diff --git a/backup_2026-09-14/code/baseline/SPEC.md b/backup_2026-09-14/code/baseline/SPEC.md new file mode 100644 index 0000000000000000000000000000000000000000..534d2ef929813613767f62b414677f7c6775b016 --- /dev/null +++ b/backup_2026-09-14/code/baseline/SPEC.md @@ -0,0 +1,88 @@ +# Baseline 动作臂契约(五臂公平消融) + +主实验:同一个 Wan2.2-TI2V-5B、同一份数据、同一套训练配方,**唯一自由变量是动作以什么方式进模型**: + +| 臂 | 代表作 | 机制(要按上游代码移植,不是凭印象) | 上游代码入口 | +|---|---|---|---| +| `arope` | 本项目 | 世界坐标 RoPE + known/new 掩码,0 参数 | `actionrope/arope.py` | +| `linear` | ReactiveGWM | 每个 DiT block 一个线性层,把动作映射成 hidden 上的偏置 | `vender/ReactiveGWM/inference/models/dit.py`、`training/data/action_utils.py`、`inference/utils/actions.py` | +| `xattn` | Matrix-Game 3 | 键盘/动作 token 与视频 token 沿时间轴做 cross-attention(前若干 block) | `vender/Matrix-Game/Matrix-Game-3/wan/modules/action_module.py`、`model.py`、`utils/conditions.py` | +| `prompt` | Incantation | 动作走文本,逐 latent(逐 cell)的 prompt 控制 | `vender/Incantation/modules/causal_model.py`、`inference.py`、`prompts/` | +| `adaln` | AlayaWorld | 动作嵌入进 adaLN 调制(与时间步嵌入同路) | `vender/AlayaWorld/alaya/control/action.py`、`alaya/model/components.py`、`ltx2/modules/model.py`、`timestep_embedding.py` | + +旧报告的口径(要对齐):四臂全部从零起训、同数据同 seed;**带动作的臂收到完全相同的控制信号(逐 cell 累计偏移)**; +文本一律剥除动作词(prompt 臂除外——文本就是它的通道)。Linear 移植自 ReactiveGWM 官方实现(30 个逐块线性偏置,+0.18M), +Cross-Attn 复刻 Matrix-Game 3.0 键盘通路(前 15 块时间轴交叉注意力,+98.6M)。 + +## 钩子接口(`actionrope/arope.py::arope_forward(..., arm=, action_inputs=)`) + +`arm` 是一个 `nn.Module`(`baseline/base.py::ActionArm` 的子类),`arope_forward` 在固定位置调用它; +`arm=None` 时 `arope_forward` 与原实现逐位相同。调用顺序与形状: + +```python +grid = dict(b, f=21, h=15, w=26, n_tok_per_frame=390) # token 网格 +feats = arm.encode(action_inputs, grid) # 一次;返回任意张量/tuple(建议 [b, f, d]),会作为张量参数穿过梯度检查点 +t_mod = arm.modify_t_mod(t_mod, feats, grid) # t_mod: [b, S, 6, dim](逐 token,S = f·h·w;帧 0 的 t 已置 0) +context = arm.extra_context(context, feats, grid) # 文本 context: [b, L, dim] 或 [(b f), L, dim](逐 cell) +x = arm.after_patch(x, feats, grid) # x: [b, S, dim],patch embedding 之后、blocks 之前 +for i, block in enumerate(dit.blocks): # 每个 block 内部(在梯度检查点里): + x = arm.block_pre(i, x, feats, grid) # block 入口 + ... self_attn ... + x = arm.block_mid(i, x, feats, grid) # 自注意力之后、文本 cross-attn 之前 + ... cross_attn ... + x = arm.block_pre_ffn(i, x, feats, grid) # 文本 cross-attn 之后、FFN 之前(Matrix-Game 3 的注入位置) + ... ffn ... + x = arm.block_post(i, x, feats, grid) # block 出口 +``` + +token 排列是 `(f h w)`:token 序号 `s = f_idx * 390 + i_h * 26 + j_w`,所以 `[b, S, dim] → [b, f, h*w, dim]` 用 `x.view(b, f, -1, dim)`。 + +`ActionArm` 基类(`baseline/base.py`)所有钩子默认恒等、`encode` 默认返回 None;子类只覆盖自己用到的。 +基类还提供:`install(dit)`(默认空;需要读 dit.dim / num_heads / 层数时用),`n_new_params()`,`zero_init_check()`。 + +### 动作输入 `action_inputs`(dataset 统一提供,臂自己选用) + +```python +{ + "offset_px": float32 [b, 21, 2], # 逐 cell 累计玩家屏幕投影位移 (dx, dy) px,cell 0 = 0;与 ARoPE 同一个信号(sidecar) + "offset_tok": float32 [b, 21, 2], # = offset_px / 32 + "delta_tok": float32 [b, 21, 2], # 逐 cell 增量 = offset_tok[k] − offset_tok[k−1],cell 0 = 0(速度) + "action_idx": int64 [b, 21], # 9 类离散标签(0 idle,1 up … 按 prompts.ACTIONS),已翻回真实屏幕方向 +} +``` + +**主信号是 `offset_px` / `offset_tok`(累计偏移),与旧报告一致。** 上游代码用离散按键的(Matrix-Game 键盘) +按其原样用 `action_idx`(one-hot / embedding),并在 docstring 里写明;若上游同时接受连续量(鼠标/相机), +连续量用 `delta_tok`。每个臂在 `baseline/.py` 顶部 docstring 写清:上游是怎么做的(文件:行)、这里怎么对应、 +用了哪个信号、新增参数量、初始化方式(**新增路径必须零初始化或等效地保证"装上瞬间输出与原模型相同"**)。 + +### 文本 + +`linear` / `xattn` / `adaln` / `arope`:`text_mode=scene`(动作词剥离,`text_table_actionrope.pt`)。 +`prompt`:`text_mode=scene_action`(动作词翻回真实方向,`text_table_eybx_mirror.pt`),逐 cell 文本已经是 +`arope_forward` 的原生能力(每帧 token 只 attend 自己 cell 的文本)。Incantation 若有别的逐 latent 做法 +(例如逐帧 prompt 掩码、专门的 attention),按上游移植并说明差异。 + +### 训练 / 推理接入(integration 阶段做,臂的作者不要改这些文件) + +* `actionrope/train.py --arm {arope,plain,linear,xattn,prompt,adaln}`:`plain` 保留(= prompt 臂的旧名,行为不变); + 新臂:`install_arope(dit, mask_channel=False)`(普通 RoPE、无 mask、权重全 1)+ `arm = baseline.build_arm(name, dit)`, + arm 的参数与 DiT 一起训练(同 lr);ckpt 导出时 arm 参数以 `arm.` 前缀一起写进 safetensors;config.json 记 arm 名与新增参数量。 +* `actionrope/infer.py --arm `:按 ckpt 元数据/键集自动装 arm;动作脚本 → `action_inputs`(`offset_px` 同 ARoPE; + `action_idx` 由每 cell 速度方向得到,同 `velocity_to_label(mirror=False)`)。 +* `baseline/__init__.py::build_arm(name, dit) -> ActionArm`、`ARMS = {...}`。 + +### 测试(每个臂 `tests/test_arm_.py`,单卡,模型只加载一次) + +1. 装上后 **输出与原模型逐位相同**(零初始化)——`arope_forward(arm=arm)` vs `arope_forward()`。 +2. 给非零动作、把新增参数随机扰动后输出**有变化**且梯度能回到新增参数与 DiT(`use_gradient_checkpointing=True`)。 +3. 新增参数量打印并与上游/旧报告对照(linear ≈ 0.18M,xattn ≈ 98.6M;差得远要解释)。 +4. ckpt 键集:`arm.state_dict()` 键名无冲突、可 strict 加载。 +5. 单卡 2 步真实训练 smoke(`--limit 8 --max_steps 2`)在 integration 阶段跑。 + +## 纪律 + +只在 `/opt/dlami/nvme/zhiyangdeng/ActionRoPE` 内读写;新文件只放 `baseline/`、`tests/`;`vender/` 只读(不改、不删、不跑它们的脚本、不下载它们的权重); +不改 `actionrope/*.py`(钩子已加好;确需改动写进 report 交 integration 决定);不动 data/、models/、DiffSynth-Studio/; +禁止 rm -rf、sudo、pip 卸载/升降级、杀非自己启动的进程、任何网络上传/下载(vender 已克隆好);不读凭据。 +GPU:正在跑 8 卡训练(每卡 24 GB 已用,143 GB 总),单卡前向+反向 smoke 用分配给你的那一张,跑完立刻释放。 diff --git a/backup_2026-09-14/code/baseline/__init__.py b/backup_2026-09-14/code/baseline/__init__.py new file mode 100644 index 0000000000000000000000000000000000000000..80b8983b3cec146f46e5e0e7a9ea1e13431d6604 --- /dev/null +++ b/backup_2026-09-14/code/baseline/__init__.py @@ -0,0 +1,200 @@ +"""baseline 动作臂的注册表与装配入口(baseline/SPEC.md「训练 / 推理接入」)。 + + from baseline import ARMS, build_arm + arm = build_arm("linear", dit) # 建参数 → install(dit) → 搬到 dit 的 device / dtype + +五臂里 `arope`(本项目)与 `plain`(= prompt 臂旧名)不走 ActionArm:arope 的动作在 RoPE 里, +plain 与 prompt 行为完全相同(train.py 里 plain 仍按旧路径 arm=None 跑,prompt 走 PromptArm 的零钩子, +两者前向逐位一致;保留 plain 是为了旧 ckpt / 旧脚本不改)。 + +ckpt 约定:arm 参数以 `arm.` 前缀与 DiT 权重写在同一个 safetensors 里(train.py::export_dit_weights), +safetensors metadata 里记 `arm=`;`detect_arm_from_keys` 只看键集就能判断臂名与 xattn 的结构配置, +metadata 缺失(手工拼的 ckpt)时推理仍能自动装对。 +""" +from __future__ import annotations + +import json +from typing import Iterable + +import torch + +from baseline.base import ActionArm + +# 各臂的类延迟导入:prompt.py 会把 data/code 加进 sys.path、xattn.py 依赖 einops, +# 不用某个臂时不必付这些 import 的代价,也避免一个臂坏了拖垮别的臂。 +_ARM_MODULES = { + "linear": ("baseline.linear", "LinearArm"), + "xattn": ("baseline.xattn", "XAttnArm"), + "prompt": ("baseline.prompt", "PromptArm"), + "adaln": ("baseline.adaln", "AdaLNArm"), +} +# 不走 ActionArm 的两个臂(train.py / infer.py 的 --arm 也接受它们) +NATIVE_ARMS = ("arope", "plain") +# 全部合法臂名(CLI choices 用) +ARM_NAMES = tuple(NATIVE_ARMS) + tuple(_ARM_MODULES) +# 动作走文本的臂:text_mode=scene_action(动作词翻回真实方向);其余剥动作从句 +TEXT_ARMS = ("plain", "prompt") +# ckpt 里 arm 参数的前缀 +ARM_PREFIX = "arm." + + +class _LazyArms(dict): + """ARMS[name] → 臂类;第一次取时才 import 对应模块。""" + + def __missing__(self, name): + if name not in _ARM_MODULES: + raise KeyError(f"未知动作臂 {name!r},可选 {list(_ARM_MODULES)}(arope / plain 不走 ActionArm)") + mod_name, cls_name = _ARM_MODULES[name] + import importlib + + cls = getattr(importlib.import_module(mod_name), cls_name) + self[name] = cls + return cls + + def __contains__(self, name): + return name in _ARM_MODULES + + def __iter__(self): + return iter(_ARM_MODULES) + + def __len__(self): + return len(_ARM_MODULES) + + +ARMS = _LazyArms() + + +def arm_text_mode(name: str) -> str: + """臂 → dataset 的 text_mode:动作走文本的臂保留动作从句,其余剥掉。""" + return "scene_action" if name in TEXT_ARMS else "scene" + + +def parse_arm_kwargs(spec) -> dict: + """--arm_kwargs 的 JSON 串(或已是 dict / None)→ dict。""" + if spec is None or spec == "": + return {} + if isinstance(spec, dict): + return dict(spec) + kw = json.loads(spec) + if not isinstance(kw, dict): + raise ValueError(f"--arm_kwargs 应为 JSON 对象,得到 {spec!r}") + return kw + + +def build_arm(name: str, dit, arm_kwargs: dict | str | None = None) -> ActionArm: + """按名字建臂、install(dit)、搬到 dit 的 device / dtype。arope / plain 没有 ActionArm ⇒ 返回 None。 + + install 由各臂自己按 dit.dim / 层数建参数并 .to(dit);这里再统一 .to 一次是兜底: + 某个臂的 install 若只建了参数没搬卡(例如 prompt 臂无参数),DeepSpeed 下混着 CPU 参数会炸。 + """ + if name in NATIVE_ARMS: + return None + cls = ARMS[name] + arm = cls(**parse_arm_kwargs(arm_kwargs)) + arm.install(dit) + ref = dit.patch_embedding.weight + arm.to(device=ref.device, dtype=ref.dtype) + return arm + + +# -------------------------------------------------------------------------- +# ckpt 键集 → 臂 +# -------------------------------------------------------------------------- + +def split_arm_keys(sd: dict) -> tuple[dict, dict]: + """safetensors 的 state_dict → (DiT 部分, arm 部分(已去掉 'arm.' 前缀))。""" + dit_sd, arm_sd = {}, {} + for k, v in sd.items(): + if k.startswith(ARM_PREFIX): + arm_sd[k[len(ARM_PREFIX):]] = v + else: + dit_sd[k] = v + return dit_sd, arm_sd + + +def detect_arm_from_keys(arm_keys: Iterable[str], shapes: dict | None = None) -> tuple[str | None, dict]: + """去掉前缀后的 arm 键集 → (臂名, 构造 kwargs)。没有 arm 键 ⇒ (None, {}):可能是 arope / plain / prompt,需看 metadata。 + + 各臂的键名互不重叠(linear: action_embedders.*;xattn: action_modules.*;adaln: embedder.* / proj.*), + xattn 的结构配置能从形状反推:keyboard_attn_kv.weight 的 in_features = hidden_size(128)·window_frames, + 有无 mouse_mlp.* = enable_mouse,有无 keyboard_embed.* = enable_keyboard,blocks = action_modules. 的 i 集合。 + """ + keys = list(arm_keys) + if not keys: + return None, {} + heads = {k.split(".")[0] for k in keys} + if heads == {"action_embedders"}: + return "linear", {} + if heads == {"action_modules"}: + blocks = sorted({int(k.split(".")[1]) for k in keys}) + kw: dict = {"blocks": blocks} + kw["enable_mouse"] = any(".mouse_mlp." in k for k in keys) + kw["enable_keyboard"] = any(".keyboard_embed." in k for k in keys) + if shapes is not None and kw["enable_keyboard"]: + kv_key = f"action_modules.{blocks[0]}.keyboard_attn_kv.weight" + emb_key = f"action_modules.{blocks[0]}.keyboard_embed.2.weight" + if kv_key in shapes and emb_key in shapes: + hidden = int(shapes[emb_key][0]) + kw["window_frames"] = int(shapes[kv_key][1]) // hidden + kw["hidden_size"] = hidden + elif shapes is not None and kw["enable_mouse"]: + mlp_key = f"action_modules.{blocks[0]}.mouse_mlp.0.weight" + if mlp_key in shapes: + # in_features = 2·window_frames + dim;dim 从 proj_mouse 的 out_features 拿 + proj_key = f"action_modules.{blocks[0]}.proj_mouse.weight" + dim = int(shapes[proj_key][0]) if proj_key in shapes else 3072 + kw["window_frames"] = (int(shapes[mlp_key][1]) - dim) // 2 + return "xattn", kw + if heads <= {"embedder", "proj"}: + kw = {} + if shapes is not None and "embedder.0.weight" in shapes: + n_in = int(shapes["embedder.0.weight"][1]) + # n_in = n_axes · freq_dim_per_axis;默认 freq 32 ⇒ 4 轴 128 / 2 轴 64 + kw["use_delta"] = n_in >= 4 * 32 + return "adaln", kw + raise ValueError(f"无法从 arm 键集识别臂:顶层键 {sorted(heads)}") + + +def detect_arm_from_ckpt(sd: dict, metadata: dict | None = None) -> tuple[str | None, dict]: + """(state_dict, safetensors metadata) → (臂名, 构造 kwargs)。 + + metadata 里的 arm 名优先(它能区分 arope / plain / prompt 这三个无 arm 键的臂);有 arm 键时 + 以键集反推的结构配置为准,并核对与 metadata 一致。metadata 缺失且无 arm 键 ⇒ (None, {}),由调用方决定默认。 + """ + _, arm_sd = split_arm_keys(sd) + shapes = {k: tuple(v.shape) for k, v in arm_sd.items()} + name_keys, kw = detect_arm_from_keys(arm_sd.keys(), shapes) + name_meta = (metadata or {}).get("arm") + if name_meta and name_keys and name_meta != name_keys: + raise ValueError(f"ckpt metadata 说 arm={name_meta!r},键集却是 {name_keys!r}") + if metadata and metadata.get("arm_kwargs"): + # 训练时的构造参数(JSON)比形状反推更完整(例如 heads_num) + try: + kw = {**parse_arm_kwargs(metadata["arm_kwargs"]), **kw} + except (ValueError, json.JSONDecodeError): + pass + return name_meta or name_keys, kw + + +def make_action_inputs(offset_px: torch.Tensor, action_idx: torch.Tensor | None = None) -> dict: + """offset_px [b, 21, 2] (+ action_idx [b, 21]) → SPEC 的 action_inputs dict(offset_tok / delta_tok 由此派生)。 + + dataset.py 与 infer.py 共用,保证两边 delta_tok 的定义一致(cell 0 = 0,其余为相邻 cell 之差)。 + """ + from actionrope.arope import PX_PER_TOKEN + + off_px = torch.as_tensor(offset_px, dtype=torch.float32) + off_tok = off_px / PX_PER_TOKEN + delta = torch.zeros_like(off_tok) + delta[..., 1:, :] = off_tok[..., 1:, :] - off_tok[..., :-1, :] + out = {"offset_px": off_px, "offset_tok": off_tok, "delta_tok": delta} + if action_idx is not None: + out["action_idx"] = torch.as_tensor(action_idx, dtype=torch.int64) + return out + + +__all__ = [ + "ARMS", "ARM_NAMES", "NATIVE_ARMS", "TEXT_ARMS", "ARM_PREFIX", "ActionArm", + "build_arm", "arm_text_mode", "parse_arm_kwargs", "split_arm_keys", + "detect_arm_from_keys", "detect_arm_from_ckpt", "make_action_inputs", +] diff --git a/backup_2026-09-14/code/baseline/adaln.py b/backup_2026-09-14/code/baseline/adaln.py new file mode 100644 index 0000000000000000000000000000000000000000..61e5c9a705795faf62f3ce5e43e9cd23829c8686 --- /dev/null +++ b/backup_2026-09-14/code/baseline/adaln.py @@ -0,0 +1,207 @@ +"""adaln 臂:动作嵌进 adaLN 调制(AlayaWorld 的 Action-AdaLN 移植到 Wan2.2-TI2V-5B)。 + +上游机制(vender/AlayaWorld,基座是 LTX-2.3,不是 Wan) +------------------------------------------------------ +alaya/model/loader.py:16,163 实际装的是 `ltx2/modules/model_ltx_2_3.py::LTX23Model`, +`_runtime_transformer_overrides` (loader.py:206) 把 `enable_action_control=cfg.control.uses("action")` 传进去。 +(`ltx2/modules/model.py:969-997` 的 81 类离散 `DiscreteActionEmbedder` 是 LTX-2 旧路径,训练/推理都不走它。) + +1. 动作编码(连续 6 维、逐 latent 帧) + * `alaya/control/action.py:78-115 c2w_to_adaln_action_vectors`:相机 c2w 按 latent 步长(8 帧)抽样, + 相邻两个 latent 的相对位姿 `inv(c2w[i-1]) @ c2w[i]` → 平移 xyz + 欧拉角 xyz,共 6 维;latent 0 没有前驱 ⇒ 0。 + **这是逐 latent 的速度(增量),不是累计位移。** 每轴再除以 `control.action_scale` + (schema.py:210,默认 "0.14,0.075,0.22,0.17,0.70,0.16")把量级归一到 ~[-1, 1]。 + * `model_ltx_2_3.py:130-175 ActionAdaLNEmbedder`:每轴 `value * freq_scale(1000)` 做 32 维正弦编码 + (schema.py:211-212 `action_freq_scale=1000, action_freq_dim_per_axis=32`;频率 10000^(-i/16),[cos, sin]), + 6 轴拼成 192 维 → `Linear(192, dim) → SiLU → Linear(dim, dim)` ⇒ `a` [B, T, dim]。 +2. 进 adaLN(与时间步嵌入同路,逐帧广播到该帧所有 token) + * `model_ltx_2_3.py:782-786`:`action_adaln_projection = Sequential(SiLU, Linear(dim, 6*dim))`, + 与 `AdaLayerNormSingle.linear`(timestep_embedding.py:120-127:`linear(silu(embedded_timestep))`)同构。 + * `model_ltx_2_3.py:1171-1176, 1252-1253`:`a0 = projection(a)`,`a`/`a0` 按 `tokens_per_frame` repeat_interleave + 到逐 token,然后 `timestep_emb += a0`([B, N, 6*dim],所有 block 共用的 shift/scale/gate 六元组), + `embedded_timestep += a`([B, N, dim],只给输出头 `_process_output` 的 shift/scale 用,model_ltx_2_3.py:829-840)。 + block 内 `get_ada_values` (547-555) = `scale_shift_table + timestep_emb` 切 6 段——与 Wan 的 + `block.modulation + t_mod` 完全同构。条件(clean)帧的 token 也照加自己的动作(1153-1156 注释)。 + * 不是每层一套:只有一套 embedder + 一套 projection,30 层共用(同时间步嵌入一样)。 +3. 初始化:`model_ltx_2_3.py:785-786` 最后一层 `Linear(dim, 6*dim)` 权重 normal(std=1e-3)、偏置 0("近零"); + embedder MLP 用 PyTorch 默认初始化。 + +本实现的对应关系 +---------------- +Wan 的时间步路径(arope.py::arope_forward):`t = time_embedding(sinusoid(t_tok))` [b, S, dim], +`t_mod = time_projection(t)` = `Linear(SiLU(t))` 展成 [b, S, 6, dim],每个 block `modulation + t_mod` 切 6 段。 +所以上游 `timestep_emb += a0` 一一对应到钩子 `modify_t_mod`: + + a = embedder(actions) [b, f, dim] (同上游 ActionAdaLNEmbedder,轴数改为 4) + a0 = proj(a) = Linear(SiLU(a)) [b, f, 6, dim] (同上游 action_adaln_projection) + t_mod[b, s, :, :] += a0[b, frame(s)] (帧 k 的 390 个 token 共用一份;token 排列 (f h w)) + +* 未移植的部分:上游还把 `a` 加进输出头的 `embedded_timestep`。Wan 的 `dit.head(x, t)` 用的 `t` 没有钩子可改 + (SPEC 只给了 `modify_t_mod`),且那只是最后一个 LayerNorm 的 shift/scale,30 层 × 6 元组的主路径已完整,故省略; + 若 integration 想补,只需在 arope_forward 里对 `t` 也加一条钩子。 +* 帧 0 是条件帧:数据集保证 `offset_tok[:, 0] = delta_tok[:, 0] = 0`,与上游 latent 0 的零向量一致; + 和上游一样,零向量也照走 embedder(得到一个常量"静止"嵌入),不额外屏蔽——上游对 clean 条件 token 也加动作。 +* 帧数不等于 21 时按上游做线性插值到 f(`F.interpolate(mode='linear', align_corners=True)`)。 + +信号 +---- +上游用的是逐 latent 速度(相对位姿),本项目的主信号是累计偏移 `offset_tok`(SPEC:与 ARoPE 同一个信号)。 +按 SPEC 的约定两者都给:动作向量 = `[offset_tok(dx, dy), delta_tok(dx, dy)]` 共 4 轴,每轴各做 32 维正弦编码 +(4 × 32 = 128 维进 MLP)。每轴的归一化尺度 `ACTION_SCALE_TOK` 相当于上游的 `action_scale`, +取自 sidecar 实测(3000 个 valid clip):|offset_tok| 的 p99 ≈ (9.5, 6.4),|delta_tok| 的 p99 ≈ (0.59, 0.44), +取整为 (10, 6.5, 0.6, 0.45),归一后 ~[-1, 1],再乘 freq_scale=1000 落到与时间步同量级(正弦编码分辨得开)。 +上游把动作先转成模型 dtype(bf16)再编码,这里正弦编码用 float32/float64 算完再转 bf16 进 MLP—— +bf16 只有 3 位有效数字,累计偏移 10 token 会被量化到 0.06 token,没必要丢这个精度。 + +参数量(dim=3072) +----------------- +embedder: Linear(128→3072) 396,288 + Linear(3072→3072) 9,440,256 = 9,836,544 +proj: Linear(3072→18432) 56,641,536 +合计 66,478,080 ≈ 66.5M(上游 LTX-2.3 inner_dim=4096、6 轴时约 118M;旧报告 linear +0.18M、xattn +98.6M)。 + +初始化 +------ +上游最后一层是 std=1e-3 的"近零",装上会有 ~1e-3 量级的扰动。SPEC 要求装上瞬间输出与原模型逐位相同, +所以这里把 `proj` 的最后一层 Linear 权重和偏置都置 0(`t_mod + 0` 在 bf16 下逐位不变); +embedder 保持 PyTorch 默认初始化,与上游一致。第一步只有 proj 的权重有非零梯度,之后 embedder 才跟着动。 +""" +from __future__ import annotations + + +import torch +import torch.nn as nn +import torch.nn.functional as F + +from baseline.base import ActionArm + +# 动作向量的轴顺序:[offset_dx, offset_dy, delta_dx, delta_dy],单位 token +ACTION_AXES = ("offset_dx", "offset_dy", "delta_dx", "delta_dy") +# 每轴归一化尺度(上游 action_scale 的对应物),sidecar 实测 p99 取整,见模块 docstring +ACTION_SCALE_TOK = (10.0, 6.5, 0.6, 0.45) +# 上游默认:schema.py:211-212 +FREQ_SCALE = 1000.0 +FREQ_DIM_PER_AXIS = 32 + + +def sinusoidal_per_axis(position: torch.Tensor, dim: int) -> torch.Tensor: + """照抄 model_ltx_2_3.py:151-160 `ActionAdaLNEmbedder._sinusoidal_embedding`: + [..., ] 位置 → [..., dim],频率 10000^(-i/(dim//2)),输出顺序 [cos, sin],float64 算完转回输入 dtype。""" + orig_shape = position.shape + pos_flat = position.reshape(-1).to(torch.float64) + freqs = torch.pow( + 10000, + -torch.arange(dim // 2, dtype=torch.float64, device=position.device).div(max(dim // 2, 1)), + ) + sinusoid = torch.outer(pos_flat, freqs) + emb = torch.cat([torch.cos(sinusoid), torch.sin(sinusoid)], dim=-1) + return emb.view(*orig_shape, dim).to(position.dtype) + + +class AdaLNArm(ActionArm): + """AlayaWorld 式 Action-AdaLN:一套 embedder + 一套 6·dim 投影,加到逐 token 的 t_mod 上,30 层共用。""" + + name = "adaln" + + def __init__( + self, + freq_dim_per_axis: int = FREQ_DIM_PER_AXIS, + freq_scale: float = FREQ_SCALE, + action_scale: tuple[float, ...] = ACTION_SCALE_TOK, + use_delta: bool = True, + ): + super().__init__() + self.freq_dim_per_axis = int(freq_dim_per_axis) + self.freq_scale = float(freq_scale) + self.use_delta = bool(use_delta) + n_axes = 4 if self.use_delta else 2 + assert len(action_scale) >= n_axes, f"action_scale 至少要 {n_axes} 个值" + # 用 buffer 存尺度:随模块 .to() 走,不进 state_dict(persistent=False),ckpt 键集只有权重 + self.register_buffer("action_scale", torch.tensor(action_scale[:n_axes], dtype=torch.float32), persistent=False) + self.n_axes = n_axes + self.dim: int | None = None + # 真正的参数在 install(dit) 里按 dit.dim 建 + self.embedder: nn.Sequential | None = None + self.proj: nn.Sequential | None = None + + # ---- 建参数 ---- + def install(self, dit) -> None: + """按 dit.dim 建 embedder / proj,放到 dit 的 device / dtype 上,proj 末层零初始化。""" + dim = int(dit.dim) + ref = dit.time_projection[-1].weight # Wan 的 Linear(dim, 6*dim),拿它的 device / dtype + self.dim = dim + # 同上游 ActionAdaLNEmbedder.mlp:Linear(n_axes*freq, dim) → SiLU → Linear(dim, dim),默认初始化 + self.embedder = nn.Sequential( + nn.Linear(self.n_axes * self.freq_dim_per_axis, dim), + nn.SiLU(), + nn.Linear(dim, dim), + ) + # 同上游 action_adaln_projection:SiLU → Linear(dim, 6*dim);上游 std=1e-3,这里置 0 保证装上不改输出 + self.proj = nn.Sequential(nn.SiLU(), nn.Linear(dim, 6 * dim, bias=True)) + nn.init.zeros_(self.proj[-1].weight) + nn.init.zeros_(self.proj[-1].bias) + self.to(device=ref.device, dtype=ref.dtype) + + # ---- 动作 → 向量 ---- + def action_vectors(self, action_inputs: dict, grid: dict) -> torch.Tensor: + """action_inputs → 归一化后的 [b, f, n_axes] float32(单位 token / 尺度)。 + + delta_tok 缺省时由 offset_tok 差分得到(定义同 SPEC:cell 0 = 0)。帧数不等于 grid['f'] 时按上游线性插值。 + """ + offset = torch.as_tensor(action_inputs["offset_tok"], dtype=torch.float32) + assert offset.dim() == 3 and offset.shape[-1] == 2, f"offset_tok 应为 [b, f, 2],得到 {tuple(offset.shape)}" + parts = [offset] + if self.use_delta: + if action_inputs.get("delta_tok") is not None: + delta = torch.as_tensor(action_inputs["delta_tok"], dtype=torch.float32, device=offset.device) + else: + delta = torch.zeros_like(offset) + delta[:, 1:] = offset[:, 1:] - offset[:, :-1] + parts.append(delta) + vec = torch.cat(parts, dim=-1) # [b, f_in, n_axes] + f = int(grid["f"]) + if vec.shape[1] != f: + # 同 model_ltx_2_3.py:1164-1168:帧数不匹配就沿时间轴线性插值 + vec = F.interpolate(vec.permute(0, 2, 1), size=f, mode="linear", align_corners=True).permute(0, 2, 1) + return vec / self.action_scale.to(vec.device) + + # ---- 钩子 ---- + def encode(self, action_inputs: dict | None, grid: dict): + """动作 → a0 [b, f, 6, dim](模型 dtype),只算一次;没有动作输入 ⇒ None(钩子全部恒等)。""" + if action_inputs is None or self.proj is None: + return None + w = self.embedder[0].weight + vec = self.action_vectors(action_inputs, grid).to(w.device) # [b, f, n_axes] float32 + # 逐轴正弦编码(× freq_scale 落到时间步量级),拼成 [b, f, n_axes*freq_dim] + emb = torch.cat( + [sinusoidal_per_axis(vec[..., k] * self.freq_scale, self.freq_dim_per_axis) for k in range(self.n_axes)], + dim=-1, + ) + a = self.embedder(emb.to(w.dtype)) # [b, f, dim] + a0 = self.proj(a) # [b, f, 6*dim] + return a0.unflatten(-1, (6, self.dim)) + + def modify_t_mod(self, t_mod: torch.Tensor, feats, grid: dict) -> torch.Tensor: + """t_mod [b, S, 6, dim] += a0 按帧广播(帧 k 的 n_tok_per_frame 个 token 共用一份)。""" + if feats is None: + return t_mod + b, s = t_mod.shape[:2] + f, n = int(grid["f"]), int(grid["n_tok_per_frame"]) + assert s == f * n, f"S={s} 与 f*n_tok_per_frame={f * n} 不符" + assert feats.shape[0] in (1, b) and feats.shape[1] == f, f"feats 形状 {tuple(feats.shape)} 与 grid 不符" + # token 排列 (f h w):[b, f, 1, 6, dim] 广播到 [b, f, n, 6, dim] 再摊平成 S + add = feats.unsqueeze(2).expand(feats.shape[0], f, n, 6, self.dim).reshape(feats.shape[0], s, 6, self.dim) + return t_mod + add.to(dtype=t_mod.dtype, device=t_mod.device) + + # ---- 工具 ---- + def zero_init_check(self) -> bool: + """proj 末层全零 ⇒ a0 ≡ 0 ⇒ t_mod 不变。""" + if self.proj is None: + return False + lin = self.proj[-1] + return bool((lin.weight == 0).all() and (lin.bias == 0).all()) + + @staticmethod + def expected_n_params(dim: int, n_axes: int = 4, freq_dim_per_axis: int = FREQ_DIM_PER_AXIS) -> int: + """按结构算的参数量,测试用来对照 n_new_params()。""" + n_in = n_axes * freq_dim_per_axis + return (n_in * dim + dim) + (dim * dim + dim) + (dim * 6 * dim + 6 * dim) diff --git a/backup_2026-09-14/code/baseline/base.py b/backup_2026-09-14/code/baseline/base.py new file mode 100644 index 0000000000000000000000000000000000000000..af5c77f9e129a1683c5848eb13456f86098576a3 --- /dev/null +++ b/backup_2026-09-14/code/baseline/base.py @@ -0,0 +1,51 @@ +"""动作臂基类:baseline/SPEC.md 里钩子接口的默认实现(全部恒等)。 + +各 baseline(linear / xattn / prompt / adaln)继承它,只覆盖自己用到的钩子。 +`arope_forward(arm=None)` 时一个钩子都不会被调用,所以基类本身不影响 ARoPE 臂。 +""" +from __future__ import annotations + +import torch +import torch.nn as nn + + +class ActionArm(nn.Module): + name = "base" + + def install(self, dit) -> None: + """需要按 dit 的 dim / num_heads / 层数建参数时在这里做(build_arm 会调用一次)。""" + + # ---- 钩子:签名固定,见 baseline/SPEC.md ---- + def encode(self, action_inputs: dict | None, grid: dict): + """动作输入 → 特征(任意张量或 tuple),只算一次;None 表示这个臂不需要。""" + return None + + def modify_t_mod(self, t_mod: torch.Tensor, feats, grid: dict) -> torch.Tensor: + return t_mod + + def extra_context(self, context: torch.Tensor, feats, grid: dict) -> torch.Tensor: + return context + + def after_patch(self, x: torch.Tensor, feats, grid: dict) -> torch.Tensor: + return x + + def block_pre(self, idx: int, x: torch.Tensor, feats, grid: dict) -> torch.Tensor: + return x + + def block_mid(self, idx: int, x: torch.Tensor, feats, grid: dict) -> torch.Tensor: + return x + + def block_pre_ffn(self, idx: int, x: torch.Tensor, feats, grid: dict) -> torch.Tensor: + """文本 cross-attn 之后、FFN 之前。""" + return x + + def block_post(self, idx: int, x: torch.Tensor, feats, grid: dict) -> torch.Tensor: + return x + + # ---- 工具 ---- + def n_new_params(self) -> int: + return sum(p.numel() for p in self.parameters()) + + def zero_init_check(self) -> bool: + """"装上瞬间不改变输出"的粗检:至少有一条通向残差流的路径是零。子类按自己的结构覆盖。""" + return True diff --git a/backup_2026-09-14/code/baseline/linear.py b/backup_2026-09-14/code/baseline/linear.py new file mode 100644 index 0000000000000000000000000000000000000000..b21637ea8c79650e37312b0ca591e46193b0f6f0 --- /dev/null +++ b/backup_2026-09-14/code/baseline/linear.py @@ -0,0 +1,97 @@ +"""`linear` 臂:ReactiveGWM 的逐块线性动作偏置(30 个 bias-free Linear,加在每个 DiT block 入口)。 + +上游机制(vender/ReactiveGWM,只读) +----------------------------------- +* 模型 `inference/models/dit.py::WanModelAction`(同一个 Wan2.2-TI2V-5B 基座,dim 3072 / 30 层): + - L207-209 `self.action_embedders = nn.ModuleList([nn.Linear(num_buttons, dim, bias=False) for _ in range(num_layers)])` + —— 每个 block 一个 **无偏置** 线性层,把动作向量投到 hidden 维;没有门控(docstring:"No gates")。 + - L222-226 `_bin_action`:原始逐帧键盘 one-hot `[B, T_raw, K]` 用 `adaptive_max_pool1d` 压到 latent 帧数 `[B, f, K]` + (每个 latent 帧 = 4 个视频帧的"按过即 1")。 + - L228-234 `_inject_action`:`emb = action_embedders[i](action[B,f,K].to(x.dtype))` → `[B, f, C]`, + 沿 h·w 展开成逐 token 偏置 `[B, f·h·w, C]`,`x = x + bias`。 + - L284-286 前向:`for i, block: x = _inject_action(x, action, i, f, h, w); x = block(x, ctx, t_mod, freqs)` + —— 偏置加在 **block 入口的残差流**(进 norm1/self-attn 之前),不是 adaLN、不是 cross-attn。 +* 动作向量 `training/data/action_utils.py` / `inference/utils/actions.py`:parquet 的 10 个按键列 + (`inference/constants.py::SF_BUTTON_COLS`,UP/DOWN/LEFT/RIGHT + 6 攻击键)0/1 值,`hold_last_upsample`(10 帧窗) + 补成逐视频帧 dense one-hot,不做归一化。 +* 初始化:`training/bidirectional/train.py` L17-18 / L134-137:"ActionModule keys stay at their default (zero / xavier) init", + 其余权重从 Wan2.2-TI2V-5B 按形状拷贝(`_transfer_weights`)。训练时 action_embedders 与 DiT 全参数同 lr 训练; + 推理有 `action_cfg_scale`(`inference/pipeline.py` L218-224,动作置零做无动作分支)。 +* 上游参数量:30 × 10 × 3072 = 921,600(10 键)。 + +本实现的对应(baseline/SPEC.md 的钩子) +-------------------------------------- +* `encode`:取 `action_inputs["offset_tok"]`(float32 `[b, 21, 2]`,逐 cell 累计屏幕位移 (dx, dy),单位 token, + 与 ARoPE 臂**完全相同的控制信号**——旧报告口径"带动作的臂收到相同的逐 cell 累计偏移")。 + 上游的"逐帧 one-hot → adaptive_max_pool 到 f 个 latent 帧"这一步,在我们这边由 sidecar 的 + `frames_to_cells`(cell 内逐帧偏移取均值)已经做完,dataset 直接给逐 cell 的 `[b, 21, 2]`, + 所以这里不再池化,只做形状校验。不归一化(上游也不归一化;零初始化下量纲只影响学习动态,不影响装上瞬间的等价性)。 + cell 0 的偏移恒为 0 ⇒ 无偏置 Linear 在条件帧上的偏置恒为 0,与"首帧是干净条件帧"一致。 +* `block_pre(i, x)`:`x + expand(action_embedders[i](offset_tok))`,与上游 `_inject_action` 同位置同算式。 + 小矩阵乘在 fp32 里算再转回 x.dtype:offset_tok 最大约 ±11 token,bf16 在该量级的分辨率是 1/16 token = 2 px, + fp32 保住亚像素信息;上游输入是 0/1 one-hot,bf16 本来就无损,所以它直接 `.to(x.dtype)`。 +* 参数量:30 × 2 × 3072 = **184,320 ≈ 0.18M**(与旧报告 +0.18M 一致:旧报告就是 2 维偏移输入)。 +* 初始化:**全零**(SPEC 要求"装上瞬间输出与原模型逐位相同";上游 docstring 也把 zero 列为默认之一)。 + 零权重 ⇒ 偏置张量逐位为 0 ⇒ `x + 0 == x` 逐位相等。 +* ckpt 键:`action_embedders.{i}.weight`(与上游键布局同名;integration 阶段导出时加 `arm.` 前缀,与 DiT 键无冲突)。 +""" +from __future__ import annotations + +import torch +import torch.nn as nn +import torch.nn.functional as F + +from baseline.base import ActionArm + +# 上游 SF_BUTTON_COLS 是 10 维 one-hot;这里换成 SPEC 的 (dx, dy) 累计偏移,2 维 +ACTION_DIM = 2 + + +class LinearArm(ActionArm): + name = "linear" + + def __init__(self, dim: int = 3072, num_layers: int = 30, in_dim: int = ACTION_DIM): + super().__init__() + self.dim, self.num_layers, self.in_dim = dim, num_layers, in_dim + self.action_embedders = self._build(dim, num_layers, in_dim) + + @staticmethod + def _build(dim: int, num_layers: int, in_dim: int) -> nn.ModuleList: + # 与上游 dit.py L207-209 同构:每层一个 bias-free Linear;权重零初始化(见模块 docstring) + embedders = nn.ModuleList([nn.Linear(in_dim, dim, bias=False) for _ in range(num_layers)]) + for lin in embedders: + nn.init.zeros_(lin.weight) + return embedders + + def install(self, dit) -> None: + """按 dit 的 dim / 层数建参数,并放到 dit 的 device / dtype(与 DiT 一起以 bf16 训练)。""" + dim, num_layers = int(dit.dim), len(dit.blocks) + if (dim, num_layers) != (self.dim, self.num_layers): + self.dim, self.num_layers = dim, num_layers + self.action_embedders = self._build(dim, num_layers, self.in_dim) + ref = dit.patch_embedding.weight + self.to(device=ref.device, dtype=ref.dtype) + + # ---- 钩子 ---- + def encode(self, action_inputs: dict | None, grid: dict): + """offset_tok [b, f, 2] → 同一张量(float32)。None ⇒ 不注入(对应上游 keyboard_action=None 的分支)。""" + if action_inputs is None: + return None + off = action_inputs["offset_tok"] + b, f = grid["b"], grid["f"] + assert off.shape == (b, f, self.in_dim), f"offset_tok 形状应为 [{b}, {f}, {self.in_dim}],得到 {tuple(off.shape)}" + return off.to(torch.float32) + + def block_pre(self, idx: int, x: torch.Tensor, feats, grid: dict) -> torch.Tensor: + """上游 `_inject_action`:逐帧线性偏置沿帧内 h·w 个 token 广播后加到残差流。""" + if feats is None: + return x + b, f, n = grid["b"], grid["f"], grid["n_tok_per_frame"] + weight = self.action_embedders[idx].weight + emb = F.linear(feats.to(device=x.device), weight.to(torch.float32)).to(x.dtype) # [b, f, C] + bias = emb.unsqueeze(2).expand(b, f, n, self.dim).reshape(b, f * n, self.dim) + return x + bias + + # ---- 工具 ---- + def zero_init_check(self) -> bool: + return all(bool((lin.weight == 0).all()) for lin in self.action_embedders) diff --git a/backup_2026-09-14/code/baseline/prompt.py b/backup_2026-09-14/code/baseline/prompt.py new file mode 100644 index 0000000000000000000000000000000000000000..d02c9ee6b9639632339dd26e0a85b23c5d73edb0 --- /dev/null +++ b/backup_2026-09-14/code/baseline/prompt.py @@ -0,0 +1,267 @@ +"""Prompt 臂(Incantation 移植):动作走文本,逐 latent 帧(逐 cell)的 prompt 控制。零新增参数、零钩子。 + +上游机制(vender/Incantation,只读) +-------------------------------------- +Incantation 的动作接口**纯粹是自然语言**,模型里没有任何动作专用模块: + +* 模型结构 `modules/causal_model.py`:`CausalWanModel` 与 Wan2.2-TI2V-5B 的 `WanModel` 参数名逐一对应 + (:9 "Weight-compatible with WanModel"、:47-48、:238、:284-286、:386-389),子模块只有 + patch_embedding / text_embedding / time_embedding / time_projection / blocks / head(:434-450), + 没有 action embedding、action cross-attn、adaLN 动作支路。`modules/attention.py` 只有注意力后端、 + RoPE、Norm,同样没有动作模块。它与教师的唯一差异是自注意力改成分块因果 + KV cache(:93-133、:135-224), + 那是流式生成的效率设计,不是动作通路。 +* 动作 → 文本 `inference.py:76-159 PromptGenerator`:动作脚本(`"Move forward"` 或 `["Move forward", 秒]`) + 按 `TIME_STEP = 0.25 s`(:85)展开成时间线,每个 latent 帧一条 prompt: + `_steps = max(1, round(duration / 0.25))`(:133-134),没给时长的用 `DURATION_MAP`(:87-131,缺省 1.0 s); + 两个实体的时间线取最长者、短的用最后一个动作补齐(:152-154);模板 + `f"person_1 performs {p}. boss_1 performs {b}."`(:157)。0.25 s = 16 fps 下 4 帧 = 恰好 1 个 latent 帧, + 与本项目"cell k = 帧 4k−3…4k"的粒度完全一致。 +* 文本编码 `inference.py:247-260 encode_prompts`:每条**唯一**串过一次 UMT5 得 [512, 4096](去重,:250-258), + 再按帧展开成 list(:259)。 +* 逐帧对齐 `inference.py:318-353 generate`:第 fi 个 latent 帧用 `prompt_embeds_list[pi]` 做 context(:320-321), + 每帧开始把 `crossattn_cache["is_init"]` 清掉(:323-324)重新算该帧文本的 k/v。也就是说**每帧 token 只 + cross-attend 自己那帧的文本**——没有 attention mask 拼接,也没有跨帧的文本序列;逐帧对齐靠"一次只生成一帧"实现。 +* 逐帧文本掩码 `causal_model.py:340-344`(`cross_out * cross_attn_mask`)+ :673-686 / :760-772 + (`frame_mask = (t > 0)`):只有噪声帧(t > 0)收文本,干净帧(t = 0,含写 KV cache 的那一遍)不收, + 注释说明是为了"文本信息不泄漏进自注意力 KV cache"(:760-764)。 +* 已发布的训练前向 `causal_model.py:589-712 _forward_train` 收的 context 是**每个样本一条**(:650-655), + 并不逐帧;逐帧文本只在流式推理里出现。训练配方(Self-Forcing 式蒸馏、逐帧 rollout)未开源 + (README "Release Status")。 + +本实现的对应关系 +---------------- +本仓库 `arope_forward` 原生支持逐 cell 文本(`actionrope/arope.py::_embed_context / _block_forward`: +context `[b, f, L, 4096]` ⇒ q 重排成 `(b f) (h w) c`,k/v 为 `(b f) L c`,每帧 token 只 attend 自己 cell 的文本; +唯一串只算一次 text_embedding,`context_ids` 去重),这正是 Incantation "逐 latent 帧一条 prompt、每帧只看自己 +文本" 的双向并行版本。所以这个臂**不需要任何钩子**(全部继承基类的恒等实现),只声明它要的数据契约: + +* `text_mode = "scene_action"`:数据集不剥动作从句,动作词按 `prompts.mirror_action` 翻回真实屏幕方向 + (`text_table_eybx_mirror.pt`)。这就是它的动作通道。 +* `per_cell_context = True`:context 必须是 `[b, f, 512, 4096]`(dataset 默认如此)。`extra_context` 里做核对, + 拿到整条 context 直接报错,避免"以为逐 cell 其实整条"的静默错误(`require_per_cell=False` 可放行)。 +* `uses_offset_px = False`:`arope_forward(offset_px=None)`(普通 RoPE)、无 mask 通道、loss 权重全 1。 + `action_inputs` 里的 `offset_px / offset_tok / delta_tok / action_idx` 一个都不用——Incantation 也没有任何 + 非文本的动作输入;`action_idx` 的信息已经以动作从句的形式在文本里(infer 侧由 `velocity_to_label(mirror=False)` + 得到同一个标签再拼进 prompt)。 + +一致处 / 差异处(逐条) +---------------------- +1. [一致] 动作只走文本,模型零改动、零新增参数(Incantation 的 student 与教师权重同构)。 +2. [一致] 粒度:1 条 prompt / 1 个 latent 帧(0.25 s = 4 视频帧)= 本项目的 1 个 cell。 +3. [一致] 逐帧对齐方式:每帧 token 只 cross-attend 自己那帧的文本 k/v,不是把各帧文本拼成长序列, + 也不是 attention mask。Incantation 靠逐帧流式生成天然实现,这里靠 `(b f)` 分组的 cross-attn 并行实现; + 所有 cell 文本相同时两者都退化成整条条件。 +4. [一致] 文本编码去重:唯一串只编码一次(`encode_prompts` ↔ `_embed_context` + `context_ids`)。 +5. [一致] 时间线展开规则:`round(秒 / 0.25)` 个 cell,缺省时长 1.0 s,脚本短于视频用最后一个动作补齐 + (见下面 `script_to_timeline`)。 +6. [差异] prompt 模板:Incantation 是多实体槽位 `person_1 performs {p}. boss_1 performs {b}.`,不含场景 + (场景由首帧给);本数据集是单实体 + 场景从句 `In a 2.5D top down view, {scene}, the player is {action}.` + (`data/code/scenes.py::PROMPT_TMPL`)。不能换成 Incantation 模板:模型在本数据集模板上训练、推理时 + 查的是预计算文本表(不挂 T5),且转场语料要求场景从句逐 cell 变化。动作词表也不同 + (Incantation 是 Elden Ring 的 11 个玩家动作 + 31 个 boss 动作;这里是 9 个方向标签)。 +7. [差异,未复刻] `cross_attn_mask = (t > 0)`:Incantation 的干净帧不收文本。本实现里帧 0(TI2V 条件帧,t=0) + 照常 cross-attend cell 0 的文本。原因:(a) 它是因果 student 的 KV-cache 设计(防文本泄漏进 cache), + 不是动作接口本身;本模型双向、无 cache,不存在泄漏问题;(b) 钩子接口里 cross-attn 输出没有单独的 + 挂点(`block_mid` 在 cross-attn 之前、`block_post` 在 ffn 之后),且 `cross_attn.o` 带 bias,无法靠构造 + context 让输出恰为 0,精确复刻要改 `actionrope/arope.py`(加一个逐帧 cross-attn 掩码参数); + (c) 复刻会让"装上瞬间输出与原模型相同"不成立,并且与其它四臂(帧 0 都 attend 场景文本)不对等。 + 若 integration 决定要它,见文末 `CROSS_ATTN_MASK_NOTE`。 +8. [差异] 自注意力:Incantation 是分块因果(帧 f 只看 ≤ f 的帧)+ KV cache 流式;本实现与其它四臂一样是 + Wan 原生的双向全注意力,一次并行出 21 个 cell。这是生成范式的差异,五臂共享,不属于动作通路。 +9. [差异] Incantation 已发布的训练前向是整条 context;本实现训练即逐 cell(与其推理一致,比其发布代码更"逐帧")。 + +信号 / 参数量 / 初始化 +--------------------- +* 信号:文本(动作从句),不读 `action_inputs`。 +* 新增参数:0(Incantation 同样为 0:其 student 的 state_dict 键集与教师一致)。 +* 初始化:无新参数,装上瞬间与原模型**逐位**相同(`arope_forward(arm=PromptArm())` 只多了一次形状核对)。 +* 旧报告口径:"Wan + Prompt" = `train.py --arm plain` 的行为,本臂与之完全相同,只是走 ActionArm 接口。 + +推理时"动作脚本 → 逐 cell prompt" +-------------------------------- +对照 `vender/Incantation/prompts/prompts.txt`(手工模式:一行一条 prompt、逐帧)与 +`examples/actions_example.json`(动作模式:`[["Move forward", 1.5], "Roll forward", ...]`),本臂建议: + +* 动作模式(推荐,与 `infer.py --actions "right:1.0:10,left:1.0:11"` 同一套速度/方向约定): + `script_to_cell_prompts(scene, [["right", 2.5], "left", ["idle", 1.0]], trigger=None)` ⇒ 21 条 + `PROMPT_TMPL` 串;`script_to_action_spec(script, mult)` ⇒ `--actions` 字符串,让 `offset_px` + (只用于实测位移对比、不进模型)与文本说的方向一致。动作词 = 真实屏幕方向(`mirror=False` 口径)。 +* 手工模式:一行一条、共 21 行(cell 0 是条件帧也要给),串必须能在 `text_table_eybx_mirror.pt` 查到, + 否则回退加载 UMT5(`infer.py::TextEncoder`)。 +* CFG 负条件:逐 cell 裸动作串 `In a 2.5D top down view, the player is {action}.` + (训练 dropout 用的就是它,`infer.py::BARE_TMPL`),不是 `NULL_PROMPT`(不在 eybx 表里)。 +""" +from __future__ import annotations + +import os +import sys + +import torch + +from baseline.base import ActionArm + +ROOT = os.path.dirname(os.path.dirname(os.path.abspath(__file__))) +if os.path.join(ROOT, "data", "code") not in sys.path: + sys.path.insert(0, os.path.join(ROOT, "data", "code")) +from scenes import ACTIONS, PROMPT_TMPL, SCENE_NL # noqa: E402 + +# ---- Incantation 的时间线常量(inference.py:85, :133-134, :140) ---- +TIME_STEP_S = 0.25 # 1 条 prompt 覆盖 0.25 s = 1 个 latent 帧 = 本项目 1 个 cell +DEFAULT_DURATION_S = 1.0 # DURATION_MAP 查不到时的缺省时长(inference.py:140) +CELLS = 21 + +# 动作脚本里的方向名 → scenes.ACTIONS 下标(与 actionrope/infer.py::DIR_NAMES 一致;不 import infer 是因为 +# 它 import 时会带起 opencv / diffsynth 等推理依赖) +LABEL_NAMES = ["idle", "up", "up-left", "left", "down-left", "down", "down-right", "right", "up-right"] +DIR_NAMES = { + "idle": 0, "up": 1, "up-left": 2, "left": 3, "down-left": 4, + "down": 5, "down-right": 6, "right": 7, "up-right": 8, + "ul": 2, "dl": 4, "dr": 6, "ur": 8, "u": 1, "d": 5, "l": 3, "r": 7, +} + +CROSS_ATTN_MASK_NOTE = ( + "Incantation 的 (t > 0) 逐帧 cross-attn 掩码未复刻。要复刻需在 actionrope/arope.py::_block_forward 的 " + "cross_attn 之后乘一个 [b, S, 1] 的逐帧掩码(帧 0 为 0),并在 arope_forward 加参数透传;" + "这会改变帧 0 token 的表示(进而经自注意力影响全部帧),装上瞬间就不再与原模型逐位相同。" +) + + +class PromptArm(ActionArm): + """零钩子:动作全在逐 cell 文本里,模型本身一个参数都不加。""" + + name = "prompt" + # ---- 数据 / 前向契约(integration 按这几个属性配 dataset 与 arope_forward)---- + text_mode = "scene_action" # 动作从句保留并翻回真实方向(text_table_eybx_mirror.pt) + per_cell_context = True # context 必须是 [b, f, 512, 4096] + uses_offset_px = False # arope_forward(offset_px=None):普通 RoPE + mask_channel = False # 无 known/new 掩码通道 + new_weight = 1.0 # loss 权重全 1 + + def __init__(self, require_per_cell: bool = True): + super().__init__() + self.require_per_cell = bool(require_per_cell) + + def install(self, dit) -> None: + """无参数可建;只记下几何信息供 extra_context 的核对用。""" + self._dim = int(getattr(dit, "dim", 0)) + + def encode(self, action_inputs, grid: dict): + """不消费 action_inputs(Incantation 没有非文本的动作输入)。返回 None ⇒ 钩子收到 feats=None。""" + return None + + def extra_context(self, context: torch.Tensor, feats, grid: dict) -> torch.Tensor: + """恒等;只核对 context 真是逐 cell 的([(b f), L, dim]),否则这个臂根本没有动作通道。""" + if self.require_per_cell and grid is not None: + b, f = int(grid["b"]), int(grid["f"]) + if context.shape[0] != b * f: + raise ValueError( + f"prompt 臂要求逐 cell 文本(context [b, f, 512, 4096] ⇒ 嵌入后 {b * f} 行)," + f"得到 {context.shape[0]} 行。请给 dataset text_mode='scene_action' 的 [b, 21, 512, 4096] context;" + f"确要整条 context 用 PromptArm(require_per_cell=False)。" + ) + return context + + # ---- 工具 ---- + def n_new_params(self) -> int: + return 0 + + def zero_init_check(self) -> bool: + return True # 没有任何通向残差流的新路径 + + def describe(self) -> dict: + return dict(name=self.name, text_mode=self.text_mode, per_cell_context=self.per_cell_context, + uses_offset_px=self.uses_offset_px, mask_channel=self.mask_channel, + new_weight=self.new_weight, n_new_params=0, upstream="Incantation (text-only action interface)") + + +# -------------------------------------------------------------------------- +# 推理:动作脚本 → 逐 cell prompt(对照 inference.py::PromptGenerator) +# -------------------------------------------------------------------------- + +def _steps(duration_s: float) -> int: + """Incantation 的 `_steps`:max(1, round(秒 / 0.25))。""" + return max(1, int(round(float(duration_s) / TIME_STEP_S))) + + +def script_to_timeline(script: list, n_cells: int = CELLS, default_duration_s: float = DEFAULT_DURATION_S) -> list[int]: + """动作脚本 → 长度 n_cells 的动作标签时间线(scenes.ACTIONS 下标)。 + + 脚本项:`"right"`(缺省时长)或 `["right", 秒]`(None 秒 ⇒ 缺省),方向名见 DIR_NAMES,也可直接给标签下标。 + 展开规则照 Incantation:每项 round(秒/0.25) 个 cell;总长不足 n_cells 用最后一个动作补齐 + (脚本为空 ⇒ idle,对应其 "Standing");超出则截断(本项目视频固定 21 个 cell,Incantation 是按脚本定长)。 + """ + tl: list[int] = [] + for item in script: + if isinstance(item, (list, tuple)): + name, dur = item[0], (item[1] if len(item) > 1 and item[1] is not None else default_duration_s) + else: + name, dur = item, default_duration_s + if isinstance(name, str): + key = name.strip().lower() + if key not in DIR_NAMES: + raise ValueError(f"未知动作 {name!r},可选 {sorted(DIR_NAMES)} 或标签下标 0..8") + label = DIR_NAMES[key] + else: + label = int(name) + if not 0 <= label < len(ACTIONS): + raise ValueError(f"动作标签下标越界: {label}") + tl += [label] * _steps(dur) + if not tl: + tl = [0] + tl += [tl[-1]] * (n_cells - len(tl)) + return tl[:n_cells] + + +def scene_clause(scene: str) -> str: + """scene key(tidal_flats)或完整从句("in a ...")。""" + if scene in SCENE_NL: + return SCENE_NL[scene] + if scene.lower().startswith("in a"): + return scene + raise ValueError(f"scene 应为 key {sorted(SCENE_NL)} 或 'in a ...' 从句,得到 {scene!r}") + + +def timeline_to_cell_prompts(scene: str, timeline: list[int], trigger: str | None = None) -> list[str]: + """标签时间线 → 21 条数据集模板 prompt(动作词 = 真实屏幕方向,配 text_table_eybx_mirror.pt)。 + + trigger "burn:::" / "cut:::":与 infer.py::compose_cell_prompts 同一约定, + cell [start, start+n) 用转场从句,之后切成纯 B 场景。 + """ + if len(timeline) != CELLS: + raise ValueError(f"时间线应有 {CELLS} 个 cell,得到 {len(timeline)}") + clauses = [scene_clause(scene)] * CELLS + if trigger: + kind, b, start, n = trigger.split(":") + start, n = int(start), int(n) + tmpl = {"burn": "{a} burning away into {b}", "cut": "{a} cutting to {b}"} + if kind not in tmpl: + raise ValueError(f"trigger 类型应为 burn/cut,得到 {kind!r}") + if not (0 <= start < CELLS and n >= 1): + raise ValueError(f"trigger 的 start/n 越界: {start}/{n}") + b_nl = scene_clause(b) + trig = tmpl[kind].format(a=clauses[0], b=b_nl[3:] if b_nl.startswith("in ") else b_nl) + for k in range(start, CELLS): + clauses[k] = trig if k < start + n else b_nl + return [PROMPT_TMPL.format(scene=c, action=ACTIONS[l]) for c, l in zip(clauses, timeline)] + + +def script_to_cell_prompts(scene: str, script: list, trigger: str | None = None) -> list[str]: + """Incantation 风格动作脚本 → 21 条逐 cell prompt。例: + script_to_cell_prompts("tidal_flats", [["right", 2.5], "left", ["idle", 1.0]]) + """ + return timeline_to_cell_prompts(scene, script_to_timeline(script), trigger) + + +def script_to_action_spec(script: list, mult: float = 1.0) -> str: + """同一脚本 → infer.py 的 `--actions` 串("right:1.0:10,left:1.0:11"),让实测位移的参考指令与文本一致。 + + 时间线里连续相同的标签合并成一段;idle 段速度为 0("idle:0:n")。 + """ + tl = script_to_timeline(script) + segs: list[tuple[int, int]] = [] + for lab in tl: + if segs and segs[-1][0] == lab: + segs[-1] = (lab, segs[-1][1] + 1) + else: + segs.append((lab, 1)) + return ",".join(f"{LABEL_NAMES[lab]}:{0.0 if lab == 0 else mult}:{n}" for lab, n in segs) diff --git a/backup_2026-09-14/code/baseline/xattn.py b/backup_2026-09-14/code/baseline/xattn.py new file mode 100644 index 0000000000000000000000000000000000000000..19a736f49999d35fdf41527eb19565aa0647b4dc --- /dev/null +++ b/backup_2026-09-14/code/baseline/xattn.py @@ -0,0 +1,288 @@ +"""xattn 臂:Matrix-Game 3 的动作模块(键盘 cross-attn + 鼠标时间轴 self-attn)移植到 Wan2.2-TI2V-5B。 + +上游机制(vender/Matrix-Game/Matrix-Game-3,只读) +------------------------------------------------ +* `wan/modules/action_module.py::ActionModule`(L39-333,"action module from GameFactory"): + - 输入:`keyboard_condition [B, N_frames, C_key]`(逐视频帧、多热按键向量,`utils/conditions.py` L73-107 + 的 KEYBOARD_IDX = forward/back/left/right 各占一位,按下为 1;同时按两键 ⇒ 两位为 1); + `mouse_condition [B, N_frames, 2]`(逐视频帧的连续相机增量,CAM_VALUE=0.1 量级)。 + N_frames = 4·(T−1)+1,T = latent 帧数(L192-198)。 + - 时间窗口(L207-214 / L268-281):在帧序列前面补 `pad_t = 4·windows_size` 个帧 0 的拷贝, + latent 帧 i 取补齐后 `[4i, 4i+pad_t)` 这 12 帧(= 该 latent 之前 3 个 latent 跨度里的按键), + 展平成一个 `windows·4·C` 向量 ⇒ 每个 latent 帧一条动作 token。 + - 键盘分支(L267-332):`keyboard_embed`(Linear(C_key,128)-SiLU-Linear(128,128))逐帧嵌入后按窗口展平成 1536 维, + `keyboard_attn_kv: 1536 → 2·1024` 得到 k/v(每 latent 帧一条 token);视频 token 经 `mouse_attn_q: dim → 1024` + 得到 q;q/k 各做无仿射 RMSNorm(head_dim 64,eps 1e-6;`WanRMSNorm.weight` 是死参数,forward 没用,L16-28); + q 重排成 `(B S) T H D`(S = h·w,同一空间位置的 T 帧作为一条序列),k/v 沿时间轴(T 条)与之做 + **非因果** attention(`causal=False`),q/k 先加时间轴 RoPE(`rope_dim_list=[8,28,28]`,`theta=256`, + h/w 轴位置恒为 0,等价于只旋转每头前 8 维,L146-184 / L308-315);`proj_keyboard: 1024 → dim`,残差相加。 + - 鼠标分支(L201-265):把视频 token 重排成 `(B S) T C`,与同窗口展平的鼠标量(12·2 = 24 维)在通道上拼接, + `mouse_mlp`(Linear(dim+24,1024)-GELU-Linear(1024,1024)-LayerNorm)后 `t_qkv: 1024 → 3·1024`, + 在时间轴 T 上做 self-attention(同样的 RMSNorm + 时间 RoPE),`proj_mouse: 1024 → dim` 残差相加。 + 鼠标分支在键盘分支之前,键盘分支的 q 取的是加过鼠标输出之后的 hidden。 +* `wan/modules/model.py`:L533-536 只有 `block_idx ∈ action_config['blocks']` 的 block 才建 ActionModule; + L617-662 在 block 内 **文本 cross-attn 之后、FFN 之前** 调 `self.action_model(x, T, h, w, mouse_cond, keyboard_cond)`; + L1097-1103 `init_weights` 把 `proj_mouse` / `proj_keyboard` 的权重和偏置置零(其余 Linear xavier_uniform、偏置 0)。 +* 配置:Matrix-Game-3 仓库不带 config.json;`Matrix-Game-2/configs/distilled_model/universal/config.json` 给出 + `blocks=[0..14]`(前 15 块)、`hidden_size=128, keyboard_hidden_dim=mouse_hidden_dim=1024, heads_num=16, + windows_size=3, vae_time_compression_ratio=4, rope_theta=256, rope_dim_list=[8,28,28], qk_norm=True, qkv_bias=False`, + 与 ActionModule 的默认值一致;本实现沿用这组超参(`img_hidden_size` 换成本模型的 dim=3072)。 + +本实现的对应关系 +---------------- +* 钩子位置:用 `block_pre_ffn`(文本 cross-attn 之后、FFN 之前),与上游 model.py 的注入位置一致 + (2026-09-05 arope_forward 补了这个钩子;之前用的 block_mid 比上游早一个子层)。 + 上游在 `mouse_cond is not None` 时还有 `x = self.norm3(x)` 直接替换残差流的写法(model.py L600-601), + 这会在零初始化时就改变预训练模型的输出,与"装上不改输出"矛盾,这里不复刻。 +* 信号: + - 键盘 ← `action_inputs["action_idx"]`([b, 21] 的 9 类标签),按上游 KEYBOARD_IDX 的键位编码映射成 4 位多热 + [up, down, left, right](对角 = 两键同按,idle = 全 0;9 类 ↔ 9 个互异向量,与 one-hot 等价的信息量, + 见 `KEY_TABLE`),即 `keyboard_dim_in=4`(Matrix-Game-2 配置的取值)。 + - 鼠标 ← `action_inputs["delta_tok"]`([b, 21, 2] 逐 cell 速度,token 单位,连续量),对应上游的相机增量。 + - 数据是逐 cell 的,上游是逐视频帧的:按 SPEC 的 cell↔帧映射(帧 0 = cell 0,帧 4k−3…4k = cell k)把每个 cell 的 + 值复制到它的 4 帧上,再走上游一模一样的补齐 + 12 帧窗口(`_window_cell_index`)。cell 内 4 帧相同, + 窗口里会出现重复列——这是上游结构的直接后果,保留不动(也是参数量 1536→2048 的来源)。 + 窗口长度用视频帧数 `window_frames` 表示(默认 4·windows_size = 12;`window_frames=1` 退化成每 cell 一条嵌入)。 + - 动作特征在 `encode` 里只算一次:`[b, f, 4·windows_size, 6]`(前 4 列按键、后 2 列鼠标),作为一个张量穿过梯度检查点; + 各 block 的 ActionModule 自己做 embed / kv 投影(上游每块一份参数,不共享)。 +* 上游 `k.repeat(S,1,1,1)` 与 `rearrange(q, "B (T S) ... -> (B S) T ...")` 的 batch 排列在 B>1 时对不上 + (前者 s 外 b 内,后者 b 外 s 内),这里用 expand 按 (b, s) 正确对齐;B=1 时两者相同。 +* attention 用 `F.scaled_dot_product_attention`(上游是 flash_attn_func,数学等价);RMSNorm 在 float32 里算再转回。 + +新增参数量(dim=3072,前 15 块,每块一份) +----------------------------------------- +* 键盘分支每块 9,454,336:keyboard_embed 17,152 + mouse_attn_q 3072·1024 + keyboard_attn_kv 1536·2048 + proj_keyboard 1024·3072 + ⇒ 15 块 141,815,040(≈141.8M)。 +* 鼠标分支每块 10,514,432:mouse_mlp 4,222,976(含 LayerNorm 2,048)+ t_qkv 1024·3072 + proj_mouse 1024·3072 + ⇒ 15 块 157,716,480(≈157.7M)。 +* 默认(键盘 + 鼠标)合计 299,531,520(≈299.5M)。 +* 旧报告的 +98.6M 对应 `enable_mouse=False, window_frames=1`(每个 latent 帧只取一帧按键嵌入,kv 输入 128 → 2048, + 每块 6,570,752,15 块 98,561,280):即"只复刻键盘通路、不做 12 帧窗口"。上游默认的 4·windows_size=12 帧窗口把 kv + 输入放大到 1536,仅键盘通路就是 141.8M。本实现按上游代码保留窗口与鼠标分支,二者都可用构造参数关掉。 + +初始化 +------ +所有 Linear 权重 xavier_uniform、偏置 0(上游 `init_weights`),`proj_keyboard` / `proj_mouse` 权重置零且无偏置(qkv_bias=False), +LayerNorm 取默认 (1, 0)。两条分支都只经 proj 进入残差流,所以装上瞬间输出与原模型逐位相同(`zero_init_check`)。 +""" +from __future__ import annotations + +from typing import Iterable + +import torch +import torch.nn as nn +import torch.nn.functional as F +from einops import rearrange + +from baseline.base import ActionArm + +# ActionModule 的时间压缩比:一个 latent 帧对应 4 个视频帧(与 SPEC 的 cell↔帧一致) +VAE_TIME_RATIO = 4 +# 上游 rope_dim_list=[8,28,28] 里只有 t 轴那 8 维真的在旋转(h/w 位置恒 0) +ROPE_T_DIM = 8 +ROPE_THETA = 256.0 + +# actionrope.prompts.ACTIONS 的 9 类 → 上游 KEYBOARD_IDX 风格的多热按键 [up(forward), down(back), left, right] +KEY_TABLE = torch.tensor([ + [0, 0, 0, 0], # 0 standing idle + [1, 0, 0, 0], # 1 moving up + [1, 0, 1, 0], # 2 moving up-left + [0, 0, 1, 0], # 3 moving left + [0, 1, 1, 0], # 4 moving down-left + [0, 1, 0, 0], # 5 moving down + [0, 1, 0, 1], # 6 moving down-right + [0, 0, 0, 1], # 7 moving right + [1, 0, 0, 1], # 8 moving up-right +], dtype=torch.float32) +KEYBOARD_DIM_IN = KEY_TABLE.shape[1] +MOUSE_DIM_IN = 2 + + +def _rms_norm(x: torch.Tensor, eps: float = 1e-6) -> torch.Tensor: + """上游 WanRMSNorm(无仿射;它的 weight 在 forward 里没用到)。float32 里算,回到输入 dtype。""" + xf = x.float() + return (xf * torch.rsqrt(xf.pow(2).mean(dim=-1, keepdim=True) + eps)).to(x.dtype) + + +def _temporal_rope(x: torch.Tensor) -> torch.Tensor: + """上游 get_rotary_pos_embed + apply_rotary_emb 在 rope_sizes=[T,1,1] 下的等价形式。 + + x: [N, T, H, D]。只有每头前 ROPE_T_DIM 维按时间位置 0..T-1 旋转(相邻两维成对,theta=256), + 其余维位置为 0(cos=1, sin=0)原样保留。上游在 float32 里算再 type_as 回去,这里一样。 + """ + T, D = x.shape[1], x.shape[-1] + assert D >= ROPE_T_DIM + half = ROPE_T_DIM // 2 + inv = 1.0 / (ROPE_THETA ** (torch.arange(0, ROPE_T_DIM, 2, device=x.device).float() / ROPE_T_DIM)) # [4] + ang = torch.arange(T, device=x.device).float()[:, None] * inv[None, :] # [T, 4] + cos = ang.cos().view(1, T, 1, half, 1) + sin = ang.sin().view(1, T, 1, half, 1) + xr = x[..., :ROPE_T_DIM].float().reshape(x.shape[0], T, x.shape[2], half, 2) + x_re, x_im = xr.unbind(-1) + rot = torch.stack([x_re * cos[..., 0] - x_im * sin[..., 0], + x_re * sin[..., 0] + x_im * cos[..., 0]], dim=-1).flatten(-2) + return torch.cat([rot.to(x.dtype), x[..., ROPE_T_DIM:]], dim=-1) + + +def _window_cell_index(f: int, window_frames: int) -> torch.Tensor: + """上游"补 pad_t 帧 + 每 latent 取 [4i, 4i+pad_t)"的窗口(pad_t = 4·windows_size),折算成 [f, pad_t] 的 cell 下标。 + + 补齐后第 p 个视频帧 = 原视频帧 max(p − pad_t, 0),即 latent i 看的是原视频帧 [4i − pad_t, 4i); + 原视频帧 j 属于 cell (j+3)//4(帧 0 = cell 0,帧 4k−3…4k = cell k)。这样 feats 直接按 cell gather, + 不必真的展开成 81 帧。pad_t 这里放宽成任意 window_frames(=1 时 latent i 只看帧 4i−1,即 cell i 自己)。 + """ + pad_t = window_frames + i = torch.arange(f).view(f, 1) + j = torch.arange(pad_t).view(1, pad_t) + frame = (VAE_TIME_RATIO * i + j - pad_t).clamp(min=0) + return (frame + VAE_TIME_RATIO - 1) // VAE_TIME_RATIO + + +class MG3ActionModule(nn.Module): + """一个 block 的动作模块(上游 ActionModule 去掉 memory 分支,B>1 的 k/v 对齐修正)。""" + + def __init__(self, img_hidden_size: int, *, hidden_size: int = 128, keyboard_hidden_dim: int = 1024, + mouse_hidden_dim: int = 1024, heads_num: int = 16, window_frames: int = 12, + enable_keyboard: bool = True, enable_mouse: bool = True, qkv_bias: bool = False): + super().__init__() + self.heads_num = heads_num + self.window_frames = window_frames + self.enable_keyboard = enable_keyboard + self.enable_mouse = enable_mouse + win = window_frames # 上游 = vae_time_compression_ratio · windows_size = 12 + if enable_mouse: + c = mouse_hidden_dim + self.mouse_mlp = nn.Sequential( + nn.Linear(MOUSE_DIM_IN * win + img_hidden_size, c, bias=True), + nn.GELU(approximate="tanh"), + nn.Linear(c, c), + nn.LayerNorm(c), + ) + self.t_qkv = nn.Linear(c, c * 3, bias=qkv_bias) + self.proj_mouse = nn.Linear(c, img_hidden_size, bias=qkv_bias) + if enable_keyboard: + self.keyboard_embed = nn.Sequential( + nn.Linear(KEYBOARD_DIM_IN, hidden_size, bias=True), nn.SiLU(), nn.Linear(hidden_size, hidden_size, bias=True)) + self.mouse_attn_q = nn.Linear(img_hidden_size, keyboard_hidden_dim, bias=qkv_bias) # 名字照抄上游:其实是键盘分支的 q + self.keyboard_attn_kv = nn.Linear(hidden_size * win, keyboard_hidden_dim * 2, bias=qkv_bias) + self.proj_keyboard = nn.Linear(keyboard_hidden_dim, img_hidden_size, bias=qkv_bias) + self.reset_parameters() + + def reset_parameters(self) -> None: + """上游 init_weights:Linear xavier_uniform + 零偏置;proj_* 置零(进入残差流的唯一路径)。""" + for m in self.modules(): + if isinstance(m, nn.Linear): + nn.init.xavier_uniform_(m.weight) + if m.bias is not None: + nn.init.zeros_(m.bias) + elif isinstance(m, nn.LayerNorm): + nn.init.ones_(m.weight) + nn.init.zeros_(m.bias) + for name in ("proj_mouse", "proj_keyboard"): + if hasattr(self, name): + nn.init.zeros_(getattr(self, name).weight) + + def _attend(self, q: torch.Tensor, k: torch.Tensor, v: torch.Tensor) -> torch.Tensor: + """q/k/v: [N, T, H, D];RMSNorm + 时间 RoPE + 非因果 SDPA,返回 [N, T, H·D]。""" + q = _temporal_rope(_rms_norm(q).to(v.dtype)) + k = _temporal_rope(_rms_norm(k).to(v.dtype)) + out = F.scaled_dot_product_attention(q.transpose(1, 2), k.transpose(1, 2), v.transpose(1, 2), is_causal=False) + return out.transpose(1, 2).flatten(2) + + def forward(self, x: torch.Tensor, feats: torch.Tensor, grid: dict) -> torch.Tensor: + """x: [b, (f h w), dim];feats: [b, f, window_frames, 4+2](按键多热 + 鼠标连续量,已按窗口展开)。""" + b, f, S = grid["b"], grid["f"], grid["n_tok_per_frame"] + assert x.shape[1] == f * S and feats.shape[:2] == (b, f) + H = self.heads_num + dtype = x.dtype + hidden = x + + if self.enable_mouse: + # 上游 L201-265:同一空间位置的 T 帧作为序列,与窗口鼠标量拼接后做时间轴 self-attention + mouse_win = feats[..., KEYBOARD_DIM_IN:].reshape(b, f, -1).to(dtype) # [b, f, 24],(window d) 排列 + h_t = rearrange(hidden, "b (f s) c -> (b s) f c", f=f) + m = mouse_win.unsqueeze(1).expand(b, S, f, mouse_win.shape[-1]).reshape(b * S, f, -1) + g = self.mouse_mlp(torch.cat([h_t, m], dim=-1)) + q, k, v = rearrange(self.t_qkv(g), "n t (k h d) -> k n t h d", k=3, h=H) + attn = rearrange(self._attend(q, k, v), "(b s) f c -> b (f s) c", b=b) + hidden = hidden + self.proj_mouse(attn) + + if self.enable_keyboard: + # 上游 L267-332:每 latent 帧一条键盘 token 作 k/v,视频 token 作 q,沿时间轴 cross-attention + key_win = feats[..., :KEYBOARD_DIM_IN].to(self.keyboard_embed[0].weight.dtype) # [b, f, 12, 4] + key_tok = self.keyboard_embed(key_win).reshape(b, f, -1) # [b, f, 12·128] + q = rearrange(self.mouse_attn_q(hidden), "b (f s) (h d) -> (b s) f h d", f=f, h=H) + k, v = rearrange(self.keyboard_attn_kv(key_tok), "b f (k h d) -> k b f h d", k=2, h=H) + # 上游 k.repeat(S) 在 B>1 时与 q 的 (b s) 排列错位,这里按 (b, s) 展开 + k = k.unsqueeze(1).expand(b, S, *k.shape[1:]).reshape(b * S, *k.shape[1:]) + v = v.unsqueeze(1).expand(b, S, *v.shape[1:]).reshape(b * S, *v.shape[1:]) + attn = rearrange(self._attend(q, k, v), "(b s) f c -> b (f s) c", b=b) + hidden = hidden + self.proj_keyboard(attn) + return hidden + + +class XAttnArm(ActionArm): + """Matrix-Game 3 动作模块臂:前 `blocks` 个 block 的 block_pre_ffn 钩子上各挂一个 MG3ActionModule。""" + + name = "xattn" + + def __init__(self, blocks: Iterable[int] = range(15), *, enable_keyboard: bool = True, enable_mouse: bool = True, + windows_size: int = 3, window_frames: int | None = None, hidden_size: int = 128, + keyboard_hidden_dim: int = 1024, mouse_hidden_dim: int = 1024, heads_num: int = 16): + """windows_size 是上游的单位(latent 帧数,窗口 = 4·windows_size 个视频帧);window_frames 给了就直接按视频帧数 + (旧报告口径 `enable_mouse=False, window_frames=1`)。""" + super().__init__() + self.blocks = sorted(int(i) for i in blocks) + if window_frames is None: + window_frames = VAE_TIME_RATIO * windows_size + assert window_frames >= 1 + self.window_frames = window_frames + self.cfg = dict(enable_keyboard=enable_keyboard, enable_mouse=enable_mouse, window_frames=window_frames, + hidden_size=hidden_size, keyboard_hidden_dim=keyboard_hidden_dim, + mouse_hidden_dim=mouse_hidden_dim, heads_num=heads_num) + # ModuleDict 的键用 block 下标的字符串:state_dict 键形如 action_modules.3.proj_keyboard.weight + self.action_modules = nn.ModuleDict() + + def install(self, dit) -> None: + assert len(self.action_modules) == 0, "XAttnArm 只能 install 一次" + assert max(self.blocks) < len(dit.blocks), f"blocks 超出 DiT 层数 {len(dit.blocks)}" + ref = dit.patch_embedding.weight + for i in self.blocks: + self.action_modules[str(i)] = MG3ActionModule(dit.dim, **self.cfg) + # 参数与 DiT 同 dtype / 同卡一起训练(ZeRO-2 下混合 dtype 会出问题) + self.action_modules.to(device=ref.device, dtype=ref.dtype) + + # ---- 钩子 ---- + def encode(self, action_inputs: dict | None, grid: dict): + """action_idx [b, f] + delta_tok [b, f, 2] → 窗口特征 float32 [b, f, window_frames, 6]。""" + if action_inputs is None: + return None + b, f = grid["b"], grid["f"] + idx = torch.as_tensor(action_inputs["action_idx"]).long() + assert idx.shape == (b, f), f"action_idx 应为 [b={b}, f={f}],得到 {tuple(idx.shape)}" + device = idx.device + keys = KEY_TABLE.to(device)[idx] # [b, f, 4] + if self.cfg["enable_mouse"]: + delta = torch.as_tensor(action_inputs["delta_tok"]).to(device=device, dtype=torch.float32) + assert delta.shape == (b, f, 2), f"delta_tok 应为 [b={b}, f={f}, 2],得到 {tuple(delta.shape)}" + else: + delta = torch.zeros(b, f, 2, device=device) + cond = torch.cat([keys, delta], dim=-1) # [b, f, 6] + win = _window_cell_index(f, self.window_frames).to(device) # [f, window_frames] + return cond[:, win] # [b, f, window_frames, 6] + + def block_pre_ffn(self, idx: int, x: torch.Tensor, feats, grid: dict) -> torch.Tensor: + key = str(idx) + if feats is None or key not in self.action_modules: + return x + return self.action_modules[key](x, feats, grid) + + # ---- 工具 ---- + def zero_init_check(self) -> bool: + ok = len(self.action_modules) > 0 + for mod in self.action_modules.values(): + for name in ("proj_mouse", "proj_keyboard"): + if hasattr(mod, name): + lin = getattr(mod, name) + ok = ok and bool((lin.weight == 0).all()) and (lin.bias is None or bool((lin.bias == 0).all())) + return ok diff --git a/backup_2026-09-14/code/configs/accelerate_zero2.yaml b/backup_2026-09-14/code/configs/accelerate_zero2.yaml new file mode 100644 index 0000000000000000000000000000000000000000..525f57608bae395b56e77e8df6ce2c6acf6769d0 --- /dev/null +++ b/backup_2026-09-14/code/configs/accelerate_zero2.yaml @@ -0,0 +1,26 @@ +# 8 卡 DeepSpeed ZeRO-2,bf16,无 offload,梯度裁剪 1.0,梯度累积 1。 +# train_micro_batch_size_per_gpu 由 accelerate 填 "auto" ⇒ 取 train.py 里 DataLoader 的 batch_size(默认 1)。 +# 不用 deepspeed_config_file:accelerate 1.14 里它与 mixed_precision 等键互斥,yaml 原生字段更省事。 +compute_environment: LOCAL_MACHINE +debug: false +deepspeed_config: + gradient_accumulation_steps: 1 + gradient_clipping: 1.0 + offload_optimizer_device: none + offload_param_device: none + zero3_init_flag: false + zero_stage: 2 +distributed_type: DEEPSPEED +downcast_bf16: 'no' +enable_cpu_affinity: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 8 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/code/configs/accelerate_zero2_4gpu.yaml b/backup_2026-09-14/code/configs/accelerate_zero2_4gpu.yaml new file mode 100644 index 0000000000000000000000000000000000000000..89e9941f0b66e5ef7d49b4341b01816039a19358 --- /dev/null +++ b/backup_2026-09-14/code/configs/accelerate_zero2_4gpu.yaml @@ -0,0 +1,26 @@ +# 4 卡(自测用,配合 CUDA_VISIBLE_DEVICES=0,1,2,3) DeepSpeed ZeRO-2,bf16,无 offload,梯度裁剪 1.0,梯度累积 1。 +# train_micro_batch_size_per_gpu 由 accelerate 填 "auto" ⇒ 取 train.py 里 DataLoader 的 batch_size(默认 1)。 +# 不用 deepspeed_config_file:accelerate 1.14 里它与 mixed_precision 等键互斥,yaml 原生字段更省事。 +compute_environment: LOCAL_MACHINE +debug: false +deepspeed_config: + gradient_accumulation_steps: 1 + gradient_clipping: 1.0 + offload_optimizer_device: none + offload_param_device: none + zero3_init_flag: false + zero_stage: 2 +distributed_type: DEEPSPEED +downcast_bf16: 'no' +enable_cpu_affinity: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 4 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/code/configs/accelerate_zero2_ga2.yaml b/backup_2026-09-14/code/configs/accelerate_zero2_ga2.yaml new file mode 100644 index 0000000000000000000000000000000000000000..b5051b28d35659585b9134dd5c0a658fafd6d93c --- /dev/null +++ b/backup_2026-09-14/code/configs/accelerate_zero2_ga2.yaml @@ -0,0 +1,27 @@ +# 与 accelerate_zero2.yaml 相同,只把梯度累积改成 2(全局 batch 16);train.py 传 --grad_accum 2 +# 8 卡 DeepSpeed ZeRO-2,bf16,无 offload,梯度裁剪 1.0,梯度累积 1。 +# train_micro_batch_size_per_gpu 由 accelerate 填 "auto" ⇒ 取 train.py 里 DataLoader 的 batch_size(默认 1)。 +# 不用 deepspeed_config_file:accelerate 1.14 里它与 mixed_precision 等键互斥,yaml 原生字段更省事。 +compute_environment: LOCAL_MACHINE +debug: false +deepspeed_config: + gradient_accumulation_steps: 2 + gradient_clipping: 1.0 + offload_optimizer_device: none + offload_param_device: none + zero3_init_flag: false + zero_stage: 2 +distributed_type: DEEPSPEED +downcast_bf16: 'no' +enable_cpu_affinity: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 8 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/code/demo/engine.py b/backup_2026-09-14/code/demo/engine.py new file mode 100644 index 0000000000000000000000000000000000000000..2496c20a5c9c7ef2536226555ca466c9a70f2f7f --- /dev/null +++ b/backup_2026-09-14/code/demo/engine.py @@ -0,0 +1,326 @@ +"""交互式 rollout 引擎:常驻模型 + 滑窗 KV + 流式因果 VAE,一次生成一个 cell。 + +与 `distill/eval/rollout_eval.py:deploy_rollout_flowmap` 走**同一条**采样路径(同样的 +`frame_cond` / `fm.euler_step` / t=0 提交),区别只有三点,都是为了交互: + + 1. `off_ext` 是**增长的**,不预先铺满 —— 动作是玩家现给的。`frame_cond` 只看 + [k−window, k] 这一段历史窗口,所以往后追加不影响任何已提交的 cell。 + 2. VAE 逐 cell 解码而不是最后整片解码。Wan 的 3D VAE 在时间上是因果的(decoder 带 + `_feat_map` 缓存),把这个缓存跨调用留住就能无缝流式出帧 —— 见 StreamVAE。 + 整片 tiled 解码 161 帧要 3.6 s;流式下每 cell 只解 1 个 latent frame。 + 3. 不跑到头就停:无限续走。世界坐标是窗口锚定的(rope_cap == sink+kv_window), + 所以走多远都不会越界 —— 这正是 ARoPE 相对编码的性质。 + +一个 cell = 4 帧 = 16 fps 下的 250 ms。实测稳态 N=4 时 DiT 约 175 ms/cell, +所以生成比播放快,**缓冲深度是唯一的延迟旋钮**:见 server.py 的 lead_cells。 +""" +from __future__ import annotations + +import os +import sys +import threading +import time +from collections import deque + +import numpy as np +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.abspath(__file__))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from actionrope import geometry as G # noqa: E402 +from actionrope import infer # noqa: E402 +from actionrope.prompts import NULL_PROMPT # noqa: E402 +from distill import flowmap as fm # noqa: E402 +from safetensors import safe_open # noqa: E402 +from safetensors.torch import load_file # noqa: E402 + +from distill.arope_dit import AropeDiT, unwrap # noqa: E402 +from distill.eval.rollout_eval import _ckpt_metadata, frames_to_cells_n # noqa: E402 +from distill.stage3_dmd.dmd_arope import frame_cond # noqa: E402 + +CELL_FRAMES = 4 + + +def safetensors_keys(path: str) -> list[str]: + """只读 header 拿键名 —— 不为了数个数就把 10 GB 读进内存。""" + with safe_open(path, "pt") as f: + return list(f.keys()) + + +class StreamVAE: + """持有 Wan VAE decoder 的因果时间缓存,逐 latent frame 解码。 + + `VideoVAE_.decode` / `VideoVAE38_.decode` 每次调用都 `clear_cache()` 再从头跑整段;我们要的 + 是跨调用保留,所以把循环体拆出来。`conv2` 是 CausalConv3d(kernel=1)、时间感受野为 1,可逐帧过。 + + ★ Wan2.2 的 VAE 是 `VideoVAE38_`,与 2.1 的 `VideoVAE_` 有两处不同,漏掉任何一处都直接报错 + 或出错帧(实测:漏 first_chunk ⇒ "size of tensor a (2) must match b (4)"): + 1. **整段的第一个** latent frame 要 `first_chunk=True` —— 它决定 avg_shortcut 出 1 帧还是 4 帧 + 2. 循环之后要 `unpatchify(out, patch_size=2)` + 所以第 1 帧出 1 帧、之后每帧出 4 帧,正好是 (F−1)/4+1 的压缩率。 + """ + + def __init__(self, vae, device): + self.vae = vae + self.m = vae.model + self.device = device + for attr in ("decoder", "conv2", "clear_cache"): + assert hasattr(self.m, attr), f"VAE 内核没有 {attr},DiffSynth 版本变了" + self.is38 = type(self.m).__name__.endswith("38_") + self.first = True + + def reset(self): + self.m.clear_cache() + self.first = True + + @torch.no_grad() + def decode_one(self, z: torch.Tensor) -> np.ndarray: + """z [1,48,1,h,w] → uint8 [n,H,W,3](整段首次 n=1,之后 n=4)。""" + scale = self.vae.scale + z = z.to(self.device) + if isinstance(scale[0], torch.Tensor): + s0 = scale[0].to(dtype=z.dtype, device=z.device).view(1, -1, 1, 1, 1) + s1 = scale[1].to(dtype=z.dtype, device=z.device).view(1, -1, 1, 1, 1) + z = z / s1 + s0 + else: + z = z / scale[1] + scale[0] + x = self.m.conv2(z) + self.m._conv_idx = [0] + kw = {"first_chunk": True} if (self.is38 and self.first) else {} + out, self.m._feat_map, self.m._conv_idx = self.m.decoder( + x, feat_cache=self.m._feat_map, feat_idx=self.m._conv_idx, **kw) + self.first = False + if self.is38: + from diffsynth.models.wan_video_vae import unpatchify + out = unpatchify(out, patch_size=2) + out = out.clamp_(-1, 1).float() # [1,3,n,H,W] + arr = ((out[0].permute(1, 2, 3, 0) + 1) * 127.5).clamp_(0, 255) + return arr.to(torch.uint8).cpu().numpy() + + +class TinyStreamVAE: + """TAEHV(madebyollin/taehv)的流式解码器 —— demo 的默认 VAE。 + + Wan2.2 5B 用 `taew2_2`;`_super` 是同一架构的大解码器,README 明说是给「实时世界模型、 + TAEHV 输出即最终输出」的场景(我们正是),而这个分辨率下两者都是 3 ms/cell,所以默认取 super。 + + 实测(480×832、单 H200、稳态):全量 Wan VAE 流式 87 ms/cell → TAEHV 3 ms/cell,快 ~30×。 + 合上 DiT 的 167 ms,一个 cell(4 帧 = 16 fps 下 250 ms)总共 170 ms ⇒ 0.68× 实时。 + + 两处容易搞错: + · 布局是 **NTCHW**,我们的 latent 是 NCTHW,要 permute + · TAEHV **不做** mean/std 反缩放("decodes exactly what diffusion models use"), + 所以喂的是 DiT 直接输出的 latent,不是 WanVideoVAE.decode 里那个 z/std+mean + """ + + def __init__(self, weights: str, device, dtype=torch.float16): + import sys as _s + tp = os.path.join(ROOT, "vendor", "taehv") + if tp not in _s.path: + _s.path.insert(0, tp) + from taehv import TAEHV, StreamingTAEHV + self.device, self.dtype = device, dtype + self.tae = TAEHV(weights).to(device, dtype).eval() + self.st = StreamingTAEHV(self.tae) + + def reset(self): + self.st.reset() + + @torch.no_grad() + def decode_one(self, z: torch.Tensor) -> np.ndarray: + x = z.to(self.device, self.dtype).permute(0, 2, 1, 3, 4) # NCTHW -> NTCHW + out, frames = self.st.decode(x), [] + while out is not None: + frames.append(out) + out = self.st.decode() + if not frames: + return np.zeros((0, 1, 1, 3), np.uint8) + v = torch.cat(frames, dim=1)[0] # [t,3,H,W],值域 [0,1] + v = (v.permute(0, 2, 3, 1).clamp(0, 1) * 255).to(torch.uint8) + return v.cpu().numpy() + + +class Engine: + """常驻 GPU 的交互式生成器。generate 循环跑在自己的线程里。""" + + def __init__(self, ckpt: str, *, device: str = "cuda", steps: int = 4, + sink_size: int = 3, kv_window: int = 17, rope_cap: int = 20, + scene: str | None = None, seed: int = 0, vae: str = "taehv_super", + log=print): + self.log = log + self.device = torch.device(device) + self.steps = steps + self.sink_size, self.kv_window, self.rope_cap = sink_size, kv_window, rope_cap + assert rope_cap == sink_size + kv_window, \ + f"rope_cap({rope_cap}) 必须 == sink({sink_size})+window({kv_window})" + self.seed = seed + + t0 = time.time() + # 832 键喂不进 load_models 的 strict 加载(它只认 827),所以:基座 → 装壳 → 灌权重。 + # 顺序不能反:install_flowmap 会把读出层零初始化,装完再 load 才拿得到训出来的 delta。 + # 与 rollout_eval:720-727 同一条路径。 + meta = _ckpt_metadata(ckpt) + n_keys = len(safetensors_keys(ckpt)) + if n_keys < 830: + raise SystemExit(f"{ckpt} 只有 {n_keys} 个键,不是 flow map 学生 —— demo 要 832 键的。") + self.pipe, dit, _ = infer.load_models(None, True, device, need_vae=True, arm="arope") + self.dit = AropeDiT(dit=dit, mask_channel=True, causal=True) + unwrap(self.dit).install_flowmap(form=meta.get("flowmap_form", "residual"), + gate=float(meta.get("delta_gate", 1.0))) + unwrap(self.dit).dit.load_state_dict(load_file(ckpt), strict=True) + self.dit.eval().requires_grad_(False) + unwrap(self.dit).move_rope_table(self.device) + if vae == "full": + self.svae = StreamVAE(self.pipe.vae, self.device) + else: + name = "taew2_2_super" if vae == "taehv_super" else "taew2_2" + w = os.path.join(ROOT, "vendor", "taehv", f"{name}.pth") + if not os.path.exists(w): + raise SystemExit(f"没有 {w} —— git clone https://github.com/madebyollin/taehv vendor/taehv") + self.svae = TinyStreamVAE(w, self.device) + self.vae_kind = vae + + sc = torch.load(infer.SIDECAR, map_location="cpu", weights_only=False) + self.walk_speed = np.array(sc["meta"]["walk_speed_px_s"], np.float64) + + # 文本走查表(与 rollout_eval:742 同一条);表里没有的串会回退去加载 UMT5, + # 那要多占 ~11 GB,所以 demo 默认用 NULL_PROMPT —— 它一定在表里。 + enc = infer.TextEncoder(infer.TEXT_TABLE["arope"], device) + prompts = [infer.strip_action(scene) if scene else NULL_PROMPT] * G.CELLS + ctx, ids = infer.build_context(enc, prompts, device, per_cell=True) + # ARoPE 臂的文本只含场景、动作已剥掉,所以 21 格必然逐位相同 —— 相同才能在无限 + # rollout 里复用同一格(等价于 extend_context 的 "hold")。不同就是口径出问题了。 + assert torch.allclose(ctx[:, 0], ctx[:, -1]), "逐 cell 文本不一致,不能复用单格上下文" + self.ctx1, self.ids1 = ctx[:, :1].contiguous(), ids[:, :1].contiguous() + self.log(f"[engine] 模型 {time.time() - t0:.0f}s · {n_keys} 键 flow map · " + f"N={steps} · sink={sink_size} window={kv_window} · vae={vae}") + + self.sigmas = fm.anystep_sigmas(steps) + fm.assert_anystep_axis(torch.as_tensor(self.sigmas), terminal=True) + + self._lock = threading.Lock() + self._vel = np.zeros(2, np.float64) # 当前速度指令 px/s + self.out = deque() # 待推的帧 + self._out_lock = threading.Lock() + self._stop = threading.Event() + self._thread: threading.Thread | None = None + self.lead_cells = 1 + self.stats = {"cells": 0, "gen_ms": 0.0, "dec_ms": 0.0} + self.cache = None + + # ---- 会话 ---- + + def reset(self, first_frame: np.ndarray): + """用一张首帧开一局。会丢弃旧的 KV / VAE 缓存。""" + with self._lock: + bare = unwrap(self.dit) + if self.cache is not None: + bare.release_kv_cache(self.cache) + z0 = infer.encode_first_frame(self.pipe, first_frame, tiled=False) + self.z0 = z0 + self.lat_h, self.lat_w = z0.shape[-2], z0.shape[-1] + self.cache = bare.init_kv_cache(kv_window=self.kv_window, + sink_size=self.sink_size, rope_cap=self.rope_cap) + self.k = 0 + self.frame_off = np.zeros((1, 2), np.float64) # 逐帧世界偏移,随 cell 增长 + self._push_off() + ow, mk = frame_cond(self.off_ext, 0, self.sink_size, self.kv_window, + self.lat_h, self.lat_w) + zeros = torch.zeros(1, device=self.device) + with torch.no_grad(): + self._call(z0, zeros, 0, True, ow, mk) # 真首帧 t=r=0 进缓存 + self.svae.reset() + with self._out_lock: + self.out.clear() + for f in self.svae.decode_one(z0): + self.out.append(f) + self.g = torch.Generator("cpu").manual_seed(self.seed) + self.stats = {"cells": 0, "gen_ms": 0.0, "dec_ms": 0.0} + + def _push_off(self): + cells = self.k + 1 + cell_off = frames_to_cells_n(self.frame_off, cells) + self.off_ext = torch.tensor(cell_off, dtype=torch.float32, + device=self.device).unsqueeze(0) + + def set_velocity(self, vx: float, vy: float): + with self._lock: + self._vel = np.array([vx, vy], np.float64) + + def velocity_from_keys(self, dx: float, dy: float, mult: float = 1.0) -> np.ndarray: + """方向单位向量 → 逐轴速度(横纵步速不同是透视造成的,与 infer.parse_actions 同口径)。""" + n = float(np.hypot(dx, dy)) + if n < 1e-9: + return np.zeros(2) + return self.walk_speed * np.array([dx, dy]) / n * mult + + # ---- 生成 ---- + + def _call(self, x, t, k, commit, ow, mk, r=None): + return self.dit(x, t, self.ctx1, context_ids=self.ids1, + r_timestep=(t if r is None else r), + first_frame_cond=False, frame_index=k, kv_cache=self.cache, + commit=commit, offset_win=ow, mask_in_k=mk) + + @torch.no_grad() + def step_once(self): + """按当前速度生成并解码一个 cell。""" + with self._lock: + vel = self._vel.copy() + t0 = time.time() + # 4 帧的逐帧偏移递推,与 action_offsets 同一条 + last = self.frame_off[-1] + new = np.stack([last + vel * (i + 1) / G.FPS for i in range(CELL_FRAMES)], 0) + self.frame_off = np.concatenate([self.frame_off, new], 0) + self.k += 1 + self._push_off() + k = self.k + ow, mk = frame_cond(self.off_ext, k, self.sink_size, self.kv_window, + self.lat_h, self.lat_w) + x = torch.randn(1, self.z0.shape[1], 1, self.lat_h, self.lat_w, + generator=self.g).to(dtype=self.z0.dtype, device=self.device) + for i in range(len(self.sigmas) - 1): + s_t, s_r = float(self.sigmas[i]), float(self.sigmas[i + 1]) + tt = torch.full((1,), s_t * fm.NUM_TRAIN_TIMESTEPS, device=self.device) + rr = torch.full((1,), s_r * fm.NUM_TRAIN_TIMESTEPS, device=self.device) + x = fm.euler_step(x, self._call(x, tt, k, False, ow, mk, r=rr), s_t, s_r) + zeros = torch.zeros(1, device=self.device) + self._call(x.detach(), zeros, k, True, ow, mk) # 每 cell 恰好提交一次,t=0 + t1 = time.time() + frames = self.svae.decode_one(x) + t2 = time.time() + with self._out_lock: + for f in frames: + self.out.append(f) + self.stats = {"cells": k, "gen_ms": (t1 - t0) * 1e3, "dec_ms": (t2 - t1) * 1e3} + + def _loop(self): + while not self._stop.is_set(): + with self._out_lock: + buffered = len(self.out) + # 只保持 lead_cells 个 cell 的缓冲:多了就是白白增加操作延迟 + if buffered >= self.lead_cells * CELL_FRAMES: + time.sleep(0.004) + continue + try: + self.step_once() + except Exception as e: # noqa: BLE001 + self.log(f"[engine] 生成失败:{type(e).__name__}: {e}") + self._stop.set() + + def start(self): + self._stop.clear() + self._thread = threading.Thread(target=self._loop, daemon=True, name="arope-engine") + self._thread.start() + + def stop(self): + self._stop.set() + if self._thread is not None: + self._thread.join(timeout=5) + + def pop_frame(self): + with self._out_lock: + return self.out.popleft() if self.out else None diff --git a/backup_2026-09-14/code/demo/index.html b/backup_2026-09-14/code/demo/index.html new file mode 100644 index 0000000000000000000000000000000000000000..17039adc56f0297365833fa68f1ea008f0fdf6e1 --- /dev/null +++ b/backup_2026-09-14/code/demo/index.html @@ -0,0 +1,96 @@ + + +ActionRoPE — 交互 rollout + + +

ActionRoPE · any-step AR rollout

+ + +
+ 移动 + WA + SD + (或方向键 · Shift 加速) +
+ +
+ + + 缓冲 + +
+
连接中…
+ + diff --git a/backup_2026-09-14/code/demo/run.sh b/backup_2026-09-14/code/demo/run.sh new file mode 100644 index 0000000000000000000000000000000000000000..ec2d5c0c8d4908589bd76e472c768ce1384f6d84 --- /dev/null +++ b/backup_2026-09-14/code/demo/run.sh @@ -0,0 +1,24 @@ +#!/usr/bin/env bash +# ActionRoPE 交互 demo 启动器。默认只绑回环 —— 这是共用机器。 +# +# bash demo/run.sh # 用 stage2-flowmap 的 7500 +# CKPT=.../ema_step150.safetensors bash demo/run.sh # 换个 ckpt +# STEPS=2 bash demo/run.sh # 更快、质量略降 +# +# 远程玩:在你自己电脑上 ssh -N -L 8420:127.0.0.1:8420 <这台机器>,再开 localhost:8420 +set -euo pipefail +ROOT="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +CKPT="${CKPT:-$ROOT/outputs/distill/stage2_flowmap/ema/ema_step7500.safetensors}" +PORT="${PORT:-8420}"; HOST="${HOST:-127.0.0.1}"; STEPS="${STEPS:-4}"; GPU="${GPU:-}" +[ -f "$CKPT" ] || { echo "ABORT: 没有 ckpt $CKPT"; exit 1; } + +# 挑一张空卡;显式给 GPU= 就用那张。demo 要约 17 GB。 +if [ -z "$GPU" ]; then + GPU="$(nvidia-smi --query-gpu=index,memory.used --format=csv,noheader,nounits \ + | awk -F', *' '$2<2000 {print $1; exit}')" + [ -n "$GPU" ] || { echo "ABORT: 没有空闲的卡(都 >2 GB 占用)。别抢别人的。"; exit 1; } +fi +echo "[demo] GPU $GPU · ckpt $(basename "$CKPT") · N=$STEPS 步 · http://$HOST:$PORT/" +export PYTHONPATH="$ROOT" DIFFSYNTH_SKIP_DOWNLOAD=True CUDA_DEVICE_ORDER=PCI_BUS_ID CUDA_VISIBLE_DEVICES="$GPU" +exec "$ROOT/.venv/bin/python" "$ROOT/demo/server.py" \ + --ckpt "$CKPT" --host "$HOST" --port "$PORT" --steps "$STEPS" --vae "${VAE:-taehv_super}" "$@" diff --git a/backup_2026-09-14/code/demo/server.py b/backup_2026-09-14/code/demo/server.py new file mode 100644 index 0000000000000000000000000000000000000000..d80185cca2a4bf5252dade3480f309d7f7d2decb --- /dev/null +++ b/backup_2026-09-14/code/demo/server.py @@ -0,0 +1,195 @@ +"""ActionRoPE 交互 demo:WebRTC 视频 + WebSocket 控制。 + + bash demo/run.sh # 默认绑 127.0.0.1:8420,只有本机能连 + ssh -N -L 8420:127.0.0.1:8420 <这台机器> # 在你自己电脑上开隧道,然后浏览器 localhost:8420 + +★ 默认**只绑回环**。这是共用机器,绑 0.0.0.0 等于把一个能跑 5B 模型的接口暴露给整个内网, + 所以要暴露必须显式 --host 0.0.0.0,且会打印一条警告。别图省事。 + +延迟预算(单张 H200、N=4 步、实测): + DiT 生成 ~175 ms / cell + 流式 VAE 解码 ~25 ms / cell(整片 tiled 解码是 3.6 s/161 帧,流式后不再是瓶颈) + 一个 cell = 4 帧 = 16 fps 下 250 ms 的画面 + 所以生成比播放快,**延迟由缓冲深度决定,不由传输决定**:lead_cells=1 时,一次按键最坏 + 要等「当前 cell 播完 + 下一个 cell 生成」≈ 250 + 200 = 450 ms 才看得见效果。 + WebRTC 相对 WS+JPEG 只省 20~50 ms —— 选它是因为它自带拥塞控制和帧率节拍, + 不是因为它能解决这 450 ms。真要压延迟得动 cell 粒度(模型的时间压缩率是 4),那是模型的事。 +""" +from __future__ import annotations + +import argparse +import asyncio +import fractions +import json +import os +import sys +import time + +import av +import numpy as np +from aiohttp import WSMsgType, web +from aiortc import RTCPeerConnection, RTCSessionDescription, VideoStreamTrack + +HERE = os.path.dirname(os.path.abspath(__file__)) +ROOT = os.path.dirname(HERE) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from demo.engine import CELL_FRAMES, Engine # noqa: E402 + +FPS = 16 +TIME_BASE = fractions.Fraction(1, FPS) + + +class GameTrack(VideoStreamTrack): + """把引擎的帧队列按 16 fps 节拍推出去。 + + 队列空时**重复上一帧**而不是阻塞:WebRTC 的节拍一旦被拖住,浏览器侧的 jitter buffer + 会加深,之后每一帧都多欠一份延迟,比丢一帧糟得多。 + """ + + kind = "video" + + def __init__(self, engine: Engine): + super().__init__() + self.engine = engine + self.last = None + self.n = 0 + self.repeats = 0 + + async def recv(self): + pts, _ = await self.next_timestamp() + f = self.engine.pop_frame() + if f is None: + f = self.last + self.repeats += 1 + if f is None: # 还没 reset,先给一块黑 + f = np.zeros((480, 832, 3), np.uint8) + self.last = f + self.n += 1 + frame = av.VideoFrame.from_ndarray(f, format="rgb24") + frame.pts, frame.time_base = pts, TIME_BASE + return frame + + +def build_app(engine: Engine, first_frames: list[str], log=print) -> web.Application: + app = web.Application() + app["pcs"] = set() + + async def index(_): + return web.FileResponse(os.path.join(HERE, "index.html")) + + async def frames(_): + return web.json_response([os.path.basename(p) for p in first_frames]) + + async def offer(request): + params = await request.json() + pc = RTCPeerConnection() + app["pcs"].add(pc) + + @pc.on("connectionstatechange") + async def on_state(): + log(f"[rtc] {pc.connectionState}") + if pc.connectionState in ("failed", "closed"): + await pc.close() + app["pcs"].discard(pc) + + pc.addTrack(GameTrack(engine)) + await pc.setRemoteDescription(RTCSessionDescription(params["sdp"], params["type"])) + answer = await pc.createAnswer() + await pc.setLocalDescription(answer) + return web.json_response({"sdp": pc.localDescription.sdp, "type": pc.localDescription.type}) + + async def ws(request): + sock = web.WebSocketResponse(heartbeat=10) + await sock.prepare(request) + loop = asyncio.get_running_loop() + async for msg in sock: + if msg.type is not WSMsgType.TEXT: + continue + try: + m = json.loads(msg.data) + except Exception: # noqa: BLE001 + continue + t = m.get("type") + if t == "action": + v = engine.velocity_from_keys(float(m.get("dx", 0)), float(m.get("dy", 0)), + float(m.get("mult", 1.0))) + engine.set_velocity(float(v[0]), float(v[1])) + elif t == "reset": + name = m.get("first_frame") + path = next((p for p in first_frames if os.path.basename(p) == name), + first_frames[0]) + # 必须走 infer.load_first_frame:它按 26:15 居中裁剪再缩到 832×480。 + # 裸 imread 会把 bg50 的 1536×1024 原图直接喂进去 ⇒ latent 从 30×52 变 64×96, + # token 数 4 倍,实测生成从 ~190 ms 涨到 768 ms,而且步速尺度也错了。 + from actionrope import infer as _inf + img = _inf.load_first_frame(path) + # reset 会重建 KV 与 VAE 缓存,是阻塞的 GPU 操作 —— 丢到线程池, + # 否则 aiohttp 的事件循环会卡住,连带 WebRTC 的心跳一起停。 + engine.stop() + await loop.run_in_executor(None, engine.reset, img) + engine.start() + await sock.send_json({"type": "reset_ok", "first_frame": os.path.basename(path)}) + elif t == "config": + if "lead_cells" in m: + engine.lead_cells = max(1, min(4, int(m["lead_cells"]))) + elif t == "stats": + await sock.send_json({"type": "stats", **engine.stats, + "buffered": len(engine.out), + "lead_cells": engine.lead_cells}) + return sock + + app.router.add_get("/", index) + app.router.add_get("/frames", frames) + app.router.add_post("/offer", offer) + app.router.add_get("/ws", ws) + + async def on_shutdown(app): + for pc in list(app["pcs"]): + await pc.close() + engine.stop() + app.on_shutdown.append(on_shutdown) + return app + + +def main(argv=None): + ap = argparse.ArgumentParser(description="ActionRoPE 交互 demo") + ap.add_argument("--ckpt", required=True, help="832 键的 flow map 学生(stage2/stage3 的 ema)") + ap.add_argument("--host", default="127.0.0.1", help="默认只绑回环。共用机器,绑 0.0.0.0 前先想清楚") + ap.add_argument("--port", type=int, default=8420) + ap.add_argument("--steps", type=int, default=4, help="any-step 采样步数;2 更快、4 更稳") + ap.add_argument("--sink_size", type=int, default=3) + ap.add_argument("--kv_window", type=int, default=17) + ap.add_argument("--rope_cap", type=int, default=20) + ap.add_argument("--scene", default=None, help="场景描述串;不给就用 NULL_PROMPT(bg50 口径)") + ap.add_argument("--first_frame_dir", default=os.path.join(ROOT, "data/eval/eybx_bg_50")) + ap.add_argument("--seed", type=int, default=0) + ap.add_argument("--vae", choices=["taehv_super", "taehv", "full"], default="taehv_super", + help="解码器。taehv* = TAEHV 流式(3 ms/cell),full = 全量 Wan VAE(87 ms/cell)") + args = ap.parse_args(argv) + + import glob + firsts = sorted(glob.glob(os.path.join(args.first_frame_dir, "*.png"))) + if not firsts: + raise SystemExit(f"{args.first_frame_dir} 里没有 png 首帧") + + if args.host not in ("127.0.0.1", "localhost", "::1"): + print(f"!! 正在把 demo 绑到 {args.host} —— 这台机器是共用的,内网里任何人都能连上并占用这张卡。") + print("!! 想安全一点就用默认的 127.0.0.1 + ssh -N -L 隧道。") + + engine = Engine(args.ckpt, steps=args.steps, sink_size=args.sink_size, + kv_window=args.kv_window, rope_cap=args.rope_cap, + scene=args.scene, seed=args.seed, vae=args.vae) + from actionrope import infer as _inf + t0 = time.time() + engine.reset(_inf.load_first_frame(firsts[0])) + engine.start() + print(f"[demo] 首局就绪 {time.time() - t0:.1f}s · {len(firsts)} 张首帧可选") + print(f"[demo] 打开 http://{args.host}:{args.port}/ " + f"(远程的话先 ssh -N -L {args.port}:127.0.0.1:{args.port} 这台机器)") + web.run_app(build_app(engine, firsts), host=args.host, port=args.port, print=None) + + +if __name__ == "__main__": + main() diff --git a/backup_2026-09-14/code/distill/AUDIT_CFPP_2026-09-10.md b/backup_2026-09-14/code/distill/AUDIT_CFPP_2026-09-10.md new file mode 100644 index 0000000000000000000000000000000000000000..53d7e374dcc41849f5e4f8d5251a344b45415cab --- /dev/null +++ b/backup_2026-09-14/code/distill/AUDIT_CFPP_2026-09-10.md @@ -0,0 +1,128 @@ +# CF++ Stage2 CD + Stage3 DMD 移植审计报告(终版) + +路径缩写:`$R=/opt/dlami/nvme/zhiyangdeng/ActionRoPE`,`$U=$R/hf/worldmind_ref/WorldMind/distill/code`,`$G=$R/hf/worldmind_ref/GraphGWM/train/code_distill`。未加前缀的 `distill/…` 均在 `$R` 下。 + +## 1. 结论 + +**CD 逻辑(代码+数学)正确。** `distill/stage2_cd/cd_arope.py` 对 `$U/stage2_cd/cd_gm.py:94-134` 是逐行忠实实现:σ/t/idx 配对、Euler 符号、cell 0 重钉、detach、cells 1: 上的 MSE、cond/clean_x 不变、v 空间 CFG、跨 rank 同步的 idx 流与按 micro 计数的快进、fp32 EMA 影子在真实优化器步之后更新一次、ema_start 硬拷贝窗口、ZeRO-2 下 zip 对齐——CPU 上 oracle 与上游转写位级一致(test_stage2_cd 9/9、test_stage23_upstream_diff 全过)。唯一实质弱点是结构性且已记录的:默认 4 节点部署轴上 σ=0.2516(部署终读点)从不是一致性 source,是固定点族的自由分量(杠杆为上游 σ=0.096 的 2.6×);docstring 的"等于教师一步估计"只在 step 0 成立。**DMD 逻辑(代码+数学)正确**:x0 = x_t − σv、共用一份噪声与 t、(pred_fake − pred_real)/‖gen − pred_real‖ 归一化+clamp+nan_to_num、0.5·MSE 代理梯度恰为 +grad 且锚 cell 为 0、[20,980) 索引钳制、x0 空间 CFG、双向教师/critic 无 clean_x、流式重放与融合梯度精确相等(rel<1e-6)、5:1 步序与优化器常量与 `$U/stage3_dmd/dmd_gm.py:193-246, 681-706` 一致,FSDP 习语(prepare 前 fp32、use_orig_params 断言、裸 bf16 教师、每模型 clip、get_state_dict 导出、`_KVRef`)在 torch 2.11/accelerate 1.14 源码层面无误。**一个设计层面的 major**(DMD-1):打分尾巴的 t=0 锚点是学生生成的 cell,且端口同时去掉了所有流形上参考(无真 cell 0、sink=0、VAE 重锚硬拒),其文档论证把 RoPE 坐标漂移与 latent 值漂移混为一谈,导致 DMD 目标对锚点携带的全局外观偏移无恢复力——这不是代码 bug,而是"已记录但论证不完整"的偏差。**另两个 major 是基础设施**:stage2 启动器无 8 卡分支(裸 `DISTILL_NGPU=8` 会以等效 batch 16 训练),以及部署评测脚本用 sink 3/w17 评估按 sink 0/w20 训练的学生。当前 live run(`outputs/distill/stage2_cd`,01:43:07 起,world 8/GA 1/train_batch_size 8,teacher=student=stage1_long_K3 step1000,start_step 0,~5.06 s/步)已由人工绕过了第一个 major,配方正确。 + +## 2. 已确认发现(按复核后严重度排序) + +复核规则:3 位反驳者中 ≥2 未反驳即确认;表中级别为复核后共识。 + +| ID | 级别 | 位置(端口 ↔ 上游) | 机理 / 数学与后果 | 精确修复 | +|---|---|---|---|---| +| **INFRA-1** (CDINFRA-1≡R1) | **major** | 端口 `distill/stage2_cd/run.sh:42-43`(`GRAD_ACCUM:-2`,`ACC_CFG` 硬编码 `accelerate_zero2_4gpu_ga${GRAD_ACCUM}.yaml`,无 `DISTILL_NGPU` 分支)、`:93`(abort 文案"只有 2/4 两份")、`:132`(`--num_processes $DISTILL_NPROC`);`distill/common.sh:36-44`;`cd_arope.py:513-519`(GA 门只比 yaml GA==`--grad_accum`,文案只列 4gpu);`configs/accelerate_zero2_8gpu_ga1.yaml:4-5`("等效 batch 仍是 8…别改 GA")存在但从不被选;`stage2_cd/config.json:68-71`(4×1×2=8)。↔ 上游 `$U/../launch/stage2_v3_ext.sh:37-42`(8×1×1=8,"Reverted from an aborted accum=2 attempt")、`$U/stage2_cd/cd_gm.py:274`(GA 默认 1);本仓库正确范式 `distill/stage2_flowmap/run.sh:52-58`、`distill/stage1_long/run.sh:37-43`。 | eff = world×bs×GA。accelerate 1.14 `launch.py:1272-1277` 仅在 CLI 为 None 时采用 yaml 值 ⇒ `--num_processes 8` 覆盖 yaml 的 4,GA 仍 2 ⇒ **8×1×2=16**(文档/上游 8);DeepSpeed train_batch_size 同为 16(accelerator.py:2223-2227)。`GRAD_ACCUM=1` ⇒ `4gpu_ga1.yaml` 不存在 ⇒ 误导性 abort。续训禁改 GA(`cd_arope.py:587-590`)⇒ step 0 即锁死。后果:裸启动=未记录配方(2× 样本/步、wall-clock 不降、EMA 每样本更新减半),只有 `run.sh:124` 一行"等效 batch=16"提示,无守卫。live run 已手工传 `GRAD_ACCUM=1 ACC_CFG=…8gpu_ga1.yaml` 绕过。 | `run.sh:42-43` 改为:`if [ "$DISTILL_NGPU" = "8" ]; then GRAD_ACCUM="${GRAD_ACCUM:-1}"; ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_8gpu_ga${GRAD_ACCUM}.yaml}"; else GRAD_ACCUM="${GRAD_ACCUM:-2}"; ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_4gpu_ga${GRAD_ACCUM}.yaml}"; fi`;`:93` 后加 `[ $((DISTILL_NPROC*GRAD_ACCUM)) = 8 ]` 断言(`EFF_BATCH_OVERRIDE=1` 放行);`:93` 与 `cd_arope.py:515-518` 文案列出真实 4 份 yaml;`RUNBOOK.md:104` 附 8 卡形式;`config.json:69-71` 注 "4×GA2 或 8×GA1";同样修 `distill/stage1_ar/run.sh:39-40`;修 `configs/accelerate_zero2_8gpu_ga2.yaml:4-5,11` 过期头注释(写 GA1/eff 8,实为 GA2/eff 16)。 | +| **DMD-1** | **major** | 端口 `distill/stage3_dmd/dmd_arope.py:449-457`(`a=total-1-Keff; tail_sl=generated[:,:,a:]`,`first_frame_cond=True`)、`distill/flow_pf.py:328-331`(tail cell 0 不加噪 t=0)、`dmd_arope.py:209-211,222-233`(每 rollout 一个 exit_step;p=1/4 时锚点是 σ=1 的一步输出)、`:658-660`(`--reanchor_every` 硬拒)、`stage3_dmd/config.json:39,46`、`PORT_SPEC.md:375-382`、R10 `:556`、对抗评审 `:666-668`([MAJOR] 未闭合)。↔ 上游 `$U/stage3_dmd/dmd_gm.py:365-367`(sink=3:"frame0 is a REAL VAE-encoded latent → permanent on-manifold anchor")、`:674`(tail=cat(real frame0, last-K))、`:171-178`(decode→末帧→encode 重锚已实现);`DMD_WINDOWING_SPEC.md:61-64,85`(ReactiveGWM 连续尾巴**配** `dmd_tail_reanchor: vae`);`$G/stage3_dmd/dmd_gm.py:158-164`(重锚存在的原因:"darken/wash root cause");`diag_pull.py:5-12`(frankenstein 变暗仅"假设 B",无结果 ⇒ R10 前提未验证);SFT `actionrope/train.py:234-235`(cell 0 恒为真 x0)。 | 端口打分条件 c=(x_a^θ, off−off_a),x_a^θ~p_θ(a=N−20∈[1,7]),未加噪、不打分、detach。(i) 教师在其 cell-0 支撑外被查询(无高斯平滑)。(ii) 对整段窗口的全局外观变换 g(亮度/色偏):教师与 critic 都以 g·x̃_a 为条件 ⇒ pred_fake−pred_real≈0 ⇒ 对 g 零梯度;上游真 frame0 钉住 g=id。sink=0+窗口锚定坐标(off_win=off[j]−off[a])对 RoPE 精确,但与 latent 值离流形正交——`config.json:39` 的"抗漂移机制"论证是混淆。目标只惩罚窗内相对漂移**率**,对锚点携带的累积偏移无恢复力;dmd 带/critic/gnorm 全部看不到。复核者补充:训练时未约束段只有 cell 1..a≤7(真 cell 0 仍在缓存内),部署 sink=0 过 cell 20 后偏移为随机游走。 | (a) 文档:`config.json` `_reanchor_every/_scored_tail`、`PORT_SPEC` R3/R10 改为"sink=0+锚定仅解决 RoPE 坐标 OOD;尾锚是生成 cell(N−20∈[1,7]);目标对锚点携带的全局外观偏移盲",并显式闭合 `PORT_SPEC.md:666-668`。(b) **门**:把 `distill/eval/sweep_photodrift.sh`(41 cell 逐 cell std/mean vs stage2 基线,**按训练几何 sink 0/w20 跑**,见 GEO-1)列为 stage3 冒烟与 EMA 里程碑挑选的必做项,与 rollout_eval 位移一起。(c) 仅当出现窗恒定变暗/偏移:加 `--tail_reanchor vae`,仅对 tail cell a 做 `dmd_gm.py:171-178` 的 decode(6 latent)→末像素帧→encode,detach,不动学生缓存(修 (i),不修 g-pin);或按步 rank-sync 抽 a∈{0, N−K} 交替头/尾窗口(修 g-pin;代价 cell 21..27 后驱逐信号减半,一位复核者反对)。 | +| **GEO-1** (rollout F1) | **major**(原 blocker) | 端口训练 `distill/stage3_dmd/run.sh:57-59`(KV_WINDOW 20/SINK 0/ROPE_CAP 20)、`dmd_arope.py:543-549`;`distill/eval/rollout_eval.py:588-590` 默认 0/20/20 **但** `distill/eval/sweep8.sh:50`、`photodrift.sh:16`、`paired50.sh:23` 硬编码 `--sink_size 3 --kv_window 17 --rope_cap 20`;`longhorizon/README.md:47`;本机 42 份 `outputs/distill/eval/stage1_long_K3/*.json` 全记 sink 3/w17/121 cell;`distill/tests/preflight.py:100,119-125`(锚到第一个保留 cell=cell 0 ⇒ 绝对坐标);`rollout_eval.py:745` 仅为 flowmap 读元数据。↔ 上游 `$U/stage3_dmd/run.sh:46`(训练=部署 sink3/w17/cap20)、`DMD_WINDOWING_SPEC.md:48-50`(train/infer 同几何);`PORT_SPEC.md:359`、`RUNBOOK.md:170-174`(两几何仅 k≤20 重合,只说"可比较");`test_world_rope_window.py:19-28,323-345`(sink>0 = OOD 负控制)。 | k≤20 保留集相同;k=21 差 {0,3},k≥23 各差 3 cell。sink 3 下窗内跨度 357 px(k21)→426 px=1.14×包络(k25)→686 px=1.84×(k40) 线性增长(sink 0 恒 346 px);当前 cell 掩码 known 比例 0.58→0.17(k40)→0(k≥48,=README 的 12 s)。时间位置两者同为 0..20,差异全在 h/w RoPE 与掩码通道——恰是 test c2/d2 证明 stage3 rollout 从不产生的输入。后果:stage3 EMA 之间及 vs stage2 的 paired50/photodrift(cell>20)度量的是 OOD 外推,ckpt 选择轴错误;训练本身与默认 rollout_eval 路径一致(故降级 major)。 | 三个脚本删掉 `--sink_size 3 --kv_window 17 --rope_cap 20`(默认即训练几何);顺手替换死路径 `/tmp/claude-2011/…`(`sweep8.sh:17`、`photodrift.sh:12`、`paired50.sh:12`,本机无法运行)。`rollout_eval.py` 在 `_ckpt_metadata`(`:120-127`,`:745` 附近)读 do_save 写的 `kv_window/sink_size/rope_cap`(`dmd_arope.py:1090-1093`),存在且与 CLI 不等则拒绝,除非 `--allow_geometry_mismatch`(stage1/2 ckpt 无这些键,不受限)。sink3/w17 只作 RUNBOOK:174 的显式 A/B,不作唯一选择轴。stage1_long_K3 的 121-cell 基线需按 sink 0/w20 重跑。若产品几何确为 sink 3:改 `run.sh:57-58` 并重写 `PORT_SPEC.md:359`/`_geometry`——二选一。 | +| **CD-1** | minor | 端口 `distill/stage2_cd/cd_arope.py:118-122`(docstring:"学生在那里的行为等于 stage1 教师的一步估计")、`:741-743,:758`(`idx∈[0,K-2]`)、`:138-146`(`build_cd_axis` 只向下追加)、`:299-301`/`run.sh:52`/`config.json _cd_tail_t`(默认 0,"不改用户拍板的轴");部署终读同节点 `distill/eval/rollout_eval.py:212-214`、`dmd_arope.py:228`。↔ 上游 `$U/stage2_cd/cd_gm.py:65-69`(N=48,自由节点 σ=0.0962)、`:435`;`$U/stage2_cd/run.sh:41`(部署 1000,250);48 轴节点 45..47=[0.25,0.1786,0.0962](CPU 验证)⇒ 上游终读 σ=0.2516 落在 SOURCE 节点旁。 | f(x,σ)=x−σv(c_skip=1, c_out=−σ)。平稳解族 {f(·,σ_i)=f(·,σ_3)∘Φ_2∘…∘Φ_i},f(·,σ_3) 任意(含常数);CM 边界条件只在 σ→0 由参数化强制,此处 c_out=−0.2516(上游 −0.096 的 2.6×)。共享参数下 pair 0-2 的梯度会顺带移动 v_θ(·,σ_3),无恢复项。docstring 等式仅 step 0 成立(student==ema==teacher)。已验证 `CD_TAIL_T=100` ⇒ 轴 [1,0.75,0.5006,0.2516,0.1011],4 对,部署节点不变。后果有界:`cm_err/tgt_err` 已按 idx 记录(`:249,:716,:799-800`;idx==2 行的 tgt_err 即 ‖f_EMA(·,0.2516)−x0‖²,live run 目前 ~0.04-0.05),stage3 在 exit_step=3 时直接训练该节点(`dmd_arope.py:219-228`)。 | 改 `:120-121` docstring 为"初始时等于教师一步估计,此后无约束项维持(上游 σ=0.096 节点同理,仅杠杆小 2.6×)";RUNBOOK/PORT_SPEC §Stage2 注明哪个节点无约束。训练中盯 `train_log.csv` idx==2 行的 tgt_err 相对 step≤200 基线;仅当 cd 降、tgt_err 升时,以**新 OUT** 跑 `CD_TAIL_T=100` 消融(续训不能改轴;轴系用户拍板,不改默认;改则同步 `cd_arope.py:299-301`/`run.sh:52`/`config.json`/`test_stage2_cd.py::test_1`)。 | +| **INFRA-2** (CDINFRA-2) | minor | 端口 `cd_arope.py:575-597`(续训只查 step/grad_accum/axis_sigmas;`:594` 重指 student/ema,`args.teacher_ckpt` 不动,`:617` 原样加载)、`:738-740`(progress.json 无 ckpt 路径;`runlib.py:224-229`)、`:449-452`(meta gate 只比 tf/windowed,不比身份)、`run.sh:15`(`AR=… # 换一个 stage1 检查点`)、`:38/:76`(固定 OUT + RESUME=auto)、`:123`(横幅"teacher = student init = $AR"续训时为假);`_smoke_stage2_cd/progress.json` 实测键集无 ckpt 字段。↔ 上游 `$U/stage2_cd/cd_gm.py:326-337,472-473`(同洞,但 `stage2_v3_ext.sh:17-29,41-42` 硬编码 RD/TEACHER 并断言状态);`PORT_SPEC.md:249`(P1 同源要求)。 | 目标 cm_tn=lat_tn−σ_tn·EMA(lat_tn),lat_tn=lat_t+(σ_tn−σ_t)·T_B(lat_t)。student/EMA 若来自对 T_A 蒸馏的 run,链条锚在 f_A(·,0.25)∘Φ_{T_B},loss 有限且下降,无报错。后果:一旦 progress.json 出现(step 500),>10 min 后换 `AR=` 进默认 OUT 的重启静默续训旧权重。live run 已从 step 0 起。 | do_save `:738-740` 的 `write_progress` 加 `student_ckpt=args.student_ckpt, teacher_ckpt=args.teacher_ckpt`(CLI 值,`student_init` 续训后是 dits 路径);`:593` 后加 `for k in ("student_ckpt","teacher_ckpt"): old,new=prog.get(k),getattr(args,k); if old and new and realpath(old)!=realpath(new): raise SystemExit(...)`(dry_run 下两者为 None,需 None-safe);旧 progress.json 回退读 dits header 同名键(`:722-725` 已写);stage3 镜像 `dmd_arope.py:1112` 与 `:891-914`;修 `run.sh:123` 横幅;`RUNBOOK.md:180` 记"换 AR= ⇒ 换 OUT 或 RESUME=none"。**live run 结束后再改。** | +| **FSDP-CAST** (S3-FSDP-1≡dit-wrapper F1) | minor | 端口 `dmd_arope.py:193-195`(`student(..., offset_win=ow)` fp32)、`:456-457`(`cond_t` `offset_px` fp32 → critic `:370`)、`:968/:991-996`(教师裸 bf16 不 prepare)、`distill/arope_dit.py:755,:892`(forward **内**才 `.to(float64)/PX_PER_TOKEN`)、`_KVRef` docstring `:217-231`(只提容器重建)。↔ 库/上游:torch 2.11 `fsdp/_runtime_utils.py:610-627`+`distributed/utils.py:59-63`(root cast 所有浮点 kwargs→bf16)、accelerate 1.14 `utils/dataclasses.py:2118-2124`(未设 `cast_root_forward_inputs`,默认 True `fsdp/api.py:225`);`$U/stage3_dmd/dmd_gm.py:569-576`(教师也 FSDP 包 ⇒ 对称);部署 `actionrope/infer.py:606`、`rollout_eval.py:477-478` 传精确 fp32;stage2 DeepSpeed 无输入 cast。 | bf16 8 位尾数:|o|<256 px 误差≤0.5 px,[256,512) ≤1 px;锚定窗跨度≤373 px ⇒ ≤1 px=1/32 token=≤0.031 rad(顶频 1 rad/token,`arope.py:68-81`),两 cell 相对≤2 px。掩码由 fp32 在调用前算好,不受影响(`dmd_arope.py:151,457`)。**时间步半边不成立**:`_per_token_timestep_pf` 对所有调用方按 latent dtype 取整(`arope_dit.py:177`);复核者对教师侧 latent 是否 fp32 有分歧,属二阶。后果:学生/critic 与教师、与 SFT/部署间 ≤1/32 token 坐标不一致;量级远低于 DMD 信号,但未记录;step-0 "dmd 恰为 0"(`:473-474,:921,:1173`)在 FSDP 下只 ≈0;`tests/test_world_rope_window.py:176-181` 的"f32 ⇒ 训练中精确"在 FSDP 下不成立。 | 首选(局部):偏移以 int64 定点传入——`frame_cond :150-152`、`:456-457`、probe `:487` 用 `(off*1024).round().to(torch.int64)`,`arope_dit.py:755/:892` 解码 `.to(float64)/1024/PX_PER_TOKEN`;两入口断言 `offset.dtype not in (bf16, fp16)`。备选:prepare 前 `plugin.mixed_precision_policy = dataclasses.replace(plugin.mixed_precision_policy, cast_root_forward_inputs=False)`(须重验 latent/timestep dtype 路径;一位复核者反对)。无论如何:PORT_SPEC 风险表新增一条;step-0 注释改"≈0";`test_stage3_dmd.py:257` 的 `==0.0` 不要变成 FSDP 运行时断言。 | +| **S3-GUARD-3** | minor | 端口 `dmd_arope.py:1237-1238`(`gng=_clip(...)` 直接 `opt_g.step()`,gng 只进日志 `:1261,:1271,:1280`)、`:1161-1172`(唯一 abort=预跑 probe,一次 backward,不覆盖 `stream_grad_replay :273-340` 的 20 次交错 backward)、`:1259-1263`(LOG_EVERY=10 ⇒ step 1 的 gnorm_g 不打印);承诺处 `PORT_SPEC.md:540-541`(R5)、`:586`(S7a)、`configs/accelerate_fsdp_dmd_8gpu.yaml:13`、`_4gpu.yaml:11`("从第 1 步就打印 grad_norm,恰为 0 立刻中止")。↔ 上游 `$G/stage3_dmd/dmd_gm.py:1193-1208`(gnorm_g 是 FSDP 下唯一可信信号,仅打印)、`$U/stage3_dmd/dmd_gm.py:641-648`;`_scheme2_docs/docs/交接_蒸馏_STAGE2_NEXT_SESSION.md:283`(真实发生过:gnorm_g=0.00 每步、critic 正常、生成器没学)。 | step 0:critic==teacher(cfg=1)⇒ dmd 恰 0 合法(`test_stage3_dmd.py:256`)。step≥resume_step+1:critic 已走 critic_steps=5 步 ⇒ pred_fake≠pred_real ⇒ 代理 d/dg=grad/n≠0 ⇒ gng>0 是硬不变量;恰为 0.0 只能是 autograd/FSDP 路径断裂。后果:无学习 run 烧完 500 步而 critic loss 动、dmd 打印"健康"。 | `:1237` 与 `:1238` 之间加 `if step > resume_step and (gng == 0.0 or math.isnan(gng)): raise SystemExit(f"[gnorm] generator grad norm {gng} at step {step}: student receives no gradient (check FSDP backward setup / fsdp_use_orig_params / autocast cache / stray detach)")`(FSDP `clip_grad_norm_` 是集合通信,各 rank 同值,不会挂;inf 不 abort,clip 已归零);同步 `config.json:109 _gate`、PORT_SPEC R5、两份 yaml 头注释;可选 CPU 测试 monkeypatch `_clip` 返回 0 断言 SystemExit。 | +| **GEO-2** (rollout F2) | minor | 端口 `arope_dit.py:875-877`(mask_emb 加进残差流)、`:338-339,:353-357`(缓存 pre-RoPE K/V,掩码内容已在 x 中,读时只重做旋转)、`dmd_arope.py:150-151`(cell j 的掩码锚在 `max(0,j−20)`)、`:449-457`(打分掩码锚在 N−20);过度表述 `PORT_SPEC.md:366`("bit-for-bit")`,368`、`dmd_arope.py:145-146`、`arope_dit.py:325-326`、`data.py:127-131`;`test_world_rope_window.py` d1 仅 a=0(`:352-359`)、a3 故意固定掩码(`:198`);`test_stage3_dmd.py:186-209` 只查 shape。↔ 上游 `$U/gamemaster/models/gamemaster_dit.py:212-241` 无空间掩码通道,无对应物。 | 等价训练 clip 需 M(off[j]−off[a]),缓存持 M(off[j]−off[a_j]),a_j27 稳态模式未训练;打分用尾锚掩码是教师 SFT 分布内的**正确**目标条件(3 位复核者中 2 位),与上游 `dmd_gm.py:674-677` 用打分器原生表示一致——不是 bug。 | 只改文档(上述 5 处:"RoPE 重锚定精确(a1/a3)、查询 cell 掩码精确(d1);缓存 cell 的掩码通道按提交时锚点固化,k>20 的历史与锚在 k−20 的 clip 不同——stage2→stage3 输入移位,自强迫训练穿过");加 test d3 记录数值(扩到 k=61)并断言查询 cell 0%;**不要**给教师/critic 喂混合锚掩码(会把双向教师推出分布);可选 `--mask_zero` 消融(须同时作用 rollout 与打分,否则制造新的 c_gen≠c_score);注明 k>27 稳态未训练或按显存抬 rollout_max。 | +| **GEO-3** (rollout F3) | minor | 端口 `arope_dit.py:853-857`(`n_cached==min(frame_index,cap)`)、`:309-316`(`_evict` 使 n_cached==cap 成为提交的不动点)、`:833-835`(docstring 声称能拦重复 commit)、`:801,:923`(`frames_cached` 只写不读;库内无读者)、`tests/test_kv_equiv.py:276-286`(test_5 仅饱和前)。↔ 上游 `gamemaster_dit.py:631-721`(无任何 n_cached 检查,`frames_cached :721` 同样无读者);`$G/graphgwm/models/graph_dit.py:855-857`(记录同一"饱和后形状对内容错")。 | k≥cap 时谓词恒为 cap==cap。CPU 复现(kv_window=3):cell 4 重复提交与跳过 cell 5 均不报错,重复提交改变后续 K/V(max|Δv|=2.5e-2)。现行调用方均每 k 恰提交一次(`dmd_arope.py:194/246,:306/318,:489/495`;`rollout_eval.py:287/300,:334`),`test_stage3_dmd.py:99-135` 的 spy 会拦。后果:无现行错算;未来编辑(重开 re-anchor、提前 `continue`)在 stage3 专门训练的驱逐区静默损坏窗口。 | forward_frame 入口加 `assert kv_cache["frames_cached"] == frame_index, f"frame_index={frame_index} 但缓存最后提交的是 cell {kv_cache['frames_cached']-1} —— 漏 commit 或重复 commit 了"`(消息须含 "frame_index" 与 "commit" 字样,保 test_4 `match="frame_index"`、test_5 `match="commit"`);改 `:833-835` docstring;test_5 扩饱和后重复/跳过用例(kv_window=2,commit 0..3 后重提 3;跳过 4 读 5)。 | +| **GEO-5** (rollout F5) | minor | 端口 `tests/test_world_rope_window.py:45`(`ROOT="/data/zhiyangdeng/ActionRoPE"`)、`:67-68,:91-93`(sidecar 缺失即 skip);同硬编码 `test_kv_equiv.py:42`(仅 sys.path,实测无影响)、`test_bitparity.py:28`、`test_flowmap_model.py:35`(`:548` STAGE1B_CKPT 亦错)、`test_iface_fidelity.py:34`;正确写法 `tests/preflight.py:45`、`test_tf_port.py:32`;`RUNBOOK.md:30`(`cd /data/…`)、`:34`(容忍计数漂移)。↔ 无上游对应;`PORT_SPEC.md:45,359,535,582`(把包络门定为 sink=0 前置门)。 | 本机跑该文件 = 3 passed / 7 skipped(b1/b2/b3/c1/c2/d1/d2);sidecar 实际在 `$R/data/latent/arope_sidecar.pt`;改路径后 10 passed(包络 372.97 px=11.655 tok=23.311 latent;b2 1.0056×/0.2%;c2 sink=1→1.50×)。后果:sink=0 包络内证据门在本机静默不跑(跑起来会过);无 run.sh 调 pytest,不阻塞启动。 | 5 个文件改为 `ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__))))`;corpus fixture 加 `AROPE_REQUIRE_SIDECAR=1` 时 `pytest.fail`(RUNBOOK 启动门用该变量);修 `RUNBOOK.md:30/34`。 | +| **R3** | minor | 端口 `tests/test_stage2_flowmap.py:445-466`(唯一三处一致性测试;`:453` parse_args 无 `--dry_run` ⇒ `stage2_flowmap/fm_arope.py:443-444` 因 stage1b ckpt 缺失 SystemExit,本机红);`test_stage2_cd.py`/`test_stage3_dmd.py` 无此测试;`cd_arope.py:354-362`、`dmd_arope.py:676-687` 同样需 `--dry_run`。↔ `RUNBOOK.md:15-17`、`PORT_SPEC.md:559`(R11) 只陈述规则。 | CPU 复刻:stage2_cd 23 常量 0 不一致;stage3_dmd 29 常量仅 `clamp` 假阳(`'20,980'` vs `dmd_arope.py:669-672` 派生 tuple);flowmap 加 `--dry_run` 后 36/0。今日无漂移;未来单处改动无自动拦截。 | `test_stage2_flowmap.py:453` 加 `"--dry_run"`;克隆到 cd/dmd 测试(`parse_args(["--output",p,"--dry_run"])`,skip 派生键 betas/denoise/clamp 与 ckpt 路径,`checked>=20`),加 run.sh 别名映射(cd: DISCRETE_N→discrete_cd_N、SOLVER_STEPS→teacher_solver_steps、CFG_SCALE→real_guidance_scale、MIN_RT、WINDOW(_SINK)、KEEP_*;dmd: SINK→sink_size、SCORE_FRAMES、OFFSET_CHUNK、CLAMP、KEEP_*)并断言硬编码字面量(`--opt8bit 0 --batch_size 1 --context_extend hold --reanchor_every 0 --frankenstein 0 --scene_dropout 0.0 --use_ema 1`)。 | +| **R4** | minor | 端口 `distill/stage3_dmd/run.sh:52`(硬编码 `accelerate_fsdp_dmd_4gpu.yaml`)、`:158`、`:147`(echo "4gpu.yaml 8 卡"自相矛盾)、`stage3_dmd/config.json:83-85,104-106`、`PORT_SPEC.md:469`(world 4/eff 4)、`dmd_arope.py:746`(`GIB_STATIC_4GPU` 在 8 卡下保守);`configs/accelerate_fsdp_dmd_8gpu.yaml` 与 4gpu 仅 `num_processes` 不同,`stage3_onpolicy/run.sh:42` 在用。↔ 上游 `$U/../launch/stage3_cd15k.sh:10-11`(NPROC=8,部署线)、`$U/stage3_dmd/run.sh:29`(默认 3)。 | stage3 无 GA 旋钮 ⇒ eff=world=8(上游部署线亦 8,非害);运行快照 `env.world_size` 正确(`dmd_arope.py:1035`)。仅文档漂移。 | `run.sh:52` 加 DISTILL_NGPU 分支(模板 `stage3_onpolicy/run.sh:41-45`,**不是** stage2_cd);`:147` 打印 `等效 batch=$DISTILL_NPROC`;`config.json` 加 `_world_size` 注、`PORT_SPEC.md:469` 记 "processes=DISTILL_NGPU,eff=processes"。 | +| **R2** | info | 端口 `stage2_cd/run.sh:32-33,:97`(`AR` 单变量喂 teacher+student)、`:80-88`(默认 `stage1_ar_tf/dits/dit_step12000` 本机不存在 ⇒ abort;`:85` 的 `AR=` 提示在 `-d $STAGE1_OUT/dits` 分支内,本机不打印);TEACHER/STUDENT 属 stage3(`stage3_dmd/run.sh:41,43`),INIT 属 stage1_long(`:28`)。↔ 上游 `$U/stage2_cd/run.sh:24,34`(`AR_CKPT` 同一约定)。 | 失败响亮(abort),非静默;override 名已在 `run.sh:15`、`PORT_SPEC.md:301` 记录。 | 用 `AR=`;把 `:85` 提示移出分支;`RUNBOOK.md:104` 写明 `AR=` 与长教师。**不要**加 TEACHER 别名:stage3 的双向 SFT ckpt(`outputs/arope_10k_ga2/step-10000`)无 tf/windowed 元数据键,`cd_arope.py:452` 只比存在的键 ⇒ 陈旧 `export TEACHER` 会静默通过 P1 门。 | +| **R5** | info | 端口 `stage2_cd/run.sh:76,:116-118`(RESUME=auto)、`cd_arope.py:575-597,:646-652`(不看 `finished` 标志;`:827` 写 `finished=true` 全库无读者);过期前缀 `/data/zhiyangdeng/ActionRoPE`:`stage2_cd/run.sh:13`、`stage3_dmd/run.sh:16`、`stage1_ar/run.sh:12`、`RUNBOOK.md:30/95/128`、`stage1b_adapt/run.sh:34`、`stage3_onpolicy/run.sh:13` 及多份测试 docstring。↔ 上游 `stage2_v3_ext.sh:42`(依赖续 finished run 延长)。 | 同 OUT 冒烟后全量 = 从 step 20 续;数值无害(decay=0 硬拷到 200、warmup 正确续、beta1=0)。本机冒烟已用 `_smoke_stage2_cd`,live run start_step 0。照抄过期路径的真实后果是 `mkdir -p` 到 `/data`(系统盘)并写 ~40 GB ckpt。 | 文档:过期前缀改为 `$R` 或 `$(pwd)`;RUNBOOK 加 `_smoke_stage2_cd` 示例。可选:`:579-580` 对 `finished=true 且 step0**(这是 streamed 重放在 FSDP 多 rank 上的首次执行,S8 仍开,必须人工看);dmd 进 +0.15…+0.68 带;critic 下降;`_budget_gate` 通过;对 `ema_step10/20` 跑 `sweep_photodrift.sh`(已改成训练几何)确认无立即变暗。 + +### 3d. Stage3 DMD 全量 +``` +DISTILL_NGPU=8 \ +ACC_CFG=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/distill/configs/accelerate_fsdp_dmd_8gpu.yaml \ +OUT=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd \ +STUDENT=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step.safetensors \ +bash distill/stage3_dmd/run.sh # 500 步,eff batch 8(=上游 cd15k 的 8 rank),save_every 50,keep_emas 25 +``` +里程碑挑选:`rollout_eval`(位移/动作服从)+ `sweep_photodrift`(41 cell std/mean vs stage2 基线),**均按 sink 0/w20/cap 20**;sink 3/w17 只作显式 A/B。 + +## 4. 已验证正确(摘要) + +**CD 数学与循环** +- 配对 σ_t=sig[idx]>σ_tn=sig[idx+1],idx∈[0,K−2](`cd_arope.py:758,764-766` ≡ `cd_gm.py:105-106,435`);部署轴 idx [0,625,833,937],σ [1,0.75,0.5006,0.251597],t=σ·1000 位级对齐(`flow_pf.py:263-288`,DiffSynth `flow_match.py:52`)。 +- 加噪 `(1−s)x0+sε` cell 0 钉住(`:212` ≡ `cd_gm.py:79-83,111`);教师 Euler `lat_t+(s_tn−s_t)v`,v=ε−x0,每子步重钉(`:233-234` ≡ `:122-123`;DiffSynth `flow_match.py:391,409-411`);cm_t 带梯度、cm_tn 在 no_grad 下由 EMA 算(`:237-245` ≡ `:126-131`);loss=MSE(cells 1:),目标 detach(`:248` ≡ `:133`);oracle loss==0、上游转写位级一致(12/12 pass)。 +- cond/clean_x 在 teacher/student/EMA 三次前向中是同一对象,EMA 取 x=lat_tn 但 clean_x=x0(`:202-206,225,238,244` ≡ `:100-102,117-131`);`first_frame_cond=True`+标量 t 复现 `_per_frame_t`(`arope_dit.py:167-194`)。 +- v 空间 CFG 只作用于冻结教师,uncond=NULL_PROMPT(stage1 scene_dropout=0.1 ⇒ 分布内),cfg==1 跳过(`:206,227-231,666-682` ≡ `:117-121`)。 +- idx 流:CPU 生成器 seed 1234+seed 全 rank 同、每 micro 一抽、按 micro 计数快进,续训拒改 GA/轴(`:741-743,758,573-593` ≡ `:417-422,435`)。 +- 仅一个 nn.Module 进 prepare(`:656`;accelerate 只保留最后一个 Module);教师 bf16 冻结 eval(`:622`);EMA fp32 影子非 nn.Module(`ema.py:66-86`),在 DeepSpeed 真实 step 之后每优化器步更新一次(accelerate `utils/deepspeed.py:264-284`;`:777-793`);ema_start 语义与上游一致(步 1..200 硬拷,201 起衰减);ZeRO-2 下参数全量非分片,zip 顺序/数量/形状断言(`ema.py:49-55`,DeepSpeed `stage_1_and_2.py:805-808`)。 +- AdamW(2e-6, wd 0, betas (0,0.999))、warmup 100 LambdaLR、clip 10 注入 DS 并生效(`:641-645,511-512`;live train.log 印证);GA 门关闭 accelerate 静默采纳路径(`:513-519`);`_ckpt_meta_gate` 接受 stage1_long_K3 step1000(header:teacher_forcing=True、windowed 0/0、827 BF16 张量,额外键 long_seg_dir 被忽略)。 +- 无隐藏 F=61 依赖:F 取自 latent shape,RoPE 表预算到 1024(`cd_arope.py:171,185-193`,DiffSynth `wan_video_dit.py:405-407`)。 +- 三处配方一致:stage2 22 常量、stage3 27 常量 run.sh==argparse==config.json(上游 A 的 6 处 run.sh/argparse 不一致均按 run.sh 侧解决)。 + +**调度器** +- 1000 格网格、权重、`training_target=noise−x0`、`add_noise_pf` 逐 cell 广播(fp32 算 1−σ 再 cast,优于上游 bf16)、`idx_of_t/t_of_idx` 往返、`cd_axis(N)` 与 `set_timesteps(4)` 陷阱规避、`ti2v_noise` 钳制 [20,980)=σ∈(0.0969,0.9959]——全部与 DiffSynth `flow_match.py` 及 `$U/gamemaster/flow_match.py` `torch.equal`(33 tests pass)。 +- bf16 时间步取整(750→752 等)是 SFT/stage1/2/3/部署共用的约定,无 train/infer 网格错配。 + +**DMD/critic 数学、步序、FSDP** +- `x0=noisy−σ·v`,共用一份噪声与 t(`dmd_arope.py:358-370` ≡ `dmd_gm.py:204-219`);归一化 `|clip−pred_real|` 在 eval_idx 上均值 clamp 1e-2 + nan_to_num(`:371-377` ≡ `:221-224`);代理 `0.5·mse(g,(g−grad).detach())` 梯度=grad/n,锚 cell 0(`:378,:391`;CPU autograd 验证);cfg 1.0/3.0 与上游转写位级一致。 +- eval_idx=tail 1..20(`grad_start_range :260-262`,`:353`,`:454` 断言锚不打分);critic 目标 noise−clip 无时间步权重(`:408-413` ≡ `:244-245`);教师/critic `causal=False`、无 clean_x/kv_cache、`first_frame_cond=True` 与 SFT 一致(`:935-936,:131-132,:457`)。 +- 步序 rollout→DMD loss→student backward→clip→opt_g→slr_g→EMA→critic×5→slr_c(`:1189-1257` ≡ `dmd_gm.py:681-706`);AdamW betas (0,0.999) wd 0.01、lr 2e-6/1e-6、warmup 100、clip 10 每模型经 FSDP 自身 `clip_grad_norm_`(`:1054-1059`)。 +- prepare 前全部 `.float()` 并断言(`:957-962`);`fsdp_use_orig_params` 断言(`:836-842`);教师不 prepare;EMA FSDP 包 fp32 冻结、zip 更新(`ema.py:41-63`);`get_state_dict`+safetensors bf16 827 键(`runlib.py:297-353`);`dit.freqs` 在四个裸模块上搬到 device(`:997-1000`);accelerate 1.14 对 FSDP1 多模型+多优化器无限制。 +- 流式重放精确:提交在 no_grad 下且缓存 K/V detach(`arope_dit.py:356-357`),逐帧代理 `0.5·mse/n_eval` 求和=融合代理(`:325`;test_7 rel<1e-6,`config.json _measured cos 1.0`);梯度检查点永不触及 rollout(`arope_dit.py:689-692`)。 +- N/grad_start/exit_step 从共享种子抽并由 rank 0 广播(`:1120-1148`)⇒ 各 rank 前向/反向次数一致,无集合通信错配;`_budget_gate` 在 8 rank 下保守通过;`_KVRef` 在 torch 2.11 `_apply_to_tensors` 下按身份返回(`torch/distributed/utils.py:252-253`)。 + +**Rollout 几何与 DiT 包装** +- RoPE 重锚定精确:q·k 只依赖位置差,f64 下窗口平移 rel 2.3e-15(`build_world_freqs`、DiffSynth `rope_apply :94-100`;test a1/a3);`retained_cells`/`window_offsets_for_frame`/`forward_frame` 的 tpos_j=j−a、off_win_j=off[j]−off[a] 自洽(`preflight.py:77-131`,`arope_dit.py:893-908`);`rope_cap==sink+kv_window` 四处强制。 +- 训练 rollout 与 `rollout_eval.deploy_rollout` 同一代码路径(`rollout_eval.py:79` 导入 `frame_cond`;`:308-358`):同 renoise 链 `den=x−σ_i v; x_next=(1−σ_{i+1})den+σ_{i+1}ε`、t=0 detach 提交每 k 一次;exit_step 语义 ≡ `dmd_gm.py:140-184`(部署跑满表为已记录差异)。 +- 驱逐被训练到:`rollout_min≥sink+kv_window+1=21`,`ROLLOUT 21..27` ≡ 上游;`preflight_sliding_kv` 断言驱逐改变输出(`preflight.py:245-287`)。 +- 掩码:块因果 [S,S] 与 TF [2S,2S] 谓词 ≡ `gamemaster_dit.py:536-567`,所有 local/sink/drop_anchor 组合闭式+探针零泄漏;SDPA bool 语义 True=可见;窗口化 TF 同时约束 clean 半边(已记录,且比上游 `:549-554` 更正确);两半共享 f_start=0 RoPE、per-cell 文本、head 只读 noisy 半边、mask_emb 两半都加(≡ `:496-586`)。 +- KV 路径缓存 pre-RoPE K、读时重旋转、最老非 sink 驱逐、commit 标志/detach、`_evict` 为 while 循环(上游单 if 的超集)、n_sink 钳制(GraphGWM 修的 bug 已含);绝对模式 f_start 与上游 post-RoPE 缓存等价;`forward()` 的 kv 路径守卫(first_frame_cond False、无 clean_x/offset_px/mask_input、无 gc、frame_index 必填)。 +- 偏移/文本外推对齐(`extend_context` hold ≡ `dmd_gm.py:632-637`;`extend_offsets` 积分与 `parse_actions` 一致;`assert_rollout_aligned` 每次前调用);resample 步长≤语料 per-cell p99.9;当前 cell 掩码在 k=20→21 连续(test d1)。 +- 无重复提交:`self_forcing_rollout`、`stream_grad_replay`、`deploy_rollout`、`probe_student_grad` 均每 k 恰一次(spy 测试 `test_stage3_dmd.py:99-135`、`test_kv_equiv.py` test_7/8)。 + +**启动器/环境** +- `common.sh:36-44` 8 卡路径正确(CUDA_VISIBLE_DEVICES 0-7、NCCL_P2P_LEVEL=NVL、OMP 16×8≤160 核);端口无冲突(29532/29536/29541+/29545);磁盘 26 TB 空闲,全量 stage2 ≈180 GB;数据前置全部存在(train_eybx 20983、val_eybx 1175、sidecar、text_table);stage3 `STUDENT` 路径含 `/dits/` 双重拒绝;`_assert_run_dir_safe` 拒外阶段目录/10 min 内活 train.log。 + +### 信息级备注(非发现) +- `PORT_SPEC.md` 仍写 "Expect loss ≈ 0 at step 0" / S7(e),与 `config.json _expect`(部署轴 step 0 loss 非 ≈0)矛盾,会误导冒烟判读。 +- `deploy_schedule` 吸附容差用全局 0.5·max(Δt)(≈2.47),t=3.0 会被静默吸到 idx 999 而非拒绝;固定 4 步表不受影响。 +- 窗口化 TF 的 `local` 含查询 cell 自身:匹配部署 kv_window=20 需 local=21(F=21 下=全因果);配置 0/0,无影响。 +- F=61 TF 掩码 [2S,2S] S=23790 ⇒ 2.26 GB bool 常驻 `_mask_cache` + SDPA 转 bias ~4.5 GB 瞬时;混 21/61 cell 会同时保留两份。 +- `_KVRef` 恢复只在根 `forward()`;依赖嵌套 FSDP 单元不 cast/重建输入(accelerate 留 `cast_forward_inputs=False`)。 +- streamed 重放在 FSDP **≥2 rank** 上从未在任何参考树中执行过(GraphGWM 生产用 fused;端口 streamed==fused 检查为单卡;S8 未闭合)——3c 冒烟是首次,务必逐步看 gnorm_g。 \ No newline at end of file diff --git a/backup_2026-09-14/code/distill/MANIFEST.md5 b/backup_2026-09-14/code/distill/MANIFEST.md5 new file mode 100644 index 0000000000000000000000000000000000000000..32196e7182cb239acb091011720f5dcef2c7a1f0 --- /dev/null +++ b/backup_2026-09-14/code/distill/MANIFEST.md5 @@ -0,0 +1,63 @@ +# distill/ 状态快照 —— 生成于 2026-09-07 14:59:44 stage3-onpolicy 起训前 +# 本版通过:339 tests + stage2-flowmap 8000 步产物 + stage3-onpolicy 20 步 8 卡 FSDP 冒烟 +# (horizon=4、~11 s/step、峰值 75-119 GB/卡、832/827/832 存档键数正确) +# 起训前: md5sum -c distill/MANIFEST.md5 + +d41d8cd98f00b204e9800998ecf8427e distill/__init__.py +f4f75f84ac79b1d03519f2e204959546 distill/arope_dit.py +5584bc8392d100d475c187b1d95d56d0 distill/common.sh +e6de64ae254088f01625e19221111add distill/configs/accelerate_fsdp_dmd_4gpu.yaml +e2ce1fd7ca6d187cacbfa81e78535055 distill/configs/accelerate_fsdp_dmd_8gpu.yaml +0d2bb6efe49b050aea306541b4a34d65 distill/configs/accelerate_zero2_4gpu_ga2.yaml +85ee449b05bf9f686f14c45196455523 distill/configs/accelerate_zero2_4gpu_ga4.yaml +6a34ea5734cf13f06e924d9754a70c12 distill/configs/accelerate_zero2_8gpu_ga1.yaml +7548174929fd59a62a8a1d194b088575 distill/data.py +3c4bb6e458ae3b9fe4d4ca812e581a18 distill/ema.py +efacdb167135b5bc106b1cadc8bd997c distill/eval/anystep_probe.py +d34dc0469f49fc5826f8094062adf385 distill/eval/flowmap_liveness.py +33963f63c251db48899df3c550c38e2e distill/eval/null_branch_probe.py +86f7ccdda50e7027e88cb0550863f451 distill/eval/rollout_eval.py +908f04c018f2ce1d0e207fd1f88933bd distill/eval/sweep8.sh +dac8e1258f3cbf34db5d2b419ef61aa9 distill/eval/tf_rollout_probe.py +a3324266dd8f3e1ff437a53fa16cd993 distill/flow_map.py +7707dd7f57bd3aa3415c96b9baf99f88 distill/flow_pf.py +d67ba664053d958506178a2d9fe3a470 distill/flowmap.py +166cbbbda1d4bd5fa792cc8f75900a64 distill/onpolicy.py +94fe49fa6b1688529dd563351197b6f8 distill/runlib.py +0ab413868394a1467be20ec317be4ae9 distill/stage1_ar/ar_tf.py +369dcf3e22a04fa74fb8502e2e8e99d7 distill/stage1_ar/config.json +cff6e9ea64e3648ccef727ccebebac62 distill/stage1_ar/run.sh +cf14a9aa4c9f52f15111ac06e6cb3936 distill/stage1b_adapt/run.sh +45f9f10b4ab8a6299e43c291ab4f4b91 distill/stage2_cd/cd_arope.py +2402bf288b7f78d7a30bf65e0aa3868c distill/stage2_cd/config.json +1f635a72fb0e938028afa356b28479cd distill/stage2_cd/run.sh +67f689be9600a8bd540480bb8585a0ea distill/stage2_flowmap/config.json +06875f5dee35b8cc28ff90e456545cf1 distill/stage2_flowmap/fm_arope.py +22507adaec0ef9339b292a24095b3c9f distill/stage2_flowmap/run.sh +043f7d0fcce74f87fd185c3cca6ff9fb distill/stage3_dmd/config.json +20e550d8b05ac9f20412979332400797 distill/stage3_dmd/dmd_arope.py +9de618ffe59f845e52f421665a4adf55 distill/stage3_dmd/run.sh +dfa2de24921c087c842529242e1aeb10 distill/stage3_onpolicy/config.json +6361310acf172703a94a804bf230483f distill/stage3_onpolicy/onpolicy_arope.py +6373a4762e4958eb01dab45b4a1aaa4c distill/stage3_onpolicy/run.sh +0a5c95ab6dfc326869d8185efb816eae distill/tests/preflight.py +0c42f9fed1bf89a626a313750cb97398 distill/tests/test_bitparity.py +644e50542cba2c5accda10b496616cc0 distill/tests/test_cond_dropout.py +8645b069fa5870292e9e80768c56085b distill/tests/test_data.py +b4424fe522987570e086b3c247baab74 distill/tests/test_flow_pf.py +781f3bdeafff7cc4373f5391460ad87a distill/tests/test_flowmap_model.py +6f8c6eb2dda143c914e863879f838a92 distill/tests/test_flowmap_objective.py +61d614833748b9d1fdf4a6ad369daba3 distill/tests/test_flowmap_upstream_diff.py +56f50b9ce20f2f8a756cdbe140bafbc5 distill/tests/test_fm_arope_wiring.py +70abc01e9dece1d8c1ac349bacf65e23 distill/tests/test_iface_fidelity.py +2bb100531f06f83e6c2ac2df864b995a distill/tests/test_kv_equiv.py +f3cd288f4db613489a9cb753816ff1b7 distill/tests/test_onpolicy.py +fdb6bfa9b7e4d365fed7e71fa8b5ce71 distill/tests/test_runlib.py +ae80f988c038cf2a1e5558aecbe51024 distill/tests/test_stage23_upstream_diff.py +0090187c8363f55c0e406499a211c367 distill/tests/test_stage2_cd.py +a45eb617da973973aa8037dba48155b8 distill/tests/test_stage2_flowmap.py +2d41d3760508df0b4608967ba0a5b366 distill/tests/test_stage3_dmd.py +a8ac99c5a2ec7a64637cc8a46b551340 distill/tests/test_tf_port.py +436730aa47115a5d9166f2426c659827 distill/tests/test_world_rope_window.py +d317cfcb9b10cd1ad326ca9dca1cd41c distill/eval/photodrift.sh +a6d75b49e766cedc15b1ebc9e23119c2 distill/eval/sweep_photodrift.sh diff --git a/backup_2026-09-14/code/distill/OPSD_OFFICIAL_NOTES.md b/backup_2026-09-14/code/distill/OPSD_OFFICIAL_NOTES.md new file mode 100644 index 0000000000000000000000000000000000000000..23b8a71d5d78d8169e210816f389e8e9c5d1ffa0 --- /dev/null +++ b/backup_2026-09-14/code/distill/OPSD_OFFICIAL_NOTES.md @@ -0,0 +1,50 @@ +# OPSD-V 官方实现(vendor/OPSD-V,commit 8ecb193,2026-08-31)与 GraphGWM 移植(hf/worldmind_ref/GraphGWM/train/code_distill/stage4_opsd)的差异笔记 + +读的是 `vendor/OPSD-V/model/opsd_streaming_training.py::compute_opsd_generator_loss / setup_opsd_sequence / _replace_cache_chunk_with_gt`、 +`trainer/opsd_streaming.py::fwdbwd_one_step_opsd / _ema_update_lora_teacher_adapter`、`configs/train_self_forcing_lora.yaml`。 + +## 官方机制(逐条) +1. **部署表**:`denoising_step_list: [1000, 750, 500, 250]` + `warp_denoising_step: true`(把 t 映射到 scheduler 的 shift 网格)——与本仓库的 4 步部署表 + `deploy_schedule` 吸附到 1000 网格同构。chunk = 3 个 latent 帧(`num_frame_per_block: 3`);本仓库 chunk = 1 cell。 +2. **两条缓存都从 GT 首 chunk 起**(`opsd_use_gt_first_chunk: true`,t=0 写入)。窗口起点 `window_start` 在 GT 长视频里**随机**(按 block 对齐;`window_start_override: 0` 时固定从 0 起),rollout 长度 `opsd_loss_frames`(180 帧)≤ `opsd_max_loss_frames`(243)。 +3. **每个 chunk、每个去噪步**:同一份 `noise_chunk` / 同一 `noisy_input` 先喂教师(no_grad,权重换成 EMA/teacher adapter),再喂学生(需要 loss 的步 enable_grad)。`opsd_teacher_trajectory_mode: student` ⇒ `teacher_noisy_input = noisy_input`(教师走学生访问的 noisy 状态)。 +4. **loss**:`flow` ⇒ `mean((student_flow − teacher_flow.detach())²)`;`opsd_loss_step_mode: all` ⇒ 每个去噪步都算;`backward_per_chunk: true` 时**逐步** `(step_loss / total_loss_terms / grad_accum).backward()`(不是逐 chunk 累加后再反传),反传后 detach 两条缓存里的张量;`total_loss_terms` = 全窗口被打分的 (chunk, step) 对数。 +5. **重新加噪**:`noisy_input = add_noise(student_chunk.detach(), transition_noise, next_t)`(学生自己的 x0 + 新噪声;stop-gradient 过渡),与本仓库的 renoise 链一致。 +6. **chunk 结束后写缓存**(`context_noise: 0` ⇒ t=0 干净写入):学生缓存写**学生**的最终 x0;教师缓存写**教师自己**的最终 x0(`teacher_chunk`,用 EMA 权重 `_write_chunk_to_cache(use_teacher_ema=True)`)。 +7. **教师缓存的 GT 替换**(`opsd_teacher_context_mode: gt_kv`):写完之后,若已生成 ≥2 个 chunk,把教师缓存里**倒数第二个** chunk 原位替换成 GT(`_replace_cache_chunk_with_gt`:暂存 `global_end_index/local_end_index`,在该位置用 t=0 前向重写 K/V,再恢复 end index)。于是打分第 k 个 chunk 时教师缓存 = **GT 0..k−2 + 教师自己的 k−1**。 +8. **教师权重**:`lora_ema_enabled: true, ema_weight: 0.9999, ema_start_step: 0` ⇒ 教师 = 学生(LoRA)的 EMA,每步更新;`max_iters` 3300(longlive)/ 见 self_forcing 配置。LoRA rank 256,lr 1e-5,`max_grad_norm_generator: 10.0`,gradient checkpointing 开。 +9. `opsd_loss_start_frame: 21`(前 7 个 3 帧 chunk 不打分);`opsd_teacher_use_future_gt_context: false`(教师不看未来 GT,默认关)。 + +## GraphGWM 移植与官方的差异(本仓库移植时要显式选择) +| 项 | 官方 | GraphGWM | 本仓库建议 | +|---|---|---|---| +| 教师缓存里最近一个 chunk | **教师自己**的 x0(`teacher_chunk`) | **学生**的 k−1(`--teacher_keep_last 1`) | 加 `--teacher_last_chunk {teacher,student,none}`,默认 `teacher`(官方) | +| 反传粒度 | 逐去噪步 `(step_loss/total_terms).backward()` | 逐 chunk(chunk 内各步求和 / 步数) | 逐步反传(显存更小),归一化按全窗口 total_terms(官方) | +| 教师权重 | 学生 EMA 0.9999(每步更新) | 冻结(`--ema_decay 0`),理由:全参微调 + 短跑下 EMA 会漂向学生 | 默认冻结,`--ema_decay` 可开(0.9999) | +| loss_start | 21 latent 帧 | 12 | 默认 12,可调;文档写明官方是 21 | +| 窗口起点 | GT 长视频里随机(block 对齐) | 段首(cell 0) | 默认段首(61 cell 全用);`--rollout_cells < 61` 时随机起点 | +| chunk | 3 latent 帧 | 1 | 1 cell(部署也是逐 cell) | +| 缓存写入 | 官方在**原位**替换倒数第二 chunk 为 GT(cache 是固定长度数组 + end index)。**写入顺序**:先 `_write_chunk_to_cache(teacher_chunk)`(此刻缓存里还是 GT 0..k−2 + 教师的 k−1),再把 k−1 换成 GT、**不重算最近一格** ⇒ 打分 k+1 时最近一格(教师的 k)第 1 层起的 K/V 嵌着"教师的 k−1",不是全 GT 历史 | 追加式滑窗缓存做不到原位替换 ⇒ 真实缓存**滞后一帧** + 每 chunk 快照再把学生的 k−1 commit 进快照(K/V 在全 GT 历史上算 —— latent 层面同官方,K/V 层面不同) | 快照法 + 官方写入顺序:cell k 打分完教师把自己的 x0 commit 进**它打分用的那条快照**(上下文正是官方的),取走那格 raw K/V(`last_kv_frame`),cell k+1 用 `append_kv_frame` 接到 GT 0..k−1 的新快照末尾。latent 与逐层 K/V 都与官方相同(test_stage4_opsd::test_13 逐位核对)。student 模式保留 GraphGWM 口径 | +| 教师前向实现 | 换权重(summon_full_params 拷贝 EMA) | 单独一份冻结 bf16 教师模块 | 单独教师模块(同 stage3 real-score 教师) | +| RNG | 教师前向前后保存/恢复 RNG state | 无 | 无 dropout,可略;但打分状态的噪声必须显式共享 | + +## 补充核对(trainer/opsd_streaming.py) +- 训练循环顺序:`zero_grad → [GA 次 fwdbwd_one_step_opsd(逐步 backward,grad 捕获到 deferred buffer)] → 恢复 grad → clip(10.0) → optimizer.step → EMA 更新(LoRA 模式:teacher adapter ← decay·teacher + (1−decay)·student,decay=0.9999)→ step+=1`。 +- 教师 adapter 起始 = 学生 adapter 的拷贝(训练前两者相同 ⇒ 教师起点 = 未 OPSD 的基座);3300 步后 0.9999^3300≈0.72 的权重仍是初始权重 ⇒ 官方教师本质上是「几乎冻结、缓慢跟随学生」。GraphGWM 用完全冻结教师是它的 decay→1 极限,差异可忽略;本仓库默认冻结,可选 EMA。 +- 每个去噪步前保存 CPU/CUDA RNG state,教师前向后恢复,再跑学生:保证学生前向的随机数(若有 dropout 等)与「没有教师前向」时一致;本仓库 DiT 推理无 dropout,可略。 +- `context_noise=0` ⇒ `add_noise(x0, ε, t=0)` = x0(`context_noisy` 名义上加噪,实际是干净写入),与本仓库 t=0 commit 一致。 +- `generated_spans` 不含 GT 首 chunk(只记生成的 chunk)⇒ 第一个生成 chunk 打分时教师缓存 = GT 首 chunk;第 k 个生成 chunk 打分时教师缓存 = GT 首 chunk + GT 生成段 1..k−2 + 教师自己的 k−1(写缓存后再把倒数第二个替换成 GT,最近一个保留)。 + +## 本仓库 `distill/stage4_opsd/opsd_arope.py` 的最终选择(2026-09-10) +| 项 | 选择 | 开关 | +|---|---|---| +| 教师缓存最近一格 | **官方**:教师自己在最后一个去噪步、学生的 noisy 上算出的 x0(未打分 cell 也跑一次教师最后一步) | `--teacher_last_chunk teacher` / `student`(GraphGWM) | +| loss 归一化 | **官方**:整窗所有打分 (cell, step) 的平均(逐 cell backward 时每 cell 均值 ÷ 打分 cell 数) | `--loss_norm window` / `cell`(GraphGWM) | +| 教师权重 | 冻结 init_ckpt(官方 EMA 0.9999 ≈ 冻结;FSDP 下未实现 EMA)。开 EMA 时教师留 **fp32**:bf16 半 ulp ~2e-3 吃不进 1e-4 的增量,bf16 教师上 EMA 会静默退化成冻结(trainer 在加载处断言) | `--ema_decay`(仅单进程) | +| 反传粒度 | 逐 cell(与官方逐步等价) | — | +| grad_clip | **官方** 10.0(`max_grad_norm_generator`;stage3 同值)。曾是 1.0(未记录的偏离;window 归一化下会每步触发,把 AdamW 变成归一化 SGD) | `GRAD_CLIP` | +| Adam betas | **官方** (0.0, 0.999)(`train_self_forcing_lora.yaml` beta1/beta2;stage3 同值)。曾是 (0.9, 0.95)(无出处) | `ADAM_BETAS` | +| loss_start | 12(GraphGWM;官方 21) | `LOSS_START` | +| 窗口起点 | 段首 cell 0(VAE 首 latent 是 TI2V 锚点,不能随机) | — | +| 缓存写法 | 滞后一格的真值缓存 + 每 cell 浅快照 + **官方写入顺序**:最近一格是教师在上一格打分完 commit 进它打分用的快照后取走的 raw K/V(`last_kv_frame` / `append_kv_frame`,arope_dit),不是在全 GT 历史上重新 commit(那样 latent 同、第 1 层起的 K/V 不同,教师轨迹从 cell 3 起与官方分道) | — | +| RNG | 不需要(DiT 推理无 dropout;噪声显式共享) | — | +| 条件 dtype | offset_win / mask 按 latent dtype 量化一次后给两个模型(FSDP 根前向 cast 变空操作) | — | diff --git a/backup_2026-09-14/code/distill/PORT_SPEC.md b/backup_2026-09-14/code/distill/PORT_SPEC.md new file mode 100644 index 0000000000000000000000000000000000000000..6a7a9275fdfab618b9faff04d5a0b5be8bc978ed --- /dev/null +++ b/backup_2026-09-14/code/distill/PORT_SPEC.md @@ -0,0 +1,752 @@ +# ActionRoPE 三阶段蒸馏 — 移植规格(workflow 产出 + 对抗验证修正) + +## 用户已拍板的决定 + +- teacher: 直接用 outputs/arope_10k_ga2/step-10000.safetensors,不再续 SFT + +- stage1 等效 batch = 8 (4 GPU x GA2), lr 1e-5 + +- 部署采样 = 4 步 denoise_list 1000,750,500,250 —— stage2 CD 轴与 stage3 都按这个训 + +- 只能用 GPU 0,1,2,3 + + +## canonical_source +Port from **A = `/data/zhiyangdeng/ActionRoPE/_wm/WorldMind/distill/code/`**, stage by stage, keeping its v5 recipe constants and the `rope_cap == sink + kv_window == F-1` invariant; back-port four things from **B = `/data/zhiyangdeng/ActionRoPE/_wm/GraphGWM/train/code_distill/`**; mine **C** (ReactiveGWM) for config only; ignore **D**. + +Why A: it is the only self-contained, GPU-validated, checkpoint-producing trunk (`docs/CKPT_LINEAGE.md`, deploy pick `stage3_dmd/v3_cd15k/ema/ema_step400`), and its control interface — per-frame conditioning `[B,F,...]` + a clean-history `clean_x` channel + a sliding KV cache — is structurally what ActionRoPE needs. B is a *descendant* of A ("Ported from WorldMind's `distill/code/` on 2026-08-03. The algorithm is unchanged.", B/README.md:3) that swapped the control signal to a numeric `[B,F,10]` action vector — the wrong interface here, since ActionRoPE deliberately keeps per-cell text AND puts action in RoPE. C is not runnable on this box (every math symbol lives in a private DiffSynth fork: `diffsynth.pipelines.reactive_gwm_casual_forcing` is absent from `/data/zhiyangdeng/ActionRoPE/DiffSynth-Studio/`). + +Back-port from B (all four are cheap and each prevents a class of silent failure): +1. `stream_grad_replay` + `--grad_pass streamed` (B `stage3_dmd/dmd_gm.py:287,669`) — the fused DMD rollout graph is 77.8 GB of activations at `grad_horizon=20`. It is exact, not an approximation, because every cache commit runs under `no_grad` (frames are independent single-frame graphs) and the DMD surrogate is a mean-reduced MSE against a fully detached target. We need this on 4 GPUs. +2. `preflight_sliding_kv(...)` (B `:446`, called at `:861`) — millisecond tiny-CPU-model check of the sink/eviction arithmetic before an allocation is burned. +3. The rule **never `torch.utils.checkpoint` the KV-rollout block loop** (B `graphgwm/models/graph_dit.py:838-870`). The sliding commit is destructive; once the cache saturates the replayed read has the right *shape* and the wrong *contents* — no error, silently corrupt gradients. ActionRoPE uses `gradient_checkpoint_forward` on every block (`actionrope/arope.py:387`), so this is a live landmine. +4. `scripts/test_tf_port.py` verbatim as the teacher-forcing gate (5 assertions incl. `clean f -> noisy f` leak == 0.00e+00). + +From C, as configuration only: `dmd_timestep_clamp [20,980]`, `dmd_teacher_offload_cpu`, `*_ema_shadow_device: cpu`, in-process `expandable_segments` before `import torch`, full accelerate-state resume, and the long-tail-rollout idea. + +## target_layout +- /data/zhiyangdeng/ActionRoPE/distill/__init__.py — package marker, exports nothing — new +- /data/zhiyangdeng/ActionRoPE/distill/arope_dit.py — THE central new file. `class AropeDiT(nn.Module)` wrapping DiffSynth `WanModel` + `arope_mask_embedding`, with: (a) `causal` block-causal `[S,S]` mask, (b) `clean_x`/`aug_t` teacher-forcing `[2S,2S]` dual-stream, (c) `init_kv_cache`/`forward_frame` sliding cache with WINDOW-ANCHORED world coordinates, (d) a module-level monkeypatch of `diffsynth.models.wan_video_dit.DiTBlock.forward` so blocks are entered through `block(...)` (FSDP all-gather hook). — derived from `_wm/WorldMind/distill/code/gamemaster/models/gamemaster_dit.py:120-250` (sdpa + SelfAttention + both cache modes), `:449-587` (forward/TF/mask/head-slice), `:591-730` (init_kv_cache/forward_frame), grafted onto `actionrope/arope.py:277-395` (`_block_forward`, `arope_forward`, `build_world_freqs`) +- /data/zhiyangdeng/ActionRoPE/distill/flow_pf.py — per-frame flow-match helpers over DiffSynth's `FlowMatchScheduler("Wan")`: `sample_pf_timestep_ids(B,F,dev)`, `add_noise_pf(x0,noise,idx_pf)`, `training_weight_pf(idx_pf)`, `sigma_of_idx`, `idx_of_t`, `cd_axis(N=48)`, `ti2v_noise(clip, clamp=(20,980))`. — derived from `_wm/.../gamemaster/flow_match.py:21-130`, re-expressed against `DiffSynth-Studio/diffsynth/diffusion/flow_match.py:42-53,353-363,397-407` (which is scalar-timestep-only: `add_noise`/`training_weight` do an `argmin`, and `add_noise_pf`/`sample_pf_timestep_ids` do not exist) +- /data/zhiyangdeng/ActionRoPE/distill/data.py — `DistillBatch` helpers on top of the unchanged `actionrope.dataset.AropeLatentDataset`: `to_device`, `make_mask_input(offset_px)`, `make_weight_map(offset_px)`, plus the two NEW offset utilities the rollout needs — `extend_offsets(offset_px, N, mode)` and `window_offsets(offset_px, a, k)` (re-anchor to the window's oldest retained cell). — derived from `actionrope/dataset.py:220-261`, `actionrope/arope.py:142-179`, `actionrope/infer.py:92-136` (`parse_actions`), and the *idea* of C's `dmd_action_extend_mode: preset_chunks` +- /data/zhiyangdeng/ActionRoPE/distill/runlib.py — run-dir/logging/checkpoint conventions: `resolve_run_dir`, `dit_path/ema_path/critic_path`, `save_dit(accel, model, path, metadata)` (strips `dit.`, keeps 827-key ActionRoPE format, chmod 0644), `load_dit_ckpt(model, path)` (strict except `arope_mask_embedding.*`), `progress.json`, `rotate(pattern, keep)` for dits AND emas AND critics, `TextTee`, `CsvLog`, `JsonlLogger`, `save_state_rotating`. — derived from `_wm/.../gamemaster/infra/run.py:37-310` and `actionrope/train.py:176-197,278-325` +- /data/zhiyangdeng/ActionRoPE/distill/ema.py — `EmaShadow`: fp32 shadow module + `update(student, decay)` via `zip(...)`, `hard_copy`, `state_dict` export. fp32 because a bf16 shadow at decay 0.99 silently drops the 1% update. — derived from `_wm/.../stage2_cd/cd_gm.py:138-148` and `stage3_dmd/dmd_gm.py:309-318` +- /data/zhiyangdeng/ActionRoPE/distill/stage1_ar/ar_tf.py — stage-1 trainer: causalize `outputs/arope_10k_ga2/step-10000.safetensors` under teacher forcing, one trainable model, DeepSpeed ZeRO-2. — derived from `_wm/.../stage1_ar_teacher/ar_diffusion_gm.py:61-135,138-347` fused with `actionrope/train.py:200-271,387-620` (the loop, optimizer, DeepSpeed guards, export, resume) +- /data/zhiyangdeng/ActionRoPE/distill/stage1_ar/run.sh — launcher with absolute paths resolved from the script location (NOT the dead `/opt/dlami/...` ROOT in `scripts/train_arope.sh:6`), `CUDA_VISIBLE_DEVICES=0,1,2,3`, port 29531. — derived from `_wm/.../stage1_ar_teacher/run.sh:30-38` + `scripts/train_arope.sh:14-21` +- /data/zhiyangdeng/ActionRoPE/distill/stage2_cd/cd_arope.py — stage-2 Causal Consistency Distillation: student (ZeRO-2 engine) + frozen bf16 teacher + fp32 EMA shadow, 48-point axis, one teacher Euler step, MSE between x0-estimates. — derived from `_wm/.../stage2_cd/cd_gm.py:63-148,231-489` +- /data/zhiyangdeng/ActionRoPE/distill/stage2_cd/run.sh — 4-GPU ZeRO-2 launcher, port 29532. — derived from `_wm/.../stage2_cd/run.sh:29-41` +- /data/zhiyangdeng/ActionRoPE/distill/stage3_dmd/dmd_arope.py — stage-3 self-forcing DMD: causal student + bidir critic (both FSDP-trainable) + frozen bidir teacher + FSDP EMA; sliding-KV rollout, contiguous scored tail, streamed grad replay. — derived from `_wm/.../stage3_dmd/dmd_gm.py:32-318,321-758` + B's `stage3_dmd/dmd_gm.py:287` (`stream_grad_replay`) and `:446` (`preflight_sliding_kv`) +- /data/zhiyangdeng/ActionRoPE/distill/stage3_dmd/run.sh — 4-GPU FSDP launcher, port 29536; recipe constants from A's run.sh NOT its argparse defaults. — derived from `_wm/.../stage3_dmd/run.sh:39-51` + `launch/stage3_cd15k.sh:33-34` +- /data/zhiyangdeng/ActionRoPE/distill/configs/accelerate_zero2_4gpu_ga2.yaml — 4 processes, ZeRO-2, bf16, GA 2, gradient_clipping 1.0. — derived from `configs/accelerate_zero2_4gpu.yaml` (only `gradient_accumulation_steps` changes) +- /data/zhiyangdeng/ActionRoPE/distill/configs/accelerate_zero2_4gpu_ga4.yaml — same with GA 4 (the eff-batch-16 option). — derived from `configs/accelerate_zero2_ga2.yaml` +- /data/zhiyangdeng/ActionRoPE/distill/configs/accelerate_fsdp_dmd_4gpu.yaml — FSDP1 for stage 3 only: `fsdp_version: 1`, `fsdp_reshard_after_forward: FULL_SHARD`, `fsdp_auto_wrap_policy: TRANSFORMER_BASED_WRAP`, `fsdp_transformer_layer_cls_to_wrap: DiTBlock`, `fsdp_use_orig_params: true`, `fsdp_sync_module_states: false`, `fsdp_cpu_ram_efficient_loading: false`, `fsdp_state_dict_type: SHARDED_STATE_DICT`, `fsdp_activation_checkpointing: false`, `mixed_precision: bf16`, `num_processes: 4`. — derived from `_wm/.../common/accelerate_fsdp_dmd.yaml`; NOTE accelerate 1.14 reads `fsdp_reshard_after_forward` (`accelerate/utils/dataclasses.py:1848`), `fsdp_sharding_strategy` is the deprecated spelling (`:1836`) +- /data/zhiyangdeng/ActionRoPE/distill/tests/test_tf_port.py — the 5-assertion TF gate: clean_x=None bit-identity vs stock `arope_forward` (causal on and off); TF output shape == noisy half; `clean f -> noisy f` leak == 0.0; `clean f -> noisy f+1` effect > 0; `clean f -> noisy Tensor + def init_kv_cache(self, kv_window=20, sink_size=0, rope_cap=20) -> dict + def forward_frame(self, x_k, t_k, ctx_k, frame_index, kv_cache, commit, *, + offset_win, mask_in_k) -> Tensor +``` +`forward()` dispatches to `forward_frame` when `kv_cache is not None`, and asserts `clean_x is None` in that case — the dispatch exists so FSDP's parameter all-gather hook fires; **never call `forward_frame` directly on a wrapped model**. Conversely `init_kv_cache` must be called on the *bare* module (`m.module if hasattr(m,"module") else m`). + +**Why a wrapper at all.** `arope_forward` is a free function that reaches into `dit.patch_embedding`, `dit.time_embedding`, `dit.text_embedding`, `dit.blocks[i].norm1`, `dit.head`. Under FSDP with `TRANSFORMER_BASED_WRAP` on `DiTBlock`, those parameters are sharded and only all-gathered inside the wrapped module's `forward()` — direct attribute access returns shards. This is the #1 silent-corruption risk in the whole port. + +**Changes to the block path.** Monkeypatch once at import: +```python +diffsynth.models.wan_video_dit.DiTBlock.forward = arope_block_forward +``` +`arope_block_forward(self, x, context, t_mod, freqs, *, f, attn_mask=None, kv=None)` is `actionrope/arope.py:277-318` verbatim with one substitution: `self.self_attn(input_x, freqs)` → `arope_self_attn(self.self_attn, input_x, freqs, attn_mask, kv)`. The `arm` hooks are dropped (ARoPE has no arm; `build_arm("arope", …)` returns None). Blocks are called as `block(x, ctx, t_mod, freqs, f=f, attn_mask=mask)` — via `gradient_checkpoint_forward` on the parallel path, and **directly, never checkpointed, on the rollout path**. + +**`arope_self_attn`** — the only genuinely new attention code: +```python +def arope_self_attn(sa, x, freqs, attn_mask=None, kv=None): + n, d = sa.num_heads, sa.head_dim + q = rope_apply(sa.norm_q(sa.q(x)), freqs_q, n) # [b,s,dim] (wan_video_dit.py:93-100) + k_raw = sa.norm_k(sa.k(x)); v = sa.v(x) + if kv is None: # parallel path + k = rope_apply(k_raw, freqs, n) + o = F.scaled_dot_product_attention(_h(q), _h(k), _h(v), attn_mask=attn_mask) + else: # streaming path: raw-K cache + re-RoPE + k_hist, v_hist = kv["k"][kv["layer"]], kv["v"][kv["layer"]] + k_cat = torch.cat([rope_apply(k_hist, kv["freqs_hist"], n), + rope_apply(k_raw, kv["freqs_cur"], n)], dim=1) + v_cat = torch.cat([v_hist, v], dim=1) + o = F.scaled_dot_product_attention(_h(q), _h(k_cat), _h(v_cat), attn_mask=None) + if kv["commit"]: # append RAW k/v, evict oldest past kv_window + kv["k"][kv["layer"]] = _evict(torch.cat([k_hist, k_raw], 1), kv).detach() + kv["v"][kv["layer"]] = _evict(torch.cat([v_hist, v], 1), kv).detach() + return sa.o(_unh(o)) +``` +With `attn_mask=None` and `kv=None` this is bit-identical to stock, because `flash_attention()` in `wan_video_dit.py:30-63` already falls through to `F.scaled_dot_product_attention` — neither `flash_attn` nor `sageattention` is installed in `.venv`. Add `assert not (FLASH_ATTN_2_AVAILABLE or FLASH_ATTN_3_AVAILABLE or SAGE_ATTN_AVAILABLE)` at import so a later `pip install` cannot silently fork the two paths. + +**Causal + TF masks** (`_build_masks`, from `gamemaster_dit.py:531-569`), with `hw = (30//2)*(52//2) = 390`, `Fl = 21`, `S = 8190`: +- plain causal: `fidx = arange(S)//390; mask = fidx[:,None] >= fidx[None,:]` — spatially bidirectional inside a cell, causal across cells. +- TF `[2S,2S] = [16380,16380]`: `eye | clean_mask | noise_self | noise_ctx`, where `noise_ctx = ~cq & ck & (fk < fq)` — a noisy cell f attends its own noisy tokens plus **strictly previous clean** cells, never clean cell f (that is the answer), never another noisy cell. +- windowed variant kept behind `train_local_attn_size` / `train_sink_size` but **unused** (both 0 in stages 1–2). Note A's own bug: in TF mode the window bounds only `noise_ctx`; `clean_mask` stays fully block-causal so a windowed run leaks unbounded history through the clean half (`gamemaster_dit.py:546` vs `:549-554`). Fix it in the port even though we do not use it. + +**TF plumbing summary** (all in `AropeDiT.forward`, `clean_x is not None`): +| item | value | +|---|---| +| tokens | `cat([patch(clean_x)+maskemb(mask_in), patch(x)+maskemb(mask_in)])` → `[b,16380,3072]` | +| timestep | `t_tok = cat([zeros, ts_noisy_tok])` → `[b,16380]`; `t_mod [b,16380,6,3072]` | +| context | `cat([context, context], dim=1)` `[b,42,512,4096]`, ids likewise, `_embed_context` then `f=42` in the block regroup | +| freqs | `cat([freqs21, freqs21], dim=1)` `[b,16380,1,64]` complex128 — gives per-half `f_start=0` **and** identical world coords for clean/noisy cell f | +| head | `x=x[:,8190:]; t=t[:,8190:]` before `dit.head(x, t)` | + +## `distill/flow_pf.py` — scheduler + +DiffSynth's `FlowMatchScheduler("Wan")` (`diffsynth/diffusion/flow_match.py:42-53`) computes the *identical* grid to WorldMind's: `sigmas = linspace(1,0,1001)[:-1]`, `sigmas = 5σ/(1+4σ)`, `timesteps = σ·1000`, `x_t=(1-σ)x0+σε`, target `ε-x0`, and `set_training_weight()` (`:353-363`) is byte-for-byte the same bsmntw bell when `len(timesteps)==1000`. What is missing is the **index-based per-frame API**: + +```python +def sample_pf_timestep_ids(B, F, dev): return torch.randint(0, 1000, (B, F), device=dev) +def add_noise_pf(x0, noise, idx_pf): s = sched.sigmas.to(x0)[idx_pf].view(B,1,F,1,1); return (1-s)*x0 + s*noise +def training_weight_pf(idx_pf): return sched.linear_timesteps_weights.to(idx_pf.device)[idx_pf] +def cd_axis(N=48): s = FlowMatchScheduler("Wan"); s.set_timesteps(N); return s.sigmas, s.timesteps +def ti2v_noise(clip, clamp=(20,980)): idx = randint(*clamp); ... ts scalar, cell0 clean & unnoised +``` +**Direction trap:** `sigmas[0]=1.0` is PURE NOISE, `sigmas[999]≈0.005` is near-clean. "Noisier == higher sigma == LOWER index." Getting this backwards silently trains the wrong noise regime (it is exactly A's `--tf_noise_aug_max_idx>0` bug). + +## `distill/data.py` — dataset + offsets + +`actionrope.dataset.AropeLatentDataset` is used **unmodified**; it already yields everything needed: `input_latents [48,21,30,52] bf16`, `context [21,512,4096] bf16`, `context_ids [21] i64`, `offset_px [21,2] f32`, `offset_tok`, `delta_tok`, `action_idx`, `clip_id`, `kind`, collated by `arope_collate`. All WorldMind dataset machinery is deleted, not adapted: `PrecomputedRenderDataset`, `V4PromptDataset`, `collate_precomputed`, `text_table.pt`, `boss_dropout`/`NEUTRAL_BOSS`, `--v4_prompts`/`--v4_text_table`, `--move_sidecar`/`--coarse_frac`, `--balance {game,game_boss}` + `oversample_clip_files` + `vrising.GAME_OF_BOSS` (a hardcoded 14-boss dict that `KeyError`s on any non-WorldMind filename), and the blake2b `clip_is_val` split (ActionRoPE's split is the offline `train_eybx` / `val_eybx` manifests, so `--val_frac` is meaningless — pass the directories). + +New in this file: +```python +def make_mask_input(offset_px): return known_mask(offset_px/16.0, 30, 52).float().unsqueeze(1) # [b,1,f,30,52] +def make_weight_map(offset_px): return loss_weight_map(offset_px, 30, 52, new_weight=2.0) # [b,1,f,30,52] +def window_offsets(off, a, k): return off[:, a:k+1] - off[:, a:a+1] # anchor-relative, stage-3 +def extend_offsets(off, N, mode, chunk=5, rng=None) -> [b,N+1,2] # 'continue' | 'resample' +``` +Note `make_mask_input` uses `known_mask(...)` directly rather than the handoff's `loss_weight_map(off).eq(1).float()` — the latter only equals the known mask while `new_weight != 1` and `new_weight_shape == "flat"` (with `dist` ramping it silently stops matching). + +## `distill/runlib.py` — checkpoints + +Format stays **ActionRoPE's**, not WorldMind's: single 10.0 GB safetensors, 827 bf16 tensors, DiT keys with the `dit.` prefix stripped, string-valued metadata, `chmod 0644` (safetensors writes 0600). `load_dit_ckpt` is strict except that `arope_mask_embedding.{weight,bias}` may be missing (zero-init) — WorldMind's loader raises on *any* missing key, which would reject every ActionRoPE checkpoint. Run dir: `dits/dit_step{N}.safetensors`, `ema/ema_step{N}.safetensors`, `critic/critic_step{N}.safetensors`, `state_A|state_B` + `state` symlink (stage 1 only), `progress.json`, `config.json`, `train.log`, `train_log.csv`, `train_log.jsonl`. **Rotate `dits/` too** — A rotates only `state_step*` and its v4 stage-1 run cost 746 GB in `dits/` alone. + +## Preconditions (this machine, not yet done) + +```bash +cd /data/zhiyangdeng/ActionRoPE +bash data/unpack.sh "$PWD/data" # 23 pool tars -> data/latent/pool (22,782), then symlink splits +cp hf/data/arope_sidecar.pt hf/data/text_table_actionrope.pt data/latent/ +mkdir -p outputs/arope_10k_ga2 && cp hf/checkpoints/arope_10k_ga2/* outputs/arope_10k_ga2/ +mkdir -p data/eval && cp -r hf/data/eval/eybx_bg_50 data/eval/ +``` +`data/latent/` currently holds only `manifests/`, `pool_shards/` and `text_table_eybx.pt`; `train_eybx`, `val_eybx`, `arope_sidecar.pt` and `text_table_actionrope.pt` do not exist yet, so every command above fails without this. Expect the dataset banner to read `20983 .pt, invalid 1, leak 257, low_rt 2197, used 18528, text_table 361 keys` — matching `hf/checkpoints/arope_10k_ga2/config.json`. Also note `scripts/train_arope.sh:6` hardcodes `ROOT=/opt/dlami/nvme/zhiyangdeng/ActionRoPE`, a dead path here; the new `run.sh` files must resolve ROOT from the script location. + +## stage1 +## Stage 1 — causalization by teacher forcing + +**Product.** `outputs/distill/stage1_ar_tf/dits/dit_step{N}.safetensors` (827 keys, bf16, 10.0 GB, `arope_mask_embedding.{weight,bias}` included). It becomes BOTH `--teacher_ckpt` and `--student_ckpt` of stage 2 with `--teacher_causal 1 --teacher_forcing`. + +**Init.** `outputs/arope_10k_ga2/step-10000.safetensors` (from `hf/checkpoints/arope_10k_ga2/`). This is a *bidirectional* full-clip SFT model — exactly the role `stage1_v4.sh:36`'s `INIT=ckpt/l4_bidir/v4_ortho/dits/dit_step120000.safetensors` plays. + +**Objective** (`distill/stage1_ar/ar_tf.py::ar_tf_loss`, port of `ar_diffusion_gm.py:83-104` fused with `actionrope/train.py:224-271`): + +```python +x0 = batch["input_latents"] # [b,48,21,30,52] bf16 +off = batch["offset_px"] # [b,21,2] f32 +noise = torch.randn_like(x0) # bf16, WM parity (ar_diffusion_gm.py:85) +idx_pf = torch.randint(0, 1000, (b, 21), device=dev) # EXACTLY uniform, independent per cell +noisy = add_noise_pf(x0, noise, idx_pf) # (1-s)x0 + s*eps, s.view(b,1,21,1,1) +ts_pf = sched.timesteps.to(dev)[idx_pf].float() # [b,21] in (4.98, 1000] +# --- the ONE deliberate deviation from WorldMind TF: keep ActionRoPE's TI2V anchor --- +noisy[:, :, 0] = x0[:, :, 0] # cell 0 = clean GT +ts_pf[:, 0] = 0.0 +mask_in = known_mask(off / 16.0, 30, 52).float().unsqueeze(1) # [b,1,21,30,52] +w = loss_weight_map(off, 30, 52, new_weight=2.0) # [b,1,21,30,52] +with torch.autocast("cuda", torch.bfloat16): + v = student(noisy, ts_pf, batch["context"], context_ids=batch["context_ids"], + offset_px=off, mask_input=mask_in, first_frame_cond=True, + clean_x=x0, aug_t=None) # causal=True set at construction +target = noise - x0 +se = (v.float() - target.float()) ** 2 +se, w = se[:, :, 1:], w[:, :, 1:] # cell 0 is the condition: NO loss (ActionRoPE contract) +per_frame = (se * w).sum(dim=(1, 3, 4)) / (w.sum(dim=(1, 3, 4)) * 48) # [b,20] ARoPE sum-w normalisation, per cell +tw = training_weight_pf(idx_pf[:, 1:]).float() # [b,20] bsmntw bell, per cell +loss = (tw * per_frame).mean() +``` + +Three things changed vs `ar_diffusion_gm.py`, each for a stated reason: +- **frame 0.** WorldMind TF trains cell 0 as an unconditional generator (`noise_ctx` is strictly `fk (b f) n c"` regroup lines up row-for-row. This is the ARoPE-native equivalent of `gamemaster_dit.py:524`. + - RoPE: `freqs = cat([freqs21, freqs21], dim=1)` `[b, 16380, 1, 64]` complex128. This *automatically* gives WorldMind's per-half `f_start=0` rule (`gamemaster_dit.py:183-189`) **and** makes clean cell f and noisy cell f share the same world coordinate. Do NOT build freqs for 42 frames. + - mask: `[16380,16380]` bool, built exactly as `gamemaster_dit.py:536-556` with `hw=390`, `Fl=21`, `S=8190`: `eye | clean_mask | noise_self | noise_ctx`. + - head: `x = x[:, 8190:]; t = t[:, 8190:]` before `dit.head(x, t)`; unpatchify with `f=21`. +4. Plain block-causal (`clean_x=None, causal=True`, used by stage 2's few-step student at inference and by stage 3's rollout when not streaming): `fidx = arange(8190)//390; mask = fidx[:,None] >= fidx[None,:]`. + +**Distributed.** DeepSpeed ZeRO-2, one trainable model — i.e. the *unchanged* ActionRoPE stack (`accelerator.prepare(module, optimizer, dataloader)`; LR scheduler deliberately outside prepare and stepped only on `sync_gradients`, `train.py:453,574-575`; `--grad_clip` injected into `deepspeed_config["gradient_clipping"]` before prepare, `train.py:396`; `set_seed(seed, device_specific=True)`, `train.py:392`; `module.dit.freqs = tuple(t.to(device) ...)` AFTER prepare, `train.py:461`). + +**Recipe.** lr 1e-5 constant after 200-step linear warmup; AdamW wd 0.01; grad clip 1.0; `batch_size 1`, `grad_accum 2`, 4 ranks ⇒ **effective batch 8**; `max_steps 12000`; `save_every 500`; `--windowed_train 0 --windowed_sink 0` (full causal, the stage-1 production setting); `--tf_noise_aug_max_idx 0` (**never >0** — `ar_diffusion_gm.py:93` indexes the wrong end of the sigma grid; the near-clean band is `randint(N-k, N)`, not `randint(0,k)`). + +**Exact launch command (4 GPUs):** + +```bash +cd /data/zhiyangdeng/ActionRoPE +export PYTHONPATH=/data/zhiyangdeng/ActionRoPE +export DIFFSYNTH_SKIP_DOWNLOAD=True +export CUDA_VISIBLE_DEVICES=0,1,2,3 +export PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True +export NCCL_P2P_LEVEL=NVL OMP_NUM_THREADS=16 +mkdir -p outputs/distill/stage1_ar_tf +.venv/bin/accelerate launch \ + --config_file distill/configs/accelerate_zero2_4gpu_ga2.yaml \ + --num_processes 4 --main_process_port 29531 \ + distill/stage1_ar/ar_tf.py \ + --init_ckpt outputs/arope_10k_ga2/step-10000.safetensors \ + --train_dir data/latent/train_eybx --val_dir data/latent/val_eybx \ + --sidecar data/latent/arope_sidecar.pt \ + --text_table data/latent/text_table_actionrope.pt \ + --teacher_forcing --tf_noise_aug_max_idx 0 \ + --windowed_train 0 --windowed_sink 0 \ + --new_weight 2.0 --scene_dropout 0.1 --min_rt_ratio 0.8 --val_min_rt_ratio 0.9 \ + --lr 1e-5 --weight_decay 0.01 --warmup 200 --grad_clip 1.0 \ + --batch_size 1 --grad_accum 2 --max_steps 12000 \ + --save_every 500 --keep_last_dits 6 --save_state \ + --val_every 500 --val_n 16 --val_timesteps 200,500,800 \ + --log_every 20 --num_workers 2 --seed 0 \ + --output /data/zhiyangdeng/ActionRoPE/outputs/distill/stage1_ar_tf \ + 2>&1 | tee -a outputs/distill/stage1_ar_tf/train.log +``` + +Resume after a crash: append `--resume outputs/distill/stage1_ar_tf/state` (accelerate state dir; `--resume …/step-N.safetensors` is a weights-only warm start that resets step to 0 — `train.py:465-476`). + +**Cost.** ~5.5 s per micro-batch (WorldMind measured 11 s/optimizer step at GA2 on 8 GPUs for the same 5B at 16,380 tokens), ⇒ ~11 s/optimizer step at GA2 on 4 GPUs ⇒ 12,000 steps ≈ **38 h**. Disk: 24 dits × 10 GB (rotate to 6 = 60 GB) + 2 DeepSpeed state slots ≈ 120 GB. + +**Fallback if the `[16380,16380]` mask is too expensive:** `--no-teacher_forcing` runs the Diffusion-Forcing variant — single 8,190-token stream, plain `[S,S]` causal mask, cell 0 clean, loss on cells 1:. ~2.5× cheaper. Cost: stage 2 must then run `--no-teacher_forcing` too (`cd_gm.py:263-267`: the flag is valid only when the teacher AND student were trained that way). + +## stage2 +## Stage 2 — Causal Consistency Distillation (CF++ "P1 faithful") + +**Product.** `outputs/distill/stage2_cd/ema/ema_step{N}.safetensors` — the **deploy weight** and the stage-3 generator init. `dits/dit_step{N}.safetensors` exists for resume only. Grabbing `dits/` instead of `ema/` silently ships a worse model (`cd_gm.py:483`, `stage2_cd/run.sh:40`). + +**Three models, all `AropeDiT`, all `causal=True`, all initialised from the SAME stage-1 file** (`--teacher_ckpt == --student_ckpt`, CF++ route P1: teacher and student byte-identical and structurally identical at step 0, which is what a *trajectory*-matching objective requires): +- `student` — trainable, DeepSpeed ZeRO-2 engine, `use_gradient_checkpointing=True` +- `ema` — fp32 shadow (`distill/ema.py`), `requires_grad_(False).eval()`, run under `autocast(bf16)`; NOT passed to `accelerator.prepare` +- `teacher` — bf16, `requires_grad_(False).eval()`, NOT passed to prepare + +**Unconstrained node (audit CD-1, 2026-09-10).** On the default 4-node deploy axis the lowest node σ=0.2516 (the deploy's final x0 read) is never a consistency SOURCE (idx ∈ [0, K−2]); it equals the teacher's one-step estimate only at step 0 and no term holds it there afterwards — the same structure as upstream's σ=0.096 node, with 2.6× the leverage (c_out = −σ). Watch `train_log.csv` rows with idx==2: `tgt_err` = ‖f_EMA(·,0.2516) − x0‖² must not climb while `cd` falls. `CD_TAIL_T=100` adds a σ=0.1011 node (4 pairs, deploy nodes unchanged) but only for a NEW run — the axis cannot change on resume. + +Only one `nn.Module` goes into `prepare` — this is mandatory, not stylistic: `accelerate/accelerator.py:2229-2236` loops `for obj in result: if isinstance(obj, nn.Module): model = obj`, so **the last model silently wins and everything else is left unwrapped with no warning**. With ZeRO-2 params are not sharded, so the naive `zip(ema.parameters(), student_module.parameters())` EMA is exact — the same guarantee WorldMind gets from `fsdp_use_orig_params: true` (`cd_gm.py:32-36`), obtained here for free. + +**One training step** (`cd_generator_loss`, port of `cd_gm.py:91-134`): + +```python +sig, tst = cd_axis(48) # FlowMatchScheduler("Wan").set_timesteps(48) + # sigmas=[1.0,0.99576,...,0.17857,0.09615], t=sigmas*1000 +idx = int(torch.randint(0, 47, (1,), generator=idx_rng)) # idx in [0,46]; CPU gen seeded 1234+seed, + # IDENTICAL on all ranks -> same consistency level +s_t, s_tn = sig[idx], sig[idx + 1] # s_tn < s_t +t_v, tn_v = float(tst[idx]), float(tst[idx + 1]) +eps = torch.randn(x0.shape, dtype=x0.dtype, device=dev) # bf16 +lat_t = (1 - s_t) * x0 + s_t * eps +lat_t[:, :, 0] = x0[:, :, 0] # cell 0 clean (i2v anchor) +cond = dict(context=ctx, context_ids=ids, offset_px=off, mask_input=mask_in, + first_frame_cond=True, clean_x=x0, aug_t=None) # HELD INVARIANT across all 3 forwards +with torch.no_grad(), autocast_bf16(): + v_pred = teacher(lat_t, t_v, **cond) # scalar t + first_frame_cond => ts[:,0]=0, rest=t_v + lat_tn = lat_t + (s_tn - s_t) * v_pred # ONE Euler step toward clean + lat_tn[:, :, 0] = x0[:, :, 0] # re-clamp cell 0 +with autocast_bf16(): + cm_t = lat_t - s_t * student(lat_t, t_v, **cond) # grad +with torch.no_grad(), autocast_bf16(): + cm_tn = lat_tn - s_tn * ema(lat_tn, tn_v, **cond) # no grad +loss = F.mse_loss(cm_t[:, :, 1:].float(), cm_tn[:, :, 1:].detach().float()) +``` + +Notes that matter: +- ActionRoPE's `first_frame_cond=True` + a **scalar** timestep already produces exactly WorldMind's `ts_pf[:,0]=0, ts_pf[:,1:]=t_val` (`actionrope/arope.py:213-228`). No per-frame timestep vector is needed here, only in stage 1. +- `real_guidance_scale` defaults to **1.0** and the uncond forward is skipped when `abs(cfg-1)<1e-6`. But unlike WorldMind, ActionRoPE **does** have conditioning dropout (`--scene_dropout 0.1` against `NULL_PROMPT = "In a 2.5D top down view."`, `actionrope/prompts.py:29`), so the null forward is *in* distribution and cfg>1 is a legitimate knob. Keep 1.0 for the first run (it is also 2× cheaper), sweep later; if you sweep, the uncond embedding is `text_table_actionrope.pt[NULL_PROMPT]` broadcast to `[b,21,512,4096]` — **not** a WorldMind-style `make_neg_emb.py` artifact, and `common/neg_emb.pt` does not exist in that tree anyway. +- The loss is plain unweighted MSE — ActionRoPE's new-region weight map is deliberately NOT applied. CD matches the teacher's own trajectory; re-weighting it would make the student's fixed point differ from the flow it is being distilled from. (Flagged as an open question.) +- The consistency axis never reaches σ=0: the lowest pair is `(0.17857, 0.09615)`. That is why the deploy schedule must end at the low-noise end. + +**Windows.** `--windowed_train 0 --windowed_sink 0` (full causal over the 21 cells). WorldMind's "iron rule" 20/1 is *bit-equivalent to full causal at F=21* — and here a naive `W=20, sink=0` would drop cell 0 from cell 20's context, which is fatal because cell 0 is ActionRoPE's clean anchor. Use full causal and re-derive only if F ever moves. + +**EMA.** decay 0.99, `ema_start 200` (hard copy `ema←student` for step<200), applied once per optimizer step. Half-life ≈ 69 steps: this is a *target network*, not a cosmetic average. Expect loss ≈ 0 at step 0 (all three models identical) and rising. + +**Optimizer.** `torch.optim.AdamW(lr=2e-6, weight_decay=0.0, betas=(0.0, 0.999))` — beta1 = 0 is intentional CF convention, do not "fix" it. `--opt8bit 0`: bitsandbytes is **not installed** in `.venv` (verified), and on 4×143 GB we do not need it. Grad clip 10.0. LR: linear warmup 100 then constant forever, which makes every `save_every` boundary a legitimate stop point. + +**Exact launch command (4 GPUs):** + +```bash +cd /data/zhiyangdeng/ActionRoPE +export PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True +export CUDA_VISIBLE_DEVICES=0,1,2,3 +export PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True +export NCCL_P2P_LEVEL=NVL OMP_NUM_THREADS=16 +AR=/data/zhiyangdeng/ActionRoPE/outputs/distill/stage1_ar_tf/dits/dit_step12000.safetensors +mkdir -p outputs/distill/stage2_cd +.venv/bin/accelerate launch \ + --config_file distill/configs/accelerate_zero2_4gpu_ga2.yaml \ + --num_processes 4 --main_process_port 29532 \ + distill/stage2_cd/cd_arope.py \ + --teacher_ckpt "$AR" --student_ckpt "$AR" \ + --teacher_causal 1 --teacher_forcing \ + --windowed_train 0 --windowed_sink 0 \ + --discrete_cd_N 48 --real_guidance_scale 1.0 \ + --ema_decay 0.99 --ema_start 200 \ + --train_dir data/latent/train_eybx --sidecar data/latent/arope_sidecar.pt \ + --text_table data/latent/text_table_actionrope.pt \ + --scene_dropout 0.0 --min_rt_ratio 0.8 \ + --lr 2e-6 --opt8bit 0 --batch_size 1 --grad_accum 2 --max_steps 8000 --warmup 100 \ + --save_every 500 --keep_last_emas 25 --keep_last_dits 2 \ + --log_every 20 --num_workers 2 --seed 0 \ + --output /data/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd \ + 2>&1 | tee -a outputs/distill/stage2_cd/train.log +``` + +`--scene_dropout 0.0` because CD has no CFG (WorldMind forces `boss_dropout=0.0` for the same reason, `cd_gm.py:355,362`). + +**Resume** is weights-only (`dits/dit_step{N}` → student, `ema/ema_step{N}` → EMA, step from `progress.json`) and must fast-forward the idx RNG by `resume_step * grad_accum` draws (`cd_gm.py:422-425`) — **one idx is drawn per micro-batch, not per optimizer step**. Changing `--grad_accum` across a resume desynchronizes that stream across ranks and is forbidden (`stage2_v3_ext.sh:37-39` records an accum=2 attempt being reverted for exactly this). + +**`--keep_last_emas 25`, not 2.** WorldMind's `--keep_last_states` is a misnomer that prunes only `ema/`; the default 2 would `os.remove` the intermediate EMAs you need to pick a stage-3 init from (`cd_gm.py:472-477`). + +**Memory (4 GPUs).** student ZeRO-2 engine ≈ 33 GB (measured ActionRoPE 4-GPU SFT peak 32.8 GB, README:257) + teacher bf16 10 GB + EMA fp32 20 GB + TF activations ⇒ ~70–80 GB of 143 GB. Comfortable. + +**Cost.** 3 TF forwards + 1 TF backward ≈ 9 s/micro-batch ⇒ ~18 s/optimizer step at GA2 ⇒ 8,000 steps ≈ **40 h**. Lineage says this is where the quality is: `cd15k400 ≈ t100k400 >> cd10k@300 > cd2k@300` — *stage-2 step count is the dominant lever*, not the stage-3 teacher. + +**Deployment of the stage-2 EMA on its own.** `--denoise_list 1000,250` (2 steps, σ 1.0 → 0.25), cfg 1.0, cell 0 written back after every step. This is a real candidate deliverable — `stage3_dmd/run.sh:13-14` says the stage-3 output is explicitly "NOT the deploy pick — Stage-2 CD is". Evaluate it with `distill/eval/rollout_eval.py` before committing 3 more days to stage 3. + +## stage3 +## Stage 3 — self-forcing DMD (short polish stage) + +**Product.** `outputs/distill/stage3_dmd/ema/ema_step{N}.safetensors`. Pick **by eye** from the per-50-step sweep, not the last step; both WorldMind v3 arms deployed `ema_step400` out of 450–600. + +**Four models.** +- `student` / generator — `AropeDiT(causal=True)`, init from **stage-2 `ema/ema_step{N}`**, trainable, FSDP, grad-checkpointed on the *parallel* path only. +- `critic` / fake-score — `AropeDiT(causal=False)`, init from the **bidirectional SFT** ckpt `outputs/arope_10k_ga2/step-10000.safetensors`, trainable, FSDP. +- `teacher` / real-score — `AropeDiT(causal=False)`, **same bidirectional SFT ckpt**, frozen bf16, NOT FSDP-wrapped (10 GB replicated is cheaper than the wrapping complexity at 143 GB/card). +- `ema` — `AropeDiT(causal=True)`, frozen, FSDP-wrapped fp32 so the per-shard `zip()` EMA is exact. + +**The teacher is NOT stage 1.** Getting this wrong trains against the wrong score *and the loss still falls*. Stage 2 needs trajectory match (hence a causal teacher); stage 3 needs only terminal distribution match, so it uses the stronger bidirectional model. + +**Why FSDP here and ZeRO-2 in stages 1–2.** Two trainable models cannot share one accelerate DeepSpeed engine (`accelerator.py:2229-2236` keeps only the last `nn.Module`), and DDP + fp32 AdamW for 2×5B is 120 GB of optimizer state per card. FSDP1 FULL_SHARD across 4 ranks gives student 5 (params fp32/4) + 10 (Adam m,v /4) + 5 (grads) = 20 GB, critic 20 GB, EMA 5 GB, teacher bf16 10 GB ⇒ **55 GB static**. + +**Mandatory FSDP details:** +- `.float()` every model **before** `accelerate.prepare`. ActionRoPE's checkpoints and `WanVideoPipeline.from_pretrained(torch_dtype=bfloat16)` give bf16 params; under FSDP MixedPrecision(param_dtype=bf16) that leaves **no fp32 master weights** and AdamW updates bf16 in place — the same trap ActionRoPE's own README known-issue 9 records for single-process training. WorldMind never hit it because their checkpoints are fp32 (19,999,235,184 B = 5B×4). +- `fsdp_use_orig_params: true` — load-bearing twice: the optimizers are built over `model.parameters()` before prepare and never remapped (with `false` they step stale FlatParameter views, get no grads, and **the model silently never learns**), and the zip-EMA needs identical Parameter identity/order/sharding. +- `fsdp_sync_module_states: false`, `fsdp_cpu_ram_efficient_loading: false` — every rank loads the same safetensors deterministically; with sync on, rank 0 materialises all models for the broadcast and OOMs the prepare. +- `dit.freqs` (a plain tuple attribute of complex128 tensors, not a buffer) must be `.to(device)`'d on **each** bare module after prepare. +- Do **not** use `accel.clip_grad_norm_` with >1 FSDP model (its matcher does a tensor `==`); use the local `_clip(model, 10.0)` that prefers `model.clip_grad_norm_`. +- Do **not** use `accel.save_state`; write `accel.get_state_dict(m)` → `safetensors.save_file` for student/critic/ema. Optimizer state is not saved; resume ≠ an uninterrupted run. + +### The rollout, and the two ActionRoPE-specific redesigns + +**`init_kv_cache(kv_window=20, sink_size=0, rope_cap=20)`.** The WorldMind invariant `rope_cap == sink + kv_window == F-1 == 20` is preserved, but **`sink_size` is 0, not 3**. Reason: WorldMind's sink keeps the first few frames permanently visible at RoPE positions 0..2. In ActionRoPE the h/w RoPE position is a *world coordinate that keeps drifting*. Measured over all 22,781 valid clips in `hf/data/arope_sidecar.pt`: `max|offset_px| = 373.0 px = 11.66 tokens = 23.31 latent cells` over 21 cells, on a 15×26 token grid. A permanent sink frame would sit tens of tokens away in world space after 30 cells of rollout — far outside anything the model ever saw. `sink=0` + window anchoring keeps every attention window's *RoPE coordinates* exactly those of a training clip — and fixes only that (see the GEO-2 note below and R10 for what it does not fix). + +**Window-anchored coordinates.** At absolute cell `k` with anchor `a = max(0, k - kv_window)`: +``` +tpos_j = j - a # 0 .. min(k, 20) temporal RoPE +off_win_j = offset_px[j] - offset_px[a] # world RoPE, anchored to the window's oldest cell +``` +Both axes are anchor-relative; RoPE is relative, so the RoPE re-anchoring is exact (`test_world_rope_window.py` a1/a3) and the *query* cell's known-mask is exact (d1). It is **not** bit-for-bit a 21-cell clip: the known-mask channel of each cached cell is frozen at its own commit-time anchor `a_j = max(0, j-20) < a`, so for k>20 the history differs from a clip anchored at k-20 (CPU measurement: ~3% window mask disagreement at k=21 → ~31-33% at k≥40; the current cell is always 0%). This is a stage2→stage3 input shift that self-forcing trains through; the k>27 steady state is untrained at `rollout_max=27` (GEO-2). This is the direct analogue of WorldMind's `tpos = min(frame_index, rope_cap)` clamp, which has no meaning for a drifting spatial coordinate. Cache **raw (pre-RoPE) K**, re-RoPE on read at the anchored coordinates, evict the oldest frame past `kv_window` — the sliding path of `gamemaster_dit.py:212-239` with `n_sink=0`. Assert `test_world_rope_window.py`'s shift-invariance before trusting it. (Optimization, later: re-anchoring from `a` to `a+1` is one fixed complex rotation per token, so cached post-RoPE K can be updated with a single complex multiply instead of a full float64 re-rope; the naive re-rope costs 20×390 keys × 3072 dims × 30 layers × 2 denoise steps × N frames in float64.) + +**`mask_input` per frame.** `known_mask(off_win / 16, 30, 52)` computed from the *anchored* offsets — so "known" means "inside the window anchor's footprint", which is what the model was trained on (for the *query* cell; cached cells keep the mask they were committed with — GEO-2 above). + +**Offset extension past 21 cells.** `parse_actions` hard-requires exactly 21 cells (`infer.py:127`). `distill/data.py::extend_offsets(offset_px, N, mode)`: +- `continue` — repeat the last per-cell delta (`delta_tok[-1]`). +- `resample` (**default**) — draw a direction from `geometry.ACTION_DIRS` × `walk_speed_px_s = [69.24, 46.01]` × a multiplier in [0.8, 1.2] for chunks of 5 cells, mirroring C's `dmd_action_extend_mode: preset_chunks` / `dmd_action_chunk_frames: 10`. +An offset stream cannot be "held" the way WorldMind holds the last prompt (`dmd_gm.py:660-666`); a held offset means "the player stopped", which is a *different action*, not a neutral one. This is the same trap B's README records for V Rising's null action. + +**Contiguous scored tail, not a frankenstein.** WorldMind slices `cat([real frame0, last-K generated])` — temporally discontinuous, and `diag_pull.py` exists specifically because that construction is the suspected cause of the residual darkening. For ActionRoPE it is also *geometrically* incoherent (frame 0 at world 0 stitched to a tail hundreds of px away). Use instead: +``` +Keff = 20 +tail_sl = generated[:, :, N-20 : N+1] # 21 CONTIGUOUS cells +off_scored = offset_px[N-20 : N+1] - offset_px[N-20] # anchored, in-envelope +grad_mask_t = [False] + [True]*20 # eval_idx = 1..20 +``` +Cell 0 of the scored clip is a *generated* cell used as the clean anchor (unnoised, `t=0`) — which is exactly the self-forcing condition we want the student to satisfy, and also the one place where the port has no on-manifold reference: see R10 (DMD-1) for what the objective cannot see through that anchor and the mandatory `sweep_photodrift.sh` gate. Set `--rollout_min 20 --rollout_max 26 --dmd_score_frames 20 --grad_horizon 20` so `grad_start == tail_start == N-20` and every scored cell carries autograd. (Keeping WorldMind's frankenstein form is available behind `--frankenstein 1` for parity checks.) + +### Losses (`dmd_gm.py:193-246`, unchanged math) + +```python +# DMD generator loss — everything in x0 space, gradient computed under no_grad +noisy, t_s, sigma = ti2v_noise(gen.detach(), clamp=(20, 980)) # one shared t, cell0 clean & unnoised +with torch.no_grad(): + pred_real = noisy - sigma * teacher(noisy, t_s, **cond_t) # cfg==1.0 -> uncond forward SKIPPED + pred_fake = noisy - sigma * critic (noisy, t_s, **cond_t) + normalizer = (gen.detach() - pred_real)[:, :, 1:].abs().mean(dim=[1,2,3,4], keepdim=True).clamp(min=1e-2) + grad = torch.nan_to_num((pred_fake - pred_real) / normalizer) +loss = 0.5 * F.mse_loss(gen[:, :, 1:].float(), (gen - grad).detach()[:, :, 1:].float()) + +# critic loss — plain flow-matching on the student's own detached samples +clip = gen.detach(); noisy, t_s, _, eps = ti2v_noise(clip) +loss_c = F.mse_loss(critic(noisy, t_s, **cond_t)[:, :, 1:].float(), (eps - clip)[:, :, 1:].float()) +``` +`cond_t` for teacher/critic is `dict(context=ctx_t, context_ids=ids_t, offset_px=off_scored, mask_input=mask_t, first_frame_cond=True)` — **no `clean_x`**: teacher and critic are only ever driven in their native bidirectional full-clip mode. That is this file's iron rule. + +### Step ordering (do not reorder) + +rollout → tail slice → `dmd_generator_loss` → `accel.backward` (or streamed replay) → `_clip(student,10)` → `opt_g.step/zero_grad` → `slr_g.step` → EMA update → `for _ in range(5): critic_loss → backward → _clip(critic,10) → opt_c.step/zero_grad` → `slr_c.step()` once. + +A student rollout not *immediately* followed by a student backward zeroes the student grad on the next generator step (FSDP's backward setup is consumed; reproducer `stage3_dmd/test_fsdp_rollout_grad.py`). Hence: the generator updates every step, student backward precedes critic backward, and the 5:1 critic lead comes from inner steps on the same detached sample. + +### Launch (4 GPUs) + +```bash +cd /data/zhiyangdeng/ActionRoPE +export PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True +export CUDA_VISIBLE_DEVICES=0,1,2,3 +export PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True +export NCCL_P2P_LEVEL=NVL OMP_NUM_THREADS=16 +unset GM_XCACHE GM_COMPILE GM_SAGEATTN # never during training +STUDENT=/data/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step8000.safetensors +TEACHER=/data/zhiyangdeng/ActionRoPE/outputs/arope_10k_ga2/step-10000.safetensors +mkdir -p outputs/distill/stage3_dmd +.venv/bin/accelerate launch \ + --config_file distill/configs/accelerate_fsdp_dmd_4gpu.yaml \ + --num_processes 4 --main_process_port 29536 \ + distill/stage3_dmd/dmd_arope.py \ + --student_ckpt "$STUDENT" --teacher_ckpt "$TEACHER" \ + --denoise_list 1000,250 --real_guidance_scale 1.0 \ + --kv_window 20 --sink_size 0 --rope_cap 20 \ + --rollout_min 20 --rollout_max 26 --dmd_score_frames 20 --grad_horizon 20 \ + --grad_pass streamed --reanchor_every 0 \ + --offset_extend resample --offset_chunk_cells 5 \ + --critic_steps 5 --lr 2e-6 --lr_critic 1e-6 --warmup 100 \ + --opt8bit 0 --use_ema 1 --ema_decay 0.99 --ema_start 100 \ + --batch_size 1 --max_steps 500 --save_every 50 --keep_last_critics 3 \ + --dmd_timestep_clamp 20,980 --log_every 10 --seed 0 \ + --output /data/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd \ + 2>&1 | tee -a outputs/distill/stage3_dmd/train.log +``` + +**Never invoke `dmd_arope.py` on argparse defaults.** In A, `run.sh` and argparse disagree on six flags and every disagreement is a known failure: lr 5e-6 (argparse) collapses — bright ~100 steps then a sudden darkening at ~100–150; `critic_steps` 4 vs 5; `dmd_score_frames` 26 vs 20; `grad_horizon` 14 vs 20; `rollout_max` 100 vs 27; `reanchor_every` 16 vs 0. Mirror `run.sh`'s values into the argparse defaults of the port so this cannot recur. + +**Cost.** ~16.7 s/step (the per-rank work is unchanged from WorldMind's 8-GPU measurement since batch is 1/rank); 500 steps ≈ **2.5–3.5 h**. Save every 50 ⇒ 10 × (dit + critic + ema) × 10 GB = 300 GB; rotate `critic/` to 3. + +**`--grad_pass streamed` is not optional on 4 GPUs.** B measured the fused rollout graph at 36.1 GB (grad_horizon 8) / 77.8 GB (grad_horizon 20). 55 GB static + 78 GB activations = 133 GB of 143 — no margin for fragmentation. Streamed replay: pass 1 records `record["exit"][k]=(noisy,tsv)` and `record["commit"][k]` under `no_grad`; pass 2 re-commits the SAME tensors in the SAME order (bit-identical cache), backwards each grad frame immediately, `del v, den, loss_k`. Exact, not approximate. + +## four_gpu_plan +## Running on exactly GPUs 0–3 of 8 + +**Isolation.** Every launcher exports `CUDA_VISIBLE_DEVICES=0,1,2,3` before `accelerate launch`, and `--num_processes 4` matches. Do **not** port WorldMind's `FORCE=1` GPU-busy override (`stage2_v4.sh:24-27`) — it exists to steal cards. Instead the launchers should *refuse* to start if `nvidia-smi -i 0,1,2,3 --query-gpu=memory.used` shows anything above ~500 MiB, and never look at 4–7. Current state (read-only check): all 8 GPUs are 0 MiB / 0 % — GPUs 4–7 are idle but belong to other users; leave them alone. + +**Ports.** accelerate defaults to `--main_process_port 29500`, which collides with any other run on this box. Fixed assignment: stage 1 → **29531**, stage 2 → **29532**, stage 3 → **29536**, smoke runs → 29541+. Never run two of these concurrently on the same 4 cards anyway. + +**Env, every launch:** +```bash +export CUDA_VISIBLE_DEVICES=0,1,2,3 +export PYTHONPATH=/data/zhiyangdeng/ActionRoPE +export DIFFSYNTH_SKIP_DOWNLOAD=True +export PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True +export NCCL_P2P_LEVEL=NVL +export OMP_NUM_THREADS=16 # 160 cores on this box; unbounded threads thrash the 4 ranks +unset GM_XCACHE GM_COMPILE GM_SAGEATTN # WorldMind env hooks: XCACHE cuts autograd, COMPILE hangs, SAGE is slower +``` +Consider setting `expandable_segments` **in-process before `import torch`** (C's `train.py:22-27` records that the launch-time export was measured not to reach accelerate subprocesses). + +## Parallelism per stage + +| stage | models | backend | config | processes | batch × GA | eff batch | +|---|---|---|---|---|---|---| +| 1 AR-TF | 1 trainable | DeepSpeed ZeRO-2 | `accelerate_zero2_{4gpu_ga2,8gpu_ga1}.yaml`(run.sh 按 DISTILL_NGPU 选) | 4 / 8 | 1 × 2 / 1 × 1 | 8 | +| 2 CD | 1 trainable + 2 frozen | DeepSpeed ZeRO-2 | `accelerate_zero2_{4gpu_ga2,8gpu_ga1}.yaml`(同上,run.sh 断言 eff==8) | 4 / 8 | 1 × 2 / 1 × 1 | 8 | +| 3 DMD | 2 trainable + 2 frozen | **FSDP1 FULL_SHARD** | `accelerate_fsdp_dmd_{4,8}gpu.yaml`(run.sh 按 DISTILL_NGPU 选) | = DISTILL_NGPU | 1 × 1 | = processes | + +Stages 1–2 stay on ActionRoPE's proven ZeRO-2 stack because each has exactly one trainable model — and accelerate's DeepSpeed path *silently keeps only the last* `nn.Module` passed to `prepare` (`accelerator.py:2229-2236`), so frozen teacher/EMA simply must not be passed. Stage 3 has two trainable models and therefore must move to FSDP; that is also where WorldMind's FSDP idioms (`use_orig_params`, `sync_module_states: false`, `model.clip_grad_norm_`, `get_state_dict`+safetensors instead of `save_state`) come across verbatim. + +Effective batch 8 at stage 1 is half WorldMind's 16 (they had 8 GPUs). `--grad_accum 4` with `accelerate_zero2_4gpu_ga4.yaml` restores 16 and doubles wall-clock. `--grad_accum` **must** equal the yaml's `gradient_accumulation_steps` or `train.py:399` raises `SystemExit`; carry that guard into every new trainer. + +## Memory budget per GPU (H200, 143,771 MiB) + +Measured anchors from ActionRoPE's own README:257,338 — 8-GPU ZeRO-2 peak **22.7 GB**, 4-GPU ZeRO-2 peak **32.8 GB** at 1.22 s/step, single-process no-DeepSpeed **46.7 GB**. Model is 4,999,803,072 params ⇒ bf16 10.0 GB, fp32 20.0 GB, AdamW fp32 m+v 40.0 GB. + +**Stage 1 (ZeRO-2, 4 ranks, TF).** +``` +bf16 params (replicated) 10.0 GB +ZeRO-2 optimizer shard (fp32 master+m+v)/4 15.0 GB +gradient shard + reduce buckets ~5 GB +activations (grad-ckpt, 16,380 tokens) ~3 GB (one block live + t_mod 0.6 GB) +TF attn mask [16380,16380] bool 0.27 GB (+ SDPA's float conversion, see risk 1) +------------------------------------------------------- +total ~34-40 GB of 143 COMFORTABLE +``` + +**Stage 2 (ZeRO-2, 4 ranks, 3 models, TF).** +``` +student engine (as above) ~33 GB +teacher, bf16, frozen, unwrapped 10.0 GB +EMA, fp32, frozen, unwrapped 20.0 GB +activations: 1 backward + 2 no-grad forwards ~5 GB +------------------------------------------------------- +total ~70-80 GB of 143 COMFORTABLE +``` +EMA is fp32 on purpose: at decay 0.99 a bf16 shadow (8-bit mantissa) silently drops updates smaller than ~0.4 % of the parameter, which destroys the target network. It runs under `autocast(bf16)` so compute cost is unchanged. + +**Stage 3 (FSDP FULL_SHARD, 4 ranks, 4 models).** +``` +student fp32 params/4 5 + Adam/4 10 + grads/4 5 20 GB +critic same 20 GB +ema fp32 params/4 5 GB +teacher bf16, frozen, UNWRAPPED (replicated) 10 GB +------------------------------------------------------- +static 55 GB +rollout activations, --grad_pass streamed ~5 GB -> ~60-70 GB OK +rollout activations, --grad_pass fused 78 GB -> ~133 GB NO MARGIN +``` +B measured the fused path at 36.1 GB (grad_horizon 8) and 77.8 GB (grad_horizon 20). **Ship `--grad_pass streamed` before the first real stage-3 launch.** If it is not ready, run stage 3 with `--grad_horizon 8 --dmd_score_frames 8` as a stopgap. Escape hatches in order of preference: (1) streamed replay; (2) `dmd_teacher_offload_cpu` (frozen teacher to CPU, −10 GB, C's trick); (3) drop `--critic_steps` to 3. + +## Wall clock and disk + +| stage | s/optimizer step (4 GPU) | steps | wall clock | ckpt disk | +|---|---|---|---|---| +| 1 AR-TF | ~11 (2 × 5.5 s TF micro-batches) | 12,000 | **~38 h** | 24×10 GB dits (rotate 6) + 2 state slots ≈ 180 GB | +| 2 CD | ~18 (2 × ~9 s: 3 TF fwd + 1 TF bwd) | 8,000 | **~40 h** | 16 dits (rotate 2) + 16 emas (keep 25) ≈ 180 GB | +| 3 DMD | ~17 | 500 | **~3 h** | 10 × (dit+critic+ema) ≈ 300 GB (rotate critic to 3 ⇒ ~230 GB) | + +Total ≈ **81 h ≈ 3.4 days** of the 4 cards, ~600 GB of checkpoints, plus 67 GB of unpacked latents (134 GB until the pool tars are deleted). `df -h /data` shows 14 TB with 13 TB free — no constraint. Host RAM 2,015 GB; the 1.5 GB `text_table_actionrope.pt` loaded per rank (train+val) is ~12 GB total, fine. + +The 5.5 s/micro-batch TF figure is WorldMind's *measured* 11 s/step at GA2 on 8×H200 for the same 5B at 16,380 tokens, not an extrapolation. A pure FLOP estimate says ~3.2 s; the 1.7× gap is the masked-SDPA slow path, which is exactly what smoke test #1 below measures and what `flex_attention` would recover. + +## risks + +### R1 +**1. `F.scaled_dot_product_attention` with a `[16380,16380]` bool mask may fall to the math backend.** That materialises `[b, 24, 16380, 16380]` scores = 12.9 GB in bf16 and is catastrophically slow; it is the most likely explanation for WorldMind's 11 s/step vs a ~4 s FLOP estimate. Mitigation: measure first (smoke #1) with `torch.nn.attention.sdpa_kernel` + `torch.cuda.max_memory_allocated`; if EFFICIENT_ATTENTION is not selected, switch the causal and TF masks to `torch.nn.attention.flex_attention` with a `create_block_mask` (present in this venv at `torch/nn/attention/flex_attention.py`) — the TF mask is ~25 % dense, so block-sparse should be 3–4× faster *and* remove the 268 MB mask allocation. Fallback if flex compile is unstable: split TF into two SDPA calls (clean-half causal `[S,S]`, then noisy queries against `cat([clean, own-noisy])`). + +### R2 +**2. FSDP + direct submodule access silently returns shards.** `arope_forward` reaches into `dit.patch_embedding`, `dit.blocks[i].norm1`, `dit.head` etc.; with `TRANSFORMER_BASED_WRAP` on `DiTBlock`, block params are only all-gathered inside the wrapped module's `forward()`. Reaching in gives garbage with no error. Mitigation: the `AropeDiT` wrapper + the `DiTBlock.forward` monkeypatch so blocks are entered as `block(...)`; gate with a 2-GPU FSDP smoke asserting the output matches a 1-GPU run to bf16 tolerance before any stage-3 launch. + +### R3 +**3. World-coordinate RoPE goes out of distribution in a long rollout.** Measured max displacement inside a 21-cell clip is 373.0 px = 11.66 tokens on a 15×26 grid; a 30-cell rollout in true world coordinates puts the oldest cached key ~17+ tokens away, and a permanent sink frame far worse. Mitigation: window-anchored coordinates (`off_win = offset[j] - offset[a]`, `tpos = j - a`) with `sink_size=0`, gated by `test_world_rope_window.py`'s shift-invariance assertion. This is a redesign of WorldMind's `tpos = min(frame_index, rope_cap)` clamp, not a rename — the clamp has no meaning for a drifting spatial coordinate. **Scope (DMD-1):** this fixes *only* the RoPE-coordinate OOD problem. It says nothing about latent *values* leaving the VAE manifold — WorldMind's sink was also its on-manifold anchor (a real VAE-encoded frame 0), and this port keeps no such anchor; that failure mode and its gate live in R10. + +### R4 +**4. bf16 parameters under FSDP leave no fp32 master and AdamW updates bf16 in place.** ActionRoPE checkpoints and `WanVideoPipeline.from_pretrained(torch_dtype=bfloat16)` are bf16; WorldMind never hit this because their checkpoints are fp32. Symptom is a run that trains but learns slowly/noisily, with no error. Mitigation: `.float()` every model before `accelerate.prepare` in stage 3, and assert `next(m.parameters()).dtype is torch.float32` right before prepare. (ActionRoPE's own README known-issue 9 records the single-process version of this bug.) + +### R5 +**5. `fsdp_use_orig_params: false` makes the model silently never learn.** The optimizers are built over `model.parameters()` before prepare and never remapped; FSDP1 substitutes a FlatParameter, the optimizer steps stale tensors and receives no grads. It also breaks the zip-EMA. Mitigation: set it true in the yaml, and assert `accelerator.state.fsdp_plugin.use_orig_params` at startup; `probe_student_grad` before the first step; and — **implemented (S3-GUARD-3)** — `dmd_arope.py` raises `SystemExit` right before `opt_g.step()` whenever `gnorm_g == 0.0` or NaN at any `step > resume_step`. After `critic_steps` critic updates `pred_fake != pred_real`, so a non-zero generator grad norm is a hard invariant; `inf` is not aborted (the clip already zeroes it) and the exact-zero DMD grad at step 0 is recipe, not wiring (the probe covers that step). + +### R6 +**6. Gradient checkpointing over the sliding KV rollout produces silently wrong gradients.** The commit path is destructive (`torch.cat` + eviction), so the checkpoint replay attends to a different history. While the cache is growing you get `CheckpointError: Recomputed values have different metadata`; **once it saturates at `kv_window`, the shapes match and only the contents are wrong — no error at all** (B, `graphgwm/models/graph_dit.py:838-870`, measured 2026-08-13). ActionRoPE routes every block through `gradient_checkpoint_forward` (`arope.py:387`), so this is one line away. Mitigation: `forward_frame` never passes `use_gradient_checkpointing=True`; assert it. + +### R7 +**7. Teacher-forcing leak — the #1 silent port failure.** If clean cell f reaches noisy cell f, the loss collapses toward zero while the rollout stays broken: a failure that looks like success. Mitigation: `distill/tests/test_tf_port.py` as a hard CI gate (leak `clean f -> noisy f` == 0.00e+00, `clean f -> noisy f+1` > 0, `clean f -> noisy FA2 > sage > SDPA; the port always uses SDPA. Today neither is installed so the paths are identical — that is load-bearing. Mitigation: import-time assert that all three availability flags are False, plus an equivalence test (`clean_x=None, causal=False` must be bit-identical to stock `arope_forward`). + +### R9 +**9. Re-RoPE cost in the rollout.** `rope_apply` upcasts to float64 and multiplies by complex128 freqs. Re-roping 20×390 cached keys × 3072 dims × 30 layers × 2 denoise steps × ~26 cells per rollout is real float64 work every step. Mitigation: measure in the throughput smoke; if it dominates, replace the full re-rope with the incremental one-complex-multiply re-anchor (rotating cached post-RoPE K by `exp(-i·Δ·inv_freq)` when the anchor advances by one cell) — exact for a 26-cell rollout. + +### R10 +**10. The DMD frankenstein clip is geometrically incoherent under ARoPE.** `cat([real cell0 at world 0, tail cells hundreds of px away])` is both temporally and *spatially* discontinuous, and WorldMind's `diag_pull.py` already exists because it is the suspected cause of their residual darkening. Mitigation: contiguous scored tail `generated[:, :, N-20:N+1]` with anchored offsets; keep the frankenstein behind a flag for parity comparison only. + +**Open cost (DMD-1, documented, not a code bug).** The contiguous tail's t=0 anchor is a *generated* cell (`a = N-20 ∈ [1,7]`, unnoised, unscored, detached). `sink=0` + window anchoring fixes only the RoPE-coordinate OOD problem (R3); the port has removed every on-manifold reference (no real cell 0 in the scored clip, no sink, `--reanchor_every` hard-rejected). The DMD objective is blind to a global appearance offset g (brightness / colour cast) carried by that anchor: teacher and critic both condition on g·x_a, so `pred_fake - pred_real ≈ 0` for that mode and the generator receives zero gradient against it — WorldMind's real frame-0 sink pinned g to identity. The objective only penalises the intra-window drift *rate*, never the accumulated offset, and the `dmd` band, `critic` and `gnorm` cannot see it (the frankenstein-darkening story was only `diag_pull.py`'s untested hypothesis B, so this design's premise is unverified). Therefore: (a) `distill/eval/sweep_photodrift.sh` (41-cell per-cell std/mean vs the stage2 baseline, run in the **training** geometry sink 0 / w20) is a **mandatory** gate for the stage-3 smoke and for every EMA milestone selection, alongside `rollout_eval.py`'s displacement; (b) if a constant darkening/offset appears, the fallback is `--tail_reanchor vae` (to be implemented: decode → last pixel frame → encode of the *tail anchor cell only*, per WorldMind `dmd_gm.py:171-178`, detached, student cache untouched) — not re-enabling `--reanchor_every`. + +### R11 +**11. Copying argparse defaults instead of `run.sh` values reproduces known collapses.** In A, six flags disagree between argparse and `run.sh`, and the argparse generator lr 5e-6 is precisely the high-LR min-max collapse (bright ~100 steps, sudden darkening at 100–150). The checked-in `stage*/config.json` files are stale source-machine artifacts and are also not the recipe. Mitigation: hardcode `run.sh`'s values as the port's argparse defaults; the only authoritative record of what a run ate is `train.log:1`. + +### R12 +**12. Deploying `dits/` instead of `ema/`.** True for stage 2 AND stage 3. `dits/` and `critic/` exist only for resume; every eval and DEPLOY symlink upstream points at `ema/`. Silent quality loss with no error. Mitigation: name the files so it is obvious and have `rollout_eval.py` refuse a path containing `/dits/` unless `--allow_raw_student`. + +### R13 +**13. Preconditions not met on this machine.** `data/latent/{train_eybx,val_eybx,arope_sidecar.pt,text_table_actionrope.pt}` do not exist yet (only `manifests/`, `pool_shards/`, `text_table_eybx.pt`), and `outputs/` does not exist. `scripts/train_arope.sh:6` hardcodes a dead `/opt/dlami/...` ROOT. Mitigation: run the unpack + copy block, then check the dataset banner reads `used 18528 / text_table 361 keys`. + +### R14 +**14. Shared-machine hygiene.** accelerate's default `--main_process_port 29500` collides with any other job; WorldMind's launchers additionally carry a `FORCE=1` that steals busy GPUs. Mitigation: explicit ports 29531/29532/29536, `CUDA_VISIBLE_DEVICES=0,1,2,3` in every launcher, a guard that refuses to start if GPUs 0–3 are busy, and no `FORCE` path at all. + +## smoke_tests + +### **S0 — preconditions (no GPU, ~10 min).** `bash data/unpack.sh "$PWD/data"`; copy sidecar/text-table/ckpt per the handoff; then `.venv/bin/python -m pytest tests/test_geometry.py tests/test_prompts.py -q`. Then instantiate `AropeLatentDataset('data/latent/train_eybx', exclude_src_in='data/latent/val_eybx', min_rt_ratio=0.8)` and assert the banner reads `20983 .pt, invalid 1, leak 257, low_rt 2197, used 18528, text_table 361 keys` — byte-matching `hf/checkpoints/arope_10k_ga2/config.json`. A wrong count means the wrong text table or a missing `data/meta/*.jsonl`. + +### **S1 — stock-equivalence gate (1 GPU, ~2 min). Run before anything else.** With `causal=False, clean_x=None, mask_input` as usual, assert `AropeDiT(...)(x, t, ctx, ...)` is **bit-identical** to `actionrope.arope.arope_forward(dit, ...)` on the real 10k weights, and that `pytest tests/test_arope.py -q` still passes *after* the `DiTBlock.forward` monkeypatch is imported. Also assert `FLASH_ATTN_2_AVAILABLE == FLASH_ATTN_3_AVAILABLE == SAGE_ATTN_AVAILABLE == False`. If this fails, everything downstream is measuring the wrong model. + +### **S2 — SDPA backend + memory probe for the TF mask (1 GPU, ~1 min).** Build the real `[16380,16380]` bool mask, run one `F.scaled_dot_product_attention` at `[1, 24, 16380, 128]` bf16 under `torch.nn.attention.sdpa_kernel`, and record which backend is chosen plus `torch.cuda.max_memory_allocated()` and wall time. Pass = EFFICIENT_ATTENTION selected and peak < 5 GB. Fail = the math backend materialised ~12.9 GB of scores ⇒ switch to `flex_attention` + `create_block_mask` before committing 38 h to stage 1. This single test decides the stage-1 budget. + +### **S3 — teacher-forcing leak gate (CPU, tiny 2-layer AropeDiT, ~30 s).** Port of B's `scripts/test_tf_port.py`, five assertions: (a) `clean_x=None` output bit-identical to the non-TF path for `causal` True and False; (b) TF output shape == the noisy half only, `[b,48,21,30,52]`; (c) perturbing clean cell f changes noisy cell f by exactly **0.00e+00**; (d) perturbing clean cell f changes noisy cell f+1 by > 0; (e) perturbing clean cell f leaves noisy cells < f at exactly 0.0. Plus: `aug_t` changes the output, and `freqs` for the TF stream equals `cat([freqs21, freqs21])` (not a 42-frame table). + +### **S4 — KV-cache equivalence (1 GPU or CPU float64, ~2 min).** Absolute-mode `forward_frame` over 21 cells vs the full-clip `causal=True` parallel forward: per-frame `max|Δ| < 1e-9` in float64. Negative control: forcing `frame_index=0` for every cell must diverge. Then sliding mode with `kv_window=20, sink=0`: for k ≤ 20 (no eviction yet) it must match the absolute path bit-for-bit, since the anchored positions are still 0..k. Derived from `_scheme2_docs/.../test_kv_cache_equiv.py` and `test_sliding_kv.py` (both need `import os` added). + +### **S5 — world-RoPE window invariance (CPU, ~30 s).** Assert that shifting a whole window's `(t, offset)` by a constant leaves the self-attention scores unchanged (so anchoring is exact), that `known_mask` on anchored offsets equals the training-time mask for a real 21-cell clip, and that over `hf/data/arope_sidecar.pt` the intra-window displacement stays within the measured training envelope (max 373.0 px = 11.66 token = 23.31 latent cells). Also run `preflight_sliding_kv(sink=0, kv_window=20, rope_cap=20)` on a 2-layer CPU model — it catches the sink-clamp class of bug (`n_sink = min(sink, n_cached)`) in milliseconds. + +### **S6 — `--dry_run` per stage (1 GPU, ~2 min each).** Tiny config (dim 128, 2 layers, 4 heads) + synthetic batch, 12 steps, `save_every 6`. Asserts the loop, the loss wiring, and the export path without touching real weights. Stage 2 additionally: CD loss reaches student params, teacher and EMA are grad-free, hard-copy and decay both work, and the `cfg != 1` branch is finite. Stage 3 additionally: `_assert_native_scoring`-equivalent gates fire (`C == 48`, `context.dim() == 4 and shape[1] == Fl`, `ts[:,0] == 0`, cells 1..N share one t). + +### **S7 — 4-GPU 20-step live smoke per stage (~10 min each), into a throwaway `outputs/distill/_smoke_` on port 29541.** Real weights, real data, `--max_steps 20 --save_every 10 --log_every 1`. Check: (a) `grad_norm` is finite and non-zero from step 1 (zero ⇒ `fsdp_use_orig_params` / DeepSpeed wiring is broken and the model would never learn; for stage 3 this is now enforced in code — `gnorm_g == 0`/NaN at any `step > resume_step` is a `SystemExit`, S3-GUARD-3); (b) `mem_gb` matches the budget above; (c) `s/step` matches the estimate — if stage 1 is not ~11 s, S2 was wrong; (d) the exported safetensors passes `.venv/bin/python tests/check_ckpt.py --arm arope` (827 keys, strict load, `arope_mask_embedding.*` present and, after 20 steps, non-zero); (e) stage-2 loss is ≈0 at step 0 and rising — a *flat* zero means the EMA/teacher wiring is degenerate; (f) stage-3 `dmd` starts near 0 and moves into the +0.15…+0.68 band while `critic` falls — a monotonically shrinking `dmd` is not the target, it is a min-max objective. + +### **S8 — 2-GPU FSDP sharding sanity (stage 3 only, ~5 min).** Run one forward on 2 ranks under FSDP and compare against a single-GPU unsharded forward on the same input; must match to bf16 tolerance. This is the only cheap way to catch the 'submodule accessed outside `forward()` returns a shard' failure (risk 2) before the 4-model job. Also assert `next(m.parameters()).dtype is torch.float32` immediately before `prepare` for every trainable model, and that `m.dit.freqs[0].device` is CUDA on every bare module after prepare. + +### **S9 — deploy-path parity (1 GPU, ~5 min, after each stage).** Generate one clip with the stage's checkpoint through `distill/eval/rollout_eval.py` at the *exact* deploy schedule (`--denoise_list 1000,250`, cfg 1.0, cell 0 written back after every step) and through `actionrope/infer.py::sample` at 50 steps, on the same first frame + `--actions right:1.0:21`. Measure background displacement with `infer.py::measure_displacement` against `-frame_offset_px[80]`. This is the only check that the few-step student still obeys the action, and it also catches a training/inference schedule mismatch — WorldMind's `set_timesteps(2)` trap yields `[1000, 833]`, reading x0 at 83 % noise and returning a blurry conditional mean. + + +# ================ 对抗验证发现的问题(必须修)================ + + +## LENS: interface +Not sound along this lens as written. The plan gets the *parallel* interface right — I verified the shapes and dtypes it claims: `build_world_freqs` returns `[b, f*h*w, 1, 64]` complex128 and `cat([freqs21, freqs21], dim=1)` is genuinely the correct per-half `f_start=0` construction (arope.py:84-118); hw=390, S=8190, 2S=16380 are correct; `_block_forward`'s per-cell cross-attn regroup lines up row-for-row at f=42 with `ids_tf = cat([ids, ids], dim=1)` (arope.py:303-310); `dit.head(x, t)` accepts the sliced `[b,8190,3072]` t via Head's `len(t_mod.shape)==3` branch (wan_video_dit.py:277-283); `mask_input = known_mask(off/16, 30, 52).float().unsqueeze(1)` exactly reproduces train.py:243-245; the FlowMatchScheduler("Wan") CD-axis numbers (1.0, 0.99576, 0.17857, 0.09615 at N=48, shift 5) and the (4.98, 1000] training grid check out arithmetically against flow_match.py:82-92,353-363; the `linear_timesteps_weights` index API is real; the accelerate "last nn.Module silently wins" claim is real (accelerator.py:2230-2234); and no flash_attn/sageattention/bitsandbytes is installed, so the SDPA-equivalence argument holds today. But the *streaming and DMD* interfaces are where the lens bites, and three of the four items it asks about are broken or absent there. `first_frame_cond` means "cell 0 of this tensor", so the plan's own default silently zeroes the timestep of every rolled-out cell; per-cell context is simply not extended past cell 20 or sliced for the scored tail, despite the reference doing exactly that 30 lines from a passage the plan cites; `build_world_freqs` lacks the `f_start` the whole sliding-window design rests on; and `offset_px` is asked to mean two different things through one dispatch. Stage 1 additionally calls `arope_forward` with a `[b,21]` timestep it provably rejects. Only `mask_input` is threaded cleanly end to end. These are fixable with a tightened `AropeDiT` contract (explicit `offset_win`/`mask_in_k`/`f_start`, a `[b,F]`-capable timestep expansion, an `extend_context` twin to `extend_offsets`, and asserts that make the illegal combinations loud) — but as written the plan would produce a stage-3 rollout that runs, logs falling losses, and is wrong. + + +### [BLOCKER] `first_frame_cond` is never threaded (or suppressed) in the single-frame rollout path, and ActionRoPE's implementation makes the default value actively destructive. `_per_token_timestep` zeroes frame 0 **of the tensor it is handed**, not "the clip's cell 0": `t_tok = timestep.view(b,1,1).expand(b, f, n_tok)` then `if first_frame_cond: t_tok[:, 0] = 0`. In `forward_frame` the latent is one cell (`f == 1`), so `first_frame_cond=True` sets t=0 for **every** rolled-out cell — the student is told each noisy frame is the clean anchor. The plan's own `AropeDiT.forward` signature carries `first_frame_cond=True` as the default and "dispatches to `forward_frame` when `kv_cache is not None`", while the listed `forward_frame(self, x_k, t_k, ctx_k, frame_index, kv_cache, commit, *, offset_win, mask_in_k)` has no `first_frame_cond` parameter at all and no stated rule. The reference has no analogue of this trap to inherit: WorldMind's `forward_frame` takes a raw `[B]` timestep and the caller sets 0 explicitly (`student(commit_lat, torch.zeros(B, device=dev), ...)`), so the port has no upstream guard to copy. Failure is silent: the rollout still produces tensors, DMD/critic losses still compute and fall. +- 证据: actionrope/arope.py:213-228 (assert at :224, `t_tok[:, 0] = 0` at :227); _wm/WorldMind/distill/code/gamemaster/models/gamemaster_dit.py:629-664 (forward_frame builds `ts = timestep_k.reshape(B)`, no first-frame concept) and :183 (caller passes torch.zeros for the commit pass) +- 修法: State the contract explicitly: `AropeDiT.forward` must force `first_frame_cond=False` (or reject a True value) whenever `kv_cache is not None`, and `forward_frame` must consume `t_k` verbatim, with the rollout caller passing `t=0` only for the committed anchor cell. Add an assertion in `forward_frame` (`assert not first_frame_cond`) and a rollout unit test that frame k>0 with t=800 produces a different output than the same call with t=0. + + +### [BLOCKER] Per-cell text context is threaded through stage 1 and stage 2 but **not** through the stage-3 AR rollout or the DMD student/critic/real-score. `cond_t = dict(context=ctx_t, context_ids=ids_t, ...)` and the rollout's `ctx_k` are used but never defined, and no target-layout file produces them. This is not cosmetic: the dataset yields exactly 21 cells of context (`context [21,512,4096]`, `context_ids [21]`), while the plan launches with `--rollout_min 20 --rollout_max 26`, so cells 21..26 have no text at all, and the contiguous scored tail `generated[:, :, N-20:N+1]` needs a matching 21-row `prompts_t` slice that the plan's snippet omits (it lists `tail_sl`, `off_scored`, `grad_mask_t` only). `distill/data.py` is specified to extend `offset_px` (`extend_offsets`) but nothing extends context. The plan cites `dmd_gm.py:660-666` for the offset half of exactly this problem and drops the prompt half, even though the reference solves it 30 lines earlier by holding the last authored per-frame prompt. +- 证据: actionrope/dataset.py:240-253 (context is fixed at CELLS=21); _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:630-637 (`last = context[:, Fl-1:Fl]; pad = last.expand(...); prompts = torch.cat([context, pad], dim=1)`) and :678-680 (`prompts_t = torch.cat([prompts[:, :1], prompts[:, 1+N-Keff:]], dim=1)`); plan stage3 `cond_t`/`ctx_t`/`ctx_k` undefined; plan target_layout distill/data.py lists only offset utilities +- 修法: Add `extend_context(context, context_ids, N, mode)` to `distill/data.py` alongside `extend_offsets` (hold cell 20's row and id, mirroring dmd_gm.py:630-637 — legitimate here because ActionRoPE prompts are scene-only after `prompts.strip_action`), and make the tail slice produce `ctx_t = ctx_ext[:, N-20:N+1]`, `ids_t = ids_ext[:, N-20:N+1]` in lockstep with `off_scored`. Assert `ctx_t.shape[1] == tail_sl.shape[2] == off_scored.shape[1] == 21` before every teacher/critic forward. + + +### [MAJOR] Stage 1 passes a per-cell timestep vector into a forward that hard-rejects it. `arope_forward` supports only a scalar or `[b]` timestep — `_per_token_timestep` asserts `timestep.numel() == b`. The plan's stage-1 loss calls `student(noisy, ts_pf, ...)` with `ts_pf` of shape `[b, 21]` (21b elements), and `hf/DISTILL_HANDOFF.md:58` states the contract as "timestep 标量或 [b]". The plan's `shared_changes` describes building `t_tok` inside the TF branch but never lists "replace `_per_token_timestep` with a `[b,F]`-capable expansion" as a required change, and the stage-1 fallback it offers (`--no-teacher_forcing`, "single 8,190-token stream") has no TF branch to hide in — that path would hit the assert directly. +- 证据: actionrope/arope.py:213-228 (`assert timestep.numel() == b, "timestep 应为标量或 [b={b}]"` at :224); hf/DISTILL_HANDOFF.md:58; plan stage1 `v = student(noisy, ts_pf, ...)` with `idx_pf = torch.randint(0, 1000, (b, 21))` +- 修法: Name the replacement explicitly in the AropeDiT spec: a `_per_token_timestep_pf(latents, timestep, n_tok, first_frame_cond)` accepting scalar, `[b]`, and `[b,F]` (expanding `[b,F] -> [b,F*n_tok]`, applying first_frame_cond after expansion), used by both the TF and the plain block-causal paths. Cover it in test_tf_port.py with a `[b,21]` timestep on the non-TF causal path. + + +### [MAJOR] The sliding KV cache needs RoPE at a temporal offset, and `build_world_freqs` cannot express one. It has signature `build_world_freqs(dit, f, h, w, offset_tok=None, device=None)` and always indexes `f_table[:f]`, i.e. temporal positions 0..f-1. The reference's equivalent takes `f_start`: `rope(q, Fl, Hl, Wl, f_start=tpos)` and `rope(k_hist[:, n_sink*hw:], R, Hl, Wl, f_start=tpos-R)`. In the plan's window-anchored scheme the current cell sits at `tpos = k - a = n_cached`, which `build_world_freqs` cannot produce for a single-frame latent (`f=1` yields position 0). `grep -rn f_start actionrope/` returns nothing. The plan's arope_dit.py derivation note claims the sliding path is "`gamemaster_dit.py:212-239` with `n_sink=0`" grafted onto `build_world_freqs`, but that graft is missing the one argument the sliding path is built around. +- 证据: actionrope/arope.py:84 (signature) and :105,:113 (`f_table[:f]` in both branches); _wm/WorldMind/distill/code/gamemaster/models/gamemaster_dit.py:216-218, :225-232 (`f_start=tpos`, `f_start=tpos-R`, `f_start=0`) +- 修法: Add `f_start: int = 0` to a `distill/`-local `build_world_freqs` variant (indexing `f_table[f_start:f_start+f]`) and route both `kv["freqs_cur"]` (f=1, f_start=n_cached) and `kv["freqs_hist"]` (f=n_cached, f_start=0) through it. test_kv_equiv.py's float64 absolute-mode check must exercise f_start != 0, otherwise it passes trivially at frame 0. + + +### [MAJOR] `offset_px` carries two incompatible shape contracts across the plan's single dispatch point, and neither is stated. On the parallel path `arope_forward` requires `offset_tok.shape == (b, f, 2)` where `f` is the frame count of the latent being denoised. On the streaming path the latent has `f == 1`, but freqs for the cached history must be rebuilt from the whole window's anchored offsets — so the argument must be `[b, n_cached+1, 2]` while `x` has one frame. The plan lists `AropeDiT.forward(..., offset_px=None, mask_input=None, ..., kv_cache=None)` and separately `forward_frame(..., offset_win, mask_in_k)`, without saying how `offset_px` maps onto `offset_win`, and the `assert offset_tok.shape == (b, f, 2)` inside `build_world_freqs` will either fire or be bypassed silently depending on which `f` is passed. +- 证据: actionrope/arope.py:110 (`assert offset_tok.shape == (b, f, 2)`), :378-381 (`build_world_freqs(dit, f, h, w, offset_px/PX_PER_TOKEN)` with f taken from the patch-embedded latent); plan shared_changes AropeDiT signature vs. forward_frame signature +- 修法: Give the streaming path its own named parameter (`offset_win=[b, n_cached+1, 2]`, `mask_in_k=[b,1,1,30,52]`) on `AropeDiT.forward` and assert `offset_px is None` when `kv_cache is not None`, mirroring the existing `assert clean_x is None`. Document that `offset_win[:, -1]` is the current cell and `offset_win[:, 0] == 0` (the anchor), and assert both. + + +### [MINOR] The TF timestep formula, taken literally, drops `first_frame_cond` from the noisy half. The shared_changes table specifies `t_tok = cat([zeros, ts_noisy_tok])` with no mention of zeroing the noisy half's cell 0. Stage 2 depends on that zeroing: it passes a **scalar** `t_v` and relies on `first_frame_cond=True` to produce WorldMind's `ts[:,0]=0, ts[:,1:]=t_v` (the stage-2 comment says exactly this), and stage 2 also clamps `lat_t[:,:,0] = x0[:,:,0]`. If the TF branch expands the scalar without applying first_frame_cond, noisy cell 0 is a clean latent labelled t=t_v. Loss and training continue normally. +- 证据: actionrope/arope.py:225-227 (first_frame_cond applies only inside `_per_token_timestep`); plan shared_changes TF plumbing table row "timestep" vs. plan stage2 comment "scalar t + first_frame_cond => ts[:,0]=0, rest=t_v"; _wm/WorldMind/distill/code/stage2_cd/cd_gm.py:68-72 (`_per_frame_t` sets `ts[:, 0] = 0.0` before it ever reaches the model) +- 修法: Restate the row as `ts_noisy_tok = _per_token_timestep_pf(x, timestep, n_tok, first_frame_cond)` followed by `t_tok = cat([ts_clean_tok, ts_noisy_tok], dim=1)`, and add an assertion to test_tf_port.py that `t_tok[:, S:S+390]` is all zero when `first_frame_cond=True`. + + +### [MINOR] The `arope_self_attn` sketch references an undefined `freqs_q`: `q = rope_apply(sa.norm_q(sa.q(x)), freqs_q, n)` is computed before the `kv is None` branch, but the function's parameter is `freqs` and the streaming branch separately uses `kv["freqs_cur"]`/`kv["freqs_hist"]`. As written the parallel path would NameError and the streaming path's query RoPE source is unspecified. +- 证据: plan shared_changes `arope_self_attn` body; the stock op it replaces is DiffSynth-Studio/diffsynth/models/wan_video_dit.py:155-163, where q and k share one `freqs` +- 修法: Make it explicit: the parallel path ropes q and k with the same `freqs`; the streaming path ropes q with `kv["freqs_cur"]` (position tpos) and the concatenated history with `kv["freqs_hist"]`. S1's bit-identity gate against `arope_forward` only covers the parallel path, so the streaming query RoPE needs its own float64 check in test_kv_equiv.py. + + +### [MINOR] A load-bearing source claim is factually wrong. The plan asserts twice that `scripts/train_arope.sh:6` hardcodes a dead `ROOT=/opt/dlami/nvme/zhiyangdeng/ActionRoPE` (target_layout stage1 run.sh entry, and risk 13). The actual line is `ROOT=/data/zhiyangdeng/ActionRoPE` — already correct for this box. Minor on its own, but it is cited as the justification for a design decision (resolving ROOT from script location) and it means at least one "verified against the source" claim in the risk register was not. +- 证据: scripts/train_arope.sh:6 reads `ROOT=/data/zhiyangdeng/ActionRoPE` +- 修法: Drop the claim, or re-derive it (the dead path may live in another script — grep for `/opt/dlami` before re-asserting). Re-check the other file:line assertions in the risk register the same way. + + +## LENS: algorithm +Mixed. The two headline objectives are faithful, and I confirmed them literally: the CD loss (one frozen-teacher Euler step, `latent_tn = latent_t + (s_tn - s_t)*v_pred`, frame0 re-clamped, `MSE(cm_t[:,:,1:], cm_tn[:,:,1:].detach())`, idx drawn once per micro-batch in [0, N-2], clean_x threaded into all three forwards) matches `stage2_cd/cd_gm.py:91-134,435-439` exactly; the DMD gradient (x0-space `pred_fake - pred_real`, per-sample `abs().mean()` normalizer clamped at 1e-2, `nan_to_num`, `0.5*F.mse_loss(g, (gen-grad).detach())`, cond-only teacher at cfg==1, critic on detached samples with `eps - clip` on frames 1:) matches `stage3_dmd/dmd_gm.py:193-246`. The v5 recipe constants, the `rope_cap == sink + kv_window` assert, `keep_last_states` pruning only `ema/`, the `randint(0,k)` sigma-band bug at `ar_diffusion_gm.py:93`, the `W=20/sink=1 ≡ full causal at F=21` equivalence, and the accelerate DeepSpeed "last nn.Module wins" claim are all correct as stated. + +Where it breaks is the autoregressive path. The plan's stage-3 rollout description omits three mechanics that the source depends on — the commit pass runs at timestep 0, the denoise loop breaks at a randomly drawn exit step with detached intermediate re-noising, and grad crosses exactly one forward per frame — and it inherits ActionRoPE's `first_frame_cond` into a single-frame stream where that flag zeroes the timestep outright. Each of those fails silently: finite loss, descending curves, wrong model. It also has no plan for extending per-cell text past cell 20, which the rollout at `--rollout_max 26` requires and which the source explicitly handles. The frame-0 clean-anchor condition itself is preserved correctly and consistently across all three stages (the deliberate stage-1 deviation is sound and actually removes a stage1/stage2 mismatch that WorldMind has), and the `seperated_timestep` path is handled correctly on every parallel forward — it is only the KV-cache forward where it is unsafe. + + +### [BLOCKER] `first_frame_cond=True` on the single-frame KV-cache path silently zeroes the rollout timestep. ActionRoPE's seperated_timestep helper does `t_tok[:, 0] = 0` where `f = latents.shape[2]`; on `forward_frame` f==1, so cell 0 IS the only cell and every rollout forward runs at t=0 no matter what `--denoise_list` says. WorldMind has no such hazard: `forward_frame` builds `t` straight from `timestep_k` with no frame-0 carve-out. The plan's `AropeDiT.forward` signature keeps `first_frame_cond=True` as a default and says only that it 'dispatches to forward_frame when kv_cache is not None' plus 'asserts clean_x is None in that case' — the timestep flag is never mentioned. Failure is silent: velocity is finite, latents look plausible, DMD loss descends. +- 证据: actionrope/arope.py:220-228 (`b, f = latents.shape[0], latents.shape[2]` … `if first_frame_cond: t_tok[:, 0] = 0`); contrast _wm/WorldMind/distill/code/gamemaster/models/gamemaster_dit.py:663-667 (`ts = timestep_k.reshape(B)`; `t = self.time_embedding(...)` — no carve-out) +- 修法: In `AropeDiT.forward_frame`, build `t_tok` from `t_k` unconditionally, never via `_per_token_timestep(..., first_frame_cond)`. Add a hard `assert kv_cache is None or first_frame_cond is False` in `forward()` before dispatch, and add an S4 assertion that `forward_frame(x, t=250.0, ...)` differs from `forward_frame(x, t=0.0, ...)`. + + +### [BLOCKER] The plan never states that the KV commit pass runs at timestep 0. WorldMind commits frame 0 and every generated frame with `torch.zeros(B, device=dev)` and `commit_lat = den.detach()`. That t=0 is load-bearing, not cosmetic: it is what makes the cached history match the TF *clean* stream (`ts_clean = torch.zeros_like(ts_noisy)` when `aug_t is None`), which is the only conditioning the stage-2 teacher-forced student was ever trained under. A port that commits the denoised frame at the exit-step timestep (the natural reading of 'commit the denoised frame') gives cached K/V the wrong time modulation and drives the TF-trained student OOD with no error. +- 证据: _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:123-124 and :182-184 (`commit_lat = den.detach()` … `student(commit_lat, torch.zeros(B, device=dev), ctx_k, frame_index=k, kv_cache=cache, commit=True)`); gamemaster_dit.py:502 (`ts_clean = torch.zeros_like(ts_noisy)`) +- 修法: State it in the stage-3 spec and in `forward_frame`'s contract: the commit pass is always `t=0` on the detached denoised latent, exactly once per `frame_index` (the sliding commit is append-only, so a second commit at the same index doubles the frame and corrupts `n_cached`/eviction). Add it to the S4 KV-equivalence test. + + +### [BLOCKER] No mechanism to extend per-cell `context`/`context_ids` past cell 20, which `--rollout_max 26` requires. `AropeLatentDataset.__getitem__` hard-requires exactly CELLS=21 prompt keys and returns `context [21,512,4096]` + `context_ids [21]`. WorldMind explicitly handles the 1+N > Fl case by holding the last authored per-frame prompt. The plan's `distill/data.py` lists only `extend_offsets` and `window_offsets` and discusses at length why offsets cannot be 'held' — but never mentions the text stream at all. The port then either crashes at `_assert_native_scoring`'s `context.shape[1] == Fl` gate, or (worse) someone `.expand`s the wrong cell and the rollout is conditioned on a stale prompt with no error. +- 证据: actionrope/dataset.py:226-233 (`if len(keys) != CELLS: raise`; `context = torch.stack(...)`, `context_ids = torch.tensor([...])`); contrast _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:628-635 (`last = context[:, Fl-1:Fl]; pad = last.expand(...); prompts = torch.cat([context, pad], dim=1)`) +- 修法: Add `extend_context(context, context_ids, N, mode)` to `distill/data.py` alongside `extend_offsets`, and make the extension policy for text an explicit open question paired with the offset one (holding the last prompt while resampling the offset direction makes text and geometry disagree). Assert `prompts.shape[1] == 1 + N` and `ids.shape[1] == 1 + N` before the rollout. + + +### [MAJOR] The exit-step randomization and the loop `break` are missing from the plan's rollout description. In the source, one `exit_step = randint(0, nsteps)` is drawn per rollout; the denoise loop *breaks* there, intermediate re-noising uses `den.detach()`, and `grad_on = in_window and is_exit` — so every frame's `den` is the x0 estimate at a randomly chosen denoise step and grad crosses exactly one forward per frame. The plan describes the rollout only as 'sliding-KV rollout, contiguous scored tail, streamed grad replay' and mentions `record["exit"][k]` once, inside a memory bullet. A port that runs both of `--denoise_list 1000,250` and takes grad on the last step is a different estimator (never trains the 1-step regime, doubles the grad graph) and would still train to a plausible-looking loss curve. +- 证据: _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:140,148-149,155-159 (`exit_step = int(torch.randint(0, nsteps, ...))`; `is_exit = (si == exit_step)`; `grad_on = in_window and is_exit`; `if is_exit: break`; `noisy = (1 - ns) * den.detach() + ns * torch.randn_like(den)`) +- 修法: Write the exit-step contract into the stage-3 section explicitly (one draw per rollout, rank-synced like N; break at exit; intermediate re-noise detached; grad only on the exit forward), and make it an assertion in the S6 dry-run: exactly one grad-carrying student forward per grad frame. + + +### [MAJOR] Setting `--sink_size 0` together with `--reanchor_every 0` removes every on-manifold anchor from the rollout. WorldMind's sink exists precisely because 'frame0 is a REAL VAE-encoded latent -> a permanent on-manifold anchor', and run.sh disables the VAE re-anchor *because* the sink is on. The plan turns off both and argues only about RoPE going OOD in world coordinates — it never addresses the drift/darkening failure mode that WorldMind attributes to losing the manifold anchor. Secondary consequence: with sink=0, the `preflight_sliding_kv` gate the plan makes mandatory is vacuous — its entire purpose is the `n_sink = min(sink, n_cached)` clamp, and its loop `for k in range(sink_size + 1)` runs a single frame that never reaches eviction at k=20. +- 证据: _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:365-367 (`--sink_size` help: 'frame0 is a REAL VAE-encoded latent -> a permanent on-manifold anchor') and run.sh:46,48 (`--kv_window 17 --rope_cap 20 --sink_size 3` with `--reanchor_every 0`); _wm/GraphGWM/train/code_distill/stage3_dmd/dmd_gm.py:446-470 (`for k in range(sink_size + 1)`) +- 修法: Either keep a sink of 1 (frame 0 only, at anchored world position — the shift-invariance argument still holds if its offset is re-anchored with the rest of the window) or state explicitly why on-manifold anchoring is unnecessary here and add a drift metric to the 20-step smoke. Drop `preflight_sliding_kv` from the sink=0 gate list, or replace it with a real eviction preflight that rolls out past `sink + kv_window` frames. +- 状态: **closed 2026-09-10 (audit DMD-1)** — resolved by the second option, with the honest version of the argument: on-manifold anchoring is *not* shown to be unnecessary. R3/R10 and `stage3_dmd/config.json` (`_geometry` / `_reanchor_every` / `_scored_tail`) now state that `sink=0` + window anchoring fixes only the RoPE-coordinate OOD problem, that the scored tail's t=0 anchor is a generated cell (`N-20 ∈ [1,7]`), and that the DMD objective is blind to a global appearance offset carried by that anchor. The drift metric is `distill/eval/sweep_photodrift.sh` (41-cell std/mean vs the stage2 baseline, training geometry), made a mandatory gate for the stage-3 smoke and EMA milestone selection; `--tail_reanchor vae` (tail anchor cell only, detached) is the designated fallback if a constant darkening/offset appears. The secondary point is also closed: `preflight_sliding_kv` now rolls `sink + kv_window + n_extra` cells and hard-fails unless eviction happened and changed the output (`tests/preflight.py`). + + +### [MAJOR] `--rollout_min 20` under-trains eviction and deviates from the run.sh constants the plan claims to mirror. A's run.sh is `--rollout_min 21 --rollout_max 27`, and the argparse help states the minimum must be '>= F to exercise eviction'. Eviction fires only once `n_cached > sink + kv_window = 20`, i.e. after committing frame 20. At the plan's N=20 minimum the eviction fires on the very last commit and is then never read back — that rollout trains zero post-eviction reads, which is the entire point of the windowed rollout. +- 证据: _wm/WorldMind/distill/code/stage3_dmd/run.sh:47 (`--rollout_min 21 --rollout_max 27`) vs dmd_gm.py:369-370 ('min total generated frames N (>=F to exercise eviction)'); eviction site gamemaster_dit.py:234-236 (`if nk.shape[1] // hw > sink + Kr`) +- 修法: Use `--rollout_min 21 --rollout_max 27` verbatim. If the contiguous 21-cell tail is kept, note that at N=21 it starts at absolute index 1 (the first generated cell), not at the real frame 0. + + +### [MINOR] `grad_start == tail_start == N-20` is off by one against the source. With `score_last_k = Keff = 20` and `grad_horizon = 20`, the source computes `tail_start = max(1, total - 20) = N - 19` and `grad_start = N - 19` (since `hi = max(tail_start, total - grad_horizon)` collapses to the same value), so the grad window is absolute N-19..N. The plan's own `grad_mask_t = [False] + [True]*20` over a tail sliced at `generated[:, :, N-20 : N+1]` is consistent with N-19..N; only the prose is wrong. Implemented literally as N-20 it shifts the window one cell early, putting a detached cell into `eval_idx` and dropping the last generated cell from the gradient — with `eval_idx` still 20 entries long, so nothing errors. +- 证据: _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:131-136 (`tail_start = max(1, total - score_last_k)`; `lo = tail_start`; `hi = max(tail_start, total - grad_horizon)`; `grad_end = grad_start + grad_horizon`) with total = 1 + N +- 修法: Fix the prose to `grad_start = tail_start + 1 = N - 19`, and assert in code that `grad_mask_t[0] is False and grad_mask_t[1:].all()` and that `generated[:, :, N-19:].requires_grad`. + + +### [MINOR] The DMD normalizer is reduced over `[:, :, 1:]` where the source reduces over `eval_idx`. These coincide only under the plan's exact `grad_horizon == dmd_score_frames == 20` configuration. The plan's own OOM stopgap in the risks section (`--grad_horizon 8 --dmd_score_frames 8`) breaks the coincidence: `eval_idx` would then be a strict subset of `1:`, the normalizer would be computed over more frames than are scored, and the effective DMD gradient scale changes silently. +- 证据: _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:214-216 (`p_real = generated.detach() - pred_real`; `normalizer = p_real[:, :, eval_idx].abs().mean(dim=[1,2,3,4], keepdim=True).clamp(min=1e-2)`) +- 修法: Compute `eval_idx = nonzero(grad_mask_t)` and index the normalizer, the surrogate, and the critic loss with it rather than hardcoding `1:`, exactly as the source does. + + +### [MINOR] DiffSynth's `FlowMatchScheduler.set_timesteps` is destructive, unlike WorldMind's. WorldMind's `cd_axis` writes to separate `infer_sigmas`/`infer_timesteps` fields and leaves the 1000-point training grid and bell weights intact; DiffSynth's overwrites `self.sigmas`/`self.timesteps` in place and only rebuilds `linear_timesteps_weights` when `training=True`. The plan's `flow_pf.py` has a module-level `sched` used by `add_noise_pf`, `training_weight_pf` and `ti2v_noise` (which draws `randint(20, 980)` into a 1000-grid) alongside a `cd_axis(N=48)`. Calling `cd_axis` on that shared object — or any other `set_timesteps` — silently replaces the 1000-point grid with a 48-point one; every index draw then reads the wrong sigma or goes out of range. The plan's snippet constructs a fresh scheduler, but the invariant is never stated. +- 证据: DiffSynth-Studio/diffsynth/diffusion/flow_match.py:405-415 (`self.sigmas, self.timesteps = self.set_timesteps_fn(...)`; `if training: self.set_training_weight()`); contrast _wm/WorldMind/distill/code/gamemaster/flow_match.py:104-116 (`self.infer_sigmas = sigmas; self.infer_timesteps = ...`) +- 修法: Document and assert the invariant in `flow_pf.py`: the module-level scheduler is built once with `set_timesteps(1000, training=True)` and `set_timesteps` is never called on it again; `cd_axis` always constructs and returns from a throwaway instance. Assert `len(sched.timesteps) == 1000 and sched.linear_timesteps_weights is not None` at the top of every stage. + + +### [MINOR] Stages 1-2 leave the frozen teacher and EMA outside `accelerate.prepare` (correctly, per the DeepSpeed 'last nn.Module wins' loop, which I verified) but the plan never says they must be device-placed manually. WorldMind got this for free because it passed all three models to prepare under FSDP. The same applies to `dit.freqs` — a plain tuple attribute of complex128 tensors, not a buffer — which the plan requires `.to(device)` on only in the stage-3 section, though the unprepared stage-2 teacher and EMA need it identically. +- 证据: _wm/WorldMind/distill/code/stage2_cd/cd_gm.py:401 (`student, ema, teacher, opt_g, dl, slr_g = accel.prepare(student, ema, teacher, opt_g, dl, slr_g)`); .venv/.../accelerate/accelerator.py:2229-2236 (`for obj in result: if isinstance(obj, torch.nn.Module): model = obj`); actionrope/train.py:461 (freqs moved after prepare) +- 修法: State in the stage-2 spec that teacher and EMA are `.to(accel.device)`'d explicitly and that `m.dit.freqs = tuple(t.to(device) for t in m.dit.freqs)` runs on all three bare modules, and assert `next(teacher.parameters()).device == accel.device and teacher.dit.freqs[0].is_cuda` before the first step. + + +### [MINOR] `dmd_timestep_clamp [20,980]` is presented as a back-port from C, but A already hardcodes exactly that. Harmless mis-attribution, but it means the flag is a no-op relative to the canonical source and reviewers may waste time treating it as a new degree of freedom. +- 证据: _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:44-48 (`lo, hi = int(0.02 * n), int(0.98 * n)`; `torch.randint(lo, hi, (B,), ...)` with n = 1000) +- 修法: Re-label as 'A's hardcoded clamp, promoted to a flag' so its default is understood to be parity, not a change. + + +## LENS: resources +Feasible, but the stage-3 headroom is fictional in the plan's own numbers and the whole schedule leans on an unwritten code path. Verified positives first: 4× H200 at 143,771 MiB each, all 8 currently at 0 MiB; full NV18 NVLink mesh so `NCCL_P2P_LEVEL=NVL` is valid for 0-3; GPUs 0-3 sit on NUMA0 with 80 logical cores, so 4 ranks × OMP_NUM_THREADS=16 fits; /data has 13 TB free against a ~600 GB-1.2 TB checkpoint plan and 197 GB of data already unpacked; 1,961 GB RAM available. The stage-3 static arithmetic (student 20 + critic 20 + ema 5 + teacher-bf16-replicated 10 = 55 GB on 4 ranks) is correct, and comfortably better than WorldMind's own 3-rank run.sh default. accelerate 1.14 + torch 2.11 still carry FSDP1, and the proposed `fsdp_version: 1` / `fsdp_reshard_after_forward` yaml parses. `dit.freqs` is a plain tuple attribute (wan_video_dit.py:405-407), not a buffer, so FSDP's `buffer_dtype=bf16` will not silently downcast the complex128 RoPE table. Token geometry transfers exactly (WorldMind is also 480×832 → 30×52 latent → 8190/16380 tokens), so borrowing their timings is legitimate — and the timings the plan quotes are real: 11 s/step stage 1, 8.591 s/step stage 2, 16.7 s/step stage 3, all traceable to WorldMind's run READMEs. Now the problems. Stage 3 is the only stage that does not fit as specified: the plan's fused number is 133 of 143 GB before the critic's ~15 GB of activations that A explicitly budgets and checkpoints and the plan silently drops — that is ~148 GB, a certain OOM — while the streamed path that avoids it exists only in GraphGWM and has to be re-hosted on an `AropeDiT` sliding-KV cache that has not been written. Stage 3 is scheduled as a 3-hour tail; it is really a port-plus-gate with an OOM on the other side. Compounding it, the plan drops `opt8bit`, which every WorldMind memory measurement it cites was taken with, self-inflicting +25 GB on exactly this stage, and then files bitsandbytes under open questions. Stages 1 and 2 do fit on 4 GPUs, but not for the reasons given: the per-line activation budget (~3 GB, ~5 GB) is off by roughly 7× against WorldMind's only measured per-card figure (~31.7 GiB/card at the same 21-frame geometry with 8-way sharding and 8-bit Adam), so stage 1 is ~50 GB and stage 2 ~75-85 GB — still safe at 143 GB, but "COMFORTABLE" is being asserted from numbers that are wrong, and the same optimism is what makes the stage-3 line read as safe when it is not. Disk is genuinely a non-issue even at 2× the plan's estimate. GPU isolation is sound in the three launchers, but the busy-guard the plan proposes to derive scans all eight cards as written upstream (it would abort on someone else's job on 4-7), the S-series smokes are unpinned, and every pre-existing ActionRoPE launcher defaults to 0-7 — including `scripts/train_arope.sh`, which open_question 1 would invoke. + + +### [BLOCKER] Stage 3's only viable memory path (`--grad_pass streamed`) does not exist in the codebase the plan says it is porting from, and the fallback it would land on is a worse OOM than the plan admits. `--grad_pass` / `stream_grad_replay` exist ONLY in B (GraphGWM); A (WorldMind), the declared canonical source for `dmd_arope.py`, has neither — `grep -n 'grad_pass\|stream_grad_replay' _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py` returns nothing. So on 4 GPUs the first stage-3 launch depends on new code (B's replay logic re-hosted on an `AropeDiT.forward_frame` sliding cache that itself does not exist yet, with the plan's own window-anchored re-RoPE redesign layered on top). The plan's own fused figure (55 static + 78 activations = 133 of 143) is already at zero margin, and it omits the critic activations (see next finding), pushing fused to ~148 GB — a certain OOM, not a tight fit. +- 证据: _wm/GraphGWM/train/code_distill/stage3_dmd/dmd_gm.py:287 (stream_grad_replay), :292-294 ("36.1 GB of activations at horizon 8 and 77.8 GB at horizon 20"), :669-676 (--grad_pass, "which is what OOM'd the 8-GPU run"); absent from _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py +- 修法: Do not schedule stage 3 as a 3-hour tail on the plan. Make `stream_grad_replay` + a passing `test_kv_equiv.py` an explicit gate with its own budget, and make the FIRST stage-3 launch `--grad_horizon 8 --dmd_score_frames 8` (55 + 36 + critic ≈ 106 GB, real margin) regardless of whether streaming is ready. Only raise to 20 after a measured `torch.cuda.max_memory_allocated()` from a 20-step smoke. Also add `--opt8bit` back as a first-class escape hatch (see below) rather than the plan's third-choice `--critic_steps 3`. + + +### [MAJOR] The stage-3 budget omits the critic's activations entirely, and the plan never enables gradient checkpointing on the critic. A does both explicitly, with the number attached: the critic runs a full 21-frame forward+backward five times per step. The plan's `AropeDiT.forward` signature defaults `use_gradient_checkpointing=False`, and the stage-3 step ordering ("critic_loss → backward → _clip(critic,10) → opt_c.step") never passes it True. Under `fsdp_activation_checkpointing: false` (the plan's own yaml) nothing else supplies it. That is ~15 GB missing from a budget the plan calls "~60-70 GB OK". +- 证据: _wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:456 ("Critic does a full 21-frame forward+backward each step (~15GB activation) -> checkpoint it."), :458-459 (critic.use_gradient_checkpointing = True; student.use_gradient_checkpointing = True) +- 修法: Add to the stage-3 spec: every critic forward and the student's parallel/scoring forwards pass `use_gradient_checkpointing=True`; only `forward_frame` on the rollout path passes False (which the plan already asserts for a different reason, risk 6). Add `+15 GB critic activations` to the stage-3 table and re-state the streamed total as ~75-90 GB, not 60-70. + + +### [MAJOR] The stage-1/2 activation line is understated by roughly 7×, so "COMFORTABLE" is asserted on a number that contradicts the only measured per-card figure in the reference tree. WorldMind's stage-2 CD run — 8 ranks, FSDP, same 3-model shape, same token geometry — measured **~31.7 GiB/card**. On 8-rank FSDP with `opt8bit=1`, static is only ~11 GB (params 20/8 + grads 20/8 + AdamW8bit 10/8 + teacher 20/8 + ema 20/8), so ≈20 GB of that is activations/workspace at 21 frames. The plan budgets "activations (grad-ckpt, 16,380 tokens) ~3 GB" for stage 1 and "~5 GB" for stage 2. Same geometry, so the numbers transfer: WorldMind is 480×832 → latent 30×52 → 8190 tokens (16380 under TF), identical to ActionRoPE's [48,21,30,52]. Realistic 4-GPU ZeRO-2 stage-1 peak is ~50 GB, not "34-40". No OOM at 143 GB, but the same 3-GB intuition is what makes the stage-3 streamed line optimistic. +- 证据: _wm/WorldMind/ckpt/l4_distill/stage2_cd/v4_LIVE/README.md:16,134 ("8 卡 99% util、各 ~31.7 GiB", 8 ranks of cd_gm); _wm/WorldMind/distill/code/gamemaster/data/vrising.py:79 (target_hw=(480, 832)) +- 修法: Replace the invented per-line activation figures with the one measured anchor: ~20 GB activations/workspace per rank at F=21 / 16,380 tokens. Restate stage 1 as ~50 GB and stage 2 as ~75-85 GB of 143. Keep smoke S2 as the gate — but note that if SDPA falls to the math backend on the [16380,16380] mask, the risk-1 12.9 GB score tensor lands on top of ~50 GB, not on top of "34-40 GB". + + +### [MAJOR] Every memory and throughput anchor the plan borrows from WorldMind was measured with 8-bit Adam, and the plan drops it. Stage-2 v4_LIVE ran `opt8bit=1`; the stage-3 deploy run `v3_cd15k` ran `opt8bit: 1, paged_opt: 0`. The plan sets `--opt8bit 0` in both stages and dismisses bitsandbytes with "on 4×143 GB we do not need it". For stage 3 that self-inflicts +30 GB: fp32 AdamW m+v is 40 GB/model vs ~10 GB for AdamW8bit, so per-rank static goes from ~30 GB to the plan's 55 GB — on precisely the stage that has no margin. The plan's arithmetic is correct; its framing ("we do not need it") is not, and open_question 11 files it as an optional nicety rather than the largest single lever on the binding constraint. +- 证据: _wm/WorldMind/ckpt/l4_distill/stage3_dmd/v3_cd15k/config.json:30-31 ("opt8bit": 1, "paged_opt": 0); _wm/WorldMind/ckpt/l4_distill/stage2_cd/v4_LIVE/README.md:51 (opt8bit=1) +- 修法: Promote `--opt8bit` to the top of the stage-3 escape-hatch list (ahead of `dmd_teacher_offload_cpu` and `--critic_steps 3`) and resolve the bitsandbytes install decision BEFORE stage 3 rather than in open_questions — it is the difference between 55 GB and ~30 GB of static. Alternatively state plainly that the 4-GPU port is running a 25-GB-heavier optimizer than every measurement it cites. + + +### [MINOR] Stage-3 wall clock ignores the streamed-replay compute penalty. The 16.7 s/step anchor is real and correctly quoted — but it is from an 8×H200 run that used the **fused** grad pass (A has no streamed path at all). B's own docstring prices streaming at ~1.5-1.8× the forward compute. The plan mandates streaming and then keeps the fused timing, giving "~17 s/step ... 500 steps ≈ 3 h". +- 证据: _wm/WorldMind/ckpt/l4_distill/stage3_dmd/v3_cd15k/README.md:72 ("约 2h39m 跑 500 步,稳态 0.06 it/s(≈16.7 s/step)"); _wm/GraphGWM/train/code_distill/stage3_dmd/dmd_gm.py:672 ("~1.5-1.8x the forward compute") +- 修法: State stage 3 as ~25-30 s/step under `--grad_pass streamed` ⇒ 500 steps ≈ 3.5-4.5 h, and mark 16.7 s/step as the fused-path reference only. + + +### [MINOR] The GPU-busy guard the plan says it will derive checks ALL EIGHT cards, so ported as cited it aborts whenever GPUs 4-7 are in use by another user — the exact opposite of the isolation the plan wants. The plan cites `stage3_cd15k.sh:33-34` for the launcher derivation; the guard actually lives at :25-28 and is `nvidia-smi --query-gpu=memory.used --format=csv,noheader,nounits | awk '$1>20000' | wc -l`, with no `-i`. WorldMind's own stage-1 README records this firing for exactly this reason. +- 证据: _wm/WorldMind/distill/launch/stage3_cd15k.sh:25-28; _wm/WorldMind/ckpt/l4_distill/stage1_ar/v4/README.md:83-84 ("launcher 的 GPU 守卫在任一张卡 memory.used > 20000 MiB 时 abort") +- 修法: Write the guard as `nvidia-smi -i 0,1,2,3 --query-gpu=memory.used ...` (nvidia-smi -i uses physical indices and is unaffected by CUDA_VISIBLE_DEVICES) and fix the citation. Threshold 500 MiB as the plan says, not 20000. + + +### [MINOR] Several ways into GPUs 4-7 remain open. Every existing ActionRoPE launcher defaults to all eight cards, `smoke_all.sh` hardcodes 0-7, and four test docstrings prescribe GPUs 4/5/6/7. The plan's own open_question 1 ("first extend the SFT to 20k-40k on the same 4 GPUs") would in practice invoke `scripts/train_arope.sh`, which takes 8 unless the env var is exported. And the S-series smokes are specified as "1 GPU" / "2-GPU" with no `CUDA_VISIBLE_DEVICES` given. +- 证据: scripts/train_arope.sh:9, scripts/train_baseline.sh:14, scripts/train_plain.sh:8 (all `${CUDA_VISIBLE_DEVICES:-0,1,2,3,4,5,6,7}`); scripts/smoke_all.sh:46,60,103; tests/test_arm_adaln.py:3 (=7), tests/test_arm_xattn.py:3 (=5), tests/test_arm_prompt.py:3 (=6), tests/test_infer.py:3 (=4) +- 修法: Pin `CUDA_VISIBLE_DEVICES` explicitly in every S0-S9 command (S1/S2/S4/S6/S9 → `0`; S8 → `0,1`) and add an explicit note that the SFT-extension option requires `CUDA_VISIBLE_DEVICES=0,1,2,3 GA=2 bash scripts/train_arope.sh`, never the bare script. + + +### [MINOR] Stage-3 checkpoint disk is understated ~2×, and the host-RAM line is incomplete. The plan `.float()`s every stage-3 model, and `accelerator.get_state_dict` under FSDP returns a FULL_STATE_DICT with `offload_to_cpu=True, rank0_only=True` — i.e. fp32 tensors on rank-0 CPU. Unless `runlib.save_dit` explicitly casts to bf16 (the plan asserts the 10.0 GB / 827-bf16-tensor format but never says it downcasts an fp32 FSDP state dict), each file is ~20 GB: 10 saves × 3 files = 600 GB, not 300. WorldMind's own fp32 singles are 19,999,235,184 B. Separately, models are built on CPU (`load_dit(..., device="cpu")`), so four fp32 5B models per rank × 4 ranks ≈ 320 GB of host RAM live at prepare time, plus a 20 GB fp32 state dict on rank 0 at every save — the plan's RAM paragraph counts only the 12 GB of text tables. +- 证据: .venv/lib/python3.12/site-packages/accelerate/accelerator.py:4060-4066 (FSDP branch: FullStateDictConfig(offload_to_cpu=True, rank0_only=True)); actionrope/train.py:426 (load_dit(args.model_dir, device="cpu")); _wm/WorldMind/ckpt/l4_distill/stage2_cd/v4_LIVE/README.md ("单件大小 19,999,235,184 B = 18.63 GiB") +- 修法: Make `save_dit` cast to bf16 explicitly and assert `dtype is torch.bfloat16` on export (it also keeps the 827-key/10.0 GB ActionRoPE format claim true), or restate stage-3 disk as ~600 GB. Add the ~340-400 GB host-RAM figure to the resource table. Neither is binding — /data has 13 TB free and the box has 1,961 GB RAM available — but both numbers are wrong as written. + + +### [MINOR] Two source-config claims in the plan are factually wrong, in a way that misdirects the review. (a) `common/accelerate_fsdp_dmd.yaml` is `num_processes: 3`, not 8 — only `common/accelerate_fsdp.yaml` is 8, and every run.sh overrides it with `--num_processes "$NPROC"` on the CLI, so the yaml value is inert. The real 8-GPU history comes from `launch/stage3_cd15k.sh:11` (`NPROC=8 # match cd10k world_size=8 (run.sh default is 3)`). (b) risk 13 / the stage-1 launcher derivation both claim `scripts/train_arope.sh:6` hardcodes a dead `/opt/dlami/nvme/...` ROOT; it actually reads `ROOT=/data/zhiyangdeng/ActionRoPE`, correct on this box. Risk 13's "preconditions not met" is also stale — `data/latent/{train_eybx,val_eybx,arope_sidecar.pt,text_table_actionrope.pt}` and `outputs/arope_10k_ga2/step-10000.safetensors` (9,999,690,792 B, bf16) all exist as of Sep 5 16:13. +- 证据: _wm/WorldMind/distill/code/common/accelerate_fsdp_dmd.yaml:13 (num_processes: 3); _wm/WorldMind/distill/launch/stage3_cd15k.sh:11; scripts/train_arope.sh:6 (ROOT=/data/zhiyangdeng/ActionRoPE) +- 修法: Correct both claims and drop the S0 unpack step (or reduce it to a verification of the existing banner). The FSDP1 yaml itself is fine: accelerate 1.14 accepts `fsdp_version: 1` + `fsdp_reshard_after_forward: FULL_SHARD` (utils/dataclasses.py:1834-1873), and for v1 `sharding_strategy` is filled from the FULL_SHARD env default and wins at accelerator.py:1940 — so that part of the plan needs no change. diff --git a/backup_2026-09-14/code/distill/RUNBOOK.md b/backup_2026-09-14/code/distill/RUNBOOK.md new file mode 100644 index 0000000000000000000000000000000000000000..30c461ebaf87938c4ca87f41435f835bebcc413e --- /dev/null +++ b/backup_2026-09-14/code/distill/RUNBOOK.md @@ -0,0 +1,248 @@ +# ActionRoPE 三阶段蒸馏 —— 串联手册 + +因果强制(causal forcing)三阶段:**stage1 teacher forcing → stage2 CD 初始化 → stage3 DMD**。 +移植自 `teawhite/worldmind` 的 `WorldMind/distill/code/`(正典),`stream_grad_replay` 与 +`preflight_sliding_kv` 反向移植自 `GraphGWM/train/code_distill/`。 + +设计与逐条对抗评审结论在 `PORT_SPEC.md`。本文件只讲**怎么跑**。 + +## 铁律 + +* **只用 GPU 0-3。** 4-7 是别人的卡。`common.sh` 会在启动前检查 0-3 是否空闲, + 查不到占用(nvidia-smi 出错、返回行数不对)就拒绝启动 —— fail-closed,不是 fail-open。 + 阈值只能调严不能调松(`GPU_BUSY_MIB=999999` 不再是偷卡后门)。 +* **一次只跑一个阶段。** 三个阶段都要满 4 张卡。 +* 每个阶段的配方常量在**三处**重复:`run.sh` 的默认值 / `.py` 的 argparse 默认值 / + `config.json`。上游 WorldMind 这三处有六项不一致,每一项都对应一次已知崩溃。 + **改配方 = 同时改这三处。** + +## 用户已拍板 + +| 项 | 值 | 理由 | +|---|---|---| +| teacher | `outputs/arope_10k_ga2/step-10000.safetensors` | 不再续 SFT,直接开蒸 | +| stage1 等效 batch | 8(4 卡 × GA2),lr 1e-5 | 同 lr 下微调阶段更多 optimizer step 划算 | +| 部署采样表 | 4 步 `1000,750,500,250` | stage2 的 CD 轴与 stage3 的 rollout 都按这张表训;**训练与推理必须逐点相同** | + +## 跑之前 + +```bash +cd /opt/dlami/nvme/zhiyangdeng/ActionRoPE # 本机;旧机是 /data/zhiyangdeng/ActionRoPE +export PYTHONPATH=$PWD DIFFSYNTH_SKIP_DOWNLOAD=True + +# 全量测试(CPU 即可,不抢训练卡)—— 310 项通过 + 2 项 skip(两项 skip 是下面那两道真权重闸) +# 计数会随 flow map 的文件继续落地而变;红了才是问题,数字对不上先看是不是刚加了测试。 +AROPE_REQUIRE_SIDECAR=1 CUDA_VISIBLE_DEVICES="" .venv/bin/python -m pytest distill/tests/ -q # 有 AROPE_REQUIRE_SIDECAR 时语料包络门不许 skip + +# ★ 最吃重的两项默认都是 skip 的,都要**真实 5B 权重**,每次动过 arope_dit.py 都要跑。 +# 它们一旦失败,后面所有阶段都在量一个错的模型。 + +# (1) AropeDiT 与 arope_forward 逐位一致(回归锚点本体) +AROPE_BITPARITY_REAL=1 \ +AROPE_BITPARITY_CKPT=$PWD/outputs/arope_10k_ga2/step-10000.safetensors \ +CUDA_VISIBLE_DEVICES=0 .venv/bin/python -m pytest distill/tests/test_bitparity.py -q -k real + +# (2) flow map 装上去的那一刻,stage1b 教师逐位没被动过(对任意 r,不只是 r == t) +AROPE_FLOWMAP_REAL=1 \ +CUDA_VISIBLE_DEVICES=0 .venv/bin/python -m pytest distill/tests/test_flowmap_model.py -q -s -k real_weights +``` + +## flow map(stage2-flowmap 的模型侧) + +`AropeDiT.install_flowmap(form="residual", gate=1.0)` 给模型加第二个时间步 `r` +(`forward(..., r_timestep=)` / `forward_frame(..., r_k=)`),学均速度 `u(x_t, t, r)`。 + +* **默认 `residual` 形式对任意 (t, r) 与装之前逐位相同**(真权重实测 max|Δ| = 0.000e+00): + `delta_embedding = deepcopy(time_embedding)` 但**第二个 Linear 清零**。上游 AnyFlow 的 + `convex` 形式只在 `r == t` 的对角线上恒等,off-diagonal 差 1.2e-01 —— 我们 50 % 的样本按构造 + 就在 off-diagonal 上,所以它只留作消融(`--flowmap_form convex`)。 +* **初始化顺序**(写反了不报错,只是隐表示变垃圾,数值闸门看不见): + 新 run `AropeDiT() → load_dit_ckpt(stage1b)【strict 827】→ install_flowmap()`; + 续训 `AropeDiT() → install_flowmap() → load_dit_ckpt(dit_stepN)【strict 832】`。 + 非要反着来就得显式 `load_dit_ckpt(..., allow_missing=runlib.FLOWMAP_KEYS)`,别设成默认。 +* **checkpoint**:多 5 个平铺键 `delta_embedding.{0,2}.{weight,bias}` + `delta_gate`, + 827 → **832**(`runlib.AROPE_DIT_KEYS_FLOWMAP`,+20.5 MB),格式其余部分一字未变。 + 存的时候 `save_dit(..., expect_keys=runlib.AROPE_DIT_KEYS_FLOWMAP)` 并写 metadata + `flowmap=1 / flowmap_form / deltatime_type=r / delta_gate`;读的时候用 + `runlib.is_flowmap_ckpt(path)` 选采样器。**没有精确 827 键的导出**: + `u(x,t,t) = head(E(t) + g·D(P(t)))` 是两条 Sequential 的和,折不回一条 —— 于是 + `actionrope/infer.py`、`tests/check_ckpt.py`、`eval_bg50.py` 会拒收 flow-map 权重,这是对的。 +* **没装的时候 `r_timestep` 必须是 None 或与 `timestep` 完全相同**,否则直接断言失败。 + 上游那个 stock embedder 收下 r 然后忽略它,接错线会退化成普通扩散模型且不报错。 + +## stage1 —— teacher forcing 因果化 + +把双向 SFT 检查点在因果掩码下继续训,得到因果 AR 扩散模型。 + +```bash +bash distill/stage1_ar/run.sh +``` + +4 卡 DeepSpeed ZeRO-2,12000 步,实测 **7.0 s/step ⇒ 约 23 h**,每卡 37 GB。 +产物 `outputs/distill/stage1_ar_tf/dits/dit_step12000.safetensors`(827 张量 / 10.00 GB)。 + +`grad_clip` 默认 **10.0**,不是 SFT 名义上的 1.0:SFT 实测 5000 步 `grad_norm` +p50=0.072 / max=0.481,阈值 1.0 一次都没触发;stage1 的 gnorm 约 2.5,1.0 会**步步都裁**, +等于把优化器换成归一化 SGD、等效 lr 掉到约 1/3。10.0 同时对齐 WorldMind stage1 与 SFT 的实际行为。 + +健康信号:`loss_ema` 与 `--val_every 500` 的曲线。**不要**把单次 `grad_norm` 尖峰当发散 —— +它逐 run 不可复现、同样输入能摆动约 10×。 + +20 步实机冒烟(`OUT` 必须写绝对路径,`$ROOT` 在调用方 shell 里是空的): + +```bash +MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 VAL_EVERY=10 VAL_N=16 PORT=29541 \ + OUT=/data/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage1 \ + bash distill/stage1_ar/run.sh +``` + +## stage2 —— 因果一致性蒸馏(CD) + +在**部署轴**上做一致性蒸馏;产物是 **EMA**(不是裸 dit),它才是 stage3 的初始化。 + +```bash +bash distill/stage2_cd/run.sh # 默认吃 stage1 的 dit_step12000(4 卡 GA2) +DISTILL_NGPU=8 AR=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors \ + bash distill/stage2_cd/run.sh # 8 卡形式:GA 自动选 1,run.sh 断言等效 batch == 8;换了 AR= 就换 OUT 或 RESUME=none +``` + +4 卡 ZeRO-2(或 8 卡 GA1,等效 batch 都是 8),8000 步,lr 2e-6,betas `0.0,0.999`(CF 约定:目标随 EMA 漂移,动量会追旧目标)。本机 8 卡实测 5.06 s/步 ⇒ 约 11.3 h。 +`KEEP_EMAS=25` —— stage3 的 init 要从这些里挑,别按 `dits/` 的口径只留 2 个。 +产物 `outputs/distill/stage2_cd/ema/ema_step8000.safetensors`。 + +CD 目标:教师走**一个** Euler 步,学生与 EMA 各自在**自己的** σ 上取 x0 估计后求 MSE。 +(`cm_tn` 必须用 `σ_tn` 而不是 `σ_t` —— 这里曾经有过一个字符的 bug,现在与上游逐位一致。) + +**哪个节点没被约束(CD-1)。** 默认 4 节点部署轴 [1, 0.75, 0.5006, 0.2516] 上,部署终读点 +σ=0.2516 只当过一致性对的目标、从不是 source,没有任何一项 loss 约束它:学生在那里等于 stage1 +教师的一步估计**只在 step 0 成立**(student == ema == teacher),此后它是固定点族的自由分量, +共享参数下 pair 0-2 的梯度会顺带移动它而无恢复项。上游 N=48 轴的 σ=0.096 节点结构相同, +只是 c_out=−σ 的杠杆小 2.6×。训练中盯 `train_log.csv` 里 **idx==2 行的 `tgt_err`** +(= ‖f_EMA(·, 0.2516) − x0‖²)相对 step≤200 的基线;`cd` 降而 `tgt_err` 升才是问题。 +`CD_TAIL_T=100` 会在轴末再挂一个 σ=0.1011 节点(4 对,部署节点不变)—— 轴是 EMA 目标的定义, +**只能用于新 OUT 的新 run**,续训不能改轴;默认 0 是用户拍板的轴,不改。 + +## stage3 —— self-forcing DMD + +```bash +bash distill/stage3_dmd/run.sh # 默认吃 stage2 的 ema_step8000 +``` + +4 卡 **FSDP1**(不是 ZeRO-2),500 步,`SAVE_EVERY=50` —— 部署权重要逐个里程碑人眼挑。 +四个模型:因果学生 / 双向 critic(fake-score)/ 冻结的双向 real-score 教师 / EMA。 + +`SCORE_FRAMES=GRAD_HORIZON=20`:连续打分尾巴取 1+20 = 21 个 cell,正好等于教师与 critic +训练时的片长。**首次跑必须先量显存**: + +```bash +MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 PROFILE_MEM=1 PORT=29541 \ + OUT=/data/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage3 \ + bash distill/stage3_dmd/run.sh +``` + +预期每卡约 66 GiB(140 GiB 的卡)。`GRAD_PASS=streamed` 是默认且不要改成 `fused` —— +fused 在 horizon=20 时要 189 GiB/卡,必 OOM;streamed 的梯度与 fused 逐位等价。 +(`_budget_gate` 会在读 40 GB 基座权重**之前**就拦住必炸的组合。) + +`dmd` loss 应进入 +0.15…+0.68 区间而 `critic` 下降。**这是 min-max,单调收缩的 `dmd` 不是目标。** + +## 评测 + +```bash +# 少步学生是否还听动作 —— 背景位移 vs 指令位移 +CUDA_VISIBLE_DEVICES=0 .venv/bin/python -m distill.eval.rollout_eval \ + --ckpt outputs/distill/stage3_dmd/ema/ema_step400.safetensors \ + --denoise_list 1000,750,500,250 --actions right:1.0:21 +``` + +`rollout_eval.py` 是 `distill/` 里唯一不走 `common.sh` 的入口,它自带显存守卫; +训练在跑时它会拒绝上卡(`--allow_busy_gpu` 会把自己硬顶在空闲量减 8 GB,撑死只炸自己)。 +纯 CPU 自检:`--self_test --device cpu`。 + +### 崩了要先分清是路径还是曝光偏差 + +```bash +CUDA_VISIBLE_DEVICES=0 .venv/bin/python distill/eval/tf_rollout_probe.py \ + --ckpt <任意阶段的 ckpt> --clip clip_Eybx_100000092_000000 +``` + +同一条 KV-cache 路径跑两遍,唯一差别是提交进缓存的是**真值 latent** 还是**模型自己的 x0**: + +* **gt 平稳、self 衰减** ⇒ 部署路径没问题,崩的是误差累积(曝光偏差)。这正是 stage3 + self-forcing 要修的东西,不是 bug。 +* **gt 也衰减** ⇒ 部署路径与训练不匹配(t=0 提交 / 窗口锚定的 RoPE 或 mask),是移植 bug, + 别往下走。 + +**stage1@9000 的实测**(2026-09-06,供后续对比):gt 全程 22.7–31.8 dB 平稳; +self 从 cell 1 的 24.39 单调掉到 cell 17 的 16.20,同时 `|x0|` 从 1.111 涨到 1.404 +(真值一直在 1.2 附近)——能量正反馈,像素上表现为亮区从边缘往里收缩、cell 20 全黑。 +路径已排除,符合预期。 + +### sink / kv_window 的对比在 stage1 上问不出来 + +`sink=3 + window=17` 与 `sink=0 + window=20` 在 **21 个 cell 之内保留集完全相同** +(`[0,3) ∪ [3,20) == [0,20)`,没有驱逐),所以两者数学上等价、PSNR 逐位一样。 +它们只在 cell 21 开始驱逐后才分叉。要比这两个配置,得等模型能活过 cell 21 —— 即 stage3 之后。 + +## 出问题时 + +* **拒绝启动,说 GPU 有占用** —— 先 `nvidia-smi` 看是不是自己上一个 job 没退干净。 + 别去动 4-7。确认上一次真的死了再用 `FORCE_RUN_DIR=1`。 +* **续训** —— 三个阶段都默认 `RESUME=auto`(有 `progress.json` 就续)。 + stage1 有完整的 DeepSpeed state 双槽轮转;stage2/3 只热启动权重,优化器不落盘。 +* **loss 恒 0 且不报错** —— 检查 `grad_horizon ≤ dmd_score_frames`(argparse 会拦), + 以及 `rope_cap == sink + kv_window == F−1 == 20` 这条几何铁律。 + +## 还没做的两件事 + +1. **S8:2 卡 FSDP 分片一致性。** stage3 的 `arope_forward` 会直接伸手取 `dit.blocks[i].norm1` + 这类子模块;FSDP 的 `TRANSFORMER_BASED_WRAP` 只在被包模块的 `forward()` 里 all-gather, + 伸手取到的是分片、**不报错**。`AropeDiT` 的 monkeypatch 就是为了让每个 block 都从 + `block(...)` 进入,但"FSDP 真的 all-gather 对了"这件事只能在 2 卡上验。 + 卡一空出来就跑,在 stage3 首launch之前。 +2. **滑动 KV 的吞吐实测。** 每层都在 float64 重算整段历史的 RoPE。 + `PROFILE_MEM=1` 的冒烟同时会给出 s/step,量到了再信任何 wall-clock 估计。 + +## stage4 —— OPSD(On-Policy Self-Distillation,长视野后训练) + +MeiGen-AI OPSD-V 经 GraphGWM `stage4_opsd/opsd_gm.py` 移植(`distill/stage4_opsd/opsd_arope.py`),并对照 +官方实现 `vendor/OPSD-V/model/opsd_streaming_training.py` 逐行核对(差异表 `distill/OPSD_OFFICIAL_NOTES.md`)。 +后训练 stage3 的 `ema/ema_step300`,**不换采样器、不改推理**。学生用部署的 4 步 renoise 表 on-policy +rollout 61 个 cell(`data/latent_long/K3` 的长段)并提交自己的 x0;一份**冻结在初值**的教师在同一个 +(noisy, t) 上被求值,但它的缓存里是真值 0..k−2 + 最近生成的 k−1(默认官方口径:教师自己在最后一步算出的 x0, +`TEACHER_LAST_CHUNK=student` 换成 GraphGWM 的学生 x0;`snapshot_kv_cache` 分叉滞后一格的真值缓存); +loss = 两者速度场的 MSE,整窗所有打分 (cell, step) 取平均(`LOSS_NORM=window`,官方;`cell` = GraphGWM),逐 cell backward。 +几何 sink 3 / window 17 / cap 20 / absolute = stage3 训练与部署的几何。**训练面 = 官方的 LoRA rank 256 / lr 1e-5** +(`LORA_RANK`,distill/lora.py;教师 = 同一模型关补丁,存盘折回 827 键)。`LORA_RANK=0` 是全量微调,2026-09-10 实测 lr 1e-6 下 +step50 起就糊、step100 更糊(`outputs/distill/eval/stage4_opsd/ema{50,100}_60s_indist/`),别用。与官方仍不同的:教师冻结 +(官方 EMA adapter 0.9999 ≈ 冻结)、窗口起点固定在段首(VAE 首 latent 是锚点)、loss_start 12(官方 21,可 `LOSS_START=20`)。 + +```bash +# 三处配方(run.sh 默认 == argparse 默认 == config.json)由 tests/test_stage4_opsd.py 逐项比 +CUDA_VISIBLE_DEVICES="" .venv/bin/python distill/stage4_opsd/opsd_arope.py --smoke # 六条 CPU 不变量,~10 s +CUDA_VISIBLE_DEVICES="" .venv/bin/python distill/stage4_opsd/opsd_arope.py --dry_run \ + --output /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/_dry_opsd --max_steps 3 # tiny 三模型端到端 +CUDA_VISIBLE_DEVICES="" .venv/bin/python -m pytest -q -p no:cacheprovider \ + distill/tests/test_stage4_opsd.py distill/tests/test_kv_equiv.py + +# ★ 墙钟与显存都没量过(config.json 的 _budget 全是外推:60–160 s/步、峰值 ≈ 55–60 GiB/卡)。 +# 先跑 20 步冒烟(OUT 必须写绝对路径),看 [mem step*] 的峰值与 step_time,再开 300 步: +DISTILL_NGPU=8 MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 PROFILE_MEM=1 PORT=29547 \ + OUT=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage4 \ + bash distill/stage4_opsd/run.sh +DISTILL_NGPU=8 bash distill/stage4_opsd/run.sh # 正式:300 步,每 50 步存 dits/ + ema/,全留 +``` + +**开跑后要读的两个启动信号**(run.sh 与 `train.log` 里都有): + +1. `[first-step] opsd … gnorm …` —— opsd 必须**小但非零**(bf16 5B 上量级 1e-3…1e-1):恰好 0 = 教师在读学生 + 自己的上下文、没有任何信号(上游第一次 launch 就这样静默跑了 6 小时);很大 = 两者不在同一个状态上。 + gnorm 必须有限且 > 0。trainer 自己也拦:恰好 0.0 / NaN ⇒ SystemExit(ZERO-LOSS / gnorm 守卫,从第一步起就拦, + OPSD 没有 stage3 那种"第 0 步恰好 0"的配方性质)。 +2. `[model] mask-channel ||W||` 学生与教师都非零(known 掩码通道 = 空间条件;0 = 那个模型对它盲)。 + +教师冻结 ⇒ loss 缓慢下降是正常的;跌到起点的 15% 以下是 COLLAPSE(学生学会了无视自己的缓存,目标的退化极小值), +trainer 会在日志里打 `[warn] COLLAPSE?`(不中止)。 +**质量判据不是 loss**:`distill/eval/rollout_eval.py` 在 60+ cell 上把 `dits/dit_step{N}`(上游的部署产物,学生本体) +与 `ema/ema_step{N}`(我们额外的 fp32 EMA 影子)逐个里程碑与 pre-OPSD 的 `stage3_dmd/ema/ema_step300` 比远端漂移 —— +OPSD 的全部主张都在 rollout 的远端,那个对比才是交付物。`--teacher_context student` 只是自检(loss 恒 0),run.sh 拒绝用它训练。 diff --git a/backup_2026-09-14/code/distill/__init__.py b/backup_2026-09-14/code/distill/__init__.py new file mode 100644 index 0000000000000000000000000000000000000000..e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 diff --git a/backup_2026-09-14/code/distill/arope_dit.py b/backup_2026-09-14/code/distill/arope_dit.py new file mode 100644 index 0000000000000000000000000000000000000000..2cd0910520f7e652afaabc65812af5e708b47495 --- /dev/null +++ b/backup_2026-09-14/code/distill/arope_dit.py @@ -0,0 +1,1091 @@ +#!/usr/bin/env python3 +"""蒸馏用的 DiT 包装:`AropeDiT` = DiffSynth `WanModel` + ARoPE(世界坐标 RoPE / known-mask 通道 / +逐 cell 文本 cross-attn),三种前向模式共用一套权重。 + +为什么要包一层 nn.Module +----------------------- +`actionrope.arope.arope_forward` 是自由函数,直接伸手拿 `dit.patch_embedding` / `dit.time_embedding` +/ `dit.blocks[i].norm1` / `dit.head` 的参数。stage3 用 FSDP1 + TRANSFORMER_BASED_WRAP(DiTBlock): +block 的参数只在 **该 block 自己的 forward() 里** 才被 all-gather,在外面伸手拿到的是分片 —— +不报错,结果是垃圾(PORT_SPEC risk 2,全项目第一号静默腐化风险)。所以: + +1. 整个前向搬进 `AropeDiT.forward`(根模块的 forward,根上的 patch/time/head 参数在这里被 gather); +2. block 一律用 `block(...)` 调用以触发 FSDP 的 pre-forward hook —— 为此在 import 时把 + `diffsynth.models.wan_video_dit.DiTBlock.forward` 打成 `arope_block_forward` + (= `actionrope/arope.py:277-318` 的 `_block_forward` 逐行照抄,只把 `self_attn(input_x, freqs)` + 换成带 attn_mask / KV 缓存的 `arope_self_attn`;`arm` 钩子去掉,ARoPE 没有臂)。 + +三种前向模式 +----------- +1. **并行双向**(`causal=False, clean_x=None, kv_cache=None`)—— 与 `arope_forward` **逐位相同**, + 这是整个移植的回归锚点(`distill/tests/test_bitparity.py`)。 +2. **并行块因果**(`causal=True`):21 个 cell 之间因果、cell 内空间双向;`clean_x` 非 None 时再加 + teacher-forcing 双流 `[2S,2S]` 掩码(clean 流 + noisy 流;noisy cell f 只看自己 + **严格之前** 的 + clean cell,绝不看 clean cell f —— 那就是答案,泄漏 = loss 掉到 0 而 rollout 是坏的)。 +3. **流式单 cell**(`kv_cache` 非 None):滑窗 KV 缓存。缓存 **RoPE 之前的 K**,读的时候按 + **窗口锚定** 的坐标重新 RoPE(时间位 j-a、世界坐标 offset[j]-offset[a]),驱逐超出 kv_window 的最老 cell。 + +三条 BLOCKER(PORT_SPEC 对抗验证,违反任何一条都是"能跑、loss 会降、模型是错的") +----------------------------------------------------------------------------- +* **B1 first_frame_cond 绝不能进单 cell 路径。** `actionrope/arope.py:227` 的 `t_tok[:, 0] = 0` 抹的是 + "这个张量的第 0 帧";单 cell 前向里 f==1,于是 rollout 的每一个 cell 都被告知 t=0。 + `forward()` 在 kv_cache 非 None 时硬断言 `first_frame_cond is False`,`forward_frame` 无条件按 `t_k` 建时间步。 +* **B2 build_world_freqs 需要 f_start。** 上游签名固定查 `f_table[:f]`,单 cell 永远拿到时间位 0。 + 这里给出 distill 本地的 `build_world_freqs(..., f_start=0)` 变体(**不改** `actionrope/arope.py`), + f_start=0 时与上游逐位相同。 +* **B3 逐 cell 时间步。** 上游 `_per_token_timestep` 断言 `timestep.numel() == b`,stage1 要传 `[b, 21]`。 + 这里的 `_per_token_timestep_pf` 接受 标量 / `[b]` / `[b, F]`,前两种与上游逐位相同。 + +flow map(stage2-flowmap):第二个时间步 r +---------------------------------------- +`install_flowmap()` 之后模型学的是 **均速度** `u(x_t, t, r)`,`forward(..., r_timestep=...)` / +`forward_frame(..., r_k=...)` 多收一个 r。默认(`residual` + 读出层零初始化)**对任意 (t, r)** +都与装之前逐位相同,所以它同时是 flow map 的初值和回归锚点。没装的时候 r 这条路径完全不存在, +`r_timestep` 只准是 None 或与 `timestep` 相同 —— 上游那个不带 delta 分支的 embedder 会 **收下 r +然后忽略它**(transformer_far_wan_model.py:241),于是接错线会退化成普通扩散模型且不报错。 +新增的 5 个键(`delta_embedding.{0,2}.{weight,bias}` + `delta_gate`)挂在 **dit 上**,827 → 832。 + +另外两条硬规矩 +------------- +* **绝不对 KV rollout 做梯度检查点**(risk 6):滑窗 commit 是破坏性的(cat + 驱逐),checkpoint 重算时 + 读到的是 **驱逐之后** 的缓存 —— 缓存没满时报 `CheckpointError`,满了以后形状对、内容错、**不报错**。 + `forward()` 在 kv_cache 非 None 时断言 `use_gradient_checkpointing` 为假;`forward_frame` 里 block 直接调用。 +* **注意力只走 SDPA**(risk 8):import 时断言 flash-attn / sageattention 都没装 —— 装了的话 + `flash_attention()` 会改走别的 kernel,`arope_forward` 与本文件就悄悄分叉,回归锚点失效。 +""" +from __future__ import annotations + +import copy +import functools +import os +import sys + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +import torch +import torch.nn as nn +import torch.nn.functional as F +from einops import rearrange + +from diffsynth.core.gradient import gradient_checkpoint_forward +from diffsynth.models import wan_video_dit as _wvd +from diffsynth.models.wan_video_dit import WanModel, modulate, rope_apply, sinusoidal_embedding_1d + +ROOT = os.path.dirname(os.path.dirname(os.path.abspath(__file__))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +# _axis_freqs / _embed_context 直接复用上游实现:逐位等价是硬要求,不能各写一份 +from actionrope.arope import ( # noqa: E402 + MASK_EMBEDDING_NAME, + PX_PER_TOKEN, + _axis_freqs, + _embed_context, + install_arope, +) + +MODEL_DIR = os.path.join(ROOT, "models/Wan2.2-TI2V-5B") +DIT_FILES = [os.path.join(MODEL_DIR, f"diffusion_pytorch_model-0000{i}-of-00003.safetensors") for i in (1, 2, 3)] +LAT_H, LAT_W = 30, 52 + +# ---- flow map(stage2-flowmap):第二个时间步 r 的分支 ---------------------------------- +# 两个名字都挂在 **dit 上**(`dit.add_module` / `dit.register_buffer`),不是挂在 AropeDiT 包装上: +# runlib.strip_dit_prefix 只认 `dit.` / `arm.` 前缀,挂在包装上会被当成"包装层自己的 buffer"静默丢掉。 +# 这是 actionrope/arope.py:196-206 给 arope_mask_embedding 用的同一条先例。 +DELTA_EMBEDDING_NAME = "delta_embedding" +DELTA_GATE_NAME = "delta_gate" +FLOWMAP_FORMS = ("residual", "convex") + +# risk 8:本文件的自注意力恒走 F.scaled_dot_product_attention;上游 flash_attention() 在这三个标志 +# 全为 False 时也落到 SDPA,两条路径才逐位相同。哪天有人 pip install flash-attn,这个断言先炸, +# 而不是让 test_bitparity 之外的所有下游悄悄测在另一个模型上。 +assert not (_wvd.FLASH_ATTN_3_AVAILABLE or _wvd.FLASH_ATTN_2_AVAILABLE or _wvd.SAGE_ATTN_AVAILABLE), ( + "检测到 flash_attn / sageattention:DiffSynth 的 flash_attention() 会改走它们," + "而 distill/arope_dit.py 恒走 SDPA,两条路径不再逐位相同。卸载它们,或先修 arope_self_attn。" +) + + +# -------------------------------------------------------------------------- +# 世界坐标 RoPE(distill 本地变体:多一个 f_start) +# -------------------------------------------------------------------------- + +def rot2d(vec: torch.Tensor, ang: torch.Tensor) -> torch.Tensor: + """把 (dx, dy)(屏幕 u 向右、v 向下,单位任意)绕原点转 ang 弧度。vec [..., 2]、ang 可广播到 [...]。 + + u' = u·cos − v·sin,v' = u·sin + v·cos。v 轴朝下 ⇒ 正角在屏幕上是顺时针,纯约定。 + """ + c, s_ = torch.cos(ang), torch.sin(ang) + u, v = vec[..., 0], vec[..., 1] + return torch.stack([u * c - v * s_, u * s_ + v * c], dim=-1) + + +def world_pos_maps(offset_tok: torch.Tensor, angle, h: int, w: int, scale=None): + """逐 token 的世界坐标 (pos_h, pos_w),各 [b, f, h, w]。 + + cell j 的 token (i_h, j_w) 在**当前相机系**里的位置 = 绕画幅中心转 angle[b,j] 之后再加该 cell 的偏移: + (u, v) = R(angle) · (j_w − ctr_w, i_h − ctr_h) + (dx, dy) + (ctr_w, ctr_h) + angle 全 0 ⇒ 退化成可分离的 pos_h = i + dy / pos_w = j + dx(与旋转前的实现逐位相同)。 + """ + b, f = offset_tok.shape[:2] + dev, dt = offset_tok.device, torch.float64 + gi = torch.arange(h, device=dev, dtype=dt).view(1, 1, h, 1).expand(b, f, h, w) + gj = torch.arange(w, device=dev, dtype=dt).view(1, 1, 1, w).expand(b, f, h, w) + ctr_h, ctr_w = (h - 1) / 2.0, (w - 1) / 2.0 + local = torch.stack([gj - ctr_w, gi - ctr_h], dim=-1) # [b, f, h, w, 2] = (u, v) + ang = angle.to(device=dev, dtype=dt).view(b, f, 1, 1) + rot = rot2d(local, ang) + if scale is not None: + # 位置整体等比缩放(判决实验):位置铺得越开 ⇒ 这一帧名义上覆盖的世界越大。 + # 若模型把"位置场变大"读成"视野变大",画面内容就该按 1/scale 缩小。 + rot = rot * torch.as_tensor(scale, device=dev, dtype=dt).view(b, f, 1, 1, 1) + off = offset_tok.to(dt).view(b, f, 1, 1, 2) + pos_w = rot[..., 0] + off[..., 0] + ctr_w + pos_h = rot[..., 1] + off[..., 1] + ctr_h + return pos_h, pos_w + + +def build_world_freqs(dit: WanModel, f: int, h: int, w: int, offset_tok=None, device=None, + f_start: int = 0, angle=None, scale=None) -> torch.Tensor: + """`actionrope.arope.build_world_freqs` + `f_start`(BLOCKER B2)。 + + f_start:这一段 token 的时间轴 **绝对起点**,查 `f_table[f_start:f_start+f]`。滑窗 KV 路径靠它把 + 单个 cell 放到时间位 tpos(否则 f==1 永远拿到位置 0,整条历史与当前帧的相对时间全塌成 0)。 + f_start=0 时与上游函数逐位相同(`f_table[0:f]` 就是 `f_table[:f]`)。 + + offset_tok: [b, f, 2] = (dx_tok, dy_tok),token 单位;None ⇒ 普通查表 RoPE,返回 [f*h*w, 1, 64], + 否则返回 [b, f*h*w, 1, 64]。dtype 跟随 dit.freqs(complex128)。 + + angle: [b, f] 弧度,每个 cell 的相机朝向**相对当前 cell**(当前 cell 恒为 0)。None / 全 0 ⇒ 走可分离 + 路径(逐位等于旋转支持加入之前的实现)。非零时改走逐 token 的位置图:h/w 两轴被耦合,位置不再可分离。 + RoPE 本身对小数位置是解析的(`polar(1, pos·inv_freq)`),所以旋转出来的小数坐标天然合法; + 模型没见过的是"位移随 token 位置变化"这种场,而不是某个没见过的数值。 + """ + f_table, h_table, w_table = dit.freqs + if device is None: + device = offset_tok.device if offset_tok is not None else f_table.device + d_h, d_w = h_table.shape[1] * 2, w_table.shape[1] * 2 # 42, 42 + assert f_start >= 0 and f_start + f <= f_table.shape[0], ( + f"时间轴 RoPE 表只有 {f_table.shape[0]} 行,要不到 [{f_start}, {f_start + f})" + ) + ft = f_table[f_start:f_start + f] + + if offset_tok is None: + # 走与原函数一样的查表,保证等价性;不重新算 h/w 轴 + return torch.cat([ + ft.view(f, 1, 1, -1).expand(f, h, w, -1), + h_table[:h].view(1, h, 1, -1).expand(f, h, w, -1), + w_table[:w].view(1, 1, w, -1).expand(f, h, w, -1), + ], dim=-1).reshape(f * h * w, 1, -1).to(device) + + offset_tok = offset_tok.to(device=device, dtype=torch.float64) + b = offset_tok.shape[0] + assert offset_tok.shape == (b, f, 2), f"offset_tok 形状应为 [b, {f}, 2],得到 {tuple(offset_tok.shape)}" + dx = offset_tok[..., 0] # [b, f] + dy = offset_tok[..., 1] + has_rot = angle is not None and bool(torch.any(torch.as_tensor(angle) != 0)) + has_scale = scale is not None and bool(torch.any(torch.as_tensor(scale) != 1)) + if has_rot or has_scale: + ang = (torch.zeros(b, f, device=device, dtype=torch.float64) if angle is None + else torch.as_tensor(angle, device=device, dtype=torch.float64)) + assert ang.shape == (b, f), f"angle 形状应为 [b={b}, f={f}],得到 {tuple(ang.shape)}" + pos_h, pos_w = world_pos_maps(offset_tok, ang, h, w, scale) # 各 [b, f, h, w] + fh = _axis_freqs(pos_h, d_h) # [b, f, h, w, 21] + fw = _axis_freqs(pos_w, d_w) + freqs = torch.cat([ + ft.to(device).view(1, f, 1, 1, -1).expand(b, f, h, w, -1), fh, fw, + ], dim=-1) + return freqs.reshape(b, f * h * w, 1, -1).to(f_table.dtype) + + pos_h = torch.arange(h, device=device, dtype=torch.float64).view(1, 1, h) + dy.view(b, f, 1) # [b, f, h] + pos_w = torch.arange(w, device=device, dtype=torch.float64).view(1, 1, w) + dx.view(b, f, 1) # [b, f, w] + fh = _axis_freqs(pos_h, d_h) # [b, f, h, 21] + fw = _axis_freqs(pos_w, d_w) # [b, f, w, 21] + freqs = torch.cat([ + ft.to(device).view(1, f, 1, 1, -1).expand(b, f, h, w, -1), + fh.view(b, f, h, 1, -1).expand(b, f, h, w, -1), + fw.view(b, f, 1, w, -1).expand(b, f, h, w, -1), + ], dim=-1) + return freqs.reshape(b, f * h * w, 1, -1).to(f_table.dtype) + + +def _freqs_cat_dim(freqs: torch.Tensor) -> int: + """freqs 的 token 轴:无 batch 的 [S,1,64] 是 0,逐样本的 [b,S,1,64] 是 1。""" + assert freqs.dim() in (3, 4), f"freqs 应为 [S,1,64] 或 [b,S,1,64],得到 {tuple(freqs.shape)}" + return 0 if freqs.dim() == 3 else 1 + + +# -------------------------------------------------------------------------- +# 时间步:标量 / [b] / [b, F] +# -------------------------------------------------------------------------- + +def _per_token_timestep_pf(latents: torch.Tensor, timestep, n_tok_per_frame: int, + first_frame_cond: bool) -> torch.Tensor: + """逐 token 时间步。标量 / [b] 与 `actionrope.arope._per_token_timestep` 逐位相同; + 多出的 `[b, F]` 分支是 stage1 的逐 cell 加噪要的(BLOCKER B3)。 + + first_frame_cond 在展开之后才作用(把 cell 0 的 t 置 0),所以 `[b, F]` 传进来时 + cell 0 那一列会被覆盖成 0 —— 这正是 ActionRoPE 的 TI2V 契约(cell 0 是干净锚点)。 + 返回 [b, f * n_tok_per_frame],dtype 跟 latents。 + """ + b, f = latents.shape[0], latents.shape[2] + timestep = torch.as_tensor(timestep, device=latents.device).to(latents.dtype) + # 上游 _per_token_timestep 无条件先 reshape(-1),所以 [b,1] / [1,1] 在它那里是合法的"逐样本"写法。 + # 只在形状 **不可能** 是逐 cell(不是 [b,f])且元素数为 1 或 b 时压平:接受的输入集合是上游的严格超集, + # 且 f==1 时两种解释本来就同解,不存在歧义。 + if timestep.dim() > 1 and tuple(timestep.shape) != (b, f) and timestep.numel() in (1, b): + timestep = timestep.reshape(-1) + if timestep.dim() <= 1: + timestep = timestep.reshape(-1) + if timestep.numel() == 1: + timestep = timestep.expand(b) + assert timestep.numel() == b, f"timestep 应为标量 / [b={b}] / [b={b}, f={f}],得到 {timestep.numel()} 个" + t_tok = timestep.view(b, 1, 1).expand(b, f, n_tok_per_frame).clone() + else: + assert timestep.shape == (b, f), f"逐 cell timestep 形状应为 [b={b}, f={f}],得到 {tuple(timestep.shape)}" + t_tok = timestep.view(b, f, 1).expand(b, f, n_tok_per_frame).clone() + if first_frame_cond: + t_tok[:, 0] = 0 + return t_tok.reshape(b, f * n_tok_per_frame) + + +def _ts_equal(a, b) -> bool: + """两个时间步参数(标量 / [b] / [b,F] / python float)在数值上是否完全相同。 + + 只在"模型没装 flow map 却收到了 r"这条断言路径上用(正常训练/推理都不走),所以允许它做 + 一次 device→CPU 的同步。同一个对象直接返回 True,不做任何拷贝。 + """ + if a is b: + return True + ta = torch.as_tensor(a).detach().to(device="cpu", dtype=torch.float64).reshape(-1) + tb = torch.as_tensor(b).detach().to(device="cpu", dtype=torch.float64).reshape(-1) + if ta.numel() == 1 and tb.numel() > 1: + ta = ta.expand_as(tb) + elif tb.numel() == 1 and ta.numel() > 1: + tb = tb.expand_as(ta) + return ta.shape == tb.shape and bool(torch.equal(ta, tb)) + + +# -------------------------------------------------------------------------- +# 注意力掩码 +# -------------------------------------------------------------------------- + +class _KVRef: + """指回 KV cache 本体的自引用句柄 —— 用来绕开 FSDP 对 forward 输入容器的重建。 + + ★ 这是一个必须记住的 FSDP 行为:混合精度下 FSDP 会 cast forward 的输入, + `_apply_to_tensors` 会**遍历并重建** dict / list / tuple,于是 `forward_frame` 写进去的 + K/V 落在一份**拷贝**上,调用方的 cache 永远是空的 —— 而且不报错(2 卡实测: + `外层 dict is 内层 dict → False`,commit 之后外层 cell 数恒为 0)。 + + 但 FSDP 只 cast 张量,**非张量值按引用原样保留**(同一实测:放进去的哨兵对象 `is` 相同)。 + 所以在 cache 里塞一个指回自己的普通对象,就能在 forward 里把原始 dict 找回来。 + + 为什么不改成"把 cache 挂成模块属性":调用必须走包装模块的 forward(参数 all-gather 挂在 + 那里,直接调 forward_frame 拿到的是分片、同样不报错),而 34 处调用点与全部测试都按 + `kv_cache=` 这个 kwarg 写的。用自引用句柄两边都不用动。 + """ + + __slots__ = ("cache",) + + def __init__(self, cache: dict): + self.cache = cache + + +def build_causal_mask(f: int, hw: int, device, local: int = 0, sink: int = 0, + drop_anchor: bool = False) -> torch.Tensor: + """块因果 [S, S] bool(True=可见):cell 之间因果,cell 内空间双向。S = f*hw。 + + local>0 ⇒ 只看最近 local 个 cell(外加 sink 个恒可见的开头 cell),对角线恒保留。 + stage1/2 都是 local=0 —— F=21 下"窗口 20 + sink 1"与全因果等价,而 sink=0 的 W=20 会把 + cell 0(ActionRoPE 的干净锚点)从 cell 20 的视野里踢掉,是致命的。 + """ + fidx = torch.arange(f * hw, device=device) // hw # [S] 每个 token 属于哪个 cell + causal = fidx.unsqueeze(1) >= fidx.unsqueeze(0) + if drop_anchor: # 见 build_tf_mask 的同名参数 + causal = causal & ((fidx.unsqueeze(0) != 0) | (fidx.unsqueeze(1) == 0)) + if local and local > 0: + in_win = fidx.unsqueeze(0) > (fidx.unsqueeze(1) - local) + if sink and sink > 0: + in_win = in_win | (fidx.unsqueeze(0) < sink) + return (causal & in_win) | (fidx.unsqueeze(1) == fidx.unsqueeze(0)) + return causal + + +def build_tf_mask(f: int, hw: int, device, local: int = 0, sink: int = 0, + drop_anchor: bool = False) -> torch.Tensor: + """teacher-forcing 双流掩码 [2S, 2S] bool。token [0,S) = clean 流,[S,2S) = noisy 流。 + + * clean q:在 clean 半流内块因果(看 clean 0..f)。 + * noisy q(cell f):看自己那一个 noisy cell + **严格之前** 的 clean cell(fk < fq)。 + 绝不看 clean cell f(那就是答案),也绝不看别的 noisy cell。 + 对角线(eye)恒保留。 + + local>0 时同时约束 **两个半流**——上游 `gamemaster_dit.py:546 vs :549-554` 只约束了 noisy_ctx, + clean 半流仍是全块因果,于是窗口化训练会从 clean 半流泄漏无界历史。这里顺手修掉(虽然我们不用窗口)。 + """ + S = f * hw + tok = torch.arange(2 * S, device=device) + cln = tok < S + fr = torch.where(cln, tok // hw, (tok - S) // hw) # 两个半流各自的 cell 序号 0..f-1 + cq, ck = cln[:, None], cln[None, :] + fq, fk = fr[:, None], fr[None, :] + clean_mask = cq & ck & (fk <= fq) + noise_self = (~cq) & (~ck) & (fq == fk) + noise_ctx = (~cq) & ck & (fk < fq) + # drop_anchor:把 clean cell 0(TI2V 锚点)从**每一个** noisy cell 的视野里摘掉,其余历史照旧。 + # 这是「只 drop 场景参考、保留历史」那条 null —— 与 local/sink 拼不出来:local=F−1 sink=0 只能 + # 把 cell 0 挤出**最后一格**的窗口,cell 19 的 20 格窗口里它还在。 + # Δv_anchor = v(全) − v(drop_anchor) 才是"锚点相对于历史的话语权",正是外观漂移要压的那一项。 + if drop_anchor: + noise_ctx = noise_ctx & (fk != 0) + if local and local > 0: + in_win = fk > (fq - local) + if sink and sink > 0: + in_win = in_win | (fk < sink) + noise_ctx = noise_ctx & in_win + clean_mask = clean_mask & in_win + eye = tok[:, None] == tok[None, :] + return eye | clean_mask | noise_self | noise_ctx + + +# -------------------------------------------------------------------------- +# 自注意力:并行(可带 mask) / 流式(滑窗 KV 缓存) +# -------------------------------------------------------------------------- + +def _heads(x: torch.Tensor, n: int) -> torch.Tensor: + return rearrange(x, "b s (n d) -> b n s d", n=n) + + +def _unheads(x: torch.Tensor, n: int) -> torch.Tensor: + return rearrange(x, "b n s d -> b s (n d)", n=n) + + +def _evict(t: torch.Tensor, kv: dict) -> torch.Tensor: + """滑窗驱逐:缓存超过 sink + kv_window 个 cell 就丢掉最老的 **非 sink** cell。t: [b, n*hw, dim]。""" + kw = kv["kv_window"] + if kw is None: + return t + hw, sink = kv["hw"], kv["sink_size"] + while t.shape[1] // hw > sink + kw: + t = torch.cat([t[:, :sink * hw], t[:, (sink + 1) * hw:]], dim=1) + return t + + +def arope_self_attn(sa, x: torch.Tensor, freqs: torch.Tensor, attn_mask=None, kv=None) -> torch.Tensor: + """`SelfAttention.forward` 的替身。attn_mask=None 且 kv=None 时与上游 **逐位相同** + (上游 `flash_attention()` 在没装 flash/sage 时同样落到 SDPA,见文件头的 import 断言)。 + + kv 非 None ⇒ 流式:缓存 **RoPE 之前** 的 K,读的时候按窗口锚定坐标重算 + (`kv["freqs_hist"]` 给历史、`kv["freqs_cur"]` 给当前 cell)。RoPE 是相对编码,所以重锚定对 + 注意力分数是**精确**的;但缓存的 K/V 是从带掩码通道的 x 算出来的,掩码按各 cell **提交时**的 + 锚点固化,k>20 之后的历史与一段锚在 k−20 的训练片段并不逐位相同(stage2→stage3 输入移位, + 自强迫训练穿过,GEO-2)。 + """ + n = sa.num_heads + if kv is None: + q = rope_apply(sa.norm_q(sa.q(x)), freqs, n) + k = rope_apply(sa.norm_k(sa.k(x)), freqs, n) + v = sa.v(x) + o = F.scaled_dot_product_attention(_heads(q, n), _heads(k, n), _heads(v, n), attn_mask=attn_mask) + return sa.o(_unheads(o, n)) + + # ---- 流式单 cell ---- + li = kv["layer"] + k_raw = sa.norm_k(sa.k(x)) # 进缓存的是这个(RoPE 之前) + v = sa.v(x) + q = rope_apply(sa.norm_q(sa.q(x)), kv["freqs_cur"], n) + k_hist, v_hist = kv["k"][li], kv["v"][li] + if k_hist is None: + k_cat, v_cat = rope_apply(k_raw, kv["freqs_cur"], n), v + else: + fh = kv["freqs_hist"] + assert fh is not None and fh.shape[_freqs_cat_dim(fh)] == k_hist.shape[1], ( + f"历史 freqs 与缓存长度不符:freqs {tuple(fh.shape)} vs k_hist {tuple(k_hist.shape)}" + ) + k_cat = torch.cat([rope_apply(k_hist, fh, n), rope_apply(k_raw, kv["freqs_cur"], n)], dim=1) + v_cat = torch.cat([v_hist, v], dim=1) + o = F.scaled_dot_product_attention(_heads(q, n), _heads(k_cat, n), _heads(v_cat, n), attn_mask=None) + if kv["commit"]: + nk = k_raw if k_hist is None else torch.cat([k_hist, k_raw], dim=1) + nv = v if v_hist is None else torch.cat([v_hist, v], dim=1) + # detach:缓存是跨帧的常量,梯度绝不能穿过它(stage3 的 streamed replay 正是靠这一点才是精确的) + kv["k"][li] = _evict(nk, kv).detach() + kv["v"][li] = _evict(nv, kv).detach() + return sa.o(_unheads(o, n)) + + +# -------------------------------------------------------------------------- +# DiTBlock.forward 的猴补丁(FSDP all-gather 必须经过 block(...) 这个入口) +# -------------------------------------------------------------------------- + +def arope_block_forward(self, x, context, t_mod, freqs, *, f: int | None = None, + attn_mask=None, kv=None): + """= `actionrope/arope.py:277-318` 的 `_block_forward`(arm 去掉),唯一改动: + `self.self_attn(input_x, freqs)` → `arope_self_attn(self.self_attn, input_x, freqs, attn_mask, kv)`。 + + f:逐 cell 文本 cross-attn 的 cell 数(TF 双流时是 2*Fl)。context 是整条 [b,L,dim] 时用不到, + 默认 None —— 这样 DiffSynth 自己的 `model_fn_wan_video`(`block(x, context, t_mod, freqs)`, + 四个位置参数、整条 context)在打完补丁之后照样能跑,且逐位不变。 + """ + has_seq = len(t_mod.shape) == 4 + chunk_dim = 2 if has_seq else 1 + shift_msa, scale_msa, gate_msa, shift_mlp, scale_mlp, gate_mlp = ( + self.modulation.to(dtype=t_mod.dtype, device=t_mod.device) + t_mod).chunk(6, dim=chunk_dim) + if has_seq: + shift_msa, scale_msa, gate_msa, shift_mlp, scale_mlp, gate_mlp = ( + shift_msa.squeeze(2), scale_msa.squeeze(2), gate_msa.squeeze(2), + shift_mlp.squeeze(2), scale_mlp.squeeze(2), gate_mlp.squeeze(2), + ) + input_x = modulate(self.norm1(x), shift_msa, scale_msa) + x = self.gate(x, gate_msa, arope_self_attn(self.self_attn, input_x, freqs, attn_mask, kv)) + + q_in = self.norm3(x) + if context.shape[0] == x.shape[0]: + x = x + self.cross_attn(q_in, context) + else: + b = x.shape[0] + assert f is not None, "逐 cell context 需要显式传 f(block 的 cell 数)" + assert context.shape[0] == b * f, f"逐 cell context 应有 b*f={b * f} 行,得到 {context.shape[0]}" + q_in = rearrange(q_in, "b (f n) c -> (b f) n c", f=f) + y = self.cross_attn(q_in, context) + x = x + rearrange(y, "(b f) n c -> b (f n) c", f=f) + + input_x = modulate(self.norm2(x), shift_mlp, scale_mlp) + x = self.gate(x, gate_mlp, self.ffn(input_x)) + return x + + +# 全局、一次性:所有 DiTBlock 实例(含 DiffSynth 自己 pipeline 里的)都换成上面这个 forward。 +_wvd.DiTBlock.forward = arope_block_forward + + +# -------------------------------------------------------------------------- +# 模型加载 +# -------------------------------------------------------------------------- + +def load_dit(model_dir: str = MODEL_DIR, device: str = "cpu") -> WanModel: + """只加载 DiT(不挂 T5 / VAE),bf16,先落 CPU —— 与 `actionrope/train.py:163-174` 一致。""" + from diffsynth.pipelines.wan_video import ModelConfig, WanVideoPipeline + + files = [os.path.join(model_dir, f"diffusion_pytorch_model-0000{i}-of-00003.safetensors") for i in (1, 2, 3)] + pipe = WanVideoPipeline.from_pretrained( + torch_dtype=torch.bfloat16, device=device, + model_configs=[ModelConfig(path=files)], + tokenizer_config=None, redirect_common_files=False, + ) + return pipe.dit + + +def unwrap(model: nn.Module) -> "AropeDiT": + """拿到裸的 AropeDiT(DeepSpeed / FSDP / DDP 包装之后 `init_kv_cache`、`dit.freqs` 都要走裸模块)。""" + while hasattr(model, "module"): + model = model.module + return model + + +# -------------------------------------------------------------------------- +# AropeDiT +# -------------------------------------------------------------------------- + +class AropeDiT(nn.Module): + """WanModel + ARoPE 的包装。三种前向模式见文件头。 + + causal:False = 双向教师 / critic;True = 因果学生(块因果掩码 + 允许 TF 双流 + 允许流式 KV)。 + train_local_attn_size / train_sink_size:窗口化训练(stage1/2 都是 0,即全因果)。 + """ + + def __init__(self, model_dir: str = MODEL_DIR, mask_channel: bool = True, causal: bool = False, + train_local_attn_size: int = 0, train_sink_size: int = 0, dit: WanModel | None = None, + flowmap_form: str | None = None): + super().__init__() + if dit is None: + dit = load_dit(model_dir, device="cpu") + # mask 通道零初始化:装上的瞬间输出与原模型完全相同 + self.dit = install_arope(dit, mask_channel=mask_channel) + self.mask_channel = bool(mask_channel) + self.causal = bool(causal) + self.train_local_attn_size = int(train_local_attn_size) + self.train_sink_size = int(train_sink_size) + # 训练期把 cell 0(TI2V 锚点)从 noisy 的视野里摘掉,其余历史保留 —— Δv_anchor 的 null + self.train_drop_anchor = False + # flow map(stage2-flowmap)的第二时间步分支:None = 没装(默认,与装之前逐位相同)。 + # 装了以后是 "residual" / "convex"。__init__ **绝不自己装**,只有 install_flowmap() 会。 + # 传进来的 dit 已经带着 delta 分支(deepcopy / 再包一层 / 从 832 键装载过)时必须显式说明是 + # 哪一种形式:两种形式的融合公式不同,猜错了就是"能跑、数值是另一个模型"。 + assert flowmap_form is None or flowmap_form in FLOWMAP_FORMS, ( + f"flowmap_form 只能是 {FLOWMAP_FORMS} 或 None,得到 {flowmap_form!r}") + if hasattr(self.dit, DELTA_EMBEDDING_NAME): + assert flowmap_form is not None, ( + "传进来的 dit 上已经有 delta_embedding 了,请显式给 AropeDiT(..., flowmap_form=...):" + "residual 与 convex 的融合公式不同,猜错了不会报错,只会安静地跑成另一个模型。") + self.flowmap_form: str | None = flowmap_form + # 模块级默认;每次 forward 还可以单独传。KV rollout 上两者都必须是假(risk 6)。 + self.use_gradient_checkpointing = False + self.use_gradient_checkpointing_offload = False + # [16380,16380] 的 bool 掩码 268 MB,按 (f, hw, tf, 窗口, device) 缓存,别每步重建 + self._mask_cache: dict = {} + + # ---- 小工具 ---- + + def move_rope_table(self, device) -> "AropeDiT": + """`dit.freqs` 是普通 tuple 属性(不是 buffer),`.to(device)` / prepare 都搬不动它。 + DeepSpeed / FSDP prepare 之后必须在 **裸模块** 上调一次。""" + self.dit.freqs = tuple(t.to(device) for t in self.dit.freqs) + return self + + def _get_mask(self, f: int, hw: int, device, tf: bool): + if not self.causal: + return None + key = (f, hw, bool(tf), self.train_local_attn_size, self.train_sink_size, + bool(self.train_drop_anchor), str(device)) + m = self._mask_cache.get(key) + if m is None: + build = build_tf_mask if tf else build_causal_mask + m = build(f, hw, device, self.train_local_attn_size, self.train_sink_size, + drop_anchor=bool(self.train_drop_anchor)) + self._mask_cache[key] = m + return m + + def _mask_embed(self, mask_input, ref: torch.Tensor): + """mask 通道的 embedding。ref 是 patch_embedding 的 **输出**(不是权重)—— + autocast 下输出是 bf16 而权重可能是 fp32,拿错参照物就与 arope.py:372 不再逐位相同。""" + if mask_input is None: + return None + if not hasattr(self.dit, MASK_EMBEDDING_NAME): + raise ValueError("给了 mask_input 但 dit 没有 arope_mask_embedding,请先 install_arope(dit, mask_channel=True)") + return getattr(self.dit, MASK_EMBEDDING_NAME)(mask_input.to(device=ref.device, dtype=ref.dtype)) + + # ---- flow map:第二个时间步 r ---- + + @property + def has_flowmap(self) -> bool: + """装了 delta 分支没有。**以 dit 上的模块为准**,不看包装上的 flowmap_form —— + 续训是"先 install 再 strict load",权重里有没有这五个键才是唯一事实。""" + return hasattr(self.dit, DELTA_EMBEDDING_NAME) + + def install_flowmap(self, form: str = "residual", gate: float = 1.0) -> "AropeDiT": + """装上第二时间步 r 的 delta 分支。**绝不从 __init__ 调**(见下面的初始化顺序)。 + + form="residual"(默认,本项目用的) + t = E(t) + g · D(r),`D = deepcopy(E)` 但把 **第二个 Linear** 的 weight/bias 清零。 + 于是 D(·) ≡ 0,对 **任意** (t, r) 都与装之前逐位相同 —— 这是硬要求:我们 50 % 的样本 + 按构造就在 r ≠ t 的off-diagonal 上,而初值是 24 GPU-hours 换来的 stage1b 教师。 + 只清 **读出层**、保留第一层学好的 256→3072:分支一上来就有 r 的有意义隐表示, + ∂L/∂delta_embedding[2] 在第 0 步就非零,立刻开始学(arope_mask_embedding 零初始化 Conv3d 的同一套路)。 + form="convex"(上游 AnyFlow,transformer_far_wan_model.py:330) + t = (1−g)·E(t) + g·D(r),D 是 E 的原样 deepcopy。**只在 r == t 那条对角线上**与教师相同; + off-diagonal 是两个不同时间嵌入的 0.75/0.25 混合(CPU 实测 max|Δ| ≈ 1.1e-01)。 + 只留作"上游保真度"消融,别指望它是恒等的。 + ⚠ 千万别在 convex 里"顺手零初始化":那给出 t = 0.75·E(t),把教师的时间嵌入缩水 25 %, + 比两种做法都糟,却长得像一个安全的零初始化。 + + gate:`dit.delta_gate`,**persistent=True 的 buffer**,跟着权重走。上游是 persistent=False + (从 config 重建),于是训练与推理可以悄悄用不同的门而不报错。residual 形式下门乘的是一个 + 本来就是 0 的读出,第 0 步冗余,之后只等价于给 delta_embedding[2] 换一个有效 lr。 + + 导出格式(runlib):两个名字都挂在 dit 上 ⇒ state_dict 里是 `dit.delta_embedding.{0,2}.{weight,bias}` + 和 `dit.delta_gate`,strip_dit_prefix 剥掉 `dit.` 之后正好是 5 个新键,827 → 832 + (runlib.AROPE_DIT_KEYS_FLOWMAP / runlib.FLOWMAP_KEYS)。挂在 AropeDiT 包装上会被静默丢掉。 + + 初始化顺序(写错了不会报错,会静默丢掉教师): + 新 run : AropeDiT(...) → load_dit_ckpt(m, stage1b)【strict 827】→ install_flowmap() + 续训 : AropeDiT(...) → install_flowmap() → load_dit_ckpt(m, dit_stepN)【strict 832】 + 反过来(先 install 再从 827 的 ckpt 装)会 deepcopy 到 **随机初始化** 的 time_embedding, + 之后 load 又把 time_embedding 覆盖成教师的 —— delta 分支第一层从此与 time_embedding 不一致。 + residual 形式下输出仍然是恒等的(读出是 0),但分支的隐表示是垃圾。所以装完立刻自检 + (见下面的两个 assert),训练脚本再另外跑一次真前向的 max|Δ| == 0.0 闸门。 + """ + assert form in FLOWMAP_FORMS, f"flowmap_form 只能是 {FLOWMAP_FORMS},得到 {form!r}" + # ★ convex 形式下门必须落在开区间 (0, 1)。上游 gate_value = 0.25。 + # g == 1.0(本方法的 residual 默认值)会让 t = 0·E(t) + 1·D(r) —— 时间嵌入被 r 嵌入**整个替换**, + # 模型对 t 再无任何依赖(实测 |u(t=900,r=100) − u(t=100,r=100)| = 0.000e+00)。 + # 而 r == t 时 D(t) == E(t)(D 是 E 的原样 deepcopy),所以 trainer 那道 + # _assert_teacher_identity(convex 只查对角线)会**给出绿灯**。静默、灾难性, + # 只要有人写了 `--flowmap_form convex` 而忘了跟上 `--delta_gate 0.25` 就会中招。 + # g == 0.0 则是另一个极端:delta 分支恒被乘没,r 完全不起作用,退化成普通扩散模型。 + if form == "convex": + assert 0.0 < float(gate) < 1.0, ( + f"convex 形式的 delta_gate 必须落在开区间 (0, 1),得到 {gate}(上游 gate_value = 0.25)。\n" + f" t = (1−g)·E(t) + g·D(r):g=1 把时间嵌入整个换成 r 嵌入(模型对 t 零依赖)," + f"g=0 把 r 分支整个乘没(退化成普通扩散)。两种都能骗过只查 r==t 对角线的同一性闸。\n" + f" 想用上游保真度消融请写 --flowmap_form convex --delta_gate 0.25。" + ) + assert not self.has_flowmap, ( + "已经装过 flow map 了。重复 install 会用当前的 time_embedding 重新 deepcopy 一份," + "把已经训练过的 delta 分支整个丢掉(residual 形式下还会把它清零)—— 静默、无报错。" + ) + dit = self.dit + emb = dit.time_embedding + assert isinstance(emb, nn.Sequential) and len(emb) == 3, ( + f"time_embedding 应是 Sequential(Linear, SiLU, Linear),得到 {emb}" + ) + delta = copy.deepcopy(emb) + if form == "residual": + nn.init.zeros_(delta[2].weight) + nn.init.zeros_(delta[2].bias) + dit.add_module(DELTA_EMBEDDING_NAME, delta) + + ref = emb[0].weight + g = torch.tensor([float(gate)], dtype=ref.dtype, device=ref.device) + assert float(g.item()) == float(gate), ( + f"gate={gate} 在 {ref.dtype} 下不可精确表示(存回来是 {float(g.item())}):" + "门要跟着 bf16 权重一起存盘,不精确就意味着训练用的门和装载回来的门不是同一个数" + ) + dit.register_buffer(DELTA_GATE_NAME, g, persistent=True) + self.flowmap_form = form + + if form == "residual": + assert torch.equal(delta[0].weight, emb[0].weight) and torch.equal(delta[0].bias, emb[0].bias), ( + "delta_embedding 第一层应当是 time_embedding 的逐位副本" + ) + assert float(delta[2].weight.abs().max()) == 0.0 and float(delta[2].bias.abs().max()) == 0.0, ( + "residual 形式的 delta_embedding 读出层必须是全 0" + ) + return self + + def _embed_time(self, t_tok: torch.Tensor, r_tok: torch.Tensor | None) -> torch.Tensor: + """[b, S] 的逐 token 时间步 → [b, S, dim] 的时间嵌入。 + + 没装 flow map ⇒ 与改动之前 **逐字相同** 的一行(回归锚点靠这个)。 + 装了 ⇒ 按 flowmap_form 融合。三个要点: + * 融合发生在 **time_projection 之前**,而 time_projection[0] 就是 SiLU —— + `dit.time_projection(blended)` 逐字等于上游的 `time_proj(act_fn(rt_emb))`。 + * 两个分支共用 **同一个** 正弦编码和同一个 0..1000 量纲。r 用 [0,1] 的 σ 而 t 用 [0,1000] + 的话,正弦编码会悄悄塌成近似常数。 + * 门与 delta 分支的输出统一 cast 到 **主分支的 dtype**,绝不让 fp32 的门把 bf16 的和提升成 + fp32(上游 :326 把门 cast 成第三种 dtype,混合精度提升进 time_proj,bf16 下 r==t 的恒等性 + 在 1e-3 量级就破了)。 + """ + dit = self.dit + b, S = t_tok.shape + e_t = sinusoidal_embedding_1d(dit.freq_dim, t_tok.reshape(-1)).view(b, S, -1) + base = dit.time_embedding(e_t) + if r_tok is None: + return base + assert self.flowmap_form in FLOWMAP_FORMS, ( + f"dit 上有 delta 分支但包装的 flowmap_form 是 {self.flowmap_form!r} —— " + "谁把两者拆开了(直接 add_module?绕过 install_flowmap?)") + e_r = sinusoidal_embedding_1d(dit.freq_dim, r_tok.reshape(-1)).view(b, S, -1) + delta = getattr(dit, DELTA_EMBEDDING_NAME)(e_r).to(base.dtype) + g = getattr(dit, DELTA_GATE_NAME).to(base.dtype) + if self.flowmap_form == "convex": + return (1.0 - g) * base + g * delta + return base + g * delta + + def _resolve_r(self, timestep, r_timestep): + """r 的准入闸门,返回真正要用的 r(没装 flow map 时恒为 None)。 + + 上游那个不带 flow map 的 embedder **收下 r_timestep 然后忽略它** + (transformer_far_wan_model.py:241),于是"忘了接 delta 分支"会退化成一个普通扩散模型, + 不报错、loss 照降。这里两边都硬断言:装了就必须给 r;没装就只准不给、或者给一个与 t 相同的 r。 + """ + if self.has_flowmap: + assert r_timestep is not None, ( + "模型装了 flow map(dit.delta_embedding 存在),r_timestep / r_k 是必填的。" + "扩散槽请显式传 r_timestep=timestep,别省略。" + ) + return r_timestep + if r_timestep is None: + return None + assert _ts_equal(timestep, r_timestep), ( + "模型没装 flow map(没有 dit.delta_embedding),r_timestep 只能是 None 或与 timestep 完全相同;" + "给了一个不同的 r 说明调用方以为自己在跑 flow map —— 那会静默地跑成普通扩散。" + "先 install_flowmap()。" + ) + return None + + # ---- 前向 ---- + + def forward(self, x: torch.Tensor, timestep, context: torch.Tensor, *, + context_ids=None, offset_px=None, mask_input=None, first_frame_cond: bool = True, + r_timestep=None, clean_x=None, aug_t=None, + frame_index=None, kv_cache=None, commit: bool = True, + offset_win=None, mask_in_k=None, angle_win=None, angle_px=None, scale_px=None, + use_gradient_checkpointing: bool = False, + use_gradient_checkpointing_offload: bool = False) -> torch.Tensor: + """x [b, 48, f, 30, 52] → [b, 48, f, 30, 52](TF 模式只返回 noisy 半流,形状同样是 f 个 cell)。 + + 并行路径 + timestep 标量 / [b] / [b, f](逐 cell) + context [b, 512, 4096](整条)或 [b, f, 512, 4096](逐 cell) + context_ids [b, f] 整数,同 id ⇒ 同串,用于逐 cell 去重 + offset_px [b, f, 2] px;None ⇒ 普通查表 RoPE + mask_input [b, 1, f, 30, 52] float,known=1 / new=0 + first_frame_cond cell 0 是干净锚点,其 timestep 与 r 都置 0 + r_timestep flow map 的第二个时间步(0..1000,与 timestep 同量纲、同形状规则)。 + 装了 flow map ⇒ **必填**(扩散槽显式传 r_timestep=timestep); + 没装 ⇒ 只能是 None 或与 timestep 完全相同。first_frame_cond 对 r **同样** + 生效 —— 否则 TI2V 锚点那一格会掉到对角线之外,而那正是最不能变的一格。 + clean_x [b, 48, f, 30, 52] 干净历史流 ⇒ 打开 teacher forcing 双流(要求 causal=True) + aug_t clean 半流的时间步(None ⇒ 0,即精确干净)。clean 半流的 r **硬接** r := t + (= 上游把 clean_timestep 同时当两个参数传,trainer:359):干净流恒在对角线上。 + + 流式路径(kv_cache 非 None):转发给 `forward_frame`。这个转发是故意的 —— + FSDP 的参数 all-gather 挂在 **包装模块的 forward** 上,**绝不要**在被包装的模型上直接调 + `forward_frame`。反过来 `init_kv_cache` 必须在裸模块(`unwrap(m)`)上调。 + """ + gc = bool(use_gradient_checkpointing or self.use_gradient_checkpointing) + gc_off = bool(use_gradient_checkpointing_offload or self.use_gradient_checkpointing_offload) + r_eff = self._resolve_r(timestep, r_timestep) # 没装 flow map ⇒ None,下面整条 r 路径不存在 + + if kv_cache is not None: + # ★ FSDP 会重建 forward 的输入容器(见 _KVRef 的 docstring):拿 ref 把**调用方的 + # 那一份** dict 找回来,否则 commit 写进拷贝、缓存永远是空的且不报错。 + ref = kv_cache.get("_ref") + if ref is not None and ref.cache is not kv_cache: + kv_cache = ref.cache + # BLOCKER B1:first_frame_cond 抹的是"这个张量的第 0 帧",单 cell 前向里就是全部 + assert first_frame_cond is False, ( + "流式路径必须 first_frame_cond=False:单 cell 前向 f==1," + "arope.py:227 的 t_tok[:,0]=0 会把 rollout 里每一个 cell 的时间步都抹成 0" + ) + assert clean_x is None, "teacher forcing 是训练路径,不能与 KV 缓存同用" + assert angle_px is None, "流式路径的相机朝向走 angle_win([b, n_cached+1],相对当前 cell)" + assert offset_px is None, "流式路径的世界坐标走 offset_win([b, n_cached+1, 2],窗口锚定)" + assert mask_input is None, "流式路径的 known 掩码走 mask_in_k([b, 1, 1, 30, 52])" + assert not gc, ( + "绝不能对 KV rollout 做梯度检查点:滑窗 commit 是破坏性的,重算时读到的是驱逐后的缓存 —— " + "缓存满了以后形状对、内容错、不报错(PORT_SPEC risk 6)" + ) + assert frame_index is not None, "流式路径必须给 frame_index(绝对 cell 序号)" + return self.forward_frame(x, timestep, context, frame_index, kv_cache, commit, + offset_win=offset_win, mask_in_k=mask_in_k, context_ids=context_ids, + r_k=r_eff, angle_win=angle_win) + + dit = self.dit + b, _, f_in, lat_h, lat_w = x.shape + p_f, p_h, p_w = dit.patch_size + n_tok = (lat_h // p_h) * (lat_w // p_w) + tf = clean_x is not None + if tf: + assert self.causal, "teacher forcing 双流只对因果学生有意义(causal=True)" + assert clean_x.shape == x.shape, f"clean_x {tuple(clean_x.shape)} 应与 x {tuple(x.shape)} 同形" + + # ---- 时间步:逐 token ---- + ts_noisy_tok = _per_token_timestep_pf(x, timestep, n_tok, first_frame_cond) # [b, f*n_tok] + # r 与 t 走 **同一个** 展开函数、同一个 first_frame_cond:cell 0 的 t 和 r 一起被抹成 0 + rs_noisy_tok = (None if r_eff is None + else _per_token_timestep_pf(x, r_eff, n_tok, first_frame_cond)) + if tf: + # clean 半流:aug_t=None ⇒ 全 0(精确干净)。给了 aug_t 就整条按 aug_t, + # 不再套 first_frame_cond —— clean cell 0 本来就是锚点,与其它 clean cell 同一个噪声级别。 + ts_clean_tok = (torch.zeros_like(ts_noisy_tok) if aug_t is None + else _per_token_timestep_pf(clean_x, aug_t, n_tok, False)) + t_tok = torch.cat([ts_clean_tok, ts_noisy_tok], dim=1) # [b, 2*f*n_tok] + # clean 半流恒在 r == t 的对角线上(--tf_aug > 0 时就是 r_clean = aug_t,不是 0) + r_tok = None if rs_noisy_tok is None else torch.cat([ts_clean_tok, rs_noisy_tok], dim=1) + else: + t_tok = ts_noisy_tok + r_tok = rs_noisy_tok + t = self._embed_time(t_tok, r_tok) + t_mod = dit.time_projection(t).unflatten(2, (6, dit.dim)) + + # ---- 文本:TF 时在 4D 层面复制(clean / noisy 两半共用同一条 cell 文本)---- + if tf and context.dim() == 4: + context = torch.cat([context, context], dim=1) # [b, 2f, L, 4096] + if context_ids is not None: + context_ids = torch.cat([context_ids, context_ids], dim=1) # [b, 2f] + ctx = _embed_context(dit, context, context_ids) + + # ---- patch embedding(+ 零初始化的 mask 通道)---- + xt = dit.patch_embedding(x) + mask_emb = self._mask_embed(mask_input, xt) + if mask_emb is not None: + xt = xt + mask_emb + f, h, w = xt.shape[2:] + assert f * h * w == ts_noisy_tok.shape[1], ( + f"patch 之后的 token 数 {f * h * w} 与时间步 {ts_noisy_tok.shape[1]} 不符(temporal patch 必须是 1)" + ) + tokens = rearrange(xt, "b c f h w -> b (f h w) c").contiguous() + s_half = f * h * w + if tf: + # clean 半流用同一份 mask embedding(数值上与重算一遍完全一样) + xc = dit.patch_embedding(clean_x) + if mask_emb is not None: + xc = xc + mask_emb + tokens = torch.cat([rearrange(xc, "b c f h w -> b (f h w) c").contiguous(), tokens], dim=1) + + # ---- RoPE:TF 时两半各自从 f_start=0 起算(cat 两份 21 帧的表,而不是造一张 42 帧的表)---- + if offset_px is None: + assert angle_px is None, "给了 angle_px 就必须给 offset_px(坐标要一起旋)" + freqs = build_world_freqs(dit, f, h, w, None, device=x.device) + else: + # angle_px [b, f] 弧度:**绝对**朝向,锚在 cell 0(并行路径里 cell 0 是干净的 TI2V 锚点, + # 它的格点必须保持轴对齐)。None ⇒ 逐位走旋转支持加入之前的老路。 + freqs = build_world_freqs(dit, f, h, w, offset_px.to(torch.float64) / PX_PER_TOKEN, + device=x.device, angle=angle_px, scale=scale_px) + if tf: + freqs = torch.cat([freqs, freqs], dim=_freqs_cat_dim(freqs)) + + # ---- 掩码 + blocks ---- + attn_mask = self._get_mask(f, h * w, tokens.device, tf) + f_cross = 2 * f if tf else f + for block in dit.blocks: + # 用 block(...) 而不是伸手拿 block 的子模块:FSDP 的 all-gather 挂在这个入口上 + tokens = gradient_checkpoint_forward( + functools.partial(block, f=f_cross, attn_mask=attn_mask, kv=None), + gc, gc_off, + tokens, ctx, t_mod, freqs, + ) + + # ---- head:TF 时只取 noisy 半流(clean 前缀连同它的时间调制一起丢掉)---- + if tf: + tokens = tokens[:, s_half:] + t = t[:, s_half:] + tokens = dit.head(tokens, t) + return dit.unpatchify(tokens, (f, h, w)) + + # ---- 滑窗 KV 缓存 ---- + + def init_kv_cache(self, kv_window: int | None = 20, sink_size: int = 0, rope_cap: int = 20, + num_layers: int | None = None) -> dict: + """每条 rollout 一份新缓存(换 clip 必须重建)。**在裸模块上调**(`unwrap(m).init_kv_cache(...)`)。 + + kv_window=None ⇒ 绝对模式:缓存无限增长,时间位就是 frame_index(等价性测试 / 短 rollout 用)。 + kv_window 给了 ⇒ 滑窗模式:缓存 raw K,读的时候按窗口锚定坐标重算 RoPE, + 超出 sink + kv_window 就驱逐最老的非 sink cell。 + + ActionRoPE 的部署配置是 sink_size=0:WorldMind 的 sink 把开头几帧永久钉在 RoPE 位 0..sink-1, + 但这里 h/w 的 RoPE 位是 **一直在漂的世界坐标**(实测 21 个 cell 内最大位移 373 px = 11.66 token), + 钉住的 sink 帧在 rollout 几十个 cell 之后会落在世界坐标几十个 token 之外,模型没见过。 + sink=0 + 窗口锚定 ⇒ 每个注意力窗口的 RoPE 坐标精确等于一段训练片段的坐标(只解决坐标 OOD; + 缓存 cell 的掩码通道按提交时锚点固化,见 arope_self_attn;latent 值离流形见 PORT_SPEC R10)。 + """ + n = num_layers if num_layers is not None else len(self.dit.blocks) + assert self.causal, "KV 缓存是因果学生的流式路径(causal=True)" + if kv_window is not None: + assert kv_window >= 1 and sink_size >= 0 + assert rope_cap == sink_size + kv_window, ( + f"rope_cap 必须 == sink_size + kv_window({rope_cap} != {sink_size} + {kv_window}):" + "时间位 tpos 恒等于窗口内已缓存的 cell 数,超过 cap 就是训练时没见过的相对距离" + ) + cache = { + "k": [None] * n, "v": [None] * n, "frames_cached": 0, + "kv_window": kv_window, "sink_size": int(sink_size), "rope_cap": int(rope_cap), + "hw": None, "layer": None, "commit": False, "freqs_cur": None, "freqs_hist": None, + } + # 自引用句柄:FSDP 会重建 forward 的输入容器,靠它在 forward 里找回**这一份** dict。 + # 非张量值 FSDP 按引用保留,所以 ref 穿得过去(见 _KVRef 的 docstring 与 2 卡实测)。 + cache["_ref"] = _KVRef(cache) + return cache + + @staticmethod + def release_kv_cache(cache: dict) -> None: + """用完一条 rollout 必须调 —— `_ref` 与 cache 互相引用,构成**引用环**。 + + 引用计数放不掉环,只能等循环 GC,而 GC 是惰性的:一条 21 cell 的 rollout 缓存十几 GB + 的 K/V,几步之内显存就爬满(实测 98 → 120 → 126 GB 然后 OOM)。 + `clear()` 把 dict 清空即断环,张量当场释放。 + """ + if cache is not None: + cache.clear() + + @staticmethod + def snapshot_kv_cache(cache: dict) -> dict: + """浅快照:分叉一条历史给别人读写(stage4 OPSD 的教师上下文),**原缓存一个字节不动**。 + + 为什么浅拷贝就是正确的分支(与上游 GraphGWM `KVCache.clone_shallow` 同一条依据): + `arope_self_attn` 的提交趟写的是 `kv["k"][li] = _evict(torch.cat([k_hist, k_raw]), kv).detach()` + —— `torch.cat` 造**新**张量、`_evict` 要么原样返回它要么再 cat 一个新的,然后**重新绑定** + 列表槽位;缓存里已有的张量从不被就地写。`frames_cached` 是 int、`freqs_*` / `hw` / `layer` / + `commit` 也都是每次前向重新赋值的瞬态字段。所以:新 dict + 拷贝过的 'k'/'v' 列表 + 指向新 dict + 的 `_KVRef`,就是一条独立分支 —— 往快照里 commit 只改快照的槽位,原缓存的槽位仍指着旧张量。 + + 与 `forward_frame` 入口断言 `frames_cached == frame_index` 的配合(stage4 的用法): + 真实历史 0..k−2 的快照 frames_cached == k−1;把学生的 cell k−1 以 frame_index=k−1 commit 进快照 + ⇒ frames_cached == k;随后给 cell k 打分(frame_index=k)正好通过。用完必须 + `release_kv_cache(snapshot)`:快照自己也带 `_ref` 引用环(原缓存不受影响,共享的张量仍被它持有)。 + """ + snap = {k: v for k, v in cache.items() if k != "_ref"} + snap["k"] = list(cache["k"]) + snap["v"] = list(cache["v"]) + snap["_ref"] = _KVRef(snap) + return snap + + @staticmethod + def last_kv_frame(cache: dict) -> tuple[list, list]: + """取**最近一次 commit** 的那个 cell 的 raw K/V(每层 [b, hw, dim],RoPE 之前,clone 过、detach 过)。 + + 提交趟把新 cell cat 在末尾、`_evict` 只从 sink 之后丢最老的,所以最近一格恒是每层最后 hw 个 token。 + clone:调用方通常紧接着 `release_kv_cache` 这份缓存,切片视图会拖着整条 [b, n*hw, dim] 不放。 + stage4 OPSD 用它复现官方的写入顺序(见 `append_kv_frame`)。""" + hw = cache["hw"] + assert hw is not None and cache["k"][0] is not None, "缓存还没提交过任何 cell" + ks = [t[:, -hw:].detach().clone() for t in cache["k"]] + vs = [t[:, -hw:].detach().clone() for t in cache["v"]] + return ks, vs + + @staticmethod + def append_kv_frame(cache: dict, k_slices: list, v_slices: list, frame_index: int) -> None: + """把一格**已经算好的** raw K/V 按提交趟的规则追加进缓存:逐层 cat + `_evict` + frames_cached 推进。 + + 与 `arope_self_attn` 的 commit 路径逐字相同(cat 造新张量、重新绑定槽位、原张量不动),所以对 + `snapshot_kv_cache` 的快照调用同样不碰原缓存。用途(stage4 OPSD,官方 gt_kv 的写入顺序):官方教师把 + 自己的 chunk k 写进缓存时缓存里还是 [GT 0..k−2, 教师的 k−1],**之后**才把 k−1 原位换成 GT;于是打分 + k+1 时最近一格的 K/V(第 1 层起)是在"教师的 k−1"上下文里算出来的,不是在全 GT 历史上重算的。 + 我们的缓存 append-only,只能:cell k 打分完把教师的 x0 commit 进它打分用的那条快照(上下文正是官方的), + `last_kv_frame` 取走那格 raw K/V,cell k+1 时用本函数把它接到真值 0..k−1 的新快照末尾。 + raw K/V 与位置无关(RoPE 读时按 (tpos, offset_win) 重算),搬到另一条同长度的缓存末尾是精确的。""" + assert cache["frames_cached"] == frame_index, ( + f"append_kv_frame:frame_index={frame_index} 但缓存最后提交的是 cell {cache['frames_cached'] - 1}") + assert len(k_slices) == len(cache["k"]) == len(v_slices), "层数不符" + hw = k_slices[0].shape[1] + assert cache["hw"] in (None, hw), (cache["hw"], hw) + k0 = cache["k"][0] + n_cached = 0 if k0 is None else k0.shape[1] // hw + if cache["kv_window"] is not None: + cap = cache["sink_size"] + cache["kv_window"] + assert n_cached == min(frame_index, cap), (n_cached, frame_index, cap) + else: + assert n_cached == frame_index, (n_cached, frame_index) + cache["hw"] = hw + for li in range(len(cache["k"])): + kh, vh = cache["k"][li], cache["v"][li] + kn, vn = k_slices[li], v_slices[li] + assert kn.shape[1] == hw and vn.shape[1] == hw, (kn.shape, vn.shape) + nk = kn if kh is None else torch.cat([kh, kn], dim=1) + nv = vn if vh is None else torch.cat([vh, vn], dim=1) + cache["k"][li] = _evict(nk, cache).detach() + cache["v"][li] = _evict(nv, cache).detach() + cache["frames_cached"] = frame_index + 1 + + def forward_frame(self, x_k: torch.Tensor, t_k, ctx_k: torch.Tensor, frame_index: int, + kv_cache: dict, commit: bool = True, *, + offset_win=None, mask_in_k=None, context_ids=None, r_k=None, + angle_win=None) -> torch.Tensor: + """单 cell 前向,注意力打到缓存里的历史 + 自己。**不要直接调**(走 `forward(..., kv_cache=...)`, + 否则 FSDP 不 all-gather 根模块的参数)。 + + x_k: [b, 48, 1, 30, 52] + t_k: 标量 / [b] / [b, 1],**原样使用**,绝不套 first_frame_cond(BLOCKER B1) + r_k: flow map 的第二时间步,规则同 t_k:**同样原样使用、同样不套 first_frame_cond** + (B1 对 r 一字不差地成立)。装了 flow map ⇒ 必填;没装 ⇒ None 或与 t_k 相同。 + ctx_k: [b, 1, 512, 4096](逐 cell)或 [b, 512, 4096](整条) + frame_index 绝对 cell 序号 k + commit True = 把这一帧的 K/V 写进缓存(干净/最终那一趟);False = 中间去噪趟,只读不写。 + 滑窗 commit 是 append-only 的:同一个 frame_index commit 两次会把这帧塞进去两遍, + n_cached / 驱逐全乱。拦它的是入口的 `frames_cached == frame_index` 断言(每次 + commit 把 frames_cached 推到 frame_index+1);下面的 n_cached 断言只在缓存饱和 + 之前有效 —— k ≥ cap 后 `_evict` 让 n_cached 恒等于 cap,重复 / 漏 commit 形状对、 + 内容错、不报错(GEO-3)。 + offset_win [b, n_cached+1, 2] px,**窗口锚定**:offset_win[:,0] 恒为 0(窗口里最老那个 cell), + offset_win[:,-1] 是当前 cell。None ⇒ 普通查表 RoPE。 + mask_in_k [b, 1, 1, 30, 52],用 **锚定之后** 的 offset 算的 known 掩码。 + """ + dit = self.dit + assert self.causal, "forward_frame 是因果学生的流式路径(causal=True)" + b, _, f1, lat_h, lat_w = x_k.shape + assert f1 == 1, f"forward_frame 一次只处理一个 cell,得到 f={f1}" + p_f, p_h, p_w = dit.patch_size + h, w = lat_h // p_h, lat_w // p_w + hw = h * w + + # ★ GEO-3:每个 frame_index 恰好 commit 一次。缓存饱和后 n_cached 恒 == cap,下面那条断言 + # 拦不住重复 / 漏 commit(形状对、内容错、不报错),只有这个计数器能。commit=False 的去噪趟 + # 不推进它,所以同一 frame_index 上反复 commit=False 再 commit=True 一次照样通过。 + assert kv_cache["frames_cached"] == frame_index, ( + f"frame_index={frame_index} 但缓存最后提交的是 cell {kv_cache['frames_cached'] - 1} " + "—— 漏 commit 或重复 commit 了" + ) + + # 缓存长度以第 0 层为准(各层同步推进) + k0 = kv_cache["k"][0] + n_cached = 0 if k0 is None else k0.shape[1] // hw + sliding = kv_cache["kv_window"] is not None + if sliding: + cap = kv_cache["sink_size"] + kv_cache["kv_window"] + assert n_cached == min(frame_index, cap), ( + f"缓存里有 {n_cached} 个 cell,按 frame_index={frame_index} / 窗口 {cap} 应为 " + f"{min(frame_index, cap)} —— 漏 commit 或重复 commit 了" + ) + else: + assert n_cached == frame_index, ( + f"绝对模式下缓存长度必须等于 frame_index({n_cached} != {frame_index})" + ) + tpos = n_cached # 当前 cell 的时间位;滑窗下恒等于 min(frame_index, rope_cap) + + # ---- 时间步:原样用 t_k / r_k,**没有** first_frame_cond ---- + r_eff = self._resolve_r(t_k, r_k) + t_tok = _per_token_timestep_pf(x_k, t_k, hw, first_frame_cond=False) # [b, hw] + r_tok = (None if r_eff is None + else _per_token_timestep_pf(x_k, r_eff, hw, first_frame_cond=False)) + t = self._embed_time(t_tok, r_tok) + t_mod = dit.time_projection(t).unflatten(2, (6, dit.dim)) + + ctx = _embed_context(dit, ctx_k, context_ids) + + xt = dit.patch_embedding(x_k) + mask_emb = self._mask_embed(mask_in_k, xt) + if mask_emb is not None: + xt = xt + mask_emb + assert xt.shape[2] == 1 and xt.shape[3] == h and xt.shape[4] == w + tokens = rearrange(xt, "b c f h w -> b (f h w) c").contiguous() + + # ---- 窗口锚定的 RoPE ---- + if offset_win is None: + off_win_tok = None + else: + assert offset_win.shape == (b, n_cached + 1, 2), ( + f"offset_win 形状应为 [b={b}, n_cached+1={n_cached + 1}, 2],得到 {tuple(offset_win.shape)}" + ) + assert bool(torch.all(offset_win[:, 0] == 0)), ( + "offset_win[:, 0] 必须是 0:世界坐标要锚在窗口里最老那个 cell 上" + "(off_win = offset_px[a:k+1] - offset_px[a])" + ) + off_win_tok = offset_win.to(torch.float64) / PX_PER_TOKEN + if angle_win is None: + ang_win = None + else: + assert off_win_tok is not None, "给了 angle_win 就必须给 offset_win(坐标要一起进当前相机系)" + ang_win = angle_win.to(device=tokens.device, dtype=torch.float64) + assert ang_win.shape == (b, n_cached + 1), ( + f"angle_win 形状应为 [b={b}, n_cached+1={n_cached + 1}],得到 {tuple(ang_win.shape)}" + ) + assert bool(torch.all(ang_win[:, -1] == 0)), ( + "angle_win[:, -1] 必须是 0:一切都表达在**当前 cell 的相机系**里," + "当前帧自己的格点必须保持轴对齐(模型唯一见过的帧内结构)" + ) + cur_off = None if off_win_tok is None else off_win_tok[:, n_cached:n_cached + 1] + cur_ang = None if ang_win is None else ang_win[:, n_cached:n_cached + 1] + freqs_cur = build_world_freqs(dit, 1, h, w, cur_off, device=tokens.device, f_start=tpos, + angle=cur_ang) + + freqs_hist = None + if n_cached > 0: + n_sink = min(kv_cache["sink_size"], n_cached) + R = n_cached - n_sink + parts = [] + if n_sink > 0: + # sink 段永久钉在时间位 0..n_sink-1(sink_size=0 时这一段不存在) + off_s = None if off_win_tok is None else off_win_tok[:, :n_sink] + ang_s = None if ang_win is None else ang_win[:, :n_sink] + parts.append(build_world_freqs(dit, n_sink, h, w, off_s, device=tokens.device, f_start=0, + angle=ang_s)) + if R > 0: + off_r = None if off_win_tok is None else off_win_tok[:, n_sink:n_cached] + ang_r = None if ang_win is None else ang_win[:, n_sink:n_cached] + parts.append(build_world_freqs(dit, R, h, w, off_r, device=tokens.device, f_start=tpos - R, + angle=ang_r)) + freqs_hist = parts[0] if len(parts) == 1 else torch.cat(parts, dim=_freqs_cat_dim(parts[0])) + + kv_cache["hw"] = hw + kv_cache["commit"] = bool(commit) + kv_cache["freqs_cur"] = freqs_cur + kv_cache["freqs_hist"] = freqs_hist + + # 直接调 block,**绝不** gradient_checkpoint_forward(risk 6:滑窗 commit 是破坏性的, + # 重算时读到的是驱逐之后的缓存,缓存满了以后形状对内容错、不报错) + for li, block in enumerate(dit.blocks): + kv_cache["layer"] = li + tokens = block(tokens, ctx, t_mod, freqs_cur, f=1, attn_mask=None, kv=kv_cache) + + tokens = dit.head(tokens, t) + if commit: + kv_cache["frames_cached"] = frame_index + 1 + return dit.unpatchify(tokens, (1, h, w)) + + +# 模块级别名(与 AropeDiT.release_kv_cache 一样是静态的;stage4 OPSD 直接 import 它们) +snapshot_kv_cache = AropeDiT.snapshot_kv_cache +last_kv_frame = AropeDiT.last_kv_frame +append_kv_frame = AropeDiT.append_kv_frame diff --git a/backup_2026-09-14/code/distill/common.sh b/backup_2026-09-14/code/distill/common.sh new file mode 100644 index 0000000000000000000000000000000000000000..e202344eaf50108ff0fda919e99d7f356686957c --- /dev/null +++ b/backup_2026-09-14/code/distill/common.sh @@ -0,0 +1,89 @@ +#!/usr/bin/env bash +# 三阶段蒸馏所有 launcher 的公共前置:source 它,不要执行它。 +# source "$(dirname "${BASH_SOURCE[0]}")/../common.sh" # 从 distill/stageN_*/run.sh 里 +# 干四件事: +# 1) 从自身位置推 ROOT(不写死路径 —— 脚本随仓库搬走也不会指向别人的盘) +# 2) 统一环境变量(PYTHONPATH / DIFFSYNTH_SKIP_DOWNLOAD / 分配器 / NCCL / OMP),并 unset WorldMind 的三个 env hook +# 3) 钉死 CUDA_VISIBLE_DEVICES=0,1,2,3 —— 4-7 卡是别人的,1-3 是正式训练预留,任何情况下都不碰 +# 4) GPU 占用守卫:0-3 里任意一张 >500 MiB 就拒绝启动 +set -euo pipefail + +# ---- 1) ROOT:由本文件所在目录(/distill)上溯一级得到 ---- +ROOT="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +export ROOT +PY="$ROOT/.venv/bin/python" +ACC="$ROOT/.venv/bin/accelerate" +export PY ACC +[ -x "$PY" ] || { echo "ABORT: 找不到 $PY"; exit 1; } +[ -x "$ACC" ] || { echo "ABORT: 找不到 $ACC"; exit 1; } + +# ---- 2) 环境 ---- +export PYTHONPATH="$ROOT${PYTHONPATH:+:$PYTHONPATH}" +export DIFFSYNTH_SKIP_DOWNLOAD=True +export PYTORCH_CUDA_ALLOC_CONF="${PYTORCH_CUDA_ALLOC_CONF:-expandable_segments:True}" +export NCCL_P2P_LEVEL="${NCCL_P2P_LEVEL:-NVL}" # 0-3 在同一张 NV18 NVLink mesh 上 +export OMP_NUM_THREADS="${OMP_NUM_THREADS:-16}" # 本机 160 逻辑核;不限线程会让 4 个 rank 互相抖动 +export TOKENIZERS_PARALLELISM=false +unset GM_XCACHE GM_COMPILE GM_SAGEATTN || true # WorldMind 的 env hook:XCACHE 切断 autograd、COMPILE 会挂、SAGE 更慢 + +# ---- 3) 卡的隔离:只用 0,1,2,3,且不接受外部覆盖 ---- +# CUDA 默认按 FASTEST_FIRST 枚举,理论上可以与 nvidia-smi 的 PCI 顺序不同;钉成 PCI_BUS_ID 之后 +# CUDA_VISIBLE_DEVICES=0,1,2,3 与守卫里的 `nvidia-smi -i 0,1,2,3` 一定指同样这四张物理卡。 +export CUDA_DEVICE_ORDER=PCI_BUS_ID +# DISTILL_NGPU:用前几张卡。**默认仍是 4** —— 这是共用机器,4-7 默认留给别人。 +# 要用 8 必须显式 DISTILL_NGPU=8,而且先跟人确认:守卫只能看出「现在有没有人在用」, +# 看不出「别人正打算用」。 +DISTILL_NGPU="${DISTILL_NGPU:-4}" +case "$DISTILL_NGPU" in + 1|2|4|8) : ;; + *) echo "ABORT: DISTILL_NGPU 只接受 1/2/4/8,得到 $DISTILL_NGPU" >&2; return 1 2>/dev/null || exit 1 ;; +esac +DISTILL_GPUS="$(seq -s, 0 $((DISTILL_NGPU - 1)))" +DISTILL_NPROC="$DISTILL_NGPU" +export CUDA_VISIBLE_DEVICES="$DISTILL_GPUS" +export DISTILL_GPUS DISTILL_NPROC DISTILL_NGPU + +# ---- 4) GPU 占用守卫 ---- +# 注意:`nvidia-smi -i` 用的是物理编号,不受 CUDA_VISIBLE_DEVICES 影响,所以这里明确只查 0-3。 +# 上游 WorldMind 的写法(launch/stage3_cd15k.sh:25-28)不带 -i、查全部 8 张、阈值 20000 MiB —— 别人用 4-7 时它会误报中止, +# 正好和我们要的隔离相反;且没有 FORCE=1 偷卡的后门。 +require_idle_gpus() { + local thresh="${1:-500}" out rc busy seen want + command -v nvidia-smi >/dev/null 2>&1 || { echo "ABORT: 没有 nvidia-smi" >&2; return 1; } + # ★ 必须显式收 nvidia-smi 的退出码,不能写成 busy="$(nvidia-smi ... | awk ...)"。 + # 本函数是以 `require_idle_gpus ... || exit 1` 调用的,bash 在 `||` 左侧会**关掉 errexit**(连函数体一起), + # 所以命令替换失败不会中止脚本,只会让 busy 变成空串 —— 守卫就会打印"空闲"然后照样去抢卡。 + # 驱动半死 / GPU 掉总线 / -i 编号非法 都会走到这条路上,宁可不跑也不能查不到就放行。 + out="$(timeout 30 nvidia-smi -i "$DISTILL_GPUS" --query-gpu=index,memory.used --format=csv,noheader,nounits 2>&1)" + rc=$? + if [ "$rc" -ne 0 ]; then + echo "ABORT: nvidia-smi -i $DISTILL_GPUS 查询失败(退出码 $rc):" >&2 + printf ' %s\n' "$out" >&2 + echo " 查不到占用就不许启动 —— 1-3 是正式训练预留、4-7 是别人的卡。" >&2 + return 1 + fi + # 必须恰好回来 0,1,2,3 这四行:驱动半死 / MIG 分区时 nvidia-smi 可能只吐一部分还 exit 0, + # 漏掉的那几张等于根本没查过。 + seen="$(printf '%s\n' "$out" | awk -F', *' 'NF>=2 {printf "%s,", $1}')" + want="$DISTILL_GPUS," + if [ "$seen" != "$want" ]; then + echo "ABORT: nvidia-smi 只回了 [${seen%,}],期望 [$DISTILL_GPUS];有卡查不到,不启动。" >&2 + return 1 + fi + # $2+0 强制数值比较;memory.used 不是纯数字([N/A] / [Unknown Error])也当成占用 + busy="$(printf '%s\n' "$out" | awk -F', *' -v t="$thresh" \ + '$2 !~ /^[0-9]+$/ || $2+0 > t+0 {printf "GPU%s=%sMiB ", $1, $2}')" + if [ -n "$busy" ]; then + echo "ABORT: GPU $DISTILL_GPUS 上有占用(>${thresh} MiB): $busy" >&2 + echo " 另一个蒸馏/训练任务还在跑?先停掉它。不要去动 GPU 4-7(别人的卡)。" >&2 + return 1 + fi + echo "[guard] GPU $DISTILL_GPUS 空闲(每张 <= ${thresh} MiB),可以启动。" + return 0 +} + +# 阈值只允许调**严**,不允许调松:GPU_BUSY_MIB=999999 曾经等于一个偷卡后门 —— +# 能让第二个 launcher 直接盖在正在跑的训练上(两个 job 抢同四张卡 = 双双 OOM 或龟速)。 +# 上面第 41 行说"没有偷卡的后门",这一行是让那句话成立的地方。 +GPU_BUSY_MIB_EFF=$(( ${GPU_BUSY_MIB:-500} < 500 ? ${GPU_BUSY_MIB:-500} : 500 )) +require_idle_gpus "$GPU_BUSY_MIB_EFF" || exit 1 diff --git a/backup_2026-09-14/code/distill/configs/accelerate_fsdp_dmd_4gpu.yaml b/backup_2026-09-14/code/distill/configs/accelerate_fsdp_dmd_4gpu.yaml new file mode 100644 index 0000000000000000000000000000000000000000..cdedd049ae08b795ee2dd0d737c27b0478a85b5f --- /dev/null +++ b/backup_2026-09-14/code/distill/configs/accelerate_fsdp_dmd_4gpu.yaml @@ -0,0 +1,47 @@ +# 蒸馏 stage3(self-forcing DMD)专用:4 卡(GPU 0,1,2,3) FSDP1 FULL_SHARD,bf16。 +# 派生自 _wm/WorldMind/distill/code/common/accelerate_fsdp_dmd.yaml(那份是 num_processes: 3,被 run.sh 的 +# --num_processes 覆盖;这里直接写死 4)。stage1/2 用 ZeRO-2,只有 stage3 有两个可训模型(student + critic), +# 而 accelerate 的 DeepSpeed 分支只保留传给 prepare 的最后一个 nn.Module(accelerator.py:2229-2236),故必须换 FSDP。 +# +# fsdp_version: 1 —— 显式选 FSDP1;accelerate 1.14 的 v1 分支读 fsdp_reshard_after_forward(utils/dataclasses.py:1848), +# fsdp_sharding_strategy 是已废弃的旧拼写(:1836)。FULL_SHARD ⇒ 参数/梯度/优化器状态全切 4 份。 +# fsdp_use_orig_params: true —— 【风险 5,致命】两处吃紧:优化器在 prepare 之前按 model.parameters() 建好且此后不再重映射, +# 若为 false,FSDP1 换上 FlatParameter,优化器 step 的是过期张量、永远收不到梯度 —— 模型静默地完全不学习,无报错; +# 同时 zip-EMA 也要求 Parameter 的身份/顺序/分片完全一致。启动时断言 +# accelerator.state.fsdp_plugin.use_orig_params 为真、开跑前 probe_student_grad 量一次梯度可达性; +# 并且(已实现,S3-GUARD-3)dmd_arope.py 在每个生成器步的 opt_g.step() 之前检查 gnorm_g: +# step > resume_step 后恰为 0.0 或 NaN 直接 SystemExit(inf 不拦,clip 已归零;step 0 的 dmd 梯度 +# 恰为 0 是配方性质、由 probe 覆盖、不拦)。 +# fsdp_sync_module_states: false + fsdp_cpu_ram_efficient_loading: false —— 每个 rank 自己确定性地读同一份 safetensors, +# 不需要 rank0 广播;开了 sync 会让 rank0 一次性实体化全部模型,prepare 阶段直接 OOM。 +# fsdp_state_dict_type: SHARDED_STATE_DICT —— 存 optimizer state 用分片;导权重走 accelerator.get_state_dict + safetensors。 +# fsdp_activation_checkpointing: false —— 梯度检查点在模型侧按路径开(student 只在并行路径上开、critic 必须开), +# 不交给 FSDP 全局包,否则 rollout 的单帧图也会被包进去。 +compute_environment: LOCAL_MACHINE +debug: false +distributed_type: FSDP +downcast_bf16: 'no' +enable_cpu_affinity: false +fsdp_config: + fsdp_version: 1 + fsdp_reshard_after_forward: FULL_SHARD + fsdp_auto_wrap_policy: TRANSFORMER_BASED_WRAP + fsdp_transformer_layer_cls_to_wrap: DiTBlock + fsdp_backward_prefetch: BACKWARD_PRE + fsdp_state_dict_type: SHARDED_STATE_DICT + fsdp_offload_params: false + fsdp_use_orig_params: true + fsdp_sync_module_states: false + fsdp_cpu_ram_efficient_loading: false + fsdp_activation_checkpointing: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 4 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/code/distill/configs/accelerate_fsdp_dmd_8gpu.yaml b/backup_2026-09-14/code/distill/configs/accelerate_fsdp_dmd_8gpu.yaml new file mode 100644 index 0000000000000000000000000000000000000000..8dbc784cc08a783cb00c68401f97e5ce05d98ab2 --- /dev/null +++ b/backup_2026-09-14/code/distill/configs/accelerate_fsdp_dmd_8gpu.yaml @@ -0,0 +1,49 @@ +# 8 卡版:由 accelerate_fsdp_dmd_4gpu.yaml 只改 num_processes 4 -> 8 得到。 +# ⚠️ 共用机器,4-7 默认不归我们;用它前先确认没人要用(common.sh 需要 DISTILL_NGPU=8)。 +# 蒸馏 stage3(on-policy DMD)专用:8 卡 FSDP1 FULL_SHARD,bf16。 +# 派生自 _wm/WorldMind/distill/code/common/accelerate_fsdp_dmd.yaml(那份是 num_processes: 3,被 run.sh 的 +# --num_processes 覆盖;这里直接写死 4)。stage1/2 用 ZeRO-2,只有 stage3 有两个可训模型(student + critic), +# 而 accelerate 的 DeepSpeed 分支只保留传给 prepare 的最后一个 nn.Module(accelerator.py:2229-2236),故必须换 FSDP。 +# +# fsdp_version: 1 —— 显式选 FSDP1;accelerate 1.14 的 v1 分支读 fsdp_reshard_after_forward(utils/dataclasses.py:1848), +# fsdp_sharding_strategy 是已废弃的旧拼写(:1836)。FULL_SHARD ⇒ 参数/梯度/优化器状态全切 4 份。 +# fsdp_use_orig_params: true —— 【风险 5,致命】两处吃紧:优化器在 prepare 之前按 model.parameters() 建好且此后不再重映射, +# 若为 false,FSDP1 换上 FlatParameter,优化器 step 的是过期张量、永远收不到梯度 —— 模型静默地完全不学习,无报错; +# 同时 zip-EMA 也要求 Parameter 的身份/顺序/分片完全一致。启动时断言 +# accelerator.state.fsdp_plugin.use_orig_params 为真、开跑前 probe_student_grad 量一次梯度可达性; +# 并且(已实现,S3-GUARD-3)dmd_arope.py 在每个生成器步的 opt_g.step() 之前检查 gnorm_g: +# step > resume_step 后恰为 0.0 或 NaN 直接 SystemExit(inf 不拦,clip 已归零;step 0 的 dmd 梯度 +# 恰为 0 是配方性质、由 probe 覆盖、不拦)。 +# fsdp_sync_module_states: false + fsdp_cpu_ram_efficient_loading: false —— 每个 rank 自己确定性地读同一份 safetensors, +# 不需要 rank0 广播;开了 sync 会让 rank0 一次性实体化全部模型,prepare 阶段直接 OOM。 +# fsdp_state_dict_type: SHARDED_STATE_DICT —— 存 optimizer state 用分片;导权重走 accelerator.get_state_dict + safetensors。 +# fsdp_activation_checkpointing: false —— 梯度检查点在模型侧按路径开(student 只在并行路径上开、critic 必须开), +# 不交给 FSDP 全局包,否则 rollout 的单帧图也会被包进去。 +compute_environment: LOCAL_MACHINE +debug: false +distributed_type: FSDP +downcast_bf16: 'no' +enable_cpu_affinity: false +fsdp_config: + fsdp_version: 1 + fsdp_reshard_after_forward: FULL_SHARD + fsdp_auto_wrap_policy: TRANSFORMER_BASED_WRAP + fsdp_transformer_layer_cls_to_wrap: DiTBlock + fsdp_backward_prefetch: BACKWARD_PRE + fsdp_state_dict_type: SHARDED_STATE_DICT + fsdp_offload_params: false + fsdp_use_orig_params: true + fsdp_sync_module_states: false + fsdp_cpu_ram_efficient_loading: false + fsdp_activation_checkpointing: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 8 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/code/distill/configs/accelerate_zero2_4gpu_ga2.yaml b/backup_2026-09-14/code/distill/configs/accelerate_zero2_4gpu_ga2.yaml new file mode 100644 index 0000000000000000000000000000000000000000..0cdb213b1be522476e53369714b968abf5c11748 --- /dev/null +++ b/backup_2026-09-14/code/distill/configs/accelerate_zero2_4gpu_ga2.yaml @@ -0,0 +1,28 @@ +# 蒸馏 stage1/stage2 用:4 卡(GPU 0,1,2,3) DeepSpeed ZeRO-2,bf16,无 offload,梯度裁剪 1.0,梯度累积 2。 +# 派生自 configs/accelerate_zero2_4gpu.yaml,只改 gradient_accumulation_steps: 1 -> 2(等效 batch = 4 卡 × 1 × 2 = 8)。 +# train_micro_batch_size_per_gpu 由 accelerate 填 "auto" ⇒ 取训练脚本里 DataLoader 的 batch_size(默认 1)。 +# 训练脚本的 --grad_accum 必须等于这里的 2,否则 SystemExit(train.py:399 那条守卫要原样带进新 trainer)。 +# 不用 deepspeed_config_file:accelerate 1.14 里它与 mixed_precision 等键互斥,yaml 原生字段更省事。 +compute_environment: LOCAL_MACHINE +debug: false +deepspeed_config: + gradient_accumulation_steps: 2 + gradient_clipping: 1.0 + offload_optimizer_device: none + offload_param_device: none + zero3_init_flag: false + zero_stage: 2 +distributed_type: DEEPSPEED +downcast_bf16: 'no' +enable_cpu_affinity: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 4 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/code/distill/configs/accelerate_zero2_4gpu_ga4.yaml b/backup_2026-09-14/code/distill/configs/accelerate_zero2_4gpu_ga4.yaml new file mode 100644 index 0000000000000000000000000000000000000000..91931861d81031731296f405eba677430c4e74ea --- /dev/null +++ b/backup_2026-09-14/code/distill/configs/accelerate_zero2_4gpu_ga4.yaml @@ -0,0 +1,28 @@ +# 蒸馏 stage1/stage2 用:4 卡(GPU 0,1,2,3) DeepSpeed ZeRO-2,bf16,无 offload,梯度裁剪 1.0,梯度累积 4。 +# 派生自 configs/accelerate_zero2_4gpu.yaml,只改 gradient_accumulation_steps: 1 -> 4(等效 batch = 4 卡 × 1 × 4 = 16,stage1 的 eff-batch-16 备选)。 +# train_micro_batch_size_per_gpu 由 accelerate 填 "auto" ⇒ 取训练脚本里 DataLoader 的 batch_size(默认 1)。 +# 训练脚本的 --grad_accum 必须等于这里的 4,否则 SystemExit(train.py:399 那条守卫要原样带进新 trainer)。 +# 不用 deepspeed_config_file:accelerate 1.14 里它与 mixed_precision 等键互斥,yaml 原生字段更省事。 +compute_environment: LOCAL_MACHINE +debug: false +deepspeed_config: + gradient_accumulation_steps: 4 + gradient_clipping: 1.0 + offload_optimizer_device: none + offload_param_device: none + zero3_init_flag: false + zero_stage: 2 +distributed_type: DEEPSPEED +downcast_bf16: 'no' +enable_cpu_affinity: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 4 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/code/distill/configs/accelerate_zero2_8gpu_ga1.yaml b/backup_2026-09-14/code/distill/configs/accelerate_zero2_8gpu_ga1.yaml new file mode 100644 index 0000000000000000000000000000000000000000..3643e3428b622f7dae089955d202b66bdd8d7830 --- /dev/null +++ b/backup_2026-09-14/code/distill/configs/accelerate_zero2_8gpu_ga1.yaml @@ -0,0 +1,34 @@ +# 蒸馏 stage1/stage2 用:8 卡(GPU 0-7) DeepSpeed ZeRO-2,bf16,无 offload,梯度裁剪 1.0,梯度累积 1。 +# 派生自 accelerate_zero2_4gpu_ga2.yaml,只改两处:num_processes 4 -> 8、gradient_accumulation_steps 2 -> 1。 +# +# **等效 batch 仍然是 8**(8 卡 × micro 1 × GA 1 = 8),与 4 卡 GA2 完全相同 —— 换句话说这是同一个 +# 配方跑得快一倍,而不是另一个配方。想要等效 batch 16 得另建 ga2 的 8 卡版,别在这里改 GA。 +# +# ⚠️ 这台是共用机器。4-7 默认不归我们;用这份配置前先确认没人要用。 +# common.sh 需要 DISTILL_NGPU=8 才会放开 CUDA_VISIBLE_DEVICES 和守卫的检查范围。 +# +# train_micro_batch_size_per_gpu 由 accelerate 填 "auto" ⇒ 取训练脚本里 DataLoader 的 batch_size(默认 1)。 +# 训练脚本的 --grad_accum 必须等于这里的 1,否则 SystemExit。 +compute_environment: LOCAL_MACHINE +debug: false +deepspeed_config: + gradient_accumulation_steps: 1 + gradient_clipping: 1.0 + offload_optimizer_device: none + offload_param_device: none + zero3_init_flag: false + zero_stage: 2 +distributed_type: DEEPSPEED +downcast_bf16: 'no' +enable_cpu_affinity: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 8 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/code/distill/configs/accelerate_zero2_8gpu_ga2.yaml b/backup_2026-09-14/code/distill/configs/accelerate_zero2_8gpu_ga2.yaml new file mode 100644 index 0000000000000000000000000000000000000000..a020d367a364c5c12bde398d5a79c82b55e74938 --- /dev/null +++ b/backup_2026-09-14/code/distill/configs/accelerate_zero2_8gpu_ga2.yaml @@ -0,0 +1,36 @@ +# 长视野续训用(distill/stage1_long/run.sh 在 DISTILL_NGPU=8 时选它):8 卡(GPU 0-7) DeepSpeed ZeRO-2, +# bf16,无 offload,梯度裁剪 1.0,梯度累积 2。 +# 派生自 accelerate_zero2_8gpu_ga1.yaml,只改 gradient_accumulation_steps 1 -> 2(longhorizon/README 建议等效 batch 16)。 +# +# **等效 batch 是 16**(8 卡 × micro 1 × GA 2 = 16),与 4 卡 GA4(accelerate_zero2_4gpu_ga4.yaml)相同 —— +# 这是 stage1_long 的配方,**不是** stage1/stage2 的等效 batch 8:那两条在 8 卡下用 +# accelerate_zero2_8gpu_ga1.yaml(各自的 run.sh 按 DISTILL_NGPU 自动选,并断言 卡数×GA == 8)。 +# +# ⚠️ 这台是共用机器。4-7 默认不归我们;用这份配置前先确认没人要用。 +# common.sh 需要 DISTILL_NGPU=8 才会放开 CUDA_VISIBLE_DEVICES 和守卫的检查范围。 +# +# train_micro_batch_size_per_gpu 由 accelerate 填 "auto" ⇒ 取训练脚本里 DataLoader 的 batch_size(默认 1)。 +# 训练脚本的 --grad_accum 必须等于这里的 2,否则 SystemExit。 +compute_environment: LOCAL_MACHINE +debug: false +deepspeed_config: + gradient_accumulation_steps: 2 + gradient_clipping: 1.0 + offload_optimizer_device: none + offload_param_device: none + zero3_init_flag: false + zero_stage: 2 +distributed_type: DEEPSPEED +downcast_bf16: 'no' +enable_cpu_affinity: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 8 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/code/distill/data.py b/backup_2026-09-14/code/distill/data.py new file mode 100644 index 0000000000000000000000000000000000000000..217d35f1f6d8fb94a7939e952392872bbcfc220d --- /dev/null +++ b/backup_2026-09-14/code/distill/data.py @@ -0,0 +1,399 @@ +"""蒸馏用的 batch 工具:mask / 权重图 / 偏移与文本的延长和开窗。 + +数据集本身**一行不改**:`actionrope.dataset.AropeLatentDataset` + `arope_collate` 已经给齐 +了三个阶段需要的一切(`input_latents [b,48,21,30,52] bf16`、`context [b,21,512,4096] bf16`、 +`context_ids [b,21] i64`、`offset_px [b,21,2] f32`、`offset_tok`、`delta_tok`、`action_idx`、 +`clip_id`、`kind`)。本文件只做 batch 之上的纯函数,不碰 IO、不碰随机数据增强。 + +四类工具 +-------- +1. `to_device` —— 与 `actionrope/train.py:344` 同一份语义(张量搬走,字符串 list 原样)。 +2. `make_mask_input` / `make_weight_map` —— stage1/2 的 `mask_input` 与 loss 权重图。 + `mask_input` 直接用 `known_mask(offset_px / 16, 30, 52)`,**不能**写成 + `loss_weight_map(...).eq(1)`:那样一来模型的输入通道就被 loss 配方绑架了—— + `new_weight=1.0`(想关掉 new 区加权时的自然写法)会让权重图恒等于 1,掩码整幅变成 + "全 known",模型输入被悄悄改掉而不报错;`sigma`/`ramp_latent` 也各自能把这条等价关系 + 推到 float32 的舍入边缘(dist 模式下 `d == 0 ⟺ known` 只是巧合,紧贴边界的 + `1 + 5e-10` 在 float32 里就是 1.0)。掩码是**模型输入**,权重图是**loss 配方**, + 两件事必须各自从 offset 现算。 +3. `window_offsets` / `window_context` —— stage3 滑窗 KV 的**锚定切片**。绝对 cell k、 + 窗口最老保留 cell a 时,窗口内的世界坐标一律减去 `offset_px[a]`,于是整段窗口在 RoPE + 看来就是一条以自身 cell 0 为原点的 21-cell 训练 clip(RoPE 是相对编码,整体平移不变)。 + 两者索引口径完全一致:`[:, a:k+1]`。 +4. `extend_offsets` / `extend_context` —— rollout 超过 21 cell 时的延长。 + `--rollout_max 26` 意味着 cell 21..26 在数据里根本不存在:`parse_actions` 硬要求 21 个 + cell(`infer.py:127`),`AropeLatentDataset.__getitem__` 硬要求 21 条 prompt。两条流必须 + **同时**延长而且逐下标对齐,否则要么在 `context.shape[1] == 1+N` 的断言处崩,要么更糟: + 几何往前走、文本停在 cell 20,rollout 照跑、loss 照降,但训的是错的东西。 + + 两条流的延长策略**故意不同**,这不是笔误: + * 文本可以"保持"最后一条(`_wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:628-637` + 的 `last = context[:, Fl-1:Fl]; pad = last.expand(...)`)。ARoPE 臂的 prompt 经 + `prompts.strip_action` 剥掉了动作从句,只剩场景描述,而 rollout 不换场景,所以 + "保持最后一条" 在这里是**语义正确**的,不是凑合。 + * 偏移不能"保持"。偏移保持不动 = "玩家站住了",那是**另一个动作**,不是中性动作 + (V Rising 的 null action 陷阱,GraphGWM/README 记过一次)。所以偏移必须继续积分一个 + 速度:`continue`(沿用最后一段速度)或 `resample`(默认,每 5 个 cell 换一次方向, + 方向取 `geometry.ACTION_DIRS` 9 类、速度取 sidecar 实测的 `walk_speed_px_s`)。 + +速度 → 逐 cell 偏移的换算(不是拍脑袋的 v/4) +------------------------------------------ +Wan2.2 因果 VAE 的分组是 cell 0 = 帧 0、cell k = 帧 4k−3…4k(`geometry.cell_frames`), +逐 cell 偏移是 cell 内各帧偏移的**均值**(`geometry.frames_to_cells`),而逐帧偏移按 +`frame_off[i] = frame_off[i−1] + v[cell(i)] / FPS` 积分(`infer.py::parse_actions`)。 +把这两步合起来,逐 cell 增量是(v 单位 px/s,FPS=16): + + delta[1] = 2.5 · v[1] / FPS (cell 0 只有帧 0,起步项不同) + delta[k] = (1.5 · v[k−1] + 2.5 · v[k]) / FPS (k ≥ 2) + +匀速时退化成 4·v/FPS = v/4 px per cell(一个 cell = 4 帧 = 0.25 s)。换方向的那个 cell 上 +1.5/2.5 的加权才是真值,直接写 v/4 会在每个 chunk 边界差 1.5·|Δv|/16(最大 ~13 px ≈ 0.8 个 +latent 格)。`test_data.py::test_extend_matches_frame_integration` 用帧级积分逐位核对了这条。 +""" +from __future__ import annotations + +import math + +import numpy as np +import torch + +from actionrope.arope import known_mask, loss_weight_map +from actionrope.geometry import ACTION_DIRS, CELLS, FPS, LAT_H, LAT_W, PX_PER_LATENT + +# 一个 cell 覆盖 4 帧(cell 0 除外),见 geometry.cell_frames +CELL_FRAMES = 4 +# 帧级积分 + cell 内均值合出来的两个权重(推导见模块 docstring) +_W_PREV, _W_CUR = 1.5, 2.5 + +# sidecar 实测步速(data/latent/arope_sidecar.pt 的 meta["walk_speed_px_s"],已乘 |gain|)。 +# 横纵不同是透视造成的,不是噪声;`infer.py::parse_actions` 也是按轴分别乘这个数。 +# 只作为默认值:真跑的时候优先用 walk_speed_from_sidecar() 从当前 sidecar 现读。 +WALK_SPEED_PX_S = (69.24106392992304, 46.012630371093756) + +# rollout 延长的默认档位,与 stage3 的 --offset_chunk_cells 5 对齐 +DEFAULT_CHUNK_CELLS = 5 +DEFAULT_SPEED_MULT = (0.8, 1.2) + + +# -------------------------------------------------------------------------- +# batch 搬运 +# -------------------------------------------------------------------------- + +def to_device(batch: dict, device, non_blocking: bool = True) -> dict: + """张量搬到 device,其余(clip_id / kind 这种 list[str])原样带过去。 + + 与 `actionrope/train.py:344-345` 同一份实现,蒸馏侧不再各写一遍。 + """ + return { + k: (v.to(device, non_blocking=non_blocking) if isinstance(v, torch.Tensor) else v) + for k, v in batch.items() + } + + +# -------------------------------------------------------------------------- +# mask 通道 / loss 权重图 +# -------------------------------------------------------------------------- + +def make_mask_input(offset_px: torch.Tensor, lat_h: int = LAT_H, lat_w: int = LAT_W, + angle=None) -> torch.Tensor: + """known/new 掩码通道 → float32 [b, 1, f, lat_h, lat_w],喂给 `dit.arope_mask_embedding`。 + + offset_px [b, f, 2] px。除以 PX_PER_LATENT=16 换成 latent 格单位,与 + `actionrope/train.py:243-245` 逐位一致(known=1、new=0)。 + stage3 传的是**锚定后**的窗口偏移(见 window_offsets),于是 "known" 的含义变成 + "落在窗口最老那一 cell 的足迹内"——正是模型训练时见过的那种。 + """ + off = _as_bf2(offset_px, "offset_px") + if angle is not None and bool(torch.any(torch.as_tensor(angle) != 0)): + known = _known_rotated(off / PX_PER_LATENT, angle, lat_h, lat_w) + else: + known = known_mask(off / PX_PER_LATENT, lat_h, lat_w) # bool [b, f, h, w] + return known.to(torch.float32).unsqueeze(1) + + +def _known_rotated(off: torch.Tensor, angle, lat_h: int, lat_w: int) -> torch.Tensor: + """相机在锚点与当前 cell 之间转了 angle 弧度时的 known 掩码(angle = 锚点朝向 − 当前朝向)。 + + 当前格点 p 先按原口径加上偏移,再绕画幅中心转 −angle 回到**锚点相机系**,落在锚点足迹 + [−0.5, h−0.5] × [−0.5, w−0.5] 内 ⇒ known。angle=0 时逐位退化成 `known_mask`(旋转成恒等)。 + 旋转之后 known 区是一块**斜的**多边形 —— 训练里只出现过轴对齐的边界,这一条是已知的分布外。 + """ + from distill.arope_dit import rot2d + b, f = off.shape[:2] + dev, dt = off.device, torch.float64 + ang = torch.as_tensor(angle, device=dev, dtype=dt).view(b, f, 1, 1) + gi = torch.arange(lat_h, device=dev, dtype=dt).view(1, 1, lat_h, 1).expand(b, f, lat_h, lat_w) + gj = torch.arange(lat_w, device=dev, dtype=dt).view(1, 1, 1, lat_w).expand(b, f, lat_h, lat_w) + ctr_h, ctr_w = (lat_h - 1) / 2.0, (lat_w - 1) / 2.0 + o = off.to(dt).view(b, f, 1, 1, 2) + p = torch.stack([gj + o[..., 0] - ctr_w, gi + o[..., 1] - ctr_h], dim=-1) + q = rot2d(p, -ang) + wj, wi = q[..., 0] + ctr_w, q[..., 1] + ctr_h + return (wi >= -0.5) & (wi <= lat_h - 0.5) & (wj >= -0.5) & (wj <= lat_w - 0.5) + + +def make_weight_map(offset_px: torch.Tensor, lat_h: int = LAT_H, lat_w: int = LAT_W, + new_weight: float = 2.0, ramp_latent: float = 0.0, sigma=None) -> torch.Tensor: + """loss 权重图 → float32 [b, 1, f, lat_h, lat_w](known=1,new=new_weight)。 + + 直接转手 `actionrope.arope.loss_weight_map`,把 10k 检查点训练时用的 new 区 ×2 权重 + 原样带进 stage1。stage2 的 CD loss **故意不用**这张图(见 PORT_SPEC)。 + """ + off = _as_bf2(offset_px, "offset_px") + return loss_weight_map(off, lat_h, lat_w, new_weight=new_weight, + ramp_latent=ramp_latent, sigma=sigma) + + +# -------------------------------------------------------------------------- +# 滑窗锚定 +# -------------------------------------------------------------------------- + +def window_offsets(offset_px: torch.Tensor, a: int, k: int) -> torch.Tensor: + """窗口 [a, k] 的锚定偏移 → [b, k−a+1, 2],第 0 项恒为 0。 + + a = max(0, k − kv_window) 是窗口里最老的保留 cell。RoPE 是相对编码,整窗同时平移 + (t, offset) 不改变任何注意力分数,所以 RoPE 重锚定是精确的(`tests/test_world_rope_window.py` a1/a3), + 当前查询 cell 的 known 掩码也精确(d1)。但**缓存里各 cell 的 known 掩码通道是按它们各自提交时的锚点 + a_j = max(0, j−20) < a 固化的**,所以 k>20 的历史与一条锚在 k−20 的训练 clip 并不逐位相同 —— + 这是 stage2→stage3 的输入分布移位,靠 self-forcing 训练穿过(审计 GEO-2)。 + """ + off = _as_bf2(offset_px, "offset_px") + f = off.shape[1] + if not 0 <= a <= k < f: + raise ValueError(f"窗口下标越界: a={a}, k={k}, f={f}") + return off[:, a:k + 1] - off[:, a:a + 1] + + +def window_context(context: torch.Tensor, context_ids: torch.Tensor, a: int, k: int): + """`window_offsets` 的文本孪生:同一段 [a, k] 的 context / context_ids。 + + 单独写出来只有一个理由——把 "偏移窗口" 和 "文本窗口" 的下标口径钉在同一个函数里, + stage3 的 scored tail 才不会两边差一格。 + """ + ctx, ids = _check_context(context, context_ids) + f = ctx.shape[1] + if not 0 <= a <= k < f: + raise ValueError(f"窗口下标越界: a={a}, k={k}, f={f}") + return ctx[:, a:k + 1], ids[:, a:k + 1] + + +# -------------------------------------------------------------------------- +# rollout 延长:偏移 +# -------------------------------------------------------------------------- + +def walk_speed_from_sidecar(sidecar) -> tuple[float, float]: + """从 sidecar(路径或已加载的 dict)取实测步速 (px/s)。默认常量只是它的冻结副本。""" + from actionrope.dataset import load_sidecar + + meta = load_sidecar(sidecar)["meta"] + ws = meta["walk_speed_px_s"] + if len(ws) != 2: + raise ValueError(f"sidecar meta 的 walk_speed_px_s 应为 2 个数,得到 {ws!r}") + return float(ws[0]), float(ws[1]) + + +def append_cell_velocity(offset_px: torch.Tensor, vel: torch.Tensor) -> torch.Tensor: + """把逐 cell 速度 vel [b, m, 2](px/s)接到 offset_px [b, F0, 2] 后面 → [b, F0+m, 2]。 + + 用模块 docstring 的 (1.5·v_prev + 2.5·v_cur)/FPS 增量积分,即帧级积分 + cell 内均值的 + 闭式解。第一个新 cell 需要"上一 cell 的速度",而数据只给了偏移,所以从最后一段已知增量 + 反推匀速等效值 v_prev(匀速时精确;变速时那一格的误差 ≤ 1.5·|Δv|/16)。 + """ + off = _as_bf2(offset_px, "offset_px") + if vel.dim() != 3 or vel.shape[0] != off.shape[0] or vel.shape[2] != 2: + raise ValueError(f"vel 形状应为 [{off.shape[0]}, m, 2],得到 {tuple(vel.shape)}") + b, f0 = off.shape[:2] + if f0 < 1: + raise ValueError("offset_px 至少要有 cell 0(形状 [b, ≥1, 2])") + m = vel.shape[1] + if m == 0: + return off.clone() + vel = vel.to(device=off.device, dtype=off.dtype) + + v_prev = _implied_last_velocity(off) # [b, 2] px/s + out = [off] + cur = off[:, -1] # [b, 2] 最后一个已知 cell 的累计偏移 + k = f0 # 即将写入的绝对 cell 下标 + for j in range(m): + v = vel[:, j] + if k == 0: + raise ValueError("cell 0 的偏移恒为 0,不能由速度生成") + if k == 1: + # cell 0 只有帧 0,起步项只有 2.5 那一半 + delta = (_W_CUR * v) / FPS + else: + delta = (_W_PREV * v_prev + _W_CUR * v) / FPS + cur = cur + delta + out.append(cur.unsqueeze(1)) + v_prev = v + k += 1 + return torch.cat(out, dim=1) + + +def extend_offsets(offset_px: torch.Tensor, N: int, mode: str = "resample", + chunk: int = DEFAULT_CHUNK_CELLS, rng: torch.Generator | None = None, + walk_speed=None, speed_mult: tuple[float, float] = DEFAULT_SPEED_MULT, + include_idle: bool = True) -> torch.Tensor: + """把 [b, F0, 2] 的逐 cell 偏移延长/裁剪到 rollout 需要的 [b, N+1, 2]。 + + N = rollout 生成的 cell 数(不含 cell 0),所以长度是 1+N,与 + `dmd_gm.py:628-637` 的 `prompts.shape[1] == 1 + N` 口径一致。 + 1+N ≤ F0 时就是切片(原样保留真值),不会引入任何合成运动。 + + mode: + * "resample"(默认)—— 每 `chunk` 个 cell 抽一次动作:方向取 `geometry.ACTION_DIRS` + 的 9 类之一(含 idle),速度按轴取 walk_speed × 倍率([0.8, 1.2] 均匀), + 与 `infer.py::parse_actions` 的 `ACTION_DIRS[i] * walk_speed * mult` 完全同构, + 对应 ReactiveGWM 的 `dmd_action_extend_mode: preset_chunks`。逐样本独立抽。 + * "continue" —— 沿用最后一段已知增量隐含的匀速(等价于把 delta_tok[-1] 一路重复)。 + + rng: CPU 上的 torch.Generator。抽样一律在 CPU 上做再搬到 offset_px.device, + 这样 4 张卡上的种子行为与设备无关;各 rank 抽到不同方向没关系(数据本来就不同), + **形状**由 rank-synced 的 N 决定,FSDP 的 all-gather 不会错位。 + """ + off = _as_bf2(offset_px, "offset_px") + b, f0 = off.shape[:2] + if N < 0: + raise ValueError(f"N 应 ≥ 0,得到 {N}") + want = N + 1 + if want <= f0: + return off[:, :want].contiguous() + m = want - f0 + + if mode == "continue": + v = _implied_last_velocity(off).unsqueeze(1).expand(b, m, 2) # [b, m, 2] + elif mode == "resample": + v = _sample_chunk_velocity(b, m, chunk=chunk, rng=rng, walk_speed=walk_speed, + speed_mult=speed_mult, include_idle=include_idle) + v = v.to(device=off.device, dtype=off.dtype) + else: + raise ValueError(f"未知 mode {mode!r},可选 'resample' | 'continue'") + ext = append_cell_velocity(off, v) + assert ext.shape == (b, want, 2), f"延长失败: {tuple(ext.shape)} != {(b, want, 2)}" + return ext + + +# -------------------------------------------------------------------------- +# rollout 延长:文本 +# -------------------------------------------------------------------------- + +def extend_context(context: torch.Tensor, context_ids: torch.Tensor, N: int, mode: str = "hold"): + """把 [b, F0, L, C] 的逐 cell 文本与 [b, F0] 的 id 延长/裁剪到 1+N 个 cell。 + + 返回 (context_ext [b, 1+N, L, C], ids_ext [b, 1+N]),与 `extend_offsets` 逐下标对齐。 + + mode="hold"(唯一实现):cell ≥ F0 一律复制**最后一条已写好的** cell 文本及其 id, + 照抄 `_wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:628-637`。ARoPE 臂的 prompt 已被 + `prompts.strip_action` 剥成"只剩场景",rollout 又不换场景,所以保持是语义正确的; + id 必须跟着一起保持,`arope_forward` 靠它去重 text_embedding,id 错了就会拿错一行文本。 + 转场语料(burn / hardcut)的 cell 20 已经是烧完之后的目标场景,保持它同样正确。 + + 注意:文本"保持"而偏移"继续走",两者策略不同是**有意的**(见模块 docstring), + 不是这里漏了一种模式。 + """ + ctx, ids = _check_context(context, context_ids) + b, f0 = ctx.shape[:2] + if N < 0: + raise ValueError(f"N 应 ≥ 0,得到 {N}") + if mode != "hold": + raise ValueError(f"未知 mode {mode!r}:文本只实现 'hold'(保持最后一条已写好的 cell 文本)") + want = N + 1 + if want <= f0: + return ctx[:, :want].contiguous(), ids[:, :want].contiguous() + pad_n = want - f0 + ctx_pad = ctx[:, f0 - 1:f0].expand(b, pad_n, *ctx.shape[2:]) + ids_pad = ids[:, f0 - 1:f0].expand(b, pad_n) + ctx_ext = torch.cat([ctx, ctx_pad], dim=1) + ids_ext = torch.cat([ids, ids_pad], dim=1) + assert ctx_ext.shape[1] == want and ids_ext.shape[1] == want, ( + f"文本延长失败: {ctx_ext.shape[1]}/{ids_ext.shape[1]} != {want}") + return ctx_ext, ids_ext + + +def assert_rollout_aligned(offset_ext: torch.Tensor, context_ext: torch.Tensor, + ids_ext: torch.Tensor, N: int, latent=None) -> None: + """rollout 前的对齐闸:三条(可选四条)流的 cell 数必须都是 1+N,且 batch 一致。 + + stage3 每次 rollout 之前、每次 teacher/critic forward 之前都调一下——这类错位 + 不会报错、只会让 loss 照降而训错东西,所以要用断言把它变响。 + """ + want = N + 1 + b = offset_ext.shape[0] + if offset_ext.shape != (b, want, 2): + raise AssertionError(f"offset 形状 {tuple(offset_ext.shape)} != {(b, want, 2)}") + if context_ext.shape[:2] != (b, want): + raise AssertionError(f"context 形状 {tuple(context_ext.shape)} 前两维 != {(b, want)}") + if tuple(ids_ext.shape) != (b, want): + raise AssertionError(f"context_ids 形状 {tuple(ids_ext.shape)} != {(b, want)}") + if latent is not None and (latent.shape[0] != b or latent.shape[2] != want): + raise AssertionError(f"latent 形状 {tuple(latent.shape)} 与 [b={b}, ·, f={want}, ·, ·] 不符") + + +# -------------------------------------------------------------------------- +# 内部 +# -------------------------------------------------------------------------- + +def _as_bf2(off: torch.Tensor, name: str) -> torch.Tensor: + if not isinstance(off, torch.Tensor): + raise TypeError(f"{name} 应为 Tensor,得到 {type(off)}") + if off.dim() != 3 or off.shape[-1] != 2: + raise ValueError(f"{name} 形状应为 [b, f, 2],得到 {tuple(off.shape)}") + return off + + +def _check_context(context: torch.Tensor, context_ids: torch.Tensor): + if context.dim() != 4: + raise ValueError(f"context 形状应为 [b, f, L, C],得到 {tuple(context.shape)}") + if context_ids.dim() != 2: + raise ValueError(f"context_ids 形状应为 [b, f],得到 {tuple(context_ids.shape)}") + if context.shape[:2] != context_ids.shape: + raise ValueError(f"context {tuple(context.shape)[:2]} 与 context_ids " + f"{tuple(context_ids.shape)} 的 (b, f) 不一致") + return context, context_ids + + +def _implied_last_velocity(off: torch.Tensor) -> torch.Tensor: + """从最后一段已知增量反推匀速等效速度 [b, 2](px/s)。 + + 匀速时 delta[k] = 4·v/FPS(k ≥ 2),delta[1] = 2.5·v/FPS;F0 = 1(只有 cell 0)时 + 没有任何增量可用,只能取 0(此时 'continue' 退化成"站住不动",调用方应当用 'resample')。 + """ + b, f0 = off.shape[:2] + if f0 < 2: + return off.new_zeros(b, 2) + delta = off[:, -1] - off[:, -2] + w = _W_CUR if f0 == 2 else (_W_PREV + _W_CUR) # 2.5(cell 1) / 4.0(cell ≥ 2) + return delta * (FPS / w) + + +def _sample_chunk_velocity(b: int, m: int, chunk: int, rng: torch.Generator | None, + walk_speed, speed_mult: tuple[float, float], + include_idle: bool) -> torch.Tensor: + """逐样本、每 chunk 个 cell 抽一次动作 → 逐 cell 速度 [b, m, 2](px/s,float32 CPU)。""" + if chunk < 1: + raise ValueError(f"chunk 应 ≥ 1,得到 {chunk}") + if rng is not None and rng.device.type != "cpu": + raise ValueError("rng 必须是 CPU 上的 torch.Generator(抽样固定在 CPU 做,保证跨设备一致)") + lo, hi = float(speed_mult[0]), float(speed_mult[1]) + if not 0.0 <= lo <= hi: + raise ValueError(f"speed_mult 应为 0 ≤ lo ≤ hi,得到 {speed_mult!r}") + ws = WALK_SPEED_PX_S if walk_speed is None else walk_speed + ws = torch.tensor([float(ws[0]), float(ws[1])], dtype=torch.float32) + dirs = torch.from_numpy(np.asarray(ACTION_DIRS, dtype=np.float32)) # [9, 2] 单位方向,0 = idle + n_dir = dirs.shape[0] + lo_idx = 0 if include_idle else 1 + + n_chunk = math.ceil(m / chunk) + idx = torch.randint(lo_idx, n_dir, (b, n_chunk), generator=rng) # [b, n_chunk] + mult = torch.rand((b, n_chunk, 1), generator=rng) * (hi - lo) + lo # [b, n_chunk, 1] + v_chunk = dirs[idx] * ws.view(1, 1, 2) * mult # [b, n_chunk, 2] + # 每个 chunk 的速度铺满它覆盖的 cell(最后一个 chunk 可能不满,截断) + return v_chunk.repeat_interleave(chunk, dim=1)[:, :m].contiguous() + + +__all__ = [ + "ACTION_DIRS", "CELLS", "CELL_FRAMES", "DEFAULT_CHUNK_CELLS", "DEFAULT_SPEED_MULT", + "WALK_SPEED_PX_S", "append_cell_velocity", "assert_rollout_aligned", "extend_context", + "extend_offsets", "make_mask_input", "make_weight_map", "to_device", + "walk_speed_from_sidecar", "window_context", "window_offsets", +] diff --git a/backup_2026-09-14/code/distill/ema.py b/backup_2026-09-14/code/distill/ema.py new file mode 100644 index 0000000000000000000000000000000000000000..67919a4169b449cc2b61fe52c6b013314aa4a98c --- /dev/null +++ b/backup_2026-09-14/code/distill/ema.py @@ -0,0 +1,160 @@ +#!/usr/bin/env python3 +"""生成器 EMA:fp32 影子权重(stage2 CD 的目标网络 / stage2·stage3 的部署权重)。 + + from distill.ema import EmaShadow, ema_update + ema = EmaShadow(build_arope_dit(...), device="cuda") # 不进 accelerator.prepare + ... + ema.update(student, decay=(0.0 if step < args.ema_start else args.ema_decay)) + runlib.save_dit(accel, ema, runlib.ema_path(run_dir, step), {"step": step, "ema_decay": decay}) + +★ 影子必须是 fp32。bf16 只有 8 位尾数,相对精度 ~2^-8 ≈ 0.4%:decay=0.99 时 +`pe = 0.99*pe + 0.01*p`,那 1% 的增量落在 pe 尾数之下会被舍入直接吃掉 —— 影子权重在数值上 +纹丝不动,loss 却一切正常(CD 的 loss 本来就从 0 开始涨)。这不是精度损失,是目标网络失效。 +tests/test_runlib.py::test_bf16_shadow_drops_the_update 把这条钉成了断言。 +fp32 影子只是存储;前向照样在 autocast(bf16) 下跑,算力开销不变(多 20 GB 显存,见 PORT_SPEC 预算表)。 + +★ EmaShadow 故意**不是** nn.Module。accelerate 的 prepare 会 `for obj in result: if isinstance(obj, nn.Module): model = obj` +(accelerator.py:2229-2236)—— 最后一个 nn.Module 静默胜出,其余一个警告都没有就没被包装。 +影子不是 nn.Module 就绝不可能被误传进 prepare、被卷进优化器的参数表、或者混进上层模块的 state_dict。 +它照样能当模型调用(__call__ 转发给内部 module)。 + +stage3 的 EMA 是 FSDP 包装的 AropeDiT(要按分片 zip),不走 EmaShadow,直接用模块级的 +ema_update(ema, student, decay);两条路的数学完全一样。 +""" +from __future__ import annotations + +import copy + +import torch +import torch.nn as nn + + +def _bare(model: nn.Module) -> nn.Module: + """剥掉 DDP / DeepSpeedEngine / EmaShadow 的外壳。""" + seen = 0 + while hasattr(model, "module") and isinstance(getattr(model, "module"), nn.Module) and seen < 8: + model = model.module + seen += 1 + return model + + +@torch.no_grad() +def ema_update(ema: nn.Module, student, decay: float) -> None: + """逐参数 EMA:`pe = decay*pe + (1-decay)*p`,decay <= 0 ⇒ 硬拷贝。 + + zip 成立的前提:两边暴露的是**同一组、同一顺序、同一分片方式**的 Parameter。 + ZeRO-2 不分片参数,天然成立;FSDP 要 fsdp_use_orig_params=true(PORT_SPEC R5)。 + 这里额外核对个数与逐个形状,顺序错位在绝大多数情况下会当场炸出来,而不是静默训歪。 + student 可以是 DeepSpeedEngine / DDP —— nn.Module 外壳的 parameters() 顺序与内部一致。""" + pe_list = list(ema.parameters()) + ps_list = list(student.parameters()) + if len(pe_list) != len(ps_list): + raise RuntimeError(f"EMA 参数个数不匹配:影子 {len(pe_list)} vs 学生 {len(ps_list)}") + for i, (pe, p) in enumerate(zip(pe_list, ps_list)): + if pe.shape != p.shape: + raise RuntimeError(f"EMA 第 {i} 个参数形状不匹配:影子 {tuple(pe.shape)} vs 学生 {tuple(p.shape)}") + src = p.data + if src.device != pe.device: + src = src.to(pe.device, non_blocking=True) + if decay <= 0.0: + pe.data.copy_(src) # 硬拷贝(step < ema_start) + else: + # dtype 由 TensorIterator 就地提升:src 是 bf16 也不会额外分配一份 fp32 + pe.data.mul_(decay).add_(src, alpha=1.0 - decay) + + +class EmaShadow: + """fp32 影子权重。不是 nn.Module(见文件头),但能当模型直接调用。 + + EmaShadow(module) —— deepcopy 一份,源模型归调用方(多占一份显存/内存) + EmaShadow(module, own=True) —— 直接接管这个 module(stage2 已经单独建了第三个模型时用这个, + 不再多复制一份 5B 权重) + device="cpu" 可以把影子放在主存里(ReactiveGWM 的 *_ema_shadow_device: cpu), + update 会自动把学生的分片搬过来;但前向就得先 .to("cuda"),stage2 默认放卡上。 + """ + + def __init__(self, module: nn.Module, *, device=None, own: bool = False, dtype: torch.dtype = torch.float32): + if dtype != torch.float32: + raise ValueError("影子必须是 fp32:bf16 在 decay=0.99 下会把 1% 的增量整个舍掉(见文件头)") + src = _bare(module) + self.module = src if own else copy.deepcopy(src) + self.module.to(dtype=dtype) + if device is not None: + self.module.to(device=device) + self.module.requires_grad_(False).eval() + self.dtype = dtype + self._assert_fp32() + + # ---- 数值 ---- + def _assert_fp32(self) -> None: + bad = [n for n, p in self.module.named_parameters() if p.dtype is not torch.float32] + if bad: + raise RuntimeError(f"影子权重不是 fp32:{bad[:5]}…({len(bad)})") + + @torch.no_grad() + def update(self, student, decay: float) -> None: + """一个 optimizer step 调一次(不是每个 micro-batch)。decay <= 0 ⇒ 硬拷贝。""" + ema_update(self.module, student, decay) + + @torch.no_grad() + def hard_copy(self, student) -> None: + """影子 ← 学生。step < ema_start 期间每步都调,等价于 update(student, 0.0)。""" + ema_update(self.module, student, 0.0) + + # ---- 当模型用 ---- + def __call__(self, *args, **kwargs): + return self.module(*args, **kwargs) + + def forward(self, *args, **kwargs): + return self.module(*args, **kwargs) + + def parameters(self, recurse: bool = True): + return self.module.parameters(recurse=recurse) + + def named_parameters(self, *args, **kwargs): + return self.module.named_parameters(*args, **kwargs) + + def buffers(self, recurse: bool = True): + return self.module.buffers(recurse=recurse) + + def to(self, *args, **kwargs): + """只搬设备。dtype 不许动:.to(torch.bfloat16) 会当场毁掉目标网络。 + + 注意 dit.freqs 是普通的 tuple 属性(不是 buffer),Module.to 搬不动它 —— + 影子搬完设备后调用方要照 train.py:461 那样补一句 + `ema.module.dit.freqs = tuple(t.to(device) for t in ema.module.dit.freqs)`。""" + if any(isinstance(a, torch.dtype) for a in args) or kwargs.get("dtype") is not None: + raise RuntimeError("影子权重的 dtype 不许改(fp32),只搬设备") + self.module.to(*args, **kwargs) + return self + + def eval(self): + self.module.eval() + return self + + def train(self, mode: bool = True): + """影子永远是 eval —— 显式挡住 train(),免得被跟着学生一起 .train() 打开 dropout。""" + if mode: + raise RuntimeError("EMA 影子不训练,别对它调 train()") + return self.eval() + + # ---- 导出 ---- + def state_dict(self, *args, **kwargs): + """直接透传内部 module 的键集(不带 "module." 前缀), + 这样 runlib.save_dit(accel, ema, ...) 剥掉 `dit.` 之后得到的就是标准的 827 键。""" + return self.module.state_dict(*args, **kwargs) + + def load_state_dict(self, *args, **kwargs): + out = self.module.load_state_dict(*args, **kwargs) + self._assert_fp32() + return out + + def export_state_dict(self, dtype: torch.dtype = torch.bfloat16) -> dict: + """给不走 runlib.save_dit 的场合用:CPU + contiguous + 指定 dtype。""" + return {k: v.detach().to(device="cpu", dtype=dtype).contiguous() + for k, v in self.module.state_dict().items()} + + def __repr__(self): + n = sum(p.numel() for p in self.module.parameters()) + dev = next(self.module.parameters()).device if n else "?" + return f"EmaShadow({type(self.module).__name__}, {n:,} params, fp32, {dev})" diff --git a/backup_2026-09-14/code/distill/eval/anystep_probe.py b/backup_2026-09-14/code/distill/eval/anystep_probe.py new file mode 100644 index 0000000000000000000000000000000000000000..14f8d6cfc384e0f24dd0a00d44695ec18b8c3cb1 --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/anystep_probe.py @@ -0,0 +1,196 @@ +"""stage2-flowmap 的**必跑前置门**:单卡量一个真实 micro batch。 + +`distill/stage2_flowmap/config.json` 的 `_gate` 把这个探针列为 launch 前的必要条件。理由很直接: +`~75 GB/卡` 和 `~14 s/step` 到此为止都是**推算**,从没有任何代码在真实几何(f=21、16380 token、 +5B 权重、4 次前向 + 1 次反向)上量过。用一张卡量到,好过用 4 张(或 8 张)卡去撞 OOM。 + +三件事,都在 GPU 0 上、都不写权重: + + S-FM10 真权重恒等 —— 装上 flow map 之后,对 r ∈ {t, 0, 250, 1000} 与装之前逐位相同。 + 这是整条链的回归锚点:它一旦不成立,后面训的就不是 stage1b 那个教师了。 + S-FM11 一个真实 micro batch 的峰值显存与墙钟(走 **fm_loss 本体**,不是复刻一份)。 + S-FM12 中心差分的 bf16 噪声底 —— 实测 (u_p − u_m) 的信噪比。fidelity 评审记录过: + 探针在生产里被量化到 bf16,实际间隔是 8–12 而非名义的 10,分母却用字面 2·eps, + 于是 dF/dt 有平均 16.6 % 的系统性尺度误差。这个是**继承自上游、故意不改**的, + 但它到底有多大,得有个数。 + + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \ + .venv/bin/python distill/eval/anystep_probe.py + +单卡跑不出 4/8 卡的 ZeRO-2 分片行为(优化器状态是分片的),所以这里报的是**单进程上界**: +参数 + 梯度 + 激活 + Adam 全在一张卡上。多卡只会更省。反过来说,**单卡装不下不代表多卡装不下**, +所以 OOM 时脚本会把分片后的估算一并打出来,而不是直接判死刑。 +""" +from __future__ import annotations + +import argparse +import os +import sys +import time + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +os.environ.setdefault("PYTORCH_CUDA_ALLOC_CONF", "expandable_segments:True") + +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.dataset import AropeLatentDataset, arope_collate, load_sidecar # noqa: E402 +from distill import flowmap as fm # noqa: E402 +from distill import runlib # noqa: E402 +from distill.arope_dit import AropeDiT, unwrap # noqa: E402 +from distill.data import to_device # noqa: E402 +from distill.stage2_flowmap.fm_arope import _tf_probe, fm_loss # noqa: E402 + +GB = 1024 ** 3 + + +def _mem(dev) -> float: + return torch.cuda.max_memory_allocated(dev) / GB if dev.type == "cuda" else 0.0 + + +def main(): + ap = argparse.ArgumentParser(description=__doc__, formatter_class=argparse.RawDescriptionHelpFormatter) + ap.add_argument("--init_ckpt", default=f"{ROOT}/outputs/distill/stage1b_adapt/dits/dit_step3000.safetensors") + ap.add_argument("--train_dir", default=f"{ROOT}/data/latent/train_eybx") + ap.add_argument("--sidecar", default=f"{ROOT}/data/latent/arope_sidecar.pt") + ap.add_argument("--text_table", default=f"{ROOT}/data/latent/text_table_actionrope.pt") + ap.add_argument("--flowmap_form", default="residual", choices=["residual", "convex"]) + ap.add_argument("--delta_gate", type=float, default=1.0) + ap.add_argument("--flowmap_epsilon", type=float, default=5.0) + ap.add_argument("--cfg_scale", type=float, default=3.0, help="与 run.sh 默认一致:开着文本 fuse 才量得到真实前向数") + ap.add_argument("--iters", type=int, default=3, help="计时取后 iters-1 次(第 1 次含 cudnn/分配器预热)") + ap.add_argument("--device", default="cuda") + ap.add_argument("--skip_backward", action="store_true", help="只量前向(调试用;默认量 fwd+bwd)") + args = ap.parse_args() + + dev = torch.device(args.device) + log = print + + # ---------------- S-FM10 真权重恒等 ---------------- + log("=" * 70) + log("S-FM10 真权重恒等(装 flow map 前后,对任意 r 逐位相同)") + from safetensors.torch import load_file + model = AropeDiT(causal=True, mask_channel=True).to(dev).eval() + unwrap(model).dit.load_state_dict(load_file(args.init_ckpt), strict=True) + model = model.to(torch.bfloat16) + unwrap(model).move_rope_table(dev) + n_before = len(unwrap(model).dit.state_dict()) + + pre = _tf_probe(unwrap(model), 500.0, None) # 装之前的参照 + unwrap(model).install_flowmap(form=args.flowmap_form, gate=args.delta_gate) + unwrap(model).to(dev) + n_after = len(unwrap(model).dit.state_dict()) + + worst = 0.0 + for r in (500.0, 0.0, 250.0, 1000.0): + post = _tf_probe(unwrap(model), 500.0, r) + d = (post.float() - pre.float()).abs().max().item() + worst = max(worst, d) + log(f" t=500 r={r:7.1f} max|Δ| = {d:.3e}") + log(f" 键数 {n_before} → {n_after} 最大偏差 {worst:.3e}") + if args.flowmap_form == "residual" and worst != 0.0: + raise SystemExit(f"S-FM10 失败:residual 形式必须对任意 r 逐位相同,实测 {worst:.3e}。" + f"这说明 delta 分支的读出层没有真的零初始化 —— 别往下跑。") + log(" ✅ 通过" if worst == 0.0 else f" ⚠️ convex 形式 off-diagonal 有偏差(预期内)") + + # ---------------- 真实 micro batch ---------------- + log("=" * 70) + log("S-FM11 一个真实 micro batch 的显存与墙钟(走 fm_loss 本体)") + sc = load_sidecar(args.sidecar) + ds = AropeLatentDataset(args.train_dir, sc, args.text_table, text_mode="scene", + scene_dropout=0.0, limit=8, min_rt_ratio=0.8, verbose=False) + batch = to_device(arope_collate([ds[0]]), dev) + log(f" latent {tuple(batch['input_latents'].shape)} context {tuple(batch['context'].shape)}") + + uncond = None + if abs(args.cfg_scale - 1.0) >= 1e-6: + from actionrope.prompts import NULL_PROMPT + table = torch.load(args.text_table, map_location="cpu", weights_only=False) + row = table[NULL_PROMPT].to(torch.bfloat16) + uncond = row.view(1, 1, *row.shape).to(dev).expand(1, batch["context"].shape[1], -1, -1) + gains = {"text": args.cfg_scale - 1.0, "anchor": 0.0, "action": 0.0, "hist": 0.0, "ctx": 0.0} + + model.train() + for p in unwrap(model).parameters(): + p.requires_grad_(True) + + # 全局 batch 必须按真实值抽:G=1 时 round(0.5*1)=0,diffusion 槽为空,sample_tr 会(正确地)断言。 + # 真实跑法是 4 卡 GA2 或 8 卡 GA1,两者全局 batch 都是 8。这里用 world_size=8 复现, + # 并遍历 rank 覆盖三种角色 —— 三者代价不同:diffusion 槽(r==t)的中心差分不进 loss, + # 自由 (t,r) 槽最贵。报告取**最贵的那个**,因为 OOM 只需要发生一次。 + WORLD = 8 + gen = torch.Generator(device="cpu").manual_seed(0) + split_gen = fm.make_split_generator(0) + per_role: dict[int, list] = {} + ROLE_NAME = {fm.ROLE_DIFFUSION: "diffusion(r==t)", fm.ROLE_CONSISTENCY: "consistency(r=0)", + fm.ROLE_RANDOM: "random(t,r)"} + n_iter = max(args.iters, 1) + for i in range(n_iter * WORLD): + rank = i % WORLD + g_i = torch.Generator(device="cpu").manual_seed(1000 + i) + sg_i = fm.make_split_generator(i) + tr = fm.sample_tr(1, world_size=WORLD, rank=rank, gen=g_i, split_gen=sg_i, + diffusion_ratio=0.5, consistency_ratio=0.25, rotate=True, device=dev) + role = int(tr.role[0]) if hasattr(tr, "role") else fm.ROLE_RANDOM + torch.cuda.reset_peak_memory_stats(dev) + unwrap(model).zero_grad(set_to_none=True) + torch.cuda.synchronize(dev) + t0 = time.time() + loss_b, stats = fm_loss(model, batch, tr, gains=gains, + uncond=uncond, + uncond_ids=(None if uncond is None else torch.zeros_like(batch["context_ids"])), + epsilon=args.flowmap_epsilon, eps_clamp=True, + use_gradient_checkpointing=True) + loss = loss_b.mean() + if not args.skip_backward: + loss.backward() + torch.cuda.synchronize(dev) + dt, pk = time.time() - t0, _mem(dev) + per_role.setdefault(role, []).append((dt, pk, float(loss))) + if i < WORLD: # 第一轮是预热,只打印不计入 + log(f" 预热 rank{rank} {ROLE_NAME.get(role, role):18s} {dt:5.2f}s {pk:5.1f} GB") + + log(" —— 稳态(去掉第一轮预热)——") + t_micro, pk = 0.0, 0.0 + for role, rows in sorted(per_role.items()): + warm = rows[1:] or rows + tt = sum(r[0] for r in warm) / len(warm) + pp = max(r[1] for r in warm) + ll = sum(r[2] for r in warm) / len(warm) + log(f" {ROLE_NAME.get(role, role):18s} n={len(warm)} {tt:5.2f}s 峰值 {pp:5.1f} GB loss {ll:.4f}") + t_micro, pk = max(t_micro, tt), max(pk, pp) + log(f" 最贵角色: {t_micro:.2f}s / micro 峰值显存 {pk:.1f} GB(单进程,未分片)") + + # ---------------- 换算 ---------------- + log("=" * 70) + log("换算(micro → step;等效 batch 恒为 8)") + for ngpu, ga in ((4, 2), (8, 1)): + s_step = t_micro * ga + log(f" {ngpu} 卡 × GA{ga}: {s_step:5.2f} s/step 8000 步 ≈ {s_step * 8000 / 3600:5.1f} h") + log(" 注:显存是单进程上界。ZeRO-2 把 Adam 状态按卡分片,实际每卡应低于这个数;") + log(" 反过来,这里 OOM 也不代表多卡装不下。") + + # ---------------- S-FM12 bf16 噪声底 ---------------- + log("=" * 70) + log("S-FM12 中心差分的 bf16 噪声底") + log(" 已知问题(继承自上游、故意不改):探针时间步在生产里被量化到 bf16,") + log(" 实际间隔不是名义的 2·eps,分母却按 2·eps 除 ⇒ dF/dt 有系统性尺度误差。") + eps = args.flowmap_epsilon + for t_val in (100.0, 500.0, 900.0): + tt = torch.full((1,), t_val, device=dev) + tp = (tt + eps).to(torch.bfloat16).float() + tm = (tt - eps).to(torch.bfloat16).float() + real = float((tp - tm).item()) + log(f" t={t_val:6.1f} 名义间隔 {2 * eps:.1f} bf16 实际 {real:5.2f} " + f"尺度误差 {100 * (real - 2 * eps) / (2 * eps):+6.1f}%") + log(" (--eps_clamp 1 会按**实际**步长除,把这一项消掉;--eps_clamp 0 复现上游)") + + log("=" * 70) + log(f"探针通过。stage2-flowmap 可以起训。峰值 {pk:.1f} GB / micro {t_micro:.2f}s") + + +if __name__ == "__main__": + main() diff --git a/backup_2026-09-14/code/distill/eval/flowmap_liveness.py b/backup_2026-09-14/code/distill/eval/flowmap_liveness.py new file mode 100644 index 0000000000000000000000000000000000000000..eb9cec3313ca1232e6a913c32a172c269080bcc6 --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/flowmap_liveness.py @@ -0,0 +1,183 @@ +"""flow map 到底有没有在学 —— 「一晚上空跑」的直接排查。 + +零初始化的代价:装上 flow map 的那一刻,`delta_embedding` 的读出层全零,于是 +`u(x, t, r) ≡ u(x, t, t)` 对**任意** r 成立。这正是教师同一性门要的性质,但它也意味着 +**此刻模型对 r 完全没有依赖**。r 依赖必须靠训练长出来。 + +如果梯度进不去那条分支,训练不会报错、loss 照样下降(因为 50 % 的样本是 r==t 的 +diffusion 槽,那本来就是普通扩散 loss),最后得到的只是一个普通扩散模型 —— 花了一晚上 +8 张卡,any-step 这件事一步没学到。 + +这个脚本用**真权重、真 fm_loss**跑几步真优化,然后回答三个问题: + + L1 delta_embedding 的读出层还是不是全零?(是 ⇒ 梯度根本没进去,死的) + L2 梯度范数有没有真的落在 delta 分支上?(与主干比,量级对不对) + L3 几步之后 u(x,t,r) 对不同 r 是否已经**分开**?(分不开 ⇒ 学不到任何 r 依赖) + + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \ + .venv/bin/python distill/eval/flowmap_liveness.py --steps 12 + +也可以直接查一个已经存下来的 checkpoint(训练跑起来之后用这个,最省事、也最有说服力): + + ... .venv/bin/python distill/eval/flowmap_liveness.py \ + --ckpt outputs/distill/stage2_flowmap/ema/ema_step500.safetensors +""" +from __future__ import annotations + +import argparse +import os +import sys + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +os.environ.setdefault("PYTORCH_CUDA_ALLOC_CONF", "expandable_segments:True") + +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.dataset import AropeLatentDataset, arope_collate, load_sidecar # noqa: E402 +from distill import flowmap as fm # noqa: E402 +from distill.arope_dit import AropeDiT, unwrap # noqa: E402 +from distill.data import to_device # noqa: E402 +from distill.stage2_flowmap.fm_arope import _tf_probe, fm_loss # noqa: E402 + +DELTA_KEYS = ["delta_embedding.0.weight", "delta_embedding.0.bias", + "delta_embedding.2.weight", "delta_embedding.2.bias"] + + +def _delta_stats(dit) -> dict: + sd = dit.state_dict() + out = {} + for k in DELTA_KEYS: + if k in sd: + v = sd[k].float() + out[k] = (float(v.abs().max()), float(v.abs().mean())) + if "delta_gate" in sd: + out["delta_gate"] = (float(sd["delta_gate"].float().abs().max()), 0.0) + return out + + +def _r_spread(module, t_val: float = 500.0) -> float: + """同一个 (x, t) 下,不同 r 的输出最大分离度。0 ⇒ 模型对 r 毫无依赖。""" + base = _tf_probe(module, t_val, t_val) + worst = 0.0 + for r in (0.0, 250.0, 750.0, 1000.0): + d = (_tf_probe(module, t_val, r).float() - base.float()).abs().max().item() + worst = max(worst, d) + return worst + + +def main(): + ap = argparse.ArgumentParser(description=__doc__, formatter_class=argparse.RawDescriptionHelpFormatter) + ap.add_argument("--ckpt", default=None, help="直接查一个已存的 flow-map ckpt(832 键),不跑优化") + ap.add_argument("--init_ckpt", default=f"{ROOT}/outputs/distill/stage1b_adapt/dits/dit_step3000.safetensors") + ap.add_argument("--train_dir", default=f"{ROOT}/data/latent/train_eybx") + ap.add_argument("--sidecar", default=f"{ROOT}/data/latent/arope_sidecar.pt") + ap.add_argument("--text_table", default=f"{ROOT}/data/latent/text_table_actionrope.pt") + ap.add_argument("--steps", type=int, default=12) + ap.add_argument("--lr", type=float, default=1e-5) + ap.add_argument("--device", default="cuda") + args = ap.parse_args() + + dev = torch.device(args.device) + log = print + from safetensors.torch import load_file + + # ---------------- 只查 checkpoint ---------------- + if args.ckpt: + sd = load_file(args.ckpt) + log(f"checkpoint: {args.ckpt}") + log(f" 键数 {len(sd)}") + dead = True + for k in DELTA_KEYS + ["delta_gate"]: + if k not in sd: + log(f" ✗ 缺 {k} —— 这不是 flow-map checkpoint") + continue + v = sd[k].float() + mx, mn = float(v.abs().max()), float(v.abs().mean()) + log(f" {k:32s} |max| {mx:.3e} |mean| {mn:.3e}") + if k == "delta_embedding.2.weight": + dead = (mx == 0.0) + log("") + if dead: + log(" ❌ delta_embedding.2.weight 仍然全零 ⇒ r 分支是死的,训练没在学 any-step") + raise SystemExit(1) + log(" ✅ 读出层已非零 ⇒ 梯度确实进了 delta 分支,模型在学 r 依赖") + return + + # ---------------- 跑真优化 ---------------- + model = AropeDiT(causal=True, mask_channel=True).to(dev).eval() + unwrap(model).dit.load_state_dict(load_file(args.init_ckpt), strict=True) + model = model.to(torch.bfloat16) + unwrap(model).move_rope_table(dev) + unwrap(model).install_flowmap(form="residual", gate=1.0) + unwrap(model).to(dev) + bare = unwrap(model) + + log("=" * 72) + log("L1 装上之后(训练前)") + for k, (mx, mn) in _delta_stats(bare.dit).items(): + log(f" {k:32s} |max| {mx:.3e}") + spread0 = _r_spread(bare) + log(f" 不同 r 的输出分离度 = {spread0:.3e} (0 是**对的**:零初始化 ⇒ 此刻没有 r 依赖)") + + sc = load_sidecar(args.sidecar) + ds = AropeLatentDataset(args.train_dir, sc, args.text_table, text_mode="scene", + scene_dropout=0.0, limit=8, min_rt_ratio=0.8, verbose=False) + from actionrope.prompts import NULL_PROMPT + table = torch.load(args.text_table, map_location="cpu", weights_only=False) + row = table[NULL_PROMPT].to(torch.bfloat16) + + model.train() + for p in bare.parameters(): + p.requires_grad_(True) + opt = torch.optim.AdamW(bare.parameters(), lr=args.lr, betas=(0.9, 0.999), weight_decay=0.0) + + delta_names = [n for n, _ in bare.dit.named_parameters() if n.startswith("delta_embedding")] + log("=" * 72) + log(f"L2 跑 {args.steps} 步真 fm_loss(lr={args.lr}),看梯度落在哪") + split_gen = fm.make_split_generator(0) + for i in range(args.steps): + batch = to_device(arope_collate([ds[i % len(ds)]]), dev) + uncond = row.view(1, 1, *row.shape).to(dev).expand(1, batch["context"].shape[1], -1, -1) + g_i = torch.Generator(device="cpu").manual_seed(500 + i) + tr = fm.sample_tr(1, world_size=8, rank=i % 8, gen=g_i, split_gen=fm.make_split_generator(i), + diffusion_ratio=0.5, consistency_ratio=0.25, rotate=True, device=dev) + opt.zero_grad(set_to_none=True) + loss_b, stats = fm_loss(model, batch, tr, gains={"text": 2.0}, uncond=uncond, + uncond_ids=torch.zeros_like(batch["context_ids"]), + epsilon=5.0, eps_clamp=True, use_gradient_checkpointing=True) + loss_b.mean().backward() + gd = torch.sqrt(sum((p.grad.float() ** 2).sum() for n, p in bare.dit.named_parameters() + if n.startswith("delta_embedding") and p.grad is not None)) + ga = torch.sqrt(sum((p.grad.float() ** 2).sum() for p in bare.parameters() if p.grad is not None)) + role = ["diffusion", "consistency", "random"][int(tr.role[0])] + log(f" step {i + 1:2d} {role:12s} t={float(tr.t[0]):6.1f} r={float(tr.r[0]):6.1f} " + f"loss {float(loss_b.mean()):.4f} |g_delta| {float(gd):.3e} |g_all| {float(ga):.3e}") + opt.step() + + log("=" * 72) + log("L1' 训练之后") + dead = False + for k, (mx, mn) in _delta_stats(bare.dit).items(): + log(f" {k:32s} |max| {mx:.3e}") + if k == "delta_embedding.2.weight" and mx == 0.0: + dead = True + log("=" * 72) + log("L3 r 依赖有没有长出来") + spread1 = _r_spread(bare) + log(f" 训练前 {spread0:.3e} → 训练后 {spread1:.3e}") + + log("=" * 72) + if dead or spread1 <= spread0: + log("❌ 机制没通:delta 分支没动 / 不同 r 的输出仍然一样。") + log(" 继续跑下去只会得到一个普通扩散模型,any-step 一步没学到。停机排查。") + raise SystemExit(1) + log("✅ 机制通了:梯度进了 delta 分支,读出层已非零,不同 r 的输出已经分开。") + log(f" 注意 r 依赖是**从零长出来**的,前期分离度小是正常的(这几步就有 {spread1:.1e})。") + + +if __name__ == "__main__": + main() diff --git a/backup_2026-09-14/code/distill/eval/loop_spec.txt b/backup_2026-09-14/code/distill/eval/loop_spec.txt new file mode 100644 index 0000000000000000000000000000000000000000..32c0fe73575eea9810ad098c3f58436dc454372e --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/loop_spec.txt @@ -0,0 +1 @@ +idle:1.0:1,right:1.0:10,down:1.0:10,left:1.0:10,up:1.0:10 diff --git a/backup_2026-09-14/code/distill/eval/null_branch_probe.py b/backup_2026-09-14/code/distill/eval/null_branch_probe.py new file mode 100644 index 0000000000000000000000000000000000000000..ebe54bd3e1c4e696fdddfda8ece6b2209bc44832 --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/null_branch_probe.py @@ -0,0 +1,113 @@ +"""四条 null 分支到底训出来了没有 —— stage1b 适配微调的验收探针。 + +适配微调的**唯一目的**是把 text 之外的三条 null 分支变成分布内的合法输入。val 不掉只说明 +主目标没被破坏,说明不了 null 分支能不能用。这里直接量: + + 同一批 clip、同一份噪声、同一组噪声档,对每条分支各算一次 loss。 + + 微调前(stage1 的 ckpt) null 分支从没训过 ⇒ loss 应显著高、甚至爆掉 + 微调后(stage1b 的 ckpt) null 分支已训 ⇒ loss 明显下降,而 full 那条基本不动 + +`Δloss = loss(null) − loss(full)` 还有第二重意义:它就是"这条条件带来多少信息量"。 +Δ 越大说明该条件越重要 —— 于是能直接回答"该给哪条轴多大的 guidance 权重"。 + + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \ + .venv/bin/python distill/eval/null_branch_probe.py \ + --before outputs/distill/stage1_ar_tf/dits/dit_step10000.safetensors \ + --after outputs/distill/stage1b_adapt/dits/dit_step3000.safetensors +""" +from __future__ import annotations + +import argparse +import os +import sys + +import torch + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.dataset import AropeLatentDataset, arope_collate, load_sidecar # noqa: E402 +from distill.arope_dit import AropeDiT, unwrap # noqa: E402 +from distill.data import to_device # noqa: E402 +from distill.flow_pf import sample_pf_timestep_ids # noqa: E402 +from distill.stage1_ar.ar_tf import ar_tf_loss # noqa: E402 + +# 四条分支:名字 → 传给 ar_tf_loss 的 kwargs(p=1.0 ⇒ 强制命中) +BRANCHES = { + "full": {}, + "anchor": {"anchor_dropout": 1.0}, # ★ 摘掉 cell 0、历史保留 + "action": {"action_dropout": 1.0}, # offset ≡ 0 + "hist": {"hist_dropout": 1.0}, # 只剩 cell 0 + "ctx": {"ctx_dropout": 1.0}, # 什么都看不到 +} + + +@torch.no_grad() +def probe(ckpt: str, batches, seeds, device: str) -> dict[str, float]: + from safetensors.torch import load_file + m = AropeDiT(causal=True, mask_channel=True).to(device).eval() + unwrap(m).dit.load_state_dict(load_file(ckpt), strict=True) + m = m.to(torch.bfloat16) + unwrap(m).move_rope_table(device) + + out = {} + for name, kw in BRANCHES.items(): + tot = 0.0 + for batch, seed in zip(batches, seeds): + b = to_device(batch, device) + x0 = b["input_latents"] + g = torch.Generator(device="cpu").manual_seed(seed) + noise = torch.randn(x0.shape, generator=g).to(dtype=x0.dtype, device=device) + idx = sample_pf_timestep_ids(x0.shape[0], x0.shape[2], device, + torch.Generator(device="cpu").manual_seed(seed + 7)) + loss, _ = ar_tf_loss(m, b, noise=noise, idx_pf=idx, **kw) + tot += float(loss) + out[name] = tot / len(batches) + del m + torch.cuda.empty_cache() + return out + + +def main(): + ap = argparse.ArgumentParser(description=__doc__, formatter_class=argparse.RawDescriptionHelpFormatter) + ap.add_argument("--before", required=True, help="适配微调**前**的 ckpt") + ap.add_argument("--after", required=True, help="适配微调**后**的 ckpt") + ap.add_argument("--n", type=int, default=8, help="用多少条 val clip") + ap.add_argument("--val_dir", default=f"{ROOT}/data/latent/val_eybx") + ap.add_argument("--sidecar", default=f"{ROOT}/data/latent/arope_sidecar.pt") + ap.add_argument("--text_table", default=f"{ROOT}/data/latent/text_table_actionrope.pt") + ap.add_argument("--device", default="cuda") + args = ap.parse_args() + + sc = load_sidecar(args.sidecar) + ds = AropeLatentDataset(args.val_dir, sc, args.text_table, text_mode="scene", + scene_dropout=0.0, limit=args.n, verbose=False) + batches = [arope_collate([ds[i]]) for i in range(min(args.n, len(ds)))] + seeds = list(range(len(batches))) + print(f"用 {len(batches)} 条 val clip,固定噪声/噪声档,每条分支各算一次\n") + + res = {} + for tag, ck in (("before", args.before), ("after", args.after)): + res[tag] = probe(ck, batches, seeds, args.device) + print(f" {tag}: {os.path.basename(ck)} 已量完") + + print(f"\n{'分支':<8} {'微调前':>10} {'微调后':>10} {'变化':>10} {'Δ vs full(后)':>14}") + print("-" * 62) + full_after = res["after"]["full"] + for name in BRANCHES: + b, a = res["before"][name], res["after"][name] + d = a - full_after + note = "" if name == "full" else f"{d:+.4f}" + print(f"{name:<8} {b:10.4f} {a:10.4f} {a - b:+10.4f} {note:>14}") + + print("\n读法:") + print(" · full 那行「变化」应接近 0 —— 补 null 分支不该破坏主目标") + print(" · 其余三行「变化」应显著为负 —— 说明这些从没训过的输入现在训出来了") + print(" · 「Δ vs full」= 该条件的信息量,越大越重要,可直接用来定 guidance 权重的相对大小") + + +if __name__ == "__main__": + main() diff --git a/backup_2026-09-14/code/distill/eval/paired50.sh b/backup_2026-09-14/code/distill/eval/paired50.sh new file mode 100644 index 0000000000000000000000000000000000000000..d77813fd3ddfe1eb51b042d64da23c28afdd778a --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/paired50.sh @@ -0,0 +1,39 @@ +#!/usr/bin/env bash +# 50 张首帧的配对评测:同首帧、同动作脚本、同种子,只换权重。 +# +# bash distill/eval/paired50.sh [tagA] [tagB] [maxjobs] +# +# 为什么必须 50 张而不是 4 张:同一份权重在不同首帧上的净漂移散布是 9~36 px(sd≈11), +# 而各 stage3 变体之间的差异只有 1~3 px。n=4 时均值标准误 5.5 px —— 判据分辨不出效应, +# 实测四个 ‖Δ‖ 差几个量级的权重全部落在 22~26。n=50 时标准误降到 ~1.6 px,才谈得上比较。 +set -euo pipefail +ROOT="$(cd "$(dirname "${BASH_SOURCE[0]}")/../.." && pwd)" +A="${1:?ckptA}"; B="${2:?ckptB}"; TA="${3:-A}"; TB="${4:-B}"; MAXJOBS="${5:-6}" +SPEC_FILE="${SPEC_FILE:-$ROOT/distill/eval/loop_spec.txt}" # 41 cell 净零闭环(重建,见 sweep8.sh 文件头) +SPEC="$(cat "$SPEC_FILE")" +# stage3 学生必须按**训练几何**评(sink 0 / window 20 / cap 20 = rollout_eval.py 默认,GEO-1); +# sink 3 / w17 只作显式 A/B:SINK=3 KV_WINDOW=17 ROPE_CAP=20 bash distill/eval/paired50.sh ... +# 几何旗标只在环境变量显式给出时才追加;默认一个都不传 ⇒ rollout_eval.py 的默认 sink 0 / window 20 / +# cap 20 = stage3 训练几何。三者必须满足 rope_cap == sink + window(rollout_eval 会核)。 +GEO=() +if [ -n "${SINK:-}" ]; then GEO+=(--sink_size "$SINK"); fi +if [ -n "${KV_WINDOW:-}" ]; then GEO+=(--kv_window "$KV_WINDOW"); fi +if [ -n "${ROPE_CAP:-}" ]; then GEO+=(--rope_cap "$ROPE_CAP"); fi +OUT="$ROOT/outputs/distill/eval/paired"; mkdir -p "$OUT" +export PYTHONPATH="$ROOT" DIFFSYNTH_SKIP_DOWNLOAD=True CUDA_DEVICE_ORDER=PCI_BUS_ID +i=0 +for f in "$ROOT"/data/eval/eybx_bg_50/*.png; do + n="$(basename "$f" .png)" + for tc in "$TA:$A" "$TB:$B"; do + t="${tc%%:*}"; c="${tc#*:}" + [ -s "$OUT/${t}_${n}.log" ] && continue + CUDA_VISIBLE_DEVICES=$(( i % 8 )) nohup "$ROOT/.venv/bin/python" "$ROOT/distill/eval/rollout_eval.py" \ + --ckpt "$c" --mode rollout --cells 41 "${GEO[@]}" \ + --num_inference_steps 4 --actions "$SPEC" --allow_busy_gpu --seed 0 \ + --first_frame "$f" --tiled --no-save_video \ + --out "$OUT/${t}_${n}.mp4" > "$OUT/${t}_${n}.log" 2>&1 & + i=$(( i + 1 )); (( i % MAXJOBS == 0 )) && wait + done +done +wait +echo "[paired] 完成,结果在 $OUT" diff --git a/backup_2026-09-14/code/distill/eval/photodrift.sh b/backup_2026-09-14/code/distill/eval/photodrift.sh new file mode 100644 index 0000000000000000000000000000000000000000..b55e374caf626d6007d26ab283deca3755e555d0 --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/photodrift.sh @@ -0,0 +1,39 @@ +#!/usr/bin/env bash +# 一个 ckpt → 41-cell rollout → 逐 cell 的像素 std/mean 表。 +# +# stage3 的失败模式是**光度漂移**(正式 run 烧白 std 39→2.7 mean 60→171;冻 critic 过饱和 +# std 39→80),不是结构噪声,所以判据就是这两条曲线平不平。基线 stage2-7500 是 std 37~40、 +# mean 60.7→42.9。sift 能量出位移就更好,量不出(sift=None)本身就是「已经坏了」。 +# ⚠ 上面的基线数字是在旧几何(sink 3 / w17)+ 原始 loop spec 下量的;脚本现已默认训练几何(sink 0 / w20) +# + 重建的 loop_spec.txt,严格说不可比 —— stage2 跑完后用新默认重测 stage2 EMA 并更新这里(GEO-1)。 +# +# bash distill/eval/photodrift.sh [gpu] [steps] +set -euo pipefail +CK="$1"; TAG="$2"; GPU="${3:-0}"; N="${4:-4}" +ROOT="$(cd "$(dirname "${BASH_SOURCE[0]}")/../.." && pwd)" +SPEC_FILE="${SPEC_FILE:-$ROOT/distill/eval/loop_spec.txt}" # 41 cell 净零闭环(重建,见 sweep8.sh 文件头) +[ -f "$SPEC_FILE" ] || { echo "ABORT: 没有动作脚本 $SPEC_FILE"; exit 1; } +# stage3 学生必须按**训练几何**评(sink 0 / window 20 / cap 20 = rollout_eval.py 默认,GEO-1); +# sink 3 / w17 只作显式 A/B:SINK=3 KV_WINDOW=17 ROPE_CAP=20 bash distill/eval/photodrift.sh ... +# 几何旗标只在环境变量显式给出时才追加;默认一个都不传 ⇒ rollout_eval.py 的默认 sink 0 / window 20 / +# cap 20 = stage3 训练几何。三者必须满足 rope_cap == sink + window(rollout_eval 会核)。 +GEO=() +if [ -n "${SINK:-}" ]; then GEO+=(--sink_size "$SINK"); fi +if [ -n "${KV_WINDOW:-}" ]; then GEO+=(--kv_window "$KV_WINDOW"); fi +if [ -n "${ROPE_CAP:-}" ]; then GEO+=(--rope_cap "$ROPE_CAP"); fi +OUT="$ROOT/outputs/distill/eval/deploy"; mkdir -p "$OUT" +export PYTHONPATH="$ROOT" DIFFSYNTH_SKIP_DOWNLOAD=True CUDA_DEVICE_ORDER=PCI_BUS_ID +CUDA_VISIBLE_DEVICES=$GPU "$ROOT/.venv/bin/python" "$ROOT/distill/eval/rollout_eval.py" \ + --ckpt "$CK" --mode rollout --cells 41 "${GEO[@]}" \ + --num_inference_steps "$N" --actions "$(cat "$SPEC_FILE")" --allow_raw_student \ + --first_frame "$ROOT/data/eval/eybx_bg_50/19_medieval_castle.png" --tiled \ + --out "$OUT/$TAG.mp4" > "$OUT/$TAG.log" 2>&1 +grep -E "实测位移" "$OUT/$TAG.log" || true +"$ROOT/.venv/bin/python" - "$OUT/$TAG.mp4" "$TAG" <<'PY' +import sys, imageio.v3 as iio, numpy as np +g = iio.imread(sys.argv[1]).astype(np.float32).mean(-1) +idx = [0,4,8,20,40,80,120,160] +print(f"{sys.argv[2]:22s} 帧 " + " ".join(f"{i:>5d}" for i in idx)) +print(f"{' std':22s} " + " ".join(f"{g[i].std():5.1f}" for i in idx)) +print(f"{' mean':22s} " + " ".join(f"{g[i].mean():5.1f}" for i in idx)) +PY diff --git a/backup_2026-09-14/code/distill/eval/rollout_eval.py b/backup_2026-09-14/code/distill/eval/rollout_eval.py new file mode 100644 index 0000000000000000000000000000000000000000..00329e1cc70406d166bba644e937462acc269243 --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/rollout_eval.py @@ -0,0 +1,1105 @@ +#!/usr/bin/env python3 +"""蒸馏产物的部署路径评测:按 4 步部署表生成一条 clip,实测背景位移 vs 指令位移。 + + # stage3 学生:因果 AR rollout(滑窗 KV),就是它训练时那条路 + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + .venv/bin/python distill/eval/rollout_eval.py \\ + --ckpt outputs/distill/stage3_dmd/ema/ema_step400.safetensors \\ + --replay \\ + --out outputs/distill/stage3_dmd/eval/ema400_replay.mp4 + + # stage2 EMA 自己的部署路径:整片并行、2 步 + ... --mode parallel --denoise_list 1000,250 \\ + --first_frame --scene --actions "right:1.0:21" + + # 挑部署权重:一次扫完所有 ema(只加载一次 10 GB pipeline,之后只换 DiT 权重) + ... --sweep 'outputs/distill/stage3_dmd/ema/ema_step*.safetensors' --replay \\ + --out_dir outputs/distill/stage3_dmd/eval/sweep + + # 不碰真权重的自检(tiny 模型 + 合成条件,无 VAE) + ... --self_test + +为什么需要这个文件 +----------------- +蒸馏的两个 loss 都不是质量指标:CD 的 loss 从 0 开始涨,DMD 是 min-max 目标(单调下降反而是坏消息)。 +ActionRoPE 唯一有意义的判据是**动作服从性**:命令背景往右走 373 px,画面是不是真的往左挪了 373 px。 +这里把 `actionrope/infer.py` 的 SIFT+RANSAC 实测(measure_displacement)与动作脚本解析(parse_actions) +原样接过来,只把采样器换成蒸馏后的少步部署表 —— 于是「少步学生还听不听指令」这个问题有了数字答案。 +上游 WorldMind 判质量用的是亮度(brightness_eval.py),那是它的失败模式;这里的失败模式是动作漂移。 + +两条部署路径(`--mode`) +---------------------- +rollout(默认):滑窗 KV、逐 cell 自回归,**与 stage3 训练时的 self_forcing_rollout 逐行同构** + —— 条件(窗口锚定的 offset_win / mask_in_k)直接 import 训练侧的 frame_cond, + 提交趟同样是 detach 过的 x0 + t=0。差别只有一条:推理不抽退出档,每个 cell 把整张表走完。 + 它能超过 21 个 cell(这正是 stage3 要练的东西)。 +parallel:整片块因果、一次去噪全部 cell,cell 0 每步写回 —— stage2 EMA 自己的部署路径。 + +采样规则(两条路一致,也与训练一致) +-------------------------------- + den = noisy − sigma_i · v(noisy, t_i) # x0 估计 + noisy = (1 − sigma_{i+1})·den + sigma_{i+1}·ε # 重新加噪到下一档(**新**噪声) +最后一档直接取 den。这**不是** `infer.sample` 的 Euler 步(`x + (σ_next − σ)·v`)—— +那是 50 步扩散采样器;少步一致性/自强制学生训练时见到的就是上面这条 x0→重新加噪的链。 +`--ref_steps 50` 会额外跑一遍 `infer.sample`,给出同一条件下的 50 步参照(PORT_SPEC 的 S9)。 + +一个必须守住的坑 +--------------- +部署权重是 `ema/`,不是 `dits/`。`dits/` 与 `critic/` 只为续训存在;拿 `dits/` 上线不会报错, +只会静默降质。所以路径里带 `/dits/` 时本脚本直接拒跑,除非显式 `--allow_raw_student`(risk 12)。 +""" +from __future__ import annotations + +import argparse +import re +import glob +import json +import math +import os +import subprocess +import sys +import time + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +os.environ.setdefault("PYTORCH_CUDA_ALLOC_CONF", "expandable_segments:True") + +import numpy as np +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope import geometry as G # noqa: E402 +from actionrope import infer # noqa: E402 +from actionrope.prompts import NULL_PROMPT # noqa: E402 +from distill import flowmap as fm # noqa: E402 +from distill.arope_dit import AropeDiT, unwrap # noqa: E402 +from distill.data import extend_context, extend_offsets, make_mask_input, window_offsets # noqa: E402 +from distill.flow_pf import DEPLOY_DENOISE_LIST, deploy_schedule # noqa: E402 +from distill import runlib # noqa: E402 +from distill.arope_dit import rot2d # noqa: E402 +from distill.stage3_dmd.dmd_arope import frame_cond # noqa: E402 ← 训练侧同一份逐 cell 条件 +from distill.tests.preflight import retained_cells, window_offsets_for_frame # noqa: E402 + +CELL_FRAMES = 4 # cell k(≥1) = 帧 4k−3 … 4k(Wan2.2 因果 VAE 的分组) + + +# ---------------------------------------------------------------------------- +# 指令 → 逐帧 / 逐 cell 偏移 +# ---------------------------------------------------------------------------- + +def cell_of_frames(cells: int) -> np.ndarray: + """每一帧属于哪个 cell(cell 0 = 帧 0;cell k = 帧 4k−3 … 4k)。= geometry.cell_frames 的逆, + 只是把 21 的硬编码换成 cells —— rollout 要跑到 21 个 cell 以外,而 geometry 硬要求正好 21。""" + n_frames = CELL_FRAMES * cells - (CELL_FRAMES - 1) # cells=21 ⇒ 81 = G.FRAMES + cell_of = np.zeros(n_frames, int) + for k in range(1, cells): + cell_of[CELL_FRAMES * k - 3: CELL_FRAMES * k + 1] = k + return cell_of + + +def frames_to_cells_n(frame_off: np.ndarray, cells: int) -> np.ndarray: + """逐帧偏移 → 逐 cell 偏移(cell 内取均值)。cells == 21 时与 geometry.frames_to_cells 逐位相同。""" + cell_of = cell_of_frames(cells) + assert len(frame_off) == len(cell_of), f"帧数 {len(frame_off)} 与 {cells} cell 要求的 {len(cell_of)} 不符" + return np.stack([frame_off[cell_of == k].mean(0) for k in range(cells)], 0) + + +def action_offsets(vel: np.ndarray, cells: int) -> tuple[np.ndarray, np.ndarray]: + """逐 cell 速度 (px/s) [cells,2] → (frame_offset_px [4·cells−3, 2], cell_offset_px [cells,2])。 + + 与 `infer.parse_actions` + `geometry.frames_to_cells` 用的是**同一条**递推 + (`frame_off[i] = frame_off[i−1] + v[cell(i)]/FPS`,cell 内取均值),只是把 21 的硬编码 + 换成了 cells —— cells == 21 时逐位相同(`_assert_matches_parse_actions` 会核对)。 + """ + assert vel.shape == (cells, 2), f"vel 形状应为 ({cells}, 2),得到 {vel.shape}" + cell_of = cell_of_frames(cells) + frame_off = np.zeros((len(cell_of), 2), np.float64) + for i in range(1, len(cell_of)): + frame_off[i] = frame_off[i - 1] + vel[cell_of[i]] / G.FPS + return frame_off, frames_to_cells_n(frame_off, cells) + + +def _ckpt_metadata(path: str) -> dict: + """读 safetensors 头里的 __metadata__(不加载权重)。save_dit 在这里写 flowmap 的形式与 gate, + stage3 的 do_save 还写训练几何(kv_window / sink_size / rope_cap,见 _check_ckpt_geometry)。""" + import json as _json + import struct + with open(path, "rb") as f: + n = struct.unpack(" None: + """stage3 学生必须按**训练几何**评(GEO-1):ckpt 元数据里 kv_window / sink_size / rope_cap 三键齐全 + 且任一与命令行不等 ⇒ 拒绝,除非 --allow_geometry_mismatch(只作显式 A/B,RUNBOOK 的口径)。 + + 为什么硬拒而不是警告:sink 3 / w17 与训练的 sink 0 / w20 只在 k≤20 的保留集相同,之后的 h/w RoPE + 与掩码通道是训练 rollout 从未产生过的输入 —— 拿它比 EMA、比 stage2 都只是在比 OOD 外推,ckpt + 选择轴就错了。三键不全(stage1 / stage2 的 ckpt)不受限。""" + meta = _ckpt_metadata(path) + if not all(k in meta for k in GEOMETRY_META_KEYS): + return + try: + ck = {k: int(meta[k]) for k in GEOMETRY_META_KEYS} + except ValueError as e: + raise SystemExit(f"{path} 的几何元数据不是整数:{ {k: meta[k] for k in GEOMETRY_META_KEYS} }({e})") + cli = {k: int(getattr(args, k)) for k in GEOMETRY_META_KEYS} + diff = {k: (ck[k], cli[k]) for k in GEOMETRY_META_KEYS if ck[k] != cli[k]} + if "sink_anchor" in meta and str(meta["sink_anchor"]) != str(args.sink_anchor): + diff["sink_anchor"] = (str(meta["sink_anchor"]), str(args.sink_anchor)) + if not diff: + log(f"[geometry] {os.path.basename(path)} 训练几何 sink {ck['sink_size']} / window {ck['kv_window']} / " + f"cap {ck['rope_cap']} == 命令行") + return + msg = (f"{path} 的训练几何与命令行不符:" + ", ".join(f"{k} ckpt={a} cli={b}" for k, (a, b) in diff.items()) + + "。\n stage3 学生只在训练几何下才是分布内的(GEO-1);请用 --sink_size/--kv_window/--rope_cap " + "对齐 ckpt,或加 --allow_geometry_mismatch(只作显式 A/B,不作 ckpt 选择轴)。") + if args.allow_geometry_mismatch: + log(f"[geometry] 放行(--allow_geometry_mismatch):{msg}") + return + raise SystemExit(msg) + + +def _assert_matches_parse_actions(spec: str, walk_speed: np.ndarray) -> None: + """cells=21 时本文件的递推必须与 infer.parse_actions / frames_to_cells 逐位相同。""" + fo, vel = infer.parse_actions(spec, walk_speed) + fo2, co2 = action_offsets(vel, G.CELLS) + assert np.array_equal(fo, fo2), "action_offsets 与 infer.parse_actions 的逐帧偏移不一致" + assert np.array_equal(G.frames_to_cells(fo), co2), "逐 cell 偏移与 geometry.frames_to_cells 不一致" + + +def parse_actions_n(spec: str, walk_speed: np.ndarray, cells: int) -> np.ndarray: + """与 `infer.parse_actions` 同一套语法,但总 cell 数是 `cells` 而不是硬写的 21。 + + 上游那个函数在 `len(vel) != G.CELLS` 时直接抛错(`actionrope/infer.py:127`),而超出训练 + 视野的多段指令("绕一圈"、"第 30 格突然转向")正是 AR rollout 唯一值得测的东西 —— + 直线走到底用 `extend_velocity` 重复末段就够了,不需要这个函数。 + + 分段解析是从上游抄来的,所以两份实现可能漂移;`cells == 21` 时本函数会直接调上游核对, + 逐位不同就抛。不动 `actionrope/`:那是训练与推理的正典,评测不该改它。 + """ + toks = [t.strip() for t in spec.split(",") if t.strip()] + segs, i = [], 0 + while i < len(toks): + if ":" not in toks[i]: # "dx,dy:n" 被逗号切开了,粘回去 + if i + 1 >= len(toks): + raise ValueError(f"动作段不完整: {toks[i]!r}") + segs.append(toks[i] + ";" + toks[i + 1]); i += 2 + else: + segs.append(toks[i]); i += 1 + vel = [] + for seg in segs: + parts = seg.split(":") + if len(parts) == 3: + name, mult, n = parts[0].strip().lower(), float(parts[1]), int(parts[2]) + if name not in infer.DIR_NAMES: + raise ValueError(f"未知方向 {name!r},可选 {sorted(infer.DIR_NAMES)}") + v = G.ACTION_DIRS[infer.DIR_NAMES[name]] * walk_speed * mult + elif len(parts) == 2 and ";" in parts[0]: + dx, dy = (float(t) for t in parts[0].split(";")) + v, n = np.array([dx, dy], np.float64), int(parts[1]) + else: + raise ValueError(f"动作段格式应为 dir:mult:cells 或 dx,dy:cells,得到 {seg!r}") + vel += [v] * n + if len(vel) != cells: + raise ValueError(f"动作脚本的 cell 数合计应为 {cells}(--cells),得到 {len(vel)}") + vel = np.stack(vel, 0) + if cells == G.CELLS: # 与上游对表,防止两份解析漂移 + _, vel_up = infer.parse_actions(spec, walk_speed) + assert np.array_equal(vel, vel_up), "parse_actions_n 与 infer.parse_actions 解析结果不一致" + return vel + + +def extend_velocity(vel: np.ndarray, cells: int) -> np.ndarray: + """把动作脚本的逐 cell 速度延长到 cells 个 cell:重复最后一段的速度。 + + 评测**故意**不用训练侧默认的 `resample`:那是给训练喂多样性的,随机重抽方向之后 + 「指令」就不再是一个可核对的东西了。重复最后一段速度 = 一条明确的、可以拿来比对的指令, + 在 cell 层面与 `data.extend_offsets(mode="continue")` 同解。 + """ + if cells <= len(vel): + return vel[:cells] + return np.concatenate([vel, np.repeat(vel[-1:], cells - len(vel), axis=0)], 0) + + +# ---------------------------------------------------------------------------- +# 两条部署采样路径 +# ---------------------------------------------------------------------------- + +ROT_MASK = ("rot", "plain") # rot = 斜的 known 多边形(几何正确);plain = 老的轴对齐掩码(消融) + + +def parallel_mask(off_t: torch.Tensor, ang_t, lh: int, lw: int, rot_mask: str = "rot"): + """并行路径的 known 掩码。ang_t [b, f] 是**绝对**朝向(cell 0 = 0):cell k 自己的格点先转 φ_k + 进世界系再判定是否落在 cell 0 的足迹内。`_known_rotated` 的口径是"偏移在该 cell 自己的相机系里、 + 角度取锚点相对该 cell",所以这里传 R(−φ_k)·off_k 与 −φ_k。ang_t=None ⇒ 老路。""" + if ang_t is None or rot_mask == "plain": + return make_mask_input(off_t, lh, lw) + off_local = rot2d(off_t, -ang_t) + return make_mask_input(off_local, lh, lw, angle=-ang_t) + + +@torch.no_grad() +def deploy_parallel(model: AropeDiT, z0: torch.Tensor, context, context_ids, off_t: torch.Tensor, + deploy: tuple, *, seed: int = 0, log=print, ang_t=None, + rot_mask: str = "rot", scale_t=None) -> torch.Tensor: + """整片并行的少步部署(stage2 EMA 自己的路径)。cell 0 每一步都写回首帧 latent。""" + _, sig, t_grid = deploy + b, c, _, lh, lw = z0.shape[0], z0.shape[1], 0, z0.shape[3], z0.shape[4] + cells = off_t.shape[1] + g = torch.Generator("cpu").manual_seed(seed) + latents = torch.randn(b, c, cells, lh, lw, generator=g).to(dtype=z0.dtype, device=z0.device) + latents[:, :, 0:1] = z0 + mask_in = parallel_mask(off_t, ang_t, lh, lw, rot_mask) + t0 = time.time() + for i in range(len(t_grid)): + ts = torch.full((b,), float(t_grid[i]), device=z0.device) + v = model(latents, ts, context, context_ids=context_ids, offset_px=off_t, + mask_input=mask_in, first_frame_cond=True, angle_px=ang_t, scale_px=scale_t) + den = latents - float(sig[i]) * v # x0 估计 + if i + 1 == len(t_grid): + latents = den + else: + ns = float(sig[i + 1]) + latents = (1.0 - ns) * den + ns * torch.randn(den.shape, generator=g).to(den) + latents[:, :, 0:1] = z0 # TI2V 锚点,每步写回 + log(f" parallel step {i + 1}/{len(t_grid)} t={float(t_grid[i]):.0f} σ={float(sig[i]):.4f} " + f"· {time.time() - t0:.1f}s") + return latents + + +@torch.no_grad() +def deploy_parallel_flowmap(model: AropeDiT, z0: torch.Tensor, context, context_ids, + off_t: torch.Tensor, sigmas, *, seed: int = 0, log=print) -> torch.Tensor: + """整片并行的 **flow map** 部署(stage2-flowmap 的 EMA 走这条)。 + + 与 renoise 版的两处**本质**差别,接错任何一处都不会报错、只会安静地产出另一个模型: + + 1. 模型要吃**两个**时间步。每步喂 (t_i, r_i) = (σ_i, σ_{i+1})·1000,它预测的是区间 + [r, t] 上的**均**速度,不是 t 处的瞬时速度。 + 2. **全程不重新加噪**。每步就是 `x ← x − (σ_t − σ_r)·u`;轴的末位是 0.0,所以最后一步 + 直接落在干净估计上,不需要再单独读一次 x0。renoise 版每步都要重采一份新噪声, + 那是一致性/扩散学生的采样方式,拿来采 flow map 会多注入 N 份噪声。 + + `sigmas` 长度 N+1、严格降序、末位 0.0(`flowmap.anystep_sigmas(N)`)。N 可以任意取 —— + 这正是 any-step 的主张本身,4 步和 24 步用的是同一份权重。 + """ + fm.assert_anystep_axis(sigmas if torch.is_tensor(sigmas) else torch.as_tensor(sigmas), terminal=True) + b, c, _, lh, lw = z0.shape[0], z0.shape[1], 0, z0.shape[3], z0.shape[4] + cells = off_t.shape[1] + g = torch.Generator("cpu").manual_seed(seed) + x = torch.randn(b, c, cells, lh, lw, generator=g).to(dtype=z0.dtype, device=z0.device) + x[:, :, 0:1] = z0 + mask_in = make_mask_input(off_t, lh, lw) + t0 = time.time() + N = len(sigmas) - 1 + for i in range(N): + s_t, s_r = float(sigmas[i]), float(sigmas[i + 1]) + tt = torch.full((b,), s_t * fm.NUM_TRAIN_TIMESTEPS, device=z0.device) + rr = torch.full((b,), s_r * fm.NUM_TRAIN_TIMESTEPS, device=z0.device) + u = model(x, tt, context, context_ids=context_ids, r_timestep=rr, + offset_px=off_t, mask_input=mask_in, first_frame_cond=True) + x = fm.euler_step(x, u, s_t, s_r) + x[:, :, 0:1] = z0 # TI2V 锚点,每步写回 + log(f" flowmap parallel {i + 1}/{N} σ {s_t:.4f}→{s_r:.4f} · {time.time() - t0:.1f}s") + return x + + +@torch.no_grad() +def deploy_rollout_flowmap(model: AropeDiT, z0: torch.Tensor, ctx_ext, ids_ext, off_ext: torch.Tensor, + cells: int, sigmas, *, kv_window: int = 20, sink_size: int = 0, + rope_cap: int = 20, seed: int = 0, log=print, sink_anchor: str = "absolute") -> torch.Tensor: + """滑窗 KV 的逐 cell 自回归 **flow map** 部署。 + + 结构与 `deploy_rollout` 逐行对应,只把每个 cell 内部的采样链换成 flow-map Euler: + 每个 cell 沿整条 any-step 轴走完(无重新加噪),然后**照旧**用 `t=0` 提交 detach 过的 + 结果进缓存 —— 提交趟的 t=0 与 flow map 无关,它是 TF clean 流的同分布要求,不能改。 + """ + fm.assert_anystep_axis(sigmas if torch.is_tensor(sigmas) else torch.as_tensor(sigmas), terminal=True) + b, c, _, lh, lw = z0.shape + dev = z0.device + bare = unwrap(model) + cache = bare.init_kv_cache(kv_window=kv_window, sink_size=sink_size, rope_cap=rope_cap) + g = torch.Generator("cpu").manual_seed(seed) + N = len(sigmas) - 1 + + def _call(x, t, k, commit, ow, mk, r=None): + return model(x, t, ctx_ext[:, k:k + 1], context_ids=ids_ext[:, k:k + 1], + r_timestep=(t if r is None else r), + first_frame_cond=False, frame_index=k, kv_cache=cache, commit=commit, + offset_win=ow, mask_in_k=mk) + + ow0, mk0 = frame_cond(off_ext, 0, sink_size, kv_window, lh, lw, sink_anchor) + zeros = torch.zeros(b, device=dev) + _call(z0, zeros, 0, True, ow0, mk0) # 真实首帧,t=r=0 进缓存 + frames = [z0] + t0 = time.time() + for k in range(1, cells): + ow, mk = frame_cond(off_ext, k, sink_size, kv_window, lh, lw, sink_anchor) + x = torch.randn(b, c, 1, lh, lw, generator=g).to(dtype=z0.dtype, device=dev) + for i in range(N): + s_t, s_r = float(sigmas[i]), float(sigmas[i + 1]) + tt = torch.full((b,), s_t * fm.NUM_TRAIN_TIMESTEPS, device=dev) + rr = torch.full((b,), s_r * fm.NUM_TRAIN_TIMESTEPS, device=dev) + x = fm.euler_step(x, _call(x, tt, k, False, ow, mk, r=rr), s_t, s_r) + frames.append(x) + _call(x.detach(), zeros, k, True, ow, mk) # 每个 cell 恰好提交一次,t=0 + if k % 5 == 0 or k == cells - 1: + log(f" flowmap rollout cell {k}/{cells - 1} · {time.time() - t0:.1f}s") + out = torch.cat(frames, dim=2) + bare.release_kv_cache(cache) # cache 与 _ref 成环,不显式清会拖着十几 GB 不放 + return out + + +@torch.no_grad() +def build_angles(args, cells: int, device, log=print): + """--rotate <每 cell 度数> / --rotate_spec ":,..." ⇒ [1, cells] 的逐 cell 相机朝向(弧度)。 + + cell 0 恒为 0(首帧定义世界系);朝向是**累计**的:φ_k = φ_{k−1} + 该段的每格角速度。 + 都没给 ⇒ None,整条 rollout 逐位走旋转之前的老路。 + """ + spec = getattr(args, "rotate_spec", None) + rate = float(getattr(args, "rotate", 0.0) or 0.0) + if not spec and rate == 0.0: + return None + per_cell = [0.0] * cells + if spec: + k = 1 + for seg in [t.strip() for t in spec.split(",") if t.strip()]: + deg, n = seg.split(":") + for _ in range(int(n)): + if k < cells: + per_cell[k] = float(deg) + k += 1 + if k < cells: # 没铺满 ⇒ 末段的角速度续到底 + last = float(spec.split(",")[-1].split(":")[0]) + for j in range(k, cells): + per_cell[j] = last + else: + for j in range(1, cells): + per_cell[j] = rate + ang = torch.tensor(per_cell, dtype=torch.float32, device=device).cumsum(0).unsqueeze(0) + ang = ang * math.pi / 180.0 + deg = (ang[0] * 180.0 / math.pi).tolist() + log(f" --rotate:相机朝向 cell0={deg[0]:.1f}° → cell{cells - 1}={deg[-1]:.1f}°" + f"(每格最大 {max(per_cell):.2f}°;画幅角点离中心 ~15 token,1° 约合角点 0.26 token 位移)") + return ang + + +def build_scales(args, cells: int, device, log=print): + """--zoom <每 cell 的位置缩放率>:位置整体等比缩放 s_k = (1+rate)^k(cell 0 = 1)。 + + 判决实验用:位置铺得越开,这一帧名义上覆盖的世界就越大。若模型把"位置场变大"读成"视野变大", + 内容应当按 1/s 缩小 —— 那就说明旋转时看到的缩小也是同一条通道,靠推理端补不回来。 + """ + rate = float(getattr(args, "zoom", 0.0) or 0.0) + if rate == 0.0: + return None + s = torch.tensor([(1.0 + rate) ** k for k in range(cells)], dtype=torch.float32, device=device).unsqueeze(0) + log(f" --zoom:位置缩放 cell0={float(s[0, 0]):.3f} → cell{cells - 1}={float(s[0, -1]):.3f}" + f"(若模型按视野读,内容应缩小到 1/{float(s[0, -1]):.3f} = {1 / float(s[0, -1]):.3f})") + return s + + +def frame_cond_rot(off_ext: torch.Tensor, ang_ext: torch.Tensor, k: int, sink_size: int, + kv_window: int, lat_h: int, lat_w: int, sink_anchor: str = "absolute", + rot_mask: str = "rot"): + """带相机旋转的逐 cell 条件:返回 (offset_win, mask_in_k, angle_win)。 + + 一切表达在**当前 cell 的相机系**里(`angle_win[:, -1] == 0`,当前帧格点保持轴对齐): + · 偏移:先把全部世界偏移转 −φ_k 进当前相机系,再走与 frame_cond 完全相同的窗口锚定; + · 角度:φ_j − φ_k(历史 cell 相对当前相机转了多少); + · 掩码:known 的判据仍是"落在锚点 cell 的足迹内",锚点相对当前转了 φ_a − φ_k,于是足迹是斜的。 + ang_ext 全 0 时逐位退化成 `frame_cond`(本函数自带断言核对)。 + """ + idx = retained_cells(k, sink_size, kv_window) + [k] + sel = torch.as_tensor(idx, device=off_ext.device, dtype=torch.long) + phi_k = ang_ext[:, k] # [b] + ang_win = ang_ext.index_select(1, sel) - phi_k.unsqueeze(1) # [b, n+1],最后一项恒 0 + off_rot = rot2d(off_ext, -phi_k.unsqueeze(1)) # 整条转进当前相机系 + ow = window_offsets_for_frame(off_rot, k, sink_size, kv_window, sink_anchor=sink_anchor) + # 锚点 = ow 里被减成 0 的那一格(absolute ⇒ idx[0];window 且缓存饱和 ⇒ idx[sink_size]) + saturated = kv_window is not None and k > sink_size + kv_window + a = sink_size if (sink_anchor == "window" and sink_size > 0 and saturated) else 0 + mk = (make_mask_input(ow[:, -1:], lat_h, lat_w) if rot_mask == "plain" + else make_mask_input(ow[:, -1:], lat_h, lat_w, angle=ang_win[:, a:a + 1])) + return ow, mk, ang_win + + +def deploy_rollout(model: AropeDiT, z0: torch.Tensor, ctx_ext, ids_ext, off_ext: torch.Tensor, + cells: int, deploy: tuple, *, kv_window: int = 20, sink_size: int = 0, + rope_cap: int = 20, seed: int = 0, log=print, euler=None, sink_anchor: str = "absolute", + ang_ext: torch.Tensor | None = None, rot_mask: str = "rot") -> torch.Tensor: + """滑窗 KV 的逐 cell 自回归部署 —— stage3 的 self_forcing_rollout 的 no-grad 孪生。 + + euler 非 None ⇒ 每个 cell 不走 renoise 链,而是用这个 FlowMatchScheduler 的 Euler ODE + (`sched.step`,与 `infer.sample` 同一条路;longhorizon/README 的「ODE 16 步」口径), + 从纯噪声 σ=1 一路积分到 σ=0。KV 提交与条件完全不变。 + + 与训练时的唯一差别:推理不抽退出档,每个 cell 把整张部署表走完再提交。 + 条件(窗口锚定的 offset_win / 当前 cell 的 known 掩码)直接用训练侧的 frame_cond, + 提交趟同样是 **detach 过的 x0 + t=0**(这个 0 让缓存历史与 TF 的 clean 流同分布)。 + """ + _, sig, t_grid = deploy + b, c, _, lh, lw = z0.shape + dev = z0.device + bare = unwrap(model) + cache = bare.init_kv_cache(kv_window=kv_window, sink_size=sink_size, rope_cap=rope_cap) + g = torch.Generator("cpu").manual_seed(seed) + + def _call(x, t, k, commit, ow, mk, aw=None): + return model(x, t, ctx_ext[:, k:k + 1], context_ids=ids_ext[:, k:k + 1], + first_frame_cond=False, frame_index=k, kv_cache=cache, commit=commit, + offset_win=ow, mask_in_k=mk, angle_win=aw) + + def _cond(k): + # ang_ext=None ⇒ 完全走旋转之前的那条路(frame_cond),逐位不变 + if ang_ext is None: + ow_, mk_ = frame_cond(off_ext, k, sink_size, kv_window, lh, lw, sink_anchor) + return ow_, mk_, None + return frame_cond_rot(off_ext, ang_ext, k, sink_size, kv_window, lh, lw, sink_anchor, rot_mask) + + ow0, mk0, aw0 = _cond(0) + _call(z0, torch.zeros(b, device=dev), 0, True, ow0, mk0, aw0) # 真实首帧,t=0 进缓存 + frames = [z0] + t0 = time.time() + for k in range(1, cells): + ow, mk, aw = _cond(k) + noisy = torch.randn(b, c, 1, lh, lw, generator=g).to(dtype=z0.dtype, device=dev) + den = None + if euler is not None: + x = noisy + for i, t in enumerate(euler.timesteps): + ts = torch.full((b,), float(t), device=dev) + x = euler.step(_call(x, ts, k, False, ow, mk, aw), euler.timesteps[i], x) + den = x + else: + for i in range(len(t_grid)): + ts = torch.full((b,), float(t_grid[i]), device=dev) + den = noisy - float(sig[i]) * _call(noisy, ts, k, False, ow, mk, aw) + if i + 1 < len(t_grid): + ns = float(sig[i + 1]) + noisy = (1.0 - ns) * den + ns * torch.randn(den.shape, generator=g).to(den) + frames.append(den) + _call(den.detach(), torch.zeros(b, device=dev), k, True, ow, mk, aw) # 每个 cell 恰好提交一次 + if k % 5 == 0 or k == cells - 1: + log(f" rollout cell {k}/{cells - 1} · {time.time() - t0:.1f}s") + return torch.cat(frames, dim=2) + + +# ---------------------------------------------------------------------------- +# 一次评测 +# ---------------------------------------------------------------------------- + +def measure(frames: np.ndarray, frame_off: np.ndarray, chain: int = 16) -> dict: + """SIFT+RANSAC 实测背景位移 vs 指令。指令背景位移 = −frame_offset_px[最后一帧]。""" + k = len(frames) - 1 + meas = infer.measure_displacement(infer.to_gray(frames), k=k, chain=chain) + expect = (-frame_off[k]).tolist() + err = None if meas["sift"] is None else [meas["sift"][0] - expect[0], meas["sift"][1] - expect[1]] + out = {"k": k, "measured": meas, "expected_bg_shift": expect, "error_px": err} + if err is not None: + out["error_norm_px"] = float(np.hypot(*err)) + out["expected_norm_px"] = float(np.hypot(*expect)) + out["error_rel"] = (out["error_norm_px"] / out["expected_norm_px"] + if out["expected_norm_px"] > 1e-6 else None) + return out + + +def run_one(model, pipe, z0, cond, args, deploy, log=print, sigmas=None) -> dict: + """生成 + 解码 + 实测。cond 由 build_condition() 给出。 + + `sigmas` 非 None ⇒ 走 flow-map 的 any-step Euler(无重新加噪,模型吃 (t, r) 两个时间步); + None ⇒ 走原来的 renoise 链。两者接错都不报错,所以分流在 main() 里按 checkpoint 决定。 + """ + t0 = time.time() + if args.mode == "rollout": + if sigmas is not None: + if cond.get("ang_ext") is not None: + raise SystemExit("--rotate 只支持 renoise / euler 的 rollout 路径,flowmap 分支没接") + lat = deploy_rollout_flowmap(model, z0, cond["ctx_ext"], cond["ids_ext"], cond["off_ext"], + cond["cells"], sigmas, kv_window=args.kv_window, + sink_size=args.sink_size, rope_cap=args.rope_cap, + seed=args.seed, log=log, sink_anchor=args.sink_anchor) + else: + lat = deploy_rollout(model, z0, cond["ctx_ext"], cond["ids_ext"], cond["off_ext"], + cond["cells"], deploy, kv_window=args.kv_window, + sink_size=args.sink_size, rope_cap=args.rope_cap, seed=args.seed, log=log, + euler=getattr(args, "euler_sched", None), sink_anchor=args.sink_anchor, + ang_ext=cond.get("ang_ext"), rot_mask=args.rotate_mask) + else: + if sigmas is not None: + lat = deploy_parallel_flowmap(model, z0, cond["context"], cond["context_ids"], + cond["off_par"], sigmas, seed=args.seed, log=log) + else: + ang_par = cond.get("ang_ext") + if ang_par is not None: + ang_par = ang_par[:, :cond["off_par"].shape[1]] + lat = deploy_parallel(model, z0, cond["context"], cond["context_ids"], cond["off_par"], + deploy, seed=args.seed, log=log, ang_t=ang_par, + rot_mask=args.rotate_mask, scale_t=cond.get("scale_ext")) + torch.cuda.synchronize() if z0.is_cuda else None + sample_sec = time.time() - t0 + assert torch.isfinite(lat).all(), "采样输出里有 NaN/Inf" + t0 = time.time() + frames = infer.decode_video(pipe, lat, tiled=args.tiled) + dec_sec = time.time() - t0 + res = measure(frames, cond["frame_off"], chain=args.chain) + res.update(sample_sec=sample_sec, decode_sec=dec_sec, frames=int(frames.shape[0]), + cells=cond["cells"], mode=args.mode) + return res, frames, lat + + +def apply_late_trigger(prompts21: list[str], spec: str, cells: int) -> list[str]: + """把 21 条(已 strip_action 的)逐 cell 场景串延到 cells 条,并在 cell ≥ 21 处再切一次场景。 + + spec "burn:::"(或 cut:):cell [start, start+n) 用转场从句「B burning away into C」, + 之后的 cell 切成纯 C;start 之前保持 cell 20 的场景 B(= extend_context 的 hold)。start 必须 ≥ 21, + 21 以内的切换走 --trigger(那是训练语料的口径)。串必须在文本表里(14 个源场景 × 13 个目的都有)。 + """ + kind, c, start, n = spec.split(":") + start, n = int(start), int(n) + if kind not in infer.TRIG_TMPL: + raise ValueError(f"--late_trigger 类型应为 burn/cut,得到 {kind!r}") + if not (G.CELLS <= start < cells and n >= 1 and start + n <= cells): + raise ValueError(f"--late_trigger 的 start/n 越界:start={start} n={n} cells={cells}(start 须 ≥ {G.CELLS})") + m = re.match(r"^In a 2\.5D top down view, the player is (.+)\.$", prompts21[-1]) + if not m: + raise ValueError(f"cell 20 没有场景从句({prompts21[-1]!r}),无法构造转场;请给 --scene") + a, c_nl = m.group(1), infer.scene_clause(c) + trig = infer.TRIG_TMPL[kind].format(a=a, b=c_nl[3:] if c_nl.startswith("in ") else c_nl) + tmpl = "In a 2.5D top down view, the player is {scene}." + out = list(prompts21) + [prompts21[-1]] * (start - G.CELLS) + out += [tmpl.format(scene=trig)] * n + [tmpl.format(scene=c_nl)] * (cells - start - n) + assert len(out) == cells + return out + + +def apply_switches(scene_a: str, spec: str, cells: int) -> list[str]: + """从 --scene A 起,按 spec "burn:B:10:2,burn:C:20:2,cut:D:30:2" 在任意 cell 处连续切换多次场景, + 直接生成整条 cells 长的逐 cell 场景串(与 apply_late_trigger 同一套转场从句与模板;串都在文本表里)。 + 每段:[start, start+n) 用「上一场景 burning away into 新场景」,之后是纯新场景,直到下一次切换。""" + tmpl = "In a 2.5D top down view, the player is {scene}." + cur = infer.scene_clause(scene_a) + segs = [] + for tok in [t.strip() for t in spec.split(",") if t.strip()]: + kind, c, start, n = tok.split(":") + start, n = int(start), int(n) + if kind not in infer.TRIG_TMPL: + raise ValueError(f"--switches 类型应为 burn/cut,得到 {kind!r}") + segs.append((start, n, kind, c)) + segs.sort() + out: list[str] = [] + for start, n, kind, c in segs: + if not (len(out) <= start and 1 <= start and start + n <= cells): + raise ValueError(f"--switches 段越界或重叠:start={start} n={n} cells={cells},已生成 {len(out)} 条") + out += [tmpl.format(scene=cur)] * (start - len(out)) + c_nl = infer.scene_clause(c) + trig = infer.TRIG_TMPL[kind].format(a=cur, b=c_nl[3:] if c_nl.startswith("in ") else c_nl) + out += [tmpl.format(scene=trig)] * n + cur = c_nl + out += [tmpl.format(scene=cur)] * (cells - len(out)) + assert len(out) == cells + return out + + +def build_condition(args, enc, device, log=print) -> dict: + """指令 → 逐帧偏移 / 逐 cell 偏移 / 逐 cell 文本 / 首帧规格。""" + sc = torch.load(infer.SIDECAR, map_location="cpu", weights_only=False) + walk_speed = np.array(sc["meta"]["walk_speed_px_s"], np.float64) + cells = args.cells + if args.replay: + row = infer.load_meta_row(args.replay) + c = sc["clips"][args.replay] + frame_off21 = c["frame_offset_px"].numpy().astype(np.float64) # [81,2] 真值 + prompts = [infer.strip_action(p) for p in row["prompts"]] # ARoPE 臂只看场景 + first_spec = args.replay + co21 = G.frames_to_cells(frame_off21) + assert np.array_equal(co21, frames_to_cells_n(frame_off21, G.CELLS)), "逐 cell 归约口径分叉了" + if cells == G.CELLS: + frame_off, cell_off = frame_off21, co21 + elif cells < G.CELLS: + # 截短(冒烟/计时用):cell k 覆盖帧 4k−3…4k,所以前 cells 个 cell 用前 4·cells−3 帧。 + # 不能整段拿 81 帧去配 cells 个 cell —— frames_to_cells_n 会直接断言失败。 + n_keep = CELL_FRAMES * cells - (CELL_FRAMES - 1) + frame_off = frame_off21[:n_keep] + cell_off = frames_to_cells_n(frame_off, cells) + assert np.array_equal(cell_off, co21[:cells]), "截短不该改动前 cells 个 cell 的真值" + log(f" replay 截到 {cells} cell({n_keep} 帧)") + else: + # 21 个 cell 之内**原样用真值逐帧偏移**(sidecar 的真实轨迹不是分段匀速,重建一遍会失真), + # 21 之外按末段隐含的匀速续走(= data.extend_offsets("continue")) + v_last = (co21[-1] - co21[-2]) * G.FPS / CELL_FRAMES + n_ext = CELL_FRAMES * (cells - G.CELLS) + ext = frame_off21[-1] + np.outer(np.arange(1, n_ext + 1) / G.FPS, v_last) + frame_off = np.concatenate([frame_off21, ext], 0) + cell_off = frames_to_cells_n(frame_off, cells) + assert np.array_equal(cell_off[:G.CELLS], co21), "延长不该改动前 21 个 cell 的真值" + log(f" replay 延到 {cells} cell:末段速度 ({v_last[0]:+.1f},{v_last[1]:+.1f}) px/s 续走") + else: + if not (args.first_frame and args.actions): + raise SystemExit("非 --replay 模式需要 --first_frame 和 --actions") + n_spec = sum(int(s.split(":")[-1]) for s in args.actions.split(",") if ":" in s) + if n_spec == cells and cells != G.CELLS: + # 多段指令铺满整个 rollout("绕一圈"、"第 30 格转向")—— 超出训练视野的指令 + # 才是 AR rollout 值得测的东西。直线到底仍走下面那条 21+extend 的路。 + vel = parse_actions_n(args.actions, walk_speed, cells) + log(f" 动作脚本铺满 {cells} cell(不是 21+续走)") + else: + _assert_matches_parse_actions(args.actions, walk_speed) # 与 infer.py 同一条递推 + _, vel21 = infer.parse_actions(args.actions, walk_speed) + vel = extend_velocity(vel21, cells) + frame_off, cell_off = action_offsets(vel, cells) + # 文本只含场景(ARoPE 臂走 strip_action),动作走 RoPE 不走文本,所以标签取前 21 格即可 + labels21 = [infer.velocity_to_label(v, mirror=False) for v in vel[:G.CELLS]] + if args.scene: + prompts = [infer.strip_action(p) for p in + infer.compose_cell_prompts(args.scene, args.trigger, labels21)] + else: + # bg50 的 50 张背景不属于 18 个训练场景,配不出场景从句 —— eval_bg50.py:189-192 + # 的默认口径就是空条件串,这里对齐它,别硬编一个模型没见过的场景描述。 + prompts = [NULL_PROMPT] * G.CELLS + log(f" 未给 --scene,用空条件串 {NULL_PROMPT!r}(bg50 的默认口径)") + first_spec = args.first_frame + assert len(prompts) == G.CELLS, f"prompt 应为 {G.CELLS} 条,得到 {len(prompts)}" + context, context_ids = infer.build_context(enc, prompts, device, per_cell=True) # [1,21,512,4096] + off21 = torch.tensor(cell_off[:G.CELLS], dtype=torch.float32).unsqueeze(0).to(device) + off_full = torch.tensor(cell_off, dtype=torch.float32).unsqueeze(0).to(device) + # 逐 cell 文本延到 1+N(cell ≥ 21 保持最后一条,与训练侧 extend_context 同一函数) + ctx_ext, ids_ext = extend_context(context, context_ids, cells - 1, mode="hold") + if getattr(args, "late_trigger", None): + prompts_n = apply_late_trigger(prompts, args.late_trigger, cells) + ctx_ext, ids_ext = infer.build_context(enc, prompts_n, device, per_cell=True) # [1, cells, 512, 4096] + sw = [k for k in range(1, cells) if prompts_n[k] != prompts_n[k - 1]] + log(f" --late_trigger {args.late_trigger}:cell {sw} 处切换,{len(set(prompts_n))} 条不同的串") + prompts = prompts_n + if getattr(args, "switches", None): + if not args.scene: + raise SystemExit("--switches 需要 --scene 作为起始场景") + prompts_n = apply_switches(args.scene, args.switches, cells) + ctx_ext, ids_ext = infer.build_context(enc, prompts_n, device, per_cell=True) # [1, cells, 512, 4096] + sw = [k for k in range(1, cells) if prompts_n[k] != prompts_n[k - 1]] + log(f" --switches {args.switches}:cell {sw} 处切换,{len(set(prompts_n))} 条不同的串") + prompts = prompts_n + off_ext = off_full if cells > G.CELLS else off21 + # 整片并行路径喂的是绝对世界坐标(cell 0 恒为 0,本来就锚定);rollout 路径在每个 cell 现算窗口锚定 + off_par = window_offsets(off_ext[:, :min(cells, off_ext.shape[1])], 0, min(cells, off_ext.shape[1]) - 1) + return {"frame_off": frame_off, "cell_off": cell_off, "cells": cells, "prompts": prompts, + "context": ctx_ext[:, :cells], "context_ids": ids_ext[:, :cells], + "ctx_ext": ctx_ext, "ids_ext": ids_ext, "off_ext": off_ext, "off_par": off_par, + "ang_ext": build_angles(args, cells, off_ext.device, log=log), + "scale_ext": build_scales(args, cells, off_ext.device, log=log), + "first_spec": first_spec, "walk_speed": walk_speed.tolist()} + + +# ---------------------------------------------------------------------------- +# 自检(tiny 模型,不碰真权重 / 不需要 VAE) +# ---------------------------------------------------------------------------- + +def self_test(log=print, device: str | None = None) -> None: + from diffsynth.models.wan_video_dit import WanModel + tiny = dict(dim=128, in_dim=48, ffn_dim=256, out_dim=48, text_dim=4096, freq_dim=256, eps=1e-6, + patch_size=(1, 2, 2), num_heads=4, num_layers=2, has_image_input=False) + # 尊重 --device:--self_test 不需要 GPU,别在训练用的卡上白建一个 CUDA 上下文 + dev = device if device else ("cuda" if torch.cuda.is_available() else "cpu") + if str(dev).startswith("cuda") and not torch.cuda.is_available(): + dev = "cpu" + torch.manual_seed(0) + model = AropeDiT(dit=WanModel(**tiny).to(torch.bfloat16), mask_channel=True, causal=True) + model.eval().requires_grad_(False).to(dev) + unwrap(model).move_rope_table(torch.device(dev)) + deploy = deploy_schedule(DEPLOY_DENOISE_LIST) + log(f"1. 部署表 t={[round(float(x), 1) for x in deploy[2]]} σ={[round(float(x), 4) for x in deploy[1]]}") + + sc = torch.load(infer.SIDECAR, map_location="cpu", weights_only=False) + ws = np.array(sc["meta"]["walk_speed_px_s"], np.float64) + _assert_matches_parse_actions("right:1.0:21", ws) + fo, vel = infer.parse_actions("right:1.0:21", ws) + log(f"2. 指令递推 action_offsets(vel,21) 与 infer.parse_actions / frames_to_cells 逐位相同;" + f"frame_offset_px[80]=({fo[80, 0]:+.1f},{fo[80, 1]:+.1f}) ⇒ 期望背景位移 ({-fo[80, 0]:+.1f},{-fo[80, 1]:+.1f})") + N = 30 + vel_ext = extend_velocity(vel, N) + fo_ext, co_ext = action_offsets(vel_ext, N) + assert np.allclose(fo_ext[:81], fo), "延长之后前 81 帧必须与 21 cell 的结果完全一致" + off_ext_t = torch.tensor(co_ext, dtype=torch.float32).unsqueeze(0).to(dev) + ref = extend_offsets(torch.tensor(G.frames_to_cells(fo), dtype=torch.float32).unsqueeze(0).to(dev), + N - 1, mode="continue") + d = float((off_ext_t - ref).abs().max()) + log(f"3. 延长口径 action_offsets(continue) vs data.extend_offsets('continue') max|Δ| {d:.3e} px " + f"({N} cell,都是重复末段匀速)") + assert d < 1e-3, d + + b, c, lh, lw, L = 1, 48, 8, 10, 4 + z0 = torch.randn(b, c, 1, lh, lw, device=dev, dtype=torch.bfloat16) + ctx = torch.randn(b, G.CELLS, L, 4096, device=dev, dtype=torch.bfloat16) + ids = torch.zeros(b, G.CELLS, dtype=torch.int64, device=dev) + ctx_ext, ids_ext = extend_context(ctx, ids, N - 1, mode="hold") + lat = deploy_rollout(model, z0, ctx_ext, ids_ext, off_ext_t, N, deploy, + kv_window=20, sink_size=0, rope_cap=20, seed=0, log=lambda *a: None) + assert lat.shape == (b, c, N, lh, lw) and torch.isfinite(lat).all() + log(f"4. rollout {N} cell(窗口 20 ⇒ 驱逐 {max(0, N - 1 - 20)} 次)输出 {tuple(lat.shape)} 全部有限;" + f"|lat| 均值 {float(lat.float().abs().mean()):.4f}") + + off_par = window_offsets(off_ext_t[:, :G.CELLS], 0, G.CELLS - 1) + lat_p = deploy_parallel(model, z0, ctx, ids, off_par, deploy, seed=0, log=lambda *a: None) + assert lat_p.shape == (b, c, G.CELLS, lh, lw) and torch.isfinite(lat_p).all() + assert torch.equal(lat_p[:, :, 0:1], z0), "parallel 路径必须每步把 cell 0 写回首帧 latent" + log(f"5. parallel {G.CELLS} cell 输出 {tuple(lat_p.shape)} 全部有限、cell 0 == 首帧 latent;" + f"|lat| 均值 {float(lat_p.float().abs().mean()):.4f}") + + # 6. 用一段**已知平移**的合成画面把 measure() 的接线和符号约定钉死。 + # measure_displacement 的 sift 是**画面内容**在图像坐标里的位移;指令一侧比的是 + # −frame_offset_px(玩家往右走 ⇒ 背景往左挪),所以两者必须差一个负号。 + rng = np.random.default_rng(0) + pad = 200 + base = (rng.random((G.H + 2 * pad, G.W + 2 * pad)) * 255).astype(np.uint8) + d_content = np.array([6.0, -2.0]) # 每帧内容位移(px) + syn = np.stack([np.stack([base[pad - int(round(d_content[1] * k)): pad - int(round(d_content[1] * k)) + G.H, + pad - int(round(d_content[0] * k)): pad - int(round(d_content[0] * k)) + G.W]] * 3, + -1) for k in range(G.CELLS)], 0) + # 指令 = 内容位移的相反数 ⇒ 误差应当 ≈ 0 + fo_syn = np.stack([-d_content * k for k in range(G.CELLS)], 0) + res = measure(syn, fo_syn, chain=8) + log(f"6. 实测接线 帧0→{res['k']} 合成平移真值 {(d_content * res['k']).tolist()} · " + f"sift={infer.fmt(res['measured']['sift'])}({res['measured']['sift_source']}," + f"{res['measured']['sift_direct_inliers']} 内点)· 指令 {infer.fmt(res['expected_bg_shift'])} · " + f"误差 {infer.fmt(res['error_px'])} ⇒ |误差| {res['error_norm_px']:.3f} px") + assert res["error_norm_px"] < 1.0, res + log("self_test OK") + + +# ---------------------------------------------------------------------------- +# 主流程 +# ---------------------------------------------------------------------------- + +def parse_args(argv=None): + ap = argparse.ArgumentParser(description="蒸馏产物的部署路径评测(少步 / AR rollout + 背景位移实测)") + ap.add_argument("--ckpt", default=None, help="蒸馏产物 safetensors;部署权重是 ema/,不是 dits/") + ap.add_argument("--sweep", default=None, + help="glob(如 '.../ema/ema_step*.safetensors'):按 step 依次评测。" + "只加载一次 10 GB pipeline,之后只换 DiT 权重") + ap.add_argument("--allow_raw_student", action="store_true", + help="放行路径里带 /dits/ 的 checkpoint。dits/ 只为续训存在,拿它上线是静默降质(risk 12)") + ap.add_argument("--mode", choices=["rollout", "parallel"], default="rollout", + help="rollout:滑窗 KV 逐 cell 自回归(stage3 的部署路径)。" + "parallel:整片块因果一次去噪(stage2 EMA 的部署路径)") + ap.add_argument("--causal", action=argparse.BooleanOptionalAction, default=True, + help="蒸馏产物都是因果的。评双向 SFT 基线时用 --no-causal --mode parallel") + ap.add_argument("--denoise_list", default=",".join(str(int(x)) for x in DEPLOY_DENOISE_LIST), + help="部署采样表(原始 t 值,严格降序)。默认就是用户拍板的 4 步 1000,750,500,250;" + "stage2 EMA 单独部署时用 1000,250") + ap.add_argument("--cells", type=int, default=G.CELLS, + help="生成多少个 latent cell。>21 只在 --mode rollout 下有意义(那正是 stage3 练的东西)") + ap.add_argument("--kv_window", type=int, default=20) + ap.add_argument("--sink_size", type=int, default=0) + ap.add_argument("--rope_cap", type=int, default=20) + ap.add_argument("--sink_anchor", choices=("absolute", "window"), default="absolute", + help="sink_size>0 时世界坐标锚点:absolute = cell 0(当前 RoPE 位无界增长);window = 滑动窗最老 cell," + "sink 段偏移钉 0(内容可见、RoPE 在包络内)。stage3 ckpt 元数据里有这个键时必须一致") + ap.add_argument("--allow_geometry_mismatch", action="store_true", + help="ckpt 元数据里的训练几何(stage3 do_save 写的 kv_window/sink_size/rope_cap)与命令行" + "不等时也跑。默认拒绝:stage3 学生只在训练几何下才是分布内的(GEO-1)," + "sink 3 / w17 之类只作显式 A/B,不作 ckpt 选择轴。stage1/2 的 ckpt 没有这些键,不受限") + ap.add_argument("--ref_steps", type=int, default=0, + help=">0 ⇒ 额外跑一遍 infer.sample 的 N 步扩散采样作参照(PORT_SPEC 的 S9,一般填 50)") + ap.add_argument("--sampler", choices=["auto", "flowmap", "renoise", "euler"], default="auto", + help="auto(默认)= 按 checkpoint 自己判(832 键 + delta_embedding ⇒ flowmap)。" + "两者接错都不会报错、只会安静地产出另一个模型的结果,所以显式指定时与权重不符会被拒。" + "euler = 非 flow-map 权重 + --mode rollout 时,每个 cell 走 FlowMatchScheduler 的 " + "Euler ODE(--euler_steps / --euler_shift,与 infer.sample 同一条 sched.step),不重新加噪") + ap.add_argument("--euler_steps", type=int, default=16, help="--sampler euler 的步数(longhorizon/README 用 16)") + ap.add_argument("--euler_shift", type=float, default=5.0, help="--sampler euler 的 shift(infer.sample 用 5)") + ap.add_argument("--num_inference_steps", type=int, default=4, + help="flow-map 采样的步数 N(--sampler flowmap/auto 命中时才用)。" + "同一份权重 4 步和 24 步都能采 —— 这正是 any-step 的主张,验收就看这两个的一致性。" + "renoise 路径不看这个参数,它用 --denoise_list") + + ap.add_argument("--replay", default=None, help="clip_id:用 sidecar 真值偏移 + 该 clip 首帧 + 原 prompt") + ap.add_argument("--first_frame", default=None, help="png / mp4 / clip_id") + ap.add_argument("--scene", default=None) + ap.add_argument("--trigger", default=None, help="burn:::(或 cut:),start < 21:训练语料口径的转场") + ap.add_argument("--rotate", type=float, default=0.0, + help="相机每 cell 旋转多少**度**(累计;cell 0 恒为 0)。一切表达在当前相机系里:当前帧格点" + "保持轴对齐,历史 token 按 φ_j−φ_k 转进来。0 = 不转(逐位走老路)") + ap.add_argument("--zoom", type=float, default=0.0, + help="每 cell 的**位置缩放**率(判决实验,只接并行路径):位置乘 (1+rate)^k。" + "模型若把位置场的尺度读成视野大小,内容就会按 1/(1+rate)^k 缩小") + ap.add_argument("--rotate_mask", choices=sorted(ROT_MASK), default="rot", + help="旋转时 known 掩码怎么算:rot = 跟着转的斜多边形(几何正确,四角变 new);" + "plain = 老的轴对齐掩码(消融:看画面缩小/摆动是不是掩码通道闹的)") + ap.add_argument("--rotate_spec", default=None, + help='分段角速度 "2:20,0:20,-2:20"(每格度数:格数,铺不满就把末段续到底),与 --rotate 二选一') + ap.add_argument("--switches", default=None, + help='多次场景切换脚本 "burn:B:10:2,burn:C:20:2,cut:D:30:2"(从 --scene 起,任意 cell,整条 rollout ' + '的逐 cell 串直接生成;与 --trigger/--late_trigger 互斥)') + ap.add_argument("--late_trigger", default=None, + help="burn:::(或 cut:),start ≥ 21:rollout 视野外再切一次场景(cell 20 的场景 → C)") + ap.add_argument("--actions", default=None, + help='动作脚本,如 "right:1.0:21"。cell 合计 == --cells 时铺满整条 rollout(如 loop_spec.txt 的 41 cell),' + '否则必须正好 21 个 cell、cell ≥21 按末段速度续走') + ap.add_argument("--text_table", default=None, help="默认用 arope 臂的纯场景表") + ap.add_argument("--chain", type=int, default=16, help="SIFT 链式测量的分段长度") + ap.add_argument("--tiled", action="store_true", help="VAE 分块解码(长 rollout 显存吃紧时用)") + ap.add_argument("--seed", type=int, default=0) + ap.add_argument("--device", default="cuda") + ap.add_argument("--out", default=None, help="输出 mp4(同名 _frame0.png / .json 一并写出)") + ap.add_argument("--out_dir", default=None, help="--sweep 时的输出目录") + ap.add_argument("--save_video", action=argparse.BooleanOptionalAction, default=True, + help="--sweep 扫很多个 ckpt 时可以 --no-save_video 只留 json") + ap.add_argument("--gpu_headroom_gb", type=float, default=40.0, + help="目标卡至少要有这么多空闲显存才肯跑(权重 9.3 GB + rollout + VAE 解码)") + ap.add_argument("--allow_busy_gpu", action="store_true", + help="卡上有别的任务时也跑;会把本进程的显存**硬顶**在空闲量减 8 GB," + "撑死只炸自己,不会把同卡的训练挤 OOM") + ap.add_argument("--self_test", action="store_true", help="tiny 模型自检,不碰真权重、不需要 VAE") + args = ap.parse_args(argv) + if args.self_test: + return args + if not (args.ckpt or args.sweep): + raise SystemExit("要么 --ckpt,要么 --sweep") + if args.sweep and not args.out_dir: + raise SystemExit("--sweep 需要 --out_dir") + if args.ckpt and not args.out: + raise SystemExit("--ckpt 需要 --out") + if args.cells < 2: + raise SystemExit(f"--cells 至少 2,得到 {args.cells}") + if args.cells != G.CELLS and args.mode != "rollout": + raise SystemExit(f"--cells {args.cells} != {G.CELLS} 只在 --mode rollout 下成立" + f"(parallel 是整片一次去噪,长度由文本/偏移的 cell 数决定," + f"超出 21 就没有真实训练分布可言)") + if args.rope_cap != args.sink_size + args.kv_window: + raise SystemExit(f"--rope_cap({args.rope_cap}) 必须 == sink({args.sink_size}) + window({args.kv_window})") + args.denoise = [float(t) for t in args.denoise_list.split(",") if t.strip()] + args.euler_sched = None + if args.sampler == "euler": + if args.mode != "rollout": + raise SystemExit("--sampler euler 只实现了 --mode rollout(parallel 请用 --ref_steps 走 infer.sample)") + from diffsynth.diffusion.flow_match import FlowMatchScheduler + args.euler_sched = FlowMatchScheduler("Wan") + args.euler_sched.set_timesteps(args.euler_steps, shift=args.euler_shift) + return args + + +def _ckpt_list(args) -> list[str]: + paths = sorted(glob.glob(args.sweep), key=lambda p: int("".join(ch for ch in os.path.basename(p) + if ch.isdigit()) or 0)) if args.sweep \ + else [args.ckpt] + if not paths: + raise SystemExit(f"--sweep 没匹配到任何文件:{args.sweep}") + for p in paths: + if "/dits/" in p.replace(os.sep, "/") and not args.allow_raw_student: + raise SystemExit( + f"拒绝评测 {p}:dits/ 是续训用的原始学生权重,部署权重是 ema/。\n" + " 拿 dits/ 上线不会报错,只会静默降质(PORT_SPEC risk 12)。" + "确实想看原始学生就加 --allow_raw_student。") + if not os.path.isfile(p): + raise SystemExit(f"checkpoint 不存在:{p}") + return paths + + +def _require_gpu_headroom(device: str, need_gb: float, allow_busy: bool, log=print) -> None: + """评测默认**不许**跟正在跑的训练抢同一张卡。 + + 为什么:本脚本要 9.3 GB 权重 + rollout(实测 N=26 峰值 12.6 GB)+ VAE 解码 81~101 帧, + 几十 GB 的量级;蒸馏训练是 6~40 h 的长任务,被一次评测挤 OOM 的代价远大于等它跑完。 + 而文件头的示例命令写的正是 `CUDA_VISIBLE_DEVICES=0` —— 那恰好是训练在用的卡。 + + 用 nvidia-smi 查(不是 torch.cuda.mem_get_info):后者要先在目标卡上建 CUDA 上下文, + 光是"看一眼"就先占几百 MB。查不到就拒绝启动,与 distill/common.sh 的 require_idle_gpus 同一套 fail-closed 口径。 + --allow_busy_gpu 时不再拒绝,但把本进程钉死在 (空闲 − 8 GB):共享可以,但必须是**有界**的共享。 + """ + if not str(device).startswith("cuda") or not torch.cuda.is_available(): + return + idx = torch.device(device).index + if idx is None: # "cuda" ⇒ 当前默认卡(CUDA_VISIBLE_DEVICES 里的第 0 张) + idx = 0 + phys = os.environ.get("CUDA_VISIBLE_DEVICES") + phys = phys.split(",")[idx].strip() if phys else str(idx) + try: + out = subprocess.run(["nvidia-smi", "-i", phys, "--query-gpu=memory.used,memory.total", + "--format=csv,noheader,nounits"], capture_output=True, text=True, + timeout=30, check=True).stdout.strip().splitlines() + used, total = (float(x) for x in out[0].split(",")) + except Exception as e: # 驱动半死 / 编号非法 / 超时 —— 查不到就不跑 + raise SystemExit(f"ABORT: 查不到 GPU {phys} 的占用({type(e).__name__}: {e})。" + "查不到就不许启动;要绕过请显式 --device cpu 或 --allow_busy_gpu。") + free = (total - used) / 1024.0 # MiB -> GiB + log(f"[gpu] 物理 GPU {phys}:已用 {used / 1024:.1f} / {total / 1024:.0f} GiB,空闲 {free:.1f} GiB") + if used / 1024.0 > 1.0 and not allow_busy: + raise SystemExit( + f"ABORT: GPU {phys} 上已经有 {used / 1024:.1f} GiB 被占用 —— 多半是蒸馏训练还在跑。" + f"评测要 ~{need_gb:.0f} GiB,别去挤它。等它跑完,或换一张空卡" + f"(CUDA_VISIBLE_DEVICES=<空闲卡>,**不要**动别人的卡)," + f"或 --allow_busy_gpu(会把本进程硬顶在 {max(free - 8, 4):.0f} GiB,只炸自己)。") + if free < need_gb and not allow_busy: + raise SystemExit(f"ABORT: GPU {phys} 只剩 {free:.1f} GiB 空闲 < --gpu_headroom_gb {need_gb:.0f}。") + if allow_busy: + cap = max(free - 8.0, 4.0) # 留 8 GiB 给同卡的训练做碎片/峰值余量 + torch.cuda.set_per_process_memory_fraction(min(cap / (total / 1024.0), 0.95), idx) + log(f"[gpu] --allow_busy_gpu:本进程显存硬顶 {cap:.0f} GiB(超了只 OOM 我自己)") + + +def main(argv=None): + args = parse_args(argv) + if args.self_test: + self_test(device=args.device) + return 0 + paths = _ckpt_list(args) + for p in paths: # 只读 safetensors 头:训练几何 vs 命令行(GEO-1),权重还没碰 + _check_ckpt_geometry(p, args) + # ★ 在加载 10 GB pipeline 之前先问一句这张卡是不是别人的(fail-closed,见函数注释) + _require_gpu_headroom(args.device, args.gpu_headroom_gb, args.allow_busy_gpu) + deploy = deploy_schedule(args.denoise) + print(f"部署表 {args.denoise} ⇒ 网格 t={[round(float(x), 1) for x in deploy[2]]} " + f"σ={[round(float(x), 4) for x in deploy[1]]} · mode={args.mode} · cells={args.cells}") + + # ---- 采样器分流:按 **checkpoint 本身**(832 键 + flowmap metadata)决定,不看命令行心情 ---- + # 拿 renoise 采样器去采 flow-map 权重不会报错,只会安静地产出另一个模型的结果 —— + # 所以默认 auto 从权重里读,而不是让调用方记得加旗标。 + is_fm = [runlib.is_flowmap_ckpt(p) for p in paths] + if args.sampler == "auto": + use_flowmap = is_fm[0] + else: + use_flowmap = (args.sampler == "flowmap") # renoise / euler 都是非 flow-map 权重的采样器 + if use_flowmap != is_fm[0]: + raise SystemExit( + f"--sampler {args.sampler} 与 checkpoint 不符:{paths[0]} " + f"{'是' if is_fm[0] else '不是'} flow-map 权重(832 键 + delta_embedding)。\n" + f" 两者接错都不会报错,只会安静地产出另一个模型的结果,所以这里直接拒绝。") + if len(set(is_fm)) > 1: + raise SystemExit("--sweep 里混了 flow-map 与非 flow-map 的 checkpoint;分开扫。") + + from safetensors.torch import load_file + t0 = time.time() + if use_flowmap: + # 832 键喂不进 load_models 的 strict 加载(它只认 827),所以:基座 → 装壳 → 灌权重。 + # 顺序不能反:install_flowmap 会把读出层零初始化,装完再 load 才拿得到训出来的 delta。 + meta = _ckpt_metadata(paths[0]) + pipe, dit, _ = infer.load_models(None, True, args.device, need_vae=True, arm="arope") + model = AropeDiT(dit=dit, mask_channel=True, causal=args.causal) + unwrap(model).install_flowmap(form=meta.get("flowmap_form", "residual"), + gate=float(meta.get("delta_gate", 1.0))) + unwrap(model).dit.load_state_dict(load_file(paths[0]), strict=True) + has_mask = True + else: + pipe, dit, _ = infer.load_models(paths[0], None, args.device, need_vae=True, arm="arope") + has_mask = hasattr(dit, "arope_mask_embedding") + model = AropeDiT(dit=dit, mask_channel=has_mask, causal=args.causal) + model.eval().requires_grad_(False) + unwrap(model).move_rope_table(torch.device(args.device)) + sig_any = fm.anystep_sigmas(args.num_inference_steps) if use_flowmap else None + print(f"模型加载 {time.time() - t0:.0f}s · causal={args.causal} · mask_channel={has_mask} · " + f"采样器={'flowmap' if use_flowmap else ('euler' if args.euler_sched is not None else 'renoise')}" + + (f" · Euler {args.euler_steps} 步 shift {args.euler_shift} t={[round(float(t)) for t in args.euler_sched.timesteps]}" + if args.euler_sched is not None else "") + + (f" · N={args.num_inference_steps} 步 σ={[round(float(x), 4) for x in sig_any]}" + if use_flowmap else "")) + + table_key = "arope" + enc = infer.TextEncoder(args.text_table or infer.TEXT_TABLE[table_key], args.device) + cond = build_condition(args, enc, args.device) + fo = cond["frame_off"] + print(f"指令:{cond['cells']} cell · frame_offset_px[末帧]=({fo[-1, 0]:+.1f},{fo[-1, 1]:+.1f}) " + f"⇒ 期望背景位移 ({-fo[-1, 0]:+.1f},{-fo[-1, 1]:+.1f})") + img = infer.load_first_frame(cond["first_spec"]) + z0 = infer.encode_first_frame(pipe, img, tiled=args.tiled) + + from safetensors.torch import load_file + rows = [] + for p in paths: + if p != paths[0]: + # 只换 DiT 权重,不重建 10 GB pipeline(sweep 的全部意义) + unwrap(model).dit.load_state_dict(load_file(p), strict=True) + step = "".join(ch for ch in os.path.basename(p) if ch.isdigit()) + stem = (os.path.splitext(args.out)[0] if args.out + else os.path.join(args.out_dir, os.path.splitext(os.path.basename(p))[0])) + os.makedirs(os.path.dirname(os.path.abspath(stem)), exist_ok=True) + print(f"\n=== {os.path.basename(p)} ===") + torch.cuda.reset_peak_memory_stats() if args.device.startswith("cuda") else None + res, frames, lat = run_one(model, pipe, z0, cond, args, deploy, sigmas=sig_any) + info = {"ckpt": p, "step": int(step) if step else None, "mode": args.mode, + "sampler": ("flowmap" if use_flowmap else ("euler" if args.euler_sched is not None else "renoise")), + "euler": ({"steps": args.euler_steps, "shift": args.euler_shift} if args.euler_sched is not None else None), + "num_inference_steps": (args.num_inference_steps if use_flowmap else None), + "anystep_sigmas": ([round(float(x), 6) for x in sig_any] if use_flowmap else None), + "denoise_list": (None if use_flowmap else args.denoise), + "cells": cond["cells"], "seed": args.seed, + "kv_window": args.kv_window, "sink_size": args.sink_size, "rope_cap": args.rope_cap, + "prompts": sorted(set(cond["prompts"])), "walk_speed_px_s": cond["walk_speed"], + "frame_offset_px_last": fo[-1].tolist(), **res} + if args.device.startswith("cuda"): + info["peak_mem_gb"] = torch.cuda.max_memory_allocated() / 1e9 + m = res["measured"] + print(f"实测位移 帧0→{res['k']}:sift={infer.fmt(m['sift'])}({m['sift_source']})" + f" · 指令 {infer.fmt(res['expected_bg_shift'])} · 误差 {infer.fmt(res['error_px'])}" + + (f" · |误差| {res['error_norm_px']:.1f} px = {100 * res['error_rel']:.1f}%" + if res.get("error_rel") is not None else "")) + + if args.ref_steps > 0: + # PORT_SPEC 的 S9:同一条件下的 N 步扩散参照(infer.sample 的 Euler 步,不是少步表) + lat_ref = infer.sample(unwrap(model).dit, z0, cond["context"][:, :G.CELLS], + cond["context_ids"][:, :G.CELLS], + cond["off_par"][:, :G.CELLS], + make_mask_input(cond["off_par"][:, :G.CELLS], z0.shape[3], z0.shape[4]), + steps=args.ref_steps, shift=5.0, cfg=1.0, seed=args.seed) + fr_ref = infer.decode_video(pipe, lat_ref, tiled=args.tiled) + info["ref"] = {"steps": args.ref_steps, **measure(fr_ref, fo[:len(fr_ref)], chain=args.chain)} + rm = info["ref"]["measured"] + print(f"{args.ref_steps} 步参照:sift={infer.fmt(rm['sift'])} · " + f"误差 {infer.fmt(info['ref']['error_px'])}") + + if args.replay: + gt = infer.read_frames(infer.find_clip_mp4(args.replay)) + n = min(len(gt), len(frames)) + per = [infer.psnr(frames[i], gt[i]) for i in range(n)] + info["psnr_frame0"] = per[0] + info["psnr_mean_rest"] = float(np.mean(per[1:])) if n > 1 else None + info["gt_measured"] = infer.measure_displacement(infer.to_gray(gt[:n]), k=n - 1, chain=args.chain) + print(f"与 GT 比:帧 0 PSNR {per[0]:.1f} dB · 其余平均 {info['psnr_mean_rest']:.1f} dB · " + f"GT 实测 sift={infer.fmt(info['gt_measured']['sift'])}") + + if args.save_video: + from PIL import Image + from diffsynth.utils.data import save_video + save_video(list(frames), stem + ".mp4", fps=int(G.FPS), quality=9) + Image.fromarray(img).save(stem + "_frame0.png") + info["out"] = stem + ".mp4" + with open(stem + ".json", "w", encoding="utf-8") as fh: + json.dump(info, fh, ensure_ascii=False, indent=1, default=float) + rows.append(info) + del frames, lat + + if len(rows) > 1: + print("\n=== sweep 汇总(按 |误差| 从小到大;部署权重就从这里挑)===") + ok = [r for r in rows if r.get("error_norm_px") is not None] + for r in sorted(ok, key=lambda r: r["error_norm_px"]): + print(f" step {str(r['step']):>6} |误差| {r['error_norm_px']:7.1f} px " + f"({100 * r['error_rel']:5.1f}%) sift={infer.fmt(r['measured']['sift'])} " + f"{os.path.basename(r['ckpt'])}") + for r in rows: + if r.get("error_norm_px") is None: + print(f" step {str(r['step']):>6} 实测失败(SIFT 匹配不上;画面可能已经崩了) " + f"{os.path.basename(r['ckpt'])}") + csv = os.path.join(args.out_dir, "sweep.csv") + with open(csv, "w", encoding="utf-8") as fh: + fh.write("step,ckpt,err_px,err_rel,sift_dx,sift_dy,exp_dx,exp_dy,sample_sec\n") + for r in rows: + s = r["measured"]["sift"] or [float("nan")] * 2 + e = r["expected_bg_shift"] + fh.write(f"{r['step']},{os.path.basename(r['ckpt'])}," + f"{r.get('error_norm_px', float('nan'))},{r.get('error_rel', float('nan'))}," + f"{s[0]},{s[1]},{e[0]},{e[1]},{r['sample_sec']:.1f}\n") + print(f"汇总写到 {csv}") + return 0 + + +if __name__ == "__main__": + sys.exit(main()) diff --git a/backup_2026-09-14/code/distill/eval/sgf_parity_probe.py b/backup_2026-09-14/code/distill/eval/sgf_parity_probe.py new file mode 100644 index 0000000000000000000000000000000000000000..e4a410465da97ff85d8ba4359eb8b4ae7a8b82dd --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/sgf_parity_probe.py @@ -0,0 +1,112 @@ +"""SGF 两趟 replay 的几何等价性自检 —— 上 SGF 之前必须过的那一关。 + +SGF 的 `self_gradient_forcing_match_context` 要求 pass 2 喂的上下文与 pass 1 **真正提交进 +KV 缓存**的东西一致。在 ARoPE 下这不是"传同一个张量"就完事的: + pass 1 每个 cell 锚在**自己窗口里最老那一格**(frame_cond → window_offsets_for_frame) + pass 2 整片并行、first_frame_cond=True、锚在**片自己的 cell 0** +两者只在整窗平移上不同,而 RoPE 是相对编码、平移不改分数 —— 但这个论证只在 +**rollout 长度 == 打分片长**(缓存跨度与并行片完全重合)时成立。 + +所以判据是数值的:pass 1 流式在退出档算出的 x0,与 pass 2 并行 TF 在同一档算出的 x0, +逐 cell 比对。对不上就说明几何/掩码分叉了,这时候去训练只会得到"loss 照跑、就是不涨"。 + + python distill/eval/sgf_parity_probe.py --ckpt <832 键 flow map> [--cells 21] [--steps 4] +""" +from __future__ import annotations + +import argparse +import os +import sys + +import numpy as np +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +sys.path.insert(0, ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from actionrope import geometry as G # noqa: E402 +from actionrope import infer # noqa: E402 +from actionrope.prompts import NULL_PROMPT # noqa: E402 +from distill import flowmap as fm # noqa: E402 +from distill import onpolicy as op # noqa: E402 +from distill.arope_dit import AropeDiT, unwrap # noqa: E402 +from distill.data import make_mask_input, window_context, window_offsets # noqa: E402 +from distill.eval.rollout_eval import _ckpt_metadata # noqa: E402 +from distill.stage3_dmd.dmd_arope import frame_cond # noqa: E402 + + +def main(argv=None): + ap = argparse.ArgumentParser(description="SGF 两趟 replay 的几何等价性自检") + ap.add_argument("--ckpt", required=True) + ap.add_argument("--cells", type=int, default=21, help="1+K;必须与训练时的片长一致") + ap.add_argument("--steps", type=int, default=4) + ap.add_argument("--kv_window", type=int, default=20) + ap.add_argument("--sink_size", type=int, default=0) + ap.add_argument("--rope_cap", type=int, default=20) + ap.add_argument("--device", default="cuda") + ap.add_argument("--tol", type=float, default=0.05, help="逐 cell 相对误差上限") + args = ap.parse_args(argv) + + from safetensors.torch import load_file + meta = _ckpt_metadata(args.ckpt) + pipe, dit, _ = infer.load_models(None, True, args.device, need_vae=False, arm="arope") + model = AropeDiT(dit=dit, mask_channel=True, causal=True) + unwrap(model).install_flowmap(form=meta.get("flowmap_form", "residual"), + gate=float(meta.get("delta_gate", 1.0))) + unwrap(model).dit.load_state_dict(load_file(args.ckpt), strict=True) + model.eval().requires_grad_(False) + dev = torch.device(args.device) + unwrap(model).move_rope_table(dev) + + enc = infer.TextEncoder(infer.TEXT_TABLE["arope"], args.device) + ctx, ids = infer.build_context(enc, [NULL_PROMPT] * G.CELLS, args.device, per_cell=True) + N = args.cells - 1 + ctx_ext = ctx[:, :1].repeat(1, args.cells, 1, 1) + ids_ext = ids[:, :1].repeat(1, args.cells) + + # 一条往右匀速的轨迹(内容不重要,重要的是每个 cell 的世界坐标都不同) + sc = torch.load(infer.SIDECAR, map_location="cpu", weights_only=False) + ws = np.array(sc["meta"]["walk_speed_px_s"], np.float64) + cell_off = np.stack([np.array([ws[0], 0.0]) * k * 4 / G.FPS for k in range(args.cells)], 0) + off_ext = torch.tensor(cell_off, dtype=torch.float32, device=dev).unsqueeze(0) + + g = torch.Generator("cpu").manual_seed(0) + z0 = torch.randn(1, 48, 1, G.LAT_H, G.LAT_W, generator=g).to(dev, torch.bfloat16) + sig = fm.anystep_sigmas(args.steps) + + print(f"片长 {args.cells} cell · N={args.steps} 步 · kv_window={args.kv_window} " + f"sink={args.sink_size} · σ={[round(float(x),4) for x in sig]}") + ok_all = True + for exit_idx in range(args.steps): + with torch.autocast("cuda", torch.bfloat16, enabled=(dev.type == "cuda")), torch.no_grad(): + noisy, x0_cache = op.sgf_rollout( + model, z0, ctx_ext, ids_ext, off_ext, N, sig, exit_idx, + kv_window=args.kv_window, rope_cap=args.rope_cap, sink_size=args.sink_size, + gen=torch.Generator("cpu").manual_seed(1), unwrap_fn=unwrap, frame_cond_fn=frame_cond) + off_t = window_offsets(off_ext, 0, N) + ctx_t, ids_t = window_context(ctx_ext, ids_ext, 0, N) + cond = dict(context=ctx_t, context_ids=ids_t, offset_px=off_t, + mask_input=make_mask_input(off_t, G.LAT_H, G.LAT_W), first_frame_cond=True) + x0_p2 = op.sgf_replay(model, noisy, x0_cache, cond, sig, exit_idx, context_noise=0.0) + + a = x0_cache[:, :, 1:].float() + b = x0_p2[:, :, 1:].float() + # 逐 cell 相对 L2:把 (C,H,W) 摊平再取范数(torch.norm 的 dim 只吃 2-tuple) + af = a[0].permute(1, 0, 2, 3).flatten(1) # [cells, C*H*W] + bf = b[0].permute(1, 0, 2, 3).flatten(1) + rel = (af - bf).norm(dim=1) / (af.norm(dim=1) + 1e-9) + ok = bool((rel < args.tol).all()) + ok_all &= ok + print(f" exit_idx={exit_idx} (σ {float(sig[exit_idx]):.4f}→{float(sig[exit_idx+1]):.4f}) " + f"逐 cell 相对误差 中位 {rel.median():.4f} 最大 {rel.max():.4f} " + f"(cell {int(rel.argmax())+1}) {'✓' if ok else '✗ 分叉'}") + print("\n" + ("通过:pass 1 的流式几何与 pass 2 的并行几何一致,match_context 成立。" + if ok_all else + "★ 未通过:两趟看到的不是同一段历史。别在这个状态下训 SGF —— " + "loss 会照跑,模型学到的却是另一条上下文。")) + return 0 if ok_all else 1 + + +if __name__ == "__main__": + raise SystemExit(main()) diff --git a/backup_2026-09-14/code/distill/eval/sweep8.sh b/backup_2026-09-14/code/distill/eval/sweep8.sh new file mode 100644 index 0000000000000000000000000000000000000000..8381e54e35261516b88bda056ce3a06a2d0dcf86 --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/sweep8.sh @@ -0,0 +1,73 @@ +#!/usr/bin/env bash +# stage2-flowmap 的里程碑扫描:把 (ckpt × 步数) 的组合按卡分片,8 张卡并行。 +# +# rollout_eval.py 自己是单卡的(一次只加载一份 10 GB pipeline),所以并行靠分片而不是靠它。 +# 每个组合一个独立进程、钉死一张卡;重复加载 pipeline 的 11 s 相对 rollout 的 24~82 s 可以忽略。 +# +# bash distill/eval/sweep8.sh [OUTDIR] +# +# 判据两个(都不是 loss —— flow map 的 loss 是自举目标,平的): +# 净漂移 px 绕一圈回到起点的误差,指令是 0。衡量动作服从性。 +# 4 vs 24 同一份权重两个步数的一致性。这是 any-step 主张本身。 +# +# 几何:默认**不传** --sink_size/--kv_window/--rope_cap ⇒ 用 rollout_eval.py 的默认 sink 0 / window 20 / +# cap 20 = stage3 的训练几何(distill/stage3_dmd/run.sh:57-59)。stage3 学生只在训练几何下才是 +# 分布内的(GEO-1:sink 3 / w17 与它只在 k≤20 的保留集相同,之后的 h/w RoPE 与掩码通道是训练里 +# 从未出现过的输入,拿它挑 EMA 只是在比 OOD 外推)。sink 3 / w17 只作**显式 A/B**,走环境变量: +# SINK=3 KV_WINDOW=17 ROPE_CAP=20 bash distill/eval/sweep8.sh +# rollout_eval.py 会拿 stage3 ckpt 元数据里的训练几何核对命令行,不等就拒(--allow_geometry_mismatch 放行)。 +# 动作脚本:loop_spec.txt 是丢失的原始脚本的**重建**——41 cell 的闭环,净期望背景位移恰为 0: +# idle 放在 cell 0(那是首帧锚点,cell 0 的速度永远不生效),之后 右/下/左/上 各 10 cell = 各 40 帧, +# 横纵各自抵消。若把 idle 放末尾,right 段只剩 9 个生效 cell,净偏 −walk_speed_x/4 ≈ −17 px。 +set -euo pipefail +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +ROOT="$(cd "$HERE/../.." && pwd)" +OUTDIR="${1:-$ROOT/outputs/distill/eval/sweep_stage2fm}" +EMA_DIR="${EMA_DIR:-$ROOT/outputs/distill/stage2_flowmap/ema}" +SPEC_FILE="${SPEC_FILE:-$ROOT/distill/eval/loop_spec.txt}" +FIRST_FRAME="${FIRST_FRAME:-$ROOT/data/eval/eybx_bg_50/19_medieval_castle.png}" +STEPS_LIST="${STEPS_LIST:-4 24}" +CELLS="${CELLS:-41}" +NGPU="${NGPU:-8}" + +export PYTHONPATH="$ROOT" DIFFSYNTH_SKIP_DOWNLOAD=True CUDA_DEVICE_ORDER=PCI_BUS_ID +PY="$ROOT/.venv/bin/python" +mkdir -p "$OUTDIR" +[ -f "$SPEC_FILE" ] || { echo "ABORT: 没有动作脚本 $SPEC_FILE"; exit 1; } +SPEC="$(cat "$SPEC_FILE")" +# 几何旗标只在环境变量显式给出时才追加;默认一个都不传 ⇒ rollout_eval.py 的默认 sink 0 / window 20 / +# cap 20 = stage3 训练几何。三者必须满足 rope_cap == sink + window(rollout_eval 会核)。 +GEO=() +if [ -n "${SINK:-}" ]; then GEO+=(--sink_size "$SINK"); fi +if [ -n "${KV_WINDOW:-}" ]; then GEO+=(--kv_window "$KV_WINDOW"); fi +if [ -n "${ROPE_CAP:-}" ]; then GEO+=(--rope_cap "$ROPE_CAP"); fi + +# 先确认这 8 张卡是空的 —— 与 common.sh 同一套 fail-closed 口径(这里不 source 它,因为 +# rollout_eval 是单卡工具、不走 accelerate;但"别人在用就别抢"这条规矩一样适用)。 +busy="$(nvidia-smi -i "$(seq -s, 0 $((NGPU-1)))" --query-gpu=index,memory.used \ + --format=csv,noheader,nounits 2>&1)" || { echo "ABORT: nvidia-smi 查询失败:$busy"; exit 1; } +echo "$busy" | awk -F', *' '$2>500 {print " GPU"$1"="$2"MiB"; f=1} END{exit f+0}' || { + echo "ABORT: 上面这些卡上有占用(>500 MiB)。别抢别人的卡。"; exit 1; } +echo "[guard] GPU 0-$((NGPU-1)) 空闲" + +jobs_list=() +for ck in $(ls "$EMA_DIR"/ema_step*.safetensors | sort -t_ -k3 -n); do + for n in $STEPS_LIST; do jobs_list+=("$ck|$n"); done +done +echo "[sweep] ${#jobs_list[@]} 个组合 → $NGPU 张卡,输出 $OUTDIR" + +i=0 +for j in "${jobs_list[@]}"; do + ck="${j%|*}"; n="${j#*|}" + gpu=$(( i % NGPU )); i=$(( i + 1 )) + tag="$(basename "$ck" .safetensors)_n${n}" + CUDA_VISIBLE_DEVICES=$gpu nohup "$PY" "$HERE/rollout_eval.py" \ + --ckpt "$ck" --mode rollout --cells "$CELLS" "${GEO[@]}" \ + --num_inference_steps "$n" --actions "$SPEC" \ + --first_frame "$FIRST_FRAME" --tiled --no-save_video \ + --out "$OUTDIR/$tag.mp4" > "$OUTDIR/$tag.log" 2>&1 & + # 每张卡同时最多一个(一个进程 ~17 GB,同卡叠两个也放得下,但会互相拖慢且不好读数) + if (( i % NGPU == 0 )); then wait; fi +done +wait +echo "[sweep] 全部完成" diff --git a/backup_2026-09-14/code/distill/eval/sweep_photodrift.sh b/backup_2026-09-14/code/distill/eval/sweep_photodrift.sh new file mode 100644 index 0000000000000000000000000000000000000000..e601d982a849e92b9214fe6744e5a6fbdfe1a178 --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/sweep_photodrift.sh @@ -0,0 +1,46 @@ +#!/usr/bin/env bash +# stage3 里程碑扫描:把一个 run 的所有 ema_step*.safetensors 按卡分片,每张卡跑一个 +# 41-cell rollout,汇总成一张逐 cell 的 std/mean 表。 +# +# bash distill/eval/sweep_photodrift.sh [steps] [ngpu] +# +# 为什么判据是 std/mean 而不是 loss:DMD 的 loss 按构造就没有数值意义(它只是把预先算好的 +# grad 塞进 autograd 的载体),flow-map 的 loss 是自举目标、是平的。stage3 的失败模式是 +# **光度漂移被自回归递推放大**,只在长 rollout 上显形 —— 所以只能这么量。 +# +# 基线(stage2-flowmap ema_step7500,同样 41 cell / N=4): +# std 39.4 37.9 37.8 38.9 36.9 40.4 39.1 28.9 +# mean 60.7 57.2 56.5 55.4 54.5 51.3 63.5 42.9 净漂移 9.3 px +# 及格 = 不比它差;成功 = 净漂移 < 9.3 px。 +# ⚠ 基线是旧几何(sink 3 / w17)+ 原始 loop spec 下量的;现默认训练几何(sink 0 / w20)+ 重建 loop_spec.txt, +# stage2 跑完后重测 stage2 EMA 并更新上面 4 行(GEO-1)。 +set -euo pipefail +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +ROOT="$(cd "$HERE/../.." && pwd)" +RUN="${1:?用法: sweep_photodrift.sh [steps] [ngpu]}" +N="${2:-4}"; NGPU="${3:-8}" +# ★ 并发上限不是卡数:每个 rollout_eval 进程要先把 10 GB 权重读进**宿主内存**再上卡, +# 8 个同时起会打出瞬时 RAM 尖峰,实测被 OOM killer 全部收走(4 个输出文件都是 0 字节, +# 看起来像"跑完了没结果")。3~4 个足够把 8 张卡喂饱,因为瓶颈是 rollout 不是加载。 +MAXJOBS="${MAXJOBS:-3}" +EMA_DIR="$RUN/ema" +[ -d "$EMA_DIR" ] || { echo "ABORT: 没有 $EMA_DIR"; exit 1; } + +busy="$(nvidia-smi -i "$(seq -s, 0 $((NGPU-1)))" --query-gpu=index,memory.used \ + --format=csv,noheader,nounits 2>&1)" || { echo "ABORT: nvidia-smi 查询失败:$busy"; exit 1; } +echo "$busy" | awk -F', *' '$2>500 {print " GPU"$1"="$2"MiB"; f=1} END{exit f+0}' || { + echo "ABORT: 上面这些卡上有占用(>500 MiB)。别抢别人的卡。"; exit 1; } + +i=0 +for ck in $(ls "$EMA_DIR"/ema_step*.safetensors | sort -t_ -k3 -n); do + tag="$(basename "$RUN")_$(basename "$ck" .safetensors)_n$N" + bash "$HERE/photodrift.sh" "$ck" "$tag" $(( i % NGPU )) "$N" \ + > "$ROOT/outputs/distill/eval/deploy/$tag.txt" 2>&1 & + i=$(( i + 1 )) + if (( i % MAXJOBS == 0 )); then wait; fi +done +wait +echo "=========== 汇总(基线 std 39.4→28.9 / mean 60.7→42.9 / 漂移 9.3 px)===========" +for f in "$ROOT/outputs/distill/eval/deploy/$(basename "$RUN")"_ema_step*_n$N.txt; do + [ -f "$f" ] && cat "$f" +done diff --git a/backup_2026-09-14/code/distill/eval/tf_rollout_probe.py b/backup_2026-09-14/code/distill/eval/tf_rollout_probe.py new file mode 100644 index 0000000000000000000000000000000000000000..6988f6a03d3c05ac0e5a2952c3de169aac4d356e --- /dev/null +++ b/backup_2026-09-14/code/distill/eval/tf_rollout_probe.py @@ -0,0 +1,135 @@ +"""教师强制 rollout 探针 —— 把「部署路径有 bug」和「曝光偏差」分开。 + +同一条 KV-cache 自回归路径,只改提交进缓存的东西: + + self —— 提交模型自己的 x0 估计(= 真正的部署路径 / deploy_rollout) + gt —— 提交**真值 latent**(= 训练时 TF 的 clean 流) + +两者的差别只有历史的来源。所以: + gt 干净、self 崩 ⇒ 路径没问题,崩的是误差累积(曝光偏差),正是 stage3 self-forcing 要修的 + gt 也崩 ⇒ 部署路径与训练不匹配(t=0 提交 / 窗口锚定的 RoPE 或 mask),是移植 bug + +每个 cell 都拿它的 x0 估计与真值算 PSNR,于是能看出崩塌是从哪一个 cell 开始的。 + + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \ + .venv/bin/python distill/eval/tf_rollout_probe.py \ + --ckpt outputs/distill/stage1_ar_tf/dits/dit_step9000.safetensors \ + --clip clip_Eybx_100000092_000000 +""" +from __future__ import annotations + +import argparse +import os +import sys + +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from diffsynth.diffusion.flow_match import FlowMatchScheduler # noqa: E402 + +from actionrope import geometry as G # noqa: E402 +from actionrope import infer # noqa: E402 +from distill.arope_dit import AropeDiT, unwrap # noqa: E402 +from distill.stage3_dmd.dmd_arope import frame_cond # noqa: E402 + + +def psnr(a: torch.Tensor, b: torch.Tensor) -> float: + """latent 空间的 PSNR(同一把尺子量所有 cell,只用来看相对趋势)。""" + mse = (a.float() - b.float()).pow(2).mean().item() + if mse <= 0: + return float("inf") + rng = (b.float().max() - b.float().min()).item() + return 20.0 * torch.log10(torch.tensor(rng / (mse ** 0.5))).item() + + +@torch.no_grad() +def probe(model, gt_lat, ctx, ids, off, t_grid, sig, *, commit_source: str, + kv_window: int, sink_size: int, rope_cap: int, seed: int = 0): + dev = gt_lat.device + b, c, cells, lh, lw = gt_lat.shape + bare = unwrap(model) + cache = bare.init_kv_cache(kv_window=kv_window, sink_size=sink_size, rope_cap=rope_cap) + g = torch.Generator("cpu").manual_seed(seed) + + def call(x, t, k, commit, ow, mk): + return model(x, t, ctx[:, k:k + 1], context_ids=ids[:, k:k + 1], + first_frame_cond=False, frame_index=k, kv_cache=cache, + commit=commit, offset_win=ow, mask_in_k=mk) + + ow0, mk0 = frame_cond(off, 0, sink_size, kv_window, lh, lw) + call(gt_lat[:, :, 0:1], torch.zeros(b, device=dev), 0, True, ow0, mk0) # cell 0 = 真首帧 + + rows = [] + for k in range(1, cells): + ow, mk = frame_cond(off, k, sink_size, kv_window, lh, lw) + x = torch.randn(b, c, 1, lh, lw, generator=g).to(dtype=gt_lat.dtype, device=dev) + den = None + for i in range(len(t_grid)): + ts = torch.full((b,), float(t_grid[i]), device=dev) + v = call(x, ts, k, False, ow, mk) + den = x - float(sig[i]) * v + if i + 1 < len(t_grid): + ns = float(sig[i + 1]) + x = (1.0 - ns) * den + ns * torch.randn(den.shape, generator=g).to(den) + gt_k = gt_lat[:, :, k:k + 1] + rows.append((k, psnr(den, gt_k), den.float().abs().mean().item(), gt_k.float().abs().mean().item())) + # ★ 唯一的差别:提交谁的历史 + commit_lat = gt_k if commit_source == "gt" else den.detach() + call(commit_lat, torch.zeros(b, device=dev), k, True, ow, mk) + return rows + + +def main(): + ap = argparse.ArgumentParser(description=__doc__, formatter_class=argparse.RawDescriptionHelpFormatter) + ap.add_argument("--ckpt", required=True) + ap.add_argument("--clip", required=True) + ap.add_argument("--steps", type=int, default=50) + ap.add_argument("--kv_window", type=int, default=20) + ap.add_argument("--sink_size", type=int, default=0) + ap.add_argument("--rope_cap", type=int, default=None) + ap.add_argument("--device", default="cuda") + args = ap.parse_args() + if args.rope_cap is None: + args.rope_cap = args.sink_size + args.kv_window + + dev = args.device + lat = torch.load(f"{ROOT}/data/latent/val_eybx/{args.clip}.pt", map_location="cpu", + weights_only=False)["latent"][None].to(dev) # [1,48,21,30,52] + sc = torch.load(infer.SIDECAR, map_location="cpu", weights_only=False) + off = sc["clips"][args.clip]["offset_px"][None].float().to(dev) # [1,21,2] + + row = infer.load_meta_row(args.clip) + prompts = [infer.strip_action(p) for p in row["prompts"]] + table = torch.load(f"{ROOT}/data/latent/text_table_actionrope.pt", map_location="cpu", + weights_only=False) + keys = sorted(set(prompts)) # context_ids 才是权威的分组依据 + kmap = {p: i for i, p in enumerate(keys)} + ctx = torch.stack([table[p] for p in prompts])[None].to(dev).to(torch.bfloat16) + ids = torch.tensor([kmap[p] for p in prompts])[None].to(dev) + + from safetensors.torch import load_file + model = AropeDiT(causal=True, mask_channel=True).to(dev).eval() + unwrap(model).dit.load_state_dict(load_file(args.ckpt), strict=True) + model = model.to(torch.bfloat16) + + s = FlowMatchScheduler("Wan") + s.set_timesteps(args.steps, training=False) + t_grid = [float(t) for t in s.timesteps] + sig = [float(x) for x in s.sigmas] + + print(f"clip={args.clip} cells={lat.shape[2]} steps={args.steps} " + f"window={args.kv_window} sink={args.sink_size}") + for src in ("gt", "self"): + rows = probe(model, lat, ctx, ids, off, t_grid, sig, commit_source=src, + kv_window=args.kv_window, sink_size=args.sink_size, rope_cap=args.rope_cap) + print(f"\n=== 提交 {src} 历史 ===") + print(" cell PSNR(x0 vs GT) |x0| |GT|") + for k, p, a, b_ in rows: + print(f" {k:4d} {p:12.2f} {a:6.3f} {b_:6.3f}") + + +if __name__ == "__main__": + main() diff --git a/backup_2026-09-14/code/distill/flow_map.py b/backup_2026-09-14/code/distill/flow_map.py new file mode 100644 index 0000000000000000000000000000000000000000..d2f7711e9ec98aca7a63da897cd756b978688454 --- /dev/null +++ b/backup_2026-09-14/code/distill/flow_map.py @@ -0,0 +1,11 @@ +#!/usr/bin/env python3 +"""**别名转发**。规范模块是 `distill/flowmap.py`(任务书点名的文件名);设计文档的 +target_layout 里写的是 `flow_map.py`。两个名字都能 import,免得 trainer / sampler 按另一个 +名字写就在启动时 ImportError。 + +新代码请一律 `from distill import flowmap`。这个文件不加任何逻辑,改动只发生在 flowmap.py。 +""" +from distill.flowmap import * # noqa: F401,F403 +from distill import flowmap as _fm # noqa: E402 + +__all__ = list(_fm.__all__) diff --git a/backup_2026-09-14/code/distill/flow_pf.py b/backup_2026-09-14/code/distill/flow_pf.py new file mode 100644 index 0000000000000000000000000000000000000000..5c26d62ec6fdd41e850493f4e6c594eeee8113d5 --- /dev/null +++ b/backup_2026-09-14/code/distill/flow_pf.py @@ -0,0 +1,345 @@ +#!/usr/bin/env python3 +"""逐 cell(per-frame)的 flow-matching 工具,全部建在 DiffSynth 的 FlowMatchScheduler("Wan") 上。 + +ActionRoPE 的 SFT(actionrope/train.py:218-219)用的就是 `FlowMatchScheduler("Wan")` + +`set_timesteps(1000, training=True)`,网格是: + + s = linspace(1, 0, 1001)[:-1] # 1000 个点 + sigma = 5·s / (1 + 4·s) # Wan shift=5 + t = sigma · 1000 # 与 sigma 一一对应 + x_t = (1 − sigma)·x0 + sigma·eps + target = eps − x0 + weight = bsmntw 钟形(set_training_weight) + +蒸馏要的东西 DiffSynth 没有:它的 `add_noise` / `training_weight` 只吃**标量** timestep(内部 +argmin 反查下标),没有 `[B,F]` 的逐 cell 版本。这里补上,并且一律**按下标**索引,不再 argmin +反查(浮点反查在 1000 点网格上是无谓的风险)。 + +方向陷阱(写反了不会报错,只会悄悄训错噪声档) +------------------------------------------------ + sigmas[0] = 1.0 纯噪声 t = 1000 + sigmas[999] ≈ 0.00498 近干净 t ≈ 4.98 +即 **越噪 == sigma 越大 == 下标越小**。WorldMind 的 `--tf_noise_aug_max_idx` 就是把这个搞反了 +(近干净档应该是 `randint(N-k, N)`,不是 `randint(0, k)`)。 + +模块级 scheduler 的不变量(对抗评审 [MINOR],必须遵守) +-------------------------------------------------------- +DiffSynth 的 `set_timesteps` 是**破坏性**的:它就地覆写 `self.sigmas` / `self.timesteps`,而且 +只在 `training=True` 时重建 `linear_timesteps_weights`(flow_match.py:365-375)。WorldMind 自己 +那份写进独立的 `infer_sigmas` / `infer_timesteps`,不碰训练网格 —— 移植时**不能**照抄那个用法。 +所以这里: + + * 模块级 `_SCHED` 只在 import 时 `set_timesteps(1000, training=True)` 一次; + * 之后 `_SCHED.set_timesteps` 被实例级替换成一个直接抛异常的桩,物理上堵死第二次调用; + * `cd_axis()` / `deploy_schedule()` 这类需要别的点数的,一律**新建一个临时 scheduler**; + * 每个 public 函数开头都跑 `_assert_sched()`:断言 `len(timesteps)==1000`、 + `linear_timesteps_weights is not None`,并且三个张量与 import 时的快照逐位相等。 +""" +from __future__ import annotations + +import os +import sys + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.abspath(__file__))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +from diffsynth.diffusion.flow_match import FlowMatchScheduler # noqa: E402 + +__all__ = [ + "NUM_TRAIN_TIMESTEPS", "WAN_SHIFT", "DMD_TIMESTEP_CLAMP", "DEPLOY_DENOISE_LIST", + "sched", "sigmas", "timesteps", "weights", + "sigma_of_idx", "t_of_idx", "idx_of_t", "sigma_of_t", + "sample_pf_timestep_ids", "add_noise_pf", "training_target", "training_weight_pf", + "cd_axis", "deploy_schedule", "assert_deploy_covered", + "ti2v_noise", "assert_ti2v", +] + +NUM_TRAIN_TIMESTEPS = 1000 +WAN_SHIFT = 5.0 +# stage3 DMD 抽 t 的下标区间(WorldMind dmd_gm.py:47-50 的 int(0.02·n)/int(0.98·n),n=1000)。 +# 是**下标**区间不是 t 值区间:idx∈[20,980) ⇒ sigma∈(0.0969, 0.9959] ⇒ t∈(96.9, 995.9]。 +DMD_TIMESTEP_CLAMP = (20, 980) +# 用户拍板的部署采样表:4 步,原始 t 值(不是下标)。stage2 的 CD 轴和 stage3 都按这个训。 +# 用显式 t 值而不是 set_timesteps(4):后者在 shift=5 下给出 [1000, 833, 625, 357],最后一步在 +# sigma=0.357 处读 x0,读出来是条件均值(软/糊)。见 WorldMind dmd_gm.py:461-467 的同一坑。 +DEPLOY_DENOISE_LIST = (1000.0, 750.0, 500.0, 250.0) + + +# ---------------------------------------------------------------------------- +# 模块级 scheduler —— 建一次,之后只读 +# ---------------------------------------------------------------------------- + +def _forbidden_set_timesteps(*a, **kw): + raise RuntimeError( + "distill.flow_pf: 模块级 scheduler 是 1000 点训练网格,set_timesteps 会就地覆写它。" + "需要别的点数请用 cd_axis(N) / deploy_schedule()(它们新建临时实例)。" + ) + + +_SCHED = FlowMatchScheduler("Wan") +_SCHED.set_timesteps(NUM_TRAIN_TIMESTEPS, training=True) +_SCHED.set_timesteps = _forbidden_set_timesteps # 实例级遮蔽类方法,堵死第二次调用 + +# import 时的快照:_assert_sched 拿它逐位比对,任何外部改写都当场炸而不是悄悄算错 +_SNAP_SIGMAS = _SCHED.sigmas.detach().clone() +_SNAP_TIMESTEPS = _SCHED.timesteps.detach().clone() +_SNAP_WEIGHTS = _SCHED.linear_timesteps_weights.detach().clone() + + +def _assert_sched() -> FlowMatchScheduler: + """每个 public 函数开头都调:确认 1000 点训练网格和钟形权重都还在、且没被人改过。""" + assert getattr(_SCHED, "timesteps", None) is not None, "flow_pf: scheduler 未初始化" + assert len(_SCHED.timesteps) == NUM_TRAIN_TIMESTEPS, \ + f"flow_pf: 训练网格被覆写了,len(timesteps)={len(_SCHED.timesteps)} != {NUM_TRAIN_TIMESTEPS}" + assert len(_SCHED.sigmas) == NUM_TRAIN_TIMESTEPS, \ + f"flow_pf: 训练网格被覆写了,len(sigmas)={len(_SCHED.sigmas)} != {NUM_TRAIN_TIMESTEPS}" + assert getattr(_SCHED, "linear_timesteps_weights", None) is not None, \ + "flow_pf: linear_timesteps_weights 丢了(set_timesteps(training=False) 不重建它)" + assert torch.equal(_SCHED.sigmas, _SNAP_SIGMAS) and torch.equal(_SCHED.timesteps, _SNAP_TIMESTEPS) \ + and torch.equal(_SCHED.linear_timesteps_weights, _SNAP_WEIGHTS), \ + "flow_pf: 模块级 scheduler 的张量被就地改写过" + return _SCHED + + +def sched() -> FlowMatchScheduler: + """取模块级(唯一的)训练 scheduler,取之前先验不变量。""" + return _assert_sched() + + +def sigmas(device=None, dtype=torch.float32) -> torch.Tensor: + """1000 点 sigma 网格 [1000],降序:sigmas[0]=1.0(纯噪声)→ sigmas[999]≈0.00498(近干净)。""" + return _assert_sched().sigmas.to(device=device, dtype=dtype) + + +def timesteps(device=None, dtype=torch.float32) -> torch.Tensor: + """1000 点 t 网格 [1000] = sigma·1000,降序:t[0]=1000 → t[999]≈4.98。""" + return _assert_sched().timesteps.to(device=device, dtype=dtype) + + +def weights(device=None, dtype=torch.float32) -> torch.Tensor: + """bsmntw 钟形训练权重 [1000](DiffSynth set_training_weight,len==1000 时不走经验缩放分支)。""" + return _assert_sched().linear_timesteps_weights.to(device=device, dtype=dtype) + + +# ---------------------------------------------------------------------------- +# 下标 ↔ sigma ↔ t +# ---------------------------------------------------------------------------- + +def _as_long(idx, device=None) -> torch.Tensor: + if not torch.is_tensor(idx): + idx = torch.as_tensor(idx) + if idx.dtype not in (torch.int32, torch.int64): + assert not idx.is_floating_point(), "flow_pf: 下标必须是整型(浮点 t 值请走 idx_of_t)" + idx = idx.long() + idx = idx.long() + return idx if device is None else idx.to(device) + + +def _check_idx(idx: torch.Tensor) -> torch.Tensor: + lo, hi = int(idx.min()), int(idx.max()) + assert 0 <= lo and hi < NUM_TRAIN_TIMESTEPS, \ + f"flow_pf: 下标越界 [{lo},{hi}],合法区间 [0,{NUM_TRAIN_TIMESTEPS - 1}]" + return idx + + +def _gather(grid: torch.Tensor, idx, device, dtype) -> torch.Tensor: + idx = _check_idx(_as_long(idx)) + out = grid.to(device=idx.device, dtype=torch.float32)[idx] + if device is not None: + out = out.to(device) + return out.to(dtype) + + +def sigma_of_idx(idx, device=None, dtype=torch.float32) -> torch.Tensor: + """下标 → sigma,形状原样保留(标量 int 给回 0 维张量);device=None 表示跟 idx 走。""" + return _gather(_assert_sched().sigmas, idx, device, dtype) + + +def t_of_idx(idx, device=None, dtype=torch.float32) -> torch.Tensor: + """下标 → t 值(= sigma·1000),形状原样保留。stage1 的 ts_pf 就是 t_of_idx(idx_pf)。""" + return _gather(_assert_sched().timesteps, idx, device, dtype) + + +def idx_of_t(t) -> torch.Tensor: + """原始 t 值 → 1000 点网格上最近的下标(WorldMind dmd_gm.py:104 的 `_sigma_of` 反查)。 + + 形状原样保留;标量 float 给回 0 维 long 张量。部署表 [1000,750,500,250] 就是靠这个落到 + sigma [1.0, 0.75, 0.5, 0.25](750 在网格上是精确点,500/250 差 <5e-4)。""" + s = _assert_sched() + if not torch.is_tensor(t): + t = torch.as_tensor(t, dtype=torch.float32) + t = t.to(torch.float32) + grid = s.timesteps.to(device=t.device, dtype=torch.float32) + return (grid - t.unsqueeze(-1)).abs().argmin(dim=-1) + + +def sigma_of_t(t, device=None, dtype=torch.float32) -> torch.Tensor: + """原始 t 值 → sigma(先 idx_of_t 再查表)。stage3 rollout 的 `_sigma_of`。""" + return sigma_of_idx(idx_of_t(t), device=device, dtype=dtype) + + +# ---------------------------------------------------------------------------- +# 逐 cell 加噪(Diffusion Forcing / stage1 teacher forcing) +# ---------------------------------------------------------------------------- + +def sample_pf_timestep_ids(B: int, F: int, dev, gen: torch.Generator | None = None) -> torch.Tensor: + """[B,F] 独立同分布的逐 cell 噪声档下标,**严格均匀** randint(0,1000)。 + + 不要换成 `round((1-u)·999)` 那种写法:它把下标 0 和 999 的概率各砍一半。""" + _assert_sched() + assert B > 0 and F > 0 + g_dev = dev if gen is None else gen.device + idx = torch.randint(0, NUM_TRAIN_TIMESTEPS, (B, F), device=g_dev, generator=gen) + return idx.to(dev) + + +def add_noise_pf(x0: torch.Tensor, noise: torch.Tensor, idx_pf: torch.Tensor) -> torch.Tensor: + """逐 cell 加噪:x_t = (1−sigma)·x0 + sigma·eps,sigma 按 [B,1,F,1,1] 广播。 + + x0 / noise: [B,C,F,H,W];idx_pf: [B,F] long。返回 x0.dtype。 + + 为什么系数在 fp32 里算完再 cast:sigma 接近 1 时 `1 − bf16(0.99593) = 0.00391`,而真值是 + 0.00407 —— bf16 直接相减是灾难性抵消,4% 的相对误差直接打在 x0 的系数上。fp32 里先算 + `1−sigma` 再 cast 成 bf16 是精确的(bf16 表示小数本身没问题),这也正是 DiffSynth 标量 + `add_noise` 的实际行为(0 维 fp32 标量参与类型提升,先算差再降位)。""" + _assert_sched() + assert x0.dim() == 5, f"flow_pf: x0 需要 [B,C,F,H,W],得到 {tuple(x0.shape)}" + assert noise.shape == x0.shape, f"flow_pf: noise {tuple(noise.shape)} != x0 {tuple(x0.shape)}" + assert noise.dtype == x0.dtype, f"flow_pf: noise dtype {noise.dtype} != x0 {x0.dtype}" + idx_pf = _check_idx(_as_long(idx_pf, x0.device)) + assert idx_pf.dim() == 2 and idx_pf.shape[0] == x0.shape[0] and idx_pf.shape[1] == x0.shape[2], \ + f"flow_pf: idx_pf 需要 [B,F]=[{x0.shape[0]},{x0.shape[2]}],得到 {tuple(idx_pf.shape)}" + b, f = idx_pf.shape + sig = _SCHED.sigmas.to(device=x0.device, dtype=torch.float32)[idx_pf].view(b, 1, f, 1, 1) + return (1.0 - sig).to(x0.dtype) * x0 + sig.to(x0.dtype) * noise + + +def training_target(x0: torch.Tensor, noise: torch.Tensor) -> torch.Tensor: + """flow-matching 目标:eps − x0(与噪声档无关,DiffSynth training_target 同)。""" + assert noise.shape == x0.shape + return noise - x0 + + +def training_weight_pf(idx_pf: torch.Tensor) -> torch.Tensor: + """逐 cell 的 bsmntw 钟形权重,形状与 idx_pf 相同,fp32。中段 t≈500 最重、两端最轻。""" + _assert_sched() + idx = _check_idx(_as_long(idx_pf)) + w = _SCHED.linear_timesteps_weights.to(device=idx.device, dtype=torch.float32) + return w[idx] + + +# ---------------------------------------------------------------------------- +# stage2 的一致性轴 / 部署采样表(都用**临时** scheduler,绝不碰模块级那个) +# ---------------------------------------------------------------------------- + +def cd_axis(N: int = 48, device=None, check_deploy: bool = True): + """stage2 CD 的离散一致性轴:`FlowMatchScheduler("Wan").set_timesteps(N)` 的 (sigmas, timesteps)。 + + N=48 时 sigmas = [1.0, 0.99576, …, 0.17857, 0.09615],t = sigma·1000,都是**降序**(下标越大越干净)。 + 轴永远到不了 sigma=0(最低一对是 0.17857 → 0.09615),所以部署采样表必须结束在低噪端。 + + 临时实例:DiffSynth 的 set_timesteps 就地覆写 sigmas/timesteps,在模块级 scheduler 上调一次 + 就把 1000 点训练网格换成 N 点的,之后每次 idx 抽样要么读错 sigma 要么直接越界(对抗评审 [MINOR])。 + + check_deploy:顺带断言这条轴的 sigma 区间覆盖 DEPLOY_DENOISE_LIST 的所有读点。""" + _assert_sched() + assert N >= 2, f"flow_pf: cd_axis 需要 N>=2,得到 {N}" + tmp = FlowMatchScheduler("Wan") # 一次性实例,出了这个函数就被回收 + tmp.set_timesteps(N) # training=False:轴上不需要钟形权重 + sig = tmp.sigmas.detach().clone().to(device=device, dtype=torch.float32) + tst = tmp.timesteps.detach().clone().to(device=device, dtype=torch.float32) + assert sig.shape == (N,) and tst.shape == (N,), f"flow_pf: cd_axis 点数不对 {tuple(sig.shape)}" + assert bool((sig[:-1] > sig[1:]).all()), "flow_pf: cd_axis 的 sigma 必须严格降序" + if check_deploy: + assert_deploy_covered(sig) + _assert_sched() # 再验一次:临时实例没污染模块级的 + return sig, tst + + +def deploy_schedule(denoise_list=None, device=None): + """部署采样表(原始 t 值)→ 落到 1000 点训练网格上的 (idx[K], sigma[K], t_grid[K])。 + + 默认就是用户拍板的 4 步 `DEPLOY_DENOISE_LIST = (1000, 750, 500, 250)`。 + 返回的 t_grid 是网格上的实际值(1000 / 750 / 500.0? / 250.0? 见下),采样时应当用它而不是 + 原始输入值,这样 sigma 与 t 严格一一对应。""" + _assert_sched() + ds = tuple(DEPLOY_DENOISE_LIST if denoise_list is None else denoise_list) + assert len(ds) >= 1, "flow_pf: 部署表不能为空" + t_req = torch.as_tensor([float(x) for x in ds], dtype=torch.float32) + if len(ds) > 1: + assert bool((t_req[:-1] > t_req[1:]).all()), \ + f"flow_pf: 部署表必须严格降序(从噪到净),得到 {ds}" + idx = idx_of_t(t_req) + sig = sigma_of_idx(idx) + t_grid = t_of_idx(idx) + # 落点误差不该超过半个格。注意网格在 t 轴上**不等距**(sigma 等距、t=sigma·1000 也等距在 + # sigma 上,但相邻 sigma 之间的间隔是 5/(1+4s)²·0.001,从噪端 0.2 涨到净端 ~4.98), + # 所以阈值取全局最大间隔的一半:请求 t=250 落到 251.6 是正常的,请求 t=1.0(低于网格下界 + # 4.98)才会被拦下。 + gap = float((_SCHED.timesteps[:-1] - _SCHED.timesteps[1:]).max()) + assert bool((t_grid - t_req).abs().max() <= 0.5 * gap + 1e-3), \ + f"flow_pf: 部署 t 值 {ds} 落不到网格上(最近点 {t_grid.tolist()},半格 {0.5 * gap:.3f})" + if device is not None: + idx, sig, t_grid = idx.to(device), sig.to(device), t_grid.to(device) + return idx, sig, t_grid + + +def assert_deploy_covered(sig_axis: torch.Tensor, denoise_list=None) -> None: + """断言 CD 一致性轴的 sigma 区间覆盖部署表的每个读点。 + + 覆盖不到意味着:学生在部署要读 x0 的那个噪声档上,从来没被一致性目标约束过。 + N=48 轴是 [0.09615, 1.0],部署表最低读点 sigma=0.25 —— 覆盖住。""" + _, sig_dep, _ = deploy_schedule(denoise_list) + lo, hi = float(sig_axis.min()), float(sig_axis.max()) + d_lo, d_hi = float(sig_dep.min()), float(sig_dep.max()) + assert d_lo >= lo - 1e-6, \ + f"flow_pf: 部署表最低 sigma {d_lo:.5f} 低于 CD 轴下界 {lo:.5f},该档没被一致性约束过" + assert d_hi <= hi + 1e-6, \ + f"flow_pf: 部署表最高 sigma {d_hi:.5f} 高于 CD 轴上界 {hi:.5f}" + + +# ---------------------------------------------------------------------------- +# stage3 DMD 的原生 TI2V 加噪 +# ---------------------------------------------------------------------------- + +def ti2v_noise(clip: torch.Tensor, clamp=DMD_TIMESTEP_CLAMP, gen: torch.Generator | None = None): + """原生 TI2V 加噪(= ActionRoPE SFT / infer 的条件形式):cell 0 干净且 t=0,cell 1..F−1 + 共享**一个**抽出来的 t。WorldMind dmd_gm.py:53-66 的移植。 + + clip: [B,C,F,H,W](可以带梯度:cell 0 用 torch.where 写回,不做原地赋值) + clamp: **下标**区间 [lo, hi),默认 (20, 980) —— 即 WorldMind 的 [0.02, 0.98]·1000。 + 返回 (noisy, ts_pf[B,F] fp32, sigma[B] fp32, noise);noise 与 clip 同 dtype/shape。""" + _assert_sched() + assert clip.dim() == 5, f"flow_pf: clip 需要 [B,C,F,H,W],得到 {tuple(clip.shape)}" + b, _, f = clip.shape[:3] + lo, hi = int(clamp[0]), int(clamp[1]) + assert 0 <= lo < hi <= NUM_TRAIN_TIMESTEPS, f"flow_pf: clamp 下标区间不合法 {clamp}" + dev = clip.device + g_dev = dev if gen is None else gen.device + idx = torch.randint(lo, hi, (b,), device=g_dev, generator=gen).to(dev) + noise = torch.randn(clip.shape, device=g_dev, dtype=clip.dtype, generator=gen).to(dev) + sig = _SCHED.sigmas.to(device=dev, dtype=torch.float32)[idx] # [B] fp32 + s5 = sig.view(b, 1, 1, 1, 1) + noisy = (1.0 - s5).to(clip.dtype) * clip + s5.to(clip.dtype) * noise + ts_pf = _SCHED.timesteps.to(device=dev, dtype=torch.float32)[idx][:, None].expand(b, f).clone() + ts_pf[:, 0] = 0.0 + f0 = (torch.arange(f, device=dev)[None, :] == 0).view(1, 1, f, 1, 1) + noisy = torch.where(f0, clip, noisy) # cell 0 = 干净 GT + return noisy, ts_pf, sig, noise + + +def assert_ti2v(noisy: torch.Tensor, clip: torch.Tensor, ts_pf: torch.Tensor) -> None: + """teacher / critic 每次前向前的 fail-fast 门(WorldMind dmd_gm.py:31-42 的输入部分): + cell 0 必须干净且 t=0,cell 1.. 必须共享同一个 t。""" + assert noisy.shape == clip.shape and noisy.dim() == 5 + assert ts_pf.shape == (clip.shape[0], clip.shape[2]), \ + f"[gate] ts_pf 需要 [B,F]={(clip.shape[0], clip.shape[2])},得到 {tuple(ts_pf.shape)}" + assert bool((ts_pf[:, 0] == 0).all()), "[gate] cell 0 必须是干净条件帧(t=0)" + assert torch.equal(noisy[:, :, 0], clip[:, :, 0]), "[gate] cell 0 的 latent 必须原样是干净 GT" + if ts_pf.shape[1] > 1: + assert torch.allclose(ts_pf[:, 1:], ts_pf[:, 1:2].expand_as(ts_pf[:, 1:])), \ + "[gate] cell 1..F−1 必须共享同一个 t(原生 TI2V)" diff --git a/backup_2026-09-14/code/distill/flowmap.py b/backup_2026-09-14/code/distill/flowmap.py new file mode 100644 index 0000000000000000000000000000000000000000..e6bc5376d7e68e78dfa504387beefd9326a2b798 --- /dev/null +++ b/backup_2026-09-14/code/distill/flowmap.py @@ -0,0 +1,934 @@ +#!/usr/bin/env python3 +"""AnyFlow 式 **flow map**(any-step)蒸馏的调度器件 + 目标函数,全部建在 `distill/flow_pf.py` 的 +1000 点 Wan 训练网格上,**不引入 diffusers**。 + +本模块只负责数学;训练循环(run 目录 / ZeRO-2 / EMA / 日志 / 保存)在 +`distill/stage2_flowmap/flowmap_arope.py`,采样器在 `distill/eval/rollout_eval.py`。 + +一句话的算法 +------------ +把速度场 `v(x_t, t)` 换成**平均速度场** `u(x_t, t, r)`,它是 `[r, t]` 区间上的平均速度: + + x_r = x_t − (σ_t − σ_r)·u(x_t, t, r) (一步就能从 t 跳到任意 r) + +训练目标(AnyFlow `trainer_far_wan_anyflow_pretrain.py:232-390`): + + target = (ε − x0) − (t − r)·dF/dt (t, r 都是 0..1000 单位) + dF/dt ≈ [u(x_t + v·ε_h/1000, t+ε_h, r) − u(x_t − v·ε_h/1000, t−ε_h, r)] / (2·ε_h·den) + +`r == t` 时修正项恒为 0,目标退化成普通 rectified flow 的 `ε − x0` —— 这就是 50% 的 +diffusion 槽为什么是"免费的锚"。 + +上游三个来源 +------------ + * `vendor/AnyFlow/far/schedulers/scheduling_flowmap_euler_discrete.py:44-112` + set_train_weight('beta08') / set_timesteps / step + * `vendor/AnyFlow/far/trainers/trainer_far_wan_anyflow_pretrain.py:232-390` + sample_timestep / compute_central_difference / train_causal + * `vendor/AnyFlow/options/train/anyflow/farwan_causal/pretrain/…4k_b16.yml:53-64` + shift 5.0 / weight_type beta08 / diffusion_ratio 0.5 / consistency_ratio 0.25 / epsilon 5 + +★★★ flow-map 约定与 flow_pf 的差异(写错都**不报错**,只是悄悄训另一根轴)★★★ +================================================================================ +1. **网格公式相同,点数含义不同。** + flow_pf 的模块级网格是 `FlowMatchScheduler("Wan").set_timesteps(1000, training=True)`,即 + `σ = apply_shift(linspace(1,0,1001)[:-1])`,shift=5。上游 `FlowMapDiscreteScheduler.set_timesteps(n)` + 是**同一个公式** `apply_shift(linspace(1,0,n+1)[:-1])`,只是 n 取推理步数。所以: + - 训练轴(抽 t)用 flow_pf 的 1000 点网格 —— 与上游 n=1000 数学同一(fp32 vs fp64, + max|Δ| = 1.2e-7,见 `test_flowmap_objective.py::test_grid_matches_upstream_formula`); + - 推理轴(N=4/24)用 `anystep_sigmas(N)`,它内部新建**临时** FlowMatchScheduler。 + **绝不要**把 `linspace(1,0,n+1)[:-1]` 直接当成 σ:少了 apply_shift 就是 shift=1 的另一根轴。 + +2. **`anystep_sigmas` 末尾补 0.0,`flow_pf.cd_axis` 不补。** + 上游 `set_timesteps` 出来的轴**没有终点 0**(N=4 是 [1, .9375, .8333, .625])。flow map 的 + Euler 链最后一步必须走到 σ_r = 0 才落在干净估计上;不补 0 就停在 σ=0.625,读出来是糊的 + 条件均值(与 flow_pf:66-68 记的 DEPLOY_DENOISE_LIST 那个坑同源)。 + 反过来 CD 轴**故意**不补 0(一致性目标在低噪端读 x0),所以这两个函数返回的东西长度差 1、 + 语义不同,别互相代入。 + +3. **权重曲线不同。** flow_pf.weights() 是 **bsmntw**(高斯钟形,峰 2.076 @ σ≈0.5005); + flow map 默认 **beta08** = σ·(1−σ)^0.5 归一化到 sum=1000(峰 1.408 @ σ=0.6670)。 + 两条曲线的峰位置差 0.17 个 σ。默认**不要**用 `flow_pf.training_weight_pf`。 + +4. **r 是原始 float,不是下标。** consistency 槽要的是**精确的 0.0**,而 1000 点网格 + `linspace(1,0,1001)[:-1]` 按构造不含 0(最低点 σ=0.00498, t=4.98)。 + `flow_pf.idx_of_t(0.0)` 会返回 **999**(σ=0.00498)—— 把它当 r 用就把"一致性槽"悄悄变成 + "近一致性槽",(t−r) 少了 4.98/1000 的量。所以本模块的 r 一律走原始值,σ_r = r/1000。 + 注意 `t/1000` 与 `flow_pf.sigmas()` 在 fp32 下**不逐位相等**(max|Δ| = 6e-8):在网格上一律 + 用 `flow_pf.sigma_of_idx(idx)`,只有 off-grid 的 r 才用 `sigma_of_t_exact`。 + +5. **方向。** flow_pf 的 σ 是**降序**(下标 0 = σ 1.0 = 最噪)。上游 `t = max(t1,t2)`、 + `r = min(t1,t2)` 是在**值**上取的 ⇒ 在**下标**上是 `i_t = min`、`i_r = max`。反了的话 + (t−r) 变号,修正项整条反向,loss 照样下降。 + +6. **单位。** ε = 5.0 是 **0..1000 的 t 单位**:latent 扰动除以 1000(换算成 σ 单位), + 时间扰动不除,(t−r) 也在 1000 单位,三者精确相消。把 latent 扰动写成 `v·ε` 会让 dF/dt + 偏大 ~1000×,训练指标全程健康而流形是错的(见 `test_flowmap_objective.py` 的注入实验 I-3)。 + +7. **逐 cell vs 逐样本 t。** `flow_pf.sample_pf_timestep_ids` 给的是 [B,F] 逐 cell 独立 + (stage1 的 diffusion forcing)。flow map 默认是**一个标量 (t,r) 广播到 21 个 cell** + + cell 0 钉成干净 GT —— 这才对应部署路径(每个 cell 对着已提交的干净历史去噪)。 + +8. **没有 `assert_deploy_covered`。** CD 必须让一致性轴覆盖部署读点(flow_pf:291-302); + flow map 的训练轴与部署表**解耦**,这正是换掉 stage2 的理由。`anystep_sigmas` 不做这个断言。 + +模块级不变量 +------------ +本模块**只读** flow_pf 的访问器,从不调用模块级 scheduler 的 set_timesteps(flow_pf 已经把它 +换成抛异常的桩)。需要 N 点轴时新建临时 `FlowMatchScheduler("Wan")`,与 `flow_pf.cd_axis` 同一个惯用法。 +""" +from __future__ import annotations + +import contextlib +import os +import sys +from dataclasses import dataclass, field + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.abspath(__file__))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from diffsynth.diffusion.flow_match import FlowMatchScheduler # noqa: E402 + +from distill import flow_pf # noqa: E402 + +__all__ = [ + # 常量 + "NUM_TRAIN_TIMESTEPS", "T_MAX", "T_MIN", "FLOWMAP_EPSILON", + "DIFFUSION_RATIO", "CONSISTENCY_RATIO", "FUSE_GUIDANCE_SCALE", + "SPLIT_SEED_BASE", "NULL_AXES", "ROLE_NAMES", + "ROLE_DIFFUSION", "ROLE_CONSISTENCY", "ROLE_RANDOM", + # 网格 / 权重 + "sigma_of_t_exact", "t_of_sigma_exact", + "beta08_weights", "flowmap_weights", "weight_of_idx", "weight_of_t", + # any-step 轴 + "anystep_shift", "anystep_sigmas", "anystep_timesteps", "deploy_flowmap_sigmas", "assert_anystep_axis", + # (t, r) 抽样与跨 rank 划分 + "TRSample", "split_counts", "make_split_generator", "advance_split_generator", + "split_slots", "roles_of_slots", "sample_tr", + # 加噪 + "keep_frame0", "add_noise_scalar", + # 目标 + "fuse_denominator", "active_gains", "fuse_predictions", + "probes_needed", "central_difference", "flowmap_target", + "flowmap_loss", "adaptive_balance", + # guidance 钩子 + "null_axis", "NULL_AXIS_TABLE", + # 采样 + "euler_step", "euler_chain", +] + +# ---------------------------------------------------------------------------- +# 常量(= 上游 pretrain 配方;三处副本规则见 RUNBOOK,这里是 python 侧唯一一份) +# ---------------------------------------------------------------------------- + +NUM_TRAIN_TIMESTEPS = flow_pf.NUM_TRAIN_TIMESTEPS # 1000 +T_MAX = 1000.0 # σ=1,每条采样轨迹的起点;t 不许超过它(σ>1 离分布) +T_MIN = 0.0 # σ=0,干净;cell 0 与 TF clean 半流用的就是 t=0,在分布内 +FLOWMAP_EPSILON = 5.0 # 中心差分步长,**0..1000 的 t 单位**(yml:64 `epsilon: 5`) +DIFFUSION_RATIO = 0.5 # yml:62 +CONSISTENCY_RATIO = 0.25 # yml:63 +FUSE_GUIDANCE_SCALE = 3.0 # yml:53;g_text = w − 1 = 2.0 +SPLIT_SEED_BASE = 4321 # split 用的 CPU 生成器种子基数(各 rank 必须一致) + +NULL_AXES = ("text", "anchor", "action", "hist", "ctx") + +ROLE_DIFFUSION, ROLE_CONSISTENCY, ROLE_RANDOM = 0, 1, 2 +ROLE_NAMES = ("diffusion", "consistency", "random") + + +# ---------------------------------------------------------------------------- +# σ ↔ t(网格上一律走 flow_pf;只有 off-grid 的 r 才用下面这两个) +# ---------------------------------------------------------------------------- + +def sigma_of_t_exact(t): + """t → σ,**按定义** σ = t/1000,不做网格反查。 + + Wan 网格上 `timesteps ≡ sigmas · 1000` 是构造式(flow_match.py:43-52),所以这个换算在数学上 + 精确;但 fp32 下 `t/1000` 与 `flow_pf.sigmas()` **不逐位相等**(max|Δ| = 5.96e-8)。 + 所以:**在网格上取 σ 请用 `flow_pf.sigma_of_idx(idx)`**,这个函数只给 off-grid 的 r 用 + (典型就是 consistency 槽的 r = 0.0 —— 网格里根本没有 0)。 + """ + if torch.is_tensor(t): + return t.to(torch.float32) / float(NUM_TRAIN_TIMESTEPS) + return float(t) / float(NUM_TRAIN_TIMESTEPS) + + +def t_of_sigma_exact(sigma): + """σ → t = σ·1000。同上:网格上请用 `flow_pf.t_of_idx`。""" + if torch.is_tensor(sigma): + return sigma.to(torch.float32) * float(NUM_TRAIN_TIMESTEPS) + return float(sigma) * float(NUM_TRAIN_TIMESTEPS) + + +def _assert_t_range(name: str, v, lo: float = T_MIN, hi: float = T_MAX) -> None: + """API 边界的硬断言:t / r 必须落在 [0, 1000]。单位搞错(喂 σ 或喂下标)在这里当场炸。""" + if torch.is_tensor(v): + mn, mx = float(v.min()), float(v.max()) + else: + mn = mx = float(v) + assert lo - 1e-4 <= mn and mx <= hi + 1e-4, \ + (f"flowmap: {name} 越界 [{mn:.4f}, {mx:.4f}],合法区间 [{lo}, {hi}](0..1000 的 t 单位)。" + f"喂进来的是 σ(0..1)还是下标(0..999)?") + + +# ---------------------------------------------------------------------------- +# 训练权重 +# ---------------------------------------------------------------------------- + +_W_CACHE: dict = {} + + +def beta08_weights(device=None, dtype=torch.float32) -> torch.Tensor: + """上游 `set_train_weight('beta08')`(scheduling_flowmap_euler_discrete.py:53-56)在我们 + 1000 点网格上的复刻: + + t = σ (上游是 timesteps/1000,Wan 网格上就等于 σ) + y = t^1.0 · (1 − t)^0.5 + w = y · (1000 / Σy) + + 返回 [1000] 降序对齐 `flow_pf.sigmas()`:w[0] = 0.0(σ=1)、w[1] = 0.0517、 + 峰 1.4076 @ σ=0.66698(下标 714)、w[999] = 0.0182。 + + ⚠ w[0] 恰好是 **0.0** —— 而 σ=1 是每条采样轨迹的起点。上游连续抽 t 时这是零测度,我们在 + 1000 点网格上以 1/1000 的概率抽中它,那一步梯度全被乘没。这是**继承**的性质(bsmntw 在 + σ=1 处同样是 0,stage1 就这么训的),要压请用 `flowmap_weights(weight_floor=...)`。 + + 与上游的**已知且有意**的差异(实测,钉在 test_beta08_matches_upstream_formula 里): + 上游在 fp64 里建网格,我们从 flow_pf 的 fp32 网格算 —— 单一真相源优先于最后一位小数。 + 差异集中在 σ→1 那一端的 `(1−σ)^0.5`:σ=0.99979979 处 `1−σ ≈ 2.0e-4` 是灾难性抵消, + fp32 网格 1e-7 的绝对误差被放大成 **相对 1.295e-4**;但那格的权重只有 0.0517,所以 + **绝对**误差是 6.70e-06(下标 1,全网格最大值),相对峰值 1.408 是 5e-6。其余 999 格更小。 + 归一化的 Σ 在 fp64 里做,避免 1000 项累加的误差。 + """ + key = ("beta08", str(device), str(dtype)) + if key not in _W_CACHE: + s = flow_pf.sigmas().double() # [1000] 降序,只读 + y = (s ** 1.0) * ((1.0 - s) ** 0.5) + w = y * (float(NUM_TRAIN_TIMESTEPS) / y.sum()) + _W_CACHE[key] = w.to(device=device, dtype=dtype) + return _W_CACHE[key] + + +def flowmap_weights(weight_type: str = "beta08", weight_floor: float = 0.0, + device=None, dtype=torch.float32) -> torch.Tensor: + """按名字取 [1000] 训练权重。 + + beta08 上游 flow map 的默认(本 stage 的默认) + bsmntw/gaussian flow_pf.weights(),即 stage1/SFT 用的高斯钟形(消融用) + uniform 全 1(上游 'uniform') + + weight_floor:归一化**之后**做 `clamp_min`,把 σ=1 那一格从 0 抬起来。默认 0.0 = 上游逐位一致; + 非 0 会让 Σw 略微超过 1000(这是有意的,别再归一化回去,否则中段会被压低)。 + """ + wt = str(weight_type).lower() + if wt == "beta08": + w = beta08_weights(device=device, dtype=dtype) + elif wt in ("bsmntw", "gaussian"): + # flow_pf.weights() == DiffSynth set_training_weight() == 上游 'gaussian' 分支 + w = flow_pf.weights(device=device, dtype=dtype) + elif wt == "uniform": + w = torch.ones(NUM_TRAIN_TIMESTEPS, device=device, dtype=dtype) + else: + raise ValueError(f"flowmap: 未知 weight_type={weight_type!r}(beta08 / bsmntw / uniform)") + floor = float(weight_floor) + assert floor >= 0.0, f"flowmap: weight_floor 必须 >=0,得到 {floor}" + return w.clamp_min(floor) if floor > 0.0 else w + + +def weight_of_idx(idx, weight_type: str = "beta08", weight_floor: float = 0.0) -> torch.Tensor: + """按**下标**取权重(形状原样保留)。上游 `get_train_weight` 是对 t 做 argmin 反查;我们的 t + 本来就是从下标查出来的,直接索引与反查结果恒等(见 test_weight_lookup_matches_argmin)。""" + idx = idx if torch.is_tensor(idx) else torch.as_tensor(idx) + assert not idx.is_floating_point(), "flowmap: weight_of_idx 要的是整型下标(浮点 t 请用 weight_of_t)" + w = flowmap_weights(weight_type, weight_floor, device=idx.device) + return w[idx.long()] + + +def weight_of_t(t, weight_type: str = "beta08", weight_floor: float = 0.0) -> torch.Tensor: + """按**原始 t 值**取权重(走 flow_pf.idx_of_t 的 argmin 反查)= 上游 `get_train_weight`。""" + _assert_t_range("t", t) + t = t if torch.is_tensor(t) else torch.as_tensor(t, dtype=torch.float32) + return weight_of_idx(flow_pf.idx_of_t(t).to(t.device), weight_type, weight_floor) + + +# ---------------------------------------------------------------------------- +# any-step 采样轴(每次都新建**临时** scheduler,绝不碰 flow_pf 的模块级那个) +# ---------------------------------------------------------------------------- + +def anystep_shift(u): + """上游 `FlowMapDiscreteScheduler.apply_shift`(scheduling_flowmap_euler_discrete.py:76-80): + + σ = shift·u / (1 + (shift−1)·u) shift = flow_pf.WAN_SHIFT = 5 + + u ∈ [0,1] 是**未 shift** 的均匀参数,σ 是真正的噪声水平。这两个东西差别很大: + u=0.5 ⇒ σ=0.833。把 u 直接当 σ 用不会报错,只会把噪声档整体压到低噪端。 + on-policy 侧 generator 抽均匀 u、critic 抽 logit-normal u,都要经过这里。 + """ + u = u if torch.is_tensor(u) else torch.as_tensor(u, dtype=torch.float32) + sh = flow_pf.WAN_SHIFT + return sh * u / (1.0 + (sh - 1.0) * u) + + +def anystep_sigmas(N: int, device=None, dtype=torch.float32, terminal: bool = True) -> torch.Tensor: + """N 步 any-step 采样轴的 σ,**长度 N+1、严格降序、末位是 0.0**。 + + 前 N 个点 = `FlowMatchScheduler("Wan").set_timesteps(N).sigmas` + = 上游 `apply_shift(linspace(1,0,N+1)[:-1])`,shift=5。 + 末位补的 0.0 是 flow map 的终点:Euler 链的最后一步 `x −= (σ_{N-1} − 0)·u` 直接落在干净估计上, + 不需要再单独读一次 `x0 = x − σ·v`。 + + N=4 ⇒ [1.0, 0.9375, 0.83333, 0.625, 0.0] + N=24 ⇒ [1.0, 0.99138, …, 0.3125, 0.17857, 0.0] + 这一对(4 与 24)就是 any-step 结论的验收点(上游 yml:100 `num_inference_steps: [4, 24]`)。 + + terminal=False 用来和上游 `set_timesteps` 逐位对拍,正常采样**不要**关。 + """ + flow_pf.sched() # 先验模块级不变量 + assert int(N) >= 1, f"flowmap: anystep_sigmas 需要 N>=1,得到 {N}" + tmp = FlowMatchScheduler("Wan") # 一次性实例,出了函数就回收 + tmp.set_timesteps(int(N)) # training=False:推理轴不需要钟形权重 + sig = tmp.sigmas.detach().clone().to(torch.float32) + assert sig.shape == (int(N),), f"flowmap: anystep 轴点数不对 {tuple(sig.shape)}" + if terminal: + sig = torch.cat([sig, sig.new_zeros(1)]) + assert_anystep_axis(sig, terminal=terminal) + flow_pf.sched() # 再验一次:临时实例没污染模块级的 + return sig.to(device=device, dtype=dtype) + + +def anystep_timesteps(N: int, device=None, dtype=torch.float32, terminal: bool = True) -> torch.Tensor: + """同上,返回 t = σ·1000(喂给模型的就是它)。""" + return anystep_sigmas(N, device=device, dtype=dtype, terminal=terminal) * float(NUM_TRAIN_TIMESTEPS) + + +def deploy_flowmap_sigmas(denoise_list=None, device=None, dtype=torch.float32) -> torch.Tensor: + """把用户拍板的部署表(默认 `flow_pf.DEPLOY_DENOISE_LIST = (1000, 750, 500, 250)`)落到 1000 点 + 网格,再补一个终点 0.0 ⇒ [1.0, 0.75, 0.50060, 0.25161, 0.0]。 + + flow map 对采样表没有任何约束(训练轴与部署轴解耦),所以这里**不**调 `assert_deploy_covered`。 + """ + _, sig, _ = flow_pf.deploy_schedule(denoise_list) + sig = torch.cat([sig.to(torch.float32), torch.zeros(1)]) + assert_anystep_axis(sig, terminal=True) + return sig.to(device=device, dtype=dtype) + + +def assert_anystep_axis(sig: torch.Tensor, terminal: bool = True) -> None: + """采样轴的 fail-fast 门:严格降序、σ ∈ [0,1]、起点 ≤1,terminal 时末位恰为 0.0。""" + assert sig.dim() == 1 and sig.numel() >= 2, f"flowmap: 采样轴形状不对 {tuple(sig.shape)}" + assert bool((sig[:-1] > sig[1:]).all()), f"flowmap: 采样轴必须严格降序,得到 {sig.tolist()}" + assert float(sig.max()) <= 1.0 + 1e-6 and float(sig.min()) >= -1e-9, \ + f"flowmap: 采样轴 σ 越界 [{float(sig.min())}, {float(sig.max())}]" + if terminal: + assert float(sig[-1]) == 0.0, \ + (f"flowmap: 采样轴末位必须是精确的 0.0,得到 {float(sig[-1])} —— " + f"不补 0 的话最后一步停在中间噪声档,读出来是糊的条件均值") + + +# ---------------------------------------------------------------------------- +# (t, r) 抽样 + 跨 rank 的 diffusion / consistency / random 划分 +# ---------------------------------------------------------------------------- + +@dataclass +class TRSample: + """一次 micro batch 里**本 rank** 的 (t, r) 与角色。所有张量都是 [b]。""" + idx_t: torch.Tensor # [b] long,t 在 1000 点网格上的下标(越小越噪) + idx_r: torch.Tensor # [b] long,r 的下标;consistency 槽是 -1(off-grid,见下) + t: torch.Tensor # [b] fp32,0..1000 + r: torch.Tensor # [b] fp32,0..1000;consistency 槽恰为 0.0 + sigma_t: torch.Tensor # [b] fp32,= flow_pf.sigma_of_idx(idx_t) + sigma_r: torch.Tensor # [b] fp32 + is_diffusion: torch.Tensor # [b] bool,r == t + role: torch.Tensor # [b] long,ROLE_DIFFUSION / _CONSISTENCY / _RANDOM + slot: torch.Tensor # [b] long,本样本在全局 batch 里拿到的槽位 + perm: torch.Tensor = field(default_factory=lambda: torch.empty(0, dtype=torch.long)) + n_diffusion: int = 0 + n_consistency: int = 0 + + @property + def role_names(self) -> list[str]: + return [ROLE_NAMES[int(x)] for x in self.role] + + +def split_counts(world_batch: int, diffusion_ratio: float = DIFFUSION_RATIO, + consistency_ratio: float = CONSISTENCY_RATIO) -> tuple[int, int]: + """上游 trainer:243-245 的 `round(ratio · total_global_bsz)`。 + + G = world_size · batch_size。G=4 / 0.5 / 0.25 ⇒ (2, 1),剩 1 个 random 槽。 + 注意 python 的 round 是 banker's rounding(round(0.5)==0),与上游同一函数,照抄。 + """ + G = int(world_batch) + assert G >= 1, f"flowmap: world_batch 必须 >=1,得到 {G}" + assert 0.0 <= diffusion_ratio <= 1.0 and 0.0 <= consistency_ratio <= 1.0 + n_d = int(round(float(diffusion_ratio) * G)) + n_c = int(round(float(consistency_ratio) * G)) + assert n_d + n_c <= G, \ + f"flowmap: diffusion_ratio+consistency_ratio 的槽位 {n_d}+{n_c} 超过全局 batch {G}" + assert n_d >= 1, \ + (f"flowmap: 全局 batch {G} 下 diffusion 槽为 0 —— adaptive_balance 的分母会是空集," + f"loss 直接 NaN。调大 --diffusion_ratio 或加大全局 batch") + return n_d, n_c + + +def make_split_generator(seed: int = 0) -> torch.Generator: + """划分用的 **CPU** 生成器。所有 rank 必须用同一个种子 —— 它决定每个 micro batch 的槽位轮换, + rank 之间不一致就会出现"两个 rank 都以为自己是 diffusion 槽",全局比例失衡且不报错。 + + 与逐 rank 抽 (t,r) 的生成器(`set_seed(seed, device_specific=True)` 那条)严格分开。 + """ + g = torch.Generator(device="cpu") + g.manual_seed(int(SPLIT_SEED_BASE) + int(seed)) + return g + + +def advance_split_generator(gen: torch.Generator, n_micro: int, world_batch: int) -> torch.Generator: + """resume 时把划分流快进 n_micro 次抽取(cd_arope.py:745-747 的 idx_rng 惯用法)。 + + ⚠ 快进的次数是 **micro batch 数**(= step · grad_accum),不是优化步数。所以 resume 时 + **不许改 --grad_accum**:改了以后同一个 step 对应的 micro 计数变了,各 rank 的流会错位。 + """ + G = int(world_batch) + for _ in range(int(n_micro)): + torch.randperm(G, generator=gen) + return gen + + +def split_slots(world_batch: int, gen: torch.Generator | None = None, + rotate: bool = True) -> torch.Tensor: + """返回 [G] 的槽位分配:全局位置 i(= rank·bsz + j)拿到的槽位 `slots[i]`。 + + rotate=True(默认,本移植的**有意偏离**):所有 rank 用同一个 CPU 生成器抽一个 + `randperm(G)`,每个 micro batch 换一次。全局比例每个 micro 都精确等于上游,但角色在 rank + 之间轮转。 + + rotate=False:`arange(G)`,即上游 `global_start_idx = rank·bsz + j` 的**静态**分配。 + G=4 时那意味着 rank0/1 永远 diffusion、rank2 永远 consistency、rank3 永远 random, + 整整 8000 步不变 —— 而且 adaptive_balance 的分母永远是同两个 rank 的 2 样本均值。 + 留着它是为了跑上游逐位差分门禁。 + """ + G = int(world_batch) + assert G >= 1 + if not rotate: + return torch.arange(G, dtype=torch.long) + assert gen is not None, "flowmap: rotate=True 必须给一个各 rank 一致的 CPU 生成器(make_split_generator)" + assert gen.device.type == "cpu", "flowmap: 划分生成器必须在 CPU 上(CUDA 生成器各 rank 不同步)" + return torch.randperm(G, generator=gen) + + +def roles_of_slots(slots: torch.Tensor, n_diffusion: int, n_consistency: int) -> torch.Tensor: + """槽位 → 角色(上游 trainer:248-256 的三段 if/elif/else)。""" + slots = slots.long() + role = torch.full_like(slots, ROLE_RANDOM) + role = torch.where(slots < int(n_diffusion) + int(n_consistency), torch.full_like(slots, ROLE_CONSISTENCY), role) + role = torch.where(slots < int(n_diffusion), torch.full_like(slots, ROLE_DIFFUSION), role) + return role + + +def sample_tr(batch_size: int, world_size: int = 1, rank: int = 0, *, + gen: torch.Generator | None = None, + split_gen: torch.Generator | None = None, + diffusion_ratio: float = DIFFUSION_RATIO, + consistency_ratio: float = CONSISTENCY_RATIO, + rotate: bool = True, device="cpu") -> TRSample: + """抽本 rank 这一个 micro batch 的 (t, r)。 + + 抽法(上游 trainer:232-241 在 1000 点网格上的离散化): + i1, i2 ~ randint(0, 1000) 逐 rank 独立(gen 是 device-specific 的那条) + i_t = min(i1, i2) i_r = max(i1, i2) σ 降序 ⇒ 下标小 = σ 大 = t 大 + t = flow_pf.t_of_idx(i_t) 已经过 shift 变换,(4.98, 1000] + 角色覆写: + diffusion r := t (精确相等,后面 probes_needed 靠 `==` 判定) + consistency r := 0.0(**off-grid**,idx_r 记 −1) + random 保留抽出来的一对 + + 与上游的差异:上游 `t1,t2 ~ U(0,1)` 连续、再 apply_shift;我们在 1000 点网格上均匀抽下标, + 正是同一个分布的离散化(网格本身就是 `apply_shift(linspace(1,0,1001)[:-1])`)。 + """ + b, W = int(batch_size), int(world_size) + assert b >= 1 and W >= 1 and 0 <= int(rank) < W + G = W * b + n_d, n_c = split_counts(G, diffusion_ratio, consistency_ratio) + + perm = split_slots(G, gen=split_gen, rotate=rotate) # [G] CPU + slot = perm[int(rank) * b: int(rank) * b + b].to(device) # [b] 本 rank 的槽位 + role = roles_of_slots(slot, n_d, n_c) + + g_dev = device if gen is None else gen.device + pair = torch.randint(0, NUM_TRAIN_TIMESTEPS, (b, 2), device=g_dev, generator=gen).to(device) + idx_t = pair.min(dim=1).values.long() # 下标小 ⇒ σ 大 ⇒ t 大 + idx_r = pair.max(dim=1).values.long() + + t = flow_pf.t_of_idx(idx_t, device=device) # [b] fp32 + sig_t = flow_pf.sigma_of_idx(idx_t, device=device) + r = flow_pf.t_of_idx(idx_r, device=device) + sig_r = flow_pf.sigma_of_idx(idx_r, device=device) + + is_role_d = role == ROLE_DIFFUSION + is_d = is_role_d + is_c = role == ROLE_CONSISTENCY + # diffusion:r := t(`t.clone()` 保证逐位相等,probes_needed 的 `==` 才成立) + r = torch.where(is_d, t, r) + sig_r = torch.where(is_d, sig_t, sig_r) + idx_r = torch.where(is_d, idx_t, idx_r) + # consistency:r := 精确 0.0,idx 记 −1(网格上没有 0,见文件头差异 #4) + zero = torch.zeros_like(r) + r = torch.where(is_c, zero, r) + sig_r = torch.where(is_c, zero, sig_r) + idx_r = torch.where(is_c, torch.full_like(idx_r, -1), idx_r) + + # ★ is_diffusion 由**值**派生,不由角色派生:random 槽偶然抽到 i1 == i2 时也落在对角线上 + # (1000 点网格上 p = 1/1000;上游连续抽 t 是零测度,所以它没遇到过这个 case)。 + # 语义要的是"修正项是否消失",而不是"抽签抽到了哪个槽":这两个用途都跟着值走 —— + # probes_needed 靠它省两次前向,adaptive_balance 靠它决定谁进分母。 + # 派生只会**增加**对角线样本,不会减少,所以 split_counts 的 n_diffusion>=1 保证仍然成立。 + # role 保留为抽样出身的标签,只用于日志(角色直方图与 diffusion mask 可以不等,这是对的)。 + is_d = (r == t) + _assert_t_range("t", t) + _assert_t_range("r", r) + assert bool((t >= r - 1e-6).all()), f"flowmap: 必须 t >= r,得到 t={t.tolist()} r={r.tolist()}" + assert bool(is_d[is_role_d].all()), "flowmap: diffusion 槽必须逐位落在 r==t 对角线上" + assert not bool(is_d[is_c].any()), "flowmap: consistency 槽的 r=0 不可能等于 t(网格最低 t=4.98)" + return TRSample(idx_t=idx_t, idx_r=idx_r, t=t, r=r, sigma_t=sig_t, sigma_r=sig_r, + is_diffusion=is_d, role=role, slot=slot, perm=perm, + n_diffusion=n_d, n_consistency=n_c) + + +# ---------------------------------------------------------------------------- +# 加噪(标量 t 广播到 21 个 cell + cell 0 钉成干净 GT) +# ---------------------------------------------------------------------------- + +def keep_frame0(x: torch.Tensor, clip: torch.Tensor) -> torch.Tensor: + """cell 0 换回 clip 的 cell 0(out-of-place,clip 带梯度时也安全)。 + + 与 `stage2_cd/cd_arope.py:_keep_frame0` 逐字相同;这里再写一份是为了让 flowmap.py 不反向依赖 + 某个 stage 目录。中心差分的两个探针输入**必须**过这个:v·ε/1000 打到 cell 0 上就破坏了 + TI2V 干净锚点,而整个条件形式都建在那个锚点上。 + """ + f0 = (torch.arange(x.shape[2], device=x.device) == 0).view(1, 1, -1, 1, 1) + return torch.where(f0, clip, x) + + +def add_noise_scalar(x0: torch.Tensor, noise: torch.Tensor, idx_t: torch.Tensor, + pin_first_cell: bool = True) -> torch.Tensor: + """x_t = (1−σ_t)·x0 + σ_t·ε,**一个标量档广播到所有 cell**,再把 cell 0 钉回干净 GT。 + + x0 / noise: [b,C,F,H,W];idx_t: [b] long(每个样本一个网格下标)。 + 走 `flow_pf.add_noise_pf`(fp32 里算系数再降位,避免 σ→1 时 `1−bf16(σ)` 的灾难性抵消)。 + """ + assert x0.dim() == 5, f"flowmap: x0 需要 [b,C,F,H,W],得到 {tuple(x0.shape)}" + idx_t = idx_t.long().to(x0.device) + assert idx_t.dim() == 1 and idx_t.shape[0] == x0.shape[0], \ + f"flowmap: idx_t 需要 [b]={x0.shape[0]},得到 {tuple(idx_t.shape)}" + idx_pf = idx_t[:, None].expand(x0.shape[0], x0.shape[2]).contiguous() # [b,F] 同一个档 + x_t = flow_pf.add_noise_pf(x0, noise, idx_pf) + return keep_frame0(x_t, x0) if pin_first_cell else x_t + + +# ---------------------------------------------------------------------------- +# guidance 蒸馏(多轴 null 的融合) +# ---------------------------------------------------------------------------- + +NULL_AXIS_TABLE = { + # axis 来源 干预点 + "text": ("stage1b --scene_dropout", "cross-attn:context ← NULL_PROMPT 行,context_ids ← 0"), + "anchor": ("stage1b --anchor_dropout", "TF 掩码:bare.train_drop_anchor=True,干净 cell 0 从每个 noisy cell 视野里摘掉"), + "action": ("stage1b --action_dropout", "世界 RoPE + known 掩码:offset_px ← 0,mask_input 按它重建"), + "hist": ("stage1b --hist_dropout", "因果掩码:train_local_attn_size, train_sink_size = 1, 1(只看得到 cell 0)"), + "ctx": ("stage1b --ctx_dropout", "因果掩码:train_local_attn_size, train_sink_size = 1, 0(什么都看不到)"), +} + + +def active_gains(gains: dict, dropped: set | tuple | list | None = None) -> dict: + """把**本 micro batch 已经在主前向里被 drop 掉的轴**的 g 归零,并丢掉 g==0 的项。 + + 这是对上游的一处**有意修正**:上游在 `pixel_loss:307-309` 里以 10% 概率把 text 换成负条件, + 那时 `cond == uncond`,融合在算术上是恒等 —— 但 `guidance` 仍然是 3.0 并被塞进 `dF_dt` 的 + 分母(trainer:279),于是**恰好在这批样本上**修正项小了 3×。我们按实际生效的轴算 den, + 顺带省掉那一次冗余前向。 + """ + dropped = set(dropped or ()) + out = {} + for k, g in gains.items(): + assert k in NULL_AXES, f"flowmap: 未知 null 轴 {k!r},合法值 {NULL_AXES}" + g = float(g) + assert g >= 0.0, f"flowmap: g_{k} 必须 >=0(负值等于把 null 方向放大,语义未定义),得到 {g}" + if k not in dropped and g != 0.0: + out[k] = g + return out + + +def fuse_denominator(gains: dict) -> float: + """den = 1 + Σ_j g_j。text-only、g_text = w−1 = 2 时 den == w == 3(上游的 `guidance`)。""" + return 1.0 + sum(float(g) for g in gains.values()) + + +def fuse_predictions(f_full: torch.Tensor, nulls: dict, gains: dict, + clip_k: float = 0.0) -> tuple[torch.Tensor, float]: + """多轴 CFG 融合: + + pred = (F_full + Σ_j g_j · F_{∅_j}) / (1 + Σ_j g_j) + + text-only、g_text = 2 时,与上游 `(noise_pred − (1 − w)·noise_pred_uncond) / w`(w=3)是 + **同一个 IEEE 值**(fp32 / fp64 下 `torch.equal` 均为 True)—— 所以多轴代码路径能过逐位差分门禁。 + + 最优点上这会把 `F_full → v* + Σ_j g_j (v* − v_{∅_j})`,即多轴 CFG 放大后的场,永久烤进权重: + 推理时**一次前向都不用多做**,代价是强度也再也调不回来了。 + + clip_k > 0:把 `|pred − F_full|` 截断到 `clip_k · std(F_full)` —— 打开额外轴时的熔断器 + (那几条轴是**掩码差**不是 classifier-free 的分数差,放大它是外推;而且参照物是学生自己, + 是正反馈回路)。默认 0 = 不截断 = 上游行为。 + + 返回 (pred, den)。所有 F_{∅_j} 都应当是 `torch.no_grad()` 下算出来的。 + """ + assert set(nulls.keys()) >= set(gains.keys()), \ + f"flowmap: gains 里有 {set(gains) - set(nulls)} 但 nulls 没给对应的前向" + den = fuse_denominator(gains) + assert den > 0.0, f"flowmap: den={den} 必须 >0" + pred = f_full + for k in NULL_AXES: # 固定顺序 ⇒ 浮点结果可复现 + if k in gains: + g = float(gains[k]) + fn = nulls[k] + assert fn.shape == f_full.shape, f"flowmap: null[{k}] 形状 {tuple(fn.shape)} != {tuple(f_full.shape)}" + pred = pred + g * fn + pred = pred / den + if float(clip_k) > 0.0: + with torch.no_grad(): + lim = float(clip_k) * f_full.float().std() + d = (pred - f_full).clamp(min=-lim, max=lim) + pred = f_full + d + return pred, den + + +@contextlib.contextmanager +def null_axis(axis: str, cond: dict, *, bare=None, + null_context=None, null_context_ids=None, mask_input_fn=None): + """产出某一条 null 轴的 cond(并在退出时把裸模块属性原样还回去)。 + + 用法(trainer 侧): + + with flowmap.null_axis("anchor", cond, bare=unwrap(model)) as cond_j: + with torch.no_grad(), autocast: + nulls["anchor"] = bare(x_t, t, r_timestep=r, **cond_j) + + 为什么属性存取包在这里而不是抄到 trainer:三条掩码轴改的是**裸模块属性** + (`ar_tf.py:200-210` 的惯用法),中途异常没还原的话,之后所有前向都在错误的注意力窗口上跑 + 且不报错。放在一个 contextmanager 里,`finally` 只写一次。 + + text 需要 null_context([b,L,4096] 或 [b,f,L,4096],NULL_PROMPT 那一行)+ null_context_ids(全 0) + action 把 offset_px 归零并按它重建 mask_input(默认惰性 import `distill.data.make_mask_input`) + anchor/hist/ctx 只改 bare 的属性,cond 原样 + """ + assert axis in NULL_AXES, f"flowmap: 未知 null 轴 {axis!r},合法值 {NULL_AXES}" + saved = None + try: + if axis == "text": + assert null_context is not None, "flowmap: text null 需要 null_context(NULL_PROMPT 的嵌入)" + ids = null_context_ids + if ids is None and cond.get("context_ids") is not None: + ids = torch.zeros_like(cond["context_ids"]) + yield dict(cond, context=null_context, context_ids=ids) + return + if axis == "action": + off = cond.get("offset_px") + assert off is not None, "flowmap: action null 需要 cond['offset_px']" + off0 = torch.zeros_like(off) + c = dict(cond, offset_px=off0) + mi = cond.get("mask_input") + if mi is not None: + if mask_input_fn is None: + from distill.data import make_mask_input as _mk # 惰性 import + c["mask_input"] = _mk(off0, int(mi.shape[-2]), int(mi.shape[-1])).to( + device=mi.device, dtype=mi.dtype) + else: + c["mask_input"] = mask_input_fn(off0) + yield c + return + # anchor / hist / ctx:掩码干预,只动裸模块属性 + assert bare is not None, f"flowmap: {axis} null 是注意力掩码干预,必须给 bare=unwrap(model)" + saved = (bare.train_local_attn_size, bare.train_sink_size, bare.train_drop_anchor) + if axis == "ctx": + bare.train_local_attn_size, bare.train_sink_size = 1, 0 # 谁都看不到 + elif axis == "hist": + bare.train_local_attn_size, bare.train_sink_size = 1, 1 # 只看得到 cell 0 + else: # anchor + bare.train_drop_anchor = True # 只摘掉 cell 0 + yield dict(cond) + finally: + if saved is not None: + bare.train_local_attn_size, bare.train_sink_size, bare.train_drop_anchor = saved + + +# ---------------------------------------------------------------------------- +# 中心差分 dF/dt +# ---------------------------------------------------------------------------- + +def probes_needed(t, r) -> bool: + """t 与 r **逐位相等**时不用跑探针(dF/dt 恒为 0)。 + + 不只是省两次前向:`0 × NaN = NaN` 而不是 0,所以这个跳过同时是数值熔断器 —— + diffusion 槽上哪怕探针炸了也进不了 loss。判定用 `==`(`sample_tr` 里 diffusion 槽是 + `torch.where(is_d, t, r)`,逐位相等有保证),不用容差。 + """ + if torch.is_tensor(t) or torch.is_tensor(r): + tt = t if torch.is_tensor(t) else torch.as_tensor(t) + rr = r if torch.is_tensor(r) else torch.as_tensor(r) + return bool((tt != rr).any()) + return float(t) != float(r) + + +def _hi(x: torch.Tensor) -> torch.Tensor: + """提升到至少 fp32 做系数/残差运算;已经是 fp64 的**保持 fp64**。 + + 不要写成 `.float()`:那会把 fp64 降成 fp32,解析门禁(fp64 闭式核对)就只剩 1e-8 的分辨率, + 量纲 bug 的注入实验会被浮点噪声盖住。生产里 latent 是 bf16,这个函数返回 fp32,行为不变。 + """ + return x if x.dtype in (torch.float32, torch.float64) else x.float() + + +def _hi_dtype(x: torch.Tensor) -> torch.dtype: + """时间标量(t / r / width)该用的 dtype:fp64 输入配 fp64,其余一律 fp32。""" + return torch.float64 if x.dtype == torch.float64 else torch.float32 + + +def _bvec(v, b: int, device, dtype=torch.float32) -> torch.Tensor: + if torch.is_tensor(v): + out = v.to(device=device, dtype=dtype).reshape(-1) + else: + out = torch.full((b,), float(v), device=device, dtype=dtype) + if out.numel() == 1 and b > 1: + out = out.expand(b).contiguous() + assert out.shape == (b,), f"flowmap: 期望 [b]={b} 的标量向量,得到 {tuple(out.shape)}" + return out + + +@torch.no_grad() +def central_difference(u_fn, x_t: torch.Tensor, x0: torch.Tensor, noise: torch.Tensor, + t, r, *, epsilon: float = FLOWMAP_EPSILON, den: float = 1.0, + eps_clamp: bool = True, t_min: float = T_MIN, t_max: float = T_MAX, + pin_first_cell: bool = True) -> torch.Tensor: + """dF/dt 的中心差分(上游 `compute_central_difference`, trainer:260-277)。 + + 单位(★ 最容易写错的一处,写错了 1000× 也不会报错): + v = ε − x0 速度(σ 单位,dx/dσ) + t_p = min(t + ε_h, 1000) t_m = max(t − ε_h, 0) **时间**扰动不除 1000 + x_p = keep_frame0(x_t + v·(t_p − t)/1000, x0) **latent** 扰动除 1000 + x_m = keep_frame0(x_t − v·(t − t_m)/1000, x0) + dF/dt = (u_p − u_m) / (width · den) width = t_p − t_m + + 闭式核对(`u = A·x + b·t/1000 + c·r/1000`,轨迹 x(t) = x0 + (t/1000)·v): + 真值 dF/dt = A·v/1000 + b/1000,中心差分恰好给出同一个值(test 里到 8e-18)。 + + `den`:上游把探针**只用条件分支**跑(`u_func` 传的是 prompt_embeds,不做融合),再整体除以 + `guidance`。所以 dF/dt 是**条件场**的导数除以 den,**不是**融合场的导数(那还要再跑 2·|axes| + 次 null 探针)。这是上游的选择,照抄。 + + `eps_clamp=True`(默认,本移植的偏离):把探针钉在 [t_min, t_max] 内,并用**实际**步长做分母。 + t=1000(σ=1,每条轨迹的起点,我们有 1/1000 的概率抽到)时 t_p 本来会是 1005 ⇒ σ>1 离分布。 + 不触边时 width 直接取字面量 `2·ε_h`:fp32 下 `(t+5)−(t−5)` 在 1000 个网格点里有 5 个 + 不精确等于 10.0(max|Δ| = 3.05e-5),取字面量既更准也与上游逐位一致。 + `eps_clamp=False` 复现上游(不夹、width ≡ 2·ε_h),给差分门禁用。 + + ⚠ bf16 噪声地板(**实测**,非推测):latent 扰动是 `v·ε/1000 = 0.005·v`,而 bf16 的相对 + 精度是 2^-8 ≈ 0.0039。在 [4,48,21,30,52] 的随机 latent 上,实际落地的 `(x_p − x_m)` 相对 + 理想值 `2·v·ε/1000` 的**逐元素平均相对误差 29.4%**,其中 **17.4% 的元素扰动被完全舍掉** + (范数只差 1.3%,所以是零均值量化噪声不是偏置)。这是从上游继承的性质(它的 latent 也是 + bf16)。模型输出对 780×48 个元素求和会把它平均掉不少,但上线前值得用真权重量一下 + `u_p − u_m` 的信噪比(见 anystep_probe.py 的建议)。 + """ + assert x_t.dim() == 5 and x0.shape == x_t.shape and noise.shape == x_t.shape + b, dev = x_t.shape[0], x_t.device + tdt = _hi_dtype(x_t) + tv = _bvec(t, b, dev, tdt) + rv = _bvec(r, b, dev, tdt) + _assert_t_range("t", tv) + _assert_t_range("r", rv) + eh = float(epsilon) + assert eh > 0.0, f"flowmap: epsilon 必须 >0,得到 {eh}" + assert float(den) > 0.0, f"flowmap: den 必须 >0,得到 {den}" + + if not probes_needed(tv, rv): + # 全是 diffusion 槽:一次前向都不跑 + return torch.zeros((), device=dev, dtype=torch.float32) + + if eps_clamp: + t_p = torch.minimum(tv + eh, torch.full_like(tv, float(t_max))) + t_m = torch.maximum(tv - eh, torch.full_like(tv, float(t_min))) + clamped = (t_p != tv + eh) | (t_m != tv - eh) + width = torch.where(clamped, t_p - t_m, torch.full_like(tv, 2.0 * eh)) + assert bool((width > 0).all()), \ + f"flowmap: 中心差分步长退化成 0(t={tv.tolist()}, ε={eh}, 区间 [{t_min},{t_max}])" + else: # 上游:不夹、width ≡ 2ε + t_p, t_m = tv + eh, tv - eh + width = torch.full_like(tv, 2.0 * eh) + + v = (_hi(noise) - _hi(x0)) # ε − x0,至少 fp32 里算系数 + d_p = ((t_p - tv) / float(NUM_TRAIN_TIMESTEPS)).view(b, 1, 1, 1, 1) + d_m = ((tv - t_m) / float(NUM_TRAIN_TIMESTEPS)).view(b, 1, 1, 1, 1) + x_p = (_hi(x_t) + v * d_p).to(x_t.dtype) + x_m = (_hi(x_t) - v * d_m).to(x_t.dtype) + if pin_first_cell: + x_p, x_m = keep_frame0(x_p, x0), keep_frame0(x_m, x0) + + u_p = u_fn(x_p, t_p, rv) + u_m = u_fn(x_m, t_m, rv) + assert u_p.shape == x_t.shape and u_m.shape == x_t.shape, \ + f"flowmap: 探针输出形状 {tuple(u_p.shape)} != {tuple(x_t.shape)}" + + dF = (_hi(u_p) - _hi(u_m)) / (width * float(den)).view(b, 1, 1, 1, 1) + # t == r 的样本把 dF 硬置 0:(t−r)=0 已经让它进不了 target,但 0×NaN=NaN,必须显式清掉 + same = (tv == rv).view(b, 1, 1, 1, 1) + return torch.where(same, torch.zeros_like(dF), dF) + + +# ---------------------------------------------------------------------------- +# 目标与 loss +# ---------------------------------------------------------------------------- + +def flowmap_target(x0: torch.Tensor, noise: torch.Tensor, t, r, + dF_dt: torch.Tensor | float = 0.0) -> torch.Tensor: + """flow-map 目标(上游 trainer:381): + + target = (ε − x0) − (t − r)·dF/dt t, r 都是 0..1000 单位 + + `r == t` ⇒ 修正项恒为 0 ⇒ 退化成 rectified flow 的 `ε − x0`(= `flow_pf.training_target`)。 + fp32 里算:dF/dt 在大 (t−r) 上是重尾的,bf16 的 8 位尾数会先吃掉残差再进 MSE。 + """ + assert x0.dim() == 5 and noise.shape == x0.shape + b, dev = x0.shape[0], x0.device + tv = _bvec(t, b, dev, _hi_dtype(x0)) + rv = _bvec(r, b, dev, _hi_dtype(x0)) + _assert_t_range("t", tv) + _assert_t_range("r", rv) + v = _hi(noise) - _hi(x0) + if isinstance(dF_dt, (int, float)) and float(dF_dt) == 0.0: + return v + dt = (tv - rv).view(b, 1, 1, 1, 1) + d = dF_dt if torch.is_tensor(dF_dt) else torch.as_tensor(float(dF_dt), device=dev, dtype=v.dtype) + return v - dt * _hi(d) + + +def flowmap_loss(pred: torch.Tensor, target: torch.Tensor, *, + idx_t: torch.Tensor | None = None, t=None, + weight_type: str = "beta08", weight_floor: float = 0.0, + skip_first_cell: bool = True) -> tuple[torch.Tensor, dict]: + """逐样本的加权 MSE(上游 trainer:383-385)。返回 (loss_b [b], stats)。 + + se = (pred − target)^2 fp32 + per_sample = se[:, :, 1:].mean(dim=(1,2,3,4)) cell 0 是干净锚点,不计 + loss_b = per_sample · w(σ_t) beta08 钟形,逐样本一个标量 + + `skip_first_cell` 是**我们的**约定(stage1/stage2-CD 都这么切);上游把所有 noisy 帧都算进去, + 因为它的干净上下文是另一段 token,本来就不在这个张量里。 + + 权重按下标取(`idx_t`)比按值 argmin 反查(`t`)便宜且等价,两者给一个即可。 + 上游 `loss.unsqueeze(-1) * weight` 再 `.mean(-1)`:weight 是 [b,f] 但逐帧同值,等价于逐样本 + 乘一个标量 —— 这里直接写成标量乘法。 + """ + assert pred.shape == target.shape and pred.dim() == 5, \ + f"flowmap: pred {tuple(pred.shape)} vs target {tuple(target.shape)}" + se = (_hi(pred) - _hi(target)) ** 2 + se_l = se[:, :, 1:] if skip_first_cell else se + assert se_l.shape[2] >= 1, "flowmap: skip_first_cell=True 时至少要有 2 个 cell" + per_sample = se_l.mean(dim=(1, 2, 3, 4)) # [b] + if idx_t is not None: + w = weight_of_idx(idx_t.to(pred.device), weight_type, weight_floor).to(se.dtype) + elif t is not None: + w = weight_of_t(t, weight_type, weight_floor).to(device=pred.device, dtype=se.dtype) + else: + w = torch.ones_like(per_sample) + w = w.reshape(-1) + assert w.shape == per_sample.shape, f"flowmap: 权重形状 {tuple(w.shape)} != [b]={tuple(per_sample.shape)}" + loss_b = per_sample * w + stats = { + "mse": se_l.mean().detach(), # 完全不加权,跨配方可比(= ar_tf_loss 的 "mse") + "loss_uw": per_sample.mean().detach(), + "tw_mean": w.mean().detach(), + } + return loss_b, stats + + +def adaptive_balance(loss_b: torch.Tensor, is_diffusion: torch.Tensor, + gather_fn=None, eps: float = 1e-5) -> tuple[torch.Tensor, dict]: + """上游 trainer:386-390 的自适应配平:把每个**非** diffusion 样本的 loss 重整到全局 diffusion 均值。 + + gl = gather(loss_b.detach()) [G] ← 集合通信,每个 rank 每个 micro 都要跑 + gm = gather(is_diffusion) [G] + scale = gl[gm].mean() / (loss_b.detach() + eps) + loss_b = where(is_diffusion, loss_b, loss_b · scale) + + 代数性质(就是它让 (t−r)·dF/dt 这一项可训):重整之后**每个非 diffusion 样本的 loss 值恰好 + 等于全局 diffusion 均值**(差一个 eps/(L+eps) 的相对量),梯度方向不变、量级被拉平。 + 没有它,修正项那条比普通 flow matching 重尾得多,直接主导梯度。 + + `torch.where` 代替上游的原地 masked 赋值:值相同,图更干净(原地赋值在 autograd 里要多留一份)。 + `gather_fn=None` ⇒ 单进程(测试 / dry_run);trainer 传 `accelerator.gather`。 + ⚠ 全局 diffusion 集合为空时**抛异常**而不是产出 NaN:`split_counts` 已经断言 n_diffusion>=1, + 这里是第二道。 + """ + assert loss_b.dim() == 1 and is_diffusion.shape == loss_b.shape + is_d = is_diffusion.bool() + det = loss_b.detach() + if gather_fn is None: + gl, gm = det, is_d + else: + gl = gather_fn(det) + # bool 的集合通信在部分后端上不受支持,统一走 float 再阈值化(值等价) + gm = gather_fn(is_d.to(det.dtype)) > 0.5 + gl, gm = gl.reshape(-1), gm.reshape(-1) + assert gl.shape == gm.shape, f"flowmap: gather 后形状不一致 {tuple(gl.shape)} vs {tuple(gm.shape)}" + if not bool(gm.any()): + raise RuntimeError( + "flowmap.adaptive_balance: 全局 diffusion 集合为空 —— 分母会是 nan。" + "检查 --diffusion_ratio / 全局 batch(split_counts 要求 n_diffusion>=1)," + "以及各 rank 的 split 生成器是不是同一个种子。") + gm_mean = gl[gm].mean() + scale = gm_mean / (det + float(eps)) + out = torch.where(is_d, loss_b, loss_b * scale) + info = { + "gm_mean": gm_mean.detach(), + "n_diffusion_global": int(gm.sum()), + "n_global": int(gm.numel()), + "scale_mean": scale[~is_d].mean().detach() if bool((~is_d).any()) else torch.zeros((), device=loss_b.device), + } + return out, info + + +# ---------------------------------------------------------------------------- +# 采样:平均速度场上的确定性 Euler +# ---------------------------------------------------------------------------- + +def euler_step(x: torch.Tensor, u: torch.Tensor, sigma_t, sigma_r) -> torch.Tensor: + """一步 flow-map Euler(上游 scheduler.step,按 num_train_timesteps 归一化后的形式): + + x_r = x_t − (σ_t − σ_r)·u(x_t, t, r) + + 符号与 DiffSynth 的 `prev_sample = sample + model_output·(σ_next − σ)` 一致(σ_next < σ), + 所以没有方向歧义。**全程无新噪声** —— 这与现有 `deploy_parallel/deploy_rollout` 的 + "估 x0 再用新噪声重新加噪" 是**两个不同的采样器**,把 flow-map 权重喂进后者会出似是而非的垃圾。 + """ + s_t, s_r = float(sigma_t), float(sigma_r) + assert s_t > s_r - 1e-9, f"flowmap: Euler 必须从噪往净走,得到 σ_t={s_t} → σ_r={s_r}" + return x - (s_t - s_r) * u + + +def euler_chain(u_fn, x: torch.Tensor, sigmas, pin_fn=None) -> torch.Tensor: + """沿一条 any-step 轴跑完整条 Euler 链(参考实现 / 解析门禁用;真正的部署采样器带 KV cache + 与逐 cell 提交,在 `distill/eval/rollout_eval.py`)。 + + u_fn(x, t_val, r_val) → u;t = σ·1000。`pin_fn(x)` 每步之后调一次(TI2V 锚点重新钉 cell 0)。 + """ + sig = sigmas if torch.is_tensor(sigmas) else torch.as_tensor(sigmas, dtype=torch.float32) + assert_anystep_axis(sig, terminal=bool(float(sig[-1]) == 0.0)) + for i in range(int(sig.numel()) - 1): + s_t, s_r = float(sig[i]), float(sig[i + 1]) + u = u_fn(x, s_t * NUM_TRAIN_TIMESTEPS, s_r * NUM_TRAIN_TIMESTEPS) + x = euler_step(x, u, s_t, s_r) + if pin_fn is not None: + x = pin_fn(x) + return x diff --git a/backup_2026-09-14/code/distill/longtraj.py b/backup_2026-09-14/code/distill/longtraj.py new file mode 100644 index 0000000000000000000000000000000000000000..cd4a7ec394a0d7a4a8f018ed8fc21893d78c6bf4 --- /dev/null +++ b/backup_2026-09-14/code/distill/longtraj.py @@ -0,0 +1,201 @@ +"""把 21-cell 的训练片拼成连续长轨迹 —— 长 horizon 训练/评测的数据层。 + +**为什么需要它**:stage1/2/3 全部只在 21 cell(5 秒)上训,而评测跑 41 cell、demo 想跑几分钟。 +loss 从来没有覆盖过 5 秒以上的时间跨度。数据里其实有长轨迹,只是从没被用过。 + +**数据事实**(都是实测,不是假设): + · `data/latent/train_eybx/*.pt` 每个是 21 cell = 81 帧 @16fps + · 同一 (session, seg_id) 下 `start_cell` 以 **21 为步长**递增 ⇒ 相邻片是同一条视频的连续窗口 + · 实测最长连续段 **45 个 clip = 945 cell = 236 秒**;扫 4000 个样本里 239/678 组有 ≥5 个连续片 + · ★ 但相邻片的 `video_t0` 相差 **5.25 s = 84 帧**,而每片只覆盖 81 帧 + ⇒ **每个接缝有 3 帧(0.1875 s)的空隙**,按 69 px/s 约 13 px。源 mp4 也是 81 帧, + 这 3 帧在切数据时就丢了,重编也拿不回来。这是这个数据集的硬限制,不要假装它不存在。 + +**世界坐标怎么接**(分解成两段,各用最可靠的来源): + 片内 80 帧 用该片自己的 `frame_offset_px`(sidecar 真值,精确) + 接缝 3 帧 用片末的逐帧速度外推(误差 ~2 px) + 交叉校验 `data/meta/*.jsonl` 里每片有起点世界坐标 (x, z);实测换算是 + px_x/Δx = +29.84、px_y/Δz = −19.04,比值 1.567 与 walk_speed_px_s 的 + 69.24/46.01 = 1.505 相差 4%(深度轴透视压缩)——两个独立来源互证。 + 直接拿 x/z 算整段位移不行:逐片估计的离散有 9~19%,整段就是几十 px 的误差。 + + python distill/longtraj.py --build # 建索引(读 jsonl,不碰 .pt,秒级) + python distill/longtraj.py --verify # 拼接自检:接缝位移 vs x/z 交叉校验 +""" +from __future__ import annotations + +import argparse +import collections +import glob +import json +import os + +import numpy as np +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.abspath(__file__))) +LATENT_DIR = os.path.join(ROOT, "data", "latent", "train_eybx") +META_GLOB = os.path.join(ROOT, "data", "meta", "*.jsonl") +INDEX = os.path.join(ROOT, "data", "latent", "longtraj_index.pt") + +CELLS_PER_CLIP = 21 +FRAMES_PER_CLIP = 81 # 1 + 4×20 +STRIDE_CELLS = 21 +STRIDE_FRAMES = 84 # 相邻片的 video_t0 间隔 +GAP_FRAMES = STRIDE_FRAMES - FRAMES_PER_CLIP # == 3 +# 实测标定(见文件头);只用于交叉校验,不用于生成偏移 +PX_PER_GAME_X, PX_PER_GAME_Z = 29.840, -19.040 + + +def build_index(latent_dir: str = LATENT_DIR, meta_glob: str = META_GLOB, + out: str = INDEX, log=print) -> dict: + """从 jsonl 建 (session, seg) → 连续 clip 列表 的索引。不 torch.load 任何 .pt。""" + have = {os.path.basename(p)[:-3] for p in glob.glob(os.path.join(latent_dir, "*.pt"))} + log(f"[index] latent 目录里 {len(have)} 个片") + by = collections.defaultdict(list) + n_meta = n_skip = 0 + for mp in sorted(glob.glob(meta_glob)): + with open(mp, encoding="utf-8") as f: + for line in f: + try: + r = json.loads(line) + except json.JSONDecodeError: + continue # jsonl 里有个别截断行,跳过 + n_meta += 1 + if r["clip_id"] not in have: + continue + # ★ transition.jsonl 的 1900 条是**合成转场片**(带 pair/src_a/src_b/n_burn, + # 由两段不同素材缝出来的),没有 seg_id/x/z,也根本不是连续视频 —— 必须排除, + # 否则会把人工缝合处当成真实的世界运动去训。 + if "seg_id" not in r: + n_skip += 1 + continue + by[(r["session"], r["seg_id"])].append( + (r["start_cell"], r["clip_id"], r.get("x"), r.get("z"))) + runs = [] + for (sess, seg), items in by.items(): + items.sort() + cur = [items[0]] + for prev, nxt in zip(items, items[1:]): + if nxt[0] - prev[0] == STRIDE_CELLS: + cur.append(nxt) + else: + if len(cur) > 1: + runs.append(dict(session=sess, seg_id=seg, items=cur)) + cur = [nxt] + if len(cur) > 1: + runs.append(dict(session=sess, seg_id=seg, items=cur)) + runs.sort(key=lambda r: -len(r["items"])) + idx = dict(runs=runs, cells_per_clip=CELLS_PER_CLIP, gap_frames=GAP_FRAMES, + stride_cells=STRIDE_CELLS) + torch.save(idx, out) + lens = np.array([len(r["items"]) for r in runs]) + log(f"[index] 读 {n_meta} 条 meta(跳过 {n_skip} 条合成转场片)⇒ {len(runs)} 个连续段(≥2 片)") + log(f"[index] 段长(片):中位 {int(np.median(lens))} · p90 {int(np.percentile(lens,90))} · 最长 {lens.max()}" + f" ⇒ 最长 {lens.max()*CELLS_PER_CLIP} cell = {lens.max()*CELLS_PER_CLIP*4/16:.0f} 秒") + for k in (2, 3, 5, 10, 20): + log(f"[index] ≥{k:2d} 片({k*CELLS_PER_CLIP*4/16:5.1f} 秒)的段:{int((lens>=k).sum())}") + log(f"[index] 写入 {out}") + return idx + + +def chain_offsets(frame_offsets: list[np.ndarray]) -> np.ndarray: + """把每片各自从 0 起算的逐帧偏移接成一条连续的世界轨迹 [L*81, 2]。 + + 接缝的 3 帧空隙按**该片末尾的逐帧速度**外推(见文件头:片内用真值,只有空隙外推)。 + """ + out = [frame_offsets[0].copy()] + origin = frame_offsets[0][-1].copy() + for fo in frame_offsets[1:]: + prev = out[-1] + v_end = prev[-1] - prev[-2] # 片末逐帧速度 + origin = origin + v_end * GAP_FRAMES # 跨过 3 帧空隙 + out.append(fo + origin) + origin = out[-1][-1].copy() + return np.concatenate(out, 0) + + +def load_run(run: dict, n_clips: int, start: int = 0, latent_dir: str = LATENT_DIR, + sidecar=None): + """取 run 里连续的 n_clips 片,返回拼好的长轨迹。 + + 返回 dict:latent [48, 21*n, 30, 52] · frame_off [81*n, 2] · cell_off [21*n, 2] + · prompts / actions / scenes(逐 cell 拼接)· seams(接缝处的绝对 cell 下标) + ★ latent 是**直接拼接**:第 j 片的 cell 0 在视频里只对应 1 帧(其余 cell 各 4 帧), + 所以每个接缝那一格的"曝光"比别处短。这是数据的性质,不是 bug,但训练时要知道。 + """ + from actionrope import infer + if sidecar is None: + sidecar = torch.load(infer.SIDECAR, map_location="cpu", weights_only=False) + items = run["items"][start:start + n_clips] + assert len(items) == n_clips, f"该段只有 {len(run['items'])} 片,取不到 {start}+{n_clips}" + lats, fos, prompts, actions, scenes = [], [], [], [], [] + for _, cid, _, _ in items: + d = torch.load(os.path.join(latent_dir, cid + ".pt"), map_location="cpu", + weights_only=False) + lats.append(d["latent"]) + fos.append(sidecar["clips"][cid]["frame_offset_px"].numpy().astype(np.float64)) + prompts += list(d["prompts"]) + actions += list(d["actions"]) + scenes += list(d["scenes"]) + frame_off = chain_offsets(fos) + from distill.eval.rollout_eval import frames_to_cells_n + n_cells = CELLS_PER_CLIP * n_clips + # 逐 cell 归约按每片各自的 21 格做,再拼 —— 不能整条丢给 frames_to_cells_n, + # 因为它假设「cell 0 = 1 帧、其余 4 帧」,而拼接后每 21 格就有一个这样的格子。 + cell_off = np.concatenate( + [frames_to_cells_n(frame_off[i*FRAMES_PER_CLIP:(i+1)*FRAMES_PER_CLIP], CELLS_PER_CLIP) + for i in range(n_clips)], 0) + return dict(latent=torch.cat(lats, dim=1), frame_off=frame_off, cell_off=cell_off, + prompts=prompts, actions=actions, scenes=scenes, + seams=[i * CELLS_PER_CLIP for i in range(1, n_clips)], + clip_ids=[c for _, c, _, _ in items], n_cells=n_cells) + + +def verify(n_runs: int = 20, n_clips: int = 5, log=print) -> bool: + """拼接自检:把外推出来的接缝位移和 meta 里的 (x,z) 真值对照。""" + from actionrope import infer + idx = torch.load(INDEX, map_location="cpu", weights_only=False) + sc = torch.load(infer.SIDECAR, map_location="cpu", weights_only=False) + errs, mags = [], [] + for run in [r for r in idx["runs"] if len(r["items"]) >= n_clips][:n_runs]: + items = run["items"][:n_clips] + if any(it[2] is None for it in items): + continue + fos = [sc["clips"][c]["frame_offset_px"].numpy().astype(np.float64) + for _, c, _, _ in items] + chained = chain_offsets(fos) + for j in range(1, len(items)): + got = chained[j * FRAMES_PER_CLIP] - chained[(j - 1) * FRAMES_PER_CLIP] + dx = items[j][2] - items[j - 1][2] + dz = items[j][3] - items[j - 1][3] + ref = np.array([PX_PER_GAME_X * dx, PX_PER_GAME_Z * dz]) + errs.append(np.linalg.norm(got - ref)) + mags.append(np.linalg.norm(ref)) + errs, mags = np.array(errs), np.array(mags) + rel = errs / np.maximum(mags, 1e-6) + log(f"[verify] {len(errs)} 个接缝:外推位移 vs (x,z) 真值") + log(f"[verify] 绝对误差 中位 {np.median(errs):.1f} px p90 {np.percentile(errs,90):.1f} px") + log(f"[verify] 相对误差 中位 {np.median(rel):.3f} (标定本身离散 9~19%,所以 ≲0.2 即为一致)") + log(f"[verify] 位移量级 中位 {np.median(mags):.1f} px / 片") + ok = float(np.median(rel)) < 0.25 + log("[verify] " + ("通过:拼接的世界坐标与独立来源的 (x,z) 一致。" + if ok else "★ 未通过:拼接偏移与 (x,z) 对不上,别拿它训长 horizon。")) + return ok + + +def main(argv=None): + ap = argparse.ArgumentParser(description="长轨迹数据层") + ap.add_argument("--build", action="store_true") + ap.add_argument("--verify", action="store_true") + ap.add_argument("--n_clips", type=int, default=5) + a = ap.parse_args(argv) + if a.build: + build_index() + if a.verify: + return 0 if verify(n_clips=a.n_clips) else 1 + return 0 + + +if __name__ == "__main__": + raise SystemExit(main()) diff --git a/backup_2026-09-14/code/distill/lora.py b/backup_2026-09-14/code/distill/lora.py new file mode 100644 index 0000000000000000000000000000000000000000..922942ffaca91622b75c4de58bdd468cf462abee --- /dev/null +++ b/backup_2026-09-14/code/distill/lora.py @@ -0,0 +1,180 @@ +"""低秩补丁层(LoRA)—— 忠实移植 AnyFlow on-policy 阶段的训练面。 + +**为什么需要它。** 我们在 flow-map 学生上做 on-policy DMD 失败了五次,形状完全一样:权重相对 +初值只挪到 1e-4 量级,41-cell rollout 就开始退化,再往前走就烧白/烧黑。追过的原因(学习率、 +CFG 强度、critic 更新比、上下文梯度、监督覆盖面)逐一被对照实验否掉。 + +最后核实出来的差异只有一处:**上游两个阶段都只训 LoRA,我们做的是全量微调。** + + AnyFlow onpolicy yml: + lora_config.target_module_name = [attn1.to_q, attn1.to_k, attn1.to_v, attn1.to_out.0, + ffn.net.0.proj, ffn.net.2, delta_embedder, time_embedder] + param_names_to_optimize = [lora_A, lora_B, far_patch_embedding] + lora_rank = lora_alpha = 256 (scale = alpha/rank = 1.0) + critic(discriminator)用同一份 target 但**不含** delta/time 两个嵌入。 + +破坏的载体已经用拼接实验锁定:是 self-attn / ffn 的**权重矩阵**,bias / norm / embedding +全部无辜 —— 正是 LoRA 会挂的那一批。 + +★ 但「低秩之所以安全,是因为破坏藏在低秩表达不出来的方向里」这个说法**已被实测否掉**,别再用它当理由: + 把塌掉的那份改动量做 rank-256 截断(只保留 58~73% 的能量)再加回初值,模型**照样烧白**。 + 破坏就在前 256 个主方向里,rank-256 的补丁完全有能力表达出来。 + (脚本见 scratchpad/ranktrunc.py 的做法:对每个 target 矩阵的 Δ 做 SVD 截断,其余键保留成坏的, + 这样变量就只剩「秩」这一条。) + +所以留给补丁的理由只剩两条,都比原来弱: + · B 零初始化 ⇒ 第 0 步与初值**逐位相同**,更新从零速率起步。补丁训练走的是另一条路径, + 不是「全量微调那个坏终点的低秩投影」—— 上面那个实验没有触及这一条。 + · 上游在同类学生(flow map)上就是这么跑通的,而这是我们与它之间最后一处已知差异。 + +**为什么自己写而不用 peft。** peft 的 get_peft_model 会重写模块树并加自己的一层包装,与我们 +三种自定义前向模式(并行 / TF 双流 / 单 cell 流式 KV)和 FSDP 的交互没人验过;而我们要的东西 +很简单——包住若干个 nn.Linear。自己写还有一个实际好处:合并回去这条路是显然正确的, +存盘拿到的仍然是 832 键的普通权重,**部署与评测路径一行都不用改**。 + +用法: + install_lora(unwrap(student).dit, rank=256, alpha=256, is_student=True) + install_lora(unwrap(critic).dit, rank=256, alpha=256, is_student=False) + opt = AdamW(lora_parameters(dit), lr=2e-6, betas=(0.0, 0.999)) + ... + sd = merged_state_dict(dit) # 832 键,B@A 已折进 base,可直接存 +""" +from __future__ import annotations + +import contextlib +import math +import re + +import torch +import torch.nn as nn + +# 上游 target 在我们的模块树里的对应名(见文件头的 yml 引用) +TARGET_BLOCK = re.compile(r"^blocks\.\d+\.(self_attn\.[qkvo]|ffn\.[02])$") +TARGET_STUDENT_EXTRA = re.compile(r"^(delta_embedding|time_embedding)\.[02]$") + + +def is_target(name: str, *, is_student: bool) -> bool: + """cross_attn 不在上游 target 里,跟着排除。""" + if TARGET_BLOCK.match(name): + return True + return is_student and bool(TARGET_STUDENT_EXTRA.match(name)) + + +class LoRALinear(nn.Module): + """base(x) + (x @ A^T) @ B^T · (alpha/rank)。base 冻结,bias 从不参与。 + + ★ B 必须零初始化:这是「第 0 步与初值逐位相同」的唯一保证,也是低秩之外的另一层保护。 + 改成随机初始化不会报错,只会让训练从一个偏离的点开始 —— 那正是我们要避免的东西。 + """ + + def __init__(self, base: nn.Linear, rank: int, alpha: int): + super().__init__() + assert isinstance(base, nn.Linear), type(base) + self.base = base + for p in self.base.parameters(): + p.requires_grad_(False) + d_out, d_in = base.weight.shape + self.rank, self.scale = rank, alpha / rank + f = base.weight.dtype + self.lora_A = nn.Parameter(torch.empty(rank, d_in, dtype=f, device=base.weight.device)) + self.lora_B = nn.Parameter(torch.zeros(d_out, rank, dtype=f, device=base.weight.device)) + nn.init.kaiming_uniform_(self.lora_A, a=math.sqrt(5)) + self.enabled = True # False ⇒ 只走 base(OPSD-V 的"教师 = 同一模型关掉 adapter",见 lora_disabled) + + def forward(self, x): + if not self.enabled: + return self.base(x) + return self.base(x) + torch.nn.functional.linear( + torch.nn.functional.linear(x, self.lora_A), self.lora_B) * self.scale + + @torch.no_grad() + def delta_w(self) -> torch.Tensor: + return (self.lora_B.float() @ self.lora_A.float() * self.scale) + + +def install_lora(root: nn.Module, *, rank: int = 256, alpha: int = 256, + is_student: bool, log=print) -> int: + """把匹配到的 nn.Linear 就地换成 LoRALinear,并冻结其余所有参数。返回替换个数。""" + hits = [(n, m) for n, m in root.named_modules() + if isinstance(m, nn.Linear) and is_target(n, is_student=is_student)] + if not hits: + raise SystemExit("install_lora 没匹配到任何 Linear —— 模块名口径变了") + for name, mod in hits: + parent = root.get_submodule(name.rsplit(".", 1)[0]) if "." in name else root + setattr(parent, name.rsplit(".", 1)[-1], LoRALinear(mod, rank, alpha)) + # 冻结一切非 LoRA 参数(含所有 bias / norm / embedding / patch_embedding / head) + n_tr = n_all = 0 + for n, p in root.named_parameters(): + keep = n.endswith(("lora_A", "lora_B")) + p.requires_grad_(keep) + n_all += p.numel() + n_tr += p.numel() if keep else 0 + log(f"[lora] {'学生' if is_student else 'critic'}:包了 {len(hits)} 个 Linear " + f"(rank={rank} alpha={alpha} scale={alpha/rank:g})," + f"可训 {n_tr/1e6:.1f}M / {n_all/1e6:.0f}M = {100*n_tr/n_all:.2f}%") + return len(hits) + + +@contextlib.contextmanager +def lora_disabled(root: nn.Module): + """临时关掉 root 下所有 LoRALinear 的补丁项:前向逐位等于冻结的 base(官方 OPSD-V 的教师就是这么切的, + _swap_generator_to_ema / teacher adapter;这里 base 冻结 ⇒ 教师 = init_ckpt)。嵌套安全,异常也会恢复。""" + mods = [m for m in root.modules() if isinstance(m, LoRALinear)] + prev = [m.enabled for m in mods] + for m in mods: + m.enabled = False + try: + yield + finally: + for m, e in zip(mods, prev): + m.enabled = e + + +def lora_parameters(root: nn.Module): + ps = [p for n, p in root.named_parameters() if n.endswith(("lora_A", "lora_B"))] + if not ps: + raise SystemExit("lora_parameters 空 —— install_lora 没跑或名字对不上") + return ps + + +@torch.no_grad() +def merged_state_dict(root: nn.Module, src: dict | None = None) -> dict: + """把 B@A·scale 折进 base.weight,返回**没有 LoRA 包装**的普通 state_dict。 + + src 非 None 时从它取值(FSDP 下先 accelerator.get_state_dict 拿到全量,再在这里折); + 否则直接读 root 自己的(单进程 / CPU 路径)。 + """ + sd = dict(src if src is not None else root.state_dict()) + out, n = {}, 0 + # ★ FSDP 会把每个 DiTBlock 就地包一层,named_modules() 的名字里多出 `_fsdp_wrapped_module`(激活检查点则是 + # `_checkpoint_wrapped_module`),而 FULL_STATE_DICT 的键是干净的 —— 不剥掉这些壳,下面按 owner 查模块会全部落空 + # (2026-09-10 stage4 LoRA 冒烟第一次存盘就是这么炸的)。 + _WRAP = {"_fsdp_wrapped_module", "_checkpoint_wrapped_module"} + lora = {".".join(p for p in n_.split(".") if p not in _WRAP): m + for n_, m in root.named_modules() if isinstance(m, LoRALinear)} + for k, v in sd.items(): + if k.endswith((".lora_A", ".lora_B")): + continue + if ".base." in k: + owner, tail = k.split(".base.", 1) + # ★ 前缀无关地找模块:save_dit 的 post 钩子在 strip_dit_prefix **之前**跑, + # 所以这里的键还带着 "dit." 之类的外壳前缀,直接拿 owner 去查会全部落空 + # (表现为「一个矩阵都没合并」——下面那条断言就是为这个留的)。 + mod = lora.get(owner) + if mod is None: + for cut in range(1, owner.count(".") + 1): + cand = owner.split(".", cut)[-1] + if cand in lora: + mod = lora[cand] + break + if mod is not None and tail == "weight": + A, B = sd.get(owner + ".lora_A"), sd.get(owner + ".lora_B") + if A is not None and B is not None: + v = (v.float() + (B.float() @ A.float()) * mod.scale).to(v.dtype) + n += 1 + out[owner + "." + tail] = v + else: + out[k] = v + if n == 0 and lora: + raise SystemExit("merged_state_dict 一个矩阵都没合并 —— 键名口径对不上,别存这份权重") + return out diff --git a/backup_2026-09-14/code/distill/onpolicy.py b/backup_2026-09-14/code/distill/onpolicy.py new file mode 100644 index 0000000000000000000000000000000000000000..86856f63cdd3c20d0cbb4842ae0845e54ee70f7d --- /dev/null +++ b/backup_2026-09-14/code/distill/onpolicy.py @@ -0,0 +1,378 @@ +"""stage3-onpolicy 的算法层:AnyFlow 的 on-policy DMD,移植到 ActionRoPE 的因果 AR + 滑窗 KV。 + +上游 = `vendor/AnyFlow/far/trainers/trainer_far_wan_anyflow_onpolicy.py` + + `vendor/AnyFlow/far/pipelines/pipeline_far_wan_anyflow.py::inference / training_rollout` + +它与我们原来那份 `stage3_dmd/dmd_arope.py`(WorldMind 口径)有三处**本质**差别,只有第一处是 +新机制,另外两处是命名/形式上的澄清: + +1. ★ **rollout 恒定 3 次前向,与步数 N 无关**(`pipeline_far_wan_anyflow.py:443-449`)。 + 因为学生是 flow map,「从任意 t 跳到任意 r」本来就是它的定义,所以中间步不用跑: + + prev = [σ_0, σ_g ] 一步跳到 g + current = [σ_g, σ_{g+1}] + post = [σ_{g+1}, 0 ] 一步跳到终点 + + 三段**都带梯度**(上游 inference() 里没有任何 no_grad)。压掉的是**前向次数**(N → 3), + 不是带梯度的图 —— 每个 in-window cell 仍有 3 次图,是旧 exit_step 版(1 次/cell)的 3 倍。 + 所以 grad_horizon 要相应调小:horizon 20 在 8×140 GB 上直接 OOM,实测 6 可跑。 + + `g = randrange(0, N)` 每次 rollout 抽一次(各 rank 同步)。WorldMind 的 exit_step 是 + 「跑到第 g 步就停」,要跑 g 次前向;这里是「跳过去」,永远 3 次。 + +2. ★ **每次 rollout 的步数 N 从 `[2,4,8,16,50]` 里随机抽**(`trainer:213`)。这是 on-policy + 阶段**保住 any-step 性质**的唯一机制:只在一张固定表上做 DMD,会把别的步数训丢。 + +3. 上游叫 `discriminator` 的那个模型**不是 GAN 判别器** —— `discriminator_loss` 是在学生 + 自己生成的样本上做普通 flow-matching 回归(`trainer:246-251`),也就是 DMD 的 **fake score**。 + 与我们 `dmd_arope.py` 里的 `critic` 是同一个东西,这里沿用 `critic` 这个名字。 + +三条与 ActionRoPE 契约相关、上游没有的约束(写错都不报错): + * cell 0 是干净 TI2V 锚点,任何时候都不进 loss、不被加噪。 + * 提交进 KV cache 恒用 `t=r=0` 的 detach 结果 —— 这是 TF clean 流的同分布要求,与 flow map 无关。 + * real / fake score 都在 `r == t` 上调用(上游 `trainer:120,125` 明写 `r_timestep=timesteps`), + 也就是当**普通扩散**用。它们不必是 flow map,我们就用 827 键的 stage1b 教师。 +""" +from __future__ import annotations + +import torch + +from distill import flowmap as fm + +__all__ = [ + "STEP_LIST", "draw_rollout_plan", "RolloutPlan", + "three_range_sigmas", "x0_from_u", "dmd_grad", "dmd_generator_loss", + "critic_flow_loss", "logit_normal_timesteps", "anystep_rollout", +] + +# 上游 `rollout_cfg.num_inference_steps_list`(onpolicy yml:105) +STEP_LIST = (2, 4, 8, 16, 50) + + +class RolloutPlan: + """一次 rollout 的抽签结果。所有 rank 必须拿到**同一份**,否则三段的 σ 对不上、 + DMD 的梯度会在不同 rank 上落在不同噪声档,all-reduce 之后是一锅粥(且不报错)。""" + + __slots__ = ("n_steps", "grad_idx", "sigmas") + + def __init__(self, n_steps: int, grad_idx: int, sigmas: torch.Tensor): + self.n_steps, self.grad_idx, self.sigmas = int(n_steps), int(grad_idx), sigmas + + def __repr__(self): + return f"RolloutPlan(N={self.n_steps}, g={self.grad_idx}, σ={[round(float(x),4) for x in self.sigmas]})" + + +def draw_rollout_plan(gen: torch.Generator | None = None, *, step_list=STEP_LIST, + device=None, accelerator=None) -> RolloutPlan: + """抽 (N, g) 并算出 any-step 轴。`accelerator` 非 None 时从 rank0 广播(上游 trainer:214,219)。 + + `gen` 只在单进程/测试里用;多卡一律走广播 —— 各 rank 自己抽同一个种子也「通常」一致, + 但一旦哪个 rank 多消耗一次随机数就会静默错开,广播才是硬保证。 + """ + if accelerator is not None and getattr(accelerator, "num_processes", 1) > 1: + buf = torch.zeros(2, dtype=torch.long, device=accelerator.device) + if accelerator.is_main_process: + i = int(torch.randint(len(step_list), (1,), generator=gen).item()) + n = int(step_list[i]) + buf[0], buf[1] = n, int(torch.randint(n, (1,), generator=gen).item()) + torch.distributed.broadcast(buf, src=0) + n_steps, grad_idx = int(buf[0]), int(buf[1]) + else: + n_steps = int(step_list[int(torch.randint(len(step_list), (1,), generator=gen).item())]) + grad_idx = int(torch.randint(n_steps, (1,), generator=gen).item()) + return RolloutPlan(n_steps, grad_idx, fm.anystep_sigmas(n_steps, device=device)) + + +def three_range_sigmas(plan: RolloutPlan) -> tuple[tuple[float, float] | None, + tuple[float, float], + tuple[float, float] | None]: + """把 any-step 轴切成上游那三段(`pipeline_far_wan_anyflow.py:443-445`)。 + + 轴长 N+1(末位 0.0)。g ∈ [0, N): + prev (σ[0], σ[g]) —— g == 0 时是空段(起点就是 g),返回 None + current (σ[g], σ[g+1]) —— 恒非空,带梯度 + post (σ[g+1], σ[-1]) —— g == N-1 时 σ[g+1] 就是末位 0.0,空段,返回 None + + `t == r` 的段上游直接 `continue`(:394),所以这里用 None 表示,别让调用方去跑一次 + Δσ=0 的 Euler —— 那一步数值上是恒等,但会白跑一次 5B 前向。 + """ + s = plan.sigmas + g, N = plan.grad_idx, plan.n_steps + assert 0 <= g < N, f"grad_idx {g} 必须落在 [0, {N})" + assert int(s.numel()) == N + 1, f"σ 轴长应为 {N + 1},得到 {int(s.numel())}" + a, b, c = float(s[0]), float(s[g]), float(s[g + 1]) + d = float(s[-1]) + prev = None if g == 0 else (a, b) + cur = (b, c) + post = None if (g + 1) >= N else (c, d) + return prev, cur, post + + +def x0_from_u(x: torch.Tensor, u: torch.Tensor, sigma_t) -> torch.Tensor: + """从 flow-map 输出取 x0 估计:一步跳到 σ_r = 0。 + + = 上游 `dmd_scheduler.step(noise_pred, t, noisy, torch.zeros_like(t))` + (`trainer:121,126,132`)—— r 恒为 0,所以就是 `x − σ_t·u`。 + """ + return fm.euler_step(x, u, sigma_t, 0.0) + + +def dmd_grad(pred_fake_x0: torch.Tensor, pred_real_x0: torch.Tensor, + generated: torch.Tensor, *, normalization: bool = True, + eval_mask: torch.Tensor | None = None) -> torch.Tensor: + """DMD 梯度(上游 `_compute_kl_grad` step 3-4,trainer:141-150)。 + + grad = (x0_fake − x0_real) / mean|generated − x0_real| + + 归一化的分母是**逐样本**的(上游 `mean(dim=[1,2,3,4], keepdim=True)`)。 + `eval_mask`([F] bool)非 None 时只在被打分的 cell 上归约 —— ActionRoPE 的 cell 0 是干净 + 锚点,把它算进分母会把归一化系数拉偏;上游没有这个概念,所以它没有这一项。 + + 上游**没有** clamp(min=1e-2)(那是 WorldMind 的 dmd_gm.py 有的)。这里保持上游原样, + 只做 nan_to_num —— 分母是 |真样本 − 真分数估计| 的均值,退化到 0 意味着 real score 已经 + 完美,那时 grad 本来就该是 0/0,nan_to_num 会把它变成 0,是对的。 + """ + grad = pred_fake_x0 - pred_real_x0 + if normalization: + p_real = generated - pred_real_x0 + if eval_mask is not None: + idx = torch.nonzero(eval_mask, as_tuple=True)[0] + norm = p_real.index_select(2, idx).abs().mean(dim=[1, 2, 3, 4], keepdim=True) + else: + norm = p_real.abs().mean(dim=[1, 2, 3, 4], keepdim=True) + grad = grad / norm + return torch.nan_to_num(grad) + + +def dmd_generator_loss(generated: torch.Tensor, grad: torch.Tensor, weight: float = 1.0) -> torch.Tensor: + """把 grad 变成一个可反传的标量(上游 trainer:195): + + loss = w · MSE(generated, (generated − grad).detach()) + + 这不是一个"距离",是把预先算好的梯度塞进 autograd 的标准手法: + d(loss)/d(generated) ∝ grad。所以 **loss 的数值本身没有意义**,别拿它当收敛判据。 + 上游用 double() 算这一步,照抄 —— generated 在 bf16 里,(g − grad) 的残差会被尾数吃掉。 + """ + return weight * torch.nn.functional.mse_loss( + generated.double(), (generated.double() - grad.double()).detach(), reduction="mean") + + +def logit_normal_timesteps(batch: int, *, mean: float = 0.0, std: float = 1.0, + gen: torch.Generator | None = None) -> torch.Tensor: + """critic 训练用的噪声档抽样(上游 `discriminator_loss` trainer:236, + `compute_density_for_timestep_sampling(weighting_scheme='logit_normal', logit_mean=0, logit_std=1)`)。 + + 返回 [b] 的 **shift 前** u ∈ (0,1):u = sigmoid(N(mean, std))。调用方还要 apply_shift 再 ×1000。 + 注意 generator 侧的 DMD 噪声档用的是**均匀** rand(trainer:183),两处不是同一个分布, + 别顺手统一 —— fake score 要在整条轨迹上准,而 DMD 的梯度只在被抽到的那一档上估。 + """ + return torch.sigmoid(torch.randn(batch, generator=gen) * std + mean) + + +def critic_flow_loss(u_pred: torch.Tensor, x0: torch.Tensor, noise: torch.Tensor, + *, eval_mask: torch.Tensor | None = None) -> torch.Tensor: + """fake score(上游的 `discriminator`)的训练目标(trainer:247-251): + + target = ε − x0 普通 rectified flow,**不带** flow map 的 (t−r) 修正项 + —— 它是在 r == t 上调用的,修正项本来就是 0。 + + `eval_mask` 非 None 时只在被打分的 cell 上取均值(ActionRoPE 的 cell 0 不进 loss)。 + """ + target = noise - x0 + se = (u_pred.float() - target.float()) ** 2 + if eval_mask is not None: + idx = torch.nonzero(eval_mask, as_tuple=True)[0] + se = se.index_select(2, idx) + return se.mean() + + +# ---------------------------------------------------------------------------- +# rollout:因果 AR + 滑窗 KV,每个 cell 走三段跳 +# ---------------------------------------------------------------------------- + +def anystep_rollout(student, initial_latent, ctx_ext, ids_ext, off_ext, num_gen_cells: int, + plan: "RolloutPlan", *, frame_cond, grad_horizon: int, + kv_window: int = 20, rope_cap: int = 20, sink_size: int = 0, + grad_start: int | None = None, gen: torch.Generator | None = None): + """学生用自己提交的历史自回归生成 num_gen_cells 个 cell —— on-policy 版。 + + 与 `stage3_dmd.self_forcing_rollout` 逐行对应,**只有一处不同**:每个 cell 内部不再沿 + 部署表逐步去噪 + 重新加噪,而是走上游的三段跳(`pipeline_far_wan_anyflow.py:443-449`): + + x ←(no_grad) jump(σ₀ → σ_g) prev + x ←( grad ) jump(σ_g → σ_{g+1}) current ← 全 rollout 唯一带梯度的前向 + x ←(no_grad) jump(σ_{g+1} → 0) post + + 于是**每个 cell 恒定 ≤3 次前向、与 N 无关**,而且带梯度的图只有一次单帧前向 —— + `dmd_arope` 里那个 77.8 GB 激活的问题(以及为它写的 stream_grad_replay)在这里不存在。 + + 返回 (generated [b,48,1+N,h,w], grad_mask [1+N] bool),与 self_forcing_rollout 同签名, + 所以下游的 score_tail / dmd_targets 那套可以原样接。 + """ + b, c, _, lat_h, lat_w = initial_latent.shape + dev = initial_latent.device + total = 1 + num_gen_cells + bare = unwrap_fn(student) + cache = bare.init_kv_cache(kv_window=kv_window, sink_size=sink_size, rope_cap=rope_cap) + prev_seg, cur_seg, post_seg = three_range_sigmas(plan) + + def _call(x, s_t, s_r, k, commit, ow, mk): + """一次 flow-map 前向。**必须**走 forward(..., kv_cache=):FSDP 的 all-gather 挂在 + 包装模块的 forward 上,直接调 forward_frame 拿到的是分片且不报错(dmd_arope risk 2)。""" + tt = torch.full((b,), float(s_t) * fm.NUM_TRAIN_TIMESTEPS, device=dev) + rr = torch.full((b,), float(s_r) * fm.NUM_TRAIN_TIMESTEPS, device=dev) + return student(x, tt, ctx_ext[:, k:k + 1], context_ids=ids_ext[:, k:k + 1], + r_timestep=rr, first_frame_cond=False, frame_index=k, + kv_cache=cache, commit=commit, offset_win=ow, mask_in_k=mk) + + ow0, mk0 = frame_cond(off_ext, 0, sink_size, kv_window, lat_h, lat_w) + with torch.no_grad(): + _call(initial_latent, 0.0, 0.0, 0, True, ow0, mk0) # 真实首帧,t=r=0 进缓存 + frame_list = [initial_latent[:, :, 0:1].detach()] + + if grad_start is None: + grad_start = int(torch.randint(1, max(2, total - grad_horizon + 1), (1,), generator=gen).item()) + grad_end = min(grad_start + grad_horizon, total) + + for k in range(1, total): + ow, mk = frame_cond(off_ext, k, sink_size, kv_window, lat_h, lat_w) + # CPU 上抽再搬:`torch.randn(..., device=cuda, generator=cpu_gen)` 在 CUDA 上直接报 + # "Expected a 'cuda' device type for generator"。与本文件其余噪声(generator_step / + # critic_step 里的 `randn(...).to(tail)`)口径一致,顺带让不同设备上可复现。 + # 单 cell 的张量很小,多一次 H2D 拷贝可以忽略。 + x = torch.randn(b, c, 1, lat_h, lat_w, generator=gen).to(device=dev, dtype=initial_latent.dtype) + in_window = grad_start <= k < grad_end + # ★ 三段**都**带梯度(上游 `inference()` 里没有任何 no_grad,pipeline:447-449)。 + # `grad_timestep` 的作用是把 N 次前向压成 **3** 次,不是「只让其中一次带梯度」—— + # 我第一版写成了后者,那样会丢掉 prev/post 两条通路的梯度,且不会报错。 + # 不在 grad 窗口里的 cell 仍然全程 no_grad:它们不进 loss,建图纯属浪费。 + with (torch.enable_grad() if in_window else torch.no_grad()): + if prev_seg is not None: + x = fm.euler_step(x, _call(x, *prev_seg, k, False, ow, mk), *prev_seg) + x = fm.euler_step(x, _call(x, *cur_seg, k, False, ow, mk), *cur_seg) + if post_seg is not None: + x = fm.euler_step(x, _call(x, *post_seg, k, False, ow, mk), *post_seg) + frame_list.append(x) + with torch.no_grad(): # 提交趟:detach 的 x0 + t=r=0 + _call(x.detach(), 0.0, 0.0, k, True, ow, mk) + + generated = torch.cat(frame_list, dim=2) + grad_mask = torch.tensor([grad_start <= k < grad_end for k in range(total)], device=dev) + # ★ 必须显式释放:cache 与它内部的 `_ref` 互相引用,引用计数放不掉环,只能等惰性的循环 GC。 + # 一条 rollout 的 K/V 是十几 GB,不放的话几步之内显存就爬满(实测 98→120→126 GB 后 OOM)。 + bare.release_kv_cache(cache) + return generated, grad_mask + + +def unwrap_fn(m): + """延迟 import,避免 distill.onpolicy ←→ distill.arope_dit 的循环。""" + from distill.arope_dit import unwrap + return unwrap(m) + + +# ---------------------------------------------------------------------------- +# SGF:bounded two-pass replay(vendor/SGF,pipeline/self_gradient_forcing_training.py:117-230) +# ---------------------------------------------------------------------------- + +def sgf_rollout(student, initial_latent, ctx_ext, ids_ext, off_ext, num_gen_cells: int, + sigmas, exit_idx: int, *, context_noise: float = 0.0, + kv_window: int = 20, rope_cap: int = 20, sink_size: int = 0, + gen: torch.Generator | None = None, unwrap_fn=None, frame_cond_fn=None): + """SGF 的 pass 1:**全程 no_grad** 的 AR rollout,只负责「录像」。 + + 录两样东西(上游 `_self_gradient_forcing_inference` 的 noisy_at_t / x_ctx_hat): + noisy_at_t 每个 cell 在抽中的退出档 `exit_idx` 上的**带噪输入** + x0_cache 每个 cell 提交进 KV 缓存的那份 x0(cache_mode="exit":退出档的 x0,不是走完的) + + 为什么 pass 1 可以全 no_grad —— 这正是 SGF 的论点:现在这条路上的梯度**本来就是断的** + (每个 cell 提交 KV 时是 `x.detach()`),所以在 pass 1 里建图只是浪费。真正的梯度由 pass 2 + 的一次并行 TF 前向补回来,那一次跨帧注意力才第一次带着梯度跑过自生成历史。 + + ★ 只跑到 exit_idx 就 break(上游 cache_mode="exit",trainer:179)。每个 cell 的前向数是 + exit_idx+1(去噪)+ 1(提交),期望约 N/2+1,与 anystep_rollout 的三段跳同量级。 + + 返回 (noisy_at_t, x0_cache),都是 [b,48,1+N,h,w] 且已 detach。 + """ + b, c, _, lat_h, lat_w = initial_latent.shape + dev = initial_latent.device + total = 1 + num_gen_cells + bare = unwrap_fn(student) + cache = bare.init_kv_cache(kv_window=kv_window, sink_size=sink_size, rope_cap=rope_cap) + + def _call(x, s_t, s_r, k, commit, ow, mk): + tt = torch.full((b,), float(s_t) * fm.NUM_TRAIN_TIMESTEPS, device=dev) + rr = torch.full((b,), float(s_r) * fm.NUM_TRAIN_TIMESTEPS, device=dev) + return student(x, tt, ctx_ext[:, k:k + 1], context_ids=ids_ext[:, k:k + 1], + r_timestep=rr, first_frame_cond=False, frame_index=k, + kv_cache=cache, commit=commit, offset_win=ow, mask_in_k=mk) + + ow0, mk0 = frame_cond_fn(off_ext, 0, sink_size, kv_window, lat_h, lat_w) + z0 = initial_latent[:, :, 0:1].detach() + with torch.no_grad(): + _call(z0, 0.0, 0.0, 0, True, ow0, mk0) # 真实首帧,t=r=0 进缓存 + # cell 0 是干净锚点:它的「带噪输入」就是它自己(pass 2 的 first_frame_cond 会把 t/r 抹成 0) + noisy_list, x0_list = [z0], [z0] + + with torch.no_grad(): + for k in range(1, total): + ow, mk = frame_cond_fn(off_ext, k, sink_size, kv_window, lat_h, lat_w) + x = torch.randn(b, c, 1, lat_h, lat_w, generator=gen).to(device=dev, + dtype=initial_latent.dtype) + noisy_at_exit, x0_exit = None, None + for i in range(len(sigmas) - 1): + s_t, s_r = float(sigmas[i]), float(sigmas[i + 1]) + if i == exit_idx: + noisy_at_exit = x # ★ 录的是**进入**这一档的输入 + u = _call(x, s_t, s_r, k, False, ow, mk) + if i == exit_idx: + x0_exit = x0_from_u(x, u, s_t) # 退出档的 x0 估计 + break # cache_mode="exit" + x = fm.euler_step(x, u, s_t, s_r) + assert noisy_at_exit is not None and x0_exit is not None, "没抓到退出档的状态" + noisy_list.append(noisy_at_exit) + x0_list.append(x0_exit) + _call(x0_exit, 0.0, 0.0, k, True, ow, mk) # 提交:与 x0_cache 逐位相同 + bare.release_kv_cache(cache) + return (torch.cat(noisy_list, dim=2).detach(), + torch.cat(x0_list, dim=2).detach()) + + +def sgf_replay(student, noisy_at_t, x0_cache, cond, sigmas, exit_idx: int, *, + context_noise: float = 0.0, gen=None, gradient_checkpointing: bool = True): + """SGF 的 pass 2:**一次带梯度的并行 TF 前向**,clean 半流喂 pass 1 自己生成并提交的历史。 + + 这就是被补回来的那条通路 —— 跨帧注意力这次带着梯度跑过自生成上下文 + (上游 trainer:216-230,`self_gradient_forcing_match_context=True` 分支)。 + + clean 半流必须与 pass 1 **真正提交进缓存的东西**一致(上游的 match_context)。我们提交的是 + `x0_exit`,所以这里喂的就是 `x0_cache`;`context_noise>0` 时两边都要加同一档噪声。 + + 几何:pass 2 是整片并行、first_frame_cond=True、锚在片自己的 cell 0;pass 1 的每个 cell + 锚在自己窗口里最老那一格。二者只在**整窗平移**上不同,而 RoPE 是相对编码、平移不改分数—— + 前提是 rollout 长度 == 打分片长(都是 1+K),此时 pass 1 的缓存跨度与 pass 2 的片完全重合。 + rollout 比片长时尾巴前段在 pass 1 里看过片外历史,那才是真的错配,所以别把 rollout 拉长。 + + 返回 pass 2 预测的 x0 [b,48,1+N,h,w],带梯度。 + """ + s_t, s_r = float(sigmas[exit_idx]), float(sigmas[exit_idx + 1]) + b = noisy_at_t.shape[0] + dev = noisy_at_t.device + tt = torch.full((b,), s_t * fm.NUM_TRAIN_TIMESTEPS, device=dev) + rr = torch.full((b,), s_r * fm.NUM_TRAIN_TIMESTEPS, device=dev) + if context_noise > 0: + noise = torch.randn(x0_cache.shape, generator=gen).to(x0_cache) + clean_x = fm.add_noise_scalar(x0_cache, noise, + torch.full((b,), context_noise, device=dev)) + clean_x = fm.keep_frame0(clean_x, x0_cache) # 锚点始终精确干净 + aug_t = torch.full((b,), context_noise * fm.NUM_TRAIN_TIMESTEPS, device=dev) + else: + clean_x, aug_t = x0_cache, None + # ★ 梯度检查点在这里不是可选项:pass 2 是双流 2×21×390 = 16380 token 过 30 层, + # 而 stage3 同时驻着四份模型(学生/critic 各带 fp32 主权重+优化器态、teacher、EMA)。 + # 不开实测 8×140 GB 全部 OOM(137.7 GiB 已分配)。stage1 的 TF 也是开着的。 + u = student(noisy_at_t, tt, cond["context"], context_ids=cond["context_ids"], + offset_px=cond["offset_px"], mask_input=cond["mask_input"], + first_frame_cond=True, r_timestep=rr, + clean_x=clean_x.detach(), aug_t=aug_t, + use_gradient_checkpointing=gradient_checkpointing) + return x0_from_u(noisy_at_t, u, s_t) diff --git a/backup_2026-09-14/code/distill/runlib.py b/backup_2026-09-14/code/distill/runlib.py new file mode 100644 index 0000000000000000000000000000000000000000..b4bc595e5af9483cf73c233b226c7847b57746d8 --- /dev/null +++ b/backup_2026-09-14/code/distill/runlib.py @@ -0,0 +1,542 @@ +#!/usr/bin/env python3 +"""三阶段蒸馏共用的 run 目录 / 日志 / checkpoint 约定。 + + from distill import runlib + run_dir = runlib.resolve_run_dir(args.output) + log = runlib.TextTee(os.path.join(run_dir, "train.log"), enabled=accel.is_main_process) + runlib.save_dit(accel, student, runlib.dit_path(run_dir, step), {"step": step}) + runlib.rotate(runlib.dit_glob(run_dir), args.keep_last_dits) + +目录布局(三个 stage 共用,run_dir 默认落在 /outputs/distill/): + + / + config.json 本次 run 的完整参数快照 + progress.json {"step": N, ...},续训只认它 + train.log TextTee 的人读日志(与 stdout 同步) + train_log.csv CsvLog,一步一行,固定表头 + train_log.jsonl JsonlLogger,一步一行 JSON(可被别的机器 tail) + dits/dit_step{N}.safetensors 学生原始权重,只为续训 —— 不要拿去部署 + ema/ema_step{N}.safetensors EMA 影子权重 = stage2 / stage3 的部署权重 + critic/critic_step{N}.safetensors stage3 的 fake-score critic,只为续训 + state_A/ state_B/ + state -> 软链 accelerate 完整分片存档(只有 stage1 用) + +为什么 dits / ema / critic 都要 rotate:单个文件 10.0 GB。WorldMind 只 rotate 了 +state_step*(infra/run.py:rotate_states 的注释明说不动 dits/),它的 v4 stage-1 run +光 dits/ 就吃掉 746 GB。这里 rotate() 对三种前缀一视同仁。 + +checkpoint 格式沿用 ActionRoPE 的(不是 WorldMind 的):单个 safetensors,827 个 bf16 +张量,DiT 键去掉 `dit.` 前缀(臂键保留 `arm.`),metadata 全是字符串,chmod 0644。 +这样 tests/check_ckpt.py、actionrope/infer.py、eval_bg50.py 不用改一行就能吃蒸馏产物。 + +stage2-flowmap 的产物是这个格式的**唯一一处分叉**:`AropeDiT.install_flowmap()` 多挂 5 个 +张量(`delta_embedding.{0,2}.{weight,bias}` + `delta_gate`),827 → **832**(AROPE_DIT_KEYS_FLOWMAP, ++20.5 MB)。格式本身一个字没变(单文件 / 全 bf16 / 字符串 metadata / 0644 / .tmp+rename), +只是键数变了 —— 于是上面那三个下游会**拒收**它。那是对的:flow map 要第二个时间步 r,拿旧的 +renoise 采样器去采它不会报错,只会安静地产出另一个模型的结果。用 is_flowmap_ckpt() 分流。 + +★ save_dit 显式 cast 到 bf16 并断言导出 dtype。stage3 在 prepare 前把每个模型 .float() +(FSDP + MixedPrecision(bf16) 下不这么做就没有 fp32 主权重),而 accelerator.get_state_dict +在 FSDP 分支返回的是 FULL_STATE_DICT(offload_to_cpu=True, rank0_only=True) —— rank0 CPU 上的 +**fp32**。不 cast 的话每个文件 20 GB(10 次保存 × 3 个文件 = 600 GB 而不是 300 GB), +而且 827-key / 10.0 GB 的格式承诺当场作废。 +""" +from __future__ import annotations + +import csv +import glob +import json +import os +import re +import shutil +import struct +import time + +import torch +import torch.nn as nn +from safetensors.torch import load_file, save_file + +REPO_ROOT = os.path.dirname(os.path.dirname(os.path.abspath(__file__))) +OUTPUT_ROOT = os.path.join(REPO_ROOT, "outputs", "distill") + +DIT_PREFIX = "dit." # AropeDiT 里 WanModel 的属性名;导出时剥掉 +ARM_PREFIX = "arm." # baseline 动作臂;蒸馏不用臂,保留只为格式兼容 +MASK_EMBEDDING_NAME = "arope_mask_embedding" +MASK_KEYS = (f"{MASK_EMBEDDING_NAME}.weight", f"{MASK_EMBEDDING_NAME}.bias") +AROPE_DIT_KEYS = 827 # 与 outputs/arope_10k_ga2/step-10000.safetensors 逐键一致 +REF_CKPT = os.path.join(REPO_ROOT, "outputs", "arope_10k_ga2", "step-10000.safetensors") + +# ---- flow map(stage2-flowmap):第二时间步 r 的 delta 分支 ---------------------------------- +# AropeDiT.install_flowmap() 把 delta_embedding(= time_embedding 的 deepcopy,读出层零初始化)和 +# delta_gate(persistent buffer)挂在 **dit 上**,于是 strip_dit_prefix 剥掉 `dit.` 之后就是下面这 +# 5 个平铺键 —— 格式一个字没变(单 safetensors / 全 bf16 / 字符串 metadata / 0644 / .tmp+rename), +# 只是键数 827 → 832(+20.5 MB,delta_embedding 是 10,229,760 个参数 = 5B 的 0.20 %)。 +# +# ★ 没有"精确 827 键"的导出:residual 形式下 u(x,t,t) = head(E(t) + g·D(P(t))),两条 +# Sequential(Linear, SiLU, Linear) 的和折不回一条。所以 actionrope/infer.py、tests/check_ckpt.py、 +# eval_bg50.py 会拒收 flow-map 权重 —— 这是 **对的**:拿旧的 renoise 采样器、不给 r 去采一个 flow map, +# 出来的东西看着像样但是另一个模型。导出时另外写 metadata flowmap=1 / flowmap_form / delta_gate, +# 下游按 metadata 选采样器,而不是按命令行开关。 +DELTA_EMBEDDING_NAME = "delta_embedding" +DELTA_GATE_NAME = "delta_gate" +FLOWMAP_KEYS = ( + f"{DELTA_EMBEDDING_NAME}.0.weight", f"{DELTA_EMBEDDING_NAME}.0.bias", + f"{DELTA_EMBEDDING_NAME}.2.weight", f"{DELTA_EMBEDDING_NAME}.2.bias", + DELTA_GATE_NAME, +) +AROPE_DIT_KEYS_FLOWMAP = AROPE_DIT_KEYS + len(FLOWMAP_KEYS) # 832 + + +# ---------------------------------------------------------------------------- +# 路径 +# ---------------------------------------------------------------------------- + +def resolve_run_dir(out: str) -> str: + """`out` 可以是绝对路径、相对仓库根的路径、或一个裸名字(落在 outputs/distill/ 下)。""" + if not out or not str(out).strip(): + raise ValueError("run dir 不能为空") + out = os.path.expanduser(str(out)) + if os.path.isabs(out): + return os.path.normpath(out) + if os.sep in out: + return os.path.normpath(os.path.join(REPO_ROOT, out)) + return os.path.join(OUTPUT_ROOT, out) + + +def dits_dir(run_dir: str) -> str: + return os.path.join(run_dir, "dits") + + +def ema_dir(run_dir: str) -> str: + return os.path.join(run_dir, "ema") + + +def critic_dir(run_dir: str) -> str: + return os.path.join(run_dir, "critic") + + +def dit_path(run_dir: str, step: int) -> str: + """学生原始权重:只为续训。部署一律用 ema_path()。""" + return os.path.join(dits_dir(run_dir), f"dit_step{int(step)}.safetensors") + + +def ema_path(run_dir: str, step: int) -> str: + """EMA 影子权重 = stage2 / stage3 的部署权重。""" + return os.path.join(ema_dir(run_dir), f"ema_step{int(step)}.safetensors") + + +def critic_path(run_dir: str, step: int) -> str: + return os.path.join(critic_dir(run_dir), f"critic_step{int(step)}.safetensors") + + +def dit_glob(run_dir: str) -> str: + return os.path.join(dits_dir(run_dir), "dit_step*.safetensors") + + +def ema_glob(run_dir: str) -> str: + return os.path.join(ema_dir(run_dir), "ema_step*.safetensors") + + +def critic_glob(run_dir: str) -> str: + return os.path.join(critic_dir(run_dir), "critic_step*.safetensors") + + +_STEP_RE = re.compile(r"step(\d+)") + + +def _step_of(path: str) -> int | None: + """从 dit_step500.safetensors / ema_step500.safetensors / state_step500 里取出 500。""" + m = _STEP_RE.search(os.path.basename(os.path.normpath(path))) + return int(m.group(1)) if m else None + + +def list_ckpts(pattern: str) -> list[tuple[int, str]]: + """[(step, path), ...] 按 step 升序。名字里解析不出 step 的条目直接忽略(也就永远不会被 rotate 删)。""" + out = [(s, p) for p in glob.glob(pattern) if (s := _step_of(p)) is not None] + return sorted(out) + + +def latest_ckpt(pattern: str) -> tuple[int, str] | None: + c = list_ckpts(pattern) + return c[-1] if c else None + + +def rotate(pattern: str, keep: int) -> list[str]: + """按 step 排序,删掉最旧的,保留最新 keep 个。dits / emas / critics / state_step* 通用。 + + keep <= 0 ⇒ 什么都不删(不是"全删",别把唯一的续训点抹了)。解析不出 step 的路径不碰。 + 返回被删掉的路径。目录用 rmtree,文件用 remove。""" + keep = int(keep) + if keep <= 0: + return [] + removed = [] + for _, p in list_ckpts(pattern)[:-keep]: + try: + if os.path.isdir(p) and not os.path.islink(p): + shutil.rmtree(p, ignore_errors=True) + else: + os.remove(p) + removed.append(p) + except OSError: + pass + return removed + + +def rotate_run(run_dir: str, keep_dits: int = 0, keep_emas: int = 0, keep_critics: int = 0) -> dict: + """一次把三种权重都 rotate 掉。默认 0 = 不动(显式传才删)。""" + return {"dits": rotate(dit_glob(run_dir), keep_dits), + "emas": rotate(ema_glob(run_dir), keep_emas), + "critics": rotate(critic_glob(run_dir), keep_critics)} + + +def disk_free_gb(path: str = REPO_ROOT) -> float: + try: + return shutil.disk_usage(path).free / 1e9 + except OSError: + return float("nan") + + +def warn_if_low_disk(path: str = REPO_ROOT, min_gb: float = 200.0) -> str | None: + free = disk_free_gb(path) + if free == free and free < min_gb: # 非 NaN 且不够 + return (f"磁盘告急:{path} 只剩 {free:.0f} GB(< {min_gb:.0f} GB)。一个 dit/ema/critic 是 10.0 GB," + f"一个 accelerate state 槽约 60 GB;调小 --save_every 或 --keep_last_*。") + return None + + +# ---------------------------------------------------------------------------- +# progress.json / config.json +# ---------------------------------------------------------------------------- + +def _atomic_write_text(path: str, text: str) -> None: + os.makedirs(os.path.dirname(os.path.abspath(path)), exist_ok=True) + tmp = f"{path}.tmp" + with open(tmp, "w", encoding="utf-8") as fh: + fh.write(text) + fh.flush() + os.fsync(fh.fileno()) + os.replace(tmp, path) + + +def progress_path(run_dir: str) -> str: + return os.path.join(run_dir, "progress.json") + + +def write_progress(run_dir: str, step: int, **extra) -> str: + """续训只认这个文件。原子写:保存 10 GB 权重时崩掉也不会留下半个 progress.json。""" + row = {"step": int(step), "wall": time.time(), "time": time.strftime("%Y-%m-%d %H:%M:%S"), **extra} + p = progress_path(run_dir) + _atomic_write_text(p, json.dumps(row, ensure_ascii=False, default=str)) + return p + + +def read_progress(run_dir: str) -> dict | None: + p = progress_path(run_dir) + if not os.path.isfile(p): + return None + try: + with open(p, encoding="utf-8") as fh: + return json.load(fh) + except (OSError, json.JSONDecodeError): + return None + + +def progress_step(run_dir: str, default: int = 0) -> int: + pr = read_progress(run_dir) + return int(pr["step"]) if pr and "step" in pr else int(default) + + +def save_config(run_dir: str, cfg: dict) -> str: + os.makedirs(run_dir, exist_ok=True) + p = os.path.join(run_dir, "config.json") + _atomic_write_text(p, json.dumps(cfg, indent=2, ensure_ascii=False, default=str)) + return p + + +# ---------------------------------------------------------------------------- +# checkpoint:导出 +# ---------------------------------------------------------------------------- + +def _unwrap(model): + """剥掉 DDP / DeepSpeedEngine / EmaShadow 之类的外壳,拿到裸 module。""" + seen = 0 + while hasattr(model, "module") and isinstance(getattr(model, "module"), nn.Module) and seen < 8: + model = model.module + seen += 1 + return model + + +def _gather_state_dict(accel, model) -> dict: + """accel=None ⇒ 单进程,直接 state_dict()。否则走 accelerator.get_state_dict(集合操作, + 每个 rank 都必须进来;FSDP 分支是 rank0_only,非主进程拿到空 dict)。 + + 非 nn.Module(distill.ema.EmaShadow)走本地 state_dict:它没进过 prepare,权重在每个 rank 上 + 都是整份的,get_state_dict 的 FSDP 分支反而会拿它当 FSDP 模块去遍历。""" + if accel is None or not isinstance(model, nn.Module): + return _unwrap(model).state_dict() + return accel.get_state_dict(model) + + +def strip_dit_prefix(state_dict: dict) -> tuple[dict, list[str]]: + """AropeDiT 包装的 state_dict → ActionRoPE 的导出键集。 + + 有 `dit.` 键 ⇒ 剥前缀,`arm.` 键原样保留,其余(包装层自己的 buffer 之类)丢掉并回报; + 没有 `dit.` 键 ⇒ 传进来的本来就是裸 WanModel,原样返回。""" + if not any(k.startswith(DIT_PREFIX) for k in state_dict): + return dict(state_dict), [] + out, dropped = {}, [] + for k, v in state_dict.items(): + if k.startswith(DIT_PREFIX): + out[k[len(DIT_PREFIX):]] = v + elif k.startswith(ARM_PREFIX): + out[k] = v + else: + dropped.append(k) + return out, dropped + + +def save_dit(accel, model, path: str, metadata: dict | None = None, *, + expect_keys: int | None = AROPE_DIT_KEYS, require_mask: bool = True, + dtype: torch.dtype = torch.bfloat16, log=None, post=None) -> int: + """把(可能被 ZeRO-2 / FSDP 包着的)模型导出成 ActionRoPE 格式的 safetensors,返回字节数。 + + 每个 rank 都要调用(get_state_dict 是集合操作),只有主进程落盘。 + + ★ 显式 cast 到 bf16 并断言导出 dtype。FSDP 下 accelerator.get_state_dict 返回的是 rank0 CPU 上的 + fp32 全量权重(stage3 在 prepare 前 .float() 过每个模型),不 cast 文件就是 20 GB,827-key / + 10.0 GB 的格式承诺当场作废,infer.py / check_ckpt.py 的 dtype 断言也会跟着变。 + + expect_keys / require_mask 是格式闸门:默认按 827 键 + arope_mask_embedding.{weight,bias} 校, + 对不上直接炸(少两个 mask 键 = 模型是拿 mask_channel=False 建的,装回 infer.py 会静默走错分支)。 + 小模型自测传 expect_keys=, require_mask=False。""" + if accel is not None: + accel.wait_for_everyone() + sd = _gather_state_dict(accel, model) + # post:gather 之后、格式闸门之前的一次改写。目前只有 LoRA 用它把 B@A 折回 base.weight—— + # 不折的话 state_dict 里是 `...base.weight` + `lora_A` + `lora_B`,expect_keys 当场拦下。 + # 每个 rank 都会走到这里,但只有主进程的 sd 非空(见 _gather_state_dict)。 + if post is not None and sd: + sd = post(sd) + is_main = True if accel is None else bool(accel.is_main_process) + size = 0 + if is_main and sd: + out, dropped = strip_dit_prefix(sd) + out = {k: v.detach().to(device="cpu", dtype=dtype).contiguous() for k, v in out.items()} + bad = sorted({str(v.dtype) for v in out.values()} - {str(dtype)}) + if bad: + raise RuntimeError(f"导出 dtype 不是 {dtype}:{bad}") + if expect_keys is not None and len(out) != expect_keys: + raise RuntimeError(f"{path}: 导出 {len(out)} 个张量,期望 {expect_keys} 个" + f"(丢弃的非 DiT 键 {dropped[:5]}…{len(dropped)})") + if require_mask: + miss = [k for k in MASK_KEYS if k not in out] + if miss: + raise RuntimeError(f"{path}: 缺 {miss} —— 模型是拿 mask_channel=False 建的?") + meta = {"arm": "arope", "mask_channel": "True"} + meta.update({k: str(v) for k, v in (metadata or {}).items()}) + meta.update({"n_tensors": str(len(out)), "dtype": str(dtype).replace("torch.", ""), + "saved": time.strftime("%Y-%m-%d %H:%M:%S")}) + os.makedirs(os.path.dirname(os.path.abspath(path)), exist_ok=True) + tmp = f"{path}.tmp" # 先写临时文件再 rename:写到一半崩掉不会留下半个 ckpt + save_file(out, tmp, metadata=meta) + os.chmod(tmp, 0o644) # safetensors 按 umask 写成 0600,推理可能由别的账号跑 + os.replace(tmp, path) + size = os.path.getsize(path) + msg = f"[save] {path} {len(out)} 个张量 {size / 1e9:.2f} GB" + if log is not None: + log(msg) + else: + print(msg, flush=True) + del out + del sd + if accel is not None: + accel.wait_for_everyone() + return size + + +# ---------------------------------------------------------------------------- +# checkpoint:装载 / 体检 +# ---------------------------------------------------------------------------- + +def load_dit_ckpt(model, path: str, *, assign: bool = False, allow_missing_mask: bool = True, + allow_missing: tuple | list = ()) -> dict: + """把 ActionRoPE 格式的 safetensors 装进 AropeDiT(键带 `dit.`)或裸 WanModel(键不带)。 + + strict —— 默认唯一放行的缺失是 arope_mask_embedding.{weight,bias}(install_arope 已经零初始化, + 从没装过 mask 通道的 ckpt 起步时就缺这两个键)。WorldMind 的 load_dit_ckpt 对任何 missing 都抛, + 照抄会拒收每一个 ActionRoPE checkpoint。 + + allow_missing:额外放行的键(去掉 `dit.` 前缀的名字,也接受带前缀的写法)。**唯一** 的正当用法是 + "先 install_flowmap() 再从 827 键的 stage1b 装载"这一个调用点,传 `allow_missing=FLOWMAP_KEYS`; + 别把它设成默认,否则任何一个真的漏键都会静默通过。推荐的顺序反过来:先 strict 装 827、再 install + (见 AropeDiT.install_flowmap 的文档),那样一个例外都不需要。 + + assign=False(默认):copy_ 进现有参数,保持模型自己的 dtype —— stage3 在 .float() 之后装 bf16 + ckpt 就靠这个,assign=True 会把参数直接换成 bf16 张量,fp32 主权重当场消失。""" + sd = load_file(path) + tgt = _unwrap(model) + tgt_keys = set(tgt.state_dict().keys()) + prefix = DIT_PREFIX if any(k.startswith(DIT_PREFIX) for k in tgt_keys) else "" + if prefix: + sd = {(k if k.startswith(prefix) else prefix + k): v for k, v in sd.items()} + missing, unexpected = tgt.load_state_dict(sd, strict=False, assign=assign) + allowed = {prefix + k for k in MASK_KEYS} if allow_missing_mask else set() + allowed |= {(k if prefix and k.startswith(prefix) else prefix + k) for k in allow_missing} + bad = [k for k in missing if k not in allowed] + if bad or unexpected: + raise RuntimeError(f"{path} 与模型键集不符:缺 {bad[:5]}…({len(bad)}),多 {list(unexpected)[:5]}…({len(unexpected)})") + return {"path": path, "n_tensors": len(sd), "prefix": prefix, + "missing": list(missing), "unexpected": list(unexpected)} + + +def read_ckpt_header(path: str) -> tuple[dict, dict]: + """只读 safetensors 头(不碰 10 GB 数据)→ ({key: {dtype, shape, data_offsets}}, metadata)。""" + with open(path, "rb") as fh: + n = struct.unpack(" bool: + """这份 ckpt 是不是 flow map(832 键)。**看张量键,不看 metadata** —— metadata 是人写的字符串, + 张量在不在是事实。下游(rollout_eval)应当据此选采样器:拿 renoise 采样器去采 flow map 不会报错, + 只会安静地产出另一个模型的结果。""" + hdr, _ = read_ckpt_header(path) + return all(k in hdr for k in FLOWMAP_KEYS) + + +def check_ckpt_format(path: str, expect_keys: int | None = AROPE_DIT_KEYS, + dtype: str = "BF16", require_mask: bool = True) -> dict: + """导出后的秒级体检(不加载权重):张量数 / dtype / mask 键 / metadata 全是字符串。 + + 正品参照:outputs/arope_10k_ga2/step-10000.safetensors —— 827 个 BF16 张量,9,999,690,792 B。""" + hdr, meta = read_ckpt_header(path) + dts = sorted({v["dtype"] for v in hdr.values()}) + res = {"path": path, "n_tensors": len(hdr), "dtypes": dts, "size": os.path.getsize(path), + "metadata": meta, "mask_keys": sorted(k for k in hdr if k.startswith(MASK_EMBEDDING_NAME))} + if expect_keys is not None and len(hdr) != expect_keys: + raise RuntimeError(f"{path}: {len(hdr)} 个张量,期望 {expect_keys}") + if dtype is not None and dts != [dtype]: + raise RuntimeError(f"{path}: dtype {dts},期望 ['{dtype}']") + if require_mask and set(res["mask_keys"]) != set(MASK_KEYS): + raise RuntimeError(f"{path}: mask 键 {res['mask_keys']},期望 {sorted(MASK_KEYS)}") + bad = {k: type(v).__name__ for k, v in meta.items() if not isinstance(v, str)} + if bad: + raise RuntimeError(f"{path}: metadata 必须全是字符串,{bad}") + return res + + +# ---------------------------------------------------------------------------- +# accelerate 完整存档(只有 stage1 用) +# ---------------------------------------------------------------------------- + +STATE_SLOTS = ("state_A", "state_B") + + +def save_state_rotating(accel, run_dir: str, trainer_state: dict) -> str: + """accelerator.save_state 到两个槽之一,/state 软链指向最新完整的那个。 + + 原地覆盖唯一的 state/ 目录时,保存中途崩溃会把唯一的续训点也毁掉;这里总是写到「不是当前 + state 指向」的那个槽,写完再 rename 换软链,任一时刻 state 都指向一份完整存档。不删任何目录, + 磁盘占两份(4 卡 ZeRO-2 约 2×60 GB)。--resume /state 照常。""" + link = os.path.join(run_dir, "state") + cur = os.path.basename(os.path.realpath(link)) if os.path.islink(link) else None + slot = STATE_SLOTS[1] if cur == STATE_SLOTS[0] else STATE_SLOTS[0] + state_dir = os.path.join(run_dir, slot) + accel.save_state(state_dir) + if accel.is_main_process: + with open(os.path.join(state_dir, "trainer_state.json"), "w", encoding="utf-8") as fh: + json.dump(trainer_state, fh, ensure_ascii=False, default=str) + tmp = link + ".tmp" + if os.path.lexists(tmp): + os.remove(tmp) + os.symlink(slot, tmp) + os.replace(tmp, link) # 只替换软链本身,不动任何目录 + print(f"[save] accelerator.save_state → {state_dir}({link} → {slot})", flush=True) + accel.wait_for_everyone() + return state_dir + + +# ---------------------------------------------------------------------------- +# 日志 +# ---------------------------------------------------------------------------- + +class TextTee: + """打到 stdout,同时带时间戳追加进 /train.log。 + + enabled=False(非主进程)⇒ 完全静默,也不开文件句柄。""" + + def __init__(self, path: str, enabled: bool = True): + self.path, self.enabled, self._f = path, bool(enabled), None + if self.enabled: + os.makedirs(os.path.dirname(os.path.abspath(path)), exist_ok=True) + self._f = open(path, "a", encoding="utf-8", buffering=1) + + def __call__(self, *args): + if not self.enabled: + return + msg = " ".join(str(a) for a in args) + print(msg, flush=True) + self._f.write(f"[{time.strftime('%Y-%m-%d %H:%M:%S')}] {msg}\n") + self._f.flush() + + def close(self): + if self._f is not None: + try: + self._f.close() + finally: + self._f = None + + +class CsvLog: + """固定表头的追加式 CSV(actionrope/train.py:328 的写法)。已存在且非空就不再写表头。""" + + def __init__(self, path: str, fields: list[str], enabled: bool = True): + self.enabled, self.f, self.w = bool(enabled), None, None + if not self.enabled: + return + os.makedirs(os.path.dirname(os.path.abspath(path)), exist_ok=True) + exists = os.path.isfile(path) and os.path.getsize(path) > 0 + self.f = open(path, "a", encoding="utf-8", newline="") + self.w = csv.DictWriter(self.f, fieldnames=fields, lineterminator="\n", extrasaction="ignore") + if not exists: + self.w.writeheader() + self.f.flush() + + def write(self, row: dict): + if not self.enabled: + return + self.w.writerow(row) + self.f.flush() + + def close(self): + if self.f is not None: + try: + self.f.close() + finally: + self.f = None + + +class JsonlLogger: + """一行一个 JSON 的追加式指标日志,每行都 flush,别的机器可以直接 tail。""" + + def __init__(self, path: str, enabled: bool = True): + self.path, self.enabled, self._f = path, bool(enabled), None + if self.enabled: + os.makedirs(os.path.dirname(os.path.abspath(path)), exist_ok=True) + self._f = open(path, "a", encoding="utf-8", buffering=1) + + def log(self, row: dict): + if not self.enabled: + return + row = dict(row) + row.setdefault("wall", time.time()) + self._f.write(json.dumps(row, ensure_ascii=False, default=str) + "\n") + self._f.flush() + + def close(self): + if self._f is not None: + try: + self._f.close() + finally: + self._f = None diff --git a/backup_2026-09-14/code/distill/stage1_ar/ar_tf.py b/backup_2026-09-14/code/distill/stage1_ar/ar_tf.py new file mode 100644 index 0000000000000000000000000000000000000000..b8ab1f4f3e7db19729f5d58c5a1c7da1f528c3bd --- /dev/null +++ b/backup_2026-09-14/code/distill/stage1_ar/ar_tf.py @@ -0,0 +1,695 @@ +#!/usr/bin/env python3 +"""stage1:teacher forcing 因果化 —— 把 ActionRoPE 的双向 SFT 检查点训成因果 AR 扩散模型。 + + # 4 卡正式训练(配方常量钉在 run.sh 里,argparse 默认值与它逐项相同) + bash distill/stage1_ar/run.sh + + # 单卡 3 步冒烟(不走 accelerate;AdamW 直接更新 bf16 参数、没有 fp32 主权重,loss 数值不代表训练效果) + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + .venv/bin/python distill/stage1_ar/ar_tf.py \\ + --init_ckpt outputs/arope_10k_ga2/step-10000.safetensors \\ + --limit 8 --max_steps 3 --grad_accum 1 --val_every 0 --save_every 0 --log_every 1 \\ + --output /data/zhiyangdeng/ActionRoPE/distill/_smoke_stage1 + + # 30 秒 dry run(tiny 模型 + 合成数据,不碰真权重;验循环 / 导出 / 日志 / 续训) + ... --dry_run --output + +这一阶段是什么 +------------- +outputs/arope_10k_ga2/step-10000.safetensors 是**双向**全片 SFT 模型:每个 cell 都能看见未来。 +AR rollout 要的是因果模型,所以先把它「因果化」:同一份 flow-matching 目标、同一份 new 区 ×2 权重图, +只把自注意力换成 teacher forcing 双流掩码 —— noisy cell f 只看**干净的** 0..f-1 加自己那一格。 +产物 dits/dit_step{N}.safetensors 同时做 stage2 的 --teacher_ckpt 和 --student_ckpt。 + +目标(= PORT_SPEC stage1,`ar_diffusion_gm.py:83-104` 融合 `actionrope/train.py:224-271`) +----------------------------------------------------------------------------------- +每个 cell 独立均匀抽噪声档(diffusion forcing 的加噪方式),干净历史走 clean_x 通道而不是噪声流; +loss 是 ActionRoPE 的 Σw·se/(Σw·C) **逐 cell** 算完,再乘逐 cell 的 bsmntw 钟形权重取平均。 + +相对 WorldMind 的三处刻意改动(每处都有代价明确的理由) +----------------------------------------------------- +1. **cell 0**。WorldMind 的 TF 把 cell 0 也当无条件生成来训(loss 覆盖全部 F 帧)。ActionRoPE 的契约是 + cell 0 = 干净锚点,采样时每一步都写回(infer.py:413)。照抄会改变「这个模型是什么」,所以这里 + cell 0 永远是干净 x0 + t=0 且**不计 loss** —— 与 stage2 的 `lat_t[:,:,0]=x0[:,:,0]`、stage3 的 + `ts_pf[:,0]=0` 一路对齐。 +2. **loss 形状**。`se.mean(dim=(1,3,4))`(`ar_diffusion_gm.py:102`)换成 ActionRoPE 的 + Σw·se/(Σw·C),逐 cell 算 —— 10k 检查点就是在 new 区 ×2 的权重下训出来的,丢掉它等于换了目标。 +3. **条件**。offset_px(世界坐标 RoPE)/ mask_input(known 通道)/ context_ids(逐 cell 文本)三路条件 + 穿进同一次前向,并在 AropeDiT 内部同时喂给 TF 的**两个半流**。 + +两个必须守住的坑 +--------------- +* `--tf_noise_aug_max_idx` 上游取的是**错的那一端**(`ar_diffusion_gm.py:93` 的 `randint(0, k)` 是 + σ≈1 的纯噪声区,不是近干净区)。这里实现成正确的 `randint(1000-k, 1000)`,默认仍是 0(精确干净)。 +* `--grad_accum` 必须与 accelerate yaml 的 gradient_accumulation_steps 一致,否则等效 batch 不是 8 + —— 沿用 `actionrope/train.py:399` 的 SystemExit 守卫。 +""" +from __future__ import annotations + +import argparse +import json +import math +import os +import platform +import socket +import sys +import time +import warnings +import zlib + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +# 分配器要在 import torch 之前设:launch 时 export 的环境变量到不了 accelerate 拉起的子进程(C 的 train.py:22-27) +os.environ.setdefault("PYTORCH_CUDA_ALLOC_CONF", "expandable_segments:True") + +import torch +from accelerate import Accelerator +from accelerate.utils import DistributedType, set_seed + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.dataset import DEFAULT_SIDECAR, TEXT_TABLES, AropeLatentDataset, arope_collate, load_sidecar # noqa: E402 +from distill import runlib # noqa: E402 +from distill.arope_dit import MODEL_DIR, AropeDiT, unwrap # noqa: E402 +from distill.data import make_mask_input, make_weight_map, to_device # noqa: E402 +from distill.flow_pf import ( # noqa: E402 + NUM_TRAIN_TIMESTEPS, + add_noise_pf, + idx_of_t, + sample_pf_timestep_ids, + t_of_idx, + training_target, + training_weight_pf, +) + +CELLS = 21 # 一条 clip 的 latent cell 数(数据集硬契约) +STAGE = "stage1_ar_tf" + + +# ---------------------------------------------------------------------------- +# 目标 +# ---------------------------------------------------------------------------- + +def tf_clean_stream(x0: torch.Tensor, noise: torch.Tensor, max_idx: int): + """TF 的 clean 半流。max_idx<=0 ⇒ (x0, None) 精确干净(CF 默认)。 + + max_idx>0 ⇒ CF 的 history-noise 增广:给干净历史加一点点噪声,复用**同一份** noise。 + 近干净 = **高**下标(sigmas 递减,idx 999 的 σ≈0.005),所以抽 [1000-max_idx, 1000) —— + 上游 `ar_diffusion_gm.py:93` 写的是 `randint(0, max_idx)`,那是 σ≈1 的纯噪声端,方向反了。 + cell 0 无论如何保持精确干净 + t=0:它是 ActionRoPE 的 TI2V 锚点,两个半流都得一致。 + """ + if max_idx is None or int(max_idx) <= 0: + return x0, None + k = int(max_idx) + assert 0 < k < NUM_TRAIN_TIMESTEPS, f"--tf_noise_aug_max_idx 应在 (0, {NUM_TRAIN_TIMESTEPS}) 内,得到 {k}" + b, f = x0.shape[0], x0.shape[2] + idx_aug = torch.randint(NUM_TRAIN_TIMESTEPS - k, NUM_TRAIN_TIMESTEPS, (b, f), device=x0.device) + clean_x = add_noise_pf(x0, noise, idx_aug) + aug_t = t_of_idx(idx_aug, device=x0.device) + clean_x[:, :, 0] = x0[:, :, 0] + aug_t[:, 0] = 0.0 + return clean_x, aug_t + + +def ar_tf_loss(student, batch: dict, *, new_weight: float = 2.0, new_weight_ramp: float = 0.0, + teacher_forcing: bool = True, tf_noise_aug_max_idx: int = 0, + use_gradient_checkpointing: bool = False, + action_dropout: float = 0.0, hist_dropout: float = 0.0, ctx_dropout: float = 0.0, + anchor_dropout: float = 0.0, + noise: torch.Tensor | None = None, idx_pf: torch.Tensor | None = None, + gen: torch.Generator | None = None): + """一次 micro batch 的 loss。返回 (loss, stats)。 + + teacher_forcing=True(默认):干净历史走 clean_x 通道,[2S,2S] 双流掩码,S=21*390=8190。 + teacher_forcing=False:diffusion forcing 回退路径 —— 单条 8190 token 流、普通块因果掩码, + 便宜约 2.5×(代价:stage2 也必须 --no-teacher_forcing,见 PORT_SPEC)。 + + 条件 dropout(三个默认都是 0 ⇒ stage1 的行为一个字节都不变) + ------------------------------------------------------- + 只有**训练时 drop 过**的条件,才谈得上在蒸馏时对它做 classifier-free guidance: + 否则 v(∅) 是一个没训过的输入上的外推,`v_c − v_∅` 是噪声不是信号。ActionRoPE 的 SFT + 只有 `--scene_dropout`(文本)一条,所以 text 之外的轴都得先补出来。这三个开关就是补它们: + + action_dropout offset_px ≡ 0、掩码全 known、权重图退成均匀 ⇒ 自洽的"静止相机"输入 + (语料里 22782 条 clip **没有一条**全程静止,所以这个 null 必须现训) + anchor_dropout 只把 clean cell 0 从每个 noisy cell 的视野里摘掉,**其余历史保留** + hist_dropout 注意力上下文砍成 **只剩 cell 0**(local=1 sink=1) + ctx_dropout 注意力上下文砍成 **什么都看不到**(local=1 sink=0) + + 四条 guidance(★ 是实测最该生效的那条): + ★ Δv_anchor = v(全) − v(drop_anchor) 锚点**相对于历史**的话语权 + Δv_action = v(全) − v(offset≡0) 相机运动的贡献 + Δv_hist = v(全) − v(只剩 cell 0) 历史的贡献 + Δv_ref = v(只剩 cell 0) − v(无上下文) 锚点在真空里的贡献 + + 为什么 anchor 那条才是主角:实测漂移是**漂掉的近期历史压过了首帧锚点**(AR rollout 里 + |x0| 从 1.111 涨到 1.404、外观洗白),要压回去就得放大"锚点 vs 历史"这一项。 + Δv_ref 量的是"真空里锚点值多少",与它施加的场景(历史俱全)不是同一个 regime。 + 两者都留着:anchor 是主力,ref/hist 这对嵌套档给消融用。 + + 注意 cell 0 的 TI2V 锚点(干净 latent + t=0)在**输入侧**始终保留,被 drop 的只是"别的 + cell 能不能看到它"。这样 loss 切片(cell 0 不计)和整个 TI2V 结构都不用动。 + """ + x0 = batch["input_latents"] # [b, 48, 21, 30, 52] bf16 + b, c, f, lat_h, lat_w = x0.shape # 几何从 latent 里取,dry_run 的小分辨率也能过 + dev = x0.device + off = batch["offset_px"] # [b, 21, 2] f32 + + if noise is None: + noise = torch.randn_like(x0) + if idx_pf is None: + idx_pf = sample_pf_timestep_ids(b, f, dev, gen) # [b, 21] 严格均匀,逐 cell 独立 + noisy = add_noise_pf(x0, noise, idx_pf) # x_t=(1−σ)x0+σε,σ 按 [b,1,21,1,1] 广播 + ts_pf = t_of_idx(idx_pf, device=dev) # [b, 21] f32,(4.98, 1000] + # TI2V 锚点:cell 0 用干净 x0 + t=0。模型侧 first_frame_cond=True 也会把 cell 0 的 t 抹成 0, + # 这里显式写一遍是为了让 stats 里的 t 与真实喂进去的一致,且 --no-teacher_forcing 回退路径同样成立。 + noisy[:, :, 0] = x0[:, :, 0] + ts_pf[:, 0] = 0.0 + + # ---- 条件 dropout:逐 micro batch 抽签(batch_size 恒为 1,所以逐 batch == 逐样本)---- + def _coin(p): + if p <= 0.0: + return False + return bool(torch.rand((), generator=gen, device="cpu").item() < p) + + drop_act = _coin(action_dropout) + # 三个上下文档互斥,按"砍得越狠越优先"排:ctx(全空)> hist(只剩 cell0)> anchor(只摘 cell0) + drop_ctx = _coin(ctx_dropout) + drop_hist = (not drop_ctx) and _coin(hist_dropout) + drop_anchor = (not drop_ctx) and (not drop_hist) and _coin(anchor_dropout) + if drop_act: + off = torch.zeros_like(off) # 静止相机:世界 RoPE 退回普通屏幕格 RoPE + + mask_in = make_mask_input(off, lat_h, lat_w) # [b, 1, 21, 30, 52] known=1/new=0 + w = make_weight_map(off, lat_h, lat_w, new_weight=new_weight, ramp_latent=new_weight_ramp) + clean_x, aug_t = (tf_clean_stream(x0, noise, tf_noise_aug_max_idx) if teacher_forcing else (None, None)) + + # 上下文档只改**掩码窗口**,不动 cell 0 的锚点。掩码按 (f, hw, tf, 窗口, device) 缓存, + # 三档各自命中自己的 key,不会串。改的是裸模块:DeepSpeed 包装之后 self.xxx 取不到。 + # 只在真要 drop 时才碰这两个属性 —— 测试里的桩模型没有它们,默认路径不该要求它们存在。 + bare = unwrap(student) if (drop_ctx or drop_hist or drop_anchor) else None + saved = ((bare.train_local_attn_size, bare.train_sink_size, bare.train_drop_anchor) + if bare is not None else None) + if drop_ctx: + bare.train_local_attn_size, bare.train_sink_size = 1, 0 # 谁都看不到 + elif drop_hist: + bare.train_local_attn_size, bare.train_sink_size = 1, 1 # 只看得到 cell 0 + elif drop_anchor: + bare.train_drop_anchor = True # 只摘掉 cell 0,其余历史照旧 + try: + with torch.autocast(device_type=dev.type, dtype=torch.bfloat16, enabled=(dev.type == "cuda")): + v = student(noisy, ts_pf, batch["context"], context_ids=batch["context_ids"], + offset_px=off, mask_input=mask_in, first_frame_cond=True, + clean_x=clean_x, aug_t=aug_t, + use_gradient_checkpointing=use_gradient_checkpointing) + finally: + if bare is not None: + bare.train_local_attn_size, bare.train_sink_size, bare.train_drop_anchor = saved + + target = training_target(x0, noise) # ε − x0(rectified flow) + se = (v.float() - target.float()) ** 2 + se, ww = se[:, :, 1:], w[:, :, 1:] # cell 0 是条件帧,不计 loss + # ActionRoPE 的 Σw·se/(Σw·C),但**逐 cell** 算:这样 new 区 ×2 的权重和逐 cell 的钟形权重能同时生效 + per_cell = (se * ww).sum(dim=(1, 3, 4)) / (ww.sum(dim=(1, 3, 4)) * c) # [b, 20] + tw = training_weight_pf(idx_pf[:, 1:]).float() # [b, 20] bsmntw 钟形 + loss = (tw * per_cell).mean() + stats = { + "loss_w": per_cell.mean().detach(), # 不乘钟形权重的加权 MSE,与 train.py 的 loss_w 同口径 + "mse": se.mean().detach(), # 完全不加权的 MSE,跨配方可比 + "new_frac": (ww > 1).float().mean().detach(), + "t_mean": ts_pf[:, 1:].mean().detach(), + "tw_mean": tw.mean().detach(), + # 三档 dropout 的命中率:日志里能看到实际抽签比例是不是等于设定的 p(各 rank 独立抽签, + # 所以单 rank 的短期比例会抖,看长期均值) + "d_act": torch.tensor(float(drop_act), device=dev), + "d_hist": torch.tensor(float(drop_hist), device=dev), + "d_ctx": torch.tensor(float(drop_ctx), device=dev), + "d_anc": torch.tensor(float(drop_anchor), device=dev), + } + return loss, stats + + +# ---------------------------------------------------------------------------- +# 参数 +# ---------------------------------------------------------------------------- + +def parse_args(argv=None): + ap = argparse.ArgumentParser(description="stage1:teacher forcing 因果化 ActionRoPE SFT 检查点") + # 默认值 = distill/stage1_ar/run.sh 的实参(PORT_SPEC risk 11:argparse 与 run.sh 不许有第二套配方) + ap.add_argument("--init_ckpt", default=runlib.REF_CKPT, + help="要因果化的双向 SFT 检查点(827 键 bf16)") + ap.add_argument("--model_dir", default=MODEL_DIR) + ap.add_argument("--output", required=True, help="run 目录;相对路径按 runlib.resolve_run_dir 解析") + + ap.add_argument("--train_dir", default=os.path.join(ROOT, "data/latent/train_eybx")) + ap.add_argument("--val_dir", default=os.path.join(ROOT, "data/latent/val_eybx")) + ap.add_argument("--sidecar", default=DEFAULT_SIDECAR) + ap.add_argument("--text_table", default=TEXT_TABLES["scene"], + help="ARoPE 臂固定 text_mode=scene(剥掉动作从句),361 键那张表") + ap.add_argument("--limit", type=int, default=None, help="smoke 用:只取这么多训练 clip") + ap.add_argument("--long_seg_dir", default=None, + help="长视野续训(longhorizon/README.md):给 make_long_segments.py 的段目录" + "(如 data/latent_long/K3)就用 AropeLongDatasetTF 替换训练集(F=61 等)," + "其余配方一字不动;val 仍是 --val_dir 的 21-cell clip。None = 原 stage1 行为") + ap.add_argument("--scene_dropout", type=float, default=0.1) + ap.add_argument("--min_rt_ratio", type=float, default=0.8) + ap.add_argument("--val_min_rt_ratio", type=float, default=0.9) + ap.add_argument("--val_frac", type=float, default=0.0, + help="兼容 WorldMind 的 hash 划分,只接受 0:ActionRoPE 的划分是离线的 " + "train_eybx / val_eybx 清单,而且相邻 clip 只差 3 帧,按 clip 名 hash 会漏样本") + + ap.add_argument("--teacher_forcing", action=argparse.BooleanOptionalAction, default=True, + help="默认开:干净历史走 clean_x 通道 + [2S,2S] 双流掩码。" + "--no-teacher_forcing 回退成 diffusion forcing(单流、便宜 2.5×," + "但 stage2 必须跟着一起关)") + ap.add_argument("--tf_noise_aug_max_idx", type=int, default=0, + help="clean 半流的 history-noise 增广宽度(近干净档 = 高下标)。0 = 精确干净(CF 默认)") + # ---- 条件 dropout(stage1b 适配微调用;默认全 0 ⇒ stage1 行为不变)---- + ap.add_argument("--action_dropout", type=float, default=0.0, + help="以此概率把 offset_px 清零 + 掩码全 known ⇒ 造出「静止相机」这个 null 分支。" + "语料里没有一条全程静止的 clip,不训就没有,蒸馏时 Δv_action 无从定义") + ap.add_argument("--anchor_dropout", type=float, default=0.0, + help="★ 主力档:只把 clean cell 0 从每个 noisy cell 的视野里摘掉、其余历史保留 ⇒ " + "Δv_anchor 的 null。这是「锚点 vs 已漂历史」那一项,实测的外观漂移要压的就是它") + ap.add_argument("--hist_dropout", type=float, default=0.0, + help="以此概率把注意力上下文砍成**只剩 cell 0**(local=1 sink=1)⇒ Δv_hist 的 null") + ap.add_argument("--ctx_dropout", type=float, default=0.0, + help="以此概率把注意力上下文砍成**什么都看不到**(local=1 sink=0)⇒ Δv_ref 的 null。" + "与 --hist_dropout 互斥(本档优先),cell 0 的 TI2V 锚点始终保留") + ap.add_argument("--windowed_train", type=int, default=0, + help="训练掩码的滑动窗口(cell 数)。0 = 全因果 —— F=21 下 sink=0 的 W=20 会把 " + "cell 0(干净锚点)挤出 cell 20 的视野,是致命的") + ap.add_argument("--windowed_sink", type=int, default=0, help="[windowed_train>0 时] 恒可见的开头 cell 数") + ap.add_argument("--new_weight", type=float, default=2.0, help="new 区 loss 权重(10k 检查点就是这么训的)") + ap.add_argument("--new_weight_ramp", type=float, default=0.0, + help=">0 ⇒ new 区权重按离首帧足迹的距离爬升(dist 形状);0 = flat,与 10k 检查点一致") + + ap.add_argument("--lr", type=float, default=1e-5) + ap.add_argument("--weight_decay", type=float, default=0.01) + ap.add_argument("--adam_betas", default="0.9,0.999", + help="ActionRoPE SFT 的优化器口径。WorldMind 那边是 (0.0, 0.999)(CF 约定)," + "但 stage1 是同一份 SFT 目标加了因果掩码,用户拍板沿用 SFT 的 betas") + ap.add_argument("--warmup", "--warmup_steps", dest="warmup", type=int, default=200, + help="线性 warmup 步数,之后恒定 lr(每个 save_every 边界都是合法的停止点)") + ap.add_argument("--grad_clip", type=float, default=1.0, + help="DeepSpeed 下写进 deepspeed_config.gradient_clipping(覆盖 yaml),日志里的 grad_norm 是裁剪前的") + ap.add_argument("--batch_size", type=int, default=1, help="每卡 micro batch;等效 batch = world × 它 × grad_accum") + ap.add_argument("--grad_accum", type=int, default=2, help="必须与 accelerate yaml 的 gradient_accumulation_steps 相同") + ap.add_argument("--max_steps", type=int, default=12000, help="优化器更新数(不是 micro batch 数)") + ap.add_argument("--gradient_checkpointing", action=argparse.BooleanOptionalAction, default=True) + ap.add_argument("--num_workers", type=int, default=2) + ap.add_argument("--seed", type=int, default=0) + + ap.add_argument("--save_every", type=int, default=500, help="0 ⇒ 只在训练结束时导出一次") + ap.add_argument("--keep_last_dits", type=int, default=6, help="dits/ 只留最新几个(0 = 不删;上游 v4 光 dits/ 就 746 GB)") + ap.add_argument("--save_state", action="store_true", help="同时 accelerator.save_state(state_A/state_B 轮换,可续训)") + ap.add_argument("--val_every", type=int, default=500, help="0 ⇒ 不验证") + ap.add_argument("--val_n", type=int, default=16) + ap.add_argument("--val_timesteps", default="200,500,800") + ap.add_argument("--log_every", type=int, default=20) + ap.add_argument("--resume", default=None, + help="*.safetensors ⇒ 只热启动权重(step 归 0);目录 ⇒ accelerator.load_state 续训;" + "auto ⇒ 有 /state 就续,没有就从头") + ap.add_argument("--dry_run", action="store_true", help="tiny 模型 + 合成数据,不碰真权重 / 真数据") + args = ap.parse_args(argv) + + if abs(args.val_frac) > 1e-12: + raise SystemExit("--val_frac 只接受 0:ActionRoPE 用离线的 train_eybx / val_eybx 清单划分," + "相邻 clip 只差 3 帧,按 clip 名 hash 划会把同一段画面同时放进两边。改用 --val_dir。") + if args.windowed_sink > 0 and args.windowed_train <= 0: + raise SystemExit("--windowed_sink 只在 --windowed_train > 0 时有意义") + try: + b1, b2 = (float(x) for x in args.adam_betas.split(",")) + except ValueError: + raise SystemExit(f"--adam_betas 应形如 '0.9,0.999',得到 {args.adam_betas!r}") from None + args.betas = (b1, b2) + args.val_timesteps = [float(t) for t in args.val_timesteps.split(",") if t.strip()] + if args.dry_run: + args.init_ckpt = None + elif not os.path.isfile(args.init_ckpt): + raise SystemExit(f"--init_ckpt 不存在:{args.init_ckpt}") + return args + + +# ---------------------------------------------------------------------------- +# dry run:tiny 模型 + 合成数据(PORT_SPEC 的 S6) +# ---------------------------------------------------------------------------- + +TINY = dict(dim=128, in_dim=48, ffn_dim=256, out_dim=48, text_dim=4096, freq_dim=256, eps=1e-6, + patch_size=(1, 2, 2), num_heads=4, num_layers=2, has_image_input=False) +TINY_SHAPE = (48, 5, 8, 10) # [C, cells, lat_h, lat_w] + + +class _SynDataset(torch.utils.data.Dataset): + """dry run 用:形状与 AropeLatentDataset 一致的合成样本(cell 数 / 分辨率缩小)。""" + + def __len__(self): + return 64 + + def __getitem__(self, i: int) -> dict: + g = torch.Generator().manual_seed(i) + c, f, h, w = TINY_SHAPE + off = torch.zeros(f, 2) + off[1:] = torch.randn(f - 1, 2, generator=g).cumsum(0) * 20.0 + return { + "input_latents": torch.randn(c, f, h, w, generator=g, dtype=torch.float32).to(torch.bfloat16), + "context": torch.randn(f, 8, 4096, generator=g, dtype=torch.float32).to(torch.bfloat16), + "context_ids": torch.zeros(f, dtype=torch.int64), + "offset_px": off, + "clip_id": f"syn_{i:04d}", + "kind": "syn", + } + + +def _tiny_model() -> AropeDiT: + from diffsynth.models.wan_video_dit import WanModel + torch.manual_seed(0) + dit = WanModel(**TINY).to(torch.bfloat16) + return AropeDiT(dit=dit, mask_channel=True, causal=True) + + +# ---------------------------------------------------------------------------- +# 验证 +# ---------------------------------------------------------------------------- + +@torch.no_grad() +def run_validation(accelerator: Accelerator, model, val_ds, tids: list[int], args) -> dict: + """固定 clip × 固定噪声档 × 固定噪声,各进程分摊 clip,最后 reduce(集合操作,人人都要到)。 + + 与训练不同:一次验证把 **所有** cell 都放在同一个噪声档 tid 上(cell 0 依旧干净 + t=0), + 这样曲线只随模型变、不随抽签抖,口径与 `actionrope/train.py:352-386` 一致。 + """ + model.eval() + device = accelerator.device + rank, world = accelerator.process_index, accelerator.num_processes + acc = torch.zeros(len(tids), 3, device=device, dtype=torch.float64) # loss_w 和 / mse 和 / 计数 + for i in range(rank, len(val_ds), world): + sample = val_ds[i] + batch = to_device(arope_collate([sample]), device) + x0 = batch["input_latents"] + for j, tid in enumerate(tids): + g = torch.Generator(device=device) + g.manual_seed((zlib.crc32(str(sample["clip_id"]).encode()) * 1009 + tid * 7 + args.seed) % (2 ** 31)) + noise = torch.randn(x0.shape, generator=g, device=device, dtype=x0.dtype) + idx_pf = torch.full((x0.shape[0], x0.shape[2]), int(tid), device=device, dtype=torch.int64) + _, st = ar_tf_loss(model, batch, new_weight=args.new_weight, new_weight_ramp=args.new_weight_ramp, + teacher_forcing=args.teacher_forcing, tf_noise_aug_max_idx=0, + use_gradient_checkpointing=False, noise=noise, idx_pf=idx_pf) + acc[j, 0] += st["loss_w"].double() + acc[j, 1] += st["mse"].double() + acc[j, 2] += 1 + acc = accelerator.reduce(acc, reduction="sum") + model.train() + out = {} + for j, tid in enumerate(tids): + n = max(acc[j, 2].item(), 1.0) + t = float(t_of_idx(int(tid))) + out[t] = {"loss_w": acc[j, 0].item() / n, "mse": acc[j, 1].item() / n, "n": int(acc[j, 2].item())} + return out + + +# ---------------------------------------------------------------------------- +# 主流程 +# ---------------------------------------------------------------------------- + +def main(argv=None): + args = parse_args(argv) + accelerator = Accelerator(gradient_accumulation_steps=args.grad_accum) + is_main = accelerator.is_main_process + use_ds = accelerator.distributed_type == DistributedType.DEEPSPEED + set_seed(args.seed, device_specific=True) # 每个 rank 的 ε / 噪声档 / 场景 dropout 抽签都不同 + device = accelerator.device + + if use_ds: + # 让 --grad_clip 成为唯一入口;yaml 里的 gradient_clipping 只是默认值(train.py:394-401) + ds_cfg = accelerator.state.deepspeed_plugin.deepspeed_config + ds_cfg["gradient_clipping"] = float(args.grad_clip) + ga = ds_cfg.get("gradient_accumulation_steps") + if ga not in ("auto", args.grad_accum): + raise SystemExit(f"--grad_accum={args.grad_accum} 与 accelerate yaml 的 " + f"gradient_accumulation_steps={ga} 不一致:要么传 --grad_accum {ga}," + f"要么换 distill/configs/accelerate_zero2_4gpu_ga{args.grad_accum}.yaml" + f"(现有 ga2 / ga4 两份;等效 batch = 4 × batch_size × GA)") + ds_cfg["gradient_accumulation_steps"] = args.grad_accum + + run_dir = runlib.resolve_run_dir(args.output) + if is_main: + os.makedirs(run_dir, exist_ok=True) + log = runlib.TextTee(os.path.join(run_dir, "train.log"), enabled=is_main) + jsonl = runlib.JsonlLogger(os.path.join(run_dir, "train_log.jsonl"), enabled=is_main) + eff_batch = accelerator.num_processes * args.batch_size * args.grad_accum + log(f"=== {STAGE} | run={run_dir} world={accelerator.num_processes} " + f"dist={accelerator.distributed_type} mp={accelerator.mixed_precision} ===") + if max(args.action_dropout, args.hist_dropout, args.ctx_dropout, args.anchor_dropout) > 0: + log(f"[recipe] 条件 dropout: anchor={args.anchor_dropout} action={args.action_dropout} " + f"hist={args.hist_dropout} ctx={args.ctx_dropout}(scene={args.scene_dropout} 由数据集做)") + if args.long_seg_dir: + log(f"[recipe] 长视野续训:训练集 = {args.long_seg_dir}(AropeLongDatasetTF),val = {args.val_dir}(21 cell)") + log(f"[recipe] tf={args.teacher_forcing} tf_aug={args.tf_noise_aug_max_idx} " + f"windowed={args.windowed_train}/{args.windowed_sink} new_weight={args.new_weight} " + f"lr={args.lr} betas={args.betas} wd={args.weight_decay} warmup={args.warmup} clip={args.grad_clip} " + f"bs={args.batch_size}×accum{args.grad_accum}×{accelerator.num_processes}卡 ⇒ 等效 batch {eff_batch} " + f"max_steps={args.max_steps} gc={args.gradient_checkpointing}") + low = runlib.warn_if_low_disk(run_dir) + if low: + log(f"[warn] {low}") + + # ---- 数据 ---- + if args.dry_run: + train_ds, val_ds = _SynDataset(), None + if args.max_steps > 30: + args.max_steps, args.save_every, args.warmup, args.log_every, args.val_every = 12, 6, 3, 2, 0 + log("[dry_run] tiny 模型 + 合成数据") + else: + sidecar = load_sidecar(args.sidecar) + if args.long_seg_dir: + # 长段(F=41/61/81):latent 是整段一次过 VAE 的,不是 21-cell clip 拼接;键集与 arope_collate 契约相同 + from longhorizon.arope_long_dataset import AropeLongDatasetTF + train_ds = AropeLongDatasetTF(args.long_seg_dir, text_table=args.text_table, + scene_dropout=args.scene_dropout, limit=args.limit, verbose=is_main) + else: + train_ds = AropeLatentDataset(args.train_dir, sidecar=sidecar, text_table=args.text_table, + text_mode="scene", scene_dropout=args.scene_dropout, + limit=args.limit, seed=args.seed, verbose=is_main, + exclude_src_in=args.val_dir, min_rt_ratio=args.min_rt_ratio) + val_ds = None + if args.val_every > 0 and args.val_n > 0: + # 验证不做场景 dropout;文本表已经在内存里,别再读一遍 1.5 GB + val_ds = AropeLatentDataset(args.val_dir, sidecar=sidecar, text_table=train_ds.text_table, + text_mode="scene", scene_dropout=0.0, limit=args.val_n, + seed=args.seed, verbose=is_main, min_rt_ratio=args.val_min_rt_ratio) + log(f"[data] train {len(train_ds)} clip,val {len(val_ds) if val_ds is not None else 0} clip") + dataloader = torch.utils.data.DataLoader( + train_ds, batch_size=args.batch_size, shuffle=True, drop_last=True, collate_fn=arope_collate, + num_workers=args.num_workers, pin_memory=True, persistent_workers=args.num_workers > 0, + ) + + # ---- 模型 ---- + t0 = time.time() + if args.dry_run: + module = _tiny_model() + resume_info = None + else: + module = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=True, + train_local_attn_size=args.windowed_train, train_sink_size=args.windowed_sink) + # 因果化的起点:双向 SFT 检查点。assign=False ⇒ copy_ 进现有参数,保持模型自己的 dtype + resume_info = runlib.load_dit_ckpt(module, args.init_ckpt) + log(f"[model] 双向 SFT ← {args.init_ckpt}({resume_info['n_tensors']} 个张量," + f"缺 {resume_info['missing']})") + # 只热启动权重的续训必须在 prepare **之前**:DeepSpeed 在 initialize 时就按当时的参数建好了 + # fp32 主权重副本,prepare 之后再 copy_ 进 bf16 参数,第一次 step 就会被主权重原样盖回去(静默)。 + warm_start = args.resume if (args.resume and args.resume.endswith(".safetensors")) else None + if warm_start: + info = runlib.load_dit_ckpt(module, warm_start) + log(f"[resume] 只热启动权重 {warm_start}(step 从 0 起):{info['n_tensors']} 个张量") + n_params = sum(p.numel() for p in module.parameters()) + module.train().requires_grad_(True) + log(f"[model] AropeDiT causal={module.causal} mask_channel={module.mask_channel} " + f"{n_params:,} 参数,加载 {time.time() - t0:.0f}s") + + optimizer = torch.optim.AdamW(module.parameters(), lr=args.lr, weight_decay=args.weight_decay, + betas=args.betas) + warm = max(int(args.warmup), 0) + # lr scheduler 故意不进 prepare:accelerate 包装后每步会 step num_processes 次,warmup 被悄悄压缩 + lr_scheduler = torch.optim.lr_scheduler.LambdaLR(optimizer, lambda s: min(1.0, (s + 1) / warm) if warm > 0 else 1.0) + + # 只把 **一个** nn.Module 交给 prepare(accelerator.py:2229-2236 只留最后一个,多传会静默丢) + model, optimizer, dataloader = accelerator.prepare(module, optimizer, dataloader) + # dit.freqs 是普通 tuple 属性(不是 buffer),prepare / .to() 都搬不动它 —— 必须在裸模块上搬一次 + unwrap(model).move_rope_table(device) + if is_main and use_ds: + clip_eff = getattr(getattr(model, "optimizer", None), "clip_grad", None) + log(f"[env] grad_clip={args.grad_clip}(DeepSpeed 生效值 {clip_eff})") + + # ---- 续训(accelerate 存档:权重 + 优化器 + 数据顺序,必须在 prepare 之后)---- + start_step = 0 + if args.resume and not warm_start: + rp = args.resume + if rp == "auto": + link = os.path.join(run_dir, "state") + rp = link if os.path.exists(link) else None + log(f"[resume] auto ⇒ {rp or '没有存档,从头开始'}") + if rp: + accelerator.load_state(rp) + with open(os.path.join(rp, "trainer_state.json"), encoding="utf-8") as fh: + start_step = int(json.load(fh)["step"]) + with warnings.catch_warnings(): # 优化器还没 step 就快进 scheduler,PyTorch 会提醒一句,这里是有意的 + warnings.simplefilter("ignore") + for _ in range(start_step): + lr_scheduler.step() + log(f"[resume] accelerator.load_state({rp}),从 step {start_step} 续训") + + # ---- config.json:复现所需的一切 ---- + if is_main: + cfg = { + "stage": STAGE, "args": vars(args), "eff_batch": eff_batch, + "dataset": ({"synthetic": True} if args.dry_run else { + "train_dir": args.long_seg_dir or args.train_dir, "long_seg_dir": args.long_seg_dir, + "train_used": len(train_ds), + "train_total": getattr(train_ds, "n_total", len(train_ds)), + "train_invalid": getattr(train_ds, "n_invalid", None), + "train_leak_excluded": getattr(train_ds, "n_leak", None), + "train_low_rt_excluded": getattr(train_ds, "n_low_rt", None), + "text_table_keys": len(train_ds.text_table), + "val_used": len(val_ds) if val_ds is not None else 0, + "val_clip_ids": val_ds.clip_ids() if val_ds is not None else []}), + "model": {"n_params": n_params, "causal": True, "mask_channel": True, + "init_ckpt": args.init_ckpt, "resume_info": resume_info, "start_step": start_step}, + "env": {"world_size": accelerator.num_processes, "distributed_type": str(accelerator.distributed_type), + "mixed_precision": accelerator.mixed_precision, "torch": torch.__version__, + "cuda": torch.version.cuda, + "gpu": torch.cuda.get_device_name(0) if torch.cuda.is_available() else None, + "python": sys.executable, "platform": platform.platform(), "hostname": socket.gethostname(), + "argv": sys.argv, "started": time.strftime("%Y-%m-%d %H:%M:%S"), + "cuda_visible_devices": os.environ.get("CUDA_VISIBLE_DEVICES")}, + "deepspeed_config": (accelerator.state.deepspeed_plugin.deepspeed_config if use_ds else None), + } + try: + import accelerate, diffsynth # noqa: F401 + cfg["env"]["accelerate"] = accelerate.__version__ + except Exception: + pass + runlib.save_config(run_dir, cfg) + + # ---- 日志 ---- + csv_fields = ["step", "loss", "loss_w", "mse", "new_frac", "t_mean", "lr", "grad_norm", + "step_time", "mem_gb", "epoch"] + train_log = runlib.CsvLog(os.path.join(run_dir, "train_log.csv"), csv_fields, enabled=is_main) + val_log = runlib.CsvLog(os.path.join(run_dir, "val_log.csv"), ["step", "timestep", "loss_w", "mse", "n"], + enabled=is_main) + val_tids = [int(idx_of_t(t)) for t in args.val_timesteps] + + def do_validation(step): + if val_ds is None: + return + tv = time.time() + res = run_validation(accelerator, model, val_ds, val_tids, args) + if is_main: + for t, r in res.items(): + val_log.write({"step": step, "timestep": t, **r}) + mean_w = sum(r["loss_w"] for r in res.values()) / len(res) + log("[val] step {} ".format(step) + + " ".join(f"t={t:.0f}: w={r['loss_w']:.4f} mse={r['mse']:.4f} (n={r['n']})" for t, r in res.items()) + + f" | mean w={mean_w:.4f} {time.time() - tv:.0f}s") + + def do_save(step, loss_val=None): + # save_dit 是集合操作(accelerator.get_state_dict),每个 rank 都必须进来 + runlib.save_dit(accelerator, model, runlib.dit_path(run_dir, step), + {"stage": STAGE, "step": step, "teacher_forcing": args.teacher_forcing, + "tf_noise_aug_max_idx": args.tf_noise_aug_max_idx, + "action_dropout": args.action_dropout, + "hist_dropout": args.hist_dropout, + "ctx_dropout": args.ctx_dropout, + "anchor_dropout": args.anchor_dropout, + "windowed_train": args.windowed_train, "windowed_sink": args.windowed_sink, + "new_weight": args.new_weight, "text_mode": "scene", "init_ckpt": args.init_ckpt, + "long_seg_dir": args.long_seg_dir or ""}, + expect_keys=(None if args.dry_run else runlib.AROPE_DIT_KEYS), log=log) + if is_main: + gone = runlib.rotate(runlib.dit_glob(run_dir), args.keep_last_dits) + if gone: + log(f"[rotate] 删掉 {len(gone)} 个旧 dit(保留最新 {args.keep_last_dits} 个)") + runlib.write_progress(run_dir, step, stage=STAGE, loss=loss_val) + if args.save_state: + runlib.save_state_rotating(accelerator, run_dir, {"step": step, "stage": STAGE}) + + # ---- 训练循环 ---- + model.train() + step, epoch, last_saved = start_step, 0, start_step + if device.type == "cuda": + torch.cuda.reset_peak_memory_stats(device) + log(f"[train] 从 step {start_step} 到 {args.max_steps}") + micro_time, loss_ema = 0.0, None + while step < args.max_steps: + for batch in dataloader: + if step >= args.max_steps: + break + t_step = time.time() + batch = to_device(batch, device) + lr_now = lr_scheduler.get_last_lr()[0] # 本步用的 lr(step 之后拿到的是下一步的) + with accelerator.accumulate(model): + loss, stats = ar_tf_loss( + model, batch, new_weight=args.new_weight, new_weight_ramp=args.new_weight_ramp, + teacher_forcing=args.teacher_forcing, tf_noise_aug_max_idx=args.tf_noise_aug_max_idx, + action_dropout=args.action_dropout, hist_dropout=args.hist_dropout, + ctx_dropout=args.ctx_dropout, anchor_dropout=args.anchor_dropout, + use_gradient_checkpointing=args.gradient_checkpointing) + accelerator.backward(loss) # DeepSpeed 下这一步已含 engine.step()(裁剪 + 更新) + grad_norm = (accelerator.clip_grad_norm_(model.parameters(), args.grad_clip) + if accelerator.sync_gradients else None) + optimizer.step() + if accelerator.sync_gradients: + lr_scheduler.step() # DeepSpeed 的 scheduler 包装不认累积边界,只能在这里守门 + optimizer.zero_grad(set_to_none=True) + if device.type == "cuda": + torch.cuda.synchronize(device) + micro_time += time.time() - t_step + if not accelerator.sync_gradients: + continue # 还在累积,不算一步 + step += 1 + step_time, micro_time = micro_time, 0.0 + loss_mean = accelerator.reduce(loss.detach().float(), reduction="mean").item() + loss_ema = loss_mean if loss_ema is None else 0.9 * loss_ema + 0.1 * loss_mean + if is_main and (step % args.log_every == 0 or step == args.max_steps): + gn = float(grad_norm) if grad_norm is not None and math.isfinite(float(grad_norm)) else float("nan") + row = {"step": step, "loss": loss_mean, "loss_w": stats["loss_w"].item(), + "mse": stats["mse"].item(), "new_frac": stats["new_frac"].item(), + "t_mean": stats["t_mean"].item(), "lr": lr_now, "grad_norm": gn, + "step_time": step_time, + "mem_gb": (torch.cuda.max_memory_allocated(device) / 1024 ** 3 if device.type == "cuda" else 0.0), + "epoch": epoch} + train_log.write(row) + jsonl.log({**row, "loss_ema": loss_ema}) + log(f"step {step}/{args.max_steps} loss {loss_mean:.4f} (ema {loss_ema:.4f}) " + f"w {row['loss_w']:.4f} mse {row['mse']:.4f} t̄ {row['t_mean']:.0f} new {row['new_frac']:.2f} " + f"lr {row['lr']:.2e} gnorm {gn:.3f} {step_time:.2f}s mem {row['mem_gb']:.1f}GB") + if args.val_every > 0 and step % args.val_every == 0: + do_validation(step) + if args.save_every > 0 and step % args.save_every == 0: + do_save(step, loss_mean) + last_saved = step + epoch += 1 + + if last_saved != step: + do_save(step, loss_ema) + if device.type == "cuda": + peak = torch.tensor(torch.cuda.max_memory_allocated(device) / 1024 ** 3, device=device) + peak_max = accelerator.reduce(peak, reduction="max").item() + else: + peak_max = 0.0 + log(f"[done] step {step},各进程峰值显存 {peak_max:.1f} GB。" + f"下一步:把 dits/dit_step{step}.safetensors 同时作为 stage2 的 --teacher_ckpt 与 --student_ckpt") + if is_main: + runlib.write_progress(run_dir, step, stage=STAGE, finished=True, peak_mem_gb=peak_max) + train_log.close() + val_log.close() + jsonl.close() + log.close() + accelerator.wait_for_everyone() + accelerator.end_training() + return step + + +if __name__ == "__main__": + main() diff --git a/backup_2026-09-14/code/distill/stage1_ar/config.json b/backup_2026-09-14/code/distill/stage1_ar/config.json new file mode 100644 index 0000000000000000000000000000000000000000..656cd2fc704a46c0f58b811a6275b8925d3a1145 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage1_ar/config.json @@ -0,0 +1,72 @@ +{ + "_note": "stage1(teacher forcing 因果化)真正在用的配方常量。这三处必须逐项相同:本文件 / run.sh 的默认值 / ar_tf.py 的 argparse 默认值 —— 上游 WorldMind 的 run.sh 与 argparse 有六处不一致,每一处都对应一次已知的崩溃(PORT_SPEC risk 11)。改配方就同时改这三处。", + "_not_this_file": "跑起来之后 /config.json 是那一次 run 的完整快照(含数据集统计 / 环境 / deepspeed_config),由 runlib.save_config 写;本文件只是签进仓库的配方记录。", + "_launch": "bash distill/stage1_ar/run.sh", + "stage": "stage1_ar_tf", + "script": "distill/stage1_ar/ar_tf.py", + + "init_ckpt": "outputs/arope_10k_ga2/step-10000.safetensors", + "init_ckpt_role": "双向全片 SFT(827 键 bf16,9,999,690,792 B);stage1 只把注意力换成因果 + TF 双流,不换目标", + "output": "outputs/distill/stage1_ar_tf", + "product": "dits/dit_step{N}.safetensors → stage2 的 --teacher_ckpt 与 --student_ckpt(同一份)", + + "train_dir": "data/latent/train_eybx", + "val_dir": "data/latent/val_eybx", + "sidecar": "data/latent/arope_sidecar.pt", + "text_table": "data/latent/text_table_actionrope.pt", + "text_mode": "scene", + "scene_dropout": 0.1, + "min_rt_ratio": 0.8, + "val_min_rt_ratio": 0.9, + "val_frac": 0, + "_val_frac": "只接受 0:ActionRoPE 的划分是离线的 train_eybx / val_eybx 清单,相邻 clip 只差 3 帧,按 clip 名 hash 划会漏样本", + + "teacher_forcing": true, + "tf_noise_aug_max_idx": 0, + "_tf_noise_aug_max_idx": "0 = 精确干净的历史(CF 默认)。>0 时本移植抽的是 [1000-k, 1000) 的近干净档;上游 ar_diffusion_gm.py:93 抽的是 [0, k),那是 σ≈1 的纯噪声端,方向反了", + "windowed_train": 0, + "windowed_sink": 0, + "_windowed": "全因果。F=21 下 sink=0 的 W=20 会把 cell 0(ActionRoPE 的干净锚点)挤出 cell 20 的视野", + "new_weight": 2.0, + "new_weight_ramp": 0.0, + "_new_weight": "new 区 ×2 的 loss 权重图照搬 SFT —— stage1 就是那个 SFT 目标加了因果掩码", + "first_frame_cond": true, + "loss": "cell 0 干净 + t=0 且不计 loss;cells 1..20 逐 cell 独立均匀抽噪声档,Σw·se/(Σw·48) 逐 cell 算,再乘逐 cell 的 bsmntw 钟形权重取平均", + + "optimizer": "AdamW", + "lr": 1e-05, + "weight_decay": 0.01, + "adam_betas": [0.9, 0.999], + "_adam_betas": "ActionRoPE SFT 的口径(用户拍板)。WorldMind 那边是 CF 约定的 (0.0, 0.999),不照抄", + "warmup": 200, + "lr_schedule": "线性 warmup 200 步后恒定 —— 每个 save_every 边界都是合法的停止点", + "grad_clip": 1.0, + + "batch_size": 1, + "grad_accum": 2, + "world_size": 4, + "eff_batch": 8, + "_eff_batch": "4 卡 × batch 1 × GA 2。--grad_accum 必须等于 accelerate yaml 的 gradient_accumulation_steps,否则 ar_tf.py 直接 SystemExit", + "max_steps": 12000, + "gradient_checkpointing": true, + "num_workers": 2, + "seed": 0, + + "save_every": 500, + "keep_last_dits": 6, + "save_state": true, + "val_every": 500, + "val_n": 16, + "val_timesteps": [200, 500, 800], + "log_every": 20, + "resume": "auto", + + "accelerate_config": "distill/configs/accelerate_zero2_4gpu_ga2.yaml", + "distributed": "DeepSpeed ZeRO-2, bf16, 4 进程(只有一个可训模型,所以不用 FSDP)", + "gpus": "0,1,2,3", + "main_process_port": 29531, + + "_budget": "≈11 s/优化器步(2 × 5.5 s 的 TF micro batch)⇒ 12000 步 ≈ 38 h;显存 ~34-50 GB/卡(143 GB 卡);磁盘 6×10 GB dits + 2 个 state 槽", + "_fallback": "--no-teacher_forcing 换成 diffusion forcing(单条 8190 token 流,便宜约 2.5×),代价是 stage2 必须跟着一起 --no-teacher_forcing", + "_gate": "开跑前先过 distill/tests/test_tf_port.py(clean f → noisy f 泄漏必须是 0.00e+00)" +} diff --git a/backup_2026-09-14/code/distill/stage1_ar/run.sh b/backup_2026-09-14/code/distill/stage1_ar/run.sh new file mode 100644 index 0000000000000000000000000000000000000000..15a0189b3abe6869cfb393e83c81908795d2c135 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage1_ar/run.sh @@ -0,0 +1,125 @@ +#!/usr/bin/env bash +# ───────────────────────────────────────────────────────────────────────────── +# stage1:teacher forcing 因果化(outputs/arope_10k_ga2/step-10000 → 因果 AR 扩散模型) +# +# 4 卡 DeepSpeed ZeRO-2,batch 1 × GA 2 × 4 卡 = 等效 batch 8,lr 1e-5,12000 步 ≈ 38 h。 +# DISTILL_NGPU=8 时 GA 自动降为 1(8 × 1 × 1 = 8,同一配方跑快一倍);run.sh 会断言等效 batch == 8。 +# 产物 /dits/dit_step{N}.safetensors 同时做 stage2 的 --teacher_ckpt 和 --student_ckpt。 +# +# bash distill/stage1_ar/run.sh # 按下面的配方跑 +# # PORT_SPEC 的 S7 20 步实机冒烟。OUT 必须写绝对路径:$ROOT 是 common.sh 在本脚本**内部** +# # 才导出的,调用方 shell 里它是空的(写成 $ROOT/... 会展开成 /outputs/... 然后 mkdir 权限失败)。 +# MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 PORT=29541 \ +# OUT=/data/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage1 \ +# bash distill/stage1_ar/run.sh +# bash distill/stage1_ar/run.sh --no-teacher_forcing # 便宜 2.5× 的 diffusion-forcing 回退 +# +# 这里的每一个常量都与 ar_tf.py 的 argparse 默认值、config.json 逐项相同 —— 上游 A 的 +# run.sh 与 argparse 有六处不一致、每一处都对应一次已知的崩溃(PORT_SPEC risk 11), +# 所以这个移植里只允许存在一份配方。改配方 = 同时改这三处。 +# 只有两处**故意**与 argparse 默认值不同,都是"裸跑不应该有的副作用": +# --save_state(argparse 默认关:不想让随手一跑就写两个 ~60 GB 的 state 槽) +# --resume auto(argparse 默认 None:不想让随手一跑就悄悄接着上次的 step 跑) +# +# CUDA_VISIBLE_DEVICES / GPU 占用守卫都在 common.sh 里,这里不重复也不许绕过。 +# ───────────────────────────────────────────────────────────────────────────── +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +# shellcheck source=../common.sh +source "$HERE/../common.sh" # set -euo pipefail / ROOT / PY / ACC / 环境 / 只用 GPU 0-3 / 空闲守卫 + +# ---- 输入输出(都可以用环境变量覆盖)---- +INIT="${INIT:-$ROOT/outputs/arope_10k_ga2/step-10000.safetensors}" # 要因果化的双向 SFT 检查点 +TRAIN_DIR="${TRAIN_DIR:-$ROOT/data/latent/train_eybx}" +VAL_DIR="${VAL_DIR:-$ROOT/data/latent/val_eybx}" +SIDECAR="${SIDECAR:-$ROOT/data/latent/arope_sidecar.pt}" +TEXT_TABLE="${TEXT_TABLE:-$ROOT/data/latent/text_table_actionrope.pt}" +OUT="${OUT:-$ROOT/outputs/distill/stage1_ar_tf}" + +# ---- 并行与端口 ---- +PORT="${PORT:-29531}" # 固定分配:stage1 29531 / stage2 29532 / stage3 29536 / 冒烟 29541+ +# 等效 batch **恒为 8**;卡数变的是墙钟,不是配方。accelerate 的 --num_processes 会覆盖 yaml 的 +# num_processes 而 GA 不会跟着变,所以 GA 与 yaml 按 DISTILL_NGPU 一起选(前置检查里还有等效 batch 断言)。 +# 4 卡 → GA 2 (4 × 1 × 2 = 8) +# 8 卡 → GA 1 (8 × 1 × 1 = 8) +if [ "$DISTILL_NGPU" = "8" ]; then + GRAD_ACCUM="${GRAD_ACCUM:-1}" + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_8gpu_ga${GRAD_ACCUM}.yaml}" +else + GRAD_ACCUM="${GRAD_ACCUM:-2}" + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_4gpu_ga${GRAD_ACCUM}.yaml}" +fi + +# ---- 配方(= ar_tf.py 的 argparse 默认值)---- +LR="${LR:-1e-5}" +WEIGHT_DECAY="${WEIGHT_DECAY:-0.01}" +ADAM_BETAS="${ADAM_BETAS:-0.9,0.999}" # ActionRoPE SFT 的口径(不是 WorldMind CF 的 0.0,0.999) +WARMUP="${WARMUP:-200}" +# SFT 的 1.0 是照抄数字、不是照抄行为:SFT 实测 5000 步 grad_norm p50=0.072 / max=0.481, +# 阈值 1.0 一次都没触发过。stage1 的 gnorm 是 2.1~3.0,1.0 会步步都裁 —— 等于把优化器换成 +# 归一化 SGD、等效 lr 掉到约 1/3,而用户钉的是 lr=1e-5。10.0 同时满足两边: +# 与 WorldMind stage1 一致(ar_diffusion_gm.py:317 vendor parity),且恢复"只兜离群值"的语义。 +GRAD_CLIP="${GRAD_CLIP:-10.0}" +MAX_STEPS="${MAX_STEPS:-12000}" +NEW_WEIGHT="${NEW_WEIGHT:-2.0}" +SCENE_DROPOUT="${SCENE_DROPOUT:-0.1}" +MIN_RT="${MIN_RT:-0.8}" +VAL_MIN_RT="${VAL_MIN_RT:-0.9}" +TF_AUG="${TF_AUG:-0}" # 绝不要 >0 之外的理由:见 ar_tf.py::tf_clean_stream +WINDOW="${WINDOW:-0}" # 全因果;F=21 下 sink=0 的窗口会把 cell 0 挤出视野 +WINDOW_SINK="${WINDOW_SINK:-0}" +SAVE_EVERY="${SAVE_EVERY:-500}" +KEEP_DITS="${KEEP_DITS:-6}" # 24 个 ckpt × 10 GB 不 rotate 就是 240 GB(上游 v4 光 dits/ 就 746 GB) +VAL_EVERY="${VAL_EVERY:-500}" +VAL_N="${VAL_N:-16}" +VAL_TS="${VAL_TS:-200,500,800}" +LOG_EVERY="${LOG_EVERY:-20}" +NUM_WORKERS="${NUM_WORKERS:-2}" +SEED="${SEED:-0}" +RESUME="${RESUME:-auto}" # auto:有 /state 就续训,没有就从头;none 关掉 + +# ---- 前置检查(缺什么当场说清楚,不要跑到第 3 步才炸)---- +[ -f "$INIT" ] || { echo "ABORT: 没有 init 检查点: $INIT"; exit 1; } +[ -d "$TRAIN_DIR" ] || { echo "ABORT: 没有训练集目录: $TRAIN_DIR"; exit 1; } +[ -d "$VAL_DIR" ] || { echo "ABORT: 没有验证集目录: $VAL_DIR"; exit 1; } +[ -f "$SIDECAR" ] || { echo "ABORT: 没有 sidecar: $SIDECAR"; exit 1; } +[ -f "$TEXT_TABLE" ] || { echo "ABORT: 没有文本表: $TEXT_TABLE"; exit 1; } +[ -f "$ACC_CFG" ] || { echo "ABORT: 没有 accelerate 配置: $ACC_CFG(distill/configs 现有 accelerate_zero2_4gpu_ga2 / 4gpu_ga4 / 8gpu_ga1 / 8gpu_ga2 四份;GRAD_ACCUM=$GRAD_ACCUM DISTILL_NGPU=$DISTILL_NGPU)"; exit 1; } +# 等效 batch 断言:eff = 卡数 × batch 1 × GA,配方钉死 8。裸 DISTILL_NGPU=8 + GRAD_ACCUM=2 会静默变成 16。 +if [ $((DISTILL_NPROC * GRAD_ACCUM)) -ne 8 ] && [ "${EFF_BATCH_OVERRIDE:-0}" != "1" ]; then + echo "ABORT: 等效 batch = $DISTILL_NPROC 卡 × batch 1 × GA $GRAD_ACCUM = $((DISTILL_NPROC * GRAD_ACCUM)),配方是 8(4 卡 GA2 或 8 卡 GA1)。" + echo " 真要换等效 batch:EFF_BATCH_OVERRIDE=1,并自行保证 ACC_CFG 的 gradient_accumulation_steps == GRAD_ACCUM。" + exit 1 +fi +mkdir -p "$OUT" + +ARGS=( + --init_ckpt "$INIT" + --train_dir "$TRAIN_DIR" --val_dir "$VAL_DIR" + --sidecar "$SIDECAR" --text_table "$TEXT_TABLE" + --teacher_forcing --tf_noise_aug_max_idx "$TF_AUG" + --windowed_train "$WINDOW" --windowed_sink "$WINDOW_SINK" + --new_weight "$NEW_WEIGHT" --scene_dropout "$SCENE_DROPOUT" + --min_rt_ratio "$MIN_RT" --val_min_rt_ratio "$VAL_MIN_RT" --val_frac 0 + --lr "$LR" --weight_decay "$WEIGHT_DECAY" --adam_betas "$ADAM_BETAS" + --warmup "$WARMUP" --grad_clip "$GRAD_CLIP" + --batch_size 1 --grad_accum "$GRAD_ACCUM" --max_steps "$MAX_STEPS" + --gradient_checkpointing + --save_every "$SAVE_EVERY" --keep_last_dits "$KEEP_DITS" --save_state + --val_every "$VAL_EVERY" --val_n "$VAL_N" --val_timesteps "$VAL_TS" + --log_every "$LOG_EVERY" --num_workers "$NUM_WORKERS" --seed "$SEED" + --output "$OUT" +) +# 写成 if 而不是 `[ cond ] && ARGS+=(...)`:set -e 下 && 链的写法太容易踩坑,这里不给它机会 +if [ -n "$RESUME" ] && [ "$RESUME" != "none" ]; then + ARGS+=(--resume "$RESUME") +fi + +echo "[stage1] init=$INIT" +echo "[stage1] out=$OUT port=$PORT cfg=$(basename "$ACC_CFG") 等效 batch=$((DISTILL_NPROC * GRAD_ACCUM))" +echo "[stage1] lr=$LR betas=$ADAM_BETAS warmup=$WARMUP clip=$GRAD_CLIP max_steps=$MAX_STEPS tf_aug=$TF_AUG window=$WINDOW/$WINDOW_SINK" + +# train.log 由 ar_tf.py 自己带时间戳写;这里另存一份 launch.log,收 NCCL / DeepSpeed / traceback 的原始输出 +"$ACC" launch \ + --config_file "$ACC_CFG" \ + --num_processes "$DISTILL_NPROC" --main_process_port "$PORT" \ + "$HERE/ar_tf.py" "${ARGS[@]}" "$@" 2>&1 | tee -a "$OUT/launch.log" diff --git a/backup_2026-09-14/code/distill/stage1_long/run.sh b/backup_2026-09-14/code/distill/stage1_long/run.sh new file mode 100644 index 0000000000000000000000000000000000000000..b7be66b7457fe27e2cf034fdaeab32cd53e2d61f --- /dev/null +++ b/backup_2026-09-14/code/distill/stage1_long/run.sh @@ -0,0 +1,108 @@ +#!/usr/bin/env bash +# ───────────────────────────────────────────────────────────────────────────── +# stage1-long:长视野续训(longhorizon/README.md 的配方,跑在本仓库的 distill/stage1_ar/ar_tf.py 上) +# +# 在 stage1 因果 AR 教师(outputs/distill/stage1_ar/dits/dit_step10000)上,用 K=3 拼成的 15 s 真实长段 +# (data/latent_long/K3,61 cell = 122 帧 TF 双流 = 47,580 token)继续做 teacher forcing。 +# 目标/权重图/条件与 stage1 一字不动,只换训练集(ar_tf.py --long_seg_dir);val 仍是 21-cell 的 val_eybx。 +# +# longhorizon/README 的本机配方:lr 1e-5、warmup 100、全因果(windowed 0/0)、1000 步、每 250 步存, +# 等效 batch 8 时曝光在 ckpt 间游走(750 步全黑),README 建议等效 batch 16 ⇒ 这里默认 8 卡 × GA2 = 16。 +# +# bash distill/stage1_long/run.sh # 正式:8 卡、等效 batch 16、1000 步 +# GRAD_ACCUM=1 bash distill/stage1_long/run.sh # 等效 batch 8(README 原配方,快一倍) +# # 冒烟(OUT 必须绝对路径:$ROOT 是 common.sh 在本脚本内部才导出的) +# MAX_STEPS=3 SAVE_EVERY=3 LOG_EVERY=1 VAL_EVERY=3 VAL_N=4 LIMIT=16 PORT=29546 \ +# OUT=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage1_long \ +# bash distill/stage1_long/run.sh +# +# 前置:actionrope/make_long_segments.py plan/encode 已产出 $LONG/seg*.pt(见 longhorizon/README.md)。 +# 这台机器 8 张卡都是我们的,所以默认 DISTILL_NGPU=8(common.sh 的守卫照样查 0-7 空闲)。 +# ───────────────────────────────────────────────────────────────────────────── +export DISTILL_NGPU="${DISTILL_NGPU:-8}" +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +# shellcheck source=../common.sh +source "$HERE/../common.sh" # set -euo pipefail / ROOT / PY / ACC / 环境 / 卡隔离 / 空闲守卫 + +# ---- 输入输出(都可以用环境变量覆盖)---- +INIT="${INIT:-$ROOT/outputs/distill/stage1_ar/dits/dit_step10000.safetensors}" # stage1 因果 AR 教师 +LONG="${LONG:-$ROOT/data/latent_long/K3}" # 长段目录 +VAL_DIR="${VAL_DIR:-$ROOT/data/latent/val_eybx}" +SIDECAR="${SIDECAR:-$ROOT/data/latent/arope_sidecar.pt}" +TEXT_TABLE="${TEXT_TABLE:-$ROOT/data/latent/text_table_actionrope.pt}" +OUT="${OUT:-$ROOT/outputs/distill/stage1_long_K3}" + +# ---- 并行与端口 ---- +PORT="${PORT:-29545}" # 固定分配:stage1 29531 / stage2-CD 29532 / stage1b 29533 / stage2-fm 29534 / stage3 29536 / stage1-long 29545 / 冒烟 29546+ +if [ "$DISTILL_NGPU" = "8" ]; then + GRAD_ACCUM="${GRAD_ACCUM:-2}" # 8 × 1 × 2 = 16 + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_8gpu_ga${GRAD_ACCUM}.yaml}" +else + GRAD_ACCUM="${GRAD_ACCUM:-4}" # 4 × 1 × 4 = 16 + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_4gpu_ga${GRAD_ACCUM}.yaml}" +fi + +# ---- 配方(longhorizon/README「本机配方」;其余沿用 stage1 的 argparse 默认值)---- +LR="${LR:-1e-5}" +WEIGHT_DECAY="${WEIGHT_DECAY:-0.01}" +ADAM_BETAS="${ADAM_BETAS:-0.9,0.999}" +WARMUP="${WARMUP:-100}" # 续训,不需要 stage1 的 200 +GRAD_CLIP="${GRAD_CLIP:-10.0}" # 与 stage1 / stage1b 相同:同一个目标的续训,gnorm 量级一样(≈2.5,1.0 会步步都裁) +MAX_STEPS="${MAX_STEPS:-1000}" +NEW_WEIGHT="${NEW_WEIGHT:-2.0}" +SCENE_DROPOUT="${SCENE_DROPOUT:-0.1}" +VAL_MIN_RT="${VAL_MIN_RT:-0.9}" +TF_AUG="${TF_AUG:-0}" +WINDOW="${WINDOW:-0}" # 全因果 +WINDOW_SINK="${WINDOW_SINK:-0}" +SAVE_EVERY="${SAVE_EVERY:-250}" +KEEP_DITS="${KEEP_DITS:-0}" # 0 = 不删:README 说曝光在 ckpt 间游走,4-5 份都要留着人眼挑 +VAL_EVERY="${VAL_EVERY:-250}" +VAL_N="${VAL_N:-16}" +VAL_TS="${VAL_TS:-200,500,800}" +LOG_EVERY="${LOG_EVERY:-10}" +NUM_WORKERS="${NUM_WORKERS:-2}" +SEED="${SEED:-0}" +LIMIT="${LIMIT:-}" # 冒烟用:只取前 N 段 +RESUME="${RESUME:-auto}" +SAVE_STATE="${SAVE_STATE:-1}" # 8 卡 ZeRO-2 一个 state 槽约 70 GB,两槽轮转;冒烟可 SAVE_STATE=0 + +# ---- 前置检查 ---- +[ -f "$INIT" ] || { echo "ABORT: 没有 init 检查点: $INIT"; exit 1; } +[ -d "$LONG" ] || { echo "ABORT: 没有长段目录: $LONG(先跑 actionrope.make_long_segments plan/encode)"; exit 1; } +ls "$LONG"/seg*.pt >/dev/null 2>&1 || { echo "ABORT: $LONG 里没有 seg*.pt"; exit 1; } +[ -d "$VAL_DIR" ] || { echo "ABORT: 没有验证集目录: $VAL_DIR"; exit 1; } +[ -f "$SIDECAR" ] || { echo "ABORT: 没有 sidecar: $SIDECAR"; exit 1; } +[ -f "$TEXT_TABLE" ] || { echo "ABORT: 没有文本表: $TEXT_TABLE"; exit 1; } +[ -f "$ACC_CFG" ] || { echo "ABORT: 没有 accelerate 配置: $ACC_CFG(NGPU=$DISTILL_NGPU GRAD_ACCUM=$GRAD_ACCUM)"; exit 1; } +mkdir -p "$OUT" + +ARGS=( + --init_ckpt "$INIT" + --long_seg_dir "$LONG" --val_dir "$VAL_DIR" + --sidecar "$SIDECAR" --text_table "$TEXT_TABLE" + --teacher_forcing --tf_noise_aug_max_idx "$TF_AUG" + --windowed_train "$WINDOW" --windowed_sink "$WINDOW_SINK" + --new_weight "$NEW_WEIGHT" --scene_dropout "$SCENE_DROPOUT" + --val_min_rt_ratio "$VAL_MIN_RT" --val_frac 0 + --lr "$LR" --weight_decay "$WEIGHT_DECAY" --adam_betas "$ADAM_BETAS" + --warmup "$WARMUP" --grad_clip "$GRAD_CLIP" + --batch_size 1 --grad_accum "$GRAD_ACCUM" --max_steps "$MAX_STEPS" + --gradient_checkpointing + --save_every "$SAVE_EVERY" --keep_last_dits "$KEEP_DITS" + --val_every "$VAL_EVERY" --val_n "$VAL_N" --val_timesteps "$VAL_TS" + --log_every "$LOG_EVERY" --num_workers "$NUM_WORKERS" --seed "$SEED" + --output "$OUT" +) +if [ "$SAVE_STATE" = "1" ]; then ARGS+=(--save_state); fi +if [ -n "$LIMIT" ]; then ARGS+=(--limit "$LIMIT"); fi +if [ -n "$RESUME" ] && [ "$RESUME" != "none" ]; then ARGS+=(--resume "$RESUME"); fi + +echo "[stage1-long] init=$INIT" +echo "[stage1-long] long=$LONG ($(ls "$LONG"/seg*.pt | wc -l) 段) out=$OUT port=$PORT cfg=$(basename "$ACC_CFG") 等效 batch=$((DISTILL_NPROC * GRAD_ACCUM))" +echo "[stage1-long] lr=$LR betas=$ADAM_BETAS warmup=$WARMUP clip=$GRAD_CLIP max_steps=$MAX_STEPS save_every=$SAVE_EVERY window=$WINDOW/$WINDOW_SINK" + +"$ACC" launch \ + --config_file "$ACC_CFG" \ + --num_processes "$DISTILL_NPROC" --main_process_port "$PORT" \ + "$ROOT/distill/stage1_ar/ar_tf.py" "${ARGS[@]}" "$@" 2>&1 | tee -a "$OUT/launch.log" diff --git a/backup_2026-09-14/code/distill/stage1b_adapt/run.sh b/backup_2026-09-14/code/distill/stage1b_adapt/run.sh new file mode 100644 index 0000000000000000000000000000000000000000..709cd5db71d425bc2da5d2756bde0e8e5263fc19 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage1b_adapt/run.sh @@ -0,0 +1,130 @@ +#!/usr/bin/env bash +# ───────────────────────────────────────────────────────────────────────────── +# stage1b:条件 dropout 适配微调 +# +# 把 stage1 的因果 AR 教师,在 text 之外**再补出三条合法的 null 分支**, +# 好让 stage2/3 能做 condition-specific CFG 蒸馏。 +# +# 为什么必须单独跑一段:只有训练时 drop 过的条件才能做 guidance。若 v(∅) 是一个 +# 没训过的输入上的外推,`v_c − v_∅` 就是噪声而不是信号。ActionRoPE 的 SFT 只有 +# `--scene_dropout 0.1`(文本)一条;实测语料 22782 条 clip **没有一条**全程静止 +# (静止格占比 0.81%,总位移<10px 的 clip 占 0.25%),所以「零动作」这个 null +# 不训就根本不存在。首帧参考与历史更是从来没有 drop 过。 +# +# 补出来之后,教师侧就有了可分解的引导场: +# ★ Δv_anchor = v(全) − v(摘掉 cell0、历史保留) 锚点**相对于历史**的话语权 ← 主力 +# Δv_action = v(全) − v(offset≡0) 相机运动的贡献 +# Δv_hist = v(全) − v(只剩 cell 0) 历史的贡献 +# Δv_ref = v(只剩 cell 0) − v(无上下文) 锚点在真空里的贡献 +# 目标场 v = v_full + w_s·Δv_anchor + w_a·Δv_action + …,再蒸进少步学生。 +# +# 为什么 anchor 是主力:实测退化的不是动作(绕环 10s 净漂移 18.4px / 191px 环,约 10%), +# 而是**外观**——亮度 +80%、色调走样、丢掉首帧的曝光特征。机制是漂掉的近期历史压过了 +# 首帧锚点(AR rollout 里 |x0| 从 1.111 涨到 1.404)。要压回去就得放大"锚点 vs 历史", +# 也就是 Δv_anchor。Δv_ref 量的是"真空里锚点值多少",与它施加的场景不是同一个 regime, +# 留着做消融。 +# +# 这四条与 text-CFG **正交**:动作走 RoPE 不走文本、参考走首帧 latent 不走文本, +# 所以这个分解在走文本的 baseline 臂上做不出来。 +# +# bash distill/stage1b_adapt/run.sh +# +# # 20 步实机冒烟(OUT 必须绝对路径:$ROOT 是 common.sh 在本脚本内部才导出的) +# MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 VAL_EVERY=10 VAL_N=16 PORT=29543 \ +# OUT=/data/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage1b \ +# bash distill/stage1b_adapt/run.sh +# +# 除三个 dropout 与 INIT/步数外,配方与 stage1 逐项相同 —— 这是同一个目标的续训, +# 不是新配方。lr 保持 1e-5、clip 10.0、new 区 ×2、val_frac 0。 +# ───────────────────────────────────────────────────────────────────────────── +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +# shellcheck source=../common.sh +source "$HERE/../common.sh" # set -euo pipefail / ROOT / PY / ACC / 只用 GPU 0-3 / 空闲守卫 + +STAGE1_OUT="${STAGE1_OUT:-$ROOT/outputs/distill/stage1_ar_tf}" +INIT="${INIT:-$STAGE1_OUT/dits/dit_step10000.safetensors}" # 要适配的因果教师 +TRAIN_DIR="${TRAIN_DIR:-$ROOT/data/latent/train_eybx}" +VAL_DIR="${VAL_DIR:-$ROOT/data/latent/val_eybx}" +SIDECAR="${SIDECAR:-$ROOT/data/latent/arope_sidecar.pt}" +TEXT_TABLE="${TEXT_TABLE:-$ROOT/data/latent/text_table_actionrope.pt}" +OUT="${OUT:-$ROOT/outputs/distill/stage1b_adapt}" + +PORT="${PORT:-29533}" # 固定分配:stage1 29531 / stage2 29532 / stage1b 29533 / stage3 29536 / 冒烟 29541+ +GRAD_ACCUM="${GRAD_ACCUM:-2}" # 等效 batch = 4 卡 × batch 1 × GA = 8,与 stage1 相同 +ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_4gpu_ga${GRAD_ACCUM}.yaml}" + +# ---- 四条要补的 null 分支 ---- +# 概率按「哪条最该生效」分配,不是均分: +# anchor 0.15 ★ 主力(外观漂移是实测的主要短板,这条要训得最扎实) +# action 0.05 实测动作几乎不退化,保留分支但不占样本 +# hist 0.05 消融用 +# ctx 0.05 消融用(与 hist 配对才给出 Δv_ref) +# 三个上下文档互斥(ctx > hist > anchor),合计 25%;action 独立抽签。 +# 于是约 71% 的步仍是完整条件,主目标不会被稀释太多。 +ANCHOR_DROPOUT="${ANCHOR_DROPOUT:-0.15}" +ACTION_DROPOUT="${ACTION_DROPOUT:-0.05}" +HIST_DROPOUT="${HIST_DROPOUT:-0.05}" +CTX_DROPOUT="${CTX_DROPOUT:-0.05}" + +# ---- 其余配方:与 stage1 逐项相同 ---- +LR="${LR:-1e-5}" +WEIGHT_DECAY="${WEIGHT_DECAY:-0.01}" +ADAM_BETAS="${ADAM_BETAS:-0.9,0.999}" +WARMUP="${WARMUP:-100}" # 续训,不需要 stage1 的 200 +GRAD_CLIP="${GRAD_CLIP:-10.0}" +MAX_STEPS="${MAX_STEPS:-3000}" # 4 卡 7.0 s/step ⇒ 约 5.8 h +NEW_WEIGHT="${NEW_WEIGHT:-2.0}" +SCENE_DROPOUT="${SCENE_DROPOUT:-0.1}" +TF_AUG="${TF_AUG:-0}" +WINDOW="${WINDOW:-0}" +WINDOW_SINK="${WINDOW_SINK:-0}" +MIN_RT="${MIN_RT:-0.8}" +VAL_MIN_RT="${VAL_MIN_RT:-0.9}" +SAVE_EVERY="${SAVE_EVERY:-500}" +KEEP_DITS="${KEEP_DITS:-6}" +VAL_EVERY="${VAL_EVERY:-500}" +VAL_N="${VAL_N:-16}" +VAL_TS="${VAL_TS:-201,501,800}" +LOG_EVERY="${LOG_EVERY:-20}" +NUM_WORKERS="${NUM_WORKERS:-2}" +SEED="${SEED:-0}" +RESUME="${RESUME:-auto}" +FORCE_RUN_DIR="${FORCE_RUN_DIR:-0}" + +[ -f "$INIT" ] || { echo "ABORT: 没有 init 检查点: $INIT"; exit 1; } +[ -d "$TRAIN_DIR" ] || { echo "ABORT: 没有训练集: $TRAIN_DIR"; exit 1; } +[ -f "$SIDECAR" ] || { echo "ABORT: 没有 sidecar: $SIDECAR"; exit 1; } +[ -f "$TEXT_TABLE" ] || { echo "ABORT: 没有文本表: $TEXT_TABLE"; exit 1; } +[ -f "$ACC_CFG" ] || { echo "ABORT: 没有 accelerate 配置: $ACC_CFG"; exit 1; } +mkdir -p "$OUT" + +ARGS=( + --init_ckpt "$INIT" + --train_dir "$TRAIN_DIR" --val_dir "$VAL_DIR" + --sidecar "$SIDECAR" --text_table "$TEXT_TABLE" + --teacher_forcing --tf_noise_aug_max_idx "$TF_AUG" + --windowed_train "$WINDOW" --windowed_sink "$WINDOW_SINK" + --anchor_dropout "$ANCHOR_DROPOUT" --action_dropout "$ACTION_DROPOUT" + --hist_dropout "$HIST_DROPOUT" --ctx_dropout "$CTX_DROPOUT" + --new_weight "$NEW_WEIGHT" --scene_dropout "$SCENE_DROPOUT" + --min_rt_ratio "$MIN_RT" --val_min_rt_ratio "$VAL_MIN_RT" --val_frac 0 + --lr "$LR" --weight_decay "$WEIGHT_DECAY" --adam_betas "$ADAM_BETAS" + --warmup "$WARMUP" --grad_clip "$GRAD_CLIP" + --batch_size 1 --grad_accum "$GRAD_ACCUM" --max_steps "$MAX_STEPS" + --gradient_checkpointing + --save_every "$SAVE_EVERY" --keep_last_dits "$KEEP_DITS" --save_state + --val_every "$VAL_EVERY" --val_n "$VAL_N" --val_timesteps "$VAL_TS" + --log_every "$LOG_EVERY" --num_workers "$NUM_WORKERS" --seed "$SEED" + --output "$OUT" +) +if [ -n "$RESUME" ] && [ "$RESUME" != "none" ]; then ARGS+=(--resume "$RESUME"); fi +if [ "$FORCE_RUN_DIR" = "1" ]; then ARGS+=(--force_run_dir); fi + +echo "[stage1b] init=$INIT" +echo "[stage1b] out=$OUT port=$PORT cfg=$(basename "$ACC_CFG") 等效 batch=$((DISTILL_NPROC * GRAD_ACCUM))" +echo "[stage1b] dropout: ★anchor=$ANCHOR_DROPOUT action=$ACTION_DROPOUT hist=$HIST_DROPOUT ctx=$CTX_DROPOUT scene=$SCENE_DROPOUT" +echo "[stage1b] lr=$LR clip=$GRAD_CLIP max_steps=$MAX_STEPS" +"$ACC" launch \ + --config_file "$ACC_CFG" \ + --num_processes "$DISTILL_NPROC" --main_process_port "$PORT" \ + "$ROOT/distill/stage1_ar/ar_tf.py" "${ARGS[@]}" "$@" 2>&1 | tee -a "$OUT/launch.log" diff --git a/backup_2026-09-14/code/distill/stage2_cd/cd_arope.py b/backup_2026-09-14/code/distill/stage2_cd/cd_arope.py new file mode 100644 index 0000000000000000000000000000000000000000..19b5b50b24c07463e051cc02e88391f8a202e698 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage2_cd/cd_arope.py @@ -0,0 +1,846 @@ +#!/usr/bin/env python3 +"""stage2:因果一致性蒸馏(Causal Consistency Distillation,CF++ 的 P1 忠实路线)。 + + # 4 卡正式训练(配方常量钉在 run.sh 里,argparse 默认值与它逐项相同) + bash distill/stage2_cd/run.sh + + # 30 秒 dry run(tiny 三模型 + 合成数据,不碰真权重;验三模型装配 / loss / EMA / 导出 / 续训) + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + .venv/bin/python distill/stage2_cd/cd_arope.py --dry_run \\ + --output /data/zhiyangdeng/ActionRoPE/distill/_smoke_stage2 + +这一阶段是什么 +------------- +stage1 产出的是**多步**因果 AR 扩散模型(要 50 步才出图)。CD 把它压成**少步**学生: +沿教师自己的 ODE 轨迹做局部自一致 —— 学生在噪声档 t 处给出的 x0 估计,必须等于 EMA 影子在 +「教师走了一个 Euler 步」之后的 t_next 处给出的 x0 估计。链条从轴的最低点(那里教师一步估计 +本来就准)一路往高噪端传播,于是几步采样也能落回同一条轨迹。 + +★ 产物是 **EMA 影子**:`ema/ema_step{N}.safetensors`。 + `dits/dit_step{N}.safetensors` 只为续训而存。拿 dits/ 去部署或去当 stage3 的 init 不会报错, + 只会静默拿到一个更差的模型(PORT_SPEC risk 12;上游 cd_gm.py:483 / run.sh:40 是同一句话)。 + +一步训练(= `_wm/WorldMind/distill/code/stage2_cd/cd_gm.py:91-134`,条件换成 ActionRoPE 的) +-------------------------------------------------------------------------------------- + idx ← 一致性轴上抽一格([0, K-2]),**每个 rank 抽到同一格** + lat_t = (1−σ_t)·x0 + σ_t·ε cell 0 钉回干净 GT(TI2V 锚点) + lat_tn = lat_t + (σ_tn − σ_t)·教师(lat_t, t) 一个 Euler 步,cell 0 再钉一次 + cm_t = lat_t − σ_t ·学生(lat_t , t ) 带梯度 + cm_tn = lat_tn − σ_tn·EMA (lat_tn, t_n) 无梯度 + loss = MSE(cm_t[:,:,1:], cm_tn[:,:,1:].detach()) + +三个模型,都是 AropeDiT、都 causal=True、都从**同一份** stage1 权重起步(CF++ P1:轨迹匹配 +的目标要求师生同结构同初值): + * student —— 可训练,DeepSpeed ZeRO-2 引擎,开梯度检查点 + * teacher —— bf16 冻结,**不进** accelerator.prepare + * ema —— fp32 影子(distill/ema.py),**不进** accelerator.prepare + +★ 为什么只有 student 进 prepare:accelerate 的 `for obj in result: if isinstance(obj, nn.Module): model = obj` + (accelerator.py:2229-2236)在 DeepSpeed 下**只留最后一个** nn.Module,其余的一声不吭就没被包装。 + 上游 cd_gm.py:401 把三个模型一起塞进 prepare 是靠 FSDP 才成立的,照抄到 DeepSpeed 上会静默出错。 + 代价是 teacher / ema 必须**手工搬设备**,而且 `dit.freqs` 是普通 tuple 属性(不是 buffer), + `.to(device)` 搬不动它 —— 三个裸模块都得各自 `move_rope_table(device)` 一次,第一步之前断言(见 `_assert_ready`)。 + +一致性轴 = 部署采样表(用户拍板,不是默认值可选项) +-------------------------------------------------- +部署是 4 步 `denoise_list 1000,750,500,250`,所以 CD 轴的节点就是这四个 t 落到 1000 点训练网格上的 +σ = [1.0, 0.75, 0.5006, 0.2516],一致性对是 (0→1)、(1→2)、(2→3) 三对。训练和推理必须是同一条轴: +在 σ=0.75 上做过一致性约束、推理却在 σ=0.833 上读 x0,读出来是条件均值(糊)—— +上游 `set_timesteps(2)` 给 [1000, 833] 就是踩的这个坑(dmd_gm.py:461-467)。 +`--cd_axis discrete --discrete_cd_N 48` 保留 WorldMind 的密轴做对照,但**默认不是它**, +而且切过去会打印「部署读点不在轴上」的警告。 + +两处必须守住的坑 +--------------- +* `flow_pf` 的模块级 scheduler 是 1000 点训练网格,`set_timesteps` 是破坏性的就地覆写。 + 轴一律走 `flow_pf.deploy_schedule()` / `flow_pf.cd_axis(N)`(内部用临时实例),**永远别自己调 + set_timesteps**(对抗评审 [MINOR])。 +* 一致性 idx 是**每个 micro batch 抽一次**,不是每个优化器步一次。续训要按 micro batch 数快进 + 这条随机流(cd_gm.py:417-421),并且中途改 `--grad_accum` 会让四个 rank 抽到不同的格 —— 直接拒绝。 +""" +from __future__ import annotations + +import argparse +import math +import os +import platform +import socket +import sys +import time +import warnings + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +# 分配器要在 import torch 之前设:launch 时 export 的环境变量到不了 accelerate 拉起的子进程(C 的 train.py:22-27) +os.environ.setdefault("PYTORCH_CUDA_ALLOC_CONF", "expandable_segments:True") + +import torch +import torch.nn.functional as F +from accelerate import Accelerator +from accelerate.utils import DistributedType, set_seed + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.dataset import DEFAULT_SIDECAR, TEXT_TABLES, AropeLatentDataset, arope_collate, load_sidecar # noqa: E402 +from actionrope.prompts import NULL_PROMPT # noqa: E402 +from distill import runlib # noqa: E402 +from distill.arope_dit import MODEL_DIR, AropeDiT, unwrap # noqa: E402 +from distill.data import make_mask_input, to_device # noqa: E402 +from distill.ema import EmaShadow # noqa: E402 +from distill.flow_pf import ( # noqa: E402 + DEPLOY_DENOISE_LIST, + assert_deploy_covered, + cd_axis, + deploy_schedule, + idx_of_t, + sigma_of_idx, + t_of_idx, +) + +CELLS = 21 # 一条 clip 的 latent cell 数(数据集硬契约) +STAGE = "stage2_cd" + + +# ---------------------------------------------------------------------------- +# 一致性轴 +# ---------------------------------------------------------------------------- + +def build_cd_axis(mode: str, denoise_list, discrete_N: int, tail_t: float, device=None, log=print): + """返回 (sigmas[K], timesteps[K], info)。K−1 个一致性对:(0→1)、(1→2)…(下标越大越干净)。 + + mode="deploy"(默认,用户拍板) + 轴的节点**就是**部署采样表落到 1000 点训练网格上的那几个点。K=4 ⇒ 3 对,每步 Δσ≈−0.25。 + 这条轴保证「训练约束过的噪声档」与「推理读 x0 的噪声档」逐点相同。 + mode="discrete" + WorldMind 的密轴 `FlowMatchScheduler("Wan").set_timesteps(N)`(N=48 ⇒ Δσ≈−0.004)。 + Euler 步小得多、教师目标更准,但 750 / 500 这两个部署读点不在轴上 —— 会打印警告。 + + tail_t > 0 ⇒ 在轴的**最低点之下**再挂一个节点(比如 100)。它不动任何一个部署节点,只是让 + 「部署最后一步读 x0 的那一档」也变成一次一致性对的**源**:默认 4 节点轴上 σ=0.2516 只当过目标、 + 从不是 source,也没有任何一项 loss 约束它 —— 学生在那里等于 stage1 教师的一步估计**只在 step 0 + 成立**(student == ema == teacher),此后它是固定点族的自由分量:共享参数下 pair 0-2 的梯度会 + 顺带移动 v_θ(·, σ=0.2516),无恢复项(CD-1)。上游 N=48 轴的 σ=0.096 节点结构相同,只是 c_out=−σ + 的杠杆小 2.6×。训练中盯 train_log.csv 里 idx==2 行的 tgt_err(= ‖f_EMA(·, 0.2516) − x0‖²)相对 + step≤200 的基线。CD_TAIL_T=100 ⇒ 轴 [1, 0.75, 0.5006, 0.2516, 0.1011]:多一个 σ=0.1011 节点、 + 4 对、部署节点不变 —— 但轴是 EMA 目标的定义,**只能用于新 run**,续训不能改轴。 + 默认 0 = 关,保持轴与部署表逐点相同。 + """ + dep_sig = deploy_schedule(denoise_list)[1] # [K_dep] 部署读点的 σ + if mode == "deploy": + idx, sig, tst = deploy_schedule(denoise_list) + src = f"deploy_schedule({[float(x) for x in denoise_list]}) → grid idx {idx.tolist()}" + elif mode == "discrete": + sig, tst = cd_axis(int(discrete_N), check_deploy=False) + src = f"cd_axis(N={discrete_N})" + else: + raise SystemExit(f"--cd_axis 只有 deploy / discrete,得到 {mode!r}") + + if tail_t and float(tail_t) > 0: + # 追加节点只允许在**更干净**的一侧,否则会插到部署读点之间、改掉一致性对 + ti = idx_of_t(float(tail_t)) + s_tail, t_tail = sigma_of_idx(ti).reshape(1), t_of_idx(ti).reshape(1) + if float(s_tail) >= float(sig[-1]) - 1e-9: + raise SystemExit(f"--cd_tail_t {tail_t} 的 σ={float(s_tail):.5f} 不低于轴的最低点 " + f"σ={float(sig[-1]):.5f};尾节点必须更干净(t 更小)") + sig, tst = torch.cat([sig, s_tail]), torch.cat([tst, t_tail]) + src += f" + tail t={float(t_tail):.1f}" + + assert bool((sig[:-1] > sig[1:]).all()), f"一致性轴必须严格降序:{sig.tolist()}" + assert sig.shape[0] >= 2, "一致性轴至少要 2 个节点才有一对" + assert_deploy_covered(sig, denoise_list) # 部署读点必须落在轴的 σ 区间内(flow_pf 的门) + # 训练/推理对齐的硬闸门:部署每个读点都必须**恰好是**轴上的节点 + off_axis = [float(s) for s in dep_sig if float((sig - s).abs().min()) > 1e-6] + if mode == "deploy": + assert not off_axis, f"deploy 轴居然漏了部署读点 σ={off_axis}(deploy_schedule 与 build_cd_axis 不一致)" + elif off_axis: + log(f"[axis][warn] 部署读点 σ={[round(s, 5) for s in off_axis]} 不是 {src} 的节点 —— " + f"这些档从没被一致性约束过就要在推理时读 x0。用户拍板的是 --cd_axis deploy。") + info = {"mode": mode, "source": src, "K": int(sig.shape[0]), "pairs": int(sig.shape[0]) - 1, + "sigmas": [round(float(s), 6) for s in sig], "timesteps": [round(float(t), 3) for t in tst], + "dsigma": [round(float(sig[i + 1] - sig[i]), 6) for i in range(sig.shape[0] - 1)], + "deploy_denoise_list": [float(x) for x in denoise_list], + "deploy_sigmas": [round(float(s), 6) for s in dep_sig], + "deploy_off_axis": [round(s, 6) for s in off_axis]} + if device is not None: + sig, tst = sig.to(device), tst.to(device) + return sig, tst, info + + +# ---------------------------------------------------------------------------- +# 目标 +# ---------------------------------------------------------------------------- + +def _keep_frame0(x: torch.Tensor, clip: torch.Tensor) -> torch.Tensor: + """cell 0 换成 clip 的 cell 0(out-of-place,clip 带梯度时也安全)—— cd_gm.py:84-86。""" + f0 = (torch.arange(x.shape[2], device=x.device) == 0).view(1, 1, -1, 1, 1) + return torch.where(f0, clip, x) + + +def cd_loss(student, ema, teacher, batch: dict, *, sig_t, sig_tn, t_v: float, tn_v: float, + teacher_forcing: bool = True, real_guidance_scale: float = 1.0, + uncond=None, uncond_ids=None, solver_steps: int = 1, + use_gradient_checkpointing: bool = False, + noise: torch.Tensor | None = None, gen: torch.Generator | None = None): + """一次 micro batch 的一致性 loss。返回 (loss, stats)。 + + 三次前向共用**同一份** cond(文本 / 世界坐标 / known 掩码 / clean_x):一致性步里唯一变的是 + 噪声档和被加噪的 latent,条件变了就不是同一条轨迹上的两点了(cd_gm.py:95-100)。 + """ + x0 = batch["input_latents"] # [b, 48, 21, 30, 52] bf16 + lat_h, lat_w = x0.shape[3], x0.shape[4] # 几何从 latent 取,dry_run 的小分辨率也能过 + dev = x0.device + # σ 一律转成 **python float**:轴张量留在 CPU,float() 不触发同步,而 0 维标量参与运算时 + # PyTorch 按 x0 的 dtype 走弱类型提升(`1−σ` 先在 double 里算完再降位),比 bf16 张量相减精确。 + # 反过来若把 σ 做成 [1,1,1,1,1] 的 CPU 张量,与 CUDA 上的 x0 相乘会直接报设备不一致。 + s_t, s_tn = float(sig_t), float(sig_tn) + off = batch["offset_px"] # [b, 21, 2] f32 + mask_in = make_mask_input(off, lat_h, lat_w) # [b, 1, 21, 30, 52] known=1 / new=0 + + # ★ cond 在三次前向之间逐字段不变。first_frame_cond=True + **标量** t 就等于 WorldMind 的 + # _per_frame_t(ts[:,0]=0、其余 =t)——stage2 不需要逐 cell 时间步向量(arope.py:213-228)。 + cond = dict(context=batch["context"], context_ids=batch["context_ids"], + offset_px=off, mask_input=mask_in, first_frame_cond=True, + clean_x=(x0 if teacher_forcing else None), aug_t=None) + cond_u = dict(cond, context=uncond, context_ids=uncond_ids) if uncond is not None else None + + if noise is None: + noise = torch.randn(x0.shape, device=dev, dtype=x0.dtype, generator=gen) + # σ=0.99576(N=48 轴的第二格)时 `1 − bf16(σ)` 是灾难性抵消,4% 的相对误差直接打在 x0 的系数上 + # (与 flow_pf.add_noise_pf 同一个理由);用 python 标量就没有这个问题 + lat_t = _keep_frame0((1.0 - s_t) * x0 + s_t * noise, x0) + + ac = torch.autocast(device_type=dev.type, dtype=torch.bfloat16) + + # ---- 教师:从 σ_t 走到 σ_tn(solver_steps 个 Euler 子步,默认 1 = 上游原样)---- + # 累加在 fp32 里做:Δσ 可以到 −0.25(部署轴),bf16 累加会把子步的收益吃掉。 + with torch.no_grad(), ac: + lat = lat_t.float() + x0f = x0.float() + for m in range(int(solver_steps)): + a = s_t + (s_tn - s_t) * (m / solver_steps) + z = s_tn if m == solver_steps - 1 else s_t + (s_tn - s_t) * ((m + 1) / solver_steps) + # 中间点的 t:Wan 网格上 t ≡ σ·1000,端点直接用轴上的 t 值免得多一次浮点往返 + tv = t_v if m == 0 else a * 1000.0 + v_c = teacher(lat.to(x0.dtype), tv, **cond) + if cond_u is None: + v_pred = v_c + else: + v_u = teacher(lat.to(x0.dtype), tv, **cond_u) + v_pred = v_u + real_guidance_scale * (v_c - v_u) + lat = _keep_frame0(lat + (z - a) * v_pred.float(), x0f) + lat_tn = lat.to(x0.dtype) + + # ---- 学生:t 处的 x0 估计(带梯度)---- + with ac: + v_s = student(lat_t, t_v, **cond, use_gradient_checkpointing=use_gradient_checkpointing) + # cm 在 fp32 里算:σ=1 时 cm = ε − v 是两个同量级量相减,bf16 的 8 位尾数会先吃掉残差再进 MSE + cm_t = lat_t.float() - s_t * v_s.float() + + # ---- EMA 影子:t_next 处的 x0 估计(无梯度,目标网络)---- + with torch.no_grad(), ac: + v_e = ema(lat_tn, tn_v, **cond) + cm_tn = lat_tn.float() - s_tn * v_e.float() + + # cell 0 是干净锚点,三条流里都被钉成 GT,算进 loss 只会稀释信号(上游同) + loss = F.mse_loss(cm_t[:, :, 1:], cm_tn[:, :, 1:].detach()) + with torch.no_grad(): + gt = x0.float()[:, :, 1:] + stats = { + "sigma_t": s_t, "sigma_tn": s_tn, "t": float(t_v), "tn": float(tn_v), + # 学生 / 目标各自的 x0 估计离真 x0 有多远:CD loss 只管两者之差,这两条才看得出 + # 一致性链条有没有整体飘离数据流形(loss 降但 cm_err 涨 = 塌成了自洽的糊图) + "cm_err": ((cm_t[:, :, 1:] - gt) ** 2).mean().detach(), + "tgt_err": ((cm_tn[:, :, 1:] - gt) ** 2).mean().detach(), + } + return loss, stats + + +# ---------------------------------------------------------------------------- +# 参数 +# ---------------------------------------------------------------------------- + +def parse_args(argv=None): + ap = argparse.ArgumentParser(description="stage2:因果一致性蒸馏(CD)") + # 默认值 = distill/stage2_cd/run.sh 的实参(PORT_SPEC risk 11:argparse 与 run.sh 不许有第二套配方) + ap.add_argument("--teacher_ckpt", default=None, + help="冻结教师。P1 忠实路线 = stage1 的 dits/dit_step{N}.safetensors(与 --student_ckpt 同一份)") + ap.add_argument("--student_ckpt", default=None, + help="学生 + EMA 的共同 init。P1 = 同一份 stage1 检查点") + ap.add_argument("--model_dir", default=MODEL_DIR) + ap.add_argument("--output", required=True, help="run 目录;相对路径按 runlib.resolve_run_dir 解析") + + ap.add_argument("--train_dir", default=os.path.join(ROOT, "data/latent/train_eybx")) + ap.add_argument("--val_dir", default=os.path.join(ROOT, "data/latent/val_eybx"), + help="stage2 不做验证;这个目录只用来 exclude_src_in —— 与 stage1 同一套划分," + "训练集才还是那 18528 条(少了它会把 val 的相邻 clip 混进训练)") + ap.add_argument("--sidecar", default=DEFAULT_SIDECAR) + ap.add_argument("--text_table", default=TEXT_TABLES["scene"], + help="ARoPE 臂固定 text_mode=scene(剥掉动作从句),361 键那张表") + ap.add_argument("--limit", type=int, default=None, help="smoke 用:只取这么多训练 clip") + ap.add_argument("--scene_dropout", type=float, default=0.0, + help="0:CD 不做 CFG,就不需要无条件样本(上游 cd_gm.py:355,362 同样强制 boss_dropout=0)") + ap.add_argument("--min_rt_ratio", type=float, default=0.8) + + ap.add_argument("--teacher_causal", type=int, default=1, + help="1 = P1 忠实(因果教师 = stage1 产物,师生同轨迹)。0 = P2 务实(双向教师)") + ap.add_argument("--teacher_forcing", action=argparse.BooleanOptionalAction, default=True, + help="干净 GT 走 clean_x 通道穿进**三次**前向(CF naive_consistency.py:110-136)。" + "只有当 stage1 也是 --teacher_forcing 训出来的才能开(会读检查点 metadata 核对)") + ap.add_argument("--windowed_train", type=int, default=0, + help="0 = 全因果。F=21 下 sink=0 的 W=20 会把 cell 0(干净锚点)挤出 cell 20 的视野") + ap.add_argument("--windowed_sink", type=int, default=0, help="[windowed_train>0 时] 恒可见的开头 cell 数") + + ap.add_argument("--cd_axis", default="deploy", choices=["deploy", "discrete"], + help="deploy(用户拍板)= 一致性轴的节点就是 --denoise_list 的部署读点;" + "discrete = WorldMind 的 N 点密轴(对照用,部署读点会掉出轴)") + ap.add_argument("--denoise_list", default=",".join(str(int(x)) for x in DEPLOY_DENOISE_LIST), + help="部署采样表(原始 t 值,从噪到净严格降序)。stage2 的轴和 stage3 都必须是这一串") + ap.add_argument("--discrete_cd_N", type=int, default=48, help="[--cd_axis discrete] 密轴点数(CF 默认 48)") + ap.add_argument("--cd_tail_t", type=float, default=0.0, + help="0 = 关(轴与部署表逐点相同)。>0 ⇒ 在轴最低点之下再挂一个节点," + "让部署最后那一档也成为一致性对的源(见 build_cd_axis 的说明)") + ap.add_argument("--teacher_solver_steps", type=int, default=1, + help="教师从 σ_t 走到 σ_tn 用几个 Euler 子步。1 = 上游原样。部署轴的 Δσ≈−0.25," + "一个 Euler 步的局部截断误差是 O(Δσ²),>1 会让一致性目标更准但每步多几次教师前向") + ap.add_argument("--real_guidance_scale", type=float, default=1.0, + help="教师 CFG。1.0 ⇒ 跳过无条件前向(也便宜一半)。>1 时负条件是 text_table[NULL_PROMPT]") + + ap.add_argument("--ema_decay", type=float, default=0.99, help="目标网络的 EMA 衰减(CF ema_weight 0.99,半衰期≈69 步)") + ap.add_argument("--ema_start", type=int, default=200, help="前这么多步硬拷贝 ema←student,之后才按 decay 走") + + ap.add_argument("--lr", type=float, default=2e-6, help="CF causal_cd 的 2e-6") + ap.add_argument("--weight_decay", type=float, default=0.0) + ap.add_argument("--adam_betas", default="0.0,0.999", + help="CF 约定 beta1=0(一致性目标随 EMA 漂移,动量会追着旧目标跑)。别'顺手修'成 0.9") + ap.add_argument("--warmup", type=int, default=100, help="线性 warmup 步数,之后恒定 lr") + ap.add_argument("--grad_clip", type=float, default=10.0, help="CF max_grad_norm_generator=10.0(cd_gm.py:444)") + ap.add_argument("--opt8bit", type=int, default=0, help="1 = bitsandbytes AdamW8bit(本机没装;4×143 GB 也不需要)") + ap.add_argument("--batch_size", type=int, default=1, help="每卡 micro batch;等效 batch = world × 它 × grad_accum") + ap.add_argument("--grad_accum", type=int, default=2, help="必须与 accelerate yaml 的 gradient_accumulation_steps 相同") + ap.add_argument("--max_steps", type=int, default=8000, help="优化器更新数(不是 micro batch 数)") + ap.add_argument("--gradient_checkpointing", action=argparse.BooleanOptionalAction, default=True) + ap.add_argument("--num_workers", type=int, default=2) + ap.add_argument("--seed", type=int, default=0) + + ap.add_argument("--save_every", type=int, default=500, help="0 ⇒ 只在训练结束时导出一次") + ap.add_argument("--keep_last_emas", type=int, default=25, + help="ema/ 保留几个。stage3 的 init 是从这些里**挑**出来的,别按 dits/ 的口径只留 2 个" + "(上游 --keep_last_states 默认 2 且只剪 ema/,cd_gm.py:472-477)") + ap.add_argument("--keep_last_dits", type=int, default=2, help="dits/ 只为续训而存,留 2 个够了") + ap.add_argument("--log_every", type=int, default=20) + ap.add_argument("--resume", default=None, + help="auto ⇒ 有 /progress.json 就按它续(学生←dits/、影子←ema/,只热启动权重," + "优化器状态不保存);none / 不传 ⇒ 从头") + ap.add_argument("--force_run_dir", action="store_true", + help="--output 目录里 train.log 刚被写过时仍然继续(默认拒:多半是另一个 run 还活着," + "两个 run 同写一个目录会互相 rotate 掉对方的 10 GB 权重)") + ap.add_argument("--dry_run", action="store_true", help="tiny 三模型 + 合成数据,不碰真权重 / 真数据") + args = ap.parse_args(argv) + + if args.windowed_sink > 0 and args.windowed_train <= 0: + raise SystemExit("--windowed_sink 只在 --windowed_train > 0 时有意义") + if args.teacher_forcing and not args.teacher_causal: + raise SystemExit("--teacher_forcing 需要因果教师:clean_x 双流掩码只对 causal=True 有定义" + "(AropeDiT.forward 会直接断言)。要么 --teacher_causal 1,要么 --no-teacher_forcing") + if args.teacher_solver_steps < 1: + raise SystemExit(f"--teacher_solver_steps 至少是 1,得到 {args.teacher_solver_steps}") + try: + b1, b2 = (float(x) for x in args.adam_betas.split(",")) + except ValueError: + raise SystemExit(f"--adam_betas 应形如 '0.0,0.999',得到 {args.adam_betas!r}") from None + args.betas = (b1, b2) + try: + args.denoise = [float(x) for x in args.denoise_list.split(",") if x.strip()] + except ValueError: + raise SystemExit(f"--denoise_list 应形如 '1000,750,500,250',得到 {args.denoise_list!r}") from None + if len(args.denoise) < 2: + raise SystemExit(f"--denoise_list 至少要两个点,得到 {args.denoise}") + if args.dry_run: + args.teacher_ckpt = args.student_ckpt = None + else: + for name in ("teacher_ckpt", "student_ckpt"): + p = getattr(args, name) + if not p: + raise SystemExit(f"--{name} 是必需的(P1 路线:两者都是 stage1 的 dits/dit_step{{N}}.safetensors)") + if not os.path.isfile(p): + raise SystemExit(f"--{name} 不存在:{p}") + return args + + +# ---------------------------------------------------------------------------- +# dry run:tiny 三模型 + 合成数据(PORT_SPEC 的 S6) +# ---------------------------------------------------------------------------- + +TINY = dict(dim=128, in_dim=48, ffn_dim=256, out_dim=48, text_dim=4096, freq_dim=256, eps=1e-6, + patch_size=(1, 2, 2), num_heads=4, num_layers=2, has_image_input=False) +TINY_SHAPE = (48, 5, 8, 10) # [C, cells, lat_h, lat_w] + + +class _SynDataset(torch.utils.data.Dataset): + """dry run 用:形状与 AropeLatentDataset 一致的合成样本(cell 数 / 分辨率缩小)。""" + + def __len__(self): + return 64 + + def __getitem__(self, i: int) -> dict: + g = torch.Generator().manual_seed(i) + c, f, h, w = TINY_SHAPE + off = torch.zeros(f, 2) + off[1:] = torch.randn(f - 1, 2, generator=g).cumsum(0) * 20.0 + return { + "input_latents": torch.randn(c, f, h, w, generator=g, dtype=torch.float32).to(torch.bfloat16), + "context": torch.randn(f, 8, 4096, generator=g, dtype=torch.float32).to(torch.bfloat16), + "context_ids": torch.zeros(f, dtype=torch.int64), + "offset_px": off, + "clip_id": f"syn_{i:04d}", + "kind": "syn", + } + + +def _tiny_model(causal: bool = True) -> AropeDiT: + """固定种子 ⇒ 每次调用得到**逐位相同**的权重(P1 要求 teacher/student/ema 同初值)。""" + from diffsynth.models.wan_video_dit import WanModel + torch.manual_seed(0) + dit = WanModel(**TINY).to(torch.bfloat16) + return AropeDiT(dit=dit, mask_channel=True, causal=causal) + + +# ---------------------------------------------------------------------------- +# 三模型装配的守卫 +# ---------------------------------------------------------------------------- + +def _assert_ready(model, teacher, ema, device, log) -> None: + """第一步之前把「没进 prepare 的两个模型」逐条验一遍。 + + 对抗评审 [MINOR]:teacher / ema 不进 accelerator.prepare 是对的(DeepSpeed 只留最后一个 + nn.Module),代价就是设备与 `dit.freqs` 全得手工搬,而漏搬的表现是 device mismatch 或者 + —— 更糟 —— fp32 影子被谁 .to(bf16) 过之后 EMA 静默失效。 + """ + bare_s = unwrap(model) + for name, m, want_dtype in (("teacher", teacher, torch.bfloat16), ("ema", unwrap(ema.module), torch.float32)): + p = next(m.parameters()) + # device.index 在单进程下是 None(accelerator.device == "cuda"),张量却报 cuda:0 —— 只在 + # 显式给了序号时才比序号,否则单卡自测会误报 + assert p.device.type == device.type and (device.index is None or p.device.index == device.index), \ + f"{name} 的参数在 {p.device},应该在 {device}(它没进 prepare,要手工 .to(device))" + assert p.dtype is want_dtype, f"{name} 的参数是 {p.dtype},应该是 {want_dtype}" + assert m.dit.freqs[0].device.type == device.type, \ + f"{name}.dit.freqs 还在 {m.dit.freqs[0].device}:它是普通 tuple 属性不是 buffer,"\ + f".to(device) 搬不动,必须 move_rope_table(device)" + assert not any(q.requires_grad for q in m.parameters()), f"{name} 还有参数 requires_grad=True" + assert not m.training, f"{name} 还在 train() 模式" + assert m is not bare_s, f"{name} 与学生是同一个对象 —— 三模型退化成一个,loss 恒 0" + assert unwrap(model).dit.freqs[0].device.type == device.type, "学生的 dit.freqs 没搬到卡上" + n_ema, n_stu = len(list(ema.parameters())), len(list(model.parameters())) + assert n_ema == n_stu, f"EMA 与学生的参数个数不同({n_ema} vs {n_stu})—— zip EMA 会静默错位" + log(f"[guard] 三模型就位:student(ZeRO-2, bf16) / teacher(bf16 冻结, 未 prepare) / " + f"ema(fp32 影子, 未 prepare),各 {n_stu} 个参数张量,freqs 都在 {device}") + + +def _ckpt_meta_gate(path: str, args, log) -> dict: + """读 stage1 检查点的 metadata(只读头,不碰 10 GB 数据),核对配方是否接得上。 + + ar_tf.py 的 save_dit 会把 teacher_forcing / windowed_* 写进 metadata。stage1 关了 TF 而 + stage2 开着,会训出一个「历史从没干净过」的学生:不报错、loss 照降(cd_gm.py:253-257 的同一条约束)。 + """ + try: + _, meta = runlib.read_ckpt_header(path) + except Exception as e: # struct.error / json 解析失败都不该拦住训练 + log(f"[ckpt][warn] 读不出 {os.path.basename(path)} 的 metadata({type(e).__name__}: {e}),跳过配方核对") + return {} + if not meta: + return {} + want = {"teacher_forcing": str(bool(args.teacher_forcing)), + "windowed_train": str(int(args.windowed_train)), + "windowed_sink": str(int(args.windowed_sink))} + bad = {k: (meta[k], v) for k, v in want.items() if k in meta and str(meta[k]) != v} + if bad: + raise SystemExit( + "stage1 检查点的配方与 stage2 的参数对不上:" + + ";".join(f"{k} 检查点={a} 本次={b}" for k, (a, b) in bad.items()) + + f"\n 检查点:{path}\n CD 要求师生同轨迹 —— 把 stage2 的对应参数改成检查点里的值。") + log(f"[ckpt] {os.path.basename(path)} metadata: " + + " ".join(f"{k}={meta[k]}" for k in ("stage", "step", "teacher_forcing", "windowed_train") if k in meta)) + return meta + + +def _assert_run_dir_safe(run_dir: str, stage: str, force: bool, log=print, dry_run: bool = False) -> None: + """开跑之前确认 `--output` 指的不是**别人的** run 目录。stage3 有一份逐字相同的副本。 + + 为什么要有它:保存点会 `runlib.rotate_run(run_dir, keep_dits=…)`,那是真的 `os.remove` + 10 GB 的权重文件。而 `--output` 只要是个裸名字就落在 outputs/distill/ 下(runlib.resolve_run_dir), + 所以一个 `OUT=stage1_ar_tf` 的手误就会**删掉正在跑的那次训练的检查点** —— 不报错、不可逆。 + run.sh 的注释里 OUT= 本来就是给冒烟用的常规覆盖项,手误的概率不低。 + + 两道闸,都 fail-closed: + 1. progress.json 里记着别的 stage ⇒ 这是别人的目录,直接拒。 + 2. train.log 在最近 10 分钟里被写过 ⇒ 很可能有另一个 run 正活在这个目录里 + (两个 run 同写一个目录 = 互相 rotate 对方的权重)。崩溃后立刻续训会误判, + 所以留 --force_run_dir 这个显式出口;默认不给。 + """ + prog = runlib.read_progress(run_dir) + if prog and prog.get("stage") and str(prog["stage"]) != stage: + raise SystemExit( + f"ABORT: {run_dir} 是 stage={prog['stage']!r} 的 run 目录(progress.json 记在 step " + f"{prog.get('step')}),本次是 {stage}。保存时会 rotate 掉那边的 dits/ema —— 换个 --output。") + log_path = os.path.join(run_dir, "train.log") + if os.path.isfile(log_path): + age = time.time() - os.path.getmtime(log_path) + if age < 600 and not (force or dry_run): # dry_run 目录是一次性的,天天重跑,不拿这条闸烦它 + raise SystemExit( + f"ABORT: {log_path} 在 {age / 60:.1f} 分钟前还被写过 —— 多半有另一个 run 正活在这个目录里。" + "两个 run 同写一个目录会互相 rotate 掉对方的 10 GB 权重。换个 --output;" + "如果确认上一次已经死了(比如刚崩),加 --force_run_dir(launcher 里是 FORCE_RUN_DIR=1)。") + if age < 600: + log(f"[warn] {log_path} {age / 60:.1f} 分钟前刚被写过,--force_run_dir 强行继续。") + + +# ---------------------------------------------------------------------------- +# 主流程 +# ---------------------------------------------------------------------------- + +def main(argv=None): + args = parse_args(argv) + if args.dry_run and args.max_steps > 30: + # 在打 banner 之前就改掉,否则日志里记的是一套没生效的配方 + args.max_steps, args.save_every, args.warmup, args.log_every, args.ema_start = 12, 6, 3, 2, 3 + accelerator = Accelerator(gradient_accumulation_steps=args.grad_accum) + is_main = accelerator.is_main_process + use_ds = accelerator.distributed_type == DistributedType.DEEPSPEED + set_seed(args.seed, device_specific=True) # 每个 rank 的 ε 抽签都不同;一致性 idx 另走同步的 CPU 流 + device = accelerator.device + + if use_ds: + # 让 --grad_clip 成为唯一入口;yaml 里的 gradient_clipping 只是默认值(train.py:394-401) + ds_cfg = accelerator.state.deepspeed_plugin.deepspeed_config + ds_cfg["gradient_clipping"] = float(args.grad_clip) + ga = ds_cfg.get("gradient_accumulation_steps") + if ga not in ("auto", args.grad_accum): + raise SystemExit(f"--grad_accum={args.grad_accum} 与 accelerate yaml 的 " + f"gradient_accumulation_steps={ga} 不一致:要么传 --grad_accum {ga}," + f"要么换 distill/configs/ 里 GA 匹配的 yaml" + f"(现有 accelerate_zero2_4gpu_ga2 / 4gpu_ga4 / 8gpu_ga1 / 8gpu_ga2 四份;" + f"等效 batch = num_processes × batch_size × GA,配方 8 = 4 卡 GA2 或 8 卡 GA1," + f"run.sh 按 DISTILL_NGPU 选)") + ds_cfg["gradient_accumulation_steps"] = args.grad_accum + + run_dir = runlib.resolve_run_dir(args.output) + # ★ 在**任何**写之前查:--output 指的是不是别人的 run 目录(保存时会 rotate 掉那边的 10 GB 权重)。 + # 所有 rank 都在这里 stat,之后再 barrier,保证没人先把 train.log 写新了让别的 rank 误判。 + _assert_run_dir_safe(run_dir, STAGE, bool(args.force_run_dir), dry_run=bool(args.dry_run)) + accelerator.wait_for_everyone() + if is_main: + os.makedirs(run_dir, exist_ok=True) + log = runlib.TextTee(os.path.join(run_dir, "train.log"), enabled=is_main) + jsonl = runlib.JsonlLogger(os.path.join(run_dir, "train_log.jsonl"), enabled=is_main) + eff_batch = accelerator.num_processes * args.batch_size * args.grad_accum + log(f"=== {STAGE} | run={run_dir} world={accelerator.num_processes} " + f"dist={accelerator.distributed_type} mp={accelerator.mixed_precision} ===") + log(f"[recipe] teacher_causal={args.teacher_causal} tf={args.teacher_forcing} " + f"windowed={args.windowed_train}/{args.windowed_sink} cfg={args.real_guidance_scale} " + f"ema={args.ema_decay}@{args.ema_start} lr={args.lr} betas={args.betas} wd={args.weight_decay} " + f"warmup={args.warmup} clip={args.grad_clip} " + f"bs={args.batch_size}×accum{args.grad_accum}×{accelerator.num_processes}卡 ⇒ 等效 batch {eff_batch} " + f"max_steps={args.max_steps} gc={args.gradient_checkpointing}") + low = runlib.warn_if_low_disk(run_dir) + if low: + log(f"[warn] {low}") + + # ---- 一致性轴(必须在建模型之前定下来:续训要拿它的指纹做守卫)---- + # 轴留在 CPU:cd_loss 只把 σ / t 当 python 标量用,留在 CPU 就不会每个 micro batch 同步一次 + sig, tst, axis_info = build_cd_axis(args.cd_axis, args.denoise, args.discrete_cd_N, + args.cd_tail_t, device=None, log=log) + K = int(sig.shape[0]) + log(f"[axis] {axis_info['source']} K={K}({K - 1} 对一致性)") + log(f"[axis] sigma = {axis_info['sigmas']}") + log(f"[axis] t = {axis_info['timesteps']}") + log(f"[axis] Δsigma= {axis_info['dsigma']} 教师 Euler 子步 = {args.teacher_solver_steps}") + log(f"[axis] 部署采样表 {axis_info['deploy_denoise_list']} → sigma {axis_info['deploy_sigmas']}" + f"{'(逐点都是轴上的节点)' if not axis_info['deploy_off_axis'] else '(有读点不在轴上!)'}") + + # ---- 数据 ---- + if args.dry_run: + train_ds = _SynDataset() + log("[dry_run] tiny 三模型 + 合成数据") + else: + sidecar = load_sidecar(args.sidecar) + # exclude_src_in=val_dir:与 stage1 完全同一套划分,训练集才还是 18528 条 + train_ds = AropeLatentDataset(args.train_dir, sidecar=sidecar, text_table=args.text_table, + text_mode="scene", scene_dropout=args.scene_dropout, + limit=args.limit, seed=args.seed, verbose=is_main, + exclude_src_in=args.val_dir, min_rt_ratio=args.min_rt_ratio) + log(f"[data] train {len(train_ds)} clip(scene_dropout={args.scene_dropout},CD 不做 CFG 所以是 0)") + dataloader = torch.utils.data.DataLoader( + train_ds, batch_size=args.batch_size, shuffle=True, drop_last=True, collate_fn=arope_collate, + num_workers=args.num_workers, pin_memory=True, persistent_workers=args.num_workers > 0, + ) + + # ---- 续训(只热启动权重:学生 ← dits/、影子 ← ema/;优化器状态不保存)---- + resume_step, resume_micro = 0, 0 + student_init, ema_init = args.student_ckpt, None + if args.resume and args.resume != "none": + prog = runlib.read_progress(run_dir) + if not prog or int(prog.get("step", 0)) <= 0: + log(f"[resume] {run_dir} 里没有 progress.json,从头开始") + else: + n = int(prog["step"]) + dp, ep = runlib.dit_path(run_dir, n), runlib.ema_path(run_dir, n) + miss = [p for p in (dp, ep) if not os.path.isfile(p)] + if miss: + raise SystemExit(f"progress.json 说停在 step {n},但 {miss} 不存在。" + f"要么把 --resume 关掉从头跑,要么把 progress.json 的 step 改成还在的那个。") + # 一致性 idx 是每个 micro batch 抽一次的同步流:grad_accum 变了 = 四个 rank 之后抽到不同的格 + old_ga = prog.get("grad_accum") + if old_ga is not None and int(old_ga) != args.grad_accum: + raise SystemExit(f"续训不许改 --grad_accum(存档 {old_ga} → 本次 {args.grad_accum}):" + f"一致性 idx 每个 micro batch 抽一次,改了累积数这条流就在各 rank 之间错开了") + old_axis = prog.get("axis_sigmas") + if old_axis is not None and [round(float(s), 6) for s in old_axis] != axis_info["sigmas"]: + raise SystemExit(f"续训不许换一致性轴(存档 {old_axis} → 本次 {axis_info['sigmas']})") + resume_step, student_init, ema_init = n, dp, ep + resume_micro = int(prog.get("micro", n * args.grad_accum)) + log(f"[resume] step {resume_step}:student←{os.path.basename(dp)} ema←{os.path.basename(ep)}" + f"(micro batch 计数 {resume_micro})") + + # ---- 模型:三个 AropeDiT,全部 causal 由角色决定,全部从同一份 stage1 权重起步 ---- + t0 = time.time() + win = dict(train_local_attn_size=args.windowed_train, train_sink_size=args.windowed_sink) + if args.dry_run: + module = _tiny_model(causal=True) + teacher = _tiny_model(causal=bool(args.teacher_causal)) + load_info = None + if student_init: # dry_run 也走一遍续训的装载路径 + runlib.load_dit_ckpt(module, student_init) + log(f"[model] student ← {student_init}") + else: + _ckpt_meta_gate(student_init, args, log) + if args.teacher_ckpt != student_init: # P1 下两者同一份,只在真的分叉时再验一次 + _ckpt_meta_gate(args.teacher_ckpt, args, log) + module = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=True, **win) + info_s = runlib.load_dit_ckpt(module, student_init) + log(f"[model] student ← {student_init}({info_s['n_tensors']} 个张量,缺 {info_s['missing']})") + teacher = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=bool(args.teacher_causal), **win) + info_t = runlib.load_dit_ckpt(teacher, args.teacher_ckpt) + log(f"[model] teacher ← {args.teacher_ckpt}(causal={bool(args.teacher_causal)}," + f"{info_t['n_tensors']} 个张量,缺 {info_t['missing']})") + load_info = {"student": info_s, "teacher": info_t} + # 教师:bf16 冻结。ActionRoPE 的检查点本来就是 bf16,这里显式钉一遍免得将来换了 loader 就漂了 + teacher.to(torch.bfloat16).requires_grad_(False).eval() + + # EMA 影子:deepcopy 学生(而不是再建一个 AropeDiT)—— 既省一次 10 GB 的底模盘读, + # 又保证 step 0 时 ema 与 student 逐位相同(CF++ P1 的前提) + ema = EmaShadow(module, device=None) # 先在 CPU 上转 fp32,等 prepare 之后再上卡 + if ema_init is not None: + info_e = runlib.load_dit_ckpt(ema, ema_init) # assign=False ⇒ copy_ 进 fp32 参数,不会退回 bf16 + ema._assert_fp32() + log(f"[model] ema ← {ema_init}({info_e['n_tensors']} 个张量)") + n_params = sum(p.numel() for p in module.parameters()) + module.train().requires_grad_(True) + log(f"[model] 三份 AropeDiT 各 {n_params:,} 参数;构建 {time.time() - t0:.0f}s") + + # ---- 优化器 ---- + if args.opt8bit and not args.dry_run: + import bitsandbytes as bnb # 本机没装;留着是为了与上游配方对齐 + optimizer = bnb.optim.AdamW8bit(module.parameters(), lr=args.lr, + weight_decay=args.weight_decay, betas=args.betas) + else: + optimizer = torch.optim.AdamW(module.parameters(), lr=args.lr, + weight_decay=args.weight_decay, betas=args.betas) + warm = max(int(args.warmup), 0) + # lr scheduler 故意不进 prepare:accelerate 包装后每步会 step num_processes 次,warmup 被悄悄压缩 + lr_scheduler = torch.optim.lr_scheduler.LambdaLR(optimizer, lambda s: min(1.0, (s + 1) / warm) if warm > 0 else 1.0) + if resume_step: + # 续训是只热启动权重的(优化器状态不保存),lr scheduler 不快进的话会把 warmup 重跑一遍。 + # warmup 之后是恒定 lr,所以快进等价于"接着上次的 lr"。 + with warnings.catch_warnings(): # 优化器还没 step 就先走 scheduler,PyTorch 会提醒一句,这里是有意的 + warnings.simplefilter("ignore") + for _ in range(resume_step): + lr_scheduler.step() + + # ★ 只把 **一个** nn.Module 交给 prepare(accelerator.py:2229-2236 只留最后一个,多传会静默丢)。 + # teacher 是 nn.Module、ema 是 EmaShadow(故意不是 nn.Module),两者都在这行之外。 + model, optimizer, dataloader = accelerator.prepare(module, optimizer, dataloader) + unwrap(model).move_rope_table(device) # dit.freqs 是普通 tuple 属性,prepare / .to() 都搬不动 + teacher.to(device).move_rope_table(device) + ema.to(device) + unwrap(ema.module).move_rope_table(device) + _assert_ready(model, teacher, ema, device, log) + if is_main and use_ds: + clip_eff = getattr(getattr(model, "optimizer", None), "clip_grad", None) + log(f"[env] grad_clip={args.grad_clip}(DeepSpeed 生效值 {clip_eff})") + + # ---- CFG 的负条件(cfg==1 时根本不建)---- + # 只存 [1,1,L,4096] 这一行;每个 micro batch 现 expand 成 [b,f,L,4096],配一份全 0 的 ids + # (同 id ⇒ _embed_context 只对唯一行算一次 text_embedding,不会真的算 21 遍) + uncond = None + if abs(args.real_guidance_scale - 1.0) >= 1e-6: + if args.dry_run: + null_row = torch.randn(8, 4096, dtype=torch.bfloat16) # tiny 的 L=8 + else: + table = train_ds.text_table + if NULL_PROMPT not in table: + raise SystemExit(f"--real_guidance_scale={args.real_guidance_scale} 需要负条件,但文本表里没有 " + f"NULL_PROMPT={NULL_PROMPT!r}({args.text_table})") + null_row = table[NULL_PROMPT].to(torch.bfloat16) + # [1, 1, L, 4096],用的时候按 [b, f, L, 4096] expand;ids 全 0 ⇒ _embed_context 只算一行 + uncond = null_row.view(1, 1, *null_row.shape).to(device) + log(f"[cfg] real_guidance_scale={args.real_guidance_scale},负条件 = NULL_PROMPT " + f"{tuple(null_row.shape)}(每个 micro batch 多一次教师前向)") + + # ---- config.json:复现所需的一切 ---- + if is_main: + cfg = { + "stage": STAGE, "args": vars(args), "eff_batch": eff_batch, "axis": axis_info, + "dataset": ({"synthetic": True} if args.dry_run else { + "train_dir": args.train_dir, "train_used": len(train_ds), + "train_total": train_ds.n_total, "train_invalid": train_ds.n_invalid, + "train_leak_excluded": train_ds.n_leak, "train_low_rt_excluded": train_ds.n_low_rt, + "text_table_keys": len(train_ds.text_table), "excluded_src_in": args.val_dir}), + "model": {"n_params": n_params, "causal_student": True, "causal_teacher": bool(args.teacher_causal), + "mask_channel": True, "student_ckpt": student_init, "teacher_ckpt": args.teacher_ckpt, + "ema_ckpt": ema_init, "load_info": load_info, "start_step": resume_step}, + "product": {"deploy": "ema/ema_step{N}.safetensors", + "resume_only": "dits/dit_step{N}.safetensors", + "note": "stage3 的 --student_ckpt 从 ema/ 里挑,绝不要用 dits/"}, + "env": {"world_size": accelerator.num_processes, "distributed_type": str(accelerator.distributed_type), + "mixed_precision": accelerator.mixed_precision, "torch": torch.__version__, + "cuda": torch.version.cuda, + "gpu": torch.cuda.get_device_name(0) if torch.cuda.is_available() else None, + "python": sys.executable, "platform": platform.platform(), "hostname": socket.gethostname(), + "argv": sys.argv, "started": time.strftime("%Y-%m-%d %H:%M:%S"), + "cuda_visible_devices": os.environ.get("CUDA_VISIBLE_DEVICES")}, + "deepspeed_config": (accelerator.state.deepspeed_plugin.deepspeed_config if use_ds else None), + } + try: + import accelerate # noqa: F401 + cfg["env"]["accelerate"] = accelerate.__version__ + except Exception: + pass + runlib.save_config(run_dir, cfg) + + # ---- 日志 ---- + csv_fields = ["step", "cd", "cm_err", "tgt_err", "idx", "sigma_t", "sigma_tn", "ema_decay", + "lr", "grad_norm", "step_time", "mem_gb", "epoch"] + train_log = runlib.CsvLog(os.path.join(run_dir, "train_log.csv"), csv_fields, enabled=is_main) + + def do_save(step, loss_val=None, micro=0): + # save_dit 是集合操作(accelerator.get_state_dict),每个 rank 都必须进来 + meta = {"stage": STAGE, "step": step, "teacher_forcing": args.teacher_forcing, + "windowed_train": args.windowed_train, "windowed_sink": args.windowed_sink, + "cd_axis": args.cd_axis, "denoise_list": args.denoise_list, + "ema_decay": args.ema_decay, "student_ckpt": student_init, "teacher_ckpt": args.teacher_ckpt} + expect = None if args.dry_run else runlib.AROPE_DIT_KEYS + runlib.save_dit(accelerator, model, runlib.dit_path(run_dir, step), + {**meta, "role": "raw_student_resume_only"}, expect_keys=expect, log=log) + # ★ 部署权重 / stage3 的 init:EMA。上一行的 dits/ 只为续训存在。 + runlib.save_dit(accelerator, ema, runlib.ema_path(run_dir, step), + {**meta, "role": "ema_deploy"}, expect_keys=expect, log=log) + if is_main: + gone_d = runlib.rotate(runlib.dit_glob(run_dir), args.keep_last_dits) + gone_e = runlib.rotate(runlib.ema_glob(run_dir), args.keep_last_emas) + if gone_d or gone_e: + log(f"[rotate] 删掉 {len(gone_d)} 个旧 dit(留 {args.keep_last_dits})、" + f"{len(gone_e)} 个旧 ema(留 {args.keep_last_emas})") + runlib.write_progress(run_dir, step, stage=STAGE, loss=loss_val, micro=micro, + grad_accum=args.grad_accum, axis_sigmas=axis_info["sigmas"], + deploy="ema/ema_step%d.safetensors" % step) + + # ---- 一致性 idx 的随机流:CPU 生成器,**所有 rank 同一个种子** ⇒ 每个 micro batch 抽到同一格 ---- + idx_rng = torch.Generator(device="cpu").manual_seed(1234 + args.seed) + for _ in range(resume_micro): # 按 micro batch 数快进(cd_gm.py:417-421) + torch.randint(0, K - 1, (1,), generator=idx_rng) + + # ---- 训练循环 ---- + model.train() + step, epoch, micro, last_saved = resume_step, 0, resume_micro, resume_step + if device.type == "cuda": + torch.cuda.reset_peak_memory_stats(device) + log(f"[train] 从 step {step} 到 {args.max_steps}") + micro_time, loss_ema = 0.0, None + hits = [0] * (K - 1) # 每一格被抽到几次(K−1 只有 3 格时特别值得看) + while step < args.max_steps: + for batch in dataloader: + if step >= args.max_steps: + break + t_step = time.time() + batch = to_device(batch, device) + lr_now = lr_scheduler.get_last_lr()[0] # 本步用的 lr(step 之后拿到的是下一步的) + with accelerator.accumulate(model): + # 每个 micro batch 抽一次,四个 rank 同步(否则 DDP 平均的是四条不同轨迹上的梯度) + idx = int(torch.randint(0, K - 1, (1,), generator=idx_rng).item()) + micro += 1 + hits[idx] += 1 + b = batch["input_latents"].shape[0] + loss, stats = cd_loss( + model, ema, teacher, batch, + sig_t=float(sig[idx]), sig_tn=float(sig[idx + 1]), + t_v=float(tst[idx]), tn_v=float(tst[idx + 1]), + teacher_forcing=args.teacher_forcing, real_guidance_scale=args.real_guidance_scale, + uncond=(None if uncond is None else uncond.expand(b, batch["context"].shape[1], -1, -1)), + uncond_ids=(None if uncond is None else torch.zeros_like(batch["context_ids"])), + solver_steps=args.teacher_solver_steps, + use_gradient_checkpointing=args.gradient_checkpointing) + accelerator.backward(loss) # DeepSpeed 下这一步已含 engine.step()(裁剪 + 更新) + grad_norm = (accelerator.clip_grad_norm_(model.parameters(), args.grad_clip) + if accelerator.sync_gradients else None) + optimizer.step() + if accelerator.sync_gradients: + lr_scheduler.step() # DeepSpeed 的 scheduler 包装不认累积边界,只能在这里守门 + optimizer.zero_grad(set_to_none=True) + if device.type == "cuda": + torch.cuda.synchronize(device) + micro_time += time.time() - t_step + if not accelerator.sync_gradients: + continue # 还在累积,不算一步 + step += 1 + # ★ EMA 必须在优化器更新**之后**、每个优化器步只做一次(不是每个 micro batch)。 + # step<=ema_start 期间硬拷贝:目标网络先跟紧学生,之后才开始滞后(cd_gm.py:448 同口径)。 + decay = 0.0 if step <= args.ema_start else args.ema_decay + ema.update(model, decay) + step_time, micro_time = micro_time, 0.0 + loss_mean = accelerator.reduce(loss.detach().float(), reduction="mean").item() + loss_ema = loss_mean if loss_ema is None else 0.9 * loss_ema + 0.1 * loss_mean + if is_main and (step % args.log_every == 0 or step == args.max_steps): + gn = float(grad_norm) if grad_norm is not None and math.isfinite(float(grad_norm)) else float("nan") + row = {"step": step, "cd": loss_mean, "cm_err": stats["cm_err"].item(), + "tgt_err": stats["tgt_err"].item(), "idx": idx, + "sigma_t": stats["sigma_t"], "sigma_tn": stats["sigma_tn"], "ema_decay": decay, + "lr": lr_now, "grad_norm": gn, "step_time": step_time, + "mem_gb": (torch.cuda.max_memory_allocated(device) / 1024 ** 3 if device.type == "cuda" else 0.0), + "epoch": epoch} + train_log.write(row) + jsonl.log({**row, "cd_ema": loss_ema, "micro": micro, "axis_hits": hits}) + log(f"step {step}/{args.max_steps} cd {loss_mean:.5f} (ema {loss_ema:.5f}) " + f"σ {row['sigma_t']:.4f}→{row['sigma_tn']:.4f} [idx {idx}] " + f"cm_err {row['cm_err']:.4f} tgt {row['tgt_err']:.4f} " + f"lr {lr_now:.2e} gnorm {gn:.3f} decay {decay:.2f} " + f"{step_time:.2f}s mem {row['mem_gb']:.1f}GB") + if args.save_every > 0 and step % args.save_every == 0: + do_save(step, loss_mean, micro) + last_saved = step + epoch += 1 + + if last_saved != step: + do_save(step, loss_ema, micro) + if device.type == "cuda": + peak = torch.tensor(torch.cuda.max_memory_allocated(device) / 1024 ** 3, device=device) + peak_max = accelerator.reduce(peak, reduction="max").item() + else: + peak_max = 0.0 + log(f"[done] step {step},一致性轴各格命中 {hits},各进程峰值显存 {peak_max:.1f} GB。" + f"下一步:从 ema/ 里挑一个 ema_step{{N}}.safetensors 做 stage3 的 --student_ckpt(不要用 dits/)") + if is_main: + runlib.write_progress(run_dir, step, stage=STAGE, finished=True, peak_mem_gb=peak_max, + micro=micro, grad_accum=args.grad_accum, axis_sigmas=axis_info["sigmas"], + deploy="ema/ema_step%d.safetensors" % step) + train_log.close() + jsonl.close() + log.close() + accelerator.wait_for_everyone() + accelerator.end_training() + return step + + +if __name__ == "__main__": + main() diff --git a/backup_2026-09-14/code/distill/stage2_cd/config.json b/backup_2026-09-14/code/distill/stage2_cd/config.json new file mode 100644 index 0000000000000000000000000000000000000000..13f6798e6a208efdb7b0b4e84d10db8b0fcf959a --- /dev/null +++ b/backup_2026-09-14/code/distill/stage2_cd/config.json @@ -0,0 +1,96 @@ +{ + "_note": "stage2(因果一致性蒸馏)真正在用的配方常量。这三处必须逐项相同:本文件 / run.sh 的默认值 / cd_arope.py 的 argparse 默认值 —— 上游 WorldMind 的 run.sh 与 argparse 有六处不一致,每一处都对应一次已知的崩溃(PORT_SPEC risk 11)。改配方就同时改这三处。", + "_not_this_file": "跑起来之后 /config.json 是那一次 run 的完整快照(含一致性轴 / 数据集统计 / 环境 / deepspeed_config),由 runlib.save_config 写;本文件只是签进仓库的配方记录。", + "_launch": "bash distill/stage2_cd/run.sh", + "stage": "stage2_cd", + "script": "distill/stage2_cd/cd_arope.py", + + "teacher_ckpt": "outputs/distill/stage1_ar_tf/dits/dit_step12000.safetensors", + "student_ckpt": "outputs/distill/stage1_ar_tf/dits/dit_step12000.safetensors", + "_ckpt": "P1 忠实路线:teacher 与 student/EMA 的 init 是同一份 stage1 产物。轨迹匹配的目标要求师生同结构同初值;两者不同就变成上游的 P2 务实路线(--teacher_causal 0),本移植不用", + "output": "outputs/distill/stage2_cd", + "product": "ema/ema_step{N}.safetensors → 部署权重 + stage3 的 --student_ckpt", + "_product": "dits/dit_step{N}.safetensors 只为续训存在。拿 dits/ 去部署或去当 stage3 的 init 不会报错,只会静默拿到一个更差的模型(PORT_SPEC risk 12)", + + "train_dir": "data/latent/train_eybx", + "val_dir": "data/latent/val_eybx", + "_val_dir": "stage2 不做验证;这个目录只用来 exclude_src_in —— 与 stage1 完全同一套划分,训练集才还是那 18528 条", + "sidecar": "data/latent/arope_sidecar.pt", + "text_table": "data/latent/text_table_actionrope.pt", + "text_mode": "scene", + "scene_dropout": 0.0, + "_scene_dropout": "0:CD 不做 CFG(real_guidance_scale=1.0),就不需要无条件样本。上游 cd_gm.py:355,362 同样强制 boss_dropout=0", + "min_rt_ratio": 0.8, + + "teacher_causal": 1, + "teacher_forcing": true, + "_teacher_forcing": "干净 GT 走 clean_x 通道穿进三次前向(CF naive_consistency.py:110-136)。只有当 stage1 也是 --teacher_forcing 训出来的才能开 —— cd_arope.py 会读 stage1 检查点的 metadata 核对,对不上直接 SystemExit", + "windowed_train": 0, + "windowed_sink": 0, + "_windowed": "全因果。F=21 下 sink=0 的 W=20 会把 cell 0(ActionRoPE 的干净锚点)挤出 cell 20 的视野;上游那条 20/1 的『铁律』在 F=21 上本来就与全因果等价", + + "cd_axis": "deploy", + "denoise_list": "1000,750,500,250", + "axis_sigmas": [1.0, 0.75, 0.5006, 0.251597], + "axis_timesteps": [1000.0, 750.0, 500.6, 251.597], + "axis_pairs": 3, + "_cd_axis": "用户拍板:部署是 4 步 denoise_list 1000,750,500,250,所以一致性轴的节点就是这四个 t 落到 1000 点训练网格上的 σ。训练约束过的档 = 推理读 x0 的档,一个不差。cd_arope.py 会断言这一点", + "_cd_axis_alt": "--cd_axis discrete --discrete_cd_N 48 是 WorldMind 的密轴(Δσ≈−0.004,教师 Euler 步更准),只作对照:500/250 两个部署读点不是那条轴的节点,切过去会打印警告", + "discrete_cd_N": 48, + "cd_tail_t": 0.0, + "_cd_tail_t": "0 = 轴与部署表逐点相同。>0 会在轴最低点之下再挂一个节点,让 σ=0.2516(部署最后一步读 x0 的那一档)也成为一致性对的『源』;默认关是为了不改用户拍板的轴", + "teacher_solver_steps": 1, + "_teacher_solver_steps": "教师从 σ_t 走到 σ_tn 用几个 Euler 子步。1 = 上游原样。部署轴的 Δσ≈−0.25,单步 Euler 的局部截断误差是 O(Δσ²),>1 会让一致性目标更准,代价是每个 micro batch 多几次教师前向(≈+50% 墙钟 @ 4 步)", + "real_guidance_scale": 1.0, + "_real_guidance_scale": "1.0 ⇒ 跳过无条件前向,也便宜一半。>1 时负条件是 text_table[NULL_PROMPT](ActionRoPE 有 scene_dropout,所以 cfg>1 是分布内的合法旋钮,与 WorldMind 不同)", + + "loss": "MSE(cm_t[:,:,1:], cm_tn[:,:,1:].detach()),其中 cm_t = lat_t − σ_t·student(lat_t, t)、cm_tn = lat_tn − σ_tn·ema(lat_tn, t_next),lat_tn 是冻结教师从 lat_t 走一个 Euler 步的结果", + "_loss": "纯 MSE,**故意不用** ActionRoPE 的 new 区 ×2 权重图:CD 匹配的是教师自己的轨迹,重新加权会让学生的不动点偏离被蒸馏的那条流(PORT_SPEC 里标为 open question)", + "frame0": "cell 0 在 lat_t / lat_tn 里都钉成干净 GT,first_frame_cond=True 让它的 t=0,且不计 loss —— 与 stage1、stage3 一路对齐", + + "ema_decay": 0.99, + "ema_start": 200, + "_ema": "fp32 影子(distill/ema.py),半衰期≈69 步:这是**目标网络**不是装饰性平均。step<=200 硬拷贝 ema←student,之后按 decay。bf16 影子会把 1% 的增量整个舍掉、目标网络静默失效", + + "optimizer": "AdamW", + "lr": 2e-06, + "weight_decay": 0.0, + "adam_betas": [0.0, 0.999], + "_adam_betas": "CF 约定 beta1=0(一致性目标随 EMA 漂移,动量会追着旧目标跑)。别『顺手修』成 0.9", + "warmup": 100, + "lr_schedule": "线性 warmup 100 步后恒定 —— 每个 save_every 边界都是合法的停止点", + "grad_clip": 10.0, + "_grad_clip": "CF max_grad_norm_generator=10.0(cd_gm.py:444)。用户拍板:stage2/3 用 WorldMind 的值", + "opt8bit": 0, + "_opt8bit": "bitsandbytes 本机没装;4×143 GB 也不需要 8bit 优化器", + + "batch_size": 1, + "grad_accum": 2, + "world_size": 4, + "eff_batch": 8, + "_eff_batch": "等效 batch 8 = 4 卡×GA2 或 8 卡×GA1(run.sh 按 DISTILL_NGPU 选;上面的 grad_accum/world_size 记的是 4 卡形式,run.sh 会断言 卡数×GA == 8)。--grad_accum 必须等于 accelerate yaml 的 gradient_accumulation_steps,否则 cd_arope.py 直接 SystemExit;而且**续训中途不许改**(一致性 idx 每个 micro batch 抽一次,改了这条同步流就在各 rank 之间错开)", + "max_steps": 8000, + "gradient_checkpointing": true, + "num_workers": 2, + "seed": 0, + + "save_every": 500, + "keep_last_emas": 25, + "_keep_last_emas": "stage3 的 init 是从这些 EMA 里挑出来的,别按 dits/ 的口径只留 2 个(上游 --keep_last_states 默认 2 且只剪 ema/,cd_gm.py:472-477 会把你要挑的中间权重全删掉)", + "keep_last_dits": 2, + "log_every": 20, + "resume": "auto", + "_resume": "只热启动权重(学生←dits/、影子←ema/、step←progress.json),优化器状态不保存 —— 续训不等于没断过。一致性 idx 的随机流按 progress.json 里的 micro batch 计数快进", + + "models": "三份 AropeDiT:student(可训、ZeRO-2 引擎、开梯度检查点)/ teacher(bf16 冻结)/ ema(fp32 影子)。只有 student 进 accelerator.prepare —— DeepSpeed 下 accelerate 只留最后一个 nn.Module(accelerator.py:2229-2236),多传会静默丢;代价是 teacher/ema 必须手工 .to(device) 且各自 move_rope_table(device),第一步之前由 _assert_ready 逐条断言", + + "accelerate_config": "distill/configs/accelerate_zero2_4gpu_ga2.yaml", + "distributed": "DeepSpeed ZeRO-2, bf16, 4 进程(只有一个可训模型,所以不用 FSDP;ZeRO-2 不分片参数,zip EMA 天然精确)", + "gpus": "0,1,2,3", + "main_process_port": 29532, + + "_budget": "≈18 s/优化器步(2 × 约 9 s 的 micro batch:3 次 TF 前向 + 1 次 TF 反向)⇒ 8000 步 ≈ 40 h;显存 ~75-85 GB/卡(student 引擎 ~33 + teacher bf16 10 + ema fp32 20 + 激活);磁盘 2×10 GB dits + 25×10 GB emas ≈ 270 GB", + "_expect": "step 0 的 loss **不是** ≈0:部署轴每步 Δσ≈−0.25,单步 Euler 与真轨迹差得远,所以三模型同权重时 cm_t 与 cm_tn 本来就不同(上游 N=48 密轴的 Δσ≈−0.004 才会给出 ≈0 的起点)。要看的是 cd 平稳、cm_err/tgt_err 不发散、gnorm 有限非零", + "_gate": "开跑前先过 distill/tests/(test_tf_port.py 的泄漏门 + test_kv_equiv.py),再跑一次 --dry_run", + "_next": "从 ema/ 里挑一个 ema_step{N}.safetensors 做 stage3 的 --student_ckpt;stage3 的 teacher 是**双向** SFT(outputs/arope_10k_ga2/step-10000.safetensors),不是 stage1 的产物" +} diff --git a/backup_2026-09-14/code/distill/stage2_cd/run.sh b/backup_2026-09-14/code/distill/stage2_cd/run.sh new file mode 100644 index 0000000000000000000000000000000000000000..a8e44cbb7bbb21882fcd9f2fa7e5e0c42cd18b79 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage2_cd/run.sh @@ -0,0 +1,158 @@ +#!/usr/bin/env bash +# ───────────────────────────────────────────────────────────────────────────── +# stage2:因果一致性蒸馏(CD)—— 把 stage1 的多步因果 AR 模型压成 4 步学生。 +# +# 4 卡 DeepSpeed ZeRO-2,batch 1 × GA 2 × 4 卡 = 等效 batch 8,lr 2e-6,8000 步 ≈ 40 h。 +# DISTILL_NGPU=8 时 GA 自动降为 1(8 × 1 × 1 = 8,同一配方跑快一倍);run.sh 会断言等效 batch == 8。 +# ★ 产物是 /ema/ema_step{N}.safetensors —— 部署权重、也是 stage3 的 --student_ckpt。 +# /dits/dit_step{N}.safetensors 只为续训存在,拿它去部署不会报错、只会静默变差。 +# +# bash distill/stage2_cd/run.sh # 按下面的配方跑 +# # PORT_SPEC 的 S7 20 步实机冒烟。OUT 必须写绝对路径:$ROOT 是 common.sh 在本脚本**内部** +# # 才导出的,调用方 shell 里它是空的。 +# MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 PORT=29542 \ +# OUT=/data/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage2 \ +# bash distill/stage2_cd/run.sh +# AR=/path/to/dit_step8000.safetensors bash distill/stage2_cd/run.sh # 换一个 stage1 检查点 +# +# 这里的每一个常量都与 cd_arope.py 的 argparse 默认值、config.json 逐项相同 —— 上游 A 的 +# run.sh 与 argparse 有六处不一致、每一处都对应一次已知的崩溃(PORT_SPEC risk 11), +# 所以这个移植里只允许存在一份配方。改配方 = 同时改这三处。 +# 只有一处**故意**与 argparse 默认值不同("裸跑不应该有的副作用"): +# --resume auto(argparse 默认 None:不想让随手一跑就悄悄接着上次的 step 跑) +# +# CUDA_VISIBLE_DEVICES / GPU 占用守卫都在 common.sh 里,这里不重复也不许绕过。 +# ───────────────────────────────────────────────────────────────────────────── +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +# shellcheck source=../common.sh +source "$HERE/../common.sh" # set -euo pipefail / ROOT / PY / ACC / 环境 / 只用 GPU 0-3 / 空闲守卫 + +# ---- 输入输出(都可以用环境变量覆盖)---- +# P1 忠实路线:teacher 与 student 的 init 是**同一份** stage1 产物(师生同结构同轨迹, +# 这是轨迹匹配目标的前提,也是 step 0 时 loss 最小的原因)。 +STAGE1_OUT="${STAGE1_OUT:-$ROOT/outputs/distill/stage1_ar_tf}" +AR="${AR:-$STAGE1_OUT/dits/dit_step12000.safetensors}" +TRAIN_DIR="${TRAIN_DIR:-$ROOT/data/latent/train_eybx}" +VAL_DIR="${VAL_DIR:-$ROOT/data/latent/val_eybx}" # stage2 不验证;只用来 exclude_src_in,与 stage1 同一套划分 +SIDECAR="${SIDECAR:-$ROOT/data/latent/arope_sidecar.pt}" +TEXT_TABLE="${TEXT_TABLE:-$ROOT/data/latent/text_table_actionrope.pt}" +OUT="${OUT:-$ROOT/outputs/distill/stage2_cd}" + +# ---- 并行与端口 ---- +PORT="${PORT:-29532}" # 固定分配:stage1 29531 / stage2 29532 / stage3 29536 / 冒烟 29541+ +# 等效 batch **恒为 8**(= 上游 8 卡 GA1);卡数变的是墙钟,不是配方。 +# 4 卡 → GA 2 (4 × 1 × 2 = 8) +# 8 卡 → GA 1 (8 × 1 × 1 = 8) +# accelerate 的 --num_processes 会覆盖 yaml 里的 num_processes,GA 却不会跟着变 —— +# 所以不能只改 DISTILL_NGPU 不改 GA/yaml,这里按 DISTILL_NGPU 一起选(前置检查里还有等效 batch 断言)。 +if [ "$DISTILL_NGPU" = "8" ]; then + GRAD_ACCUM="${GRAD_ACCUM:-1}" + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_8gpu_ga${GRAD_ACCUM}.yaml}" +else + GRAD_ACCUM="${GRAD_ACCUM:-2}" + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_4gpu_ga${GRAD_ACCUM}.yaml}" +fi + +# ---- 一致性轴 = 部署采样表(用户拍板)---- +# 4 步 1000/750/500/250 落到 1000 点训练网格上是 sigma [1.0, 0.75, 0.5006, 0.2516], +# 3 对一致性。训练约束过的档 = 推理读 x0 的档,一个不差。切成 CD_AXIS=discrete 只作对照, +# 那条 48 点密轴上 500/250 两个部署读点不是节点(cd_arope.py 会打印警告)。 +CD_AXIS="${CD_AXIS:-deploy}" +DENOISE_LIST="${DENOISE_LIST:-1000,750,500,250}" +DISCRETE_N="${DISCRETE_N:-48}" # 只有 CD_AXIS=discrete 时才用得上 +CD_TAIL_T="${CD_TAIL_T:-0}" # 0 = 轴与部署表逐点相同;>0 见 cd_arope.build_cd_axis +SOLVER_STEPS="${SOLVER_STEPS:-1}" # 教师一个 Euler 步(上游原样)。部署轴的 Δσ≈−0.25,>1 更准但更慢 + +# ---- 配方(= cd_arope.py 的 argparse 默认值)---- +TEACHER_CAUSAL="${TEACHER_CAUSAL:-1}" # 1 = P1 忠实(因果教师 = stage1 产物) +CFG_SCALE="${CFG_SCALE:-1.0}" # 教师 CFG。1.0 ⇒ 跳过无条件前向,也便宜一半 +EMA_DECAY="${EMA_DECAY:-0.99}" +EMA_START="${EMA_START:-200}" +LR="${LR:-2e-6}" +WEIGHT_DECAY="${WEIGHT_DECAY:-0.0}" +ADAM_BETAS="${ADAM_BETAS:-0.0,0.999}" # CF 约定 beta1=0:目标随 EMA 漂移,动量会追着旧目标跑 +WARMUP="${WARMUP:-100}" +GRAD_CLIP="${GRAD_CLIP:-10.0}" # CF max_grad_norm_generator=10.0(用户拍板:stage2/3 用 WorldMind 的值) +MAX_STEPS="${MAX_STEPS:-8000}" +SCENE_DROPOUT="${SCENE_DROPOUT:-0.0}" # CD 不做 CFG,就不需要无条件样本 +MIN_RT="${MIN_RT:-0.8}" +WINDOW="${WINDOW:-0}" # 全因果;F=21 下 sink=0 的窗口会把 cell 0(干净锚点)挤出视野 +WINDOW_SINK="${WINDOW_SINK:-0}" +SAVE_EVERY="${SAVE_EVERY:-500}" +KEEP_EMAS="${KEEP_EMAS:-25}" # stage3 的 init 是从这些里挑的,别按 dits/ 的口径只留 2 个 +KEEP_DITS="${KEEP_DITS:-2}" # dits/ 只为续训存在 +LOG_EVERY="${LOG_EVERY:-20}" +NUM_WORKERS="${NUM_WORKERS:-2}" +SEED="${SEED:-0}" +RESUME="${RESUME:-auto}" # auto:有 /progress.json 就续(只热启动权重);none 关掉 +FORCE_RUN_DIR="${FORCE_RUN_DIR:-0}" # 1:/train.log 刚被写过也照跑(只在确认上一次真的死了时用) + +# ---- 前置检查(缺什么当场说清楚,不要跑到第 3 步才炸)---- +if [ ! -f "$AR" ]; then + echo "ABORT: 没有 stage1 检查点: $AR" + if [ -d "$STAGE1_OUT/dits" ]; then + echo " $STAGE1_OUT/dits 里现有:" + ls -1 "$STAGE1_OUT/dits" 2>/dev/null | tail -8 | sed 's/^/ /' + echo " stage1 还没跑到 12000 步就先别开 stage2。" + else + echo " $STAGE1_OUT/dits 也不存在(STAGE1_OUT 可覆盖)。" + fi + echo " 要用别的检查点请显式 AR=<绝对路径> 传进来(teacher 与 student init 共用这一个变量;stage3 的 TEACHER/STUDENT 在这里不认)。" + exit 1 +fi +[ -d "$TRAIN_DIR" ] || { echo "ABORT: 没有训练集目录: $TRAIN_DIR"; exit 1; } +[ -d "$VAL_DIR" ] || { echo "ABORT: 没有验证集目录: $VAL_DIR(stage2 不验证,但要用它做 exclude_src_in)"; exit 1; } +[ -f "$SIDECAR" ] || { echo "ABORT: 没有 sidecar: $SIDECAR"; exit 1; } +[ -f "$TEXT_TABLE" ] || { echo "ABORT: 没有文本表: $TEXT_TABLE"; exit 1; } +[ -f "$ACC_CFG" ] || { echo "ABORT: 没有 accelerate 配置: $ACC_CFG(distill/configs 现有 accelerate_zero2_4gpu_ga2 / 4gpu_ga4 / 8gpu_ga1 / 8gpu_ga2 四份;GRAD_ACCUM=$GRAD_ACCUM DISTILL_NGPU=$DISTILL_NGPU)"; exit 1; } +# 等效 batch 断言:eff = 卡数 × batch 1 × GA,配方钉死 8。裸 DISTILL_NGPU=8 + GRAD_ACCUM=2 会静默变成 16 +# (2× 样本/步、墙钟不降、EMA 每样本更新减半),而且 cd_arope.py 禁止续训中途改 GA —— step 0 就锁死。 +if [ $((DISTILL_NPROC * GRAD_ACCUM)) -ne 8 ] && [ "${EFF_BATCH_OVERRIDE:-0}" != "1" ]; then + echo "ABORT: 等效 batch = $DISTILL_NPROC 卡 × batch 1 × GA $GRAD_ACCUM = $((DISTILL_NPROC * GRAD_ACCUM)),配方是 8(4 卡 GA2 或 8 卡 GA1)。" + echo " 真要换等效 batch:EFF_BATCH_OVERRIDE=1,并自行保证 ACC_CFG 的 gradient_accumulation_steps == GRAD_ACCUM。" + exit 1 +fi +mkdir -p "$OUT" + +ARGS=( + --teacher_ckpt "$AR" --student_ckpt "$AR" + --teacher_causal "$TEACHER_CAUSAL" --teacher_forcing + --windowed_train "$WINDOW" --windowed_sink "$WINDOW_SINK" + --cd_axis "$CD_AXIS" --denoise_list "$DENOISE_LIST" + --discrete_cd_N "$DISCRETE_N" --cd_tail_t "$CD_TAIL_T" + --teacher_solver_steps "$SOLVER_STEPS" --real_guidance_scale "$CFG_SCALE" + --ema_decay "$EMA_DECAY" --ema_start "$EMA_START" + --train_dir "$TRAIN_DIR" --val_dir "$VAL_DIR" + --sidecar "$SIDECAR" --text_table "$TEXT_TABLE" + --scene_dropout "$SCENE_DROPOUT" --min_rt_ratio "$MIN_RT" + --lr "$LR" --weight_decay "$WEIGHT_DECAY" --adam_betas "$ADAM_BETAS" + --warmup "$WARMUP" --grad_clip "$GRAD_CLIP" --opt8bit 0 + --batch_size 1 --grad_accum "$GRAD_ACCUM" --max_steps "$MAX_STEPS" + --gradient_checkpointing + --save_every "$SAVE_EVERY" --keep_last_emas "$KEEP_EMAS" --keep_last_dits "$KEEP_DITS" + --log_every "$LOG_EVERY" --num_workers "$NUM_WORKERS" --seed "$SEED" + --output "$OUT" +) +# 写成 if 而不是 `[ cond ] && ARGS+=(...)`:set -e 下 && 链的写法太容易踩坑,这里不给它机会 +if [ -n "$RESUME" ] && [ "$RESUME" != "none" ]; then + ARGS+=(--resume "$RESUME") + INIT_NOTE="有 $OUT/progress.json 就从那里续训(RESUME=$RESUME),否则从 init 起" +else + INIT_NOTE="RESUME=none,从 init 起" +fi +if [ "$FORCE_RUN_DIR" = "1" ]; then + ARGS+=(--force_run_dir) +fi + +echo "[stage2] teacher = $AR" +echo "[stage2] student init = 同一份 stage1 产物(P1);$INIT_NOTE" +echo "[stage2] out=$OUT port=$PORT cfg=$(basename "$ACC_CFG") 等效 batch=$((DISTILL_NPROC * GRAD_ACCUM))" +echo "[stage2] axis=$CD_AXIS denoise_list=$DENOISE_LIST solver=$SOLVER_STEPS cfg_scale=$CFG_SCALE" +echo "[stage2] lr=$LR betas=$ADAM_BETAS warmup=$WARMUP clip=$GRAD_CLIP max_steps=$MAX_STEPS ema=$EMA_DECAY@$EMA_START" +echo "[stage2] 产物 = $OUT/ema/ema_step{N}.safetensors(部署 + stage3 的 --student_ckpt);dits/ 只为续训" + +# train.log 由 cd_arope.py 自己带时间戳写;这里另存一份 launch.log,收 NCCL / DeepSpeed / traceback 的原始输出 +"$ACC" launch \ + --config_file "$ACC_CFG" \ + --num_processes "$DISTILL_NPROC" --main_process_port "$PORT" \ + "$HERE/cd_arope.py" "${ARGS[@]}" "$@" 2>&1 | tee -a "$OUT/launch.log" diff --git a/backup_2026-09-14/code/distill/stage2_flowmap/config.json b/backup_2026-09-14/code/distill/stage2_flowmap/config.json new file mode 100644 index 0000000000000000000000000000000000000000..807e4e115bcccec6d61cc3cd41b1980e28b1ae90 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage2_flowmap/config.json @@ -0,0 +1,127 @@ +{ + "_note": "stage2(flow-map 任意步蒸馏)真正在用的配方常量。这三处必须逐项相同:本文件 / run.sh 的默认值 / fm_arope.py 的 argparse 默认值 —— 上游 WorldMind 的 run.sh 与 argparse 有六处不一致,每一处都对应一次已知的崩溃(PORT_SPEC risk 11)。改配方就同时改这三处。", + "_not_this_file": "跑起来之后 /config.json 是那一次 run 的完整快照(含划槽统计 / 数据集统计 / 环境 / deepspeed_config),由 runlib.save_config 写;本文件只是签进仓库的配方记录。", + "_launch": "bash distill/stage2_flowmap/run.sh", + "stage": "stage2_flowmap", + "script": "distill/stage2_flowmap/fm_arope.py", + "_supersedes": "distill/stage2_cd/(一致性蒸馏)保持原样、依旧可跑,作为对照臂。CD 把学生绑死在一张部署采样表上;flow map 一个学生在任意步数预算下都能用,而且原生做 CFG 蒸馏 —— 这才是 stage1b 四条 null 分支的接口。", + "init_ckpt": "outputs/distill/stage1b_adapt/dits/dit_step3000.safetensors", + "_init_ckpt": "必须是 stage1b 的产物(827 键 bf16,实测 9,999,691,064 B)。fuse 每一步都读 text null,而 anchor/action/hist/ctx 四条 null 只有 stage1b 训过 —— stage1 的 dit_step10000 里根本没有。fm_arope.py 会读 ckpt metadata 核对:打开了某条 --fuse_g_* 而 ckpt 的对应 *_dropout 是 0/缺失就直接 SystemExit。", + "output": "outputs/distill/stage2_flowmap", + "product": "ema/ema_step{N}.safetensors → 部署权重", + "_product": "dits/dit_step{N}.safetensors 只为续训存在。★ 832 键(827 + delta_embedding.{0,2}.{weight,bias} + delta_gate),约 10.02 GB。actionrope/infer.py、tests/check_ckpt.py、eval_bg50.py 会按 827 键拒收 —— 这是**对的**:residual 形式下 u(x,t,t)=head(E(t)+g·D(P(t))) 折不回一条 Sequential,不存在精确的 827 键导出;拿旧的 renoise 采样器、不给 r 去采一个 flow map,会安静地产出另一个模型。", + "_sampler": "确定性 Euler:x_r = x_t − (σ_t − σ_r)·u(x_t, t, r),没有『估 x0 再重新加噪』那一步,最后一格 σ_r=0 直接落在干净估计上。与 DiffSynth 的 prev_sample = sample + v·(σ_next − σ) 同号。下游选采样器要按 ckpt 的**张量键**(runlib.is_flowmap_ckpt),不要按命令行开关。", + "train_dir": "data/latent/train_eybx", + "val_dir": "data/latent/val_eybx", + "_val_dir": "既做 exclude_src_in(与 stage1/stage1b/stage2-CD 完全同一套划分,训练集才还是那 18528 条),也是任意步验证(4 步 / 24 步)读的留出集。", + "sidecar": "data/latent/arope_sidecar.pt", + "text_table": "data/latent/text_table_actionrope.pt", + "text_mode": "scene", + "scene_dropout": 0.0, + "_scene_dropout": "数据集侧关掉,文本 dropout 改由 trainer 做(drop_text_ratio 0.10)。理由不是省事:只有 trainer 知道『这个 micro batch 的 text 轴已经被 drop 了』,那一步 g_text 必须记 0。上游在 pixel_loss(:307-309) 先 drop 再进 train_causal,于是那 10 % 的样本上 cond==uncond、fuse 是恒等,却仍然按 guidance=3 去除 dF_dt(:279)—— 修正项小了 3 倍。这是上游的 bug,本移植改掉了。", + "min_rt_ratio": 0.8, + "val_min_rt_ratio": 0.9, + "flowmap_form": "residual", + "delta_gate": 1.0, + "deltatime_type": "r", + "_flowmap_form": "delta_embedding = deepcopy(time_embedding),**第二个 Linear** 零初始化 ⇒ D(·)≡0,对**任意** (t,r) 都与 stage1b 逐位相同(CPU 实测 max|Δ| = 0.000e+00 于 r ∈ {t, 250, 0, 1000})。这是硬要求:按构造有 50 % 的样本落在 r ≠ t 的 off-diagonal 上,而 init 是 24 GPU-hours 换来的教师。上游的 convex 形式 (1−g)E(t)+g·D(r) 只在 r==t 上是恒等,off-diagonal 实测 1.11e-01 —— 保真度消融用 --flowmap_form convex --delta_gate 0.25。⚠ 千万别在 convex 里『顺手零初始化』:那给出 t = 0.75·E(t),把教师的时间嵌入缩水 25 %。", + "_delta_gate": "persistent=True 的 buffer,跟着权重存盘。上游是 persistent=False(从 config 重建),于是训练与推理可以悄悄用不同的门而不报错。1.0 与 0.25 在 bf16 下都精确(install_flowmap 会断言)。residual 形式下第 0 步冗余(乘的是一个本来就是 0 的读出),之后等价于给 delta_embedding[2] 换一个有效 lr。", + "_deltatime_type": "硬接 'r',没有 't−r' 分支。上游实现了 't-r' 但零个配置在用它:r==t 时它喂 E(0),模型与教师**处处**都不一致。", + "flowmap_epsilon": 5.0, + "eps_clamp": 1, + "_epsilon": "**0..1000 时间步量纲**。latent 扰动用 v·ε/1000、时间扰动用 ε、(t−r) 因子是 1000 量纲、分母是 (t⁺−t⁻)·den —— 四处精确相消(对解析 u = A·x + b·t/1000 + c·r/1000 验到 8e-18;1000 量纲与 σ 量纲两条算法一致到 1e-12)。经典 bug 是 latent 扰动忘了除 1000:dF_dt 直接差约 1000 倍,loss 照降、flow map 是错的。", + "_eps_clamp": "1 = 把探针夹在 [t_min, 1000] 内并按**实际**步长 (t⁺−t⁻) 除(t_min 默认 0.0 —— σ=0 是 cell 0 与 TF clean 半流本来就在用的档,在分布内;**不是**网格最低点 4.98)。t=1000(σ=1,每条采样轨迹的起点)时 t⁺ 会到 1005、σ>1 是分布外。只在离边界 5 以内才触发;远离边界时分母就是 2·ε·den、与上游逐位相同。0 = 复现上游,供 bit-diff 测试用。", + "_skip_when_t_eq_r": "t == r(精确相等,由 r := t 的赋值保证)时整段中心差分跳过、dF_dt := 0。不只是省两次前向:Δ=0 乘一个 NaN/Inf 探针是 NaN 不是 0,这是真正的数值断路器。", + "diffusion_ratio": 0.5, + "consistency_ratio": 0.25, + "split_rotate": 1, + "_split": "上游的比例。G = world 4 × batch 1 = 4 ⇒ 每个 micro batch 恰好 diffusion 2(r:=t)/ consistency 1(r:=0)/ 自由 1,GA-2 的一个优化器步是 4/2/2。", + "_split_rotate": "1 = 每个 micro batch 用**各 rank 同种子**的 randperm 轮换槽位,全局比例与上游每步都相同、只是角色在轮换。上游是 `global_start_idx = rank*bsz + i` 的 rank 静态分配:在我们 G=4 的规模下,rank 0/1 会在全部 8000 步里永远跑 r:=t、rank 2 永远 r:=0、rank 3 永远自由对,而自适应配平的分母就永远是同两个 rank 的 2 样本均值。0 = 原样复现上游(bit-diff 测试用)。续训按 progress.json 的 micro batch 计数快进这条流,并且**中途不许改 --grad_accum**(改了这条同步流就在各 rank 之间错开)。", + "per_cell_tr": 0, + "_per_cell_tr": "0 = 每个样本一个标量 t 广播到全部 21 个 cell,配 first_frame_cond=1(cell 0 干净 + t = r = 0,且不计 loss)。这与部署一致:deploy_rollout 是拿一个 cell 对着已提交的干净历史去噪。1(stage1 式逐 cell 独立抽档)**目前直接 SystemExit**:flowmap.py 的 (t,r)/target/loss 都是逐样本 [b] 的(sample_tr → TRSample、_bvec 断言 [b]),要做这个消融得先把那一侧扩成 [b,f];在 trainer 里现搭一条没验过的分叉路径比不做更糟。", + "weight_type": "beta08", + "weight_floor": 0.0, + "_weight": "上游 scheduling_flowmap_euler_discrete.py:51-53 的 beta08:y = σ^1·(1−σ)^0.5,归一到 sum = 1000(峰 1.408 @ σ=0.667)。用 flow_pf 的只读访问器算,**绝不**去 mutate 模块级 scheduler。stage1 的 bsmntw 钟形(峰 2.076 @ σ=0.5005)留作 --weight_type bsmntw 的消融。", + "_weight_floor": "两种权重在 σ=1.0(每条采样轨迹的起点)都恰好是 0:beta08 在 σ=0.9998 也只有约 0.05,bsmntw 是 y−y.min() 构造出来的 0。上游连续抽 t 时这是零测集,我们的 1000 点离散网格有 1/1000 的概率正好抽到。继承的性质、不是新引入的(stage1 就在同一条件下训过)。0.0 = 上游原样;配合逐 σ 十分位的 loss 日志看高噪桶有没有掉队。", + "adaptive_balance": 1, + "_adaptive_balance": "trainer:386-390。非 diffusion 样本的 loss 按「全局 diffusion 均值 / 自己」缩放(缩放系数无梯度)。(t−r)·dF/dt 这一项的尺度与尾部都比纯 flow matching 重,不配平就由它主导梯度。用 torch.where 代替上游的原地掩码赋值:数值相同、计算图更干净。gather 是集合操作,每个 rank、每个 micro batch 都要进;全局 diffusion 掩码为空时直接 raise(round(0.5×4)=2 不可能为空,但仍然断言)。", + "fuse_guidance_scale": 3.0, + "fuse_g_anchor": 0.0, + "fuse_g_action": 0.0, + "fuse_g_hist": 0.0, + "fuse_g_ctx": 0.0, + "fuse_clip": 0.0, + "_fuse": "pred = (F_full + Σ_j g_j·F_∅j) / (1 + Σ_j g_j),**同一个 den 也去除中心差分**。文本那条 g_text = w − 1 = 2 ⇒ pred = (F_c + 2F_u)/3,与上游 (F_c − (1−3)F_u)/3 在 fp32 与 fp64 下都是**同一个浮点值**(torch.equal 验过),所以这条多轴代码路径能通过对上游的 bit-diff 闸。另外四条轴默认 0.0。", + "_fuse_axes": "text(context ← NULL_PROMPT,ids ← 0,交叉注意力)/ ★anchor(train_drop_anchor=True,只摘 cell 0、其余历史保留,TF 掩码)/ action(offset_px ← 0,known 掩码按它重建)/ hist(local=1 sink=1,只看得到 cell 0)/ ctx(local=1 sink=0,什么都看不到)。后三条是**注意力掩码**上的干预,只在并行路径里存在 —— 流式 KV rollout 上根本取不到,所以 CD 与 DMD 在部署时永远用不了它们。guidance 蒸馏是这条流水线里唯一能把 Δv_anchor 零成本烧进学生**条件输出**的机制,而 Δv_anchor 正对着实测的短板(不是轨迹:10 s 绕环净漂 18.4 px / 191 px 环;而是外观:|x0| 从 1.111 涨到 1.404、画面洗白)。", + "_fuse_risk": "★ 这相对现有流水线是**行为改变**:rollout_eval 与 stage2-CD 从来没开过文本 CFG(--real_guidance_scale 默认 1.0)。蒸馏进去之后推理端没有旋钮能调回来。第一个实验是 CFG_SCALE=1.0 vs 3.0 的 1000 步 A/B,判据是 rollout_eval 的外观漂移与 4-vs-24 一致性;w=1 那一臂顺带是一道免费的正确性闸 —— 不做 fuse 时 diffusion 槽(r==t)第 0 步的 loss **就是** stage1 的目标,必须从 stage1b 的收敛值起步。", + "_fuse_extra_axes_risk": "四条额外轴是自指且无界的:(v_full − v_anchor∅) 是**掩码差**不是 classifier-free 的分数差,放大等于外推;而 uncond 参照物就是学生自己(自蒸馏),放大是正反馈。开的时候一条一条来、从基线 EMA 起各跑 1000 步探针(g ∈ {0.5, 1.0}),--fuse_clip 是断路器。", + "_fuse_dropped_axis": "某条轴在本 micro batch 的主前向里已经被 drop 掉 ⇒ 该轴本步 g_j 记 0,den 跟着变小,也省掉那次冗余前向。三条上下文轴互斥,任意一条被 drop 就三条一起判为不活跃。", + "drop_text_ratio": 0.1, + "anchor_dropout": 0.15, + "action_dropout": 0.05, + "hist_dropout": 0.05, + "ctx_dropout": 0.05, + "_dropout": "text 是上游的 0.10(挪进 trainer);另外四条是 stage1b 的原值,同一套互斥阶梯(ctx > hist > anchor,action 独立抽签),约 71 % 的步仍是完整条件。这不是开销:fuse **每一步**都读 text null,null 分支一旦烂掉,guidance 目标就跟着学生一起漂。而且 null 样本照样在训 flow map —— 它们让 u(x,t,r | ∅) 也成为一个合法的 flow map,那正是 fuse 有意义的前提。同时保住 stage1b 那 6 GPU-hours(给还没打开的几条轴)。", + "teacher_forcing": true, + "tf_noise_aug_max_idx": 0, + "windowed_train": 0, + "windowed_sink": 0, + "_tf": "干净 GT 走 clean_x 通道穿进**每一次**前向(主前向 + 每条 null + 两次中心差分探针)。clean 半流的 r 在 arope_dit 里**硬接** r := t(= 上游把 clean_timestep 同时当两个参数传,trainer:359):干净流恒在对角线上。tf_aug=0 ⇒ clean 半流 t = r = 0。", + "_windowed": "全因果。F=21 下 sink=0 的 W=20 会把 cell 0(ActionRoPE 的干净锚点)挤出 cell 20 的视野。", + "_frame0": "cell 0 在 x_t、两个探针输入里都钉成干净 GT(_keep_frame0),first_frame_cond=True 让它的 t 与 r 都为 0,且不计 loss —— 与 stage1 / stage2-CD / stage3 一路对齐。", + "new_weight": 1.0, + "_new_weight": "**不是**一个命令行开关:flow-map 的 loss 里根本没有 make_weight_map(stage2-CD 也没有)。再叠一层空间加权会与自适应配平相互作用,留作消融时再说。", + "bidirectional_modeling_prob": 0.0, + "_bidirectional": "上游有 0.1 的双向 flow-matching 支路,为的是别让 LoRA 毁掉冻结的双向 Wan 先验。我们花了 13k 步、约 24 GPU-hours **故意**毁掉那个先验,部署 100 % 因果,而且 r==t 那一半样本已经供了纯 flow-matching 的锚。不移植,顺带省下 10 % 的步上的 2 次前向。", + "ema_decay": 0.999, + "ema_start": 1000, + "_ema": "fp32 影子(distill/ema.py),上游的 ema_decay / ema_warmup_step。★ 产物就是它:dits/ 只为续训。step<=1000 硬拷贝 ema←student,之后按 decay。影子在 install_flowmap() **之后**才 deepcopy —— 之前拷会少 4 个参数张量,ema_update 的 zip 当场炸(distill/ema.py:53 按位置 zip,个数与逐张量形状都核对)。别把 stage2-CD 的 ema 手工混进来。", + "optimizer": "AdamW", + "lr": 1e-05, + "weight_decay": 0.0, + "adam_betas": [ + 0.9, + 0.999 + ], + "_lr": "**不是**上游的 5e-5:那个数是给 rank-256 LoRA(约 9 % 参数)调的,落到 5B 全参微调上是 stage1/stage1b 已验证的 1e-5 的 5 倍。", + "_adam_betas": "beta2 保持 0.999(上游 0.95):我们的等效 batch 是 8 而上游 32,而 t−r 大时 flow-map 的修正项尾巴很重,0.95 的窗口会把二阶矩噪声放成有效 lr 的尖峰。wd 0 是上游的,从一个好 init 出发的短蒸馏也该是 0。", + "warmup": 200, + "lr_schedule": "线性 warmup 200 步后恒定 —— 每个 save_every 边界都是合法的停止点", + "grad_clip": 1.0, + "_grad_clip": "✅ 已用 20 步 8 卡冒烟实测重钉(2026-09-07):gnorm p50=0.0730 / p90=0.1100 / max=0.1210。与 SFT 的梯度分布几乎相同(p50 0.0724 / max 0.4809),而 SFT 用 clip 1.0 跑满 5000 步一次都没触发。1.0 比实测 max 高 8.3×:兜得住离群值,正常步一步不裁。曾用的 10.0 是 max 的 83×,等于没有裁剪、也就没有离群保护。注意这与 stage1 的结论方向相反(那里 1.0 → 10.0,因为 stage1 gnorm≈2.5,1.0 会步步都裁)—— 同一条原则「阈值按实测分布定」,不同阶段不同答案。", + "lora": false, + "_lora": "**拒绝 LoRA,全参微调。** 上游的 rank-256 LoRA 存在,是因为它必须在学因果化 + flow map + guidance 蒸馏的同时保住一个冻结的双向 Wan 底模;我们已经用 stage1(10k) + stage1b(3k) 把这个模型因果化完了,没有要保护的底模。另外三条:(1) peft 会把每个参数改名成 base_model.model..base_layer 并加 lora_A/B,runlib.strip_dit_prefix 只认 dit./arm. 前缀、save_dit 按键数硬闸 —— 每次保存都得先 merge,导出的**还是**一份全量权重,LoRA 在下游一点也没省;(2) 显存不是瓶颈:自蒸馏去掉了 stage2-CD 的 10 GB 冻结教师,预算落在 143 GB 里的约 75 GB;(3) 上游的 target_module_name **故意不含 attn2**,而 ActionRoPE 的逐 cell 文本交叉注意力正是场景/动作条件所在、也正是文本 guidance 蒸馏必须落地的地方。", + "batch_size": 1, + "grad_accum": 2, + "world_size": 4, + "eff_batch": 8, + "_eff_batch": "4 卡 × batch 1 × GA 2。--grad_accum 必须等于 accelerate yaml 的 gradient_accumulation_steps,否则 fm_arope.py 直接 SystemExit;而且**续训中途不许改**(划槽每个 micro batch 抽一次,改了这条同步流就在各 rank 之间错开)。", + "max_steps": 8000, + "gradient_checkpointing": true, + "_gradient_checkpointing": "只对**主前向**生效。三到七次 no_grad 前向一律传 False —— no_grad 下做梯度检查点是纯开销。", + "num_workers": 2, + "seed": 0, + "save_every": 500, + "keep_last_emas": 25, + "keep_last_dits": 2, + "val_every": 500, + "val_n": 4, + "val_steps": "4,24", + "_val": "验证跑任意步并行采样器,N=4 与 N=24 各一遍,报各自相对 GT 的 MSE **以及 4-vs-24 的输出 MSE**。后者才是 any-step 主张的验收标准(也是上游自己的验证设置 num_inference_steps: [4, 24]);绝对重建误差在少步蒸馏里本来就不会很低。约 2 min / 次,约 3 % 开销。", + "log_every": 20, + "resume": "auto", + "_resume": "只热启动权重(学生←dits/、影子←ema/、step←progress.json),优化器状态不保存。划槽与 (t,r)/dropout 两条随机流都按 progress.json 里的 micro batch 计数快进;--grad_accum 与 --flowmap_form 中途改了直接拒。★ 这也是唯一一处**先 install_flowmap 再 strict 装 832 键**的路径;新 run 反过来(先 strict 装 827 再 install),顺序错了不会报错、只会静默丢掉教师。", + "models": "**一份** AropeDiT(自蒸馏):学生可训、DeepSpeed ZeRO-2 引擎、主前向开梯度检查点;uncond 与两次中心差分探针都调**它自己**(torch.no_grad,走 unwrap(model))。加一个 fp32 EMA 影子(distill/ema.py,不进 prepare,产物就是它)。没有 stage2-CD 的冻结教师,省 10 GB。", + "_engine_discipline": "★ no_grad 前向走 unwrap(model) 这件事**只有 ZeRO-2 才成立**(参数不分片),也正是它让 null 分支能去改被调对象上的 train_drop_anchor / train_local_attn_size。**绝不要把这一阶段『升级』成 FSDP**:那里 all-gather 挂在包装模块的 forward 上,裸调会读到分片而不报错(PORT_SPEC risk 2,本项目头号静默腐败风险)。fm_arope.py 里有显式断言,遇到 FSDP 直接拒跑。", + "_startup_gates": "(1) _assert_run_dir_safe:--output 不是别人的 run 目录(保存时会真的 os.remove 10 GB 权重);(2) _ckpt_meta_gate:init ckpt 的 teacher_forcing/windowed_* 对得上,且每条打开了 g_j 的轴,ckpt 都真的训过对应 dropout;(3) **_assert_teacher_identity**:真权重跑一次 TF 前向,装 flow map 之前 / 之后(r ∈ {t, 250, 0, 1000})必须 max|Δ| == 0.0 —— 任何初始化顺序或接线错误都死在这里;(4) _assert_ready:分布式类型 / 影子 fp32 / freqs 在卡上 / EMA 参数个数对齐;(5) 导出键数必须是 832。", + "accelerate_config": "distill/configs/accelerate_zero2_4gpu_ga2.yaml", + "distributed": "DeepSpeed ZeRO-2, bf16, 4 进程", + "gpus": "0,1,2,3", + "main_process_port": 29534, + "_ports": "stage1 29531 / stage2-CD 29532 / stage1b 29533 / stage2-flowmap 29534 / stage3 29536 / 冒烟 29541+", + "_budget": "每个 micro batch 是 1 次带梯度 TF 前向+反向 + 1 次文本 null + 2 次中心差分探针 = 4 次前向 1 次反向(stage2-CD 是 3+1)。按 stage1 实测 7.0 s/step @ GA2(即 3.5 s / micro 的前向+反向)折算,一次 no_grad TF 前向约 1.1 s ⇒ 约 6.8 s/micro ⇒ 约 14 s/优化器步 ⇒ 8000 步约 31 h。**开跑前必须用 20 步 4 卡冒烟钉住**。显存:学生 ZeRO-2 引擎约 33 GB + EMA fp32 20 GB + 激活约 20 GB + TF bool 掩码 0.27 GB(缓存,四次前向共用)≈ 75 GB / 143 GB。磁盘:832 键 bf16 约 10.02 GB/份,2 个 dit + 25 个 ema ≈ 270 GB。", + "_cost_per_axis": "每多开一条 g_j > 0 的轴就多**一次**整片 TF 前向。五条全开是 8 次前向、约 2 倍成本。", + "_expect": "step 0 的 loss 不应该是 0:consistency 槽(r=0)与自由槽上 (t−r)·dF/dt 这一项本来就不小。要看的是 fm 平稳、|dF/dt| 不发散、gnorm 有限非零、验证的 4-vs-24 agree 单调下降。CFG_SCALE=1.0 时 diffusion 槽(r==t)第 0 步的 loss 就是 stage1 的目标,必须从 stage1b 的收敛值起步 —— 对不上说明目标之外的哪里错了。", + "_gate": "开跑前:distill/tests/ 全过(含 test_flow_map.py 与对上游的 bit-diff)、AROPE_BITPARITY_REAL=1 的真权重逐位闸、一次 --dry_run、GPU-0 的 anystep_probe(真权重 max|Δ|==0.0 + 单 micro batch 的显存/吞吐),最后 20 步 4 卡冒烟。", + "_next": "从 ema/ 里挑一个 ema_step{N}.safetensors 部署 / 评测(rollout_eval 要走 flow map 的采样器)。★ 遗留项:stage3_dmd/run.sh 的默认 --student_ckpt 仍指向 outputs/distill/stage2_cd/ema/ema_step8000.safetensors;把它指到一份 832 键的 flow-map EMA 会在 strict 装载时失败,除非 stage3 也先 install_flowmap。本次任务不动 stage3。" +} diff --git a/backup_2026-09-14/code/distill/stage2_flowmap/fm_arope.py b/backup_2026-09-14/code/distill/stage2_flowmap/fm_arope.py new file mode 100644 index 0000000000000000000000000000000000000000..ac38e66789777ce5088dcaccff45a4c2c0e3fcd9 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage2_flowmap/fm_arope.py @@ -0,0 +1,1142 @@ +#!/usr/bin/env python3 +"""stage2(新):flow-map 任意步蒸馏 —— AnyFlow「pretrain」目标的移植,替换 stage2-CD。 + + # 4 卡正式训练(配方常量钉在 run.sh 里,argparse 默认值与它逐项相同) + bash distill/stage2_flowmap/run.sh + + # 30 秒 dry run(tiny 模型 + 合成数据,不碰真权重;验 install_flowmap / 划槽 / fuse / + # 中心差分 / 配平 / EMA / 832 键导出 / rotate / 任意步验证 / 续训) + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + .venv/bin/python distill/stage2_flowmap/fm_arope.py --dry_run \\ + --output /data/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage2fm + +这一阶段是什么 +------------- +stage2-CD 把学生绑死在**一张**部署采样表上(一致性轴 == denoise_list,训练/推理必须逐点相同)。 +flow map 换掉的就是这条约束:模型多收一个时间参数 r,学的是从 t 到 r 的**均速度** + + u(x_t, t, r) ≈ v − (t − r)·dF/dt , v = ε − x0 + +于是一个学生在**任何**步数预算下都能用(上游在 4 步与 24 步上同时验过),采样是确定性 Euler +`x_r = x_t − (σ_t − σ_r)·u(x_t, t, r)`,不再有「估 x0 再重新加噪」那一步。 +而且它**原生**做 CFG 蒸馏 —— 这正是 stage1b 那四条 null 分支的接口。 + +从 vendor/AnyFlow 只搬一个想法(第二时间步 r + 均速度目标),别的一概不搬: +没有 FAR chunk、没有压缩第二 patchifier、没有 flex_attention、没有两层 KV cache、 +没有 diffusers、没有 peft、没有 LoRA(我们已经用 stage1+stage1b 共 13k 步把这个 5B 因果化了, +没有需要保护的冻结底模;LoRA 的 checkpoint 还得先 merge 才导得出,下游一点也没省)。 + +分工:目标侧的数学全在 `distill/flowmap.py`(划槽 / (t,r) 抽样 / fuse / 中心差分 / target / +loss / 配平 / Euler);模型侧的 delta 分支在 `distill/arope_dit.py`(install_flowmap + r_timestep)。 +本文件只做**编排**:run 目录、装载顺序、条件 dropout 抽签、引擎纪律、EMA、日志、验证、续训。 + +一次 micro batch(= `vendor/AnyFlow/far/trainers/trainer_far_wan_anyflow_pretrain.py:260-390`, +条件换成 ActionRoPE 的;逐条有意偏离见 flowmap.py 的文件头) +-------------------------------------------------------------------------------------- + tr ← flowmap.sample_tr(...):全局 G=world×bs 个槽按 50/25/25 分(diffusion/consistency/ + random),本 rank 拿自己那几个槽;(t, r) 在 1000 点网格上抽,t >= r + x_t = flowmap.add_noise_scalar(x0, ε, idx_t) 一个标量档广播到 21 个 cell,cell 0 钉回干净 GT + F_full = 学生(x_t, t, r, 全条件) ← **唯一**走 DeepSpeed 引擎、开梯度检查点的一次 + F_∅j = 学生(x_t, t, r, 第 j 条 null) torch.no_grad,走 unwrap(model) + pred, den = flowmap.fuse_predictions(F_full, nulls, g) den = 1 + Σ_j g_j + dF_dt = flowmap.central_difference(...) t==r 时一次探针都不跑、dF_dt := 0 + target = flowmap.flowmap_target(x0, ε, t, r, dF_dt) + loss_b = flowmap.flowmap_loss(pred, target, idx_t=...) cell 0 不计,乘 beta08 权重 + loss_b = flowmap.adaptive_balance(loss_b, is_diffusion, gather_fn=accelerator.gather) + +自蒸馏,没有第二个模型 +-------------------- +上游的 uncond 前向与两次中心差分探针调的都是**同一个** transformer(no_grad)。所以这里没有 +stage2-CD 的冻结教师(省 10 GB),guidance 的参照物就是学生自己的 null 分支 —— 这正是 stage1b +必须先跑一段的原因。EMA 仍然是产物(`ema/ema_step{N}.safetensors`),`dits/` 只为续训。 + +四条必须守住的坑 +--------------- +* **初始化顺序**。新 run 是 `建模 → strict 装 stage1b(827) → install_flowmap()`; + 续训是 `建模 → install_flowmap() → strict 装 dits/(832)`。反了不会报错,只会 deepcopy 到随机 + 初始化的 time_embedding。除了顺序本身,开跑前还有一道 `_assert_teacher_identity`:真权重跑一次 + TF 前向,装之前 / 装之后(r ∈ {t, 250, 0, 1000})必须 **max|Δ| == 0.0**。 +* **引擎纪律**。只有主前向走 `model(...)`;三到七次 no_grad 前向走 `unwrap(model)`。这在 ZeRO-2 下 + 成立(参数不分片),**换成 FSDP 就会静默读到分片**(PORT_SPEC risk 2),所以下面显式拒绝 FSDP。 + 也正因为是裸模块,三条掩码 null 才改得动 `train_drop_anchor` / `train_local_attn_size`。 +* **划槽是每个 micro batch 抽一次的各 rank 同步流**。续训按 micro batch 数快进; + 中途改 `--grad_accum` 会让四个 rank 的流错开 —— 直接拒。 +* **`flow_pf` 的模块级 scheduler 是 1000 点训练网格,`set_timesteps` 是破坏性的就地覆写。** + 任何别的点数(验证用的 4 步 / 24 步轴)一律走 `flowmap.anystep_sigmas`(内部用临时实例)。 +""" +from __future__ import annotations + +import argparse +import contextlib +import math +import os +import platform +import socket +import sys +import time +import warnings +import zlib + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +# 分配器要在 import torch 之前设:launch 时 export 的环境变量到不了 accelerate 拉起的子进程(C 的 train.py:22-27) +os.environ.setdefault("PYTORCH_CUDA_ALLOC_CONF", "expandable_segments:True") + +import torch +from accelerate import Accelerator +from accelerate.utils import DistributedType, set_seed + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.dataset import DEFAULT_SIDECAR, TEXT_TABLES, AropeLatentDataset, arope_collate, load_sidecar # noqa: E402 +from actionrope.prompts import NULL_PROMPT # noqa: E402 +from distill import flowmap as fm # noqa: E402 +from distill import runlib # noqa: E402 +from distill.arope_dit import MODEL_DIR, AropeDiT, unwrap # noqa: E402 +from distill.data import make_mask_input, to_device # noqa: E402 +from distill.ema import EmaShadow # noqa: E402 +from distill.stage1_ar.ar_tf import tf_clean_stream # noqa: E402 + +CELLS = 21 # 一条 clip 的 latent cell 数(数据集硬契约) +STAGE = "stage2_flowmap" + + +# ---------------------------------------------------------------------------- +# 目标(编排;数学全在 distill/flowmap.py) +# ---------------------------------------------------------------------------- + +@contextlib.contextmanager +def _mask_axis_drop(bare, drop: dict): + """把 anchor / hist / ctx 三条**掩码**轴的 dropout 真正作用到本 micro batch 上。 + + 这三条轴与 text / action 不同:它们不是改 cond 字典里的某个张量,而是改**裸模块的属性** + (`train_drop_anchor` / `train_local_attn_size` / `train_sink_size`),注意力掩码按这几个属性 + 重建并按 key 缓存。所以只把抽签结果记在 `drop` 里是不够的 —— 那样三个 `--*_dropout` 就是 + 死参数:null 分支在 stage2 全程得不到训练(而 fuse 每一步都在读它们),并且一旦有人打开 + `--fuse_g_anchor`,那 25 % 的 micro batch 会以为"本轴已 drop"而把 g 归零、den 算小, + 可主前向其实是**完整条件** —— 目标在四分之一的样本上是错的,不报错。 + + 互斥阶梯与比例都与 stage1b 相同(ar_tf.py:186-208),并且必须罩住**每一次**前向 + (主前向 + 各条 null + 两次中心差分探针):探针量的得是同一个条件场。 + """ + if not (drop.get("ctx") or drop.get("hist") or drop.get("anchor")): + yield + return + saved = (bare.train_local_attn_size, bare.train_sink_size, bare.train_drop_anchor) + try: + if drop.get("ctx"): + bare.train_local_attn_size, bare.train_sink_size = 1, 0 # 谁都看不到 + elif drop.get("hist"): + bare.train_local_attn_size, bare.train_sink_size = 1, 1 # 只看得到 cell 0 + else: # anchor + bare.train_drop_anchor = True # 只摘掉 cell 0,其余历史照旧 + yield + finally: + bare.train_local_attn_size, bare.train_sink_size, bare.train_drop_anchor = saved + + +def fm_loss(model, batch: dict, tr, *, gains: dict, uncond=None, uncond_ids=None, + teacher_forcing: bool = True, tf_noise_aug_max_idx: int = 0, + epsilon: float = 5.0, eps_clamp: bool = True, fuse_clip: float = 0.0, + weight_type: str = "beta08", weight_floor: float = 0.0, + drop: dict | None = None, use_gradient_checkpointing: bool = False, + noise: torch.Tensor | None = None): + """一个 micro batch 的 flow-map loss。返回 (loss_b[b], stats)。 + + **不做**自适应配平 —— 那一步要 `accelerator.gather`,留在主循环里(见 main)。 + + `model` 是 DeepSpeed 引擎;主前向走它、开梯度检查点。所有 no_grad 前向走 `unwrap(model)`: + ZeRO-2 不分片参数所以裸调是安全的,而且只有裸模块上才改得动 train_drop_anchor 这些开关。 + """ + bare = unwrap(model) + x0 = batch["input_latents"] # [b, 48, 21, 30, 52] bf16 + b, _, _f, lat_h, lat_w = x0.shape # 几何从 latent 取,dry_run 的小分辨率也能过 + dev = x0.device + drop = drop or {} + off = batch["offset_px"] # [b, 21, 2] f32 + + if noise is None: + noise = torch.randn_like(x0) + # 一个标量档广播到全部 21 个 cell + cell 0 钉回干净 GT(TI2V 锚点)。逐 cell 独立抽档是 stage1 的 + # diffusion forcing,不对应我们任何一条部署路径 —— 部署是拿一个 cell 对着已提交的干净历史去噪。 + x_t = fm.add_noise_scalar(x0, noise, tr.idx_t) + t, r = tr.t.to(dev), tr.r.to(dev) # [b] fp32,0..1000 + + # ---- 条件:action null 会把 offset 清零,known 掩码要跟着重建 ---- + off_eff = torch.zeros_like(off) if drop.get("action") else off + mask_in = make_mask_input(off_eff, lat_h, lat_w) + ctx_eff, ids_eff = batch["context"], batch["context_ids"] + if drop.get("text"): + assert uncond is not None, "--drop_text_ratio > 0 需要 NULL_PROMPT 的负条件" + ctx_eff, ids_eff = uncond, uncond_ids + clean_x, aug_t = (tf_clean_stream(x0, noise, tf_noise_aug_max_idx) if teacher_forcing else (None, None)) + + # cond 在**每一次**前向之间逐字段不变:变的只有 latent 与时间步(fuse 的 null 除外, + # 那正是它要动的那一条轴)。first_frame_cond=True 把 cell 0 的 t **与 r** 一起抹成 0。 + cond = dict(context=ctx_eff, context_ids=ids_eff, offset_px=off_eff, mask_input=mask_in, + first_frame_cond=True, clean_x=clean_x, aug_t=aug_t) + ac = torch.autocast(device_type=dev.type, dtype=torch.bfloat16, enabled=(dev.type == "cuda")) + + # ★ 本 micro batch 的**每一次**前向都走这个入口,不变量钉在这一处:flow map 恒有 t >= r + # (σ_t >= σ_r,从噪声大的一端积到噪声小的一端;sample_tr 用 i_t=min / i_r=max 保证)。 + # 把两者传反(`module(z, r, r_timestep=t)`)不会报错,只会静默地训一个"往回加噪"的模型; + # 有了这个入口,四个调用点里任意一个传反都会在第一个 off-diagonal 槽上当场炸。 + def _call(module, z, tt, rr, cond_j, *, slack: float = 0.0, **kw): + tv, rv = torch.as_tensor(tt), torch.as_tensor(rr) + assert bool((tv >= rv - float(slack)).all()), ( + f"flow map 的 (t, r) 传反了:min(t−r)={float((tv - rv).min()):.3f} < −{float(slack):.3f}。" + " u(x_t, t, r) 是从 σ_t 积到 σ_r,恒有 t >= r(sample_tr 用 i_t=min / i_r=max 保证)。" + " 唯一允许 t < r 的是中心差分的 t⁻ = t − ε 那一次探针,且最多低 ε。") + with ac: + return module(z, tt, r_timestep=rr, **cond_j, **kw) + + # ---- guidance 蒸馏 ---- + # ★ 本 micro batch 已经在主前向里被 drop 掉的轴,g_j 记 0(flowmap.active_gains)。三条上下文轴 + # 互斥且共用一套掩码,任意一条被 drop 就三条一起判为不活跃。这同时修掉上游的一个 bug:它在 + # pixel_loss(:307-309) 先 drop text 再进 train_causal,那 10 % 的样本上 fuse 是恒等, + # 却仍然按 guidance=3 去除 dF_dt(:279)—— 修正项小了 3 倍。 + dropped = {ax for ax in ("text", "action") if drop.get(ax)} + if drop.get("anchor") or drop.get("hist") or drop.get("ctx"): + dropped |= {"anchor", "hist", "ctx"} + g_act = fm.active_gains(gains, dropped) + den_expect = fm.fuse_denominator(g_act) + + # ★ 三条掩码轴的 dropout 在这里真正生效,并且罩住**每一次**前向(主前向 + 各条 null + + # 两次探针):探针量的必须是同一个条件场。null_axis 自己会 save/restore,嵌进来是安全的, + # 而且互斥意味着任意一条被 drop 时这三条的 g 都已经是 0(不会有 null 前向要跑)。 + nulls = {} + with _mask_axis_drop(bare, drop): + # ---- 主前向:**唯一**一次带梯度、走引擎、开梯度检查点 ---- + f_full = _call(model, x_t, t, r, cond, + use_gradient_checkpointing=use_gradient_checkpointing) + with torch.no_grad(): + for ax in g_act: + with fm.null_axis(ax, cond, bare=bare, null_context=uncond, + null_context_ids=uncond_ids) as cond_j: + nulls[ax] = _call(bare, x_t, t, r, cond_j) + pred, den = fm.fuse_predictions(f_full, nulls, g_act, clip_k=float(fuse_clip)) + # den 必须就是 1 + Σ g_j:传给 fuse 的 g 被改了符号 / 被缩放,这里当场炸 + assert abs(den - den_expect) < 1e-9, ( + f"fuse 的 den={den} 与 1+Σg={den_expect} 不符 —— 传进 fuse_predictions 的 g 被动过了") + + # ---- 中心差分 dF/dt(探针只跑条件分支,整体除以同一个 den —— 上游的选择,照抄)---- + def _u(z, tt, rr): + # 探针允许 t⁻ = t − ε 掉到 r 以下(t − r < ε 的自由槽上必然发生),但最多低 ε + return _call(bare, z, tt, rr, cond, slack=float(epsilon)) + + d_fdt = fm.central_difference(_u, x_t, x0, noise, t, r, epsilon=float(epsilon), + den=den, eps_clamp=bool(eps_clamp)) + target = fm.flowmap_target(x0, noise, t, r, d_fdt) + loss_b, lstats = fm.flowmap_loss(pred, target, idx_t=tr.idx_t, weight_type=weight_type, + weight_floor=float(weight_floor), skip_first_cell=True) + + with torch.no_grad(): + skipped = not fm.probes_needed(t, r) + clamped = bool(((t + float(epsilon)) > fm.T_MAX).any() or ((t - float(epsilon)) < fm.T_MIN).any()) + stats = { + "t": float(t.mean()), "r": float(r.mean()), "sigma_t": float(tr.sigma_t.float().mean()), + "tw": float(lstats["tw_mean"]), "mse": float(lstats["mse"]), + "loss_uw": float(lstats["loss_uw"]), "den": float(den), "n_null": len(g_act), + "axes": ",".join(g_act) or "-", + "dfdt": (0.0 if skipped else float(d_fdt.float().pow(2).mean().sqrt())), + "tgt": float(target.float().pow(2).mean().sqrt()), + "skip_cd": bool(skipped), "clamped": clamped, + "d_text": float(bool(drop.get("text"))), "d_act": float(bool(drop.get("action"))), + "d_anc": float(bool(drop.get("anchor"))), "d_hist": float(bool(drop.get("hist"))), + "d_ctx": float(bool(drop.get("ctx"))), + } + return loss_b, stats + + +# ---------------------------------------------------------------------------- +# 参数 +# ---------------------------------------------------------------------------- + +def parse_args(argv=None): + ap = argparse.ArgumentParser(description="stage2(新):flow-map 任意步蒸馏") + # 默认值 = distill/stage2_flowmap/run.sh 的实参 = config.json(RUNBOOK 铁律:一份配方三处相同) + ap.add_argument("--init_ckpt", + default=os.path.join(ROOT, "outputs/distill/stage1b_adapt/dits/dit_step3000.safetensors"), + help="学生 + EMA 的 init。必须是 **stage1b** 的产物:fuse 每一步都要读 text null," + "而 anchor/action/hist/ctx 四条 null 只有 stage1b 训过(stage1 的 dit_step10000 没有)") + ap.add_argument("--model_dir", default=MODEL_DIR) + ap.add_argument("--output", required=True, help="run 目录;相对路径按 runlib.resolve_run_dir 解析") + + ap.add_argument("--train_dir", default=os.path.join(ROOT, "data/latent/train_eybx")) + ap.add_argument("--val_dir", default=os.path.join(ROOT, "data/latent/val_eybx"), + help="既做 exclude_src_in(与 stage1 同一套划分,训练集才还是那 18528 条)," + "也是任意步验证(4 步 / 24 步)读的留出集") + ap.add_argument("--sidecar", default=DEFAULT_SIDECAR) + ap.add_argument("--text_table", default=TEXT_TABLES["scene"], + help="ARoPE 臂固定 text_mode=scene(剥掉动作从句),361 键那张表") + ap.add_argument("--limit", type=int, default=None, help="smoke 用:只取这么多训练 clip") + ap.add_argument("--scene_dropout", type=float, default=0.0, + help="0:文本 dropout 改由 **trainer** 做(--drop_text_ratio),这样 trainer 才知道" + "本 micro batch 里 text 轴是不是已经被 drop 了(那一步 g_text 必须记 0)") + ap.add_argument("--min_rt_ratio", type=float, default=0.8) + ap.add_argument("--val_min_rt_ratio", type=float, default=0.9) + + # ---- flow map 本体 ---- + ap.add_argument("--flowmap_form", default="residual", choices=["residual", "convex"], + help="residual(本项目):t = E(t) + g·D(r),D 的读出层零初始化 ⇒ 对**任意** (t,r) 都与" + "stage1b 逐位相同。convex(上游 AnyFlow):(1−g)E(t) + g·D(r),只在 r==t 上是恒等," + "off-diagonal 实测 max|Δ|≈1.1e-01 —— 只作上游保真度消融") + ap.add_argument("--delta_gate", type=float, default=1.0, + help="dit.delta_gate(persistent buffer,跟着权重存盘)。residual 形式下第 0 步冗余" + "(乘的是一个本来就是 0 的读出),之后等价于给 delta_embedding[2] 换有效 lr。" + "上游 convex 用 0.25。1.0 / 0.25 在 bf16 下都精确") + ap.add_argument("--flowmap_epsilon", type=float, default=5.0, + help="中心差分步长,**0..1000 时间步量纲**。latent 扰动用 ε/1000、时间扰动用 ε、" + "(t−r) 是 1000 量纲,三者精确相消(flowmap.central_difference 的闭式门禁验到 8e-18)") + ap.add_argument("--eps_clamp", type=int, default=1, + help="1 = 把探针夹在 [0, 1000] 内并按**实际**步长除(t=1000 时 t⁺ 会到 1005,σ>1 是分布外)。" + "不触边时步长直接取字面量 2ε,与上游逐位一致。0 = 复现上游,供 bit-diff 测试用") + ap.add_argument("--diffusion_ratio", type=float, default=0.5, help="r := t 的槽占比(上游值)") + ap.add_argument("--consistency_ratio", type=float, default=0.25, help="r := 0 的槽占比(上游值)") + ap.add_argument("--split_rotate", type=int, default=1, + help="1 = 每个 micro batch 用各 rank **同种子**的 randperm 轮换槽位。上游是" + "`global_start_idx = rank*bsz + i` 的 rank 静态分配:G=4 时 rank 0/1 会在全部 8000 步里" + "永远跑 r:=t、rank 3 永远跑 random 对,配平的分母也永远是同两个 rank 的 2 样本均值。" + "全局比例每步都与上游相同,只是角色在轮换。0 = 原样复现上游(bit-diff 测试用)") + ap.add_argument("--per_cell_tr", type=int, default=0, + help="0(默认,且目前只有这一档)= 每个样本一个标量 t 广播到 21 个 cell —— 与部署一致。" + "1 = stage1 式逐 cell 独立抽档,不对应任何一条部署路径;flowmap.py 的 (t,r) API 是" + "逐样本 [b] 的,真要做这个消融得先把那一侧扩成 [b,f],这里不给一条没验过的分叉路径") + ap.add_argument("--weight_type", default="beta08", choices=["beta08", "bsmntw", "uniform"], + help="loss 的逐档权重。beta08 = 上游 y=σ·(1−σ)^0.5 归一到和 1000(峰 1.408 @ σ=0.667);" + "bsmntw = stage1 的钟形(峰 2.076 @ σ=0.5005),消融用") + ap.add_argument("--weight_floor", type=float, default=0.0, + help="权重下限。两种权重在 σ=1.0(每条采样轨迹的起点)都恰好是 0 —— 上游连续抽 t 时" + "是零测集,我们的 1000 点离散网格有 1/1000 概率正好抽到。0.0 = 上游原样") + ap.add_argument("--adaptive_balance", type=int, default=1, + help="1 = 非 diffusion 样本的 loss 按「全局 diffusion 均值 / 自己」缩放(trainer:386-390)。" + "(t−r)·dF/dt 这项的尺度与尾部都比纯 flow matching 重,不配平就由它主导梯度") + + # ---- guidance 蒸馏(stage1b 的四条 null 在这里接上)---- + ap.add_argument("--fuse_guidance_scale", type=float, default=3.0, + help="文本 CFG。w=3 ⇒ g_text=2,pred=(F_c+2F_u)/3 —— 与上游 (F_c−(1−3)F_u)/3 在 fp32/fp64 下" + "是**同一个**浮点值。★ 这是相对现有流水线的行为改变:rollout_eval 与 stage2-CD 从来" + "没开过文本 CFG,而蒸馏进去之后推理端没有旋钮调得回来。第一个实验是 1.0 vs 3.0 的 1000 步 A/B") + ap.add_argument("--fuse_g_anchor", type=float, default=0.0, + help="★ 锚点轴的额外强度。Δv_anchor 是「首帧锚点 vs 已漂历史」,正对着实测的外观漂移" + "(rollout 里 |x0| 1.111→1.404、画面洗白)。掩码干预只在并行路径存在,CD/DMD 部署时" + "取不到 —— guidance 蒸馏是唯一能把它零成本烧进条件输出的机制。默认 0:先落 text 基线") + ap.add_argument("--fuse_g_action", type=float, default=0.0) + ap.add_argument("--fuse_g_hist", type=float, default=0.0) + ap.add_argument("--fuse_g_ctx", type=float, default=0.0) + ap.add_argument("--fuse_clip", type=float, default=0.0, + help="0 = 关。>0 ⇒ 把 |pred − F_full| 夹在 k·std(F_full) 内。uncond 参照物是学生自己," + "放大是正反馈,这是断路器") + + # ---- 条件 dropout:stage1b 的比例继续跑,别让 null 分支烂掉 ---- + ap.add_argument("--drop_text_ratio", type=float, default=0.10, + help="上游的值,但挪进 trainer(替代数据集侧的 --scene_dropout):fuse **每一步**都读" + "text null,分支飘了 guidance 目标就跟着飘") + ap.add_argument("--anchor_dropout", type=float, default=0.15, help="stage1b 的比例,★ 主力档") + ap.add_argument("--action_dropout", type=float, default=0.05) + ap.add_argument("--hist_dropout", type=float, default=0.05) + ap.add_argument("--ctx_dropout", type=float, default=0.05, + help="三个上下文档互斥(ctx > hist > anchor),action 独立抽签,约 71 %% 的步仍是完整条件") + + # ---- 与 stage1 / stage1b / stage2-CD 一致的结构参数 ---- + ap.add_argument("--teacher_forcing", action=argparse.BooleanOptionalAction, default=True, + help="干净 GT 走 clean_x 通道穿进**每一次**前向。clean 半流恒在 r == t 的对角线上" + "(arope_dit 里硬接,= 上游把 clean_timestep 同时当两个参数传)") + ap.add_argument("--tf_noise_aug_max_idx", type=int, default=0, help="0 = clean 半流精确干净(t = r = 0)") + ap.add_argument("--windowed_train", type=int, default=0, + help="0 = 全因果。F=21 下 sink=0 的 W=20 会把 cell 0(干净锚点)挤出 cell 20 的视野") + ap.add_argument("--windowed_sink", type=int, default=0, help="[windowed_train>0 时] 恒可见的开头 cell 数") + + ap.add_argument("--ema_decay", type=float, default=0.999, help="上游 ema_decay。产物就是这个影子") + ap.add_argument("--ema_start", type=int, default=1000, help="前这么多步硬拷贝 ema←student(上游 ema_warmup_step)") + + ap.add_argument("--lr", type=float, default=1e-5, + help="**不是**上游的 5e-5:那个数是给 rank-256 LoRA(约 9 %% 参数)调的,落到 5B 全参微调上" + "是 stage1/stage1b 已验证的 1e-5 的 5 倍") + ap.add_argument("--weight_decay", type=float, default=0.0, help="上游值;从一个好 init 出发的短蒸馏,0 是对的") + ap.add_argument("--adam_betas", default="0.9,0.999", + help="beta2 保持 0.999(上游 0.95):我们的等效 batch 是 8 而上游 32,而 t−r 大时" + "flow-map 修正项尾巴很重,0.95 的窗口会把二阶矩噪声放成有效 lr 的尖峰") + ap.add_argument("--warmup", type=int, default=200, help="线性 warmup 步数,之后恒定 lr") + ap.add_argument("--grad_clip", type=float, default=1.0, + help="✅ 已用 20 步 8 卡冒烟重钉:gnorm p50=0.0730 max=0.1210,与 SFT 的分布几乎相同" + "(p50 0.0724 max 0.4809,那里 clip 1.0 跑满 5000 步没触发过)。1.0 比 max 高 8.3×," + "兜得住离群值又不裁正常步。曾用的 10.0 是 max 的 83× ⇒ 形同没有裁剪。" + "与 stage1 方向相反是对的:那里 gnorm≈2.5,1.0 会步步都裁") + ap.add_argument("--batch_size", type=int, default=1, help="每卡 micro batch;等效 batch = world × 它 × grad_accum") + ap.add_argument("--grad_accum", type=int, default=2, help="必须与 accelerate yaml 的 gradient_accumulation_steps 相同") + ap.add_argument("--max_steps", type=int, default=8000, help="优化器更新数(不是 micro batch 数)") + ap.add_argument("--gradient_checkpointing", action=argparse.BooleanOptionalAction, default=True, + help="只对**主前向**生效;no_grad 的那几次一律传 False(no_grad 下做检查点是纯开销)") + ap.add_argument("--num_workers", type=int, default=2) + ap.add_argument("--seed", type=int, default=0) + + ap.add_argument("--save_every", type=int, default=500, help="0 ⇒ 只在训练结束时导出一次") + ap.add_argument("--keep_last_emas", type=int, default=25, help="部署权重要从这些里人眼挑,别按 dits/ 的口径只留 2 个") + ap.add_argument("--keep_last_dits", type=int, default=2, help="dits/ 只为续训而存") + ap.add_argument("--val_every", type=int, default=500, help="0 ⇒ 不验证") + ap.add_argument("--val_n", type=int, default=4) + ap.add_argument("--val_steps", default="4,24", + help="任意步验证的步数预算。**4 与 24 就是 any-step 的主张本身**(也是上游自己的验证设置);" + "验收看的是 4-vs-24 的一致性,不是绝对重建误差") + ap.add_argument("--log_every", type=int, default=20) + ap.add_argument("--resume", default=None, + help="auto ⇒ 有 /progress.json 就按它续(学生←dits/、影子←ema/,只热启动权重," + "优化器状态不保存);none / 不传 ⇒ 从头") + ap.add_argument("--force_run_dir", action="store_true", + help="--output 目录里 train.log 刚被写过时仍然继续(默认拒:多半是另一个 run 还活着," + "两个 run 同写一个目录会互相 rotate 掉对方的 10 GB 权重)") + ap.add_argument("--dry_run", action="store_true", help="tiny 模型 + 合成数据,不碰真权重 / 真数据") + args = ap.parse_args(argv) + + if args.windowed_sink > 0 and args.windowed_train <= 0: + raise SystemExit("--windowed_sink 只在 --windowed_train > 0 时有意义") + if not args.teacher_forcing: + raise SystemExit("stage2-flowmap 只有 teacher forcing 路线:init 是 --teacher_forcing 训出来的 stage1b," + "关掉 TF 等于换了一个「历史从没干净过」的模型(--no-teacher_forcing 是 stage1 的回退档)") + if args.per_cell_tr: + raise SystemExit("--per_cell_tr 1 还没实现:flowmap.py 的 (t,r) / target / loss 都是逐样本 [b] 的" + "(sample_tr → TRSample、_bvec 断言 [b])。逐 cell 档要先把那一侧扩成 [b,f]," + "在这里现搭一条没验过的分叉路径比不做更糟。默认的标量档才是与部署一致的那个。") + # ★ convex + 默认门 1.0 ⇒ t = 0·E(t) + 1·D(r):时间嵌入被 r 嵌入**整个替换**,模型对 t 零依赖; + # 而 r == t 时 D(t) == E(t),所以 _assert_teacher_identity(convex 只查对角线)会给绿灯。 + # install_flowmap 里另有同一条断言(那才是唯一的收口);这里提前拦,别等到装完 10 GB 权重。 + if args.flowmap_form == "convex" and not (0.0 < args.delta_gate < 1.0): + raise SystemExit( + f"--flowmap_form convex 时 --delta_gate 必须落在开区间 (0, 1),得到 {args.delta_gate}" + f"(上游 gate_value = 0.25,所以保真度消融要写 --flowmap_form convex --delta_gate 0.25)。\n" + f" g=1 把时间嵌入整个换成 r 嵌入(模型对 t 再无依赖),g=0 把 r 分支整个乘没;" + f"两种都能骗过只查 r==t 对角线的同一性闸。") + if args.fuse_guidance_scale < 1.0: + raise SystemExit(f"--fuse_guidance_scale 至少是 1.0(1.0 = 不做文本 guidance),得到 {args.fuse_guidance_scale}") + for name in ("diffusion_ratio", "consistency_ratio"): + v = float(getattr(args, name)) + if not 0.0 <= v <= 1.0: + raise SystemExit(f"--{name} 应在 [0,1] 内,得到 {v}") + if args.diffusion_ratio + args.consistency_ratio > 1.0 + 1e-9: + raise SystemExit(f"--diffusion_ratio + --consistency_ratio 不能超过 1(得到 " + f"{args.diffusion_ratio} + {args.consistency_ratio})") + if not 0.0 < args.flowmap_epsilon < fm.NUM_TRAIN_TIMESTEPS: + raise SystemExit(f"--flowmap_epsilon 应在 (0, {fm.NUM_TRAIN_TIMESTEPS}) 的时间步量纲内," + f"得到 {args.flowmap_epsilon}") + try: + b1, b2 = (float(x) for x in args.adam_betas.split(",")) + except ValueError: + raise SystemExit(f"--adam_betas 应形如 '0.9,0.999',得到 {args.adam_betas!r}") from None + args.betas = (b1, b2) + try: + args.val_step_list = [int(x) for x in args.val_steps.split(",") if x.strip()] + except ValueError: + raise SystemExit(f"--val_steps 应形如 '4,24',得到 {args.val_steps!r}") from None + if any(n < 1 for n in args.val_step_list): + raise SystemExit(f"--val_steps 里每个步数都要 >= 1,得到 {args.val_step_list}") + # g_j = 额外强度;文本那条是 w − 1(w=3 ⇒ 2.0),其余四条直接就是额外强度 + args.gains = {"text": float(args.fuse_guidance_scale) - 1.0, "anchor": float(args.fuse_g_anchor), + "action": float(args.fuse_g_action), "hist": float(args.fuse_g_hist), + "ctx": float(args.fuse_g_ctx)} + if args.dry_run: + args.init_ckpt = None + else: + if not args.init_ckpt: + raise SystemExit("--init_ckpt 是必需的(stage1b 的 dits/dit_step{N}.safetensors)") + if not os.path.isfile(args.init_ckpt): + raise SystemExit(f"--init_ckpt 不存在:{args.init_ckpt}") + return args + + +# ---------------------------------------------------------------------------- +# dry run:tiny 模型 + 合成数据 +# ---------------------------------------------------------------------------- + +TINY = dict(dim=128, in_dim=48, ffn_dim=256, out_dim=48, text_dim=4096, freq_dim=256, eps=1e-6, + patch_size=(1, 2, 2), num_heads=4, num_layers=2, has_image_input=False) +TINY_SHAPE = (48, 5, 8, 10) # [C, cells, lat_h, lat_w] + + +class _SynDataset(torch.utils.data.Dataset): + """dry run 用:形状与 AropeLatentDataset 一致的合成样本(cell 数 / 分辨率缩小)。""" + + def __init__(self, n: int = 64): + self.n = int(n) + + def __len__(self): + return self.n + + def __getitem__(self, i: int) -> dict: + g = torch.Generator().manual_seed(i) + c, f, h, w = TINY_SHAPE + off = torch.zeros(f, 2) + off[1:] = torch.randn(f - 1, 2, generator=g).cumsum(0) * 20.0 + return { + "input_latents": torch.randn(c, f, h, w, generator=g, dtype=torch.float32).to(torch.bfloat16), + "context": torch.randn(f, 8, 4096, generator=g, dtype=torch.float32).to(torch.bfloat16), + "context_ids": torch.zeros(f, dtype=torch.int64), + "offset_px": off, + "clip_id": f"syn_{i:04d}", + "kind": "syn", + } + + +def _tiny_model() -> AropeDiT: + """固定种子 ⇒ 每次调用得到逐位相同的权重。flow map **不在这里装**(顺序在 main 里)。""" + from diffsynth.models.wan_video_dit import WanModel + torch.manual_seed(0) + dit = WanModel(**TINY).to(torch.bfloat16) + return AropeDiT(dit=dit, mask_channel=True, causal=True) + + +# ---------------------------------------------------------------------------- +# 守卫 +# ---------------------------------------------------------------------------- + +@torch.no_grad() +def _tf_probe(module: AropeDiT, t_val: float, r_val, *, cells: int = 3, lat: int = 8, + seed: int = 12345) -> torch.Tensor: + """一次**真权重、真代码路径**的 TF 前向,几何缩到 cells×lat×lat(恒等性与几何无关)。 + + 只用来做 `_assert_teacher_identity` 的两次对照:装 flow map 之前 / 之后。""" + dev = next(module.parameters()).device + dt = next(module.parameters()).dtype + g = torch.Generator().manual_seed(seed) + c = int(getattr(module.dit, "in_dim", 48)) # latent 通道数(mask 通道走单独的 embedding) + x = torch.randn(1, c, cells, lat, lat, generator=g).to(device=dev, dtype=dt) + x0 = torch.randn(1, c, cells, lat, lat, generator=g).to(device=dev, dtype=dt) + ctx = torch.randn(1, cells, 8, 4096, generator=g).to(device=dev, dtype=dt) + ids = torch.zeros(1, cells, dtype=torch.int64, device=dev) + off = torch.zeros(1, cells, 2, device=dev) + mask_in = make_mask_input(off, lat, lat) + with torch.autocast(device_type=dev.type, dtype=torch.bfloat16, enabled=(dev.type == "cuda")): + return module(x, float(t_val), ctx, context_ids=ids, offset_px=off, mask_input=mask_in, + first_frame_cond=True, r_timestep=r_val, clean_x=x0, aug_t=None).float() + + +def _assert_teacher_identity(module: AropeDiT, pre: torch.Tensor, form: str, log) -> None: + """★ 最吃重的一道闸:装上 delta 分支之后,模型对 **任意** (t, r) 都必须与 stage1b 逐位相同。 + + 这条闸不依赖「初始化顺序有没有写对」—— 顺序错了(先 install 再从 827 键装载)delta 分支的 + 第一层会与 time_embedding 不一致,residual 形式下输出仍然是恒等的,所以这里过得去; + install_flowmap() 内部另有两个 assert 专门管那件事。这里管的是**融合本身有没有接错线**: + r 走了不同的正弦量纲、门被 cast 成第三种 dtype、融合发生在 time_projection 之后 —— 每一种都会 + 在这里立刻显形。convex 形式只在 r == t 上要求恒等(它 off-diagonal 本来就不是教师)。 + """ + rows = [] + for r in (500.0, 250.0, 0.0, 1000.0): + d = float((_tf_probe(module, 500.0, r) - pre).abs().max()) + rows.append((r, d)) + must_zero = (form == "residual") or (abs(r - 500.0) < 1e-12) + if must_zero and d != 0.0: + raise SystemExit( + f"ABORT: flow map 教师同一性闸失败 —— t=500, r={r} 时 max|Δ| = {d:.3e},必须是 0.0。\n" + f" form={form}。residual 形式下 delta_embedding 的读出层是全 0,D(·)≡0,对任意 (t,r) 都该逐位相同。\n" + f" 可能原因:融合发生在 time_projection **之后**;两条分支用了不同的正弦量纲(r 传了 [0,1] 的 σ);" + f"门被 cast 成第三种 dtype 把 bf16 的和提升成 fp32;或者 install_flowmap 之后又有人动过 delta_embedding。") + log("[guard] flow map 教师同一性(t=500,真代码路径 TF 前向):" + + " ".join(f"r={r:.0f}: {d:.3e}" for r, d in rows) + + ("" if form == "residual" else " ← convex 只在 r==t 上要求 0")) + + +def _assert_ready(accelerator, model, ema, device, log) -> None: + """第一步之前把「引擎纪律」与「影子」逐条验一遍。""" + dt = accelerator.distributed_type + # ★ 这一整套 no_grad 前向走 unwrap(model) 的写法,**只有 ZeRO-2 才成立**(参数不分片)。 + # FSDP 下 all-gather 挂在包装模块的 forward 上,裸调会读到分片 —— 形状对、数值错、不报错 + # (PORT_SPEC risk 2,本项目头号静默腐败风险)。 + if dt not in (DistributedType.DEEPSPEED, DistributedType.NO, DistributedType.MULTI_GPU): + raise SystemExit(f"stage2-flowmap 只支持 DeepSpeed ZeRO-2(或单进程自测),得到 {dt}。" + f"FSDP 下 unwrap(model) 的 no_grad 前向会读到分片而**不报错**。") + if dt == DistributedType.MULTI_GPU: + log("[guard][warn] 跑在纯 DDP 上(没有 ZeRO-2):数值上没问题,但显存预算不是按这个算的") + bare = unwrap(model) + assert bare.has_flowmap, "学生身上没有 flow map(dit.delta_embedding 不存在)—— install_flowmap() 没跑到" + assert bare.causal, "flow map 学生必须是因果的(causal=True)" + assert bare.dit.freqs[0].device.type == device.type, "学生的 dit.freqs 没搬到卡上(move_rope_table)" + ebare = unwrap(ema.module) + assert ebare is not bare, "EMA 影子与学生是同一个对象 —— 影子失效且 loss 一切正常" + assert ebare.has_flowmap, "EMA 影子没有 flow map:它必须在 install_flowmap() **之后**才 deepcopy" + assert ebare.dit.freqs[0].device.type == device.type, "影子的 dit.freqs 没搬到卡上" + p = next(ebare.parameters()) + assert p.dtype is torch.float32, f"影子是 {p.dtype},必须 fp32(bf16 会把 1−decay 的增量整个舍掉)" + assert p.device.type == device.type and (device.index is None or p.device.index == device.index), \ + f"影子在 {p.device},应该在 {device}(它没进 prepare,要手工 .to(device))" + n_ema, n_stu = len(list(ema.parameters())), len(list(model.parameters())) + assert n_ema == n_stu, f"EMA 与学生的参数个数不同({n_ema} vs {n_stu})—— zip EMA 会静默错位" + log(f"[guard] 学生(ZeRO-2, bf16, 装了 flow map) + ema(fp32 影子, 未 prepare),各 {n_stu} 个参数张量," + f"freqs 都在 {device};没有冻结教师(自蒸馏)") + + +def _ckpt_meta_gate(path: str, args, log) -> dict: + """读 stage1b 检查点的 metadata(只读头,不碰 10 GB 数据),核对配方是否接得上。 + + 两件事: + 1. teacher_forcing / windowed_* 必须与本次相同(stage1b 关了 TF 而这里开着 = 训一个「历史从没干净过」 + 的学生,不报错、loss 照降)。 + 2. **每一条打开了 g_j 的 null 轴,init ckpt 必须真的训过对应的 dropout**。没训过的话 v(∅) 是没训过的 + 输入上的外推,`v_full − v_∅` 是噪声不是信号 —— 这正是 stage1b 存在的全部理由。 + """ + try: + _, meta = runlib.read_ckpt_header(path) + except Exception as e: # struct.error / json 解析失败都不该拦住训练 + log(f"[ckpt][warn] 读不出 {os.path.basename(path)} 的 metadata({type(e).__name__}: {e}),跳过配方核对") + return {} + if not meta: + return {} + want = {"teacher_forcing": str(bool(args.teacher_forcing)), + "windowed_train": str(int(args.windowed_train)), + "windowed_sink": str(int(args.windowed_sink))} + bad = {k: (meta[k], v) for k, v in want.items() if k in meta and str(meta[k]) != v} + if bad: + raise SystemExit( + "init 检查点的配方与本次参数对不上:" + + ";".join(f"{k} 检查点={a} 本次={b}" for k, (a, b) in bad.items()) + + f"\n 检查点:{path}\n 把本次的对应参数改成检查点里的值。") + missing_null = [] + for ax in ("anchor", "action", "hist", "ctx"): + if args.gains[ax] <= 0.0: + continue + got = meta.get(f"{ax}_dropout") + if got is None or float(got) <= 0.0: + missing_null.append((ax, got)) + if missing_null: + raise SystemExit( + "打开了这些 guidance 轴,但 init 检查点从没训过对应的 null 分支:" + + ";".join(f"--fuse_g_{ax}>0 而 ckpt 的 {ax}_dropout={got}" for ax, got in missing_null) + + f"\n 检查点:{path}\n 只有训练时 drop 过的条件才谈得上 guidance —— 换成 stage1b 的产物" + f"(outputs/distill/stage1b_adapt/dits/),或者把这几个 --fuse_g_* 归 0。") + log(f"[ckpt] {os.path.basename(path)} metadata: " + + " ".join(f"{k}={meta[k]}" for k in ("stage", "step", "teacher_forcing", "anchor_dropout", + "action_dropout", "hist_dropout", "ctx_dropout") if k in meta)) + return meta + + +def _assert_run_dir_safe(run_dir: str, stage: str, force: bool, log=print, dry_run: bool = False) -> None: + """开跑之前确认 `--output` 指的不是**别人的** run 目录(cd_arope.py / dmd_arope.py 有逐字相同的副本)。 + + 为什么要有它:保存点会 `runlib.rotate(...)`,那是真的 `os.remove` 10 GB 的权重文件。而 `--output` + 只要是个裸名字就落在 outputs/distill/ 下(runlib.resolve_run_dir),所以一个 `OUT=stage1b_adapt` + 的手误就会**删掉 24 GPU-hours 换来的检查点** —— 不报错、不可逆。 + + 两道闸,都 fail-closed: + 1. progress.json 里记着别的 stage ⇒ 这是别人的目录,直接拒。 + 2. train.log 在最近 10 分钟里被写过 ⇒ 很可能有另一个 run 正活在这个目录里。崩溃后立刻续训会误判, + 所以留 --force_run_dir 这个显式出口;默认不给。 + """ + prog = runlib.read_progress(run_dir) + if prog and prog.get("stage") and str(prog["stage"]) != stage: + raise SystemExit( + f"ABORT: {run_dir} 是 stage={prog['stage']!r} 的 run 目录(progress.json 记在 step " + f"{prog.get('step')}),本次是 {stage}。保存时会 rotate 掉那边的 dits/ema —— 换个 --output。") + log_path = os.path.join(run_dir, "train.log") + if os.path.isfile(log_path): + age = time.time() - os.path.getmtime(log_path) + if age < 600 and not (force or dry_run): # dry_run 目录是一次性的,天天重跑,不拿这条闸烦它 + raise SystemExit( + f"ABORT: {log_path} 在 {age / 60:.1f} 分钟前还被写过 —— 多半有另一个 run 正活在这个目录里。" + "两个 run 同写一个目录会互相 rotate 掉对方的 10 GB 权重。换个 --output;" + "如果确认上一次已经死了(比如刚崩),加 --force_run_dir(launcher 里是 FORCE_RUN_DIR=1)。") + if age < 600: + log(f"[warn] {log_path} {age / 60:.1f} 分钟前刚被写过,--force_run_dir 强行继续。") + + +# ---------------------------------------------------------------------------- +# 验证:任意步采样(4 步 / 24 步) +# ---------------------------------------------------------------------------- + +@torch.no_grad() +def run_validation(accelerator, model, val_ds, args) -> dict: + """固定 clip × 固定噪声,各进程分摊 clip,最后 reduce(集合操作,人人都要到)。 + + 采样是 flow map 自己的确定性 Euler(`flowmap.euler_chain`):`x_r = x_t − (σ_t−σ_r)·u(x_t,t,r)`, + **全程没有新噪声**,最后一格 σ_r=0 直接落在干净估计上。这与 rollout_eval 现有的 + 「估 x0 再重新加噪」是两个不同的采样器 —— 把 flow-map 权重喂进后者会出似是而非的垃圾。 + + 报两个数:每个步数预算下相对 GT 的 MSE,以及 **首尾两个预算之间的输出 MSE**(默认 4 vs 24)—— + 后者才是 any-step 主张的验收标准(绝对重建误差在少步蒸馏里本来就不会很低)。 + """ + model.eval() + device = accelerator.device + rank, world = accelerator.process_index, accelerator.num_processes + ns = list(args.val_step_list) + acc = torch.zeros(len(ns) + 2, device=device, dtype=torch.float64) # 每个 N 的 GT-MSE 和 / 一致性和 / 计数 + for i in range(rank, len(val_ds), world): + sample = val_ds[i] + batch = to_device(arope_collate([sample]), device) + x0 = batch["input_latents"] + b, c, cells, lh, lw = x0.shape + mask_in = make_mask_input(batch["offset_px"], lh, lw) + seed = (zlib.crc32(str(sample["clip_id"]).encode()) * 1009 + args.seed) % (2 ** 31) + + def _u(z, t_val, r_val): + return model(z, t_val, batch["context"], context_ids=batch["context_ids"], + offset_px=batch["offset_px"], mask_input=mask_in, + first_frame_cond=True, r_timestep=r_val) + + outs = [] + for j, n in enumerate(ns): + g = torch.Generator("cpu").manual_seed(seed) + x = torch.randn(b, c, cells, lh, lw, generator=g).to(dtype=x0.dtype, device=device) + x = fm.keep_frame0(x, x0) # TI2V 锚点:cell 0 = 真实首帧 latent + with torch.autocast(device_type=device.type, dtype=torch.bfloat16, + enabled=(device.type == "cuda")): + out = fm.euler_chain(_u, x, fm.anystep_sigmas(int(n)), + pin_fn=lambda z: fm.keep_frame0(z, x0)) + outs.append(out.float()) + acc[j] += ((out.float() - x0.float())[:, :, 1:] ** 2).mean().double() + if len(outs) >= 2: + acc[len(ns)] += ((outs[0] - outs[-1])[:, :, 1:] ** 2).mean().double() + acc[len(ns) + 1] += 1 + acc = accelerator.reduce(acc, reduction="sum") + model.train() + n_clip = max(float(acc[len(ns) + 1].item()), 1.0) + out = {f"mse_N{n}": acc[j].item() / n_clip for j, n in enumerate(ns)} + out["agree"] = acc[len(ns)].item() / n_clip + out["n"] = int(acc[len(ns) + 1].item()) + return out + + +# ---------------------------------------------------------------------------- +# 主流程 +# ---------------------------------------------------------------------------- + +def main(argv=None): + args = parse_args(argv) + if args.dry_run and args.max_steps > 30: + # 在打 banner 之前就改掉,否则日志里记的是一套没生效的配方 + args.max_steps, args.save_every, args.warmup = 12, 6, 3 + args.log_every, args.ema_start, args.val_every, args.val_n = 2, 3, 6, 2 + accelerator = Accelerator(gradient_accumulation_steps=args.grad_accum) + is_main = accelerator.is_main_process + use_ds = accelerator.distributed_type == DistributedType.DEEPSPEED + set_seed(args.seed, device_specific=True) # 每个 rank 的 ε 抽签都不同;划槽另走各 rank 同步的 CPU 流 + device = accelerator.device + world = accelerator.num_processes + if args.dry_run and world * args.batch_size < 4: + # dry run 通常是**单进程**,而划槽按全局 batch G = world × batch_size 分:G=1 时 + # round(0.5·1) = 0 个 diffusion 槽,flowmap.split_counts 会当场拒(配平的分母是空集)。 + # 把 batch 顶到 G>=4,划槽就与 4 卡正式配置相同,2/1/1 与逐样本角色都真的被走到。 + args.batch_size = -(-4 // world) + + if use_ds: + # 让 --grad_clip 成为唯一入口;yaml 里的 gradient_clipping 只是默认值(train.py:394-401) + ds_cfg = accelerator.state.deepspeed_plugin.deepspeed_config + ds_cfg["gradient_clipping"] = float(args.grad_clip) + ga = ds_cfg.get("gradient_accumulation_steps") + if ga not in ("auto", args.grad_accum): + raise SystemExit(f"--grad_accum={args.grad_accum} 与 accelerate yaml 的 " + f"gradient_accumulation_steps={ga} 不一致:要么传 --grad_accum {ga}," + f"要么换 distill/configs/accelerate_zero2_4gpu_ga{args.grad_accum}.yaml" + f"(现有 ga2 / ga4 两份;等效 batch = 4 × batch_size × GA)") + ds_cfg["gradient_accumulation_steps"] = args.grad_accum + + run_dir = runlib.resolve_run_dir(args.output) + # ★ 在**任何**写之前查:--output 指的是不是别人的 run 目录(保存时会 rotate 掉那边的 10 GB 权重)。 + _assert_run_dir_safe(run_dir, STAGE, bool(args.force_run_dir), dry_run=bool(args.dry_run)) + accelerator.wait_for_everyone() + if is_main: + os.makedirs(run_dir, exist_ok=True) + log = runlib.TextTee(os.path.join(run_dir, "train.log"), enabled=is_main) + jsonl = runlib.JsonlLogger(os.path.join(run_dir, "train_log.jsonl"), enabled=is_main) + eff_batch = world * args.batch_size * args.grad_accum + G = world * args.batch_size # 一个 micro batch 的全局样本数(划槽就按它分) + n_diff, n_cons = fm.split_counts(G, args.diffusion_ratio, args.consistency_ratio) + log(f"=== {STAGE} | run={run_dir} world={world} " + f"dist={accelerator.distributed_type} mp={accelerator.mixed_precision} ===") + log(f"[recipe] form={args.flowmap_form} gate={args.delta_gate} eps={args.flowmap_epsilon}" + f"(clamp={args.eps_clamp}) split={args.diffusion_ratio}/{args.consistency_ratio}" + f"(rotate={args.split_rotate}) weight={args.weight_type}@floor{args.weight_floor} " + f"balance={args.adaptive_balance}") + log(f"[recipe] fuse w={args.fuse_guidance_scale} ⇒ g_text={args.gains['text']:.2f};" + f"anchor={args.gains['anchor']} action={args.gains['action']} hist={args.gains['hist']} " + f"ctx={args.gains['ctx']} clip={args.fuse_clip}") + log(f"[recipe] dropout: text={args.drop_text_ratio} ★anchor={args.anchor_dropout} " + f"action={args.action_dropout} hist={args.hist_dropout} ctx={args.ctx_dropout}" + f"(scene_dropout={args.scene_dropout} 数据集侧,故意为 0)") + log(f"[recipe] tf={args.teacher_forcing} tf_aug={args.tf_noise_aug_max_idx} " + f"windowed={args.windowed_train}/{args.windowed_sink} ema={args.ema_decay}@{args.ema_start} " + f"lr={args.lr} betas={args.betas} wd={args.weight_decay} warmup={args.warmup} clip={args.grad_clip} " + f"bs={args.batch_size}×accum{args.grad_accum}×{world}卡 ⇒ 等效 batch {eff_batch} " + f"max_steps={args.max_steps} gc={args.gradient_checkpointing}") + log(f"[split] G={G} ⇒ diffusion {n_diff} / consistency {n_cons} / random {G - n_diff - n_cons} 每个 micro batch") + low = runlib.warn_if_low_disk(run_dir) + if low: + log(f"[warn] {low}") + + # ---- 数据 ---- + if args.dry_run: + train_ds, val_ds = _SynDataset(), (_SynDataset(args.val_n) if args.val_every > 0 else None) + log("[dry_run] tiny 模型 + 合成数据") + else: + sidecar = load_sidecar(args.sidecar) + # exclude_src_in=val_dir:与 stage1 完全同一套划分,训练集才还是 18528 条 + train_ds = AropeLatentDataset(args.train_dir, sidecar=sidecar, text_table=args.text_table, + text_mode="scene", scene_dropout=args.scene_dropout, + limit=args.limit, seed=args.seed, verbose=is_main, + exclude_src_in=args.val_dir, min_rt_ratio=args.min_rt_ratio) + val_ds = None + if args.val_every > 0 and args.val_n > 0: + val_ds = AropeLatentDataset(args.val_dir, sidecar=sidecar, text_table=train_ds.text_table, + text_mode="scene", scene_dropout=0.0, limit=args.val_n, + seed=args.seed, verbose=is_main, min_rt_ratio=args.val_min_rt_ratio) + log(f"[data] train {len(train_ds)} clip,val {len(val_ds) if val_ds is not None else 0} clip" + f"(scene_dropout={args.scene_dropout}:文本 dropout 由 trainer 做)") + dataloader = torch.utils.data.DataLoader( + train_ds, batch_size=args.batch_size, shuffle=True, drop_last=True, collate_fn=arope_collate, + num_workers=args.num_workers, pin_memory=True, persistent_workers=args.num_workers > 0, + ) + + # ---- 续训(只热启动权重:学生 ← dits/、影子 ← ema/;优化器状态不保存)---- + resume_step, resume_micro = 0, 0 + student_init, ema_init = args.init_ckpt, None + if args.resume and args.resume != "none": + prog = runlib.read_progress(run_dir) + if not prog or int(prog.get("step", 0)) <= 0: + log(f"[resume] {run_dir} 里没有 progress.json,从头开始") + else: + n = int(prog["step"]) + dp, ep = runlib.dit_path(run_dir, n), runlib.ema_path(run_dir, n) + miss = [p for p in (dp, ep) if not os.path.isfile(p)] + if miss: + raise SystemExit(f"progress.json 说停在 step {n},但 {miss} 不存在。" + f"要么把 --resume 关掉从头跑,要么把 progress.json 的 step 改成还在的那个。") + # 划槽是每个 micro batch 抽一次的**各 rank 同步**流:grad_accum 变了这条流就在各 rank 之间错开 + old_ga = prog.get("grad_accum") + if old_ga is not None and int(old_ga) != args.grad_accum: + raise SystemExit(f"续训不许改 --grad_accum(存档 {old_ga} → 本次 {args.grad_accum}):" + f"划槽每个 micro batch 抽一次,改了累积数这条同步流就错开了") + old_form = prog.get("flowmap_form") + if old_form is not None and str(old_form) != args.flowmap_form: + raise SystemExit(f"续训不许换 --flowmap_form(存档 {old_form} → 本次 {args.flowmap_form})") + resume_step, student_init, ema_init = n, dp, ep + resume_micro = int(prog.get("micro", n * args.grad_accum)) + log(f"[resume] step {resume_step}:student←{os.path.basename(dp)} ema←{os.path.basename(ep)}" + f"(micro batch 计数 {resume_micro})") + + # ---- 模型:一个 AropeDiT。没有冻结教师(自蒸馏:uncond 与两次探针都调它自己)---- + t0 = time.time() + win = dict(train_local_attn_size=args.windowed_train, train_sink_size=args.windowed_sink) + if args.dry_run: + module = _tiny_model() + else: + _ckpt_meta_gate(student_init, args, log) + module = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=True, **win) + load_info = None + # ★ 初始化顺序(写错了不会报错,只会静默丢掉教师): + # 新 run : 建模 → strict 装 827 → install_flowmap() + # 续训 : 建模 → install_flowmap() → strict 装 832 + # 按 ckpt 的**张量键**判定要走哪条(不看 metadata:那是人写的字符串,张量在不在是事实)。 + init_is_fm = bool(student_init) and runlib.is_flowmap_ckpt(student_init) + if init_is_fm: + module.install_flowmap(form=args.flowmap_form, gate=args.delta_gate) + module.to(device).move_rope_table(device) + if student_init: + load_info = runlib.load_dit_ckpt(module, student_init) + log(f"[model] student ← {student_init}({load_info['n_tensors']} 个张量," + f"缺 {load_info['missing']},flowmap_ckpt={init_is_fm})") + if not init_is_fm: + # 装 flow map 之前先留一张真代码路径的底片,装完逐位比对(_assert_teacher_identity) + pre = _tf_probe(module, 500.0, None) + module.install_flowmap(form=args.flowmap_form, gate=args.delta_gate) + module.to(device) # deepcopy 出来的 delta 分支 + gate buffer 也要在卡上 + _assert_teacher_identity(module, pre, args.flowmap_form, log) + del pre + else: + log("[model] init 本身就是 flow map 权重(832 键):跳过「装之前 vs 装之后」的同一性闸") + assert module.has_flowmap and module.flowmap_form == args.flowmap_form + + # 导出键数:827 + 5 = 832(delta_embedding.{0,2}.{w,b} + delta_gate,都挂在 dit 上) + export_keys = len(runlib.strip_dit_prefix(module.state_dict())[0]) + if not args.dry_run and export_keys != runlib.AROPE_DIT_KEYS_FLOWMAP: + raise SystemExit(f"导出键数是 {export_keys},期望 {runlib.AROPE_DIT_KEYS_FLOWMAP}" + f"(827 + {len(runlib.FLOWMAP_KEYS)} 个 flow map 键)") + n_params = sum(p.numel() for p in module.parameters()) + module.train().requires_grad_(True) + + # EMA 影子:deepcopy 学生(**在 install_flowmap 之后**,否则参数表少 4 个、zip 会当场炸) + ema = EmaShadow(module, device=None) # 先在 CPU 上转 fp32,等 prepare 之后再上卡 + if ema_init is not None: + info_e = runlib.load_dit_ckpt(ema, ema_init) # assign=False ⇒ copy_ 进 fp32 参数 + ema._assert_fp32() + log(f"[model] ema ← {ema_init}({info_e['n_tensors']} 个张量)") + log(f"[model] AropeDiT {n_params:,} 参数,导出 {export_keys} 键;构建 {time.time() - t0:.0f}s") + + # ---- 优化器 ---- + optimizer = torch.optim.AdamW(module.parameters(), lr=args.lr, + weight_decay=args.weight_decay, betas=args.betas) + warm = max(int(args.warmup), 0) + # lr scheduler 故意不进 prepare:accelerate 包装后每步会 step num_processes 次,warmup 被悄悄压缩 + lr_scheduler = torch.optim.lr_scheduler.LambdaLR(optimizer, lambda s: min(1.0, (s + 1) / warm) if warm > 0 else 1.0) + if resume_step: + with warnings.catch_warnings(): # 优化器还没 step 就先走 scheduler,PyTorch 会提醒一句,这里是有意的 + warnings.simplefilter("ignore") + for _ in range(resume_step): + lr_scheduler.step() + + # ★ 只把 **一个** nn.Module 交给 prepare(accelerator.py:2229-2236 只留最后一个,多传会静默丢) + model, optimizer, dataloader = accelerator.prepare(module, optimizer, dataloader) + unwrap(model).move_rope_table(device) # dit.freqs 是普通 tuple 属性,prepare / .to() 都搬不动 + ema.to(device) + unwrap(ema.module).move_rope_table(device) + _assert_ready(accelerator, model, ema, device, log) + if is_main and use_ds: + clip_eff = getattr(getattr(model, "optimizer", None), "clip_grad", None) + log(f"[env] grad_clip={args.grad_clip}(DeepSpeed 生效值 {clip_eff})") + + # ---- 文本 null(fuse 每一步都读它;--drop_text_ratio 也要它)---- + # 只存 [1,1,L,4096] 这一行;每个 micro batch 现 expand 成 [b,f,L,4096],配一份全 0 的 ids + # (同 id ⇒ _embed_context 只对唯一行算一次 text_embedding,不会真的算 21 遍) + uncond = None + if args.gains["text"] > 0.0 or args.drop_text_ratio > 0.0: + if args.dry_run: + null_row = torch.randn(8, 4096, dtype=torch.bfloat16) # tiny 的 L=8 + else: + table = train_ds.text_table + if NULL_PROMPT not in table: + raise SystemExit(f"需要文本 null(fuse_guidance_scale={args.fuse_guidance_scale} / " + f"drop_text_ratio={args.drop_text_ratio}),但文本表里没有 " + f"NULL_PROMPT={NULL_PROMPT!r}({args.text_table})") + null_row = table[NULL_PROMPT].to(torch.bfloat16) + uncond = null_row.view(1, 1, *null_row.shape).to(device) + log(f"[fuse] 文本 null = NULL_PROMPT {tuple(null_row.shape)};每个 micro batch 多 " + f"{sum(1 for a in fm.NULL_AXES if args.gains[a] > 0)} 次 no_grad 前向(每条 g_j>0 的轴一次)" + f" + 2 次中心差分探针(t==r 的槽跳过)") + + # ---- 逐档权重(只为日志;loss 里由 flowmap.flowmap_loss 按 idx_t 取)---- + wg = fm.flowmap_weights(args.weight_type, float(args.weight_floor)) + log(f"[weight] {args.weight_type} floor={args.weight_floor}:{tuple(wg.shape)}," + f"min {float(wg.min()):.4f} max {float(wg.max()):.4f} mean {float(wg.mean()):.4f}") + + # ---- config.json:复现所需的一切 ---- + if is_main: + cfg = { + "stage": STAGE, "args": vars(args), "eff_batch": eff_batch, + "split": {"G": G, "n_diffusion": n_diff, "n_consistency": n_cons, + "n_random": G - n_diff - n_cons, "rotate": bool(args.split_rotate)}, + "dataset": ({"synthetic": True} if args.dry_run else { + "train_dir": args.train_dir, "train_used": len(train_ds), + "train_total": train_ds.n_total, "train_invalid": train_ds.n_invalid, + "train_leak_excluded": train_ds.n_leak, "train_low_rt_excluded": train_ds.n_low_rt, + "text_table_keys": len(train_ds.text_table), "excluded_src_in": args.val_dir, + "val_used": len(val_ds) if val_ds is not None else 0, + "val_clip_ids": val_ds.clip_ids() if val_ds is not None else []}), + "model": {"n_params": n_params, "export_keys": export_keys, "causal": True, + "mask_channel": True, "flowmap_form": args.flowmap_form, + "delta_gate": args.delta_gate, "init_ckpt": student_init, + "init_is_flowmap": init_is_fm, "ema_ckpt": ema_init, + "load_info": load_info, "start_step": resume_step}, + "product": {"deploy": "ema/ema_step{N}.safetensors", + "resume_only": "dits/dit_step{N}.safetensors", + "sampler": "flow map 的确定性 Euler(flowmap.euler_step,要给 r)—— " + "**不是** rollout_eval 现有的 renoise 采样器", + "note": "832 键:actionrope/infer.py、tests/check_ckpt.py、eval_bg50.py 会拒收," + "这是对的(用旧采样器、不给 r 去采 flow map 会安静地产出另一个模型)"}, + "env": {"world_size": world, "distributed_type": str(accelerator.distributed_type), + "mixed_precision": accelerator.mixed_precision, "torch": torch.__version__, + "cuda": torch.version.cuda, + "gpu": torch.cuda.get_device_name(0) if torch.cuda.is_available() else None, + "python": sys.executable, "platform": platform.platform(), "hostname": socket.gethostname(), + "argv": sys.argv, "started": time.strftime("%Y-%m-%d %H:%M:%S"), + "cuda_visible_devices": os.environ.get("CUDA_VISIBLE_DEVICES")}, + "deepspeed_config": (accelerator.state.deepspeed_plugin.deepspeed_config if use_ds else None), + } + try: + import accelerate # noqa: F401 + cfg["env"]["accelerate"] = accelerate.__version__ + except Exception: + pass + runlib.save_config(run_dir, cfg) + + # ---- 日志 ---- + csv_fields = ["step", "fm", "mse", "loss_uw", "role", "t", "r", "sigma_t", "tw", "den", "n_null", + "dfdt", "tgt", "scale", "lr", "grad_norm", "step_time", "mem_gb", "epoch"] + train_log = runlib.CsvLog(os.path.join(run_dir, "train_log.csv"), csv_fields, enabled=is_main) + val_log = runlib.CsvLog(os.path.join(run_dir, "val_log.csv"), + ["step"] + [f"mse_N{n}" for n in args.val_step_list] + ["agree", "n"], + enabled=is_main) + + def do_save(step, loss_val=None, micro=0): + # save_dit 是集合操作(accelerator.get_state_dict),每个 rank 都必须进来 + meta = {"stage": STAGE, "step": step, "flowmap": 1, "flowmap_form": args.flowmap_form, + "deltatime_type": "r", "delta_gate": args.delta_gate, + "flowmap_epsilon": args.flowmap_epsilon, "eps_clamp": args.eps_clamp, + "diffusion_ratio": args.diffusion_ratio, "consistency_ratio": args.consistency_ratio, + "split_rotate": args.split_rotate, "weight_type": args.weight_type, + "weight_floor": args.weight_floor, "adaptive_balance": args.adaptive_balance, + "fuse_guidance_scale": args.fuse_guidance_scale, "fuse_clip": args.fuse_clip, + "fuse_g_anchor": args.fuse_g_anchor, "fuse_g_action": args.fuse_g_action, + "fuse_g_hist": args.fuse_g_hist, "fuse_g_ctx": args.fuse_g_ctx, + "teacher_forcing": args.teacher_forcing, + "windowed_train": args.windowed_train, "windowed_sink": args.windowed_sink, + "anchor_dropout": args.anchor_dropout, "action_dropout": args.action_dropout, + "hist_dropout": args.hist_dropout, "ctx_dropout": args.ctx_dropout, + "drop_text_ratio": args.drop_text_ratio, "init_ckpt": student_init} + runlib.save_dit(accelerator, model, runlib.dit_path(run_dir, step), + {**meta, "role": "raw_student_resume_only"}, expect_keys=export_keys, log=log) + # ★ 部署权重:EMA。上一行的 dits/ 只为续训存在。 + runlib.save_dit(accelerator, ema, runlib.ema_path(run_dir, step), + {**meta, "role": "ema_deploy"}, expect_keys=export_keys, log=log) + if is_main: + gone_d = runlib.rotate(runlib.dit_glob(run_dir), args.keep_last_dits) + gone_e = runlib.rotate(runlib.ema_glob(run_dir), args.keep_last_emas) + if gone_d or gone_e: + log(f"[rotate] 删掉 {len(gone_d)} 个旧 dit(留 {args.keep_last_dits})、" + f"{len(gone_e)} 个旧 ema(留 {args.keep_last_emas})") + runlib.write_progress(run_dir, step, stage=STAGE, loss=loss_val, micro=micro, + grad_accum=args.grad_accum, flowmap_form=args.flowmap_form, + deploy="ema/ema_step%d.safetensors" % step) + + def do_validation(step): + if val_ds is None: + return + tv = time.time() + res = run_validation(accelerator, model, val_ds, args) + if is_main: + val_log.write({"step": step, **res}) + jsonl.log({"step": step, "kind": "val", **res}) + log(f"[val] step {step} " + + " ".join(f"N={n}: mse={res[f'mse_N{n}']:.4f}" for n in args.val_step_list) + + f" | {args.val_step_list[0]}-vs-{args.val_step_list[-1]} agree={res['agree']:.5f}" + f" (n={res['n']}) {time.time() - tv:.0f}s") + + # ---- 两条随机流 ---- + # 1) 划槽:CPU 生成器,**所有 rank 同一个种子** ⇒ 每个 micro batch 各 rank 读到同一份 perm。 + # 2) (t, r) 与条件 dropout:**每个 rank 各自**的流。 + # 续训按 micro batch 数快进,**照训练时的同一串调用**(不去猜 flowmap 内部抽了几个数)。 + # dropout 抽签固定 5 个、不短路,抽签数才恒定 —— 这是快进能对齐的前提。 + split_gen = fm.make_split_generator(args.seed) + rank_rng = torch.Generator(device="cpu").manual_seed(9876 + args.seed * 131 + accelerator.process_index) + + def draw_tr(): + tr = fm.sample_tr(args.batch_size, world_size=world, rank=accelerator.process_index, + gen=rank_rng, split_gen=split_gen, + diffusion_ratio=args.diffusion_ratio, consistency_ratio=args.consistency_ratio, + rotate=bool(args.split_rotate), device=device) + return tr, torch.rand(5, generator=rank_rng) + + for _ in range(resume_micro): + draw_tr() + if resume_micro: + log(f"[resume] 两条随机流各快进 {resume_micro} 个 micro batch") + + # ---- 训练循环 ---- + model.train() + step, epoch, micro, last_saved = resume_step, 0, resume_micro, resume_step + if device.type == "cuda": + torch.cuda.reset_peak_memory_stats(device) + log(f"[train] 从 step {step} 到 {args.max_steps}") + micro_time, loss_ema = 0.0, None + roles = [0, 0, 0] # 本 rank 各角色的命中次数(rank 静态分配时会一眼看出来) + while step < args.max_steps: + for batch in dataloader: + if step >= args.max_steps: + break + t_step = time.time() + batch = to_device(batch, device) + lr_now = lr_scheduler.get_last_lr()[0] # 本步用的 lr(step 之后拿到的是下一步的) + with accelerator.accumulate(model): + tr, u5 = draw_tr() + micro += 1 + for rr in tr.role.tolist(): + roles[int(rr)] += 1 + # 条件 dropout:与 stage1b 同一套互斥阶梯(ctx > hist > anchor,action 独立抽签)。 + # batch_size 恒为 1,所以逐 batch == 逐样本(与 ar_tf.py:169-185 同口径)。 + d_ctx = bool(u5[1] < args.ctx_dropout) + d_hist = (not d_ctx) and bool(u5[2] < args.hist_dropout) + d_anc = (not d_ctx) and (not d_hist) and bool(u5[3] < args.anchor_dropout) + drop = {"text": bool(u5[0] < args.drop_text_ratio) and uncond is not None, + "action": bool(u5[4] < args.action_dropout), + "ctx": d_ctx, "hist": d_hist, "anchor": d_anc} + + b = batch["input_latents"].shape[0] + ctx_b = batch["context"] + loss_b, stats = fm_loss( + model, batch, tr, gains=args.gains, + uncond=(None if uncond is None else uncond.expand(b, ctx_b.shape[1], -1, -1)), + uncond_ids=(None if uncond is None else torch.zeros_like(batch["context_ids"])), + teacher_forcing=args.teacher_forcing, + tf_noise_aug_max_idx=args.tf_noise_aug_max_idx, + epsilon=args.flowmap_epsilon, eps_clamp=bool(args.eps_clamp), + fuse_clip=args.fuse_clip, weight_type=args.weight_type, + weight_floor=args.weight_floor, drop=drop, + use_gradient_checkpointing=args.gradient_checkpointing) + + # ---- 自适应配平(gather 是集合操作:每个 rank、每个 micro batch 都必须进来)---- + scale_log = 1.0 + if args.adaptive_balance: + loss_b, bal = fm.adaptive_balance(loss_b, tr.is_diffusion, + gather_fn=(accelerator.gather if world > 1 else None)) + scale_log = float(bal["scale_mean"]) + loss = loss_b.mean() + + accelerator.backward(loss) # DeepSpeed 下这一步已含 engine.step()(裁剪 + 更新) + grad_norm = (accelerator.clip_grad_norm_(model.parameters(), args.grad_clip) + if accelerator.sync_gradients else None) + optimizer.step() + if accelerator.sync_gradients: + lr_scheduler.step() # DeepSpeed 的 scheduler 包装不认累积边界,只能在这里守门 + optimizer.zero_grad(set_to_none=True) + if device.type == "cuda": + torch.cuda.synchronize(device) + micro_time += time.time() - t_step + if not accelerator.sync_gradients: + continue # 还在累积,不算一步 + step += 1 + # ★ EMA 必须在优化器更新**之后**、每个优化器步只做一次(不是每个 micro batch) + decay = 0.0 if step <= args.ema_start else args.ema_decay + ema.update(model, decay) + step_time, micro_time = micro_time, 0.0 + loss_mean = accelerator.reduce(loss.detach().float(), reduction="mean").item() + loss_ema = loss_mean if loss_ema is None else 0.9 * loss_ema + 0.1 * loss_mean + if is_main and (step % args.log_every == 0 or step == args.max_steps): + gn = float(grad_norm) if grad_norm is not None and math.isfinite(float(grad_norm)) else float("nan") + role_name = "+".join(fm.ROLE_NAMES[int(x)] for x in tr.role.tolist()) + row = {"step": step, "fm": loss_mean, "mse": stats["mse"], "loss_uw": stats["loss_uw"], + "role": role_name, "t": stats["t"], "r": stats["r"], "sigma_t": stats["sigma_t"], + "tw": stats["tw"], "den": stats["den"], "n_null": stats["n_null"], + "dfdt": stats["dfdt"], "tgt": stats["tgt"], "scale": scale_log, + "lr": lr_now, "grad_norm": gn, "step_time": step_time, + "mem_gb": (torch.cuda.max_memory_allocated(device) / 1024 ** 3 if device.type == "cuda" else 0.0), + "epoch": epoch} + train_log.write(row) + jsonl.log({**row, "fm_ema": loss_ema, "micro": micro, + "roles": dict(zip(fm.ROLE_NAMES, roles)), "axes": stats["axes"], + "skip_cd": stats["skip_cd"], "clamped": stats["clamped"], "decay": decay, + "drop": {k: stats[f"d_{k}"] for k in ("text", "act", "anc", "hist", "ctx")}}) + log(f"step {step}/{args.max_steps} fm {loss_mean:.5f} (ema {loss_ema:.5f}) " + f"mse {row['mse']:.5f} [{role_name}] t {row['t']:.0f}→r {row['r']:.0f} " + f"σ {row['sigma_t']:.4f} w {row['tw']:.3f} den {row['den']:.1f}/{row['n_null']}null " + f"|dF/dt| {row['dfdt']:.4f} lr {lr_now:.2e} gnorm {gn:.3f} decay {decay:.3f} " + f"{step_time:.2f}s mem {row['mem_gb']:.1f}GB") + if args.val_every > 0 and step % args.val_every == 0: + do_validation(step) + if args.save_every > 0 and step % args.save_every == 0: + do_save(step, loss_mean, micro) + last_saved = step + epoch += 1 + + if last_saved != step: + do_save(step, loss_ema, micro) + if device.type == "cuda": + peak = torch.tensor(torch.cuda.max_memory_allocated(device) / 1024 ** 3, device=device) + peak_max = accelerator.reduce(peak, reduction="max").item() + else: + peak_max = 0.0 + log(f"[done] step {step},本 rank 角色命中 {dict(zip(fm.ROLE_NAMES, roles))}," + f"各进程峰值显存 {peak_max:.1f} GB。" + f"产物 = ema/ema_step{step}.safetensors({export_keys} 键,flowmap=1);" + f"采样必须用 flow map 的 Euler(要给 r),旧的 renoise 采样器会安静地产出另一个模型") + if is_main: + runlib.write_progress(run_dir, step, stage=STAGE, finished=True, peak_mem_gb=peak_max, + micro=micro, grad_accum=args.grad_accum, flowmap_form=args.flowmap_form, + roles=dict(zip(fm.ROLE_NAMES, roles)), + deploy="ema/ema_step%d.safetensors" % step) + train_log.close() + val_log.close() + jsonl.close() + log.close() + accelerator.wait_for_everyone() + accelerator.end_training() + return step + + +if __name__ == "__main__": + main() diff --git a/backup_2026-09-14/code/distill/stage2_flowmap/run.sh b/backup_2026-09-14/code/distill/stage2_flowmap/run.sh new file mode 100644 index 0000000000000000000000000000000000000000..bdb0eaf0f917c84d4177cb44ca9a974f8cdc26eb --- /dev/null +++ b/backup_2026-09-14/code/distill/stage2_flowmap/run.sh @@ -0,0 +1,197 @@ +#!/usr/bin/env bash +# ───────────────────────────────────────────────────────────────────────────── +# stage2(新):flow-map 任意步蒸馏 —— 替换 stage2-CD。 +# +# 4 卡 DeepSpeed ZeRO-2,batch 1 × GA 2 × 4 卡 = 等效 batch 8,lr 1e-5,8000 步。 +# 预算 ≈14 s/step ⇒ 约 31 h(**必须**先用 20 步冒烟钉住 s/step 再当真,见文件末)。 +# +# ★ 产物是 /ema/ema_step{N}.safetensors —— **832 键**(827 + delta_embedding 4 + delta_gate 1)。 +# /dits/dit_step{N}.safetensors 只为续训存在。 +# ★ 采样必须用 flow map 的确定性 Euler 并且**要给 r**;拿旧的 renoise 采样器去采它不会报错, +# 只会安静地产出另一个模型。actionrope/infer.py、tests/check_ckpt.py、eval_bg50.py 会按 827 键拒收, +# 这是对的,不是 bug。 +# +# bash distill/stage2_flowmap/run.sh # 按下面的配方跑 +# # 20 步实机冒烟(S-FM13)。OUT 必须写绝对路径:$ROOT 是 common.sh 在本脚本**内部**才导出的。 +# # 它同时钉三件事:s/step、每卡峰值显存、gnorm 分布(用来重钉 GRAD_CLIP)。 +# MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 VAL_EVERY=10 VAL_N=4 PORT=29541 \ +# OUT=/data/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage2fm \ +# bash distill/stage2_flowmap/run.sh +# INIT=/path/to/dit_step3000.safetensors bash distill/stage2_flowmap/run.sh # 换一个 stage1b 检查点 +# +# 这里的每一个常量都与 fm_arope.py 的 argparse 默认值、config.json 逐项相同 —— 上游 A 的 run.sh +# 与 argparse 有六处不一致、每一处都对应一次已知的崩溃(PORT_SPEC risk 11),所以这个移植里 +# 只允许存在一份配方。改配方 = 同时改这三处。 +# 只有一处**故意**与 argparse 默认值不同("裸跑不应该有的副作用"): +# --resume auto(argparse 默认 None:不想让随手一跑就悄悄接着上次的 step 跑) +# +# CUDA_VISIBLE_DEVICES / GPU 占用守卫都在 common.sh 里,这里不重复也不许绕过。 +# ───────────────────────────────────────────────────────────────────────────── +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +# shellcheck source=../common.sh +source "$HERE/../common.sh" # set -euo pipefail / ROOT / PY / ACC / 环境 / 只用 GPU 0-3 / 空闲守卫 + +# ---- 输入输出(都可以用环境变量覆盖)---- +# init 必须是 **stage1b** 的产物:fuse 每一步都读 text null,而 anchor/action/hist/ctx 四条 null +# 只有 stage1b 训过(stage1 的 dit_step10000 里根本没有)。 +STAGE1B_OUT="${STAGE1B_OUT:-$ROOT/outputs/distill/stage1b_adapt}" +INIT="${INIT:-$STAGE1B_OUT/dits/dit_step3000.safetensors}" +TRAIN_DIR="${TRAIN_DIR:-$ROOT/data/latent/train_eybx}" +VAL_DIR="${VAL_DIR:-$ROOT/data/latent/val_eybx}" # exclude_src_in + 任意步验证(4 步 / 24 步)的留出集 +SIDECAR="${SIDECAR:-$ROOT/data/latent/arope_sidecar.pt}" +TEXT_TABLE="${TEXT_TABLE:-$ROOT/data/latent/text_table_actionrope.pt}" +OUT="${OUT:-$ROOT/outputs/distill/stage2_flowmap}" + +# ---- 并行与端口 ---- +PORT="${PORT:-29534}" # 固定分配:stage1 29531 / stage2-CD 29532 / stage1b 29533 / + # stage2-flowmap 29534 / stage3 29536 / 冒烟 29541+ +# 等效 batch **恒为 8**,与 stage1/stage1b 一致;卡数变的是墙钟,不是配方。 +# 4 卡 → GA 2 (4 × 1 × 2 = 8) +# 8 卡 → GA 1 (8 × 1 × 1 = 8) +# 想改等效 batch 就显式给 GRAD_ACCUM,并自己确认对应的 yaml 存在。 +if [ "$DISTILL_NGPU" = "8" ]; then + GRAD_ACCUM="${GRAD_ACCUM:-1}" + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_8gpu_ga${GRAD_ACCUM}.yaml}" +else + GRAD_ACCUM="${GRAD_ACCUM:-2}" + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_zero2_4gpu_ga${GRAD_ACCUM}.yaml}" +fi + +# ---- flow map 本体 ---- +# residual:t = E(t) + g·D(r),D 的读出层零初始化 ⇒ 对**任意** (t,r) 都与 stage1b 逐位相同。 +# 这是硬要求:按构造有 50 % 的样本落在 r ≠ t 的 off-diagonal 上,而 init 是 24 GPU-hours 换来的教师。 +# 上游的 convex 形式只在 r == t 上是恒等(off-diagonal 实测 max|Δ|≈1.1e-01),只作保真度消融: +# FLOWMAP_FORM=convex DELTA_GATE=0.25 bash distill/stage2_flowmap/run.sh +FLOWMAP_FORM="${FLOWMAP_FORM:-residual}" +DELTA_GATE="${DELTA_GATE:-1.0}" # persistent buffer,跟着权重存盘(上游是 persistent=False,会与推理悄悄不一致) +EPSILON="${EPSILON:-5.0}" # 中心差分步长,**0..1000 时间步量纲** +EPS_CLAMP="${EPS_CLAMP:-1}" # 1 = 夹在 [t_min,1000] 内并按实际步长除;0 = 复现上游 +DIFFUSION_RATIO="${DIFFUSION_RATIO:-0.5}" # r := t +CONSISTENCY_RATIO="${CONSISTENCY_RATIO:-0.25}" # r := 0;其余 25 % 是自由 (t,r) 对 +SPLIT_ROTATE="${SPLIT_ROTATE:-1}" # 1 = 每个 micro batch 各 rank 同步 randperm 轮换槽位(见 fm_arope.py) +PER_CELL_TR="${PER_CELL_TR:-0}" # 0 = 每个样本一个标量 t 广播到 21 个 cell(与部署一致) +WEIGHT_TYPE="${WEIGHT_TYPE:-beta08}" # 上游 y=σ·(1−σ)^0.5 归一到和 1000 +WEIGHT_FLOOR="${WEIGHT_FLOOR:-0.0}" # 两种权重在 σ=1.0 都恰好是 0;0.0 = 上游原样 +ADAPTIVE_BALANCE="${ADAPTIVE_BALANCE:-1}" + +# ---- guidance 蒸馏(stage1b 的 null 分支在这里接上)---- +# 默认只开文本那一条,且 w=3 与上游逐位相同:pred=(F_c+2F_u)/3 与 (F_c−(1−3)F_u)/3 是同一个浮点值。 +# ★ 这相对现有流水线是**行为改变**:rollout_eval 与 stage2-CD 从来没开过文本 CFG,而蒸馏进去之后 +# 推理端没有旋钮可以调回来。第一个实验是 CFG_SCALE=1.0 vs 3.0 的 1000 步 A/B。 +# 另外四条轴默认 0(这样整条多轴代码路径与上游 bit-diff 相同)。要开就一条一条来、从基线 EMA 起 +# 各跑 1000 步探针,判据是 rollout_eval 的外观漂移与 4-vs-24 一致性;FUSE_CLIP 是断路器。 +CFG_SCALE="${CFG_SCALE:-3.0}" # 文本 CFG(w);g_text = w − 1 +G_ANCHOR="${G_ANCHOR:-0.0}" # ★ 主力候选:Δv_anchor 正对着实测的外观漂移 +G_ACTION="${G_ACTION:-0.0}" +G_HIST="${G_HIST:-0.0}" +G_CTX="${G_CTX:-0.0}" +FUSE_CLIP="${FUSE_CLIP:-0.0}" # 0 = 关 + +# ---- 条件 dropout:stage1b 的比例继续跑(fuse 每一步都读 text null,分支不能烂)---- +DROP_TEXT="${DROP_TEXT:-0.10}" # 上游的值,但挪进 trainer(trainer 才知道本步 text 轴是否已被 drop) +ANCHOR_DROPOUT="${ANCHOR_DROPOUT:-0.15}" # ★ 主力 +ACTION_DROPOUT="${ACTION_DROPOUT:-0.05}" +HIST_DROPOUT="${HIST_DROPOUT:-0.05}" +CTX_DROPOUT="${CTX_DROPOUT:-0.05}" +SCENE_DROPOUT="${SCENE_DROPOUT:-0.0}" # 数据集侧关掉:文本 dropout 由 trainer 做 + +# ---- 其余配方 ---- +TF_AUG="${TF_AUG:-0}" # clean 半流精确干净(t = r = 0) +WINDOW="${WINDOW:-0}" # 全因果;F=21 下 sink=0 的窗口会把 cell 0(干净锚点)挤出视野 +WINDOW_SINK="${WINDOW_SINK:-0}" +MIN_RT="${MIN_RT:-0.8}" +VAL_MIN_RT="${VAL_MIN_RT:-0.9}" +EMA_DECAY="${EMA_DECAY:-0.999}" # 上游 ema_decay;产物就是这个影子 +EMA_START="${EMA_START:-1000}" # 之前硬拷贝(上游 ema_warmup_step) +LR="${LR:-1e-5}" # **不是**上游的 5e-5(那是 rank-256 LoRA 的数) +WEIGHT_DECAY="${WEIGHT_DECAY:-0.0}" +ADAM_BETAS="${ADAM_BETAS:-0.9,0.999}" # beta2 保持 0.999(上游 0.95;我们等效 batch 只有 8) +WARMUP="${WARMUP:-200}" +# ✅ 已用 20 步 8 卡冒烟实测重钉(2026-09-07):gnorm p50=0.0730 / p90=0.1100 / max=0.1210。 +# 与 SFT 的分布几乎相同(p50 0.0724 / max 0.4809),而 SFT 用 clip 1.0 跑满 5000 步一次都没触发。 +# 1.0 比实测 max 高 8.3×:兜得住离群值,正常步一步不裁。 +# 之前的 10.0 是 max 的 83× —— 等于没有裁剪,也就没有任何离群保护。 +# 注意这与 stage1 的结论**方向相反**(那里 1.0 → 10.0):stage1 的 gnorm 是 ~2.5,1.0 会步步都裁。 +# 同一条原则(阈值按实测分布定),不同阶段不同答案。 +GRAD_CLIP="${GRAD_CLIP:-1.0}" +MAX_STEPS="${MAX_STEPS:-8000}" +SAVE_EVERY="${SAVE_EVERY:-500}" +KEEP_EMAS="${KEEP_EMAS:-25}" # 部署权重要从这些里人眼挑,别按 dits/ 的口径只留 2 个 +KEEP_DITS="${KEEP_DITS:-2}" # dits/ 只为续训存在 +VAL_EVERY="${VAL_EVERY:-500}" +VAL_N="${VAL_N:-4}" +VAL_STEPS="${VAL_STEPS:-4,24}" # ★ any-step 的主张本身(上游自己的验证设置);验收看 4-vs-24 一致性 +LOG_EVERY="${LOG_EVERY:-20}" +NUM_WORKERS="${NUM_WORKERS:-2}" +SEED="${SEED:-0}" +RESUME="${RESUME:-auto}" # auto:有 /progress.json 就续(只热启动权重);none 关掉 +FORCE_RUN_DIR="${FORCE_RUN_DIR:-0}" # 1:/train.log 刚被写过也照跑(只在确认上一次真的死了时用) + +# ---- 前置检查(缺什么当场说清楚,不要跑到第 3 步才炸)---- +if [ ! -f "$INIT" ]; then + echo "ABORT: 没有 stage1b 检查点: $INIT" + if [ -d "$STAGE1B_OUT/dits" ]; then + echo " $STAGE1B_OUT/dits 里现有:" + ls -1 "$STAGE1B_OUT/dits" 2>/dev/null | tail -8 | sed 's/^/ /' + fi + echo " init 必须是 stage1b 的产物:guidance 蒸馏每一步都要读 null 分支," + echo " 而只有训练时 drop 过的条件才谈得上 guidance(stage1 的 dit_step10000 没有那四条)。" + exit 1 +fi +[ -d "$TRAIN_DIR" ] || { echo "ABORT: 没有训练集目录: $TRAIN_DIR"; exit 1; } +[ -d "$VAL_DIR" ] || { echo "ABORT: 没有验证集目录: $VAL_DIR(exclude_src_in + 任意步验证都要它)"; exit 1; } +[ -f "$SIDECAR" ] || { echo "ABORT: 没有 sidecar: $SIDECAR"; exit 1; } +[ -f "$TEXT_TABLE" ] || { echo "ABORT: 没有文本表: $TEXT_TABLE"; exit 1; } +[ -f "$ACC_CFG" ] || { echo "ABORT: 没有 accelerate 配置: $ACC_CFG(NGPU=$DISTILL_NGPU GRAD_ACCUM=$GRAD_ACCUM)"; exit 1; } +[ -f "$ROOT/distill/flowmap.py" ] || { echo "ABORT: 没有 distill/flowmap.py(flow map 的目标侧数学在那里)"; exit 1; } +mkdir -p "$OUT" + +ARGS=( + --init_ckpt "$INIT" + --train_dir "$TRAIN_DIR" --val_dir "$VAL_DIR" + --sidecar "$SIDECAR" --text_table "$TEXT_TABLE" + --scene_dropout "$SCENE_DROPOUT" --min_rt_ratio "$MIN_RT" --val_min_rt_ratio "$VAL_MIN_RT" + --flowmap_form "$FLOWMAP_FORM" --delta_gate "$DELTA_GATE" + --flowmap_epsilon "$EPSILON" --eps_clamp "$EPS_CLAMP" + --diffusion_ratio "$DIFFUSION_RATIO" --consistency_ratio "$CONSISTENCY_RATIO" + --split_rotate "$SPLIT_ROTATE" --per_cell_tr "$PER_CELL_TR" + --weight_type "$WEIGHT_TYPE" --weight_floor "$WEIGHT_FLOOR" + --adaptive_balance "$ADAPTIVE_BALANCE" + --fuse_guidance_scale "$CFG_SCALE" + --fuse_g_anchor "$G_ANCHOR" --fuse_g_action "$G_ACTION" + --fuse_g_hist "$G_HIST" --fuse_g_ctx "$G_CTX" --fuse_clip "$FUSE_CLIP" + --drop_text_ratio "$DROP_TEXT" --anchor_dropout "$ANCHOR_DROPOUT" + --action_dropout "$ACTION_DROPOUT" --hist_dropout "$HIST_DROPOUT" --ctx_dropout "$CTX_DROPOUT" + --teacher_forcing --tf_noise_aug_max_idx "$TF_AUG" + --windowed_train "$WINDOW" --windowed_sink "$WINDOW_SINK" + --ema_decay "$EMA_DECAY" --ema_start "$EMA_START" + --lr "$LR" --weight_decay "$WEIGHT_DECAY" --adam_betas "$ADAM_BETAS" + --warmup "$WARMUP" --grad_clip "$GRAD_CLIP" + --batch_size 1 --grad_accum "$GRAD_ACCUM" --max_steps "$MAX_STEPS" + --gradient_checkpointing + --save_every "$SAVE_EVERY" --keep_last_emas "$KEEP_EMAS" --keep_last_dits "$KEEP_DITS" + --val_every "$VAL_EVERY" --val_n "$VAL_N" --val_steps "$VAL_STEPS" + --log_every "$LOG_EVERY" --num_workers "$NUM_WORKERS" --seed "$SEED" + --output "$OUT" +) +# 写成 if 而不是 `[ cond ] && ARGS+=(...)`:set -e 下 && 链的写法太容易踩坑,这里不给它机会 +if [ -n "$RESUME" ] && [ "$RESUME" != "none" ]; then + ARGS+=(--resume "$RESUME") +fi +if [ "$FORCE_RUN_DIR" = "1" ]; then + ARGS+=(--force_run_dir) +fi + +echo "[stage2fm] init = $INIT (stage1b:四条 null 分支的来源)" +echo "[stage2fm] out=$OUT port=$PORT cfg=$(basename "$ACC_CFG") 等效 batch=$((DISTILL_NPROC * GRAD_ACCUM))" +echo "[stage2fm] form=$FLOWMAP_FORM gate=$DELTA_GATE eps=$EPSILON(clamp=$EPS_CLAMP) split=$DIFFUSION_RATIO/$CONSISTENCY_RATIO(rotate=$SPLIT_ROTATE)" +echo "[stage2fm] fuse w=$CFG_SCALE anchor=$G_ANCHOR action=$G_ACTION hist=$G_HIST ctx=$G_CTX clip=$FUSE_CLIP" +echo "[stage2fm] dropout text=$DROP_TEXT ★anchor=$ANCHOR_DROPOUT action=$ACTION_DROPOUT hist=$HIST_DROPOUT ctx=$CTX_DROPOUT" +echo "[stage2fm] lr=$LR betas=$ADAM_BETAS warmup=$WARMUP clip=$GRAD_CLIP max_steps=$MAX_STEPS ema=$EMA_DECAY@$EMA_START" +echo "[stage2fm] 产物 = $OUT/ema/ema_step{N}.safetensors(832 键,flowmap=1;采样要给 r,别用 renoise 采样器)" + +# train.log 由 fm_arope.py 自己带时间戳写;这里另存一份 launch.log,收 NCCL / DeepSpeed / traceback 的原始输出 +"$ACC" launch \ + --config_file "$ACC_CFG" \ + --num_processes "$DISTILL_NPROC" --main_process_port "$PORT" \ + "$HERE/fm_arope.py" "${ARGS[@]}" "$@" 2>&1 | tee -a "$OUT/launch.log" diff --git a/backup_2026-09-14/code/distill/stage3_dmd/config.json b/backup_2026-09-14/code/distill/stage3_dmd/config.json new file mode 100644 index 0000000000000000000000000000000000000000..3b054afeb2ebc09b934a633e03bc9fa19dfbbd37 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage3_dmd/config.json @@ -0,0 +1,115 @@ +{ + "_note": "stage3(self-forcing DMD)真正在用的配方常量。这三处必须逐项相同:本文件 / run.sh 的默认值 / dmd_arope.py 的 argparse 默认值 —— 上游 WorldMind 的 run.sh 与 argparse 有六处不一致(lr 5e-6 / critic_steps 4 / dmd_score_frames 26 / grad_horizon 14 / rollout_max 100 / reanchor_every 16),每一处都对应一次已知的崩溃(PORT_SPEC risk 11)。改配方就同时改这三处。", + "_not_this_file": "跑起来之后 /config.json 是那一次 run 的完整快照(含 preflight 结果 / 采样网格 / 数据集统计 / 环境),由 runlib.save_config 写;本文件只是签进仓库的配方记录。", + "_launch": "STUDENT= bash distill/stage3_dmd/run.sh", + "stage": "stage3_dmd", + "script": "distill/stage3_dmd/dmd_arope.py", + "student_ckpt": "outputs/distill/stage2_cd/ema/ema_step8000.safetensors", + "_student_ckpt": "生成器初值 = stage2 的 **EMA**。dits/ 只为续训存在,拿它上线是静默降质(risk 12);argparse 与 run.sh 都会拦住带 /dits/ 的路径", + "teacher_ckpt": "outputs/arope_10k_ga2/step-10000.safetensors", + "_teacher_ckpt": "real-score 教师 **和** critic 初值都用这份**双向** SFT。绝不是 stage1 的因果 ckpt:stage2 要轨迹匹配所以教师必须因果,stage3 只要终态分布匹配,用更强的双向模型。搞反了照样能训、loss 照样降", + "output": "outputs/distill/stage3_dmd", + "product": "ema/ema_step{N}.safetensors —— **逐个里程碑挑**(上游两条 v3 线都是从 450–600 步里挑了 ema_step400),不是拿最后一步;用 distill/eval/rollout_eval.py 在 4 步部署表上量背景位移来挑", + "train_dir": "data/latent/train_eybx", + "val_dir": "data/latent/val_eybx", + "_val_dir": "stage3 没有验证 loss(min-max 目标的 loss 不是质量指标),val_dir 只用来把验证集 clip 从训练集里排掉", + "sidecar": "data/latent/arope_sidecar.pt", + "text_table": "data/latent/text_table_actionrope.pt", + "text_mode": "scene", + "scene_dropout": 0.0, + "_scene_dropout": "0:rollout 要按真实场景条件走。cfg>1 时的 uncond 分支单独从文本表取 NULL_PROMPT", + "min_rt_ratio": 0.8, + "denoise_list": "1000,750,500,250", + "_denoise_list": "用户拍板的 4 步部署表。stage2 的 CD 轴、stage3 的 rollout、部署推理必须是同一张表。落到 1000 点网格上是 t=[1000.0, 750.0, 500.6, 251.6] / sigma=[1.0, 0.75, 0.5006, 0.2516](网格在 t 轴上不等距,250→251.6 是正常的最近点)", + "real_guidance_scale": 1.0, + "_real_guidance_scale": "1.0 ⇒ u + 1.0*(c−u) ≡ c,直接跳过 uncond 前向、省一半教师算力。ActionRoPE 有 --scene_dropout 训练,NULL_PROMPT 分支在分布内,所以 >1 是合法的可调项(上游的教师没有文本 dropout,那边 3.0 会放大近零残差成伪影)", + "kv_window": 20, + "sink_size": 0, + "rope_cap": 20, + "sink_anchor": "absolute", + "_sink_anchor": "sink_size>0 时世界坐标锚在哪。absolute = cell 0(sink 段留真实世界坐标,当前 cell 的 h/w RoPE 位随行走无界增长,k=40 约 1.8× 包络,审计 GEO-1);window = 滑动窗最老 cell(与 sink 0 同口径,RoPE 不出包络),sink 段偏移钉 0:内容照样可见(外观锚点),只放弃它的空间对齐。sink_size=0 时两者逐位相同。要试 sink 3 / w17 / cap 20 的部署几何,配 window。", + "_geometry": "硬不变量 rope_cap == sink_size + kv_window == F−1 == 20。sink=0 是相对上游(sink=3)的**重新设计**而不是改名:ARoPE 的 h/w RoPE 位是一直在漂的世界坐标(22781 条 clip 实测 21 cell 内最大位移 373.0 px = 11.66 token = 23.31 latent 格),被永久钉住的 sink 帧在几十个 cell 之后会落在训练分布之外。取而代之的是窗口锚定坐标:tpos_j = j − a、off_win_j = offset[j] − offset[a],a = max(0, k − kv_window)(risk 3,由 tests/test_world_rope_window.py 的 a1/a3/c2 把关)。★ 这套机制**只**解决 RoPE 坐标 OOD:重锚定对注意力分数精确(a1/a3)、查询 cell 的掩码精确(d1);缓存 cell 的掩码通道按各自提交时的锚点固化,k>20 的历史与锚在 k−20 的 clip 并不逐位相同 —— stage2→stage3 输入移位,自强迫训练穿过(GEO-2)。它对 latent **值**离流形(全局变暗/色偏)没有任何作用,见 _reanchor_every / _scored_tail(DMD-1)", + "rollout_min": 21, + "rollout_max": 27, + "_rollout": "N 每步 rank 同步地抽一次。下界必须 ≥ F=21:驱逐在 n_cached > sink+kv_window = 20 之后才发生,N=20 时它只在最后一次提交触发、之后再也没被读过 —— 那条 rollout 练到的后驱逐读取是 0 次", + "offset_extend": "resample", + "offset_chunk_cells": 5, + "_offset_extend": "cell ≥ 21 的世界偏移每 5 个 cell 重抽一次方向×步速(与 infer.py::parse_actions 同构)。continue 外推最后一段速度:512 条真实 clip 延到 N=30 时锚定窗口跨度 1.24× 包络、越界 1.2%,resample 是 1.006× / 0.2%。偏移不能像文本那样'保持'——保持住的偏移意思是'玩家停下了',那是另一个动作,不是中性动作", + "context_extend": "hold", + "_context_extend": "cell ≥ 21 的文本保持最后一条已写好的 cell 文本及其 id。ARoPE 的 prompt 已被 strip_action 剥成纯场景,rollout 又不换场景,所以保持是语义正确的。文本'保持'而偏移'继续走',两者策略不同是有意的", + "reanchor_every": 0, + "_reanchor_every": "只接受 0(上游 v5 配方本来就把 VAE 重锚关了)。★ 但要说准(DMD-1):sink=0 + 窗口锚定坐标**只**解决 RoPE 坐标 OOD,不是抗 latent 漂移机制。打分尾巴的 t=0 锚点是学生**生成**的 cell(a = N−20 ∈ [1,7]),端口同时去掉了上游的真 frame0 sink 与 VAE 重锚 ⇒ rollout 里没有任何流形上参考。对整窗的全局外观变换 g(亮度/色偏):教师与 critic 都以 g·x_a 为条件 ⇒ pred_fake − pred_real ≈ 0 ⇒ DMD 目标对 g **零梯度**,dmd 带 / critic / gnorm 全都看不到;上游的真 frame0 把 g 钉在恒等。目标只惩罚窗内相对漂移**率**,对锚点携带的累积偏移无恢复力。所以 (1) eval/sweep_photodrift.sh(41 cell 逐 cell std/mean vs stage2 基线,**按训练几何 sink 0 / w20 跑**)是 stage3 冒烟与 EMA 里程碑挑选的**必做门**;(2) 一旦出现整窗恒定变暗/偏移,后备是 --tail_reanchor vae(尚未实现:只对 tail 锚 cell a 做上游 dmd_gm.py:171-178 的 decode→末像素帧→encode,detach,不动学生缓存),不是重开 --reanchor_every", + "dmd_score_frames": 20, + "grad_horizon": 20, + "_score_and_horizon": "★ 8/8 是**首launch的指令值**,不是显存所迫。本机实测(GPU 0、真实 5B、bf16、latent 30×52 ⇒ 390 token/cell、30 层、kv_window 20,全程只用 CUDA_VISIBLE_DEVICES=0 且用 set_per_process_memory_fraction 把自己硬顶在 37.7 GiB): streamed 路径的峰值几乎不随 K/horizon 变 —— 每卡 ≈ 静态 51.2 + KV 缓存 2.72 + 打分 (teacher no_grad 0.77@9cell / 1.69@21cell) + critic 带梯度检查点 (1.41@9cell / 3.69@21cell) + **1** 帧图 6.46 = 约 62 GiB(K=8) / 66 GiB(K=20),140 GiB 的卡上一半都不到。**平价值是 20**:连续 scored tail 取 1+20 = 21 个 cell,正好等于教师/critic 训练时的 F=21;K=8 时教师看到的是 9 个 cell 的片子,比它 SFT 时短。跑一次 PROFILE_MEM=1 的 20 步冒烟确认实测峰值,就该开到 SCORE_FRAMES=20 GRAD_HORIZON=20。约束:grad_horizon ≤ dmd_score_frames,否则梯度窗口跑出打分区、loss 恒 0 还不报错", + "scored_tail": "generated[:, :, N−K : N+1],**连续** 1+K 个 cell,世界坐标锚回 tail 自己的 cell 0", + "_scored_tail": "不是上游的缝合片 cat([真 cell0, 尾巴]):那个片子时间上不连续,在 ARoPE 下**几何上**也不连续(cell 0 在世界原点、尾巴在几百 px 之外),上游的 diag_pull.py 就是因为怀疑它是残余变暗的成因才存在的(risk 10)。--frankenstein 1 保留它只为对照。★ 代价(DMD-1):连续尾巴的 t=0 锚点 cell a = N−20 ∈ [1,7] 是**生成**的,不加噪、不打分、detach —— 教师在其 cell-0 支撑(真 VAE latent)之外被查询,且锚点携带的全局外观偏移对 DMD 目标不可见(见 _reanchor_every)。frankenstein 变暗只是上游 diag_pull.py 的'假设 B'、没有结果,本设计的前提未经验证:用 sweep_photodrift.sh 量,不要靠 loss", + "grad_start": "tail_start + 1 = N − K + 1(K=20 时就是 N−19)", + "_grad_start": "tail 的 cell 0 是一个**生成**的 cell、被当干净锚点用(不加噪、t=0、不打分),所以梯度窗口从它的下一格开始。照抄上游的 lo = tail_start 会把一个 detach 的 cell 放进 eval_idx、同时把最后一个生成 cell 挤出梯度窗口,而 eval_idx 长度不变,什么都不会报错", + "eval_idx": "torch.nonzero(grad_mask_t) 且 ≥ 1;normalizer / surrogate / critic loss **都**用它索引", + "_eval_idx": "不是硬写的 [:, :, 1:]。两者只在 grad_horizon == dmd_score_frames == 20 时才重合;horizon 8 的配置下 normalizer 会在比打分区更多的帧上归约,DMD 梯度的整体缩放悄悄变了(对抗评审 [MINOR])", + "grad_pass": "streamed", + "_grad_pass": "rollout 完全不建图,之后每个 grad 帧单独重做 + backward。**同一个梯度**:缓存提交全在 no_grad 下(帧与帧之间本来就没有梯度,20 帧是 20 个独立单帧图而不是 20 层深的链),surrogate 又是 mean reduction(第 j 帧的份额正好是 1/len(eval_idx))。本机实测(GPU 0、真实 5B、bf16、latent 30×52 ⇒ 390 token/cell、30 层、kv_window 20,全程只用 CUDA_VISIBLE_DEVICES=0 且用 set_per_process_memory_fraction 把自己硬顶在 37.7 GiB): fused 每多保留一帧的图 = 6.46 GiB(h=1/2/3 实测 6.46/12.92/19.38 GiB,严格线性;贵在窗口锚定的 complex128 重 RoPE 要对 20×390 个 cached key 逐层做),所以 fused h=8 要 111 GiB/卡(79%)、h=20 要 189 GiB = 必 OOM。上游 GraphGWM 的 36.1/77.8 GB 是**另一个模型/分辨率**的数字,在这里偏小 ~1.7×,不要拿来外推。dmd_arope._budget_gate 会在读 4×10 GB 底模之前把跑不下的配置拦掉。**绝不能**用 torch.utils.checkpoint 代替 streamed:滑窗 commit 是破坏性的,缓存满了以后重算读到的是驱逐后的缓存,形状对、内容错、不报错(risk 6)", + "exit_step": "每条 rollout 随机抽一个(4 步表 ⇒ 0..3);去噪循环走到它就 break", + "_exit_step": "中间档的重新加噪用 detach 过的 x0,梯度只穿过这唯一一次退出前向。跑完整张表再在最后一步取梯度是另一个估计量(1 步区从来练不到、梯度图翻倍),而且照样会训出一条像模像样的 loss 曲线", + "commit_timestep": 0.0, + "_commit_timestep": "提交趟恒定 t=0,作用在 **detach 过的 x0** 上,每个 frame_index 恰好一次。这个 0 是承重的:它让缓存里的历史与 stage2 teacher-forcing 时的 clean 半流(ts_clean ≡ 0)同分布,而那是这个 TF 学生唯一见过的历史条件。按退出档的 t 提交 = 给历史 K/V 错误的时间调制,OOD 且无任何报错。append-only ⇒ 同一个 frame_index 提交两次会把这帧塞进缓存两遍", + "first_frame_cond_streaming": false, + "_first_frame_cond_streaming": "流式路径必须 False。_per_token_timestep 抹的是「这个张量的第 0 帧」,单 cell 前向里 f==1、那就是全部 —— True 会把 rollout 每一个 cell 的时间步都抹成 0(arope_dit.forward 已硬断言)", + "dmd_timestep_clamp": [ + 20, + 980 + ], + "_dmd_timestep_clamp": "DMD 打分抽的**下标**区间 [lo, hi),= 上游硬编码的 [0.02,0.98]·1000(提成了 flag,默认就是平价)", + "critic_steps": 5, + "_critic_steps": "= CF++ 的 dfake_gen_update_ratio。1:1 会让 fake-score 永远追不上移动中的学生 ⇒ DMD 梯度带均值回复偏置 ⇒ 糊 + loss 平。生成器必须**每步**都更新(FSDP:一次没有紧跟学生 backward 的学生 rollout 会让下一个生成器步拿到 0 梯度),所以领先量只能来自同一份 detach 样本上的内层 critic 步", + "optimizer": "AdamW", + "lr": 2e-06, + "lr_critic": 1e-06, + "_lr": "上游 argparse 的 5e-6 正是已知的高 lr min-max 崩溃:前 ~100 步又亮又有结构,然后 100–150 步之间突然变暗。2e-6 + 部署 EMA 才是稳的那条", + "weight_decay": 0.01, + "adam_betas": [ + 0.0, + 0.999 + ], + "_adam_betas": "beta1 = 0(无动量)是 CF 对非平稳 fake-score 目标的约定,不是笔误,别'修'", + "warmup": 100, + "lr_schedule": "线性 warmup 100 步后恒定 —— 每个 save_every 边界都是合法的停止点", + "grad_clip": 10.0, + "_grad_clip": "生成器与 critic 同值(WorldMind max_grad_norm_generator / _critic 都是 10.0)。裁剪走本地 _clip():accel.clip_grad_norm_ 在 >1 个 FSDP 模型时会崩(它的匹配器用张量 ==)", + "opt8bit": 0, + "_opt8bit": "只接受 0:本机 .venv 没装 bitsandbytes。代价说清楚 —— 上游所有显存/吞吐数字都是在 opt8bit=1 下量的,fp32 AdamW 的 m+v 是 40 GB/模型 vs 8bit 的 ~10 GB,4 卡分片后 stage3 静态从 ~30 GB 变成 55 GB", + "gradient_checkpointing": true, + "_gradient_checkpointing": "只作用在 critic 的**反向**前向上。本机实测(GPU 0、真实 5B、bf16、latent 30×52 ⇒ 390 token/cell、30 层、kv_window 20,全程只用 CUDA_VISIBLE_DEVICES=0 且用 set_per_process_memory_fraction 把自己硬顶在 37.7 GiB): 开着是 1.41 GiB(9 cell) / 3.69 GiB(21 cell) 活化值;**关掉**在 21 cell 上直接 OOM(>18 GiB),所以这个开关是承重的,不是省一点。**绝不会**用到 rollout 上:那条路径 arope_dit.forward 硬断言禁止(risk 6)。student 的模块级开关必须保持 False,否则 rollout 一进去就撞断言", + "batch_size": 1, + "grad_accum": 1, + "world_size": 4, + "_world_size": "processes = DISTILL_NGPU(4 或 8),eff batch = processes(无 GA)", + "eff_batch": 4, + "max_steps": 500, + "num_workers": 2, + "seed": 0, + "use_ema": 1, + "ema_decay": 0.99, + "ema_start": 100, + "_ema": "EMA 是 FSDP 包着的第四个模型(fp32,冻结),按分片 zip 更新 —— 这要求 fsdp_use_orig_params=true 保证 Parameter 的身份/顺序/分片完全一致", + "save_every": 50, + "keep_last_dits": 3, + "keep_last_emas": 25, + "keep_last_critics": 3, + "_keep_last_emas": "25:全部里程碑都要留着挑。上游的 --keep_last_states 默认 2 会把要挑的那些 ema 直接 os.remove 掉", + "log_every": 10, + "profile_mem": 0, + "resume": "auto", + "_resume": "只恢复权重(student←dits/ critic←critic/ ema←ema/ + progress.json 的 step),优化器状态不落盘:FSDP 下 accel.save_state 与 get_state_dict 的组合不可靠,而 500 步的蒸馏重置一次 Adam 状态是可接受的。续训 ≠ 不间断的一次训练", + "accelerate_config": "distill/configs/accelerate_fsdp_dmd_{4,8}gpu.yaml(run.sh 按 DISTILL_NGPU 选;两份只差 num_processes)", + "distributed": "FSDP1 FULL_SHARD, bf16, 进程数 = DISTILL_NGPU(4 或 8)。stage1/2 用 ZeRO-2;stage3 有两个可训模型(student + critic),而 accelerate 的 DeepSpeed 分支只保留传给 prepare 的最后一个 nn.Module(accelerator.py:2229-2236),所以必须换 FSDP", + "fsdp_must": "use_orig_params=true(false ⇒ 优化器 step 过期的 FlatParameter 视图、永远收不到梯度,模型静默地完全不学习);sync_module_states=false + cpu_ram_efficient_loading=false(开了 sync 会让 rank0 一次性实体化全部模型、prepare 阶段 OOM);所有可训模型在 prepare **之前** .float()(bf16 参数 + MixedPrecision(bf16) ⇒ 没有 fp32 主权重,AdamW 原地更新 bf16)", + "models": "student(因果, fp32, FSDP 可训) / critic(双向, fp32, FSDP 可训) / teacher(双向, bf16, 冻结, **不进 prepare**、整份复制 10 GB) / ema(因果, fp32, 冻结, FSDP)", + "gpus": "0-3(DISTILL_NGPU=4)或 0-7(DISTILL_NGPU=8)", + "main_process_port": 29536, + "_budget": "本机实测(GPU 0、真实 5B、bf16、latent 30×52 ⇒ 390 token/cell、30 层、kv_window 20,全程只用 CUDA_VISIBLE_DEVICES=0 且用 set_per_process_memory_fraction 把自己硬顶在 37.7 GiB): 每卡静态 51.2 GiB = student 18.63(fp32 分片参数 4.66 + 梯度 4.66 + AdamW m,v 9.31)+ critic 18.63 + ema 4.66(只有参数)+ teacher 9.31(bf16、不分片、整份复制)。动态:KV 缓存(n_cached=20、30 层)2.72;打分前向 teacher/critic no_grad 0.77(9cell)/1.69(21cell);critic 训练前向带梯度检查点 1.41(9cell)/3.69(21cell);grad 帧图 streamed 恒 1 帧 6.46 / fused h×6.46。⇒ **streamed 峰值 ≈ 62 GiB(K=8) / 66 GiB(K=20) 每卡,对 140 GiB 有 2× 余量,K=20/h=20 装得下**。fused:h=8 111 GiB(79%)、h=20 189 GiB(必 OOM),由 _budget_gate 拦。磁盘 10 次保存 ×(dit+critic+ema)×10 GB,rotate 后 ≈ 160 GB(/data 余 13 TB)。★ 时间实测(同上):单 cell 前向 160 ms(其中窗口锚定的 float64 重 RoPE 约 20 ms = 13%,所以 risk R9 的增量重锚优化**不需要**做);N=26 的整条 no-grad rollout 20.2 s / 126 次前向;整片并行 4 步 21 cell 3.7 s。streamed 还要再走一遍重放,加上打分与 5 次 critic 前向反向 ⇒ 单卡约 36 s/步;4 卡 FSDP 的 all-gather 再加两三成 ⇒ 约 40–60 s/步,500 步 ≈ 6–8 h。上游那个 16.7 s/步是 8 卡 **fused** 路径的数字,不适用。", + "_gate": "开跑前 dmd_arope.py 自己会跑两道闸:(1) preflight_sliding_kv(0,20,20) —— tiny CPU 模型上把 sink/驱逐/锚定算术跑完整一遍;(2) FSDP 的 use_orig_params 断言。第一步还会做一次 probe_student_grad:走真正的 rollout 前向对人为目标 backward,确认梯度真的到得了学生参数 —— 因为 **step 0 的 DMD 梯度必然恰好是 0**(critic 与 teacher 同一份初值 ⇒ pred_fake ≡ pred_real),拿第一步的 gnorm_g 判断接线是判不出来的。(3) **已实现**(S3-GUARD-3):step > resume_step 之后每个生成器步在 opt_g.step() 之前检查 gnorm_g,恰为 0.0 或 NaN 直接 SystemExit —— critic 已走过 critic_steps 步 ⇒ pred_fake ≠ pred_real ⇒ gnorm_g > 0 是硬不变量;inf 不拦(clip 已归零)。(4) 模型侧之外:eval/sweep_photodrift.sh 是 stage3 冒烟与 EMA 里程碑挑选的必做门(DMD-1,见 _reanchor_every)", + "_expected_curve": "dmd 从 ~0 起,随 critic 被拉开升进 +0.15…+0.68 带并在那里晃;critic 先降后随学生移动回升。**单调下降的 dmd 不是目标** —— 这是 min-max 目标。真正的质量判据是 distill/eval/rollout_eval.py 量出来的背景位移误差", + "_measured": "这几条是在本机 GPU 0 上真实量到的(stage1 训练同时在跑,全程只用 CUDA_VISIBLE_DEVICES=0、峰值 < 13 GB):deploy_rollout N=26 输出全部有限、驱逐 5 次、末 cell 读满 20 个缓存 cell;streamed 与 fused 的学生梯度 cos 相似度 1.000000000000(bf16 下相对 max|Δ| 1.4e-9);tiny 四模型 dry run 的 dmd 落在 +0.20…+0.29、critic 从 2.70 降到 1.87 —— 与 PORT_SPEC S7(f) 描述的 +0.15…+0.68 带一致" +} diff --git a/backup_2026-09-14/code/distill/stage3_dmd/dmd_arope.py b/backup_2026-09-14/code/distill/stage3_dmd/dmd_arope.py new file mode 100644 index 0000000000000000000000000000000000000000..3d19ee8b215360e8be5946e3a64747baea7184a9 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage3_dmd/dmd_arope.py @@ -0,0 +1,1333 @@ +#!/usr/bin/env python3 +"""stage3:self-forcing DMD —— 用分布匹配把 stage2 的少步因果学生再抛光一遍。 + + # 4 卡正式训练(配方常量钉在 run.sh 里,argparse 默认值与它逐项相同) + bash distill/stage3_dmd/run.sh + + # 30 秒 dry run(tiny 四模型 + 合成数据,不碰真权重 / 真数据;验 rollout、两个 loss、导出、续训) + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + .venv/bin/python distill/stage3_dmd/dmd_arope.py --dry_run \\ + --output /data/zhiyangdeng/ActionRoPE/distill/_smoke_stage3 + +这一阶段是什么 +------------- +stage2 的 EMA 已经是一个 4 步可用的因果学生,但它是**照着教师的轨迹**学出来的:teacher forcing +喂的永远是真实干净历史。真正部署时它喂给自己的是**自己生成的**历史,误差会一路累积。 +stage3 让学生真的自回归 rollout(self-forcing,滑窗 KV 缓存、逐 cell 提交),再用 DMD +(Distribution Matching Distillation)把 rollout 出来的分布推向双向教师的分布: + + student (因果, FSDP 可训) ← 生成器,从 stage2 的 ema/ema_step{N} 起步 + critic (双向, FSDP 可训) ← fake-score,学「学生自己生成的样本」的流匹配场 + teacher (双向, 冻结 bf16) ← real-score,就是 outputs/arope_10k_ga2/step-10000 + ema (因果, FSDP 冻结) ← **部署权重**(dits/ 只为续训;拿 dits/ 上线是静默降质,risk 12) + +DMD 梯度 = (pred_fake − pred_real) / normalizer,全在 x0 空间、全程 no_grad 算出来, +再套一层 0.5·MSE 的 surrogate 让它落到学生参数上。teacher 与 critic **只**在它们原生的 +双向整片模式下被驱动(没有 clean_x、没有 KV 缓存)——这是本文件的铁律。 + +教师不是 stage1 +-------------- +stage2 要的是轨迹匹配(所以教师必须因果),stage3 只要终态分布匹配,于是用更强的**双向** SFT。 +搞反了照样能训、loss 照样降,只是在对着错的 score 学(PORT_SPEC stage3)。 + +四个必须守住的坑(每一个都不会报错,只会静默训歪) +------------------------------------------------- +1. **提交趟恒定 t=0**。缓存里的历史必须与 stage2 teacher-forcing 时的 **clean 流** 同分布, + 而 TF 的 clean 半流就是 `ts_clean = 0`。按退出档的 t 提交 = 给历史 K/V 错误的时间调制。 +2. **流式路径 first_frame_cond=False**。`_per_token_timestep` 抹的是「这个张量的第 0 帧」, + 单 cell 前向里那就是全部 —— True 会把 rollout 每一个 cell 的时间步都抹成 0。 + (`arope_dit.forward` 已经硬断言,这里只是解释为什么。) +3. **绝不对 rollout 做梯度检查点**。滑窗 commit 是破坏性的:缓存饱和之后重算读到的是驱逐后的 + 缓存,形状对、内容错、不报错(risk 6)。所以 student 的模块级 gc 开关必须保持 False, + critic 的检查点按前向单独传。 +4. **rollout 区的 autocast 必须 cache_enabled=False**。rollout 里绝大多数前向在 no_grad 下跑, + autocast 会把 fp32 权重的 bf16 副本缓存下来(不带 grad_fn),那唯一一次 enable_grad 的 + 退出前向复用它 ⇒ 梯度到不了任何 Linear/Conv(B 实测 15/71 → 71/71)。 + FSDP+bf16 下参数本来就是 bf16、不发生 cast,这个开关是空操作 —— 它保护的是 dry run / + 单卡调试 / DDP 这些 fp32 参数路径。 + +配方来源 +------- +常量全部取自 A 的 `stage3_dmd/run.sh`(**不是** argparse 默认值:上游两者有六处不一致, +每一处都对应一次已知崩溃,risk 11),只有三处按本机与本模型改: + * kv_window 20 / sink 0 / rope_cap 20 —— ARoPE 的 h/w RoPE 位是一直在漂的世界坐标, + 永久 sink 帧几十个 cell 之后会落在训练分布之外;改用窗口锚定坐标(risk 3)。 + * 连续 scored tail `generated[:, :, N−K : N+1]`,不是上游 `cat([真 cell0, 尾巴])` 的 + 缝合片 —— 那个片子在 ARoPE 下连几何都不连续(risk 10;`--frankenstein 1` 留作对照)。 + * `--grad_pass streamed` 默认开 —— 本机实测(真 5B、latent 30×52、kv_window 20)fused 每多保留 + 一帧的图就是 6.46 GiB(h=1/2/3 实测 6.46/12.92/19.38,严格线性),所以 h=8 要 111 GiB/卡、 + h=20 要 189 GiB(必 OOM);streamed 恒定 ~66 GiB。上游 GraphGWM 的 36.1/77.8 GB 是另一个 + 模型/分辨率的数字,在这里偏小 ~1.7×。`_budget_gate` 会在读 4×10 GB 底模之前把跑不下的配置拦掉。 +""" +from __future__ import annotations + +import argparse +import math +import os +import platform +import socket +import sys +import time + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +# 分配器要在 import torch 之前设:launch 时 export 的环境变量到不了 accelerate 拉起的子进程 +os.environ.setdefault("PYTORCH_CUDA_ALLOC_CONF", "expandable_segments:True") + +import torch +import torch.nn.functional as F +from accelerate import Accelerator +from accelerate.utils import DistributedType, set_seed + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.dataset import DEFAULT_SIDECAR, TEXT_TABLES, AropeLatentDataset, arope_collate, load_sidecar # noqa: E402 +from actionrope.prompts import NULL_PROMPT # noqa: E402 +from distill import runlib # noqa: E402 +from distill.arope_dit import MODEL_DIR, AropeDiT, unwrap # noqa: E402 +from distill.data import ( # noqa: E402 + assert_rollout_aligned, + extend_context, + extend_offsets, + make_mask_input, + to_device, + walk_speed_from_sidecar, + window_context, + window_offsets, +) +from distill.ema import ema_update # noqa: E402 +from distill.flow_pf import DMD_TIMESTEP_CLAMP, assert_ti2v, deploy_schedule, ti2v_noise # noqa: E402 +# stage3 生产路径 import 一个 tests/ 里的模块,是 PORT_SPEC 钦定的:滑窗算术(保留哪些 cell、 +# 窗口怎么锚定)与它的自检闸写在同一个文件里,两份实现就一定会分叉。 +from distill.tests.preflight import preflight_sliding_kv, window_offsets_for_frame # noqa: E402 + +CELLS = 21 # 一条 clip 的 latent cell 数(数据集硬契约) +STAGE = "stage3_dmd" + + +# ---------------------------------------------------------------------------- +# 对齐闸:teacher / critic 每次前向之前跑一遍(上游 dmd_gm.py:31-42 的 ActionRoPE 版) +# ---------------------------------------------------------------------------- + +def _assert_native_scoring(latent: torch.Tensor, ts_pf: torch.Tensor, cond: dict) -> None: + """teacher/critic 只能在它们**原生**的双向整片模式下被驱动。这些错都不会报错、只会训歪。""" + b, c, f = latent.shape[:3] + assert c == 48, f"[gate] 需要 channels-first [B,48,F,H,W],得到 {tuple(latent.shape)}" + ctx = cond["context"] + assert ctx.dim() == 4 and tuple(ctx.shape[:2]) == (b, f), \ + f"[gate] 需要逐 cell 文本 [B,{f},L,4096],得到 {tuple(ctx.shape)}" + ids = cond["context_ids"] + assert ids is not None and tuple(ids.shape) == (b, f), \ + f"[gate] context_ids 需要 [B,{f}],得到 {None if ids is None else tuple(ids.shape)}" + off = cond["offset_px"] + assert tuple(off.shape) == (b, f, 2), f"[gate] offset_px 需要 [B,{f},2],得到 {tuple(off.shape)}" + assert bool(torch.all(off[:, 0] == 0)), \ + "[gate] scored tail 的世界坐标必须锚定在 tail 自己的 cell 0(off − off[:, :1])" + mi = cond["mask_input"] + assert mi is None or tuple(mi.shape[:3]) == (b, 1, f), \ + f"[gate] mask_input 需要 [B,1,{f},H,W],得到 {None if mi is None else tuple(mi.shape)}" + assert cond.get("first_frame_cond") is True, \ + "[gate] 整片打分路径必须 first_frame_cond=True(cell 0 是干净锚点)" + assert cond.get("clean_x") is None and cond.get("kv_cache") is None, \ + "[gate] teacher/critic 绝不走 teacher forcing / KV 缓存 —— 那是学生的路径" + assert ts_pf.shape == (b, f), f"[gate] ts_pf 需要 [B,{f}],得到 {tuple(ts_pf.shape)}" + + +# ---------------------------------------------------------------------------- +# rollout 的逐 cell 条件 +# ---------------------------------------------------------------------------- + +def frame_cond(off_ext: torch.Tensor, k: int, sink_size: int, kv_window, lat_h: int, lat_w: int, + sink_anchor: str = "absolute"): + """cell k 的两路空间条件:窗口锚定的 offset_win 和由它现算的 known 掩码。 + + offset_win [b, n_cached+1, 2]:缓存里还留着的那几个 cell + 当前 cell,整体减掉列表里 + 最老那一格(于是 [:,0] == 0)。RoPE 是相对编码,整窗平移不改分数,所以 RoPE 重锚定是**精确**的 + (tests/test_world_rope_window.py 的 a1/a3),查询 cell 的掩码也精确(d1)。但这段窗口**不是** + 逐位等于一条锚在 k−20 的训练 clip:缓存里各 cell 的 known 掩码通道是按**各自提交时**的锚点 + a_j = max(0, j−20) < a 固化进 K/V 的,k>20 之后的历史与那条 clip 不同 —— 这是 stage2→stage3 + 的输入移位,自强迫训练穿过它(GEO-2)。 + mask_in_k [b,1,1,h,w] 只能是**当前 cell** 那一格:传整窗的话 patch_embedding 的 + [b,dim,1,h,w] 会与 [b,dim,n+1,h,w] 广播成 n+1 帧。 + """ + ow = window_offsets_for_frame(off_ext, k, sink_size, kv_window, sink_anchor=sink_anchor) + mk = make_mask_input(ow[:, -1:], lat_h, lat_w) + return ow, mk + + +# ---------------------------------------------------------------------------- +# self-forcing rollout +# ---------------------------------------------------------------------------- + +def self_forcing_rollout(student, initial_latent: torch.Tensor, ctx_ext: torch.Tensor, + ids_ext: torch.Tensor, off_ext: torch.Tensor, num_gen_cells: int, + deploy: tuple, grad_horizon: int, *, + kv_window: int = 20, rope_cap: int = 20, sink_size: int = 0, + score_last_k: int | None = None, gen: torch.Generator | None = None, + record: dict | None = None, grad_start: int | None = None, + exit_step: int | None = None, sink_anchor: str = "absolute"): + """学生用自己提交的历史自回归生成 num_gen_cells 个 cell(self-forcing)。 + + initial_latent [b,48,1,h,w] 真实首帧 latent(clip 的 cell 0) + ctx_ext/ids_ext [b,1+N,L,4096] / [b,1+N],逐 cell 文本(cell k 用 [:,k]) + off_ext [b,1+N,2] px,**绝对**世界坐标;窗口锚定在每个 cell 现算 + deploy (idx, sigma, t_grid) —— flow_pf.deploy_schedule 的返回值, + t_grid 是 1000 点网格上的实际 t,sigma 与它严格一一对应 + grad_start / exit_step 调用方给的**同步过**的抽签结果(None ⇒ 本地抽,仅 smoke 用) + record 非 None ⇒ 全程 no_grad、不建任何图,只把 stream_grad_replay + 要重放的东西记下来(每帧提交的 latent、每个 grad 帧的退出输入) + + 返回 (generated [b,48,1+N,h,w],grad_mask [1+N] bool)。 + """ + b, c, _, lat_h, lat_w = initial_latent.shape + dev = initial_latent.device + total = 1 + num_gen_cells + _, sig_dep, t_dep = deploy + nsteps = len(t_dep) + assert_rollout_aligned(off_ext, ctx_ext, ids_ext, num_gen_cells) + + # init_kv_cache 在**裸模块**上调(FSDP 只包 forward,不包自定义方法) + bare = unwrap(student) + cache = bare.init_kv_cache(kv_window=kv_window, sink_size=sink_size, rope_cap=rope_cap) + + def _call(x, t, k, commit, ow, mk): + # 必须走 forward(..., kv_cache=):FSDP 的参数 all-gather 挂在包装模块的 forward 上, + # 直接调 forward_frame 拿到的是分片(risk 2)。first_frame_cond=False 见文件头坑 2。 + return student(x, t, ctx_ext[:, k:k + 1], context_ids=ids_ext[:, k:k + 1], + first_frame_cond=False, frame_index=k, kv_cache=cache, commit=commit, + offset_win=ow, mask_in_k=mk) + + # ---- cell 0:真实干净首帧,t=0 提交进缓存 ---- + ow0, mk0 = frame_cond(off_ext, 0, sink_size, kv_window, lat_h, lat_w, sink_anchor) + with torch.no_grad(): + _call(initial_latent, torch.zeros(b, device=dev), 0, True, ow0, mk0) + frame_list = [initial_latent[:, :, 0:1].detach()] + + # ---- grad 窗口:钉进 scored tail(否则 eval_idx ∩ grad_mask 为空 ⇒ loss 恒 0 且不报错)---- + if grad_start is None: + grad_start = draw_grad_start(total, grad_horizon, score_last_k, gen=gen) + grad_end = min(grad_start + grad_horizon, total) + # 每条 rollout 抽**一个**退出档(CF 的 same_step_across_blocks):去噪循环走到它就 break, + # 中间的重新加噪用 detach 过的 x0,梯度只穿过这一次退出前向。 + if exit_step is None: + exit_step = int(torch.randint(0, nsteps, (1,), generator=gen).item()) + exit_step = int(exit_step) % nsteps + + for k in range(1, total): + ow, mk = frame_cond(off_ext, k, sink_size, kv_window, lat_h, lat_w, sink_anchor) + noisy = torch.randn(b, c, 1, lat_h, lat_w, device=dev, + dtype=initial_latent.dtype, generator=gen) + in_window = grad_start <= k < grad_end + den = None + for si in range(nsteps): + is_exit = (si == exit_step) + # record 非 None ⇒ 这一趟不建图,grad 帧留给 stream_grad_replay 一帧一帧重做 + grad_on = in_window and is_exit and record is None + if in_window and is_exit and record is not None: + record["exit"][k] = (noisy.detach().clone(), si) + ts_k = torch.full((b,), float(t_dep[si]), device=dev) + with (torch.enable_grad() if grad_on else torch.no_grad()): + v = _call(noisy, ts_k, k, False, ow, mk) + den = noisy - float(sig_dep[si]) * v # x0 估计 + if is_exit: + break + ns = float(sig_dep[si + 1]) # x0 → 下一档,重新加噪(detach) + noisy = (1.0 - ns) * den.detach() + ns * torch.randn_like(den) + frame_list.append(den) # in_window 且 record is None 时带梯度 + # ---- 提交趟:**detach 过的 x0** + **t=0**,每个 frame_index 恰好一次(文件头坑 1)---- + with torch.no_grad(): + commit_lat = den.detach() + if record is not None: + record["commit"][k] = commit_lat + _call(commit_lat, torch.zeros(b, device=dev), k, True, ow, mk) + + generated = torch.cat(frame_list, dim=2) # [b,48,1+N,h,w] + grad_mask = torch.tensor([grad_start <= k < grad_end for k in range(total)], device=dev) + bare.release_kv_cache(cache) # cache 与 _ref 成环,不显式清会拖着十几 GB 不放(arope_dit 同名方法) + if record is not None: + record.update(total=total, grad_start=grad_start, grad_end=grad_end, exit_step=exit_step) + return generated, grad_mask + + +def grad_start_range(total: int, grad_horizon: int, score_last_k: int | None) -> tuple[int, int]: + """grad 窗口起点的合法闭区间 [lo, hi]。 + + 连续 tail 是 `generated[:, :, tail_start : total]`,长度 1+K,tail 的 cell 0 + (绝对下标 tail_start)是**不打分**的干净锚点,所以 lo 从 tail_start+1 起 + —— 对抗评审 [MINOR]:上游写的 `lo = tail_start` 在这里会把一个 detach 的 cell 放进 + eval_idx、同时把最后一个生成 cell 挤出梯度窗口,而 eval_idx 长度不变,什么都不会报错。 + grad_horizon == K 时 lo == hi,窗口就正好是整条 scored tail(这是配方里的情形)。 + """ + if score_last_k is None: + return 1, max(1, total - grad_horizon) + tail_start = max(0, total - 1 - score_last_k) + lo = tail_start + 1 + return lo, max(lo, total - grad_horizon) + + +def draw_grad_start(total: int, grad_horizon: int, score_last_k: int | None, + gen: torch.Generator | None = None) -> int: + """在 grad_start_range 里抽一个。训练主循环走的是 main() 里那条**定长**的同步抽签, + 这个函数只服务于 self_forcing_rollout 的本地兜底(smoke / 单测)。""" + lo, hi = grad_start_range(total, grad_horizon, score_last_k) + return int(torch.randint(lo, hi + 1, (1,), generator=gen).item()) + + +def stream_grad_replay(student, initial_latent: torch.Tensor, ctx_ext: torch.Tensor, + ids_ext: torch.Tensor, off_ext: torch.Tensor, record: dict, + deploy: tuple, frame_target, backward, *, + kv_window: int = 20, rope_cap: int = 20, sink_size: int = 0, + sink_anchor: str = "absolute") -> float: + """把带梯度的那几个 cell **一帧一帧**重做,每帧算完立刻 backward 再丢掉图。 + + 为什么要有它。grad_horizon=20 时 fused 路径同时挂着 20 帧的图:单卡实测活化值 + 36.1 GB(horizon 8)/ 77.8 GB(horizon 20),4 卡上加 55 GB 静态就没有余量了。 + + 为什么它是**精确**的而不是近似。两条性质: + 1. rollout 里每一次缓存提交都在 no_grad 下,梯度从不跨帧 —— grad_horizon 帧不是 + 一条 20 层深的链,而是 20 个碰巧同时活着的**独立**单帧图。 + 2. DMD 的 surrogate 是 `0.5*F.mse_loss(g, t)`,t 完全 detach、reduction=mean 摊到 + 每一个元素,所以第 j 帧的份额正好是 `0.5*mse(g_j, t_j) / len(eval_idx)`,逐帧相加 + 等于一次性 backward(差别只有 bf16 的求和顺序)。 + + 为什么不能用 torch.utils.checkpoint。滑窗 KV 是破坏性的:重算时缓存里已经不是前向时 + 那几帧了。缓存没满时会抛 metadata 不一致,**满了之后形状对、内容错、完全不报错**。 + + 重放靠按原顺序重新提交 `record["commit"]` 里那批**同一个**张量来重建缓存,所以到第 k 帧 + 时缓存状态与第一趟逐位相同,退出前向看到的历史也就与第一趟逐位相同。 + + frame_target(k) -> 该 cell 的 surrogate 目标 [b,48,1,h,w],None 表示这帧不打分。 + backward(loss) -> 每个 grad 帧调一次(accel.backward)。返回累加的 loss 值(只为打日志)。 + """ + b, _, _, lat_h, lat_w = initial_latent.shape + dev = initial_latent.device + _, sig_dep, t_dep = deploy + bare = unwrap(student) + cache = bare.init_kv_cache(kv_window=kv_window, sink_size=sink_size, rope_cap=rope_cap) + + def _call(x, t, k, commit, ow, mk): + return student(x, t, ctx_ext[:, k:k + 1], context_ids=ids_ext[:, k:k + 1], + first_frame_cond=False, frame_index=k, kv_cache=cache, commit=commit, + offset_win=ow, mask_in_k=mk) + + ow0, mk0 = frame_cond(off_ext, 0, sink_size, kv_window, lat_h, lat_w, sink_anchor) + with torch.no_grad(): + _call(initial_latent, torch.zeros(b, device=dev), 0, True, ow0, mk0) + + n_eval = max(1, int(record["n_eval"])) + total_loss = 0.0 + for k in range(1, record["total"]): + ow, mk = frame_cond(off_ext, k, sink_size, kv_window, lat_h, lat_w, sink_anchor) + if k in record["exit"]: + tgt = frame_target(k) + if tgt is not None: + noisy, si = record["exit"][k] + ts_k = torch.full((b,), float(t_dep[si]), device=dev) + with torch.enable_grad(): + v = _call(noisy, ts_k, k, False, ow, mk) + den = noisy - float(sig_dep[si]) * v + loss_k = 0.5 * F.mse_loss(den.float(), tgt.float()) / n_eval + backward(loss_k) + total_loss += float(loss_k.detach()) + del v, den, loss_k # 这一帧的图立刻还给分配器 + with torch.no_grad(): # 严格按第一趟的顺序重建缓存 + _call(record["commit"][k], torch.zeros(b, device=dev), k, True, ow, mk) + # ★ 与 self_forcing_rollout 同一条规矩:cache 与它内部的 _ref 互相引用,引用计数放不掉环。 + # 这里每个训练步建一份(默认 --grad_pass streamed),不显式清就是每步泄漏一份整条 + # rollout 的 K/V(本文件自标 GIB_KV_CACHE=2.72 GiB),而 _budget_gate 是按「峰值恒定」算的。 + bare.release_kv_cache(cache) + return total_loss + + +# ---------------------------------------------------------------------------- +# DMD 生成器 loss(分布匹配) +# ---------------------------------------------------------------------------- + +def dmd_targets(teacher, critic, generated: torch.Tensor, cond_t: dict, grad_mask: torch.Tensor, + *, real_guidance_scale: float = 1.0, uncond_context=None, uncond_ids=None, + clamp=DMD_TIMESTEP_CLAMP, gen: torch.Generator | None = None): + """dmd_generator_loss 里**全部 no_grad** 的那一半:给(detach 过的)片子打分、造 surrogate 目标。 + + 拆出来是为了 streamed 路径能先把目标算完、再逐帧形成 surrogate —— 因为 target 本来就是 + detach 的、mse 又是 mean reduction,逐帧拆分是同一份计算而不是近似。 + 返回 (target, eval_idx, log)。 + """ + b, _, f = generated.shape[:3] + eval_idx = torch.nonzero(grad_mask, as_tuple=False).flatten() + eval_idx = eval_idx[eval_idx >= 1] # cell 0 是干净锚点,永不打分 + assert eval_idx.numel() > 0, \ + "eval_idx 为空:grad 窗口落在 scored tail 之外了,loss 会恒等于 0 且不报错" + with torch.no_grad(): + clip = generated.detach() + noisy, ts_pf, sigma, _ = ti2v_noise(clip, clamp=clamp, gen=gen) + assert_ti2v(noisy, clip, ts_pf) + _assert_native_scoring(clip, ts_pf, cond_t) + sig = sigma.view(b, 1, 1, 1, 1) + # real-score。cfg==1.0 时 u + 1.0*(c−u) ≡ c,直接走 cond-only 把那次前向整个省掉。 + x0_real_c = noisy - sig * teacher(noisy, ts_pf, **cond_t) + if abs(real_guidance_scale - 1.0) < 1e-6: + pred_real = x0_real_c + else: + cond_u = dict(cond_t, context=uncond_context, context_ids=uncond_ids) + x0_real_u = noisy - sig * teacher(noisy, ts_pf, **cond_u) + pred_real = x0_real_u + real_guidance_scale * (x0_real_c - x0_real_u) + pred_fake = noisy - sig * critic(noisy, ts_pf, **cond_t) # fake-score + raw_grad = pred_fake - pred_real # x0 空间的 DMD 梯度 + p_real = clip - pred_real + # normalizer 只在 **eval_idx** 上归约(不是硬写的 [:, :, 1:]):两者只有在 + # grad_horizon == dmd_score_frames 时才重合,horizon 8 的省显存配置下就会分叉, + # 而分叉的后果只是 DMD 梯度整体缩放悄悄变了(对抗评审 [MINOR])。 + normalizer = p_real[:, :, eval_idx].abs().mean(dim=[1, 2, 3, 4], keepdim=True).clamp(min=1e-2) + grad = torch.nan_to_num(raw_grad / normalizer) + target = (generated - grad).detach() + log = {"dmd_gnorm": float(grad[:, :, eval_idx].norm()), + "dmd_t": float(ts_pf[:, 1].mean()), + "dmd_norm": float(normalizer.mean())} + return target, eval_idx, log + + +def dmd_generator_loss(teacher, critic, generated: torch.Tensor, cond_t: dict, + grad_mask: torch.Tensor, **kw): + """fused 路径:目标算完当场形成 surrogate。`d loss / d generated == grad`(只在 grad 窗口上)。""" + target, eval_idx, log = dmd_targets(teacher, critic, generated, cond_t, grad_mask, **kw) + g = generated[:, :, eval_idx].float() + t = target[:, :, eval_idx].float() + return 0.5 * F.mse_loss(g, t), log + + +# ---------------------------------------------------------------------------- +# critic loss(fake-score 学学生自己的分布) +# ---------------------------------------------------------------------------- + +def critic_loss(critic, generated: torch.Tensor, cond_t: dict, eval_idx: torch.Tensor, *, + clamp=DMD_TIMESTEP_CLAMP, gen: torch.Generator | None = None, + use_gradient_checkpointing: bool = True): + """critic 在**学生自己生成的(detach 过的)**样本上做普通流匹配,这样它的 score 才是 + fake 分布的合法 score。目标是 v = ε − x0(x0 就是生成片),不加任何时间步权重。 + + 打分下标用 eval_idx 而不是硬写的 [:, :, 1:]:DMD 只在 eval_idx 上用 pred_fake, + critic 也就只需要在那里准;两者用同一套下标,horizon != score_frames 时才不会错位。 + """ + clip = generated.detach() + noisy, ts_pf, _, noise = ti2v_noise(clip, clamp=clamp, gen=gen) + assert_ti2v(noisy, clip, ts_pf) + _assert_native_scoring(clip, ts_pf, cond_t) + v_fake = critic(noisy, ts_pf, use_gradient_checkpointing=use_gradient_checkpointing, **cond_t) + target = noise - clip + loss = F.mse_loss(v_fake[:, :, eval_idx].float(), target[:, :, eval_idx].float()) + return loss, {"critic": float(loss.detach())} + + +# ---------------------------------------------------------------------------- +# scored tail +# ---------------------------------------------------------------------------- + +def score_tail(generated: torch.Tensor, grad_mask: torch.Tensor, off_ext: torch.Tensor, + ctx_ext: torch.Tensor, ids_ext: torch.Tensor, N: int, Keff: int | None, *, + lat_h: int, lat_w: int, frankenstein: bool = False): + """只给 teacher/critic 看最后 1+Keff 个 **连续** cell,并把世界坐标锚回 tail 自己的 cell 0。 + + 整条 rollout 照样端到端跑完(驱逐真的被练到了),这里切的只是 loss 的输入。 + tail 的 cell 0 是一个**生成**的 cell,被当干净锚点用(不加噪、t=0、不打分)—— + 这正是 self-forcing 想让学生满足的条件。 + + frankenstein=True 复现上游的缝合片 `cat([真 cell0, 尾巴])`:时间上不连续,在 ARoPE 下 + **几何上**也不连续(cell 0 在世界原点、尾巴在几百 px 之外),只留作对照(risk 10)。 + 返回 (tail_sl, cond_t, grad_mask_t, tail_to_frame)。 + """ + total = 1 + N + if Keff is None or Keff >= N: + tail_sl, grad_mask_t = generated, grad_mask + off_t = window_offsets(off_ext, 0, N) + ctx_t, ids_t = window_context(ctx_ext, ids_ext, 0, N) + tail_to_frame = list(range(total)) + elif frankenstein: + a = total - Keff # 尾巴的第一个绝对下标 + tail_sl = torch.cat([generated[:, :, :1], generated[:, :, a:]], dim=2) + off_t = torch.cat([off_ext[:, :1], off_ext[:, a:]], dim=1) - off_ext[:, :1] + ctx_t = torch.cat([ctx_ext[:, :1], ctx_ext[:, a:]], dim=1) + ids_t = torch.cat([ids_ext[:, :1], ids_ext[:, a:]], dim=1) + grad_mask_t = torch.cat([grad_mask[:1], grad_mask[a:]]) + tail_to_frame = [0] + list(range(a, total)) + else: + a = total - 1 - Keff # 连续 tail 的第一个绝对下标 + tail_sl = generated[:, :, a:] + off_t = window_offsets(off_ext, a, N) + ctx_t, ids_t = window_context(ctx_ext, ids_ext, a, N) + grad_mask_t = grad_mask[a:] + tail_to_frame = list(range(a, total)) + assert not bool(grad_mask_t[0]), "tail 的 cell 0 是干净锚点,不能落在梯度窗口里" + cond_t = dict(context=ctx_t, context_ids=ids_t, offset_px=off_t, + mask_input=make_mask_input(off_t, lat_h, lat_w), first_frame_cond=True) + assert tail_sl.shape[2] == len(tail_to_frame) == off_t.shape[1] == ctx_t.shape[1], \ + "scored tail 的 latent / offset / 文本 cell 数对不齐" + return tail_sl, cond_t, grad_mask_t, tail_to_frame + + +# ---------------------------------------------------------------------------- +# 一次性梯度可达性自检 +# ---------------------------------------------------------------------------- + +def probe_student_grad(student, initial_latent: torch.Tensor, ctx_ext: torch.Tensor, + ids_ext: torch.Tensor, off_ext: torch.Tensor, deploy: tuple, + backward, clip_fn, *, kv_window: int, rope_cap: int, sink_size: int, + sink_anchor: str = "absolute") -> float: + """走一遍**真正的** rollout 前向(滑窗 KV、窗口锚定、单 cell),对一个人为目标 backward, + 确认梯度真的落到学生参数上。返回梯度范数(调用方负责随后 zero_grad)。 + + 为什么不能拿第 1 步的 gnorm_g 来判断:critic 与 teacher 是**同一份**双向 SFT 初值, + 所以 step 0 的 `pred_fake ≡ pred_real`,DMD 梯度**必然恰好是 0** —— 那是配方的性质, + 不是接线错误(PORT_SPEC S7(f):dmd 从 ~0 起,随 critic 拉开才进 +0.15…+0.68)。 + 而这条路径能静默断掉的方式有一堆:fsdp_use_orig_params=false(优化器 step 过期张量)、 + rollout 区 autocast 的权重缓存(bf16 副本不带 grad_fn)、某处多余的 detach。 + 它们都只表现为"loss 照打、控制通路不动",所以值得在开跑之前花一次前向+反向问清楚。 + """ + bare = unwrap(student) + cache = bare.init_kv_cache(kv_window=kv_window, sink_size=sink_size, rope_cap=rope_cap) + b, _, _, lat_h, lat_w = initial_latent.shape + dev = initial_latent.device + _, sig_dep, t_dep = deploy + ow0, mk0 = frame_cond(off_ext, 0, sink_size, kv_window, lat_h, lat_w, sink_anchor) + with torch.no_grad(): + student(initial_latent, torch.zeros(b, device=dev), ctx_ext[:, 0:1], + context_ids=ids_ext[:, 0:1], first_frame_cond=False, frame_index=0, + kv_cache=cache, commit=True, offset_win=ow0, mask_in_k=mk0) + ow, mk = frame_cond(off_ext, 1, sink_size, kv_window, lat_h, lat_w, sink_anchor) + noisy = torch.randn_like(initial_latent) + with torch.enable_grad(): + v = student(noisy, torch.full((b,), float(t_dep[0]), device=dev), ctx_ext[:, 1:2], + context_ids=ids_ext[:, 1:2], first_frame_cond=False, frame_index=1, + kv_cache=cache, commit=False, offset_win=ow, mask_in_k=mk) + den = noisy - float(sig_dep[0]) * v + probe = den.float().square().mean() # 人为目标:只要不是常数就行 + backward(probe) + gn = float(clip_fn(student, float("inf"))) # max_norm=inf ⇒ 只取范数,不缩放 + del v, den, probe + bare.release_kv_cache(cache) # 同上:只跑一次,量级小,但机制相同 + return gn + + +# ---------------------------------------------------------------------------- +# 参数 +# ---------------------------------------------------------------------------- + +def parse_args(argv=None): + ap = argparse.ArgumentParser(description="stage3:self-forcing DMD(ActionRoPE)") + # 默认值 = distill/stage3_dmd/run.sh 的实参。上游 A 的 run.sh 与 argparse 有六处不一致, + # 每一处都对应一次已知崩溃(lr 5e-6 = 高 lr min-max 崩、score_frames 26、horizon 14、 + # rollout_max 100、critic_steps 4、reanchor 16),所以这里只允许存在一份配方(risk 11)。 + ap.add_argument("--student_ckpt", default=None, + help="生成器初始化 = stage2 的 **ema/ema_step{N}.safetensors**(不是 dits/,risk 12)") + ap.add_argument("--teacher_ckpt", default=runlib.REF_CKPT, + help="real-score 教师 + critic 初始化 = **双向** SFT ckpt。" + "绝不是 stage1 的因果 ckpt:stage2 要轨迹匹配所以教师必须因果," + "stage3 只要终态分布匹配,用更强的双向模型") + ap.add_argument("--model_dir", default=MODEL_DIR) + ap.add_argument("--output", required=True, help="run 目录;相对路径按 runlib.resolve_run_dir 解析") + + ap.add_argument("--train_dir", default=os.path.join(ROOT, "data/latent/train_eybx")) + ap.add_argument("--val_dir", default=os.path.join(ROOT, "data/latent/val_eybx"), + help="只用来把验证集 clip 从训练集里排掉(stage3 没有验证 loss,靠 rollout_eval 判好坏)") + ap.add_argument("--sidecar", default=DEFAULT_SIDECAR) + ap.add_argument("--text_table", default=TEXT_TABLES["scene"]) + ap.add_argument("--limit", type=int, default=None, help="smoke 用:只取这么多训练 clip") + ap.add_argument("--min_rt_ratio", type=float, default=0.8) + ap.add_argument("--scene_dropout", type=float, default=0.0, + help="0:DMD 的 rollout 要按真实场景条件走;cfg 的 null 分支单独从文本表取 NULL_PROMPT") + + # ---- 部署采样表(用户拍板:4 步)---- + ap.add_argument("--denoise_list", default="1000,750,500,250", + help="少步采样表(原始 t 值,从噪到净严格降序)。用户拍板的部署表就是这 4 步," + "stage2 的 CD 轴与 stage3 必须按同一张表训。落到 1000 点网格上的实际 t 由 " + "flow_pf.deploy_schedule 给出,sigma 与它严格一一对应") + ap.add_argument("--real_guidance_scale", type=float, default=1.0, + help="教师 real-score 的 CFG。1.0 ⇒ 完全跳过 uncond 前向(省一半教师算力)。" + "ActionRoPE 有 --scene_dropout 训练,NULL_PROMPT 分支是在分布内的,所以 >1 合法") + + # ---- 滑窗 KV(部署几何)---- + ap.add_argument("--kv_window", type=int, default=20, help="滑动窗口里保留的 cell 数") + ap.add_argument("--sink_size", type=int, default=0, + help="恒可见的开头 cell 数。ActionRoPE 是 0:h/w 的 RoPE 位是一直在漂的世界坐标" + "(实测 21 cell 内最大 373 px = 11.66 token),钉住的 sink 帧在长 rollout 后" + "会落在训练分布之外;sink=0 + 窗口锚定让每个窗口都像一段训练 clip(risk 3)") + ap.add_argument("--rope_cap", type=int, default=20, + help="时间 RoPE 位上限 = F−1。硬不变量 rope_cap == sink_size + kv_window") + ap.add_argument("--sink_anchor", choices=("absolute", "window"), default="absolute", + help="sink_size>0 时世界坐标锚在哪:absolute = cell 0(sink 段留真实坐标,当前 cell 的 RoPE 位" + "无界增长);window = 滑动窗最老 cell(与 sink 0 同口径,RoPE 不出包络),sink 段偏移钉 0 " + "—— 内容照样可见(外观锚点),只放弃它的空间对齐。sink_size=0 时两者相同") + ap.add_argument("--rollout_min", type=int, default=21, + help="每步 rollout 生成的 cell 数下界(rank 同步抽)。必须 ≥ F=21 才练得到驱逐:" + "驱逐在 n_cached > sink+kv_window = 20 之后才发生,N=20 时它只在最后一次" + "提交时触发、之后再也没被读过") + ap.add_argument("--rollout_max", type=int, default=27) + ap.add_argument("--num_gen_cells", type=int, default=None, help="给了就固定 N(调试用),不再抽") + ap.add_argument("--offset_extend", choices=["resample", "continue"], default="resample", + help="cell ≥ 21 的世界偏移怎么续。resample:每 chunk 个 cell 重抽一次" + "方向×步速(与 infer.py::parse_actions 同构)。continue 外推最后一段速度," + "实测 512 条真实 clip 延到 N=30 时锚定窗口跨度 1.24× 包络(resample 是 1.006×)," + "越界比例 1.2%% vs 0.2%% —— 别改") + ap.add_argument("--offset_chunk_cells", type=int, default=5) + ap.add_argument("--context_extend", choices=["hold"], default="hold", + help="cell ≥ 21 的文本保持最后一条(ARoPE 的 prompt 已剥成纯场景,rollout 不换场景)") + ap.add_argument("--reanchor_every", type=int, default=0, + help="上游的 VAE 重锚(解码窗口→只留最后一帧像素→重编码→detach 重提交)。" + "本移植只接受 0:v5 配方本来就把它关了,而 ActionRoPE 对抗漂移的机制是" + "sink=0 + 窗口锚定坐标,不是把 latent 拉回 VAE 流形") + + # ---- DMD ---- + ap.add_argument("--dmd_score_frames", type=int, default=20, + help="K:只给 teacher/critic 看最后 1+K 个连续 cell。20 是与教师 F=21 对齐的" + "平价值(1+20 = 21 = teacher/critic 的训练片长)。降到 8 并不省显存" + "(streamed 峰值 62 vs 66 GiB/卡),只会让教师看 9 个 cell 的短片") + ap.add_argument("--grad_horizon", type=int, default=20, + help="rollout 里保留 autograd 的 cell 数。必须 ≤ dmd_score_frames,否则梯度窗口" + "跑出打分区、loss 恒 0 还不报错。streamed 路径下它不再是显存的主导项") + ap.add_argument("--grad_pass", choices=["streamed", "fused"], default="streamed", + help="streamed:rollout 完全不建图,之后每个 grad 帧单独重做+backward —— " + "**同一个梯度**(提交都在 no_grad 下,帧与帧之间本来就没有梯度;surrogate 又是" + "mean reduction,逐帧可拆),活化值 O(1 帧) 而不是 O(grad_horizon)," + "代价约 1.5–1.8× 前向算力。fused 实测 36.1 GB(h=8) / 77.8 GB(h=20),4 卡上没有余量") + ap.add_argument("--exit_step", type=int, default=None, + help="固定退出档(只给排查工具用)。训练必须留 None:每条 rollout 随机抽一个") + ap.add_argument("--frankenstein", type=int, default=0, + help="1 ⇒ 复现上游的缝合片 cat([真 cell0, 尾巴]),只为对照(risk 10)") + ap.add_argument("--dmd_timestep_clamp", default="20,980", + help="DMD 打分抽的**下标**区间 [lo, hi),= 上游硬编码的 [0.02,0.98]·1000") + ap.add_argument("--critic_steps", type=int, default=5, + help="每个生成器步跑几次 critic 更新(= CF++ 的 dfake_gen_update_ratio=5)。" + "1:1 会让 fake-score 永远追不上移动中的学生 ⇒ DMD 梯度有均值回复偏置 ⇒ 糊 + loss 平。" + "生成器必须**每步**都更新(见循环里的 FSDP 注释),所以领先量只能来自" + "同一份 detach 样本上的内层 critic 步") + + # ---- 优化器 ---- + ap.add_argument("--lr", type=float, default=2e-6, + help="生成器 lr。上游 argparse 的 5e-6 是已知的高 lr min-max 崩溃:" + "前 ~100 步又亮又有结构,然后 100–150 步之间突然变暗") + ap.add_argument("--lr_critic", type=float, default=1e-6) + ap.add_argument("--weight_decay", type=float, default=0.01) + ap.add_argument("--adam_betas", default="0.0,0.999", + help="beta1=0 是 CF 对非平稳 fake-score 目标的约定,别当 bug 改掉") + ap.add_argument("--warmup", type=int, default=100) + ap.add_argument("--grad_clip", type=float, default=10.0, help="生成器与 critic 都是 10.0(WorldMind 值)") + ap.add_argument("--batch_size", type=int, default=1) + ap.add_argument("--max_steps", type=int, default=500) + ap.add_argument("--gradient_checkpointing", action=argparse.BooleanOptionalAction, default=True, + help="critic 每步做 critic_steps 次整片前向+反向(21 cell 时 ~15 GB 活化值)⇒ 必须开。" + "**绝不会**用到 rollout 上:那条路径 arope_dit 硬断言禁止(risk 6)") + ap.add_argument("--opt8bit", type=int, default=0, + help="bitsandbytes AdamW8bit。本机没装(.venv 里确认过),且 4×143 GB 用不着;" + "留这个开关只是因为上游所有显存数字都是在 opt8bit=1 下量的") + ap.add_argument("--num_workers", type=int, default=2) + ap.add_argument("--seed", type=int, default=0) + + # ---- EMA / 存档 ---- + ap.add_argument("--use_ema", type=int, default=1) + ap.add_argument("--ema_decay", type=float, default=0.99) + ap.add_argument("--ema_start", type=int, default=100, help="这之前每步硬拷贝 ema ← student") + ap.add_argument("--save_every", type=int, default=50, + help="部署权重要**逐个里程碑挑**(上游两条 v3 线都是从 450–600 步里挑了 ema_step400)。0 ⇒ 只在训练结束时导出一次") + ap.add_argument("--keep_last_dits", type=int, default=3) + ap.add_argument("--keep_last_emas", type=int, default=25, help="全部里程碑都要留着挑") + ap.add_argument("--keep_last_critics", type=int, default=3) + ap.add_argument("--log_every", type=int, default=10) + ap.add_argument("--profile_mem", type=int, default=0, help="1 ⇒ 前几步逐阶段打峰值显存(开 20 之前先量这个)") + ap.add_argument("--resume", default=None, + help="auto ⇒ 有 /progress.json 就从 dits/ + critic/ + ema/ 接着跑(只恢复权重," + "优化器状态不存,续训 ≠ 不间断的一次训练)") + ap.add_argument("--force_run_dir", action="store_true", + help="--output 目录里 train.log 刚被写过时仍然继续(默认拒:多半是另一个 run 还活着," + "两个 run 同写一个目录会互相 rotate 掉对方的 10 GB 权重)") + ap.add_argument("--dry_run", action="store_true", help="tiny 四模型 + 合成数据,不碰真权重 / 真数据") + args = ap.parse_args(argv) + + if args.rope_cap != args.sink_size + args.kv_window: + raise SystemExit( + f"--rope_cap({args.rope_cap}) 必须 == --sink_size({args.sink_size}) + " + f"--kv_window({args.kv_window}):重新 RoPE 的缓存位置必须正好填满 0..rope_cap," + f"否则要么留位置空洞、要么用到训练时没出现过的相对距离") + if args.grad_horizon > args.dmd_score_frames > 0: + raise SystemExit(f"--grad_horizon({args.grad_horizon}) 必须 ≤ --dmd_score_frames" + f"({args.dmd_score_frames}):否则梯度窗口跑出打分区,loss 恒 0 且不报错") + if 0 < args.grad_horizon < args.dmd_score_frames: + # 上游 dmd_gm.py:245 的 critic loss 硬写 [:, :, 1:](整条打分尾巴);本移植改用 eval_idx。 + # 两者只在 grad_horizon == dmd_score_frames 时重合 —— 默认的 20/20 正好重合,所以是等价的。 + # 一旦调成不等,critic 就只在梯度窗口那几帧上学,打分尾巴剩下的帧它没见过, + # DMD 的 normalizer 归约范围也跟着变,等于悄悄换了目标的整体缩放。不报错,只是变差。 + print(f"[warn] grad_horizon({args.grad_horizon}) < dmd_score_frames({args.dmd_score_frames}):" + f"critic 与 normalizer 只覆盖梯度窗口的 {args.grad_horizon} 帧,而非整条 " + f"{args.dmd_score_frames} 帧打分尾巴(上游是整条)。默认 20/20 无此问题。", flush=True) + if args.critic_steps < 1: + raise SystemExit("--critic_steps 必须 ≥ 1:fake-score 一步不更新就永远追不上移动中的学生") + if args.rollout_min > args.rollout_max: + raise SystemExit(f"--rollout_min({args.rollout_min}) > --rollout_max({args.rollout_max})") + if args.rollout_min < args.sink_size + args.kv_window + 1 and not args.dry_run: + raise SystemExit(f"--rollout_min({args.rollout_min}) 必须 ≥ sink+window+1 = " + f"{args.sink_size + args.kv_window + 1},否则驱逐要么不发生、要么发生了也没被读过") + if args.reanchor_every: + raise SystemExit("--reanchor_every 只接受 0:VAE 重锚在 v5 配方里本来就是关的。" + "sink=0 + 窗口锚定坐标只解决 RoPE 坐标 OOD(PORT_SPEC risk 3),不是抗 latent 漂移;" + "尾锚外观偏移的门是 eval/sweep_photodrift.sh,后备是 --tail_reanchor vae" + "(尚未实现,PORT_SPEC risk 10 / DMD-1)") + if args.opt8bit: + raise SystemExit("--opt8bit 只接受 0:本机 .venv 没装 bitsandbytes,4×143 GB 也用不着") + try: + b1, b2 = (float(x) for x in args.adam_betas.split(",")) + except ValueError: + raise SystemExit(f"--adam_betas 应形如 '0.0,0.999',得到 {args.adam_betas!r}") from None + args.betas = (b1, b2) + try: + lo, hi = (int(x) for x in args.dmd_timestep_clamp.split(",")) + except ValueError: + raise SystemExit(f"--dmd_timestep_clamp 应形如 '20,980',得到 {args.dmd_timestep_clamp!r}") from None + args.clamp = (lo, hi) + args.denoise = [float(t) for t in args.denoise_list.split(",") if t.strip()] + if args.dry_run: + args.student_ckpt = args.teacher_ckpt = None + else: + if not args.student_ckpt: + raise SystemExit("--student_ckpt 必填:stage2 的 ema/ema_step{N}.safetensors") + # 先查这一条再查存在性:拿错文件的人给的路径通常是存在的,先报"存在与否"会盖掉真正的问题 + if "/dits/" in args.student_ckpt.replace(os.sep, "/"): + raise SystemExit(f"--student_ckpt 指向 dits/:{args.student_ckpt}\n" + " stage2 的部署权重是 ema/ema_step{N}.safetensors,dits/ 只为续训存在。" + "拿错了不会报错,只会静默从一个更差的模型起步(risk 12)。") + for p, name in ((args.student_ckpt, "--student_ckpt"), (args.teacher_ckpt, "--teacher_ckpt")): + if not os.path.isfile(p): + raise SystemExit(f"{name} 不存在:{p}") + return args + + +# ---------------------------------------------------------------------------- +# dry run:tiny 四模型 + 合成数据(PORT_SPEC 的 S6) +# ---------------------------------------------------------------------------- + +TINY = dict(dim=128, in_dim=48, ffn_dim=256, out_dim=48, text_dim=4096, freq_dim=256, eps=1e-6, + patch_size=(1, 2, 2), num_heads=4, num_layers=2, has_image_input=False) +TINY_SHAPE = (48, 5, 8, 10) # [C, cells, lat_h, lat_w] + + +class _SynDataset(torch.utils.data.Dataset): + """dry run 用:形状与 AropeLatentDataset 一致的合成样本(cell 数 / 分辨率缩小)。""" + + def __len__(self): + return 64 + + def __getitem__(self, i: int) -> dict: + g = torch.Generator().manual_seed(i) + c, f, h, w = TINY_SHAPE + off = torch.zeros(f, 2) + off[1:] = torch.randn(f - 1, 2, generator=g).cumsum(0) * 20.0 + return { + "input_latents": torch.randn(c, f, h, w, generator=g, dtype=torch.float32).to(torch.bfloat16), + "context": torch.randn(f, 8, 4096, generator=g, dtype=torch.float32).to(torch.bfloat16), + "context_ids": torch.zeros(f, dtype=torch.int64), + "offset_px": off, + "clip_id": f"syn_{i:04d}", + "kind": "syn", + } + + +def _tiny_model(causal: bool, seed: int = 0) -> AropeDiT: + from diffsynth.models.wan_video_dit import WanModel + torch.manual_seed(seed) + dit = WanModel(**TINY).to(torch.bfloat16) + return AropeDiT(dit=dit, mask_channel=True, causal=causal) + + +def _shrink_for_dry_run(args) -> None: + """把配方缩到 tiny 几何上还成立的规模:窗口 4、rollout 6–8、K=4、horizon=4。""" + args.kv_window, args.sink_size, args.rope_cap = 4, 0, 4 + args.rollout_min, args.rollout_max = 6, 8 + args.dmd_score_frames, args.grad_horizon = 4, 4 + if args.max_steps > 30: + args.max_steps, args.save_every, args.warmup, args.log_every = 6, 3, 2, 1 + args.critic_steps, args.ema_start = 2, 2 + + +# ---------------------------------------------------------------------------- +# 主流程 +# ---------------------------------------------------------------------------- + + +# 本机实测(GPU 0、真实 5B step-10000、bf16、latent 30×52 ⇒ 390 token/cell、30 层、kv_window 20)。 +# 上游 GraphGWM 的 36.1/77.8 GB 是**另一个模型/分辨率**的数字,在这里偏小 ~1.7×,不要拿来外推。 +GIB_PER_GRAD_FRAME = 6.46 # fused 每多保留一帧的图(窗口锚定的 complex128 重 RoPE 要对 20×390 个 key 逐层做,图就贵在这里) +GIB_KV_CACHE = 2.72 # n_cached=20 的 K/V 缓存(30 层) +GIB_STATIC_4GPU = 51.2 # student 18.63 + critic 18.63 + ema 4.66 + teacher(bf16 不分片) 9.31 +GIB_SCORING_MAX = 5.4 # teacher no_grad 1.69 + critic 带梯度检查点 3.69(都按 21 cell 的上界) + + +def _budget_gate(args, accel, device, log) -> None: + """显存预算闸:fused 路径按 horizon 线性吃活化值,超了就在**加载 4×5B 之前**拒绝启动。 + + 为什么值得一条硬闸:OOM 会发生在第一步 backward,也就是四个 rank 各读完 4 份 10 GB 底模、 + 跑完一整条 rollout 之后 —— 十几分钟的代价,而且 FSDP 下 OOM 常表现成 NCCL 超时而不是干净的 + CUDA OOM。streamed 与 fused 是**逐位等价**的(缓存提交全在 no_grad 下、surrogate 是 mean + reduction),所以这里没有任何精度上的取舍,直接不给 fused 跑不下的配置。 + """ + if device.type != "cuda": + return + tot = torch.cuda.get_device_properties(device).total_memory / 2 ** 30 + frames = args.grad_horizon if args.grad_pass == "fused" else 1 + need = GIB_STATIC_4GPU + GIB_KV_CACHE + GIB_SCORING_MAX + frames * GIB_PER_GRAD_FRAME + budget = 0.90 * tot # 留 10% 给碎片与 NCCL 缓冲 + tag = "(按真实 5B/4 卡规模估算;--dry_run 的 tiny 模型不适用)" if getattr(args, "dry_run", False) else "" + log(f"[budget]{tag} 每卡预估峰值 {need:.1f} GiB / {tot:.0f} GiB(静态 {GIB_STATIC_4GPU:.1f} + KV " + f"{GIB_KV_CACHE:.1f} + 打分 {GIB_SCORING_MAX:.1f} + {frames} 帧图 × {GIB_PER_GRAD_FRAME:.2f})" + f"[grad_pass={args.grad_pass} horizon={args.grad_horizon}]") + if need > budget: + h_ok = int((budget - GIB_STATIC_4GPU - GIB_KV_CACHE - GIB_SCORING_MAX) / GIB_PER_GRAD_FRAME) + raise SystemExit( + f"ABORT: --grad_pass {args.grad_pass} --grad_horizon {args.grad_horizon} 每卡要 " + f"{need:.0f} GiB,超过 {budget:.0f} GiB 的预算(卡 {tot:.0f} GiB)。" + f"fused 在本机几何下每帧图 {GIB_PER_GRAD_FRAME:.2f} GiB,最多 horizon {h_ok}。" + f"用 --grad_pass streamed(默认,与 fused 逐位等价,峰值不随 horizon 涨)。") + if args.grad_pass == "fused" and args.grad_horizon > 4: + log(f"[warn] fused 且 horizon={args.grad_horizon}:预估 {need:.0f} GiB 已经用掉 " + f"{100 * need / tot:.0f}% 的卡。streamed 是默认值,同一个梯度、峰值 {GIB_STATIC_4GPU + GIB_KV_CACHE + GIB_SCORING_MAX + GIB_PER_GRAD_FRAME:.0f} GiB。") + + +def _assert_run_dir_safe(run_dir: str, stage: str, force: bool, log=print, dry_run: bool = False) -> None: + """开跑之前确认 `--output` 指的不是**别人的** run 目录。stage3 有一份逐字相同的副本。 + + 为什么要有它:保存点会 `runlib.rotate_run(run_dir, keep_dits=…)`,那是真的 `os.remove` + 10 GB 的权重文件。而 `--output` 只要是个裸名字就落在 outputs/distill/ 下(runlib.resolve_run_dir), + 所以一个 `OUT=stage1_ar_tf` 的手误就会**删掉正在跑的那次训练的检查点** —— 不报错、不可逆。 + run.sh 的注释里 OUT= 本来就是给冒烟用的常规覆盖项,手误的概率不低。 + + 两道闸,都 fail-closed: + 1. progress.json 里记着别的 stage ⇒ 这是别人的目录,直接拒。 + 2. train.log 在最近 10 分钟里被写过 ⇒ 很可能有另一个 run 正活在这个目录里 + (两个 run 同写一个目录 = 互相 rotate 对方的权重)。崩溃后立刻续训会误判, + 所以留 --force_run_dir 这个显式出口;默认不给。 + """ + prog = runlib.read_progress(run_dir) + if prog and prog.get("stage") and str(prog["stage"]) != stage: + raise SystemExit( + f"ABORT: {run_dir} 是 stage={prog['stage']!r} 的 run 目录(progress.json 记在 step " + f"{prog.get('step')}),本次是 {stage}。保存时会 rotate 掉那边的 dits/ema —— 换个 --output。") + log_path = os.path.join(run_dir, "train.log") + if os.path.isfile(log_path): + age = time.time() - os.path.getmtime(log_path) + if age < 600 and not (force or dry_run): # dry_run 目录是一次性的,天天重跑,不拿这条闸烦它 + raise SystemExit( + f"ABORT: {log_path} 在 {age / 60:.1f} 分钟前还被写过 —— 多半有另一个 run 正活在这个目录里。" + "两个 run 同写一个目录会互相 rotate 掉对方的 10 GB 权重。换个 --output;" + "如果确认上一次已经死了(比如刚崩),加 --force_run_dir(launcher 里是 FORCE_RUN_DIR=1)。") + if age < 600: + log(f"[warn] {log_path} {age / 60:.1f} 分钟前刚被写过,--force_run_dir 强行继续。") + +def main(argv=None): + args = parse_args(argv) + if args.dry_run: + _shrink_for_dry_run(args) + accel = Accelerator(step_scheduler_with_optimizer=False) + is_main = accel.is_main_process + device = accel.device + set_seed(args.seed, device_specific=True) # 每个 rank 的噪声 / 抽签不同;同步项另有 sync_rng + + run_dir = runlib.resolve_run_dir(args.output) + # ★ 在**任何**写之前查:--output 指的是不是别人的 run 目录(保存时会 rotate 掉那边的 10 GB 权重)。 + # 所有 rank 都在这里 stat,之后再 barrier,保证没人先把 train.log 写新了让别的 rank 误判。 + _assert_run_dir_safe(run_dir, STAGE, bool(args.force_run_dir), dry_run=bool(args.dry_run)) + accel.wait_for_everyone() + if is_main: + os.makedirs(run_dir, exist_ok=True) + log = runlib.TextTee(os.path.join(run_dir, "train.log"), enabled=is_main) + jsonl = runlib.JsonlLogger(os.path.join(run_dir, "train_log.jsonl"), enabled=is_main) + log(f"=== {STAGE} | run={run_dir} world={accel.num_processes} " + f"dist={accel.distributed_type} mp={accel.mixed_precision} ===") + + # ---- 启动闸 1:滑窗 KV 的算术(tiny CPU 模型,几百毫秒;在烧掉 4×5B 之前跑)---- + pf = preflight_sliding_kv(args.sink_size, args.kv_window, args.rope_cap, + log=(log if is_main else (lambda *a: None))) + # ---- 启动闸 2:FSDP 的两条致命开关 ---- + if accel.distributed_type == DistributedType.FSDP: + plugin = accel.state.fsdp_plugin + if not getattr(plugin, "use_orig_params", False): + raise SystemExit( + "fsdp_use_orig_params 必须为 true(risk 5):优化器是在 prepare 之前按 " + "model.parameters() 建好的、此后不再重映射,false 时 FSDP1 换上 FlatParameter," + "优化器 step 的是过期张量、永远收不到梯度 —— 模型静默地完全不学习,无报错;" + "zip-EMA 也要求 Parameter 身份/顺序/分片完全一致。") + log(f"[fsdp] use_orig_params={plugin.use_orig_params} " + f"reshard={getattr(plugin, 'reshard_after_forward', None)} " + f"version={getattr(plugin, 'fsdp_version', 1)}") + elif accel.num_processes > 1: + log(f"[warn] 期望 FSDP(两个可训模型),实际是 {accel.distributed_type}") + + idx_dep, sig_dep, t_dep = deploy_schedule(args.denoise) + deploy = (idx_dep, sig_dep, t_dep) + log(f"[recipe] denoise={args.denoise} ⇒ 网格 t={[round(float(x), 1) for x in t_dep]} " + f"sigma={[round(float(x), 4) for x in sig_dep]}") + log(f"[recipe] kv_window={args.kv_window} sink={args.sink_size} cap={args.rope_cap} " + f"rollout={args.rollout_min}..{args.rollout_max} K={args.dmd_score_frames} " + f"horizon={args.grad_horizon} grad_pass={args.grad_pass} critic_steps={args.critic_steps} " + f"lr_g={args.lr} lr_c={args.lr_critic} betas={args.betas} clip={args.grad_clip} " + f"cfg={args.real_guidance_scale} ema={args.use_ema}/{args.ema_decay}@{args.ema_start} " + f"max_steps={args.max_steps}") + _budget_gate(args, accel, device, log) + if args.dmd_score_frames and args.dmd_score_frames != CELLS - 1: + log(f"[warn] dmd_score_frames={args.dmd_score_frames}:teacher/critic 看到的是 " + f"{1 + args.dmd_score_frames} 个 cell 的片子,与它们训练时的 {CELLS} 不同。" + f"这是省显存的首launch配置;量到 max_memory_allocated 之后应当开到 {CELLS - 1}") + low = runlib.warn_if_low_disk(run_dir) + if low: + log(f"[warn] {low}") + + # ---- 数据 ---- + walk_speed = None + if args.dry_run: + train_ds = _SynDataset() + text_table = None + log("[dry_run] tiny 四模型 + 合成数据") + else: + sidecar = load_sidecar(args.sidecar) + walk_speed = walk_speed_from_sidecar(sidecar) + train_ds = AropeLatentDataset(args.train_dir, sidecar=sidecar, text_table=args.text_table, + text_mode="scene", scene_dropout=args.scene_dropout, + limit=args.limit, seed=args.seed, verbose=is_main, + exclude_src_in=args.val_dir, min_rt_ratio=args.min_rt_ratio) + text_table = train_ds.text_table + log(f"[data] train {len(train_ds)} clip,实测步速 {walk_speed} px/s") + dataloader = torch.utils.data.DataLoader( + train_ds, batch_size=args.batch_size, shuffle=True, drop_last=True, collate_fn=arope_collate, + num_workers=args.num_workers, pin_memory=True, persistent_workers=args.num_workers > 0, + ) + + # ---- 续训(只恢复权重,必须在 prepare 之前装进裸模块)---- + # dry run 也走这条路(tiny ckpt 也是同一套 71 键 safetensors):续训是 stage3 唯一的 + # 恢复手段(优化器状态不落盘),不在 dry run 里练一遍,第一次真用它就是 500 步之后 + resume_step, resume_paths = 0, {} + if args.resume: + # progress.json 与三份权重必须来自**同一个**目录,否则会拿 A 的 step 去装 B 的权重 + if args.resume == "auto": + src = run_dir + elif os.path.isdir(args.resume): + src = args.resume + else: + raise SystemExit(f"--resume 只接受 'auto' 或一个 run 目录,得到 {args.resume!r}。" + "stage3 没有'只热启动权重'的续训形式 —— 那是 --student_ckpt 的职责。") + rp = runlib.read_progress(src) + if rp and int(rp.get("step", 0)) > 0: + resume_step = int(rp["step"]) + resume_paths = {"student": runlib.dit_path(src, resume_step), + "critic": runlib.critic_path(src, resume_step), + "ema": runlib.ema_path(src, resume_step)} + miss = [k for k, p in resume_paths.items() if not os.path.isfile(p)] + if miss: + raise SystemExit(f"--resume 想从 step {resume_step} 接着跑,但缺 {miss}:" + f"{[resume_paths[k] for k in miss]}") + log(f"[resume] 从 {src} 的 step {resume_step} 续:" + f"student←dits/ critic←critic/ ema←ema/(优化器状态不存,续训 ≠ 不间断的一次训练)") + else: + log("[resume] 没有 progress.json,从头开始") + + # ---- 四个模型 ---- + t0 = time.time() + if args.dry_run: + student = _tiny_model(causal=True, seed=0) + # ★ dry run 里 critic 故意与 teacher **不同**种子。真实配方是 critic ← teacher_ckpt, + # 两者逐位相同 ⇒ step 0 的 pred_fake ≡ pred_real ⇒ DMD loss 与梯度恰好是 0(这是配方 + # 的性质,见 probe_student_grad 的注释)。冒烟要看的是 surrogate/critic 两条链活没活, + # 所以这里先把它们拉开;可达性由 probe_student_grad 独立回答。 + critic = _tiny_model(causal=False, seed=2) + teacher = _tiny_model(causal=False, seed=1) + ema = _tiny_model(causal=True, seed=0) if args.use_ema else None + expect_keys = None + if resume_step: + runlib.load_dit_ckpt(student, resume_paths["student"]) + runlib.load_dit_ckpt(critic, resume_paths["critic"]) + if ema is not None: + runlib.load_dit_ckpt(ema, resume_paths["ema"]) + else: + student = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=True) + critic = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=False) + teacher = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=False) + ema = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=True) if args.use_ema else None + expect_keys = runlib.AROPE_DIT_KEYS + if resume_step: + runlib.load_dit_ckpt(student, resume_paths["student"]) + runlib.load_dit_ckpt(critic, resume_paths["critic"]) + if ema is not None: + runlib.load_dit_ckpt(ema, resume_paths["ema"]) + else: + runlib.load_dit_ckpt(student, args.student_ckpt) # 生成器 ← stage2 的 EMA + runlib.load_dit_ckpt(critic, args.teacher_ckpt) # critic ← 双向 SFT + if ema is not None: + runlib.load_dit_ckpt(ema, args.student_ckpt) # EMA 从学生初值起步 + runlib.load_dit_ckpt(teacher, args.teacher_ckpt) + log(f"[model] student←{os.path.basename(args.student_ckpt or resume_paths['student'])} " + f"critic/teacher←{os.path.basename(args.teacher_ckpt)}") + + # ★ prepare **之前** 全部 .float()(risk 4):ActionRoPE 的 ckpt 与 WanVideoPipeline 都是 bf16, + # FSDP 的 MixedPrecision(param_dtype=bf16) 下 bf16 参数**没有** fp32 主权重,AdamW 会原地更新 + # bf16 —— 训练照跑,只是学得又慢又抖,一句报错都没有。teacher 冻结且只做 no_grad 前向, + # 不进优化器,所以留 bf16(省 10 GB)。 + trainable = [("student", student), ("critic", critic)] + for name, m in trainable + ([("ema", ema)] if ema is not None else []): + m.float() + bad = next((n for n, p in m.named_parameters() if p.dtype is not torch.float32), None) + if bad is not None: + raise SystemExit(f"{name} 的 {bad} 不是 fp32 —— .float() 没生效,FSDP 下会没有 fp32 主权重") + student.train().requires_grad_(True) + critic.train().requires_grad_(True) + if ema is not None: + ema.requires_grad_(False).eval() # 冻结的部署影子;prepare 之前冻好,FSDP 才不挂梯度钩子 + # CPU dry run 没有 autocast,fp32 输入撞 bf16 权重会直接报错(onpolicy_arope.py:513 同一个坑) + teacher.to(dtype=torch.bfloat16 if device.type == "cuda" else torch.float32).requires_grad_(False).eval() + n_params = sum(p.numel() for p in student.parameters()) + log(f"[model] 4 × {n_params:,} 参数(student fp32 可训 / critic fp32 可训 / " + f"teacher bf16 冻结不分片 / ema fp32 冻结),加载 {time.time() - t0:.0f}s") + + def _adamw(params, lr): + # beta1=0(无动量)是 CF 对非平稳 fake-score 目标的约定,不是笔误 + return torch.optim.AdamW(params, lr=lr, weight_decay=args.weight_decay, betas=args.betas) + + opt_g = _adamw(student.parameters(), args.lr) + opt_c = _adamw(critic.parameters(), args.lr_critic) + warm = max(int(args.warmup), 0) + + def lr_lambda(s): + return min(1.0, (s + 1) / warm) if warm > 0 else 1.0 + + # lr scheduler 不进 prepare:accelerate 包装后每步会 step num_processes 次,warmup 被悄悄压缩 + slr_g = torch.optim.lr_scheduler.LambdaLR(opt_g, lr_lambda) + slr_c = torch.optim.lr_scheduler.LambdaLR(opt_c, lr_lambda) + + # FSDP 分支可以同时包多个 nn.Module(DeepSpeed 分支只会静默保留最后一个,所以 stage3 必须用 FSDP)。 + # teacher 不进 prepare:冻结 bf16 整份复制 10 GB,比包一层便宜也简单。 + if ema is not None: + student, critic, ema, opt_g, opt_c, dataloader = accel.prepare( + student, critic, ema, opt_g, opt_c, dataloader) + else: + student, critic, opt_g, opt_c, dataloader = accel.prepare( + student, critic, opt_g, opt_c, dataloader) + teacher.to(device) + # dit.freqs 是普通 tuple 属性(不是 buffer),prepare / .to() 都搬不动它 —— 每个裸模块都要搬一次 + for m in (student, critic, teacher) + ((ema,) if ema is not None else ()): + unwrap(m).move_rope_table(device) + assert unwrap(teacher).dit.freqs[0].device.type == device.type + + # ---- CFG 的 uncond 文本(cfg==1 时完全不需要)---- + uncond_row = None + if abs(args.real_guidance_scale - 1.0) >= 1e-6: + if args.dry_run: + uncond_row = torch.randn(8, 4096, dtype=torch.bfloat16) + else: + if NULL_PROMPT not in text_table: + raise SystemExit(f"文本表里没有 NULL_PROMPT {NULL_PROMPT!r},cfg>1 无法取 uncond") + uncond_row = text_table[NULL_PROMPT] + uncond_row = uncond_row.to(device=device, dtype=torch.bfloat16) + log(f"[cfg] real_guidance_scale={args.real_guidance_scale},uncond = NULL_PROMPT " + f"{tuple(uncond_row.shape)}(ActionRoPE 有 scene_dropout 训练,这条分支在分布内)") + + def uncond_cond(b: int, f: int): + """cfg>1 时教师的 null 条件:整条 NULL_PROMPT 广播成逐 cell,id 全 0 + (_embed_context 靠 id 去重,一行只过一次 text_embedding)。cfg==1 时返回 (None, None)。""" + if uncond_row is None: + return None, None + return (uncond_row.view(1, 1, *uncond_row.shape).expand(b, f, *uncond_row.shape), + torch.zeros(b, f, dtype=torch.int64, device=device)) + + # ---- config.json ---- + if is_main: + cfg = { + "stage": STAGE, "args": {k: v for k, v in vars(args).items() if k != "betas"}, + "betas": list(args.betas), "preflight": pf, + "deploy_schedule": {"t": [float(x) for x in t_dep], "sigma": [float(x) for x in sig_dep], + "idx": [int(x) for x in idx_dep]}, + "dataset": ({"synthetic": True} if args.dry_run else { + "train_dir": args.train_dir, "train_used": len(train_ds), + "text_table_keys": len(text_table), "walk_speed_px_s": list(walk_speed)}), + "model": {"n_params": n_params, "student_ckpt": args.student_ckpt, + "teacher_ckpt": args.teacher_ckpt, "start_step": resume_step}, + "env": {"world_size": accel.num_processes, "distributed_type": str(accel.distributed_type), + "mixed_precision": accel.mixed_precision, "torch": torch.__version__, + "cuda": torch.version.cuda, + "gpu": torch.cuda.get_device_name(0) if torch.cuda.is_available() else None, + "python": sys.executable, "platform": platform.platform(), "hostname": socket.gethostname(), + "argv": sys.argv, "started": time.strftime("%Y-%m-%d %H:%M:%S"), + "cuda_visible_devices": os.environ.get("CUDA_VISIBLE_DEVICES")}, + } + try: + import accelerate # noqa: F401 + cfg["env"]["accelerate"] = accelerate.__version__ + except Exception: + pass + runlib.save_config(run_dir, cfg) + + csv_fields = ["step", "dmd", "critic", "dmd_gnorm", "gnorm_g", "gnorm_c", "N", "grad_start", + "exit_step", "n_eval", "lr_g", "step_time", "mem_gb", "epoch"] + train_log = runlib.CsvLog(os.path.join(run_dir, "train_log.csv"), csv_fields, enabled=is_main) + + def _clip(model, max_norm): + # accel.clip_grad_norm_ 在 >1 个 FSDP 模型时会崩(它的匹配器用张量 `==`)。 + # FSDP 自带 clip_grad_norm_(会处理分片梯度);裸模块退回 torch 工具。 + if hasattr(model, "clip_grad_norm_"): + return model.clip_grad_norm_(max_norm) + return torch.nn.utils.clip_grad_norm_(model.parameters(), max_norm) + + ac = lambda: torch.autocast(device_type=device.type, dtype=torch.bfloat16, # noqa: E731 + enabled=(device.type == "cuda")) + # ★ rollout 区必须 cache_enabled=False(文件头坑 4)。FSDP+bf16 下参数本来就是 bf16、 + # 不发生 cast,这个开关是空操作;它保护的是 dry run / 单卡 / DDP 这些 fp32 参数路径。 + ac_roll = lambda: torch.autocast(device_type=device.type, dtype=torch.bfloat16, # noqa: E731 + enabled=(device.type == "cuda"), cache_enabled=False) + + # rank 同步的抽签流:N / grad_start / exit_step 三者必须**全 rank 一致**, + # 否则 FSDP 的 all-gather 形状对不上(而且不同 rank 在算不同长度的 rollout)。 + # 用一个各 rank 同种子的 CPU 生成器(可随 step 快进复现),再补一次 broadcast 兜底。 + # ★ 每步**恒定一次** randint(…, (3,)) 调用:抽签个数不随 --num_gen_cells / --exit_step 变, + # 于是续训时的快进(下面的循环)与真实消耗逐位一致。分三次抽就做不到这一点。 + sync_rng = torch.Generator().manual_seed(4321 + args.seed) + _SYNC_HI = 2 ** 31 - 1 + + def _draw_sync(): + return torch.randint(0, _SYNC_HI, (3,), generator=sync_rng).tolist() + + for _ in range(resume_step): + _draw_sync() + off_rng = torch.Generator().manual_seed(args.seed * 1000 + accel.process_index + 7) + + def _sync3(n: int, gs: int, es: int) -> tuple[int, int, int]: + if accel.num_processes <= 1: + return n, gs, es + t = torch.tensor([n, gs, es], device=device, dtype=torch.long) + torch.distributed.broadcast(t, src=0) + return int(t[0]), int(t[1]), int(t[2]) + + def do_save(step: int): + # save_dit 是集合操作(accelerator.get_state_dict),每个 rank 都必须进来 + meta = {"stage": STAGE, "step": step, "denoise_list": args.denoise_list, + "kv_window": args.kv_window, "sink_size": args.sink_size, "rope_cap": args.rope_cap, + "sink_anchor": args.sink_anchor, + "dmd_score_frames": args.dmd_score_frames, "grad_horizon": args.grad_horizon, + "student_ckpt": args.student_ckpt, "teacher_ckpt": args.teacher_ckpt, + "text_mode": "scene"} + runlib.save_dit(accel, student, runlib.dit_path(run_dir, step), meta, + expect_keys=expect_keys, require_mask=not args.dry_run, log=log) + runlib.save_dit(accel, critic, runlib.critic_path(run_dir, step), {**meta, "role": "critic"}, + expect_keys=expect_keys, require_mask=not args.dry_run, log=log) + if ema is not None: + runlib.save_dit(accel, ema, runlib.ema_path(run_dir, step), + {**meta, "role": "ema(deploy)", "ema_decay": args.ema_decay}, + expect_keys=expect_keys, require_mask=not args.dry_run, log=log) + if is_main: + gone = runlib.rotate_run(run_dir, keep_dits=args.keep_last_dits, + keep_emas=args.keep_last_emas, keep_critics=args.keep_last_critics) + n_gone = sum(len(v) for v in gone.values()) + if n_gone: + log(f"[rotate] 删掉 {n_gone} 个旧 ckpt(dits {args.keep_last_dits} / " + f"ema {args.keep_last_emas} / critic {args.keep_last_critics})") + runlib.write_progress(run_dir, step, stage=STAGE) + + # ---- 训练循环 ---- + step, epoch, last_saved = resume_step, 0, resume_step + _ls = resume_step # 上次打点的 step(算 s/step 用真实步差,不硬除 log_every) + if device.type == "cuda": + torch.cuda.reset_peak_memory_stats(device) + log(f"[train] 从 step {step} 到 {args.max_steps}") + data_iter = iter(dataloader) + t_step = time.time() + last = {} + while step < args.max_steps: + try: + batch = next(data_iter) + except StopIteration: + epoch += 1 + data_iter = iter(dataloader) + batch = next(data_iter) + batch = to_device(batch, device) + if device.type != "cuda": # 同上:CPU 路径把输入跟着提到学生的 dtype + pdt = next(unwrap(student).parameters()).dtype + for _k in ("input_latents", "context"): + batch[_k] = batch[_k].to(pdt) + x0 = batch["input_latents"] # [b,48,21,h,w] + b, _, f_clip, lat_h, lat_w = x0.shape + + # ---- rollout 长度 N / grad 窗口 / 退出档(三者都必须 rank 同步)---- + # N 与 clip 长度解耦,1+N > F 才练得到驱逐。取模的偏差可以忽略(区间 ≤ 7,上界 2^31)。 + r0, r1, r2 = _draw_sync() + N = (int(args.num_gen_cells) if args.num_gen_cells is not None + else args.rollout_min + r0 % (args.rollout_max - args.rollout_min + 1)) + total = 1 + N + Keff = min(args.dmd_score_frames, N) if args.dmd_score_frames > 0 else None + lo_gs, hi_gs = grad_start_range(total, args.grad_horizon, Keff) + grad_start = lo_gs + r1 % (hi_gs - lo_gs + 1) + exit_step = (r2 if args.exit_step is None else int(args.exit_step)) % len(t_dep) + N, grad_start, exit_step = _sync3(N, grad_start, exit_step) + + # ---- 三条流延到 1+N 个 cell,逐下标锁死 ---- + off_ext = extend_offsets(batch["offset_px"], N, mode=args.offset_extend, + chunk=args.offset_chunk_cells, rng=off_rng, walk_speed=walk_speed) + ctx_ext, ids_ext = extend_context(batch["context"], batch["context_ids"], N, + mode=args.context_extend) + assert_rollout_aligned(off_ext, ctx_ext, ids_ext, N) + initial = x0[:, :, 0:1] # 真实干净首帧 + + if step == resume_step: + # 开跑前问一次"梯度到底能不能到学生参数"(step 0 的 dmd 梯度必然是 0,问不出来) + with ac_roll(): + probe_gn = probe_student_grad(student, initial, ctx_ext, ids_ext, off_ext, deploy, + accel.backward, _clip, kv_window=args.kv_window, + rope_cap=args.rope_cap, sink_size=args.sink_size, + sink_anchor=args.sink_anchor) + opt_g.zero_grad(set_to_none=True) + log(f"[probe] rollout 梯度可达性自检 gnorm={probe_gn:.4e}") + if not (probe_gn > 0 and math.isfinite(probe_gn)): + raise SystemExit( + f"[probe] 学生的 rollout 梯度范数 = {probe_gn}:梯度根本没到学生参数。" + "依次查 fsdp_use_orig_params(false ⇒ 优化器 step 过期张量、永远收不到梯度)、" + "rollout 区 autocast 的 cache_enabled(True 时 no_grad 前向会把不带 grad_fn 的 " + "bf16 权重副本缓存下来、被那唯一一次 enable_grad 前向复用)、" + "以及 arope_dit.forward_frame 里有没有多余的 detach。") + log("[note] step 0 的 dmd 会恰好是 0:critic 与 teacher 是同一份双向 SFT 初值," + "pred_fake ≡ pred_real。它应当随 critic 被拉开而升到 +0.15…+0.68,不是单调下降。") + + _prof = bool(args.profile_mem) and step < resume_step + 3 and is_main and device.type == "cuda" + + def _mem(tag): + if _prof: + torch.cuda.synchronize(device) + log(f" [mem step{step}] {tag}: peak {torch.cuda.max_memory_allocated(device) / 2 ** 30:.1f}GB " + f"cur {torch.cuda.memory_allocated(device) / 2 ** 30:.1f}GB") + + if args.profile_mem and device.type == "cuda": + torch.cuda.reset_peak_memory_stats(device) + + # streamed:rollout 完全不建图,之后每个 grad 帧单独重做 + backward(同一个梯度) + record = {"exit": {}, "commit": {}} if args.grad_pass == "streamed" else None + with ac_roll(): + gen_clip, grad_mask = self_forcing_rollout( + student, initial, ctx_ext, ids_ext, off_ext, N, deploy, args.grad_horizon, + kv_window=args.kv_window, rope_cap=args.rope_cap, sink_size=args.sink_size, + score_last_k=Keff, record=record, grad_start=grad_start, exit_step=exit_step, + sink_anchor=args.sink_anchor) + _mem("after rollout") + + tail_sl, cond_t, grad_mask_t, tail_to_frame = score_tail( + gen_clip, grad_mask, off_ext, ctx_ext, ids_ext, N, Keff, + lat_h=lat_h, lat_w=lat_w, frankenstein=bool(args.frankenstein)) + + # ---- 生成器先更新(学生 backward 必须在 critic backward 之前),且**每步**都更新 ---- + # FSDP:一次没有紧跟着学生 backward 的学生 rollout(no_grad 的、或者跳过生成器更新的), + # 会让**下一个**生成器步拿到 0 梯度(backward setup 被消费掉了)。所以生成器每步更新, + # critic 的领先量来自同一份 detach 样本上的内层步。不要"优化"掉这个顺序。 + u_ctx, u_ids = uncond_cond(b, tail_sl.shape[2]) + if record is None: + with ac(): + gl, glog = dmd_generator_loss( + teacher, critic, tail_sl, cond_t, grad_mask_t, + real_guidance_scale=args.real_guidance_scale, + uncond_context=u_ctx, uncond_ids=u_ids, clamp=args.clamp) + _mem("after dmd_loss") + accel.backward(gl) + eval_idx = torch.nonzero(grad_mask_t, as_tuple=False).flatten() + eval_idx = eval_idx[eval_idx >= 1] + gl_val = float(gl.detach()) + else: + with ac(): + target_t, eval_idx, glog = dmd_targets( + teacher, critic, tail_sl, cond_t, grad_mask_t, + real_guidance_scale=args.real_guidance_scale, + uncond_context=u_ctx, uncond_ids=u_ids, clamp=args.clamp) + _mem("after dmd_loss") + record["n_eval"] = int(eval_idx.numel()) + frame_to_tail = {tail_to_frame[int(j)]: int(j) for j in eval_idx} + + def _tgt(k, _t=target_t, _m=frame_to_tail): + j = _m.get(k) + return None if j is None else _t[:, :, j:j + 1] + + with ac_roll(): + gl_val = stream_grad_replay(student, initial, ctx_ext, ids_ext, off_ext, record, + deploy, _tgt, accel.backward, + kv_window=args.kv_window, rope_cap=args.rope_cap, + sink_size=args.sink_size, sink_anchor=args.sink_anchor) + del target_t + _mem("after gen backward") + gng = float(_clip(student, args.grad_clip)) + # ★ S3-GUARD-3:step > resume_step 时 critic 已走过 critic_steps 步 ⇒ pred_fake ≠ pred_real + # ⇒ 代理梯度 grad/n ≠ 0 ⇒ gnorm_g > 0 是硬不变量;恰为 0.0 / NaN 只能是 autograd/FSDP 路径断裂 + # (交接文档里真实发生过:gnorm_g=0.00 每步、critic 正常、生成器一步没学)。 + # step == resume_step 那一步不拦(fresh run 的 step 0 dmd 恰为 0 是配方性质,见 probe); + # inf 不拦(clip 已把它归零)。FSDP 的 clip_grad_norm_ 是集合通信,各 rank 同值,不会挂 rank。 + if step > resume_step and (gng == 0.0 or math.isnan(gng)): + raise SystemExit( + f"[gnorm] generator grad norm {gng} at step {step}: student receives no gradient " + "(check FSDP backward setup / fsdp_use_orig_params / autocast cache / stray detach)") + opt_g.step() + opt_g.zero_grad(set_to_none=True) + slr_g.step() + if ema is not None: # 每个生成器步更新一次 + ema_update(ema, student, decay=(0.0 if step < args.ema_start else args.ema_decay)) + _mem("after opt_g.step") + + # ---- critic 更新:在**同一份 detach 样本**上跑 critic_steps 次 ---- + gen_det = tail_sl.detach() + gnc, cl_val = float("nan"), float("nan") + for _ci in range(args.critic_steps): + with ac(): + cl, _ = critic_loss(critic, gen_det, cond_t, eval_idx, clamp=args.clamp, + use_gradient_checkpointing=args.gradient_checkpointing) + accel.backward(cl) + gnc = float(_clip(critic, args.grad_clip)) + opt_c.step() + opt_c.zero_grad(set_to_none=True) + cl_val = float(cl.detach()) + slr_c.step() + _mem("after critic") + + step += 1 + last = {"dmd": gl_val, "critic": cl_val, "gnorm_g": gng, "gnorm_c": gnc, + "N": N, "grad_start": grad_start, "exit_step": exit_step, + "n_eval": int(eval_idx.numel()), **glog} + if step % args.log_every == 0 or step == args.max_steps: + now = time.time() + sec = (now - t_step) / max(step - _ls, 1) + t_step, _ls = now, step + avg_g = accel.reduce(torch.tensor(gl_val, device=device), reduction="mean").item() + avg_c = accel.reduce(torch.tensor(cl_val, device=device), reduction="mean").item() + row = {"step": step, "dmd": avg_g, "critic": avg_c, "dmd_gnorm": last["dmd_gnorm"], + "gnorm_g": gng, "gnorm_c": gnc, "N": N, "grad_start": grad_start, + "exit_step": exit_step, "n_eval": last["n_eval"], + "lr_g": slr_g.get_last_lr()[0], "step_time": sec, + "mem_gb": (torch.cuda.max_memory_allocated(device) / 2 ** 30 + if device.type == "cuda" else 0.0), "epoch": epoch} + if is_main: + train_log.write(row) + jsonl.log(row) + log(f"step {step}/{args.max_steps} dmd {avg_g:+.4f} critic {avg_c:.4f} " + f"dmd_gnorm {last['dmd_gnorm']:.1f} gnorm_g {gng:.2f} gnorm_c {gnc:.2f} " + f"N {N} grad {grad_start}..{grad_start + args.grad_horizon} exit {exit_step} " + f"n_eval {last['n_eval']} {sec:.1f}s mem {row['mem_gb']:.1f}GB") + if (args.save_every > 0 and step % args.save_every == 0) or step == args.max_steps: + do_save(step) + last_saved = step + + if last_saved != step and step > resume_step: + do_save(step) + if device.type == "cuda": + peak = torch.tensor(torch.cuda.max_memory_allocated(device) / 2 ** 30, device=device) + peak_max = accel.reduce(peak, reduction="max").item() + else: + peak_max = 0.0 + log(f"[done] step {step},各进程峰值显存 {peak_max:.1f} GB。" + f"部署权重按 ema/ema_step*.safetensors **逐个里程碑挑**(不是拿最后一步)," + f"用 distill/eval/rollout_eval.py 在 4 步部署表上量背景位移。") + if is_main: + runlib.write_progress(run_dir, step, stage=STAGE, finished=True, peak_mem_gb=peak_max, + last=last) + train_log.close() + jsonl.close() + log.close() + accel.wait_for_everyone() + accel.end_training() + return step + + +if __name__ == "__main__": + main() diff --git a/backup_2026-09-14/code/distill/stage3_dmd/run.sh b/backup_2026-09-14/code/distill/stage3_dmd/run.sh new file mode 100644 index 0000000000000000000000000000000000000000..5ad4dc770bd06140506ffa60e2553733f6e40ca0 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage3_dmd/run.sh @@ -0,0 +1,167 @@ +#!/usr/bin/env bash +# ───────────────────────────────────────────────────────────────────────────── +# stage3:self-forcing DMD(stage2 CD 的 EMA → 自回归抛光) +# +# 4 卡 FSDP1 FULL_SHARD(**不是** ZeRO-2:stage3 有两个可训模型 student + critic, +# 而 accelerate 的 DeepSpeed 分支只保留传给 prepare 的最后一个 nn.Module)。 +# 500 步 ≈ 6–8 h。实测依据(GPU 0、真实 5B、无分片):单 cell 前向 160 ms,N=26 的整条 +# no-grad rollout 20.2 s;streamed 还要再走一遍重放(重新提交 + 逐帧 grad 前向/反向), +# 加上 teacher/critic 打分与 5 次 critic 前向反向 ⇒ 单卡约 36 s/步,4 卡 FSDP 的 all-gather +# 再加两三成。上游 16.7 s/步那个数字是 8 卡 **fused** 路径的,不适用于这里。 +# 产物 /ema/ema_step{N}.safetensors —— **逐个里程碑挑**,不是拿最后一步。 +# DISTILL_NGPU=8 则 8 卡(两份 yaml 只差 num_processes);stage3 无 GA 旋钮,等效 batch = 卡数。 +# +# STUDENT= bash distill/stage3_dmd/run.sh +# # PORT_SPEC 的 S7 20 步实机冒烟(OUT 必须写绝对路径:$ROOT 只在本脚本内部有值) +# MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 PROFILE_MEM=1 PORT=29541 \ +# OUT=/data/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage3 \ +# STUDENT=... bash distill/stage3_dmd/run.sh +# # 量完显存之后开到与教师 F=21 完全对齐的平价配置: +# SCORE_FRAMES=20 GRAD_HORIZON=20 bash distill/stage3_dmd/run.sh +# +# 这里的每一个常量都与 dmd_arope.py 的 argparse 默认值、config.json 逐项相同 —— 上游 A 的 +# run.sh 与 argparse 有六处不一致(lr 5e-6 / critic_steps 4 / score 26 / horizon 14 / +# rollout_max 100 / reanchor 16),每一处都对应一次已知的崩溃(PORT_SPEC risk 11), +# 所以这个移植里只允许存在一份配方。改配方 = 同时改这三处。 +# +# 只有一处**故意**与 argparse 默认值不同,理由与 stage1 相同("裸跑不应该有的副作用"): +# --resume auto(argparse 默认 None:不想让随手一跑就悄悄接着上次的 step 跑) +# +# ⚠️ 部署几何铁律(勿动):rope_cap == sink_size + kv_window == F−1 == 20。 +# ⚠️ 采样表铁律:4 步 1000,750,500,250 —— stage2 的 CD 轴、stage3、部署推理必须是同一张表。 +# +# CUDA_VISIBLE_DEVICES / GPU 占用守卫都在 common.sh 里,这里不重复也不许绕过。 +# ───────────────────────────────────────────────────────────────────────────── +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +# shellcheck source=../common.sh +source "$HERE/../common.sh" # set -euo pipefail / ROOT / PY / ACC / 环境 / 只用 GPU 0-3 / 空闲守卫 + +# ---- 输入输出(都可以用环境变量覆盖)---- +# 生成器初值 = stage2 的 **ema/**(不是 dits/:dits/ 只为续训存在,拿错了静默降质,risk 12) +STAGE2_OUT="${STAGE2_OUT:-$ROOT/outputs/distill/stage2_cd}" +STUDENT="${STUDENT:-$STAGE2_OUT/ema/ema_step8000.safetensors}" +# real-score 教师 + critic 初值 = **双向** SFT。绝不是 stage1 的因果 ckpt。 +TEACHER="${TEACHER:-$ROOT/outputs/arope_10k_ga2/step-10000.safetensors}" +TRAIN_DIR="${TRAIN_DIR:-$ROOT/data/latent/train_eybx}" +VAL_DIR="${VAL_DIR:-$ROOT/data/latent/val_eybx}" +SIDECAR="${SIDECAR:-$ROOT/data/latent/arope_sidecar.pt}" +TEXT_TABLE="${TEXT_TABLE:-$ROOT/data/latent/text_table_actionrope.pt}" +OUT="${OUT:-$ROOT/outputs/distill/stage3_dmd}" + +# ---- 并行与端口 ---- +PORT="${PORT:-29536}" # 固定分配:stage1 29531 / stage2 29532 / stage3 29536 / 冒烟 29541+ +# stage3 没有 GA 旋钮:等效 batch = 1 × 卡数(4 卡 4 / 8 卡 8;上游部署线 cd15k 也是 8 rank)。 +# 两份 yaml 只差 num_processes;accelerate 的 --num_processes 本就会覆盖它,这里按 DISTILL_NGPU 选只为文档一致。 +if [ "$DISTILL_NGPU" = "8" ]; then + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_fsdp_dmd_8gpu.yaml}" +else + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_fsdp_dmd_4gpu.yaml}" +fi + +# ---- 配方(= dmd_arope.py 的 argparse 默认值)---- +DENOISE_LIST="${DENOISE_LIST:-1000,750,500,250}" # 用户拍板的 4 步部署表 +CFG_SCALE="${CFG_SCALE:-1.0}" # 1.0 ⇒ 完全跳过 uncond 前向(省一半教师算力) +KV_WINDOW="${KV_WINDOW:-20}" +SINK="${SINK:-0}" # ARoPE 的世界坐标一直在漂,永久 sink 帧会落在训练分布之外 +ROPE_CAP="${ROPE_CAP:-20}" # 必须 == SINK + KV_WINDOW +SINK_ANCHOR="${SINK_ANCHOR:-absolute}" # sink>0 时的世界坐标锚点:absolute(cell 0)/ window(滑动窗最老 cell,sink 偏移钉 0) +ROLLOUT_MIN="${ROLLOUT_MIN:-21}" # ≥ F=21 才练得到驱逐(N=20 时驱逐只在最后一次提交触发、没被读过) +ROLLOUT_MAX="${ROLLOUT_MAX:-27}" +# ★ 20/20 = 与教师 F=21 对齐的平价值:连续 scored tail 取 1+20 = 21 个 cell,正好是 teacher/critic +# 训练时的片长。曾经默认 8/8(给首launch留显存余量),但本机实测(见 dmd_arope.GIB_* 与 +# config.json 的 _budget)推翻了那个理由:streamed 路径峰值几乎不随 K/horizon 变 —— +# K=8 约 62 GiB/卡、K=20 约 66 GiB/卡,140 GiB 的卡上都不到一半。省不下显存,却让教师去看 +# 9 个 cell 的片子(比它 SFT 时的 21 短),是白付的分布错配,所以直接用平价值。 +# 显存真的紧张时再降 K,并且记得 grad_horizon ≤ dmd_score_frames。 +SCORE_FRAMES="${SCORE_FRAMES:-20}" +GRAD_HORIZON="${GRAD_HORIZON:-20}" +GRAD_PASS="${GRAD_PASS:-streamed}" # 本机实测每保留一帧的图 6.46 GiB ⇒ fused h=8 要 111 GiB/卡(79%)、 + # h=20 要 189 GiB = 必 OOM。streamed 恒 ~66 GiB 且梯度逐位等价。 + # (上游 GraphGWM 的 36.1/77.8 GB 是另一个模型的数,这里偏小 1.7×, + # 别拿来外推;dmd_arope 的 _budget_gate 会在装模型之前直接拦住) +OFFSET_EXTEND="${OFFSET_EXTEND:-resample}" # continue 会让锚定窗口跨度到 1.24× 包络,别改 +OFFSET_CHUNK="${OFFSET_CHUNK:-5}" +CRITIC_STEPS="${CRITIC_STEPS:-5}" # = CF++ 的 dfake_gen_update_ratio +LR="${LR:-2e-6}" # 上游 argparse 的 5e-6 是已知的高 lr min-max 崩溃 +LR_CRITIC="${LR_CRITIC:-1e-6}" +WEIGHT_DECAY="${WEIGHT_DECAY:-0.01}" +ADAM_BETAS="${ADAM_BETAS:-0.0,0.999}" # beta1=0 是 CF 对非平稳 fake-score 目标的约定 +WARMUP="${WARMUP:-100}" +GRAD_CLIP="${GRAD_CLIP:-10.0}" # 生成器与 critic 同值(WorldMind max_grad_norm_*=10.0) +MAX_STEPS="${MAX_STEPS:-500}" +CLAMP="${CLAMP:-20,980}" +EMA_DECAY="${EMA_DECAY:-0.99}" +EMA_START="${EMA_START:-100}" +SAVE_EVERY="${SAVE_EVERY:-50}" # 部署权重要逐个里程碑挑 +KEEP_DITS="${KEEP_DITS:-3}" +KEEP_EMAS="${KEEP_EMAS:-25}" # 全部里程碑都留着挑;默认 2 会把要挑的那些直接删掉 +KEEP_CRITICS="${KEEP_CRITICS:-3}" +MIN_RT="${MIN_RT:-0.8}" +LOG_EVERY="${LOG_EVERY:-10}" +PROFILE_MEM="${PROFILE_MEM:-0}" +NUM_WORKERS="${NUM_WORKERS:-2}" +SEED="${SEED:-0}" +RESUME="${RESUME:-auto}" # auto:有 /progress.json 就续(只恢复权重,优化器不落盘) +FORCE_RUN_DIR="${FORCE_RUN_DIR:-0}" # 1:/train.log 刚被写过也照跑(只在确认上一次真的死了时用) + +# ---- 前置检查(缺什么当场说清楚,不要跑到第 3 步才炸)---- +[ -f "$STUDENT" ] || { echo "ABORT: 没有 stage2 的 EMA: $STUDENT"; echo " 用 STUDENT=<绝对路径> 指定;它必须是 ema/ema_step{N}.safetensors,不是 dits/"; exit 1; } +case "$STUDENT" in + */dits/*) echo "ABORT: STUDENT 指向 dits/:$STUDENT"; echo " stage2 的部署权重是 ema/,dits/ 只为续训存在(PORT_SPEC risk 12)"; exit 1;; +esac +[ -f "$TEACHER" ] || { echo "ABORT: 没有双向 SFT 教师: $TEACHER"; exit 1; } +[ -d "$TRAIN_DIR" ] || { echo "ABORT: 没有训练集目录: $TRAIN_DIR"; exit 1; } +[ -d "$VAL_DIR" ] || { echo "ABORT: 没有验证集目录: $VAL_DIR"; exit 1; } +[ -f "$SIDECAR" ] || { echo "ABORT: 没有 sidecar: $SIDECAR"; exit 1; } +[ -f "$TEXT_TABLE" ] || { echo "ABORT: 没有文本表: $TEXT_TABLE"; exit 1; } +[ -f "$ACC_CFG" ] || { echo "ABORT: 没有 accelerate 配置: $ACC_CFG"; exit 1; } +if [ "$ROPE_CAP" -ne "$((SINK + KV_WINDOW))" ]; then + echo "ABORT: ROPE_CAP($ROPE_CAP) != SINK($SINK) + KV_WINDOW($KV_WINDOW)"; exit 1 +fi +mkdir -p "$OUT" + +ARGS=( + --student_ckpt "$STUDENT" --teacher_ckpt "$TEACHER" + --train_dir "$TRAIN_DIR" --val_dir "$VAL_DIR" + --sidecar "$SIDECAR" --text_table "$TEXT_TABLE" + --denoise_list "$DENOISE_LIST" --real_guidance_scale "$CFG_SCALE" + --kv_window "$KV_WINDOW" --sink_size "$SINK" --rope_cap "$ROPE_CAP" --sink_anchor "$SINK_ANCHOR" + --rollout_min "$ROLLOUT_MIN" --rollout_max "$ROLLOUT_MAX" + --dmd_score_frames "$SCORE_FRAMES" --grad_horizon "$GRAD_HORIZON" --grad_pass "$GRAD_PASS" + --offset_extend "$OFFSET_EXTEND" --offset_chunk_cells "$OFFSET_CHUNK" --context_extend hold + --reanchor_every 0 --frankenstein 0 --dmd_timestep_clamp "$CLAMP" + --critic_steps "$CRITIC_STEPS" + --lr "$LR" --lr_critic "$LR_CRITIC" --weight_decay "$WEIGHT_DECAY" + --adam_betas "$ADAM_BETAS" --warmup "$WARMUP" --grad_clip "$GRAD_CLIP" + --batch_size 1 --max_steps "$MAX_STEPS" --gradient_checkpointing --opt8bit 0 + --scene_dropout 0.0 --min_rt_ratio "$MIN_RT" + --use_ema 1 --ema_decay "$EMA_DECAY" --ema_start "$EMA_START" + --save_every "$SAVE_EVERY" --keep_last_dits "$KEEP_DITS" + --keep_last_emas "$KEEP_EMAS" --keep_last_critics "$KEEP_CRITICS" + --log_every "$LOG_EVERY" --profile_mem "$PROFILE_MEM" + --num_workers "$NUM_WORKERS" --seed "$SEED" + --output "$OUT" +) +# 写成 if 而不是 `[ cond ] && ARGS+=(...)`:set -e 下 && 链的写法太容易踩坑 +if [ -n "$RESUME" ] && [ "$RESUME" != "none" ]; then + ARGS+=(--resume "$RESUME") +fi +if [ "$FORCE_RUN_DIR" = "1" ]; then + ARGS+=(--force_run_dir) +fi + +echo "[stage3] student(生成器) = $STUDENT" +echo "[stage3] teacher/critic = $TEACHER (双向 SFT,不是 stage1 的因果 ckpt)" +echo "[stage3] out=$OUT port=$PORT cfg=$(basename "$ACC_CFG") $DISTILL_NPROC 卡 FSDP1 FULL_SHARD 等效 batch=$DISTILL_NPROC(无 GA)" +echo "[stage3] 采样表 $DENOISE_LIST · 窗口 $KV_WINDOW/sink $SINK/cap $ROPE_CAP/anchor $SINK_ANCHOR · rollout $ROLLOUT_MIN..$ROLLOUT_MAX" +echo "[stage3] K=$SCORE_FRAMES horizon=$GRAD_HORIZON pass=$GRAD_PASS critic_steps=$CRITIC_STEPS lr=$LR/$LR_CRITIC max_steps=$MAX_STEPS" +if [ "$SCORE_FRAMES" != "20" ]; then + echo "[stage3] 注意:K=$SCORE_FRAMES 是省显存的首launch配置(教师看到 $((SCORE_FRAMES + 1)) 个 cell,训练时是 21)。" + echo " PROFILE_MEM=1 跑 20 步量到峰值之后,用 SCORE_FRAMES=20 GRAD_HORIZON=20 开平价配置。" +fi + +# train.log 由 dmd_arope.py 自己带时间戳写;这里另存一份 launch.log,收 NCCL / FSDP / traceback 的原始输出 +"$ACC" launch \ + --config_file "$ACC_CFG" \ + --num_processes "$DISTILL_NPROC" --main_process_port "$PORT" \ + "$HERE/dmd_arope.py" "${ARGS[@]}" "$@" 2>&1 | tee -a "$OUT/launch.log" diff --git a/backup_2026-09-14/code/distill/stage3_onpolicy/config.json b/backup_2026-09-14/code/distill/stage3_onpolicy/config.json new file mode 100644 index 0000000000000000000000000000000000000000..f651e0979e1b60e5110addfcf9c3c4f2c921f6b0 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage3_onpolicy/config.json @@ -0,0 +1,60 @@ +{ + "_note": "stage3-onpolicy(AnyFlow on-policy DMD)真正在用的配方常量。这三处必须逐项相同:本文件 / run.sh 的默认值 / onpolicy_arope.py 的 argparse 默认值。上游 WorldMind 的 run.sh 与 argparse 有六处不一致,每一处都对应一次已知的崩溃 —— 这个移植里只允许存在一份配方。", + "_source": "vendor/AnyFlow/options/train/anyflow/farwan_causal/onpolicy/train_farwan1b_onpolicy_81f_480p_lr2e-6_1k_b32.yml", + "student_ckpt": "outputs/distill/stage2_flowmap/ema/ema_step8000.safetensors", + "teacher_ckpt": "outputs/distill/stage1b_adapt/dits/dit_step3000.safetensors", + "_ckpt_kinds": "★ student 必须 832 键(装了 flow map),teacher/critic 必须 827 键(只在 r==t 上当普通扩散用)。搞反不报错:827 的模型收下 r 然后忽略它,退化成普通 DMD、把 stage2 的 any-step 慢慢磨掉。onpolicy_arope._assert_ckpt_kinds 在读 40 GB 权重之前查 safetensors 头。", + "flowmap_form": "residual", + "delta_gate": 1.0, + "step_list": [ + 2, + 4, + 8, + 16, + 50 + ], + "_step_list": "★ 保住 any-step 的**唯一**机制(上游 rollout_cfg.num_inference_steps_list)。每次 rollout 抽一个 N,各 rank 广播同步。改成单个值 = 固定表 DMD,any-step 被训丢且不报错。", + "rollout_min": 21, + "rollout_max": 27, + "grad_horizon": 4, + "dmd_score_frames": 20, + "_score_frames": "1+20 = 21 = teacher/critic 训练时的片长。K 更小的话它们看到的是短片,离分布。", + "kv_window": 20, + "sink_size": 0, + "rope_cap": 20, + "_geometry": "铁律:rope_cap == sink_size + kv_window == F−1 == 20。", + "offset_extend": "resample", + "dmd_weight": 1.0, + "real_guidance_scale": 3.0, + "_cfg": "real score 的 CFG 在 **x0 空间**做,且是 cond + (cond−uncond)·w(上游 trainer:129-136),不是常见的插值形式 (1−w)·uncond + w·cond。符号写反 loss 照样有值。", + "clamp": [ + 20.0, + 980.0 + ], + "critic_steps": 1, + "_critic_steps": "上游 discriminator_update_ratio=1(WorldMind 的 dfake_gen_update_ratio 是 5)。上游的 discriminator 不是 GAN 判别器,是 fake score —— 与旧版的 critic 同一个东西。", + "lr": 2e-06, + "lr_critic": 2e-06, + "adam_betas": "0.0,0.999", + "weight_decay": 0.0, + "grad_clip": 1.0, + "_grad_clip": "上游 max_grad_norm=1.0。★ 起训前用 20 步冒烟的 gnorm p50 复核一遍 —— stage1 与 stage2-flowmap 的阈值都是这么定下来的,而且两次结论方向相反。", + "warmup": 0, + "max_steps": 1000, + "batch_size": 1, + "ema_decay": 0.99, + "ema_start": 100, + "_ema": "上游 onpolicy 的 ema_decay 是 0.99(pretrain 阶段是 0.999)。产物是 ema/,不是 dits/。", + "save_every": 50, + "keep_last_dits": 3, + "keep_last_emas": 25, + "keep_last_critics": 3, + "scene_dropout": 0.0, + "min_rt_ratio": 0.8, + "log_every": 10, + "num_workers": 2, + "seed": 0, + "_gate": "起训前:distill/tests/ 全过(含 test_onpolicy.py 28 项);--dry_run 走通;20 步实机冒烟量 s/step、每卡峰值、gnorm 分布;rollout 区 autocast 必须 cache_enabled=False (no_grad 前向缓存 bf16 权重副本会让带梯度那次拿不到梯度,且不报错)。", + "_deploy": "产物 = ema/ema_step{N}.safetensors,832 键 flowmap=1。采样必须给 r —— rollout_eval.py 的 --sampler auto 会按 checkpoint 自己判。", + "_grad_horizon": "★ 4 不是 20。与旧 stage3-DMD 不可比:那边每个 in-window cell 只有 1 次带梯度前向(exit_step 之后 break),这里按上游三段跳、三段**都**带梯度 ⇒ 3 次/cell,同样 horizon 下 autograd 图大 3 倍。8×140 GB 实测:20 直接 OOM,6 在边缘(137.4 GiB 已分配,rollout 抽到 26-27 cell 就炸),4 稳。三段跳压掉的是**前向次数**(N→3,与步数无关),不是图。" +} diff --git a/backup_2026-09-14/code/distill/stage3_onpolicy/onpolicy_arope.py b/backup_2026-09-14/code/distill/stage3_onpolicy/onpolicy_arope.py new file mode 100644 index 0000000000000000000000000000000000000000..926dcd5422a158ed73b225df1597d6a70d645c3a --- /dev/null +++ b/backup_2026-09-14/code/distill/stage3_onpolicy/onpolicy_arope.py @@ -0,0 +1,692 @@ +#!/usr/bin/env python3 +"""stage3(新):AnyFlow on-policy DMD —— 替换 stage3-DMD(WorldMind 口径)。 + + bash distill/stage3_onpolicy/run.sh + + # 20 步实机冒烟(OUT 必须绝对路径:$ROOT 是 common.sh 在脚本**内部**才导出的) + DISTILL_NGPU=8 MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 PORT=29541 \ + OUT=/data/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage3op \ + bash distill/stage3_onpolicy/run.sh + + # 不碰真权重的 dry run(tiny 四模型 + 合成数据) + ... --dry_run --output + +这一阶段做什么 +------------- +stage2-flowmap 给出的 any-step 学生是在**真值历史**上训的(teacher forcing)。实测的曝光偏差 +——喂自己生成的历史时 PSNR 从 24.4 掉到 16.2、|x0| 从 1.111 漂到 1.404——它一点没碰。 +这一阶段就是补上:学生用**自己提交的历史**自回归生成,再用 DMD 把生成分布拉回真实分布。 + +与旧 stage3-DMD 的三处本质差别(算法细节见 distill/onpolicy.py 的模块 docstring) +----------------------------------------------------------------------- +1. ★ rollout 每个 cell **恒定 ≤3 次前向**,与步数 N 无关(flow map 可以直接跳)。 + 旧版是「跑到 exit_step 就停」,要跑 g 次;那也是它必须写 stream_grad_replay 的原因 + (融合式 rollout 在 horizon=20 时 77.8 GB 激活)。**这里不需要那套东西。** +2. ★ 每次 rollout 的步数从 [2,4,8,16,50] 随机抽。这是**保住 any-step 性质**的唯一机制 —— + 只在一张固定表上做 DMD,会把别的步数训丢,而且不报错。 +3. 上游叫 discriminator 的模型不是 GAN 判别器,是 fake score,等于旧版的 critic。沿用 critic。 + +必须守住的 ActionRoPE 契约(上游没有,写错都不报错) +------------------------------------------------ +* cell 0 是干净 TI2V 锚点:不加噪、不进 loss、不进 DMD 归一化的分母。 +* 提交进 KV cache 恒用 `t=r=0` 的 detach 结果 —— TF clean 流的同分布要求,与 flow map 无关。 +* student 是 **832 键** flow-map 权重(先 install_flowmap 再 load); + teacher / critic 是 **827 键**、在 `r==t` 上当普通扩散用,**不装** flow map。 + 两者搞反不会报错:827 的模型收下 r 然后忽略它,退化成普通 DMD、any-step 悄悄训丢。 +""" +from __future__ import annotations + +import argparse +import json +import os +import re +import sys +import time + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +os.environ.setdefault("PYTORCH_CUDA_ALLOC_CONF", "expandable_segments:True") + +import torch +from accelerate import Accelerator +from accelerate.utils import DistributedType, set_seed + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.dataset import AropeLatentDataset, arope_collate, load_sidecar # noqa: E402 +from actionrope.prompts import NULL_PROMPT # noqa: E402 +from distill import flowmap as fm # noqa: E402 +from distill import lora as lora_mod # noqa: E402 +from distill import onpolicy as op # noqa: E402 +from distill import runlib # noqa: E402 +from distill.arope_dit import MODEL_DIR, AropeDiT, unwrap # noqa: E402 +from distill.data import extend_context, extend_offsets, make_mask_input, to_device # noqa: E402 +from distill.stage3_dmd.dmd_arope import ( # noqa: E402 + _assert_run_dir_safe, + _SynDataset, + _tiny_model, + draw_grad_start, + frame_cond, + score_tail, + window_context, + window_offsets, +) +from distill.tests.preflight import preflight_sliding_kv # noqa: E402 + +CELLS = 21 +STAGE = "stage3_onpolicy" + + +# ---------------------------------------------------------------------------- +# 一步 on-policy:generator 侧 +# ---------------------------------------------------------------------------- + +def generator_step(student, teacher, critic, batch, plan, args, *, device, gen=None, + sync_gen=None, uncond=None, uncond_ids=None, log=print): + """上游 `generator_loss`(trainer:152-196),换成我们的因果 AR rollout。 + + 返回 (loss, stats)。loss 的**数值没有意义**(见 onpolicy.dmd_generator_loss), + 健康信号是 dmd_gnorm 与 critic 侧的 loss,别拿它当收敛判据。 + """ + x0 = batch["input_latents"] + b, _, _, lat_h, lat_w = x0.shape + # ★ N 与 grad_start 必须**全 rank 一致**(dmd_arope 的 sync_rng 同一个理由): + # FSDP 每次 forward 都是一次集合操作,各 rank 的 rollout 长度/窗口不同 ⇒ all-gather + # 次数对不上 ⇒ NCCL 直接挂死(实测 DistBackendError,不是报错而是超时)。 + # 逐 rank 的 gen 只许用在**噪声**上。 + sg = sync_gen if sync_gen is not None else gen + N = int(torch.randint(args.rollout_min, args.rollout_max + 1, (1,), generator=sg).item()) + off_ext = extend_offsets(batch["offset_px"], N, mode=args.offset_extend) + ctx_ext, ids_ext = extend_context(batch["context"], batch["context_ids"], N, mode="hold") + # 梯度窗口必须钉进 scored tail 且避开尾巴自己的锚点 —— 朴素的 randint 会偶尔落在锚点上, + # 被 score_tail 的守卫拦下(那条守卫是对的)。复用 dmd_arope 里已经验过的这一份。 + grad_start = draw_grad_start(1 + N, args.grad_horizon, args.dmd_score_frames, gen=sg) + + # ★ rollout 区必须 cache_enabled=False(dmd_arope 文件头坑 4):窗口外的 cell 全程 no_grad, + # autocast 会把 fp32 权重的 bf16 副本缓存下来(不带 grad_fn),窗口内那几次带梯度的前向 + # 复用它 ⇒ 梯度到不了任何 Linear/Conv,且**不报错**(上游实测 15/71 → 71/71 参数)。 + if args.grad_mode == "sgf": + # SGF:pass 1 全 no_grad 只录像,pass 2 一次并行 TF 前向把上下文梯度补回来。 + # rollout 长度必须 == 打分片长,否则 pass 1/pass 2 的几何对不上(sgf_replay 的注释)。 + sig = fm.anystep_sigmas(plan.n_steps) + exit_idx = int(torch.randint(0, plan.n_steps, (1,), generator=sync_gen).item()) + with torch.autocast(device_type=device.type, dtype=torch.bfloat16, + enabled=(device.type == "cuda"), cache_enabled=False): + noisy_at_t, x0_cache = op.sgf_rollout( + student, x0[:, :, 0:1], ctx_ext, ids_ext, off_ext, N, sig, exit_idx, + kv_window=args.kv_window, rope_cap=args.rope_cap, sink_size=args.sink_size, + gen=gen, unwrap_fn=unwrap, frame_cond_fn=frame_cond) + # pass 2 覆盖**整条** rollout —— 上下文梯度要的就是全片的跨帧注意力。 + off_p2 = window_offsets(off_ext, 0, N) + ctx_p2, ids_p2 = window_context(ctx_ext, ids_ext, 0, N) + cond_p2 = dict(context=ctx_p2, context_ids=ids_p2, offset_px=off_p2, + mask_input=make_mask_input(off_p2, lat_h, lat_w), first_frame_cond=True) + ac2 = torch.autocast(device_type=device.type, dtype=torch.bfloat16, + enabled=(device.type == "cuda"), cache_enabled=False) + with ac2: + x0_p2 = op.sgf_replay(student, noisy_at_t, x0_cache, cond_p2, sig, exit_idx, + context_noise=args.context_noise, gen=gen, + gradient_checkpointing=args.gradient_checkpointing) + # ★ 但 teacher/critic 只看最后 1+K 个 cell —— 它们训练时的片长是 21,喂整条 22+ 会离分布。 + # pass 2 的梯度照样流过整片;这里切的只是 loss 的输入,与 window 模式同一条 score_tail。 + full_mask = torch.ones(1 + N, dtype=torch.bool, device=x0_p2.device) + tail_start = 0 if args.dmd_score_frames >= N else (1 + N) - (1 + args.dmd_score_frames) + full_mask[tail_start] = False # 尾巴自己的 cell 0 是锚点,不打分 + tail, cond_t, mask_t, _ = score_tail(x0_p2, full_mask, off_ext, ctx_ext, ids_ext, + N, args.dmd_score_frames, lat_h=lat_h, lat_w=lat_w) + generated = x0_cache + eval_mask = mask_t.clone() + grad_start, exit_for_log = -1, exit_idx + else: + exit_for_log = -1 + with torch.autocast(device_type=device.type, dtype=torch.bfloat16, + enabled=(device.type == "cuda"), cache_enabled=False): + generated, grad_mask = op.anystep_rollout( + student, x0[:, :, 0:1], ctx_ext, ids_ext, off_ext, N, plan, + frame_cond=frame_cond, grad_horizon=args.grad_horizon, grad_start=grad_start, + kv_window=args.kv_window, rope_cap=args.rope_cap, sink_size=args.sink_size, gen=gen) + + # 只给 teacher/critic 看连续的尾巴(它们训练时的片长是 21,喂更长会离分布) + tail, cond_t, mask_t, _ = score_tail(generated, grad_mask, off_ext, ctx_ext, ids_ext, + N, args.dmd_score_frames, lat_h=lat_h, lat_w=lat_w) + eval_mask = mask_t.clone() + eval_mask[0] = False # cell 0(尾巴的锚点)永不打分 + + ac = torch.autocast(device_type=device.type, dtype=torch.bfloat16, + enabled=(device.type == "cuda")) + with torch.no_grad(), ac: + # DMD 的噪声档:**均匀** u(上游 trainer:183 `torch.rand`),再 apply_shift、夹在 [lo,hi] + u = torch.rand(b, generator=gen) + s_t = fm.anystep_shift(u).to(device) # [b] σ + t_v = (s_t * fm.NUM_TRAIN_TIMESTEPS).clamp(args.clamp[0], args.clamp[1]) + s_t = t_v / fm.NUM_TRAIN_TIMESTEPS + noise = torch.randn(tail.shape, generator=gen).to(tail) + noisy = fm.add_noise_scalar(tail.detach(), noise, s_t) + noisy = fm.keep_frame0(noisy, tail.detach()) # 锚点不加噪 + + def _score(m, ctx, ids): + """teacher / critic 都在 r == t 上调用 —— 当普通扩散用(上游 trainer:120,125)。""" + uu = m(noisy, t_v, ctx, context_ids=ids, offset_px=cond_t["offset_px"], + mask_input=cond_t["mask_input"], first_frame_cond=True) + return op.x0_from_u(noisy, uu, s_t.view(b, 1, 1, 1, 1)) + + x0_fake = _score(critic, cond_t["context"], cond_t["context_ids"]) + x0_real = _score(teacher, cond_t["context"], cond_t["context_ids"]) + if abs(args.real_guidance_scale - 1.0) >= 1e-6: + # 上游 trainer:129-136:real score 的 CFG 在 **x0 空间**做,w 是**加**在差上的 + # pred_real = cond + (cond − uncond) · w ← 注意不是 (1−w)·uncond + w·cond + assert uncond is not None, "real_guidance_scale != 1 但没给 uncond(NULL_PROMPT 那一行)" + f_tail = cond_t["context"].shape[1] + x0_un = _score(teacher, uncond[:, :f_tail], uncond_ids[:, :f_tail]) + x0_real = x0_real + (x0_real - x0_un) * args.real_guidance_scale + grad = op.dmd_grad(x0_fake, x0_real, tail.detach(), + normalization=True, eval_mask=eval_mask) + + idx = torch.nonzero(eval_mask, as_tuple=True)[0] + loss = op.dmd_generator_loss(tail.index_select(2, idx), grad.index_select(2, idx), + weight=args.dmd_weight) + stats = {"n_cells": N, "n_steps": plan.n_steps, "grad_idx": plan.grad_idx, + "exit_idx": exit_for_log, + "sigma_dmd": float(s_t.mean()), "grad_absmean": float(grad.abs().mean()), + "n_scored": int(idx.numel())} + return loss, stats, generated.detach(), off_ext, ctx_ext, ids_ext + + +def critic_step(critic, generated, off_ext, ctx_ext, ids_ext, args, *, device, gen=None): + """上游 `discriminator_loss`(trainer:198-251):在学生**自己生成**的样本上回归 ε−x0。 + + 档位用 logit-normal(与 generator 侧的均匀不同,别顺手统一 —— fake score 要在整条轨迹上准)。 + rollout 已经在 generator_step 里跑过,这里直接复用它 detach 过的结果(上游是再 rollout 一遍; + 复用等价且省一半算力,因为那一遍本来就在 no_grad 下)。 + """ + b, _, _, lat_h, lat_w = generated.shape[0], 0, 0, generated.shape[3], generated.shape[4] + N = generated.shape[2] - 1 + # 尾巴里除**尾巴自己的 cell 0** 之外全要。注意那一格的绝对下标不是 0:K= N) else total - (1 + K) + full_mask = torch.ones(total, dtype=torch.bool, device=generated.device) + full_mask[tail_start] = False + tail, cond_t, mask_t, _ = score_tail(generated, full_mask, off_ext, ctx_ext, ids_ext, + N, args.dmd_score_frames, lat_h=lat_h, lat_w=lat_w) + eval_mask = torch.ones(tail.shape[2], dtype=torch.bool, device=tail.device) + eval_mask[0] = False + u = op.logit_normal_timesteps(b, gen=gen) + s_t = fm.anystep_shift(u).to(device) + t_v = (s_t * fm.NUM_TRAIN_TIMESTEPS).clamp(args.clamp[0], args.clamp[1]) + s_t = t_v / fm.NUM_TRAIN_TIMESTEPS + noise = torch.randn(tail.shape, generator=gen).to(tail) + noisy = fm.add_noise_scalar(tail, noise, s_t) + noisy = fm.keep_frame0(noisy, tail) + with torch.autocast(device_type=device.type, dtype=torch.bfloat16, + enabled=(device.type == "cuda")): + u_pred = critic(noisy, t_v, cond_t["context"], context_ids=cond_t["context_ids"], + offset_px=cond_t["offset_px"], mask_input=cond_t["mask_input"], + first_frame_cond=True, + use_gradient_checkpointing=args.gradient_checkpointing) + loss = op.critic_flow_loss(u_pred, tail, noise, eval_mask=eval_mask) + return loss, {"sigma_critic": float(s_t.mean())} + + +# ---------------------------------------------------------------------------- +# 参数 +# ---------------------------------------------------------------------------- + +# ---------------------------------------------------------------------------- +# 训练面(★ 这是 stage3 唯一一个被实测证伪过的配方项,见下面的注释) +# ---------------------------------------------------------------------------- + +# 上游 AnyFlow 的 on-policy 阶段学生与 critic **只训 LoRA**: +# lora_config.target_module_name = [attn1.to_q/k/v/out.0, ffn.net.0.proj, ffn.net.2, +# delta_embedder, time_embedder] ← 学生 +# (critic 少后两个) +# param_names_to_optimize = [lora_A, lora_B, far_patch_embedding] +# LoraConfig(..., bias='none') ← **所有 bias 一个都不训** +# 所以 `lr=2e-6` + `betas=(0.0,0.999)` + `clip=1.0` 是**给 LoRA 调的**超参。 +# +# 我们最初把它照搬到 832 个参数的全量微调上,实测 200 步内塌掉(std 39→2.7、mean 60→171 +# 烧白)。定位过程:拿塌掉的 dit_step100 逐组换回 stage2 初值再 rollout —— +# 还原 22 个 embedding/head 键 → 仍塌(std→2.2) ⇒ embedding 无辜 +# 还原 810 个 block 键、embedding 留坏的 → **恢复**(std 23~38、SIFT 量得出)⇒ 锅在 blocks +# 而 blocks 内部按类型看相对位移:bias 2.30e-3 > weight 1.45e-3 > modulation 3.8e-4 > norm 1.5e-5。 +# β1=0 时 update = lr·g/√v̂ ≈ lr·sign(g),每个参数每步都走满 lr、与梯度大小无关, +# 于是范数最小的 bias 相对动得最快 —— 这正是 LoRA 结构性排除掉的那一批。 +# +# ★ 但 proj **不是**修法,别被上面的推理带跑:继续做拼接实验(换回 stage2 初值再 rollout) +# 还原全部 bias/norm/modulation(521 键)、block 权重矩阵留坏的 → 仍塌(std→2.8) +# 只还原 300 个 block 权重矩阵、bias 和 embedding 全留坏的 → **恢复**(std→27.7、SIFT 量得出) +# ⇒ 致命的就是 self_attn/cross_attn/ffn 的**权重矩阵**,bias 完全无辜。而 proj 训的正是那批。 +# +# 真正的量纲在沿直线插值上(W(λ)=base+λ·(dit100−base)): +# λ=0.25(‖Δ‖/‖W‖=3.2e-4)好;λ=0.50(6.5e-4)震荡;λ=1.00(1.3e-3)烧白。 +# ⇒ 是**步长**不是方向,整个 run 的权重预算 ≈ 3e-4。lr=2e-6 只够 25 步。 +# 放大来自自回归递推:每 cell ~4% 的光度偏置,41 cell 就是 1.04^41 —— 而训练只 rollout +# 21..27 cell,这个方向从没被惩罚过。所以配方上真正要动的是 rollout 长度 + lr,不是训练面。 +# +# proj 只训 self-attn / FFN 的权重矩阵(+ 学生的 delta/time embedding 权重),对齐上游 +# LoRA 的 target。留作对照开关。 +# full 默认。 +_PROJ_BLOCK = re.compile(r"^blocks\.\d+\.(self_attn\.[qkvo]|ffn\.[02])\.weight$") +_PROJ_STUDENT_EXTRA = re.compile(r"^(delta_embedding|time_embedding)\.[02]\.weight$") + + +def in_train_scope(name: str, scope: str, *, is_student: bool) -> bool: + if scope == "full": + return True + if scope == "proj": + return bool(_PROJ_BLOCK.match(name)) or (is_student and bool(_PROJ_STUDENT_EXTRA.match(name))) + raise ValueError(f"未知 train_scope: {scope!r}") + + +def set_train_scope(model, scope: str, *, is_student: bool): + """按 scope 设 requires_grad,返回 (可训练参数列表, 可训练量, 总量)。 + + 返回的是**参数列表**而不是 model.parameters():AdamW 必须只收到可训练的那些, + 否则 FSDP 下 use_orig_params 会给冻结参数也建 state,白占显存且掩盖配置错误。 + """ + train, n_tr, n_all = [], 0, 0 + for name, prm in model.named_parameters(): + keep = in_train_scope(name, scope, is_student=is_student) + prm.requires_grad_(keep) + n_all += prm.numel() + if keep: + train.append(prm) + n_tr += prm.numel() + if not train: + raise SystemExit(f"train_scope={scope!r} 没匹配到任何参数 —— 键名口径变了") + return train, n_tr, n_all + + +def parse_args(argv=None): + ap = argparse.ArgumentParser(description="stage3-onpolicy:AnyFlow on-policy DMD") + ap.add_argument("--student_ckpt", default=None, + help="stage2-flowmap 的 **832 键 EMA**。827 键会被拒 —— 那是没装 flow map 的权重," + "拿来跑 on-policy 会退化成普通 DMD 且不报错") + ap.add_argument("--teacher_ckpt", default=None, + help="real score + critic 的初值:stage1b 的 **827 键**教师。两者在 r==t 上调用") + ap.add_argument("--model_dir", default=MODEL_DIR) + ap.add_argument("--train_dir", default=f"{ROOT}/data/latent/train_eybx") + ap.add_argument("--val_dir", default=f"{ROOT}/data/latent/val_eybx") + ap.add_argument("--sidecar", default=f"{ROOT}/data/latent/arope_sidecar.pt") + ap.add_argument("--text_table", default=f"{ROOT}/data/latent/text_table_actionrope.pt") + ap.add_argument("--output", required=True) + + ap.add_argument("--flowmap_form", default="residual", choices=["residual", "convex"]) + ap.add_argument("--delta_gate", type=float, default=1.0) + ap.add_argument("--rollout_min", type=int, default=21, + help="≥ F=21 才练得到驱逐(N=20 时驱逐只在最后一次提交触发、没被读过)") + ap.add_argument("--rollout_max", type=int, default=27) + ap.add_argument("--grad_horizon", type=int, default=4, + help="★ 与旧 stage3-DMD 不可比:那边每个 in-window cell 只有 **1** 次带梯度前向" + "(exit_step),这里三段跳**都**带梯度 ⇒ 3 次/cell,同样 horizon 下图大 3 倍。" + "8×140 GB 实测:20 直接 OOM,6 在边缘(137 GiB,抽到长 rollout 就炸),4 稳。" + "压掉的是前向次数(N→3),不是图。") + ap.add_argument("--dmd_score_frames", type=int, default=20, + help="K:teacher/critic 只看最后 1+K 个连续 cell。20 ⇒ 21 = 它们训练时的片长") + ap.add_argument("--kv_window", type=int, default=20) + ap.add_argument("--sink_size", type=int, default=0) + ap.add_argument("--rope_cap", type=int, default=20) + ap.add_argument("--offset_extend", default="resample", choices=["resample", "continue"]) + ap.add_argument("--step_list", default="2,4,8,16,50", + help="★ rollout 步数的抽签池(上游 onpolicy yml:105)。" + "改成单个值就退化成固定表 DMD —— any-step 会被训丢且不报错") + ap.add_argument("--dmd_weight", type=float, default=1.0) + ap.add_argument("--real_guidance_scale", type=float, default=3.0, + help="real score 的 CFG(上游 dmd_cfg.real_guidance_scale=3.0)。" + "在 **x0 空间**做,且是 cond + (cond−uncond)·w,不是常见的插值形式") + ap.add_argument("--clamp", default="20,980") + ap.add_argument("--lora_rank", type=int, default=0, + help="★ >0 = 只训低秩补丁(上游 AnyFlow on-policy 的训练面,rank=alpha=256)。" + "0 = 全量微调(我们试了五次,全部在 1e-4 位移量级上塌掉)") + ap.add_argument("--lora_alpha", type=int, default=0, help="默认取 = lora_rank,即 scale 1.0") + ap.add_argument("--grad_mode", choices=["window", "sgf"], default="window", + help="window=AnyFlow 的三段跳梯度窗口;sgf=Self Gradient Forcing 的两趟 replay " + "(pass1 全 no_grad 录像 + pass2 一次并行 TF 前向补回上下文梯度)") + ap.add_argument("--context_noise", type=float, default=0.0, + help="SGF 的 clean 半流噪声档(σ,0=精确干净,与上游 context_noise 同义)") + ap.add_argument("--train_scope", choices=["proj", "full"], default="full", + help="训练面。proj=只训 self-attn/FFN 权重矩阵(+学生的 delta/time embedding " + "权重),对齐上游 LoRA 的 target 且不训任何 bias;full=全量(实测会塌,只留作对照)") + ap.add_argument("--critic_steps", type=int, default=1, + help="上游 discriminator_update_ratio=1(WorldMind 是 5)") + + ap.add_argument("--lr", type=float, default=2e-6) + ap.add_argument("--lr_critic", type=float, default=2e-6) + ap.add_argument("--adam_betas", default="0.0,0.999") + ap.add_argument("--weight_decay", type=float, default=0.0) + ap.add_argument("--grad_clip", type=float, default=1.0, help="上游 max_grad_norm=1.0") + ap.add_argument("--warmup", type=int, default=0) + ap.add_argument("--max_steps", type=int, default=1000) + ap.add_argument("--batch_size", type=int, default=1) + ap.add_argument("--use_ema", type=int, default=1) + ap.add_argument("--ema_decay", type=float, default=0.99, help="上游 onpolicy ema_decay=0.99") + ap.add_argument("--ema_start", type=int, default=100) + ap.add_argument("--gradient_checkpointing", action="store_true", default=True) + ap.add_argument("--scene_dropout", type=float, default=0.0) + ap.add_argument("--min_rt_ratio", type=float, default=0.8) + ap.add_argument("--limit", type=int, default=None) + ap.add_argument("--num_workers", type=int, default=2) + ap.add_argument("--seed", type=int, default=0) + ap.add_argument("--save_every", type=int, default=50) + ap.add_argument("--keep_last_dits", type=int, default=3) + ap.add_argument("--keep_last_emas", type=int, default=25) + ap.add_argument("--keep_last_critics", type=int, default=3) + ap.add_argument("--log_every", type=int, default=10) + ap.add_argument("--resume", default=None) + ap.add_argument("--force_run_dir", action="store_true") + ap.add_argument("--dry_run", action="store_true") + args = ap.parse_args(argv) + + args.betas = tuple(float(x) for x in args.adam_betas.split(",")) + args.clamp = tuple(float(x) for x in args.clamp.split(",")) + args.step_list = tuple(int(x) for x in args.step_list.split(",") if x.strip()) + if not args.step_list: + raise SystemExit("--step_list 不能为空") + if len(args.step_list) == 1: + print(f"[warn] --step_list 只有一个值 {args.step_list}:这退化成固定表 DMD," + f"stage2 训出来的 any-step 性质会被慢慢训掉,而且不会报错。") + if args.grad_horizon > args.dmd_score_frames > 0: + raise SystemExit(f"--grad_horizon({args.grad_horizon}) 必须 ≤ --dmd_score_frames" + f"({args.dmd_score_frames}):否则梯度窗口跑出打分区,loss 恒 0 且不报错") + if args.rollout_min < args.sink_size + args.kv_window + 1: + raise SystemExit(f"--rollout_min({args.rollout_min}) 必须 ≥ sink+window+1 = " + f"{args.sink_size + args.kv_window + 1},否则驱逐一次都练不到") + if args.rope_cap != args.sink_size + args.kv_window: + raise SystemExit(f"--rope_cap({args.rope_cap}) 必须 == sink({args.sink_size}) + " + f"window({args.kv_window})(部署几何铁律)") + if not args.dry_run and not (args.student_ckpt and args.teacher_ckpt): + raise SystemExit("--student_ckpt(stage2 的 832 键 EMA)与 --teacher_ckpt(stage1b 的 827 键)都必填") + return args + + +def _assert_ckpt_kinds(args, log): + """832 / 827 搞反是这一阶段最容易犯、也最不会报错的错,所以在读 40 GB 权重之前先查头。""" + if args.dry_run: + return + if not runlib.is_flowmap_ckpt(args.student_ckpt): + raise SystemExit( + f"--student_ckpt 不是 flow-map 权重(缺 delta_embedding):{args.student_ckpt}\n" + f" on-policy 的 rollout 要给 r;827 键的模型会收下 r 然后忽略它," + f"退化成普通 DMD、把 stage2 训出来的 any-step 性质慢慢磨掉,全程不报错。") + if runlib.is_flowmap_ckpt(args.teacher_ckpt): + raise SystemExit( + f"--teacher_ckpt 是 flow-map 权重:{args.teacher_ckpt}\n" + f" real score / critic 只在 r==t 上用(当普通扩散),应当是 stage1b 的 827 键教师。") + log(f"[ckpt] student=832 键 flow-map ✓ teacher/critic=827 键 ✓") + + +# ---------------------------------------------------------------------------- +# 主循环 +# ---------------------------------------------------------------------------- + +def _load_student(args, resume_path=None): + """832 键:**先** install_flowmap 再 load。反过来读出层会被零初始化盖掉训出来的 delta, + 不报错,只是把 stage2 的 8000 步扔了(RUNBOOK「初始化顺序」那条)。""" + m = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=True) + unwrap(m).install_flowmap(form=args.flowmap_form, gate=args.delta_gate) + runlib.load_dit_ckpt(m, resume_path or args.student_ckpt) + return m + + +def main(argv=None): + args = parse_args(argv) + accel = Accelerator(step_scheduler_with_optimizer=False) + is_main, device = accel.is_main_process, accel.device + set_seed(args.seed, device_specific=True) + + run_dir = runlib.resolve_run_dir(args.output) + _assert_run_dir_safe(run_dir, STAGE, bool(args.force_run_dir), dry_run=bool(args.dry_run)) + accel.wait_for_everyone() + if is_main: + os.makedirs(run_dir, exist_ok=True) + log = runlib.TextTee(os.path.join(run_dir, "train.log"), enabled=is_main) + jsonl = runlib.JsonlLogger(os.path.join(run_dir, "train_log.jsonl"), enabled=is_main) + log(f"=== {STAGE} | run={run_dir} world={accel.num_processes} " + f"dist={accel.distributed_type} mp={accel.mixed_precision} ===") + log(f"[recipe] step_list={args.step_list} rollout={args.rollout_min}..{args.rollout_max} " + f"K={args.dmd_score_frames} horizon={args.grad_horizon} kv={args.kv_window}/sink{args.sink_size} " + f"cfg={args.real_guidance_scale} lr={args.lr}/{args.lr_critic} betas={args.betas} " + f"clip={args.grad_clip} ema={args.ema_decay}@{args.ema_start} max_steps={args.max_steps}") + preflight_sliding_kv(args.sink_size, args.kv_window, args.rope_cap, + log=(log if is_main else (lambda *a: None))) + if accel.distributed_type == DistributedType.FSDP: + plugin = accel.state.fsdp_plugin + if not getattr(plugin, "use_orig_params", False): + raise SystemExit("fsdp_use_orig_params 必须为 true:否则优化器 step 的是过期张量," + "模型静默地完全不学习(dmd_arope risk 5)") + _assert_ckpt_kinds(args, log) + + # ---- 数据 ---- + if args.dry_run: + train_ds, text_table = _SynDataset(), None + log("[dry_run] tiny 四模型 + 合成数据") + else: + sidecar = load_sidecar(args.sidecar) + train_ds = AropeLatentDataset(args.train_dir, sidecar=sidecar, text_table=args.text_table, + text_mode="scene", scene_dropout=args.scene_dropout, + limit=args.limit, seed=args.seed, verbose=is_main, + exclude_src_in=args.val_dir, min_rt_ratio=args.min_rt_ratio) + text_table = train_ds.text_table + log(f"[data] train {len(train_ds)} clip") + dl = torch.utils.data.DataLoader(train_ds, batch_size=args.batch_size, shuffle=True, + drop_last=True, collate_fn=arope_collate, + num_workers=args.num_workers, pin_memory=True, + persistent_workers=args.num_workers > 0) + + # ---- 续训(只恢复权重;优化器状态不落盘)---- + resume_step, rp_paths = 0, {} + if args.resume: + src = run_dir if args.resume == "auto" else args.resume + rp = runlib.read_progress(src) + if rp and int(rp.get("step", 0)) > 0: + resume_step = int(rp["step"]) + rp_paths = {"student": runlib.dit_path(src, resume_step), + "critic": runlib.critic_path(src, resume_step), + "ema": runlib.ema_path(src, resume_step)} + miss = [k for k, p in rp_paths.items() if not os.path.isfile(p)] + if miss: + raise SystemExit(f"--resume 想从 step {resume_step} 接着跑,但缺 {miss}") + log(f"[resume] 从 {src} 的 step {resume_step} 续") + + # ---- 四个模型:student 装 flow map(832),teacher/critic 不装(827,只在 r==t 上用)---- + t0 = time.time() + if args.dry_run: + student = _tiny_model(causal=True, seed=0) + unwrap(student).install_flowmap(form=args.flowmap_form, gate=args.delta_gate) + critic, teacher = _tiny_model(causal=False, seed=2), _tiny_model(causal=False, seed=1) + ema = _tiny_model(causal=True, seed=0) if args.use_ema else None + if ema is not None: + unwrap(ema).install_flowmap(form=args.flowmap_form, gate=args.delta_gate) + expect_keys = critic_keys = None + else: + student = _load_student(args, rp_paths.get("student")) + critic = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=False) + teacher = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=False) + runlib.load_dit_ckpt(critic, rp_paths.get("critic") or args.teacher_ckpt) + runlib.load_dit_ckpt(teacher, args.teacher_ckpt) + ema = _load_student(args, rp_paths.get("ema")) if args.use_ema else None + expect_keys = runlib.AROPE_DIT_KEYS_FLOWMAP # student/ema 装了 flow map ⇒ 832 + critic_keys = runlib.AROPE_DIT_KEYS # critic 没装 ⇒ 827 + log(f"[model] student(832, flow map) + critic/teacher(827, r==t) + ema,构建 {time.time() - t0:.0f}s") + + for name, m in [("student", student), ("critic", critic)] + ([("ema", ema)] if ema else []): + m.float() + bad = next((n for n, p in m.named_parameters() if p.dtype is not torch.float32), None) + if bad is not None: + raise SystemExit(f"{name}.{bad} 不是 fp32 —— FSDP 下没有 fp32 主权重,AdamW 会原地更新 bf16") + # teacher 冻结、只做 no_grad 前向,真实路径留 bf16 省 10 GB(CUDA 上 autocast 兜 dtype)。 + # CPU dry run 没有 autocast,这里必须跟着 float,否则 fp32 输入撞 bf16 权重直接报错。 + if device.type != "cuda": + teacher.float() + student.train() + critic.train() + teacher.eval().requires_grad_(False) + if ema is not None: + ema.eval().requires_grad_(False) + # ★ 必须在 accel.prepare 之前设 requires_grad:FSDP 是按 requires_grad 分组建 flat param 的, + # prepare 之后再改只会改到分片视图上,冻结不生效且不报错。 + if args.lora_rank > 0: + # ★ 必须在 accel.prepare 之前:FSDP 是按 requires_grad 分组建 flat param 的, + # prepare 之后再换模块 / 改 requires_grad 都只会改到分片视图上,且不报错。 + alpha = args.lora_alpha or args.lora_rank + lora_mod.install_lora(unwrap(student).dit, rank=args.lora_rank, alpha=alpha, + is_student=True, log=log) + lora_mod.install_lora(unwrap(critic).dit, rank=args.lora_rank, alpha=alpha, + is_student=False, log=log) # critic 不含 delta/time(上游口径) + if ema is not None: + # ★ EMA 影子是在装补丁之前复制的,不给它也装上,zip 配对就会「影子 75 vs 学生 107」。 + # 装上之后配对仍然逐位对齐:base 两边都冻着且相同,真正在动的只有补丁参数。 + lora_mod.install_lora(unwrap(ema).dit, rank=args.lora_rank, alpha=alpha, + is_student=True, log=lambda *_: None) + unwrap(ema).dit.requires_grad_(False) + p_g = lora_mod.lora_parameters(unwrap(student).dit) + p_c = lora_mod.lora_parameters(unwrap(critic).dit) + else: + p_g, n_g, tot_g = set_train_scope(student, args.train_scope, is_student=True) + p_c, n_c, tot_c = set_train_scope(critic, args.train_scope, is_student=False) + log(f"[scope] {args.train_scope}:学生 {n_g/1e6:.0f}M/{tot_g/1e6:.0f}M " + f"({100*n_g/tot_g:.1f}%),critic {n_c/1e6:.0f}M/{tot_c/1e6:.0f}M ({100*n_c/tot_c:.1f}%)") + + opt_g = torch.optim.AdamW(p_g, lr=args.lr, betas=args.betas, + weight_decay=args.weight_decay) + opt_c = torch.optim.AdamW(p_c, lr=args.lr_critic, betas=args.betas, + weight_decay=args.weight_decay) + # ★ ema 也必须过 prepare:zip-EMA 是按 parameters() 顺序逐个配对的,学生被 FSDP 分片而 + # 影子没分片的话,第 0 个参数就对不上(实测「影子 (3072,48,1,2,2) vs 学生 (0,)」)。 + # teacher 不进 prepare —— 它冻结、只做 no_grad 前向,分不分片无所谓,留 bf16 省 10 GB。 + if ema is not None: + student, critic, ema, opt_g, opt_c, dl = accel.prepare(student, critic, ema, opt_g, opt_c, dl) + else: + student, critic, opt_g, opt_c, dl = accel.prepare(student, critic, opt_g, opt_c, dl) + teacher.to(device) + unwrap(teacher).move_rope_table(device) + if ema is not None: + unwrap(ema).move_rope_table(device) + unwrap(student).move_rope_table(device) + unwrap(critic).move_rope_table(device) + + uncond = uncond_ids = None + if abs(args.real_guidance_scale - 1.0) >= 1e-6 and args.dry_run: + # dry run 也要走 CFG 那条路:real score 的 CFG 是 cond+(cond−uncond)·w(不是插值), + # 符号写反了 loss 照样有值,只有真跑一遍才看得出接没接上。 + row = torch.randn(8, 4096) + uncond = row.view(1, 1, *row.shape).to(device).expand(args.batch_size, CELLS + 8, -1, -1) + uncond_ids = torch.zeros(args.batch_size, CELLS + 8, dtype=torch.long, device=device) + log("[cfg] dry_run:用合成负条件走一遍 CFG 路径") + elif abs(args.real_guidance_scale - 1.0) >= 1e-6: + row = text_table[NULL_PROMPT].to(torch.float32) + uncond = row.view(1, 1, *row.shape).to(device).expand(args.batch_size, CELLS + 8, -1, -1) + uncond_ids = torch.zeros(args.batch_size, CELLS + 8, dtype=torch.long, device=device) + log(f"[cfg] real_guidance_scale={args.real_guidance_scale},负条件 = NULL_PROMPT") + + ema_shadow = None + if ema is not None: + from distill.ema import EmaShadow + # own=True:ema 这个 5B 模型已经单独建好了,别再 deepcopy 一份(stage2 同样口径) + ema_shadow = EmaShadow(ema, own=True) + + # 两条流分工明确:gen 逐 rank(噪声,本来就该各不相同);sync_gen 全 rank 同种子 + # (rollout 长度、梯度窗口 —— 这些决定集合操作的次数,错开就挂死)。 + gen = torch.Generator(device="cpu").manual_seed(1234 + args.seed * 17 + accel.process_index) + sync_gen = torch.Generator(device="cpu").manual_seed(4321 + args.seed) + plan_gen = torch.Generator(device="cpu").manual_seed(99 + args.seed) + step = resume_step + log(f"[train] 从 step {step} 到 {args.max_steps}") + + def _merge(mod): + """LoRA 下把 B@A 折回 base.weight,让导出的仍是普通 832 键权重。非 LoRA 时返回 None。""" + if args.lora_rank <= 0: + return None + bare = unwrap(mod) + dit = bare.dit if hasattr(bare, "dit") else bare + return lambda sd: lora_mod.merged_state_dict(dit, sd) + + def do_save(s): + runlib.save_dit(accel, student, runlib.dit_path(run_dir, s), expect_keys=expect_keys, + post=_merge(student), + metadata={"stage": STAGE, "step": str(s), "flowmap": "1", + "flowmap_form": args.flowmap_form, "delta_gate": str(args.delta_gate)}) + runlib.save_dit(accel, critic, runlib.critic_path(run_dir, s), expect_keys=critic_keys, + post=_merge(critic), + metadata={"stage": STAGE, "step": str(s), "role": "critic"}) + if ema_shadow is not None: + runlib.save_dit(accel, ema, runlib.ema_path(run_dir, s), expect_keys=expect_keys, + post=_merge(ema), + metadata={"stage": STAGE, "step": str(s), "flowmap": "1", + "flowmap_form": args.flowmap_form, + "delta_gate": str(args.delta_gate), "role": "ema"}) + if is_main: + runlib.rotate(os.path.join(run_dir, "dits"), args.keep_last_dits) + runlib.rotate(os.path.join(run_dir, "critic"), args.keep_last_critics) + runlib.rotate(os.path.join(run_dir, "ema"), args.keep_last_emas) + runlib.write_progress(run_dir, s, stage=STAGE, deploy=f"ema/ema_step{s}.safetensors") + + while step < args.max_steps: + for batch in dl: + if step >= args.max_steps: + break + batch = to_device(batch, device) + # autocast 关着时(CPU dry run)没人做 dtype 提升,而 latent/context 是 bf16、 + # 模型是 fp32(prepare 前 .float() 过)⇒ F.linear 直接报 dtype 不匹配。 + # CUDA 上 autocast 开着,这里是空操作。 + if device.type != "cuda": + pdt = next(unwrap(student).parameters()).dtype + for k in ("input_latents", "context"): + batch[k] = batch[k].to(pdt) + plan = op.draw_rollout_plan(plan_gen, step_list=args.step_list, + device=device, accelerator=accel) + t_step = time.time() + # 逐步重置:max_memory_allocated 是**累计**峰值,不重置的话日志里的 mem 会单调上升, + # 看起来像泄漏其实只是历史最大值。逐步重置之后这个数才等于"这一步用了多少"。 + if device.type == "cuda": + torch.cuda.reset_peak_memory_stats(device) + + opt_g.zero_grad(set_to_none=True) + g_loss, g_stats, generated, off_ext, ctx_ext, ids_ext = generator_step( + student, teacher, critic, batch, plan, args, device=device, gen=gen, + sync_gen=sync_gen, uncond=uncond, uncond_ids=uncond_ids, log=log) + accel.backward(g_loss) + gn_g = accel.clip_grad_norm_(student.parameters(), args.grad_clip) + opt_g.step() + + c_losses = [] + for _ in range(args.critic_steps): + opt_c.zero_grad(set_to_none=True) + c_loss, c_stats = critic_step(critic, generated, off_ext, ctx_ext, ids_ext, + args, device=device, gen=gen) + accel.backward(c_loss) + accel.clip_grad_norm_(critic.parameters(), args.grad_clip) + opt_c.step() + c_losses.append(float(c_loss.detach())) + + step += 1 + if ema_shadow is not None and step >= args.ema_start: + ema_shadow.update(student, decay=args.ema_decay) + elif ema_shadow is not None: + ema_shadow.hard_copy(student) + + if step % args.log_every == 0 or step == 1: + dt = time.time() - t_step + log(f"step {step}/{args.max_steps} dmd {float(g_loss.detach()):.5f} " + f"critic {sum(c_losses)/len(c_losses):.5f} N={g_stats['n_steps']} g={g_stats['grad_idx']} " + f"cells={g_stats['n_cells']} scored={g_stats['n_scored']} " + f"|grad| {g_stats['grad_absmean']:.4f} σ_dmd {g_stats['sigma_dmd']:.3f} " + f"gnorm {float(gn_g):.3f} {dt:.2f}s " + f"mem {torch.cuda.max_memory_allocated(device)/1024**3:.1f}GB" + if device.type == "cuda" else f"step {step} dmd {float(g_loss.detach()):.5f}") + jsonl.log({"step": step, "dmd": float(g_loss.detach()), + "critic": sum(c_losses) / len(c_losses), **g_stats}) + if args.save_every and step % args.save_every == 0: + do_save(step) + + if args.save_every and step % args.save_every != 0: + do_save(step) + log(f"[done] step {step}。部署权重 = ema/ema_step{step}.safetensors(832 键 flow map);" + f"采样必须给 r,用 rollout_eval 的 --sampler auto") + return 0 + + +if __name__ == "__main__": + sys.exit(main()) diff --git a/backup_2026-09-14/code/distill/stage3_onpolicy/run.sh b/backup_2026-09-14/code/distill/stage3_onpolicy/run.sh new file mode 100644 index 0000000000000000000000000000000000000000..21647958f0ae6067ae1f043b38ed13b6b05b0c54 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage3_onpolicy/run.sh @@ -0,0 +1,140 @@ +#!/usr/bin/env bash +# ───────────────────────────────────────────────────────────────────────────── +# stage3(新):AnyFlow on-policy DMD —— 替换 stage3-DMD(WorldMind 口径)。 +# +# 学生用**自己提交的历史**自回归生成,再用 DMD 把生成分布拉回真实分布。 +# stage2-flowmap 全程在真值历史上训(teacher forcing),实测的曝光偏差 +# —— 喂自己的历史时 PSNR 24.4 → 16.2、|x0| 1.111 → 1.404 —— 它一点没碰,这一阶段补。 +# +# bash distill/stage3_onpolicy/run.sh +# +# # 20 步实机冒烟。OUT 必须绝对路径:$ROOT 是 common.sh 在本脚本**内部**才导出的。 +# DISTILL_NGPU=8 MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 PORT=29541 \ +# OUT=/data/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage3op \ +# bash distill/stage3_onpolicy/run.sh +# +# ★ 三个 ckpt 的分工(搞反不报错,只会静默退化): +# --student_ckpt stage2-flowmap 的 **832 键** EMA,装了 flow map +# --teacher_ckpt stage1b 的 **827 键**教师,real score 与 critic 的初值,只在 r==t 上用 +# onpolicy_arope.py 会在读 40 GB 权重**之前**先查 safetensors 头,错了当场拒绝。 +# +# 这里的每一个常量都与 onpolicy_arope.py 的 argparse 默认值、config.json 逐项相同。 +# 改配方 = 同时改这三处。 +# ───────────────────────────────────────────────────────────────────────────── +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +# shellcheck source=../common.sh +source "$HERE/../common.sh" + +STAGE2_OUT="${STAGE2_OUT:-$ROOT/outputs/distill/stage2_flowmap}" +STAGE1B_OUT="${STAGE1B_OUT:-$ROOT/outputs/distill/stage1b_adapt}" +STUDENT="${STUDENT:-$STAGE2_OUT/ema/ema_step8000.safetensors}" +TEACHER="${TEACHER:-$STAGE1B_OUT/dits/dit_step3000.safetensors}" +TRAIN_DIR="${TRAIN_DIR:-$ROOT/data/latent/train_eybx}" +VAL_DIR="${VAL_DIR:-$ROOT/data/latent/val_eybx}" +SIDECAR="${SIDECAR:-$ROOT/data/latent/arope_sidecar.pt}" +TEXT_TABLE="${TEXT_TABLE:-$ROOT/data/latent/text_table_actionrope.pt}" +OUT="${OUT:-$ROOT/outputs/distill/stage3_onpolicy}" + +PORT="${PORT:-29537}" # 固定分配:stage1 29531 / stage2-CD 29532 / stage1b 29533 / + # stage2-flowmap 29534 / stage3-DMD 29536 / stage3-onpolicy 29537 / 冒烟 29541+ +# on-policy 的 batch 恒为 1×卡数(rollout 本身就很贵,上游 dmd_batch_size=2 是 32 卡下的) +if [ "$DISTILL_NGPU" = "8" ]; then + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_fsdp_dmd_8gpu.yaml}" +else + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_fsdp_dmd_4gpu.yaml}" +fi + +# ---- flow map / rollout ---- +FLOWMAP_FORM="${FLOWMAP_FORM:-residual}" +DELTA_GATE="${DELTA_GATE:-1.0}" +# ★ 保住 any-step 的**唯一**机制:每次 rollout 从这个池子里随机抽步数(上游 onpolicy yml:105)。 +# 改成单个值就退化成固定表 DMD,stage2 训出来的 any-step 会被慢慢磨掉,而且不报错。 +STEP_LIST="${STEP_LIST:-2,4,8,16,50}" +ROLLOUT_MIN="${ROLLOUT_MIN:-21}" # ≥ F=21 才练得到驱逐 +ROLLOUT_MAX="${ROLLOUT_MAX:-27}" +# ★ 4 不是 20:三段跳每个 cell 有 3 次带梯度前向(旧 DMD 是 1 次),同样 horizon 图大 3 倍。 +# 8×140 GB 实测:20 OOM,6 在边缘(137 GiB),4 稳。 +GRAD_HORIZON="${GRAD_HORIZON:-4}" +SCORE_FRAMES="${SCORE_FRAMES:-20}" # 1+20 = 21 = teacher/critic 训练时的片长 +KV_WINDOW="${KV_WINDOW:-20}" +SINK="${SINK:-0}" +ROPE_CAP="${ROPE_CAP:-20}" # 必须 == SINK + KV_WINDOW +OFFSET_EXTEND="${OFFSET_EXTEND:-resample}" + +# ---- DMD ---- +DMD_WEIGHT="${DMD_WEIGHT:-1.0}" +# real score 的 CFG。上游 dmd_cfg.real_guidance_scale=3.0,且是 **x0 空间**的 +# pred_real = cond + (cond − uncond)·w ← 不是插值形式,符号写反 loss 照样有值 +CFG_SCALE="${CFG_SCALE:-3.0}" +CLAMP="${CLAMP:-20,980}" +CRITIC_STEPS="${CRITIC_STEPS:-1}" # 上游 discriminator_update_ratio=1(WorldMind 是 5) + +# ---- 优化器 ---- +LR="${LR:-2e-6}" +LR_CRITIC="${LR_CRITIC:-2e-6}" +ADAM_BETAS="${ADAM_BETAS:-0.0,0.999}" # beta1=0:目标随 critic 漂移,动量会追着旧目标跑 +WEIGHT_DECAY="${WEIGHT_DECAY:-0.0}" +GRAD_CLIP="${GRAD_CLIP:-1.0}" # 上游 max_grad_norm=1.0;★ 用 20 步冒烟的 gnorm 复核 +WARMUP="${WARMUP:-0}" +MAX_STEPS="${MAX_STEPS:-1000}" # 上游 total_iter=1000 +EMA_DECAY="${EMA_DECAY:-0.99}" # 上游 onpolicy ema_decay=0.99(pretrain 是 0.999) +EMA_START="${EMA_START:-100}" +SAVE_EVERY="${SAVE_EVERY:-50}" # 部署权重要逐个里程碑人眼挑 +KEEP_DITS="${KEEP_DITS:-3}" +KEEP_EMAS="${KEEP_EMAS:-25}" +KEEP_CRITICS="${KEEP_CRITICS:-3}" +SCENE_DROPOUT="${SCENE_DROPOUT:-0.0}" +MIN_RT="${MIN_RT:-0.8}" +LOG_EVERY="${LOG_EVERY:-10}" +NUM_WORKERS="${NUM_WORKERS:-2}" +SEED="${SEED:-0}" +RESUME="${RESUME:-auto}" +FORCE_RUN_DIR="${FORCE_RUN_DIR:-0}" + +if [ ! -f "$STUDENT" ]; then + echo "ABORT: 没有 stage2-flowmap 的 EMA: $STUDENT" + [ -d "$STAGE2_OUT/ema" ] && { echo " 现有:"; ls -1 "$STAGE2_OUT/ema" | tail -6 | sed 's/^/ /'; } + exit 1 +fi +[ -f "$TEACHER" ] || { echo "ABORT: 没有 stage1b 教师: $TEACHER"; exit 1; } +[ -d "$TRAIN_DIR" ] || { echo "ABORT: 没有训练集: $TRAIN_DIR"; exit 1; } +[ -f "$SIDECAR" ] || { echo "ABORT: 没有 sidecar: $SIDECAR"; exit 1; } +[ -f "$TEXT_TABLE" ] || { echo "ABORT: 没有文本表: $TEXT_TABLE"; exit 1; } +[ -f "$ACC_CFG" ] || { echo "ABORT: 没有 accelerate 配置: $ACC_CFG(NGPU=$DISTILL_NGPU)"; exit 1; } +mkdir -p "$OUT" + +ARGS=( + --student_ckpt "$STUDENT" --teacher_ckpt "$TEACHER" + --train_dir "$TRAIN_DIR" --val_dir "$VAL_DIR" + --sidecar "$SIDECAR" --text_table "$TEXT_TABLE" + --flowmap_form "$FLOWMAP_FORM" --delta_gate "$DELTA_GATE" + --step_list "$STEP_LIST" + --rollout_min "$ROLLOUT_MIN" --rollout_max "$ROLLOUT_MAX" + --grad_horizon "$GRAD_HORIZON" --dmd_score_frames "$SCORE_FRAMES" + --kv_window "$KV_WINDOW" --sink_size "$SINK" --rope_cap "$ROPE_CAP" + --offset_extend "$OFFSET_EXTEND" + --dmd_weight "$DMD_WEIGHT" --real_guidance_scale "$CFG_SCALE" --clamp "$CLAMP" + --critic_steps "$CRITIC_STEPS" + --lr "$LR" --lr_critic "$LR_CRITIC" --adam_betas "$ADAM_BETAS" + --weight_decay "$WEIGHT_DECAY" --grad_clip "$GRAD_CLIP" --warmup "$WARMUP" + --max_steps "$MAX_STEPS" --batch_size 1 + --ema_decay "$EMA_DECAY" --ema_start "$EMA_START" + --gradient_checkpointing + --save_every "$SAVE_EVERY" --keep_last_dits "$KEEP_DITS" + --keep_last_emas "$KEEP_EMAS" --keep_last_critics "$KEEP_CRITICS" + --scene_dropout "$SCENE_DROPOUT" --min_rt_ratio "$MIN_RT" + --log_every "$LOG_EVERY" --num_workers "$NUM_WORKERS" --seed "$SEED" + --output "$OUT" +) +if [ -n "$RESUME" ] && [ "$RESUME" != "none" ]; then ARGS+=(--resume "$RESUME"); fi +if [ "$FORCE_RUN_DIR" = "1" ]; then ARGS+=(--force_run_dir); fi + +echo "[stage3op] student=$STUDENT" +echo "[stage3op] teacher=$TEACHER" +echo "[stage3op] out=$OUT port=$PORT cfg=$(basename "$ACC_CFG") 卡数=$DISTILL_NPROC" +echo "[stage3op] step_list=$STEP_LIST rollout=$ROLLOUT_MIN..$ROLLOUT_MAX K=$SCORE_FRAMES horizon=$GRAD_HORIZON" +echo "[stage3op] lr=$LR/$LR_CRITIC betas=$ADAM_BETAS clip=$GRAD_CLIP cfg_scale=$CFG_SCALE max_steps=$MAX_STEPS" +"$ACC" launch \ + --config_file "$ACC_CFG" \ + --num_processes "$DISTILL_NPROC" --main_process_port "$PORT" \ + "$HERE/onpolicy_arope.py" "${ARGS[@]}" "$@" 2>&1 | tee -a "$OUT/launch.log" diff --git a/backup_2026-09-14/code/distill/stage4_opsd/__init__.py b/backup_2026-09-14/code/distill/stage4_opsd/__init__.py new file mode 100644 index 0000000000000000000000000000000000000000..e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 diff --git a/backup_2026-09-14/code/distill/stage4_opsd/config.json b/backup_2026-09-14/code/distill/stage4_opsd/config.json new file mode 100644 index 0000000000000000000000000000000000000000..319c5396795372ee5ecea7391c467f09a9f71a11 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage4_opsd/config.json @@ -0,0 +1,105 @@ +{ + "_note": "stage4(OPSD,On-Policy Self-Distillation)真正在用的配方常量。这三处必须逐项相同:本文件 / run.sh 的默认值 / opsd_arope.py 的 argparse 默认值(PORT_SPEC risk 11;tests/test_stage4_opsd.py 逐项比)。改配方就同时改这三处。", + "_not_this_file": "跑起来之后 /config.json 是那一次 run 的完整快照(含 preflight / 采样网格 / 数据集统计 / 环境),由 runlib.save_config 写;本文件只是签进仓库的配方记录。", + "_launch": "DISTILL_NGPU=8 bash distill/stage4_opsd/run.sh(先跑 MAX_STEPS=20 PROFILE_MEM=1 的冒烟量 s/步与显存)", + "_upstream": "hf/worldmind_ref/GraphGWM/train/code_distill/stage4_opsd/opsd_gm.py(MeiGen-AI OPSD-V,arXiv 2607.08766,经 GraphGWM 移植)。机制不变:学生用部署采样器 on-policy rollout 并提交自己的 x0;冻结教师在同一个 (noisy, t) 上被求值,但缓存里是真值 0..k−2 + 学生的 k−1;loss = 速度场 MSE,逐 cell backward。 官方实现 vendor/OPSD-V(MeiGen-AI/OPSD-V,commit 8ecb193)已逐行核对,差异表见 distill/OPSD_OFFICIAL_NOTES.md:教师缓存最近一格默认改成官方的\"教师自己的 x0\"(--teacher_last_chunk),loss 归一化改成官方的整窗均值(--loss_norm window),逐步 backward 与逐 cell backward 数学相同(重加噪 detach)", + "stage": "stage4_opsd", + "script": "distill/stage4_opsd/opsd_arope.py", + "init_ckpt": "outputs/distill/stage3_dmd/ema/ema_step300.safetensors", + "_init_ckpt": "学生与冻结教师都从它起步。stage3 的部署产物是 ema/,dits/ 只为续训存在;run.sh 与 argparse 都拒绝 /dits/ 路径,除非 ALLOW_RAW_STUDENT=1 / --allow_raw_student(拿错了不报错,只是从一个更差的模型起步,risk 12)", + "output": "outputs/distill/stage4_opsd", + "product": "dits/dit_step{N}.safetensors = 学生本体(上游的部署产物:教师冻结、就是 init_ckpt 的字节副本,不存);ema/ema_step{N}.safetensors = 我们额外维护的学生 fp32 EMA 影子(decay 0.99、ema_start 50),另一个部署候选。两者都逐个里程碑用 distill/eval/rollout_eval.py 在 60+ cell 上量远端漂移来挑,并与 pre-OPSD 的 stage3 EMA 对比 —— 那个对比才是交付物", + "seg_dir": "data/latent_long/K3", + "_seg_dir": "make_long_segments 的 3000 条 61-cell 段:latent [48,61,30,52] bf16(整段一次过 VAE)、offset_px [61,2](cell 0 = 原点,绝对世界坐标)、61 条纯场景 prompt。cell 0 是两个缓存共同的真实锚点,真值 1..60 是教师的干净历史(学生从不看到)。DEVIATION:上游是'连续 clip 去掉锚帧再拼'的窗口", + "text_table": "data/latent/text_table_actionrope.pt", + "text_mode": "scene", + "scene_dropout": 0.0, + "_scene_dropout": "0:rollout 要按真实场景条件走,教师与学生看同一条文本(同一个对象,assert_same_conditioning)", + "limit": 0, + "denoise_list": "1000,750,500,250", + "_denoise_list": "必须是部署表(DEVIATION:上游 GraphGWM 是 2 步 1000,250)。OPSD 监督的是上线的那个采样器。落到 1000 点网格是 t=[1000, 750, 500.6, 251.6] / sigma=[1, 0.75, 0.5006, 0.2516]。renoise 链与 dmd_arope.self_forcing_rollout / rollout_eval.deploy_rollout 逐行相同:den = noisy − σ_i·v;noisy_next = (1−σ_{i+1})·den.detach() + σ_{i+1}·新噪声;最后以 t=0 提交 den.detach()", + "kv_window": 17, + "sink_size": 3, + "rope_cap": 20, + "sink_anchor": "absolute", + "_geometry": "硬不变量 rope_cap == sink_size + kv_window == 20。sink 3 / window 17 / absolute 是 stage3 **真正训练并部署**的几何(outputs/distill/stage3_dmd/config.json),不是 stage3 argparse 里的 0/20/20。窗口锚定的 offset_win / 当前 cell 的 known 掩码由 stage3 的 frame_cond 现算,学生与教师拿同一份对象。DEVIATION:上游只有时间轴 RoPE,这里 h/w 的 RoPE 位是世界坐标", + "rollout_cells": 61, + "_rollout_cells": "TOTAL cell 数(含锚点),必须 ≤ 段长 61(更短就切片)。61 cell = 241 帧 = 15 s,跨过 stage3 只练到的 27 cell —— rollout 里必须装得下要修的那个现象,否则每个打分 cell 都在干净区、梯度近零、跑得很健康但什么都没训(上游 run.sh 的同一条教训:41 帧 10 s 在 14 s 才开始的漂移之前)。DEVIATION:一个 cell = 1 个 latent 帧(同 GraphGWM chunk=1;OPSD-V 是 3)", + "loss_start_frame": 12, + "_loss_start_frame": "cell < 12 只 rollout 不打分(单个真实锚点还在主导)。上游 21 是 7 个 3 帧 chunk;我们按 latent cell 算。⇒ 打分 61 − 12 = 49 个 cell × 4 状态 = 196 个 (noisy, t) 状态/步", + "loss_type": "flow", + "_loss_type": "速度场 MSE(float32),论文消融的赢家(保细节、长视野更清);x0 = MSE 落在 noisy − σ·v 上,只为复现消融", + "teacher_context": "real", + "_teacher_context": "real = 方法本体。student = 退化自检:教师读学生自己的缓存对象,权重相同时 loss 必须**恰好** 0.0(--smoke 第 4 条,bit-exact:forward_frame 是缓存内容的纯函数,raw K/V 读时按同一 (tpos, offset_win) 重 RoPE,与谁在读无关)。run.sh 拒绝用 student 训练", + "teacher_keep_last": 1, + "_teacher_keep_last": "1 = 教师缓存 = 真值 0..k−2 + 最近生成的 k−1(官方 gt_kv:写完当前 chunk 后把倒数第二个 chunk 换成 GT、最近一个保留;那一格装谁的 x0 由 teacher_last_chunk 定)。实现:cache_r 恒滞后一格,每个需要教师的 cell snapshot_kv_cache(cache_r) → 把 k−1 那一格接到快照末尾 → 对快照打分 → release 快照。teacher 模式下 k−1 那一格是教师在 cell k−1 打分完 commit 进**它打分用的那条快照**(真值 0..k−3 + 教师的 k−2)后取走的 raw K/V(append_kv_frame 接上,= 官方的写入顺序:先写教师 chunk、再把倒数第二个换 GT、不重算最近一格),latent 与逐层 K/V 都与官方相同;student 模式(GraphGWM)是在 cell k 把学生的 x0 commit 到真值 0..k−2 的快照上(K/V 在全真值历史上算)。0 = 纯真值历史消融。DEVIATION:上游的 0 是'真值 0..k−2、k−1 是洞'(其 KVCache 不查帧数,教师在时间位 k−1 上给 cell k 打分);我们的 forward_frame 断言 frames_cached == frame_index 拒绝那种几何,所以这里 0 = 真值 0..k−1(真值 k−1 替换学生的 k−1)", + "teacher_last_chunk": "teacher", + "_teacher_last_chunk": "keep_last=1 时教师缓存里 k−1 那一格装谁的 x0。teacher = 官方 OPSD-V(vendor/OPSD-V model/opsd_streaming_training.py:每个 chunk 结束教师用自己在最后一个去噪步上的 x0 写缓存,再把倒数第二个 chunk 原位换成 GT);student = GraphGWM opsd_gm.py(学生提交的 x0)。官方教师是学生的 EMA(0.9999),两者几乎相同;冻结教师下会慢慢分开。teacher 模式下未打分的 cell 也要跑一次教师的最后一步 + 一次 commit(拿它的 x0 / K/V 当下一格上下文),每步多 ~2×(loss_start−1) 次教师前向", + "loss_norm": "window", + "_loss_norm": "window = 官方:(step_loss / total_loss_terms).backward(),total_loss_terms = 整个窗口所有打分 (cell, step) 对数;我们逐 cell backward,每个 cell 的 4 步均值再除以打分 cell 数,总梯度相同。cell = GraphGWM:每个 cell 的均值直接 backward,总梯度是 window 的 n_scored(49)倍 —— 只影响 clip 触发与日志里的 gnorm(Adam 对尺度不敏感)。日志里的 opsd 两种模式都是每 cell 均值", + "backward_per_chunk": 1, + "_backward_per_chunk": "逐 cell backward:一个打分 cell 的 4 个去噪状态的图同时活着(提交趟全 detach,图不跨 cell),backward 完就释放。0(整条 rollout 一次 backward)未实现:49 × 4 个图装不下", + "ema_decay": 0.0, + "_ema_decay": "**教师**的 EMA 衰减。0 = 精确冻结在 init_ckpt(默认)。参考实现 ema_weight 0.9999 × max_iters 200 = 0.980 保留初值,也就是近似冻结。>0 让教师漂向学生:loss ||v_θ(x,C_s) − v_φ(x,C_r)||² 在 φ→θ 时退化成 ||v_θ(x,C_s) − v_θ(x,C_r)||²,其全局极小值是任何**无视 KV 缓存**的模型 —— 与要修的东西正好相反,而 trainer 里没有别的项(无 GT flow-matching、无 DMD、wd=0)拉着它。FSDP 下只接受 0:教师是不分片的 bf16 副本,与分片学生 zip 会形状不符。>0(单进程)时教师自动留 fp32:bf16 的半 ulp ~2e-3 吃不进 (1−0.9999)=1e-4 的增量,mul_/add_ 会舍回旧值、EMA 静默退化成冻结教师(distill/ema.py 文件头同一条),trainer 在加载处断言教师 fp32;代价是多一份 5B fp32 权重(+9.3 GB)", + "optimizer": "AdamW", + "lora_rank": 256, + "lora_alpha": 0, + "_lora": "官方 OPSD-V 的训练面:只训 rank 256(alpha=rank,scale 1.0)的 LoRA,挂在 self_attn q/k/v/o + ffn.0/ffn.2 上(distill/lora.py,自写、非 peft);教师 = 同一模型关掉补丁(TeacherView,恒为 init_ckpt,不另占显存);存盘把 B@A 折回 base(merged_state_dict),dits/ 与 ema/ 仍是 827 键普通权重。0 = 全量微调:2026-09-10 实测 lr 1e-6 下 step50 起明显比 stage3 基线糊、step100 更糊(outputs/distill/eval/stage4_opsd/ema{50,100}_60s_indist)。续训:dits/ 是折叠后的权重,补丁从零重新起步", + "lr": 1e-05, + "_lr": "官方 LoRA 的 lr 1e-5(rank 256)。全量微调(lora_rank 0)用 1e-6:stage3 在 5e-6 崩、2e-6 稳", + "weight_decay": 0.0, + "adam_betas": "0.0,0.999", + "_adam_betas": "官方 OPSD-V 的 beta1 0.0 / beta2 0.999(vendor/OPSD-V configs/train_self_forcing_lora.yaml),也是 stage3 / stage2_cd 的值(CF 对非平稳目标的约定)。之前写的 0.9,0.95 没有出处,已改回官方", + "warmup": 50, + "lr_schedule": "线性 warmup 50 步后恒定 —— 每个 save_every 边界都是合法的停止点", + "grad_clip": 10.0, + "_grad_clip": "官方 max_grad_norm_generator 10.0(vendor/OPSD-V trainer/opsd_streaming.py),也是 stage3 的值。loss_norm=window 下累计梯度已除以 49 个打分 cell,1.0 会几乎每步触发、把 AdamW 变成归一化 SGD(RUNBOOK 的那条教训)—— 之前的 1.0 是未记录的偏离,已改回官方。裁剪走本地 _clip():FSDP 的 model.clip_grad_norm_(分片梯度、集合通信、各 rank 同值);裸模块退回 torch 工具", + "batch_size": 1, + "_batch_size": "不是调参项:rollout 是 61 cell 串行 + 逐 cell backward,显存在 rollout 里不在 batch 里", + "grad_accum": 1, + "world_size": 8, + "_world_size": "processes = DISTILL_NGPU(8 或 4),等效 batch = processes × grad_accum", + "eff_batch": 8, + "max_steps": 300, + "_max_steps": "参考实现只跑 200 步(LoRA、lr 1e-5);全量微调 1/10 的 lr,几百步是先探的量级,1000 是上界不是目标", + "num_workers": 2, + "seed": 0, + "use_ema": 1, + "student_ema_decay": 0.99, + "ema_start": 50, + "_ema": "学生的 fp32 EMA 影子是 FSDP 包着的第三个模型(冻结),按分片 zip 更新(要求 fsdp_use_orig_params=true)。这是我们的加项:上游的部署产物是 dits/ 学生本体", + "save_every": 50, + "keep_last_dits": 25, + "keep_last_emas": 25, + "_keep": "25:全部里程碑都留着挑。dits/ 在这一阶段是部署候选(上游的产物),不像 stage2/3 那样只为续训", + "log_every": 10, + "profile_mem": 0, + "resume": "auto", + "_resume": "只恢复权重(student←dits/ ema←ema/ + progress.json 的 step),教师永远 = init_ckpt,优化器状态不落盘", + "accelerate_config": "distill/configs/accelerate_fsdp_dmd_{4,8}gpu.yaml(run.sh 按 DISTILL_NGPU 选;与 stage3 同两份)", + "distributed": "FSDP1 FULL_SHARD, bf16。student(fp32 主权重,prepare 之前 .float())与 ema(fp32 冻结)进 prepare;teacher bf16 冻结、整份复制、不进 prepare(同 stage3 的 real-score 教师)", + "fsdp_must": "use_orig_params=true(false ⇒ 优化器 step 过期的 FlatParameter、永远收不到梯度,模型静默地完全不学习);rollout 区 autocast cache_enabled=False(否则 no_grad 前向缓存的 bf16 权重副本不带 grad_fn,打分前向复用它 ⇒ 梯度到不了 Linear/Conv —— 只在 fp32 参数路径上是真问题,FSDP+bf16 下是空操作);绝不对 KV rollout 做梯度检查点(滑窗 commit 是破坏性的,risk 6)", + "models": "student(因果, fp32 base 冻结 + LoRA fp32 可训, FSDP) / teacher(= 学生关掉 LoRA 补丁;lora_rank 0 时才是 bf16 冻结副本) / ema(因果, fp32 冻结, FSDP, 同样装补丁)", + "gpus": "0-7(DISTILL_NGPU=8)或 0-3(DISTILL_NGPU=4)", + "main_process_port": 29537, + "_budget": "★ 没有实测数字,全部是外推;**必须先跑 20 步 PROFILE_MEM=1 冒烟(MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 PROFILE_MEM=1 OUT=<绝对路径>/_smoke_stage4)量到 s/步与 max_memory_allocated 再开 300 步**。每步的工作量(R=61、loss_start 12 ⇒ 49 个打分 cell × 4 状态):学生 60×4 = 240 次单 cell 读(其中 196 次带梯度)+ 60 次提交 + 49 次 backward(每次 4 个状态的图,≈ 196 × 2 次前向的算力);教师(bf16 no_grad)196 次打分 + 11 次未打分 cell 的最后一步 + 59 次自己 x0 的提交(cell 1..59,官方写入顺序)+ 59 次真值提交。合计约 1000 个'单 cell 前向当量'/步,而 stage3 一步约 430 个当量(27 cell rollout + 重放 + 打分 + 5 次 critic)实测 22–40 s/步(8 卡 FSDP,N=22..26,outputs/distill/stage3_dmd/train_log.csv)⇒ 按当量比外推 50–90 s/步;按 GPU0 无分片实测 160 ms/单 cell 前向的上界算是 160 s/步。⇒ 300 步 ≈ 5–13 h。显存/卡(8 分片):静态 ≈ student fp32 分片 (参数 2.33 + 梯度 2.33 + AdamW 4.66) + ema 2.33 + teacher bf16 整份 9.31 ≈ 21 GiB;动态 ≈ 学生缓存 2.72 + 真值缓存 2.72 + 快照上 cat 出的新张量 2.72 + 4 个单 cell 图 × 6.46(stage3 实测每保留一帧的图,贵在窗口锚定的 complex128 重 RoPE 对 20×390 个 key 逐层做)≈ 34 GiB ⇒ 峰值 ≈ 55–60 GiB / 140 GiB。如果实测超出,第一个可降的是把逐 cell backward 改成逐状态 backward(4 个图 → 1 个,数学上相同:状态之间的重加噪是 detach 的)。磁盘:6 次保存 × (dit + ema) × 10 GB = 120 GB,keep 25 ⇒ 全留", + "_deviations": [ + "训练面同官方:LoRA rank 256 / lr 1e-5(自写 LoRALinear 而非 peft;target = self_attn q/k/v/o + ffn,官方 target 列表未逐项核对)。教师 = 同一模型关补丁(官方 = EMA adapter,≈ 冻结)", + "教师 = 冻结的 init_ckpt 副本(--ema_decay 0);官方是学生的 EMA(0.9999,每步更新;3300 步后仍有 72% 初值权重,≈ 冻结)。FSDP 下教师不分片,EMA 需要每步 all-gather,未实现;单进程开 --ema_decay 时教师留 fp32(bf16 吃不进 1e-4 的增量)", + "grad_clip 10.0 / adam_betas 0.0,0.999 = 官方值(不是 deviation,记在这里是因为之前的 1.0 / 0.9,0.95 曾是未记录的偏离)", + "窗口起点固定在段首 cell 0(Wan VAE 的第 0 个 latent 只编码首帧、是 TI2V 的干净锚点,中段 cell 是 4 帧块,不能充当锚点);官方在 GT 长视频里随机取 block 对齐的起点", + "逐 cell backward(4 个去噪状态的图一起反传);官方逐去噪步 backward。重加噪是 detach 的,两者梯度相同,只差活化值峰值", + "条件 = 世界坐标 offset_px + known 掩码 + 逐 cell 场景文本(不是数值动作向量);学生与教师用同一组 off_ext / ctx_ext / ids_ext 对象(assert_same_conditioning 用 is 不用 equal)", + "部署采样器 4 步 1000,750,500,250(上游 GraphGWM 2 步 1000,250)", + "一个 cell = 1 个 latent 帧(同 GraphGWM chunk=1;OPSD-V 是 3)", + "长段数据 data/latent_long/K3(整段一次过 VAE 的 61 cell),不是连续 clip 去锚帧再拼的窗口", + "逐 cell 场景文本(context [b,61,512,4096] + context_ids),不是整条 prompt", + "world-RoPE 几何 sink 3 / kv_window 17 / rope_cap 20 / sink_anchor absolute(stage3 的训练与部署几何)", + "teacher_keep_last 0 = 真值 0..k−1(上游是 0..k−2 加一个洞):forward_frame 的 frames_cached 断言拒绝那种几何", + "loss_start_frame 12(latent cell);GraphGWM 12,官方 21(其 local_attn_size 12 + 3 帧 chunk 的口径)。可用 LOSS_START=20 取\"滑窗刚填满\"的类比", + "产物:dits/ 学生本体(上游)+ ema/ 学生 fp32 EMA 影子(我们的加项);教师冻结不存", + "守卫从第一步起就拦(OPSD 的第 0 步 loss 应当 > 0,没有 stage3 那种'第 0 步恰好 0'的配方性质)" + ], + "_gate": "开跑前 opsd_arope.py 自己会跑:(1) preflight_sliding_kv(3,17,20) —— tiny CPU 模型上把 sink/驱逐/锚定算术跑完整一遍;(2) FSDP 的 use_orig_params 断言;(3) student 与 teacher 初值逐位相同的断言;(4) mask-channel ||W|| 非零的启动日志。每步 opt.step() 之前:gnorm 恰为 0.0 / NaN ⇒ SystemExit;loss 恰为 0.0 且 gnorm 0 ⇒ ZERO-LOSS SystemExit(教师与学生在读同一份上下文)。run.sh 开跑前先跑 --smoke 的六条 CPU 不变量", + "_expected_curve": "第一步 opsd 小但非零(bf16 5B 上量级 1e-3…1e-1),gnorm 有限 > 0。教师冻结 ⇒ loss 缓慢下降是正常的;跌到起点的 15% 以下(COLLAPSE)意味着学生学会了无视自己的缓存 —— 目标的退化极小值,与要修的东西相反。质量判据不是 loss:distill/eval/rollout_eval.py 在 60+ cell 上与 pre-OPSD 的 stage3 EMA 逐 quarter 比远端漂移" +} diff --git a/backup_2026-09-14/code/distill/stage4_opsd/opsd_arope.py b/backup_2026-09-14/code/distill/stage4_opsd/opsd_arope.py new file mode 100644 index 0000000000000000000000000000000000000000..679e9359acfa62c2b8684dfd66fc7382e76cee04 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage4_opsd/opsd_arope.py @@ -0,0 +1,1264 @@ +#!/usr/bin/env python3 +"""stage4:OPSD(On-Policy Self-Distillation)—— 给 stage3 的少步因果学生做后训练,专治误差累积。 + + # 8 卡正式训练(配方常量钉在 run.sh 里,argparse 默认值与 config.json 逐项相同) + DISTILL_NGPU=8 bash distill/stage4_opsd/run.sh + + # CPU 不变量自检(六条,~20 s,不碰 GPU / 真权重 / 真数据;run.sh 开跑前也会先跑它) + CUDA_VISIBLE_DEVICES="" PYTHONPATH=/opt/dlami/nvme/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + .venv/bin/python distill/stage4_opsd/opsd_arope.py --smoke + + # CPU dry run(tiny 三模型 + 合成 61-cell 段,单进程、不经 accelerate / FSDP;验整条训练循环 + 导出) + CUDA_VISIBLE_DEVICES="" PYTHONPATH=/opt/dlami/nvme/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + .venv/bin/python distill/stage4_opsd/opsd_arope.py --dry_run --output /tmp/_dry_opsd --max_steps 3 + +移植自 GraphGWM 的 `train/code_distill/stage4_opsd/opsd_gm.py`(hf/worldmind_ref),那边又是 +MeiGen-AI OPSD-V(arXiv 2607.08766)在动作条件 Wan2.2 上的移植;官方实现 `vendor/OPSD-V` +(model/opsd_streaming_training.py,commit 8ecb193)已逐行核对,差异表见 `distill/OPSD_OFFICIAL_NOTES.md`。 +**机制一字不改**,两处 GraphGWM 与官方不同的地方默认取官方口径(--teacher_last_chunk teacher、 +--loss_norm window,GraphGWM 的口径保留为开关),其余每一处与上游不同的地方都标了 DEVIATION +(也汇总在 config.json 的 _deviations 里)。 + +它修的是什么 +----------- +少步自回归生成器把自己的输出写进 KV 缓存当历史,误差就成了它自己的未来条件、一路复利。 +stage3 的 DMD 只在 21..27 个 cell 的 rollout 上做分布匹配,61 个 cell 的长段(data/latent_long/K3) +要靠 stage4 把学生的"历史被污染之后的预测"拉回"历史干净时的预测"。 + +机制,一句话:**学生保持 on-policy,教师看一份更干净的历史。** + + student 用**部署采样器**(4 步 renoise 表 1000,750,500,250)真的 rollout,把自己的 x0 提交进自己的缓存 + teacher 初值权重的**冻结**副本(--ema_decay 默认 0;官方是学生的 EMA 0.9999 ≈ 冻结),在与学生**同一个** + noisy latent、**同一个**时间步上被求值,但它的缓存里放的是 **真实** latent 0..k−2 + 最近生成的 + cell k−1(默认 = **教师自己**在最后一个去噪步上的 x0,官方 gt_kv 的写法;--teacher_last_chunk student + = GraphGWM 的写法,用学生提交的 x0) + loss 两者速度场的 MSE(float32;--loss_type x0 复现论文的消融,MSE 落在 noisy − σ·v 上), + 对该 cell 的 4 个去噪状态取平均、再除以打分 cell 数(--loss_norm window = 官方的 + Σ step_loss / total_loss_terms),**逐 cell backward**(--backward_per_chunk 1) + +教师不是更大的模型、也不是别的目标 —— 它就是同一张网络,只是被展示了一段没有漂移的历史。梯度说的是 +"假如你的过去是干净的,你会怎么预测",这正是误差累积那一项。 + +教师上下文的那一个实现细节 +------------------------- +cell k 的教师缓存必须是 REAL 0..k−2 + 最近生成的 k−1(官方 gt_kv:"写完当前 chunk 后把倒数第二个 chunk +原位换成 GT,最近一个保留")。官方的 KVCache 是定长数组可以原位改写;我们的滑窗缓存是 append-only 的, +没法把 k−1 换成真值,于是 `cache_r` 恒比学生**滞后一格**:给 cell k 打分时它只装着真值 0..k−2;每个需要教师 +的 cell 先 `snapshot_kv_cache(cache_r)`(浅快照,见 arope_dit),把 k−1 那一格接到**快照**末尾,对着快照打分, +然后把快照 release 掉。k−1 那一格装谁的 x0:`--teacher_last_chunk teacher`(默认,官方:教师自己在最后一步、 +学生的 noisy 上算出的 x0;于是未打分的 cell 也要跑一次教师的最后一步)或 `student`(GraphGWM:学生提交的 x0)。 +`--teacher_keep_last 0` 是纯真值历史的消融(DEVIATION:见下)。 + +★ 官方的**写入顺序**决定了最近一格的 K/V 是在什么上下文里算的,teacher 模式逐字复现它:官方先 +`_write_chunk_to_cache(teacher_chunk)` —— 此刻教师缓存里还是 [GT 0..k−2, 教师的 k−1],教师的 k 的逐层 K/V +(第 1 层起)就嵌着"教师的 k−1";**然后**才 `_replace_cache_chunk_with_gt` 把 k−1 原位换成 GT,且不重算最近一格。 +所以官方打分 k+1 时最近一格的 K/V ≠ "在全 GT 历史上重新 commit 教师的 k"。我们的做法:cell k 打分完,教师把自己 +的 x0 commit 进**它刚打分用的那条快照**(上下文正好是官方的),`last_kv_frame` 取走那格 raw K/V(RoPE 之前, +与位置无关),cell k+1 时 `append_kv_frame` 把它接到真值 0..k−1 的新快照末尾(cat + 驱逐,与 commit 路径同一 +套规则)。latent 与逐层 K/V 都与官方逐 chunk 相同(test_stage4_opsd::test_13 逐位核对)。student 模式(GraphGWM) +保持它原来的口径:学生提交的 x0 在 cell k 才 commit 到真值 0..k−2 的快照上,K/V 在全真值历史上算。 +`--teacher_context student` 是**退化自检**:教师读学生自己的缓存对象,权重相同时 loss 必须**恰好**为 0 +(--smoke 的第 4 条不变量)—— 永远不要拿它训练。 + +顺带一条按构造成立的性质(test_stage4_opsd 钉住了它):cell 1 的教师缓存 = [real 0] = 学生缓存,keep_last=1 时 +cell 2 的 = [real 0, 生成的 1] 也相同(teacher 模式下教师给 cell 1 算的 x0 与学生逐位相同)⇒ 这两个 cell 的 +loss 恰好 0;第一个真正有信号的 cell 是 3。配方的 loss_start 12 远在其外。 + +为什么教师读学生的缓存对象时能逐位相同:`forward_frame` 是 (x, t, 文本, 缓存内容, offset_win, mask) 的 +纯函数 —— 缓存里存的是 RoPE 之前的 raw K 与 V,读的时候按 (tpos, offset_win) 重算 RoPE,和"是谁在读"无关; +commit=False 的趟不写 k/v 列表;瞬态字段(freqs_cur / freqs_hist / hw / layer / commit)每次前向都被重赋值。 +同权重、同 dtype、同输入、同缓存 ⇒ CPU 上逐位相同(SDPA 确定性),loss 不是 ~0 而是 == 0.0。 + +DEVIATIONS(相对 opsd_gm.py / 官方 OPSD-V) +----------------------------------------- +* **训练面 = 官方的 LoRA**(--lora_rank 256,distill/lora.py 自写 LoRALinear,挂 self_attn q/k/v/o + ffn.0/2;alpha=rank)。 + 教师 = 同一模型关掉补丁(TeacherView + lora_disabled,恒为 init_ckpt,不另占显存),对应官方的 teacher adapter + (官方是学生补丁的 EMA 0.9999,3300 步后仍有 72% 初值权重 ≈ 冻结;EMA adapter 未实现,--ema_decay 在 LoRA 模式下拒绝)。 + 存盘用 merged_state_dict 把 B@A 折回 base,dits/ 与 ema/ 仍是 827 键普通权重;续训时补丁从零重新起步。 + --lora_rank 0 = 全量微调(GraphGWM 的替代方案):2026-09-10 实测 lr 1e-6 下 step50 起就比 stage3 基线糊、step100 更糊 + (outputs/distill/eval/stage4_opsd/ema{50,100}_60s_indist),别再用。全量模式下教师才是单独的 bf16 冻结副本。 + 开了 --ema_decay 教师自动留 fp32(bf16 吃不进 1e-4 的 EMA 增量,会静默退化成冻结教师;多占 9.3 GB)。 +* **反传粒度**:逐 cell(4 个去噪状态的图一起);官方逐去噪步。重加噪是 detach 的,梯度相同,只差活化值峰值。 +* **优化器超参**:grad_clip 10.0 / betas (0.0, 0.999) 就是官方的 max_grad_norm_generator / beta1、beta2(也是 + stage3 的值),不是 deviation;lr 1e-6 与全量微调(无 LoRA)是(见下)。 +* **窗口起点**固定在段首 cell 0;官方在 GT 长视频里随机取 block 对齐的起点。Wan VAE 的第 0 个 latent 只编码首帧、 + 是 TI2V 的干净锚点,中段 cell 是 4 帧块,不能充当锚点,所以这里不随机。 +* **loss_start_frame** 12(GraphGWM);官方 21(3 帧 chunk × 7,其 local_attn_size 12)。LOSS_START=20 是 + "滑窗刚填满"的类比,是配置项不是代码。 +* **条件是世界坐标 + known 掩码 + 逐 cell 场景文本**,不是数值动作向量。学生与教师用**同一组** + off_ext / ctx_ext / ids_ext 对象(上游的 assert_same_action 在这里变成 `assert_same_conditioning`: + 三条流必须是同一个对象,不是"相等")。窗口锚定的 offset_win / mask_in_k 由 stage3 的 `frame_cond` 现算, + 两个模型拿到的是同一份 (ow, mk)。 +* **部署采样器是 4 步** 1000,750,500,250(flow_pf.deploy_schedule;上游 GraphGWM 是 2 步 1000,250)。 + renoise 链与 dmd_arope.self_forcing_rollout / rollout_eval.deploy_rollout 逐行相同: + den = noisy − σ_i·v;noisy_next = (1−σ_{i+1})·den.detach() + σ_{i+1}·新噪声;最后以 t=0 提交 den.detach()。 +* **一个 cell = 1 个 latent 帧**(与 GraphGWM 的 chunk=1 相同;OPSD-V 是 3)。 +* **长段数据**:data/latent_long/K3 的 61-cell 段(整段一次过 VAE,不是上游那种"连续 clip 去掉锚帧再拼"的窗口), + cell 0 是两个缓存共同的真实锚点,真值 1..60 是教师的干净历史。 +* **几何**:sink 3 / kv_window 17 / rope_cap 20 / sink_anchor absolute —— 这就是 stage3 训练与用户部署的几何 + (outputs/distill/stage3_dmd/config.json),不是 stage3 argparse 里的 0/20/20。 +* **--teacher_keep_last 0 的语义**:上游把它实现成"真值 0..k−2、k−1 是个洞"(KVCache 不查帧数,教师在时间位 + k−1 上给 cell k 打分)。我们的 forward_frame 硬断言 frames_cached == frame_index,拒绝那种几何,所以这里 + keep_last=0 = 真值 0..k−1(用真值 k−1 **替换**学生的 k−1)—— 这才是"纯真值历史"该有的意思。 +* **全量微调**(无 LoRA 路径),lr 1e-6(stage3 在 2e-6 稳、5e-6 崩;后训练再压一档)。 +* **产物**:dits/dit_step{N} 是上游的部署产物(学生本体,教师冻结所以不存);ema/ema_step{N} 是我们 + **额外**维护的学生 fp32 EMA 影子(decay 0.99,ema_start 50),作为部署候选之一,逐个里程碑挑。 + +三条守卫(都是"能跑、看着正常、其实没在训"的那一类) +---------------------------------------------- +0. COLLAPSE 监测(上游 healthcheck.py):最近 log_every 步的 opsd 均值跌到前 10 步均值的 15% 以下 ⇒ 打 + `[warn] COLLAPSE?`(不中止:lr 1e-6 下缓慢下降是预期;判据在 60+ cell rollout 的远端漂移)。 +1. rope_cap == sink_size + kv_window(解析期 + init_kv_cache 双重断言)。 +2. 每一步 opt.step() 之前查 gnorm:恰为 0.0 / NaN ⇒ SystemExit。与 stage3 的 S3-GUARD-3 不同,OPSD 的 + 第 0 步 loss 就应当 > 0(教师看真值历史、学生看自己的),所以从第一步起就拦,不给豁免。 +3. ZERO-LOSS:loss 恰为 0.0 且 gnorm 为 0 ⇒ 教师与学生在读**同一份**上下文(上游第一次 launch 就是这样 + 静默跑了 6 小时:FSDP 重建了 dict 缓存,每一帧都在对空历史打分)⇒ SystemExit。 + 健康的第一步:opsd **小但非零**(bf16 5B 上量级 1e-3…1e-1),gnorm 有限且 > 0。 +""" +from __future__ import annotations + +import argparse +import math +import os +import platform +import socket +import sys +import time + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +# 分配器要在 import torch 之前设:launch 时 export 的环境变量到不了 accelerate 拉起的子进程 +os.environ.setdefault("PYTORCH_CUDA_ALLOC_CONF", "expandable_segments:True") + +import torch +import torch.nn.functional as F + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.dataset import TEXT_TABLES, arope_collate # noqa: E402 +from distill import runlib # noqa: E402 +from distill.arope_dit import MODEL_DIR, AropeDiT, append_kv_frame, last_kv_frame, snapshot_kv_cache, unwrap # noqa: E402 +from distill.data import assert_rollout_aligned, to_device # noqa: E402 +from distill import lora as lora_mod # noqa: E402 +from distill.ema import ema_update # noqa: E402 +from distill.flow_pf import deploy_schedule # noqa: E402 +# 几何必须与 stage3 rollout 时**同一个函数**算出来(窗口锚定 offset_win + 当前 cell 的 known 掩码) +from distill.stage3_dmd.dmd_arope import frame_cond # noqa: E402 +from distill.tests.preflight import preflight_sliding_kv, tiny_arope_dit # noqa: E402 + +STAGE = "stage4_opsd" +MASK_EMBEDDING_NAME = runlib.MASK_EMBEDDING_NAME + + +class TeacherView(torch.nn.Module): + """LoRA 模式的教师:**同一个**(可能被 FSDP 包着的)学生,前向时关掉 LoRA 补丁 ⇒ 逐位等于冻结的 base + (= --init_ckpt)。官方 OPSD-V 就是同一模型换 adapter(_swap_generator_to_ema);这里 base 冻结,所以教师恒为初值。 + 不注册成子模块(object.__setattr__),parameters() 为空;`unwrap()` 顺着 .module 能拿到裸 AropeDiT。""" + + def __init__(self, student: torch.nn.Module): + super().__init__() + object.__setattr__(self, "module", student) + + def forward(self, *a, **kw): + with lora_mod.lora_disabled(unwrap(self.module).dit): + return self.module(*a, **kw) + + +# ---------------------------------------------------------------------------- +# 对齐闸(上游 opsd_gm.py 的 assert_window_geometry / assert_same_action) +# ---------------------------------------------------------------------------- + +def assert_window_geometry(sink_size: int, kv_window: int, rope_cap: int) -> None: + """rope_cap == sink + kv_window 是解析约束不是旋钮:每次注意力读到的必须正好是 1+rope_cap 个 cell、 + 时间位 0..rope_cap —— 模型训练时的包络。差一格就是训练时没见过的相对距离,不报错、只训歪。""" + if rope_cap != sink_size + kv_window: + raise ValueError(f"window geometry broken: rope_cap {rope_cap} != sink {sink_size} + " + f"kv_window {kv_window}(解析约束,见 arope_dit.init_kv_cache)") + + +def assert_same_conditioning(student_cond: dict, teacher_cond: dict) -> None: + """教师必须对**同一份**条件打分。上游是 `torch.equal(student_act, teacher_act)`;这里的条件是 + 世界坐标 offset_px / 逐 cell 文本 / 文本 id 三条流,要求它们是**同一个对象**(`is`)而不只是相等: + 教师若拿到另一条几何或另一段文本,监督的就是另一段视频,loss 曲线上完全看不出来。""" + for key in ("offset_px", "context", "context_ids"): + if student_cond[key] is not teacher_cond[key]: + raise ValueError(f"teacher/student conditioning mismatch on {key!r}:教师会去监督另一段视频" + "(见文件头 DEVIATIONS)") + + +# ---------------------------------------------------------------------------- +# OPSD 的一步(上游 opsd_step) +# ---------------------------------------------------------------------------- + +def opsd_step(student, teacher, real_latent: torch.Tensor, ctx_ext: torch.Tensor, ids_ext: torch.Tensor, + off_ext: torch.Tensor, deploy: tuple, args, *, gen: torch.Generator | None = None, + backward_fn=None, check_snapshot: bool = False): + """一条 on-policy rollout + 逐 cell 的 OPSD 监督。 + + real_latent [b,48,T,h,w] 真实段:cell 0 是 rollout 的锚点(两个缓存都从它起步),1..T−1 是教师的干净历史 + (学生**从不**看到它们) + ctx_ext / ids_ext [b,T,L,4096] / [b,T] 逐 cell 场景文本(两个模型共用,cell k 用 [:, k]) + off_ext [b,T,2] px,**绝对**世界坐标(cell 0 = 0);窗口锚定在每个 cell 现算 + deploy flow_pf.deploy_schedule 的 (idx, sigma, t_grid) + backward_fn(loss) 每个打分 cell 调一次(--backward_per_chunk 1);None ⇒ 只算不回传 + check_snapshot True ⇒ 每个打分 cell 断言快照没有动过 cache_r(smoke / 单测用) + 返回 (平均 cell loss(float,只为日志), info dict)。 + """ + b, c, T, lat_h, lat_w = real_latent.shape + dev = real_latent.device + _, sig_dep, t_dep = deploy + nsteps = len(t_dep) + assert T >= 2, f"至少要 2 个 cell(锚点 + 1 个生成 cell),得到 {T}" + assert_window_geometry(args.sink_size, args.kv_window, args.rope_cap) + assert_rollout_aligned(off_ext, ctx_ext, ids_ext, T - 1, latent=real_latent) + assert bool(torch.all(off_ext[:, 0] == 0)), "off_ext 必须是以 cell 0 为原点的绝对世界坐标" + # 上游 assert_same_action 的 ActionRoPE 版在这里是**结构性**保证:下面的 _call 只从这一个 cond 字典取三条条件流, + # 两个模型不可能拿到不同对象(assert_same_conditioning 留给外部调用方比较两份独立构造的条件) + cond = {"offset_px": off_ext, "context": ctx_ext, "context_ids": ids_ext} + + keep_last = bool(args.teacher_keep_last) + ctx_student = (args.teacher_context == "student") + # 教师缓存里 k−1 那一格装什么(只在 keep_last=1 时有意义): + # teacher = 官方 OPSD-V:教师自己在最后一个去噪步上的 x0(opsd_streaming_training._write_chunk_to_cache(teacher_chunk)) + # student = GraphGWM opsd_gm.py:学生提交的 x0 + # 官方教师是学生的 EMA(0.9999),两者几乎相同;冻结教师下会慢慢分开。 + last_src = getattr(args, "teacher_last_chunk", "teacher") + assert last_src in ("teacher", "student"), last_src + # loss 归一化:window = 官方的 Σ step_loss / total_loss_terms(整个窗口所有打分 (cell, step) 对取平均, + # 逐 cell backward 时每个 cell 的均值再除以打分 cell 数);cell = GraphGWM(每个 cell 的均值直接 backward, + # 总梯度是 window 的 n_scored 倍,只有 clip 与日志里的 gnorm 受影响) + loss_norm = getattr(args, "loss_norm", "window") + assert loss_norm in ("window", "cell"), loss_norm + n_scored_total = sum(1 for kk in range(1, T) if kk >= args.loss_start_frame) + cell_scale = (1.0 / max(n_scored_total, 1)) if loss_norm == "window" else 1.0 + debug = bool(os.environ.get("OPSD_DEBUG")) + + bare_s, bare_t = unwrap(student), unwrap(teacher) + kw = dict(kv_window=args.kv_window, sink_size=args.sink_size, rope_cap=args.rope_cap) + cache_s = bare_s.init_kv_cache(**kw) # 学生:它**自己**生成的历史(on-policy) + cache_r = bare_t.init_kv_cache(**kw) # 教师:真值历史,滞后一格(见文件头) + zeros = torch.zeros(b, device=dev) + + # 每个 cell 的空间条件只算一次,学生与教师拿到**同一份** (ow, mk) 对象 + conds: dict[int, tuple] = {} + + def cond_k(k: int): + if k not in conds: + ow_, mk_ = frame_cond(cond["offset_px"], k, args.sink_size, args.kv_window, lat_h, lat_w, + args.sink_anchor) + # FSDP 的根前向会把 fp32 浮点输入统一转成 bf16(cast_root_forward_inputs),而裸教师拿到的是原 fp32 + # ⇒ 两个模型的 offset_win 不再逐位相同(|off|≤500 px 时最多差 1 px = 1/32 token)。这里先按 latent 的 + # dtype 量化一次,再把**同一份**对象给两个模型:GPU 上 FSDP 的 cast 变成空操作;CPU/fp32 下是恒等。 + conds[k] = (ow_.to(real_latent.dtype), mk_.to(real_latent.dtype)) + return conds[k] + + def _call(model, cache, x, t, k, commit, ow, mk): + # 必须走 forward(..., kv_cache=):FSDP 的 all-gather 挂在包装模块的 forward 上(risk 2); + # first_frame_cond=False 是流式路径的铁律(arope_dit BLOCKER B1) + return model(x, t, cond["context"][:, k:k + 1], context_ids=cond["context_ids"][:, k:k + 1], + first_frame_cond=False, frame_index=k, kv_cache=cache, commit=commit, + offset_win=ow, mask_in_k=mk) + + # ---- cell 0:唯一一个两边都从它起步的真实帧,t=0 提交 ---- + ow0, mk0 = cond_k(0) + with torch.no_grad(): + _call(student, cache_s, real_latent[:, :, 0:1], zeros, 0, True, ow0, mk0) + _call(teacher, cache_r, real_latent[:, :, 0:1], zeros, 0, True, ow0, mk0) + + def advance_real(upto: int) -> None: + """把真值 cell 提交进 cache_r,直到它装着真值 0..upto(每次都是 t=0、no_grad)。""" + with torch.no_grad(): + while cache_r["frames_cached"] <= upto: + j = cache_r["frames_cached"] + owj, mkj = cond_k(j) + _call(teacher, cache_r, real_latent[:, :, j:j + 1], zeros, j, True, owj, mkj) + assert cache_r["frames_cached"] == upto + 1, (cache_r["frames_cached"], upto) + + # 教师缓存里 k−1 那一格从哪来(只在 keep_last=1 时有意义): + # teacher 模式 = 官方的**写入顺序**:cell k−1 打分完,教师把自己的 x0 T_{k−1} commit 进**它刚打分用的那条快照** + # (里面是真值 0..k−3 + 教师的 k−2 —— 正是官方 _write_chunk_to_cache(teacher_chunk) 那一刻缓存里的东西, + # 倒数第二格换成 GT 是**之后**的事、且不重算最近一格),`last_kv_frame` 取走那格 raw K/V(prev_kv);cell k 时 + # `append_kv_frame` 把它接到真值 0..k−2 的新快照末尾。latent 与逐层 K/V 都与官方逐 chunk 相同。 + # 若改成在 cell k 把 T_{k−1} 重新 commit 到真值 0..k−2 的快照上,latent 相同、但第 1 层起的 K/V 是在全真值 + # 历史上算的(官方的嵌着教师的 k−2),教师轨迹从 cell 3 起就与官方分道 —— 这里不这么做。 + # student 模式 = GraphGWM:prev_last = 学生提交的 x0,cell k 时 commit 进真值 0..k−2 的快照(K/V 在全真值历史上算)。 + prev_kv, prev_last = None, None + teacher_write = keep_last and last_src == "teacher" + tot, n_states, per_cell = 0.0, 0, [] + for k in range(1, T): + ow, mk = cond_k(k) + scored = k >= args.loss_start_frame + # ★ 滞后的真值缓存。keep_last=1:打分 cell k 时装着真值 0..k−2(k−1 那一格留给最近生成的 chunk); + # keep_last=0:装着真值 0..k−1(DEVIATION:上游此处留一个洞,我们的 frames_cached 断言不收)。 + # 不打分的 cell 也要推进,否则后面第一个打分 cell 要一口气补几十格。 + advance_real(max(0, k - 2) if keep_last else k - 1) + # 教师这一格要不要跑:打分 cell 每个去噪步都跑;teacher 模式下未打分的 cell 也要跑**最后一步**,拿它的 x0 + # 写进缓存当下一格的教师上下文(官方教师每个 chunk 都跑、每个 chunk 都把自己的 x0 写进缓存;读趟不改缓存, + # 只跑最后一步与全跑等价)。student 模式 / keep_last=0 下未打分 cell 不需要教师。 + need_teacher = (not ctx_student) and (scored or teacher_write) + + cache_t = None + snap_guard = None + if scored and ctx_student: + # 退化自检:教师读学生自己的缓存对象。权重相同 ⇒ loss 必须恰好是 0 + cache_t = cache_s + elif need_teacher: + cache_t = snapshot_kv_cache(cache_r) + if check_snapshot: + # 在往快照里写 **之前**记下原缓存的状态:快照若共享了 k/v 列表,下面这一步 commit / append 就会露馅 + snap_guard = (cache_r["frames_cached"], [id(t) for t in cache_r["k"]], + [id(t) for t in cache_r["v"]], cache_r["k"][0].clone()) + if keep_last and k >= 2: + if teacher_write: + # 官方:最近一格 = 教师的 k−1,其 K/V 是在 [真值 0..k−3, 教师的 k−2] 上写下的(见上) + assert prev_kv is not None, f"cell {k}:上一格没有留下教师的 K/V" + append_kv_frame(cache_t, prev_kv[0], prev_kv[1], k - 1) + prev_kv = None + else: + ow_p, mk_p = cond_k(k - 1) + with torch.no_grad(): + _call(teacher, cache_t, prev_last, zeros, k - 1, True, ow_p, mk_p) + if cache_t is not None: + assert cache_t["frames_cached"] == k, ( + f"教师缓存在 cell {k} 上装着 {cache_t['frames_cached']} 个 cell,应为 {k}") + + noisy = torch.randn(b, c, 1, lat_h, lat_w, device=dev, dtype=real_latent.dtype, generator=gen) + cell_loss, den, den_t = 0.0, None, None + for si in range(nsteps): + ts_k = torch.full((b,), float(t_dep[si]), device=dev) + s_i = float(sig_dep[si]) + with (torch.enable_grad() if scored else torch.no_grad()): + v_s = _call(student, cache_s, noisy, ts_k, k, False, ow, mk) + den = noisy - s_i * v_s # x0 估计 + if cache_t is not None and (scored or si == nsteps - 1): + with torch.no_grad(): # 同一个 noisy、同一个 t(trajectory_mode=student) + v_t = _call(teacher, cache_t, noisy, ts_k, k, False, ow, mk) + den_t = noisy - s_i * v_t # 教师在学生轨迹上的 x0(官方的 teacher_chunk) + if scored: + if args.loss_type == "flow": + l_si = F.mse_loss(v_s.float(), v_t.float()) + else: # x0 消融 + l_si = F.mse_loss(den.float(), den_t.float()) + if debug and k < args.loss_start_frame + 3: + hw_ = cache_s["hw"] + nf = lambda cc: (0 if cc["k"][0] is None else cc["k"][0].shape[1] // hw_) # noqa: E731 + print(f" [dbg] k={k} si={si} t={float(t_dep[si]):.0f} cache_s={nf(cache_s)} " + f"cache_t={nf(cache_t)} cache_r={nf(cache_r)} |v_s|={v_s.float().norm():.2f} " + f"|v_t|={v_t.float().norm():.2f} |d|={(v_s.float() - v_t.float()).norm():.3e} " + f"v_s.req_grad={v_s.requires_grad}", flush=True) + cell_loss = cell_loss + l_si + n_states += 1 + if si + 1 < nsteps: + ns = float(sig_dep[si + 1]) # x0 → 下一档,重新加噪(detach) + noisy = (1.0 - ns) * den.detach() + ns * torch.randn( + den.shape, device=dev, dtype=den.dtype, generator=gen) + + if scored: + cell_loss = cell_loss / max(nsteps, 1) + if backward_fn is not None: + # 逐 cell backward:图只活到这里(提交全 detach)。cell_scale 见上:window 归一化 = 官方口径 + backward_fn(cell_loss * cell_scale if cell_scale != 1.0 else cell_loss) + val = float(cell_loss.detach()) + tot += val + per_cell.append(val) + del cell_loss + # ---- 官方 _write_chunk_to_cache(teacher_chunk):教师把自己的 x0 写进**它刚打分用的**那条缓存(t=0、no_grad), + # 取走这一格的 raw K/V 给下一个 cell 拼教师上下文;最后一个 cell 之后没人用,不写 ---- + if teacher_write and cache_t is not None and cache_t is not cache_s and k + 1 < T: + with torch.no_grad(): + _call(teacher, cache_t, den_t.detach(), zeros, k, True, ow, mk) + prev_kv = last_kv_frame(cache_t) + if snap_guard is not None: + fc0, kid, vid, k0 = snap_guard + assert cache_r["frames_cached"] == fc0, "快照把 cache_r 的 frames_cached 推进了" + assert [id(t) for t in cache_r["k"]] == kid and [id(t) for t in cache_r["v"]] == vid, \ + "快照把 cache_r 的 K/V 槽位换掉了 —— 浅快照不再是独立分支" + assert torch.equal(cache_r["k"][0], k0), "快照就地改写了 cache_r 的张量" + if cache_t is not None and cache_t is not cache_s: + bare_t.release_kv_cache(cache_t) # 快照自带 _ref 引用环,用完立刻断 + # ---- 学生提交**自己的**帧(on-policy):detach 过的 x0 + t=0,每个 frame_index 恰好一次 ---- + with torch.no_grad(): + commit = den.detach() + _call(student, cache_s, commit, zeros, k, True, ow, mk) + prev_last = commit # student 模式下一格的教师上下文(teacher 模式用 prev_kv) + del den, den_t + + bare_s.release_kv_cache(cache_s) # cache 与 _ref 成环,不显式清会拖着十几 GB 不放 + bare_t.release_kv_cache(cache_r) + info = {"n_scored_cells": len(per_cell), "n_scored_states": n_states, "T": T, + "cell_scale": cell_scale, "teacher_last_chunk": last_src, "loss_norm": loss_norm, + "first_cell": (per_cell[0] if per_cell else float("nan")), + "last_cell": (per_cell[-1] if per_cell else float("nan")), "per_cell": per_cell} + return tot / max(len(per_cell), 1), info + + +# ---------------------------------------------------------------------------- +# CPU 不变量自检(上游 smoke() 的六条) +# ---------------------------------------------------------------------------- + +SMOKE_TINY = dict(dim=24, ffn_dim=48, num_heads=2, num_layers=2) # preflight 的 tiny(latent 4×4) +SMOKE_LAT = (4, 4) + + +def _smoke_model(seed: int = 1234) -> AropeDiT: + m = tiny_arope_dit(causal=True, seed=seed, device="cpu", dtype=torch.float32, **SMOKE_TINY) + m.eval() + return m + + +def _smoke_inputs(T: int, seed: int, lat=SMOKE_LAT, l_txt: int = 4): + g = torch.Generator().manual_seed(seed) + lh, lw = lat + real = torch.randn(1, 48, T, lh, lw, generator=g) + ctx = torch.randn(1, T, l_txt, 4096, generator=g) + ids = torch.arange(T, dtype=torch.int64).unsqueeze(0) + off = torch.zeros(1, T, 2) + off[:, 1:] = torch.randn(1, T - 1, 2, generator=g).cumsum(1) * 12.0 + return real, ctx, ids, off + + +def smoke(log=print) -> None: + """形状、梯度流、以及整个方法赖以成立的两条性质 —— 全在 CPU tiny 模型上。""" + torch.manual_seed(0) + args = argparse.Namespace(kv_window=5, rope_cap=6, sink_size=1, sink_anchor="absolute", + loss_start_frame=2, teacher_keep_last=1, loss_type="flow", + teacher_context="real", teacher_last_chunk="teacher", loss_norm="window") + assert_window_geometry(args.sink_size, args.kv_window, args.rope_cap) + try: + assert_window_geometry(1, 5, 7) + except ValueError: + pass + else: + raise AssertionError("rope_cap != sink + kv_window 没有被拦住") + log("[1] window geometry rope_cap == sink + kv_window OK") + + st = _smoke_model(seed=1234) + te = _smoke_model(seed=1234) # 同种子 ⇒ 逐位相同的初值 = 冻结教师 + for (n1, p1), (n2, p2) in zip(st.state_dict().items(), te.state_dict().items()): + assert n1 == n2 and torch.equal(p1, p2), f"教师与学生初值不同:{n1}" + te.requires_grad_(False) + deploy = deploy_schedule((1000.0, 750.0, 500.0, 250.0)) # 部署表:4 步 + n_dep = len(deploy[2]) + T = 8 + real, ctx, ids, off = _smoke_inputs(T, seed=0) + + grads = [] + + def bwd(l): + l.backward() + grads.append(sum(float(p.grad.norm()) for p in st.parameters() if p.grad is not None)) + + loss, info = opsd_step(st, te, real, ctx, ids, off, deploy, args, + gen=torch.Generator().manual_seed(1), backward_fn=bwd, check_snapshot=True) + log(f"[2] rollout ran: loss {loss:.6f} scored {info['n_scored_cells']} cells / " + f"{info['n_scored_states']} states") + assert info["n_scored_cells"] == T - args.loss_start_frame, info + assert info["n_scored_states"] == info["n_scored_cells"] * n_dep, info + log(f"[3] loss applied at every one of the {n_dep} denoise states of every scored cell OK") + assert grads and grads[-1] > 0 and math.isfinite(grads[-1]), "no gradient reached the student" + log(f"[4] gradient reaches the student: |g| {grads[-1]:.4e} after {len(grads)} cells OK") + + # ★ 整个方法赖以成立的性质:教师权重相同 **且** 上下文相同 ⇒ loss 恰好为 0(不是 ~0)。 + # 否则学生与教师不在同一个 (noisy, timestep, 缓存) 状态上,之后每个数字量的都是这个错位。 + st.zero_grad(set_to_none=True) + real2, ctx2, ids2, off2 = _smoke_inputs(T, seed=5) + a_self = argparse.Namespace(**{**vars(args), "teacher_context": "student"}) + l_same, _ = opsd_step(st, st, real2, ctx2, ids2, off2, deploy, a_self, + gen=torch.Generator().manual_seed(2), backward_fn=None) + l_copy, _ = opsd_step(st, te, real2, ctx2, ids2, off2, deploy, a_self, + gen=torch.Generator().manual_seed(2), backward_fn=None) + log(f"[5] same weights, teacher reads the STUDENT cache -> loss {l_same:.3e} / " + f"{l_copy:.3e} (same object / identical copy) (must be exactly 0)") + assert l_same == 0.0 and l_copy == 0.0, ( + f"identical weights on identical context must give EXACTLY 0, got {l_same} / {l_copy} — " + "student and teacher are NOT at the same (noisy, timestep, cache) state") + + # ...真值历史下必须非零,否则 GT 上下文根本没进前向,OPSD 会静默地训向 0 + l_real, _ = opsd_step(st, te, real2, ctx2, ids2, off2, deploy, args, + gen=torch.Generator().manual_seed(2), backward_fn=None, check_snapshot=True) + log(f"[6] same weights, teacher reads the REAL history -> loss {l_real:.3e} (must be > 0)") + assert l_real > 1e-10, ("teacher context had no effect — the GT history is not reaching the " + "forward, so OPSD would be a no-op training toward 0") + log(f" -> the whole gradient signal is this gap: {l_real:.3e}") + + # 第 6 条不变量的直接形式:快照上 commit 一格,原缓存的槽位 / 张量 / frames_cached 都不动 + bare = unwrap(st) + cache = bare.init_kv_cache(kv_window=args.kv_window, sink_size=args.sink_size, rope_cap=args.rope_cap) + lh, lw = SMOKE_LAT + with torch.no_grad(): + for j in range(3): + owj, mkj = frame_cond(off2, j, args.sink_size, args.kv_window, lh, lw) + st(real2[:, :, j:j + 1], torch.zeros(1), ctx2[:, j:j + 1], context_ids=ids2[:, j:j + 1], + first_frame_cond=False, frame_index=j, kv_cache=cache, commit=True, offset_win=owj, mask_in_k=mkj) + ids_before = [id(t) for t in cache["k"]] + k0 = cache["k"][0].clone() + snap = snapshot_kv_cache(cache) + ow3, mk3 = frame_cond(off2, 3, args.sink_size, args.kv_window, lh, lw) + st(real2[:, :, 3:4], torch.zeros(1), ctx2[:, 3:4], context_ids=ids2[:, 3:4], + first_frame_cond=False, frame_index=3, kv_cache=snap, commit=True, offset_win=ow3, mask_in_k=mk3) + assert cache["frames_cached"] == 3 and snap["frames_cached"] == 4 + assert [id(t) for t in cache["k"]] == ids_before and torch.equal(cache["k"][0], k0) + assert snap["k"][0] is not cache["k"][0] and snap["_ref"].cache is snap and cache["_ref"].cache is cache + AropeDiT.release_kv_cache(snap) + assert cache["k"][0] is not None and cache["frames_cached"] == 3 + AropeDiT.release_kv_cache(cache) + log("[7] snapshot_kv_cache is an independent branch: original cache untouched after a commit OK") + + # LoRA 训练面:装补丁(B=0)后学生 ≡ base;教师 = 同一模型关掉补丁 ⇒ 与"独立冻结教师"的 loss 逐位相同; + # 梯度只落在 lora_A/B 上;补丁动过之后教师视图仍逐位等于 base;折叠后的 state_dict 键集与原模型相同 + st_l = _smoke_model(seed=1234) + keys0 = set(st_l.state_dict().keys()) + lora_mod.install_lora(st_l.dit, rank=4, alpha=4, is_student=False, log=lambda *_: None) + te_v = TeacherView(st_l) + l_ref, _ = opsd_step(st, te, real2, ctx2, ids2, off2, deploy, args, gen=torch.Generator().manual_seed(3), backward_fn=None) + l_lora, _ = opsd_step(st_l, te_v, real2, ctx2, ids2, off2, deploy, args, gen=torch.Generator().manual_seed(3), backward_fn=None) + assert l_lora == l_ref, f"LoRA 学生(B=0) + 关补丁教师 的 loss 必须逐位等于独立冻结教师:{l_lora} vs {l_ref}" + opsd_step(st_l, te_v, real2, ctx2, ids2, off2, deploy, args, gen=torch.Generator().manual_seed(3), + backward_fn=lambda l: l.backward()) + got = {n for n, p_ in st_l.named_parameters() if p_.grad is not None and float(p_.grad.abs().sum()) > 0} + assert got and all(n.endswith(("lora_A", "lora_B")) for n in got), f"梯度落到了非 LoRA 参数上:{sorted(got)[:5]}" + with torch.no_grad(): + for p_ in lora_mod.lora_parameters(st_l.dit): + p_.add_(torch.randn_like(p_) * 0.05) + x = real2[:, :, 0:1] + o_base = st(x, torch.full((1,), 500.0), ctx2[:, 0:1], context_ids=ids2[:, 0:1], first_frame_cond=False) + with lora_mod.lora_disabled(st_l.dit): + o_off = st_l(x, torch.full((1,), 500.0), ctx2[:, 0:1], context_ids=ids2[:, 0:1], first_frame_cond=False) + o_on = st_l(x, torch.full((1,), 500.0), ctx2[:, 0:1], context_ids=ids2[:, 0:1], first_frame_cond=False) + assert torch.equal(o_off, o_base) and not torch.equal(o_on, o_base), "关补丁前向必须逐位等于 base,开补丁必须不同" + merged = lora_mod.merged_state_dict(st_l.dit, {("dit." + k): v for k, v in st_l.dit.state_dict().items()}) + assert set(merged.keys()) == keys0, f"折叠后的键集变了:{sorted(set(merged) ^ keys0)[:5]}" + log(f"[8] LoRA: B=0 时 loss 逐位等于独立教师 ({l_lora:.3e});梯度只在 lora_A/B({len(got)} 个);" + "关补丁前向 == base;折叠后键集不变 OK") + log("\nALL SMOKE CHECKS PASS") + + +# ---------------------------------------------------------------------------- +# 参数 +# ---------------------------------------------------------------------------- + +def parse_args(argv=None): + ap = argparse.ArgumentParser(description="stage4:OPSD(ActionRoPE)") + # 默认值 = distill/stage4_opsd/run.sh 的实参 = config.json(三处配方,risk 11) + ap.add_argument("--smoke", action="store_true", help="CPU 六条不变量自检,不碰 GPU / 权重 / 数据") + ap.add_argument("--dry_run", action="store_true", help="tiny 三模型 + 合成 61-cell 段,单进程(不经 accelerate / FSDP)") + ap.add_argument("--init_ckpt", default=None, + help="要后训练的 stage3 **ema/ema_step{N}.safetensors**(学生与冻结教师都从它起步;不是 dits/)") + ap.add_argument("--allow_raw_student", action="store_true", + help="允许 --init_ckpt 指向 dits/(stage3 的部署产物是 ema/,dits/ 只为续训存在;拿错了静默降质)") + ap.add_argument("--model_dir", default=MODEL_DIR) + ap.add_argument("--output", default=None, help="run 目录;相对路径按 runlib.resolve_run_dir 解析") + + ap.add_argument("--seg_dir", default=os.path.join(ROOT, "data/latent_long/K3"), + help="make_long_segments 的长段目录(seg*.pt:latent [48,61,30,52] + offset_px [61,2] + 61 条 prompt)") + ap.add_argument("--text_table", default=TEXT_TABLES["scene"]) + ap.add_argument("--limit", type=int, default=0, help="smoke 用:只取这么多段;0 = 全部") + ap.add_argument("--scene_dropout", type=float, default=0.0, + help="0:rollout 要按真实场景条件走,教师与学生看同一条文本") + + # ---- rollout / 部署几何 ---- + ap.add_argument("--rollout_cells", type=int, default=61, + help="TOTAL cell 数(含锚点 cell 0)。必须 ≤ 段长(61);更短就切片。61 cell = 241 帧 = 15 s," + "跨过 stage3 只练到的 27 cell,rollout 里必须**装得下要修的那个现象**") + ap.add_argument("--denoise_list", default="1000,750,500,250", + help="必须是部署表:OPSD 监督的是**上线的那个采样器**") + ap.add_argument("--kv_window", type=int, default=17) + ap.add_argument("--sink_size", type=int, default=3) + ap.add_argument("--rope_cap", type=int, default=20, help="硬不变量 rope_cap == sink_size + kv_window") + ap.add_argument("--sink_anchor", choices=("absolute", "window"), default="absolute", + help="sink_size>0 时世界坐标锚在哪(同 stage3)。absolute = stage3 训练与部署用的") + + # ---- OPSD ---- + ap.add_argument("--loss_type", default="flow", choices=["flow", "x0"], + help="flow = 速度场(论文消融的赢家);x0 只为复现那条消融") + ap.add_argument("--loss_start_frame", type=int, default=12, + help="这之前的 cell 只 rollout 不打分(单个真实锚点还在主导;上游 21 是 7 个 3 帧 chunk," + "我们按 latent cell 算)") + ap.add_argument("--teacher_context", default="real", choices=["real", "student"], + help="real = 方法本体。student = 退化自检(权重未变时 loss 必须恰好 0),**永远不要拿它训练**") + ap.add_argument("--teacher_keep_last", type=int, default=1, + help="1 = 教师保留学生最新的 cell(论文);0 = 纯真值历史 0..k−1(DEVIATION,见文件头)") + ap.add_argument("--teacher_last_chunk", default="teacher", choices=["teacher", "student"], + help="keep_last=1 时教师缓存里 k−1 那一格装什么:teacher = 官方 OPSD-V(教师自己在最后一个去噪步上的 " + "x0,_write_chunk_to_cache(teacher_chunk));student = GraphGWM(学生提交的 x0)。官方教师是学生" + "的 EMA(0.9999),两者几乎相同;冻结教师下会慢慢分开") + ap.add_argument("--loss_norm", default="window", choices=["window", "cell"], + help="window = 官方:Σ step_loss / total_loss_terms(整个窗口所有打分 (cell, step) 对取平均);" + "cell = GraphGWM:每个 cell 的均值直接 backward(总梯度是 window 的 n_scored 倍,只影响 clip 与 gnorm)") + ap.add_argument("--backward_per_chunk", type=int, default=1, + help="1 = 逐 cell backward(活化值有界:4 个去噪状态的图)。0 未实现(整条 rollout 的图装不下)") + ap.add_argument("--ema_decay", type=float, default=0.0, + help="**教师**的 EMA 衰减。0 = 冻结在初值(默认;上游参考实现 0.9999×200 步 ≈ 0.98 保留初值," + "近似冻结)。>0 让教师漂向学生,目标的极小值就变成一个**无视缓存**的模型 —— " + "改之前看 main() 里更新点的注释") + + # ---- 优化器 ---- + ap.add_argument("--lora_rank", type=int, default=256, + help="★ 官方 OPSD-V 的训练面:只训 rank 256 的 LoRA(self_attn q/k/v/o + ffn,distill/lora.py)," + "教师 = 同一模型关掉补丁(恒为 init_ckpt)。0 = 全量微调(2026-09-10 实测 step50 起就糊," + "step100 更糊 —— 全量下 t=1000 那步的不可达目标把预测拉向均值),全量时 lr 要降到 1e-6") + ap.add_argument("--lora_alpha", type=int, default=0, help="默认 = lora_rank,即 scale 1.0(官方)") + ap.add_argument("--lr", type=float, default=1e-5, + help="官方 LoRA 的 lr 1e-5。全量微调(--lora_rank 0)用 1e-6(stage3 在 5e-6 崩、2e-6 稳)") + ap.add_argument("--weight_decay", type=float, default=0.0) + ap.add_argument("--adam_betas", default="0.0,0.999", + help="官方 OPSD-V(configs/train_self_forcing_lora.yaml beta1 0.0 / beta2 0.999),也是 stage3 的值") + ap.add_argument("--warmup", type=int, default=50, help="线性 warmup 后恒定") + ap.add_argument("--grad_clip", type=float, default=10.0, + help="官方 max_grad_norm_generator 10.0(trainer/opsd_streaming.py),也是 stage3 的值。" + "loss_norm=window 下梯度已除以打分 cell 数,1.0 会在每步都触发、把 AdamW 变成归一化 SGD") + ap.add_argument("--batch_size", type=int, default=1, + help="不是调参项:rollout 是 61 cell 串行 + 逐 cell backward,显存在 rollout 里不在 batch 里") + ap.add_argument("--grad_accum", type=int, default=1) + ap.add_argument("--max_steps", type=int, default=300, + help="参考实现只跑 200 步(LoRA、lr 1e-5);全量微调 1/10 的 lr,几百步是先探的量级") + ap.add_argument("--num_workers", type=int, default=2) + ap.add_argument("--seed", type=int, default=0) + + # ---- 学生 EMA(我们的加项;dits/ 才是上游的产物)---- + ap.add_argument("--use_ema", type=int, default=1, help="1 ⇒ 另维护一份学生的 fp32 EMA 影子 ema/ema_step{N}") + ap.add_argument("--student_ema_decay", type=float, default=0.99) + ap.add_argument("--ema_start", type=int, default=50, help="这之前每步硬拷贝 ema ← student") + + # ---- 存档 / 日志 ---- + ap.add_argument("--save_every", type=int, default=50, help="0 ⇒ 只在结束时导出") + ap.add_argument("--keep_last_dits", type=int, default=25, help="全部里程碑都留着挑") + ap.add_argument("--keep_last_emas", type=int, default=25) + ap.add_argument("--log_every", type=int, default=10) + ap.add_argument("--profile_mem", type=int, default=0, help="1 ⇒ 前几步逐阶段打峰值显存(开 300 之前先量这个)") + ap.add_argument("--resume", default=None, + help="auto ⇒ 有 /progress.json 就从 dits/ (+ ema/) 接着跑;只恢复权重,教师仍冻结在 --init_ckpt") + ap.add_argument("--force_run_dir", action="store_true", + help="--output 目录里 train.log 刚被写过时仍然继续(默认拒:多半是另一个 run 还活着)") + args = ap.parse_args(argv) + + try: + assert_window_geometry(args.sink_size, args.kv_window, args.rope_cap) + except ValueError as e: + raise SystemExit(f"ABORT: {e}") from None + try: + b1, b2 = (float(x) for x in args.adam_betas.split(",")) + except ValueError: + raise SystemExit(f"--adam_betas 应形如 '0.0,0.999',得到 {args.adam_betas!r}") from None + args.betas = (b1, b2) + args.denoise = [float(t) for t in args.denoise_list.split(",") if t.strip()] + if not args.denoise: + raise SystemExit("--denoise_list 不能为空") + if args.smoke: + return args + if args.output is None: + raise SystemExit("--output 必填(--smoke 之外)") + if args.rollout_cells < 2: + raise SystemExit(f"--rollout_cells({args.rollout_cells}) 必须 ≥ 2") + if not 1 <= args.loss_start_frame < args.rollout_cells: + raise SystemExit(f"--loss_start_frame({args.loss_start_frame}) 必须落在 [1, rollout_cells={args.rollout_cells})," + "否则要么给真实锚点打分、要么一个 cell 都不打分(loss 恒 0 且不报错)") + if args.backward_per_chunk != 1: + raise SystemExit("--backward_per_chunk 只接受 1:整条 rollout 的图(49 cell × 4 状态)装不下," + "逐 cell backward 正是把活化值限在一个 cell 上的东西") + if args.teacher_keep_last not in (0, 1): + raise SystemExit(f"--teacher_keep_last 只接受 0/1,得到 {args.teacher_keep_last}") + if args.grad_accum < 1: + raise SystemExit("--grad_accum 必须 ≥ 1") + if args.lora_rank < 0: + raise SystemExit("--lora_rank 必须 ≥ 0") + if args.lora_rank > 0 and args.ema_decay > 0: + raise SystemExit("--lora_rank > 0 时教师 = 同一模型关掉补丁(恒为 init_ckpt),--ema_decay 没有载体;" + "EMA 教师(官方 teacher adapter)未实现,官方 0.9999 本来就 ≈ 冻结") + if args.lora_rank == 0 and args.lr > 2e-6 and not args.smoke: + print(f"[warn] 全量微调(--lora_rank 0)用 lr {args.lr:g}:stage3 在 5e-6 崩、2e-6 稳,全量 OPSD 用 1e-6", flush=True) + if args.teacher_context == "student": + print("[warn] --teacher_context student 是退化自检(loss 恒 0):**永远不要拿它训练**", flush=True) + zero_upto = 2 if args.teacher_keep_last else 1 + if args.loss_start_frame <= zero_upto: + # 按构造:cell 1 的教师缓存 = [real 0] = 学生缓存;keep_last=1 时 cell 2 的 = [real 0, 学生 1] 也相同。 + # 这些 cell 的 loss 恰好是 0(不是 bug,test_stage4_opsd 钉住了这一条),第一个有信号的 cell 是 3。 + print(f"[warn] --loss_start_frame {args.loss_start_frame} ≤ {zero_upto}:前几个打分 cell 的教师上下文与学生" + f"按构造相同,loss 恰好 0、无梯度(配方是 12)", flush=True) + if args.dry_run: + args.init_ckpt = None + else: + if not args.init_ckpt: + raise SystemExit("--init_ckpt 必填:stage3 的 ema/ema_step{N}.safetensors") + # 先查这一条再查存在性:拿错文件的人给的路径通常是存在的 + if "/dits/" in args.init_ckpt.replace(os.sep, "/") and not args.allow_raw_student: + raise SystemExit(f"--init_ckpt 指向 dits/:{args.init_ckpt}\n" + " stage3 的部署权重是 ema/ema_step{N}.safetensors,dits/ 只为续训存在。" + "拿错了不会报错,只会静默从一个更差的模型起步(risk 12)。确认要用就加 --allow_raw_student。") + if not os.path.isfile(args.init_ckpt): + raise SystemExit(f"--init_ckpt 不存在:{args.init_ckpt}") + if not os.path.isdir(args.seg_dir): + raise SystemExit(f"--seg_dir 不存在:{args.seg_dir}(先跑 actionrope/make_long_segments.py plan/encode)") + if not os.path.isfile(args.text_table): + raise SystemExit(f"--text_table 不存在:{args.text_table}") + return args + + +# ---------------------------------------------------------------------------- +# dry run:tiny 三模型 + 合成长段(不碰真权重 / 真数据 / accelerate) +# ---------------------------------------------------------------------------- + +DRY_TINY = dict(dim=128, ffn_dim=256, num_heads=4, num_layers=2) # 与 test_kv_equiv 同一份 tiny 几何 +DRY_LAT = (8, 10) # latent 8×10 ⇒ patch 后 4×5 = 20 token/cell +DRY_L_TXT = 8 + + +class _SynLongDataset(torch.utils.data.Dataset): + """dry run 用:形状与 AropeLongDatasetTF 一致的合成段(cell 数按 --rollout_cells,分辨率缩到 8×10)。""" + + def __init__(self, cells: int, n: int = 16): + self.cells, self.n = int(cells), int(n) + + def __len__(self): + return self.n + + def __getitem__(self, i: int) -> dict: + g = torch.Generator().manual_seed(i) + f, (h, w) = self.cells, DRY_LAT + off = torch.zeros(f, 2) + off[1:] = torch.randn(f - 1, 2, generator=g).cumsum(0) * 12.0 + return { + "input_latents": torch.randn(48, f, h, w, generator=g).to(torch.bfloat16), + "context": torch.randn(f, DRY_L_TXT, 4096, generator=g).to(torch.bfloat16), + "context_ids": (torch.arange(f) // 20).to(torch.int64), # 每 20 个 cell 换一条"场景" + "offset_px": off, + "clip_id": f"syn_{i:04d}", + "kind": "syn", + } + + +def _tiny_model(seed: int = 0) -> AropeDiT: + return tiny_arope_dit(causal=True, seed=seed, device="cpu", dtype=torch.float32, **DRY_TINY) + + +def _shrink_for_dry_run(args) -> None: + """只缩步数 / 打点 / 存档节奏;几何(sink 3 / w17 / cap 20)、段长 61、loss_start 12 保持生产值。""" + if args.max_steps > 30: + args.max_steps = 3 + args.log_every = 1 + args.save_every = min(args.save_every, max(1, args.max_steps)) if args.save_every > 0 else 0 + args.warmup = min(args.warmup, 2) + args.ema_start = min(args.ema_start, 1) + args.num_workers = 0 + + +class _SingleProcess: + """--dry_run 用:不经 accelerate / FSDP 的单进程替身,只覆盖本文件用到的那几个接口 + (runlib.save_dit 也只用到 wait_for_everyone / get_state_dict / is_main_process)。""" + + is_main_process = True + num_processes = 1 + process_index = 0 + distributed_type = "NO" + mixed_precision = "no" + state = None + + def __init__(self, device="cpu"): + self.device = torch.device(device) + + def prepare(self, *objs): + return objs if len(objs) > 1 else objs[0] + + def backward(self, loss): + loss.backward() + + def wait_for_everyone(self): + pass + + def reduce(self, t, reduction="mean"): + return t + + def end_training(self): + pass + + def get_state_dict(self, model): + return unwrap(model).state_dict() + + +# ---------------------------------------------------------------------------- +# 主流程 +# ---------------------------------------------------------------------------- + +def _assert_run_dir_safe(run_dir: str, stage: str, force: bool, log=print, dry_run: bool = False) -> None: + """开跑之前确认 `--output` 指的不是**别人的** run 目录(与 stage3 逐字相同的两道 fail-closed 闸: + progress.json 记着别的 stage ⇒ 拒;train.log 最近 10 分钟被写过 ⇒ 多半另一个 run 还活着 ⇒ 拒, + 除非 --force_run_dir)。保存点会 rotate_run 真的 os.remove 10 GB 权重,手误一次就不可逆。""" + prog = runlib.read_progress(run_dir) + if prog and prog.get("stage") and str(prog["stage"]) != stage: + raise SystemExit( + f"ABORT: {run_dir} 是 stage={prog['stage']!r} 的 run 目录(progress.json 记在 step " + f"{prog.get('step')}),本次是 {stage}。保存时会 rotate 掉那边的 dits/ema —— 换个 --output。") + log_path = os.path.join(run_dir, "train.log") + if os.path.isfile(log_path): + age = time.time() - os.path.getmtime(log_path) + if age < 600 and not (force or dry_run): + raise SystemExit( + f"ABORT: {log_path} 在 {age / 60:.1f} 分钟前还被写过 —— 多半有另一个 run 正活在这个目录里。" + "换个 --output;确认上一次已经死了就加 --force_run_dir(launcher 里是 FORCE_RUN_DIR=1)。") + if age < 600: + log(f"[warn] {log_path} {age / 60:.1f} 分钟前刚被写过,--force_run_dir 强行继续。") + + +def teacher_param_dtype(device_type: str, ema_decay: float) -> torch.dtype: + """教师参数的 dtype:CUDA 上冻结教师放 bf16(省一份权重);CPU 没有 autocast 只能 fp32;**开了 EMA 必须 fp32** + ——(1−decay)·(student−teacher) 在 decay=0.9999 时是 1e-4 相对量,bf16 半 ulp ~2e-3 吃不进去,bf16 教师上的 + EMA 是静默的空操作(test_stage4_opsd::test_15 用真实增量量过)。""" + if device_type != "cuda" or ema_decay > 0: + return torch.float32 + return torch.bfloat16 + + +def _mask_norm(model) -> float: + """known 掩码通道的 ||W||(上游的 action ||W||):0 意味着这个模型对空间条件是盲的。""" + emb = getattr(unwrap(model).dit, MASK_EMBEDDING_NAME, None) + return float("nan") if emb is None else float(emb.weight.detach().float().norm()) + + +def main(argv=None): + args = parse_args(argv) + if args.smoke: + return smoke() + if args.dry_run: + _shrink_for_dry_run(args) + accel = _SingleProcess("cpu") + torch.manual_seed(args.seed) + else: + from accelerate import Accelerator + from accelerate.utils import DistributedType, set_seed + accel = Accelerator(step_scheduler_with_optimizer=False) + set_seed(args.seed, device_specific=True) # 每个 rank 的噪声不同;rollout 长度是定值,形状天然同步 + is_main = accel.is_main_process + device = accel.device + + run_dir = runlib.resolve_run_dir(args.output) + _assert_run_dir_safe(run_dir, STAGE, bool(args.force_run_dir), dry_run=bool(args.dry_run)) + accel.wait_for_everyone() + if is_main: + os.makedirs(run_dir, exist_ok=True) + log = runlib.TextTee(os.path.join(run_dir, "train.log"), enabled=is_main) + jsonl = runlib.JsonlLogger(os.path.join(run_dir, "train_log.jsonl"), enabled=is_main) + log(f"=== {STAGE} | run={run_dir} world={accel.num_processes} " + f"dist={accel.distributed_type} mp={accel.mixed_precision} ===") + + # ---- 启动闸 1:滑窗 KV 的算术(tiny CPU 模型,亚秒;在烧掉 3×5B 之前跑)---- + pf = preflight_sliding_kv(args.sink_size, args.kv_window, args.rope_cap, + log=(log if is_main else (lambda *a: None))) + # ---- 启动闸 2:FSDP 的致命开关 ---- + is_fsdp = False + if not args.dry_run: + if accel.distributed_type == DistributedType.FSDP: + is_fsdp = True + plugin = accel.state.fsdp_plugin + if not getattr(plugin, "use_orig_params", False): + raise SystemExit( + "fsdp_use_orig_params 必须为 true(risk 5):优化器是在 prepare 之前按 model.parameters() " + "建好的、此后不再重映射,false 时 FSDP1 换上 FlatParameter,优化器 step 的是过期张量、" + "永远收不到梯度 —— 模型静默地完全不学习;zip-EMA 也要求 Parameter 身份/顺序/分片一致。") + log(f"[fsdp] use_orig_params={plugin.use_orig_params} " + f"reshard={getattr(plugin, 'reshard_after_forward', None)} version={getattr(plugin, 'fsdp_version', 1)}") + elif accel.num_processes > 1: + log(f"[warn] 期望 FSDP,实际是 {accel.distributed_type}") + if args.ema_decay > 0 and (is_fsdp or accel.num_processes > 1): + raise SystemExit("--ema_decay > 0 在 FSDP 下不可用:教师是**不分片**的 bf16 冻结副本(不进 prepare)," + "与分片学生逐参数 zip 会形状不符。配方本来就是 0(冻结),见 main() 更新点的注释。") + + idx_dep, sig_dep, t_dep = deploy_schedule(args.denoise) + deploy = (idx_dep, sig_dep, t_dep) + n_scored = max(0, args.rollout_cells - args.loss_start_frame) + log(f"[recipe] denoise={args.denoise} ⇒ 网格 t={[round(float(x), 1) for x in t_dep]} " + f"sigma={[round(float(x), 4) for x in sig_dep]}") + log(f"[recipe] kv_window={args.kv_window} sink={args.sink_size} cap={args.rope_cap} anchor={args.sink_anchor} " + f"rollout={args.rollout_cells} cells loss_start={args.loss_start_frame} ⇒ scored {n_scored} cells × " + f"{len(t_dep)} states loss={args.loss_type} ctx={args.teacher_context} keep_last={args.teacher_keep_last} " + f"last_chunk={args.teacher_last_chunk} norm={args.loss_norm} lora={args.lora_rank} " + f"lr={args.lr} betas={args.betas} wd={args.weight_decay} clip={args.grad_clip} warmup={args.warmup} " + f"ga={args.grad_accum} teacher_ema={args.ema_decay} student_ema={args.use_ema}/{args.student_ema_decay}" + f"@{args.ema_start} max_steps={args.max_steps}") + log(f"[budget] 每步 ≈ 学生 {args.rollout_cells - 1}×{len(t_dep)} 读 + {args.rollout_cells - 1} 提交 + " + f"{n_scored}×{len(t_dep)} 反向;教师 {n_scored}×{len(t_dep)} 打分 + ~{args.rollout_cells} 提交。" + f"活化值峰值 ≈ {len(t_dep)} 个单 cell 图(stage3 实测 6.46 GiB/图)。" + f"墙钟按 stage3 的 22 s/27 cell 外推是 60–160 s/步 —— **先用 20 步 PROFILE_MEM=1 冒烟量到再信**。") + low = runlib.warn_if_low_disk(run_dir) + if low: + log(f"[warn] {low}") + + # ---- 数据 ---- + if args.dry_run: + train_ds = _SynLongDataset(args.rollout_cells) + text_table_keys = 0 + log("[dry_run] tiny 三模型 + 合成长段(单进程,不经 accelerate / FSDP)") + else: + from longhorizon.arope_long_dataset import AropeLongDatasetTF + train_ds = AropeLongDatasetTF(args.seg_dir, text_table=args.text_table, scene_dropout=args.scene_dropout, + limit=(args.limit or None), verbose=is_main) + text_table_keys = len(train_ds.text_table) + seg_cells = int(train_ds[0]["input_latents"].shape[1]) + if args.rollout_cells > seg_cells: + raise SystemExit(f"--rollout_cells({args.rollout_cells}) > 段长 {seg_cells}:真值历史只有这么多 cell," + "OPSD 的教师不能对不存在的真值打分。调小 --rollout_cells(更短就切片)。") + log(f"[data] {len(train_ds)} 段 × {seg_cells} cell(用前 {args.rollout_cells} 个),文本表 {text_table_keys} 键") + dataloader = torch.utils.data.DataLoader( + train_ds, batch_size=args.batch_size, shuffle=True, drop_last=True, collate_fn=arope_collate, + num_workers=args.num_workers, pin_memory=(device.type == "cuda"), + persistent_workers=args.num_workers > 0) + + # ---- 续训(只恢复权重,必须在 prepare 之前装进裸模块;教师永远 = --init_ckpt)---- + resume_step, resume_paths = 0, {} + if args.resume: + if args.resume == "auto": + src = run_dir + elif os.path.isdir(args.resume): + src = args.resume + else: + raise SystemExit(f"--resume 只接受 'auto' 或一个 run 目录,得到 {args.resume!r}") + rp = runlib.read_progress(src) + if rp and int(rp.get("step", 0)) > 0: + resume_step = int(rp["step"]) + resume_paths = {"student": runlib.dit_path(src, resume_step)} + if args.use_ema: + resume_paths["ema"] = runlib.ema_path(src, resume_step) + miss = [k for k, p in resume_paths.items() if not os.path.isfile(p)] + if miss: + raise SystemExit(f"--resume 想从 step {resume_step} 接着跑,但缺 {miss}:{[resume_paths[k] for k in miss]}") + log(f"[resume] 从 {src} 的 step {resume_step} 续:student←dits/ ema←ema/ 教师←init_ckpt(优化器状态不存)") + else: + log("[resume] 没有 progress.json,从头开始") + + # ---- 模型:student(fp32,LoRA 模式只训补丁)/ teacher(LoRA 模式 = 学生关掉补丁;全量模式 = bf16 冻结副本) + # / ema(fp32 冻结影子)---- + use_lora = args.lora_rank > 0 + t0 = time.time() + if args.dry_run: + student = _tiny_model(seed=0) + teacher = None if use_lora else _tiny_model(seed=0) # 同种子 ⇒ 与学生逐位相同的初值 = 冻结教师 + ema = _tiny_model(seed=0) if args.use_ema else None + expect_keys = None + if resume_step: + runlib.load_dit_ckpt(student, resume_paths["student"]) + if ema is not None: + runlib.load_dit_ckpt(ema, resume_paths["ema"]) + else: + student = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=True) + teacher = None if use_lora else AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=True) + ema = AropeDiT(model_dir=args.model_dir, mask_channel=True, causal=True) if args.use_ema else None + expect_keys = runlib.AROPE_DIT_KEYS + if teacher is not None: + runlib.load_dit_ckpt(teacher, args.init_ckpt) # 教师 = 初值,冻结 + if resume_step: + runlib.load_dit_ckpt(student, resume_paths["student"]) + if ema is not None: + runlib.load_dit_ckpt(ema, resume_paths["ema"]) + else: + runlib.load_dit_ckpt(student, args.init_ckpt) + if ema is not None: + runlib.load_dit_ckpt(ema, args.init_ckpt) + log(f"[model] student/teacher/ema ← {os.path.basename(args.init_ckpt)}" + + (f"(student/ema 已被 step {resume_step} 的续训权重覆盖)" if resume_step else "")) + if use_lora: + # ★ 必须在 .float() / prepare 之前装:FSDP 按 requires_grad 分组建 flat param,prepare 之后再换模块 / + # 改 requires_grad 只会改到分片视图上且不报错。LoRA 装在 base(= init_ckpt 或续训权重)之上,B 零初始化 + # ⇒ 第 0 步学生 ≡ base ≡ 教师。续训时 dits/ 是折叠后的普通权重,补丁从零重新起步(文档已写明)。 + alpha = args.lora_alpha or args.lora_rank + lora_mod.install_lora(unwrap(student).dit, rank=args.lora_rank, alpha=alpha, is_student=False, log=log) + if ema is not None: # 影子也要装同样的补丁:ema_update 按 zip 配对,两边参数列表必须一致 + lora_mod.install_lora(unwrap(ema).dit, rank=args.lora_rank, alpha=alpha, is_student=False, log=lambda *_: None) + if not resume_step and teacher is not None: + # 教师与学生必须从**同一份**权重起步:这是"loss 小但非零"这条启动信号的前提 + sd_s, sd_t = student.state_dict(), teacher.state_dict() + bad = next((k for k in sd_s if not torch.equal(sd_s[k].float(), sd_t[k].float())), None) + if bad is not None: + raise SystemExit(f"student 与 teacher 初值不同:{bad} —— 两者必须都从 --init_ckpt 起步") + del sd_s, sd_t + + # ★ prepare **之前** .float()(risk 4):ckpt 是 bf16,FSDP 的 MixedPrecision(bf16) 下 bf16 参数**没有** + # fp32 主权重,AdamW 会原地更新 bf16 —— 训练照跑,只是学得又慢又抖。教师冻结、只做 no_grad 前向, + # 不进优化器也不进 prepare,留 bf16(整份复制,省一次分片包装)。 + for name, m in (("student", student),) + ((("ema", ema),) if ema is not None else ()): + m.float() + bad = next((n for n, p in m.named_parameters() if p.dtype is not torch.float32), None) + if bad is not None: + raise SystemExit(f"{name} 的 {bad} 不是 fp32 —— .float() 没生效,FSDP 下会没有 fp32 主权重") + student.train() + if not use_lora: + student.requires_grad_(True) # LoRA 模式下 install_lora 已经只放开 lora_A/B,别再全放开 + if ema is not None: + ema.requires_grad_(False).eval() # 冻结影子;prepare 之前冻好,FSDP 才不挂梯度钩子 + # CPU dry run 没有 autocast,fp32 输入撞 bf16 权重会直接报错(stage3 同一个坑)。 + # ★ --ema_decay > 0 时教师必须留 fp32:EMA 增量 (1−decay)·(student−teacher) ≈ 1e-4 相对量,远在 bf16 的半 ulp + # (~2e-3)之下,bf16 教师上 mul_(decay).add_(alpha=1−decay) 会整个舍回旧值 —— 日志写着 EMA,实际是冻结教师 + # (distill/ema.py 文件头 / test_runlib 的 test_bf16_shadow_drops_the_update 钉的同一条)。fp32 教师多占一份 + # 权重(5B ≈ 9.3 GB),只在单进程可用(上面已拦 FSDP),前向照样走 autocast bf16。 + if teacher is not None: + teacher_dtype = teacher_param_dtype(device.type, args.ema_decay) + teacher.to(dtype=teacher_dtype).requires_grad_(False).eval() + if args.ema_decay > 0: + bad = next((n for n, p in teacher.named_parameters() if p.dtype is not torch.float32), None) + if bad is not None: + raise SystemExit(f"--ema_decay {args.ema_decay} > 0 但教师参数 {bad} 不是 fp32:bf16 教师吃不进 1e-4 的 EMA " + "增量,EMA 会静默退化成冻结教师") + t_desc = (f"teacher {str(teacher_dtype).replace('torch.', '')} " + f"{'EMA(' + str(args.ema_decay) + ')' if args.ema_decay > 0 else '冻结'}不分片") + else: + t_desc = "teacher = 学生关掉 LoRA 补丁(恒为 init_ckpt,不另占显存)" + n_params = sum(p.numel() for p in student.parameters()) + n_train = sum(p.numel() for p in student.parameters() if p.requires_grad) + log(f"[model] {n_params:,} 参数,可训 {n_train:,}({100 * n_train / n_params:.2f}%," + f"{'LoRA rank ' + str(args.lora_rank) if use_lora else '全量'})/ {t_desc} / " + f"ema {'fp32 冻结' if ema is not None else '关'},加载 {time.time() - t0:.0f}s") + # 上游启动时打 action ||W||;这里对应 known 掩码通道的 ||W||:两边都必须非零,否则那个模型对空间条件是盲的 + ms, mt = _mask_norm(student), _mask_norm(teacher if teacher is not None else student) + log(f"[model] mask-channel ||W||: student {ms:.4f} teacher {mt:.4f}") + if not (ms > 0 and mt > 0): + log("[warn] known 掩码通道的权重是 0 —— 模型对空间条件盲,教师会在无条件下监督") + + train_params = lora_mod.lora_parameters(unwrap(student).dit) if use_lora else list(student.parameters()) + opt = torch.optim.AdamW(train_params, lr=args.lr, weight_decay=args.weight_decay, betas=args.betas) + warm = max(int(args.warmup), 0) + + def lr_lambda(s): + return min(1.0, (s + 1) / warm) if warm > 0 else 1.0 + + # lr scheduler 不进 prepare:accelerate 包装后每步会 step num_processes 次,warmup 被悄悄压缩。 + # 续训时用 last_epoch 直接落到 resume_step(等价于 step() 了 resume_step 次,但不触发 PyTorch 的 + # "scheduler.step() before optimizer.step()" 警告) + if resume_step: + for g in opt.param_groups: + g.setdefault("initial_lr", g["lr"]) + slr = torch.optim.lr_scheduler.LambdaLR(opt, lr_lambda, last_epoch=(resume_step - 1) if resume_step else -1) + + if ema is not None: + student, ema, opt, dataloader = accel.prepare(student, ema, opt, dataloader) + else: + student, opt, dataloader = accel.prepare(student, opt, dataloader) + if teacher is None: + teacher = TeacherView(student) # prepare 之后再建:要指向 FSDP 包装后的那个学生对象 + else: + teacher.to(device) + # dit.freqs 是普通 tuple 属性(不是 buffer),prepare / .to() 都搬不动它 —— 每个裸模块都要搬一次 + for m in (student, teacher) + ((ema,) if ema is not None else ()): + unwrap(m).move_rope_table(device) + assert unwrap(teacher).dit.freqs[0].device.type == device.type + + # ---- config.json ---- + if is_main: + cfg = { + "stage": STAGE, "args": {k: v for k, v in vars(args).items() if k != "betas"}, + "betas": list(args.betas), "preflight": pf, + "deploy_schedule": {"t": [float(x) for x in t_dep], "sigma": [float(x) for x in sig_dep], + "idx": [int(x) for x in idx_dep]}, + "scored_cells": n_scored, "scored_states": n_scored * len(t_dep), + "dataset": ({"synthetic": True, "cells": args.rollout_cells} if args.dry_run else { + "seg_dir": args.seg_dir, "n_segments": len(train_ds), "segment_cells": seg_cells, + "text_table_keys": text_table_keys}), + "model": {"n_params": n_params, "init_ckpt": args.init_ckpt, "start_step": resume_step, + "teacher": t_desc, "lora_rank": args.lora_rank, + "artifacts": "dits/ = student (upstream's deploy artifact); ema/ = our fp32 EMA shadow (deploy candidate)"}, + "env": {"world_size": accel.num_processes, "distributed_type": str(accel.distributed_type), + "mixed_precision": accel.mixed_precision, "torch": torch.__version__, "cuda": torch.version.cuda, + "gpu": torch.cuda.get_device_name(0) if torch.cuda.is_available() else None, + "python": sys.executable, "platform": platform.platform(), "hostname": socket.gethostname(), + "argv": sys.argv, "started": time.strftime("%Y-%m-%d %H:%M:%S"), + "cuda_visible_devices": os.environ.get("CUDA_VISIBLE_DEVICES")}, + } + try: + import accelerate # noqa: F401 + cfg["env"]["accelerate"] = accelerate.__version__ + except Exception: + pass + runlib.save_config(run_dir, cfg) + + csv_fields = ["step", "opsd", "gnorm", "lr", "n_scored_cells", "n_scored_states", "first_cell", "last_cell", + "step_time", "mem_gb", "epoch"] + train_log = runlib.CsvLog(os.path.join(run_dir, "train_log.csv"), csv_fields, enabled=is_main) + + def _clip(model, max_norm): + # FSDP 自带 clip_grad_norm_(会处理分片梯度,集合通信、各 rank 同值);裸模块退回 torch 工具 + if hasattr(model, "clip_grad_norm_"): + return model.clip_grad_norm_(max_norm) + return torch.nn.utils.clip_grad_norm_(model.parameters(), max_norm) + + # ★ rollout 区必须 cache_enabled=False(stage3 文件头坑 4):rollout 里绝大多数前向在 no_grad 下跑, + # autocast 会把 fp32 权重的 bf16 副本缓存下来(不带 grad_fn),带梯度的打分前向复用它 ⇒ 梯度到不了 + # 任何 Linear/Conv。FSDP+bf16 下参数本来就是 bf16、不发生 cast,这个开关是空操作;它保护的是 + # dry run / 单卡 / DDP 这些 fp32 参数路径。 + ac_roll = lambda: torch.autocast(device_type=device.type, dtype=torch.bfloat16, # noqa: E731 + enabled=(device.type == "cuda"), cache_enabled=False) + gen = torch.Generator(device=device).manual_seed(args.seed + 17 * accel.process_index) + + def do_save(step: int): + # save_dit 是集合操作(accelerator.get_state_dict),每个 rank 都必须进来 + meta = {"stage": STAGE, "step": step, "init_ckpt": args.init_ckpt, "denoise_list": args.denoise_list, + "kv_window": args.kv_window, "sink_size": args.sink_size, "rope_cap": args.rope_cap, + "sink_anchor": args.sink_anchor, "loss_start_frame": args.loss_start_frame, + "rollout_cells": args.rollout_cells, "loss_type": args.loss_type, + "teacher_keep_last": args.teacher_keep_last, "teacher_last_chunk": args.teacher_last_chunk, + "loss_norm": args.loss_norm, "text_mode": "scene", "lora_rank": args.lora_rank} + + def _merge(mod): + # LoRA 下把 B@A·scale 折回 base.weight,导出的仍是 827 键普通权重(部署 / 评测路径一行不改) + return (lambda sd: lora_mod.merged_state_dict(unwrap(mod).dit, sd)) if use_lora else None + + # dits/ = 学生本体 = 上游的部署产物(教师冻结、就是 init_ckpt 的字节副本,不存) + runlib.save_dit(accel, student, runlib.dit_path(run_dir, step), {**meta, "role": "student(deploy, upstream)"}, + expect_keys=expect_keys, require_mask=not args.dry_run, log=log, post=_merge(student)) + if ema is not None: # ema/ = 我们额外的 fp32 影子,另一个部署候选 + runlib.save_dit(accel, ema, runlib.ema_path(run_dir, step), + {**meta, "role": "ema(deploy candidate)", "ema_decay": args.student_ema_decay}, + expect_keys=expect_keys, require_mask=not args.dry_run, log=log, post=_merge(ema)) + if is_main: + gone = runlib.rotate_run(run_dir, keep_dits=args.keep_last_dits, keep_emas=args.keep_last_emas) + n_gone = sum(len(v) for v in gone.values()) + if n_gone: + log(f"[rotate] 删掉 {n_gone} 个旧 ckpt(dits {args.keep_last_dits} / ema {args.keep_last_emas})") + runlib.write_progress(run_dir, step, stage=STAGE) + + # ---- 训练循环 ---- + step, epoch, last_saved = resume_step, 0, resume_step + _ls = resume_step + if device.type == "cuda": + torch.cuda.reset_peak_memory_stats(device) + log(f"[train] 从 step {step} 到 {args.max_steps}") + data_iter = iter(dataloader) + t_step = time.time() + last, micro = {}, 0 + R = args.rollout_cells + # COLLAPSE 监测(上游 healthcheck.py 的那条):教师冻结时 loss 缓慢下降正常,跌到起点 15% 以下 = 学生学会了 + # 无视自己的缓存(目标的退化极小值,与要修的东西相反)。只警告不中止:lr 1e-6 下慢慢降是预期的 + loss_base, loss_recent = [], [] + opt.zero_grad(set_to_none=True) + while step < args.max_steps: + try: + batch = next(data_iter) + except StopIteration: + epoch += 1 + data_iter = iter(dataloader) + batch = next(data_iter) + batch = to_device(batch, device) + if device.type != "cuda": # CPU 路径把输入跟着提到学生的 dtype + pdt = next(unwrap(student).parameters()).dtype + for _k in ("input_latents", "context"): + batch[_k] = batch[_k].to(pdt) + # 段更长就切片:cell 0 仍是原点,绝对坐标不用重锚 + x0 = batch["input_latents"][:, :, :R].contiguous() # [b,48,R,h,w] + ctx_ext = batch["context"][:, :R].contiguous() # [b,R,L,4096] + ids_ext = batch["context_ids"][:, :R].contiguous() # [b,R] + off_ext = batch["offset_px"][:, :R].contiguous() # [b,R,2] 绝对世界坐标 + assert_rollout_aligned(off_ext, ctx_ext, ids_ext, R - 1, latent=x0) + + _prof = bool(args.profile_mem) and step < resume_step + 3 and is_main and device.type == "cuda" + + def _mem(tag): + if _prof: + torch.cuda.synchronize(device) + log(f" [mem step{step}] {tag}: peak {torch.cuda.max_memory_allocated(device) / 2 ** 30:.1f}GB " + f"cur {torch.cuda.memory_allocated(device) / 2 ** 30:.1f}GB") + + if args.profile_mem and device.type == "cuda": + torch.cuda.reset_peak_memory_stats(device) + + def bwd(l): + accel.backward(l / max(args.grad_accum, 1)) + + t_roll = time.time() + with ac_roll(): + loss, info = opsd_step(student, teacher, x0, ctx_ext, ids_ext, off_ext, deploy, args, + gen=gen, backward_fn=bwd) + _mem("after rollout+backward") + micro += 1 + if micro % args.grad_accum != 0: + continue + + gnorm = float(_clip(student, args.grad_clip)) + # ★ S4-GUARD:与 stage3 的 S3-GUARD-3 不同,OPSD 没有"第 0 步恰好是 0"的配方性质 —— 教师看真值历史、 + # 学生看自己的,从第一步起 loss > 0 ⇒ gnorm > 0 就是硬不变量。恰为 0.0 / NaN 只能是 autograd / FSDP / + # autocast-cache 路径断裂,或者教师在读学生自己的上下文(ZERO-LOSS:上游第一次 launch 就这样静默跑了 + # 6 小时)。inf 不拦(clip 已归零)。FSDP 的 clip_grad_norm_ 是集合通信,各 rank 同值,不会挂 rank。 + if loss == 0.0 and (gnorm == 0.0 or math.isnan(gnorm)): + raise SystemExit( + f"[ZERO-LOSS] opsd == 0 且 gnorm == {gnorm} at step {step}:教师与学生在读**同一份**上下文," + "没有任何梯度。查 KV 缓存有没有真的被 commit(FSDP 重建 dict ⇒ _KVRef)、teacher_context 是不是 " + "student、以及 cache_r 是不是真的装了真值 latent。") + if gnorm == 0.0 or math.isnan(gnorm): + raise SystemExit( + f"[gnorm] student grad norm {gnorm} at step {step}: 梯度根本没到学生参数(查 " + "fsdp_use_orig_params / rollout 区 autocast 的 cache_enabled / arope_dit.forward_frame 里多余的 detach)") + if not math.isfinite(gnorm): + log(f"[warn] step {step} gnorm={gnorm}(inf,clip 已把梯度归零,这一步等于空步)") + opt.step() + opt.zero_grad(set_to_none=True) + slr.step() + # ★ 教师不追学生。loss 是 ||v_θ(x, C_student) − v_φ(x, C_real)||²;φ → θ 之后它退化成 + # ||v_θ(x, C_s) − v_θ(x, C_r)||²,其精确的全局极小值是任何**无视 KV 缓存**的模型 —— 与要修的东西 + # 正好相反。本 trainer 里没有别的项拉着它(没有 GT flow-matching、没有 DMD、wd=0),loss 会单调下降 + # 而模型在忘掉自己的历史。参考实现等价于冻结(0.9999^200 = 0.980 保留初值);--ema_decay 0 就是精确冻结。 + # 开了就必须是 fp32 教师(上面模型加载处已按 ema_decay 选 dtype 并断言):bf16 吃不进 1e-4 的增量。 + if args.ema_decay > 0: + ema_update(teacher, student, args.ema_decay) + if ema is not None: # 学生的部署影子,每个优化器步更新一次 + ema_update(ema, student, decay=(0.0 if step < args.ema_start else args.student_ema_decay)) + _mem("after opt.step") + + step += 1 + if len(loss_base) < 10: + loss_base.append(float(loss)) + else: + loss_recent.append(float(loss)) + loss_recent = loss_recent[-max(args.log_every, 1):] + last = {"opsd": float(loss), "gnorm": gnorm, "n_scored_cells": info["n_scored_cells"], + "n_scored_states": info["n_scored_states"], "first_cell": info["first_cell"], + "last_cell": info["last_cell"]} + if step == resume_step + 1: + # ★ 开跑要读的两个信号:opsd **小但非零**(恰好 0 = 教师读的是学生的上下文,无信号;很大 = 两者错位), + # gnorm 有限且 > 0 + log(f"[first-step] opsd {float(loss):.6f} (cell {args.loss_start_frame}: {info['first_cell']:.6f} → " + f"cell {R - 1}: {info['last_cell']:.6f}) gnorm {gnorm:.4e} rollout {time.time() - t_roll:.1f}s" + f" —— 期望:opsd 小但非零、gnorm 有限 > 0") + if step % args.log_every == 0 or step == args.max_steps: + now = time.time() + sec = (now - t_step) / max(step - _ls, 1) + t_step, _ls = now, step + avg = accel.reduce(torch.tensor(float(loss), device=device), reduction="mean").item() + row = {"step": step, "opsd": avg, "gnorm": gnorm, "lr": slr.get_last_lr()[0], + "n_scored_cells": info["n_scored_cells"], "n_scored_states": info["n_scored_states"], + "first_cell": info["first_cell"], "last_cell": info["last_cell"], "step_time": sec, + "mem_gb": (torch.cuda.max_memory_allocated(device) / 2 ** 30 if device.type == "cuda" else 0.0), + "epoch": epoch} + if is_main: + train_log.write(row) + jsonl.log(row) + if len(loss_base) >= 10 and len(loss_recent) >= max(args.log_every, 1): + base = sum(loss_base) / len(loss_base) + rec = sum(loss_recent) / len(loss_recent) + if base > 0 and rec < 0.15 * base: + log(f"[warn] COLLAPSE? 最近 {len(loss_recent)} 步 opsd 均值 {rec:.3e} < 起点均值 {base:.3e} 的 15% —— " + f"学生可能在学会无视自己的缓存(目标的退化极小值);去 60+ cell 的 rollout 上看远端漂移再决定") + log(f"step {step}/{args.max_steps} opsd {avg:.5f} (cell{args.loss_start_frame} {info['first_cell']:.4f} " + f"… cell{R - 1} {info['last_cell']:.4f}) gnorm {gnorm:.3f} lr {row['lr']:.2e} " + f"scored {info['n_scored_cells']}c/{info['n_scored_states']}s {sec:.1f}s mem {row['mem_gb']:.1f}GB") + if (args.save_every > 0 and step % args.save_every == 0) or step == args.max_steps: + do_save(step) + last_saved = step + + if last_saved != step and step > resume_step: + do_save(step) + if device.type == "cuda": + peak = torch.tensor(torch.cuda.max_memory_allocated(device) / 2 ** 30, device=device) + peak_max = accel.reduce(peak, reduction="max").item() + else: + peak_max = 0.0 + log(f"[done] step {step},各进程峰值显存 {peak_max:.1f} GB。dits/ 是学生本体(上游的部署产物)," + f"ema/ 是 fp32 影子;两者都按里程碑用 distill/eval/rollout_eval.py 在 60+ cell 上量远端漂移来挑 —— " + f"OPSD 的全部主张都在 rollout 的远端,与 pre-OPSD 的 stage3 EMA 对比才是交付物。") + if is_main: + runlib.write_progress(run_dir, step, stage=STAGE, finished=True, peak_mem_gb=peak_max, last=last) + train_log.close() + jsonl.close() + log.close() + accel.wait_for_everyone() + accel.end_training() + return step + + +if __name__ == "__main__": + main() diff --git a/backup_2026-09-14/code/distill/stage4_opsd/run.sh b/backup_2026-09-14/code/distill/stage4_opsd/run.sh new file mode 100644 index 0000000000000000000000000000000000000000..e3056c2d05653760e9d635637275ebd78035b2b8 --- /dev/null +++ b/backup_2026-09-14/code/distill/stage4_opsd/run.sh @@ -0,0 +1,161 @@ +#!/usr/bin/env bash +# ───────────────────────────────────────────────────────────────────────────── +# stage4:OPSD —— On-Policy Self-Distillation(stage3 DMD 的 EMA → 长视野后训练) +# +# MeiGen-AI OPSD-V(arXiv 2607.08766)经 GraphGWM(hf/worldmind_ref/.../stage4_opsd/opsd_gm.py) +# 移植到 ActionRoPE 栈。后训练 stage3 的 ema_step300;**不换采样器、不改推理**。 +# +# 为什么有这一阶段:少步 AR 学生把自己的输出写进 KV 缓存当历史,误差复利。stage3 只在 21..27 cell 的 +# rollout 上做过分布匹配;61 cell(15 s)的长段要靠这一步把"历史被污染后的预测"拉回"历史干净时的预测"。 +# +# 8 卡 FSDP1 FULL_SHARD(与 stage3 同两份 yaml;DISTILL_NGPU=4 则 4 卡)。等效 batch = 卡数 × GRAD_ACCUM。 +# ★ 墙钟没量过:按 stage3 实测 22 s/步(27 cell)外推是 60–160 s/步 ⇒ 300 步 5–13 h。 +# **先跑 20 步 PROFILE_MEM=1 冒烟量到 s/步 与峰值显存,再开正式的 300 步**(config.json 的 _budget)。 +# +# DISTILL_NGPU=8 bash distill/stage4_opsd/run.sh +# # 20 步实机冒烟(OUT 必须写绝对路径:$ROOT 只在本脚本内部有值) +# DISTILL_NGPU=8 MAX_STEPS=20 SAVE_EVERY=10 LOG_EVERY=1 PROFILE_MEM=1 PORT=29547 \ +# OUT=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/_smoke_stage4 \ +# bash distill/stage4_opsd/run.sh +# +# 这里的每一个常量都与 opsd_arope.py 的 argparse 默认值、config.json 逐项相同(三处配方,PORT_SPEC risk 11; +# tests/test_stage4_opsd.py 会逐项比)。改配方 = 同时改这三处。 +# 只有一处**故意**与 argparse 默认值不同:--resume auto(argparse 默认 None)。 +# +# ⚠️ 部署几何铁律:rope_cap == sink_size + kv_window == 20(sink 3 / window 17 = stage3 训练与部署的几何)。 +# ⚠️ 采样表铁律:4 步 1000,750,500,250 —— OPSD 监督的必须是上线的那个采样器。 +# ⚠️ TEACHER_CONTEXT=student 是退化自检(loss 恒 0),本脚本拒绝用它训练(--smoke 在 CPU 上做这条检查)。 +# +# CUDA_VISIBLE_DEVICES / GPU 占用守卫都在 common.sh 里,这里不重复也不许绕过。 +# ───────────────────────────────────────────────────────────────────────────── +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +# shellcheck source=../common.sh +source "$HERE/../common.sh" # set -euo pipefail / ROOT / PY / ACC / 环境 / GPU 隔离 / 空闲守卫 + +# ---- 输入输出(都可以用环境变量覆盖)---- +# 初值 = stage3 的 **ema/**(不是 dits/:dits/ 只为续训存在,拿错了静默降质,risk 12;ALLOW_RAW_STUDENT=1 才放行) +STAGE3_OUT="${STAGE3_OUT:-$ROOT/outputs/distill/stage3_dmd}" +INIT="${INIT:-$STAGE3_OUT/ema/ema_step300.safetensors}" +LONG="${LONG:-$ROOT/data/latent_long/K3}" # 61-cell 长段(真值历史) +TEXT_TABLE="${TEXT_TABLE:-$ROOT/data/latent/text_table_actionrope.pt}" +OUT="${OUT:-$ROOT/outputs/distill/stage4_opsd}" + +# ---- 并行与端口 ---- +PORT="${PORT:-29537}" # 固定分配:stage1 29531 / stage2 29532 / stage3 29536 / stage4 29537 / 冒烟 29547+ +if [ "$DISTILL_NGPU" = "8" ]; then + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_fsdp_dmd_8gpu.yaml}" +else + ACC_CFG="${ACC_CFG:-$ROOT/distill/configs/accelerate_fsdp_dmd_4gpu.yaml}" +fi + +# ---- 配方(= opsd_arope.py 的 argparse 默认值 = config.json)---- +DENOISE_LIST="${DENOISE_LIST:-1000,750,500,250}" # 部署表 +KV_WINDOW="${KV_WINDOW:-17}" +SINK="${SINK:-3}" +ROPE_CAP="${ROPE_CAP:-20}" # 必须 == SINK + KV_WINDOW +SINK_ANCHOR="${SINK_ANCHOR:-absolute}" +ROLLOUT_CELLS="${ROLLOUT_CELLS:-61}" # 含锚点;≤ 段长 61。rollout 里必须装得下要修的那个现象(stage3 只练到 27) +LOSS_START="${LOSS_START:-12}" # 这之前只 rollout 不打分(单个真实锚点还在主导) +LOSS_TYPE="${LOSS_TYPE:-flow}" # 速度场 MSE(论文消融赢家);x0 只为复现消融 +TEACHER_CONTEXT="${TEACHER_CONTEXT:-real}" +TEACHER_KEEP_LAST="${TEACHER_KEEP_LAST:-1}" # 教师保留最近生成的那个 cell(论文);0 = 纯真值 0..k-1 +TEACHER_LAST_CHUNK="${TEACHER_LAST_CHUNK:-teacher}" # 那一格装谁的 x0:teacher = 官方 OPSD-V(教师自己的);student = GraphGWM +LOSS_NORM="${LOSS_NORM:-window}" # window = 官方 Σ step_loss / total_loss_terms;cell = GraphGWM 逐 cell 均值 +BACKWARD_PER_CHUNK="${BACKWARD_PER_CHUNK:-1}" # 逐 cell backward(活化值有界) +EMA_DECAY="${EMA_DECAY:-0.0}" # **教师** EMA:0 = 冻结在初值(FSDP 下只接受 0;>0 只在单进程、教师自动留 fp32,见 opsd_arope.py) +LORA_RANK="${LORA_RANK:-256}" # 官方训练面:只训 rank 256 LoRA;0 = 全量微调(实测会糊,lr 要 1e-6) +LORA_ALPHA="${LORA_ALPHA:-0}" # 0 = rank(scale 1.0) +LR="${LR:-1e-5}" # 官方 LoRA 的 lr;全量微调用 1e-6 +WEIGHT_DECAY="${WEIGHT_DECAY:-0.0}" +ADAM_BETAS="${ADAM_BETAS:-0.0,0.999}" # 官方 OPSD-V beta1 0.0 / beta2 0.999(train_self_forcing_lora.yaml),也是 stage3 的值 +WARMUP="${WARMUP:-50}" +GRAD_CLIP="${GRAD_CLIP:-10.0}" # 官方 max_grad_norm_generator 10.0,也是 stage3 的值(1.0 在 window 归一化下每步都触发) +BATCH_SIZE="${BATCH_SIZE:-1}" # 不是调参项:显存在 61 cell 的串行 rollout 里,不在 batch 里 +GRAD_ACCUM="${GRAD_ACCUM:-1}" +MAX_STEPS="${MAX_STEPS:-300}" # 参考实现 200 步(LoRA、lr 1e-5);全量微调 1/10 lr,几百步是先探的量级 +USE_EMA="${USE_EMA:-1}" # 学生的 fp32 EMA 影子(我们的加项;dits/ 才是上游产物) +STUDENT_EMA_DECAY="${STUDENT_EMA_DECAY:-0.99}" +EMA_START="${EMA_START:-50}" +SAVE_EVERY="${SAVE_EVERY:-50}" +KEEP_DITS="${KEEP_DITS:-25}" # 全部里程碑都留着挑(dits/ 在这一阶段是部署候选,不只为续训) +KEEP_EMAS="${KEEP_EMAS:-25}" +LOG_EVERY="${LOG_EVERY:-10}" +PROFILE_MEM="${PROFILE_MEM:-0}" +NUM_WORKERS="${NUM_WORKERS:-2}" +SEED="${SEED:-0}" +LIMIT="${LIMIT:-0}" # 0 = 全部 3000 段 +SCENE_DROPOUT="${SCENE_DROPOUT:-0.0}" +RESUME="${RESUME:-auto}" # auto:有 /progress.json 就续(只恢复权重,教师仍冻结在 INIT) +FORCE_RUN_DIR="${FORCE_RUN_DIR:-0}" +ALLOW_RAW_STUDENT="${ALLOW_RAW_STUDENT:-0}" + +# ---- 前置检查(缺什么当场说清楚,不要跑到读完 3×10 GB 之后才炸)---- +[ -f "$INIT" ] || { echo "ABORT: 没有 stage3 的 EMA: $INIT"; echo " 用 INIT=<绝对路径> 指定;它应当是 ema/ema_step{N}.safetensors"; exit 1; } +case "$INIT" in + */dits/*) if [ "$ALLOW_RAW_STUDENT" != "1" ]; then + echo "ABORT: INIT 指向 dits/:$INIT"; echo " stage3 的部署权重是 ema/,dits/ 只为续训存在(risk 12)。确认要用就 ALLOW_RAW_STUDENT=1"; exit 1 + fi;; +esac +[ -d "$LONG" ] || { echo "ABORT: 没有长段目录: $LONG(先跑 actionrope/make_long_segments.py plan/encode)"; exit 1; } +[ -f "$TEXT_TABLE" ] || { echo "ABORT: 没有文本表: $TEXT_TABLE"; exit 1; } +[ -f "$ACC_CFG" ] || { echo "ABORT: 没有 accelerate 配置: $ACC_CFG"; exit 1; } +if [ "$ROPE_CAP" -ne "$((SINK + KV_WINDOW))" ]; then + echo "ABORT: ROPE_CAP($ROPE_CAP) != SINK($SINK) + KV_WINDOW($KV_WINDOW)"; exit 1 +fi +if [ "$TEACHER_CONTEXT" = "student" ]; then + echo "ABORT: TEACHER_CONTEXT=student 是退化自检(loss 恒 0),永远不要拿它训练。CPU 版自检见 --smoke。"; exit 1 +fi +mkdir -p "$OUT" + +# ---- CPU 闸:六条不变量,~20 s,不碰 GPU。两条是整个方法赖以成立的性质:教师读学生自己的缓存时 loss 必须 +# **恰好** 0(同一状态),读真值历史时必须非零(GT 上下文真的进了前向)。---- +echo "[stage4] CPU smoke…" +CUDA_VISIBLE_DEVICES="" "$PY" "$HERE/opsd_arope.py" --smoke || { echo "ABORT: smoke failed"; exit 1; } + +ARGS=( + --init_ckpt "$INIT" --seg_dir "$LONG" --text_table "$TEXT_TABLE" + --denoise_list "$DENOISE_LIST" + --kv_window "$KV_WINDOW" --sink_size "$SINK" --rope_cap "$ROPE_CAP" --sink_anchor "$SINK_ANCHOR" + --rollout_cells "$ROLLOUT_CELLS" --loss_start_frame "$LOSS_START" --loss_type "$LOSS_TYPE" + --teacher_context "$TEACHER_CONTEXT" --teacher_keep_last "$TEACHER_KEEP_LAST" + --teacher_last_chunk "$TEACHER_LAST_CHUNK" --loss_norm "$LOSS_NORM" + --backward_per_chunk "$BACKWARD_PER_CHUNK" --ema_decay "$EMA_DECAY" + --lora_rank "$LORA_RANK" --lora_alpha "$LORA_ALPHA" + --lr "$LR" --weight_decay "$WEIGHT_DECAY" --adam_betas "$ADAM_BETAS" --warmup "$WARMUP" + --grad_clip "$GRAD_CLIP" --batch_size "$BATCH_SIZE" --grad_accum "$GRAD_ACCUM" --max_steps "$MAX_STEPS" + --use_ema "$USE_EMA" --student_ema_decay "$STUDENT_EMA_DECAY" --ema_start "$EMA_START" + --save_every "$SAVE_EVERY" --keep_last_dits "$KEEP_DITS" --keep_last_emas "$KEEP_EMAS" + --log_every "$LOG_EVERY" --profile_mem "$PROFILE_MEM" + --num_workers "$NUM_WORKERS" --seed "$SEED" --limit "$LIMIT" --scene_dropout "$SCENE_DROPOUT" + --output "$OUT" +) +# 写成 if 而不是 `[ cond ] && ARGS+=(...)`:set -e 下 && 链的写法太容易踩坑 +if [ -n "$RESUME" ] && [ "$RESUME" != "none" ]; then + ARGS+=(--resume "$RESUME") +fi +if [ "$FORCE_RUN_DIR" = "1" ]; then + ARGS+=(--force_run_dir) +fi +if [ "$ALLOW_RAW_STUDENT" = "1" ]; then + ARGS+=(--allow_raw_student) +fi + +echo "[stage4] init(student = frozen teacher) = $INIT" +echo "[stage4] long=$LONG ($(ls "$LONG"/seg*.pt | wc -l) 段) out=$OUT port=$PORT cfg=$(basename "$ACC_CFG") $DISTILL_NPROC 卡 FSDP1 等效 batch=$((DISTILL_NPROC * GRAD_ACCUM))" +echo "[stage4] 采样表 $DENOISE_LIST · 窗口 $KV_WINDOW/sink $SINK/cap $ROPE_CAP/anchor $SINK_ANCHOR · rollout $ROLLOUT_CELLS cell · loss_start $LOSS_START ⇒ scored $((ROLLOUT_CELLS - LOSS_START)) cell × 4 状态" +echo "[stage4] lora_rank=$LORA_RANK loss=$LOSS_TYPE ctx=$TEACHER_CONTEXT keep_last=$TEACHER_KEEP_LAST last_chunk=$TEACHER_LAST_CHUNK norm=$LOSS_NORM teacher_ema=$EMA_DECAY lr=$LR betas=$ADAM_BETAS clip=$GRAD_CLIP max_steps=$MAX_STEPS" +# ★ 走开之前把启动日志里这两个信号读一遍: +# 1. [model] mask-channel ||W|| 学生与教师都必须非零(0 = 那个模型对空间条件盲,教师会在无条件下监督)。 +# 2. [first-step] 的 opsd 必须**小但非零**(恰好 0 = 教师读的是学生自己的上下文,没有信号;很大 = 两者错位), +# gnorm 有限且 > 0。trainer 自己也会在恰好 0 / NaN 时 SystemExit(ZERO-LOSS / gnorm 守卫)。 + +# train.log 由 opsd_arope.py 自己带时间戳写;这里另存一份 launch.log,收 NCCL / FSDP / traceback 的原始输出 +"$ACC" launch \ + --config_file "$ACC_CFG" \ + --num_processes "$DISTILL_NPROC" --main_process_port "$PORT" \ + "$HERE/opsd_arope.py" "${ARGS[@]}" "$@" 2>&1 | tee -a "$OUT/launch.log" +# NOTES +# * 产物:dits/dit_step{N} = 学生本体(上游的部署产物;教师冻结、就是 INIT 的字节副本,不存); +# ema/ema_step{N} = 我们额外维护的学生 fp32 EMA 影子。两者都是部署候选,逐个里程碑挑。 +# * 下一步:用 distill/eval/rollout_eval.py 在 60+ cell 上对比 pre-OPSD 的 stage3 EMA 与这里的里程碑 —— +# OPSD 的全部主张都在 rollout 的远端,那个对比才是交付物。 diff --git a/backup_2026-09-14/code/distill/tests/preflight.py b/backup_2026-09-14/code/distill/tests/preflight.py new file mode 100644 index 0000000000000000000000000000000000000000..0e0a5b11b2cbd21362e3dafe1ed817d03687ab46 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/preflight.py @@ -0,0 +1,320 @@ +#!/usr/bin/env python3 +"""滑窗 KV 的**启动前自检**:亚秒级、纯 CPU、tiny 模型,在烧掉任何一次大分配之前把 +sink / 驱逐 / 窗口锚定的算术跑一遍。stage3 启动时第一件事就调它。 +(部署配置 sink=0/window=20/cap=20 实测 ~0.4 s 含建模型、~0.2 s 复用模型; +对照的是 4 个 5B 模型 ~40 GB 的加载与 FSDP 包装。) + + from distill.tests.preflight import preflight_sliding_kv + preflight_sliding_kv(sink_size=0, kv_window=20, rope_cap=20) # stage3 的部署配置 + +移植自 `_wm/GraphGWM/train/code_distill/stage3_dmd/dmd_gm.py:446`(在 `:861` 被调用)。 +上游那一版存在的理由是一个具体的 bug:滑窗读缓存时算 +`R = k_hist.shape[1] // hw - sink`,sink>1 时 rollout 早期缓存里根本不够 sink 帧, +切片给出 n_cached*hw 个 token 而 RoPE 网格按 sink*hw 建 —— frame_index=1 上直接形状崩。 +WorldMind 原版有 `n_sink = min(sink, n_cached)` 这一行,GraphGWM 抄漏了,而 SFT 从不用 KV 缓存, +所以这个 bug 在整条 SFT 链路上是隐形的。`distill/arope_dit.py:638` 保留了那一行守卫, +本文件就是**证明它还在**的那个毫秒级证据。 + +ActionRoPE 比上游多两类必须自检的算术(world RoPE 的重新设计,PORT_SPEC risk 3): + +* **窗口锚定坐标**。缓存里留哪几个绝对 cell 完全由 sink/驱逐决定(`retained_cells`), + `offset_win` 必须逐格对上这个列表并且减掉最老那一格(`offset_win[:,0] == 0`, + `arope_dit.py:628` 硬断言)。差一格不会报错——它会让世界坐标整体错位一个 cell, + rollout 照跑、loss 照降,训的是错的几何。 +* **sink 与漂移坐标不相容**。sink_size>0 时 cell 0 被永久留在缓存里,于是窗口跨度 + = 整条 rollout 的位移,30 个 cell 之后是训练分布外的几十个 token + (`tests/test_world_rope_window.py` 量了这条)。stage3 argparse 默认 sink_size=0,正式训练/部署是 sink 3 / window 17, + 这里对 sink_size>0 只做算术自检、并在日志里点名。 + +为什么是 tiny CPU 模型而不是真权重 +-------------------------------- +自检要在 `WanVideoPipeline.from_pretrained`(10 GB × 4 个模型)之前跑完,否则"先分配再发现 +配置是错的"就毫无意义。dim 24 / 2 层 / latent 4×4 ⇒ 一次 rollout 22 帧仍是毫秒级, +而 **算术**(n_cached、驱逐、tpos、锚定 offset 的形状与值)与 5B 上完全一样。 +""" +from __future__ import annotations + +import os +import sys +import time + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.arope import PX_PER_LATENT, install_arope, known_mask # noqa: E402 +from diffsynth.models.wan_video_dit import WanModel # noqa: E402 +from distill.arope_dit import AropeDiT, unwrap # noqa: E402 +from distill.data import WALK_SPEED_PX_S, window_offsets # noqa: E402 + +__all__ = [ + "retained_cells", "window_offsets_for_frame", "cache_len", + "tiny_dit", "tiny_arope_dit", "preflight_sliding_kv", +] + +# stage3 的部署配置(PORT_SPEC stage3)。rope_cap == sink + kv_window == F-1 == 20 是硬不变量。 +DEFAULT_SINK, DEFAULT_KV_WINDOW, DEFAULT_ROPE_CAP = 0, 20, 20 + +# tiny 模型几何:latent 4×4 → patch (1,2,2) → 2×2 = 4 token/cell。 +# head_dim 必须让 precompute_freqs_cis_3d 的三段列数加起来正好是 head_dim/2: +# head_dim=12 ⇒ f 段 12-2*(12//3)=4 → 2 列,h/w 段各 4 → 2 列,合计 6 = 12/2 ✓。 +# (head_dim=16 就不行:6/2+5/2*2 = 3+2+2 = 7 ≠ 8,rope_apply 会形状崩。) +TINY = dict(dim=24, in_dim=48, ffn_dim=48, out_dim=48, text_dim=4096, freq_dim=256, + eps=1e-6, patch_size=(1, 2, 2), num_heads=2, num_layers=2, has_image_input=False) +TINY_LAT_H, TINY_LAT_W, TINY_L_TXT = 4, 4, 4 + +_TINY_CACHE: dict = {} + + +# -------------------------------------------------------------------------- +# 缓存内容的绝对 cell 下标(stage3 每帧都要用它来切 offset / 文本) +# -------------------------------------------------------------------------- + +def retained_cells(frame_index: int, sink_size: int = DEFAULT_SINK, + kv_window: int | None = DEFAULT_KV_WINDOW) -> list[int]: + """**要前向 cell k 的那一刻**,缓存里还留着哪几个绝对 cell(升序,长度 = n_cached)。 + + 提交顺序是 0,1,2,...;`arope_dit._evict` 保留开头 sink 个、丢掉第 sink 个,直到长度回到 + sink + kv_window。所以留下来的恒等于 **开头 sink 个 + 最近 kv_window 个**: + + k <= sink + kv_window ⇒ [0, k) (还没满,没驱逐) + k > sink + kv_window ⇒ [0, sink) ∪ [k - kv_window, k) (sink 段 + 最近窗口) + + kv_window=None(绝对模式,只用于等价性测试)⇒ [0, k) 永不驱逐。 + 注意 sink_size>0 时这个列表 **不连续**,`data.window_offsets` 的连续切片就不够用了, + 必须走下面的 `window_offsets_for_frame`。 + """ + if frame_index < 0: + raise ValueError(f"frame_index 应 ≥ 0,得到 {frame_index}") + if kv_window is None: + return list(range(frame_index)) + if kv_window < 1 or sink_size < 0: + raise ValueError(f"kv_window 应 ≥ 1、sink_size 应 ≥ 0,得到 {kv_window} / {sink_size}") + cap = sink_size + kv_window + if frame_index <= cap: + return list(range(frame_index)) + return list(range(sink_size)) + list(range(frame_index - kv_window, frame_index)) + + +def cache_len(frame_index: int, sink_size: int = DEFAULT_SINK, + kv_window: int | None = DEFAULT_KV_WINDOW) -> int: + """前向 cell k 之前缓存里的 cell 数 = min(k, sink + kv_window)。`forward_frame` 断言的就是它。""" + return len(retained_cells(frame_index, sink_size, kv_window)) + + +SINK_ANCHORS = ("absolute", "window") + + +def window_offsets_for_frame(offset_px: torch.Tensor, frame_index: int, + sink_size: int = DEFAULT_SINK, + kv_window: int | None = DEFAULT_KV_WINDOW, + sink_anchor: str = "absolute") -> torch.Tensor: + """`forward_frame(offset_win=...)` 要的 [b, n_cached+1, 2]:缓存里那几个 cell + 当前 cell, + 整体减去锚点的世界坐标(于是 `[:, 0] == 0`,满足 arope_dit 的锚定断言)。 + + sink_anchor(只在 sink_size>0 且缓存已饱和时有区别;sink_size=0 两者逐位相同): + absolute —— 锚在**列表里最老那一格** = cell 0。sink 段留在真实世界坐标,代价是当前 cell 的 h/w RoPE + 位随行走无界增长(k=40 时约 1.8× 训练包络),审计 GEO-1 量过。 + window —— 锚在**滑动窗最老的 cell**(k − kv_window),与 sink_size=0 的口径相同,RoPE 不出包络; + sink 段的偏移钉成 0(= 锚点位置):它们的内容照样可见(外观锚点),只是空间对齐信息 + 被放弃 —— 对"全局参照"来说本来也不需要。 + sink_size=0 时窗口连续,退化成 `data.window_offsets(off, a, k)`(本函数会自己核对这一点)。 + """ + if sink_anchor not in SINK_ANCHORS: + raise ValueError(f"sink_anchor 只能是 {SINK_ANCHORS},得到 {sink_anchor!r}") + if offset_px.dim() != 3 or offset_px.shape[-1] != 2: + raise ValueError(f"offset_px 形状应为 [b, F, 2],得到 {tuple(offset_px.shape)}") + idx = retained_cells(frame_index, sink_size, kv_window) + [frame_index] + f = offset_px.shape[1] + if idx[-1] >= f: + raise ValueError(f"offset 只有 {f} 个 cell,要不到 cell {idx[-1]}(rollout 前先 extend_offsets)") + sel = torch.as_tensor(idx, device=offset_px.device, dtype=torch.long) + out = offset_px.index_select(1, sel) + saturated = kv_window is not None and frame_index > sink_size + kv_window + if sink_anchor == "window" and sink_size > 0 and saturated: + # 保留集 = [0, sink) ∪ [k−kv_window, k):锚在 idx[sink_size] = k − kv_window,sink 段钉 0 + out = out - out[:, sink_size:sink_size + 1] + out = torch.cat([torch.zeros_like(out[:, :sink_size]), out[:, sink_size:]], dim=1) + else: + out = out - out[:, :1] + if sink_size == 0: + # 连续窗口:与 data.window_offsets 必须逐位相同 —— 两处口径钉死在一起 + ref = window_offsets(offset_px, idx[0], frame_index) + assert torch.equal(out, ref), ( + f"锚定窗口与 data.window_offsets(off, {idx[0]}, {frame_index}) 不一致 —— 下标口径分叉了") + return out + + +# -------------------------------------------------------------------------- +# tiny 模型 +# -------------------------------------------------------------------------- + +def tiny_dit(seed: int = 1234, device: str = "cpu", dtype=torch.float32, **over) -> WanModel: + """tiny WanModel + ARoPE。mask 通道随机化(零初始化 = 没接上,那就测不到它)。""" + cfg = dict(TINY) + cfg.update(over) + torch.manual_seed(seed) + dit = WanModel(**cfg).to(device=device, dtype=dtype).eval().requires_grad_(False) + install_arope(dit, mask_channel=True) + with torch.no_grad(): + dit.arope_mask_embedding.weight.normal_(0.0, 0.02) + dit.arope_mask_embedding.bias.normal_(0.0, 0.02) + dit.freqs = tuple(t.to(device) for t in dit.freqs) + return dit + + +def tiny_arope_dit(causal: bool = True, seed: int = 1234, device: str = "cpu", + dtype=torch.float32, **over) -> AropeDiT: + return AropeDiT(dit=tiny_dit(seed, device, dtype, **over), mask_channel=True, causal=causal) + + +def _tiny_cached(device: str, dtype) -> AropeDiT: + """同一进程里反复调 preflight 时不重复建模型(stage3 只调一次,测试里会调很多次)。""" + key = (device, str(dtype)) + if key not in _TINY_CACHE: + _TINY_CACHE[key] = tiny_arope_dit(causal=True, device=device, dtype=dtype) + return _TINY_CACHE[key] + + +# -------------------------------------------------------------------------- +# 自检本体 +# -------------------------------------------------------------------------- + +def _const_velocity_offsets(n_cells: int, device, dtype=torch.float32) -> torch.Tensor: + """匀速直行的 [1, n_cells, 2] 世界坐标:实测步速 × 0.25 s/cell(cell 0 起步只有 2.5/16)。 + + 只用来喂形状与数值范围合理的坐标——自检查的是算术,不是画面。 + """ + vx, vy = WALK_SPEED_PX_S + per = torch.tensor([vx, vy], dtype=torch.float64) / 4.0 # 4 帧 / 16 fps = 0.25 s + off = torch.zeros(1, n_cells, 2, dtype=torch.float64) + if n_cells > 1: + off[0, 1] = per * (2.5 / 4.0) # cell 0 只有帧 0,起步项减半 + for k in range(2, n_cells): + off[0, k] = off[0, k - 1] + per + return off.to(device=device, dtype=dtype) + + +def _rollout(m: AropeDiT, n_frames: int, sink_size: int, kv_window, rope_cap: int, + off: torch.Tensor, dtype, device) -> tuple[torch.Tensor, dict, list[int]]: + """提交式 rollout:每个 cell 一次 commit=True 前向,返回 (拼好的输出, 缓存, 每步的 n_cached)。""" + bare = unwrap(m) + hw = (TINY_LAT_H // 2) * (TINY_LAT_W // 2) + cache = bare.init_kv_cache(kv_window=kv_window, sink_size=sink_size, rope_cap=rope_cap) + g = torch.Generator().manual_seed(0) + outs, seen = [], [] + for k in range(n_frames): + k0 = cache["k"][0] + n_cached = 0 if k0 is None else k0.shape[1] // hw + want = cache_len(k, sink_size, kv_window) + assert n_cached == want, f"cell {k}: 缓存里 {n_cached} 个 cell,按 sink/窗口算术应为 {want}" + seen.append(n_cached) + ow = window_offsets_for_frame(off, k, sink_size, kv_window) + assert ow.shape == (1, n_cached + 1, 2), \ + f"cell {k}: offset_win {tuple(ow.shape)} != {(1, n_cached + 1, 2)}" + mk = known_mask(ow[:, -1:] / PX_PER_LATENT, TINY_LAT_H, TINY_LAT_W).to(dtype).unsqueeze(1) + x_k = torch.randn(1, TINY["in_dim"], 1, TINY_LAT_H, TINY_LAT_W, generator=g).to(device, dtype) + ctx = torch.randn(1, 1, TINY_L_TXT, TINY["text_dim"], generator=g).to(device, dtype) + ids = torch.zeros(1, 1, dtype=torch.int64, device=device) + with torch.no_grad(): + # 走 forward(kv_cache=...) 这个入口而不是直接调 forward_frame:FSDP 的 all-gather + # 挂在包装模块的 forward 上,stage3 也必须这么调(arope_dit.py:440) + o = m(x_k, torch.zeros(1, device=device, dtype=dtype), ctx, context_ids=ids, + first_frame_cond=False, frame_index=k, kv_cache=cache, commit=True, + offset_win=ow, mask_in_k=mk) + assert torch.isfinite(o).all(), f"cell {k} 输出出现 NaN/Inf" + outs.append(o) + return torch.cat(outs, dim=2), cache, seen + + +def preflight_sliding_kv(sink_size: int = DEFAULT_SINK, kv_window: int | None = DEFAULT_KV_WINDOW, + rope_cap: int = DEFAULT_ROPE_CAP, *, n_extra: int = 2, + check_eviction_effect: bool = True, device: str = "cpu", + dtype=torch.float32, log=print) -> dict: + """在 tiny CPU 模型上把 sink / 驱逐 / 锚定坐标的算术跑完整一遍。返回一份测量 dict。 + + 跑 `sink_size + kv_window + n_extra` 个 cell —— 刚好越过第一次驱逐,于是**同时**覆盖 + 上游那个 sink 切片 bug(rollout 早期 n_cached < sink)和驱逐之后的稳态。 + + 失败一律抬成 RuntimeError 并附上修法:这是启动闸,不是单元测试,调用方不该继续往下走。 + """ + t0 = time.time() + if kv_window is None or kv_window <= 0: + log("[preflight] kv_window 未启用(绝对模式),滑窗算术无需自检") + return {"checked": False} + + # ---- 0. 纯算术闸(不建模型就能判死的)---- + if sink_size < 0: + raise RuntimeError(f"[preflight] sink_size 必须 ≥ 0,得到 {sink_size}") + if rope_cap != sink_size + kv_window: + raise RuntimeError( + f"[preflight] rope_cap 必须 == sink_size + kv_window({rope_cap} != {sink_size} + {kv_window})。" + "时间位 tpos 恒等于窗口里已缓存的 cell 数,cap 对不上意味着 rollout 会用到训练时" + "从没出现过的相对时间距离。") + if sink_size > 0: + log(f"[preflight] 警告:sink_size={sink_size} > 0。ARoPE 的 h/w RoPE 位是一直在漂的世界坐标," + f"被永久钉住的 sink cell 在长 rollout 之后会落在训练分布之外" + f"(实测 21 cell 内最大位移 373 px = 11.66 token)。stage3 正式训练与部署用的是 sink 3 / window 17 / cap 20。") + + n_frames = sink_size + kv_window + n_extra + m = _tiny_cached(device, dtype) + f_rows = m.dit.freqs[0].shape[0] + if rope_cap + 1 > f_rows: + raise RuntimeError(f"[preflight] rope_cap={rope_cap} 超出时间轴 RoPE 表的 {f_rows} 行") + off = _const_velocity_offsets(n_frames, device, dtype) + + try: + o_slide, cache, seen = _rollout(m, n_frames, sink_size, kv_window, rope_cap, off, dtype, device) + except (AssertionError, RuntimeError, ValueError) as e: + raise RuntimeError( + f"[preflight] 滑窗 KV 路径在 sink_size={sink_size} / kv_window={kv_window} / " + f"rope_cap={rope_cap} 上失败: {type(e).__name__}: {e}\n" + f" 首先检查 distill/arope_dit.py::forward_frame 的历史 RoPE 分段:\n" + f" n_sink = min(kv_cache['sink_size'], n_cached) # ← 上游 GraphGWM 抄漏的就是这一行\n" + f" R = n_cached - n_sink\n" + f" if n_sink > 0: build_world_freqs(..., n_sink, ..., f_start=0)\n" + f" if R > 0: build_world_freqs(..., R, ..., f_start=tpos - R)\n" + f" 以及 offset_win 的切片必须与 preflight.retained_cells({n_frames - 1}, " + f"{sink_size}, {kv_window}) 逐格对齐、且减掉列表里最老那一格。") from e + + hw = (TINY_LAT_H // 2) * (TINY_LAT_W // 2) + cap = sink_size + kv_window + final = cache["k"][0].shape[1] // hw + if final > cap: + raise RuntimeError(f"[preflight] 驱逐没生效:rollout 完缓存里有 {final} 个 cell,上限是 {cap}") + n_evict = max(0, n_frames - cap) + if n_evict == 0: + raise RuntimeError( + f"[preflight] 自检没覆盖到驱逐({n_frames} 帧 ≤ 窗口 {cap})——把 n_extra 调大") + if max(seen) != cap: + raise RuntimeError(f"[preflight] n_cached 没有饱和到 {cap}(实测最大 {max(seen)})") + + # ---- 驱逐必须真的改变结果:形状对内容错是这条路径最典型的静默失败 ---- + d_evict = None + if check_eviction_effect: + big = n_frames # kv_window 大到不会驱逐,作为对照 + o_full, _, _ = _rollout(m, n_frames, sink_size, big, sink_size + big, off, dtype, device) + d_evict = float((o_full[:, :, -1] - o_slide[:, :, -1]).abs().max()) + if not d_evict > 0: + raise RuntimeError( + "[preflight] 驱逐对输出没有任何影响 —— 窗口没在滑,或者最后一帧根本没读到历史。" + "这正是'形状对、内容错、不报错'的那一类失败。") + + ms = (time.time() - t0) * 1e3 + out = {"checked": True, "sink_size": sink_size, "kv_window": kv_window, "rope_cap": rope_cap, + "n_frames": n_frames, "n_cached_max": max(seen), "n_evictions": n_evict, + "cache_cells_final": final, "evict_effect": d_evict, "ms": ms, + "retained_last": retained_cells(n_frames - 1, sink_size, kv_window)} + log(f"[preflight] 滑窗 KV OK: sink={sink_size} window={kv_window} cap={rope_cap};" + f"{n_frames} cell、n_cached 饱和在 {max(seen)}、驱逐 {n_evict} 次、缓存收在 {final} cell;" + f"驱逐对末帧的影响 {d_evict:.3e};{ms:.0f} ms") + return out + + +if __name__ == "__main__": + preflight_sliding_kv(DEFAULT_SINK, DEFAULT_KV_WINDOW, DEFAULT_ROPE_CAP) + preflight_sliding_kv(1, 4, 5) # sink>0 的算术分支(非部署配置) diff --git a/backup_2026-09-14/code/distill/tests/test_bitparity.py b/backup_2026-09-14/code/distill/tests/test_bitparity.py new file mode 100644 index 0000000000000000000000000000000000000000..5e1cc1faed3c491562a638a83ebb1cd41a061987 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_bitparity.py @@ -0,0 +1,306 @@ +#!/usr/bin/env python3 +"""回归锚点:`distill.arope_dit.AropeDiT` 的 **并行双向** 模式必须与 +`actionrope.arope.arope_forward` **逐位相同**(torch.equal,不是 allclose)。 + + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest \\ + /data/zhiyangdeng/ActionRoPE/distill/tests/test_bitparity.py -q + +默认用一个随机初始化的小 WanModel(dim 128 / 2 层 / 4 头,一张卡几秒钟)——蒸馏的每个阶段都建在 +这个等价性上:不成立的话,后面所有的 loss 都是在另一个模型上测的。 + +真权重(10 GB,约 1-2 分钟)版本用环境变量打开: + AROPE_BITPARITY_REAL=1 用 models/Wan2.2-TI2V-5B 的原始权重 + AROPE_BITPARITY_CKPT=outputs/.../step-10000.safetensors 再热启动到这份 ckpt + +顺带守住 PORT_SPEC 对抗验证的三条 BLOCKER 和两条硬规矩(都是"能跑、不报错、模型是错的"那一类)。 +""" +from __future__ import annotations + +import os +import sys + +import pytest +import torch + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from diffsynth.models import wan_video_dit as _wvd # noqa: E402 +from diffsynth.models.wan_video_dit import WanModel # noqa: E402 + +from actionrope.arope import PX_PER_LATENT, arope_forward, install_arope, known_mask # noqa: E402 +from distill.arope_dit import ( # noqa: E402 + MODEL_DIR, + AropeDiT, + arope_block_forward, + build_world_freqs, + load_dit, +) + +DEV = "cuda" if torch.cuda.is_available() else "cpu" +DTYPE = torch.bfloat16 +# 小模型几何:dim 128 / 4 头 ⇒ head_dim 32;latent 8×10 ⇒ patch 之后 4×5 = 20 token/cell +B, C, F_CELL, LAT_H, LAT_W, L_TXT = 2, 48, 5, 8, 10, 32 + + +def _tiny_dit(seed: int = 0) -> WanModel: + torch.manual_seed(seed) + dit = WanModel( + dim=128, in_dim=C, ffn_dim=256, out_dim=C, text_dim=4096, freq_dim=256, eps=1e-6, + patch_size=(1, 2, 2), num_heads=4, num_layers=2, has_image_input=False, + ) + dit = dit.to(device=DEV, dtype=DTYPE).eval().requires_grad_(False) + install_arope(dit, mask_channel=True) + with torch.no_grad(): + # 零初始化的 mask 通道等于没接上:随机化之后 mask_input 才真的参与前向 + dit.arope_mask_embedding.weight.normal_(0.0, 0.02) + dit.arope_mask_embedding.bias.normal_(0.0, 0.02) + dit.freqs = tuple(t.to(DEV) for t in dit.freqs) + return dit + + +def _batch(seed: int = 1, f: int = F_CELL): + g = torch.Generator(device="cpu").manual_seed(seed) + x = torch.randn(B, C, f, LAT_H, LAT_W, generator=g).to(device=DEV, dtype=DTYPE) + context = torch.randn(B, f, L_TXT, 4096, generator=g).to(device=DEV, dtype=DTYPE) + # 故意造重复行:_embed_context 要按 id 去重,重复率不同会走不同的分支 + ids = torch.tensor([[0, 1, 1, 2, 1][:f]] * B, dtype=torch.int64, device=DEV) + for bi in range(B): + for k in range(f): + context[bi, k] = context[bi, int(ids[bi, k])] + offset_px = (torch.rand(B, f, 2, generator=g) * 400.0 - 200.0) + offset_px[:, 0] = 0.0 # cell 0 是锚点 + offset_px = offset_px.to(DEV) + mask_input = known_mask(offset_px / PX_PER_LATENT, LAT_H, LAT_W).to(torch.float32).unsqueeze(1) + return dict(x=x, context=context, context_ids=ids, offset_px=offset_px, mask_input=mask_input) + + +@pytest.fixture(scope="module") +def tiny(): + dit = _tiny_dit() + return dit, AropeDiT(dit=dit, mask_channel=True, causal=False) + + +def _both(dit, model, bt, timestep, *, offset_px=True, mask=True, per_cell_ctx=True, + first_frame_cond=True, gc=False): + """同一组输入分别过 arope_forward 和 AropeDiT,返回 (ref, out)。""" + ctx = bt["context"] if per_cell_ctx else bt["context"][:, 0] + ids = bt["context_ids"] if per_cell_ctx else None + off = bt["offset_px"] if offset_px else None + msk = bt["mask_input"] if mask else None + with torch.no_grad(): + ref = arope_forward( + dit, bt["x"], timestep, ctx, + offset_px=off, first_frame_cond=first_frame_cond, mask_input=msk, + use_gradient_checkpointing=gc, context_ids=ids, + ) + out = model( + bt["x"], timestep, ctx, + context_ids=ids, offset_px=off, mask_input=msk, first_frame_cond=first_frame_cond, + use_gradient_checkpointing=gc, + ) + return ref, out + + +def _assert_bit_equal(ref, out, tag): + assert ref.shape == out.shape, f"[{tag}] 形状不符 {tuple(ref.shape)} vs {tuple(out.shape)}" + assert ref.dtype == out.dtype, f"[{tag}] dtype 不符 {ref.dtype} vs {out.dtype}" + if not torch.equal(ref, out): + d = (ref.float() - out.float()).abs() + raise AssertionError( + f"[{tag}] 不是逐位相同:max|Δ|={d.max().item():.3e} mean|Δ|={d.mean().item():.3e} " + f"不同元素 {int((ref != out).sum())}/{ref.numel()}" + ) + print(f" [{tag}] bit-identical {tuple(ref.shape)} {ref.dtype}") + + +# -------------------------------------------------------------------------- +# 主线:逐位等价 +# -------------------------------------------------------------------------- + +@pytest.mark.parametrize("case", [ + "full", # 世界坐标 RoPE + mask 通道 + 逐 cell 文本,标量 t,first_frame_cond + "no_offset", # 普通查表 RoPE(freqs 走 [S,1,64] 那条无 batch 的分支) + "no_mask", # 不接 mask 通道 + "shared_ctx", # 整条文本 [b, L, 4096] + "no_ffc", # first_frame_cond=False + "t_per_sample", # timestep 形状 [b] + "grad_ckpt", # 两边都开梯度检查点 +]) +def test_parallel_bidirectional_bit_identical(tiny, case): + dit, model = tiny + bt = _batch() + ts = torch.tensor([500.0], device=DEV) + kw = dict(offset_px=True, mask=True, per_cell_ctx=True, first_frame_cond=True, gc=False) + if case == "no_offset": + kw["offset_px"] = False + elif case == "no_mask": + kw["mask"] = False + elif case == "shared_ctx": + kw["per_cell_ctx"] = False + elif case == "no_ffc": + kw["first_frame_cond"] = False + elif case == "t_per_sample": + ts = torch.tensor([500.0, 137.0], device=DEV) + elif case == "grad_ckpt": + kw["gc"] = True + ref, out = _both(dit, model, bt, ts, **kw) + _assert_bit_equal(ref, out, case) + + +def test_repeatable_and_nontrivial(tiny): + """同一输入连跑两次必须逐位一致(否则"逐位相同"这个断言本身没意义), + 且换掉 mask / offset 输出必须变(否则说明这两条 conditioning 根本没接上)。""" + dit, model = tiny + bt = _batch() + ts = torch.tensor([500.0], device=DEV) + with torch.no_grad(): + a = model(bt["x"], ts, bt["context"], context_ids=bt["context_ids"], + offset_px=bt["offset_px"], mask_input=bt["mask_input"]) + b = model(bt["x"], ts, bt["context"], context_ids=bt["context_ids"], + offset_px=bt["offset_px"], mask_input=bt["mask_input"]) + c = model(bt["x"], ts, bt["context"], context_ids=bt["context_ids"], + offset_px=bt["offset_px"], mask_input=None) + d = model(bt["x"], ts, bt["context"], context_ids=bt["context_ids"], + offset_px=None, mask_input=bt["mask_input"]) + assert torch.equal(a, b), "同一输入两次前向就不一致,逐位等价的断言无意义" + assert not torch.equal(a, c), "去掉 mask_input 输出没变 —— mask 通道没接上" + assert not torch.equal(a, d), "去掉 offset_px 输出没变 —— 世界坐标 RoPE 没接上" + + +# -------------------------------------------------------------------------- +# 猴补丁不能破坏上游 +# -------------------------------------------------------------------------- + +def test_monkeypatch_installed_and_backward_compatible(tiny): + dit, _ = tiny + assert _wvd.DiTBlock.forward is arope_block_forward, "DiTBlock.forward 的猴补丁没打上" + # DiffSynth 自己的 model_fn_wan_video 用 block(x, context, t_mod, freqs) 四个位置参数 + 整条 context + b, s, dim = 2, 20, dit.dim + x = torch.randn(b, s, dim, device=DEV, dtype=DTYPE) + ctx = torch.randn(b, L_TXT, dim, device=DEV, dtype=DTYPE) + t_mod = torch.randn(b, 6, dim, device=DEV, dtype=DTYPE) + freqs = build_world_freqs(dit, 1, 4, 5, None, device=DEV) + with torch.no_grad(): + y = dit.blocks[0](x, ctx, t_mod, freqs) + assert y.shape == x.shape and torch.isfinite(y.float()).all() + + +def test_sdpa_only(tiny): + """risk 8:装了 flash-attn / sageattention 之后 arope_forward 与 AropeDiT 会悄悄分叉。""" + assert not _wvd.FLASH_ATTN_3_AVAILABLE + assert not _wvd.FLASH_ATTN_2_AVAILABLE + assert not _wvd.SAGE_ATTN_AVAILABLE + + +# -------------------------------------------------------------------------- +# 三条 BLOCKER 的回归 +# -------------------------------------------------------------------------- + +def test_blocker1_first_frame_cond_banned_on_stream(tiny): + """B1:单 cell 路径上 first_frame_cond=True 会把 rollout 每一帧的 t 抹成 0。必须硬拦。""" + dit, _ = tiny + causal = AropeDiT(dit=dit, mask_channel=True, causal=True) + cache = causal.init_kv_cache(kv_window=4, sink_size=0, rope_cap=4) + x1 = torch.randn(B, C, 1, LAT_H, LAT_W, device=DEV, dtype=DTYPE) + ctx1 = torch.randn(B, 1, L_TXT, 4096, device=DEV, dtype=DTYPE) + off1 = torch.zeros(B, 1, 2, device=DEV) + with pytest.raises(AssertionError, match="first_frame_cond"): + causal(x1, torch.tensor([250.0], device=DEV), ctx1, frame_index=0, kv_cache=cache, + offset_win=off1, first_frame_cond=True) + # risk 6:rollout 绝不能梯度检查点 + with pytest.raises(AssertionError, match="梯度检查点"): + causal(x1, torch.tensor([250.0], device=DEV), ctx1, frame_index=0, kv_cache=cache, + offset_win=off1, first_frame_cond=False, use_gradient_checkpointing=True) + # 正常一趟:t=250 与 t=0 必须给出不同的速度(时间步真的进了模型) + with torch.no_grad(): + c0 = causal.init_kv_cache(kv_window=4, sink_size=0, rope_cap=4) + v250 = causal(x1, torch.tensor([250.0], device=DEV), ctx1, frame_index=0, kv_cache=c0, + offset_win=off1, first_frame_cond=False, commit=False) + c1 = causal.init_kv_cache(kv_window=4, sink_size=0, rope_cap=4) + v0 = causal(x1, torch.tensor([0.0], device=DEV), ctx1, frame_index=0, kv_cache=c1, + offset_win=off1, first_frame_cond=False, commit=False) + assert not torch.equal(v250, v0), "t=250 与 t=0 输出相同 —— 时间步被 first_frame_cond 抹了" + + +def test_blocker2_build_world_freqs_f_start(tiny): + """B2:滑窗 KV 要把单个 cell 放到时间位 f_start。f_start=0 时必须与上游逐位相同。""" + from actionrope.arope import build_world_freqs as upstream + + dit, _ = tiny + off = torch.randn(B, 3, 2, device=DEV, dtype=torch.float64) + a = upstream(dit, 3, 4, 5, off, device=DEV) + b = build_world_freqs(dit, 3, 4, 5, off, device=DEV, f_start=0) + assert torch.equal(a, b), "f_start=0 的本地版与 actionrope.arope.build_world_freqs 不一致" + # 单 cell 放到时间位 2,应当等于 3 帧表的第 3 段 + one = build_world_freqs(dit, 1, 4, 5, off[:, 2:3], device=DEV, f_start=2) + assert torch.equal(one, a[:, 2 * 20:3 * 20]), "f_start 没有把时间轴挪到正确的位置" + # 没有 f_start 的话单 cell 永远落在时间位 0 + zero = build_world_freqs(dit, 1, 4, 5, off[:, 2:3], device=DEV, f_start=0) + assert not torch.equal(one, zero) + + +def test_blocker3_per_cell_timestep(tiny): + """B3:stage1 要传 [b, 21] 的逐 cell 时间步;上游 _per_token_timestep 断言 numel()==b。""" + dit, model = tiny + bt = _batch() + ts_pf = torch.rand(B, F_CELL, device=DEV) * 1000.0 + with torch.no_grad(): + out = model(bt["x"], ts_pf, bt["context"], context_ids=bt["context_ids"], + offset_px=bt["offset_px"], mask_input=bt["mask_input"], first_frame_cond=True) + assert out.shape == bt["x"].shape and torch.isfinite(out.float()).all() + with pytest.raises(AssertionError): + with torch.no_grad(): + arope_forward(dit, bt["x"], ts_pf, bt["context"], offset_px=bt["offset_px"], + mask_input=bt["mask_input"], context_ids=bt["context_ids"]) + # cell 0 的 t 被 first_frame_cond 覆盖成 0:把 ts_pf[:,0] 改掉,输出不该变 + ts2 = ts_pf.clone() + ts2[:, 0] = 999.0 + with torch.no_grad(): + out2 = model(bt["x"], ts2, bt["context"], context_ids=bt["context_ids"], + offset_px=bt["offset_px"], mask_input=bt["mask_input"], first_frame_cond=True) + assert torch.equal(out, out2), "first_frame_cond 没有覆盖逐 cell 时间步的 cell 0" + + +# -------------------------------------------------------------------------- +# 真权重(S1 门禁):默认跳过 +# -------------------------------------------------------------------------- + +@pytest.mark.skipif(os.environ.get("AROPE_BITPARITY_REAL") != "1", + reason="真权重 10 GB,用 AROPE_BITPARITY_REAL=1 打开") +def test_real_weights_bit_identical(): + from safetensors.torch import load_file + + dit = load_dit(MODEL_DIR, device=DEV).eval().requires_grad_(False) + install_arope(dit, mask_channel=True) + ckpt = os.environ.get("AROPE_BITPARITY_CKPT") + if ckpt: + sd = load_file(ckpt) + missing, unexpected = dit.load_state_dict(sd, strict=False) + assert not unexpected, f"ckpt 多了键:{list(unexpected)[:5]}" + assert not [k for k in missing if not k.startswith("arope_mask_embedding")], f"ckpt 缺键:{missing[:5]}" + with torch.no_grad(): + if not ckpt: + dit.arope_mask_embedding.weight.normal_(0.0, 0.02) + dit.arope_mask_embedding.bias.normal_(0.0, 0.02) + dit.freqs = tuple(t.to(DEV) for t in dit.freqs) + model = AropeDiT(dit=dit, mask_channel=True, causal=False) + + g = torch.Generator(device="cpu").manual_seed(7) + f = 21 + x = torch.randn(1, 48, f, 30, 52, generator=g).to(device=DEV, dtype=DTYPE) + context = torch.randn(1, f, 512, 4096, generator=g).to(device=DEV, dtype=DTYPE) + ids = torch.zeros(1, f, dtype=torch.int64, device=DEV) + off = (torch.rand(1, f, 2, generator=g) * 400.0 - 200.0) + off[:, 0] = 0.0 + off = off.to(DEV) + mask_input = known_mask(off / PX_PER_LATENT, 30, 52).to(torch.float32).unsqueeze(1) + ts = torch.tensor([500.0], device=DEV) + with torch.no_grad(): + ref = arope_forward(dit, x, ts, context, offset_px=off, mask_input=mask_input, context_ids=ids) + out = model(x, ts, context, context_ids=ids, offset_px=off, mask_input=mask_input) + _assert_bit_equal(ref, out, "real-5B") diff --git a/backup_2026-09-14/code/distill/tests/test_cond_dropout.py b/backup_2026-09-14/code/distill/tests/test_cond_dropout.py new file mode 100644 index 0000000000000000000000000000000000000000..3770e54ca14210075c645e859a5c6bea9c6d2bf0 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_cond_dropout.py @@ -0,0 +1,161 @@ +"""条件 dropout 的门:三条 null 分支必须真的把对应条件切掉,且默认全 0 时行为一个字节不变。 + +为什么需要:只有训练时 drop 过的条件才能在蒸馏时做 classifier-free guidance。这三档就是 +给 stage1b 适配微调补出 text 以外的 null 分支,接错了不会报错、只会让 Δv 变成噪声。 + + CUDA_VISIBLE_DEVICES="" PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \ + .venv/bin/python -m pytest distill/tests/test_cond_dropout.py -q +""" +from __future__ import annotations + +import os +import sys + +import pytest +import torch + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from distill.arope_dit import build_tf_mask # noqa: E402 +from distill.stage1_ar.ar_tf import ar_tf_loss # noqa: E402 +from distill.tests.preflight import tiny_arope_dit # noqa: E402 + +F, HW = 5, 6 # 5 个 cell、每 cell 6 个 token —— 掩码语义与真实几何无关 + + +# ---------------------------------------------------------------- 掩码语义 + +def _noisy_sees(local: int, sink: int, drop_anchor: bool = False) -> list[set[int]]: + """noisy cell f 能看到哪些 **clean** cell(token [0,S) 是 clean 流,[S,2S) 是 noisy 流)。""" + m = build_tf_mask(F, HW, "cpu", local=local, sink=sink, drop_anchor=drop_anchor) + S = F * HW + out = [] + for fq in range(F): + q = S + fq * HW # 该 noisy cell 的第一个 token + seen = {k // HW for k in range(S) if bool(m[q, k])} + out.append(seen) + return out + + +def test_1_default_window_sees_all_strictly_earlier_clean_cells(): + """local=0:noisy cell f 看 clean 0..f-1,且**绝不**看 clean f(那就是答案)。""" + seen = _noisy_sees(0, 0) + for f in range(F): + assert seen[f] == set(range(f)), f"cell {f} 看到 {seen[f]},应为 {set(range(f))}" + + +def test_2_hist_dropout_window_leaves_only_cell0(): + """local=1 sink=1:只剩 cell 0 —— Δv_hist 的 null(参考还在,历史没了)。""" + seen = _noisy_sees(1, 1) + assert seen[0] == set(), "cell 0 之前没有任何 cell,应为空" + for f in range(1, F): + assert seen[f] == {0}, f"cell {f} 看到 {seen[f]},应只剩 {{0}}" + + +def test_3_ctx_dropout_window_leaves_nothing(): + """local=1 sink=0:一个 clean cell 都看不到 —— Δv_ref 的 null。""" + seen = _noisy_sees(1, 0) + for f in range(F): + assert seen[f] == set(), f"cell {f} 还看得到 {seen[f]},应为空" + + +def test_4_the_three_windows_are_strictly_nested(): + """全历史 ⊋ 只剩 cell0 ⊋ 空。三档不嵌套的话 Δv_hist / Δv_ref 的差分就没有意义。""" + full, refonly, none_ = _noisy_sees(0, 0), _noisy_sees(1, 1), _noisy_sees(1, 0) + for f in range(1, F): + assert none_[f] < refonly[f] < full[f] or (f == 1 and none_[f] < refonly[f] == full[f]), \ + f"cell {f}: {none_[f]} / {refonly[f]} / {full[f]} 不是严格嵌套" + + +def test_4b_anchor_dropout_removes_only_cell0(): + """★ 主力档:cell 0 从每个 noisy cell 的视野里消失,**其余历史一格不少**。 + + 这是「只 drop 场景参考、保留历史」那条 null。与 local/sink 拼不出来,所以单独一档。 + """ + full, anc = _noisy_sees(0, 0), _noisy_sees(0, 0, drop_anchor=True) + for f in range(F): + assert anc[f] == full[f] - {0}, f"cell {f}: 应为 {full[f] - {0}},得到 {anc[f]}" + assert anc[1] == set(), "cell 1 的历史只有 cell 0,摘掉后应为空" + assert anc[4] == {1, 2, 3}, f"cell 4 应保留 1..3,得到 {anc[4]}" + + +def test_4c_anchor_is_not_expressible_by_local_sink(): + """把「摘掉 cell 0」写成 local=F-1 sink=0 是错的:只有最后一格丢得掉 cell 0。 + + 这条测试钉住的是**为什么要新加一个参数**,而不是复用现成的窗口 —— 否则以后有人 + 会顺手把它改回 local/sink,静默地只 drop 掉一格。 + """ + win = _noisy_sees(F - 1, 0) + assert 0 not in win[F - 1], "最后一格确实丢得掉 cell 0" + assert 0 in win[F - 2], "但倒数第二格的窗口里 cell 0 还在 —— 所以窗口拼不出这条 null" + + +# ---------------------------------------------------------------- loss 接线 + +@pytest.fixture(scope="module") +def fix(): + torch.manual_seed(0) + m = tiny_arope_dit(causal=True, device="cpu", dtype=torch.float32) + b, c, f, h, w = 1, 48, 5, 4, 4 + batch = { + "input_latents": torch.randn(b, c, f, h, w), + "context": torch.randn(b, f, 4, 4096), + "context_ids": torch.zeros(b, f, dtype=torch.long), + "offset_px": torch.randn(b, f, 2) * 40.0, + } + noise = torch.randn_like(batch["input_latents"]) + idx = torch.randint(0, 1000, (b, f)) + return m, batch, noise, idx + + +def _loss(fix, **kw): + m, batch, noise, idx = fix + torch.manual_seed(1234) + loss, stats = ar_tf_loss(m, batch, noise=noise, idx_pf=idx, **kw) + return float(loss), stats + + +def test_5_defaults_are_a_no_op(fix): + """三个 dropout 默认 0 时不消耗随机数、不改任何东西 —— stage1 正在跑,行为必须逐位不变。""" + a, _ = _loss(fix) + b, _ = _loss(fix, action_dropout=0.0, hist_dropout=0.0, ctx_dropout=0.0) + assert a == b, f"默认路径被改变了:{a} vs {b}" + + +@pytest.mark.parametrize("flag", ["action_dropout", "hist_dropout", "ctx_dropout", "anchor_dropout"]) +def test_6_each_dropout_at_p1_changes_the_loss(fix, flag): + """p=1 必须真的改变前向。改不动就说明这一路根本没接上(静默失效)。""" + base, _ = _loss(fix) + drop, stats = _loss(fix, **{flag: 1.0}) + assert drop != base, f"{flag}=1.0 与默认完全相同,说明没接上" + key = {"action_dropout": "d_act", "hist_dropout": "d_hist", + "ctx_dropout": "d_ctx", "anchor_dropout": "d_anc"}[flag] + assert float(stats[key]) == 1.0, f"{key} 应记为 1.0,得到 {float(stats[key])}" + + +def test_7_context_levels_are_mutually_exclusive(fix): + """三个上下文档同时抽中时按"砍得越狠越优先":ctx > hist > anchor。同时生效会让窗口语义含糊。""" + _, s3 = _loss(fix, hist_dropout=1.0, ctx_dropout=1.0, anchor_dropout=1.0) + assert (float(s3["d_ctx"]), float(s3["d_hist"]), float(s3["d_anc"])) == (1.0, 0.0, 0.0) + _, s2 = _loss(fix, hist_dropout=1.0, anchor_dropout=1.0) + assert (float(s2["d_hist"]), float(s2["d_anc"])) == (1.0, 0.0) + + +def test_8_action_dropout_makes_every_token_known(fix): + """offset 清零 ⇒ 没有 new 区 ⇒ 权重图退成均匀(new_frac 恒 0)。 + 否则模型会在一个「静止但仍有 new 区」的自相矛盾输入上训。""" + _, base = _loss(fix) + _, drop = _loss(fix, action_dropout=1.0) + assert float(base["new_frac"]) > 0.0, "基线本来就该有 new 区,否则这条测试是空的" + assert float(drop["new_frac"]) == 0.0, f"action drop 后仍有 new 区:{float(drop['new_frac'])}" + + +def test_9_anchor_and_hist_are_different_forwards(fix): + """anchor(摘 cell0、留历史)与 hist(只剩 cell0)是**相反**的两条 null,输出必须不同。 + 接反了不会报错,只会让两条 guidance 的符号反过来。""" + a, _ = _loss(fix, anchor_dropout=1.0) + h, _ = _loss(fix, hist_dropout=1.0) + assert a != h, "anchor 档与 hist 档给出了相同的 loss,说明至少有一条接错了" diff --git a/backup_2026-09-14/code/distill/tests/test_data.py b/backup_2026-09-14/code/distill/tests/test_data.py new file mode 100644 index 0000000000000000000000000000000000000000..16df067040af958269080154f7d88a337d835f1c --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_data.py @@ -0,0 +1,434 @@ +"""distill/data.py 的自测:纯 CPU,用真的 data/latent/arope_sidecar.pt。 + + PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest \ + /data/zhiyangdeng/ActionRoPE/distill/tests/test_data.py -q + +覆盖四类东西: +1. mask_input / weight_map 与 `actionrope.geometry` 的独立实现(numpy 那一套)逐位一致, + 并且 mask == (weight == 1)(PORT_SPEC 特意点名的那个坑:只在 flat 模式下成立)。 +2. window_offsets / window_context 的锚定与下标口径一致。 +3. extend_offsets 的两种 mode,与**帧级积分**(infer.parse_actions 的那套递推 + + geometry.frames_to_cells 的 cell 内均值)逐位一致 —— 这是本文件最要紧的一条, + 把"速度 → 逐 cell 偏移"的换算钉死,而不是照抄一个 v/4。 +4. extend_context 保持最后一条 cell 文本 + id,且与 extend_offsets 逐下标对齐。 +""" +from __future__ import annotations + +import os +import sys + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +import numpy as np +import pytest +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope import geometry as G # noqa: E402 +from actionrope.infer import parse_actions # noqa: E402 +from distill.data import ( # noqa: E402 + WALK_SPEED_PX_S, + append_cell_velocity, + assert_rollout_aligned, + extend_context, + extend_offsets, + make_mask_input, + make_weight_map, + to_device, + walk_speed_from_sidecar, + window_context, + window_offsets, +) + +SIDECAR = os.path.join(ROOT, "data/latent/arope_sidecar.pt") +N_CLIPS = 16 # 取多少条真 clip 做逐位核对 + + +# -------------------------------------------------------------------------- +# 夹具 +# -------------------------------------------------------------------------- + +@pytest.fixture(scope="module") +def sidecar(): + assert os.path.exists(SIDECAR), f"缺少 sidecar: {SIDECAR}(见 PORT_SPEC 的 Preconditions)" + return torch.load(SIDECAR, map_location="cpu", weights_only=False) + + +@pytest.fixture(scope="module") +def real_offsets(sidecar): + """真语料里前 N_CLIPS 条 valid clip 的逐 cell 偏移 → [N_CLIPS, 21, 2] float32。""" + rows = [v["offset_px"] for v in sidecar["clips"].values() if v["valid"]][:N_CLIPS] + assert len(rows) == N_CLIPS + off = torch.stack(rows, 0).to(torch.float32) + assert off.shape == (N_CLIPS, G.CELLS, 2) + assert torch.equal(off[:, 0], torch.zeros(N_CLIPS, 2)), "cell 0 的偏移应恒为 0" + return off + + +# -------------------------------------------------------------------------- +# 帧级积分参考实现(只用 geometry 的分组约定,逐行对着 infer.parse_actions 写) +# -------------------------------------------------------------------------- + +def _cell_frames(k: int) -> list[int]: + """geometry.cell_frames 的推广版(它硬限制 k < 21,这里要算到 26 cell)。""" + return [0] if k == 0 else list(range(4 * k - 3, 4 * k + 1)) + + +def _cells_from_velocity(vel: np.ndarray) -> np.ndarray: + """逐 cell 速度 [n, 2](px/s)→ 逐 cell 偏移 [n, 2],走帧级积分 + cell 内均值。 + + 递推与 infer.parse_actions:132-134 相同(frame_off[i] = frame_off[i−1] + v[cell(i)]/FPS, + 帧 0 恒为 0),分组与 geometry.frames_to_cells 相同(cell 内各帧取均值)。 + """ + vel = np.asarray(vel, np.float64) + n = vel.shape[0] + n_frames = 4 * (n - 1) + 1 + cell_of = np.zeros(n_frames, int) + for k in range(n): + cell_of[_cell_frames(k)] = k + fo = np.zeros((n_frames, 2), np.float64) + for i in range(1, n_frames): + fo[i] = fo[i - 1] + vel[cell_of[i]] / G.FPS + return np.stack([fo[_cell_frames(k)].mean(0) for k in range(n)], 0) + + +def test_reference_integrator_matches_repo(): + """先证明上面的参考实现本身没写错:21 cell 时与 parse_actions + frames_to_cells 逐位相同。""" + ws = np.array(WALK_SPEED_PX_S, np.float64) + for spec in ("right:1.0:21", "up-left:0.8:10, down:1.2:11", "idle:1.0:5, right:1.0:16"): + frame_off, vel = parse_actions(spec, ws) + truth = G.frames_to_cells(frame_off) + got = _cells_from_velocity(vel) + assert np.abs(got - truth).max() < 1e-12, f"{spec}: 参考积分器与仓库实现不一致" + + +# -------------------------------------------------------------------------- +# 1. mask_input / weight_map +# -------------------------------------------------------------------------- + +def test_make_mask_input_matches_geometry(real_offsets): + m = make_mask_input(real_offsets) + assert m.shape == (N_CLIPS, 1, G.CELLS, G.LAT_H, G.LAT_W) + assert m.dtype == torch.float32 + assert set(torch.unique(m).tolist()) <= {0.0, 1.0} + # geometry 的 numpy 独立实现(known_mask_latent),逐 clip 核对 + for i in range(N_CLIPS): + ref = G.known_mask_latent(real_offsets[i].numpy().astype(np.float64)) + got = m[i, 0].bool().numpy() + assert np.array_equal(got, ref), f"clip {i}: mask 与 geometry.known_mask_latent 不一致" + # cell 0 偏移为 0 ⇒ 整幅都是 known + assert torch.all(m[:, 0, 0] == 1.0) + + +def test_make_weight_map_flat(real_offsets): + w = make_weight_map(real_offsets, new_weight=2.0) + assert w.shape == (N_CLIPS, 1, G.CELLS, G.LAT_H, G.LAT_W) + assert w.dtype == torch.float32 + assert set(torch.unique(w).tolist()) <= {1.0, 2.0} + # flat 模式下 mask == (w == 1)。PORT_SPEC 特意说明:这条只在 flat 且 new_weight != 1 时成立, + # 所以 make_mask_input 才必须直接用 known_mask,而不是从权重图反推。 + m = make_mask_input(real_offsets) + assert torch.equal(m, (w == 1.0).float()) + assert torch.all(w[:, 0, 0] == 1.0), "cell 0 全 known ⇒ 权重全 1" + assert (w > 1.0).any(), "真语料里应当有 new 区" + + +def test_mask_must_not_be_derived_from_weight_map(real_offsets): + """把掩码写成 `loss_weight_map(...).eq(1)` 会被 loss 配方绑架,这里把反例钉住。 + + · new_weight=1.0(想关掉 new 区加权)⇒ 权重图恒为 1 ⇒ 反推的"掩码"整幅变成全 known, + 模型输入被悄悄改掉而不报错;make_mask_input 不受影响。 + · dist 爬坡下 (w == 1) 数学上仍等于 known(d == 0 ⟺ known),但那是巧合, + 而且紧贴边界的 1 + 5e-10 在 float32 里就是 1.0 —— 不能当契约用。 + """ + m = make_mask_input(real_offsets) + assert (m == 0).any(), "真语料里应当有 new 区,否则这条测试没意义" + + w1 = make_weight_map(real_offsets, new_weight=1.0) + assert torch.all(w1 == 1.0) + assert not torch.equal(m, (w1 == 1.0).float()), "new_weight=1 时反推的掩码会退化成全 known" + + w_ramp = make_weight_map(real_offsets, new_weight=2.0, ramp_latent=4.0) + assert torch.all(w_ramp >= 1.0) and torch.all(w_ramp <= 2.0) + assert (w_ramp > 1.0).any() and ((w_ramp > 1.0) & (w_ramp < 2.0)).any(), "dist 模式应当出现中间值" + assert not torch.equal(w_ramp, make_weight_map(real_offsets, new_weight=2.0)), "爬坡与 flat 应当不同" + + w_sig = make_weight_map(real_offsets, new_weight=2.0, sigma=[0.5] * N_CLIPS) + assert torch.all(w_sig >= 1.0) and float(w_sig.max()) == pytest.approx(2.0, abs=1e-6) + + +# -------------------------------------------------------------------------- +# 2. 滑窗锚定 +# -------------------------------------------------------------------------- + +def test_window_offsets_anchor(real_offsets): + a, k = 5, 20 + win = window_offsets(real_offsets, a, k) + assert win.shape == (N_CLIPS, k - a + 1, 2) + assert torch.equal(win[:, 0], torch.zeros(N_CLIPS, 2)), "窗口第 0 项必须是锚点(全 0)" + assert torch.allclose(win, real_offsets[:, a:k + 1] - real_offsets[:, a:a + 1]) + # 整窗平移不变:整条 offset 加一个常数,锚定结果不变(RoPE 的相对性靠这条) + shifted = real_offsets + torch.tensor([123.5, -47.25]) + assert torch.allclose(window_offsets(shifted, a, k), win, atol=1e-4) + # 锚定后的 mask 与"锚点足迹"一致:窗口第 0 cell 全 known + mw = make_mask_input(win) + assert torch.all(mw[:, 0, 0] == 1.0) + + +def test_window_context_locks_indices(real_offsets): + b = N_CLIPS + ctx = torch.arange(b * G.CELLS * 2 * 3, dtype=torch.float32).reshape(b, G.CELLS, 2, 3) + ids = torch.arange(b * G.CELLS, dtype=torch.int64).reshape(b, G.CELLS) + a, k = 5, 20 + cw, iw = window_context(ctx, ids, a, k) + ow = window_offsets(real_offsets, a, k) + assert cw.shape[1] == iw.shape[1] == ow.shape[1] == k - a + 1 + assert torch.equal(cw, ctx[:, a:k + 1]) and torch.equal(iw, ids[:, a:k + 1]) + + +def test_window_bounds_are_checked(real_offsets): + with pytest.raises(ValueError): + window_offsets(real_offsets, 5, 21) # k 越界 + with pytest.raises(ValueError): + window_offsets(real_offsets, 7, 3) # a > k + with pytest.raises(ValueError): + window_offsets(real_offsets[:, :, 0], 0, 3) # 形状不是 [b, f, 2] + + +# -------------------------------------------------------------------------- +# 3. 偏移延长 +# -------------------------------------------------------------------------- + +def test_extend_offsets_truncate_is_exact(real_offsets): + """1+N ≤ 21 时必须原样切片:不许把真值换成合成运动。""" + for N in (0, 1, 19, 20): + out = extend_offsets(real_offsets, N, mode="resample") + assert out.shape == (N_CLIPS, N + 1, 2) + assert torch.equal(out, real_offsets[:, :N + 1]) + + +def test_extend_offsets_prefix_preserved(real_offsets): + g = torch.Generator().manual_seed(0) + for mode in ("continue", "resample"): + ext = extend_offsets(real_offsets, 25, mode=mode, rng=g) + assert ext.shape == (N_CLIPS, 26, 2) + assert torch.equal(ext[:, :G.CELLS], real_offsets), f"{mode}: 已知的 21 个 cell 被改动了" + assert torch.isfinite(ext).all() + + +def test_extend_matches_frame_integration(): + """核心一条:延长出来的 cell 偏移 == 帧级积分 + cell 内均值的真值(float64 逐位)。 + + 构造:cell 0..20 匀速 v_a,cell 21..25 换成 v_b。把真值的前 21 个 cell 喂给 + append_cell_velocity,再接上 v_b,结果必须和整条 26 cell 的帧级积分一致——包括 + 换向那一格 (1.5·v_a + 2.5·v_b)/16 的加权。 + """ + ws = np.array(WALK_SPEED_PX_S, np.float64) + for i_a, i_b in ((7, 1), (3, 6), (7, 7), (0, 7), (2, 5)): + v_a = G.ACTION_DIRS[i_a] * ws * 1.0 + v_b = G.ACTION_DIRS[i_b] * ws * 1.15 + vel = np.concatenate([np.repeat(v_a[None], 21, 0), np.repeat(v_b[None], 5, 0)], 0) + truth = _cells_from_velocity(vel) # [26, 2] + off21 = torch.from_numpy(truth[:21]).unsqueeze(0) # [1, 21, 2] float64 + ext = append_cell_velocity(off21, torch.from_numpy(np.repeat(v_b[None], 5, 0)).unsqueeze(0)) + err = (ext[0].numpy() - truth) + assert np.abs(err).max() < 1e-9, f"dirs {i_a}->{i_b}: 最大误差 {np.abs(err).max():.3e} px" + + +def test_extend_continue_is_constant_velocity(): + """'continue' == 沿用最后一段速度:与整条匀速的帧级积分逐位一致。""" + ws = np.array(WALK_SPEED_PX_S, np.float64) + v = G.ACTION_DIRS[6] * ws * 0.9 + truth = _cells_from_velocity(np.repeat(v[None], 26, 0)) + off21 = torch.from_numpy(truth[:21]).unsqueeze(0) + ext = extend_offsets(off21, 25, mode="continue") + assert np.abs(ext[0].numpy() - truth).max() < 1e-9 + # 换个说法:延长段的逐 cell 增量恒等于最后一段已知增量 + d = ext[0, 1:] - ext[0, :-1] + assert torch.allclose(d[20:], d[19:20].expand(5, 2), atol=1e-9) + + +def test_extend_resample_chunk_structure(): + """每 5 个 cell 换一次动作:一个 chunk 内除首格外增量恒定,chunk 之间通常不同。""" + off = torch.zeros(1, 21, 2, dtype=torch.float64) # 静止起手,v_prev = 0 + g = torch.Generator().manual_seed(7) + ext = extend_offsets(off, 40, mode="resample", chunk=5, rng=g) + assert ext.shape == (1, 41, 2) + d = (ext[0, 1:] - ext[0, :-1])[20:] # 延长段的 20 个增量,chunk = [0:5], [5:10], ... + for c in range(4): + blk = d[c * 5:(c + 1) * 5] + # 首格带 1.5·v_prev 的过渡项,后 4 格是纯匀速 + assert torch.allclose(blk[1:], blk[1:2].expand(4, 2), atol=1e-9), f"chunk {c} 内速度不恒定" + seen = {tuple(np.round(d[c * 5 + 2].numpy(), 6)) for c in range(4)} + assert len(seen) >= 2, "4 个 chunk 抽到了完全相同的动作,随机化没生效" + + +def test_extend_resample_deterministic_and_seed_sensitive(real_offsets): + a = extend_offsets(real_offsets, 25, mode="resample", rng=torch.Generator().manual_seed(1234)) + b = extend_offsets(real_offsets, 25, mode="resample", rng=torch.Generator().manual_seed(1234)) + c = extend_offsets(real_offsets, 25, mode="resample", rng=torch.Generator().manual_seed(1235)) + assert torch.equal(a, b), "同种子应当逐位可复现" + assert not torch.equal(a, c), "不同种子应当抽到不同动作" + # 逐样本独立抽(batch 内不应当整齐划一) + steps = (a[:, 21:] - a[:, 20:-1]) + assert not torch.allclose(steps, steps[0:1].expand_as(steps), atol=1e-6) + + +def test_extend_resample_stays_in_envelope(real_offsets, sidecar): + """合成运动的逐 cell 步长不得超过真语料的分布:否则 RoPE 会走到训练没见过的世界坐标。""" + ws = torch.tensor(WALK_SPEED_PX_S) + bound = float(ws.max()) * 1.2 * 4.0 / G.FPS + 1e-6 # 最快方向(横向)× 最大倍率 × 4 帧/16 + g = torch.Generator().manual_seed(0) + ext = extend_offsets(real_offsets, 25, mode="resample", rng=g) + step = (ext[:, 21:] - ext[:, 20:-1]).norm(dim=-1) + assert float(step.max()) <= bound, f"步长 {float(step.max()):.3f} px 超过上界 {bound:.3f}" + # 真语料的逐 cell 步长(valid clip 全量)作为参照:合成的必须落在里面 + all_off = torch.stack([v["offset_px"] for v in sidecar["clips"].values() if v["valid"]], 0) + real_step = (all_off[:, 1:] - all_off[:, :-1]).norm(dim=-1) + assert float(step.max()) <= float(real_step.max()) + assert bound < float(real_step.flatten().quantile(0.999)), ( + f"上界 {bound:.2f} px 应当低于真语料 p99.9({float(real_step.flatten().quantile(0.999)):.2f} px)") + + +def test_extend_resample_include_idle_flag(): + off = torch.zeros(4, 21, 2, dtype=torch.float64) + g = torch.Generator().manual_seed(3) + ext = extend_offsets(off, 45, mode="resample", chunk=5, rng=g, include_idle=False) + step = (ext[:, 21:] - ext[:, 20:-1]).norm(dim=-1) + assert float(step.min()) > 1.0, "include_idle=False 时不应出现 idle(零速)chunk" + g = torch.Generator().manual_seed(3) + ext_i = extend_offsets(off, 45, mode="resample", chunk=5, rng=g, include_idle=True) + assert not torch.equal(ext, ext_i) + + +def test_extend_offsets_rejects_bad_args(real_offsets): + with pytest.raises(ValueError): + extend_offsets(real_offsets, 25, mode="hold") # 偏移不许"保持" + with pytest.raises(ValueError): + extend_offsets(real_offsets, -1) + with pytest.raises(ValueError): + extend_offsets(real_offsets, 25, chunk=0) + with pytest.raises(ValueError): + extend_offsets(real_offsets, 25, speed_mult=(1.2, 0.8)) + + # 非 CPU 的 generator 必须被挡下(抽样固定在 CPU 做)。这里用鸭子类型, + # 免得为了一条断言去初始化 CUDA context——本文件是纯 CPU 测试。 + class _FakeCudaGen: + device = torch.device("cuda") + + with pytest.raises(ValueError): + extend_offsets(real_offsets, 25, rng=_FakeCudaGen()) + + +def test_walk_speed_from_sidecar(sidecar): + ws = walk_speed_from_sidecar(sidecar) + assert len(ws) == 2 and ws[0] > ws[1] > 0 + assert abs(ws[0] - WALK_SPEED_PX_S[0]) < 1e-9 and abs(ws[1] - WALK_SPEED_PX_S[1]) < 1e-9, ( + "模块常量与当前 sidecar 的 walk_speed_px_s 已经不一致,改用 walk_speed_from_sidecar()") + + +# -------------------------------------------------------------------------- +# 4. 文本延长 + 对齐 +# -------------------------------------------------------------------------- + +def _fake_context(b=3, f=G.CELLS, L=8, C=16): + ctx = torch.arange(b * f * L * C, dtype=torch.float32).reshape(b, f, L, C) + ids = torch.arange(b * f, dtype=torch.int64).reshape(b, f) + return ctx, ids + + +def test_extend_context_holds_last_cell(): + ctx, ids = _fake_context() + N = 25 + ce, ie = extend_context(ctx, ids, N) + assert ce.shape == (3, N + 1, 8, 16) and ie.shape == (3, N + 1) + assert torch.equal(ce[:, :G.CELLS], ctx) and torch.equal(ie[:, :G.CELLS], ids) + for k in range(G.CELLS, N + 1): + assert torch.equal(ce[:, k], ctx[:, G.CELLS - 1]), f"cell {k} 没有保持最后一条文本" + assert torch.equal(ie[:, k], ids[:, G.CELLS - 1]), f"cell {k} 的 id 没跟着保持" + + +def test_extend_context_truncate_and_modes(): + ctx, ids = _fake_context() + ce, ie = extend_context(ctx, ids, 10) + assert torch.equal(ce, ctx[:, :11]) and torch.equal(ie, ids[:, :11]) + with pytest.raises(ValueError): + extend_context(ctx, ids, 25, mode="resample") # 文本只有 hold + with pytest.raises(ValueError): + extend_context(ctx, ids[:, :5], 25) # (b, f) 不一致 + with pytest.raises(ValueError): + extend_context(ctx[:, :, :, 0], ids, 25) # 维数不对 + + +def test_extend_context_real_shape_and_dtype(): + """真形状 [1, 21, 512, 4096] bf16 走一遍,确认没有对 L/C 或 dtype 的隐含假设。""" + ctx = torch.randn(1, G.CELLS, 512, 4096, dtype=torch.bfloat16) + ids = torch.randint(0, 361, (1, G.CELLS), dtype=torch.int64) + ce, ie = extend_context(ctx, ids, 25) + assert ce.shape == (1, 26, 512, 4096) and ce.dtype == torch.bfloat16 + assert ie.shape == (1, 26) and ie.dtype == torch.int64 + assert torch.equal(ce[:, 25], ctx[:, 20]) and int(ie[0, 25]) == int(ids[0, 20]) + + +def test_streams_stay_index_locked(real_offsets): + """extend_offsets / extend_context 必须给出同样长度,且 scored tail 的切片口径一致。""" + b = N_CLIPS + ctx, ids = _fake_context(b=b) + for N in (18, 20, 21, 25, 30): + off_e = extend_offsets(real_offsets, N, rng=torch.Generator().manual_seed(N)) + ctx_e, ids_e = extend_context(ctx, ids, N) + assert_rollout_aligned(off_e, ctx_e, ids_e, N) + latent = torch.zeros(b, 48, N + 1, 4, 4) + assert_rollout_aligned(off_e, ctx_e, ids_e, N, latent=latent) + # stage3 的 scored tail:最后 21 个 cell,偏移锚定到 tail 的第一格 + Keff = 20 + if N >= Keff: + a = N - Keff + off_t = window_offsets(off_e, a, N) + ctx_t, ids_t = window_context(ctx_e, ids_e, a, N) + assert off_t.shape[1] == ctx_t.shape[1] == ids_t.shape[1] == Keff + 1 == G.CELLS + assert torch.equal(off_t[:, 0], torch.zeros(b, 2)) + + +def test_assert_rollout_aligned_catches_mismatch(real_offsets): + b = N_CLIPS + ctx, ids = _fake_context(b=b) + N = 25 + off_e = extend_offsets(real_offsets, N, mode="continue") + ctx_e, ids_e = extend_context(ctx, ids, N) + with pytest.raises(AssertionError): + assert_rollout_aligned(off_e, ctx, ids, N) # 文本没延长 + with pytest.raises(AssertionError): + assert_rollout_aligned(real_offsets, ctx_e, ids_e, N) # 偏移没延长 + with pytest.raises(AssertionError): + assert_rollout_aligned(off_e, ctx_e, ids_e[:, :5], N) # id 没跟上 + with pytest.raises(AssertionError): + assert_rollout_aligned(off_e, ctx_e, ids_e, N, latent=torch.zeros(b, 48, N, 4, 4)) + + +# -------------------------------------------------------------------------- +# 5. to_device +# -------------------------------------------------------------------------- + +def test_to_device_cpu_roundtrip(real_offsets): + batch = { + "input_latents": torch.zeros(2, 48, 21, 30, 52, dtype=torch.bfloat16), + "offset_px": real_offsets[:2], + "context_ids": torch.zeros(2, 21, dtype=torch.int64), + "clip_id": ["a", "b"], + "kind": ["normal", "burn"], + } + out = to_device(batch, torch.device("cpu")) + assert set(out) == set(batch) + assert out["clip_id"] == ["a", "b"] and out["kind"] == ["normal", "burn"] + for k in ("input_latents", "offset_px", "context_ids"): + assert out[k].device.type == "cpu" and out[k].dtype == batch[k].dtype + assert torch.equal(out[k], batch[k]) + + +if __name__ == "__main__": + raise SystemExit(pytest.main([os.path.abspath(__file__), "-q"])) diff --git a/backup_2026-09-14/code/distill/tests/test_flow_pf.py b/backup_2026-09-14/code/distill/tests/test_flow_pf.py new file mode 100644 index 0000000000000000000000000000000000000000..2957169d01922aeb5679450858c35a27d1171b29 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_flow_pf.py @@ -0,0 +1,407 @@ +"""distill/flow_pf.py 的纯 CPU 数值单测:网格、方向、逐 cell 加噪、钟形权重、CD 轴、部署表、TI2V。 + + cd /data/zhiyangdeng/ActionRoPE + PYTHONPATH=. DIFFSYNTH_SKIP_DOWNLOAD=True .venv/bin/python -m pytest distill/tests/test_flow_pf.py -q + +重点盯两件事(都是对抗评审点名的): + 1. DiffSynth 的 set_timesteps 是破坏性的 —— cd_axis / deploy_schedule 调用前后模块级 1000 点 + 网格必须逐位不变,且模块级 set_timesteps 必须直接抛异常; + 2. 方向:sigmas[0]=1.0 是纯噪声、下标越大越干净。写反了不会报错,只会训错档。 +""" +from __future__ import annotations + +import os +import sys + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +import pytest +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +sys.path.insert(0, ROOT) +from diffsynth.diffusion.flow_match import FlowMatchScheduler # noqa: E402 +from distill import flow_pf as FP # noqa: E402 + +N = FP.NUM_TRAIN_TIMESTEPS + + +def _ref_sigmas(n=1000, shift=5.0): + """独立重算 Wan 网格,不经 DiffSynth:sigma = shift·s/(1+(shift−1)·s), s=linspace(1,0,n+1)[:-1]。""" + s = torch.linspace(1.0, 0.0, n + 1)[:-1] + return shift * s / (1 + (shift - 1) * s) + + +# ------------------------------------------------------------------ 网格 ---- +def test_grid_matches_closed_form(): + sig, tst = FP.sigmas(), FP.timesteps() + assert sig.shape == (N,) and tst.shape == (N,) + ref = _ref_sigmas() + assert torch.allclose(sig, ref, atol=0, rtol=0) + assert torch.allclose(tst, ref * 1000.0, atol=0, rtol=0) + # 端点:sigmas[0]=1.0(纯噪声),sigmas[999]=5·0.001/1.004 + assert float(sig[0]) == 1.0 and float(tst[0]) == 1000.0 + assert abs(float(sig[-1]) - 0.005 / 1.004) < 1e-9 + assert abs(float(tst[-1]) - 4.98007968) < 1e-5 + assert bool((sig[:-1] > sig[1:]).all()), "sigma 必须严格降序" + + +def test_direction_trap(): + """越噪 == sigma 越大 == 下标越小。""" + assert float(FP.sigma_of_idx(0)) > float(FP.sigma_of_idx(500)) > float(FP.sigma_of_idx(999)) + assert float(FP.t_of_idx(0)) == 1000.0 + assert float(FP.sigma_of_idx(999)) < 0.01 # 近干净 + assert float(FP.sigma_of_idx(0)) == 1.0 # 纯噪声 + + +def test_weights_bell(): + w = FP.weights() + assert w.shape == (N,) and torch.isfinite(w).all() + # bsmntw 钟形:峰值在 t≈500,两端最轻,均值归一到 1(y_shift·steps/Σy_shift) + assert int(w.argmax()) == int(FP.timesteps().sub(500.0).abs().argmin()) + assert abs(float(w.mean()) - 1.0) < 1e-4 + assert float(w[0]) < float(w[N // 2]) and float(w[-1]) < float(w[N // 2]) + assert float(w.min()) >= 0.0 + + +# --------------------------------------------------- 下标 ↔ sigma ↔ t ---- +def test_idx_of_t_roundtrip_and_deploy_points(): + assert int(FP.idx_of_t(1000.0)) == 0 + # t=750 在网格上是精确点:5s/(1+4s)=0.75 ⇒ s=0.375 ⇒ 下标 625 + i750 = int(FP.idx_of_t(750.0)) + assert i750 == 625 and abs(float(FP.sigma_of_idx(i750)) - 0.75) < 1e-7 + # t=500 / 250 不是精确格点(s=1/6, 1/16)。网格在 t 轴上不等距:间隔 = 5/(1+4s)², + # t≈500 处 ~1.8、t≈250 处 ~3.2,所以落点误差按半个格算而不是按 1.0 算。 + for t, tol in ((500.0, 1.0), (250.0, 1.7)): + i = int(FP.idx_of_t(t)) + assert abs(float(FP.t_of_idx(i)) - t) < tol + assert abs(float(FP.sigma_of_idx(i)) - t / 1000.0) < tol / 1000.0 + # 形状保留 + 与 DiffSynth 自己的 argmin 反查一致 + ts = torch.tensor([[1000.0, 750.0], [500.0, 250.0]]) + idx = FP.idx_of_t(ts) + assert idx.shape == (2, 2) and idx.dtype == torch.int64 + ref = FlowMatchScheduler("Wan") + ref.set_timesteps(N, training=True) + for t in (1000.0, 750.0, 500.0, 250.0, 4.98): + assert int(FP.idx_of_t(t)) == int(torch.argmin((ref.timesteps - t).abs())) + assert torch.equal(FP.sigma_of_t(ts), FP.sigma_of_idx(idx)) + + +def test_idx_bounds_are_checked(): + with pytest.raises(AssertionError): + FP.sigma_of_idx(1000) + with pytest.raises(AssertionError): + FP.sigma_of_idx(-1) + with pytest.raises(AssertionError): + FP.sigma_of_idx(torch.tensor([0.5])) # 浮点当下标用是 bug + + +# ------------------------------------------------------ 逐 cell 抽档 ---- +def test_sample_pf_timestep_ids_uniform_and_shaped(): + g = torch.Generator().manual_seed(0) + idx = FP.sample_pf_timestep_ids(4, 21, "cpu", gen=g) + assert idx.shape == (4, 21) and idx.dtype == torch.int64 + assert int(idx.min()) >= 0 and int(idx.max()) < N + big = FP.sample_pf_timestep_ids(2000, 21, "cpu", gen=torch.Generator().manual_seed(1)) + # 严格均匀:端点 0 和 999 与其它下标同概率,样本量 42000 时两端都必须出现过 + assert int(big.min()) == 0 and int(big.max()) == N - 1 + assert abs(float(big.float().mean()) - (N - 1) / 2.0) < 15.0 + # 逐 cell 独立:同一行不同 cell 不该整齐划一 + assert int(big[:, 0].eq(big[:, 1]).sum()) < 50 + # 同种子可复现 + a = FP.sample_pf_timestep_ids(4, 21, "cpu", gen=torch.Generator().manual_seed(7)) + b = FP.sample_pf_timestep_ids(4, 21, "cpu", gen=torch.Generator().manual_seed(7)) + assert torch.equal(a, b) + + +# ---------------------------------------------------------- 逐 cell 加噪 ---- +def test_add_noise_pf_closed_form_fp32(): + torch.manual_seed(0) + x0 = torch.randn(2, 48, 21, 6, 8) + eps = torch.randn_like(x0) + idx = FP.sample_pf_timestep_ids(2, 21, "cpu", gen=torch.Generator().manual_seed(3)) + xt = FP.add_noise_pf(x0, eps, idx) + sig = FP.sigmas()[idx].view(2, 1, 21, 1, 1) + assert torch.allclose(xt, (1 - sig) * x0 + sig * eps, atol=0, rtol=0) + assert xt.shape == x0.shape and xt.dtype == x0.dtype + + +def test_add_noise_pf_is_per_cell(): + """每个 cell 只吃自己那一档:把 cell 5 的下标换掉,别的 cell 一位都不能变。""" + torch.manual_seed(0) + x0 = torch.randn(1, 4, 21, 3, 3) + eps = torch.randn_like(x0) + idx = torch.full((1, 21), 300, dtype=torch.long) + a = FP.add_noise_pf(x0, eps, idx) + idx2 = idx.clone() + idx2[0, 5] = 900 + b = FP.add_noise_pf(x0, eps, idx2) + assert not torch.equal(a[:, :, 5], b[:, :, 5]) + keep = [k for k in range(21) if k != 5] + assert torch.equal(a[:, :, keep], b[:, :, keep]) + # 极端档:idx=0 ⇒ 纯噪声;idx=999 ⇒ 几乎就是 x0 + idx0 = torch.zeros(1, 21, dtype=torch.long) + assert torch.allclose(FP.add_noise_pf(x0, eps, idx0), eps, atol=1e-7) + idx9 = torch.full((1, 21), N - 1, dtype=torch.long) + assert (FP.add_noise_pf(x0, eps, idx9) - x0).abs().max() < 0.05 * eps.abs().max() + + +def test_add_noise_pf_matches_diffsynth_scalar(): + """所有 cell 用同一档时,必须与 DiffSynth 的标量 add_noise 逐位相同(fp32 与 bf16 都验)。""" + ref = FlowMatchScheduler("Wan") + ref.set_timesteps(N, training=True) + torch.manual_seed(1) + for dtype in (torch.float32, torch.bfloat16): + x0 = torch.randn(2, 48, 21, 4, 5).to(dtype) + eps = torch.randn(2, 48, 21, 4, 5).to(dtype) + for i in (0, 3, 250, 625, 999): + t = ref.timesteps[i].view(1) + got = FP.add_noise_pf(x0, eps, torch.full((2, 21), i, dtype=torch.long)) + want = ref.add_noise(x0, eps, t) + assert got.dtype == dtype and want.dtype == dtype + assert torch.equal(got, want), f"dtype={dtype} idx={i} 与 DiffSynth 标量路径不一致" + + +def test_add_noise_pf_bf16_no_catastrophic_cancellation(): + """sigma≈1 时 x0 的系数必须是 bf16(1−fp32 sigma),不是 1−bf16(sigma)(后者 4% 相对误差)。""" + x0 = torch.ones(1, 1, 2, 1, 1, dtype=torch.bfloat16) + eps = torch.zeros_like(x0) + idx = torch.full((1, 2), 20, dtype=torch.long) # sigma ≈ 0.995935 + coef = float(FP.add_noise_pf(x0, eps, idx)[0, 0, 0, 0, 0]) + sig = float(FP.sigmas()[20]) + good = float(torch.tensor(1.0 - sig, dtype=torch.bfloat16)) + bad = float(1.0 - torch.tensor(sig, dtype=torch.bfloat16)) + assert abs(good - bad) / good > 0.03 # 两条路确实差得开,测试有意义 + assert coef == good and coef != bad + + +def test_add_noise_pf_shape_guards(): + x0 = torch.randn(2, 4, 21, 3, 3) + eps = torch.randn_like(x0) + with pytest.raises(AssertionError): + FP.add_noise_pf(x0, eps, torch.zeros(2, 20, dtype=torch.long)) # F 对不上 + with pytest.raises(AssertionError): + FP.add_noise_pf(x0, eps, torch.zeros(3, 21, dtype=torch.long)) # B 对不上 + with pytest.raises(AssertionError): + FP.add_noise_pf(x0, eps, torch.full((2, 21), N, dtype=torch.long)) # 越界 + with pytest.raises(AssertionError): + FP.add_noise_pf(x0, eps.to(torch.bfloat16), torch.zeros(2, 21, dtype=torch.long)) + with pytest.raises(AssertionError): + FP.add_noise_pf(x0[:, :, 0], eps[:, :, 0], torch.zeros(2, 21, dtype=torch.long)) + + +def test_training_target(): + x0, eps = torch.randn(1, 2, 3, 2, 2), torch.randn(1, 2, 3, 2, 2) + assert torch.equal(FP.training_target(x0, eps), eps - x0) + + +# ---------------------------------------------------------- 钟形权重 ---- +def test_training_weight_pf_matches_diffsynth(): + ref = FlowMatchScheduler("Wan") + ref.set_timesteps(N, training=True) + idx = torch.tensor([[0, 250, 500, 999], [1, 2, 3, 4]]) + w = FP.training_weight_pf(idx) + assert w.shape == idx.shape and w.dtype == torch.float32 + for r in range(idx.shape[0]): + for c in range(idx.shape[1]): + i = int(idx[r, c]) + want = ref.training_weight(ref.timesteps[i].view(1)) + assert abs(float(w[r, c]) - float(want)) < 1e-7 + # 中段比两端重 + assert float(FP.training_weight_pf(torch.tensor([500]))) > float(FP.training_weight_pf(torch.tensor([0]))) + + +# ------------------------------------------------------------- CD 轴 ---- +def test_cd_axis_48(): + sig, tst = FP.cd_axis(48) + assert sig.shape == (48,) and tst.shape == (48,) + assert float(sig[0]) == 1.0 + assert abs(float(sig[1]) - 0.99576) < 1e-4 + assert abs(float(sig[-2]) - 0.178571) < 1e-5 # s=2/48 + assert abs(float(sig[-1]) - 0.096154) < 1e-5 # s=1/48 + assert bool((sig[:-1] > sig[1:]).all()) + assert torch.allclose(tst, sig * 1000.0) + # 轴到不了 0:部署表必须结束在低噪端 + assert float(sig[-1]) > 0.0 + ref = _ref_sigmas(48) + assert torch.allclose(sig, ref, atol=1e-7) + + +def test_cd_axis_does_not_destroy_module_grid(): + """对抗评审 [MINOR]:cd_axis 必须用临时实例,模块级 1000 点网格逐位不变。""" + before_s, before_t, before_w = FP.sigmas().clone(), FP.timesteps().clone(), FP.weights().clone() + for n in (4, 8, 48, 100): + FP.cd_axis(n, check_deploy=(n >= 48)) + FP.deploy_schedule() + assert len(FP.sigmas()) == N and len(FP.timesteps()) == N + assert torch.equal(FP.sigmas(), before_s) + assert torch.equal(FP.timesteps(), before_t) + assert torch.equal(FP.weights(), before_w) + # 加噪在这之后仍然正确 + x0 = torch.randn(1, 2, 3, 2, 2) + idx = torch.full((1, 3), 900, dtype=torch.long) + assert torch.allclose(FP.add_noise_pf(x0, torch.zeros_like(x0), idx), + (1 - FP.sigmas()[900]) * x0) + + +def test_module_scheduler_set_timesteps_is_blocked(): + with pytest.raises(RuntimeError): + FP.sched().set_timesteps(48) + with pytest.raises(RuntimeError): + FP.sched().set_timesteps(1000, training=True) + assert len(FP.sigmas()) == N + + +def test_assert_sched_catches_external_mutation(): + """有人就地改写模块级张量时必须当场炸,而不是悄悄用错网格。""" + s = FP.sched() + saved = s.sigmas + try: + s.sigmas = torch.linspace(1.0, 0.0, 49) + with pytest.raises(AssertionError): + FP.sigmas() + with pytest.raises(AssertionError): + FP.add_noise_pf(torch.randn(1, 1, 2, 1, 1), torch.randn(1, 1, 2, 1, 1), + torch.zeros(1, 2, dtype=torch.long)) + finally: + s.sigmas = saved + assert len(FP.sigmas()) == N and torch.equal(FP.sigmas(), saved) + + +# ---------------------------------------------------------- 部署采样表 ---- +def test_deploy_schedule_4step(): + assert FP.DEPLOY_DENOISE_LIST == (1000.0, 750.0, 500.0, 250.0) + idx, sig, t = FP.deploy_schedule() + assert idx.shape == (4,) and sig.shape == (4,) and t.shape == (4,) + assert torch.allclose(sig, torch.tensor([1.0, 0.75, 0.5, 0.25]), atol=2e-3) + assert torch.allclose(t, torch.tensor([1000.0, 750.0, 500.0, 250.0]), atol=1.7) + assert sig.tolist()[0] == 1.0 and abs(sig.tolist()[1] - 0.75) < 1e-6 + assert bool((sig[:-1] > sig[1:]).all()), "必须从噪到净" + assert int(idx[0]) == 0 and int(idx[1]) == 625 + # 和 set_timesteps(4) 的坑对照:后者最后一步停在 sigma≈0.357(读出条件均值 ⇒ 糊) + naive, _ = FP.cd_axis(4, check_deploy=False) + assert float(naive[-1]) > 0.35 and float(sig[-1]) < 0.26 + + +def test_deploy_schedule_custom_and_guards(): + idx, sig, _ = FP.deploy_schedule([1000, 250]) # stage2 EMA 的 2 步部署 + assert idx.shape == (2,) and abs(float(sig[-1]) - 0.25) < 2e-3 + with pytest.raises(AssertionError): + FP.deploy_schedule([250, 1000]) # 升序 = 方向搞反 + with pytest.raises(AssertionError): + FP.deploy_schedule([1000, 1.0]) # 1.0 落不到网格(最低 4.98) + with pytest.raises(AssertionError): + FP.deploy_schedule([]) + + +def test_assert_deploy_covered(): + sig48, _ = FP.cd_axis(48) + FP.assert_deploy_covered(sig48) # 0.09615 <= 0.25 ⇒ 覆盖 + sig4, _ = FP.cd_axis(4, check_deploy=False) + with pytest.raises(AssertionError): + FP.assert_deploy_covered(sig4) # 下界 0.625 > 0.25 ⇒ 没覆盖 + with pytest.raises(AssertionError): + FP.cd_axis(4) # 默认 check_deploy=True 就该拦住 + # 8 点轴下界 s=1/8 ⇒ sigma=0.4545 > 0.25,也覆盖不了 + with pytest.raises(AssertionError): + FP.cd_axis(8) + + +# ------------------------------------------------------------ TI2V 加噪 ---- +def test_ti2v_noise_shape_and_frame0(): + torch.manual_seed(0) + clip = torch.randn(3, 48, 21, 4, 6) + g = torch.Generator().manual_seed(11) + noisy, ts_pf, sig, eps = FP.ti2v_noise(clip, gen=g) + assert noisy.shape == clip.shape and eps.shape == clip.shape and eps.dtype == clip.dtype + assert ts_pf.shape == (3, 21) and ts_pf.dtype == torch.float32 and sig.shape == (3,) + FP.assert_ti2v(noisy, clip, ts_pf) + assert torch.equal(noisy[:, :, 0], clip[:, :, 0]) # cell 0 干净 + assert bool((ts_pf[:, 0] == 0).all()) + for b in range(3): + assert torch.equal(ts_pf[b, 1:], ts_pf[b, 1].expand(20)) # 1..F−1 共享一个 t + assert abs(float(ts_pf[b, 1]) - float(sig[b]) * 1000.0) < 1e-3 + # cell>=1 是闭式加噪 + s5 = sig.view(3, 1, 1, 1, 1) + want = (1 - s5) * clip + s5 * eps + assert torch.allclose(noisy[:, :, 1:], want[:, :, 1:], atol=0, rtol=0) + + +def test_ti2v_noise_clamp_range(): + """clamp 是**下标**区间 [20,980) ⇒ sigma∈(0.0969, 0.9959],两端都不取到。""" + g = torch.Generator().manual_seed(5) + clip = torch.zeros(512, 4, 21, 2, 2) + _, ts_pf, sig, _ = FP.ti2v_noise(clip, gen=g) + lo, hi = float(FP.sigma_of_idx(979)), float(FP.sigma_of_idx(20)) + assert abs(hi - 0.995935) < 1e-5 and abs(lo - 0.096864) < 1e-5 + assert float(sig.min()) >= lo - 1e-9 and float(sig.max()) <= hi + 1e-9 + assert float(sig.max()) < 1.0 and float(sig.min()) > 0.09 + assert float(ts_pf[:, 1].max()) < 1000.0 + # 收紧 clamp 后区间跟着收紧 + _, _, sig2, _ = FP.ti2v_noise(clip, clamp=(500, 501), gen=g) + assert torch.allclose(sig2, FP.sigma_of_idx(500).expand_as(sig2)) + with pytest.raises(AssertionError): + FP.ti2v_noise(clip, clamp=(980, 20)) + with pytest.raises(AssertionError): + FP.ti2v_noise(clip, clamp=(0, 1001)) + + +def test_ti2v_noise_keeps_grad_through_frame0(): + """stage3 的 critic loss 会把带梯度的 tail 送进来:cell 0 用 where 写回,不能断图也不能原地写。""" + clip = torch.randn(1, 4, 5, 2, 2, requires_grad=True) + noisy, _, _, _ = FP.ti2v_noise(clip, gen=torch.Generator().manual_seed(2)) + noisy.sum().backward() + assert clip.grad is not None + assert float(clip.grad[:, :, 0].abs().min()) > 0.0 # cell 0 也有梯度 + assert float(clip.grad[:, :, 1:].abs().min()) > 0.0 + + +def test_ti2v_noise_bf16_and_reproducible(): + clip = torch.randn(2, 4, 6, 2, 2).to(torch.bfloat16) + a = FP.ti2v_noise(clip, gen=torch.Generator().manual_seed(9)) + b = FP.ti2v_noise(clip, gen=torch.Generator().manual_seed(9)) + assert a[0].dtype == torch.bfloat16 and a[3].dtype == torch.bfloat16 + assert torch.equal(a[0], b[0]) and torch.equal(a[1], b[1]) and torch.equal(a[3], b[3]) + + +def test_assert_ti2v_rejects_bad_inputs(): + clip = torch.randn(1, 4, 5, 2, 2) + noisy, ts_pf, _, _ = FP.ti2v_noise(clip, gen=torch.Generator().manual_seed(4)) + bad = ts_pf.clone() + bad[:, 0] = 7.0 + with pytest.raises(AssertionError): + FP.assert_ti2v(noisy, clip, bad) + bad2 = ts_pf.clone() + bad2[:, 3] = 123.0 + with pytest.raises(AssertionError): + FP.assert_ti2v(noisy, clip, bad2) + dirty = noisy.clone() + dirty[:, :, 0] += 1.0 + with pytest.raises(AssertionError): + FP.assert_ti2v(dirty, clip, ts_pf) + + +# ------------------------------------------- stage1 loss 端到端形状自洽 ---- +def test_stage1_pipeline_shapes(): + """PORT_SPEC stage1 的那段代码原样跑一遍(小尺寸),确认形状与归一化都对得上。""" + b, c, f, h, w = 2, 48, 21, 4, 6 + x0 = torch.randn(b, c, f, h, w, dtype=torch.bfloat16) + noise = torch.randn_like(x0) + idx_pf = FP.sample_pf_timestep_ids(b, f, "cpu", gen=torch.Generator().manual_seed(0)) + noisy = FP.add_noise_pf(x0, noise, idx_pf) + ts_pf = FP.t_of_idx(idx_pf) + noisy[:, :, 0] = x0[:, :, 0] + ts_pf[:, 0] = 0.0 + assert noisy.shape == x0.shape and ts_pf.shape == (b, f) + assert torch.equal(noisy[:, :, 0], x0[:, :, 0]) and bool((ts_pf[:, 0] == 0).all()) + assert float(ts_pf[:, 1:].min()) > 4.9 and float(ts_pf[:, 1:].max()) <= 1000.0 + target = FP.training_target(x0, noise) + v = torch.randn_like(x0) + wmap = torch.ones(b, 1, f, h, w) + se = (v.float() - target.float()) ** 2 + se, wmap = se[:, :, 1:], wmap[:, :, 1:] + per_frame = (se * wmap).sum(dim=(1, 3, 4)) / (wmap.sum(dim=(1, 3, 4)) * c) + tw = FP.training_weight_pf(idx_pf[:, 1:]).float() + assert per_frame.shape == (b, f - 1) and tw.shape == (b, f - 1) + loss = (tw * per_frame).mean() + assert torch.isfinite(loss) and float(loss) > 0 diff --git a/backup_2026-09-14/code/distill/tests/test_flowmap_model.py b/backup_2026-09-14/code/distill/tests/test_flowmap_model.py new file mode 100644 index 0000000000000000000000000000000000000000..d3c4a1d38486b77f0dc0a1abab0f7c412c3f62fd --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_flowmap_model.py @@ -0,0 +1,609 @@ +#!/usr/bin/env python3 +"""flow map 模型侧的闸门:`AropeDiT.install_flowmap()` + 第二个时间步 r。 + + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest \\ + /data/zhiyangdeng/ActionRoPE/distill/tests/test_flowmap_model.py -q -s + +stage2 从 CD 换成 AnyFlow 的 flow-map any-step 蒸馏,模型侧只多一件事:均速度 +`u(x_t, t, r) ≈ v − (t−r)·dF/dt` 里的第二个时间 r。这里守住的是**换上去的那一刻什么都没变**: + +* **residual 形式(默认)对任意 (t, r) 逐位恒等**,不只是 r == t 的对角线。这是硬要求: + 按构造有 50 % 的样本在 off-diagonal 上,而初值是 stage1b —— 24 GPU-hours 换来的、不可复现的教师。 + 上游 AnyFlow 的 convex 形式 `(1−g)E(t) + g·E_d(r)` 只在对角线上恒等,off-diagonal 实测差 1e-01 + (test_13 把这条差异钉下来,免得有人换了 `--flowmap_form convex` 还以为自己是从教师起步的)。 +* **没装 delta 分支时 r 这条路径必须完全不存在**。上游那个 stock embedder 收下 r_timestep 然后 + 忽略它(transformer_far_wan_model.py:241)—— 接错线会退化成普通扩散模型,不报错、loss 照降。 +* **first_frame_cond 对 r 同样生效**、**TF 的 clean 半流硬接 r := t**、**B1 对 r 一字不差**: + 三个地方任何一个漏掉,TI2V 锚点那一格就掉到对角线之外,而那正是最不能变的一格。 +* **5 个新键活着穿过 save_dit / load_dit_ckpt**:`delta_embedding.{0,2}.{weight,bias}` + `delta_gate` + 挂在 dit 上 ⇒ strip_dit_prefix 之后是平铺键,827 → 832(test_12)。挂在 AropeDiT 包装上会被静默丢掉。 + +几何:tiny 模型(dim 128 / 2 层 / 4 头),latent 8×10 ⇒ patch 后 4×5 = 20 token/cell,F=5 cell。 +""" +from __future__ import annotations + +import copy +import os +import sys + +import pytest +import torch + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.arope import PX_PER_LATENT, known_mask # noqa: E402 +from distill import runlib # noqa: E402 +from distill.arope_dit import DELTA_EMBEDDING_NAME, DELTA_GATE_NAME, AropeDiT, unwrap # noqa: E402 +from distill.tests.preflight import tiny_dit, window_offsets_for_frame # noqa: E402 + +DEV = "cuda" if torch.cuda.is_available() else "cpu" +DT = torch.float32 +B, C, F, LH, LW, L_TXT = 2, 48, 5, 8, 10, 8 +HW = (LH // 2) * (LW // 2) # 20 token/cell +PER_CELL_PX = (17.31, 11.50) # 实测步速 (69.24, 46.01) px/s ÷ 4 帧 +# 与 r == t 一起测的三个 off-diagonal:中间、consistency 槽的 0、以及量程上界 +R_PROBES = (250.0, 0.0, 1000.0) +T_MAIN = 500.0 + + +# ---------------------------------------------------------------------------- +# 夹具 +# ---------------------------------------------------------------------------- + +def _model(causal: bool = True, dtype=DT, device: str = DEV, seed: int = 1234) -> AropeDiT: + dit = tiny_dit(seed=seed, device=device, dtype=dtype, + dim=128, ffn_dim=256, num_heads=4, num_layers=2) + return AropeDiT(dit=dit, mask_channel=True, causal=causal) + + +def _inputs(seed: int = 7, dtype=DT, device: str = DEV) -> dict: + g = torch.Generator().manual_seed(seed) + x = torch.randn(B, C, F, LH, LW, generator=g).to(device=device, dtype=dtype) + ctx = torch.randn(B, F, L_TXT, 4096, generator=g).to(device=device, dtype=dtype) + ids = torch.arange(F, device=device, dtype=torch.int64).unsqueeze(0).expand(B, F).contiguous() + per = torch.tensor(PER_CELL_PX).view(1, 1, 2) + off = torch.zeros(B, F, 2) + off[:, 1:] = (per + torch.randn(B, F - 1, 2, generator=g) * 4.0).cumsum(1) + off = off.to(device=device, dtype=torch.float32) + mask_in = known_mask(off / PX_PER_LATENT, LH, LW).to(torch.float32).unsqueeze(1) + clean = torch.randn(B, C, F, LH, LW, generator=g).to(device=device, dtype=dtype) + # 两条非平凡性前提:世界坐标要漂过至少一个 latent 格、known 掩码要真有 0 也有 1, + # 否则"世界坐标 RoPE"和"mask 通道"这两路条件等于没接上,恒等性是白测的 + assert float(off.abs().max()) > PX_PER_LATENT, f"偏移太小({float(off.abs().max()):.1f} px)" + assert 0.0 < float(mask_in.mean()) < 1.0, "known 掩码全 0 或全 1" + return dict(x=x, ctx=ctx, ids=ids, off=off, mask_in=mask_in, clean=clean) + + +@pytest.fixture(scope="module") +def d(): + return _inputs() + + +def _cond(d: dict, **over) -> dict: + c = dict(context=d["ctx"], context_ids=d["ids"], offset_px=d["off"], + mask_input=d["mask_in"], first_frame_cond=True) + c.update(over) + return c + + +def _fwd(m: AropeDiT, d: dict, t=T_MAIN, r=None, **over) -> torch.Tensor: + kw = _cond(d, **over) + if r is not None: + kw["r_timestep"] = r + with torch.no_grad(): + return m(d["x"], t, **kw) + + +def _train_delta(m: AropeDiT, scale: float = 1.0) -> AropeDiT: + """把零初始化的读出层填成"训练过"的样子:直接抄 time_embedding 的读出层。 + + 用 normal_(0, 0.02) 的话 delta 分支的贡献比舍入误差大不了多少,"r 真的改变了输出"就成了 + 在测浮点噪声。抄一份 E 的读出 ⇒ residual 给出 E(t) + E(r),量级与主分支相当,差异是结构性的。 + """ + dit = unwrap(m).dit + with torch.no_grad(): + getattr(dit, DELTA_EMBEDDING_NAME)[2].weight.copy_(dit.time_embedding[2].weight * scale) + getattr(dit, DELTA_EMBEDDING_NAME)[2].bias.copy_(dit.time_embedding[2].bias * scale) + return m + + +def _bit_equal(a: torch.Tensor, b: torch.Tensor, tag: str): + assert a.shape == b.shape and a.dtype == b.dtype, ( + f"[{tag}] 形状/dtype 不符 {tuple(a.shape)}{a.dtype} vs {tuple(b.shape)}{b.dtype}") + if not torch.equal(a, b): + dd = (a.float() - b.float()).abs() + raise AssertionError( + f"[{tag}] 不是逐位相同:max|Δ|={dd.max().item():.3e} mean|Δ|={dd.mean().item():.3e} " + f"不同元素 {int((a != b).sum())}/{a.numel()}") + + +def _maxdiff(a: torch.Tensor, b: torch.Tensor) -> float: + return float((a.float() - b.float()).abs().max()) + + +# ---------------------------------------------------------------------------- +# 1. 装上去的那一刻:键、门、零初始化 +# ---------------------------------------------------------------------------- + +def test_1_install_gate_at_init(): + m = _model() + assert m.has_flowmap is False and m.flowmap_form is None, "__init__ 绝不能自己装 flow map" + n_before = len(m.state_dict()) + + m.install_flowmap() # 默认 residual / gate 1.0 + dit = m.dit + assert m.has_flowmap is True and m.flowmap_form == "residual" + + new = sorted(set(m.state_dict()) - set(_model().state_dict())) + assert new == sorted(f"dit.{k}" for k in runlib.FLOWMAP_KEYS), f"新增的键不对:{new}" + assert len(m.state_dict()) == n_before + 5, f"应当只多 5 个键,实际 {len(m.state_dict()) - n_before}" + + de = getattr(dit, DELTA_EMBEDDING_NAME) + # 第一层是教师的逐位副本:分支一上来就有 r 的有意义隐表示,∂L/∂delta[2] 第 0 步就非零 + assert torch.equal(de[0].weight, dit.time_embedding[0].weight) + assert torch.equal(de[0].bias, dit.time_embedding[0].bias) + # 读出层全 0 ⇒ D(·) ≡ 0 ⇒ 对任意 (t, r) 恒等(test_2/3/4 端到端验) + assert float(de[2].weight.abs().max()) == 0.0 and float(de[2].bias.abs().max()) == 0.0 + assert de[2].weight is not dit.time_embedding[2].weight, "必须是 deepcopy,不能共享张量" + + g = getattr(dit, DELTA_GATE_NAME) + assert tuple(g.shape) == (1,) and float(g) == 1.0 + assert g.dtype == dit.time_embedding[0].weight.dtype and g.device == dit.time_embedding[0].weight.device + # persistent=True:门跟着权重走。上游 persistent=False(从 config 重建), + # 训练与推理可以悄悄用不同的门而不报错 + assert DELTA_GATE_NAME in {k.split(".")[-1] for k in m.state_dict()} + assert f"dit.{DELTA_GATE_NAME}" in dict(m.named_buffers()) + print(f"1. install {len(new)} 个新键 {new};delta[0] 逐位=E[0],delta[2]≡0,gate={float(g)}") + + +def test_1b_install_guards(): + m = _model().install_flowmap() + with pytest.raises(AssertionError, match="已经装过"): + m.install_flowmap() # 重复装 = 静默丢掉训练过的 delta 分支 + with pytest.raises(AssertionError, match="flowmap_form"): + _model().install_flowmap(form="convex_residual_whatever") + # 门必须在权重 dtype 下可精确表示:存盘时会被 cast 成 bf16,不精确 = 训练用的门和装回来的不是一个数 + mb = _model(dtype=torch.bfloat16) + mb.install_flowmap(gate=0.25) # 0.25 在 bf16 里是精确的 + with pytest.raises(AssertionError, match="不可精确表示"): + _model(dtype=torch.bfloat16).install_flowmap(gate=0.1) + # 再包一层已经装过 flow map 的 dit:必须显式说是哪种形式(两种融合公式不同,猜错不会报错) + with pytest.raises(AssertionError, match="已经有 delta_embedding"): + AropeDiT(dit=m.dit, mask_channel=True, causal=True) + m2 = AropeDiT(dit=m.dit, mask_channel=True, causal=True, flowmap_form="residual") + assert m2.has_flowmap and m2.flowmap_form == "residual" + with pytest.raises(AssertionError, match="flowmap_form"): + AropeDiT(dit=m.dit, mask_channel=True, causal=True, flowmap_form="nope") + # deepcopy 会把 flowmap_form 一起带走(EMA / 参照物都靠这个) + assert copy.deepcopy(m).flowmap_form == "residual" + print("1b. guards 重复 install / 非法 form / bf16 下不精确的 gate / 再包一层不说明 form —— 都被拦下") + + +# ---------------------------------------------------------------------------- +# 2-4. residual 形式:对任意 r 与装之前逐位相同(三条前向路径各一遍) +# ---------------------------------------------------------------------------- + +def test_2_identity_all_r_parallel(d): + for causal in (False, True): + m = _model(causal=causal) + base = _fwd(m, d) + m.install_flowmap() + for r in (T_MAIN,) + R_PROBES: + _bit_equal(_fwd(m, d, r=r), base, f"parallel causal={causal} r={r}") + # 逐 cell 的 [b, F] r 也要恒等(stage2 的 --per_cell_tr 消融走这条) + r_pc = torch.rand(B, F, device=DEV, dtype=DT) * 1000.0 + _bit_equal(_fwd(m, d, r=r_pc), base, f"parallel causal={causal} r=[b,F]") + print("2. identity 并行双向 / 并行块因果:r ∈ {t, 250, 0, 1000, [b,F]} 全部逐位相同") + + +def test_3_identity_all_r_tf(d): + m = _model(causal=True) + for aug_t in (None, 120.0): + base = _fwd(m, d, clean_x=d["clean"], aug_t=aug_t) + assert m.has_flowmap is False + m2 = _model(causal=True).install_flowmap() + for r in (T_MAIN,) + R_PROBES: + _bit_equal(_fwd(m2, d, r=r, clean_x=d["clean"], aug_t=aug_t), base, f"tf aug_t={aug_t} r={r}") + print("3. identity TF 双流(aug_t=None / 120):r ∈ {t, 250, 0, 1000} 全部逐位相同") + + +def test_4_identity_all_r_stream(d): + m = _model(causal=True) + ts = torch.tensor([[0.0, 900.0, 700.0, 400.0, 150.0]], device=DEV, dtype=DT).expand(B, F) + + def roll(mm, r_of): + cache = unwrap(mm).init_kv_cache(kv_window=None, sink_size=0, rope_cap=0) + outs = [] + for k in range(F): + ow = window_offsets_for_frame(d["off"], k, 0, None) + mk = known_mask(ow[:, -1:] / PX_PER_LATENT, LH, LW).to(torch.float32).unsqueeze(1) + kw = dict(offset_win=ow, mask_in_k=mk, context_ids=d["ids"][:, k:k + 1], + first_frame_cond=False, frame_index=k, kv_cache=cache, commit=True) + if r_of is not None: + kw["r_timestep"] = r_of(k) + with torch.no_grad(): + outs.append(mm(d["x"][:, :, k:k + 1], ts[:, k], d["ctx"][:, k:k + 1], **kw)) + return torch.cat(outs, dim=2) + + base = roll(m, None) + m2 = _model(causal=True).install_flowmap() + for r in (None,) + R_PROBES: # None ⇒ r := t(对角线) + _bit_equal(roll(m2, (lambda k: ts[:, k]) if r is None else (lambda k, r=r: r)), base, + f"stream r={r}") + print("4. identity 流式单 cell(forward_frame / KV 缓存):r ∈ {t, 250, 0, 1000} 全部逐位相同") + + +# ---------------------------------------------------------------------------- +# 5-6. r 真的进了模型;门真的是门 +# ---------------------------------------------------------------------------- + +def test_5_r_changes_output(d): + m = _model(causal=True) + base = _fwd(m, d) + m2 = _train_delta(_model(causal=True).install_flowmap()) + + outs = {r: _fwd(m2, d, r=r) for r in (T_MAIN,) + R_PROBES} + scale = float(base.abs().max()) + # (a) 训练过的 delta 分支必须改变输出(哪怕 r == t:D(t) 已经不是 0 了) + d_diag = _maxdiff(outs[T_MAIN], base) + assert d_diag > 1e-3 * scale, f"delta 分支训练之后 r==t 也应当改变输出,实测 {d_diag:.3e}" + # (b) 不同的 r 必须给出不同的输出 —— 否则 r 根本没进模型(上游 stock embedder 的那种静默失败) + for r in R_PROBES: + dr = _maxdiff(outs[r], outs[T_MAIN]) + assert dr > 1e-3 * scale, f"r={r} 与 r=t 的输出只差 {dr:.3e}(相对 {dr / scale:.2e})—— r 没接进去" + # (c) 逐 cell 的 r:只改一个 cell 的 r,输出必须变(且 first_frame_cond 之外的 cell 才算) + r_a = torch.full((B, F), 250.0, device=DEV, dtype=DT) + r_b = r_a.clone() + r_b[:, 2] = 800.0 + assert _maxdiff(_fwd(m2, d, r=r_a), _fwd(m2, d, r=r_b)) > 1e-3 * scale + print("5. sensitive r ∈ {t,250,0,1000} 两两不同:max|Δ| " + f"{[f'{_maxdiff(outs[r], outs[T_MAIN]):.2e}' for r in R_PROBES]}(|out| ≈ {scale:.2f})") + + +def test_6_gate_zero_restores_identity(d): + """门 = 0 ⇒ 不管 delta 分支学成什么样,输出都回到装之前,逐位。""" + m = _model(causal=True) + base = _fwd(m, d) + m2 = _train_delta(_model(causal=True).install_flowmap()) + assert _maxdiff(_fwd(m2, d, r=250.0), base) > 0.0 + with torch.no_grad(): + getattr(m2.dit, DELTA_GATE_NAME).zero_() + for r in (T_MAIN,) + R_PROBES: + _bit_equal(_fwd(m2, d, r=r), base, f"gate=0 r={r}") + print("6. gate delta_gate=0 ⇒ 任意 r 都逐位回到装之前") + + +# ---------------------------------------------------------------------------- +# 7-8. 两个方向的响亮失败 +# ---------------------------------------------------------------------------- + +def test_7_no_flowmap_r_is_strict_noop(d): + """没装 delta 分支 ⇒ r 只能是 None 或与 t 完全相同,其余一律炸。 + + 上游那个 stock embedder 收下 r_timestep 然后忽略它(transformer_far_wan_model.py:241)—— + 照抄的话"忘了 install_flowmap"会退化成普通扩散模型,不报错、loss 照降、模型是错的。 + """ + m = _model(causal=True) + base = _fwd(m, d) + _bit_equal(_fwd(m, d, r=None), base, "no-flowmap r=None") + _bit_equal(_fwd(m, d, r=T_MAIN), base, "no-flowmap r==t 标量") + _bit_equal(_fwd(m, d, r=torch.full((B,), T_MAIN, device=DEV, dtype=DT)), base, "no-flowmap r==t [b]") + ts_pc = torch.rand(B, F, device=DEV, dtype=DT) * 1000.0 + with torch.no_grad(): + ref_pc = m(d["x"], ts_pc, **_cond(d)) + _bit_equal(_fwd(m, d, t=ts_pc, r=ts_pc.clone()), ref_pc, "no-flowmap r==t [b,F]") + for bad in (250.0, torch.full((B,), 250.0, device=DEV, dtype=DT)): + with pytest.raises(AssertionError, match="没装 flow map"): + _fwd(m, d, r=bad) + print("7. no-op 没装 flow map:r=None / r==t(标量·[b]·[b,F])逐位相同,r≠t 直接炸") + + +def test_8_flowmap_requires_r(d): + """装了 delta 分支 ⇒ r 是必填的(扩散槽也要显式写 r_timestep=timestep)。""" + m = _model(causal=True).install_flowmap() + with pytest.raises(AssertionError, match="必填"): + _fwd(m, d) # 并行路径 + cache = unwrap(m).init_kv_cache(kv_window=None, sink_size=0, rope_cap=0) + ow = window_offsets_for_frame(d["off"], 0, 0, None) + mk = known_mask(ow[:, -1:] / PX_PER_LATENT, LH, LW).to(torch.float32).unsqueeze(1) + with pytest.raises(AssertionError, match="必填"): + with torch.no_grad(): + m(d["x"][:, :, :1], 0.0, d["ctx"][:, :1], frame_index=0, kv_cache=cache, commit=False, + offset_win=ow, mask_in_k=mk, context_ids=d["ids"][:, :1], first_frame_cond=False) + print("8. required 装了 flow map 却不给 r:并行路径与流式路径都直接炸") + + +# ---------------------------------------------------------------------------- +# 9-10. r 与 t 走同一套时间步规则 +# ---------------------------------------------------------------------------- + +def test_9_first_frame_cond_applies_to_r(d): + """first_frame_cond 把 cell 0 的 **t 和 r 一起** 抹成 0。 + + 只抹 t 的话 TI2V 锚点那一格就落到 (t=0, r≠0) —— 掉出对角线,而那是最不能变的一格。 + """ + m = _train_delta(_model(causal=True).install_flowmap()) + r1 = torch.full((B, F), 250.0, device=DEV, dtype=DT) + r2 = r1.clone() + r2[:, 0] = 900.0 # 只动 cell 0 的 r + _bit_equal(_fwd(m, d, r=r2, first_frame_cond=True), _fwd(m, d, r=r1, first_frame_cond=True), + "first_frame_cond=True 时 cell 0 的 r 被抹成 0") + # 反面:关掉 first_frame_cond,同一处改动必须改变输出(否则上面那条是"因为 r 根本没用") + assert _maxdiff(_fwd(m, d, r=r2, first_frame_cond=False), + _fwd(m, d, r=r1, first_frame_cond=False)) > 0.0 + print("9. ffc first_frame_cond=True ⇒ cell 0 的 r 与 t 一起归零(关掉则输出确实会变)") + + +def test_10_tf_clean_half_on_diagonal(d, monkeypatch): + """TF 的 clean 半流硬接 r := t(= 上游把 clean_timestep 同时当两个参数传,trainer:359)。 + + 直接抓 `_embed_time` 收到的 (t_tok, r_tok):这是结构性断言,不受数值巧合影响。 + """ + m = _model(causal=True).install_flowmap() + seen = {} + orig = AropeDiT._embed_time + + def spy(self, t_tok, r_tok): + seen["t"], seen["r"] = t_tok, r_tok + return orig(self, t_tok, r_tok) + + monkeypatch.setattr(AropeDiT, "_embed_time", spy) + for aug_t in (None, 120.0): + _fwd(m, d, r=250.0, clean_x=d["clean"], aug_t=aug_t) + s_half = F * HW + t_tok, r_tok = seen["t"], seen["r"] + assert t_tok.shape == r_tok.shape == (B, 2 * s_half) + assert torch.equal(r_tok[:, :s_half], t_tok[:, :s_half]), ( + f"aug_t={aug_t}:clean 半流的 r 必须逐位等于它的 t(恒在对角线上)") + exp = 0.0 if aug_t is None else aug_t + assert float(t_tok[:, :s_half].min()) == float(t_tok[:, :s_half].max()) == exp + # noisy 半流用的是传进来的 r(cell 0 被 first_frame_cond 抹成 0) + noisy_r = r_tok[:, s_half:].view(B, F, HW) + assert float(noisy_r[:, 0].abs().max()) == 0.0 + assert float(noisy_r[:, 1:].min()) == float(noisy_r[:, 1:].max()) == 250.0 + print("10. tf clean 半流 r ≡ t(aug_t=None ⇒ 0,aug_t=120 ⇒ 120);noisy 半流用传进来的 r") + + +# ---------------------------------------------------------------------------- +# 11. dtype / device +# ---------------------------------------------------------------------------- + +def test_11_dtype_and_device(d): + """bf16 主权重 + 三种门的 dtype,输出 dtype 与恒等性都不许变。 + + 上游 :326 把门 cast 成第三种 dtype 再参与 `(1−g)·temb + g·delta`,混合精度提升会一路带进 + time_proj —— bf16 下 r == t 的恒等性在 ~1e-3 量级就破了。这里门与 delta 输出统一 cast 到 + **主分支的 dtype**。 + """ + db = _inputs(dtype=torch.bfloat16) + m = _model(causal=True, dtype=torch.bfloat16) + base = _fwd(m, db) + assert base.dtype == torch.bfloat16 + + m2 = _model(causal=True, dtype=torch.bfloat16).install_flowmap() + de = getattr(m2.dit, DELTA_EMBEDDING_NAME) + assert de[0].weight.dtype == torch.bfloat16 and de[0].weight.device.type == DEV.split(":")[0] + assert getattr(m2.dit, DELTA_GATE_NAME).dtype == torch.bfloat16 + for r in (T_MAIN,) + R_PROBES: + o = _fwd(m2, db, r=r) + assert o.dtype == torch.bfloat16, f"输出 dtype 被提升成了 {o.dtype}" + _bit_equal(o, base, f"bf16 r={r}") + + # 门被换成 fp32(上游就是这么干的):输出 dtype 与恒等性都不许变 + m2.dit.delta_gate = getattr(m2.dit, DELTA_GATE_NAME).float() + assert getattr(m2.dit, DELTA_GATE_NAME).dtype == torch.float32 + for r in (T_MAIN, 250.0): + o = _fwd(m2, db, r=r) + assert o.dtype == torch.bfloat16, f"fp32 的门把输出提升成了 {o.dtype}" + _bit_equal(o, base, f"bf16 + fp32 gate r={r}") + + # .to(device) 必须把 delta 分支和门一起搬走(buffer 是 persistent 的,会跟着走)。 + # 参照物要用**同一份权重**的 deepcopy:tiny_dit 的 mask 通道是在 .to(device) 之后才随机化的, + # 另建一个 device=cuda 的模型走的是 CUDA 的 RNG 流,权重根本不是同一份。 + m3_plain = _model(causal=True, dtype=DT, device="cpu") + m3 = copy.deepcopy(m3_plain).install_flowmap() + m3_plain = m3_plain.to(device=DEV).move_rope_table(DEV) + m3 = m3.to(device=DEV).move_rope_table(DEV) + assert getattr(m3.dit, DELTA_GATE_NAME).device.type == DEV.split(":")[0] + assert getattr(m3.dit, DELTA_EMBEDDING_NAME)[0].weight.device.type == DEV.split(":")[0] + _bit_equal(_fwd(m3, d, r=250.0), _fwd(m3_plain, d), "install on cpu → .to(cuda)") + print(f"11. dtype bf16 权重 + bf16/fp32 门:输出恒为 bf16 且逐位恒等;.to({DEV}) 带走 delta 与门") + + +# ---------------------------------------------------------------------------- +# 12. checkpoint 往返:5 个新键怎么出现在文件里 +# ---------------------------------------------------------------------------- + +def test_12_checkpoint_roundtrip(d, tmp_path): + m = _train_delta(_model(causal=True).install_flowmap()) + with torch.no_grad(): # 门也要不是 1.0 才测得出它有没有被存下来 + getattr(m.dit, DELTA_GATE_NAME).fill_(0.5) + out = _fwd(m, d, r=250.0) + + n_plain = len(runlib.strip_dit_prefix(_model().state_dict())[0]) + n_fm = n_plain + len(runlib.FLOWMAP_KEYS) + p = str(tmp_path / "fm.safetensors") + runlib.save_dit(None, m, p, {"stage": "stage2_flowmap", "flowmap": 1, "flowmap_form": "residual", + "deltatime_type": "r", "delta_gate": 0.5}, + expect_keys=n_fm, dtype=torch.float32) + hdr, meta = runlib.read_ckpt_header(p) + assert len(hdr) == n_fm and n_fm == n_plain + 5 + for k in runlib.FLOWMAP_KEYS: # 平铺、无 `dit.` 前缀 —— 与 mask 键同一套规矩 + assert k in hdr, f"{k} 没进 ckpt(挂在 AropeDiT 包装上会被 strip_dit_prefix 静默丢掉)" + assert runlib.is_flowmap_ckpt(p) is True + assert meta["flowmap"] == "1" and meta["flowmap_form"] == "residual" + runlib.check_ckpt_format(p, expect_keys=n_fm, dtype="F32", require_mask=True) + print(f"12. ckpt {n_plain} → {n_fm} 键(+{len(runlib.FLOWMAP_KEYS)}):{list(runlib.FLOWMAP_KEYS)}") + + # (a) 832 → 装了 flow map 的模型:strict,一个例外都不要 + m2 = _model(causal=True).install_flowmap() + info = runlib.load_dit_ckpt(m2, p) + assert info["missing"] == [] and info["unexpected"] == [] + assert float(getattr(m2.dit, DELTA_GATE_NAME)) == 0.5, "门没跟着权重一起回来" + _bit_equal(_fwd(m2, d, r=250.0), out, "往返之后的输出") + + # (b) 832 → 没装 flow map 的模型:必须炸(多 5 个键)。这正是 infer.py / check_ckpt.py 的行为, + # 而且是对的:拿旧的 renoise 采样器、不给 r 去采一个 flow map 会安静地产出另一个模型的结果 + with pytest.raises(RuntimeError, match="键集不符"): + runlib.load_dit_ckpt(_model(causal=True), p) + + # (c) 827(stage1b 教师)→ 装了 flow map 的模型:默认炸,只有显式 allow_missing 才放行 + p827 = str(tmp_path / "teacher.safetensors") + teacher = _model(causal=True, seed=999) + runlib.save_dit(None, teacher, p827, {"stage": "stage1b"}, expect_keys=n_plain, dtype=torch.float32) + assert runlib.is_flowmap_ckpt(p827) is False + m3 = _model(causal=True).install_flowmap() + with pytest.raises(RuntimeError, match="键集不符"): + runlib.load_dit_ckpt(m3, p827) + info = runlib.load_dit_ckpt(m3, p827, allow_missing=runlib.FLOWMAP_KEYS) + assert sorted(info["missing"]) == sorted(f"dit.{k}" for k in runlib.FLOWMAP_KEYS) + # 这就是"先 install 再装 827"那条被文档警告的顺序:delta 第一层留在了 **旧** 的 time_embedding 上 + assert not torch.equal(getattr(m3.dit, DELTA_EMBEDDING_NAME)[0].weight, m3.dit.time_embedding[0].weight) + # 输出仍然逐位恒等(读出层是 0),所以这个错误 **只能** 靠键的检查抓 —— 数值闸门看不见它 + _bit_equal(_fwd(m3, d, r=250.0), _fwd(teacher, d), "install→load(827) 仍然恒等(但隐表示是错的)") + print("12b. order 832 strict 往返 OK;827 默认拒收、allow_missing 放行且输出仍恒等 —— " + "所以初始化顺序只能靠键检查抓,数值闸门看不见") + + +# ---------------------------------------------------------------------------- +# 13. convex(上游形式):只在对角线上恒等 +# ---------------------------------------------------------------------------- + +def test_13_convex_only_diagonal(d): + """`--flowmap_form convex` 是上游保真度消融,**不是** 从教师起步的那条路。 + + gate=0.25 ⇒ 0.75·E(t) + 0.25·E_d(r),对角线上数值相同但 off-diagonal 相差 1e-01 量级。 + 谁把 --flowmap_form 翻过去还指望恒等,这条测试会告诉他差多少。 + + gate 落在 (0,1) 之外的两个端点由 install_flowmap 直接拒收(见 test_1b_guards 与下面这一段): + g=1 会让 t = D(r),模型对 t 零依赖;g=0 会让 r 分支整个乘没。两种都能骗过只查 r==t 对角线的 + 同一性闸,所以必须在 install 那一刻就炸,而不是留到训练完才发现。 + """ + m0 = _model(causal=True) + base = _fwd(m0, d) + scale = float(base.abs().max()) + + # convex + 端点 gate 必须在 install 时就拒收(residual 的默认 gate=1.0 直接翻 form 是最常见的误用) + for bad in (1.0, 0.0): + with pytest.raises(AssertionError, match="delta_gate"): + _model(causal=True).install_flowmap(form="convex", gate=bad) + + m2 = _model(causal=True).install_flowmap(form="convex", gate=0.25) + diag = _maxdiff(_fwd(m2, d, r=T_MAIN), base) + offs = {r: _maxdiff(_fwd(m2, d, r=r), base) for r in R_PROBES} + assert diag <= 1e-5 * scale, f"convex 在 r==t 上应当(近似)恒等,实测 {diag:.3e}" + for r, v in offs.items(): + assert v > 1e-2 * scale, f"convex r={r} 只差 {v:.3e} —— 混合分支没接上?" + print(f"13. convex gate=0.25:r==t 差 {diag:.2e},off-diagonal 差 " + f"{[f'{v:.2e}' for v in offs.values()]}(|out| ≈ {scale:.2f})—— 只有对角线是恒等的") + + +# ---------------------------------------------------------------------------- +# 14. 装了 flow map 之后,流式与并行仍然是同一个函数 +# ---------------------------------------------------------------------------- + +def test_14_stream_equals_parallel_with_r(): + """float64、delta 分支训练过、逐 cell 的 (t, r) 都不同:forward_frame 逐 cell 展开 + 必须等于整段块因果并行前向。两条路径的融合各写了一次,这里钉死它们没有分叉。""" + dt = torch.float64 + dd = _inputs(dtype=dt) + m = _train_delta(_model(causal=True, dtype=dt).install_flowmap()) + ts = torch.tensor([[0.0, 900.0, 700.0, 400.0, 150.0]], device=DEV, dtype=dt).expand(B, F) + rs = torch.tensor([[0.0, 600.0, 250.0, 400.0, 0.0]], device=DEV, dtype=dt).expand(B, F) + + with torch.no_grad(): + par = m(dd["x"], ts, dd["ctx"], context_ids=dd["ids"], offset_px=dd["off"], + mask_input=dd["mask_in"], first_frame_cond=True, r_timestep=rs) + cache = unwrap(m).init_kv_cache(kv_window=None, sink_size=0, rope_cap=0) + outs = [] + for k in range(F): + ow = window_offsets_for_frame(dd["off"], k, 0, None) + mk = known_mask(ow[:, -1:] / PX_PER_LATENT, LH, LW).to(torch.float32).unsqueeze(1) + with torch.no_grad(): + outs.append(m(dd["x"][:, :, k:k + 1], ts[:, k], dd["ctx"][:, k:k + 1], + r_timestep=rs[:, k], frame_index=k, kv_cache=cache, commit=True, + offset_win=ow, mask_in_k=mk, context_ids=dd["ids"][:, k:k + 1], + first_frame_cond=False)) + strm = torch.cat(outs, dim=2) + per = [_maxdiff(par[:, :, k], strm[:, :, k]) for k in range(F)] + for k, v in enumerate(per): + assert v < 1e-12, f"cell {k}: 流式与并行差 {v:.3e} —— 两处融合分叉了" + # 非平凡性:r ≠ t 的那几个 cell 必须真的和 r == t 的跑法不一样 + with torch.no_grad(): + par_diag = m(dd["x"], ts, dd["ctx"], context_ids=dd["ids"], offset_px=dd["off"], + mask_input=dd["mask_in"], first_frame_cond=True, r_timestep=ts) + assert _maxdiff(par, par_diag) > 1e-3 * float(par.abs().max()) + print(f"14. equiv 带 r 的流式 == 并行:per-cell max|Δ| {[f'{v:.2e}' for v in per]}(float64)") + + +# ---------------------------------------------------------------------------- +# 15. 真权重(S-FM10):整条移植里最吃重的一道闸,默认跳过 +# ---------------------------------------------------------------------------- + +STAGE1B_CKPT = os.path.join(ROOT, "outputs/distill/stage1b_adapt/dits/dit_step3000.safetensors") + + +@pytest.mark.skipif(os.environ.get("AROPE_FLOWMAP_REAL") != "1", + reason="真权重 10 GB,用 AROPE_FLOWMAP_REAL=1 打开") +def test_15_real_weights_identity(): + """stage1b 的真教师权重(5B / bf16 / 827 键)装上 flow map 之后,max|Δ| 必须是 **恰好 0.0**。 + + 这是 AROPE_BITPARITY_REAL 的 flow-map 版:动过 arope_dit.py 就要重跑。tiny 模型证的是结构, + 这里证的是"真的这一份、我们赔不起的那份权重"没有被动过。 + + AROPE_FLOWMAP_REAL=1 CUDA_VISIBLE_DEVICES=0 ... -m pytest ... -k real -q -s + AROPE_FLOWMAP_CKPT=<别的 ckpt> 换一份权重 + """ + from distill.arope_dit import MODEL_DIR, load_dit + + ckpt = os.environ.get("AROPE_FLOWMAP_CKPT", STAGE1B_CKPT) + dit = load_dit(MODEL_DIR, device=DEV).eval().requires_grad_(False) + m = AropeDiT(dit=dit, mask_channel=True, causal=True) + info = runlib.load_dit_ckpt(m, ckpt) # strict 827:新 run 的顺序是 **先装载再 install** + assert info["missing"] == [] and info["unexpected"] == [] + unwrap(m).move_rope_table(DEV) + + g = torch.Generator(device="cpu").manual_seed(7) + f = 21 + x = torch.randn(1, 48, f, 30, 52, generator=g).to(device=DEV, dtype=torch.bfloat16) + ctx = torch.randn(1, f, 512, 4096, generator=g).to(device=DEV, dtype=torch.bfloat16) + ids = torch.zeros(1, f, dtype=torch.int64, device=DEV) + off = torch.zeros(1, f, 2) + off[:, 1:] = (torch.tensor(PER_CELL_PX).view(1, 1, 2) + + torch.randn(1, f - 1, 2, generator=g) * 4.0).cumsum(1) + off = off.to(DEV) + mask_in = known_mask(off / PX_PER_LATENT, 30, 52).to(torch.float32).unsqueeze(1) + cond = dict(context=ctx, context_ids=ids, offset_px=off, mask_input=mask_in, first_frame_cond=True) + + # ---- 装之前先把两条路径的参照物都取下来 ---- + fs = 8 # TF 掩码是 [2S,2S];f=21 就是 1.07 GB,还可能把 SDPA 逼进 math 后端 + cond_tf = dict(context=ctx[:, :fs], context_ids=ids[:, :fs], offset_px=off[:, :fs], + mask_input=mask_in[:, :, :fs], first_frame_cond=True, + clean_x=torch.randn(1, 48, fs, 30, 52, generator=g).to(device=DEV, dtype=torch.bfloat16)) + with torch.no_grad(): + base = m(x, 500.0, **cond) # 块因果并行,16380 token(真实部署几何) + base_tf = m(x[:, :, :fs], 500.0, aug_t=None, **cond_tf) # TF 双流(stage2 真正训练的形状) + + m.install_flowmap() + assert len(runlib.strip_dit_prefix(m.state_dict())[0]) == runlib.AROPE_DIT_KEYS_FLOWMAP, ( + f"真模型装完应当是 {runlib.AROPE_DIT_KEYS_FLOWMAP} 键") + de = getattr(m.dit, DELTA_EMBEDDING_NAME) + assert torch.equal(de[0].weight, m.dit.time_embedding[0].weight) + assert float(de[2].weight.abs().max()) == 0.0 and float(de[2].bias.abs().max()) == 0.0 + + for r in (500.0,) + R_PROBES: + with torch.no_grad(): + _bit_equal(m(x, 500.0, r_timestep=r, **cond), base, f"real-5B 块因果 r={r}") + _bit_equal(m(x[:, :, :fs], 500.0, r_timestep=r, aug_t=None, **cond_tf), base_tf, + f"real-5B TF r={r}") + print(f"15. real-5B {os.path.basename(ckpt)}:827 → {runlib.AROPE_DIT_KEYS_FLOWMAP} 键;" + f"f=21 块因果(16380 token)+ f={fs} TF 双流,r ∈ {{t, 250, 0, 1000}} 全部 max|Δ| = 0.000e+00") + + +if __name__ == "__main__": + sys.exit(pytest.main([__file__, "-q", "-s"])) diff --git a/backup_2026-09-14/code/distill/tests/test_flowmap_objective.py b/backup_2026-09-14/code/distill/tests/test_flowmap_objective.py new file mode 100644 index 0000000000000000000000000000000000000000..f9c571f840124e0369164d42887182e63f074b7d --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_flowmap_objective.py @@ -0,0 +1,880 @@ +#!/usr/bin/env python3 +"""`distill/flowmap.py` 的门禁:**解析预言机** + 逐件破坏注入实验。 + + CUDA_VISIBLE_DEVICES="" PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest \\ + /data/zhiyangdeng/ActionRoPE/distill/tests/test_flowmap_objective.py -q + # 注入实验(逐条把 flowmap.py 改坏,看哪些测试抓得住): + # … /.venv/bin/python distill/tests/test_flowmap_objective.py --inject-report + # 全程 CPU、无模型、fp64 解析场,不碰 GPU。 + +为什么是**解析**预言机而不是性质测试 +------------------------------------ +flow map 的目标里全是量纲:ε=5 在 0..1000 的 t 单位、latent 扰动要除 1000、(t−r) 又回到 1000 +单位。这几个因子写错任何一个,loss 照常下降、梯度范数照常正常、采样图照常出得来 —— 只是学得 +是另一个流形。性质测试("loss 恒 0"、"形状对")挡不住量纲。所以这里构造一个**闭式可解**的场: + + u(x, t, r) = A ⊙ x + b·(t/1000) + c·(r/1000) + +沿线性路径 x(t) = x0 + (t/1000)·v(v = ε − x0,因为 σ ≡ t/1000): + + F(t) = u(x(t), t, r) = A ⊙ x0 + A ⊙ v·(t/1000) + b·(t/1000) + c·(r/1000) + dF/dt = (A ⊙ v + b) / 1000 ← 闭式,与 x0/ε/σ 都无关 + +于是 target 也有闭式:`target = v − (t−r)·(A⊙v + b)/1000`。任何一个因子写错,这个等式立刻破。 + +再取 A = b = c = 0 的退化情形 `u ≡ ε − x0`(**线性路径的精确 flow map**:瞬时速度恒为 ε−x0, +所以任意 [r,t] 上的平均速度也等于它),修正项恒为 0,flow-map loss 逐位退化成 +stage1 的 rectified-flow 加权 MSE。这就是"平均速度 == 瞬时速度 ⇒ 修正项消失"的那个 case。 +""" +from __future__ import annotations + +import atexit +import importlib.util +import os +import shutil +import subprocess +import sys +import tempfile + +import pytest +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from distill import flow_pf # noqa: E402 + + +# ---------------------------------------------------------------------------- +# 被测模块:正常情况就是 distill.flowmap;注入模式下是一份被改坏的源码副本 +# ---------------------------------------------------------------------------- + +INJECTIONS: dict[str, tuple[str, str, str]] = { + # 名字: (人话描述, 原文, 替换) + "I01_tr_direction": ( + "sample_tr 把 t/r 的下标方向写反(i_t=max ⇒ t1 时修正项大 den 倍)", + " dF = (_hi(u_p) - _hi(u_m)) / (width * float(den)).view(b, 1, 1, 1, 1)", + " dF = (_hi(u_p) - _hi(u_m)) / width.view(b, 1, 1, 1, 1)"), + "I16_loss_includes_cell0": ( + "loss 把 cell 0(干净锚点)也算进去", + " se_l = se[:, :, 1:] if skip_first_cell else se", + " se_l = se"), +} + + +def _load_fm(): + """import 被测模块。`FLOWMAP_INJECT` 指定注入名时,从源码复制一份改坏的再 import。""" + name = os.environ.get("FLOWMAP_INJECT", "") + if not name: + from distill import flowmap + return flowmap + assert name in INJECTIONS, f"未知注入 {name!r}" + desc, old, new = INJECTIONS[name] + src_path = os.path.join(ROOT, "distill", "flowmap.py") + src = open(src_path, encoding="utf-8").read() + assert src.count(old) == 1, f"注入 {name} 的锚点在源码里出现 {src.count(old)} 次(需要恰好 1 次)" + # 临时副本写进 scratchpad(不污染 /tmp、也不落进 distill/),进程退出时自删 + d = os.environ.get("FLOWMAP_INJECT_DIR") or tempfile.mkdtemp(prefix="flowmap_inject_") + os.makedirs(d, exist_ok=True) + tmp = open(os.path.join(d, f"flowmap_{name}.py"), "w", encoding="utf-8") + tmp.write(src.replace(old, new, 1)) + tmp.close() + atexit.register(lambda pth=tmp.name: os.path.exists(pth) and os.remove(pth)) + spec = importlib.util.spec_from_file_location(f"flowmap_injected_{name}", tmp.name) + mod = importlib.util.module_from_spec(spec) + sys.modules[spec.name] = mod + spec.loader.exec_module(mod) + return mod + + +fm = _load_fm() + +B, C, F_CELL, H, W = 2, 6, 5, 4, 5 # tiny 几何;下标算术与真实 [1,48,21,30,52] 一样 +DEV = torch.device("cpu") + + +# ---------------------------------------------------------------------------- +# 解析场:u(x,t,r) = A⊙x + b·t/1000 + c·r/1000 +# ---------------------------------------------------------------------------- + +class LinearField: + """闭式可微的假模型。dF/dt 沿线性路径恒为 (A⊙v + b)/1000。""" + + def __init__(self, A, b, c): + self.A, self.b, self.c = A, b, c + self.calls = 0 + + def __call__(self, x, t, r): + self.calls += 1 + tv = torch.as_tensor(t, dtype=x.dtype, device=x.device).reshape(-1, 1, 1, 1, 1) + rv = torch.as_tensor(r, dtype=x.dtype, device=x.device).reshape(-1, 1, 1, 1, 1) + return self.A * x + self.b * (tv / 1000.0) + self.c * (rv / 1000.0) + + def dF_dt_closed_form(self, v): + """沿 x(t) = x0 + (t/1000)·v 的真导数。""" + return (self.A * v + self.b) / 1000.0 + + +def _fixture(seed=0, dtype=torch.float64): + g = torch.Generator().manual_seed(seed) + sh = (B, C, F_CELL, H, W) + x0 = torch.randn(sh, generator=g, dtype=dtype) + noise = torch.randn(sh, generator=g, dtype=dtype) + A = torch.randn(sh, generator=g, dtype=dtype) * 0.3 + b = torch.randn(sh, generator=g, dtype=dtype) * 0.7 + c = torch.randn(sh, generator=g, dtype=dtype) * 0.5 + return x0, noise, LinearField(A, b, c) + + +def _x_of_t(x0, noise, t): + """线性路径上的 x_t(σ ≡ t/1000)。t: [B] 张量或标量。""" + sig = torch.as_tensor(t, dtype=x0.dtype).reshape(-1, 1, 1, 1, 1) / 1000.0 + return (1.0 - sig) * x0 + sig * noise + + +# ============================================================================ +# A. 网格 / 轴:flow-map 约定 vs flow_pf +# ============================================================================ + +def _upstream_apply_shift(s, shift=5.0): + """`scheduling_flowmap_euler_discrete.py:78-82` 逐字。""" + return shift * s / (1 + (shift - 1) * s) + + +def _upstream_set_timesteps(n): + """`scheduling_flowmap_euler_discrete.py:84-93` 逐字(fp64)。""" + ts = torch.linspace(1.0, 0.0, n + 1, dtype=torch.float64)[:-1] + return _upstream_apply_shift(ts) + + +def test_train_grid_is_upstream_n1000_grid(): + """flow_pf 的 1000 点训练网格 == 上游 set_timesteps(1000) —— 同一个公式,只差 fp32/fp64。""" + ours = flow_pf.sigmas().double() + up = _upstream_set_timesteps(1000) + d = float((ours - up).abs().max()) + assert d < 2e-7, f"训练网格与上游公式不符,max|Δ|={d:.3e}" + print(f"[grid] 1000 点: max|Δ(fp32 ours, fp64 upstream)| = {d:.3e}") + + +@pytest.mark.parametrize("N", [4, 24]) +def test_anystep_axis_matches_upstream(N): + """N 点 any-step 轴(去掉末尾补的 0)== 上游 set_timesteps(N)。""" + ours = fm.anystep_sigmas(N) + assert ours.numel() == N + 1 and float(ours[-1]) == 0.0 + d = float((ours[:N].double() - _upstream_set_timesteps(N)).abs().max()) + assert d < 2e-7, f"N={N} 的 any-step 轴与上游不符,max|Δ|={d:.3e}" + print(f"[axis] N={N}: max|Δ|={d:.3e} σ={[round(float(x), 5) for x in ours]}") + + +def test_anystep_n4_exact_values(): + """N=4 的四个 σ 是设计里写死的验收值。""" + s = fm.anystep_sigmas(4) + assert [round(float(x), 6) for x in s] == [1.0, 0.9375, 0.833333, 0.625, 0.0] + + +def test_anystep_does_not_touch_module_scheduler(): + """临时 scheduler 不许污染 flow_pf 的模块级 1000 点网格(flow_pf 文件头的不变量)。""" + snap = flow_pf.sigmas().clone() + for N in (2, 4, 24, 50): + fm.anystep_sigmas(N) + fm.deploy_flowmap_sigmas() + assert torch.equal(flow_pf.sigmas(), snap) + assert len(flow_pf.timesteps()) == 1000 + + +def test_deploy_axis_gets_terminal_zero(): + s = fm.deploy_flowmap_sigmas() + assert [round(float(x), 5) for x in s] == [1.0, 0.75, 0.5006, 0.2516, 0.0] + + +def test_r_zero_is_off_grid_trap(): + """★ 文件头差异 #4:r=0 在 1000 点网格上不存在,吸附会落到 σ=0.00498。""" + i = int(flow_pf.idx_of_t(0.0)) + assert i == 999 and abs(float(flow_pf.sigma_of_idx(i)) - 0.00498) < 1e-4 + assert fm.sigma_of_t_exact(0.0) == 0.0 + + +def test_sigma_of_t_exact_is_not_bitwise_grid_sigma(): + """σ = t/1000 数学上精确,fp32 下与网格 σ **不逐位相等** —— 文档里说过,这里钉死。""" + t, s = flow_pf.timesteps(), flow_pf.sigmas() + assert not torch.equal(t / 1000.0, s) + assert float((t / 1000.0 - s).abs().max()) < 1e-6 + + +# ============================================================================ +# B. 权重 +# ============================================================================ + +def test_beta08_matches_upstream_formula(): + """上游 `set_train_weight('beta08')`(:53-56)逐行转写,要求相对差 < 1e-6。""" + ts = _upstream_set_timesteps(1000) * 1000.0 # 上游 self.timesteps + t = ts / 1000.0 + y = (t ** 1.0) * ((1 - t) ** 0.5) + up = y * (1000.0 / y.sum()) + ours = fm.beta08_weights().double() + ad = (ours - up).abs() + rel = float((ad / (up.abs() + 1e-12)).max()) + # 已知偏离:上游 fp64 建网格,我们从 flow_pf 的 fp32 网格算。差异集中在 σ→1 端的 + # (1−σ)^0.5(灾难性抵消):下标 1 处相对 1.3e-4,但那格权重只有 0.0517 ⇒ 绝对 6.7e-6。 + # 两个上界都钉住,免得它日后悄悄变大。 + assert float(ad.max()) < 1e-5, f"beta08 与上游绝对差 {float(ad.max()):.3e}" + assert rel < 2e-4, f"beta08 与上游相对差 {rel:.3e}" + assert int(ad.argmax()) == 1, "偏离应当只出现在 σ→1 那一端" + assert abs(float(ours.sum()) - 1000.0) < 1e-3 + print(f"[w] beta08: 峰 {float(ours.max()):.4f} @ σ={float(flow_pf.sigmas()[int(ours.argmax())]):.5f}, " + f"w[0]={float(ours[0]):.4f}, w[1]={float(ours[1]):.4f}, " + f"vs upstream: max_abs={float(ad.max()):.2e} @idx{int(ad.argmax())}, max_rel={rel:.2e}") + + +def test_beta08_peak_and_zero_endpoint(): + w = fm.beta08_weights() + assert abs(float(w.max()) - 1.4076) < 1e-3 + assert abs(float(flow_pf.sigmas()[int(w.argmax())]) - 0.66698) < 1e-4 + assert float(w[0]) == 0.0 # ⚠ σ=1(每条轨迹的起点)权重为 0,继承性质 + assert abs(float(fm.flowmap_weights("beta08", weight_floor=0.05)[0]) - 0.05) < 1e-7 + + +def test_beta08_differs_from_bsmntw(): + """差异 #3:两条曲线峰值与峰位都不同,互换了不会报错。""" + a, b = fm.flowmap_weights("beta08"), fm.flowmap_weights("bsmntw") + assert not torch.allclose(a, b) + assert abs(float(a.max()) - float(b.max())) > 0.5 + assert torch.equal(b, flow_pf.weights()) + + +def test_weight_lookup_matches_argmin(): + """按下标取 == 上游按 t 值 argmin 反查(全 1000 格)。""" + idx = torch.arange(1000) + assert torch.equal(fm.weight_of_idx(idx), fm.weight_of_t(flow_pf.t_of_idx(idx))) + + +# ============================================================================ +# C. 跨 rank 的 50/25/25 划分 +# ============================================================================ + +def test_split_counts_g4(): + assert fm.split_counts(4, 0.5, 0.25) == (2, 1) + assert fm.split_counts(8, 0.5, 0.25) == (4, 2) + with pytest.raises(AssertionError): + fm.split_counts(1, 0.0, 0.5) # n_diffusion==0 必须当场炸 + + +def test_split_exact_proportions_every_micro(): + """rotate 之后每个 micro 的**全局**比例仍然精确是 2/1/1。""" + G, gen = 4, fm.make_split_generator(0) + for _ in range(200): + roles = fm.roles_of_slots(fm.split_slots(G, gen, rotate=True), *fm.split_counts(G)) + cnt = [int((roles == k).sum()) for k in range(3)] + assert cnt == [2, 1, 1], cnt + + +def test_split_rotate_gives_every_rank_every_role(): + """★ 上游偏离:静态分配下 rank0/1 永远 diffusion;rotate 之后每个 rank 三种角色都见得到。""" + G = 4 + gen = fm.make_split_generator(0) + seen = {i: set() for i in range(G)} + for _ in range(100): + roles = fm.roles_of_slots(fm.split_slots(G, gen, rotate=True), *fm.split_counts(G)) + for i in range(G): + seen[i].add(int(roles[i])) + assert all(len(s) == 3 for s in seen.values()), seen + static = fm.roles_of_slots(fm.split_slots(G, rotate=False), *fm.split_counts(G)) + assert static.tolist() == [fm.ROLE_DIFFUSION, fm.ROLE_DIFFUSION, + fm.ROLE_CONSISTENCY, fm.ROLE_RANDOM] + + +def test_split_resume_fastforward_reproduces_stream(): + """resume 的快进必须逐位复现同一条流(--grad_accum 不许改,见 advance_split_generator)。""" + G, K = 4, 37 + g1 = fm.make_split_generator(7) + ref = [fm.split_slots(G, g1, True) for _ in range(K + 5)] + g2 = fm.advance_split_generator(fm.make_split_generator(7), K, G) + for j in range(5): + assert torch.equal(fm.split_slots(G, g2, True), ref[K + j]) + + +def test_split_generator_required_for_rotate(): + """rotate=True 必须显式给一个**各 rank 同种子的 CPU** 生成器;忘了给就当场炸, + 而不是退回某个隐式默认(那会让各 rank 的槽位分配不一致且不报错)。""" + with pytest.raises(AssertionError, match="生成器"): + fm.split_slots(4, None, rotate=True) + + +# ============================================================================ +# D. (t, r) 抽样 +# ============================================================================ + +def test_sample_tr_direction_and_roles(): + """方向(差异 #5)、角色语义、consistency 槽的精确 0.0。模拟 world=4、bsz=1 的 4 个 rank。""" + G = 4 + roles_seen = set() + tgens = [torch.Generator().manual_seed(100 + k) for k in range(G)] # 逐 rank 独立 + sgens = [fm.make_split_generator(0) for _ in range(G)] # 各 rank 同种子 + for _ in range(60): + cnt = [0, 0, 0] + for rank in range(G): + s = fm.sample_tr(1, G, rank, gen=tgens[rank], split_gen=sgens[rank], rotate=True) + assert bool((s.t >= s.r).all()), (s.t.tolist(), s.r.tolist()) # t 永远 >= r + role = int(s.role[0]) + cnt[role] += 1 + roles_seen.add(role) + if role == fm.ROLE_DIFFUSION: + assert torch.equal(s.t, s.r) and bool(s.is_diffusion.all()) # 逐位相等 + assert torch.equal(s.idx_t, s.idx_r) + elif role == fm.ROLE_CONSISTENCY: + assert float(s.r[0]) == 0.0 and int(s.idx_r[0]) == -1 # off-grid,不吸附 + assert not bool(s.is_diffusion.any()) + else: + assert int(s.idx_t[0]) <= int(s.idx_r[0]) # 下标小 = t 大 + # random 槽偶然落在对角线上时,is_diffusion 必须跟着**值**走 + assert bool(s.is_diffusion[0]) == (float(s.t[0]) == float(s.r[0])) + assert cnt == [2, 1, 1], cnt # 每个 micro 的全局比例恒定 + assert roles_seen == {0, 1, 2} + + +def test_is_diffusion_is_derived_from_value_not_role(): + """random 槽抽到 i1==i2 时也算 diffusion(1000 点网格上 p=1/1000;上游连续抽 t 遇不到)。 + + 语义要的是"修正项是否消失":这样的样本 target 就是 ε−x0,理应进 adaptive_balance 的分母、 + 也理应省掉两次探针。""" + hits = 0 + tg = torch.Generator().manual_seed(0) + for k in range(4000): + s = fm.sample_tr(1, 4, 3, gen=tg, split_gen=fm.make_split_generator(0), rotate=False) + assert int(s.role[0]) == fm.ROLE_RANDOM # rotate=0 ⇒ rank3 恒为 random 槽 + if float(s.t[0]) == float(s.r[0]): + hits += 1 + assert bool(s.is_diffusion[0]), "落在对角线的 random 槽必须被算作 diffusion" + else: + assert not bool(s.is_diffusion[0]) + assert hits > 0, "4000 次抽样一次都没撞上对角线?先检查抽样是不是坏了" + print(f"[split] random 槽落在对角线的次数 = {hits}/4000(期望 ≈ 4)") + + +def test_sample_tr_t_on_grid(): + tg = torch.Generator().manual_seed(3) + s = fm.sample_tr(4, 1, 0, gen=tg, split_gen=fm.make_split_generator(0)) + assert torch.equal(s.t, flow_pf.t_of_idx(s.idx_t)) + assert torch.equal(s.sigma_t, flow_pf.sigma_of_idx(s.idx_t)) + assert float(s.t.max()) <= 1000.0 and float(s.t.min()) > 4.9 + + +# ============================================================================ +# E. ★ 解析预言机 ★ +# ============================================================================ + +def test_central_difference_equals_closed_form(): + """中心差分 == (A⊙v + b)/1000,fp64 下应当到机器精度。""" + x0, noise, u = _fixture(0) + t_val = 500.0 + t = torch.full((B,), t_val, dtype=torch.float64) + r = torch.full((B,), 100.0, dtype=torch.float64) + x_t = _x_of_t(x0, noise, t) + dF = fm.central_difference(u, x_t, x0, noise, t, r, epsilon=5.0, den=1.0, + eps_clamp=True, pin_first_cell=False) + ref = u.dF_dt_closed_form(noise - x0) + err = float((dF - ref).abs().max()) + scale = float(ref.abs().max()) + assert err < 1e-15, f"中心差分与闭式不符:max|Δ|={err:.3e}(量级 {scale:.3e})" + print(f"[oracle] 中心差分 vs 闭式 dF/dt: max|Δ|={err:.3e},被测量量级={scale:.3e}") + + +def test_central_difference_scales_with_den(): + """den 只出现在分母里:den=3 的结果恰好是 den=1 的 1/3。""" + x0, noise, u = _fixture(1) + t = torch.full((B,), 400.0, dtype=torch.float64) + r = torch.zeros(B, dtype=torch.float64) + x_t = _x_of_t(x0, noise, t) + a = fm.central_difference(u, x_t, x0, noise, t, r, den=1.0, pin_first_cell=False) + b = fm.central_difference(u, x_t, x0, noise, t, r, den=3.0, pin_first_cell=False) + assert float((a / 3.0 - b).abs().max()) < 1e-15 + + +def test_units_1000_vs_sigma_agree(): + """★ 量纲交叉核对:整条目标在 1000 单位里算 == 整条在 σ 单位里算。""" + x0, noise, u = _fixture(2) + t_val, r_val, eps = 620.0, 130.0, 5.0 + v = noise - x0 + x_t = _x_of_t(x0, noise, torch.full((B,), t_val, dtype=torch.float64)) + + # (a) 1000 单位(本模块) + t = torch.full((B,), t_val, dtype=torch.float64) + r = torch.full((B,), r_val, dtype=torch.float64) + dF_t = fm.central_difference(u, x_t, x0, noise, t, r, epsilon=eps, den=1.0, pin_first_cell=False) + tgt_a = fm.flowmap_target(x0, noise, t, r, dF_t) + + # (b) 全程 σ 单位,手写 + eps_s = eps / 1000.0 + s_t, s_r = t_val / 1000.0, r_val / 1000.0 + x_p, x_m = x_t + v * eps_s, x_t - v * eps_s + u_p = u(x_p, torch.full((B,), (s_t + eps_s) * 1000.0, dtype=torch.float64), r) + u_m = u(x_m, torch.full((B,), (s_t - eps_s) * 1000.0, dtype=torch.float64), r) + dF_s = (u_p - u_m) / (2 * eps_s) + tgt_b = v - (s_t - s_r) * dF_s + + d = float((tgt_a - tgt_b).abs().max()) + assert d < 1e-12, f"1000 单位与 σ 单位的目标不一致:max|Δ|={d:.3e}" + print(f"[oracle] target(1000 单位) vs target(σ 单位): max|Δ|={d:.3e}") + + +def test_target_matches_closed_form(): + """target == v − (t−r)·(A⊙v + b)/1000,闭式。""" + x0, noise, u = _fixture(3) + t = torch.full((B,), 777.0, dtype=torch.float64) + r = torch.full((B,), 111.0, dtype=torch.float64) + x_t = _x_of_t(x0, noise, t) + dF = fm.central_difference(u, x_t, x0, noise, t, r, den=1.0, pin_first_cell=False) + tgt = fm.flowmap_target(x0, noise, t, r, dF) + v = noise - x0 + ref = v - (777.0 - 111.0) * u.dF_dt_closed_form(v) + d = float((tgt - ref).abs().max()) + assert d < 1e-12, f"target 与闭式不符:max|Δ|={d:.3e}" + print(f"[oracle] target vs 闭式: max|Δ|={d:.3e}") + + +def test_exact_flow_map_of_linear_path_has_zero_correction(): + """★★ 头号预言机:`u ≡ ε − x0` 是线性路径的**精确** flow map(瞬时速度恒定 ⇒ [r,t] 上的 + 平均速度等于它),所以修正项恒为 0,target 逐位退化成 ε − x0,loss 逐位退化成 + rectified-flow 的加权 MSE。""" + x0, noise, _ = _fixture(4) + v = noise - x0 + + class ExactFlowMap: + calls = 0 + + def __call__(self, x, t, r): + ExactFlowMap.calls += 1 + return v.clone() + + u = ExactFlowMap() + t = torch.full((B,), 830.0, dtype=torch.float64) + r = torch.full((B,), 42.0, dtype=torch.float64) + x_t = _x_of_t(x0, noise, t) + dF = fm.central_difference(u, x_t, x0, noise, t, r, den=1.0) + assert float(dF.abs().max()) == 0.0, "常场的中心差分必须逐位为 0" + tgt = fm.flowmap_target(x0, noise, t, r, dF) + assert torch.equal(tgt, flow_pf.training_target(x0, noise)), "修正项应当恒等消失" + # 预测就用同一个精确 flow map ⇒ loss 恒 0 + loss_b, st = fm.flowmap_loss(u(x_t, t, r), tgt, idx_t=flow_pf.idx_of_t(t)) + assert float(loss_b.abs().max()) == 0.0 and float(st["mse"]) == 0.0 + print(f"[oracle] 精确 flow map: dF/dt≡0,target 逐位 == ε−x0,loss == 0(探针跑了 {u.calls} 次)") + + +def test_r_equals_t_reduces_to_rectified_flow_bitwise(): + """★★ r == t 极限:目标与 loss **逐位**等于 stage1 的 rectified-flow 加权 MSE,且一次探针都不跑。""" + x0, noise, u = _fixture(5) + idx = torch.tensor([137, 642]) + t = flow_pf.t_of_idx(idx).double() + r = t.clone() + x_t = _x_of_t(x0, noise, t) + + assert fm.probes_needed(t, r) is False + before = u.calls + dF = fm.central_difference(u, x_t, x0, noise, t, r) + assert u.calls == before, "r==t 时不许跑探针" + assert float(torch.as_tensor(dF).abs().max()) == 0.0 + + tgt = fm.flowmap_target(x0, noise, t, r, dF) + assert torch.equal(tgt, flow_pf.training_target(x0, noise)) + + pred = u(x_t, t, r) # 任意非平凡预测 + loss_b, _ = fm.flowmap_loss(pred, tgt, idx_t=idx) + + # 独立手写的 rectified-flow 加权 MSE(stage1 的口径,cell 0 不计) + se = (pred.double() - (noise - x0).double()) ** 2 + per = se[:, :, 1:].mean(dim=(1, 2, 3, 4)) + ref = per * fm.beta08_weights().double()[idx] + assert torch.equal(loss_b, ref.to(loss_b.dtype)), \ + f"r==t 的 loss 与 rectified flow 不逐位相等:{loss_b.tolist()} vs {ref.tolist()}" + print(f"[oracle] r==t: target 与 loss 逐位 == rectified flow(loss={[f'{x:.6f}' for x in loss_b.tolist()]})") + + +def test_nan_probe_cannot_leak_at_r_equals_t(): + """0×NaN=NaN,所以 t==r 的样本必须**显式清零** dF/dt,不能只靠 (t−r)==0。""" + x0, noise, _ = _fixture(6) + + def nan_u(x, t, r): + return torch.full_like(x, float("nan")) + + t = torch.tensor([500.0, 500.0], dtype=torch.float64) + r = torch.tensor([500.0, 100.0], dtype=torch.float64) # 样本 0 在对角线上 + x_t = _x_of_t(x0, noise, t) + dF = fm.central_difference(nan_u, x_t, x0, noise, t, r) + assert torch.isfinite(dF[0]).all(), "对角线样本的 dF/dt 必须被清成 0" + tgt = fm.flowmap_target(x0, noise, t, r, dF) + assert torch.isfinite(tgt[0]).all() and torch.isnan(tgt[1]).any() + + +def test_probes_pin_first_cell(): + """cell 0 是 TI2V 干净锚点:探针输入不许扰动它,所以 cell 0 的 dF/dt 只剩时间项 b/1000。""" + x0, noise, u = _fixture(7) + t = torch.full((B,), 500.0, dtype=torch.float64) + r = torch.zeros(B, dtype=torch.float64) + x_t = _x_of_t(x0, noise, t) + dF = fm.central_difference(u, x_t, x0, noise, t, r, den=1.0, pin_first_cell=True) + ref = u.dF_dt_closed_form(noise - x0) + assert float((dF[:, :, 0] - (u.b[:, :, 0] / 1000.0)).abs().max()) < 1e-15, "cell 0 应当只剩时间项" + assert float((dF[:, :, 1:] - ref[:, :, 1:]).abs().max()) < 1e-15 + assert float((dF[:, :, 0] - ref[:, :, 0]).abs().max()) > 1e-6, "pin 生效时 cell 0 必须与未 pin 的不同" + + +def test_eps_clamp_only_at_boundary(): + """t=1000(σ=1,每条轨迹的起点)时才夹;不触边时步长恰好是字面量 2ε。""" + x0, noise, u = _fixture(8) + r = torch.zeros(B, dtype=torch.float64) + + rec = [] + + def spy(x, t, r_): + rec.append(float(t.reshape(-1)[0])) + return u(x, t, r_) + + fm.central_difference(spy, _x_of_t(x0, noise, torch.full((B,), 500.0, dtype=torch.float64)), + x0, noise, torch.full((B,), 500.0, dtype=torch.float64), r, eps_clamp=True) + assert rec == [505.0, 495.0] + rec.clear() + t1000 = torch.full((B,), 1000.0, dtype=torch.float64) + fm.central_difference(spy, _x_of_t(x0, noise, t1000), x0, noise, t1000, r, eps_clamp=True) + assert rec == [1000.0, 995.0], rec # 夹住上界,步长变成 5 + rec.clear() + fm.central_difference(spy, _x_of_t(x0, noise, t1000), x0, noise, t1000, r, eps_clamp=False) + assert rec == [1005.0, 995.0], rec # 上游:不夹,σ>1 + + +def test_eps_clamp_width_is_literal_two_eps(): + """不触边时分母用字面量 2ε 而不是 (t+ε)−(t−ε):fp32 下后者有 5/1000 个格不精确等于 10。""" + t = flow_pf.timesteps() + w = (t + 5.0) - (t - 5.0) + n_bad = int((w != 10.0).sum()) + assert n_bad > 0, "前提变了:如果哪天全都精确,这个测试可以删" + print(f"[fp32] (t+5)−(t−5) != 10.0 的格数 = {n_bad}/1000,max|Δ| = {float((w - 10.0).abs().max()):.3e}") + x0, noise, u = _fixture(9) + idx = torch.tensor([int((w != 10.0).nonzero()[0]), 500]) + tt = flow_pf.t_of_idx(idx).double() + r = torch.zeros(2, dtype=torch.float64) + a = fm.central_difference(u, _x_of_t(x0, noise, tt), x0, noise, tt, r, eps_clamp=True, pin_first_cell=False) + ref = u.dF_dt_closed_form(noise - x0) + assert float((a - ref).abs().max()) < 1e-13 + + +# ============================================================================ +# F. guidance 融合 +# ============================================================================ + +@pytest.mark.parametrize("dtype", [torch.float32, torch.float64]) +def test_fuse_bit_identical_to_upstream(dtype): + """★ 多轴融合在 text-only、g_text=w−1 时,与上游 `(F_c − (1−w)F_u)/w` 是**同一个 IEEE 值**。""" + g = torch.Generator().manual_seed(0) + Fc = torch.randn(4, 3, 5, 6, 7, generator=g, dtype=dtype) + Fu = torch.randn(4, 3, 5, 6, 7, generator=g, dtype=dtype) + w = fm.FUSE_GUIDANCE_SCALE + up = (Fc - (1 - w) * Fu) / w # trainer:374 逐字 + ours, den = fm.fuse_predictions(Fc, {"text": Fu}, {"text": w - 1.0}) + assert den == w + assert torch.equal(ours, up), f"{dtype}: 融合与上游不逐位相等" + + +def test_fuse_multi_axis_and_active_gains(): + g = torch.Generator().manual_seed(1) + sh = (2, 3, 4, 5, 6) + Ff = torch.randn(sh, generator=g) + nulls = {k: torch.randn(sh, generator=g) for k in fm.NULL_AXES} + gains = {"text": 2.0, "anchor": 0.5} + pred, den = fm.fuse_predictions(Ff, nulls, gains) + assert abs(den - 3.5) < 1e-9 + ref = (Ff + 2.0 * nulls["text"] + 0.5 * nulls["anchor"]) / 3.5 + assert torch.equal(pred, ref) + # 主前向里已经 drop 掉的轴,g 归零(上游 bug 的修正) + act = fm.active_gains({"text": 2.0, "anchor": 0.5}, dropped={"text"}) + assert act == {"anchor": 0.5} and abs(fm.fuse_denominator(act) - 1.5) < 1e-9 + assert fm.active_gains({"text": 0.0}) == {} + + +def test_fuse_clip_circuit_breaker(): + g = torch.Generator().manual_seed(2) + Ff = torch.randn(2, 3, 4, 5, 6, generator=g) + Fu = torch.randn(2, 3, 4, 5, 6, generator=g) * 50.0 # 极端 null + a, _ = fm.fuse_predictions(Ff, {"text": Fu}, {"text": 2.0}, clip_k=0.0) + b, _ = fm.fuse_predictions(Ff, {"text": Fu}, {"text": 2.0}, clip_k=0.5) + assert float((a - Ff).abs().max()) > float((b - Ff).abs().max()) + assert float((b - Ff).abs().max()) <= 0.5 * float(Ff.std()) + 1e-5 + + +def test_null_axis_restores_bare_attributes(): + class Bare: + train_local_attn_size, train_sink_size, train_drop_anchor = 21, 1, False + + bare, cond = Bare(), {"offset_px": torch.randn(2, 5, 2), "mask_input": torch.ones(2, 1, 5, 4, 5)} + for axis, expect in (("ctx", (1, 0, False)), ("hist", (1, 1, False)), ("anchor", (21, 1, True))): + with fm.null_axis(axis, cond, bare=bare): + assert (bare.train_local_attn_size, bare.train_sink_size, bare.train_drop_anchor) == expect + assert (bare.train_local_attn_size, bare.train_sink_size, bare.train_drop_anchor) == (21, 1, False) + # 异常路径也要还原 + with pytest.raises(RuntimeError): + with fm.null_axis("ctx", cond, bare=bare): + raise RuntimeError("boom") + assert (bare.train_local_attn_size, bare.train_sink_size) == (21, 1) + + +def test_null_axis_action_zeroes_offset(): + cond = {"offset_px": torch.randn(2, 5, 2), "mask_input": torch.zeros(2, 1, 5, 4, 5)} + with fm.null_axis("action", cond, mask_input_fn=lambda off: torch.ones(2, 1, 5, 4, 5)) as c: + assert float(c["offset_px"].abs().max()) == 0.0 + assert float(c["mask_input"].min()) == 1.0 + assert float(cond["offset_px"].abs().max()) > 0.0 # 原 cond 不被改 + + +# ============================================================================ +# G. 自适应配平 +# ============================================================================ + +def test_adaptive_balance_equalises_to_diffusion_mean(): + """★ 上游的代数性质:重整之后每个非 diffusion 样本的 loss **值**等于全局 diffusion 均值。""" + loss = torch.tensor([0.4, 0.6, 9.0, 0.001], dtype=torch.float64) + is_d = torch.tensor([True, True, False, False]) + out, info = fm.adaptive_balance(loss, is_d, eps=1e-5) + gm = float(loss[is_d].mean()) + assert torch.equal(out[is_d], loss[is_d]), "diffusion 样本必须逐位不变" + # 精确代数:out_i = gm · L_i/(L_i+eps),即"等于全局 diffusion 均值"差一个 eps/(L+eps)。 + # L=9.0 时相对偏差 1.1e-6,L=0.001 时 1.0e-2 —— eps 在小 loss 上是有意的下限保护。 + for i in (2, 3): + L = float(loss[i]) + assert abs(float(out[i]) - gm * L / (L + 1e-5)) < 1e-12, (float(out[i]), gm, L) + assert abs(float(out[2]) - gm) < 1e-4 * gm # 正常量级的样本就是 gm + assert abs(float(info["gm_mean"]) - gm) < 1e-12 + + +def test_adaptive_balance_gradient_is_rescaled_not_reversed(): + loss = torch.tensor([1.0, 4.0], dtype=torch.float64, requires_grad=True) + is_d = torch.tensor([True, False]) + out, _ = fm.adaptive_balance(loss, is_d) + out.sum().backward() + assert float(loss.grad[0]) == 1.0 + assert float(loss.grad[1]) > 0.0 and abs(float(loss.grad[1]) - 0.25) < 1e-3 # scale = 1/4 + + +def test_adaptive_balance_raises_on_empty_diffusion(): + with pytest.raises(RuntimeError, match="diffusion"): + fm.adaptive_balance(torch.tensor([1.0, 2.0]), torch.tensor([False, False])) + + +def test_adaptive_balance_uses_gather(): + """gather_fn 模拟 4 rank:分母是**全局** diffusion 均值,不是本 rank 的。""" + glob = torch.tensor([1.0, 3.0, 7.0, 0.5], dtype=torch.float64) # 4 个 rank 的 loss + gmask = torch.tensor([1.0, 1.0, 0.0, 0.0], dtype=torch.float64) # 前两个是 diffusion + + def gather(x): + # loss 是 fp64、mask 被 adaptive_balance 转成同 dtype 后传进来;按值区分即可 + return glob if float(x.reshape(-1)[0]) == 7.0 else gmask + + loss = torch.tensor([7.0], dtype=torch.float64) # 本 rank(rank 2,非 diffusion) + out, info = fm.adaptive_balance(loss, torch.tensor([False]), gather_fn=gather) + assert info["n_diffusion_global"] == 2 and info["n_global"] == 4 + assert abs(float(out[0]) - 2.0) < 1e-3 # 全局 diffusion 均值 = (1+3)/2 = 2.0 + assert abs(float(info["gm_mean"]) - 2.0) < 1e-12 + + +# ============================================================================ +# H. 采样器(解析) +# ============================================================================ + +@pytest.mark.parametrize("N", [1, 4, 24]) +def test_euler_chain_lands_on_x0(N): + """u ≡ ε − x0 是线性路径的精确 flow map ⇒ 任意步数的 Euler 链都精确落在 x0。""" + x0, noise, _ = _fixture(10) + v = noise - x0 + sig = fm.anystep_sigmas(N).double() + x = _x_of_t(x0, noise, torch.full((B,), float(sig[0]) * 1000.0, dtype=torch.float64)) + out = fm.euler_chain(lambda xx, t, r: v.clone(), x, sig) + d = float((out - x0).abs().max()) + assert d < 1e-13, f"N={N} 的 Euler 链没落在 x0:max|Δ|={d:.3e}" + print(f"[sampler] N={N}: max|x_end − x0| = {d:.3e}") + + +def test_euler_chain_deploy_table(): + x0, noise, _ = _fixture(11) + v = noise - x0 + sig = fm.deploy_flowmap_sigmas().double() + x = _x_of_t(x0, noise, torch.full((B,), 1000.0, dtype=torch.float64)) + out = fm.euler_chain(lambda xx, t, r: v.clone(), x, sig) + assert float((out - x0).abs().max()) < 1e-13 + + +def test_euler_step_direction_guard(): + x = torch.zeros(2, 3, 4, 5, 6) + with pytest.raises(AssertionError): + fm.euler_step(x, x, 0.25, 0.75) # 反着走必须炸 + + +def test_euler_chain_pins_first_cell(): + x0, noise, _ = _fixture(12) + v = noise - x0 + z0 = x0[:, :, 0:1].clone() + out = fm.euler_chain(lambda xx, t, r: v.clone(), + _x_of_t(x0, noise, torch.full((B,), 1000.0, dtype=torch.float64)), + fm.anystep_sigmas(4).double(), + pin_fn=lambda xx: fm.keep_frame0(xx, x0)) + assert torch.equal(out[:, :, 0:1], z0) + + +# ============================================================================ +# I. 加噪 / API 边界 +# ============================================================================ + +def test_add_noise_scalar_pins_cell0_and_broadcasts(): + x0 = torch.randn(B, C, F_CELL, H, W, dtype=torch.float32) + noise = torch.randn_like(x0) + idx = torch.tensor([100, 900]) + x_t = fm.add_noise_scalar(x0, noise, idx) + assert torch.equal(x_t[:, :, 0], x0[:, :, 0]) + s = flow_pf.sigma_of_idx(idx).view(B, 1, 1, 1, 1) + ref = (1 - s) * x0 + s * noise + assert torch.allclose(x_t[:, :, 1:], ref[:, :, 1:], atol=1e-6) + + +def test_t_range_guard_catches_unit_mistakes(): + x0, noise, u = _fixture(13) + t = torch.full((B,), 0.5, dtype=torch.float64) # 有人喂了 σ + with pytest.raises(AssertionError, match="0..1000"): + fm.flowmap_target(x0, noise, torch.full((B,), 1500.0, dtype=torch.float64), t * 0) + with pytest.raises(AssertionError): + fm.central_difference(u, _x_of_t(x0, noise, t), x0, noise, + torch.full((B,), -1.0, dtype=torch.float64), t * 0) + + +def test_loss_excludes_cell0(): + g = torch.Generator().manual_seed(4) + pred = torch.zeros(B, C, F_CELL, H, W, dtype=torch.float64) + tgt = torch.zeros_like(pred) + tgt[:, :, 0] = 1e6 # 只有 cell 0 有巨大误差 + loss_b, st = fm.flowmap_loss(pred, tgt, idx_t=torch.tensor([100, 100])) + assert float(loss_b.abs().max()) == 0.0 and float(st["mse"]) == 0.0 + del g + + +# ============================================================================ +# 注入实验的驱动(不是测试;`python 本文件 --inject-report` 跑) +# ============================================================================ + +def _run_injections() -> int: + here = os.path.abspath(__file__) + py = sys.executable + env0 = dict(os.environ, PYTHONPATH=ROOT, DIFFSYNTH_SKIP_DOWNLOAD="True", CUDA_VISIBLE_DEVICES="") + print("=" * 100) + print("注入实验:逐条把 flowmap.py 改坏,看整套门禁抓不抓得住") + print("=" * 100) + bad = [] + inject_dir = tempfile.mkdtemp(prefix="flowmap_inject_") + for name, (desc, _, _) in INJECTIONS.items(): + env = dict(env0, FLOWMAP_INJECT=name, FLOWMAP_INJECT_DIR=inject_dir) + p = subprocess.run([py, "-m", "pytest", here, "-q", "--no-header", "-p", "no:cacheprovider"], + env=env, capture_output=True, text=True) + out = p.stdout + p.stderr + failed = [ln.split("::")[-1].split()[0] for ln in out.splitlines() + if ln.startswith("FAILED") or ln.startswith("ERROR")] + caught = p.returncode != 0 + tag = "CAUGHT " if caught else "MISSED!" + print(f"[{tag}] {name:26s} {desc}") + if caught: + uniq = sorted(set(failed)) + print(f" → 失败 {len(failed)} 项,例如: {', '.join(uniq[:4])}" + + (f" (+{len(uniq) - 4} 项)" if len(uniq) > 4 else "")) + else: + bad.append(name) + print(f" → 全绿,门禁没抓住!\n{out[-1500:]}") + print("-" * 100) + print(f"{len(INJECTIONS) - len(bad)}/{len(INJECTIONS)} 个注入被抓住" + + ("" if not bad else f";漏网: {bad}")) + shutil.rmtree(inject_dir, ignore_errors=True) + return 1 if bad else 0 + + +if __name__ == "__main__": + if "--inject-report" in sys.argv: + sys.exit(_run_injections()) + sys.exit(pytest.main([os.path.abspath(__file__), "-q"])) diff --git a/backup_2026-09-14/code/distill/tests/test_flowmap_upstream_diff.py b/backup_2026-09-14/code/distill/tests/test_flowmap_upstream_diff.py new file mode 100644 index 0000000000000000000000000000000000000000..e72b1a6289d6b6cf0a814d90a8360267a0d6d160 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_flowmap_upstream_diff.py @@ -0,0 +1,634 @@ +#!/usr/bin/env python3 +"""stage2-flowmap 对上游 AnyFlow 的**差分**门禁(设计里的 S-FM4):把 +`vendor/AnyFlow/far/trainers/trainer_far_wan_anyflow_pretrain.py:232-390` 与 +`vendor/AnyFlow/far/schedulers/scheduling_flowmap_euler_discrete.py:44-112` +逐行转写成本文件里的 `_up_*` 函数(只把调用形式换成 ActionRoPE 的 cond),然后要求数值逐位相同。 + + CUDA_VISIBLE_DEVICES="" PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest \\ + /data/zhiyangdeng/ActionRoPE/distill/tests/test_flowmap_upstream_diff.py -q -s + # 全程 CPU、tiny 模型、fp32/fp64,不碰 GPU + +为什么在 test_flowmap_objective.py 之外还要这一份 +------------------------------------------------ +那一份测的是**性质**(闭式 dF/dt、单位自洽、注入实验)。性质测试只挡得住有人想到过的写错法。 +这一份换一个方向:上游原样抄一份,要求 `Δ == 0.0`。同一个理由、同一个惯用法见 +`distill/tests/test_stage23_upstream_diff.py` 的文件头。 + +覆盖的上游段落 +-------------- + scheduler apply_shift / set_timesteps / set_train_weight('beta08') / get_train_weight / step + trainer sample_timestep(含 rank 静态划分)/ compute_central_difference / train_causal + (fuse → dF/dt → target → 逐样本加权 MSE → 自适应配平) + +**已知且有意**的偏离(在下面各自钉了上界,不是逐位相等) + 1. 训练轴离散化:上游连续抽 t ~ U(0,1) 再 apply_shift;本移植在 flow_pf 的 1000 点网格上抽下标 + (同一个 apply_shift(linspace(1,0,1001)[:-1]) 公式,fp32 vs fp64,max|Δt| = 1.4e-4)。 + ⇒ 本文件的差分统一**用上游抽出来的 (t, r) 驱动两边**,把这一处隔离掉。 + 2. beta08 权重表:上游在 fp64 网格上建,本移植从 flow_pf 的 fp32 网格建(单一真相源)。 + max_abs = 6.7e-6 @ idx 1(σ=0.9998,(1−σ)^0.5 的灾难性抵消),max_rel = 1.3e-4。 + 3. eps_clamp / split_rotate / t==r 跳探针 / cell 0 钉净不计 loss:本移植的偏离, + 关掉开关(eps_clamp=False, rotate=False, pin_first_cell=False, skip_first_cell=False) + 之后必须逐位回到上游。 + 4. 上游 t 全程 bf16(main.py:341 mixed_precision ⇒ dtype=bfloat16),本移植的 t 是 fp32、 + 进模型时才被 `_per_token_timestep_pf` 降成 latent 的 dtype。**两边的 ±ε 探针都因此落在 + bf16 网格上**(实测 ε=5 时实际步长 8~12 而不是 10),这是继承的、不是引入的, + 由 `test_bf16_stencil_width_is_inherited_not_introduced` 把数值钉住。 +""" +from __future__ import annotations + +import os +import sys + +import pytest +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from distill import flow_pf # noqa: E402 +from distill import flowmap as fm # noqa: E402 +from distill.arope_dit import AropeDiT # noqa: E402 +from distill.data import make_mask_input # noqa: E402 + +NT = 1000 +SHIFT = 5.0 +UPSTREAM = os.path.join(ROOT, "vendor/AnyFlow/far/trainers/trainer_far_wan_anyflow_pretrain.py") + + +# ============================================================================ +# 上游转写(逐行;行号指 vendor/AnyFlow 的 bf9195a) +# ============================================================================ + +def _up_apply_shift(s, shift=SHIFT): + """scheduling_flowmap_euler_discrete.py:78-82""" + if shift == 1.0: + return s + return shift * s / (1 + (shift - 1) * s) + + +def _up_set_timesteps(n): + """scheduling_flowmap_euler_discrete.py:84-92(fp64,末尾**不**补 0)""" + ts = torch.linspace(1.0, 0.0, n + 1, dtype=torch.float64)[:-1] + ts = _up_apply_shift(ts) + return ts * NT + + +def _up_beta08(timesteps): + """scheduling_flowmap_euler_discrete.py:52-56""" + t = timesteps / NT + y = (t ** 1.0) * ((1 - t) ** 0.5) + return y * (NT / y.sum()) + + +_UP_TS = _up_set_timesteps(NT) # fp64 [1000] +_UP_W = _up_beta08(_UP_TS) # fp64 [1000] + + +def _up_get_train_weight(timesteps, table=None): + """scheduling_flowmap_euler_discrete.py:58-62(argmin 反查)""" + tbl = _UP_W if table is None else table + tid = torch.argmin((_UP_TS.unsqueeze(1) - timesteps.flatten().unsqueeze(0)).abs(), + dim=0).reshape(timesteps.shape) + return tbl[tid] + + +def _up_scale_noise(sample, timestep, noise): + """scheduling_flowmap_euler_discrete.py:64-76""" + timestep = timestep.to(device=sample.device, dtype=sample.dtype) + timestep = timestep / NT + timestep = timestep.view(*timestep.shape, *([1] * (noise.ndim - timestep.ndim))) + return timestep * noise + (1.0 - timestep) * sample + + +def _up_step(model_output, timestep, sample, r_timestep): + """scheduling_flowmap_euler_discrete.py:95-112""" + timestep = timestep / NT + r_timestep = r_timestep / NT + return sample - (timestep - r_timestep) * model_output + + +def _up_sample_timestep(batch_size, dtype, rank, world, diffusion_ratio, consistency_ratio, gen): + """trainer:232-256""" + t_1 = torch.rand(batch_size, dtype=dtype, generator=gen) + t_2 = torch.rand(batch_size, dtype=dtype, generator=gen) + t = torch.maximum(t_1, t_2) # t is the larger one + r = torch.minimum(t_1, t_2) # r is the smaller one + global_start_idx = rank * batch_size + total_global_bsz = world * batch_size + n_diffusion = round(diffusion_ratio * total_global_bsz) + n_consistency = round(consistency_ratio * total_global_bsz) + is_diffusion = torch.zeros(batch_size, dtype=torch.bool) + for batch_idx in range(batch_size): + if global_start_idx + batch_idx < n_diffusion: + r[batch_idx] = t[batch_idx] + is_diffusion[batch_idx] = True + elif global_start_idx + batch_idx < n_diffusion + n_consistency: + r[batch_idx] = 0 + return t, r, is_diffusion + + +def _up_compute_central_difference(u_func, noisy_latents, latents, noise, t, r, epsilon, guidance): + """trainer:259-277(@torch.no_grad)""" + v_pred = noise - latents + t_plus = t + epsilon + noisy_latents_plus = noisy_latents + v_pred * (epsilon / NT) + noise_pred_plus = u_func(noisy_latents_plus, t_plus, r) + t_minus = t - epsilon + noisy_latents_minus = noisy_latents - v_pred * (epsilon / NT) + noise_pred_minus = u_func(noisy_latents_minus, t_minus, r) + return (noise_pred_plus - noise_pred_minus) / (2 * epsilon * guidance) + + +def _up_train_causal(model_cond, model_uncond, latents, noise, t_norm, r_norm, is_diffusion, + guidance, epsilon, weight_table=None): + """trainer:330-390。latents / noise: [b, f, c, h, w](上游 rearrange 之后的排布); + t_norm / r_norm: [b],`sample_timestep` 出来的**归一化、未 shift** 值。""" + batch_size, num_frames = latents.shape[0], latents.shape[1] + t = t_norm[:, None].expand(batch_size, num_frames).contiguous() + r = r_norm[:, None].expand(batch_size, num_frames).contiguous() + t = _up_apply_shift(t) * NT + r = _up_apply_shift(r) * NT + noisy_latents = _up_scale_noise(latents, t, noise) + + noise_pred = model_cond(noisy_latents, t, r) + if guidance is not None: + with torch.no_grad(): + noise_pred_uncond = model_uncond(noisy_latents, t, r) + noise_pred = (noise_pred - (1 - guidance) * noise_pred_uncond) / guidance + else: + guidance = 1.0 + + dF_dt = _up_compute_central_difference( + lambda z, tt, rr: model_cond(z, tt, rr), + noisy_latents, latents, noise, t, r, epsilon, guidance) + target = (noise - latents) - (t - r).view(batch_size, num_frames, 1, 1, 1) * dF_dt + loss = torch.mean(((noise_pred.float() - target.float()) ** 2).reshape(batch_size, -1), dim=-1) + weight = _up_get_train_weight(t, weight_table) + loss = (loss.unsqueeze(-1) * weight).mean(-1) + + with torch.no_grad(): + global_loss = loss.detach() # 单进程 ⇒ all_gather 是恒等 + global_diffusion_mask = is_diffusion + scale_weight = global_loss[global_diffusion_mask].mean() / (loss[~is_diffusion] + 1e-5) + out = loss.clone() + out[~is_diffusion] = out[~is_diffusion] * scale_weight + return out, dict(t=t, r=r, noisy=noisy_latents, pred=noise_pred, target=target, dF=dF_dt, w=weight) + + +# ============================================================================ +# 工具 +# ============================================================================ + +def _ours(z): + """[b,f,c,h,w](上游排布)→ [b,c,f,h,w](本项目排布)""" + return z.permute(0, 2, 1, 3, 4).contiguous() + + +def _up(z): + return z.permute(0, 2, 1, 3, 4).contiguous() + + +def _analytic_model(c, dtype, seed, uncond_shift=None): + """u(x, t, r) = A·x + b·t/1000 + c·r/1000 + d(+ uncond 偏置)。 + 对 t 与 r 都真的有依赖,所以中心差分与 delta 分支都被真正激活。""" + g = torch.Generator().manual_seed(seed) + A = torch.randn(c, c, generator=g, dtype=torch.float64).to(dtype) * 0.3 + B = torch.randn(c, generator=g, dtype=torch.float64).to(dtype) * 0.7 + C = torch.randn(c, generator=g, dtype=torch.float64).to(dtype) * 0.5 + D = torch.randn(c, generator=g, dtype=torch.float64).to(dtype) * 0.1 + + def m(x, t, r): + y = torch.einsum("ij,bfjhw->bfihw", A, x) + y = y + (t / NT).view(*t.shape, 1, 1, 1) * B.view(1, 1, c, 1, 1) + y = y + (r / NT).view(*r.shape, 1, 1, 1) * C.view(1, 1, c, 1, 1) + y = y + D.view(1, 1, c, 1, 1) + if uncond_shift is not None: + y = y + uncond_shift.view(1, 1, c, 1, 1) + return y + return m + + +def _wrap_ours(m): + """上游排布的模型 → 本项目 `u_fn(x[b,c,f,h,w], t, r)` 的调用形式。""" + def u(z, tt, rr): + b, f = z.shape[0], z.shape[2] + dt = z.dtype if z.dtype in (torch.float32, torch.float64) else torch.float32 + tt = torch.as_tensor(tt, dtype=dt).reshape(-1)[:, None].expand(b, f) + rr = torch.as_tensor(rr, dtype=dt).reshape(-1)[:, None].expand(b, f) + return _ours(m(_up(z), tt.contiguous(), rr.contiguous())) + return u + + +def _fp32_flowmap_model(seed: int = 3) -> AropeDiT: + """fp32 的 tiny AropeDiT,装上 flow map 之后**把读出层随机化**,让 u 真的依赖 r。 + (residual 的零读出是给真训练用的初值;差分门禁需要一个 r 起作用的模型。)""" + from diffsynth.models.wan_video_dit import WanModel + torch.manual_seed(seed) + dit = WanModel(dim=128, in_dim=48, ffn_dim=256, out_dim=48, text_dim=4096, freq_dim=256, + eps=1e-6, patch_size=(1, 2, 2), num_heads=4, num_layers=2, has_image_input=False) + m = AropeDiT(dit=dit, mask_channel=True, causal=True) + m.install_flowmap(form="residual", gate=1.0) + with torch.no_grad(): + g = torch.Generator().manual_seed(seed + 1) + d = m.dit.delta_embedding + d[2].weight.copy_(torch.randn(d[2].weight.shape, generator=g) * 0.05) + d[2].bias.copy_(torch.randn(d[2].bias.shape, generator=g) * 0.05) + return m.eval() + + +# ============================================================================ +# 1. 调度器:网格 / 权重 / any-step 轴 / Euler 步 +# ============================================================================ + +def test_upstream_file_present(): + assert os.path.isfile(UPSTREAM), f"上游参考文件不在:{UPSTREAM}" + + +def test_training_grid_matches_upstream_formula(): + """flow_pf 的 1000 点网格 == apply_shift(linspace(1,0,1001)[:-1])·1000(fp32 vs fp64)。""" + ours = flow_pf.timesteps().double() + d = (ours - _UP_TS).abs().max() + print(f"\n[grid] 1000 点 max|Δt| = {float(d):.3e}(σ 量纲 {float(d) / NT:.3e})") + assert float(d) < 2e-4 + assert float(ours[0]) == 1000.0 and abs(float(ours[-1]) - 4.9800801) < 1e-5 + + +def test_beta08_matches_upstream_formula(): + """上游 set_train_weight('beta08')。已知偏离:我们从 flow_pf 的 fp32 网格算。""" + w = fm.beta08_weights().double() + d = (w - _UP_W).abs() + rel = d / _UP_W.clamp_min(1e-12) + print(f"[beta08] max_abs = {float(d.max()):.3e} @ idx {int(d.argmax())} " + f"max_rel = {float(rel.max()):.3e} 峰 {float(w.max()):.4f} @ idx {int(w.argmax())} " + f"(σ={float(flow_pf.sigmas()[int(w.argmax())]):.5f}) w[0]={float(w[0]):.3e}") + assert float(d.max()) < 1e-5, "beta08 与上游的绝对差超过 1e-5 —— 公式变了,不只是 fp32/fp64" + assert float(rel.max()) < 2e-4 + assert int(d.argmax()) == 1, "最大差应落在 idx 1(σ=0.9998,(1−σ)^0.5 的灾难性抵消)" + assert abs(float(w.sum()) - NT) < 1e-3 + assert float(w[0]) == 0.0, "σ=1 那一格权重恰为 0(继承性质,见 --weight_floor)" + + +def test_weight_lookup_matches_upstream_argmin(): + """按下标直接索引 == 上游 get_train_weight 的 argmin 反查。""" + idx = torch.arange(0, NT, 7) + t = flow_pf.t_of_idx(idx) + ours = fm.weight_of_t(t).double() + up = _up_get_train_weight(t.double(), fm.beta08_weights().double()) + assert torch.equal(ours, up), "argmin 反查与直接索引给出了不同的格子" + + +def test_anystep_axis_matches_upstream_pipeline(): + """上游 pipeline 是 `set_timesteps(N).timesteps` 再 `cat([ts, 0])` + (pipeline_far_wan_anyflow.py:429-431)—— 末尾那个 0 是上游自己补的,不是我们加的。""" + for N in (1, 2, 4, 24, 50): + up = _up_set_timesteps(N) / NT + up = torch.cat([up, up.new_zeros(1)]) + ours = fm.anystep_sigmas(N).double() + d = (ours - up).abs().max() + print(f"[axis] N={N:3d} len={len(ours)} max|Δσ| = {float(d):.3e}") + assert ours.numel() == N + 1 and float(ours[-1]) == 0.0 + assert float(d) < 2e-7 + assert [round(float(x), 5) for x in fm.anystep_sigmas(4)] == [1.0, 0.9375, 0.83333, 0.625, 0.0] + + +def test_euler_step_matches_upstream_scheduler_step(): + g = torch.Generator().manual_seed(5) + x = torch.randn(2, 3, 4, dtype=torch.float64, generator=g) + u = torch.randn(2, 3, 4, dtype=torch.float64, generator=g) + for t_val, r_val in ((1000.0, 625.0), (625.0, 0.0), (500.6, 251.6)): + up = _up_step(u, torch.tensor(t_val, dtype=torch.float64), + x, torch.tensor(r_val, dtype=torch.float64)) + ours = fm.euler_step(x, u, t_val / NT, r_val / NT) + assert torch.equal(ours, up), f"Euler 步与上游 scheduler.step 不一致 @ t={t_val} r={r_val}" + + +# ============================================================================ +# 2. (t, r) 抽样与跨 rank 划分 +# ============================================================================ + +@pytest.mark.parametrize("world,bsz", [(4, 1), (2, 2), (8, 1), (1, 4)]) +def test_split_rotate_off_reproduces_upstream_rank_static(world, bsz): + """--split_rotate 0 必须逐槽复现上游 `global_start_idx = rank·bsz + i` 的静态分配。""" + G = world * bsz + n_d, n_c = fm.split_counts(G, 0.5, 0.25) + assert (n_d, n_c) == (round(0.5 * G), round(0.25 * G)), "round() 与上游不一致" + for rank in range(world): + tr = fm.sample_tr(bsz, world_size=world, rank=rank, + gen=torch.Generator().manual_seed(1000 + rank), + split_gen=None, rotate=False) + for i in range(bsz): + slot = rank * bsz + i + up_role = ("diffusion" if slot < n_d + else "consistency" if slot < n_d + n_c else "random") + assert tr.role_names[i] == up_role, ( + f"world={world} bsz={bsz} rank={rank} i={i}: 槽 {slot} 上游是 {up_role}," + f"本移植给了 {tr.role_names[i]}") + assert int(tr.slot[i]) == slot + + +def test_role_assignment_semantics_match_upstream(): + """diffusion ⇒ r 逐位 == t;consistency ⇒ r 恰为 0.0(不是网格最低点 4.98);t >= r。""" + for rank in range(4): + tr = fm.sample_tr(1, world_size=4, rank=rank, gen=torch.Generator().manual_seed(77 + rank), + split_gen=None, rotate=False) + role = tr.role_names[0] + if role == "diffusion": + assert torch.equal(tr.r, tr.t) and bool(tr.is_diffusion[0]) + elif role == "consistency": + assert float(tr.r[0]) == 0.0, "consistency 槽的 r 必须是精确 0.0(idx_of_t(0)==999 是陷阱)" + assert float(tr.t[0]) >= float(tr.r[0]) + + +def test_discretized_t_is_uniform_pre_shift_like_upstream(): + """上游 t1,t2 ~ U(0,1)(**shift 之前**)。我们在下标上均匀抽,而 + s[i] = 1 − i/1000 ⇒ 下标均匀 == shift 前均匀,且 i_t = min(i) ⇒ t = max(方向)。""" + g = torch.Generator().manual_seed(4) + idx_t, idx_r = [], [] + for _ in range(3000): # rank 3 / world 4 / rotate=False ⇒ 恒为 random 槽 + tr = fm.sample_tr(1, world_size=4, rank=3, gen=g, split_gen=None, rotate=False) + assert tr.role_names[0] == "random" + assert bool((tr.t >= tr.r).all()), "t 必须是较大的那个(下标上是较小的那个)" + idx_t.append(int(tr.idx_t[0])) + idx_r.append(int(tr.idx_r[0])) + assert torch.allclose(tr.sigma_t, flow_pf.sigmas()[tr.idx_t]), "σ_t 必须来自网格而不是 t/1000" + pre_t = 1.0 - torch.tensor(idx_t, dtype=torch.float64) / NT # shift 之前的 s + pre_r = 1.0 - torch.tensor(idx_r, dtype=torch.float64) / NT + # 两个 U(0,1) 的 max / min,均值分别是 2/3 与 1/3 + print(f"\n[dist] E[s_t] = {float(pre_t.mean()):.4f}(上游 2/3) " + f"E[s_r] = {float(pre_r.mean()):.4f}(上游 1/3)") + assert abs(float(pre_t.mean()) - 2.0 / 3.0) < 0.02, float(pre_t.mean()) + assert abs(float(pre_r.mean()) - 1.0 / 3.0) < 0.02, float(pre_r.mean()) + + +# ============================================================================ +# 3. 目标:解析模型上的逐位差分 +# ============================================================================ + +@pytest.mark.parametrize("guidance", [3.0, None]) +def test_objective_bit_identical_analytic(guidance): + """核心门禁。上游抽 (t,r) → 上游加噪 → 两边跑同一个解析模型: + pred / dF_dt / target 必须**逐位相同**(fp64)。""" + b, f, c, h, w = 4, 5, 3, 4, 4 + eps = 5.0 + gsh = torch.Generator().manual_seed(21) + ush = torch.randn(c, dtype=torch.float64, generator=gsh) * 0.4 + MC = _analytic_model(c, torch.float64, seed=13) + MU = _analytic_model(c, torch.float64, seed=13, uncond_shift=ush) + + g = torch.Generator().manual_seed(7) + t_n, r_n, is_d = _up_sample_timestep(b, torch.float64, rank=0, world=1, + diffusion_ratio=0.5, consistency_ratio=0.25, gen=g) + x0 = torch.randn(b, f, c, h, w, dtype=torch.float64, generator=g) + noise = torch.randn(b, f, c, h, w, dtype=torch.float64, generator=g) + + up_loss, aux = _up_train_causal(MC, MU, x0, noise, t_n, r_n, is_d, guidance, eps, + weight_table=fm.beta08_weights().double()) + + # --- 本移植,喂同一批 (t, r, x_t) --- + t1000, r1000 = aux["t"][:, 0].clone(), aux["r"][:, 0].clone() + X0, NZ, XT = _ours(x0), _ours(noise), _ours(aux["noisy"]) + UC, UU = _wrap_ours(MC), _wrap_ours(MU) + + f_full = UC(XT, t1000, r1000) + gains = fm.active_gains({} if guidance is None else {"text": guidance - 1.0}, dropped=()) + nulls = {"text": UU(XT, t1000, r1000)} if gains else {} + pred, den = fm.fuse_predictions(f_full, nulls, gains) + assert den == (1.0 if guidance is None else guidance) + dF = fm.central_difference(UC, XT, X0, NZ, t1000, r1000, epsilon=eps, den=den, + eps_clamp=False, pin_first_cell=False) + target = fm.flowmap_target(X0, NZ, t1000, r1000, dF) + loss_b, _ = fm.flowmap_loss(pred, target, t=t1000, weight_type="beta08", skip_first_cell=False) + loss_b, _ = fm.adaptive_balance(loss_b, torch.as_tensor(is_d)) + + nd = ~is_d + print(f"\n[diff g={guidance}] den={den} is_diffusion={is_d.tolist()}") + assert torch.equal(pred, _ours(aux["pred"])), "融合后的 pred 与上游不逐位相同" + assert torch.equal(target, _ours(aux["target"])), "target 与上游不逐位相同" + # t==r 的行本移植把 dF 硬置 0(上游算了但随后乘 (t−r)=0);非对角行必须逐位相同 + assert torch.equal(dF[nd], _ours(aux["dF"])[nd]), "非对角行的 dF/dt 与上游不逐位相同" + assert float(dF[is_d].abs().max()) == 0.0, "对角行的 dF/dt 必须被硬置 0(0×NaN 熔断器)" + # loss 本身达不到逐位:上游是 `((p.float()-t.float())**2).reshape(b,-1).mean(-1)` + # (**降到 fp32** 再按上游的 [b,f,c,h,w] 内存序归约),我们是 fp32/fp64 的 + # `se.mean(dim=(1,2,3,4))`、张量排布是 [b,c,f,h,w]。算法完全相同,差的是归约顺序 + 上游的 .float()。 + rel = float(((loss_b - up_loss).abs() / up_loss.abs()).max()) + print(f"[diff g={guidance}] pred/target/dF 全部 Δ == 0.0;loss 最大相对差 {rel:.2e}" + f"(上游 .float() + 归约顺序)") + assert rel < 1e-6, f"ours={loss_b.tolist()} up={up_loss.tolist()}" + + +def test_objective_matches_upstream_with_upstream_weight_table(): + """把权重表也换成上游的 fp64 版:端到端仍然逐位相同 ⇒ 唯一残差就是那张表。""" + b, f, c, h, w = 3, 4, 3, 4, 4 + MC = _analytic_model(c, torch.float64, seed=31) + MU = _analytic_model(c, torch.float64, seed=31, + uncond_shift=torch.full((c,), 0.37, dtype=torch.float64)) + g = torch.Generator().manual_seed(9) + t_n, r_n, is_d = _up_sample_timestep(b, torch.float64, 0, 1, 0.5, 0.25, g) + x0 = torch.randn(b, f, c, h, w, dtype=torch.float64, generator=g) + noise = torch.randn(b, f, c, h, w, dtype=torch.float64, generator=g) + up_loss, aux = _up_train_causal(MC, MU, x0, noise, t_n, r_n, is_d, 3.0, 5.0) # 上游自己的表 + t1000, r1000 = aux["t"][:, 0].clone(), aux["r"][:, 0].clone() + X0, NZ, XT = _ours(x0), _ours(noise), _ours(aux["noisy"]) + UC, UU = _wrap_ours(MC), _wrap_ours(MU) + pred, den = fm.fuse_predictions(UC(XT, t1000, r1000), {"text": UU(XT, t1000, r1000)}, {"text": 2.0}) + dF = fm.central_difference(UC, XT, X0, NZ, t1000, r1000, epsilon=5.0, den=den, + eps_clamp=False, pin_first_cell=False) + target = fm.flowmap_target(X0, NZ, t1000, r1000, dF) + loss_b, _ = fm.flowmap_loss(pred, target, weight_type="uniform", skip_first_cell=False) + loss_b = loss_b * _up_get_train_weight(aux["t"])[:, 0] # 上游的 fp64 权重 + loss_b, _ = fm.adaptive_balance(loss_b, torch.as_tensor(is_d)) + rel = float(((loss_b - up_loss).abs() / up_loss.abs()).max()) + print(f"[diff] 换用上游 fp64 权重表后 loss 最大相对差 = {rel:.2e}(只剩归约顺序)") + assert rel < 1e-6, f"ours={loss_b.tolist()} up={up_loss.tolist()}" + + +def test_adaptive_balance_matches_upstream_algebra(): + """上游的代数性质:配平之后每个非 diffusion 样本的 loss 值 == 全局 diffusion 均值。""" + g = torch.Generator().manual_seed(2) + loss = torch.rand(8, dtype=torch.float64, generator=g) * 3 + 0.1 + is_d = torch.tensor([1, 1, 1, 1, 0, 0, 0, 0], dtype=torch.bool) + out, info = fm.adaptive_balance(loss.clone(), is_d) + # 上游:loss[~m] = loss[~m] * (gl[m].mean() / (loss[~m] + 1e-5)) + up = loss.clone() + up[~is_d] = up[~is_d] * (loss[is_d].mean() / (loss[~is_d] + 1e-5)) + assert torch.equal(out, up) + assert torch.equal(out[is_d], loss[is_d]), "diffusion 样本必须逐位不变" + assert torch.allclose(out[~is_d], loss[is_d].mean().expand(4), rtol=1e-4) + with pytest.raises(RuntimeError): + fm.adaptive_balance(loss.clone(), torch.zeros(8, dtype=torch.bool)) + + +# ============================================================================ +# 4. 目标:真 AropeDiT(模型接线)上的逐位差分 +# ============================================================================ + +def test_objective_bit_identical_on_real_aropedit(): + """把解析模型换成真 AropeDiT(fp32、装了 flow map、读出层随机化 ⇒ u 真的依赖 r)。 + 这一条把**模型接线**也纳进差分:r 走错正弦量纲、融合发生在 time_projection 之后、 + 探针把 r 当成 t —— 任何一种都会在这里炸。""" + m = _fp32_flowmap_model() + b, cells, lat, cch = 1, 4, 8, int(m.dit.in_dim) + g = torch.Generator().manual_seed(15) + x0 = torch.randn(b, cch, cells, lat, lat, generator=g) + noise = torch.randn(b, cch, cells, lat, lat, generator=g) + ctx = torch.randn(b, cells, 8, 4096, generator=g) + ctx_u = torch.randn(b, cells, 8, 4096, generator=g) + ids = torch.zeros(b, cells, dtype=torch.int64) + off = torch.zeros(b, cells, 2) + mask_in = make_mask_input(off, lat, lat) + cond = dict(context_ids=ids, offset_px=off, mask_input=mask_in, first_frame_cond=False) + + def mk(context): + @torch.no_grad() + def call(z_up, t_bf, r_bf): # 上游排布进 / 上游排布出 + return _up(m(_ours(z_up), t_bf.float(), context, r_timestep=r_bf.float(), **cond)) + return call + MC, MU = mk(ctx), mk(ctx_u) + + gg = torch.Generator().manual_seed(6) + t_n, r_n, is_d = _up_sample_timestep(b, torch.float32, 0, 4, 0.5, 0.25, gg) # rank0/world4 ⇒ diffusion + r_n = r_n.clone(); r_n[0] = t_n[0] * 0.31; is_d = torch.zeros(b, dtype=torch.bool) # 强制 off-diagonal + up_loss, aux = _up_train_causal(MC, MU, _up(x0), _up(noise), t_n, r_n, + torch.ones(b, dtype=torch.bool), # 让配平成为恒等 + 3.0, 5.0, weight_table=fm.beta08_weights().double()) + + t1000, r1000 = aux["t"][:, 0].clone(), aux["r"][:, 0].clone() + XT = _ours(aux["noisy"]) + UC = lambda z, tt, rr: m(z, torch.as_tensor(tt).float(), ctx, r_timestep=torch.as_tensor(rr).float(), **cond) # noqa: E731 + with torch.no_grad(): + f_full = UC(XT, t1000, r1000) + f_un = m(XT, t1000, ctx_u, r_timestep=r1000, **cond) + pred, den = fm.fuse_predictions(f_full, {"text": f_un}, {"text": 2.0}) + dF = fm.central_difference(UC, XT, x0, noise, t1000, r1000, epsilon=5.0, den=den, + eps_clamp=False, pin_first_cell=False) + target = fm.flowmap_target(x0, noise, t1000, r1000, dF) + loss_b, _ = fm.flowmap_loss(pred, target, t=t1000, weight_type="beta08", skip_first_cell=False) + + print(f"\n[model] t={float(t1000):.3f} r={float(r1000):.3f} |dF/dt|rms={float(dF.pow(2).mean().sqrt()):.3e}") + assert float(dF.abs().max()) > 0.0, "dF/dt 恒为 0 ⇒ 模型对 t 没有依赖,这条门禁就失去意义了" + assert torch.equal(pred, _ours(aux["pred"])), "真模型上的 pred 与上游不逐位相同" + assert torch.equal(dF, _ours(aux["dF"])), "真模型上的 dF/dt 与上游不逐位相同" + assert torch.equal(target, _ours(aux["target"])), "真模型上的 target 与上游不逐位相同" + rel = float(((loss_b - up_loss).abs() / up_loss.abs()).max()) + assert rel < 1e-6, f"ours={loss_b.tolist()} up={up_loss.tolist()}" + print(f"[model] pred/dF/target 全部 Δ == 0.0(真 AropeDiT,fp32);loss 相对差 {rel:.2e}") + + +def test_r_equals_t_reduces_to_rectified_flow(): + """r == t ⇒ dF/dt ≡ 0、target 逐位 == ε − x0、loss 逐位 == beta08 加权的 flow-matching MSE + (= stage1 的目标乘一个标量权重)。不做 fuse(--fuse_guidance_scale 1.0 ⇒ den=1)。""" + m = _fp32_flowmap_model(seed=8) + b, cells, lat, cch = 1, 4, 8, int(m.dit.in_dim) + g = torch.Generator().manual_seed(19) + x0 = torch.randn(b, cch, cells, lat, lat, generator=g) + noise = torch.randn(b, cch, cells, lat, lat, generator=g) + ctx = torch.randn(b, cells, 8, 4096, generator=g) + off = torch.zeros(b, cells, 2) + cond = dict(context_ids=torch.zeros(b, cells, dtype=torch.int64), offset_px=off, + mask_input=make_mask_input(off, lat, lat), first_frame_cond=True) + idx = torch.tensor([400]) + t = flow_pf.t_of_idx(idx) + x_t = fm.add_noise_scalar(x0, noise, idx) + + with torch.no_grad(): + f_full = m(x_t, t, ctx, r_timestep=t, **cond) + pred, den = fm.fuse_predictions(f_full, {}, fm.active_gains({"text": 0.0})) + assert den == 1.0 and torch.equal(pred, f_full), "不开 fuse 时 pred 必须逐位就是 F_full" + assert not fm.probes_needed(t, t), "r == t 时必须跳过探针" + UC = lambda z, tt, rr: m(z, torch.as_tensor(tt).float(), ctx, r_timestep=torch.as_tensor(rr).float(), **cond) # noqa: E731 + dF = fm.central_difference(UC, x_t, x0, noise, t, t, epsilon=5.0, den=den) + assert float(dF.abs().max()) == 0.0 and dF.numel() == 1, "r==t 时 dF/dt 必须是一个 0 标量" + + target = fm.flowmap_target(x0, noise, t, t, dF) + assert torch.equal(target, flow_pf.training_target(x0, noise).float()), \ + "r == t 时 target 必须逐位等于 rectified flow 的 ε − x0" + loss_b, st = fm.flowmap_loss(pred, target, idx_t=idx, weight_type="beta08") + mse = ((pred.float() - target.float()) ** 2)[:, :, 1:].mean() + w = fm.beta08_weights()[idx] + assert torch.equal(loss_b, (mse * w).reshape(1)), "r==t 的 loss 不是 beta08·MSE" + assert torch.equal(st["mse"], mse) + print(f"\n[r==t] target ≡ ε−x0,loss = beta08({float(w):.4f}) × mse({float(mse):.6f}) " + f"= {float(loss_b):.6f}") + + +# ============================================================================ +# 5. 已知偏离的上界 +# ============================================================================ + +def test_bf16_stencil_width_is_inherited_not_introduced(): + """★ 记录(而不是修)一处**继承自上游**的数值性质:探针的时间步在进模型前会被降成 + latent 的 dtype(我们是 `_per_token_timestep_pf`;上游是 `sample_timestep(dtype=bfloat16)`, + main.py:341 mixed_precision ⇒ t 全程 bf16),于是 ε=5 时**实际**落地的中心差分步长 + 不是 10 而是 8~12,而两边的分母都写死 `2·ε`。 + + 这不是移植偏离(上游同样如此),但它是一处真实的、与 t 相关的系统性偏差, + 会直接按同一个比例缩放 dF/dt。上线前应当在真权重上量一次 (u⁺−u⁻) 的信噪比。""" + ts = flow_pf.timesteps().float() + for eps in (5.0, 8.0): + w_real = (ts + eps).to(torch.bfloat16).float() - (ts - eps).to(torch.bfloat16).float() + rel = (w_real - 2 * eps).abs() / (2 * eps) + print(f"[bf16] ε={eps:4.1f} 实际步长 min {float(w_real.min()):.2f} / " + f"max {float(w_real.max()):.2f}(名义 {2 * eps:.1f}) " + f"相对误差 mean {float(rel.mean()):.4f} max {float(rel.max()):.4f}") + assert float(w_real.min()) > 0.0, "步长退化成 0 会让 dF/dt 直接 inf" + w5 = (ts + 5.0).to(torch.bfloat16).float() - (ts - 5.0).to(torch.bfloat16).float() + rel5 = ((w5 - 10.0).abs() / 10.0) + assert 0.10 < float(rel5.mean()) < 0.25, float(rel5.mean()) # 实测 0.166 + assert float(rel5.max()) <= 0.20 + 1e-6 + + +def test_eps_clamp_off_reproduces_upstream_stencil(): + """--eps_clamp 0:步长恒为字面量 2ε、探针可以越过 t=1000(上游行为)。 + --eps_clamp 1:只在离边界 ε 以内才收窄,其余格逐位相同。""" + b, cells, lat = 1, 3, 4 + g = torch.Generator().manual_seed(23) + x0 = torch.randn(b, 3, cells, lat, lat, dtype=torch.float64, generator=g) + noise = torch.randn(b, 3, cells, lat, lat, dtype=torch.float64, generator=g) + xt = torch.randn(b, 3, cells, lat, lat, dtype=torch.float64, generator=g) + seen = [] + + def u(z, tt, rr): + seen.append((float(torch.as_tensor(tt).reshape(-1)[0]), float(torch.as_tensor(rr).reshape(-1)[0]))) + return z * 0.5 + float(torch.as_tensor(tt).reshape(-1)[0]) / NT + + for t_val, expect_off, expect_on in ((500.6, (505.6, 495.6), (505.6, 495.6)), + (1000.0, (1005.0, 995.0), (1000.0, 995.0)), + (4.9800801, (9.98008, -0.01992), (9.98008, 0.0))): + for clamp, exp in ((False, expect_off), (True, expect_on)): + seen.clear() + fm.central_difference(u, xt, x0, noise, t_val, 0.0, epsilon=5.0, den=1.0, + eps_clamp=clamp, pin_first_cell=False) + got = (seen[0][0], seen[1][0]) + assert all(abs(a - b_) < 1e-4 for a, b_ in zip(got, exp)), \ + f"t={t_val} clamp={clamp}: 探针落在 {got},期望 {exp}" + print("\n[clamp] eps_clamp=0 复现上游(t=1000 ⇒ 探针到 1005,σ>1);" + "eps_clamp=1 只在边界收窄") + + +def test_convex_gate_must_be_in_open_unit_interval(): + """回归:convex + gate ∉ (0,1) 必须当场炸。 + + g == 1 ⇒ t = 0·E(t) + 1·D(r):时间嵌入被 r 嵌入**整个替换**,模型对 t 零依赖; + 而 r == t 时 D(t) == E(t),所以 trainer 那道只查对角线的 _assert_teacher_identity + 会给绿灯。上游 gate_value = 0.25。""" + from diffsynth.models.wan_video_dit import WanModel + + def tiny(): + torch.manual_seed(0) + return AropeDiT(dit=WanModel(dim=128, in_dim=48, ffn_dim=256, out_dim=48, text_dim=4096, + freq_dim=256, eps=1e-6, patch_size=(1, 2, 2), num_heads=4, + num_layers=2, has_image_input=False), + mask_channel=True, causal=True) + for bad in (1.0, 0.0, 1.5, -0.25): + with pytest.raises(AssertionError, match="开区间"): + tiny().install_flowmap(form="convex", gate=bad) + tiny().install_flowmap(form="convex", gate=0.25) # 上游值:放行 + tiny().install_flowmap(form="residual", gate=1.0) # residual 的 1.0 仍然合法 + print("[convex] gate ∈ {1.0, 0.0, 1.5, −0.25} 全部被拒;0.25(上游值)放行") + + +if __name__ == "__main__": + sys.exit(pytest.main([__file__, "-q", "-s", "-p", "no:warnings"])) diff --git a/backup_2026-09-14/code/distill/tests/test_fm_arope_wiring.py b/backup_2026-09-14/code/distill/tests/test_fm_arope_wiring.py new file mode 100644 index 0000000000000000000000000000000000000000..b450332d918b32924edccf555ab2b943fb657f4c --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_fm_arope_wiring.py @@ -0,0 +1,169 @@ +#!/usr/bin/env python3 +"""stage2-flowmap **trainer 侧**的接线闸(`distill/stage2_flowmap/fm_arope.py::fm_loss`)。 + +为什么需要这个文件 +----------------- +在这一版之前,303 项测试里**没有一项 import 过 fm_arope**:`flowmap.py` 的目标数学被 +`test_flowmap_objective.py` / `test_flowmap_upstream_diff.py` 钉得很死,`arope_dit.py` 的 +delta 分支被 `test_flowmap_model.py` 钉得很死,但把三者接起来的那几十行编排(谁把 t 传给 +timestep、谁把 r 传给 r_timestep、fuse 的 den 有没有原样传给中心差分、抽到的 dropout 有没有 +真的作用到前向上)一行都没被覆盖。这几行恰好是**改错了不报错**的地方: + +* `model(x_t, r, r_timestep=t, ...)` —— t/r 传反,训出一个"往回加噪"的模型; +* `fuse_predictions(..., {k: -v ...})` —— guidance 取反(w<1.5 时 den 仍 >0,不会炸); +* `central_difference(..., den=1.0)` —— 修正项大 den 倍(默认 3×); +* `drop["anchor"]` 抽到了却不作用到前向 —— 三个 `--*_dropout` 变成死参数。 + +四种都能让 loss 照常下降、dry run 照常跑完、全部既有测试照常绿。下面四条就是钉它们的。 +用**替身**(monkeypatch 记录调用参数)而不是数值闭式:这一层要验的是接线,不是算术。 +""" +from __future__ import annotations + +import os +import sys + +import pytest +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from actionrope.dataset import arope_collate # noqa: E402 +from distill import flowmap as fm # noqa: E402 +from distill.arope_dit import AropeDiT, unwrap # noqa: E402 +from distill.stage2_flowmap import fm_arope as T # noqa: E402 + +GAINS = {"text": 2.0, "anchor": 0.5, "action": 0.0, "hist": 0.0, "ctx": 0.0} + + +@pytest.fixture(scope="module") +def fixt(): + """tiny 学生(装了 flow map)+ 一个两样本的合成 batch + 一份必然含 off-diagonal 槽的 (t, r)。""" + torch.manual_seed(0) + model = T._tiny_model().install_flowmap() + ds = T._SynDataset(4) + batch = arope_collate([ds[i] for i in range(2)]) + tr = fm.sample_tr(2, world_size=1, rank=0, + gen=torch.Generator().manual_seed(1), + split_gen=fm.make_split_generator(0), + diffusion_ratio=0.5, consistency_ratio=0.25, + rotate=True, device=torch.device("cpu")) + assert bool((tr.t > tr.r).any()), "这组种子全落在对角线上,测不到 t≠r 的接线" + uncond = torch.randn(2, batch["context"].shape[1], 8, 4096, dtype=torch.bfloat16) + uids = torch.zeros_like(batch["context_ids"]) + noise = torch.randn_like(batch["input_latents"]) + return dict(model=model, batch=batch, tr=tr, uncond=uncond, uids=uids, noise=noise) + + +def _run(fixt, drop=None, gains=None, **kw): + return T.fm_loss(fixt["model"], fixt["batch"], fixt["tr"], gains=gains or GAINS, + uncond=fixt["uncond"], uncond_ids=fixt["uids"], + drop=drop or {}, noise=fixt["noise"], **kw) + + +# --------------------------------------------------------------------------- + + +def test_1_every_forward_gets_t_as_timestep_and_r_as_r_timestep(fixt, monkeypatch): + """主前向 / 每条 null / 两次探针:timestep 收到的必须是 t,r_timestep 收到的必须是 r。 + + 传反不会报错(两个参数同形同量纲),只会把 u(x_t, t, r) 训成 u(x_t, r, t) —— 沿着 + **加噪**方向的均速度。这里直接记录进 AropeDiT.forward 的实参。 + """ + seen = [] + orig = AropeDiT.forward + + def spy(self, x, timestep, context, **kw): + seen.append((torch.as_tensor(timestep).clone().float(), + torch.as_tensor(kw.get("r_timestep")).clone().float())) + return orig(self, x, timestep, context, **kw) + + monkeypatch.setattr(AropeDiT, "forward", spy) + _run(fixt) + assert len(seen) >= 4, f"至少该有 主前向 + 1 条 text null + 2 次探针,实测 {len(seen)} 次" + t_ref, r_ref = fixt["tr"].t.float(), fixt["tr"].r.float() + tt0, rr0 = seen[0] + assert torch.equal(tt0, t_ref) and torch.equal(rr0, r_ref), ( + f"主前向拿到的 (t, r) = ({tt0.tolist()}, {rr0.tolist()}),应当是 " + f"({t_ref.tolist()}, {r_ref.tolist()}) —— 两者传反了") + eps = 5.0 # fm_loss 的默认 flowmap_epsilon + for i, (tt, rr) in enumerate(seen): + assert torch.equal(rr, r_ref), f"第 {i} 次前向的 r 变了:{rr.tolist()} != {r_ref.tolist()}" + assert bool((tt >= rr - eps).all()), ( + f"第 {i} 次前向 t < r − ε:t={tt.tolist()} r={rr.tolist()};" + "只有中心差分的 t⁻ = t − ε 允许低于 r,且最多低 ε") + print(f"1. 接线 {len(seen)} 次前向,r 恒为 tr.r;主前向 (t,r) 逐位正确;" + f"探针 t 只在 [t−ε, t+ε] 内动") + + +def test_2_central_difference_receives_the_fuse_den(fixt, monkeypatch): + """探针只跑条件分支,所以 dF/dt 必须除以**融合用的同一个** den = 1 + Σ g_j。 + + 写成 den=1.0 会让修正项大 den 倍(默认 3×)—— loss 照降、任何既有测试都不会红。 + """ + got = {} + orig = fm.central_difference + + def spy(*a, **kw): + got["den"] = kw.get("den") + return orig(*a, **kw) + + monkeypatch.setattr(fm, "central_difference", spy) + _, st = _run(fixt) + want = fm.fuse_denominator(fm.active_gains(GAINS, set())) + assert got["den"] == pytest.approx(want, abs=1e-12), ( + f"central_difference 拿到 den={got['den']},应当是 fuse 的 1+Σg={want}") + assert st["den"] == pytest.approx(want, abs=1e-12) + print(f"2. den fuse 与中心差分共用 den = {want}(1 + 2.0 文本 + 0.5 锚点)") + + +def test_3_mask_axis_dropout_reaches_every_forward(fixt, monkeypatch): + """anchor / hist / ctx 三条轴改的是**裸模块属性**,不是 cond 字典 —— 只把抽签结果记在 + `drop` 里等于没做。这三条 dropout 必须在本 micro batch 的每一次前向里都生效,退出后还原。 + """ + bare = unwrap(fixt["model"]) + seen = [] + orig = AropeDiT._get_mask + + def spy(self, f, hw, device, tf): + seen.append((self.train_local_attn_size, self.train_sink_size, bool(self.train_drop_anchor))) + return orig(self, f, hw, device, tf) + + monkeypatch.setattr(AropeDiT, "_get_mask", spy) + want = {"anchor": (0, 0, True), "hist": (1, 1, False), "ctx": (1, 0, False)} + rows = [] + for axis, exp in want.items(): + seen.clear() + _, st = _run(fixt, drop={axis: True}) + states = sorted(set(seen)) + assert states == [exp], f"drop={axis} 时前向里看到的掩码状态是 {states},应当恒为 [{exp}]" + assert (bare.train_local_attn_size, bare.train_sink_size, bare.train_drop_anchor) == (0, 0, False), \ + f"drop={axis} 之后裸模块属性没还原" + rows.append(f"{axis}→{exp}") + seen.clear() + _run(fixt, drop={}) + assert (0, 0, False) in set(seen), "不 drop 时主前向必须是完整条件" + print("3. dropout 掩码轴真的作用到每一次前向并还原:" + " ".join(rows)) + + +def test_4_dropped_axis_deactivates_its_own_gain(fixt): + """本 micro batch 已经被 drop 掉的轴,g_j 记 0、den 跟着变小,也不再多跑那次 null 前向。 + + (这同时是对上游 trainer:279 的修正:它 drop 了 text 还照 guidance=3 去除 dF_dt。) + """ + _, full = _run(fixt, drop={}) + _, d_anc = _run(fixt, drop={"anchor": True}) + _, d_txt = _run(fixt, drop={"text": True}) + assert full["den"] == pytest.approx(3.5) and full["n_null"] == 2 + assert d_anc["den"] == pytest.approx(3.0) and d_anc["n_null"] == 1, \ + f"drop anchor 之后 den 应当从 3.5 掉到 3.0,实测 {d_anc['den']}" + assert d_txt["den"] == pytest.approx(1.5) and d_txt["n_null"] == 1, \ + f"drop text 之后 den 应当从 3.5 掉到 1.5,实测 {d_txt['den']}" + print(f"4. den 随 drop 变:完整 {full['den']}/{full['n_null']}null," + f"drop anchor {d_anc['den']}/{d_anc['n_null']}null,drop text {d_txt['den']}/{d_txt['n_null']}null") + + +if __name__ == "__main__": + raise SystemExit(pytest.main([__file__, "-q", "-s"])) diff --git a/backup_2026-09-14/code/distill/tests/test_iface_fidelity.py b/backup_2026-09-14/code/distill/tests/test_iface_fidelity.py new file mode 100644 index 0000000000000000000000000000000000000000..963ff32b61ecf03f97bdaede281d40d1de77a69d --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_iface_fidelity.py @@ -0,0 +1,450 @@ +#!/usr/bin/env python3 +"""接口保真度门禁:`distill.arope_dit.AropeDiT` 相对 `actionrope.arope.arope_forward` 的 +**契约** 必须是严格超集,而且多出来的三条路径(f_start / 逐 cell 条件 / 双流)要真的接对了。 + + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest \\ + /data/zhiyangdeng/ActionRoPE/distill/tests/test_iface_fidelity.py -q + +与 `test_bitparity.py` 的分工:那份钉的是"同一组输入两边输出逐位相同",这份钉的是 +**输入集合本身** 和 **逐 cell 对位**: + +1. 逐位等价在 test_bitparity 没覆盖的配置下依然成立 —— fp32 权重 + autocast(bf16)(stage2/3 的实际 + 配置,`_mask_embed` 拿 patch_embedding 的输出还是权重做参照物,在这里才分得出来)、 + 梯度检查点 offload、f==1、`context_ids=None` 的按内容去重。 +2. `timestep` 形状契约:上游 `_per_token_timestep` 先 `reshape(-1)`,所以 `[b,1]` / `[1,1]` 是合法的 + 逐样本写法;AropeDiT 必须照单全收并给出逐位相同的结果(只多接一个 `[b,f]`)。 +3. **f_start != 0 真的被走到**(PORT_SPEC BLOCKER B2):只测 frame 0 的话 f_start 恒为 0,测试自动通过。 + 这里既测查表分支(`offset_tok=None`)的 f_start,也把 `forward_frame` 整条 rollout 与 + 全片段块因果并行前向对齐到 float64 精度,并给出"把 f_start 钉死成 0"的反向对照 —— 后者必须炸。 +4. 逐 cell 对位:块因果下 cell j 的输出绝不能被 cell k>j 的 offset_px / mask_input / context / timestep + 影响(差值必须 **精确** 为 0,不是 1e-6 量级);teacher-forcing 双流同理,且 clean cell f 绝不能 + 泄漏进 noisy cell f。 +""" +from __future__ import annotations + +import os +import sys + +import pytest +import torch + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from diffsynth.models.wan_video_dit import WanModel # noqa: E402 + +from actionrope.arope import ( # noqa: E402 + PX_PER_LATENT, + arope_forward, + build_world_freqs as upstream_build_world_freqs, + install_arope, + known_mask, +) +import distill.arope_dit as AD # noqa: E402 +from distill.arope_dit import AropeDiT, build_world_freqs, unwrap # noqa: E402 + +DEV = "cuda" if torch.cuda.is_available() else "cpu" +# dim 128 / 4 头 ⇒ head_dim 32 ⇒ RoPE 轴 (12,10,10)/2 = 6+5+5 = 16 复数,正好半个 head_dim。 +# 换成 dim 64 会得到 3+2+2=7 != 8,rope_apply 直接形状不匹配 —— 别动这组数。 +DIM, HEADS, LAYERS = 128, 4, 2 +C, LAT_H, LAT_W, L_TXT = 48, 8, 10, 16 +HW = (LAT_H // 2) * (LAT_W // 2) # 20 token/cell + + +def _dit(dtype, seed: int = 0) -> WanModel: + torch.manual_seed(seed) + dit = WanModel(dim=DIM, in_dim=C, ffn_dim=2 * DIM, out_dim=C, text_dim=4096, freq_dim=2 * DIM, + eps=1e-6, patch_size=(1, 2, 2), num_heads=HEADS, num_layers=LAYERS, + has_image_input=False) + dit = dit.to(device=DEV, dtype=dtype).eval().requires_grad_(False) + install_arope(dit, mask_channel=True) + with torch.no_grad(): + # 零初始化的 mask 通道等于没接上:随机化之后 mask_input 才真的参与前向 + dit.arope_mask_embedding.weight.normal_(0.0, 0.05) + dit.arope_mask_embedding.bias.normal_(0.0, 0.05) + dit.arope_mask_embedding.to(dtype=dtype) + dit.freqs = tuple(t.to(DEV) for t in dit.freqs) + return dit + + +def _batch(b: int, f: int, dtype, seed: int = 1, per_cell_ids: bool = True): + g = torch.Generator(device="cpu").manual_seed(seed) + x = torch.randn(b, C, f, LAT_H, LAT_W, generator=g).to(DEV, dtype) + ctx = torch.randn(b, f, L_TXT, 4096, generator=g).to(DEV, dtype) + if per_cell_ids: + ids = torch.arange(f, dtype=torch.int64, device=DEV).view(1, f).repeat(b, 1) + else: + ids = torch.zeros(b, f, dtype=torch.int64, device=DEV) + ctx = ctx[:, 0:1].expand(b, f, L_TXT, 4096).contiguous() + off = (torch.rand(b, f, 2, generator=g) * 300.0 - 150.0) + off[:, 0] = 0.0 # cell 0 是锚点 + off = off.to(DEV, dtype) + msk = known_mask(off / PX_PER_LATENT, LAT_H, LAT_W).to(dtype).unsqueeze(1) + ts = (torch.rand(b, f, generator=g) * 900.0 + 50.0).to(DEV, dtype) + return dict(x=x, ctx=ctx, ids=ids, off=off, msk=msk, ts=ts) + + +@pytest.fixture(scope="module") +def bf16(): + """bf16 双向模型:跟 arope_forward 对逐位等价用。""" + dit = _dit(torch.bfloat16, seed=0) + return dit, AropeDiT(dit=dit, mask_channel=True, causal=False) + + +@pytest.fixture(scope="module") +def fp32(): + """fp32 权重:stage2/3 在 autocast(bf16) 下跑的就是这种模型。""" + dit = _dit(torch.float32, seed=0) + return dit, AropeDiT(dit=dit, mask_channel=True, causal=False) + + +@pytest.fixture(scope="module") +def f64(): + """float64 因果模型:泄漏 / 对位断言要 == 0,不能用 1e-6 的容差糊过去。""" + dit = _dit(torch.float64, seed=2) + return dit, AropeDiT(dit=dit, mask_channel=True, causal=True) + + +def _eq(ref, out, tag): + assert ref.shape == out.shape and ref.dtype == out.dtype, f"[{tag}] {ref.shape}/{ref.dtype} vs {out.shape}/{out.dtype}" + if not torch.equal(ref, out): + d = (ref.float() - out.float()).abs() + raise AssertionError(f"[{tag}] 不是逐位相同:max|Δ|={d.max().item():.3e} " + f"不同元素 {int((ref != out).sum())}/{ref.numel()}") + + +# -------------------------------------------------------------------------- +# 1. test_bitparity 没覆盖到的等价配置 +# -------------------------------------------------------------------------- + +def test_parity_under_autocast_with_fp32_weights(fp32): + """stage2/3 的真实配置:权重 fp32、autocast bf16。此时 patch_embedding 的 **输出** 是 bf16 而 + **权重** 是 fp32,`_mask_embed` 拿错参照物就会在这里(且只在这里)分叉。""" + dit, model = fp32 + bt = _batch(2, 5, torch.float32, seed=11) + ts = torch.tensor([500.0], device=DEV) + with torch.no_grad(), torch.autocast(DEV, torch.bfloat16, enabled=(DEV == "cuda")): + ref = arope_forward(dit, bt["x"], ts, bt["ctx"], offset_px=bt["off"], + mask_input=bt["msk"], context_ids=bt["ids"]) + out = model(bt["x"], ts, bt["ctx"], context_ids=bt["ids"], offset_px=bt["off"], + mask_input=bt["msk"]) + _eq(ref, out, "autocast-fp32") + + +def test_parity_gradient_checkpointing_offload(bf16): + dit, model = bf16 + bt = _batch(2, 5, torch.bfloat16, seed=12) + ts = torch.tensor([500.0], device=DEV) + with torch.no_grad(): + ref = arope_forward(dit, bt["x"], ts, bt["ctx"], offset_px=bt["off"], mask_input=bt["msk"], + context_ids=bt["ids"], use_gradient_checkpointing_offload=True) + out = model(bt["x"], ts, bt["ctx"], context_ids=bt["ids"], offset_px=bt["off"], + mask_input=bt["msk"], use_gradient_checkpointing_offload=True) + _eq(ref, out, "gc-offload") + + +def test_parity_single_cell_and_content_dedup(bf16): + """f==1(rollout 的形状)与 context_ids=None(按内容去重)两条分支。""" + dit, model = bf16 + ts = torch.tensor([500.0], device=DEV) + bt1 = _batch(2, 1, torch.bfloat16, seed=13) + with torch.no_grad(): + ref = arope_forward(dit, bt1["x"], ts, bt1["ctx"], offset_px=bt1["off"], + mask_input=bt1["msk"], context_ids=bt1["ids"], first_frame_cond=False) + out = model(bt1["x"], ts, bt1["ctx"], context_ids=bt1["ids"], offset_px=bt1["off"], + mask_input=bt1["msk"], first_frame_cond=False) + _eq(ref, out, "f=1") + + bt = _batch(2, 5, torch.bfloat16, seed=14) + with torch.no_grad(): + ref = arope_forward(dit, bt["x"], ts, bt["ctx"], offset_px=bt["off"], + mask_input=bt["msk"], context_ids=None) + out = model(bt["x"], ts, bt["ctx"], context_ids=None, offset_px=bt["off"], + mask_input=bt["msk"]) + _eq(ref, out, "ids=None") + + +# -------------------------------------------------------------------------- +# 2. timestep 形状契约:必须是上游的严格超集 +# -------------------------------------------------------------------------- + +def test_timestep_shape_contract_is_a_superset(bf16): + """上游 `_per_token_timestep` 先 `reshape(-1)`,所以 [b,1] / [1,1] 也是合法的逐样本写法。 + AropeDiT 是它的替身,接受的形状只能多不能少,而且结果必须逐位相同。""" + dit, model = bf16 + b, f = 2, 5 + bt = _batch(b, f, torch.bfloat16, seed=15) + shapes = { + "python float": 500.0, + "0-dim": torch.tensor(500.0, device=DEV), + "[1]": torch.tensor([500.0], device=DEV), + "[b]": torch.tensor([500.0, 137.0], device=DEV), + "[b,1]": torch.tensor([[500.0], [137.0]], device=DEV), + "[1,1]": torch.tensor([[500.0]], device=DEV), + } + for tag, ts in shapes.items(): + with torch.no_grad(): + ref = arope_forward(dit, bt["x"], ts, bt["ctx"], offset_px=bt["off"], + mask_input=bt["msk"], context_ids=bt["ids"]) + out = model(bt["x"], ts, bt["ctx"], context_ids=bt["ids"], offset_px=bt["off"], + mask_input=bt["msk"]) + _eq(ref, out, f"timestep {tag}") + + # 多出来的那一个:[b, f] 逐 cell(BLOCKER B3),上游必须拒收 + with torch.no_grad(): + out = model(bt["x"], bt["ts"].float(), bt["ctx"], context_ids=bt["ids"], + offset_px=bt["off"], mask_input=bt["msk"]) + assert out.shape == bt["x"].shape + with pytest.raises(AssertionError): + with torch.no_grad(): + arope_forward(dit, bt["x"], bt["ts"].float(), bt["ctx"], offset_px=bt["off"], + mask_input=bt["msk"], context_ids=bt["ids"]) + + +# -------------------------------------------------------------------------- +# 3. f_start != 0(BLOCKER B2) +# -------------------------------------------------------------------------- + +def test_f_start_on_table_lookup_branch(bf16): + """`offset_win=None` 的 rollout 走的是查表分支,它的 f_start 与带偏移的那条分支是两段代码。""" + dit, _ = bf16 + h, w = LAT_H // 2, LAT_W // 2 + three = build_world_freqs(dit, 3, h, w, None, device=DEV, f_start=0) + assert torch.equal(three, upstream_build_world_freqs(dit, 3, h, w, None, device=DEV)) + seg2 = build_world_freqs(dit, 1, h, w, None, device=DEV, f_start=2) + assert torch.equal(seg2, three[2 * h * w:3 * h * w]), "查表分支的 f_start 没挪时间轴" + assert not torch.equal(seg2, build_world_freqs(dit, 1, h, w, None, device=DEV, f_start=0)) + with pytest.raises(AssertionError): # 越界必须炸,不能静默截断 + build_world_freqs(dit, 1, h, w, None, device=DEV, f_start=dit.freqs[0].shape[0]) + + +def _rollout(model, bt, f, kv_window, rope_cap, sink=0, commit=True): + """按 PORT_SPEC 的窗口锚定约定跑一条 rollout,返回 (拼好的输出, 每个 cell 的 tpos)。""" + cache = unwrap(model).init_kv_cache(kv_window=kv_window, sink_size=sink, rope_cap=rope_cap) + outs, tpos = [], [] + for k in range(f): + k0 = cache["k"][0] + n_cached = 0 if k0 is None else k0.shape[1] // HW + a = k - n_cached # 窗口里最老那个 cell 的绝对序号 + ow = bt["off"][:, a:k + 1] - bt["off"][:, a:a + 1] # 锚定:ow[:,0] 恒为 0 + mk = known_mask(ow / PX_PER_LATENT, LAT_H, LAT_W).to(bt["off"].dtype).unsqueeze(1)[:, :, -1:] + tpos.append(n_cached) + with torch.no_grad(): + outs.append(model(bt["x"][:, :, k:k + 1], bt["ts"][:, k:k + 1], bt["ctx"][:, k:k + 1], + context_ids=bt["ids"][:, k:k + 1], frame_index=k, kv_cache=cache, + offset_win=ow, mask_in_k=mk, first_frame_cond=False, commit=commit)) + return torch.cat(outs, dim=2), tpos + + +def test_stream_matches_parallel_causal_float64(f64): + """绝对模式的 `forward_frame` 逐 cell 展开 == 全片段块因果并行前向(float64,PORT_SPEC S4)。 + 这是 f_start != 0 唯一的端到端证据:cell k 的时间位是 k,只测 cell 0 的话恒等于 0,测了等于没测。 + + **必须 float64(或至少 fp32)**:实测真 5B 上 fp32 两条路差 2e-6,bf16 差 2.4e-2 —— 后者是 + "390 token 一次注意力" 与 "8190 token 带掩码一次注意力" 的舍入差,逐 cell 平坦、不累积, + 但足以淹没任何真实 bug。拿 bf16 写这个门禁等于没写。""" + _, model = f64 + f = 6 + bt = _batch(1, f, torch.float64, seed=21) + with torch.no_grad(): + ref = model(bt["x"], bt["ts"], bt["ctx"], context_ids=bt["ids"], offset_px=bt["off"], + mask_input=bt["msk"], first_frame_cond=False) + out, tpos = _rollout(model, bt, f, kv_window=None, rope_cap=20) + assert tpos == list(range(f)), f"绝对模式的时间位应为 0..{f - 1},得到 {tpos}" + d = [(out[:, :, k] - ref[:, :, k]).abs().max().item() for k in range(f)] + assert max(d) < 1e-9, f"流式与并行不等价:per-cell max|Δ| = {d}" + + +def test_stream_negative_control_f_start_pinned_to_zero(f64, monkeypatch): + """反向对照:把 f_start 钉死成 0(= 上游 build_world_freqs 的行为),cell>=1 必须显著偏离。 + 没有这条,上面那个等价测试可能只是在测"两边都错得一样"。""" + _, model = f64 + f = 6 + bt = _batch(1, f, torch.float64, seed=21) + with torch.no_grad(): + ref = model(bt["x"], bt["ts"], bt["ctx"], context_ids=bt["ids"], offset_px=bt["off"], + mask_input=bt["msk"], first_frame_cond=False) + orig = AD.build_world_freqs + monkeypatch.setattr(AD, "build_world_freqs", + lambda dit, f_, h, w, offset_tok=None, device=None, f_start=0, angle=None, scale=None: + orig(dit, f_, h, w, offset_tok, device, 0)) + out, _ = _rollout(model, bt, f, kv_window=None, rope_cap=20) + d = [(out[:, :, k] - ref[:, :, k]).abs().max().item() for k in range(f)] + assert d[0] < 1e-9, "cell 0 的 f_start 本来就是 0,不该受影响" + assert all(v > 1e-4 for v in d[1:]), f"钉死 f_start=0 之后 cell>=1 竟然没变:{d}" + + +def test_sliding_matches_absolute_before_eviction(f64): + """滑窗模式在还没驱逐(k <= 窗口)之前必须与绝对模式 **逐位相同**:锚定后的时间位就是 0..k。 + 驱逐之后必须真的不一样,否则说明 `_evict` 根本没生效。""" + _, model = f64 + f, W = 8, 3 + bt = _batch(1, f, torch.float64, seed=22) + abs_out, abs_tpos = _rollout(model, bt, f, kv_window=None, rope_cap=20) + sl_out, sl_tpos = _rollout(model, bt, f, kv_window=W, rope_cap=W) + assert abs_tpos == list(range(f)) + assert sl_tpos == [min(k, W) for k in range(f)], f"滑窗时间位没有在 {W} 处饱和:{sl_tpos}" + d = [(abs_out[:, :, k] - sl_out[:, :, k]).abs().max().item() for k in range(f)] + assert all(v == 0.0 for v in d[:W + 1]), f"驱逐之前滑窗与绝对模式就不一致:{d[:W + 1]}" + assert all(v > 1e-9 for v in d[W + 1:]), f"驱逐之后没有任何变化,_evict 没生效:{d[W + 1:]}" + + +def test_stream_guards(f64): + """三个把"能跑但是错的"变成"直接炸"的断言。""" + _, model = f64 + f = 4 + bt = _batch(1, f, torch.float64, seed=23) + cache = unwrap(model).init_kv_cache(kv_window=4, sink_size=0, rope_cap=4) + + def call(k, ow, **kw): + mk = known_mask(ow / PX_PER_LATENT, LAT_H, LAT_W).to(torch.float64).unsqueeze(1)[:, :, -1:] + return model(bt["x"][:, :, k:k + 1], bt["ts"][:, k:k + 1], bt["ctx"][:, k:k + 1], + context_ids=bt["ids"][:, k:k + 1], frame_index=k, kv_cache=cache, + offset_win=ow, mask_in_k=mk, **{"first_frame_cond": False, **kw}) + + with torch.no_grad(): + call(0, bt["off"][:, 0:1] - bt["off"][:, 0:1]) + with pytest.raises(AssertionError, match="漏 commit 或重复 commit"): + with torch.no_grad(): + call(0, bt["off"][:, 0:1] - bt["off"][:, 0:1]) + with pytest.raises(AssertionError, match="必须是 0"): # 没锚定 + with torch.no_grad(): + call(1, bt["off"][:, 1:3]) + with pytest.raises(AssertionError, match="n_cached"): # 窗口长度不对 + with torch.no_grad(): + call(1, bt["off"][:, 0:3] - bt["off"][:, 0:1]) + with pytest.raises(AssertionError, match="first_frame_cond"): # BLOCKER B1 + with torch.no_grad(): + call(1, bt["off"][:, 0:2] - bt["off"][:, 0:1], first_frame_cond=True) + + +# -------------------------------------------------------------------------- +# 4. 逐 cell 对位:条件绝不能串到别的 cell 上 +# -------------------------------------------------------------------------- + +def _perturb(bt, field, cell): + b2 = {k: (v.clone() if torch.is_tensor(v) else v) for k, v in bt.items()} + if field == "off": + b2["off"][:, cell] += 37.0 + b2["msk"] = known_mask(b2["off"] / PX_PER_LATENT, LAT_H, LAT_W).to(b2["off"].dtype).unsqueeze(1) + elif field == "msk": + b2["msk"][:, :, cell] = 1.0 - b2["msk"][:, :, cell] + elif field == "ctx": + b2["ctx"][:, cell] += 1.0 + b2["ids"][:, cell] = 999 + elif field == "ts": + b2["ts"][:, cell] = 7.0 + elif field == "x": + b2["x"][:, :, cell] += 1.0 + return b2 + + +@pytest.mark.parametrize("field", ["off", "msk", "ctx", "ts", "x"]) +def test_per_cell_conditioning_alignment_causal(f64, field): + """块因果下 cell j 只看得到 cell <= j。改 cell 3 的任何一条 conditioning, + cell 0/1/2 的输出必须 **精确** 不变 —— 差一个 cell 的错位在这里立刻现形。""" + _, model = f64 + f, cell = 6, 3 + bt = _batch(1, f, torch.float64, seed=24) + + def run(b_): + with torch.no_grad(): + return model(b_["x"], b_["ts"], b_["ctx"], context_ids=b_["ids"], offset_px=b_["off"], + mask_input=b_["msk"], first_frame_cond=False) + + ref = run(bt) + out = run(_perturb(bt, field, cell)) + d = [(out[:, :, j] - ref[:, :, j]).abs().max().item() for j in range(f)] + assert all(v == 0.0 for v in d[:cell]), f"{field}@{cell} 影响到了更早的 cell:{d[:cell]}" + assert d[cell] > 0.0, f"{field}@{cell} 对本 cell 完全没影响,这条 conditioning 没接上:{d}" + if field == "x": + # 双向自注意力被块因果掩掉之后,改 noisy 输入只能影响它自己那一格之后的 cell + assert d[cell + 1] > 0.0 + + +@pytest.mark.parametrize("field,expect_self", [("ctx", True), ("off", True), ("msk", True)]) +def test_teacher_forcing_stream_alignment(f64, field, expect_self): + """TF 双流:context / freqs / mask 都是 `cat([clean, noisy])` 拼出来的,拼错顺序就会把 + clean 半流的条件套到 noisy 半流上。noisy cell 3 之前的输出必须精确不变。""" + _, model = f64 + f, cell = 6, 3 + bt = _batch(1, f, torch.float64, seed=25) + g = torch.Generator(device="cpu").manual_seed(99) + x0 = torch.randn(1, C, f, LAT_H, LAT_W, generator=g).to(DEV, torch.float64) + + def run(b_, clean=x0): + with torch.no_grad(): + return model(b_["x"], b_["ts"], b_["ctx"], context_ids=b_["ids"], offset_px=b_["off"], + mask_input=b_["msk"], first_frame_cond=False, clean_x=clean, aug_t=None) + + ref = run(bt) + assert ref.shape == bt["x"].shape, "TF 只应返回 noisy 半流" + out = run(_perturb(bt, field, cell)) + d = [(out[:, :, j] - ref[:, :, j]).abs().max().item() for j in range(f)] + assert all(v == 0.0 for v in d[:cell]), f"TF {field}@{cell} 串到了更早的 cell:{d[:cell]}" + if expect_self: + assert d[cell] > 0.0, f"TF {field}@{cell} 对本 cell 没影响:{d}" + + +def test_teacher_forcing_no_same_cell_leak(f64): + """clean cell f 是 noisy cell f 的答案。掩码写错一格 ⇒ loss 掉到 0、rollout 是坏的。""" + _, model = f64 + f, cell = 6, 3 + bt = _batch(1, f, torch.float64, seed=25) + g = torch.Generator(device="cpu").manual_seed(99) + x0 = torch.randn(1, C, f, LAT_H, LAT_W, generator=g).to(DEV, torch.float64) + x0b = x0.clone() + x0b[:, :, cell] += 1.0 + + def run(clean): + with torch.no_grad(): + return model(bt["x"], bt["ts"], bt["ctx"], context_ids=bt["ids"], offset_px=bt["off"], + mask_input=bt["msk"], first_frame_cond=False, clean_x=clean, aug_t=None) + + d = [(run(x0b)[:, :, j] - run(x0)[:, :, j]).abs().max().item() for j in range(f)] + assert all(v == 0.0 for v in d[:cell + 1]), f"clean cell {cell} 泄漏进了 noisy cell <= {cell}:{d}" + assert d[cell + 1] > 0.0, f"clean cell {cell} 没有作为历史喂给 noisy cell {cell + 1}:{d}" + + +def test_context_ids_are_authoritative_not_content(f64): + """`_embed_context` 只信 `context_ids`,**不看内容**:同 id 的若干行会被折叠成 **第一行**。 + + 这是上游 arope.py 的契约(`_dedup_rows`),本文件原样继承。钉住它是因为它的错法极其隐蔽: + id 与行内容对不上时,并行前向(21 行、按 id 折叠)会拿 cell 0 的文本喂给所有 cell,而流式前向 + (每次只喂 1 行)拿的是各自的文本 —— 实测真 5B 上两条路会差 rel_l2 ≈ 0.3,输出照样有限、 + 像模像样。stage3 的 `extend_context` / `window_context` 必须让 ids 与行 **索引锁死**。""" + _, model = f64 + f = 5 + bt = _batch(1, f, torch.float64, seed=27) # 逐 cell 内容互不相同 + lying = torch.zeros(1, f, dtype=torch.int64, device=DEV) # 谎报:全同 id + with torch.no_grad(): + collapsed = model(bt["x"], bt["ts"], bt["ctx"], context_ids=lying, offset_px=bt["off"], + mask_input=bt["msk"], first_frame_cond=False) + cell0_only = model(bt["x"], bt["ts"], bt["ctx"][:, 0], context_ids=None, offset_px=bt["off"], + mask_input=bt["msk"], first_frame_cond=False) + honest = model(bt["x"], bt["ts"], bt["ctx"], context_ids=bt["ids"], offset_px=bt["off"], + mask_input=bt["msk"], first_frame_cond=False) + assert (collapsed - cell0_only).abs().max().item() < 1e-12, "谎报 id 之后不是折叠到第一行" + assert (honest - collapsed).abs().max().item() > 1e-3, "诚实 id 与谎报 id 输出一样,说明文本根本没进模型" + + +def test_per_cell_context_equals_shared_context(f64): + """21 条 cell 文本完全相同 ⇒ 与整条 [b,L,4096] 模式等价(只差 SDPA 分批的舍入)。 + 去重 / 重排 / f_cross 三处里任意一处错位,这里都会炸开到 1e-1 量级。""" + _, model = f64 + f = 5 + bt = _batch(1, f, torch.float64, seed=26, per_cell_ids=False) + with torch.no_grad(): + a = model(bt["x"], bt["ts"], bt["ctx"], context_ids=bt["ids"], offset_px=bt["off"], + mask_input=bt["msk"], first_frame_cond=False) + b = model(bt["x"], bt["ts"], bt["ctx"][:, 0], context_ids=None, offset_px=bt["off"], + mask_input=bt["msk"], first_frame_cond=False) + assert (a - b).abs().max().item() < 1e-12, f"逐 cell 与整条文本不等价:{(a - b).abs().max().item():.3e}" + + +if __name__ == "__main__": + raise SystemExit(pytest.main([__file__, "-q", "-s"])) diff --git a/backup_2026-09-14/code/distill/tests/test_kv_equiv.py b/backup_2026-09-14/code/distill/tests/test_kv_equiv.py new file mode 100644 index 0000000000000000000000000000000000000000..8f44d14cbfaffe7db649bcece3f5d04bf723e19c --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_kv_equiv.py @@ -0,0 +1,546 @@ +#!/usr/bin/env python3 +"""滑窗 KV 缓存闸门(stage3 的硬闸)——`forward_frame` 的流式单 cell 前向必须与整段 +块因果并行前向**同一个函数**,滑窗只是在它上面加一个有界的注意力集合。 + + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest \\ + /data/zhiyangdeng/ActionRoPE/distill/tests/test_kv_equiv.py -q -s + # 或直接当脚本跑 + +移植自 `_wm/WorldMind/distill/_scheme2_docs/code/distill/test_kv_cache_equiv.py` 与 +`test_sliding_kv.py`(两份都缺 `import os` 跑不起来),并按 ActionRoPE 的重新设计补齐四处: + +1. **窗口锚定的世界坐标**。上游只有时间轴,`tpos = min(frame_index, rope_cap)` 一个标量; + ARoPE 的 h/w RoPE 位是一直在漂的世界坐标,所以窗口里每个 cell 的 (t, offset) **一起** + 减去窗口里最老那一格(`preflight.window_offsets_for_frame`)。等价性因此从"时间位连续" + 变成"整窗平移不变"——`tests/test_world_rope_window.py` 单独证那一条,这里证端到端数值。 +2. **f_start != 0 必须被真的走到**。`build_world_freqs(..., f_start=tpos)` 是 BLOCKER B2 的产物; + 只测 frame 0 的话 f_start 恒为 0,测了等于没测。本文件用 spy 记下每次调用的 f_start, + 断言 freqs_cur 的 f_start 恰好覆盖 0..F-1(滑窗时饱和在 rope_cap)。 +3. **多步去噪 + 单次提交**。部署是 4 步(1000/750/500/250)去噪、然后把干净 latent 以 t=0 + 提交进缓存。中间趟必须 commit=False(否则同一个 cell 被塞进缓存 5 遍,n_cached 与驱逐全乱), + 提交趟必须恰好一次、且 t=0。本文件按真实部署表跑一遍并逐次核对。 +4. **三条守卫必须炸**。重复的 frame_index / 同一个 cell 提交两次 / 未锚定的 offset_win。 + 上游那份"负控制"是让 frame_index 恒为 0 然后看数值是否发散;这里它直接被断言拦住, + 这是更强的保证(发散量是数值问题,断言是结构问题)。 + +几何:tiny 模型(dim 128 / 2 层 / 4 头),latent 8×10 ⇒ patch 后 4×5 = 20 token/cell,F=5 cell。 +真实规模是 hw=390、F=21、kv_window=20 —— 算术完全一样。全程 float64:等价性是 1e-15 还是 +1e-7 决定了它是"同一个函数"还是"差不多的两个函数"。 +""" +from __future__ import annotations + +import os +import sys +import types + +import pytest +import torch + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.arope import PX_PER_LATENT, known_mask # noqa: E402 +from distill import arope_dit as AD # noqa: E402 +from distill.arope_dit import AropeDiT, unwrap # noqa: E402 +from distill.flow_pf import DEPLOY_DENOISE_LIST, deploy_schedule # noqa: E402 +from distill.tests.preflight import cache_len, tiny_dit, window_offsets_for_frame # noqa: E402 + +DEV = "cuda" if torch.cuda.is_available() else "cpu" +DT = torch.float64 # 1e-15 与 1e-7 是两个不同的结论,必须 float64 +B, C, F, LH, LW, L_TXT = 1, 48, 5, 8, 10, 8 # latent 8×10 → patch 后 4×5 +HW = (LH // 2) * (LW // 2) # 20 token/cell(真实几何 390) +# 实测步速 (69.24, 46.01) px/s ÷ 4(一个 cell = 4 帧 / 16 fps = 0.25 s)= 逐 cell 位移 +PER_CELL_PX = (17.31, 11.50) +REAL_HW, REAL_F, REAL_KW = 390, 21, 20 # 只用于报告里的对照 + +TOL_EQUIV = 1e-12 # 实测 ~1.5e-15;留三个数量级余量 +TOL_DIVERGE = 1e-6 # 驱逐必须造成**结构性**差异,不是舍入 + + +# ---------------------------------------------------------------------------- +# 夹具 +# ---------------------------------------------------------------------------- + +def _model() -> AropeDiT: + """与 test_tf_port 同一份 tiny 几何(dim 128 / 4 头 ⇒ head_dim 32,RoPE 三段 6+5+5=16 ✓)。""" + dit = tiny_dit(seed=1234, device=DEV, dtype=DT, + dim=128, ffn_dim=256, num_heads=4, num_layers=2) + return AropeDiT(dit=dit, mask_channel=True, causal=True) + + +def _inputs(seed: int = 7) -> dict: + g = torch.Generator().manual_seed(seed) + x = torch.randn(B, C, F, LH, LW, generator=g).to(device=DEV, dtype=DT) + ctx = torch.randn(B, F, L_TXT, 4096, generator=g).to(device=DEV, dtype=DT) + # 逐 cell **不同** 的文本:整条相同的话 cross-attn 的分组对不对根本测不出来 + ids = torch.arange(F, device=DEV, dtype=torch.int64).unsqueeze(0) + # cell 0 = 0(世界坐标锚点),之后按实测步速匀速直行 + 抖动 —— 与真实 clip 同量级 + per = torch.tensor(PER_CELL_PX).view(1, 1, 2) + off = torch.zeros(B, F, 2) + off[:, 1:] = (per + torch.randn(B, F - 1, 2, generator=g) * 4.0).cumsum(1) + off = off.to(device=DEV, dtype=torch.float32) + mask_in = known_mask(off / PX_PER_LATENT, LH, LW).to(torch.float32).unsqueeze(1) + # cell 0 干净(TI2V 锚点,t=0),其余逐 cell 不同噪声档 + ts_pf = torch.tensor([[0.0, 900.0, 700.0, 400.0, 150.0]], device=DEV, dtype=DT) + # 两条非平凡性前提:世界坐标要漂过至少一个 latent 格,known 掩码要真的有 0 也有 1, + # 否则"世界坐标 RoPE"和"mask 通道"这两路条件在本测试里等于没接,等价性是白测的。 + assert float(off.abs().max()) > PX_PER_LATENT, f"偏移太小({float(off.abs().max()):.1f} px)" + assert 0.0 < float(mask_in.mean()) < 1.0, "known 掩码全 0 或全 1,new 区没被覆盖到" + return dict(x=x, ctx=ctx, ids=ids, off=off, mask_in=mask_in, ts_pf=ts_pf) + + +@pytest.fixture(scope="module") +def m(): + return _model() + + +@pytest.fixture(scope="module") +def d(): + return _inputs() + + +# ---------------------------------------------------------------------------- +# rollout 工具:与 stage3 的调用口径完全一致 +# ---------------------------------------------------------------------------- + +def _frame_kwargs(d: dict, k: int, sink_size: int, kv_window): + """一个 cell 的三路条件:窗口锚定的 offset_win / 由锚定 offset 现算的 mask / 逐 cell 文本。""" + ow = window_offsets_for_frame(d["off"], k, sink_size, kv_window) # [b, n_cached+1, 2] + # mask_in_k 只能是**当前 cell** 那一格([b,1,1,H,W])。传整窗的话 patch_embedding 的 + # 输出 [b,dim,1,h,w] 会与 [b,dim,n+1,h,w] 广播成 n+1 帧 —— arope_dit.py:618 的断言拦这个。 + mk = known_mask(ow[:, -1:] / PX_PER_LATENT, LH, LW).to(torch.float32).unsqueeze(1) + return dict(offset_win=ow, mask_in_k=mk, + context_ids=d["ids"][:, k:k + 1], first_frame_cond=False) + + +def _rollout(m: AropeDiT, d: dict, *, kv_window=None, sink_size: int = 0, rope_cap: int = 0, + n: int = F): + """每个 cell 一次 commit=True 前向(等价性测试的口径:一趟就是最终结果)。""" + cache = unwrap(m).init_kv_cache(kv_window=kv_window, sink_size=sink_size, rope_cap=rope_cap) + outs = [] + for k in range(n): + with torch.no_grad(): + outs.append(m(d["x"][:, :, k:k + 1], d["ts_pf"][:, k], d["ctx"][:, k:k + 1], + frame_index=k, kv_cache=cache, commit=True, + **_frame_kwargs(d, k, sink_size, kv_window))) + return torch.cat(outs, dim=2), cache + + +def _parallel(m: AropeDiT, d: dict) -> torch.Tensor: + """整段块因果并行前向 —— 参照物。first_frame_cond=True 抹的正好是 ts_pf[:,0](本来就是 0)。""" + with torch.no_grad(): + return m(d["x"], d["ts_pf"], d["ctx"], context_ids=d["ids"], offset_px=d["off"], + mask_input=d["mask_in"], first_frame_cond=True) + + +class _FreqSpy: + """按**调用顺序**记下每次 build_world_freqs 的 (f, f_start)。 + + 不能靠 f==1 来区分 freqs_cur / freqs_hist:cell 1 的历史正好也只有 1 个 cell, + 两者的 f 都是 1。所以直接核对整条调用序列——它同时钉死了顺序、分段和 f_start。 + """ + + def __init__(self, monkeypatch): + self.calls: list[tuple[int, int]] = [] + orig = AD.build_world_freqs + + def spy(dit, f, h, w, offset_tok=None, device=None, f_start=0, angle=None, scale=None): + self.calls.append((int(f), int(f_start))) + return orig(dit, f, h, w, offset_tok, device=device, f_start=f_start, angle=angle, scale=scale) + + monkeypatch.setattr(AD, "build_world_freqs", spy) + + def reset(self): + self.calls.clear() + + +def _expected_freq_calls(n: int, kv_window=None, sink_size: int = 0) -> list[tuple[int, int]]: + """rollout 期间 build_world_freqs 应该被怎么调(sink=0): + + cell k: (f=1, f_start=tpos) 当前 cell,时间位 tpos = n_cached + (f=n_cached, f_start=0) 历史段,锚定到窗口最老那一格 ⇒ 从 0 起算 + tpos 在滑窗下饱和在 rope_cap = sink + kv_window —— 这正是"窗口锚定"的定义。 + """ + assert sink_size == 0, "本 helper 只覆盖部署配置 sink_size=0" + exp = [] + for k in range(n): + n_cached = cache_len(k, sink_size, kv_window) + exp.append((1, n_cached)) + if n_cached > 0: + exp.append((n_cached, 0)) + return exp + + +# ---------------------------------------------------------------------------- +# 1. 绝对模式的 forward_frame == 整段块因果并行前向 +# ---------------------------------------------------------------------------- + +def test_1_absolute_rollout_equals_parallel(monkeypatch, m, d): + spy = _FreqSpy(monkeypatch) + o_par = _parallel(m, d) + assert spy.calls == [(F, 0)], f"并行路径应只建一张 {F} 帧的 RoPE 表,实测 {spy.calls}" + spy.reset() + o_abs, cache = _rollout(m, d) + + per = [float((o_par[:, :, k] - o_abs[:, :, k]).abs().max()) for k in range(F)] + scale = float(o_par.abs().max()) + assert tuple(o_abs.shape) == tuple(o_par.shape) == (B, C, F, LH, LW) + for k, v in enumerate(per): + assert v < TOL_EQUIV, ( + f"cell {k}: 流式与并行差 {v:.3e} —— 两条路径不是同一个函数了" + "(查 freqs 的 f_start / 锚定 offset / 掩码集合)") + assert cache["frames_cached"] == F, f"frames_cached={cache['frames_cached']} != {F}" + print(f"1. equiv absolute forward_frame == 整段块因果并行:per-cell max|Δ| " + f"{[f'{v:.2e}' for v in per]}(相对 {max(per) / scale:.2e},float64)") + + # f_start != 0 必须被真的走到:只覆盖 frame 0 的话 f_start 恒为 0,这个测试是白测的 + exp = _expected_freq_calls(F, kv_window=None) + assert spy.calls == exp, f"RoPE 分段调用序列不对:\n 实测 {spy.calls}\n 应为 {exp}" + assert max(fs for f, fs in spy.calls) == F - 1 > 0, \ + "f_start 从没超过 0 —— 单 cell 的时间位没接上(BLOCKER B2 回归)" + print(f" f_start build_world_freqs 调用序列 {spy.calls}" + f"((f, f_start);当前 cell 走到 f_start={F - 1},历史段恒从 0 起算;" + f"真实规模 f_start 饱和在 {REAL_KW})") + + +# ---------------------------------------------------------------------------- +# 2. 滑窗且不驱逐(kv_window >= F-1)== 绝对模式,逐位相同 +# ---------------------------------------------------------------------------- + +def test_2_sliding_without_eviction_is_bitwise_absolute(m, d): + o_abs, _ = _rollout(m, d) + kw = F - 1 # rollout 全程 n_cached <= kw,不会驱逐 + o_slide, cache = _rollout(m, d, kv_window=kw, sink_size=0, rope_cap=kw) + assert torch.equal(o_abs, o_slide), ( + f"滑窗(无驱逐)与绝对模式不逐位相同:max|Δ|={float((o_abs - o_slide).abs().max()):.3e}。" + "两者此时的 f_start / 锚定 offset / 注意力集合本应完全一致") + # 最后一帧提交之后缓存才第一次超出窗口并被裁到 kw,不影响任何一个输出 + assert cache["k"][0].shape[1] // HW == kw + print(f"2. no-evict sliding(kv_window={kw}=F-1, sink=0) == absolute:逐位相同 " + f"(torch.equal);提交完缓存收在 {kw} cell") + + +# ---------------------------------------------------------------------------- +# 3. 滑窗且驱逐(kv_window=2):驱逐前逐位相同,驱逐后必须真的不同 +# ---------------------------------------------------------------------------- + +def test_3_sliding_with_eviction(monkeypatch, m, d): + o_abs, _ = _rollout(m, d) + kw = 2 + spy = _FreqSpy(monkeypatch) + o_ev, cache = _rollout(m, d, kv_window=kw, sink_size=0, rope_cap=kw) + assert torch.isfinite(o_ev).all(), "驱逐路径产生了 NaN/Inf" + + # 时间位 tpos 必须饱和在 rope_cap:这就是"窗口锚定"——第 4 个 cell 与第 3 个 cell + # 看到的相对时间几何完全一样,都是"一段从自己 cell 0 起算的短 clip" + exp = _expected_freq_calls(F, kv_window=kw) + assert spy.calls == exp, f"滑窗的 RoPE 分段序列不对:\n 实测 {spy.calls}\n 应为 {exp}" + assert max(fs for f, fs in spy.calls) == kw, "tpos 没有饱和在 rope_cap" + + # 缓存在提交 cell 2 时第一次超限(3 > 0+2)并丢掉 cell 0 ⇒ cell 0,1,2 的**输出**不受影响 + pre = max(float((o_abs[:, :, k] - o_ev[:, :, k]).abs().max()) for k in range(kw + 1)) + post = max(float((o_abs[:, :, k] - o_ev[:, :, k]).abs().max()) for k in range(kw + 1, F)) + assert pre < 1e-9, f"驱逐改变了驱逐之前的 cell(max|Δ|={pre:.3e})—— 提交时机错了" + assert post > TOL_DIVERGE, ( + f"驱逐对之后的 cell 完全没影响(max|Δ|={post:.3e})—— 窗口根本没在滑," + "或者 _evict 丢掉的不是最老那一格") + assert cache["k"][0].shape[1] // HW == kw, "缓存没有被限制在 kv_window 内" + for k in range(F): + assert cache_len(k, 0, kw) == min(k, kw) + print(f"3. evict sliding(kv_window={kw}, sink=0):cell 0..{kw} 与 absolute 差 {pre:.2e}(驱逐前);" + f"cell {kw + 1}..{F - 1} 差 {post:.2e}(驱逐确实生效);缓存恒 ≤ {kw} cell;" + f"tpos 饱和在 {kw}({[fs for f, fs in spy.calls]})") + + +# ---------------------------------------------------------------------------- +# 4-6. 三条守卫必须炸 +# ---------------------------------------------------------------------------- + +def test_4_guard_duplicate_frame_index(m, d): + """上游的"负控制"(frame_index 恒为 0)在这里不是数值发散,而是直接被断言拦住。""" + cache = unwrap(m).init_kv_cache(kv_window=None, sink_size=0, rope_cap=0) + with torch.no_grad(): + m(d["x"][:, :, 0:1], d["ts_pf"][:, 0], d["ctx"][:, 0:1], + frame_index=0, kv_cache=cache, commit=True, **_frame_kwargs(d, 0, 0, None)) + with pytest.raises(AssertionError, match="frame_index"): + # 第二个 cell 仍报 frame_index=0:缓存里已经有 1 个 cell,对不上 + m(d["x"][:, :, 1:2], d["ts_pf"][:, 1], d["ctx"][:, 1:2], + frame_index=0, kv_cache=cache, commit=True, **_frame_kwargs(d, 0, 0, None)) + print("4. guard 重复的 frame_index(上游的负控制)被断言拦住: True") + + +def test_5_guard_double_commit(m, d): + """同一个 cell 提交两次 = 它在缓存里出现两遍,n_cached 与驱逐从此全错,而且不会报错。""" + cache = unwrap(m).init_kv_cache(kv_window=2, sink_size=0, rope_cap=2) + with torch.no_grad(): + for k in range(2): + m(d["x"][:, :, k:k + 1], d["ts_pf"][:, k], d["ctx"][:, k:k + 1], + frame_index=k, kv_cache=cache, commit=True, **_frame_kwargs(d, k, 0, 2)) + with pytest.raises(AssertionError, match="commit"): + m(d["x"][:, :, 1:2], d["ts_pf"][:, 1], d["ctx"][:, 1:2], + frame_index=1, kv_cache=cache, commit=True, **_frame_kwargs(d, 1, 0, 2)) + print("5. guard 同一个 frame_index 提交两次被断言拦住: True") + + +def _saturated_cache(m, d, kw: int): + """kv_window=kw、commit 0..kw+1 之后的缓存:n_cached 已饱和在 kw(提交成了 _evict 的不动点)。""" + cache = unwrap(m).init_kv_cache(kv_window=kw, sink_size=0, rope_cap=kw) + with torch.no_grad(): + for k in range(kw + 2): + m(d["x"][:, :, k:k + 1], d["ts_pf"][:, k], d["ctx"][:, k:k + 1], + frame_index=k, kv_cache=cache, commit=True, **_frame_kwargs(d, k, 0, kw)) + assert cache["k"][0].shape[1] // HW == kw and cache["frames_cached"] == kw + 2 + return cache + + +def test_5b_guard_saturated_cache_duplicate_commit_and_skipped_cell(m, d): + """GEO-3:缓存饱和后 `n_cached == min(frame_index, cap)` 恒为 cap == cap,test_5 依赖的那条 + 谓词从此拦不住任何东西 —— 重复提交 / 漏提交都只改**内容**不改形状。forward_frame 入口必须 + 另查 `frames_cached == frame_index`(最后提交的 cell 编号 + 1),否则 stage3 专门训练的 + 驱逐区会被将来的编辑(重开 re-anchor、提前 continue)静默弄坏。""" + kw = 2 + # (a) commit 0..3 之后重提 cell 3:n_cached 仍是 2 == min(3, 2),只有 frames_cached 看得出来 + cache = _saturated_cache(m, d, kw) + with torch.no_grad(), pytest.raises(AssertionError, match="commit"): + m(d["x"][:, :, 3:4], d["ts_pf"][:, 3], d["ctx"][:, 3:4], + frame_index=3, kv_cache=cache, commit=True, **_frame_kwargs(d, 3, 0, kw)) + # (b) 跳过 cell 4 直接读 cell 5:同样 n_cached == 2 == min(5, 2) + cache = _saturated_cache(m, d, kw) + d6 = dict(d) # 语料只有 F=5 个 cell,给 cell 5 补一格世界坐标 / 文本 id + per = torch.tensor(PER_CELL_PX, device=DEV, dtype=d["off"].dtype).view(1, 1, 2) + d6["off"] = torch.cat([d["off"], d["off"][:, -1:] + per], dim=1) + d6["ids"] = torch.arange(6, device=DEV, dtype=torch.int64).unsqueeze(0) + with torch.no_grad(), pytest.raises(AssertionError, match="frame_index"): + m(d["x"][:, :, 4:5], d["ts_pf"][:, 4], d["ctx"][:, 4:5], + frame_index=5, kv_cache=cache, commit=False, **_frame_kwargs(d6, 5, 0, kw)) + print("5b. guard 饱和缓存下的重复提交 / 漏提交都被 frames_cached 断言拦住: True") + + +def test_6_guard_unanchored_offset_win(m, d): + """offset_win 必须锚定([:,0] == 0)。没锚定 = 整窗世界坐标偏了一个常量: + RoPE 分数不变(test_world_rope_window 证的就是这条),但 mask / known 区与训练时不一致, + 而且一旦 sink>0 就连分数都不再等价。所以这里要求它**结构上**是锚定的。""" + cache = unwrap(m).init_kv_cache(kv_window=2, sink_size=0, rope_cap=2) + kw0 = _frame_kwargs(d, 0, 0, 2) + with torch.no_grad(): + m(d["x"][:, :, 0:1], d["ts_pf"][:, 0], d["ctx"][:, 0:1], + frame_index=0, kv_cache=cache, commit=True, **kw0) + bad = _frame_kwargs(d, 1, 0, 2) + # 未锚定的世界坐标:整窗加一个常量,于是 offset_win[:,0] != 0。 + # (直接用 d["off"][:, 0:2] 是不行的——数据集的 off[0] 本来就是 0,看起来"恰好锚定"。) + bad["offset_win"] = d["off"][:, 0:2] + 5.0 + with pytest.raises(AssertionError, match="offset_win"): + m(d["x"][:, :, 1:2], d["ts_pf"][:, 1], d["ctx"][:, 1:2], + frame_index=1, kv_cache=cache, commit=True, **bad) + print("6. guard 未锚定的 offset_win([:,0] != 0)被断言拦住: True") + + +# ---------------------------------------------------------------------------- +# 7. 中间去噪趟(commit=False)绝不能污染缓存 +# ---------------------------------------------------------------------------- + +def test_7_commit_false_does_not_pollute(m, d): + cache = unwrap(m).init_kv_cache(kv_window=None, sink_size=0, rope_cap=0) + with torch.no_grad(): + m(d["x"][:, :, 0:1], d["ts_pf"][:, 0], d["ctx"][:, 0:1], frame_index=0, + kv_cache=cache, commit=True, **_frame_kwargs(d, 0, 0, None)) + k_after0 = cache["k"][0].clone() + for t_val in (900.0, 400.0): + m(d["x"][:, :, 1:2], torch.full((B,), t_val, device=DEV, dtype=DT), d["ctx"][:, 1:2], + frame_index=1, kv_cache=cache, commit=False, **_frame_kwargs(d, 1, 0, None)) + k_before = cache["k"][0].clone() + assert cache["frames_cached"] == 1, "commit=False 推进了 frames_cached" + m(d["x"][:, :, 1:2], d["ts_pf"][:, 1], d["ctx"][:, 1:2], frame_index=1, + kv_cache=cache, commit=True, **_frame_kwargs(d, 1, 0, None)) + assert torch.equal(k_after0, k_before), "commit=False 污染了缓存" + assert cache["k"][0].shape[1] == 2 * k_after0.shape[1], "commit=True 没有让缓存长一个 cell" + assert cache["frames_cached"] == 2 + print("7. commit commit=False 不改缓存、commit=True 长一个 cell: True") + + +# ---------------------------------------------------------------------------- +# 8. 真实部署表:4 步去噪 + 每个 frame_index 恰好一次 t=0 的提交 +# ---------------------------------------------------------------------------- + +def test_8_deploy_schedule_single_commit_at_t0(monkeypatch, m, d): + """按用户拍板的部署表(1000/750/500/250)跑一遍 AR rollout,逐次核对提交口径。 + + 这是 stage3 rollout 的骨架:中间趟 commit=False(只读缓存),拿到干净 latent 之后 + 以 **t=0** 提交一次。提交趟的时间步必须是 0——缓存里存的是"干净历史",用带噪时间步提交 + 等于把噪声档写进历史,rollout 会照跑、loss 会照降。 + """ + _, sig, t_grid = deploy_schedule(device=DEV) + K = len(t_grid) + assert tuple(float(t) for t in DEPLOY_DENOISE_LIST) == (1000.0, 750.0, 500.0, 250.0) + + seen: list[tuple[int, bool, float]] = [] + orig = AropeDiT.forward_frame + + def spy(self, x_k, t_k, ctx_k, frame_index, kv_cache, commit=True, **kw): + seen.append((int(frame_index), bool(commit), + float(torch.as_tensor(t_k).reshape(-1)[0]))) + return orig(self, x_k, t_k, ctx_k, frame_index, kv_cache, commit, **kw) + + monkeypatch.setattr(m, "forward_frame", types.MethodType(spy, m), raising=False) + + cache = unwrap(m).init_kv_cache(kv_window=None, sink_size=0, rope_cap=0) + zero = torch.zeros(B, device=DEV, dtype=DT) + sig_path = [float(s) for s in sig] + [0.0] # 最后一步走到 sigma=0(纯净) + gen = [] + with torch.no_grad(): + for k in range(F): + fk = _frame_kwargs(d, k, 0, None) + if k == 0: + lat = d["x"][:, :, 0:1] # cell 0 = 真实干净锚点,不去噪 + else: + lat = torch.randn(B, C, 1, LH, LW, device=DEV, dtype=DT) # 纯噪起步 + for j in range(K): + t_j = torch.full((B,), float(t_grid[j]), device=DEV, dtype=DT) + v = m(lat, t_j, d["ctx"][:, k:k + 1], frame_index=k, kv_cache=cache, + commit=False, **fk) + lat = lat + (sig_path[j + 1] - sig_path[j]) * v # flow-match 欧拉步 + assert torch.isfinite(lat).all(), f"cell {k} 去噪出现 NaN/Inf" + # 提交趟:干净 latent,t = 0,恰好一次 + m(lat, zero, d["ctx"][:, k:k + 1], frame_index=k, kv_cache=cache, commit=True, **fk) + gen.append(lat) + + commits = {} + reads = {} + for fi, c, t in seen: + (commits if c else reads).setdefault(fi, []).append(t) + assert sorted(commits) == list(range(F)), f"提交覆盖的 frame_index 是 {sorted(commits)}" + for k in range(F): + assert len(commits[k]) == 1, f"cell {k} 提交了 {len(commits[k])} 次(必须恰好 1 次)" + assert commits[k][0] == 0.0, f"cell {k} 的提交趟时间步是 {commits[k][0]},必须是 0" + assert reads.get(0, []) == [], "cell 0 是真实锚点,不该有去噪趟" + for k in range(1, F): + assert [round(t) for t in reads[k]] == [round(float(x)) for x in t_grid], \ + f"cell {k} 的去噪趟时间步 {reads[k]} 与部署表 {t_grid.tolist()} 不符" + assert cache["frames_cached"] == F + assert cache["k"][0].shape[1] // HW == F, "提交次数与缓存长度对不上" + print(f"8. deploy {K} 步部署表 {[round(float(t)) for t in t_grid]}:每个 cell " + f"{K} 次 commit=False + 恰好 1 次 t=0 的 commit;缓存 {F} cell;" + f"rollout 输出有限: {bool(torch.isfinite(torch.cat(gen, 2)).all())}") + + +# ---------------------------------------------------------------------------- +# 9. forward() 的分发守卫(流式路径的四条硬规矩) +# ---------------------------------------------------------------------------- + +def test_9_dispatch_guards(m, d): + cache = unwrap(m).init_kv_cache(kv_window=None, sink_size=0, rope_cap=0) + base = dict(frame_index=0, kv_cache=cache, commit=False, **_frame_kwargs(d, 0, 0, None)) + args = (d["x"][:, :, 0:1], d["ts_pf"][:, 0], d["ctx"][:, 0:1]) + with torch.no_grad(): + # B1:first_frame_cond 抹的是"这个张量的第 0 帧",单 cell 前向里就是全部 + with pytest.raises(AssertionError, match="first_frame_cond"): + m(*args, **{**base, "first_frame_cond": True}) + # risk 6:滑窗 commit 是破坏性的,checkpoint 重算读到的是驱逐后的缓存 + with pytest.raises(AssertionError, match="梯度检查点"): + m(*args, **base, use_gradient_checkpointing=True) + with pytest.raises(AssertionError, match="teacher forcing"): + m(*args, **base, clean_x=d["x"][:, :, 0:1]) + with pytest.raises(AssertionError, match="offset_win"): + m(*args, **{**base, "offset_px": d["off"][:, 0:1]}) + with pytest.raises(AssertionError, match="mask_in_k"): + m(*args, **{**base, "mask_input": d["mask_in"][:, :, 0:1]}) + print("9. dispatch first_frame_cond / 梯度检查点 / clean_x / offset_px / mask_input " + "五条流式守卫全部拦住: True") + + +# ---------------------------------------------------------------------------- +# 10. preflight:stage3 启动闸本身也要能跑(部署配置 sink=0 / window=20 / cap=20) +# ---------------------------------------------------------------------------- + +def test_10_preflight_deploy_config(): + from distill.tests.preflight import preflight_sliding_kv + + out = preflight_sliding_kv(0, REAL_KW, REAL_KW, log=lambda *a: None) + assert out["checked"] and out["n_cached_max"] == REAL_KW and out["n_evictions"] >= 1 + assert out["cache_cells_final"] == REAL_KW and out["evict_effect"] > 0 + with pytest.raises(RuntimeError, match="rope_cap"): + preflight_sliding_kv(0, 20, 21, log=lambda *a: None) # 破坏不变量必须炸 + print(f"10. preflight sink=0/window={REAL_KW}/cap={REAL_KW}: n_cached 饱和 {out['n_cached_max']}、" + f"驱逐 {out['n_evictions']} 次、末帧影响 {out['evict_effect']:.2e}、{out['ms']:.0f} ms;" + f"rope_cap 不变量被破坏时抛 RuntimeError: True") + + +if __name__ == "__main__": + sys.exit(pytest.main([os.path.abspath(__file__), "-q", "-s"])) + + +# ---------------------------------------------------------------- FSDP 容器重建 + +def test_11_kv_cache_survives_container_rebuild(): + """★ FSDP 混合精度会**重建** forward 的输入容器(dict/list/tuple),于是 forward_frame + 写进去的 K/V 落在一份拷贝上、调用方的 cache 永远是空的 —— 而且不报错。 + + 2 卡实测(修之前):`外层 dict is 内层 dict → False`,commit 之后外层 cell 数恒为 0。 + `init_kv_cache` 往 cache 里塞了一个自引用的 `_KVRef`(非张量,FSDP 按引用保留), + `forward` 用它把调用方那一份找回来。 + + 这里在单进程里**模拟**那次重建(浅拷贝 dict),不需要起 FSDP 就能钉住这条不变量。 + 以后有人把 `_ref` 当垃圾字段清掉,这条会红。 + """ + from distill.tests.preflight import tiny_arope_dit + m = tiny_arope_dit(causal=True, device="cpu", dtype=torch.float32) + b, c, h, w = 1, 48, 4, 4 + cache = m.init_kv_cache(kv_window=20, sink_size=0, rope_cap=20) + assert "_ref" in cache and cache["_ref"].cache is cache, "init_kv_cache 应放一个自引用句柄" + + x = torch.randn(b, c, 1, h, w) + ctx, ids = torch.randn(b, 1, 4, 4096), torch.zeros(b, 1, dtype=torch.long) + ow, mk = torch.zeros(b, 1, 2), torch.ones(b, 1, 1, h, w) + t = torch.zeros(b) + with torch.no_grad(): + # ★ 传**浅拷贝**,模拟 FSDP 的容器重建 + m(x, t, ctx, context_ids=ids, first_frame_cond=False, frame_index=0, + kv_cache=dict(cache), commit=True, offset_win=ow, mask_in_k=mk) + k0 = cache["k"][0] + assert k0 is not None, "commit 写进了拷贝 —— 自引用句柄没起作用(FSDP 下会静默地永远空缓存)" + hw = (h // 2) * (w // 2) + assert k0.shape[1] // hw == 1, f"应缓存 1 个 cell,得到 {k0.shape[1] // hw}" + + +# ---------------------------------------------------------------- stage4 OPSD:浅快照 + +def test_12_snapshot_kv_cache_is_an_independent_branch(m, d): + """stage4 OPSD 的教师上下文靠它:真值缓存滞后一格,每个打分 cell `snapshot_kv_cache(cache_r)`、把学生的 + k−1 commit 进**快照**、对快照打分。浅拷贝之所以是正确的分支:`arope_self_attn` 的 commit 用 torch.cat 造 + 新张量再**重新绑定**列表槽位,从不就地写缓存里的张量(上游 GraphGWM KVCache.clone_shallow 的同一条依据)。 + 这里钉住:commit 进快照后原缓存的槽位 / 张量 / frames_cached 全不动;快照自己带 `_ref`;释放快照不伤原缓存。""" + kw = 2 + cache = _saturated_cache(m, d, kw) # frames_cached = 4,n_cached 饱和在 2 + fc = cache["frames_cached"] + k_ids = [id(t) for t in cache["k"]] + k0 = cache["k"][0].clone() + snap = AD.snapshot_kv_cache(cache) + assert snap is not cache and snap["k"] is not cache["k"] and snap["v"] is not cache["v"] + assert all(a is b for a, b in zip(snap["k"], cache["k"])), "快照共享(不复制)张量" + assert snap["_ref"].cache is snap and cache["_ref"].cache is cache, "_KVRef 各指各的 dict" + assert snap["frames_cached"] == fc + with torch.no_grad(): # 往快照里提交 cell 4(frame_index == frames_cached ✓) + m(d["x"][:, :, 4:5], d["ts_pf"][:, 4], d["ctx"][:, 4:5], + frame_index=4, kv_cache=snap, commit=True, **_frame_kwargs(d, 4, 0, kw)) + assert snap["frames_cached"] == fc + 1 and cache["frames_cached"] == fc, "快照推进了原缓存的 frames_cached" + assert [id(t) for t in cache["k"]] == k_ids and torch.equal(cache["k"][0], k0), "原缓存的槽位/张量被动了" + assert all(a is not b for a, b in zip(snap["k"], cache["k"])), "快照的槽位应已换成新 cat 出来的张量" + assert snap["k"][0].shape[1] // HW == kw and cache["k"][0].shape[1] // HW == kw + # 快照 = 原缓存丢掉最老一格 + 新 cell(sink=0):前 (kw−1) 格逐位等于原缓存的后 (kw−1) 格 + assert torch.equal(snap["k"][0][:, :(kw - 1) * HW], cache["k"][0][:, HW:]) + # 同一 cell 在两条分支上读到的历史不同 ⇒ 输出必须不同(快照真的是另一条历史) + with torch.no_grad(): + o_snap = m(d["x"][:, :, 4:5], d["ts_pf"][:, 4], d["ctx"][:, 4:5], frame_index=5, kv_cache=snap, + commit=False, offset_win=torch.zeros(B, kw + 1, 2, device=DEV), mask_in_k=None, + context_ids=d["ids"][:, 4:5], first_frame_cond=False) + o_orig = m(d["x"][:, :, 4:5], d["ts_pf"][:, 4], d["ctx"][:, 4:5], frame_index=4, kv_cache=cache, + commit=False, **_frame_kwargs(d, 4, 0, kw)) + assert float((o_snap - o_orig).abs().max()) > TOL_DIVERGE + AropeDiT.release_kv_cache(snap) + assert not snap and cache["k"][0] is not None and cache["frames_cached"] == fc, "释放快照伤到了原缓存" + print("12. snapshot snapshot_kv_cache:浅快照上 commit 不动原缓存的槽位/张量/frames_cached,_ref 各指各的," + "释放快照不伤原缓存: True") diff --git a/backup_2026-09-14/code/distill/tests/test_onpolicy.py b/backup_2026-09-14/code/distill/tests/test_onpolicy.py new file mode 100644 index 0000000000000000000000000000000000000000..057b6475168b8bea9fdd4b9db61a8dd087b8d6a2 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_onpolicy.py @@ -0,0 +1,272 @@ +"""stage3-onpolicy 算法层的门。 + +这一层的每一条都是**静默错误**:三段切错只会少跑或多跑一次前向,DMD 梯度的符号反了 +loss 数值照样漂亮(那个 loss 本来就没有意义),critic 的 target 少了/多了修正项也不报错。 +所以这里全部拿**解析答案**对,不靠"看起来合理"。 + + CUDA_VISIBLE_DEVICES="" PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \ + .venv/bin/python -m pytest distill/tests/test_onpolicy.py -q +""" +from __future__ import annotations + +import os +import sys + +import pytest +import torch + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from distill import flowmap as fm # noqa: E402 +from distill import onpolicy as op # noqa: E402 + + +# ------------------------------------------------------------------ 三段切分 + +@pytest.mark.parametrize("N", [2, 4, 8, 16, 50]) +def test_1_three_ranges_cover_the_axis_exactly(N): + """三段首尾相接、整体覆盖 σ[0] → σ[-1],中间不重不漏。 + + 漏一段 = rollout 没走完就去打分;重一段 = 同一区间走两次,等于步长翻倍。两者都不报错。 + """ + s = fm.anystep_sigmas(N) + for g in range(N): + prev, cur, post = op.three_range_sigmas(op.RolloutPlan(N, g, s)) + segs = [x for x in (prev, cur, post) if x is not None] + assert segs[0][0] == float(s[0]), f"N={N} g={g}: 起点应为 σ[0]" + assert segs[-1][1] == float(s[-1]), f"N={N} g={g}: 终点应为 σ[-1]=0" + for a, b in zip(segs, segs[1:]): + assert a[1] == b[0], f"N={N} g={g}: 段之间不接续 {a} → {b}" + for a, b in segs: + assert a > b, f"N={N} g={g}: 段 ({a},{b}) 不是严格降序" + + +@pytest.mark.parametrize("N", [2, 4, 8, 16, 50]) +def test_2_forward_count_is_always_three_or_fewer(N): + """★ 这是移植的核心主张:前向次数与 N **无关**,最多 3 次。 + + 我们原来的 DMD 是「跑到第 g 步就停」,要 g 次前向;这里因为学生是 flow map,可以直接跳。 + 如果哪天有人把它改回逐步跑,这条会立刻红 —— 而 loss 曲线不会有任何异样。 + """ + s = fm.anystep_sigmas(N) + for g in range(N): + prev, cur, post = op.three_range_sigmas(op.RolloutPlan(N, g, s)) + assert sum(x is not None for x in (prev, cur, post)) <= 3 + assert cur is not None, "带梯度的那一段永远存在" + + +def test_3_empty_segments_are_at_the_endpoints_only(): + """g=0 ⇒ 没有 prev;g=N-1 ⇒ 没有 post。别的位置两段都在。 + + 上游对 `t == r` 的段是直接 continue(pipeline:394);这里用 None 表示,让调用方 + 不要白跑一次 Δσ=0 的 5B 前向(数值上恒等,但那是一次真实的前向开销)。 + """ + N = 8 + s = fm.anystep_sigmas(N) + prev, cur, post = op.three_range_sigmas(op.RolloutPlan(N, 0, s)) + assert prev is None and post is not None + prev, cur, post = op.three_range_sigmas(op.RolloutPlan(N, N - 1, s)) + assert prev is not None and post is None + for g in range(1, N - 1): + prev, cur, post = op.three_range_sigmas(op.RolloutPlan(N, g, s)) + assert prev is not None and post is not None + + +# ------------------------------------------------------------------ x0 / DMD + +def test_4_x0_from_u_is_the_r_equals_zero_jump(): + """x0 估计就是「一步跳到 σ=0」,与上游 scheduler.step(..., r=0) 同解。""" + x = torch.randn(2, 48, 5, 4, 4) + u = torch.randn_like(x) + for s_t in (1.0, 0.75, 0.25): + got = op.x0_from_u(x, u, s_t) + assert torch.allclose(got, x - s_t * u, atol=0, rtol=0), f"σ={s_t}" + + +def test_5_dmd_grad_direction_and_normalizer(): + """grad = (x0_fake − x0_real)/mean|gen − x0_real|。符号反了 loss 照样好看,所以钉死方向。""" + gen_ = torch.zeros(1, 48, 5, 4, 4) + real = torch.full_like(gen_, -2.0) # gen − real = +2 ⇒ 分母 2.0 + fake = torch.full_like(gen_, 1.0) # fake − real = +3 + g = op.dmd_grad(fake, real, gen_) + assert torch.allclose(g, torch.full_like(g, 1.5)), f"应为 3/2 = 1.5,得到 {g.flatten()[0]}" + g0 = op.dmd_grad(real.clone(), real, gen_) # fake == real ⇒ 梯度为 0(已收敛) + assert torch.count_nonzero(g0) == 0 + + +def test_6_dmd_grad_normalizer_is_per_sample(): + """分母逐样本算(上游 keepdim 的 mean over [1,2,3,4])。批内共用一个分母会把 + 两条难度不同的样本耦合起来 —— 不报错,只是梯度尺度错。""" + a = torch.zeros(2, 48, 3, 2, 2) + real = torch.zeros_like(a); real[0] = -1.0; real[1] = -4.0 # 分母 1 和 4 + fake = torch.ones_like(a) + g = op.dmd_grad(fake, real, a) + assert torch.allclose(g[0], torch.full_like(g[0], 2.0)), g[0].flatten()[0] # (1−(−1))/1 + assert torch.allclose(g[1], torch.full_like(g[1], 1.25)), g[1].flatten()[0] # (1−(−4))/4 + + +def test_7_eval_mask_excludes_cell0_from_the_normalizer(): + """ActionRoPE 的 cell 0 是干净锚点,不该进归一化分母。上游没有这个概念(它没有锚点)。""" + a = torch.zeros(1, 48, 4, 2, 2) + real = torch.zeros_like(a) + real[:, :, 0] = -100.0 # cell 0 放一个极端值 + real[:, :, 1:] = -2.0 + fake = torch.ones_like(a) + m = torch.tensor([False, True, True, True]) + g_masked = op.dmd_grad(fake, real, a, eval_mask=m) + g_all = op.dmd_grad(fake, real, a) + # 被 mask 的版本分母 = 2.0;不 mask 的会被 cell 0 的 100 拉大 + assert abs(float(g_masked[:, :, 1].flatten()[0]) - 1.5) < 1e-5 + assert float(g_all[:, :, 1].abs().mean()) < float(g_masked[:, :, 1].abs().mean()) + + +def test_8_generator_loss_gradient_equals_the_dmd_grad(): + """★ `loss = MSE(gen, (gen−grad).detach())` 的**唯一**意义是 d(loss)/d(gen) ∝ grad。 + loss 的数值本身没有意义(它是把预先算好的梯度塞进 autograd 的手法),所以这里验梯度而不是验值。""" + gen_ = torch.randn(2, 48, 3, 2, 2, dtype=torch.double, requires_grad=True) + grad = torch.randn_like(gen_.detach()) + loss = op.dmd_generator_loss(gen_, grad, weight=1.0) + loss.backward() + n = gen_.numel() + assert torch.allclose(gen_.grad, 2.0 * grad / n, atol=1e-12), "d(loss)/d(gen) 应为 2·grad/N" + + +# ------------------------------------------------------------------ critic + +def test_9_critic_target_has_no_flowmap_correction(): + """critic 在 r == t 上调用 ⇒ target 就是 ε − x0,**不带** (t−r)·dF/dt。 + 顺手加上修正项不会报错,只会让 fake score 学一个不同的量。""" + x0 = torch.randn(1, 48, 4, 2, 2) + noise = torch.randn_like(x0) + u = noise - x0 # 完美预测 + assert float(op.critic_flow_loss(u, x0, noise)) == 0.0 + off = op.critic_flow_loss(u + 0.5, x0, noise) + assert abs(float(off) - 0.25) < 1e-5 + + +def test_10_critic_eval_mask_drops_cell0(): + x0 = torch.randn(1, 48, 4, 2, 2) + noise = torch.randn_like(x0) + u = noise - x0 + u[:, :, 0] += 10.0 # 只把 cell 0 弄错 + m = torch.tensor([False, True, True, True]) + assert float(op.critic_flow_loss(u, x0, noise, eval_mask=m)) == 0.0 + assert float(op.critic_flow_loss(u, x0, noise)) > 0.0 + + +# ------------------------------------------------------------------ 抽签 + +def test_11_plan_draws_from_the_upstream_step_list(): + assert op.STEP_LIST == (2, 4, 8, 16, 50), "上游 onpolicy yml:105" + seen = set() + g = torch.Generator().manual_seed(0) + for _ in range(300): + p = op.draw_rollout_plan(g) + assert p.n_steps in op.STEP_LIST + assert 0 <= p.grad_idx < p.n_steps, f"g={p.grad_idx} 越界 N={p.n_steps}" + assert int(p.sigmas.numel()) == p.n_steps + 1 + seen.add(p.n_steps) + assert seen == set(op.STEP_LIST), f"300 次没抽全 {op.STEP_LIST},实际 {sorted(seen)}" + + +def test_12_logit_normal_is_in_open_unit_interval(): + """critic 的档位抽样是 shift **前**的 u∈(0,1);直接当 t 用(0..1000)会静默错 1000 倍。""" + u = op.logit_normal_timesteps(4096, gen=torch.Generator().manual_seed(0)) + assert u.shape == (4096,) + assert float(u.min()) > 0.0 and float(u.max()) < 1.0 + assert abs(float(u.mean()) - 0.5) < 0.02, f"logit-normal(0,1) 的均值应≈0.5,得到 {float(u.mean())}" + + +def test_13_generator_and_critic_use_different_timestep_distributions(): + """generator 的 DMD 档位是**均匀**(trainer:183),critic 是 **logit-normal**(trainer:236)。 + 顺手统一成一个不会报错 —— 但 fake score 要在整条轨迹上准,DMD 只在抽到的那一档上估。""" + g = torch.Generator().manual_seed(1) + ln = op.logit_normal_timesteps(20000, gen=g) + uni = torch.rand(20000, generator=g) + # logit-normal 在中间更集中:标准差明显小于均匀分布的 1/sqrt(12)≈0.2887 + assert float(ln.std()) < 0.24 < float(uni.std()), f"ln.std={float(ln.std()):.4f} uni.std={float(uni.std()):.4f}" + + +# ------------------------------------------------------------------ rollout + +@pytest.fixture(scope="module") +def tiny(): + from distill.tests.preflight import tiny_arope_dit + torch.manual_seed(0) + m = tiny_arope_dit(causal=True, device="cpu", dtype=torch.float32) + m.install_flowmap(form="residual", gate=1.0) + return m + + +def _run(tiny, N, g, cells=4, horizon=2, grad_start=1, spy=None): + from distill.stage3_dmd.dmd_arope import frame_cond + b, c, h, w = 1, 48, 4, 4 + z0 = torch.randn(b, c, 1, h, w) + ctx = torch.randn(b, 1 + cells, 4, 4096) + ids = torch.zeros(b, 1 + cells, dtype=torch.long) + off = torch.cumsum(torch.randn(b, 1 + cells, 2) * 8.0, dim=1) + off = off - off[:, :1] + plan = op.RolloutPlan(N, g, fm.anystep_sigmas(N)) + return op.anystep_rollout(tiny, z0, ctx, ids, off, cells, plan, + frame_cond=frame_cond, grad_horizon=horizon, + kv_window=20, rope_cap=20, sink_size=0, grad_start=grad_start) + + +@pytest.mark.parametrize("N,g", [(2, 0), (4, 2), (8, 7), (50, 13)]) +def test_14_rollout_forward_count_is_independent_of_N(tiny, N, g, monkeypatch): + """★ 移植的核心主张:每个 cell 的**去噪**前向次数 ≤3,与 N 无关。 + + 统计的是传给 forward 的调用数,减去每个 cell 一次的提交趟和 cell 0 的那次。 + 有人把它改回逐步去噪的话这条立刻红,而 loss 曲线不会有任何异样。 + """ + calls = [] + orig = type(tiny).forward + monkeypatch.setattr(type(tiny), "forward", + lambda self, *a, **kw: (calls.append(kw.get("commit", True)), orig(self, *a, **kw))[1]) + gen_out, mask = _run(tiny, N, g, cells=4) + commits = sum(1 for c in calls if c) + denoise = len(calls) - commits + prev, cur, post = op.three_range_sigmas(op.RolloutPlan(N, g, fm.anystep_sigmas(N))) + per_cell = sum(x is not None for x in (prev, cur, post)) + assert commits == 5, f"应为 cell0 + 4 个生成 cell 各提交一次,得到 {commits}" + assert denoise == 4 * per_cell, f"N={N} g={g}: 去噪前向 {denoise},应为 4×{per_cell}" + assert denoise <= 12, "每个 cell 最多 3 次去噪前向" + + +def test_15_rollout_shape_and_cell0_is_the_real_first_frame(tiny): + gen_out, mask = _run(tiny, 4, 1, cells=4) + assert gen_out.shape == (1, 48, 5, 4, 4) + assert torch.isfinite(gen_out).all() + assert mask.shape == (5,) and not bool(mask[0]), "cell 0 是干净锚点,绝不进 grad 窗口" + + +def test_16_gradient_flows_only_into_the_grad_window(tiny): + """窗口外的 cell 全程 no_grad ⇒ 它们对 loss 没有梯度通路。 + 窗口内的必须有 —— 两边都错的话 loss 恒有值但学不到东西。""" + gen_out, mask = _run(tiny, 4, 1, cells=4, horizon=2, grad_start=1) + assert gen_out.requires_grad, "窗口内的 cell 应带梯度" + idx = torch.nonzero(mask, as_tuple=True)[0] + assert idx.tolist() == [1, 2], f"grad_start=1 horizon=2 ⇒ 窗口应为 [1,2],得到 {idx.tolist()}" + gen_out[:, :, idx].sum().backward() + got = sum(1 for p in tiny.parameters() if p.grad is not None and p.grad.abs().sum() > 0) + assert got > 0, "grad 窗口里没有任何参数拿到梯度" + + +def test_17_all_three_segments_carry_gradient(tiny, monkeypatch): + """★ 上游 inference() 里三段都不在 no_grad 下(pipeline:447-449)。 + 只让 current 带梯度会丢掉 prev/post 两条通路 —— 不报错,只是梯度不完整。 + 这里用 g=2、N=4(三段都非空)比对:三段都带梯度时,带梯度的前向次数应为 3。""" + grad_calls = [] + orig = type(tiny).forward + + def spy(self, *a, **kw): + out = orig(self, *a, **kw) + if torch.is_grad_enabled() and not kw.get("commit", True): + grad_calls.append(1) + return out + monkeypatch.setattr(type(tiny), "forward", spy) + _run(tiny, 4, 2, cells=3, horizon=1, grad_start=1) + assert len(grad_calls) == 3, f"grad 窗口里的那个 cell 应有 3 次带梯度前向,得到 {len(grad_calls)}" diff --git a/backup_2026-09-14/code/distill/tests/test_rotation.py b/backup_2026-09-14/code/distill/tests/test_rotation.py new file mode 100644 index 0000000000000000000000000000000000000000..b2576a5d4cf7c81e0c45e9d0e6374c02c272141a --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_rotation.py @@ -0,0 +1,135 @@ +#!/usr/bin/env python3 +"""相机旋转(world-RoPE 里的 h/w 耦合)的自检。 + +钉四条: +1. angle=None / 全 0 ⇒ 与旋转支持加入之前的可分离路径**逐位相同**(老路一个 bit 都没动)。 +2. 旋转后的 token 位置等于独立算的闭式解:绕画幅中心转 φ 再加该 cell 偏移。 +3. RoPE 的相对性在旋转下仍成立:把所有 cell 的偏移整体平移,freqs 的**相对**结构不变 + (用注意力分数比,而不是比 freqs 本身)。 +4. known 掩码:angle=0 逐位退化成老实现;转 180° 时掩码等于把老掩码上下左右翻转。 +""" +import os +import sys + +import pytest +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from distill.arope_dit import build_world_freqs, rot2d, world_pos_maps # noqa: E402 +from distill.data import make_mask_input # noqa: E402 +from distill.tests.preflight import tiny_arope_dit # noqa: E402 + +H, W = 5, 7 # 画幅(token 单位),奇偶都覆盖 + + +@pytest.fixture(scope="module") +def dit(): + return tiny_arope_dit(causal=True, seed=0, device="cpu", dtype=torch.float32, + dim=24, ffn_dim=48, num_heads=2, num_layers=2).dit + + +def _off(b=1, f=3): + torch.manual_seed(0) + return torch.randn(b, f, 2, dtype=torch.float64) * 3.0 + + +def test_1_zero_angle_is_bit_identical(dit): + off = _off() + f = off.shape[1] + ref = build_world_freqs(dit, f, H, W, off, device="cpu") + for ang in (None, torch.zeros(1, f, dtype=torch.float64)): + got = build_world_freqs(dit, f, H, W, off, device="cpu", angle=ang) + assert torch.equal(got, ref), "angle 为 None / 全 0 时必须与可分离路径逐位相同" + + +def test_2_rotated_positions_match_closed_form(): + off = _off(f=2) + ang = torch.tensor([[0.0, 0.4]], dtype=torch.float64) + pos_h, pos_w = world_pos_maps(off, ang, H, W) + ch, cw = (H - 1) / 2.0, (W - 1) / 2.0 + import math + for j in range(2): + phi = float(ang[0, j]); c, s = math.cos(phi), math.sin(phi) + for i in range(H): + for m in range(W): + u, v = m - cw, i - ch + ew = u * c - v * s + float(off[0, j, 0]) + cw + eh = u * s + v * c + float(off[0, j, 1]) + ch + assert abs(float(pos_w[0, j, i, m]) - ew) < 1e-12 + assert abs(float(pos_h[0, j, i, m]) - eh) < 1e-12 + # φ=0 的那一格必须精确落回可分离形式 + assert torch.allclose(pos_h[0, 0, :, 0], + torch.arange(H, dtype=torch.float64) + off[0, 0, 1], atol=1e-12) + + +def _scores(dit, off, ang): + """同一份随机 q/k 在给定几何下的注意力分数(RoPE 施加之后),[f*h*w, f*h*w]。""" + from diffsynth.models.wan_video_dit import rope_apply + f = off.shape[1] + fr = build_world_freqs(dit, f, H, W, off, device="cpu", angle=ang) + n, hd = 2, 2 * fr.shape[-1] # rope_apply 吃 [b, seq, n*head_dim] + torch.manual_seed(1) + q = torch.randn(1, f * H * W, n * hd) + k = torch.randn(1, f * H * W, n * hd) + qr, kr = rope_apply(q, fr, n), rope_apply(k, fr, n) + qr = qr.view(1, -1, n, hd).float() + kr = kr.view(1, -1, n, hd).float() + return torch.einsum("bqnd,bknd->bqk", qr, kr) + + +def test_3_translation_invariance_holds_under_rotation(dit): + off = _off(f=2) + ang = torch.tensor([[0.35, 0.0]], dtype=torch.float64) + shift = torch.tensor([[[2.0, -3.0]]], dtype=torch.float64) # 所有 cell 同一个平移 + a = _scores(dit, off, ang) + b = _scores(dit, off + shift, ang) + assert torch.allclose(a, b, atol=1e-4), "RoPE 的相对性:整体平移不该改变任何注意力分数" + # 而整体**旋转**会改变分数(旋转不是 RoPE 的不变量,这一条正是实验要问的问题) + c = _scores(dit, off, ang + 0.3) + assert not torch.allclose(a, c, atol=1e-3) + + +def test_4_known_mask_rotation(): + lh, lw = 6, 8 + off = torch.tensor([[[16.0, -32.0]]], dtype=torch.float32) # px,除以 16 = latent 格 + ref = make_mask_input(off, lh, lw) + assert torch.equal(make_mask_input(off, lh, lw, angle=torch.zeros(1, 1)), ref) + import math + rot180 = make_mask_input(off, lh, lw, angle=torch.full((1, 1), math.pi)) + # 转 180° = 绕中心点对称:把"先加偏移再判定"的格点整体翻过来 + exp = torch.flip(make_mask_input(-off, lh, lw), dims=(-2, -1)) + assert torch.equal(rot180, exp), "180° 的 known 区应当等于老掩码的中心对称翻转" + # 转 90° 时 known 区面积不变(刚体变换,只是斜过来了) + rot90 = make_mask_input(off, lh, lw, angle=torch.full((1, 1), math.pi / 2)) + assert abs(float(rot90.sum()) - float(ref.sum())) <= 0.35 * float(ref.sum()) + + +def test_5_frame_cond_rot_degenerates_to_frame_cond(): + """ang_ext 全 0 时,评测侧的 frame_cond_rot 必须与训练侧的 frame_cond 逐位相同(老路一个 bit 没动)。""" + from distill.eval.rollout_eval import frame_cond_rot + from distill.stage3_dmd.dmd_arope import frame_cond + torch.manual_seed(0) + cells, lh, lw = 30, 6, 8 + off = torch.randn(1, cells, 2) * 40.0 + off[:, 0] = 0 + off = off.cumsum(1) + ang0 = torch.zeros(1, cells) + for anchor in ("absolute", "window"): + for k in (0, 1, 5, 21, 29): + ow_r, mk_r, aw = frame_cond_rot(off, ang0, k, 3, 17, lh, lw, anchor) + ow, mk = frame_cond(off, k, 3, 17, lh, lw, anchor) + assert torch.equal(ow_r, ow), (anchor, k) + assert torch.equal(mk_r, mk), (anchor, k) + assert aw.shape == (1, ow.shape[1]) and float(aw[0, -1]) == 0.0 + # 非零角:当前 cell 的角恒为 0,历史 cell 拿到 φ_j − φ_k + ang = torch.arange(cells, dtype=torch.float32).unsqueeze(0) * 0.05 + _, _, aw = frame_cond_rot(off, ang, 21, 3, 17, lh, lw, "absolute") + assert float(aw[0, -1]) == 0.0 and float(aw[0, 0]) < 0, "历史相对当前应是负角(当前转得更多)" + + +if __name__ == "__main__": + raise SystemExit(pytest.main([__file__, "-q", "-s"])) diff --git a/backup_2026-09-14/code/distill/tests/test_runlib.py b/backup_2026-09-14/code/distill/tests/test_runlib.py new file mode 100644 index 0000000000000000000000000000000000000000..515b867bb120881ea2cb0b668cbcfaa0d619ee2c --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_runlib.py @@ -0,0 +1,564 @@ +#!/usr/bin/env python3 +"""distill/runlib.py 与 distill/ema.py 的纯 CPU 单测(不碰 GPU、不加载 5B 模型)。 + + PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest distill/tests/test_runlib.py -q + +两条最要紧的断言: +* test_save_dit_casts_fp32_state_dict_to_bf16 —— FSDP 下 accelerator.get_state_dict 给的是 + rank0 CPU 上的 fp32 全量权重(stage3 在 prepare 前 .float() 过),不显式 cast 文件就翻倍到 20 GB, + 827-key / 10.0 GB 的格式承诺作废。这里拿一个 fp32 的假 accelerator 走完整条导出路径。 +* test_bf16_shadow_drops_the_update —— bf16 影子在 decay=0.99 下把 1% 的增量整个舍掉(50 步后 + 逐位不变),fp32 影子照常收敛。EmaShadow 因此拒绝 fp32 以外的 dtype。 + +格式对照的正品是 outputs/arope_10k_ga2/step-10000.safetensors(827 个 BF16 张量,9,999,690,792 B)。 +""" +from __future__ import annotations + +import json +import os +import stat +import sys + +import pytest +import torch +import torch.nn as nn + +sys.path.insert(0, os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__))))) +from distill import runlib # noqa: E402 +from distill.ema import EmaShadow, ema_update # noqa: E402 + + +# ------------------------------------------------------------------ 假模型 / 假 accelerator ---- + +class TinyWan(nn.Module): + """模仿 WanModel 的键集:patch_embedding / blocks.N.* / head / arope_mask_embedding。""" + + def __init__(self, dim: int = 8, n_blocks: int = 2, mask_channel: bool = True): + super().__init__() + self.patch_embedding = nn.Linear(dim, dim) + self.blocks = nn.ModuleList(nn.Linear(dim, dim) for _ in range(n_blocks)) + self.head = nn.Linear(dim, dim) + if mask_channel: + conv = nn.Linear(1, dim) + nn.init.zeros_(conv.weight) + nn.init.zeros_(conv.bias) + self.add_module(runlib.MASK_EMBEDDING_NAME, conv) + + def forward(self, x): + for b in self.blocks: + x = b(x) + return self.head(x) + + +class TinyAropeDiT(nn.Module): + """模仿 distill/arope_dit.py 的 AropeDiT:WanModel 挂在 self.dit 上,导出时剥掉 `dit.` 前缀。""" + + def __init__(self, **kw): + super().__init__() + self.dit = TinyWan(**kw) + + def forward(self, x): + return self.dit(x) + + +class FakeAccel: + """够 save_dit / save_state_rotating 用的最小 accelerator。 + + get_state_dict 故意返回 **fp32 CPU** 权重 —— 这正是 FSDP 分支 + FullStateDictConfig(offload_to_cpu=True, rank0_only=True) 的形状。""" + + def __init__(self, is_main: bool = True): + self.is_main_process = is_main + self.barriers = 0 + self.saved = [] + + def wait_for_everyone(self): + self.barriers += 1 + + def get_state_dict(self, model): + if not self.is_main_process: + return {} + return {k: v.detach().to(device="cpu", dtype=torch.float32) for k, v in model.state_dict().items()} + + def save_state(self, d): + os.makedirs(d, exist_ok=True) + with open(os.path.join(d, "model.bin"), "w") as fh: + fh.write("x" * 16) + self.saved.append(d) + + +def _tiny(**kw): + torch.manual_seed(0) + return TinyAropeDiT(**kw) + + +def _nkeys(m): + return len(m.state_dict()) + + +# ------------------------------------------------------------------ 路径 ---- + +def test_resolve_run_dir(): + assert runlib.resolve_run_dir("/tmp/foo/bar") == "/tmp/foo/bar" + # 裸名字落在 outputs/distill/ 下 + assert runlib.resolve_run_dir("stage1_ar_tf") == os.path.join(runlib.OUTPUT_ROOT, "stage1_ar_tf") + # 带分隔符的相对路径按仓库根解析(scripts/train_arope.sh:6 那个写死的 /opt/dlami ROOT 就是这样死的) + assert runlib.resolve_run_dir("outputs/distill/x") == os.path.join(runlib.REPO_ROOT, "outputs/distill/x") + assert runlib.REPO_ROOT == os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) # 旧机是 /data/zhiyangdeng/ActionRoPE + with pytest.raises(ValueError): + runlib.resolve_run_dir("") + + +def test_ckpt_paths(): + r = "/tmp/run" + assert runlib.dit_path(r, 500) == "/tmp/run/dits/dit_step500.safetensors" + assert runlib.ema_path(r, 500) == "/tmp/run/ema/ema_step500.safetensors" + assert runlib.critic_path(r, 500) == "/tmp/run/critic/critic_step500.safetensors" + assert runlib.dit_glob(r).endswith("dits/dit_step*.safetensors") + assert runlib.ema_glob(r).endswith("ema/ema_step*.safetensors") + assert runlib.critic_glob(r).endswith("critic/critic_step*.safetensors") + + +# ------------------------------------------------------------------ rotate ---- + +def _touch(p): + os.makedirs(os.path.dirname(p), exist_ok=True) + open(p, "w").close() + return p + + +def test_rotate_covers_dits_emas_critics(tmp_path): + """A 只 rotate state_step*,它的 v4 stage-1 run 光 dits/ 就吃掉 746 GB。三种都要 rotate。""" + run = str(tmp_path / "run") + steps = [100, 200, 1000, 50] # 故意乱序 + 一个四位数,验证是按数值不是按字典序排 + for s in steps: + _touch(runlib.dit_path(run, s)) + _touch(runlib.ema_path(run, s)) + _touch(runlib.critic_path(run, s)) + assert [s for s, _ in runlib.list_ckpts(runlib.dit_glob(run))] == [50, 100, 200, 1000] + assert runlib.latest_ckpt(runlib.dit_glob(run))[0] == 1000 + + out = runlib.rotate_run(run, keep_dits=2, keep_emas=3, keep_critics=1) + assert len(out["dits"]) == 2 and len(out["emas"]) == 1 and len(out["critics"]) == 3 + assert [s for s, _ in runlib.list_ckpts(runlib.dit_glob(run))] == [200, 1000] + assert [s for s, _ in runlib.list_ckpts(runlib.ema_glob(run))] == [100, 200, 1000] + assert [s for s, _ in runlib.list_ckpts(runlib.critic_glob(run))] == [1000] + + +def test_rotate_keep_zero_deletes_nothing(tmp_path): + """keep<=0 是"不删",不是"全删" —— 别把唯一的续训点抹了。""" + run = str(tmp_path / "run") + for s in (1, 2, 3): + _touch(runlib.dit_path(run, s)) + assert runlib.rotate(runlib.dit_glob(run), 0) == [] + assert runlib.rotate(runlib.dit_glob(run), -1) == [] + assert len(runlib.list_ckpts(runlib.dit_glob(run))) == 3 + assert runlib.rotate(runlib.dit_glob(run), 99) == [] # keep 比现有的多 + + +def test_rotate_ignores_unparseable_names(tmp_path): + """名字里没有 step 的文件永远不删(比如手工留下的 dit_best.safetensors)。""" + run = str(tmp_path / "run") + for s in (1, 2, 3): + _touch(runlib.dit_path(run, s)) + keep_me = _touch(os.path.join(runlib.dits_dir(run), "dit_best.safetensors")) + runlib.rotate(os.path.join(runlib.dits_dir(run), "dit_*.safetensors"), 1) + assert os.path.isfile(keep_me) + assert [s for s, _ in runlib.list_ckpts(runlib.dit_glob(run))] == [3] + + +def test_rotate_handles_state_dirs(tmp_path): + run = str(tmp_path / "run") + for s in (10, 20, 30): + os.makedirs(os.path.join(run, f"state_step{s}", "sub")) + removed = runlib.rotate(os.path.join(run, "state_step*"), 1) + assert len(removed) == 2 and os.path.isdir(os.path.join(run, "state_step30")) + + +# ------------------------------------------------------------------ save_dit ---- + +def test_save_dit_casts_fp32_state_dict_to_bf16(tmp_path): + """★ 对抗评审的那一条:FSDP 给的是 fp32,导出必须显式 cast 成 bf16 并断言 dtype。""" + m = _tiny() + n = _nkeys(m) + accel = FakeAccel() + path = runlib.dit_path(str(tmp_path / "run"), 100) + size = runlib.save_dit(accel, m, path, {"step": 100}, expect_keys=n, require_mask=True) + + hdr, meta = runlib.read_ckpt_header(path) + assert len(hdr) == n + assert sorted({v["dtype"] for v in hdr.values()}) == ["BF16"] # 不是 F32 + n_elem = sum(p.numel() for p in m.parameters()) + assert size - 2 * n_elem < 4096 # 2 B/参数(fp32 会是 4 B) + # `dit.` 前缀被剥掉,mask 键在 + assert not any(k.startswith("dit.") for k in hdr) + assert set(runlib.MASK_KEYS) <= set(hdr) + assert "blocks.0.weight" in hdr + # metadata 全是字符串,且带上 check_ckpt.py / detect_arm_from_ckpt 需要的 arm 名 + assert all(isinstance(v, str) for v in meta.values()) + assert meta["arm"] == "arope" and meta["step"] == "100" and meta["dtype"] == "bfloat16" + assert meta["n_tensors"] == str(n) + # safetensors 默认按 umask 写 0600;推理可能由别的账号跑 + assert stat.S_IMODE(os.stat(path).st_mode) == 0o644 + assert accel.barriers == 2 # 前后各一次 + assert not os.path.exists(path + ".tmp") # 临时文件已 rename 掉 + + +def test_save_dit_values_survive_the_cast(tmp_path): + from safetensors.torch import load_file + m = _tiny() + path = str(tmp_path / "d.safetensors") + runlib.save_dit(FakeAccel(), m, path, None, expect_keys=_nkeys(m)) + sd = load_file(path) + for k, v in m.dit.state_dict().items(): + assert torch.equal(sd[k].float(), v.to(torch.bfloat16).float()) + + +def test_save_dit_key_count_and_mask_gates(tmp_path): + m = _tiny() + n = _nkeys(m) + with pytest.raises(RuntimeError, match="期望"): + runlib.save_dit(FakeAccel(), m, str(tmp_path / "a.safetensors"), None, expect_keys=n + 1) + # mask_channel=False 建出来的模型少两个键:默认闸门必须挡住(装回 infer.py 会静默走错分支) + m2 = _tiny(mask_channel=False) + with pytest.raises(RuntimeError, match="缺"): + runlib.save_dit(FakeAccel(), m2, str(tmp_path / "b.safetensors"), None, expect_keys=_nkeys(m2)) + # 显式关掉才放行 + runlib.save_dit(FakeAccel(), m2, str(tmp_path / "c.safetensors"), None, + expect_keys=_nkeys(m2), require_mask=False) + + +def test_save_dit_non_main_writes_nothing(tmp_path): + path = str(tmp_path / "x.safetensors") + assert runlib.save_dit(FakeAccel(is_main=False), _tiny(), path, None, expect_keys=None) == 0 + assert not os.path.exists(path) + + +def test_save_dit_without_accelerator(tmp_path): + """accel=None(单进程 smoke / 本测试)也要能导出。""" + m = _tiny() + path = str(tmp_path / "s.safetensors") + runlib.save_dit(None, m, path, {"step": 1}, expect_keys=_nkeys(m)) + assert runlib.check_ckpt_format(path, expect_keys=_nkeys(m))["dtypes"] == ["BF16"] + + +def test_check_ckpt_format_catches_fp32(tmp_path): + m = _tiny() + path = str(tmp_path / "f32.safetensors") + runlib.save_dit(None, m, path, None, expect_keys=_nkeys(m), dtype=torch.float32) + assert runlib.read_ckpt_header(path)[1]["dtype"] == "float32" + with pytest.raises(RuntimeError, match="dtype"): + runlib.check_ckpt_format(path, expect_keys=_nkeys(m)) + + +# ------------------------------------------------------------------ load_dit_ckpt ---- + +def test_load_dit_ckpt_roundtrip_wrapper_and_bare(tmp_path): + src = _tiny() + path = str(tmp_path / "d.safetensors") + runlib.save_dit(None, src, path, None, expect_keys=_nkeys(src)) + + # 带 dit. 前缀的包装模型 + dst = TinyAropeDiT() + nn.init.constant_(dst.dit.head.weight, 7.0) + info = runlib.load_dit_ckpt(dst, path) + assert info["prefix"] == "dit." and info["missing"] == [] and info["unexpected"] == [] + assert torch.equal(dst.dit.head.weight.to(torch.bfloat16), src.dit.head.weight.to(torch.bfloat16)) + # 裸 WanModel(不带前缀)也能装 + bare = TinyWan() + assert runlib.load_dit_ckpt(bare, path)["prefix"] == "" + + +def test_load_dit_ckpt_allows_only_missing_mask(tmp_path): + """strict,唯一放行的缺失是 arope_mask_embedding.*(零初始化)。 + WorldMind 的 load_dit_ckpt 对任何 missing 都抛,照抄会拒收每一个 ActionRoPE checkpoint。""" + from safetensors.torch import load_file, save_file + src = _tiny() + full = str(tmp_path / "full.safetensors") + runlib.save_dit(None, src, full, None, expect_keys=_nkeys(src)) + sd = load_file(full) + + no_mask = str(tmp_path / "no_mask.safetensors") + save_file({k: v for k, v in sd.items() if not k.startswith(runlib.MASK_EMBEDDING_NAME)}, no_mask) + dst = TinyAropeDiT() + info = runlib.load_dit_ckpt(dst, no_mask) # 放行 + assert sorted(info["missing"]) == sorted("dit." + k for k in runlib.MASK_KEYS) + assert float(getattr(dst.dit, runlib.MASK_EMBEDDING_NAME).weight.detach().abs().sum()) == 0.0 + with pytest.raises(RuntimeError, match="缺"): + runlib.load_dit_ckpt(TinyAropeDiT(), no_mask, allow_missing_mask=False) + + # 别的键缺 ⇒ 炸 + drop_head = str(tmp_path / "drop.safetensors") + save_file({k: v for k, v in sd.items() if k != "head.weight"}, drop_head) + with pytest.raises(RuntimeError, match="缺"): + runlib.load_dit_ckpt(TinyAropeDiT(), drop_head) + # 多余的键 ⇒ 炸 + extra = str(tmp_path / "extra.safetensors") + save_file({**sd, "blocks.9.weight": torch.zeros(8, 8, dtype=torch.bfloat16)}, extra) + with pytest.raises(RuntimeError, match="多"): + runlib.load_dit_ckpt(TinyAropeDiT(), extra) + + +def test_load_dit_ckpt_keeps_model_dtype(tmp_path): + """assign=False(默认)把 bf16 权重 copy_ 进 fp32 参数,fp32 主权重不能被换掉(stage3 R4)。""" + src = _tiny() + path = str(tmp_path / "d.safetensors") + runlib.save_dit(None, src, path, None, expect_keys=_nkeys(src)) + dst = TinyAropeDiT().float() + runlib.load_dit_ckpt(dst, path) + assert all(p.dtype is torch.float32 for p in dst.parameters()) + + +# ------------------------------------------------------------------ progress / config ---- + +def test_progress_json(tmp_path): + run = str(tmp_path / "run") + os.makedirs(run) + assert runlib.read_progress(run) is None and runlib.progress_step(run) == 0 + runlib.write_progress(run, 500, ema_decay=0.99) + pr = runlib.read_progress(run) + assert pr["step"] == 500 and pr["ema_decay"] == 0.99 and "time" in pr + assert runlib.progress_step(run) == 500 + runlib.write_progress(run, 1000) + assert runlib.progress_step(run) == 1000 + assert not os.path.exists(runlib.progress_path(run) + ".tmp") + + +def test_save_config(tmp_path): + run = str(tmp_path / "run") + p = runlib.save_config(run, {"lr": 1e-5, "path": tmp_path}) # 非 JSON 类型走 default=str + with open(p, encoding="utf-8") as fh: + assert json.load(fh)["lr"] == 1e-5 + + +# ------------------------------------------------------------------ 日志 ---- + +def test_text_tee_csv_jsonl(tmp_path, capsys): + log = runlib.TextTee(str(tmp_path / "run" / "train.log")) + log("hello", 1) + log.close() + assert "hello 1" in capsys.readouterr().out + assert "hello 1" in open(str(tmp_path / "run" / "train.log"), encoding="utf-8").read() + + csv_path = str(tmp_path / "run" / "train_log.csv") + c = runlib.CsvLog(csv_path, ["step", "loss"]) + c.write({"step": 1, "loss": 0.5, "extra": "ignored"}) # extrasaction="ignore" + c.close() + runlib.CsvLog(csv_path, ["step", "loss"]).write({"step": 2, "loss": 0.25}) # 追加不重复表头 + lines = open(csv_path, encoding="utf-8").read().strip().split("\n") + assert lines == ["step,loss", "1,0.5", "2,0.25"] + + jl = runlib.JsonlLogger(str(tmp_path / "run" / "train_log.jsonl")) + jl.log({"step": 1, "cd": 0.0}) + jl.close() + row = json.loads(open(str(tmp_path / "run" / "train_log.jsonl"), encoding="utf-8").readline()) + assert row["step"] == 1 and "wall" in row + + +def test_loggers_disabled_open_no_file(tmp_path, capsys): + """非主进程:完全静默,一个文件句柄都不开。""" + p = str(tmp_path / "run" / "train.log") + log = runlib.TextTee(p, enabled=False) + log("nope") + log.close() + runlib.CsvLog(str(tmp_path / "run" / "a.csv"), ["step"], enabled=False).write({"step": 1}) + runlib.JsonlLogger(str(tmp_path / "run" / "a.jsonl"), enabled=False).log({"step": 1}) + assert not os.path.exists(tmp_path / "run") + assert capsys.readouterr().out == "" + + +# ------------------------------------------------------------------ save_state_rotating ---- + +def test_save_state_rotating_alternates_slots(tmp_path): + run = str(tmp_path / "run") + os.makedirs(run) + accel = FakeAccel() + d1 = runlib.save_state_rotating(accel, run, {"step": 100}) + assert os.path.basename(d1) == "state_A" + assert os.path.realpath(os.path.join(run, "state")) == os.path.realpath(d1) + d2 = runlib.save_state_rotating(accel, run, {"step": 200}) + assert os.path.basename(d2) == "state_B" + assert os.path.realpath(os.path.join(run, "state")) == os.path.realpath(d2) + d3 = runlib.save_state_rotating(accel, run, {"step": 300}) + assert os.path.basename(d3) == "state_A" # 回到 A,两个槽轮流 + with open(os.path.join(d3, "trainer_state.json"), encoding="utf-8") as fh: + assert json.load(fh)["step"] == 300 + assert os.path.isdir(os.path.join(run, "state_B")) # 另一份完整存档还在 + assert not os.path.lexists(os.path.join(run, "state.tmp")) + + +# ------------------------------------------------------------------ EmaShadow ---- + +def test_bf16_shadow_drops_the_update(): + """★ 影子必须 fp32:decay=0.99 时 bf16 影子把 1% 的增量整个舍掉,50 步后逐位不变。""" + p = torch.full((4,), 1.0 + 2 ** -7, dtype=torch.bfloat16) # 学生:比影子高一个 bf16 ulp + bad = torch.full((4,), 1.0, dtype=torch.bfloat16) + good = torch.full((4,), 1.0, dtype=torch.float32) + for _ in range(50): + bad.mul_(0.99).add_(p, alpha=0.01) + good.mul_(0.99).add_(p, alpha=0.01) + assert (bad.float() - 1.0).abs().max().item() == 0.0 # 影子纹丝不动 = 目标网络失效 + assert (good - 1.0).abs().max().item() == pytest.approx((1 - 0.99 ** 50) * 2 ** -7, rel=1e-3) + with pytest.raises(ValueError): + EmaShadow(_tiny(), dtype=torch.bfloat16) + + +def test_ema_shadow_is_fp32_and_frozen(): + student = _tiny().to(torch.bfloat16) + ema = EmaShadow(student) + assert all(p.dtype is torch.float32 for p in ema.parameters()) # 源是 bf16,影子仍是 fp32 + assert all(not p.requires_grad for p in ema.parameters()) + assert not ema.module.training + with pytest.raises(RuntimeError): + ema.to(torch.bfloat16) + with pytest.raises(RuntimeError): + ema.train() + assert ema.train(False) is ema + + +def test_ema_shadow_is_not_a_module(): + """accelerate 的 prepare 只认 isinstance(obj, nn.Module) 并让最后一个静默胜出 + (accelerator.py:2229-2236)。影子不是 nn.Module ⇒ 不可能被误传进去。""" + ema = EmaShadow(_tiny()) + assert not isinstance(ema, nn.Module) + holder = nn.Module() + assert len(list(holder.parameters())) == 0 + + +def test_ema_update_math_and_hard_copy(): + student = _tiny() + ema = EmaShadow(student) + with torch.no_grad(): + for p in student.parameters(): + p.add_(torch.full_like(p, 0.5)) + before = [p.detach().clone() for p in ema.parameters()] + ema.update(student, 0.99) + for pe, b, ps in zip(ema.parameters(), before, student.parameters()): + assert torch.allclose(pe, 0.99 * b + 0.01 * ps.float(), atol=1e-7) + ema.hard_copy(student) # = update(..., 0.0) + for pe, ps in zip(ema.parameters(), student.parameters()): + assert torch.equal(pe, ps.float()) + ema.update(student, 0.0) + for pe, ps in zip(ema.parameters(), student.parameters()): + assert torch.equal(pe, ps.float()) + + +def test_ema_update_from_bf16_student_moves_the_shadow(): + """真实配置:学生 bf16、影子 fp32 —— 1% 的增量必须真的落进影子。 + 这是 test_bf16_shadow_drops_the_update 的正面对照:同样的一个 bf16 ulp 的差,fp32 影子接得住。""" + student = _tiny().to(torch.bfloat16) + ema = EmaShadow(student) + with torch.no_grad(): + for p in student.parameters(): + p.fill_(1.0 + 2 ** -7) # 学生:正好高一个 bf16 ulp + for p in ema.parameters(): + p.fill_(1.0) + for _ in range(50): + ema.update(student, 0.99) + moved = max(float((pe - 1.0).abs().max()) for pe in ema.parameters()) + assert moved == pytest.approx((1 - 0.99 ** 50) * 2 ** -7, rel=1e-3) + + +def test_ema_update_through_a_wrapper(): + """学生可能是 DeepSpeedEngine / DDP:外壳的 parameters() 顺序与内部一致。""" + student = _tiny() + ema = EmaShadow(student) + + class Wrapper(nn.Module): + def __init__(self, m): + super().__init__() + self.module = m + + ema.update(Wrapper(student), 0.5) + for pe, ps in zip(ema.parameters(), student.parameters()): + assert torch.allclose(pe, ps.float(), atol=1e-7) # 影子初值 = 学生,0.5 混合后仍相等 + + +def test_ema_update_rejects_mismatch(): + ema = EmaShadow(_tiny()) + with pytest.raises(RuntimeError, match="个数"): + ema.update(_tiny(n_blocks=3), 0.99) + with pytest.raises(RuntimeError, match="形状"): + ema.update(_tiny(dim=16), 0.99) + + +def test_ema_shadow_own_adopts_in_place(): + m = _tiny() + ema = EmaShadow(m, own=True) + assert ema.module is m and all(p.dtype is torch.float32 for p in m.parameters()) + + +def test_ema_shadow_exports_the_same_keys_as_the_model(tmp_path): + """state_dict 透传内部 module ⇒ save_dit 剥掉 `dit.` 之后与直接存学生完全同一套键。""" + student = _tiny() + ema = EmaShadow(student) + assert "module." not in "".join(ema.state_dict().keys()) + p_dit = runlib.dit_path(str(tmp_path / "run"), 10) + p_ema = runlib.ema_path(str(tmp_path / "run"), 10) + runlib.save_dit(FakeAccel(), student, p_dit, {"step": 10}, expect_keys=_nkeys(student)) + runlib.save_dit(FakeAccel(), ema, p_ema, {"step": 10}, expect_keys=_nkeys(student)) + assert set(runlib.read_ckpt_header(p_dit)[0]) == set(runlib.read_ckpt_header(p_ema)[0]) + assert runlib.check_ckpt_format(p_ema, expect_keys=_nkeys(student))["dtypes"] == ["BF16"] + exported = ema.export_state_dict() # 原样带 `dit.` 前缀(裸 state_dict 的 cast) + assert set(runlib.strip_dit_prefix(exported)[0]) == set(runlib.read_ckpt_header(p_ema)[0]) + assert all(v.dtype is torch.bfloat16 and not v.is_cuda for v in exported.values()) + + +def test_module_level_ema_update_on_two_modules(): + """stage3 的 EMA 是 FSDP 包装的 AropeDiT,直接用模块级 ema_update(分片 zip)。""" + a, b = _tiny().float(), _tiny() + with torch.no_grad(): + for p in b.parameters(): + p.add_(1.0) + ema_update(a, b, 0.0) + for pa, pb in zip(a.parameters(), b.parameters()): + assert torch.equal(pa, pb) + + +# ------------------------------------------------------------------ 与真 checkpoint 对表 ---- + +REF = runlib.REF_CKPT + + +@pytest.mark.skipif(not os.path.isfile(REF), reason=f"{REF} 不在(见 PORT_SPEC 的 preconditions)") +def test_reference_checkpoint_is_the_format_save_dit_produces(): + """正品 outputs/arope_10k_ga2/step-10000.safetensors:827 个 BF16 张量、9,999,690,792 B、 + metadata 全字符串且 arm=arope。save_dit 的默认闸门必须原样放行它。""" + res = runlib.check_ckpt_format(REF) # 默认 827 / BF16 / mask 键 + assert res["n_tensors"] == runlib.AROPE_DIT_KEYS == 827 + assert res["dtypes"] == ["BF16"] + assert res["size"] == 9999690792 + assert 9.9 < res["size"] / 1e9 < 10.1 + assert res["mask_keys"] == sorted(runlib.MASK_KEYS) + assert res["metadata"]["arm"] == "arope" and res["metadata"]["mask_channel"] == "True" + assert res["metadata"]["step"] == "10000" + + +@pytest.mark.skipif(not os.path.isfile(REF), reason=f"{REF} 不在") +def test_strip_dit_prefix_reproduces_the_reference_key_set(): + """把正品的键加上 `dit.` 前缀(= AropeDiT 包装后的 state_dict 键),过一遍 strip_dit_prefix, + 必须逐键还原成正品的 827 键 —— 导出格式与 10k 教师完全一致。""" + hdr, _ = runlib.read_ckpt_header(REF) + wrapped = {"dit." + k: torch.empty(0) for k in hdr} + wrapped["some_wrapper_buffer"] = torch.empty(0) # 包装层自己的东西必须被丢掉 + out, dropped = runlib.strip_dit_prefix(wrapped) + assert set(out) == set(hdr) and len(out) == 827 + assert dropped == ["some_wrapper_buffer"] + assert runlib.MASK_KEYS[0] in out and runlib.MASK_KEYS[1] in out + + +@pytest.mark.skipif(not os.path.isfile(REF), reason=f"{REF} 不在") +def test_reference_prefix_histogram(): + """键的家族分布:blocks 810 + text_embedding 4 + time_embedding 4 + head 3 + + arope_mask_embedding 2 + patch_embedding 2 + time_projection 2 = 827,没有 arm.* 键。""" + import collections + hdr, _ = runlib.read_ckpt_header(REF) + hist = collections.Counter(k.split(".")[0] for k in hdr) + assert hist == {"blocks": 810, "text_embedding": 4, "time_embedding": 4, "head": 3, + "arope_mask_embedding": 2, "patch_embedding": 2, "time_projection": 2} + assert not [k for k in hdr if k.startswith(runlib.ARM_PREFIX)] + + +if __name__ == "__main__": + raise SystemExit(pytest.main([__file__, "-q"])) diff --git a/backup_2026-09-14/code/distill/tests/test_sink_anchor.py b/backup_2026-09-14/code/distill/tests/test_sink_anchor.py new file mode 100644 index 0000000000000000000000000000000000000000..2ad6115b065335ea82116d42bee68074c5c6d778 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_sink_anchor.py @@ -0,0 +1,62 @@ +"""sink_anchor=window:sink>0 时把世界坐标锚在滑动窗最老的 cell、sink 段偏移钉 0(CPU,纯几何)。 + + CUDA_VISIBLE_DEVICES="" PYTHONPATH= DIFFSYNTH_SKIP_DOWNLOAD=True .venv/bin/python -m pytest distill/tests/test_sink_anchor.py -q +""" +import os +import sys + +import pytest +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from distill.tests.preflight import retained_cells, window_offsets_for_frame # noqa: E402 + + +def _off(F=60, seed=0): + g = torch.Generator().manual_seed(seed) + off = torch.zeros(2, F, 2) + off[:, 1:] = (torch.randn(2, F - 1, 2, generator=g) * 20.0).cumsum(1) + return off + + +@pytest.mark.parametrize("sink,kv", [(3, 17), (1, 19), (0, 20)]) +def test_window_anchor_geometry(sink, kv): + off = _off() + cap = sink + kv + for k in range(1, 60): + a_abs = window_offsets_for_frame(off, k, sink, kv, sink_anchor="absolute") + a_win = window_offsets_for_frame(off, k, sink, kv, sink_anchor="window") + idx = retained_cells(k, sink, kv) + [k] + assert a_win.shape == (2, len(idx), 2) == a_abs.shape + assert torch.all(a_win[:, 0] == 0) and torch.all(a_abs[:, 0] == 0) # arope_dit 的锚定断言 + if sink == 0 or k <= cap: + assert torch.equal(a_win, a_abs), f"k={k}:未饱和 / sink=0 时两种锚点必须逐位相同" + continue + anchor = k - kv # 滑动窗最老 cell + assert idx[sink] == anchor + assert torch.all(a_win[:, :sink] == 0), "sink 段偏移应钉 0" + ref = off[:, idx[sink:]] - off[:, anchor:anchor + 1] + assert torch.equal(a_win[:, sink:], ref), "非 sink 段应锚在滑动窗最老 cell" + # absolute 模式当前 cell 的偏移随 k 无界增长;window 模式 = 锚在 k−kv 的滑动窗,与 sink=0 / window=kv 的口径相同 + w0 = window_offsets_for_frame(off, k, 0, kv, sink_anchor="absolute") + assert torch.equal(a_win[:, -1], w0[:, -1]), "window 模式当前 cell 的锚定偏移应与 sink=0/window=kv 相同" + + +def test_bad_anchor_rejected(): + with pytest.raises(ValueError): + window_offsets_for_frame(_off(), 5, 3, 17, sink_anchor="bogus") + + +def test_frame_cond_passthrough(): + from distill.stage3_dmd.dmd_arope import frame_cond + off = _off() + ow_a, mk_a = frame_cond(off, 30, 3, 17, 30, 52) + ow_w, mk_w = frame_cond(off, 30, 3, 17, 30, 52, sink_anchor="window") + assert torch.all(ow_w[:, :3] == 0) and not torch.equal(ow_a, ow_w) + assert mk_w.shape == (2, 1, 1, 30, 52) + # 当前 cell 的 known 掩码按锚定后的偏移算:window 模式(锚在 k−17)应与 sink=0/w17 的掩码相同 + ow0, mk0 = frame_cond(off, 30, 0, 17, 30, 52) + assert torch.equal(mk_w, mk0) diff --git a/backup_2026-09-14/code/distill/tests/test_stage23_upstream_diff.py b/backup_2026-09-14/code/distill/tests/test_stage23_upstream_diff.py new file mode 100644 index 0000000000000000000000000000000000000000..d80a0d92606066249b2a077cb871d3a7c6228a5b --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_stage23_upstream_diff.py @@ -0,0 +1,301 @@ +#!/usr/bin/env python3 +"""stage2 / stage3 的**差分**门禁:把上游那两段 loss 逐行转写一份,要求数值逐位相同。 + + CUDA_VISIBLE_DEVICES="" PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest \\ + /data/zhiyangdeng/ActionRoPE/distill/tests/test_stage23_upstream_diff.py -q + # 或直接当脚本跑;全程 CPU、tiny 模型、fp32,不碰 GPU + +为什么在 test_stage2_cd.py / test_stage3_dmd.py 之外还要这一份 +------------------------------------------------------------ +那两份测的是**性质**(预言机 loss 恒 0、critic≡teacher 时 DMD 恒 0、提交恒 t=0、streamed==fused)。 +性质测试只挡得住有人想到过的那几种写错法。这一份换一个方向:把 +`_wm/WorldMind/distill/code/stage2_cd/cd_gm.py:91-134` 和 +`_wm/WorldMind/distill/code/stage3_dmd/dmd_gm.py:193-246` **原样抄成本文件里的 +`_upstream_*` 函数**(只把调用形式换成 ActionRoPE 的 cond),然后要求 +`Δ == 0.0`。任何一处偏离——不管有没有人想到过——都会当场炸。 + +具体地,下面这些改动能通过上述性质测试却过不了这一份: + * normalizer 从 `mean(dim=[1,2,3,4], keepdim=True)`(**逐样本**)改成全局 `mean()`; + * `clamp(min=1e-2)` 的下限改成别的数(预言机情形下 p_real≡0,clamp 才是唯一起作用的项); + * surrogate 的 `0.5 *` 掉了; + * 教师 CFG 从 **x0 空间**(`x0_u + s·(x0_c − x0_u)`)改成 v 空间——cfg==1 时两者恒等, + 只有 cfg>1 才分叉,所以必须专门测一档 cfg=3; + * critic 的目标从 `noise − clip` 写成 `clip − noise`(符号反了,loss 照样下降); + * `p_real` 从 `generated − pred_real` 写成 `generated − pred_fake`。 + +全程 fp32(tiny 模型不 `.to(bfloat16)`):两边套的是**同一个** autocast,所以 Δ 必须是 +严格的 0.0,而不是「小于某个容差」。最后一条用 bf16 latent 单独把「本移植 lat_t 存 bf16、 +上游存 fp32」这一处**已知且有意**的差异钉成一个上界,免得它日后悄悄变大。 +""" +from __future__ import annotations + +import os +import sys + +import pytest +import torch +import torch.nn.functional as F + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from distill import flow_pf # noqa: E402 +from distill.arope_dit import AropeDiT # noqa: E402 +from distill.data import make_mask_input # noqa: E402 +from distill.stage2_cd import cd_arope as S2 # noqa: E402 +from distill.stage3_dmd import dmd_arope as S3 # noqa: E402 + +B, C, LH, LW, L_TXT = 1, 48, 8, 10, 8 +F_CD = 5 # stage2 的 clip cell 数(真实是 21,下标算术一样) +F_TAIL = 9 # stage3 的 scored tail 长度 1+K(K=8 ⇒ 9) + + +def _fp32_model(causal: bool, seed: int) -> AropeDiT: + """fp32 的 tiny AropeDiT。故意不走 S2/S3 的 `_tiny_model`:那两个返回 bf16, + bf16 的 latent 会把「逐位相同」冲淡成「差 2e-3」,差分就失去分辨率了。""" + from diffsynth.models.wan_video_dit import WanModel + torch.manual_seed(seed) + return AropeDiT(dit=WanModel(**S2.TINY), mask_channel=True, causal=causal) + + +def _offsets(f: int, g: torch.Generator, scale: float = 20.0) -> torch.Tensor: + off = torch.zeros(B, f, 2) + off[:, 1:] = torch.randn(B, f - 1, 2, generator=g).cumsum(1) * scale + return off + + +# ---------------------------------------------------------------------------- +# 上游转写:cd_gm.py:91-134(teacher_forcing=True 分支) +# ---------------------------------------------------------------------------- + +def _keep_frame0(x, clip): # cd_gm.py:84-86 + f0 = (torch.arange(clip.shape[2], device=clip.device) == 0).view(1, 1, -1, 1, 1) + return torch.where(f0, clip, x) + + +def _upstream_cd(student, ema, teacher, clip, cond, sigmas, tsteps, idx, + cfg=1.0, noise=None, cond_u=None): + """cd_gm.cd_generator_loss 原样。σ 保持上游的 [1,1,1,1,1] fp32 张量形态。""" + sig_t, sig_tn = sigmas[idx], sigmas[idx + 1] + t_val, tn_val = float(tsteps[idx]), float(tsteps[idx + 1]) + s_t, s_tn = sig_t.view(1, 1, 1, 1, 1), sig_tn.view(1, 1, 1, 1, 1) + ac = lambda: torch.autocast(device_type=clip.device.type, dtype=torch.bfloat16) # noqa: E731 + latent_t = _keep_frame0((1 - s_t) * clip + s_t * noise, clip) + with torch.no_grad(), ac(): + v_c = teacher(latent_t, t_val, **cond) + if abs(cfg - 1.0) < 1e-6: + v_pred = v_c + else: + v_u = teacher(latent_t, t_val, **cond_u) + v_pred = v_u + cfg * (v_c - v_u) # ★ v 空间(stage2 与 stage3 不同) + latent_tn = _keep_frame0(latent_t + (s_tn - s_t) * v_pred, clip) + with ac(): + v_s = student(latent_t, t_val, **cond) + cm_t = latent_t - s_t * v_s + with torch.no_grad(), ac(): + cm_tn = latent_tn - s_tn * ema(latent_tn, tn_val, **cond) + return F.mse_loss(cm_t[:, :, 1:].float(), cm_tn[:, :, 1:].detach().float()) + + +# ---------------------------------------------------------------------------- +# 上游转写:dmd_gm.py:193-246 +# ---------------------------------------------------------------------------- + +def _upstream_dmd(teacher, critic, generated, cond_t, grad_mask, seed, cfg=1.0, cond_u=None): + eval_idx = torch.nonzero(grad_mask, as_tuple=False).flatten() + eval_idx = eval_idx[eval_idx >= 1] # 永不含 cell 0 + with torch.no_grad(): + torch.manual_seed(seed) # 与被测方共用同一份加噪抽签 + noisy, ts_pf, sigma, _ = flow_pf.ti2v_noise(generated.detach()) + sig = sigma.view(generated.shape[0], 1, 1, 1, 1) + x0_real_c = noisy - sig * teacher(noisy, ts_pf, **cond_t) + if abs(cfg - 1.0) < 1e-6: + pred_real = x0_real_c + else: + x0_real_u = noisy - sig * teacher(noisy, ts_pf, **cond_u) + pred_real = x0_real_u + cfg * (x0_real_c - x0_real_u) # ★ x0 空间 + pred_fake = noisy - sig * critic(noisy, ts_pf, **cond_t) + raw_grad = pred_fake - pred_real + p_real = generated.detach() - pred_real + normalizer = p_real[:, :, eval_idx].abs().mean(dim=[1, 2, 3, 4], keepdim=True).clamp(min=1e-2) + grad = torch.nan_to_num(raw_grad / normalizer) + target = (generated - grad).detach() + loss = 0.5 * F.mse_loss(generated[:, :, eval_idx].float(), target[:, :, eval_idx].float()) + return loss, float(grad[:, :, eval_idx].norm()) + + +def _upstream_critic(critic, generated, cond_t, seed): + clip = generated.detach() + torch.manual_seed(seed) + noisy, ts_pf, _, noise = flow_pf.ti2v_noise(clip) + return F.mse_loss(critic(noisy, ts_pf, **cond_t)[:, :, 1:].float(), + (noise - clip)[:, :, 1:].float()) # v = ε − x0 + + +# ---------------------------------------------------------------------------- +# 夹具 +# ---------------------------------------------------------------------------- + +@pytest.fixture(scope="module") +def cd_fix(): + stu, ema, tea = _fp32_model(True, 0), _fp32_model(True, 1), _fp32_model(True, 2) + for m in (ema, tea): + m.requires_grad_(False).eval() + g = torch.Generator().manual_seed(7) + x0 = torch.randn(B, C, F_CD, LH, LW, generator=g) + ctx = torch.randn(B, F_CD, L_TXT, 4096, generator=g) + ids = torch.zeros(B, F_CD, dtype=torch.int64) + off = _offsets(F_CD, g) + noise = torch.randn(x0.shape, generator=g) + batch = {"input_latents": x0, "context": ctx, "context_ids": ids, "offset_px": off} + cond = dict(context=ctx, context_ids=ids, offset_px=off, + mask_input=make_mask_input(off, LH, LW), first_frame_cond=True, + clean_x=x0, aug_t=None) + sig, tst, _ = S2.build_cd_axis("deploy", flow_pf.DEPLOY_DENOISE_LIST, 48, 0.0, log=lambda *a: None) + return dict(stu=stu, ema=ema, tea=tea, x0=x0, ctx=ctx, ids=ids, off=off, + noise=noise, batch=batch, cond=cond, sig=sig, tst=tst) + + +@pytest.fixture(scope="module") +def dmd_fix(): + teacher, critic = _fp32_model(False, 1), _fp32_model(False, 2) + for m in (teacher, critic): + m.requires_grad_(False).eval() + g = torch.Generator().manual_seed(11) + gen = (torch.randn(B, C, F_TAIL, LH, LW, generator=g) * 0.7).requires_grad_(True) + ctx = torch.randn(B, F_TAIL, L_TXT, 4096, generator=g) + ids = torch.zeros(B, F_TAIL, dtype=torch.int64) + off = _offsets(F_TAIL, g) + off = off - off[:, :1] # scored tail 锚在自己的 cell 0 + cond_t = dict(context=ctx, context_ids=ids, offset_px=off, + mask_input=make_mask_input(off, LH, LW), first_frame_cond=True) + cond_u = dict(cond_t, context=torch.randn(B, F_TAIL, L_TXT, 4096, generator=g), + context_ids=torch.zeros(B, F_TAIL, dtype=torch.int64)) + grad_mask = torch.tensor([False] + [True] * (F_TAIL - 1)) # K == horizon 的配方形态 + return dict(teacher=teacher, critic=critic, gen=gen, cond_t=cond_t, cond_u=cond_u, + grad_mask=grad_mask) + + +# ---------------------------------------------------------------------------- +# 1-2. stage2 CD +# ---------------------------------------------------------------------------- + +def test_1_cd_loss_is_bit_identical_to_cd_gm(cd_fix): + """轴上**每一对**都比。一对一对地比而不是只比第一对:σ 用错档这类 bug 在 idx=0 + (σ_t=1.0)上最不显眼。""" + d = cd_fix + for i in range(d["sig"].shape[0] - 1): + port, _ = S2.cd_loss(d["stu"], d["ema"], d["tea"], d["batch"], + sig_t=float(d["sig"][i]), sig_tn=float(d["sig"][i + 1]), + t_v=float(d["tst"][i]), tn_v=float(d["tst"][i + 1]), + teacher_forcing=True, noise=d["noise"]) + ref = _upstream_cd(d["stu"], d["ema"], d["tea"], d["x0"], d["cond"], + d["sig"], d["tst"], i, noise=d["noise"]) + assert float(port.detach()) == float(ref.detach()), ( + f"轴对 {i}(σ {float(d['sig'][i]):.4f}→{float(d['sig'][i+1]):.4f}):" + f"移植 {float(port.detach()):.10f} vs cd_gm.py 转写 {float(ref.detach()):.10f}") + + +def test_2_cd_teacher_cfg_stays_in_v_space(cd_fix): + """cfg==1 时 `u + 1·(c−u) ≡ c`,所以 CFG 写在哪个空间都看不出来;只有 cfg>1 才分叉。 + stage2 的教师 CFG 在 **v 空间**(stage3 的在 x0 空间,两者不能互抄)。""" + d = cd_fix + cond_u = dict(d["cond"], context=d["ctx"] * 0.5, context_ids=torch.zeros_like(d["ids"])) + port, _ = S2.cd_loss(d["stu"], d["ema"], d["tea"], d["batch"], + sig_t=float(d["sig"][0]), sig_tn=float(d["sig"][1]), + t_v=float(d["tst"][0]), tn_v=float(d["tst"][1]), + real_guidance_scale=3.0, uncond=d["ctx"] * 0.5, + uncond_ids=torch.zeros_like(d["ids"]), noise=d["noise"]) + ref = _upstream_cd(d["stu"], d["ema"], d["tea"], d["x0"], d["cond"], d["sig"], d["tst"], 0, + cfg=3.0, noise=d["noise"], cond_u=cond_u) + assert float(port.detach()) == float(ref.detach()), (float(port.detach()), float(ref.detach())) + + +def test_3_bf16_latent_is_the_only_known_deviation(cd_fix): + """本移植把 lat_t 留在 bf16(σ 是 python 标量),上游是 fp32(σ 是 0 维张量)—— + 这是**有意**的:模型在 autocast 下看到的本来就是 bf16 的那一份。把它钉成上界, + 免得哪天变成别的东西。""" + d = cd_fix + stu, ema, tea = (_fp32_model(True, s) for s in (0, 1, 2)) + for m in (stu, ema, tea): + m.to(torch.bfloat16) + for m in (ema, tea): + m.requires_grad_(False).eval() + x0 = d["x0"].to(torch.bfloat16) + noise = d["noise"].to(torch.bfloat16) + batch = dict(d["batch"], input_latents=x0, context=d["ctx"].to(torch.bfloat16)) + cond = dict(d["cond"], clean_x=x0, context=d["ctx"].to(torch.bfloat16)) + port, _ = S2.cd_loss(stu, ema, tea, batch, sig_t=float(d["sig"][0]), sig_tn=float(d["sig"][1]), + t_v=float(d["tst"][0]), tn_v=float(d["tst"][1]), noise=noise) + ref = _upstream_cd(stu, ema, tea, x0, cond, d["sig"], d["tst"], 0, noise=noise) + rel = abs(float(port.detach()) - float(ref.detach())) / max(float(ref.detach()), 1e-12) + assert rel < 5e-3, f"bf16 下的偏差 {rel:.2e} 超出已知量级(实测 ~2e-3)" + + +# ---------------------------------------------------------------------------- +# 4-6. stage3 DMD +# ---------------------------------------------------------------------------- + +@pytest.mark.parametrize("cfg", [1.0, 3.0]) +def test_4_dmd_loss_and_gradient_are_bit_identical_to_dmd_gm(dmd_fix, cfg): + """loss **和** `d loss / d generated` 都比。只比 loss 挡不住 surrogate 的常数因子写错 + (0.5 掉了 loss 会变,但 target 若同时改也可能对上);梯度才是真正被 backward 用的东西。""" + d = dmd_fix + uc = None if cfg == 1.0 else d["cond_u"] + torch.manual_seed(123) + port, log = S3.dmd_generator_loss( + d["teacher"], d["critic"], d["gen"], d["cond_t"], d["grad_mask"], + real_guidance_scale=cfg, + uncond_context=(None if uc is None else uc["context"]), + uncond_ids=(None if uc is None else uc["context_ids"])) + ref, ref_gnorm = _upstream_dmd(d["teacher"], d["critic"], d["gen"], d["cond_t"], + d["grad_mask"], seed=123, cfg=cfg, cond_u=uc) + assert float(port.detach()) == float(ref.detach()), (cfg, float(port.detach()), float(ref.detach())) + assert log["dmd_gnorm"] == ref_gnorm, (log["dmd_gnorm"], ref_gnorm) + gp = torch.autograd.grad(port, d["gen"], retain_graph=True)[0] + gr = torch.autograd.grad(ref, d["gen"], retain_graph=True)[0] + assert float((gp - gr).abs().max()) == 0.0, float((gp - gr).abs().max()) + + +def test_5_critic_loss_is_bit_identical_to_dmd_gm(dmd_fix): + """配方里 K == grad_horizon,此时 eval_idx ≡ [:, :, 1:],所以可以直接与上游对。 + 这一条同时钉住目标的符号:v = ε − x0,反过来写 loss 照样会降。""" + d = dmd_fix + ei = torch.nonzero(d["grad_mask"], as_tuple=False).flatten() + ei = ei[ei >= 1] + assert ei.tolist() == list(range(1, F_TAIL)), ei.tolist() + torch.manual_seed(77) + port, _ = S3.critic_loss(d["critic"], d["gen"], d["cond_t"], ei, + use_gradient_checkpointing=False) + ref = _upstream_critic(d["critic"], d["gen"], d["cond_t"], seed=77) + assert float(port.detach()) == float(ref.detach()), (float(port.detach()), float(ref.detach())) + + +def test_6_normalizer_floor_is_exactly_1e_2(dmd_fix): + """把 teacher 换成解析速度场使 `pred_real ≡ generated` ⇒ `p_real ≡ 0`,于是 normalizer + 只剩 clamp 的下限;再让 critic 给出 `pred_fake = generated + 1` ⇒ DMD 梯度恒等于 + `1 / 1e-2 = 100`。下限被改成别的数,这里就直接读出来。""" + d = dmd_fix + gen = d["gen"] + torch.manual_seed(31) + noisy, ts_pf, sigma, _ = flow_pf.ti2v_noise(gen.detach()) + sig = sigma.view(B, 1, 1, 1, 1) + + class _T: # v ⇒ x0_real ≡ generated + def __call__(self, x, t, **kw): return ((noisy - gen.detach()) / sig).to(x.dtype) + + class _Cr: # v ⇒ pred_fake ≡ generated + 1 + def __call__(self, x, t, **kw): return ((noisy - (gen.detach() + 1.0)) / sig).to(x.dtype) + + torch.manual_seed(31) # 同一份加噪,noisy/sigma 才与上面一致 + target, eval_idx, log = S3.dmd_targets(_T(), _Cr(), gen, d["cond_t"], d["grad_mask"]) + grad = (gen - target)[:, :, eval_idx] + assert abs(log["dmd_norm"] - 1e-2) < 1e-9, log["dmd_norm"] + assert abs(float(grad.abs().mean()) - 100.0) < 1e-2, float(grad.abs().mean()) + + +if __name__ == "__main__": + sys.exit(pytest.main([__file__, "-q", "-s"])) diff --git a/backup_2026-09-14/code/distill/tests/test_stage2_cd.py b/backup_2026-09-14/code/distill/tests/test_stage2_cd.py new file mode 100644 index 0000000000000000000000000000000000000000..216cc1b0acece1187ff26487446cd841f9891d34 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_stage2_cd.py @@ -0,0 +1,379 @@ +#!/usr/bin/env python3 +"""stage2(因果一致性蒸馏)的门禁。 + +为什么需要这个文件 +----------------- +distill/tests/ 里原有的 150 条测试全部是 stage1 与共享设施的;**没有一条**碰过 +stage2_cd/cd_arope.py。实测过:把 `cm_tn = lat_tn - s_tn*v_e` 改成 `- s_t*v_e` +(一致性目标算错噪声档,CD 里最经典的静默 bug),整套 150 条照样全绿,`--dry_run` +也照样跑完、loss 还是 0.0x 的漂亮数字。也就是说 stage2 在此之前是**完全没有门禁**的。 + +这里的每一条都对着一个「不报错、loss 照降、只是训歪」的失效: + +* test_1 轴的节点必须逐点就是部署读点(用户拍板的 4 步表) +* test_2 ★ 用**解析预言机**把 cd_loss 钉死成恒等于 0 —— 一次同时守住 σ_t/σ_tn 用对没有、 + 教师 Euler 步方向对不对、x0 估计公式 `x_t − σ·v` 有没有写反 +* test_3 梯度只能到学生,教师 / EMA 必须是 0 +* test_4 三次前向共用**同一批** cond 对象(换了就不是同一条轨迹上的两点) +* test_5 cell 0 在三条流里都被钉成 GT +* test_6 _keep_frame0 out-of-place、可反传 +* test_7 检查点 metadata 配方不符必须 SystemExit +* test_8 discrete 轴必须报出「部署读点掉出轴」 + +全部 CPU、tiny 模型,整文件几秒钟。 +""" +import os +import sys +import types + +import pytest +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from distill import flow_pf # noqa: E402 +from distill.stage2_cd import cd_arope as S2 # noqa: E402 + +TOL_ORACLE = 1e-10 # 预言机路径全程 fp32,残差应当在机器精度上 +B, C, F, H, W = 1, 48, 5, 8, 10 + + +# ---------------------------------------------------------------------------- +# 工具 +# ---------------------------------------------------------------------------- + +def _batch(dtype=torch.float32, seed=0): + """形状与 AropeLatentDataset 一致的合成 batch(cd_loss 只用这四个键)。""" + g = torch.Generator().manual_seed(seed) + off = torch.zeros(B, F, 2) + off[:, 1:] = torch.randn(B, F - 1, 2, generator=g).cumsum(1) * 20.0 + return { + "input_latents": torch.randn(B, C, F, H, W, generator=g).to(dtype), + "context": torch.randn(B, F, 8, 4096, generator=g).to(dtype), + "context_ids": torch.zeros(B, F, dtype=torch.int64), + "offset_px": off, + } + + +class _Oracle: + """流匹配的**解析**速度场:v(x, t) ≡ ε − x0,与 x、t 都无关。 + + 对这个场,PF-ODE dx/dσ = v 是线性的,所以: + · 单个 Euler 步 **精确**:lat_t + (σ_tn−σ_t)·v = (1−σ_tn)x0 + σ_tn·ε + · x0 估计 **精确**:x_σ − σ·v = (1−σ)x0 + σ·ε − σ(ε−x0) = x0,对**任何** σ 成立 + 于是学生与 EMA 的 x0 估计都恒等于 x0,cd_loss 必须恰好是 0。 + 任何一处用错 σ(比如 cm_tn 用了 σ_t)都会立刻把它推离 0(下面 test_2 量到 ~1.2e-1)。 + """ + + def __init__(self, x0, noise): + self.v = (noise - x0) + self.calls = [] # [(x, t, cond)],供 test_4 / test_5 检查 + + def __call__(self, x, t, **kw): + kw.pop("use_gradient_checkpointing", None) + self.calls.append((x, float(t), kw)) + return self.v.clone() + + +def _axis(): + sig, tst, info = S2.build_cd_axis("deploy", flow_pf.DEPLOY_DENOISE_LIST, 48, 0.0, log=lambda *a: None) + return sig, tst, info + + +# ---------------------------------------------------------------------------- +# 1. 一致性轴 == 部署采样表 +# ---------------------------------------------------------------------------- + +def test_1_deploy_axis_nodes_are_exactly_the_deploy_read_points(): + """用户拍板:stage2 的 CD 轴与 stage3 都必须训在 1000/750/500/250 这张 4 步表上。 + 这条把「轴」与「部署表」焊死:flow_pf.deploy_schedule 是唯一真源。""" + sig, tst, info = _axis() + d_idx, d_sig, d_t = flow_pf.deploy_schedule(flow_pf.DEPLOY_DENOISE_LIST) + assert torch.equal(sig, d_sig), f"轴节点与部署读点不同:{sig.tolist()} vs {d_sig.tolist()}" + assert torch.equal(tst, d_t) + assert info["K"] == 4 and info["pairs"] == 3, (info["K"], info["pairs"]) + # 严格降序(从噪到净);一致性对的下标只能取 [0, K-2] + assert torch.all(sig[1:] < sig[:-1]), sig.tolist() + assert info["deploy_off_axis"] == [], info["deploy_off_axis"] + # 部署读点逐点落在轴上(build_cd_axis 内部也断言,这里独立复核一遍) + flow_pf.assert_deploy_covered(sig, flow_pf.DEPLOY_DENOISE_LIST) + + +# ---------------------------------------------------------------------------- +# 2. ★ 解析预言机:cd_loss 必须恰好是 0 +# ---------------------------------------------------------------------------- + +def test_2_oracle_makes_cd_loss_exactly_zero(): + """三个模型都换成解析速度场时,学生与 EMA 的 x0 估计都恒等于 x0 ⇒ loss ≡ 0。 + + 这是本文件最强的一条:它不是在测「loss 小」,而是在测一条**恒等式**。 + 实测拿它抓 `cm_tn` 用错 σ 的注入 bug:loss 从 0.0 变成 1.2e-01(差 11 个数量级)。 + """ + batch = _batch() + x0 = batch["input_latents"] + noise = torch.randn(x0.shape, generator=torch.Generator().manual_seed(7)) + sig, tst, _ = _axis() + + for i in range(len(sig) - 1): # 轴上每一对都要成立,不是只测第一对 + m = _Oracle(x0, noise) + loss, stats = S2.cd_loss(m, m, m, batch, + sig_t=float(sig[i]), sig_tn=float(sig[i + 1]), + t_v=float(tst[i]), tn_v=float(tst[i + 1]), + noise=noise) + assert torch.isfinite(loss), (i, loss) + assert float(loss) < TOL_ORACLE, ( + f"轴对 {i}(σ {float(sig[i])}→{float(sig[i+1])})的预言机 loss 应当恰好是 0,得到 {float(loss):.3e}。" + "σ 用错档 / Euler 步方向反了 / x0 估计写成 x+σv 都会打在这里") + # 两条诊断量也必须是 0:cm_err/tgt_err 是「x0 估计离真 x0 多远」 + assert float(stats["cm_err"]) < TOL_ORACLE, float(stats["cm_err"]) + assert float(stats["tgt_err"]) < TOL_ORACLE, float(stats["tgt_err"]) + assert stats["sigma_t"] == float(sig[i]) and stats["sigma_tn"] == float(sig[i + 1]) + + +def test_2b_oracle_loss_is_nonzero_when_the_target_reads_the_wrong_sigma(): + """test_2 的负控制:手工按「cm_tn 用了 σ_t」重算一遍,确认那个 bug 确实会把 loss 顶起来。 + 没有这一条,test_2 可能只是在测「0 == 0」。""" + batch = _batch() + x0 = batch["input_latents"] + noise = torch.randn(x0.shape, generator=torch.Generator().manual_seed(7)) + sig, tst, _ = _axis() + s_t, s_tn = float(sig[0]), float(sig[1]) + v = noise - x0 + lat_tn = (1.0 - s_tn) * x0 + s_tn * noise + good = lat_tn - s_tn * v # == x0 + bad = lat_tn - s_t * v # 注入 bug 的形态 + assert torch.allclose(good, x0, atol=1e-6) + err = torch.nn.functional.mse_loss(bad[:, :, 1:], x0[:, :, 1:]) + assert float(err) > 1e-3, float(err) # 实测 ~1.2e-1 + + +# ---------------------------------------------------------------------------- +# 3. 梯度只到学生 +# ---------------------------------------------------------------------------- + +def test_3_gradient_reaches_only_the_student(): + """teacher / ema 必须全程 no_grad。任何一个漏了都不会报错,只是在把目标网络一起优化掉 + (CD 会立刻塌成平凡解)。""" + student, teacher, ema = S2._tiny_model(), S2._tiny_model(), S2._tiny_model() + for m in (teacher, ema): + m.eval() + for p in m.parameters(): + p.requires_grad_(False) + student.train() + batch = _batch(dtype=torch.bfloat16) + sig, tst, _ = _axis() + loss, _ = S2.cd_loss(student, ema, teacher, batch, + sig_t=float(sig[0]), sig_tn=float(sig[1]), + t_v=float(tst[0]), tn_v=float(tst[1]), + gen=torch.Generator().manual_seed(3)) + assert torch.isfinite(loss) and float(loss.detach()) > 0 + loss.backward() + n_grad = sum(1 for p in student.parameters() if p.grad is not None and p.grad.abs().sum() > 0) + assert n_grad > 0, "学生一个参数都没拿到梯度:cd_loss 与优化器之间断了" + for name, m in (("teacher", teacher), ("ema", ema)): + leaked = [n for n, p in m.named_parameters() if p.grad is not None and p.grad.abs().sum() > 0] + assert not leaked, f"{name} 拿到了梯度(前 3 个 {leaked[:3]}):目标网络被一起训了" + + +# ---------------------------------------------------------------------------- +# 4 / 5. cond 恒定、cell 0 恒为 GT +# ---------------------------------------------------------------------------- + +def test_4_the_three_forwards_share_one_cond(): + """一致性步里唯一允许变的是噪声档与被加噪的 latent。cond 变了,学生与目标就不在 + 同一条轨迹上,loss 依旧收敛、学到的却是别的东西。""" + batch = _batch() + x0 = batch["input_latents"] + noise = torch.randn(x0.shape, generator=torch.Generator().manual_seed(1)) + sig, tst, _ = _axis() + m = _Oracle(x0, noise) + S2.cd_loss(m, m, m, batch, sig_t=float(sig[0]), sig_tn=float(sig[1]), + t_v=float(tst[0]), tn_v=float(tst[1]), noise=noise) + assert len(m.calls) == 3, [c[1] for c in m.calls] # teacher / student / ema 各一次 + keys = ("context", "context_ids", "offset_px", "mask_input", "first_frame_cond", "clean_x") + base = m.calls[0][2] + for j, (_, _, cond) in enumerate(m.calls[1:], start=1): + for k in keys: + a, b = base[k], cond[k] + if isinstance(a, torch.Tensor): + assert a is b, f"第 {j} 次前向的 cond['{k}'] 不是同一个对象" + else: + assert a == b, (k, a, b) + assert base["first_frame_cond"] is True + assert base["clean_x"] is x0, "teacher_forcing 时 clean_x 必须就是这一批的干净 GT" + # 时间步:teacher 与 student 都在 σ_t 档,ema 在 σ_tn 档 + assert m.calls[0][1] == float(tst[0]) and m.calls[1][1] == float(tst[0]) + assert m.calls[2][1] == float(tst[1]) + + +def test_5_cell0_is_pinned_to_ground_truth_in_all_three_streams(): + """cell 0 是干净锚点。三条流里任何一条没钉住,学生就会学到「首帧也是噪声」。""" + batch = _batch() + x0 = batch["input_latents"] + noise = torch.randn(x0.shape, generator=torch.Generator().manual_seed(2)) + sig, tst, _ = _axis() + m = _Oracle(x0, noise) + S2.cd_loss(m, m, m, batch, sig_t=float(sig[0]), sig_tn=float(sig[1]), + t_v=float(tst[0]), tn_v=float(tst[1]), noise=noise) + for j, (x, _, _) in enumerate(m.calls): + assert torch.equal(x[:, :, 0], x0[:, :, 0]), f"第 {j} 次前向的 cell 0 不是 GT" + # 其余 cell 必须**已经**被加噪(否则 _keep_frame0 把整片都钉住了) + assert not torch.equal(m.calls[1][0][:, :, 1:], x0[:, :, 1:]) + + +def test_6_keep_frame0_is_out_of_place_and_differentiable(): + a = torch.randn(1, 2, 4, 3, 3, requires_grad=True) + clip = torch.randn(1, 2, 4, 3, 3) + out = S2._keep_frame0(a, clip) + assert out is not a and a.grad is None # out-of-place + assert torch.equal(out[:, :, 0], clip[:, :, 0]) + assert torch.equal(out[:, :, 1:], a[:, :, 1:]) + out.sum().backward() # 可反传,且 cell 0 不回传到 a + assert a.grad is not None + assert float(a.grad[:, :, 0].abs().sum()) == 0.0 + assert float(a.grad[:, :, 1:].abs().sum()) > 0.0 + + +# ---------------------------------------------------------------------------- +# 7 / 8. 启动期守卫 +# ---------------------------------------------------------------------------- + +def test_7_ckpt_metadata_gate_rejects_a_recipe_mismatch(tmp_path): + """stage1 关了 TF 而 stage2 开着 ⇒ 学生的历史从来没干净过。不报错、loss 照降。""" + from safetensors.torch import save_file + p = str(tmp_path / "dit_step100.safetensors") + save_file({"w": torch.zeros(2)}, p, + metadata={"stage": "stage1_ar", "step": "100", "teacher_forcing": "False", + "windowed_train": "0", "windowed_sink": "0"}) + args = types.SimpleNamespace(teacher_forcing=True, windowed_train=0, windowed_sink=0) + with pytest.raises(SystemExit) as e: + S2._ckpt_meta_gate(p, args, log=lambda *a: None) + assert "teacher_forcing" in str(e.value) + + args_ok = types.SimpleNamespace(teacher_forcing=False, windowed_train=0, windowed_sink=0) + meta = S2._ckpt_meta_gate(p, args_ok, log=lambda *a: None) # 配方一致 ⇒ 放行 + assert meta["teacher_forcing"] == "False" + + # 没有 metadata / 读不出来都只能 warn,不能拦训练 + p2 = str(tmp_path / "nometa.safetensors") + save_file({"w": torch.zeros(2)}, p2) + assert S2._ckpt_meta_gate(p2, args, log=lambda *a: None) == {} + p3 = str(tmp_path / "garbage.safetensors") + open(p3, "wb").write(b"not a safetensors file at all") + assert S2._ckpt_meta_gate(p3, args, log=lambda *a: None) == {} + + +def test_8_discrete_axis_reports_the_deploy_points_that_fall_off_it(): + """`--cd_axis discrete` 是对照臂,不是默认。它必须**明说**部署读点掉出了轴 —— + 否则那两档从没被一致性约束过,推理时却要在那里读 x0。""" + lines = [] + sig, tst, info = S2.build_cd_axis("discrete", flow_pf.DEPLOY_DENOISE_LIST, 48, 0.0, + log=lines.append) + assert info["K"] == 48 and torch.all(sig[1:] < sig[:-1]) + assert info["deploy_off_axis"], "N=48 密轴上部署读点本来就落不全,off_axis 不该是空的" + assert any("[axis][warn]" in ln for ln in lines), lines + # deploy 轴则一个都不掉 + _, _, info_d = S2.build_cd_axis("deploy", flow_pf.DEPLOY_DENOISE_LIST, 48, 0.0, log=lambda *a: None) + assert info_d["deploy_off_axis"] == [] + + +# ---------------------------------------------------------------------------- +# 9. 三处配方:run.sh 默认 == argparse 默认 == config.json(PORT_SPEC risk 11) +# ---------------------------------------------------------------------------- + +def _norm_path(x) -> str: + """路径常量在 run.sh 里写成 `$ROOT/...`、config.json 里写成相对路径、argparse 里是绝对路径 —— + 三种写法指的是同一个位置,比较前统一成相对 ROOT 的形式。""" + t = str(x) + for pre in (f"{ROOT}/", "$ROOT/", "${ROOT}/"): + if t.startswith(pre): + return t[len(pre):] + return t + + +def _same(a, b) -> bool: + try: + return abs(float(a) - float(b)) < 1e-12 + except (TypeError, ValueError): + return _norm_path(a) == _norm_path(b) + + +def _check_three_places(stage: str, args: dict, alias: dict, skip: set, derived: set, + literals: set, flags: tuple) -> list: + """run.sh 的 `VAR="${VAR:-default}"` 默认值、ARGS=( ... ) 里的硬编码字面量、config.json, + 逐项对 argparse 默认值 `args`。返回比过的 dest 列表;不一致直接 assert。""" + import json + import re + sh = open(os.path.join(ROOT, "distill", stage, "run.sh"), encoding="utf-8").read() + cfg = json.load(open(os.path.join(ROOT, "distill", stage, "config.json"), encoding="utf-8")) + env: dict = {} + for name, val in re.findall(r'^\s*([A-Z_][A-Z0-9_]*)="\$\{\1:-([^}]*)\}"', sh, re.M): + env.setdefault(name, []).append(val) + checked, bad = [], [] + for name, vals in env.items(): + if name in skip: + continue + dest = alias.get(name, name.lower()) + if name in alias: + assert dest in args, f"别名表把 {name} 映到了不存在的 argparse dest {dest!r}" + if dest not in args or dest in derived: + continue + checked.append(dest) + # 同一个变量若按并行度分支(如 GRAD_ACCUM 的 4 卡 / 8 卡),argparse 默认值须是其中之一 + if not any(_same(v, args[dest]) for v in vals): + bad.append(f"{dest}: run.sh={vals!r} argparse={args[dest]!r}") + # ARGS=( ... ) 里的硬编码字面量(`--opt8bit 0` 这类不走环境变量的)也必须等于 argparse 默认值 + block = re.search(r"^ARGS=\((.*?)^\)", sh, re.M | re.S).group(1) + lits = dict(re.findall(r'--([A-Za-z0-9_]+)\s+(?!["$-])(\S+)', block)) + assert literals <= set(lits), f"run.sh ARGS 里的硬编码字面量变了:{sorted(lits)}(应含 {sorted(literals)})" + for dest, v in lits.items(): + assert dest in args, f"run.sh ARGS 传了 --{dest},argparse 里没有" + checked.append(dest) + if not _same(v, args[dest]): + bad.append(f"{dest}: run.sh 字面量={v!r} argparse={args[dest]!r}") + found_flags = set() + for flag in flags: # 裸开关:出现即 True(词边界匹配,行中位置也算) + if re.search(rf"--{flag}(?=\s|$)", block, re.M): + found_flags.add(flag) + checked.append(flag) + if args[flag] is not True: + bad.append(f"{flag}: run.sh 传了 --{flag},argparse 默认却是 {args[flag]!r}") + assert found_flags == set(flags), f"run.sh ARGS 里没找到这些裸开关(检查会空过):{sorted(set(flags) - found_flags)}" + for dest in checked: + if dest in cfg and not isinstance(cfg[dest], (dict, list)) and not _same(cfg[dest], args[dest]): + bad.append(f"{dest}: config.json={cfg[dest]!r} argparse={args[dest]!r}") + assert len(checked) >= 20, f"只比到 {len(checked)} 个常量,正则大概率没匹配上 run.sh:{checked}" + assert not bad, "三处配方不一致:\n " + "\n ".join(bad) + return checked + + +# run.sh 的环境变量名 → argparse dest(其余按小写同名)。ckpt / 输出路径 / 端口 / RESUME 故意不比: +# RESUME=auto 是 run.sh 唯一**有意**与 argparse(None)不同的地方 +_RUN_SH_ALIAS = { + "DISCRETE_N": "discrete_cd_N", "SOLVER_STEPS": "teacher_solver_steps", + "CFG_SCALE": "real_guidance_scale", "MIN_RT": "min_rt_ratio", + "WINDOW": "windowed_train", "WINDOW_SINK": "windowed_sink", + "KEEP_EMAS": "keep_last_emas", "KEEP_DITS": "keep_last_dits", + "TEACHER_CAUSAL": "teacher_causal", "CD_AXIS": "cd_axis", + "DENOISE_LIST": "denoise_list", "CD_TAIL_T": "cd_tail_t", +} +_RUN_SH_SKIP = {"STAGE1_OUT", "AR", "OUT", "PORT", "ACC_CFG", "RESUME", "FORCE_RUN_DIR"} +_DERIVED = {"betas", "denoise"} # parse_args 从 adam_betas / denoise_list 派生的,不是 CLI 常量 + + +def test_9_run_sh_defaults_match_argparse_defaults_and_config_json(tmp_path): + """RUNBOOK 铁律:run.sh 默认 == argparse 默认 == config.json。上游 A 的 run.sh 与 argparse + 六处不一致、每处对应一次已知崩溃;这个移植只允许存在一份配方,改一处不改另两处要在这里被拦。""" + # --dry_run:否则 parse_args 会因 --teacher_ckpt/--student_ckpt 缺失而 SystemExit + a = vars(S2.parse_args(["--output", str(tmp_path / "_argparse_probe"), "--dry_run"])) + checked = _check_three_places("stage2_cd", a, _RUN_SH_ALIAS, _RUN_SH_SKIP, _DERIVED, + literals={"opt8bit", "batch_size"}, + flags=("teacher_forcing", "gradient_checkpointing")) + print(f"9. recipe run.sh == argparse == config.json:{len(checked)} 个常量 {sorted(checked)}") + + +if __name__ == "__main__": + raise SystemExit(pytest.main([__file__, "-q", "-s"])) diff --git a/backup_2026-09-14/code/distill/tests/test_stage2_flowmap.py b/backup_2026-09-14/code/distill/tests/test_stage2_flowmap.py new file mode 100644 index 0000000000000000000000000000000000000000..57264514b2edf6b76c18b093de683c2ad96de7a1 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_stage2_flowmap.py @@ -0,0 +1,536 @@ +# -*- coding: utf-8 -*- +"""stage2-flowmap 训练器(`distill/stage2_flowmap/fm_arope.py`)的编排闸门。 + +为什么单独一份:`distill/tests/test_flowmap_objective.py` 只盯 `distill/flowmap.py` 的数学, +`distill/tests/test_flowmap_model.py` 只盯 `distill/arope_dit.py` 的 delta 分支。**把这两块拼起来的 +那 1082 行 —— 谁被 drop、哪条 g_j 还活着、主前向拿到的是 t 还是 r、den 有没有传进中心差分、 +TF 干净流在不在、cell 0 有没有钉住 —— 之前一行测试都没有。** + +实测(对抗性注入实验,2026-09-06):往 flowmap.py / arope_dit.py 里注入 7 个 bug,7 个全被抓; +往 fm_arope.py 的 `fm_loss` 里注入同一类 7 个 bug(t/r 对调、修正项变号、guidance 增益取反、 +den 丢掉、权重写死 uniform、first_frame_cond 关掉、TF 关掉),**7 个全部溜过**了 260 项测试。 +本文件就是把那 7 个洞堵上。 + +手法:`fm_loss(model, ...)` 只通过 `model(...)` / `unwrap(model)(...)` 碰模型,所以用一个 +**解析 + 录音**的桩替掉它,闭式算出 target / pred / loss 再逐项比对: + + u(x, t, r) = A⊙x + b·(t/1000) + c·(r/1000) + d·mean(context) + +u 对 x 线性、对 t 仿射 ⇒ 中心差分**没有截断误差**,闭式 dF/dt = (A⊙v/1000 + b/1000), +只剩 fp32 舍入。桩同时录下每一次前向的全部 kwargs,编排类的断言直接读录音。 +""" + +from __future__ import annotations + +import os +import subprocess +import sys + +import pytest +import torch + +_ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if _ROOT not in sys.path: + sys.path.insert(0, _ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from distill import flow_pf # noqa: E402 +from distill import flowmap as fm # noqa: E402 +from distill.stage2_flowmap.fm_arope import fm_loss # noqa: E402 + +SHAPE = (1, 6, 5, 4, 4) # [b, c, cells, h, w],几何无关,只要 cells >= 2 +LTOK, DTXT = 3, 8 # 文本 token 数 / 维度 +EPS = 5.0 + + +# ---------------------------------------------------------------------------- +# 解析 + 录音桩 +# ---------------------------------------------------------------------------- + +def _bcast(v, b: int, device) -> torch.Tensor: + """[b] 或标量 → [b,1,1,1,1] fp32。""" + if torch.is_tensor(v): + out = v.detach().to(device=device, dtype=torch.float32).reshape(-1) + else: + out = torch.full((b,), float(v), device=device, dtype=torch.float32) + if out.numel() == 1 and b > 1: + out = out.expand(b) + return out.reshape(b, 1, 1, 1, 1) + + +class RecModel(torch.nn.Module): + """`u = A⊙x + b·t/1000 + c·r/1000 + d·mean(context)`,并录下每一次调用。 + + 带 `nn.Parameter` 是为了让主前向的输出真的 `requires_grad`(no_grad 的那几次则不会), + engine-discipline 的断言靠这个区分。三个属性 `train_*` 是 `flowmap.null_axis` 要改的那几个。 + """ + + def __init__(self, seed: int = 0): + super().__init__() + g = torch.Generator().manual_seed(seed) + c = SHAPE[1] + mk = lambda: torch.nn.Parameter(torch.randn(1, c, 1, 1, 1, generator=g)) # noqa: E731 + self.A, self.bt, self.cr, self.dx = mk(), mk(), mk(), mk() + # null_axis 要读写的裸模块属性(真 AropeDiT 上也是这三个) + self.train_drop_anchor = False + self.train_local_attn_size = 0 + self.train_sink_size = 0 + self.calls: list[dict] = [] + + def u(self, x, t, r, ctx) -> torch.Tensor: + b, dev = x.shape[0], x.device + tv, rv = _bcast(t, b, dev), _bcast(r, b, dev) + cm = ctx.float().reshape(b, -1).mean(dim=1).reshape(b, 1, 1, 1, 1) + return self.A * x.float() + self.bt * (tv / 1000.0) + self.cr * (rv / 1000.0) + self.dx * cm + + def forward(self, x, timestep, *, r_timestep=None, context=None, context_ids=None, + offset_px=None, mask_input=None, first_frame_cond=False, + clean_x=None, aug_t=None, use_gradient_checkpointing=False, **kw): + self.calls.append(dict( + x=x.detach().clone(), t=timestep, r=r_timestep, context=context, + context_ids=context_ids, offset_px=offset_px, mask_input=mask_input, + first_frame_cond=first_frame_cond, clean_x=clean_x, aug_t=aug_t, + gc=bool(use_gradient_checkpointing), grad=torch.is_grad_enabled(), + drop_anchor=self.train_drop_anchor, + local=self.train_local_attn_size, sink=self.train_sink_size, extra=dict(kw))) + return self.u(x, timestep, timestep if r_timestep is None else r_timestep, context) + + +# ---------------------------------------------------------------------------- +# 夹具 +# ---------------------------------------------------------------------------- + +def _batch(seed: int = 7) -> dict: + g = torch.Generator().manual_seed(seed) + b, c, f, h, w = SHAPE + return { + "input_latents": torch.randn(b, c, f, h, w, generator=g), + "offset_px": torch.randn(b, f, 2, generator=g) * 8.0, + "context": torch.randn(b, f, LTOK, DTXT, generator=g), + "context_ids": torch.zeros(b, f, LTOK, dtype=torch.long), + } + + +def _uncond(seed: int = 99): + g = torch.Generator().manual_seed(seed) + b, _, f, _, _ = SHAPE + return (torch.randn(1, 1, LTOK, DTXT, generator=g).expand(b, f, -1, -1), + torch.zeros(b, f, LTOK, dtype=torch.long)) + + +def _tr(mode: str, idx_t: int = 300, gap: int = 200) -> fm.TRSample: + """手搓一个 TRSample(比让 sample_tr 随机抽再筛角色确定得多)。""" + b = SHAPE[0] + it = torch.full((b,), int(idx_t), dtype=torch.long) + t = flow_pf.t_of_idx(it) + st = flow_pf.sigma_of_idx(it) + if mode == "diffusion": # r := t,逐位相等 + ir, r, sr, role = it.clone(), t.clone(), st.clone(), fm.ROLE_DIFFUSION + elif mode == "consistency": # r := 精确 0.0(off-grid) + ir = torch.full_like(it, -1) + r, sr, role = torch.zeros_like(t), torch.zeros_like(st), fm.ROLE_CONSISTENCY + else: # random:下标更大 ⇒ σ 更小 ⇒ r < t + ir = (it + int(gap)).clamp(max=flow_pf.NUM_TRAIN_TIMESTEPS - 1) + r, sr, role = flow_pf.t_of_idx(ir), flow_pf.sigma_of_idx(ir), fm.ROLE_RANDOM + return fm.TRSample(idx_t=it, idx_r=ir, t=t, r=r, sigma_t=st, sigma_r=sr, + is_diffusion=(r == t), role=torch.full_like(it, int(role)), + slot=torch.arange(b), perm=torch.arange(b), + n_diffusion=1, n_consistency=1) + + +def _run(mode="random", gains=None, drop=None, weight_type="beta08", model=None, + gc=True, eps_clamp=True, tf=True, batch=None, noise=None, **kw): + m = model if model is not None else RecModel() + bt = batch if batch is not None else _batch() + tr = _tr(mode) + nz = noise if noise is not None else torch.randn( + SHAPE, generator=torch.Generator().manual_seed(11)) + uc, uci = _uncond() + loss_b, stats = fm_loss(m, bt, tr, gains=(gains if gains is not None else {"text": 2.0}), + uncond=uc, uncond_ids=uci, teacher_forcing=tf, + epsilon=EPS, eps_clamp=eps_clamp, weight_type=weight_type, + drop=(drop or {}), use_gradient_checkpointing=gc, noise=nz, + **kw) + return m, bt, tr, nz, (uc, uci), loss_b, stats + + +# ============================================================================ +# 1. 编排:谁拿到了 t,谁拿到了 r +# ============================================================================ + +def test_main_forward_gets_t_in_timestep_and_r_in_r_timestep(): + """t 与 r 对调是这一层最容易犯又最看不出来的错:loss 照降,学出来的是另一个流图。""" + m, _, tr, *_ = _run("random") + c0 = m.calls[0] + assert torch.equal(c0["t"].cpu(), tr.t), "主前向的 timestep 必须是 t" + assert c0["r"] is not None, "装了 flow map 就必须显式给 r_timestep" + assert torch.equal(c0["r"].cpu(), tr.r), "主前向的 r_timestep 必须是 r" + assert not torch.equal(tr.t, tr.r), "本用例要的是 off-diagonal 槽,否则 t/r 对调看不出来" + + +def test_all_forwards_share_one_r(): + """null 前向与两次探针都必须用**同一个** r:只有 t 在动,这是中心差分的定义。""" + m, _, tr, *_ = _run("random") + assert len(m.calls) >= 4 + for i, c in enumerate(m.calls): + assert torch.equal(c["r"].cpu(), tr.r), f"第 {i} 次前向的 r 被改了" + + +# ============================================================================ +# 2. 引擎纪律 +# ============================================================================ + +def test_only_the_main_forward_has_grad_and_checkpointing(): + """主前向:走引擎、开梯度检查点、带梯度。其余(null + 两次探针):no_grad、不检查点。""" + m, _, _, *_ = _run("random", gc=True) + assert m.calls[0]["gc"] is True and m.calls[0]["grad"] is True + for i, c in enumerate(m.calls[1:], start=1): + assert c["gc"] is False, f"第 {i} 次前向不该开梯度检查点(no_grad 下是纯开销)" + assert c["grad"] is False, f"第 {i} 次前向必须在 no_grad 里" + + +def test_loss_is_differentiable_only_through_the_main_forward(): + m, *_, loss_b, _ = _run("random") + assert loss_b.requires_grad + loss_b.mean().backward() + assert m.A.grad is not None and torch.isfinite(m.A.grad).all() + + +# ============================================================================ +# 3. 条件:TI2V 锚点 + teacher forcing +# ============================================================================ + +def test_every_forward_is_ti2v_anchored_and_teacher_forced(): + """`first_frame_cond=True` 把 cell 0 的 t **与 r** 一起抹成 0;clean_x 是 TF 干净流。 + 任何一个前向漏掉,条件就与部署不一致,而 loss 一样会降。""" + m, bt, *_ = _run("random", tf=True) + for i, c in enumerate(m.calls): + assert c["first_frame_cond"] is True, f"第 {i} 次前向丢了 first_frame_cond" + assert c["clean_x"] is not None, f"第 {i} 次前向丢了 TF 干净流" + assert torch.equal(c["clean_x"], bt["input_latents"]), "tf_aug=0 时 clean_x 就是 x0" + + +def test_teacher_forcing_off_is_honoured(): + m, *_ = _run("random", tf=False) + assert all(c["clean_x"] is None for c in m.calls) + + +def test_cell0_is_pinned_in_the_main_input_and_in_both_probes(): + """探针把 latent 扰动 v·ε/1000;打到 cell 0 上就破坏了整套条件所依赖的干净锚点契约。""" + m, bt, *_ = _run("random") + x0c0 = bt["input_latents"][:, :, 0] + for i, c in enumerate(m.calls): + assert torch.equal(c["x"][:, :, 0], x0c0), f"第 {i} 次前向的 cell 0 不是干净 GT" + + +# ============================================================================ +# 4. 前向次数与探针跳过 +# ============================================================================ + +def test_forward_count_random_slot(): + """1 次主前向 + 每条活跃 null 轴 1 次 + 2 次中心差分探针。""" + m, *_ = _run("random", gains={"text": 2.0}) + assert len(m.calls) == 4, [c["t"] for c in m.calls] + + +def test_probes_are_skipped_on_the_diffusion_diagonal(): + """t == r ⇒ dF/dt 恒 0 ⇒ 两次探针一次都不跑(省算力,同时是 0×NaN 的熔断器)。""" + m, *_, stats = _run("diffusion") + assert len(m.calls) == 2, "diffusion 槽只该有 主前向 + 1 次 text null" + assert stats["skip_cd"] is True and stats["dfdt"] == 0.0 + + +def test_probe_stencil_is_t_plus_minus_epsilon(): + m, _, tr, *_ = _run("random") + tp, tm = m.calls[-2]["t"], m.calls[-1]["t"] + assert torch.allclose(tp.cpu(), tr.t + EPS, atol=1e-4), f"t+ 应当是 t+ε,得到 {tp}" + assert torch.allclose(tm.cpu(), tr.t - EPS, atol=1e-4), f"t- 应当是 t−ε,得到 {tm}" + + +# ============================================================================ +# 5. 闭式核对:target / pred / loss(量纲 + 符号 + den + 权重) +# ============================================================================ + +def _closed_form(m: RecModel, bt: dict, tr: fm.TRSample, nz: torch.Tensor, + uc, gains: dict, weight_type="beta08"): + """在桩的解析形式下把 fm_loss 该给出的东西全部闭式算一遍。""" + x0 = bt["input_latents"].float() + x_t = fm.add_noise_scalar(x0, nz, tr.idx_t).float() + v = nz.float() - x0 + b = x0.shape[0] + den = 1.0 + sum(float(g) for g in gains.values()) + t5 = _bcast(tr.t, b, x0.device) + r5 = _bcast(tr.r, b, x0.device) + + def _u(x, tt, rr, ctx): + return m.u(x, tt, rr, ctx) + + f_full = _u(x_t, tr.t, tr.r, bt["context"]) + pred = f_full + for k in fm.NULL_AXES: + if k in gains: + ctx_k = uc[0] if k == "text" else bt["context"] + pred = pred + float(gains[k]) * _u(x_t, tr.t, tr.r, ctx_k) + pred = pred / den + + # dF/dt 闭式:u 对 x 线性、对 t 仿射,x(t) = x_t + v·(t−t0)/1000 + # du/dt = A⊙v/1000 + b/1000 ;再整体除以 den(上游的选择) + d_fdt = (m.A * v / 1000.0 + m.bt / 1000.0) / den + d_fdt = d_fdt * torch.ones_like(x0) + # cell 0 在两个探针里都被钉回 x0 ⇒ 那一格的 x 扰动是 0 ⇒ dF/dt 只剩 b/1000 那一项 + d_fdt[:, :, 0] = (m.bt.reshape(1, -1, 1, 1) / 1000.0 / den).expand(d_fdt[:, :, 0].shape) + target = v - (t5 - r5) * d_fdt + + se = (pred - target) ** 2 + per = se[:, :, 1:].mean(dim=(1, 2, 3, 4)) + w = fm.weight_of_idx(tr.idx_t, weight_type) + return dict(pred=pred, target=target, loss_b=per * w, den=den, + mse=se[:, :, 1:].mean(), w=w) + + +def test_target_and_loss_match_the_closed_form(): + """一次抓住:量纲(/1000)、修正项符号、(t−r) 方向、den 有没有传进中心差分、权重。""" + gains = {"text": 2.0} + m, bt, tr, nz, uc, loss_b, stats = _run("random", gains=gains) + cf = _closed_form(m, bt, tr, nz, uc, gains) + assert stats["den"] == cf["den"] == 3.0 + rel = float((loss_b - cf["loss_b"]).abs().max() / cf["loss_b"].abs().max()) + assert rel < 2e-5, f"loss 与闭式差 {rel:.2e}(loss={loss_b.tolist()} 闭式={cf['loss_b'].tolist()})" + assert abs(float(stats["mse"]) - float(cf["mse"])) / float(cf["mse"]) < 2e-5 + + +def test_correction_term_sign_and_direction(): + """把 (t−r)·dF/dt 的符号或方向弄反,target 会偏离闭式 —— 显式钉住这一项本身。""" + gains = {"text": 2.0} + m, bt, tr, nz, uc, loss_b, _ = _run("random", gains=gains) + cf = _closed_form(m, bt, tr, nz, uc, gains) + v = nz.float() - bt["input_latents"].float() + corr = cf["target"] - v # = −(t−r)·dF/dt + assert float(corr.abs().max()) > 1e-4, "修正项量级太小,这个用例区分不出符号" + # 反号 / 反方向的 target 必须给出显著不同的 loss + for bad in (v - corr, v + 2 * corr): + se = (cf["pred"] - bad) ** 2 + bad_loss = se[:, :, 1:].mean(dim=(1, 2, 3, 4)) * cf["w"] + assert float((bad_loss - loss_b).abs().max() / loss_b.abs().max()) > 1e-3 + + +def test_central_difference_is_divided_by_den(): + """den 只出现在 dF/dt 的分母里;把它丢掉在 r==t 上完全看不出来,只有 off-diagonal 能抓。""" + kw = dict(mode="random", batch=_batch(), noise=torch.randn( + SHAPE, generator=torch.Generator().manual_seed(11))) + m1, bt, tr, nz, uc, l1, s1 = _run(gains={"text": 2.0}, model=RecModel(0), **kw) + m2, *_, l2, s2 = _run(gains={"text": 2.0, "anchor": 1.0}, model=RecModel(0), **kw) + assert s1["den"] == 3.0 and s2["den"] == 4.0 + cf2 = _closed_form(m2, bt, tr, nz, uc, {"text": 2.0, "anchor": 1.0}) + rel = float((l2 - cf2["loss_b"]).abs().max() / cf2["loss_b"].abs().max()) + assert rel < 2e-5, f"den=4 时 loss 与闭式差 {rel:.2e}" + assert float((l1 - l2).abs().max()) > 0.0 + + +def test_fused_prediction_uses_plus_g_not_minus(): + """guidance 代数取反(pred = (F − g·F∅)/den)会把学生推离条件场,loss 依旧下降。""" + gains = {"text": 2.0} + m, bt, tr, nz, uc, loss_b, _ = _run("random", gains=gains) + cf = _closed_form(m, bt, tr, nz, uc, gains) + x_t = fm.add_noise_scalar(bt["input_latents"].float(), nz, tr.idx_t).float() + f_full = m.u(x_t, tr.t, tr.r, bt["context"]) + f_null = m.u(x_t, tr.t, tr.r, uc[0]) + assert float((f_full - f_null).abs().max()) > 1e-4, "text null 必须真的改变输出" + bad = (f_full - 2.0 * f_null) / 3.0 + se = (bad - cf["target"]) ** 2 + bad_loss = se[:, :, 1:].mean(dim=(1, 2, 3, 4)) * cf["w"] + assert float((bad_loss - loss_b).abs().max() / loss_b.abs().max()) > 1e-3 + + +# ============================================================================ +# 6. 权重 +# ============================================================================ + +def test_loss_is_beta08_weighted_not_uniform(): + """`--weight_type` 被忽略(写死 uniform / 换成 stage1 的钟形)在日志上看不出来。""" + kw = dict(mode="random", batch=_batch(), noise=torch.randn( + SHAPE, generator=torch.Generator().manual_seed(11))) + idx = _tr("random").idx_t + w8 = float(fm.weight_of_idx(idx, "beta08")[0]) + assert abs(w8 - 1.0) > 0.05, "本用例要一个 beta08 明显偏离 1 的格点" + _, _, _, _, _, l8, s8 = _run(model=RecModel(0), weight_type="beta08", **kw) + _, _, _, _, _, lu, su = _run(model=RecModel(0), weight_type="uniform", **kw) + # 未加权的 mse 必须一致,加权后必须差 w8 倍 + assert abs(float(s8["mse"]) - float(su["mse"])) < 1e-6 + assert torch.allclose(l8, lu * w8, rtol=2e-5), f"beta08/uniform 之比应为 {w8}" + assert abs(float(s8["tw"]) - w8) < 1e-5 + + +# ============================================================================ +# 7. null 轴:激活、失活、属性还原 +# ============================================================================ + +def test_dropped_axis_deactivates_its_gain_and_skips_its_forward(): + """主前向已经 drop 掉 text 的那 10 % 步上,fuse 是恒等 —— g_text 必须记 0, + den 必须跟着变成 1(上游在这里仍然除 3,修正项小了 3 倍,那是上游的 bug)。""" + m, _, _, _, uc, _, stats = _run("random", gains={"text": 2.0}, drop={"text": True}) + assert stats["den"] == 1.0 and stats["n_null"] == 0 + assert len(m.calls) == 3, "text 被 drop ⇒ 主前向 + 2 次探针,没有 null 前向" + assert torch.equal(m.calls[0]["context"], uc[0]), "主前向本身要用 null 文本" + + +def test_mask_axis_drop_deactivates_all_three_context_axes(): + """anchor/hist/ctx 互斥且共用一套掩码:任意一条被 drop,三条都不活跃。""" + _, _, _, _, _, _, stats = _run( + "random", gains={"text": 2.0, "anchor": 1.0, "hist": 1.0, "ctx": 1.0}, + drop={"anchor": True}) + assert stats["den"] == 3.0 and stats["axes"] == "text" + + +def test_anchor_null_flips_drop_anchor_only_on_its_own_forward(): + m, *_ = _run("random", gains={"text": 2.0, "anchor": 1.0}) + flags = [c["drop_anchor"] for c in m.calls] + assert sum(bool(f) for f in flags) == 1, f"只该有 anchor null 那一次是 True,得到 {flags}" + assert m.calls[0]["drop_anchor"] is False, "主前向不能带 drop_anchor" + assert m.train_drop_anchor is False, "退出后必须还原(否则之后所有前向都在错的掩码上跑)" + + +def test_bare_attributes_are_restored_after_every_mask_axis(): + m = RecModel() + m.train_local_attn_size, m.train_sink_size, m.train_drop_anchor = 7, 3, False + _run("random", gains={"text": 2.0, "hist": 1.0, "ctx": 1.0}, model=m) + assert (m.train_local_attn_size, m.train_sink_size, m.train_drop_anchor) == (7, 3, False) + + +def test_action_null_zeroes_offsets_and_rebuilds_the_mask(): + """action null 把 offset 清零,known 掩码通道**必须**跟着重建 —— 否则条件自相矛盾。""" + m, bt, *_ = _run("random", gains={"text": 2.0, "action": 1.0}) + act = [c for c in m.calls if c["offset_px"] is not None + and float(c["offset_px"].abs().max()) == 0.0] + assert len(act) == 1, "应当恰好有一次 action null 前向" + main_mask = m.calls[0]["mask_input"] + assert not torch.equal(act[0]["mask_input"], main_mask), "掩码没有按清零后的 offset 重建" + + +# ============================================================================ +# 8. CLI +# ============================================================================ + +def test_cli_help_does_not_crash(): + """回归:help 串里的字面 `%` 会让 argparse 的 `_expand_help` 抛 ValueError, + `--help` 直接崩(2026-09-06 修)。""" + p = subprocess.run( + [sys.executable, os.path.join(_ROOT, "distill", "stage2_flowmap", "fm_arope.py"), "--help"], + capture_output=True, text=True, timeout=300, + env=dict(os.environ, PYTHONPATH=_ROOT, CUDA_VISIBLE_DEVICES="", + DIFFSYNTH_SKIP_DOWNLOAD="True")) + assert p.returncode == 0, f"--help 崩了:\n{p.stderr[-2000:]}" + for flag in ("--flowmap_form", "--split_rotate", "--eps_clamp", "--fuse_guidance_scale", + "--weight_type", "--flowmap_epsilon"): + assert flag in p.stdout, f"{flag} 没出现在 --help 里" + + +def _norm(x): + """路径常量在 run.sh 里写成 `$ROOT/...`、config.json 里写成相对路径、argparse 里是绝对路径 —— + 三种写法指的是同一个位置,比较前统一成相对 _ROOT 的形式。""" + t = str(x) + for pre in (f"{_ROOT}/", "$ROOT/", "${ROOT}/"): + if t.startswith(pre): + return t[len(pre):] + return t + + +def _same(a, b) -> bool: + try: + return abs(float(a) - float(b)) < 1e-12 + except (TypeError, ValueError): + return _norm(a) == _norm(b) + + +def test_run_sh_defaults_match_argparse_defaults(): + """RUNBOOK 铁律:run.sh 默认 == argparse 默认 == config.json,否则是已知的崩溃类。""" + import json + import re + from distill.stage2_flowmap.fm_arope import parse_args + sh = open(os.path.join(_ROOT, "distill", "stage2_flowmap", "run.sh"), encoding="utf-8").read() + cfg = json.load(open(os.path.join(_ROOT, "distill", "stage2_flowmap", "config.json"), + encoding="utf-8")) + # --dry_run:parse_args 否则会因 stage1b 检查点不存在而 SystemExit(本机没有真权重也要能跑) + a = parse_args(["--output", os.path.join(_ROOT, "outputs", "distill", "_argparse_probe"), "--dry_run"]) + env = dict(re.findall(r'^([A-Z_][A-Z0-9_]*)="\$\{\1:-([^}]*)\}"', sh, re.M)) + checked, bad = 0, [] + for k, v in vars(a).items(): + ev = env.get(k.upper()) + if ev is None or ev == "" or k in ("resume", "out", "init_ckpt", "model_dir"): + continue + checked += 1 + if not _same(ev, v): + bad.append(f"{k}: run.sh={ev!r} argparse={v!r}") + if k in cfg and not isinstance(cfg[k], (dict, list)) and not _same(cfg[k], v): + bad.append(f"{k}: config.json={cfg[k]!r} argparse={v!r}") + assert checked >= 20, f"只比到 {checked} 个常量,正则大概率没匹配上 run.sh" + assert not bad, "三处配方不一致:\n " + "\n ".join(bad) + + +# ============================================================================ +# 9. 掩码轴的 dropout 必须真的作用到本 micro batch(不是只记在 drop 字典里) +# ============================================================================ + +@pytest.mark.parametrize("axis,want", [ + ("anchor", {"drop_anchor": True, "local": 0, "sink": 0}), + ("hist", {"drop_anchor": False, "local": 1, "sink": 1}), + ("ctx", {"drop_anchor": False, "local": 1, "sink": 0}), +]) +def test_mask_axis_dropout_is_applied_to_every_forward(axis, want): + """anchor / hist / ctx 三条轴改的是**裸模块属性**,不是 cond 字典里的张量。 + + 只把抽签结果记进 `drop` 而不真的作用上去,三个 `--*_dropout` 就是死参数:null 分支在 stage2 + 全程得不到训练(而 fuse 每一步都在读 text null,其余三条一旦打开也一样),并且打开 + `--fuse_g_anchor` 之后那 15 % 的 micro batch 会以为"本轴已 drop"而把 g 归零、den 算小, + 可主前向跑的其实是**完整条件** —— 四分之一的样本目标是错的,不报错、loss 照降。 + + 而且必须罩住**每一次**前向(主前向 + null + 两次中心差分探针):探针量的得是同一个条件场。 + """ + m = RecModel() + before = (m.train_local_attn_size, m.train_sink_size, m.train_drop_anchor) + _run("random", gains={"text": 2.0}, drop={axis: True}, model=m) + assert len(m.calls) == 4, f"应当是 主前向 + text null + 2 次探针,得到 {len(m.calls)}" + for i, c in enumerate(m.calls): + got = {"drop_anchor": bool(c["drop_anchor"]), "local": c["local"], "sink": c["sink"]} + assert got == want, f"drop={axis} 时第 {i} 次前向的掩码属性是 {got},应为 {want}" + assert (m.train_local_attn_size, m.train_sink_size, m.train_drop_anchor) == before, \ + "退出后必须还原,否则之后所有 micro batch 都在错的注意力窗口上跑" + + +def test_no_mask_dropout_leaves_attributes_untouched(): + m = RecModel() + m.train_local_attn_size, m.train_sink_size = 5, 2 + _run("random", gains={"text": 2.0}, drop={"text": True}, model=m) + for c in m.calls: + assert (c["local"], c["sink"], c["drop_anchor"]) == (5, 2, False) + + +# ============================================================================ +# 10. --fuse_clip:打开额外 guidance 轴时的熔断器 +# ============================================================================ + +def test_fuse_clip_actually_clamps(): + """`--fuse_clip` 是设计里给额外 null 轴准备的熔断器(那几条是**掩码差**不是分数差, + 放大是外推,而参照物又是学生自己 —— 正反馈)。被忽略的话熔断器就是个摆设。""" + gains = {"text": 2.0} + kw = dict(mode="random", batch=_batch(), noise=torch.randn( + SHAPE, generator=torch.Generator().manual_seed(11))) + m0, bt, tr, nz, uc, l0, _ = _run(gains=gains, model=RecModel(0), fuse_clip=0.0, **kw) + _, _, _, _, _, lc, _ = _run(gains=gains, model=RecModel(0), fuse_clip=0.01, **kw) + + cf = _closed_form(m0, bt, tr, nz, uc, gains) + lim = 0.01 * float(cf["pred"].new_tensor(0) + _f_full(m0, bt, tr, nz).float().std()) + d = cf["pred"] - _f_full(m0, bt, tr, nz) + assert float(d.abs().max()) > lim, "本用例要求截断真的会触发,否则测不出忽略与否" + + clipped = _f_full(m0, bt, tr, nz) + d.clamp(min=-lim, max=lim) + se = (clipped - cf["target"]) ** 2 + want = se[:, :, 1:].mean(dim=(1, 2, 3, 4)) * cf["w"] + assert float((lc - want).abs().max() / want.abs().max()) < 2e-5, \ + f"fuse_clip=0.01 的 loss 与闭式截断结果不符:{lc.tolist()} vs {want.tolist()}" + assert float((lc - l0).abs().max()) > 0.0, "fuse_clip 被忽略了:截断前后 loss 一模一样" + + +def _f_full(m: RecModel, bt: dict, tr: fm.TRSample, nz: torch.Tensor) -> torch.Tensor: + x_t = fm.add_noise_scalar(bt["input_latents"].float(), nz, tr.idx_t).float() + return m.u(x_t, tr.t, tr.r, bt["context"]) diff --git a/backup_2026-09-14/code/distill/tests/test_stage3_dmd.py b/backup_2026-09-14/code/distill/tests/test_stage3_dmd.py new file mode 100644 index 0000000000000000000000000000000000000000..3ec40bb96cb4ced978403c9b67283f576f4a4b59 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_stage3_dmd.py @@ -0,0 +1,454 @@ +#!/usr/bin/env python3 +"""stage3(self-forcing DMD)的门禁。 + +为什么需要这个文件 +----------------- +与 test_stage2_cd.py 同一个理由:原有的 150 条测试**没有一条**碰过 stage3_dmd/dmd_arope.py。 +实测过:把 self_forcing_rollout 的提交趟从 `torch.zeros(b)` 改成 `torch.full((b,), 250.0)` +(违反文件头「四条铁律」的第 1 条:提交进缓存的历史必须与 stage2 teacher-forcing 的 clean 流 +同分布,也就是 t≡0),整套 150 条全绿,`--dry_run` 的 dmd loss 从 +0.2440 变成 +0.2439 —— +四位有效数字里只动了最后一位,肉眼绝无可能发现。 + +另外 `_shrink_for_dry_run` 会把 kv_window / rollout / K / horizon 全部覆写成 tiny 值, +所以**生产几何**(窗口 20、N=21..27、K=8、horizon=8)的下标算术在此之前从未被执行过。 +test_3 / test_4 就跑在生产数字上。 + +* test_1 ★ 提交趟恒 t=0,且每个 frame_index 恰好一次(rollout 与 replay 两条路径都测) +* test_2 流式前向恒 first_frame_cond=False +* test_3 生产几何下 grad 窗口必须落在 scored tail 内、且不含 tail 的干净锚点 +* test_4 score_tail 的切片 / 世界坐标锚定 / grad_mask 对齐(生产几何) +* test_5 梯度只穿过**一次**退出前向,其余全在 no_grad 下 +* test_6 eval_idx 永不含 cell 0;critic ≡ teacher 时 DMD loss 恰好是 0(step 0 的形态) +* test_7 ★ streamed 的逐帧 backward == fused 的一次性 backward(这是省显存路径的全部依据) + +全部 CPU、tiny 模型。 +""" +import os +import sys + +import pytest +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from distill import flow_pf # noqa: E402 +from distill.stage3_dmd import dmd_arope as S3 # noqa: E402 +from distill.tests import preflight as PF # noqa: E402 + +B = 1 +LH, LW = PF.TINY_LAT_H, PF.TINY_LAT_W +KV, SINK, CAP = 4, 0, 4 # tiny 几何上的滑窗(N=6 ⇒ 7 cell,会真的驱逐) +N_GEN = 6 + + +# ---------------------------------------------------------------------------- +# 工具 +# ---------------------------------------------------------------------------- + +def _deploy(): + return flow_pf.deploy_schedule(flow_pf.DEPLOY_DENOISE_LIST) + + +def _inputs(n_gen=N_GEN, seed=0): + """rollout 要的四件套,索引全部按 1+N 对齐(assert_rollout_aligned 会核)。""" + g = torch.Generator().manual_seed(seed) + total = 1 + n_gen + z0 = torch.randn(B, 48, 1, LH, LW, generator=g) + ctx = torch.randn(B, total, PF.TINY_L_TXT, 4096, generator=g) + ids = torch.zeros(B, total, dtype=torch.int64) + off = torch.zeros(B, total, 2) + off[:, 1:] = torch.randn(B, total - 1, 2, generator=g).cumsum(1) * 12.0 + return z0, ctx, ids, off + + +def _spy(model): + """把每次 forward 的关键 kwargs 记下来(含调用时 grad 是否打开)。 + + 直接替换实例上的 forward:nn.Module.__call__ 取的是 `self.forward`,实例属性优先, + 所以 FSDP 之外的所有路径都会被记到。 + """ + calls = [] + orig = model.forward + + def spy(*a, **kw): + x, t = a[0], a[1] + calls.append(dict(frame_index=kw.get("frame_index"), commit=kw.get("commit"), + first_frame_cond=kw.get("first_frame_cond"), + t_max=float(torch.as_tensor(t).float().abs().max()), + grad_enabled=torch.is_grad_enabled(), + x_requires_grad=bool(getattr(x, "requires_grad", False)))) + return orig(*a, **kw) + + model.forward = spy + return calls + + +def _model(seed=1234): + m = PF.tiny_arope_dit(causal=True, seed=seed, device="cpu", dtype=torch.float32) + m.eval() + return m + + +# ---------------------------------------------------------------------------- +# 1 / 2. 流式前向的两条铁律 +# ---------------------------------------------------------------------------- + +def test_1_commit_pass_is_always_t0_and_exactly_once_per_cell(): + """铁律 1:缓存里的历史必须与 stage2 TF 的 clean 半流同分布,而 TF 的 clean 流就是 ts=0。 + 按退出档的 t 提交 = 给历史 K/V 错误的时间调制 —— 不报错,loss 几乎不动,学生学歪。""" + m = _model() + calls = _spy(m) + z0, ctx, ids, off = _inputs() + S3.self_forcing_rollout(m, z0, ctx, ids, off, N_GEN, _deploy(), grad_horizon=4, + kv_window=KV, rope_cap=CAP, sink_size=SINK, score_last_k=4, + gen=torch.Generator().manual_seed(5)) + commits = [c for c in calls if c["commit"]] + assert commits, "一次提交都没有:缓存根本没被写过" + for c in commits: + assert c["t_max"] == 0.0, ( + f"提交趟的 t 必须恒为 0,cell {c['frame_index']} 用了 t={c['t_max']}。" + "缓存里的历史会带上错误的时间调制(文件头铁律 1)") + assert not c["grad_enabled"], f"cell {c['frame_index']} 的提交趟没有关梯度" + seen = [c["frame_index"] for c in commits] + assert seen == list(range(1 + N_GEN)), f"每个 frame_index 必须恰好提交一次,得到 {seen}" + + +def test_1b_replay_commits_are_also_t0(): + """stream_grad_replay 里有**第二处**提交。只修一处、另一处漏掉,训练同样是静默训歪。""" + m = _model() + z0, ctx, ids, off = _inputs() + rec = {"exit": {}, "commit": {}} + S3.self_forcing_rollout(m, z0, ctx, ids, off, N_GEN, _deploy(), grad_horizon=4, + kv_window=KV, rope_cap=CAP, sink_size=SINK, score_last_k=4, + gen=torch.Generator().manual_seed(5), record=rec) + rec["n_eval"] = max(1, len(rec["exit"])) + calls = _spy(m) + S3.stream_grad_replay(m, z0, ctx, ids, off, rec, _deploy(), + frame_target=lambda k: None, backward=lambda l: None, + kv_window=KV, rope_cap=CAP, sink_size=SINK) + commits = [c for c in calls if c["commit"]] + assert [c["frame_index"] for c in commits] == list(range(1 + N_GEN)) + for c in commits: + assert c["t_max"] == 0.0, f"replay 的提交趟 t 必须是 0,cell {c['frame_index']} 用了 {c['t_max']}" + + +def test_2_streaming_forwards_never_enable_first_frame_cond(): + """铁律 2:`_per_token_timestep` 抹的是「这个张量的第 0 帧」。单 cell 前向里那就是全部 —— + True 会把 rollout 每一个 cell 的时间步都抹成 0。""" + m = _model() + calls = _spy(m) + z0, ctx, ids, off = _inputs() + S3.self_forcing_rollout(m, z0, ctx, ids, off, N_GEN, _deploy(), grad_horizon=4, + kv_window=KV, rope_cap=CAP, sink_size=SINK, score_last_k=4, + gen=torch.Generator().manual_seed(5)) + assert calls + for c in calls: + assert c["first_frame_cond"] is False, \ + f"cell {c['frame_index']} 的流式前向 first_frame_cond={c['first_frame_cond']}" + + +# ---------------------------------------------------------------------------- +# 3 / 4. 生产几何下的下标算术(--dry_run 会把这些数覆写掉,别处没有执行过) +# ---------------------------------------------------------------------------- + +@pytest.mark.parametrize("n_gen", [21, 22, 26, 27]) +def test_3_grad_window_sits_inside_the_scored_tail_at_production_geometry(n_gen): + """配方是 K=8 / horizon=8 / N∈[21,27]。grad 窗口必须整个落在 scored tail 里, + 且不能盖住 tail 的 cell 0(那是不打分的干净锚点)——否则 eval_idx 与 grad_mask 的交集 + 要么少一帧、要么含一个 detach 的 cell,两种都不报错。""" + K = HOR = 8 + total = 1 + n_gen + lo, hi = S3.grad_start_range(total, HOR, K) + assert lo == hi, f"K == horizon 时窗口只有一个合法起点,得到 [{lo}, {hi}]" + tail_start = max(0, total - 1 - K) # score_tail 里的 a + assert lo == tail_start + 1, (lo, tail_start) + grad_end = min(lo + HOR, total) + assert grad_end == total, f"grad 窗口必须一直盖到最后一个生成 cell,得到 {grad_end} != {total}" + assert grad_end - lo == HOR, (lo, grad_end) + assert lo > tail_start, "tail 的干净锚点被放进了梯度窗口" + for s in range(lo, hi + 1): # draw_grad_start 只会抽到这个区间 + assert tail_start < s and min(s + HOR, total) <= total + + +def test_3b_draw_grad_start_stays_in_range(): + for n_gen in (21, 24, 27): + total = 1 + n_gen + lo, hi = S3.grad_start_range(total, 8, 8) + for seed in range(8): + s = S3.draw_grad_start(total, 8, 8, gen=torch.Generator().manual_seed(seed)) + assert lo <= s <= hi, (n_gen, s, lo, hi) + + +@pytest.mark.parametrize("n_gen", [21, 27]) +def test_4_score_tail_is_aligned_and_anchored_at_production_geometry(n_gen): + """teacher/critic 看到的那片 tail:latent / 世界坐标 / 文本 / grad_mask 必须逐 cell 对齐, + 世界坐标要锚回 tail 自己的 cell 0(否则 tail 落在离原点几百 px 的地方,教师直接出分布)。""" + K, HOR = 8, 8 + total = 1 + n_gen + gen_lat = torch.randn(B, 48, total, LH, LW) + lo, _ = S3.grad_start_range(total, HOR, K) + grad_mask = torch.tensor([lo <= k < min(lo + HOR, total) for k in range(total)]) + _, ctx, ids, off = _inputs(n_gen) + tail, cond_t, gm_t, t2f = S3.score_tail(gen_lat, grad_mask, off, ctx, ids, n_gen, K, + lat_h=LH, lat_w=LW) + a = total - 1 - K + assert tail.shape[2] == 1 + K == len(t2f) == gm_t.numel(), (tail.shape, len(t2f)) + assert t2f == list(range(a, total)) + assert torch.equal(tail, gen_lat[:, :, a:]) + assert not bool(gm_t[0]), "tail 的 cell 0 不能落在梯度窗口里" + assert bool(gm_t[1:].all()), "K == horizon 时 tail 除锚点外每个 cell 都该打分" + ow = cond_t["offset_px"] + assert ow.shape == (B, 1 + K, 2) + assert torch.equal(ow[:, 0], torch.zeros(B, 2)), "tail 的世界坐标没有锚回自己的 cell 0" + assert torch.allclose(ow, off[:, a:] - off[:, a:a + 1]) + assert cond_t["context"].shape[1] == 1 + K and cond_t["context_ids"].shape[1] == 1 + K + assert cond_t["mask_input"].shape == (B, 1, 1 + K, LH, LW) + assert cond_t["first_frame_cond"] is True + + +# ---------------------------------------------------------------------------- +# 5. 梯度只穿过一次退出前向 +# ---------------------------------------------------------------------------- + +def test_5_gradient_crosses_exactly_one_forward_per_grad_frame(): + """铁律 3/4 的可执行形式:rollout 里带梯度的前向数 == grad 窗口里的 cell 数, + 而且每一次都是 commit=False 的读趟。多一次 = 图跨帧、显存爆;少一次 = 那帧根本没学。""" + m = _model() + calls = _spy(m) + z0, ctx, ids, off = _inputs() + hor = 3 + with torch.enable_grad(): + gen_lat, grad_mask = S3.self_forcing_rollout( + m, z0, ctx, ids, off, N_GEN, _deploy(), grad_horizon=hor, + kv_window=KV, rope_cap=CAP, sink_size=SINK, score_last_k=4, + grad_start=4, exit_step=1, gen=torch.Generator().manual_seed(5)) + on = [c for c in calls if c["grad_enabled"]] + assert len(on) == hor, f"带梯度的前向应当恰好 {hor} 次(每个 grad cell 一次),得到 {len(on)}" + assert all(not c["commit"] for c in on), "提交趟不许带梯度" + assert sorted(c["frame_index"] for c in on) == [4, 5, 6] + assert int(grad_mask.sum()) == hor and bool(grad_mask[4]) and not bool(grad_mask[3]) + assert gen_lat.requires_grad, "整片输出没有梯度:surrogate 到不了学生" + + +# ---------------------------------------------------------------------------- +# 6. eval_idx 与 step-0 的退化形态 +# ---------------------------------------------------------------------------- + +def test_6_eval_idx_excludes_the_anchor_and_dmd_is_zero_when_critic_equals_teacher(): + """DMD 是 (pred_fake − pred_real)/normalizer。critic 与 teacher 同一份初值时它恒等于 0 + —— 这就是 step 0 的形态,不是 bug。同时确认 eval_idx 永不含 cell 0(干净锚点不打分)。""" + K = 4 + total = 1 + N_GEN + gen_lat = torch.randn(B, 48, total, LH, LW) + lo, _ = S3.grad_start_range(total, K, K) + grad_mask = torch.tensor([lo <= k < min(lo + K, total) for k in range(total)]) + _, ctx, ids, off = _inputs() + tail, cond_t, gm_t, _ = S3.score_tail(gen_lat, grad_mask, off, ctx, ids, N_GEN, K, + lat_h=LH, lat_w=LW) + + same = _model(seed=7) # teacher 与 critic 是同一个对象 ⇒ 逐位相同 + loss, log = S3.dmd_generator_loss(same, same, tail, cond_t, gm_t, + gen=torch.Generator().manual_seed(11)) + assert float(loss) == 0.0, f"critic ≡ teacher 时 DMD surrogate 必须恰好是 0,得到 {float(loss)}" + assert log["dmd_gnorm"] == 0.0 + + tgt, eval_idx, _ = S3.dmd_targets(same, same, tail, cond_t, gm_t, + gen=torch.Generator().manual_seed(11)) + assert int(eval_idx.min()) >= 1, f"eval_idx 含了 cell 0:{eval_idx.tolist()}" + assert eval_idx.tolist() == torch.nonzero(gm_t).flatten().tolist() + assert torch.allclose(tgt, tail), "critic ≡ teacher 时 surrogate 目标就是片子自己" + + other = _model(seed=99) # 负控制:critic 一旦被拉开就必须非 0 + loss2, log2 = S3.dmd_generator_loss(same, other, tail, cond_t, gm_t, + gen=torch.Generator().manual_seed(11)) + assert float(loss2) > 0.0 and log2["dmd_gnorm"] > 0.0, (float(loss2), log2) + + +def test_6b_eval_idx_drops_cell0_even_when_the_mask_asks_for_it(): + """`eval_idx = eval_idx[eval_idx >= 1]` 这一条的**契约**测试。 + + 走 score_tail 进来时 grad_mask[0] 恒为 False(那边有断言),所以过滤器在正常流程里 + 看不出效果 —— 把它删掉,test_6 照样绿。但 dmd_targets / critic_loss 是公开 API, + 契约是「cell 0 是干净锚点,永不打分」,得直接拿一个**含 cell 0 的**掩码来验。 + 掩码含 cell 0 而过滤器没了的话:那个 detach 的干净锚点会进 normalizer 和 surrogate, + DMD 梯度整体被悄悄缩放,不报错。 + """ + K = 4 + total = 1 + N_GEN + gen_lat = torch.randn(B, 48, total, LH, LW) + _, ctx, ids, off = _inputs() + lo, _ = S3.grad_start_range(total, K, K) # 合法的 grad 窗口(score_tail 要求锚点不打分) + grad_mask = torch.tensor([lo <= k < min(lo + K, total) for k in range(total)]) + tail, cond_t, _, _ = S3.score_tail(gen_lat, grad_mask, off, ctx, ids, N_GEN, K, + lat_h=LH, lat_w=LW) + bad_mask = torch.ones(tail.shape[2], dtype=torch.bool) # ← 连 cell 0 一起要求打分 + same = _model(seed=7) + _, eval_idx, _ = S3.dmd_targets(same, same, tail, cond_t, bad_mask, + gen=torch.Generator().manual_seed(11)) + assert int(eval_idx.min()) >= 1, f"eval_idx 必须永远丢掉 cell 0,得到 {eval_idx.tolist()}" + assert eval_idx.tolist() == list(range(1, tail.shape[2])) + # critic 用的是同一套下标,两边不许分叉 + loss_c, _ = S3.critic_loss(same, tail, cond_t, eval_idx, + gen=torch.Generator().manual_seed(11), + use_gradient_checkpointing=False) + assert torch.isfinite(loss_c) + + +# ---------------------------------------------------------------------------- +# 7. streamed == fused +# ---------------------------------------------------------------------------- + +def test_7_streamed_per_frame_backward_equals_the_fused_backward(): + """省显存路径的**全部**依据:逐帧 backward 与一次性 backward 必须给出同一份梯度。 + 成立的条件是「每次缓存提交都在 no_grad 下 ⇒ 各 grad 帧是独立的单帧图」+「surrogate 是 + reduction=mean 的 mse ⇒ 第 j 帧的份额正好是 mse_j / n_eval」。任何一条被破坏, + 这里就会分叉,而训练本身照样跑。""" + z0, ctx, ids, off = _inputs() + dep = _deploy() + hor, gs, ex = 3, 4, 1 + kw = dict(kv_window=KV, rope_cap=CAP, sink_size=SINK, score_last_k=4, + grad_start=gs, exit_step=ex) + + # ---- fused:一趟建图,一次 backward ---- + m_f = _model() + torch.manual_seed(21) # 中间重加噪走的是 randn_like(全局流),必须钉住 + gen_f, mask_f = S3.self_forcing_rollout(m_f, z0, ctx, ids, off, N_GEN, dep, + grad_horizon=hor, + gen=torch.Generator().manual_seed(5), **kw) + idx = torch.nonzero(mask_f).flatten() + n_eval = int(idx.numel()) + tgt = torch.randn(B, 48, 1 + N_GEN, LH, LW, generator=torch.Generator().manual_seed(33)) + loss_f = 0.5 * torch.nn.functional.mse_loss(gen_f[:, :, idx].float(), tgt[:, :, idx].float()) + loss_f.backward() + g_f = {n: p.grad.detach().clone() for n, p in m_f.named_parameters() if p.grad is not None} + + # ---- streamed:同一条 rollout 全程 no_grad 录下来,再逐帧重做 + 逐帧 backward ---- + m_s = _model() + rec = {"exit": {}, "commit": {}} + torch.manual_seed(21) + gen_s, mask_s = S3.self_forcing_rollout(m_s, z0, ctx, ids, off, N_GEN, dep, + grad_horizon=hor, record=rec, + gen=torch.Generator().manual_seed(5), **kw) + # 两趟的 rollout 必须逐位相同,否则后面比的就不是同一份梯度 + assert torch.equal(gen_s, gen_f.detach()), "record 那趟与建图那趟的 rollout 不一致" + assert torch.equal(mask_s, mask_f) + assert sorted(rec["exit"]) == idx.tolist(), (sorted(rec["exit"]), idx.tolist()) + rec["n_eval"] = n_eval + tot = S3.stream_grad_replay(m_s, z0, ctx, ids, off, rec, dep, + frame_target=lambda k: tgt[:, :, k:k + 1], + backward=lambda l: l.backward(), + kv_window=KV, rope_cap=CAP, sink_size=SINK) + g_s = {n: p.grad.detach().clone() for n, p in m_s.named_parameters() if p.grad is not None} + + assert abs(tot - float(loss_f.detach())) < 1e-6, (tot, float(loss_f.detach())) + assert set(g_s) == set(g_f) and g_f, (len(g_s), len(g_f)) + num = sum(float(((g_s[n] - g_f[n]) ** 2).sum()) for n in g_f) + den = sum(float((g_f[n] ** 2).sum()) for n in g_f) + assert den > 0, "fused 路径自己的梯度就是 0,这条测试没有意义" + rel = (num / den) ** 0.5 + assert rel < 1e-6, f"streamed 与 fused 的梯度相对差 {rel:.3e}(应当在数值噪声量级)" + + +# ---------------------------------------------------------------------------- +# 8. 三处配方:run.sh 默认 == argparse 默认 == config.json(PORT_SPEC risk 11) +# ---------------------------------------------------------------------------- + +def _norm_path(x) -> str: + """路径常量在 run.sh 里写成 `$ROOT/...`、config.json 里写成相对路径、argparse 里是绝对路径 —— + 三种写法指的是同一个位置,比较前统一成相对 ROOT 的形式。""" + t = str(x) + for pre in (f"{ROOT}/", "$ROOT/", "${ROOT}/"): + if t.startswith(pre): + return t[len(pre):] + return t + + +def _same(a, b) -> bool: + try: + return abs(float(a) - float(b)) < 1e-12 + except (TypeError, ValueError): + return _norm_path(a) == _norm_path(b) + + +def _check_three_places(stage: str, args: dict, alias: dict, skip: set, derived: set, + literals: set, flags: tuple) -> list: + """run.sh 的 `VAR="${VAR:-default}"` 默认值、ARGS=( ... ) 里的硬编码字面量、config.json, + 逐项对 argparse 默认值 `args`。返回比过的 dest 列表;不一致直接 assert。""" + import json + import re + sh = open(os.path.join(ROOT, "distill", stage, "run.sh"), encoding="utf-8").read() + cfg = json.load(open(os.path.join(ROOT, "distill", stage, "config.json"), encoding="utf-8")) + env: dict = {} + for name, val in re.findall(r'^\s*([A-Z_][A-Z0-9_]*)="\$\{\1:-([^}]*)\}"', sh, re.M): + env.setdefault(name, []).append(val) + checked, bad = [], [] + for name, vals in env.items(): + if name in skip: + continue + dest = alias.get(name, name.lower()) + if name in alias: + assert dest in args, f"别名表把 {name} 映到了不存在的 argparse dest {dest!r}" + if dest not in args or dest in derived: + continue + checked.append(dest) + # 同一个变量若按并行度分支(如 GRAD_ACCUM 的 4 卡 / 8 卡),argparse 默认值须是其中之一 + if not any(_same(v, args[dest]) for v in vals): + bad.append(f"{dest}: run.sh={vals!r} argparse={args[dest]!r}") + # ARGS=( ... ) 里的硬编码字面量(`--opt8bit 0` 这类不走环境变量的)也必须等于 argparse 默认值 + block = re.search(r"^ARGS=\((.*?)^\)", sh, re.M | re.S).group(1) + lits = dict(re.findall(r'--([A-Za-z0-9_]+)\s+(?!["$-])(\S+)', block)) + assert literals <= set(lits), f"run.sh ARGS 里的硬编码字面量变了:{sorted(lits)}(应含 {sorted(literals)})" + for dest, v in lits.items(): + assert dest in args, f"run.sh ARGS 传了 --{dest},argparse 里没有" + checked.append(dest) + if not _same(v, args[dest]): + bad.append(f"{dest}: run.sh 字面量={v!r} argparse={args[dest]!r}") + found_flags = set() + for flag in flags: # 裸开关:出现即 True(词边界匹配,行中位置也算) + if re.search(rf"--{flag}(?=\s|$)", block, re.M): + found_flags.add(flag) + checked.append(flag) + if args[flag] is not True: + bad.append(f"{flag}: run.sh 传了 --{flag},argparse 默认却是 {args[flag]!r}") + assert found_flags == set(flags), f"run.sh ARGS 里没找到这些裸开关(检查会空过):{sorted(set(flags) - found_flags)}" + for dest in checked: + if dest in cfg and not isinstance(cfg[dest], (dict, list)) and not _same(cfg[dest], args[dest]): + bad.append(f"{dest}: config.json={cfg[dest]!r} argparse={args[dest]!r}") + assert len(checked) >= 20, f"只比到 {len(checked)} 个常量,正则大概率没匹配上 run.sh:{checked}" + assert not bad, "三处配方不一致:\n " + "\n ".join(bad) + return checked + + +# run.sh 的环境变量名 → argparse dest(其余按小写同名)。ckpt / 输出路径 / 端口 / RESUME 故意不比: +# RESUME=auto 是 run.sh 唯一**有意**与 argparse(None)不同的地方 +_RUN_SH_ALIAS = { + "SINK": "sink_size", "SCORE_FRAMES": "dmd_score_frames", "OFFSET_CHUNK": "offset_chunk_cells", + "CLAMP": "dmd_timestep_clamp", "CFG_SCALE": "real_guidance_scale", "MIN_RT": "min_rt_ratio", + "KEEP_DITS": "keep_last_dits", "KEEP_EMAS": "keep_last_emas", "KEEP_CRITICS": "keep_last_critics", + "DENOISE_LIST": "denoise_list", "KV_WINDOW": "kv_window", "ROPE_CAP": "rope_cap", + "ROLLOUT_MIN": "rollout_min", "ROLLOUT_MAX": "rollout_max", "GRAD_HORIZON": "grad_horizon", + "GRAD_PASS": "grad_pass", "OFFSET_EXTEND": "offset_extend", "CRITIC_STEPS": "critic_steps", + "LR_CRITIC": "lr_critic", "PROFILE_MEM": "profile_mem", +} +_RUN_SH_SKIP = {"STAGE2_OUT", "STUDENT", "TEACHER", "OUT", "PORT", "ACC_CFG", "RESUME", "FORCE_RUN_DIR"} +_DERIVED = {"betas", "denoise", "clamp"} # parse_args 派生的 tuple/list;比的是它们的 CLI 字符串 + + +def test_8_run_sh_defaults_match_argparse_defaults_and_config_json(tmp_path): + """RUNBOOK 铁律:run.sh 默认 == argparse 默认 == config.json。上游 A 的 run.sh 与 argparse + 六处不一致(lr 5e-6 / critic_steps 4 / score 26 / horizon 14 / rollout_max 100 / reanchor 16), + 每处对应一次已知崩溃;这个移植只允许存在一份配方,改一处不改另两处要在这里被拦。""" + # --dry_run:否则 parse_args 会因 --student_ckpt 缺失而 SystemExit + a = vars(S3.parse_args(["--output", str(tmp_path / "_argparse_probe"), "--dry_run"])) + checked = _check_three_places("stage3_dmd", a, _RUN_SH_ALIAS, _RUN_SH_SKIP, _DERIVED, + literals={"opt8bit", "batch_size", "context_extend", "reanchor_every", + "frankenstein", "scene_dropout", "use_ema"}, + flags=("gradient_checkpointing",)) + print(f"8. recipe run.sh == argparse == config.json:{len(checked)} 个常量 {sorted(checked)}") + + +if __name__ == "__main__": + raise SystemExit(pytest.main([__file__, "-q", "-s"])) diff --git a/backup_2026-09-14/code/distill/tests/test_stage4_opsd.py b/backup_2026-09-14/code/distill/tests/test_stage4_opsd.py new file mode 100644 index 0000000000000000000000000000000000000000..728000453f8ad1230b9f5e7af350c60a6068e20b --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_stage4_opsd.py @@ -0,0 +1,666 @@ +#!/usr/bin/env python3 +"""stage4(OPSD,On-Policy Self-Distillation)的门禁。 + +上游 opsd_gm.py 的 smoke() 有六条不变量;这里把它们拆成 pytest,并补上 ActionRoPE 侧特有的几条 +(教师缓存的滞后 / 快照内容、三处配方一致、dry run 端到端)。全部 CPU、tiny 模型(preflight 的 dim 24 / 4×4)。 + +* test_1 ★ 几何:rope_cap == sink + kv_window(函数 + argparse 两道) +* test_2 rollout 跑通:打分 (T − loss_start) 个 cell、每个 cell 4 个状态;学生的提交趟恒 t=0、每个 + frame_index 恰好一次、first_frame_cond 恒 False(沿用 test_stage3_dmd 的 spy 口径) +* test_3 梯度真的落到学生参数上(逐 cell backward 每次都有非零梯度) +* test_4 ★ 同权重 + teacher_context=student ⇒ loss **恰好** 0.0(同一个对象 / 逐位相同的副本都要) +* test_5 ★ 同权重 + 真值历史 ⇒ loss > 0(GT 上下文真的进了前向) +* test_6 快照不动原缓存:check_snapshot 路径 + 直接对 snapshot_kv_cache 的槽位/张量/frames_cached 做断言 +* test_7 教师看到的上下文:打分 cell k 时 cache_t.frames_cached == k;keep_last=1 + student 模式下教师把**学生的** + k−1 commit 进快照(就是学生刚提交的那个张量);teacher 模式下教师在 cell k 打分完把**自己的** x0 commit + 进它打分用的快照(官方写入顺序);其余 commit 全是真值 latent;keep_last=0 时教师只 commit 真值 +* test_8 x0 消融跑通且与 flow 不同 +* test_9 三处配方:run.sh 默认 == argparse 默认 == config.json(复用 test_stage3_dmd 的检查器) +* test_10 --dry_run 端到端(缩到 8 cell / 2 步):dits/ + ema/ 导出、progress.json、config.json、csv +* test_11 loss_norm=window:每个 cell 的梯度 = cell 模式 ÷ 打分 cell 数(官方 total_loss_terms) +* test_12 teacher / student 两种最近一格:零 loss 集合相同、从 cell 3 起不同 +* test_13 ★ 官方写入顺序逐位复现:把官方"定长数组 + 原位替换"的 gt_kv 直译成另一套构造(写教师 chunk → + 把倒数第二格原位换成在纯 GT 缓存上重算的 GT K/V),教师在每个打分 cell 上读到的整条缓存(每层 K 与 V) + 必须与它逐位相同;同时证明"在全 GT 历史上重新 commit 教师的 k−1"从 cell 3 起第 1 层的 K 就不同 +* test_14 append_kv_frame / last_kv_frame 与 commit 路径逐位相同(含驱逐),且不动原缓存 +* test_15 ★ --ema_decay > 0 ⇒ 教师必须 fp32:bf16 教师上 decay 0.9999 的 EMA 是静默空操作(量给你看), + teacher_param_dtype 在 CUDA + ema_decay>0 时给 fp32、冻结时给 bf16、CPU 恒 fp32 +""" +import copy +import os +import subprocess +import sys + +import pytest +import torch + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +from distill import flow_pf, runlib # noqa: E402 +from distill.arope_dit import AropeDiT, snapshot_kv_cache # noqa: E402 +from distill.stage3_dmd.dmd_arope import frame_cond # noqa: E402 +from distill.stage4_opsd import opsd_arope as S4 # noqa: E402 +from distill.tests.test_stage3_dmd import _check_three_places # noqa: E402 + +import argparse # noqa: E402 + +T = 8 +KV, SINK, CAP = 5, 1, 6 # tiny 几何:cap 6,T=8 ⇒ cell 7 上真的驱逐;sink>0 走 sink 分支(部署也是 sink 3) +LOSS_START = 2 +LH, LW = S4.SMOKE_LAT + + +def _args(**over): + base = dict(kv_window=KV, rope_cap=CAP, sink_size=SINK, sink_anchor="absolute", + loss_start_frame=LOSS_START, teacher_keep_last=1, loss_type="flow", teacher_context="real", + teacher_last_chunk="teacher", loss_norm="window") + base.update(over) + return argparse.Namespace(**base) + + +def _deploy(): + return flow_pf.deploy_schedule(flow_pf.DEPLOY_DENOISE_LIST) + + +def _zero_cells(keep_last: int) -> set: + """按构造教师上下文 ≡ 学生上下文、loss 恰好为 0 的 cell: + keep_last=1 ⇒ k=1([real 0])与 k=2([real 0, 学生 1]);keep_last=0 ⇒ 只有 k=1。 + 第一个真正有信号的 cell 是 k=3(keep_last=1)—— 这也是 loss_start_frame 必须 ≥ 3(配方 12)的原因。""" + return {1, 2} if keep_last else {1} + + +def _check_per_cell(per_cell, keep_last): + zero = _zero_cells(keep_last) + for i, v in enumerate(per_cell): + k = LOSS_START + i + if k in zero: + assert v == 0.0, f"cell {k}:教师与学生上下文按构造相同,loss 必须恰好 0,得到 {v}" + else: + assert v > 0.0, f"cell {k}:真值历史已经与学生历史不同,loss 必须 > 0,得到 {v}" + + +def _pair(seed=1234): + """学生 + 逐位相同的冻结教师。""" + st = S4._smoke_model(seed=seed) + te = S4._smoke_model(seed=seed) + te.requires_grad_(False) + return st, te + + +def _spy(model): + """记下每次 forward 的关键 kwargs(frame_index / commit / t / grad 状态 / 传进来的 x 与 cache 对象)。""" + calls = [] + orig = model.forward + + def spy(*a, **kw): + x, t = a[0], a[1] + calls.append(dict(frame_index=kw.get("frame_index"), commit=kw.get("commit"), + first_frame_cond=kw.get("first_frame_cond"), cache=kw.get("kv_cache"), + frames_cached=kw.get("kv_cache")["frames_cached"], + t_max=float(torch.as_tensor(t).float().abs().max()), + grad_enabled=torch.is_grad_enabled(), x=x)) + return orig(*a, **kw) + + model.forward = spy + return calls + + +# ---------------------------------------------------------------------------- +# 1. 几何 +# ---------------------------------------------------------------------------- + +def test_1_geometry_gate(tmp_path): + S4.assert_window_geometry(3, 17, 20) + with pytest.raises(ValueError, match="rope_cap"): + S4.assert_window_geometry(3, 17, 21) + with pytest.raises(SystemExit): + S4.parse_args(["--output", str(tmp_path), "--dry_run", "--sink_size", "3", "--kv_window", "17", "--rope_cap", "21"]) + a = S4.parse_args(["--output", str(tmp_path), "--dry_run"]) + assert (a.sink_size, a.kv_window, a.rope_cap, a.sink_anchor) == (3, 17, 20, "absolute"), "部署几何默认值变了" + # 拒绝 dits/ 初值,除非 --allow_raw_student(先于存在性检查) + with pytest.raises(SystemExit, match="dits"): + S4.parse_args(["--output", str(tmp_path), "--init_ckpt", "/x/dits/dit_step300.safetensors"]) + + +# ---------------------------------------------------------------------------- +# 2 / 3. rollout 跑通、打分计数、梯度可达 +# ---------------------------------------------------------------------------- + +def test_2_rollout_scores_expected_cells_and_states_and_commits_are_clean(): + st, te = _pair() + calls = _spy(st) + real, ctx, ids, off = S4._smoke_inputs(T, seed=0) + loss, info = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(), + gen=torch.Generator().manual_seed(1), backward_fn=None) + assert info["n_scored_cells"] == T - LOSS_START, info + assert info["n_scored_states"] == (T - LOSS_START) * 4, info + assert len(info["per_cell"]) == T - LOSS_START + _check_per_cell(info["per_cell"], keep_last=1) # k=2 恰好 0(上下文相同),k≥3 > 0 + assert loss > 0 and abs(loss - sum(info["per_cell"]) / len(info["per_cell"])) < 1e-9 + commits = [c for c in calls if c["commit"]] + assert [c["frame_index"] for c in commits] == list(range(T)), "学生每个 frame_index 恰好提交一次" + for c in commits: + assert c["t_max"] == 0.0 and not c["grad_enabled"], f"提交趟必须 t=0 且 no_grad(cell {c['frame_index']})" + reads = [c for c in calls if not c["commit"]] + assert len(reads) == (T - 1) * 4, "每个生成 cell 4 次读趟" + assert all(c["first_frame_cond"] is False for c in calls), "流式路径 first_frame_cond 恒 False" + assert all(c["cache"] is calls[0]["cache"] for c in calls), "学生只读写自己那一份缓存" + + +def test_3_gradient_reaches_the_student(): + st, te = _pair() + real, ctx, ids, off = S4._smoke_inputs(T, seed=0) + grads = [] + + def bwd(l): + assert l.requires_grad and l.dim() == 0 + l.backward() + grads.append(sum(float(p.grad.norm()) for p in st.parameters() if p.grad is not None)) + st.zero_grad(set_to_none=True) + + S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(), + gen=torch.Generator().manual_seed(1), backward_fn=bwd) + assert len(grads) == T - LOSS_START, "逐 cell backward:每个打分 cell 一次" + assert all(torch.isfinite(torch.tensor(g)) for g in grads), grads + for i, g in enumerate(grads): # 上下文相同的 cell 梯度恰好 0,其余 > 0 + k = LOSS_START + i + assert (g == 0.0) if k in _zero_cells(1) else (g > 0.0), (k, g) + assert all(p.grad is None for p in te.parameters()), "教师不许有梯度" + + +# ---------------------------------------------------------------------------- +# 4 / 5. 整个方法赖以成立的两条性质 +# ---------------------------------------------------------------------------- + +def test_4_student_context_with_identical_weights_gives_exactly_zero(): + """教师读学生自己的缓存对象 ⇒ 同一个 (noisy, t, 缓存) 状态 ⇒ loss == 0.0,不是 ~0。 + forward_frame 是缓存内容的纯函数(raw K/V 读时按同一 (tpos, offset_win) 重 RoPE),与谁在读无关。""" + st, te = _pair() + real, ctx, ids, off = S4._smoke_inputs(T, seed=5) + a = _args(teacher_context="student") + l_same, info = S4.opsd_step(st, st, real, ctx, ids, off, _deploy(), a, gen=torch.Generator().manual_seed(2)) + assert l_same == 0.0 and all(v == 0.0 for v in info["per_cell"]), info["per_cell"] + l_copy, _ = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), a, gen=torch.Generator().manual_seed(2)) + assert l_copy == 0.0 + l_x0, _ = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(teacher_context="student", loss_type="x0"), + gen=torch.Generator().manual_seed(2)) + assert l_x0 == 0.0 + # 权重一旦不同就必须非 0(负控制:这条检查本身不是恒真的) + other = S4._smoke_model(seed=99).requires_grad_(False) + l_other, _ = S4.opsd_step(st, other, real, ctx, ids, off, _deploy(), a, gen=torch.Generator().manual_seed(2)) + assert l_other > 0 + + +def test_5_real_history_with_identical_weights_gives_positive_loss(): + st, te = _pair() + real, ctx, ids, off = S4._smoke_inputs(T, seed=5) + l_real, info = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(), + gen=torch.Generator().manual_seed(2), check_snapshot=True) + assert l_real > 1e-10, info["per_cell"] + _check_per_cell(info["per_cell"], keep_last=1) + l_pure, info0 = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(teacher_keep_last=0), + gen=torch.Generator().manual_seed(2), check_snapshot=True) + assert l_pure > 1e-10 and l_pure != l_real, "keep_last 0/1 是两种不同的教师上下文" + _check_per_cell(info0["per_cell"], keep_last=0) # 纯真值 0..k−1:从 k=2 起就与学生不同 + # loss_start=1 时 cell 1 两种模式都恰好 0(教师缓存 = [real 0] = 学生缓存) + _, info1 = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(loss_start_frame=1), + gen=torch.Generator().manual_seed(2)) + assert info1["per_cell"][0] == 0.0 and info1["per_cell"][1] == 0.0 and info1["per_cell"][2] > 0.0 + + +# ---------------------------------------------------------------------------- +# 6. 快照不动原缓存 +# ---------------------------------------------------------------------------- + +def test_6_snapshot_kv_cache_does_not_mutate_the_original(): + st, _ = _pair() + real, ctx, ids, off = S4._smoke_inputs(T, seed=5) + cache = st.init_kv_cache(kv_window=KV, sink_size=SINK, rope_cap=CAP) + zero = torch.zeros(1) + with torch.no_grad(): + for j in range(CAP + 1): # 填到饱和(cap 6,提交 7 格 ⇒ 驱逐一次) + ow, mk = frame_cond(off, j, SINK, KV, LH, LW) + st(real[:, :, j:j + 1], zero, ctx[:, j:j + 1], context_ids=ids[:, j:j + 1], first_frame_cond=False, + frame_index=j, kv_cache=cache, commit=True, offset_win=ow, mask_in_k=mk) + fc = cache["frames_cached"] + k_ids, v_ids = [id(t) for t in cache["k"]], [id(t) for t in cache["v"]] + k_clone = [t.clone() for t in cache["k"]] + snap = snapshot_kv_cache(cache) + assert snap is not cache and snap["k"] is not cache["k"] and snap["v"] is not cache["v"] + assert all(a is b for a, b in zip(snap["k"], cache["k"])), "快照共享张量(浅)" + assert snap["_ref"].cache is snap and cache["_ref"].cache is cache, "各自的 _KVRef 指回各自" + assert snap["frames_cached"] == fc and snap["kv_window"] == KV and snap["sink_size"] == SINK + # 往快照里 commit 一格(驱逐再发生一次),原缓存必须纹丝不动 + j = fc + ow, mk = frame_cond(off, j, SINK, KV, LH, LW) + with torch.no_grad(): + st(real[:, :, j:j + 1], zero, ctx[:, j:j + 1], context_ids=ids[:, j:j + 1], first_frame_cond=False, + frame_index=j, kv_cache=snap, commit=True, offset_win=ow, mask_in_k=mk) + assert snap["frames_cached"] == fc + 1 and cache["frames_cached"] == fc + assert [id(t) for t in cache["k"]] == k_ids and [id(t) for t in cache["v"]] == v_ids + assert all(torch.equal(a, b) for a, b in zip(cache["k"], k_clone)) + assert all(a is not b for a, b in zip(snap["k"], cache["k"])), "快照的槽位已经换成新张量" + hw = (LH // 2) * (LW // 2) + assert snap["k"][0].shape[1] // hw == CAP == cache["k"][0].shape[1] // hw, "两边都收在 cap 内" + # 快照里的内容 = 原缓存驱逐掉最老的非 sink 格 + 新 cell:sink 段相同、窗口段整体前移一格 + k_old, k_new = cache["k"][0], snap["k"][0] + assert torch.equal(k_new[:, :SINK * hw], k_old[:, :SINK * hw]), "sink 段不变" + assert torch.equal(k_new[:, SINK * hw:-hw], k_old[:, (SINK + 1) * hw:]), "窗口段前移一格" + # 释放快照不影响原缓存;原缓存照常可用(frames_cached 断言按原缓存自己的计数走) + AropeDiT.release_kv_cache(snap) + assert not snap and cache["k"][0] is not None and cache["frames_cached"] == fc + with torch.no_grad(): + st(real[:, :, j:j + 1], torch.full((1,), 500.0), ctx[:, j:j + 1], context_ids=ids[:, j:j + 1], + first_frame_cond=False, frame_index=j, kv_cache=cache, commit=False, offset_win=ow, mask_in_k=mk) + assert cache["frames_cached"] == fc + AropeDiT.release_kv_cache(cache) + + +# ---------------------------------------------------------------------------- +# 7. 教师到底看到了什么 +# ---------------------------------------------------------------------------- + +@pytest.mark.parametrize("keep_last,last_src", [(1, "student"), (0, "student"), (1, "teacher")]) +def test_7_teacher_context_is_real_history_plus_latest_generated_cell(keep_last, last_src): + st, te = _pair() + real, ctx, ids, off = S4._smoke_inputs(T, seed=5) + cs, ct = _spy(st), _spy(te) + S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(teacher_keep_last=keep_last, teacher_last_chunk=last_src), + gen=torch.Generator().manual_seed(2), check_snapshot=True) + student_commits = {c["frame_index"]: c["x"] for c in cs if c["commit"]} + t_commits = [c for c in ct if c["commit"]] + t_reads = [c for c in ct if not c["commit"]] + teacher_mode = keep_last == 1 and last_src == "teacher" + # 打分读趟:cell k 上教师缓存装着 k 个 cell(frames_cached == frame_index),4 个状态、t 与学生相同 + for k in range(LOSS_START, T): + rk = [c for c in t_reads if c["frame_index"] == k] + assert len(rk) == 4 and all(c["frames_cached"] == k for c in rk), (k, [c["frames_cached"] for c in rk]) + sk = [c for c in cs if not c["commit"] and c["frame_index"] == k] + assert [c["t_max"] for c in rk] == [c["t_max"] for c in sk], "教师与学生的时间步序列必须相同" + assert all(c["x"] is s["x"] for c, s in zip(rk, sk)), "教师与学生必须拿同一个 noisy 张量" + assert all(not c["grad_enabled"] for c in rk), "教师前向 no_grad" + # 未打分的 cell:teacher 模式下教师只跑最后一步(拿它的 x0 当下一格上下文),其余模式不跑 + for k in range(1, LOSS_START): + rk = [c for c in t_reads if c["frame_index"] == k] + if teacher_mode: + assert len(rk) == 1 and rk[0]["frames_cached"] == k, (k, len(rk)) + sk = [c for c in cs if not c["commit"] and c["frame_index"] == k] + assert rk[0]["x"] is sk[-1]["x"] and rk[0]["t_max"] == sk[-1]["t_max"], "教师的最后一步要在学生最后一个 noisy 上" + else: + assert not rk, (k, len(rk)) + # 提交趟:keep_last=1 时生成 cell 的提交 —— + # student 模式:cell k 把学生刚提交的那个张量对象以 frame_index=k−1 commit 进快照; + # teacher 模式(官方写入顺序):cell k 打分完把教师自己的 x0 以 frame_index=k commit 进它打分用的快照 + # (另一个对象;权重相同且上下文相同的 j≤2 与学生逐位相等,j≥3 起上下文不同、值不同;最后一个 cell 不写)。 + # 其余全是真值 latent;keep_last=0 时教师只提交真值 + n_gen, n_real = 0, 0 + for c in t_commits: + j = c["frame_index"] + if torch.equal(c["x"], real[:, :, j:j + 1]): + n_real += 1 + else: + assert keep_last == 1, "keep_last=0 时教师不许提交任何生成的 cell" + if teacher_mode: + assert c["x"] is not student_commits[j], f"teacher 模式下 frame {j} 提交的应是教师自己的 x0" + same = torch.equal(c["x"], student_commits[j]) + assert same == (j <= 2), (j, same) + else: + assert c["x"] is student_commits[j], f"教师在 frame {j} 提交的不是学生自己提交的那个张量" + n_gen += 1 + if teacher_mode: + assert n_gen == T - 2, n_gen # 每个 cell k≥2 都提交 k−1 + assert n_real == T - 2, n_real + elif keep_last: + assert n_gen == T - LOSS_START - (1 if LOSS_START == 1 else 0) + # 真值:cell 0 + 打分前推进到 k−2 ⇒ 真值 0..T−3 + assert n_real == T - 2, n_real + else: + assert n_gen == 0 and n_real == T - 1, n_real # 真值 0..T−2 + # 真值提交的 frame_index 严格递增、每格一次(滞后缓存是 append-only 的,不能乱序) + real_idx = [c["frame_index"] for c in t_commits if torch.equal(c["x"], real[:, :, c["frame_index"]:c["frame_index"] + 1])] + assert real_idx == list(range(len(real_idx))), real_idx + + +# ---------------------------------------------------------------------------- +# 8. x0 消融 +# ---------------------------------------------------------------------------- + +def test_8_x0_loss_type_runs_and_differs_from_flow(): + st, te = _pair() + real, ctx, ids, off = S4._smoke_inputs(T, seed=5) + l_flow, _ = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(loss_type="flow"), + gen=torch.Generator().manual_seed(2)) + l_x0, _ = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(loss_type="x0"), + gen=torch.Generator().manual_seed(2)) + assert l_x0 > 0 and l_flow > 0 and l_x0 != l_flow + # x0 = MSE(noisy − σ v_s, noisy − σ v_t) = σ² · MSE(v_s, v_t):平均 σ² < 1,所以 x0 一定比 flow 小 + assert l_x0 < l_flow + + +# ---------------------------------------------------------------------------- +# 9. 三处配方 +# ---------------------------------------------------------------------------- + +_RUN_SH_ALIAS = { + "LONG": "seg_dir", "SINK": "sink_size", "LOSS_START": "loss_start_frame", + "KEEP_DITS": "keep_last_dits", "KEEP_EMAS": "keep_last_emas", "DENOISE_LIST": "denoise_list", + "KV_WINDOW": "kv_window", "ROPE_CAP": "rope_cap", "SINK_ANCHOR": "sink_anchor", + "ROLLOUT_CELLS": "rollout_cells", "LOSS_TYPE": "loss_type", "TEACHER_CONTEXT": "teacher_context", + "TEACHER_KEEP_LAST": "teacher_keep_last", "BACKWARD_PER_CHUNK": "backward_per_chunk", + "TEACHER_LAST_CHUNK": "teacher_last_chunk", "LOSS_NORM": "loss_norm", + "EMA_DECAY": "ema_decay", "STUDENT_EMA_DECAY": "student_ema_decay", "EMA_START": "ema_start", + "USE_EMA": "use_ema", "GRAD_ACCUM": "grad_accum", "PROFILE_MEM": "profile_mem", "TEXT_TABLE": "text_table", +} +_RUN_SH_SKIP = {"STAGE3_OUT", "INIT", "OUT", "PORT", "ACC_CFG", "RESUME", "FORCE_RUN_DIR", "ALLOW_RAW_STUDENT"} +_DERIVED = {"betas", "denoise"} + + +def test_9_run_sh_defaults_match_argparse_defaults_and_config_json(tmp_path): + a = vars(S4.parse_args(["--output", str(tmp_path / "_argparse_probe"), "--dry_run"])) + checked = _check_three_places("stage4_opsd", a, _RUN_SH_ALIAS, _RUN_SH_SKIP, _DERIVED, + literals=set(), flags=()) + for must in ("kv_window", "sink_size", "rope_cap", "sink_anchor", "rollout_cells", "loss_start_frame", + "loss_type", "teacher_context", "teacher_keep_last", "teacher_last_chunk", "loss_norm", "lora_rank", + "backward_per_chunk", "ema_decay", + "lr", "adam_betas", "warmup", "grad_clip", "max_steps", "save_every", "keep_last_dits", + "student_ema_decay", "ema_start", "denoise_list", "seg_dir", "text_table"): + assert must in checked, f"{must} 没有被三处检查覆盖到" + print(f"9. recipe run.sh == argparse == config.json:{len(checked)} 个常量 {sorted(checked)}") + + +# ---------------------------------------------------------------------------- +# 10. dry run 端到端 +# ---------------------------------------------------------------------------- + +def test_10_dry_run_end_to_end(tmp_path): + out = tmp_path / "_dry_opsd" + env = dict(os.environ, CUDA_VISIBLE_DEVICES="", PYTHONPATH=ROOT, DIFFSYNTH_SKIP_DOWNLOAD="True") + cmd = [sys.executable, os.path.join(ROOT, "distill/stage4_opsd/opsd_arope.py"), "--dry_run", + "--output", str(out), "--max_steps", "2", "--rollout_cells", "8", "--loss_start_frame", "3", + "--save_every", "1"] + r = subprocess.run(cmd, env=env, capture_output=True, text=True, timeout=900) + assert r.returncode == 0, r.stdout[-3000:] + r.stderr[-3000:] + assert "[first-step] opsd" in r.stdout and "ALL SMOKE" not in r.stdout + prog = runlib.read_progress(str(out)) + assert prog and prog["step"] == 2 and prog["stage"] == "stage4_opsd" and prog.get("finished") + import csv + import json + rows = list(csv.DictReader(open(out / "train_log.csv"))) + assert [int(x["step"]) for x in rows] == [1, 2] + assert all(float(x["opsd"]) > 0 and float(x["gnorm"]) > 0 for x in rows), rows + assert all(int(x["n_scored_cells"]) == 5 and int(x["n_scored_states"]) == 20 for x in rows) + cfg = json.load(open(out / "config.json")) + assert cfg["stage"] == "stage4_opsd" and cfg["args"]["rollout_cells"] == 8 and cfg["scored_cells"] == 5 + for step in (1, 2): + for p in (runlib.dit_path(str(out), step), runlib.ema_path(str(out), step)): + res = runlib.check_ckpt_format(p, expect_keys=None, require_mask=True) + assert res["metadata"]["stage"] == "stage4_opsd" and res["metadata"]["step"] == str(step) + assert res["metadata"]["teacher_keep_last"] == "1" and res["metadata"]["rollout_cells"] == "8" + assert res["metadata"]["teacher_last_chunk"] == "teacher" and res["metadata"]["loss_norm"] == "window" + assert res["metadata"]["lora_rank"] == "256", res["metadata"].get("lora_rank") + # dits/ 与 ema/ 在 ema_start=1 之后必须不同(EMA 真的在滑动,不是硬拷贝) + from safetensors.torch import load_file + d2, e2 = load_file(runlib.dit_path(str(out), 2)), load_file(runlib.ema_path(str(out), 2)) + assert any(not torch.equal(d2[k], e2[k]) for k in d2), "step 2 的 ema 与 dit 逐位相同:EMA 没在滑" + + +# ---------------------------------------------------------------------------- +# 11 / 12. 官方口径:整窗归一化、教师自己的 x0 当上下文 +# ---------------------------------------------------------------------------- + +def _grad_norms(st, te, a, seed=2): + grads = [] + + def bwd(l): + l.backward() + grads.append(sum(float(p.grad.norm()) for p in st.parameters() if p.grad is not None)) + st.zero_grad(set_to_none=True) + + real, ctx, ids, off = S4._smoke_inputs(T, seed=5) + _, info = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), a, gen=torch.Generator().manual_seed(seed), backward_fn=bwd) + return grads, info + + +def test_11_window_norm_divides_each_cell_gradient_by_the_number_of_scored_cells(): + """官方 (step_loss / total_loss_terms).backward():逐 cell backward 时每个 cell 的 4 步均值再除以打分 cell 数。""" + st, te = _pair() + g_cell, info_c = _grad_norms(st, te, _args(loss_norm="cell")) + g_win, info_w = _grad_norms(st, te, _args(loss_norm="window")) + n = T - LOSS_START + assert info_c["cell_scale"] == 1.0 and abs(info_w["cell_scale"] - 1.0 / n) < 1e-12 + assert info_c["per_cell"] == info_w["per_cell"], "日志里的 per-cell loss 不受归一化影响" + for gc, gw in zip(g_cell, g_win): + assert abs(gw * n - gc) <= 1e-5 * max(gc, 1e-12), (gc, gw, n) + + +def test_12_teacher_last_chunk_teacher_vs_student(): + """teacher 模式 = 官方:教师缓存里 k−1 是教师自己的 x0,且其 K/V 是按官方写入顺序在 [real 0..k−3, 教师的 k−2] + 上写下的。权重相同时零 loss 的 cell 集合与 student 模式相同({1,2}:cell 2 时教师的 1 与学生的 1 逐位相同、 + 上下文 [real 0] 也相同)。cell 3 起两种模式就不同:teacher 模式最近一格(教师的 2,latent 与学生的 2 逐位相同) + 的 K/V 嵌着教师的 1(= 学生的 1 ≠ real 1),student 模式是把学生的 2 commit 到 [real 0, real 1] 上算的。""" + st, te = _pair() + real, ctx, ids, off = S4._smoke_inputs(T, seed=5) + a_t = _args(loss_start_frame=1, teacher_last_chunk="teacher") + a_s = _args(loss_start_frame=1, teacher_last_chunk="student") + _, it = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), a_t, gen=torch.Generator().manual_seed(2), check_snapshot=True) + _, is_ = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), a_s, gen=torch.Generator().manual_seed(2), check_snapshot=True) + pt, ps = it["per_cell"], is_["per_cell"] # 下标 i ⇒ cell i+1 + assert it["teacher_last_chunk"] == "teacher" and is_["teacher_last_chunk"] == "student" + assert pt[0] == 0.0 and pt[1] == 0.0 and ps[0] == 0.0 and ps[1] == 0.0 + assert pt[2] > 0 and ps[2] > 0 and pt[2] != ps[2], (pt[2], ps[2]) + assert all(pt[i] != ps[i] for i in range(3, T - 1)), "cell ≥4 起教师上下文里的 k−1 不同,loss 不该逐位相同" + assert all(v > 0 for v in pt[2:]) and all(v > 0 for v in ps[2:]) + # teacher 模式下的梯度也到得了学生 + g, _ = _grad_norms(st, te, _args(teacher_last_chunk="teacher")) + assert g and all(x > 0 for x in g[1:]) and torch.isfinite(torch.tensor(g)).all() + + +# ---------------------------------------------------------------------------- +# 13 / 14. 官方写入顺序:教师最近一格的 K/V 逐位等于官方"定长数组 + 原位替换"的结果 +# ---------------------------------------------------------------------------- + +def _commit(model, cache, x, j, off, ctx, ids): + ow, mk = frame_cond(off, j, SINK, KV, LH, LW) + with torch.no_grad(): + model(x, torch.zeros(1), ctx[:, j:j + 1], context_ids=ids[:, j:j + 1], first_frame_cond=False, + frame_index=j, kv_cache=cache, commit=True, offset_win=ow, mask_in_k=mk) + + +def _spy_with_kv(model): + """test_7 的 spy 再加一项:读趟(commit=False)时把缓存每层 K/V clone 下来(快照用完就 release,事后看不到)。""" + calls = [] + orig = model.forward + + def spy(*a, **kw): + cache = kw.get("kv_cache") + rec = dict(frame_index=kw.get("frame_index"), commit=kw.get("commit"), x=a[0], + frames_cached=cache["frames_cached"]) + if not kw.get("commit"): + rec["k"] = [None if t is None else t.clone() for t in cache["k"]] + rec["v"] = [None if t is None else t.clone() for t in cache["v"]] + calls.append(rec) + return orig(*a, **kw) + + model.forward = spy + return calls + + +def test_13_teacher_cache_matches_official_write_then_replace_order(): + """官方 gt_kv(vendor/OPSD-V model/opsd_streaming_training.py)每个 chunk 结束:先 `_write_chunk_to_cache(teacher_chunk)` + —— 此刻缓存里还是 [GT 0..k−2, 教师的 k−1],教师的 k 第 1 层起的 K/V 就嵌着教师的 k−1;**然后** + `_replace_cache_chunk_with_gt` 把 k−1 原位换成 GT(在 GT 上下文里重算),不重算最近一格。 + 这里把那套"定长数组 + 原位替换"直译成另一套构造(与 opsd_step 的快照 + append 不共享一行逻辑), + 教师在每个打分 cell 上读到的整条缓存必须逐位相同。再证明反例:把教师的 k−1 重新 commit 到全 GT 历史上, + latent 相同但从 cell 3 起第 1 层的 K 不同 —— 这就是快照法若不按官方顺序写会偏离的那一点。""" + st, te = _pair() + real, ctx, ids, off = S4._smoke_inputs(T, seed=5) + ct = _spy_with_kv(te) + S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(loss_start_frame=1, teacher_last_chunk="teacher"), + gen=torch.Generator().manual_seed(2), check_snapshot=True) + # 教师自己的 x0(官方的 teacher_chunk):cell 1..T−2 各一次 + t_lat = {c["frame_index"]: c["x"] for c in ct + if c["commit"] and not torch.equal(c["x"], real[:, :, c["frame_index"]:c["frame_index"] + 1])} + assert sorted(t_lat) == list(range(1, T - 1)), sorted(t_lat) + seen = {} # 打分 cell k 时教师读到的缓存(每层 K/V) + for c in ct: + if not c["commit"] and c["frame_index"] not in seen: + seen[c["frame_index"]] = (c["k"], c["v"]) + assert sorted(seen) == list(range(1, T)) + hw = (LH // 2) * (LW // 2) + + # ---- 官方写法的直译:C = 教师缓存(定长数组的语义),G = 纯 GT 缓存(给"原位换 GT"重算 K/V 用)---- + C = te.init_kv_cache(kv_window=KV, sink_size=SINK, rope_cap=CAP) + G = te.init_kv_cache(kv_window=KV, sink_size=SINK, rope_cap=CAP) + _commit(te, C, real[:, :, 0:1], 0, off, ctx, ids) + _commit(te, G, real[:, :, 0:1], 0, off, ctx, ids) + for k in range(1, T): + # 打分 cell k:官方缓存 = [GT 0..k−2, 教师的 k−1],与 opsd_step 里教师读到的逐位相同(每层 K 与 V、整条) + ks, vs = seen[k] + assert C["frames_cached"] == k + for li in range(len(C["k"])): + assert C["k"][li].shape == ks[li].shape, (k, li, C["k"][li].shape, ks[li].shape) + assert torch.equal(C["k"][li], ks[li]), f"cell {k} 层 {li} 的 K 与官方写入顺序不同" + assert torch.equal(C["v"][li], vs[li]), f"cell {k} 层 {li} 的 V 与官方写入顺序不同" + if k == T - 1: + break + # 官方 chunk 结束:(1) 先把教师的 k 写进缓存(上下文 = 当前 C) + _commit(te, C, t_lat[k], k, off, ctx, ids) + # (2) 再把倒数第二格(k−1)原位换成 GT:在纯 GT 缓存上以 t=0 重算 GT k−1 的 K/V(官方 _replace_cache_chunk_with_gt + # 的 is_recompute 路径只重写那一格,最近一格不动) + if k >= 2: + _commit(te, G, real[:, :, k - 1:k], k - 1, off, ctx, ids) + gk, gv = AropeDiT.last_kv_frame(G) + for li in range(len(C["k"])): + Ck, Cv = C["k"][li], C["v"][li] + assert Ck.shape[1] >= 2 * hw + C["k"][li] = torch.cat([Ck[:, :-2 * hw], gk[li], Ck[:, -hw:]], dim=1) + C["v"][li] = torch.cat([Cv[:, :-2 * hw], gv[li], Cv[:, -hw:]], dim=1) + AropeDiT.release_kv_cache(C) + AropeDiT.release_kv_cache(G) + + # ---- 反例:教师的 k−1 在**全 GT 历史**上重新 commit(快照法不按官方顺序写的结果)---- + # 第 0 层的 K/V 只看输入 latent ⇒ 相同;第 1 层起看历史 ⇒ 从 cell 3 起不同(cell 2 时历史都是 [GT 0],仍相同) + for k in range(2, T): + N = te.init_kv_cache(kv_window=KV, sink_size=SINK, rope_cap=CAP) + for j in range(k - 1): + _commit(te, N, real[:, :, j:j + 1], j, off, ctx, ids) + _commit(te, N, t_lat[k - 1], k - 1, off, ctx, ids) + ks, _ = seen[k] + assert torch.equal(N["k"][0][:, -hw:], ks[0][:, -hw:]), f"cell {k}:第 0 层 K 与上下文无关,必须相同" + same1 = torch.equal(N["k"][1][:, -hw:], ks[1][:, -hw:]) + assert same1 == (k == 2), (k, same1, "全 GT 历史上重算的 K/V 从 cell 3 起就不是官方的") + AropeDiT.release_kv_cache(N) + + +def test_14_append_kv_frame_equals_commit_path_including_eviction(): + """append_kv_frame(last_kv_frame(A)) 与直接 commit 逐位相同(每层 K/V、frames_cached),驱逐前后都成立; + 快照上做不动原缓存;last_kv_frame 给的是 clone(不拖着整条缓存);frame_index 错位被拦。""" + st, _ = _pair() + TT = CAP + 3 # 跨过饱和点(cap 6),驱逐真的发生 + real, ctx, ids, off = S4._smoke_inputs(TT, seed=7) + cache = st.init_kv_cache(kv_window=KV, sink_size=SINK, rope_cap=CAP) + _commit(st, cache, real[:, :, 0:1], 0, off, ctx, ids) + hw = (LH // 2) * (LW // 2) + for j in range(1, TT): + A = snapshot_kv_cache(cache) + _commit(st, A, real[:, :, j:j + 1], j, off, ctx, ids) # 参考:真正的 commit 路径 + ks, vs = AropeDiT.last_kv_frame(A) + assert all(t.shape[1] == hw and t._base is None for t in ks + vs), "last_kv_frame 必须给 clone 过的 [b,hw,dim]" + B = snapshot_kv_cache(cache) + ids_before, k0 = [id(t) for t in cache["k"]], cache["k"][0].clone() + with pytest.raises(AssertionError): + AropeDiT.append_kv_frame(B, ks, vs, j + 1) # frame_index 错位 + AropeDiT.append_kv_frame(B, ks, vs, j) + assert B["frames_cached"] == A["frames_cached"] == j + 1 + for li in range(len(A["k"])): + assert torch.equal(A["k"][li], B["k"][li]) and torch.equal(A["v"][li], B["v"][li]), (j, li) + assert A["k"][li].shape[1] // hw == min(j + 1, CAP) + assert [id(t) for t in cache["k"]] == ids_before and torch.equal(cache["k"][0], k0), "append 动了原缓存" + assert cache["frames_cached"] == j + AropeDiT.release_kv_cache(A) + AropeDiT.release_kv_cache(B) + _commit(st, cache, real[:, :, j:j + 1], j, off, ctx, ids) + AropeDiT.release_kv_cache(cache) + + +# ---------------------------------------------------------------------------- +# 15. 教师 EMA 只能在 fp32 上做 +# ---------------------------------------------------------------------------- + +def test_15_teacher_ema_requires_fp32_teacher(): + """官方教师 = 学生 EMA(0.9999)。bf16 半 ulp ~2e-3,1e-4 的增量 mul_/add_ 之后舍回旧值 —— 教师纹丝不动、日志却写着 + EMA。trainer 按 (device, ema_decay) 选教师 dtype:CUDA 冻结 ⇒ bf16;CUDA + EMA ⇒ fp32;CPU 恒 fp32。""" + from distill.ema import ema_update + assert S4.teacher_param_dtype("cuda", 0.0) is torch.bfloat16 + assert S4.teacher_param_dtype("cuda", 0.9999) is torch.float32 + assert S4.teacher_param_dtype("cpu", 0.0) is torch.float32 and S4.teacher_param_dtype("cpu", 0.9999) is torch.float32 + # 量给你看:学生比教师漂 0.1%(远大于一步 EMA 该走的量),bf16 教师一步 EMA 后几乎一个元素都没动,fp32 教师全动 + torch.manual_seed(0) + st = S4._smoke_model(seed=1234) + with torch.no_grad(): + for p in st.parameters(): + p.mul_(1.0 + 1e-3) + te_bf16 = S4._smoke_model(seed=1234).to(torch.bfloat16) + te_fp32 = S4._smoke_model(seed=1234) + ref_bf16 = [p.detach().clone() for p in te_bf16.parameters()] + ref_fp32 = [p.detach().clone() for p in te_fp32.parameters()] + ema_update(te_bf16, st, 0.9999) + ema_update(te_fp32, st, 0.9999) + n = sum(p.numel() for p in te_fp32.parameters()) + moved_bf16 = sum(int((p != r).sum()) for p, r in zip(te_bf16.parameters(), ref_bf16)) + moved_fp32 = sum(int((p != r).sum()) for p, r in zip(te_fp32.parameters(), ref_fp32)) + assert moved_fp32 > 0.9 * n, (moved_fp32, n) + assert moved_bf16 < 0.05 * n, (moved_bf16, n, "bf16 教师竟然吃进了 1e-4 的 EMA 增量?") + + +# ---------------------------------------------------------------------------- +# 16. LoRA 训练面(官方口径) +# ---------------------------------------------------------------------------- + +def test_16_lora_student_with_adapter_off_teacher_matches_frozen_teacher(): + from distill import lora as lora_mod + st, te = _pair() + real, ctx, ids, off = S4._smoke_inputs(T, seed=5) + st_l = S4._smoke_model(seed=1234) + keys0 = set(st_l.state_dict().keys()) + n_wrapped = lora_mod.install_lora(st_l.dit, rank=4, alpha=4, is_student=False, log=lambda *_: None) + assert n_wrapped == 2 * 6, n_wrapped # 2 层 × (self_attn q/k/v/o + ffn.0/2) + te_v = S4.TeacherView(st_l) + assert S4.unwrap(te_v) is st_l and list(te_v.parameters()) == [] + l_ref, i_ref = S4.opsd_step(st, te, real, ctx, ids, off, _deploy(), _args(), gen=torch.Generator().manual_seed(2)) + l_lora, i_lora = S4.opsd_step(st_l, te_v, real, ctx, ids, off, _deploy(), _args(), gen=torch.Generator().manual_seed(2)) + assert l_lora == l_ref and i_lora["per_cell"] == i_ref["per_cell"], "B=0 时 LoRA 学生 + 关补丁教师 必须逐位复现独立教师" + grads = [] + + def bwd(l): + l.backward() + grads.append([n for n, p in st_l.named_parameters() if p.grad is not None and float(p.grad.abs().sum()) > 0]) + st_l.zero_grad(set_to_none=True) + + S4.opsd_step(st_l, te_v, real, ctx, ids, off, _deploy(), _args(), gen=torch.Generator().manual_seed(2), backward_fn=bwd) + touched = {n for g in grads for n in g} + assert touched and all(n.endswith(("lora_A", "lora_B")) for n in touched), sorted(touched)[:5] + assert any(n.endswith("lora_B") for n in touched), "lora_B 必须有梯度(A 随机初始化 ⇒ B 的梯度非零)" + # 补丁动过之后:教师视图仍 == base;学生 != base;折叠后的 state_dict 键集与原模型相同且等于 base + B@A + with torch.no_grad(): + for p in lora_mod.lora_parameters(st_l.dit): + p.add_(torch.randn_like(p) * 0.05) + x, t5 = real[:, :, 0:1], torch.full((1,), 500.0) + o_base = st(x, t5, ctx[:, 0:1], context_ids=ids[:, 0:1], first_frame_cond=False) + o_off = te_v(x, t5, ctx[:, 0:1], context_ids=ids[:, 0:1], first_frame_cond=False) + o_on = st_l(x, t5, ctx[:, 0:1], context_ids=ids[:, 0:1], first_frame_cond=False) + assert torch.equal(o_off, o_base) and not torch.equal(o_on, o_base) + assert all(m.enabled for m in st_l.dit.modules() if isinstance(m, lora_mod.LoRALinear)), "视图用完必须恢复 enabled" + merged = lora_mod.merged_state_dict(st_l.dit, {"dit." + k: v for k, v in st_l.dit.state_dict().items()}) + assert set(merged) == keys0 + st_m = S4._smoke_model(seed=99) + st_m.load_state_dict(merged) + o_m = st_m(x, t5, ctx[:, 0:1], context_ids=ids[:, 0:1], first_frame_cond=False) + assert torch.allclose(o_m, o_on, atol=1e-5, rtol=1e-4), "折叠后的普通权重前向必须等于开补丁的 LoRA 前向" + + +if __name__ == "__main__": + raise SystemExit(pytest.main([__file__, "-q", "-s"])) diff --git a/backup_2026-09-14/code/distill/tests/test_tf_port.py b/backup_2026-09-14/code/distill/tests/test_tf_port.py new file mode 100644 index 0000000000000000000000000000000000000000..d8164b4efecde6ddb9aa45f54b169f139f37b268 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_tf_port.py @@ -0,0 +1,366 @@ +#!/usr/bin/env python3 +"""teacher forcing 移植闸门(stage1 的硬闸)——上游 `_wm/GraphGWM/train/code_distill/scripts/test_tf_port.py` +的结构照搬,补上 ActionRoPE 特有的三条(逐 cell 时间步 / first_frame_cond 抹的那一行 / 世界坐标 RoPE 分两半)。 + + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest \\ + /data/zhiyangdeng/ActionRoPE/distill/tests/test_tf_port.py -q -s + # 或直接当脚本跑:... .venv/bin/python distill/tests/test_tf_port.py + +为什么这是**闸门**而不是普通单测(PORT_SPEC risk 7,全项目第一号"假成功") +-------------------------------------------------------------------- +teacher forcing 的全部意义在于:noisy cell f 只能看见**干净的** 0..f-1。要是它还能看见 clean cell f, +那就是直接看答案 —— loss 会掉到接近 0,曲线漂亮,rollout 是坏的,而且没有任何报错。 +所以第 3 条断言要求泄漏**精确等于 0.00e+00**(不是 <1e-6):掩码要么完全挡住,要么就是漏了。 + +几何:tiny 模型(dim 128 / 2 层 / 4 头),latent 8×10 ⇒ patch 后 4×5 = 20 token/cell,F=21 cell, +S = 21×20 = 420,TF 双流 840 token。真实规模是 hw=390、S=8190、TF 16380 —— 语义完全一样, +这里用 float64 跑,掩码泄漏是不是精确 0 一目了然。 +""" +from __future__ import annotations + +import importlib.util +import os +import sys +import types + +import pytest +import torch + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) # 本机路径;旧机是 /data/zhiyangdeng/ActionRoPE +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from diffsynth.models.wan_video_dit import WanModel # noqa: E402 + +from actionrope.arope import PX_PER_LATENT, arope_forward, install_arope, known_mask # noqa: E402 +from distill import arope_dit as AD # noqa: E402 +from distill.arope_dit import AropeDiT, build_tf_mask # noqa: E402 + +DEV = "cuda" if torch.cuda.is_available() else "cpu" +DT = torch.float64 # 泄漏必须是精确 0:float64 下没有"数值噪声"这个借口 +B, C, F, LH, LW, L_TXT = 1, 48, 21, 8, 10, 8 +HW = (LH // 2) * (LW // 2) # 20 token/cell(真实几何 390) +S = F * HW # 420(真实几何 8190) +REAL_HW, REAL_S = 390, 8190 # 真实几何,只用于报告里的对照 + + +# ---------------------------------------------------------------------------- +# 夹具 +# ---------------------------------------------------------------------------- + +def _tiny_dit(seed: int = 1234) -> WanModel: + torch.manual_seed(seed) + dit = WanModel(dim=128, in_dim=C, ffn_dim=256, out_dim=C, text_dim=4096, freq_dim=256, eps=1e-6, + patch_size=(1, 2, 2), num_heads=4, num_layers=2, has_image_input=False) + dit = dit.to(device=DEV, dtype=DT).eval().requires_grad_(False) + install_arope(dit, mask_channel=True) + with torch.no_grad(): + # 零初始化的 mask 通道 = 没接上:随机化之后 mask_input 才真的参与前向 + dit.arope_mask_embedding.weight.normal_(0.0, 0.02) + dit.arope_mask_embedding.bias.normal_(0.0, 0.02) + dit.freqs = tuple(t.to(DEV) for t in dit.freqs) + return dit + + +def _model(causal: bool, seed: int = 1234) -> AropeDiT: + return AropeDiT(dit=_tiny_dit(seed), mask_channel=True, causal=causal) + + +def _inputs(seed: int = 7): + g = torch.Generator().manual_seed(seed) + x = torch.randn(B, C, F, LH, LW, generator=g).to(device=DEV, dtype=DT) + clean = torch.randn(B, C, F, LH, LW, generator=g).to(device=DEV, dtype=DT) + ctx = torch.randn(B, F, L_TXT, 4096, generator=g).to(device=DEV, dtype=DT) + ids = torch.zeros(B, F, dtype=torch.int64, device=DEV) # 普通 clip:21 条文本相同 + off = torch.zeros(B, F, 2) + off[:, 1:] = torch.randn(B, F - 1, 2, generator=g).cumsum(1) * 12.0 # cell 0 = 0(世界坐标锚点) + off = off.to(device=DEV, dtype=torch.float32) + mask_in = known_mask(off / PX_PER_LATENT, LH, LW).to(torch.float32).unsqueeze(1) + ts = torch.full((B,), 700.0, device=DEV, dtype=DT) + ts_pf = torch.linspace(50.0, 950.0, F, device=DEV, dtype=DT).unsqueeze(0).repeat(B, 1) # [b, 21] 逐 cell + return dict(x=x, clean=clean, ctx=ctx, ids=ids, off=off, mask_in=mask_in, ts=ts, ts_pf=ts_pf) + + +@pytest.fixture(scope="module") +def d(): + return _inputs() + + +@pytest.fixture(scope="module") +def causal_m(): + return _model(True) + + +@pytest.fixture(scope="module") +def bidir_m(): + return _model(False) + + +def _cond(d, *, tf: bool = False) -> dict: + """三路条件(逐 cell 文本 id / 世界坐标 / known 掩码)+ TI2V 锚点,与 stage1 的实参一致。""" + kw = dict(context_ids=d["ids"], offset_px=d["off"], mask_input=d["mask_in"], first_frame_cond=True) + if tf: + kw["clean_x"] = d["clean"] + return kw + + +# ---------------------------------------------------------------------------- +# 1. clean_x=None 时必须与非 TF 路径逐位相同(移植不用时必须免费) +# ---------------------------------------------------------------------------- + +@pytest.mark.parametrize("causal", [False, True]) +def test_1_identity_when_clean_x_none(d, causal): + m = _model(causal) + with torch.no_grad(): + a = m(d["x"], d["ts"], d["ctx"], **_cond(d)) + b = m(d["x"], d["ts"], d["ctx"], **_cond(d), clean_x=None, aug_t=None) + assert torch.equal(a, b), "显式传 clean_x=None 改变了输出" + print(f"1. identity causal={causal!s:<5} clean_x=None 逐位相同: True {tuple(a.shape)}") + if not causal: + with torch.no_grad(): + ref = arope_forward(m.dit, d["x"], d["ts"], d["ctx"], offset_px=d["off"], + first_frame_cond=True, mask_input=d["mask_in"], context_ids=d["ids"]) + assert torch.equal(ref, a), "双向路径与上游 arope_forward 不再逐位相同(回归锚点断了)" + print(" + 与上游 arope_forward 逐位相同: True") + + +# ---------------------------------------------------------------------------- +# 2. TF 的形状:只吐 noisy 半流 +# ---------------------------------------------------------------------------- + +def test_2_tf_shapes(d, causal_m): + with torch.no_grad(): + v = causal_m(d["x"], d["ts"], d["ctx"], **_cond(d, tf=True)) + v_shared = causal_m(d["x"], d["ts"], d["ctx"][:, 0], offset_px=d["off"], + mask_input=d["mask_in"], first_frame_cond=True, clean_x=d["clean"]) + assert tuple(v.shape) == (B, C, F, LH, LW), f"TF 输出 {tuple(v.shape)} 不是 noisy 半流" + assert tuple(v_shared.shape) == (B, C, F, LH, LW) + assert torch.isfinite(v).all() + print(f"2. shapes TF 输出 {tuple(v.shape)} == 只有 noisy 半流: True(逐 cell 文本 / 整条文本都过)") + + +def test_2b_tf_requires_causal(d, bidir_m): + with pytest.raises(AssertionError): + bidir_m(d["x"], d["ts"], d["ctx"], **_cond(d, tf=True)) + print(" TF + causal=False 被拒绝: True") + + +# ---------------------------------------------------------------------------- +# 3. 泄漏矩阵:clean f -> noisy f 必须精确是 0.00e+00 +# ---------------------------------------------------------------------------- + +@pytest.fixture(scope="module") +def leak_matrix(d, causal_m): + with torch.no_grad(): + base = causal_m(d["x"], d["ts"], d["ctx"], **_cond(d, tf=True)) + rows = [] + for f in range(F): + c2 = d["clean"].clone() + c2[:, :, f] += 5.0 # 只扰动 clean cell f + with torch.no_grad(): + vv = causal_m(d["x"], d["ts"], d["ctx"], **_cond(d), clean_x=c2) + rows.append((vv - base).abs().amax(dim=(0, 1, 3, 4))) # [F] 每个 noisy cell 的 max|Δ| + return torch.stack(rows) # M[f_clean, f_noisy] + + +def test_3a_no_self_copy(leak_matrix): + M = leak_matrix + self_leak = max(float(M[f, f]) for f in range(F)) + print(f"3. no-copy clean f -> noisy f 泄漏 {self_leak:.2e}(必须精确 0): {self_leak == 0.0}") + assert self_leak == 0.0, ( + f"noisy cell f 看得见自己的 clean 孪生(泄漏 {self_leak:.3e})——" + "模型可以直接抄答案,loss 会掉到 0 而 rollout 是坏的") + + +def test_3b_history_reaches_next_cell(leak_matrix): + M = leak_matrix + prev = min(float(M[f, f + 1]) for f in range(F - 1)) + print(f" history clean f -> noisy f+1 影响 {prev:.2e}(必须 >0): {prev > 0}") + assert prev > 1e-9, "clean 历史根本没进 noisy 流 —— 掩码把 noise_ctx 也挡了" + + +def test_3c_no_future_leak(leak_matrix): + M = leak_matrix + fut = max((float(M[f, g]) for f in range(F) for g in range(f)), default=0.0) + print(f" no-future clean f -> noisy 0 + loss.backward() + g_head = m.dit.head.head.weight.grad + g_mask = m.dit.arope_mask_embedding.weight.grad + assert g_head is not None and torch.isfinite(g_head).all() and float(g_head.abs().sum()) > 0 + assert g_mask is not None and float(g_mask.abs().sum()) > 0, "mask 通道没进计算图" + print(f"8. loss ar_tf_loss = {float(loss.detach()):.4f}(w {float(stats['loss_w']):.4f} " + f"mse {float(stats['mse']):.4f} new {float(stats['new_frac']):.2f});" + f"cell0 干净 + t=0、梯度到 head 与 mask 通道: True") + + +def test_8b_no_teacher_forcing_fallback(ar_tf_mod, d): + """--no-teacher_forcing 的回退路径必须是真代码:单流 + 块因果,cell 0 依旧干净。""" + m = _model(True) + batch = {"input_latents": d["x"], "context": d["ctx"], "context_ids": d["ids"], "offset_px": d["off"]} + rec = _Recorder(m) + torch.manual_seed(0) + loss, _ = ar_tf_mod.ar_tf_loss(rec, batch, teacher_forcing=False) + assert rec.seen["kw"]["clean_x"] is None and rec.seen["kw"]["aug_t"] is None + assert torch.isfinite(loss) and float(loss.detach()) > 0 + print(f" diffusion-forcing 回退(clean_x=None)loss = {float(loss.detach()):.4f}: OK") + + +if __name__ == "__main__": + sys.exit(pytest.main([os.path.abspath(__file__), "-q", "-s"])) diff --git a/backup_2026-09-14/code/distill/tests/test_world_rope_window.py b/backup_2026-09-14/code/distill/tests/test_world_rope_window.py new file mode 100644 index 0000000000000000000000000000000000000000..ab59b8f185771daed7cc66c9b3052b94a302d1d8 --- /dev/null +++ b/backup_2026-09-14/code/distill/tests/test_world_rope_window.py @@ -0,0 +1,406 @@ +#!/usr/bin/env python3 +"""世界坐标 RoPE 的**窗口锚定**闸门(PORT_SPEC risk 3;上游没有对应文件,全新)。 + + CUDA_VISIBLE_DEVICES=0 PYTHONPATH=/data/zhiyangdeng/ActionRoPE DIFFSYNTH_SKIP_DOWNLOAD=True \\ + /data/zhiyangdeng/ActionRoPE/.venv/bin/python -m pytest \\ + /data/zhiyangdeng/ActionRoPE/distill/tests/test_world_rope_window.py -q -s + +要证的是什么 +----------- +WorldMind 的滑窗把当前帧的时间位钳成 `tpos = min(frame_index, rope_cap)`,再把开头 `sink_size` +帧永久钉在时间位 0..sink-1。时间轴上这样做是安全的(位置是序号)。ARoPE 的 h/w RoPE 位不是序号, +是**一直在漂的世界坐标**——钳位对它没有意义,钉住更糟。所以这里改成:窗口内每个 cell 的 +**时间位和世界坐标一起**减去窗口里最老那一格(`data.window_offsets` / `preflight.window_offsets_for_frame`), +`sink_size = 0`。 + +这套做法成立需要三件事同时为真,本文件逐条量: + +(a) **整窗平移不变**。RoPE 是相对编码,把一整个窗口的 (t, offset) 同时加一个常量,自注意力 + 分数一位不变 ⇒ 重锚定是**精确**变换,不是近似。(这同时解释了为什么 sink 必须是 0: + sink 帧不跟着窗口一起平移,平移就不再是"常量",(a) 立刻失效。) + +(b) **锚定之后的窗口位移落在训练包络内**。包络从真实语料现算(`data/latent/arope_sidecar.pt`, + 22781 个 valid clip),不信任 PORT_SPEC 里写死的 373.0 px。锚定窗口的跨度恒等于 + `kv_window` 个 cell 的位移——与一条 21-cell 训练 clip 同构,**不随 rollout 长度增长**。 + +(c) **不锚定就会漂出去**(负控制)。世界坐标直接用绝对值时,位移随 N 线性增长;N=30 时 + 实测已经越过包络。sink_size>0 等价于把 cell 0 永久留在窗口里,跨度就是这个漂出去的值—— + 这就是"sink_size 必须是 0"的全部理由。 + +(d) **mask 通道要跟着锚定坐标一起算**。`known_mask` 是模型输入,它必须和 RoPE 用同一套坐标; + 用绝对世界坐标算的话,rollout 到 N=30 整幅都会被标成 new,模型收到的是训练时没见过的输入。 + +几何:tiny 模型(dim 128 / 2 层 / 4 头),float64。分数不变性是 1e-16 还是 1e-3 是两个不同的结论。 +""" +from __future__ import annotations + +import os +import sys + +import pytest +import torch + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +ROOT = os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) + +from actionrope.arope import PX_PER_LATENT, PX_PER_TOKEN, known_mask # noqa: E402 +from diffsynth.models.wan_video_dit import rope_apply # noqa: E402 +from distill.arope_dit import AropeDiT, _heads, build_world_freqs # noqa: E402 +from distill.data import extend_offsets, make_mask_input, make_weight_map, window_offsets # noqa: E402 +from distill.tests.preflight import retained_cells, tiny_dit, window_offsets_for_frame # noqa: E402 + +DEV = "cuda" if torch.cuda.is_available() else "cpu" +DT = torch.float64 +B, C, LH, LW, L_TXT = 1, 48, 8, 10, 8 +H, W = LH // 2, LW // 2 # patch 后 4×5 = 20 token/cell(真实几何 15×26 = 390) +REAL_LAT_H, REAL_LAT_W = 30, 52 # 真实 latent 几何,(b)(c)(d) 全按它算 + +KV_WINDOW, SINK, N_ROLL = 20, 0, 30 # stage3 的部署配置 + 一条 30 cell 的 rollout +N_CLIPS = 512 # 语料抽样数(全量 22781 也跑得动,抽样是为了测试时长) + +# PORT_SPEC 里写死的数(本文件的任务之一就是**核对**它,不是相信它) +SPEC_ENV_PX, SPEC_ENV_TOK, SPEC_ENV_LAT = 373.0, 11.66, 23.31 + +SIDECAR = os.path.join(ROOT, "data/latent/arope_sidecar.pt") +SIDECAR_FALLBACK = os.path.join(ROOT, "hf/data/arope_sidecar.pt") + + +# ---------------------------------------------------------------------------- +# 夹具 +# ---------------------------------------------------------------------------- + +@pytest.fixture(scope="module") +def sa(): + """真实的 SelfAttention(norm_q / norm_k / q / k 全走一遍),不是自造的点积。""" + dit = tiny_dit(seed=1234, device=DEV, dtype=DT, dim=128, ffn_dim=256, num_heads=4, num_layers=2) + return dit, dit.blocks[0].self_attn + + +@pytest.fixture(scope="module") +def model(): + dit = tiny_dit(seed=1234, device=DEV, dtype=DT, dim=128, ffn_dim=256, num_heads=4, num_layers=2) + return AropeDiT(dit=dit, mask_channel=True, causal=True) + + +@pytest.fixture(scope="module") +def corpus(): + """真实语料的逐 cell 世界坐标 [Nclip, 21, 2] px(只取 valid)。""" + path = SIDECAR if os.path.exists(SIDECAR) else SIDECAR_FALLBACK + if not os.path.exists(path): + if os.environ.get("AROPE_REQUIRE_SIDECAR") == "1": + # RUNBOOK 的启动门带这个变量跑:sink=0 的包络证据门(b/c/d)不许静默跳过(GEO-5) + pytest.fail(f"AROPE_REQUIRE_SIDECAR=1 但没有 sidecar({SIDECAR} / {SIDECAR_FALLBACK})" + "—— (b)(c)(d) 的语料闸不许静默跳过") + pytest.skip(f"没有 sidecar({SIDECAR}),(b)(c)(d) 的语料闸跳过") + sc = torch.load(path, map_location="cpu", weights_only=False) + clips = sc["clips"] + off = torch.stack([e["offset_px"].to(torch.float32) for e in clips.values() if e["valid"]]) + return dict(off=off, n_total=len(clips), n_valid=off.shape[0], path=path, + walk=tuple(float(v) for v in sc["meta"]["walk_speed_px_s"])) + + +def _win_offsets(f: int, seed: int, px_per_cell=(17.31, 11.50), jitter: float = 4.0): + """一段与真实 clip 同量级的窗口世界坐标 [1, f, 2] px(cell 0 = 0)。""" + g = torch.Generator().manual_seed(seed) + per = torch.tensor(px_per_cell).view(1, 1, 2) + off = torch.zeros(1, f, 2) + off[:, 1:] = (per + torch.randn(1, f - 1, 2, generator=g) * jitter).cumsum(1) + return off.to(device=DEV, dtype=torch.float64) + + +def _scores(sa_mod, x, freqs): + """自注意力**分数**(softmax 之前):只有它决定 RoPE 编了什么位置关系。""" + n = sa_mod.num_heads + q = rope_apply(sa_mod.norm_q(sa_mod.q(x)), freqs, n) + k = rope_apply(sa_mod.norm_k(sa_mod.k(x)), freqs, n) + return _heads(q, n) @ _heads(k, n).transpose(-1, -2) + + +# ============================================================================ +# (a) 整窗平移不变 —— 窗口锚定之所以是精确变换 +# ============================================================================ + +def test_a1_scores_invariant_under_constant_window_shift(sa): + """把窗口的 (t, offset) 同时加一个常量:分数必须一位不变。 + + 这正是 rollout 里发生的事——绝对 cell k 的窗口 [a, k],我们把它当成"从 0 起算的 + 一段 clip"来编码(时间位 j−a、世界坐标 off[j]−off[a])。这两种编码差的就是常量 + (Δt=a, Δoff=off[a]),所以它们**必须**给出同一组分数,否则重锚定就是在改模型的输入。 + """ + dit, sa_mod = sa + Fw = KV_WINDOW + 1 # 21 cell = 一整个滑窗 + S = Fw * H * W + g = torch.Generator().manual_seed(3) + x = torch.randn(1, S, dit.dim, generator=g).to(device=DEV, dtype=DT) + + off_abs = _win_offsets(Fw, seed=11) # 窗口内各 cell 的"绝对"世界坐标 + a_t = 137 # 时间轴常量位移(绝对 cell 序号 a) + d_off = torch.tensor([[[451.0, -288.0]]], dtype=torch.float64, device=DEV) # 世界坐标常量位移 + + f_anch = build_world_freqs(dit, Fw, H, W, off_abs / PX_PER_TOKEN, device=DEV, f_start=0) + f_shift = build_world_freqs(dit, Fw, H, W, (off_abs + d_off) / PX_PER_TOKEN, + device=DEV, f_start=a_t) + with torch.no_grad(): + sA, sB = _scores(sa_mod, x, f_anch), _scores(sa_mod, x, f_shift) + dmax = float((sA - sB).abs().max()) + rel = dmax / float(sA.abs().max()) + assert rel < 1e-12, ( + f"整窗平移 (Δt={a_t}, Δoff={d_off.flatten().tolist()} px) 改变了注意力分数 " + f"(rel {rel:.3e}) —— 窗口重锚定不是精确变换,滑窗 KV 的全部前提失效") + print(f"a1. shift-inv 窗口 {Fw} cell、Δt={a_t}、Δoff={d_off.flatten().tolist()} px:" + f"分数 max|Δ| {dmax:.3e},相对 {rel:.3e}(float64 机器精度)") + + +def test_a2_non_constant_shift_does_change_scores(sa): + """负控制:只挪窗口里**一个** cell(非常量位移)必须显著改变分数,否则 a1 是白测的。""" + dit, sa_mod = sa + Fw = KV_WINDOW + 1 + S = Fw * H * W + g = torch.Generator().manual_seed(3) + x = torch.randn(1, S, dit.dim, generator=g).to(device=DEV, dtype=DT) + off_abs = _win_offsets(Fw, seed=11) + bad = off_abs.clone() + bad[:, Fw // 2] += torch.tensor([80.0, 0.0], dtype=torch.float64, device=DEV) # 2.5 token + f_ok = build_world_freqs(dit, Fw, H, W, off_abs / PX_PER_TOKEN, device=DEV, f_start=0) + f_bad = build_world_freqs(dit, Fw, H, W, bad / PX_PER_TOKEN, device=DEV, f_start=0) + with torch.no_grad(): + d = float((_scores(sa_mod, x, f_ok) - _scores(sa_mod, x, f_bad)).abs().max()) + assert d > 1e-3, f"只挪一个 cell 也没改变分数({d:.3e})—— 世界坐标根本没进 RoPE" + print(f"a2. control 只挪窗口里一个 cell(+80 px = 2.5 token):分数 max|Δ| {d:.3e}(必须 >0)") + + +def test_a3_model_output_invariant_under_world_shift(model): + """端到端:整段 clip 的世界坐标同时加常量、mask 通道保持不变 ⇒ 模型输出不变。 + + a1 证的是分数,这里证的是**整个 ARoPE 前向**(patch/mask/cross-attn/head 全在内) + 也只依赖相对世界坐标。stage3 的 rollout 靠的就是这条。 + + 两档精度,分开测,因为它们的下界来自不同的地方: + * offset 用 float64 ⇒ rel ~1e-16,这是 RoPE 数学本身(complex128 + rope_apply 的 fp64 升位); + * offset 用 float32(`AropeLatentDataset` 给的就是 f32)⇒ rel ~1e-9,下界是 + **平移之后那个坐标的 float32 存储精度**(451 px 上 1 ulp ≈ 5e-5 px),不是 RoPE。 + 两者都远在 bf16 训练噪声(eps 8e-3)之下,所以重锚定在实际训练里是精确的。 + """ + Fc = 5 + g = torch.Generator().manual_seed(5) + x = torch.randn(B, C, Fc, LH, LW, generator=g).to(device=DEV, dtype=DT) + ctx = torch.randn(B, Fc, L_TXT, 4096, generator=g).to(device=DEV, dtype=DT) + ids = torch.arange(Fc, device=DEV).unsqueeze(0) + off64 = _win_offsets(Fc, seed=9) # float64 + ts = torch.tensor([[0.0, 900.0, 700.0, 400.0, 150.0]], device=DEV, dtype=DT) + rels = {} + for name, dtype, tol in (("f64", torch.float64, 1e-12), ("f32", torch.float32, 1e-7)): + off = off64.to(dtype) + mask_in = known_mask(off / PX_PER_LATENT, LH, LW).to(torch.float32).unsqueeze(1) + shift = torch.tensor([[[451.0, -288.0]]], device=DEV, dtype=dtype) + kw = dict(context_ids=ids, mask_input=mask_in, first_frame_cond=True) + with torch.no_grad(): + o0 = model(x, ts, ctx, offset_px=off, **kw) + o1 = model(x, ts, ctx, offset_px=off + shift, **kw) # mask 通道故意保持不变 + rels[name] = float((o0 - o1).abs().max()) / float(o0.abs().max()) + assert rels[name] < tol, \ + f"整段世界坐标平移改变了模型输出(offset {name},rel {rels[name]:.3e} ≥ {tol:.0e})" + print(f"a3. end-to-end 整段 clip 世界坐标 +[451.0, -288.0] px、mask 不变:输出相对 max|Δ| " + f"offset-f64 {rels['f64']:.3e}(RoPE 数学)/ offset-f32 {rels['f32']:.3e}" + f"(数据集真实 dtype,下界是 f32 存储精度);bf16 训练噪声是 8e-3") + + +# ============================================================================ +# (b) 训练包络:先从真实语料量出来,再看锚定窗口在不在里面 +# ============================================================================ + +@pytest.fixture(scope="module") +def envelope(corpus): + """训练包络 = 语料里**任意两 cell 之间**世界位移的最大值(逐轴,px)。 + + "任意两 cell"而不是"相对 cell 0",因为滑窗的锚点是窗口里最老那一格,不一定是 cell 0。 + """ + off = corpus["off"] # [Nclip, 21, 2] + pair = (off[:, :, None, :] - off[:, None, :, :]).abs() # [Nclip, 21, 21, 2] + return dict(px=float(pair.max()), abs_px=float(off.abs().max())) + + +def test_b1_envelope_matches_spec(corpus, envelope): + """PORT_SPEC 写的 373.0 px = 11.66 token = 23.31 latent 格必须能被真实 sidecar 复现。""" + env = envelope["px"] + tok, lat = env / PX_PER_TOKEN, env / PX_PER_LATENT + assert corpus["n_valid"] == 22781 and corpus["n_total"] == 22782, \ + f"语料规模不对:{corpus['n_valid']} valid / {corpus['n_total']}(PORT_SPEC 记的是 22781/22782)" + assert abs(env - SPEC_ENV_PX) < 1.0, f"包络 {env:.2f} px 与 PORT_SPEC 的 {SPEC_ENV_PX} 对不上" + assert abs(tok - SPEC_ENV_TOK) < 0.02 and abs(lat - SPEC_ENV_LAT) < 0.05 + # cell 0 恒为 0,所以"任意两 cell"的极值恰好在"相对 cell 0"上取到 + assert abs(env - envelope["abs_px"]) < 1e-3, "最大 pairwise 位移不等于最大 |offset_px|" + assert float(corpus["off"][:, 0].abs().max()) == 0.0, "cell 0 的世界坐标不是 0" + print(f"b1. envelope {corpus['n_valid']}/{corpus['n_total']} valid clip,21 cell 内最大世界位移 " + f"{env:.2f} px = {tok:.3f} token = {lat:.3f} latent 格" + f"(PORT_SPEC: {SPEC_ENV_PX}/{SPEC_ENV_TOK}/{SPEC_ENV_LAT});步速 {corpus['walk']}") + + +def _window_vs_world(off_ext: torch.Tensor, kv_window: int, sink_size: int = 0): + """逐 cell 量两个数:锚定窗口的跨度、以及不锚定(相对 cell 0)的世界位移。返回 [b, N+1] 两张表。""" + n = off_ext.shape[1] + anch, world = [], [] + for k in range(n): + ow = window_offsets_for_frame(off_ext, k, sink_size, kv_window) # [b, n_cached+1, 2] + anch.append(ow.abs().amax(dim=(1, 2))) + world.append((off_ext[:, k] - off_ext[:, 0]).abs().amax(dim=1)) + return torch.stack(anch, 1), torch.stack(world, 1) + + +@pytest.fixture(scope="module") +def rollout_stats(corpus): + """把 512 条真实 clip 按 stage3 的默认延长方式(resample,5 cell 一换向)延到 N=30。""" + torch.manual_seed(0) + sel = torch.randperm(corpus["off"].shape[0])[:N_CLIPS] + o = corpus["off"][sel] + g = torch.Generator().manual_seed(0) + ext = extend_offsets(o, N_ROLL, mode="resample", chunk=5, rng=g) # [N_CLIPS, 31, 2] + A, U = _window_vs_world(ext, KV_WINDOW, SINK) + return dict(ext=ext, anchored=A, world=U) + + +def test_b2_anchored_window_stays_in_envelope(envelope, rollout_stats): + """锚定窗口的跨度 ≈ kv_window 个 cell 的位移,**不随 rollout 长度增长**,且落在包络内。""" + env = envelope["px"] + A = rollout_stats["anchored"] + frac_out = float((A.amax(1) > env).float().mean()) + ratio = float(A.max()) / env + grow = float(A[:, N_ROLL].mean() / A[:, KV_WINDOW].mean()) + assert ratio < 1.05, f"锚定窗口跨度 {A.max():.1f} px = {ratio:.3f}× 包络,超出太多" + assert frac_out < 0.01, f"{frac_out:.3f} 的 clip 的锚定窗口越过了包络(应 <1%)" + assert grow < 1.0, ( + f"锚定窗口跨度随 N 增长了(N={N_ROLL} 是 N={KV_WINDOW} 的 {grow:.3f} 倍)—— " + "窗口没有真的被 kv_window 限住") + print(f"b2. anchored {N_CLIPS} 条真实 clip 延到 N={N_ROLL}(resample)、kv_window={KV_WINDOW}:" + f"跨度 max {float(A.max()):.1f} px = {ratio:.3f}× 包络,越界比例 {frac_out:.4f}," + f"N={N_ROLL} 相对 N={KV_WINDOW} 的增长 {grow:.3f}×(<1 ⇒ 不随 rollout 变长)") + + +def test_b3_fastest_real_clip_anchored_equals_envelope(corpus, envelope): + """确定性版本:取语料里最快的那条 clip、按它自己的末段速度续走到 N=30。 + + 锚定跨度恒等于包络本身(它就是定义包络的那条 clip 的 21-cell 位移)——**一点没多**。 + """ + off = corpus["off"] + i = int(off.abs().amax(dim=(1, 2)).argmax()) + ext = extend_offsets(off[i:i + 1], N_ROLL, mode="continue") + A, _ = _window_vs_world(ext, KV_WINDOW, SINK) + a_max = float(A.max()) + assert a_max <= envelope["px"] + 1e-3, \ + f"最快 clip 的锚定跨度 {a_max:.2f} px 越过了包络 {envelope['px']:.2f}" + print(f"b3. fastest 语料最快 clip(#{i})续走到 N={N_ROLL}:锚定跨度 max {a_max:.2f} px " + f"= {a_max / PX_PER_TOKEN:.2f} token,恰好等于包络({envelope['px']:.2f} px)") + + +# ============================================================================ +# (c) 负控制:不锚定就漂出去;sink_size>0 等价于不锚定 +# ============================================================================ + +def test_c1_unanchored_world_coords_drift_out_of_range(corpus, envelope, rollout_stats): + """不锚定(世界坐标直接相对 cell 0)时,位移随 N 增长并越过包络。""" + env = envelope["px"] + A, U = rollout_stats["anchored"], rollout_stats["world"] + u_max = float(U.max()) + frac_a = float((A.amax(1) > env).float().mean()) + frac_u = float((U[:, N_ROLL] > env).float().mean()) + grow = float(U[:, N_ROLL].max() / U[:, KV_WINDOW].max()) + assert u_max > env, f"不锚定的最大位移 {u_max:.1f} px 没有越过包络 {env:.1f} px" + assert frac_u > 10 * max(frac_a, 1e-4), \ + f"不锚定的越界比例 {frac_u:.4f} 没有显著高于锚定的 {frac_a:.4f}" + assert grow > 1.2, f"不锚定的位移没有随 N 增长(N={N_ROLL}/N={KV_WINDOW} = {grow:.3f})" + + # 确定性版本:最快的那条 clip + off = corpus["off"] + i = int(off.abs().amax(dim=(1, 2)).argmax()) + ext = extend_offsets(off[i:i + 1], N_ROLL, mode="continue") + d30 = float((ext[0, N_ROLL] - ext[0, 0]).abs().max()) + assert d30 > env, f"最快 clip 在 N={N_ROLL} 的世界位移 {d30:.1f} px 没有越过包络" + print(f"c1. unanchored {N_CLIPS} 条 clip 到 N={N_ROLL}:不锚定位移 max {u_max:.1f} px " + f"= {u_max / env:.2f}× 包络,越界比例 {frac_u:.4f}(锚定 {frac_a:.4f})," + f"N={N_ROLL}/N={KV_WINDOW} 增长 {grow:.2f}×;最快 clip 到 N={N_ROLL} 已漂到 " + f"{d30:.1f} px = {d30 / PX_PER_TOKEN:.2f} token(包络 {env / PX_PER_TOKEN:.2f} token)") + + +def test_c2_sink_pins_cell0_and_reproduces_the_drift(corpus, envelope): + """sink_size>0 = 把 cell 0 永久留在窗口里 ⇒ 窗口跨度就是那个漂出去的世界位移。 + + 这就是"ActionRoPE 用 sink_size=0"的全部理由,也是与 WorldMind 唯一的结构性分歧。 + """ + assert retained_cells(N_ROLL, 0, KV_WINDOW) == list(range(N_ROLL - KV_WINDOW, N_ROLL)), \ + "sink=0 的保留集合应是最近 kv_window 个 cell" + r1 = retained_cells(N_ROLL, 1, KV_WINDOW) + assert r1[0] == 0 and r1[1:] == list(range(N_ROLL - KV_WINDOW, N_ROLL)), \ + f"sink=1 应把 cell 0 永久钉住,实测保留集合 {r1}" + assert len(r1) == 1 + KV_WINDOW + + off = corpus["off"] + i = int(off.abs().amax(dim=(1, 2)).argmax()) + ext = extend_offsets(off[i:i + 1], N_ROLL, mode="continue") + span0 = float(window_offsets_for_frame(ext, N_ROLL, 0, KV_WINDOW).abs().max()) + span1 = float(window_offsets_for_frame(ext, N_ROLL, 1, KV_WINDOW).abs().max()) + env = envelope["px"] + assert span0 <= env + 1e-3, f"sink=0 的窗口跨度 {span0:.1f} px 越界了" + assert span1 > env, f"sink=1 的窗口跨度 {span1:.1f} px 竟然没越界(钉住的 cell 0 没生效?)" + print(f"c2. sink 最快 clip、cell {N_ROLL}:sink=0 窗口跨度 {span0:.1f} px " + f"= {span0 / PX_PER_TOKEN:.2f} token(包络内);sink=1 因为钉住 cell 0,跨度 " + f"{span1:.1f} px = {span1 / PX_PER_TOKEN:.2f} token = {span1 / env:.2f}× 包络(训练分布外)") + + +# ============================================================================ +# (d) mask 通道 / loss 权重图必须和锚定坐标一致 +# ============================================================================ + +def test_d1_mask_agrees_with_anchored_offsets(corpus): + """整条 clip 锚在 cell 0 时(a=0、off[0]=0),锚定坐标算的 mask 与训练时逐位相同。""" + off = corpus["off"][:4] # [4, 21, 2] + full = make_mask_input(off, REAL_LAT_H, REAL_LAT_W) # [4, 1, 21, 30, 52] + for k in (0, 7, 13, 20): + ow = window_offsets(off, 0, k) + got = make_mask_input(ow[:, -1:], REAL_LAT_H, REAL_LAT_W) + assert torch.equal(got, full[:, :, k:k + 1]), f"cell {k} 的锚定 mask 与训练时的不同" + w = make_weight_map(off, REAL_LAT_H, REAL_LAT_W, new_weight=2.0) + known = full.bool() + assert torch.equal(w.eq(1.0), known) and torch.equal(w.eq(2.0), ~known), \ + "loss 权重图与 known 掩码在 flat 模式下应严格互补(known=1 / new=2)" + print(f"d1. mask 4 条真实 clip:window_offsets(off,0,k) 算出的 mask 与整段训练 mask " + f"逐位相同(cell 0/7/13/20);权重图 known=1 / new=2.0 与掩码严格互补") + + +def test_d2_unanchored_mask_leaves_the_training_range(corpus): + """mask 通道的负控制:锚定的 known 比例**不随 N 变化**,不锚定的单调塌到 0。 + + known 比例是模型的**输入**,不是 loss 配方。真实语料里逐 cell known 比例的下界是 + 22.3%(中位数 80.8%,0.1 分位 45.1%);不锚定的世界坐标 rollout 到 N=50 时是精确的 0—— + "整幅都是没见过的新内容",训练时一个 cell 也没有。而锚定之后它恒等于 + "kv_window 个 cell 的位移"对应的那个比例,与训练分布同一档。 + """ + off = corpus["off"] + ratio = make_mask_input(off, REAL_LAT_H, REAL_LAT_W).mean(dim=(1, 3, 4)) # [Nclip, 21] + tr_min, tr_p001, tr_med = (float(ratio.min()), float(ratio.flatten().quantile(0.001)), + float(ratio.median())) + i = int(off.abs().amax(dim=(1, 2)).argmax()) + rows = [] + for n in (N_ROLL, 40, 50): + ext = extend_offsets(off[i:i + 1], n, mode="continue") + anch = window_offsets_for_frame(ext, n, SINK, KV_WINDOW)[:, -1:] # 锚定后的当前 cell + world = ext[:, n:n + 1] - ext[:, 0:1] # 不锚定 + rows.append((n, + float(make_mask_input(anch, REAL_LAT_H, REAL_LAT_W).mean()), + float(make_mask_input(world, REAL_LAT_H, REAL_LAT_W).mean()))) + a30, w30 = rows[0][1], rows[0][2] + assert all(abs(r[1] - a30) < 1e-6 for r in rows), \ + f"锚定的 known 比例随 N 变了:{[(n, round(a, 4)) for n, a, _ in rows]}" + assert a30 > tr_p001, f"锚定的 known 比例 {a30:.4f} 掉到了训练语料 0.1 分位 {tr_p001:.4f} 以下" + assert [r[2] for r in rows] == sorted((r[2] for r in rows), reverse=True), "不锚定的比例没有单调下降" + assert rows[-1][2] == 0.0, f"不锚定到 N={rows[-1][0]} 时 known 比例应精确为 0,实测 {rows[-1][2]:.4f}" + assert w30 < tr_p001, f"不锚定在 N={N_ROLL} 的 known 比例 {w30:.4f} 还没掉出训练 0.1 分位" + print(f"d2. mask-oob 训练 known 比例 min {tr_min:.3f} / p0.1% {tr_p001:.3f} / 中位 {tr_med:.3f};" + f"最快 clip 锚定后恒 {a30:.3f}(N=30/40/50 不变),不锚定 " + f"{'→'.join(f'{w:.3f}' for _, _, w in rows)}(N=50 时整幅 new,训练时零样本)") + + +if __name__ == "__main__": + sys.exit(pytest.main([os.path.abspath(__file__), "-q", "-s"])) diff --git a/backup_2026-09-14/code/ltx/train_ltx_arope.py b/backup_2026-09-14/code/ltx/train_ltx_arope.py new file mode 100644 index 0000000000000000000000000000000000000000..3c3a929a870e4215c7fd6a63fd629e3009bceca4 --- /dev/null +++ b/backup_2026-09-14/code/ltx/train_ltx_arope.py @@ -0,0 +1,991 @@ +#!/usr/bin/env python3 +"""LTX-2.5(22B)+ ActionRoPE 世界坐标条件化:全参数微调 baseline。 + +与 Wan 双向 SFT 的那条臂(outputs/arope_10k_ga2,见 actionrope/train.py + actionrope/arope.py) +同配方,为的是让两条臂能直接比较;配方细节列在文件底部 parse_args() 里,逐项对应 +outputs/arope_10k_ga2/config.json。只训 DiT(arope_mask_embed 是它的一部分), +VAE / 文本编码器都不加载——latent 和文本都已经离线编好(ltx/encode_latents.py、 +ltx/build_text_table.py),训练只读 data/latent_ltx/{train,val}/*.pt 和 +data/latent_ltx/text_table_ltx.pt。 + +跑之前必须: + export PYTHONPATH=/DiffSynth-LTX +(LTX-2.5 只有上游 main 支持,本仓库钉的 diffsynth 2.1.6 给 Wan 用,两者互斥;见 +check_diffsynth()。不要因为要跑这个脚本就去升级 DiffSynth-Studio。) + +前向路径逐行照抄 DiffSynth-LTX 自己的两处(不改 DiffSynth-LTX 一个字): + diffsynth/pipelines/ltx2_audio_video.py::model_fn_ltx2 (patchify → 首帧条件替换 → dit() → unpatchify) + diffsynth/diffusion/loss.py::FlowMatchSFTAudioVideoLoss (sample timestep → add_noise → training_target + → model_fn → mse × training_weight(t)) +世界坐标位置注入 / known-new 掩码 / loss 权重 / 掩码通道安装的数学都在 ltx/arope_ltx.py +(与 ltx/ltx_arope.py 的推理自检共用同一份实现,见该文件顶部的说明)。 + +与 Wan 配方逐处对照 + 明确写出的偏离(都不是随手为之,见对应位置的行内注释): + * timestep / add_noise / training_target / training_weight:同一套 FlowMatchScheduler 数学, + 只是模板从 "Wan" 换成 "LTX-2"(sigma 表不同,见 diffsynth/diffusion/flow_match.py)。 + * 首帧条件:Wan 是 TI2V 的 seperated_timestep 路径(帧 0 的 t 强制 0,patch_embedding 前替换); + LTX 用它自己的 I2V 机制(input_latents_video=x0 + denoise_mask_video 帧 0 置 0),效果等价, + 机制是 model_fn_ltx2 自带的,不是我们加的。 + * 【偏离 1】Wan 的训练循环显式把帧 0 从 loss 里剔掉(actionrope/train.py 里 `pred[:, :, 1:]`); + 这里**不剔**——跟 DiffSynth-LTX 自己的 FlowMatchSFTAudioVideoLoss 一样,不对 I2V 条件帧做任何 + 特殊处理,loss 就是整条 pred/target 的加权 MSE。这是按"逐行照抄 model_fn_ltx2 + loss.py"的 + 要求做的选择,不是疏漏:flow matching 的 target=noise-x0 在 t=0(条件帧)处依然有明确定义, + LTX 官方的 I2V 全参微调配方(examples/ltx2/model_training/train.py 的 sft:train 任务)就是这么 + 训的。offset_px 在 frame 0 恒为 0,known 掩码在那一帧全 True,权重恒为 1,不会被 new_weight 放大。 + * 【偏离 2】LTX 的 `video_context` 是整条视频共享的**一个**全局 cross-attention 条件(DiffSynth-LTX + 没有 Wan-ARoPE 臂那个"每 cell 独立 attend 自己的文本"的改法),所以这里每条 clip 只挑 + **一个**场景串(`draw_scene_key` 取 `prompts[0]` 剥完动作从句后的结果),不是 Wan 那边的 + 21 个逐 cell 串。多数 clip 的 21 条剥完动作后本来就相同;转场 clip(burn/hardcut)会因此丢失 + "场景中途切换"这个信号——这是 LTX 原生架构的限制,不是本脚本能绕开的,做 baseline 先接受。 + * 【偏离 3】batch_size 只支持 1(与 Wan 配方一致,8×2=16 有效批的构成方式相同):不同 clip 的 + scene 串过 Gemma4 之后 token 数 L 不同,`ltx_collate` 不做 padding,batch_size>1 时若几条 L + 恰好相等能跑,但不保证。 + * 【偏离 4】不支持 accelerator.save_state 的完整续训(Wan 臂的 --save_state/--resume ); + `--resume` 只接受 *.safetensors 热启动权重(等价于 Wan 的 `--resume xxx.safetensors` 分支), + step 从 0 起。配方里没有要求"掉线后接着算 step",先不做,需要时再加。 + * loss 权重(known=1 / new=new_weight,flat 一刀切)、scene_dropout(以 --scene_dropout 概率把 + 场景串换成 NULL_PROMPT)都严格对应 actionrope/arope.py 的 loss_weight_map(flat) / + actionrope/train.py 的 scene dropout。 + +CPU 自检(不加载 22B 权重,不需要 GPU): + PYTHONPATH=/DiffSynth-LTX .venv/bin/python ltx/train_ltx_arope.py --self_test + PYTHONPATH=/DiffSynth-LTX .venv/bin/python ltx/train_ltx_arope.py --dry_run + +真实训练见 ltx/run_train.sh(accelerate + DeepSpeed ZeRO-2 offload,8 卡)。 +""" +from __future__ import annotations + +import argparse +import glob +import json +import math +import os +import platform +import random +import socket +import sys +import tempfile +import time +import zlib + +os.environ.setdefault("DIFFSYNTH_SKIP_DOWNLOAD", "True") + +import torch +import torch.nn as nn + +LTX_DIR = os.path.dirname(os.path.abspath(__file__)) +ROOT = os.path.dirname(LTX_DIR) +if ROOT not in sys.path: + sys.path.insert(0, ROOT) +if LTX_DIR not in sys.path: # `import arope_ltx`(同目录共享模块)不受调用方 cwd 影响 + sys.path.insert(0, LTX_DIR) + +from arope_ltx import ( # noqa: E402 + install_per_frame_cross_attention, per_frame_context, latent_frame_cells, set_per_frame_context, + FPS, H, LAT_F, LAT_H, LAT_W, MASK_EMBED_NAME, NUM_PIXEL_FRAMES, PX_PER_LATENT, W, + build_patch_grid, inject_world_offset, install_arope_mask, known_mask_ltx, loss_weight_map_ltx, +) +from actionrope.prompts import NULL_PROMPT, strip_action # noqa: E402 纯字符串处理,不依赖 diffsynth +from distill import runlib # noqa: E402 纯 torch/safetensors,不依赖 diffsynth(见模块顶部说明) + +MODEL_DIR_DEFAULT = os.path.join(ROOT, "models", "LTX-2.5") +REPACK_DIR_DEFAULT = os.path.join(ROOT, "models", "LTX-2.5-Repackage") +DIT_SAFETENSORS_REL = "diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" + +LATENT_SHAPE = (128, LAT_F, LAT_H, LAT_W) +TRANSITION_KINDS = ("burn", "hardcut") + + +def check_diffsynth() -> str: + import diffsynth + p = os.path.dirname(diffsynth.__file__) + if "DiffSynth-LTX" not in p: + raise SystemExit( + f"diffsynth 解析到了 {p}\n" + "LTX-2.5 只有上游 main 支持,本仓库钉的 2.1.6 是给 Wan 用的。\n" + "跑这个脚本要带 PYTHONPATH=/DiffSynth-LTX(不要去升级 DiffSynth-Studio," + "Wan 的整条链路都吃那一份)。") + return p + + +# ---------------------------------------------------------------------------- +# 数据集 +# ---------------------------------------------------------------------------- + +def _clip_ids_in(split_dir: str) -> set[str]: + return {os.path.splitext(f)[0] for f in os.listdir(split_dir) if f.endswith(".pt")} + + +def _load_meta_index(meta_dir: str) -> dict[str, dict]: + """data/meta/*.jsonl 里训练侧用得着的几个字段:src_a / src_b(转场泄漏)、rt_ratio(世界降速)。 + 与 actionrope/dataset.py::load_meta_index 逻辑相同,自成一份是为了不 import actionrope.dataset + ——那个模块要 `from baseline import make_action_inputs`,链路上有没有 diffsynth 依赖没有把握, + 这条 LTX 训练链路对 diffsynth 的解析很敏感(必须是 DiffSynth-LTX),不值得冒这个险。""" + out: dict[str, dict] = {} + for f in sorted(glob.glob(os.path.join(meta_dir, "*.jsonl"))): + with open(f, encoding="utf-8") as fh: + for line in fh: + r = json.loads(line) + out[r["clip_id"]] = {k: r[k] for k in ("src_a", "src_b", "rt_ratio", "kind") if k in r} + return out + + +def draw_scene_key(prompts: list[str], scene_dropout: float, rng=random) -> str: + """从 21 条 raw prompt(scene_action,带动作从句,与 Wan 那份逐条相同)里取场景串。 + + LTX 的 video_context 是整条视频共享的一份全局条件(见文件头【偏离 2】),所以只取 cell 0 剥完 + 动作从句的结果代表整条 clip;以 scene_dropout 概率整条换成 NULL_PROMPT(对应 + actionrope/train.py 的 `_prompt_keys` 在 text_mode="scene" 时的 dropout 分支)。 + """ + if scene_dropout > 0 and rng.random() < scene_dropout: + return NULL_PROMPT + return strip_action(prompts[0]) + + +def draw_scene_keys(prompts: list[str], scene_dropout: float, rng=random) -> list[str]: + """21 条逐 cell 场景串(= actionrope/dataset.py::_prompt_keys 的 "scene" 分支):整条 clip 一次抽签, + 命中 dropout 则 21 条全换 NULL_PROMPT,否则逐条剥动作从句。转场 clip 的切换点之后是另一个场景的串—— + 这正是 2026-09-14 之前 draw_scene_key(只取 prompts[0])丢掉的信号。""" + if scene_dropout > 0 and rng.random() < scene_dropout: + return [NULL_PROMPT] * len(prompts) + return [strip_action(p) for p in prompts] + + +class LtxAropeDataset(torch.utils.data.Dataset): + def __init__( + self, + split_dir: str, + sidecar: dict, + text_table: dict[str, torch.Tensor], + meta_dir: str, + scene_dropout: float = 0.1, + limit: int | None = None, + seed: int = 0, + verbose: bool = True, + exclude_src_in: str | None = None, + min_rt_ratio: float = 0.0, + latent_cells: list[int] | None = None, + ): + self.split_dir = split_dir + # 每个 latent 帧取哪个 cell 的文本(11 帧 ⇒ cell 0,2,4,…,20),None ⇒ 按生产网格现算 + self.latent_cells = list(latent_cells) if latent_cells is not None else latent_frame_cells(build_patch_grid()[3]) + self.scene_dropout = float(scene_dropout) + self.min_rt_ratio = float(min_rt_ratio) + self.sidecar_meta = sidecar["meta"] + clips = sidecar["clips"] + self.text_table = text_table + + protected = _clip_ids_in(exclude_src_in) if exclude_src_in else set() + meta = _load_meta_index(meta_dir) if (protected or self.min_rt_ratio > 0) else {} + + files = sorted(glob.glob(os.path.join(split_dir, "*.pt"))) + if not files: + raise FileNotFoundError(f"{split_dir} 下没有 .pt(先跑 ltx/encode_latents.py --split ...)") + n_missing = n_invalid = n_leak = n_low_rt = 0 + self.items: list[tuple[str, str]] = [] + for p in files: + cid = os.path.splitext(os.path.basename(p))[0] + rec = clips.get(cid) + if rec is None: + n_missing += 1 + continue + if not bool(rec["valid"]): + n_invalid += 1 + continue + m = meta.get(cid, {}) + if rec["kind"] in TRANSITION_KINDS: + if protected and (m.get("src_a") in protected or m.get("src_b") in protected): + n_leak += 1 + continue + elif self.min_rt_ratio > 0 and float(m.get("rt_ratio", 1.0)) < self.min_rt_ratio: + n_low_rt += 1 + continue + self.items.append((cid, p)) + self.n_total, self.n_missing, self.n_invalid = len(files), n_missing, n_invalid + self.n_leak, self.n_low_rt = n_leak, n_low_rt + + if limit is not None and limit < len(self.items): + rng = random.Random(seed) + rng.shuffle(self.items) + self.items = sorted(self.items[:limit]) + + self.frame_off = {cid: clips[cid]["frame_offset_px"].to(torch.float32).clone() for cid, _ in self.items} + + if verbose: + print( + f"[LtxAropeDataset] {split_dir}: {self.n_total} 个 .pt," + f"sidecar 缺失 {n_missing},valid=False 剔除 {n_invalid}," + + (f"转场泄漏剔除 {n_leak}," if exclude_src_in else "") + + (f"rt_ratio<{self.min_rt_ratio} 剔除 {n_low_rt}," if self.min_rt_ratio > 0 else "") + + f"可用 {len(self.items)}" + + (f"(limit={limit})" if limit is not None else "") + + f";文本表 {len(self.text_table)} 键,scene_dropout={self.scene_dropout}", + flush=True, + ) + + def __len__(self) -> int: + return len(self.items) + + def clip_ids(self) -> list[str]: + return [cid for cid, _ in self.items] + + def __getitem__(self, idx: int) -> dict: + cid, path = self.items[idx] + d = torch.load(path, map_location="cpu", weights_only=False) + latent = d["latent"] + if tuple(latent.shape) != LATENT_SHAPE: + raise ValueError(f"{cid}: latent 形状 {tuple(latent.shape)} != {LATENT_SHAPE}") + keys21 = draw_scene_keys(d["prompts"], self.scene_dropout) + keys_f = [keys21[c] for c in self.latent_cells] # 每个 latent 帧一条 + try: + ctx = torch.stack([self.text_table[k] for k in keys_f], 0) # [f, L, D] + except KeyError as e: + raise KeyError( + f"{cid}: 文本表里没有 {e.args[0]!r}——用更新过的 ltx/build_text_table.py 重新生成 " + "data/latent_ltx/text_table_ltx.pt(要包含 strip_action 之后的场景串 + NULL_PROMPT)" + ) from None + uniq = {k: i for i, k in enumerate(dict.fromkeys(keys_f))} + return { + "input_latents": latent.to(torch.bfloat16).contiguous(), + "context": ctx.to(torch.bfloat16), # [f, L, D] 逐 latent 帧 + "context_ids": torch.tensor([uniq[k] for k in keys_f], dtype=torch.int64), # [f],同 id ⇒ 同串 + "frame_offset_px": self.frame_off[cid].clone(), + "clip_id": cid, + } + + +def ltx_collate(batch: list[dict]) -> dict: + ls = {b["context"].shape[1] for b in batch} + if len(ls) != 1: + raise ValueError( + f"batch 内 context 长度不一致 {sorted(ls)}:不同场景串过 Gemma4 后 token 数不同," + "ltx_collate 不做 padding(见 train_ltx_arope.py 文件头【偏离 3】),batch_size 请用 1。" + ) + return { + "input_latents": torch.stack([b["input_latents"] for b in batch], 0), + "context": torch.stack([b["context"] for b in batch], 0), # [b, f, L, D] + "context_ids": torch.stack([b["context_ids"] for b in batch], 0), # [b, f] + "frame_offset_px": torch.stack([b["frame_offset_px"] for b in batch], 0), + "clip_id": [b["clip_id"] for b in batch], + } + + +def to_device(batch: dict, device) -> dict: + return {k: (v.to(device, non_blocking=True) if isinstance(v, torch.Tensor) else v) for k, v in batch.items()} + + +# ---------------------------------------------------------------------------- +# 模型 +# ---------------------------------------------------------------------------- + +def load_dit(model_dir: str, repack_dir: str, device: str = "cpu"): + """只加载 DiT(不挂 VAE / 文本编码器),bf16。先落在 CPU,交给 accelerator.prepare 搬上卡。""" + from diffsynth.pipelines.ltx2_audio_video import LTX2AudioVideoPipeline, ModelConfig + + cfg = dict(offload_dtype=torch.bfloat16, offload_device="cpu", onload_dtype=torch.bfloat16, + onload_device=device, preparing_dtype=torch.bfloat16, preparing_device=device, + computation_dtype=torch.bfloat16, computation_device=device) + pipe = LTX2AudioVideoPipeline.from_pretrained( + torch_dtype=torch.bfloat16, device=device, + tokenizer_config=ModelConfig(path=os.path.join(repack_dir, "tokenizer")), + model_configs=[ModelConfig(path=os.path.join(model_dir, DIT_SAFETENSORS_REL), **cfg)], + ) + return pipe.dit + + +def load_dit_ckpt_ltx(dit: nn.Module, path: str, mask_channel: bool, log=print) -> dict: + """从我们自己导出的 safetensors 热启动 DiT 权重。 + + strict——唯一放行的缺失是 arope_mask_embed.{weight,bias}(install_arope_mask 已经零初始化, + 从没装过掩码通道的 ckpt 起步、或本次不用掩码通道时就缺这两个键;不是这两个键的缺失/多余 + 一律报错,不能静默丢权重或吃进不认识的键)。""" + from safetensors.torch import load_file + + sd = load_file(path) + missing, unexpected = dit.load_state_dict(sd, strict=False) + allowed_missing = {f"{MASK_EMBED_NAME}.weight", f"{MASK_EMBED_NAME}.bias"} if mask_channel else set() + bad_missing = [k for k in missing if k not in allowed_missing] + if bad_missing or unexpected: + raise RuntimeError( + f"{path} 与模型键集不符:缺 {bad_missing[:5]}…({len(bad_missing)})," + f"多 {list(unexpected)[:5]}…({len(unexpected)})" + ) + if missing: + log(f"[resume] strict=False 放行的缺失键({MASK_EMBED_NAME} 零初始化生效):{sorted(missing)}") + return {"missing": list(missing), "unexpected": list(unexpected), "n_tensors": len(sd)} + + +class LtxAropeTrainModule(nn.Module): + """把 DiT + flow-matching loss 包成一个 module:forward 直接返回 (loss, stats)。 + + 与 actionrope/train.py::AropeTrainModule 同构(那边包 Wan 的 WanModel + arope_forward)。 + """ + + def __init__(self, dit, video_patchifier, pos_sec: torch.Tensor, patch_frame_idx: torch.Tensor, + latent_frame_pixel_idx: torch.Tensor, mask_channel: bool, new_weight: float, + gradient_checkpointing: bool, anchor_in_loss: bool = False): + super().__init__() + from diffsynth.diffusion.flow_match import FlowMatchScheduler + from diffsynth.pipelines.ltx2_audio_video import model_fn_ltx2 + + self.dit = dit + self.video_patchifier = video_patchifier + self._model_fn = model_fn_ltx2 + # persistent=False:这些是从我们自己的 832x480x81 网格算出来的常量,不进 checkpoint + # (save_dit 按 'dit.' 前缀导出,顶层键反正也会被 strip_dit_prefix 丢掉) + self.register_buffer("pos_sec", pos_sec, persistent=False) + self.register_buffer("patch_frame_idx", patch_frame_idx, persistent=False) + self.register_buffer("latent_frame_pixel_idx", latent_frame_pixel_idx, persistent=False) + self.mask_channel = bool(mask_channel) + self.new_weight = float(new_weight) + self.anchor_in_loss = bool(anchor_in_loss) + self.gradient_checkpointing = bool(gradient_checkpointing) + self.scheduler = FlowMatchScheduler("LTX-2") + self.scheduler.set_timesteps(1000, training=True) + + def timestep_id_for(self, t: float) -> int: + return int(torch.argmin((self.scheduler.timesteps - t).abs())) + + def forward(self, batch: dict, timestep_id: int, noise: torch.Tensor | None = None, train: bool = True): + x0 = batch["input_latents"] # [b, 128, 11, 15, 26] bf16 + b, c, f, h, w = x0.shape + device = x0.device + timestep = self.scheduler.timesteps[timestep_id].view(1) # float32 cpu + if noise is None: + noise = torch.randn_like(x0) + noisy = self.scheduler.add_noise(x0, noise, timestep) + target = self.scheduler.training_target(x0, noise, timestep) + + frame_off = batch["frame_offset_px"].to(device) # [b, 81, 2] px,逐像素帧 + pos_sec = self.pos_sec.to(device) + patch_frame_idx = self.patch_frame_idx.to(device) + latent_frame_pixel_idx = self.latent_frame_pixel_idx.to(device) + # 位置保持 float32:推理侧 NoiseInitializer 对 LTX-2.5 就是 float32(is_ltx25 时不 cast 到 bf16)。 + # 之前这里 .to(x0.dtype) 把像素坐标压成 bf16,x∈[512,1024) 只剩 4 px 分辨率、[1024,2048) 只剩 8 px, + # 训练时 RoPE 位置带量化噪声而推理时没有 —— 训推不一致,而且 ActionRoPE 的精度就在这几个像素上。 + video_positions = inject_world_offset(pos_sec, patch_frame_idx, frame_off).float() + + off_latent_px = frame_off[:, latent_frame_pixel_idx, :] # [b, f, 2] px,下采样到 latent 帧 + weight = loss_weight_map_ltx(off_latent_px, h, w, self.new_weight).to(device) # [b,1,f,h,w] + + if self.mask_channel: + known = known_mask_ltx(off_latent_px / PX_PER_LATENT, h, w) # bool [b,f,h,w] + self.dit._arope_mask_patch = self.video_patchifier.patchify(known.to(x0.dtype).unsqueeze(1)) + else: + self.dit._arope_mask_patch = None + + video_keyframes_mask = torch.zeros(b, 1, f, h, w, dtype=torch.float32, device=device) + video_keyframes_mask[:, :, 0] = 1.0 + denoise_mask_video = torch.ones(b, 1, f, h, w, dtype=x0.dtype, device=device) + denoise_mask_video[:, :, 0] = 0.0 # 帧 0 = 干净锚点(LTX 自己的 I2V 机制,见文件头说明) + + timestep_dev = timestep.to(device=device, dtype=x0.dtype) + ctx = batch["context"] # [b, f, L, D] 逐 latent 帧文本 + assert ctx.dim() == 4 and ctx.shape[1] == f, f"context 应为 [b, f={f}, L, D],得到 {tuple(ctx.shape)}" + video_context = ctx.reshape(b, f * ctx.shape[2], ctx.shape[3]) + # 每帧只 attend 自己那条文本(见 arope_ltx.py)。开关设成常驻而不是 with 作用域:梯度检查点会在 + # backward 里重算 block 前向,那时若开关已复位,重算路径的张量形状会与保存的对不上。 + set_per_frame_context(f) + pred, _ = self._model_fn( + dit=self.dit, video_latents=noisy, video_context=video_context, + video_positions=video_positions, video_patchifier=self.video_patchifier, + timestep=timestep_dev, video_keyframes_mask=video_keyframes_mask, + input_latents_video=x0, denoise_mask_video=denoise_mask_video, + use_gradient_checkpointing=self.gradient_checkpointing and train, + ) + + se = (pred.float() - target.float()) ** 2 + if self.anchor_in_loss: + # 旧行为(DiffSynth 自带损失的口径):锚点帧也进 loss + se_w, w_eff = se, weight + else: + # ★ 锚点帧不计 loss(Wan 那条臂的口径,actionrope/train.py:260「帧 0 是条件帧,不计 loss」)。 + # 帧 0 的输入被 denoise_mask_video 换成了**干净** latent、时间步置 0,而 training_target 仍然是 + # 按抽到的 timestep 算的速度场 —— 输入说"无噪声"、目标说"某个噪声水平",这对配对本身矛盾: + # 最优预测与目标之间差着一整份噪声,那部分梯度是纯噪声、没有信号。 + # LTX 只有 11 个 latent 帧,锚点占 1/11(Wan 21 个 cell 只占 1/21),影响更大。 + se_w, w_eff = se[:, :, 1:], weight[:, :, 1:] + loss_w = (se_w * w_eff).sum() / (w_eff.sum() * c) + mse = se_w.mean() + loss = loss_w * self.scheduler.training_weight(timestep).to(loss_w.device) + stats = { + "loss_w": loss_w.detach(), "mse": mse.detach(), + "new_frac": (weight > 1).float().mean().detach(), "timestep": float(timestep.item()), + } + return loss, stats + + +@torch.no_grad() +def run_validation(accelerator, model, module: LtxAropeTrainModule, val_ds, tids: list[int], seed: int): + """固定 clip 集 x 固定 timestep 集 x 固定噪声,各进程分摊 clip,reduce 求和。""" + model.eval() + device = accelerator.device + rank, world = accelerator.process_index, accelerator.num_processes + n_t = len(tids) + acc = torch.zeros(n_t, 3, device=device, dtype=torch.float64) + for i in range(rank, len(val_ds), world): + sample = val_ds[i] + batch = to_device(ltx_collate([sample]), device) + for j, tid in enumerate(tids): + gdev = device if device.type == "cuda" else torch.device("cpu") + g = torch.Generator(device=gdev) + g.manual_seed((zlib.crc32(sample["clip_id"].encode()) * 1009 + tid * 7 + seed) % (2 ** 31)) + noise = torch.randn(batch["input_latents"].shape, generator=g, device=gdev, + dtype=batch["input_latents"].dtype).to(device) + _, stats = model(batch, tid, noise=noise, train=False) + acc[j, 0] += stats["loss_w"].double() + acc[j, 1] += stats["mse"].double() + acc[j, 2] += 1 + acc = accelerator.reduce(acc, reduction="sum") + model.train() + out = {} + for j, tid in enumerate(tids): + n = max(acc[j, 2].item(), 1.0) + out[float(module.scheduler.timesteps[tid])] = { + "loss_w": acc[j, 0].item() / n, "mse": acc[j, 1].item() / n, "n": int(acc[j, 2].item()) + } + return out + + +# ---------------------------------------------------------------------------- +# CPU 自检 +# ---------------------------------------------------------------------------- + +def _per_frame_checks(log=print) -> None: + """[6] 逐帧文本 = 整条文本(11 行相同)时与原实现逐位等价;[7] 只改第 j 行时,只有第 j 帧的输出变。 + 玩具 LTXModel(1 层)上分别验 cross_attention_adaln=True(LTX-2.5 的真实配置)和 False。""" + from diffsynth.models.ltx2_dit import LTXModel, LTXModelType + from diffsynth.models.ltx2_video_vae import VideoLatentPatchifier + from diffsynth.pipelines.ltx2_audio_video import model_fn_ltx2 + install_per_frame_cross_attention(log=lambda *a: None) + vl, pos_sec, _, _ = build_patch_grid(9, 64, 96, FPS) + f, pf, L = vl.frames, VideoLatentPatchifier(patch_size=1), 6 + # 只验 cross_attention_adaln=True(LTX-2.5 的真实配置):DiffSynth 的玩具 LTXModel 在 adaln=False 下数值 + # 本身就发散(两条不同文本的输出差 1e36 量级),不是可用的测试夹具。 + for adaln in (True,): + torch.manual_seed(0) + d = LTXModel(model_type=LTXModelType.VideoOnly, num_attention_heads=2, attention_head_dim=8, in_channels=128, + out_channels=128, num_layers=1, cross_attention_dim=16, caption_channels=32, + positional_embedding_max_pos=[20, 2048, 2048], cross_attention_adaln=adaln).eval() + x = torch.randn(1, 128, f, vl.height, vl.width) + t = torch.tensor([500.0]) + kf = torch.zeros(1, 1, f, vl.height, vl.width); kf[:, :, 0] = 1.0 + ctx1 = torch.randn(1, L, 32) + kw = dict(dit=d, video_latents=x, video_positions=pos_sec, video_patchifier=pf, timestep=t, video_keyframes_mask=kf) + with torch.no_grad(): + ref, _ = model_fn_ltx2(video_context=ctx1, **kw) + with per_frame_context(f): + same, _ = model_fn_ltx2(video_context=ctx1.repeat(1, f, 1), **kw) + j = f - 1 # 玩具网格只有 2 个 latent 帧,改最后一帧 + ctx2 = ctx1.repeat(1, f, 1).clone(); ctx2[:, j * L:(j + 1) * L] = torch.randn(1, L, 32) + diff, _ = model_fn_ltx2(video_context=ctx2, **kw) + assert not torch.isnan(ref).any() and not torch.isnan(same).any(), \ + f"adaln={adaln}: NaN —— ref {bool(torch.isnan(ref).any())} / 逐帧 {bool(torch.isnan(same).any())} / diff {bool(torch.isnan(diff).any())}" + assert torch.allclose(ref, same, atol=1e-5, rtol=1e-4), f"adaln={adaln}: 逐帧(同串) 与整条不等价,max|Δ|={float((ref-same).abs().max()):.2e}" + delta = (diff - ref).abs().amax(dim=(0, 1, 3, 4)) # [f] + others = max(float(delta[k]) for k in range(f) if k != j) + assert float(delta[j]) > 1e-4 and others < 1e-6, f"adaln={adaln}: 改第 {j} 行,各帧 |Δ| = {[round(float(v), 6) for v in delta]}" + log(f"=== [6] 逐帧文本(cross_attention_adaln={adaln},LTX-2.5 真实配置)===\n" + f" 11 行同串 ⇔ 整条:max|Δ|={float((ref-same).abs().max()):.1e} OK;只改第 {j} 行 ⇒ 只有第 {j} 帧变" + f"(该帧 |Δ| {float(delta[j]):.3f},其它帧 {others:.1e}) OK") + + +def self_test(log=print) -> int: + """CPU 自检,全程不加载 22B 权重: + 1. 位置注入 vs 独立闭式计算 + 2. known/new 掩码 vs 暴力循环 + 3. loss 权重的取值 + 4. scene dropout 命中率 + 5. 零初始化掩码通道对 patchify_proj 输出零影响 + """ + log("[env] diffsynth = " + check_diffsynth()) + + log("=== [1] 位置注入 vs 独立闭式计算 ===") + vl, pos_sec, patch_frame_idx, latent_frame_pixel_idx = build_patch_grid(NUM_PIXEL_FRAMES, H, W, FPS) + assert (vl.frames, vl.height, vl.width) == (LAT_F, LAT_H, LAT_W), vl + b = 2 + frame_off = torch.zeros(b, NUM_PIXEL_FRAMES, 2) + frame_off[0, :, 0] = torch.linspace(0, 300, NUM_PIXEL_FRAMES) # 样本 0:dx 匀速增大 + frame_off[1, :, 1] = torch.linspace(0, 150, NUM_PIXEL_FRAMES) # 样本 1:dy 匀速增大(测批量不串味) + vp = inject_world_offset(pos_sec, patch_frame_idx, frame_off) + n_per_frame = vl.height * vl.width + for bi in range(b): + for lf in range(vl.frames): + px_frame = int(latent_frame_pixel_idx[lf]) + expect_dx = float(frame_off[bi, px_frame, 0]) + expect_dy = float(frame_off[bi, px_frame, 1]) + sl = slice(lf * n_per_frame, (lf + 1) * n_per_frame) + got_dx = vp[bi, 2, sl, 0] - pos_sec[0, 2, sl, 0] + got_dy = vp[bi, 1, sl, 0] - pos_sec[0, 1, sl, 0] + assert float(got_dx.max() - got_dx.min()) < 1e-6, (bi, lf, "dx 同帧不一致") + assert float(got_dy.max() - got_dy.min()) < 1e-6, (bi, lf, "dy 同帧不一致") + assert abs(float(got_dx[0]) - expect_dx) < 1e-6, (bi, lf, float(got_dx[0]), expect_dx) + assert abs(float(got_dy[0]) - expect_dy) < 1e-6, (bi, lf, float(got_dy[0]), expect_dy) + log(f" {vl.frames} latent 帧 x {n_per_frame} patch/帧 x {b} 样本,逐帧独立闭式核对通过 OK") + + log("=== [2] known/new 掩码 vs 暴力循环 ===") + torch.manual_seed(0) + off = (torch.rand(2, LAT_F, 2) - 0.5) * 20.0 # latent 格单位,足够大以同时产生 known 与 new + got = known_mask_ltx(off, LAT_H, LAT_W) + brute = torch.zeros_like(got) + for bi in range(off.shape[0]): + for fi in range(LAT_F): + dx, dy = float(off[bi, fi, 0]), float(off[bi, fi, 1]) + for i in range(LAT_H): + for j in range(LAT_W): + wi, wj = i + dy, j + dx + brute[bi, fi, i, j] = (-0.5 <= wi <= LAT_H - 0.5) and (-0.5 <= wj <= LAT_W - 0.5) + assert torch.equal(got, brute) + n_new = int((~got).sum()) + assert 0 < n_new < got.numel(), "随机偏移应同时产生 known 与 new,测试幅度需要调整" + log(f" {tuple(got.shape)} 全元素与暴力循环一致({n_new}/{got.numel()} 个 new 格) OK") + + log("=== [3] loss 权重取值 ===") + new_weight = 2.0 + off_px = off * PX_PER_LATENT # 换回像素单位(loss_weight_map_ltx 的输入约定),x32 是精确的(2 的幂) + w = loss_weight_map_ltx(off_px, LAT_H, LAT_W, new_weight) + assert tuple(w.shape) == (2, 1, LAT_F, LAT_H, LAT_W) + assert torch.equal(w.squeeze(1) == 1.0, got), "known 格权重应恰为 1.0" + assert torch.equal(w.squeeze(1) == new_weight, ~got), f"new 格权重应恰为 {new_weight}" + log(f" known→1.0,new→{new_weight},形状 {tuple(w.shape)} OK") + + log("=== [4] scene dropout 命中率 ===") + prompts = ["In a 2.5D top down view, in a high rocky mountain pass, the player is moving up."] * 21 + rng = random.Random(0) + n, p = 20000, 0.1 + hits = sum(1 for _ in range(n) if draw_scene_key(prompts, p, rng) == NULL_PROMPT) + rate = hits / n + se = (p * (1 - p) / n) ** 0.5 + assert abs(rate - p) < 6 * se, (rate, p, se) + non_drop = draw_scene_key(prompts, 0.0, rng) + assert non_drop == "In a 2.5D top down view, the player is in a high rocky mountain pass." + log(f" {n} 次抽样命中率 {rate:.4f}(配置 {p},6σ={6 * se:.4f});scene_dropout=0 时 strip_action 正确 OK") + + log("=== [5] 零初始化掩码通道对 patchify_proj 输出零影响 ===") + + class _FakeDit(nn.Module): + def __init__(self, in_ch: int, inner_dim: int): + super().__init__() + self.inner_dim = inner_dim + self.patchify_proj = nn.Linear(in_ch, inner_dim) + + torch.manual_seed(1) + fake = _FakeDit(8, 16) + install_arope_mask(fake, log=lambda *a: None) + x = torch.randn(2, 5, 8) + out0 = fake.patchify_proj(x) + fake._arope_mask_patch = torch.randn(2, 5, 1) * 100.0 # 任意非零掩码,不只测全零 + out1 = fake.patchify_proj(x) + assert torch.equal(out0, out1), "零初始化的 arope_mask_embed 不应改变 patchify_proj 输出" + log(" Linear(1, inner_dim) 权重/偏置零初始化:任意掩码下输出与不装掩码时 bit-identical OK") + + _per_frame_checks(log) + log("\nALL SELF TESTS PASS") + return 0 + + +# ---------------------------------------------------------------------------- +# CPU dry run:玩具模型 + 合成数据,跑 2 步端到端 +# ---------------------------------------------------------------------------- + +def dry_run(log=print) -> int: + check_diffsynth() + from diffsynth.diffusion.flow_match import FlowMatchScheduler + from diffsynth.models.ltx2_dit import LTXModel, LTXModelType + from diffsynth.models.ltx2_video_vae import VideoLatentPatchifier + from diffsynth.pipelines.ltx2_audio_video import model_fn_ltx2 + + torch.manual_seed(0) + + def make_dit(): + d = LTXModel(model_type=LTXModelType.VideoOnly, num_attention_heads=2, attention_head_dim=8, + in_channels=128, out_channels=128, num_layers=2, cross_attention_dim=16, + caption_channels=32, positional_embedding_max_pos=[20, 2048, 2048]) + install_arope_mask(d, log=log) + install_per_frame_cross_attention(log=log) + return d + + dit = make_dit() + n_params = sum(p.numel() for p in dit.parameters()) + n_keys = len(dit.state_dict()) + log(f"[dry_run] 玩具 LTXModel(VideoOnly,2 层,heads=2 head_dim=8 ⇒ inner_dim=16):" + f"{n_params:,} 参数,{n_keys} 个 state_dict 键(含 {MASK_EMBED_NAME})") + + # 合成画幅:832x480x81 帧太大(4290 patch),CPU 上跑不快;用小画幅只为验证数据流通, + # 不代表生产分辨率的显存/耗时(这点在 --dry_run 的报告里要显式说明,不能拿它估算显存)。 + NF_px, H_px, W_px = 9, 64, 96 + vl, pos_sec, patch_frame_idx, latent_frame_pixel_idx = build_patch_grid(NF_px, H_px, W_px, FPS) + log(f"[dry_run] 合成画幅 {W_px}x{H_px}x{NF_px} 帧 ⇒ latent {vl.frames}x{vl.height}x{vl.width}" + f"({pos_sec.shape[2]} patch)——不是生产分辨率 832x480x81,只为让 CPU 前反向几秒内跑完") + + video_patchifier = VideoLatentPatchifier(patch_size=1) + scheduler = FlowMatchScheduler("LTX-2") + scheduler.set_timesteps(1000, training=True) + + b = 1 + x0 = torch.randn(b, 128, vl.frames, vl.height, vl.width) # float32:CPU 上 bf16 matmul 慢,dry run 只验逻辑 + frame_off = torch.zeros(b, NF_px, 2) + frame_off[0, :, 0] = torch.linspace(0, 40, NF_px) # 合成一段匀速右移 + + optimizer = torch.optim.AdamW(dit.parameters(), lr=1e-3) + dit.train() + out_dir = tempfile.mkdtemp(prefix="ltx_arope_dryrun_") + ckpt_path = None + for step in range(1, 3): + video_positions = inject_world_offset(pos_sec, patch_frame_idx, frame_off) + off_latent_px = frame_off[:, latent_frame_pixel_idx, :] + weight = loss_weight_map_ltx(off_latent_px, vl.height, vl.width, 2.0) + known = known_mask_ltx(off_latent_px / PX_PER_LATENT, vl.height, vl.width) + dit._arope_mask_patch = video_patchifier.patchify(known.to(x0.dtype).unsqueeze(1)) + + video_keyframes_mask = torch.zeros(b, 1, vl.frames, vl.height, vl.width) + video_keyframes_mask[:, :, 0] = 1.0 + denoise_mask_video = torch.ones(b, 1, vl.frames, vl.height, vl.width) + denoise_mask_video[:, :, 0] = 0.0 + video_context = torch.randn(b, vl.frames * 6, 32) # 逐 latent 帧文本:[b, f*L, D],L=6 + + tid = int(torch.randint(0, 1000, (1,))) + timestep = scheduler.timesteps[tid].view(1) + noise = torch.randn_like(x0) + noisy = scheduler.add_noise(x0, noise, timestep) + target = scheduler.training_target(x0, noise, timestep) + + set_per_frame_context(vl.frames) # 常驻开关(梯度检查点重算时也要是逐帧路径) + pred, _ = model_fn_ltx2( + dit=dit, video_latents=noisy, video_context=video_context, video_positions=video_positions, + video_patchifier=video_patchifier, timestep=timestep, video_keyframes_mask=video_keyframes_mask, + input_latents_video=x0, denoise_mask_video=denoise_mask_video, use_gradient_checkpointing=True, + ) + se = (pred.float() - target.float()) ** 2 + # 与 LtxAropeTrainModule.forward 同一口径:锚点帧(latent 帧 0)不计 loss。 + # 两种口径都算出来打印,确保这条规则真的被干跑覆盖到(内联实现容易与模块漂移)。 + loss_all = (se * weight).sum() / (weight.sum() * x0.shape[1]) + loss_w = (se[:, :, 1:] * weight[:, :, 1:]).sum() / (weight[:, :, 1:].sum() * x0.shape[1]) + assert abs(float(loss_all) - float(loss_w)) > 1e-9, "锚点排除没生效:两种口径数值相同" + loss = loss_w * scheduler.training_weight(timestep) + + optimizer.zero_grad(set_to_none=True) + loss.backward() + gnorm = torch.nn.utils.clip_grad_norm_(dit.parameters(), 1.0) + optimizer.step() + log(f"[dry_run] step {step}: loss={loss.item():.6f} loss_w={loss_w.item():.6f} " + f"(含锚点帧则为 {loss_all.item():.6f}) " + f"t={float(timestep.item()):.1f} new_frac={(weight > 1).float().mean().item():.2f} " + f"grad_norm={float(gnorm):.4f} mask_embed.weight.grad_abs_sum=" + f"{float(dit.arope_mask_embed.weight.grad.abs().sum()):.4e}") + + if step == 2: + ckpt_path = runlib.dit_path(out_dir, step) + runlib.save_dit(None, dit, ckpt_path, {"arm": "arope", "step": step, "dry_run": True}, + expect_keys=n_keys, require_mask=False, log=log) + + # round-trip:新建一个同架构的模型,装回刚存的 ckpt,核对一个张量数值一致(bf16 精度内) + fresh = make_dit() + info = load_dit_ckpt_ltx(fresh, ckpt_path, mask_channel=True, log=log) + assert not info["missing"] and not info["unexpected"], info + ref_key = "patchify_proj.weight" + v_saved = fresh.state_dict()[ref_key].float() + v_orig = dit.state_dict()[ref_key].float() + assert torch.allclose(v_saved, v_orig, atol=2e-2), "round-trip 后 patchify_proj.weight 数值对不上(超出 bf16 精度)" + log(f"[dry_run] round-trip 装载 {ckpt_path} 成功:{info['n_tensors']} 个张量," + f"{ref_key} 数值一致(bf16 精度内,max|diff|={float((v_saved - v_orig).abs().max()):.4e})") + log("\nDRY RUN PASS(数据 -> 位置注入 -> 掩码 -> 前向 -> loss -> 反向 -> 保存 -> 装回,全打通)") + return 0 + + +# ---------------------------------------------------------------------------- +# 参数 +# ---------------------------------------------------------------------------- + +def parse_args(argv=None): + ap = argparse.ArgumentParser( + description="LTX-2.5 (22B) + ActionRoPE 世界坐标条件化,全参数微调 baseline" + "(与 outputs/arope_10k_ga2 的 Wan 双向 SFT 同配方,见文件头注释)") + ap.add_argument("--train_dir", default=os.path.join(ROOT, "data/latent_ltx/train")) + ap.add_argument("--val_dir", default=os.path.join(ROOT, "data/latent_ltx/val")) + ap.add_argument("--text_table", default=os.path.join(ROOT, "data/latent_ltx/text_table_ltx.pt")) + ap.add_argument("--sidecar", default=os.path.join(ROOT, "data/latent/arope_sidecar.pt")) + ap.add_argument("--meta_dir", default=os.path.join(ROOT, "data/meta")) + ap.add_argument("--model_dir", default=MODEL_DIR_DEFAULT) + ap.add_argument("--repack_dir", default=REPACK_DIR_DEFAULT) + ap.add_argument("--limit", type=int, default=None, help="smoke 用:只取这么多训练 clip") + ap.add_argument("--min_rt_ratio", type=float, default=0.8, + help="训练集按 meta 的 rt_ratio 剔除世界降速 clip(0 => 不剔),与 Wan 配方对齐") + ap.add_argument("--val_min_rt_ratio", type=float, default=0.9) + + ap.add_argument("--mask_channel", action=argparse.BooleanOptionalAction, default=True, + help="是否装 known/new 掩码通道(零初始化 Linear,默认开)") + ap.add_argument("--new_weight", type=float, default=2.0, help="new 区 loss 权重(flat,一刀切)") + ap.add_argument("--scene_dropout", type=float, default=0.1) + + ap.add_argument("--lr", type=float, default=1e-5) + ap.add_argument("--weight_decay", type=float, default=0.01) + ap.add_argument("--warmup_steps", type=int, default=200, help="线性 warmup 步数后转常数 lr") + ap.add_argument("--grad_clip", type=float, default=1.0) + ap.add_argument("--max_steps", type=int, default=5000) + ap.add_argument("--batch_size", type=int, default=1, help="每卡 micro batch;>1 见【偏离 3】") + ap.add_argument("--grad_accum", type=int, default=2) + ap.add_argument("--num_workers", type=int, default=2) + ap.add_argument("--gradient_checkpointing", action=argparse.BooleanOptionalAction, default=True) + + ap.add_argument("--save_every", type=int, default=500) + ap.add_argument("--val_every", type=int, default=500, help="0 => 不验证") + ap.add_argument("--val_n", type=int, default=16) + ap.add_argument("--val_timesteps", default="200,500,800") + ap.add_argument("--log_every", type=int, default=1) + ap.add_argument("--output", default=os.path.join(ROOT, "outputs/ltx/arope_baseline"), + help="run 目录(runlib 的布局:dits/ + config.json + train.log + train_log.csv)") + ap.add_argument("--resume", default=None, + help="*.safetensors:热启动权重(strict=False 只放行 arope_mask_embed 缺失)," + "step 从 0 起,不做 accelerate state 续训(见【偏离 4】)") + ap.add_argument("--seed", type=int, default=0) + + ap.add_argument("--self_test", action="store_true", help="CPU 自检(不加载权重,不需要 GPU)") + ap.add_argument("--dry_run", action="store_true", help="玩具模型 + 合成数据跑 2 步(不需要 GPU)") + args = ap.parse_args(argv) + args.val_timesteps = [float(t) for t in args.val_timesteps.split(",") if t.strip()] + if not os.path.isabs(args.output): + args.output = os.path.join(ROOT, args.output) + return args + + +# ---------------------------------------------------------------------------- +# 主流程 +# ---------------------------------------------------------------------------- + +def main(argv=None): + args = parse_args(argv) + if args.self_test: + return self_test() + if args.dry_run: + return dry_run() + + check_diffsynth() + from accelerate import Accelerator + from accelerate.utils import DistributedType, set_seed + from diffsynth.models.ltx2_video_vae import VideoLatentPatchifier + + if args.batch_size != 1: + print(f"[warn] batch_size={args.batch_size} != 1,见文件头【偏离 3】:ltx_collate 不做 padding," + "不保证不同长度的场景串能拼批。", flush=True) + + if not os.path.isfile(args.text_table): + raise SystemExit( + f"没有文本表 {args.text_table}\n先跑(需要 GPU 加载 Gemma4 文本编码器):\n" + f" PYTHONPATH={ROOT}/DiffSynth-LTX .venv/bin/python ltx/build_text_table.py" + ) + if not os.path.isfile(args.sidecar): + raise SystemExit(f"没有相机偏移 sidecar: {args.sidecar}") + for d in (args.train_dir, args.val_dir): + if args.val_every > 0 or d is args.train_dir: + if not os.path.isdir(d): + raise SystemExit(f"没有 latent 目录: {d}(先跑 ltx/encode_latents.py)") + + accelerator = Accelerator(gradient_accumulation_steps=args.grad_accum) + is_main = accelerator.is_main_process + use_ds = accelerator.distributed_type == DistributedType.DEEPSPEED + set_seed(args.seed, device_specific=True) + if use_ds: + # accelerate 的 clip_grad_norm_ 在 DeepSpeed 下只取回范数不裁剪,裁剪由引擎按 config 做; + # 让 --grad_clip 成为唯一入口,yaml 里的 gradient_clipping 只是默认值(与 Wan 臂同样的处理) + accelerator.state.deepspeed_plugin.deepspeed_config["gradient_clipping"] = float(args.grad_clip) + ga = accelerator.state.deepspeed_plugin.deepspeed_config.get("gradient_accumulation_steps") + if ga not in ("auto", args.grad_accum): + raise SystemExit( + f"--grad_accum={args.grad_accum} 与 accelerate yaml 的 gradient_accumulation_steps={ga} 不一致" + ) + accelerator.state.deepspeed_plugin.deepspeed_config["gradient_accumulation_steps"] = args.grad_accum + + run_dir = runlib.resolve_run_dir(args.output) + if is_main: + os.makedirs(run_dir, exist_ok=True) + log = runlib.TextTee(os.path.join(run_dir, "train.log"), enabled=is_main) + if is_main: + log(f"[env] world={accelerator.num_processes} distributed={accelerator.distributed_type} " + f"mixed_precision={accelerator.mixed_precision} device={accelerator.device}") + + # ---- 数据 ---- + sidecar = torch.load(args.sidecar, map_location="cpu", weights_only=False) + text_table = torch.load(args.text_table, map_location="cpu", weights_only=False)["table"] + latent_cells = latent_frame_cells(build_patch_grid(NUM_PIXEL_FRAMES, H, W, FPS)[3]) + if is_main: + log(f"[text] 逐 latent 帧文本:11 帧取 cell {latent_cells}(转场 clip 切换点之后取另一场景的串)") + train_ds = LtxAropeDataset(args.train_dir, sidecar=sidecar, text_table=text_table, meta_dir=args.meta_dir, + scene_dropout=args.scene_dropout, limit=args.limit, seed=args.seed, verbose=is_main, + exclude_src_in=args.val_dir, min_rt_ratio=args.min_rt_ratio, latent_cells=latent_cells) + val_ds = None + if args.val_every > 0 and args.val_n > 0: + val_ds = LtxAropeDataset(args.val_dir, sidecar=sidecar, text_table=text_table, meta_dir=args.meta_dir, + scene_dropout=0.0, limit=args.val_n, seed=args.seed, verbose=is_main, + min_rt_ratio=args.val_min_rt_ratio, latent_cells=latent_cells) + dataloader = torch.utils.data.DataLoader( + train_ds, batch_size=args.batch_size, shuffle=True, drop_last=True, collate_fn=ltx_collate, + num_workers=args.num_workers, pin_memory=True, persistent_workers=args.num_workers > 0, + ) + + # ---- 模型 ---- + t0 = time.time() + dit = load_dit(args.model_dir, args.repack_dir, device="cpu") + if args.mask_channel: + install_arope_mask(dit, log=log) + install_per_frame_cross_attention(log=log) + resume_info = None + if args.resume: + resume_info = load_dit_ckpt_ltx(dit, args.resume, args.mask_channel, log=log) + log(f"[resume] 热启动权重 {args.resume}: {resume_info}") + dit.train().requires_grad_(True) + n_params = sum(p.numel() for p in dit.parameters()) + n_keys = len(dit.state_dict()) + if is_main: + log(f"[model] DiT 加载 {time.time() - t0:.0f}s,{n_params:,} 参数,{n_keys} 个 state_dict 键," + f"mask_channel={args.mask_channel},has {MASK_EMBED_NAME}={hasattr(dit, MASK_EMBED_NAME)}") + + video_patchifier = VideoLatentPatchifier(patch_size=1) + vl, pos_sec, patch_frame_idx, latent_frame_pixel_idx = build_patch_grid(NUM_PIXEL_FRAMES, H, W, FPS) + module = LtxAropeTrainModule(dit, video_patchifier, pos_sec, patch_frame_idx, latent_frame_pixel_idx, + args.mask_channel, args.new_weight, args.gradient_checkpointing) + + optimizer = torch.optim.AdamW(module.parameters(), lr=args.lr, weight_decay=args.weight_decay) + warm = max(int(args.warmup_steps), 0) + lr_scheduler = torch.optim.lr_scheduler.LambdaLR(optimizer, lambda s: min(1.0, (s + 1) / warm) if warm > 0 else 1.0) + + model, optimizer, dataloader = accelerator.prepare(module, optimizer, dataloader) + device = accelerator.device + if is_main: + log(f"[env] grad_clip={args.grad_clip}") + + # ---- config.json:复现所需的一切(沿用 distill/runlib.py 的布局约定)---- + if is_main: + meta = sidecar["meta"] + cfg = { + "args": vars(args), + "sidecar_meta": {k: meta[k] for k in + ("version", "gain_correction", "walk_speed_px_s", "M_px832", "n_clips", "n_valid", + "max_sample_dt") if k in meta}, + "per_frame_context": True, "latent_cells": latent_cells, + "dataset": {"train_total": train_ds.n_total, "train_missing": train_ds.n_missing, + "train_invalid": train_ds.n_invalid, "train_leak_excluded": train_ds.n_leak, + "train_low_rt_excluded": train_ds.n_low_rt, "train_used": len(train_ds), + "text_table_keys": len(train_ds.text_table), + "val_used": len(val_ds) if val_ds is not None else 0, + "val_clip_ids": val_ds.clip_ids() if val_ds is not None else []}, + "model": {"dit_safetensors": os.path.join(args.model_dir, DIT_SAFETENSORS_REL), "n_params": n_params, + "n_state_dict_keys": n_keys, "mask_channel": args.mask_channel, + "resume_info": resume_info}, + "env": {"world_size": accelerator.num_processes, "distributed_type": str(accelerator.distributed_type), + "mixed_precision": accelerator.mixed_precision, "torch": torch.__version__, + "cuda": torch.version.cuda, "gpu": torch.cuda.get_device_name(0) if torch.cuda.is_available() else None, + "python": sys.executable, "platform": platform.platform(), "hostname": socket.gethostname(), + "argv": sys.argv, "started": time.strftime("%Y-%m-%d %H:%M:%S"), + "cuda_visible_devices": os.environ.get("CUDA_VISIBLE_DEVICES")}, + "deepspeed_config": accelerator.state.deepspeed_plugin.deepspeed_config if use_ds else None, + } + try: + import accelerate + import deepspeed + cfg["env"]["accelerate"] = accelerate.__version__ + cfg["env"]["deepspeed"] = deepspeed.__version__ + except Exception: + pass + runlib.save_config(run_dir, cfg) + + train_log = val_log = None + if is_main: + train_log = runlib.CsvLog(os.path.join(run_dir, "train_log.csv"), + ["step", "loss", "loss_w", "mse", "new_frac", "timestep", "lr", "grad_norm", + "step_time", "mem_gb", "epoch"]) + val_log = runlib.CsvLog(os.path.join(run_dir, "val_log.csv"), ["step", "timestep", "loss_w", "mse", "n"]) + + cpu_gen = torch.Generator().manual_seed(args.seed * 1000 + accelerator.process_index) + val_tids = [module.timestep_id_for(t) for t in args.val_timesteps] + + def do_validation(step): + if val_ds is None: + return + tv = time.time() + res = run_validation(accelerator, model, module, val_ds, val_tids, args.seed) + if is_main: + for t, r in res.items(): + val_log.write({"step": step, "timestep": t, **r}) + mean_w = sum(r["loss_w"] for r in res.values()) / len(res) + mean_mse = sum(r["mse"] for r in res.values()) / len(res) + log(f"[val] step {step} " + + " ".join(f"t={t:.0f}: w={r['loss_w']:.4f} mse={r['mse']:.4f} (n={r['n']})" for t, r in res.items()) + + f" | mean w={mean_w:.4f} mse={mean_mse:.4f} {time.time() - tv:.0f}s") + + def do_save(step): + path = runlib.dit_path(run_dir, step) + runlib.save_dit(accelerator, model, path, + {"arm": "arope", "step": step, "mask_channel": args.mask_channel, + "new_weight": args.new_weight, "scene_dropout": args.scene_dropout}, + expect_keys=n_keys, require_mask=False, dtype=torch.bfloat16, log=log) + if is_main: + runlib.write_progress(run_dir, step) + + # ---- 训练循环 ---- + model.train() + step_count, epoch = 0, 0 + if torch.cuda.is_available(): + torch.cuda.reset_peak_memory_stats(device) + if is_main: + log(f"[train] {len(train_ds)} 个 clip,每进程 batch {args.batch_size},{accelerator.num_processes} 进程," + f"到 {args.max_steps} 步") + micro_time = 0.0 + while step_count < args.max_steps: + for batch in dataloader: + if step_count >= args.max_steps: + break + t_step = time.time() + batch = to_device(batch, device) + tid = int(torch.randint(0, 1000, (1,), generator=cpu_gen)) + lr_now = lr_scheduler.get_last_lr()[0] + with accelerator.accumulate(model): + loss, stats = model(batch, tid) + accelerator.backward(loss) + grad_norm = accelerator.clip_grad_norm_(model.parameters(), args.grad_clip) if accelerator.sync_gradients else None + optimizer.step() + if accelerator.sync_gradients: + lr_scheduler.step() + optimizer.zero_grad(set_to_none=True) + if torch.cuda.is_available(): + torch.cuda.synchronize(device) + micro_time += time.time() - t_step + if not accelerator.sync_gradients: + continue + step_count += 1 + step_time, micro_time = micro_time, 0.0 + loss_mean = accelerator.reduce(loss.detach().float(), reduction="mean").item() + if is_main and (step_count % args.log_every == 0 or step_count == args.max_steps): + gn = float(grad_norm) if grad_norm is not None and math.isfinite(float(grad_norm)) else float("nan") + mem_gb = torch.cuda.max_memory_allocated(device) / 1024 ** 3 if torch.cuda.is_available() else 0.0 + row = {"step": step_count, "loss": loss_mean, "loss_w": stats["loss_w"].item(), + "mse": stats["mse"].item(), "new_frac": stats["new_frac"].item(), + "timestep": stats["timestep"], "lr": lr_now, "grad_norm": gn, + "step_time": step_time, "mem_gb": mem_gb, "epoch": epoch} + train_log.write(row) + log(f"step {step_count}/{args.max_steps} loss {loss_mean:.4f} (w {row['loss_w']:.4f} " + f"mse {row['mse']:.4f} t {row['timestep']:.0f} new {row['new_frac']:.2f}) " + f"lr {row['lr']:.2e} gnorm {gn:.3f} {step_time:.2f}s mem {row['mem_gb']:.1f}GB") + + if args.val_every > 0 and step_count % args.val_every == 0: + do_validation(step_count) + if args.save_every > 0 and step_count % args.save_every == 0: + do_save(step_count) + epoch += 1 + + if args.save_every <= 0 or step_count % args.save_every != 0: + do_save(step_count) + if is_main: + log(f"[done] step {step_count}") + with open(os.path.join(run_dir, "done.json"), "w", encoding="utf-8") as fh: + json.dump({"step": step_count, "finished": time.strftime("%Y-%m-%d %H:%M:%S")}, fh, indent=2) + train_log.close() + val_log.close() + log.close() + accelerator.wait_for_everyone() + accelerator.end_training() + return 0 + + +if __name__ == "__main__": + raise SystemExit(main()) diff --git a/backup_2026-09-14/runs/arope_10k_ga2/config.json b/backup_2026-09-14/runs/arope_10k_ga2/config.json new file mode 100644 index 0000000000000000000000000000000000000000..32849ceff3453bdac9d12d6ee78b47a1a2a273b6 --- /dev/null +++ b/backup_2026-09-14/runs/arope_10k_ga2/config.json @@ -0,0 +1,198 @@ +{ + "args": { + "arm": "arope", + "mask_channel": true, + "new_weight": 2.0, + "new_weight_shape": "flat", + "new_weight_ramp": 4.0, + "new_weight_sigma": false, + "text_mode": "scene", + "text_table": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "scene_dropout": 0.1, + "mirror_labels": true, + "first_frame_cond": true, + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx", + "val_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx", + "sidecar": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "model_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B", + "limit": null, + "min_rt_ratio": 0.8, + "val_min_rt_ratio": 0.9, + "lr": 1e-05, + "weight_decay": 0.01, + "warmup_steps": 200, + "grad_clip": 1.0, + "max_steps": 10000, + "batch_size": 1, + "grad_accum": 2, + "num_workers": 2, + "gradient_checkpointing": true, + "save_every": 1000, + "save_state": true, + "val_every": 500, + "val_n": 16, + "val_timesteps": [ + 200.0, + 500.0, + 800.0 + ], + "log_every": 1, + "output": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/arope_10k_ga2", + "resume": "outputs/arope_5k_ga2/state", + "seed": 0 + }, + "sidecar_meta": { + "version": "arope_sidecar_v1", + "gain_correction": [ + -1.1223353683364354, + -1.12 + ], + "walk_speed_px_s": [ + 69.24106392992304, + 46.012630371093756 + ], + "M_px832": [ + [ + -26.562482341426065, + -0.10811496854140469 + ], + [ + -2.730642040963448, + 11.486215518608526 + ], + [ + 0.4151829271053684, + 16.944469913263354 + ] + ], + "n_clips": 22782, + "n_valid": 22781, + "max_sample_dt": 0.5, + "notes": "frame_offset_px = 玩家屏幕投影位移(p_i − p_0,M_px832 = 日志 M_px1280 按 832/1280、480/720 缩放)× gain_correction;背景相对屏幕的位移 = −frame_offset_px。日志按 video_t=video_t0+i/16 最近邻采样(与 make_clips 一致);valid=False 当任一帧最近邻样本时间差 > 0.5 s、坐标 NaN、所选日志样本 vt 倒退或相邻差 > max(0.5, 1/16+2×0.5+0.1) s(跨 offset 台阶)或单帧位移 > 200.0 px;转场 clip 的 valid = src_a 且 src_b 均 valid。max_log_dt 是该 clip 最近邻时间差的最大值,可据此放宽 valid 而不必重算。walk_speed_px_s 由直行 clip(21 cell 动作全同≠idle、rt_ratio≥0.9)的 |Δoffset|/5s 取中位,已乘 |gain_correction|。 x: g_s1=-1.121 g_s2=-1.124 (相差 0.3%) R²=0.988/0.981 符号一致率=0.00/0.01 ⇒ 采用 |g|=1.122,符号 反于 SPEC 约定(实测背景位移 ≈ +frame_offset) ⇒ gain=-1.122;y: g_s1=-1.127 g_s2=-1.118 (相差 0.8%) R²=0.921/0.839 符号一致率=0.01/0.04 ⇒ 幅值不满足(相差<5% 且 R²≥0.9),保持 1.0,符号 反于 SPEC 约定(实测背景位移 ≈ +frame_offset) ⇒ gain=-1.000\n[人工 2026-09-04] 纵向幅值改用实测 1.12(两 session 1.127/1.118、相差 0.8%,R² 0.92/0.84):step-5000 推理 up/down 超调 27% 证实 1.0 是欠标定。 2026-09-04 纵向增益 1.12(人定)" + }, + "dataset": { + "train_total": 20983, + "train_missing": 0, + "train_invalid": 1, + "train_leak_excluded": 257, + "train_low_rt_excluded": 2197, + "train_used": 18528, + "text_table_keys": 361, + "val_used": 16, + "val_clip_ids": [ + "clip_Eybx_100000255_000042", + "clip_Eybx_100000496_000000", + "clip_Eybx_100000680_000063", + "clip_Eybx_100000737_000063", + "clip_Eybx_100000737_000168", + "clip_Eybx_100000751_000231", + "clip_Eybx_100000751_000546", + "clip_Eybx_100000752_000000", + "clip_Eybx_100000838_000168", + "clip_Eybx_100001216_000000", + "clip_Eybx_100001217_000105", + "clip_Eybx_100002599_000000", + "clip_Eybx_100002875_000147", + "clip_Eybx_200000624_000000", + "clip_Eybx_200001033_000126", + "clip_Eybx_200001197_000063" + ] + }, + "model": { + "dit_files": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" + ], + "n_params": 4999803072, + "mask_embedding": true, + "resume_info": null, + "start_step": 5000 + }, + "env": { + "world_size": 8, + "distributed_type": "DistributedType.DEEPSPEED", + "mixed_precision": "bf16", + "torch": "2.11.0+cu128", + "cuda": "12.8", + "gpu": "NVIDIA H200", + "python": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/python3.12", + "platform": "Linux-6.12.94-123.192.amzn2023.x86_64-x86_64-with-glibc2.34", + "hostname": "ip-172-16-209-205.ap-southeast-3.compute.internal", + "argv": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/actionrope/train.py", + "--arm", + "arope", + "--mask_channel", + "--new_weight", + "2.0", + "--scene_dropout", + "0.1", + "--lr", + "1e-5", + "--weight_decay", + "0.01", + "--warmup_steps", + "500", + "--max_steps", + "40000", + "--save_every", + "1000", + "--save_state", + "--val_every", + "500", + "--val_n", + "16", + "--val_timesteps", + "200,500,800", + "--min_rt_ratio", + "0.8", + "--val_min_rt_ratio", + "0.9", + "--grad_accum", + "2", + "--num_workers", + "2", + "--seed", + "0", + "--output", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/arope_10k_ga2", + "--resume", + "outputs/arope_5k_ga2/state", + "--max_steps", + "10000", + "--warmup_steps", + "200" + ], + "started": "2026-09-05 03:40:16", + "cuda_visible_devices": "0,1,2,3,4,5,6,7", + "accelerate": "1.14.0", + "deepspeed": "0.19.6" + }, + "deepspeed_config": { + "train_batch_size": 16, + "train_micro_batch_size_per_gpu": 1, + "gradient_accumulation_steps": 2, + "zero_optimization": { + "stage": 2, + "offload_optimizer": { + "device": "none", + "nvme_path": null + }, + "offload_param": { + "device": "none", + "nvme_path": null + }, + "stage3_gather_16bit_weights_on_model_save": false + }, + "gradient_clipping": 1.0, + "steps_per_print": Infinity, + "bf16": { + "enabled": true + }, + "fp16": { + "enabled": false + }, + "zero_allow_untested_optimizer": true + } +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/arope_10k_ga2/train_log.csv b/backup_2026-09-14/runs/arope_10k_ga2/train_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..8d8f7a24fe2554790fca7d7a0ac434de1759bb3f --- /dev/null +++ b/backup_2026-09-14/runs/arope_10k_ga2/train_log.csv @@ -0,0 +1,5001 @@ +step,loss,loss_w,mse,new_frac,timestep,lr,grad_norm,step_time,mem_gb,epoch +5001,0.12396913766860962,0.1753576695919037,0.1862131655216217,0.20445512235164642,619.959716796875,1e-05,0.06652428209781647,6.816464424133301,23.908316612243652,0 +5002,0.15061824023723602,0.12390491366386414,0.12113198637962341,0.17596153914928436,847.8120727539062,1e-05,0.07088517397642136,2.3401196002960205,23.90831708908081,0 +5003,0.25128716230392456,0.08857756853103638,0.08454417437314987,0.1665704995393753,829.9730834960938,1e-05,0.0884695053100586,2.333880662918091,23.90831708908081,0 +5004,0.19733090698719025,0.11272919178009033,0.11398660391569138,0.13967947661876678,713.9794311523438,1e-05,0.0662466436624527,2.350452423095703,23.90831708908081,0 +5005,0.16796553134918213,0.1693478226661682,0.15453402698040009,0.206025630235672,754.75439453125,1e-05,0.08027336001396179,2.35585355758667,23.90831708908081,0 +5006,0.1336386650800705,0.33035579323768616,0.329693078994751,0.2710256278514862,996.3473510742188,1e-05,0.0575825534760952,2.3466618061065674,23.90831708908081,0 +5007,0.20113268494606018,0.29081639647483826,0.2895623743534088,0.24631409347057343,682.8494262695312,1e-05,0.08154845982789993,2.3426899909973145,23.90831708908081,0 +5008,0.12474001199007034,0.19891586899757385,0.19271041452884674,0.17070512473583221,905.8369750976562,1e-05,0.06516439467668533,2.3507134914398193,23.90831708908081,0 +5009,0.3673306703567505,0.30255982279777527,0.32070109248161316,0.2341987043619156,338.9212646484375,1e-05,0.08966701477766037,2.3474631309509277,23.90831708908081,0 +5010,0.13076606392860413,0.1461355984210968,0.1472446471452713,0.13487179577350616,596.2343139648438,1e-05,0.06123118847608566,2.581278085708618,23.90831708908081,0 +5011,0.09430454671382904,0.27526453137397766,0.2687618136405945,0.2014743536710739,995.728271484375,1e-05,0.06419777870178223,2.69964337348938,23.90831708908081,0 +5012,0.11510974913835526,0.23750336468219757,0.22626718878746033,0.24384614825248718,918.9618530273438,1e-05,0.0739562064409256,2.3482840061187744,23.90831708908081,0 +5013,0.1348162740468979,0.13743498921394348,0.1681661456823349,0.23615384101867676,994.0623168945312,1e-05,0.07325037568807602,2.3505728244781494,23.90831708908081,0 +5014,0.17419518530368805,0.089059017598629,0.0900491401553154,0.12224358320236206,909.21484375,1e-05,0.06162845343351364,2.354996681213379,23.90831708908081,0 +5015,0.24441732466220856,0.12028176337480545,0.1236071065068245,0.18330127000808716,898.8763427734375,1e-05,0.07123281061649323,2.3619868755340576,23.90831708908081,0 +5016,0.2579156458377838,0.20787015557289124,0.19053496420383453,0.3020833134651184,873.4939575195312,1e-05,0.07822312414646149,2.355214834213257,23.90831708908081,0 +5017,0.18611684441566467,0.15176250040531158,0.151584655046463,0.2516666650772095,818.9655151367188,1e-05,0.0669388696551323,2.3569610118865967,23.927849769592285,0 +5018,0.18447430431842804,0.11438518762588501,0.1338844895362854,0.19201922416687012,969.4793090820312,1e-05,0.06613612174987793,2.356630802154541,23.927849769592285,0 +5019,0.17780372500419617,0.25992056727409363,0.2578416168689728,0.20112179219722748,995.5211791992188,1e-05,0.05886191129684448,2.3671467304229736,23.927849769592285,0 +5020,0.31849896907806396,0.9188219904899597,0.9207091927528381,0.2551923096179962,38.75969314575195,1e-05,0.0800551250576973,2.3746676445007324,23.927849769592285,0 +5021,0.15342049300670624,0.13524064421653748,0.12913478910923004,0.2552884519100189,812.9371337890625,1e-05,0.05523855239152908,2.692039728164673,23.927849769592285,0 +5022,0.2475401908159256,0.2639806866645813,0.24718686938285828,0.22384615242481232,944.2269897460938,1e-05,0.0813823789358139,2.4987730979919434,23.927849769592285,0 +5023,0.15449918806552887,0.059985604137182236,0.06813006848096848,0.1395512819290161,944.52587890625,1e-05,0.07794991135597229,2.354727268218994,23.927849769592285,0 +5024,0.22713005542755127,0.10930012166500092,0.11881572008132935,0.24467948079109192,750.0000610351562,1e-05,0.07114620506763458,2.34686279296875,23.927849769592285,0 +5025,0.27650707960128784,0.11955150216817856,0.12180060148239136,0.2743269205093384,773.6281127929688,1e-05,0.07048816233873367,2.3516876697540283,23.927849769592285,0 +5026,0.0960342213511467,0.1373356431722641,0.13943475484848022,0.16971153020858765,818.9655151367188,1e-05,0.06236525624990463,2.343247175216675,23.927849769592285,0 +5027,0.15482467412948608,0.13278841972351074,0.1391572505235672,0.26461538672447205,883.2159423828125,1e-05,0.06996692717075348,2.3519082069396973,23.927849769592285,0 +5028,0.11090793460607529,0.39209237694740295,0.37841546535491943,0.235929474234581,988.4937133789062,1e-05,0.06019750237464905,2.3454082012176514,23.927849769592285,0 +5029,0.16767767071723938,0.20459596812725067,0.1931465119123459,0.18246793746948242,943.62744140625,1e-05,0.06470603495836258,2.345197916030884,23.927849769592285,0 +5030,0.19677843153476715,0.21610280871391296,0.21083499491214752,0.2048717886209488,796.4441528320312,1e-05,0.07747430354356766,2.3451333045959473,23.927849769592285,0 +5031,0.14934931695461273,0.2901374101638794,0.280889093875885,0.275865375995636,702.7145385742188,1e-05,0.07778895646333694,2.4811980724334717,23.927849769592285,0 +5032,0.2645472288131714,0.2447805404663086,0.23446960747241974,0.2657371759414673,454.8346252441406,1e-05,0.08135377615690231,2.6384761333465576,23.927849769592285,0 +5033,0.1722709834575653,0.15278901159763336,0.1568373590707779,0.24564102292060852,945.4190673828125,1e-05,0.07787833362817764,2.5792036056518555,23.927849769592285,0 +5034,0.17752191424369812,0.18438874185085297,0.1761932224035263,0.1630128175020218,834.44140625,1e-05,0.06629732996225357,2.346728801727295,23.927849769592285,0 +5035,0.23772883415222168,0.12364893406629562,0.13294310867786407,0.2695833146572113,851.403076171875,1e-05,0.07184983044862747,2.35127854347229,23.927849769592285,0 +5036,0.1893758773803711,0.18106122314929962,0.17264220118522644,0.15868589282035828,898.0855712890625,1e-05,0.07261152565479279,2.3582165241241455,23.927849769592285,0 +5037,0.18489126861095428,0.1823817491531372,0.18280431628227234,0.23628203570842743,938.7450561523438,1e-05,0.07717408239841461,2.35891056060791,23.927849769592285,0 +5038,0.1798870712518692,0.178557887673378,0.16795876622200012,0.2186538428068161,763.9968872070312,1e-05,0.07442138344049454,2.3530046939849854,23.927849769592285,0 +5039,0.1468973010778427,0.09644106775522232,0.10836213827133179,0.2714102566242218,802.292236328125,1e-05,0.06264933198690414,2.3564324378967285,23.927849769592285,0 +5040,0.1420254111289978,0.15740607678890228,0.1622152477502823,0.18474358320236206,674.4935913085938,1e-05,0.07610240578651428,2.3575780391693115,23.927849769592285,0 +5041,0.3339119255542755,0.29231008887290955,0.2904678285121918,0.22166666388511658,979.6713256835938,1e-05,0.07710474729537964,2.353752613067627,23.927849769592285,0 +5042,0.19148722290992737,0.5732229948043823,0.5713918805122375,0.19573716819286346,137.90036010742188,1e-05,0.061578646302223206,2.6107842922210693,23.927849769592285,0 +5043,0.15253452956676483,0.11895161122083664,0.12800361216068268,0.2567628026008606,950.9569091796875,1e-05,0.07161504775285721,2.513784170150757,23.927849769592285,0 +5044,0.19574035704135895,0.8936508893966675,0.8942527770996094,0.2211538404226303,29.296875,1e-05,0.0974719226360321,2.352734327316284,23.927849769592285,0 +5045,0.10340273380279541,0.23178425431251526,0.22488756477832794,0.22317306697368622,962.7756958007812,1e-05,0.07534176111221313,2.3516783714294434,23.927849769592285,0 +5046,0.27617987990379333,0.19438154995441437,0.19204527139663696,0.25333333015441895,643.2039184570312,1e-05,0.06987982243299484,2.352651357650757,23.927849769592285,0 +5047,0.25665387511253357,0.19793398678302765,0.19326351583003998,0.2452884465456009,950.095947265625,1e-05,0.07341401278972626,2.348529577255249,23.927849769592285,0 +5048,0.11683379113674164,0.2739725112915039,0.2653006911277771,0.20769229531288147,948.6500244140625,1e-05,0.07505831867456436,2.347050189971924,23.927849769592285,0 +5049,0.19249483942985535,0.2035708725452423,0.19768290221691132,0.21830128133296967,855.4293212890625,1e-05,0.05836017429828644,2.34451961517334,23.927849769592285,0 +5050,0.2888912260532379,0.2084384262561798,0.20635157823562622,0.2533012628555298,956.2970581054688,1e-05,0.07486651092767715,2.34759521484375,23.927849769592285,0 +5051,0.21879303455352783,0.10764438658952713,0.11066335439682007,0.26945510506629944,626.2474975585938,1e-05,0.06694962084293365,2.3457374572753906,23.927849769592285,0 +5052,0.2645169198513031,0.16475629806518555,0.1604553610086441,0.20262819528579712,712.13427734375,1e-05,0.07087492942810059,2.3464114665985107,23.927849769592285,0 +5053,0.1524803638458252,0.2362128645181656,0.22029417753219604,0.2051602452993393,932.0956420898438,1e-05,0.06574011594057083,2.717479705810547,23.927849769592285,0 +5054,0.16442790627479553,0.2922319769859314,0.27944833040237427,0.2873397469520569,972.9610595703125,1e-05,0.05864611268043518,2.4869537353515625,23.927849769592285,0 +5055,0.2602281868457794,0.2307814508676529,0.22249218821525574,0.226666659116745,750.7987060546875,1e-05,0.07333575189113617,2.345482587814331,23.927849769592285,0 +5056,0.12662799656391144,0.2873222827911377,0.28146111965179443,0.2168269157409668,973.2064208984375,1e-05,0.06624576449394226,2.3451459407806396,23.927849769592285,0 +5057,0.3141603469848633,0.4272877275943756,0.4177910387516022,0.20512819290161133,270.376220703125,1e-05,0.07997699826955795,2.3432559967041016,23.927849769592285,0 +5058,0.15479698777198792,0.15833906829357147,0.1577746719121933,0.27801281213760376,763.9968872070312,1e-05,0.07515173405408859,2.3456368446350098,23.927849769592285,0 +5059,0.14016912877559662,0.20033006370067596,0.21093925833702087,0.2401602417230606,971.4794311523438,1e-05,0.07247120887041092,2.34505295753479,23.927849769592285,0 +5060,0.2906135320663452,0.4078788459300995,0.42138513922691345,0.22701922059059143,211.79405212402344,1e-05,0.07544051855802536,2.349548578262329,23.927849769592285,0 +5061,0.1680890917778015,0.27027177810668945,0.26404765248298645,0.22137819230556488,997.168212890625,1e-05,0.06956598907709122,2.342949867248535,23.927849769592285,0 +5062,0.21711257100105286,0.19748921692371368,0.1865343302488327,0.28391024470329285,925.1558837890625,1e-05,0.08927035331726074,2.344569444656372,23.927849769592285,0 +5063,0.17780357599258423,0.15215027332305908,0.1514967828989029,0.09352564066648483,541.3831787109375,1e-05,0.07001229375600815,2.471982717514038,23.927849769592285,0 +5064,0.28926318883895874,0.3015317916870117,0.2945120632648468,0.22528845071792603,999.7998046875,1e-05,0.09991195797920227,2.505136013031006,23.927849769592285,0 +5065,0.2406020164489746,0.2249590903520584,0.22123964130878448,0.1849999874830246,714.8972778320312,1e-05,0.08133416622877121,2.501866102218628,23.927849769592285,0 +5066,0.2713121175765991,0.12244519591331482,0.1238306388258934,0.2107371687889099,753.9683227539062,1e-05,0.07715131342411041,2.348583459854126,23.927849769592285,0 +5067,0.12475588172674179,0.12454883754253387,0.1360151469707489,0.1841346025466919,851.9107666015625,1e-05,0.07011280208826065,2.36169171333313,23.927849769592285,0 +5068,0.16997788846492767,0.22769173979759216,0.23221120238304138,0.24227562546730042,446.65814208984375,1e-05,0.07876814156770706,2.3445355892181396,23.927849769592285,0 +5069,0.18088415265083313,0.1949985772371292,0.1818695366382599,0.23394230008125305,706.521728515625,1e-05,0.0703992247581482,2.348170518875122,23.927849769592285,0 +5070,0.25485119223594666,0.2739202380180359,0.27283453941345215,0.24115383625030518,374.6498718261719,1e-05,0.0915733128786087,2.3477513790130615,23.927849769592285,0 +5071,0.17921487987041473,0.25332167744636536,0.24815739691257477,0.17663460969924927,955.188720703125,1e-05,0.08208867162466049,2.348482608795166,23.927849769592285,0 +5072,0.16810689866542816,0.24502603709697723,0.24197666347026825,0.19230768084526062,935.6137084960938,1e-05,0.08339954912662506,2.3421640396118164,23.927849769592285,0 +5073,0.198198601603508,0.34908226132392883,0.36923328042030334,0.12679485976696014,215.23179626464844,1e-05,0.09088331460952759,2.3461720943450928,23.927849769592285,0 +5074,0.19269594550132751,0.2643725275993347,0.25729960203170776,0.315032035112381,949.8078002929688,1e-05,0.07722052186727524,2.785726547241211,23.927849769592285,0 +5075,0.15623421967029572,0.16021357476711273,0.17872554063796997,0.21801280975341797,352.0115051269531,1e-05,0.08523885905742645,2.4681477546691895,23.927849769592285,0 +5076,0.16187641024589539,0.5740721821784973,0.5920196175575256,0.2221153825521469,993.0098266601562,1e-05,0.0877344012260437,2.3579859733581543,23.927849769592285,0 +5077,0.1458740234375,0.06518741697072983,0.06404130160808563,0.22394229471683502,829.4078369140625,1e-05,0.07451795786619186,2.350282669067383,23.927849769592285,0 +5078,0.2861899733543396,0.12195249646902084,0.11384553462266922,0.23288460075855255,922.431884765625,1e-05,0.08013901859521866,2.3477461338043213,23.927849769592285,0 +5079,0.28941401839256287,0.1454111635684967,0.14912240207195282,0.13913461565971375,917.19921875,1e-05,0.08401159197092056,2.3499748706817627,23.927849769592285,0 +5080,0.17593079805374146,0.28564468026161194,0.273795485496521,0.22721153497695923,990.448486328125,1e-05,0.07789837568998337,2.355616807937622,23.927849769592285,0 +5081,0.14050251245498657,0.13085225224494934,0.12873908877372742,0.19833332300186157,818.3701782226562,1e-05,0.06294786930084229,2.357250928878784,23.927849769592285,0 +5082,0.1563006341457367,0.5557848215103149,0.5602220296859741,0.22692306339740753,133.9285888671875,1e-05,0.081198550760746,2.3611347675323486,23.927849769592285,0 +5083,0.2222585380077362,0.14913314580917358,0.14217041432857513,0.22660255432128906,785.6611938476562,1e-05,0.07083915174007416,2.355897903442383,23.927849769592285,0 +5084,0.20270876586437225,0.48764872550964355,0.4882217049598694,0.161474347114563,996.3473510742188,1e-05,0.07779261469841003,2.3554883003234863,23.927849769592285,0 +5085,0.22804638743400574,0.19872784614562988,0.187640979886055,0.2132692188024521,937.8121948242188,1e-05,0.08359218388795853,2.5826644897460938,23.927849769592285,0 +5086,0.2089012861251831,0.17259390652179718,0.17129290103912354,0.114967942237854,981.2984008789062,1e-05,0.08426851779222488,2.462851047515869,23.927849769592285,0 +5087,0.10316629707813263,0.1388513445854187,0.1445489078760147,0.2597435712814331,963.3027954101562,1e-05,0.07692091166973114,2.356395959854126,23.927849769592285,0 +5088,0.21470196545124054,0.15504731237888336,0.14922522008419037,0.21096153557300568,552.4553833007812,1e-05,0.08185762166976929,2.3561246395111084,23.927849769592285,0 +5089,0.14077143371105194,0.1861007958650589,0.1843518316745758,0.20923076570034027,897.6888427734375,1e-05,0.06347329169511795,2.3523287773132324,23.927849769592285,0 +5090,0.14477306604385376,0.5567863583564758,0.5857855081558228,0.21330127120018005,109.48905944824219,1e-05,0.07209490239620209,2.348334550857544,23.927849769592285,0 +5091,0.16696695983409882,0.13612785935401917,0.1378188282251358,0.2580128014087677,916.8442993164062,1e-05,0.08175458759069443,2.3509886264801025,23.927849769592285,0 +5092,0.2178020030260086,0.19219952821731567,0.19867298007011414,0.27685895562171936,927.8350219726562,1e-05,0.06445411592721939,2.3463761806488037,23.927849769592285,0 +5093,0.16790376603603363,0.19792789220809937,0.19981765747070312,0.26769229769706726,970.48291015625,1e-05,0.07208459079265594,2.347593307495117,23.927849769592285,0 +5094,0.3030604422092438,0.2969719171524048,0.297349214553833,0.2496153712272644,610.940673828125,1e-05,0.08210183680057526,2.343099594116211,23.927849769592285,0 +5095,0.2591870129108429,0.13898888230323792,0.1439259946346283,0.20980767905712128,839.89501953125,1e-05,0.07348192483186722,2.564483642578125,23.927849769592285,0 +5096,0.19122673571109772,0.18819934129714966,0.18271714448928833,0.21695512533187866,910.3261108398438,1e-05,0.06203077360987663,2.48270845413208,23.927849769592285,0 +5097,0.2117602676153183,0.14555102586746216,0.14676618576049805,0.2641025483608246,848.8447265625,1e-05,0.08011705428361893,2.484253168106079,23.927849769592285,0 +5098,0.2552010715007782,0.19696667790412903,0.18684567511081696,0.24621793627738953,917.5531616210938,1e-05,0.08687655627727509,2.348442554473877,23.927849769592285,0 +5099,0.17283746600151062,0.23643498122692108,0.2254045456647873,0.25778844952583313,823.6697998046875,1e-05,0.06926904618740082,2.3468129634857178,23.927849769592285,0 +5100,0.1367543786764145,0.4921228289604187,0.5101453065872192,0.18137820065021515,66.28787994384766,1e-05,0.0779334157705307,2.3463754653930664,23.927849769592285,0 +5101,0.20213960111141205,0.1452443152666092,0.14429447054862976,0.20150640606880188,954.0719604492188,1e-05,0.07687019556760788,2.3439016342163086,23.927849769592285,0 +5102,0.19822077453136444,0.27050766348838806,0.2527691721916199,0.2583012580871582,642.0233154296875,1e-05,0.08156578242778778,2.342374563217163,23.927849769592285,0 +5103,0.23342815041542053,0.14538684487342834,0.14138926565647125,0.208717942237854,858.3959350585938,1e-05,0.06737913936376572,2.3491194248199463,23.927849769592285,0 +5104,0.25746652483940125,0.14647182822227478,0.14765781164169312,0.20749999582767487,847.8120727539062,1e-05,0.089533232152462,2.346026659011841,23.927849769592285,0 +5105,0.1980602741241455,0.2717779874801636,0.2742403745651245,0.15570512413978577,971.23095703125,1e-05,0.06444460153579712,2.3482484817504883,23.927849769592285,0 +5106,0.11615247279405594,0.24118907749652863,0.24468035995960236,0.25237178802490234,968.468505859375,1e-05,0.06693664193153381,2.6253507137298584,23.927849769592285,0 +5107,0.14148926734924316,0.22755314409732819,0.23333662748336792,0.2383333295583725,977.07421875,1e-05,0.057238031178712845,2.345763683319092,23.927849769592285,0 +5108,0.1381394863128662,0.16573750972747803,0.1604158878326416,0.19384615123271942,934.6619262695312,1e-05,0.11817675828933716,2.577488660812378,23.927849769592285,0 +5109,0.1940983533859253,0.1622997671365738,0.15511023998260498,0.11166666448116302,837.7308349609375,1e-05,0.07679791748523712,2.352980613708496,23.927849769592285,0 +5110,0.17978227138519287,0.16930872201919556,0.16452358663082123,0.216057687997818,627.4900512695312,1e-05,0.06556373834609985,2.3487541675567627,23.927849769592285,0 +5111,0.17800840735435486,0.15637314319610596,0.14880242943763733,0.1567307561635971,918.9618530273438,1e-05,0.08614987134933472,2.3562498092651367,23.927849769592285,0 +5112,0.21694321930408478,0.12835514545440674,0.13511033356189728,0.25708332657814026,704.624755859375,1e-05,0.07664737850427628,2.3514673709869385,23.927849769592285,0 +5113,0.2906861901283264,0.20771317183971405,0.19956451654434204,0.2337179332971573,590.71728515625,1e-05,0.07799935340881348,2.355391502380371,23.927849769592285,0 +5114,0.1570003628730774,0.12078171223402023,0.12028251588344574,0.1447756290435791,957.39697265625,1e-05,0.07395709306001663,2.358138084411621,23.927849769592285,0 +5115,0.08937250822782516,0.1405135840177536,0.1492452472448349,0.2015705108642578,872.1281127929688,1e-05,0.07802707701921463,2.3578388690948486,23.927849769592285,0 +5116,0.2251613587141037,0.30737200379371643,0.3002626299858093,0.21249999105930328,505.9523620605469,1e-05,0.07493547350168228,2.5650837421417236,23.927849769592285,0 +5117,0.1922968178987503,0.2221338301897049,0.2148650586605072,0.3064422905445099,960.3799438476562,1e-05,0.07364660501480103,2.5919477939605713,23.927849769592285,0 +5118,0.19844940304756165,0.15935125946998596,0.15551574528217316,0.21660254895687103,579.399169921875,1e-05,0.06406373530626297,2.4981887340545654,23.927849769592285,0 +5119,0.24487845599651337,0.18454399704933167,0.18776899576187134,0.18695512413978577,740.2120361328125,1e-05,0.07949520647525787,2.360217571258545,23.927849769592285,0 +5120,0.18133215606212616,0.15429124236106873,0.1577400267124176,0.20692306756973267,893.2648315429688,1e-05,0.07659855484962463,2.3431642055511475,23.927849769592285,0 +5121,0.1966509222984314,0.3968755304813385,0.39268872141838074,0.2090063989162445,264.1955871582031,1e-05,0.06573547422885895,2.345682144165039,23.927849769592285,0 +5122,0.23118337988853455,0.19339348375797272,0.1870521605014801,0.23942306637763977,680.7832641601562,1e-05,0.07711943238973618,2.343320846557617,23.927849769592285,0 +5123,0.21498170495033264,0.13862504065036774,0.13131684064865112,0.20685896277427673,772.1712036132812,1e-05,0.08392170071601868,2.34592342376709,23.927849769592285,0 +5124,0.21046268939971924,0.16452491283416748,0.16262602806091309,0.22900639474391937,735.1730346679688,1e-05,0.07990646362304688,2.3460609912872314,23.927849769592285,0 +5125,0.13638366758823395,0.1347484141588211,0.13042007386684418,0.2640705108642578,719.4397583007812,1e-05,0.054110512137413025,2.3508994579315186,23.927849769592285,0 +5126,0.2740517258644104,0.15371155738830566,0.168696790933609,0.2069871723651886,942.1181640625,1e-05,0.08485549688339233,2.347332239151001,23.927849769592285,0 +5127,0.26877841353416443,0.07628638297319412,0.08410835266113281,0.21839742362499237,812.9371337890625,1e-05,0.07939413189888,2.602269411087036,23.927849769592285,0 +5128,0.08943091332912445,0.13385328650474548,0.14701172709465027,0.2574358880519867,978.7327270507812,1e-05,0.07147829234600067,2.495720624923706,23.927849769592285,0 +5129,0.21716168522834778,0.18274396657943726,0.1826246827840805,0.27977561950683594,761.7188110351562,1e-05,0.08162055164575577,2.4729793071746826,23.927849769592285,0 +5130,0.22844433784484863,0.14662213623523712,0.14452165365219116,0.23310896754264832,898.0855712890625,1e-05,0.09352516382932663,2.3449225425720215,23.927849769592285,0 +5131,0.2152954339981079,0.12349411845207214,0.12250018864870071,0.23362179100513458,842.5684204101562,1e-05,0.08428605645895004,2.3466384410858154,23.927849769592285,0 +5132,0.22882583737373352,0.19348719716072083,0.19372838735580444,0.28910255432128906,858.8861083984375,1e-05,0.06381262838840485,2.347963333129883,23.927849769592285,0 +5133,0.17211733758449554,0.25986430048942566,0.25777485966682434,0.11144230514764786,769.9692993164062,1e-05,0.0663069412112236,2.3478517532348633,23.927849769592285,0 +5134,0.1162194013595581,0.36917805671691895,0.35924962162971497,0.21839742362499237,989.5833129882812,1e-05,0.07972283661365509,2.345395088195801,23.927849769592285,0 +5135,0.3362942337989807,0.11052019894123077,0.11941856890916824,0.17903845012187958,849.8719482421875,1e-05,0.08420082181692123,2.344296932220459,23.927849769592285,0 +5136,0.21391895413398743,0.20170560479164124,0.1926078349351883,0.2337179332971573,897.2911987304688,1e-05,0.0748491883277893,2.348076581954956,23.927849769592285,0 +5137,0.14754919707775116,0.05046330764889717,0.053533174097537994,0.1418910175561905,637.2549438476562,1e-05,0.07786587625741959,2.3504204750061035,23.927849769592285,0 +5138,0.20017123222351074,0.1466999053955078,0.1473923623561859,0.2713140845298767,832.777099609375,1e-05,0.05785219743847847,2.678595542907715,23.927849769592285,0 +5139,0.17925119400024414,0.20379695296287537,0.1975669413805008,0.2390064001083374,894.0774536132812,1e-05,0.06305626779794693,2.574028491973877,23.927849769592285,0 +5140,0.21654614806175232,0.1458996832370758,0.14261703193187714,0.24419870972633362,887.0499877929688,1e-05,0.08034539967775345,2.3505053520202637,23.927849769592285,0 +5141,0.08991597592830658,0.08701079338788986,0.0990295261144638,0.246538445353508,832.2192993164062,1e-05,0.07284029573202133,2.34527850151062,23.927849769592285,0 +5142,0.10867966711521149,0.19573773443698883,0.19653116166591644,0.29586538672447205,963.0394287109375,1e-05,0.07439775764942169,2.3483898639678955,23.927849769592285,0 +5143,0.13308876752853394,0.08890219777822495,0.09792885184288025,0.14942307770252228,920.0105590820312,1e-05,0.07706308364868164,2.344287395477295,23.927849769592285,0 +5144,0.2669280767440796,0.23417390882968903,0.22442540526390076,0.23157049715518951,521.561767578125,1e-05,0.0883355438709259,2.349210500717163,23.927849769592285,0 +5145,0.24061670899391174,0.13368038833141327,0.13187633454799652,0.1703205108642578,724.7899169921875,1e-05,0.0718962773680687,2.3472108840942383,23.927849769592285,0 +5146,0.18970587849617004,0.4973081350326538,0.48265984654426575,0.25410255789756775,157.3426513671875,1e-05,0.06481197476387024,2.344425916671753,23.927849769592285,0 +5147,0.18371914327144623,0.18358615040779114,0.18139798939228058,0.18589742481708527,736.8637084960938,1e-05,0.06963367760181427,2.3452675342559814,23.927849769592285,0 +5148,0.13033084571361542,0.17199110984802246,0.17418034374713898,0.2597435712814331,957.9439697265625,1e-05,0.06245220825076103,2.5676283836364746,23.927849769592285,0 +5149,0.27135035395622253,0.16987939178943634,0.16650953888893127,0.24983973801136017,960.1112060546875,1e-05,0.0641375184059143,2.7019407749176025,23.927849769592285,0 +5150,0.19135664403438568,0.31268808245658875,0.30826079845428467,0.22727563977241516,982.2193603515625,1e-05,0.0691121369600296,2.4747769832611084,23.927849769592285,0 +5151,0.25583577156066895,0.1463867425918579,0.14994724094867706,0.24205127358436584,757.8740844726562,1e-05,0.06436111778020859,2.346526861190796,23.927849769592285,0 +5152,0.20591406524181366,0.23217090964317322,0.22653192281723022,0.24833332002162933,541.3831787109375,1e-05,0.06818213313817978,2.351691484451294,23.927849769592285,0 +5153,0.15402212738990784,0.12989099323749542,0.12534715235233307,0.27310895919799805,915.4175415039062,1e-05,0.08112319558858871,2.346240997314453,23.927849769592285,0 +5154,0.19591186940670013,0.48898977041244507,0.48168444633483887,0.2350640892982483,993.4319458007812,1e-05,0.06852216273546219,2.347334146499634,23.927849769592285,0 +5155,0.13448511064052582,0.17672383785247803,0.17527426779270172,0.24419870972633362,949.5192260742188,1e-05,0.06711234897375107,2.3429901599884033,23.927849769592285,0 +5156,0.15148280560970306,0.18402467668056488,0.1873488873243332,0.24282050132751465,639.6484985351562,1e-05,0.08323631435632706,2.349349021911621,23.927849769592285,0 +5157,0.20022033154964447,0.13718459010124207,0.14025209844112396,0.27157050371170044,907.7218017578125,1e-05,0.07455828785896301,2.3479158878326416,23.927849769592285,0 +5158,0.2774081528186798,0.13512858748435974,0.13590779900550842,0.22064101696014404,886.6278686523438,1e-05,0.09729699790477753,2.5540378093719482,23.927849769592285,0 +5159,0.26295095682144165,0.43163496255874634,0.4299815595149994,0.23256409168243408,215.23179626464844,1e-05,0.07334978133440018,2.65168833732605,23.927849769592285,0 +5160,0.27371862530708313,0.22583457827568054,0.20582932233810425,0.2800000011920929,869.3666381835938,1e-05,0.07577123492956161,2.764503240585327,23.927849769592285,0 +5161,0.2515585422515869,0.16416895389556885,0.1609766185283661,0.19294871389865875,854.930419921875,1e-05,0.06451243907213211,2.356841802597046,23.927849769592285,0 +5162,0.12502634525299072,0.1304536610841751,0.1371367871761322,0.1946474313735962,806.7376098632812,1e-05,0.06472600996494293,2.344813108444214,23.927849769592285,0 +5163,0.3500574827194214,0.32548195123672485,0.32715263962745667,0.1635897308588028,254.77706909179688,1e-05,0.08263792842626572,2.3481109142303467,23.927849769592285,0 +5164,0.21662719547748566,0.25567626953125,0.24745555222034454,0.265256404876709,860.34912109375,1e-05,0.07195690274238586,2.3501298427581787,23.927849769592285,0 +5165,0.19025680422782898,0.2369246631860733,0.23507945239543915,0.24666665494441986,659.2627563476562,1e-05,0.07568856328725815,2.3540124893188477,23.927849769592285,0 +5166,0.24173504114151,0.07177215069532394,0.0758509561419487,0.19749999046325684,772.1712036132812,1e-05,0.06891977041959763,2.351773262023926,23.927849769592285,0 +5167,0.2883889973163605,0.3788205087184906,0.3588714003562927,0.27291664481163025,993.8524169921875,1e-05,0.07248047739267349,2.3482913970947266,23.927849769592285,0 +5168,0.2171173095703125,0.18631760776042938,0.20276029407978058,0.22836537659168243,993.8524169921875,1e-05,0.07044336944818497,2.349968910217285,23.927849769592285,0 +5169,0.16999176144599915,0.2295321673154831,0.23252475261688232,0.29083332419395447,982.677490234375,1e-05,0.06709949672222137,2.4691874980926514,23.927849769592285,0 +5170,0.26204439997673035,0.6587874293327332,0.6685041189193726,0.2741987109184265,83.95523071289062,1e-05,0.08122095465660095,2.5934813022613525,23.927849769592285,0 +5171,0.1661701202392578,0.3472750782966614,0.34615013003349304,0.2709615230560303,267.29559326171875,1e-05,0.06344947963953018,2.5109598636627197,23.927849769592285,0 +5172,0.33337855339050293,0.18587782979011536,0.18597643077373505,0.2723717987537384,771.4395751953125,1e-05,0.06727824360132217,2.356698751449585,23.927849769592285,0 +5173,0.30928876996040344,0.1180308535695076,0.12072982639074326,0.22189101576805115,813.5474853515625,1e-05,0.08144019544124603,2.3454952239990234,23.927849769592285,0 +5174,0.29706645011901855,0.17193631827831268,0.16621536016464233,0.2618589699268341,561.674072265625,1e-05,0.08190993219614029,2.3461432456970215,23.927849769592285,0 +5175,0.19422131776809692,0.23703309893608093,0.22318942844867706,0.2949358820915222,945.1219482421875,1e-05,0.0708136186003685,2.348388195037842,23.927849769592285,0 +5176,0.1816551834344864,0.25741609930992126,0.2559604048728943,0.16833332180976868,856.9182739257812,1e-05,0.07681439071893692,2.3467023372650146,23.927849769592285,0 +5177,0.20132982730865479,0.18512995541095734,0.18297572433948517,0.15801280736923218,587.923828125,1e-05,0.0676674097776413,2.345000743865967,23.927849769592285,0 +5178,0.1575547456741333,0.23223096132278442,0.2218397706747055,0.24631409347057343,972.4690551757812,1e-05,0.06474442034959793,2.346975564956665,23.927849769592285,0 +5179,0.17754732072353363,0.38506972789764404,0.3705909550189972,0.25823718309402466,987.8356323242188,1e-05,0.09133727848529816,2.341000556945801,23.927849769592285,0 +5180,0.2687474191188812,0.16689713299274445,0.1743738353252411,0.18503203988075256,940.287353515625,1e-05,0.09219317883253098,2.6814026832580566,23.927849769592285,0 +5181,0.1991535723209381,0.14791938662528992,0.1564813256263733,0.185384601354599,636.0511474609375,1e-05,0.0880136787891388,2.5206990242004395,23.927849769592285,0 +5182,0.21409592032432556,0.28835076093673706,0.2828958034515381,0.2622756361961365,627.4900512695312,1e-05,0.07379091531038284,2.5985419750213623,23.927849769592285,0 +5183,0.220342755317688,0.16733558475971222,0.1657181829214096,0.2574038505554199,869.3666381835938,1e-05,0.07292193174362183,2.3513553142547607,23.927849769592285,0 +5184,0.17083093523979187,0.13948583602905273,0.13592034578323364,0.1784294843673706,917.9064331054688,1e-05,0.0732099711894989,2.3455002307891846,23.927849769592285,0 +5185,0.2266271412372589,0.41184818744659424,0.4104648530483246,0.23817306756973267,993.4319458007812,1e-05,0.10916577279567719,2.3467366695404053,23.927849769592285,0 +5186,0.21544599533081055,0.13134679198265076,0.1311548948287964,0.15625,899.2704467773438,1e-05,0.07634114474058151,2.3455193042755127,23.927849769592285,0 +5187,0.1531638354063034,0.2692537009716034,0.27630120515823364,0.23144230246543884,964.61181640625,1e-05,0.06978948414325714,2.3469481468200684,23.927849769592285,0 +5188,0.303508996963501,0.452050119638443,0.44038036465644836,0.16842947900295258,999.5994262695312,1e-05,0.08626527339220047,2.3665692806243896,23.927849769592285,0 +5189,0.24739155173301697,0.12893128395080566,0.133670374751091,0.06266025453805923,521.561767578125,1e-05,0.07617493718862534,2.3435213565826416,23.927849769592285,0 +5190,0.27427858114242554,0.18498390913009644,0.1714467853307724,0.2173076868057251,874.8499145507812,1e-05,0.07229169458150864,2.484074115753174,23.927849769592285,0 +5191,0.2556895911693573,0.17101526260375977,0.1627069115638733,0.31121793389320374,716.7235717773438,1e-05,0.07465687394142151,2.5804150104522705,23.927849769592285,0 +5192,0.17167694866657257,0.1353931576013565,0.13533146679401398,0.2597435712814331,664.7939453125,1e-05,0.08166181296110153,2.6262757778167725,23.927849769592285,0 +5193,0.1822730451822281,0.17912213504314423,0.17731507122516632,0.17221152782440186,643.2039184570312,1e-05,0.0977095514535904,2.3620119094848633,23.927849769592285,0 +5194,0.09913761913776398,0.27074864506721497,0.2744089365005493,0.20403845608234406,959.5725708007812,1e-05,0.068871408700943,2.3439176082611084,23.927849769592285,0 +5195,0.18318012356758118,0.40890586376190186,0.37179261445999146,0.25942307710647583,992.58642578125,1e-05,0.06368137151002884,2.3568878173828125,23.927849769592285,0 +5196,0.2460479587316513,0.2728419303894043,0.25969570875167847,0.19278845191001892,939.9801635742188,1e-05,0.0993536189198494,2.347719669342041,23.927849769592285,0 +5197,0.1450507938861847,0.17369523644447327,0.16594670712947845,0.18253204226493835,853.9290161132812,1e-05,0.08176638185977936,2.347177267074585,23.927849769592285,0 +5198,0.22290711104869843,0.9546909332275391,0.9648585915565491,0.23240384459495544,19.685039520263672,1e-05,0.07679542154073715,2.3497416973114014,23.927849769592285,0 +5199,0.1767687350511551,0.5629236698150635,0.5634511113166809,0.2001281976699829,137.90036010742188,1e-05,0.07230863720178604,2.348855972290039,23.927849769592285,0 +5200,0.14989741146564484,0.3447262942790985,0.32529833912849426,0.18503203988075256,976.1173706054688,1e-05,0.09291092306375504,2.348656177520752,23.927849769592285,0 +5201,0.18600936233997345,0.2800087332725525,0.25789862871170044,0.176121786236763,978.2608642578125,1e-05,0.09606433659791946,2.8261210918426514,23.927849769592285,0 +5202,0.20748741924762726,0.17765149474143982,0.17370863258838654,0.20983973145484924,804.208251953125,1e-05,0.07456475496292114,2.582455635070801,23.927849769592285,0 +5203,0.3000362515449524,0.2271888256072998,0.21427947282791138,0.32499998807907104,853.4264526367188,1e-05,0.08224697411060333,2.7388195991516113,23.927849769592285,0 +5204,0.21390996873378754,0.2985512614250183,0.2961033582687378,0.2870192229747772,470.6982727050781,1e-05,0.1568770408630371,2.357632875442505,23.927849769592285,0 +5205,0.12931731343269348,0.11982781440019608,0.12334727495908737,0.16958332061767578,852.4172973632812,1e-05,0.07526718080043793,2.3478872776031494,23.927849769592285,0 +5206,0.16955247521400452,0.14424604177474976,0.13297925889492035,0.20532050728797913,790.4412231445312,1e-05,0.07029373198747635,2.351393938064575,23.927849769592285,0 +5207,0.13592340052127838,0.8994878530502319,0.8954993486404419,0.24214743077754974,38.75969314575195,1e-05,0.0668020024895668,2.3542582988739014,23.927849769592285,0 +5208,0.1568823605775833,0.14567270874977112,0.15263502299785614,0.11064102500677109,945.1219482421875,1e-05,0.0670013353228569,2.370196580886841,23.927849769592285,0 +5209,0.17875948548316956,0.11665230989456177,0.12431398779153824,0.1792948693037033,529.9539794921875,1e-05,0.07132474333047867,2.3522510528564453,23.927849769592285,0 +5210,0.1996845304965973,0.38702112436294556,0.3857407569885254,0.30493587255477905,257.9365234375,1e-05,0.08294521272182465,2.3608150482177734,23.927849769592285,0 +5211,0.17768794298171997,0.15494343638420105,0.15471479296684265,0.21032050251960754,655.8935546875,1e-05,0.07380069047212601,2.48313570022583,23.927849769592285,0 +5212,0.33242207765579224,0.4262095093727112,0.44413551688194275,0.16862179338932037,161.1498260498047,1e-05,0.07982098311185837,2.6102914810180664,23.927849769592285,0 +5213,0.2812444269657135,0.2173120230436325,0.2084423005580902,0.19131410121917725,926.165771484375,1e-05,0.10426932573318481,2.586196184158325,23.927849769592285,0 +5214,0.11267279088497162,0.1906852126121521,0.18405736982822418,0.14000000059604645,889.5617065429688,1e-05,0.07542622834444046,2.5471391677856445,23.927849769592285,0 +5215,0.2062045931816101,0.24753537774085999,0.23370106518268585,0.2355448603630066,851.403076171875,1e-05,0.07117389142513275,2.3548734188079834,23.927849769592285,0 +5216,0.19150827825069427,0.15244418382644653,0.15238717198371887,0.19333332777023315,744.3366088867188,1e-05,0.08701645582914352,2.347979784011841,23.927849769592285,0 +5217,0.3570081889629364,0.21168510615825653,0.20878301560878754,0.2499999850988388,524.9420166015625,1e-05,0.0997476801276207,2.3486528396606445,23.927849769592285,0 +5218,0.08920344710350037,0.13827228546142578,0.12898635864257812,0.27019229531288147,937.1871948242188,1e-05,0.06642284989356995,2.352586269378662,23.927849769592285,0 +5219,0.17964054644107819,0.06896693259477615,0.0664319396018982,0.24028845131397247,742.69482421875,1e-05,0.07652653753757477,2.3528192043304443,23.927849769592285,0 +5220,0.18536114692687988,0.3664981722831726,0.3567582964897156,0.24772435426712036,305.8912353515625,1e-05,0.13447773456573486,2.348672389984131,23.927849769592285,0 +5221,0.08571191877126694,0.12475685775279999,0.11991201341152191,0.21849358081817627,838.2740478515625,1e-05,0.07169722765684128,2.346327543258667,23.927849769592285,0 +5222,0.27093809843063354,0.324142724275589,0.29451021552085876,0.20913460850715637,984.0426025390625,1e-05,0.08220871537923813,2.596728563308716,23.927849769592285,0 +5223,0.20429310202598572,0.16386312246322632,0.15532681345939636,0.23019230365753174,797.1013793945312,1e-05,0.07984992116689682,2.5806777477264404,23.927849769592285,0 +5224,0.1869402527809143,0.2124461680650711,0.20413410663604736,0.28900641202926636,782.8849487304688,1e-05,0.06747209280729294,2.795564889907837,23.927849769592285,0 +5225,0.19902841746807098,0.2599945068359375,0.2543807029724121,0.21214742958545685,895.6915893554688,1e-05,0.07728578895330429,2.352036237716675,23.927849769592285,0 +5226,0.15686896443367004,0.06049390882253647,0.06598299741744995,0.11413460969924927,793.128662109375,1e-05,0.06254924833774567,2.346508502960205,23.927849769592285,0 +5227,0.19735129177570343,0.2972297668457031,0.29374873638153076,0.14782050251960754,314.37127685546875,1e-05,0.07862217724323273,2.3462841510772705,23.927849769592285,0 +5228,0.30863645672798157,0.283363938331604,0.30865222215652466,0.14576922357082367,235.38963317871094,1e-05,0.08655965328216553,2.348787784576416,23.927849769592285,0 +5229,0.3572536110877991,0.5937656760215759,0.5847022533416748,0.20240384340286255,117.75362396240234,1e-05,0.06785117834806442,2.3416056632995605,23.927849769592285,0 +5230,0.25761592388153076,0.2758389115333557,0.2684830129146576,0.2400640994310379,965.6505737304688,1e-05,0.07027603685855865,2.3458545207977295,23.927849769592285,0 +5231,0.20788459479808807,0.09912897646427155,0.09956756979227066,0.14897435903549194,933.7044067382812,1e-05,0.07355031371116638,2.34686541557312,23.927849769592285,0 +5232,0.15955765545368195,0.2691333591938019,0.2570132911205292,0.20926281809806824,988.0552978515625,1e-05,0.08691763877868652,2.452497720718384,23.927849769592285,0 +5233,0.24048884212970734,0.1910383105278015,0.1811039298772812,0.25631409883499146,915.0589599609375,1e-05,0.07621514052152634,2.6075961589813232,23.927849769592285,0 +5234,0.08731256425380707,0.15206436812877655,0.14915941655635834,0.2127884477376938,923.799560546875,1e-05,0.07255136966705322,2.4776840209960938,23.927849769592285,0 +5235,0.19670350849628448,0.5511362552642822,0.5985441207885742,0.1584615260362625,75.18797302246094,1e-05,0.086979441344738,2.4647724628448486,23.927849769592285,0 +5236,0.15030139684677124,0.17161886394023895,0.17136351764202118,0.1849999874830246,985.6176147460938,1e-05,0.08662750571966171,2.3513023853302,23.927849769592285,0 +5237,0.1194080337882042,0.16514676809310913,0.1614360213279724,0.21666665375232697,770.7055053710938,1e-05,0.06520999222993851,2.3497812747955322,23.927849769592285,0 +5238,0.16770502924919128,0.19587822258472443,0.20073294639587402,0.2978525459766388,829.9730834960938,1e-05,0.08185639977455139,2.3548567295074463,23.927849769592285,0 +5239,0.18971294164657593,0.23709602653980255,0.2352423071861267,0.24842947721481323,747.5884399414062,1e-05,0.09888915717601776,2.3693857192993164,23.927849769592285,0 +5240,0.09226549416780472,0.24800877273082733,0.2510526776313782,0.1828846037387848,997.168212890625,1e-05,0.08387114852666855,2.3603382110595703,23.927849769592285,0 +5241,0.17511163651943207,0.09616100043058395,0.0950489416718483,0.0919230729341507,925.1558837890625,1e-05,0.06982853263616562,2.3553571701049805,23.927849769592285,0 +5242,0.28499719500541687,0.19927923381328583,0.20125417411327362,0.19333332777023315,849.3589477539062,1e-05,0.10191607475280762,2.3692660331726074,23.927849769592285,0 +5243,0.2684917151927948,0.18507827818393707,0.18352338671684265,0.22823716700077057,678.7020263671875,1e-05,0.0926603302359581,2.5021214485168457,23.927849769592285,0 +5244,0.1547355055809021,0.12844929099082947,0.12923674285411835,0.12705127894878387,859.375,1e-05,0.07575906068086624,2.581400156021118,23.927849769592285,0 +5245,0.12778344750404358,0.10638295114040375,0.10014785826206207,0.11929486691951752,858.8861083984375,1e-05,0.06794192641973495,2.7345213890075684,23.927849769592285,0 +5246,0.1800653636455536,0.18846555054187775,0.18891923129558563,0.19173076748847961,955.4664916992188,1e-05,0.0970764309167862,2.5882692337036133,23.927849769592285,0 +5247,0.28824084997177124,0.3543168902397156,0.3558579385280609,0.20955127477645874,300.1519775390625,1e-05,0.1016911044716835,2.3558101654052734,23.927849769592285,0 +5248,0.1520041823387146,0.1137319952249527,0.11877609044313431,0.19243589043617249,798.4103393554688,1e-05,0.07298199832439423,2.357619047164917,23.927849769592285,0 +5249,0.22359351813793182,0.20384277403354645,0.19898422062397003,0.253269225358963,680.7832641601562,1e-05,0.0923076868057251,2.355117082595825,23.927849769592285,0 +5250,0.21324703097343445,0.1329469382762909,0.13197974860668182,0.2234935760498047,865.1477661132812,1e-05,0.08585800975561142,2.358914613723755,23.927849769592285,0 +5251,0.19558560848236084,0.30913373827934265,0.31397005915641785,0.1990704983472824,319.94049072265625,1e-05,0.06565874069929123,2.353261947631836,23.927849769592285,0 +5252,0.1932687908411026,0.1300632506608963,0.13075430691242218,0.1243269219994545,870.7523803710938,1e-05,0.0686790943145752,2.3597500324249268,23.927849769592285,0 +5253,0.10370628535747528,0.2769847512245178,0.2642826437950134,0.29323717951774597,925.4932250976562,1e-05,0.06785278022289276,2.4545252323150635,23.927849769592285,0 +5254,0.16121788322925568,0.09818015992641449,0.10334213078022003,0.31243589520454407,678.7020263671875,1e-05,0.06721163541078568,2.481067657470703,23.927849769592285,0 +5255,0.12971225380897522,0.1699763983488083,0.16325803101062775,0.2673717737197876,875.74853515625,1e-05,0.06726783514022827,2.48026442527771,23.927849769592285,0 +5256,0.24275782704353333,0.1856110543012619,0.19000521302223206,0.05836538225412369,398.5013732910156,1e-05,0.08745922893285751,2.6419677734375,23.927849769592285,0 +5257,0.13659080862998962,0.19942356646060944,0.192010760307312,0.1249999925494194,850.3836669921875,1e-05,0.06733272224664688,2.3580434322357178,23.927849769592285,0 +5258,0.23255127668380737,0.4502922296524048,0.44577348232269287,0.22855769097805023,248.39744567871094,1e-05,0.08010541647672653,2.3497812747955322,23.927849769592285,0 +5259,0.33163881301879883,0.1801217496395111,0.17718948423862457,0.24935896694660187,723.90576171875,1e-05,0.08071870356798172,2.348375082015991,23.927849769592285,0 +5260,0.3042118549346924,0.3374428153038025,0.3510929048061371,0.2241666615009308,232.08470153808594,1e-05,0.1259361207485199,2.348470449447632,23.927849769592285,0 +5261,0.26289236545562744,0.2502800524234772,0.24897438287734985,0.09673076868057251,542.9864501953125,1e-05,0.08172217756509781,2.3447375297546387,23.927849769592285,0 +5262,0.21025221049785614,0.15173457562923431,0.14398126304149628,0.16221153736114502,783.5821533203125,1e-05,0.08525200188159943,2.3439748287200928,23.927849769592285,0 +5263,0.14976362884044647,0.20449243485927582,0.1999061405658722,0.20820511877536774,944.8242797851562,1e-05,0.07108871638774872,2.3477675914764404,23.927849769592285,0 +5264,0.10889362543821335,0.18080763518810272,0.17877238988876343,0.2194230705499649,845.7308959960938,1e-05,0.07081590592861176,2.5585529804229736,23.927849769592285,0 +5265,0.34223809838294983,0.07826343923807144,0.0756661519408226,0.20974358916282654,719.4397583007812,1e-05,0.0966959297657013,2.4955074787139893,23.927849769592285,0 +5266,0.1917012631893158,0.10368523001670837,0.12435231357812881,0.2259935885667801,448.71795654296875,1e-05,0.09262557327747345,2.4866721630096436,23.927849769592285,0 +5267,0.11630697548389435,0.24459587037563324,0.23702119290828705,0.23230768740177155,853.4264526367188,1e-05,0.06631157547235489,2.487414836883545,23.927849769592285,0 +5268,0.1104566901922226,0.24889157712459564,0.24256089329719543,0.23586536943912506,985.3936767578125,1e-05,0.07120247930288315,2.3498921394348145,23.927849769592285,0 +5269,0.1480950564146042,0.22929206490516663,0.21612423658370972,0.15983973443508148,946.0116577148438,1e-05,0.08180148154497147,2.3425793647766113,23.927849769592285,0 +5270,0.23162856698036194,0.17466017603874207,0.1678655743598938,0.2542628049850464,887.0499877929688,1e-05,0.09034068882465363,2.3474955558776855,23.927849769592285,0 +5271,0.17144548892974854,0.1645917147397995,0.16574949026107788,0.23240384459495544,939.9801635742188,1e-05,0.080768883228302,2.352113962173462,23.927849769592285,0 +5272,0.12301965057849884,0.17688892781734467,0.1784459352493286,0.12102563679218292,636.0511474609375,1e-05,0.07864179462194443,2.3516902923583984,23.927849769592285,0 +5273,0.22343429923057556,0.21162550151348114,0.19983169436454773,0.23423075675964355,802.292236328125,1e-05,0.0815984234213829,2.3446052074432373,23.927849769592285,0 +5274,0.20059072971343994,0.21980872750282288,0.2302040159702301,0.23874999582767487,349.42364501953125,1e-05,0.08835948258638382,2.3408613204956055,23.927849769592285,0 +5275,0.24657057225704193,0.13318444788455963,0.14361415803432465,0.2756730616092682,603.0020751953125,1e-05,0.09173822402954102,2.4665427207946777,23.927849769592285,0 +5276,0.16433492302894592,0.13520239293575287,0.13555414974689484,0.2759294807910919,526.620361328125,1e-05,0.0680534616112709,2.4796204566955566,23.927849769592285,0 +5277,0.2670261561870575,0.10839127004146576,0.1181226447224617,0.18067307770252228,745.9677734375,1e-05,0.10704340785741806,2.5921428203582764,23.927849769592285,0 +5278,0.20243319869041443,0.1878259927034378,0.19021952152252197,0.1666666567325592,852.9224853515625,1e-05,0.08346386253833771,2.355416774749756,23.927849769592285,0 +5279,0.1575893759727478,0.25567102432250977,0.24443522095680237,0.17403845489025116,964.0897216796875,1e-05,0.0809592604637146,2.349708318710327,23.927849769592285,0 +5280,0.37975770235061646,0.1241789162158966,0.12374536693096161,0.22410255670547485,746.7793579101562,1e-05,0.1114724725484848,2.349231243133545,23.927849769592285,0 +5281,0.24486233294010162,0.19237177073955536,0.18024535477161407,0.2657371759414673,944.8242797851562,1e-05,0.07745897769927979,2.3520376682281494,23.927849769592285,0 +5282,0.1801416575908661,0.41843870282173157,0.4187770485877991,0.23897434771060944,129.92831420898438,1e-05,0.07498028874397278,2.348306179046631,23.927849769592285,0 +5283,0.11089309304952621,0.19649402797222137,0.17686544358730316,0.24227562546730042,911.7965698242188,1e-05,0.07603487372398376,2.352262258529663,23.927849769592285,0 +5284,0.21588660776615143,0.23565155267715454,0.23850302398204803,0.21647435426712036,407.6819763183594,1e-05,0.09451489895582199,2.3484511375427246,23.927849769592285,0 +5285,0.18157793581485748,0.17250405251979828,0.162933811545372,0.26999998092651367,925.1558837890625,1e-05,0.10470027476549149,2.550464630126953,23.927849769592285,0 +5286,0.16969454288482666,0.27440211176872253,0.2629636228084564,0.24333332479000092,988.0552978515625,1e-05,0.06700393557548523,2.359771966934204,23.927849769592285,0 +5287,0.17875705659389496,0.192896768450737,0.1876223236322403,0.2224999964237213,854.4303588867188,1e-05,0.0852782279253006,2.4806909561157227,23.927849769592285,0 +5288,0.2000717669725418,0.23612827062606812,0.23671799898147583,0.26980769634246826,458.8607482910156,1e-05,0.09135060757398605,2.5640580654144287,23.927849769592285,0 +5289,0.163762629032135,0.10410498082637787,0.11493729799985886,0.17618589103221893,613.5438232421875,1e-05,0.08335421979427338,2.3505632877349854,23.927849769592285,0 +5290,0.2388223260641098,0.13520315289497375,0.13144321739673615,0.19169871509075165,681.8181762695312,1e-05,0.06652907282114029,2.354670524597168,23.927849769592285,0 +5291,0.29310300946235657,0.14595408737659454,0.14762209355831146,0.2640064060688019,531.6091918945312,1e-05,0.09218531847000122,2.3534045219421387,23.927849769592285,0 +5292,0.279518723487854,0.22891965508460999,0.22493091225624084,0.19689102470874786,429.7900695800781,1e-05,0.08312983065843582,2.357896566390991,23.927849769592285,0 +5293,0.12815719842910767,0.22783330082893372,0.21675196290016174,0.24423076212406158,956.0206298828125,1e-05,0.08961139619350433,2.353102922439575,23.927849769592285,0 +5294,0.14518387615680695,0.16556750237941742,0.15929247438907623,0.19929486513137817,926.8355712890625,1e-05,0.08233343809843063,2.356325149536133,23.927849769592285,0 +5295,0.07189003378152847,0.10557317733764648,0.11388308554887772,0.27666667103767395,928.4979858398438,1e-05,0.07321072369813919,2.3562164306640625,23.927849769592285,0 +5296,0.19391173124313354,0.1684177964925766,0.15987743437290192,0.2464423030614853,793.795654296875,1e-05,0.08740249276161194,2.5986311435699463,23.927849769592285,0 +5297,0.17307689785957336,0.1856924444437027,0.1868709921836853,0.2435256391763687,698.8536376953125,1e-05,0.07525549829006195,2.4763994216918945,23.927849769592285,0 +5298,0.13104213774204254,0.19088535010814667,0.1792248785495758,0.2078525573015213,892.0389404296875,1e-05,0.09452072530984879,2.5232532024383545,23.927849769592285,0 +5299,0.17632631957530975,0.16670462489128113,0.17431733012199402,0.22525639832019806,386.7403564453125,1e-05,0.09685581177473068,2.529486894607544,23.927849769592285,0 +5300,0.23577208817005157,0.36468571424484253,0.38756972551345825,0.23663461208343506,993.2210693359375,1e-05,0.11484143137931824,2.354424238204956,23.927849769592285,0 +5301,0.17159253358840942,0.13321632146835327,0.126840740442276,0.11451922357082367,772.9007568359375,1e-05,0.07638920843601227,2.34591007232666,23.927849769592285,0 +5302,0.25056377053260803,0.15863797068595886,0.1814708709716797,0.26009613275527954,288.4615478515625,1e-05,0.10309353470802307,2.3503258228302,23.927849769592285,0 +5303,0.23657730221748352,0.6856974363327026,0.6795405745506287,0.21124999225139618,92.59259796142578,1e-05,0.06687835603952408,2.3500359058380127,23.927849769592285,0 +5304,0.18450193107128143,0.1558866947889328,0.15345311164855957,0.2493269145488739,931.1224365234375,1e-05,0.10350142419338226,2.346985101699829,23.927849769592285,0 +5305,0.07673769444227219,0.11573991924524307,0.11584246903657913,0.11092948168516159,969.9821166992188,1e-05,0.08493601530790329,2.352445125579834,23.927849769592285,0 +5306,0.09935364872217178,0.1822265386581421,0.17180673778057098,0.16759614646434784,927.5025634765625,1e-05,0.07547155767679214,2.498242139816284,23.927849769592285,0 +5307,0.18306225538253784,0.18138469755649567,0.18120186030864716,0.20666666328907013,592.105224609375,1e-05,0.09321251511573792,2.5855841636657715,23.927849769592285,0 +5308,0.1266690343618393,0.33072027564048767,0.32129645347595215,0.19701921939849854,985.1694946289062,1e-05,0.06517033278942108,2.3513364791870117,23.927849769592285,0 +5309,0.2884090840816498,0.20446975529193878,0.20776638388633728,0.21455127000808716,577.95703125,1e-05,0.08303826302289963,2.7042152881622314,23.927849769592285,0 +5310,0.26478853821754456,0.14378832280635834,0.14026670157909393,0.09576922655105591,765.50390625,1e-05,0.09562334418296814,2.3495938777923584,23.927849769592285,0 +5311,0.21430763602256775,0.2915570139884949,0.2868102192878723,0.28554487228393555,393.8356018066406,1e-05,0.0718364492058754,2.3432600498199463,23.927849769592285,0 +5312,0.12363271415233612,0.1514940708875656,0.1471935361623764,0.24108973145484924,621.2273559570312,1e-05,0.056430380791425705,2.3475306034088135,23.927849769592285,0 +5313,0.3498452603816986,0.25197967886924744,0.2406817078590393,0.25400641560554504,690.9660034179688,1e-05,0.1099601686000824,2.348942279815674,23.927849769592285,0 +5314,0.16089066863059998,0.2726810574531555,0.27381619811058044,0.2205769121646881,997.9838256835938,1e-05,0.06831961870193481,2.3451480865478516,23.927849769592285,0 +5315,0.31296515464782715,0.2327861785888672,0.2262827605009079,0.3161538243293762,576.5086669921875,1e-05,0.0764942616224289,2.346799850463867,23.927849769592285,0 +5316,0.24895766377449036,0.25855305790901184,0.24083223938941956,0.24317306280136108,998.7943115234375,1e-05,0.07020800560712814,2.3496315479278564,23.927849769592285,0 +5317,0.12922772765159607,0.12026336789131165,0.12235574424266815,0.2394871711730957,876.6427001953125,1e-05,0.19465669989585876,2.474654197692871,23.927849769592285,0 +5318,0.08260194212198257,0.37400245666503906,0.36095789074897766,0.24666665494441986,989.148681640625,1e-05,0.07615596055984497,2.5941731929779053,23.927849769592285,0 +5319,0.25015494227409363,0.0933915302157402,0.09580986946821213,0.10163461416959763,875.74853515625,1e-05,0.07669807225465775,2.579590082168579,23.927849769592285,0 +5320,0.1944408118724823,0.25326812267303467,0.255328893661499,0.26711538434028625,994.0623168945312,1e-05,0.06479982286691666,2.4755020141601562,23.927849769592285,0 +5321,0.21889233589172363,0.2297455221414566,0.223001629114151,0.2879807651042938,668.0632934570312,1e-05,0.06813768297433853,2.349522590637207,23.927849769592285,0 +5322,0.29591816663742065,0.1974565088748932,0.18289552628993988,0.25621792674064636,860.8343505859375,1e-05,0.08395759016275406,2.3469905853271484,23.927849769592285,0 +5323,0.2867881655693054,0.27617648243904114,0.27470719814300537,0.2474999874830246,427.6316223144531,1e-05,0.08200974762439728,2.345611333847046,23.927849769592285,0 +5324,0.2668382227420807,0.2124115228652954,0.2111077755689621,0.20999999344348907,823.0874633789062,1e-05,0.08498803526163101,2.3478968143463135,23.927849769592285,0 +5325,0.19014813005924225,0.2642771005630493,0.2463131844997406,0.18689101934432983,991.0935668945312,1e-05,0.07812992483377457,2.3464980125427246,23.927849769592285,0 +5326,0.20475803315639496,0.2584388554096222,0.25426244735717773,0.19756409525871277,400.81524658203125,1e-05,0.09341473132371902,2.3479232788085938,23.927849769592285,0 +5327,0.12689661979675293,0.2748928666114807,0.2636251449584961,0.2623397409915924,936.8737182617188,1e-05,0.07293400168418884,2.4730470180511475,23.927849769592285,0 +5328,0.32473573088645935,0.2012583166360855,0.19458825886249542,0.20599357783794403,985.8411254882812,1e-05,0.10698801279067993,2.357581377029419,23.927849769592285,0 +5329,0.27922073006629944,0.11676745116710663,0.11773673444986343,0.1139102503657341,730.8970947265625,1e-05,0.06824930757284164,2.7206008434295654,23.927849769592285,0 +5330,0.23842985928058624,0.3393169045448303,0.32781487703323364,0.19990384578704834,985.6176147460938,1e-05,0.11145905405282974,2.5706729888916016,23.927849769592285,0 +5331,0.09844131767749786,0.11027377843856812,0.11701720207929611,0.1696474254131317,790.4412231445312,1e-05,0.08487017452716827,2.4719934463500977,23.927849769592285,0 +5332,0.29018935561180115,0.34785929322242737,0.34265172481536865,0.25737178325653076,228.7581787109375,1e-05,0.08431471139192581,2.350701093673706,23.927849769592285,0 +5333,0.24316412210464478,0.6359860897064209,0.6324838995933533,0.198685884475708,125.89928436279297,1e-05,0.07091900706291199,2.3441927433013916,23.927849769592285,0 +5334,0.16617341339588165,0.2180667668581009,0.21219050884246826,0.22099357843399048,896.4932861328125,1e-05,0.07217987626791,2.3500218391418457,23.927849769592285,0 +5335,0.17945997416973114,0.21747726202011108,0.23507225513458252,0.15756410360336304,391.4835205078125,1e-05,0.1016637533903122,2.3474490642547607,23.927849769592285,0 +5336,0.25844067335128784,0.16158649325370789,0.15200911462306976,0.2292628139257431,857.9046020507812,1e-05,0.0958699956536293,2.3493990898132324,23.927849769592285,0 +5337,0.16625633835792542,0.36731016635894775,0.35875728726387024,0.2499999850988388,248.39744567871094,1e-05,0.08346706628799438,2.345503091812134,23.927849769592285,0 +5338,0.26363542675971985,0.16350558400154114,0.15404216945171356,0.2108333259820938,903.1631469726562,1e-05,0.08249147981405258,2.5273971557617188,23.927849769592285,0 +5339,0.16518542170524597,0.3866609036922455,0.3536251187324524,0.20326922833919525,981.7597045898438,1e-05,0.09781647473573685,2.480757236480713,23.927849769592285,0 +5340,0.14545652270317078,0.1119413748383522,0.12198266386985779,0.10602563619613647,978.0244140625,1e-05,0.06702184677124023,2.3508596420288086,23.927849769592285,0 +5341,0.12001606076955795,0.16075408458709717,0.15324746072292328,0.248653843998909,908.0963134765625,1e-05,0.0747554749250412,2.698004961013794,23.927849769592285,0 +5342,0.1960681676864624,0.24755486845970154,0.2303488850593567,0.21897435188293457,958.7605590820312,1e-05,0.07508858293294907,2.5060007572174072,23.927849769592285,0 +5343,0.13730880618095398,0.09742982685565948,0.10125903785228729,0.2777884602546692,965.3915405273438,1e-05,0.07280238717794418,2.3439443111419678,23.927849769592285,0 +5344,0.20435142517089844,0.16323669254779816,0.16304610669612885,0.2581089735031128,849.8719482421875,1e-05,0.0680885910987854,2.3439388275146484,23.927849769592285,0 +5345,0.23215948045253754,0.24243761599063873,0.2438824325799942,0.2566666603088379,994.4806518554688,1e-05,0.08123641461133957,2.3461263179779053,23.927849769592285,0 +5346,0.211042582988739,0.19327408075332642,0.18712934851646423,0.14858974516391754,928.1668090820312,1e-05,0.07114521414041519,2.347651958465576,23.927849769592285,0 +5347,0.2000492662191391,0.2679435610771179,0.26007962226867676,0.2799038290977478,682.8494262695312,1e-05,0.06957723200321198,2.3463985919952393,23.927849769592285,0 +5348,0.3338465988636017,0.17440564930438995,0.17484790086746216,0.21935896575450897,905.8369750976562,1e-05,0.09781546890735626,2.5748751163482666,23.927849769592285,0 +5349,0.13387981057167053,0.358982115983963,0.33006781339645386,0.22612178325653076,988.4937133789062,1e-05,0.08825522661209106,2.3523027896881104,23.927849769592285,0 +5350,0.15504024922847748,0.11324958503246307,0.13696108758449554,0.22362178564071655,993.0098266601562,1e-05,0.08080945909023285,2.5877652168273926,23.927849769592285,0 +5351,0.4048371911048889,0.1328243613243103,0.1295076459646225,0.10682691633701324,774.3531494140625,1e-05,0.10508366674184799,2.465860605239868,23.927849769592285,0 +5352,0.16716468334197998,0.19882863759994507,0.19005979597568512,0.1928205043077469,951.5281982421875,1e-05,0.0680520310997963,2.5821070671081543,23.927849769592285,0 +5353,0.13898205757141113,0.23516540229320526,0.22895586490631104,0.2684935927391052,669.14501953125,1e-05,0.0583004467189312,2.3573756217956543,23.927849769592285,0 +5354,0.09227780997753143,0.09161771088838577,0.08958842605352402,0.17865383625030518,894.0774536132812,1e-05,0.0701449066400528,2.3471200466156006,23.927849769592285,0 +5355,0.17618156969547272,0.1704728603363037,0.1565326750278473,0.2497115284204483,934.9798583984375,1e-05,0.0848003700375557,2.3497045040130615,23.927849769592285,0 +5356,0.19671368598937988,0.20644640922546387,0.20013922452926636,0.24384614825248718,504.1766052246094,1e-05,0.10669955611228943,2.349888801574707,23.927849769592285,0 +5357,0.15346556901931763,0.19467097520828247,0.18082211911678314,0.24400639533996582,967.4503784179688,1e-05,0.07440336793661118,2.350867748260498,23.927849769592285,0 +5358,0.1897842437028885,0.20573203265666962,0.20264098048210144,0.24983973801136017,592.105224609375,1e-05,0.07029598951339722,2.354801893234253,23.927849769592285,0 +5359,0.20375663042068481,0.3057038486003876,0.30563798546791077,0.2616666555404663,444.587646484375,1e-05,0.08133682608604431,2.539231777191162,23.927849769592285,0 +5360,0.1714472621679306,0.21329018473625183,0.21504348516464233,0.22477562725543976,448.71795654296875,1e-05,0.07152152061462402,2.357745409011841,23.927849769592285,0 +5361,0.13123367726802826,0.14348360896110535,0.14172779023647308,0.2356410175561905,757.0978393554688,1e-05,0.07751674205064774,2.4774489402770996,23.927849769592285,0 +5362,0.2723928391933441,0.1977253258228302,0.20023764669895172,0.28285256028175354,536.5296630859375,1e-05,0.08130646497011185,2.5922117233276367,23.927849769592285,0 +5363,0.13629890978336334,0.15132908523082733,0.1505487710237503,0.11157050728797913,640.8381958007812,1e-05,0.06876832991838455,2.577709674835205,23.927849769592285,0 +5364,0.2840625047683716,0.4451208710670471,0.4535662829875946,0.2131730616092682,235.38963317871094,1e-05,0.09070990234613419,2.3554320335388184,23.927849769592285,0 +5365,0.16123616695404053,0.1525612473487854,0.15202699601650238,0.28996792435646057,858.3959350585938,1e-05,0.06951118260622025,2.3477375507354736,23.927849769592285,0 +5366,0.2615284025669098,0.16012521088123322,0.15803112089633942,0.23887819051742554,623.7474975585938,1e-05,0.07729267328977585,2.349541664123535,23.927849769592285,0 +5367,0.2330121099948883,0.20935876667499542,0.18673735857009888,0.25041666626930237,874.8499145507812,1e-05,0.07078099250793457,2.3519906997680664,23.927849769592285,0 +5368,0.17098253965377808,0.12886033952236176,0.13074736297130585,0.1898076832294464,808.6157836914062,1e-05,0.06406357884407043,2.351863384246826,23.927849769592285,0 +5369,0.0925842672586441,0.10236940532922745,0.1054033562541008,0.15028846263885498,756.319091796875,1e-05,0.07853134721517563,2.5698559284210205,23.927849769592285,0 +5370,0.24142244458198547,0.10587257891893387,0.11106280237436295,0.24858973920345306,847.2938232421875,1e-05,0.07488024234771729,2.3544275760650635,23.927849769592285,0 +5371,0.12421116232872009,0.20132307708263397,0.201240673661232,0.16650640964508057,921.3984985351562,1e-05,0.06658083200454712,2.5027501583099365,23.927849769592285,0 +5372,0.2320248931646347,0.1906607300043106,0.17930400371551514,0.2587820291519165,915.7753295898438,1e-05,0.0918542891740799,2.3541581630706787,23.927849769592285,0 +5373,0.17795273661613464,0.26499080657958984,0.26231780648231506,0.25304487347602844,462.8463439941406,1e-05,0.07392631471157074,2.6659090518951416,23.927849769592285,0 +5374,0.19070303440093994,0.2558414936065674,0.24847367405891418,0.25189101696014404,560.154541015625,1e-05,0.07235632836818695,2.466339349746704,23.927849769592285,0 +5375,0.25197526812553406,0.20981502532958984,0.19996331632137299,0.1347435861825943,965.6505737304688,1e-05,0.07447823882102966,2.349806308746338,23.927849769592285,0 +5376,0.2698148488998413,0.21297529339790344,0.21530653536319733,0.2209615260362625,934.9798583984375,1e-05,0.07643993943929672,2.349829912185669,23.927849769592285,0 +5377,0.19040650129318237,0.1287359893321991,0.12845417857170105,0.28237178921699524,706.521728515625,1e-05,0.0682346522808075,2.3442604541778564,23.927849769592285,0 +5378,0.2114628255367279,0.28154870867729187,0.2864812910556793,0.26807692646980286,989.5833129882812,1e-05,0.07296399027109146,2.3476409912109375,23.927849769592285,0 +5379,0.25361010432243347,0.12647713720798492,0.135752871632576,0.22644229233264923,866.0933227539062,1e-05,0.07689017802476883,2.4355783462524414,23.927849769592285,0 +5380,0.13523772358894348,0.22447411715984344,0.21940772235393524,0.21426281332969666,957.6707763671875,1e-05,0.06081356480717659,2.357320547103882,23.927849769592285,0 +5381,0.1567355841398239,0.2110283523797989,0.21546757221221924,0.22833332419395447,560.154541015625,1e-05,0.06533131748437881,2.348830223083496,23.927849769592285,0 +5382,0.16156047582626343,0.22053687274456024,0.20086362957954407,0.21849358081817627,907.3464965820312,1e-05,0.07889653742313385,2.6626856327056885,23.927849769592285,0 +5383,0.17277008295059204,0.13244961202144623,0.12599579989910126,0.22070512175559998,831.0991821289062,1e-05,0.07595109939575195,2.485854387283325,23.927849769592285,0 +5384,0.1395174264907837,0.13090452551841736,0.1395118534564972,0.21666665375232697,909.21484375,1e-05,0.07069393247365952,2.4772205352783203,23.927849769592285,0 +5385,0.24285396933555603,0.1302804797887802,0.13412250578403473,0.19471153616905212,633.6292114257812,1e-05,0.05543864890933037,2.584336042404175,23.927849769592285,0 +5386,0.19748611748218536,0.19559426605701447,0.19686326384544373,0.18166665732860565,797.1013793945312,1e-05,0.06564583629369736,2.346834182739258,23.927849769592285,0 +5387,0.17361968755722046,0.13999877870082855,0.14186805486679077,0.24782049655914307,714.8972778320312,1e-05,0.08730816096067429,2.3454580307006836,23.927849769592285,0 +5388,0.24191680550575256,0.16962279379367828,0.16303126513957977,0.18182691931724548,685.9205932617188,1e-05,0.07118100672960281,2.349545955657959,23.927849769592285,0 +5389,0.1440940797328949,0.24054144322872162,0.2321937531232834,0.1437179446220398,973.6957397460938,1e-05,0.07423107326030731,2.3427646160125732,23.927849769592285,0 +5390,0.17963729798793793,0.4779909551143646,0.43275952339172363,0.2525961399078369,999.7998046875,1e-05,0.05922761186957359,2.5606231689453125,23.927849769592285,0 +5391,0.3060559928417206,0.17487138509750366,0.1695035994052887,0.24474358558654785,662.593994140625,1e-05,0.08031771332025528,2.3434221744537354,23.927849769592285,0 +5392,0.36780598759651184,0.4214017987251282,0.4329524636268616,0.2667948603630066,179.79454040527344,1e-05,0.08658131211996078,2.4661223888397217,23.927849769592285,0 +5393,0.1483866274356842,0.3484342098236084,0.3163577914237976,0.1480448693037033,997.168212890625,1e-05,0.06669623404741287,2.3549513816833496,23.927849769592285,0 +5394,0.30322182178497314,0.25108227133750916,0.24835897982120514,0.2172115296125412,564.6929931640625,1e-05,0.0865018293261528,2.521535873413086,23.927849769592285,0 +5395,0.23594270646572113,0.15720468759536743,0.1476583182811737,0.30214741826057434,738.5433959960938,1e-05,0.07124273478984833,2.515934944152832,23.927849769592285,0 +5396,0.23525801301002502,0.2969423830509186,0.3456677198410034,0.21820512413978577,125.89928436279297,1e-05,0.06732706725597382,2.3543941974639893,23.927849769592285,0 +5397,0.236011803150177,0.7499249577522278,0.7611883878707886,0.2006089687347412,66.28787994384766,1e-05,0.06934957206249237,2.3482518196105957,23.927849769592285,0 +5398,0.18898750841617584,0.12640775740146637,0.12610730528831482,0.1760256290435791,940.287353515625,1e-05,0.07259328663349152,2.3454790115356445,23.927849769592285,0 +5399,0.1245824545621872,0.0826156958937645,0.08441675454378128,0.02211538329720497,975.3954467773438,1e-05,0.0723479613661766,2.3464200496673584,23.927849769592285,0 +5400,0.27200770378112793,0.16720513999462128,0.15708115696907043,0.2710256278514862,888.3101196289062,1e-05,0.07030817866325378,2.3458573818206787,23.927849769592285,0 +5401,0.23885725438594818,0.2118716686964035,0.20069891214370728,0.226666659116745,882.784912109375,1e-05,0.07864691317081451,2.467562198638916,23.927849769592285,0 +5402,0.09773509204387665,0.13646720349788666,0.13480837643146515,0.20499999821186066,905.0772094726562,1e-05,0.0632263571023941,2.3482601642608643,23.927849769592285,0 +5403,0.1637992262840271,0.10523062944412231,0.1010490283370018,0.1449679434299469,815.9722900390625,1e-05,0.0754685252904892,2.509922981262207,23.927849769592285,0 +5404,0.29050469398498535,0.20158813893795013,0.19180728495121002,0.2533012628555298,970.48291015625,1e-05,0.07107707113027573,2.3493974208831787,23.927849769592285,0 +5405,0.12777076661586761,0.39890849590301514,0.3788888156414032,0.2959294617176056,989.8002319335938,1e-05,0.07127785682678223,2.670654773712158,23.927849769592285,0 +5406,0.2694455683231354,0.20974363386631012,0.206781804561615,0.3066987097263336,977.787353515625,1e-05,0.06819144636392593,2.480316162109375,23.927849769592285,0 +5407,0.33496028184890747,0.5776817798614502,0.5855593085289001,0.2760256230831146,113.63636016845703,1e-05,0.08481316268444061,2.351571798324585,23.927849769592285,0 +5408,0.250632643699646,0.20492281019687653,0.2153620570898056,0.18314102292060852,610.940673828125,1e-05,0.06295958906412125,2.343043565750122,23.927849769592285,0 +5409,0.14823980629444122,0.12801547348499298,0.1257047951221466,0.16346153616905212,908.0963134765625,1e-05,0.067787766456604,2.3466567993164062,23.927849769592285,0 +5410,0.20966428518295288,0.3130306005477905,0.3056039810180664,0.2753525674343109,572.1257934570312,1e-05,0.0877886712551117,2.3467421531677246,23.927849769592285,0 +5411,0.24653664231300354,0.1755693256855011,0.16089192032814026,0.2869230806827545,793.128662109375,1e-05,0.07255289703607559,2.4635238647460938,23.927849769592285,0 +5412,0.2490554004907608,0.09126986563205719,0.09570547938346863,0.08967948704957962,838.8157958984375,1e-05,0.06918811798095703,2.3518779277801514,23.927849769592285,0 +5413,0.21157221496105194,0.1194315031170845,0.11211057752370834,0.1844230741262436,855.4293212890625,1e-05,0.06481076776981354,2.564714193344116,23.927849769592285,0 +5414,0.208708718419075,0.17974554002285004,0.1796969324350357,0.11631409823894501,959.0316162109375,1e-05,0.07048800587654114,2.3577911853790283,23.927849769592285,0 +5415,0.26474258303642273,0.2679150402545929,0.2866505980491638,0.1703205108642578,344.2029113769531,1e-05,0.06773976236581802,2.4408583641052246,23.927849769592285,0 +5416,0.18182244896888733,0.19827447831630707,0.1927109658718109,0.25544869899749756,485.94134521484375,1e-05,0.05960085988044739,2.6228601932525635,23.927849769592285,0 +5417,0.20513726770877838,0.07328011095523834,0.07940217107534409,0.17243589460849762,675.5514526367188,1e-05,0.06269731372594833,2.360337495803833,23.927849769592285,0 +5418,0.12765732407569885,0.5157843232154846,0.47542229294776917,0.29317307472229004,994.6895141601562,1e-05,0.054428353905677795,2.3442091941833496,23.927849769592285,0 +5419,0.2444239854812622,0.24263997375965118,0.22938814759254456,0.19842948019504547,915.4175415039062,1e-05,0.07447326183319092,2.3444018363952637,23.927849769592285,0 +5420,0.19140446186065674,0.21433709561824799,0.20992691814899445,0.20384614169597626,669.14501953125,1e-05,0.06128868833184242,2.3449409008026123,23.927849769592285,0 +5421,0.19590912759304047,0.24585780501365662,0.23205281794071198,0.21907050907611847,938.7450561523438,1e-05,0.05988069623708725,2.3472213745117188,23.927849769592285,0 +5422,0.2778964340686798,0.34995022416114807,0.3519412577152252,0.247307687997818,300.1519775390625,1e-05,0.0782557800412178,2.4688737392425537,23.927849769592285,0 +5423,0.1535205841064453,0.16083064675331116,0.15732978284358978,0.2403525561094284,882.3529052734375,1e-05,0.06787772476673126,2.348210096359253,23.927849769592285,0 +5424,0.14952440559864044,0.18110571801662445,0.18415339291095734,0.2764102518558502,466.7919921875,1e-05,0.07362532615661621,2.608757972717285,23.927849769592285,0 +5425,0.22458568215370178,0.108553946018219,0.11869779974222183,0.1831730753183365,425.4617614746094,1e-05,0.07619626075029373,2.3555688858032227,23.927849769592285,0 +5426,0.17179511487483978,0.24010486900806427,0.2353285253047943,0.23519229888916016,668.0632934570312,1e-05,0.09425599873065948,2.4826841354370117,23.927849769592285,0 +5427,0.24327464401721954,0.8364002704620361,0.8349891304969788,0.22266024351119995,34.046695709228516,1e-05,0.06966941058635712,2.5768887996673584,23.927849769592285,0 +5428,0.2441723644733429,0.16840730607509613,0.1781919002532959,0.21458332240581512,429.7900695800781,1e-05,0.11013252288103104,2.358381748199463,23.927849769592285,0 +5429,0.3063632845878601,0.171190544962883,0.1694224327802658,0.2581730782985687,725.671142578125,1e-05,0.06351786106824875,2.3585116863250732,23.927849769592285,0 +5430,0.30800339579582214,0.25885072350502014,0.2652544379234314,0.22999998927116394,992.374267578125,1e-05,0.08542849123477936,2.356006145477295,23.927849769592285,0 +5431,0.20522551238536835,0.21382424235343933,0.21416115760803223,0.26538461446762085,665.8878784179688,1e-05,0.06090838462114334,2.3610424995422363,23.927849769592285,0 +5432,0.2244434803724289,0.12907084822654724,0.12711021304130554,0.1839423030614853,877.9761962890625,1e-05,0.071551613509655,2.4720537662506104,23.927849769592285,0 +5433,0.14686743915081024,0.16932842135429382,0.1679612100124359,0.25939100980758667,964.872314453125,1e-05,0.06589098274707794,2.367675542831421,23.927849769592285,0 +5434,0.2191045731306076,0.09323661029338837,0.09819894284009933,0.291858971118927,947.4830322265625,1e-05,0.08674421906471252,2.358097553253174,23.927849769592285,0 +5435,0.23146465420722961,0.3465932607650757,0.36239567399024963,0.21205127239227295,344.2029113769531,1e-05,0.07346121221780777,2.8044612407684326,23.927849769592285,0 +5436,0.2736108601093292,0.12621861696243286,0.13808703422546387,0.25025638937950134,665.8878784179688,1e-05,0.08141683042049408,2.3546268939971924,23.927849769592285,0 +5437,0.14008814096450806,0.14935877919197083,0.1500251740217209,0.21391025185585022,816.57421875,1e-05,0.06830348074436188,2.5394845008850098,23.927849769592285,0 +5438,0.2327364683151245,0.1925133466720581,0.1961425393819809,0.2566666603088379,521.561767578125,1e-05,0.07928446680307388,2.5339343547821045,23.927849769592285,0 +5439,0.2694432735443115,0.09247457981109619,0.095520980656147,0.08855769038200378,575.0540771484375,1e-05,0.07562349736690521,2.3506951332092285,23.927849769592285,0 +5440,0.18247969448566437,0.21259881556034088,0.2153731733560562,0.1638782024383545,992.374267578125,1e-05,0.06349070370197296,2.3515639305114746,23.927849769592285,0 +5441,0.14523088932037354,0.25952908396720886,0.25820058584213257,0.1726602464914322,974.4267578125,1e-05,0.06146755814552307,2.350292921066284,23.927849769592285,0 +5442,0.2027459293603897,0.13615651428699493,0.12871219217777252,0.19249999523162842,859.8626708984375,1e-05,0.07664288580417633,2.357042074203491,23.927849769592285,0 +5443,0.23832416534423828,0.1170591413974762,0.11680074781179428,0.2234935760498047,664.7939453125,1e-05,0.07212279736995697,2.464484453201294,23.927849769592285,0 +5444,0.14165213704109192,0.15626412630081177,0.15907949209213257,0.303846150636673,752.3885498046875,1e-05,0.07453878968954086,2.3559274673461914,23.927849769592285,0 +5445,0.13434132933616638,0.0865512490272522,0.08495166897773743,0.162820503115654,684.9005737304688,1e-05,0.06897709518671036,2.6047966480255127,23.927849769592285,0 +5446,0.1761370599269867,0.3061034679412842,0.3006921410560608,0.20461538434028625,344.2029113769531,1e-05,0.06822594255208969,2.3597538471221924,23.927849769592285,0 +5447,0.24706068634986877,0.10095232725143433,0.10016100853681564,0.09464742988348007,623.7474975585938,1e-05,0.06186385080218315,2.482835054397583,23.927849769592285,0 +5448,0.2487967312335968,0.146395742893219,0.14143942296504974,0.16730768978595734,760.95458984375,1e-05,0.074949711561203,2.4702529907226562,23.927849769592285,0 +5449,0.12392677366733551,0.13195548951625824,0.14297069609165192,0.2639102339744568,924.81787109375,1e-05,0.08391539007425308,2.3717989921569824,23.927849769592285,0 +5450,0.13718359172344208,0.16134953498840332,0.169549822807312,0.25778844952583313,961.4497680664062,1e-05,0.06357220560312271,2.3482062816619873,23.927849769592285,0 +5451,0.16346046328544617,0.2442815899848938,0.22940362989902496,0.26211538910865784,880.6146240234375,1e-05,0.06700774282217026,2.350048303604126,23.927849769592285,0 +5452,0.0787598043680191,0.25358763337135315,0.2412794679403305,0.17455127835273743,934.6619262695312,1e-05,0.07259166240692139,2.3480515480041504,23.927849769592285,0 +5453,0.08399339020252228,0.4502020478248596,0.4249112010002136,0.22740383446216583,997.5768432617188,1e-05,0.06687350571155548,2.469844102859497,23.927849769592285,0 +5454,0.172186017036438,0.1723499447107315,0.17359457910060883,0.22208333015441895,708.4055786132812,1e-05,0.07761776447296143,2.3607943058013916,23.927849769592285,0 +5455,0.21401473879814148,0.24199806153774261,0.22662556171417236,0.23541665077209473,973.2064208984375,1e-05,0.06951333582401276,2.484718084335327,23.927849769592285,0 +5456,0.24779365956783295,0.10259980708360672,0.11135241389274597,0.24919870495796204,775.796630859375,1e-05,0.07947023957967758,2.585768699645996,23.927849769592285,0 +5457,0.15665492415428162,0.2447269856929779,0.2379441112279892,0.250576913356781,972.7151489257812,1e-05,0.07711295783519745,2.3461318016052246,23.927849769592285,0 +5458,0.13160814344882965,0.1727656126022339,0.17218351364135742,0.24849358201026917,809.2384033203125,1e-05,0.06242542341351509,2.8033180236816406,23.927849769592285,0 +5459,0.42622116208076477,0.22893641889095306,0.22928062081336975,0.2140384465456009,464.8240966796875,1e-05,0.08148875087499619,2.4841794967651367,23.927849769592285,0 +5460,0.18011698126792908,0.125223770737648,0.13022653758525848,0.24288460612297058,727.4247436523438,1e-05,0.15062059462070465,2.354226589202881,23.927849769592285,0 +5461,0.1326553374528885,0.1770029217004776,0.17322827875614166,0.1422756314277649,830.5369873046875,1e-05,0.06825155764818192,2.358290195465088,23.927849769592285,0 +5462,0.13603156805038452,0.18570448458194733,0.18510562181472778,0.18993589282035828,925.1558837890625,1e-05,0.06432261317968369,2.3615243434906006,23.927849769592285,0 +5463,0.24846476316452026,0.15556035935878754,0.15077108144760132,0.25778844952583313,821.3306274414062,1e-05,0.08188235759735107,2.3587048053741455,23.927849769592285,0 +5464,0.24177145957946777,0.14449891448020935,0.1505187302827835,0.2401602417230606,884.5029296875,1e-05,0.06397801637649536,2.566140651702881,23.927849769592285,0 +5465,0.1845141351222992,0.3361269235610962,0.32983240485191345,0.22980768978595734,319.94049072265625,1e-05,0.08293340355157852,2.3694539070129395,23.927849769592285,0 +5466,0.25180506706237793,0.21748918294906616,0.21188293397426605,0.21477563679218292,855.9268798828125,1e-05,0.07557254284620285,2.571539878845215,23.927849769592285,0 +5467,0.25883686542510986,0.1730261594057083,0.17287230491638184,0.23432691395282745,925.8298950195312,1e-05,0.07669488340616226,2.490593671798706,23.927849769592285,0 +5468,0.209331676363945,0.38481405377388,0.40126025676727295,0.18541665375232697,176.11683654785156,1e-05,0.07892857491970062,2.3557121753692627,23.927849769592285,0 +5469,0.24799010157585144,0.227355495095253,0.22588451206684113,0.22480767965316772,971.23095703125,1e-05,0.07190253585577011,2.4900310039520264,23.927849769592285,0 +5470,0.29482296109199524,0.1938607096672058,0.1903909593820572,0.18871794641017914,629.9603271484375,1e-05,0.06890992820262909,2.472972869873047,23.927849769592285,0 +5471,0.17371830344200134,0.27874836325645447,0.28676119446754456,0.3015384376049042,270.376220703125,1e-05,0.06812499463558197,2.357609987258911,23.927849769592285,0 +5472,0.19807793200016022,0.15814580023288727,0.15492458641529083,0.22913460433483124,708.4055786132812,1e-05,0.0723944753408432,2.3524301052093506,23.927849769592285,0 +5473,0.2956816852092743,0.17826887965202332,0.17935200035572052,0.20695511996746063,885.3558349609375,1e-05,0.08164255321025848,2.354684352874756,23.927849769592285,0 +5474,0.11351828277111053,0.14513356983661652,0.14227734506130219,0.24666665494441986,909.9564819335938,1e-05,0.06711265444755554,2.3484878540039062,23.927849769592285,0 +5475,0.20996801555156708,0.1748683601617813,0.17410320043563843,0.16099359095096588,511.2293395996094,1e-05,0.09110122919082642,2.4768733978271484,23.927849769592285,0 +5476,0.33570098876953125,0.36038702726364136,0.38456279039382935,0.1931089609861374,300.1519775390625,1e-05,0.0868690088391304,2.3614306449890137,23.927849769592285,0 +5477,0.17350834608078003,0.34889236092567444,0.3346327543258667,0.2689102590084076,983.36181640625,1e-05,0.05770697817206383,2.6131229400634766,23.927849769592285,0 +5478,0.23138195276260376,0.11930155754089355,0.13135778903961182,0.19439101219177246,949.22998046875,1e-05,0.08035169541835785,2.35443377494812,23.927849769592285,0 +5479,0.17580074071884155,0.3068799376487732,0.33214256167411804,0.2619551122188568,204.84951782226562,1e-05,0.06510625779628754,2.4920825958251953,23.927849769592285,0 +5480,0.29602447152137756,0.22089406847953796,0.21996073424816132,0.17499999701976776,655.8935546875,1e-05,0.07180511206388474,2.4715428352355957,23.927849769592285,0 +5481,0.28671813011169434,0.34279870986938477,0.3522222638130188,0.19089743494987488,288.4615478515625,1e-05,0.07560336589813232,2.5098471641540527,23.927849769592285,0 +5482,0.12815973162651062,0.30863988399505615,0.30077823996543884,0.2050640881061554,966.4247436523438,1e-05,0.06330686062574387,2.3487675189971924,23.927849769592285,0 +5483,0.2354251891374588,0.23481708765029907,0.24625569581985474,0.26807692646980286,984.7198486328125,1e-05,0.07087797671556473,2.3450870513916016,23.927849769592285,0 +5484,0.26881080865859985,0.17571447789669037,0.16958515346050262,0.23217947781085968,898.8763427734375,1e-05,0.0661674439907074,2.3425486087799072,23.927849769592285,0 +5485,0.20090240240097046,0.19390816986560822,0.19000446796417236,0.25788459181785583,670.22265625,1e-05,0.07211631536483765,2.346771717071533,23.927849769592285,0 +5486,0.23535653948783875,0.21046312153339386,0.21952460706233978,0.18224358558654785,621.2273559570312,1e-05,0.07798396795988083,2.5616652965545654,23.927849769592285,0 +5487,0.24586910009384155,0.3281347155570984,0.32141268253326416,0.2525961399078369,491.5048522949219,1e-05,0.08177125453948975,2.353403091430664,23.927849769592285,0 +5488,0.1645067185163498,0.13320845365524292,0.12664224207401276,0.23519229888916016,887.0499877929688,1e-05,0.06417866051197052,2.5061428546905518,23.927849769592285,0 +5489,0.1947769820690155,0.2298302799463272,0.22209259867668152,0.14923076331615448,886.6278686523438,1e-05,0.06688195466995239,2.3526999950408936,23.927849769592285,0 +5490,0.1393279880285263,0.24168743193149567,0.2224482297897339,0.25448715686798096,943.62744140625,1e-05,0.07111310958862305,2.527021646499634,23.927849769592285,0 +5491,0.2633472979068756,0.07178474217653275,0.07714112102985382,0.2971474230289459,806.1080322265625,1e-05,0.08079319447278976,2.458530902862549,23.927849769592285,0 +5492,0.14734746515750885,0.28165483474731445,0.2842290699481964,0.19711537659168243,973.6957397460938,1e-05,0.07012167572975159,2.3550808429718018,23.927849769592285,0 +5493,0.17703378200531006,0.27572745084762573,0.2941615879535675,0.14397434890270233,285.49383544921875,1e-05,0.06470665335655212,2.3522772789001465,23.927849769592285,0 +5494,0.27575424313545227,0.2680054306983948,0.25881776213645935,0.23038460314273834,644.3798828125,1e-05,0.08054480701684952,2.34744930267334,23.927849769592285,0 +5495,0.309162974357605,0.18787351250648499,0.1839202344417572,0.2292628139257431,966.1671142578125,1e-05,0.07659183442592621,2.3545634746551514,23.927849769592285,0 +5496,0.13517458736896515,0.19388557970523834,0.18080775439739227,0.24384614825248718,903.9313354492188,1e-05,0.07271873205900192,2.4638290405273438,23.927849769592285,0 +5497,0.1377250850200653,0.1689821034669876,0.1581428050994873,0.25939100980758667,871.670654296875,1e-05,0.06684643775224686,2.3664140701293945,23.927849769592285,0 +5498,0.1499040424823761,0.17646123468875885,0.166276752948761,0.2940064072608948,668.0632934570312,1e-05,0.07205774635076523,2.3604860305786133,23.927849769592285,0 +5499,0.28386834263801575,0.18047064542770386,0.17801381647586823,0.14230768382549286,825.4075927734375,1e-05,0.07974898815155029,2.5133543014526367,23.927849769592285,0 +5500,0.28885379433631897,0.16273239254951477,0.1599416583776474,0.1666666567325592,592.105224609375,1e-05,0.08051242679357529,2.3559718132019043,23.927849769592285,0 +5501,0.2178441882133484,0.17833659052848816,0.1692599058151245,0.24105767905712128,795.1236572265625,1e-05,0.08304844796657562,2.6694135665893555,23.927849769592285,0 +5502,0.16322320699691772,0.121458500623703,0.1274770200252533,0.18583332002162933,954.3519897460938,1e-05,0.06881378591060638,2.62343168258667,23.927849769592285,0 +5503,0.1706165373325348,0.18878360092639923,0.1855180710554123,0.2509615421295166,957.39697265625,1e-05,0.07290530949831009,2.3490655422210693,23.927849769592285,0 +5504,0.2282339185476303,0.5797263979911804,0.5717161297798157,0.22451922297477722,164.93057250976562,1e-05,0.07010279595851898,2.3486242294311523,23.927849769592285,0 +5505,0.24266065657138824,0.18023093044757843,0.176981121301651,0.27493590116500854,558.6282348632812,1e-05,0.07319913059473038,2.348633050918579,23.927849769592285,0 +5506,0.1861555278301239,0.18559488654136658,0.177875354886055,0.08147435635328293,956.0206298828125,1e-05,0.06633445620536804,2.3548920154571533,23.927849769592285,0 +5507,0.2577967643737793,0.48547154664993286,0.49629586935043335,0.19900640845298767,161.1498260498047,1e-05,0.0767449215054512,2.580753803253174,23.927849769592285,0 +5508,0.2090911567211151,0.20612886548042297,0.21680115163326263,0.26173076033592224,418.88299560546875,1e-05,0.06178995966911316,2.3547096252441406,23.927849769592285,0 +5509,0.10336065292358398,0.43573975563049316,0.432442307472229,0.08913461118936539,993.4319458007812,1e-05,0.06620916724205017,2.607038974761963,23.927849769592285,0 +5510,0.18060408532619476,0.055091340094804764,0.062476128339767456,0.21631409227848053,905.4575805664062,1e-05,0.07240220904350281,2.357081413269043,23.927849769592285,0 +5511,0.2875709533691406,0.18638116121292114,0.18434832990169525,0.11798076331615448,594.86376953125,1e-05,0.08396709710359573,2.4910504817962646,23.927849769592285,0 +5512,0.26099979877471924,0.27320513129234314,0.26780569553375244,0.16448716819286346,963.8278198242188,1e-05,0.07774943113327026,2.504584789276123,23.927849769592285,0 +5513,0.2978719174861908,0.1842171996831894,0.1859169602394104,0.2756410241127014,736.8637084960938,1e-05,0.06647559255361557,2.4994192123413086,23.927849769592285,0 +5514,0.15504947304725647,0.19640012085437775,0.18688976764678955,0.241891011595726,931.447509765625,1e-05,0.06261229515075684,2.3561673164367676,23.927849769592285,0 +5515,0.11225815862417221,0.18235397338867188,0.1669563204050064,0.22519229352474213,839.3560791015625,1e-05,0.06603264063596725,2.344743251800537,23.927849769592285,0 +5516,0.07249923050403595,0.18296021223068237,0.18190062046051025,0.165512815117836,956.2970581054688,1e-05,0.06049274653196335,2.3469202518463135,23.927849769592285,0 +5517,0.23885130882263184,0.16743797063827515,0.1557823270559311,0.18121793866157532,664.7939453125,1e-05,0.06759220361709595,2.346963882446289,23.927849769592285,0 +5518,0.18111935257911682,0.2093605250120163,0.20090414583683014,0.20173075795173645,961.1829223632812,1e-05,0.07488580048084259,2.535595178604126,23.927849769592285,0 +5519,0.1709144413471222,0.24379080533981323,0.2278919816017151,0.21631409227848053,966.4247436523438,1e-05,0.07480461150407791,2.5923430919647217,23.927849769592285,0 +5520,0.13057899475097656,0.15618136525154114,0.15300460159778595,0.24833332002162933,900.8379516601562,1e-05,0.0654154047369957,2.5791304111480713,23.927849769592285,0 +5521,0.25250640511512756,0.44469550251960754,0.4392758309841156,0.19487178325653076,367.23162841796875,1e-05,0.07855620980262756,2.355668544769287,23.927849769592285,0 +5522,0.12477551400661469,0.10903062671422958,0.11554604023694992,0.16891025006771088,791.788818359375,1e-05,0.06426183879375458,2.5736582279205322,23.927849769592285,0 +5523,0.2875942289829254,0.2205123007297516,0.2223314344882965,0.20884615182876587,485.94134521484375,1e-05,0.07929666340351105,2.531904935836792,23.927849769592285,0 +5524,0.17885105311870575,0.2210531234741211,0.2144312560558319,0.19041666388511658,925.4932250976562,1e-05,0.07365722954273224,2.357151746749878,23.927849769592285,0 +5525,0.14426098763942719,0.25121694803237915,0.2371809035539627,0.2632051110267639,908.4699096679688,1e-05,0.07522077858448029,2.3499906063079834,23.927849769592285,0 +5526,0.1042785719037056,0.11097479611635208,0.11182091385126114,0.2172115296125412,976.1173706054688,1e-05,0.070554718375206,2.3473896980285645,23.927849769592285,0 +5527,0.2878505289554596,0.19618980586528778,0.21471205353736877,0.13076922297477722,325.4438171386719,1e-05,0.10137959569692612,2.3465869426727295,23.927849769592285,0 +5528,0.1678810864686966,0.1960996389389038,0.19572024047374725,0.2316666543483734,869.8297119140625,1e-05,0.061418965458869934,2.5597341060638428,23.927849769592285,0 +5529,0.17442753911018372,0.20728017389774323,0.19734416902065277,0.276442289352417,935.9296264648438,1e-05,0.06716311722993851,2.3574774265289307,23.927849769592285,0 +5530,0.17076629400253296,0.13092757761478424,0.13356135785579681,0.2574038505554199,908.0963134765625,1e-05,0.07254569232463837,2.461150646209717,23.927849769592285,0 +5531,0.25702667236328125,0.25207218527793884,0.24688424170017242,0.21266025304794312,921.3984985351562,1e-05,0.07724101096391678,2.529703140258789,23.927849769592285,0 +5532,0.22430597245693207,0.22953549027442932,0.22899529337882996,0.3077884614467621,504.1766052246094,1e-05,0.08102601021528244,2.471135139465332,23.927849769592285,0 +5533,0.19276319444179535,0.9996064901351929,1.0044082403182983,0.2008974254131317,4.9800801277160645,1e-05,0.0630064532160759,2.475109577178955,23.927849769592285,0 +5534,0.24745342135429382,0.1670040488243103,0.16322702169418335,0.08782050758600235,949.5192260742188,1e-05,0.07645078003406525,2.535930871963501,23.927849769592285,0 +5535,0.20082888007164001,0.1763172596693039,0.16237391531467438,0.21974357962608337,878.85986328125,1e-05,0.08502818644046783,2.3569724559783936,23.927849769592285,0 +5536,0.2591830790042877,0.22119151055812836,0.21337802708148956,0.28506410121917725,957.39697265625,1e-05,0.07529066503047943,2.352196216583252,23.927849769592285,0 +5537,0.22877275943756104,0.5965465903282166,0.6052100658416748,0.18775640428066254,66.28787994384766,1e-05,0.06948000192642212,2.3512051105499268,23.927849769592285,0 +5538,0.11208596080541611,0.1575392186641693,0.15520885586738586,0.22230768203735352,914.6995849609375,1e-05,0.06352847069501877,2.459984064102173,23.927849769592285,0 +5539,0.15085911750793457,0.17306357622146606,0.15921463072299957,0.26961538195610046,838.2740478515625,1e-05,0.06113481894135475,2.367398262023926,23.927849769592285,0 +5540,0.27365899085998535,0.2582319676876068,0.251038521528244,0.30522435903549194,954.3519897460938,1e-05,0.0946630984544754,2.352886199951172,23.927849769592285,0 +5541,0.2186448574066162,0.122129887342453,0.11997857689857483,0.3050961494445801,589.323486328125,1e-05,0.07246709614992142,2.594686269760132,23.927849769592285,0 +5542,0.19757840037345886,0.18959590792655945,0.1919407695531845,0.2068910151720047,735.1730346679688,1e-05,0.06534253060817719,2.3659956455230713,23.927849769592285,0 +5543,0.13694585859775543,0.2632138431072235,0.2612583339214325,0.19073717296123505,951.8129272460938,1e-05,0.06324418634176254,2.6117939949035645,23.927849769592285,0 +5544,0.2768084406852722,0.46487703919410706,0.4620956480503082,0.25996795296669006,208.3333282470703,1e-05,0.09318830072879791,2.3700225353240967,23.927849769592285,0 +5545,0.17256084084510803,0.20097878575325012,0.2079443782567978,0.17974358797073364,598.9583129882812,1e-05,0.08969729393720627,2.5038485527038574,23.927849769592285,0 +5546,0.13256995379924774,0.8501063585281372,0.8553478121757507,0.13759614527225494,48.076927185058594,1e-05,0.058426421135663986,2.3559651374816895,23.927849769592285,0 +5547,0.29330965876579285,0.08008650690317154,0.08562707901000977,0.2074679434299469,732.615966796875,1e-05,0.09953953325748444,2.3538107872009277,23.927849769592285,0 +5548,0.3421217203140259,0.23723547160625458,0.2420034557580948,0.1638782024383545,241.93548583984375,1e-05,0.09785652905702591,2.3556737899780273,23.927849769592285,0 +5549,0.1416212022304535,0.11115369200706482,0.1102469339966774,0.07865384221076965,767.0015869140625,1e-05,0.07092645019292831,2.564213514328003,23.927849769592285,0 +5550,0.188345804810524,0.11071130633354187,0.11386453360319138,0.2608974277973175,701.75439453125,1e-05,0.0805690735578537,2.3551578521728516,23.927849769592285,0 +5551,0.16330769658088684,0.12575873732566833,0.12691782414913177,0.24214743077754974,875.74853515625,1e-05,0.09354403614997864,2.4758970737457275,23.927849769592285,0 +5552,0.14698949456214905,0.13200488686561584,0.12927226722240448,0.10624999552965164,778.6576538085938,1e-05,0.07716107368469238,2.3645763397216797,23.927849769592285,0 +5553,0.30520209670066833,0.2469608336687088,0.24303729832172394,0.2316666543483734,666.9776611328125,1e-05,0.0832630842924118,2.468381404876709,23.927849769592285,0 +5554,0.20363278687000275,0.32361307740211487,0.2999088168144226,0.1366666555404663,978.9678955078125,1e-05,0.09375211596488953,2.486964702606201,23.927849769592285,0 +5555,0.1568947732448578,0.17601507902145386,0.17204242944717407,0.24173076450824738,792.4597778320312,1e-05,0.07225620001554489,2.4825148582458496,23.927849769592285,0 +5556,0.22369630634784698,0.5614805817604065,0.5764700174331665,0.25564101338386536,101.10294342041016,1e-05,0.1128903329372406,2.362622022628784,23.927849769592285,0 +5557,0.18648284673690796,0.18557944893836975,0.17644591629505157,0.23499998450279236,859.375,1e-05,0.06704635173082352,2.3555102348327637,23.927849769592285,0 +5558,0.27519989013671875,0.21310147643089294,0.205190509557724,0.3302564024925232,722.12841796875,1e-05,0.09737095236778259,2.352165937423706,23.927849769592285,0 +5559,0.2012597918510437,0.31848588585853577,0.3126777410507202,0.25999999046325684,968.2146606445312,1e-05,0.07464314252138138,2.35351824760437,23.927849769592285,0 +5560,0.1873333752155304,0.1896638423204422,0.18668882548809052,0.25400641560554504,625.0,1e-05,0.06723669171333313,2.47595477104187,23.927849769592285,0 +5561,0.2255735695362091,0.19844813644886017,0.19286808371543884,0.22977563738822937,950.095947265625,1e-05,0.0881897509098053,2.3497660160064697,23.927849769592285,0 +5562,0.17132160067558289,0.14041632413864136,0.13780473172664642,0.25785255432128906,890.3912353515625,1e-05,0.1339186429977417,2.580646514892578,23.927849769592285,0 +5563,0.20022137463092804,0.23714390397071838,0.23031170666217804,0.17141024768352509,934.0242309570312,1e-05,0.10178453475236893,2.349609375,23.927849769592285,0 +5564,0.25893568992614746,0.22509503364562988,0.22424697875976562,0.28439101576805115,495.1690979003906,1e-05,0.0746784582734108,2.4689650535583496,23.927849769592285,0 +5565,0.24194394052028656,0.09923665970563889,0.10838322341442108,0.22195512056350708,749.19873046875,1e-05,0.07432471960783005,2.697164297103882,23.927849769592285,0 +5566,0.307058185338974,0.19894590973854065,0.19940008223056793,0.18278846144676208,884.9298706054688,1e-05,0.0701834186911583,2.570108413696289,23.927849769592285,0 +5567,0.3138534426689148,0.21113371849060059,0.20550106465816498,0.11176281422376633,927.1693725585938,1e-05,0.0684855505824089,2.356678009033203,23.927849769592285,0 +5568,0.12182024866342545,0.17827534675598145,0.16669152677059174,0.26230767369270325,908.0963134765625,1e-05,0.07590302079916,2.349759578704834,23.927849769592285,0 +5569,0.18827155232429504,0.20078501105308533,0.18843919038772583,0.20942306518554688,909.9564819335938,1e-05,0.07260437309741974,2.354243040084839,23.927849769592285,0 +5570,0.16846397519111633,0.17104630172252655,0.16742290556430817,0.23054486513137817,780.78076171875,1e-05,0.06672082841396332,2.4659717082977295,23.927849769592285,0 +5571,0.20814856886863708,0.16138164699077606,0.16044309735298157,0.2523076832294464,870.2915649414062,1e-05,0.06765464693307877,2.3564438819885254,23.927849769592285,0 +5572,0.2772175371646881,0.18927697837352753,0.17911270260810852,0.18496793508529663,922.431884765625,1e-05,0.07079776376485825,2.349440574645996,23.927849769592285,0 +5573,0.20064689218997955,0.17611876130104065,0.17583222687244415,0.18368588387966156,940.900146484375,1e-05,0.07877185195684433,2.4995405673980713,23.927849769592285,0 +5574,0.3071122467517853,0.23189912736415863,0.22205474972724915,0.22035256028175354,627.4900512695312,1e-05,0.074159175157547,2.3513472080230713,23.927849769592285,0 +5575,0.20888552069664001,0.13365577161312103,0.1402432918548584,0.25708332657814026,764.7515258789062,1e-05,0.0706067681312561,2.7888920307159424,23.927849769592285,0 +5576,0.26650768518447876,0.5245593786239624,0.5320506691932678,0.19307690858840942,141.84397888183594,1e-05,0.07651514559984207,2.358121871948242,23.927849769592285,0 +5577,0.18390513956546783,0.18008141219615936,0.16204889118671417,0.2366025596857071,888.3101196289062,1e-05,0.07744058966636658,2.556650400161743,23.927849769592285,0 +5578,0.27758437395095825,0.1540384143590927,0.15500494837760925,0.09753204882144928,750.7987060546875,1e-05,0.07411808520555496,2.3519084453582764,23.927849769592285,0 +5579,0.14942960441112518,0.7815386652946472,0.7806128263473511,0.2449999898672104,66.28787994384766,1e-05,0.07772386074066162,2.3526148796081543,23.927849769592285,0 +5580,0.14505980908870697,0.14367371797561646,0.144876167178154,0.22304485738277435,539.7727661132812,1e-05,0.06722191721200943,2.3548643589019775,23.927849769592285,0 +5581,0.13172698020935059,0.12345541268587112,0.12270712107419968,0.24666665494441986,892.8571166992188,1e-05,0.07508751004934311,2.4850516319274902,23.927849769592285,0 +5582,0.0899818018078804,0.1513267606496811,0.15181991457939148,0.13131409883499146,614.83740234375,1e-05,0.07761072367429733,2.354064702987671,23.927849769592285,0 +5583,0.21961267292499542,0.2238696962594986,0.22777527570724487,0.1458333283662796,976.1173706054688,1e-05,0.07694913446903229,2.5100386142730713,23.927849769592285,0 +5584,0.20024529099464417,0.23126374185085297,0.22432775795459747,0.2390064001083374,476.4851989746094,1e-05,0.061155546456575394,2.3552989959716797,23.927849769592285,0 +5585,0.1518065631389618,0.30159860849380493,0.28478485345840454,0.2611217796802521,988.4937133789062,1e-05,0.05616213008761406,2.356076717376709,23.927849769592285,0 +5586,0.2652316689491272,0.39304277300834656,0.40281254053115845,0.0716666653752327,222.03948974609375,1e-05,0.06840119510889053,2.821962356567383,23.927849769592285,0 +5587,0.20642702281475067,0.2195594310760498,0.21702486276626587,0.22323717176914215,943.62744140625,1e-05,0.08742310106754303,2.4787864685058594,23.927849769592285,0 +5588,0.2583214342594147,0.0984332486987114,0.11206140369176865,0.1737179458141327,861.318359375,1e-05,0.0642097070813179,2.3681046962738037,23.927849769592285,0 +5589,0.26907095313072205,0.16024409234523773,0.16428840160369873,0.15820512175559998,923.799560546875,1e-05,0.07998766005039215,2.359753131866455,23.927849769592285,0 +5590,0.11128738522529602,0.21681874990463257,0.20953910052776337,0.27166664600372314,743.5170288085938,1e-05,0.06627574563026428,2.3543853759765625,23.927849769592285,0 +5591,0.23965930938720703,0.4459192752838135,0.44869464635849,0.14820511639118195,282.50775146484375,1e-05,0.06345157325267792,2.4671196937561035,23.927849769592285,0 +5592,0.21065860986709595,0.2957981824874878,0.3029932379722595,0.2244551181793213,367.23162841796875,1e-05,0.0751393735408783,2.365386724472046,23.927849769592285,0 +5593,0.21049483120441437,0.12708234786987305,0.12346525490283966,0.17932692170143127,868.4371337890625,1e-05,0.0648847445845604,2.3547234535217285,23.927849769592285,0 +5594,0.3508177399635315,0.16765955090522766,0.1635398119688034,0.16176281869411469,829.9730834960938,1e-05,0.08667977154254913,2.493281602859497,23.927849769592285,0 +5595,0.25648123025894165,0.4201512634754181,0.42262575030326843,0.19624999165534973,211.79405212402344,1e-05,0.07073056697845459,2.3580424785614014,23.927849769592285,0 +5596,0.15398985147476196,0.19191725552082062,0.19828395545482635,0.24339742958545685,711.2069091796875,1e-05,0.06948839128017426,2.516615390777588,23.927849769592285,0 +5597,0.15897811949253082,0.10343711823225021,0.09700990468263626,0.2342948615550995,945.7156982421875,1e-05,0.07430030405521393,2.5085878372192383,23.927849769592285,0 +5598,0.24517251551151276,0.080719493329525,0.08316104859113693,0.13025639951229095,888.7283325195312,1e-05,0.08154159039258957,2.4923365116119385,23.927849769592285,0 +5599,0.24091923236846924,0.25121554732322693,0.24532249569892883,0.25342947244644165,450.76727294921875,1e-05,0.06617468595504761,2.34936785697937,23.927849769592285,0 +5600,0.17904101312160492,0.3927636444568634,0.3947032690048218,0.1873076856136322,995.3138427734375,1e-05,0.06268558651208878,2.3515031337738037,23.927849769592285,0 +5601,0.23205004632472992,0.4850485622882843,0.49108806252479553,0.22307690978050232,204.84951782226562,1e-05,0.0680575966835022,2.3518059253692627,23.927849769592285,0 +5602,0.16109062731266022,0.18285217881202698,0.18000394105911255,0.2575320303440094,610.940673828125,1e-05,0.07460425049066544,2.4747447967529297,23.927849769592285,0 +5603,0.17426443099975586,0.11899490654468536,0.11241716146469116,0.10048076510429382,852.4172973632812,1e-05,0.0791173204779625,2.356163740158081,23.927849769592285,0 +5604,0.18595051765441895,0.22052085399627686,0.22400419414043427,0.16346153616905212,552.4553833007812,1e-05,0.0684502050280571,2.4831454753875732,23.927849769592285,0 +5605,0.1949169933795929,0.1717873364686966,0.1676131933927536,0.23397435247898102,796.4441528320312,1e-05,0.08235689997673035,2.3497166633605957,23.927849769592285,0 +5606,0.19845467805862427,0.3131251633167267,0.30284246802330017,0.228589728474617,969.7308959960938,1e-05,0.07498729228973389,2.350468873977661,23.927849769592285,0 +5607,0.24732905626296997,0.8548360466957092,0.8503902554512024,0.20224358141422272,38.75969314575195,1e-05,0.07426809519529343,2.6162307262420654,23.927849769592285,0 +5608,0.11209315806627274,0.29737240076065063,0.27942508459091187,0.23749999701976776,990.87890625,1e-05,0.07099483907222748,2.5032873153686523,23.927849769592285,0 +5609,0.1653500348329544,0.3045072555541992,0.30500084161758423,0.19490383565425873,282.50775146484375,1e-05,0.06381261348724365,2.485487222671509,23.927849769592285,0 +5610,0.18959473073482513,0.1596536934375763,0.15534161031246185,0.26964741945266724,807.9915161132812,1e-05,0.08065248280763626,2.348407030105591,23.927849769592285,0 +5611,0.2667752206325531,0.22548989951610565,0.20896057784557343,0.2677564024925232,946.6019287109375,1e-05,0.07897037267684937,2.349022150039673,23.927849769592285,0 +5612,0.2614467144012451,0.17536883056163788,0.17215536534786224,0.24211537837982178,698.8536376953125,1e-05,0.09073133021593094,2.572077512741089,23.927849769592285,0 +5613,0.27019989490509033,0.6367248296737671,0.6283551454544067,0.2383333295583725,109.48905944824219,1e-05,0.0892501100897789,2.35494065284729,23.927849769592285,0 +5614,0.25139835476875305,0.3503069281578064,0.3436252176761627,0.18028844892978668,983.36181640625,1e-05,0.06317929178476334,2.3454694747924805,23.927849769592285,0 +5615,0.1714150756597519,0.23819518089294434,0.2277458757162094,0.27791666984558105,626.2474975585938,1e-05,0.07713605463504791,2.617720127105713,23.927849769592285,0 +5616,0.25468558073043823,0.12576794624328613,0.1301511526107788,0.16910256445407867,923.799560546875,1e-05,0.07644464075565338,2.3554434776306152,23.927849769592285,0 +5617,0.2544126808643341,0.1314239501953125,0.13482482731342316,0.16923075914382935,542.9864501953125,1e-05,0.07829435169696808,2.5306947231292725,23.927849769592285,0 +5618,0.2492486983537674,0.14984872937202454,0.1477854698896408,0.2396794855594635,804.208251953125,1e-05,0.07289008051156998,2.354522705078125,23.927849769592285,0 +5619,0.2020079493522644,0.16600677371025085,0.167306587100029,0.0723397433757782,870.2915649414062,1e-05,0.07484272122383118,2.348789691925049,23.927849769592285,0 +5620,0.19965213537216187,0.44039851427078247,0.4248429536819458,0.24772435426712036,995.10595703125,1e-05,0.07262507826089859,2.5238397121429443,23.927849769592285,0 +5621,0.17522181570529938,0.18620792031288147,0.17205163836479187,0.2050640881061554,867.5030517578125,1e-05,0.06629505753517151,2.3489809036254883,23.927849769592285,0 +5622,0.12899518013000488,0.06700829416513443,0.06991207599639893,0.19301281869411469,841.503173828125,1e-05,0.07738924771547318,2.4489405155181885,23.927849769592285,0 +5623,0.21235954761505127,0.2693324387073517,0.2569449543952942,0.27445513010025024,965.6505737304688,1e-05,0.07337144017219543,2.3560752868652344,23.927849769592285,0 +5624,0.14257661998271942,0.15005312860012054,0.14484994113445282,0.198108971118927,714.8972778320312,1e-05,0.06821974366903305,2.345942974090576,23.927849769592285,0 +5625,0.18852756917476654,0.21814917027950287,0.2143838107585907,0.303044855594635,529.9539794921875,1e-05,0.07526124268770218,2.565502882003784,23.927849769592285,0 +5626,0.24067863821983337,0.6249322891235352,0.6608142852783203,0.265256404876709,38.75969314575195,1e-05,0.07021409273147583,2.468367576599121,23.927849769592285,0 +5627,0.12024809420108795,0.17262040078639984,0.15602260828018188,0.22326922416687012,898.4814453125,1e-05,0.06549420207738876,2.4769744873046875,23.927849769592285,0 +5628,0.1778288185596466,0.15498149394989014,0.14898733794689178,0.21041665971279144,557.0953369140625,1e-05,0.07624969631433487,2.35640811920166,23.927849769592285,0 +5629,0.09750723838806152,0.6018217206001282,0.5616925358772278,0.19467948377132416,993.8524169921875,1e-05,0.07134101539850235,2.516202211380005,23.927849769592285,0 +5630,0.19208399951457977,0.13625654578208923,0.12487305700778961,0.22499999403953552,775.0761108398438,1e-05,0.062123142182826996,2.471492290496826,23.927849769592285,0 +5631,0.12519621849060059,0.18130508065223694,0.16904857754707336,0.18753203749656677,726.5493774414062,1e-05,0.06450106203556061,2.3568413257598877,23.927849769592285,0 +5632,0.23358893394470215,0.23195157945156097,0.22240491211414337,0.19717948138713837,971.23095703125,1e-05,0.06839070469141006,2.349681854248047,23.927849769592285,0 +5633,0.19141148030757904,0.3017234206199646,0.2922388017177582,0.2318589687347412,973.4513549804688,1e-05,0.07361827045679092,2.563148260116577,23.927849769592285,0 +5634,0.17012818157672882,0.3222549557685852,0.33292409777641296,0.2105448693037033,270.376220703125,1e-05,0.06838686764240265,2.3579277992248535,23.927849769592285,0 +5635,0.21450740098953247,0.32691213488578796,0.3172690272331238,0.21022434532642365,983.1340942382812,1e-05,0.05647703632712364,2.346004009246826,23.927849769592285,0 +5636,0.3250907063484192,0.22049261629581451,0.21899601817131042,0.23711538314819336,425.4617614746094,1e-05,0.07172038406133652,2.4781084060668945,23.927849769592285,0 +5637,0.14931631088256836,0.2888273596763611,0.282191663980484,0.22230768203735352,968.2146606445312,1e-05,0.06849580258131027,2.3657422065734863,23.927849769592285,0 +5638,0.2338762879371643,0.2472180724143982,0.24041186273097992,0.24096153676509857,440.41455078125,1e-05,0.0771874412894249,2.5011887550354004,23.927849769592285,0 +5639,0.15487243235111237,0.11632771044969559,0.11096068471670151,0.2363140881061554,831.0991821289062,1e-05,0.05950271710753441,2.355989694595337,23.927849769592285,0 +5640,0.1693870574235916,0.20324991643428802,0.19010856747627258,0.3071794807910919,895.2894897460938,1e-05,0.08212416619062424,2.481241464614868,23.927849769592285,0 +5641,0.21983188390731812,0.11201529204845428,0.1131860762834549,0.2786217927932739,879.7392578125,1e-05,0.07591234892606735,2.5780527591705322,23.927849769592285,0 +5642,0.279823362827301,0.5169354677200317,0.5004377961158752,0.21907050907611847,994.4806518554688,1e-05,0.07348693907260895,2.349865674972534,23.927849769592285,0 +5643,0.257601797580719,0.20925946533679962,0.21140128374099731,0.18166665732860565,894.0774536132812,1e-05,0.06707040965557098,2.3493428230285645,23.927849769592285,0 +5644,0.13313379883766174,0.23836636543273926,0.23771913349628448,0.2261858880519867,859.375,1e-05,0.06012604013085365,2.4952104091644287,23.927849769592285,0 +5645,0.14527617394924164,0.2516627311706543,0.25128504633903503,0.2064102441072464,986.2869873046875,1e-05,0.06684686988592148,2.356614589691162,23.927849769592285,0 +5646,0.18459409475326538,0.16047118604183197,0.15978921949863434,0.14346154034137726,709.3425903320312,1e-05,0.06541478633880615,2.3458690643310547,23.927849769592285,0 +5647,0.22296500205993652,0.15225999057292938,0.15314215421676636,0.19932691752910614,791.788818359375,1e-05,0.06524384766817093,2.592783212661743,23.927849769592285,0 +5648,0.3238312005996704,0.32672563195228577,0.32081007957458496,0.28698715567588806,364.73089599609375,1e-05,0.07531470060348511,2.490410566329956,23.927849769592285,0 +5649,0.08901916444301605,0.16601641476154327,0.15309058129787445,0.26150640845298767,876.1961669921875,1e-05,0.06446664035320282,2.350421667098999,23.927849769592285,0 +5650,0.21971243619918823,0.11793526262044907,0.1205475702881813,0.1616666615009308,526.620361328125,1e-05,0.06656119972467422,2.4598889350891113,23.927849769592285,0 +5651,0.12610214948654175,0.2278118133544922,0.22411124408245087,0.25573715567588806,958.2166748046875,1e-05,0.06476741284132004,2.358508348464966,23.927849769592285,0 +5652,0.04819300398230553,0.1411905735731125,0.13318057358264923,0.28314101696014404,916.1324462890625,1e-05,0.0676642507314682,2.4699854850769043,23.927849769592285,0 +5653,0.23066405951976776,0.20209108293056488,0.2096584588289261,0.16381409764289856,713.0584106445312,1e-05,0.07948263734579086,2.346710443496704,23.927849769592285,0 +5654,0.2168651670217514,0.5560668706893921,0.6012362837791443,0.2243589609861374,75.18797302246094,1e-05,0.09003332257270813,2.479973316192627,23.927849769592285,0 +5655,0.25767722725868225,0.389884352684021,0.39754974842071533,0.23894229531288147,228.7581787109375,1e-05,0.06435118615627289,2.3597664833068848,23.927849769592285,0 +5656,0.11614006757736206,0.16165785491466522,0.16652894020080566,0.12900640070438385,954.0719604492188,1e-05,0.07652845233678818,2.349620819091797,23.927849769592285,0 +5657,0.1606949120759964,0.17032749950885773,0.16765327751636505,0.26807692646980286,965.1322021484375,1e-05,0.10505834966897964,2.4695777893066406,23.927849769592285,0 +5658,0.18296386301517487,0.2777079939842224,0.26889553666114807,0.21743589639663696,956.2970581054688,1e-05,0.06768626719713211,2.3608100414276123,23.927849769592285,0 +5659,0.2633223831653595,0.26179513335227966,0.25669151544570923,0.14038461446762085,936.5596923828125,1e-05,0.09274109452962875,2.5207104682922363,23.927849769592285,0 +5660,0.29027578234672546,0.2501339018344879,0.23569360375404358,0.29759615659713745,947.1898803710938,1e-05,0.09670516103506088,2.3535423278808594,23.927849769592285,0 +5661,0.3573342561721802,0.2051452249288559,0.22248363494873047,0.23647435009479523,377.094970703125,1e-05,0.1026361808180809,2.4777116775512695,23.927849769592285,0 +5662,0.2688021659851074,0.13840392231941223,0.14524191617965698,0.18516024947166443,757.8740844726562,1e-05,0.07522603869438171,2.3482892513275146,23.927849769592285,0 +5663,0.13516609370708466,0.08147413283586502,0.08139276504516602,0.0016666665906086564,918.6107788085938,1e-05,0.06906065344810486,2.59230899810791,23.927849769592285,0 +5664,0.18404147028923035,0.1437874436378479,0.147435262799263,0.2518269121646881,867.0343017578125,1e-05,0.07344195246696472,2.3542823791503906,23.927849769592285,0 +5665,0.26424968242645264,0.11572563648223877,0.11745480448007584,0.18842947483062744,480.2955627441406,1e-05,0.11448594182729721,2.473679780960083,23.927849769592285,0 +5666,0.2246936410665512,0.20543710887432098,0.20471933484077454,0.28865382075309753,959.3023071289062,1e-05,0.07309980690479279,2.3496484756469727,23.927849769592285,0 +5667,0.2749773859977722,0.7912635207176208,0.8014262914657593,0.1863461434841156,66.28787994384766,1e-05,0.07666444778442383,2.3513965606689453,23.927849769592285,0 +5668,0.21152183413505554,0.19812442362308502,0.19809500873088837,0.15512819588184357,529.9539794921875,1e-05,0.0671810582280159,2.585886240005493,23.927849769592285,0 +5669,0.19251884520053864,0.09851690381765366,0.10122500360012054,0.08384615182876587,742.69482421875,1e-05,0.07579386979341507,2.3576467037200928,23.927849769592285,0 +5670,0.18630023300647736,0.17023512721061707,0.16579443216323853,0.2609294652938843,693.9501953125,1e-05,0.09547989070415497,2.501272201538086,23.927849769592285,0 +5671,0.1688997894525528,0.15957432985305786,0.1636190414428711,0.25525641441345215,911.4300537109375,1e-05,0.07909367978572845,2.4651122093200684,23.927849769592285,0 +5672,0.07210467755794525,0.34219858050346375,0.3551909327507019,0.1557692289352417,995.10595703125,1e-05,0.06794047355651855,2.3728718757629395,23.927849769592285,0 +5673,0.16926616430282593,0.11777889728546143,0.1154395341873169,0.20137819647789001,816.57421875,1e-05,0.07065476477146149,2.535795211791992,23.927849769592285,0 +5674,0.20108254253864288,0.1960606575012207,0.2036275565624237,0.2103525549173355,594.86376953125,1e-05,0.08703302592039108,2.3693947792053223,23.927849769592285,0 +5675,0.17984597384929657,0.13210663199424744,0.1363820880651474,0.264455109834671,694.9378051757812,1e-05,0.07498031109571457,2.357759714126587,23.927849769592285,0 +5676,0.16423165798187256,0.21300825476646423,0.2010040283203125,0.23358973860740662,758.6478271484375,1e-05,0.06795375794172287,2.352754592895508,23.927849769592285,0 +5677,0.19394974410533905,0.18229469656944275,0.18229100108146667,0.27195513248443604,986.952880859375,1e-05,0.06064724177122116,2.354973793029785,23.927849769592285,0 +5678,0.25222882628440857,0.19982995092868805,0.2026720643043518,0.24477563798427582,832.777099609375,1e-05,0.1441049724817276,2.4635488986968994,23.927849769592285,0 +5679,0.19591788947582245,0.13256341218948364,0.14228498935699463,0.22804486751556396,918.9618530273438,1e-05,0.07062976807355881,2.4879722595214844,23.927849769592285,0 +5680,0.21560512483119965,0.20653635263442993,0.19607853889465332,0.279134601354599,789.7643432617188,1e-05,0.07502494752407074,2.4751198291778564,23.927849769592285,0 +5681,0.15693417191505432,0.10205601155757904,0.09712350368499756,0.20685896277427673,825.4075927734375,1e-05,0.0667283907532692,2.3566033840179443,23.927849769592285,0 +5682,0.15197783708572388,0.14945489168167114,0.14746125042438507,0.2946794629096985,504.1766052246094,1e-05,0.06860842555761337,2.477849006652832,23.927849769592285,0 +5683,0.1815451830625534,0.3221021294593811,0.31498825550079346,0.1733333319425583,997.7804565429688,1e-05,0.08887948840856552,2.360952138900757,23.927849769592285,0 +5684,0.23806342482566833,0.39328476786613464,0.393705815076828,0.2104487121105194,270.376220703125,1e-05,0.07317083328962326,2.4906833171844482,23.927849769592285,0 +5685,0.17860428988933563,0.2870110273361206,0.28740158677101135,0.17733973264694214,949.22998046875,1e-05,0.07306527346372604,2.3483054637908936,23.927849769592285,0 +5686,0.22775539755821228,0.2190372496843338,0.21081799268722534,0.19775640964508057,731.7578735351562,1e-05,0.08775235712528229,2.4744515419006348,23.927849769592285,0 +5687,0.20524488389492035,0.17502857744693756,0.16997098922729492,0.19173076748847961,644.3798828125,1e-05,0.0892014428973198,2.3474552631378174,23.927849769592285,0 +5688,0.30204135179519653,0.3536670207977295,0.34880349040031433,0.2620512843132019,276.479736328125,1e-05,0.06906812638044357,2.3521347045898438,23.927849769592285,0 +5689,0.10061069577932358,0.29322052001953125,0.27891868352890015,0.2717307507991791,968.468505859375,1e-05,0.08325675874948502,2.4967992305755615,23.927849769592285,0 +5690,0.19231751561164856,0.370369553565979,0.3426791727542877,0.2549999952316284,986.2869873046875,1e-05,0.0846044048666954,2.3575778007507324,23.927849769592285,0 +5691,0.14861856400966644,0.10026571154594421,0.09429653733968735,0.23368589580059052,877.9761962890625,1e-05,0.08159009367227554,2.5542988777160645,23.927849769592285,0 +5692,0.16491281986236572,0.20903466641902924,0.1944999098777771,0.2309935837984085,828.2725830078125,1e-05,0.06812293082475662,2.3524394035339355,23.927849769592285,0 +5693,0.30476245284080505,0.1780766099691391,0.1673121154308319,0.1887499988079071,902.3915405273438,1e-05,0.07221806049346924,2.579998016357422,23.927849769592285,0 +5694,0.1572619080543518,0.16737033426761627,0.1623760163784027,0.24666665494441986,976.3572998046875,1e-05,0.09508967399597168,2.4652912616729736,23.927849769592285,0 +5695,0.18067041039466858,0.16453687846660614,0.1794256865978241,0.22871793806552887,476.4851989746094,1e-05,0.1241326555609703,2.361182689666748,23.927849769592285,0 +5696,0.12776397168636322,0.06379813700914383,0.07741085439920425,0.2305128127336502,743.5170288085938,1e-05,0.06261339783668518,2.350980281829834,23.927849769592285,0 +5697,0.3417333960533142,0.11284413933753967,0.1163736954331398,0.17009614408016205,725.671142578125,1e-05,0.11406233161687851,2.3571817874908447,23.927849769592285,0 +5698,0.13659311830997467,0.17542952299118042,0.18234500288963318,0.1357051283121109,973.2064208984375,1e-05,0.08415095508098602,2.3552820682525635,23.927849769592285,0 +5699,0.12861093878746033,0.19827958941459656,0.18677476048469543,0.24810896813869476,684.9005737304688,1e-05,0.07080117613077164,2.354494571685791,23.927849769592285,0 +5700,0.14099004864692688,0.1566583514213562,0.15525932610034943,0.1830769181251526,931.7718505859375,1e-05,0.07255320250988007,2.4926846027374268,23.927849769592285,0 +5701,0.1928432136774063,0.13620735704898834,0.14060227572917938,0.24374999105930328,962.7756958007812,1e-05,0.0860176756978035,2.4833433628082275,23.927849769592285,0 +5702,0.19117437303066254,0.16035500168800354,0.15580815076828003,0.23266024887561798,841.503173828125,1e-05,0.08616367727518082,2.3600575923919678,23.927849769592285,0 +5703,0.34366220235824585,0.6060852408409119,0.6605343222618103,0.26403844356536865,75.18797302246094,1e-05,0.0912747010588646,2.35503888130188,23.927849769592285,0 +5704,0.1955539584159851,0.21312783658504486,0.20449531078338623,0.24243588745594025,627.4900512695312,1e-05,0.0704210177063942,2.5044965744018555,23.927849769592285,0 +5705,0.1845330148935318,0.11049558967351913,0.12090999633073807,0.2509615421295166,798.4103393554688,1e-05,0.10259681195020676,2.568129539489746,23.927849769592285,0 +5706,0.19272948801517487,0.10807730257511139,0.1177058294415474,0.22032050788402557,989.3660888671875,1e-05,0.07128243148326874,2.3566410541534424,23.927849769592285,0 +5707,0.1453080177307129,0.14322997629642487,0.15281268954277039,0.1498717963695526,900.0560302734375,1e-05,0.07201346009969711,2.465273141860962,23.927849769592285,0 +5708,0.16080820560455322,0.1905793994665146,0.18683336675167084,0.16900640726089478,850.8939819335938,1e-05,0.08573300391435623,2.352511167526245,23.927849769592285,0 +5709,0.23849771916866302,0.1879991739988327,0.1841096132993698,0.2038140892982483,587.923828125,1e-05,0.08311524987220764,2.3511087894439697,23.927849769592285,0 +5710,0.20793507993221283,0.2761496305465698,0.27907320857048035,0.28400638699531555,993.0098266601562,1e-05,0.07608421891927719,2.3468029499053955,23.927849769592285,0 +5711,0.291032999753952,0.3601820170879364,0.35203641653060913,0.2556089758872986,319.94049072265625,1e-05,0.08206170797348022,2.5611729621887207,23.927849769592285,0 +5712,0.1924557089805603,0.2722407579421997,0.2630872428417206,0.2117948681116104,966.4247436523438,1e-05,0.08111611753702164,2.507728338241577,23.927849769592285,0 +5713,0.25910311937332153,0.28327468037605286,0.29046154022216797,0.2815704941749573,201.34228515625,1e-05,0.08767932653427124,2.349492073059082,23.927849769592285,0 +5714,0.2719944417476654,0.8453266620635986,0.8501380681991577,0.22394229471683502,83.95523071289062,1e-05,0.07235854119062424,2.4813830852508545,23.927849769592285,0 +5715,0.20136016607284546,0.18156571686267853,0.18416155874729156,0.2623717784881592,468.75,1e-05,0.09024836868047714,2.352071762084961,23.927849769592285,0 +5716,0.15861597657203674,0.15573129057884216,0.15498213469982147,0.24118588864803314,900.8379516601562,1e-05,0.07979033887386322,2.5448713302612305,23.927849769592285,0 +5717,0.22302907705307007,0.11767373234033585,0.12164299935102463,0.08394230157136917,833.3333129882812,1e-05,0.07609350234270096,2.548705816268921,23.927849769592285,0 +5718,0.1739913374185562,0.1355663686990738,0.1403781622648239,0.2817307710647583,896.4932861328125,1e-05,0.0756622701883316,2.362194061279297,23.927849769592285,0 +5719,0.22522465884685516,0.13440856337547302,0.12587396800518036,0.2710256278514862,972.9610595703125,1e-05,0.08387305587530136,2.3535654544830322,23.927849769592285,0 +5720,0.19653776288032532,0.18411466479301453,0.17643550038337708,0.270641028881073,971.9750366210938,1e-05,0.07539535313844681,2.351677894592285,23.927849769592285,0 +5721,0.21875548362731934,0.28935205936431885,0.28165575861930847,0.2844551205635071,352.0115051269531,1e-05,0.0813995823264122,2.4936110973358154,23.927849769592285,0 +5722,0.20806828141212463,0.16932767629623413,0.16724905371665955,0.23198717832565308,717.632080078125,1e-05,0.08055516332387924,2.492936611175537,23.927849769592285,0 +5723,0.24620485305786133,0.2358705699443817,0.22489820420742035,0.1804487109184265,937.8121948242188,1e-05,0.07827434688806534,2.369533061981201,23.927849769592285,0 +5724,0.26186907291412354,0.14555399119853973,0.14055092632770538,0.27929484844207764,849.8719482421875,1e-05,0.0736420750617981,2.359424114227295,23.927849769592285,0 +5725,0.21973924338817596,0.14952319860458374,0.1624649316072464,0.2270512729883194,960.9158325195312,1e-05,0.08321513235569,2.4967708587646484,23.927849769592285,0 +5726,0.20903529226779938,0.25774508714675903,0.2446039468050003,0.2521153688430786,881.0508422851562,1e-05,0.0665276050567627,2.4706552028656006,23.927849769592285,0 +5727,0.1770699918270111,0.2512744963169098,0.23751327395439148,0.26490384340286255,961.1829223632812,1e-05,0.06716569513082504,2.3655381202697754,23.927849769592285,0 +5728,0.1400846242904663,0.2009323090314865,0.19294215738773346,0.22227562963962555,524.9420166015625,1e-05,0.07731446623802185,2.4828274250030518,23.927849769592285,0 +5729,0.18649263679981232,0.34565532207489014,0.3512110114097595,0.22330127656459808,991.9489135742188,1e-05,0.06427516043186188,2.3622827529907227,23.927849769592285,0 +5730,0.10287297517061234,0.09276750683784485,0.09905163943767548,0.1359935849905014,928.1668090820312,1e-05,0.06439388543367386,2.351935625076294,23.927849769592285,0 +5731,0.1433737426996231,0.2623961567878723,0.2540687024593353,0.22333332896232605,899.6636962890625,1e-05,0.071421779692173,2.56191086769104,23.927849769592285,0 +5732,0.17971614003181458,0.25056102871894836,0.24302959442138672,0.20519229769706726,531.6091918945312,1e-05,0.06938444823026657,2.3552427291870117,23.927849769592285,0 +5733,0.2890869975090027,0.055316608399152756,0.05995891988277435,0.1027243584394455,880.6146240234375,1e-05,0.07457401603460312,2.5107271671295166,23.927849769592285,0 +5734,0.13883045315742493,0.22276851534843445,0.22385664284229279,0.1638782024383545,917.9064331054688,1e-05,0.06594450026750565,2.3462343215942383,23.927849769592285,0 +5735,0.26850244402885437,0.22426052391529083,0.22915558516979218,0.20666666328907013,952.09716796875,1e-05,0.07232772558927536,2.4703502655029297,23.927849769592285,0 +5736,0.279421865940094,0.3573397099971771,0.3448610007762909,0.1856730729341507,989.148681640625,1e-05,0.06911078095436096,2.3538124561309814,23.927849769592285,0 +5737,0.17261523008346558,0.19486618041992188,0.19378730654716492,0.2010897397994995,948.067626953125,1e-05,0.07653556764125824,2.4937663078308105,23.927849769592285,0 +5738,0.26887577772140503,0.2341792732477188,0.23260779678821564,0.23246793448925018,476.4851989746094,1e-05,0.06327813863754272,2.3506393432617188,23.927849769592285,0 +5739,0.13752320408821106,0.18229487538337708,0.18035972118377686,0.2612820267677307,899.2704467773438,1e-05,0.07075440138578415,2.4521453380584717,23.927849769592285,0 +5740,0.24498946964740753,0.15585735440254211,0.1560511440038681,0.25208333134651184,824.2506713867188,1e-05,0.06133521348237991,2.3614070415496826,23.927849769592285,0 +5741,0.23497745394706726,0.13021712005138397,0.12718379497528076,0.226666659116745,894.0774536132812,1e-05,0.08184677362442017,2.3432536125183105,23.927849769592285,0 +5742,0.2691429853439331,0.1442192941904068,0.1431920975446701,0.23971152305603027,907.3464965820312,1e-05,0.07822674512863159,2.5888521671295166,23.927849769592285,0 +5743,0.23221592605113983,0.19051089882850647,0.17926061153411865,0.32006409764289856,905.0772094726562,1e-05,0.06383125483989716,2.4874136447906494,23.927849769592285,0 +5744,0.17888861894607544,0.22243954241275787,0.21870212256908417,0.23112179338932037,516.4320068359375,1e-05,0.07311742007732391,2.3519248962402344,23.927849769592285,0 +5745,0.19096747040748596,0.256488561630249,0.2700560986995697,0.21964742243289948,976.3572998046875,1e-05,0.0644579604268074,2.3451108932495117,23.927849769592285,0 +5746,0.18062394857406616,0.20360305905342102,0.20347855985164642,0.18067307770252228,854.4303588867188,1e-05,0.06640550494194031,2.480126142501831,23.927849769592285,0 +5747,0.19806241989135742,0.22307491302490234,0.21520167589187622,0.24342948198318481,675.5514526367188,1e-05,0.07088591903448105,2.347172975540161,23.927849769592285,0 +5748,0.21740159392356873,0.13747797906398773,0.13429483771324158,0.19701921939849854,879.3001098632812,1e-05,0.07435870170593262,2.4856507778167725,23.927849769592285,0 +5749,0.23299935460090637,0.16942425072193146,0.16493040323257446,0.23028844594955444,790.4412231445312,1e-05,0.08238827437162399,2.35140061378479,23.927849769592285,0 +5750,0.2692497968673706,0.25480467081069946,0.25649911165237427,0.2480769157409668,997.5768432617188,1e-05,0.0817522406578064,2.473578453063965,23.927849769592285,0 +5751,0.25131192803382874,0.3471844494342804,0.34602147340774536,0.19939102232456207,999.1974487304688,1e-05,0.07261403650045395,2.3520689010620117,23.927849769592285,0 +5752,0.1721085011959076,0.1340728998184204,0.13898350298404694,0.1933012753725052,919.3121948242188,1e-05,0.06858377903699875,2.477559804916382,23.927849769592285,0 +5753,0.2066015899181366,0.06974506378173828,0.07389392703771591,0.11948717385530472,900.0560302734375,1e-05,0.0732152909040451,2.592008352279663,23.927849769592285,0 +5754,0.27694010734558105,0.2767156958580017,0.2744375467300415,0.2558974325656891,288.4615478515625,1e-05,0.08964003622531891,2.4707210063934326,23.927849769592285,0 +5755,0.25748902559280396,0.17432717978954315,0.1796572357416153,0.17522434890270233,577.95703125,1e-05,0.07281916588544846,2.364949941635132,23.927849769592285,0 +5756,0.15621401369571686,0.16706226766109467,0.15166722238063812,0.29916664958000183,858.3959350585938,1e-05,0.06977242976427078,2.567784547805786,23.927849769592285,0 +5757,0.1730288863182068,0.18182966113090515,0.17128415405750275,0.18342947959899902,929.8156127929688,1e-05,0.06312759220600128,2.3600502014160156,23.927849769592285,0 +5758,0.25889503955841064,0.16129480302333832,0.16138707101345062,0.16785255074501038,529.9539794921875,1e-05,0.09508182108402252,2.3552358150482178,23.927849769592285,0 +5759,0.2169274091720581,0.23299095034599304,0.22678664326667786,0.19490383565425873,961.7158813476562,1e-05,0.06038983166217804,2.520120143890381,23.927849769592285,0 +5760,0.1464274823665619,0.19269001483917236,0.19236698746681213,0.27147436141967773,722.12841796875,1e-05,0.06686970591545105,2.349363088607788,23.927849769592285,0 +5761,0.16825984418392181,0.20750287175178528,0.21400384604930878,0.21628203988075256,982.2193603515625,1e-05,0.09104014933109283,2.463593006134033,23.927849769592285,0 +5762,0.12494111061096191,0.17644880712032318,0.16688670217990875,0.13256409764289856,949.5192260742188,1e-05,0.059537068009376526,2.3530256748199463,23.927849769592285,0 +5763,0.2767399847507477,0.09090159088373184,0.09212508797645569,0.19663460552692413,839.89501953125,1e-05,0.0744144394993782,2.5925850868225098,23.927849769592285,0 +5764,0.18188029527664185,0.3685726821422577,0.37122753262519836,0.18977563083171844,999.3985595703125,1e-05,0.05854809656739235,2.3637027740478516,23.927849769592285,0 +5765,0.26759663224220276,0.19033671915531158,0.1888842135667801,0.2982371747493744,961.7158813476562,1e-05,0.07328125834465027,2.502781867980957,23.927849769592285,0 +5766,0.32896047830581665,0.2557135224342346,0.24966633319854736,0.2636217772960663,958.7605590820312,1e-05,0.07621677219867706,2.483473300933838,23.927849769592285,0 +5767,0.1764053851366043,0.16595600545406342,0.1589599847793579,0.25990384817123413,746.7793579101562,1e-05,0.062018632888793945,2.3640403747558594,23.927849769592285,0 +5768,0.17643004655838013,0.14766620099544525,0.13719442486763,0.11157050728797913,898.4814453125,1e-05,0.07176343351602554,2.349595785140991,23.927849769592285,0 +5769,0.2324834167957306,0.17969447374343872,0.17794683575630188,0.23695512115955353,673.4317626953125,1e-05,0.0629018098115921,2.4526865482330322,23.927849769592285,0 +5770,0.31219738721847534,0.32428038120269775,0.33233359456062317,0.3000640869140625,285.49383544921875,1e-05,0.08625642955303192,2.3559012413024902,23.927849769592285,0 +5771,0.0942164808511734,0.21558043360710144,0.2155110239982605,0.2072756290435791,980.6033935546875,1e-05,0.06126616895198822,2.477661371231079,23.927849769592285,0 +5772,0.25330111384391785,0.3126492202281952,0.31021755933761597,0.13887819647789001,1000.0,1e-05,0.06674038618803024,2.3581454753875732,23.927849769592285,0 +5773,0.19041477143764496,0.09257904440164566,0.09723461419343948,0.21833331882953644,833.3333129882812,1e-05,0.08173476159572601,2.5761516094207764,23.927849769592285,0 +5774,0.21602940559387207,0.24025698006153107,0.24578306078910828,0.2923717796802521,811.7109985351562,1e-05,0.08869218081235886,2.581761360168457,23.927849769592285,0 +5775,0.16773010790348053,0.3162235617637634,0.31294554471969604,0.25439101457595825,964.0897216796875,1e-05,0.06470248848199844,2.353360891342163,23.927849769592285,0 +5776,0.2805209755897522,0.15084590017795563,0.14887209236621857,0.22692306339740753,651.3410034179688,1e-05,0.08097958564758301,2.4645562171936035,23.927849769592285,0 +5777,0.19375985860824585,0.621157169342041,0.6373940706253052,0.23028844594955444,57.25191116333008,1e-05,0.0807424783706665,2.5766990184783936,23.927849769592285,0 +5778,0.15158621966838837,0.11158600449562073,0.11446963250637054,0.15554486215114594,917.9064331054688,1e-05,0.08293387293815613,2.3480217456817627,23.927849769592285,0 +5779,0.21391870081424713,0.2381245493888855,0.23232190310955048,0.20464742183685303,777.2314453125,1e-05,0.0623285137116909,2.3447694778442383,23.927849769592285,0 +5780,0.26942726969718933,0.21893823146820068,0.20661911368370056,0.217403843998909,948.6500244140625,1e-05,0.1004507765173912,2.56911301612854,23.927849769592285,0 +5781,0.2124834507703781,0.19729705154895782,0.19210615754127502,0.2522115409374237,941.8146362304688,1e-05,0.08871632069349289,2.3571808338165283,23.927849769592285,0 +5782,0.18269535899162292,0.10328276455402374,0.09792356193065643,0.21477563679218292,876.6427001953125,1e-05,0.06996693462133408,2.492323398590088,23.927849769592285,0 +5783,0.19282940030097961,0.1647205650806427,0.165227010846138,0.10907050967216492,671.2963256835938,1e-05,0.07420437783002853,2.456252098083496,23.927849769592285,0 +5784,0.13024817407131195,0.1403406858444214,0.14139114320278168,0.07826922833919525,787.0369873046875,1e-05,0.07702934741973877,2.358945846557617,23.927849769592285,0 +5785,0.13957393169403076,0.11074314266443253,0.10292651504278183,0.1643589735031128,929.1580810546875,1e-05,0.07174026966094971,2.481513738632202,23.927849769592285,0 +5786,0.25762099027633667,0.308113157749176,0.32468950748443604,0.2276282012462616,325.4438171386719,1e-05,0.06813826411962509,2.4943735599517822,23.927849769592285,0 +5787,0.17722831666469574,0.17160828411579132,0.16584061086177826,0.2985897362232208,965.3915405273438,1e-05,0.06885017454624176,2.353222370147705,23.927849769592285,0 +5788,0.3734895586967468,0.286731481552124,0.2979029417037964,0.27272436022758484,303.0303039550781,1e-05,0.06966391205787659,2.487855911254883,23.927849769592285,0 +5789,0.3013908863067627,0.22252069413661957,0.21117128431797028,0.2622756361961365,570.6521606445312,1e-05,0.0725177749991417,2.3448336124420166,23.927849769592285,0 +5790,0.15446366369724274,0.13200397789478302,0.12270215898752213,0.2912179231643677,950.9569091796875,1e-05,0.07482884079217911,2.349956512451172,23.927849769592285,0 +5791,0.21733610332012177,0.15496166050434113,0.14294679462909698,0.23249998688697815,781.4841918945312,1e-05,0.07046768069267273,2.4821653366088867,23.927849769592285,0 +5792,0.1872093826532364,0.1402476280927658,0.13974876701831818,0.21833331882953644,782.8849487304688,1e-05,0.07081373780965805,2.349982261657715,23.927849769592285,0 +5793,0.1836467832326889,0.11047016829252243,0.12394541501998901,0.27147436141967773,934.3434448242188,1e-05,0.06703472137451172,2.3469045162200928,23.927849769592285,0 +5794,0.26717227697372437,0.14030636847019196,0.1421678513288498,0.13057692348957062,685.9205932617188,1e-05,0.09540946781635284,2.5589630603790283,23.927849769592285,0 +5795,0.3163616359233856,0.25275447964668274,0.24633543193340302,0.19044871628284454,505.9523620605469,1e-05,0.06733997911214828,2.5108766555786133,23.927849769592285,0 +5796,0.1946118026971817,0.07573700696229935,0.07953256368637085,0.09666666388511658,757.8740844726562,1e-05,0.07982540130615234,2.357733726501465,23.927849769592285,0 +5797,0.3041996359825134,0.32358646392822266,0.3230859339237213,0.21862179040908813,423.2804260253906,1e-05,0.08250822126865387,2.481076240539551,23.927849769592285,0 +5798,0.13180279731750488,0.07917935401201248,0.08658291399478912,0.1144871786236763,586.51806640625,1e-05,0.07557718455791473,2.472097158432007,23.927849769592285,0 +5799,0.24488839507102966,0.5786424279212952,0.5756732225418091,0.2572115361690521,129.92831420898438,1e-05,0.08207546174526215,2.361912965774536,23.927849769592285,0 +5800,0.15310007333755493,0.15487246215343475,0.14797724783420563,0.2499999850988388,757.8740844726562,1e-05,0.13101565837860107,2.3524391651153564,23.927849769592285,0 +5801,0.09298307448625565,0.2394360452890396,0.24326181411743164,0.1833653748035431,988.7123413085938,1e-05,0.06039293855428696,2.346771478652954,23.927849769592285,0 +5802,0.1626700907945633,0.12605473399162292,0.13732774555683136,0.24842947721481323,940.287353515625,1e-05,0.07457967102527618,2.603527545928955,23.927849769592285,0 +5803,0.21105673909187317,0.1256811022758484,0.12394817173480988,0.2477884590625763,913.978515625,1e-05,0.07992985099554062,2.512155294418335,23.927849769592285,0 +5804,0.3070790469646454,0.2330426722764969,0.23352618515491486,0.21435897052288055,468.75,1e-05,0.07350960373878479,2.3646514415740967,23.927849769592285,0 +5805,0.10464482754468918,0.17281599342823029,0.1805919110774994,0.261762797832489,944.2269897460938,1e-05,0.08617274463176727,2.4797496795654297,23.927849769592285,0 +5806,0.26186704635620117,0.25034478306770325,0.24236027896404266,0.29413461685180664,425.4617614746094,1e-05,0.07236768305301666,2.492669105529785,23.927849769592285,0 +5807,0.237915500998497,0.13957205414772034,0.13696038722991943,0.25185897946357727,802.292236328125,1e-05,0.08492682874202728,2.480182409286499,23.927849769592285,0 +5808,0.13194361329078674,0.22222888469696045,0.22421903908252716,0.22413460910320282,974.9119873046875,1e-05,0.06407313793897629,2.3487601280212402,23.927849769592285,0 +5809,0.07404744625091553,0.17970961332321167,0.17132273316383362,0.2286858856678009,961.4497680664062,1e-05,0.09346401691436768,2.5096397399902344,23.927849769592285,0 +5810,0.2155325710773468,0.20568396151065826,0.2025671899318695,0.2250320464372635,697.8798828125,1e-05,0.06364670395851135,2.355952739715576,23.927849769592285,0 +5811,0.24064688384532928,0.20489712059497833,0.19451993703842163,0.2360256314277649,883.2159423828125,1e-05,0.09166675060987473,2.347177743911743,23.927849769592285,0 +5812,0.22097092866897583,0.2241940051317215,0.21502070128917694,0.25266024470329285,767.0015869140625,1e-05,0.06906527280807495,2.5184085369110107,23.927849769592285,0 +5813,0.10225396603345871,0.42736294865608215,0.4107799828052521,0.270480751991272,987.8356323242188,1e-05,0.06634040921926498,2.3565123081207275,23.927849769592285,0 +5814,0.13081304728984833,0.2772396504878998,0.26806461811065674,0.20080126821994781,936.8737182617188,1e-05,0.07891238480806351,2.580411434173584,23.927849769592285,0 +5815,0.12915022671222687,0.20990894734859467,0.1994897723197937,0.2860576808452606,966.4247436523438,1e-05,0.06707517802715302,2.3518338203430176,23.927849769592285,0 +5816,0.2572842240333557,0.1439058780670166,0.1612795889377594,0.2069871723651886,964.0897216796875,1e-05,0.08643686771392822,2.5861620903015137,23.927849769592285,0 +5817,0.2673640251159668,0.23893584311008453,0.237814798951149,0.23830127716064453,857.9046020507812,1e-05,0.0852883905172348,2.4732401371002197,23.927849769592285,0 +5818,0.20496317744255066,0.11042314022779465,0.11224259436130524,0.18391025066375732,910.6948852539062,1e-05,0.06998240202665329,2.35585880279541,23.927849769592285,0 +5819,0.2236303687095642,0.1448964774608612,0.14296334981918335,0.11317307502031326,740.2120361328125,1e-05,0.0784773901104927,2.3457977771759033,23.927849769592285,0 +5820,0.12273167073726654,0.2581429183483124,0.24734333157539368,0.2005128115415573,988.0552978515625,1e-05,0.07040539383888245,2.5400121212005615,23.927849769592285,0 +5821,0.24219708144664764,0.13713733851909637,0.13718242943286896,0.15862178802490234,929.1580810546875,1e-05,0.0725623071193695,2.356963872909546,23.927849769592285,0 +5822,0.14507287740707397,0.1339508593082428,0.14201287925243378,0.2542628049850464,693.9501953125,1e-05,0.06963552534580231,2.3471646308898926,23.927849769592285,0 +5823,0.16107910871505737,0.14084480702877045,0.14429216086864471,0.22012819349765778,937.1871948242188,1e-05,0.07794960588216782,2.498692035675049,23.927849769592285,0 +5824,0.20424555242061615,0.2473040372133255,0.2583712339401245,0.14384615421295166,996.3473510742188,1e-05,0.06814075261354446,2.4679036140441895,23.927849769592285,0 +5825,0.12481442838907242,0.1700575351715088,0.16413357853889465,0.15512819588184357,911.4300537109375,1e-05,0.06566495448350906,2.3588461875915527,23.927849769592285,0 +5826,0.16752935945987701,0.13361917436122894,0.13123489916324615,0.14048075675964355,914.6995849609375,1e-05,0.06622146815061569,2.4945614337921143,23.927849769592285,0 +5827,0.12259230762720108,0.2447107583284378,0.22972561419010162,0.21810896694660187,967.7055053710938,1e-05,0.07510843873023987,2.509918212890625,23.927849769592285,0 +5828,0.18448881804943085,0.26717397570610046,0.2532893121242523,0.276602566242218,953.5103759765625,1e-05,0.06955741345882416,2.5243289470672607,23.927849769592285,0 +5829,0.2623874545097351,0.17419172823429108,0.1659700721502304,0.25304487347602844,780.78076171875,1e-05,0.09114690870046616,2.3554203510284424,23.927849769592285,0 +5830,0.19949762523174286,0.1173195168375969,0.12448246031999588,0.255961537361145,647.8805541992188,1e-05,0.07130840420722961,2.356963634490967,23.927849769592285,0 +5831,0.3491554260253906,0.12365435808897018,0.12153590470552444,0.06974358856678009,744.3366088867188,1e-05,0.07100336998701096,2.5149736404418945,23.927849769592285,0 +5832,0.1646881252527237,0.18612819910049438,0.1896100640296936,0.1576922982931137,643.2039184570312,1e-05,0.06648242473602295,2.3605432510375977,23.927849769592285,0 +5833,0.10682126879692078,0.13549216091632843,0.14469318091869354,0.2361217886209488,691.9642944335938,1e-05,0.06358268857002258,2.4903788566589355,23.927849769592285,0 +5834,0.16739661991596222,0.13233332335948944,0.13343115150928497,0.1616666615009308,877.5327758789062,1e-05,0.07878860831260681,2.3641109466552734,23.927849769592285,0 +5835,0.2032114863395691,0.1697080433368683,0.16020497679710388,0.2923397421836853,802.9328002929688,1e-05,0.07154667377471924,2.5048270225524902,23.927849769592285,0 +5836,0.1841164529323578,0.12908823788166046,0.130276158452034,0.21381409466266632,502.3923645019531,1e-05,0.07737986743450165,2.5760226249694824,23.927849769592285,0 +5837,0.18520818650722504,0.20702145993709564,0.19045908749103546,0.2198076844215393,891.2169799804688,1e-05,0.061644550412893295,2.595330238342285,23.927849769592285,0 +5838,0.2312818020582199,0.19648025929927826,0.20182229578495026,0.25641024112701416,981.2984008789062,1e-05,0.08159198611974716,2.361968517303467,23.927849769592285,0 +5839,0.17589403688907623,0.17347261309623718,0.18001669645309448,0.12048076838254929,966.6818237304688,1e-05,0.09088127315044403,2.499432325363159,23.927849769592285,0 +5840,0.16535675525665283,0.28066930174827576,0.27474161982536316,0.22256410121917725,959.3023071289062,1e-05,0.07201343774795532,2.3546736240386963,23.927849769592285,0 +5841,0.27958106994628906,0.17312535643577576,0.16648954153060913,0.272596150636673,695.9219970703125,1e-05,0.07587303966283798,2.4758872985839844,23.927849769592285,0 +5842,0.17101836204528809,0.19001504778862,0.18505923449993134,0.28900641202926636,891.2169799804688,1e-05,0.08239421248435974,2.360261917114258,23.927849769592285,0 +5843,0.3579164445400238,0.11959293484687805,0.13246648013591766,0.2142307609319687,928.828369140625,1e-05,0.07445237785577774,2.3500444889068604,23.927849769592285,0 +5844,0.31215590238571167,0.16415823996067047,0.16684600710868835,0.26144230365753174,434.0730895996094,1e-05,0.08503769338130951,2.5676610469818115,23.927849769592285,0 +5845,0.1486901342868805,0.601543664932251,0.6060118675231934,0.2113140970468521,125.89928436279297,1e-05,0.06961087882518768,2.4539544582366943,23.927849769592285,0 +5846,0.07930786162614822,0.38375067710876465,0.40990328788757324,0.18141025304794312,995.9349365234375,1e-05,0.06458697468042374,2.501986265182495,23.927849769592285,0 +5847,0.2285362035036087,0.23316596448421478,0.21955139935016632,0.2243589609861374,979.9048461914062,1e-05,0.07300395518541336,2.3601372241973877,23.927849769592285,0 +5848,0.13440045714378357,0.2158372402191162,0.21179111301898956,0.24987179040908813,576.5086669921875,1e-05,0.07350260019302368,2.4656004905700684,23.927849769592285,0 +5849,0.22378702461719513,0.22844728827476501,0.21976524591445923,0.21067306399345398,921.0526123046875,1e-05,0.07934370636940002,2.503411054611206,23.927849769592285,0 +5850,0.19842131435871124,0.1235639676451683,0.12465636432170868,0.23724357783794403,915.4175415039062,1e-05,0.0702919140458107,2.354861259460449,23.927849769592285,0 +5851,0.2261931449174881,0.15776561200618744,0.15854600071907043,0.2619551122188568,724.7899169921875,1e-05,0.07757718116044998,2.357975721359253,23.927849769592285,0 +5852,0.25292250514030457,0.23757848143577576,0.23281103372573853,0.19060896337032318,845.2072143554688,1e-05,0.07866436243057251,2.472688674926758,23.927849769592285,0 +5853,0.16264274716377258,0.28387969732284546,0.26541993021965027,0.25826922059059143,983.1340942382812,1e-05,0.07032101601362228,2.367171287536621,23.927849769592285,0 +5854,0.12720239162445068,0.17026592791080475,0.1715451180934906,0.09801281988620758,867.0343017578125,1e-05,0.07655514031648636,2.3546340465545654,23.927849769592285,0 +5855,0.35437124967575073,0.13915465772151947,0.13565048575401306,0.2519230544567108,736.0197143554688,1e-05,0.07970943301916122,2.5463802814483643,23.927849769592285,0 +5856,0.1994059681892395,0.15060292184352875,0.1492231786251068,0.19365383684635162,793.795654296875,1e-05,0.07777418941259384,2.531839609146118,23.927849769592285,0 +5857,0.15221455693244934,0.09615027904510498,0.10356125980615616,0.08044871687889099,906.9703979492188,1e-05,0.07089449465274811,2.573662281036377,23.927849769592285,0 +5858,0.1634441316127777,0.1846815049648285,0.18796586990356445,0.16701921820640564,966.1671142578125,1e-05,0.06302537769079208,2.360837697982788,23.927849769592285,0 +5859,0.24911601841449738,0.3316311836242676,0.3378450870513916,0.24384614825248718,993.4319458007812,1e-05,0.09185822308063507,2.593736171722412,23.927849769592285,0 +5860,0.20294873416423798,0.2587505578994751,0.2587164044380188,0.2562820315361023,950.6705322265625,1e-05,0.06834174692630768,2.513417959213257,23.927849769592285,0 +5861,0.08709073066711426,0.16252566874027252,0.16109097003936768,0.2240705043077469,745.9677734375,1e-05,0.06535851955413818,2.3597350120544434,23.927849769592285,0 +5862,0.24663282930850983,0.10640132427215576,0.10120244324207306,0.26067307591438293,838.8157958984375,1e-05,0.0718364417552948,2.359734535217285,23.927849769592285,0 +5863,0.17247793078422546,0.1276940405368805,0.12706254422664642,0.24464742839336395,975.15380859375,1e-05,0.07506920397281647,2.4684438705444336,23.927849769592285,0 +5864,0.14836810529232025,0.13746218383312225,0.12558196485042572,0.229935884475708,793.795654296875,1e-05,0.07694349437952042,2.3642969131469727,23.927849769592285,0 +5865,0.16436117887496948,0.22030167281627655,0.21304503083229065,0.20551280677318573,528.291015625,1e-05,0.0721503272652626,2.466390609741211,23.927849769592285,0 +5866,0.15704800188541412,0.1670731157064438,0.16353468596935272,0.2499999850988388,865.6211547851562,1e-05,0.07864917069673538,2.486539602279663,23.927849769592285,0 +5867,0.19656676054000854,0.2754753828048706,0.27514657378196716,0.2202884554862976,988.2747802734375,1e-05,0.06446810811758041,2.3568129539489746,23.927849769592285,0 +5868,0.3165486454963684,0.1932152658700943,0.2016887068748474,0.1832692176103592,676.6055297851562,1e-05,0.08298870921134949,2.4905600547790527,23.927849769592285,0 +5869,0.13212093710899353,0.1485518515110016,0.1484164446592331,0.24128204584121704,739.3790893554688,1e-05,0.07791722565889359,2.4795687198638916,23.927849769592285,0 +5870,0.21434295177459717,0.5943295955657959,0.6278684139251709,0.2516666650772095,70.75472259521484,1e-05,0.07860265672206879,2.360583782196045,23.927849769592285,0 +5871,0.16201385855674744,0.07172997295856476,0.07057361304759979,0.2189422994852066,895.2894897460938,1e-05,0.06447461992502213,2.3536489009857178,23.927849769592285,0 +5872,0.13388724625110626,0.12697122991085052,0.1323012411594391,0.27426281571388245,716.7235717773438,1e-05,0.06290984153747559,2.3483388423919678,23.927849769592285,0 +5873,0.22649872303009033,0.15763631463050842,0.1523367017507553,0.19852563738822937,941.8146362304688,1e-05,0.07599706947803497,2.3493692874908447,23.927849769592285,0 +5874,0.18747077882289886,0.20913107693195343,0.21055059134960175,0.22833332419395447,847.8120727539062,1e-05,0.07415497303009033,2.4715023040771484,23.927849769592285,0 +5875,0.26131460070610046,0.18723858892917633,0.18513742089271545,0.24503204226493835,904.3141479492188,1e-05,0.06911086291074753,2.3534483909606934,23.927849769592285,0 +5876,0.16221776604652405,0.20447996258735657,0.2126069813966751,0.27849358320236206,995.10595703125,1e-05,0.07018745690584183,2.4794797897338867,23.927849769592285,0 +5877,0.1404845416545868,0.08349577337503433,0.08693081140518188,0.14230768382549286,657.0208740234375,1e-05,0.08496726304292679,2.5150625705718994,23.927849769592285,0 +5878,0.2226523905992508,0.35098886489868164,0.3323875665664673,0.21512819826602936,988.2747802734375,1e-05,0.06901837885379791,2.47518253326416,23.927849769592285,0 +5879,0.16543777287006378,0.15603654086589813,0.1619778871536255,0.12945511937141418,416.6666564941406,1e-05,0.07134146243333817,2.351938009262085,23.927849769592285,0 +5880,0.24052214622497559,0.18454189598560333,0.18059736490249634,0.18916666507720947,822.50341796875,1e-05,0.07419431209564209,2.587434768676758,23.927849769592285,0 +5881,0.17222066223621368,0.1883922517299652,0.1940755546092987,0.13429486751556396,493.3414306640625,1e-05,0.07810674607753754,2.5437123775482178,23.927849769592285,0 +5882,0.17130166292190552,0.6857554316520691,0.6813050508499146,0.3272756338119507,92.59259796142578,1e-05,0.05565663427114487,2.358626365661621,23.927849769592285,0 +5883,0.16338784992694855,0.1512305736541748,0.14081338047981262,0.11842948198318481,918.6107788085938,1e-05,0.06664353609085083,2.357616662979126,23.927849769592285,0 +5884,0.1816965788602829,0.25971275568008423,0.2586662769317627,0.10461538285017014,991.9489135742188,1e-05,0.06655504554510117,2.498256206512451,23.927849769592285,0 +5885,0.10447178035974503,0.2569997310638428,0.24259868264198303,0.2729807496070862,963.8278198242188,1e-05,0.06414031237363815,2.355832099914551,23.927849769592285,0 +5886,0.26871174573898315,0.2506949007511139,0.27888771891593933,0.27182692289352417,176.11683654785156,1e-05,0.07732444256544113,2.3508784770965576,23.927849769592285,0 +5887,0.2907395660877228,0.2066846787929535,0.20062892138957977,0.24794870615005493,555.5556030273438,1e-05,0.07303439825773239,2.5930283069610596,23.927849769592285,0 +5888,0.24201957881450653,0.3855573236942291,0.37462159991264343,0.20102563500404358,285.49383544921875,1e-05,0.0735335648059845,2.3576390743255615,23.927849769592285,0 +5889,0.21514253318309784,0.28270161151885986,0.2754571735858917,0.25477564334869385,254.77706909179688,1e-05,0.06894128769636154,2.5101418495178223,23.927849769592285,0 +5890,0.2360428273677826,0.14557616412639618,0.14310643076896667,0.2558653652667999,711.2069091796875,1e-05,0.07264743745326996,2.355816125869751,23.927849769592285,0 +5891,0.14875206351280212,0.1698198765516281,0.1627705693244934,0.2356410175561905,874.3990478515625,1e-05,0.06283389776945114,2.479694128036499,23.927849769592285,0 +5892,0.3177803158760071,0.16410917043685913,0.16256001591682434,0.24288460612297058,811.7109985351562,1e-05,0.07350342720746994,2.3572537899017334,23.927849769592285,0 +5893,0.1444573849439621,0.13071972131729126,0.13004130125045776,0.23221153020858765,847.2938232421875,1e-05,0.06846848130226135,2.3507633209228516,23.927849769592285,0 +5894,0.301382452249527,0.1166616827249527,0.1189367026090622,0.09711538255214691,748.3948974609375,1e-05,0.08535604178905487,2.3489341735839844,23.927849769592285,0 +5895,0.21433842182159424,0.3482857644557953,0.37629443407058716,0.21391025185585022,141.84397888183594,1e-05,0.07597463577985764,2.473910331726074,23.927849769592285,0 +5896,0.1771983653306961,0.17284546792507172,0.17800113558769226,0.16987179219722748,649.0385131835938,1e-05,0.05798666551709175,2.352297306060791,23.927849769592285,0 +5897,0.2864181399345398,0.15819773077964783,0.1579345464706421,0.28035256266593933,767.0015869140625,1e-05,0.06897368282079697,2.3530426025390625,23.927849769592285,0 +5898,0.25279098749160767,0.2385219782590866,0.22859260439872742,0.23817306756973267,820.7417602539062,1e-05,0.08084356784820557,2.50919508934021,23.927849769592285,0 +5899,0.1425636261701584,0.15715721249580383,0.14960525929927826,0.21842947602272034,913.978515625,1e-05,0.061939314007759094,2.3496546745300293,23.927849769592285,0 +5900,0.2594403922557831,0.19139450788497925,0.18960997462272644,0.2547435760498047,484.06866455078125,1e-05,0.0664098933339119,2.5343515872955322,23.927849769592285,0 +5901,0.19948710501194,0.1991901695728302,0.19128234684467316,0.28999999165534973,852.4172973632812,1e-05,0.0723506361246109,2.5055017471313477,23.927849769592285,0 +5902,0.2432074248790741,0.7452835440635681,0.7456021308898926,0.17028845846652985,70.75472259521484,1e-05,0.08064505457878113,2.49407696723938,23.927849769592285,0 +5903,0.11275196075439453,0.03828075900673866,0.037141211330890656,0.07067307084798813,802.9328002929688,1e-05,0.060621440410614014,2.3506217002868652,23.927849769592285,0 +5904,0.1681695282459259,0.1761111170053482,0.17456811666488647,0.10403845459222794,601.6597900390625,1e-05,0.0755285695195198,2.3522021770477295,23.927849769592285,0 +5905,0.2193087637424469,0.17038938403129578,0.1655641347169876,0.2720192074775696,857.9046020507812,1e-05,0.07572908699512482,2.4821436405181885,23.927849769592285,0 +5906,0.25419554114341736,0.24869804084300995,0.24417582154273987,0.30907049775123596,544.5823974609375,1e-05,0.06796076893806458,2.3634655475616455,23.927849769592285,0 +5907,0.2030661702156067,0.20784476399421692,0.19436115026474,0.291698694229126,968.7218017578125,1e-05,0.07556968182325363,2.34916353225708,23.927849769592285,0 +5908,0.2108096182346344,0.3170165717601776,0.32409921288490295,0.1966666579246521,257.9365234375,1e-05,0.07232401520013809,2.487452268600464,23.927849769592285,0 +5909,0.0686594694852829,0.12946517765522003,0.12999685108661652,0.11657050997018814,934.9798583984375,1e-05,0.07558800280094147,2.3565263748168945,23.927849769592285,0 +5910,0.15506193041801453,0.11669614166021347,0.11461815983057022,0.2671794891357422,942.7236938476562,1e-05,0.08251085132360458,2.3515102863311768,23.927849769592285,0 +5911,0.1490786075592041,0.12141791731119156,0.12187499552965164,0.07208333164453506,803.5714111328125,1e-05,0.06474658101797104,2.510556221008301,23.927849769592285,0 +5912,0.3002949357032776,0.10412876307964325,0.11137411743402481,0.24262820184230804,855.4293212890625,1e-05,0.10999532043933868,2.7156317234039307,23.927849769592285,0 +5913,0.16246484220027924,0.35525596141815186,0.32993820309638977,0.23243588209152222,996.3473510742188,1e-05,0.05857965350151062,2.363738536834717,23.927849769592285,0 +5914,0.26994454860687256,0.2631494104862213,0.26613056659698486,0.2541345953941345,396.1748962402344,1e-05,0.06466497480869293,2.348020553588867,23.927849769592285,0 +5915,0.24818727374076843,0.20080778002738953,0.18380114436149597,0.22403845191001892,905.0772094726562,1e-05,0.09163045883178711,2.350024938583374,23.927849769592285,0 +5916,0.17047467827796936,0.2040434330701828,0.214534193277359,0.3008333146572113,294.342529296875,1e-05,0.09372200816869736,2.4908981323242188,23.927849769592285,0 +5917,0.15914273262023926,0.16883987188339233,0.16567113995552063,0.20291665196418762,627.4900512695312,1e-05,0.07488814741373062,2.3530609607696533,23.927849769592285,0 +5918,0.07664936035871506,0.4619070589542389,0.5193513631820679,0.16528844833374023,52.6819953918457,1e-05,0.09091529995203018,2.346961736679077,23.927849769592285,0 +5919,0.2424553483724594,0.15181221067905426,0.14731581509113312,0.2348717898130417,769.2307739257812,1e-05,0.06426696479320526,2.6892497539520264,23.927849769592285,0 +5920,0.13470298051834106,0.1817837655544281,0.18635053932666779,0.24503204226493835,969.2273559570312,1e-05,0.07457285374403,2.3535397052764893,23.927849769592285,0 +5921,0.15085607767105103,0.2406313568353653,0.23113802075386047,0.24833332002162933,819.5592651367188,1e-05,0.07178590446710587,2.4785802364349365,23.927849769592285,0 +5922,0.16856232285499573,0.2092282623052597,0.19744132459163666,0.25987178087234497,941.5103759765625,1e-05,0.0668567419052124,2.357060194015503,23.927849769592285,0 +5923,0.28187039494514465,0.2778336703777313,0.2837599217891693,0.24038460850715637,336.25732421875,1e-05,0.09190412610769272,2.4826226234436035,23.927849769592285,0 +5924,0.170485720038414,0.16735243797302246,0.1519773304462433,0.15141025185585022,670.22265625,1e-05,0.06791602075099945,2.354156255722046,23.927849769592285,0 +5925,0.17073345184326172,0.3406665623188019,0.3444755971431732,0.2805769145488739,285.49383544921875,1e-05,0.06603509187698364,2.3471126556396484,23.927849769592285,0 +5926,0.22486011683940887,0.11288686841726303,0.1316508948802948,0.2205769121646881,943.3267822265625,1e-05,0.07201847434043884,2.4816291332244873,23.927849769592285,0 +5927,0.294415146112442,0.2503412961959839,0.24692875146865845,0.17461538314819336,367.23162841796875,1e-05,0.10346852988004684,2.3538715839385986,23.927849769592285,0 +5928,0.23893876373767853,0.15965557098388672,0.1596558392047882,0.15362179279327393,839.89501953125,1e-05,0.08574216067790985,2.345048427581787,23.927849769592285,0 +5929,0.12941385805606842,0.16883018612861633,0.17053990066051483,0.2622756361961365,896.8926391601562,1e-05,0.06966143101453781,2.3494303226470947,23.927849769592285,0 +5930,0.28657469153404236,0.13992813229560852,0.13502968847751617,0.26105767488479614,792.4597778320312,1e-05,0.09709567576646805,2.5795838832855225,23.927849769592285,0 +5931,0.21026957035064697,0.1474320888519287,0.14589066803455353,0.06692307442426682,597.59912109375,1e-05,0.0932038426399231,2.3488104343414307,23.927849769592285,0 +5932,0.34070855379104614,0.12436745315790176,0.12515465915203094,0.13173076510429382,855.4293212890625,1e-05,0.08118578046560287,2.5679075717926025,23.927849769592285,0 +5933,0.23060771822929382,0.20341746509075165,0.1932533085346222,0.2749999761581421,605.6701049804688,1e-05,0.07121926546096802,2.4793128967285156,23.927849769592285,0 +5934,0.22650490701198578,0.23529928922653198,0.22849413752555847,0.2117948681116104,754.75439453125,1e-05,0.07137586921453476,2.5847132205963135,23.927849769592285,0 +5935,0.2057696282863617,0.11445887386798859,0.11972761154174805,0.29490384459495544,881.4859008789062,1e-05,0.08836998790502548,2.362612247467041,23.927849769592285,0 +5936,0.058613039553165436,0.138762965798378,0.1382979452610016,0.20365384221076965,944.2269897460938,1e-05,0.07742470502853394,2.344010829925537,23.927849769592285,0 +5937,0.24143391847610474,0.13271217048168182,0.13458099961280823,0.23897434771060944,616.125732421875,1e-05,0.0725250393152237,2.4716687202453613,23.927849769592285,0 +5938,0.17914213240146637,0.23161759972572327,0.24066804349422455,0.16224358975887299,815.9722900390625,1e-05,0.07184769958257675,2.3480987548828125,23.927849769592285,0 +5939,0.15441913902759552,0.17924170196056366,0.17274996638298035,0.22871793806552887,941.20556640625,1e-05,0.0943436250090599,2.3469996452331543,23.927849769592285,0 +5940,0.39829713106155396,0.3652142286300659,0.3684879243373871,0.2499999850988388,251.59742736816406,1e-05,0.10600750893354416,2.4856319427490234,23.927849769592285,0 +5941,0.16853956878185272,0.23779922723770142,0.22511865198612213,0.30051282048225403,886.6278686523438,1e-05,0.058636873960494995,2.4606592655181885,23.927849769592285,0 +5942,0.18520966172218323,0.1266414225101471,0.12756797671318054,0.11442307382822037,772.1712036132812,1e-05,0.09841950237751007,2.34857177734375,23.927849769592285,0 +5943,0.2062993198633194,0.1568523645401001,0.15578807890415192,0.18814101815223694,789.7643432617188,1e-05,0.1185467466711998,2.7162394523620605,23.927849769592285,0 +5944,0.131694495677948,0.25845009088516235,0.24838344752788544,0.24618588387966156,818.9655151367188,1e-05,0.07567571103572845,2.4737308025360107,23.927849769592285,0 +5945,0.16546128690242767,0.20631444454193115,0.2031519114971161,0.19118589162826538,952.6641235351562,1e-05,0.07012505829334259,2.354355573654175,23.927849769592285,0 +5946,0.2832922339439392,0.1354522407054901,0.1277807354927063,0.20124998688697815,590.71728515625,1e-05,0.09624595940113068,2.348903179168701,23.927849769592285,0 +5947,0.2917461097240448,0.0966886430978775,0.1001296117901802,0.06990384310483932,769.2307739257812,1e-05,0.06655453145503998,2.4894533157348633,23.927849769592285,0 +5948,0.44566527009010315,0.3115849792957306,0.29953521490097046,0.21358974277973175,429.7900695800781,1e-05,0.08837670832872391,2.354156732559204,23.927849769592285,0 +5949,0.18868094682693481,0.2570456564426422,0.2544550895690918,0.26653844118118286,650.1919555664062,1e-05,0.06646541506052017,2.3509812355041504,23.927849769592285,0 +5950,0.21022675931453705,0.13227443397045135,0.1321774274110794,0.2142307609319687,948.067626953125,1e-05,0.08110910654067993,2.3455913066864014,23.927849769592285,0 +5951,0.34473955631256104,0.3352070450782776,0.3227357566356659,0.2975640892982483,276.479736328125,1e-05,0.08372488617897034,2.515794277191162,23.927849769592285,0 +5952,0.20628488063812256,0.11083508282899857,0.11124008893966675,0.08980768918991089,714.8972778320312,1e-05,0.0732138380408287,2.459707736968994,23.927849769592285,0 +5953,0.1597001850605011,0.21433025598526,0.21990665793418884,0.25958332419395447,362.2159423828125,1e-05,0.05969592556357384,2.4717304706573486,23.927849769592285,0 +5954,0.27356475591659546,0.11570228636264801,0.11340824514627457,0.22022435069084167,841.503173828125,1e-05,0.08306229114532471,2.4782252311706543,23.927849769592285,0 +5955,0.1745757907629013,0.2757081091403961,0.26726776361465454,0.32163459062576294,952.3810424804688,1e-05,0.08189184218645096,2.5935137271881104,23.927849769592285,0 +5956,0.17868909239768982,0.1270885318517685,0.12858101725578308,0.21650640666484833,815.9722900390625,1e-05,0.0668102353811264,2.352992296218872,23.927849769592285,0 +5957,0.13684794306755066,0.15449611842632294,0.1470528095960617,0.26945510506629944,772.9007568359375,1e-05,0.06757140904664993,2.346503973007202,23.927849769592285,0 +5958,0.17390155792236328,0.18196645379066467,0.16875706613063812,0.30048075318336487,757.8740844726562,1e-05,0.08474645763635635,2.4700875282287598,23.927849769592285,0 +5959,0.22087779641151428,0.3070184886455536,0.2946244180202484,0.2514423131942749,442.5064697265625,1e-05,0.069199338555336,2.3491058349609375,23.927849769592285,0 +5960,0.21330790221691132,0.23566582798957825,0.2384704202413559,0.23423075675964355,976.8355712890625,1e-05,0.07521704584360123,2.35024356842041,23.927849769592285,0 +5961,0.17442767322063446,0.14207077026367188,0.14305159449577332,0.18522435426712036,898.8763427734375,1e-05,0.06251850724220276,2.3449113368988037,23.927849769592285,0 +5962,0.07162372022867203,0.2948903441429138,0.2840849459171295,0.18157050013542175,964.0897216796875,1e-05,0.05896570533514023,2.5961556434631348,23.927849769592285,0 +5963,0.19435647130012512,0.20714038610458374,0.2112307995557785,0.19150640070438385,425.4617614746094,1e-05,0.07280537486076355,2.3639609813690186,23.927849769592285,0 +5964,0.10720360279083252,0.1335948258638382,0.12380953133106232,0.17692306637763977,757.8740844726562,1e-05,0.0769742876291275,2.504361391067505,23.927849769592285,0 +5965,0.09817185997962952,0.1463220864534378,0.14048145711421967,0.27945512533187866,943.0255737304688,1e-05,0.11812431365251541,2.611043691635132,23.927849769592285,0 +5966,0.3626924157142639,0.8599612712860107,0.8823267221450806,0.21666665375232697,34.046695709228516,1e-05,0.07384089380502701,2.3550424575805664,23.927849769592285,0 +5967,0.21047979593276978,0.20292867720127106,0.19591458141803741,0.1874038428068161,598.9583129882812,1e-05,0.07465440779924393,2.349102735519409,23.927849769592285,0 +5968,0.15591776371002197,0.21356365084648132,0.23638249933719635,0.2569230794906616,317.1641845703125,1e-05,0.07657020539045334,2.483588695526123,23.927849769592285,0 +5969,0.23051762580871582,0.22923681139945984,0.22103561460971832,0.23182691633701324,915.4175415039062,1e-05,0.05815047398209572,2.357877254486084,23.927849769592285,0 +5970,0.1489933878183365,0.11227598041296005,0.10872264206409454,0.1899999976158142,623.7474975585938,1e-05,0.07139240205287933,2.3530361652374268,23.927849769592285,0 +5971,0.2319808006286621,0.17590227723121643,0.16960537433624268,0.23483973741531372,887.8910522460938,1e-05,0.06955264508724213,2.347430944442749,23.927849769592285,0 +5972,0.1732627898454666,0.15997914969921112,0.1584150493144989,0.27253204584121704,839.89501953125,1e-05,0.06760063022375107,2.4620532989501953,23.927849769592285,0 +5973,0.22813266515731812,0.2627466022968292,0.26758697628974915,0.26423075795173645,438.31170654296875,1e-05,0.07999861240386963,2.4781100749969482,23.927849769592285,0 +5974,0.3087090849876404,0.24611365795135498,0.2623691260814667,0.1050320491194725,208.3333282470703,1e-05,0.059915196150541306,2.3598523139953613,23.927849769592285,0 +5975,0.2596166729927063,0.18618269264698029,0.17917847633361816,0.2583012580871582,723.90576171875,1e-05,0.16776368021965027,2.606691837310791,23.927849769592285,0 +5976,0.14583691954612732,0.12836915254592896,0.12863700091838837,0.2919551134109497,930.4703369140625,1e-05,0.07016926258802414,2.601198196411133,23.927849769592285,0 +5977,0.2213110327720642,0.24504201114177704,0.24364177882671356,0.27858972549438477,623.7474975585938,1e-05,0.0635647252202034,2.349440813064575,23.927849769592285,0 +5978,0.11193174123764038,0.14517168700695038,0.14643751084804535,0.22923076152801514,707.4652709960938,1e-05,0.07075206190347672,2.350972890853882,23.927849769592285,0 +5979,0.12209174782037735,0.3078291118144989,0.3018345832824707,0.19759614765644073,971.4794311523438,1e-05,0.07223488390445709,2.497875690460205,23.927849769592285,0 +5980,0.2610563635826111,0.15747448801994324,0.14883524179458618,0.21916665136814117,812.3250122070312,1e-05,0.06665774434804916,2.3501617908477783,23.927849769592285,0 +5981,0.16274622082710266,0.263999342918396,0.2585451602935791,0.1428525596857071,957.1228637695312,1e-05,0.06459524482488632,2.348109245300293,23.927849769592285,0 +5982,0.3330059051513672,0.26210200786590576,0.2583014667034149,0.23410256206989288,464.8240966796875,1e-05,0.07642665505409241,2.3514323234558105,23.927849769592285,0 +5983,0.310523122549057,0.4554116427898407,0.4438088536262512,0.15929485857486725,994.4806518554688,1e-05,0.07399896532297134,2.560662031173706,23.927849769592285,0 +5984,0.14901557564735413,0.14759859442710876,0.14911703765392303,0.23810896277427673,931.1224365234375,1e-05,0.07099225372076035,2.574887275695801,23.927849769592285,0 +5985,0.3037118911743164,0.19215117394924164,0.18800239264965057,0.23352563381195068,697.8798828125,1e-05,0.06902223825454712,2.461228370666504,23.927849769592285,0 +5986,0.1664692908525467,0.25336286425590515,0.24401918053627014,0.24657049775123596,943.9275512695312,1e-05,0.055823154747486115,2.631993055343628,23.927849769592285,0 +5987,0.20916709303855896,0.21589243412017822,0.21375960111618042,0.29035255312919617,496.98797607421875,1e-05,0.06901943683624268,2.483365535736084,23.927849769592285,0 +5988,0.15884944796562195,0.16834111511707306,0.16079513728618622,0.23310896754264832,749.19873046875,1e-05,0.07140494883060455,2.3521618843078613,23.927849769592285,0 +5989,0.18652397394180298,0.2580322325229645,0.24993681907653809,0.24182690680027008,963.0394287109375,1e-05,0.05819137394428253,2.4781124591827393,23.927849769592285,0 +5990,0.21900856494903564,0.21428263187408447,0.20146484673023224,0.2541345953941345,951.5281982421875,1e-05,0.06799422204494476,2.359912157058716,23.927849769592285,0 +5991,0.14067161083221436,0.22599288821220398,0.23112894594669342,0.2666987180709839,982.677490234375,1e-05,0.06443382799625397,2.3498194217681885,23.927849769592285,0 +5992,0.2039482146501541,0.21315701305866241,0.20568020641803741,0.24878203868865967,658.1439819335938,1e-05,0.07872553169727325,2.350632905960083,23.927849769592285,0 +5993,0.25974389910697937,0.26434335112571716,0.2602781057357788,0.21028845012187958,924.4791870117188,1e-05,0.06539014726877213,2.354933738708496,23.927849769592285,0 +5994,0.18805964291095734,0.19229070842266083,0.1896481066942215,0.22923076152801514,549.327392578125,1e-05,0.07324884086847305,2.537466526031494,23.927849769592285,0 +5995,0.26688137650489807,0.09077323973178864,0.09494763612747192,0.11865384131669998,786.3502197265625,1e-05,0.06560800969600677,2.5291974544525146,23.927849769592285,0 +5996,0.2628457546234131,0.10956428200006485,0.10948803275823593,0.0038461536169052124,663.6961059570312,1e-05,0.06696947664022446,2.3562514781951904,23.927849769592285,0 +5997,0.21331243216991425,0.19412750005722046,0.19719134271144867,0.24022434651851654,982.4486694335938,1e-05,0.07075056433677673,2.6722254753112793,23.927849769592285,0 +5998,0.13782812654972076,0.12608090043067932,0.13047610223293304,0.12942306697368622,951.8129272460938,1e-05,0.08574359863996506,2.3543474674224854,23.927849769592285,0 +5999,0.22139737010002136,0.23450875282287598,0.23409952223300934,0.22157050669193268,462.8463439941406,1e-05,0.0767323300242424,2.34891939163208,23.927849769592285,0 +6000,0.18324321508407593,0.07381346076726913,0.08071933686733246,0.1144871786236763,619.959716796875,1e-05,0.07626557350158691,2.5043747425079346,23.927849769592285,0 +6001,0.1726415902376175,0.5321806073188782,0.4798084497451782,0.21602563560009003,994.6895141601562,1e-05,0.07863593846559525,2.3501646518707275,23.927849769592285,0 +6002,0.1926552951335907,0.21494340896606445,0.20850789546966553,0.2558653652667999,964.872314453125,1e-05,0.07137397676706314,2.343902587890625,23.927849769592285,0 +6003,0.1985234022140503,0.16994011402130127,0.1693391501903534,0.20333333313465118,609.6311645507812,1e-05,0.07238218933343887,2.3433518409729004,23.927849769592285,0 +6004,0.1737011820077896,0.13621476292610168,0.12746307253837585,0.21592947840690613,745.9677734375,1e-05,0.06859173625707626,2.4692375659942627,23.927849769592285,0 +6005,0.09252738952636719,0.1739887297153473,0.17210720479488373,0.21791665256023407,828.8410034179688,1e-05,0.06934536248445511,2.5273773670196533,23.927850246429443,0 +6006,0.19481605291366577,0.13390275835990906,0.12963072955608368,0.20455127954483032,870.7523803710938,1e-05,0.06931683421134949,2.3545496463775635,23.927850246429443,0 +6007,0.3455479145050049,0.18938840925693512,0.1748700886964798,0.23666666448116302,936.5596923828125,1e-05,0.08130142092704773,2.5180442333221436,23.927850246429443,0 +6008,0.20157909393310547,0.23651070892810822,0.2245916724205017,0.22980768978595734,686.9369506835938,1e-05,0.07662711292505264,2.6093802452087402,23.927850246429443,0 +6009,0.15925292670726776,0.10512255132198334,0.10223446786403656,0.20253203809261322,663.6961059570312,1e-05,0.06316561251878738,2.359522819519043,23.927850246429443,0 +6010,0.2356298714876175,0.21265093982219696,0.2180652916431427,0.24157050251960754,500.59954833984375,1e-05,0.0761934369802475,2.3649978637695312,23.927850246429443,0 +6011,0.13274361193180084,0.1157405897974968,0.11447691172361374,0.23923076689243317,811.095458984375,1e-05,0.07492835819721222,2.5833380222320557,23.927850246429443,0 +6012,0.29569077491760254,0.1489996463060379,0.14420431852340698,0.20198717713356018,764.7515258789062,1e-05,0.06728707998991013,2.364217519760132,23.927850246429443,0 +6013,0.2563164532184601,0.19431009888648987,0.1901424378156662,0.23932690918445587,663.6961059570312,1e-05,0.10469554364681244,2.356292724609375,23.927850246429443,0 +6014,0.15040095150470734,0.45003634691238403,0.42579907178878784,0.2305128127336502,992.58642578125,1e-05,0.05765499547123909,2.3585968017578125,23.927850246429443,0 +6015,0.20181557536125183,0.1523173749446869,0.16662421822547913,0.21987178921699524,708.4055786132812,1e-05,0.06269045919179916,2.5600106716156006,23.927850246429443,0 +6016,0.3095564544200897,0.15607476234436035,0.15264058113098145,0.24432691931724548,965.9091796875,1e-05,0.07661513239145279,2.3675341606140137,23.927850246429443,0 +6017,0.16803395748138428,0.2009214609861374,0.18612763285636902,0.2639102339744568,844.1558227539062,1e-05,0.0765429362654686,2.355095148086548,23.927850246429443,0 +6018,0.09973475337028503,0.2216011881828308,0.21922250092029572,0.12282051146030426,964.0897216796875,1e-05,0.0838833600282669,2.6077890396118164,23.927850246429443,0 +6019,0.13724395632743835,0.15020246803760529,0.1470823585987091,0.22157050669193268,837.1862182617188,1e-05,0.0790197104215622,2.499415636062622,23.927850246429443,0 +6020,0.22636865079402924,0.26405349373817444,0.24150006473064423,0.22509615123271942,969.7308959960938,1e-05,0.07967071235179901,2.3548691272735596,23.927850246429443,0 +6021,0.17653264105319977,0.18864773213863373,0.18808700144290924,0.27512818574905396,853.4264526367188,1e-05,0.06916505843400955,2.595946788787842,23.927850246429443,0 +6022,0.14073607325553894,0.23858781158924103,0.2350248098373413,0.29423075914382935,918.9618530273438,1e-05,0.07254503667354584,2.3583412170410156,23.927850246429443,0 +6023,0.2737163305282593,0.2166023999452591,0.21161000430583954,0.1783333271741867,928.1668090820312,1e-05,0.07334627211093903,2.349116086959839,23.927850246429443,0 +6024,0.23162898421287537,0.4629441201686859,0.46096324920654297,0.23057691752910614,141.84397888183594,1e-05,0.08147800713777542,2.3511219024658203,23.927850246429443,0 +6025,0.15370717644691467,0.22448354959487915,0.21823059022426605,0.19499999284744263,717.632080078125,1e-05,0.07889047265052795,2.347529172897339,23.927850246429443,0 +6026,0.12854884564876556,0.11593344807624817,0.1186157837510109,0.16855768859386444,931.447509765625,1e-05,0.07016443461179733,2.6441264152526855,23.927850246429443,0 +6027,0.33049285411834717,0.15683810412883759,0.14827083051204681,0.28948718309402466,867.9705810546875,1e-05,0.09582439810037613,2.361027956008911,23.927850246429443,0 +6028,0.23685552179813385,0.34121981263160706,0.31005582213401794,0.24048076570034027,988.9306640625,1e-05,0.06832464039325714,2.4517598152160645,23.927850246429443,0 +6029,0.22717709839344025,0.06589540094137192,0.0711197629570961,0.1574999988079071,919.6617431640625,1e-05,0.06528578698635101,2.6184794902801514,23.927850246429443,0 +6030,0.2526411712169647,0.4482401907444,0.4558001458644867,0.22673076391220093,121.84115600585938,1e-05,0.08566121011972427,2.357814073562622,23.927850246429443,0 +6031,0.1277855634689331,0.15600016713142395,0.15120163559913635,0.30060896277427673,924.81787109375,1e-05,0.07027314603328705,2.349952459335327,23.927850246429443,0 +6032,0.08808856457471848,0.16044694185256958,0.15895001590251923,0.23301281034946442,941.8146362304688,1e-05,0.05454206466674805,2.5325634479522705,23.927850246429443,0 +6033,0.22230447828769684,0.2972484230995178,0.29668259620666504,0.20769229531288147,452.8061218261719,1e-05,0.07488573342561722,2.348665952682495,23.927850246429443,0 +6034,0.1603967249393463,0.9213556051254272,0.9226046800613403,0.15512819588184357,38.75969314575195,1e-05,0.0691450908780098,2.3507838249206543,23.927850246429443,0 +6035,0.2654152810573578,0.2054009884595871,0.1930069774389267,0.24333332479000092,940.5940551757812,1e-05,0.07959285378456116,2.351270914077759,23.927850246429443,0 +6036,0.06970294564962387,0.16094142198562622,0.1612136960029602,0.23323717713356018,941.8146362304688,1e-05,0.06248610094189644,2.5670082569122314,23.927850246429443,0 +6037,0.09046713262796402,0.2127828747034073,0.2169468253850937,0.2152884602546692,986.50927734375,1e-05,0.0633080005645752,2.3655080795288086,23.927850246429443,0 +6038,0.15302801132202148,0.11911455541849136,0.11858713626861572,0.16874998807907104,956.0206298828125,1e-05,0.08674585819244385,2.3520543575286865,23.927850246429443,0 +6039,0.15444205701351166,0.17540764808654785,0.18668365478515625,0.21669870615005493,812.3250122070312,1e-05,0.07277598232030869,2.5165903568267822,23.927850246429443,0 +6040,0.1906869262456894,0.09119301289319992,0.08790402114391327,0.17666666209697723,942.7236938476562,1e-05,0.06659042090177536,2.5960919857025146,23.927850246429443,0 +6041,0.22057005763053894,0.19297051429748535,0.19319947063922882,0.16471153497695923,576.5086669921875,1e-05,0.09630981832742691,2.354841470718384,23.927850246429443,0 +6042,0.1564732939004898,0.09264932572841644,0.10345926135778427,0.17926281690597534,468.75,1e-05,0.08240599930286407,2.350942373275757,23.927850246429443,0 +6043,0.3130505084991455,0.2158568948507309,0.2208184152841568,0.14971153438091278,681.8181762695312,1e-05,0.08655888587236404,2.556222438812256,23.927850246429443,0 +6044,0.1312568336725235,0.19906581938266754,0.17458173632621765,0.23368589580059052,852.9224853515625,1e-05,0.08622302860021591,2.3501780033111572,23.927850246429443,0 +6045,0.12791070342063904,0.195168137550354,0.19359631836414337,0.24823717772960663,966.6818237304688,1e-05,0.08493471890687943,2.349316358566284,23.927850246429443,0 +6046,0.19143714010715485,0.14214640855789185,0.1358216255903244,0.24022434651851654,867.0343017578125,1e-05,0.0819307342171669,2.3488683700561523,23.927850246429443,0 +6047,0.24469846487045288,0.21858182549476624,0.20889374613761902,0.24378204345703125,959.8422241210938,1e-05,0.06725834310054779,2.5264649391174316,23.927850246429443,0 +6048,0.2911084294319153,0.15010376274585724,0.15487341582775116,0.18570512533187866,845.7308959960938,1e-05,0.09512439370155334,2.3604836463928223,23.927850246429443,0 +6049,0.29094353318214417,0.15881776809692383,0.15309405326843262,0.2718910276889801,735.1730346679688,1e-05,0.10208430886268616,2.351830244064331,23.927850246429443,0 +6050,0.20480354130268097,0.26726263761520386,0.26305150985717773,0.18163460493087769,534.8970336914062,1e-05,0.07777447998523712,2.7086191177368164,23.927850246429443,0 +6051,0.17733624577522278,0.2941506803035736,0.29436007142066956,0.15035255253314972,957.39697265625,1e-05,0.06683173775672913,2.364532709121704,23.927850246429443,0 +6052,0.223702073097229,0.18133971095085144,0.1726355105638504,0.22169871628284454,558.6282348632812,1e-05,0.09706100076436996,2.3579471111297607,23.927850246429443,0 +6053,0.23312194645404816,0.14495278894901276,0.1426020860671997,0.20224358141422272,954.9102783203125,1e-05,0.07012288272380829,2.4877567291259766,23.927850246429443,0 +6054,0.19837716221809387,0.27867233753204346,0.2936798930168152,0.18660256266593933,204.84951782226562,1e-05,0.0707489401102066,2.366919755935669,23.927850246429443,0 +6055,0.11192408204078674,0.20213685929775238,0.19599896669387817,0.24067306518554688,930.4703369140625,1e-05,0.06432753056287766,2.3640100955963135,23.927850246429443,0 +6056,0.11490051448345184,0.20101943612098694,0.20506654679775238,0.20519229769706726,962.2467651367188,1e-05,0.11102911829948425,2.3638265132904053,23.927850246429443,0 +6057,0.15186874568462372,0.13055579364299774,0.13766583800315857,0.1438141018152237,956.2970581054688,1e-05,0.079757459461689,2.5774893760681152,23.927850246429443,0 +6058,0.19500115513801575,0.2535668909549713,0.24938496947288513,0.19615383446216583,710.2763671875,1e-05,0.07520946115255356,2.4891340732574463,23.927850246429443,0 +6059,0.17382456362247467,0.16336821019649506,0.16595908999443054,0.1876922994852066,948.067626953125,1e-05,0.08112730830907822,2.355374336242676,23.927850246429443,0 +6060,0.2670019865036011,0.18766018748283386,0.18544350564479828,0.16689102351665497,933.0629272460938,1e-05,0.09160351753234863,2.356645107269287,23.927850246429443,0 +6061,0.12841472029685974,0.09972480684518814,0.1040867269039154,0.1415064036846161,893.6715698242188,1e-05,0.07919620722532272,2.501504898071289,23.927850246429443,0 +6062,0.13351908326148987,0.21272976696491241,0.22053582966327667,0.20195512473583221,991.3079833984375,1e-05,0.0707293152809143,2.3522281646728516,23.927850246429443,0 +6063,0.2201162427663803,0.1280076503753662,0.12773890793323517,0.2494230717420578,829.4078369140625,1e-05,0.091281957924366,2.3553433418273926,23.927850246429443,0 +6064,0.11154501140117645,0.22519677877426147,0.2242075651884079,0.21134614944458008,970.9821166992188,1e-05,0.05862998962402344,2.5009772777557373,23.927850246429443,0 +6065,0.14009733498096466,0.08622464537620544,0.08867485821247101,0.25612178444862366,796.4441528320312,1e-05,0.061398524791002274,2.353541612625122,23.927850246429443,0 +6066,0.2134389579296112,0.1995958536863327,0.20325921475887299,0.2449038326740265,519.8598022460938,1e-05,0.085991270840168,2.355206251144409,23.927850246429443,0 +6067,0.12530159950256348,0.1633220762014389,0.16308796405792236,0.23724357783794403,941.8146362304688,1e-05,0.06538470089435577,2.349993944168091,23.927850246429443,0 +6068,0.3122062683105469,0.4685678482055664,0.4793491065502167,0.2182692289352417,190.67796325683594,1e-05,0.08637041598558426,2.4682564735412598,23.927850246429443,0 +6069,0.2685651183128357,0.22523000836372375,0.21823692321777344,0.2840704917907715,558.6282348632812,1e-05,0.07169099152088165,2.5158300399780273,23.927850246429443,0 +6070,0.2074919044971466,0.2962118089199066,0.29497331380844116,0.10897435247898102,341.5697937011719,1e-05,0.06376403570175171,2.348911762237549,23.927850246429443,0 +6071,0.2098267525434494,0.15445099771022797,0.15650546550750732,0.13971152901649475,925.1558837890625,1e-05,0.07090633362531662,2.634857416152954,23.927850246429443,0 +6072,0.12375134229660034,0.13267463445663452,0.1340866982936859,0.18967947363853455,661.4877319335938,1e-05,0.08452469110488892,2.494776964187622,23.927850246429443,0 +6073,0.17388951778411865,0.25071173906326294,0.24568688869476318,0.2945833206176758,873.4939575195312,1e-05,0.07968512922525406,2.3516364097595215,23.927850246429443,0 +6074,0.2140398621559143,0.15199051797389984,0.14214091002941132,0.2689102590084076,742.69482421875,1e-05,0.07023367285728455,2.527125120162964,23.927850246429443,0 +6075,0.21282702684402466,0.1747075915336609,0.1668976992368698,0.27775639295578003,707.4652709960938,1e-05,0.06456109881401062,2.359854221343994,23.927850246429443,0 +6076,0.1853250414133072,0.13705365359783173,0.14133116602897644,0.24400639533996582,897.2911987304688,1e-05,0.07542955875396729,2.350093126296997,23.927850246429443,0 +6077,0.28704407811164856,0.112046018242836,0.12539340555667877,0.16076922416687012,622.4899291992188,1e-05,0.07772674411535263,2.347259998321533,23.927850246429443,0 +6078,0.1530046910047531,0.20902934670448303,0.1835992932319641,0.24628204107284546,895.6915893554688,1e-05,0.08288173377513885,2.3511362075805664,23.927850246429443,0 +6079,0.28991779685020447,0.21620793640613556,0.20906959474086761,0.2149999886751175,851.403076171875,1e-05,0.07102053612470627,2.6891257762908936,23.927850246429443,0 +6080,0.23129147291183472,0.2779392600059509,0.27482739090919495,0.2146153748035431,317.1641845703125,1e-05,0.07340390235185623,2.349320888519287,23.927850246429443,0 +6081,0.20918329060077667,0.11813271790742874,0.11813344061374664,0.2273397296667099,674.4935913085938,1e-05,0.06994573026895523,2.564155101776123,23.927850246429443,0 +6082,0.17528846859931946,0.11790517717599869,0.12140848487615585,0.1364743560552597,898.8763427734375,1e-05,0.07261810451745987,2.509551525115967,23.927850246429443,0 +6083,0.22688281536102295,0.17683807015419006,0.17488770186901093,0.18666665256023407,647.8805541992188,1e-05,0.07538627833127975,2.3509840965270996,23.927850246429443,0 +6084,0.2511109709739685,0.22745634615421295,0.22476261854171753,0.1876922994852066,772.1712036132812,1e-05,0.0792304277420044,2.348127603530884,23.927850246429443,0 +6085,0.24592316150665283,0.24310310184955597,0.24058441817760468,0.21349358558654785,605.6701049804688,1e-05,0.0714443176984787,2.5099594593048096,23.927850246429443,0 +6086,0.1908596307039261,0.1566542685031891,0.1529235541820526,0.2563461363315582,925.1558837890625,1e-05,0.05522860214114189,2.3531594276428223,23.927850246429443,0 +6087,0.2104918360710144,0.19488131999969482,0.18560092151165009,0.2749038338661194,652.4856567382812,1e-05,0.0757545754313469,2.3526036739349365,23.927850246429443,0 +6088,0.19489428400993347,0.3203129470348358,0.3282637298107147,0.14326922595500946,273.4375,1e-05,0.07667598128318787,2.348381757736206,23.927850246429443,0 +6089,0.13473738729953766,0.2763127386569977,0.2706772983074188,0.19099357724189758,954.9102783203125,1e-05,0.06991217285394669,2.4720566272735596,23.927850246429443,0 +6090,0.1784343123435974,0.14291179180145264,0.14107081294059753,0.26701921224594116,912.162109375,1e-05,0.0674835741519928,2.470996141433716,23.927850246429443,0 +6091,0.30935579538345337,0.46659788489341736,0.4575398564338684,0.22948716580867767,204.84951782226562,1e-05,0.09960584342479706,2.35408091545105,23.927850246429443,0 +6092,0.2243334949016571,0.2421308010816574,0.2457425594329834,0.22999998927116394,744.3366088867188,1e-05,0.06586746871471405,2.475132703781128,23.927850246429443,0 +6093,0.21864525973796844,0.17338520288467407,0.17232999205589294,0.2578205168247223,464.8240966796875,1e-05,0.0704837515950203,2.6989858150482178,23.927850246429443,0 +6094,0.3082064092159271,0.24720197916030884,0.235178142786026,0.18205127120018005,577.95703125,1e-05,0.0768851637840271,2.354736566543579,23.927850246429443,0 +6095,0.21608255803585052,0.18894387781620026,0.19253720343112946,0.20980767905712128,745.9677734375,1e-05,0.06672346591949463,2.5277817249298096,23.927850246429443,0 +6096,0.23235557973384857,0.13846972584724426,0.131583571434021,0.20721152424812317,967.9602661132812,1e-05,0.07314766198396683,2.3492493629455566,23.927850246429443,0 +6097,0.19875077903270721,0.16860398650169373,0.1706697791814804,0.25391024351119995,933.7044067382812,1e-05,0.0751439556479454,2.35029673576355,23.927850246429443,0 +6098,0.12490709871053696,0.14666472375392914,0.14808183908462524,0.20471152663230896,767.7470092773438,1e-05,0.06420955061912537,2.352579355239868,23.927850246429443,0 +6099,0.18706196546554565,0.18261604011058807,0.17934465408325195,0.27977561950683594,625.0,1e-05,0.07425317168235779,2.3491716384887695,23.927850246429443,0 +6100,0.21861951053142548,0.23457658290863037,0.22410811483860016,0.19391025602817535,913.6167602539062,1e-05,0.0756111666560173,2.719292163848877,23.927850246429443,0 +6101,0.22299721837043762,0.24503028392791748,0.23792830109596252,0.2313781976699829,875.74853515625,1e-05,0.07314187288284302,2.353329658508301,23.927850246429443,0 +6102,0.23308341205120087,0.16631406545639038,0.15898042917251587,0.2508012652397156,777.2314453125,1e-05,0.07539346069097519,2.348546266555786,23.927850246429443,0 +6103,0.1784283071756363,0.1105613112449646,0.12284183502197266,0.2905128002166748,713.9794311523438,1e-05,0.0786963403224945,2.587235927581787,23.927850246429443,0 +6104,0.26497748494148254,0.22302652895450592,0.2183225154876709,0.15602563321590424,946.896240234375,1e-05,0.07567978650331497,2.3614044189453125,23.927850246429443,0 +6105,0.1902199685573578,0.21468622982501984,0.20528031885623932,0.2142307609319687,949.8078002929688,1e-05,0.08810554444789886,2.5062897205352783,23.927850246429443,0 +6106,0.20426252484321594,0.1931702196598053,0.18496914207935333,0.2271474301815033,916.1324462890625,1e-05,0.08892501890659332,2.3664088249206543,23.927850246429443,0 +6107,0.2580687999725342,0.27991732954978943,0.2707502543926239,0.27810895442962646,965.6505737304688,1e-05,0.08516480773687363,2.3558309078216553,23.927850246429443,0 +6108,0.28161999583244324,0.1875169724225998,0.18293514847755432,0.26387819647789,698.8536376953125,1e-05,0.09525787830352783,2.362805128097534,23.927850246429443,0 +6109,0.28455114364624023,0.24716094136238098,0.25101718306541443,0.26711538434028625,717.632080078125,1e-05,0.07149236649274826,2.3553555011749268,23.927850246429443,0 +6110,0.10816419124603271,0.20937784016132355,0.2089691013097763,0.19846153259277344,914.6995849609375,1e-05,0.06716521829366684,2.5390963554382324,23.927850246429443,0 +6111,0.24225389957427979,0.24492423236370087,0.22961753606796265,0.2531089782714844,904.3141479492188,1e-05,0.07552913576364517,2.4645872116088867,23.927850246429443,0 +6112,0.21230915188789368,0.12079202383756638,0.11662382632493973,0.2337179332971573,886.6278686523438,1e-05,0.07050323486328125,2.3621113300323486,23.927850246429443,0 +6113,0.21802367269992828,0.22790570557117462,0.2159743458032608,0.20413461327552795,940.900146484375,1e-05,0.07188595831394196,2.472752094268799,23.927850246429443,0 +6114,0.21444295346736908,0.24841666221618652,0.23514004051685333,0.15548075735569,600.3118286132812,1e-05,0.05803864076733589,2.571063995361328,23.927850246429443,0 +6115,0.16771908104419708,0.25022798776626587,0.24392732977867126,0.20644229650497437,915.7753295898438,1e-05,0.0741136446595192,2.3592162132263184,23.927850246429443,0 +6116,0.13545766472816467,0.21786050498485565,0.2263239026069641,0.24532049894332886,956.5726318359375,1e-05,0.06773283332586288,2.5112156867980957,23.927850246429443,0 +6117,0.24103280901908875,0.14595523476600647,0.14639268815517426,0.2759294807910919,450.76727294921875,1e-05,0.0731140598654747,2.3516852855682373,23.927850246429443,0 +6118,0.14299969375133514,0.22660787403583527,0.22321921586990356,0.1364743560552597,870.7523803710938,1e-05,0.058998990803956985,2.3483643531799316,23.927850246429443,0 +6119,0.18190737068653107,0.28249332308769226,0.26176387071609497,0.22307690978050232,995.5211791992188,1e-05,0.06664027273654938,2.347759962081909,23.927850246429443,0 +6120,0.19485771656036377,0.24750980734825134,0.2440851777791977,0.21820512413978577,916.4888305664062,1e-05,0.06010859087109566,2.346322536468506,23.927850246429443,0 +6121,0.1982921063899994,0.22606973350048065,0.22649265825748444,0.14730769395828247,952.9466552734375,1e-05,0.08508014678955078,2.3534579277038574,23.927850246429443,0 +6122,0.23292477428913116,0.1980280727148056,0.19742873311042786,0.18592947721481323,514.7058715820312,1e-05,0.06477618217468262,2.602506637573242,23.927850246429443,0 +6123,0.2045729011297226,0.15446242690086365,0.1618507206439972,0.12358973920345306,594.86376953125,1e-05,0.07094905525445938,2.3535358905792236,23.927850246429443,0 +6124,0.1774810403585434,0.24493008852005005,0.24138090014457703,0.21939101815223694,973.2064208984375,1e-05,0.0755888968706131,2.7018203735351562,23.927850246429443,0 +6125,0.22213523089885712,0.11146699637174606,0.12188420444726944,0.19201922416687012,920.0105590820312,1e-05,0.07416001707315445,2.3590168952941895,23.927850246429443,0 +6126,0.1284748613834381,0.2901252806186676,0.285422682762146,0.21464742720127106,995.9349365234375,1e-05,0.07531797885894775,2.34911847114563,23.927850246429443,0 +6127,0.191437765955925,0.157594695687294,0.1520979106426239,0.2458653748035431,823.6697998046875,1e-05,0.06891487538814545,2.475848913192749,23.927850246429443,0 +6128,0.24308925867080688,0.20185895264148712,0.1959037333726883,0.2763461470603943,597.59912109375,1e-05,0.08822190016508102,2.349153757095337,23.927850246429443,0 +6129,0.13047482073307037,0.11352810263633728,0.11440399289131165,0.2149999886751175,972.4690551757812,1e-05,0.06765363365411758,2.351332902908325,23.927850246429443,0 +6130,0.18502308428287506,0.2536502182483673,0.24787452816963196,0.28362178802490234,985.8411254882812,1e-05,0.07604026049375534,2.3509795665740967,23.927850246429443,0 +6131,0.24268227815628052,0.1709771752357483,0.16073325276374817,0.23926280438899994,856.9182739257812,1e-05,0.08220098912715912,2.453033447265625,23.927850246429443,0 +6132,0.29101064801216125,0.1119074895977974,0.11414708942174911,0.2563461363315582,794.4606323242188,1e-05,0.08023922145366669,2.4658782482147217,23.927850246429443,0 +6133,0.28714054822921753,0.13830658793449402,0.13177818059921265,0.22108973562717438,737.7049560546875,1e-05,0.07713494449853897,2.3585333824157715,23.927850246429443,0 +6134,0.2678905725479126,0.09663505107164383,0.10337654501199722,0.1324358880519867,676.6055297851562,1e-05,0.08597727864980698,2.349025249481201,23.927850246429443,0 +6135,0.10134873539209366,0.04898666590452194,0.05095088481903076,0.11842948198318481,681.8181762695312,1e-05,0.07474391907453537,2.5341315269470215,23.927850246429443,0 +6136,0.2234799861907959,0.2324332445859909,0.23129907250404358,0.21089743077754974,359.68658447265625,1e-05,0.07799676060676575,2.3442955017089844,23.927850246429443,0 +6137,0.2312687337398529,0.1620406061410904,0.16382120549678802,0.2601282000541687,842.5684204101562,1e-05,0.07068050652742386,2.349820137023926,23.927850246429443,0 +6138,0.18280380964279175,0.5421240925788879,0.5717358589172363,0.26499998569488525,109.48905944824219,1e-05,0.06897685676813126,2.4811482429504395,23.927850246429443,0 +6139,0.22098411619663239,0.18717987835407257,0.1849975287914276,0.2314743548631668,646.7181396484375,1e-05,0.06347117573022842,2.3502845764160156,23.927850246429443,0 +6140,0.21797573566436768,0.1716015636920929,0.16669359803199768,0.20368589460849762,670.22265625,1e-05,0.07975572347640991,2.3497214317321777,23.927850246429443,0 +6141,0.16812528669834137,0.07744207978248596,0.07999812066555023,0.1360897421836853,779.3674926757812,1e-05,0.06695875525474548,2.347639322280884,23.927850246429443,0 +6142,0.08694054931402206,0.26802879571914673,0.268923282623291,0.12551280856132507,985.8411254882812,1e-05,0.06544845551252365,2.3514907360076904,23.927850246429443,0 +6143,0.1717505156993866,0.103114053606987,0.11595342308282852,0.14108973741531372,438.31170654296875,1e-05,0.06634902209043503,2.5830862522125244,23.927850246429443,0 +6144,0.22935260832309723,0.18503226339817047,0.19314301013946533,0.16826923191547394,425.4617614746094,1e-05,0.06343948841094971,2.350231647491455,23.927850246429443,0 +6145,0.18650595843791962,0.24747197329998016,0.24074646830558777,0.24621793627738953,790.4412231445312,1e-05,0.08267712593078613,2.5061399936676025,23.927850246429443,0 +6146,0.12658849358558655,0.12287446856498718,0.1193821057677269,0.23445512354373932,880.177490234375,1e-05,0.07204645872116089,2.356480836868286,23.927850246429443,0 +6147,0.2080414891242981,0.15060646831989288,0.14751090109348297,0.1631089746952057,876.1961669921875,1e-05,0.07387307286262512,2.351323127746582,23.927850246429443,0 +6148,0.20294789969921112,0.16529636085033417,0.15592218935489655,0.2444230616092682,866.0933227539062,1e-05,0.07249803096055984,2.47310733795166,23.927850246429443,0 +6149,0.16930921375751495,0.16189925372600555,0.16195864975452423,0.25362178683280945,917.9064331054688,1e-05,0.0647377297282219,2.3615071773529053,23.927850246429443,0 +6150,0.1847320795059204,0.1618882119655609,0.18272434175014496,0.18823717534542084,979.4371948242188,1e-05,0.07051518559455872,2.354792833328247,23.927850246429443,0 +6151,0.2174377739429474,0.26285839080810547,0.24529045820236206,0.21214742958545685,956.8480224609375,1e-05,0.06359270215034485,2.351313829421997,23.927850246429443,0 +6152,0.19646430015563965,0.7812607884407043,0.7752637267112732,0.12054486572742462,48.076927185058594,1e-05,0.06350434571504593,2.523566484451294,23.927850246429443,0 +6153,0.32435303926467896,0.07930634915828705,0.08199308812618256,0.1119871735572815,703.6713256835938,1e-05,0.07675335556268692,2.3547439575195312,23.927850246429443,0 +6154,0.1476777195930481,0.28268247842788696,0.28315576910972595,0.17016024887561798,998.18701171875,1e-05,0.06553637981414795,2.4781298637390137,23.927850246429443,0 +6155,0.11328482627868652,0.23251914978027344,0.2333274483680725,0.2981410026550293,981.7597045898438,1e-05,0.06388004124164581,2.347241163253784,23.927850246429443,0 +6156,0.23092401027679443,0.13526034355163574,0.13302455842494965,0.2516345977783203,782.8849487304688,1e-05,0.06594835221767426,2.641441583633423,23.927850246429443,0 +6157,0.18707041442394257,0.24225270748138428,0.2388044148683548,0.21166665852069855,905.8369750976562,1e-05,0.07315566390752792,2.3520326614379883,23.927850246429443,0 +6158,0.11857934296131134,0.12294074147939682,0.12610995769500732,0.1988781988620758,890.3912353515625,1e-05,0.05721711367368698,2.342787742614746,23.927850246429443,0 +6159,0.3095126152038574,0.2855258285999298,0.27585887908935547,0.23358973860740662,969.2273559570312,1e-05,0.07541581988334656,2.560190200805664,23.927850246429443,1 +6160,0.19946804642677307,0.23888801038265228,0.2355322688817978,0.27134615182876587,466.7919921875,1e-05,0.07429537177085876,2.354048252105713,23.927850246429443,1 +6161,0.1705085039138794,0.07778508216142654,0.08233538269996643,0.10288461297750473,748.3948974609375,1e-05,0.06543337553739548,2.348461389541626,23.927850246429443,1 +6162,0.18880939483642578,0.15891991555690765,0.1525057703256607,0.21233972907066345,869.3666381835938,1e-05,0.06875187903642654,2.3518409729003906,23.927850246429443,1 +6163,0.18655195832252502,0.10648904740810394,0.11035002768039703,0.20355768501758575,870.2915649414062,1e-05,0.06726395338773727,2.3450400829315186,23.927850246429443,1 +6164,0.1725567728281021,0.2730013132095337,0.2558310627937317,0.2547435760498047,948.9403076171875,1e-05,0.062199171632528305,2.3546249866485596,23.927850246429443,1 +6165,0.181773379445076,0.11887718737125397,0.11399618536233902,0.16900640726089478,749.19873046875,1e-05,0.07388211786746979,2.579596757888794,23.927850246429443,1 +6166,0.1343158781528473,0.1577557474374771,0.14842018485069275,0.22070512175559998,769.9692993164062,1e-05,0.06221957132220268,2.5131607055664062,23.927850246429443,1 +6167,0.14469338953495026,0.17859534919261932,0.17050451040267944,0.27320513129234314,753.9683227539062,1e-05,0.0860256552696228,2.463439464569092,23.927850246429443,1 +6168,0.20133155584335327,0.18441972136497498,0.19218973815441132,0.19429486989974976,978.9678955078125,1e-05,0.06954313814640045,2.3546576499938965,23.927850246429443,1 +6169,0.20945832133293152,0.1860342174768448,0.17874561250209808,0.23743589222431183,754.75439453125,1e-05,0.07639790326356888,2.3466718196868896,23.927850246429443,1 +6170,0.26904526352882385,0.22625088691711426,0.21619851887226105,0.19602563977241516,796.4441528320312,1e-05,0.08927974104881287,2.487340211868286,23.927850246429443,1 +6171,0.15947481989860535,0.1373804360628128,0.1348673552274704,0.2792307734489441,924.81787109375,1e-05,0.0751042440533638,2.3618452548980713,23.927850246429443,1 +6172,0.2038259506225586,0.12972170114517212,0.13042838871479034,0.23830127716064453,632.4110717773438,1e-05,0.0700189396739006,2.35448956489563,23.927850246429443,1 +6173,0.11896102130413055,0.21311995387077332,0.2230232059955597,0.1832692176103592,593.4874267578125,1e-05,0.06232127919793129,2.476475238800049,23.927850246429443,1 +6174,0.0527859628200531,0.14317764341831207,0.1407082974910736,0.24419870972633362,811.095458984375,1e-05,0.055895350873470306,2.3609187602996826,23.927850246429443,1 +6175,0.09158331900835037,0.11005322635173798,0.11158005893230438,0.26903843879699707,839.3560791015625,1e-05,0.06558676064014435,2.527266263961792,23.927850246429443,1 +6176,0.2415425181388855,0.2701779007911682,0.26796168088912964,0.21945512294769287,464.8240966796875,1e-05,0.07551795989274979,2.3611791133880615,23.927850246429443,1 +6177,0.19851350784301758,0.22119516134262085,0.20572511851787567,0.2365064024925232,895.6915893554688,1e-05,0.06290838122367859,2.733058214187622,23.927850246429443,1 +6178,0.2530180811882019,0.5503827333450317,0.5467111468315125,0.2905128002166748,145.7597198486328,1e-05,0.0783647894859314,2.568695306777954,23.927850246429443,1 +6179,0.21575114130973816,0.3841164708137512,0.38548627495765686,0.17999999225139618,300.1519775390625,1e-05,0.06696482747793198,2.352121591567993,23.927850246429443,1 +6180,0.1582714021205902,0.17995893955230713,0.17838908731937408,0.22727563977241516,939.6723022460938,1e-05,0.07400845736265182,2.3506407737731934,23.927850246429443,1 +6181,0.20083338022232056,0.23156194388866425,0.21682249009609222,0.22403845191001892,893.6715698242188,1e-05,0.06742124259471893,2.5172922611236572,23.927850246429443,1 +6182,0.1766071319580078,0.2487131655216217,0.24512158334255219,0.17685896158218384,971.23095703125,1e-05,0.0602213591337204,2.3502466678619385,23.927850246429443,1 +6183,0.16816763579845428,0.34846365451812744,0.35419049859046936,0.21929486095905304,987.615478515625,1e-05,0.06696536391973495,2.4980967044830322,23.927850246429443,1 +6184,0.19968129694461823,0.25302356481552124,0.267113596200943,0.18628203868865967,381.9444580078125,1e-05,0.06973005831241608,2.357473611831665,23.927850246429443,1 +6185,0.24693557620048523,0.7495572566986084,0.7588267922401428,0.2950640916824341,83.95523071289062,1e-05,0.0626634731888771,2.3499438762664795,23.927850246429443,1 +6186,0.2767646610736847,0.22373884916305542,0.21347923576831818,0.22528845071792603,976.3572998046875,1e-05,0.08591676503419876,2.494248628616333,23.927850246429443,1 +6187,0.17217768728733063,0.0745784118771553,0.07447203248739243,0.21666665375232697,836.6402587890625,1e-05,0.0681304931640625,2.5635719299316406,23.927850246429443,1 +6188,0.13121293485164642,0.1942448914051056,0.19237707555294037,0.21211537718772888,828.2725830078125,1e-05,0.07837577164173126,2.4656317234039307,23.927850246429443,1 +6189,0.17358121275901794,0.16329386830329895,0.1659109890460968,0.06833332777023315,968.2146606445312,1e-05,0.06819666177034378,2.3464717864990234,23.927850246429443,1 +6190,0.2079767882823944,0.648186206817627,0.7103587985038757,0.20907050371170044,57.25191116333008,1e-05,0.07944932579994202,2.350895404815674,23.927850246429443,1 +6191,0.26272034645080566,0.13103501498699188,0.12623323500156403,0.2741025686264038,887.0499877929688,1e-05,0.0718793272972107,2.346332550048828,23.927850246429443,1 +6192,0.223050057888031,0.21609953045845032,0.21492694318294525,0.2373717874288559,456.8528137207031,1e-05,0.07106032967567444,2.4768781661987305,23.927850246429443,1 +6193,0.25223615765571594,0.15772198140621185,0.14971458911895752,0.20903845131397247,827.7026977539062,1e-05,0.0793541669845581,2.3515429496765137,23.927850246429443,1 +6194,0.15315058827400208,0.10805481672286987,0.10043465346097946,0.2497115284204483,807.9915161132812,1e-05,0.06394463032484055,2.4676761627197266,23.927850246429443,1 +6195,0.14932557940483093,0.14047595858573914,0.1349392980337143,0.12118589133024216,991.3079833984375,1e-05,0.08410973101854324,2.348212718963623,23.927850246429443,1 +6196,0.2535504698753357,0.38254067301750183,0.38125360012054443,0.15304486453533173,300.1519775390625,1e-05,0.07054421305656433,2.476703643798828,23.927850246429443,1 +6197,0.11046161502599716,0.9985779523849487,0.9986863732337952,0.20134614408016205,19.685039520263672,1e-05,0.06859181821346283,2.3588204383850098,23.927850246429443,1 +6198,0.13440653681755066,0.16664648056030273,0.15932202339172363,0.12141025066375732,829.4078369140625,1e-05,0.06905041635036469,2.5850484371185303,23.927850246429443,1 +6199,0.2821204960346222,0.20107220113277435,0.199386864900589,0.2943589687347412,722.12841796875,1e-05,0.08070853352546692,2.5645270347595215,23.927850246429443,1 +6200,0.2085767537355423,0.21740205585956573,0.20840632915496826,0.2842628061771393,547.7528686523438,1e-05,0.06454480439424515,2.357717275619507,23.927850246429443,1 +6201,0.20429420471191406,0.18192631006240845,0.1770702302455902,0.2476923018693924,654.7619018554688,1e-05,0.07572810351848602,2.3521158695220947,23.927850246429443,1 +6202,0.16486874222755432,0.12888695299625397,0.12908488512039185,0.2480769157409668,825.4075927734375,1e-05,0.05838710442185402,2.487164258956909,23.927850246429443,1 +6203,0.16631358861923218,0.14417582750320435,0.13939517736434937,0.275865375995636,631.1881713867188,1e-05,0.06744582951068878,2.361882209777832,23.927850246429443,1 +6204,0.2173183560371399,0.47089865803718567,0.4595215618610382,0.29423075914382935,997.7804565429688,1e-05,0.07185711711645126,2.349307060241699,23.927850246429443,1 +6205,0.14690473675727844,0.18904338777065277,0.189803346991539,0.13105769455432892,980.13818359375,1e-05,0.07834973931312561,2.35192608833313,23.927850246429443,1 +6206,0.24787095189094543,0.8655760288238525,0.8808468580245972,0.28756409883499146,43.43629455566406,1e-05,0.08513807505369186,2.3485496044158936,23.927850246429443,1 +6207,0.20920051634311676,0.1686115711927414,0.1640762984752655,0.21012820303440094,639.6484985351562,1e-05,0.06639628112316132,2.5633363723754883,23.927850246429443,1 +6208,0.14908917248249054,0.12671232223510742,0.12341915816068649,0.19586537778377533,938.1237182617188,1e-05,0.0694521889090538,2.466475009918213,23.927850246429443,1 +6209,0.20194852352142334,0.09430550783872604,0.09910848736763,0.10673076659440994,700.7908935546875,1e-05,0.07187344133853912,2.6920228004455566,23.927850246429443,1 +6210,0.2510416805744171,0.19166626036167145,0.1796344518661499,0.2458653748035431,583.6886596679688,1e-05,0.07722771912813187,2.351266384124756,23.927850246429443,1 +6211,0.22613343596458435,0.20372983813285828,0.19595694541931152,0.28807690739631653,627.4900512695312,1e-05,0.08048633486032486,2.3463759422302246,23.927850246429443,1 +6212,0.13143348693847656,0.15281614661216736,0.14491727948188782,0.23221153020858765,953.2288818359375,1e-05,0.06746425479650497,2.347588300704956,23.927850246429443,1 +6213,0.1616118848323822,0.1738484650850296,0.1748817265033722,0.2659294903278351,526.620361328125,1e-05,0.07122748345136642,2.4688808917999268,23.927850246429443,1 +6214,0.23750272393226624,0.26910921931266785,0.25665754079818726,0.25400641560554504,974.9119873046875,1e-05,0.07238724082708359,2.3488943576812744,23.927850246429443,1 +6215,0.23698922991752625,0.052222687751054764,0.051750920712947845,0.11102563887834549,867.5030517578125,1e-05,0.061218127608299255,2.461916446685791,23.927850246429443,1 +6216,0.1750527322292328,0.21824897825717926,0.2027764767408371,0.30355769395828247,632.4110717773438,1e-05,0.07381163537502289,2.34851336479187,23.927850246429443,1 +6217,0.16381880640983582,0.24537885189056396,0.2495357096195221,0.25246793031692505,963.8278198242188,1e-05,0.062226612120866776,2.3455862998962402,23.927850246429443,1 +6218,0.17190836369991302,0.15578335523605347,0.15868061780929565,0.24378204345703125,855.9268798828125,1e-05,0.09777159243822098,2.537181854248047,23.927850246429443,1 +6219,0.29865700006484985,0.21264547109603882,0.20499901473522186,0.22602562606334686,619.959716796875,1e-05,0.07507547736167908,2.675668716430664,23.927850246429443,1 +6220,0.2810985743999481,0.1397119015455246,0.15100054442882538,0.20128203928470612,922.088134765625,1e-05,0.06157918646931648,2.574397325515747,23.927850246429443,1 +6221,0.2614634037017822,0.22205784916877747,0.21668456494808197,0.2103525549173355,618.6868286132812,1e-05,0.06517022848129272,2.345912456512451,23.927850246429443,1 +6222,0.2380281388759613,0.22252090275287628,0.21879270672798157,0.27977561950683594,512.9716796875,1e-05,0.08714298903942108,2.3491368293762207,23.927850246429443,1 +6223,0.20771212875843048,0.16177549958229065,0.1553707867860794,0.21698717772960663,938.1237182617188,1e-05,0.0652499794960022,2.4637222290039062,23.927850246429443,1 +6224,0.2533103823661804,0.1557287573814392,0.1496172547340393,0.19836537539958954,698.8536376953125,1e-05,0.06341003626585007,2.344900608062744,23.927850246429443,1 +6225,0.15093562006950378,0.2334786206483841,0.22082936763763428,0.25371792912483215,928.4979858398438,1e-05,0.0744311660528183,2.3451483249664307,23.927850246429443,1 +6226,0.1359996497631073,0.24440138041973114,0.22352296113967896,0.2215384542942047,938.7450561523438,1e-05,0.07277466356754303,2.346515417098999,23.927850246429443,1 +6227,0.19502322375774384,0.23180566728115082,0.22429773211479187,0.20701922476291656,986.2869873046875,1e-05,0.06889516860246658,2.3484749794006348,23.927850246429443,1 +6228,0.24155229330062866,0.23360714316368103,0.23337508738040924,0.24592947959899902,398.5013732910156,1e-05,0.07271727174520493,2.4698071479797363,23.927850246429443,1 +6229,0.09508762508630753,0.1816171556711197,0.1796392947435379,0.2005128115415573,859.375,1e-05,0.0742175281047821,2.3549180030822754,23.927850246429443,1 +6230,0.21938621997833252,0.16859962046146393,0.16034944355487823,0.16342948377132416,890.3912353515625,1e-05,0.06453366577625275,2.5883564949035645,23.927850246429443,1 +6231,0.23356620967388153,0.1255878359079361,0.12836416065692902,0.1860576868057251,652.4856567382812,1e-05,0.06649278849363327,2.3574883937835693,23.927850246429443,1 +6232,0.16469982266426086,0.2590697705745697,0.24246886372566223,0.24051281809806824,935.2970581054688,1e-05,0.05444576218724251,2.35365891456604,23.927850246429443,1 +6233,0.2483135163784027,0.39251014590263367,0.4033440053462982,0.10663460940122604,336.25732421875,1e-05,0.06120499223470688,2.358851671218872,23.927850246429443,1 +6234,0.13717201352119446,0.24858760833740234,0.2562941908836365,0.13727563619613647,978.9678955078125,1e-05,0.05871378630399704,2.5621893405914307,23.927850246429443,1 +6235,0.12913274765014648,0.3440600335597992,0.33484500646591187,0.25467947125434875,991.52197265625,1e-05,0.060346707701683044,2.362975835800171,23.927850246429443,1 +6236,0.22644677758216858,0.22596843540668488,0.23076163232326508,0.17884615063667297,400.81524658203125,1e-05,0.112261101603508,2.4777395725250244,23.927850246429443,1 +6237,0.17587023973464966,0.40742775797843933,0.39333945512771606,0.33407050371170044,991.52197265625,1e-05,0.0605638213455677,2.363057851791382,23.927850246429443,1 +6238,0.14963233470916748,0.11671721935272217,0.1142222136259079,0.07612179219722748,965.6505737304688,1e-05,0.07103859633207321,2.3563296794891357,23.927850246429443,1 +6239,0.17896230518817902,0.19934730231761932,0.1893327236175537,0.18881408870220184,697.8798828125,1e-05,0.08344165235757828,2.4793832302093506,23.927850246429443,1 +6240,0.23974968492984772,0.12104672938585281,0.12399987876415253,0.22807691991329193,827.1312866210938,1e-05,0.0720759928226471,2.509310722351074,23.927850246429443,1 +6241,0.1757078319787979,0.3815554976463318,0.3857147693634033,0.14913460612297058,999.3985595703125,1e-05,0.06364890933036804,2.475363254547119,23.927850246429443,1 +6242,0.161798894405365,0.1270696371793747,0.12513326108455658,0.27282050251960754,728.2971801757812,1e-05,0.06399307399988174,2.3532962799072266,23.927850246429443,1 +6243,0.28320056200027466,0.23013241589069366,0.22768734395503998,0.10259614884853363,427.6316223144531,1e-05,0.08196074515581131,2.3473644256591797,23.927850246429443,1 +6244,0.12516909837722778,0.18650507926940918,0.192920982837677,0.06737179309129715,976.5967407226562,1e-05,0.06310299783945084,2.463552474975586,23.927850246429443,1 +6245,0.13604015111923218,0.19449123740196228,0.19116152822971344,0.2157692164182663,891.62841796875,1e-05,0.06798825412988663,2.3519363403320312,23.927850246429443,1 +6246,0.15757516026496887,0.14021071791648865,0.14768317341804504,0.24096153676509857,664.7939453125,1e-05,0.07059270143508911,2.3501079082489014,23.927850246429443,1 +6247,0.09774411469697952,0.2255105972290039,0.22883079946041107,0.20025640726089478,996.5530395507812,1e-05,0.07035449892282486,2.455338954925537,23.927850246429443,1 +6248,0.21569351851940155,0.275952011346817,0.2851162254810333,0.2632371783256531,300.1519775390625,1e-05,0.06193584203720093,2.354567289352417,23.927850246429443,1 +6249,0.2048572599887848,0.20212185382843018,0.20573951303958893,0.13653846085071564,626.2474975585938,1e-05,0.06111063063144684,2.340876579284668,23.927850246429443,1 +6250,0.15750834345817566,0.227530837059021,0.23070837557315826,0.20150640606880188,909.9564819335938,1e-05,0.06827470660209656,2.476633310317993,23.927850246429443,1 +6251,0.1528492271900177,0.055714234709739685,0.06350426375865936,0.2105448693037033,710.2763671875,1e-05,0.11036987602710724,2.6235647201538086,23.927850246429443,1 +6252,0.2231755256652832,0.22629466652870178,0.22680918872356415,0.23442307114601135,491.5048522949219,1e-05,0.06529336422681808,2.3479254245758057,23.927850246429443,1 +6253,0.1497465968132019,0.17617546021938324,0.17153924703598022,0.21532049775123596,938.1237182617188,1e-05,0.06217273324728012,2.3491480350494385,23.927850246429443,1 +6254,0.14637835323810577,0.22034572064876556,0.20373494923114777,0.22499999403953552,998.3897094726562,1e-05,0.059473175555467606,2.346743106842041,23.927850246429443,1 +6255,0.14670723676681519,0.15173454582691193,0.15145479142665863,0.18814101815223694,887.8910522460938,1e-05,0.07069934159517288,2.4897725582122803,23.927850246429443,1 +6256,0.2922837734222412,0.24683594703674316,0.2406090497970581,0.24554486572742462,456.8528137207031,1e-05,0.08092208951711655,2.3564367294311523,23.927850246429443,1 +6257,0.32547450065612793,0.35845884680747986,0.3588722050189972,0.16766025125980377,354.58453369140625,1e-05,0.06375929713249207,2.3465473651885986,23.927850246429443,1 +6258,0.19625595211982727,0.39620882272720337,0.3807665705680847,0.21833331882953644,988.7123413085938,1e-05,0.07073681056499481,2.5664567947387695,23.927850246429443,1 +6259,0.13833095133304596,0.20747141540050507,0.20798300206661224,0.17057691514492035,899.6636962890625,1e-05,0.06362102180719376,2.350205421447754,23.927850246429443,1 +6260,0.18156851828098297,0.13178452849388123,0.12899324297904968,0.09054487198591232,645.55126953125,1e-05,0.07997265458106995,2.3482041358947754,23.927850246429443,1 +6261,0.22888800501823425,0.1347193866968155,0.1331062763929367,0.11621794104576111,637.2549438476562,1e-05,0.06333499401807785,2.518191337585449,23.927850246429443,1 +6262,0.21082554757595062,0.22884446382522583,0.21209129691123962,0.2722115218639374,939.0547485351562,1e-05,0.07625594735145569,2.477696418762207,23.927850246429443,1 +6263,0.140772745013237,0.16925610601902008,0.1635158807039261,0.25903844833374023,935.9296264648438,1e-05,0.08198139071464539,2.3461763858795166,23.927850246429443,1 +6264,0.24576127529144287,0.15634611248970032,0.15065380930900574,0.22923076152801514,799.0620727539062,1e-05,0.06958936154842377,2.3485400676727295,23.927850246429443,1 +6265,0.1875670850276947,0.15186499059200287,0.14410218596458435,0.3025640845298767,848.3289794921875,1e-05,0.06697523593902588,2.3501667976379395,23.927850246429443,1 +6266,0.13088344037532806,0.20705477893352509,0.20631541311740875,0.13499999046325684,908.8427124023438,1e-05,0.05768880993127823,2.46943736076355,23.927850246429443,1 +6267,0.2335537225008011,0.28200674057006836,0.27724984288215637,0.17355768382549286,995.9349365234375,1e-05,0.08083706349134445,2.3496696949005127,23.927850246429443,1 +6268,0.21944892406463623,0.33074378967285156,0.3394221067428589,0.15753205120563507,137.90036010742188,1e-05,0.09307143092155457,2.346419334411621,23.927850246429443,1 +6269,0.30240219831466675,0.3993317782878876,0.43378254771232605,0.1768910139799118,157.3426513671875,1e-05,0.0679350271821022,2.473613739013672,23.927850246429443,1 +6270,0.23205804824829102,0.3985956013202667,0.409509539604187,0.26384615898132324,245.17686462402344,1e-05,0.08528007566928864,2.355319023132324,23.927850246429443,1 +6271,0.24538582563400269,0.3596493601799011,0.36545801162719727,0.20192307233810425,254.77706909179688,1e-05,0.07192456722259521,2.4745779037475586,23.927850246429443,1 +6272,0.20446854829788208,0.17347952723503113,0.16319866478443146,0.2471153736114502,906.9703979492188,1e-05,0.06388818472623825,2.57027268409729,23.927850246429443,1 +6273,0.20492373406887054,0.23781150579452515,0.2308749258518219,0.18477563560009003,944.52587890625,1e-05,0.0716077908873558,2.354114532470703,23.927850246429443,1 +6274,0.16586674749851227,0.23329831659793854,0.25006023049354553,0.13903845846652985,978.9678955078125,1e-05,0.06159146875143051,2.34873628616333,23.927850246429443,1 +6275,0.1663433164358139,0.326630562543869,0.33906617760658264,0.2971474230289459,232.08470153808594,1e-05,0.06263145059347153,2.3474557399749756,23.927850246429443,1 +6276,0.14421296119689941,0.5699628591537476,0.5767356753349304,0.28016024827957153,129.92831420898438,1e-05,0.06845305114984512,2.4559619426727295,23.927850246429443,1 +6277,0.1991148293018341,0.20963114500045776,0.21241846680641174,0.17413461208343506,828.2725830078125,1e-05,0.0645572617650032,2.3689064979553223,23.927850246429443,1 +6278,0.18652065098285675,0.12777598202228546,0.12131460011005402,0.20753204822540283,946.6019287109375,1e-05,0.07047608494758606,2.3623242378234863,23.927850246429443,1 +6279,0.10372766107320786,0.1355745941400528,0.14737093448638916,0.18820512294769287,878.85986328125,1e-05,0.06644465774297714,2.4824094772338867,23.927850246429443,1 +6280,0.10558739304542542,0.3153053820133209,0.3277709186077118,0.1838461458683014,974.1835327148438,1e-05,0.07143060863018036,2.365504264831543,23.927850246429443,1 +6281,0.22391389310359955,0.17197467386722565,0.164769247174263,0.24108973145484924,950.9569091796875,1e-05,0.07034279406070709,2.356536865234375,23.927850246429443,1 +6282,0.28790852427482605,0.30929815769195557,0.3483539819717407,0.22205127775669098,993.8524169921875,1e-05,0.07626458257436752,2.5860648155212402,23.927850246429443,1 +6283,0.2133125215768814,0.25460872054100037,0.23985645174980164,0.2635256350040436,764.7515258789062,1e-05,0.0815996378660202,2.580233573913574,23.927850246429443,1 +6284,0.1906469464302063,0.19982118904590607,0.19146670401096344,0.21858973801136017,658.1439819335938,1e-05,0.06665045022964478,2.3584001064300537,23.927850246429443,1 +6285,0.14185668528079987,0.2277146726846695,0.21920543909072876,0.25826922059059143,909.9564819335938,1e-05,0.06579318642616272,2.352153778076172,23.927850246429443,1 +6286,0.3098253309726715,0.8344103693962097,0.8405432105064392,0.19221153855323792,994.89794921875,1e-05,0.07924388349056244,2.3488223552703857,23.927850246429443,1 +6287,0.18915122747421265,0.4954695999622345,0.5006723999977112,0.22272434830665588,101.10294342041016,1e-05,0.07846169918775558,2.4851601123809814,23.927850246429443,1 +6288,0.21999387443065643,0.2048637419939041,0.19113758206367493,0.2449038326740265,678.7020263671875,1e-05,0.06671404838562012,2.358428955078125,23.927850246429443,1 +6289,0.3278125524520874,0.21446412801742554,0.20634518563747406,0.18320512771606445,809.8590698242188,1e-05,0.07776534557342529,2.348832607269287,23.927850246429443,1 +6290,0.15846490859985352,0.11689531058073044,0.1253129541873932,0.2506089508533478,665.8878784179688,1e-05,0.07586240023374557,2.474747896194458,23.927850246429443,1 +6291,0.17468363046646118,0.1562519371509552,0.153501957654953,0.26624998450279236,871.2120971679688,1e-05,0.07146737724542618,2.3526973724365234,23.927850246429443,1 +6292,0.2412269562482834,0.1325153410434723,0.13339529931545258,0.11147435754537582,725.671142578125,1e-05,0.07218369096517563,2.3452367782592773,23.927850246429443,1 +6293,0.1699572503566742,0.20341837406158447,0.19474641978740692,0.2683012783527374,952.9466552734375,1e-05,0.06734936684370041,2.7019219398498535,23.927850246429443,1 +6294,0.2445470094680786,0.19413746893405914,0.1927868276834488,0.18320512771606445,779.3674926757812,1e-05,0.07635406404733658,2.5735721588134766,23.927850246429443,1 +6295,0.2515244781970978,0.11458062380552292,0.11586438119411469,0.0948076918721199,895.6915893554688,1e-05,0.0714920312166214,2.3557000160217285,23.927850246429443,1 +6296,0.25020357966423035,0.31795933842658997,0.3147251307964325,0.26499998569488525,303.0303039550781,1e-05,0.06458643078804016,2.3476052284240723,23.927850246429443,1 +6297,0.2898356020450592,0.19277988374233246,0.1895896941423416,0.2090063989162445,923.458740234375,1e-05,0.06820168346166611,2.348177671432495,23.927850246429443,1 +6298,0.1921909600496292,0.32304373383522034,0.3240465223789215,0.24753203988075256,996.5530395507812,1e-05,0.07120580226182938,2.513144016265869,23.927850246429443,1 +6299,0.20801149308681488,0.14379936456680298,0.1405183970928192,0.22288461029529572,798.4103393554688,1e-05,0.06745500862598419,2.3534345626831055,23.927850246429443,1 +6300,0.15408356487751007,0.16870667040348053,0.15924572944641113,0.20830127596855164,894.0774536132812,1e-05,0.07097966969013214,2.4765524864196777,23.927850246429443,1 +6301,0.1649014800786972,0.14060723781585693,0.13956871628761292,0.29413461685180664,859.375,1e-05,0.06747665256261826,2.3605637550354004,23.927850246429443,1 +6302,0.2818692922592163,0.21414367854595184,0.2141190469264984,0.17455127835273743,895.2894897460938,1e-05,0.07543040066957474,2.357110023498535,23.927850246429443,1 +6303,0.23071834444999695,0.17794129252433777,0.18305547535419464,0.23464742302894592,444.587646484375,1e-05,0.07712678611278534,2.354750394821167,23.927850246429443,1 +6304,0.0923205316066742,0.16383585333824158,0.15586626529693604,0.24237178266048431,869.3666381835938,1e-05,0.06125970557332039,2.7202699184417725,23.927850246429443,1 +6305,0.3004494309425354,0.17224463820457458,0.17045672237873077,0.21211537718772888,740.2120361328125,1e-05,0.06956011801958084,2.3682215213775635,23.927850246429443,1 +6306,0.2338113933801651,0.17035163938999176,0.1587030291557312,0.20782050490379333,828.8410034179688,1e-05,0.0770520269870758,2.3570775985717773,23.927850246429443,1 +6307,0.1632988303899765,0.2399328500032425,0.2265927940607071,0.1616666615009308,957.39697265625,1e-05,0.0671018660068512,2.3522136211395264,23.927850246429443,1 +6308,0.2303435504436493,0.1829906702041626,0.1810578852891922,0.2556730806827545,519.8598022460938,1e-05,0.06007513403892517,2.478719472885132,23.927850246429443,1 +6309,0.177634596824646,0.1264965832233429,0.13175730407238007,0.19355767965316772,893.2648315429688,1e-05,0.06101110950112343,2.3627657890319824,23.927850246429443,1 +6310,0.1833977848291397,0.087382972240448,0.0867774561047554,0.20923076570034027,957.6707763671875,1e-05,0.061698928475379944,2.351903200149536,23.927850246429443,1 +6311,0.16032446920871735,0.28199613094329834,0.2660454213619232,0.2518269121646881,992.58642578125,1e-05,0.07008074969053268,2.5093894004821777,23.927850246429443,1 +6312,0.2539094090461731,0.19869770109653473,0.19952425360679626,0.27253204584121704,579.399169921875,1e-05,0.0660334900021553,2.3579161167144775,23.927850246429443,1 +6313,0.2624628245830536,0.22451139986515045,0.22803549468517303,0.24868588149547577,950.3834838867188,1e-05,0.06847739219665527,2.353071689605713,23.927850246429443,1 +6314,0.16165822744369507,0.14510369300842285,0.1412860006093979,0.29006409645080566,869.8297119140625,1e-05,0.05699549615383148,2.638749837875366,23.927850246429443,1 +6315,0.13438637554645538,0.26021385192871094,0.25495633482933044,0.23855768144130707,930.4703369140625,1e-05,0.060279104858636856,2.796215295791626,23.927850246429443,1 +6316,0.1633385866880417,0.1314384490251541,0.1334313452243805,0.2527884542942047,560.154541015625,1e-05,0.0632735937833786,2.3583743572235107,23.927850246429443,1 +6317,0.20875424146652222,0.18803274631500244,0.1846003532409668,0.24618588387966156,681.8181762695312,1e-05,0.061483487486839294,2.354015827178955,23.927850246429443,1 +6318,0.17855340242385864,0.580369770526886,0.5949814915657043,0.2519551217556,105.31136322021484,1e-05,0.06364994496107101,2.3540961742401123,23.927850246429443,1 +6319,0.2700744569301605,0.1334501951932907,0.13500066101551056,0.1987820416688919,623.7474975585938,1e-05,0.07634755969047546,2.5253078937530518,23.927850246429443,1 +6320,0.21780382096767426,0.21887561678886414,0.2087625116109848,0.25448715686798096,844.6821899414062,1e-05,0.07353974878787994,2.358490228652954,23.927850246429443,1 +6321,0.15891408920288086,0.11200600117444992,0.11776003986597061,0.1742948591709137,743.5170288085938,1e-05,0.07005731761455536,2.3564605712890625,23.927850246429443,1 +6322,0.27923181653022766,0.1949288696050644,0.19002270698547363,0.23179486393928528,823.6697998046875,1e-05,0.06776928156614304,2.4728763103485107,23.927850246429443,1 +6323,0.2438919097185135,0.4165489971637726,0.41946208477020264,0.22987177968025208,228.7581787109375,1e-05,0.07131841778755188,2.3587656021118164,23.927850246429443,1 +6324,0.287731409072876,0.16138771176338196,0.15945349633693695,0.22833332419395447,897.2911987304688,1e-05,0.07977143675088882,2.5844671726226807,23.927850246429443,1 +6325,0.15833376348018646,0.2659057378768921,0.25982865691185,0.2283012717962265,969.9821166992188,1e-05,0.0727614313364029,2.6053295135498047,23.927850246429443,1 +6326,0.11296402662992477,0.10736323148012161,0.102169930934906,0.2710256278514862,945.4190673828125,1e-05,0.07334063947200775,2.489309549331665,23.927850246429443,1 +6327,0.35802263021469116,0.31534886360168457,0.31291070580482483,0.23615384101867676,489.6593933105469,1e-05,0.07464753091335297,2.351771593093872,23.927850246429443,1 +6328,0.13648110628128052,0.24718059599399567,0.23863016068935394,0.2381410151720047,963.5654907226562,1e-05,0.07757041603326797,2.349985361099243,23.927850246429443,1 +6329,0.0950707420706749,0.3088624179363251,0.3053272068500519,0.20006409287452698,979.6713256835938,1e-05,0.06591374427080154,2.454397678375244,23.927850246429443,1 +6330,0.12451928108930588,0.16471567749977112,0.1615043580532074,0.33195510506629944,533.2568969726562,1e-05,0.06389958411455154,2.358084201812744,23.927850246429443,1 +6331,0.33673766255378723,0.29312410950660706,0.3034931719303131,0.19057691097259521,993.642333984375,1e-05,0.06407340615987778,2.348118543624878,23.927850246429443,1 +6332,0.13600191473960876,0.10080140084028244,0.10574940592050552,0.1961858868598938,853.9290161132812,1e-05,0.06450516730546951,2.453425884246826,23.927850246429443,1 +6333,0.11848768591880798,0.20759238302707672,0.19833914935588837,0.2444230616092682,797.7569580078125,1e-05,0.06322576850652695,2.3597216606140137,23.927850246429443,1 +6334,0.28982824087142944,0.33293643593788147,0.34062081575393677,0.2351602464914322,194.25677490234375,1e-05,0.060883939266204834,2.350574254989624,23.927850246429443,1 +6335,0.12647563219070435,0.14776737987995148,0.14626847207546234,0.24128204584121704,796.4441528320312,1e-05,0.073087677359581,2.532750129699707,23.927850246429443,1 +6336,0.27767977118492126,0.19002856314182281,0.19077353179454803,0.23124998807907104,754.75439453125,1e-05,0.06496547907590866,2.6934168338775635,23.927850246429443,1 +6337,0.21018610894680023,0.13319450616836548,0.14617623388767242,0.22826921939849854,948.9403076171875,1e-05,0.06520693749189377,2.3539047241210938,23.927850246429443,1 +6338,0.22208428382873535,0.1905985027551651,0.18030662834644318,0.2424679398536682,946.6019287109375,1e-05,0.07249265164136887,2.3518104553222656,23.927850246429443,1 +6339,0.1357100009918213,0.10324843972921371,0.10443446785211563,0.18650640547275543,853.4264526367188,1e-05,0.07926147431135178,2.346534490585327,23.927850246429443,1 +6340,0.29480087757110596,0.15799278020858765,0.1499042958021164,0.23455128073692322,720.3389282226562,1e-05,0.06910130381584167,2.5719428062438965,23.927850246429443,1 +6341,0.15621189773082733,0.27565670013427734,0.2691860795021057,0.28198716044425964,944.52587890625,1e-05,0.07112793624401093,2.3520917892456055,23.927850246429443,1 +6342,0.22691653668880463,0.3047163188457489,0.2990434169769287,0.1631089746952057,993.2210693359375,1e-05,0.07388968020677567,2.347578525543213,23.927850246429443,1 +6343,0.2060442715883255,0.17547540366649628,0.16228361427783966,0.21419870853424072,911.0628662109375,1e-05,0.07162118703126907,2.471074104309082,23.927850246429443,1 +6344,0.20839901268482208,0.15295983850955963,0.15227101743221283,0.2234935760498047,482.1867370605469,1e-05,0.07636862248182297,2.3667972087860107,23.927850246429443,1 +6345,0.18203313648700714,0.28915080428123474,0.2870030701160431,0.24964742362499237,485.94134521484375,1e-05,0.060405101627111435,2.569826602935791,23.927850246429443,1 +6346,0.2305615395307541,0.18458443880081177,0.17867834866046906,0.2620833218097687,940.900146484375,1e-05,0.09028033912181854,2.583244562149048,23.927850246429443,1 +6347,0.2453397661447525,0.10995960235595703,0.11239180713891983,0.1469871699810028,848.3289794921875,1e-05,0.08939559012651443,2.639739513397217,23.927850246429443,1 +6348,0.13621830940246582,0.1936916559934616,0.19628947973251343,0.21435897052288055,942.1181640625,1e-05,0.08298977464437485,2.3621535301208496,23.927850246429443,1 +6349,0.1960158497095108,0.13598258793354034,0.12960225343704224,0.20192307233810425,764.7515258789062,1e-05,0.058582790195941925,2.353895902633667,23.927850246429443,1 +6350,0.19266259670257568,0.2406604290008545,0.22721201181411743,0.22846153378486633,919.6617431640625,1e-05,0.07525116950273514,2.3576273918151855,23.927850246429443,1 +6351,0.22185319662094116,0.25708919763565063,0.29101648926734924,0.17685896158218384,204.84951782226562,1e-05,0.08171841502189636,2.5411689281463623,23.927850246429443,1 +6352,0.20233199000358582,0.18946228921413422,0.19127124547958374,0.16519230604171753,468.75,1e-05,0.07581173628568649,2.355165958404541,23.927850246429443,1 +6353,0.21097704768180847,0.43169769644737244,0.43047311902046204,0.27775639295578003,225.4098358154297,1e-05,0.07188038527965546,2.358532428741455,23.927850246429443,1 +6354,0.24818235635757446,0.1695602983236313,0.1665281057357788,0.17182691395282745,618.6868286132812,1e-05,0.06942642480134964,2.5753774642944336,23.927850246429443,1 +6355,0.17105796933174133,0.26027438044548035,0.25266510248184204,0.241314098238945,863.7206420898438,1e-05,0.06668759137392044,2.3666090965270996,23.927850246429443,1 +6356,0.3282742202281952,0.28463658690452576,0.2788691818714142,0.19775640964508057,338.9212646484375,1e-05,0.07197624444961548,2.4836843013763428,23.927850246429443,1 +6357,0.24863722920417786,0.2856076657772064,0.29150131344795227,0.22557690739631653,314.37127685546875,1e-05,0.06913254410028458,2.665487051010132,23.927850246429443,1 +6358,0.23251721262931824,0.1798316091299057,0.17652790248394012,0.26596152782440186,756.319091796875,1e-05,0.06446082144975662,2.475656032562256,23.927850246429443,1 +6359,0.2505175769329071,0.14952436089515686,0.14812886714935303,0.21118588745594025,605.6701049804688,1e-05,0.07308878004550934,2.3473663330078125,23.927850246429443,1 +6360,0.1239289715886116,0.3307856023311615,0.3283645510673523,0.14163461327552795,989.5833129882812,1e-05,0.10121684521436691,2.349475622177124,23.927850246429443,1 +6361,0.17978322505950928,0.3105676472187042,0.2997269332408905,0.19576922059059143,987.8356323242188,1e-05,0.06859893351793289,2.5742247104644775,23.927850246429443,1 +6362,0.2510773241519928,0.34518587589263916,0.3364696502685547,0.2487499862909317,317.1641845703125,1e-05,0.06963931769132614,2.359135150909424,23.927850246429443,1 +6363,0.1913701742887497,0.11924442648887634,0.11776214838027954,0.13487179577350616,938.1237182617188,1e-05,0.07610300183296204,2.349729537963867,23.927850246429443,1 +6364,0.22243790328502655,0.10797090828418732,0.10756777226924896,0.2265705019235611,706.521728515625,1e-05,0.060040973126888275,2.4513134956359863,23.927850246429443,1 +6365,0.2970275282859802,0.1796502321958542,0.18107552826404572,0.16083332896232605,619.959716796875,1e-05,0.08022674918174744,2.358802556991577,23.927850246429443,1 +6366,0.15697737038135529,0.15084682404994965,0.14161494374275208,0.27858972549438477,817.174560546875,1e-05,0.06275518983602524,2.350137710571289,23.927850246429443,1 +6367,0.2037455141544342,0.15733687579631805,0.15459071099758148,0.19884614646434784,833.3333129882812,1e-05,0.07187401503324509,2.581528663635254,23.927850246429443,1 +6368,0.20285913348197937,0.645169734954834,0.6461782455444336,0.22403845191001892,101.10294342041016,1e-05,0.06140388920903206,2.5762789249420166,23.927850246429443,1 +6369,0.18529543280601501,0.2348470240831375,0.23255160450935364,0.2581089735031128,398.5013732910156,1e-05,0.0751429945230484,2.359339475631714,23.927850246429443,1 +6370,0.186046302318573,0.1572488695383072,0.15081024169921875,0.2149038314819336,484.06866455078125,1e-05,0.0672273337841034,2.3436124324798584,23.927850246429443,1 +6371,0.2831367254257202,0.3084597587585449,0.30473095178604126,0.22310896217823029,336.25732421875,1e-05,0.0886235386133194,2.4754979610443115,23.927850246429443,1 +6372,0.20676244795322418,0.1958177089691162,0.1947060227394104,0.22266024351119995,541.3831787109375,1e-05,0.06998021900653839,2.3564186096191406,23.927850246429443,1 +6373,0.14522510766983032,0.17177928984165192,0.16990920901298523,0.2291666567325592,949.22998046875,1e-05,0.06884085386991501,2.3442201614379883,23.927850246429443,1 +6374,0.11584657430648804,0.19237731397151947,0.207397922873497,0.165512815117836,990.87890625,1e-05,0.08325649797916412,2.3461220264434814,23.927850246429443,1 +6375,0.20070719718933105,0.16144531965255737,0.15691840648651123,0.1983974277973175,690.9660034179688,1e-05,0.08269000053405762,2.571153402328491,23.927850246429443,1 +6376,0.109260693192482,0.28204265236854553,0.2705214023590088,0.21028845012187958,986.50927734375,1e-05,0.06755457073450089,2.3422067165374756,23.927850246429443,1 +6377,0.20003636181354523,0.21463197469711304,0.21307341754436493,0.2564423084259033,964.3510131835938,1e-05,0.07346787303686142,2.464995861053467,23.927850246429443,1 +6378,0.08884178102016449,0.16702096164226532,0.17563259601593018,0.17044870555400848,709.3425903320312,1e-05,0.07184172421693802,2.4799838066101074,23.927850246429443,1 +6379,0.13661323487758636,0.21054041385650635,0.2085629552602768,0.12560896575450897,961.1829223632812,1e-05,0.07931947708129883,2.562145471572876,23.927850246429443,1 +6380,0.2089499682188034,0.11576144397258759,0.12045658379793167,0.2244551181793213,907.3464965820312,1e-05,0.07113991677761078,2.3484628200531006,23.927850246429443,1 +6381,0.36947157979011536,0.14977359771728516,0.1433292031288147,0.2457692176103592,874.3990478515625,1e-05,0.068416528403759,2.3445873260498047,23.927850246429443,1 +6382,0.19401033222675323,0.41615504026412964,0.4004623293876648,0.26025640964508057,994.89794921875,1e-05,0.08340617269277573,2.562588691711426,23.927850246429443,1 +6383,0.25301066040992737,0.20855405926704407,0.20739607512950897,0.27099359035491943,987.3948974609375,1e-05,0.06627916544675827,2.3570868968963623,23.927850246429443,1 +6384,0.31424546241760254,0.27371910214424133,0.2643735706806183,0.23262819647789001,493.3414306640625,1e-05,0.07968339323997498,2.3438541889190674,23.927850246429443,1 +6385,0.14610163867473602,0.06730098277330399,0.0680094063282013,0.14570511877536774,750.0000610351562,1e-05,0.06604615598917007,2.344794273376465,23.927850246429443,1 +6386,0.2196991741657257,0.13062016665935516,0.12311623245477676,0.22884614765644073,877.0883178710938,1e-05,0.06549137830734253,2.4671597480773926,23.927850246429443,1 +6387,0.2782359719276428,0.2022523432970047,0.20203199982643127,0.25304487347602844,563.1868286132812,1e-05,0.0997946709394455,2.345885753631592,23.927850246429443,1 +6388,0.1468416005373001,0.16523775458335876,0.1617971658706665,0.23301281034946442,798.4103393554688,1e-05,0.06225861236453056,2.580601930618286,23.927850246429443,1 +6389,0.18780966103076935,0.14547662436962128,0.14805762469768524,0.23464742302894592,723.0185546875,1e-05,0.06461945921182632,2.5793745517730713,23.927850246429443,1 +6390,0.11185692250728607,0.15734554827213287,0.14372608065605164,0.23394230008125305,757.8740844726562,1e-05,0.0693792924284935,2.3636868000030518,23.927850246429443,1 +6391,0.21961244940757751,0.25097382068634033,0.24360652267932892,0.2530769109725952,333.5777282714844,1e-05,0.06781183928251266,2.358381986618042,23.927850246429443,1 +6392,0.27697810530662537,0.20726759731769562,0.2091449648141861,0.18926280736923218,686.9369506835938,1e-05,0.06937610357999802,2.4693191051483154,23.927850246429443,1 +6393,0.18166407942771912,0.14044778048992157,0.1470022201538086,0.20980767905712128,921.0526123046875,1e-05,0.06318989396095276,2.3565971851348877,23.927850246429443,1 +6394,0.2750765085220337,0.19689328968524933,0.19399626553058624,0.1783333271741867,679.7445678710938,1e-05,0.08025318384170532,2.347594976425171,23.927850246429443,1 +6395,0.1830769181251526,0.27134445309638977,0.2622922956943512,0.09003204852342606,939.9801635742188,1e-05,0.0715385377407074,2.3484456539154053,23.927850246429443,1 +6396,0.214129239320755,0.943636953830719,0.9520243406295776,0.2500961422920227,29.296875,1e-05,0.059279922395944595,2.3522403240203857,23.927850246429443,1 +6397,0.2520839273929596,0.31367042660713196,0.31231409311294556,0.22999998927116394,359.68658447265625,1e-05,0.07569794356822968,2.479919672012329,23.927850246429443,1 +6398,0.20162704586982727,0.14320583641529083,0.14953230321407318,0.23307691514492035,813.5474853515625,1e-05,0.06766069680452347,2.3497164249420166,23.927850246429443,1 +6399,0.15527985990047455,0.11998383700847626,0.11931860446929932,0.22333332896232605,765.50390625,1e-05,0.08980751037597656,2.800914764404297,23.927850246429443,1 +6400,0.17464683949947357,0.159142404794693,0.1566188633441925,0.17826922237873077,922.431884765625,1e-05,0.10593780130147934,2.520841121673584,23.927850246429443,1 +6401,0.18115581572055817,0.1545213758945465,0.154734268784523,0.26028844714164734,583.6886596679688,1e-05,0.10832598060369492,2.34787917137146,23.927850246429443,1 +6402,0.22719323635101318,0.14621007442474365,0.142870232462883,0.16621793806552887,907.7218017578125,1e-05,0.0847024917602539,2.3444464206695557,23.927850246429443,1 +6403,0.33996933698654175,0.24835853278636932,0.2460028976202011,0.23009614646434784,333.5777282714844,1e-05,0.08091294020414352,2.5682871341705322,23.927850246429443,1 +6404,0.1309591680765152,0.1344110071659088,0.14458578824996948,0.24480769038200378,966.1671142578125,1e-05,0.05683135613799095,2.353637218475342,23.927850246429443,1 +6405,0.24896220862865448,0.28384721279144287,0.27516281604766846,0.2849358916282654,905.8369750976562,1e-05,0.08032352477312088,2.347292423248291,23.927850246429443,1 +6406,0.23507285118103027,0.1787525862455368,0.17075380682945251,0.2519230544567108,807.9915161132812,1e-05,0.07540091872215271,2.3451380729675293,23.927850246429443,1 +6407,0.23959340155124664,0.14949649572372437,0.14824485778808594,0.23567306995391846,763.2398681640625,1e-05,0.0822845920920372,2.5962817668914795,23.927850246429443,1 +6408,0.19898679852485657,0.2129647135734558,0.21073922514915466,0.25525641441345215,777.2314453125,1e-05,0.06062193959951401,2.3561558723449707,23.927850246429443,1 +6409,0.24020856618881226,0.33656567335128784,0.33087700605392456,0.27871793508529663,534.8970336914062,1e-05,0.0747985988855362,2.580554246902466,23.927850246429443,1 +6410,0.14627651870250702,0.11430215835571289,0.10856392979621887,0.06666666269302368,723.90576171875,1e-05,0.07295620441436768,2.4853363037109375,23.927850246429443,1 +6411,0.1839912086725235,0.20454558730125427,0.1946353167295456,0.2756730616092682,940.287353515625,1e-05,0.07346108555793762,2.3575332164764404,23.927850246429443,1 +6412,0.2026074230670929,0.15745288133621216,0.14920707046985626,0.20064102113246918,823.6697998046875,1e-05,0.07314756512641907,2.350243330001831,23.927850246429443,1 +6413,0.12570294737815857,0.2676445245742798,0.25218749046325684,0.2540704905986786,993.2210693359375,1e-05,0.06796146184206009,2.358168125152588,23.927850246429443,1 +6414,0.2685837745666504,0.3458954095840454,0.3438735008239746,0.15823717415332794,364.73089599609375,1e-05,0.07512564957141876,2.5389225482940674,23.927850246429443,1 +6415,0.11696607619524002,0.0896611362695694,0.10181304812431335,0.2117948681116104,772.1712036132812,1e-05,0.08528218418359756,2.356578826904297,23.927850246429443,1 +6416,0.27505815029144287,0.19749392569065094,0.1845632940530777,0.18435896933078766,715.8119506835938,1e-05,0.09216831624507904,2.353538990020752,23.927850246429443,1 +6417,0.2650936245918274,0.19449134171009064,0.19516801834106445,0.21333332359790802,544.5823974609375,1e-05,0.07916317135095596,2.354036331176758,23.927850246429443,1 +6418,0.16278670728206635,0.17330816388130188,0.15956978499889374,0.1942628175020218,836.0927734375,1e-05,0.06776849925518036,2.5024313926696777,23.927850246429443,1 +6419,0.11844440549612045,0.22425025701522827,0.2258477658033371,0.22833332419395447,982.4486694335938,1e-05,0.0623873807489872,2.361191987991333,23.927850246429443,1 +6420,0.17856529355049133,0.2641550302505493,0.2596258223056793,0.3053846061229706,971.7275390625,1e-05,0.06997309625148773,2.495978593826294,23.927850246429443,1 +6421,0.15240204334259033,0.1639547348022461,0.1555735468864441,0.10246794670820236,855.9268798828125,1e-05,0.07002293318510056,2.8089988231658936,23.927850246429443,1 +6422,0.14788565039634705,0.21530915796756744,0.20577390491962433,0.26826921105384827,856.4231567382812,1e-05,0.06953438371419907,2.3558003902435303,23.927850246429443,1 +6423,0.24007947742938995,0.1773838847875595,0.18329328298568726,0.14278845489025116,470.6982727050781,1e-05,0.06762055307626724,2.3470053672790527,23.927850246429443,1 +6424,0.25550180673599243,0.19466964900493622,0.19107505679130554,0.250576913356781,596.2343139648438,1e-05,0.068636953830719,2.5638937950134277,23.927850246429443,1 +6425,0.10808315128087997,0.18191476166248322,0.17713981866836548,0.2581730782985687,927.5025634765625,1e-05,0.09456241130828857,2.364816904067993,23.927850246429443,1 +6426,0.14558331668376923,0.21067872643470764,0.20325154066085815,0.2468269169330597,856.9182739257812,1e-05,0.06111359968781471,2.3541157245635986,23.927850246429443,1 +6427,0.23958554863929749,0.7806558609008789,0.7864970564842224,0.18163460493087769,83.95523071289062,1e-05,0.07987356185913086,2.3552608489990234,23.927850246429443,1 +6428,0.1494583934545517,0.1474836766719818,0.14586777985095978,0.24339742958545685,697.8798828125,1e-05,0.0626269206404686,2.3553030490875244,23.927850246429443,1 +6429,0.1670048087835312,0.23718997836112976,0.23835845291614532,0.14499999582767487,948.3590698242188,1e-05,0.0679926723241806,2.57793927192688,23.927850246429443,1 +6430,0.24657383561134338,0.5202752947807312,0.49964001774787903,0.2212499976158142,201.34228515625,1e-05,0.07278234511613846,2.507920265197754,23.927850246429443,1 +6431,0.2589374780654907,0.29690098762512207,0.28136640787124634,0.21887819468975067,975.15380859375,1e-05,0.0808555856347084,2.520150661468506,23.927850246429443,1 +6432,0.21252384781837463,0.8071104288101196,0.8065941333770752,0.23342947661876678,66.28787994384766,1e-05,0.07219225913286209,2.470505952835083,23.927850246429443,1 +6433,0.27945101261138916,0.17950527369976044,0.17408740520477295,0.07115384191274643,871.670654296875,1e-05,0.06662334501743317,2.3482697010040283,23.927850246429443,1 +6434,0.17700470983982086,0.12642863392829895,0.11766153573989868,0.22769230604171753,678.7020263671875,1e-05,0.08182211965322495,2.4794182777404785,23.927850246429443,1 +6435,0.14198660850524902,0.16986173391342163,0.1599341779947281,0.2047756314277649,948.6500244140625,1e-05,0.06234702467918396,2.3583014011383057,23.927850246429443,1 +6436,0.1696448028087616,0.1604980230331421,0.1617611050605774,0.26480767130851746,876.6427001953125,1e-05,0.07320607453584671,2.356796979904175,23.927850246429443,1 +6437,0.13016049563884735,0.2527405619621277,0.2513763904571533,0.2306089699268341,983.36181640625,1e-05,0.07878667116165161,2.358351469039917,23.927850246429443,1 +6438,0.27287718653678894,0.14318527281284332,0.14495141804218292,0.25785255432128906,799.7118530273438,1e-05,0.08767568320035934,2.356471538543701,23.927850246429443,1 +6439,0.08625292778015137,0.26425155997276306,0.25736749172210693,0.20576922595500946,967.194580078125,1e-05,0.07740700989961624,2.481672763824463,23.927850246429443,1 +6440,0.2621991038322449,0.28884822130203247,0.30484724044799805,0.13067306578159332,172.413818359375,1e-05,0.07195262610912323,2.3662054538726807,23.927850246429443,1 +6441,0.18963338434696198,0.2600940763950348,0.25573623180389404,0.27756407856941223,386.7403564453125,1e-05,0.061707254499197006,2.511823892593384,23.927850246429443,1 +6442,0.1807372272014618,0.1220068633556366,0.12353672087192535,0.10753204673528671,669.14501953125,1e-05,0.06735437363386154,2.5975937843322754,23.927850246429443,1 +6443,0.21846222877502441,0.21649570763111115,0.2179718315601349,0.15862178802490234,946.6019287109375,1e-05,0.08901155740022659,2.5971879959106445,23.927850246429443,1 +6444,0.22679854929447174,0.4509918689727783,0.4316971004009247,0.1960897296667099,995.728271484375,1e-05,0.07779081910848618,2.354069232940674,23.927850246429443,1 +6445,0.22155404090881348,0.17004986107349396,0.17021027207374573,0.18060897290706635,655.8935546875,1e-05,0.07191538065671921,2.5029358863830566,23.927850246429443,1 +6446,0.18020950257778168,0.26917192339897156,0.2599833607673645,0.2199038416147232,990.0166625976562,1e-05,0.06437305361032486,2.348210334777832,23.927850246429443,1 +6447,0.11511315405368805,0.16016371548175812,0.15996256470680237,0.2416987121105194,759.419189453125,1e-05,0.10210303217172623,2.3524248600006104,23.927850246429443,1 +6448,0.16514557600021362,0.1321987509727478,0.12795987725257874,0.1832692176103592,774.3531494140625,1e-05,0.07057912647724152,2.353358268737793,23.927850246429443,1 +6449,0.23310865461826324,0.3770906925201416,0.3468937873840332,0.17980769276618958,992.374267578125,1e-05,0.05833684653043747,2.3494784832000732,23.927850246429443,1 +6450,0.24551934003829956,0.5377948880195618,0.5279914140701294,0.2173076868057251,125.89928436279297,1e-05,0.06722505390644073,2.5773730278015137,23.927850246429443,1 +6451,0.22942815721035004,0.13335293531417847,0.13338708877563477,0.15525640547275543,619.959716796875,1e-05,0.08156999945640564,2.353823661804199,23.927850246429443,1 +6452,0.21219530701637268,0.19443786144256592,0.19525288045406342,0.2470192164182663,775.0761108398438,1e-05,0.06492315977811813,2.4920973777770996,23.927850246429443,1 +6453,0.3626982271671295,0.23295147716999054,0.22958646714687347,0.2487499862909317,544.5823974609375,1e-05,0.07199505716562271,2.636611223220825,23.927850246429443,1 +6454,0.30192655324935913,0.16334909200668335,0.16983486711978912,0.20692306756973267,765.50390625,1e-05,0.08960916846990585,2.3557820320129395,23.927850246429443,1 +6455,0.23633937537670135,0.17249281704425812,0.16465720534324646,0.26567307114601135,702.7145385742188,1e-05,0.08277533203363419,2.473543405532837,23.927850246429443,1 +6456,0.18753142654895782,0.15764513611793518,0.15553095936775208,0.26778843998908997,846.7742309570312,1e-05,0.06502925604581833,2.3567254543304443,23.927850246429443,1 +6457,0.20455290377140045,0.4349181354045868,0.4660454988479614,0.1825961470603943,157.3426513671875,1e-05,0.06507661193609238,2.3492817878723145,23.927850246429443,1 +6458,0.10075510293245316,0.3767213225364685,0.36238184571266174,0.20762819051742554,974.9119873046875,1e-05,0.06192893162369728,2.3501474857330322,23.927850246429443,1 +6459,0.226902037858963,0.19921797513961792,0.19180749356746674,0.22929486632347107,804.208251953125,1e-05,0.07527053356170654,2.345545530319214,23.927850246429443,1 +6460,0.19095927476882935,0.30795958638191223,0.3072434663772583,0.23246793448925018,344.2029113769531,1e-05,0.07940879464149475,2.4534597396850586,23.927850246429443,1 +6461,0.21316057443618774,0.6299065351486206,0.6404856443405151,0.2523076832294464,133.9285888671875,1e-05,0.08492008596658707,2.3593292236328125,23.927850246429443,1 +6462,0.1388077437877655,0.16481944918632507,0.15572626888751984,0.22371794283390045,792.4597778320312,1e-05,0.06828545778989792,2.4838318824768066,23.927850246429443,1 +6463,0.34153643250465393,0.18839502334594727,0.18047402799129486,0.20092947781085968,816.57421875,1e-05,0.08027336746454239,2.7082021236419678,23.927850246429443,1 +6464,0.27787184715270996,0.17055292427539825,0.16585083305835724,0.23205126821994781,890.8045654296875,1e-05,0.08440367877483368,2.4901700019836426,23.927850246429443,1 +6465,0.24535655975341797,0.09519021213054657,0.09328892827033997,0.16173076629638672,718.5374145507812,1e-05,0.06988495588302612,2.357001781463623,23.927850246429443,1 +6466,0.169147327542305,0.30309170484542847,0.27825379371643066,0.24964742362499237,971.23095703125,1e-05,0.08574216067790985,2.5663902759552,23.927850246429443,1 +6467,0.22512197494506836,0.1742154359817505,0.16861888766288757,0.2527884542942047,940.900146484375,1e-05,0.06966745108366013,2.364427089691162,23.927850246429443,1 +6468,0.3060595989227295,0.1495264768600464,0.14704938232898712,0.2548397481441498,606.9959106445312,1e-05,0.07781506329774857,2.354992389678955,23.927850246429443,1 +6469,0.17200429737567902,0.29283013939857483,0.2822299599647522,0.24983973801136017,987.174072265625,1e-05,0.0759216770529747,2.356898784637451,23.927850246429443,1 +6470,0.139807790517807,0.15868060290813446,0.16006867587566376,0.20474357903003693,780.0751953125,1e-05,0.07556837797164917,2.3585731983184814,23.927850246429443,1 +6471,0.13350899517536163,0.14029905200004578,0.13511493802070618,0.12903845310211182,757.0978393554688,1e-05,0.08218993991613388,2.573859691619873,23.927850246429443,1 +6472,0.2059996873140335,0.15097837150096893,0.15380892157554626,0.2565705180168152,906.5933837890625,1e-05,0.07556824386119843,2.571671962738037,23.927850246429443,1 +6473,0.17783856391906738,0.18252187967300415,0.1795119047164917,0.22980768978595734,688.9586791992188,1e-05,0.06659260392189026,2.358335256576538,23.927850246429443,1 +6474,0.2142171561717987,0.1263105869293213,0.1239638403058052,0.23134614527225494,682.8494262695312,1e-05,0.06624908000230789,2.6141984462738037,23.927850246429443,1 +6475,0.3302760720252991,0.24086423218250275,0.23952645063400269,0.2835897207260132,723.0185546875,1e-05,0.07997148483991623,2.3556196689605713,23.927850246429443,1 +6476,0.16242969036102295,0.24616140127182007,0.23065713047981262,0.21967947483062744,965.6505737304688,1e-05,0.07069805264472961,2.345726251602173,23.927850246429443,1 +6477,0.2500954568386078,0.17040613293647766,0.16773390769958496,0.2050640881061554,944.8242797851562,1e-05,0.07127340137958527,2.4779272079467773,23.927850246429443,1 +6478,0.25934016704559326,0.7540333271026611,0.7537338137626648,0.21753203868865967,79.58802795410156,1e-05,0.08283756673336029,2.3480725288391113,23.927850246429443,1 +6479,0.20837844908237457,0.15878136456012726,0.1563318371772766,0.19166666269302368,801.0057983398438,1e-05,0.0674542486667633,2.3464887142181396,23.927850246429443,1 +6480,0.18999667465686798,0.14488551020622253,0.13585162162780762,0.26121795177459717,877.5327758789062,1e-05,0.07484568655490875,2.350285768508911,23.927850246429443,1 +6481,0.21699002385139465,0.1780708134174347,0.17227864265441895,0.26387819647789,747.5884399414062,1e-05,0.08467579632997513,2.4561569690704346,23.927850246429443,1 +6482,0.21391281485557556,0.14001446962356567,0.13429740071296692,0.23730768263339996,912.162109375,1e-05,0.07130192965269089,2.3525917530059814,23.927850246429443,1 +6483,0.19863535463809967,0.24837490916252136,0.24923285841941833,0.16141025722026825,427.6316223144531,1e-05,0.06890564411878586,2.4682235717773438,23.927850246429443,1 +6484,0.15078666806221008,0.20926500856876373,0.2130582183599472,0.25208333134651184,958.4887084960938,1e-05,0.09715264290571213,2.4939212799072266,23.927850246429443,1 +6485,0.2443215399980545,0.18938681483268738,0.1767757385969162,0.2281089723110199,665.8878784179688,1e-05,0.09320343285799026,2.5632283687591553,23.927850246429443,1 +6486,0.1745896339416504,0.2069934904575348,0.2044946551322937,0.24842947721481323,950.9569091796875,1e-05,0.0726185217499733,2.351285457611084,23.927850246429443,1 +6487,0.17724668979644775,0.2379203587770462,0.22473233938217163,0.20721152424812317,954.0719604492188,1e-05,0.07689643651247025,2.350348472595215,23.927850246429443,1 +6488,0.09658348560333252,0.18424992263317108,0.17821469902992249,0.20339742302894592,808.6157836914062,1e-05,0.07897132635116577,2.6055288314819336,23.927850246429443,1 +6489,0.17454634606838226,0.20190519094467163,0.17962957918643951,0.2630448639392853,860.34912109375,1e-05,0.08201266825199127,2.345369338989258,23.927850246429443,1 +6490,0.2288619577884674,0.14059840142726898,0.13957922160625458,0.1931089609861374,918.259033203125,1e-05,0.06838653236627579,2.347235918045044,23.927850246429443,1 +6491,0.185719296336174,0.17493212223052979,0.17971038818359375,0.1652243584394455,772.9007568359375,1e-05,0.06842104345560074,2.3465497493743896,23.927850246429443,1 +6492,0.19650451838970184,0.13407596945762634,0.12708692252635956,0.28314101696014404,872.1281127929688,1e-05,0.06749468296766281,2.5023388862609863,23.927850246429443,1 +6493,0.2558356523513794,0.2406940758228302,0.2400617152452469,0.18993589282035828,319.94049072265625,1e-05,0.07086215168237686,2.3475611209869385,23.927850246429443,1 +6494,0.12458682805299759,0.10186165571212769,0.10347883403301239,0.15983973443508148,835.5437622070312,1e-05,0.06729782372713089,2.4662654399871826,23.927850246429443,1 +6495,0.22469937801361084,0.22082021832466125,0.2185143530368805,0.2469230741262436,502.3923645019531,1e-05,0.06775541603565216,2.4909493923187256,23.927850246429443,1 +6496,0.1619429737329483,0.17233124375343323,0.16874900460243225,0.1631089746952057,936.5596923828125,1e-05,0.07360527664422989,2.545715808868408,23.927850246429443,1 +6497,0.2825160026550293,0.1889888346195221,0.19847680628299713,0.20743589103221893,915.4175415039062,1e-05,0.08899663388729095,2.349125862121582,23.927850246429443,1 +6498,0.13611306250095367,0.2646581828594208,0.2743569612503052,0.21262820065021515,966.4247436523438,1e-05,0.06783337891101837,2.513420820236206,23.927850246429443,1 +6499,0.23931409418582916,0.21417559683322906,0.2107834815979004,0.2557692229747772,965.6505737304688,1e-05,0.07727651298046112,2.3562490940093994,23.927850246429443,1 +6500,0.14737462997436523,0.3162696659564972,0.31092068552970886,0.1932051181793213,971.23095703125,1e-05,0.09987953305244446,2.354846239089966,23.927850246429443,1 +6501,0.1557793766260147,0.2531014680862427,0.24393625557422638,0.15833333134651184,915.0589599609375,1e-05,0.07972590625286102,2.3837921619415283,23.927850246429443,1 +6502,0.19241298735141754,0.21049825847148895,0.21804094314575195,0.213365375995636,897.2911987304688,1e-05,0.09755922853946686,2.461744546890259,23.927850246429443,1 +6503,0.09873894602060318,0.13773863017559052,0.13098488748073578,0.12714743614196777,745.9677734375,1e-05,0.06622800976037979,2.368102550506592,23.927850246429443,1 +6504,0.28620266914367676,0.19928354024887085,0.19285696744918823,0.19044871628284454,691.9642944335938,1e-05,0.10807570070028305,2.3556036949157715,23.927850246429443,1 +6505,0.11455287039279938,0.11890306323766708,0.1223575621843338,0.18487179279327393,965.6505737304688,1e-05,0.0726209357380867,2.778867483139038,23.927850246429443,1 +6506,0.10867421329021454,0.06824552267789841,0.07871027290821075,0.24195511639118195,887.8910522460938,1e-05,0.08942946791648865,2.4635660648345947,23.927850246429443,1 +6507,0.19865788519382477,0.15635527670383453,0.14857511222362518,0.19663460552692413,918.9618530273438,1e-05,0.11245745420455933,2.359565019607544,23.927850246429443,1 +6508,0.2832504212856293,0.8916115164756775,0.9229610562324524,0.27926281094551086,14.822135925292969,1e-05,0.09276589006185532,2.6070830821990967,23.927850246429443,1 +6509,0.2530166208744049,0.10996764153242111,0.11021152138710022,0.26653844118118286,898.8763427734375,1e-05,0.06685777008533478,2.3590874671936035,23.927850246429443,1 +6510,0.20022985339164734,0.14962466061115265,0.1462344378232956,0.24336537718772888,927.1693725585938,1e-05,0.07751286029815674,2.3446662425994873,23.927850246429443,1 +6511,0.2745254337787628,0.17936113476753235,0.18511785566806793,0.23884613811969757,874.8499145507812,1e-05,0.07783642411231995,2.3458328247070312,23.927850246429443,1 +6512,0.1272146850824356,0.26482081413269043,0.25309449434280396,0.2259935885667801,960.6482543945312,1e-05,0.08352779597043991,2.3499221801757812,23.927850246429443,1 +6513,0.22828654944896698,0.19948294758796692,0.19808849692344666,0.2316666543483734,831.6600341796875,1e-05,0.08066996932029724,2.5644712448120117,23.927850246429443,1 +6514,0.19005843997001648,0.3179492950439453,0.30817678570747375,0.21160255372524261,943.3267822265625,1e-05,0.08138024061918259,2.3494205474853516,23.927850246429443,1 +6515,0.21821996569633484,0.20069971680641174,0.19752995669841766,0.2483653724193573,646.7181396484375,1e-05,0.088477224111557,2.3468680381774902,23.927850246429443,1 +6516,0.24951714277267456,0.1515801101922989,0.1446293741464615,0.284519225358963,806.7376098632812,1e-05,0.0785854160785675,2.7488818168640137,23.927850246429443,1 +6517,0.1640976071357727,0.37098339200019836,0.3612525761127472,0.2170192301273346,992.58642578125,1e-05,0.11178866028785706,2.48880672454834,23.927850246429443,1 +6518,0.26102814078330994,0.4401719868183136,0.42640307545661926,0.229358971118927,996.3473510742188,1e-05,0.07608697563409805,2.4947333335876465,23.927850246429443,1 +6519,0.1497201770544052,0.15702137351036072,0.1553311049938202,0.21439102292060852,657.0208740234375,1e-05,0.08246666193008423,2.3597097396850586,23.927850246429443,1 +6520,0.16221600770950317,0.10210880637168884,0.10484594851732254,0.19807691872119904,649.0385131835938,1e-05,0.0758197009563446,2.355133295059204,23.927850246429443,1 +6521,0.23873236775398254,0.22468961775302887,0.22937946021556854,0.219326913356781,937.5,1e-05,0.06380534172058105,2.3571953773498535,23.927850246429443,1 +6522,0.1838940531015396,0.14819973707199097,0.14764249324798584,0.22064101696014404,664.7939453125,1e-05,0.07992921769618988,2.352962017059326,23.927850246429443,1 +6523,0.16123369336128235,0.11674284189939499,0.11960942298173904,0.07496794313192368,725.671142578125,1e-05,0.07544054836034775,2.356870174407959,23.927850246429443,1 +6524,0.13022735714912415,0.16597993671894073,0.16106672585010529,0.18028844892978668,766.25390625,1e-05,0.072130486369133,2.474630832672119,23.927850246429443,1 +6525,0.16687197983264923,0.1853339970111847,0.17790043354034424,0.27878203988075256,975.3954467773438,1e-05,0.08312059938907623,2.354340076446533,23.927850246429443,1 +6526,0.11772581189870834,0.15420964360237122,0.14252382516860962,0.2006089687347412,878.4185791015625,1e-05,0.10665182024240494,2.5760092735290527,23.927850246429443,1 +6527,0.18906179070472717,0.23885633051395416,0.2424129843711853,0.12660256028175354,993.4319458007812,1e-05,0.07209281623363495,2.6173765659332275,23.927850246429443,1 +6528,0.2612152695655823,0.12039671838283539,0.11035391688346863,0.20195512473583221,705.574951171875,1e-05,0.08398377895355225,2.478821277618408,23.927850246429443,1 +6529,0.32221975922584534,0.17343659698963165,0.16374471783638,0.2667948603630066,798.4103393554688,1e-05,0.08060012012720108,2.5815701484680176,23.927850246429443,1 +6530,0.29402416944503784,0.3210799992084503,0.31678491830825806,0.2199999988079071,391.4835205078125,1e-05,0.08893364667892456,2.3519861698150635,23.927850246429443,1 +6531,0.36184799671173096,0.20620086789131165,0.1909814029932022,0.2371794730424881,870.2915649414062,1e-05,0.08227811008691788,2.347916603088379,23.927850246429443,1 +6532,0.08201828598976135,0.204518660902977,0.20625634491443634,0.24317306280136108,946.3070678710938,1e-05,0.06364413350820541,2.3462111949920654,23.927850246429443,1 +6533,0.2232200652360916,0.1999301016330719,0.1937488317489624,0.2545512616634369,952.09716796875,1e-05,0.07872746884822845,2.346858263015747,23.927850246429443,1 +6534,0.14561891555786133,0.16132208704948425,0.14422258734703064,0.2221153825521469,929.4871826171875,1e-05,0.07267113029956818,2.4892380237579346,23.927850246429443,1 +6535,0.08490011841058731,0.1827462762594223,0.19793175160884857,0.29163461923599243,993.642333984375,1e-05,0.09091155230998993,2.357943534851074,23.927850246429443,1 +6536,0.25459060072898865,0.15021586418151855,0.1423773467540741,0.17951922118663788,811.7109985351562,1e-05,0.08371023088693619,2.347632884979248,23.927850246429443,1 +6537,0.26226359605789185,0.15439999103546143,0.15975122153759003,0.27137818932533264,409.94622802734375,1e-05,0.07385287433862686,2.523432731628418,23.927850246429443,1 +6538,0.2937448024749756,0.26820820569992065,0.26329267024993896,0.2240705043077469,533.2568969726562,1e-05,0.06805984675884247,2.3467023372650146,23.927850246429443,1 +6539,0.12502142786979675,0.12495125830173492,0.12876515090465546,0.2184615284204483,898.4814453125,1e-05,0.08610702306032181,2.5138955116271973,23.927850246429443,1 +6540,0.150094673037529,0.13650107383728027,0.1376657485961914,0.2875961363315582,846.2532348632812,1e-05,0.06514523178339005,2.496521472930908,23.927850246429443,1 +6541,0.20462508499622345,0.25116920471191406,0.24256570637226105,0.21958333253860474,780.0751953125,1e-05,0.07575838267803192,2.3476638793945312,23.927850246429443,1 +6542,0.1609666794538498,0.1828741431236267,0.17527055740356445,0.2149038314819336,946.3070678710938,1e-05,0.06897775083780289,2.3490114212036133,23.927850246429443,1 +6543,0.14133991301059723,0.19552552700042725,0.19150474667549133,0.26240384578704834,834.44140625,1e-05,0.06910218298435211,2.351954460144043,23.927850246429443,1 +6544,0.15239934623241425,0.2544098198413849,0.27127373218536377,0.1974358856678009,982.4486694335938,1e-05,0.06953125447034836,2.347323417663574,23.927850246429443,1 +6545,0.36900952458381653,0.18003661930561066,0.1661681979894638,0.2450961470603943,848.8447265625,1e-05,0.08247143030166626,2.506974220275879,23.927850246429443,1 +6546,0.11435766518115997,0.2178936004638672,0.21157293021678925,0.23846152424812317,767.0015869140625,1e-05,0.06229597330093384,2.349569320678711,23.927850246429443,1 +6547,0.21346506476402283,0.15187935531139374,0.16917645931243896,0.22044870257377625,438.31170654296875,1e-05,0.08029191195964813,2.346932888031006,23.927850246429443,1 +6548,0.13239705562591553,0.0837525725364685,0.0891319215297699,0.19788460433483124,802.292236328125,1e-05,0.07596591114997864,2.825108528137207,23.927850246429443,1 +6549,0.4047570526599884,0.18933288753032684,0.1770693063735962,0.2660897374153137,919.3121948242188,1e-05,0.08775345236063004,2.4593889713287354,23.927850246429443,1 +6550,0.24391824007034302,0.18292753398418427,0.1948123574256897,0.27185896039009094,974.4267578125,1e-05,0.07971800863742828,2.4809772968292236,23.927850246429443,1 +6551,0.23042720556259155,0.21107295155525208,0.21068279445171356,0.2461538314819336,514.7058715820312,1e-05,0.06784776598215103,2.354301691055298,23.927850246429443,1 +6552,0.3422253429889679,0.49022454023361206,0.49101853370666504,0.2323397397994995,187.07484436035156,1e-05,0.07641392201185226,2.348114013671875,23.927850246429443,1 +6553,0.07728957384824753,0.15543565154075623,0.1562301516532898,0.18945512175559998,882.784912109375,1e-05,0.06800144165754318,2.34716534614563,23.927850246429443,1 +6554,0.17014801502227783,0.16733431816101074,0.17389988899230957,0.21333332359790802,608.3162231445312,1e-05,0.06895581632852554,2.3586058616638184,23.927850246429443,1 +6555,0.18698066473007202,0.08179425448179245,0.08048838376998901,0.09756410121917725,534.8970336914062,1e-05,0.10383173823356628,2.346604108810425,23.927850246429443,1 +6556,0.2505200207233429,0.3135770559310913,0.311504065990448,0.27070510387420654,990.448486328125,1e-05,0.07418107241392136,2.5304131507873535,23.927850246429443,1 +6557,0.17357344925403595,0.15896566212177277,0.16333600878715515,0.20570512115955353,824.8300170898438,1e-05,0.06701812148094177,2.3606345653533936,23.927850246429443,1 +6558,0.18436339497566223,0.2901006042957306,0.2828894853591919,0.1673397421836853,647.8805541992188,1e-05,0.07825348526239395,2.527089834213257,23.927850246429443,1 +6559,0.2107534408569336,0.30819937586784363,0.29747945070266724,0.24310895800590515,974.9119873046875,1e-05,0.07548335194587708,2.5020406246185303,23.927850246429443,1 +6560,0.17427708208560944,0.15137499570846558,0.15188756585121155,0.17028845846652985,920.7059936523438,1e-05,0.06889678537845612,2.594125986099243,23.927850246429443,1 +6561,0.21549947559833527,0.08098291605710983,0.09193750470876694,0.16285255551338196,566.1925659179688,1e-05,0.07717182487249374,2.512296438217163,23.927850246429443,1 +6562,0.19897641241550446,0.1758956015110016,0.16934946179389954,0.2747756242752075,653.6259765625,1e-05,0.06828070431947708,2.3584635257720947,23.927850246429443,1 +6563,0.24165353178977966,0.2925255298614502,0.28224268555641174,0.21926280856132507,381.9444580078125,1e-05,0.08055547624826431,2.3540244102478027,23.927850246429443,1 +6564,0.281899631023407,0.16184845566749573,0.15397219359874725,0.10910256206989288,905.4575805664062,1e-05,0.07107803225517273,2.3507466316223145,23.927850246429443,1 +6565,0.14834736287593842,0.11957556754350662,0.11751119047403336,0.22198717296123505,705.574951171875,1e-05,0.06425903737545013,2.348872661590576,23.927850246429443,1 +6566,0.2302691638469696,0.1436263918876648,0.15254561603069305,0.11576922982931137,631.1881713867188,1e-05,0.06454093754291534,2.350085735321045,23.927850246429443,1 +6567,0.2404869794845581,0.17473381757736206,0.16708821058273315,0.18073716759681702,823.6697998046875,1e-05,0.08096897602081299,2.494696855545044,23.927850246429443,1 +6568,0.2025584876537323,0.47834083437919617,0.505242109298706,0.26499998569488525,141.84397888183594,1e-05,0.06996177136898041,2.348473310470581,23.927850246429443,1 +6569,0.21037130057811737,0.12733742594718933,0.13367100059986115,0.18342947959899902,734.3234252929688,1e-05,0.07587168365716934,2.729231357574463,23.927850246429443,1 +6570,0.15265198051929474,0.19814425706863403,0.18136702477931976,0.24291665852069855,875.74853515625,1e-05,0.06928142160177231,2.3629496097564697,23.927850246429443,1 +6571,0.1495364010334015,0.20457807183265686,0.2019270360469818,0.23413459956645966,991.0935668945312,1e-05,0.073750801384449,2.4953181743621826,23.927850246429443,1 +6572,0.09227599948644638,0.1604050099849701,0.16992425918579102,0.27996793389320374,836.6402587890625,1e-05,0.07709255814552307,2.548971176147461,23.927850246429443,1 +6573,0.3129000663757324,0.20093131065368652,0.2001994401216507,0.199455127120018,454.8346252441406,1e-05,0.08359619230031967,2.3544492721557617,23.927850246429443,1 +6574,0.17513030767440796,0.15040777623653412,0.1476343870162964,0.2167307585477829,930.143310546875,1e-05,0.10366211086511612,2.3470916748046875,23.927850246429443,1 +6575,0.08860918879508972,0.3180854916572571,0.3189648687839508,0.1776602566242218,974.1835327148438,1e-05,0.07367942482233047,2.3469932079315186,23.927850246429443,1 +6576,0.15767085552215576,0.16980178654193878,0.1754114031791687,0.2146153748035431,935.9296264648438,1e-05,0.0639500543475151,2.3441503047943115,23.927850246429443,1 +6577,0.17904908955097198,0.0910978838801384,0.0910431295633316,0.12096153199672699,846.2532348632812,1e-05,0.06967667490243912,2.481734037399292,23.927850246429443,1 +6578,0.20856338739395142,0.09187222272157669,0.09373793751001358,0.291858971118927,723.90576171875,1e-05,0.08860462158918381,2.353585958480835,23.927850246429443,1 +6579,0.1390567272901535,0.1919105350971222,0.18391242623329163,0.2865384519100189,962.2467651367188,1e-05,0.07050547748804092,2.4758758544921875,23.927850246429443,1 +6580,0.27149125933647156,0.15978623926639557,0.15933184325695038,0.19961537420749664,725.671142578125,1e-05,0.07809305191040039,2.497546672821045,23.927850246429443,1 +6581,0.24262987077236176,0.27541017532348633,0.266323447227478,0.1044551208615303,695.9219970703125,1e-05,0.075201116502285,2.3512797355651855,23.927850246429443,1 +6582,0.153773233294487,0.17771600186824799,0.16748908162117004,0.2371794730424881,791.1160888671875,1e-05,0.06837505102157593,2.6070895195007324,23.927850246429443,1 +6583,0.21216963231563568,0.1889832764863968,0.19220994412899017,0.22253204882144928,976.1173706054688,1e-05,0.07002796232700348,2.5029354095458984,23.927850246429443,1 +6584,0.20734938979148865,0.6500944495201111,0.6584270000457764,0.29413461685180664,133.9285888671875,1e-05,0.07237938046455383,2.3466508388519287,23.927850246429443,1 +6585,0.1494697630405426,0.11834824085235596,0.11943899840116501,0.2412179410457611,723.0185546875,1e-05,0.07656518369913101,2.347071409225464,23.927850246429443,1 +6586,0.23599275946617126,0.11606277525424957,0.12431269139051437,0.2283974289894104,878.85986328125,1e-05,0.0725434422492981,2.3473713397979736,23.927850246429443,1 +6587,0.11683997511863708,0.2420964390039444,0.23911358416080475,0.18516024947166443,963.8278198242188,1e-05,0.06415661424398422,2.345588445663452,23.927850246429443,1 +6588,0.21315354108810425,0.21341253817081451,0.21097326278686523,0.2407371699810028,952.3810424804688,1e-05,0.0773891806602478,2.466949462890625,23.927850246429443,1 +6589,0.14923352003097534,0.09297525137662888,0.09036839753389359,0.2639743387699127,864.6732177734375,1e-05,0.06913010776042938,2.581071138381958,23.927850246429443,1 +6590,0.21030503511428833,0.24200408160686493,0.23337270319461823,0.24570511281490326,464.8240966796875,1e-05,0.06654626131057739,2.36193585395813,23.927850246429443,1 +6591,0.15808962285518646,0.17186900973320007,0.15913693606853485,0.2879166603088379,835.5437622070312,1e-05,0.06274750828742981,2.479726791381836,23.927850246429443,1 +6592,0.2641451954841614,0.2572953701019287,0.2744103968143463,0.16022434830665588,989.3660888671875,1e-05,0.08033227920532227,2.5435116291046143,23.927850246429443,1 +6593,0.27363741397857666,0.254387766122818,0.25165891647338867,0.24794870615005493,367.23162841796875,1e-05,0.07858217507600784,2.492003917694092,23.927850246429443,1 +6594,0.18301258981227875,0.11686646938323975,0.12069079279899597,0.30753204226493835,858.8861083984375,1e-05,0.08030126243829727,2.3675403594970703,23.927850246429443,1 +6595,0.1914830058813095,0.13973204791545868,0.1353253722190857,0.3008333146572113,807.365478515625,1e-05,0.06956345587968826,2.353893995285034,23.927850246429443,1 +6596,0.18717637658119202,0.12937355041503906,0.12707632780075073,0.13862179219722748,956.0206298828125,1e-05,0.07952362298965454,2.356642246246338,23.927850246429443,1 +6597,0.12642131745815277,0.16883663833141327,0.16399778425693512,0.19903846085071564,691.9642944335938,1e-05,0.06386281549930573,2.3602888584136963,23.927850246429443,1 +6598,0.27898988127708435,0.3253571391105652,0.318063884973526,0.22227562963962555,542.9864501953125,1e-05,0.0642583817243576,2.3606832027435303,23.927850246429443,1 +6599,0.19707590341567993,0.12268110364675522,0.12928946316242218,0.15455128252506256,666.9776611328125,1e-05,0.07617927342653275,2.482266426086426,23.927850246429443,1 +6600,0.10257796943187714,0.29982253909111023,0.28197795152664185,0.22054485976696014,989.148681640625,1e-05,0.07391010224819183,2.4923994541168213,23.927850246429443,1 +6601,0.10716314613819122,0.20525208115577698,0.2024860382080078,0.1439102441072464,902.7777709960938,1e-05,0.07464838027954102,2.579364776611328,23.927850246429443,1 +6602,0.24740031361579895,0.19611935317516327,0.1987951099872589,0.23448717594146729,590.71728515625,1e-05,0.08739424496889114,2.3615097999572754,23.927850246429443,1 +6603,0.1587098389863968,0.19245348870754242,0.18885566294193268,0.2304166555404663,646.7181396484375,1e-05,0.06985128670930862,2.4862844944000244,23.927850246429443,1 +6604,0.17659282684326172,0.19066454470157623,0.19069691002368927,0.22314101457595825,374.6498718261719,1e-05,0.07455883920192719,2.511538505554199,23.927850246429443,1 +6605,0.18675054609775543,0.23485639691352844,0.22846612334251404,0.27727562189102173,855.4293212890625,1e-05,0.07879562675952911,2.3506414890289307,23.927850246429443,1 +6606,0.08863659203052521,0.15876007080078125,0.14979243278503418,0.2211538404226303,753.9683227539062,1e-05,0.06910628080368042,2.3511602878570557,23.927850246429443,1 +6607,0.2136692851781845,0.330136775970459,0.3224197328090668,0.26211538910865784,976.3572998046875,1e-05,0.06949418783187866,2.349242687225342,23.927850246429443,1 +6608,0.1530778557062149,0.19941946864128113,0.18970231711864471,0.21115383505821228,971.4794311523438,1e-05,0.0658031553030014,2.3491740226745605,23.927850246429443,1 +6609,0.25644651055336,0.29056107997894287,0.28658100962638855,0.21926280856132507,713.0584106445312,1e-05,0.09111251682043076,2.346921682357788,23.927850246429443,1 +6610,0.2243884950876236,0.6734634041786194,0.6573020219802856,0.29288461804389954,57.25191116333008,1e-05,0.06956107169389725,2.4619123935699463,23.927850246429443,1 +6611,0.2000463306903839,0.16549919545650482,0.16015149652957916,0.28371793031692505,720.3389282226562,1e-05,0.06847580522298813,2.5879313945770264,23.927850246429443,1 +6612,0.11073324084281921,0.14965201914310455,0.15690967440605164,0.23580127954483032,797.1013793945312,1e-05,0.08204969763755798,2.480147361755371,23.927850246429443,1 +6613,0.2239295393228531,0.13670200109481812,0.144063338637352,0.14474359154701233,810.4782104492188,1e-05,0.06228772923350334,2.479515552520752,23.927850246429443,1 +6614,0.24123981595039368,0.13608039915561676,0.1317388415336609,0.24003204703330994,937.8121948242188,1e-05,0.07408718019723892,2.480790138244629,23.927850246429443,1 +6615,0.19910956919193268,0.20013539493083954,0.20364294946193695,0.1049358919262886,838.2740478515625,1e-05,0.06548969447612762,2.355175733566284,23.927850246429443,1 +6616,0.2559393644332886,0.9918567538261414,0.9882278442382812,0.24435897171497345,9.920635223388672,1e-05,0.07111822813749313,2.3462069034576416,23.927850246429443,1 +6617,0.22261810302734375,0.20091673731803894,0.1864481121301651,0.21416665613651276,931.1224365234375,1e-05,0.06822273880243301,2.348463535308838,23.927850246429443,1 +6618,0.19845150411128998,0.17373481392860413,0.16490213572978973,0.2653205096721649,944.2269897460938,1e-05,0.06809215247631073,2.345041275024414,23.927850246429443,1 +6619,0.26456013321876526,0.18475523591041565,0.16699980199337006,0.22413460910320282,923.458740234375,1e-05,0.07394947856664658,2.3523004055023193,23.927850246429443,1 +6620,0.22708870470523834,0.20389169454574585,0.20101206004619598,0.23801280558109283,847.8120727539062,1e-05,0.06792474538087845,2.347121477127075,23.927850246429443,1 +6621,0.19936761260032654,0.14708662033081055,0.1539611518383026,0.2629166543483734,797.1013793945312,1e-05,0.07325273752212524,2.3476319313049316,23.927850246429443,1 +6622,0.09714553505182266,0.23561006784439087,0.22601249814033508,0.2316666543483734,936.8737182617188,1e-05,0.06551327556371689,2.6969048976898193,23.927850246429443,1 +6623,0.07371686398983002,0.41882407665252686,0.39668524265289307,0.3302564024925232,991.52197265625,1e-05,0.05833013355731964,2.5862350463867188,23.927850246429443,1 +6624,0.1924254298210144,0.2213357537984848,0.22532771527767181,0.2508012652397156,377.094970703125,1e-05,0.08979020267724991,2.5728652477264404,23.927850246429443,1 +6625,0.21736325323581696,0.6794606447219849,0.6798603534698486,0.1464102566242218,38.75969314575195,1e-05,0.06052267551422119,2.5808510780334473,23.927850246429443,1 +6626,0.19761037826538086,0.30671656131744385,0.2919469475746155,0.23798075318336487,372.1910095214844,1e-05,0.06672689318656921,2.3510918617248535,23.927850246429443,1 +6627,0.2708186209201813,0.1760464757680893,0.1743873506784439,0.22548076510429382,631.1881713867188,1e-05,0.09495024383068085,2.3485660552978516,23.927850246429443,1 +6628,0.10198003798723221,0.8677793741226196,0.8565129041671753,0.2844551205635071,34.046695709228516,1e-05,0.065609872341156,2.348297119140625,23.927850246429443,1 +6629,0.24460163712501526,0.19899705052375793,0.2033223807811737,0.24983973801136017,968.468505859375,1e-05,0.0821734219789505,2.34818959236145,23.927850246429443,1 +6630,0.1888933926820755,0.16305948793888092,0.17117875814437866,0.1849038451910019,945.4190673828125,1e-05,0.0692506656050682,2.3507490158081055,23.927850246429443,1 +6631,0.19193318486213684,0.15292054414749146,0.15517430007457733,0.19660255312919617,887.0499877929688,1e-05,0.060581132769584656,2.4628970623016357,23.927850246429443,1 +6632,0.17509983479976654,0.29360467195510864,0.28746989369392395,0.21134614944458008,976.3572998046875,1e-05,0.07547406852245331,2.614419460296631,23.927850246429443,1 +6633,0.19712495803833008,0.25665557384490967,0.2530522644519806,0.24766024947166443,697.8798828125,1e-05,0.06025668978691101,2.5932929515838623,23.927850246429443,1 +6634,0.19207847118377686,0.14718373119831085,0.14762043952941895,0.24525639414787292,959.3023071289062,1e-05,0.07043291628360748,2.485079765319824,23.927850246429443,1 +6635,0.0603083074092865,0.19034284353256226,0.18130168318748474,0.27676281332969666,958.4887084960938,1e-05,0.06028660014271736,2.5416526794433594,23.927850246429443,1 +6636,0.19551818072795868,0.16117873787879944,0.15214812755584717,0.1776602566242218,819.5592651367188,1e-05,0.09658131003379822,2.4940731525421143,23.927850246429443,1 +6637,0.14123208820819855,0.22027762234210968,0.2223896086215973,0.22874999046325684,977.5501098632812,1e-05,0.07123056799173355,2.351836919784546,23.927850246429443,1 +6638,0.17424383759498596,0.17259900271892548,0.17609290778636932,0.20798076689243317,606.9959106445312,1e-05,0.07913072407245636,2.3532960414886475,23.927850246429443,1 +6639,0.25684332847595215,0.31026116013526917,0.31976181268692017,0.23673075437545776,208.3333282470703,1e-05,0.07767069339752197,2.3508918285369873,23.927850246429443,1 +6640,0.28134945034980774,0.2029295116662979,0.1970008909702301,0.2547435760498047,563.1868286132812,1e-05,0.07599705457687378,2.3534095287323,23.927850246429443,1 +6641,0.3506554663181305,0.3271521329879761,0.3212531805038452,0.27907049655914307,536.5296630859375,1e-05,0.0847446471452713,2.5584187507629395,23.927850246429443,1 +6642,0.19394183158874512,0.16764628887176514,0.1636776179075241,0.17724359035491943,969.4793090820312,1e-05,0.07566238194704056,2.47670578956604,23.927850246429443,1 +6643,0.20731274783611298,0.14332549273967743,0.14258015155792236,0.2681410014629364,971.23095703125,1e-05,0.06913383305072784,2.479243278503418,23.927850246429443,1 +6644,0.2172372043132782,0.28869715332984924,0.2807644307613373,0.1636858880519867,994.89794921875,1e-05,0.06925482302904129,2.486163854598999,23.927850246429443,1 +6645,0.10789100080728531,0.15837740898132324,0.16366195678710938,0.2619551122188568,961.9814453125,1e-05,0.0967816561460495,2.4703288078308105,23.927850246429443,1 +6646,0.27693501114845276,0.5962115526199341,0.5890847444534302,0.24676281213760376,149.64788818359375,1e-05,0.07888511568307877,2.4933862686157227,23.927850246429443,1 +6647,0.22305619716644287,0.381979376077652,0.3585403561592102,0.22746793925762177,988.0552978515625,1e-05,0.07780613750219345,2.351743459701538,23.927850246429443,1 +6648,0.2859516143798828,0.28515908122062683,0.2915337085723877,0.22496794164180756,325.4438171386719,1e-05,0.08115671575069427,2.3438851833343506,23.927850246429443,1 +6649,0.25959229469299316,0.1694343239068985,0.16417737305164337,0.24419870972633362,708.4055786132812,1e-05,0.07860490679740906,2.3482823371887207,23.927850246429443,1 +6650,0.20378388464450836,0.182852640748024,0.17687925696372986,0.19041666388511658,524.9420166015625,1e-05,0.07547338306903839,2.3455886840820312,23.927850246429443,1 +6651,0.22506673634052277,0.1997639685869217,0.19875988364219666,0.1992628127336502,409.94622802734375,1e-05,0.08385166525840759,2.3477604389190674,23.927850246429443,1 +6652,0.26060613989830017,0.3268502652645111,0.33554011583328247,0.22999998927116394,403.11651611328125,1e-05,0.07752666622400284,2.466647148132324,23.927850246429443,1 +6653,0.1552055925130844,0.26864057779312134,0.2608623802661896,0.2391987144947052,993.0098266601562,1e-05,0.06906193494796753,2.5219955444335938,23.927850246429443,1 +6654,0.17644549906253815,0.15962167084217072,0.16221870481967926,0.20365384221076965,961.4497680664062,1e-05,0.07430216670036316,2.5735747814178467,23.927850246429443,1 +6655,0.21564869582653046,0.1435014307498932,0.14167420566082,0.22394229471683502,931.1224365234375,1e-05,0.07952924072742462,2.4687252044677734,23.927850246429443,1 +6656,0.35658225417137146,0.2824622690677643,0.28197938203811646,0.2071794867515564,354.58453369140625,1e-05,0.0753808543086052,2.4852850437164307,23.927850246429443,1 +6657,0.2659052312374115,0.19951334595680237,0.20276138186454773,0.24477563798427582,831.6600341796875,1e-05,0.06845022737979889,2.4644272327423096,23.927850246429443,1 +6658,0.12259833514690399,0.17243830859661102,0.17441615462303162,0.24317306280136108,898.4814453125,1e-05,0.07181891053915024,2.3496174812316895,23.927850246429443,1 +6659,0.22035452723503113,0.15028116106987,0.15454581379890442,0.12205127626657486,844.6821899414062,1e-05,0.06987004727125168,2.344029664993286,23.927850246429443,1 +6660,0.24833139777183533,0.8851495981216431,0.89515221118927,0.2602243423461914,38.75969314575195,1e-05,0.07385758310556412,2.3450098037719727,23.927850246429443,1 +6661,0.26184508204460144,0.11225279420614243,0.11211326718330383,0.1992628127336502,741.8699340820312,1e-05,0.07126224786043167,2.3471438884735107,23.927850246429443,1 +6662,0.22193202376365662,0.2335580736398697,0.2366936206817627,0.1576922982931137,989.8002319335938,1e-05,0.05806858465075493,2.346675157546997,23.927850246429443,1 +6663,0.19606168568134308,0.22147896885871887,0.21091577410697937,0.20035254955291748,877.5327758789062,1e-05,0.06579428911209106,2.568500280380249,23.927850246429443,1 +6664,0.19953188300132751,0.4317958354949951,0.42702820897102356,0.2740384638309479,273.4375,1e-05,0.06717343628406525,2.3502492904663086,23.927850246429443,1 +6665,0.173110231757164,0.2080189287662506,0.2129015177488327,0.24820512533187866,953.2288818359375,1e-05,0.06942496448755264,2.482090950012207,23.927850246429443,1 +6666,0.17425493896007538,0.0998535305261612,0.10099909454584122,0.15455128252506256,868.4371337890625,1e-05,0.06752336025238037,2.3475606441497803,23.927850246429443,1 +6667,0.15233652293682098,0.4290238618850708,0.4145556688308716,0.21897435188293457,998.592041015625,1e-05,0.05391547456383705,2.6092886924743652,23.927850246429443,1 +6668,0.2754630148410797,0.1757325828075409,0.1740318387746811,0.2142307609319687,762.48046875,1e-05,0.07191105931997299,2.350714921951294,23.927850246429443,1 +6669,0.21383756399154663,0.2383708506822586,0.2284124791622162,0.2096794843673706,959.8422241210938,1e-05,0.08098211139440536,2.3504464626312256,23.927850246429443,1 +6670,0.24397212266921997,0.18994638323783875,0.18870888650417328,0.17198717594146729,628.7276611328125,1e-05,0.07527166604995728,2.355602502822876,23.927850246429443,1 +6671,0.17255979776382446,0.15690499544143677,0.14894573390483856,0.12064102292060852,868.9024658203125,1e-05,0.060034897178411484,2.36110520362854,23.927850246429443,1 +6672,0.17888060212135315,0.15585923194885254,0.15504556894302368,0.23570512235164642,549.327392578125,1e-05,0.07620830833911896,2.3509480953216553,23.927850246429443,1 +6673,0.20954836905002594,0.11400999873876572,0.1107567697763443,0.14195512235164642,838.8157958984375,1e-05,0.06604506075382233,2.477815866470337,23.927850246429443,1 +6674,0.23666825890541077,0.22109158337116241,0.21035663783550262,0.22413460910320282,947.775634765625,1e-05,0.07293976843357086,2.6036438941955566,23.927850246429443,1 +6675,0.11453330516815186,0.22282767295837402,0.21784381568431854,0.2682371735572815,960.3799438476562,1e-05,0.0743940994143486,2.5043179988861084,23.927850246429443,1 +6676,0.22103407979011536,0.11711858212947845,0.11970002204179764,0.09711538255214691,740.2120361328125,1e-05,0.07293050736188889,2.475149631500244,23.927850246429443,1 +6677,0.20664970576763153,0.32528039813041687,0.3181465268135071,0.24387820065021515,998.3897094726562,1e-05,0.06521119177341461,2.3484809398651123,23.927850246429443,1 +6678,0.19203424453735352,0.20826031267642975,0.21441954374313354,0.21621793508529663,531.6091918945312,1e-05,0.06759683787822723,2.5131278038024902,23.927850246429443,1 +6679,0.1241002231836319,0.19718080759048462,0.19047830998897552,0.23346152901649475,458.8607482910156,1e-05,0.06359661370515823,2.351370096206665,23.927850246429443,1 +6680,0.16467785835266113,0.17688323557376862,0.1854379028081894,0.18378204107284546,971.9750366210938,1e-05,0.07102604955434799,2.345465660095215,23.927850246429443,1 +6681,0.10774991661310196,0.10176464170217514,0.10194450616836548,0.15698717534542084,906.9703979492188,1e-05,0.06157095357775688,2.344860076904297,23.927850246429443,1 +6682,0.348040372133255,0.24587975442409515,0.24966497719287872,0.23217947781085968,369.71832275390625,1e-05,0.07442623376846313,2.34464168548584,23.927850246429443,1 +6683,0.14303357899188995,0.26519346237182617,0.2710455358028412,0.24237178266048431,996.5530395507812,1e-05,0.06593593209981918,2.344672441482544,23.927850246429443,1 +6684,0.21687108278274536,0.21078698337078094,0.1959896683692932,0.24996793270111084,720.3389282226562,1e-05,0.08042371273040771,2.664156913757324,23.927850246429443,1 +6685,0.29064488410949707,0.2696745991706848,0.28753966093063354,0.23144230246543884,438.31170654296875,1e-05,0.07090283930301666,2.351896047592163,23.927850246429443,1 +6686,0.10677149891853333,0.9481574296951294,0.9545331597328186,0.26384615898132324,34.046695709228516,1e-05,0.059866514056921005,2.6873459815979004,23.927850246429443,1 +6687,0.16959761083126068,0.2496747076511383,0.25262829661369324,0.2045833319425583,987.174072265625,1e-05,0.07173950970172882,2.3532536029815674,23.927850246429443,1 +6688,0.14618061482906342,0.17949645221233368,0.18900679051876068,0.16740384697914124,985.3936767578125,1e-05,0.06456625461578369,2.462869644165039,23.927850246429443,1 +6689,0.17955435812473297,0.22071786224842072,0.22285686433315277,0.22333332896232605,985.1694946289062,1e-05,0.07833798974752426,2.351764678955078,23.927850246429443,1 +6690,0.2609059810638428,0.12159913033246994,0.13196636736392975,0.24118588864803314,518.14990234375,1e-05,0.07166674733161926,2.3449501991271973,23.927850246429443,1 +6691,0.29760849475860596,0.2139018326997757,0.20350351929664612,0.32528844475746155,839.3560791015625,1e-05,0.07386042177677155,2.344040632247925,23.927850246429443,1 +6692,0.18862290680408478,0.15930506587028503,0.15780234336853027,0.2518269121646881,928.4979858398438,1e-05,0.08135667443275452,2.3477401733398438,23.927850246429443,1 +6693,0.18604426085948944,0.9418777823448181,0.9465557932853699,0.2616666555404663,34.046695709228516,1e-05,0.0586317703127861,2.3504059314727783,23.927850246429443,1 +6694,0.036314330995082855,0.14090123772621155,0.14345814287662506,0.23246793448925018,936.5596923828125,1e-05,0.06534591317176819,2.342186212539673,23.927850246429443,1 +6695,0.2063753306865692,0.15134106576442719,0.1513594388961792,0.00833333283662796,979.9048461914062,1e-05,0.11202418804168701,2.7095940113067627,23.927850246429443,1 +6696,0.08180879056453705,0.1797727644443512,0.18118585646152496,0.2395833283662796,789.7643432617188,1e-05,0.06781457364559174,2.351879835128784,23.927850246429443,1 +6697,0.28638923168182373,0.06933142244815826,0.07510526478290558,0.1738141030073166,899.2704467773438,1e-05,0.07521466165781021,2.4672467708587646,23.927850246429443,1 +6698,0.21172384917736053,0.0842675045132637,0.08468842506408691,0.11846153438091278,837.7308349609375,1e-05,0.06944112479686737,2.356391668319702,23.927850246429443,1 +6699,0.099912628531456,0.0908152237534523,0.08994199335575104,0.18695512413978577,874.8499145507812,1e-05,0.06663915514945984,2.6766207218170166,23.927850246429443,1 +6700,0.2133253663778305,0.2417687177658081,0.2341996282339096,0.23471152782440186,977.07421875,1e-05,0.08835750073194504,2.352612257003784,23.927850246429443,1 +6701,0.10139382630586624,0.2219753861427307,0.21145199239253998,0.2367948591709137,950.9569091796875,1e-05,0.07522562146186829,2.3507351875305176,23.927850246429443,1 +6702,0.19111251831054688,0.8671258687973022,0.8625479936599731,0.20724357664585114,9.920635223388672,1e-05,0.07154446095228195,2.3564748764038086,23.927850246429443,1 +6703,0.1277327984571457,0.20726284384727478,0.1967659741640091,0.1646474301815033,674.4935913085938,1e-05,0.07000230997800827,2.3555290699005127,23.927850246429443,1 +6704,0.2921992540359497,0.25854673981666565,0.2781693637371063,0.27089741826057434,308.7349548339844,1e-05,0.0855317935347557,2.3550713062286377,23.927850246429443,1 +6705,0.2396397739648819,0.19954365491867065,0.19010674953460693,0.23990383744239807,808.6157836914062,1e-05,0.07678326219320297,2.4885811805725098,23.927850246429443,1 +6706,0.13842527568340302,0.07794400304555893,0.08096581697463989,0.13198716938495636,986.50927734375,1e-05,0.09142827242612839,2.361130714416504,23.927850246429443,1 +6707,0.16187962889671326,0.18727229535579681,0.16968408226966858,0.1859615296125412,837.7308349609375,1e-05,0.0757780373096466,2.4750640392303467,23.927850246429443,1 +6708,0.20536606013774872,0.23264414072036743,0.2241416871547699,0.2356410175561905,990.232666015625,1e-05,0.10318990796804428,2.56793212890625,23.927850246429443,1 +6709,0.1967235654592514,0.18798445165157318,0.19057750701904297,0.2480769157409668,971.9750366210938,1e-05,0.07715550810098648,2.3546721935272217,23.927850246429443,1 +6710,0.20477211475372314,0.15536844730377197,0.15766063332557678,0.22342948615550995,848.8447265625,1e-05,0.07356709241867065,2.668125867843628,23.927850246429443,1 +6711,0.26306411623954773,0.4696294069290161,0.4617558419704437,0.20820511877536774,990.6640014648438,1e-05,0.0740586593747139,2.353196620941162,23.927850246429443,1 +6712,0.1830958127975464,0.578447163105011,0.5902442336082458,0.28089743852615356,117.75362396240234,1e-05,0.07771220803260803,2.343219518661499,23.927850246429443,1 +6713,0.13091044127941132,0.13932272791862488,0.15224598348140717,0.24435897171497345,949.8078002929688,1e-05,0.06796818226575851,2.347604751586914,23.927850246429443,1 +6714,0.1844194382429123,0.18094688653945923,0.17972317337989807,0.2403525561094284,804.8433837890625,1e-05,0.09576807916164398,2.345830202102661,23.927850246429443,1 +6715,0.1571417599916458,0.30218473076820374,0.29848015308380127,0.2348717898130417,305.8912353515625,1e-05,0.08684878051280975,2.3468570709228516,23.927850246429443,1 +6716,0.2275528907775879,0.16719260811805725,0.16261686384677887,0.2374679446220398,902.0044555664062,1e-05,0.0678718164563179,2.6543784141540527,23.927850246429443,1 +6717,0.21043309569358826,0.16931988298892975,0.17177660763263702,0.18939101696014404,929.4871826171875,1e-05,0.07869555801153183,2.5740673542022705,23.927850246429443,1 +6718,0.29780665040016174,0.5053703784942627,0.5062412023544312,0.17884615063667297,330.88238525390625,1e-05,0.09423550218343735,2.480320453643799,23.927850246429443,1 +6719,0.18307068943977356,0.1373651772737503,0.13716769218444824,0.23903845250606537,756.319091796875,1e-05,0.07217609882354736,2.3611207008361816,23.927850246429443,1 +6720,0.1583135426044464,0.19861869513988495,0.18696121871471405,0.2765063941478729,668.0632934570312,1e-05,0.08115340769290924,2.4653804302215576,23.927850246429443,1 +6721,0.3639402389526367,0.17302942276000977,0.17469467222690582,0.13333332538604736,832.777099609375,1e-05,0.1367834210395813,2.604810953140259,23.927850246429443,1 +6722,0.11396043002605438,0.08922301977872849,0.09722087532281876,0.25150638818740845,897.2911987304688,1e-05,0.062180791050195694,2.3545219898223877,23.927850246429443,1 +6723,0.17756211757659912,0.18375380337238312,0.17293381690979004,0.2749999761581421,892.4485473632812,1e-05,0.07521352916955948,2.365544319152832,23.927850246429443,1 +6724,0.20386040210723877,0.2077755182981491,0.19295547902584076,0.26387819647789,853.4264526367188,1e-05,0.07771053910255432,2.365016460418701,23.927850246429443,1 +6725,0.18016144633293152,0.2665509879589081,0.25918516516685486,0.16708332300186157,738.5433959960938,1e-05,0.06284429132938385,2.3559250831604004,23.927850246429443,1 +6726,0.2027730792760849,0.12660154700279236,0.12876200675964355,0.20810896158218384,647.8805541992188,1e-05,0.08872164785861969,2.472386360168457,23.927850246429443,1 +6727,0.21548910439014435,0.1528123915195465,0.1514655500650406,0.07499999552965164,638.4540405273438,1e-05,0.08207879960536957,2.4772183895111084,23.927850246429443,1 +6728,0.15667015314102173,0.15990544855594635,0.1601897031068802,0.17009614408016205,908.0963134765625,1e-05,0.07108163088560104,2.4705092906951904,23.927850246429443,1 +6729,0.20141063630580902,0.1851210743188858,0.17256790399551392,0.2523076832294464,894.4823608398438,1e-05,0.08570767939090729,2.51936674118042,23.927850246429443,1 +6730,0.22147324681282043,0.100283183157444,0.0986754521727562,0.22663460671901703,697.8798828125,1e-05,0.08695640414953232,2.350517988204956,23.927850246429443,1 +6731,0.2324308454990387,0.16868023574352264,0.17962218821048737,0.2717307507991791,965.3915405273438,1e-05,0.10615701973438263,2.6608645915985107,23.927850246429443,1 +6732,0.12306418269872665,0.3655741512775421,0.3592750132083893,0.22958332300186157,991.0935668945312,1e-05,0.0633355900645256,2.360788106918335,23.927850246429443,1 +6733,0.14784947037696838,0.21180258691310883,0.19890666007995605,0.23971152305603027,628.7276611328125,1e-05,0.0657884031534195,2.3480122089385986,23.927850246429443,1 +6734,0.2755947709083557,0.1664690375328064,0.1660321056842804,0.23782050609588623,881.0508422851562,1e-05,0.12448590993881226,2.3470418453216553,23.927850246429443,1 +6735,0.24312715232372284,0.6463764905929565,0.6608600616455078,0.2182692289352417,70.75472259521484,1e-05,0.08539484441280365,2.348118782043457,23.927850246429443,1 +6736,0.2280602753162384,0.20627756416797638,0.21131928265094757,0.22977563738822937,349.42364501953125,1e-05,0.07159879803657532,2.3492043018341064,23.927850246429443,1 +6737,0.11473457515239716,0.16759565472602844,0.15917442739009857,0.2211538404226303,938.4346313476562,1e-05,0.060457292944192886,2.7883310317993164,23.927850246429443,1 +6738,0.17172828316688538,0.19252808392047882,0.18807272613048553,0.1428525596857071,885.7808837890625,1e-05,0.07674127072095871,2.352586507797241,23.927850246429443,1 +6739,0.12713956832885742,0.3526603579521179,0.35468411445617676,0.19999998807907104,983.1340942382812,1e-05,0.08299153298139572,2.5818424224853516,23.927850246429443,1 +6740,0.2294023036956787,0.14725470542907715,0.145257368683815,0.2337179332971573,572.1257934570312,1e-05,0.07707152515649796,2.3524656295776367,23.927850246429443,1 +6741,0.08948824554681778,0.17460796236991882,0.17022818326950073,0.21381409466266632,723.0185546875,1e-05,0.07827838510274887,2.475151300430298,23.927850246429443,1 +6742,0.2677900493144989,0.13765056431293488,0.13311678171157837,0.24333332479000092,864.197509765625,1e-05,0.07905863225460052,2.4841911792755127,23.927850246429443,1 +6743,0.25592952966690063,0.3130086362361908,0.3195459246635437,0.1666666567325592,977.3124389648438,1e-05,0.10523045808076859,2.347433567047119,23.927850246429443,1 +6744,0.07900422066450119,0.2517750859260559,0.2442040592432022,0.2606410086154938,993.8524169921875,1e-05,0.05451447516679764,2.348896026611328,23.927850246429443,1 +6745,0.23783843219280243,0.49311563372612,0.5027394890785217,0.24532049894332886,218.64686584472656,1e-05,0.07650235295295715,2.3455650806427,23.927850246429443,1 +6746,0.2367849349975586,0.21237966418266296,0.214136004447937,0.3049679398536682,978.9678955078125,1e-05,0.07854431122541428,2.343167543411255,23.927850246429443,1 +6747,0.21429164707660675,0.2854357063770294,0.2789818346500397,0.2367948591709137,270.376220703125,1e-05,0.07968505471944809,2.346144676208496,23.927850246429443,1 +6748,0.19651326537132263,0.20357416570186615,0.20787625014781952,0.23999999463558197,812.9371337890625,1e-05,0.08180298656225204,2.5950746536254883,23.927850246429443,1 +6749,0.3201521039009094,0.3493683338165283,0.35865074396133423,0.2466346025466919,228.7581787109375,1e-05,0.09749327600002289,2.46557879447937,23.927850246429443,1 +6750,0.1534656584262848,0.1433202028274536,0.13785098493099213,0.16615383327007294,935.6137084960938,1e-05,0.06632275879383087,2.5764684677124023,23.927850246429443,1 +6751,0.13173548877239227,0.11056315898895264,0.11264729499816895,0.1931089609861374,741.0423583984375,1e-05,0.06592729687690735,2.3443074226379395,23.927850246429443,1 +6752,0.21139712631702423,0.18129342794418335,0.17208264768123627,0.16019229590892792,883.6459350585938,1e-05,0.07560742646455765,2.464247465133667,23.927850246429443,1 +6753,0.17201554775238037,0.37478384375572205,0.3628014922142029,0.2549999952316284,238.6731414794922,1e-05,0.07855929434299469,2.354823112487793,23.927850246429443,1 +6754,0.3232325613498688,0.20283645391464233,0.19898977875709534,0.15445512533187866,825.4075927734375,1e-05,0.07710346579551697,2.3422913551330566,23.927850246429443,1 +6755,0.17535632848739624,0.18670447170734406,0.18400228023529053,0.27810895442962646,945.7156982421875,1e-05,0.0629175677895546,2.3435285091400146,23.927850246429443,1 +6756,0.2057553231716156,0.15823297202587128,0.14509624242782593,0.21163460612297058,598.9583129882812,1e-05,0.08141700178384781,2.3463833332061768,23.927850246429443,1 +6757,0.18040831387043,0.18154118955135345,0.17805272340774536,0.15705128014087677,960.3799438476562,1e-05,0.08421886712312698,2.3502912521362305,23.927850246429443,1 +6758,0.16561070084571838,0.2539231777191162,0.24922709167003632,0.24285255372524261,665.8878784179688,1e-05,0.07105589658021927,2.480271339416504,23.927850246429443,1 +6759,0.18382132053375244,0.1038321778178215,0.1061474159359932,0.12387820333242416,528.291015625,1e-05,0.07277118414640427,2.5705718994140625,23.927850246429443,1 +6760,0.2191794216632843,0.21636487543582916,0.2174966037273407,0.10278845578432083,989.8002319335938,1e-05,0.07281261682510376,2.580373525619507,23.927850246429443,1 +6761,0.1741412878036499,0.16154244542121887,0.16518403589725494,0.10166666656732559,936.5596923828125,1e-05,0.07399310171604156,2.476332664489746,23.927850246429443,1 +6762,0.25609204173088074,0.17080098390579224,0.16590872406959534,0.14423076808452606,880.6146240234375,1e-05,0.08163624256849289,2.347013473510742,23.927850246429443,1 +6763,0.21700888872146606,0.10062165558338165,0.09800258278846741,0.16814102232456207,685.9205932617188,1e-05,0.06527107208967209,2.565215826034546,23.927850246429443,1 +6764,0.1710522174835205,0.42970794439315796,0.4247239828109741,0.23522435128688812,201.34228515625,1e-05,0.0734991580247879,2.350292921066284,23.927850246429443,1 +6765,0.14876432716846466,0.15254944562911987,0.13737377524375916,0.22538460791110992,817.174560546875,1e-05,0.08174555748701096,2.347043037414551,23.927850246429443,1 +6766,0.1462096869945526,0.16263219714164734,0.15527640283107758,0.28660255670547485,956.5726318359375,1e-05,0.061867114156484604,2.3543500900268555,23.927850246429443,1 +6767,0.16763465106487274,0.16628271341323853,0.15471933782100677,0.24445511400699615,931.1224365234375,1e-05,0.07160384207963943,2.352597713470459,23.927850246429443,1 +6768,0.2684856951236725,0.17019447684288025,0.16481566429138184,0.2547435760498047,921.0526123046875,1e-05,0.07298500090837479,2.3608102798461914,23.927850246429443,1 +6769,0.1886567324399948,0.20645512640476227,0.2012139856815338,0.2088140994310379,933.3839721679688,1e-05,0.06933658570051193,2.5317747592926025,23.927850246429443,1 +6770,0.12422316521406174,0.29832321405410767,0.2881533205509186,0.26826921105384827,967.194580078125,1e-05,0.06543347239494324,2.3646185398101807,23.927850246429443,1 +6771,0.15317201614379883,0.20390263199806213,0.19624511897563934,0.29993587732315063,726.5493774414062,1e-05,0.06636534631252289,2.5988759994506836,23.927850246429443,1 +6772,0.27138835191726685,0.08997516334056854,0.10089870542287827,0.13278844952583313,524.9420166015625,1e-05,0.08278285712003708,2.3633437156677246,23.927850246429443,1 +6773,0.29790037870407104,0.27043604850769043,0.26314646005630493,0.20201922953128815,431.9371643066406,1e-05,0.08219819515943527,2.3509888648986816,23.927850246429443,1 +6774,0.2745749354362488,0.13283881545066833,0.13869336247444153,0.08394230157136917,536.5296630859375,1e-05,0.07183295488357544,2.6934056282043457,23.927850246429443,1 +6775,0.22090549767017365,0.2656477093696594,0.2762760818004608,0.2569551169872284,992.58642578125,1e-05,0.06617600470781326,2.3541698455810547,23.927850246429443,1 +6776,0.13848140835762024,0.7117713093757629,0.7317451238632202,0.2541666626930237,48.076927185058594,1e-05,0.06068361550569534,2.347074508666992,23.927850246429443,1 +6777,0.20638664066791534,0.1491636037826538,0.15453960001468658,0.26076921820640564,677.6557006835938,1e-05,0.06253642588853836,2.3510236740112305,23.927850246429443,1 +6778,0.16649699211120605,0.13768696784973145,0.13795627653598785,0.09410256147384644,661.4877319335938,1e-05,0.07574243098497391,2.354247808456421,23.927850246429443,1 +6779,0.23970124125480652,0.24652588367462158,0.23757800459861755,0.21833331882953644,736.0197143554688,1e-05,0.07783841341733932,2.3475217819213867,23.927850246429443,1 +6780,0.2613322138786316,0.1508922427892685,0.1534295231103897,0.21733973920345306,919.3121948242188,1e-05,0.06787793338298798,2.6705777645111084,23.927850246429443,1 +6781,0.24197696149349213,0.38289836049079895,0.3617931604385376,0.2530769109725952,995.5211791992188,1e-05,0.06427284330129623,2.507054567337036,23.927850246429443,1 +6782,0.2460317462682724,0.14356429874897003,0.13763220608234406,0.24685896933078766,855.9268798828125,1e-05,0.07547812908887863,2.4661169052124023,23.927850246429443,1 +6783,0.3355843722820282,0.2301793247461319,0.2354671210050583,0.2449999898672104,425.4617614746094,1e-05,0.06930704414844513,2.3571937084198,23.927850246429443,1 +6784,0.266597181558609,0.13255713880062103,0.13035228848457336,0.24448716640472412,938.1237182617188,1e-05,0.062303315848112106,2.4671120643615723,23.927850246429443,1 +6785,0.15575191378593445,0.5167179107666016,0.5419744849205017,0.13317307829856873,164.93057250976562,1e-05,0.06783466786146164,2.4792585372924805,23.927850246429443,1 +6786,0.09984929859638214,0.2151482254266739,0.20743469893932343,0.137532040476799,964.3510131835938,1e-05,0.07465960830450058,2.352294445037842,23.927850246429443,1 +6787,0.20367927849292755,0.20933444797992706,0.20136645436286926,0.17570511996746063,824.8300170898438,1e-05,0.07681070268154144,2.3434348106384277,23.927850246429443,1 +6788,0.35813313722610474,0.181125670671463,0.1645742505788803,0.20397435128688812,723.90576171875,1e-05,0.074922576546669,2.3470003604888916,23.927850246429443,1 +6789,0.16279026865959167,0.17689386010169983,0.17300240695476532,0.24003204703330994,871.670654296875,1e-05,0.07303891330957413,2.345198392868042,23.927850246429443,1 +6790,0.12590937316417694,0.26391884684562683,0.2506718337535858,0.2138461470603943,964.3510131835938,1e-05,0.0680697038769722,2.454850196838379,23.927850246429443,1 +6791,0.1927049458026886,0.1922307014465332,0.18910442292690277,0.1795833259820938,678.7020263671875,1e-05,0.07710921764373779,2.506736993789673,23.927850246429443,1 +6792,0.25123482942581177,0.24111542105674744,0.22446519136428833,0.21333332359790802,960.3799438476562,1e-05,0.0715479776263237,2.4689998626708984,23.927850246429443,1 +6793,0.1806061863899231,0.18934394419193268,0.19270962476730347,0.23201921582221985,926.8355712890625,1e-05,0.0616888664662838,2.583954095840454,23.927850246429443,1 +6794,0.18443186581134796,0.21240927278995514,0.21405375003814697,0.25429487228393555,677.6557006835938,1e-05,0.07170440256595612,2.3454091548919678,23.927850246429443,1 +6795,0.20958003401756287,0.17122039198875427,0.1742316037416458,0.20532050728797913,489.6593933105469,1e-05,0.07602038234472275,2.64290714263916,23.927850246429443,1 +6796,0.2026815116405487,0.18486319482326508,0.1869708150625229,0.22262819111347198,677.6557006835938,1e-05,0.06630933284759521,2.3581290245056152,23.927850246429443,1 +6797,0.2815720736980438,0.19259050488471985,0.1911790519952774,0.16461537778377533,680.7832641601562,1e-05,0.0872306078672409,2.344712018966675,23.927850246429443,1 +6798,0.21686185896396637,0.24881860613822937,0.2352677434682846,0.24455127120018005,637.2549438476562,1e-05,0.06704483926296234,2.3482561111450195,23.927850246429443,1 +6799,0.19850130379199982,0.21971553564071655,0.21918714046478271,0.19833332300186157,907.7218017578125,1e-05,0.07482341676950455,2.3414735794067383,23.927850246429443,1 +6800,0.17835332453250885,0.20508156716823578,0.2026800960302353,0.14423076808452606,862.7633056640625,1e-05,0.061017297208309174,2.3457016944885254,23.927850246429443,1 +6801,0.28207361698150635,0.3217233717441559,0.3197041153907776,0.22692306339740753,427.6316223144531,1e-05,0.07135799527168274,2.686650276184082,23.927850246429443,1 +6802,0.2289009988307953,0.10668101161718369,0.10527337342500687,0.09141024947166443,892.4485473632812,1e-05,0.05882163345813751,2.353390693664551,23.927850246429443,1 +6803,0.28589174151420593,0.27993476390838623,0.2644030749797821,0.19807691872119904,938.4346313476562,1e-05,0.10133843868970871,2.466660261154175,23.927850246429443,1 +6804,0.34807512164115906,0.22201937437057495,0.23424658179283142,0.20538461208343506,643.2039184570312,1e-05,0.07760017365217209,2.349107503890991,23.927850246429443,1 +6805,0.18585960566997528,0.3266737163066864,0.3228847086429596,0.19519230723381042,972.9610595703125,1e-05,0.07197684049606323,2.351848602294922,23.927850246429443,1 +6806,0.16644534468650818,0.2372148036956787,0.2365250140428543,0.196762815117836,564.6929931640625,1e-05,0.07376187294721603,2.488297462463379,23.927850246429443,1 +6807,0.15307694673538208,0.35109877586364746,0.3614092469215393,0.17903845012187958,330.88238525390625,1e-05,0.07616447657346725,2.357546091079712,23.927850246429443,1 +6808,0.24417687952518463,0.098945252597332,0.10431340336799622,0.12320512533187866,937.1871948242188,1e-05,0.07638638466596603,2.3597381114959717,23.927850246429443,1 +6809,0.237144336104393,0.21483899652957916,0.2112530916929245,0.25544869899749756,474.5657653808594,1e-05,0.08261343091726303,2.3562800884246826,23.927850246429443,1 +6810,0.21521134674549103,0.08256613463163376,0.07612063735723495,0.148910254240036,887.0499877929688,1e-05,0.09324591606855392,2.3577539920806885,23.927850246429443,1 +6811,0.0961727648973465,0.36162009835243225,0.38180777430534363,0.2101602554321289,995.5211791992188,1e-05,0.05881700664758682,2.35431170463562,23.927850246429443,1 +6812,0.2992883324623108,0.18553373217582703,0.1785341501235962,0.19189101457595825,807.9915161132812,1e-05,0.07586362212896347,2.592421054840088,23.927850246429443,1 +6813,0.18361765146255493,0.19889883697032928,0.18915651738643646,0.13766025006771088,937.8121948242188,1e-05,0.07576460391283035,2.4798426628112793,23.927850246429443,1 +6814,0.13231754302978516,0.19500388205051422,0.17712633311748505,0.25342947244644165,878.4185791015625,1e-05,0.06694264709949493,2.354890823364258,23.927850246429443,1 +6815,0.2109440267086029,0.21879804134368896,0.22941656410694122,0.12987178564071655,987.174072265625,1e-05,0.06472355127334595,2.3505942821502686,23.927850246429443,1 +6816,0.3291092813014984,0.20723757147789001,0.20273374021053314,0.2488461434841156,507.7196960449219,1e-05,0.07904135435819626,2.4541285037994385,23.927850246429443,1 +6817,0.1882266253232956,0.576704204082489,0.5862622857093811,0.22833332419395447,141.84397888183594,1e-05,0.06621961295604706,2.516806125640869,23.927850246429443,1 +6818,0.2653919458389282,0.21761633455753326,0.21186810731887817,0.22778844833374023,847.8120727539062,1e-05,0.07095000147819519,2.347815990447998,23.927850246429443,1 +6819,0.2908961772918701,0.4106597602367401,0.4025747776031494,0.2647756338119507,218.64686584472656,1e-05,0.0739528238773346,2.35260009765625,23.927850246429443,1 +6820,0.11257012188434601,0.11430413275957108,0.1118173748254776,0.2570192217826843,879.7392578125,1e-05,0.08005256950855255,2.346341609954834,23.927850246429443,1 +6821,0.21952030062675476,0.17125026881694794,0.1605789065361023,0.1904807686805725,782.1857299804688,1e-05,0.06654868274927139,2.349433183670044,23.927850246429443,1 +6822,0.10730355978012085,0.2861083447933197,0.2782115936279297,0.24964742362499237,995.9349365234375,1e-05,0.06108663231134415,2.511261224746704,23.927850246429443,1 +6823,0.2659408748149872,0.1817461997270584,0.18573373556137085,0.2547435760498047,958.2166748046875,1e-05,0.07332983613014221,2.7115426063537598,23.927850246429443,1 +6824,0.24818576872348785,0.2382589876651764,0.2311653196811676,0.17003203928470612,953.5103759765625,1e-05,0.0677986815571785,2.470174789428711,23.927850246429443,1 +6825,0.17887991666793823,0.12423878908157349,0.1315423995256424,0.21012820303440094,729.1666870117188,1e-05,0.07286832481622696,2.346133232116699,23.927850246429443,1 +6826,0.30210939049720764,0.2173650562763214,0.21482016146183014,0.17499999701976776,733.4710693359375,1e-05,0.08409611880779266,2.343961000442505,23.927850246429443,1 +6827,0.2631387412548065,0.11925429850816727,0.11772136390209198,0.18381409347057343,742.69482421875,1e-05,0.07402516901493073,2.52382755279541,23.927850246429443,1 +6828,0.16248883306980133,0.07046008855104446,0.06866598129272461,0.21967947483062744,838.8157958984375,1e-05,0.06203707680106163,2.3605854511260986,23.927850246429443,1 +6829,0.3719494640827179,0.1385815441608429,0.1259171962738037,0.2149999886751175,660.3773803710938,1e-05,0.06680584698915482,2.354997396469116,23.927850246429443,1 +6830,0.16241563856601715,0.19894395768642426,0.18742026388645172,0.22756409645080566,853.9290161132812,1e-05,0.06959836930036545,2.3583695888519287,23.927850246429443,1 +6831,0.22575843334197998,0.11915614455938339,0.1264372169971466,0.3014102578163147,929.1580810546875,1e-05,0.058332737535238266,2.354572057723999,23.927850246429443,1 +6832,0.1319229006767273,0.18565094470977783,0.17503315210342407,0.17724359035491943,829.9730834960938,1e-05,0.056120991706848145,2.3583128452301025,23.927850246429443,1 +6833,0.21411316096782684,0.23385386168956757,0.2354496717453003,0.2395833283662796,993.0098266601562,1e-05,0.07553450018167496,2.4924426078796387,23.927850246429443,1 +6834,0.19271524250507355,0.16590817272663116,0.1549251675605774,0.1650320440530777,714.8972778320312,1e-05,0.0667373389005661,2.7793333530426025,23.927850246429443,1 +6835,0.14276400208473206,0.17325729131698608,0.1603052318096161,0.24608974158763885,933.7044067382812,1e-05,0.07300037890672684,2.3580081462860107,23.927850246429443,1 +6836,0.1789507269859314,0.10594065487384796,0.10566314309835434,0.15737178921699524,612.2449340820312,1e-05,0.12946948409080505,2.3472530841827393,23.927850246429443,1 +6837,0.3131696879863739,0.33320504426956177,0.3598083555698395,0.2450961470603943,183.4470977783203,1e-05,0.09375135600566864,2.3491384983062744,23.927850246429443,1 +6838,0.13607241213321686,0.16554562747478485,0.1578620970249176,0.11166666448116302,875.2998046875,1e-05,0.0709957405924797,2.824263095855713,23.927850246429443,1 +6839,0.1112869530916214,0.16318176686763763,0.16086192429065704,0.24157050251960754,953.2288818359375,1e-05,0.0642157718539238,2.3494083881378174,23.927850246429443,1 +6840,0.18550176918506622,0.18531496822834015,0.1850564181804657,0.14490383863449097,946.6019287109375,1e-05,0.06351504474878311,2.347951650619507,23.927850246429443,1 +6841,0.2071290761232376,0.1315743327140808,0.13503333926200867,0.26499998569488525,855.9268798828125,1e-05,0.06867868453264236,2.3473758697509766,23.927850246429443,1 +6842,0.20194223523139954,0.19758763909339905,0.1909395456314087,0.23657050728797913,902.3915405273438,1e-05,0.08007990568876266,2.351696252822876,23.927850246429443,1 +6843,0.24190804362297058,0.235059916973114,0.22724145650863647,0.21028845012187958,701.75439453125,1e-05,0.07576517015695572,2.538170576095581,23.927850246429443,1 +6844,0.23997898399829865,0.19131289422512054,0.1794084757566452,0.2096794843673706,725.671142578125,1e-05,0.07861242443323135,2.477391481399536,23.927850246429443,1 +6845,0.34248173236846924,0.36615806818008423,0.3965032398700714,0.1027243584394455,117.75362396240234,1e-05,0.078841432929039,2.6934192180633545,23.927850246429443,1 +6846,0.15431714057922363,0.1626971960067749,0.15401947498321533,0.2495192289352417,843.6281127929688,1e-05,0.09259544312953949,2.352292060852051,23.927850246429443,1 +6847,0.20459194481372833,0.5266525149345398,0.5220020413398743,0.1985897421836853,991.3079833984375,1e-05,0.0912017673254013,2.347097635269165,23.927850246429443,1 +6848,0.17740872502326965,0.16943876445293427,0.17522551119327545,0.13557691872119904,450.76727294921875,1e-05,0.07484595477581024,2.477569341659546,23.927850246429443,1 +6849,0.162569060921669,0.1857648342847824,0.18818634748458862,0.24118588864803314,937.8121948242188,1e-05,0.05895885080099106,2.478663682937622,23.927850246429443,1 +6850,0.2060582935810089,0.18624264001846313,0.176418274641037,0.24384614825248718,725.671142578125,1e-05,0.06265383213758469,2.3474996089935303,23.927850246429443,1 +6851,0.24076047539710999,0.23686888813972473,0.24018152058124542,0.20339742302894592,626.2474975585938,1e-05,0.07778145372867584,2.3497259616851807,23.927850246429443,1 +6852,0.19326190650463104,0.21136990189552307,0.20406457781791687,0.1754487156867981,600.3118286132812,1e-05,0.08611839264631271,2.3551790714263916,23.927850246429443,1 +6853,0.23344334959983826,0.5741032958030701,0.5736746788024902,0.2272435873746872,145.7597198486328,1e-05,0.06480352580547333,2.348233699798584,23.927850246429443,1 +6854,0.17597723007202148,0.12247208505868912,0.12191170454025269,0.17628204822540283,605.6701049804688,1e-05,0.06619798392057419,2.5087268352508545,23.927850246429443,1 +6855,0.19010114669799805,0.26800066232681274,0.27346864342689514,0.21631409227848053,975.3954467773438,1e-05,0.07670754939317703,2.7814176082611084,23.927850246429443,1 +6856,0.22451676428318024,0.19442221522331238,0.18294525146484375,0.204679474234581,943.0255737304688,1e-05,0.079096220433712,2.3556501865386963,23.927850246429443,1 +6857,0.10796798765659332,0.1927468627691269,0.19485561549663544,0.25663459300994873,972.7151489257812,1e-05,0.0712636262178421,2.35067081451416,23.927850246429443,1 +6858,0.10078960657119751,0.18798142671585083,0.176260307431221,0.3000320494174957,869.3666381835938,1e-05,0.07092109322547913,2.350585699081421,23.927850246429443,1 +6859,0.18829463422298431,0.629224419593811,0.6286519765853882,0.1922435760498047,137.90036010742188,1e-05,0.07226254791021347,2.5066871643066406,23.927850246429443,1 +6860,0.22061771154403687,0.1461193859577179,0.1565006673336029,0.25923076272010803,400.81524658203125,1e-05,0.0846167504787445,2.600022315979004,23.927850246429443,1 +6861,0.18910463154315948,0.24706551432609558,0.24661658704280853,0.18230769038200378,514.7058715820312,1e-05,0.06089947745203972,2.347639799118042,23.927850246429443,1 +6862,0.24554136395454407,0.19069544970989227,0.189570352435112,0.24278844892978668,985.1694946289062,1e-05,0.06903111934661865,2.344634532928467,23.927850246429443,1 +6863,0.18586412072181702,0.15172961354255676,0.14688707888126373,0.222019225358963,949.5192260742188,1e-05,0.08755536377429962,2.3468680381774902,23.927850246429443,1 +6864,0.2956213355064392,0.34842410683631897,0.35538381338119507,0.26105767488479614,359.68658447265625,1e-05,0.07994171231985092,2.539569854736328,23.927850246429443,1 +6865,0.1847071796655655,0.2113318145275116,0.19514794647693634,0.31121793389320374,883.2159423828125,1e-05,0.07580497115850449,2.497007131576538,23.927850246429443,1 +6866,0.2043571174144745,0.20107826590538025,0.19786696135997772,0.19833332300186157,758.6478271484375,1e-05,0.06137078255414963,2.6879477500915527,23.927850246429443,1 +6867,0.3182050585746765,0.3015478849411011,0.29516080021858215,0.26839742064476013,977.07421875,1e-05,0.0880453810095787,2.359419822692871,23.927850246429443,1 +6868,0.2696058452129364,0.2765464782714844,0.2646544575691223,0.2638140916824341,414.4384765625,1e-05,0.08178430795669556,2.348529100418091,23.927850246429443,1 +6869,0.1949414163827896,0.23820050060749054,0.2330082207918167,0.1766025573015213,903.1631469726562,1e-05,0.07010028511285782,2.507870674133301,23.927850246429443,1 +6870,0.2799323499202728,0.3192356526851654,0.3167288601398468,0.2474038302898407,314.37127685546875,1e-05,0.07815132290124893,2.53263521194458,23.927850246429443,1 +6871,0.17701543867588043,0.13648922741413116,0.13396574556827545,0.2671794891357422,968.7218017578125,1e-05,0.07078692317008972,2.3500547409057617,23.927850246429443,1 +6872,0.3414209485054016,0.18856757879257202,0.20683680474758148,0.25070512294769287,273.4375,1e-05,0.09757931530475616,2.3455007076263428,23.927850246429443,1 +6873,0.2112177312374115,0.2711257338523865,0.25258055329322815,0.2319551259279251,969.2273559570312,1e-05,0.09149149805307388,2.346921682357788,23.927850246429443,1 +6874,0.17309445142745972,0.2140066921710968,0.20519272983074188,0.2192307561635971,719.4397583007812,1e-05,0.09463975578546524,2.3478100299835205,23.927850246429443,1 +6875,0.12765593826770782,0.1841156780719757,0.17955395579338074,0.21211537718772888,804.208251953125,1e-05,0.07867152988910675,2.6247458457946777,23.927850246429443,1 +6876,0.12777940928936005,0.06997264921665192,0.07782384753227234,0.21753203868865967,713.0584106445312,1e-05,0.07091319561004639,2.3634090423583984,23.927850246429443,1 +6877,0.10258349031209946,0.23525741696357727,0.2454601526260376,0.21320511400699615,926.165771484375,1e-05,0.08931826800107956,2.688209295272827,23.927850246429443,1 +6878,0.22985956072807312,0.15496371686458588,0.15052641928195953,0.23644229769706726,646.7181396484375,1e-05,0.09336228668689728,2.3570783138275146,23.927850246429443,1 +6879,0.25239911675453186,0.17480991780757904,0.17451803386211395,0.1995512694120407,959.0316162109375,1e-05,0.09476589411497116,2.3500471115112305,23.927850246429443,1 +6880,0.20420047640800476,0.1732144057750702,0.16297802329063416,0.29240384697914124,845.2072143554688,1e-05,0.08112634718418121,2.583639144897461,23.927850246429443,1 +6881,0.21970753371715546,0.18494001030921936,0.17095670104026794,0.2499999850988388,934.0242309570312,1e-05,0.1087346002459526,2.4926211833953857,23.927850246429443,1 +6882,0.15231718122959137,0.12878286838531494,0.12499929219484329,0.1307051181793213,850.3836669921875,1e-05,0.056044407188892365,2.3564341068267822,23.927850246429443,1 +6883,0.15316513180732727,0.27578967809677124,0.2638512849807739,0.25641024112701416,737.7049560546875,1e-05,0.07602276653051376,2.34818696975708,23.927850246429443,1 +6884,0.2063392698764801,0.23891721665859222,0.22903336584568024,0.22535255551338196,529.9539794921875,1e-05,0.06822122633457184,2.3477470874786377,23.927850246429443,1 +6885,0.1792074292898178,0.08603969216346741,0.08847411721944809,0.12163460999727249,871.670654296875,1e-05,0.0820816233754158,2.4957587718963623,23.927850246429443,1 +6886,0.30434519052505493,0.2545613944530487,0.246477410197258,0.2383333295583725,977.5501098632812,1e-05,0.08085911720991135,2.516822099685669,23.927850246429443,1 +6887,0.18265002965927124,0.17178715765476227,0.16950911283493042,0.28862178325653076,603.0020751953125,1e-05,0.061171237379312515,2.5013294219970703,23.927850246429443,1 +6888,0.1992388516664505,0.22549308836460114,0.21579143404960632,0.2598397433757782,884.0750122070312,1e-05,0.08264726400375366,2.360313653945923,23.927850246429443,1 +6889,0.2151881754398346,0.20617693662643433,0.1987246870994568,0.23362179100513458,918.9618530273438,1e-05,0.07690441608428955,2.3446929454803467,23.927850246429443,1 +6890,0.14667649567127228,0.2375599443912506,0.22719058394432068,0.2538782060146332,930.7967529296875,1e-05,0.07246502488851547,2.3430991172790527,23.927850246429443,1 +6891,0.20426569879055023,0.18064545094966888,0.1841188371181488,0.26839742064476013,970.2327880859375,1e-05,0.0825229361653328,2.652057647705078,23.927850246429443,1 +6892,0.22176875174045563,0.19723141193389893,0.18760743737220764,0.1538461446762085,723.0185546875,1e-05,0.08370282500982285,2.35208797454834,23.927850246429443,1 +6893,0.18798474967479706,0.27011701464653015,0.26304376125335693,0.2517628073692322,803.5714111328125,1e-05,0.07078894972801208,2.35007643699646,23.927850246429443,1 +6894,0.19472822546958923,0.3265117108821869,0.32481229305267334,0.18685896694660187,991.0935668945312,1e-05,0.0680616945028305,2.346639394760132,23.927850246429443,1 +6895,0.15972083806991577,0.13144367933273315,0.12616054713726044,0.13993589580059052,597.59912109375,1e-05,0.08866733312606812,2.3465943336486816,23.927850246429443,1 +6896,0.3022884726524353,0.2324683517217636,0.23974238336086273,0.270480751991272,988.7123413085938,1e-05,0.08952173590660095,2.5211706161499023,23.927850246429443,1 +6897,0.17553791403770447,0.23233561217784882,0.23226875066757202,0.09730768948793411,995.5211791992188,1e-05,0.06730751693248749,2.4773545265197754,23.927850246429443,1 +6898,0.23250582814216614,0.1063133254647255,0.11019985377788544,0.2527243494987488,633.6292114257812,1e-05,0.07948751747608185,2.672031879425049,23.927850246429443,1 +6899,0.11182072013616562,0.42771315574645996,0.4441674053668976,0.23163460195064545,161.1498260498047,1e-05,0.07048189640045166,2.3499488830566406,23.927850246429443,1 +6900,0.2450634390115738,0.21931661665439606,0.21051761507987976,0.3090384602546692,939.36376953125,1e-05,0.07802320271730423,2.3482728004455566,23.927850246429443,1 +6901,0.1972488909959793,0.19408482313156128,0.18106599152088165,0.2463461458683014,934.3434448242188,1e-05,0.07118000835180283,2.580474615097046,23.927850246429443,1 +6902,0.12514880299568176,0.13360488414764404,0.1371174156665802,0.3031730651855469,693.9501953125,1e-05,0.06495018303394318,2.567514419555664,23.927850246429443,1 +6903,0.11745338886976242,0.16810062527656555,0.1619051992893219,0.17326922714710236,874.8499145507812,1e-05,0.07139601558446884,2.356593370437622,23.927850246429443,1 +6904,0.15635913610458374,0.07538069784641266,0.07415252178907394,0.04849358648061752,855.9268798828125,1e-05,0.07158534228801727,2.355522871017456,23.927850246429443,1 +6905,0.2272099256515503,0.235683873295784,0.23349831998348236,0.2103525549173355,960.1112060546875,1e-05,0.1037910059094429,2.3539767265319824,23.927850246429443,1 +6906,0.23358683288097382,0.2710449993610382,0.28428688645362854,0.18647435307502747,941.20556640625,1e-05,0.07723361253738403,2.36128568649292,23.927850246429443,1 +6907,0.1697712242603302,0.12113732099533081,0.1100783720612526,0.20403845608234406,856.9182739257812,1e-05,0.07215084880590439,2.61934494972229,23.927850246429443,1 +6908,0.1347718983888626,0.1395777463912964,0.1342255026102066,0.14701922237873077,918.6107788085938,1e-05,0.07518700510263443,2.4872138500213623,23.927850246429443,1 +6909,0.20790842175483704,0.13171064853668213,0.12950657308101654,0.22403845191001892,945.4190673828125,1e-05,0.08601942658424377,2.355192184448242,23.927850246429443,1 +6910,0.280010461807251,0.2728551924228668,0.2719891667366028,0.24269229173660278,374.6498718261719,1e-05,0.09749513864517212,2.355865955352783,23.927850246429443,1 +6911,0.24503742158412933,0.190565288066864,0.18445086479187012,0.20038460195064545,839.89501953125,1e-05,0.08078975975513458,2.3498332500457764,23.927850246429443,1 +6912,0.24420738220214844,0.1511395126581192,0.14607733488082886,0.22499999403953552,680.7832641601562,1e-05,0.07262245565652847,2.5400543212890625,23.927850246429443,1 +6913,0.11133308708667755,0.1718040257692337,0.16897423565387726,0.23711538314819336,987.615478515625,1e-05,0.06655056029558182,2.547461986541748,23.927850246429443,1 +6914,0.23527050018310547,0.13196434080600739,0.13068686425685883,0.204679474234581,653.6259765625,1e-05,0.11079524457454681,2.346360206604004,23.927850246429443,1 +6915,0.2129354476928711,0.16356219351291656,0.16415327787399292,0.21086537837982178,657.0208740234375,1e-05,0.08004329353570938,2.351207733154297,23.927850246429443,1 +6916,0.17074249684810638,0.18454276025295258,0.18600335717201233,0.2470192164182663,937.5,1e-05,0.06265750527381897,2.345867395401001,23.927850246429443,1 +6917,0.12090827524662018,0.2368152141571045,0.2207217961549759,0.2141346037387848,981.9896850585938,1e-05,0.07913286983966827,2.468378782272339,23.927850246429443,1 +6918,0.2068137377500534,0.11854217946529388,0.1164732277393341,0.1540384590625763,848.8447265625,1e-05,0.07422509789466858,2.5678961277008057,23.927850246429443,1 +6919,0.11431199312210083,0.09269969165325165,0.09743727743625641,0.09522435814142227,855.9268798828125,1e-05,0.08114875853061676,2.7214179039001465,23.927850246429443,1 +6920,0.17580997943878174,0.11114265769720078,0.12012870609760284,0.23788461089134216,922.7748413085938,1e-05,0.10464426875114441,2.352781295776367,23.927850246429443,1 +6921,0.2796767055988312,0.24376916885375977,0.24741573631763458,0.2783333361148834,427.6316223144531,1e-05,0.06985196471214294,2.347947835922241,23.927850246429443,1 +6922,0.06706293672323227,0.36892735958099365,0.3690686821937561,0.16025640070438385,987.3948974609375,1e-05,0.08895301073789597,2.347568988800049,23.927850246429443,1 +6923,0.29205524921417236,0.14829114079475403,0.14526522159576416,0.254647433757782,764.7515258789062,1e-05,0.08533837646245956,2.6923482418060303,23.927850246429443,1 +6924,0.16724713146686554,0.22111466526985168,0.21664516627788544,0.20137819647789001,446.65814208984375,1e-05,0.07102365791797638,2.357311725616455,23.927850246429443,1 +6925,0.12119171023368835,0.19987785816192627,0.19670727849006653,0.15096153318881989,819.5592651367188,1e-05,0.08715790510177612,2.35087513923645,23.927850246429443,1 +6926,0.16596336662769318,0.10674979537725449,0.09916362911462784,0.1643589735031128,904.6961059570312,1e-05,0.0864061638712883,2.351133108139038,23.927850246429443,1 +6927,0.1786816567182541,0.13745228946208954,0.1329936534166336,0.22499999403953552,789.0855712890625,1e-05,0.07527800649404526,2.3530328273773193,23.927850246429443,1 +6928,0.19197580218315125,0.2004404515028,0.1955479234457016,0.25602564215660095,947.1898803710938,1e-05,0.06091184914112091,2.487532377243042,23.927850246429443,1 +6929,0.38012996315956116,0.21498730778694153,0.20961464941501617,0.21230769157409668,676.6055297851562,1e-05,0.0933389961719513,2.58978271484375,23.927850246429443,1 +6930,0.22690440714359283,0.18143682181835175,0.17699715495109558,0.23362179100513458,684.9005737304688,1e-05,0.10419882088899612,2.3607358932495117,23.927850246429443,1 +6931,0.20226606726646423,0.11951558291912079,0.12456436455249786,0.14483973383903503,793.795654296875,1e-05,0.0825163796544075,2.3524885177612305,23.927850246429443,1 +6932,0.22474902868270874,0.1665109395980835,0.16294139623641968,0.18291665613651276,761.7188110351562,1e-05,0.07880216091871262,2.3520610332489014,23.927850246429443,1 +6933,0.20980367064476013,0.4318886995315552,0.44140753149986267,0.26798075437545776,179.79454040527344,1e-05,0.0667579248547554,2.4874894618988037,23.927850246429443,1 +6934,0.20162340998649597,0.1294560581445694,0.12605462968349457,0.25381410121917725,734.3234252929688,1e-05,0.06451971083879471,2.495260238647461,23.927850246429443,1 +6935,0.22913900017738342,0.14686545729637146,0.1502894163131714,0.1159294843673706,669.14501953125,1e-05,0.08063370734453201,2.3527133464813232,23.927850246429443,1 +6936,0.14276766777038574,0.23268207907676697,0.22855882346630096,0.21608974039554596,953.7914428710938,1e-05,0.05866628140211105,2.351358413696289,23.927850246429443,1 +6937,0.19657780230045319,0.1649155169725418,0.16267995536327362,0.2474999874830246,613.5438232421875,1e-05,0.09029760211706161,2.3495585918426514,23.927850246429443,1 +6938,0.18296192586421967,0.4216802716255188,0.417600154876709,0.2499038428068161,238.6731414794922,1e-05,0.062150247395038605,2.3482210636138916,23.927850246429443,1 +6939,0.1927475780248642,0.25360018014907837,0.2423747330904007,0.26201921701431274,968.2146606445312,1e-05,0.06613188982009888,2.71572208404541,23.927850246429443,1 +6940,0.28353768587112427,0.13057979941368103,0.12399119883775711,0.3071794807910919,915.7753295898438,1e-05,0.09964121878147125,2.6896915435791016,23.927850246429443,1 +6941,0.1538163721561432,0.23155002295970917,0.22309477627277374,0.20884615182876587,756.319091796875,1e-05,0.0862678810954094,2.3528921604156494,23.927850246429443,1 +6942,0.21746842563152313,0.459623247385025,0.4411848187446594,0.20233973860740662,994.6895141601562,1e-05,0.07999088615179062,2.347806215286255,23.927850246429443,1 +6943,0.20123565196990967,0.16023942828178406,0.15777286887168884,0.07804486900568008,561.674072265625,1e-05,0.07774971425533295,2.352762222290039,23.927850246429443,1 +6944,0.24108554422855377,0.17288373410701752,0.18110151588916779,0.2351602464914322,973.6957397460938,1e-05,0.06199267506599426,2.4742534160614014,23.927850246429443,1 +6945,0.24043980240821838,0.27095115184783936,0.26556098461151123,0.1422756314277649,995.9349365234375,1e-05,0.08955337107181549,2.4935431480407715,23.927850246429443,1 +6946,0.21247725188732147,0.19764584302902222,0.19333843886852264,0.19266024231910706,896.0928344726562,1e-05,0.06705448031425476,2.3602333068847656,23.927850246429443,1 +6947,0.23749412596225739,0.2718678414821625,0.26679152250289917,0.12105768918991089,978.7327270507812,1e-05,0.07123779505491257,2.3574860095977783,23.927850246429443,1 +6948,0.18590140342712402,0.16199460625648499,0.1578635573387146,0.2579807639122009,887.8910522460938,1e-05,0.090758316218853,2.3508219718933105,23.927850246429443,1 +6949,0.2325206995010376,0.24937675893306732,0.23920945823192596,0.23423075675964355,598.9583129882812,1e-05,0.08100584149360657,2.4916646480560303,23.927850246429443,1 +6950,0.20394812524318695,0.21218341588974,0.2068568468093872,0.25400641560554504,984.7198486328125,1e-05,0.06966038048267365,2.3570895195007324,23.927850246429443,1 +6951,0.19864924252033234,0.24967904388904572,0.262411892414093,0.2270512729883194,983.1340942382812,1e-05,0.07690536230802536,2.739084243774414,23.927850246429443,1 +6952,0.17577418684959412,0.20581276714801788,0.20451875030994415,0.17730768024921417,740.2120361328125,1e-05,0.06863367557525635,2.3513989448547363,23.927850246429443,1 +6953,0.10898114740848541,0.1586979776620865,0.14629730582237244,0.22727563977241516,844.1558227539062,1e-05,0.07315849512815475,2.355599880218506,23.927850246429443,1 +6954,0.18280762434005737,0.1733720898628235,0.16523289680480957,0.17330127954483032,908.8427124023438,1e-05,0.07834959775209427,2.4826481342315674,23.927850246429443,1 +6955,0.14345227181911469,0.6126911640167236,0.6478558778762817,0.07573717832565308,48.076927185058594,1e-05,0.07954531908035278,2.353731155395508,23.927850246429443,1 +6956,0.2313428670167923,0.22153301537036896,0.20985367894172668,0.24326921999454498,798.4103393554688,1e-05,0.07769488543272018,2.5024609565734863,23.927850246429443,1 +6957,0.21267709136009216,0.152489572763443,0.143224835395813,0.24522435665130615,785.6611938476562,1e-05,0.08830302953720093,2.3460474014282227,23.927850246429443,1 +6958,0.18989141285419464,0.20823217928409576,0.19929781556129456,0.13878203928470612,968.974853515625,1e-05,0.0856262817978859,2.3502087593078613,23.927850246429443,1 +6959,0.12815803289413452,0.16714075207710266,0.16992774605751038,0.2169230729341507,575.0540771484375,1e-05,0.07106701284646988,2.3444228172302246,23.927850246429443,1 +6960,0.21504344046115875,0.1958172619342804,0.19038018584251404,0.26955127716064453,900.8379516601562,1e-05,0.07710736989974976,2.7404096126556396,23.927850246429443,1 +6961,0.28600621223449707,0.24321842193603516,0.2382436841726303,0.208717942237854,780.0751953125,1e-05,0.08500660955905914,2.484302282333374,23.927850246429443,1 +6962,0.2017097771167755,0.17286477982997894,0.16375920176506042,0.26868587732315063,907.3464965820312,1e-05,0.07607308030128479,2.3565587997436523,23.927850246429443,1 +6963,0.17545366287231445,0.14005784690380096,0.13582707941532135,0.23791666328907013,892.4485473632812,1e-05,0.06708751618862152,2.3437488079071045,23.927850246429443,1 +6964,0.16346998512744904,0.18917465209960938,0.18284882605075836,0.21387819945812225,958.2166748046875,1e-05,0.06406089663505554,2.347363233566284,23.927850246429443,1 +6965,0.13972234725952148,0.24471218883991241,0.24114739894866943,0.1983012706041336,883.6459350585938,1e-05,0.08662621676921844,2.4865334033966064,23.927850246429443,1 +6966,0.2823151648044586,0.17496289312839508,0.17874757945537567,0.22233973443508148,577.95703125,1e-05,0.07803399115800858,2.4646308422088623,23.927850246429443,1 +6967,0.18424899876117706,0.1314086616039276,0.12802386283874512,0.2726922929286957,889.9769897460938,1e-05,0.061648327857255936,2.3561654090881348,23.927850246429443,1 +6968,0.17715179920196533,0.2748788595199585,0.292331725358963,0.16673076152801514,254.77706909179688,1e-05,0.07933024317026138,2.344331979751587,23.927850246429443,1 +6969,0.21816498041152954,0.18360331654548645,0.18297521770000458,0.2212499976158142,911.4300537109375,1e-05,0.06864399462938309,2.3457040786743164,23.927850246429443,1 +6970,0.2477128505706787,0.17310836911201477,0.17224964499473572,0.17884615063667297,713.0584106445312,1e-05,0.07908722758293152,2.463498115539551,23.927850246429443,1 +6971,0.17674748599529266,0.23460115492343903,0.23897306621074677,0.23855768144130707,995.5211791992188,1e-05,0.07046515494585037,2.5294253826141357,23.927850246429443,1 +6972,0.1152288168668747,0.173851877450943,0.17541341483592987,0.21830128133296967,614.83740234375,1e-05,0.0592183843255043,2.5727577209472656,23.927850246429443,1 +6973,0.21184559166431427,0.17991404235363007,0.18976841866970062,0.2191346138715744,963.3027954101562,1e-05,0.0798192173242569,2.3462395668029785,23.927850246429443,1 +6974,0.24009211361408234,0.1723944991827011,0.16279135644435883,0.19990384578704834,748.3948974609375,1e-05,0.07438301295042038,2.3461191654205322,23.927850246429443,1 +6975,0.17078493535518646,0.2001871019601822,0.20274409651756287,0.19499999284744263,975.3954467773438,1e-05,0.09275602549314499,2.3484461307525635,23.927850246429443,1 +6976,0.21302126348018646,0.15829719603061676,0.14935725927352905,0.24862179160118103,882.3529052734375,1e-05,0.06795529276132584,2.353726387023926,23.927850246429443,1 +6977,0.23794914782047272,0.1547173112630844,0.1629849374294281,0.11189102381467819,979.6713256835938,1e-05,0.09816884994506836,2.568974494934082,23.927850246429443,1 +6978,0.21369361877441406,0.11916987597942352,0.12315711379051208,0.0935576856136322,573.5930786132812,1e-05,0.061402998864650726,2.3647565841674805,23.927850246429443,1 +6979,0.15653526782989502,0.16856689751148224,0.1680210381746292,0.17830127477645874,902.0044555664062,1e-05,0.06995313614606857,2.3550047874450684,23.927850246429443,1 +6980,0.1793021261692047,0.21875888109207153,0.2255493402481079,0.264455109834671,763.2398681640625,1e-05,0.07292711734771729,2.3602981567382812,23.927850246429443,1 +6981,0.18935050070285797,0.15336284041404724,0.14460279047489166,0.22746793925762177,847.2938232421875,1e-05,0.06851963698863983,2.604349374771118,23.927850246429443,1 +6982,0.28401464223861694,0.37263524532318115,0.365278035402298,0.10208333283662796,448.71795654296875,1e-05,0.07972085475921631,2.3667447566986084,23.927850246429443,1 +6983,0.18778206408023834,0.15096287429332733,0.1489192098379135,0.2928525507450104,840.9685668945312,1e-05,0.06491130590438843,2.4856719970703125,23.927850246429443,1 +6984,0.21010972559452057,0.17382995784282684,0.17098002135753632,0.22544871270656586,898.8763427734375,1e-05,0.07408555597066879,2.351985216140747,23.927850246429443,1 +6985,0.20313966274261475,0.19619125127792358,0.18268029391765594,0.228589728474617,855.9268798828125,1e-05,0.06405390053987503,2.346646547317505,23.927850246429443,1 +6986,0.21258404850959778,0.2244327962398529,0.21212585270404816,0.23160254955291748,643.2039184570312,1e-05,0.06630940735340118,2.4527931213378906,23.927850246429443,1 +6987,0.14430224895477295,0.14740383625030518,0.1412764936685562,0.275865375995636,888.7283325195312,1e-05,0.0689748078584671,2.3543317317962646,23.927850246429443,1 +6988,0.18513061106204987,0.10965122282505035,0.11151400208473206,0.26695510745048523,917.9064331054688,1e-05,0.07688342034816742,2.467146158218384,23.927850246429443,1 +6989,0.4030958414077759,0.3181926906108856,0.3229893147945404,0.19499999284744263,396.1748962402344,1e-05,0.09352939575910568,2.345655679702759,23.927850246429443,1 +6990,0.2264576256275177,0.2298622876405716,0.22544901072978973,0.23605768382549286,903.5476684570312,1e-05,0.0981765165925026,2.345064878463745,23.927850246429443,1 +6991,0.2497224360704422,0.19342033565044403,0.18753372132778168,0.29538461565971375,693.9501953125,1e-05,0.06742478907108307,2.4711415767669678,23.927850246429443,1 +6992,0.15667401254177094,0.25572827458381653,0.25410112738609314,0.23897434771060944,985.3936767578125,1e-05,0.0689806193113327,2.5238137245178223,23.927850246429443,1 +6993,0.21247492730617523,0.22950728237628937,0.2206803858280182,0.2555769085884094,487.8049011230469,1e-05,0.06690371781587601,2.606196641921997,23.927850246429443,1 +6994,0.2770700454711914,0.4141691327095032,0.4095461368560791,0.13900640606880188,222.03948974609375,1e-05,0.08151131123304367,2.357668399810791,23.927850246429443,1 +6995,0.19679048657417297,0.16435080766677856,0.15180587768554688,0.2182692289352417,794.4606323242188,1e-05,0.0708143338561058,2.3424878120422363,23.927850246429443,1 +6996,0.1875048130750656,0.13448062539100647,0.13971547782421112,0.2854166626930237,970.9821166992188,1e-05,0.06431808322668076,2.3469278812408447,23.927850246429443,1 +6997,0.20432883501052856,0.2575652003288269,0.2562962472438812,0.2823076844215393,969.7308959960938,1e-05,0.07884279638528824,2.548276901245117,23.927850246429443,1 +6998,0.10024301707744598,0.1451670378446579,0.13517910242080688,0.20278845727443695,737.7049560546875,1e-05,0.06482978910207748,2.353520393371582,23.927850246429443,1 +6999,0.17354200780391693,0.1974547952413559,0.17902064323425293,0.23721152544021606,952.3810424804688,1e-05,0.07533858716487885,2.5963022708892822,23.927850246429443,1 +7000,0.2562028169631958,0.23461127281188965,0.22051048278808594,0.1944551169872284,980.6033935546875,1e-05,0.07533379644155502,2.342958450317383,23.927850246429443,1 +7001,0.32058775424957275,0.2231491059064865,0.21485719084739685,0.26298075914382935,564.6929931640625,1e-05,0.07351633161306381,2.33780837059021,23.927850246429443,1 +7002,0.3220420479774475,0.2233109027147293,0.21856707334518433,0.2499999850988388,965.3915405273438,1e-05,0.08036722987890244,2.5097451210021973,23.927850246429443,1 +7003,0.22361430525779724,0.23338016867637634,0.22640639543533325,0.2777884602546692,787.0369873046875,1e-05,0.06172611936926842,2.637813091278076,23.927850246429443,1 +7004,0.2562118470668793,0.22773809731006622,0.22862987220287323,0.24532049894332886,577.95703125,1e-05,0.24465346336364746,2.5517845153808594,23.927850246429443,1 +7005,0.26656439900398254,0.13337168097496033,0.14781402051448822,0.22423076629638672,498.798095703125,1e-05,0.08446091413497925,2.343050956726074,23.927850246429443,1 +7006,0.09655193239450455,0.26753169298171997,0.2475477159023285,0.22499999403953552,995.728271484375,1e-05,0.0593416728079319,2.343691110610962,23.927850246429443,1 +7007,0.16956214606761932,0.41986212134361267,0.4025039076805115,0.26653844118118286,994.6895141601562,1e-05,0.06774993985891342,2.348867654800415,23.927850246429443,1 +7008,0.10629638284444809,0.13610021770000458,0.14517179131507874,0.24060896039009094,529.9539794921875,1e-05,0.06376375257968903,2.707779884338379,23.927850246429443,1 +7009,0.20463968813419342,0.1581256091594696,0.15508505702018738,0.20291665196418762,675.5514526367188,1e-05,0.06786592304706573,2.3579652309417725,23.927850246429443,1 +7010,0.20851698517799377,0.17690467834472656,0.1753917932510376,0.26692306995391846,717.632080078125,1e-05,0.06347066164016724,2.3544862270355225,23.927850246429443,1 +7011,0.21070554852485657,0.29747697710990906,0.29523661732673645,0.22538460791110992,305.8912353515625,1e-05,0.06717809289693832,2.34584641456604,23.927850246429443,1 +7012,0.19110938906669617,0.1872529536485672,0.17911362648010254,0.24887819588184357,677.6557006835938,1e-05,0.06897596269845963,2.4740588665008545,23.927850246429443,1 +7013,0.19125325977802277,0.11899956315755844,0.11460226029157639,0.12217948585748672,802.292236328125,1e-05,0.07485608011484146,2.4597342014312744,23.927850246429443,1 +7014,0.15464574098587036,0.12618087232112885,0.12322231382131577,0.14048075675964355,828.2725830078125,1e-05,0.06306539475917816,2.607558488845825,23.927850246429443,1 +7015,0.15623147785663605,0.25234565138816833,0.24355272948741913,0.2676602602005005,980.13818359375,1e-05,0.06904415041208267,2.3591370582580566,23.927850246429443,1 +7016,0.2845929265022278,0.18120315670967102,0.16920539736747742,0.289903849363327,850.3836669921875,1e-05,0.07655030488967896,2.3469996452331543,23.927850246429443,1 +7017,0.16704019904136658,0.26837775111198425,0.25160425901412964,0.13467948138713837,968.2146606445312,1e-05,0.07479536533355713,2.3473753929138184,23.927850246429443,1 +7018,0.24586635828018188,0.17799323797225952,0.17708992958068848,0.22439101338386536,934.3434448242188,1e-05,0.07989739626646042,2.5295157432556152,23.927850246429443,1 +7019,0.20668917894363403,0.23049436509609222,0.23952005803585052,0.12262819707393646,450.76727294921875,1e-05,0.09837038815021515,2.4743597507476807,23.927850246429443,1 +7020,0.19399027526378632,0.30141568183898926,0.26183220744132996,0.22166666388511658,991.3079833984375,1e-05,0.06960330158472061,2.3499372005462646,23.927850246429443,1 +7021,0.22291627526283264,0.32965171337127686,0.3279622197151184,0.16846153140068054,346.82080078125,1e-05,0.07737836241722107,2.3462412357330322,23.927850246429443,1 +7022,0.11109770089387894,0.1954265981912613,0.18574181199073792,0.22826921939849854,959.5725708007812,1e-05,0.07314300537109375,2.3441436290740967,23.927850246429443,1 +7023,0.2250634878873825,0.22420832514762878,0.2271675020456314,0.20278845727443695,997.9838256835938,1e-05,0.08408467471599579,2.4616169929504395,23.927850246429443,1 +7024,0.15992680191993713,0.7919318675994873,0.8480051159858704,0.22721153497695923,24.50980567932129,1e-05,0.0771351084113121,2.461024522781372,23.927850246429443,1 +7025,0.14942298829555511,0.17731086909770966,0.1767258495092392,0.20230768620967865,412.1983947753906,1e-05,0.06944790482521057,2.5068624019622803,23.927850246429443,1 +7026,0.1820894330739975,0.20428599417209625,0.19598343968391418,0.2109294831752777,900.8379516601562,1e-05,0.058424048125743866,2.3466312885284424,23.927850246429443,1 +7027,0.10828832536935806,0.1897786259651184,0.1987244188785553,0.1571153849363327,972.9610595703125,1e-05,0.06590589880943298,2.3431928157806396,23.927850246429443,1 +7028,0.31590646505355835,0.5454732179641724,0.5564095973968506,0.2467307597398758,129.92831420898438,1e-05,0.071436308324337,2.3450284004211426,23.927850246429443,1 +7029,0.21911093592643738,0.29063427448272705,0.3056280314922333,0.1358012706041336,238.6731414794922,1e-05,0.06657039374113083,2.4745419025421143,23.927850246429443,1 +7030,0.11580117046833038,0.25639602541923523,0.2572587728500366,0.19894230365753174,976.5967407226562,1e-05,0.05899432301521301,2.477562189102173,23.927850246429443,1 +7031,0.1814485788345337,0.05684884265065193,0.06458835303783417,0.1395512819290161,621.2273559570312,1e-05,0.08064804971218109,2.3441126346588135,23.927850246429443,1 +7032,0.22137956321239471,0.13065490126609802,0.13435819745063782,0.2640064060688019,917.9064331054688,1e-05,0.060082629323005676,2.346867322921753,23.927850246429443,1 +7033,0.18958726525306702,0.10843249410390854,0.10793843120336533,0.23326922953128815,908.8427124023438,1e-05,0.060615792870521545,2.3454599380493164,23.927850246429443,1 +7034,0.16244937479496002,0.19830407202243805,0.17824997007846832,0.19326922297477722,878.85986328125,1e-05,0.056589700281620026,2.6086668968200684,23.927850246429443,1 +7035,0.23362743854522705,0.1892612874507904,0.1910102367401123,0.27455127239227295,975.3954467773438,1e-05,0.07670634984970093,2.519805908203125,23.927850246429443,1 +7036,0.19299982488155365,0.22594599425792694,0.20757374167442322,0.2040064036846161,989.3660888671875,1e-05,0.07010287791490555,2.474620819091797,23.927850246429443,1 +7037,0.28847745060920715,0.1572292298078537,0.15752452611923218,0.18676280975341797,944.8242797851562,1e-05,0.0686260387301445,2.34476900100708,23.927850246429443,1 +7038,0.2901498079299927,0.07102034240961075,0.07990176975727081,0.15580128133296967,629.9603271484375,1e-05,0.06975884735584259,2.3468682765960693,23.927850246429443,1 +7039,0.20762550830841064,0.22431156039237976,0.24323980510234833,0.17817306518554688,362.2159423828125,1e-05,0.07511637359857559,2.5576748847961426,23.927850246429443,1 +7040,0.18151462078094482,0.25889450311660767,0.25139209628105164,0.22400639951229095,963.5654907226562,1e-05,0.07309775054454803,2.3620803356170654,23.927850246429443,1 +7041,0.23607993125915527,0.24686174094676971,0.25845587253570557,0.27108973264694214,276.479736328125,1e-05,0.06793530285358429,2.5150809288024902,23.927850246429443,1 +7042,0.16469502449035645,0.2510373592376709,0.24568742513656616,0.26964741945266724,444.587646484375,1e-05,0.06311915814876556,2.3454275131225586,23.927850246429443,1 +7043,0.08302566409111023,0.12433963268995285,0.11868531256914139,0.28708332777023315,784.2772827148438,1e-05,0.07837671041488647,2.35316801071167,23.927850246429443,1 +7044,0.15929166972637177,0.13347099721431732,0.13021352887153625,0.24291665852069855,870.7523803710938,1e-05,0.07695214450359344,2.468250274658203,23.927850246429443,1 +7045,0.21719442307949066,0.11144310981035233,0.11443047225475311,0.22112178802490234,861.318359375,1e-05,0.08674371242523193,2.466383934020996,23.927850246429443,1 +7046,0.12934206426143646,0.08858843147754669,0.09319788962602615,0.179391011595726,845.2072143554688,1e-05,0.06029652804136276,2.4737658500671387,23.927850246429443,1 +7047,0.2591644525527954,0.1967894583940506,0.1856892704963684,0.22903844714164734,886.2048950195312,1e-05,0.07731813937425613,2.3499670028686523,23.927850246429443,1 +7048,0.18041928112506866,0.294218510389328,0.2911011278629303,0.19942307472229004,297.256103515625,1e-05,0.07327524572610855,2.346796751022339,23.927850246429443,1 +7049,0.22703096270561218,0.11387041956186295,0.1140487864613533,0.2499999850988388,491.5048522949219,1e-05,0.06991090625524521,2.3425118923187256,23.927850246429443,1 +7050,0.15207651257514954,0.16003236174583435,0.1543644368648529,0.1623397320508957,977.787353515625,1e-05,0.0714966207742691,2.460291862487793,23.927850246429443,1 +7051,0.2087465077638626,0.12721949815750122,0.12837201356887817,0.15772435069084167,847.8120727539062,1e-05,0.0782388299703598,2.4703638553619385,23.927850246429443,1 +7052,0.1485300362110138,0.1405419260263443,0.1308916062116623,0.15233974158763885,728.2971801757812,1e-05,0.08105365186929703,2.3602092266082764,23.927850246429443,1 +7053,0.2130620777606964,0.15377521514892578,0.15161623060703278,0.22519229352474213,851.403076171875,1e-05,0.06754520535469055,2.344676971435547,23.927850246429443,1 +7054,0.24945291876792908,0.22158077359199524,0.21944548189640045,0.2520512640476227,538.1549072265625,1e-05,0.07336873561143875,2.346425771713257,23.927850246429443,1 +7055,0.22468283772468567,0.0647943913936615,0.07113789021968842,0.10516025125980377,749.19873046875,1e-05,0.07639943063259125,2.515733480453491,23.927850246429443,1 +7056,0.30732062458992004,0.26336348056793213,0.2617882788181305,0.132339745759964,412.1983947753906,1e-05,0.06995106488466263,2.593676805496216,23.927850246429443,1 +7057,0.1732460856437683,0.18403948843479156,0.17695412039756775,0.17961537837982178,665.8878784179688,1e-05,0.07541663199663162,2.4751768112182617,23.927850246429443,1 +7058,0.25696438550949097,0.20419242978096008,0.19464008510112762,0.17378205060958862,577.95703125,1e-05,0.08046078681945801,2.3463752269744873,23.927850246429443,1 +7059,0.2251843363046646,0.19875526428222656,0.19199508428573608,0.2353525608778,807.9915161132812,1e-05,0.0702110007405281,2.347187042236328,23.927850246429443,1 +7060,0.2703201472759247,0.17047612369060516,0.17082571983337402,0.20983973145484924,487.8049011230469,1e-05,0.07474034279584885,2.3410918712615967,23.927850246429443,1 +7061,0.15552350878715515,0.12011352181434631,0.1217447891831398,0.11233974248170853,875.2998046875,1e-05,0.06611055135726929,2.567617177963257,23.927850246429443,1 +7062,0.17167110741138458,0.2899637222290039,0.2832578420639038,0.27032050490379333,945.7156982421875,1e-05,0.06358601152896881,2.5740537643432617,23.927850246429443,1 +7063,0.2710942029953003,0.18203110992908478,0.18848033249378204,0.14570511877536774,431.9371643066406,1e-05,0.07759209722280502,2.350600242614746,23.927850246429443,1 +7064,0.25165891647338867,0.2469489872455597,0.22632065415382385,0.2383333295583725,978.0244140625,1e-05,0.07151089608669281,2.347991943359375,23.927850246429443,1 +7065,0.21933144330978394,0.26751047372817993,0.27456262707710266,0.14205127954483032,225.4098358154297,1e-05,0.06384347379207611,2.460984468460083,23.927850246429443,1 +7066,0.14085587859153748,0.17821095883846283,0.17780724167823792,0.21666665375232697,717.632080078125,1e-05,0.06417230516672134,2.488870859146118,23.927850246429443,1 +7067,0.2998257279396057,0.18832765519618988,0.1841365396976471,0.20740383863449097,575.0540771484375,1e-05,0.06826434284448624,2.694230556488037,23.927850246429443,1 +7068,0.27225974202156067,0.1592264622449875,0.1574554741382599,0.2520192265510559,618.6868286132812,1e-05,0.06589174270629883,2.355350971221924,23.927850246429443,1 +7069,0.24709779024124146,0.09037463366985321,0.09568165987730026,0.13269230723381042,705.574951171875,1e-05,0.05628781393170357,2.346454381942749,23.927850246429443,1 +7070,0.14916503429412842,0.2106824666261673,0.19704191386699677,0.21657051146030426,629.9603271484375,1e-05,0.07073093950748444,2.3453004360198975,23.927850246429443,1 +7071,0.12899364531040192,0.07300925254821777,0.07516898214817047,0.0950961485505104,782.1857299804688,1e-05,0.06219206750392914,2.34440016746521,23.927850246429443,1 +7072,0.1967584788799286,0.14245964586734772,0.14499548077583313,0.2711217701435089,940.900146484375,1e-05,0.06189815327525139,2.5244829654693604,23.927850246429443,1 +7073,0.21743632853031158,0.12055017799139023,0.12978136539459229,0.16942307353019714,928.4979858398438,1e-05,0.076426200568676,2.468376398086548,23.927850246429443,1 +7074,0.2410840094089508,0.16860225796699524,0.16860824823379517,0.24698716402053833,792.4597778320312,1e-05,0.07159563153982162,2.3474619388580322,23.927850246429443,1 +7075,0.17878957092761993,0.26597535610198975,0.26592764258384705,0.22275640070438385,969.4793090820312,1e-05,0.0700371116399765,2.342979907989502,23.927850246429443,1 +7076,0.17782533168792725,0.18274082243442535,0.18447190523147583,0.2803846001625061,523.2557983398438,1e-05,0.09283149242401123,2.5742459297180176,23.927850246429443,1 +7077,0.210481658577919,0.12190006673336029,0.11847750842571259,0.24096153676509857,929.1580810546875,1e-05,0.07433489710092545,2.4618911743164062,23.927850246429443,1 +7078,0.16173909604549408,0.168120875954628,0.16306792199611664,0.2167307585477829,725.671142578125,1e-05,0.0723503977060318,2.463320016860962,23.927850246429443,1 +7079,0.17582763731479645,0.2712898254394531,0.2648216784000397,0.22496794164180756,988.4937133789062,1e-05,0.07925623655319214,2.363004446029663,23.927850246429443,1 +7080,0.22977513074874878,0.2602170705795288,0.2591612935066223,0.22583332657814026,982.4486694335938,1e-05,0.07008768618106842,2.345276355743408,23.927850246429443,1 +7081,0.08800005167722702,0.29828891158103943,0.28509244322776794,0.22073717415332794,966.6818237304688,1e-05,0.06498529016971588,2.3450448513031006,23.927850246429443,1 +7082,0.22137416899204254,0.3388107717037201,0.3335726857185364,0.2316666543483734,987.174072265625,1e-05,0.08860274404287338,2.3476223945617676,23.927850246429443,1 +7083,0.11812436580657959,0.2263554036617279,0.22891618311405182,0.21416665613651276,976.1173706054688,1e-05,0.07417011260986328,2.568652391433716,23.927850246429443,1 +7084,0.20358218252658844,0.166117861866951,0.1670006513595581,0.08070512861013412,547.7528686523438,1e-05,0.0600937157869339,2.6169769763946533,23.927850246429443,1 +7085,0.22864454984664917,0.3588791787624359,0.3627711534500122,0.2660897374153137,261.0759582519531,1e-05,0.06685774028301239,2.3505187034606934,23.927850246429443,1 +7086,0.2411869317293167,0.3111307919025421,0.30477145314216614,0.1883653849363327,958.7605590820312,1e-05,0.0874791070818901,2.3518686294555664,23.927850246429443,1 +7087,0.2928173243999481,0.18276195228099823,0.16818809509277344,0.2654487192630768,846.2532348632812,1e-05,0.07624603807926178,2.546973466873169,23.927850246429443,1 +7088,0.26763612031936646,0.09646739810705185,0.09137405455112457,0.09666666388511658,964.0897216796875,1e-05,0.06379816681146622,2.4883859157562256,23.927850246429443,1 +7089,0.2284759283065796,0.13358795642852783,0.13126613199710846,0.2108333259820938,766.25390625,1e-05,0.08004985004663467,2.6008927822113037,23.927850246429443,1 +7090,0.2279830276966095,0.2248643934726715,0.219600647687912,0.16679486632347107,828.2725830078125,1e-05,0.09462851285934448,2.3635916709899902,23.927850246429443,1 +7091,0.24409574270248413,0.1851716786623001,0.17578676342964172,0.14740383625030518,521.561767578125,1e-05,0.06949897110462189,2.357503890991211,23.927850246429443,1 +7092,0.26673781871795654,0.6098982691764832,0.6149176359176636,0.1557692289352417,70.75472259521484,1e-05,0.06894061714410782,2.354382038116455,23.927850246429443,1 +7093,0.1405671238899231,0.15724603831768036,0.16147448122501373,0.11548076570034027,978.9678955078125,1e-05,0.07391361147165298,2.4784021377563477,23.927850246429443,1 +7094,0.124493308365345,0.13830547034740448,0.12783943116664886,0.22612178325653076,856.4231567382812,1e-05,0.10303203761577606,2.5342626571655273,23.927850246429443,1 +7095,0.15948598086833954,0.23135565221309662,0.23311786353588104,0.22826921939849854,994.2716674804688,1e-05,0.07642120122909546,2.3610503673553467,23.927850246429443,1 +7096,0.1520213484764099,0.27971693873405457,0.2666832208633423,0.20676280558109283,822.50341796875,1e-05,0.06934341788291931,2.3502309322357178,23.927850246429443,1 +7097,0.18468621373176575,0.29022446274757385,0.30003684759140015,0.19711537659168243,444.587646484375,1e-05,0.0733737051486969,2.5787525177001953,23.927850246429443,1 +7098,0.24381551146507263,0.1519957035779953,0.1491919755935669,0.2499999850988388,861.80126953125,1e-05,0.07775434851646423,2.7565701007843018,23.927850246429443,1 +7099,0.2505331337451935,0.1554345041513443,0.16335062682628632,0.27407050132751465,952.3810424804688,1e-05,0.07700063288211823,2.4814207553863525,23.927850246429443,1 +7100,0.21467018127441406,0.25677332282066345,0.2578042447566986,0.19746793806552887,987.174072265625,1e-05,0.06527093052864075,2.3570990562438965,23.927850246429443,1 +7101,0.2090436816215515,0.20767952501773834,0.20800650119781494,0.16365383565425873,673.4317626953125,1e-05,0.07624316960573196,2.3453078269958496,23.927850246429443,1 +7102,0.21566851437091827,0.16923347115516663,0.16749651730060577,0.2934294641017914,877.9761962890625,1e-05,0.07018470019102097,2.3462600708007812,23.927850246429443,1 +7103,0.2804737389087677,0.1940767467021942,0.18849033117294312,0.19326922297477722,653.6259765625,1e-05,0.07404020428657532,2.3451108932495117,23.927850246429443,1 +7104,0.23764842748641968,0.20000280439853668,0.19852158427238464,0.2700640857219696,954.6314086914062,1e-05,0.07086890190839767,2.4737699031829834,23.927850246429443,1 +7105,0.1697319746017456,0.3141162693500519,0.30864232778549194,0.2058333307504654,666.9776611328125,1e-05,0.07127238810062408,2.4902124404907227,23.927850246429443,1 +7106,0.2697153687477112,0.1954982429742813,0.19767853617668152,0.2557692229747772,622.4899291992188,1e-05,0.08042213320732117,2.340029716491699,23.927850246429443,1 +7107,0.1634306013584137,0.17854729294776917,0.20318317413330078,0.21400640904903412,425.4617614746094,1e-05,0.05753267928957939,2.4630887508392334,23.927850246429443,1 +7108,0.11892380565404892,0.08250242471694946,0.08729828149080276,0.1648397445678711,898.4814453125,1e-05,0.062413718551397324,2.4911487102508545,23.927850246429443,1 +7109,0.15982456505298615,0.19408465921878815,0.19259990751743317,0.16817307472229004,883.2159423828125,1e-05,0.06595735996961594,2.484015703201294,23.927850246429443,1 +7110,0.10399378091096878,0.11900299787521362,0.11075349897146225,0.2482692152261734,876.6427001953125,1e-05,0.07200559973716736,2.5838875770568848,23.927850246429443,1 +7111,0.2314937561750412,0.08717384934425354,0.0853472575545311,0.11262819916009903,854.930419921875,1e-05,0.061294075101614,2.3437280654907227,23.927850246429443,1 +7112,0.132207989692688,0.1537962555885315,0.14380162954330444,0.2140384465456009,965.9091796875,1e-05,0.06918132305145264,2.3463785648345947,23.927850246429443,1 +7113,0.26550421118736267,0.24953612685203552,0.2510584592819214,0.24891024827957153,440.41455078125,1e-05,0.0737449899315834,2.3448703289031982,23.927850246429443,1 +7114,0.16618283092975616,0.17279750108718872,0.16962270438671112,0.17596153914928436,977.3124389648438,1e-05,0.055095769464969635,2.47929310798645,23.927850246429443,1 +7115,0.2812498211860657,0.11171074211597443,0.10364226251840591,0.23278845846652985,926.5010375976562,1e-05,0.0748223066329956,2.469251871109009,23.927850246429443,1 +7116,0.2192814201116562,0.21125219762325287,0.2169896960258484,0.2497115284204483,700.7908935546875,1e-05,0.06424549221992493,2.3586504459381104,23.927850246429443,1 +7117,0.22613850235939026,0.3047814965248108,0.2989444434642792,0.2430448681116104,993.2210693359375,1e-05,0.06686073541641235,2.348173141479492,23.927850246429443,1 +7118,0.22097554802894592,0.19252192974090576,0.19900119304656982,0.22865383327007294,961.1829223632812,1e-05,0.08549127727746964,2.5762417316436768,23.927850246429443,1 +7119,0.22649383544921875,0.1989438682794571,0.1984492391347885,0.3146474361419678,610.940673828125,1e-05,0.0775383859872818,2.4721004962921143,23.927850246429443,1 +7120,0.17472869157791138,0.13786792755126953,0.14042891561985016,0.1828846037387848,763.2398681640625,1e-05,0.06893674284219742,2.5913290977478027,23.927850246429443,1 +7121,0.30188339948654175,0.1966356784105301,0.19554273784160614,0.2528845965862274,446.65814208984375,1e-05,0.07374639809131622,2.486910104751587,23.927850246429443,1 +7122,0.15043982863426208,0.1728319674730301,0.17156611382961273,0.24862179160118103,739.3790893554688,1e-05,0.06834518909454346,2.3567779064178467,23.927850246429443,1 +7123,0.1391393393278122,0.14493782818317413,0.14380089938640594,0.23288460075855255,907.3464965820312,1e-05,0.07226065546274185,2.3500847816467285,23.927850246429443,1 +7124,0.1582922637462616,0.2842670977115631,0.2905522286891937,0.18589742481708527,984.494384765625,1e-05,0.06709993630647659,2.349093198776245,23.927850246429443,1 +7125,0.14203278720378876,0.33161526918411255,0.3192763328552246,0.22650639712810516,989.148681640625,1e-05,0.07193263620138168,2.4654901027679443,23.927850246429443,1 +7126,0.13826577365398407,0.16300135850906372,0.16874201595783234,0.1800640970468521,889.9769897460938,1e-05,0.0670735165476799,2.5730628967285156,23.927850246429443,1 +7127,0.13507559895515442,0.09511110931634903,0.09276824444532394,0.24301281571388245,940.900146484375,1e-05,0.0695338249206543,2.3601534366607666,23.927850246429443,1 +7128,0.13972626626491547,0.17420947551727295,0.16689901053905487,0.29326921701431274,868.4371337890625,1e-05,0.06720432639122009,2.3454577922821045,23.927850246429443,1 +7129,0.14883452653884888,0.16607369482517242,0.15778382122516632,0.189423069357872,824.2506713867188,1e-05,0.07370389997959137,2.6353821754455566,23.927850246429443,1 +7130,0.3039805293083191,0.33018386363983154,0.332381933927536,0.23846152424812317,276.479736328125,1e-05,0.06876781582832336,2.4754438400268555,23.927850246429443,1 +7131,0.20626091957092285,0.2441936433315277,0.25762611627578735,0.13480769097805023,978.4969482421875,1e-05,0.0868225172162056,2.5477867126464844,23.927850246429443,1 +7132,0.23724383115768433,0.2713017463684082,0.27002713084220886,0.21900640428066254,482.1867370605469,1e-05,0.06976109743118286,2.3576714992523193,23.927850246429443,1 +7133,0.2460089474916458,0.31390368938446045,0.30367979407310486,0.22980768978595734,941.8146362304688,1e-05,0.07045229524374008,2.3460071086883545,23.927850246429443,1 +7134,0.27141326665878296,0.18562734127044678,0.18232937157154083,0.2628205120563507,617.4088745117188,1e-05,0.07342937588691711,2.3448121547698975,23.927850246429443,1 +7135,0.2652893662452698,0.23903360962867737,0.23281612992286682,0.23782050609588623,926.8355712890625,1e-05,0.06383431702852249,2.4569365978240967,23.927850246429443,1 +7136,0.238051638007164,0.23963113129138947,0.24337393045425415,0.10092948377132416,988.4937133789062,1e-05,0.07740543782711029,2.346066951751709,23.927850246429443,1 +7137,0.12840892374515533,0.2534680962562561,0.2546776533126831,0.24910254776477814,973.6957397460938,1e-05,0.06211230158805847,2.544292449951172,23.927850246429443,1 +7138,0.24560271203517914,0.1575993001461029,0.15431368350982666,0.226666659116745,987.3948974609375,1e-05,0.07157637923955917,2.3476085662841797,23.927850246429443,1 +7139,0.1314975917339325,0.1482401341199875,0.15188826620578766,0.2614102363586426,546.1712036132812,1e-05,0.06155025213956833,2.5089271068573,23.927850246429443,1 +7140,0.21704763174057007,0.24461908638477325,0.23928259313106537,0.23448717594146729,773.6281127929688,1e-05,0.06692882627248764,2.4609673023223877,23.927850246429443,1 +7141,0.13466304540634155,0.19808031618595123,0.1903378665447235,0.24676281213760376,977.3124389648438,1e-05,0.0788249745965004,2.5629518032073975,23.927850246429443,1 +7142,0.2136344313621521,0.14782065153121948,0.13886946439743042,0.15407051146030426,646.7181396484375,1e-05,0.0807671844959259,2.496580123901367,23.927850246429443,1 +7143,0.13997197151184082,0.40757590532302856,0.3880740702152252,0.29471153020858765,992.7984008789062,1e-05,0.056230220943689346,2.3467133045196533,23.927850246429443,1 +7144,0.25953730940818787,0.4914233386516571,0.5126376152038574,0.24746793508529663,92.59259796142578,1e-05,0.0840395912528038,2.3485982418060303,23.927850246429443,1 +7145,0.2042163759469986,0.2125653475522995,0.20404820144176483,0.27955126762390137,949.5192260742188,1e-05,0.08193115890026093,2.348249912261963,23.927850246429443,1 +7146,0.20500794053077698,0.1602773815393448,0.16116632521152496,0.21753203868865967,742.69482421875,1e-05,0.06357806921005249,2.5513930320739746,23.927850246429443,1 +7147,0.16212710738182068,0.23187340795993805,0.2298748642206192,0.21612179279327393,985.8411254882812,1e-05,0.07236713916063309,2.451615571975708,23.927850246429443,1 +7148,0.2571100890636444,0.42109712958335876,0.4299476146697998,0.24342948198318481,204.84951782226562,1e-05,0.07933341711759567,2.357283592224121,23.927850246429443,1 +7149,0.18737198412418365,0.16994483768939972,0.16734911501407623,0.14586538076400757,759.419189453125,1e-05,0.07587127387523651,2.3476388454437256,23.927850246429443,1 +7150,0.13556939363479614,0.1926463097333908,0.2006206214427948,0.2601282000541687,981.5291137695312,1e-05,0.06559740751981735,2.4902567863464355,23.927850246429443,1 +7151,0.20071855187416077,0.20862558484077454,0.21599186956882477,0.2384294718503952,558.6282348632812,1e-05,0.06008860468864441,2.3555986881256104,23.927850246429443,1 +7152,0.17837972939014435,0.2374018281698227,0.23059077560901642,0.21105767786502838,906.9703979492188,1e-05,0.06639805436134338,2.4859657287597656,23.927850246429443,1 +7153,0.22472414374351501,0.16282020509243011,0.16399861872196198,0.21583332121372223,825.9837646484375,1e-05,0.10047029703855515,2.3522608280181885,23.927850246429443,1 +7154,0.16444949805736542,0.2261698693037033,0.21912534534931183,0.20769229531288147,893.2648315429688,1e-05,0.06893262267112732,2.3519115447998047,23.927850246429443,1 +7155,0.17263163626194,0.30506542325019836,0.29193225502967834,0.2699679434299469,981.7597045898438,1e-05,0.06887461990118027,2.3466849327087402,23.927850246429443,1 +7156,0.31035301089286804,0.2421271950006485,0.25216442346572876,0.12054486572742462,288.4615478515625,1e-05,0.09609404951334,2.4688057899475098,23.927850246429443,1 +7157,0.26120057702064514,0.17665183544158936,0.1873806267976761,0.19243589043617249,978.9678955078125,1e-05,0.06771203875541687,2.354085683822632,23.927850246429443,1 +7158,0.10755113512277603,0.20999766886234283,0.19792504608631134,0.2294551134109497,833.3333129882812,1e-05,0.0747247114777565,2.4809000492095947,23.927850246429443,1 +7159,0.22216150164604187,0.2927209436893463,0.2818221151828766,0.24621793627738953,957.6707763671875,1e-05,0.06082028150558472,2.3540098667144775,23.927850246429443,1 +7160,0.24308092892169952,0.4428068697452545,0.4502447545528412,0.2990064024925232,238.6731414794922,1e-05,0.06159394606947899,2.348576068878174,23.927850246429443,1 +7161,0.13056476414203644,0.23997355997562408,0.22662384808063507,0.28967946767807007,949.8078002929688,1e-05,0.06671634316444397,2.6037895679473877,23.927850246429443,1 +7162,0.14726629853248596,0.11649905145168304,0.1157190278172493,0.2656089663505554,823.6697998046875,1e-05,0.07092943042516708,2.5004451274871826,23.927850246429443,1 +7163,0.14479097723960876,0.17859232425689697,0.18322180211544037,0.20499999821186066,686.9369506835938,1e-05,0.06653361767530441,2.504953384399414,23.927850246429443,1 +7164,0.18966399133205414,0.14743441343307495,0.14469456672668457,0.22282050549983978,850.8939819335938,1e-05,0.06772991269826889,2.3521769046783447,23.927850246429443,1 +7165,0.2248609960079193,0.21647250652313232,0.20975874364376068,0.25083333253860474,516.4320068359375,1e-05,0.06988808512687683,2.3420004844665527,23.927850246429443,1 +7166,0.24037937819957733,0.11023540049791336,0.1127026155591011,0.09624999761581421,677.6557006835938,1e-05,0.08332609385251999,2.345850706100464,23.927850246429443,1 +7167,0.16225562989711761,0.23570534586906433,0.2471349835395813,0.20067307353019714,979.6713256835938,1e-05,0.06269365549087524,2.481809377670288,23.927850246429443,1 +7168,0.2131924331188202,0.19710104167461395,0.18263761699199677,0.2499999850988388,950.3834838867188,1e-05,0.07176971435546875,2.3480262756347656,23.927850246429443,1 +7169,0.18428432941436768,0.2655230164527893,0.2528708577156067,0.22275640070438385,978.4969482421875,1e-05,0.07127837836742401,2.4738688468933105,23.927850246429443,1 +7170,0.23684582114219666,0.30757468938827515,0.311680406332016,0.1923397332429886,698.8536376953125,1e-05,0.06864999234676361,2.348068952560425,23.927850246429443,1 +7171,0.20985066890716553,0.12011965364217758,0.11851412057876587,0.24666665494441986,881.0508422851562,1e-05,0.07164177298545837,2.4752557277679443,23.927850246429443,1 +7172,0.21460866928100586,0.1681487262248993,0.1672539860010147,0.13846153020858765,664.7939453125,1e-05,0.07342007011175156,2.355342388153076,23.927850246429443,1 +7173,0.1387820541858673,0.1733914166688919,0.16787371039390564,0.24105767905712128,936.5596923828125,1e-05,0.06519558280706406,2.695793390274048,23.927850246429443,1 +7174,0.16736029088497162,0.14230851829051971,0.15902432799339294,0.2683012783527374,974.9119873046875,1e-05,0.07017601281404495,2.357875108718872,23.927850246429443,1 +7175,0.2252689152956009,0.13381671905517578,0.1290467232465744,0.19948717951774597,905.4575805664062,1e-05,0.06604599207639694,2.347200870513916,23.927850246429443,1 +7176,0.18181395530700684,0.12571761012077332,0.1299324929714203,0.2661217749118805,736.8637084960938,1e-05,0.06796056777238846,2.3420937061309814,23.927850246429443,1 +7177,0.1797083616256714,0.12046130001544952,0.1329156905412674,0.2482692152261734,864.197509765625,1e-05,0.06206567585468292,2.345017433166504,23.927850246429443,1 +7178,0.18546681106090546,0.28733620047569275,0.2852702736854553,0.17884615063667297,926.8355712890625,1e-05,0.06681130826473236,2.468402147293091,23.927850246429443,1 +7179,0.27943626046180725,0.19797781109809875,0.19407831132411957,0.2138461470603943,787.0369873046875,1e-05,0.08018217980861664,2.3530588150024414,23.927850246429443,1 +7180,0.20575082302093506,0.17395205795764923,0.175888329744339,0.13730768859386444,557.0953369140625,1e-05,0.06179901957511902,2.511045455932617,23.927850246429443,1 +7181,0.14269332587718964,0.19725260138511658,0.18178413808345795,0.2241666615009308,924.4791870117188,1e-05,0.05702308937907219,2.3511486053466797,23.927850246429443,1 +7182,0.22142620384693146,0.18062646687030792,0.17195412516593933,0.244615375995636,793.128662109375,1e-05,0.09751886874437332,2.456775426864624,23.927850246429443,1 +7183,0.24470217525959015,0.06838474422693253,0.07506975531578064,0.11983974277973175,692.9590454101562,1e-05,0.05152246356010437,2.352506160736084,23.927850246429443,1 +7184,0.20536555349826813,0.2973718047142029,0.30176398158073425,0.20999999344348907,496.98797607421875,1e-05,0.0704181119799614,2.465593099594116,23.927850246429443,1 +7185,0.15833671391010284,0.45383161306381226,0.46804821491241455,0.17923076450824738,125.89928436279297,1e-05,0.06893117725849152,2.357935905456543,23.927850246429443,1 +7186,0.1958460509777069,0.1410796344280243,0.14014960825443268,0.20019230246543884,657.0208740234375,1e-05,0.07048534601926804,2.353510618209839,23.927850246429443,1 +7187,0.2783716320991516,0.2563471794128418,0.26554492115974426,0.23749999701976776,330.88238525390625,1e-05,0.08210952579975128,2.3557512760162354,23.927850246429443,1 +7188,0.27968332171440125,0.15018120408058167,0.14963719248771667,0.2941987216472626,690.9660034179688,1e-05,0.06661008298397064,2.4563357830047607,23.927850246429443,1 +7189,0.3478297293186188,0.1568644791841507,0.15099789202213287,0.27955126762390137,847.8120727539062,1e-05,0.0856495201587677,2.3658218383789062,23.927850246429443,1 +7190,0.14864487946033478,0.1077880859375,0.11396816372871399,0.2613140940666199,861.80126953125,1e-05,0.0708044096827507,2.473992109298706,23.927850246429443,1 +7191,0.3410720229148865,0.7515372037887573,0.7481945157051086,0.22528845071792603,79.58802795410156,1e-05,0.07942983508110046,2.361783504486084,23.927850246429443,1 +7192,0.23033876717090607,0.21347327530384064,0.20373061299324036,0.2380448579788208,817.7731323242188,1e-05,0.06386100500822067,2.5415215492248535,23.927850246429443,1 +7193,0.2590421736240387,0.2455292046070099,0.2443845272064209,0.22807691991329193,448.71795654296875,1e-05,0.0701276957988739,2.3560662269592285,23.927850246429443,1 +7194,0.2026837170124054,0.20200617611408234,0.19705402851104736,0.25070512294769287,536.5296630859375,1e-05,0.07449998706579208,2.4951119422912598,23.927850246429443,1 +7195,0.24082213640213013,0.3305758535861969,0.3301037549972534,0.22826921939849854,398.5013732910156,1e-05,0.07895231246948242,2.5911355018615723,23.927850246429443,1 +7196,0.21299545466899872,0.134149432182312,0.13360758125782013,0.2004166543483734,693.9501953125,1e-05,0.08153816312551498,2.350728750228882,23.927850246429443,1 +7197,0.23534023761749268,0.1994851529598236,0.19463972747325897,0.23576922714710236,645.55126953125,1e-05,0.07759397476911545,2.349931478500366,23.927850246429443,1 +7198,0.1599329710006714,0.26102954149246216,0.239796981215477,0.3042948544025421,895.2894897460938,1e-05,0.07675796002149582,2.3496487140655518,23.927850246429443,1 +7199,0.25036320090293884,0.22213143110275269,0.24370723962783813,0.18541665375232697,466.7919921875,1e-05,0.08268741518259048,2.479668378829956,23.927850246429443,1 +7200,0.3685905635356903,0.3707912564277649,0.36928775906562805,0.25862178206443787,330.88238525390625,1e-05,0.09904341399669647,2.3497536182403564,23.927850246429443,1 +7201,0.17253467440605164,0.18071924149990082,0.16837266087532043,0.2487499862909317,898.8763427734375,1e-05,0.07209467142820358,2.5809340476989746,23.927850246429443,1 +7202,0.16373717784881592,0.1725798100233078,0.167550727725029,0.3049038350582123,592.105224609375,1e-05,0.08000610768795013,2.350497245788574,23.927850246429443,1 +7203,0.11773449927568436,0.1295909434556961,0.1267051100730896,0.09721153229475021,863.2425537109375,1e-05,0.06924065202474594,2.4566409587860107,23.927850246429443,1 +7204,0.21614223718643188,0.2759876549243927,0.2699483036994934,0.27310895919799805,685.9205932617188,1e-05,0.06974419951438904,2.566563606262207,23.927850246429443,1 +7205,0.21641859412193298,0.12790334224700928,0.13566508889198303,0.20778845250606537,587.923828125,1e-05,0.08939257264137268,2.477224588394165,23.927850246429443,1 +7206,0.22862571477890015,0.1215728372335434,0.13721150159835815,0.1452564001083374,982.9059448242188,1e-05,0.06871714442968369,2.355926513671875,23.927850246429443,1 +7207,0.25834929943084717,0.10550455749034882,0.10428523272275925,0.2820192277431488,850.3836669921875,1e-05,0.11127099394798279,2.3435208797454834,23.927850246429443,1 +7208,0.22052158415317535,0.17560772597789764,0.1719399243593216,0.2527243494987488,593.4874267578125,1e-05,0.08422698080539703,2.346104621887207,23.927850246429443,1 +7209,0.20458054542541504,0.17854058742523193,0.18179361522197723,0.23865383863449097,916.1324462890625,1e-05,0.07151524722576141,2.3494458198547363,23.927850246429443,1 +7210,0.2897374927997589,0.17537230253219604,0.18594864010810852,0.1548076868057251,983.5890502929688,1e-05,0.09017866104841232,2.4612295627593994,23.927850246429443,1 +7211,0.1730537861585617,0.26634880900382996,0.2605839967727661,0.11060897260904312,968.468505859375,1e-05,0.08346779644489288,2.3559956550598145,23.927850246429443,1 +7212,0.14131733775138855,0.20461244881153107,0.21140211820602417,0.23897434771060944,994.0623168945312,1e-05,0.107460618019104,2.467472553253174,23.927850246429443,1 +7213,0.23654384911060333,0.19287632405757904,0.18209777772426605,0.2199999988079071,891.62841796875,1e-05,0.08330146223306656,2.4877753257751465,23.927850246429443,1 +7214,0.0747402012348175,0.34299787878990173,0.33514314889907837,0.23666666448116302,996.9635620117188,1e-05,0.06942731887102127,2.3512461185455322,23.927850246429443,1 +7215,0.20614324510097504,0.3366445004940033,0.33280232548713684,0.22243589162826538,364.73089599609375,1e-05,0.0795101523399353,2.478156805038452,23.927850246429443,1 +7216,0.18889319896697998,0.26334232091903687,0.27289631962776184,0.21112178266048431,248.39744567871094,1e-05,0.09026718884706497,2.591646194458008,23.927850246429443,1 +7217,0.18884395062923431,0.257874459028244,0.24537108838558197,0.22612178325653076,978.2608642578125,1e-05,0.07642465829849243,2.3473970890045166,23.927850246429443,1 +7218,0.19388166069984436,0.21576637029647827,0.21649180352687836,0.23608973622322083,986.2869873046875,1e-05,0.07002899050712585,2.352978467941284,23.927850246429443,1 +7219,0.24458467960357666,0.14334605634212494,0.14653588831424713,0.24205127358436584,780.0751953125,1e-05,0.08927597105503082,2.34531569480896,23.927850246429443,1 +7220,0.1915094256401062,0.20447716116905212,0.21606720983982086,0.1782371699810028,652.4856567382812,1e-05,0.09929933398962021,2.343535900115967,23.927850246429443,1 +7221,0.1694539189338684,0.3360055088996887,0.3230080008506775,0.13653846085071564,986.50927734375,1e-05,0.07729468494653702,2.47795033454895,23.927850246429443,1 +7222,0.24747106432914734,0.1539531797170639,0.1533791571855545,0.10907050967216492,750.0000610351562,1e-05,0.0832953155040741,2.3522305488586426,23.927850246429443,1 +7223,0.22551943361759186,0.2715744376182556,0.2503858506679535,0.23330126702785492,760.95458984375,1e-05,0.08264389634132385,2.8154757022857666,23.927850246429443,1 +7224,0.3231886625289917,0.17815887928009033,0.17640449106693268,0.2547435760498047,531.6091918945312,1e-05,0.08245338499546051,2.542999029159546,23.927850246429443,1 +7225,0.40361130237579346,0.4578647017478943,0.4470006227493286,0.1988781988620758,273.4375,1e-05,0.0729936957359314,2.362626791000366,23.927850246429443,1 +7226,0.15746918320655823,0.18634437024593353,0.17860184609889984,0.21637819707393646,860.8343505859375,1e-05,0.066375732421875,2.5903446674346924,23.927850246429443,1 +7227,0.2400626838207245,0.20957456529140472,0.21389305591583252,0.21211537718772888,962.2467651367188,1e-05,0.08973244577646255,2.4879024028778076,23.927850246429443,1 +7228,0.14378264546394348,0.20003612339496613,0.19475005567073822,0.14608973264694214,827.1312866210938,1e-05,0.09752364456653595,2.360692024230957,23.927850246429443,1 +7229,0.17828546464443207,0.2396850883960724,0.23652143776416779,0.20628204941749573,953.2288818359375,1e-05,0.07375591993331909,2.357489585876465,23.927850246429443,1 +7230,0.1861153393983841,0.11055953055620193,0.11409295350313187,0.1771794855594635,682.8494262695312,1e-05,0.06499120593070984,2.3533689975738525,23.927850246429443,1 +7231,0.20647475123405457,0.11117610335350037,0.12065481394529343,0.13076922297477722,619.959716796875,1e-05,0.07636076956987381,2.3529276847839355,23.927850246429443,1 +7232,0.2508964538574219,0.8043848276138306,0.8099493384361267,0.2614743411540985,61.78706741333008,1e-05,0.0982540175318718,2.472459554672241,23.927850246429443,1 +7233,0.27574387192726135,0.16156525909900665,0.1547994762659073,0.24445511400699615,673.4317626953125,1e-05,0.07278787344694138,2.519794464111328,23.927850246429443,1 +7234,0.1444365680217743,0.194294735789299,0.17886772751808167,0.2051602452993393,856.9182739257812,1e-05,0.07385096698999405,2.46577525138855,23.927850246429443,1 +7235,0.0971788763999939,0.2320512980222702,0.23307763040065765,0.22525639832019806,994.0623168945312,1e-05,0.06066575273871422,2.3573801517486572,23.927850246429443,1 +7236,0.26012513041496277,0.18780457973480225,0.1849478781223297,0.16807691752910614,647.8805541992188,1e-05,0.08644868433475494,2.4704318046569824,23.927850246429443,1 +7237,0.1904861032962799,0.151497483253479,0.14714950323104858,0.24272434413433075,808.6157836914062,1e-05,0.07176217436790466,2.5339386463165283,23.927850246429443,1 +7238,0.25652480125427246,0.2585790157318115,0.25112593173980713,0.2719230651855469,663.6961059570312,1e-05,0.07825731486082077,2.3576669692993164,23.927850246429443,1 +7239,0.17417550086975098,0.21641583740711212,0.20625926554203033,0.27820512652397156,967.4503784179688,1e-05,0.0691126361489296,2.351917028427124,23.927850246429443,1 +7240,0.22429132461547852,0.16675519943237305,0.15825702250003815,0.19679486751556396,685.9205932617188,1e-05,0.07307743281126022,2.3514389991760254,23.927850246429443,1 +7241,0.23228611052036285,0.16202673316001892,0.1561506986618042,0.22756409645080566,918.259033203125,1e-05,0.08652928471565247,2.3499531745910645,23.927850246429443,1 +7242,0.1507757306098938,0.22855694591999054,0.223328098654747,0.17807692289352417,942.7236938476562,1e-05,0.06364896148443222,2.492993116378784,23.927850246429443,1 +7243,0.3131224513053894,0.2014721930027008,0.20041346549987793,0.25400641560554504,862.7633056640625,1e-05,0.07348146289587021,2.356365919113159,23.927850246429443,1 +7244,0.12002328038215637,0.287715345621109,0.2890014946460724,0.2696794867515564,991.9489135742188,1e-05,0.07962911576032639,2.493879795074463,23.927850246429443,1 +7245,0.2071186900138855,0.21528194844722748,0.2060571014881134,0.18967947363853455,955.188720703125,1e-05,0.0724412202835083,2.6780972480773926,23.927850246429443,1 +7246,0.19980062544345856,0.08074777573347092,0.07524685561656952,0.22003203630447388,688.9586791992188,1e-05,0.07106862217187881,2.355140447616577,23.927850246429443,1 +7247,0.16190358996391296,0.23847168684005737,0.22844254970550537,0.18525640666484833,827.1312866210938,1e-05,0.062176745384931564,2.509922742843628,23.927850246429443,1 +7248,0.21010740101337433,0.22236190736293793,0.23511378467082977,0.15535256266593933,990.448486328125,1e-05,0.06648921966552734,2.4997994899749756,23.927850246429443,1 +7249,0.1383996307849884,0.1671004593372345,0.16058410704135895,0.2625320553779602,903.1631469726562,1e-05,0.06951873749494553,2.349987030029297,23.927850246429443,1 +7250,0.14753612875938416,0.2540234625339508,0.25049734115600586,0.21666665375232697,745.1535034179688,1e-05,0.06209187209606171,2.351266622543335,23.927850246429443,1 +7251,0.1416754126548767,0.06978729367256165,0.066459059715271,0.11528845876455307,796.4441528320312,1e-05,0.06753803789615631,2.3466858863830566,23.927850246429443,1 +7252,0.17525973916053772,0.2139354944229126,0.2164047658443451,0.18060897290706635,871.2120971679688,1e-05,0.08094663918018341,2.350604295730591,23.927850246429443,1 +7253,0.25110146403312683,0.21700875461101532,0.2135857790708542,0.17884615063667297,838.2740478515625,1e-05,0.09073734283447266,2.4993762969970703,23.927850246429443,1 +7254,0.1542491316795349,0.10081379115581512,0.10457904636859894,0.17907050251960754,887.4710083007812,1e-05,0.059367984533309937,2.4609014987945557,23.927850246429443,1 +7255,0.20501354336738586,0.30732375383377075,0.29935145378112793,0.19487178325653076,687.94970703125,1e-05,0.061957426369190216,2.5089480876922607,23.927850246429443,1 +7256,0.22695142030715942,0.18346789479255676,0.18740229308605194,0.22166666388511658,561.674072265625,1e-05,0.0750451311469078,2.3576457500457764,23.927850246429443,1 +7257,0.15021663904190063,0.1388620287179947,0.1362568587064743,0.21249999105930328,678.7020263671875,1e-05,0.06842434406280518,2.48762583732605,23.927850246429443,1 +7258,0.19649948179721832,0.37027493119239807,0.32945334911346436,0.24801281094551086,990.232666015625,1e-05,0.08913582563400269,2.3601460456848145,23.927850246429443,1 +7259,0.18926140666007996,0.23788169026374817,0.239310160279274,0.16756409406661987,418.88299560546875,1e-05,0.06896640360355377,2.355315923690796,23.927850246429443,1 +7260,0.16971978545188904,0.20450955629348755,0.20463967323303223,0.1735256314277649,988.2747802734375,1e-05,0.07125163823366165,2.34624981880188,23.927850246429443,1 +7261,0.27260059118270874,0.18674336373806,0.18900273740291595,0.24958331882953644,521.561767578125,1e-05,0.07931019365787506,2.351266860961914,23.927850246429443,1 +7262,0.12625041604042053,0.11043005436658859,0.1051376536488533,0.2357371747493744,839.3560791015625,1e-05,0.05671815946698189,2.344095230102539,23.927850246429443,1 +7263,0.21699382364749908,0.28221482038497925,0.2861679792404175,0.11913461238145828,576.5086669921875,1e-05,0.06927020102739334,2.4961345195770264,23.927850246429443,1 +7264,0.1721196174621582,0.12211368978023529,0.12594926357269287,0.2296474277973175,662.593994140625,1e-05,0.07366683334112167,2.348550319671631,23.927850246429443,1 +7265,0.2193872183561325,0.18039046227931976,0.17470332980155945,0.22865383327007294,794.4606323242188,1e-05,0.06819866597652435,2.560725688934326,23.927850246429443,1 +7266,0.27790775895118713,0.26334089040756226,0.26308029890060425,0.2658974230289459,403.11651611328125,1e-05,0.07947191596031189,2.669661045074463,23.927850246429443,1 +7267,0.21184194087982178,0.5298224687576294,0.5246533751487732,0.2755769193172455,179.79454040527344,1e-05,0.09310494363307953,2.3504858016967773,23.927850246429443,1 +7268,0.29532915353775024,0.47260767221450806,0.4767794609069824,0.1890384554862976,222.03948974609375,1e-05,0.07983505725860596,2.5726590156555176,23.927850246429443,1 +7269,0.12035252153873444,0.21516203880310059,0.20192191004753113,0.24573716521263123,918.9618530273438,1e-05,0.06929566711187363,2.485280752182007,23.927850246429443,1 +7270,0.20656661689281464,0.18933747708797455,0.18946333229541779,0.17512819170951843,745.1535034179688,1e-05,0.06691066175699234,2.3543529510498047,23.927850246429443,1 +7271,0.2193727195262909,0.2155144214630127,0.22090944647789001,0.1835576891899109,484.06866455078125,1e-05,0.079678475856781,2.3499743938446045,23.927850246429443,1 +7272,0.2680620551109314,0.331256628036499,0.3313462436199188,0.2867628037929535,270.376220703125,1e-05,0.07601214945316315,2.3484771251678467,23.927850246429443,1 +7273,0.19860407710075378,0.19596076011657715,0.19344940781593323,0.16477563977241516,824.8300170898438,1e-05,0.06368611752986908,2.3435745239257812,23.927850246429443,1 +7274,0.11998946964740753,0.06739712506532669,0.06871842592954636,0.08855769038200378,891.2169799804688,1e-05,0.06414391100406647,2.604119062423706,23.927850246429443,1 +7275,0.23295152187347412,0.139032244682312,0.13846184313297272,0.25189101696014404,934.3434448242188,1e-05,0.07715913653373718,2.345590353012085,23.927850246429443,1 +7276,0.19202974438667297,0.17632389068603516,0.1710910201072693,0.16544871032238007,873.039794921875,1e-05,0.08594988286495209,2.646587371826172,23.927850246429443,1 +7277,0.1933118999004364,0.12833333015441895,0.12803058326244354,0.24477563798427582,785.6611938476562,1e-05,0.08443643152713776,2.3491592407226562,23.927850246429443,1 +7278,0.2940220832824707,0.13907259702682495,0.13335631787776947,0.28342947363853455,774.3531494140625,1e-05,0.07989877462387085,2.3442208766937256,23.927850246429443,1 +7279,0.19540582597255707,0.12650996446609497,0.13439728319644928,0.21160255372524261,934.6619262695312,1e-05,0.07037666440010071,2.7480010986328125,23.927850246429443,1 +7280,0.189754456281662,0.1382555216550827,0.1447608917951584,0.2659294903278351,813.5474853515625,1e-05,0.07449783384799957,2.3652853965759277,23.927850246429443,1 +7281,0.20103177428245544,0.48333215713500977,0.4806939363479614,0.29817306995391846,999.5994262695312,1e-05,0.059499628841876984,2.3484511375427246,23.927850246429443,1 +7282,0.29031652212142944,0.2872152626514435,0.28151723742485046,0.24243588745594025,386.7403564453125,1e-05,0.07453049719333649,2.3463196754455566,23.927850246429443,1 +7283,0.1978682577610016,0.13985700905323029,0.14531652629375458,0.13833333551883698,873.947021484375,1e-05,0.0845894142985344,2.3458518981933594,23.927850246429443,1 +7284,0.15124207735061646,0.18417640030384064,0.1658635437488556,0.20368589460849762,934.0242309570312,1e-05,0.07179625332355499,2.493847370147705,23.927850246429443,1 +7285,0.1730303019285202,0.19402466714382172,0.19225084781646729,0.2537499964237213,412.1983947753906,1e-05,0.06879337877035141,2.353940486907959,23.927850246429443,1 +7286,0.23002201318740845,0.2735418677330017,0.27018406987190247,0.22749999165534973,400.81524658203125,1e-05,0.06538579612970352,2.4656994342803955,23.927850246429443,1 +7287,0.20201249420642853,0.17616018652915955,0.1732603758573532,0.20198717713356018,867.5030517578125,1e-05,0.07444876432418823,2.587663173675537,23.927850246429443,1 +7288,0.2407207190990448,0.15618468821048737,0.1702709048986435,0.21987178921699524,827.7026977539062,1e-05,0.08167726546525955,2.3605074882507324,23.927850246429443,1 +7289,0.19360123574733734,0.16121602058410645,0.15437184274196625,0.10198717564344406,957.6707763671875,1e-05,0.06865198910236359,2.491696357727051,23.927850246429443,1 +7290,0.17262756824493408,0.13995474576950073,0.1412723958492279,0.21429486572742462,805.4765625,1e-05,0.0661093220114708,2.5051732063293457,23.927850246429443,1 +7291,0.1731410175561905,0.24716877937316895,0.23424799740314484,0.276602566242218,927.5025634765625,1e-05,0.08857318758964539,2.3644309043884277,23.927850246429443,1 +7292,0.33733096718788147,0.3901848793029785,0.38661158084869385,0.1964743584394455,384.3490905761719,1e-05,0.09329500794410706,2.354551076889038,23.927850246429443,1 +7293,0.2954080104827881,0.3679407835006714,0.3622112572193146,0.22775639593601227,498.798095703125,1e-05,0.06387145817279816,2.35685396194458,23.927850246429443,1 +7294,0.2138228863477707,0.2609739899635315,0.25092995166778564,0.2796153724193573,649.0385131835938,1e-05,0.0658860132098198,2.354564666748047,23.927850246429443,1 +7295,0.17146265506744385,0.27830326557159424,0.25954100489616394,0.2642948627471924,964.61181640625,1e-05,0.07521496713161469,2.482816219329834,23.927850246429443,1 +7296,0.19097818434238434,0.116999052464962,0.1141730323433876,0.16176281869411469,884.9298706054688,1e-05,0.07302560657262802,2.3505561351776123,23.927850246429443,1 +7297,0.202266663312912,0.19234202802181244,0.19485308229923248,0.26326921582221985,590.71728515625,1e-05,0.0732635036110878,2.693096876144409,23.927850246429443,1 +7298,0.19391188025474548,0.16732123494148254,0.16311879456043243,0.18301281332969666,780.78076171875,1e-05,0.07339761406183243,2.4758570194244385,23.927850246429443,1 +7299,0.15427756309509277,0.1394207924604416,0.13663946092128754,0.13798075914382935,637.2549438476562,1e-05,0.06112436577677727,2.355448007583618,23.927850246429443,1 +7300,0.23841281235218048,0.16680946946144104,0.16709963977336884,0.24423076212406158,814.7632446289062,1e-05,0.07513385266065598,2.460355520248413,23.927850246429443,1 +7301,0.2636427581310272,0.23914673924446106,0.22900176048278809,0.20192307233810425,640.8381958007812,1e-05,0.0810784175992012,2.5988950729370117,23.927850246429443,1 +7302,0.17433886229991913,0.16170355677604675,0.15662653744220734,0.20576922595500946,924.1397094726562,1e-05,0.06411396712064743,2.3540987968444824,23.927850246429443,1 +7303,0.32943230867385864,0.13888026773929596,0.13972309231758118,0.09666666388511658,755.5379638671875,1e-05,0.09084498882293701,2.347308874130249,23.927850246429443,1 +7304,0.140580415725708,0.10110694169998169,0.11276214569807053,0.19201922416687012,930.4703369140625,1e-05,0.07070812582969666,2.345275640487671,23.927850246429443,1 +7305,0.21089304983615875,0.17383581399917603,0.1731768548488617,0.22330127656459808,972.4690551757812,1e-05,0.06574828177690506,2.3464009761810303,23.927850246429443,1 +7306,0.10145329684019089,0.16083669662475586,0.16298186779022217,0.16298076510429382,699.823974609375,1e-05,0.06018495187163353,2.4691741466522217,23.927850246429443,1 +7307,0.24250665307044983,0.20696674287319183,0.2015019655227661,0.2549999952316284,929.8156127929688,1e-05,0.08107579499483109,2.3430187702178955,23.927850246429443,1 +7308,0.2499140501022339,0.2439969778060913,0.24428483843803406,0.1368589699268341,362.2159423828125,1e-05,0.0746246799826622,2.6062819957733154,23.927850246429443,1 +7309,0.14245839416980743,0.34045493602752686,0.3443170189857483,0.18128204345703125,990.6640014648438,1e-05,0.066152423620224,2.3607306480407715,23.927850246429443,1 +7310,0.12580499053001404,0.14000238478183746,0.15261614322662354,0.24583332240581512,702.7145385742188,1e-05,0.07041832059621811,2.4708642959594727,23.927850246429443,1 +7311,0.14465443789958954,0.17803604900836945,0.16952325403690338,0.14865383505821228,944.52587890625,1e-05,0.07373278588056564,2.487797975540161,23.927850246429443,1 +7312,0.1531195491552353,0.13133186101913452,0.13147294521331787,0.1862499862909317,660.3773803710938,1e-05,0.08205099403858185,2.3575615882873535,23.927850246429443,1 +7313,0.14338690042495728,0.21466897428035736,0.21008305251598358,0.26009613275527954,931.1224365234375,1e-05,0.0682360827922821,2.3487586975097656,23.927850246429443,1 +7314,0.1966448873281479,0.2434832900762558,0.25403162837028503,0.18833333253860474,990.87890625,1e-05,0.06787820905447006,2.3429150581359863,23.927850246429443,1 +7315,0.23592406511306763,0.20987680554389954,0.21614807844161987,0.2238781899213791,987.174072265625,1e-05,0.2300945520401001,2.341787815093994,23.927850246429443,1 +7316,0.2681245505809784,0.11245125532150269,0.11500565707683563,0.20346152782440186,858.3959350585938,1e-05,0.0714138001203537,2.4409024715423584,23.927850246429443,1 +7317,0.2772030830383301,0.12610222399234772,0.11092569679021835,0.2883974313735962,888.7283325195312,1e-05,0.07050548493862152,2.3836264610290527,23.927850246429443,2 +7318,0.201975479722023,0.24294471740722656,0.23438851535320282,0.28689101338386536,801.64990234375,1e-05,0.07058879733085632,2.3484370708465576,23.927850246429443,2 +7319,0.1480073183774948,0.14838699996471405,0.14772237837314606,0.2613781988620758,891.2169799804688,1e-05,0.06576947122812271,2.5040698051452637,23.927850246429443,2 +7320,0.1619025617837906,0.03178759664297104,0.038892295211553574,0.22894230484962463,756.319091796875,1e-05,0.07718878239393234,2.3478798866271973,23.927850246429443,2 +7321,0.20990923047065735,0.11962085962295532,0.11920557916164398,0.24564102292060852,851.403076171875,1e-05,0.07395271211862564,2.483100652694702,23.927850246429443,2 +7322,0.1506178081035614,0.16882061958312988,0.1696038395166397,0.24249999225139618,974.1835327148438,1e-05,0.06421492248773575,2.5965373516082764,23.927850246429443,2 +7323,0.22233152389526367,0.29570966958999634,0.29305675625801086,0.09576922655105591,341.5697937011719,1e-05,0.09488239884376526,2.3539252281188965,23.927850246429443,2 +7324,0.14042815566062927,0.05160866305232048,0.05205094814300537,0.008653845638036728,594.86376953125,1e-05,0.06896845251321793,2.3508493900299072,23.927850246429443,2 +7325,0.20759078860282898,0.17475107312202454,0.1734902262687683,0.23608973622322083,847.8120727539062,1e-05,0.13402701914310455,2.3496241569519043,23.927850246429443,2 +7326,0.1387479454278946,0.1458551287651062,0.1455640196800232,0.1959935873746872,777.2314453125,1e-05,0.06616285443305969,2.3540291786193848,23.927850246429443,2 +7327,0.23752383887767792,0.14704257249832153,0.14776156842708588,0.2586858868598938,729.1666870117188,1e-05,0.06882140785455704,2.457151412963867,23.927850246429443,2 +7328,0.2871955335140228,0.2629779279232025,0.25688648223876953,0.22554486989974976,468.75,1e-05,0.08747183531522751,2.3626458644866943,23.927850246429443,2 +7329,0.10014092177152634,0.15744175016880035,0.15203215181827545,0.24237178266048431,829.4078369140625,1e-05,0.06738131493330002,2.6416103839874268,23.927850246429443,2 +7330,0.2847767174243927,0.16548703610897064,0.1644861400127411,0.23355768620967865,847.2938232421875,1e-05,0.09547294676303864,2.3517444133758545,23.927850246429443,2 +7331,0.20689523220062256,0.21454882621765137,0.20736990869045258,0.23365384340286255,800.3597412109375,1e-05,0.07370571792125702,2.3585965633392334,23.927850246429443,2 +7332,0.20161907374858856,0.24253444373607635,0.23845361173152924,0.2875961363315582,999.7998046875,1e-05,0.07392088323831558,2.3493471145629883,23.927850246429443,2 +7333,0.13051405549049377,0.1776222586631775,0.17914187908172607,0.20503205060958862,914.3394165039062,1e-05,0.06949571520090103,2.500735282897949,23.927850246429443,2 +7334,0.13225877285003662,0.40070170164108276,0.40452736616134644,0.08541666716337204,997.3726806640625,1e-05,0.06351564079523087,2.3520925045013428,23.927850246429443,2 +7335,0.27091673016548157,0.1497737616300583,0.1663098931312561,0.2500961422920227,593.4874267578125,1e-05,0.08308639377355576,2.348639965057373,23.927850246429443,2 +7336,0.24653643369674683,0.3101802468299866,0.2949550151824951,0.200032040476799,961.1829223632812,1e-05,0.07291309535503387,2.349621057510376,23.927850246429443,2 +7337,0.22490233182907104,0.30312955379486084,0.3391062319278717,0.2185576856136322,129.92831420898438,1e-05,0.09565277397632599,2.351013660430908,23.927850246429443,2 +7338,0.20102493464946747,0.2563053369522095,0.24419666826725006,0.2672435939311981,973.4513549804688,1e-05,0.06923730671405792,2.461585760116577,23.927850246429443,2 +7339,0.22094272077083588,0.2549298405647278,0.2926424741744995,0.2136538326740265,172.413818359375,1e-05,0.08224929869174957,2.5719354152679443,23.927850246429443,2 +7340,0.2014608383178711,0.24115625023841858,0.23176006972789764,0.24967947602272034,733.4710693359375,1e-05,0.07297864556312561,2.5845372676849365,23.927850246429443,2 +7341,0.2510039508342743,0.2480802983045578,0.2566390037536621,0.0945192277431488,975.3954467773438,1e-05,0.07422537356615067,2.353668451309204,23.927850246429443,2 +7342,0.17038960754871368,0.17114774882793427,0.16652600467205048,0.23301281034946442,832.2192993164062,1e-05,0.0646028071641922,2.470151662826538,23.927850246429443,2 +7343,0.19610753655433655,0.15247172117233276,0.15391650795936584,0.2245512753725052,938.1237182617188,1e-05,0.07216043025255203,2.495814800262451,23.927850246429443,2 +7344,0.2918766736984253,0.1514393389225006,0.14955422282218933,0.1838461458683014,893.2648315429688,1e-05,0.09033184498548508,2.3551206588745117,23.927850246429443,2 +7345,0.31785356998443604,0.11514962464570999,0.1263398677110672,0.2081410139799118,958.2166748046875,1e-05,0.06477028131484985,2.347543478012085,23.927850246429443,2 +7346,0.29783421754837036,0.15531983971595764,0.15334168076515198,0.26634615659713745,798.4103393554688,1e-05,0.08513684570789337,2.349707841873169,23.927850246429443,2 +7347,0.244772806763649,0.17421352863311768,0.17130433022975922,0.15897434949874878,381.9444580078125,1e-05,0.07846943289041519,2.349987506866455,23.927850246429443,2 +7348,0.17117726802825928,0.21005061268806458,0.2110263556241989,0.01538461446762085,989.5833129882812,1e-05,0.07101862132549286,2.3516411781311035,23.927850246429443,2 +7349,0.15117493271827698,0.230616956949234,0.21600764989852905,0.23711538314819336,930.143310546875,1e-05,0.062201447784900665,2.4945192337036133,23.927850246429443,2 +7350,0.22583234310150146,0.1162661612033844,0.11968178302049637,0.31400638818740845,855.4293212890625,1e-05,0.0906776636838913,2.486212730407715,23.927850246429443,2 +7351,0.2250799983739853,0.28827807307243347,0.2755332887172699,0.21358974277973175,920.358642578125,1e-05,0.07663816958665848,2.466571569442749,23.927850246429443,2 +7352,0.31174927949905396,0.19197332859039307,0.19494369626045227,0.24599358439445496,604.3388061523438,1e-05,0.08622176945209503,2.58251953125,23.927850246429443,2 +7353,0.12669023871421814,0.18607328832149506,0.1773582547903061,0.2801922857761383,858.8861083984375,1e-05,0.06527247279882431,2.3560731410980225,23.927850246429443,2 +7354,0.29826629161834717,0.34028586745262146,0.33590584993362427,0.29935896396636963,176.11683654785156,1e-05,0.0872204452753067,2.499671697616577,23.927850246429443,2 +7355,0.1542845517396927,0.0541863739490509,0.061782486736774445,0.20214742422103882,722.12841796875,1e-05,0.06252662092447281,2.3570704460144043,23.927850246429443,2 +7356,0.17085899412631989,0.172024205327034,0.16549894213676453,0.24858973920345306,920.0105590820312,1e-05,0.06074707582592964,2.3567752838134766,23.927850246429443,2 +7357,0.157321497797966,0.23107008635997772,0.2274157553911209,0.21666665375232697,986.50927734375,1e-05,0.07522708922624588,2.3587429523468018,23.927850246429443,2 +7358,0.18515968322753906,0.19991955161094666,0.19837239384651184,0.14423076808452606,823.0874633789062,1e-05,0.07455882430076599,2.3581929206848145,23.927850246429443,2 +7359,0.14337077736854553,0.30698323249816895,0.3037075102329254,0.24666665494441986,987.174072265625,1e-05,0.06800483167171478,2.354708194732666,23.927850246429443,2 +7360,0.1606467366218567,0.15735621750354767,0.15237560868263245,0.2829166650772095,827.1312866210938,1e-05,0.06958870589733124,2.478534698486328,23.927850246429443,2 +7361,0.2928539216518402,0.31840893626213074,0.30854928493499756,0.26346153020858765,555.5556030273438,1e-05,0.1011294350028038,2.7033755779266357,23.927850246429443,2 +7362,0.17671868205070496,0.16487891972064972,0.15893402695655823,0.22605767846107483,717.632080078125,1e-05,0.06465476006269455,2.5864765644073486,23.927850246429443,2 +7363,0.25904250144958496,0.17775365710258484,0.17503021657466888,0.24211537837982178,932.7411499023438,1e-05,0.07460130751132965,2.478667736053467,23.927850246429443,2 +7364,0.14231683313846588,0.2718558609485626,0.26132553815841675,0.2540384531021118,951.2427978515625,1e-05,0.06370165199041367,2.359225273132324,23.927850246429443,2 +7365,0.25450190901756287,0.2370852530002594,0.2377084195613861,0.20666666328907013,577.95703125,1e-05,0.06474674493074417,2.3550610542297363,23.927850246429443,2 +7366,0.2928180992603302,0.20999735593795776,0.2036869376897812,0.2958012819290161,716.7235717773438,1e-05,0.0741770938038826,2.3469014167785645,23.927850246429443,2 +7367,0.26472604274749756,0.18269841372966766,0.1758006364107132,0.2500961422920227,609.6311645507812,1e-05,0.07630182802677155,2.3466086387634277,23.927850246429443,2 +7368,0.1868787407875061,0.48189476132392883,0.47922483086586,0.32778844237327576,264.1955871582031,1e-05,0.06363551318645477,2.349026679992676,23.927850246429443,2 +7369,0.21602419018745422,0.29126057028770447,0.29842692613601685,0.28112179040908813,322.7003173828125,1e-05,0.06832199543714523,2.347825288772583,23.927850246429443,2 +7370,0.06944720447063446,0.1620449721813202,0.15434226393699646,0.1288461536169052,879.3001098632812,1e-05,0.06186312064528465,2.49456787109375,23.927850246429443,2 +7371,0.2085496336221695,0.3941856622695923,0.40133604407310486,0.229358971118927,222.03948974609375,1e-05,0.06927654147148132,2.572216510772705,23.927850246429443,2 +7372,0.20708712935447693,0.2146950513124466,0.21121515333652496,0.2777884602546692,498.798095703125,1e-05,0.06583385169506073,2.5262975692749023,23.927850246429443,2 +7373,0.18786247074604034,0.1353573203086853,0.13285528123378754,0.20483973622322083,908.0963134765625,1e-05,0.07619916647672653,2.352475881576538,23.927850246429443,2 +7374,0.12500378489494324,0.17739129066467285,0.16866594552993774,0.21516025066375732,955.7438354492188,1e-05,0.05793456733226776,2.5695581436157227,23.927850246429443,2 +7375,0.2028457671403885,0.2171969711780548,0.21690058708190918,0.1644551157951355,939.6723022460938,1e-05,0.07404690980911255,2.4902288913726807,23.927850246429443,2 +7376,0.1636827439069748,0.09053557366132736,0.09303310513496399,0.09092948585748672,847.2938232421875,1e-05,0.06856244802474976,2.3510184288024902,23.927850246429443,2 +7377,0.21285320818424225,0.24029281735420227,0.23376746475696564,0.19804486632347107,915.0589599609375,1e-05,0.06608438491821289,2.350308418273926,23.927850246429443,2 +7378,0.18831828236579895,0.15363197028636932,0.13919293880462646,0.21314102411270142,837.7308349609375,1e-05,0.06770431250333786,2.3523786067962646,23.927850246429443,2 +7379,0.24694405496120453,0.3073321580886841,0.3158753514289856,0.22128205001354218,319.94049072265625,1e-05,0.0730932354927063,2.346250534057617,23.927850246429443,2 +7380,0.18334467709064484,0.069780133664608,0.08060303330421448,0.21541665494441986,892.4485473632812,1e-05,0.06418586522340775,2.347465753555298,23.927850246429443,2 +7381,0.24099919199943542,0.33635735511779785,0.3282754421234131,0.2728525400161743,495.1690979003906,1e-05,0.07921940088272095,2.4869015216827393,23.927850246429443,2 +7382,0.16695018112659454,0.10446879267692566,0.10936590284109116,0.2909294664859772,894.8863525390625,1e-05,0.06287413090467453,2.6155474185943604,23.927850246429443,2 +7383,0.2145603448152542,0.09953466802835464,0.10630708932876587,0.24945512413978577,643.2039184570312,1e-05,0.06426718086004257,2.496176242828369,23.927850246429443,2 +7384,0.20611527562141418,0.15818968415260315,0.15656445920467377,0.13544870913028717,749.19873046875,1e-05,0.06636042892932892,2.476361036300659,23.927850246429443,2 +7385,0.1853189468383789,0.16527755558490753,0.16609522700309753,0.2545512616634369,558.6282348632812,1e-05,0.05476323515176773,2.589287519454956,23.927850246429443,2 +7386,0.1747957020998001,0.32411882281303406,0.32950544357299805,0.27474358677864075,276.479736328125,1e-05,0.07436561584472656,2.3695573806762695,23.927850246429443,2 +7387,0.25400808453559875,0.33071568608283997,0.34494704008102417,0.13900640606880188,300.1519775390625,1e-05,0.07829425483942032,2.3599579334259033,23.927850246429443,2 +7388,0.17798268795013428,0.22066079080104828,0.2189253270626068,0.2499999850988388,933.0629272460938,1e-05,0.06999244540929794,2.3602097034454346,23.927850246429443,2 +7389,0.17669802904129028,0.18362240493297577,0.1911090910434723,0.26182690262794495,640.8381958007812,1e-05,0.07989207655191422,2.359508514404297,23.927850246429443,2 +7390,0.24857959151268005,0.13630563020706177,0.13303880393505096,0.20964743196964264,850.3836669921875,1e-05,0.07801252603530884,2.360065221786499,23.927850246429443,2 +7391,0.16873343288898468,0.19157366454601288,0.2076604664325714,0.22644229233264923,975.3954467773438,1e-05,0.06575404107570648,2.501385450363159,23.927850246429443,2 +7392,0.1377999484539032,0.09603732824325562,0.09849636256694794,0.15858973562717438,873.039794921875,1e-05,0.0727882906794548,2.5133094787597656,23.927850246429443,2 +7393,0.15415076911449432,0.10971786081790924,0.10647162795066833,0.2744230628013611,846.7742309570312,1e-05,0.05937046930193901,2.6182188987731934,23.927850246429443,2 +7394,0.21323373913764954,0.15169787406921387,0.13891199231147766,0.2074679434299469,751.5949096679688,1e-05,0.06663835048675537,2.352261543273926,23.927850246429443,2 +7395,0.19046832621097565,0.29695552587509155,0.28661033511161804,0.23762819170951843,940.900146484375,1e-05,0.06684809178113937,2.5813162326812744,23.927850246429443,2 +7396,0.17713984847068787,0.2160629779100418,0.21070842444896698,0.2363140881061554,767.7470092773438,1e-05,0.06675565242767334,2.470492124557495,23.927850246429443,2 +7397,0.1602461189031601,0.20375759899616241,0.19564281404018402,0.2163461446762085,953.5103759765625,1e-05,0.07957598567008972,2.3627235889434814,23.927850246429443,2 +7398,0.15034125745296478,0.221713125705719,0.2189265787601471,0.1977243572473526,815.9722900390625,1e-05,0.06026972830295563,2.349640369415283,23.927850246429443,2 +7399,0.26418811082839966,0.21376557648181915,0.20633181929588318,0.2760256230831146,519.8598022460938,1e-05,0.07525260746479034,2.3504221439361572,23.927850246429443,2 +7400,0.10520011931657791,0.11235179007053375,0.11577732861042023,0.21541665494441986,886.6278686523438,1e-05,0.07856824994087219,2.348186492919922,23.927850246429443,2 +7401,0.23857243359088898,0.23038350045681,0.2129569947719574,0.2656089663505554,955.188720703125,1e-05,0.06851115077733994,2.4897851943969727,23.927850246429443,2 +7402,0.07189878076314926,0.13920481503009796,0.13682574033737183,0.166858971118927,847.2938232421875,1e-05,0.06107551231980324,2.3586502075195312,23.927850246429443,2 +7403,0.15229852497577667,0.09415381401777267,0.10224542766809464,0.10756409913301468,972.4690551757812,1e-05,0.06335626542568207,2.6844985485076904,23.927850246429443,2 +7404,0.24039646983146667,0.1598130464553833,0.15541990101337433,0.2730448544025421,638.4540405273438,1e-05,0.07746975123882294,2.56331467628479,23.927850246429443,2 +7405,0.25437381863594055,0.20710612833499908,0.1908690184354782,0.2707692086696625,956.8480224609375,1e-05,0.07120876014232635,2.3525924682617188,23.927850246429443,2 +7406,0.22160667181015015,0.400538831949234,0.38963449001312256,0.32073715329170227,991.52197265625,1e-05,0.06610740721225739,2.4792230129241943,23.927850246429443,2 +7407,0.18126799166202545,0.22204725444316864,0.21368810534477234,0.1887499988079071,939.6723022460938,1e-05,0.07555133104324341,2.5883116722106934,23.927850246429443,2 +7408,0.08745628595352173,0.10266461968421936,0.10241000354290009,0.19301281869411469,693.9501953125,1e-05,0.08012194186449051,2.3557989597320557,23.927850246429443,2 +7409,0.1235262006521225,0.09558403491973877,0.09000993520021439,0.16660255193710327,881.0508422851562,1e-05,0.06904198229312897,2.3579044342041016,23.927850246429443,2 +7410,0.16282859444618225,0.2410929799079895,0.23084263503551483,0.1862499862909317,925.4932250976562,1e-05,0.07583785802125931,2.3546557426452637,23.927850246429443,2 +7411,0.21907441318035126,0.10074440389871597,0.0953274592757225,0.0739743560552597,833.3333129882812,1e-05,0.0797666609287262,2.3583199977874756,23.927850246429443,2 +7412,0.16074912250041962,0.23000919818878174,0.22679206728935242,0.2380448579788208,664.7939453125,1e-05,0.07811839133501053,2.4915640354156494,23.927850246429443,2 +7413,0.11712906509637833,0.23187492787837982,0.21872936189174652,0.19153845310211182,909.5860595703125,1e-05,0.07586118578910828,2.3577721118927,23.927850246429443,2 +7414,0.2501883804798126,0.6813747882843018,0.667460560798645,0.21881408989429474,61.78706741333008,1e-05,0.067125104367733,2.612743616104126,23.927850246429443,2 +7415,0.17826174199581146,0.1994001567363739,0.18691827356815338,0.22070512175559998,963.3027954101562,1e-05,0.0706804022192955,2.5381510257720947,23.927850246429443,2 +7416,0.15210828185081482,0.1263781189918518,0.12790586054325104,0.23496794700622559,846.2532348632812,1e-05,0.06718625873327255,2.4842958450317383,23.927850246429443,2 +7417,0.31122004985809326,0.17345164716243744,0.1733279973268509,0.27935895323753357,971.4794311523438,1e-05,0.08967095613479614,2.4800608158111572,23.927850246429443,2 +7418,0.12844616174697876,0.20452678203582764,0.20515012741088867,0.17903845012187958,869.3666381835938,1e-05,0.07373961061239243,2.354818344116211,23.927850246429443,2 +7419,0.24809519946575165,0.19806574285030365,0.19589659571647644,0.1933974325656891,930.4703369140625,1e-05,0.09163518995046616,2.3534746170043945,23.927850246429443,2 +7420,0.17323525249958038,0.10126637667417526,0.10198542475700378,0.2477884590625763,794.4606323242188,1e-05,0.07289241254329681,2.351102828979492,23.927850246429443,2 +7421,0.14796604216098785,0.14586296677589417,0.14134131371974945,0.19035255908966064,877.5327758789062,1e-05,0.0691278949379921,2.3477206230163574,23.927850246429443,2 +7422,0.12795567512512207,0.08356072008609772,0.08459427207708359,0.13355769217014313,903.9313354492188,1e-05,0.06458394229412079,2.347905158996582,23.927850246429443,2 +7423,0.2952331006526947,0.34631940722465515,0.36176833510398865,0.2140384465456009,208.3333282470703,1e-05,0.09544507414102554,2.4706833362579346,23.927850246429443,2 +7424,0.25002214312553406,0.20252838730812073,0.20409438014030457,0.11019230633974075,977.07421875,1e-05,0.06936891376972198,2.4909698963165283,23.927850246429443,2 +7425,0.2338133007287979,0.17410871386528015,0.16915564239025116,0.25788459181785583,796.4441528320312,1e-05,0.0780564397573471,2.659796953201294,23.927850246429443,2 +7426,0.21737144887447357,0.10377916693687439,0.11177463829517365,0.21182692050933838,958.2166748046875,1e-05,0.08199319243431091,2.3519396781921387,23.927850246429443,2 +7427,0.21759268641471863,0.25871869921684265,0.25775831937789917,0.20913460850715637,881.4859008789062,1e-05,0.07048981636762619,2.4553141593933105,23.927850246429443,2 +7428,0.2897056043148041,0.18015436828136444,0.1732177883386612,0.1901922971010208,678.7020263671875,1e-05,0.06761609762907028,2.574561834335327,23.927850246429443,2 +7429,0.26660025119781494,0.22394461929798126,0.2340635061264038,0.20224358141422272,431.9371643066406,1e-05,0.0724676102399826,2.3481948375701904,23.927850246429443,2 +7430,0.2983075976371765,0.2285211980342865,0.21555258333683014,0.22554486989974976,730.0333251953125,1e-05,0.09909814596176147,2.343364953994751,23.927850246429443,2 +7431,0.19283616542816162,0.1916976124048233,0.1860504299402237,0.26951920986175537,539.7727661132812,1e-05,0.08229391276836395,2.3498823642730713,23.927850246429443,2 +7432,0.24335652589797974,0.23713241517543793,0.24088388681411743,0.18926280736923218,555.5556030273438,1e-05,0.0776255801320076,2.3552067279815674,23.927850246429443,2 +7433,0.2711013853549957,0.19186833500862122,0.21511776745319366,0.21958333253860474,208.3333282470703,1e-05,0.14251406490802765,2.347689151763916,23.927850246429443,2 +7434,0.2777372896671295,0.15753653645515442,0.15713681280612946,0.25544869899749756,817.7731323242188,1e-05,0.08015326410531998,2.4704806804656982,23.927850246429443,2 +7435,0.2042694240808487,0.1763264536857605,0.1806163638830185,0.16730768978595734,583.6886596679688,1e-05,0.09504491835832596,2.580291509628296,23.927850246429443,2 +7436,0.2985232472419739,0.2029404193162918,0.19141767919063568,0.2749038338661194,967.194580078125,1e-05,0.12482723593711853,2.475630044937134,23.927850246429443,2 +7437,0.2847166955471039,0.6710259318351746,0.7367568016052246,0.2531730532646179,29.296875,1e-05,0.10423140972852707,2.479537010192871,23.927850246429443,2 +7438,0.17077989876270294,0.14583420753479004,0.13706782460212708,0.2351602464914322,834.44140625,1e-05,0.06973624229431152,2.3546924591064453,23.927850246429443,2 +7439,0.1721530258655548,0.19211573898792267,0.19283565878868103,0.24532049894332886,772.1712036132812,1e-05,0.07565619796514511,2.48280930519104,23.927850246429443,2 +7440,0.1984134316444397,0.1676236391067505,0.16422592103481293,0.24394230544567108,827.7026977539062,1e-05,0.13872985541820526,2.35129976272583,23.927850246429443,2 +7441,0.13989709317684174,0.10472261905670166,0.11900494992733002,0.22999998927116394,804.208251953125,1e-05,0.0719664990901947,2.357182741165161,23.927850246429443,2 +7442,0.17475880682468414,0.11580003052949905,0.12451605498790741,0.17605768144130707,832.2192993164062,1e-05,0.07095351070165634,2.353771686553955,23.927850246429443,2 +7443,0.25114181637763977,0.21584844589233398,0.20538464188575745,0.1663782000541687,976.3572998046875,1e-05,0.1387721300125122,2.3569869995117188,23.927850246429443,2 +7444,0.2423841953277588,0.41800662875175476,0.41407907009124756,0.1942628175020218,228.7581787109375,1e-05,0.07123619318008423,2.4709091186523438,23.927850246429443,2 +7445,0.18848267197608948,0.21786107122898102,0.209845170378685,0.2512499988079071,516.4320068359375,1e-05,0.07377732545137405,2.369532346725464,23.927850246429443,2 +7446,0.25259828567504883,0.141401007771492,0.14491936564445496,0.14910255372524261,909.5860595703125,1e-05,0.08331798762083054,2.4930787086486816,23.927850246429443,2 +7447,0.20899178087711334,0.30863651633262634,0.3092145621776581,0.2629487216472626,996.9635620117188,1e-05,0.09338931739330292,2.485964059829712,23.927850246429443,2 +7448,0.23302581906318665,0.1987461894750595,0.18794846534729004,0.15839743614196777,673.4317626953125,1e-05,0.0700860321521759,2.472304582595825,23.927850246429443,2 +7449,0.1836887001991272,0.2861004173755646,0.29511356353759766,0.2609294652938843,996.7586059570312,1e-05,0.06819625943899155,2.5085926055908203,23.927850246429443,2 +7450,0.33564049005508423,0.17719335854053497,0.1651306450366974,0.2514423131942749,753.9683227539062,1e-05,0.08839833736419678,2.3855788707733154,23.927850246429443,2 +7451,0.1894083172082901,0.2113793045282364,0.20143383741378784,0.1958974301815033,912.5270385742188,1e-05,0.072137251496315,2.3640222549438477,23.927850246429443,2 +7452,0.16449818015098572,0.23033975064754486,0.23782706260681152,0.1450641006231308,984.0426025390625,1e-05,0.07030870020389557,2.3618578910827637,23.927850246429443,2 +7453,0.27160125970840454,0.1659211665391922,0.16655299067497253,0.1348397433757782,582.2649536132812,1e-05,0.0857614055275917,2.358534574508667,23.927850246429443,2 +7454,0.27145642042160034,0.16779614984989166,0.16843679547309875,0.19044871628284454,446.65814208984375,1e-05,0.08106163144111633,2.352828025817871,23.927850246429443,2 +7455,0.17041867971420288,0.2067779153585434,0.2036190629005432,0.23451922833919525,994.89794921875,1e-05,0.07791969925165176,2.4921936988830566,23.927850246429443,2 +7456,0.18843576312065125,0.1643732190132141,0.1550646275281906,0.23471152782440186,840.4324951171875,1e-05,0.0717286542057991,2.630333662033081,23.927850246429443,2 +7457,0.30418121814727783,0.253442645072937,0.25318750739097595,0.23855768144130707,472.6368408203125,1e-05,0.08065294474363327,2.3561830520629883,23.927850246429443,2 +7458,0.053341276943683624,0.1565597951412201,0.16284306347370148,0.25070512294769287,974.6696166992188,1e-05,0.060355573892593384,2.5090997219085693,23.927850246429443,2 +7459,0.21386201679706573,0.2503497004508972,0.2485467493534088,0.22884614765644073,489.6593933105469,1e-05,0.0741085484623909,2.351910352706909,23.927850246429443,2 +7460,0.2235247790813446,0.20428748428821564,0.19183282554149628,0.1843269169330597,872.5845947265625,1e-05,0.07554396986961365,2.4811975955963135,23.927850246429443,2 +7461,0.147038996219635,0.0763719454407692,0.07928480952978134,0.11240383982658386,869.8297119140625,1e-05,0.07527428865432739,2.3518898487091064,23.927850246429443,2 +7462,0.23739708960056305,0.8698226809501648,0.8819108009338379,0.11618589609861374,43.43629455566406,1e-05,0.07251808792352676,2.3487908840179443,23.927850246429443,2 +7463,0.21746793389320374,0.46934807300567627,0.4771531820297241,0.2346794754266739,254.77706909179688,1e-05,0.06688611209392548,2.3489785194396973,23.927850246429443,2 +7464,0.2639189660549164,0.18499837815761566,0.18915106356143951,0.2274358868598938,838.8157958984375,1e-05,0.07302019000053406,2.3496437072753906,23.927850246429443,2 +7465,0.19318044185638428,0.1818557232618332,0.18606454133987427,0.23628203570842743,570.6521606445312,1e-05,0.09253065288066864,2.3487937450408936,23.927850246429443,2 +7466,0.262858122587204,0.21729813516139984,0.21730868518352509,0.13891024887561798,969.4793090820312,1e-05,0.07828069478273392,2.491699457168579,23.927850246429443,2 +7467,0.2937896251678467,0.1995450258255005,0.19951224327087402,0.2969871759414673,734.3234252929688,1e-05,0.07980401813983917,2.534942865371704,23.927850246429443,2 +7468,0.2327561229467392,0.16217517852783203,0.15516376495361328,0.1806410253047943,781.4841918945312,1e-05,0.07997535169124603,2.4748809337615967,23.927850246429443,2 +7469,0.2610839605331421,0.247955322265625,0.25227639079093933,0.24201922118663788,357.1428527832031,1e-05,0.08075156062841415,2.529592752456665,23.927850246429443,2 +7470,0.16452112793922424,0.13024841248989105,0.12351219356060028,0.27878203988075256,929.8156127929688,1e-05,0.06918422877788544,2.3587441444396973,23.927850246429443,2 +7471,0.2139294594526291,0.1786997765302658,0.17639273405075073,0.1805448681116104,573.5930786132812,1e-05,0.07105112075805664,2.350602626800537,23.927850246429443,2 +7472,0.2784273624420166,0.2247980237007141,0.24115563929080963,0.19240383803844452,276.479736328125,1e-05,0.09435819834470749,2.347904682159424,23.927850246429443,2 +7473,0.14363518357276917,0.27255403995513916,0.2568613290786743,0.16519230604171753,981.7597045898438,1e-05,0.07364567369222641,2.3531532287597656,23.927850246429443,2 +7474,0.184378519654274,0.2175290584564209,0.21470575034618378,0.17884615063667297,756.319091796875,1e-05,0.06839155405759811,2.3553919792175293,23.927850246429443,2 +7475,0.1438906043767929,0.38426363468170166,0.35835978388786316,0.25612178444862366,999.3985595703125,1e-05,0.06537646800279617,2.3566977977752686,23.927850246429443,2 +7476,0.24102458357810974,0.12587334215641022,0.14365965127944946,0.19528844952583313,938.7450561523438,1e-05,0.07034812122583389,2.357863426208496,23.927850246429443,2 +7477,0.19021153450012207,0.14214198291301727,0.13772568106651306,0.15102563798427582,795.1236572265625,1e-05,0.07019326835870743,2.5257821083068848,23.927850246429443,2 +7478,0.1454564929008484,0.18072623014450073,0.17837893962860107,0.20865383744239807,988.9306640625,1e-05,0.06501579284667969,2.509371757507324,23.927850246429443,2 +7479,0.18343888223171234,0.29409292340278625,0.2865116000175476,0.20807690918445587,940.287353515625,1e-05,0.0847429409623146,2.5859169960021973,23.927850246429443,2 +7480,0.09469658136367798,0.15922927856445312,0.1434129923582077,0.2378525584936142,956.5726318359375,1e-05,0.06577756255865097,2.357600688934326,23.927850246429443,2 +7481,0.14009858667850494,0.20465663075447083,0.20240382850170135,0.29269230365753174,904.3141479492188,1e-05,0.06898589432239532,2.486602306365967,23.927850246429443,2 +7482,0.102450892329216,0.15860679745674133,0.1567247211933136,0.12003204971551895,903.9313354492188,1e-05,0.0831720381975174,2.3572700023651123,23.927850246429443,2 +7483,0.11371778696775436,0.2537675201892853,0.2625241279602051,0.2503845989704132,998.3897094726562,1e-05,0.07276201248168945,2.3573896884918213,23.927850246429443,2 +7484,0.15508252382278442,0.23867115378379822,0.23516292870044708,0.1752564013004303,970.2327880859375,1e-05,0.058991689234972,2.350606918334961,23.927850246429443,2 +7485,0.20607417821884155,0.20237478613853455,0.21690872311592102,0.18525640666484833,456.8528137207031,1e-05,0.06348621100187302,2.349613666534424,23.927850246429443,2 +7486,0.20895592868328094,0.19845758378505707,0.19632215797901154,0.23423075675964355,953.2288818359375,1e-05,0.07726114243268967,2.3506317138671875,23.927850246429443,2 +7487,0.22872069478034973,0.36767303943634033,0.36821600794792175,0.21416665613651276,264.1955871582031,1e-05,0.07412254810333252,2.3567726612091064,23.927850246429443,2 +7488,0.206614688038826,0.19114215672016144,0.18514631688594818,0.09987179189920425,698.8536376953125,1e-05,0.07308407872915268,2.6282007694244385,23.927850246429443,2 +7489,0.18698731064796448,0.18336798250675201,0.18219880759716034,0.2499999850988388,625.0,1e-05,0.06835604459047318,2.3584001064300537,23.927850246429443,2 +7490,0.23922394216060638,0.2008632868528366,0.19967898726463318,0.11483974009752274,516.4320068359375,1e-05,0.0668010339140892,2.4789209365844727,23.927850246429443,2 +7491,0.2313084453344345,0.32717761397361755,0.32571980357170105,0.2001281976699829,990.0166625976562,1e-05,0.06763807684183121,2.5739688873291016,23.927850246429443,2 +7492,0.20146527886390686,0.12667928636074066,0.12999200820922852,0.1833653748035431,814.15625,1e-05,0.07650657743215561,2.3613884449005127,23.927850246429443,2 +7493,0.21036870777606964,0.12538771331310272,0.125185027718544,0.25487178564071655,639.6484985351562,1e-05,0.07138700038194656,2.3630802631378174,23.927850246429443,2 +7494,0.11515665054321289,0.20044785737991333,0.19588465988636017,0.1722756326198578,834.44140625,1e-05,0.0724496841430664,2.3537397384643555,23.927850246429443,2 +7495,0.1767541915178299,0.27696701884269714,0.26908063888549805,0.21342948079109192,978.7327270507812,1e-05,0.07547199726104736,2.359916925430298,23.927850246429443,2 +7496,0.14797943830490112,0.19936232268810272,0.20106832683086395,0.2903205156326294,699.823974609375,1e-05,0.06962964683771133,2.3613903522491455,23.927850246429443,2 +7497,0.2195749580860138,0.25961682200431824,0.2515844404697418,0.24842947721481323,986.952880859375,1e-05,0.08398810774087906,2.3564627170562744,23.927850246429443,2 +7498,0.18778131902217865,0.22250741720199585,0.22412630915641785,0.29317307472229004,982.677490234375,1e-05,0.06719813495874405,2.6503143310546875,23.927850246429443,2 +7499,0.23049475252628326,0.1970207393169403,0.18464167416095734,0.22592948377132416,925.1558837890625,1e-05,0.07181902229785919,2.584717035293579,23.927850246429443,2 +7500,0.19447968900203705,0.23996272683143616,0.22909773886203766,0.32528844475746155,939.36376953125,1e-05,0.08478638529777527,2.3557841777801514,23.927850246429443,2 +7501,0.224939227104187,0.15230272710323334,0.16078051924705505,0.23916666209697723,634.842529296875,1e-05,0.08117907494306564,2.6004371643066406,23.927850246429443,2 +7502,0.19709038734436035,0.1031871885061264,0.10551286488771439,0.24118588864803314,633.6292114257812,1e-05,0.06065569445490837,2.4852588176727295,23.927850246429443,2 +7503,0.1329331248998642,0.09375828504562378,0.09211185574531555,0.17865383625030518,915.4175415039062,1e-05,0.08455123752355576,2.355266571044922,23.927850246429443,2 +7504,0.18189340829849243,0.09693249315023422,0.10645720362663269,0.11942306905984879,745.9677734375,1e-05,0.07942457497119904,2.3493683338165283,23.927850246429443,2 +7505,0.24442294239997864,0.2789728045463562,0.2661493718624115,0.24958331882953644,352.0115051269531,1e-05,0.08575008064508438,2.3494982719421387,23.927850246429443,2 +7506,0.20976008474826813,0.2324739396572113,0.22625643014907837,0.27483972907066345,569.172119140625,1e-05,0.0665876641869545,2.3495631217956543,23.927850246429443,2 +7507,0.2394542098045349,0.2641030251979828,0.26899394392967224,0.24362178146839142,305.8912353515625,1e-05,0.08768229931592941,2.34440016746521,23.927850246429443,2 +7508,0.25237953662872314,0.16300778090953827,0.15699733793735504,0.2850320339202881,743.5170288085938,1e-05,0.058031875640153885,2.564973831176758,23.927850246429443,2 +7509,0.1680312305688858,0.27836841344833374,0.27107125520706177,0.1766025573015213,965.3915405273438,1e-05,0.061765313148498535,2.6042134761810303,23.927850246429443,2 +7510,0.0700514018535614,0.13624964654445648,0.1342831403017044,0.26903843879699707,894.8863525390625,1e-05,0.07040178030729294,2.359835147857666,23.927850246429443,2 +7511,0.14397872984409332,0.13880178332328796,0.13790389895439148,0.24272434413433075,912.5270385742188,1e-05,0.07050245255231857,2.6199300289154053,23.927850246429443,2 +7512,0.3286057114601135,0.3175711929798126,0.31358906626701355,0.303044855594635,319.94049072265625,1e-05,0.08338320255279541,2.35147762298584,23.927850246429443,2 +7513,0.1511819213628769,0.2061624974012375,0.2026827335357666,0.19346153736114502,932.0956420898438,1e-05,0.07126122713088989,2.599100112915039,23.927850246429443,2 +7514,0.19089455902576447,0.11373274773359299,0.10804234445095062,0.21096153557300568,815.3685913085938,1e-05,0.06370307505130768,2.362044334411621,23.927850246429443,2 +7515,0.18061360716819763,0.21527765691280365,0.21087010204792023,0.08913461118936539,570.6521606445312,1e-05,0.07770036160945892,2.342393636703491,23.927850246429443,2 +7516,0.08691619336605072,0.12193772196769714,0.12398487329483032,0.11769230663776398,904.6961059570312,1e-05,0.15187373757362366,2.3474199771881104,23.927850246429443,2 +7517,0.21618491411209106,0.1353742480278015,0.14313547313213348,0.14211538434028625,843.0989990234375,1e-05,0.07565520703792572,2.343839168548584,23.927850246429443,2 +7518,0.21975983679294586,0.15750457346439362,0.15354712307453156,0.25185897946357727,673.4317626953125,1e-05,0.08528438210487366,2.345994234085083,23.927850246429443,2 +7519,0.2696225047111511,0.23264016211032867,0.22499345242977142,0.2530128061771393,789.0855712890625,1e-05,0.07527919858694077,2.6044771671295166,23.927850246429443,2 +7520,0.23367144167423248,0.21373870968818665,0.2003445029258728,0.26298075914382935,889.5617065429688,1e-05,0.07299181818962097,2.4709818363189697,23.927850246429443,2 +7521,0.27491873502731323,0.2431284338235855,0.2379380315542221,0.2275320440530777,491.5048522949219,1e-05,0.07490594685077667,2.5675177574157715,23.927850246429443,2 +7522,0.24594363570213318,0.31177717447280884,0.3090055286884308,0.22999998927116394,980.37109375,1e-05,0.07183852791786194,2.4831178188323975,23.927850246429443,2 +7523,0.21644553542137146,0.3710317015647888,0.36831122636795044,0.2609935700893402,245.17686462402344,1e-05,0.07544208317995071,2.4784858226776123,23.927850246429443,2 +7524,0.19742080569267273,0.21078048646450043,0.20987221598625183,0.25544869899749756,946.896240234375,1e-05,0.08258852362632751,2.3565797805786133,23.927850246429443,2 +7525,0.3009335696697235,0.13651861250400543,0.15045501291751862,0.11983974277973175,976.5967407226562,1e-05,0.08171418309211731,2.3501713275909424,23.927850246429443,2 +7526,0.16977255046367645,0.16175855696201324,0.15781879425048828,0.2408333271741867,952.6641235351562,1e-05,0.0644054263830185,2.3444631099700928,23.927850246429443,2 +7527,0.25867295265197754,0.2056470513343811,0.2037499099969864,0.17858973145484924,717.632080078125,1e-05,0.07611870020627975,2.3472466468811035,23.927850246429443,2 +7528,0.11774516105651855,0.29197394847869873,0.28874823451042175,0.23294870555400848,794.4606323242188,1e-05,0.06186090409755707,2.3476269245147705,23.927850246429443,2 +7529,0.24428755044937134,0.0771554559469223,0.08307100832462311,0.15801280736923218,616.125732421875,1e-05,0.11620117723941803,2.4741954803466797,23.927850246429443,2 +7530,0.21639862656593323,0.19083018600940704,0.17388388514518738,0.2278205007314682,934.3434448242188,1e-05,0.0736064538359642,2.5720365047454834,23.927850246429443,2 +7531,0.19421744346618652,0.1045953556895256,0.09881965070962906,0.20657050609588623,874.3990478515625,1e-05,0.07646409422159195,2.481043577194214,23.927850246429443,2 +7532,0.22705523669719696,0.1924876719713211,0.1860238015651703,0.23266024887561798,745.9677734375,1e-05,0.07893449813127518,2.573237895965576,23.927850246429443,2 +7533,0.19224770367145538,0.20566600561141968,0.19773723185062408,0.28089743852615356,942.1181640625,1e-05,0.06421570479869843,2.3544039726257324,23.927850246429443,2 +7534,0.13862448930740356,0.19803467392921448,0.18521979451179504,0.2990064024925232,914.6995849609375,1e-05,0.06022396311163902,2.572321653366089,23.927850246429443,2 +7535,0.23229709267616272,0.29844048619270325,0.2908001244068146,0.2272435873746872,649.0385131835938,1e-05,0.07530076801776886,2.3471086025238037,23.927850246429443,2 +7536,0.13916420936584473,0.253610759973526,0.25567159056663513,0.2169230729341507,997.3726806640625,1e-05,0.06722873449325562,2.350497245788574,23.927850246429443,2 +7537,0.10329616069793701,0.2534119486808777,0.277858167886734,0.19423076510429382,993.642333984375,1e-05,0.06472516804933548,2.344134569168091,23.927850246429443,2 +7538,0.14996197819709778,0.3220404386520386,0.2906644940376282,0.20291665196418762,992.374267578125,1e-05,0.06611444056034088,2.348923683166504,23.927850246429443,2 +7539,0.26079535484313965,0.17200082540512085,0.1707419455051422,0.16285255551338196,825.4075927734375,1e-05,0.07801131904125214,2.344886302947998,23.927850246429443,2 +7540,0.1482328623533249,0.24268169701099396,0.239027738571167,0.15842948853969574,963.5654907226562,1e-05,0.06895945966243744,2.590261936187744,23.927850246429443,2 +7541,0.22419169545173645,0.1505577266216278,0.14331762492656708,0.2563782036304474,896.4932861328125,1e-05,0.06953831762075424,2.355025291442871,23.927850246429443,2 +7542,0.2447100430727005,0.27722010016441345,0.2687245309352875,0.28080126643180847,297.256103515625,1e-05,0.0775766372680664,2.469230890274048,23.927850246429443,2 +7543,0.18248441815376282,0.1750757098197937,0.16150303184986115,0.2994871735572815,778.6576538085938,1e-05,0.07493113726377487,2.558480739593506,23.927850246429443,2 +7544,0.2664230763912201,0.2479214072227478,0.25254136323928833,0.19999998807907104,454.8346252441406,1e-05,0.07043395191431046,2.34944748878479,23.927850246429443,2 +7545,0.3091224431991577,0.1714603751897812,0.17098355293273926,0.2514423131942749,745.1535034179688,1e-05,0.06655020266771317,2.4711413383483887,23.927850246429443,2 +7546,0.23325283825397491,0.11649630963802338,0.11467275768518448,0.1636858880519867,764.7515258789062,1e-05,0.062015652656555176,2.349351167678833,23.927850246429443,2 +7547,0.17930671572685242,0.34311437606811523,0.3229093551635742,0.24326921999454498,208.3333282470703,1e-05,0.07459954917430878,2.346684455871582,23.927850246429443,2 +7548,0.18260465562343597,0.17458538711071014,0.16218653321266174,0.2383333295583725,856.9182739257812,1e-05,0.07015813887119293,2.346320152282715,23.927850246429443,2 +7549,0.3041418790817261,0.4768355190753937,0.4950937330722809,0.15772435069084167,225.4098358154297,1e-05,0.06729023158550262,2.348423957824707,23.927850246429443,2 +7550,0.1520260125398636,0.1377992033958435,0.1320214420557022,0.06666666269302368,941.8146362304688,1e-05,0.06786858290433884,2.353372812271118,23.927850246429443,2 +7551,0.15733127295970917,0.08614172041416168,0.08865083754062653,0.17663460969924927,881.0508422851562,1e-05,0.08030276745557785,2.4992587566375732,23.927850246429443,2 +7552,0.1770728975534439,0.15482355654239655,0.16416141390800476,0.20038460195064545,452.8061218261719,1e-05,0.11738888919353485,2.489511013031006,23.927850246429443,2 +7553,0.1697159707546234,0.14318445324897766,0.14026974141597748,0.2619551122188568,878.85986328125,1e-05,0.06372664123773575,2.46439528465271,23.927850246429443,2 +7554,0.18773600459098816,0.18004892766475677,0.18250533938407898,0.2449999898672104,982.2193603515625,1e-05,0.07671935856342316,2.5284175872802734,23.927850246429443,2 +7555,0.2460210621356964,0.3012409806251526,0.33125215768814087,0.3014102578163147,183.4470977783203,1e-05,0.1663677841424942,2.501246929168701,23.927850246429443,2 +7556,0.27183660864830017,0.2974569499492645,0.2812633216381073,0.2457692176103592,969.2273559570312,1e-05,0.07872837781906128,2.349137306213379,23.927850246429443,2 +7557,0.3112320303916931,0.20519588887691498,0.19454512000083923,0.22333332896232605,867.5030517578125,1e-05,0.08899722248315811,2.346994638442993,23.927850246429443,2 +7558,0.13754786550998688,0.07290824502706528,0.07936223596334457,0.1046474352478981,946.3070678710938,1e-05,0.0918567031621933,2.3478779792785645,23.927850246429443,2 +7559,0.18586799502372742,0.19092509150505066,0.1996455192565918,0.19121794402599335,992.7984008789062,1e-05,0.1575966626405716,2.3473336696624756,23.927850246429443,2 +7560,0.2487454116344452,0.7386497259140015,0.7744878530502319,0.21249999105930328,61.78706741333008,1e-05,0.10126471519470215,2.351747751235962,23.927850246429443,2 +7561,0.15522782504558563,0.15005335211753845,0.15114988386631012,0.3199358880519867,927.1693725585938,1e-05,0.07321730256080627,2.4914205074310303,23.927850246429443,2 +7562,0.24423660337924957,0.13788369297981262,0.13418859243392944,0.22999998927116394,769.9692993164062,1e-05,0.08649983257055283,2.3525502681732178,23.927850246429443,2 +7563,0.27723076939582825,0.18885530531406403,0.19304277002811432,0.24057690799236298,509.47869873046875,1e-05,0.11483804881572723,2.4694788455963135,23.927850246429443,2 +7564,0.19116857647895813,0.2812575697898865,0.28873392939567566,0.1995512694120407,985.6176147460938,1e-05,0.08040162920951843,2.4686570167541504,23.927850246429443,2 +7565,0.16359588503837585,0.15742027759552002,0.1582450270652771,0.24051281809806824,558.6282348632812,1e-05,0.08059995621442795,2.3597772121429443,23.927850246429443,2 +7566,0.1733093559741974,0.1830066591501236,0.16681358218193054,0.23153845965862274,917.5531616210938,1e-05,0.0704379752278328,2.4773576259613037,23.927850246429443,2 +7567,0.15442155301570892,0.1294916868209839,0.12888476252555847,0.2518269121646881,826.5582275390625,1e-05,0.4809456169605255,2.3514277935028076,23.927850246429443,2 +7568,0.17848533391952515,0.06120246276259422,0.06551096588373184,0.10733973979949951,831.0991821289062,1e-05,0.08321044594049454,2.3506362438201904,23.927850246429443,2 +7569,0.18522292375564575,0.236729696393013,0.2396121621131897,0.22939102351665497,427.6316223144531,1e-05,0.08549274504184723,2.3449556827545166,23.927850246429443,2 +7570,0.14020748436450958,0.13379411399364471,0.12861432135105133,0.2520192265510559,956.5726318359375,1e-05,0.08572148531675339,2.3478152751922607,23.927850246429443,2 +7571,0.2581948935985565,0.15899571776390076,0.15457558631896973,0.25400641560554504,767.7470092773438,1e-05,0.08984952419996262,2.3495595455169678,23.927850246429443,2 +7572,0.27862194180488586,0.21596452593803406,0.2074434459209442,0.298397421836853,699.823974609375,1e-05,0.07680943608283997,2.588085174560547,23.927850246429443,2 +7573,0.19185417890548706,0.10836280882358551,0.104514941573143,0.21022434532642365,872.5845947265625,1e-05,0.08649556338787079,2.349513530731201,23.927850246429443,2 +7574,0.3012535572052002,0.13175781071186066,0.12896828353405,0.24253204464912415,769.9692993164062,1e-05,0.0880638137459755,2.4635181427001953,23.927850246429443,2 +7575,0.2060500681400299,0.14416058361530304,0.15068408846855164,0.15987178683280945,693.9501953125,1e-05,0.07725600153207779,2.474360227584839,23.927850246429443,2 +7576,0.2143395096063614,0.24227122962474823,0.24323467910289764,0.19326922297477722,558.6282348632812,1e-05,0.0763317197561264,2.349508285522461,23.927850246429443,2 +7577,0.13663700222969055,0.19808925688266754,0.19879311323165894,0.268525630235672,716.7235717773438,1e-05,0.11313414573669434,2.3516175746917725,23.927850246429443,2 +7578,0.1678617298603058,0.28293806314468384,0.287991464138031,0.22554486989974976,248.39744567871094,1e-05,0.0722193792462349,2.350609540939331,23.927850246429443,2 +7579,0.1524023413658142,0.12869057059288025,0.11812783777713776,0.24676281213760376,907.3464965820312,1e-05,0.06810623407363892,2.3545148372650146,23.927850246429443,2 +7580,0.2348315566778183,0.20987585186958313,0.20924946665763855,0.021474357694387436,336.25732421875,1e-05,0.06681772321462631,2.3561222553253174,23.927850246429443,2 +7581,0.18347568809986115,0.14802254736423492,0.14305797219276428,0.2525961399078369,949.22998046875,1e-05,0.07746374607086182,2.354763984680176,23.927850246429443,2 +7582,0.21352525055408478,0.13278116285800934,0.1308656632900238,0.24810896813869476,712.13427734375,1e-05,0.07107789814472198,2.5030295848846436,23.927850246429443,2 +7583,0.15181203186511993,0.30239537358283997,0.30406317114830017,0.2484615296125412,986.952880859375,1e-05,0.06523510068655014,2.4981911182403564,23.927850246429443,2 +7584,0.29515719413757324,0.12539424002170563,0.11960428208112717,0.20189101994037628,827.7026977539062,1e-05,0.06027405336499214,2.4790661334991455,23.927850246429443,2 +7585,0.3278884291648865,0.1822436898946762,0.1784610152244568,0.257916659116745,736.0197143554688,1e-05,0.08779168874025345,2.3530380725860596,23.927850246429443,2 +7586,0.2329205572605133,0.48643767833709717,0.5147302150726318,0.2068910151720047,225.4098358154297,1e-05,0.06676733493804932,2.47583270072937,23.927850246429443,2 +7587,0.15197573602199554,0.1303553730249405,0.1275196522474289,0.21551281213760376,920.7059936523438,1e-05,0.06244121119379997,2.478339672088623,23.927850246429443,2 +7588,0.17918506264686584,0.20768214762210846,0.206186443567276,0.2537499964237213,598.9583129882812,1e-05,0.06748032569885254,2.3540914058685303,23.927850246429443,2 +7589,0.1794177144765854,0.21555748581886292,0.2194640189409256,0.23275640606880188,974.9119873046875,1e-05,0.07787466794252396,2.3528714179992676,23.927850246429443,2 +7590,0.18839412927627563,0.1746554672718048,0.17854757606983185,0.22458332777023315,646.7181396484375,1e-05,0.07866472005844116,2.3511197566986084,23.927850246429443,2 +7591,0.1357077956199646,0.04522549360990524,0.05007396265864372,0.10801281780004501,958.2166748046875,1e-05,0.05593661591410637,2.3486318588256836,23.927850246429443,2 +7592,0.3928212821483612,0.14345616102218628,0.14236709475517273,0.27115383744239807,772.9007568359375,1e-05,0.07854834944009781,2.3481178283691406,23.927850246429443,2 +7593,0.254042387008667,0.29872021079063416,0.2937600314617157,0.29134613275527954,960.1112060546875,1e-05,0.0729585513472557,2.7013051509857178,23.927850246429443,2 +7594,0.21525920927524567,0.20814518630504608,0.20221950113773346,0.2549999952316284,750.0000610351562,1e-05,0.07474862784147263,2.578566074371338,23.927850246429443,2 +7595,0.17256398499011993,0.19186076521873474,0.18930329382419586,0.1417948603630066,863.7206420898438,1e-05,0.06137503683567047,2.4644899368286133,23.927850246429443,2 +7596,0.16554531455039978,0.22941981256008148,0.2277776300907135,0.15705128014087677,434.0730895996094,1e-05,0.06106220930814743,2.3486618995666504,23.927850246429443,2 +7597,0.25132495164871216,0.22938647866249084,0.22292806208133698,0.23326922953128815,917.9064331054688,1e-05,0.06802796572446823,2.7343080043792725,23.927850246429443,2 +7598,0.1396266222000122,0.17312613129615784,0.17032495141029358,0.2265705019235611,715.8119506835938,1e-05,0.06674367189407349,2.3565354347229004,23.927850246429443,2 +7599,0.3283616006374359,0.6690384745597839,0.7113239169120789,0.18169870972633362,38.75969314575195,1e-05,0.08360413461923599,2.3537979125976562,23.927850246429443,2 +7600,0.1753355711698532,0.22349049150943756,0.23570677638053894,0.20112179219722748,988.7123413085938,1e-05,0.07750261574983597,2.357156991958618,23.927850246429443,2 +7601,0.14666493237018585,0.13938772678375244,0.13375437259674072,0.2621474266052246,904.3141479492188,1e-05,0.06482617557048798,2.3571324348449707,23.927850246429443,2 +7602,0.2700754404067993,0.8759588003158569,0.8813008069992065,0.09637819975614548,61.78706741333008,1e-05,0.0877748653292656,2.358441114425659,23.927850246429443,2 +7603,0.18040983378887177,0.09390784800052643,0.09257623553276062,0.11262819916009903,700.7908935546875,1e-05,0.07798822224140167,2.5009639263153076,23.927850246429443,2 +7604,0.13544921576976776,0.17221321165561676,0.17462049424648285,0.2103525549173355,853.9290161132812,1e-05,0.06872247159481049,2.483179807662964,23.927850246429443,2 +7605,0.1480989307165146,0.23594659566879272,0.2196597456932068,0.24310895800590515,922.088134765625,1e-05,0.07528242468833923,2.569361686706543,23.927850246429443,2 +7606,0.23131060600280762,0.17061524093151093,0.16822093725204468,0.30320510268211365,619.959716796875,1e-05,0.08799982070922852,2.3583552837371826,23.927850246429443,2 +7607,0.18778586387634277,0.12614154815673828,0.1379944533109665,0.1565384566783905,985.1694946289062,1e-05,0.07004479318857193,2.460374593734741,23.927850246429443,2 +7608,0.15935330092906952,0.1466151475906372,0.1438571959733963,0.23115383088588715,868.4371337890625,1e-05,0.07596077769994736,2.4911227226257324,23.927850246429443,2 +7609,0.2311030477285385,0.129686638712883,0.14114944636821747,0.20480768382549286,573.5930786132812,1e-05,0.08046465367078781,2.361257314682007,23.927850246429443,2 +7610,0.21899524331092834,0.20450492203235626,0.2244867980480194,0.21967947483062744,977.787353515625,1e-05,0.07077065855264664,2.353783369064331,23.927850246429443,2 +7611,0.2128704935312271,0.16143617033958435,0.14858302474021912,0.2675640881061554,802.9328002929688,1e-05,0.07021652162075043,2.3522825241088867,23.927850246429443,2 +7612,0.2804414629936218,0.34993302822113037,0.34496885538101196,0.2667628228664398,431.9371643066406,1e-05,0.0661599189043045,2.350402593612671,23.927850246429443,2 +7613,0.12960052490234375,0.20549695193767548,0.1989404559135437,0.2149999886751175,708.4055786132812,1e-05,0.07202383875846863,2.3497140407562256,23.927850246429443,2 +7614,0.1434435248374939,0.11694151163101196,0.12845772504806519,0.18214742839336395,888.7283325195312,1e-05,0.0826277956366539,2.5638370513916016,23.927850246429443,2 +7615,0.4026559293270111,0.14354144036769867,0.15921421349048615,0.12743589282035828,478.3950500488281,1e-05,0.09511841833591461,2.349809408187866,23.927850246429443,2 +7616,0.16141578555107117,0.14138555526733398,0.1369597166776657,0.24618588387966156,916.4888305664062,1e-05,0.07099054753780365,2.62532901763916,23.927850246429443,2 +7617,0.10525747388601303,0.49025678634643555,0.4840181767940521,0.28785255551338196,992.1616821289062,1e-05,0.06420645117759705,2.3579251766204834,23.927850246429443,2 +7618,0.2847299575805664,0.2131626009941101,0.21298065781593323,0.22064101696014404,695.9219970703125,1e-05,0.07779711484909058,2.5733745098114014,23.927850246429443,2 +7619,0.11228616535663605,0.10235829651355743,0.1045149713754654,0.10634615272283554,935.2970581054688,1e-05,0.06851541250944138,2.590114116668701,23.927850246429443,2 +7620,0.17028963565826416,0.13324786722660065,0.13513579964637756,0.2654166519641876,892.0389404296875,1e-05,0.07431595772504807,2.358118772506714,23.927850246429443,2 +7621,0.23428723216056824,0.44481903314590454,0.41662704944610596,0.19990384578704834,996.9635620117188,1e-05,0.09117182344198227,2.348616600036621,23.927850246429443,2 +7622,0.25840991735458374,0.1749386340379715,0.17119140923023224,0.13887819647789001,616.125732421875,1e-05,0.05983937531709671,2.354384422302246,23.927850246429443,2 +7623,0.18450988829135895,0.20871394872665405,0.19611692428588867,0.24445511400699615,966.4247436523438,1e-05,0.07307247817516327,2.349130868911743,23.927850246429443,2 +7624,0.21423204243183136,0.1947123110294342,0.18186789751052856,0.20384614169597626,953.7914428710938,1e-05,0.08432476222515106,2.5794143676757812,23.927850246429443,2 +7625,0.22433024644851685,0.13185687363147736,0.13118962943553925,0.16874998807907104,678.7020263671875,1e-05,0.0707419365644455,2.5465099811553955,23.927850246429443,2 +7626,0.20790888369083405,0.2706093490123749,0.26108190417289734,0.2420833259820938,975.3954467773438,1e-05,0.073097825050354,2.4991772174835205,23.927850246429443,2 +7627,0.30142804980278015,0.2298356145620346,0.22383008897304535,0.2663140892982483,505.9523620605469,1e-05,0.08351340144872665,2.567375659942627,23.927850246429443,2 +7628,0.0973733589053154,0.13753969967365265,0.14368288218975067,0.23269230127334595,956.0206298828125,1e-05,0.07485740631818771,2.3571720123291016,23.927850246429443,2 +7629,0.15182828903198242,0.1002548411488533,0.10034016519784927,0.1638782024383545,917.9064331054688,1e-05,0.07270041108131409,2.5832419395446777,23.927850246429443,2 +7630,0.21135343611240387,0.12819159030914307,0.1389084905385971,0.19419871270656586,649.0385131835938,1e-05,0.0851583406329155,2.3650803565979004,23.927850246429443,2 +7631,0.1577167958021164,0.17929357290267944,0.18205897510051727,0.24333332479000092,991.52197265625,1e-05,0.07724029570817947,2.3518362045288086,23.927850246429443,2 +7632,0.2319585531949997,0.2402014285326004,0.24386583268642426,0.31669870018959045,464.8240966796875,1e-05,0.0885833278298378,2.353475570678711,23.927850246429443,2 +7633,0.23491749167442322,0.28330808877944946,0.2826172411441803,0.1899999976158142,939.36376953125,1e-05,0.0673321783542633,2.3547046184539795,23.927850246429443,2 +7634,0.23104193806648254,0.2022159993648529,0.2136271744966507,0.1733333319425583,959.5725708007812,1e-05,0.0688851848244667,2.3530797958374023,23.927850246429443,2 +7635,0.2337374985218048,0.12600167095661163,0.12875865399837494,0.2940064072608948,729.1666870117188,1e-05,0.08625098317861557,2.497621536254883,23.927850246429443,2 +7636,0.19417887926101685,0.2321539968252182,0.23251907527446747,0.216057687997818,476.4851989746094,1e-05,0.07420609146356583,2.3535196781158447,23.927850246429443,2 +7637,0.29984214901924133,0.19467732310295105,0.19317403435707092,0.15907050669193268,464.8240966796875,1e-05,0.08069619536399841,2.596626043319702,23.927850246429443,2 +7638,0.1153053343296051,0.19553439319133759,0.19146671891212463,0.23480768501758575,956.2970581054688,1e-05,0.07089629024267197,2.353853940963745,23.927850246429443,2 +7639,0.144682839512825,0.18219032883644104,0.18934516608715057,0.1624358892440796,314.37127685546875,1e-05,0.07185911387205124,2.347625255584717,23.927850246429443,2 +7640,0.2166764736175537,0.19987744092941284,0.195418119430542,0.23615384101867676,892.0389404296875,1e-05,0.09090857207775116,2.592676877975464,23.927850246429443,2 +7641,0.23957358300685883,0.31251418590545654,0.3139762580394745,0.25708332657814026,583.6886596679688,1e-05,0.07565128803253174,2.3510258197784424,23.927850246429443,2 +7642,0.22514313459396362,0.14630071818828583,0.14452368021011353,0.21964742243289948,741.8699340820312,1e-05,0.08331889659166336,2.3501553535461426,23.927850246429443,2 +7643,0.15142297744750977,0.09918512403964996,0.09602563828229904,0.2574999928474426,952.09716796875,1e-05,0.09078074991703033,2.3469114303588867,23.927850246429443,2 +7644,0.27450627088546753,0.20515918731689453,0.19725078344345093,0.13314102590084076,931.1224365234375,1e-05,0.0721018835902214,2.346519708633423,23.927850246429443,2 +7645,0.14901864528656006,0.23487210273742676,0.2523795962333679,0.19894230365753174,359.68658447265625,1e-05,0.09218580275774002,2.3453972339630127,23.927850246429443,2 +7646,0.16877387464046478,0.14401794970035553,0.1470346748828888,0.2075641006231308,897.6888427734375,1e-05,0.08528203517198563,2.4825260639190674,23.927850246429443,2 +7647,0.16329795122146606,0.2753881514072418,0.27536410093307495,0.1946474313735962,988.2747802734375,1e-05,0.0678805261850357,2.349257707595825,23.927850246429443,2 +7648,0.14813973009586334,0.29337385296821594,0.2971044182777405,0.2626281976699829,994.4806518554688,1e-05,0.07437516748905182,2.5710456371307373,23.927850246429443,2 +7649,0.16974098980426788,0.23110373318195343,0.21819381415843964,0.17330127954483032,989.148681640625,1e-05,0.07574629783630371,2.350863218307495,23.927850246429443,2 +7650,0.23950423300266266,0.09186526387929916,0.10244954377412796,0.2069871723651886,805.4765625,1e-05,0.07210022211074829,2.5185654163360596,23.927850246429443,2 +7651,0.26448407769203186,0.2648428976535797,0.2542338967323303,0.18224358558654785,973.2064208984375,1e-05,0.07019996643066406,2.47074031829834,23.927850246429443,2 +7652,0.21363817155361176,0.10057362169027328,0.10813847929239273,0.24262820184230804,713.9794311523438,1e-05,0.07501120120286942,2.346350908279419,23.927850246429443,2 +7653,0.17676495015621185,0.21038027107715607,0.19816702604293823,0.24823717772960663,698.8536376953125,1e-05,0.06298311054706573,2.349247694015503,23.927850246429443,2 +7654,0.10752063244581223,0.20908381044864655,0.20065481960773468,0.21541665494441986,871.670654296875,1e-05,0.06951098889112473,2.3439853191375732,23.927850246429443,2 +7655,0.09823082387447357,0.15449707210063934,0.1448449045419693,0.25112178921699524,878.85986328125,1e-05,0.07375772297382355,2.347385883331299,23.927850246429443,2 +7656,0.10867514461278915,0.16664938628673553,0.16018925607204437,0.2452884465456009,936.2449951171875,1e-05,0.06846005469560623,2.5105180740356445,23.927850246429443,2 +7657,0.2206634134054184,0.10305394232273102,0.09565325081348419,0.21307691931724548,789.0855712890625,1e-05,0.08543548732995987,2.4996397495269775,23.927850246429443,2 +7658,0.24429234862327576,0.19771306216716766,0.20214003324508667,0.22852563858032227,582.2649536132812,1e-05,0.06119867414236069,2.761125087738037,23.927850246429443,2 +7659,0.17889466881752014,0.20653222501277924,0.2188078761100769,0.21689102053642273,573.5930786132812,1e-05,0.06390272825956345,2.4832141399383545,23.927850246429443,2 +7660,0.2333507537841797,0.2146693617105484,0.20968803763389587,0.2292628139257431,576.5086669921875,1e-05,0.07163726538419724,2.3659873008728027,23.927850246429443,2 +7661,0.15687909722328186,0.18578392267227173,0.17837569117546082,0.25862178206443787,893.2648315429688,1e-05,0.0662713497877121,2.628897190093994,23.927850246429443,2 +7662,0.13218194246292114,0.3392549455165863,0.32790592312812805,0.17884615063667297,992.7984008789062,1e-05,0.07648269832134247,2.3641445636749268,23.927850246429443,2 +7663,0.14466512203216553,0.1904296725988388,0.20122118294239044,0.23493589460849762,979.4371948242188,1e-05,0.08441420644521713,2.3569631576538086,23.927850246429443,2 +7664,0.26383885741233826,0.22358158230781555,0.21271394193172455,0.302467942237854,736.0197143554688,1e-05,0.076687753200531,2.3630459308624268,23.927850246429443,2 +7665,0.22125263512134552,0.048265740275382996,0.050277192145586014,0.13105769455432892,928.4979858398438,1e-05,0.0657409280538559,2.361473798751831,23.927850246429443,2 +7666,0.1823476105928421,0.061514027416706085,0.06559823453426361,0.16032050549983978,881.0508422851562,1e-05,0.0772874504327774,2.361790180206299,23.927850246429443,2 +7667,0.297184020280838,0.414069265127182,0.41357776522636414,0.18666665256023407,992.58642578125,1e-05,0.07954877614974976,2.6112375259399414,23.927850246429443,2 +7668,0.19626714289188385,0.08196880668401718,0.08746187388896942,0.24173076450824738,813.5474853515625,1e-05,0.06503673642873764,2.4767873287200928,23.927850246429443,2 +7669,0.1533759981393814,0.20033524930477142,0.2021598517894745,0.20980767905712128,934.6619262695312,1e-05,0.06963275372982025,2.4963347911834717,23.927850246429443,2 +7670,0.16868002712726593,0.23918335139751434,0.23437078297138214,0.23134614527225494,682.8494262695312,1e-05,0.08402969688177109,2.3647990226745605,23.927850246429443,2 +7671,0.2204330861568451,0.1282496452331543,0.13304969668388367,0.21753203868865967,600.3118286132812,1e-05,0.07568762451410294,2.4590163230895996,23.927850246429443,2 +7672,0.22898945212364197,0.16087369620800018,0.15042629837989807,0.1935897320508957,847.2938232421875,1e-05,0.07210800051689148,2.4782915115356445,23.927850246429443,2 +7673,0.289242684841156,0.11787668615579605,0.12077374011278152,0.19621793925762177,683.8768310546875,1e-05,0.07627302408218384,2.352435827255249,23.927850246429443,2 +7674,0.18032227456569672,0.3692135512828827,0.353872686624527,0.23666666448116302,997.9838256835938,1e-05,0.07262034714221954,2.352567195892334,23.927850246429443,2 +7675,0.24177609384059906,0.3159244954586029,0.30495256185531616,0.2200961410999298,986.50927734375,1e-05,0.07223038375377655,2.3491859436035156,23.927850246429443,2 +7676,0.1596749722957611,0.16423796117305756,0.1573566496372223,0.17166666686534882,954.6314086914062,1e-05,0.0707281231880188,2.3478763103485107,23.927850246429443,2 +7677,0.1627126932144165,0.19862566888332367,0.19379636645317078,0.20365384221076965,539.7727661132812,1e-05,0.06596681475639343,2.500143527984619,23.927850246429443,2 +7678,0.1302635222673416,0.12721189856529236,0.13490796089172363,0.26124998927116394,869.8297119140625,1e-05,0.06923098117113113,2.4636754989624023,23.927850246429443,2 +7679,0.20071250200271606,0.13460388779640198,0.13181990385055542,0.15833333134651184,753.9683227539062,1e-05,0.0687662661075592,2.5160207748413086,23.927850246429443,2 +7680,0.15683478116989136,0.15385021269321442,0.16381287574768066,0.1539423018693924,544.5823974609375,1e-05,0.06241527199745178,2.5084543228149414,23.927850246429443,2 +7681,0.17418423295021057,0.3935914933681488,0.39375409483909607,0.25660255551338196,261.0759582519531,1e-05,0.0730092003941536,2.349186658859253,23.927850246429443,2 +7682,0.22463369369506836,0.11084375530481339,0.11346648633480072,0.14355768263339996,699.823974609375,1e-05,0.06773236393928528,2.558184862136841,23.927850246429443,2 +7683,0.12674076855182648,0.20335426926612854,0.20207712054252625,0.27128204703330994,995.10595703125,1e-05,0.0613168329000473,2.350090980529785,23.927850246429443,2 +7684,0.29449301958084106,0.3628352880477905,0.3762721121311188,0.2117948681116104,254.77706909179688,1e-05,0.07923342287540436,2.345302104949951,23.927850246429443,2 +7685,0.14745981991291046,0.22796152532100677,0.22241027653217316,0.19573716819286346,727.4247436523438,1e-05,0.06311041116714478,2.3460018634796143,23.927850246429443,2 +7686,0.09920468181371689,0.13896968960762024,0.1445775181055069,0.11407050490379333,737.7049560546875,1e-05,0.08054373413324356,2.344644546508789,23.927850246429443,2 +7687,0.29841792583465576,0.2553809583187103,0.25047701597213745,0.1550961434841156,519.8598022460938,1e-05,0.07782264053821564,2.3436694145202637,23.927850246429443,2 +7688,0.1911875158548355,0.11471444368362427,0.11481404304504395,0.2759294807910919,634.842529296875,1e-05,0.07640983164310455,2.4834234714508057,23.927850246429443,2 +7689,0.31331300735473633,0.31679782271385193,0.3173481225967407,0.2749038338661194,364.73089599609375,1e-05,0.0770232304930687,2.5687530040740967,23.927850246429443,2 +7690,0.2485841065645218,0.35829034447669983,0.35147517919540405,0.1355128139257431,294.342529296875,1e-05,0.0660335049033165,2.364690065383911,23.927850246429443,2 +7691,0.21402877569198608,0.2205115258693695,0.20659540593624115,0.21592947840690613,961.4497680664062,1e-05,0.08004048466682434,2.4839208126068115,23.927850246429443,2 +7692,0.18412069976329803,0.5589994788169861,0.5329579710960388,0.2211538404226303,83.95523071289062,1e-05,0.07163558900356293,2.3509485721588135,23.927850246429443,2 +7693,0.1335807591676712,0.2037227898836136,0.20478123426437378,0.2759615182876587,998.9959716796875,1e-05,0.08353648334741592,2.5298633575439453,23.927850246429443,2 +7694,0.1354675590991974,0.22776062786579132,0.21231406927108765,0.20512819290161133,949.8078002929688,1e-05,0.0681576356291771,2.3491246700286865,23.927850246429443,2 +7695,0.287369042634964,0.2746647000312805,0.2773281931877136,0.21804486215114594,458.8607482910156,1e-05,0.08174039423465729,2.3501503467559814,23.927850246429443,2 +7696,0.08300244808197021,0.10846278816461563,0.10614285618066788,0.2935897409915924,652.4856567382812,1e-05,0.05870005860924721,2.3523826599121094,23.927850246429443,2 +7697,0.24814416468143463,0.3156746029853821,0.3032841384410858,0.2295512706041336,992.374267578125,1e-05,0.08952133357524872,2.3493802547454834,23.927850246429443,2 +7698,0.23501959443092346,0.6869258880615234,0.6870484948158264,0.13112178444862366,88.28997039794922,1e-05,0.07115045189857483,2.509852647781372,23.927850246429443,2 +7699,0.2744254171848297,0.18653112649917603,0.17440994083881378,0.213365375995636,873.4939575195312,1e-05,0.07082270830869675,2.3697969913482666,23.927850246429443,2 +7700,0.17834188044071198,0.1592177450656891,0.15541420876979828,0.14051280915737152,773.6281127929688,1e-05,0.07373704761266708,2.586513042449951,23.927850246429443,2 +7701,0.1354743391275406,0.1534368097782135,0.16068950295448303,0.2199038416147232,935.6137084960938,1e-05,0.08755263686180115,2.4484922885894775,23.927850246429443,2 +7702,0.20185324549674988,0.17957106232643127,0.1677631139755249,0.25217947363853455,876.1961669921875,1e-05,0.07352873682975769,2.366715669631958,23.927850246429443,2 +7703,0.2637673616409302,0.906370997428894,0.9046148657798767,0.2815384566783905,48.076927185058594,1e-05,0.07966014742851257,2.568235397338867,23.927850246429443,2 +7704,0.21101899445056915,0.06952623277902603,0.08080175518989563,0.2202884554862976,870.7523803710938,1e-05,0.07314818352460861,2.3626809120178223,23.927850246429443,2 +7705,0.156717911362648,0.23553867638111115,0.23697073757648468,0.19423076510429382,946.0116577148438,1e-05,0.0661594569683075,2.346679210662842,23.927850246429443,2 +7706,0.3203377425670624,0.2626875340938568,0.2640922963619232,0.2568589746952057,484.06866455078125,1e-05,0.0858549103140831,2.3497602939605713,23.927850246429443,2 +7707,0.16074909269809723,0.18032261729240417,0.16883018612861633,0.23333331942558289,953.2288818359375,1e-05,0.06671447306871414,2.3483452796936035,23.927850246429443,2 +7708,0.30724868178367615,0.5680312514305115,0.5659554600715637,0.2137499898672104,133.9285888671875,1e-05,0.10667477548122406,2.346510171890259,23.927850246429443,2 +7709,0.16879625618457794,0.24891124665737152,0.23483744263648987,0.23628203570842743,995.10595703125,1e-05,0.06172672659158707,2.479862928390503,23.927850246429443,2 +7710,0.24218828976154327,0.16513095796108246,0.15164734423160553,0.23666666448116302,863.7206420898438,1e-05,0.06107870861887932,2.3494956493377686,23.927850246429443,2 +7711,0.15976430475711823,0.11404751241207123,0.11490631103515625,0.22044870257377625,869.8297119140625,1e-05,0.06544671207666397,2.521817445755005,23.927850246429443,2 +7712,0.20243611931800842,0.15537039935588837,0.1561710089445114,0.19112178683280945,542.9864501953125,1e-05,0.08227840065956116,2.554420232772827,23.927850246429443,2 +7713,0.1779489517211914,0.36930063366889954,0.3528442084789276,0.26653844118118286,989.5833129882812,1e-05,0.06470420956611633,2.3547022342681885,23.927850246429443,2 +7714,0.10348916053771973,0.13824687898159027,0.14097684621810913,0.26980769634246826,771.4395751953125,1e-05,0.06034161150455475,2.594012975692749,23.927850246429443,2 +7715,0.24047216773033142,0.185973659157753,0.1800118088722229,0.20339742302894592,719.4397583007812,1e-05,0.06308266520500183,2.3481645584106445,23.927850246429443,2 +7716,0.23957204818725586,0.24179238080978394,0.24279338121414185,0.31746792793273926,689.9642333984375,1e-05,0.09219717234373093,2.349010467529297,23.927850246429443,2 +7717,0.19669389724731445,0.19768312573432922,0.19131119549274445,0.23624999821186066,629.9603271484375,1e-05,0.0887087881565094,2.3495702743530273,23.927850246429443,2 +7718,0.26483798027038574,0.2858356535434723,0.2844575345516205,0.2549038231372833,998.592041015625,1e-05,0.07524265348911285,2.3535408973693848,23.927850246429443,2 +7719,0.19733162224292755,0.24844861030578613,0.2469833344221115,0.2768910229206085,672.3660278320312,1e-05,0.07306147366762161,2.35701060295105,23.927850246429443,2 +7720,0.17984111607074738,0.09057580679655075,0.0988837257027626,0.2574358880519867,873.039794921875,1e-05,0.07228048145771027,2.355088949203491,23.927850246429443,2 +7721,0.24984779953956604,0.25522249937057495,0.2605382800102234,0.08554486930370331,288.4615478515625,1e-05,0.07500472664833069,2.470804452896118,23.927850246429443,2 +7722,0.2524881064891815,0.08179108053445816,0.08520301431417465,0.12323717772960663,612.2449340820312,1e-05,0.07595749199390411,2.6173007488250732,23.927850246429443,2 +7723,0.20629101991653442,0.26829689741134644,0.2693805396556854,0.12964743375778198,333.5777282714844,1e-05,0.06779701262712479,2.3583641052246094,23.927850246429443,2 +7724,0.2098778784275055,0.4123433530330658,0.4181358516216278,0.16717948019504547,183.4470977783203,1e-05,0.07643012702465057,2.3485536575317383,23.927850246429443,2 +7725,0.15495122969150543,0.14131425321102142,0.13995133340358734,0.2445192188024521,875.74853515625,1e-05,0.08198095858097076,2.7029075622558594,23.927850246429443,2 +7726,0.3210526704788208,0.1693664938211441,0.1603655219078064,0.11249999701976776,920.7059936523438,1e-05,0.07413459569215775,2.35795259475708,23.927850246429443,2 +7727,0.0920158177614212,0.2088010460138321,0.19885703921318054,0.29971152544021606,804.8433837890625,1e-05,0.06098272651433945,2.3493802547454834,23.927850246429443,2 +7728,0.2596795856952667,0.2355525940656662,0.224002867937088,0.323108971118927,889.5617065429688,1e-05,0.07325610518455505,2.3483705520629883,23.927850246429443,2 +7729,0.2576477527618408,0.18881775438785553,0.19657276570796967,0.18224358558654785,775.0761108398438,1e-05,0.07312151789665222,2.3476765155792236,23.927850246429443,2 +7730,0.22922691702842712,0.2643691897392273,0.2622222304344177,0.18224358558654785,352.0115051269531,1e-05,0.05557272210717201,2.4616036415100098,23.927850246429443,2 +7731,0.2786407172679901,0.41134580969810486,0.4067065715789795,0.2640705108642578,369.71832275390625,1e-05,0.0790824368596077,2.5658416748046875,23.927850246429443,2 +7732,0.1507072150707245,0.1335507035255432,0.1280268281698227,0.2761538326740265,900.8379516601562,1e-05,0.06446486711502075,2.4810094833374023,23.927850246429443,2 +7733,0.25022396445274353,0.1938258707523346,0.20304974913597107,0.23528845608234406,713.9794311523438,1e-05,0.07361172884702682,2.510439872741699,23.927850246429443,2 +7734,0.21896377205848694,0.14662007987499237,0.15129277110099792,0.24891024827957153,884.0750122070312,1e-05,0.07793524861335754,2.346717596054077,23.927850246429443,2 +7735,0.2328592836856842,0.31322386860847473,0.32650113105773926,0.2101602554321289,273.4375,1e-05,0.08182559162378311,2.4666428565979004,23.927850246429443,2 +7736,0.15212595462799072,0.24805524945259094,0.24819590151309967,0.1831730753183365,608.3162231445312,1e-05,0.07312189042568207,2.5080690383911133,23.927850246429443,2 +7737,0.14122802019119263,0.12570708990097046,0.13085556030273438,0.18342947959899902,881.0508422851562,1e-05,0.10117334127426147,2.3522775173187256,23.927850246429443,2 +7738,0.22562991082668304,0.20599859952926636,0.19576700031757355,0.2945833206176758,920.7059936523438,1e-05,0.0751929059624672,2.3468594551086426,23.927850246429443,2 +7739,0.21476486325263977,0.23084087669849396,0.2316027134656906,0.11971153318881989,384.3490905761719,1e-05,0.08271091431379318,2.350391387939453,23.927850246429443,2 +7740,0.06659653782844543,0.09401576966047287,0.110899917781353,0.22929486632347107,912.8910522460938,1e-05,0.06249570474028587,2.5635313987731934,23.927850246429443,2 +7741,0.18977005779743195,0.16127584874629974,0.14907750487327576,0.2006089687347412,885.7808837890625,1e-05,0.06424093246459961,2.3612489700317383,23.927850246429443,2 +7742,0.21288180351257324,0.09542173892259598,0.10865069180727005,0.14044871926307678,985.1694946289062,1e-05,0.07798344641923904,2.472123146057129,23.927850246429443,2 +7743,0.1290208101272583,0.20218263566493988,0.20388484001159668,0.25246793031692505,516.4320068359375,1e-05,0.06636619567871094,2.5062615871429443,23.927850246429443,2 +7744,0.13330133259296417,0.27499791979789734,0.2713591158390045,0.1913461536169052,877.9761962890625,1e-05,0.1005837693810463,2.362215042114258,23.927850246429443,2 +7745,0.0821211189031601,0.07829710841178894,0.0855841264128685,0.25070512294769287,795.1236572265625,1e-05,0.06138230115175247,2.3505120277404785,23.927850246429443,2 +7746,0.20353013277053833,0.16103595495224,0.15809999406337738,0.1666666567325592,604.3388061523438,1e-05,0.0638871043920517,2.6705148220062256,23.927850246429443,2 +7747,0.16392113268375397,0.22648176550865173,0.21874119341373444,0.21983973681926727,649.0385131835938,1e-05,0.07421067357063293,2.355644941329956,23.927850246429443,2 +7748,0.2560615837574005,0.29306986927986145,0.28435683250427246,0.25852563977241516,555.5556030273438,1e-05,0.07167991995811462,2.350346326828003,23.927850246429443,2 +7749,0.2882169485092163,0.10489363968372345,0.11189375817775726,0.173429474234581,768.4899291992188,1e-05,0.06697419285774231,2.342529296875,23.927850246429443,2 +7750,0.33935683965682983,0.2711235582828522,0.2725270688533783,0.27503204345703125,379.5264587402344,1e-05,0.06456766277551651,2.3492467403411865,23.927850246429443,2 +7751,0.13473784923553467,0.19588209688663483,0.19594620168209076,0.26791664958000183,914.3394165039062,1e-05,0.06849576532840729,2.4615447521209717,23.927850246429443,2 +7752,0.13355161249637604,0.1566009670495987,0.15127968788146973,0.2755448520183563,872.5845947265625,1e-05,0.06072085350751877,2.497279167175293,23.927850246429443,2 +7753,0.18627285957336426,0.40830177068710327,0.43499115109443665,0.10602563619613647,105.31136322021484,1e-05,0.06613991409540176,2.3494181632995605,23.927850246429443,2 +7754,0.257614403963089,0.17259521782398224,0.185811385512352,0.19669871032238007,369.71832275390625,1e-05,0.07354353368282318,2.714529514312744,23.927850246429443,2 +7755,0.19573095440864563,0.12137773633003235,0.1332826465368271,0.20445512235164642,818.9655151367188,1e-05,0.07009771466255188,2.354862689971924,23.927850246429443,2 +7756,0.266579270362854,0.31608685851097107,0.31727421283721924,0.22971153259277344,593.4874267578125,1e-05,0.0757298544049263,2.3488831520080566,23.927850246429443,2 +7757,0.10216156393289566,0.20698872208595276,0.20814189314842224,0.23666666448116302,948.6500244140625,1e-05,0.06121871992945671,2.577954053878784,23.927850246429443,2 +7758,0.21114873886108398,0.24482296407222748,0.2350539118051529,0.24612177908420563,711.2069091796875,1e-05,0.060013897716999054,2.3493735790252686,23.927850246429443,2 +7759,0.24592000246047974,0.18391811847686768,0.19666075706481934,0.23362179100513458,374.6498718261719,1e-05,0.07081510871648788,2.347747802734375,23.927850246429443,2 +7760,0.22397202253341675,0.0965561494231224,0.09785530716180801,0.09275640547275543,714.8972778320312,1e-05,0.06397905200719833,2.344020128250122,23.927850246429443,2 +7761,0.20995144546031952,0.1265326291322708,0.1348804384469986,0.11804486811161041,961.9814453125,1e-05,0.06031808629631996,2.3448095321655273,23.927850246429443,2 +7762,0.15080197155475616,0.3062971830368042,0.30854281783103943,0.22554486989974976,981.7597045898438,1e-05,0.1340436041355133,2.5011847019195557,23.927850246429443,2 +7763,0.2740211486816406,0.19580994546413422,0.1788661777973175,0.2581089735031128,835.5437622070312,1e-05,0.0638517513871193,2.472289562225342,23.927850246429443,2 +7764,0.23623518645763397,0.17511612176895142,0.17402036488056183,0.22621794044971466,653.6259765625,1e-05,0.061784181743860245,2.350916862487793,23.927850246429443,2 +7765,0.23351098597049713,0.10796406120061874,0.11716775596141815,0.1665704995393753,526.620361328125,1e-05,0.07247520983219147,2.5186681747436523,23.927850246429443,2 +7766,0.16577528417110443,0.14173340797424316,0.14700773358345032,0.134262815117836,952.3810424804688,1e-05,0.07855942845344543,2.3510918617248535,23.927850246429443,2 +7767,0.26542598009109497,0.13547050952911377,0.1313829869031906,0.20112179219722748,868.9024658203125,1e-05,0.0706617683172226,2.4909751415252686,23.927850246429443,2 +7768,0.21917562186717987,0.1710982620716095,0.1573878824710846,0.24458332359790802,504.1766052246094,1e-05,0.06825738400220871,2.4756853580474854,23.927850246429443,2 +7769,0.2586020231246948,0.22301360964775085,0.21565550565719604,0.20355768501758575,877.9761962890625,1e-05,0.07171957939863205,2.3518645763397217,23.927850246429443,2 +7770,0.31309086084365845,0.10765159875154495,0.11072603613138199,0.24374999105930328,792.4597778320312,1e-05,0.07988734543323517,2.3496882915496826,23.927850246429443,2 +7771,0.129124715924263,0.1352020800113678,0.1392524093389511,0.20266024768352509,725.671142578125,1e-05,0.05753764137625694,2.350160837173462,23.927850246429443,2 +7772,0.13680535554885864,0.09079957753419876,0.08882801979780197,0.1883653849363327,864.197509765625,1e-05,0.069844089448452,2.468867063522339,23.927850246429443,2 +7773,0.19839374721050262,0.20512785017490387,0.19265152513980865,0.22929486632347107,951.5281982421875,1e-05,0.0630946159362793,2.3548905849456787,23.927850246429443,2 +7774,0.22069406509399414,0.18216072022914886,0.17222559452056885,0.20371794700622559,801.64990234375,1e-05,0.06583012640476227,2.351933240890503,23.927850246429443,2 +7775,0.283176064491272,0.20892047882080078,0.2035980075597763,0.29798075556755066,752.3885498046875,1e-05,0.08113162219524384,2.351278066635132,23.927850246429443,2 +7776,0.19298061728477478,0.13925865292549133,0.1389230638742447,0.2472115308046341,678.7020263671875,1e-05,0.06804262846708298,2.5884881019592285,23.927850246429443,2 +7777,0.13445527851581573,0.20618808269500732,0.20053406059741974,0.2557692229747772,597.59912109375,1e-05,0.059815991669893265,2.3501625061035156,23.927850246429443,2 +7778,0.21059373021125793,0.18412157893180847,0.1795516163110733,0.23310896754264832,938.7450561523438,1e-05,0.07059410959482193,2.4815566539764404,23.927850246429443,2 +7779,0.23270894587039948,0.33427131175994873,0.3211399018764496,0.3096153736114502,981.7597045898438,1e-05,0.07283978164196014,2.5907578468322754,23.927850246429443,2 +7780,0.13932564854621887,0.09556782245635986,0.09696390479803085,0.20634613931179047,746.7793579101562,1e-05,0.0649530366063118,2.348414659500122,23.927850246429443,2 +7781,0.17423248291015625,0.2408534437417984,0.23596233129501343,0.23608973622322083,963.5654907226562,1e-05,0.07246079295873642,2.3480348587036133,23.927850246429443,2 +7782,0.19823101162910461,0.12660959362983704,0.13173630833625793,0.19070512056350708,775.0761108398438,1e-05,0.06839516758918762,2.350419044494629,23.927850246429443,2 +7783,0.1652645617723465,0.20345617830753326,0.19557391107082367,0.2388141006231308,933.3839721679688,1e-05,0.0626947209239006,2.465440511703491,23.927850246429443,2 +7784,0.09595346450805664,0.15121135115623474,0.15394583344459534,0.22230768203735352,823.6697998046875,1e-05,0.055506039410829544,2.481555461883545,23.927850246429443,2 +7785,0.19407008588314056,0.16621175408363342,0.16189943253993988,0.23205126821994781,900.4474487304688,1e-05,0.06078600138425827,2.349496603012085,23.927850246429443,2 +7786,0.15986353158950806,0.2484167367219925,0.23981545865535736,0.20778845250606537,965.3915405273438,1e-05,0.06898772716522217,2.482062816619873,23.927850246429443,2 +7787,0.21922677755355835,0.12345791608095169,0.12234491854906082,0.10637819766998291,632.4110717773438,1e-05,0.07007860392332077,2.5055055618286133,23.927850246429443,2 +7788,0.17278707027435303,0.16606803238391876,0.161116361618042,0.21003204584121704,680.7832641601562,1e-05,0.059897132217884064,2.350588798522949,23.927850246429443,2 +7789,0.10128720104694366,0.1374540627002716,0.13344193994998932,0.21967947483062744,821.9178466796875,1e-05,0.064837746322155,2.5127193927764893,23.927850246429443,2 +7790,0.20009872317314148,0.1862127184867859,0.19740375876426697,0.23499998450279236,918.259033203125,1e-05,0.0847029909491539,2.3540735244750977,23.927850246429443,2 +7791,0.13633790612220764,0.1518932580947876,0.1432187259197235,0.26471152901649475,864.197509765625,1e-05,0.1330839842557907,2.349675416946411,23.927850246429443,2 +7792,0.18694035708904266,0.2785952687263489,0.27526748180389404,0.19099357724189758,957.39697265625,1e-05,0.06630872935056686,2.3513643741607666,23.927850246429443,2 +7793,0.2215682417154312,0.1356712281703949,0.13012346625328064,0.22467948496341705,829.4078369140625,1e-05,0.07022606581449509,2.3528196811676025,23.927850246429443,2 +7794,0.21831944584846497,0.22030456364154816,0.22117237746715546,0.11124999821186066,619.959716796875,1e-05,0.07227376103401184,2.6807401180267334,23.927850246429443,2 +7795,0.3076211214065552,0.09081614017486572,0.0998702421784401,0.2500961422920227,592.105224609375,1e-05,0.08537048101425171,2.3712801933288574,23.927850246429443,2 +7796,0.23071449995040894,0.3327004313468933,0.3278125822544098,0.21862179040908813,996.5530395507812,1e-05,0.06518113613128662,2.481147527694702,23.927850246429443,2 +7797,0.15809696912765503,0.13997426629066467,0.13659192621707916,0.23243588209152222,918.6107788085938,1e-05,0.07234153151512146,2.497857093811035,23.927850246429443,2 +7798,0.056596994400024414,0.2046651691198349,0.21007826924324036,0.2066987156867981,922.431884765625,1e-05,0.06961511075496674,2.3671717643737793,23.927850246429443,2 +7799,0.18350426852703094,0.09958309680223465,0.09657250344753265,0.10304486751556396,900.8379516601562,1e-05,0.06753376126289368,2.491105556488037,23.927850246429443,2 +7800,0.1820317804813385,0.6704587936401367,0.6831340789794922,0.20384614169597626,92.59259796142578,1e-05,0.06947152316570282,2.4990155696868896,23.927850246429443,2 +7801,0.265743225812912,0.14628607034683228,0.146959125995636,0.14945513010025024,514.7058715820312,1e-05,0.07315358519554138,2.3583216667175293,23.927850246429443,2 +7802,0.27068087458610535,0.27513328194618225,0.26435965299606323,0.16032050549983978,982.9059448242188,1e-05,0.06258659809827805,2.354665756225586,23.927850246429443,2 +7803,0.25644463300704956,0.16161245107650757,0.15329629182815552,0.28125,796.4441528320312,1e-05,0.07052033394575119,2.352133274078369,23.927850246429443,2 +7804,0.2969167232513428,0.2445679008960724,0.23703554272651672,0.16118589043617249,509.47869873046875,1e-05,0.0855647623538971,2.353654623031616,23.927850246429443,2 +7805,0.07141997665166855,0.27602165937423706,0.2811752259731293,0.29073718190193176,981.0671997070312,1e-05,0.058884669095277786,2.676861524581909,23.927850246429443,2 +7806,0.23596081137657166,0.29336580634117126,0.28351444005966187,0.26624998450279236,956.2970581054688,1e-05,0.08173611015081406,2.361057758331299,23.927850246429443,2 +7807,0.07056919485330582,0.15573444962501526,0.1456972062587738,0.20692306756973267,923.799560546875,1e-05,0.06575027108192444,2.5130858421325684,23.927850246429443,2 +7808,0.17969848215579987,0.21378161013126373,0.2137695550918579,0.23576922714710236,971.9750366210938,1e-05,0.06501810997724533,2.5468034744262695,23.927850246429443,2 +7809,0.17475625872612,0.25899767875671387,0.24719250202178955,0.25006410479545593,869.3666381835938,1e-05,0.07331358641386032,2.58512806892395,23.927850246429443,2 +7810,0.16746781766414642,0.19199725985527039,0.17768195271492004,0.23839743435382843,861.318359375,1e-05,0.0647900253534317,2.5018153190612793,23.927850246429443,2 +7811,0.20224259793758392,0.22564609348773956,0.20909090340137482,0.2866345942020416,952.9466552734375,1e-05,0.07720942795276642,2.357757568359375,23.927850246429443,2 +7812,0.17678454518318176,0.17933966219425201,0.18032994866371155,0.13333332538604736,713.0584106445312,1e-05,0.06409541517496109,2.3532142639160156,23.927850246429443,2 +7813,0.17023253440856934,0.16652226448059082,0.15703459084033966,0.24326921999454498,763.9968872070312,1e-05,0.06395775824785233,2.3527657985687256,23.927850246429443,2 +7814,0.19567301869392395,0.20474757254123688,0.1994493305683136,0.1953205019235611,829.4078369140625,1e-05,0.05677152797579765,2.3531062602996826,23.927850246429443,2 +7815,0.2102663815021515,0.2367960512638092,0.22293604910373688,0.24698716402053833,621.2273559570312,1e-05,0.06807247549295425,2.471651315689087,23.927850246429443,2 +7816,0.25166839361190796,0.13715694844722748,0.13339398801326752,0.2520192265510559,824.8300170898438,1e-05,0.07335428148508072,2.464001417160034,23.927850246429443,2 +7817,0.1932823210954666,0.1284324824810028,0.12448432296514511,0.15445512533187866,958.7605590820312,1e-05,0.053164269775152206,2.3648900985717773,23.927850246429443,2 +7818,0.2944933772087097,0.4232639968395233,0.42214804887771606,0.17115384340286255,322.7003173828125,1e-05,0.08075293898582458,2.6564555168151855,23.927850246429443,2 +7819,0.11145270615816116,0.2709973156452179,0.2565222978591919,0.20961537957191467,984.494384765625,1e-05,0.060377027839422226,2.355468988418579,23.927850246429443,2 +7820,0.31495022773742676,0.23271028697490692,0.23206767439842224,0.22817306220531464,961.1829223632812,1e-05,0.06910700350999832,2.5112478733062744,23.927850246429443,2 +7821,0.17905277013778687,0.15319059789180756,0.1488756239414215,0.2014743536710739,894.0774536132812,1e-05,0.061653364449739456,2.593851089477539,23.927850246429443,2 +7822,0.20947659015655518,0.22825095057487488,0.21902978420257568,0.2107371687889099,930.4703369140625,1e-05,0.07057186961174011,2.3545238971710205,23.927850246429443,2 +7823,0.20293183624744415,0.2294694036245346,0.23381739854812622,0.21076922118663788,976.5967407226562,1e-05,0.06609907746315002,2.347848653793335,23.927850246429443,2 +7824,0.1624031960964203,0.5646317005157471,0.5835627913475037,0.23256409168243408,96.86347198486328,1e-05,0.06396567821502686,2.35090970993042,23.927850246429443,2 +7825,0.20207881927490234,0.3213987946510315,0.3211667537689209,0.18089742958545685,986.952880859375,1e-05,0.062116898596286774,2.3466367721557617,23.927850246429443,2 +7826,0.13554921746253967,0.39654478430747986,0.41537293791770935,0.1646474301815033,998.9959716796875,1e-05,0.07001730054616928,2.565943956375122,23.927850246429443,2 +7827,0.20435206592082977,0.07775702327489853,0.08361143618822098,0.14499999582767487,631.1881713867188,1e-05,0.198788583278656,2.4759361743927,23.927850246429443,2 +7828,0.09182020276784897,0.15822438895702362,0.15733544528484344,0.29365384578704834,915.4175415039062,1e-05,0.0637783408164978,2.4621689319610596,23.927850246429443,2 +7829,0.13663199543952942,0.10527435690164566,0.10209610313177109,0.21435897052288055,941.20556640625,1e-05,0.0791642963886261,2.588813304901123,23.927850246429443,2 +7830,0.23241516947746277,0.2606542110443115,0.2505001723766327,0.21907050907611847,472.6368408203125,1e-05,0.08298642188310623,2.355933427810669,23.927850246429443,2 +7831,0.2234848439693451,0.16732020676136017,0.16385456919670105,0.2544230818748474,939.36376953125,1e-05,0.08210916817188263,2.615151882171631,23.927850246429443,2 +7832,0.185135155916214,0.24900175631046295,0.2700282335281372,0.20169870555400848,291.41107177734375,1e-05,0.07676942646503448,2.536529541015625,23.927850246429443,2 +7833,0.2359142005443573,0.20717652142047882,0.20918329060077667,0.19205127656459808,632.4110717773438,1e-05,0.07452607154846191,2.349048614501953,23.927850246429443,2 +7834,0.22562038898468018,0.739128828048706,0.7270210385322571,0.23663461208343506,52.6819953918457,1e-05,0.07097680866718292,2.3464910984039307,23.927850246429443,2 +7835,0.18001317977905273,0.21198506653308868,0.20611298084259033,0.2317628115415573,938.1237182617188,1e-05,0.06583317369222641,2.357187509536743,23.927850246429443,2 +7836,0.24227453768253326,0.16087649762630463,0.16005153954029083,0.2362179458141327,639.6484985351562,1e-05,0.06653521209955215,2.4761548042297363,23.927850246429443,2 +7837,0.2898876368999481,0.1968085616827011,0.1978480964899063,0.20224358141422272,780.0751953125,1e-05,0.08366963267326355,2.3447232246398926,23.927850246429443,2 +7838,0.192983478307724,0.18373233079910278,0.19305972754955292,0.21128204464912415,727.4247436523438,1e-05,0.07309666275978088,2.5775372982025146,23.927850246429443,2 +7839,0.12284326553344727,0.19562841951847076,0.19319593906402588,0.24551281332969666,696.9026489257812,1e-05,0.06873718649148941,2.576137065887451,23.927850246429443,2 +7840,0.16076350212097168,0.2696673274040222,0.2643387019634247,0.17980769276618958,981.9896850585938,1e-05,0.08542203158140182,2.542248249053955,23.927850246429443,2 +7841,0.2485576868057251,0.2067948877811432,0.2102690488100052,0.2401602417230606,963.5654907226562,1e-05,0.13473574817180634,2.4971089363098145,23.927850246429443,2 +7842,0.14104096591472626,0.3317456841468811,0.3232681155204773,0.18830128014087677,976.8355712890625,1e-05,0.07353811711072922,2.4721593856811523,23.927850246429443,2 +7843,0.15137773752212524,0.1636752188205719,0.16692902147769928,0.15410256385803223,702.7145385742188,1e-05,0.06519258767366409,2.3564016819000244,23.927850246429443,2 +7844,0.11030791699886322,0.16495174169540405,0.1409982442855835,0.2289743572473526,884.0750122070312,1e-05,0.06816846132278442,2.3533084392547607,23.927850246429443,2 +7845,0.27376237511634827,0.16238567233085632,0.15954390168190002,0.2625320553779602,604.3388061523438,1e-05,0.07713153958320618,2.3539528846740723,23.927850246429443,2 +7846,0.23037704825401306,0.14035701751708984,0.1311168670654297,0.2122756391763687,909.9564819335938,1e-05,0.07123622298240662,2.477449417114258,23.927850246429443,2 +7847,0.19422763586044312,0.20739682018756866,0.20041640102863312,0.23576922714710236,823.6697998046875,1e-05,0.06246226280927658,2.35984206199646,23.927850246429443,2 +7848,0.1067158654332161,0.18514296412467957,0.18332181870937347,0.2138461470603943,890.8045654296875,1e-05,0.07716802507638931,2.5050735473632812,23.927850246429443,2 +7849,0.23722413182258606,0.2015235871076584,0.18506276607513428,0.24298076331615448,968.468505859375,1e-05,0.08154980093240738,2.455571174621582,23.927850246429443,2 +7850,0.262225478887558,0.1981523334980011,0.19122111797332764,0.22817306220531464,962.2467651367188,1e-05,0.07464446127414703,2.5849075317382812,23.927850246429443,2 +7851,0.26066330075263977,0.14669795334339142,0.14453186094760895,0.29150640964508057,825.4075927734375,1e-05,0.07277903705835342,2.355293035507202,23.927850246429443,2 +7852,0.1498982012271881,0.2600780129432678,0.23803898692131042,0.22221152484416962,961.1829223632812,1e-05,0.06989327818155289,2.5904126167297363,23.927850246429443,2 +7853,0.33338290452957153,0.1778179407119751,0.17939385771751404,0.11826922744512558,751.5949096679688,1e-05,0.06826796382665634,2.472240686416626,23.927850246429443,2 +7854,0.2041211724281311,0.2844996750354767,0.2749500870704651,0.22692306339740753,466.7919921875,1e-05,0.07380827516317368,2.3595991134643555,23.927850246429443,2 +7855,0.11247952282428741,0.48610323667526245,0.47380125522613525,0.2549999952316284,993.4319458007812,1e-05,0.07666324079036713,2.352353572845459,23.927850246429443,2 +7856,0.25851377844810486,0.20979197323322296,0.20838889479637146,0.285897433757782,986.064208984375,1e-05,0.0691959336400032,2.3479957580566406,23.927850246429443,2 +7857,0.11913323402404785,0.24771854281425476,0.24219709634780884,0.09996794164180756,977.07421875,1e-05,0.06363273411989212,2.521716356277466,23.927850246429443,2 +7858,0.15966543555259705,0.6135361194610596,0.6164525747299194,0.2566666603088379,125.89928436279297,1e-05,0.07749553769826889,2.3579864501953125,23.927850246429443,2 +7859,0.20882484316825867,0.20119674503803253,0.20154790580272675,0.22307690978050232,782.8849487304688,1e-05,0.0720917284488678,2.5804271697998047,23.927850246429443,2 +7860,0.14148353040218353,0.32562196254730225,0.33487266302108765,0.14878204464912415,990.0166625976562,1e-05,0.06603336334228516,2.593106746673584,23.927850246429443,2 +7861,0.21078065037727356,0.1463545262813568,0.14180102944374084,0.24253204464912415,957.9439697265625,1e-05,0.06713523715734482,2.363572359085083,23.927850246429443,2 +7862,0.16583847999572754,0.0749703124165535,0.07911952584981918,0.0939423069357872,899.2704467773438,1e-05,0.06862680613994598,2.351611614227295,23.927850246429443,2 +7863,0.184337317943573,0.25470438599586487,0.24901419878005981,0.2693910300731659,826.5582275390625,1e-05,0.07150726020336151,2.4716222286224365,23.927850246429443,2 +7864,0.07723447680473328,0.322966605424881,0.2943192720413208,0.21195511519908905,989.8002319335938,1e-05,0.06119006872177124,2.4729013442993164,23.927850246429443,2 +7865,0.1757732629776001,0.17188134789466858,0.16149944067001343,0.19756409525871277,944.52587890625,1e-05,0.07918597012758255,2.3506805896759033,23.927850246429443,2 +7866,0.16035331785678864,0.18542850017547607,0.17160958051681519,0.19865383207798004,950.6705322265625,1e-05,0.0717238038778305,2.349403142929077,23.927850246429443,2 +7867,0.3038276731967926,0.13570083677768707,0.13830804824829102,0.18371793627738953,687.94970703125,1e-05,0.07421914488077164,2.3473522663116455,23.927850246429443,2 +7868,0.15199226140975952,0.0830099806189537,0.0841805562376976,0.12580128014087677,799.7118530273438,1e-05,0.06151770055294037,2.4769442081451416,23.927850246429443,2 +7869,0.22042745351791382,0.09472391754388809,0.09580880403518677,0.08051281422376633,862.2828979492188,1e-05,0.07552621513605118,2.493952512741089,23.927850246429443,2 +7870,0.13374274969100952,0.24678267538547516,0.24404564499855042,0.3008333146572113,412.1983947753906,1e-05,0.0681380182504654,2.543452739715576,23.927850246429443,2 +7871,0.2512879967689514,0.1387147456407547,0.14355884492397308,0.22679486870765686,752.3885498046875,1e-05,0.0675070658326149,2.5883889198303223,23.927850246429443,2 +7872,0.26897192001342773,0.17567841708660126,0.16955119371414185,0.21333332359790802,935.9296264648438,1e-05,0.07652807980775833,2.3469889163970947,23.927850246429443,2 +7873,0.19432587921619415,0.03934905305504799,0.046680573374032974,0.19141024351119995,802.9328002929688,1e-05,0.07513295859098434,2.4906790256500244,23.927850246429443,2 +7874,0.12058371305465698,0.11720587313175201,0.10837573558092117,0.1837499886751175,769.2307739257812,1e-05,0.06081324443221092,2.35463809967041,23.927850246429443,2 +7875,0.27492499351501465,0.24161168932914734,0.23711960017681122,0.2318589687347412,412.1983947753906,1e-05,0.06749366968870163,2.5178768634796143,23.927850246429443,2 +7876,0.19887837767601013,0.16573065519332886,0.1637643277645111,0.08804486691951752,828.2725830078125,1e-05,0.0667165070772171,2.3511126041412354,23.927850246429443,2 +7877,0.2850630581378937,0.3317957818508148,0.33969876170158386,0.3086538314819336,285.49383544921875,1e-05,0.06956713646650314,2.3509409427642822,23.927850246429443,2 +7878,0.1574641466140747,0.19319015741348267,0.19147944450378418,0.2098717838525772,920.0105590820312,1e-05,0.06905817240476608,2.4678027629852295,23.927850246429443,2 +7879,0.2016027718782425,0.16823291778564453,0.16405697166919708,0.2369871735572815,950.3834838867188,1e-05,0.07263468205928802,2.482314348220825,23.927850246429443,2 +7880,0.19889704883098602,0.1616547852754593,0.16899734735488892,0.20067307353019714,862.7633056640625,1e-05,0.06504235416650772,2.5866708755493164,23.927850246429443,2 +7881,0.26843374967575073,0.35052287578582764,0.3455859422683716,0.20285256206989288,484.06866455078125,1e-05,0.07684201002120972,2.3627521991729736,23.927850246429443,2 +7882,0.177390456199646,0.3253604471683502,0.32474470138549805,0.20499999821186066,998.592041015625,1e-05,0.06507904082536697,2.5326898097991943,23.927850246429443,2 +7883,0.2162570059299469,0.08389932662248611,0.08201330155134201,0.10557691752910614,745.9677734375,1e-05,0.055816784501075745,2.349513053894043,23.927850246429443,2 +7884,0.19300180673599243,0.23883146047592163,0.23841208219528198,0.16999998688697815,978.0244140625,1e-05,0.07033158093690872,2.4898266792297363,23.927850246429443,2 +7885,0.18206430971622467,0.27262812852859497,0.279245525598526,0.2254166603088379,308.7349548339844,1e-05,0.06836777180433273,2.4613072872161865,23.927850246429443,2 +7886,0.3114001154899597,0.21117132902145386,0.19826102256774902,0.24166665971279144,579.399169921875,1e-05,0.07800617069005966,2.3610708713531494,23.927850246429443,2 +7887,0.22231437265872955,0.1928539127111435,0.1872868686914444,0.154903843998909,952.6641235351562,1e-05,0.0666671022772789,2.348177909851074,23.927850246429443,2 +7888,0.11308571696281433,0.4377347230911255,0.40383630990982056,0.24320511519908905,994.6895141601562,1e-05,0.06276459991931915,2.347454071044922,23.927850246429443,2 +7889,0.2615092992782593,0.26159432530403137,0.2480054348707199,0.24782049655914307,384.3490905761719,1e-05,0.07772135734558105,2.5734057426452637,23.927850246429443,2 +7890,0.23848199844360352,0.1828828752040863,0.18487758934497833,0.22586537897586823,888.7283325195312,1e-05,0.07127904146909714,2.518373489379883,23.927850246429443,2 +7891,0.13878896832466125,0.18220219016075134,0.16756075620651245,0.24782049655914307,875.74853515625,1e-05,0.06840997189283371,2.491083860397339,23.927850246429443,2 +7892,0.18594461679458618,0.18975625932216644,0.19042792916297913,0.25663459300994873,664.7939453125,1e-05,0.07323150336742401,2.5323410034179688,23.927850246429443,2 +7893,0.1871730089187622,0.3285031318664551,0.3267187774181366,0.2855128049850464,346.82080078125,1e-05,0.06790982186794281,2.3556346893310547,23.927850246429443,2 +7894,0.25040724873542786,0.25519874691963196,0.25745370984077454,0.19326922297477722,552.4553833007812,1e-05,0.06988821923732758,2.346693515777588,23.927850246429443,2 +7895,0.29196107387542725,0.7098073959350586,0.6874134540557861,0.24275639653205872,109.48905944824219,1e-05,0.06832453608512878,2.3458127975463867,23.927850246429443,2 +7896,0.19213944673538208,0.14860068261623383,0.13461381196975708,0.2157692164182663,680.7832641601562,1e-05,0.08284260332584381,2.5771119594573975,23.927850246429443,2 +7897,0.2015988826751709,0.18621128797531128,0.1821989268064499,0.15131409466266632,924.4791870117188,1e-05,0.06839299201965332,2.3497185707092285,23.927850246429443,2 +7898,0.1459883153438568,0.12038622051477432,0.1350688934326172,0.20538461208343506,938.4346313476562,1e-05,0.07000304758548737,2.3472087383270264,23.927850246429443,2 +7899,0.12875764071941376,0.14694015681743622,0.14183565974235535,0.18698717653751373,744.3366088867188,1e-05,0.07711312174797058,2.3496975898742676,23.927850246429443,2 +7900,0.13947394490242004,0.2142176777124405,0.2065304070711136,0.20320512354373932,956.0206298828125,1e-05,0.07335522025823593,2.5165388584136963,23.927850246429443,2 +7901,0.17107808589935303,0.13735932111740112,0.13077621161937714,0.2675320506095886,850.8939819335938,1e-05,0.08004924654960632,2.477938175201416,23.927850246429443,2 +7902,0.23773600161075592,0.15073956549167633,0.15093794465065002,0.27532050013542175,884.9298706054688,1e-05,0.06979308277368546,2.574683427810669,23.927850246429443,2 +7903,0.23635844886302948,0.5829090476036072,0.6021231412887573,0.22070512175559998,88.28997039794922,1e-05,0.06487930566072464,2.52260160446167,23.927850246429443,2 +7904,0.21577435731887817,0.19547002017498016,0.18434837460517883,0.230705127120018,793.795654296875,1e-05,0.07154742628335953,2.3661000728607178,23.927850246429443,2 +7905,0.21543563902378082,0.18384741246700287,0.18299447000026703,0.2488461434841156,653.6259765625,1e-05,0.081222303211689,2.49770450592041,23.927850246429443,2 +7906,0.19239197671413422,0.3484112024307251,0.3441638648509979,0.25903844833374023,317.1641845703125,1e-05,0.0724971741437912,2.357100486755371,23.927850246429443,2 +7907,0.22132907807826996,0.13662050664424896,0.14140205085277557,0.1770833283662796,801.0057983398438,1e-05,0.07577142864465714,2.4762744903564453,23.927850246429443,2 +7908,0.2585539221763611,0.18982884287834167,0.19268856942653656,0.168205127120018,544.5823974609375,1e-05,0.07477425783872604,2.360935688018799,23.927850246429443,2 +7909,0.2933702766895294,0.28478842973709106,0.28666552901268005,0.11999999731779099,333.5777282714844,1e-05,0.07423914968967438,2.3531410694122314,23.927850246429443,2 +7910,0.2393137514591217,0.17230291664600372,0.16163857281208038,0.26403844356536865,651.3410034179688,1e-05,0.08883035182952881,2.4606683254241943,23.927850246429443,2 +7911,0.19397689402103424,0.180623859167099,0.18413247168064117,0.23628203570842743,770.7055053710938,1e-05,0.07483521103858948,2.4646198749542236,23.927850246429443,2 +7912,0.22330892086029053,0.2894931435585022,0.2929190993309021,0.13115383684635162,183.4470977783203,1e-05,0.0693952739238739,2.4808261394500732,23.927850246429443,2 +7913,0.16168993711471558,0.18770329654216766,0.1903352439403534,0.22817306220531464,776.5151977539062,1e-05,0.06776358932256699,2.359074831008911,23.927850246429443,2 +7914,0.2101013958454132,0.10504040867090225,0.11033488810062408,0.09910256415605545,803.5714111328125,1e-05,0.08873215317726135,2.505770206451416,23.927850246429443,2 +7915,0.17986075580120087,0.18268954753875732,0.17088131606578827,0.19249999523162842,891.2169799804688,1e-05,0.061654407531023026,2.5748658180236816,23.927850246429443,2 +7916,0.2902042269706726,0.12681657075881958,0.129520446062088,0.24483972787857056,645.55126953125,1e-05,0.08856671303510666,2.36260986328125,23.927850246429443,2 +7917,0.29980847239494324,0.1658267080783844,0.16578169167041779,0.179391011595726,637.2549438476562,1e-05,0.06881223618984222,2.346214771270752,23.927850246429443,2 +7918,0.14120659232139587,0.19930553436279297,0.19210681319236755,0.22317306697368622,943.3267822265625,1e-05,0.07048682868480682,2.577658176422119,23.927850246429443,2 +7919,0.1290881186723709,0.1777845174074173,0.16792260110378265,0.23499998450279236,967.4503784179688,1e-05,0.06772360950708389,2.345883369445801,23.927850246429443,2 +7920,0.17545010149478912,0.12404268234968185,0.118655264377594,0.20576922595500946,815.3685913085938,1e-05,0.06170540675520897,2.348749876022339,23.927850246429443,2 +7921,0.1850164383649826,0.1481478065252304,0.15475428104400635,0.23317307233810425,961.7158813476562,1e-05,0.06746579706668854,2.465333938598633,23.927850246429443,2 +7922,0.1955813467502594,0.1470944881439209,0.13686494529247284,0.24621793627738953,968.7218017578125,1e-05,0.08764573186635971,2.4747419357299805,23.927850246429443,2 +7923,0.2816792130470276,0.10627792030572891,0.1084640622138977,0.13064101338386536,636.0511474609375,1e-05,0.07017315179109573,2.570568084716797,23.927850246429443,2 +7924,0.33671891689300537,0.1720634549856186,0.16879601776599884,0.12483973801136017,845.7308959960938,1e-05,0.0779128298163414,2.5096890926361084,23.927850246429443,2 +7925,0.20138542354106903,0.17331667244434357,0.16439135372638702,0.24464742839336395,834.44140625,1e-05,0.08111556619405746,2.3546180725097656,23.927850246429443,2 +7926,0.2156878262758255,0.17801612615585327,0.16771113872528076,0.2572115361690521,723.90576171875,1e-05,0.07883337885141373,2.465240955352783,23.927850246429443,2 +7927,0.17960241436958313,0.13587884604930878,0.1265786588191986,0.22692306339740753,863.2425537109375,1e-05,0.060841646045446396,2.3585963249206543,23.927850246429443,2 +7928,0.27109384536743164,0.3458295464515686,0.34227439761161804,0.20733973383903503,493.3414306640625,1e-05,0.09737903624773026,2.5314278602600098,23.927850246429443,2 +7929,0.24611295759677887,0.16306816041469574,0.15498018264770508,0.288589745759964,777.2314453125,1e-05,0.0757129043340683,2.3523828983306885,23.927850246429443,2 +7930,0.22860223054885864,0.21150539815425873,0.2101900279521942,0.19756409525871277,647.8805541992188,1e-05,0.06571169197559357,2.3494486808776855,23.927850246429443,2 +7931,0.2950190603733063,0.21668848395347595,0.21216538548469543,0.19394229352474213,655.8935546875,1e-05,0.0810684859752655,2.4762344360351562,23.927850246429443,2 +7932,0.12365254014730453,0.11414512246847153,0.11708769202232361,0.20964743196964264,745.9677734375,1e-05,0.0863523930311203,2.3626158237457275,23.927850246429443,2 +7933,0.2294078916311264,0.14578001201152802,0.14927847683429718,0.2614102363586426,554.0089721679688,1e-05,0.06922020763158798,2.5694174766540527,23.927850246429443,2 +7934,0.1735459268093109,0.29105156660079956,0.27768006920814514,0.2098717838525772,978.9678955078125,1e-05,0.08060568571090698,2.527299642562866,23.927850246429443,2 +7935,0.19100956618785858,0.14068768918514252,0.13648660480976105,0.15516024827957153,899.2704467773438,1e-05,0.08147560805082321,2.4841136932373047,23.927850246429443,2 +7936,0.23284423351287842,0.14959605038166046,0.1425444483757019,0.26038461923599243,707.4652709960938,1e-05,0.06898975372314453,2.3516504764556885,23.927850246429443,2 +7937,0.11052442342042923,0.20068718492984772,0.19030532240867615,0.24878203868865967,812.9371337890625,1e-05,0.058509133756160736,2.6115171909332275,23.927850246429443,2 +7938,0.2785557508468628,0.19981150329113007,0.20281603932380676,0.22285255789756775,458.8607482910156,1e-05,0.09097699075937271,2.3738672733306885,23.927850246429443,2 +7939,0.3093200922012329,0.4029211699962616,0.4046834111213684,0.281826913356781,228.7581787109375,1e-05,0.07274520397186279,2.511794090270996,23.927850246429443,2 +7940,0.12734657526016235,0.15123936533927917,0.1447170078754425,0.25362178683280945,936.2449951171875,1e-05,0.06623360514640808,2.3592488765716553,23.927850246429443,2 +7941,0.23450487852096558,0.1471896767616272,0.14163367450237274,0.2594551146030426,840.9685668945312,1e-05,0.08443548530340195,2.35841965675354,23.927850246429443,2 +7942,0.18854723870754242,0.14896024763584137,0.1601380556821823,0.2869230806827545,496.98797607421875,1e-05,0.07798244804143906,2.4662246704101562,23.927850246429443,2 +7943,0.25664451718330383,0.09666333347558975,0.10223229229450226,0.13365383446216583,929.4871826171875,1e-05,0.0622294582426548,2.356473445892334,23.927850246429443,2 +7944,0.22867397964000702,0.2270456999540329,0.22562913596630096,0.27666667103767395,450.76727294921875,1e-05,0.06817664206027985,2.7052886486053467,23.927850246429443,2 +7945,0.1280844509601593,0.1960485875606537,0.18503786623477936,0.3208012580871582,949.5192260742188,1e-05,0.07714805006980896,2.4855170249938965,23.927850246429443,2 +7946,0.16391099989414215,0.12190490961074829,0.12335080653429031,0.14397434890270233,601.6597900390625,1e-05,0.06250352412462234,2.3571691513061523,23.927850246429443,2 +7947,0.18785317242145538,0.04267805442214012,0.04345632717013359,0.10230769217014313,718.5374145507812,1e-05,0.07366916537284851,2.478895902633667,23.927850246429443,2 +7948,0.16239666938781738,0.501237154006958,0.49136000871658325,0.26855766773223877,204.84951782226562,1e-05,0.06618967652320862,2.3621697425842285,23.927850246429443,2 +7949,0.1484195590019226,0.1616392284631729,0.16374729573726654,0.17230768501758575,750.0000610351562,1e-05,0.06760220974683762,2.4758150577545166,23.927850246429443,2 +7950,0.2528449296951294,0.2983962893486023,0.29035690426826477,0.274487167596817,728.2971801757812,1e-05,0.09037680923938751,2.362778663635254,23.927850246429443,2 +7951,0.300836980342865,0.141220822930336,0.14653988182544708,0.16891025006771088,954.3519897460938,1e-05,0.06598170101642609,2.3493127822875977,23.927850246429443,2 +7952,0.2549218237400055,0.09520378708839417,0.09688875079154968,0.26695510745048523,726.5493774414062,1e-05,0.07907003909349442,2.3541877269744873,23.927850246429443,2 +7953,0.18573135137557983,0.2253388613462448,0.22004657983779907,0.2702884376049042,980.13818359375,1e-05,0.0728951171040535,2.4817707538604736,23.927850246429443,2 +7954,0.2798864245414734,0.296421617269516,0.28671547770500183,0.2199999988079071,594.86376953125,1e-05,0.06421279162168503,2.490415096282959,23.927850246429443,2 +7955,0.3626585900783539,0.29264166951179504,0.28823307156562805,0.24253204464912415,485.94134521484375,1e-05,0.07253355532884598,2.3555123805999756,23.927850246429443,2 +7956,0.18913868069648743,0.209804505109787,0.2021637111902237,0.26298075914382935,882.3529052734375,1e-05,0.08075878024101257,2.5683343410491943,23.927850246429443,2 +7957,0.18375037610530853,0.38926616311073303,0.3718623220920563,0.2361217886209488,988.9306640625,1e-05,0.060096625238657,2.357163190841675,23.927850246429443,2 +7958,0.1185837984085083,0.10089821368455887,0.10700859129428864,0.15785256028175354,805.4765625,1e-05,0.054411303251981735,2.5998058319091797,23.927850246429443,2 +7959,0.16811725497245789,0.13467808067798615,0.13606742024421692,0.18410255014896393,947.1898803710938,1e-05,0.06258311867713928,2.3451273441314697,23.927850246429443,2 +7960,0.17200997471809387,0.23494111001491547,0.22667112946510315,0.26548075675964355,911.0628662109375,1e-05,0.0804223045706749,2.587779998779297,23.927850246429443,2 +7961,0.3154190480709076,0.12251456826925278,0.12247241288423538,0.14057691395282745,987.8356323242188,1e-05,0.08048641681671143,2.3597593307495117,23.927850246429443,2 +7962,0.1280370056629181,0.22727549076080322,0.2217775136232376,0.2291666567325592,884.0750122070312,1e-05,0.06517499685287476,2.3490917682647705,23.927850246429443,2 +7963,0.13234198093414307,0.45487406849861145,0.4644513726234436,0.2572115361690521,176.11683654785156,1e-05,0.06161202862858772,2.48838210105896,23.927850246429443,2 +7964,0.2152780145406723,0.2876744270324707,0.2833845317363739,0.24666665494441986,418.88299560546875,1e-05,0.08143531531095505,2.3523428440093994,23.927850246429443,2 +7965,0.26477497816085815,0.2970614433288574,0.2927226126194,0.19884614646434784,482.1867370605469,1e-05,0.07305800914764404,2.511584520339966,23.927850246429443,2 +7966,0.22236976027488708,0.20544032752513885,0.21443982422351837,0.3026922941207886,993.8524169921875,1e-05,0.07348285615444183,2.3532042503356934,23.927850246429443,2 +7967,0.25050538778305054,0.1314854621887207,0.1279631406068802,0.2083333283662796,910.3261108398438,1e-05,0.06492576003074646,2.541064500808716,23.927850246429443,2 +7968,0.148675799369812,0.17680418491363525,0.17873360216617584,0.2876923084259033,972.2222290039062,1e-05,0.0655897930264473,2.3460378646850586,23.927850246429443,2 +7969,0.24001561105251312,0.21907839179039001,0.2040790319442749,0.2094871699810028,750.0000610351562,1e-05,0.07629779726266861,2.4690122604370117,23.927850246429443,2 +7970,0.21354058384895325,0.21763256192207336,0.2006593495607376,0.2435256391763687,877.0883178710938,1e-05,0.07792436331510544,2.349456310272217,23.927850246429443,2 +7971,0.14329007267951965,0.1416214108467102,0.13721226155757904,0.20432691276073456,803.5714111328125,1e-05,0.07579110562801361,2.5276081562042236,23.927850246429443,2 +7972,0.19702520966529846,0.4676196277141571,0.4882069528102875,0.20913460850715637,176.11683654785156,1e-05,0.08633020520210266,2.35094952583313,23.927850246429443,2 +7973,0.17475056648254395,0.1816556304693222,0.17344212532043457,0.2653205096721649,959.8422241210938,1e-05,0.08754363656044006,2.346156120300293,23.927850246429443,2 +7974,0.2453784942626953,0.17706580460071564,0.16883784532546997,0.2741346061229706,730.0333251953125,1e-05,0.09317788481712341,2.468581199645996,23.927850246429443,2 +7975,0.12577024102210999,0.374194860458374,0.3549343943595886,0.29538461565971375,988.0552978515625,1e-05,0.06678362190723419,2.4731366634368896,23.927850246429443,2 +7976,0.19603818655014038,0.14322756230831146,0.15157632529735565,0.2707371711730957,364.73089599609375,1e-05,0.07199274003505707,2.3588647842407227,23.927850246429443,2 +7977,0.2846378684043884,0.10513438284397125,0.10563493520021439,0.16333332657814026,950.6705322265625,1e-05,0.08246520906686783,2.4614005088806152,23.927850246429443,2 +7978,0.29390645027160645,0.6220642924308777,0.6240107417106628,0.21288460493087769,197.81146240234375,1e-05,0.0734947994351387,2.3609108924865723,23.927850246429443,2 +7979,0.2329491525888443,0.16726656258106232,0.16210180521011353,0.21833331882953644,943.0255737304688,1e-05,0.07703915238380432,2.4948880672454834,23.927850246429443,2 +7980,0.16584226489067078,0.23055413365364075,0.23641248047351837,0.18041665852069855,992.374267578125,1e-05,0.06705833971500397,2.3526108264923096,23.927850246429443,2 +7981,0.16860440373420715,0.14150027930736542,0.12950263917446136,0.1456410139799118,763.2398681640625,1e-05,0.07583967596292496,2.4643666744232178,23.927850246429443,2 +7982,0.2502874732017517,0.20606394112110138,0.1992897093296051,0.18647435307502747,747.5884399414062,1e-05,0.08978311717510223,2.356844902038574,23.927850246429443,2 +7983,0.13130302727222443,0.4326765835285187,0.43483293056488037,0.16605769097805023,215.23179626464844,1e-05,0.07203829288482666,2.3503570556640625,23.927850246429443,2 +7984,0.2760651707649231,0.11120300740003586,0.11388569325208664,0.1469871699810028,740.2120361328125,1e-05,0.07648815959692001,2.487949848175049,23.927850246429443,2 +7985,0.2590704560279846,0.14532370865345,0.1622679978609085,0.19756409525871277,720.3389282226562,1e-05,0.07396560907363892,2.3572118282318115,23.927850246429443,2 +7986,0.16172465682029724,0.20036979019641876,0.1937330961227417,0.17788460850715637,886.6278686523438,1e-05,0.07292167842388153,2.6763553619384766,23.927850246429443,2 +7987,0.2307022213935852,0.20696723461151123,0.2005378156900406,0.22624999284744263,888.3101196289062,1e-05,0.06760433316230774,2.353001117706299,23.927850246429443,2 +7988,0.22583463788032532,0.24362708628177643,0.23777756094932556,0.1897115260362625,963.8278198242188,1e-05,0.06806106865406036,2.467033863067627,23.927850246429443,2 +7989,0.32823970913887024,0.21653173863887787,0.21314966678619385,0.2515384554862976,536.5296630859375,1e-05,0.0918625146150589,2.353792905807495,23.927850246429443,2 +7990,0.22313906252384186,0.1420653909444809,0.14229416847229004,0.05775640904903412,801.0057983398438,1e-05,0.062393590807914734,2.476501226425171,23.927850246429443,2 +7991,0.2021164745092392,0.17973624169826508,0.17761972546577454,0.18243588507175446,980.13818359375,1e-05,0.07146996259689331,2.3505287170410156,23.927850246429443,2 +7992,0.1789589524269104,0.5837467908859253,0.5883139371871948,0.1033012792468071,137.90036010742188,1e-05,0.0718344897031784,2.474684238433838,23.927850246429443,2 +7993,0.22428767383098602,0.27570828795433044,0.28089892864227295,0.11830127984285355,336.25732421875,1e-05,0.12521450221538544,2.349238157272339,23.927850246429443,2 +7994,0.11263776570558548,0.2779805064201355,0.2741936147212982,0.24714742600917816,956.8480224609375,1e-05,0.07006336748600006,2.3509163856506348,23.927850246429443,2 +7995,0.19390621781349182,0.11793561279773712,0.11344520002603531,0.21916665136814117,865.6211547851562,1e-05,0.062425870448350906,2.4888806343078613,23.927850246429443,2 +7996,0.17898893356323242,0.19844365119934082,0.1821349561214447,0.23714742064476013,735.1730346679688,1e-05,0.07144169509410858,2.5608198642730713,23.927850246429443,2 +7997,0.24199512600898743,0.216861754655838,0.2099304348230362,0.2631089687347412,626.2474975585938,1e-05,0.08651399612426758,2.4640164375305176,23.927850246429443,2 +7998,0.1534883826971054,0.2998768985271454,0.2798250615596771,0.1597115397453308,996.5530395507812,1e-05,0.06336486339569092,2.3435921669006348,23.927850246429443,2 +7999,0.30207380652427673,0.3114258646965027,0.3106943964958191,0.27080127596855164,442.5064697265625,1e-05,0.08732957392930984,2.48732852935791,23.927850246429443,2 +8000,0.2955731451511383,0.21996518969535828,0.21580587327480316,0.2006089687347412,377.094970703125,1e-05,0.0775744616985321,2.351766586303711,23.927850246429443,2 +8001,0.20865187048912048,0.20174472033977509,0.21652370691299438,0.10256409645080566,999.5994262695312,1e-05,0.07431278377771378,2.3453800678253174,23.927850246429443,2 +8002,0.22976338863372803,0.17196406424045563,0.1756318062543869,0.2354487031698227,852.9224853515625,1e-05,0.1032186821103096,2.4629414081573486,23.927850246429443,2 +8003,0.21190717816352844,0.1537754088640213,0.1660953313112259,0.09887820482254028,984.0426025390625,1e-05,0.06596743315458298,2.3473150730133057,23.927850246429443,2 +8004,0.23899990320205688,0.1869087517261505,0.17994268238544464,0.17836537957191467,651.3410034179688,1e-05,0.07055888324975967,2.3441832065582275,23.927850246429443,2 +8005,0.09026110172271729,0.12380483001470566,0.12050327658653259,0.21580126881599426,840.4324951171875,1e-05,0.05990190804004669,2.514467477798462,23.927850246429443,2 +8006,0.11492467671632767,0.2315230518579483,0.23009656369686127,0.23458331823349,967.4503784179688,1e-05,0.09264726936817169,2.545706272125244,23.927850246429443,2 +8007,0.07405947893857956,0.12150101363658905,0.11780175566673279,0.2388141006231308,901.2276611328125,1e-05,0.06744027882814407,2.452265977859497,23.927850246429443,2 +8008,0.18079575896263123,0.1399678736925125,0.14091403782367706,0.0949038416147232,653.6259765625,1e-05,0.09874995052814484,2.365912675857544,23.927850246429443,2 +8009,0.26145681738853455,0.25090259313583374,0.2577270567417145,0.2931410074234009,405.4053955078125,1e-05,0.07653264701366425,2.4909980297088623,23.927850246429443,2 +8010,0.2313043773174286,0.27988401055336,0.27277201414108276,0.30560895800590515,978.4969482421875,1e-05,0.08738727122545242,2.372202157974243,23.927850246429443,2 +8011,0.33801090717315674,0.13924898207187653,0.1316174566745758,0.23048076033592224,605.6701049804688,1e-05,0.10425018519163132,2.578792095184326,23.927850246429443,2 +8012,0.1919257938861847,0.08411093801259995,0.08585797250270844,0.06801281869411469,871.2120971679688,1e-05,0.11168163269758224,2.3598287105560303,23.927850246429443,2 +8013,0.2572687864303589,0.19982308149337769,0.1978827714920044,0.10657051205635071,866.564453125,1e-05,0.06859058886766434,2.51564621925354,23.927850246429443,2 +8014,0.158579021692276,0.10556147992610931,0.09938319772481918,0.17378205060958862,923.1171264648438,1e-05,0.06012153625488281,2.3651013374328613,23.927850246429443,2 +8015,0.14307233691215515,0.30778053402900696,0.3034783899784088,0.1931089609861374,975.6365966796875,1e-05,0.07435981929302216,2.3553550243377686,23.927850246429443,2 +8016,0.17663848400115967,0.2337021678686142,0.22930355370044708,0.21849358081817627,902.0044555664062,1e-05,0.08272642642259598,2.507551908493042,23.927850246429443,2 +8017,0.13214465975761414,0.38109782338142395,0.35973024368286133,0.2623717784881592,990.0166625976562,1e-05,0.06024705618619919,2.5029232501983643,23.927850246429443,2 +8018,0.2373344451189041,0.21656419336795807,0.21236905455589294,0.2290704995393753,976.5967407226562,1e-05,0.07182763516902924,2.5440759658813477,23.927850246429443,2 +8019,0.13449448347091675,0.1544407457113266,0.1542338728904724,0.10108973830938339,953.2288818359375,1e-05,0.06845961511135101,2.362386465072632,23.927850246429443,2 +8020,0.22647422552108765,0.14173105359077454,0.13150329887866974,0.2530769109725952,823.6697998046875,1e-05,0.07476844638586044,2.482454776763916,23.927850246429443,2 +8021,0.2504270672798157,0.08189287781715393,0.08066899329423904,0.21967947483062744,929.1580810546875,1e-05,0.10267183184623718,2.4764230251312256,23.927850246429443,2 +8022,0.16845491528511047,0.17558923363685608,0.15676143765449524,0.25208333134651184,674.4935913085938,1e-05,0.06812995672225952,2.3558247089385986,23.927850246429443,2 +8023,0.18239256739616394,0.13257776200771332,0.1271096169948578,0.26201921701431274,911.7965698242188,1e-05,0.06588778644800186,2.4891645908355713,23.927850246429443,2 +8024,0.32284605503082275,0.15758778154850006,0.1526646912097931,0.21621793508529663,807.9915161132812,1e-05,0.08899614214897156,2.5543737411499023,23.927850246429443,2 +8025,0.2706143260002136,0.30079659819602966,0.29666122794151306,0.2201922982931137,470.6982727050781,1e-05,0.08662644773721695,2.4427263736724854,23.927850246429443,2 +8026,0.2666579484939575,0.20223858952522278,0.20003020763397217,0.21028845012187958,969.2273559570312,1e-05,0.06659277528524399,3.766282558441162,23.927850246429443,2 +8027,0.23276188969612122,0.27043822407722473,0.26994937658309937,0.18573717772960663,496.98797607421875,1e-05,0.06495039910078049,2.936070680618286,23.927850246429443,2 +8028,0.109617218375206,0.296502947807312,0.28614625334739685,0.20740383863449097,971.23095703125,1e-05,0.06567128747701645,2.45792555809021,23.927850246429443,2 +8029,0.232655331492424,0.29857516288757324,0.27267491817474365,0.20503205060958862,979.4371948242188,1e-05,0.09084150940179825,2.3584775924682617,23.927850246429443,2 +8030,0.21469907462596893,0.20251958072185516,0.19112245738506317,0.22727563977241516,504.1766052246094,1e-05,0.0823565199971199,2.350968360900879,23.927850246429443,2 +8031,0.13274237513542175,0.23350609838962555,0.2220209389925003,0.2829807698726654,916.8442993164062,1e-05,0.07489433884620667,2.4997265338897705,23.927850246429443,2 +8032,0.08109918981790543,0.11749660223722458,0.12233556807041168,0.24535255134105682,917.9064331054688,1e-05,0.0728665366768837,2.50406813621521,23.927850246429443,2 +8033,0.24661847949028015,0.3367401361465454,0.33818426728248596,0.1240384578704834,346.82080078125,1e-05,0.07283151894807816,2.362931251525879,23.927850246429443,2 +8034,0.19091293215751648,0.3993063271045685,0.38575834035873413,0.24592947959899902,996.3473510742188,1e-05,0.08173596858978271,2.481191635131836,23.927850246429443,2 +8035,0.1716482937335968,0.2051907181739807,0.20393650233745575,0.13269230723381042,689.9642333984375,1e-05,0.0873885527253151,2.3672842979431152,23.927850246429443,2 +8036,0.18536391854286194,0.37023216485977173,0.3624655306339264,0.15772435069084167,267.29559326171875,1e-05,0.07018613070249557,2.358412742614746,23.927850246429443,2 +8037,0.27562031149864197,0.20822949707508087,0.19747671484947205,0.09926281869411469,929.4871826171875,1e-05,0.08690237998962402,2.4791691303253174,23.927850246429443,2 +8038,0.09698625653982162,0.17781245708465576,0.1740468144416809,0.2354487031698227,927.5025634765625,1e-05,0.06318341940641403,2.486436128616333,23.927850246429443,2 +8039,0.2540573477745056,0.7468736171722412,0.757512092590332,0.30009615421295166,75.18797302246094,1e-05,0.07010801136493683,2.497082471847534,23.927850246429443,2 +8040,0.17845991253852844,0.24510498344898224,0.23422743380069733,0.2201922982931137,466.7919921875,1e-05,0.07559423893690109,2.3511598110198975,23.927850246429443,2 +8041,0.13006240129470825,0.5452949404716492,0.5215882062911987,0.30012819170951843,997.7804565429688,1e-05,0.0640697330236435,2.3508033752441406,23.927850246429443,2 +8042,0.18870584666728973,0.2027292102575302,0.19814009964466095,0.20955127477645874,823.0874633789062,1e-05,0.07006501406431198,2.4832332134246826,23.927850246429443,2 +8043,0.1255493462085724,0.09530965983867645,0.09347424656152725,0.16769230365753174,866.0933227539062,1e-05,0.07592175155878067,2.5949950218200684,23.927850246429443,2 +8044,0.24803026020526886,0.3189551830291748,0.3131989538669586,0.23192307353019714,319.94049072265625,1e-05,0.08761506527662277,2.3558058738708496,23.927850246429443,2 +8045,0.24298778176307678,0.19450610876083374,0.17965136468410492,0.30144229531288147,818.3701782226562,1e-05,0.17784930765628815,2.4613888263702393,23.927850246429443,2 +8046,0.1467779576778412,0.17215725779533386,0.16761712729930878,0.2746794819831848,784.2772827148438,1e-05,0.07506922632455826,2.3591222763061523,23.927850246429443,2 +8047,0.16148726642131805,0.15997281670570374,0.1604980081319809,0.2381410151720047,889.5617065429688,1e-05,0.08785508573055267,2.347921133041382,23.927850246429443,2 +8048,0.17077518999576569,0.19654381275177002,0.19543203711509705,0.22064101696014404,509.47869873046875,1e-05,0.0663105696439743,2.4951839447021484,23.927850246429443,2 +8049,0.299510657787323,0.1487380564212799,0.1405278444290161,0.2401602417230606,837.1862182617188,1e-05,0.07326944917440414,2.569685459136963,23.927850246429443,2 +8050,0.1308378428220749,0.13000504672527313,0.13286010921001434,0.12358973920345306,929.4871826171875,1e-05,0.05954474210739136,2.355464220046997,23.927850246429443,2 +8051,0.08706201612949371,0.11661672592163086,0.11921292543411255,0.17923076450824738,893.6715698242188,1e-05,0.055896274745464325,2.3506906032562256,23.927850246429443,2 +8052,0.2144065648317337,0.31439852714538574,0.32911479473114014,0.16586537659168243,248.39744567871094,1e-05,0.08098716288805008,2.458503246307373,23.927850246429443,2 +8053,0.3202490210533142,0.4985419511795044,0.4933658540248871,0.22166666388511658,172.413818359375,1e-05,0.09151577949523926,2.506971597671509,23.927850246429443,2 +8054,0.17911775410175323,0.18502770364284515,0.17534077167510986,0.14567306637763977,962.2467651367188,1e-05,0.09587053954601288,2.348513126373291,23.927850246429443,2 +8055,0.14329653978347778,0.18769635260105133,0.19099874794483185,0.12522435188293457,632.4110717773438,1e-05,0.06293197721242905,2.349842071533203,23.927850246429443,2 +8056,0.2565394341945648,0.1838376224040985,0.17344096302986145,0.20740383863449097,735.1730346679688,1e-05,0.07129915803670883,2.4737937450408936,23.927850246429443,2 +8057,0.1690995842218399,0.3533857464790344,0.3515242636203766,0.24455127120018005,297.256103515625,1e-05,0.07883333414793015,2.3525688648223877,23.927850246429443,2 +8058,0.18836399912834167,0.13815177977085114,0.13062824308872223,0.08817307651042938,933.7044067382812,1e-05,0.0735422670841217,2.49017596244812,23.927850246429443,2 +8059,0.21050290763378143,0.13061216473579407,0.12852367758750916,0.21871794760227203,645.55126953125,1e-05,0.0603492371737957,2.490490198135376,23.927850246429443,2 +8060,0.21689508855342865,0.14353805780410767,0.1426485776901245,0.27878203988075256,815.9722900390625,1e-05,0.07523921132087708,2.4677188396453857,23.927850246429443,2 +8061,0.15786974132061005,0.11964541673660278,0.1171398013830185,0.23400640487670898,818.9655151367188,1e-05,0.0826951414346695,2.3675878047943115,23.927850246429443,2 +8062,0.28325575590133667,0.15983609855175018,0.15291230380535126,0.19384615123271942,928.1668090820312,1e-05,0.07779474556446075,2.3567304611206055,23.927850246429443,2 +8063,0.1928737908601761,0.41421622037887573,0.39990028738975525,0.2270512729883194,993.642333984375,1e-05,0.05737427622079849,2.5059525966644287,23.927850246429443,2 +8064,0.29375094175338745,0.35191643238067627,0.36210787296295166,0.22499999403953552,396.1748962402344,1e-05,0.07832591980695724,2.3586902618408203,23.927850246429443,2 +8065,0.29640311002731323,0.4088665843009949,0.39917969703674316,0.25923076272010803,208.3333282470703,1e-05,0.09137370437383652,2.354037046432495,23.927850246429443,2 +8066,0.17151519656181335,0.2276821881532669,0.22430184483528137,0.2529807686805725,644.3798828125,1e-05,0.06942980736494064,2.3571693897247314,23.927850246429443,2 +8067,0.1948583871126175,0.19732435047626495,0.17690090835094452,0.2270512729883194,903.5476684570312,1e-05,0.07365351170301437,2.4793784618377686,23.927850246429443,2 +8068,0.19526460766792297,0.2180848866701126,0.20547150075435638,0.2520192265510559,967.9602661132812,1e-05,0.06977491825819016,2.3565239906311035,23.927850246429443,2 +8069,0.22499501705169678,0.2087748944759369,0.21176740527153015,0.21124999225139618,765.50390625,1e-05,0.08195717632770538,2.456594944000244,23.927850246429443,2 +8070,0.15310588479042053,0.11442152410745621,0.11278942227363586,0.14083333313465118,863.2425537109375,1e-05,0.06964277476072311,2.5727484226226807,23.927850246429443,2 +8071,0.18162532150745392,0.1820848286151886,0.18036575615406036,0.18137820065021515,837.1862182617188,1e-05,0.05716531723737717,2.469797134399414,23.927850246429443,2 +8072,0.2520942687988281,0.2582455277442932,0.24863509833812714,0.24641025066375732,701.75439453125,1e-05,0.06860782951116562,2.3506336212158203,23.927850246429443,2 +8073,0.23713067173957825,0.19111226499080658,0.1760752648115158,0.23076921701431274,803.5714111328125,1e-05,0.06619854271411896,2.3474080562591553,23.927850246429443,2 +8074,0.25015562772750854,0.25357675552368164,0.24301238358020782,0.17214742302894592,498.798095703125,1e-05,0.06799127161502838,2.5828726291656494,23.927850246429443,2 +8075,0.19404523074626923,0.20770235359668732,0.2156866192817688,0.213365375995636,903.9313354492188,1e-05,0.06753462553024292,2.3589377403259277,23.927850246429443,2 +8076,0.13456089794635773,0.17401663959026337,0.17259448766708374,0.14195512235164642,919.3121948242188,1e-05,0.06576228141784668,2.3525919914245605,23.927850246429443,2 +8077,0.1709103137254715,0.42736512422561646,0.3981442451477051,0.22596153616905212,994.89794921875,1e-05,0.06372856348752975,2.561973810195923,23.927850246429443,2 +8078,0.14679977297782898,0.1138230711221695,0.10968382656574249,0.27032050490379333,733.4710693359375,1e-05,0.06761880964040756,2.351590871810913,23.927850246429443,2 +8079,0.3185194730758667,0.20929716527462006,0.20276197791099548,0.20923076570034027,644.3798828125,1e-05,0.07669852674007416,2.471524238586426,23.927850246429443,2 +8080,0.18999749422073364,0.14254629611968994,0.14480355381965637,0.24551281332969666,829.9730834960938,1e-05,0.0626806989312172,2.4840550422668457,23.927850246429443,2 +8081,0.22486385703086853,0.10235046595335007,0.09878332167863846,0.15698717534542084,860.34912109375,1e-05,0.07253167778253555,2.3620574474334717,23.927850246429443,2 +8082,0.14904363453388214,0.09049326181411743,0.0958205834031105,0.21208332479000092,868.9024658203125,1e-05,0.07292097806930542,2.6046972274780273,23.927850246429443,2 +8083,0.261213481426239,0.1705097109079361,0.19991500675678253,0.21945512294769287,248.39744567871094,1e-05,0.07489017397165298,2.3535234928131104,23.927850246429443,2 +8084,0.08786336332559586,0.2563968598842621,0.2646142840385437,0.25785255432128906,993.0098266601562,1e-05,0.06475304812192917,2.4736416339874268,23.927850246429443,2 +8085,0.17344699800014496,0.15831875801086426,0.15863080322742462,0.24262820184230804,892.8571166992188,1e-05,0.07262171059846878,2.527885675430298,23.927850246429443,2 +8086,0.12659424543380737,0.20477302372455597,0.19067278504371643,0.25660255551338196,850.8939819335938,1e-05,0.06024331972002983,2.3493149280548096,23.927850246429443,2 +8087,0.16630588471889496,0.08307873457670212,0.09420938044786453,0.23086537420749664,856.4231567382812,1e-05,0.0704725906252861,2.3467094898223877,23.927850246429443,2 +8088,0.13685549795627594,0.7289237380027771,0.7508022785186768,0.2244551181793213,66.28787994384766,1e-05,0.061603445559740067,2.508901596069336,23.927850246429443,2 +8089,0.2293335348367691,0.14885391294956207,0.1427503079175949,0.15358974039554596,952.9466552734375,1e-05,0.0707620307803154,2.349881172180176,23.927850246429443,2 +8090,0.1569163203239441,0.24291931092739105,0.24560721218585968,0.1903846114873886,966.1671142578125,1e-05,0.06606173515319824,2.459242820739746,23.927850246429443,2 +8091,0.21368490159511566,0.17597129940986633,0.1699722409248352,0.26990383863449097,895.6915893554688,1e-05,0.07574374973773956,2.5977063179016113,23.927850246429443,2 +8092,0.2130487710237503,0.46570390462875366,0.4510394036769867,0.24275639653205872,997.9838256835938,1e-05,0.06255506724119186,2.4707388877868652,23.927850246429443,2 +8093,0.17991426587104797,0.31435367465019226,0.3087114691734314,0.26019230484962463,446.65814208984375,1e-05,0.06435485929250717,2.3585093021392822,23.927850246429443,2 +8094,0.18549582362174988,0.164737269282341,0.16225911676883698,0.1052243560552597,569.172119140625,1e-05,0.07627169787883759,2.3548898696899414,23.927850246429443,2 +8095,0.18887804448604584,0.26343971490859985,0.2636231780052185,0.23884613811969757,970.7328491210938,1e-05,0.0621681846678257,2.7184362411499023,23.927850246429443,2 +8096,0.1058763712644577,0.16465939581394196,0.16422449052333832,0.23464742302894592,932.7411499023438,1e-05,0.062245484441518784,2.3630242347717285,23.927850246429443,2 +8097,0.14223651587963104,0.24304166436195374,0.2324506640434265,0.18131409585475922,994.2716674804688,1e-05,0.06245602294802666,2.358654022216797,23.927850246429443,2 +8098,0.20610567927360535,0.11114761978387833,0.112909235060215,0.2737179398536682,804.208251953125,1e-05,0.07271743565797806,2.5788824558258057,23.927850246429443,2 +8099,0.20819708704948425,0.27480199933052063,0.27466681599617004,0.18810896575450897,431.9371643066406,1e-05,0.06892574578523636,2.3551394939422607,23.927850246429443,2 +8100,0.22266371548175812,0.24963122606277466,0.24558617174625397,0.2966666519641876,625.0,1e-05,0.06309401988983154,2.3523101806640625,23.927850246429443,2 +8101,0.13232916593551636,0.1472386121749878,0.15792568027973175,0.10695512592792511,763.2398681640625,1e-05,0.0677088126540184,2.3566784858703613,23.927850246429443,2 +8102,0.22964411973953247,0.3085474967956543,0.2982121706008911,0.2703525424003601,984.2687377929688,1e-05,0.07435446232557297,2.5485479831695557,23.927850246429443,2 +8103,0.1769503951072693,0.19165150821208954,0.1987520456314087,0.22288461029529572,982.4486694335938,1e-05,0.0736498013138771,2.5804834365844727,23.927850246429443,2 +8104,0.20149710774421692,0.18859505653381348,0.18688234686851501,0.24333332479000092,939.9801635742188,1e-05,0.07209177315235138,2.351976156234741,23.927850246429443,2 +8105,0.0961204394698143,0.13771571218967438,0.1321021467447281,0.2842628061771393,908.4699096679688,1e-05,0.06974341720342636,2.3473751544952393,23.927850246429443,2 +8106,0.17625612020492554,0.18117718398571014,0.18242278695106506,0.2470192164182663,854.4303588867188,1e-05,0.06535147875547409,2.7051267623901367,23.927850246429443,2 +8107,0.1216169148683548,0.19304096698760986,0.1838052123785019,0.13990384340286255,916.4888305664062,1e-05,0.06964936852455139,2.3524954319000244,23.927850246429443,2 +8108,0.3323238492012024,0.13816481828689575,0.1390240490436554,0.22923076152801514,924.4791870117188,1e-05,0.09109924733638763,2.35148549079895,23.927850246429443,2 +8109,0.07872851192951202,0.20258864760398865,0.1972682923078537,0.25314101576805115,959.5725708007812,1e-05,0.05322655290365219,2.4668054580688477,23.927850246429443,2 +8110,0.13712111115455627,0.20470015704631805,0.19997727870941162,0.20673076808452606,896.0928344726562,1e-05,0.06116769462823868,2.354503870010376,23.927850246429443,2 +8111,0.1397625058889389,0.2266944944858551,0.22260449826717377,0.2516345977783203,756.319091796875,1e-05,0.07117611914873123,2.518333911895752,23.927850246429443,2 +8112,0.22024337947368622,0.21724461019039154,0.2079201489686966,0.21166665852069855,531.6091918945312,1e-05,0.07178264111280441,2.5066988468170166,23.927850246429443,2 +8113,0.152566596865654,0.13799551129341125,0.13530279695987701,0.2565705180168152,882.3529052734375,1e-05,0.06817904859781265,2.5004754066467285,23.927850246429443,2 +8114,0.10107828676700592,0.8987216949462891,0.903276801109314,0.2450961470603943,34.046695709228516,1e-05,0.06775388866662979,2.3518383502960205,23.927850246429443,2 +8115,0.3276255130767822,0.2574387490749359,0.2500002384185791,0.186153843998909,598.9583129882812,1e-05,0.09337224066257477,2.3490805625915527,23.927850246429443,2 +8116,0.13046084344387054,0.12259045988321304,0.1240893006324768,0.2323397397994995,931.1224365234375,1e-05,0.0645814910531044,2.494321346282959,23.927850246429443,2 +8117,0.24540570378303528,0.09281456470489502,0.09922512620687485,0.3061538338661194,793.795654296875,1e-05,0.07022900879383087,2.3529489040374756,23.927850246429443,2 +8118,0.2567581236362457,0.23663543164730072,0.23582151532173157,0.20416666567325592,509.47869873046875,1e-05,0.06976595520973206,2.349842071533203,23.927850246429443,2 +8119,0.2232327163219452,0.291728675365448,0.2987251281738281,0.23730768263339996,364.73089599609375,1e-05,0.06944458186626434,2.348444700241089,23.927850246429443,2 +8120,0.1553778052330017,0.25549381971359253,0.24678227305412292,0.27974358201026917,948.6500244140625,1e-05,0.062428656965494156,2.5792946815490723,23.927850246429443,2 +8121,0.2018917202949524,0.9259595274925232,0.933722198009491,0.21387819945812225,38.75969314575195,1e-05,0.0643022209405899,2.3531956672668457,23.927850246429443,2 +8122,0.1765836477279663,0.1424456685781479,0.1396380513906479,0.07499999552965164,923.458740234375,1e-05,0.0667959526181221,2.350112199783325,23.927850246429443,2 +8123,0.077443428337574,0.23893344402313232,0.23285527527332306,0.20637819170951843,984.494384765625,1e-05,0.06611645966768265,2.5012307167053223,23.927850246429443,2 +8124,0.35105904936790466,0.11621180176734924,0.11992911249399185,0.18753203749656677,900.4474487304688,1e-05,0.08940334618091583,2.362351894378662,23.927850246429443,2 +8125,0.2188885509967804,0.14114300906658173,0.1393670290708542,0.18676280975341797,865.6211547851562,1e-05,0.06888969987630844,2.3552420139312744,23.927850246429443,2 +8126,0.23562957346439362,0.2820289433002472,0.268057644367218,0.27128204703330994,770.7055053710938,1e-05,0.06960288435220718,2.358290910720825,23.927850246429443,2 +8127,0.19262002408504486,0.07871966063976288,0.08518342673778534,0.19240383803844452,723.90576171875,1e-05,0.07411952316761017,2.5230135917663574,23.927850246429443,2 +8128,0.24411362409591675,0.06278907507658005,0.06041599437594414,0.18887819349765778,769.2307739257812,1e-05,0.08008364588022232,2.356844902038574,23.927850246429443,2 +8129,0.3086671829223633,0.33804193139076233,0.324726402759552,0.24935896694660187,215.23179626464844,1e-05,0.0911039337515831,2.3616554737091064,23.927850246429443,2 +8130,0.11391523480415344,0.19258974492549896,0.18890395760536194,0.1234615370631218,496.98797607421875,1e-05,0.0624343678355217,2.473097562789917,23.927850246429443,2 +8131,0.21713250875473022,0.15133734047412872,0.15375736355781555,0.29221153259277344,563.1868286132812,1e-05,0.0745268315076828,2.366177797317505,23.927850246429443,2 +8132,0.21097207069396973,0.5049048066139221,0.5086913108825684,0.22499999403953552,222.03948974609375,1e-05,0.06469137221574783,2.470824956893921,23.927850246429443,2 +8133,0.16058778762817383,0.049478188157081604,0.04446631297469139,0.09410256147384644,867.5030517578125,1e-05,0.0616055428981781,2.3585097789764404,23.927850246429443,2 +8134,0.1929188072681427,0.17562294006347656,0.18308039009571075,0.2401602417230606,579.399169921875,1e-05,0.07121497392654419,2.6345503330230713,23.927850246429443,2 +8135,0.18758602440357208,0.15853968262672424,0.1642485111951828,0.26028844714164734,500.59954833984375,1e-05,0.06832102686166763,2.3642680644989014,23.927850246429443,2 +8136,0.16676943004131317,0.10925047844648361,0.1073978841304779,0.2560897469520569,942.4212036132812,1e-05,0.07159949094057083,2.353020429611206,23.927850246429443,2 +8137,0.23995846509933472,0.5423409938812256,0.5499877333641052,0.27733972668647766,161.1498260498047,1e-05,0.0708167627453804,2.492737293243408,23.927850246429443,2 +8138,0.11674593389034271,0.09809862077236176,0.12053615599870682,0.2635897397994995,962.2467651367188,1e-05,0.05975747108459473,2.3552908897399902,23.927850246429443,2 +8139,0.14409378170967102,0.18179045617580414,0.17674680054187775,0.20240384340286255,806.7376098632812,1e-05,0.06863583624362946,2.3528244495391846,23.927850246429443,2 +8140,0.22699479758739471,0.3642581105232239,0.37706488370895386,0.23009614646434784,251.59742736816406,1e-05,0.06575381755828857,2.34877610206604,23.927850246429443,2 +8141,0.2382321059703827,0.1765180379152298,0.17063333094120026,0.1790063977241516,626.2474975585938,1e-05,0.07203608006238937,2.5746302604675293,23.927850246429443,2 +8142,0.16201967000961304,0.14624954760074615,0.15079177916049957,0.2435256391763687,799.0620727539062,1e-05,0.0667177364230156,2.5600740909576416,23.927850246429443,2 +8143,0.18938955664634705,0.16623538732528687,0.16736064851284027,0.18673075735569,712.13427734375,1e-05,0.06606800109148026,2.358020067214966,23.927850246429443,2 +8144,0.27055567502975464,0.15301018953323364,0.1509992480278015,0.21342948079109192,902.3915405273438,1e-05,0.06538904458284378,2.601536512374878,23.927850246429443,2 +8145,0.23502539098262787,0.2054012268781662,0.20121848583221436,0.1899999976158142,943.9275512695312,1e-05,0.06819106638431549,2.491346836090088,23.927850246429443,2 +8146,0.0981840044260025,0.22066852450370789,0.22037167847156525,0.26019230484962463,954.0719604492188,1e-05,0.05919075384736061,2.3495569229125977,23.927850246429443,2 +8147,0.1752931773662567,0.24942854046821594,0.2520143985748291,0.23849357664585114,478.3950500488281,1e-05,0.07627230137586594,2.3543360233306885,23.927850246429443,2 +8148,0.20119251310825348,0.19166353344917297,0.1823893040418625,0.22871793806552887,899.6636962890625,1e-05,0.06429366767406464,2.71059250831604,23.927850246429443,2 +8149,0.23972249031066895,0.16952845454216003,0.16834647953510284,0.22378204762935638,821.9178466796875,1e-05,0.06861996650695801,2.361590623855591,23.927850246429443,2 +8150,0.20014166831970215,0.12772588431835175,0.13148795068264008,0.24275639653205872,423.2804260253906,1e-05,0.0742870345711708,2.3514740467071533,23.927850246429443,2 +8151,0.23636433482170105,0.2246616929769516,0.21537253260612488,0.2074679434299469,893.6715698242188,1e-05,0.07270203530788422,2.3605451583862305,23.927850246429443,2 +8152,0.3192254304885864,0.2220619171857834,0.2157314568758011,0.18823717534542084,863.7206420898438,1e-05,0.06877315044403076,2.492969274520874,23.927850246429443,2 +8153,0.17686045169830322,0.08754715323448181,0.09293922036886215,0.1648397445678711,932.418701171875,1e-05,0.06923697143793106,2.477616310119629,23.927850246429443,2 +8154,0.23850467801094055,0.7587420344352722,0.8061685562133789,0.16740384697914124,38.75969314575195,1e-05,0.09962925314903259,2.3682212829589844,23.927850246429443,2 +8155,0.26238641142845154,0.1147734597325325,0.11462409794330597,0.2560897469520569,678.7020263671875,1e-05,0.06326441466808319,2.5812320709228516,23.927850246429443,2 +8156,0.0775628536939621,0.19426476955413818,0.195066899061203,0.22756409645080566,815.9722900390625,1e-05,0.06635671108961105,2.3609938621520996,23.927850246429443,2 +8157,0.22028034925460815,0.20751628279685974,0.20691239833831787,0.1944551169872284,941.20556640625,1e-05,0.0860074907541275,2.351580858230591,23.927850246429443,2 +8158,0.15150293707847595,0.18083946406841278,0.19640633463859558,0.25708332657814026,986.064208984375,1e-05,0.069874607026577,2.517871141433716,23.927850246429443,2 +8159,0.1661330759525299,0.18896761536598206,0.18638788163661957,0.18516024947166443,975.6365966796875,1e-05,0.06026901677250862,2.356544256210327,23.927850246429443,2 +8160,0.21119926869869232,0.2828035056591034,0.26759934425354004,0.2841345965862274,891.2169799804688,1e-05,0.06041780859231949,2.3500025272369385,23.927850246429443,2 +8161,0.2189064621925354,0.19421854615211487,0.20521079003810883,0.2169230729341507,594.86376953125,1e-05,0.08085481077432632,2.3458309173583984,23.927850246429443,2 +8162,0.258024662733078,0.2874714136123657,0.2702748477458954,0.24833332002162933,992.374267578125,1e-05,0.07789567112922668,2.3461973667144775,23.927850246429443,2 +8163,0.16969391703605652,0.2643323838710785,0.26413917541503906,0.21214742958545685,362.2159423828125,1e-05,0.06586342304944992,2.6047744750976562,23.927850246429443,2 +8164,0.15953335165977478,0.2304803729057312,0.23418641090393066,0.23753204941749573,984.94482421875,1e-05,0.08178775012493134,2.5714690685272217,23.927850246429443,2 +8165,0.1617601215839386,0.2839477062225342,0.26380541920661926,0.2833012640476227,923.1171264648438,1e-05,0.06684567034244537,2.5675928592681885,23.927850246429443,2 +8166,0.17427755892276764,0.2621256709098816,0.25539734959602356,0.24919870495796204,791.788818359375,1e-05,0.07324858009815216,2.552852153778076,23.927850246429443,2 +8167,0.17319421470165253,0.10736104846000671,0.11581670492887497,0.21477563679218292,852.9224853515625,1e-05,0.07353177666664124,2.355165958404541,23.927850246429443,2 +8168,0.29826754331588745,0.10166044533252716,0.10628647357225418,0.16900640726089478,828.2725830078125,1e-05,0.07428616285324097,2.348841667175293,23.927850246429443,2 +8169,0.2423900067806244,0.36791330575942993,0.36394980549812317,0.1941666603088379,994.89794921875,1e-05,0.07510103285312653,2.608330011367798,23.927850246429443,2 +8170,0.25563737750053406,0.11694210022687912,0.11439219117164612,0.306538462638855,926.8355712890625,1e-05,0.06948433071374893,2.352323532104492,23.927850246429443,2 +8171,0.14840665459632874,0.11293569207191467,0.10507642477750778,0.24028845131397247,883.6459350585938,1e-05,0.07795292884111404,2.3584840297698975,23.927850246429443,2 +8172,0.14553025364875793,0.3469081223011017,0.3259408175945282,0.21935896575450897,986.952880859375,1e-05,0.06526818126440048,2.355349540710449,23.927850246429443,2 +8173,0.1939491480588913,0.17759902775287628,0.17297635972499847,0.18833333253860474,782.1857299804688,1e-05,0.07147183269262314,2.539060592651367,23.927850246429443,2 +8174,0.1837405115365982,0.18639373779296875,0.19329719245433807,0.21993589401245117,427.6316223144531,1e-05,0.06707601994276047,2.4904520511627197,23.927850246429443,2 +8175,0.17911426723003387,0.09157917648553848,0.09887271374464035,0.2247435748577118,921.7437133789062,1e-05,0.06523717194795609,2.3709511756896973,23.927850246429443,2 +8176,0.1713467687368393,0.15905065834522247,0.15799465775489807,0.1572115272283554,730.0333251953125,1e-05,0.060431573539972305,2.5507123470306396,23.927850246429443,2 +8177,0.19515889883041382,0.12107149511575699,0.12460421770811081,0.24814102053642273,789.0855712890625,1e-05,0.08117452263832092,2.372722625732422,23.927850246429443,2 +8178,0.21557781100273132,0.3162418007850647,0.31639882922172546,0.2172115296125412,403.11651611328125,1e-05,0.07132261246442795,2.3555076122283936,23.927850246429443,2 +8179,0.17344427108764648,0.21850638091564178,0.20967404544353485,0.23778845369815826,932.7411499023438,1e-05,0.06209544464945793,2.3534059524536133,23.927850246429443,2 +8180,0.3669852912425995,0.20420467853546143,0.1882128268480301,0.2260897308588028,912.162109375,1e-05,0.07475723326206207,2.5873100757598877,23.927850246429443,2 +8181,0.2633424401283264,0.3790830075740814,0.36157235503196716,0.23240384459495544,528.291015625,1e-05,0.07162877172231674,2.3496150970458984,23.927850246429443,2 +8182,0.12193924933671951,0.0944410189986229,0.10564744472503662,0.2714102566242218,896.4932861328125,1e-05,0.06737080216407776,2.3504443168640137,23.927850246429443,2 +8183,0.1459333747625351,0.2104339599609375,0.2169218212366104,0.1377243548631668,489.6593933105469,1e-05,0.07945600897073746,2.3520760536193848,23.927850246429443,2 +8184,0.2093314379453659,0.143692746758461,0.14216522872447968,0.26932692527770996,828.8410034179688,1e-05,0.0834878459572792,2.5006935596466064,23.927850246429443,2 +8185,0.19305481016635895,0.14699460566043854,0.1377006322145462,0.23711538314819336,835.5437622070312,1e-05,0.06567344814538956,2.5686209201812744,23.927850246429443,2 +8186,0.16982345283031464,0.25989460945129395,0.24940437078475952,0.11599358916282654,844.6821899414062,1e-05,0.06070242077112198,2.521080255508423,23.927850246429443,2 +8187,0.09082650393247604,0.18659228086471558,0.1766166239976883,0.2624358832836151,830.5369873046875,1e-05,0.06110144779086113,2.4988794326782227,23.927850246429443,2 +8188,0.2533375918865204,0.28698012232780457,0.28055447340011597,0.21666665375232697,926.8355712890625,1e-05,0.0822712630033493,2.3539958000183105,23.927850246429443,2 +8189,0.2293272316455841,0.1396775245666504,0.13804852962493896,0.23294870555400848,907.3464965820312,1e-05,0.07071588933467865,2.3483119010925293,23.927850246429443,2 +8190,0.1709580421447754,0.207133948802948,0.20989632606506348,0.21333332359790802,889.1455078125,1e-05,0.06234922260046005,2.5045557022094727,23.927850246429443,2 +8191,0.13986535370349884,0.1253916174173355,0.1253659874200821,0.2480769157409668,863.7206420898438,1e-05,0.06995348632335663,2.3555030822753906,23.927850246429443,2 +8192,0.13932323455810547,0.20972952246665955,0.207627072930336,0.20044870674610138,952.3810424804688,1e-05,0.06087421625852585,2.3565516471862793,23.927850246429443,2 +8193,0.24380488693714142,0.15261885523796082,0.1527436524629593,0.24419870972633362,946.3070678710938,1e-05,0.08612567186355591,2.3492913246154785,23.927850246429443,2 +8194,0.2634829580783844,0.2901184856891632,0.2817274332046509,0.23580127954483032,634.842529296875,1e-05,0.06736139208078384,2.4626967906951904,23.927850246429443,2 +8195,0.3063291311264038,0.30672773718833923,0.3113058805465698,0.2958012819290161,583.6886596679688,1e-05,0.06997435539960861,2.383357048034668,23.927850246429443,2 +8196,0.1584692746400833,0.8807395100593567,0.8908284902572632,0.24012818932533264,9.920635223388672,1e-05,0.07227740436792374,2.623443126678467,23.927850246429443,2 +8197,0.16421182453632355,0.19458292424678802,0.193400040268898,0.17685896158218384,403.11651611328125,1e-05,0.056744880974292755,2.7231578826904297,23.927850246429443,2 +8198,0.17698845267295837,0.19492709636688232,0.19929403066635132,0.19243589043617249,876.6427001953125,1e-05,0.0647430270910263,3.4587302207946777,23.927850246429443,2 +8199,0.07568351924419403,0.17930640280246735,0.18458037078380585,0.11051281541585922,973.2064208984375,1e-05,0.06361095607280731,3.24444317817688,23.927850246429443,2 +8200,0.11517448723316193,0.08401805907487869,0.08850788325071335,0.13977563381195068,705.574951171875,1e-05,0.06678405404090881,3.078648328781128,23.927850246429443,2 +8201,0.1732006072998047,0.1274411529302597,0.12347511947154999,0.2636217772960663,837.7308349609375,1e-05,0.06666091084480286,2.9154834747314453,23.927850246429443,2 +8202,0.23788505792617798,0.17809362709522247,0.17846092581748962,0.18458332121372223,930.143310546875,1e-05,0.06487780064344406,2.3607518672943115,23.927850246429443,2 +8203,0.13232529163360596,0.1198246106505394,0.12638069689273834,0.24144229292869568,660.3773803710938,1e-05,0.060934800654649734,2.3521206378936768,23.927850246429443,2 +8204,0.11572010815143585,0.04027335345745087,0.04752664640545845,0.19932691752910614,844.1558227539062,1e-05,0.071468785405159,2.352968215942383,23.927850246429443,2 +8205,0.1794375628232956,0.251992791891098,0.2534216344356537,0.26538461446762085,485.94134521484375,1e-05,0.07032331824302673,2.5681633949279785,23.927850246429443,2 +8206,0.18370504677295685,0.10458458214998245,0.10393643379211426,0.2516666650772095,969.2273559570312,1e-05,0.06533902883529663,2.364675760269165,23.927850246429443,2 +8207,0.2640463411808014,0.2781063914299011,0.27336281538009644,0.23365384340286255,640.8381958007812,1e-05,0.06745054572820663,2.732478141784668,23.927850246429443,2 +8208,0.33017152547836304,0.16343757510185242,0.15975891053676605,0.12599357962608337,688.9586791992188,1e-05,0.07832380384206772,2.5739777088165283,23.927850246429443,2 +8209,0.31099843978881836,0.12908659875392914,0.1390390247106552,0.18144230544567108,462.8463439941406,1e-05,0.08257019519805908,2.3585214614868164,23.927850246429443,2 +8210,0.15981855988502502,0.21430426836013794,0.2048856019973755,0.22320511937141418,631.1881713867188,1e-05,0.0577278807759285,2.415593385696411,23.927850246429443,2 +8211,0.375650554895401,0.11305996030569077,0.1117127388715744,0.10727563500404358,642.0233154296875,1e-05,0.08552563190460205,2.5257115364074707,23.927850246429443,2 +8212,0.2639991044998169,0.14145427942276,0.13407865166664124,0.1464102566242218,616.125732421875,1e-05,0.06472011655569077,2.539130210876465,23.927850246429443,2 +8213,0.21795371174812317,0.15541872382164001,0.15926407277584076,0.16644230484962463,671.2963256835938,1e-05,0.06392969936132431,4.097864151000977,23.927850246429443,2 +8214,0.16228565573692322,0.15067991614341736,0.151544988155365,0.2514743506908417,956.8480224609375,1e-05,0.08848738670349121,3.7189736366271973,23.927850246429443,2 +8215,0.2365572154521942,0.15681622922420502,0.15194475650787354,0.1903846114873886,593.4874267578125,1e-05,0.08620134741067886,4.116002321243286,23.927850246429443,2 +8216,0.1210300400853157,0.16435077786445618,0.15987850725650787,0.19432692229747772,925.1558837890625,1e-05,0.0713144838809967,2.5922446250915527,23.927850246429443,2 +8217,0.30257102847099304,0.0885658785700798,0.09559868276119232,0.22480767965316772,822.50341796875,1e-05,0.06231861189007759,4.248051643371582,23.927850246429443,2 +8218,0.2807704210281372,0.1935613751411438,0.18145793676376343,0.2361217886209488,690.9660034179688,1e-05,0.06361014395952225,3.044501781463623,23.927850246429443,2 +8219,0.12587781250476837,0.1931750327348709,0.18318593502044678,0.19112178683280945,924.4791870117188,1e-05,0.08689216524362564,2.5351078510284424,23.927850246429443,2 +8220,0.17840661108493805,0.23419883847236633,0.23671330511569977,0.28737178444862366,831.0991821289062,1e-05,0.07364215701818466,2.3580174446105957,23.927850246429443,2 +8221,0.31269752979278564,0.21701976656913757,0.22449028491973877,0.2310897409915924,427.6316223144531,1e-05,0.07057449966669083,2.3574748039245605,23.927850246429443,2 +8222,0.2293907105922699,0.2730492651462555,0.26505985856056213,0.1677243560552597,386.7403564453125,1e-05,0.0690167248249054,2.670841932296753,23.927850246429443,2 +8223,0.21997785568237305,0.10955799371004105,0.11648502200841904,0.1148717924952507,803.5714111328125,1e-05,0.084436796605587,2.3585357666015625,23.927850246429443,2 +8224,0.1491514891386032,0.32506757974624634,0.3022650480270386,0.14782050251960754,989.3660888671875,1e-05,0.06310005486011505,2.360055685043335,23.927850246429443,2 +8225,0.2881752848625183,0.18000172078609467,0.17677345871925354,0.25833332538604736,577.95703125,1e-05,0.08153068274259567,2.3553409576416016,23.927850246429443,2 +8226,0.12856125831604004,0.2893619239330292,0.28114020824432373,0.2862820327281952,965.3915405273438,1e-05,0.06302385777235031,2.4931957721710205,23.927850246429443,2 +8227,0.09848073124885559,0.13753950595855713,0.14463289082050323,0.26820510625839233,892.8571166992188,1e-05,0.06558869779109955,2.3566126823425293,23.927850246429443,2 +8228,0.1969752460718155,0.10805924981832504,0.10095728188753128,0.20682691037654877,860.34912109375,1e-05,0.06945822387933731,2.673034191131592,23.927850246429443,2 +8229,0.22253067791461945,0.16412143409252167,0.165025532245636,0.22544871270656586,817.174560546875,1e-05,0.07621992379426956,2.871182441711426,23.927850246429443,2 +8230,0.21342474222183228,0.0806773379445076,0.08291041851043701,0.20538461208343506,814.15625,1e-05,0.07105346769094467,2.4514639377593994,23.927850246429443,2 +8231,0.17739053070545197,0.2682795822620392,0.2624068260192871,0.2537499964237213,972.2222290039062,1e-05,0.08727415651082993,3.8403148651123047,23.927850246429443,2 +8232,0.12038706988096237,0.2768017649650574,0.2634402811527252,0.31121793389320374,990.0166625976562,1e-05,0.06655152142047882,3.7100605964660645,23.927850246429443,2 +8233,0.2013750821352005,0.27834394574165344,0.264335960149765,0.3034615218639374,966.1671142578125,1e-05,0.07129435241222382,3.5511651039123535,23.927850246429443,2 +8234,0.2569447159767151,0.1810453236103058,0.18206480145454407,0.1733333319425583,586.51806640625,1e-05,0.07381556928157806,2.6711463928222656,23.927850246429443,2 +8235,0.16769440472126007,0.18584874272346497,0.18153350055217743,0.23323717713356018,936.2449951171875,1e-05,0.06568209081888199,2.354306221008301,23.927850246429443,2 +8236,0.35927799344062805,0.08266911655664444,0.0885334461927414,0.1524038463830948,855.4293212890625,1e-05,0.07388012856245041,2.355649709701538,23.927850246429443,2 +8237,0.13928359746932983,0.26451006531715393,0.26724693179130554,0.17224358022212982,981.2984008789062,1e-05,0.06502299010753632,2.487682580947876,23.927850246429443,2 +8238,0.09752865880727768,0.3657473623752594,0.36862611770629883,0.24333332479000092,994.0623168945312,1e-05,0.06468196213245392,2.365532875061035,23.927850246429443,2 +8239,0.18396982550621033,0.43672335147857666,0.446023166179657,0.1922435760498047,43.43629455566406,1e-05,0.08081107586622238,2.614736795425415,23.927850246429443,2 +8240,0.22317318618297577,0.07628585398197174,0.08262591063976288,0.13179486989974976,797.7569580078125,1e-05,0.07355939596891403,2.539537191390991,23.927850246429443,2 +8241,0.20223943889141083,0.11958098411560059,0.11965379863977432,0.16737179458141327,526.620361328125,1e-05,0.07125990092754364,2.358750820159912,23.927850246429443,2 +8242,0.32443445920944214,0.1584128737449646,0.15875107049942017,0.2770833373069763,946.896240234375,1e-05,0.07212503254413605,2.3494608402252197,23.927850246429443,2 +8243,0.22622321546077728,0.1358492523431778,0.1338895857334137,0.2093910127878189,736.0197143554688,1e-05,0.08067256957292557,2.527287006378174,23.927850246429443,2 +8244,0.2434946894645691,0.16994306445121765,0.15876436233520508,0.22769230604171753,761.7188110351562,1e-05,0.07407332211732864,2.36100435256958,23.927850246429443,2 +8245,0.19159016013145447,0.14692062139511108,0.14762172102928162,0.23923076689243317,959.0316162109375,1e-05,0.06413235515356064,2.3633933067321777,23.927850246429443,2 +8246,0.15018203854560852,0.1719169020652771,0.1643354296684265,0.2221153825521469,897.2911987304688,1e-05,0.07039625942707062,2.486964464187622,23.927850246429443,2 +8247,0.2125774323940277,0.1052619144320488,0.10167771577835083,0.1831730753183365,554.0089721679688,1e-05,0.07751142233610153,2.5818521976470947,23.927850246429443,2 +8248,0.14053523540496826,0.25912028551101685,0.25392189621925354,0.24833332002162933,580.8350830078125,1e-05,0.06430826336145401,2.5235769748687744,23.927850246429443,2 +8249,0.21152539551258087,0.19857212901115417,0.1900862604379654,0.18163460493087769,721.2352294921875,1e-05,0.0900774747133255,4.754737854003906,23.927850246429443,2 +8250,0.21568603813648224,0.16824226081371307,0.16396185755729675,0.1552884578704834,651.3410034179688,1e-05,0.07538049668073654,2.7647995948791504,23.927850246429443,2 +8251,0.185918390750885,0.18471664190292358,0.17808391153812408,0.23009614646434784,853.9290161132812,1e-05,0.07472815364599228,3.7759604454040527,23.927850246429443,2 +8252,0.1627362221479416,0.05854225903749466,0.06191135570406914,0.15743589401245117,807.365478515625,1e-05,0.0688987597823143,2.514780044555664,23.927850246429443,2 +8253,0.2213933765888214,0.06182386353611946,0.06669369339942932,0.10711538046598434,889.9769897460938,1e-05,0.08401336520910263,2.3544602394104004,23.927850246429443,2 +8254,0.20505355298519135,0.15298613905906677,0.15375538170337677,0.17230768501758575,649.0385131835938,1e-05,0.06741824001073837,2.6119492053985596,23.927850246429443,2 +8255,0.18917851150035858,0.12093151360750198,0.12983620166778564,0.26317307353019714,921.0526123046875,1e-05,0.0683426633477211,2.3599624633789062,23.927850246429443,2 +8256,0.24030141532421112,0.18196344375610352,0.16899164021015167,0.23102563619613647,733.4710693359375,1e-05,0.10528679192066193,2.3553566932678223,23.927850246429443,2 +8257,0.25224894285202026,0.7650895118713379,0.7832834720611572,0.17089742422103882,66.28787994384766,1e-05,0.06809161603450775,2.353591203689575,23.927850246429443,2 +8258,0.2081519365310669,0.09391628205776215,0.09963595867156982,0.11346153169870377,755.5379638671875,1e-05,0.06552968174219131,2.3550353050231934,23.927850246429443,2 +8259,0.21787995100021362,0.12799684703350067,0.12951846420764923,0.1868269145488739,804.208251953125,1e-05,0.07866241782903671,2.512425661087036,23.927850246429443,2 +8260,0.2727258801460266,0.16300678253173828,0.15908779203891754,0.19929486513137817,741.8699340820312,1e-05,0.08884429931640625,2.5954763889312744,23.927850246429443,2 +8261,0.2572823166847229,0.24761314690113068,0.23744437098503113,0.20455127954483032,500.59954833984375,1e-05,0.07010261714458466,2.4893460273742676,23.927850246429443,2 +8262,0.17197489738464355,0.2166513353586197,0.21035806834697723,0.26057690382003784,948.067626953125,1e-05,0.07273128628730774,2.350687026977539,23.927850246429443,2 +8263,0.2907058596611023,0.3534371256828308,0.3551717698574066,0.2547435760498047,241.93548583984375,1e-05,0.08415888994932175,2.348308801651001,23.927850246429443,2 +8264,0.14361456036567688,0.29996082186698914,0.2812172472476959,0.22730767726898193,981.9896850585938,1e-05,0.07455984503030777,2.478853225708008,23.927850246429443,2 +8265,0.22082528471946716,0.20907972753047943,0.19745664298534393,0.2851923108100891,777.2314453125,1e-05,0.0712340697646141,2.53082537651062,23.927850246429443,2 +8266,0.15152746438980103,0.26118576526641846,0.2473875731229782,0.19871793687343597,972.2222290039062,1e-05,0.06556348502635956,2.348255157470703,23.927850246429443,2 +8267,0.2754267454147339,0.7158539891242981,0.726762592792511,0.3064422905445099,57.25191116333008,1e-05,0.07981003075838089,2.3490612506866455,23.927850246429443,2 +8268,0.1919061690568924,0.1587165743112564,0.16784927248954773,0.19759614765644073,937.8121948242188,1e-05,0.07105462998151779,2.3516693115234375,23.927850246429443,2 +8269,0.3071557879447937,0.32030242681503296,0.31512558460235596,0.12262819707393646,303.0303039550781,1e-05,0.06461281329393387,2.461397647857666,23.927850246429443,2 +8270,0.22207826375961304,0.06379131972789764,0.06332434713840485,0.11798076331615448,825.4075927734375,1e-05,0.06737625598907471,2.3533685207366943,23.927850246429443,2 +8271,0.0729130282998085,0.14159634709358215,0.14030195772647858,0.28967946767807007,900.8379516601562,1e-05,0.06721361726522446,2.5273663997650146,23.927850246429443,2 +8272,0.11274091899394989,0.15892449021339417,0.15395332872867584,0.2468269169330597,818.3701782226562,1e-05,0.06562521308660507,2.563295364379883,23.927850246429443,2 +8273,0.20484621822834015,0.9774200916290283,0.9812922477722168,0.2678205072879791,24.50980567932129,1e-05,0.07181064784526825,2.349121570587158,23.927850246429443,2 +8274,0.12548011541366577,0.15332509577274323,0.1604720801115036,0.1669551283121109,891.2169799804688,1e-05,0.06261537969112396,2.3520686626434326,23.927850246429443,2 +8275,0.15589639544487,0.21878761053085327,0.210770383477211,0.22596153616905212,849.3589477539062,1e-05,0.06478502601385117,2.6979308128356934,23.927850246429443,2 +8276,0.1729031205177307,0.15767045319080353,0.1604657918214798,0.20150640606880188,504.1766052246094,1e-05,0.07045084983110428,2.417210578918457,23.927850246429443,2 +8277,0.1696307212114334,0.21940816938877106,0.2112446427345276,0.28900641202926636,897.2911987304688,1e-05,0.0659678652882576,2.434645175933838,23.927850246429443,2 +8278,0.07867774367332458,0.15066492557525635,0.14076128602027893,0.15310896933078766,889.5617065429688,1e-05,0.06739019602537155,2.4840304851531982,23.927850246429443,2 +8279,0.16135630011558533,0.22414903342723846,0.21595536172389984,0.23256409168243408,935.9296264648438,1e-05,0.06828802078962326,2.3491170406341553,23.927850246429443,2 +8280,0.19248978793621063,0.13430283963680267,0.1398066133260727,0.1783333271741867,879.7392578125,1e-05,0.09726890176534653,2.8933327198028564,23.927850246429443,2 +8281,0.2516860067844391,0.18422633409500122,0.1894729882478714,0.10141025483608246,965.9091796875,1e-05,0.07404471188783646,2.915358304977417,23.927850246429443,2 +8282,0.23636697232723236,0.05140373483300209,0.0609920434653759,0.19185896217823029,606.9959106445312,1e-05,0.06986135244369507,3.1076929569244385,23.927850246429443,2 +8283,0.23379859328269958,0.3955748975276947,0.39437058568000793,0.16403844952583313,300.1519775390625,1e-05,0.06729690730571747,2.920107841491699,23.927850246429443,2 +8284,0.1346619576215744,0.14558690786361694,0.14453816413879395,0.19173076748847961,832.777099609375,1e-05,0.07483889907598495,2.7357940673828125,23.927850246429443,2 +8285,0.2648952007293701,0.18220391869544983,0.1847856491804123,0.19211538136005402,963.3027954101562,1e-05,0.0871872752904892,3.01102614402771,23.927850246429443,2 +8286,0.2049332708120346,0.20596866309642792,0.2032315880060196,0.13951922953128815,442.5064697265625,1e-05,0.060718223452568054,2.5778937339782715,23.927850246429443,2 +8287,0.1628882735967636,0.16398394107818604,0.14807705581188202,0.17144230008125305,885.3558349609375,1e-05,0.08565486967563629,2.3976597785949707,23.927850246429443,2 +8288,0.20688512921333313,0.2675245702266693,0.2533378005027771,0.2370833307504654,988.2747802734375,1e-05,0.0649971142411232,2.3686611652374268,23.927850246429443,2 +8289,0.28106623888015747,0.2087917923927307,0.20483221113681793,0.11176281422376633,870.7523803710938,1e-05,0.08040851354598999,2.385701894760132,23.927850246429443,2 +8290,0.301418662071228,0.10566200315952301,0.1117248386144638,0.30185896158218384,917.9064331054688,1e-05,0.06713881343603134,2.4070982933044434,23.927850246429443,2 +8291,0.1675429791212082,0.45358943939208984,0.4346652925014496,0.23615384101867676,994.4806518554688,1e-05,0.05770289897918701,2.479959487915039,23.927850246429443,2 +8292,0.2511292099952698,0.18685966730117798,0.17682071030139923,0.28214743733406067,840.9685668945312,1e-05,0.08451833575963974,2.4785895347595215,23.927850246429443,2 +8293,0.22660991549491882,0.41298824548721313,0.4097588062286377,0.24842947721481323,215.23179626464844,1e-05,0.07422801107168198,2.480861186981201,23.927850246429443,2 +8294,0.1060962975025177,0.15806636214256287,0.16256028413772583,0.245961531996727,861.318359375,1e-05,0.07395493239164352,2.3616628646850586,23.927850246429443,2 +8295,0.2626066207885742,0.15513287484645844,0.1559024602174759,0.2836858928203583,753.9683227539062,1e-05,0.07069181650876999,2.348814010620117,23.927850246429443,2 +8296,0.13773028552532196,0.7600299715995789,0.8084778189659119,0.15304486453533173,29.296875,1e-05,0.06273171305656433,2.5043294429779053,23.927850246429443,2 +8297,0.10815927386283875,0.0957595556974411,0.10368998348712921,0.27182692289352417,918.6107788085938,1e-05,0.05916188284754753,2.506772994995117,23.927850246429443,2 +8298,0.19764721393585205,0.25973260402679443,0.253267377614975,0.22746793925762177,512.9716796875,1e-05,0.08526553958654404,2.3513758182525635,23.927850246429443,2 +8299,0.16274607181549072,0.17532879114151,0.1654854416847229,0.20128203928470612,741.0423583984375,1e-05,0.07314493507146835,2.352903127670288,23.927850246429443,2 +8300,0.14398497343063354,0.21993781626224518,0.23995625972747803,0.19788460433483124,204.84951782226562,1e-05,0.07301786541938782,2.351972818374634,23.927850246429443,2 +8301,0.21015802025794983,0.12941375374794006,0.140834778547287,0.1659935861825943,889.9769897460938,1e-05,0.06632493436336517,2.349757671356201,23.927850246429443,2 +8302,0.20022253692150116,0.13509665429592133,0.1331268697977066,0.2477884590625763,818.3701782226562,1e-05,0.07283562421798706,2.6127655506134033,23.927850246429443,2 +8303,0.29471415281295776,0.1456662267446518,0.13872094452381134,0.15939101576805115,815.3685913085938,1e-05,0.07005510479211807,2.6319801807403564,23.927850246429443,2 +8304,0.17704400420188904,0.20727430284023285,0.20496448874473572,0.17522434890270233,504.1766052246094,1e-05,0.06349064409732819,2.355748414993286,23.927850246429443,2 +8305,0.14188137650489807,0.19775430858135223,0.19261716306209564,0.2383333295583725,976.5967407226562,1e-05,0.0664844661951065,2.3485567569732666,23.927850246429443,2 +8306,0.2630378305912018,0.16734065115451813,0.15100635588169098,0.24163460731506348,793.128662109375,1e-05,0.0748659074306488,2.348092555999756,23.927850246429443,2 +8307,0.27548056840896606,0.36353546380996704,0.34522315859794617,0.2677564024925232,988.0552978515625,1e-05,0.08065838366746902,2.650609254837036,23.927850246429443,2 +8308,0.1605837047100067,0.23114272952079773,0.22397515177726746,0.2518269121646881,983.5890502929688,1e-05,0.0606776624917984,2.3626413345336914,23.927850246429443,2 +8309,0.25348132848739624,0.17530138790607452,0.1761767566204071,0.22323717176914215,637.2549438476562,1e-05,0.08450386673212051,2.348869800567627,23.927850246429443,2 +8310,0.32445821166038513,0.17009477317333221,0.1577519178390503,0.2832051217556,688.9586791992188,1e-05,0.0931372195482254,2.3525681495666504,23.927850246429443,2 +8311,0.19467328488826752,0.4350532293319702,0.4206729829311371,0.29374998807907104,994.2716674804688,1e-05,0.06561890244483948,2.358332872390747,23.927850246429443,2 +8312,0.1481514275074005,0.2326294183731079,0.2556062638759613,0.24480769038200378,996.1414184570312,1e-05,0.06854918599128723,2.5303761959075928,23.927850246429443,2 +8313,0.16497565805912018,0.17071717977523804,0.16511081159114838,0.2308012694120407,877.5327758789062,1e-05,0.07283016294240952,2.481189012527466,23.927850246429443,2 +8314,0.15704815089702606,0.2998908460140228,0.3341192603111267,0.2205769121646881,211.79405212402344,1e-05,0.09594020992517471,2.6025795936584473,23.927850246429443,2 +8315,0.21192656457424164,0.2144606113433838,0.20769613981246948,0.22368589043617249,834.9933471679688,1e-05,0.06505390256643295,2.360477924346924,23.927850246429443,2 +8316,0.15667735040187836,0.06485040485858917,0.0757712870836258,0.1928205043077469,920.358642578125,1e-05,0.07104846090078354,2.3510913848876953,23.927850246429443,2 +8317,0.11912236362695694,0.15734431147575378,0.15482793748378754,0.22564101219177246,807.9915161132812,1e-05,0.06891361624002457,2.3484795093536377,23.927850246429443,2 +8318,0.24475467205047607,0.10421165823936462,0.0979032889008522,0.2702564001083374,708.4055786132812,1e-05,0.09639308601617813,2.5496227741241455,23.927850246429443,2 +8319,0.24364998936653137,0.19347074627876282,0.1906358003616333,0.2131730616092682,899.2704467773438,1e-05,0.07713498175144196,2.357769250869751,23.927850246429443,2 +8320,0.20437303185462952,0.23267869651317596,0.23645378649234772,0.24157050251960754,967.7055053710938,1e-05,0.06142469868063927,2.347736358642578,23.927850246429443,2 +8321,0.14172989130020142,0.17045381665229797,0.15889927744865417,0.20753204822540283,782.1857299804688,1e-05,0.06906547397375107,2.3519608974456787,23.927850246429443,2 +8322,0.2932191491127014,0.22063718736171722,0.20971831679344177,0.30253204703330994,916.1324462890625,1e-05,0.09917425364255905,2.3514020442962646,23.927850246429443,2 +8323,0.07891226559877396,0.12435664981603622,0.12199120223522186,0.2588782012462616,709.3425903320312,1e-05,0.06937149912118912,2.4999263286590576,23.927850246429443,2 +8324,0.17374840378761292,0.20664796233177185,0.19998964667320251,0.28006410598754883,959.8422241210938,1e-05,0.07264681905508041,2.5330653190612793,23.927850246429443,2 +8325,0.27514350414276123,0.25086161494255066,0.2662319540977478,0.23913460969924927,294.342529296875,1e-05,0.07073575258255005,2.6794867515563965,23.927850246429443,2 +8326,0.24041104316711426,0.14785945415496826,0.14465267956256866,0.2495192289352417,893.2648315429688,1e-05,0.07007668912410736,2.4760897159576416,23.927850246429443,2 +8327,0.2910923361778259,0.1639658659696579,0.1719403713941574,0.30839741230010986,396.1748962402344,1e-05,0.06613101810216904,2.3559110164642334,23.927850246429443,2 +8328,0.09081227332353592,0.14220647513866425,0.14330388605594635,0.24227562546730042,811.7109985351562,1e-05,0.07001406699419022,2.8261985778808594,23.927850246429443,2 +8329,0.24719160795211792,0.07789751142263412,0.08118293434381485,0.13602563738822937,714.8972778320312,1e-05,0.07732272893190384,2.9264981746673584,23.927850246429443,2 +8330,0.2689667344093323,0.24136586487293243,0.2270651012659073,0.26548075675964355,474.5657653808594,1e-05,0.07170304656028748,3.057114362716675,23.927850246429443,2 +8331,0.17519745230674744,0.09335820376873016,0.0884542316198349,0.29086536169052124,842.0365600585938,1e-05,0.06361434608697891,2.926178216934204,23.927850246429443,2 +8332,0.195740208029747,0.13822953402996063,0.14052018523216248,0.132916659116745,867.9705810546875,1e-05,0.0686461329460144,2.8159987926483154,23.927850246429443,2 +8333,0.210533007979393,0.1965302973985672,0.19782434403896332,0.19259615242481232,464.8240966796875,1e-05,0.07193735986948013,2.9905433654785156,23.927850246429443,2 +8334,0.1869828850030899,0.18053790926933289,0.1816985011100769,0.24487178027629852,663.6961059570312,1e-05,0.06534377485513687,2.5588958263397217,23.927850246429443,2 +8335,0.15291310846805573,0.1631164699792862,0.15821854770183563,0.25439101457595825,968.2146606445312,1e-05,0.059674426913261414,2.696640968322754,23.927850246429443,2 +8336,0.2203005701303482,0.20095263421535492,0.20545877516269684,0.1147756353020668,995.10595703125,1e-05,0.08339136093854904,2.383056402206421,23.927850246429443,2 +8337,0.16332463920116425,0.17080852389335632,0.17390567064285278,0.1828846037387848,934.3434448242188,1e-05,0.10357780009508133,2.3926761150360107,23.927850246429443,2 +8338,0.18757623434066772,0.12384375929832458,0.12485199421644211,0.24525639414787292,943.9275512695312,1e-05,0.103450708091259,2.646026611328125,23.927850246429443,2 +8339,0.18784171342849731,0.3476412892341614,0.34755411744117737,0.24804486334323883,322.7003173828125,1e-05,0.06683222204446793,2.489245891571045,23.927850246429443,2 +8340,0.1515299677848816,0.09218998998403549,0.09016714990139008,0.2488461434841156,875.74853515625,1e-05,0.07183016091585159,2.3630635738372803,23.927850246429443,2 +8341,0.25651830434799194,0.2683022618293762,0.2672812342643738,0.21477563679218292,502.3923645019531,1e-05,0.09984162449836731,2.3541159629821777,23.927850246429443,2 +8342,0.1499566286802292,0.24757908284664154,0.22890883684158325,0.22846153378486633,888.7283325195312,1e-05,0.0806821659207344,2.3512699604034424,23.927850246429443,2 +8343,0.11774665862321854,0.15009132027626038,0.14254377782344818,0.19929486513137817,869.3666381835938,1e-05,0.06188512593507767,2.351090431213379,23.927850246429443,2 +8344,0.19106267392635345,0.16587044298648834,0.16414766013622284,0.23666666448116302,709.3425903320312,1e-05,0.08820613473653793,2.573948860168457,23.927850246429443,2 +8345,0.150186225771904,0.2816808521747589,0.29146450757980347,0.26951920986175537,976.5967407226562,1e-05,0.07615263760089874,2.519212484359741,23.927850246429443,2 +8346,0.20139271020889282,0.25807061791419983,0.246932253241539,0.27756407856941223,984.94482421875,1e-05,0.09418997168540955,2.5623536109924316,23.927850246429443,2 +8347,0.22320902347564697,0.275286465883255,0.27772390842437744,0.2915705144405365,359.68658447265625,1e-05,0.07273317128419876,2.3536417484283447,23.927850246429443,2 +8348,0.3069691061973572,0.17868217825889587,0.1730831265449524,0.2440384477376938,802.292236328125,1e-05,0.08938512951135635,2.351292133331299,23.927850246429443,2 +8349,0.23276273906230927,0.20778697729110718,0.20589372515678406,0.2392948567867279,524.9420166015625,1e-05,0.07255463302135468,2.470546245574951,23.927850246429443,2 +8350,0.17973248660564423,0.15629293024539948,0.1549173891544342,0.20557691156864166,972.4690551757812,1e-05,0.07889629900455475,2.488699197769165,23.927850246429443,2 +8351,0.23647788166999817,0.194749116897583,0.18295948207378387,0.2157692164182663,966.4247436523438,1e-05,0.10366740822792053,2.352923631668091,23.927850246429443,2 +8352,0.30519574880599976,0.30810827016830444,0.31947028636932373,0.22391024231910706,270.376220703125,1e-05,0.09063122421503067,2.351004123687744,23.927850246429443,2 +8353,0.22234290838241577,0.08736061304807663,0.08466267585754395,0.24503204226493835,849.8719482421875,1e-05,0.07587043195962906,2.3636741638183594,23.927850246429443,2 +8354,0.14271432161331177,0.25008460879325867,0.25493893027305603,0.2316666543483734,547.7528686523438,1e-05,0.10256200283765793,2.360136032104492,23.927850246429443,2 +8355,0.29589173197746277,0.21015244722366333,0.20277062058448792,0.22051280736923218,909.5860595703125,1e-05,0.07971655577421188,2.5344536304473877,23.927850246429443,2 +8356,0.17734630405902863,0.2107516974210739,0.20726583898067474,0.21249999105930328,963.8278198242188,1e-05,0.06989914923906326,2.607210397720337,23.927850246429443,2 +8357,0.1403159648180008,0.14842814207077026,0.14442193508148193,0.25621792674064636,721.2352294921875,1e-05,0.0627228170633316,2.364649772644043,23.927850246429443,2 +8358,0.22246602177619934,0.21636977791786194,0.22412650287151337,0.2767307460308075,341.5697937011719,1e-05,0.11615278571844101,2.3566172122955322,23.927850246429443,2 +8359,0.0920742079615593,0.09672583639621735,0.10494692623615265,0.2456730604171753,915.4175415039062,1e-05,0.08259529620409012,2.3535053730010986,23.927850246429443,2 +8360,0.27048009634017944,0.17110267281532288,0.17191848158836365,0.09801281988620758,909.21484375,1e-05,0.07661620527505875,2.627495288848877,23.927850246429443,2 +8361,0.2709760069847107,0.240752175450325,0.23456062376499176,0.23673075437545776,416.6666564941406,1e-05,0.06870676577091217,2.3583760261535645,23.927850246429443,2 +8362,0.32132986187934875,0.2512856125831604,0.24700762331485748,0.20576922595500946,621.2273559570312,1e-05,0.10423122346401215,2.3481106758117676,23.927850246429443,2 +8363,0.17266294360160828,0.19206173717975616,0.19422313570976257,0.25833332538604736,969.9821166992188,1e-05,0.07509826868772507,2.3495585918426514,23.927850246429443,2 +8364,0.2516534626483917,0.1766137182712555,0.16542018949985504,0.24153845012187958,911.4300537109375,1e-05,0.07951038330793381,2.351315975189209,23.927850246429443,2 +8365,0.1538904905319214,0.23446549475193024,0.22195078432559967,0.196762815117836,898.8763427734375,1e-05,0.0826316624879837,2.472001075744629,23.927850246429443,2 +8366,0.27415505051612854,0.1116330549120903,0.10787723958492279,0.19221153855323792,614.83740234375,1e-05,0.0944942906498909,2.5361671447753906,23.927850246429443,2 +8367,0.11971080303192139,0.20465806126594543,0.1998690962791443,0.2607051134109497,981.9896850585938,1e-05,0.06146617233753204,2.501819372177124,23.927850246429443,2 +8368,0.3043697774410248,0.23772305250167847,0.21613308787345886,0.22224357724189758,914.3394165039062,1e-05,0.09537117928266525,2.3446478843688965,23.927850246429443,2 +8369,0.12404008209705353,0.10485276579856873,0.10229344666004181,0.13746795058250427,801.0057983398438,1e-05,0.0628727376461029,2.348515033721924,23.927850246429443,2 +8370,0.23658840358257294,0.269388347864151,0.2595820724964142,0.19307690858840942,991.7354736328125,1e-05,0.07846728712320328,2.494352102279663,23.927850246429443,2 +8371,0.16542096436023712,0.10800094157457352,0.10827238112688065,0.17320512235164642,889.1455078125,1e-05,0.08349578082561493,2.572458267211914,23.927850246429443,2 +8372,0.25543293356895447,0.18050535023212433,0.17687353491783142,0.1565384566783905,493.3414306640625,1e-05,0.07189135998487473,2.353660821914673,23.927850246429443,2 +8373,0.15223053097724915,0.22117096185684204,0.20895616710186005,0.2724679410457611,833.3333129882812,1e-05,0.0742148905992508,2.3515679836273193,23.927850246429443,2 +8374,0.23307713866233826,0.1723533719778061,0.15756669640541077,0.2499999850988388,911.7965698242188,1e-05,0.09188466519117355,2.3466956615448,23.927850246429443,2 +8375,0.16460196673870087,0.08387835323810577,0.0975487008690834,0.2203846126794815,915.4175415039062,1e-05,0.09572182595729828,2.3522467613220215,23.927850246429443,2 +8376,0.22319400310516357,0.10372611880302429,0.11984752863645554,0.19583332538604736,931.447509765625,1e-05,0.06452624499797821,2.4723031520843506,23.927850246429443,2 +8377,0.2793063521385193,0.35040849447250366,0.36098483204841614,0.1906730681657791,314.37127685546875,1e-05,0.10054899752140045,2.5291566848754883,23.927850246429443,2 +8378,0.27996525168418884,0.16306531429290771,0.15794023871421814,0.23301281034946442,861.318359375,1e-05,0.10056861490011215,2.3540685176849365,23.927850246429443,2 +8379,0.2239867001771927,0.1740696132183075,0.17197184264659882,0.20217947661876678,954.0719604492188,1e-05,0.08707181364297867,2.347532272338867,23.927850246429443,2 +8380,0.1834133267402649,0.1633293628692627,0.15822964906692505,0.2209615260362625,970.9821166992188,1e-05,0.07335390150547028,2.3547751903533936,23.927850246429443,2 +8381,0.22743558883666992,0.166281595826149,0.1597040444612503,0.2678525447845459,685.9205932617188,1e-05,0.08593051880598068,2.6281485557556152,23.927850246429443,2 +8382,0.17542017996311188,0.2771390974521637,0.26667940616607666,0.2506730556488037,975.3954467773438,1e-05,0.08328870683908463,2.535942316055298,23.927850246429443,2 +8383,0.2469320446252823,0.07158864289522171,0.0688362717628479,0.2347756326198578,801.0057983398438,1e-05,0.08311261981725693,2.3578033447265625,23.927850246429443,2 +8384,0.18630127608776093,0.15512600541114807,0.15419253706932068,0.2760256230831146,727.4247436523438,1e-05,0.07293917238712311,2.357304811477661,23.927850246429443,2 +8385,0.21745699644088745,0.13324885070323944,0.12860184907913208,0.14826922118663788,829.4078369140625,1e-05,0.08873790502548218,2.355696678161621,23.927850246429443,2 +8386,0.18872755765914917,0.1517765074968338,0.1353551745414734,0.20740383863449097,900.0560302734375,1e-05,0.07889454811811447,2.355503559112549,23.927850246429443,2 +8387,0.2686713933944702,0.25213003158569336,0.23679833114147186,0.29855766892433167,570.6521606445312,1e-05,0.06991829723119736,2.484663963317871,23.927850246429443,2 +8388,0.13983039557933807,0.09892076253890991,0.09725699573755264,0.18352563679218292,789.7643432617188,1e-05,0.06592237949371338,2.7350995540618896,23.927850246429443,2 +8389,0.24563728272914886,0.1719612330198288,0.16456125676631927,0.300352543592453,583.6886596679688,1e-05,0.07494249939918518,2.357940673828125,23.927850246429443,2 +8390,0.22891061007976532,0.249069944024086,0.2431226372718811,0.2368910163640976,542.9864501953125,1e-05,0.08607091009616852,2.3517494201660156,23.927850246429443,2 +8391,0.19598016142845154,0.19417604804039001,0.19652605056762695,0.24012818932533264,938.1237182617188,1e-05,0.07135920971632004,2.346466541290283,23.927850246429443,2 +8392,0.16095103323459625,0.17663967609405518,0.1663425713777542,0.29131409525871277,938.7450561523438,1e-05,0.07332378625869751,2.6210999488830566,23.927850246429443,2 +8393,0.21681305766105652,0.16684968769550323,0.16215136647224426,0.2844551205635071,740.2120361328125,1e-05,0.07613486796617508,2.3589601516723633,23.927850246429443,2 +8394,0.322914719581604,0.21417930722236633,0.2071267068386078,0.226666659116745,621.2273559570312,1e-05,0.07369890809059143,2.3482565879821777,23.927850246429443,2 +8395,0.21630798280239105,0.19724075496196747,0.18813760578632355,0.25766023993492126,892.0389404296875,1e-05,0.07361050695180893,2.350952386856079,23.927850246429443,2 +8396,0.16247466206550598,0.17705921828746796,0.1634349524974823,0.2713140845298767,745.9677734375,1e-05,0.06775062531232834,2.344984769821167,23.927850246429443,2 +8397,0.18814587593078613,0.17001131176948547,0.15929922461509705,0.23230768740177155,866.0933227539062,1e-05,0.0772467777132988,2.348184585571289,23.927850246429443,2 +8398,0.18240700662136078,0.1988002508878708,0.19539761543273926,0.24708332121372223,945.4190673828125,1e-05,0.07250648736953735,2.645798921585083,23.927850246429443,2 +8399,0.23776157200336456,0.1833401322364807,0.1893177330493927,0.22605767846107483,842.0365600585938,1e-05,0.0840216875076294,2.5242552757263184,23.927850246429443,2 +8400,0.14810800552368164,0.18982963263988495,0.19710102677345276,0.23692306876182556,586.51806640625,1e-05,0.07417313754558563,2.3511242866516113,23.927850246429443,2 +8401,0.2000267505645752,0.2051638960838318,0.20506691932678223,0.25141024589538574,726.5493774414062,1e-05,0.07537966221570969,2.350625991821289,23.927850246429443,2 +8402,0.1743934452533722,0.17274999618530273,0.16145189106464386,0.2295512706041336,691.9642944335938,1e-05,0.06520284712314606,2.5263350009918213,23.927850246429443,2 +8403,0.18701858818531036,0.09744672477245331,0.09853851795196533,0.12666666507720947,652.4856567382812,1e-05,0.07950225472450256,2.5958824157714844,23.927850246429443,2 +8404,0.3143399953842163,0.38860857486724854,0.38857656717300415,0.12503205239772797,245.17686462402344,1e-05,0.0702725499868393,2.3518941402435303,23.927850246429443,2 +8405,0.22592929005622864,0.1923198103904724,0.19008275866508484,0.2401602417230606,922.7748413085938,1e-05,0.08955574780702591,2.355062484741211,23.927850246429443,2 +8406,0.18029004335403442,0.156007781624794,0.16358007490634918,0.1619551181793213,897.6888427734375,1e-05,0.07710786163806915,2.3590211868286133,23.927850246429443,2 +8407,0.29039230942726135,0.2066000998020172,0.19708649814128876,0.31419870257377625,787.721923828125,1e-05,0.07381266355514526,2.359771251678467,23.927850246429443,2 +8408,0.18767428398132324,0.25176575779914856,0.24600505828857422,0.23999999463558197,921.7437133789062,1e-05,0.09037664532661438,2.588508367538452,23.927850246429443,2 +8409,0.11870944499969482,0.22504426538944244,0.21688993275165558,0.2044871747493744,930.4703369140625,1e-05,0.08614138513803482,2.743440628051758,23.927850246429443,2 +8410,0.22138512134552002,0.10163608938455582,0.10634302347898483,0.21839742362499237,768.4899291992188,1e-05,0.06386592984199524,2.363391876220703,23.927850246429443,2 +8411,0.2378702610731125,0.17144425213336945,0.17540910840034485,0.0918269231915474,966.4247436523438,1e-05,0.07188082486391068,2.349604606628418,23.927850246429443,2 +8412,0.17555831372737885,0.1595529466867447,0.15916132926940918,0.1972435861825943,967.7055053710938,1e-05,0.07698050141334534,2.3519680500030518,23.927850246429443,2 +8413,0.13025037944316864,0.2561626732349396,0.2455986589193344,0.23830127716064453,937.1871948242188,1e-05,0.0593644343316555,2.505972385406494,23.927850246429443,2 +8414,0.22258701920509338,0.15871837735176086,0.16046401858329773,0.14820511639118195,767.7470092773438,1e-05,0.0931260958313942,2.545433282852173,23.927850246429443,2 +8415,0.21968252956867218,0.8882569074630737,0.8920294046401978,0.26935896277427673,43.43629455566406,1e-05,0.10228046029806137,2.3519630432128906,23.927850246429443,2 +8416,0.23009635508060455,0.16166195273399353,0.1701468825340271,0.2650320529937744,956.8480224609375,1e-05,0.08471619337797165,2.348651647567749,23.927850246429443,2 +8417,0.2838399112224579,0.19082793593406677,0.18514539301395416,0.17692306637763977,981.2984008789062,1e-05,0.06815384328365326,2.346970558166504,23.927850246429443,2 +8418,0.30942580103874207,0.5248143076896667,0.5254164338111877,0.18221153318881989,121.84115600585938,1e-05,0.07007709890604019,2.5667340755462646,23.927850246429443,2 +8419,0.14375661313533783,0.17460112273693085,0.17599301040172577,0.27330127358436584,909.21484375,1e-05,0.07872799038887024,2.7086448669433594,23.927850246429443,2 +8420,0.23340952396392822,0.143575981259346,0.1361396163702011,0.11538460850715637,797.1013793945312,1e-05,0.08918007463216782,2.3530972003936768,23.927850246429443,2 +8421,0.12651392817497253,0.12987668812274933,0.1267354041337967,0.17932692170143127,915.0589599609375,1e-05,0.06869439035654068,2.349639415740967,23.927850246429443,2 +8422,0.214598149061203,0.20443573594093323,0.19215081632137299,0.2746794819831848,647.8805541992188,1e-05,0.06999928504228592,2.345872163772583,23.927850246429443,2 +8423,0.26919883489608765,0.48815834522247314,0.49380257725715637,0.0842948704957962,133.9285888671875,1e-05,0.07097993791103363,2.3446006774902344,23.927850246429443,2 +8424,0.23206059634685516,0.3069242835044861,0.297879159450531,0.2657371759414673,344.2029113769531,1e-05,0.08120395243167877,2.5759103298187256,23.927850246429443,2 +8425,0.22628921270370483,0.24445785582065582,0.23924890160560608,0.1279807686805725,971.7275390625,1e-05,0.07465457916259766,2.351252317428589,23.927850246429443,2 +8426,0.09871698915958405,0.2533804178237915,0.25594377517700195,0.15282051265239716,992.374267578125,1e-05,0.06411103904247284,2.3435168266296387,23.927850246429443,2 +8427,0.29560133814811707,0.1587635576725006,0.1537935733795166,0.2947756350040436,899.2704467773438,1e-05,0.07723924517631531,2.3445091247558594,23.927850246429443,2 +8428,0.317192018032074,0.19403621554374695,0.18212658166885376,0.25852563977241516,911.7965698242188,1e-05,0.10091568529605865,2.344782590866089,23.927850246429443,2 +8429,0.2906933128833771,0.1334962248802185,0.13694307208061218,0.2270512729883194,726.5493774414062,1e-05,0.07155444473028183,2.4778125286102295,23.927850246429443,2 +8430,0.10913396626710892,0.16699674725532532,0.16059668362140656,0.1676281988620758,916.8442993164062,1e-05,0.06814029067754745,2.668409824371338,23.927850246429443,2 +8431,0.07625095546245575,0.10780975967645645,0.11438938975334167,0.2622756361961365,860.34912109375,1e-05,0.09075383096933365,2.360485792160034,23.927850246429443,2 +8432,0.1798734813928604,0.15506070852279663,0.15276044607162476,0.2520192265510559,649.0385131835938,1e-05,0.09838879853487015,2.348766803741455,23.927850246429443,2 +8433,0.2368532121181488,0.17722707986831665,0.17525853216648102,0.2158653736114502,966.6818237304688,1e-05,0.0843934714794159,2.3454551696777344,23.927850246429443,2 +8434,0.1919185221195221,0.20040078461170197,0.19050301611423492,0.30253204703330994,539.7727661132812,1e-05,0.07195527106523514,2.491818428039551,23.927850246429443,2 +8435,0.2095627635717392,0.14386707544326782,0.1432010680437088,0.1414102464914322,915.0589599609375,1e-05,0.08047837764024734,2.489600896835327,23.927850246429443,2 +8436,0.2873068153858185,0.20063471794128418,0.2046402394771576,0.1832692176103592,958.2166748046875,1e-05,0.08191407471895218,2.3479652404785156,23.927850246429443,2 +8437,0.3720639646053314,0.1649617701768875,0.15619103610515594,0.22451922297477722,832.777099609375,1e-05,0.07632683217525482,2.346299886703491,23.927850246429443,2 +8438,0.24699604511260986,0.15264992415905,0.17828412353992462,0.2136538326740265,294.342529296875,1e-05,0.07260534912347794,2.3462700843811035,23.927850246429443,2 +8439,0.21805858612060547,0.1732422560453415,0.16447758674621582,0.20830127596855164,915.0589599609375,1e-05,0.07887747883796692,2.4858906269073486,23.927850246429443,2 +8440,0.28648245334625244,0.14799924194812775,0.1348905861377716,0.22266024351119995,925.4932250976562,1e-05,0.07498068362474442,2.482545852661133,23.927850246429443,2 +8441,0.13977891206741333,0.6321384906768799,0.6298611760139465,0.22612178325653076,121.84115600585938,1e-05,0.08266593515872955,2.588582992553711,23.927850246429443,2 +8442,0.1532096266746521,0.18848170340061188,0.18675830960273743,0.10897435247898102,580.8350830078125,1e-05,0.07130034267902374,2.350660800933838,23.927850246429443,2 +8443,0.24115420877933502,0.3749277591705322,0.36733633279800415,0.20705127716064453,322.7003173828125,1e-05,0.0712210163474083,2.3507301807403564,23.927850246429443,2 +8444,0.3473995625972748,0.11104223877191544,0.10591477155685425,0.2144230753183365,689.9642333984375,1e-05,0.0856083333492279,2.576164722442627,23.927850246429443,2 +8445,0.19585691392421722,0.15652738511562347,0.14415113627910614,0.2709615230560303,892.8571166992188,1e-05,0.06419584155082703,2.4993321895599365,23.927850246429443,2 +8446,0.10959509015083313,0.08373340964317322,0.09083402156829834,0.15503203868865967,951.2427978515625,1e-05,0.06341886520385742,2.349512815475464,23.927850246429443,2 +8447,0.12052951753139496,0.17530427873134613,0.16817229986190796,0.2988140881061554,600.3118286132812,1e-05,0.0773012638092041,2.3491222858428955,23.927850246429443,2 +8448,0.1568438857793808,0.23605594038963318,0.23114259541034698,0.29874998331069946,965.9091796875,1e-05,0.07783786952495575,2.3458707332611084,23.927850246429443,2 +8449,0.17890232801437378,0.2547544836997986,0.2506527900695801,0.20874999463558197,979.4371948242188,1e-05,0.05734047293663025,2.349092960357666,23.927850246429443,2 +8450,0.189049631357193,0.14349040389060974,0.1437356173992157,0.17499999701976776,805.4765625,1e-05,0.07149834930896759,2.472973585128784,23.927850246429443,2 +8451,0.27255064249038696,0.20949538052082062,0.21950045228004456,0.26576921343803406,647.8805541992188,1e-05,0.07418746501207352,2.7788403034210205,23.927850246429443,2 +8452,0.16569341719150543,0.4025164544582367,0.3966480493545532,0.24878203868865967,245.17686462402344,1e-05,0.07768228650093079,2.3521041870117188,23.927850246429443,2 +8453,0.13825151324272156,0.1396317183971405,0.1340865194797516,0.2156730741262436,793.795654296875,1e-05,0.06796126067638397,2.345275402069092,23.927850246429443,2 +8454,0.1498134434223175,0.14018718898296356,0.13242453336715698,0.1799679398536682,983.1340942382812,1e-05,0.0626598447561264,2.3492348194122314,23.927850246429443,2 +8455,0.1769087165594101,0.16213734447956085,0.16194592416286469,0.3061217963695526,902.3915405273438,1e-05,0.07765066623687744,2.4798424243927,23.927850246429443,2 +8456,0.2710430920124054,0.08855409175157547,0.09515497833490372,0.22333332896232605,766.25390625,1e-05,0.08709981292486191,2.474478244781494,23.927850246429443,2 +8457,0.21111208200454712,0.18466681241989136,0.17583996057510376,0.23657050728797913,677.6557006835938,1e-05,0.06959760934114456,2.3622212409973145,23.927850246429443,2 +8458,0.1438533365726471,0.23184825479984283,0.22967489063739777,0.13634614646434784,973.4513549804688,1e-05,0.08027885109186172,2.354309558868408,23.927850246429443,2 +8459,0.14085140824317932,0.22246894240379333,0.21164245903491974,0.2454807609319687,810.4782104492188,1e-05,0.06810100376605988,2.3551297187805176,23.927850246429443,2 +8460,0.18100693821907043,0.2122456282377243,0.20621703565120697,0.25198715925216675,967.9602661132812,1e-05,0.08360770344734192,2.356201410293579,23.927850246429443,2 +8461,0.2701335847377777,0.1482434719800949,0.14618726074695587,0.27022436261177063,897.6888427734375,1e-05,0.06734389811754227,2.484105110168457,23.927850246429443,2 +8462,0.20974811911582947,0.6942168474197388,0.7029234766960144,0.11974358558654785,83.95523071289062,1e-05,0.07774447649717331,2.492610216140747,23.927850246429443,2 +8463,0.21763364970684052,0.17636580765247345,0.1699281483888626,0.11666665971279144,333.5777282714844,1e-05,0.07450637221336365,2.3592758178710938,23.927850246429443,2 +8464,0.21061170101165771,0.17717935144901276,0.17148184776306152,0.22961537539958954,668.0632934570312,1e-05,0.07352796196937561,2.351684808731079,23.927850246429443,2 +8465,0.18271349370479584,0.13933785259723663,0.1376330703496933,0.2532051205635071,948.6500244140625,1e-05,0.07208532094955444,2.3522884845733643,23.927850246429443,2 +8466,0.06815331429243088,0.11075280606746674,0.10784081369638443,0.21910256147384644,873.947021484375,1e-05,0.06670219451189041,2.5948398113250732,23.927850246429443,2 +8467,0.22328078746795654,0.2792125642299652,0.30795061588287354,0.2747115194797516,254.77706909179688,1e-05,0.08287569880485535,2.3472514152526855,23.927850246429443,2 +8468,0.13499854505062103,0.17117978632450104,0.17073191702365875,0.08413461595773697,711.2069091796875,1e-05,0.06659389287233353,2.3497891426086426,23.927850246429443,2 +8469,0.232603520154953,0.2736511528491974,0.24504248797893524,0.2289743572473526,996.1414184570312,1e-05,0.08955089747905731,2.3473427295684814,23.927850246429443,2 +8470,0.27593502402305603,0.17584073543548584,0.1735629439353943,0.27695512771606445,890.3912353515625,1e-05,0.06514120101928711,2.3492848873138428,23.927850246429443,2 +8471,0.18558111786842346,0.44643449783325195,0.4451866149902344,0.2622756361961365,208.3333282470703,1e-05,0.06757393479347229,2.463425397872925,23.927850246429443,2 +8472,0.16320478916168213,0.16350752115249634,0.1678590327501297,0.10166666656732559,660.3773803710938,1e-05,0.06882314383983612,2.6909127235412598,23.927850246429443,2 +8473,0.20123781263828278,0.2058054655790329,0.19808250665664673,0.26836538314819336,711.2069091796875,1e-05,0.07228243350982666,2.3494300842285156,23.927850246429443,2 +8474,0.17794197797775269,0.6801561713218689,0.6769506931304932,0.20557691156864166,75.18797302246094,1e-05,0.08018206804990768,2.3450393676757812,23.927850246429443,2 +8475,0.22331640124320984,0.2085084617137909,0.19821223616600037,0.2230128049850464,823.6697998046875,1e-05,0.07609517872333527,2.3665289878845215,23.927850246429443,3 +8476,0.2042582929134369,0.15101578831672668,0.14899052679538727,0.20522435009479523,668.0632934570312,1e-05,0.061677996069192886,2.4717442989349365,23.927850246429443,3 +8477,0.17263562977313995,0.18186481297016144,0.18209530413150787,0.24003204703330994,666.9776611328125,1e-05,0.062375593930482864,2.813915491104126,23.927850246429443,3 +8478,0.25668954849243164,0.20248793065547943,0.19179967045783997,0.18320512771606445,873.4939575195312,1e-05,0.08234896510839462,2.3653557300567627,23.927850246429443,3 +8479,0.1799103021621704,0.14599788188934326,0.13888752460479736,0.19689102470874786,884.5029296875,1e-05,0.0671217069029808,2.363250255584717,23.927850246429443,3 +8480,0.12058014422655106,0.04780524596571922,0.05456983298063278,0.1456410139799118,825.4075927734375,1e-05,0.06861720234155655,2.3607544898986816,23.927850246429443,3 +8481,0.1989258974790573,0.14842107892036438,0.14079704880714417,0.26038461923599243,729.1666870117188,1e-05,0.06162915378808975,2.5681426525115967,23.927850246429443,3 +8482,0.23986345529556274,0.3475969135761261,0.34433576464653015,0.2671794891357422,279.50311279296875,1e-05,0.06976566463708878,2.3770432472229004,23.927850246429443,3 +8483,0.16306988894939423,0.16432204842567444,0.1655770093202591,0.2068910151720047,913.6167602539062,1e-05,0.06155388057231903,2.691240072250366,23.927850246429443,3 +8484,0.2011188119649887,0.22961249947547913,0.22023054957389832,0.2109294831752777,859.8626708984375,1e-05,0.07760263234376907,2.364769458770752,23.927850246429443,3 +8485,0.20447148382663727,0.09340017288923264,0.09467487782239914,0.21342948079109192,732.615966796875,1e-05,0.08199504762887955,2.3623154163360596,23.927850246429443,3 +8486,0.15377351641654968,0.9178136587142944,0.9222572445869446,0.21291665732860565,34.046695709228516,1e-05,0.07631541043519974,2.3614816665649414,23.927850246429443,3 +8487,0.2287909835577011,0.1980184018611908,0.19115325808525085,0.23141025006771088,789.0855712890625,1e-05,0.07074315845966339,2.5938522815704346,23.927850246429443,3 +8488,0.20358909666538239,0.2769649028778076,0.289387047290802,0.17387819290161133,998.3897094726562,1e-05,0.07553993165493011,2.359358549118042,23.927850246429443,3 +8489,0.21554236114025116,0.11556059122085571,0.12043437361717224,0.20038460195064545,657.0208740234375,1e-05,0.06624798476696014,2.3560075759887695,23.927850246429443,3 +8490,0.2982187271118164,0.29737183451652527,0.28734636306762695,0.2549999952316284,317.1641845703125,1e-05,0.0709545761346817,2.3596413135528564,23.927850246429443,3 +8491,0.15037278831005096,0.20176032185554504,0.19537942111492157,0.19221153855323792,713.0584106445312,1e-05,0.0681304857134819,2.3600871562957764,23.927850246429443,3 +8492,0.24755793809890747,0.1392650604248047,0.13559308648109436,0.2201922982931137,704.624755859375,1e-05,0.08089863508939743,2.488057851791382,23.927850246429443,3 +8493,0.142025887966156,0.21080440282821655,0.19978661835193634,0.226666659116745,881.0508422851562,1e-05,0.07197678089141846,2.497406005859375,23.927850246429443,3 +8494,0.1641111969947815,0.19725443422794342,0.18963049352169037,0.15009614825248718,504.1766052246094,1e-05,0.08212828636169434,2.546393632888794,23.927850246429443,3 +8495,0.23838362097740173,0.16844436526298523,0.16385053098201752,0.15108974277973175,955.7438354492188,1e-05,0.08145812153816223,2.3500685691833496,23.927850246429443,3 +8496,0.26682502031326294,0.2016104906797409,0.1964336633682251,0.1993589699268341,922.7748413085938,1e-05,0.06723664700984955,2.35654878616333,23.927850246429443,3 +8497,0.12887251377105713,0.07574577629566193,0.07941636443138123,0.06983973830938339,918.6107788085938,1e-05,0.07814580202102661,2.3549718856811523,23.927850246429443,3 +8498,0.1876276135444641,0.17474360764026642,0.15968038141727448,0.26615384221076965,713.9794311523438,1e-05,0.06597691029310226,2.667717456817627,23.927850246429443,3 +8499,0.13660097122192383,0.16237984597682953,0.15883995592594147,0.10259614884853363,612.2449340820312,1e-05,0.06393261253833771,2.3475990295410156,23.927850246429443,3 +8500,0.15424787998199463,0.16130851209163666,0.15379852056503296,0.24554486572742462,804.8433837890625,1e-05,0.06924740970134735,2.3569300174713135,23.927850246429443,3 +8501,0.09069186449050903,0.2445637732744217,0.2413923442363739,0.1749679446220398,973.6957397460938,1e-05,0.07031276822090149,2.3752918243408203,23.927850246429443,3 +8502,0.2264493703842163,0.22291706502437592,0.19995592534542084,0.2495192289352417,953.5103759765625,1e-05,0.07148978859186172,2.5569863319396973,23.927850246429443,3 +8503,0.26386693120002747,0.15794599056243896,0.15982843935489655,0.2852243483066559,675.5514526367188,1e-05,0.06788084656000137,2.357056140899658,23.927850246429443,3 +8504,0.15814420580863953,0.08866206556558609,0.09951670467853546,0.1311858892440796,942.7236938476562,1e-05,0.05949622392654419,2.610860586166382,23.927850246429443,3 +8505,0.17156121134757996,0.4125038981437683,0.4146133065223694,0.20112179219722748,222.03948974609375,1e-05,0.081768698990345,2.357604742050171,23.927850246429443,3 +8506,0.19191691279411316,0.22643359005451202,0.22051648795604706,0.2262820452451706,786.3502197265625,1e-05,0.06838126480579376,2.3556020259857178,23.927850246429443,3 +8507,0.155804842710495,0.26450222730636597,0.24628446996212006,0.22833332419395447,996.5530395507812,1e-05,0.0754179060459137,2.3568732738494873,23.927850246429443,3 +8508,0.09999047964811325,0.16292500495910645,0.15925918519496918,0.2309935837984085,809.8590698242188,1e-05,0.06450340151786804,2.521554946899414,23.927850246429443,3 +8509,0.19192278385162354,0.3021908700466156,0.2994842231273651,0.21160255372524261,824.8300170898438,1e-05,0.07486214488744736,2.3602988719940186,23.927850246429443,3 +8510,0.1948578953742981,0.19152066111564636,0.18963003158569336,0.15705128014087677,526.620361328125,1e-05,0.06056481599807739,2.3584134578704834,23.927850246429443,3 +8511,0.15352460741996765,0.1558804214000702,0.15925639867782593,0.2348717898130417,818.9655151367188,1e-05,0.0740109384059906,2.356523275375366,23.927850246429443,3 +8512,0.21988442540168762,0.1620672345161438,0.15954184532165527,0.24137820303440094,953.5103759765625,1e-05,0.07984109967947006,2.363367795944214,23.927850246429443,3 +8513,0.29261723160743713,0.060723304748535156,0.05892195552587509,0.09554486721754074,762.48046875,1e-05,0.07298872619867325,2.4861345291137695,23.927850246429443,3 +8514,0.21441462635993958,0.5212854146957397,0.5174618363380432,0.1658974289894104,999.7998046875,1e-05,0.07076159119606018,2.6170973777770996,23.927850246429443,3 +8515,0.21628621220588684,0.393526554107666,0.41104358434677124,0.20913460850715637,225.4098358154297,1e-05,0.0823974609375,2.488940477371216,23.927850246429443,3 +8516,0.18637222051620483,0.25443509221076965,0.25193971395492554,0.1772756278514862,950.9569091796875,1e-05,0.07468345016241074,2.3557238578796387,23.927850246429443,3 +8517,0.11590052396059036,0.13787929713726044,0.13086965680122375,0.2615705132484436,929.1580810546875,1e-05,0.08419090509414673,2.356766700744629,23.927850246429443,3 +8518,0.27976563572883606,0.20670178532600403,0.20990777015686035,0.23410256206989288,468.75,1e-05,0.07455757260322571,2.3596105575561523,23.927850246429443,3 +8519,0.29849570989608765,0.2888936400413513,0.27626878023147583,0.2743269205093384,970.2327880859375,1e-05,0.08064047992229462,2.6520111560821533,23.927850246429443,3 +8520,0.11157852411270142,0.14887453615665436,0.14366742968559265,0.09086538106203079,877.9761962890625,1e-05,0.07077629119157791,2.3538670539855957,23.927850246429443,3 +8521,0.1317141354084015,0.20458373427391052,0.2155357301235199,0.20455127954483032,466.7919921875,1e-05,0.06285634636878967,2.355778932571411,23.927850246429443,3 +8522,0.18966972827911377,0.15683698654174805,0.1705547422170639,0.23249998688697815,671.2963256835938,1e-05,0.07776185125112534,2.348276138305664,23.927850246429443,3 +8523,0.211448073387146,0.15744023025035858,0.147413969039917,0.23336537182331085,930.7967529296875,1e-05,0.06458230316638947,2.355266809463501,23.927850246429443,3 +8524,0.2564886510372162,0.14806528389453888,0.1536865085363388,0.289903849363327,526.620361328125,1e-05,0.06355396658182144,2.586124897003174,23.927850246429443,3 +8525,0.2139933556318283,0.14401879906654358,0.14373379945755005,0.2992948591709137,678.7020263671875,1e-05,0.06748948991298676,2.58211612701416,23.927850246429443,3 +8526,0.23263904452323914,0.09787261486053467,0.09679803997278214,0.22256410121917725,843.0989990234375,1e-05,0.07453516870737076,2.475684642791748,23.927850246429443,3 +8527,0.26486489176750183,0.20169435441493988,0.19583649933338165,0.17374999821186066,884.9298706054688,1e-05,0.06905586272478104,2.3495218753814697,23.927850246429443,3 +8528,0.2071681022644043,0.2384871244430542,0.22518093883991241,0.2497115284204483,854.930419921875,1e-05,0.07720479369163513,2.3483574390411377,23.927850246429443,3 +8529,0.26016539335250854,0.5921095609664917,0.5748322010040283,0.229935884475708,153.50877380371094,1e-05,0.07302584499120712,2.5948002338409424,23.927850246429443,3 +8530,0.1848657727241516,0.17117448151111603,0.16206422448158264,0.22730767726898193,803.5714111328125,1e-05,0.07076625525951385,2.3501250743865967,23.927850246429443,3 +8531,0.12493610382080078,0.13290941715240479,0.1288464069366455,0.2692948579788208,807.9915161132812,1e-05,0.07373011857271194,2.349707841873169,23.927850246429443,3 +8532,0.2588135600090027,0.8181008696556091,0.8208959102630615,0.28342947363853455,52.6819953918457,1e-05,0.07006550580263138,2.3463633060455322,23.927850246429443,3 +8533,0.1750451624393463,0.08924549072980881,0.08155196905136108,0.19278845191001892,448.71795654296875,1e-05,0.16106580197811127,2.3498125076293945,23.927850246429443,3 +8534,0.2272796481847763,0.21607249975204468,0.21354670822620392,0.216634601354599,943.3267822265625,1e-05,0.06421128660440445,2.5092594623565674,23.927850246429443,3 +8535,0.21063770353794098,0.1795513778924942,0.17000022530555725,0.2832692265510559,958.2166748046875,1e-05,0.08000541478395462,2.4917047023773193,23.927850246429443,3 +8536,0.1555379331111908,0.10894370079040527,0.11253707110881805,0.20884615182876587,879.3001098632812,1e-05,0.06715679168701172,2.5747017860412598,23.927850246429443,3 +8537,0.3014203906059265,0.21100544929504395,0.21053414046764374,0.1417948603630066,485.94134521484375,1e-05,0.08641192317008972,2.51674485206604,23.927850246429443,3 +8538,0.08873242884874344,0.146346777677536,0.1481839418411255,0.1308012753725052,945.1219482421875,1e-05,0.05311937257647514,2.3515591621398926,23.927850246429443,3 +8539,0.2743697166442871,0.2840096354484558,0.2704518139362335,0.18685896694660187,444.587646484375,1e-05,0.0933910459280014,2.3565165996551514,23.927850246429443,3 +8540,0.2470826804637909,0.19855999946594238,0.18931865692138672,0.21333332359790802,961.4497680664062,1e-05,0.07785690575838089,2.653529405593872,23.927850246429443,3 +8541,0.13349704444408417,0.2659296989440918,0.2590264678001404,0.16891025006771088,561.674072265625,1e-05,0.06301771104335785,2.352633237838745,23.927850246429443,3 +8542,0.17270155251026154,0.11607374250888824,0.11606688052415848,0.1235576868057251,822.50341796875,1e-05,0.05589454248547554,2.3564844131469727,23.927850246429443,3 +8543,0.1558072715997696,0.2329518347978592,0.22805505990982056,0.2316666543483734,658.1439819335938,1e-05,0.07511840015649796,2.364812135696411,23.927850246429443,3 +8544,0.22897227108478546,0.14963512122631073,0.14578790962696075,0.22157050669193268,919.3121948242188,1e-05,0.08757971972227097,2.357086181640625,23.927850246429443,3 +8545,0.13681843876838684,0.2672111392021179,0.24718666076660156,0.24676281213760376,961.4497680664062,1e-05,0.06454376131296158,2.5869314670562744,23.927850246429443,3 +8546,0.19671139121055603,0.9200119972229004,0.9502270221710205,0.20743589103221893,19.685039520263672,1e-05,0.06747161597013474,2.522733211517334,23.927850246429443,3 +8547,0.27379339933395386,0.18428342044353485,0.17860446870326996,0.2558653652667999,681.8181762695312,1e-05,0.08240796625614166,2.4734270572662354,23.927850246429443,3 +8548,0.1596297174692154,0.1994040608406067,0.1885071098804474,0.279134601354599,820.1513671875,1e-05,0.06632152199745178,2.359639883041382,23.927850246429443,3 +8549,0.23453719913959503,0.39251893758773804,0.3678930401802063,0.24833332002162933,998.9959716796875,1e-05,0.06875349581241608,2.3533735275268555,23.927850246429443,3 +8550,0.17519330978393555,0.27941790223121643,0.2648391127586365,0.25746792554855347,968.468505859375,1e-05,0.07310894876718521,2.604890823364258,23.927850246429443,3 +8551,0.20607241988182068,0.12991154193878174,0.12760032713413239,0.19442306458950043,950.9569091796875,1e-05,0.06354136019945145,2.367088556289673,23.927850246429443,3 +8552,0.14020203053951263,0.19453084468841553,0.19377616047859192,0.19833332300186157,682.8494262695312,1e-05,0.06223258376121521,2.365119457244873,23.927850246429443,3 +8553,0.28321292996406555,0.23492562770843506,0.217956081032753,0.23314101994037628,976.1173706054688,1e-05,0.06932637095451355,2.3570716381073,23.927850246429443,3 +8554,0.11780758202075958,0.14798811078071594,0.15003015100955963,0.04657050967216492,466.7919921875,1e-05,0.0695328488945961,2.3529770374298096,23.927850246429443,3 +8555,0.2027963548898697,0.1394951343536377,0.13976140320301056,0.06833332777023315,773.6281127929688,1e-05,0.07406468689441681,2.3569958209991455,23.927850246429443,3 +8556,0.18217551708221436,0.21134106814861298,0.2149062305688858,0.27589741349220276,470.6982727050781,1e-05,0.07282824069261551,2.495457887649536,23.927850246429443,3 +8557,0.1916043907403946,0.19018098711967468,0.17591150104999542,0.25391024351119995,789.0855712890625,1e-05,0.07867899537086487,2.760493516921997,23.927850246429443,3 +8558,0.21815478801727295,0.23078900575637817,0.22629006206989288,0.27756407856941223,440.41455078125,1e-05,0.06277699023485184,2.589017391204834,23.927850246429443,3 +8559,0.16129674017429352,0.17674662172794342,0.18055106699466705,0.2664102613925934,974.4267578125,1e-05,0.07125099748373032,2.3577706813812256,23.927850246429443,3 +8560,0.15335606038570404,0.13180303573608398,0.13346198201179504,0.23403845727443695,787.0369873046875,1e-05,0.07393915951251984,2.3527426719665527,23.927850246429443,3 +8561,0.19305339455604553,0.17233720421791077,0.1657913625240326,0.2820512652397156,761.7188110351562,1e-05,0.06450433284044266,2.672034978866577,23.927850246429443,3 +8562,0.20807421207427979,0.215680792927742,0.2084757685661316,0.1778525561094284,714.8972778320312,1e-05,0.07359173893928528,2.365959405899048,23.927850246429443,3 +8563,0.25875309109687805,0.4628666937351227,0.4488402307033539,0.2267628163099289,238.6731414794922,1e-05,0.07000693678855896,2.357738971710205,23.927850246429443,3 +8564,0.1359965205192566,0.13741876184940338,0.1343197524547577,0.2015705108642578,507.7196960449219,1e-05,0.06381300836801529,2.359189987182617,23.927850246429443,3 +8565,0.16114945709705353,0.06938008964061737,0.08022286742925644,0.21407049894332886,884.0750122070312,1e-05,0.07637204229831696,2.3501157760620117,23.927850246429443,3 +8566,0.14241433143615723,0.1550436019897461,0.15494439005851746,0.2718910276889801,932.7411499023438,1e-05,0.07811034470796585,2.4957756996154785,23.927850246429443,3 +8567,0.2231985628604889,0.09266062080860138,0.09626270830631256,0.1119871735572815,579.399169921875,1e-05,0.07969014346599579,2.566314697265625,23.927850246429443,3 +8568,0.33428433537483215,0.14691652357578278,0.1497889906167984,0.24679486453533173,868.9024658203125,1e-05,0.0917312502861023,2.4875376224517822,23.927850246429443,3 +8569,0.11670175194740295,0.08177116513252258,0.08571631461381912,0.09692307561635971,916.1324462890625,1e-05,0.07707461714744568,2.4835879802703857,23.927850246429443,3 +8570,0.17575997114181519,0.23442243039608002,0.2319892793893814,0.20951922237873077,879.3001098632812,1e-05,0.08305244892835617,2.357597589492798,23.927850246429443,3 +8571,0.26909226179122925,0.2528424859046936,0.2560400664806366,0.2523076832294464,964.61181640625,1e-05,0.06877713650465012,2.3534438610076904,23.927850246429443,3 +8572,0.13533921539783478,0.1486092060804367,0.15440160036087036,0.18657051026821136,880.177490234375,1e-05,0.07747514545917511,2.64082670211792,23.927850246429443,3 +8573,0.1933349370956421,0.14571107923984528,0.1434696912765503,0.2947756350040436,721.2352294921875,1e-05,0.06953231990337372,2.3561294078826904,23.927850246429443,3 +8574,0.10924838483333588,0.10936718434095383,0.10065402835607529,0.22253204882144928,878.4185791015625,1e-05,0.059808194637298584,2.3478071689605713,23.927850246429443,3 +8575,0.2214515507221222,0.1726323962211609,0.16231563687324524,0.24346153438091278,838.2740478515625,1e-05,0.07002697139978409,2.347748041152954,23.927850246429443,3 +8576,0.24328561127185822,0.19954600930213928,0.19093522429466248,0.21849358081817627,749.19873046875,1e-05,0.07984604686498642,2.352729082107544,23.927850246429443,3 +8577,0.16403500735759735,0.36042532324790955,0.35598990321159363,0.2627564072608948,989.3660888671875,1e-05,0.06912872195243835,2.5223469734191895,23.927850246429443,3 +8578,0.06893978267908096,0.14040330052375793,0.15495780110359192,0.24842947721481323,974.4267578125,1e-05,0.06562719494104385,2.4890308380126953,23.927850246429443,3 +8579,0.2398848831653595,0.1655261516571045,0.17347919940948486,0.22339743375778198,874.8499145507812,1e-05,0.07735604792833328,2.357318878173828,23.927850246429443,3 +8580,0.2808273732662201,0.28288936614990234,0.2903185486793518,0.27522435784339905,988.2747802734375,1e-05,0.06743938475847244,2.5945558547973633,23.927850246429443,3 +8581,0.2211865484714508,0.19662390649318695,0.18822415173053741,0.11538460850715637,795.1236572265625,1e-05,0.07051163911819458,2.3516201972961426,23.927850246429443,3 +8582,0.2227039635181427,0.18470944464206696,0.1710003763437271,0.24349358677864075,880.6146240234375,1e-05,0.07086946815252304,2.479207754135132,23.927850246429443,3 +8583,0.18656131625175476,0.16338202357292175,0.17195789515972137,0.14474359154701233,965.3915405273438,1e-05,0.06613261997699738,2.6432864665985107,23.927850246429443,3 +8584,0.15314944088459015,0.15928564965724945,0.155865877866745,0.25217947363853455,837.1862182617188,1e-05,0.06612143665552139,2.3508479595184326,23.927850246429443,3 +8585,0.1779865324497223,0.23970629274845123,0.2311168909072876,0.23314101994037628,909.5860595703125,1e-05,0.06709866970777512,2.3492000102996826,23.927850246429443,3 +8586,0.21738821268081665,0.20029225945472717,0.20013724267482758,0.237275630235672,912.162109375,1e-05,0.08316749334335327,2.3527143001556396,23.927850246429443,3 +8587,0.15353251993656158,0.16946624219417572,0.16178014874458313,0.23849357664585114,915.0589599609375,1e-05,0.06682933866977692,2.354184627532959,23.927850246429443,3 +8588,0.26887255907058716,0.22767707705497742,0.2106476128101349,0.22602562606334686,924.81787109375,1e-05,0.05664050579071045,2.55009126663208,23.927850246429443,3 +8589,0.17716071009635925,0.3726496994495392,0.4135012626647949,0.13900640606880188,66.28787994384766,1e-05,0.08023194223642349,2.669196128845215,23.927850246429443,3 +8590,0.13889269530773163,0.17664079368114471,0.17754878103733063,0.12967948615550995,945.7156982421875,1e-05,0.05871560797095299,2.5364904403686523,23.927850246429443,3 +8591,0.18117234110832214,0.14882546663284302,0.1409348100423813,0.19717948138713837,868.9024658203125,1e-05,0.06327445805072784,2.3642051219940186,23.927850246429443,3 +8592,0.30533578991889954,0.3993522822856903,0.41631031036376953,0.0924999937415123,145.7597198486328,1e-05,0.06793773174285889,2.350192070007324,23.927850246429443,3 +8593,0.1713300496339798,0.2072436362504959,0.19029434025287628,0.20307691395282745,925.8298950195312,1e-05,0.06632876396179199,2.5773656368255615,23.927850246429443,3 +8594,0.2675936222076416,0.23155447840690613,0.24060672521591187,0.2358333319425583,975.3954467773438,1e-05,0.0660223439335823,2.7200491428375244,23.927850246429443,3 +8595,0.25088900327682495,0.21713359653949738,0.2144421935081482,0.15096153318881989,903.1631469726562,1e-05,0.072769396007061,2.3620479106903076,23.927850246429443,3 +8596,0.24373076856136322,0.13853324949741364,0.1410640925168991,0.28660255670547485,790.4412231445312,1e-05,0.06900183856487274,2.358363389968872,23.927850246429443,3 +8597,0.18386167287826538,0.16145078837871552,0.15481294691562653,0.2778525650501251,788.4046630859375,1e-05,0.06290314346551895,2.3534762859344482,23.927850246429443,3 +8598,0.17887739837169647,0.1604398638010025,0.14828763902187347,0.2497115284204483,940.900146484375,1e-05,0.07400535047054291,2.351914882659912,23.927850246429443,3 +8599,0.299771249294281,0.17225654423236847,0.1584884077310562,0.20471152663230896,756.319091796875,1e-05,0.08693750947713852,2.6004104614257812,23.927850246429443,3 +8600,0.242629736661911,0.2261440008878708,0.20311398804187775,0.24621793627738953,990.6640014648438,1e-05,0.06906136870384216,2.3517799377441406,23.927850246429443,3 +8601,0.14141462743282318,0.23034928739070892,0.23809461295604706,0.10666666179895401,352.0115051269531,1e-05,0.07111404091119766,2.4885687828063965,23.927850246429443,3 +8602,0.27139508724212646,0.2997322678565979,0.298271119594574,0.2562499940395355,362.2159423828125,1e-05,0.0671030804514885,2.353755235671997,23.927850246429443,3 +8603,0.20661981403827667,0.20598874986171722,0.2068290114402771,0.22980768978595734,652.4856567382812,1e-05,0.06206508353352547,2.350069522857666,23.927850246429443,3 +8604,0.17772692441940308,0.3890819251537323,0.39084765315055847,0.09849358350038528,141.84397888183594,1e-05,0.06789345294237137,2.629002094268799,23.927850246429443,3 +8605,0.19249959290027618,0.17445231974124908,0.17029906809329987,0.2483653724193573,940.5940551757812,1e-05,0.0651516243815422,2.355428695678711,23.927850246429443,3 +8606,0.272000789642334,0.1889648735523224,0.18782462179660797,0.24003204703330994,687.94970703125,1e-05,0.06820511072874069,2.3473122119903564,23.927850246429443,3 +8607,0.2646399140357971,0.20916344225406647,0.20693138241767883,0.2557692229747772,644.3798828125,1e-05,0.07213058322668076,2.348999500274658,23.927850246429443,3 +8608,0.12960079312324524,0.09310118108987808,0.09753547608852386,0.2303204983472824,873.947021484375,1e-05,0.06735768914222717,2.3468148708343506,23.927850246429443,3 +8609,0.20297133922576904,0.1542866975069046,0.14974795281887054,0.2091025561094284,906.9703979492188,1e-05,0.06720484793186188,2.468302011489868,23.927850246429443,3 +8610,0.29060420393943787,0.17381949722766876,0.16830052435398102,0.17493589222431183,790.4412231445312,1e-05,0.08360886573791504,2.5956954956054688,23.927850246429443,3 +8611,0.171205073595047,0.16942662000656128,0.1678571254014969,0.22451922297477722,760.1881103515625,1e-05,0.08781673014163971,2.4626317024230957,23.927850246429443,3 +8612,0.15346309542655945,0.11602677404880524,0.11789834499359131,0.30733972787857056,886.2048950195312,1e-05,0.07392875850200653,2.3615427017211914,23.927850246429443,3 +8613,0.2885103225708008,0.17095424234867096,0.17897044122219086,0.26887819170951843,547.7528686523438,1e-05,0.07075363397598267,2.3503968715667725,23.927850246429443,3 +8614,0.12885819375514984,0.2662103772163391,0.2545319199562073,0.24051281809806824,760.1881103515625,1e-05,0.06347281485795975,2.500617742538452,23.927850246429443,3 +8615,0.2510758936405182,0.14754366874694824,0.1421627700328827,0.2390064001083374,942.7236938476562,1e-05,0.07670170813798904,2.701791763305664,23.927850246429443,3 +8616,0.2067653387784958,0.34721639752388,0.32808902859687805,0.24384614825248718,983.8159790039062,1e-05,0.07039332389831543,2.3521268367767334,23.927850246429443,3 +8617,0.35898518562316895,0.4077579379081726,0.395479679107666,0.2419871687889099,235.38963317871094,1e-05,0.08061493933200836,2.354046106338501,23.927850246429443,3 +8618,0.21528029441833496,0.532139003276825,0.5279335975646973,0.17522434890270233,149.64788818359375,1e-05,0.08301273733377457,2.351884603500366,23.927850246429443,3 +8619,0.15442605316638947,0.2666059732437134,0.2534288167953491,0.26993587613105774,967.194580078125,1e-05,0.0637887641787529,2.357182025909424,23.927850246429443,3 +8620,0.18025843799114227,0.07730806618928909,0.0812380462884903,0.1050320491194725,902.3915405273438,1e-05,0.0707247331738472,2.6574835777282715,23.927850246429443,3 +8621,0.37308937311172485,0.21921157836914062,0.2142762541770935,0.313076913356781,802.292236328125,1e-05,0.07014685124158859,2.565382719039917,23.927850246429443,3 +8622,0.27609559893608093,0.23903514444828033,0.2395011931657791,0.2355448603630066,446.65814208984375,1e-05,0.08527375012636185,2.666288137435913,23.927850246429443,3 +8623,0.15523648262023926,0.3890100121498108,0.41969984769821167,0.21208332479000092,66.28787994384766,1e-05,0.07246812433004379,3.35770320892334,23.927850246429443,3 +8624,0.22636151313781738,0.24988125264644623,0.2522633373737335,0.17423076927661896,743.5170288085938,1e-05,0.06793199479579926,3.839632272720337,23.927850246429443,3 +8625,0.24418911337852478,0.18627400696277618,0.18093691766262054,0.2224999964237213,844.1558227539062,1e-05,0.07165385037660599,2.5962228775024414,23.927850246429443,3 +8626,0.21870315074920654,0.24710983037948608,0.2536337375640869,0.17618589103221893,341.5697937011719,1e-05,0.07599008828401566,2.355360507965088,23.927850246429443,3 +8627,0.15868178009986877,0.26080068945884705,0.2588658630847931,0.23596152663230896,421.0875244140625,1e-05,0.07445040345191956,2.3470335006713867,23.927850246429443,3 +8628,0.14236605167388916,0.3462669551372528,0.3450598120689392,0.12560896575450897,294.342529296875,1e-05,0.061624351888895035,2.3534739017486572,23.927850246429443,3 +8629,0.13579174876213074,0.1985420137643814,0.1856662780046463,0.2844551205635071,948.3590698242188,1e-05,0.07100272178649902,2.353116750717163,23.927850246429443,3 +8630,0.2612158954143524,0.2687285840511322,0.256656676530838,0.24310895800590515,979.4371948242188,1e-05,0.07505913078784943,2.463698387145996,23.927850246429443,3 +8631,0.13060739636421204,0.15879620611667633,0.15586279332637787,0.24608974158763885,850.3836669921875,1e-05,0.07103464007377625,2.4844088554382324,23.927850246429443,3 +8632,0.1429961919784546,0.19524577260017395,0.19414427876472473,0.2449999898672104,707.4652709960938,1e-05,0.061619799584150314,2.3617053031921387,23.927850246429443,3 +8633,0.20787960290908813,0.13163085281848907,0.12872661650180817,0.17144230008125305,835.5437622070312,1e-05,0.06427109241485596,2.5435683727264404,23.927850246429443,3 +8634,0.3151853382587433,0.2717827558517456,0.2655354142189026,0.27038460969924927,509.47869873046875,1e-05,0.07979600876569748,2.3674700260162354,23.927850246429443,3 +8635,0.2930600345134735,0.20076943933963776,0.20845778286457062,0.2316666543483734,873.947021484375,1e-05,0.06953895092010498,2.5317091941833496,23.927850246429443,3 +8636,0.16095195710659027,0.27594393491744995,0.28537359833717346,0.1723717898130417,248.39744567871094,1e-05,0.06447754800319672,2.7424917221069336,23.927850246429443,3 +8637,0.15940117835998535,0.14648687839508057,0.14009717106819153,0.14865383505821228,873.039794921875,1e-05,0.07182838022708893,2.3784756660461426,23.927850246429443,3 +8638,0.20559176802635193,0.13108502328395844,0.12929467856884003,0.2673397362232208,721.2352294921875,1e-05,0.06569769978523254,2.5699782371520996,23.927850246429443,3 +8639,0.07126598060131073,0.22616741061210632,0.21344870328903198,0.19775640964508057,940.900146484375,1e-05,0.0712994933128357,2.684753656387329,23.927850246429443,3 +8640,0.2537299394607544,0.27394792437553406,0.2692059874534607,0.14608973264694214,279.50311279296875,1e-05,0.09498310834169388,5.181687116622925,23.927850246429443,3 +8641,0.188152477145195,0.08599143475294113,0.08519110828638077,0.19342948496341705,753.9683227539062,1e-05,0.0630299299955368,5.130505084991455,23.927850246429443,3 +8642,0.10563838481903076,0.29580768942832947,0.2847994565963745,0.24717947840690613,980.37109375,1e-05,0.06487082690000534,4.530416965484619,23.927850246429443,3 +8643,0.16349691152572632,0.138801708817482,0.13353998959064484,0.22788460552692413,785.6611938476562,1e-05,0.08118771016597748,2.4601824283599854,23.927850246429443,3 +8644,0.15273725986480713,0.2523362636566162,0.23405848443508148,0.2775000035762787,952.09716796875,1e-05,0.0812714472413063,2.3626763820648193,23.927850246429443,3 +8645,0.2158803939819336,0.209354430437088,0.20327480137348175,0.18573717772960663,752.3885498046875,1e-05,0.07489822059869766,2.3592913150787354,23.927850246429443,3 +8646,0.16185429692268372,0.15851621329784393,0.1616973727941513,0.10080128163099289,555.5556030273438,1e-05,0.0722457692027092,2.5510106086730957,23.927850246429443,3 +8647,0.13563470542430878,0.12964320182800293,0.13596723973751068,0.18926280736923218,701.75439453125,1e-05,0.056108150631189346,2.356480836868286,23.927850246429443,3 +8648,0.24402135610580444,0.24750572443008423,0.24349141120910645,0.2520512640476227,941.8146362304688,1e-05,0.07458501309156418,2.367549180984497,23.927850246429443,3 +8649,0.21371352672576904,0.19358590245246887,0.18812331557273865,0.17980769276618958,946.0116577148438,1e-05,0.0680464580655098,2.435791015625,23.927850246429443,3 +8650,0.18816959857940674,0.04854632169008255,0.04959515482187271,0.02211538329720497,865.1477661132812,1e-05,0.10331050306558609,2.3653371334075928,23.927850246429443,3 +8651,0.2085070013999939,0.19646641612052917,0.19507859647274017,0.2005128115415573,696.9026489257812,1e-05,0.049595922231674194,2.3653292655944824,23.927850246429443,3 +8652,0.1634761095046997,0.2167464643716812,0.21270236372947693,0.24916665256023407,913.6167602539062,1e-05,0.07018279284238815,2.6709141731262207,23.927850246429443,3 +8653,0.17784442007541656,0.15457311272621155,0.14991514384746552,0.2476923018693924,875.74853515625,1e-05,0.0705941691994667,2.5543954372406006,23.927850246429443,3 +8654,0.18732988834381104,0.23604631423950195,0.2270672619342804,0.22006408870220184,907.7218017578125,1e-05,0.08492899686098099,2.4760384559631348,23.927850246429443,3 +8655,0.25459229946136475,0.16574393212795258,0.15640003979206085,0.27051281929016113,838.8157958984375,1e-05,0.0738961473107338,2.349947214126587,23.927850246429443,3 +8656,0.15804052352905273,0.1490979641675949,0.15070199966430664,0.2604166567325592,961.7158813476562,1e-05,0.058281004428863525,2.6032257080078125,23.927850246429443,3 +8657,0.14616860449314117,0.14812344312667847,0.14810232818126678,0.2516666650772095,866.0933227539062,1e-05,0.07042913883924484,2.355403423309326,23.927850246429443,3 +8658,0.14542917907238007,0.09508918970823288,0.10742148011922836,0.23407050967216492,557.0953369140625,1e-05,0.06809671223163605,2.355027198791504,23.927850246429443,3 +8659,0.1652369350194931,0.13884775340557098,0.14684969186782837,0.22214743494987488,572.1257934570312,1e-05,0.0722697451710701,2.350381851196289,23.927850246429443,3 +8660,0.18193255364894867,0.1477106362581253,0.1397860050201416,0.2199999988079071,898.8763427734375,1e-05,0.07197607308626175,2.3477261066436768,23.927850246429443,3 +8661,0.1881559193134308,0.1380615234375,0.1381600797176361,0.21891024708747864,896.4932861328125,1e-05,0.06256994605064392,2.3525898456573486,23.927850246429443,3 +8662,0.3008192777633667,0.20018397271633148,0.19392256438732147,0.27580127120018005,585.1063842773438,1e-05,0.07901182770729065,2.5180349349975586,23.927850246429443,3 +8663,0.2119852751493454,0.20946943759918213,0.2019224762916565,0.21608974039554596,951.5281982421875,1e-05,0.07335910946130753,2.6097559928894043,23.927850246429443,3 +8664,0.22712522745132446,0.5199481844902039,0.516495406627655,0.22429485619068146,179.79454040527344,1e-05,0.05896613746881485,2.356062173843384,23.927850246429443,3 +8665,0.1713564395904541,0.20062042772769928,0.203607439994812,0.1049358919262886,919.6617431640625,1e-05,0.06269420683383942,2.4977426528930664,23.927850246429443,3 +8666,0.30115216970443726,0.2933526337146759,0.29662713408470154,0.2981089651584625,412.1983947753906,1e-05,0.09289127588272095,2.5046632289886475,23.927850246429443,3 +8667,0.2244490683078766,0.20270034670829773,0.20142169296741486,0.2628525495529175,462.8463439941406,1e-05,0.08347263187170029,2.8403713703155518,23.927850246429443,3 +8668,0.14298085868358612,0.2771602272987366,0.2671911418437958,0.13179486989974976,996.3473510742188,1e-05,0.0645504742860794,3.2843451499938965,23.927850246429443,3 +8669,0.2442966103553772,0.09491270035505295,0.09798016399145126,0.15208332240581512,787.0369873046875,1e-05,0.07263129204511642,3.834869146347046,23.927850246429443,3 +8670,0.196070596575737,0.1670539379119873,0.1664295196533203,0.22977563738822937,967.4503784179688,1e-05,0.07937096804380417,3.392901659011841,23.927850246429443,3 +8671,0.1308073252439499,0.36922788619995117,0.3592436909675598,0.1983974277973175,992.58642578125,1e-05,0.054180122911930084,3.97772479057312,23.927850246429443,3 +8672,0.14833146333694458,0.1512089967727661,0.15051418542861938,0.2310897409915924,779.3674926757812,1e-05,0.07587046176195145,3.607801675796509,23.927850246429443,3 +8673,0.1901651918888092,0.16506022214889526,0.16384178400039673,0.16032050549983978,917.9064331054688,1e-05,0.0673379972577095,4.391895532608032,23.927850246429443,3 +8674,0.23068562150001526,0.24006330966949463,0.23229365050792694,0.25903844833374023,745.9677734375,1e-05,0.06849849224090576,3.8306143283843994,23.927850246429443,3 +8675,0.2141055315732956,0.13368459045886993,0.13548274338245392,0.25746792554855347,489.6593933105469,1e-05,0.07258442789316177,2.613332986831665,23.927850246429443,3 +8676,0.24975086748600006,0.18781957030296326,0.2008269876241684,0.1627243459224701,995.5211791992188,1e-05,0.05996638908982277,2.6716601848602295,23.927850246429443,3 +8677,0.2377576231956482,0.12685830891132355,0.12656329572200775,0.17365384101867676,803.5714111328125,1e-05,0.07230008393526077,3.9725208282470703,23.927850246429443,3 +8678,0.33134040236473083,0.48314720392227173,0.4871249794960022,0.1348397433757782,137.90036010742188,1e-05,0.08001598715782166,4.4327919483184814,23.927850246429443,3 +8679,0.2919764518737793,0.44607022404670715,0.44242170453071594,0.18483974039554596,341.5697937011719,1e-05,0.06948525458574295,2.540865898132324,23.927850246429443,3 +8680,0.08734919875860214,0.15015463531017303,0.1501871943473816,0.10108973830938339,929.8156127929688,1e-05,0.05896277353167534,2.5392470359802246,23.927850246429443,3 +8681,0.1504984050989151,0.13086062669754028,0.12882256507873535,0.16314101219177246,857.9046020507812,1e-05,0.08425857126712799,2.487778902053833,23.927850246429443,3 +8682,0.2836645841598511,0.1538015902042389,0.14315639436244965,0.21483974158763885,914.3394165039062,1e-05,0.08311017602682114,3.288109302520752,23.927850246429443,3 +8683,0.18529179692268372,0.11485914885997772,0.11236932873725891,0.17378205060958862,618.6868286132812,1e-05,0.0696755200624466,2.3982410430908203,23.927850246429443,3 +8684,0.14126208424568176,0.2225245088338852,0.21754680573940277,0.23278845846652985,979.4371948242188,1e-05,0.08017377555370331,3.607177972793579,23.927850246429443,3 +8685,0.3025664985179901,0.20731236040592194,0.20602895319461823,0.17589743435382843,959.8422241210938,1e-05,0.08756238967180252,2.9978108406066895,23.927850246429443,3 +8686,0.0992928221821785,0.1475878357887268,0.13853350281715393,0.2395833283662796,944.2269897460938,1e-05,0.06613722443580627,3.50053071975708,23.927850246429443,3 +8687,0.3454892039299011,0.23832623660564423,0.2321961224079132,0.31118589639663696,505.9523620605469,1e-05,0.09238278120756149,5.064727544784546,23.927850246429443,3 +8688,0.24311614036560059,0.2816162705421448,0.2913374602794647,0.25118589401245117,330.88238525390625,1e-05,0.07481524348258972,5.0504844188690186,23.927850246429443,3 +8689,0.2501949965953827,0.29799067974090576,0.29714226722717285,0.20240384340286255,993.0098266601562,1e-05,0.08678951859474182,5.005868911743164,23.927850246429443,3 +8690,0.27006271481513977,0.4362255036830902,0.4420984089374542,0.26599356532096863,176.11683654785156,1e-05,0.07564239948987961,3.913562536239624,23.927850246429443,3 +8691,0.19790583848953247,0.2773594856262207,0.2743140757083893,0.14557692408561707,367.23162841796875,1e-05,0.07127171009778976,4.832297086715698,23.927850246429443,3 +8692,0.25352877378463745,0.204154834151268,0.206292062997818,0.28910255432128906,977.787353515625,1e-05,0.06985162943601608,2.541996479034424,23.927850246429443,3 +8693,0.18697157502174377,0.20728027820587158,0.19940517842769623,0.23054486513137817,920.7059936523438,1e-05,0.07913515716791153,2.3595845699310303,23.927850246429443,3 +8694,0.23084664344787598,0.30145952105522156,0.30034956336021423,0.19833332300186157,993.642333984375,1e-05,0.08320941776037216,2.363245964050293,23.927850246429443,3 +8695,0.18174448609352112,0.46697869896888733,0.47246748208999634,0.12073717266321182,121.84115600585938,1e-05,0.07516748458147049,2.917628765106201,23.927850246429443,3 +8696,0.3083609938621521,0.2703835070133209,0.2729206383228302,0.20339742302894592,973.2064208984375,1e-05,0.08085773140192032,2.3894546031951904,23.927850246429443,3 +8697,0.20108747482299805,0.16014757752418518,0.15705618262290955,0.2176923006772995,883.6459350585938,1e-05,0.07479804009199142,2.6091721057891846,23.927850246429443,3 +8698,0.2267225980758667,0.09768417477607727,0.10854735970497131,0.229935884475708,844.1558227539062,1e-05,0.07044027000665665,2.4035818576812744,23.927850246429443,3 +8699,0.21477748453617096,0.12176693230867386,0.1251249462366104,0.16958332061767578,898.8763427734375,1e-05,0.07514015585184097,3.215808391571045,23.927850246429443,3 +8700,0.2947505712509155,0.2151975929737091,0.2161353975534439,0.19737178087234497,988.4937133789062,1e-05,0.08185923099517822,2.4413583278656006,23.927850246429443,3 +8701,0.1789906919002533,0.18214742839336395,0.1851198524236679,0.2720192074775696,592.105224609375,1e-05,0.0636412501335144,3.0049397945404053,23.927850246429443,3 +8702,0.20859408378601074,0.2464306801557541,0.24228012561798096,0.15907050669193268,931.7718505859375,1e-05,0.07697256654500961,4.822688579559326,23.927850246429443,3 +8703,0.2482595145702362,0.1535753458738327,0.14940352737903595,0.23057691752910614,752.3885498046875,1e-05,0.06653138250112534,3.3229706287384033,23.927850246429443,3 +8704,0.14154338836669922,0.26511555910110474,0.2463451325893402,0.21448716521263123,968.7218017578125,1e-05,0.0719713494181633,2.9990487098693848,23.927850246429443,3 +8705,0.13054776191711426,0.17639581859111786,0.1632535755634308,0.23336537182331085,960.9158325195312,1e-05,0.06877617537975311,4.538731098175049,23.927850246429443,3 +8706,0.11576659977436066,0.17201565206050873,0.16926512122154236,0.11249999701976776,639.6484985351562,1e-05,0.06561824679374695,2.561518669128418,23.927850246429443,3 +8707,0.2701526880264282,0.40200501680374146,0.4163132607936859,0.2854166626930237,153.50877380371094,1e-05,0.06681777536869049,2.711705207824707,23.927850246429443,3 +8708,0.19225753843784332,0.06949055939912796,0.08088687062263489,0.21820512413978577,692.9590454101562,1e-05,0.05500045418739319,4.27835750579834,23.927850246429443,3 +8709,0.3040030300617218,0.21177685260772705,0.21396803855895996,0.22166666388511658,977.787353515625,1e-05,0.07770085334777832,3.1774439811706543,23.927850246429443,3 +8710,0.2316633015871048,0.17809154093265533,0.18087084591388702,0.2508012652397156,500.59954833984375,1e-05,0.07874782383441925,2.9781503677368164,23.927850246429443,3 +8711,0.1710098534822464,0.23001503944396973,0.23555997014045715,0.2827884554862976,989.5833129882812,1e-05,0.062334198504686356,2.360236167907715,23.927850246429443,3 +8712,0.2955939769744873,0.15813854336738586,0.1523042470216751,0.23839743435382843,796.4441528320312,1e-05,0.06613795459270477,2.3622639179229736,23.927850246429443,3 +8713,0.14369429647922516,0.1417107731103897,0.14310434460639954,0.09983973950147629,944.2269897460938,1e-05,0.07714246958494186,2.35514235496521,23.927850246429443,3 +8714,0.2203211635351181,0.11484261602163315,0.11622802913188934,0.18134614825248718,845.7308959960938,1e-05,0.07372024655342102,2.3549587726593018,23.927850246429443,3 +8715,0.18019986152648926,0.13533447682857513,0.13269534707069397,0.14522434771060944,766.25390625,1e-05,0.06486831605434418,2.3602256774902344,23.927850246429443,3 +8716,0.16362892091274261,0.1826014369726181,0.16734382510185242,0.21858973801136017,843.0989990234375,1e-05,0.06955300271511078,2.7673072814941406,23.927850246429443,3 +8717,0.2437066286802292,0.12255493551492691,0.12093311548233032,0.2172115296125412,811.095458984375,1e-05,0.07718420028686523,2.499051094055176,23.927850246429443,3 +8718,0.17411795258522034,0.18813258409500122,0.17392010986804962,0.23772434890270233,922.088134765625,1e-05,0.07589621096849442,2.3474018573760986,23.927850246429443,3 +8719,0.14466294646263123,0.20838692784309387,0.2176131308078766,0.2859615385532379,416.6666564941406,1e-05,0.07140448689460754,2.606022596359253,23.927850246429443,3 +8720,0.2847626805305481,0.2155783474445343,0.2109065055847168,0.18333332240581512,644.3798828125,1e-05,0.07506003230810165,2.696178674697876,23.927850246429443,3 +8721,0.1753884255886078,0.15684598684310913,0.15983834862709045,0.2203846126794815,905.4575805664062,1e-05,0.07667234539985657,2.6007089614868164,23.927850246429443,3 +8722,0.18307840824127197,0.15268656611442566,0.15305453538894653,0.16288460791110992,618.6868286132812,1e-05,0.055968038737773895,2.4322845935821533,23.927850246429443,3 +8723,0.1856445074081421,0.2490910440683365,0.23807507753372192,0.1971474289894104,377.094970703125,1e-05,0.06904421001672745,2.5158896446228027,23.927850246429443,3 +8724,0.20938000082969666,0.18240945041179657,0.17692790925502777,0.20961537957191467,913.2543334960938,1e-05,0.07285775989294052,2.5486862659454346,23.927850246429443,3 +8725,0.20463860034942627,0.23084011673927307,0.22795848548412323,0.24842947721481323,838.8157958984375,1e-05,0.08240547776222229,2.3600947856903076,23.927850246429443,3 +8726,0.1438845545053482,0.13495512306690216,0.13545940816402435,0.1824038326740265,948.9403076171875,1e-05,0.0652303397655487,3.722825765609741,23.927850246429443,3 +8727,0.22599825263023376,0.26506659388542175,0.25791969895362854,0.2641987204551697,827.7026977539062,1e-05,0.07780846208333969,5.538288831710815,23.927850246429443,3 +8728,0.1848621964454651,0.2090967893600464,0.2232963591814041,0.24503204226493835,319.94049072265625,1e-05,0.07136118412017822,5.438878774642944,23.927850246429443,3 +8729,0.21510641276836395,0.29264381527900696,0.2879709303379059,0.17499999701976776,994.4806518554688,1e-05,0.07691207528114319,4.340687036514282,23.927850246429443,3 +8730,0.23846516013145447,0.1555941104888916,0.15480078756809235,0.20666666328907013,879.7392578125,1e-05,0.06837465614080429,2.358483076095581,23.927850246429443,3 +8731,0.14871707558631897,0.21493443846702576,0.21491537988185883,0.16064101457595825,842.5684204101562,1e-05,0.07218842953443527,2.7871360778808594,23.927850246429443,3 +8732,0.25069600343704224,0.17040464282035828,0.16484329104423523,0.2149038314819336,942.1181640625,1e-05,0.08286207169294357,2.3555784225463867,23.927850246429443,3 +8733,0.19637322425842285,0.11337684094905853,0.11344842612743378,0.22673076391220093,775.0761108398438,1e-05,0.0712483748793602,2.359816074371338,23.927850246429443,3 +8734,0.1013040766119957,0.07547689229249954,0.0773325115442276,0.1352243572473526,841.503173828125,1e-05,0.05119222030043602,2.38672137260437,23.927850246429443,3 +8735,0.15023398399353027,0.2521761357784271,0.255961537361145,0.1148717924952507,995.728271484375,1e-05,0.0671144649386406,2.391817331314087,23.927850246429443,3 +8736,0.23758308589458466,0.15521340072155,0.1425965428352356,0.2583974301815033,852.4172973632812,1e-05,0.07219754904508591,2.3769946098327637,23.927850246429443,3 +8737,0.24390991032123566,0.2043643295764923,0.20623786747455597,0.20769229531288147,829.9730834960938,1e-05,0.08070795238018036,2.8700132369995117,23.927850246429443,3 +8738,0.2354922592639923,0.1620151698589325,0.15263378620147705,0.22846153378486633,861.80126953125,1e-05,0.07292316108942032,2.8395164012908936,23.927850246429443,3 +8739,0.28541871905326843,0.29496267437934875,0.2925107777118683,0.2360256314277649,731.7578735351562,1e-05,0.06317229568958282,2.3725345134735107,23.927850246429443,3 +8740,0.1561783254146576,0.17708741128444672,0.16998125612735748,0.1873076856136322,662.593994140625,1e-05,0.061916425824165344,2.5751333236694336,23.927850246429443,3 +8741,0.2335522174835205,0.5963929891586304,0.6014420986175537,0.27253204584121704,137.90036010742188,1e-05,0.07727399468421936,2.3591489791870117,23.927850246429443,3 +8742,0.21996812522411346,0.34349361062049866,0.35990750789642334,0.1898076832294464,228.7581787109375,1e-05,0.07893142849206924,2.5436465740203857,23.927850246429443,3 +8743,0.2155267745256424,0.10368838161230087,0.11470045894384384,0.19256410002708435,890.3912353515625,1e-05,0.07529640942811966,2.3482789993286133,23.927850246429443,3 +8744,0.1733468621969223,0.19354070723056793,0.19168423116207123,0.21756409108638763,916.8442993164062,1e-05,0.07065697759389877,2.342460870742798,23.927850246429443,3 +8745,0.23648588359355927,0.24399784207344055,0.23825806379318237,0.2745192348957062,995.3138427734375,1e-05,0.06945747137069702,2.3457534313201904,23.927850246429443,3 +8746,0.25909191370010376,0.31224551796913147,0.31230247020721436,0.20368589460849762,487.8049011230469,1e-05,0.06804240494966507,2.3645033836364746,23.927850246429443,3 +8747,0.14632157981395721,0.23244191706180573,0.22507624328136444,0.15458333492279053,948.9403076171875,1e-05,0.07946950942277908,2.5362091064453125,23.927850246429443,3 +8748,0.30789777636528015,0.24238233268260956,0.2288738638162613,0.1618589609861374,951.8129272460938,1e-05,0.06292629987001419,2.628220319747925,23.927850246429443,3 +8749,0.22986526787281036,0.14695313572883606,0.148963063955307,0.21211537718772888,737.7049560546875,1e-05,0.07323911041021347,2.8993868827819824,23.927850246429443,3 +8750,0.22103936970233917,0.2643331289291382,0.253496378660202,0.24618588387966156,754.75439453125,1e-05,0.06677209585905075,4.535530090332031,23.927850246429443,3 +8751,0.31597912311553955,0.19208098948001862,0.1903538703918457,0.1783333271741867,679.7445678710938,1e-05,0.08165409415960312,2.516062021255493,23.927850246429443,3 +8752,0.2167469710111618,0.1683589369058609,0.16549238562583923,0.23333331942558289,937.1871948242188,1e-05,0.07177039980888367,2.686983346939087,23.927850246429443,3 +8753,0.34915661811828613,0.33662790060043335,0.334559828042984,0.25996795296669006,322.7003173828125,1e-05,0.08134482055902481,2.3618054389953613,23.927850246429443,3 +8754,0.23616300523281097,0.1837873011827469,0.174749955534935,0.25083333253860474,797.1013793945312,1e-05,0.07915576547384262,2.3563289642333984,23.927850246429443,3 +8755,0.14605891704559326,0.2659666836261749,0.25262251496315,0.19865383207798004,979.9048461914062,1e-05,0.06322554498910904,2.358103036880493,23.927850246429443,3 +8756,0.23953725397586823,0.1436479687690735,0.15630273520946503,0.1851923018693924,927.1693725585938,1e-05,0.07465563714504242,2.361358642578125,23.927850246429443,3 +8757,0.17451255023479462,0.17467717826366425,0.16543172299861908,0.2122756391763687,870.2915649414062,1e-05,0.07785344123840332,2.3592817783355713,23.927850246429443,3 +8758,0.16576209664344788,0.23273462057113647,0.23685608804225922,0.19499999284744263,996.9635620117188,1e-05,0.0639503002166748,2.5826103687286377,23.927850246429443,3 +8759,0.24784541130065918,0.32637184858322144,0.32184845209121704,0.19756409525871277,297.256103515625,1e-05,0.06382394582033157,2.666771411895752,23.927850246429443,3 +8760,0.1650594025850296,0.3012126088142395,0.2941398620605469,0.23666666448116302,992.374267578125,1e-05,0.0703083723783493,2.397516965866089,23.927850246429443,3 +8761,0.13167378306388855,0.19210198521614075,0.19212204217910767,0.18926280736923218,813.5474853515625,1e-05,0.07361708581447601,2.7229807376861572,23.927850246429443,3 +8762,0.22478801012039185,0.2909025549888611,0.2664247751235962,0.23705127835273743,971.23095703125,1e-05,0.08144474029541016,2.6720151901245117,23.927850246429443,3 +8763,0.158442422747612,0.14930406212806702,0.15001441538333893,0.23423075675964355,903.5476684570312,1e-05,0.07356594502925873,2.549093008041382,23.927850246429443,3 +8764,0.18473996222019196,0.06933347135782242,0.06655465066432953,0.07612179219722748,823.0874633789062,1e-05,0.07092487066984177,2.5477726459503174,23.927850246429443,3 +8765,0.25959518551826477,0.17827057838439941,0.18651624023914337,0.2701602578163147,495.1690979003906,1e-05,0.0694599449634552,2.5541248321533203,23.927850246429443,3 +8766,0.19109073281288147,0.2092069536447525,0.21243175864219666,0.2424679398536682,466.7919921875,1e-05,0.0747348889708519,5.196306943893433,23.927850246429443,3 +8767,0.1949356496334076,0.2092176079750061,0.20267723500728607,0.25506410002708435,675.5514526367188,1e-05,0.06083837151527405,5.151135444641113,23.927850246429443,3 +8768,0.289792001247406,0.07432663440704346,0.08073554188013077,0.16323716938495636,936.2449951171875,1e-05,0.06942939013242722,4.508439540863037,23.927850246429443,3 +8769,0.2888610064983368,0.1691506803035736,0.16828079521656036,0.21067306399345398,717.632080078125,1e-05,0.08228875696659088,2.724461555480957,23.927850246429443,3 +8770,0.16120994091033936,0.10947463661432266,0.11623658239841461,0.24320511519908905,878.4185791015625,1e-05,0.06922078132629395,2.6161208152770996,23.927850246429443,3 +8771,0.20413489639759064,0.22817735373973846,0.22074878215789795,0.305737167596817,928.4979858398438,1e-05,0.06758013367652893,2.362459897994995,23.927850246429443,3 +8772,0.20724351704120636,0.18071308732032776,0.17931315302848816,0.20907050371170044,957.9439697265625,1e-05,0.0821828544139862,2.547487735748291,23.927850246429443,3 +8773,0.20223456621170044,0.17781803011894226,0.1711314618587494,0.11153845489025116,362.2159423828125,1e-05,0.0668596625328064,2.4870636463165283,23.927850246429443,3 +8774,0.1455860137939453,0.33582058548927307,0.3369321823120117,0.25160256028175354,998.3897094726562,1e-05,0.07188760489225388,2.3908884525299072,23.927850246429443,3 +8775,0.1256265938282013,0.1862366944551468,0.17961683869361877,0.24516025185585022,932.418701171875,1e-05,0.07190337777137756,2.3615429401397705,23.927850246429443,3 +8776,0.23921623826026917,0.09321483969688416,0.09800942987203598,0.10381409525871277,655.8935546875,1e-05,0.08161108195781708,2.3752026557922363,23.927850246429443,3 +8777,0.11463522911071777,0.20954996347427368,0.2002963423728943,0.20522435009479523,917.9064331054688,1e-05,0.06659191101789474,2.3598990440368652,23.927850246429443,3 +8778,0.19255954027175903,0.6596999168395996,0.6642142534255981,0.0931730717420578,83.95523071289062,1e-05,0.08878757059574127,2.3604044914245605,23.927850246429443,3 +8779,0.23529668152332306,0.69083172082901,0.680070161819458,0.2396794855594635,999.3985595703125,1e-05,0.059630922973155975,2.360428810119629,23.927850246429443,3 +8780,0.21386128664016724,0.18003864586353302,0.17407263815402985,0.2367948591709137,913.2543334960938,1e-05,0.059863314032554626,2.7230937480926514,23.927850246429443,3 +8781,0.2178337723016739,0.24164415895938873,0.23980101943016052,0.2476923018693924,593.4874267578125,1e-05,0.08832862973213196,2.354335308074951,23.927850246429443,3 +8782,0.1559637188911438,0.14619401097297668,0.1419047862291336,0.23310896754264832,772.9007568359375,1e-05,0.05980685353279114,2.483640193939209,23.927850246429443,3 +8783,0.10873717814683914,0.18152061104774475,0.18322236835956573,0.08647435903549194,971.23095703125,1e-05,0.060761626809835434,2.3581645488739014,23.927850246429443,3 +8784,0.2712631821632385,0.3197534680366516,0.3273189067840576,0.28400638699531555,285.49383544921875,1e-05,0.0766046866774559,2.7675461769104004,23.927850246429443,3 +8785,0.1812841296195984,0.19829553365707397,0.1886889785528183,0.23663461208343506,933.7044067382812,1e-05,0.07331681996583939,2.357893705368042,23.927850246429443,3 +8786,0.1935415416955948,0.23134146630764008,0.23799900710582733,0.29105767607688904,999.1974487304688,1e-05,0.06937839090824127,2.3547441959381104,23.927850246429443,3 +8787,0.21533246338367462,0.7471993565559387,0.7387049198150635,0.24397434294223785,92.59259796142578,1e-05,0.07701878249645233,2.352670431137085,23.927850246429443,3 +8788,0.17167961597442627,0.12728844583034515,0.12448274344205856,0.11368589103221893,755.5379638671875,1e-05,0.06934808939695358,2.3486955165863037,23.927850246429443,3 +8789,0.1867092102766037,0.12999269366264343,0.12413959950208664,0.18185897171497345,881.4859008789062,1e-05,0.07569265365600586,2.355285167694092,23.927850246429443,3 +8790,0.30841952562332153,0.21260946989059448,0.2083142250776291,0.2931410074234009,572.1257934570312,1e-05,0.09039957076311111,2.653380870819092,23.927850246429443,3 +8791,0.09623395651578903,0.20684026181697845,0.2047991305589676,0.16923075914382935,725.671142578125,1e-05,0.06789613515138626,2.5083022117614746,23.927850246429443,3 +8792,0.22633908689022064,0.13949307799339294,0.13638336956501007,0.2383333295583725,785.6611938476562,1e-05,0.0748135969042778,2.3540477752685547,23.927850246429443,3 +8793,0.3479292392730713,0.12832161784172058,0.127699077129364,0.2518269121646881,840.9685668945312,1e-05,0.07426691055297852,2.5011062622070312,23.927850246429443,3 +8794,0.21773633360862732,0.1498030126094818,0.14401523768901825,0.19544871151447296,733.4710693359375,1e-05,0.07830596715211868,2.569369316101074,23.927850246429443,3 +8795,0.23635688424110413,0.18805067241191864,0.19370102882385254,0.22378204762935638,773.6281127929688,1e-05,0.07652183622121811,2.410827159881592,23.927850246429443,3 +8796,0.23931366205215454,0.21766820549964905,0.21862804889678955,0.21535255014896393,974.4267578125,1e-05,0.07743256539106369,2.4667515754699707,23.927850246429443,3 +8797,0.1852767914533615,0.19886630773544312,0.20129510760307312,0.2251282036304474,767.0015869140625,1e-05,0.07292435318231583,2.3958826065063477,23.927850246429443,3 +8798,0.22219981253147125,0.19884207844734192,0.2053089439868927,0.25131410360336304,464.8240966796875,1e-05,0.07044196128845215,2.684652328491211,23.927850246429443,3 +8799,0.1583935171365738,0.23454032838344574,0.240330770611763,0.1288461536169052,973.2064208984375,1e-05,0.07468133419752121,2.8081188201904297,23.927850246429443,3 +8800,0.14180587232112885,0.20921896398067474,0.21802155673503876,0.25112178921699524,980.37109375,1e-05,0.062164753675460815,2.94992995262146,23.927850246429443,3 +8801,0.2640366554260254,0.27031567692756653,0.2673881947994232,0.23105768859386444,398.5013732910156,1e-05,0.07992654293775558,2.6445367336273193,23.927850246429443,3 +8802,0.16418218612670898,0.17256923019886017,0.1665191948413849,0.1433333307504654,958.7605590820312,1e-05,0.07752411812543869,2.351027727127075,23.927850246429443,3 +8803,0.21534141898155212,0.28984054923057556,0.2763960361480713,0.23310896754264832,974.9119873046875,1e-05,0.0772792398929596,2.3511669635772705,23.927850246429443,3 +8804,0.14354750514030457,0.27281689643859863,0.2647979259490967,0.25708332657814026,991.3079833984375,1e-05,0.06017783656716347,2.4834837913513184,23.927850246429443,3 +8805,0.17812958359718323,0.28260689973831177,0.29275262355804443,0.24333332479000092,319.94049072265625,1e-05,0.07122960686683655,2.5980136394500732,23.927850246429443,3 +8806,0.10036525875329971,0.13045744597911835,0.1357322782278061,0.24916665256023407,946.6019287109375,1e-05,0.08936858922243118,2.3523995876312256,23.927850246429443,3 +8807,0.21885927021503448,0.21598878502845764,0.2283140867948532,0.196762815117836,460.8586120605469,1e-05,0.06893495470285416,2.3528456687927246,23.927850246429443,3 +8808,0.1510852575302124,0.16029949486255646,0.15404528379440308,0.17701922357082367,920.7059936523438,1e-05,0.06977486610412598,2.352993965148926,23.927850246429443,3 +8809,0.17545843124389648,0.1001371517777443,0.11509936302900314,0.2082371711730957,389.1184997558594,1e-05,0.07816395163536072,2.3501861095428467,23.927850246429443,3 +8810,0.11791375279426575,0.13120824098587036,0.12809044122695923,0.12448717653751373,932.418701171875,1e-05,0.06726471334695816,2.35318922996521,23.927850246429443,3 +8811,0.26399555802345276,0.12955376505851746,0.14142587780952454,0.2079487144947052,942.4212036132812,1e-05,0.07709211856126785,2.467287063598633,23.927850246429443,3 +8812,0.17075695097446442,0.11164075136184692,0.11217385530471802,0.13935896754264832,825.4075927734375,1e-05,0.08079691976308823,2.7118420600891113,23.927850246429443,3 +8813,0.11899058520793915,0.19560497999191284,0.18767523765563965,0.2397756278514862,954.9102783203125,1e-05,0.07477832585573196,2.3594493865966797,23.927850246429443,3 +8814,0.139775812625885,0.20894092321395874,0.2037806361913681,0.24233973026275635,906.2156372070312,1e-05,0.08753824979066849,2.3521082401275635,23.927850246429443,3 +8815,0.2833763659000397,0.16700319945812225,0.1609637439250946,0.24608974158763885,618.6868286132812,1e-05,0.071809783577919,2.7847402095794678,23.927850246429443,3 +8816,0.20843935012817383,0.30266672372817993,0.3296777009963989,0.2827884554862976,997.7804565429688,1e-05,0.07131373882293701,2.482821464538574,23.927850246429443,3 +8817,0.2636595368385315,0.08122606575489044,0.08740910142660141,0.19884614646434784,760.1881103515625,1e-05,0.07210606336593628,2.355100631713867,23.927850246429443,3 +8818,0.19364988803863525,0.1779237985610962,0.1846858263015747,0.2080448567867279,999.1974487304688,1e-05,0.07235778868198395,2.359114408493042,23.927850246429443,3 +8819,0.18678539991378784,0.08712854236364365,0.09645512700080872,0.2574999928474426,770.7055053710938,1e-05,0.06906957179307938,2.3523216247558594,23.927850246429443,3 +8820,0.13938158750534058,0.15850359201431274,0.17672279477119446,0.2683012783527374,982.9059448242188,1e-05,0.07110794633626938,2.3524539470672607,23.927850246429443,3 +8821,0.14883631467819214,0.1427646279335022,0.13637325167655945,0.19842948019504547,767.7470092773438,1e-05,0.0718100443482399,2.565202474594116,23.927850246429443,3 +8822,0.22266671061515808,0.15243029594421387,0.1611783355474472,0.15448717772960663,609.6311645507812,1e-05,0.10018250346183777,2.571819543838501,23.927850246429443,3 +8823,0.19058319926261902,0.13617154955863953,0.13280291855335236,0.19006410241127014,753.9683227539062,1e-05,0.07140117138624191,2.5176727771759033,23.927850246429443,3 +8824,0.22862331569194794,0.15297092497348785,0.14875340461730957,0.20628204941749573,874.8499145507812,1e-05,0.0768369510769844,2.352590560913086,23.927850246429443,3 +8825,0.3013276755809784,0.09180689603090286,0.09055490046739578,0.22330127656459808,756.319091796875,1e-05,0.07368447631597519,2.4682564735412598,23.927850246429443,3 +8826,0.22997459769248962,0.09223859757184982,0.0880785807967186,0.2180769145488739,803.5714111328125,1e-05,0.07890451699495316,2.561537742614746,23.927850246429443,3 +8827,0.20273298025131226,0.12855687737464905,0.13920466601848602,0.25564101338386536,550.8948364257812,1e-05,0.06272377073764801,2.3540380001068115,23.927850246429443,3 +8828,0.20206189155578613,0.4984762966632843,0.49110692739486694,0.23144230246543884,218.64686584472656,1e-05,0.08029991388320923,2.3463356494903564,23.927850246429443,3 +8829,0.20329593122005463,0.2542837858200073,0.2622513771057129,0.10573717206716537,308.7349548339844,1e-05,0.0721098780632019,2.3515536785125732,23.927850246429443,3 +8830,0.109763503074646,0.14310427010059357,0.1411333531141281,0.2524038255214691,564.6929931640625,1e-05,0.07987039536237717,2.34639310836792,23.927850246429443,3 +8831,0.1657715141773224,0.07555209845304489,0.08437197655439377,0.13887819647789001,642.0233154296875,1e-05,0.07958252727985382,2.350182294845581,23.927850246429443,3 +8832,0.2531956434249878,0.22160471975803375,0.21910634636878967,0.23208332061767578,968.974853515625,1e-05,0.07112418860197067,2.4815666675567627,23.927850246429443,3 +8833,0.16600824892520905,0.1701246201992035,0.15826639533042908,0.17378205060958862,776.5151977539062,1e-05,0.08595339208841324,2.5515522956848145,23.927850246429443,3 +8834,0.1965416967868805,0.148816779255867,0.14833571016788483,0.13057692348957062,867.9705810546875,1e-05,0.07288197427988052,2.511124849319458,23.927850246429443,3 +8835,0.22786085307598114,0.1729992926120758,0.1702054888010025,0.19929486513137817,642.0233154296875,1e-05,0.07710564136505127,2.347301721572876,23.927850246429443,3 +8836,0.11689674109220505,0.07642607390880585,0.07787634432315826,0.12935896217823029,936.8737182617188,1e-05,0.07663087546825409,2.5862255096435547,23.927850246429443,3 +8837,0.14424285292625427,0.12159880250692368,0.1256246268749237,0.23368589580059052,677.6557006835938,1e-05,0.06563324481248856,2.7656264305114746,23.927850246429443,3 +8838,0.1412944197654724,0.15709225833415985,0.14773331582546234,0.26999998092651367,873.947021484375,1e-05,0.06816855818033218,2.3569376468658447,23.927850246429443,3 +8839,0.10519027709960938,0.171249121427536,0.16222403943538666,0.2523076832294464,957.6707763671875,1e-05,0.07717899233102798,2.3469693660736084,23.927850246429443,3 +8840,0.23127436637878418,0.40630000829696655,0.40038737654685974,0.20166665315628052,997.5768432617188,1e-05,0.07748787105083466,2.3475286960601807,23.927850246429443,3 +8841,0.24673756957054138,0.2510175108909607,0.24350331723690033,0.22971153259277344,505.9523620605469,1e-05,0.07783985137939453,2.3449313640594482,23.927850246429443,3 +8842,0.23939765989780426,0.1938653439283371,0.19589745998382568,0.2529807686805725,651.3410034179688,1e-05,0.06685309112071991,2.3575332164764404,23.927850246429443,3 +8843,0.2635880708694458,0.17447206377983093,0.1745697408914566,0.14624999463558197,533.2568969726562,1e-05,0.08753491193056107,2.5741543769836426,23.927850246429443,3 +8844,0.17739175260066986,0.11313214898109436,0.12319131195545197,0.1565384566783905,987.615478515625,1e-05,0.07698294520378113,2.540470600128174,23.927850246429443,3 +8845,0.20002038776874542,0.29226574301719666,0.2766221761703491,0.23538461327552795,985.6176147460938,1e-05,0.06705451011657715,2.3581902980804443,23.927850246429443,3 +8846,0.1765294373035431,0.23870541155338287,0.24484485387802124,0.22701922059059143,431.9371643066406,1e-05,0.12834686040878296,2.355114459991455,23.927850246429443,3 +8847,0.19809119403362274,0.22215434908866882,0.23315055668354034,0.23028844594955444,983.5890502929688,1e-05,0.08063919097185135,2.6063590049743652,23.927850246429443,3 +8848,0.22110874950885773,0.9542906284332275,0.9569671154022217,0.2506089508533478,29.296875,1e-05,0.05859464779496193,2.3576724529266357,23.927850246429443,3 +8849,0.2658230662345886,0.14982347190380096,0.14116781949996948,0.23730768263339996,932.7411499023438,1e-05,0.07262249290943146,2.3488802909851074,23.927850246429443,3 +8850,0.15823091566562653,0.13852499425411224,0.13289129734039307,0.22759614884853363,782.1857299804688,1e-05,0.0625191256403923,2.351140022277832,23.927850246429443,3 +8851,0.21925939619541168,0.14799082279205322,0.1435965597629547,0.28314101696014404,957.39697265625,1e-05,0.09834359586238861,2.3489441871643066,23.927850246429443,3 +8852,0.2527788281440735,0.1433929055929184,0.1383848786354065,0.22557690739631653,760.95458984375,1e-05,0.0632423534989357,2.352797508239746,23.927850246429443,3 +8853,0.11173795163631439,0.16746747493743896,0.16292700171470642,0.2581089735031128,938.1237182617188,1e-05,0.05624953284859657,2.495368480682373,23.927850246429443,3 +8854,0.1798650622367859,0.187310591340065,0.1803717017173767,0.22746793925762177,854.930419921875,1e-05,0.0721622034907341,2.572530508041382,23.927850246429443,3 +8855,0.14227665960788727,0.24852362275123596,0.235479474067688,0.18224358558654785,971.23095703125,1e-05,0.0841456726193428,2.4939002990722656,23.927850246429443,3 +8856,0.2175370156764984,0.2132878452539444,0.21677133440971375,0.28294870257377625,995.3138427734375,1e-05,0.07498567551374435,2.3596246242523193,23.927850246429443,3 +8857,0.20020273327827454,0.14347770810127258,0.1361023634672165,0.1889422982931137,782.8849487304688,1e-05,0.06832209974527359,2.3685357570648193,23.927850246429443,3 +8858,0.15045587718486786,0.1729225069284439,0.1654975712299347,0.2876923084259033,640.8381958007812,1e-05,0.07135827839374542,2.620256185531616,23.927850246429443,3 +8859,0.14675888419151306,0.1348179578781128,0.1281629353761673,0.19766025245189667,765.50390625,1e-05,0.05601557344198227,2.3589892387390137,23.927850246429443,3 +8860,0.23268075287342072,0.2723320722579956,0.2710294723510742,0.2392948567867279,367.23162841796875,1e-05,0.07772575318813324,2.3565285205841064,23.927850246429443,3 +8861,0.17137928307056427,0.1317211240530014,0.1288822889328003,0.24935896694660187,861.80126953125,1e-05,0.10430287569761276,2.3551228046417236,23.927850246429443,3 +8862,0.1962597370147705,0.10486838221549988,0.10433010756969452,0.059583332389593124,923.1171264648438,1e-05,0.06810995936393738,2.3536128997802734,23.927850246429443,3 +8863,0.2390298992395401,0.15083983540534973,0.1398245096206665,0.23192307353019714,829.9730834960938,1e-05,0.07212061434984207,2.3633036613464355,23.927850246429443,3 +8864,0.21002289652824402,0.14780408143997192,0.14753124117851257,0.21249999105930328,881.919921875,1e-05,0.07345948368310928,2.571805000305176,23.927850246429443,3 +8865,0.394480437040329,0.12601006031036377,0.12013861536979675,0.19519230723381042,837.7308349609375,1e-05,0.11591073125600815,2.694042444229126,23.927850246429443,3 +8866,0.31316694617271423,0.11627829819917679,0.12301609665155411,0.21397435665130615,786.3502197265625,1e-05,0.08848804235458374,2.361694812774658,23.927850246429443,3 +8867,0.13119840621948242,0.09228862822055817,0.09574467688798904,0.12830127775669098,827.7026977539062,1e-05,0.07240759581327438,2.348184585571289,23.927850246429443,3 +8868,0.16720177233219147,0.11040788143873215,0.11201176047325134,0.2563461363315582,859.375,1e-05,0.09285705536603928,2.589388370513916,23.927850246429443,3 +8869,0.16805996000766754,0.22891339659690857,0.21246206760406494,0.21657051146030426,917.19921875,1e-05,0.0811818391084671,2.51467227935791,23.927850246429443,3 +8870,0.152157723903656,0.12335778027772903,0.12252634018659592,0.13980768620967865,937.5,1e-05,0.07167088240385056,2.346304416656494,23.927850246429443,3 +8871,0.3185842037200928,0.15586994588375092,0.1542910933494568,0.2430448681116104,857.4120483398438,1e-05,0.07957234978675842,2.3439571857452393,23.927850246429443,3 +8872,0.23070991039276123,0.46549439430236816,0.5005931854248047,0.23599357903003693,137.90036010742188,1e-05,0.08836613595485687,2.3444137573242188,23.927850246429443,3 +8873,0.22465728223323822,0.22043362259864807,0.2279796451330185,0.25836536288261414,855.9268798828125,1e-05,0.07146111130714417,2.3443973064422607,23.927850246429443,3 +8874,0.2842426002025604,0.09697818756103516,0.1021202802658081,0.10673076659440994,658.1439819335938,1e-05,0.07861389964818954,2.348353147506714,23.927850246429443,3 +8875,0.1460714489221573,0.22867624461650848,0.23047630488872528,0.13173076510429382,993.8524169921875,1e-05,0.0751926526427269,2.4980664253234863,23.927850246429443,3 +8876,0.23356913030147552,0.14975133538246155,0.15261657536029816,0.24330127239227295,957.9439697265625,1e-05,0.07012610882520676,2.495246171951294,23.927850246429443,3 +8877,0.2170570194721222,0.1352047622203827,0.13618376851081848,0.2813461422920227,782.8849487304688,1e-05,0.06852436065673828,2.3493564128875732,23.927850246429443,3 +8878,0.20572561025619507,0.1686640828847885,0.15792788565158844,0.24833332002162933,699.823974609375,1e-05,0.07395810633897781,2.346348524093628,23.927850246429443,3 +8879,0.13419362902641296,0.187901109457016,0.1886126548051834,0.22891025245189667,849.3589477539062,1e-05,0.06786105036735535,2.649620771408081,23.927850246429443,3 +8880,0.13239698112010956,0.34545692801475525,0.3369233310222626,0.2374679446220398,991.3079833984375,1e-05,0.06194857135415077,2.3595449924468994,23.927850246429443,3 +8881,0.2526617646217346,0.30114373564720154,0.274556964635849,0.25977563858032227,987.615478515625,1e-05,0.09070627391338348,2.3424770832061768,23.927850246429443,3 +8882,0.2575211822986603,0.1737920641899109,0.17272765934467316,0.25467947125434875,612.2449340820312,1e-05,0.08923323452472687,2.3435630798339844,23.927850246429443,3 +8883,0.22438351809978485,0.17726589739322662,0.17450140416622162,0.2514423131942749,925.1558837890625,1e-05,0.07839751243591309,2.3473596572875977,23.927850246429443,3 +8884,0.2070828676223755,0.2774707078933716,0.2548244595527649,0.2898397445678711,967.9602661132812,1e-05,0.06134752184152603,2.346256971359253,23.927850246429443,3 +8885,0.10652759671211243,0.2342453896999359,0.21814294159412384,0.24512819945812225,977.5501098632812,1e-05,0.0592569038271904,2.489813804626465,23.927850246429443,3 +8886,0.1483420431613922,0.14121121168136597,0.13603094220161438,0.255961537361145,887.4710083007812,1e-05,0.06267441064119339,2.710930824279785,23.927850246429443,3 +8887,0.2528902292251587,0.1620529443025589,0.15552575886249542,0.2841345965862274,712.13427734375,1e-05,0.08634773641824722,2.3538365364074707,23.927850246429443,3 +8888,0.28861311078071594,0.15332096815109253,0.1604541838169098,0.14397434890270233,621.2273559570312,1e-05,0.061122335493564606,2.3467495441436768,23.927850246429443,3 +8889,0.21088574826717377,0.19691486656665802,0.18474434316158295,0.20926281809806824,943.0255737304688,1e-05,0.05343576520681381,2.458381414413452,23.927850246429443,3 +8890,0.16539599001407623,0.32151320576667786,0.3495500683784485,0.2268589586019516,996.1414184570312,1e-05,0.0678354948759079,2.7549736499786377,23.927850246429443,3 +8891,0.12618228793144226,0.11493702977895737,0.11411330103874207,0.13519230484962463,923.799560546875,1e-05,0.06969437003135681,2.352346897125244,23.927850246429443,3 +8892,0.14750398695468903,0.10416385531425476,0.10029225051403046,0.268525630235672,887.0499877929688,1e-05,0.07550537586212158,2.3558614253997803,23.927850246429443,3 +8893,0.31798064708709717,0.39138373732566833,0.3819824159145355,0.24772435426712036,273.4375,1e-05,0.1057150661945343,2.350283622741699,23.927850246429443,3 +8894,0.19312603771686554,0.2682195007801056,0.26593390107154846,0.2194230705499649,982.4486694335938,1e-05,0.06068907678127289,2.3596549034118652,23.927850246429443,3 +8895,0.2827858328819275,0.2288510650396347,0.2402723878622055,0.17618589103221893,442.5064697265625,1e-05,0.07565012574195862,2.3522472381591797,23.927850246429443,3 +8896,0.23597636818885803,0.27890458703041077,0.2964525818824768,0.15977562963962555,218.64686584472656,1e-05,0.07337243109941483,2.5039703845977783,23.927850246429443,3 +8897,0.20784099400043488,0.2060254067182541,0.20681707561016083,0.2969871759414673,680.7832641601562,1e-05,0.06483136862516403,2.5046355724334717,23.927850246429443,3 +8898,0.2186127007007599,0.10310478508472443,0.10015442222356796,0.08249999582767487,557.0953369140625,1e-05,0.07399609684944153,2.358015537261963,23.927850246429443,3 +8899,0.2733161747455597,0.13579779863357544,0.1355578452348709,0.1949358880519867,828.8410034179688,1e-05,0.08025665581226349,2.3545587062835693,23.927850246429443,3 +8900,0.1574535369873047,0.13210974633693695,0.13491752743721008,0.20810896158218384,610.940673828125,1e-05,0.07793254405260086,2.5684242248535156,23.927850246429443,3 +8901,0.19875290989875793,0.15358278155326843,0.15704698860645294,0.17092947661876678,544.5823974609375,1e-05,0.06643438339233398,2.3600754737854004,23.927850246429443,3 +8902,0.18519428372383118,0.17861248552799225,0.17577916383743286,0.31910255551338196,680.7832641601562,1e-05,0.06942605972290039,2.3601317405700684,23.927850246429443,3 +8903,0.19256238639354706,0.17064586281776428,0.16742773354053497,0.20749999582767487,959.5725708007812,1e-05,0.0674537941813469,2.3513619899749756,23.927850246429443,3 +8904,0.1485203206539154,0.20310890674591064,0.21220864355564117,0.2754487097263336,341.5697937011719,1e-05,0.0859920009970665,2.352717638015747,23.927850246429443,3 +8905,0.1671980917453766,0.15260496735572815,0.14493443071842194,0.18141025304794312,866.0933227539062,1e-05,0.0719960406422615,2.3521218299865723,23.927850246429443,3 +8906,0.18737737834453583,0.17790202796459198,0.1703881174325943,0.31871792674064636,809.8590698242188,1e-05,0.06979288160800934,2.3500804901123047,23.927850246429443,3 +8907,0.22949117422103882,0.1653679758310318,0.16535790264606476,0.1936858892440796,613.5438232421875,1e-05,0.06951913237571716,2.5600013732910156,23.927850246429443,3 +8908,0.2267347127199173,0.23255813121795654,0.22733309864997864,0.14948716759681702,909.9564819335938,1e-05,0.06719141453504562,2.3564562797546387,23.927850246429443,3 +8909,0.2052934467792511,0.21792633831501007,0.2063802033662796,0.2622756361961365,678.7020263671875,1e-05,0.06403057277202606,2.356494426727295,23.927850246429443,3 +8910,0.1493120640516281,0.15676358342170715,0.14975905418395996,0.29006409645080566,926.165771484375,1e-05,0.07383153587579727,2.3479998111724854,23.927850246429443,3 +8911,0.10876679420471191,0.1683366894721985,0.16842308640480042,0.17089742422103882,968.7218017578125,1e-05,0.057967789471149445,2.786830186843872,23.927850246429443,3 +8912,0.11076868325471878,0.1841391921043396,0.17041942477226257,0.16118589043617249,844.1558227539062,1e-05,0.07702930271625519,2.354771852493286,23.927850246429443,3 +8913,0.08595460653305054,0.29635512828826904,0.2874584197998047,0.23451922833919525,994.0623168945312,1e-05,0.06187115237116814,2.3437232971191406,23.927850246429443,3 +8914,0.14123502373695374,0.16798721253871918,0.1582193374633789,0.2430448681116104,707.4652709960938,1e-05,0.08259116113185883,2.347701072692871,23.927850246429443,3 +8915,0.10573593527078629,0.14289860427379608,0.13462994992733002,0.2599358856678009,919.3121948242188,1e-05,0.07047294825315475,2.3496596813201904,23.927850246429443,3 +8916,0.137302428483963,0.23709061741828918,0.22695624828338623,0.20730768144130707,978.9678955078125,1e-05,0.07759305834770203,2.3523828983306885,23.927850246429443,3 +8917,0.1545868217945099,0.1626213788986206,0.1559792309999466,0.2550961375236511,753.9683227539062,1e-05,0.07945811003446579,2.510826826095581,23.927850246429443,3 +8918,0.23034073412418365,0.2525085508823395,0.24993668496608734,0.25977563858032227,995.9349365234375,1e-05,0.0724189281463623,2.751983165740967,23.927850246429443,3 +8919,0.21438483893871307,0.6668069958686829,0.6695141196250916,0.1944551169872284,157.3426513671875,1e-05,0.07733362168073654,2.3559601306915283,23.927850246429443,3 +8920,0.19783993065357208,0.10479658097028732,0.11040334403514862,0.14576922357082367,821.9178466796875,1e-05,0.06359568238258362,2.3452789783477783,23.927850246429443,3 +8921,0.1501339077949524,0.25842753052711487,0.2529383599758148,0.29246795177459717,966.6818237304688,1e-05,0.08096271753311157,2.470893383026123,23.927850246429443,3 +8922,0.12781637907028198,0.14627425372600555,0.13860371708869934,0.21987178921699524,709.3425903320312,1e-05,0.06208936870098114,2.531496524810791,23.927850246429443,3 +8923,0.18248800933361053,0.26717114448547363,0.2685355246067047,0.16544871032238007,989.148681640625,1e-05,0.0690532773733139,2.344949960708618,23.927850246429443,3 +8924,0.1914072483778,0.206085205078125,0.20311763882637024,0.16653846204280853,968.2146606445312,1e-05,0.07989446818828583,2.350712299346924,23.927850246429443,3 +8925,0.18530899286270142,0.2731684148311615,0.26395556330680847,0.20355768501758575,507.7196960449219,1e-05,0.07406093925237656,2.3479881286621094,23.927850246429443,3 +8926,0.27751249074935913,0.22794999182224274,0.24952906370162964,0.22451922297477722,314.37127685546875,1e-05,0.07003506273031235,2.346914052963257,23.927850246429443,3 +8927,0.19704774022102356,0.09589115530252457,0.09875168651342392,0.20980767905712128,704.624755859375,1e-05,0.07219751179218292,2.597064971923828,23.927850246429443,3 +8928,0.10102377086877823,0.04886467009782791,0.05549320578575134,0.1395512819290161,701.75439453125,1e-05,0.09282258152961731,2.554936647415161,23.927850246429443,3 +8929,0.2483965903520584,0.19293300807476044,0.18813194334506989,0.21907050907611847,908.8427124023438,1e-05,0.07052287459373474,2.355210065841675,23.927850246429443,3 +8930,0.20897693932056427,0.1311337947845459,0.12598136067390442,0.1749679446220398,795.784912109375,1e-05,0.07332777231931686,2.3472399711608887,23.927850246429443,3 +8931,0.18709512054920197,0.2624450623989105,0.2618214190006256,0.2643589675426483,997.9838256835938,1e-05,0.07156261056661606,2.35019588470459,23.927850246429443,3 +8932,0.1479671448469162,0.21781384944915771,0.2161952406167984,0.11240383982658386,967.194580078125,1e-05,0.08897610008716583,2.6602911949157715,23.927850246429443,3 +8933,0.19034473598003387,0.1591600775718689,0.15428698062896729,0.21801280975341797,812.3250122070312,1e-05,0.07245096564292908,2.3536250591278076,23.927850246429443,3 +8934,0.3760507106781006,0.21807090938091278,0.2092067450284958,0.2654487192630768,704.624755859375,1e-05,0.0832483172416687,2.344086170196533,23.927850246429443,3 +8935,0.20637929439544678,0.6168839335441589,0.6217893958091736,0.10198717564344406,57.25191116333008,1e-05,0.0873885229229927,2.3499417304992676,23.927850246429443,3 +8936,0.16213686764240265,0.20910483598709106,0.20416182279586792,0.1836538463830948,760.95458984375,1e-05,0.061740633100271225,2.351172685623169,23.927850246429443,3 +8937,0.18068251013755798,0.25133016705513,0.25647610425949097,0.2397756278514862,991.9489135742188,1e-05,0.06521034240722656,2.3471579551696777,23.927850246429443,3 +8938,0.23467490077018738,0.18633976578712463,0.18313200771808624,0.2516666650772095,911.4300537109375,1e-05,0.0743168443441391,2.464693784713745,23.927850246429443,3 +8939,0.27471113204956055,0.1698198914527893,0.1665782332420349,0.29846152663230896,603.0020751953125,1e-05,0.06631700694561005,2.596114158630371,23.927850246429443,3 +8940,0.2651291787624359,0.1536797136068344,0.1605430394411087,0.2210576832294464,748.3948974609375,1e-05,0.0793798565864563,2.3524951934814453,23.927850246429443,3 +8941,0.20764541625976562,0.686592698097229,0.6917142271995544,0.19999998807907104,121.84115600585938,1e-05,0.06366057693958282,2.3485465049743652,23.927850246429443,3 +8942,0.18535900115966797,0.17561399936676025,0.17516088485717773,0.24541665613651276,857.4120483398438,1e-05,0.06370702385902405,2.347900867462158,23.927850246429443,3 +8943,0.3159770667552948,0.21213264763355255,0.20555661618709564,0.2566666603088379,612.2449340820312,1e-05,0.08783015608787537,2.7172906398773193,23.927850246429443,3 +8944,0.13323210179805756,0.06383269280195236,0.07142960280179977,0.14346154034137726,566.1925659179688,1e-05,0.06329899281263351,2.3555757999420166,23.927850246429443,3 +8945,0.2440485954284668,0.1662416309118271,0.17093084752559662,0.1646474301815033,639.6484985351562,1e-05,0.06475017964839935,2.344280958175659,23.927850246429443,3 +8946,0.1847815215587616,0.31972765922546387,0.3265073299407959,0.204679474234581,176.11683654785156,1e-05,0.07640452682971954,2.3482015132904053,23.927850246429443,3 +8947,0.28876054286956787,0.28964874148368835,0.2896391749382019,0.20096153020858765,330.88238525390625,1e-05,0.08118515461683273,2.3470299243927,23.927850246429443,3 +8948,0.1743002086877823,0.27005621790885925,0.2564646601676941,0.2801922857761383,977.3124389648438,1e-05,0.07074742019176483,2.34842586517334,23.927850246429443,3 +8949,0.33846232295036316,0.20846973359584808,0.19897106289863586,0.28865382075309753,583.6886596679688,1e-05,0.07600132375955582,2.5797839164733887,23.927850246429443,3 +8950,0.16900302469730377,0.1778416931629181,0.17200975120067596,0.2751922905445099,664.7939453125,1e-05,0.06636413186788559,2.3550853729248047,23.927850246429443,3 +8951,0.07488095015287399,0.16840386390686035,0.1671898365020752,0.19807691872119904,858.3959350585938,1e-05,0.060849785804748535,2.346787929534912,23.927850246429443,3 +8952,0.31091755628585815,0.5986632108688354,0.5953547954559326,0.20868588984012604,133.9285888671875,1e-05,0.095945343375206,2.3484904766082764,23.927850246429443,3 +8953,0.22609275579452515,0.2052692472934723,0.19126243889331818,0.2915705144405365,934.6619262695312,1e-05,0.08260361850261688,2.5001862049102783,23.927850246429443,3 +8954,0.19413231313228607,0.3237501382827759,0.3069724440574646,0.2771153748035431,991.52197265625,1e-05,0.057577140629291534,2.5152430534362793,23.927850246429443,3 +8955,0.18576844036579132,0.2107720673084259,0.21178027987480164,0.20964743196964264,974.4267578125,1e-05,0.08835798501968384,2.5667684078216553,23.927850246429443,3 +8956,0.16717268526554108,0.14324262738227844,0.1380142718553543,0.2525961399078369,941.20556640625,1e-05,0.07815912365913391,2.3516266345977783,23.927850246429443,3 +8957,0.2694002091884613,0.12015228718519211,0.12126994878053665,0.19147434830665588,665.8878784179688,1e-05,0.07186123728752136,2.3461198806762695,23.927850246429443,3 +8958,0.06811527162790298,0.31451964378356934,0.2908422350883484,0.20541666448116302,973.9398803710938,1e-05,0.06785576045513153,2.3533389568328857,23.927850246429443,3 +8959,0.14614790678024292,0.33919039368629456,0.32963019609451294,0.22006408870220184,986.731201171875,1e-05,0.06421781331300735,2.470972776412964,23.927850246429443,3 +8960,0.29609549045562744,0.48242929577827454,0.48013436794281006,0.1597115397453308,190.67796325683594,1e-05,0.07265648245811462,2.57963490486145,23.927850246429443,3 +8961,0.18154335021972656,0.14991825819015503,0.1440705806016922,0.2390064001083374,806.7376098632812,1e-05,0.0650663673877716,2.3542017936706543,23.927850246429443,3 +8962,0.17719067633152008,0.08332744985818863,0.08987028896808624,0.15602563321590424,756.319091796875,1e-05,0.0844394788146019,2.388988971710205,23.927850246429443,3 +8963,0.25919026136398315,0.35710135102272034,0.3526330292224884,0.1943589597940445,992.7984008789062,1e-05,0.06913267821073532,2.5163207054138184,23.927850246429443,3 +8964,0.15609534084796906,0.17775461077690125,0.18740248680114746,0.2184615284204483,984.2687377929688,1e-05,0.06500685960054398,2.799522876739502,23.927850246429443,3 +8965,0.2661914527416229,0.11692295968532562,0.12992696464061737,0.1841346025466919,884.5029296875,1e-05,0.06541819125413895,2.907160520553589,23.927850246429443,3 +8966,0.16427242755889893,0.28020572662353516,0.27488142251968384,0.19189101457595825,454.8346252441406,1e-05,0.06626665592193604,3.063533067703247,23.927850246429443,3 +8967,0.1599174439907074,0.13394995033740997,0.12713533639907837,0.2703525424003601,839.89501953125,1e-05,0.07486619800329208,5.443351984024048,23.927850246429443,3 +8968,0.1656307876110077,0.18272840976715088,0.18462291359901428,0.20657050609588623,849.8719482421875,1e-05,0.0704912319779396,4.979034185409546,23.927850246429443,3 +8969,0.18346954882144928,0.3610258102416992,0.35651642084121704,0.2742948532104492,984.0426025390625,1e-05,0.0730806440114975,3.4860100746154785,23.927850246429443,3 +8970,0.16243721544742584,0.11093305051326752,0.123055599629879,0.18022435903549194,925.8298950195312,1e-05,0.09515921026468277,2.8013916015625,23.927850246429443,3 +8971,0.20472946763038635,0.15815381705760956,0.15223777294158936,0.19054485857486725,687.94970703125,1e-05,0.07226717472076416,2.3705406188964844,23.927850246429443,3 +8972,0.17820599675178528,0.2318463772535324,0.22685106098651886,0.21314102411270142,977.3124389648438,1e-05,0.07049249112606049,3.297128438949585,23.927850246429443,3 +8973,0.13409458100795746,0.07963160425424576,0.0776088610291481,0.2283974289894104,674.4935913085938,1e-05,0.08150595426559448,4.068514585494995,23.927850246429443,3 +8974,0.25485870242118835,0.23809181153774261,0.230798602104187,0.2518269121646881,747.5884399414062,1e-05,0.07388860732316971,2.6726582050323486,23.927850246429443,3 +8975,0.10618503391742706,0.1371615082025528,0.13465183973312378,0.20121793448925018,938.1237182617188,1e-05,0.07226117700338364,2.586055040359497,23.927850246429443,3 +8976,0.10186596214771271,0.12043288350105286,0.12561826407909393,0.20759615302085876,906.2156372070312,1e-05,0.06149446219205856,2.3576791286468506,23.927850246429443,3 +8977,0.16592293977737427,0.15577326714992523,0.1490028202533722,0.2343910187482834,939.36376953125,1e-05,0.10062210261821747,2.357300281524658,23.927850246429443,3 +8978,0.2652411460876465,0.17969202995300293,0.16561539471149445,0.2694871723651886,708.4055786132812,1e-05,0.08329638838768005,2.377305746078491,23.927850246429443,3 +8979,0.2917986512184143,0.1578579843044281,0.1535090059041977,0.21666665375232697,828.8410034179688,1e-05,0.09024784713983536,2.454131841659546,23.927850246429443,3 +8980,0.2186514437198639,0.15036487579345703,0.14778029918670654,0.25006410479545593,888.3101196289062,1e-05,0.06680126488208771,2.3711206912994385,23.927850246429443,3 +8981,0.19668379426002502,0.15248435735702515,0.14558182656764984,0.22102563083171844,550.8948364257812,1e-05,0.08172976970672607,2.79196834564209,23.927850246429443,3 +8982,0.16584151983261108,0.09765452146530151,0.09886735677719116,0.15137819945812225,784.2772827148438,1e-05,0.08411359786987305,2.3677566051483154,23.927850246429443,3 +8983,0.22999358177185059,0.16388007998466492,0.17301341891288757,0.15067307651042938,627.4900512695312,1e-05,0.08447583019733429,2.3683998584747314,23.927850246429443,3 +8984,0.20754830539226532,0.1951029747724533,0.19282464683055878,0.22294871509075165,558.6282348632812,1e-05,0.07421875,2.3570752143859863,23.927850246429443,3 +8985,0.1681043952703476,0.2055724710226059,0.18561406433582306,0.29913461208343506,843.6281127929688,1e-05,0.07238725572824478,2.6704325675964355,23.927850246429443,3 +8986,0.24471069872379303,0.18556365370750427,0.18118956685066223,0.1877884566783905,986.50927734375,1e-05,0.07402429729700089,2.482168197631836,23.927850246429443,3 +8987,0.2486637532711029,0.5481929779052734,0.5717863440513611,0.182115375995636,125.89928436279297,1e-05,0.07964300364255905,2.348438024520874,23.927850246429443,3 +8988,0.13671676814556122,0.21959188580513,0.2178785800933838,0.2943589687347412,918.259033203125,1e-05,0.07940811663866043,2.348233699798584,23.927850246429443,3 +8989,0.17529155313968658,0.1495974212884903,0.14537718892097473,0.12054486572742462,957.39697265625,1e-05,0.07027431577444077,2.3532369136810303,23.927850246429443,3 +8990,0.1257350742816925,0.14765718579292297,0.15402042865753174,0.04615384340286255,846.7742309570312,1e-05,0.08514418452978134,2.350348949432373,23.927850246429443,3 +8991,0.2740795910358429,0.16791190207004547,0.15460579097270966,0.2986217737197876,877.9761962890625,1e-05,0.07463740557432175,2.5739660263061523,23.927850246429443,3 +8992,0.20393863320350647,0.25841766595840454,0.2564389109611511,0.13951922953128815,346.82080078125,1e-05,0.07978721708059311,2.5764389038085938,23.927850246429443,3 +8993,0.20430508255958557,0.16452106833457947,0.15949268639087677,0.21551281213760376,594.86376953125,1e-05,0.07176201045513153,2.3594279289245605,23.927850246429443,3 +8994,0.22372804582118988,0.13030549883842468,0.13248564302921295,0.23858973383903503,934.3434448242188,1e-05,0.08737228810787201,2.3486390113830566,23.927850246429443,3 +8995,0.21292677521705627,0.19017593562602997,0.1767307072877884,0.22692306339740753,691.9642944335938,1e-05,0.08456327766180038,2.529940366744995,23.927850246429443,3 +8996,0.18000386655330658,0.19672973453998566,0.18431976437568665,0.19737178087234497,907.7218017578125,1e-05,0.07170236110687256,2.595445394515991,23.927850246429443,3 +8997,0.21345840394496918,0.11677589267492294,0.11709887534379959,0.22499999403953552,589.323486328125,1e-05,0.07892251014709473,2.584205389022827,23.927850246429443,3 +8998,0.17566777765750885,0.2024749219417572,0.1903303563594818,0.2522435784339905,944.8242797851562,1e-05,0.08216097950935364,2.3524680137634277,23.927850246429443,3 +8999,0.21986564993858337,0.053264349699020386,0.058271683752536774,0.22330127656459808,495.1690979003906,1e-05,0.08481360226869583,2.3459410667419434,23.927850246429443,3 +9000,0.11608868837356567,0.09217895567417145,0.09552717953920364,0.12320512533187866,673.4317626953125,1e-05,0.06868484616279602,2.3491218090057373,23.927850246429443,3 +9001,0.2947019636631012,0.09528937935829163,0.09884286671876907,0.1466025561094284,892.8571166992188,1e-05,0.0925971195101738,2.4529576301574707,23.927850246429443,3 +9002,0.1573837250471115,0.08293403685092926,0.08665212988853455,0.05673076584935188,575.0540771484375,1e-05,0.07470991462469101,2.643986701965332,23.927850246429443,3 +9003,0.21309325098991394,0.08633655309677124,0.09787021577358246,0.24862179160118103,487.8049011230469,1e-05,0.06861589848995209,2.348353862762451,23.927850246429443,3 +9004,0.09919475018978119,0.16933315992355347,0.15582001209259033,0.19557692110538483,878.4185791015625,1e-05,0.0677100196480751,2.340222120285034,23.927850246429443,3 +9005,0.2576012909412384,0.385958731174469,0.37615469098091125,0.11596153676509857,137.90036010742188,1e-05,0.07981206476688385,2.344189405441284,23.927850246429443,3 +9006,0.08265797048807144,0.10157608985900879,0.10723304748535156,0.12256409972906113,881.919921875,1e-05,0.08179701119661331,2.73409104347229,23.927850246429443,3 +9007,0.23122833669185638,0.18368922173976898,0.1724357306957245,0.20999999344348907,867.5030517578125,1e-05,0.07615303993225098,2.3591058254241943,23.927850246429443,3 +9008,0.16935859620571136,0.2177520990371704,0.2261047661304474,0.23384614288806915,908.0963134765625,1e-05,0.07850389927625656,2.3518295288085938,23.927850246429443,3 +9009,0.31587833166122437,0.5598080158233643,0.6051034927368164,0.16124999523162842,105.31136322021484,1e-05,0.09306973963975906,2.3553669452667236,23.927850246429443,3 +9010,0.13587579131126404,0.15315741300582886,0.15838636457920074,0.19016024470329285,876.6427001953125,1e-05,0.09014039486646652,2.3564372062683105,23.927850246429443,3 +9011,0.17714771628379822,0.13250254094600677,0.13066811859607697,0.24833332002162933,711.2069091796875,1e-05,0.07702349126338959,2.358816623687744,23.927850246429443,3 +9012,0.05723521113395691,0.1251009851694107,0.12356239557266235,0.2499999850988388,873.4939575195312,1e-05,0.07259838283061981,2.489375114440918,23.927850246429443,3 +9013,0.14585641026496887,0.2109881490468979,0.1999640017747879,0.2743269205093384,836.6402587890625,1e-05,0.07295770943164825,2.516252279281616,23.927850246429443,3 +9014,0.2616870701313019,0.22155815362930298,0.21963666379451752,0.18842947483062744,978.9678955078125,1e-05,0.06832738220691681,2.363064765930176,23.927850246429443,3 +9015,0.1522025167942047,0.22616231441497803,0.21728196740150452,0.17044870555400848,964.3510131835938,1e-05,0.07716397941112518,2.355254650115967,23.927850246429443,3 +9016,0.21221594512462616,0.21004915237426758,0.20478323101997375,0.2835897207260132,979.2027587890625,1e-05,0.07409298419952393,2.5303192138671875,23.927850246429443,3 +9017,0.25845348834991455,0.12486684322357178,0.13605305552482605,0.23576922714710236,784.97021484375,1e-05,0.0640462189912796,2.488900899887085,23.927850246429443,3 +9018,0.23595157265663147,0.17733316123485565,0.17389915883541107,0.22692306339740753,622.4899291992188,1e-05,0.07501918077468872,2.3519861698150635,23.927850246429443,3 +9019,0.20584312081336975,0.11429447680711746,0.10969441384077072,0.20490384101867676,827.1312866210938,1e-05,0.0788460448384285,2.352851629257202,23.927850246429443,3 +9020,0.30414271354675293,0.1465202122926712,0.1557251662015915,0.1619551181793213,600.3118286132812,1e-05,0.07608307898044586,2.3504393100738525,23.927850246429443,3 +9021,0.21396256983280182,0.13237513601779938,0.12954756617546082,0.12833333015441895,789.7643432617188,1e-05,0.07131633907556534,2.347074508666992,23.927850246429443,3 +9022,0.1709597110748291,0.06863732635974884,0.07337004691362381,0.10746794193983078,754.75439453125,1e-05,0.07630079984664917,2.3466672897338867,23.927850246429443,3 +9023,0.2705773115158081,0.14820623397827148,0.14791861176490784,0.1959935873746872,821.3306274414062,1e-05,0.07522376626729965,2.756972551345825,23.927850246429443,3 +9024,0.08611436933279037,0.23865361511707306,0.22248892486095428,0.22942306101322174,957.39697265625,1e-05,0.06601256877183914,2.3624181747436523,23.927850246429443,3 +9025,0.2327214479446411,0.17241482436656952,0.17277902364730835,0.303846150636673,952.09716796875,1e-05,0.06151987239718437,2.3469481468200684,23.927850246429443,3 +9026,0.22278770804405212,0.19054459035396576,0.18409380316734314,0.18868589401245117,580.8350830078125,1e-05,0.0841774046421051,2.3452060222625732,23.927850246429443,3 +9027,0.1347818672657013,0.12418463081121445,0.12829433381557465,0.22240383923053741,901.2276611328125,1e-05,0.06450781971216202,2.557511329650879,23.927850246429443,3 +9028,0.24000273644924164,0.15951602160930634,0.15685279667377472,0.24868588149547577,918.259033203125,1e-05,0.07975570112466812,2.4721550941467285,23.927850246429443,3 +9029,0.16042672097682953,0.22354216873645782,0.21707724034786224,0.2391025573015213,746.7793579101562,1e-05,0.06273674964904785,2.3511147499084473,23.927850246429443,3 +9030,0.2601228654384613,0.17376159131526947,0.16299569606781006,0.2716987133026123,871.2120971679688,1e-05,0.06917362660169601,2.3451480865478516,23.927850246429443,3 +9031,0.15400967001914978,0.1996326744556427,0.20106972754001617,0.20855768024921417,938.1237182617188,1e-05,0.07412461191415787,2.347851037979126,23.927850246429443,3 +9032,0.20345914363861084,0.15350954234600067,0.15927475690841675,0.23342947661876678,915.4175415039062,1e-05,0.06650805473327637,2.348454713821411,23.927850246429443,3 +9033,0.1424841731786728,0.11592480540275574,0.11623778194189072,0.1755448579788208,804.8433837890625,1e-05,0.07897139340639114,2.477391481399536,23.927850246429443,3 +9034,0.16557490825653076,0.17971381545066833,0.18027757108211517,0.24413460493087769,968.974853515625,1e-05,0.0719274953007698,2.74342679977417,23.927850246429443,3 +9035,0.22916729748249054,0.17902888357639313,0.18472886085510254,0.2127884477376938,605.6701049804688,1e-05,0.0776788592338562,2.352520227432251,23.927850246429443,3 +9036,0.24961623549461365,0.14348956942558289,0.14279571175575256,0.2773076891899109,748.3948974609375,1e-05,0.07284925878047943,2.3429932594299316,23.927850246429443,3 +9037,0.18489289283752441,0.20920205116271973,0.20556089282035828,0.22833332419395447,939.9801635742188,1e-05,0.076262466609478,2.3399593830108643,23.927850246429443,3 +9038,0.2557723820209503,0.13851779699325562,0.13543462753295898,0.1615705043077469,587.923828125,1e-05,0.06207067891955376,2.628459930419922,23.927850246429443,3 +9039,0.2456527054309845,0.17762428522109985,0.17892397940158844,0.21086537837982178,533.2568969726562,1e-05,0.06365048885345459,2.508383274078369,23.927850246429443,3 +9040,0.22393450140953064,0.5371860265731812,0.5874965190887451,0.20855768024921417,79.58802795410156,1e-05,0.07408072799444199,2.3526322841644287,23.927850246429443,3 +9041,0.2625667154788971,0.12302917242050171,0.12060435861349106,0.24733974039554596,804.208251953125,1e-05,0.06596488505601883,2.352079153060913,23.927850246429443,3 +9042,0.2822103202342987,0.29257938265800476,0.29806023836135864,0.19833332300186157,341.5697937011719,1e-05,0.06858398020267487,2.3491673469543457,23.927850246429443,3 +9043,0.15884745121002197,0.17369674146175385,0.16804078221321106,0.23570512235164642,767.0015869140625,1e-05,0.061188023537397385,2.3487327098846436,23.927850246429443,3 +9044,0.18300458788871765,0.16581344604492188,0.15769493579864502,0.2169230729341507,779.3674926757812,1e-05,0.083768330514431,2.7837486267089844,23.927850246429443,3 +9045,0.1248219907283783,0.14022360742092133,0.12955349683761597,0.22596153616905212,851.9107666015625,1e-05,0.062210630625486374,2.3541135787963867,23.927850246429443,3 +9046,0.1636543571949005,0.35088256001472473,0.3445337414741516,0.23253203928470612,518.14990234375,1e-05,0.1260099709033966,2.3448750972747803,23.927850246429443,3 +9047,0.2850154638290405,0.272948682308197,0.27167460322380066,0.2655448615550995,990.87890625,1e-05,0.10196958482265472,2.343716859817505,23.927850246429443,3 +9048,0.10736406594514847,0.21713930368423462,0.1975056529045105,0.21717947721481323,898.0855712890625,1e-05,0.07332143932580948,2.502045154571533,23.927850246429443,3 +9049,0.38197067379951477,0.23239190876483917,0.22980572283267975,0.12862178683280945,314.37127685546875,1e-05,0.07537104934453964,2.6999640464782715,23.927850246429443,3 +9050,0.10177231580018997,0.34544262290000916,0.334242582321167,0.26907050609588623,978.7327270507812,1e-05,0.06368052959442139,2.3663792610168457,23.927850246429443,3 +9051,0.10963580012321472,0.12562310695648193,0.11531583964824677,0.21048076450824738,883.6459350585938,1e-05,0.07267428934574127,2.344144344329834,23.927850246429443,3 +9052,0.26983144879341125,0.14731402695178986,0.14844144880771637,0.20474357903003693,866.0933227539062,1e-05,0.08885365724563599,2.354883909225464,23.927850246429443,3 +9053,0.1419188678264618,0.15223613381385803,0.1495051234960556,0.16105768084526062,894.8863525390625,1e-05,0.10265287011861801,2.347257375717163,23.927850246429443,3 +9054,0.22483912110328674,0.2368798404932022,0.22686219215393066,0.21387819945812225,933.3839721679688,1e-05,0.0732281357049942,2.3503472805023193,23.927850246429443,3 +9055,0.30547869205474854,0.1820002794265747,0.1710517257452011,0.2658012807369232,927.8350219726562,1e-05,0.13141334056854248,2.826686382293701,23.927850246429443,3 +9056,0.13438357412815094,0.11313993483781815,0.1152624785900116,0.2672435939311981,774.3531494140625,1e-05,0.06612227112054825,2.355912923812866,23.927850246429443,3 +9057,0.2168257236480713,0.3586350381374359,0.3651348650455475,0.15862178802490234,245.17686462402344,1e-05,0.06972814351320267,2.351357936859131,23.927850246429443,3 +9058,0.26561179757118225,0.14459608495235443,0.13855870068073273,0.19948717951774597,943.62744140625,1e-05,0.08506482094526291,2.344599962234497,23.927850246429443,3 +9059,0.2664914131164551,0.22177505493164062,0.2028847187757492,0.22221152484416962,938.4346313476562,1e-05,0.0722462460398674,2.5113720893859863,23.927850246429443,3 +9060,0.2096351683139801,0.3095332682132721,0.3086930215358734,0.3077884614467621,330.88238525390625,1e-05,0.07261386513710022,2.584258556365967,23.927850246429443,3 +9061,0.13038969039916992,0.17086361348628998,0.16459842026233673,0.1790063977241516,657.0208740234375,1e-05,0.05598386377096176,2.35897159576416,23.927850246429443,3 +9062,0.32790014147758484,0.218802809715271,0.21499626338481903,0.09759615361690521,783.5821533203125,1e-05,0.07206045091152191,2.348369836807251,23.927850246429443,3 +9063,0.1690075397491455,0.2959579527378082,0.29143404960632324,0.24996793270111084,311.56158447265625,1e-05,0.08152920007705688,2.3640551567077637,23.927850246429443,3 +9064,0.2701548933982849,0.353194922208786,0.356086790561676,0.23198717832565308,248.39744567871094,1e-05,0.07553590089082718,2.347838878631592,23.927850246429443,3 +9065,0.24253100156784058,0.1402854472398758,0.13340459764003754,0.19105768203735352,924.81787109375,1e-05,0.06482567638158798,2.7600302696228027,23.927850246429443,3 +9066,0.22094571590423584,0.2834963798522949,0.29045969247817993,0.22285255789756775,270.376220703125,1e-05,0.0690985769033432,2.5802972316741943,23.927850246429443,3 +9067,0.16523005068302155,0.20652441680431366,0.20237553119659424,0.2822115421295166,959.8422241210938,1e-05,0.06706101447343826,2.354313373565674,23.927850246429443,3 +9068,0.24916088581085205,0.09757199138402939,0.09728448837995529,0.14608973264694214,892.0389404296875,1e-05,0.06988312304019928,2.345191478729248,23.927850246429443,3 +9069,0.21752223372459412,0.15608514845371246,0.15157271921634674,0.15647435188293457,938.1237182617188,1e-05,0.0647783949971199,2.3442885875701904,23.927850246429443,3 +9070,0.1644386500120163,0.22884142398834229,0.21892061829566956,0.2510897219181061,956.2970581054688,1e-05,0.07482322305440903,2.629526138305664,23.927850246429443,3 +9071,0.17696481943130493,0.18310147523880005,0.16780254244804382,0.20503205060958862,734.3234252929688,1e-05,0.06174585968255997,2.4779584407806396,23.927850246429443,3 +9072,0.23910541832447052,0.13726533949375153,0.145797461271286,0.20580127835273743,526.620361328125,1e-05,0.07582969963550568,2.3494207859039307,23.927850246429443,3 +9073,0.1877431720495224,0.15818816423416138,0.15400363504886627,0.18676280975341797,567.685546875,1e-05,0.07367599755525589,2.3475966453552246,23.927850246429443,3 +9074,0.07523838430643082,0.2966654896736145,0.30262938141822815,0.2474038302898407,990.448486328125,1e-05,0.058904197067022324,2.3496973514556885,23.927850246429443,3 +9075,0.1341506838798523,0.1267872154712677,0.14018534123897552,0.2583974301815033,496.98797607421875,1e-05,0.06299717724323273,2.350290060043335,23.927850246429443,3 +9076,0.2350066900253296,0.19970053434371948,0.200967937707901,0.21657051146030426,509.47869873046875,1e-05,0.0737733319401741,2.6999380588531494,23.927850246429443,3 +9077,0.2564941644668579,0.14774669706821442,0.15656311810016632,0.1586538404226303,937.8121948242188,1e-05,0.07892958074808121,2.3560519218444824,23.927850246429443,3 +9078,0.17035137116909027,0.13696585595607758,0.13156713545322418,0.25826922059059143,830.5369873046875,1e-05,0.06592792272567749,2.351017713546753,23.927850246429443,3 +9079,0.2568821907043457,0.16262157261371613,0.16010507941246033,0.1675320416688919,852.4172973632812,1e-05,0.06926035135984421,2.3597521781921387,23.927850246429443,3 +9080,0.18442855775356293,0.23841413855552673,0.24060246348381042,0.2040064036846161,998.18701171875,1e-05,0.06685303151607513,2.5331099033355713,23.927850246429443,3 +9081,0.11214057356119156,0.16478092968463898,0.15990474820137024,0.1741025596857071,929.4871826171875,1e-05,0.07339604198932648,2.4861128330230713,23.927850246429443,3 +9082,0.11958441138267517,0.14261433482170105,0.14267678558826447,0.26759615540504456,742.69482421875,1e-05,0.07688327878713608,2.6154284477233887,23.927850246429443,3 +9083,0.07462013512849808,0.20656941831111908,0.213302344083786,0.18676280975341797,980.6033935546875,1e-05,0.061995185911655426,2.353142738342285,23.927850246429443,3 +9084,0.14740560948848724,0.1952366679906845,0.17711098492145538,0.20673076808452606,909.9564819335938,1e-05,0.0728977844119072,2.3540306091308594,23.927850246429443,3 +9085,0.11900721490383148,0.13524502515792847,0.13863329589366913,0.2658974230289459,586.51806640625,1e-05,0.07447418570518494,2.35006046295166,23.927850246429443,3 +9086,0.3095378279685974,0.6115050911903381,0.6116645932197571,0.17913460731506348,153.50877380371094,1e-05,0.07396864891052246,2.613065004348755,23.927850246429443,3 +9087,0.34632641077041626,0.44633859395980835,0.44395408034324646,0.2609935700893402,190.67796325683594,1e-05,0.07157232612371445,2.5441548824310303,23.927850246429443,3 +9088,0.21177950501441956,0.09709861874580383,0.09894801676273346,0.26695510745048523,866.564453125,1e-05,0.07135188579559326,2.353679656982422,23.927850246429443,3 +9089,0.17988929152488708,0.17849238216876984,0.18297429382801056,0.1652243584394455,815.3685913085938,1e-05,0.06922253221273422,2.349579334259033,23.927850246429443,3 +9090,0.16426077485084534,0.14116477966308594,0.14327611029148102,0.2910897433757782,634.842529296875,1e-05,0.06736201047897339,2.3500757217407227,23.927850246429443,3 +9091,0.2631092965602875,0.15067727863788605,0.16194945573806763,0.2869230806827545,485.94134521484375,1e-05,0.08755151182413101,2.62483549118042,23.927850246429443,3 +9092,0.19903238117694855,0.1096898764371872,0.10937701165676117,0.009615384042263031,651.3410034179688,1e-05,0.07328663766384125,2.518148183822632,23.927850246429443,3 +9093,0.20505648851394653,0.22848211228847504,0.2226881980895996,0.2201922982931137,874.8499145507812,1e-05,0.06640253216028214,2.356520891189575,23.927850246429443,3 +9094,0.2118983119726181,0.272756963968277,0.25446414947509766,0.23974357545375824,966.6818237304688,1e-05,0.0673123151063919,2.345771074295044,23.927850246429443,3 +9095,0.2939039468765259,0.3997045159339905,0.39206212759017944,0.25391024351119995,314.37127685546875,1e-05,0.07705006003379822,2.3412024974823,23.927850246429443,3 +9096,0.22055023908615112,0.26576489210128784,0.2715306878089905,0.25083333253860474,267.29559326171875,1e-05,0.06296945363283157,2.651914119720459,23.927850246429443,3 +9097,0.19453485310077667,0.186935693025589,0.18413761258125305,0.18230769038200378,931.447509765625,1e-05,0.06774412095546722,2.615791082382202,23.927850246429443,3 +9098,0.27079442143440247,0.18320800364017487,0.17094548046588898,0.2039102464914322,664.7939453125,1e-05,0.06734944880008698,2.3518340587615967,23.927850246429443,3 +9099,0.20729823410511017,0.20573002099990845,0.19210553169250488,0.228589728474617,955.188720703125,1e-05,0.07105565816164017,2.3505749702453613,23.927850246429443,3 +9100,0.1718543916940689,0.17680874466896057,0.174542635679245,0.24551281332969666,879.3001098632812,1e-05,0.06822362542152405,2.345700979232788,23.927850246429443,3 +9101,0.22773940861225128,0.1729220598936081,0.16620217263698578,0.12455127388238907,849.8719482421875,1e-05,0.06634989380836487,2.348466396331787,23.927850246429443,3 +9102,0.2187047004699707,0.2756391167640686,0.2951536178588867,0.21038460731506348,238.6731414794922,1e-05,0.07229610532522202,2.5196568965911865,23.927850246429443,3 +9103,0.21492065489292145,0.17213360965251923,0.1671553999185562,0.2056410163640976,910.6948852539062,1e-05,0.07389393448829651,2.502258777618408,23.927850246429443,3 +9104,0.13979612290859222,0.16037945449352264,0.160513773560524,0.274487167596817,905.8369750976562,1e-05,0.06540291011333466,2.3597655296325684,23.927850246429443,3 +9105,0.11618785560131073,0.17139632999897003,0.15919198095798492,0.2556730806827545,972.4690551757812,1e-05,0.07011143863201141,2.348700761795044,23.927850246429443,3 +9106,0.20143310725688934,0.14882782101631165,0.1355644166469574,0.2519551217556,777.9456176757812,1e-05,0.07502757757902145,2.353830575942993,23.927850246429443,3 +9107,0.20685051381587982,0.39985203742980957,0.3779008984565735,0.1998397409915924,990.448486328125,1e-05,0.07780962437391281,2.555377721786499,23.927850246429443,3 +9108,0.12565374374389648,0.2310570329427719,0.22196169197559357,0.1890384554862976,946.896240234375,1e-05,0.06054883822798729,2.5839786529541016,23.927850246429443,3 +9109,0.2735622823238373,0.19032686948776245,0.18996112048625946,0.2273397296667099,679.7445678710938,1e-05,0.09220883250236511,2.3613128662109375,23.927850246429443,3 +9110,0.26935142278671265,0.26085856556892395,0.2557896077632904,0.2404487133026123,629.9603271484375,1e-05,0.07235492020845413,2.357564926147461,23.927850246429443,3 +9111,0.25463372468948364,0.29674461483955383,0.2902320623397827,0.23499998450279236,981.7597045898438,1e-05,0.08025886118412018,2.3585333824157715,23.927850246429443,3 +9112,0.18476979434490204,0.17225223779678345,0.16944563388824463,0.20298075675964355,920.7059936523438,1e-05,0.07997262477874756,2.6578893661499023,23.927850246429443,3 +9113,0.27700912952423096,0.19941481947898865,0.1917872279882431,0.2538782060146332,843.6281127929688,1e-05,0.07661614567041397,2.4989118576049805,23.927850246429443,3 +9114,0.150746151804924,0.15053881704807281,0.14158378541469574,0.17387819290161133,807.9915161132812,1e-05,0.06695359945297241,2.368818521499634,23.927850246429443,3 +9115,0.16605612635612488,0.46242934465408325,0.4481779932975769,0.21298076212406158,179.79454040527344,1e-05,0.07361961901187897,2.347022533416748,23.927850246429443,3 +9116,0.12921860814094543,0.3046132028102875,0.2924008369445801,0.23230768740177155,972.4690551757812,1e-05,0.06970658898353577,2.352921485900879,23.927850246429443,3 +9117,0.20906168222427368,0.13027070462703705,0.1365031898021698,0.30320510268211365,777.9456176757812,1e-05,0.06022214889526367,2.352816581726074,23.927850246429443,3 +9118,0.18651697039604187,0.1532917320728302,0.15816353261470795,0.26980769634246826,650.1919555664062,1e-05,0.07266687601804733,2.6417040824890137,23.927850246429443,3 +9119,0.09374727308750153,0.33279046416282654,0.3306736946105957,0.23124998807907104,982.677490234375,1e-05,0.06394810974597931,2.5399129390716553,23.927850246429443,3 +9120,0.1622583568096161,0.16348768770694733,0.16388806700706482,0.2113140970468521,873.947021484375,1e-05,0.07191697508096695,2.3495960235595703,23.927850246429443,3 +9121,0.27677950263023376,0.22526034712791443,0.22892732918262482,0.27041664719581604,414.4384765625,1e-05,0.09194265305995941,2.3443210124969482,23.927850246429443,3 +9122,0.3075014650821686,0.23253284394741058,0.21919600665569305,0.15548075735569,659.2627563476562,1e-05,0.07670464366674423,2.3556370735168457,23.927850246429443,3 +9123,0.21145185828208923,0.20884478092193604,0.20299191772937775,0.2305128127336502,680.7832641601562,1e-05,0.06906048953533173,2.6644973754882812,23.927850246429443,3 +9124,0.2729732096195221,0.11514467746019363,0.1136680543422699,0.26971152424812317,872.5845947265625,1e-05,0.07772331684827805,2.5791678428649902,23.927850246429443,3 +9125,0.23694869875907898,0.18865327537059784,0.18710027635097504,0.2614743411540985,859.375,1e-05,0.07250548899173737,2.36000919342041,23.927850246429443,3 +9126,0.16173826158046722,0.21267320215702057,0.21240538358688354,0.2542628049850464,448.71795654296875,1e-05,0.07242436707019806,2.35111927986145,23.927850246429443,3 +9127,0.20011897385120392,0.1814567893743515,0.1852162778377533,0.1961858868598938,740.2120361328125,1e-05,0.07615179568529129,2.3513386249542236,23.927850246429443,3 +9128,0.2366861253976822,0.2101556360721588,0.20274178683757782,0.22929486632347107,730.8970947265625,1e-05,0.08414900302886963,2.5789217948913574,23.927850246429443,3 +9129,0.2547224760055542,0.8171203136444092,0.8187768459320068,0.20080126821994781,92.59259796142578,1e-05,0.05374683812260628,2.5514307022094727,23.927850246429443,3 +9130,0.13932307064533234,0.23871475458145142,0.23810230195522308,0.28913459181785583,891.62841796875,1e-05,0.07500223815441132,2.4715418815612793,23.927850246429443,3 +9131,0.12096276879310608,0.30322903394699097,0.2946804463863373,0.23336537182331085,981.5291137695312,1e-05,0.06707865744829178,2.3483808040618896,23.927850246429443,3 +9132,0.17441953718662262,0.10611895471811295,0.11643847078084946,0.17368589341640472,971.9750366210938,1e-05,0.06967201828956604,2.3504903316497803,23.927850246429443,3 +9133,0.16183263063430786,0.13292375206947327,0.1335807889699936,0.2190384566783905,830.5369873046875,1e-05,0.0737222209572792,2.352994203567505,23.927850246429443,3 +9134,0.28608617186546326,0.19054938852787018,0.20101132988929749,0.2400640994310379,462.8463439941406,1e-05,0.0811939388513565,2.592700958251953,23.927850246429443,3 +9135,0.2832874655723572,0.2481115609407425,0.23840650916099548,0.23387819528579712,563.1868286132812,1e-05,0.06847385317087173,2.548527240753174,23.927850246429443,3 +9136,0.12082453817129135,0.2361777126789093,0.2286890298128128,0.14233973622322083,996.7586059570312,1e-05,0.06779352575540543,2.3675880432128906,23.927850246429443,3 +9137,0.16004884243011475,0.3851405382156372,0.36362403631210327,0.2630448639392853,1000.0,1e-05,0.06283518671989441,2.359788179397583,23.927850246429443,3 +9138,0.23764589428901672,0.11532089114189148,0.12236297875642776,0.18057692050933838,838.2740478515625,1e-05,0.07135984301567078,2.3752973079681396,23.927850246429443,3 +9139,0.19700700044631958,0.09114004671573639,0.09045076370239258,0.16846153140068054,879.3001098632812,1e-05,0.06565577536821365,2.4827866554260254,23.927850246429443,3 +9140,0.19373181462287903,0.3112834692001343,0.3035557270050049,0.23916666209697723,625.0,1e-05,0.06495792418718338,2.569112777709961,23.927850246429443,3 +9141,0.30686500668525696,0.16060198843479156,0.16205935180187225,0.20993588864803314,798.4103393554688,1e-05,0.0726023018360138,2.3593075275421143,23.927850246429443,3 +9142,0.1892947107553482,0.11823592334985733,0.11133617907762527,0.22006408870220184,909.5860595703125,1e-05,0.06825193762779236,2.3506393432617188,23.927850246429443,3 +9143,0.1449795514345169,0.25585222244262695,0.2472049444913864,0.17778845131397247,803.5714111328125,1e-05,0.06300058215856552,2.3504116535186768,23.927850246429443,3 +9144,0.22764252126216888,0.18312880396842957,0.16933463513851166,0.2096794843673706,892.0389404296875,1e-05,0.07040237635374069,2.5698440074920654,23.927850246429443,3 +9145,0.23681312799453735,0.10702864825725555,0.1095023974776268,0.1623397320508957,636.0511474609375,1e-05,0.06446130573749542,2.4909474849700928,23.927850246429443,3 +9146,0.1934996396303177,0.15353310108184814,0.1638992428779602,0.16224358975887299,838.2740478515625,1e-05,0.07500240206718445,2.3539488315582275,23.927850246429443,3 +9147,0.17351609468460083,0.19988659024238586,0.18749558925628662,0.14983974397182465,924.1397094726562,1e-05,0.06360698491334915,2.349261522293091,23.927850246429443,3 +9148,0.17090214788913727,0.2540340721607208,0.2552705705165863,0.2269551157951355,405.4053955078125,1e-05,0.06490617990493774,2.352494716644287,23.927850246429443,3 +9149,0.2770197093486786,0.28574442863464355,0.2791430950164795,0.22596153616905212,491.5048522949219,1e-05,0.07449556887149811,2.3548059463500977,23.927850246429443,3 +9150,0.17221008241176605,0.1295899748802185,0.14102262258529663,0.23695512115955353,971.9750366210938,1e-05,0.0629485696554184,2.7563886642456055,23.927850246429443,3 +9151,0.20710758864879608,0.16220210492610931,0.1697402447462082,0.2184615284204483,948.9403076171875,1e-05,0.0641445517539978,2.5355541706085205,23.927850246429443,3 +9152,0.22360706329345703,0.14448851346969604,0.13835084438323975,0.09730768948793411,753.1796264648438,1e-05,0.06844807416200638,2.3544270992279053,23.927850246429443,3 +9153,0.178342804312706,0.252666711807251,0.24571259319782257,0.15948717296123505,998.3897094726562,1e-05,0.07254218310117722,2.3450710773468018,23.927850246429443,3 +9154,0.15423382818698883,0.13040536642074585,0.1270749270915985,0.2385256290435791,878.85986328125,1e-05,0.06942012906074524,2.348237991333008,23.927850246429443,3 +9155,0.15870316326618195,0.15046268701553345,0.14016801118850708,0.23461537063121796,904.6961059570312,1e-05,0.060615040361881256,2.590944766998291,23.927850246429443,3 +9156,0.2989915609359741,0.15194368362426758,0.15162190794944763,0.11006409674882889,557.0953369140625,1e-05,0.070435531437397,2.4761478900909424,23.927850246429443,3 +9157,0.17640939354896545,0.16339200735092163,0.15686273574829102,0.22615383565425873,719.4397583007812,1e-05,0.06024307385087013,2.3507802486419678,23.927850246429443,3 +9158,0.2125130295753479,0.19773899018764496,0.1931072175502777,0.23339742422103882,741.0423583984375,1e-05,0.0674564465880394,2.3541014194488525,23.927850246429443,3 +9159,0.24242138862609863,0.18725766241550446,0.18713583052158356,0.3029807507991791,757.0978393554688,1e-05,0.07339194416999817,2.3468716144561768,23.927850246429443,3 +9160,0.16552375257015228,0.14080914855003357,0.13929365575313568,0.20557691156864166,589.323486328125,1e-05,0.05992458388209343,2.4769809246063232,23.927850246429443,3 +9161,0.11184239387512207,0.3743041157722473,0.36922651529312134,0.22499999403953552,977.3124389648438,1e-05,0.05678905174136162,2.551034688949585,23.927850246429443,3 +9162,0.15627042949199677,0.10750235617160797,0.10270991921424866,0.25044870376586914,936.5596923828125,1e-05,0.07615197449922562,2.348121404647827,23.927850246429443,3 +9163,0.14099781215190887,0.22360742092132568,0.2145857959985733,0.22749999165534973,996.3473510742188,1e-05,0.067701056599617,2.34716796875,23.927850246429443,3 +9164,0.2264438420534134,0.3094404637813568,0.3096909523010254,0.23897434771060944,294.342529296875,1e-05,0.07875538617372513,2.363192081451416,23.927850246429443,3 +9165,0.15061505138874054,0.2039071023464203,0.1872585266828537,0.2309935837984085,820.7417602539062,1e-05,0.08981591463088989,2.520260810852051,23.927850246429443,3 +9166,0.297254741191864,0.13920527696609497,0.14767850935459137,0.23865383863449097,830.5369873046875,1e-05,0.07692229002714157,2.4769768714904785,23.927850246429443,3 +9167,0.17007023096084595,0.35801225900650024,0.3398726284503937,0.16256409883499146,993.2210693359375,1e-05,0.08285395801067352,2.5045394897460938,23.927850246429443,3 +9168,0.10154375433921814,0.29231953620910645,0.28902730345726013,0.20346152782440186,992.1616821289062,1e-05,0.057858049869537354,2.347918748855591,23.927850246429443,3 +9169,0.17709606885910034,0.18147246539592743,0.17247575521469116,0.2530769109725952,806.1080322265625,1e-05,0.06400226801633835,2.3452954292297363,23.927850246429443,3 +9170,0.16126501560211182,0.17129011452198029,0.173427551984787,0.19301281869411469,967.4503784179688,1e-05,0.06601759791374207,2.348585844039917,23.927850246429443,3 +9171,0.22389981150627136,0.30456534028053284,0.28825804591178894,0.1983974277973175,984.94482421875,1e-05,0.06478801369667053,2.5690479278564453,23.927850246429443,3 +9172,0.2224201261997223,0.212192103266716,0.2029356062412262,0.14493589103221893,956.0206298828125,1e-05,0.06627745926380157,2.485059976577759,23.927850246429443,3 +9173,0.10134367644786835,0.2612856328487396,0.24762573838233948,0.2548397481441498,973.2064208984375,1e-05,0.07065723091363907,2.3489365577697754,23.927850246429443,3 +9174,0.18127292394638062,0.22935134172439575,0.22896571457386017,0.18022435903549194,996.7586059570312,1e-05,0.06842068582773209,2.344956159591675,23.927850246429443,3 +9175,0.10368369519710541,0.18364308774471283,0.17250651121139526,0.2513461410999298,850.3836669921875,1e-05,0.058889903128147125,2.5446436405181885,23.927850246429443,3 +9176,0.23694069683551788,0.23492880165576935,0.21846719086170197,0.28439101576805115,961.9814453125,1e-05,0.08444826304912567,2.517307996749878,23.927850246429443,3 +9177,0.21562087535858154,0.19135630130767822,0.1835727095603943,0.23307691514492035,817.7731323242188,1e-05,0.07442336529493332,2.372785806655884,23.927850246429443,3 +9178,0.22292284667491913,0.21235278248786926,0.21603937447071075,0.28775641322135925,468.75,1e-05,0.06942321360111237,2.5158774852752686,23.927850246429443,3 +9179,0.16724418103694916,0.07904689013957977,0.08913525193929672,0.25371792912483215,928.1668090820312,1e-05,0.06727779656648636,2.3526599407196045,23.927850246429443,3 +9180,0.24608559906482697,0.40472862124443054,0.41021838784217834,0.23358973860740662,211.79405212402344,1e-05,0.06751647591590881,2.351979970932007,23.927850246429443,3 +9181,0.15665572881698608,0.08660019189119339,0.09220050275325775,0.24298076331615448,827.1312866210938,1e-05,0.07827388495206833,2.3533318042755127,23.927850246429443,3 +9182,0.21090035140514374,0.22610126435756683,0.21559524536132812,0.25064101815223694,983.1340942382812,1e-05,0.07090781629085541,2.726872682571411,23.927850246429443,3 +9183,0.16362537443637848,0.23384910821914673,0.2332044541835785,0.19554486870765686,993.4319458007812,1e-05,0.07046560198068619,2.359830379486084,23.927850246429443,3 +9184,0.1410694718360901,0.279852032661438,0.26799920201301575,0.2632051110267639,948.3590698242188,1e-05,0.06058904901146889,2.3501617908477783,23.927850246429443,3 +9185,0.15993906557559967,0.14897671341896057,0.15257464349269867,0.1883653849363327,852.4172973632812,1e-05,0.07007695734500885,2.349499225616455,23.927850246429443,3 +9186,0.2456662952899933,0.3195793628692627,0.3123018145561218,0.23362179100513458,381.9444580078125,1e-05,0.08061341941356659,2.503620147705078,23.927850246429443,3 +9187,0.27489444613456726,0.14185643196105957,0.1424832046031952,0.23724357783794403,836.0927734375,1e-05,0.07584019005298615,2.480886936187744,23.927850246429443,3 +9188,0.2023715376853943,0.19523614645004272,0.21375206112861633,0.18820512294769287,311.56158447265625,1e-05,0.07385872304439545,2.4717822074890137,23.927850246429443,3 +9189,0.1304684281349182,0.2124967724084854,0.2173304408788681,0.14051280915737152,977.5501098632812,1e-05,0.07617093622684479,2.353563070297241,23.927850246429443,3 +9190,0.22536887228488922,0.21357357501983643,0.21102920174598694,0.1810256391763687,735.1730346679688,1e-05,0.07280652225017548,2.348360061645508,23.927850246429443,3 +9191,0.23283518850803375,0.16841208934783936,0.16727951169013977,0.238621786236763,694.9378051757812,1e-05,0.07684695720672607,2.345731735229492,23.927850246429443,3 +9192,0.19157478213310242,0.37559548020362854,0.34763219952583313,0.15160255134105682,985.6176147460938,1e-05,0.06838368624448776,2.540870428085327,23.927850246429443,3 +9193,0.2302136868238449,0.17427842319011688,0.17250396311283112,0.22336538136005402,583.6886596679688,1e-05,0.06447790563106537,2.6986300945281982,23.927850246429443,3 +9194,0.2661856710910797,0.13829821348190308,0.14007793366909027,0.14910255372524261,881.0508422851562,1e-05,0.10010067373514175,2.3684232234954834,23.927850246429443,3 +9195,0.19623973965644836,0.33393996953964233,0.33678483963012695,0.23131409287452698,294.342529296875,1e-05,0.07720126956701279,2.3462026119232178,23.927850246429443,3 +9196,0.2410886436700821,0.11644387990236282,0.11079243570566177,0.23721152544021606,937.5,1e-05,0.07144128531217575,2.6005306243896484,23.927850246429443,3 +9197,0.1661364585161209,0.18447713553905487,0.17167896032333374,0.2295512706041336,949.5192260742188,1e-05,0.06703788787126541,2.3783063888549805,23.927850246429443,3 +9198,0.1873933970928192,0.31698450446128845,0.30892422795295715,0.22423076629638672,991.7354736328125,1e-05,0.06349408626556396,3.9059805870056152,23.927850246429443,3 +9199,0.2284032553434372,0.1868513822555542,0.18928973376750946,0.22227562963962555,726.5493774414062,1e-05,0.06814923882484436,3.864426374435425,23.927850246429443,3 +9200,0.2793753445148468,0.16618476808071136,0.1652146726846695,0.21939101815223694,668.0632934570312,1e-05,0.0870690867304802,2.685725450515747,23.927850246429443,3 +9201,0.3297179937362671,0.22931961715221405,0.22066959738731384,0.20836538076400757,764.7515258789062,1e-05,0.07122068852186203,3.437913656234741,23.927850246429443,3 +9202,0.17321687936782837,0.22546595335006714,0.219875305891037,0.25621792674064636,808.6157836914062,1e-05,0.06914225220680237,3.5934038162231445,23.927850246429443,3 +9203,0.16192243993282318,0.20620211958885193,0.19587302207946777,0.2526282072067261,878.4185791015625,1e-05,0.07625024020671844,5.31176233291626,23.927850246429443,3 +9204,0.11206550896167755,0.1682710200548172,0.1601867973804474,0.25041666626930237,928.1668090820312,1e-05,0.06922878324985504,2.9967079162597656,23.927850246429443,3 +9205,0.14797604084014893,0.16542552411556244,0.1661394238471985,0.25663459300994873,833.8881225585938,1e-05,0.0728188306093216,2.3890490531921387,23.927850246429443,3 +9206,0.3365408480167389,0.15206503868103027,0.15117475390434265,0.22092947363853455,836.0927734375,1e-05,0.1366027593612671,3.0656018257141113,23.927850246429443,3 +9207,0.19535104930400848,0.14742298424243927,0.14487123489379883,0.2149999886751175,763.9968872070312,1e-05,0.07485885173082352,3.1186699867248535,23.927850246429443,3 +9208,0.15760578215122223,0.173692524433136,0.17226001620292664,0.17166666686534882,663.6961059570312,1e-05,0.06980441510677338,4.256110906600952,23.927850246429443,3 +9209,0.32329070568084717,0.29580098390579224,0.29284656047821045,0.20435896515846252,981.7597045898438,1e-05,0.11601037532091141,3.3263943195343018,23.927850246429443,3 +9210,0.2369522750377655,0.14837214350700378,0.13943353295326233,0.24650640785694122,757.0978393554688,1e-05,0.09271489828824997,2.61209774017334,23.927850246429443,3 +9211,0.25913000106811523,0.20896634459495544,0.2089112102985382,0.22442306578159332,979.9048461914062,1e-05,0.07841011881828308,3.2310972213745117,23.927850246429443,3 +9212,0.14293497800827026,0.18417797982692719,0.17529308795928955,0.2074679434299469,770.7055053710938,1e-05,0.06974990665912628,4.562643766403198,23.927850246429443,3 +9213,0.29095813632011414,0.16490104794502258,0.1667158305644989,0.3006410002708435,911.7965698242188,1e-05,0.08395393937826157,2.7495598793029785,23.927850246429443,3 +9214,0.21681952476501465,0.20354118943214417,0.20928511023521423,0.2601282000541687,547.7528686523438,1e-05,0.07572043687105179,2.4849040508270264,23.927850246429443,3 +9215,0.2927112579345703,0.26485028862953186,0.2600539028644562,0.1952243447303772,585.1063842773438,1e-05,0.08908630907535553,2.3586862087249756,23.927850246429443,3 +9216,0.32836079597473145,0.44293349981307983,0.43965503573417664,0.2170192301273346,197.81146240234375,1e-05,0.08118265122175217,2.354698896408081,23.927850246429443,3 +9217,0.1386529505252838,0.14093543589115143,0.13561053574085236,0.2582051157951355,792.4597778320312,1e-05,0.06098666787147522,2.3621411323547363,23.927850246429443,3 +9218,0.2823817729949951,0.1921873688697815,0.1807042509317398,0.21333332359790802,827.1312866210938,1e-05,0.09061626344919205,2.6787915229797363,23.927850246429443,3 +9219,0.13222932815551758,0.17278683185577393,0.16672442853450775,0.15939101576805115,958.7605590820312,1e-05,0.06866537034511566,2.3720703125,23.927850246429443,3 +9220,0.20518654584884644,0.22455483675003052,0.23024891316890717,0.21333332359790802,472.6368408203125,1e-05,0.06181694567203522,2.3521053791046143,23.927850246429443,3 +9221,0.22408607602119446,0.16931931674480438,0.16239379346370697,0.18612179160118103,923.1171264648438,1e-05,0.0924973413348198,2.5882341861724854,23.927850246429443,3 +9222,0.11568377166986465,0.17979183793067932,0.1745532900094986,0.19189101457595825,850.3836669921875,1e-05,0.06298261135816574,2.354185104370117,23.927850246429443,3 +9223,0.29229095578193665,0.13681888580322266,0.1345997154712677,0.24416665732860565,685.9205932617188,1e-05,0.08547526597976685,2.350989818572998,23.927850246429443,3 +9224,0.08101179450750351,0.22215451300144196,0.2296065390110016,0.16730768978595734,996.9635620117188,1e-05,0.0670844092965126,2.60217547416687,23.927850246429443,3 +9225,0.1921151578426361,0.13687895238399506,0.13908235728740692,0.23666666448116302,920.0105590820312,1e-05,0.06946811825037003,2.358771324157715,23.927850246429443,3 +9226,0.19367250800132751,0.29467326402664185,0.2909402847290039,0.2506730556488037,472.6368408203125,1e-05,0.07939786463975906,2.349365472793579,23.927850246429443,3 +9227,0.19062405824661255,0.26158979535102844,0.252402663230896,0.24820512533187866,963.5654907226562,1e-05,0.07315078377723694,2.34721302986145,23.927850246429443,3 +9228,0.10098125040531158,0.1816040724515915,0.1808268278837204,0.12522435188293457,954.9102783203125,1e-05,0.06693629920482635,2.485902786254883,23.927850246429443,3 +9229,0.17704623937606812,0.2673873007297516,0.26439499855041504,0.2832051217556,550.8948364257812,1e-05,0.06848184019327164,2.480851411819458,23.927850246429443,3 +9230,0.09832656383514404,0.30745255947113037,0.30320730805397034,0.2104487121105194,999.3985595703125,1e-05,0.06047046184539795,2.359034538269043,23.927850246429443,3 +9231,0.13375797867774963,0.1462225317955017,0.1506377011537552,0.17695511877536774,696.9026489257812,1e-05,0.07989740371704102,2.528895616531372,23.927850246429443,3 +9232,0.24369829893112183,0.19150416553020477,0.19603221118450165,0.20980767905712128,706.521728515625,1e-05,0.0726127028465271,2.351797580718994,23.927850246429443,3 +9233,0.22981920838356018,0.1255880892276764,0.12238138914108276,0.10403845459222794,777.2314453125,1e-05,0.0735250785946846,2.349851608276367,23.927850246429443,3 +9234,0.21482257544994354,0.19893673062324524,0.19516463577747345,0.2499038428068161,979.4371948242188,1e-05,0.07954287528991699,2.597494602203369,23.927850246429443,3 +9235,0.2102072536945343,0.12061991542577744,0.1185934767127037,0.10865384340286255,799.0620727539062,1e-05,0.10538974404335022,2.6606292724609375,23.927850246429443,3 +9236,0.19391100108623505,0.4074862599372864,0.39300981163978577,0.3037179410457611,986.952880859375,1e-05,0.06734287738800049,2.3493871688842773,23.927850246429443,3 +9237,0.23880857229232788,0.18364036083221436,0.1814674735069275,0.2826922833919525,845.2072143554688,1e-05,0.07770027965307236,2.349820852279663,23.927850246429443,3 +9238,0.1952250748872757,0.14469854533672333,0.14161299169063568,0.09576922655105591,729.1666870117188,1e-05,0.07149937748908997,2.3505442142486572,23.927850246429443,3 +9239,0.24337248504161835,0.09605327248573303,0.10202555358409882,0.16208332777023315,775.0761108398438,1e-05,0.06832465529441833,2.6186676025390625,23.927850246429443,3 +9240,0.27402105927467346,0.2121269851922989,0.21477574110031128,0.15679486095905304,626.2474975585938,1e-05,0.07523544877767563,2.6878862380981445,23.927850246429443,3 +9241,0.16406786441802979,0.20736627280712128,0.20752684772014618,0.19833332300186157,845.2072143554688,1e-05,0.06634194403886795,2.3598499298095703,23.927850246429443,3 +9242,0.24593855440616608,0.20270885527133942,0.1946297138929367,0.3087179362773895,915.0589599609375,1e-05,0.08529645204544067,2.4948508739471436,23.927850246429443,3 +9243,0.20297449827194214,0.13374504446983337,0.12636494636535645,0.23644229769706726,940.5940551757812,1e-05,0.0667261928319931,2.347903251647949,23.927850246429443,3 +9244,0.1653435379266739,0.1259140819311142,0.13267448544502258,0.1530769169330597,757.8740844726562,1e-05,0.10275731235742569,2.3502280712127686,23.927850246429443,3 +9245,0.21993736922740936,0.6663734316825867,0.7115990519523621,0.20301280915737152,57.25191116333008,1e-05,0.07680090516805649,2.604553699493408,23.927850246429443,3 +9246,0.20935620367527008,0.09495113044977188,0.09856989979743958,0.2777884602546692,702.7145385742188,1e-05,0.05645575001835823,2.353698492050171,23.927850246429443,3 +9247,0.13216650485992432,0.21053850650787354,0.19304992258548737,0.25641024112701416,887.4710083007812,1e-05,0.06631024181842804,2.3488502502441406,23.927850246429443,3 +9248,0.25009724497795105,0.17596879601478577,0.1755785495042801,0.23961538076400757,839.89501953125,1e-05,0.07258529216051102,2.3464794158935547,23.927850246429443,3 +9249,0.07340329885482788,0.27525320649147034,0.2654586136341095,0.2380448579788208,967.9602661132812,1e-05,0.06494729965925217,2.3541462421417236,23.927850246429443,3 +9250,0.3336595594882965,0.21713130176067352,0.20914028584957123,0.22573716938495636,666.9776611328125,1e-05,0.06272236257791519,2.6391639709472656,23.927850246429443,3 +9251,0.13971343636512756,0.15350626409053802,0.15674977004528046,0.27009615302085876,627.4900512695312,1e-05,0.06341591477394104,2.3629069328308105,23.927850246429443,3 +9252,0.19244618713855743,0.09965459257364273,0.10021550208330154,0.114967942237854,653.6259765625,1e-05,0.0833907201886177,2.4732463359832764,23.927850246429443,3 +9253,0.1461927592754364,0.16909044981002808,0.16645708680152893,0.15955127775669098,951.8129272460938,1e-05,0.063117116689682,2.3617570400238037,23.927850246429443,3 +9254,0.10328850150108337,0.19084583222866058,0.19526031613349915,0.22246794402599335,887.4710083007812,1e-05,0.05562949180603027,2.3505446910858154,23.927850246429443,3 +9255,0.1171482503414154,0.044706810265779495,0.04543393477797508,0.11483974009752274,757.0978393554688,1e-05,0.06970829516649246,2.5361673831939697,23.927850246429443,3 +9256,0.11421369761228561,0.33633294701576233,0.32473182678222656,0.22326922416687012,969.7308959960938,1e-05,0.06258993595838547,2.492532253265381,23.927850246429443,3 +9257,0.18691474199295044,0.10924533754587173,0.10091738402843475,0.2190384566783905,778.6576538085938,1e-05,0.08227851241827011,2.3476712703704834,23.927850246429443,3 +9258,0.19749242067337036,0.14700134098529816,0.14825627207756042,0.2762179374694824,788.4046630859375,1e-05,0.06776445358991623,2.4958226680755615,23.927850246429443,3 +9259,0.22204305231571198,0.23903483152389526,0.23948250710964203,0.08711538463830948,988.4937133789062,1e-05,0.07791370898485184,2.5311622619628906,23.927850246429443,3 +9260,0.2251352071762085,0.14599697291851044,0.13465704023838043,0.22826921939849854,839.3560791015625,1e-05,0.07825154066085815,2.5222761631011963,23.927850246429443,3 +9261,0.19998794794082642,0.803149938583374,0.8004099726676941,0.20762819051742554,61.78706741333008,1e-05,0.09630227088928223,3.133240222930908,23.927850246429443,3 +9262,0.27111032605171204,0.13492627441883087,0.1291695535182953,0.26230767369270325,693.9501953125,1e-05,0.07961919158697128,3.973299503326416,23.927850246429443,3 +9263,0.1820901781320572,0.21514461934566498,0.21691185235977173,0.27977561950683594,989.5833129882812,1e-05,0.060998208820819855,2.5807082653045654,23.927850246429443,3 +9264,0.1782311499118805,0.20125159621238708,0.18154612183570862,0.22778844833374023,938.1237182617188,1e-05,0.08564015477895737,2.353978395462036,23.927850246429443,3 +9265,0.09528236091136932,0.20913326740264893,0.1965382993221283,0.23528845608234406,908.4699096679688,1e-05,0.05462242290377617,2.3524327278137207,23.927850246429443,3 +9266,0.2714235782623291,0.21585001051425934,0.2114514410495758,0.22333332896232605,810.4782104492188,1e-05,0.07492099702358246,2.7338926792144775,23.927850246429443,3 +9267,0.183700293302536,0.1686791628599167,0.15927214920520782,0.25564101338386536,918.9618530273438,1e-05,0.08104154467582703,2.3698909282684326,23.927850246429443,3 +9268,0.2689053416252136,0.13475407660007477,0.13695989549160004,0.19429486989974976,590.71728515625,1e-05,0.07432021200656891,2.3563425540924072,23.927850246429443,3 +9269,0.25236234068870544,0.13302496075630188,0.1413135975599289,0.25708332657814026,859.375,1e-05,0.07538796961307526,2.3599860668182373,23.927850246429443,3 +9270,0.19222407042980194,0.1866925209760666,0.1850140243768692,0.21394230425357819,760.95458984375,1e-05,0.07843268662691116,2.3621199131011963,23.927850246429443,3 +9271,0.3036835491657257,0.16944360733032227,0.1575559675693512,0.2713140845298767,727.4247436523438,1e-05,0.07787744700908661,2.516225814819336,23.927850246429443,3 +9272,0.1259731948375702,0.2452481985092163,0.2353314459323883,0.19990384578704834,983.1340942382812,1e-05,0.06919241696596146,2.552814483642578,23.927850246429443,3 +9273,0.19142460823059082,0.19944055378437042,0.19588103890419006,0.06666666269302368,977.07421875,1e-05,0.07332804054021835,2.3544976711273193,23.927850246429443,3 +9274,0.15108773112297058,0.856010913848877,0.850609302520752,0.1636858880519867,52.6819953918457,1e-05,0.07489211112260818,2.55732798576355,23.927850246429443,3 +9275,0.13352586328983307,0.2930554449558258,0.2754882872104645,0.2555769085884094,982.677490234375,1e-05,0.0656566470861435,2.3567004203796387,23.927850246429443,3 +9276,0.143572598695755,0.29226207733154297,0.29072049260139465,0.22826921939849854,362.2159423828125,1e-05,0.08248601853847504,2.3558452129364014,23.927850246429443,3 +9277,0.17652732133865356,0.1651274710893631,0.16061556339263916,0.23237179219722748,932.418701171875,1e-05,0.06698320060968399,2.567342758178711,23.927850246429443,3 +9278,0.254646897315979,0.21284949779510498,0.21711409091949463,0.22025640308856964,738.5433959960938,1e-05,0.07366762310266495,2.355949640274048,23.927850246429443,3 +9279,0.11813877522945404,0.24831432104110718,0.23771217465400696,0.2972756326198578,945.7156982421875,1e-05,0.06210371106863022,2.347526788711548,23.927850246429443,3 +9280,0.12406030297279358,0.11202022433280945,0.11814666539430618,0.30339741706848145,910.3261108398438,1e-05,0.06042582541704178,2.3482248783111572,23.927850246429443,3 +9281,0.28045713901519775,0.20564506947994232,0.19769179821014404,0.2467307597398758,741.0423583984375,1e-05,0.07988976687192917,2.5136077404022217,23.927850246429443,3 +9282,0.09244444966316223,0.09561339765787125,0.10218203067779541,0.24445511400699615,753.1796264648438,1e-05,0.0649118423461914,2.50130033493042,23.927850246429443,3 +9283,0.15851713716983795,0.16340315341949463,0.16118988394737244,0.23346152901649475,988.2747802734375,1e-05,0.07886721193790436,2.358778953552246,23.927850246429443,3 +9284,0.08102074265480042,0.2915743887424469,0.29106631875038147,0.13499999046325684,991.0935668945312,1e-05,0.0670282319188118,2.4676194190979004,23.927850246429443,3 +9285,0.13387718796730042,0.6206222176551819,0.6340789794921875,0.16749998927116394,29.296875,1e-05,0.07440472394227982,2.3607358932495117,23.927850246429443,3 +9286,0.19284315407276154,0.19535133242607117,0.18978290259838104,0.22499999403953552,964.3510131835938,1e-05,0.07019341737031937,2.3448855876922607,23.927850246429443,3 +9287,0.18553408980369568,0.2330935299396515,0.22364357113838196,0.2838461399078369,832.2192993164062,1e-05,0.07503563910722733,2.621088743209839,23.927850246429443,3 +9288,0.13889552652835846,0.05565051734447479,0.06253976374864578,0.15810896456241608,906.5933837890625,1e-05,0.05708344653248787,2.472764015197754,23.927850246429443,3 +9289,0.25266602635383606,0.24481482803821564,0.24242858588695526,0.2199999988079071,746.7793579101562,1e-05,0.06713283061981201,2.352006196975708,23.927850246429443,3 +9290,0.09636566787958145,0.09593436866998672,0.09972735494375229,0.19211538136005402,961.1829223632812,1e-05,0.06276638060808182,2.349210739135742,23.927850246429443,3 +9291,0.2416558861732483,0.5423402190208435,0.5220999717712402,0.18173076212406158,998.18701171875,1e-05,0.07432367652654648,2.342944383621216,23.927850246429443,3 +9292,0.15156753361225128,0.2138742208480835,0.21232092380523682,0.23522435128688812,860.34912109375,1e-05,0.06546559929847717,2.515413761138916,23.927850246429443,3 +9293,0.2070678025484085,0.19500036537647247,0.21405698359012604,0.15602563321590424,998.592041015625,1e-05,0.06384745240211487,2.482481002807617,23.927850246429443,3 +9294,0.1625910848379135,0.19452299177646637,0.20357584953308105,0.3061217963695526,427.6316223144531,1e-05,0.07721816003322601,2.3493893146514893,23.927850246429443,3 +9295,0.22318902611732483,0.1756030023097992,0.16670668125152588,0.242660254240036,659.2627563476562,1e-05,0.06592509150505066,2.469796895980835,23.927850246429443,3 +9296,0.23154717683792114,0.12553271651268005,0.1311694085597992,0.22288461029529572,883.6459350585938,1e-05,0.071831613779068,2.347508430480957,23.927850246429443,3 +9297,0.2091895341873169,0.41477417945861816,0.38792309165000916,0.24733974039554596,984.0426025390625,1e-05,0.07084707170724869,2.347862958908081,23.927850246429443,3 +9298,0.2409578263759613,0.23539090156555176,0.2279069572687149,0.26945510506629944,950.095947265625,1e-05,0.07736102491617203,2.5681142807006836,23.927850246429443,3 +9299,0.15308192372322083,0.15199926495552063,0.14755120873451233,0.2149999886751175,906.2156372070312,1e-05,0.06781642138957977,2.4762279987335205,23.927850246429443,3 +9300,0.17711375653743744,0.1687195897102356,0.18721812963485718,0.22987177968025208,965.6505737304688,1e-05,0.06990068405866623,2.3447933197021484,23.927850246429443,3 +9301,0.17092853784561157,0.12999403476715088,0.1355881690979004,0.18919871747493744,713.0584106445312,1e-05,0.06602697819471359,2.346601724624634,23.927850246429443,3 +9302,0.15097936987876892,0.14520876109600067,0.13897310197353363,0.2540384531021118,829.4078369140625,1e-05,0.06164195016026497,2.3445725440979004,23.927850246429443,3 +9303,0.15679582953453064,0.08355320245027542,0.08656087517738342,0.2499999850988388,825.9837646484375,1e-05,0.058502864092588425,2.3476521968841553,23.927850246429443,3 +9304,0.22071978449821472,0.1531476229429245,0.15472891926765442,0.2708333134651184,696.9026489257812,1e-05,0.06525833159685135,2.348288059234619,23.927850246429443,3 +9305,0.12946201860904694,0.3041307330131531,0.3116815984249115,0.2041025608778,996.1414184570312,1e-05,0.06100887060165405,2.345140218734741,23.927850246429443,3 +9306,0.32999202609062195,0.2144043743610382,0.2064380943775177,0.2911858856678009,814.7632446289062,1e-05,0.07779961824417114,2.4745662212371826,23.927850246429443,3 +9307,0.24187979102134705,0.21732233464717865,0.21193267405033112,0.2826922833919525,593.4874267578125,1e-05,0.06636461615562439,2.3453826904296875,23.927850246429443,3 +9308,0.15904387831687927,0.059664614498615265,0.06180393695831299,0.11903845518827438,952.9466552734375,1e-05,0.09500036388635635,2.504817247390747,23.927850246429443,3 +9309,0.16282618045806885,0.17906613647937775,0.17279121279716492,0.24288460612297058,963.5654907226562,1e-05,0.0664931982755661,2.469088315963745,23.927850246429443,3 +9310,0.17876183986663818,0.15940126776695251,0.15140655636787415,0.14673076570034027,914.6995849609375,1e-05,0.0659986063838005,2.564080238342285,23.927850246429443,3 +9311,0.24205274879932404,0.06177562102675438,0.06527669727802277,0.09387820214033127,744.3366088867188,1e-05,0.08382050693035126,2.355576992034912,23.927850246429443,3 +9312,0.21310639381408691,0.16583245992660522,0.16433964669704437,0.2397756278514862,916.4888305664062,1e-05,0.11156731843948364,2.342905044555664,23.927850246429443,3 +9313,0.14472971856594086,0.13334514200687408,0.13816335797309875,0.22785255312919617,912.162109375,1e-05,0.06918270140886307,2.50825572013855,23.927850246429443,3 +9314,0.23250041902065277,0.1817418932914734,0.1741662323474884,0.19942307472229004,941.8146362304688,1e-05,0.07631418853998184,2.4891350269317627,23.927850246429443,3 +9315,0.06288755685091019,0.27186229825019836,0.2589433789253235,0.2795833349227905,974.9119873046875,1e-05,0.06622952967882156,2.3470969200134277,23.927850246429443,3 +9316,0.16807805001735687,0.2921997010707855,0.2737753689289093,0.24551281332969666,976.3572998046875,1e-05,0.06430833786725998,2.34828519821167,23.927850246429443,3 +9317,0.15236447751522064,0.10631735622882843,0.10023725032806396,0.20685896277427673,894.4823608398438,1e-05,0.06617424637079239,2.5154364109039307,23.927850246429443,3 +9318,0.22117720544338226,0.29455918073654175,0.2946803569793701,0.24733974039554596,514.7058715820312,1e-05,0.06717745959758759,2.3471202850341797,23.927850246429443,3 +9319,0.2770645022392273,0.3616466522216797,0.3635987639427185,0.22749999165534973,204.84951782226562,1e-05,0.06886208057403564,2.4927780628204346,23.927850246429443,3 +9320,0.14505702257156372,0.2925146222114563,0.28762906789779663,0.2068910151720047,981.0671997070312,1e-05,0.08563809096813202,2.5649988651275635,23.927850246429443,3 +9321,0.1720038652420044,0.17042823135852814,0.16146884858608246,0.23249998688697815,900.0560302734375,1e-05,0.06553260236978531,2.347763776779175,23.927850246429443,3 +9322,0.14141079783439636,0.19905370473861694,0.2060796469449997,0.23897434771060944,993.0098266601562,1e-05,0.06611227989196777,2.3480703830718994,23.927850246429443,3 +9323,0.2543940544128418,0.1601376086473465,0.15496830642223358,0.22221152484416962,573.5930786132812,1e-05,0.07266949117183685,2.5996272563934326,23.927850246429443,3 +9324,0.2743082344532013,0.28248870372772217,0.26763805747032166,0.19166666269302368,995.9349365234375,1e-05,0.08487255871295929,2.592702627182007,23.927850246429443,3 +9325,0.1401117593050003,0.1864805668592453,0.18941842019557953,0.18333332240581512,716.7235717773438,1e-05,0.06590575724840164,2.3547966480255127,23.927850246429443,3 +9326,0.3074820935726166,0.18712948262691498,0.17704881727695465,0.24804486334323883,946.896240234375,1e-05,0.0728316530585289,2.3478879928588867,23.927850246429443,3 +9327,0.3456874191761017,0.20867973566055298,0.21245597302913666,0.1892307549715042,519.8598022460938,1e-05,0.08344153314828873,2.463376522064209,23.927850246429443,3 +9328,0.11296556890010834,0.2529990077018738,0.2363114356994629,0.2348717898130417,973.2064208984375,1e-05,0.07007304579019547,2.355010986328125,23.927850246429443,3 +9329,0.28032875061035156,0.14979849755764008,0.1452077180147171,0.2216346114873886,828.2725830078125,1e-05,0.07276257872581482,2.350553035736084,23.927850246429443,3 +9330,0.13315747678279877,0.2116967737674713,0.19969087839126587,0.1657051295042038,971.23095703125,1e-05,0.06388973444700241,2.6041011810302734,23.927850246429443,3 +9331,0.13281142711639404,0.4787650406360626,0.47931456565856934,0.210641011595726,157.3426513671875,1e-05,0.07558644562959671,2.550969362258911,23.927850246429443,3 +9332,0.21239396929740906,0.216287299990654,0.2111048847436905,0.2599358856678009,683.8768310546875,1e-05,0.08347809314727783,2.3510303497314453,23.927850246429443,3 +9333,0.26131707429885864,0.20738601684570312,0.2091326117515564,0.21929486095905304,906.9703979492188,1e-05,0.09135882556438446,2.3512580394744873,23.927850246429443,3 +9334,0.16068574786186218,0.20020414888858795,0.18901655077934265,0.2615705132484436,937.1871948242188,1e-05,0.07166624069213867,2.5192079544067383,23.927850246429443,3 +9335,0.27975863218307495,0.2294289469718933,0.22269777953624725,0.3073717951774597,625.0,1e-05,0.0840686485171318,2.4840118885040283,23.927850246429443,3 +9336,0.3472943603992462,0.6312476992607117,0.636260986328125,0.20442306995391846,153.50877380371094,1e-05,0.07376762479543686,2.3586533069610596,23.927850246429443,3 +9337,0.2857398986816406,0.31475767493247986,0.3038007318973541,0.13269230723381042,990.448486328125,1e-05,0.06326203048229218,2.3485639095306396,23.927850246429443,3 +9338,0.14213551580905914,0.22168020904064178,0.21491162478923798,0.19586537778377533,866.564453125,1e-05,0.0631042867898941,2.5782134532928467,23.927850246429443,3 +9339,0.10578715801239014,0.14888690412044525,0.13960237801074982,0.12910255789756775,793.795654296875,1e-05,0.07072429358959198,2.3493549823760986,23.927850246429443,3 +9340,0.21960154175758362,0.18712612986564636,0.17310650646686554,0.2508012652397156,653.6259765625,1e-05,0.08842817693948746,2.51194429397583,23.927850246429443,3 +9341,0.1580643355846405,0.17816948890686035,0.1656247228384018,0.2791025638580322,927.1693725585938,1e-05,0.0644550621509552,2.6366262435913086,23.927850246429443,3 +9342,0.2266065776348114,0.21584740281105042,0.2049567997455597,0.22740383446216583,671.2963256835938,1e-05,0.0814424455165863,2.3608791828155518,23.927850246429443,3 +9343,0.24447853863239288,0.17851530015468597,0.19292692840099335,0.18371793627738953,427.6316223144531,1e-05,0.12903769314289093,2.350025177001953,23.927850246429443,3 +9344,0.18517634272575378,0.4390757977962494,0.44382140040397644,0.26836538314819336,215.23179626464844,1e-05,0.05851232260465622,2.354442834854126,23.927850246429443,3 +9345,0.2023274302482605,0.2386939972639084,0.22884801030158997,0.23980768024921417,828.2725830078125,1e-05,0.07414064556360245,2.612668991088867,23.927850246429443,3 +9346,0.22289837896823883,0.24213777482509613,0.2375885546207428,0.254647433757782,689.9642333984375,1e-05,0.07013004273176193,2.5914084911346436,23.927850246429443,3 +9347,0.17743849754333496,0.21977311372756958,0.21051764488220215,0.19586537778377533,859.375,1e-05,0.07145541161298752,2.3545732498168945,23.927850246429443,3 +9348,0.21057970821857452,0.13342301547527313,0.1264379918575287,0.18516024947166443,883.6459350585938,1e-05,0.06605274230241776,2.3481733798980713,23.927850246429443,3 +9349,0.2174517661333084,0.20508290827274323,0.20538978278636932,0.24923075735569,732.615966796875,1e-05,0.07261663675308228,2.469369411468506,23.927850246429443,3 +9350,0.16998250782489777,0.16587740182876587,0.15895844995975494,0.08525640517473221,753.1796264648438,1e-05,0.07744564116001129,2.3464977741241455,23.927850246429443,3 +9351,0.19439393281936646,0.2025768756866455,0.200111985206604,0.21240383386611938,979.6713256835938,1e-05,0.062431756407022476,2.5239264965057373,23.927850246429443,3 +9352,0.23506300151348114,0.15087825059890747,0.15357616543769836,0.19471153616905212,926.165771484375,1e-05,0.0715351402759552,2.5330917835235596,23.927850246429443,3 +9353,0.29854413866996765,0.4161529541015625,0.41292789578437805,0.2186538428068161,211.79405212402344,1e-05,0.0783657357096672,2.378964424133301,23.927850246429443,3 +9354,0.24348995089530945,0.2398274540901184,0.241804301738739,0.29326921701431274,869.3666381835938,1e-05,0.07080817222595215,2.352212429046631,23.927850246429443,3 +9355,0.231942281126976,0.18003767728805542,0.17033764719963074,0.1877884566783905,908.4699096679688,1e-05,0.06992097198963165,2.535454750061035,23.927850246429443,3 +9356,0.22043654322624207,0.10054279863834381,0.10464490205049515,0.19865383207798004,930.4703369140625,1e-05,0.07058921456336975,2.4867327213287354,23.927850246429443,3 +9357,0.14818987250328064,0.2609606087207794,0.25904497504234314,0.19951921701431274,936.5596923828125,1e-05,0.061826933175325394,2.3604445457458496,23.927850246429443,3 +9358,0.24786043167114258,0.20780211687088013,0.19684194028377533,0.2517628073692322,963.3027954101562,1e-05,0.0636979192495346,2.3841867446899414,23.927850246429443,3 +9359,0.29508715867996216,0.18191605806350708,0.17382720112800598,0.25641024112701416,491.5048522949219,1e-05,0.07424181699752808,2.6274971961975098,23.927850246429443,3 +9360,0.2634143531322479,0.22714899480342865,0.21640095114707947,0.2530769109725952,391.4835205078125,1e-05,0.06659531593322754,2.725921392440796,23.927850246429443,3 +9361,0.13842861354351044,0.13932949304580688,0.14347510039806366,0.2684935927391052,806.1080322265625,1e-05,0.06771820783615112,2.420969009399414,23.927850246429443,3 +9362,0.22355271875858307,0.22604826092720032,0.21844513714313507,0.28788459300994873,974.9119873046875,1e-05,0.0805361196398735,3.335139751434326,23.927850246429443,3 +9363,0.09592219442129135,0.16770131886005402,0.1616019606590271,0.1360897421836853,937.5,1e-05,0.06936594843864441,2.393580913543701,23.927850246429443,3 +9364,0.17685668170452118,0.7165606617927551,0.712616503238678,0.22692306339740753,70.75472259521484,1e-05,0.08369676023721695,3.425158977508545,23.927850246429443,3 +9365,0.2665388584136963,0.29319098591804504,0.28270506858825684,0.22769230604171753,944.52587890625,1e-05,0.0777590349316597,2.723865032196045,23.927850246429443,3 +9366,0.1604180932044983,0.1309899240732193,0.13708290457725525,0.07794871181249619,994.2716674804688,1e-05,0.05964982509613037,3.123978853225708,23.927850246429443,3 +9367,0.163710817694664,0.10016997903585434,0.09617283195257187,0.1799679398536682,693.9501953125,1e-05,0.06751402467489243,3.48211932182312,23.927850246429443,3 +9368,0.315009206533432,0.22280177474021912,0.21861156821250916,0.28362178802490234,639.6484985351562,1e-05,0.0967678651213646,2.438936710357666,23.927850246429443,3 +9369,0.13943728804588318,0.1524810492992401,0.1554211676120758,0.17820511758327484,728.2971801757812,1e-05,0.07713419198989868,2.4444286823272705,23.927850246429443,3 +9370,0.19471363723278046,0.16595050692558289,0.16545118391513824,0.23974357545375824,956.5726318359375,1e-05,0.07016261667013168,2.570394515991211,23.927850246429443,3 +9371,0.10790503770112991,0.08768295496702194,0.0885024145245552,0.1363781988620758,911.0628662109375,1e-05,0.06312871724367142,2.443995237350464,23.927850246429443,3 +9372,0.17282943427562714,0.1458146870136261,0.1460210531949997,0.23749999701976776,712.13427734375,1e-05,0.09188985824584961,2.6799728870391846,23.927850246429443,3 +9373,0.14799702167510986,0.14006580412387848,0.13765868544578552,0.20224358141422272,957.6707763671875,1e-05,0.0820225402712822,2.711829900741577,23.927850246429443,3 +9374,0.2753288447856903,0.23793867230415344,0.23802585899829865,0.2724038362503052,416.6666564941406,1e-05,0.08182813227176666,3.214212417602539,23.927850246429443,3 +9375,0.23056262731552124,0.17698737978935242,0.16713528335094452,0.1591346114873886,773.6281127929688,1e-05,0.10379757732152939,3.6566269397735596,23.927850246429443,3 +9376,0.18036524951457977,0.13130596280097961,0.12843628227710724,0.13173076510429382,647.8805541992188,1e-05,0.07459153234958649,2.365506649017334,23.927850246429443,3 +9377,0.20330877602100372,0.15491612255573273,0.163545161485672,0.2548397481441498,863.2425537109375,1e-05,0.08425666391849518,2.597381830215454,23.927850246429443,3 +9378,0.19767078757286072,0.07936449348926544,0.0825096145272255,0.14955127239227295,757.0978393554688,1e-05,0.08888024836778641,2.4910590648651123,23.927850246429443,3 +9379,0.22244924306869507,0.3135952055454254,0.3026784360408783,0.2144230753183365,308.7349548339844,1e-05,0.06913041323423386,2.3544132709503174,23.927850246429443,3 +9380,0.1935909390449524,0.17083221673965454,0.15867303311824799,0.2816345989704132,942.7236938476562,1e-05,0.07307495176792145,2.351494550704956,23.927850246429443,3 +9381,0.2156372219324112,0.1970917284488678,0.1843676120042801,0.19278845191001892,959.3023071289062,1e-05,0.12511591613292694,2.5009078979492188,23.927850246429443,3 +9382,0.15341387689113617,0.2644111216068268,0.25693872570991516,0.14464743435382843,982.2193603515625,1e-05,0.07085226476192474,2.346329689025879,23.927850246429443,3 +9383,0.21191222965717316,0.15230484306812286,0.14388732612133026,0.2578205168247223,965.1322021484375,1e-05,0.08046743273735046,2.5732855796813965,23.927850246429443,3 +9384,0.22641459107398987,0.2219948172569275,0.22722342610359192,0.19826921820640564,627.4900512695312,1e-05,0.10820969194173813,2.352625608444214,23.927850246429443,3 +9385,0.10810375213623047,0.3009430766105652,0.28515809774398804,0.26057690382003784,1000.0,1e-05,0.0704977884888649,2.3442916870117188,23.927850246429443,3 +9386,0.308226078748703,0.17054203152656555,0.1649704873561859,0.2159615308046341,862.7633056640625,1e-05,0.07788169384002686,2.3478941917419434,23.927850246429443,3 +9387,0.14292752742767334,0.20231756567955017,0.19608791172504425,0.30560895800590515,795.1236572265625,1e-05,0.08513642847537994,2.6420538425445557,23.927850246429443,3 +9388,0.15489500761032104,0.23220232129096985,0.22753402590751648,0.07967948168516159,985.3936767578125,1e-05,0.07370436936616898,2.503950357437134,23.927850246429443,3 +9389,0.2038872092962265,0.17750702798366547,0.16890868544578552,0.17192307114601135,860.34912109375,1e-05,0.07761041074991226,2.3644235134124756,23.927850246429443,3 +9390,0.18088825047016144,0.1516438126564026,0.14355383813381195,0.28400638699531555,924.81787109375,1e-05,0.0581774078309536,2.3536417484283447,23.927850246429443,3 +9391,0.22576232254505157,0.23844707012176514,0.2337845116853714,0.2425640970468521,425.4617614746094,1e-05,0.07290180772542953,2.4671597480773926,23.927850246429443,3 +9392,0.3004111349582672,0.23050689697265625,0.2194352149963379,0.19137819111347198,791.1160888671875,1e-05,0.08590659499168396,2.3574721813201904,23.927850246429443,3 +9393,0.07201385498046875,0.22780567407608032,0.2115863561630249,0.2361217886209488,896.4932861328125,1e-05,0.05510766804218292,2.454890489578247,23.927850246429443,3 +9394,0.11314699798822403,0.2190646529197693,0.20738181471824646,0.18439102172851562,858.3959350585938,1e-05,0.058778662234544754,2.5237443447113037,23.927850246429443,3 +9395,0.1983400583267212,0.2163587361574173,0.21472856402397156,0.09753204882144928,474.5657653808594,1e-05,0.07023902982473373,2.352644681930542,23.927850246429443,3 +9396,0.2754152715206146,0.3078685998916626,0.3026866018772125,0.22855769097805023,440.41455078125,1e-05,0.08614674210548401,2.347766399383545,23.927850246429443,3 +9397,0.21812871098518372,0.3499548137187958,0.34347784519195557,0.24429486691951752,414.4384765625,1e-05,0.06133822351694107,2.3487842082977295,23.927850246429443,3 +9398,0.15963879227638245,0.11115338653326035,0.11908622086048126,0.2475961446762085,840.4324951171875,1e-05,0.07423538714647293,2.5545473098754883,23.927850246429443,3 +9399,0.1548115313053131,0.14712117612361908,0.14784970879554749,0.25766023993492126,921.7437133789062,1e-05,0.07996676117181778,2.521857976913452,23.927850246429443,3 +9400,0.1883723884820938,0.2081037312746048,0.18914571404457092,0.15141025185585022,961.9814453125,1e-05,0.06360290944576263,2.348839521408081,23.927850246429443,3 +9401,0.2935381829738617,0.11080542951822281,0.12269315868616104,0.2637179493904114,906.9703979492188,1e-05,0.09271898865699768,2.3483102321624756,23.927850246429443,3 +9402,0.219257652759552,0.26992493867874146,0.26237910985946655,0.24429486691951752,973.6957397460938,1e-05,0.07157798856496811,2.5607337951660156,23.927850246429443,3 +9403,0.15913303196430206,0.12466288357973099,0.11892212927341461,0.12544871866703033,902.0044555664062,1e-05,0.07388421893119812,2.350752830505371,23.927850246429443,3 +9404,0.10642553120851517,0.42208462953567505,0.4160229563713074,0.16461537778377533,994.4806518554688,1e-05,0.05446097254753113,2.7262682914733887,23.927850246429443,3 +9405,0.18937943875789642,0.08347396552562714,0.0803498774766922,0.2520192265510559,564.6929931640625,1e-05,0.06574461609125137,2.3538777828216553,23.927850246429443,3 +9406,0.2627979516983032,0.20240163803100586,0.2157633900642395,0.2097756266593933,523.2557983398438,1e-05,0.07354258000850677,2.3488941192626953,23.927850246429443,3 +9407,0.13477596640586853,0.16388732194900513,0.16879956424236298,0.24371793866157532,858.3959350585938,1e-05,0.0653073638677597,2.345550060272217,23.927850246429443,3 +9408,0.20911787450313568,0.1763688027858734,0.17306530475616455,0.25217947363853455,665.8878784179688,1e-05,0.07280140370130539,2.5195212364196777,23.927850246429443,3 +9409,0.1979452222585678,0.12513545155525208,0.13432912528514862,0.16128204762935638,739.3790893554688,1e-05,0.0748385488986969,2.3528809547424316,23.927850246429443,3 +9410,0.15481260418891907,0.12998317182064056,0.1313236653804779,0.09041666239500046,723.0185546875,1e-05,0.07498236745595932,2.3435986042022705,23.927850246429443,3 +9411,0.18834611773490906,0.1924421638250351,0.20869745314121246,0.1759294867515564,969.2273559570312,1e-05,0.06832814961671829,2.3481245040893555,23.927850246429443,3 +9412,0.2510021924972534,0.16134200990200043,0.14985977113246918,0.2011858969926834,693.9501953125,1e-05,0.0722985565662384,2.35013484954834,23.927850246429443,3 +9413,0.16455620527267456,0.1685400903224945,0.1682860255241394,0.24868588149547577,965.9091796875,1e-05,0.07653309404850006,2.5394022464752197,23.927850246429443,3 +9414,0.2219102382659912,0.19509348273277283,0.19828249514102936,0.2796153724193573,950.095947265625,1e-05,0.08025071769952774,2.454538583755493,23.927850246429443,3 +9415,0.16099020838737488,0.0970902368426323,0.10427231341600418,0.19788460433483124,926.8355712890625,1e-05,0.05758367106318474,2.535123109817505,23.927850246429443,3 +9416,0.17532481253147125,0.2339078038930893,0.23680227994918823,0.2712499797344208,995.9349365234375,1e-05,0.06374548375606537,2.3616654872894287,23.927850246429443,3 +9417,0.15877653658390045,0.21775056421756744,0.21764855086803436,0.25910255312919617,906.9703979492188,1e-05,0.06895093619823456,2.356235980987549,23.927850246429443,3 +9418,0.24646614491939545,0.20262661576271057,0.20313823223114014,0.22692306339740753,701.75439453125,1e-05,0.08019889146089554,2.352853536605835,23.927850246429443,3 +9419,0.237514927983284,0.14753791689872742,0.14369912445545197,0.28881409764289856,807.365478515625,1e-05,0.06735363602638245,2.5027449131011963,23.927850246429443,3 +9420,0.13040301203727722,0.1285024732351303,0.12704017758369446,0.2169230729341507,913.978515625,1e-05,0.09516255557537079,2.493072032928467,23.927850246429443,3 +9421,0.2086942493915558,0.1576704978942871,0.15312083065509796,0.2579807639122009,859.375,1e-05,0.06803454458713531,2.3514270782470703,23.927850246429443,3 +9422,0.12266234308481216,0.18269997835159302,0.1803024858236313,0.24666665494441986,825.9837646484375,1e-05,0.06548851728439331,2.3501715660095215,23.927850246429443,3 +9423,0.17536567151546478,0.05738246068358421,0.06523095071315765,0.13977563381195068,625.0,1e-05,0.072636179625988,2.4615886211395264,23.927850246429443,3 +9424,0.15412664413452148,0.18042564392089844,0.17438778281211853,0.2327243536710739,918.6107788085938,1e-05,0.07799878716468811,2.358105182647705,23.927850246429443,3 +9425,0.25795677304267883,0.13642209768295288,0.13543355464935303,0.2086217850446701,679.7445678710938,1e-05,0.0749596580862999,2.487255096435547,23.927850246429443,3 +9426,0.21032115817070007,0.25001078844070435,0.2651316225528717,0.1870192289352417,364.73089599609375,1e-05,0.06831277906894684,2.5588390827178955,23.927850246429443,3 +9427,0.20793549716472626,0.1946072280406952,0.18859487771987915,0.24871793389320374,952.3810424804688,1e-05,0.06472329795360565,2.350043773651123,23.927850246429443,3 +9428,0.18096643686294556,0.1492971032857895,0.15838494896888733,0.20131409168243408,567.685546875,1e-05,0.06963641196489334,2.35267972946167,23.927850246429443,3 +9429,0.25646817684173584,0.1970524936914444,0.19182603061199188,0.2407371699810028,810.4782104492188,1e-05,0.06648848950862885,2.5248618125915527,23.927850246429443,3 +9430,0.23418757319450378,0.27639785408973694,0.2671649754047394,0.24967947602272034,987.8356323242188,1e-05,0.07249712944030762,2.5851635932922363,23.927850246429443,3 +9431,0.19838330149650574,0.12911097705364227,0.1264091432094574,0.12871794402599335,785.6611938476562,1e-05,0.06873665750026703,2.354578971862793,23.927850246429443,3 +9432,0.15896642208099365,0.24486498534679413,0.23882263898849487,0.23358973860740662,979.6713256835938,1e-05,0.06921029835939407,2.344893217086792,23.927850246429443,3 +9433,0.2048371583223343,0.20092162489891052,0.20115935802459717,0.13634614646434784,925.4932250976562,1e-05,0.06786277890205383,2.350827932357788,23.927850246429443,3 +9434,0.192585289478302,0.15790584683418274,0.14932161569595337,0.15705128014087677,897.6888427734375,1e-05,0.06691959500312805,2.473371982574463,23.927850246429443,3 +9435,0.16963669657707214,0.12360099703073502,0.12898582220077515,0.23788461089134216,948.3590698242188,1e-05,0.0701458677649498,2.4625158309936523,23.927850246429443,3 +9436,0.239364892244339,0.25841987133026123,0.24022644758224487,0.2149038314819336,984.0426025390625,1e-05,0.07225443422794342,2.513373613357544,23.927850246429443,3 +9437,0.17833568155765533,0.20657463371753693,0.21504974365234375,0.2517628073692322,994.6895141601562,1e-05,0.06106536090373993,2.358926773071289,23.927850246429443,3 +9438,0.2718607485294342,0.4456990361213684,0.44019371271133423,0.2230128049850464,201.34228515625,1e-05,0.061969999223947525,2.345695734024048,23.927850246429443,3 +9439,0.22663980722427368,0.5679613947868347,0.5792811512947083,0.2554166615009308,121.84115600585938,1e-05,0.0667966902256012,2.350438117980957,23.927850246429443,3 +9440,0.17196157574653625,0.1535906195640564,0.15879608690738678,0.2795192301273346,959.3023071289062,1e-05,0.06619568169116974,2.4998207092285156,23.927850246429443,3 +9441,0.22339826822280884,0.1361067146062851,0.13981907069683075,0.2464423030614853,787.721923828125,1e-05,0.07304175943136215,2.4704723358154297,23.927850246429443,3 +9442,0.24300958216190338,0.12784132361412048,0.12090975791215897,0.0914423018693924,819.5592651367188,1e-05,0.06209941953420639,2.3501803874969482,23.927850246429443,3 +9443,0.1356428861618042,0.15782484412193298,0.15223680436611176,0.27407050132751465,920.0105590820312,1e-05,0.056971948593854904,2.345947742462158,23.927850246429443,3 +9444,0.2429806888103485,0.1990458369255066,0.20052242279052734,0.17769229412078857,736.0197143554688,1e-05,0.0786091536283493,2.3468785285949707,23.927850246429443,3 +9445,0.09290073812007904,0.18825222551822662,0.2042827308177948,0.25708332657814026,975.6365966796875,1e-05,0.061946652829647064,2.478764772415161,23.927850246429443,3 +9446,0.09535481780767441,0.14393004775047302,0.14099106192588806,0.28996792435646057,905.8369750976562,1e-05,0.06423898786306381,2.576627731323242,23.927850246429443,3 +9447,0.21687860786914825,0.12707991898059845,0.14276741445064545,0.13278844952583313,978.4969482421875,1e-05,0.08343271166086197,2.663431406021118,23.927850246429443,3 +9448,0.19607286155223846,0.18923327326774597,0.18356215953826904,0.16346153616905212,909.21484375,1e-05,0.06489331275224686,2.352682590484619,23.927850246429443,3 +9449,0.15643326938152313,0.12550745904445648,0.11952414363622665,0.2144230753183365,907.3464965820312,1e-05,0.057661790400743484,2.350858211517334,23.927850246429443,3 +9450,0.10788128525018692,0.1160283163189888,0.11947639286518097,0.23317307233810425,915.7753295898438,1e-05,0.07545343041419983,2.3530006408691406,23.927850246429443,3 +9451,0.2780996561050415,0.11286237090826035,0.11863600462675095,0.24060896039009094,670.22265625,1e-05,0.06856521219015121,2.355605125427246,23.927850246429443,3 +9452,0.07065688073635101,0.35663294792175293,0.3721969425678253,0.23163460195064545,986.2869873046875,1e-05,0.0569525808095932,2.6040897369384766,23.927850246429443,3 +9453,0.20740491151809692,0.2585558295249939,0.2684328556060791,0.19173076748847961,987.8356323242188,1e-05,0.06455414742231369,2.371083974838257,23.927850246429443,3 +9454,0.2199801206588745,0.23985904455184937,0.2531154155731201,0.19346153736114502,294.342529296875,1e-05,0.08740276098251343,2.3574283123016357,23.927850246429443,3 +9455,0.1827908158302307,0.178772434592247,0.1698766052722931,0.23455128073692322,963.8278198242188,1e-05,0.06551945954561234,2.3599958419799805,23.927850246429443,3 +9456,0.14962267875671387,0.14554114639759064,0.13593818247318268,0.26326921582221985,840.4324951171875,1e-05,0.07020588219165802,2.677724838256836,23.927850246429443,3 +9457,0.16675147414207458,0.3562547564506531,0.3590982258319855,0.18695512413978577,995.3138427734375,1e-05,0.0728122740983963,2.510526418685913,23.927850246429443,3 +9458,0.1617252379655838,0.24319308996200562,0.2288842797279358,0.2368910163640976,982.9059448242188,1e-05,0.07999398559331894,2.4756805896759033,23.927850246429443,3 +9459,0.19693703949451447,0.23239149153232574,0.22778631746768951,0.1833653748035431,723.0185546875,1e-05,0.0700794979929924,2.358086347579956,23.927850246429443,3 +9460,0.2789604663848877,0.41403281688690186,0.41301706433296204,0.24487178027629852,228.7581787109375,1e-05,0.07032150775194168,2.347309112548828,23.927850246429443,3 +9461,0.20108401775360107,0.3402431905269623,0.3364783525466919,0.2624358832836151,322.7003173828125,1e-05,0.06730677932500839,2.5018739700317383,23.927850246429443,3 +9462,0.3521311283111572,0.24328301846981049,0.23667676746845245,0.20455127954483032,364.73089599609375,1e-05,0.08367601037025452,2.4725191593170166,23.927850246429443,3 +9463,0.1905582994222641,0.22109447419643402,0.21128813922405243,0.26198717951774597,809.2384033203125,1e-05,0.07415038347244263,2.3596951961517334,23.927850246429443,3 +9464,0.14245933294296265,0.14653700590133667,0.13866817951202393,0.184807687997818,883.6459350585938,1e-05,0.08663959056138992,2.3466546535491943,23.927850246429443,3 +9465,0.26724934577941895,0.1342502236366272,0.13670150935649872,0.25371792912483215,587.923828125,1e-05,0.07700895518064499,2.3485467433929443,23.927850246429443,3 +9466,0.2513805627822876,0.26016855239868164,0.2518231272697449,0.22660255432128906,951.2427978515625,1e-05,0.06604622304439545,2.452737331390381,23.927850246429443,3 +9467,0.10994993895292282,0.08587267249822617,0.09718918055295944,0.16419871151447296,961.7158813476562,1e-05,0.059681929647922516,2.5086312294006348,23.927850246429443,3 +9468,0.20170895755290985,0.1818624585866928,0.17246504127979279,0.22496794164180756,319.94049072265625,1e-05,0.080585777759552,2.6110692024230957,23.927850246429443,3 +9469,0.28039979934692383,0.11178402602672577,0.12041546404361725,0.2525961399078369,721.2352294921875,1e-05,0.08800964057445526,2.4748575687408447,23.927850246429443,3 +9470,0.21766088902950287,0.2881738543510437,0.2763632535934448,0.2666987180709839,952.09716796875,1e-05,0.06728999316692352,2.351444959640503,23.927850246429443,3 +9471,0.19371049106121063,0.22135242819786072,0.20889711380004883,0.26846152544021606,536.5296630859375,1e-05,0.06164126470685005,2.609506607055664,23.927850246429443,3 +9472,0.2415526807308197,0.12339910119771957,0.1222318485379219,0.1540384590625763,916.1324462890625,1e-05,0.08626823127269745,2.362375259399414,23.927850246429443,3 +9473,0.2610107660293579,0.5592715740203857,0.5554089546203613,0.20365384221076965,137.90036010742188,1e-05,0.08973164856433868,2.6428072452545166,23.927850246429443,3 +9474,0.08834045380353928,0.14474819600582123,0.14409728348255157,0.12807691097259521,653.6259765625,1e-05,0.059688203036785126,2.3591043949127197,23.927850246429443,3 +9475,0.24354447424411774,0.11758206784725189,0.11468205600976944,0.11169871687889099,888.7283325195312,1e-05,0.08105330169200897,2.358377695083618,23.927850246429443,3 +9476,0.17020010948181152,0.27010512351989746,0.26703140139579773,0.21211537718772888,414.4384765625,1e-05,0.09402086585760117,2.3587021827697754,23.927850246429443,3 +9477,0.19745904207229614,0.13218946754932404,0.13488566875457764,0.2703525424003601,793.128662109375,1e-05,0.06450700759887695,2.683511257171631,23.927850246429443,3 +9478,0.21805264055728912,0.2368106245994568,0.22359758615493774,0.22391024231910706,926.165771484375,1e-05,0.07683690637350082,2.537327289581299,23.927850246429443,3 +9479,0.0969339981675148,0.20854350924491882,0.19949105381965637,0.22182691097259521,827.1312866210938,1e-05,0.05970543250441551,2.3698534965515137,23.927850246429443,3 +9480,0.2945489287376404,0.32000917196273804,0.31569233536720276,0.22496794164180756,586.51806640625,1e-05,0.0716874971985817,2.490399122238159,23.927850246429443,3 +9481,0.20876501500606537,0.13764582574367523,0.14597061276435852,0.12198717147111893,947.775634765625,1e-05,0.06985452771186829,2.3562774658203125,23.927850246429443,3 +9482,0.3512035608291626,0.3011770248413086,0.29946333169937134,0.21230769157409668,418.88299560546875,1e-05,0.07203495502471924,2.4953553676605225,23.927850246429443,3 +9483,0.25474366545677185,0.19909679889678955,0.19445925951004028,0.18387819826602936,977.3124389648438,1e-05,0.06471264362335205,2.358318567276001,23.927850246429443,3 +9484,0.15413124859333038,0.24786785244941711,0.25370827317237854,0.19557692110538483,992.7984008789062,1e-05,0.062363654375076294,2.596550941467285,23.927850246429443,3 +9485,0.16540426015853882,0.37579599022865295,0.3694289028644562,0.302467942237854,984.94482421875,1e-05,0.07041307538747787,2.3502469062805176,23.927850246429443,3 +9486,0.23204748332500458,0.2911266088485718,0.286836177110672,0.2792307734489441,978.9678955078125,1e-05,0.07535608112812042,2.351172685623169,23.927850246429443,3 +9487,0.29539304971694946,0.20147021114826202,0.18953371047973633,0.26624998450279236,730.0333251953125,1e-05,0.05547819286584854,2.3486812114715576,23.927850246429443,3 +9488,0.1723988801240921,0.19161710143089294,0.181635782122612,0.20519229769706726,875.2998046875,1e-05,0.06451664119958878,2.675475597381592,23.927850246429443,3 +9489,0.2553054988384247,0.11693453788757324,0.1201886534690857,0.23685896396636963,708.4055786132812,1e-05,0.0641896054148674,2.629119396209717,23.927850246429443,3 +9490,0.15145878493785858,0.12671668827533722,0.1340925395488739,0.2403525561094284,877.0883178710938,1e-05,0.062207091599702835,2.4758458137512207,23.927850246429443,3 +9491,0.17279641330242157,0.14694106578826904,0.14296825230121613,0.25621792674064636,719.4397583007812,1e-05,0.06199822574853897,2.3699450492858887,23.927850246429443,3 +9492,0.09346579015254974,0.29054754972457886,0.30257678031921387,0.22903844714164734,981.0671997070312,1e-05,0.051174044609069824,2.365488052368164,23.927850246429443,3 +9493,0.13064689934253693,0.22801202535629272,0.2239856719970703,0.26913461089134216,460.8586120605469,1e-05,0.06079419329762459,2.632784128189087,23.927850246429443,3 +9494,0.2904892861843109,0.23903875052928925,0.2296769767999649,0.22737178206443787,815.9722900390625,1e-05,0.07462423294782639,2.5494730472564697,23.927850246429443,3 +9495,0.2385300099849701,0.3080091178417206,0.3059859871864319,0.24432691931724548,291.41107177734375,1e-05,0.059040263295173645,2.3702218532562256,23.927850246429443,3 +9496,0.22093848884105682,0.21670523285865784,0.21225665509700775,0.17807692289352417,757.8740844726562,1e-05,0.06226099282503128,2.355013370513916,23.927850246429443,3 +9497,0.24246834218502045,0.13444912433624268,0.13704070448875427,0.18858973681926727,512.9716796875,1e-05,0.07067269086837769,2.3534955978393555,23.927850246429443,3 +9498,0.1775851994752884,0.1938970685005188,0.19033710658550262,0.21666665375232697,701.75439453125,1e-05,0.08113551884889603,2.486009359359741,23.927850246429443,3 +9499,0.15849635004997253,0.1437726467847824,0.14212121069431305,0.12342948466539383,746.7793579101562,1e-05,0.061406202614307404,2.5870912075042725,23.927850246429443,3 +9500,0.2650216519832611,0.5187810063362122,0.5209077596664429,0.23493589460849762,187.07484436035156,1e-05,0.06113624945282936,2.508875846862793,23.927850246429443,3 +9501,0.1581602245569229,0.2162986546754837,0.21171444654464722,0.2318589687347412,647.8805541992188,1e-05,0.05980946123600006,2.6021478176116943,23.927850246429443,3 +9502,0.09122002869844437,0.3031071424484253,0.2859378755092621,0.18724358081817627,979.6713256835938,1e-05,0.07348176836967468,2.3595104217529297,23.927850246429443,3 +9503,0.32595381140708923,0.4351920187473297,0.43660858273506165,0.21166665852069855,211.79405212402344,1e-05,0.06756425648927689,2.4914612770080566,23.927850246429443,3 +9504,0.1270557940006256,0.23379021883010864,0.2232113629579544,0.21535255014896393,873.039794921875,1e-05,0.06327833235263824,2.3558053970336914,23.927850246429443,3 +9505,0.048625148832798004,0.17221978306770325,0.17053988575935364,0.24333332479000092,974.4267578125,1e-05,0.0612330362200737,2.5105462074279785,23.927850246429443,3 +9506,0.23536810278892517,0.31661689281463623,0.31685778498649597,0.16538460552692413,257.9365234375,1e-05,0.06543826311826706,2.352541446685791,23.927850246429443,3 +9507,0.1554466038942337,0.09279794991016388,0.09632313996553421,0.18147435784339905,769.2307739257812,1e-05,0.08837458491325378,2.3468177318573,23.927850246429443,3 +9508,0.2362459897994995,0.7777336835861206,0.7908143997192383,0.21676281094551086,52.6819953918457,1e-05,0.06625603139400482,2.3476603031158447,23.927850246429443,3 +9509,0.14636071026325226,0.28283509612083435,0.273669570684433,0.17141024768352509,959.3023071289062,1e-05,0.06681287288665771,2.7481722831726074,23.927850246429443,3 +9510,0.24122808873653412,0.16818304359912872,0.1738601177930832,0.23916666209697723,965.6505737304688,1e-05,0.07216450572013855,2.5191280841827393,23.927850246429443,3 +9511,0.27135521173477173,0.3673757314682007,0.36118727922439575,0.2535576820373535,328.1711120605469,1e-05,0.07000582665205002,2.5111312866210938,23.927850246429443,3 +9512,0.19869251549243927,0.16655553877353668,0.16010689735412598,0.29073718190193176,948.3590698242188,1e-05,0.06651964038610458,2.357304573059082,23.927850246429443,3 +9513,0.21763958036899567,0.14841119945049286,0.14719627797603607,0.23067307472229004,779.3674926757812,1e-05,0.07230081409215927,2.3446738719940186,23.927850246429443,3 +9514,0.17011365294456482,0.11442216485738754,0.1108795553445816,0.27012819051742554,838.2740478515625,1e-05,0.06977612525224686,2.6229522228240967,23.927850246429443,3 +9515,0.24572914838790894,0.21745431423187256,0.20772026479244232,0.1983012706041336,756.319091796875,1e-05,0.0704512819647789,2.350675106048584,23.927850246429443,3 +9516,0.24205715954303741,0.2226545661687851,0.20696806907653809,0.29374998807907104,934.6619262695312,1e-05,0.06643754988908768,2.345285654067993,23.927850246429443,3 +9517,0.16684503853321075,0.12443707883358002,0.12449788302183151,0.2394871711730957,747.5884399414062,1e-05,0.06659023463726044,2.3418338298797607,23.927850246429443,3 +9518,0.15534351766109467,0.21234969794750214,0.20171384513378143,0.2260897308588028,587.923828125,1e-05,0.06645484268665314,2.348522663116455,23.927850246429443,3 +9519,0.26370248198509216,0.09258022159337997,0.09555434435606003,0.2882051169872284,802.9328002929688,1e-05,0.06587506085634232,2.3428778648376465,23.927850246429443,3 +9520,0.25177425146102905,0.21762233972549438,0.2074367254972458,0.23339742422103882,807.9915161132812,1e-05,0.07276628166437149,2.555651903152466,23.927850246429443,3 +9521,0.22322018444538116,0.23198524117469788,0.21395455300807953,0.24535255134105682,336.25732421875,1e-05,0.07416955381631851,2.58827805519104,23.927850246429443,3 +9522,0.2157966047525406,0.13847199082374573,0.12776592373847961,0.22499999403953552,643.2039184570312,1e-05,0.06447014212608337,2.5585014820098877,23.927850246429443,3 +9523,0.17741169035434723,0.19967587292194366,0.18341396749019623,0.2470192164182663,816.57421875,1e-05,0.07800216972827911,2.355926275253296,23.927850246429443,3 +9524,0.35775306820869446,0.2591412663459778,0.2523948848247528,0.1961858868598938,436.19793701171875,1e-05,0.07783474773168564,2.3502886295318604,23.927850246429443,3 +9525,0.23250961303710938,0.12467826902866364,0.12727783620357513,0.2536858916282654,720.3389282226562,1e-05,0.06469278782606125,2.5287270545959473,23.927850246429443,3 +9526,0.1806258261203766,0.15342554450035095,0.15630722045898438,0.2729487121105194,681.8181762695312,1e-05,0.0666336864233017,2.488018274307251,23.927850246429443,3 +9527,0.25171416997909546,0.13925474882125854,0.13697516918182373,0.2493269145488739,907.3464965820312,1e-05,0.07155177742242813,2.3574438095092773,23.927850246429443,3 +9528,0.229853093624115,0.2291622906923294,0.21963317692279816,0.22586537897586823,918.9618530273438,1e-05,0.07374540716409683,2.358078718185425,23.927850246429443,3 +9529,0.19118273258209229,0.3399641215801239,0.3315655589103699,0.2243589609861374,564.6929931640625,1e-05,0.06962677091360092,2.3550667762756348,23.927850246429443,3 +9530,0.21659120917320251,0.22561797499656677,0.20504702627658844,0.2536858916282654,956.5726318359375,1e-05,0.08962826430797577,2.6944785118103027,23.927850246429443,3 +9531,0.20857319235801697,0.16726034879684448,0.17017175257205963,0.13961538672447205,549.327392578125,1e-05,0.06971196830272675,2.3627123832702637,23.927850246429443,3 +9532,0.22640402615070343,0.2600648105144501,0.2538570165634155,0.23830127716064453,784.97021484375,1e-05,0.06702790409326553,2.6196861267089844,23.927850246429443,3 +9533,0.26875850558280945,0.20581355690956116,0.19525673985481262,0.1739102452993393,951.2427978515625,1e-05,0.06683922559022903,2.5177435874938965,23.927850246429443,3 +9534,0.21350209414958954,0.15435834228992462,0.1513979285955429,0.2563782036304474,838.2740478515625,1e-05,0.07487116754055023,2.350808620452881,23.927850246429443,3 +9535,0.2174408882856369,0.20177045464515686,0.21091362833976746,0.25881409645080566,446.65814208984375,1e-05,0.07815124839544296,2.3557558059692383,23.927850246429443,3 +9536,0.22142243385314941,0.185015007853508,0.17976579070091248,0.2396794855594635,678.7020263671875,1e-05,0.0865759328007698,2.866222620010376,23.927850246429443,3 +9537,0.2973760962486267,0.15343260765075684,0.15246367454528809,0.24028845131397247,646.7181396484375,1e-05,0.07786521315574646,2.362424612045288,23.927850246429443,3 +9538,0.24103514850139618,0.20195652544498444,0.19920815527439117,0.1419871747493744,987.8356323242188,1e-05,0.07882817834615707,2.352741241455078,23.927850246429443,3 +9539,0.19403676688671112,0.24824072420597076,0.2531152069568634,0.09330128133296967,997.5768432617188,1e-05,0.07456657290458679,2.3516032695770264,23.927850246429443,3 +9540,0.26777371764183044,0.16232487559318542,0.16970838606357574,0.16355769336223602,418.88299560546875,1e-05,0.10490716248750687,2.3460159301757812,23.927850246429443,3 +9541,0.26956072449684143,0.24430686235427856,0.233578160405159,0.19939102232456207,583.6886596679688,1e-05,0.08040349930524826,2.6861233711242676,23.927850246429443,3 +9542,0.1810864955186844,0.19024905562400818,0.20686686038970947,0.21012820303440094,999.3985595703125,1e-05,0.0631396621465683,2.359260082244873,23.927850246429443,3 +9543,0.1905643492937088,0.21976366639137268,0.21213838458061218,0.2532051205635071,941.5103759765625,1e-05,0.08095123618841171,2.5589439868927,23.927850246429443,3 +9544,0.2315409779548645,0.16013731062412262,0.17296884953975677,0.2258012741804123,440.41455078125,1e-05,0.07037315517663956,2.5411581993103027,23.927850246429443,3 +9545,0.29606232047080994,0.36638668179512024,0.36320987343788147,0.19971153140068054,248.39744567871094,1e-05,0.07415209710597992,2.352672576904297,23.927850246429443,3 +9546,0.12131384760141373,0.1423453688621521,0.1346057504415512,0.19458332657814026,908.0963134765625,1e-05,0.06430438160896301,2.5330300331115723,23.927850246429443,3 +9547,0.19209179282188416,0.19330912828445435,0.1812288761138916,0.2749038338661194,949.5192260742188,1e-05,0.07204815745353699,2.472775459289551,23.927850246429443,3 +9548,0.16689687967300415,0.20974652469158173,0.2109357863664627,0.17993588745594025,529.9539794921875,1e-05,0.07806709408760071,2.3530755043029785,23.927850246429443,3 +9549,0.267583966255188,0.2612960636615753,0.25464656949043274,0.21858973801136017,797.7569580078125,1e-05,0.06880484521389008,2.3465824127197266,23.927850246429443,3 +9550,0.15765076875686646,0.053317319601774216,0.05776841938495636,0.16041666269302368,922.088134765625,1e-05,0.07038352638483047,2.3548524379730225,23.927850246429443,3 +9551,0.21690218150615692,0.22348864376544952,0.21689167618751526,0.22769230604171753,505.9523620605469,1e-05,0.06454430520534515,2.346346139907837,23.927850246429443,3 +9552,0.2513347864151001,0.28419557213783264,0.2782285511493683,0.2549999952316284,458.8607482910156,1e-05,0.07409598678350449,2.534487247467041,23.927850246429443,3 +9553,0.23750784993171692,0.18678605556488037,0.1773371398448944,0.2952243387699127,799.0620727539062,1e-05,0.07491772621870041,2.4938535690307617,23.927850246429443,3 +9554,0.2748863697052002,0.1792120635509491,0.16198690235614777,0.23733973503112793,877.0883178710938,1e-05,0.07462568581104279,2.5711660385131836,23.927850246429443,3 +9555,0.1827617734670639,0.06671515107154846,0.07419946044683456,0.1298397332429886,941.8146362304688,1e-05,0.05830012261867523,2.3501534461975098,23.927850246429443,3 +9556,0.2507573366165161,0.32915198802948,0.3283851742744446,0.24298076331615448,429.7900695800781,1e-05,0.0703546330332756,2.3481719493865967,23.927850246429443,3 +9557,0.19661661982536316,0.16121822595596313,0.15346312522888184,0.22535255551338196,829.4078369140625,1e-05,0.06960906833410263,2.5263075828552246,23.927850246429443,3 +9558,0.14104166626930237,0.1654338538646698,0.17037618160247803,0.21570512652397156,668.0632934570312,1e-05,0.06417092680931091,2.5939276218414307,23.927850246429443,3 +9559,0.1453891396522522,0.24864280223846436,0.24466247856616974,0.25198715925216675,429.7900695800781,1e-05,0.06487211585044861,2.3540849685668945,23.927850246429443,3 +9560,0.16086047887802124,0.2611829340457916,0.2507791519165039,0.29076921939849854,981.5291137695312,1e-05,0.0636531412601471,2.3491950035095215,23.927850246429443,3 +9561,0.1318240612745285,0.19515730440616608,0.19493670761585236,0.2580128014087677,938.1237182617188,1e-05,0.07303597778081894,2.3512349128723145,23.927850246429443,3 +9562,0.20777928829193115,0.14564408361911774,0.15295296907424927,0.23102563619613647,806.1080322265625,1e-05,0.07166481763124466,2.4599335193634033,23.927850246429443,3 +9563,0.22400635480880737,0.24708016216754913,0.24151866137981415,0.2200961410999298,764.7515258789062,1e-05,0.07494132220745087,2.364267587661743,23.927850246429443,3 +9564,0.10166503489017487,0.09709523618221283,0.10308346152305603,0.30185896158218384,802.292236328125,1e-05,0.0614495724439621,2.5013015270233154,23.927850246429443,3 +9565,0.3974505364894867,0.2552351951599121,0.2456727772951126,0.18073716759681702,558.6282348632812,1e-05,0.06801847368478775,2.485384941101074,23.927850246429443,3 +9566,0.18828612565994263,0.21848881244659424,0.21494464576244354,0.19852563738822937,944.52587890625,1e-05,0.0639798641204834,2.3528213500976562,23.927850246429443,3 +9567,0.32358527183532715,0.23031659424304962,0.23032620549201965,0.16894230246543884,592.105224609375,1e-05,0.06340537965297699,2.5976524353027344,23.927850246429443,3 +9568,0.1939547210931778,0.13538531959056854,0.13363885879516602,0.27060896158218384,509.47869873046875,1e-05,0.06491490453481674,2.4702625274658203,23.927850246429443,3 +9569,0.21094094216823578,0.09879479557275772,0.10107716172933578,0.22227562963962555,852.9224853515625,1e-05,0.07440169900655746,2.3560144901275635,23.927850246429443,3 +9570,0.1312241107225418,0.21684512495994568,0.20297129452228546,0.21621793508529663,961.1829223632812,1e-05,0.06434070318937302,2.3545761108398438,23.927850246429443,3 +9571,0.22074832022190094,0.2230868935585022,0.20981256663799286,0.2889743447303772,960.6482543945312,1e-05,0.06737489253282547,2.3501436710357666,23.927850246429443,3 +9572,0.12683852016925812,0.14917688071727753,0.13561907410621643,0.20685896277427673,876.6427001953125,1e-05,0.08093268424272537,2.3507533073425293,23.927850246429443,3 +9573,0.2387993037700653,0.3165511190891266,0.32357257604599,0.10016025602817535,245.17686462402344,1e-05,0.060415107756853104,2.596069812774658,23.927850246429443,3 +9574,0.19674865901470184,0.16550835967063904,0.15627484023571014,0.25923076272010803,949.22998046875,1e-05,0.07211557775735855,2.353904962539673,23.927850246429443,3 +9575,0.14243699610233307,0.1955990493297577,0.18964776396751404,0.17887820303440094,967.7055053710938,1e-05,0.07557186484336853,2.614483118057251,23.927850246429443,3 +9576,0.17585599422454834,0.08164151757955551,0.0873025506734848,0.19910255074501038,799.7118530273438,1e-05,0.07876626402139664,2.35551381111145,23.927850246429443,3 +9577,0.24234546720981598,0.0761827677488327,0.0802086740732193,0.10602563619613647,811.7109985351562,1e-05,0.0742572471499443,2.349703550338745,23.927850246429443,3 +9578,0.18587283790111542,0.2952715754508972,0.29673779010772705,0.2522115409374237,964.0897216796875,1e-05,0.06562042981386185,2.5175092220306396,23.927850246429443,3 +9579,0.18718171119689941,0.22197170555591583,0.21934106945991516,0.2065064013004303,699.823974609375,1e-05,0.0766785740852356,2.6021525859832764,23.927850246429443,3 +9580,0.1835978627204895,0.22295521199703217,0.22561782598495483,0.26653844118118286,973.2064208984375,1e-05,0.10819823294878006,2.3483400344848633,23.927850246429443,3 +9581,0.148712158203125,0.2625155746936798,0.25366929173469543,0.24243588745594025,960.9158325195312,1e-05,0.06809636205434799,2.352139711380005,23.927850246429443,3 +9582,0.1439618468284607,0.17396757006645203,0.16323934495449066,0.24019229412078857,862.7633056640625,1e-05,0.07602589577436447,2.3535921573638916,23.927850246429443,3 +9583,0.15109768509864807,0.11374279856681824,0.11556363850831985,0.24358972907066345,921.3984985351562,1e-05,0.06614510715007782,2.356250524520874,23.927850246429443,3 +9584,0.16931362450122833,0.16936278343200684,0.173831969499588,0.1945512741804123,702.7145385742188,1e-05,0.07262784987688065,2.5814836025238037,23.927850246429443,3 +9585,0.24594302475452423,0.22060184180736542,0.20184682309627533,0.23826922476291656,872.5845947265625,1e-05,0.06550653278827667,2.3599331378936768,23.927850246429443,3 +9586,0.2953881323337555,0.4312755763530731,0.42602595686912537,0.211410254240036,285.49383544921875,1e-05,0.06825573742389679,2.610421895980835,23.927850246429443,3 +9587,0.188462033867836,0.23831574618816376,0.23777785897254944,0.260608971118927,900.0560302734375,1e-05,0.07639308273792267,2.3580055236816406,23.927850246429443,3 +9588,0.30429738759994507,0.15834027528762817,0.15621688961982727,0.16499999165534973,674.4935913085938,1e-05,0.10525113344192505,2.3593900203704834,23.927850246429443,3 +9589,0.16132788360118866,0.16682898998260498,0.15716975927352905,0.1276922971010208,918.259033203125,1e-05,0.06798753887414932,2.6249070167541504,23.927850246429443,3 +9590,0.19264383614063263,0.11243944615125656,0.1170080155134201,0.1948397308588028,612.2449340820312,1e-05,0.08030401170253754,2.4836666584014893,23.927850246429443,3 +9591,0.12044891715049744,0.22215622663497925,0.21508462727069855,0.20169870555400848,984.94482421875,1e-05,0.061200354248285294,2.3522884845733643,23.927850246429443,3 +9592,0.21333344280719757,0.15727224946022034,0.15263234078884125,0.274487167596817,805.4765625,1e-05,0.07166007906198502,2.3533027172088623,23.927850246429443,3 +9593,0.24809765815734863,0.13925616443157196,0.1376059353351593,0.2962820529937744,908.8427124023438,1e-05,0.07800082862377167,2.349696159362793,23.927850246429443,3 +9594,0.2033795416355133,0.17757292091846466,0.1727248579263687,0.24887819588184357,925.8298950195312,1e-05,0.0798501968383789,2.3555545806884766,23.927850246429443,3 +9595,0.28569385409355164,0.17413054406642914,0.16599352657794952,0.18131409585475922,931.1224365234375,1e-05,0.07445143908262253,2.511993885040283,23.927850246429443,3 +9596,0.17973238229751587,0.24189147353172302,0.23341481387615204,0.2521474361419678,894.0774536132812,1e-05,0.07305344939231873,2.7418596744537354,23.927850246429443,3 +9597,0.20885160565376282,0.2029566764831543,0.19824406504631042,0.23644229769706726,943.0255737304688,1e-05,0.0862758532166481,2.357534885406494,23.927850246429443,3 +9598,0.17943666875362396,0.2076650708913803,0.2065976858139038,0.16365383565425873,867.5030517578125,1e-05,0.07226446270942688,2.353242874145508,23.927850246429443,3 +9599,0.16048921644687653,0.13288788497447968,0.13062971830368042,0.204679474234581,938.1237182617188,1e-05,0.06443924456834793,2.3471360206604004,23.927850246429443,3 +9600,0.30018165707588196,0.2398255467414856,0.23034486174583435,0.164166659116745,751.5949096679688,1e-05,0.06879812479019165,2.70662522315979,23.927850246429443,3 +9601,0.11280118674039841,0.6711344718933105,0.6726677417755127,0.2362179458141327,24.50980567932129,1e-05,0.0576561875641346,2.3596127033233643,23.927850246429443,3 +9602,0.17053844034671783,0.15394186973571777,0.1526721566915512,0.11628204584121704,964.3510131835938,1e-05,0.07029039412736893,2.346365451812744,23.927850246429443,3 +9603,0.11828335374593735,0.15759219229221344,0.1481402963399887,0.14810897409915924,861.318359375,1e-05,0.05728583037853241,2.3478355407714844,23.927850246429443,3 +9604,0.26232942938804626,0.1845449060201645,0.18084008991718292,0.24214743077754974,472.6368408203125,1e-05,0.07154545933008194,2.344404458999634,23.927850246429443,3 +9605,0.15163332223892212,0.17383524775505066,0.18513265252113342,0.21669870615005493,772.9007568359375,1e-05,0.06552346050739288,2.4780993461608887,23.927850246429443,3 +9606,0.23971405625343323,0.24178573489189148,0.2393854707479477,0.22778844833374023,718.5374145507812,1e-05,0.07216712832450867,2.4823970794677734,23.927850246429443,3 +9607,0.18778105080127716,0.13224206864833832,0.1396096795797348,0.20067307353019714,956.2970581054688,1e-05,0.06627378612756729,2.6004257202148438,23.927850246429443,3 +9608,0.14145715534687042,0.14134390652179718,0.14094112813472748,0.20278845727443695,979.9048461914062,1e-05,0.06475383788347244,2.34667706489563,23.927850246429443,3 +9609,0.12526766955852509,0.18858321011066437,0.19469259679317474,0.16737179458141327,423.2804260253906,1e-05,0.06072218716144562,2.343890905380249,23.927850246429443,3 +9610,0.1864255666732788,0.22911179065704346,0.21506339311599731,0.2278205007314682,881.919921875,1e-05,0.06623965501785278,2.6215245723724365,23.927850246429443,3 +9611,0.09826154261827469,0.14366601407527924,0.14740684628486633,0.17195512354373932,813.5474853515625,1e-05,0.05876366049051285,2.4792368412017822,23.927850246429443,3 +9612,0.2293986827135086,0.1537569761276245,0.14731311798095703,0.2279166579246521,947.4830322265625,1e-05,0.07022900134325027,2.349820137023926,23.927850246429443,3 +9613,0.2298402637243271,0.13535024225711823,0.13961835205554962,0.264455109834671,684.9005737304688,1e-05,0.0635703057050705,2.3523316383361816,23.927850246429443,3 +9614,0.18855679035186768,0.06168721243739128,0.06673448532819748,0.18131409585475922,770.7055053710938,1e-05,0.07017959654331207,2.352651357650757,23.927850246429443,3 +9615,0.4172089397907257,0.11374668031930923,0.11396405845880508,0.1557692289352417,423.2804260253906,1e-05,0.09216628223657608,2.348123788833618,23.927850246429443,3 +9616,0.1184726357460022,0.18858957290649414,0.18286924064159393,0.20339742302894592,881.919921875,1e-05,0.07685986906290054,2.7244985103607178,23.927850246429443,3 +9617,0.22088667750358582,0.1673201620578766,0.15944306552410126,0.2251282036304474,839.3560791015625,1e-05,0.06662800163030624,2.5780158042907715,23.927850246429443,3 +9618,0.1808960884809494,0.24729953706264496,0.22846725583076477,0.26019230484962463,959.0316162109375,1e-05,0.0804210752248764,2.348904609680176,23.927850246429443,3 +9619,0.23334965109825134,0.9319179058074951,0.9410975575447083,0.18182691931724548,48.076927185058594,1e-05,0.05802714824676514,2.348680019378662,23.927850246429443,3 +9620,0.24539944529533386,0.15747375786304474,0.1562783420085907,0.1033012792468071,754.75439453125,1e-05,0.062048010528087616,2.5153908729553223,23.927850246429443,3 +9621,0.20629587769508362,0.27717551589012146,0.26823827624320984,0.2865384519100189,393.8356018066406,1e-05,0.07007132470607758,2.3649075031280518,23.927850246429443,3 +9622,0.16173100471496582,0.07233662903308868,0.08363023400306702,0.20916666090488434,519.8598022460938,1e-05,0.06597526371479034,2.3529694080352783,23.927850246429443,3 +9623,0.20224998891353607,0.21965162456035614,0.225815087556839,0.13333332538604736,956.8480224609375,1e-05,0.06522150337696075,2.3518621921539307,23.927850246429443,3 +9624,0.1680387258529663,0.24752582609653473,0.2284238040447235,0.252692312002182,965.3915405273438,1e-05,0.06815988570451736,2.349649429321289,23.927850246429443,3 +9625,0.2613292336463928,0.1535036563873291,0.1672092229127884,0.19237178564071655,610.940673828125,1e-05,0.07390748709440231,2.348388671875,23.927850246429443,3 +9626,0.14882783591747284,0.1600421518087387,0.15610313415527344,0.20227563381195068,776.5151977539062,1e-05,0.06673137843608856,2.35189151763916,23.927850246429443,3 +9627,0.18557219207286835,0.24690653383731842,0.24081717431545258,0.26624998450279236,988.0552978515625,1e-05,0.07110362499952316,2.6293599605560303,23.927850246429443,3 +9628,0.20673994719982147,0.11726075410842896,0.11153359711170197,0.22182691097259521,810.4782104492188,1e-05,0.061338458210229874,2.5030415058135986,23.927850246429443,3 +9629,0.2104795128107071,0.1618954837322235,0.154238760471344,0.24512819945812225,939.9801635742188,1e-05,0.067112497985363,2.356424331665039,23.927850246429443,3 +9630,0.15836456418037415,0.12226635962724686,0.12949350476264954,0.10641025006771088,512.9716796875,1e-05,0.07022435963153839,2.3568403720855713,23.927850246429443,3 +9631,0.16474008560180664,0.08871079981327057,0.09404776990413666,0.1548076868057251,844.1558227539062,1e-05,0.06148136407136917,2.5461032390594482,23.927850246429443,3 +9632,0.19824650883674622,0.19109730422496796,0.19248631596565247,0.22128205001354218,655.8935546875,1e-05,0.06433994323015213,2.4790966510772705,23.927850246429443,3 +9633,0.21850745379924774,0.2563399076461792,0.2533186972141266,0.17035256326198578,896.8926391601562,1e-05,0.06837569177150726,2.375697612762451,23.927850246429443,4 +9634,0.30588284134864807,0.22269213199615479,0.22356556355953217,0.2071794867515564,458.8607482910156,1e-05,0.07929404824972153,2.3509764671325684,23.927850246429443,4 +9635,0.29245004057884216,0.2512769103050232,0.24486422538757324,0.1889422982931137,618.6868286132812,1e-05,0.060095787048339844,2.3563168048858643,23.927850246429443,4 +9636,0.15680471062660217,0.046100910753011703,0.05240905284881592,0.13977563381195068,884.9298706054688,1e-05,0.06242090463638306,2.35479998588562,23.927850246429443,4 +9637,0.3082526624202728,0.2868318557739258,0.2837271988391876,0.16833332180976868,519.8598022460938,1e-05,0.07328104972839355,2.450493812561035,23.927850246429443,4 +9638,0.15420293807983398,0.26846715807914734,0.24278658628463745,0.2350640892982483,935.2970581054688,1e-05,0.07301083952188492,2.718106746673584,23.927850246429443,4 +9639,0.27488893270492554,0.14396154880523682,0.14051637053489685,0.2528204917907715,733.4710693359375,1e-05,0.0685340091586113,2.356518030166626,23.927850246429443,4 +9640,0.24509984254837036,0.16872026026248932,0.16647541522979736,0.16528844833374023,538.1549072265625,1e-05,0.07114526629447937,2.348621129989624,23.927850246429443,4 +9641,0.27875858545303345,0.1449645757675171,0.1409084051847458,0.2755448520183563,827.7026977539062,1e-05,0.07888131588697433,2.4938857555389404,23.927850246429443,4 +9642,0.2574980854988098,0.24529191851615906,0.24103493988513947,0.29317307472229004,655.8935546875,1e-05,0.06128460168838501,2.6049816608428955,23.927850246429443,4 +9643,0.3477557301521301,0.2079148292541504,0.1983153074979782,0.28910255432128906,804.8433837890625,1e-05,0.06319420039653778,2.357056140899658,23.927850246429443,4 +9644,0.09172052890062332,0.4073687791824341,0.39891180396080017,0.20509614050388336,996.3473510742188,1e-05,0.06796661019325256,2.3510196208953857,23.927850246429443,4 +9645,0.26291507482528687,0.19477233290672302,0.206431582570076,0.21698717772960663,955.4664916992188,1e-05,0.06964930146932602,2.351454734802246,23.927850246429443,4 +9646,0.248101145029068,0.11111345887184143,0.11987125873565674,0.17605768144130707,779.3674926757812,1e-05,0.07265478372573853,2.342895030975342,23.927850246429443,4 +9647,0.19790524244308472,0.17757469415664673,0.1657828390598297,0.2556730806827545,988.7123413085938,1e-05,0.06992669403553009,2.34732723236084,23.927850246429443,4 +9648,0.27593085169792175,0.3426800072193146,0.3396455943584442,0.10516025125980377,208.3333282470703,1e-05,0.06141112372279167,2.5512583255767822,23.927850246429443,4 +9649,0.20449161529541016,0.0863962396979332,0.09280956536531448,0.20749999582767487,786.3502197265625,1e-05,0.07143771648406982,2.5027999877929688,23.927850246429443,4 +9650,0.22351837158203125,0.16576848924160004,0.15685802698135376,0.25910255312919617,868.9024658203125,1e-05,0.0679633840918541,2.349010467529297,23.927850246429443,4 +9651,0.15370267629623413,0.19091618061065674,0.19388911128044128,0.2524038255214691,311.56158447265625,1e-05,0.06238142028450966,2.3481252193450928,23.927850246429443,4 +9652,0.29043394327163696,0.2565913796424866,0.26230311393737793,0.21410255134105682,915.4175415039062,1e-05,0.0785280391573906,2.6153295040130615,23.927850246429443,4 +9653,0.3183088004589081,0.2575252652168274,0.2589567303657532,0.3053846061229706,674.4935913085938,1e-05,0.054353371262550354,2.4673967361450195,23.927850246429443,4 +9654,0.08694511651992798,0.17455780506134033,0.16499297320842743,0.2582051157951355,945.7156982421875,1e-05,0.0758691355586052,2.364264726638794,23.927850246429443,4 +9655,0.2156236320734024,0.059702444821596146,0.05826512351632118,0.09554486721754074,873.039794921875,1e-05,0.06980086117982864,2.3523576259613037,23.927850246429443,4 +9656,0.3031740188598633,0.41080522537231445,0.40860459208488464,0.20942306518554688,215.23179626464844,1e-05,0.07989614456892014,2.348639488220215,23.927850246429443,4 +9657,0.21291740238666534,0.36984220147132874,0.3626822829246521,0.25554487109184265,994.6895141601562,1e-05,0.060577720403671265,2.3494741916656494,23.927850246429443,4 +9658,0.32359856367111206,0.19604326784610748,0.19005092978477478,0.146217942237854,787.0369873046875,1e-05,0.06743503361940384,2.4626340866088867,23.927850246429443,4 +9659,0.11383441090583801,0.5559090971946716,0.58077073097229,0.18666665256023407,75.18797302246094,1e-05,0.07022404670715332,2.6246814727783203,23.927850246429443,4 +9660,0.26622021198272705,0.18056795001029968,0.17586874961853027,0.20144230127334595,784.2772827148438,1e-05,0.06712300330400467,2.3514010906219482,23.927850246429443,4 +9661,0.16597090661525726,0.13347181677818298,0.12508192658424377,0.24910254776477814,744.3366088867188,1e-05,0.07418666034936905,2.351818561553955,23.927850246429443,4 +9662,0.1442086100578308,0.23544499278068542,0.23514153063297272,0.18589742481708527,973.4513549804688,1e-05,0.06643866002559662,2.353957176208496,23.927850246429443,4 +9663,0.12229526042938232,0.15126731991767883,0.14381055533885956,0.07967948168516159,943.0255737304688,1e-05,0.0648055449128151,2.5905091762542725,23.927850246429443,4 +9664,0.13362222909927368,0.13802829384803772,0.13883686065673828,0.26384615898132324,844.1558227539062,1e-05,0.06191875413060188,2.5840725898742676,23.927850246429443,4 +9665,0.11320862919092178,0.14962942898273468,0.14695510268211365,0.24714742600917816,804.8433837890625,1e-05,0.052788760513067245,2.3557801246643066,23.927850246429443,4 +9666,0.2271522432565689,0.29888638854026794,0.29132145643234253,0.1873076856136322,900.4474487304688,1e-05,0.07391075044870377,2.351050853729248,23.927850246429443,4 +9667,0.11989615857601166,0.20381872355937958,0.19084706902503967,0.26387819647789,800.3597412109375,1e-05,0.06642758846282959,2.3496785163879395,23.927850246429443,4 +9668,0.10450129956007004,0.08268316090106964,0.09385094046592712,0.1371474266052246,972.2222290039062,1e-05,0.056985724717378616,2.3487114906311035,23.927850246429443,4 +9669,0.17403142154216766,0.2655031979084015,0.2554406523704529,0.1882692277431488,980.13818359375,1e-05,0.06286948919296265,2.606686592102051,23.927850246429443,4 +9670,0.1623210608959198,0.23763054609298706,0.2608529329299927,0.17701922357082367,989.3660888671875,1e-05,0.07317370921373367,2.5082173347473145,23.927850246429443,4 +9671,0.2574624717235565,0.24805839359760284,0.24931536614894867,0.24608974158763885,598.9583129882812,1e-05,0.06237434595823288,2.348264455795288,23.927850246429443,4 +9672,0.10316997766494751,0.4364083707332611,0.44690847396850586,0.20096153020858765,96.86347198486328,1e-05,0.0670737624168396,2.3497262001037598,23.927850246429443,4 +9673,0.20644903182983398,0.12700554728507996,0.12496166676282883,0.19499999284744263,850.8939819335938,1e-05,0.0609339103102684,2.6100897789001465,23.927850246429443,4 +9674,0.2273789644241333,0.5482681393623352,0.5714658498764038,0.17522434890270233,88.28997039794922,1e-05,0.06926627457141876,2.469788074493408,23.927850246429443,4 +9675,0.0899619311094284,0.22340969741344452,0.22023168206214905,0.15166665613651276,896.8926391601562,1e-05,0.0702189952135086,2.3505992889404297,23.927850246429443,4 +9676,0.2839050889015198,0.12637761235237122,0.13387665152549744,0.24996793270111084,600.3118286132812,1e-05,0.07356788218021393,2.349661350250244,23.927850246429443,4 +9677,0.15542788803577423,0.26271939277648926,0.25083884596824646,0.16160255670547485,991.52197265625,1e-05,0.07081569731235504,2.347209930419922,23.927850246429443,4 +9678,0.29381415247917175,0.11221882700920105,0.11659809947013855,0.15685896575450897,926.165771484375,1e-05,0.06606414914131165,2.353092908859253,23.927850246429443,4 +9679,0.16545720398426056,0.4809054732322693,0.4759453535079956,0.24192306399345398,987.174072265625,1e-05,0.06983926892280579,2.4664981365203857,23.927850246429443,4 +9680,0.15089985728263855,0.1262941211462021,0.14935974776744843,0.23102563619613647,982.9059448242188,1e-05,0.07781622558832169,2.5816116333007812,23.927850246429443,4 +9681,0.17647281289100647,0.24530422687530518,0.24669861793518066,0.18907050788402557,476.4851989746094,1e-05,0.06427370756864548,2.347693920135498,23.927850246429443,4 +9682,0.20433713495731354,0.25562816858291626,0.24480456113815308,0.26615384221076965,372.1910095214844,1e-05,0.062452610582113266,2.351989269256592,23.927850246429443,4 +9683,0.24800650775432587,0.08142930269241333,0.0858512669801712,0.1050320491194725,689.9642333984375,1e-05,0.08033286035060883,2.48871111869812,23.927850246429443,4 +9684,0.2983059585094452,0.21663253009319305,0.2064872533082962,0.24051281809806824,627.4900512695312,1e-05,0.06833073496818542,2.348235845565796,23.927850246429443,4 +9685,0.1378200501203537,0.2337670922279358,0.22582654654979706,0.26653844118118286,853.9290161132812,1e-05,0.06054184213280678,2.6008174419403076,23.927850246429443,4 +9686,0.29499804973602295,0.1372966468334198,0.14179261028766632,0.23144230246543884,746.7793579101562,1e-05,0.07199408859014511,2.3519325256347656,23.927850246429443,4 +9687,0.1302662491798401,0.26074615120887756,0.25057312846183777,0.2786217927932739,873.4939575195312,1e-05,0.08901193737983704,2.3674967288970947,23.927850246429443,4 +9688,0.25017571449279785,0.23273958265781403,0.22205665707588196,0.2383333295583725,872.5845947265625,1e-05,0.06653954833745956,2.3524057865142822,23.927850246429443,4 +9689,0.11136875301599503,0.15822596848011017,0.15498144924640656,0.19294871389865875,839.89501953125,1e-05,0.0692133828997612,2.3507046699523926,23.927850246429443,4 +9690,0.21550917625427246,0.196010023355484,0.19360004365444183,0.268525630235672,802.292236328125,1e-05,0.06710175424814224,2.5782647132873535,23.927850246429443,4 +9691,0.11390972882509232,0.17371755838394165,0.16239960491657257,0.2844230532646179,940.900146484375,1e-05,0.06307534128427505,2.700178384780884,23.927850246429443,4 +9692,0.1172611191868782,0.0449046716094017,0.0514625683426857,0.18785256147384644,721.2352294921875,1e-05,0.060039810836315155,2.365563154220581,23.927850246429443,4 +9693,0.23227256536483765,0.22518669068813324,0.2143612504005432,0.2538782060146332,818.9655151367188,1e-05,0.08525396883487701,2.3630294799804688,23.927850246429443,4 +9694,0.21055541932582855,0.22012785077095032,0.23144493997097015,0.13076922297477722,555.5556030273438,1e-05,0.06849014759063721,2.6202526092529297,23.927850246429443,4 +9695,0.3337860703468323,0.2220640778541565,0.22629964351654053,0.18092948198318481,555.5556030273438,1e-05,0.07379607856273651,2.3624966144561768,23.927850246429443,4 +9696,0.23309999704360962,0.17814858257770538,0.16405296325683594,0.21544870734214783,880.177490234375,1e-05,0.07222546637058258,2.487170934677124,23.927850246429443,4 +9697,0.1874334216117859,0.6685875654220581,0.6821731328964233,0.21560896933078766,92.59259796142578,1e-05,0.06422638148069382,2.351078987121582,23.927850246429443,4 +9698,0.18511168658733368,0.13270635902881622,0.13157349824905396,0.1787179410457611,946.896240234375,1e-05,0.06485816836357117,2.356346845626831,23.927850246429443,4 +9699,0.18486860394477844,0.19080334901809692,0.1829359531402588,0.2593589723110199,974.6696166992188,1e-05,0.0615805946290493,2.3568875789642334,23.927850246429443,4 +9700,0.15580441057682037,0.1371593475341797,0.13280044496059418,0.06352563947439194,969.9821166992188,1e-05,0.065199114382267,2.4710710048675537,23.927850246429443,4 +9701,0.21080106496810913,0.2586888372898102,0.2554001808166504,0.22285255789756775,978.0244140625,1e-05,0.06344439834356308,2.476240873336792,23.927850246429443,4 +9702,0.17818686366081238,0.1767861694097519,0.17878618836402893,0.23275640606880188,752.3885498046875,1e-05,0.06310304999351501,2.594111680984497,23.927850246429443,4 +9703,0.18371787667274475,0.12892986834049225,0.12417349219322205,0.12054486572742462,870.2915649414062,1e-05,0.06469633430242538,2.357283592224121,23.927850246429443,4 +9704,0.2855784296989441,0.23240850865840912,0.23227635025978088,0.1838461458683014,476.4851989746094,1e-05,0.07556174695491791,2.5004255771636963,23.927850246429443,4 +9705,0.2201828807592392,0.16046200692653656,0.17926788330078125,0.15227563679218292,225.4098358154297,1e-05,0.07819633185863495,2.3600080013275146,23.927850246429443,4 +9706,0.12566687166690826,0.09719941020011902,0.10207340121269226,0.256538450717926,811.095458984375,1e-05,0.06188797578215599,2.5058302879333496,23.927850246429443,4 +9707,0.1676938533782959,0.22035939991474152,0.21080048382282257,0.2149999886751175,914.6995849609375,1e-05,0.060132138431072235,2.3717098236083984,23.927850246429443,4 +9708,0.22859841585159302,0.20545594394207,0.20403556525707245,0.2294551134109497,995.9349365234375,1e-05,0.06690630316734314,2.3559517860412598,23.927850246429443,4 +9709,0.11109322309494019,0.14209118485450745,0.14353469014167786,0.19333332777023315,780.0751953125,1e-05,0.07391884177923203,2.3584201335906982,23.927850246429443,4 +9710,0.19554877281188965,0.24856038391590118,0.24198397994041443,0.1488140970468521,821.3306274414062,1e-05,0.08442053198814392,2.3559679985046387,23.927850246429443,4 +9711,0.16587062180042267,0.16373969614505768,0.15347395837306976,0.2468269169330597,805.4765625,1e-05,0.0732346847653389,2.5893547534942627,23.927850246429443,4 +9712,0.10817773640155792,0.1845051646232605,0.1818815916776657,0.11259614676237106,592.105224609375,1e-05,0.058952320367097855,2.650390863418579,23.927850246429443,4 +9713,0.25534337759017944,0.19453434646129608,0.18968747556209564,0.2716025412082672,622.4899291992188,1e-05,0.09198205918073654,2.3585009574890137,23.927850246429443,4 +9714,0.1235690638422966,0.1967635154724121,0.2011961191892624,0.26173076033592224,987.3948974609375,1e-05,0.06349814683198929,2.35194993019104,23.927850246429443,4 +9715,0.23740975558757782,0.16299858689308167,0.15673546493053436,0.17301280796527863,818.3701782226562,1e-05,0.08642861992120743,2.6192715167999268,23.927850246429443,4 +9716,0.1309652477502823,0.24350197613239288,0.24318033456802368,0.14826922118663788,341.5697937011719,1e-05,0.05802597850561142,2.3537790775299072,23.927850246429443,4 +9717,0.2247566282749176,0.17625641822814941,0.1653354912996292,0.2507692277431488,802.9328002929688,1e-05,0.07316270470619202,2.4883968830108643,23.927850246429443,4 +9718,0.13911953568458557,0.22566477954387665,0.2147950828075409,0.30253204703330994,842.5684204101562,1e-05,0.07853668928146362,2.356048583984375,23.927850246429443,4 +9719,0.16233094036579132,0.2059439867734909,0.19830478727817535,0.2462499886751175,668.0632934570312,1e-05,0.07505995035171509,2.3547918796539307,23.927850246429443,4 +9720,0.0916329175233841,0.41782405972480774,0.4076394736766815,0.24916665256023407,998.18701171875,1e-05,0.05840790271759033,2.355196237564087,23.927850246429443,4 +9721,0.17027106881141663,0.2382257729768753,0.23633542656898499,0.20974358916282654,507.7196960449219,1e-05,0.06860559433698654,2.359112501144409,23.927850246429443,4 +9722,0.25908660888671875,0.16784580051898956,0.17920684814453125,0.27996793389320374,909.9564819335938,1e-05,0.07047725468873978,2.632647752761841,23.927850246429443,4 +9723,0.21553801000118256,0.14940351247787476,0.15482480823993683,0.15618589520454407,686.9369506835938,1e-05,0.0743139311671257,2.570995807647705,23.927850246429443,4 +9724,0.24617256224155426,0.30393916368484497,0.30502399802207947,0.20413461327552795,396.1748962402344,1e-05,0.06579054147005081,2.359239339828491,23.927850246429443,4 +9725,0.216352641582489,0.17183955013751984,0.16490693390369415,0.2555128037929535,835.5437622070312,1e-05,0.06612173467874527,2.349050521850586,23.927850246429443,4 +9726,0.23290768265724182,0.1837775856256485,0.17542287707328796,0.22499999403953552,973.6957397460938,1e-05,0.07192344963550568,2.5903139114379883,23.927850246429443,4 +9727,0.18338578939437866,0.16462640464305878,0.15384095907211304,0.2366025596857071,801.64990234375,1e-05,0.07502063363790512,2.350388765335083,23.927850246429443,4 +9728,0.20425255596637726,0.25647804141044617,0.24595168232917786,0.28794869780540466,988.2747802734375,1e-05,0.058836374431848526,2.3470003604888916,23.927850246429443,4 +9729,0.24216386675834656,0.20103055238723755,0.19943194091320038,0.23926280438899994,502.3923645019531,1e-05,0.08076581358909607,2.347156524658203,23.927850246429443,4 +9730,0.19236047565937042,0.6334303617477417,0.6508651375770569,0.23666666448116302,125.89928436279297,1e-05,0.06315480917692184,2.346076726913452,23.927850246429443,4 +9731,0.21924307942390442,0.1269609034061432,0.12286921590566635,0.20064102113246918,812.9371337890625,1e-05,0.06414496153593063,2.3491971492767334,23.927850246429443,4 +9732,0.2024657130241394,0.27522221207618713,0.27964258193969727,0.15689101815223694,349.42364501953125,1e-05,0.06412822753190994,2.485192060470581,23.927850246429443,4 +9733,0.11934296786785126,0.1621946394443512,0.15134793519973755,0.28044870495796204,859.8626708984375,1e-05,0.06118083372712135,2.667052984237671,23.927850246429443,4 +9734,0.13433100283145905,0.17414264380931854,0.1615140289068222,0.21378204226493835,687.94970703125,1e-05,0.07919252663850784,2.5123038291931152,23.927850246429443,4 +9735,0.21997696161270142,0.13672040402889252,0.1322389841079712,0.21631409227848053,860.8343505859375,1e-05,0.06621553003787994,2.3492558002471924,23.927850246429443,4 +9736,0.30081817507743835,0.08360258489847183,0.08110640197992325,0.2347756326198578,948.6500244140625,1e-05,0.06356674432754517,2.6251699924468994,23.927850246429443,4 +9737,0.23573875427246094,0.10477130860090256,0.1057370975613594,0.23442307114601135,901.2276611328125,1e-05,0.07389011234045029,2.34981107711792,23.927850246429443,4 +9738,0.2779998183250427,0.24422721564769745,0.24135766923427582,0.302467942237854,776.5151977539062,1e-05,0.0731610655784607,2.485501766204834,23.927850246429443,4 +9739,0.17153450846672058,0.22480453550815582,0.21996313333511353,0.2162499874830246,649.0385131835938,1e-05,0.06417600810527802,2.3476574420928955,23.927850246429443,4 +9740,0.22030994296073914,0.5326620936393738,0.5277911424636841,0.24618588387966156,101.10294342041016,1e-05,0.06516637653112411,2.3496155738830566,23.927850246429443,4 +9741,0.2521365284919739,0.18650902807712555,0.17800748348236084,0.2337179332971573,683.8768310546875,1e-05,0.07724762707948685,2.350524425506592,23.927850246429443,4 +9742,0.20163261890411377,0.15837135910987854,0.15193872153759003,0.21205127239227295,926.5010375976562,1e-05,0.13094556331634521,2.342742919921875,23.927850246429443,4 +9743,0.3111344575881958,0.18856926262378693,0.18664909899234772,0.21195511519908905,937.1871948242188,1e-05,0.07874124497175217,2.455122709274292,23.927850246429443,4 +9744,0.15824951231479645,0.1704953908920288,0.17237785458564758,0.21554486453533173,834.9933471679688,1e-05,0.07868914306163788,2.5381979942321777,23.927850246429443,4 +9745,0.3400707542896271,0.2408563643693924,0.2319881021976471,0.09727563709020615,789.0855712890625,1e-05,0.07897649705410004,2.3580477237701416,23.927850246429443,4 +9746,0.17626580595970154,0.19140294194221497,0.18755581974983215,0.21842947602272034,974.9119873046875,1e-05,0.07185832411050797,2.3518052101135254,23.927850246429443,4 +9747,0.3545277714729309,0.15404286980628967,0.1574702262878418,0.29096153378486633,597.59912109375,1e-05,0.11018776148557663,2.5149624347686768,23.927850246429443,4 +9748,0.22886209189891815,0.14858409762382507,0.15277531743049622,0.15862178802490234,560.154541015625,1e-05,0.07362855970859528,2.5939438343048096,23.927850246429443,4 +9749,0.14895230531692505,0.13842229545116425,0.15353943407535553,0.25496792793273926,980.6033935546875,1e-05,0.08344998955726624,2.366976737976074,23.927850246429443,4 +9750,0.13413776457309723,0.1550949364900589,0.1486259549856186,0.24214743077754974,632.4110717773438,1e-05,0.07699417322874069,2.3577756881713867,23.927850246429443,4 +9751,0.18685513734817505,0.2769622802734375,0.26818016171455383,0.2198076844215393,423.2804260253906,1e-05,0.10315262526273727,2.3625285625457764,23.927850246429443,4 +9752,0.18603652715682983,0.26548048853874207,0.27200913429260254,0.21233972907066345,341.5697937011719,1e-05,0.09922978281974792,2.3569114208221436,23.927850246429443,4 +9753,0.18171732127666473,0.2772299647331238,0.27825984358787537,0.13855768740177155,993.0098266601562,1e-05,0.0803479552268982,2.4858558177948,23.927850246429443,4 +9754,0.15765149891376495,0.22079767286777496,0.2343023419380188,0.20541666448116302,851.9107666015625,1e-05,0.07702813297510147,2.484820604324341,23.927850246429443,4 +9755,0.18281856179237366,0.23160673677921295,0.22329401969909668,0.19586537778377533,748.3948974609375,1e-05,0.08309830725193024,2.600707769393921,23.927850246429443,4 +9756,0.3129824697971344,0.2472268044948578,0.24842612445354462,0.2167307585477829,416.6666564941406,1e-05,0.10765483975410461,2.3557515144348145,23.927850246429443,4 +9757,0.2553041875362396,0.19997256994247437,0.19706523418426514,0.2449999898672104,677.6557006835938,1e-05,0.11779617518186569,2.5277493000030518,23.927850246429443,4 +9758,0.2611311674118042,0.2624896466732025,0.25194185972213745,0.235929474234581,748.3948974609375,1e-05,0.07130631804466248,2.3543636798858643,23.927850246429443,4 +9759,0.18348129093647003,0.20950332283973694,0.1944899708032608,0.1565384566783905,956.2970581054688,1e-05,0.08116091787815094,2.466087579727173,23.927850246429443,4 +9760,0.15285280346870422,0.2584879994392395,0.2698237895965576,0.24519230425357819,997.9838256835938,1e-05,0.06485551595687866,2.3582141399383545,23.927850246429443,4 +9761,0.21179066598415375,0.2295846939086914,0.22828474640846252,0.23124998807907104,943.62744140625,1e-05,0.07526211440563202,2.3522074222564697,23.927850246429443,4 +9762,0.1739143580198288,0.160169780254364,0.17057323455810547,0.23073716461658478,959.3023071289062,1e-05,0.08554115891456604,2.3601365089416504,23.927850246429443,4 +9763,0.22110646963119507,0.2473817765712738,0.23906654119491577,0.21958333253860474,763.2398681640625,1e-05,0.08854509145021439,2.3508141040802,23.927850246429443,4 +9764,0.24587565660476685,0.11340738832950592,0.10716179013252258,0.1599999964237213,891.62841796875,1e-05,0.08908244222402573,2.673570156097412,23.927850246429443,4 +9765,0.1204441487789154,0.14447307586669922,0.1414024829864502,0.24439100921154022,586.51806640625,1e-05,0.09766275435686111,2.357731580734253,23.927850246429443,4 +9766,0.20876218378543854,0.23434504866600037,0.22137343883514404,0.1928205043077469,971.9750366210938,1e-05,0.10152238607406616,2.4993033409118652,23.927850246429443,4 +9767,0.18579384684562683,0.23609769344329834,0.22879958152770996,0.23342947661876678,452.8061218261719,1e-05,0.09447947144508362,2.3546817302703857,23.927850246429443,4 +9768,0.17817284166812897,0.2166644036769867,0.2094990760087967,0.21474358439445496,961.4497680664062,1e-05,0.06560651957988739,2.5047876834869385,23.927850246429443,4 +9769,0.23389750719070435,0.11900001019239426,0.12149647623300552,0.19371794164180756,714.8972778320312,1e-05,0.07388368993997574,2.3460824489593506,23.927850246429443,4 +9770,0.11243127286434174,0.15683145821094513,0.16864371299743652,0.1697435826063156,968.468505859375,1e-05,0.15810447931289673,2.5902609825134277,23.927850246429443,4 +9771,0.15803822875022888,0.2711305022239685,0.25989705324172974,0.24333332479000092,682.8494262695312,1e-05,0.07500343024730682,2.347975254058838,23.927850246429443,4 +9772,0.30888620018959045,0.17414513230323792,0.16605155169963837,0.20999999344348907,760.1881103515625,1e-05,0.08025159686803818,2.344871759414673,23.927850246429443,4 +9773,0.1809868961572647,0.12428702414035797,0.12562069296836853,0.1230769157409668,691.9642944335938,1e-05,0.0764358714222908,2.348396062850952,23.927850246429443,4 +9774,0.22094528377056122,0.14989759027957916,0.1552790105342865,0.24368588626384735,863.7206420898438,1e-05,0.07909360527992249,2.458942174911499,23.927850246429443,4 +9775,0.30693623423576355,0.15882670879364014,0.15785923600196838,0.2646474242210388,623.7474975585938,1e-05,0.09093654900789261,2.484016180038452,23.927850246429443,4 +9776,0.20625866949558258,0.19874051213264465,0.19590993225574493,0.20791666209697723,872.5845947265625,1e-05,0.11311671137809753,2.5404410362243652,23.927850246429443,4 +9777,0.21019108593463898,0.25496411323547363,0.2527046501636505,0.254647433757782,367.23162841796875,1e-05,0.09221099317073822,2.5981287956237793,23.927850246429443,4 +9778,0.23634429275989532,0.1872299611568451,0.19127041101455688,0.26326921582221985,519.8598022460938,1e-05,0.0809374675154686,2.350114345550537,23.927850246429443,4 +9779,0.26138243079185486,0.4769374430179596,0.46777525544166565,0.2112179398536682,168.68511962890625,1e-05,0.07422986626625061,2.358004331588745,23.927850246429443,4 +9780,0.15962952375411987,0.2548874616622925,0.2522600293159485,0.26772433519363403,890.3912353515625,1e-05,0.07297258079051971,2.4829397201538086,23.927850246429443,4 +9781,0.0892639011144638,0.17624731361865997,0.16479851305484772,0.20365384221076965,879.7392578125,1e-05,0.06508959829807281,2.3845584392547607,23.927850246429443,4 +9782,0.19493523240089417,0.18295812606811523,0.19546273350715637,0.2249358892440796,384.3490905761719,1e-05,0.08224965631961823,2.3585846424102783,23.927850246429443,4 +9783,0.1186862587928772,0.1271924525499344,0.12747344374656677,0.2597435712814331,685.9205932617188,1e-05,0.07153503596782684,2.360924482345581,23.927850246429443,4 +9784,0.14244216680526733,0.40346309542655945,0.4229564368724823,0.21689102053642273,149.64788818359375,1e-05,0.07026196271181107,2.3580234050750732,23.927850246429443,4 +9785,0.30156588554382324,0.22744236886501312,0.22220531105995178,0.1945512741804123,440.41455078125,1e-05,0.07260160148143768,2.5462124347686768,23.927850246429443,4 +9786,0.19363853335380554,0.19093406200408936,0.19462710618972778,0.25874999165534973,991.3079833984375,1e-05,0.09052043408155441,2.590258836746216,23.927850246429443,4 +9787,0.22153416275978088,0.14133591949939728,0.1436939686536789,0.22951921820640564,837.1862182617188,1e-05,0.08303635567426682,2.7185206413269043,23.927850246429443,4 +9788,0.18857747316360474,0.1430622786283493,0.14743708074092865,0.1417948603630066,583.6886596679688,1e-05,0.07513602823019028,2.360980987548828,23.927850246429443,4 +9789,0.13076315820217133,0.7125326991081238,0.7203547358512878,0.2091025561094284,75.18797302246094,1e-05,0.06904862076044083,2.565690040588379,23.927850246429443,4 +9790,0.14745281636714935,0.15463927388191223,0.16333413124084473,0.20150640606880188,814.15625,1e-05,0.07155416905879974,2.3631515502929688,23.927850246429443,4 +9791,0.25911787152290344,0.16126401722431183,0.15641961991786957,0.24602563679218292,971.9750366210938,1e-05,0.07564738392829895,2.6086747646331787,23.927850246429443,4 +9792,0.2009543925523758,0.26568329334259033,0.26580581068992615,0.2768910229206085,608.3162231445312,1e-05,0.07355295866727829,2.3514554500579834,23.927850246429443,4 +9793,0.20565858483314514,0.22063149511814117,0.23149773478507996,0.23179486393928528,729.1666870117188,1e-05,0.06603464484214783,2.348825216293335,23.927850246429443,4 +9794,0.23135781288146973,0.3187277615070343,0.3197237551212311,0.2445192188024521,330.88238525390625,1e-05,0.08266581594944,2.3498177528381348,23.927850246429443,4 +9795,0.1754896640777588,0.1701032519340515,0.1591724008321762,0.17044870555400848,802.292236328125,1e-05,0.0798715204000473,2.4576189517974854,23.927850246429443,4 +9796,0.23976406455039978,0.1670253425836563,0.15915875136852264,0.25227564573287964,777.2314453125,1e-05,0.1156393513083458,2.4851412773132324,23.927850246429443,4 +9797,0.15489904582500458,0.15016071498394012,0.14562171697616577,0.25615382194519043,928.828369140625,1e-05,0.07002297043800354,2.5171682834625244,23.927850246429443,4 +9798,0.14682288467884064,0.1503080576658249,0.1474393755197525,0.2967948615550995,934.6619262695312,1e-05,0.07089465111494064,2.4967174530029297,23.927850246429443,4 +9799,0.20201967656612396,0.21188338100910187,0.20980514585971832,0.3056410253047943,860.34912109375,1e-05,0.086915984749794,2.359140157699585,23.927850246429443,4 +9800,0.1832304298877716,0.16658532619476318,0.16751110553741455,0.16573716700077057,865.6211547851562,1e-05,0.07037615031003952,2.35935378074646,23.927850246429443,4 +9801,0.29530543088912964,0.1947944611310959,0.19071392714977264,0.17647434771060944,606.9959106445312,1e-05,0.07337044179439545,2.358025550842285,23.927850246429443,4 +9802,0.25976383686065674,0.13457664847373962,0.13273264467716217,0.23695512115955353,748.3948974609375,1e-05,0.06866323947906494,2.4964120388031006,23.927850246429443,4 +9803,0.15605643391609192,0.1648709625005722,0.1507049947977066,0.23240384459495544,797.1013793945312,1e-05,0.07650379091501236,2.3613548278808594,23.927850246429443,4 +9804,0.18269093334674835,0.11237522214651108,0.10357880592346191,0.20124998688697815,851.403076171875,1e-05,0.0806572362780571,2.3628089427948,23.927850246429443,4 +9805,0.2165038287639618,0.11734350770711899,0.1266811639070511,0.20423075556755066,563.1868286132812,1e-05,0.06649952381849289,2.3632876873016357,23.927850246429443,4 +9806,0.2538439631462097,0.1622665524482727,0.15864291787147522,0.18676280975341797,542.9864501953125,1e-05,0.07090283930301666,2.4728031158447266,23.927850246429443,4 +9807,0.205577552318573,0.1394464373588562,0.14070793986320496,0.25766023993492126,906.2156372070312,1e-05,0.08050087094306946,2.520664691925049,23.927850246429443,4 +9808,0.12669101357460022,0.179997518658638,0.1744786500930786,0.23310896754264832,834.9933471679688,1e-05,0.07102487236261368,2.551800012588501,23.927850246429443,4 +9809,0.23194371163845062,0.11409159004688263,0.11257169395685196,0.24858973920345306,874.8499145507812,1e-05,0.09587229043245316,2.363495349884033,23.927850246429443,4 +9810,0.2639380097389221,0.2659064829349518,0.27268508076667786,0.15772435069084167,695.9219970703125,1e-05,0.09350848942995071,2.5178062915802,23.927850246429443,4 +9811,0.1637302041053772,0.1444278359413147,0.14569322764873505,0.15169870853424072,867.5030517578125,1e-05,0.08440461754798889,2.3508670330047607,23.927850246429443,4 +9812,0.22975009679794312,0.11948338896036148,0.12218188494443893,0.2881089746952057,754.75439453125,1e-05,0.07161810994148254,2.5221128463745117,23.927850246429443,4 +9813,0.26747673749923706,0.11995013058185577,0.11601375788450241,0.24407050013542175,930.143310546875,1e-05,0.06951477378606796,2.363919973373413,23.927850246429443,4 +9814,0.24547536671161652,0.21046657860279083,0.2106795459985733,0.23913460969924927,895.6915893554688,1e-05,0.08563748002052307,2.346558094024658,23.927850246429443,4 +9815,0.15348616242408752,0.1716974526643753,0.16061821579933167,0.18570512533187866,872.1281127929688,1e-05,0.08757776021957397,2.346388816833496,23.927850246429443,4 +9816,0.19208252429962158,0.31971150636672974,0.3131506145000458,0.1743910163640976,341.5697937011719,1e-05,0.07562246918678284,2.349364995956421,23.927850246429443,4 +9817,0.15508411824703217,0.2945108115673065,0.27683159708976746,0.2581730782985687,985.8411254882812,1e-05,0.0738009363412857,2.475846529006958,23.927850246429443,4 +9818,0.21338045597076416,0.26295503973960876,0.2625054717063904,0.2180769145488739,936.5596923828125,1e-05,0.09193193912506104,2.352930784225464,23.927850246429443,4 +9819,0.28608351945877075,0.12631046772003174,0.1239931583404541,0.20423075556755066,928.4979858398438,1e-05,0.08778700232505798,2.7223544120788574,23.927850246429443,4 +9820,0.23402804136276245,0.15639962255954742,0.16638538241386414,0.16224358975887299,870.7523803710938,1e-05,0.06970525532960892,2.356092929840088,23.927850246429443,4 +9821,0.2072451114654541,0.12444376945495605,0.13565239310264587,0.29557690024375916,478.3950500488281,1e-05,0.06921086460351944,2.352553367614746,23.927850246429443,4 +9822,0.19137930870056152,0.1997130960226059,0.18824715912342072,0.24589742720127106,764.7515258789062,1e-05,0.07462962716817856,2.354841709136963,23.927850246429443,4 +9823,0.2089453488588333,0.12624461948871613,0.12342878431081772,0.2082371711730957,745.1535034179688,1e-05,0.06812223047018051,2.478605270385742,23.927850246429443,4 +9824,0.2675386965274811,0.18892520666122437,0.19261658191680908,0.18621794879436493,821.9178466796875,1e-05,0.06479623168706894,2.3571157455444336,23.927850246429443,4 +9825,0.2473362684249878,0.1936722844839096,0.18217138946056366,0.19423076510429382,867.0343017578125,1e-05,0.07108922302722931,2.3567330837249756,23.927850246429443,4 +9826,0.1801799237728119,0.18759019672870636,0.17834222316741943,0.1717948615550995,898.8763427734375,1e-05,0.07329826802015305,2.358027935028076,23.927850246429443,4 +9827,0.3753160536289215,0.2193921059370041,0.22396409511566162,0.23256409168243408,975.6365966796875,1e-05,0.07869205623865128,2.4634835720062256,23.927850246429443,4 +9828,0.1623164713382721,0.07298960536718369,0.08014021068811417,0.14509615302085876,721.2352294921875,1e-05,0.06176183000206947,2.5841963291168213,23.927850246429443,4 +9829,0.11256732046604156,0.23778867721557617,0.22518345713615417,0.27935895323753357,941.8146362304688,1e-05,0.0622430182993412,2.5008480548858643,23.927850246429443,4 +9830,0.1620112508535385,0.8180931210517883,0.7603003978729248,0.2301281988620758,998.9959716796875,1e-05,0.06357163190841675,2.5388927459716797,23.927850246429443,4 +9831,0.3459479808807373,0.2943604588508606,0.2856560945510864,0.10208333283662796,650.1919555664062,1e-05,0.08962331712245941,2.513111114501953,23.927850246429443,4 +9832,0.188958078622818,0.35294094681739807,0.3309602737426758,0.2962820529937744,984.2687377929688,1e-05,0.0742863193154335,2.346088171005249,23.927850246429443,4 +9833,0.10566126555204391,0.2629328668117523,0.2538772523403168,0.27695512771606445,933.0629272460938,1e-05,0.08512376993894577,2.352034091949463,23.927850246429443,4 +9834,0.10482986271381378,0.10538913309574127,0.1061818078160286,0.204679474234581,939.9801635742188,1e-05,0.07175257056951523,2.3479220867156982,23.927850246429443,4 +9835,0.23542192578315735,0.20812512934207916,0.2114948332309723,0.25035256147384644,454.8346252441406,1e-05,0.07433230429887772,2.3477084636688232,23.927850246429443,4 +9836,0.16538174450397491,0.16219456493854523,0.1755881905555725,0.11131409555673599,436.19793701171875,1e-05,0.06528988480567932,2.3464202880859375,23.927850246429443,4 +9837,0.2897665798664093,0.08835077285766602,0.09586340188980103,0.25836536288261414,886.2048950195312,1e-05,0.08414612710475922,2.3458478450775146,23.927850246429443,4 +9838,0.24382129311561584,0.3190794587135315,0.32326748967170715,0.10657051205635071,379.5264587402344,1e-05,0.06438928097486496,2.4791533946990967,23.927850246429443,4 +9839,0.25049352645874023,0.3823716342449188,0.3930385708808899,0.10663460940122604,346.82080078125,1e-05,0.061336368322372437,2.3556923866271973,23.927850246429443,4 +9840,0.28098973631858826,0.4385964870452881,0.45385023951530457,0.25089743733406067,194.25677490234375,1e-05,0.08825606107711792,2.529242515563965,23.927850246429443,4 +9841,0.3059295415878296,0.18134747445583344,0.17839142680168152,0.13333332538604736,523.2557983398438,1e-05,0.08071684837341309,2.613389492034912,23.927850246429443,4 +9842,0.2581965923309326,0.23155350983142853,0.22960953414440155,0.22862178087234497,421.0875244140625,1e-05,0.06362533569335938,2.3507399559020996,23.927850246429443,4 +9843,0.2608017027378082,0.11942948400974274,0.12212306261062622,0.3031730651855469,812.9371337890625,1e-05,0.06821189075708389,2.349872350692749,23.927850246429443,4 +9844,0.09441624581813812,0.15834170579910278,0.15148654580116272,0.2563782036304474,938.7450561523438,1e-05,0.12321676313877106,2.4864888191223145,23.927850246429443,4 +9845,0.289057195186615,0.19346372783184052,0.19253908097743988,0.2965705096721649,717.632080078125,1e-05,0.08504361659288406,2.3440330028533936,23.927850246429443,4 +9846,0.2241440713405609,0.142179936170578,0.14668133854866028,0.24871793389320374,566.1925659179688,1e-05,0.06658236682415009,2.346012592315674,23.927850246429443,4 +9847,0.195154070854187,0.23554418981075287,0.23062027990818024,0.2476923018693924,458.8607482910156,1e-05,0.06535005569458008,2.346252918243408,23.927850246429443,4 +9848,0.30988574028015137,0.9767122268676758,0.9784974455833435,0.25439101457595825,4.9800801277160645,1e-05,0.07230550050735474,2.4590628147125244,23.927850246429443,4 +9849,0.22379612922668457,0.28656020760536194,0.29715272784233093,0.17666666209697723,228.7581787109375,1e-05,0.0780540406703949,2.5114681720733643,23.927850246429443,4 +9850,0.14666205644607544,0.23144042491912842,0.2276136428117752,0.14128205180168152,974.6696166992188,1e-05,0.05877577140927315,2.3477165699005127,23.927850246429443,4 +9851,0.13835249841213226,0.1508321613073349,0.14562025666236877,0.19499999284744263,794.4606323242188,1e-05,0.08385898172855377,2.611765146255493,23.927850246429443,4 +9852,0.3205123245716095,0.3346867263317108,0.3445627689361572,0.19243589043617249,225.4098358154297,1e-05,0.09537798911333084,2.5192208290100098,23.927850246429443,4 +9853,0.15690229833126068,0.17040443420410156,0.15800997614860535,0.2079487144947052,949.8078002929688,1e-05,0.07776105403900146,2.364525079727173,23.927850246429443,4 +9854,0.32572364807128906,0.3715533912181854,0.3781798481941223,0.12506410479545593,172.413818359375,1e-05,0.08987613022327423,2.72098445892334,23.927850246429443,4 +9855,0.20303355157375336,0.08142320811748505,0.08299542218446732,0.26326921582221985,857.9046020507812,1e-05,0.09620578587055206,2.3650972843170166,23.927850246429443,4 +9856,0.25841206312179565,0.11886778473854065,0.11880425363779068,0.07615384459495544,750.0000610351562,1e-05,0.06561499834060669,2.3538033962249756,23.927850246429443,4 +9857,0.1484757959842682,0.5341026186943054,0.5030651688575745,0.20493589341640472,998.9959716796875,1e-05,0.06989342719316483,2.3532583713531494,23.927850246429443,4 +9858,0.22792871296405792,0.23010893166065216,0.21890397369861603,0.2559935748577118,978.2608642578125,1e-05,0.07224424183368683,2.55946946144104,23.927850246429443,4 +9859,0.28622734546661377,0.10736407339572906,0.11132703721523285,0.18621794879436493,905.8369750976562,1e-05,0.09343497455120087,2.4945592880249023,23.927850246429443,4 +9860,0.1839817762374878,0.17503273487091064,0.17909733951091766,0.2097756266593933,866.564453125,1e-05,0.07181628048419952,2.364762783050537,23.927850246429443,4 +9861,0.16068512201309204,0.1488025039434433,0.14300398528575897,0.25621792674064636,628.7276611328125,1e-05,0.06828157603740692,2.3513147830963135,23.927850246429443,4 +9862,0.10569360852241516,0.08620243519544601,0.08472690731287003,0.22166666388511658,801.0057983398438,1e-05,0.06839646399021149,2.783143997192383,23.927850246429443,4 +9863,0.10225111991167068,0.17407488822937012,0.1710035651922226,0.23237179219722748,663.6961059570312,1e-05,0.064298115670681,2.362154245376587,23.927850246429443,4 +9864,0.221748486161232,0.22200016677379608,0.21040214598178864,0.3217628002166748,913.978515625,1e-05,0.10518017411231995,2.35188364982605,23.927850246429443,4 +9865,0.31261998414993286,0.3242160379886627,0.3238934874534607,0.21833331882953644,319.94049072265625,1e-05,0.10150617361068726,2.6390795707702637,23.927850246429443,4 +9866,0.24625281989574432,0.33065006136894226,0.330364853143692,0.13935896754264832,276.479736328125,1e-05,0.08298614621162415,2.360483169555664,23.927850246429443,4 +9867,0.25848567485809326,0.19564463198184967,0.18488314747810364,0.17724359035491943,716.7235717773438,1e-05,0.09248320758342743,2.355832576751709,23.927850246429443,4 +9868,0.20309698581695557,0.19665424525737762,0.20007802546024323,0.1373397409915924,919.3121948242188,1e-05,0.15024495124816895,2.353139877319336,23.927850246429443,4 +9869,0.3613429665565491,0.2371121495962143,0.23347324132919312,0.2113140970468521,967.4503784179688,1e-05,0.0792585015296936,2.459690809249878,23.927850246429443,4 +9870,0.1910676658153534,0.21052934229373932,0.21501517295837402,0.13112178444862366,992.1616821289062,1e-05,0.07199274003505707,2.5789833068847656,23.927850246429443,4 +9871,0.21967259049415588,0.16680921614170074,0.14967326819896698,0.24163460731506348,821.9178466796875,1e-05,0.08351227641105652,2.354931116104126,23.927850246429443,4 +9872,0.19896456599235535,0.14139990508556366,0.14699389040470123,0.12243589013814926,681.8181762695312,1e-05,0.10368155688047409,2.3477416038513184,23.927850246429443,4 +9873,0.06849846988916397,0.3709668219089508,0.3751637935638428,0.25525641441345215,1000.0,1e-05,0.08988562971353531,2.6735780239105225,23.927850246429443,4 +9874,0.36808374524116516,0.31408095359802246,0.30765318870544434,0.26624998450279236,359.68658447265625,1e-05,0.14127013087272644,2.352076768875122,23.927850246429443,4 +9875,0.31244686245918274,0.16325290501117706,0.15269699692726135,0.2864423096179962,827.1312866210938,1e-05,0.09340588748455048,2.347775459289551,23.927850246429443,4 +9876,0.17658866941928864,0.14942152798175812,0.15594950318336487,0.23743589222431183,954.6314086914062,1e-05,0.07897600531578064,2.621588945388794,23.927850246429443,4 +9877,0.2130003720521927,0.09458751976490021,0.08853108435869217,0.18435896933078766,705.574951171875,1e-05,0.10255759954452515,2.358842372894287,23.927850246429443,4 +9878,0.23580661416053772,0.1441931426525116,0.14649979770183563,0.204679474234581,677.6557006835938,1e-05,0.08429708331823349,2.349095582962036,23.927850246429443,4 +9879,0.21681807935237885,0.14765486121177673,0.14173515141010284,0.09711538255214691,895.2894897460938,1e-05,0.18311598896980286,2.491715908050537,23.927850246429443,4 +9880,0.1562020480632782,0.13438232243061066,0.13172028958797455,0.20163460075855255,951.5281982421875,1e-05,0.07891599833965302,2.476430892944336,23.927850246429443,4 +9881,0.14132246375083923,0.1386716067790985,0.14592280983924866,0.18631409108638763,905.8369750976562,1e-05,0.07295616716146469,2.3603177070617676,23.927850246429443,4 +9882,0.2539846897125244,0.5393576622009277,0.5557582378387451,0.2244551181793213,141.84397888183594,1e-05,0.15042072534561157,2.346485137939453,23.927850246429443,4 +9883,0.23390290141105652,0.4414710998535156,0.43773236870765686,0.14608973264694214,998.18701171875,1e-05,0.08292864263057709,2.5194101333618164,23.927850246429443,4 +9884,0.18797828257083893,0.1536310613155365,0.1506946086883545,0.20580127835273743,948.067626953125,1e-05,0.10506201535463333,2.6212427616119385,23.927850246429443,4 +9885,0.18044687807559967,0.18713577091693878,0.1884932816028595,0.19999998807907104,792.4597778320312,1e-05,0.07887104898691177,2.3564796447753906,23.927850246429443,4 +9886,0.13668277859687805,0.12158482521772385,0.12108398228883743,0.2503845989704132,863.2425537109375,1e-05,0.06925718486309052,2.4841275215148926,23.927850246429443,4 +9887,0.13002963364124298,0.14724186062812805,0.14792779088020325,0.1427564024925232,807.365478515625,1e-05,0.07398007810115814,2.3570375442504883,23.927850246429443,4 +9888,0.1705520749092102,0.17156517505645752,0.16620315611362457,0.22980768978595734,835.5437622070312,1e-05,0.07243642956018448,2.3513386249542236,23.927850246429443,4 +9889,0.23387420177459717,0.34811273217201233,0.34350690245628357,0.25951921939849854,328.1711120605469,1e-05,0.10783032327890396,2.3497493267059326,23.927850246429443,4 +9890,0.1896568089723587,0.139501690864563,0.13624544441699982,0.10874999314546585,669.14501953125,1e-05,0.08001680672168732,2.463003635406494,23.927850246429443,4 +9891,0.27899593114852905,0.1663316935300827,0.15587486326694489,0.2689102590084076,901.2276611328125,1e-05,0.06967365741729736,2.584672212600708,23.927850246429443,4 +9892,0.2257044017314911,0.23367726802825928,0.2199719250202179,0.2568589746952057,774.3531494140625,1e-05,0.07437119632959366,2.3523547649383545,23.927850246429443,4 +9893,0.1821810007095337,0.13312388956546783,0.12804608047008514,0.16038461029529572,775.796630859375,1e-05,0.11016616970300674,2.346205472946167,23.927850246429443,4 +9894,0.21368932723999023,0.1299542933702469,0.12968869507312775,0.21080127358436584,769.2307739257812,1e-05,0.10829933732748032,2.7089810371398926,23.927850246429443,4 +9895,0.1891927421092987,0.7647415995597839,0.7984145283699036,0.24689102172851562,19.685039520263672,1e-05,0.08062922954559326,2.358684539794922,23.927850246429443,4 +9896,0.22116133570671082,0.1987098604440689,0.17986905574798584,0.2495192289352417,884.0750122070312,1e-05,0.08105721324682236,2.3487138748168945,23.927850246429443,4 +9897,0.14861595630645752,0.19415070116519928,0.18801669776439667,0.2487499862909317,833.3333129882812,1e-05,0.06338688731193542,2.6043472290039062,23.927850246429443,4 +9898,0.14627721905708313,0.6546306610107422,0.6434234976768494,0.23169870674610138,133.9285888671875,1e-05,0.07665273547172546,2.350125312805176,23.927850246429443,4 +9899,0.15478037297725677,0.16079124808311462,0.16537447273731232,0.23201921582221985,802.292236328125,1e-05,0.06892421841621399,2.35465407371521,23.927850246429443,4 +9900,0.2335008680820465,0.13728049397468567,0.12839825451374054,0.1787179410457611,730.0333251953125,1e-05,0.10576115548610687,2.353282928466797,23.927850246429443,4 +9901,0.17763036489486694,0.19288727641105652,0.19364812970161438,0.22208333015441895,464.8240966796875,1e-05,0.0612298920750618,2.357341766357422,23.927850246429443,4 +9902,0.13414274156093597,0.23335225880146027,0.23486672341823578,0.11423076689243317,978.2608642578125,1e-05,0.06561483442783356,2.483696460723877,23.927850246429443,4 +9903,0.15782316029071808,0.1362115442752838,0.1299608051776886,0.2348717898130417,822.50341796875,1e-05,0.08060380816459656,2.3652608394622803,23.927850246429443,4 +9904,0.14370585978031158,0.10907795280218124,0.12031322717666626,0.1841346025466919,744.3366088867188,1e-05,0.06999798119068146,2.5278403759002686,23.927850246429443,4 +9905,0.3644927442073822,0.18187540769577026,0.17820408940315247,0.19237178564071655,746.7793579101562,1e-05,0.11184050142765045,2.6285359859466553,23.927850246429443,4 +9906,0.16860081255435944,0.1280643194913864,0.1153511255979538,0.23262819647789001,856.4231567382812,1e-05,0.06914744526147842,2.3627700805664062,23.927850246429443,4 +9907,0.19709262251853943,0.2116449624300003,0.1912013441324234,0.2634294629096985,933.3839721679688,1e-05,0.07640597969293594,2.3581671714782715,23.927850246429443,4 +9908,0.14424876868724823,0.13365112245082855,0.14451320469379425,0.1759294867515564,912.5270385742188,1e-05,0.07062865793704987,2.484363079071045,23.927850246429443,4 +9909,0.36248916387557983,0.5231481790542603,0.5334588885307312,0.23208332061767578,187.07484436035156,1e-05,0.09751615673303604,2.351646900177002,23.927850246429443,4 +9910,0.3107205033302307,0.31722864508628845,0.3058541417121887,0.276442289352417,308.7349548339844,1e-05,0.08454152196645737,2.350250482559204,23.927850246429443,4 +9911,0.2131592333316803,0.19375552237033844,0.18542595207691193,0.1498717963695526,828.2725830078125,1e-05,0.06481552124023438,2.463465690612793,23.927850246429443,4 +9912,0.06117980182170868,0.13403041660785675,0.1275385171175003,0.2531730532646179,625.0,1e-05,0.051826801151037216,2.4834096431732178,23.927850246429443,4 +9913,0.224969282746315,0.1792379766702652,0.18669259548187256,0.2695833146572113,393.8356018066406,1e-05,0.09946629405021667,2.3591420650482178,23.927850246429443,4 +9914,0.09790948033332825,0.3244561553001404,0.3120274841785431,0.1548076868057251,981.5291137695312,1e-05,0.06982589513063431,2.345302104949951,23.927850246429443,4 +9915,0.10468361526727676,0.20161905884742737,0.20213164389133453,0.14499999582767487,925.4932250976562,1e-05,0.07056625932455063,2.498485803604126,23.927850246429443,4 +9916,0.2424398809671402,0.14935775101184845,0.15334631502628326,0.21298076212406158,725.671142578125,1e-05,0.0837613195180893,2.5842483043670654,23.927850246429443,4 +9917,0.21845394372940063,0.25056976079940796,0.2460681051015854,0.23423075675964355,330.88238525390625,1e-05,0.09256773442029953,2.347135066986084,23.927850246429443,4 +9918,0.2514817714691162,0.16543473303318024,0.15659897029399872,0.2852884531021118,922.088134765625,1e-05,0.07298288494348526,2.5108983516693115,23.927850246429443,4 +9919,0.21351194381713867,0.5687784552574158,0.5822627544403076,0.22185896337032318,117.75362396240234,1e-05,0.076546810567379,2.36173939704895,23.927850246429443,4 +9920,0.16123563051223755,0.17119498550891876,0.17634285986423492,0.2602243423461914,414.4384765625,1e-05,0.07097180932760239,2.3528764247894287,23.927850246429443,4 +9921,0.26827436685562134,0.1425129920244217,0.14893990755081177,0.17990383505821228,639.6484985351562,1e-05,0.08578553795814514,2.550377130508423,23.927850246429443,4 +9922,0.14672736823558807,0.21565531194210052,0.2201322466135025,0.207371786236763,555.5556030273438,1e-05,0.06815879046916962,2.3591959476470947,23.927850246429443,4 +9923,0.265637069940567,0.23705808818340302,0.23614774644374847,0.27137818932533264,739.3790893554688,1e-05,0.06864047795534134,2.5245254039764404,23.927850246429443,4 +9924,0.098423533141613,0.21564148366451263,0.21262678503990173,0.2961217761039734,951.2427978515625,1e-05,0.07401622831821442,2.356231927871704,23.927850246429443,4 +9925,0.06945706158876419,0.19531425833702087,0.18139894306659698,0.2057371735572815,915.0589599609375,1e-05,0.058246154338121414,2.5167295932769775,23.927850246429443,4 +9926,0.26401156187057495,0.1797918677330017,0.18000507354736328,0.13429486751556396,959.8422241210938,1e-05,0.07123532146215439,2.5325729846954346,23.927850246429443,4 +9927,0.18617044389247894,0.23865675926208496,0.23432137072086334,0.20961537957191467,864.6732177734375,1e-05,0.08084820955991745,2.3590917587280273,23.927850246429443,4 +9928,0.21620559692382812,0.2590334117412567,0.24760884046554565,0.2533653676509857,947.4830322265625,1e-05,0.07838918268680573,2.3485655784606934,23.927850246429443,4 +9929,0.1845674365758896,0.15907204151153564,0.15358269214630127,0.261185884475708,723.90576171875,1e-05,0.06375013291835785,2.4934070110321045,23.927850246429443,4 +9930,0.2450280487537384,0.3056812286376953,0.29287657141685486,0.23387819528579712,975.15380859375,1e-05,0.07753697037696838,2.354278087615967,23.927850246429443,4 +9931,0.1337524652481079,0.07862751185894012,0.08234211802482605,0.1456410139799118,799.7118530273438,1e-05,0.06148557364940643,2.3560619354248047,23.927850246429443,4 +9932,0.18856652081012726,0.19468188285827637,0.18342174589633942,0.26298075914382935,797.1013793945312,1e-05,0.06668172776699066,2.464388132095337,23.927850246429443,4 +9933,0.1631876826286316,0.2851811945438385,0.2908115088939667,0.20483973622322083,414.4384765625,1e-05,0.06877709925174713,2.3674702644348145,23.927850246429443,4 +9934,0.1671265810728073,0.26821646094322205,0.2682152986526489,0.2207692265510559,988.0552978515625,1e-05,0.06165262684226036,2.478078842163086,23.927850246429443,4 +9935,0.20303277671337128,0.09709905833005905,0.09199991077184677,0.23528845608234406,837.1862182617188,1e-05,0.08471626043319702,2.354933261871338,23.927850246429443,4 +9936,0.2835165858268738,0.17116394639015198,0.17087885737419128,0.23685896396636963,560.154541015625,1e-05,0.08417556434869766,2.5583555698394775,23.927850246429443,4 +9937,0.2510107159614563,0.18616268038749695,0.17967915534973145,0.21124999225139618,628.7276611328125,1e-05,0.08364199846982956,2.6828134059906006,23.927850246429443,4 +9938,0.08790645748376846,0.22131921350955963,0.2152833491563797,0.240544855594635,971.23095703125,1e-05,0.05528077855706215,2.3560149669647217,23.927850246429443,4 +9939,0.22562937438488007,0.2191566675901413,0.21151220798492432,0.2713140845298767,474.5657653808594,1e-05,0.0764164850115776,2.349242925643921,23.927850246429443,4 +9940,0.20465755462646484,0.3985445201396942,0.3908802270889282,0.23541665077209473,319.94049072265625,1e-05,0.0697488933801651,2.34995698928833,23.927850246429443,4 +9941,0.26933157444000244,0.206409752368927,0.2037370800971985,0.20499999821186066,890.8045654296875,1e-05,0.07492318749427795,2.347385883331299,23.927850246429443,4 +9942,0.2020423710346222,0.1805415153503418,0.17071256041526794,0.26762819290161133,846.2532348632812,1e-05,0.05871397256851196,2.356027603149414,23.927850246429443,4 +9943,0.12334500253200531,0.16943767666816711,0.1516202837228775,0.2211538404226303,938.7450561523438,1e-05,0.06328253448009491,2.585355281829834,23.927850246429443,4 +9944,0.22252658009529114,0.1687510460615158,0.16755661368370056,0.19278845191001892,498.798095703125,1e-05,0.0826970562338829,2.360623598098755,23.927850246429443,4 +9945,0.17318348586559296,0.2977067232131958,0.28675922751426697,0.1887499988079071,984.94482421875,1e-05,0.0664009377360344,2.5056164264678955,23.927850246429443,4 +9946,0.2022933065891266,0.21168336272239685,0.19584301114082336,0.22041666507720947,898.4814453125,1e-05,0.0687660425901413,2.358551502227783,23.927850246429443,4 +9947,0.14856086671352386,0.17965607345104218,0.1791229248046875,0.20586538314819336,946.896240234375,1e-05,0.07001880556344986,2.6280083656311035,23.927850246429443,4 +9948,0.19725516438484192,0.18522140383720398,0.18074272572994232,0.15916666388511658,713.9794311523438,1e-05,0.08504696190357208,2.534238338470459,23.927850246429443,4 +9949,0.2727259397506714,0.09742238372564316,0.10225070267915726,0.2707371711730957,573.5930786132812,1e-05,0.0712445005774498,2.3575844764709473,23.927850246429443,4 +9950,0.2980685234069824,0.23225407302379608,0.22990469634532928,0.20282050967216492,405.4053955078125,1e-05,0.06753867864608765,2.4857237339019775,23.927850246429443,4 +9951,0.17746871709823608,0.29019683599472046,0.3064225912094116,0.2531730532646179,338.9212646484375,1e-05,0.06372206658124924,2.351093292236328,23.927850246429443,4 +9952,0.2596839666366577,0.23165316879749298,0.23100391030311584,0.2261858880519867,834.44140625,1e-05,0.07735353708267212,2.3522684574127197,23.927850246429443,4 +9953,0.3274438977241516,0.23727910220623016,0.25363093614578247,0.22987177968025208,261.0759582519531,1e-05,0.07715824246406555,2.5037851333618164,23.927850246429443,4 +9954,0.26271483302116394,0.21335062384605408,0.21386964619159698,0.1999358832836151,964.872314453125,1e-05,0.08385255932807922,2.3545002937316895,23.927850246429443,4 +9955,0.2223016768693924,0.1426149308681488,0.13608019053936005,0.23657050728797913,940.5940551757812,1e-05,0.0784493237733841,2.4677929878234863,23.927850246429443,4 +9956,0.16933539509773254,0.14643149077892303,0.14549118280410767,0.06032051146030426,919.6617431640625,1e-05,0.07607844471931458,2.35959792137146,23.927850246429443,4 +9957,0.20610171556472778,0.34447816014289856,0.33608487248420715,0.12782050669193268,996.5530395507812,1e-05,0.07097402215003967,2.5039684772491455,23.927850246429443,4 +9958,0.28397202491760254,0.4871739447116852,0.48041024804115295,0.2666666507720947,176.11683654785156,1e-05,0.07143428176641464,2.5732030868530273,23.927850246429443,4 +9959,0.2017049342393875,0.3205505609512329,0.3263547122478485,0.2112179398536682,996.9635620117188,1e-05,0.07552987337112427,2.354858875274658,23.927850246429443,4 +9960,0.22272717952728271,0.2760527729988098,0.27180051803588867,0.2066987156867981,409.94622802734375,1e-05,0.06317214667797089,2.5876753330230713,23.927850246429443,4 +9961,0.19428522884845734,0.15087369084358215,0.14961878955364227,0.20326922833919525,729.1666870117188,1e-05,0.06342289596796036,2.3615262508392334,23.927850246429443,4 +9962,0.24409060180187225,0.3918154537677765,0.37583884596824646,0.22602562606334686,990.232666015625,1e-05,0.06161199137568474,2.354484796524048,23.927850246429443,4 +9963,0.227150097489357,0.14178913831710815,0.13531158864498138,0.22137819230556488,910.3261108398438,1e-05,0.07922029495239258,2.3576581478118896,23.927850246429443,4 +9964,0.2689879834651947,0.15783771872520447,0.15263579785823822,0.15512819588184357,819.5592651367188,1e-05,0.0639074370265007,2.5944783687591553,23.927850246429443,4 +9965,0.21678043901920319,0.12175846844911575,0.13165639340877533,0.2893589735031128,870.7523803710938,1e-05,0.0683257207274437,2.360564947128296,23.927850246429443,4 +9966,0.1381758600473404,0.23813025653362274,0.22496919333934784,0.21314102411270142,965.6505737304688,1e-05,0.06490489840507507,2.469006299972534,23.927850246429443,4 +9967,0.21752265095710754,0.4518071413040161,0.4627307057380676,0.19576922059059143,222.03948974609375,1e-05,0.0653168112039566,2.379222869873047,23.927850246429443,4 +9968,0.25960177183151245,0.2507674992084503,0.2417432814836502,0.25391024351119995,935.9296264648438,1e-05,0.07103625684976578,2.5476725101470947,23.927850246429443,4 +9969,0.0920119509100914,0.13675421476364136,0.13216878473758698,0.25621792674064636,861.80126953125,1e-05,0.06283924728631973,2.7848260402679443,23.927850246429443,4 +9970,0.18430304527282715,0.2020241618156433,0.19845110177993774,0.22990383207798004,621.2273559570312,1e-05,0.06718023866415024,2.369954824447632,23.927850246429443,4 +9971,0.1985391080379486,0.2515847682952881,0.2670826315879822,0.1815384477376938,386.7403564453125,1e-05,0.07654877752065659,2.4836585521698,23.927850246429443,4 +9972,0.19970270991325378,0.3796027898788452,0.38441988825798035,0.19682691991329193,988.4937133789062,1e-05,0.06777767837047577,2.3699073791503906,23.927850246429443,4 +9973,0.25828614830970764,0.29669955372810364,0.2832149863243103,0.23240384459495544,980.37109375,1e-05,0.07136037945747375,2.3555545806884766,23.927850246429443,4 +9974,0.11319971829652786,0.20338629186153412,0.1974133998155594,0.22842948138713837,998.18701171875,1e-05,0.06252048909664154,2.354288339614868,23.927850246429443,4 +9975,0.18635398149490356,0.5447637438774109,0.5729650259017944,0.21804486215114594,137.90036010742188,1e-05,0.06113874912261963,2.530895471572876,23.927850246429443,4 +9976,0.20968584716320038,0.3529369533061981,0.3387283682823181,0.24512819945812225,999.1974487304688,1e-05,0.0718424841761589,2.3512446880340576,23.927850246429443,4 +9977,0.18456459045410156,0.13416825234889984,0.13449445366859436,0.23208332061767578,883.6459350585938,1e-05,0.05893847346305847,2.4727816581726074,23.927850246429443,4 +9978,0.3136070668697357,0.1698678880929947,0.16994920372962952,0.199455127120018,580.8350830078125,1e-05,0.07056058198213577,2.5505993366241455,23.927850246429443,4 +9979,0.14679032564163208,0.15790054202079773,0.15468519926071167,0.22378204762935638,958.4887084960938,1e-05,0.06822378933429718,2.512882709503174,23.927850246429443,4 +9980,0.19395893812179565,0.15709680318832397,0.1506280153989792,0.25381410121917725,932.7411499023438,1e-05,0.0672607496380806,2.3573269844055176,23.927850246429443,4 +9981,0.20112040638923645,0.19675390422344208,0.18560145795345306,0.2846474349498749,702.7145385742188,1e-05,0.09751571714878082,2.347247838973999,23.927850246429443,4 +9982,0.19895081222057343,0.2064281702041626,0.18929795920848846,0.1977243572473526,954.3519897460938,1e-05,0.07139323651790619,2.618468761444092,23.927850246429443,4 +9983,0.12512360513210297,0.251223087310791,0.26107341051101685,0.2364102452993393,996.7586059570312,1e-05,0.05782109498977661,2.355912923812866,23.927850246429443,4 +9984,0.24934540688991547,0.33969369530677795,0.3371223509311676,0.24551281332969666,317.1641845703125,1e-05,0.0778193399310112,2.349379539489746,23.927850246429443,4 +9985,0.16610997915267944,0.11650664359331131,0.1095452532172203,0.22025640308856964,893.6715698242188,1e-05,0.10000623017549515,2.5304949283599854,23.927850246429443,4 +9986,0.2141488790512085,0.13362538814544678,0.12867110967636108,0.14512820541858673,652.4856567382812,1e-05,0.0761907622218132,2.3627564907073975,23.927850246429443,4 +9987,0.27281901240348816,0.21974946558475494,0.21711479127407074,0.2562820315361023,498.798095703125,1e-05,0.07128465920686722,2.370284080505371,23.927850246429443,4 +9988,0.23767800629138947,0.13140976428985596,0.13844341039657593,0.2527243494987488,436.19793701171875,1e-05,0.08547306060791016,2.5250229835510254,23.927850246429443,4 +9989,0.1981286108493805,0.16535401344299316,0.16020889580249786,0.18483974039554596,896.8926391601562,1e-05,0.06551532447338104,2.5302846431732178,23.927850246429443,4 +9990,0.11290508508682251,0.19281838834285736,0.18461404740810394,0.24038460850715637,969.4793090820312,1e-05,0.06464005261659622,2.5523183345794678,23.927850246429443,4 +9991,0.1693635880947113,0.07514312863349915,0.08318503201007843,0.2416025549173355,910.3261108398438,1e-05,0.07579675316810608,2.3567698001861572,23.927850246429443,4 +9992,0.0996367558836937,0.13664282858371735,0.13550905883312225,0.11397435516119003,811.095458984375,1e-05,0.06017698720097542,2.4888837337493896,23.927850246429443,4 +9993,0.22815488278865814,0.2373419851064682,0.2265893965959549,0.2553845942020416,750.7987060546875,1e-05,0.0741705447435379,2.367154359817505,23.927850246429443,4 +9994,0.1632440984249115,0.2610473930835724,0.249265655875206,0.20971153676509857,970.7328491210938,1e-05,0.07184285670518875,2.3503072261810303,23.927850246429443,4 +9995,0.2386641651391983,0.12891224026679993,0.12514042854309082,0.2272435873746872,880.6146240234375,1e-05,0.061180420219898224,2.3493423461914062,23.927850246429443,4 +9996,0.17122475802898407,0.12464606016874313,0.13233846426010132,0.13451921939849854,901.2276611328125,1e-05,0.06096312776207924,2.4994571208953857,23.927850246429443,4 +9997,0.2383725941181183,0.3116574287414551,0.2997981011867523,0.32073715329170227,973.2064208984375,1e-05,0.06800774484872818,2.3563902378082275,23.927850246429443,4 +9998,0.16532905399799347,0.07831607013940811,0.08493980020284653,0.11131409555673599,563.1868286132812,1e-05,0.07537110149860382,2.4957926273345947,23.927850246429443,4 +9999,0.2091672569513321,0.20825591683387756,0.1998285949230194,0.1467948704957962,454.8346252441406,1e-05,0.06335795670747757,2.3509323596954346,23.927850246429443,4 +10000,0.32756590843200684,0.2137197107076645,0.21851754188537598,0.2319551259279251,498.798095703125,1e-05,0.06506844609975815,2.690211534500122,23.927850246429443,4 diff --git a/backup_2026-09-14/runs/arope_10k_ga2/val_log.csv b/backup_2026-09-14/runs/arope_10k_ga2/val_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..791a9ae1607cb311ed82228aa26a429937c80807 --- /dev/null +++ b/backup_2026-09-14/runs/arope_10k_ga2/val_log.csv @@ -0,0 +1,31 @@ +step,timestep,loss_w,mse,n +5500,201.34228515625,0.39373586885631084,0.40245538391172886,16 +5500,500.59954833984375,0.194950798060745,0.19764317106455564,16 +5500,799.7118530273438,0.14730172092095017,0.14678399357944727,16 +6000,201.34228515625,0.3932978715747595,0.4020219575613737,16 +6000,500.59954833984375,0.19463775726035237,0.19733685348182917,16 +6000,799.7118530273438,0.14619701774790883,0.14582466892898083,16 +6500,201.34228515625,0.3934456668794155,0.40215890295803547,16 +6500,500.59954833984375,0.19450403098016977,0.19717187527567148,16 +6500,799.7118530273438,0.14613287430256605,0.14574308088049293,16 +7000,201.34228515625,0.39247288182377815,0.40117979422211647,16 +7000,500.59954833984375,0.1940845320932567,0.19674364756792784,16 +7000,799.7118530273438,0.14565369440242648,0.14519670279696584,16 +7500,201.34228515625,0.39186473190784454,0.4005490727722645,16 +7500,500.59954833984375,0.19372447114437819,0.19637897983193398,16 +7500,799.7118530273438,0.14493277436122298,0.1445154813118279,16 +8000,201.34228515625,0.3919813446700573,0.40068078227341175,16 +8000,500.59954833984375,0.19363673450425267,0.19629012513905764,16 +8000,799.7118530273438,0.144635456148535,0.14425768237560987,16 +8500,201.34228515625,0.3917994275689125,0.40049630403518677,16 +8500,500.59954833984375,0.19332052115350962,0.19596819393336773,16 +8500,799.7118530273438,0.14433192880824208,0.14388835104182363,16 +9000,201.34228515625,0.3917235191911459,0.40039703249931335,16 +9000,500.59954833984375,0.19325074460357428,0.19591137720271945,16 +9000,799.7118530273438,0.1440424770116806,0.14358054706826806,16 +9500,201.34228515625,0.39111047983169556,0.39975298568606377,16 +9500,500.59954833984375,0.1926723187789321,0.19529615342617035,16 +9500,799.7118530273438,0.14345569629222155,0.1430615270510316,16 +10000,201.34228515625,0.39062325097620487,0.3992959074676037,16 +10000,500.59954833984375,0.19242403889074922,0.19507068395614624,16 +10000,799.7118530273438,0.1431090901605785,0.1427153991535306,16 diff --git a/backup_2026-09-14/runs/distill__stage1_long_K3/config.json b/backup_2026-09-14/runs/distill__stage1_long_K3/config.json new file mode 100644 index 0000000000000000000000000000000000000000..587dab1b824b37d7cfabeede57b82d88ef65dea4 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage1_long_K3/config.json @@ -0,0 +1,206 @@ +{ + "stage": "stage1_ar_tf", + "args": { + "init_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_ar/dits/dit_step10000.safetensors", + "model_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B", + "output": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3", + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx", + "val_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx", + "sidecar": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "text_table": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "limit": null, + "long_seg_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3", + "scene_dropout": 0.1, + "min_rt_ratio": 0.8, + "val_min_rt_ratio": 0.9, + "val_frac": 0.0, + "teacher_forcing": true, + "tf_noise_aug_max_idx": 0, + "action_dropout": 0.0, + "anchor_dropout": 0.0, + "hist_dropout": 0.0, + "ctx_dropout": 0.0, + "windowed_train": 0, + "windowed_sink": 0, + "new_weight": 2.0, + "new_weight_ramp": 0.0, + "lr": 1e-05, + "weight_decay": 0.01, + "adam_betas": "0.9,0.999", + "warmup": 100, + "grad_clip": 10.0, + "batch_size": 1, + "grad_accum": 2, + "max_steps": 1000, + "gradient_checkpointing": true, + "num_workers": 2, + "seed": 0, + "save_every": 250, + "keep_last_dits": 0, + "save_state": true, + "val_every": 250, + "val_n": 16, + "val_timesteps": [ + 200.0, + 500.0, + 800.0 + ], + "log_every": 10, + "resume": "auto", + "dry_run": false, + "betas": [ + 0.9, + 0.999 + ] + }, + "eff_batch": 16, + "dataset": { + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3", + "long_seg_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3", + "train_used": 3000, + "train_total": 3000, + "train_invalid": null, + "train_leak_excluded": null, + "train_low_rt_excluded": null, + "text_table_keys": 361, + "val_used": 16, + "val_clip_ids": [ + "clip_Eybx_100000255_000042", + "clip_Eybx_100000496_000000", + "clip_Eybx_100000680_000063", + "clip_Eybx_100000737_000063", + "clip_Eybx_100000737_000168", + "clip_Eybx_100000751_000231", + "clip_Eybx_100000751_000546", + "clip_Eybx_100000752_000000", + "clip_Eybx_100000838_000168", + "clip_Eybx_100001216_000000", + "clip_Eybx_100001217_000105", + "clip_Eybx_100002599_000000", + "clip_Eybx_100002875_000147", + "clip_Eybx_200000624_000000", + "clip_Eybx_200001033_000126", + "clip_Eybx_200001197_000063" + ] + }, + "model": { + "n_params": 4999803072, + "causal": true, + "mask_channel": true, + "init_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_ar/dits/dit_step10000.safetensors", + "resume_info": { + "path": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_ar/dits/dit_step10000.safetensors", + "n_tensors": 827, + "prefix": "dit.", + "missing": [], + "unexpected": [] + }, + "start_step": 0 + }, + "env": { + "world_size": 8, + "distributed_type": "DistributedType.DEEPSPEED", + "mixed_precision": "bf16", + "torch": "2.11.0+cu128", + "cuda": "12.8", + "gpu": "NVIDIA H200", + "python": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/python3.12", + "platform": "Linux-6.12.94-123.192.amzn2023.x86_64-x86_64-with-glibc2.34", + "hostname": "ip-172-16-244-218.ap-southeast-3.compute.internal", + "argv": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/distill/stage1_ar/ar_tf.py", + "--init_ckpt", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_ar/dits/dit_step10000.safetensors", + "--long_seg_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3", + "--val_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx", + "--sidecar", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "--text_table", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "--teacher_forcing", + "--tf_noise_aug_max_idx", + "0", + "--windowed_train", + "0", + "--windowed_sink", + "0", + "--new_weight", + "2.0", + "--scene_dropout", + "0.1", + "--val_min_rt_ratio", + "0.9", + "--val_frac", + "0", + "--lr", + "1e-5", + "--weight_decay", + "0.01", + "--adam_betas", + "0.9,0.999", + "--warmup", + "100", + "--grad_clip", + "10.0", + "--batch_size", + "1", + "--grad_accum", + "2", + "--max_steps", + "1000", + "--gradient_checkpointing", + "--save_every", + "250", + "--keep_last_dits", + "0", + "--val_every", + "250", + "--val_n", + "16", + "--val_timesteps", + "200,500,800", + "--log_every", + "10", + "--num_workers", + "2", + "--seed", + "0", + "--output", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3", + "--save_state", + "--resume", + "auto" + ], + "started": "2026-09-09 13:00:19", + "cuda_visible_devices": "0,1,2,3,4,5,6,7", + "accelerate": "1.14.0" + }, + "deepspeed_config": { + "train_batch_size": 16, + "train_micro_batch_size_per_gpu": 1, + "gradient_accumulation_steps": 2, + "zero_optimization": { + "stage": 2, + "offload_optimizer": { + "device": "none", + "nvme_path": null + }, + "offload_param": { + "device": "none", + "nvme_path": null + }, + "stage3_gather_16bit_weights_on_model_save": false + }, + "gradient_clipping": 10.0, + "steps_per_print": Infinity, + "bf16": { + "enabled": true + }, + "fp16": { + "enabled": false + }, + "zero_allow_untested_optimizer": true + } +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/distill__stage1_long_K3/launch.log b/backup_2026-09-14/runs/distill__stage1_long_K3/launch.log new file mode 100644 index 0000000000000000000000000000000000000000..9dd1d084e21104cbc50fd874223bfacbe6bcd052 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage1_long_K3/launch.log @@ -0,0 +1,481 @@ +=== stage1_ar_tf | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3 world=8 dist=DistributedType.DEEPSPEED mp=bf16 === +[recipe] 长视野续训:训练集 = /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3(AropeLongDatasetTF),val = /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx(21 cell) +[recipe] tf=True tf_aug=0 windowed=0/0 new_weight=2.0 lr=1e-05 betas=(0.9, 0.999) wd=0.01 warmup=100 clip=10.0 bs=1×accum2×8卡 ⇒ 等效 batch 16 max_steps=1000 gc=True +[AropeLongDatasetTF] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3: 3000 段,latent (48, 61, 30, 52),文本表 361 键,scene_dropout=0.1 +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +[AropeLatentDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx: 1175 个 .pt,sidecar 缺失 0,valid=False 剔除 0,rt_ratio<0.9 剔除 193,可用 16(limit=16);text_mode=scene,文本表 361 键,scene_dropout=0.0 +[data] train 3000 clip,val 16 clip +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] 双向 SFT ← /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_ar/dits/dit_step10000.safetensors(827 个张量,缺 []) +[model] AropeDiT causal=True mask_channel=True 4,999,803,072 参数,加载 5s +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[env] grad_clip=10.0(DeepSpeed 生效值 10.0) +[resume] auto ⇒ 没有存档,从头开始 +[train] 从 step 0 到 1000 +[2026-09-09 13:00:22,125] [WARNING] [torch_autocast.py:122:autocast_if_enabled] torch.autocast is enabled outside DeepSpeed but disabled within the DeepSpeed engine. If you are using DeepSpeed's built-in mixed precision, the engine will follow the settings in bf16/fp16 section. To use torch's native autocast instead, configure the `torch_autocast` section in the DeepSpeed config. +step 10/1000 loss 0.1584 (ema 0.1459) w 0.2250 mse 0.2270 t̄ 744 new 0.51 lr 1.00e-06 gnorm 0.056 37.73s mem 53.3GB +step 20/1000 loss 0.1259 (ema 0.1421) w 0.1564 mse 0.1623 t̄ 708 new 0.53 lr 2.00e-06 gnorm 0.053 37.70s mem 53.3GB +step 30/1000 loss 0.1583 (ema 0.1434) w 0.2041 mse 0.2040 t̄ 745 new 0.62 lr 3.00e-06 gnorm 0.049 37.68s mem 53.3GB +step 40/1000 loss 0.1590 (ema 0.1451) w 0.1237 mse 0.1240 t̄ 756 new 0.62 lr 4.00e-06 gnorm 0.047 37.70s mem 53.3GB +step 50/1000 loss 0.1611 (ema 0.1430) w 0.2348 mse 0.2304 t̄ 719 new 0.51 lr 5.00e-06 gnorm 0.032 37.69s mem 53.3GB +step 60/1000 loss 0.1530 (ema 0.1509) w 0.1603 mse 0.1593 t̄ 711 new 0.56 lr 6.00e-06 gnorm 0.033 37.70s mem 53.3GB +step 70/1000 loss 0.1396 (ema 0.1402) w 0.1677 mse 0.1627 t̄ 766 new 0.58 lr 7.00e-06 gnorm 0.042 37.69s mem 53.3GB +step 80/1000 loss 0.1545 (ema 0.1450) w 0.1101 mse 0.1109 t̄ 778 new 0.19 lr 8.00e-06 gnorm 0.040 37.68s mem 53.3GB +step 90/1000 loss 0.1551 (ema 0.1376) w 0.1475 mse 0.1476 t̄ 757 new 0.47 lr 9.00e-06 gnorm 0.035 37.72s mem 53.3GB +step 100/1000 loss 0.1349 (ema 0.1394) w 0.1593 mse 0.1577 t̄ 704 new 0.62 lr 1.00e-05 gnorm 0.054 37.70s mem 53.3GB +step 110/1000 loss 0.1274 (ema 0.1429) w 0.1170 mse 0.1177 t̄ 758 new 0.57 lr 1.00e-05 gnorm 0.039 37.70s mem 53.3GB +step 120/1000 loss 0.1236 (ema 0.1417) w 0.1027 mse 0.1054 t̄ 782 new 0.67 lr 1.00e-05 gnorm 0.053 37.70s mem 53.3GB +step 130/1000 loss 0.1391 (ema 0.1349) w 0.0885 mse 0.0908 t̄ 801 new 0.35 lr 1.00e-05 gnorm 0.043 37.72s mem 53.3GB +step 140/1000 loss 0.1430 (ema 0.1422) w 0.1698 mse 0.1706 t̄ 690 new 0.26 lr 1.00e-05 gnorm 0.080 37.70s mem 53.3GB +step 150/1000 loss 0.1215 (ema 0.1410) w 0.0973 mse 0.0970 t̄ 759 new 0.55 lr 1.00e-05 gnorm 0.042 37.71s mem 53.3GB +step 160/1000 loss 0.1289 (ema 0.1421) w 0.1276 mse 0.1315 t̄ 774 new 0.35 lr 1.00e-05 gnorm 0.042 37.71s mem 53.3GB +step 170/1000 loss 0.1345 (ema 0.1438) w 0.1062 mse 0.1071 t̄ 804 new 0.23 lr 1.00e-05 gnorm 0.051 37.73s mem 53.3GB +step 180/1000 loss 0.1262 (ema 0.1424) w 0.1364 mse 0.1350 t̄ 759 new 0.42 lr 1.00e-05 gnorm 0.047 37.71s mem 53.3GB +step 190/1000 loss 0.1548 (ema 0.1420) w 0.1354 mse 0.1354 t̄ 748 new 0.41 lr 1.00e-05 gnorm 0.036 37.69s mem 53.3GB +step 200/1000 loss 0.1409 (ema 0.1381) w 0.1973 mse 0.1981 t̄ 732 new 0.57 lr 1.00e-05 gnorm 0.037 37.70s mem 53.3GB +step 210/1000 loss 0.1627 (ema 0.1421) w 0.2369 mse 0.2435 t̄ 786 new 0.52 lr 1.00e-05 gnorm 0.042 37.72s mem 53.3GB +step 220/1000 loss 0.1495 (ema 0.1411) w 0.2075 mse 0.2097 t̄ 768 new 0.40 lr 1.00e-05 gnorm 0.052 37.69s mem 53.3GB +step 230/1000 loss 0.1249 (ema 0.1367) w 0.1315 mse 0.1301 t̄ 780 new 0.40 lr 1.00e-05 gnorm 0.049 37.68s mem 53.3GB +step 240/1000 loss 0.1622 (ema 0.1394) w 0.0740 mse 0.0802 t̄ 769 new 0.33 lr 1.00e-05 gnorm 0.059 37.70s mem 53.3GB +step 250/1000 loss 0.1599 (ema 0.1413) w 0.1366 mse 0.1350 t̄ 730 new 0.44 lr 1.00e-05 gnorm 0.056 37.70s mem 53.3GB +[val] step 250 t=201: w=0.3815 mse=0.3878 (n=16) t=501: w=0.1501 mse=0.1501 (n=16) t=800: w=0.0807 mse=0.0797 (n=16) | mean w=0.2041 6s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step250.safetensors 827 个张量 10.00 GB +[save] accelerator.save_state → /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state_A(/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state → state_A) +step 260/1000 loss 0.1400 (ema 0.1404) w 0.1481 mse 0.1480 t̄ 758 new 0.46 lr 1.00e-05 gnorm 0.042 37.70s mem 53.6GB +step 270/1000 loss 0.1495 (ema 0.1398) w 0.1967 mse 0.1958 t̄ 784 new 0.62 lr 1.00e-05 gnorm 0.059 37.69s mem 53.6GB +step 280/1000 loss 0.1320 (ema 0.1371) w 0.1010 mse 0.1060 t̄ 782 new 0.29 lr 1.00e-05 gnorm 0.071 37.69s mem 53.6GB +step 290/1000 loss 0.1273 (ema 0.1346) w 0.1247 mse 0.1264 t̄ 789 new 0.41 lr 1.00e-05 gnorm 0.060 37.67s mem 53.6GB +step 300/1000 loss 0.1305 (ema 0.1391) w 0.1293 mse 0.1274 t̄ 716 new 0.52 lr 1.00e-05 gnorm 0.048 37.70s mem 53.6GB +step 310/1000 loss 0.1556 (ema 0.1445) w 0.1780 mse 0.1802 t̄ 747 new 0.56 lr 1.00e-05 gnorm 0.047 37.69s mem 53.6GB +step 320/1000 loss 0.1401 (ema 0.1394) w 0.1748 mse 0.1747 t̄ 791 new 0.57 lr 1.00e-05 gnorm 0.047 37.68s mem 53.6GB +step 330/1000 loss 0.1487 (ema 0.1424) w 0.1552 mse 0.1550 t̄ 764 new 0.66 lr 1.00e-05 gnorm 0.044 37.69s mem 53.6GB +step 340/1000 loss 0.1231 (ema 0.1436) w 0.1677 mse 0.1633 t̄ 727 new 0.58 lr 1.00e-05 gnorm 0.039 37.69s mem 53.6GB +step 350/1000 loss 0.1258 (ema 0.1369) w 0.1091 mse 0.1179 t̄ 734 new 0.47 lr 1.00e-05 gnorm 0.090 37.67s mem 53.6GB +step 360/1000 loss 0.1434 (ema 0.1476) w 0.1172 mse 0.1226 t̄ 807 new 0.45 lr 1.00e-05 gnorm 0.068 37.88s mem 53.6GB +step 370/1000 loss 0.1315 (ema 0.1370) w 0.1102 mse 0.1117 t̄ 797 new 0.19 lr 1.00e-05 gnorm 0.049 37.69s mem 53.6GB +step 380/1000 loss 0.1224 (ema 0.1356) w 0.1210 mse 0.1200 t̄ 760 new 0.62 lr 1.00e-05 gnorm 0.058 37.69s mem 53.6GB +step 390/1000 loss 0.1310 (ema 0.1412) w 0.0963 mse 0.0973 t̄ 734 new 0.53 lr 1.00e-05 gnorm 0.050 37.74s mem 53.6GB +step 400/1000 loss 0.1325 (ema 0.1406) w 0.1067 mse 0.1065 t̄ 746 new 0.50 lr 1.00e-05 gnorm 0.054 37.69s mem 53.6GB +step 410/1000 loss 0.1515 (ema 0.1435) w 0.2114 mse 0.2109 t̄ 738 new 0.60 lr 1.00e-05 gnorm 0.053 37.70s mem 53.6GB +step 420/1000 loss 0.1738 (ema 0.1433) w 0.1898 mse 0.1898 t̄ 681 new 0.51 lr 1.00e-05 gnorm 0.056 37.68s mem 53.6GB +step 430/1000 loss 0.1390 (ema 0.1449) w 0.0803 mse 0.0852 t̄ 787 new 0.38 lr 1.00e-05 gnorm 0.039 37.70s mem 53.6GB +step 440/1000 loss 0.1376 (ema 0.1387) w 0.1622 mse 0.1612 t̄ 753 new 0.31 lr 1.00e-05 gnorm 0.044 37.69s mem 53.6GB +step 450/1000 loss 0.1405 (ema 0.1394) w 0.0756 mse 0.0751 t̄ 768 new 0.53 lr 1.00e-05 gnorm 0.042 37.70s mem 53.6GB +step 460/1000 loss 0.1421 (ema 0.1359) w 0.1817 mse 0.1830 t̄ 760 new 0.62 lr 1.00e-05 gnorm 0.046 37.69s mem 53.6GB +step 470/1000 loss 0.1330 (ema 0.1332) w 0.1399 mse 0.1412 t̄ 724 new 0.61 lr 1.00e-05 gnorm 0.048 37.68s mem 53.6GB +step 480/1000 loss 0.1483 (ema 0.1359) w 0.1142 mse 0.1160 t̄ 737 new 0.52 lr 1.00e-05 gnorm 0.070 77.08s mem 53.6GB +step 490/1000 loss 0.1607 (ema 0.1374) w 0.0862 mse 0.0852 t̄ 810 new 0.62 lr 1.00e-05 gnorm 0.068 55.93s mem 53.6GB +step 500/1000 loss 0.1415 (ema 0.1405) w 0.1902 mse 0.1910 t̄ 668 new 0.36 lr 1.00e-05 gnorm 0.046 53.26s mem 53.6GB +[val] step 500 t=201: w=0.3810 mse=0.3873 (n=16) t=501: w=0.1498 mse=0.1497 (n=16) t=800: w=0.0803 mse=0.0793 (n=16) | mean w=0.2037 5s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step500.safetensors 827 个张量 10.00 GB +[save] accelerator.save_state → /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state_B(/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state → state_B) +step 510/1000 loss 0.1157 (ema 0.1400) w 0.1196 mse 0.1206 t̄ 756 new 0.66 lr 1.00e-05 gnorm 0.061 75.36s mem 53.6GB +step 520/1000 loss 0.1716 (ema 0.1375) w 0.1921 mse 0.1903 t̄ 732 new 0.53 lr 1.00e-05 gnorm 0.047 44.92s mem 53.6GB +step 530/1000 loss 0.1431 (ema 0.1369) w 0.1857 mse 0.1772 t̄ 689 new 0.42 lr 1.00e-05 gnorm 0.042 37.65s mem 53.6GB +step 540/1000 loss 0.1486 (ema 0.1372) w 0.1922 mse 0.1879 t̄ 704 new 0.64 lr 1.00e-05 gnorm 0.067 37.69s mem 53.6GB +step 550/1000 loss 0.1454 (ema 0.1396) w 0.1470 mse 0.1501 t̄ 721 new 0.34 lr 1.00e-05 gnorm 0.049 37.70s mem 53.6GB +step 560/1000 loss 0.1429 (ema 0.1376) w 0.1168 mse 0.1172 t̄ 706 new 0.63 lr 1.00e-05 gnorm 0.055 37.69s mem 53.6GB +step 570/1000 loss 0.1519 (ema 0.1420) w 0.1679 mse 0.1651 t̄ 744 new 0.41 lr 1.00e-05 gnorm 0.060 37.69s mem 53.6GB +step 580/1000 loss 0.1651 (ema 0.1446) w 0.2491 mse 0.2458 t̄ 711 new 0.30 lr 1.00e-05 gnorm 0.050 37.68s mem 53.6GB +step 590/1000 loss 0.1540 (ema 0.1390) w 0.1342 mse 0.1318 t̄ 796 new 0.57 lr 1.00e-05 gnorm 0.050 37.68s mem 53.6GB +step 600/1000 loss 0.1644 (ema 0.1439) w 0.1304 mse 0.1253 t̄ 760 new 0.35 lr 1.00e-05 gnorm 0.051 37.69s mem 53.6GB +step 610/1000 loss 0.1306 (ema 0.1423) w 0.1398 mse 0.1418 t̄ 732 new 0.58 lr 1.00e-05 gnorm 0.057 37.69s mem 53.6GB +step 620/1000 loss 0.1194 (ema 0.1398) w 0.1323 mse 0.1347 t̄ 765 new 0.52 lr 1.00e-05 gnorm 0.054 37.68s mem 53.6GB +step 630/1000 loss 0.1285 (ema 0.1403) w 0.1314 mse 0.1354 t̄ 739 new 0.58 lr 1.00e-05 gnorm 0.048 37.70s mem 53.6GB +step 640/1000 loss 0.1236 (ema 0.1373) w 0.1352 mse 0.1333 t̄ 771 new 0.59 lr 1.00e-05 gnorm 0.046 37.67s mem 53.6GB +step 650/1000 loss 0.1589 (ema 0.1444) w 0.1574 mse 0.1598 t̄ 693 new 0.60 lr 1.00e-05 gnorm 0.040 37.68s mem 53.6GB +step 660/1000 loss 0.1200 (ema 0.1353) w 0.0988 mse 0.1002 t̄ 812 new 0.34 lr 1.00e-05 gnorm 0.043 37.68s mem 53.6GB +step 670/1000 loss 0.1340 (ema 0.1351) w 0.1467 mse 0.1432 t̄ 700 new 0.40 lr 1.00e-05 gnorm 0.048 37.68s mem 53.6GB +step 680/1000 loss 0.1529 (ema 0.1389) w 0.1259 mse 0.1232 t̄ 718 new 0.60 lr 1.00e-05 gnorm 0.070 37.69s mem 53.6GB +step 690/1000 loss 0.1314 (ema 0.1398) w 0.0914 mse 0.0992 t̄ 748 new 0.29 lr 1.00e-05 gnorm 0.052 37.70s mem 53.6GB +step 700/1000 loss 0.1560 (ema 0.1350) w 0.1282 mse 0.1287 t̄ 752 new 0.66 lr 1.00e-05 gnorm 0.052 37.68s mem 53.6GB +step 710/1000 loss 0.1118 (ema 0.1372) w 0.1140 mse 0.1165 t̄ 779 new 0.59 lr 1.00e-05 gnorm 0.043 37.72s mem 53.6GB +step 720/1000 loss 0.1631 (ema 0.1385) w 0.1033 mse 0.1041 t̄ 795 new 0.59 lr 1.00e-05 gnorm 0.048 37.70s mem 53.6GB +step 730/1000 loss 0.1091 (ema 0.1356) w 0.0646 mse 0.0703 t̄ 752 new 0.22 lr 1.00e-05 gnorm 0.049 37.69s mem 53.6GB +step 740/1000 loss 0.1631 (ema 0.1351) w 0.1429 mse 0.1414 t̄ 729 new 0.42 lr 1.00e-05 gnorm 0.047 37.68s mem 53.6GB +step 750/1000 loss 0.1246 (ema 0.1383) w 0.2017 mse 0.1925 t̄ 753 new 0.45 lr 1.00e-05 gnorm 0.057 37.70s mem 53.6GB +[val] step 750 t=201: w=0.3803 mse=0.3865 (n=16) t=501: w=0.1494 mse=0.1493 (n=16) t=800: w=0.0799 mse=0.0789 (n=16) | mean w=0.2032 5s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step750.safetensors 827 个张量 10.00 GB +[save] accelerator.save_state → /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state_A(/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state → state_A) +step 760/1000 loss 0.1322 (ema 0.1389) w 0.1912 mse 0.1921 t̄ 729 new 0.60 lr 1.00e-05 gnorm 0.057 37.68s mem 53.6GB +step 770/1000 loss 0.1501 (ema 0.1408) w 0.1638 mse 0.1645 t̄ 755 new 0.47 lr 1.00e-05 gnorm 0.064 37.69s mem 53.6GB +step 780/1000 loss 0.1275 (ema 0.1396) w 0.1288 mse 0.1302 t̄ 743 new 0.58 lr 1.00e-05 gnorm 0.040 37.70s mem 53.6GB +step 790/1000 loss 0.1684 (ema 0.1425) w 0.1353 mse 0.1362 t̄ 766 new 0.63 lr 1.00e-05 gnorm 0.057 37.70s mem 53.6GB +step 800/1000 loss 0.1664 (ema 0.1425) w 0.1972 mse 0.1971 t̄ 768 new 0.58 lr 1.00e-05 gnorm 0.048 37.71s mem 53.6GB +step 810/1000 loss 0.1450 (ema 0.1413) w 0.1151 mse 0.1134 t̄ 815 new 0.59 lr 1.00e-05 gnorm 0.059 37.71s mem 53.6GB +step 820/1000 loss 0.1252 (ema 0.1395) w 0.0932 mse 0.0969 t̄ 749 new 0.26 lr 1.00e-05 gnorm 0.084 37.68s mem 53.6GB +step 830/1000 loss 0.1293 (ema 0.1399) w 0.1356 mse 0.1372 t̄ 701 new 0.60 lr 1.00e-05 gnorm 0.051 37.70s mem 53.6GB +step 840/1000 loss 0.1339 (ema 0.1392) w 0.1839 mse 0.1853 t̄ 814 new 0.54 lr 1.00e-05 gnorm 0.045 37.72s mem 53.6GB +step 850/1000 loss 0.1346 (ema 0.1362) w 0.1191 mse 0.1222 t̄ 782 new 0.41 lr 1.00e-05 gnorm 0.066 37.71s mem 53.6GB +step 860/1000 loss 0.1276 (ema 0.1403) w 0.0971 mse 0.0933 t̄ 786 new 0.55 lr 1.00e-05 gnorm 0.073 37.69s mem 53.6GB +step 870/1000 loss 0.1372 (ema 0.1407) w 0.1131 mse 0.1173 t̄ 747 new 0.42 lr 1.00e-05 gnorm 0.049 37.68s mem 53.6GB +step 880/1000 loss 0.1618 (ema 0.1456) w 0.1231 mse 0.1215 t̄ 763 new 0.57 lr 1.00e-05 gnorm 0.074 37.94s mem 53.6GB +step 890/1000 loss 0.1304 (ema 0.1435) w 0.1230 mse 0.1235 t̄ 770 new 0.50 lr 1.00e-05 gnorm 0.068 37.70s mem 53.6GB +step 900/1000 loss 0.1321 (ema 0.1376) w 0.1855 mse 0.1851 t̄ 765 new 0.52 lr 1.00e-05 gnorm 0.060 37.69s mem 53.6GB +step 910/1000 loss 0.1374 (ema 0.1398) w 0.1143 mse 0.1132 t̄ 787 new 0.57 lr 1.00e-05 gnorm 0.045 37.94s mem 53.6GB +step 920/1000 loss 0.1284 (ema 0.1375) w 0.1215 mse 0.1232 t̄ 749 new 0.60 lr 1.00e-05 gnorm 0.081 37.68s mem 53.6GB +step 930/1000 loss 0.1451 (ema 0.1436) w 0.1707 mse 0.1709 t̄ 792 new 0.48 lr 1.00e-05 gnorm 0.043 37.70s mem 53.6GB +step 940/1000 loss 0.1493 (ema 0.1426) w 0.1036 mse 0.1010 t̄ 741 new 0.58 lr 1.00e-05 gnorm 0.030 18.86s mem 53.6GB +step 950/1000 loss 0.1710 (ema 0.1502) w 0.1831 mse 0.1789 t̄ 760 new 0.61 lr 1.00e-05 gnorm 0.072 37.68s mem 53.6GB +step 960/1000 loss 0.1205 (ema 0.1414) w 0.0702 mse 0.0720 t̄ 769 new 0.53 lr 1.00e-05 gnorm 0.066 37.68s mem 53.6GB +step 970/1000 loss 0.1539 (ema 0.1417) w 0.1219 mse 0.1209 t̄ 749 new 0.56 lr 1.00e-05 gnorm 0.052 37.67s mem 53.6GB +step 980/1000 loss 0.1194 (ema 0.1371) w 0.1063 mse 0.1062 t̄ 750 new 0.63 lr 1.00e-05 gnorm 0.055 37.69s mem 53.6GB +step 990/1000 loss 0.1345 (ema 0.1408) w 0.1532 mse 0.1543 t̄ 709 new 0.68 lr 1.00e-05 gnorm 0.038 37.66s mem 53.6GB +step 1000/1000 loss 0.1311 (ema 0.1414) w 0.1403 mse 0.1376 t̄ 760 new 0.65 lr 1.00e-05 gnorm 0.065 37.72s mem 53.6GB +[val] step 1000 t=201: w=0.3798 mse=0.3860 (n=16) t=501: w=0.1490 mse=0.1489 (n=16) t=800: w=0.0796 mse=0.0786 (n=16) | mean w=0.2028 5s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors 827 个张量 10.00 GB +[save] accelerator.save_state → /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state_B(/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state → state_B) +[done] step 1000,各进程峰值显存 53.9 GB。下一步:把 dits/dit_step1000.safetensors 同时作为 stage2 的 --teacher_ckpt 与 --student_ckpt diff --git a/backup_2026-09-14/runs/distill__stage1_long_K3/progress.json b/backup_2026-09-14/runs/distill__stage1_long_K3/progress.json new file mode 100644 index 0000000000000000000000000000000000000000..bbaa872d390f12c250ef5ce27089fb61b7944e41 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage1_long_K3/progress.json @@ -0,0 +1 @@ +{"step": 1000, "wall": 1788997910.236511, "time": "2026-09-09 23:51:50", "stage": "stage1_ar_tf", "finished": true, "peak_mem_gb": 53.91726303100586} \ No newline at end of file diff --git a/backup_2026-09-14/runs/distill__stage1_long_K3/stdout.log b/backup_2026-09-14/runs/distill__stage1_long_K3/stdout.log new file mode 100644 index 0000000000000000000000000000000000000000..8f7b51b66449328f917a4f5e015ccef897315463 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage1_long_K3/stdout.log @@ -0,0 +1,485 @@ +[guard] GPU 0,1,2,3,4,5,6,7 空闲(每张 <= 500 MiB),可以启动。 +[stage1-long] init=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_ar/dits/dit_step10000.safetensors +[stage1-long] long=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3 (3000 段) out=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3 port=29545 cfg=accelerate_zero2_8gpu_ga2.yaml 等效 batch=16 +[stage1-long] lr=1e-5 betas=0.9,0.999 warmup=100 clip=10.0 max_steps=1000 save_every=250 window=0/0 +=== stage1_ar_tf | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3 world=8 dist=DistributedType.DEEPSPEED mp=bf16 === +[recipe] 长视野续训:训练集 = /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3(AropeLongDatasetTF),val = /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx(21 cell) +[recipe] tf=True tf_aug=0 windowed=0/0 new_weight=2.0 lr=1e-05 betas=(0.9, 0.999) wd=0.01 warmup=100 clip=10.0 bs=1×accum2×8卡 ⇒ 等效 batch 16 max_steps=1000 gc=True +[AropeLongDatasetTF] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3: 3000 段,latent (48, 61, 30, 52),文本表 361 键,scene_dropout=0.1 +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +[AropeLatentDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx: 1175 个 .pt,sidecar 缺失 0,valid=False 剔除 0,rt_ratio<0.9 剔除 193,可用 16(limit=16);text_mode=scene,文本表 361 键,scene_dropout=0.0 +[data] train 3000 clip,val 16 clip +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] 双向 SFT ← /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_ar/dits/dit_step10000.safetensors(827 个张量,缺 []) +[model] AropeDiT causal=True mask_channel=True 4,999,803,072 参数,加载 5s +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[env] grad_clip=10.0(DeepSpeed 生效值 10.0) +[resume] auto ⇒ 没有存档,从头开始 +[train] 从 step 0 到 1000 +[2026-09-09 13:00:22,125] [WARNING] [torch_autocast.py:122:autocast_if_enabled] torch.autocast is enabled outside DeepSpeed but disabled within the DeepSpeed engine. If you are using DeepSpeed's built-in mixed precision, the engine will follow the settings in bf16/fp16 section. To use torch's native autocast instead, configure the `torch_autocast` section in the DeepSpeed config. +step 10/1000 loss 0.1584 (ema 0.1459) w 0.2250 mse 0.2270 t̄ 744 new 0.51 lr 1.00e-06 gnorm 0.056 37.73s mem 53.3GB +step 20/1000 loss 0.1259 (ema 0.1421) w 0.1564 mse 0.1623 t̄ 708 new 0.53 lr 2.00e-06 gnorm 0.053 37.70s mem 53.3GB +step 30/1000 loss 0.1583 (ema 0.1434) w 0.2041 mse 0.2040 t̄ 745 new 0.62 lr 3.00e-06 gnorm 0.049 37.68s mem 53.3GB +step 40/1000 loss 0.1590 (ema 0.1451) w 0.1237 mse 0.1240 t̄ 756 new 0.62 lr 4.00e-06 gnorm 0.047 37.70s mem 53.3GB +step 50/1000 loss 0.1611 (ema 0.1430) w 0.2348 mse 0.2304 t̄ 719 new 0.51 lr 5.00e-06 gnorm 0.032 37.69s mem 53.3GB +step 60/1000 loss 0.1530 (ema 0.1509) w 0.1603 mse 0.1593 t̄ 711 new 0.56 lr 6.00e-06 gnorm 0.033 37.70s mem 53.3GB +step 70/1000 loss 0.1396 (ema 0.1402) w 0.1677 mse 0.1627 t̄ 766 new 0.58 lr 7.00e-06 gnorm 0.042 37.69s mem 53.3GB +step 80/1000 loss 0.1545 (ema 0.1450) w 0.1101 mse 0.1109 t̄ 778 new 0.19 lr 8.00e-06 gnorm 0.040 37.68s mem 53.3GB +step 90/1000 loss 0.1551 (ema 0.1376) w 0.1475 mse 0.1476 t̄ 757 new 0.47 lr 9.00e-06 gnorm 0.035 37.72s mem 53.3GB +step 100/1000 loss 0.1349 (ema 0.1394) w 0.1593 mse 0.1577 t̄ 704 new 0.62 lr 1.00e-05 gnorm 0.054 37.70s mem 53.3GB +step 110/1000 loss 0.1274 (ema 0.1429) w 0.1170 mse 0.1177 t̄ 758 new 0.57 lr 1.00e-05 gnorm 0.039 37.70s mem 53.3GB +step 120/1000 loss 0.1236 (ema 0.1417) w 0.1027 mse 0.1054 t̄ 782 new 0.67 lr 1.00e-05 gnorm 0.053 37.70s mem 53.3GB +step 130/1000 loss 0.1391 (ema 0.1349) w 0.0885 mse 0.0908 t̄ 801 new 0.35 lr 1.00e-05 gnorm 0.043 37.72s mem 53.3GB +step 140/1000 loss 0.1430 (ema 0.1422) w 0.1698 mse 0.1706 t̄ 690 new 0.26 lr 1.00e-05 gnorm 0.080 37.70s mem 53.3GB +step 150/1000 loss 0.1215 (ema 0.1410) w 0.0973 mse 0.0970 t̄ 759 new 0.55 lr 1.00e-05 gnorm 0.042 37.71s mem 53.3GB +step 160/1000 loss 0.1289 (ema 0.1421) w 0.1276 mse 0.1315 t̄ 774 new 0.35 lr 1.00e-05 gnorm 0.042 37.71s mem 53.3GB +step 170/1000 loss 0.1345 (ema 0.1438) w 0.1062 mse 0.1071 t̄ 804 new 0.23 lr 1.00e-05 gnorm 0.051 37.73s mem 53.3GB +step 180/1000 loss 0.1262 (ema 0.1424) w 0.1364 mse 0.1350 t̄ 759 new 0.42 lr 1.00e-05 gnorm 0.047 37.71s mem 53.3GB +step 190/1000 loss 0.1548 (ema 0.1420) w 0.1354 mse 0.1354 t̄ 748 new 0.41 lr 1.00e-05 gnorm 0.036 37.69s mem 53.3GB +step 200/1000 loss 0.1409 (ema 0.1381) w 0.1973 mse 0.1981 t̄ 732 new 0.57 lr 1.00e-05 gnorm 0.037 37.70s mem 53.3GB +step 210/1000 loss 0.1627 (ema 0.1421) w 0.2369 mse 0.2435 t̄ 786 new 0.52 lr 1.00e-05 gnorm 0.042 37.72s mem 53.3GB +step 220/1000 loss 0.1495 (ema 0.1411) w 0.2075 mse 0.2097 t̄ 768 new 0.40 lr 1.00e-05 gnorm 0.052 37.69s mem 53.3GB +step 230/1000 loss 0.1249 (ema 0.1367) w 0.1315 mse 0.1301 t̄ 780 new 0.40 lr 1.00e-05 gnorm 0.049 37.68s mem 53.3GB +step 240/1000 loss 0.1622 (ema 0.1394) w 0.0740 mse 0.0802 t̄ 769 new 0.33 lr 1.00e-05 gnorm 0.059 37.70s mem 53.3GB +step 250/1000 loss 0.1599 (ema 0.1413) w 0.1366 mse 0.1350 t̄ 730 new 0.44 lr 1.00e-05 gnorm 0.056 37.70s mem 53.3GB +[val] step 250 t=201: w=0.3815 mse=0.3878 (n=16) t=501: w=0.1501 mse=0.1501 (n=16) t=800: w=0.0807 mse=0.0797 (n=16) | mean w=0.2041 6s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step250.safetensors 827 个张量 10.00 GB +[save] accelerator.save_state → /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state_A(/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state → state_A) +step 260/1000 loss 0.1400 (ema 0.1404) w 0.1481 mse 0.1480 t̄ 758 new 0.46 lr 1.00e-05 gnorm 0.042 37.70s mem 53.6GB +step 270/1000 loss 0.1495 (ema 0.1398) w 0.1967 mse 0.1958 t̄ 784 new 0.62 lr 1.00e-05 gnorm 0.059 37.69s mem 53.6GB +step 280/1000 loss 0.1320 (ema 0.1371) w 0.1010 mse 0.1060 t̄ 782 new 0.29 lr 1.00e-05 gnorm 0.071 37.69s mem 53.6GB +step 290/1000 loss 0.1273 (ema 0.1346) w 0.1247 mse 0.1264 t̄ 789 new 0.41 lr 1.00e-05 gnorm 0.060 37.67s mem 53.6GB +step 300/1000 loss 0.1305 (ema 0.1391) w 0.1293 mse 0.1274 t̄ 716 new 0.52 lr 1.00e-05 gnorm 0.048 37.70s mem 53.6GB +step 310/1000 loss 0.1556 (ema 0.1445) w 0.1780 mse 0.1802 t̄ 747 new 0.56 lr 1.00e-05 gnorm 0.047 37.69s mem 53.6GB +step 320/1000 loss 0.1401 (ema 0.1394) w 0.1748 mse 0.1747 t̄ 791 new 0.57 lr 1.00e-05 gnorm 0.047 37.68s mem 53.6GB +step 330/1000 loss 0.1487 (ema 0.1424) w 0.1552 mse 0.1550 t̄ 764 new 0.66 lr 1.00e-05 gnorm 0.044 37.69s mem 53.6GB +step 340/1000 loss 0.1231 (ema 0.1436) w 0.1677 mse 0.1633 t̄ 727 new 0.58 lr 1.00e-05 gnorm 0.039 37.69s mem 53.6GB +step 350/1000 loss 0.1258 (ema 0.1369) w 0.1091 mse 0.1179 t̄ 734 new 0.47 lr 1.00e-05 gnorm 0.090 37.67s mem 53.6GB +step 360/1000 loss 0.1434 (ema 0.1476) w 0.1172 mse 0.1226 t̄ 807 new 0.45 lr 1.00e-05 gnorm 0.068 37.88s mem 53.6GB +step 370/1000 loss 0.1315 (ema 0.1370) w 0.1102 mse 0.1117 t̄ 797 new 0.19 lr 1.00e-05 gnorm 0.049 37.69s mem 53.6GB +step 380/1000 loss 0.1224 (ema 0.1356) w 0.1210 mse 0.1200 t̄ 760 new 0.62 lr 1.00e-05 gnorm 0.058 37.69s mem 53.6GB +step 390/1000 loss 0.1310 (ema 0.1412) w 0.0963 mse 0.0973 t̄ 734 new 0.53 lr 1.00e-05 gnorm 0.050 37.74s mem 53.6GB +step 400/1000 loss 0.1325 (ema 0.1406) w 0.1067 mse 0.1065 t̄ 746 new 0.50 lr 1.00e-05 gnorm 0.054 37.69s mem 53.6GB +step 410/1000 loss 0.1515 (ema 0.1435) w 0.2114 mse 0.2109 t̄ 738 new 0.60 lr 1.00e-05 gnorm 0.053 37.70s mem 53.6GB +step 420/1000 loss 0.1738 (ema 0.1433) w 0.1898 mse 0.1898 t̄ 681 new 0.51 lr 1.00e-05 gnorm 0.056 37.68s mem 53.6GB +step 430/1000 loss 0.1390 (ema 0.1449) w 0.0803 mse 0.0852 t̄ 787 new 0.38 lr 1.00e-05 gnorm 0.039 37.70s mem 53.6GB +step 440/1000 loss 0.1376 (ema 0.1387) w 0.1622 mse 0.1612 t̄ 753 new 0.31 lr 1.00e-05 gnorm 0.044 37.69s mem 53.6GB +step 450/1000 loss 0.1405 (ema 0.1394) w 0.0756 mse 0.0751 t̄ 768 new 0.53 lr 1.00e-05 gnorm 0.042 37.70s mem 53.6GB +step 460/1000 loss 0.1421 (ema 0.1359) w 0.1817 mse 0.1830 t̄ 760 new 0.62 lr 1.00e-05 gnorm 0.046 37.69s mem 53.6GB +step 470/1000 loss 0.1330 (ema 0.1332) w 0.1399 mse 0.1412 t̄ 724 new 0.61 lr 1.00e-05 gnorm 0.048 37.68s mem 53.6GB +step 480/1000 loss 0.1483 (ema 0.1359) w 0.1142 mse 0.1160 t̄ 737 new 0.52 lr 1.00e-05 gnorm 0.070 77.08s mem 53.6GB +step 490/1000 loss 0.1607 (ema 0.1374) w 0.0862 mse 0.0852 t̄ 810 new 0.62 lr 1.00e-05 gnorm 0.068 55.93s mem 53.6GB +step 500/1000 loss 0.1415 (ema 0.1405) w 0.1902 mse 0.1910 t̄ 668 new 0.36 lr 1.00e-05 gnorm 0.046 53.26s mem 53.6GB +[val] step 500 t=201: w=0.3810 mse=0.3873 (n=16) t=501: w=0.1498 mse=0.1497 (n=16) t=800: w=0.0803 mse=0.0793 (n=16) | mean w=0.2037 5s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step500.safetensors 827 个张量 10.00 GB +[save] accelerator.save_state → /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state_B(/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state → state_B) +step 510/1000 loss 0.1157 (ema 0.1400) w 0.1196 mse 0.1206 t̄ 756 new 0.66 lr 1.00e-05 gnorm 0.061 75.36s mem 53.6GB +step 520/1000 loss 0.1716 (ema 0.1375) w 0.1921 mse 0.1903 t̄ 732 new 0.53 lr 1.00e-05 gnorm 0.047 44.92s mem 53.6GB +step 530/1000 loss 0.1431 (ema 0.1369) w 0.1857 mse 0.1772 t̄ 689 new 0.42 lr 1.00e-05 gnorm 0.042 37.65s mem 53.6GB +step 540/1000 loss 0.1486 (ema 0.1372) w 0.1922 mse 0.1879 t̄ 704 new 0.64 lr 1.00e-05 gnorm 0.067 37.69s mem 53.6GB +step 550/1000 loss 0.1454 (ema 0.1396) w 0.1470 mse 0.1501 t̄ 721 new 0.34 lr 1.00e-05 gnorm 0.049 37.70s mem 53.6GB +step 560/1000 loss 0.1429 (ema 0.1376) w 0.1168 mse 0.1172 t̄ 706 new 0.63 lr 1.00e-05 gnorm 0.055 37.69s mem 53.6GB +step 570/1000 loss 0.1519 (ema 0.1420) w 0.1679 mse 0.1651 t̄ 744 new 0.41 lr 1.00e-05 gnorm 0.060 37.69s mem 53.6GB +step 580/1000 loss 0.1651 (ema 0.1446) w 0.2491 mse 0.2458 t̄ 711 new 0.30 lr 1.00e-05 gnorm 0.050 37.68s mem 53.6GB +step 590/1000 loss 0.1540 (ema 0.1390) w 0.1342 mse 0.1318 t̄ 796 new 0.57 lr 1.00e-05 gnorm 0.050 37.68s mem 53.6GB +step 600/1000 loss 0.1644 (ema 0.1439) w 0.1304 mse 0.1253 t̄ 760 new 0.35 lr 1.00e-05 gnorm 0.051 37.69s mem 53.6GB +step 610/1000 loss 0.1306 (ema 0.1423) w 0.1398 mse 0.1418 t̄ 732 new 0.58 lr 1.00e-05 gnorm 0.057 37.69s mem 53.6GB +step 620/1000 loss 0.1194 (ema 0.1398) w 0.1323 mse 0.1347 t̄ 765 new 0.52 lr 1.00e-05 gnorm 0.054 37.68s mem 53.6GB +step 630/1000 loss 0.1285 (ema 0.1403) w 0.1314 mse 0.1354 t̄ 739 new 0.58 lr 1.00e-05 gnorm 0.048 37.70s mem 53.6GB +step 640/1000 loss 0.1236 (ema 0.1373) w 0.1352 mse 0.1333 t̄ 771 new 0.59 lr 1.00e-05 gnorm 0.046 37.67s mem 53.6GB +step 650/1000 loss 0.1589 (ema 0.1444) w 0.1574 mse 0.1598 t̄ 693 new 0.60 lr 1.00e-05 gnorm 0.040 37.68s mem 53.6GB +step 660/1000 loss 0.1200 (ema 0.1353) w 0.0988 mse 0.1002 t̄ 812 new 0.34 lr 1.00e-05 gnorm 0.043 37.68s mem 53.6GB +step 670/1000 loss 0.1340 (ema 0.1351) w 0.1467 mse 0.1432 t̄ 700 new 0.40 lr 1.00e-05 gnorm 0.048 37.68s mem 53.6GB +step 680/1000 loss 0.1529 (ema 0.1389) w 0.1259 mse 0.1232 t̄ 718 new 0.60 lr 1.00e-05 gnorm 0.070 37.69s mem 53.6GB +step 690/1000 loss 0.1314 (ema 0.1398) w 0.0914 mse 0.0992 t̄ 748 new 0.29 lr 1.00e-05 gnorm 0.052 37.70s mem 53.6GB +step 700/1000 loss 0.1560 (ema 0.1350) w 0.1282 mse 0.1287 t̄ 752 new 0.66 lr 1.00e-05 gnorm 0.052 37.68s mem 53.6GB +step 710/1000 loss 0.1118 (ema 0.1372) w 0.1140 mse 0.1165 t̄ 779 new 0.59 lr 1.00e-05 gnorm 0.043 37.72s mem 53.6GB +step 720/1000 loss 0.1631 (ema 0.1385) w 0.1033 mse 0.1041 t̄ 795 new 0.59 lr 1.00e-05 gnorm 0.048 37.70s mem 53.6GB +step 730/1000 loss 0.1091 (ema 0.1356) w 0.0646 mse 0.0703 t̄ 752 new 0.22 lr 1.00e-05 gnorm 0.049 37.69s mem 53.6GB +step 740/1000 loss 0.1631 (ema 0.1351) w 0.1429 mse 0.1414 t̄ 729 new 0.42 lr 1.00e-05 gnorm 0.047 37.68s mem 53.6GB +step 750/1000 loss 0.1246 (ema 0.1383) w 0.2017 mse 0.1925 t̄ 753 new 0.45 lr 1.00e-05 gnorm 0.057 37.70s mem 53.6GB +[val] step 750 t=201: w=0.3803 mse=0.3865 (n=16) t=501: w=0.1494 mse=0.1493 (n=16) t=800: w=0.0799 mse=0.0789 (n=16) | mean w=0.2032 5s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step750.safetensors 827 个张量 10.00 GB +[save] accelerator.save_state → /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state_A(/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state → state_A) +step 760/1000 loss 0.1322 (ema 0.1389) w 0.1912 mse 0.1921 t̄ 729 new 0.60 lr 1.00e-05 gnorm 0.057 37.68s mem 53.6GB +step 770/1000 loss 0.1501 (ema 0.1408) w 0.1638 mse 0.1645 t̄ 755 new 0.47 lr 1.00e-05 gnorm 0.064 37.69s mem 53.6GB +step 780/1000 loss 0.1275 (ema 0.1396) w 0.1288 mse 0.1302 t̄ 743 new 0.58 lr 1.00e-05 gnorm 0.040 37.70s mem 53.6GB +step 790/1000 loss 0.1684 (ema 0.1425) w 0.1353 mse 0.1362 t̄ 766 new 0.63 lr 1.00e-05 gnorm 0.057 37.70s mem 53.6GB +step 800/1000 loss 0.1664 (ema 0.1425) w 0.1972 mse 0.1971 t̄ 768 new 0.58 lr 1.00e-05 gnorm 0.048 37.71s mem 53.6GB +step 810/1000 loss 0.1450 (ema 0.1413) w 0.1151 mse 0.1134 t̄ 815 new 0.59 lr 1.00e-05 gnorm 0.059 37.71s mem 53.6GB +step 820/1000 loss 0.1252 (ema 0.1395) w 0.0932 mse 0.0969 t̄ 749 new 0.26 lr 1.00e-05 gnorm 0.084 37.68s mem 53.6GB +step 830/1000 loss 0.1293 (ema 0.1399) w 0.1356 mse 0.1372 t̄ 701 new 0.60 lr 1.00e-05 gnorm 0.051 37.70s mem 53.6GB +step 840/1000 loss 0.1339 (ema 0.1392) w 0.1839 mse 0.1853 t̄ 814 new 0.54 lr 1.00e-05 gnorm 0.045 37.72s mem 53.6GB +step 850/1000 loss 0.1346 (ema 0.1362) w 0.1191 mse 0.1222 t̄ 782 new 0.41 lr 1.00e-05 gnorm 0.066 37.71s mem 53.6GB +step 860/1000 loss 0.1276 (ema 0.1403) w 0.0971 mse 0.0933 t̄ 786 new 0.55 lr 1.00e-05 gnorm 0.073 37.69s mem 53.6GB +step 870/1000 loss 0.1372 (ema 0.1407) w 0.1131 mse 0.1173 t̄ 747 new 0.42 lr 1.00e-05 gnorm 0.049 37.68s mem 53.6GB +step 880/1000 loss 0.1618 (ema 0.1456) w 0.1231 mse 0.1215 t̄ 763 new 0.57 lr 1.00e-05 gnorm 0.074 37.94s mem 53.6GB +step 890/1000 loss 0.1304 (ema 0.1435) w 0.1230 mse 0.1235 t̄ 770 new 0.50 lr 1.00e-05 gnorm 0.068 37.70s mem 53.6GB +step 900/1000 loss 0.1321 (ema 0.1376) w 0.1855 mse 0.1851 t̄ 765 new 0.52 lr 1.00e-05 gnorm 0.060 37.69s mem 53.6GB +step 910/1000 loss 0.1374 (ema 0.1398) w 0.1143 mse 0.1132 t̄ 787 new 0.57 lr 1.00e-05 gnorm 0.045 37.94s mem 53.6GB +step 920/1000 loss 0.1284 (ema 0.1375) w 0.1215 mse 0.1232 t̄ 749 new 0.60 lr 1.00e-05 gnorm 0.081 37.68s mem 53.6GB +step 930/1000 loss 0.1451 (ema 0.1436) w 0.1707 mse 0.1709 t̄ 792 new 0.48 lr 1.00e-05 gnorm 0.043 37.70s mem 53.6GB +step 940/1000 loss 0.1493 (ema 0.1426) w 0.1036 mse 0.1010 t̄ 741 new 0.58 lr 1.00e-05 gnorm 0.030 18.86s mem 53.6GB +step 950/1000 loss 0.1710 (ema 0.1502) w 0.1831 mse 0.1789 t̄ 760 new 0.61 lr 1.00e-05 gnorm 0.072 37.68s mem 53.6GB +step 960/1000 loss 0.1205 (ema 0.1414) w 0.0702 mse 0.0720 t̄ 769 new 0.53 lr 1.00e-05 gnorm 0.066 37.68s mem 53.6GB +step 970/1000 loss 0.1539 (ema 0.1417) w 0.1219 mse 0.1209 t̄ 749 new 0.56 lr 1.00e-05 gnorm 0.052 37.67s mem 53.6GB +step 980/1000 loss 0.1194 (ema 0.1371) w 0.1063 mse 0.1062 t̄ 750 new 0.63 lr 1.00e-05 gnorm 0.055 37.69s mem 53.6GB +step 990/1000 loss 0.1345 (ema 0.1408) w 0.1532 mse 0.1543 t̄ 709 new 0.68 lr 1.00e-05 gnorm 0.038 37.66s mem 53.6GB +step 1000/1000 loss 0.1311 (ema 0.1414) w 0.1403 mse 0.1376 t̄ 760 new 0.65 lr 1.00e-05 gnorm 0.065 37.72s mem 53.6GB +[val] step 1000 t=201: w=0.3798 mse=0.3860 (n=16) t=501: w=0.1490 mse=0.1489 (n=16) t=800: w=0.0796 mse=0.0786 (n=16) | mean w=0.2028 5s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors 827 个张量 10.00 GB +[save] accelerator.save_state → /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state_B(/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/state → state_B) +[done] step 1000,各进程峰值显存 53.9 GB。下一步:把 dits/dit_step1000.safetensors 同时作为 stage2 的 --teacher_ckpt 与 --student_ckpt diff --git a/backup_2026-09-14/runs/distill__stage1_long_K3/train.log b/backup_2026-09-14/runs/distill__stage1_long_K3/train.log new file mode 100644 index 0000000000000000000000000000000000000000..dd390aab1afc004279b08b43622740168e3a53d3 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage1_long_K3/train.log @@ -0,0 +1,118 @@ +[2026-09-09 13:00:03] === stage1_ar_tf | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3 world=8 dist=DistributedType.DEEPSPEED mp=bf16 === +[2026-09-09 13:00:03] [recipe] 长视野续训:训练集 = /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3(AropeLongDatasetTF),val = /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx(21 cell) +[2026-09-09 13:00:03] [recipe] tf=True tf_aug=0 windowed=0/0 new_weight=2.0 lr=1e-05 betas=(0.9, 0.999) wd=0.01 warmup=100 clip=10.0 bs=1×accum2×8卡 ⇒ 等效 batch 16 max_steps=1000 gc=True +[2026-09-09 13:00:07] [data] train 3000 clip,val 16 clip +[2026-09-09 13:00:12] [model] 双向 SFT ← /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_ar/dits/dit_step10000.safetensors(827 个张量,缺 []) +[2026-09-09 13:00:12] [model] AropeDiT causal=True mask_channel=True 4,999,803,072 参数,加载 5s +[2026-09-09 13:00:19] [env] grad_clip=10.0(DeepSpeed 生效值 10.0) +[2026-09-09 13:00:19] [resume] auto ⇒ 没有存档,从头开始 +[2026-09-09 13:00:19] [train] 从 step 0 到 1000 +[2026-09-09 13:06:46] step 10/1000 loss 0.1584 (ema 0.1459) w 0.2250 mse 0.2270 t̄ 744 new 0.51 lr 1.00e-06 gnorm 0.056 37.73s mem 53.3GB +[2026-09-09 13:13:03] step 20/1000 loss 0.1259 (ema 0.1421) w 0.1564 mse 0.1623 t̄ 708 new 0.53 lr 2.00e-06 gnorm 0.053 37.70s mem 53.3GB +[2026-09-09 13:19:21] step 30/1000 loss 0.1583 (ema 0.1434) w 0.2041 mse 0.2040 t̄ 745 new 0.62 lr 3.00e-06 gnorm 0.049 37.68s mem 53.3GB +[2026-09-09 13:25:38] step 40/1000 loss 0.1590 (ema 0.1451) w 0.1237 mse 0.1240 t̄ 756 new 0.62 lr 4.00e-06 gnorm 0.047 37.70s mem 53.3GB +[2026-09-09 13:31:55] step 50/1000 loss 0.1611 (ema 0.1430) w 0.2348 mse 0.2304 t̄ 719 new 0.51 lr 5.00e-06 gnorm 0.032 37.69s mem 53.3GB +[2026-09-09 13:38:13] step 60/1000 loss 0.1530 (ema 0.1509) w 0.1603 mse 0.1593 t̄ 711 new 0.56 lr 6.00e-06 gnorm 0.033 37.70s mem 53.3GB +[2026-09-09 13:44:30] step 70/1000 loss 0.1396 (ema 0.1402) w 0.1677 mse 0.1627 t̄ 766 new 0.58 lr 7.00e-06 gnorm 0.042 37.69s mem 53.3GB +[2026-09-09 13:50:47] step 80/1000 loss 0.1545 (ema 0.1450) w 0.1101 mse 0.1109 t̄ 778 new 0.19 lr 8.00e-06 gnorm 0.040 37.68s mem 53.3GB +[2026-09-09 13:57:05] step 90/1000 loss 0.1551 (ema 0.1376) w 0.1475 mse 0.1476 t̄ 757 new 0.47 lr 9.00e-06 gnorm 0.035 37.72s mem 53.3GB +[2026-09-09 14:03:22] step 100/1000 loss 0.1349 (ema 0.1394) w 0.1593 mse 0.1577 t̄ 704 new 0.62 lr 1.00e-05 gnorm 0.054 37.70s mem 53.3GB +[2026-09-09 14:09:39] step 110/1000 loss 0.1274 (ema 0.1429) w 0.1170 mse 0.1177 t̄ 758 new 0.57 lr 1.00e-05 gnorm 0.039 37.70s mem 53.3GB +[2026-09-09 14:15:57] step 120/1000 loss 0.1236 (ema 0.1417) w 0.1027 mse 0.1054 t̄ 782 new 0.67 lr 1.00e-05 gnorm 0.053 37.70s mem 53.3GB +[2026-09-09 14:22:14] step 130/1000 loss 0.1391 (ema 0.1349) w 0.0885 mse 0.0908 t̄ 801 new 0.35 lr 1.00e-05 gnorm 0.043 37.72s mem 53.3GB +[2026-09-09 14:28:32] step 140/1000 loss 0.1430 (ema 0.1422) w 0.1698 mse 0.1706 t̄ 690 new 0.26 lr 1.00e-05 gnorm 0.080 37.70s mem 53.3GB +[2026-09-09 14:34:49] step 150/1000 loss 0.1215 (ema 0.1410) w 0.0973 mse 0.0970 t̄ 759 new 0.55 lr 1.00e-05 gnorm 0.042 37.71s mem 53.3GB +[2026-09-09 14:41:06] step 160/1000 loss 0.1289 (ema 0.1421) w 0.1276 mse 0.1315 t̄ 774 new 0.35 lr 1.00e-05 gnorm 0.042 37.71s mem 53.3GB +[2026-09-09 14:47:24] step 170/1000 loss 0.1345 (ema 0.1438) w 0.1062 mse 0.1071 t̄ 804 new 0.23 lr 1.00e-05 gnorm 0.051 37.73s mem 53.3GB +[2026-09-09 14:53:41] step 180/1000 loss 0.1262 (ema 0.1424) w 0.1364 mse 0.1350 t̄ 759 new 0.42 lr 1.00e-05 gnorm 0.047 37.71s mem 53.3GB +[2026-09-09 14:59:41] step 190/1000 loss 0.1548 (ema 0.1420) w 0.1354 mse 0.1354 t̄ 748 new 0.41 lr 1.00e-05 gnorm 0.036 37.69s mem 53.3GB +[2026-09-09 15:05:59] step 200/1000 loss 0.1409 (ema 0.1381) w 0.1973 mse 0.1981 t̄ 732 new 0.57 lr 1.00e-05 gnorm 0.037 37.70s mem 53.3GB +[2026-09-09 15:12:16] step 210/1000 loss 0.1627 (ema 0.1421) w 0.2369 mse 0.2435 t̄ 786 new 0.52 lr 1.00e-05 gnorm 0.042 37.72s mem 53.3GB +[2026-09-09 15:18:34] step 220/1000 loss 0.1495 (ema 0.1411) w 0.2075 mse 0.2097 t̄ 768 new 0.40 lr 1.00e-05 gnorm 0.052 37.69s mem 53.3GB +[2026-09-09 15:24:51] step 230/1000 loss 0.1249 (ema 0.1367) w 0.1315 mse 0.1301 t̄ 780 new 0.40 lr 1.00e-05 gnorm 0.049 37.68s mem 53.3GB +[2026-09-09 15:31:09] step 240/1000 loss 0.1622 (ema 0.1394) w 0.0740 mse 0.0802 t̄ 769 new 0.33 lr 1.00e-05 gnorm 0.059 37.70s mem 53.3GB +[2026-09-09 15:37:26] step 250/1000 loss 0.1599 (ema 0.1413) w 0.1366 mse 0.1350 t̄ 730 new 0.44 lr 1.00e-05 gnorm 0.056 37.70s mem 53.3GB +[2026-09-09 15:37:32] [val] step 250 t=201: w=0.3815 mse=0.3878 (n=16) t=501: w=0.1501 mse=0.1501 (n=16) t=800: w=0.0807 mse=0.0797 (n=16) | mean w=0.2041 6s +[2026-09-09 15:37:44] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step250.safetensors 827 个张量 10.00 GB +[2026-09-09 15:44:27] step 260/1000 loss 0.1400 (ema 0.1404) w 0.1481 mse 0.1480 t̄ 758 new 0.46 lr 1.00e-05 gnorm 0.042 37.70s mem 53.6GB +[2026-09-09 15:50:45] step 270/1000 loss 0.1495 (ema 0.1398) w 0.1967 mse 0.1958 t̄ 784 new 0.62 lr 1.00e-05 gnorm 0.059 37.69s mem 53.6GB +[2026-09-09 15:57:02] step 280/1000 loss 0.1320 (ema 0.1371) w 0.1010 mse 0.1060 t̄ 782 new 0.29 lr 1.00e-05 gnorm 0.071 37.69s mem 53.6GB +[2026-09-09 16:03:19] step 290/1000 loss 0.1273 (ema 0.1346) w 0.1247 mse 0.1264 t̄ 789 new 0.41 lr 1.00e-05 gnorm 0.060 37.67s mem 53.6GB +[2026-09-09 16:09:37] step 300/1000 loss 0.1305 (ema 0.1391) w 0.1293 mse 0.1274 t̄ 716 new 0.52 lr 1.00e-05 gnorm 0.048 37.70s mem 53.6GB +[2026-09-09 16:15:54] step 310/1000 loss 0.1556 (ema 0.1445) w 0.1780 mse 0.1802 t̄ 747 new 0.56 lr 1.00e-05 gnorm 0.047 37.69s mem 53.6GB +[2026-09-09 16:22:11] step 320/1000 loss 0.1401 (ema 0.1394) w 0.1748 mse 0.1747 t̄ 791 new 0.57 lr 1.00e-05 gnorm 0.047 37.68s mem 53.6GB +[2026-09-09 16:28:29] step 330/1000 loss 0.1487 (ema 0.1424) w 0.1552 mse 0.1550 t̄ 764 new 0.66 lr 1.00e-05 gnorm 0.044 37.69s mem 53.6GB +[2026-09-09 16:34:46] step 340/1000 loss 0.1231 (ema 0.1436) w 0.1677 mse 0.1633 t̄ 727 new 0.58 lr 1.00e-05 gnorm 0.039 37.69s mem 53.6GB +[2026-09-09 16:41:04] step 350/1000 loss 0.1258 (ema 0.1369) w 0.1091 mse 0.1179 t̄ 734 new 0.47 lr 1.00e-05 gnorm 0.090 37.67s mem 53.6GB +[2026-09-09 16:47:21] step 360/1000 loss 0.1434 (ema 0.1476) w 0.1172 mse 0.1226 t̄ 807 new 0.45 lr 1.00e-05 gnorm 0.068 37.88s mem 53.6GB +[2026-09-09 16:53:39] step 370/1000 loss 0.1315 (ema 0.1370) w 0.1102 mse 0.1117 t̄ 797 new 0.19 lr 1.00e-05 gnorm 0.049 37.69s mem 53.6GB +[2026-09-09 16:59:39] step 380/1000 loss 0.1224 (ema 0.1356) w 0.1210 mse 0.1200 t̄ 760 new 0.62 lr 1.00e-05 gnorm 0.058 37.69s mem 53.6GB +[2026-09-09 17:05:56] step 390/1000 loss 0.1310 (ema 0.1412) w 0.0963 mse 0.0973 t̄ 734 new 0.53 lr 1.00e-05 gnorm 0.050 37.74s mem 53.6GB +[2026-09-09 17:12:14] step 400/1000 loss 0.1325 (ema 0.1406) w 0.1067 mse 0.1065 t̄ 746 new 0.50 lr 1.00e-05 gnorm 0.054 37.69s mem 53.6GB +[2026-09-09 17:18:31] step 410/1000 loss 0.1515 (ema 0.1435) w 0.2114 mse 0.2109 t̄ 738 new 0.60 lr 1.00e-05 gnorm 0.053 37.70s mem 53.6GB +[2026-09-09 17:24:49] step 420/1000 loss 0.1738 (ema 0.1433) w 0.1898 mse 0.1898 t̄ 681 new 0.51 lr 1.00e-05 gnorm 0.056 37.68s mem 53.6GB +[2026-09-09 17:31:06] step 430/1000 loss 0.1390 (ema 0.1449) w 0.0803 mse 0.0852 t̄ 787 new 0.38 lr 1.00e-05 gnorm 0.039 37.70s mem 53.6GB +[2026-09-09 17:37:23] step 440/1000 loss 0.1376 (ema 0.1387) w 0.1622 mse 0.1612 t̄ 753 new 0.31 lr 1.00e-05 gnorm 0.044 37.69s mem 53.6GB +[2026-09-09 17:43:41] step 450/1000 loss 0.1405 (ema 0.1394) w 0.0756 mse 0.0751 t̄ 768 new 0.53 lr 1.00e-05 gnorm 0.042 37.70s mem 53.6GB +[2026-09-09 17:49:58] step 460/1000 loss 0.1421 (ema 0.1359) w 0.1817 mse 0.1830 t̄ 760 new 0.62 lr 1.00e-05 gnorm 0.046 37.69s mem 53.6GB +[2026-09-09 17:56:15] step 470/1000 loss 0.1330 (ema 0.1332) w 0.1399 mse 0.1412 t̄ 724 new 0.61 lr 1.00e-05 gnorm 0.048 37.68s mem 53.6GB +[2026-09-09 18:07:16] step 480/1000 loss 0.1483 (ema 0.1359) w 0.1142 mse 0.1160 t̄ 737 new 0.52 lr 1.00e-05 gnorm 0.070 77.08s mem 53.6GB +[2026-09-09 18:18:24] step 490/1000 loss 0.1607 (ema 0.1374) w 0.0862 mse 0.0852 t̄ 810 new 0.62 lr 1.00e-05 gnorm 0.068 55.93s mem 53.6GB +[2026-09-09 18:29:32] step 500/1000 loss 0.1415 (ema 0.1405) w 0.1902 mse 0.1910 t̄ 668 new 0.36 lr 1.00e-05 gnorm 0.046 53.26s mem 53.6GB +[2026-09-09 18:29:37] [val] step 500 t=201: w=0.3810 mse=0.3873 (n=16) t=501: w=0.1498 mse=0.1497 (n=16) t=800: w=0.0803 mse=0.0793 (n=16) | mean w=0.2037 5s +[2026-09-09 18:29:48] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step500.safetensors 827 个张量 10.00 GB +[2026-09-09 18:37:37] step 510/1000 loss 0.1157 (ema 0.1400) w 0.1196 mse 0.1206 t̄ 756 new 0.66 lr 1.00e-05 gnorm 0.061 75.36s mem 53.6GB +[2026-09-09 18:47:46] step 520/1000 loss 0.1716 (ema 0.1375) w 0.1921 mse 0.1903 t̄ 732 new 0.53 lr 1.00e-05 gnorm 0.047 44.92s mem 53.6GB +[2026-09-09 18:55:33] step 530/1000 loss 0.1431 (ema 0.1369) w 0.1857 mse 0.1772 t̄ 689 new 0.42 lr 1.00e-05 gnorm 0.042 37.65s mem 53.6GB +[2026-09-09 19:01:50] step 540/1000 loss 0.1486 (ema 0.1372) w 0.1922 mse 0.1879 t̄ 704 new 0.64 lr 1.00e-05 gnorm 0.067 37.69s mem 53.6GB +[2026-09-09 19:08:07] step 550/1000 loss 0.1454 (ema 0.1396) w 0.1470 mse 0.1501 t̄ 721 new 0.34 lr 1.00e-05 gnorm 0.049 37.70s mem 53.6GB +[2026-09-09 19:14:25] step 560/1000 loss 0.1429 (ema 0.1376) w 0.1168 mse 0.1172 t̄ 706 new 0.63 lr 1.00e-05 gnorm 0.055 37.69s mem 53.6GB +[2026-09-09 19:20:24] step 570/1000 loss 0.1519 (ema 0.1420) w 0.1679 mse 0.1651 t̄ 744 new 0.41 lr 1.00e-05 gnorm 0.060 37.69s mem 53.6GB +[2026-09-09 19:26:41] step 580/1000 loss 0.1651 (ema 0.1446) w 0.2491 mse 0.2458 t̄ 711 new 0.30 lr 1.00e-05 gnorm 0.050 37.68s mem 53.6GB +[2026-09-09 19:32:59] step 590/1000 loss 0.1540 (ema 0.1390) w 0.1342 mse 0.1318 t̄ 796 new 0.57 lr 1.00e-05 gnorm 0.050 37.68s mem 53.6GB +[2026-09-09 19:39:16] step 600/1000 loss 0.1644 (ema 0.1439) w 0.1304 mse 0.1253 t̄ 760 new 0.35 lr 1.00e-05 gnorm 0.051 37.69s mem 53.6GB +[2026-09-09 19:45:33] step 610/1000 loss 0.1306 (ema 0.1423) w 0.1398 mse 0.1418 t̄ 732 new 0.58 lr 1.00e-05 gnorm 0.057 37.69s mem 53.6GB +[2026-09-09 19:51:51] step 620/1000 loss 0.1194 (ema 0.1398) w 0.1323 mse 0.1347 t̄ 765 new 0.52 lr 1.00e-05 gnorm 0.054 37.68s mem 53.6GB +[2026-09-09 19:58:08] step 630/1000 loss 0.1285 (ema 0.1403) w 0.1314 mse 0.1354 t̄ 739 new 0.58 lr 1.00e-05 gnorm 0.048 37.70s mem 53.6GB +[2026-09-09 20:04:25] step 640/1000 loss 0.1236 (ema 0.1373) w 0.1352 mse 0.1333 t̄ 771 new 0.59 lr 1.00e-05 gnorm 0.046 37.67s mem 53.6GB +[2026-09-09 20:10:43] step 650/1000 loss 0.1589 (ema 0.1444) w 0.1574 mse 0.1598 t̄ 693 new 0.60 lr 1.00e-05 gnorm 0.040 37.68s mem 53.6GB +[2026-09-09 20:17:00] step 660/1000 loss 0.1200 (ema 0.1353) w 0.0988 mse 0.1002 t̄ 812 new 0.34 lr 1.00e-05 gnorm 0.043 37.68s mem 53.6GB +[2026-09-09 20:23:17] step 670/1000 loss 0.1340 (ema 0.1351) w 0.1467 mse 0.1432 t̄ 700 new 0.40 lr 1.00e-05 gnorm 0.048 37.68s mem 53.6GB +[2026-09-09 20:29:35] step 680/1000 loss 0.1529 (ema 0.1389) w 0.1259 mse 0.1232 t̄ 718 new 0.60 lr 1.00e-05 gnorm 0.070 37.69s mem 53.6GB +[2026-09-09 20:35:52] step 690/1000 loss 0.1314 (ema 0.1398) w 0.0914 mse 0.0992 t̄ 748 new 0.29 lr 1.00e-05 gnorm 0.052 37.70s mem 53.6GB +[2026-09-09 20:42:10] step 700/1000 loss 0.1560 (ema 0.1350) w 0.1282 mse 0.1287 t̄ 752 new 0.66 lr 1.00e-05 gnorm 0.052 37.68s mem 53.6GB +[2026-09-09 20:48:27] step 710/1000 loss 0.1118 (ema 0.1372) w 0.1140 mse 0.1165 t̄ 779 new 0.59 lr 1.00e-05 gnorm 0.043 37.72s mem 53.6GB +[2026-09-09 20:54:45] step 720/1000 loss 0.1631 (ema 0.1385) w 0.1033 mse 0.1041 t̄ 795 new 0.59 lr 1.00e-05 gnorm 0.048 37.70s mem 53.6GB +[2026-09-09 21:01:02] step 730/1000 loss 0.1091 (ema 0.1356) w 0.0646 mse 0.0703 t̄ 752 new 0.22 lr 1.00e-05 gnorm 0.049 37.69s mem 53.6GB +[2026-09-09 21:07:19] step 740/1000 loss 0.1631 (ema 0.1351) w 0.1429 mse 0.1414 t̄ 729 new 0.42 lr 1.00e-05 gnorm 0.047 37.68s mem 53.6GB +[2026-09-09 21:13:37] step 750/1000 loss 0.1246 (ema 0.1383) w 0.2017 mse 0.1925 t̄ 753 new 0.45 lr 1.00e-05 gnorm 0.057 37.70s mem 53.6GB +[2026-09-09 21:13:41] [val] step 750 t=201: w=0.3803 mse=0.3865 (n=16) t=501: w=0.1494 mse=0.1493 (n=16) t=800: w=0.0799 mse=0.0789 (n=16) | mean w=0.2032 5s +[2026-09-09 21:13:53] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step750.safetensors 827 个张量 10.00 GB +[2026-09-09 21:20:23] step 760/1000 loss 0.1322 (ema 0.1389) w 0.1912 mse 0.1921 t̄ 729 new 0.60 lr 1.00e-05 gnorm 0.057 37.68s mem 53.6GB +[2026-09-09 21:26:41] step 770/1000 loss 0.1501 (ema 0.1408) w 0.1638 mse 0.1645 t̄ 755 new 0.47 lr 1.00e-05 gnorm 0.064 37.69s mem 53.6GB +[2026-09-09 21:32:58] step 780/1000 loss 0.1275 (ema 0.1396) w 0.1288 mse 0.1302 t̄ 743 new 0.58 lr 1.00e-05 gnorm 0.040 37.70s mem 53.6GB +[2026-09-09 21:39:15] step 790/1000 loss 0.1684 (ema 0.1425) w 0.1353 mse 0.1362 t̄ 766 new 0.63 lr 1.00e-05 gnorm 0.057 37.70s mem 53.6GB +[2026-09-09 21:45:33] step 800/1000 loss 0.1664 (ema 0.1425) w 0.1972 mse 0.1971 t̄ 768 new 0.58 lr 1.00e-05 gnorm 0.048 37.71s mem 53.6GB +[2026-09-09 21:51:50] step 810/1000 loss 0.1450 (ema 0.1413) w 0.1151 mse 0.1134 t̄ 815 new 0.59 lr 1.00e-05 gnorm 0.059 37.71s mem 53.6GB +[2026-09-09 21:58:08] step 820/1000 loss 0.1252 (ema 0.1395) w 0.0932 mse 0.0969 t̄ 749 new 0.26 lr 1.00e-05 gnorm 0.084 37.68s mem 53.6GB +[2026-09-09 22:04:25] step 830/1000 loss 0.1293 (ema 0.1399) w 0.1356 mse 0.1372 t̄ 701 new 0.60 lr 1.00e-05 gnorm 0.051 37.70s mem 53.6GB +[2026-09-09 22:10:43] step 840/1000 loss 0.1339 (ema 0.1392) w 0.1839 mse 0.1853 t̄ 814 new 0.54 lr 1.00e-05 gnorm 0.045 37.72s mem 53.6GB +[2026-09-09 22:17:00] step 850/1000 loss 0.1346 (ema 0.1362) w 0.1191 mse 0.1222 t̄ 782 new 0.41 lr 1.00e-05 gnorm 0.066 37.71s mem 53.6GB +[2026-09-09 22:23:17] step 860/1000 loss 0.1276 (ema 0.1403) w 0.0971 mse 0.0933 t̄ 786 new 0.55 lr 1.00e-05 gnorm 0.073 37.69s mem 53.6GB +[2026-09-09 22:29:35] step 870/1000 loss 0.1372 (ema 0.1407) w 0.1131 mse 0.1173 t̄ 747 new 0.42 lr 1.00e-05 gnorm 0.049 37.68s mem 53.6GB +[2026-09-09 22:35:52] step 880/1000 loss 0.1618 (ema 0.1456) w 0.1231 mse 0.1215 t̄ 763 new 0.57 lr 1.00e-05 gnorm 0.074 37.94s mem 53.6GB +[2026-09-09 22:42:09] step 890/1000 loss 0.1304 (ema 0.1435) w 0.1230 mse 0.1235 t̄ 770 new 0.50 lr 1.00e-05 gnorm 0.068 37.70s mem 53.6GB +[2026-09-09 22:48:27] step 900/1000 loss 0.1321 (ema 0.1376) w 0.1855 mse 0.1851 t̄ 765 new 0.52 lr 1.00e-05 gnorm 0.060 37.69s mem 53.6GB +[2026-09-09 22:54:44] step 910/1000 loss 0.1374 (ema 0.1398) w 0.1143 mse 0.1132 t̄ 787 new 0.57 lr 1.00e-05 gnorm 0.045 37.94s mem 53.6GB +[2026-09-09 23:01:02] step 920/1000 loss 0.1284 (ema 0.1375) w 0.1215 mse 0.1232 t̄ 749 new 0.60 lr 1.00e-05 gnorm 0.081 37.68s mem 53.6GB +[2026-09-09 23:07:19] step 930/1000 loss 0.1451 (ema 0.1436) w 0.1707 mse 0.1709 t̄ 792 new 0.48 lr 1.00e-05 gnorm 0.043 37.70s mem 53.6GB +[2026-09-09 23:13:17] step 940/1000 loss 0.1493 (ema 0.1426) w 0.1036 mse 0.1010 t̄ 741 new 0.58 lr 1.00e-05 gnorm 0.030 18.86s mem 53.6GB +[2026-09-09 23:19:36] step 950/1000 loss 0.1710 (ema 0.1502) w 0.1831 mse 0.1789 t̄ 760 new 0.61 lr 1.00e-05 gnorm 0.072 37.68s mem 53.6GB +[2026-09-09 23:25:53] step 960/1000 loss 0.1205 (ema 0.1414) w 0.0702 mse 0.0720 t̄ 769 new 0.53 lr 1.00e-05 gnorm 0.066 37.68s mem 53.6GB +[2026-09-09 23:32:10] step 970/1000 loss 0.1539 (ema 0.1417) w 0.1219 mse 0.1209 t̄ 749 new 0.56 lr 1.00e-05 gnorm 0.052 37.67s mem 53.6GB +[2026-09-09 23:38:28] step 980/1000 loss 0.1194 (ema 0.1371) w 0.1063 mse 0.1062 t̄ 750 new 0.63 lr 1.00e-05 gnorm 0.055 37.69s mem 53.6GB +[2026-09-09 23:44:45] step 990/1000 loss 0.1345 (ema 0.1408) w 0.1532 mse 0.1543 t̄ 709 new 0.68 lr 1.00e-05 gnorm 0.038 37.66s mem 53.6GB +[2026-09-09 23:51:03] step 1000/1000 loss 0.1311 (ema 0.1414) w 0.1403 mse 0.1376 t̄ 760 new 0.65 lr 1.00e-05 gnorm 0.065 37.72s mem 53.6GB +[2026-09-09 23:51:08] [val] step 1000 t=201: w=0.3798 mse=0.3860 (n=16) t=501: w=0.1490 mse=0.1489 (n=16) t=800: w=0.0796 mse=0.0786 (n=16) | mean w=0.2028 5s +[2026-09-09 23:51:19] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors 827 个张量 10.00 GB +[2026-09-09 23:51:50] [done] step 1000,各进程峰值显存 53.9 GB。下一步:把 dits/dit_step1000.safetensors 同时作为 stage2 的 --teacher_ckpt 与 --student_ckpt diff --git a/backup_2026-09-14/runs/distill__stage1_long_K3/train_log.csv b/backup_2026-09-14/runs/distill__stage1_long_K3/train_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..9df1248633889bf648172727d7edaa92943077b6 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage1_long_K3/train_log.csv @@ -0,0 +1,101 @@ +step,loss,loss_w,mse,new_frac,t_mean,lr,grad_norm,step_time,mem_gb,epoch +10,0.1583614945411682,0.2249932885169983,0.22700496017932892,0.5057265162467957,743.8316040039062,1.0000000000000002e-06,0.05616622045636177,37.73296070098877,53.30815362930298,0 +20,0.12587635219097137,0.15638230741024017,0.16230493783950806,0.5252777934074402,707.9498291015625,2.0000000000000003e-06,0.052793506532907486,37.698028326034546,53.30815362930298,0 +30,0.15825293958187103,0.20405301451683044,0.20398932695388794,0.6163781881332397,745.4285278320312,3e-06,0.04861089959740639,37.675482511520386,53.31791925430298,0 +40,0.1590442657470703,0.12374106794595718,0.1239837259054184,0.6165598034858704,756.0269775390625,4.000000000000001e-06,0.047001589089632034,37.69775652885437,53.31791925430298,0 +50,0.16110752522945404,0.23483909666538239,0.23040737211704254,0.5096901655197144,718.5108642578125,5e-06,0.032209012657403946,37.68843483924866,53.31791925430298,0 +60,0.15300039947032928,0.1603212058544159,0.15930107235908508,0.5610363483428955,710.7864990234375,6e-06,0.03304430469870567,37.698206424713135,53.31791925430298,0 +70,0.13963583111763,0.16770736873149872,0.16274063289165497,0.5785149335861206,765.9114990234375,7e-06,0.042441606521606445,37.68532943725586,53.31791925430298,0 +80,0.15445047616958618,0.11007685959339142,0.11091657727956772,0.18803419172763824,777.6867065429688,8.000000000000001e-06,0.039707012474536896,37.68367004394531,53.31791925430298,0 +90,0.15513278543949127,0.14750945568084717,0.14761944115161896,0.4696153700351715,756.6023559570312,9e-06,0.03483732417225838,37.72062826156616,53.31791925430298,0 +100,0.13493648171424866,0.1593243032693863,0.15773557126522064,0.6191025376319885,703.9724731445312,1e-05,0.05386737361550331,37.70365571975708,53.31791925430298,0 +110,0.12736749649047852,0.11697904765605927,0.11773841083049774,0.5709828734397888,758.4075317382812,1e-05,0.03916962817311287,37.696189403533936,53.31791925430298,0 +120,0.12357127666473389,0.10266093164682388,0.10544555634260178,0.6650854349136353,781.7003173828125,1e-05,0.052862897515296936,37.70389437675476,53.31791925430298,0 +130,0.1391105204820633,0.0885145366191864,0.09083279222249985,0.34976494312286377,801.0758056640625,1e-05,0.043420352041721344,37.724388122558594,53.31791925430298,0 +140,0.14295734465122223,0.16981716454029083,0.1706412434577942,0.2648397386074066,690.0591430664062,1e-05,0.0801834911108017,37.6994514465332,53.31791925430298,0 +150,0.12150605022907257,0.09728700667619705,0.0969669371843338,0.5496260523796082,759.0708618164062,1e-05,0.04244877025485039,37.70719885826111,53.31791925430298,0 +160,0.12894746661186218,0.1275957226753235,0.1315368413925171,0.3456517159938812,774.4952392578125,1e-05,0.042318668216466904,37.7077853679657,53.31791925430298,0 +170,0.1345142275094986,0.10616852343082428,0.10705418884754181,0.23077991604804993,804.4078369140625,1e-05,0.05068165063858032,37.72691988945007,53.31791925430298,0 +180,0.12615492939949036,0.1363668292760849,0.1349932998418808,0.4161858856678009,759.4569702148438,1e-05,0.04723222181200981,37.7061972618103,53.31791925430298,0 +190,0.15481582283973694,0.1353680044412613,0.13536450266838074,0.4094337522983551,748.1643676757812,1e-05,0.03617393597960472,37.69146490097046,53.31791925430298,1 +200,0.14090760052204132,0.1972944736480713,0.19807232916355133,0.5663568377494812,731.9937744140625,1e-05,0.03650210052728653,37.70066785812378,53.31791925430298,1 +210,0.16269947588443756,0.23687487840652466,0.24345985054969788,0.5238995552062988,786.3251953125,1e-05,0.04246130958199501,37.71721339225769,53.31791925430298,1 +220,0.14945626258850098,0.20754125714302063,0.20965370535850525,0.39868590235710144,767.5299072265625,1e-05,0.05235280841588974,37.68889117240906,53.31791925430298,1 +230,0.1249290183186531,0.13145123422145844,0.1300734132528305,0.40262821316719055,779.7090454101562,1e-05,0.04868627339601517,37.68022561073303,53.31791925430298,1 +240,0.16222518682479858,0.07400436699390411,0.0801735445857048,0.3258974254131317,769.3916015625,1e-05,0.05931134149432182,37.70407223701477,53.31791925430298,1 +250,0.15992014110088348,0.13663512468338013,0.13503411412239075,0.4449999928474426,730.0726928710938,1e-05,0.05615527555346489,37.700129985809326,53.31791925430298,1 +260,0.1399713009595871,0.14813725650310516,0.1480182558298111,0.4578418731689453,757.7387084960938,1e-05,0.04215523228049278,37.70291876792908,53.558032512664795,1 +270,0.14947105944156647,0.19667276740074158,0.19578731060028076,0.6163781881332397,784.0849609375,1e-05,0.058858487755060196,37.68845200538635,53.558032512664795,1 +280,0.1319608986377716,0.10096912831068039,0.1059713065624237,0.29411324858665466,781.5582275390625,1e-05,0.07064863294363022,37.69252967834473,53.558032512664795,1 +290,0.12729066610336304,0.1247357428073883,0.12643341720104218,0.41361111402511597,789.4957275390625,1e-05,0.060091398656368256,37.673436880111694,53.558032512664795,1 +300,0.13047823309898376,0.1293272078037262,0.1274172067642212,0.5209615230560303,715.8438110351562,1e-05,0.04846926033496857,37.7011878490448,53.558032512664795,1 +310,0.15562622249126434,0.1780223250389099,0.18015459179878235,0.5567521452903748,747.003662109375,1e-05,0.047128867357969284,37.687872648239136,53.558032512664795,1 +320,0.14006493985652924,0.17479592561721802,0.17466601729393005,0.5686110854148865,790.7432861328125,1e-05,0.04663350060582161,37.67581081390381,53.558032512664795,1 +330,0.14872007071971893,0.15519069135189056,0.15498477220535278,0.6644444465637207,764.0178833007812,1e-05,0.04367080330848694,37.68673062324524,53.558032512664795,1 +340,0.12313466519117355,0.16768860816955566,0.16327819228172302,0.5809187889099121,726.8543701171875,1e-05,0.03942617401480675,37.69166827201843,53.558032512664795,1 +350,0.12579283118247986,0.10913228243589401,0.11786564439535141,0.46875,733.6221313476562,1e-05,0.08975692093372345,37.6699697971344,53.558032512664795,1 +360,0.14335402846336365,0.11715080589056015,0.12259959429502487,0.4523611068725586,806.9153442382812,1e-05,0.0678974837064743,37.87500619888306,53.567798137664795,1 +370,0.13147500157356262,0.11015000194311142,0.11170652508735657,0.18803419172763824,797.266357421875,1e-05,0.04899510368704796,37.686097621917725,53.567798137664795,1 +380,0.1224161759018898,0.12095893174409866,0.11996495723724365,0.6185897588729858,759.8928833007812,1e-05,0.05819598212838173,37.685758113861084,53.567798137664795,2 +390,0.1310349702835083,0.09634587168693542,0.09733590483665466,0.526602566242218,733.5352172851562,1e-05,0.05042249336838722,37.74064302444458,53.567798137664795,2 +400,0.1325083076953888,0.10673534125089645,0.10646133869886398,0.4951495826244354,745.7780151367188,1e-05,0.054438911378383636,37.69475340843201,53.567798137664795,2 +410,0.15149913728237152,0.21139615774154663,0.2108972668647766,0.5980021357536316,737.69970703125,1e-05,0.0528128482401371,37.699907302856445,53.567798137664795,2 +420,0.17384642362594604,0.18978607654571533,0.18980994820594788,0.514433741569519,681.468505859375,1e-05,0.056222088634967804,37.67893719673157,53.567798137664795,2 +430,0.13898175954818726,0.08028118312358856,0.0852079764008522,0.37668803334236145,786.6223754882812,1e-05,0.03866992145776749,37.70082402229309,53.567798137664795,2 +440,0.13762924075126648,0.16217510402202606,0.16118957102298737,0.31398504972457886,752.6624145507812,1e-05,0.043623995035886765,37.6918044090271,53.567798137664795,2 +450,0.14051520824432373,0.0756102204322815,0.07511130720376968,0.5250641107559204,768.1432495117188,1e-05,0.04213845357298851,37.69807004928589,53.567798137664795,2 +460,0.1421384960412979,0.1816793531179428,0.1829817146062851,0.6165705323219299,760.4703369140625,1e-05,0.046380624175071716,37.685041666030884,53.567798137664795,2 +470,0.1329851597547531,0.139876589179039,0.14120899140834808,0.6117521524429321,724.284423828125,1e-05,0.048363443464040756,37.681113481521606,53.567798137664795,2 +480,0.14826883375644684,0.11418729275465012,0.11602962017059326,0.5242948532104492,737.1156005859375,1e-05,0.06965313106775284,77.07542324066162,53.567798137664795,2 +490,0.16065943241119385,0.08623848855495453,0.08523833751678467,0.6168055534362793,810.4320678710938,1e-05,0.06762462854385376,55.9260950088501,53.567798137664795,2 +500,0.14145749807357788,0.19023239612579346,0.1910468488931656,0.3622435927391052,667.5218505859375,1e-05,0.045899584889411926,53.26429605484009,53.567798137664795,2 +510,0.11571231484413147,0.11962682753801346,0.12056799232959747,0.6553311944007874,755.5052490234375,1e-05,0.06131831184029579,75.35721397399902,53.567798137664795,2 +520,0.17161299288272858,0.19206435978412628,0.19034145772457123,0.5253098011016846,732.4088745117188,1e-05,0.04723488166928291,44.91633868217468,53.567798137664795,2 +530,0.14305062592029572,0.18574102222919464,0.17721927165985107,0.418953001499176,689.36279296875,1e-05,0.0418662503361702,37.6490912437439,53.567798137664795,2 +540,0.14857901632785797,0.19215859472751617,0.18785808980464935,0.6368482708930969,703.5884399414062,1e-05,0.06666959077119827,37.68798351287842,53.567798137664795,2 +550,0.14538541436195374,0.14701691269874573,0.1500675231218338,0.33742520213127136,721.1704711914062,1e-05,0.04934736341238022,37.703829526901245,53.567798137664795,2 +560,0.1429290771484375,0.11680241674184799,0.11717966943979263,0.6278846263885498,705.8316040039062,1e-05,0.054931581020355225,37.693909883499146,53.567798137664795,2 +570,0.15187326073646545,0.1678682416677475,0.1650807112455368,0.4147542715072632,744.357666015625,1e-05,0.059747468680143356,37.68618631362915,53.567798137664795,3 +580,0.1651434451341629,0.24912004172801971,0.24579252302646637,0.3002243638038635,710.911376953125,1e-05,0.049732357263565063,37.68005561828613,53.567798137664795,3 +590,0.15402476489543915,0.13422295451164246,0.13179278373718262,0.5701709389686584,795.9903564453125,1e-05,0.049564581364393234,37.68456053733826,53.567798137664795,3 +600,0.16441167891025543,0.1303936243057251,0.12532371282577515,0.3460683822631836,759.6456298828125,1e-05,0.05148438736796379,37.68948221206665,53.567798137664795,3 +610,0.13064301013946533,0.13983695209026337,0.14177319407463074,0.5824145078659058,731.7777709960938,1e-05,0.05737392604351044,37.687960147857666,53.567798137664795,3 +620,0.11940351128578186,0.1322811096906662,0.13468217849731445,0.5188674926757812,764.5083618164062,1e-05,0.053736548870801926,37.6788010597229,53.567798137664795,3 +630,0.12850110232830048,0.13139913976192474,0.13536562025547028,0.5828418731689453,739.2901000976562,1e-05,0.048439376056194305,37.69603514671326,53.567798137664795,3 +640,0.12356819957494736,0.13518774509429932,0.13329555094242096,0.5902457237243652,771.4380493164062,1e-05,0.04646633565425873,37.67470574378967,53.567798137664795,3 +650,0.15893588960170746,0.15741989016532898,0.1597706824541092,0.6006624102592468,692.5242309570312,1e-05,0.04001593962311745,37.67720651626587,53.567798137664795,3 +660,0.11995096504688263,0.0987866148352623,0.10016878694295883,0.33549144864082336,811.6890869140625,1e-05,0.04282493516802788,37.67963409423828,53.567798137664795,3 +670,0.13395394384860992,0.14669962227344513,0.1431729942560196,0.4039316177368164,699.7033081054688,1e-05,0.048201750963926315,37.681084632873535,53.567798137664795,3 +680,0.15294180810451508,0.12592004239559174,0.1232105940580368,0.6029059886932373,717.753662109375,1e-05,0.07019387930631638,37.68811011314392,53.567798137664795,3 +690,0.13135255873203278,0.09143830090761185,0.09924253076314926,0.29028844833374023,748.2555541992188,1e-05,0.052010368555784225,37.69706726074219,53.567798137664795,3 +700,0.1560392677783966,0.12821230292320251,0.12869544327259064,0.6594017148017883,751.9866333007812,1e-05,0.051952507346868515,37.678152561187744,53.567798137664795,3 +710,0.11183924227952957,0.11397770792245865,0.1164795458316803,0.5858867764472961,778.9644775390625,1e-05,0.04267773777246475,37.72096610069275,53.567798137664795,3 +720,0.1630864441394806,0.103326216340065,0.10410811752080917,0.592553436756134,794.609130859375,1e-05,0.04814440757036209,37.69808578491211,53.567798137664795,3 +730,0.10910098999738693,0.06459244340658188,0.0703330859541893,0.2248183786869049,752.3870239257812,1e-05,0.049223531037569046,37.68774390220642,53.567798137664795,3 +740,0.1631426364183426,0.14289790391921997,0.14137686789035797,0.423397421836853,729.1687622070312,1e-05,0.04708944261074066,37.68330717086792,53.567798137664795,3 +750,0.12458633631467819,0.20169605314731598,0.1925148367881775,0.44603630900382996,753.3093872070312,1e-05,0.0573154054582119,37.70182752609253,53.567798137664795,3 +760,0.1322019249200821,0.191249281167984,0.1920958012342453,0.6035256385803223,728.8035278320312,1e-05,0.057402174919843674,37.68372964859009,53.567798137664795,4 +770,0.15014886856079102,0.16381484270095825,0.1644662320613861,0.472820520401001,755.00830078125,1e-05,0.06403718888759613,37.68952751159668,53.567798137664795,4 +780,0.12751799821853638,0.12881357967853546,0.1301976442337036,0.5824145078659058,743.335693359375,1e-05,0.04029831290245056,37.69772744178772,53.567798137664795,4 +790,0.168404221534729,0.13528551161289215,0.13617880642414093,0.6344016790390015,765.9296264648438,1e-05,0.057430557906627655,37.69595694541931,53.567798137664795,4 +800,0.16640645265579224,0.19723163545131683,0.19714860618114471,0.5795512795448303,768.2172241210938,1e-05,0.04751436412334442,37.7074921131134,53.567798137664795,4 +810,0.14501464366912842,0.11510448157787323,0.11337947100400925,0.5914636850357056,815.3278198242188,1e-05,0.05878002941608429,37.70922040939331,53.567798137664795,4 +820,0.12523363530635834,0.09317061305046082,0.09692180901765823,0.2623717784881592,749.0256958007812,1e-05,0.08382903784513474,37.6800799369812,53.567798137664795,4 +830,0.1293306052684784,0.1355966031551361,0.1372058093547821,0.5950534343719482,700.8533325195312,1e-05,0.05137011408805847,37.70431208610535,53.567798137664795,4 +840,0.13393999636173248,0.18393510580062866,0.18526345491409302,0.5418375730514526,813.8609008789062,1e-05,0.04494185000658035,37.72442650794983,53.567798137664795,4 +850,0.1346394568681717,0.11911574006080627,0.12223143130540848,0.4146687984466553,782.4246215820312,1e-05,0.06594221293926239,37.71236824989319,53.567798137664795,4 +860,0.12762725353240967,0.09707259386777878,0.09326602518558502,0.5522221922874451,785.7552490234375,1e-05,0.07343245297670364,37.693058490753174,53.567798137664795,4 +870,0.13718722760677338,0.11308441311120987,0.11734640598297119,0.42481836676597595,747.3893432617188,1e-05,0.04919911175966263,37.6841778755188,53.567798137664795,4 +880,0.1617676466703415,0.12310130894184113,0.12146846204996109,0.5740491151809692,763.1251831054688,1e-05,0.07402163743972778,37.941548109054565,53.567798137664795,4 +890,0.13041985034942627,0.12300196290016174,0.12350521981716156,0.5035149455070496,769.7569580078125,1e-05,0.06762660294771194,37.70043635368347,53.567798137664795,4 +900,0.13211260735988617,0.18548616766929626,0.18507631123065948,0.5233333110809326,764.5797119140625,1e-05,0.059955939650535583,37.68526244163513,53.567798137664795,4 +910,0.13738499581813812,0.11426613479852676,0.11315011233091354,0.5747863054275513,787.2326049804688,1e-05,0.04472280293703079,37.943676471710205,53.567798137664795,4 +920,0.12843632698059082,0.12149108946323395,0.1232450008392334,0.6008333563804626,748.8433837890625,1e-05,0.08060906827449799,37.67823076248169,53.567798137664795,4 +930,0.14511162042617798,0.17066459357738495,0.17087286710739136,0.48170939087867737,792.2379150390625,1e-05,0.04340855032205582,37.696786642074585,53.567798137664795,4 +940,0.1493133157491684,0.10356731712818146,0.1010042056441307,0.5818162560462952,741.4551391601562,1e-05,0.030317094177007675,18.862207889556885,53.567798137664795,4 +950,0.17104566097259521,0.18306949734687805,0.17893633246421814,0.6140598058700562,760.2376708984375,1e-05,0.07160846889019012,37.68009400367737,53.567798137664795,5 +960,0.12051471322774887,0.07024399936199188,0.07198139280080795,0.5277243256568909,769.02880859375,1e-05,0.06609585136175156,37.67623710632324,53.567798137664795,5 +970,0.15386991202831268,0.12194225192070007,0.12092136591672897,0.558311939239502,748.5880126953125,1e-05,0.05218657851219177,37.67359900474548,53.567798137664795,5 +980,0.11943873018026352,0.10626286268234253,0.10617166757583618,0.6322969794273376,750.0030517578125,1e-05,0.055375829339027405,37.69031596183777,53.567798137664795,5 +990,0.13453646004199982,0.15316642820835114,0.15427303314208984,0.6782799363136292,709.3366088867188,1e-05,0.038403067737817764,37.65932869911194,53.567798137664795,5 +1000,0.13112466037273407,0.140347421169281,0.13759860396385193,0.6488461494445801,760.2708129882812,1e-05,0.0645131841301918,37.71748685836792,53.567798137664795,5 diff --git a/backup_2026-09-14/runs/distill__stage1_long_K3/val_log.csv b/backup_2026-09-14/runs/distill__stage1_long_K3/val_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..abf08f03fee235da1896662c672b3e1f9228f733 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage1_long_K3/val_log.csv @@ -0,0 +1,13 @@ +step,timestep,loss_w,mse,n +250,201.34228515625,0.38145557418465614,0.3877797443419695,16 +250,500.59954833984375,0.15014502312988043,0.15011095954105258,16 +250,799.7118530273438,0.08066209987737238,0.07972472975961864,16 +500,201.34228515625,0.3810220155864954,0.38730750419199467,16 +500,500.59954833984375,0.1498034060932696,0.1497388044372201,16 +500,799.7118530273438,0.08030852815136313,0.07934991084039211,16 +750,201.34228515625,0.38027768209576607,0.386525921523571,16 +750,500.59954833984375,0.149359202478081,0.14927750080823898,16 +750,799.7118530273438,0.07990076881833375,0.07891914714127779,16 +1000,201.34228515625,0.37976587377488613,0.3859920762479305,16 +1000,500.59954833984375,0.14902084693312645,0.1489363294094801,16 +1000,799.7118530273438,0.07957463804632425,0.07859518635086715,16 diff --git a/backup_2026-09-14/runs/distill__stage2_cd/config.json b/backup_2026-09-14/runs/distill__stage2_cd/config.json new file mode 100644 index 0000000000000000000000000000000000000000..20fd78196868fc347bc7caae4d7a69b16daf8a33 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage2_cd/config.json @@ -0,0 +1,252 @@ +{ + "stage": "stage2_cd", + "args": { + "teacher_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors", + "student_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors", + "model_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B", + "output": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd", + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx", + "val_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx", + "sidecar": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "text_table": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "limit": null, + "scene_dropout": 0.0, + "min_rt_ratio": 0.8, + "teacher_causal": 1, + "teacher_forcing": true, + "windowed_train": 0, + "windowed_sink": 0, + "cd_axis": "deploy", + "denoise_list": "1000,750,500,250", + "discrete_cd_N": 48, + "cd_tail_t": 0.0, + "teacher_solver_steps": 1, + "real_guidance_scale": 1.0, + "ema_decay": 0.99, + "ema_start": 200, + "lr": 2e-06, + "weight_decay": 0.0, + "adam_betas": "0.0,0.999", + "warmup": 100, + "grad_clip": 10.0, + "opt8bit": 0, + "batch_size": 1, + "grad_accum": 1, + "max_steps": 8000, + "gradient_checkpointing": true, + "num_workers": 2, + "seed": 0, + "save_every": 500, + "keep_last_emas": 25, + "keep_last_dits": 2, + "log_every": 20, + "resume": "auto", + "force_run_dir": false, + "dry_run": false, + "betas": [ + 0.0, + 0.999 + ], + "denoise": [ + 1000.0, + 750.0, + 500.0, + 250.0 + ] + }, + "eff_batch": 8, + "axis": { + "mode": "deploy", + "source": "deploy_schedule([1000.0, 750.0, 500.0, 250.0]) → grid idx [0, 625, 833, 937]", + "K": 4, + "pairs": 3, + "sigmas": [ + 1.0, + 0.75, + 0.5006, + 0.251597 + ], + "timesteps": [ + 1000.0, + 750.0, + 500.6, + 251.597 + ], + "dsigma": [ + -0.25, + -0.2494, + -0.249002 + ], + "deploy_denoise_list": [ + 1000.0, + 750.0, + 500.0, + 250.0 + ], + "deploy_sigmas": [ + 1.0, + 0.75, + 0.5006, + 0.251597 + ], + "deploy_off_axis": [] + }, + "dataset": { + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx", + "train_used": 18528, + "train_total": 20983, + "train_invalid": 1, + "train_leak_excluded": 257, + "train_low_rt_excluded": 2197, + "text_table_keys": 361, + "excluded_src_in": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx" + }, + "model": { + "n_params": 4999803072, + "causal_student": true, + "causal_teacher": true, + "mask_channel": true, + "student_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors", + "teacher_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors", + "ema_ckpt": null, + "load_info": { + "student": { + "path": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors", + "n_tensors": 827, + "prefix": "dit.", + "missing": [], + "unexpected": [] + }, + "teacher": { + "path": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors", + "n_tensors": 827, + "prefix": "dit.", + "missing": [], + "unexpected": [] + } + }, + "start_step": 0 + }, + "product": { + "deploy": "ema/ema_step{N}.safetensors", + "resume_only": "dits/dit_step{N}.safetensors", + "note": "stage3 的 --student_ckpt 从 ema/ 里挑,绝不要用 dits/" + }, + "env": { + "world_size": 8, + "distributed_type": "DistributedType.DEEPSPEED", + "mixed_precision": "bf16", + "torch": "2.11.0+cu128", + "cuda": "12.8", + "gpu": "NVIDIA H200", + "python": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/python3.12", + "platform": "Linux-6.12.94-123.192.amzn2023.x86_64-x86_64-with-glibc2.34", + "hostname": "ip-172-16-244-218.ap-southeast-3.compute.internal", + "argv": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/distill/stage2_cd/cd_arope.py", + "--teacher_ckpt", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors", + "--student_ckpt", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors", + "--teacher_causal", + "1", + "--teacher_forcing", + "--windowed_train", + "0", + "--windowed_sink", + "0", + "--cd_axis", + "deploy", + "--denoise_list", + "1000,750,500,250", + "--discrete_cd_N", + "48", + "--cd_tail_t", + "0", + "--teacher_solver_steps", + "1", + "--real_guidance_scale", + "1.0", + "--ema_decay", + "0.99", + "--ema_start", + "200", + "--train_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx", + "--val_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx", + "--sidecar", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "--text_table", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "--scene_dropout", + "0.0", + "--min_rt_ratio", + "0.8", + "--lr", + "2e-6", + "--weight_decay", + "0.0", + "--adam_betas", + "0.0,0.999", + "--warmup", + "100", + "--grad_clip", + "10.0", + "--opt8bit", + "0", + "--batch_size", + "1", + "--grad_accum", + "1", + "--max_steps", + "8000", + "--gradient_checkpointing", + "--save_every", + "500", + "--keep_last_emas", + "25", + "--keep_last_dits", + "2", + "--log_every", + "20", + "--num_workers", + "2", + "--seed", + "0", + "--output", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd", + "--resume", + "auto" + ], + "started": "2026-09-10 01:43:07", + "cuda_visible_devices": "0,1,2,3,4,5,6,7", + "accelerate": "1.14.0" + }, + "deepspeed_config": { + "train_batch_size": 8, + "train_micro_batch_size_per_gpu": 1, + "gradient_accumulation_steps": 1, + "zero_optimization": { + "stage": 2, + "offload_optimizer": { + "device": "none", + "nvme_path": null + }, + "offload_param": { + "device": "none", + "nvme_path": null + }, + "stage3_gather_16bit_weights_on_model_save": false + }, + "gradient_clipping": 10.0, + "steps_per_print": Infinity, + "bf16": { + "enabled": true + }, + "fp16": { + "enabled": false + }, + "zero_allow_untested_optimizer": true + } +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/distill__stage2_cd/launch.log b/backup_2026-09-14/runs/distill__stage2_cd/launch.log new file mode 100644 index 0000000000000000000000000000000000000000..51764ea27c52ecb56028362b54683a61132dc664 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage2_cd/launch.log @@ -0,0 +1,1138 @@ +=== stage2_cd | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd world=8 dist=DistributedType.DEEPSPEED mp=bf16 === +[recipe] teacher_causal=1 tf=True windowed=0/0 cfg=1.0 ema=0.99@200 lr=2e-06 betas=(0.0, 0.999) wd=0.0 warmup=100 clip=10.0 bs=1×accum1×8卡 ⇒ 等效 batch 8 max_steps=8000 gc=True +[axis] deploy_schedule([1000.0, 750.0, 500.0, 250.0]) → grid idx [0, 625, 833, 937] K=4(3 对一致性) +[axis] sigma = [1.0, 0.75, 0.5006, 0.251597] +[axis] t = [1000.0, 750.0, 500.6, 251.597] +[axis] Δsigma= [-0.25, -0.2494, -0.249002] 教师 Euler 子步 = 1 +[axis] 部署采样表 [1000.0, 750.0, 500.0, 250.0] → sigma [1.0, 0.75, 0.5006, 0.251597](逐点都是轴上的节点) +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +[AropeLatentDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx: 20983 个 .pt,sidecar 缺失 0,valid=False 剔除 1,src 在 val_eybx 的转场剔除 257,rt_ratio<0.8 剔除 2197,可用 18528;text_mode=scene,文本表 361 键,scene_dropout=0.0 +[data] train 18528 clip(scene_dropout=0.0,CD 不做 CFG 所以是 0) +[resume] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd 里没有 progress.json,从头开始 +[ckpt] dit_step1000.safetensors metadata: stage=stage1_ar_tf step=1000 teacher_forcing=True windowed_train=0 +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] student ← /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors(827 个张量,缺 []) +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] teacher ← /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors(causal=True,827 个张量,缺 []) +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] 三份 AropeDiT 各 4,999,803,072 参数;构建 18s +[guard] 三模型就位:student(ZeRO-2, bf16) / teacher(bf16 冻结, 未 prepare) / ema(fp32 影子, 未 prepare),各 827 个参数张量,freqs 都在 cuda:0 +[env] grad_clip=10.0(DeepSpeed 生效值 10.0) +[train] 从 step 0 到 8000 +[2026-09-10 01:43:12,484] [WARNING] [torch_autocast.py:122:autocast_if_enabled] torch.autocast is enabled outside DeepSpeed but disabled within the DeepSpeed engine. If you are using DeepSpeed's built-in mixed precision, the engine will follow the settings in bf16/fp16 section. To use torch's native autocast instead, configure the `torch_autocast` section in the DeepSpeed config. +step 20/8000 cd 0.01828 (ema 0.01584) σ 1.0000→0.7500 [idx 0] cm_err 0.0972 tgt 0.1121 lr 4.00e-07 gnorm 0.367 decay 0.00 5.06s mem 56.4GB +step 40/8000 cd 0.00341 (ema 0.01071) σ 0.7500→0.5006 [idx 1] cm_err 0.0469 tgt 0.0487 lr 8.00e-07 gnorm 0.065 decay 0.00 5.05s mem 56.4GB +step 60/8000 cd 0.00329 (ema 0.00673) σ 0.7500→0.5006 [idx 1] cm_err 0.0481 tgt 0.0508 lr 1.20e-06 gnorm 0.055 decay 0.00 5.06s mem 56.4GB +step 80/8000 cd 0.03503 (ema 0.01108) σ 1.0000→0.7500 [idx 0] cm_err 0.2447 tgt 0.2350 lr 1.60e-06 gnorm 1.374 decay 0.00 5.24s mem 56.4GB +step 100/8000 cd 0.02229 (ema 0.01106) σ 1.0000→0.7500 [idx 0] cm_err 0.3274 tgt 0.3253 lr 2.00e-06 gnorm 0.636 decay 0.00 5.05s mem 56.4GB +step 120/8000 cd 0.00105 (ema 0.00848) σ 0.5006→0.2516 [idx 2] cm_err 0.0424 tgt 0.0437 lr 2.00e-06 gnorm 0.022 decay 0.00 5.06s mem 56.4GB +step 140/8000 cd 0.00108 (ema 0.00717) σ 0.5006→0.2516 [idx 2] cm_err 0.0518 tgt 0.0508 lr 2.00e-06 gnorm 0.030 decay 0.00 5.07s mem 56.4GB +step 160/8000 cd 0.02082 (ema 0.01003) σ 1.0000→0.7500 [idx 0] cm_err 0.1552 tgt 0.1442 lr 2.00e-06 gnorm 0.694 decay 0.00 5.06s mem 56.4GB +step 180/8000 cd 0.01940 (ema 0.00856) σ 1.0000→0.7500 [idx 0] cm_err 0.2188 tgt 0.2200 lr 2.00e-06 gnorm 0.544 decay 0.00 5.05s mem 56.4GB +step 200/8000 cd 0.00110 (ema 0.00847) σ 0.5006→0.2516 [idx 2] cm_err 0.0548 tgt 0.0509 lr 2.00e-06 gnorm 0.026 decay 0.00 5.06s mem 56.4GB +step 220/8000 cd 0.00194 (ema 0.00809) σ 0.7500→0.5006 [idx 1] cm_err 0.0716 tgt 0.0714 lr 2.00e-06 gnorm 0.032 decay 0.99 5.06s mem 56.4GB +step 240/8000 cd 0.01537 (ema 0.00516) σ 1.0000→0.7500 [idx 0] cm_err 0.1076 tgt 0.1160 lr 2.00e-06 gnorm 0.451 decay 0.99 5.06s mem 56.4GB +step 260/8000 cd 0.00090 (ema 0.00507) σ 0.5006→0.2516 [idx 2] cm_err 0.0668 tgt 0.0645 lr 2.00e-06 gnorm 0.016 decay 0.99 5.06s mem 56.4GB +step 280/8000 cd 0.00108 (ema 0.00370) σ 0.7500→0.5006 [idx 1] cm_err 0.0844 tgt 0.0852 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +step 300/8000 cd 0.00112 (ema 0.00781) σ 0.5006→0.2516 [idx 2] cm_err 0.0478 tgt 0.0456 lr 2.00e-06 gnorm 0.025 decay 0.99 5.06s mem 56.4GB +step 320/8000 cd 0.00083 (ema 0.00649) σ 0.5006→0.2516 [idx 2] cm_err 0.0601 tgt 0.0589 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +step 340/8000 cd 0.01663 (ema 0.00709) σ 1.0000→0.7500 [idx 0] cm_err 0.1778 tgt 0.1877 lr 2.00e-06 gnorm 0.416 decay 0.99 5.06s mem 56.4GB +step 360/8000 cd 0.00168 (ema 0.01049) σ 0.7500→0.5006 [idx 1] cm_err 0.1064 tgt 0.1052 lr 2.00e-06 gnorm 0.043 decay 0.99 5.06s mem 56.4GB +step 380/8000 cd 0.01391 (ema 0.00974) σ 1.0000→0.7500 [idx 0] cm_err 0.2778 tgt 0.2906 lr 2.00e-06 gnorm 0.359 decay 0.99 5.06s mem 56.4GB +step 400/8000 cd 0.00206 (ema 0.01686) σ 0.7500→0.5006 [idx 1] cm_err 0.0726 tgt 0.0705 lr 2.00e-06 gnorm 0.050 decay 0.99 5.07s mem 56.4GB +step 420/8000 cd 0.00103 (ema 0.00656) σ 0.5006→0.2516 [idx 2] cm_err 0.0716 tgt 0.0695 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +step 440/8000 cd 0.00126 (ema 0.00520) σ 0.7500→0.5006 [idx 1] cm_err 0.0576 tgt 0.0576 lr 2.00e-06 gnorm 0.031 decay 0.99 5.06s mem 56.4GB +step 460/8000 cd 0.00092 (ema 0.00943) σ 0.5006→0.2516 [idx 2] cm_err 0.0584 tgt 0.0555 lr 2.00e-06 gnorm 0.019 decay 0.99 5.06s mem 56.4GB +step 480/8000 cd 0.01890 (ema 0.00749) σ 1.0000→0.7500 [idx 0] cm_err 0.2567 tgt 0.2469 lr 2.00e-06 gnorm 0.588 decay 0.99 5.06s mem 56.4GB +step 500/8000 cd 0.00120 (ema 0.00499) σ 0.7500→0.5006 [idx 1] cm_err 0.0741 tgt 0.0741 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step500.safetensors 827 个张量 10.00 GB +step 520/8000 cd 0.00126 (ema 0.00769) σ 0.7500→0.5006 [idx 1] cm_err 0.0561 tgt 0.0563 lr 2.00e-06 gnorm 0.032 decay 0.99 5.07s mem 56.4GB +step 540/8000 cd 0.00082 (ema 0.00464) σ 0.5006→0.2516 [idx 2] cm_err 0.0344 tgt 0.0334 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 560/8000 cd 0.00082 (ema 0.00776) σ 0.5006→0.2516 [idx 2] cm_err 0.0464 tgt 0.0451 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 580/8000 cd 0.00077 (ema 0.00451) σ 0.5006→0.2516 [idx 2] cm_err 0.0337 tgt 0.0328 lr 2.00e-06 gnorm 0.008 decay 0.99 5.05s mem 56.4GB +step 600/8000 cd 0.00101 (ema 0.00690) σ 0.7500→0.5006 [idx 1] cm_err 0.0711 tgt 0.0698 lr 2.00e-06 gnorm 0.015 decay 0.99 5.05s mem 56.4GB +step 620/8000 cd 0.01436 (ema 0.00710) σ 1.0000→0.7500 [idx 0] cm_err 0.1376 tgt 0.1407 lr 2.00e-06 gnorm 0.286 decay 0.99 5.07s mem 56.4GB +step 640/8000 cd 0.01215 (ema 0.00615) σ 1.0000→0.7500 [idx 0] cm_err 0.0978 tgt 0.1033 lr 2.00e-06 gnorm 0.335 decay 0.99 5.07s mem 56.4GB +step 660/8000 cd 0.01268 (ema 0.01000) σ 1.0000→0.7500 [idx 0] cm_err 0.1933 tgt 0.1912 lr 2.00e-06 gnorm 0.347 decay 0.99 5.06s mem 56.4GB +step 680/8000 cd 0.01612 (ema 0.00881) σ 1.0000→0.7500 [idx 0] cm_err 0.1135 tgt 0.1149 lr 2.00e-06 gnorm 0.554 decay 0.99 5.06s mem 56.4GB +step 700/8000 cd 0.00113 (ema 0.00684) σ 0.7500→0.5006 [idx 1] cm_err 0.0383 tgt 0.0380 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +step 720/8000 cd 0.01526 (ema 0.00589) σ 1.0000→0.7500 [idx 0] cm_err 0.1953 tgt 0.2055 lr 2.00e-06 gnorm 0.465 decay 0.99 5.06s mem 56.4GB +step 740/8000 cd 0.00105 (ema 0.00667) σ 0.7500→0.5006 [idx 1] cm_err 0.0679 tgt 0.0678 lr 2.00e-06 gnorm 0.014 decay 0.99 5.07s mem 56.4GB +step 760/8000 cd 0.00107 (ema 0.00597) σ 0.7500→0.5006 [idx 1] cm_err 0.0537 tgt 0.0540 lr 2.00e-06 gnorm 0.016 decay 0.99 5.06s mem 56.4GB +step 780/8000 cd 0.00077 (ema 0.00640) σ 0.5006→0.2516 [idx 2] cm_err 0.0169 tgt 0.0164 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 800/8000 cd 0.00078 (ema 0.00484) σ 0.5006→0.2516 [idx 2] cm_err 0.0345 tgt 0.0338 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 820/8000 cd 0.01184 (ema 0.00529) σ 1.0000→0.7500 [idx 0] cm_err 0.3708 tgt 0.3898 lr 2.00e-06 gnorm 0.243 decay 0.99 5.06s mem 56.4GB +step 840/8000 cd 0.01486 (ema 0.00430) σ 1.0000→0.7500 [idx 0] cm_err 0.1355 tgt 0.1356 lr 2.00e-06 gnorm 0.488 decay 0.99 5.06s mem 56.4GB +step 860/8000 cd 0.00106 (ema 0.00806) σ 0.7500→0.5006 [idx 1] cm_err 0.0655 tgt 0.0651 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +step 880/8000 cd 0.00089 (ema 0.00345) σ 0.7500→0.5006 [idx 1] cm_err 0.0788 tgt 0.0780 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 900/8000 cd 0.00116 (ema 0.00354) σ 0.7500→0.5006 [idx 1] cm_err 0.1151 tgt 0.1138 lr 2.00e-06 gnorm 0.032 decay 0.99 5.06s mem 56.4GB +step 920/8000 cd 0.00101 (ema 0.00498) σ 0.7500→0.5006 [idx 1] cm_err 0.0664 tgt 0.0659 lr 2.00e-06 gnorm 0.023 decay 0.99 5.06s mem 56.4GB +step 940/8000 cd 0.02430 (ema 0.00718) σ 1.0000→0.7500 [idx 0] cm_err 0.1247 tgt 0.1099 lr 2.00e-06 gnorm 0.815 decay 0.99 5.06s mem 56.4GB +step 960/8000 cd 0.00106 (ema 0.00504) σ 0.7500→0.5006 [idx 1] cm_err 0.0838 tgt 0.0838 lr 2.00e-06 gnorm 0.027 decay 0.99 5.06s mem 56.4GB +step 980/8000 cd 0.00097 (ema 0.00290) σ 0.7500→0.5006 [idx 1] cm_err 0.0385 tgt 0.0383 lr 2.00e-06 gnorm 0.018 decay 0.99 5.05s mem 56.4GB +step 1000/8000 cd 0.01083 (ema 0.00485) σ 1.0000→0.7500 [idx 0] cm_err 0.1393 tgt 0.1442 lr 2.00e-06 gnorm 0.258 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step1000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step1000.safetensors 827 个张量 10.00 GB +step 1020/8000 cd 0.00106 (ema 0.00381) σ 0.7500→0.5006 [idx 1] cm_err 0.0880 tgt 0.0869 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +step 1040/8000 cd 0.02060 (ema 0.00817) σ 1.0000→0.7500 [idx 0] cm_err 0.2941 tgt 0.3140 lr 2.00e-06 gnorm 0.553 decay 0.99 5.05s mem 56.4GB +step 1060/8000 cd 0.00117 (ema 0.00470) σ 0.7500→0.5006 [idx 1] cm_err 0.0577 tgt 0.0572 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +step 1080/8000 cd 0.00109 (ema 0.00776) σ 0.7500→0.5006 [idx 1] cm_err 0.0662 tgt 0.0654 lr 2.00e-06 gnorm 0.021 decay 0.99 5.06s mem 56.4GB +step 1100/8000 cd 0.00118 (ema 0.00423) σ 0.7500→0.5006 [idx 1] cm_err 0.0642 tgt 0.0641 lr 2.00e-06 gnorm 0.020 decay 0.99 5.08s mem 56.4GB +step 1120/8000 cd 0.00068 (ema 0.00499) σ 0.5006→0.2516 [idx 2] cm_err 0.0433 tgt 0.0423 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 1140/8000 cd 0.00109 (ema 0.00480) σ 0.7500→0.5006 [idx 1] cm_err 0.0944 tgt 0.0932 lr 2.00e-06 gnorm 0.029 decay 0.99 5.15s mem 56.4GB +step 1160/8000 cd 0.01419 (ema 0.00613) σ 1.0000→0.7500 [idx 0] cm_err 0.2168 tgt 0.2179 lr 2.00e-06 gnorm 0.452 decay 0.99 5.06s mem 56.4GB +step 1180/8000 cd 0.00063 (ema 0.00570) σ 0.5006→0.2516 [idx 2] cm_err 0.0290 tgt 0.0284 lr 2.00e-06 gnorm 0.007 decay 0.99 5.07s mem 56.4GB +step 1200/8000 cd 0.00070 (ema 0.00673) σ 0.5006→0.2516 [idx 2] cm_err 0.0426 tgt 0.0415 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 1220/8000 cd 0.00059 (ema 0.00436) σ 0.5006→0.2516 [idx 2] cm_err 0.0398 tgt 0.0388 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +step 1240/8000 cd 0.00942 (ema 0.00294) σ 1.0000→0.7500 [idx 0] cm_err 0.2142 tgt 0.2164 lr 2.00e-06 gnorm 0.293 decay 0.99 5.06s mem 56.4GB +step 1260/8000 cd 0.01180 (ema 0.00606) σ 1.0000→0.7500 [idx 0] cm_err 0.1573 tgt 0.1622 lr 2.00e-06 gnorm 0.349 decay 0.99 5.06s mem 56.4GB +step 1280/8000 cd 0.00063 (ema 0.00642) σ 0.5006→0.2516 [idx 2] cm_err 0.0383 tgt 0.0377 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 1300/8000 cd 0.00100 (ema 0.00235) σ 0.7500→0.5006 [idx 1] cm_err 0.0422 tgt 0.0418 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 1320/8000 cd 0.01055 (ema 0.00400) σ 1.0000→0.7500 [idx 0] cm_err 0.1695 tgt 0.1721 lr 2.00e-06 gnorm 0.320 decay 0.99 5.06s mem 56.4GB +step 1340/8000 cd 0.00126 (ema 0.00526) σ 0.7500→0.5006 [idx 1] cm_err 0.0580 tgt 0.0575 lr 2.00e-06 gnorm 0.032 decay 0.99 5.06s mem 56.4GB +step 1360/8000 cd 0.00059 (ema 0.00402) σ 0.5006→0.2516 [idx 2] cm_err 0.0475 tgt 0.0464 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +step 1380/8000 cd 0.01047 (ema 0.00308) σ 1.0000→0.7500 [idx 0] cm_err 0.1503 tgt 0.1540 lr 2.00e-06 gnorm 0.192 decay 0.99 5.06s mem 56.4GB +step 1400/8000 cd 0.01682 (ema 0.00497) σ 1.0000→0.7500 [idx 0] cm_err 0.1447 tgt 0.1402 lr 2.00e-06 gnorm 0.638 decay 0.99 5.07s mem 56.4GB +step 1420/8000 cd 0.00062 (ema 0.00425) σ 0.5006→0.2516 [idx 2] cm_err 0.0483 tgt 0.0475 lr 2.00e-06 gnorm 0.008 decay 0.99 5.07s mem 56.4GB +step 1440/8000 cd 0.01048 (ema 0.00316) σ 1.0000→0.7500 [idx 0] cm_err 0.1542 tgt 0.1545 lr 2.00e-06 gnorm 0.374 decay 0.99 5.06s mem 56.4GB +step 1460/8000 cd 0.00098 (ema 0.00699) σ 0.7500→0.5006 [idx 1] cm_err 0.0385 tgt 0.0383 lr 2.00e-06 gnorm 0.027 decay 0.99 5.07s mem 56.4GB +step 1480/8000 cd 0.01224 (ema 0.00582) σ 1.0000→0.7500 [idx 0] cm_err 0.1812 tgt 0.1782 lr 2.00e-06 gnorm 0.394 decay 0.99 5.06s mem 56.4GB +step 1500/8000 cd 0.00119 (ema 0.00613) σ 0.7500→0.5006 [idx 1] cm_err 0.0576 tgt 0.0567 lr 2.00e-06 gnorm 0.038 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step1500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step1500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 1520/8000 cd 0.00058 (ema 0.00479) σ 0.5006→0.2516 [idx 2] cm_err 0.0392 tgt 0.0387 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +step 1540/8000 cd 0.00084 (ema 0.00304) σ 0.7500→0.5006 [idx 1] cm_err 0.0488 tgt 0.0484 lr 2.00e-06 gnorm 0.014 decay 0.99 5.05s mem 56.4GB +step 1560/8000 cd 0.00096 (ema 0.00482) σ 0.7500→0.5006 [idx 1] cm_err 0.1041 tgt 0.1021 lr 2.00e-06 gnorm 0.030 decay 0.99 5.06s mem 56.4GB +step 1580/8000 cd 0.00061 (ema 0.00539) σ 0.5006→0.2516 [idx 2] cm_err 0.0362 tgt 0.0355 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +step 1600/8000 cd 0.01118 (ema 0.00605) σ 1.0000→0.7500 [idx 0] cm_err 0.1658 tgt 0.1676 lr 2.00e-06 gnorm 0.222 decay 0.99 5.06s mem 56.4GB +step 1620/8000 cd 0.00065 (ema 0.00389) σ 0.5006→0.2516 [idx 2] cm_err 0.0425 tgt 0.0412 lr 2.00e-06 gnorm 0.009 decay 0.99 5.88s mem 56.4GB +step 1640/8000 cd 0.01024 (ema 0.00708) σ 1.0000→0.7500 [idx 0] cm_err 0.3047 tgt 0.2987 lr 2.00e-06 gnorm 0.194 decay 0.99 5.06s mem 56.4GB +step 1660/8000 cd 0.01631 (ema 0.00742) σ 1.0000→0.7500 [idx 0] cm_err 0.1797 tgt 0.1803 lr 2.00e-06 gnorm 0.511 decay 0.99 5.07s mem 56.4GB +step 1680/8000 cd 0.00082 (ema 0.00385) σ 0.7500→0.5006 [idx 1] cm_err 0.0570 tgt 0.0562 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +step 1700/8000 cd 0.00061 (ema 0.00325) σ 0.5006→0.2516 [idx 2] cm_err 0.0614 tgt 0.0605 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 1720/8000 cd 0.00067 (ema 0.00873) σ 0.5006→0.2516 [idx 2] cm_err 0.0417 tgt 0.0411 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 1740/8000 cd 0.00105 (ema 0.00250) σ 0.7500→0.5006 [idx 1] cm_err 0.0615 tgt 0.0609 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +step 1760/8000 cd 0.02116 (ema 0.00458) σ 1.0000→0.7500 [idx 0] cm_err 0.2334 tgt 0.2316 lr 2.00e-06 gnorm 0.711 decay 0.99 5.06s mem 56.4GB +step 1780/8000 cd 0.00091 (ema 0.00746) σ 0.7500→0.5006 [idx 1] cm_err 0.0454 tgt 0.0451 lr 2.00e-06 gnorm 0.023 decay 0.99 5.06s mem 56.4GB +step 1800/8000 cd 0.00120 (ema 0.00469) σ 0.7500→0.5006 [idx 1] cm_err 0.0920 tgt 0.0911 lr 2.00e-06 gnorm 0.028 decay 0.99 5.07s mem 56.4GB +step 1820/8000 cd 0.00092 (ema 0.00657) σ 0.7500→0.5006 [idx 1] cm_err 0.0609 tgt 0.0604 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +step 1840/8000 cd 0.00109 (ema 0.00460) σ 0.7500→0.5006 [idx 1] cm_err 0.0897 tgt 0.0883 lr 2.00e-06 gnorm 0.030 decay 0.99 5.06s mem 56.4GB +step 1860/8000 cd 0.00096 (ema 0.00454) σ 0.7500→0.5006 [idx 1] cm_err 0.0556 tgt 0.0550 lr 2.00e-06 gnorm 0.031 decay 0.99 5.06s mem 56.4GB +step 1880/8000 cd 0.00061 (ema 0.00642) σ 0.5006→0.2516 [idx 2] cm_err 0.0355 tgt 0.0347 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 1900/8000 cd 0.00097 (ema 0.00377) σ 0.7500→0.5006 [idx 1] cm_err 0.0603 tgt 0.0597 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +step 1920/8000 cd 0.01042 (ema 0.00496) σ 1.0000→0.7500 [idx 0] cm_err 0.1550 tgt 0.1608 lr 2.00e-06 gnorm 0.225 decay 0.99 5.06s mem 56.4GB +step 1940/8000 cd 0.00107 (ema 0.00419) σ 0.7500→0.5006 [idx 1] cm_err 0.0380 tgt 0.0378 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +step 1960/8000 cd 0.00061 (ema 0.00424) σ 0.5006→0.2516 [idx 2] cm_err 0.0485 tgt 0.0477 lr 2.00e-06 gnorm 0.008 decay 0.99 5.07s mem 56.4GB +step 1980/8000 cd 0.00120 (ema 0.00450) σ 0.7500→0.5006 [idx 1] cm_err 0.0549 tgt 0.0544 lr 2.00e-06 gnorm 0.021 decay 0.99 5.06s mem 56.4GB +step 2000/8000 cd 0.00096 (ema 0.00466) σ 0.7500→0.5006 [idx 1] cm_err 0.0677 tgt 0.0669 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step2000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step2000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 2020/8000 cd 0.01544 (ema 0.00770) σ 1.0000→0.7500 [idx 0] cm_err 0.2528 tgt 0.2616 lr 2.00e-06 gnorm 0.318 decay 0.99 5.05s mem 56.4GB +step 2040/8000 cd 0.00087 (ema 0.00266) σ 0.7500→0.5006 [idx 1] cm_err 0.0492 tgt 0.0495 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 2060/8000 cd 0.01465 (ema 0.00514) σ 1.0000→0.7500 [idx 0] cm_err 0.1456 tgt 0.1429 lr 2.00e-06 gnorm 0.411 decay 0.99 5.07s mem 56.4GB +step 2080/8000 cd 0.00087 (ema 0.00249) σ 0.7500→0.5006 [idx 1] cm_err 0.0473 tgt 0.0466 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +step 2100/8000 cd 0.00058 (ema 0.00384) σ 0.5006→0.2516 [idx 2] cm_err 0.0446 tgt 0.0438 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 2120/8000 cd 0.00148 (ema 0.00470) σ 0.7500→0.5006 [idx 1] cm_err 0.0466 tgt 0.0459 lr 2.00e-06 gnorm 0.053 decay 0.99 5.06s mem 56.4GB +step 2140/8000 cd 0.00072 (ema 0.00520) σ 0.5006→0.2516 [idx 2] cm_err 0.0513 tgt 0.0500 lr 2.00e-06 gnorm 0.015 decay 0.99 5.06s mem 56.4GB +step 2160/8000 cd 0.00057 (ema 0.00348) σ 0.5006→0.2516 [idx 2] cm_err 0.0458 tgt 0.0448 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 2180/8000 cd 0.02909 (ema 0.00963) σ 1.0000→0.7500 [idx 0] cm_err 0.3351 tgt 0.3314 lr 2.00e-06 gnorm 0.520 decay 0.99 5.06s mem 56.4GB +step 2200/8000 cd 0.00116 (ema 0.00557) σ 0.7500→0.5006 [idx 1] cm_err 0.0902 tgt 0.0894 lr 2.00e-06 gnorm 0.038 decay 0.99 5.06s mem 56.4GB +step 2220/8000 cd 0.01201 (ema 0.00568) σ 1.0000→0.7500 [idx 0] cm_err 0.2446 tgt 0.2589 lr 2.00e-06 gnorm 0.294 decay 0.99 5.06s mem 56.4GB +step 2240/8000 cd 0.01801 (ema 0.00703) σ 1.0000→0.7500 [idx 0] cm_err 0.0623 tgt 0.0620 lr 2.00e-06 gnorm 0.465 decay 0.99 5.05s mem 56.4GB +step 2260/8000 cd 0.01048 (ema 0.00959) σ 1.0000→0.7500 [idx 0] cm_err 0.1846 tgt 0.1927 lr 2.00e-06 gnorm 0.219 decay 0.99 5.06s mem 56.4GB +step 2280/8000 cd 0.00077 (ema 0.00419) σ 0.7500→0.5006 [idx 1] cm_err 0.0635 tgt 0.0629 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +step 2300/8000 cd 0.00066 (ema 0.00592) σ 0.5006→0.2516 [idx 2] cm_err 0.0469 tgt 0.0459 lr 2.00e-06 gnorm 0.006 decay 0.99 5.07s mem 56.4GB +step 2320/8000 cd 0.01077 (ema 0.00333) σ 1.0000→0.7500 [idx 0] cm_err 0.1949 tgt 0.1989 lr 2.00e-06 gnorm 0.207 decay 0.99 5.06s mem 56.4GB +step 2340/8000 cd 0.00100 (ema 0.00601) σ 0.7500→0.5006 [idx 1] cm_err 0.1300 tgt 0.1280 lr 2.00e-06 gnorm 0.028 decay 0.99 5.06s mem 56.4GB +step 2360/8000 cd 0.00096 (ema 0.00725) σ 0.7500→0.5006 [idx 1] cm_err 0.0503 tgt 0.0498 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +step 2380/8000 cd 0.01130 (ema 0.00537) σ 1.0000→0.7500 [idx 0] cm_err 0.1482 tgt 0.1488 lr 2.00e-06 gnorm 0.341 decay 0.99 5.06s mem 56.4GB +step 2400/8000 cd 0.00061 (ema 0.00403) σ 0.5006→0.2516 [idx 2] cm_err 0.0324 tgt 0.0317 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 2420/8000 cd 0.00057 (ema 0.00445) σ 0.5006→0.2516 [idx 2] cm_err 0.0230 tgt 0.0226 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +step 2440/8000 cd 0.00088 (ema 0.00442) σ 0.7500→0.5006 [idx 1] cm_err 0.0651 tgt 0.0644 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 2460/8000 cd 0.01241 (ema 0.00457) σ 1.0000→0.7500 [idx 0] cm_err 0.3334 tgt 0.3463 lr 2.00e-06 gnorm 0.266 decay 0.99 5.07s mem 56.4GB +step 2480/8000 cd 0.01255 (ema 0.00410) σ 1.0000→0.7500 [idx 0] cm_err 0.3060 tgt 0.3188 lr 2.00e-06 gnorm 0.250 decay 0.99 5.06s mem 56.4GB +step 2500/8000 cd 0.01257 (ema 0.00502) σ 1.0000→0.7500 [idx 0] cm_err 0.1356 tgt 0.1354 lr 2.00e-06 gnorm 0.364 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step2500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step2500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 2520/8000 cd 0.00093 (ema 0.00369) σ 0.7500→0.5006 [idx 1] cm_err 0.0757 tgt 0.0749 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +step 2540/8000 cd 0.00103 (ema 0.00392) σ 0.7500→0.5006 [idx 1] cm_err 0.0576 tgt 0.0571 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +step 2560/8000 cd 0.00053 (ema 0.00514) σ 0.5006→0.2516 [idx 2] cm_err 0.0389 tgt 0.0381 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 2580/8000 cd 0.00095 (ema 0.00585) σ 0.7500→0.5006 [idx 1] cm_err 0.0521 tgt 0.0512 lr 2.00e-06 gnorm 0.024 decay 0.99 5.06s mem 56.4GB +step 2600/8000 cd 0.00108 (ema 0.00573) σ 0.7500→0.5006 [idx 1] cm_err 0.0580 tgt 0.0570 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 2620/8000 cd 0.00861 (ema 0.00335) σ 1.0000→0.7500 [idx 0] cm_err 0.1172 tgt 0.1208 lr 2.00e-06 gnorm 0.280 decay 0.99 5.06s mem 56.4GB +step 2640/8000 cd 0.00193 (ema 0.00446) σ 0.7500→0.5006 [idx 1] cm_err 0.1274 tgt 0.1244 lr 2.00e-06 gnorm 0.075 decay 0.99 5.07s mem 56.4GB +step 2660/8000 cd 0.01074 (ema 0.00683) σ 1.0000→0.7500 [idx 0] cm_err 0.2263 tgt 0.2217 lr 2.00e-06 gnorm 0.273 decay 0.99 5.05s mem 56.4GB +step 2680/8000 cd 0.00097 (ema 0.00751) σ 0.7500→0.5006 [idx 1] cm_err 0.0788 tgt 0.0777 lr 2.00e-06 gnorm 0.016 decay 0.99 5.06s mem 56.4GB +step 2700/8000 cd 0.00084 (ema 0.00205) σ 0.7500→0.5006 [idx 1] cm_err 0.0310 tgt 0.0303 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +step 2720/8000 cd 0.00097 (ema 0.00374) σ 0.7500→0.5006 [idx 1] cm_err 0.0739 tgt 0.0733 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +step 2740/8000 cd 0.00112 (ema 0.00550) σ 0.7500→0.5006 [idx 1] cm_err 0.0670 tgt 0.0659 lr 2.00e-06 gnorm 0.030 decay 0.99 5.09s mem 56.4GB +step 2760/8000 cd 0.00052 (ema 0.00331) σ 0.5006→0.2516 [idx 2] cm_err 0.0413 tgt 0.0407 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 2780/8000 cd 0.00096 (ema 0.00475) σ 0.7500→0.5006 [idx 1] cm_err 0.0624 tgt 0.0619 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 2800/8000 cd 0.00125 (ema 0.00606) σ 0.7500→0.5006 [idx 1] cm_err 0.0625 tgt 0.0610 lr 2.00e-06 gnorm 0.035 decay 0.99 5.06s mem 56.4GB +step 2820/8000 cd 0.00052 (ema 0.00412) σ 0.5006→0.2516 [idx 2] cm_err 0.0224 tgt 0.0217 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +step 2840/8000 cd 0.00951 (ema 0.00724) σ 1.0000→0.7500 [idx 0] cm_err 0.2601 tgt 0.2693 lr 2.00e-06 gnorm 0.142 decay 0.99 5.06s mem 56.4GB +step 2860/8000 cd 0.00055 (ema 0.00275) σ 0.5006→0.2516 [idx 2] cm_err 0.0452 tgt 0.0446 lr 2.00e-06 gnorm 0.005 decay 0.99 5.05s mem 56.4GB +step 2880/8000 cd 0.00862 (ema 0.00400) σ 1.0000→0.7500 [idx 0] cm_err 0.0812 tgt 0.0814 lr 2.00e-06 gnorm 0.197 decay 0.99 5.06s mem 56.4GB +step 2900/8000 cd 0.00093 (ema 0.00212) σ 0.7500→0.5006 [idx 1] cm_err 0.0859 tgt 0.0850 lr 2.00e-06 gnorm 0.009 decay 0.99 5.16s mem 56.4GB +step 2920/8000 cd 0.00051 (ema 0.00309) σ 0.5006→0.2516 [idx 2] cm_err 0.0318 tgt 0.0312 lr 2.00e-06 gnorm 0.007 decay 0.99 5.06s mem 56.4GB +step 2940/8000 cd 0.00074 (ema 0.00877) σ 0.5006→0.2516 [idx 2] cm_err 0.0519 tgt 0.0510 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +step 2960/8000 cd 0.00093 (ema 0.00367) σ 0.7500→0.5006 [idx 1] cm_err 0.0618 tgt 0.0610 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 2980/8000 cd 0.01229 (ema 0.00609) σ 1.0000→0.7500 [idx 0] cm_err 0.1692 tgt 0.1662 lr 2.00e-06 gnorm 0.340 decay 0.99 5.05s mem 56.4GB +step 3000/8000 cd 0.00824 (ema 0.00931) σ 1.0000→0.7500 [idx 0] cm_err 0.2439 tgt 0.2477 lr 2.00e-06 gnorm 0.201 decay 0.99 5.05s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step3000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step3000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 3020/8000 cd 0.00091 (ema 0.00706) σ 0.7500→0.5006 [idx 1] cm_err 0.0423 tgt 0.0416 lr 2.00e-06 gnorm 0.024 decay 0.99 5.06s mem 56.4GB +step 3040/8000 cd 0.00916 (ema 0.00493) σ 1.0000→0.7500 [idx 0] cm_err 0.3138 tgt 0.3200 lr 2.00e-06 gnorm 0.194 decay 0.99 5.06s mem 56.4GB +step 3060/8000 cd 0.00915 (ema 0.00489) σ 1.0000→0.7500 [idx 0] cm_err 0.1755 tgt 0.1762 lr 2.00e-06 gnorm 0.277 decay 0.99 5.06s mem 56.4GB +step 3080/8000 cd 0.01015 (ema 0.00522) σ 1.0000→0.7500 [idx 0] cm_err 0.1892 tgt 0.1907 lr 2.00e-06 gnorm 0.298 decay 0.99 5.06s mem 56.4GB +step 3100/8000 cd 0.00143 (ema 0.00404) σ 0.7500→0.5006 [idx 1] cm_err 0.0428 tgt 0.0422 lr 2.00e-06 gnorm 0.045 decay 0.99 5.06s mem 56.4GB +step 3120/8000 cd 0.00057 (ema 0.00343) σ 0.5006→0.2516 [idx 2] cm_err 0.0457 tgt 0.0447 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 3140/8000 cd 0.01110 (ema 0.00603) σ 1.0000→0.7500 [idx 0] cm_err 0.2483 tgt 0.2479 lr 2.00e-06 gnorm 0.252 decay 0.99 5.05s mem 56.4GB +step 3160/8000 cd 0.00059 (ema 0.00527) σ 0.5006→0.2516 [idx 2] cm_err 0.0489 tgt 0.0479 lr 2.00e-06 gnorm 0.006 decay 0.99 5.07s mem 56.4GB +step 3180/8000 cd 0.01475 (ema 0.00589) σ 1.0000→0.7500 [idx 0] cm_err 0.2153 tgt 0.2205 lr 2.00e-06 gnorm 0.412 decay 0.99 5.06s mem 56.4GB +step 3200/8000 cd 0.00056 (ema 0.00538) σ 0.5006→0.2516 [idx 2] cm_err 0.0438 tgt 0.0430 lr 2.00e-06 gnorm 0.013 decay 0.99 5.96s mem 56.4GB +step 3220/8000 cd 0.01866 (ema 0.00603) σ 1.0000→0.7500 [idx 0] cm_err 0.2699 tgt 0.2560 lr 2.00e-06 gnorm 0.489 decay 0.99 5.07s mem 56.4GB +step 3240/8000 cd 0.00061 (ema 0.00282) σ 0.5006→0.2516 [idx 2] cm_err 0.0414 tgt 0.0408 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 3260/8000 cd 0.01200 (ema 0.00678) σ 1.0000→0.7500 [idx 0] cm_err 0.1437 tgt 0.1455 lr 2.00e-06 gnorm 0.323 decay 0.99 5.06s mem 56.4GB +step 3280/8000 cd 0.00759 (ema 0.00329) σ 1.0000→0.7500 [idx 0] cm_err 0.1292 tgt 0.1302 lr 2.00e-06 gnorm 0.218 decay 0.99 5.06s mem 56.4GB +step 3300/8000 cd 0.01886 (ema 0.00711) σ 1.0000→0.7500 [idx 0] cm_err 0.2080 tgt 0.1961 lr 2.00e-06 gnorm 0.415 decay 0.99 5.07s mem 56.4GB +step 3320/8000 cd 0.00092 (ema 0.00386) σ 0.7500→0.5006 [idx 1] cm_err 0.0508 tgt 0.0506 lr 2.00e-06 gnorm 0.023 decay 0.99 5.06s mem 56.4GB +step 3340/8000 cd 0.00846 (ema 0.00499) σ 1.0000→0.7500 [idx 0] cm_err 0.3158 tgt 0.3273 lr 2.00e-06 gnorm 0.189 decay 0.99 5.06s mem 56.4GB +step 3360/8000 cd 0.00064 (ema 0.00389) σ 0.5006→0.2516 [idx 2] cm_err 0.0470 tgt 0.0457 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +step 3380/8000 cd 0.00066 (ema 0.00472) σ 0.5006→0.2516 [idx 2] cm_err 0.0843 tgt 0.0828 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 3400/8000 cd 0.03068 (ema 0.01040) σ 1.0000→0.7500 [idx 0] cm_err 0.2464 tgt 0.2540 lr 2.00e-06 gnorm 0.442 decay 0.99 5.06s mem 56.4GB +step 3420/8000 cd 0.00102 (ema 0.00626) σ 0.7500→0.5006 [idx 1] cm_err 0.0455 tgt 0.0444 lr 2.00e-06 gnorm 0.021 decay 0.99 5.07s mem 56.4GB +step 3440/8000 cd 0.00078 (ema 0.00270) σ 0.7500→0.5006 [idx 1] cm_err 0.0596 tgt 0.0590 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 3460/8000 cd 0.00094 (ema 0.00549) σ 0.7500→0.5006 [idx 1] cm_err 0.0752 tgt 0.0745 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +step 3480/8000 cd 0.01041 (ema 0.00421) σ 1.0000→0.7500 [idx 0] cm_err 0.1586 tgt 0.1551 lr 2.00e-06 gnorm 0.284 decay 0.99 5.06s mem 56.4GB +step 3500/8000 cd 0.00055 (ema 0.00479) σ 0.5006→0.2516 [idx 2] cm_err 0.0480 tgt 0.0469 lr 2.00e-06 gnorm 0.006 decay 0.99 5.07s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step3500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step3500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 3520/8000 cd 0.00088 (ema 0.00332) σ 0.7500→0.5006 [idx 1] cm_err 0.0545 tgt 0.0540 lr 2.00e-06 gnorm 0.011 decay 0.99 5.07s mem 56.4GB +step 3540/8000 cd 0.01227 (ema 0.00556) σ 1.0000→0.7500 [idx 0] cm_err 0.1098 tgt 0.1098 lr 2.00e-06 gnorm 0.362 decay 0.99 5.06s mem 56.4GB +step 3560/8000 cd 0.01495 (ema 0.00602) σ 1.0000→0.7500 [idx 0] cm_err 0.2028 tgt 0.1921 lr 2.00e-06 gnorm 0.379 decay 0.99 5.07s mem 56.4GB +step 3580/8000 cd 0.01725 (ema 0.00956) σ 1.0000→0.7500 [idx 0] cm_err 0.1335 tgt 0.1343 lr 2.00e-06 gnorm 0.423 decay 0.99 5.06s mem 56.4GB +step 3600/8000 cd 0.01223 (ema 0.00434) σ 1.0000→0.7500 [idx 0] cm_err 0.2895 tgt 0.2975 lr 2.00e-06 gnorm 0.274 decay 0.99 5.06s mem 56.4GB +step 3620/8000 cd 0.00057 (ema 0.00549) σ 0.5006→0.2516 [idx 2] cm_err 0.0389 tgt 0.0381 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 3640/8000 cd 0.00102 (ema 0.00493) σ 0.7500→0.5006 [idx 1] cm_err 0.0578 tgt 0.0571 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +step 3660/8000 cd 0.00063 (ema 0.00617) σ 0.5006→0.2516 [idx 2] cm_err 0.0686 tgt 0.0676 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +step 3680/8000 cd 0.01036 (ema 0.00494) σ 1.0000→0.7500 [idx 0] cm_err 0.1474 tgt 0.1425 lr 2.00e-06 gnorm 0.252 decay 0.99 5.06s mem 56.4GB +step 3700/8000 cd 0.00090 (ema 0.00475) σ 0.7500→0.5006 [idx 1] cm_err 0.0599 tgt 0.0586 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 3720/8000 cd 0.00102 (ema 0.00576) σ 0.7500→0.5006 [idx 1] cm_err 0.0527 tgt 0.0520 lr 2.00e-06 gnorm 0.015 decay 0.99 5.07s mem 56.4GB +step 3740/8000 cd 0.01570 (ema 0.00608) σ 1.0000→0.7500 [idx 0] cm_err 0.1554 tgt 0.1433 lr 2.00e-06 gnorm 0.423 decay 0.99 5.06s mem 56.4GB +step 3760/8000 cd 0.00087 (ema 0.00338) σ 0.7500→0.5006 [idx 1] cm_err 0.0849 tgt 0.0837 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 3780/8000 cd 0.00057 (ema 0.00339) σ 0.5006→0.2516 [idx 2] cm_err 0.0361 tgt 0.0352 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 3800/8000 cd 0.00115 (ema 0.00636) σ 0.7500→0.5006 [idx 1] cm_err 0.0530 tgt 0.0515 lr 2.00e-06 gnorm 0.039 decay 0.99 5.06s mem 56.4GB +step 3820/8000 cd 0.00108 (ema 0.00333) σ 0.7500→0.5006 [idx 1] cm_err 0.0544 tgt 0.0537 lr 2.00e-06 gnorm 0.027 decay 0.99 5.06s mem 56.4GB +step 3840/8000 cd 0.00117 (ema 0.00579) σ 0.7500→0.5006 [idx 1] cm_err 0.0614 tgt 0.0603 lr 2.00e-06 gnorm 0.044 decay 0.99 5.06s mem 56.4GB +step 3860/8000 cd 0.00102 (ema 0.00603) σ 0.7500→0.5006 [idx 1] cm_err 0.0817 tgt 0.0809 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 3880/8000 cd 0.00097 (ema 0.00513) σ 0.7500→0.5006 [idx 1] cm_err 0.1079 tgt 0.1065 lr 2.00e-06 gnorm 0.015 decay 0.99 5.07s mem 56.4GB +step 3900/8000 cd 0.00063 (ema 0.00597) σ 0.5006→0.2516 [idx 2] cm_err 0.0458 tgt 0.0444 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +step 3920/8000 cd 0.00053 (ema 0.00331) σ 0.5006→0.2516 [idx 2] cm_err 0.0515 tgt 0.0505 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 3940/8000 cd 0.01254 (ema 0.00365) σ 1.0000→0.7500 [idx 0] cm_err 0.1956 tgt 0.1865 lr 2.00e-06 gnorm 0.328 decay 0.99 5.05s mem 56.4GB +step 3960/8000 cd 0.00863 (ema 0.00822) σ 1.0000→0.7500 [idx 0] cm_err 0.0838 tgt 0.0850 lr 2.00e-06 gnorm 0.157 decay 0.99 5.06s mem 56.4GB +step 3980/8000 cd 0.00091 (ema 0.00281) σ 0.7500→0.5006 [idx 1] cm_err 0.0738 tgt 0.0730 lr 2.00e-06 gnorm 0.008 decay 0.99 5.08s mem 56.4GB +step 4000/8000 cd 0.00090 (ema 0.00496) σ 0.7500→0.5006 [idx 1] cm_err 0.0633 tgt 0.0625 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step4000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step4000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 4020/8000 cd 0.00051 (ema 0.00386) σ 0.5006→0.2516 [idx 2] cm_err 0.0357 tgt 0.0346 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 4040/8000 cd 0.01014 (ema 0.00502) σ 1.0000→0.7500 [idx 0] cm_err 0.0988 tgt 0.1023 lr 2.00e-06 gnorm 0.296 decay 0.99 5.06s mem 56.4GB +step 4060/8000 cd 0.00934 (ema 0.00425) σ 1.0000→0.7500 [idx 0] cm_err 0.1293 tgt 0.1352 lr 2.00e-06 gnorm 0.253 decay 0.99 5.06s mem 56.4GB +step 4080/8000 cd 0.00105 (ema 0.00602) σ 0.7500→0.5006 [idx 1] cm_err 0.0352 tgt 0.0341 lr 2.00e-06 gnorm 0.038 decay 0.99 5.06s mem 56.4GB +step 4100/8000 cd 0.02041 (ema 0.00503) σ 1.0000→0.7500 [idx 0] cm_err 0.2482 tgt 0.2569 lr 2.00e-06 gnorm 0.518 decay 0.99 5.06s mem 56.4GB +step 4120/8000 cd 0.00590 (ema 0.00486) σ 1.0000→0.7500 [idx 0] cm_err 0.0542 tgt 0.0534 lr 2.00e-06 gnorm 0.099 decay 0.99 5.06s mem 56.4GB +step 4140/8000 cd 0.00083 (ema 0.00194) σ 0.7500→0.5006 [idx 1] cm_err 0.0316 tgt 0.0314 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 4160/8000 cd 0.00051 (ema 0.00384) σ 0.5006→0.2516 [idx 2] cm_err 0.0284 tgt 0.0278 lr 2.00e-06 gnorm 0.008 decay 0.99 5.07s mem 56.4GB +step 4180/8000 cd 0.00049 (ema 0.00135) σ 0.5006→0.2516 [idx 2] cm_err 0.0447 tgt 0.0436 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 4200/8000 cd 0.01110 (ema 0.00632) σ 1.0000→0.7500 [idx 0] cm_err 0.0995 tgt 0.0954 lr 2.00e-06 gnorm 0.230 decay 0.99 5.06s mem 56.4GB +step 4220/8000 cd 0.00096 (ema 0.00681) σ 0.7500→0.5006 [idx 1] cm_err 0.0742 tgt 0.0731 lr 2.00e-06 gnorm 0.020 decay 0.99 5.06s mem 56.4GB +step 4240/8000 cd 0.00061 (ema 0.00659) σ 0.5006→0.2516 [idx 2] cm_err 0.0606 tgt 0.0592 lr 2.00e-06 gnorm 0.011 decay 0.99 5.07s mem 56.4GB +step 4260/8000 cd 0.00106 (ema 0.00630) σ 0.7500→0.5006 [idx 1] cm_err 0.0440 tgt 0.0434 lr 2.00e-06 gnorm 0.047 decay 0.99 5.06s mem 56.4GB +step 4280/8000 cd 0.00065 (ema 0.00436) σ 0.5006→0.2516 [idx 2] cm_err 0.0715 tgt 0.0705 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 4300/8000 cd 0.00083 (ema 0.00235) σ 0.7500→0.5006 [idx 1] cm_err 0.0599 tgt 0.0591 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 4320/8000 cd 0.00990 (ema 0.00652) σ 1.0000→0.7500 [idx 0] cm_err 0.1270 tgt 0.1208 lr 2.00e-06 gnorm 0.287 decay 0.99 5.06s mem 56.4GB +step 4340/8000 cd 0.00056 (ema 0.00520) σ 0.5006→0.2516 [idx 2] cm_err 0.0478 tgt 0.0471 lr 2.00e-06 gnorm 0.007 decay 0.99 5.07s mem 56.4GB +step 4360/8000 cd 0.01104 (ema 0.00470) σ 1.0000→0.7500 [idx 0] cm_err 0.1553 tgt 0.1575 lr 2.00e-06 gnorm 0.345 decay 0.99 5.06s mem 56.4GB +step 4380/8000 cd 0.00166 (ema 0.00472) σ 0.7500→0.5006 [idx 1] cm_err 0.0569 tgt 0.0557 lr 2.00e-06 gnorm 0.067 decay 0.99 5.06s mem 56.4GB +step 4400/8000 cd 0.00093 (ema 0.00406) σ 0.7500→0.5006 [idx 1] cm_err 0.0796 tgt 0.0789 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 4420/8000 cd 0.00049 (ema 0.00351) σ 0.5006→0.2516 [idx 2] cm_err 0.0505 tgt 0.0496 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 4440/8000 cd 0.01184 (ema 0.00279) σ 1.0000→0.7500 [idx 0] cm_err 0.2598 tgt 0.2582 lr 2.00e-06 gnorm 0.277 decay 0.99 5.07s mem 56.4GB +step 4460/8000 cd 0.00090 (ema 0.00492) σ 0.7500→0.5006 [idx 1] cm_err 0.0466 tgt 0.0454 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +step 4480/8000 cd 0.00082 (ema 0.00312) σ 0.7500→0.5006 [idx 1] cm_err 0.0606 tgt 0.0602 lr 2.00e-06 gnorm 0.024 decay 0.99 5.07s mem 56.4GB +step 4500/8000 cd 0.01178 (ema 0.00317) σ 1.0000→0.7500 [idx 0] cm_err 0.1905 tgt 0.2081 lr 2.00e-06 gnorm 0.304 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step4500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step4500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 4520/8000 cd 0.00098 (ema 0.00445) σ 0.7500→0.5006 [idx 1] cm_err 0.0543 tgt 0.0535 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +step 4540/8000 cd 0.00088 (ema 0.00255) σ 0.7500→0.5006 [idx 1] cm_err 0.0553 tgt 0.0549 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 4560/8000 cd 0.01320 (ema 0.00844) σ 1.0000→0.7500 [idx 0] cm_err 0.1088 tgt 0.1053 lr 2.00e-06 gnorm 0.342 decay 0.99 5.07s mem 56.4GB +step 4580/8000 cd 0.00098 (ema 0.00494) σ 0.7500→0.5006 [idx 1] cm_err 0.0585 tgt 0.0576 lr 2.00e-06 gnorm 0.031 decay 0.99 5.06s mem 56.4GB +step 4600/8000 cd 0.01044 (ema 0.00357) σ 1.0000→0.7500 [idx 0] cm_err 0.2378 tgt 0.2290 lr 2.00e-06 gnorm 0.227 decay 0.99 5.06s mem 56.4GB +step 4620/8000 cd 0.00082 (ema 0.00407) σ 0.7500→0.5006 [idx 1] cm_err 0.0815 tgt 0.0803 lr 2.00e-06 gnorm 0.015 decay 0.99 5.07s mem 56.4GB +step 4640/8000 cd 0.00059 (ema 0.00441) σ 0.5006→0.2516 [idx 2] cm_err 0.0419 tgt 0.0410 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 4660/8000 cd 0.01260 (ema 0.00903) σ 1.0000→0.7500 [idx 0] cm_err 0.2888 tgt 0.2917 lr 2.00e-06 gnorm 0.275 decay 0.99 5.06s mem 56.4GB +step 4680/8000 cd 0.00084 (ema 0.00365) σ 0.7500→0.5006 [idx 1] cm_err 0.0414 tgt 0.0408 lr 2.00e-06 gnorm 0.020 decay 0.99 5.05s mem 56.4GB +step 4700/8000 cd 0.01073 (ema 0.00275) σ 1.0000→0.7500 [idx 0] cm_err 0.2724 tgt 0.2789 lr 2.00e-06 gnorm 0.198 decay 0.99 5.06s mem 56.4GB +step 4720/8000 cd 0.00106 (ema 0.00331) σ 0.7500→0.5006 [idx 1] cm_err 0.0882 tgt 0.0871 lr 2.00e-06 gnorm 0.029 decay 0.99 5.06s mem 56.4GB +step 4740/8000 cd 0.00098 (ema 0.00419) σ 0.7500→0.5006 [idx 1] cm_err 0.0597 tgt 0.0590 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 4760/8000 cd 0.00087 (ema 0.00275) σ 0.7500→0.5006 [idx 1] cm_err 0.0468 tgt 0.0461 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 4780/8000 cd 0.00046 (ema 0.00459) σ 0.5006→0.2516 [idx 2] cm_err 0.0442 tgt 0.0430 lr 2.00e-06 gnorm 0.006 decay 0.99 5.05s mem 56.4GB +step 4800/8000 cd 0.00107 (ema 0.00555) σ 0.7500→0.5006 [idx 1] cm_err 0.0837 tgt 0.0817 lr 2.00e-06 gnorm 0.028 decay 0.99 5.07s mem 56.4GB +step 4820/8000 cd 0.00057 (ema 0.00439) σ 0.5006→0.2516 [idx 2] cm_err 0.0554 tgt 0.0542 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +step 4840/8000 cd 0.00095 (ema 0.00263) σ 0.7500→0.5006 [idx 1] cm_err 0.0713 tgt 0.0703 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 4860/8000 cd 0.00094 (ema 0.00579) σ 0.7500→0.5006 [idx 1] cm_err 0.0647 tgt 0.0637 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +step 4880/8000 cd 0.00137 (ema 0.00566) σ 0.7500→0.5006 [idx 1] cm_err 0.0606 tgt 0.0587 lr 2.00e-06 gnorm 0.068 decay 0.99 5.06s mem 56.4GB +step 4900/8000 cd 0.00117 (ema 0.00430) σ 0.7500→0.5006 [idx 1] cm_err 0.0939 tgt 0.0924 lr 2.00e-06 gnorm 0.024 decay 0.99 5.06s mem 56.4GB +step 4920/8000 cd 0.00086 (ema 0.00368) σ 0.7500→0.5006 [idx 1] cm_err 0.1211 tgt 0.1198 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +step 4940/8000 cd 0.00094 (ema 0.00267) σ 0.7500→0.5006 [idx 1] cm_err 0.0603 tgt 0.0596 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +step 4960/8000 cd 0.00056 (ema 0.00259) σ 0.5006→0.2516 [idx 2] cm_err 0.0395 tgt 0.0387 lr 2.00e-06 gnorm 0.004 decay 0.99 5.07s mem 56.4GB +step 4980/8000 cd 0.00054 (ema 0.00462) σ 0.5006→0.2516 [idx 2] cm_err 0.0781 tgt 0.0773 lr 2.00e-06 gnorm 0.007 decay 0.99 5.06s mem 56.4GB +step 5000/8000 cd 0.01469 (ema 0.00685) σ 1.0000→0.7500 [idx 0] cm_err 0.2082 tgt 0.2092 lr 2.00e-06 gnorm 0.407 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step5000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step5000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 5020/8000 cd 0.00056 (ema 0.00336) σ 0.5006→0.2516 [idx 2] cm_err 0.0483 tgt 0.0476 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +step 5040/8000 cd 0.01108 (ema 0.00550) σ 1.0000→0.7500 [idx 0] cm_err 0.1684 tgt 0.1651 lr 2.00e-06 gnorm 0.264 decay 0.99 5.05s mem 56.4GB +step 5060/8000 cd 0.01288 (ema 0.00797) σ 1.0000→0.7500 [idx 0] cm_err 0.3076 tgt 0.3028 lr 2.00e-06 gnorm 0.239 decay 0.99 5.06s mem 56.4GB +step 5080/8000 cd 0.01043 (ema 0.00602) σ 1.0000→0.7500 [idx 0] cm_err 0.1665 tgt 0.1703 lr 2.00e-06 gnorm 0.273 decay 0.99 5.06s mem 56.4GB +step 5100/8000 cd 0.00077 (ema 0.00344) σ 0.7500→0.5006 [idx 1] cm_err 0.0708 tgt 0.0704 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 5120/8000 cd 0.00893 (ema 0.00363) σ 1.0000→0.7500 [idx 0] cm_err 0.2257 tgt 0.2337 lr 2.00e-06 gnorm 0.184 decay 0.99 5.08s mem 56.4GB +step 5140/8000 cd 0.00050 (ema 0.00207) σ 0.5006→0.2516 [idx 2] cm_err 0.0431 tgt 0.0425 lr 2.00e-06 gnorm 0.006 decay 0.99 5.05s mem 56.4GB +step 5160/8000 cd 0.00096 (ema 0.00261) σ 0.7500→0.5006 [idx 1] cm_err 0.0654 tgt 0.0646 lr 2.00e-06 gnorm 0.015 decay 0.99 5.06s mem 56.4GB +step 5180/8000 cd 0.00051 (ema 0.00195) σ 0.5006→0.2516 [idx 2] cm_err 0.0429 tgt 0.0420 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 5200/8000 cd 0.01234 (ema 0.00374) σ 1.0000→0.7500 [idx 0] cm_err 0.1777 tgt 0.1777 lr 2.00e-06 gnorm 0.307 decay 0.99 5.05s mem 56.4GB +step 5220/8000 cd 0.00085 (ema 0.00240) σ 0.7500→0.5006 [idx 1] cm_err 0.0767 tgt 0.0761 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +step 5240/8000 cd 0.00121 (ema 0.00545) σ 0.7500→0.5006 [idx 1] cm_err 0.0548 tgt 0.0531 lr 2.00e-06 gnorm 0.044 decay 0.99 5.06s mem 56.4GB +step 5260/8000 cd 0.00092 (ema 0.00284) σ 0.7500→0.5006 [idx 1] cm_err 0.0742 tgt 0.0728 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 5280/8000 cd 0.00084 (ema 0.00456) σ 0.7500→0.5006 [idx 1] cm_err 0.0463 tgt 0.0455 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +step 5300/8000 cd 0.01331 (ema 0.00397) σ 1.0000→0.7500 [idx 0] cm_err 0.2281 tgt 0.2382 lr 2.00e-06 gnorm 0.292 decay 0.99 5.06s mem 56.4GB +step 5320/8000 cd 0.00104 (ema 0.00478) σ 0.7500→0.5006 [idx 1] cm_err 0.0573 tgt 0.0561 lr 2.00e-06 gnorm 0.059 decay 0.99 5.07s mem 56.4GB +step 5340/8000 cd 0.00136 (ema 0.00744) σ 0.7500→0.5006 [idx 1] cm_err 0.0685 tgt 0.0673 lr 2.00e-06 gnorm 0.054 decay 0.99 5.07s mem 56.4GB +step 5360/8000 cd 0.01140 (ema 0.00500) σ 1.0000→0.7500 [idx 0] cm_err 0.0994 tgt 0.1027 lr 2.00e-06 gnorm 0.212 decay 0.99 5.06s mem 56.4GB +step 5380/8000 cd 0.00086 (ema 0.00275) σ 0.7500→0.5006 [idx 1] cm_err 0.0347 tgt 0.0343 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 5400/8000 cd 0.00776 (ema 0.00415) σ 1.0000→0.7500 [idx 0] cm_err 0.1232 tgt 0.1185 lr 2.00e-06 gnorm 0.185 decay 0.99 5.06s mem 56.4GB +step 5420/8000 cd 0.00052 (ema 0.00297) σ 0.5006→0.2516 [idx 2] cm_err 0.0369 tgt 0.0363 lr 2.00e-06 gnorm 0.009 decay 0.99 6.20s mem 56.4GB +step 5440/8000 cd 0.00079 (ema 0.00389) σ 0.7500→0.5006 [idx 1] cm_err 0.0198 tgt 0.0196 lr 2.00e-06 gnorm 0.009 decay 0.99 5.09s mem 56.4GB +step 5460/8000 cd 0.00139 (ema 0.00482) σ 0.7500→0.5006 [idx 1] cm_err 0.0516 tgt 0.0505 lr 2.00e-06 gnorm 0.055 decay 0.99 5.06s mem 56.4GB +step 5480/8000 cd 0.00044 (ema 0.00272) σ 0.5006→0.2516 [idx 2] cm_err 0.0682 tgt 0.0673 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 5500/8000 cd 0.01257 (ema 0.00361) σ 1.0000→0.7500 [idx 0] cm_err 0.1372 tgt 0.1424 lr 2.00e-06 gnorm 0.329 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step5500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step5500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 5520/8000 cd 0.00129 (ema 0.00401) σ 0.7500→0.5006 [idx 1] cm_err 0.0618 tgt 0.0609 lr 2.00e-06 gnorm 0.046 decay 0.99 5.07s mem 56.4GB +step 5540/8000 cd 0.00112 (ema 0.00503) σ 0.7500→0.5006 [idx 1] cm_err 0.0766 tgt 0.0760 lr 2.00e-06 gnorm 0.041 decay 0.99 5.07s mem 56.4GB +step 5560/8000 cd 0.00060 (ema 0.00512) σ 0.5006→0.2516 [idx 2] cm_err 0.0509 tgt 0.0496 lr 2.00e-06 gnorm 0.011 decay 0.99 5.05s mem 56.4GB +step 5580/8000 cd 0.01663 (ema 0.00585) σ 1.0000→0.7500 [idx 0] cm_err 0.1580 tgt 0.1557 lr 2.00e-06 gnorm 0.449 decay 0.99 5.06s mem 56.4GB +step 5600/8000 cd 0.00106 (ema 0.00448) σ 0.7500→0.5006 [idx 1] cm_err 0.0521 tgt 0.0516 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +step 5620/8000 cd 0.00087 (ema 0.00497) σ 0.7500→0.5006 [idx 1] cm_err 0.0438 tgt 0.0432 lr 2.00e-06 gnorm 0.020 decay 0.99 5.06s mem 56.4GB +step 5640/8000 cd 0.01473 (ema 0.00912) σ 1.0000→0.7500 [idx 0] cm_err 0.2025 tgt 0.2012 lr 2.00e-06 gnorm 0.324 decay 0.99 5.06s mem 56.4GB +step 5660/8000 cd 0.00058 (ema 0.00500) σ 0.5006→0.2516 [idx 2] cm_err 0.0513 tgt 0.0504 lr 2.00e-06 gnorm 0.014 decay 0.99 5.05s mem 56.4GB +step 5680/8000 cd 0.01229 (ema 0.00385) σ 1.0000→0.7500 [idx 0] cm_err 0.1477 tgt 0.1402 lr 2.00e-06 gnorm 0.321 decay 0.99 5.07s mem 56.4GB +step 5700/8000 cd 0.00948 (ema 0.00400) σ 1.0000→0.7500 [idx 0] cm_err 0.1595 tgt 0.1634 lr 2.00e-06 gnorm 0.185 decay 0.99 5.06s mem 56.4GB +step 5720/8000 cd 0.00050 (ema 0.00161) σ 0.5006→0.2516 [idx 2] cm_err 0.0327 tgt 0.0320 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +step 5740/8000 cd 0.00048 (ema 0.00313) σ 0.5006→0.2516 [idx 2] cm_err 0.0554 tgt 0.0544 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +step 5760/8000 cd 0.00053 (ema 0.00332) σ 0.5006→0.2516 [idx 2] cm_err 0.0427 tgt 0.0418 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 5780/8000 cd 0.00056 (ema 0.00496) σ 0.5006→0.2516 [idx 2] cm_err 0.0194 tgt 0.0187 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +step 5800/8000 cd 0.00081 (ema 0.00638) σ 0.7500→0.5006 [idx 1] cm_err 0.0556 tgt 0.0548 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +step 5820/8000 cd 0.00099 (ema 0.00298) σ 0.7500→0.5006 [idx 1] cm_err 0.0783 tgt 0.0768 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 5840/8000 cd 0.00108 (ema 0.00467) σ 0.7500→0.5006 [idx 1] cm_err 0.0750 tgt 0.0742 lr 2.00e-06 gnorm 0.040 decay 0.99 5.07s mem 56.4GB +step 5860/8000 cd 0.00099 (ema 0.00541) σ 0.7500→0.5006 [idx 1] cm_err 0.0664 tgt 0.0660 lr 2.00e-06 gnorm 0.046 decay 0.99 5.06s mem 56.4GB +step 5880/8000 cd 0.01138 (ema 0.00470) σ 1.0000→0.7500 [idx 0] cm_err 0.1302 tgt 0.1294 lr 2.00e-06 gnorm 0.261 decay 0.99 5.06s mem 56.4GB +step 5900/8000 cd 0.01493 (ema 0.00483) σ 1.0000→0.7500 [idx 0] cm_err 0.2021 tgt 0.2025 lr 2.00e-06 gnorm 0.381 decay 0.99 5.05s mem 56.4GB +step 5920/8000 cd 0.00094 (ema 0.00359) σ 0.7500→0.5006 [idx 1] cm_err 0.1049 tgt 0.1035 lr 2.00e-06 gnorm 0.021 decay 0.99 5.07s mem 56.4GB +step 5940/8000 cd 0.01159 (ema 0.00328) σ 1.0000→0.7500 [idx 0] cm_err 0.2350 tgt 0.2379 lr 2.00e-06 gnorm 0.223 decay 0.99 5.05s mem 56.4GB +step 5960/8000 cd 0.00958 (ema 0.00297) σ 1.0000→0.7500 [idx 0] cm_err 0.2493 tgt 0.2507 lr 2.00e-06 gnorm 0.222 decay 0.99 5.06s mem 56.4GB +step 5980/8000 cd 0.00106 (ema 0.00426) σ 0.7500→0.5006 [idx 1] cm_err 0.0427 tgt 0.0422 lr 2.00e-06 gnorm 0.028 decay 0.99 5.06s mem 56.4GB +step 6000/8000 cd 0.01442 (ema 0.00680) σ 1.0000→0.7500 [idx 0] cm_err 0.1174 tgt 0.1134 lr 2.00e-06 gnorm 0.321 decay 0.99 5.05s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step6000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step6000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 6020/8000 cd 0.00077 (ema 0.00584) σ 0.7500→0.5006 [idx 1] cm_err 0.0320 tgt 0.0313 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +step 6040/8000 cd 0.00056 (ema 0.00432) σ 0.5006→0.2516 [idx 2] cm_err 0.0347 tgt 0.0337 lr 2.00e-06 gnorm 0.008 decay 0.99 5.05s mem 56.4GB +step 6060/8000 cd 0.00058 (ema 0.00469) σ 0.5006→0.2516 [idx 2] cm_err 0.0405 tgt 0.0396 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +step 6080/8000 cd 0.00055 (ema 0.00581) σ 0.5006→0.2516 [idx 2] cm_err 0.0359 tgt 0.0347 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +step 6100/8000 cd 0.00058 (ema 0.00308) σ 0.5006→0.2516 [idx 2] cm_err 0.0664 tgt 0.0650 lr 2.00e-06 gnorm 0.009 decay 0.99 5.05s mem 56.4GB +step 6120/8000 cd 0.00104 (ema 0.00364) σ 0.7500→0.5006 [idx 1] cm_err 0.0621 tgt 0.0608 lr 2.00e-06 gnorm 0.023 decay 0.99 5.07s mem 56.4GB +step 6140/8000 cd 0.01080 (ema 0.00607) σ 1.0000→0.7500 [idx 0] cm_err 0.1918 tgt 0.1914 lr 2.00e-06 gnorm 0.212 decay 0.99 5.07s mem 56.4GB +step 6160/8000 cd 0.01188 (ema 0.00819) σ 1.0000→0.7500 [idx 0] cm_err 0.2502 tgt 0.2539 lr 2.00e-06 gnorm 0.237 decay 0.99 5.06s mem 56.4GB +step 6180/8000 cd 0.00133 (ema 0.00517) σ 0.7500→0.5006 [idx 1] cm_err 0.0589 tgt 0.0582 lr 2.00e-06 gnorm 0.055 decay 0.99 5.07s mem 56.4GB +step 6200/8000 cd 0.00051 (ema 0.00344) σ 0.5006→0.2516 [idx 2] cm_err 0.0405 tgt 0.0398 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 6220/8000 cd 0.00091 (ema 0.00231) σ 0.7500→0.5006 [idx 1] cm_err 0.0503 tgt 0.0493 lr 2.00e-06 gnorm 0.034 decay 0.99 5.06s mem 56.4GB +step 6240/8000 cd 0.00088 (ema 0.00500) σ 0.7500→0.5006 [idx 1] cm_err 0.0713 tgt 0.0706 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 6260/8000 cd 0.00125 (ema 0.00526) σ 0.7500→0.5006 [idx 1] cm_err 0.0484 tgt 0.0469 lr 2.00e-06 gnorm 0.066 decay 0.99 5.06s mem 56.4GB +step 6280/8000 cd 0.00053 (ema 0.00449) σ 0.5006→0.2516 [idx 2] cm_err 0.0580 tgt 0.0572 lr 2.00e-06 gnorm 0.005 decay 0.99 5.05s mem 56.4GB +step 6300/8000 cd 0.00055 (ema 0.00501) σ 0.5006→0.2516 [idx 2] cm_err 0.0422 tgt 0.0411 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +step 6320/8000 cd 0.00839 (ema 0.00393) σ 1.0000→0.7500 [idx 0] cm_err 0.0791 tgt 0.0784 lr 2.00e-06 gnorm 0.178 decay 0.99 5.05s mem 56.4GB +step 6340/8000 cd 0.00142 (ema 0.00283) σ 0.7500→0.5006 [idx 1] cm_err 0.0793 tgt 0.0774 lr 2.00e-06 gnorm 0.050 decay 0.99 5.06s mem 56.4GB +step 6360/8000 cd 0.01346 (ema 0.00543) σ 1.0000→0.7500 [idx 0] cm_err 0.1882 tgt 0.1928 lr 2.00e-06 gnorm 0.323 decay 0.99 5.07s mem 56.4GB +step 6380/8000 cd 0.00084 (ema 0.00352) σ 0.7500→0.5006 [idx 1] cm_err 0.0474 tgt 0.0467 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 6400/8000 cd 0.00049 (ema 0.00451) σ 0.5006→0.2516 [idx 2] cm_err 0.0577 tgt 0.0564 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 6420/8000 cd 0.00052 (ema 0.00428) σ 0.5006→0.2516 [idx 2] cm_err 0.0665 tgt 0.0654 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 6440/8000 cd 0.01540 (ema 0.00701) σ 1.0000→0.7500 [idx 0] cm_err 0.2276 tgt 0.2388 lr 2.00e-06 gnorm 0.285 decay 0.99 5.06s mem 56.4GB +step 6460/8000 cd 0.00119 (ema 0.00556) σ 0.7500→0.5006 [idx 1] cm_err 0.0688 tgt 0.0668 lr 2.00e-06 gnorm 0.029 decay 0.99 5.06s mem 56.4GB +step 6480/8000 cd 0.00057 (ema 0.00390) σ 0.5006→0.2516 [idx 2] cm_err 0.0660 tgt 0.0646 lr 2.00e-06 gnorm 0.007 decay 0.99 5.07s mem 56.4GB +step 6500/8000 cd 0.00676 (ema 0.00373) σ 1.0000→0.7500 [idx 0] cm_err 0.1278 tgt 0.1353 lr 2.00e-06 gnorm 0.132 decay 0.99 5.07s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step6500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step6500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 6520/8000 cd 0.00112 (ema 0.00632) σ 0.7500→0.5006 [idx 1] cm_err 0.0622 tgt 0.0609 lr 2.00e-06 gnorm 0.034 decay 0.99 5.06s mem 56.4GB +step 6540/8000 cd 0.00988 (ema 0.00446) σ 1.0000→0.7500 [idx 0] cm_err 0.0971 tgt 0.0896 lr 2.00e-06 gnorm 0.184 decay 0.99 5.06s mem 56.4GB +step 6560/8000 cd 0.00088 (ema 0.00271) σ 0.7500→0.5006 [idx 1] cm_err 0.0621 tgt 0.0610 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +step 6580/8000 cd 0.01266 (ema 0.00320) σ 1.0000→0.7500 [idx 0] cm_err 0.1525 tgt 0.1590 lr 2.00e-06 gnorm 0.334 decay 0.99 5.06s mem 56.4GB +step 6600/8000 cd 0.00090 (ema 0.00284) σ 0.7500→0.5006 [idx 1] cm_err 0.0618 tgt 0.0610 lr 2.00e-06 gnorm 0.015 decay 0.99 5.06s mem 56.4GB +step 6620/8000 cd 0.00048 (ema 0.00296) σ 0.5006→0.2516 [idx 2] cm_err 0.0370 tgt 0.0362 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +step 6640/8000 cd 0.01536 (ema 0.00645) σ 1.0000→0.7500 [idx 0] cm_err 0.1734 tgt 0.1719 lr 2.00e-06 gnorm 0.373 decay 0.99 5.07s mem 56.4GB +step 6660/8000 cd 0.00121 (ema 0.00425) σ 0.7500→0.5006 [idx 1] cm_err 0.0752 tgt 0.0739 lr 2.00e-06 gnorm 0.054 decay 0.99 5.06s mem 56.4GB +step 6680/8000 cd 0.00047 (ema 0.00204) σ 0.5006→0.2516 [idx 2] cm_err 0.0549 tgt 0.0538 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +step 6700/8000 cd 0.01336 (ema 0.00589) σ 1.0000→0.7500 [idx 0] cm_err 0.2160 tgt 0.2173 lr 2.00e-06 gnorm 0.294 decay 0.99 5.06s mem 56.4GB +step 6720/8000 cd 0.00046 (ema 0.00477) σ 0.5006→0.2516 [idx 2] cm_err 0.0496 tgt 0.0485 lr 2.00e-06 gnorm 0.004 decay 0.99 5.05s mem 56.4GB +step 6740/8000 cd 0.00955 (ema 0.00533) σ 1.0000→0.7500 [idx 0] cm_err 0.2307 tgt 0.2325 lr 2.00e-06 gnorm 0.216 decay 0.99 5.06s mem 56.4GB +step 6760/8000 cd 0.00058 (ema 0.00384) σ 0.5006→0.2516 [idx 2] cm_err 0.0435 tgt 0.0423 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +step 6780/8000 cd 0.00053 (ema 0.00415) σ 0.5006→0.2516 [idx 2] cm_err 0.0400 tgt 0.0389 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 6800/8000 cd 0.01733 (ema 0.00754) σ 1.0000→0.7500 [idx 0] cm_err 0.2233 tgt 0.2111 lr 2.00e-06 gnorm 0.346 decay 0.99 5.05s mem 56.4GB +step 6820/8000 cd 0.00127 (ema 0.00488) σ 0.7500→0.5006 [idx 1] cm_err 0.0711 tgt 0.0698 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +step 6840/8000 cd 0.01192 (ema 0.00530) σ 1.0000→0.7500 [idx 0] cm_err 0.2127 tgt 0.2123 lr 2.00e-06 gnorm 0.245 decay 0.99 5.06s mem 56.4GB +step 6860/8000 cd 0.00842 (ema 0.00579) σ 1.0000→0.7500 [idx 0] cm_err 0.1606 tgt 0.1612 lr 2.00e-06 gnorm 0.154 decay 0.99 5.06s mem 56.4GB +step 6880/8000 cd 0.00131 (ema 0.00435) σ 0.7500→0.5006 [idx 1] cm_err 0.0491 tgt 0.0476 lr 2.00e-06 gnorm 0.034 decay 0.99 5.07s mem 56.4GB +step 6900/8000 cd 0.01266 (ema 0.00535) σ 1.0000→0.7500 [idx 0] cm_err 0.1372 tgt 0.1378 lr 2.00e-06 gnorm 0.283 decay 0.99 5.06s mem 56.4GB +step 6920/8000 cd 0.00098 (ema 0.00694) σ 0.7500→0.5006 [idx 1] cm_err 0.1273 tgt 0.1259 lr 2.00e-06 gnorm 0.021 decay 0.99 5.06s mem 56.4GB +step 6940/8000 cd 0.00053 (ema 0.00307) σ 0.5006→0.2516 [idx 2] cm_err 0.0327 tgt 0.0319 lr 2.00e-06 gnorm 0.008 decay 0.99 5.08s mem 56.4GB +step 6960/8000 cd 0.01088 (ema 0.00377) σ 1.0000→0.7500 [idx 0] cm_err 0.1689 tgt 0.1653 lr 2.00e-06 gnorm 0.301 decay 0.99 5.06s mem 56.4GB +step 6980/8000 cd 0.01076 (ema 0.00451) σ 1.0000→0.7500 [idx 0] cm_err 0.1134 tgt 0.1148 lr 2.00e-06 gnorm 0.223 decay 0.99 5.05s mem 56.4GB +step 7000/8000 cd 0.00065 (ema 0.00490) σ 0.5006→0.2516 [idx 2] cm_err 0.0461 tgt 0.0447 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step7000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step7000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +W0910 11:47:43.293000 1467387 .venv/lib/python3.12/site-packages/torch/distributed/elastic/agent/server/api.py:739] Received 15 death signal, shutting down workers +Traceback (most recent call last): + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/accelerate", line 6, in + sys.exit(main()) + ^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/accelerate/commands/accelerate_cli.py", line 50, in main + args.func(args) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/accelerate/commands/launch.py", line 1392, in launch_command + deepspeed_launcher(args) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/accelerate/commands/launch.py", line 1076, in deepspeed_launcher + distrib_run.run(args) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/run.py", line 981, in run + elastic_launch( + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/launcher/api.py", line 170, in __call__ + return launch_agent(self._config, self._entrypoint, list(args)) + ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/launcher/api.py", line 308, in launch_agent + result = agent.run() + ^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/metrics/api.py", line 134, in wrapper + result = f(*args, **kwargs) + ^^^^^^^^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/agent/server/api.py", line 731, in run + result = self._invoke_run(role) + ^^^^^^^^^^^^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/agent/server/api.py", line 908, in _invoke_run + time.sleep(monitor_interval) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/multiprocessing/api.py", line 86, in _terminate_process_handler + raise SignalException(f"Process {os.getpid()} got signal: {sigval}", sigval=sigval) +torch.distributed.elastic.multiprocessing.api.SignalException: Process 1467387 got signal: 15 diff --git a/backup_2026-09-14/runs/distill__stage2_cd/progress.json b/backup_2026-09-14/runs/distill__stage2_cd/progress.json new file mode 100644 index 0000000000000000000000000000000000000000..f9fd27bc2fda7ec986d52ed73f7a587f4bc8eb0b --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage2_cd/progress.json @@ -0,0 +1 @@ +{"step": 7000, "wall": 1789040803.7785752, "time": "2026-09-10 11:46:43", "stage": "stage2_cd", "loss": 0.0006539164460264146, "micro": 7000, "grad_accum": 1, "axis_sigmas": [1.0, 0.75, 0.5006, 0.251597], "deploy": "ema/ema_step7000.safetensors"} \ No newline at end of file diff --git a/backup_2026-09-14/runs/distill__stage2_cd/stdout.log b/backup_2026-09-14/runs/distill__stage2_cd/stdout.log new file mode 100644 index 0000000000000000000000000000000000000000..605f184f000d41224c3c5c00c0c945b2b5ad909c --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage2_cd/stdout.log @@ -0,0 +1,1144 @@ +[guard] GPU 0,1,2,3,4,5,6,7 空闲(每张 <= 500 MiB),可以启动。 +[stage2] teacher = student init = /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors (P1:同一份 stage1 产物) +[stage2] out=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd port=29532 cfg=accelerate_zero2_8gpu_ga1.yaml 等效 batch=8 +[stage2] axis=deploy denoise_list=1000,750,500,250 solver=1 cfg_scale=1.0 +[stage2] lr=2e-6 betas=0.0,0.999 warmup=100 clip=10.0 max_steps=8000 ema=0.99@200 +[stage2] 产物 = /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step{N}.safetensors(部署 + stage3 的 --student_ckpt);dits/ 只为续训 +=== stage2_cd | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd world=8 dist=DistributedType.DEEPSPEED mp=bf16 === +[recipe] teacher_causal=1 tf=True windowed=0/0 cfg=1.0 ema=0.99@200 lr=2e-06 betas=(0.0, 0.999) wd=0.0 warmup=100 clip=10.0 bs=1×accum1×8卡 ⇒ 等效 batch 8 max_steps=8000 gc=True +[axis] deploy_schedule([1000.0, 750.0, 500.0, 250.0]) → grid idx [0, 625, 833, 937] K=4(3 对一致性) +[axis] sigma = [1.0, 0.75, 0.5006, 0.251597] +[axis] t = [1000.0, 750.0, 500.6, 251.597] +[axis] Δsigma= [-0.25, -0.2494, -0.249002] 教师 Euler 子步 = 1 +[axis] 部署采样表 [1000.0, 750.0, 500.0, 250.0] → sigma [1.0, 0.75, 0.5006, 0.251597](逐点都是轴上的节点) +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +[AropeLatentDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx: 20983 个 .pt,sidecar 缺失 0,valid=False 剔除 1,src 在 val_eybx 的转场剔除 257,rt_ratio<0.8 剔除 2197,可用 18528;text_mode=scene,文本表 361 键,scene_dropout=0.0 +[data] train 18528 clip(scene_dropout=0.0,CD 不做 CFG 所以是 0) +[resume] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd 里没有 progress.json,从头开始 +[ckpt] dit_step1000.safetensors metadata: stage=stage1_ar_tf step=1000 teacher_forcing=True windowed_train=0 +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] student ← /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors(827 个张量,缺 []) +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] teacher ← /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors(causal=True,827 个张量,缺 []) +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] 三份 AropeDiT 各 4,999,803,072 参数;构建 18s +[guard] 三模型就位:student(ZeRO-2, bf16) / teacher(bf16 冻结, 未 prepare) / ema(fp32 影子, 未 prepare),各 827 个参数张量,freqs 都在 cuda:0 +[env] grad_clip=10.0(DeepSpeed 生效值 10.0) +[train] 从 step 0 到 8000 +[2026-09-10 01:43:12,484] [WARNING] [torch_autocast.py:122:autocast_if_enabled] torch.autocast is enabled outside DeepSpeed but disabled within the DeepSpeed engine. If you are using DeepSpeed's built-in mixed precision, the engine will follow the settings in bf16/fp16 section. To use torch's native autocast instead, configure the `torch_autocast` section in the DeepSpeed config. +step 20/8000 cd 0.01828 (ema 0.01584) σ 1.0000→0.7500 [idx 0] cm_err 0.0972 tgt 0.1121 lr 4.00e-07 gnorm 0.367 decay 0.00 5.06s mem 56.4GB +step 40/8000 cd 0.00341 (ema 0.01071) σ 0.7500→0.5006 [idx 1] cm_err 0.0469 tgt 0.0487 lr 8.00e-07 gnorm 0.065 decay 0.00 5.05s mem 56.4GB +step 60/8000 cd 0.00329 (ema 0.00673) σ 0.7500→0.5006 [idx 1] cm_err 0.0481 tgt 0.0508 lr 1.20e-06 gnorm 0.055 decay 0.00 5.06s mem 56.4GB +step 80/8000 cd 0.03503 (ema 0.01108) σ 1.0000→0.7500 [idx 0] cm_err 0.2447 tgt 0.2350 lr 1.60e-06 gnorm 1.374 decay 0.00 5.24s mem 56.4GB +step 100/8000 cd 0.02229 (ema 0.01106) σ 1.0000→0.7500 [idx 0] cm_err 0.3274 tgt 0.3253 lr 2.00e-06 gnorm 0.636 decay 0.00 5.05s mem 56.4GB +step 120/8000 cd 0.00105 (ema 0.00848) σ 0.5006→0.2516 [idx 2] cm_err 0.0424 tgt 0.0437 lr 2.00e-06 gnorm 0.022 decay 0.00 5.06s mem 56.4GB +step 140/8000 cd 0.00108 (ema 0.00717) σ 0.5006→0.2516 [idx 2] cm_err 0.0518 tgt 0.0508 lr 2.00e-06 gnorm 0.030 decay 0.00 5.07s mem 56.4GB +step 160/8000 cd 0.02082 (ema 0.01003) σ 1.0000→0.7500 [idx 0] cm_err 0.1552 tgt 0.1442 lr 2.00e-06 gnorm 0.694 decay 0.00 5.06s mem 56.4GB +step 180/8000 cd 0.01940 (ema 0.00856) σ 1.0000→0.7500 [idx 0] cm_err 0.2188 tgt 0.2200 lr 2.00e-06 gnorm 0.544 decay 0.00 5.05s mem 56.4GB +step 200/8000 cd 0.00110 (ema 0.00847) σ 0.5006→0.2516 [idx 2] cm_err 0.0548 tgt 0.0509 lr 2.00e-06 gnorm 0.026 decay 0.00 5.06s mem 56.4GB +step 220/8000 cd 0.00194 (ema 0.00809) σ 0.7500→0.5006 [idx 1] cm_err 0.0716 tgt 0.0714 lr 2.00e-06 gnorm 0.032 decay 0.99 5.06s mem 56.4GB +step 240/8000 cd 0.01537 (ema 0.00516) σ 1.0000→0.7500 [idx 0] cm_err 0.1076 tgt 0.1160 lr 2.00e-06 gnorm 0.451 decay 0.99 5.06s mem 56.4GB +step 260/8000 cd 0.00090 (ema 0.00507) σ 0.5006→0.2516 [idx 2] cm_err 0.0668 tgt 0.0645 lr 2.00e-06 gnorm 0.016 decay 0.99 5.06s mem 56.4GB +step 280/8000 cd 0.00108 (ema 0.00370) σ 0.7500→0.5006 [idx 1] cm_err 0.0844 tgt 0.0852 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +step 300/8000 cd 0.00112 (ema 0.00781) σ 0.5006→0.2516 [idx 2] cm_err 0.0478 tgt 0.0456 lr 2.00e-06 gnorm 0.025 decay 0.99 5.06s mem 56.4GB +step 320/8000 cd 0.00083 (ema 0.00649) σ 0.5006→0.2516 [idx 2] cm_err 0.0601 tgt 0.0589 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +step 340/8000 cd 0.01663 (ema 0.00709) σ 1.0000→0.7500 [idx 0] cm_err 0.1778 tgt 0.1877 lr 2.00e-06 gnorm 0.416 decay 0.99 5.06s mem 56.4GB +step 360/8000 cd 0.00168 (ema 0.01049) σ 0.7500→0.5006 [idx 1] cm_err 0.1064 tgt 0.1052 lr 2.00e-06 gnorm 0.043 decay 0.99 5.06s mem 56.4GB +step 380/8000 cd 0.01391 (ema 0.00974) σ 1.0000→0.7500 [idx 0] cm_err 0.2778 tgt 0.2906 lr 2.00e-06 gnorm 0.359 decay 0.99 5.06s mem 56.4GB +step 400/8000 cd 0.00206 (ema 0.01686) σ 0.7500→0.5006 [idx 1] cm_err 0.0726 tgt 0.0705 lr 2.00e-06 gnorm 0.050 decay 0.99 5.07s mem 56.4GB +step 420/8000 cd 0.00103 (ema 0.00656) σ 0.5006→0.2516 [idx 2] cm_err 0.0716 tgt 0.0695 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +step 440/8000 cd 0.00126 (ema 0.00520) σ 0.7500→0.5006 [idx 1] cm_err 0.0576 tgt 0.0576 lr 2.00e-06 gnorm 0.031 decay 0.99 5.06s mem 56.4GB +step 460/8000 cd 0.00092 (ema 0.00943) σ 0.5006→0.2516 [idx 2] cm_err 0.0584 tgt 0.0555 lr 2.00e-06 gnorm 0.019 decay 0.99 5.06s mem 56.4GB +step 480/8000 cd 0.01890 (ema 0.00749) σ 1.0000→0.7500 [idx 0] cm_err 0.2567 tgt 0.2469 lr 2.00e-06 gnorm 0.588 decay 0.99 5.06s mem 56.4GB +step 500/8000 cd 0.00120 (ema 0.00499) σ 0.7500→0.5006 [idx 1] cm_err 0.0741 tgt 0.0741 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step500.safetensors 827 个张量 10.00 GB +step 520/8000 cd 0.00126 (ema 0.00769) σ 0.7500→0.5006 [idx 1] cm_err 0.0561 tgt 0.0563 lr 2.00e-06 gnorm 0.032 decay 0.99 5.07s mem 56.4GB +step 540/8000 cd 0.00082 (ema 0.00464) σ 0.5006→0.2516 [idx 2] cm_err 0.0344 tgt 0.0334 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 560/8000 cd 0.00082 (ema 0.00776) σ 0.5006→0.2516 [idx 2] cm_err 0.0464 tgt 0.0451 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 580/8000 cd 0.00077 (ema 0.00451) σ 0.5006→0.2516 [idx 2] cm_err 0.0337 tgt 0.0328 lr 2.00e-06 gnorm 0.008 decay 0.99 5.05s mem 56.4GB +step 600/8000 cd 0.00101 (ema 0.00690) σ 0.7500→0.5006 [idx 1] cm_err 0.0711 tgt 0.0698 lr 2.00e-06 gnorm 0.015 decay 0.99 5.05s mem 56.4GB +step 620/8000 cd 0.01436 (ema 0.00710) σ 1.0000→0.7500 [idx 0] cm_err 0.1376 tgt 0.1407 lr 2.00e-06 gnorm 0.286 decay 0.99 5.07s mem 56.4GB +step 640/8000 cd 0.01215 (ema 0.00615) σ 1.0000→0.7500 [idx 0] cm_err 0.0978 tgt 0.1033 lr 2.00e-06 gnorm 0.335 decay 0.99 5.07s mem 56.4GB +step 660/8000 cd 0.01268 (ema 0.01000) σ 1.0000→0.7500 [idx 0] cm_err 0.1933 tgt 0.1912 lr 2.00e-06 gnorm 0.347 decay 0.99 5.06s mem 56.4GB +step 680/8000 cd 0.01612 (ema 0.00881) σ 1.0000→0.7500 [idx 0] cm_err 0.1135 tgt 0.1149 lr 2.00e-06 gnorm 0.554 decay 0.99 5.06s mem 56.4GB +step 700/8000 cd 0.00113 (ema 0.00684) σ 0.7500→0.5006 [idx 1] cm_err 0.0383 tgt 0.0380 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +step 720/8000 cd 0.01526 (ema 0.00589) σ 1.0000→0.7500 [idx 0] cm_err 0.1953 tgt 0.2055 lr 2.00e-06 gnorm 0.465 decay 0.99 5.06s mem 56.4GB +step 740/8000 cd 0.00105 (ema 0.00667) σ 0.7500→0.5006 [idx 1] cm_err 0.0679 tgt 0.0678 lr 2.00e-06 gnorm 0.014 decay 0.99 5.07s mem 56.4GB +step 760/8000 cd 0.00107 (ema 0.00597) σ 0.7500→0.5006 [idx 1] cm_err 0.0537 tgt 0.0540 lr 2.00e-06 gnorm 0.016 decay 0.99 5.06s mem 56.4GB +step 780/8000 cd 0.00077 (ema 0.00640) σ 0.5006→0.2516 [idx 2] cm_err 0.0169 tgt 0.0164 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 800/8000 cd 0.00078 (ema 0.00484) σ 0.5006→0.2516 [idx 2] cm_err 0.0345 tgt 0.0338 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 820/8000 cd 0.01184 (ema 0.00529) σ 1.0000→0.7500 [idx 0] cm_err 0.3708 tgt 0.3898 lr 2.00e-06 gnorm 0.243 decay 0.99 5.06s mem 56.4GB +step 840/8000 cd 0.01486 (ema 0.00430) σ 1.0000→0.7500 [idx 0] cm_err 0.1355 tgt 0.1356 lr 2.00e-06 gnorm 0.488 decay 0.99 5.06s mem 56.4GB +step 860/8000 cd 0.00106 (ema 0.00806) σ 0.7500→0.5006 [idx 1] cm_err 0.0655 tgt 0.0651 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +step 880/8000 cd 0.00089 (ema 0.00345) σ 0.7500→0.5006 [idx 1] cm_err 0.0788 tgt 0.0780 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 900/8000 cd 0.00116 (ema 0.00354) σ 0.7500→0.5006 [idx 1] cm_err 0.1151 tgt 0.1138 lr 2.00e-06 gnorm 0.032 decay 0.99 5.06s mem 56.4GB +step 920/8000 cd 0.00101 (ema 0.00498) σ 0.7500→0.5006 [idx 1] cm_err 0.0664 tgt 0.0659 lr 2.00e-06 gnorm 0.023 decay 0.99 5.06s mem 56.4GB +step 940/8000 cd 0.02430 (ema 0.00718) σ 1.0000→0.7500 [idx 0] cm_err 0.1247 tgt 0.1099 lr 2.00e-06 gnorm 0.815 decay 0.99 5.06s mem 56.4GB +step 960/8000 cd 0.00106 (ema 0.00504) σ 0.7500→0.5006 [idx 1] cm_err 0.0838 tgt 0.0838 lr 2.00e-06 gnorm 0.027 decay 0.99 5.06s mem 56.4GB +step 980/8000 cd 0.00097 (ema 0.00290) σ 0.7500→0.5006 [idx 1] cm_err 0.0385 tgt 0.0383 lr 2.00e-06 gnorm 0.018 decay 0.99 5.05s mem 56.4GB +step 1000/8000 cd 0.01083 (ema 0.00485) σ 1.0000→0.7500 [idx 0] cm_err 0.1393 tgt 0.1442 lr 2.00e-06 gnorm 0.258 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step1000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step1000.safetensors 827 个张量 10.00 GB +step 1020/8000 cd 0.00106 (ema 0.00381) σ 0.7500→0.5006 [idx 1] cm_err 0.0880 tgt 0.0869 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +step 1040/8000 cd 0.02060 (ema 0.00817) σ 1.0000→0.7500 [idx 0] cm_err 0.2941 tgt 0.3140 lr 2.00e-06 gnorm 0.553 decay 0.99 5.05s mem 56.4GB +step 1060/8000 cd 0.00117 (ema 0.00470) σ 0.7500→0.5006 [idx 1] cm_err 0.0577 tgt 0.0572 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +step 1080/8000 cd 0.00109 (ema 0.00776) σ 0.7500→0.5006 [idx 1] cm_err 0.0662 tgt 0.0654 lr 2.00e-06 gnorm 0.021 decay 0.99 5.06s mem 56.4GB +step 1100/8000 cd 0.00118 (ema 0.00423) σ 0.7500→0.5006 [idx 1] cm_err 0.0642 tgt 0.0641 lr 2.00e-06 gnorm 0.020 decay 0.99 5.08s mem 56.4GB +step 1120/8000 cd 0.00068 (ema 0.00499) σ 0.5006→0.2516 [idx 2] cm_err 0.0433 tgt 0.0423 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 1140/8000 cd 0.00109 (ema 0.00480) σ 0.7500→0.5006 [idx 1] cm_err 0.0944 tgt 0.0932 lr 2.00e-06 gnorm 0.029 decay 0.99 5.15s mem 56.4GB +step 1160/8000 cd 0.01419 (ema 0.00613) σ 1.0000→0.7500 [idx 0] cm_err 0.2168 tgt 0.2179 lr 2.00e-06 gnorm 0.452 decay 0.99 5.06s mem 56.4GB +step 1180/8000 cd 0.00063 (ema 0.00570) σ 0.5006→0.2516 [idx 2] cm_err 0.0290 tgt 0.0284 lr 2.00e-06 gnorm 0.007 decay 0.99 5.07s mem 56.4GB +step 1200/8000 cd 0.00070 (ema 0.00673) σ 0.5006→0.2516 [idx 2] cm_err 0.0426 tgt 0.0415 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 1220/8000 cd 0.00059 (ema 0.00436) σ 0.5006→0.2516 [idx 2] cm_err 0.0398 tgt 0.0388 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +step 1240/8000 cd 0.00942 (ema 0.00294) σ 1.0000→0.7500 [idx 0] cm_err 0.2142 tgt 0.2164 lr 2.00e-06 gnorm 0.293 decay 0.99 5.06s mem 56.4GB +step 1260/8000 cd 0.01180 (ema 0.00606) σ 1.0000→0.7500 [idx 0] cm_err 0.1573 tgt 0.1622 lr 2.00e-06 gnorm 0.349 decay 0.99 5.06s mem 56.4GB +step 1280/8000 cd 0.00063 (ema 0.00642) σ 0.5006→0.2516 [idx 2] cm_err 0.0383 tgt 0.0377 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 1300/8000 cd 0.00100 (ema 0.00235) σ 0.7500→0.5006 [idx 1] cm_err 0.0422 tgt 0.0418 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 1320/8000 cd 0.01055 (ema 0.00400) σ 1.0000→0.7500 [idx 0] cm_err 0.1695 tgt 0.1721 lr 2.00e-06 gnorm 0.320 decay 0.99 5.06s mem 56.4GB +step 1340/8000 cd 0.00126 (ema 0.00526) σ 0.7500→0.5006 [idx 1] cm_err 0.0580 tgt 0.0575 lr 2.00e-06 gnorm 0.032 decay 0.99 5.06s mem 56.4GB +step 1360/8000 cd 0.00059 (ema 0.00402) σ 0.5006→0.2516 [idx 2] cm_err 0.0475 tgt 0.0464 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +step 1380/8000 cd 0.01047 (ema 0.00308) σ 1.0000→0.7500 [idx 0] cm_err 0.1503 tgt 0.1540 lr 2.00e-06 gnorm 0.192 decay 0.99 5.06s mem 56.4GB +step 1400/8000 cd 0.01682 (ema 0.00497) σ 1.0000→0.7500 [idx 0] cm_err 0.1447 tgt 0.1402 lr 2.00e-06 gnorm 0.638 decay 0.99 5.07s mem 56.4GB +step 1420/8000 cd 0.00062 (ema 0.00425) σ 0.5006→0.2516 [idx 2] cm_err 0.0483 tgt 0.0475 lr 2.00e-06 gnorm 0.008 decay 0.99 5.07s mem 56.4GB +step 1440/8000 cd 0.01048 (ema 0.00316) σ 1.0000→0.7500 [idx 0] cm_err 0.1542 tgt 0.1545 lr 2.00e-06 gnorm 0.374 decay 0.99 5.06s mem 56.4GB +step 1460/8000 cd 0.00098 (ema 0.00699) σ 0.7500→0.5006 [idx 1] cm_err 0.0385 tgt 0.0383 lr 2.00e-06 gnorm 0.027 decay 0.99 5.07s mem 56.4GB +step 1480/8000 cd 0.01224 (ema 0.00582) σ 1.0000→0.7500 [idx 0] cm_err 0.1812 tgt 0.1782 lr 2.00e-06 gnorm 0.394 decay 0.99 5.06s mem 56.4GB +step 1500/8000 cd 0.00119 (ema 0.00613) σ 0.7500→0.5006 [idx 1] cm_err 0.0576 tgt 0.0567 lr 2.00e-06 gnorm 0.038 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step1500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step1500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 1520/8000 cd 0.00058 (ema 0.00479) σ 0.5006→0.2516 [idx 2] cm_err 0.0392 tgt 0.0387 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +step 1540/8000 cd 0.00084 (ema 0.00304) σ 0.7500→0.5006 [idx 1] cm_err 0.0488 tgt 0.0484 lr 2.00e-06 gnorm 0.014 decay 0.99 5.05s mem 56.4GB +step 1560/8000 cd 0.00096 (ema 0.00482) σ 0.7500→0.5006 [idx 1] cm_err 0.1041 tgt 0.1021 lr 2.00e-06 gnorm 0.030 decay 0.99 5.06s mem 56.4GB +step 1580/8000 cd 0.00061 (ema 0.00539) σ 0.5006→0.2516 [idx 2] cm_err 0.0362 tgt 0.0355 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +step 1600/8000 cd 0.01118 (ema 0.00605) σ 1.0000→0.7500 [idx 0] cm_err 0.1658 tgt 0.1676 lr 2.00e-06 gnorm 0.222 decay 0.99 5.06s mem 56.4GB +step 1620/8000 cd 0.00065 (ema 0.00389) σ 0.5006→0.2516 [idx 2] cm_err 0.0425 tgt 0.0412 lr 2.00e-06 gnorm 0.009 decay 0.99 5.88s mem 56.4GB +step 1640/8000 cd 0.01024 (ema 0.00708) σ 1.0000→0.7500 [idx 0] cm_err 0.3047 tgt 0.2987 lr 2.00e-06 gnorm 0.194 decay 0.99 5.06s mem 56.4GB +step 1660/8000 cd 0.01631 (ema 0.00742) σ 1.0000→0.7500 [idx 0] cm_err 0.1797 tgt 0.1803 lr 2.00e-06 gnorm 0.511 decay 0.99 5.07s mem 56.4GB +step 1680/8000 cd 0.00082 (ema 0.00385) σ 0.7500→0.5006 [idx 1] cm_err 0.0570 tgt 0.0562 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +step 1700/8000 cd 0.00061 (ema 0.00325) σ 0.5006→0.2516 [idx 2] cm_err 0.0614 tgt 0.0605 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 1720/8000 cd 0.00067 (ema 0.00873) σ 0.5006→0.2516 [idx 2] cm_err 0.0417 tgt 0.0411 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 1740/8000 cd 0.00105 (ema 0.00250) σ 0.7500→0.5006 [idx 1] cm_err 0.0615 tgt 0.0609 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +step 1760/8000 cd 0.02116 (ema 0.00458) σ 1.0000→0.7500 [idx 0] cm_err 0.2334 tgt 0.2316 lr 2.00e-06 gnorm 0.711 decay 0.99 5.06s mem 56.4GB +step 1780/8000 cd 0.00091 (ema 0.00746) σ 0.7500→0.5006 [idx 1] cm_err 0.0454 tgt 0.0451 lr 2.00e-06 gnorm 0.023 decay 0.99 5.06s mem 56.4GB +step 1800/8000 cd 0.00120 (ema 0.00469) σ 0.7500→0.5006 [idx 1] cm_err 0.0920 tgt 0.0911 lr 2.00e-06 gnorm 0.028 decay 0.99 5.07s mem 56.4GB +step 1820/8000 cd 0.00092 (ema 0.00657) σ 0.7500→0.5006 [idx 1] cm_err 0.0609 tgt 0.0604 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +step 1840/8000 cd 0.00109 (ema 0.00460) σ 0.7500→0.5006 [idx 1] cm_err 0.0897 tgt 0.0883 lr 2.00e-06 gnorm 0.030 decay 0.99 5.06s mem 56.4GB +step 1860/8000 cd 0.00096 (ema 0.00454) σ 0.7500→0.5006 [idx 1] cm_err 0.0556 tgt 0.0550 lr 2.00e-06 gnorm 0.031 decay 0.99 5.06s mem 56.4GB +step 1880/8000 cd 0.00061 (ema 0.00642) σ 0.5006→0.2516 [idx 2] cm_err 0.0355 tgt 0.0347 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 1900/8000 cd 0.00097 (ema 0.00377) σ 0.7500→0.5006 [idx 1] cm_err 0.0603 tgt 0.0597 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +step 1920/8000 cd 0.01042 (ema 0.00496) σ 1.0000→0.7500 [idx 0] cm_err 0.1550 tgt 0.1608 lr 2.00e-06 gnorm 0.225 decay 0.99 5.06s mem 56.4GB +step 1940/8000 cd 0.00107 (ema 0.00419) σ 0.7500→0.5006 [idx 1] cm_err 0.0380 tgt 0.0378 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +step 1960/8000 cd 0.00061 (ema 0.00424) σ 0.5006→0.2516 [idx 2] cm_err 0.0485 tgt 0.0477 lr 2.00e-06 gnorm 0.008 decay 0.99 5.07s mem 56.4GB +step 1980/8000 cd 0.00120 (ema 0.00450) σ 0.7500→0.5006 [idx 1] cm_err 0.0549 tgt 0.0544 lr 2.00e-06 gnorm 0.021 decay 0.99 5.06s mem 56.4GB +step 2000/8000 cd 0.00096 (ema 0.00466) σ 0.7500→0.5006 [idx 1] cm_err 0.0677 tgt 0.0669 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step2000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step2000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 2020/8000 cd 0.01544 (ema 0.00770) σ 1.0000→0.7500 [idx 0] cm_err 0.2528 tgt 0.2616 lr 2.00e-06 gnorm 0.318 decay 0.99 5.05s mem 56.4GB +step 2040/8000 cd 0.00087 (ema 0.00266) σ 0.7500→0.5006 [idx 1] cm_err 0.0492 tgt 0.0495 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 2060/8000 cd 0.01465 (ema 0.00514) σ 1.0000→0.7500 [idx 0] cm_err 0.1456 tgt 0.1429 lr 2.00e-06 gnorm 0.411 decay 0.99 5.07s mem 56.4GB +step 2080/8000 cd 0.00087 (ema 0.00249) σ 0.7500→0.5006 [idx 1] cm_err 0.0473 tgt 0.0466 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +step 2100/8000 cd 0.00058 (ema 0.00384) σ 0.5006→0.2516 [idx 2] cm_err 0.0446 tgt 0.0438 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 2120/8000 cd 0.00148 (ema 0.00470) σ 0.7500→0.5006 [idx 1] cm_err 0.0466 tgt 0.0459 lr 2.00e-06 gnorm 0.053 decay 0.99 5.06s mem 56.4GB +step 2140/8000 cd 0.00072 (ema 0.00520) σ 0.5006→0.2516 [idx 2] cm_err 0.0513 tgt 0.0500 lr 2.00e-06 gnorm 0.015 decay 0.99 5.06s mem 56.4GB +step 2160/8000 cd 0.00057 (ema 0.00348) σ 0.5006→0.2516 [idx 2] cm_err 0.0458 tgt 0.0448 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 2180/8000 cd 0.02909 (ema 0.00963) σ 1.0000→0.7500 [idx 0] cm_err 0.3351 tgt 0.3314 lr 2.00e-06 gnorm 0.520 decay 0.99 5.06s mem 56.4GB +step 2200/8000 cd 0.00116 (ema 0.00557) σ 0.7500→0.5006 [idx 1] cm_err 0.0902 tgt 0.0894 lr 2.00e-06 gnorm 0.038 decay 0.99 5.06s mem 56.4GB +step 2220/8000 cd 0.01201 (ema 0.00568) σ 1.0000→0.7500 [idx 0] cm_err 0.2446 tgt 0.2589 lr 2.00e-06 gnorm 0.294 decay 0.99 5.06s mem 56.4GB +step 2240/8000 cd 0.01801 (ema 0.00703) σ 1.0000→0.7500 [idx 0] cm_err 0.0623 tgt 0.0620 lr 2.00e-06 gnorm 0.465 decay 0.99 5.05s mem 56.4GB +step 2260/8000 cd 0.01048 (ema 0.00959) σ 1.0000→0.7500 [idx 0] cm_err 0.1846 tgt 0.1927 lr 2.00e-06 gnorm 0.219 decay 0.99 5.06s mem 56.4GB +step 2280/8000 cd 0.00077 (ema 0.00419) σ 0.7500→0.5006 [idx 1] cm_err 0.0635 tgt 0.0629 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +step 2300/8000 cd 0.00066 (ema 0.00592) σ 0.5006→0.2516 [idx 2] cm_err 0.0469 tgt 0.0459 lr 2.00e-06 gnorm 0.006 decay 0.99 5.07s mem 56.4GB +step 2320/8000 cd 0.01077 (ema 0.00333) σ 1.0000→0.7500 [idx 0] cm_err 0.1949 tgt 0.1989 lr 2.00e-06 gnorm 0.207 decay 0.99 5.06s mem 56.4GB +step 2340/8000 cd 0.00100 (ema 0.00601) σ 0.7500→0.5006 [idx 1] cm_err 0.1300 tgt 0.1280 lr 2.00e-06 gnorm 0.028 decay 0.99 5.06s mem 56.4GB +step 2360/8000 cd 0.00096 (ema 0.00725) σ 0.7500→0.5006 [idx 1] cm_err 0.0503 tgt 0.0498 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +step 2380/8000 cd 0.01130 (ema 0.00537) σ 1.0000→0.7500 [idx 0] cm_err 0.1482 tgt 0.1488 lr 2.00e-06 gnorm 0.341 decay 0.99 5.06s mem 56.4GB +step 2400/8000 cd 0.00061 (ema 0.00403) σ 0.5006→0.2516 [idx 2] cm_err 0.0324 tgt 0.0317 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 2420/8000 cd 0.00057 (ema 0.00445) σ 0.5006→0.2516 [idx 2] cm_err 0.0230 tgt 0.0226 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +step 2440/8000 cd 0.00088 (ema 0.00442) σ 0.7500→0.5006 [idx 1] cm_err 0.0651 tgt 0.0644 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 2460/8000 cd 0.01241 (ema 0.00457) σ 1.0000→0.7500 [idx 0] cm_err 0.3334 tgt 0.3463 lr 2.00e-06 gnorm 0.266 decay 0.99 5.07s mem 56.4GB +step 2480/8000 cd 0.01255 (ema 0.00410) σ 1.0000→0.7500 [idx 0] cm_err 0.3060 tgt 0.3188 lr 2.00e-06 gnorm 0.250 decay 0.99 5.06s mem 56.4GB +step 2500/8000 cd 0.01257 (ema 0.00502) σ 1.0000→0.7500 [idx 0] cm_err 0.1356 tgt 0.1354 lr 2.00e-06 gnorm 0.364 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step2500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step2500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 2520/8000 cd 0.00093 (ema 0.00369) σ 0.7500→0.5006 [idx 1] cm_err 0.0757 tgt 0.0749 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +step 2540/8000 cd 0.00103 (ema 0.00392) σ 0.7500→0.5006 [idx 1] cm_err 0.0576 tgt 0.0571 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +step 2560/8000 cd 0.00053 (ema 0.00514) σ 0.5006→0.2516 [idx 2] cm_err 0.0389 tgt 0.0381 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 2580/8000 cd 0.00095 (ema 0.00585) σ 0.7500→0.5006 [idx 1] cm_err 0.0521 tgt 0.0512 lr 2.00e-06 gnorm 0.024 decay 0.99 5.06s mem 56.4GB +step 2600/8000 cd 0.00108 (ema 0.00573) σ 0.7500→0.5006 [idx 1] cm_err 0.0580 tgt 0.0570 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 2620/8000 cd 0.00861 (ema 0.00335) σ 1.0000→0.7500 [idx 0] cm_err 0.1172 tgt 0.1208 lr 2.00e-06 gnorm 0.280 decay 0.99 5.06s mem 56.4GB +step 2640/8000 cd 0.00193 (ema 0.00446) σ 0.7500→0.5006 [idx 1] cm_err 0.1274 tgt 0.1244 lr 2.00e-06 gnorm 0.075 decay 0.99 5.07s mem 56.4GB +step 2660/8000 cd 0.01074 (ema 0.00683) σ 1.0000→0.7500 [idx 0] cm_err 0.2263 tgt 0.2217 lr 2.00e-06 gnorm 0.273 decay 0.99 5.05s mem 56.4GB +step 2680/8000 cd 0.00097 (ema 0.00751) σ 0.7500→0.5006 [idx 1] cm_err 0.0788 tgt 0.0777 lr 2.00e-06 gnorm 0.016 decay 0.99 5.06s mem 56.4GB +step 2700/8000 cd 0.00084 (ema 0.00205) σ 0.7500→0.5006 [idx 1] cm_err 0.0310 tgt 0.0303 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +step 2720/8000 cd 0.00097 (ema 0.00374) σ 0.7500→0.5006 [idx 1] cm_err 0.0739 tgt 0.0733 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +step 2740/8000 cd 0.00112 (ema 0.00550) σ 0.7500→0.5006 [idx 1] cm_err 0.0670 tgt 0.0659 lr 2.00e-06 gnorm 0.030 decay 0.99 5.09s mem 56.4GB +step 2760/8000 cd 0.00052 (ema 0.00331) σ 0.5006→0.2516 [idx 2] cm_err 0.0413 tgt 0.0407 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 2780/8000 cd 0.00096 (ema 0.00475) σ 0.7500→0.5006 [idx 1] cm_err 0.0624 tgt 0.0619 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 2800/8000 cd 0.00125 (ema 0.00606) σ 0.7500→0.5006 [idx 1] cm_err 0.0625 tgt 0.0610 lr 2.00e-06 gnorm 0.035 decay 0.99 5.06s mem 56.4GB +step 2820/8000 cd 0.00052 (ema 0.00412) σ 0.5006→0.2516 [idx 2] cm_err 0.0224 tgt 0.0217 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +step 2840/8000 cd 0.00951 (ema 0.00724) σ 1.0000→0.7500 [idx 0] cm_err 0.2601 tgt 0.2693 lr 2.00e-06 gnorm 0.142 decay 0.99 5.06s mem 56.4GB +step 2860/8000 cd 0.00055 (ema 0.00275) σ 0.5006→0.2516 [idx 2] cm_err 0.0452 tgt 0.0446 lr 2.00e-06 gnorm 0.005 decay 0.99 5.05s mem 56.4GB +step 2880/8000 cd 0.00862 (ema 0.00400) σ 1.0000→0.7500 [idx 0] cm_err 0.0812 tgt 0.0814 lr 2.00e-06 gnorm 0.197 decay 0.99 5.06s mem 56.4GB +step 2900/8000 cd 0.00093 (ema 0.00212) σ 0.7500→0.5006 [idx 1] cm_err 0.0859 tgt 0.0850 lr 2.00e-06 gnorm 0.009 decay 0.99 5.16s mem 56.4GB +step 2920/8000 cd 0.00051 (ema 0.00309) σ 0.5006→0.2516 [idx 2] cm_err 0.0318 tgt 0.0312 lr 2.00e-06 gnorm 0.007 decay 0.99 5.06s mem 56.4GB +step 2940/8000 cd 0.00074 (ema 0.00877) σ 0.5006→0.2516 [idx 2] cm_err 0.0519 tgt 0.0510 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +step 2960/8000 cd 0.00093 (ema 0.00367) σ 0.7500→0.5006 [idx 1] cm_err 0.0618 tgt 0.0610 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 2980/8000 cd 0.01229 (ema 0.00609) σ 1.0000→0.7500 [idx 0] cm_err 0.1692 tgt 0.1662 lr 2.00e-06 gnorm 0.340 decay 0.99 5.05s mem 56.4GB +step 3000/8000 cd 0.00824 (ema 0.00931) σ 1.0000→0.7500 [idx 0] cm_err 0.2439 tgt 0.2477 lr 2.00e-06 gnorm 0.201 decay 0.99 5.05s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step3000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step3000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 3020/8000 cd 0.00091 (ema 0.00706) σ 0.7500→0.5006 [idx 1] cm_err 0.0423 tgt 0.0416 lr 2.00e-06 gnorm 0.024 decay 0.99 5.06s mem 56.4GB +step 3040/8000 cd 0.00916 (ema 0.00493) σ 1.0000→0.7500 [idx 0] cm_err 0.3138 tgt 0.3200 lr 2.00e-06 gnorm 0.194 decay 0.99 5.06s mem 56.4GB +step 3060/8000 cd 0.00915 (ema 0.00489) σ 1.0000→0.7500 [idx 0] cm_err 0.1755 tgt 0.1762 lr 2.00e-06 gnorm 0.277 decay 0.99 5.06s mem 56.4GB +step 3080/8000 cd 0.01015 (ema 0.00522) σ 1.0000→0.7500 [idx 0] cm_err 0.1892 tgt 0.1907 lr 2.00e-06 gnorm 0.298 decay 0.99 5.06s mem 56.4GB +step 3100/8000 cd 0.00143 (ema 0.00404) σ 0.7500→0.5006 [idx 1] cm_err 0.0428 tgt 0.0422 lr 2.00e-06 gnorm 0.045 decay 0.99 5.06s mem 56.4GB +step 3120/8000 cd 0.00057 (ema 0.00343) σ 0.5006→0.2516 [idx 2] cm_err 0.0457 tgt 0.0447 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 3140/8000 cd 0.01110 (ema 0.00603) σ 1.0000→0.7500 [idx 0] cm_err 0.2483 tgt 0.2479 lr 2.00e-06 gnorm 0.252 decay 0.99 5.05s mem 56.4GB +step 3160/8000 cd 0.00059 (ema 0.00527) σ 0.5006→0.2516 [idx 2] cm_err 0.0489 tgt 0.0479 lr 2.00e-06 gnorm 0.006 decay 0.99 5.07s mem 56.4GB +step 3180/8000 cd 0.01475 (ema 0.00589) σ 1.0000→0.7500 [idx 0] cm_err 0.2153 tgt 0.2205 lr 2.00e-06 gnorm 0.412 decay 0.99 5.06s mem 56.4GB +step 3200/8000 cd 0.00056 (ema 0.00538) σ 0.5006→0.2516 [idx 2] cm_err 0.0438 tgt 0.0430 lr 2.00e-06 gnorm 0.013 decay 0.99 5.96s mem 56.4GB +step 3220/8000 cd 0.01866 (ema 0.00603) σ 1.0000→0.7500 [idx 0] cm_err 0.2699 tgt 0.2560 lr 2.00e-06 gnorm 0.489 decay 0.99 5.07s mem 56.4GB +step 3240/8000 cd 0.00061 (ema 0.00282) σ 0.5006→0.2516 [idx 2] cm_err 0.0414 tgt 0.0408 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 3260/8000 cd 0.01200 (ema 0.00678) σ 1.0000→0.7500 [idx 0] cm_err 0.1437 tgt 0.1455 lr 2.00e-06 gnorm 0.323 decay 0.99 5.06s mem 56.4GB +step 3280/8000 cd 0.00759 (ema 0.00329) σ 1.0000→0.7500 [idx 0] cm_err 0.1292 tgt 0.1302 lr 2.00e-06 gnorm 0.218 decay 0.99 5.06s mem 56.4GB +step 3300/8000 cd 0.01886 (ema 0.00711) σ 1.0000→0.7500 [idx 0] cm_err 0.2080 tgt 0.1961 lr 2.00e-06 gnorm 0.415 decay 0.99 5.07s mem 56.4GB +step 3320/8000 cd 0.00092 (ema 0.00386) σ 0.7500→0.5006 [idx 1] cm_err 0.0508 tgt 0.0506 lr 2.00e-06 gnorm 0.023 decay 0.99 5.06s mem 56.4GB +step 3340/8000 cd 0.00846 (ema 0.00499) σ 1.0000→0.7500 [idx 0] cm_err 0.3158 tgt 0.3273 lr 2.00e-06 gnorm 0.189 decay 0.99 5.06s mem 56.4GB +step 3360/8000 cd 0.00064 (ema 0.00389) σ 0.5006→0.2516 [idx 2] cm_err 0.0470 tgt 0.0457 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +step 3380/8000 cd 0.00066 (ema 0.00472) σ 0.5006→0.2516 [idx 2] cm_err 0.0843 tgt 0.0828 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 3400/8000 cd 0.03068 (ema 0.01040) σ 1.0000→0.7500 [idx 0] cm_err 0.2464 tgt 0.2540 lr 2.00e-06 gnorm 0.442 decay 0.99 5.06s mem 56.4GB +step 3420/8000 cd 0.00102 (ema 0.00626) σ 0.7500→0.5006 [idx 1] cm_err 0.0455 tgt 0.0444 lr 2.00e-06 gnorm 0.021 decay 0.99 5.07s mem 56.4GB +step 3440/8000 cd 0.00078 (ema 0.00270) σ 0.7500→0.5006 [idx 1] cm_err 0.0596 tgt 0.0590 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 3460/8000 cd 0.00094 (ema 0.00549) σ 0.7500→0.5006 [idx 1] cm_err 0.0752 tgt 0.0745 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +step 3480/8000 cd 0.01041 (ema 0.00421) σ 1.0000→0.7500 [idx 0] cm_err 0.1586 tgt 0.1551 lr 2.00e-06 gnorm 0.284 decay 0.99 5.06s mem 56.4GB +step 3500/8000 cd 0.00055 (ema 0.00479) σ 0.5006→0.2516 [idx 2] cm_err 0.0480 tgt 0.0469 lr 2.00e-06 gnorm 0.006 decay 0.99 5.07s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step3500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step3500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 3520/8000 cd 0.00088 (ema 0.00332) σ 0.7500→0.5006 [idx 1] cm_err 0.0545 tgt 0.0540 lr 2.00e-06 gnorm 0.011 decay 0.99 5.07s mem 56.4GB +step 3540/8000 cd 0.01227 (ema 0.00556) σ 1.0000→0.7500 [idx 0] cm_err 0.1098 tgt 0.1098 lr 2.00e-06 gnorm 0.362 decay 0.99 5.06s mem 56.4GB +step 3560/8000 cd 0.01495 (ema 0.00602) σ 1.0000→0.7500 [idx 0] cm_err 0.2028 tgt 0.1921 lr 2.00e-06 gnorm 0.379 decay 0.99 5.07s mem 56.4GB +step 3580/8000 cd 0.01725 (ema 0.00956) σ 1.0000→0.7500 [idx 0] cm_err 0.1335 tgt 0.1343 lr 2.00e-06 gnorm 0.423 decay 0.99 5.06s mem 56.4GB +step 3600/8000 cd 0.01223 (ema 0.00434) σ 1.0000→0.7500 [idx 0] cm_err 0.2895 tgt 0.2975 lr 2.00e-06 gnorm 0.274 decay 0.99 5.06s mem 56.4GB +step 3620/8000 cd 0.00057 (ema 0.00549) σ 0.5006→0.2516 [idx 2] cm_err 0.0389 tgt 0.0381 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 3640/8000 cd 0.00102 (ema 0.00493) σ 0.7500→0.5006 [idx 1] cm_err 0.0578 tgt 0.0571 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +step 3660/8000 cd 0.00063 (ema 0.00617) σ 0.5006→0.2516 [idx 2] cm_err 0.0686 tgt 0.0676 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +step 3680/8000 cd 0.01036 (ema 0.00494) σ 1.0000→0.7500 [idx 0] cm_err 0.1474 tgt 0.1425 lr 2.00e-06 gnorm 0.252 decay 0.99 5.06s mem 56.4GB +step 3700/8000 cd 0.00090 (ema 0.00475) σ 0.7500→0.5006 [idx 1] cm_err 0.0599 tgt 0.0586 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 3720/8000 cd 0.00102 (ema 0.00576) σ 0.7500→0.5006 [idx 1] cm_err 0.0527 tgt 0.0520 lr 2.00e-06 gnorm 0.015 decay 0.99 5.07s mem 56.4GB +step 3740/8000 cd 0.01570 (ema 0.00608) σ 1.0000→0.7500 [idx 0] cm_err 0.1554 tgt 0.1433 lr 2.00e-06 gnorm 0.423 decay 0.99 5.06s mem 56.4GB +step 3760/8000 cd 0.00087 (ema 0.00338) σ 0.7500→0.5006 [idx 1] cm_err 0.0849 tgt 0.0837 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 3780/8000 cd 0.00057 (ema 0.00339) σ 0.5006→0.2516 [idx 2] cm_err 0.0361 tgt 0.0352 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 3800/8000 cd 0.00115 (ema 0.00636) σ 0.7500→0.5006 [idx 1] cm_err 0.0530 tgt 0.0515 lr 2.00e-06 gnorm 0.039 decay 0.99 5.06s mem 56.4GB +step 3820/8000 cd 0.00108 (ema 0.00333) σ 0.7500→0.5006 [idx 1] cm_err 0.0544 tgt 0.0537 lr 2.00e-06 gnorm 0.027 decay 0.99 5.06s mem 56.4GB +step 3840/8000 cd 0.00117 (ema 0.00579) σ 0.7500→0.5006 [idx 1] cm_err 0.0614 tgt 0.0603 lr 2.00e-06 gnorm 0.044 decay 0.99 5.06s mem 56.4GB +step 3860/8000 cd 0.00102 (ema 0.00603) σ 0.7500→0.5006 [idx 1] cm_err 0.0817 tgt 0.0809 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 3880/8000 cd 0.00097 (ema 0.00513) σ 0.7500→0.5006 [idx 1] cm_err 0.1079 tgt 0.1065 lr 2.00e-06 gnorm 0.015 decay 0.99 5.07s mem 56.4GB +step 3900/8000 cd 0.00063 (ema 0.00597) σ 0.5006→0.2516 [idx 2] cm_err 0.0458 tgt 0.0444 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +step 3920/8000 cd 0.00053 (ema 0.00331) σ 0.5006→0.2516 [idx 2] cm_err 0.0515 tgt 0.0505 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 3940/8000 cd 0.01254 (ema 0.00365) σ 1.0000→0.7500 [idx 0] cm_err 0.1956 tgt 0.1865 lr 2.00e-06 gnorm 0.328 decay 0.99 5.05s mem 56.4GB +step 3960/8000 cd 0.00863 (ema 0.00822) σ 1.0000→0.7500 [idx 0] cm_err 0.0838 tgt 0.0850 lr 2.00e-06 gnorm 0.157 decay 0.99 5.06s mem 56.4GB +step 3980/8000 cd 0.00091 (ema 0.00281) σ 0.7500→0.5006 [idx 1] cm_err 0.0738 tgt 0.0730 lr 2.00e-06 gnorm 0.008 decay 0.99 5.08s mem 56.4GB +step 4000/8000 cd 0.00090 (ema 0.00496) σ 0.7500→0.5006 [idx 1] cm_err 0.0633 tgt 0.0625 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step4000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step4000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 4020/8000 cd 0.00051 (ema 0.00386) σ 0.5006→0.2516 [idx 2] cm_err 0.0357 tgt 0.0346 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 4040/8000 cd 0.01014 (ema 0.00502) σ 1.0000→0.7500 [idx 0] cm_err 0.0988 tgt 0.1023 lr 2.00e-06 gnorm 0.296 decay 0.99 5.06s mem 56.4GB +step 4060/8000 cd 0.00934 (ema 0.00425) σ 1.0000→0.7500 [idx 0] cm_err 0.1293 tgt 0.1352 lr 2.00e-06 gnorm 0.253 decay 0.99 5.06s mem 56.4GB +step 4080/8000 cd 0.00105 (ema 0.00602) σ 0.7500→0.5006 [idx 1] cm_err 0.0352 tgt 0.0341 lr 2.00e-06 gnorm 0.038 decay 0.99 5.06s mem 56.4GB +step 4100/8000 cd 0.02041 (ema 0.00503) σ 1.0000→0.7500 [idx 0] cm_err 0.2482 tgt 0.2569 lr 2.00e-06 gnorm 0.518 decay 0.99 5.06s mem 56.4GB +step 4120/8000 cd 0.00590 (ema 0.00486) σ 1.0000→0.7500 [idx 0] cm_err 0.0542 tgt 0.0534 lr 2.00e-06 gnorm 0.099 decay 0.99 5.06s mem 56.4GB +step 4140/8000 cd 0.00083 (ema 0.00194) σ 0.7500→0.5006 [idx 1] cm_err 0.0316 tgt 0.0314 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 4160/8000 cd 0.00051 (ema 0.00384) σ 0.5006→0.2516 [idx 2] cm_err 0.0284 tgt 0.0278 lr 2.00e-06 gnorm 0.008 decay 0.99 5.07s mem 56.4GB +step 4180/8000 cd 0.00049 (ema 0.00135) σ 0.5006→0.2516 [idx 2] cm_err 0.0447 tgt 0.0436 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 4200/8000 cd 0.01110 (ema 0.00632) σ 1.0000→0.7500 [idx 0] cm_err 0.0995 tgt 0.0954 lr 2.00e-06 gnorm 0.230 decay 0.99 5.06s mem 56.4GB +step 4220/8000 cd 0.00096 (ema 0.00681) σ 0.7500→0.5006 [idx 1] cm_err 0.0742 tgt 0.0731 lr 2.00e-06 gnorm 0.020 decay 0.99 5.06s mem 56.4GB +step 4240/8000 cd 0.00061 (ema 0.00659) σ 0.5006→0.2516 [idx 2] cm_err 0.0606 tgt 0.0592 lr 2.00e-06 gnorm 0.011 decay 0.99 5.07s mem 56.4GB +step 4260/8000 cd 0.00106 (ema 0.00630) σ 0.7500→0.5006 [idx 1] cm_err 0.0440 tgt 0.0434 lr 2.00e-06 gnorm 0.047 decay 0.99 5.06s mem 56.4GB +step 4280/8000 cd 0.00065 (ema 0.00436) σ 0.5006→0.2516 [idx 2] cm_err 0.0715 tgt 0.0705 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 4300/8000 cd 0.00083 (ema 0.00235) σ 0.7500→0.5006 [idx 1] cm_err 0.0599 tgt 0.0591 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 4320/8000 cd 0.00990 (ema 0.00652) σ 1.0000→0.7500 [idx 0] cm_err 0.1270 tgt 0.1208 lr 2.00e-06 gnorm 0.287 decay 0.99 5.06s mem 56.4GB +step 4340/8000 cd 0.00056 (ema 0.00520) σ 0.5006→0.2516 [idx 2] cm_err 0.0478 tgt 0.0471 lr 2.00e-06 gnorm 0.007 decay 0.99 5.07s mem 56.4GB +step 4360/8000 cd 0.01104 (ema 0.00470) σ 1.0000→0.7500 [idx 0] cm_err 0.1553 tgt 0.1575 lr 2.00e-06 gnorm 0.345 decay 0.99 5.06s mem 56.4GB +step 4380/8000 cd 0.00166 (ema 0.00472) σ 0.7500→0.5006 [idx 1] cm_err 0.0569 tgt 0.0557 lr 2.00e-06 gnorm 0.067 decay 0.99 5.06s mem 56.4GB +step 4400/8000 cd 0.00093 (ema 0.00406) σ 0.7500→0.5006 [idx 1] cm_err 0.0796 tgt 0.0789 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 4420/8000 cd 0.00049 (ema 0.00351) σ 0.5006→0.2516 [idx 2] cm_err 0.0505 tgt 0.0496 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 4440/8000 cd 0.01184 (ema 0.00279) σ 1.0000→0.7500 [idx 0] cm_err 0.2598 tgt 0.2582 lr 2.00e-06 gnorm 0.277 decay 0.99 5.07s mem 56.4GB +step 4460/8000 cd 0.00090 (ema 0.00492) σ 0.7500→0.5006 [idx 1] cm_err 0.0466 tgt 0.0454 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +step 4480/8000 cd 0.00082 (ema 0.00312) σ 0.7500→0.5006 [idx 1] cm_err 0.0606 tgt 0.0602 lr 2.00e-06 gnorm 0.024 decay 0.99 5.07s mem 56.4GB +step 4500/8000 cd 0.01178 (ema 0.00317) σ 1.0000→0.7500 [idx 0] cm_err 0.1905 tgt 0.2081 lr 2.00e-06 gnorm 0.304 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step4500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step4500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 4520/8000 cd 0.00098 (ema 0.00445) σ 0.7500→0.5006 [idx 1] cm_err 0.0543 tgt 0.0535 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +step 4540/8000 cd 0.00088 (ema 0.00255) σ 0.7500→0.5006 [idx 1] cm_err 0.0553 tgt 0.0549 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 4560/8000 cd 0.01320 (ema 0.00844) σ 1.0000→0.7500 [idx 0] cm_err 0.1088 tgt 0.1053 lr 2.00e-06 gnorm 0.342 decay 0.99 5.07s mem 56.4GB +step 4580/8000 cd 0.00098 (ema 0.00494) σ 0.7500→0.5006 [idx 1] cm_err 0.0585 tgt 0.0576 lr 2.00e-06 gnorm 0.031 decay 0.99 5.06s mem 56.4GB +step 4600/8000 cd 0.01044 (ema 0.00357) σ 1.0000→0.7500 [idx 0] cm_err 0.2378 tgt 0.2290 lr 2.00e-06 gnorm 0.227 decay 0.99 5.06s mem 56.4GB +step 4620/8000 cd 0.00082 (ema 0.00407) σ 0.7500→0.5006 [idx 1] cm_err 0.0815 tgt 0.0803 lr 2.00e-06 gnorm 0.015 decay 0.99 5.07s mem 56.4GB +step 4640/8000 cd 0.00059 (ema 0.00441) σ 0.5006→0.2516 [idx 2] cm_err 0.0419 tgt 0.0410 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 4660/8000 cd 0.01260 (ema 0.00903) σ 1.0000→0.7500 [idx 0] cm_err 0.2888 tgt 0.2917 lr 2.00e-06 gnorm 0.275 decay 0.99 5.06s mem 56.4GB +step 4680/8000 cd 0.00084 (ema 0.00365) σ 0.7500→0.5006 [idx 1] cm_err 0.0414 tgt 0.0408 lr 2.00e-06 gnorm 0.020 decay 0.99 5.05s mem 56.4GB +step 4700/8000 cd 0.01073 (ema 0.00275) σ 1.0000→0.7500 [idx 0] cm_err 0.2724 tgt 0.2789 lr 2.00e-06 gnorm 0.198 decay 0.99 5.06s mem 56.4GB +step 4720/8000 cd 0.00106 (ema 0.00331) σ 0.7500→0.5006 [idx 1] cm_err 0.0882 tgt 0.0871 lr 2.00e-06 gnorm 0.029 decay 0.99 5.06s mem 56.4GB +step 4740/8000 cd 0.00098 (ema 0.00419) σ 0.7500→0.5006 [idx 1] cm_err 0.0597 tgt 0.0590 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 4760/8000 cd 0.00087 (ema 0.00275) σ 0.7500→0.5006 [idx 1] cm_err 0.0468 tgt 0.0461 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 4780/8000 cd 0.00046 (ema 0.00459) σ 0.5006→0.2516 [idx 2] cm_err 0.0442 tgt 0.0430 lr 2.00e-06 gnorm 0.006 decay 0.99 5.05s mem 56.4GB +step 4800/8000 cd 0.00107 (ema 0.00555) σ 0.7500→0.5006 [idx 1] cm_err 0.0837 tgt 0.0817 lr 2.00e-06 gnorm 0.028 decay 0.99 5.07s mem 56.4GB +step 4820/8000 cd 0.00057 (ema 0.00439) σ 0.5006→0.2516 [idx 2] cm_err 0.0554 tgt 0.0542 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +step 4840/8000 cd 0.00095 (ema 0.00263) σ 0.7500→0.5006 [idx 1] cm_err 0.0713 tgt 0.0703 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 4860/8000 cd 0.00094 (ema 0.00579) σ 0.7500→0.5006 [idx 1] cm_err 0.0647 tgt 0.0637 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +step 4880/8000 cd 0.00137 (ema 0.00566) σ 0.7500→0.5006 [idx 1] cm_err 0.0606 tgt 0.0587 lr 2.00e-06 gnorm 0.068 decay 0.99 5.06s mem 56.4GB +step 4900/8000 cd 0.00117 (ema 0.00430) σ 0.7500→0.5006 [idx 1] cm_err 0.0939 tgt 0.0924 lr 2.00e-06 gnorm 0.024 decay 0.99 5.06s mem 56.4GB +step 4920/8000 cd 0.00086 (ema 0.00368) σ 0.7500→0.5006 [idx 1] cm_err 0.1211 tgt 0.1198 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +step 4940/8000 cd 0.00094 (ema 0.00267) σ 0.7500→0.5006 [idx 1] cm_err 0.0603 tgt 0.0596 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +step 4960/8000 cd 0.00056 (ema 0.00259) σ 0.5006→0.2516 [idx 2] cm_err 0.0395 tgt 0.0387 lr 2.00e-06 gnorm 0.004 decay 0.99 5.07s mem 56.4GB +step 4980/8000 cd 0.00054 (ema 0.00462) σ 0.5006→0.2516 [idx 2] cm_err 0.0781 tgt 0.0773 lr 2.00e-06 gnorm 0.007 decay 0.99 5.06s mem 56.4GB +step 5000/8000 cd 0.01469 (ema 0.00685) σ 1.0000→0.7500 [idx 0] cm_err 0.2082 tgt 0.2092 lr 2.00e-06 gnorm 0.407 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step5000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step5000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 5020/8000 cd 0.00056 (ema 0.00336) σ 0.5006→0.2516 [idx 2] cm_err 0.0483 tgt 0.0476 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +step 5040/8000 cd 0.01108 (ema 0.00550) σ 1.0000→0.7500 [idx 0] cm_err 0.1684 tgt 0.1651 lr 2.00e-06 gnorm 0.264 decay 0.99 5.05s mem 56.4GB +step 5060/8000 cd 0.01288 (ema 0.00797) σ 1.0000→0.7500 [idx 0] cm_err 0.3076 tgt 0.3028 lr 2.00e-06 gnorm 0.239 decay 0.99 5.06s mem 56.4GB +step 5080/8000 cd 0.01043 (ema 0.00602) σ 1.0000→0.7500 [idx 0] cm_err 0.1665 tgt 0.1703 lr 2.00e-06 gnorm 0.273 decay 0.99 5.06s mem 56.4GB +step 5100/8000 cd 0.00077 (ema 0.00344) σ 0.7500→0.5006 [idx 1] cm_err 0.0708 tgt 0.0704 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 5120/8000 cd 0.00893 (ema 0.00363) σ 1.0000→0.7500 [idx 0] cm_err 0.2257 tgt 0.2337 lr 2.00e-06 gnorm 0.184 decay 0.99 5.08s mem 56.4GB +step 5140/8000 cd 0.00050 (ema 0.00207) σ 0.5006→0.2516 [idx 2] cm_err 0.0431 tgt 0.0425 lr 2.00e-06 gnorm 0.006 decay 0.99 5.05s mem 56.4GB +step 5160/8000 cd 0.00096 (ema 0.00261) σ 0.7500→0.5006 [idx 1] cm_err 0.0654 tgt 0.0646 lr 2.00e-06 gnorm 0.015 decay 0.99 5.06s mem 56.4GB +step 5180/8000 cd 0.00051 (ema 0.00195) σ 0.5006→0.2516 [idx 2] cm_err 0.0429 tgt 0.0420 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 5200/8000 cd 0.01234 (ema 0.00374) σ 1.0000→0.7500 [idx 0] cm_err 0.1777 tgt 0.1777 lr 2.00e-06 gnorm 0.307 decay 0.99 5.05s mem 56.4GB +step 5220/8000 cd 0.00085 (ema 0.00240) σ 0.7500→0.5006 [idx 1] cm_err 0.0767 tgt 0.0761 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +step 5240/8000 cd 0.00121 (ema 0.00545) σ 0.7500→0.5006 [idx 1] cm_err 0.0548 tgt 0.0531 lr 2.00e-06 gnorm 0.044 decay 0.99 5.06s mem 56.4GB +step 5260/8000 cd 0.00092 (ema 0.00284) σ 0.7500→0.5006 [idx 1] cm_err 0.0742 tgt 0.0728 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +step 5280/8000 cd 0.00084 (ema 0.00456) σ 0.7500→0.5006 [idx 1] cm_err 0.0463 tgt 0.0455 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +step 5300/8000 cd 0.01331 (ema 0.00397) σ 1.0000→0.7500 [idx 0] cm_err 0.2281 tgt 0.2382 lr 2.00e-06 gnorm 0.292 decay 0.99 5.06s mem 56.4GB +step 5320/8000 cd 0.00104 (ema 0.00478) σ 0.7500→0.5006 [idx 1] cm_err 0.0573 tgt 0.0561 lr 2.00e-06 gnorm 0.059 decay 0.99 5.07s mem 56.4GB +step 5340/8000 cd 0.00136 (ema 0.00744) σ 0.7500→0.5006 [idx 1] cm_err 0.0685 tgt 0.0673 lr 2.00e-06 gnorm 0.054 decay 0.99 5.07s mem 56.4GB +step 5360/8000 cd 0.01140 (ema 0.00500) σ 1.0000→0.7500 [idx 0] cm_err 0.0994 tgt 0.1027 lr 2.00e-06 gnorm 0.212 decay 0.99 5.06s mem 56.4GB +step 5380/8000 cd 0.00086 (ema 0.00275) σ 0.7500→0.5006 [idx 1] cm_err 0.0347 tgt 0.0343 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 5400/8000 cd 0.00776 (ema 0.00415) σ 1.0000→0.7500 [idx 0] cm_err 0.1232 tgt 0.1185 lr 2.00e-06 gnorm 0.185 decay 0.99 5.06s mem 56.4GB +step 5420/8000 cd 0.00052 (ema 0.00297) σ 0.5006→0.2516 [idx 2] cm_err 0.0369 tgt 0.0363 lr 2.00e-06 gnorm 0.009 decay 0.99 6.20s mem 56.4GB +step 5440/8000 cd 0.00079 (ema 0.00389) σ 0.7500→0.5006 [idx 1] cm_err 0.0198 tgt 0.0196 lr 2.00e-06 gnorm 0.009 decay 0.99 5.09s mem 56.4GB +step 5460/8000 cd 0.00139 (ema 0.00482) σ 0.7500→0.5006 [idx 1] cm_err 0.0516 tgt 0.0505 lr 2.00e-06 gnorm 0.055 decay 0.99 5.06s mem 56.4GB +step 5480/8000 cd 0.00044 (ema 0.00272) σ 0.5006→0.2516 [idx 2] cm_err 0.0682 tgt 0.0673 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 5500/8000 cd 0.01257 (ema 0.00361) σ 1.0000→0.7500 [idx 0] cm_err 0.1372 tgt 0.1424 lr 2.00e-06 gnorm 0.329 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step5500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step5500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 5520/8000 cd 0.00129 (ema 0.00401) σ 0.7500→0.5006 [idx 1] cm_err 0.0618 tgt 0.0609 lr 2.00e-06 gnorm 0.046 decay 0.99 5.07s mem 56.4GB +step 5540/8000 cd 0.00112 (ema 0.00503) σ 0.7500→0.5006 [idx 1] cm_err 0.0766 tgt 0.0760 lr 2.00e-06 gnorm 0.041 decay 0.99 5.07s mem 56.4GB +step 5560/8000 cd 0.00060 (ema 0.00512) σ 0.5006→0.2516 [idx 2] cm_err 0.0509 tgt 0.0496 lr 2.00e-06 gnorm 0.011 decay 0.99 5.05s mem 56.4GB +step 5580/8000 cd 0.01663 (ema 0.00585) σ 1.0000→0.7500 [idx 0] cm_err 0.1580 tgt 0.1557 lr 2.00e-06 gnorm 0.449 decay 0.99 5.06s mem 56.4GB +step 5600/8000 cd 0.00106 (ema 0.00448) σ 0.7500→0.5006 [idx 1] cm_err 0.0521 tgt 0.0516 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +step 5620/8000 cd 0.00087 (ema 0.00497) σ 0.7500→0.5006 [idx 1] cm_err 0.0438 tgt 0.0432 lr 2.00e-06 gnorm 0.020 decay 0.99 5.06s mem 56.4GB +step 5640/8000 cd 0.01473 (ema 0.00912) σ 1.0000→0.7500 [idx 0] cm_err 0.2025 tgt 0.2012 lr 2.00e-06 gnorm 0.324 decay 0.99 5.06s mem 56.4GB +step 5660/8000 cd 0.00058 (ema 0.00500) σ 0.5006→0.2516 [idx 2] cm_err 0.0513 tgt 0.0504 lr 2.00e-06 gnorm 0.014 decay 0.99 5.05s mem 56.4GB +step 5680/8000 cd 0.01229 (ema 0.00385) σ 1.0000→0.7500 [idx 0] cm_err 0.1477 tgt 0.1402 lr 2.00e-06 gnorm 0.321 decay 0.99 5.07s mem 56.4GB +step 5700/8000 cd 0.00948 (ema 0.00400) σ 1.0000→0.7500 [idx 0] cm_err 0.1595 tgt 0.1634 lr 2.00e-06 gnorm 0.185 decay 0.99 5.06s mem 56.4GB +step 5720/8000 cd 0.00050 (ema 0.00161) σ 0.5006→0.2516 [idx 2] cm_err 0.0327 tgt 0.0320 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +step 5740/8000 cd 0.00048 (ema 0.00313) σ 0.5006→0.2516 [idx 2] cm_err 0.0554 tgt 0.0544 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +step 5760/8000 cd 0.00053 (ema 0.00332) σ 0.5006→0.2516 [idx 2] cm_err 0.0427 tgt 0.0418 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 5780/8000 cd 0.00056 (ema 0.00496) σ 0.5006→0.2516 [idx 2] cm_err 0.0194 tgt 0.0187 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +step 5800/8000 cd 0.00081 (ema 0.00638) σ 0.7500→0.5006 [idx 1] cm_err 0.0556 tgt 0.0548 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +step 5820/8000 cd 0.00099 (ema 0.00298) σ 0.7500→0.5006 [idx 1] cm_err 0.0783 tgt 0.0768 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +step 5840/8000 cd 0.00108 (ema 0.00467) σ 0.7500→0.5006 [idx 1] cm_err 0.0750 tgt 0.0742 lr 2.00e-06 gnorm 0.040 decay 0.99 5.07s mem 56.4GB +step 5860/8000 cd 0.00099 (ema 0.00541) σ 0.7500→0.5006 [idx 1] cm_err 0.0664 tgt 0.0660 lr 2.00e-06 gnorm 0.046 decay 0.99 5.06s mem 56.4GB +step 5880/8000 cd 0.01138 (ema 0.00470) σ 1.0000→0.7500 [idx 0] cm_err 0.1302 tgt 0.1294 lr 2.00e-06 gnorm 0.261 decay 0.99 5.06s mem 56.4GB +step 5900/8000 cd 0.01493 (ema 0.00483) σ 1.0000→0.7500 [idx 0] cm_err 0.2021 tgt 0.2025 lr 2.00e-06 gnorm 0.381 decay 0.99 5.05s mem 56.4GB +step 5920/8000 cd 0.00094 (ema 0.00359) σ 0.7500→0.5006 [idx 1] cm_err 0.1049 tgt 0.1035 lr 2.00e-06 gnorm 0.021 decay 0.99 5.07s mem 56.4GB +step 5940/8000 cd 0.01159 (ema 0.00328) σ 1.0000→0.7500 [idx 0] cm_err 0.2350 tgt 0.2379 lr 2.00e-06 gnorm 0.223 decay 0.99 5.05s mem 56.4GB +step 5960/8000 cd 0.00958 (ema 0.00297) σ 1.0000→0.7500 [idx 0] cm_err 0.2493 tgt 0.2507 lr 2.00e-06 gnorm 0.222 decay 0.99 5.06s mem 56.4GB +step 5980/8000 cd 0.00106 (ema 0.00426) σ 0.7500→0.5006 [idx 1] cm_err 0.0427 tgt 0.0422 lr 2.00e-06 gnorm 0.028 decay 0.99 5.06s mem 56.4GB +step 6000/8000 cd 0.01442 (ema 0.00680) σ 1.0000→0.7500 [idx 0] cm_err 0.1174 tgt 0.1134 lr 2.00e-06 gnorm 0.321 decay 0.99 5.05s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step6000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step6000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 6020/8000 cd 0.00077 (ema 0.00584) σ 0.7500→0.5006 [idx 1] cm_err 0.0320 tgt 0.0313 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +step 6040/8000 cd 0.00056 (ema 0.00432) σ 0.5006→0.2516 [idx 2] cm_err 0.0347 tgt 0.0337 lr 2.00e-06 gnorm 0.008 decay 0.99 5.05s mem 56.4GB +step 6060/8000 cd 0.00058 (ema 0.00469) σ 0.5006→0.2516 [idx 2] cm_err 0.0405 tgt 0.0396 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +step 6080/8000 cd 0.00055 (ema 0.00581) σ 0.5006→0.2516 [idx 2] cm_err 0.0359 tgt 0.0347 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +step 6100/8000 cd 0.00058 (ema 0.00308) σ 0.5006→0.2516 [idx 2] cm_err 0.0664 tgt 0.0650 lr 2.00e-06 gnorm 0.009 decay 0.99 5.05s mem 56.4GB +step 6120/8000 cd 0.00104 (ema 0.00364) σ 0.7500→0.5006 [idx 1] cm_err 0.0621 tgt 0.0608 lr 2.00e-06 gnorm 0.023 decay 0.99 5.07s mem 56.4GB +step 6140/8000 cd 0.01080 (ema 0.00607) σ 1.0000→0.7500 [idx 0] cm_err 0.1918 tgt 0.1914 lr 2.00e-06 gnorm 0.212 decay 0.99 5.07s mem 56.4GB +step 6160/8000 cd 0.01188 (ema 0.00819) σ 1.0000→0.7500 [idx 0] cm_err 0.2502 tgt 0.2539 lr 2.00e-06 gnorm 0.237 decay 0.99 5.06s mem 56.4GB +step 6180/8000 cd 0.00133 (ema 0.00517) σ 0.7500→0.5006 [idx 1] cm_err 0.0589 tgt 0.0582 lr 2.00e-06 gnorm 0.055 decay 0.99 5.07s mem 56.4GB +step 6200/8000 cd 0.00051 (ema 0.00344) σ 0.5006→0.2516 [idx 2] cm_err 0.0405 tgt 0.0398 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 6220/8000 cd 0.00091 (ema 0.00231) σ 0.7500→0.5006 [idx 1] cm_err 0.0503 tgt 0.0493 lr 2.00e-06 gnorm 0.034 decay 0.99 5.06s mem 56.4GB +step 6240/8000 cd 0.00088 (ema 0.00500) σ 0.7500→0.5006 [idx 1] cm_err 0.0713 tgt 0.0706 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +step 6260/8000 cd 0.00125 (ema 0.00526) σ 0.7500→0.5006 [idx 1] cm_err 0.0484 tgt 0.0469 lr 2.00e-06 gnorm 0.066 decay 0.99 5.06s mem 56.4GB +step 6280/8000 cd 0.00053 (ema 0.00449) σ 0.5006→0.2516 [idx 2] cm_err 0.0580 tgt 0.0572 lr 2.00e-06 gnorm 0.005 decay 0.99 5.05s mem 56.4GB +step 6300/8000 cd 0.00055 (ema 0.00501) σ 0.5006→0.2516 [idx 2] cm_err 0.0422 tgt 0.0411 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +step 6320/8000 cd 0.00839 (ema 0.00393) σ 1.0000→0.7500 [idx 0] cm_err 0.0791 tgt 0.0784 lr 2.00e-06 gnorm 0.178 decay 0.99 5.05s mem 56.4GB +step 6340/8000 cd 0.00142 (ema 0.00283) σ 0.7500→0.5006 [idx 1] cm_err 0.0793 tgt 0.0774 lr 2.00e-06 gnorm 0.050 decay 0.99 5.06s mem 56.4GB +step 6360/8000 cd 0.01346 (ema 0.00543) σ 1.0000→0.7500 [idx 0] cm_err 0.1882 tgt 0.1928 lr 2.00e-06 gnorm 0.323 decay 0.99 5.07s mem 56.4GB +step 6380/8000 cd 0.00084 (ema 0.00352) σ 0.7500→0.5006 [idx 1] cm_err 0.0474 tgt 0.0467 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +step 6400/8000 cd 0.00049 (ema 0.00451) σ 0.5006→0.2516 [idx 2] cm_err 0.0577 tgt 0.0564 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +step 6420/8000 cd 0.00052 (ema 0.00428) σ 0.5006→0.2516 [idx 2] cm_err 0.0665 tgt 0.0654 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +step 6440/8000 cd 0.01540 (ema 0.00701) σ 1.0000→0.7500 [idx 0] cm_err 0.2276 tgt 0.2388 lr 2.00e-06 gnorm 0.285 decay 0.99 5.06s mem 56.4GB +step 6460/8000 cd 0.00119 (ema 0.00556) σ 0.7500→0.5006 [idx 1] cm_err 0.0688 tgt 0.0668 lr 2.00e-06 gnorm 0.029 decay 0.99 5.06s mem 56.4GB +step 6480/8000 cd 0.00057 (ema 0.00390) σ 0.5006→0.2516 [idx 2] cm_err 0.0660 tgt 0.0646 lr 2.00e-06 gnorm 0.007 decay 0.99 5.07s mem 56.4GB +step 6500/8000 cd 0.00676 (ema 0.00373) σ 1.0000→0.7500 [idx 0] cm_err 0.1278 tgt 0.1353 lr 2.00e-06 gnorm 0.132 decay 0.99 5.07s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step6500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step6500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +step 6520/8000 cd 0.00112 (ema 0.00632) σ 0.7500→0.5006 [idx 1] cm_err 0.0622 tgt 0.0609 lr 2.00e-06 gnorm 0.034 decay 0.99 5.06s mem 56.4GB +step 6540/8000 cd 0.00988 (ema 0.00446) σ 1.0000→0.7500 [idx 0] cm_err 0.0971 tgt 0.0896 lr 2.00e-06 gnorm 0.184 decay 0.99 5.06s mem 56.4GB +step 6560/8000 cd 0.00088 (ema 0.00271) σ 0.7500→0.5006 [idx 1] cm_err 0.0621 tgt 0.0610 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +step 6580/8000 cd 0.01266 (ema 0.00320) σ 1.0000→0.7500 [idx 0] cm_err 0.1525 tgt 0.1590 lr 2.00e-06 gnorm 0.334 decay 0.99 5.06s mem 56.4GB +step 6600/8000 cd 0.00090 (ema 0.00284) σ 0.7500→0.5006 [idx 1] cm_err 0.0618 tgt 0.0610 lr 2.00e-06 gnorm 0.015 decay 0.99 5.06s mem 56.4GB +step 6620/8000 cd 0.00048 (ema 0.00296) σ 0.5006→0.2516 [idx 2] cm_err 0.0370 tgt 0.0362 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +step 6640/8000 cd 0.01536 (ema 0.00645) σ 1.0000→0.7500 [idx 0] cm_err 0.1734 tgt 0.1719 lr 2.00e-06 gnorm 0.373 decay 0.99 5.07s mem 56.4GB +step 6660/8000 cd 0.00121 (ema 0.00425) σ 0.7500→0.5006 [idx 1] cm_err 0.0752 tgt 0.0739 lr 2.00e-06 gnorm 0.054 decay 0.99 5.06s mem 56.4GB +step 6680/8000 cd 0.00047 (ema 0.00204) σ 0.5006→0.2516 [idx 2] cm_err 0.0549 tgt 0.0538 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +step 6700/8000 cd 0.01336 (ema 0.00589) σ 1.0000→0.7500 [idx 0] cm_err 0.2160 tgt 0.2173 lr 2.00e-06 gnorm 0.294 decay 0.99 5.06s mem 56.4GB +step 6720/8000 cd 0.00046 (ema 0.00477) σ 0.5006→0.2516 [idx 2] cm_err 0.0496 tgt 0.0485 lr 2.00e-06 gnorm 0.004 decay 0.99 5.05s mem 56.4GB +step 6740/8000 cd 0.00955 (ema 0.00533) σ 1.0000→0.7500 [idx 0] cm_err 0.2307 tgt 0.2325 lr 2.00e-06 gnorm 0.216 decay 0.99 5.06s mem 56.4GB +step 6760/8000 cd 0.00058 (ema 0.00384) σ 0.5006→0.2516 [idx 2] cm_err 0.0435 tgt 0.0423 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +step 6780/8000 cd 0.00053 (ema 0.00415) σ 0.5006→0.2516 [idx 2] cm_err 0.0400 tgt 0.0389 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +step 6800/8000 cd 0.01733 (ema 0.00754) σ 1.0000→0.7500 [idx 0] cm_err 0.2233 tgt 0.2111 lr 2.00e-06 gnorm 0.346 decay 0.99 5.05s mem 56.4GB +step 6820/8000 cd 0.00127 (ema 0.00488) σ 0.7500→0.5006 [idx 1] cm_err 0.0711 tgt 0.0698 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +step 6840/8000 cd 0.01192 (ema 0.00530) σ 1.0000→0.7500 [idx 0] cm_err 0.2127 tgt 0.2123 lr 2.00e-06 gnorm 0.245 decay 0.99 5.06s mem 56.4GB +step 6860/8000 cd 0.00842 (ema 0.00579) σ 1.0000→0.7500 [idx 0] cm_err 0.1606 tgt 0.1612 lr 2.00e-06 gnorm 0.154 decay 0.99 5.06s mem 56.4GB +step 6880/8000 cd 0.00131 (ema 0.00435) σ 0.7500→0.5006 [idx 1] cm_err 0.0491 tgt 0.0476 lr 2.00e-06 gnorm 0.034 decay 0.99 5.07s mem 56.4GB +step 6900/8000 cd 0.01266 (ema 0.00535) σ 1.0000→0.7500 [idx 0] cm_err 0.1372 tgt 0.1378 lr 2.00e-06 gnorm 0.283 decay 0.99 5.06s mem 56.4GB +step 6920/8000 cd 0.00098 (ema 0.00694) σ 0.7500→0.5006 [idx 1] cm_err 0.1273 tgt 0.1259 lr 2.00e-06 gnorm 0.021 decay 0.99 5.06s mem 56.4GB +step 6940/8000 cd 0.00053 (ema 0.00307) σ 0.5006→0.2516 [idx 2] cm_err 0.0327 tgt 0.0319 lr 2.00e-06 gnorm 0.008 decay 0.99 5.08s mem 56.4GB +step 6960/8000 cd 0.01088 (ema 0.00377) σ 1.0000→0.7500 [idx 0] cm_err 0.1689 tgt 0.1653 lr 2.00e-06 gnorm 0.301 decay 0.99 5.06s mem 56.4GB +step 6980/8000 cd 0.01076 (ema 0.00451) σ 1.0000→0.7500 [idx 0] cm_err 0.1134 tgt 0.1148 lr 2.00e-06 gnorm 0.223 decay 0.99 5.05s mem 56.4GB +step 7000/8000 cd 0.00065 (ema 0.00490) σ 0.5006→0.2516 [idx 2] cm_err 0.0461 tgt 0.0447 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step7000.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step7000.safetensors 827 个张量 10.00 GB +[rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +W0910 11:47:43.293000 1467387 .venv/lib/python3.12/site-packages/torch/distributed/elastic/agent/server/api.py:739] Received 15 death signal, shutting down workers +Traceback (most recent call last): + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/accelerate", line 6, in + sys.exit(main()) + ^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/accelerate/commands/accelerate_cli.py", line 50, in main + args.func(args) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/accelerate/commands/launch.py", line 1392, in launch_command + deepspeed_launcher(args) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/accelerate/commands/launch.py", line 1076, in deepspeed_launcher + distrib_run.run(args) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/run.py", line 981, in run + elastic_launch( + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/launcher/api.py", line 170, in __call__ + return launch_agent(self._config, self._entrypoint, list(args)) + ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/launcher/api.py", line 308, in launch_agent + result = agent.run() + ^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/metrics/api.py", line 134, in wrapper + result = f(*args, **kwargs) + ^^^^^^^^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/agent/server/api.py", line 731, in run + result = self._invoke_run(role) + ^^^^^^^^^^^^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/agent/server/api.py", line 908, in _invoke_run + time.sleep(monitor_interval) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/multiprocessing/api.py", line 86, in _terminate_process_handler + raise SignalException(f"Process {os.getpid()} got signal: {sigval}", sigval=sigval) +torch.distributed.elastic.multiprocessing.api.SignalException: Process 1467387 got signal: 15 diff --git a/backup_2026-09-14/runs/distill__stage2_cd/train.log b/backup_2026-09-14/runs/distill__stage2_cd/train.log new file mode 100644 index 0000000000000000000000000000000000000000..22aa19fc998856657c77532325777985097cd292 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage2_cd/train.log @@ -0,0 +1,406 @@ +[2026-09-10 01:42:27] === stage2_cd | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd world=8 dist=DistributedType.DEEPSPEED mp=bf16 === +[2026-09-10 01:42:27] [recipe] teacher_causal=1 tf=True windowed=0/0 cfg=1.0 ema=0.99@200 lr=2e-06 betas=(0.0, 0.999) wd=0.0 warmup=100 clip=10.0 bs=1×accum1×8卡 ⇒ 等效 batch 8 max_steps=8000 gc=True +[2026-09-10 01:42:27] [axis] deploy_schedule([1000.0, 750.0, 500.0, 250.0]) → grid idx [0, 625, 833, 937] K=4(3 对一致性) +[2026-09-10 01:42:27] [axis] sigma = [1.0, 0.75, 0.5006, 0.251597] +[2026-09-10 01:42:27] [axis] t = [1000.0, 750.0, 500.6, 251.597] +[2026-09-10 01:42:27] [axis] Δsigma= [-0.25, -0.2494, -0.249002] 教师 Euler 子步 = 1 +[2026-09-10 01:42:27] [axis] 部署采样表 [1000.0, 750.0, 500.0, 250.0] → sigma [1.0, 0.75, 0.5006, 0.251597](逐点都是轴上的节点) +[2026-09-10 01:42:31] [data] train 18528 clip(scene_dropout=0.0,CD 不做 CFG 所以是 0) +[2026-09-10 01:42:31] [resume] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd 里没有 progress.json,从头开始 +[2026-09-10 01:42:31] [ckpt] dit_step1000.safetensors metadata: stage=stage1_ar_tf step=1000 teacher_forcing=True windowed_train=0 +[2026-09-10 01:42:39] [model] student ← /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors(827 个张量,缺 []) +[2026-09-10 01:42:45] [model] teacher ← /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage1_long_K3/dits/dit_step1000.safetensors(causal=True,827 个张量,缺 []) +[2026-09-10 01:42:49] [model] 三份 AropeDiT 各 4,999,803,072 参数;构建 18s +[2026-09-10 01:43:07] [guard] 三模型就位:student(ZeRO-2, bf16) / teacher(bf16 冻结, 未 prepare) / ema(fp32 影子, 未 prepare),各 827 个参数张量,freqs 都在 cuda:0 +[2026-09-10 01:43:07] [env] grad_clip=10.0(DeepSpeed 生效值 10.0) +[2026-09-10 01:43:07] [train] 从 step 0 到 8000 +[2026-09-10 01:45:04] step 20/8000 cd 0.01828 (ema 0.01584) σ 1.0000→0.7500 [idx 0] cm_err 0.0972 tgt 0.1121 lr 4.00e-07 gnorm 0.367 decay 0.00 5.06s mem 56.4GB +[2026-09-10 01:46:47] step 40/8000 cd 0.00341 (ema 0.01071) σ 0.7500→0.5006 [idx 1] cm_err 0.0469 tgt 0.0487 lr 8.00e-07 gnorm 0.065 decay 0.00 5.05s mem 56.4GB +[2026-09-10 01:48:29] step 60/8000 cd 0.00329 (ema 0.00673) σ 0.7500→0.5006 [idx 1] cm_err 0.0481 tgt 0.0508 lr 1.20e-06 gnorm 0.055 decay 0.00 5.06s mem 56.4GB +[2026-09-10 01:50:11] step 80/8000 cd 0.03503 (ema 0.01108) σ 1.0000→0.7500 [idx 0] cm_err 0.2447 tgt 0.2350 lr 1.60e-06 gnorm 1.374 decay 0.00 5.24s mem 56.4GB +[2026-09-10 01:51:52] step 100/8000 cd 0.02229 (ema 0.01106) σ 1.0000→0.7500 [idx 0] cm_err 0.3274 tgt 0.3253 lr 2.00e-06 gnorm 0.636 decay 0.00 5.05s mem 56.4GB +[2026-09-10 01:53:34] step 120/8000 cd 0.00105 (ema 0.00848) σ 0.5006→0.2516 [idx 2] cm_err 0.0424 tgt 0.0437 lr 2.00e-06 gnorm 0.022 decay 0.00 5.06s mem 56.4GB +[2026-09-10 01:55:16] step 140/8000 cd 0.00108 (ema 0.00717) σ 0.5006→0.2516 [idx 2] cm_err 0.0518 tgt 0.0508 lr 2.00e-06 gnorm 0.030 decay 0.00 5.07s mem 56.4GB +[2026-09-10 01:56:58] step 160/8000 cd 0.02082 (ema 0.01003) σ 1.0000→0.7500 [idx 0] cm_err 0.1552 tgt 0.1442 lr 2.00e-06 gnorm 0.694 decay 0.00 5.06s mem 56.4GB +[2026-09-10 01:58:40] step 180/8000 cd 0.01940 (ema 0.00856) σ 1.0000→0.7500 [idx 0] cm_err 0.2188 tgt 0.2200 lr 2.00e-06 gnorm 0.544 decay 0.00 5.05s mem 56.4GB +[2026-09-10 02:00:22] step 200/8000 cd 0.00110 (ema 0.00847) σ 0.5006→0.2516 [idx 2] cm_err 0.0548 tgt 0.0509 lr 2.00e-06 gnorm 0.026 decay 0.00 5.06s mem 56.4GB +[2026-09-10 02:02:04] step 220/8000 cd 0.00194 (ema 0.00809) σ 0.7500→0.5006 [idx 1] cm_err 0.0716 tgt 0.0714 lr 2.00e-06 gnorm 0.032 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:03:46] step 240/8000 cd 0.01537 (ema 0.00516) σ 1.0000→0.7500 [idx 0] cm_err 0.1076 tgt 0.1160 lr 2.00e-06 gnorm 0.451 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:05:28] step 260/8000 cd 0.00090 (ema 0.00507) σ 0.5006→0.2516 [idx 2] cm_err 0.0668 tgt 0.0645 lr 2.00e-06 gnorm 0.016 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:07:11] step 280/8000 cd 0.00108 (ema 0.00370) σ 0.7500→0.5006 [idx 1] cm_err 0.0844 tgt 0.0852 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:08:53] step 300/8000 cd 0.00112 (ema 0.00781) σ 0.5006→0.2516 [idx 2] cm_err 0.0478 tgt 0.0456 lr 2.00e-06 gnorm 0.025 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:10:36] step 320/8000 cd 0.00083 (ema 0.00649) σ 0.5006→0.2516 [idx 2] cm_err 0.0601 tgt 0.0589 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +[2026-09-10 02:12:18] step 340/8000 cd 0.01663 (ema 0.00709) σ 1.0000→0.7500 [idx 0] cm_err 0.1778 tgt 0.1877 lr 2.00e-06 gnorm 0.416 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:14:02] step 360/8000 cd 0.00168 (ema 0.01049) σ 0.7500→0.5006 [idx 1] cm_err 0.1064 tgt 0.1052 lr 2.00e-06 gnorm 0.043 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:15:44] step 380/8000 cd 0.01391 (ema 0.00974) σ 1.0000→0.7500 [idx 0] cm_err 0.2778 tgt 0.2906 lr 2.00e-06 gnorm 0.359 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:17:26] step 400/8000 cd 0.00206 (ema 0.01686) σ 0.7500→0.5006 [idx 1] cm_err 0.0726 tgt 0.0705 lr 2.00e-06 gnorm 0.050 decay 0.99 5.07s mem 56.4GB +[2026-09-10 02:19:08] step 420/8000 cd 0.00103 (ema 0.00656) σ 0.5006→0.2516 [idx 2] cm_err 0.0716 tgt 0.0695 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:20:50] step 440/8000 cd 0.00126 (ema 0.00520) σ 0.7500→0.5006 [idx 1] cm_err 0.0576 tgt 0.0576 lr 2.00e-06 gnorm 0.031 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:22:33] step 460/8000 cd 0.00092 (ema 0.00943) σ 0.5006→0.2516 [idx 2] cm_err 0.0584 tgt 0.0555 lr 2.00e-06 gnorm 0.019 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:24:15] step 480/8000 cd 0.01890 (ema 0.00749) σ 1.0000→0.7500 [idx 0] cm_err 0.2567 tgt 0.2469 lr 2.00e-06 gnorm 0.588 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:25:57] step 500/8000 cd 0.00120 (ema 0.00499) σ 0.7500→0.5006 [idx 1] cm_err 0.0741 tgt 0.0741 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:26:22] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step500.safetensors 827 个张量 10.00 GB +[2026-09-10 02:26:41] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step500.safetensors 827 个张量 10.00 GB +[2026-09-10 02:28:23] step 520/8000 cd 0.00126 (ema 0.00769) σ 0.7500→0.5006 [idx 1] cm_err 0.0561 tgt 0.0563 lr 2.00e-06 gnorm 0.032 decay 0.99 5.07s mem 56.4GB +[2026-09-10 02:30:05] step 540/8000 cd 0.00082 (ema 0.00464) σ 0.5006→0.2516 [idx 2] cm_err 0.0344 tgt 0.0334 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:31:47] step 560/8000 cd 0.00082 (ema 0.00776) σ 0.5006→0.2516 [idx 2] cm_err 0.0464 tgt 0.0451 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:33:30] step 580/8000 cd 0.00077 (ema 0.00451) σ 0.5006→0.2516 [idx 2] cm_err 0.0337 tgt 0.0328 lr 2.00e-06 gnorm 0.008 decay 0.99 5.05s mem 56.4GB +[2026-09-10 02:35:12] step 600/8000 cd 0.00101 (ema 0.00690) σ 0.7500→0.5006 [idx 1] cm_err 0.0711 tgt 0.0698 lr 2.00e-06 gnorm 0.015 decay 0.99 5.05s mem 56.4GB +[2026-09-10 02:36:54] step 620/8000 cd 0.01436 (ema 0.00710) σ 1.0000→0.7500 [idx 0] cm_err 0.1376 tgt 0.1407 lr 2.00e-06 gnorm 0.286 decay 0.99 5.07s mem 56.4GB +[2026-09-10 02:38:38] step 640/8000 cd 0.01215 (ema 0.00615) σ 1.0000→0.7500 [idx 0] cm_err 0.0978 tgt 0.1033 lr 2.00e-06 gnorm 0.335 decay 0.99 5.07s mem 56.4GB +[2026-09-10 02:40:20] step 660/8000 cd 0.01268 (ema 0.01000) σ 1.0000→0.7500 [idx 0] cm_err 0.1933 tgt 0.1912 lr 2.00e-06 gnorm 0.347 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:42:02] step 680/8000 cd 0.01612 (ema 0.00881) σ 1.0000→0.7500 [idx 0] cm_err 0.1135 tgt 0.1149 lr 2.00e-06 gnorm 0.554 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:43:44] step 700/8000 cd 0.00113 (ema 0.00684) σ 0.7500→0.5006 [idx 1] cm_err 0.0383 tgt 0.0380 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +[2026-09-10 02:45:26] step 720/8000 cd 0.01526 (ema 0.00589) σ 1.0000→0.7500 [idx 0] cm_err 0.1953 tgt 0.2055 lr 2.00e-06 gnorm 0.465 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:47:08] step 740/8000 cd 0.00105 (ema 0.00667) σ 0.7500→0.5006 [idx 1] cm_err 0.0679 tgt 0.0678 lr 2.00e-06 gnorm 0.014 decay 0.99 5.07s mem 56.4GB +[2026-09-10 02:48:51] step 760/8000 cd 0.00107 (ema 0.00597) σ 0.7500→0.5006 [idx 1] cm_err 0.0537 tgt 0.0540 lr 2.00e-06 gnorm 0.016 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:50:33] step 780/8000 cd 0.00077 (ema 0.00640) σ 0.5006→0.2516 [idx 2] cm_err 0.0169 tgt 0.0164 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:52:15] step 800/8000 cd 0.00078 (ema 0.00484) σ 0.5006→0.2516 [idx 2] cm_err 0.0345 tgt 0.0338 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:53:57] step 820/8000 cd 0.01184 (ema 0.00529) σ 1.0000→0.7500 [idx 0] cm_err 0.3708 tgt 0.3898 lr 2.00e-06 gnorm 0.243 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:55:39] step 840/8000 cd 0.01486 (ema 0.00430) σ 1.0000→0.7500 [idx 0] cm_err 0.1355 tgt 0.1356 lr 2.00e-06 gnorm 0.488 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:57:21] step 860/8000 cd 0.00106 (ema 0.00806) σ 0.7500→0.5006 [idx 1] cm_err 0.0655 tgt 0.0651 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +[2026-09-10 02:59:03] step 880/8000 cd 0.00089 (ema 0.00345) σ 0.7500→0.5006 [idx 1] cm_err 0.0788 tgt 0.0780 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:00:45] step 900/8000 cd 0.00116 (ema 0.00354) σ 0.7500→0.5006 [idx 1] cm_err 0.1151 tgt 0.1138 lr 2.00e-06 gnorm 0.032 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:02:28] step 920/8000 cd 0.00101 (ema 0.00498) σ 0.7500→0.5006 [idx 1] cm_err 0.0664 tgt 0.0659 lr 2.00e-06 gnorm 0.023 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:04:10] step 940/8000 cd 0.02430 (ema 0.00718) σ 1.0000→0.7500 [idx 0] cm_err 0.1247 tgt 0.1099 lr 2.00e-06 gnorm 0.815 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:05:52] step 960/8000 cd 0.00106 (ema 0.00504) σ 0.7500→0.5006 [idx 1] cm_err 0.0838 tgt 0.0838 lr 2.00e-06 gnorm 0.027 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:07:34] step 980/8000 cd 0.00097 (ema 0.00290) σ 0.7500→0.5006 [idx 1] cm_err 0.0385 tgt 0.0383 lr 2.00e-06 gnorm 0.018 decay 0.99 5.05s mem 56.4GB +[2026-09-10 03:09:17] step 1000/8000 cd 0.01083 (ema 0.00485) σ 1.0000→0.7500 [idx 0] cm_err 0.1393 tgt 0.1442 lr 2.00e-06 gnorm 0.258 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:09:37] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step1000.safetensors 827 个张量 10.00 GB +[2026-09-10 03:09:54] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step1000.safetensors 827 个张量 10.00 GB +[2026-09-10 03:11:37] step 1020/8000 cd 0.00106 (ema 0.00381) σ 0.7500→0.5006 [idx 1] cm_err 0.0880 tgt 0.0869 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +[2026-09-10 03:13:19] step 1040/8000 cd 0.02060 (ema 0.00817) σ 1.0000→0.7500 [idx 0] cm_err 0.2941 tgt 0.3140 lr 2.00e-06 gnorm 0.553 decay 0.99 5.05s mem 56.4GB +[2026-09-10 03:15:01] step 1060/8000 cd 0.00117 (ema 0.00470) σ 0.7500→0.5006 [idx 1] cm_err 0.0577 tgt 0.0572 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:16:43] step 1080/8000 cd 0.00109 (ema 0.00776) σ 0.7500→0.5006 [idx 1] cm_err 0.0662 tgt 0.0654 lr 2.00e-06 gnorm 0.021 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:18:26] step 1100/8000 cd 0.00118 (ema 0.00423) σ 0.7500→0.5006 [idx 1] cm_err 0.0642 tgt 0.0641 lr 2.00e-06 gnorm 0.020 decay 0.99 5.08s mem 56.4GB +[2026-09-10 03:20:08] step 1120/8000 cd 0.00068 (ema 0.00499) σ 0.5006→0.2516 [idx 2] cm_err 0.0433 tgt 0.0423 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:21:51] step 1140/8000 cd 0.00109 (ema 0.00480) σ 0.7500→0.5006 [idx 1] cm_err 0.0944 tgt 0.0932 lr 2.00e-06 gnorm 0.029 decay 0.99 5.15s mem 56.4GB +[2026-09-10 03:23:33] step 1160/8000 cd 0.01419 (ema 0.00613) σ 1.0000→0.7500 [idx 0] cm_err 0.2168 tgt 0.2179 lr 2.00e-06 gnorm 0.452 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:25:15] step 1180/8000 cd 0.00063 (ema 0.00570) σ 0.5006→0.2516 [idx 2] cm_err 0.0290 tgt 0.0284 lr 2.00e-06 gnorm 0.007 decay 0.99 5.07s mem 56.4GB +[2026-09-10 03:26:57] step 1200/8000 cd 0.00070 (ema 0.00673) σ 0.5006→0.2516 [idx 2] cm_err 0.0426 tgt 0.0415 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:28:39] step 1220/8000 cd 0.00059 (ema 0.00436) σ 0.5006→0.2516 [idx 2] cm_err 0.0398 tgt 0.0388 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:30:21] step 1240/8000 cd 0.00942 (ema 0.00294) σ 1.0000→0.7500 [idx 0] cm_err 0.2142 tgt 0.2164 lr 2.00e-06 gnorm 0.293 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:32:04] step 1260/8000 cd 0.01180 (ema 0.00606) σ 1.0000→0.7500 [idx 0] cm_err 0.1573 tgt 0.1622 lr 2.00e-06 gnorm 0.349 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:33:46] step 1280/8000 cd 0.00063 (ema 0.00642) σ 0.5006→0.2516 [idx 2] cm_err 0.0383 tgt 0.0377 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:35:28] step 1300/8000 cd 0.00100 (ema 0.00235) σ 0.7500→0.5006 [idx 1] cm_err 0.0422 tgt 0.0418 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:37:10] step 1320/8000 cd 0.01055 (ema 0.00400) σ 1.0000→0.7500 [idx 0] cm_err 0.1695 tgt 0.1721 lr 2.00e-06 gnorm 0.320 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:38:52] step 1340/8000 cd 0.00126 (ema 0.00526) σ 0.7500→0.5006 [idx 1] cm_err 0.0580 tgt 0.0575 lr 2.00e-06 gnorm 0.032 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:40:35] step 1360/8000 cd 0.00059 (ema 0.00402) σ 0.5006→0.2516 [idx 2] cm_err 0.0475 tgt 0.0464 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +[2026-09-10 03:42:17] step 1380/8000 cd 0.01047 (ema 0.00308) σ 1.0000→0.7500 [idx 0] cm_err 0.1503 tgt 0.1540 lr 2.00e-06 gnorm 0.192 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:43:59] step 1400/8000 cd 0.01682 (ema 0.00497) σ 1.0000→0.7500 [idx 0] cm_err 0.1447 tgt 0.1402 lr 2.00e-06 gnorm 0.638 decay 0.99 5.07s mem 56.4GB +[2026-09-10 03:45:41] step 1420/8000 cd 0.00062 (ema 0.00425) σ 0.5006→0.2516 [idx 2] cm_err 0.0483 tgt 0.0475 lr 2.00e-06 gnorm 0.008 decay 0.99 5.07s mem 56.4GB +[2026-09-10 03:47:23] step 1440/8000 cd 0.01048 (ema 0.00316) σ 1.0000→0.7500 [idx 0] cm_err 0.1542 tgt 0.1545 lr 2.00e-06 gnorm 0.374 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:49:06] step 1460/8000 cd 0.00098 (ema 0.00699) σ 0.7500→0.5006 [idx 1] cm_err 0.0385 tgt 0.0383 lr 2.00e-06 gnorm 0.027 decay 0.99 5.07s mem 56.4GB +[2026-09-10 03:50:48] step 1480/8000 cd 0.01224 (ema 0.00582) σ 1.0000→0.7500 [idx 0] cm_err 0.1812 tgt 0.1782 lr 2.00e-06 gnorm 0.394 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:52:30] step 1500/8000 cd 0.00119 (ema 0.00613) σ 0.7500→0.5006 [idx 1] cm_err 0.0576 tgt 0.0567 lr 2.00e-06 gnorm 0.038 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:52:40] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step1500.safetensors 827 个张量 10.00 GB +[2026-09-10 03:52:55] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step1500.safetensors 827 个张量 10.00 GB +[2026-09-10 03:52:57] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 03:54:39] step 1520/8000 cd 0.00058 (ema 0.00479) σ 0.5006→0.2516 [idx 2] cm_err 0.0392 tgt 0.0387 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +[2026-09-10 03:56:21] step 1540/8000 cd 0.00084 (ema 0.00304) σ 0.7500→0.5006 [idx 1] cm_err 0.0488 tgt 0.0484 lr 2.00e-06 gnorm 0.014 decay 0.99 5.05s mem 56.4GB +[2026-09-10 03:58:04] step 1560/8000 cd 0.00096 (ema 0.00482) σ 0.7500→0.5006 [idx 1] cm_err 0.1041 tgt 0.1021 lr 2.00e-06 gnorm 0.030 decay 0.99 5.06s mem 56.4GB +[2026-09-10 03:59:46] step 1580/8000 cd 0.00061 (ema 0.00539) σ 0.5006→0.2516 [idx 2] cm_err 0.0362 tgt 0.0355 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +[2026-09-10 04:01:28] step 1600/8000 cd 0.01118 (ema 0.00605) σ 1.0000→0.7500 [idx 0] cm_err 0.1658 tgt 0.1676 lr 2.00e-06 gnorm 0.222 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:03:11] step 1620/8000 cd 0.00065 (ema 0.00389) σ 0.5006→0.2516 [idx 2] cm_err 0.0425 tgt 0.0412 lr 2.00e-06 gnorm 0.009 decay 0.99 5.88s mem 56.4GB +[2026-09-10 04:04:53] step 1640/8000 cd 0.01024 (ema 0.00708) σ 1.0000→0.7500 [idx 0] cm_err 0.3047 tgt 0.2987 lr 2.00e-06 gnorm 0.194 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:06:35] step 1660/8000 cd 0.01631 (ema 0.00742) σ 1.0000→0.7500 [idx 0] cm_err 0.1797 tgt 0.1803 lr 2.00e-06 gnorm 0.511 decay 0.99 5.07s mem 56.4GB +[2026-09-10 04:08:17] step 1680/8000 cd 0.00082 (ema 0.00385) σ 0.7500→0.5006 [idx 1] cm_err 0.0570 tgt 0.0562 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:10:00] step 1700/8000 cd 0.00061 (ema 0.00325) σ 0.5006→0.2516 [idx 2] cm_err 0.0614 tgt 0.0605 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:11:42] step 1720/8000 cd 0.00067 (ema 0.00873) σ 0.5006→0.2516 [idx 2] cm_err 0.0417 tgt 0.0411 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:13:24] step 1740/8000 cd 0.00105 (ema 0.00250) σ 0.7500→0.5006 [idx 1] cm_err 0.0615 tgt 0.0609 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +[2026-09-10 04:15:06] step 1760/8000 cd 0.02116 (ema 0.00458) σ 1.0000→0.7500 [idx 0] cm_err 0.2334 tgt 0.2316 lr 2.00e-06 gnorm 0.711 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:16:48] step 1780/8000 cd 0.00091 (ema 0.00746) σ 0.7500→0.5006 [idx 1] cm_err 0.0454 tgt 0.0451 lr 2.00e-06 gnorm 0.023 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:18:30] step 1800/8000 cd 0.00120 (ema 0.00469) σ 0.7500→0.5006 [idx 1] cm_err 0.0920 tgt 0.0911 lr 2.00e-06 gnorm 0.028 decay 0.99 5.07s mem 56.4GB +[2026-09-10 04:20:13] step 1820/8000 cd 0.00092 (ema 0.00657) σ 0.7500→0.5006 [idx 1] cm_err 0.0609 tgt 0.0604 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +[2026-09-10 04:21:55] step 1840/8000 cd 0.00109 (ema 0.00460) σ 0.7500→0.5006 [idx 1] cm_err 0.0897 tgt 0.0883 lr 2.00e-06 gnorm 0.030 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:23:37] step 1860/8000 cd 0.00096 (ema 0.00454) σ 0.7500→0.5006 [idx 1] cm_err 0.0556 tgt 0.0550 lr 2.00e-06 gnorm 0.031 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:25:19] step 1880/8000 cd 0.00061 (ema 0.00642) σ 0.5006→0.2516 [idx 2] cm_err 0.0355 tgt 0.0347 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:27:02] step 1900/8000 cd 0.00097 (ema 0.00377) σ 0.7500→0.5006 [idx 1] cm_err 0.0603 tgt 0.0597 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +[2026-09-10 04:28:44] step 1920/8000 cd 0.01042 (ema 0.00496) σ 1.0000→0.7500 [idx 0] cm_err 0.1550 tgt 0.1608 lr 2.00e-06 gnorm 0.225 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:30:26] step 1940/8000 cd 0.00107 (ema 0.00419) σ 0.7500→0.5006 [idx 1] cm_err 0.0380 tgt 0.0378 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:32:08] step 1960/8000 cd 0.00061 (ema 0.00424) σ 0.5006→0.2516 [idx 2] cm_err 0.0485 tgt 0.0477 lr 2.00e-06 gnorm 0.008 decay 0.99 5.07s mem 56.4GB +[2026-09-10 04:33:50] step 1980/8000 cd 0.00120 (ema 0.00450) σ 0.7500→0.5006 [idx 1] cm_err 0.0549 tgt 0.0544 lr 2.00e-06 gnorm 0.021 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:35:33] step 2000/8000 cd 0.00096 (ema 0.00466) σ 0.7500→0.5006 [idx 1] cm_err 0.0677 tgt 0.0669 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +[2026-09-10 04:35:43] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step2000.safetensors 827 个张量 10.00 GB +[2026-09-10 04:35:58] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step2000.safetensors 827 个张量 10.00 GB +[2026-09-10 04:36:00] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 04:37:42] step 2020/8000 cd 0.01544 (ema 0.00770) σ 1.0000→0.7500 [idx 0] cm_err 0.2528 tgt 0.2616 lr 2.00e-06 gnorm 0.318 decay 0.99 5.05s mem 56.4GB +[2026-09-10 04:39:25] step 2040/8000 cd 0.00087 (ema 0.00266) σ 0.7500→0.5006 [idx 1] cm_err 0.0492 tgt 0.0495 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:41:07] step 2060/8000 cd 0.01465 (ema 0.00514) σ 1.0000→0.7500 [idx 0] cm_err 0.1456 tgt 0.1429 lr 2.00e-06 gnorm 0.411 decay 0.99 5.07s mem 56.4GB +[2026-09-10 04:42:49] step 2080/8000 cd 0.00087 (ema 0.00249) σ 0.7500→0.5006 [idx 1] cm_err 0.0473 tgt 0.0466 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +[2026-09-10 04:44:31] step 2100/8000 cd 0.00058 (ema 0.00384) σ 0.5006→0.2516 [idx 2] cm_err 0.0446 tgt 0.0438 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:46:14] step 2120/8000 cd 0.00148 (ema 0.00470) σ 0.7500→0.5006 [idx 1] cm_err 0.0466 tgt 0.0459 lr 2.00e-06 gnorm 0.053 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:47:56] step 2140/8000 cd 0.00072 (ema 0.00520) σ 0.5006→0.2516 [idx 2] cm_err 0.0513 tgt 0.0500 lr 2.00e-06 gnorm 0.015 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:49:38] step 2160/8000 cd 0.00057 (ema 0.00348) σ 0.5006→0.2516 [idx 2] cm_err 0.0458 tgt 0.0448 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:51:20] step 2180/8000 cd 0.02909 (ema 0.00963) σ 1.0000→0.7500 [idx 0] cm_err 0.3351 tgt 0.3314 lr 2.00e-06 gnorm 0.520 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:53:02] step 2200/8000 cd 0.00116 (ema 0.00557) σ 0.7500→0.5006 [idx 1] cm_err 0.0902 tgt 0.0894 lr 2.00e-06 gnorm 0.038 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:54:44] step 2220/8000 cd 0.01201 (ema 0.00568) σ 1.0000→0.7500 [idx 0] cm_err 0.2446 tgt 0.2589 lr 2.00e-06 gnorm 0.294 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:56:26] step 2240/8000 cd 0.01801 (ema 0.00703) σ 1.0000→0.7500 [idx 0] cm_err 0.0623 tgt 0.0620 lr 2.00e-06 gnorm 0.465 decay 0.99 5.05s mem 56.4GB +[2026-09-10 04:58:09] step 2260/8000 cd 0.01048 (ema 0.00959) σ 1.0000→0.7500 [idx 0] cm_err 0.1846 tgt 0.1927 lr 2.00e-06 gnorm 0.219 decay 0.99 5.06s mem 56.4GB +[2026-09-10 04:59:51] step 2280/8000 cd 0.00077 (ema 0.00419) σ 0.7500→0.5006 [idx 1] cm_err 0.0635 tgt 0.0629 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +[2026-09-10 05:01:33] step 2300/8000 cd 0.00066 (ema 0.00592) σ 0.5006→0.2516 [idx 2] cm_err 0.0469 tgt 0.0459 lr 2.00e-06 gnorm 0.006 decay 0.99 5.07s mem 56.4GB +[2026-09-10 05:03:16] step 2320/8000 cd 0.01077 (ema 0.00333) σ 1.0000→0.7500 [idx 0] cm_err 0.1949 tgt 0.1989 lr 2.00e-06 gnorm 0.207 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:04:58] step 2340/8000 cd 0.00100 (ema 0.00601) σ 0.7500→0.5006 [idx 1] cm_err 0.1300 tgt 0.1280 lr 2.00e-06 gnorm 0.028 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:06:40] step 2360/8000 cd 0.00096 (ema 0.00725) σ 0.7500→0.5006 [idx 1] cm_err 0.0503 tgt 0.0498 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:08:22] step 2380/8000 cd 0.01130 (ema 0.00537) σ 1.0000→0.7500 [idx 0] cm_err 0.1482 tgt 0.1488 lr 2.00e-06 gnorm 0.341 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:10:04] step 2400/8000 cd 0.00061 (ema 0.00403) σ 0.5006→0.2516 [idx 2] cm_err 0.0324 tgt 0.0317 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:11:47] step 2420/8000 cd 0.00057 (ema 0.00445) σ 0.5006→0.2516 [idx 2] cm_err 0.0230 tgt 0.0226 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +[2026-09-10 05:13:29] step 2440/8000 cd 0.00088 (ema 0.00442) σ 0.7500→0.5006 [idx 1] cm_err 0.0651 tgt 0.0644 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:15:11] step 2460/8000 cd 0.01241 (ema 0.00457) σ 1.0000→0.7500 [idx 0] cm_err 0.3334 tgt 0.3463 lr 2.00e-06 gnorm 0.266 decay 0.99 5.07s mem 56.4GB +[2026-09-10 05:16:53] step 2480/8000 cd 0.01255 (ema 0.00410) σ 1.0000→0.7500 [idx 0] cm_err 0.3060 tgt 0.3188 lr 2.00e-06 gnorm 0.250 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:18:35] step 2500/8000 cd 0.01257 (ema 0.00502) σ 1.0000→0.7500 [idx 0] cm_err 0.1356 tgt 0.1354 lr 2.00e-06 gnorm 0.364 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:18:46] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step2500.safetensors 827 个张量 10.00 GB +[2026-09-10 05:19:02] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step2500.safetensors 827 个张量 10.00 GB +[2026-09-10 05:19:03] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 05:20:45] step 2520/8000 cd 0.00093 (ema 0.00369) σ 0.7500→0.5006 [idx 1] cm_err 0.0757 tgt 0.0749 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:22:28] step 2540/8000 cd 0.00103 (ema 0.00392) σ 0.7500→0.5006 [idx 1] cm_err 0.0576 tgt 0.0571 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:24:11] step 2560/8000 cd 0.00053 (ema 0.00514) σ 0.5006→0.2516 [idx 2] cm_err 0.0389 tgt 0.0381 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:25:53] step 2580/8000 cd 0.00095 (ema 0.00585) σ 0.7500→0.5006 [idx 1] cm_err 0.0521 tgt 0.0512 lr 2.00e-06 gnorm 0.024 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:27:35] step 2600/8000 cd 0.00108 (ema 0.00573) σ 0.7500→0.5006 [idx 1] cm_err 0.0580 tgt 0.0570 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:29:17] step 2620/8000 cd 0.00861 (ema 0.00335) σ 1.0000→0.7500 [idx 0] cm_err 0.1172 tgt 0.1208 lr 2.00e-06 gnorm 0.280 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:30:59] step 2640/8000 cd 0.00193 (ema 0.00446) σ 0.7500→0.5006 [idx 1] cm_err 0.1274 tgt 0.1244 lr 2.00e-06 gnorm 0.075 decay 0.99 5.07s mem 56.4GB +[2026-09-10 05:32:41] step 2660/8000 cd 0.01074 (ema 0.00683) σ 1.0000→0.7500 [idx 0] cm_err 0.2263 tgt 0.2217 lr 2.00e-06 gnorm 0.273 decay 0.99 5.05s mem 56.4GB +[2026-09-10 05:34:23] step 2680/8000 cd 0.00097 (ema 0.00751) σ 0.7500→0.5006 [idx 1] cm_err 0.0788 tgt 0.0777 lr 2.00e-06 gnorm 0.016 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:36:06] step 2700/8000 cd 0.00084 (ema 0.00205) σ 0.7500→0.5006 [idx 1] cm_err 0.0310 tgt 0.0303 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +[2026-09-10 05:37:48] step 2720/8000 cd 0.00097 (ema 0.00374) σ 0.7500→0.5006 [idx 1] cm_err 0.0739 tgt 0.0733 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:39:31] step 2740/8000 cd 0.00112 (ema 0.00550) σ 0.7500→0.5006 [idx 1] cm_err 0.0670 tgt 0.0659 lr 2.00e-06 gnorm 0.030 decay 0.99 5.09s mem 56.4GB +[2026-09-10 05:41:14] step 2760/8000 cd 0.00052 (ema 0.00331) σ 0.5006→0.2516 [idx 2] cm_err 0.0413 tgt 0.0407 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:42:56] step 2780/8000 cd 0.00096 (ema 0.00475) σ 0.7500→0.5006 [idx 1] cm_err 0.0624 tgt 0.0619 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:44:38] step 2800/8000 cd 0.00125 (ema 0.00606) σ 0.7500→0.5006 [idx 1] cm_err 0.0625 tgt 0.0610 lr 2.00e-06 gnorm 0.035 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:46:20] step 2820/8000 cd 0.00052 (ema 0.00412) σ 0.5006→0.2516 [idx 2] cm_err 0.0224 tgt 0.0217 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +[2026-09-10 05:48:02] step 2840/8000 cd 0.00951 (ema 0.00724) σ 1.0000→0.7500 [idx 0] cm_err 0.2601 tgt 0.2693 lr 2.00e-06 gnorm 0.142 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:49:45] step 2860/8000 cd 0.00055 (ema 0.00275) σ 0.5006→0.2516 [idx 2] cm_err 0.0452 tgt 0.0446 lr 2.00e-06 gnorm 0.005 decay 0.99 5.05s mem 56.4GB +[2026-09-10 05:51:27] step 2880/8000 cd 0.00862 (ema 0.00400) σ 1.0000→0.7500 [idx 0] cm_err 0.0812 tgt 0.0814 lr 2.00e-06 gnorm 0.197 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:53:10] step 2900/8000 cd 0.00093 (ema 0.00212) σ 0.7500→0.5006 [idx 1] cm_err 0.0859 tgt 0.0850 lr 2.00e-06 gnorm 0.009 decay 0.99 5.16s mem 56.4GB +[2026-09-10 05:54:52] step 2920/8000 cd 0.00051 (ema 0.00309) σ 0.5006→0.2516 [idx 2] cm_err 0.0318 tgt 0.0312 lr 2.00e-06 gnorm 0.007 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:56:34] step 2940/8000 cd 0.00074 (ema 0.00877) σ 0.5006→0.2516 [idx 2] cm_err 0.0519 tgt 0.0510 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:58:16] step 2960/8000 cd 0.00093 (ema 0.00367) σ 0.7500→0.5006 [idx 1] cm_err 0.0618 tgt 0.0610 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[2026-09-10 05:59:58] step 2980/8000 cd 0.01229 (ema 0.00609) σ 1.0000→0.7500 [idx 0] cm_err 0.1692 tgt 0.1662 lr 2.00e-06 gnorm 0.340 decay 0.99 5.05s mem 56.4GB +[2026-09-10 06:01:40] step 3000/8000 cd 0.00824 (ema 0.00931) σ 1.0000→0.7500 [idx 0] cm_err 0.2439 tgt 0.2477 lr 2.00e-06 gnorm 0.201 decay 0.99 5.05s mem 56.4GB +[2026-09-10 06:01:51] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step3000.safetensors 827 个张量 10.00 GB +[2026-09-10 06:02:06] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step3000.safetensors 827 个张量 10.00 GB +[2026-09-10 06:02:07] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 06:03:49] step 3020/8000 cd 0.00091 (ema 0.00706) σ 0.7500→0.5006 [idx 1] cm_err 0.0423 tgt 0.0416 lr 2.00e-06 gnorm 0.024 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:05:33] step 3040/8000 cd 0.00916 (ema 0.00493) σ 1.0000→0.7500 [idx 0] cm_err 0.3138 tgt 0.3200 lr 2.00e-06 gnorm 0.194 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:07:15] step 3060/8000 cd 0.00915 (ema 0.00489) σ 1.0000→0.7500 [idx 0] cm_err 0.1755 tgt 0.1762 lr 2.00e-06 gnorm 0.277 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:08:57] step 3080/8000 cd 0.01015 (ema 0.00522) σ 1.0000→0.7500 [idx 0] cm_err 0.1892 tgt 0.1907 lr 2.00e-06 gnorm 0.298 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:10:39] step 3100/8000 cd 0.00143 (ema 0.00404) σ 0.7500→0.5006 [idx 1] cm_err 0.0428 tgt 0.0422 lr 2.00e-06 gnorm 0.045 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:12:21] step 3120/8000 cd 0.00057 (ema 0.00343) σ 0.5006→0.2516 [idx 2] cm_err 0.0457 tgt 0.0447 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:14:03] step 3140/8000 cd 0.01110 (ema 0.00603) σ 1.0000→0.7500 [idx 0] cm_err 0.2483 tgt 0.2479 lr 2.00e-06 gnorm 0.252 decay 0.99 5.05s mem 56.4GB +[2026-09-10 06:15:46] step 3160/8000 cd 0.00059 (ema 0.00527) σ 0.5006→0.2516 [idx 2] cm_err 0.0489 tgt 0.0479 lr 2.00e-06 gnorm 0.006 decay 0.99 5.07s mem 56.4GB +[2026-09-10 06:17:28] step 3180/8000 cd 0.01475 (ema 0.00589) σ 1.0000→0.7500 [idx 0] cm_err 0.2153 tgt 0.2205 lr 2.00e-06 gnorm 0.412 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:19:11] step 3200/8000 cd 0.00056 (ema 0.00538) σ 0.5006→0.2516 [idx 2] cm_err 0.0438 tgt 0.0430 lr 2.00e-06 gnorm 0.013 decay 0.99 5.96s mem 56.4GB +[2026-09-10 06:20:53] step 3220/8000 cd 0.01866 (ema 0.00603) σ 1.0000→0.7500 [idx 0] cm_err 0.2699 tgt 0.2560 lr 2.00e-06 gnorm 0.489 decay 0.99 5.07s mem 56.4GB +[2026-09-10 06:22:35] step 3240/8000 cd 0.00061 (ema 0.00282) σ 0.5006→0.2516 [idx 2] cm_err 0.0414 tgt 0.0408 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:24:17] step 3260/8000 cd 0.01200 (ema 0.00678) σ 1.0000→0.7500 [idx 0] cm_err 0.1437 tgt 0.1455 lr 2.00e-06 gnorm 0.323 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:25:59] step 3280/8000 cd 0.00759 (ema 0.00329) σ 1.0000→0.7500 [idx 0] cm_err 0.1292 tgt 0.1302 lr 2.00e-06 gnorm 0.218 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:27:43] step 3300/8000 cd 0.01886 (ema 0.00711) σ 1.0000→0.7500 [idx 0] cm_err 0.2080 tgt 0.1961 lr 2.00e-06 gnorm 0.415 decay 0.99 5.07s mem 56.4GB +[2026-09-10 06:29:25] step 3320/8000 cd 0.00092 (ema 0.00386) σ 0.7500→0.5006 [idx 1] cm_err 0.0508 tgt 0.0506 lr 2.00e-06 gnorm 0.023 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:31:07] step 3340/8000 cd 0.00846 (ema 0.00499) σ 1.0000→0.7500 [idx 0] cm_err 0.3158 tgt 0.3273 lr 2.00e-06 gnorm 0.189 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:32:49] step 3360/8000 cd 0.00064 (ema 0.00389) σ 0.5006→0.2516 [idx 2] cm_err 0.0470 tgt 0.0457 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +[2026-09-10 06:34:31] step 3380/8000 cd 0.00066 (ema 0.00472) σ 0.5006→0.2516 [idx 2] cm_err 0.0843 tgt 0.0828 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:36:13] step 3400/8000 cd 0.03068 (ema 0.01040) σ 1.0000→0.7500 [idx 0] cm_err 0.2464 tgt 0.2540 lr 2.00e-06 gnorm 0.442 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:37:56] step 3420/8000 cd 0.00102 (ema 0.00626) σ 0.7500→0.5006 [idx 1] cm_err 0.0455 tgt 0.0444 lr 2.00e-06 gnorm 0.021 decay 0.99 5.07s mem 56.4GB +[2026-09-10 06:39:38] step 3440/8000 cd 0.00078 (ema 0.00270) σ 0.7500→0.5006 [idx 1] cm_err 0.0596 tgt 0.0590 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:41:20] step 3460/8000 cd 0.00094 (ema 0.00549) σ 0.7500→0.5006 [idx 1] cm_err 0.0752 tgt 0.0745 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:43:02] step 3480/8000 cd 0.01041 (ema 0.00421) σ 1.0000→0.7500 [idx 0] cm_err 0.1586 tgt 0.1551 lr 2.00e-06 gnorm 0.284 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:44:44] step 3500/8000 cd 0.00055 (ema 0.00479) σ 0.5006→0.2516 [idx 2] cm_err 0.0480 tgt 0.0469 lr 2.00e-06 gnorm 0.006 decay 0.99 5.07s mem 56.4GB +[2026-09-10 06:44:55] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step3500.safetensors 827 个张量 10.00 GB +[2026-09-10 06:45:10] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step3500.safetensors 827 个张量 10.00 GB +[2026-09-10 06:45:12] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 06:46:54] step 3520/8000 cd 0.00088 (ema 0.00332) σ 0.7500→0.5006 [idx 1] cm_err 0.0545 tgt 0.0540 lr 2.00e-06 gnorm 0.011 decay 0.99 5.07s mem 56.4GB +[2026-09-10 06:48:36] step 3540/8000 cd 0.01227 (ema 0.00556) σ 1.0000→0.7500 [idx 0] cm_err 0.1098 tgt 0.1098 lr 2.00e-06 gnorm 0.362 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:50:18] step 3560/8000 cd 0.01495 (ema 0.00602) σ 1.0000→0.7500 [idx 0] cm_err 0.2028 tgt 0.1921 lr 2.00e-06 gnorm 0.379 decay 0.99 5.07s mem 56.4GB +[2026-09-10 06:52:01] step 3580/8000 cd 0.01725 (ema 0.00956) σ 1.0000→0.7500 [idx 0] cm_err 0.1335 tgt 0.1343 lr 2.00e-06 gnorm 0.423 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:53:43] step 3600/8000 cd 0.01223 (ema 0.00434) σ 1.0000→0.7500 [idx 0] cm_err 0.2895 tgt 0.2975 lr 2.00e-06 gnorm 0.274 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:55:25] step 3620/8000 cd 0.00057 (ema 0.00549) σ 0.5006→0.2516 [idx 2] cm_err 0.0389 tgt 0.0381 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:57:07] step 3640/8000 cd 0.00102 (ema 0.00493) σ 0.7500→0.5006 [idx 1] cm_err 0.0578 tgt 0.0571 lr 2.00e-06 gnorm 0.022 decay 0.99 5.06s mem 56.4GB +[2026-09-10 06:58:49] step 3660/8000 cd 0.00063 (ema 0.00617) σ 0.5006→0.2516 [idx 2] cm_err 0.0686 tgt 0.0676 lr 2.00e-06 gnorm 0.013 decay 0.99 5.07s mem 56.4GB +[2026-09-10 07:00:31] step 3680/8000 cd 0.01036 (ema 0.00494) σ 1.0000→0.7500 [idx 0] cm_err 0.1474 tgt 0.1425 lr 2.00e-06 gnorm 0.252 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:02:14] step 3700/8000 cd 0.00090 (ema 0.00475) σ 0.7500→0.5006 [idx 1] cm_err 0.0599 tgt 0.0586 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:03:56] step 3720/8000 cd 0.00102 (ema 0.00576) σ 0.7500→0.5006 [idx 1] cm_err 0.0527 tgt 0.0520 lr 2.00e-06 gnorm 0.015 decay 0.99 5.07s mem 56.4GB +[2026-09-10 07:05:38] step 3740/8000 cd 0.01570 (ema 0.00608) σ 1.0000→0.7500 [idx 0] cm_err 0.1554 tgt 0.1433 lr 2.00e-06 gnorm 0.423 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:07:20] step 3760/8000 cd 0.00087 (ema 0.00338) σ 0.7500→0.5006 [idx 1] cm_err 0.0849 tgt 0.0837 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:09:02] step 3780/8000 cd 0.00057 (ema 0.00339) σ 0.5006→0.2516 [idx 2] cm_err 0.0361 tgt 0.0352 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:10:45] step 3800/8000 cd 0.00115 (ema 0.00636) σ 0.7500→0.5006 [idx 1] cm_err 0.0530 tgt 0.0515 lr 2.00e-06 gnorm 0.039 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:12:27] step 3820/8000 cd 0.00108 (ema 0.00333) σ 0.7500→0.5006 [idx 1] cm_err 0.0544 tgt 0.0537 lr 2.00e-06 gnorm 0.027 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:14:09] step 3840/8000 cd 0.00117 (ema 0.00579) σ 0.7500→0.5006 [idx 1] cm_err 0.0614 tgt 0.0603 lr 2.00e-06 gnorm 0.044 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:15:51] step 3860/8000 cd 0.00102 (ema 0.00603) σ 0.7500→0.5006 [idx 1] cm_err 0.0817 tgt 0.0809 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:17:33] step 3880/8000 cd 0.00097 (ema 0.00513) σ 0.7500→0.5006 [idx 1] cm_err 0.1079 tgt 0.1065 lr 2.00e-06 gnorm 0.015 decay 0.99 5.07s mem 56.4GB +[2026-09-10 07:19:16] step 3900/8000 cd 0.00063 (ema 0.00597) σ 0.5006→0.2516 [idx 2] cm_err 0.0458 tgt 0.0444 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +[2026-09-10 07:20:58] step 3920/8000 cd 0.00053 (ema 0.00331) σ 0.5006→0.2516 [idx 2] cm_err 0.0515 tgt 0.0505 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:22:40] step 3940/8000 cd 0.01254 (ema 0.00365) σ 1.0000→0.7500 [idx 0] cm_err 0.1956 tgt 0.1865 lr 2.00e-06 gnorm 0.328 decay 0.99 5.05s mem 56.4GB +[2026-09-10 07:24:22] step 3960/8000 cd 0.00863 (ema 0.00822) σ 1.0000→0.7500 [idx 0] cm_err 0.0838 tgt 0.0850 lr 2.00e-06 gnorm 0.157 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:26:05] step 3980/8000 cd 0.00091 (ema 0.00281) σ 0.7500→0.5006 [idx 1] cm_err 0.0738 tgt 0.0730 lr 2.00e-06 gnorm 0.008 decay 0.99 5.08s mem 56.4GB +[2026-09-10 07:27:47] step 4000/8000 cd 0.00090 (ema 0.00496) σ 0.7500→0.5006 [idx 1] cm_err 0.0633 tgt 0.0625 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:27:57] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step4000.safetensors 827 个张量 10.00 GB +[2026-09-10 07:28:14] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step4000.safetensors 827 个张量 10.00 GB +[2026-09-10 07:28:15] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 07:29:57] step 4020/8000 cd 0.00051 (ema 0.00386) σ 0.5006→0.2516 [idx 2] cm_err 0.0357 tgt 0.0346 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:31:40] step 4040/8000 cd 0.01014 (ema 0.00502) σ 1.0000→0.7500 [idx 0] cm_err 0.0988 tgt 0.1023 lr 2.00e-06 gnorm 0.296 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:33:22] step 4060/8000 cd 0.00934 (ema 0.00425) σ 1.0000→0.7500 [idx 0] cm_err 0.1293 tgt 0.1352 lr 2.00e-06 gnorm 0.253 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:35:04] step 4080/8000 cd 0.00105 (ema 0.00602) σ 0.7500→0.5006 [idx 1] cm_err 0.0352 tgt 0.0341 lr 2.00e-06 gnorm 0.038 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:36:46] step 4100/8000 cd 0.02041 (ema 0.00503) σ 1.0000→0.7500 [idx 0] cm_err 0.2482 tgt 0.2569 lr 2.00e-06 gnorm 0.518 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:38:28] step 4120/8000 cd 0.00590 (ema 0.00486) σ 1.0000→0.7500 [idx 0] cm_err 0.0542 tgt 0.0534 lr 2.00e-06 gnorm 0.099 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:40:10] step 4140/8000 cd 0.00083 (ema 0.00194) σ 0.7500→0.5006 [idx 1] cm_err 0.0316 tgt 0.0314 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:41:53] step 4160/8000 cd 0.00051 (ema 0.00384) σ 0.5006→0.2516 [idx 2] cm_err 0.0284 tgt 0.0278 lr 2.00e-06 gnorm 0.008 decay 0.99 5.07s mem 56.4GB +[2026-09-10 07:43:35] step 4180/8000 cd 0.00049 (ema 0.00135) σ 0.5006→0.2516 [idx 2] cm_err 0.0447 tgt 0.0436 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:45:17] step 4200/8000 cd 0.01110 (ema 0.00632) σ 1.0000→0.7500 [idx 0] cm_err 0.0995 tgt 0.0954 lr 2.00e-06 gnorm 0.230 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:46:59] step 4220/8000 cd 0.00096 (ema 0.00681) σ 0.7500→0.5006 [idx 1] cm_err 0.0742 tgt 0.0731 lr 2.00e-06 gnorm 0.020 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:48:42] step 4240/8000 cd 0.00061 (ema 0.00659) σ 0.5006→0.2516 [idx 2] cm_err 0.0606 tgt 0.0592 lr 2.00e-06 gnorm 0.011 decay 0.99 5.07s mem 56.4GB +[2026-09-10 07:50:24] step 4260/8000 cd 0.00106 (ema 0.00630) σ 0.7500→0.5006 [idx 1] cm_err 0.0440 tgt 0.0434 lr 2.00e-06 gnorm 0.047 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:52:06] step 4280/8000 cd 0.00065 (ema 0.00436) σ 0.5006→0.2516 [idx 2] cm_err 0.0715 tgt 0.0705 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:53:48] step 4300/8000 cd 0.00083 (ema 0.00235) σ 0.7500→0.5006 [idx 1] cm_err 0.0599 tgt 0.0591 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:55:30] step 4320/8000 cd 0.00990 (ema 0.00652) σ 1.0000→0.7500 [idx 0] cm_err 0.1270 tgt 0.1208 lr 2.00e-06 gnorm 0.287 decay 0.99 5.06s mem 56.4GB +[2026-09-10 07:57:12] step 4340/8000 cd 0.00056 (ema 0.00520) σ 0.5006→0.2516 [idx 2] cm_err 0.0478 tgt 0.0471 lr 2.00e-06 gnorm 0.007 decay 0.99 5.07s mem 56.4GB +[2026-09-10 07:58:54] step 4360/8000 cd 0.01104 (ema 0.00470) σ 1.0000→0.7500 [idx 0] cm_err 0.1553 tgt 0.1575 lr 2.00e-06 gnorm 0.345 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:00:36] step 4380/8000 cd 0.00166 (ema 0.00472) σ 0.7500→0.5006 [idx 1] cm_err 0.0569 tgt 0.0557 lr 2.00e-06 gnorm 0.067 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:02:19] step 4400/8000 cd 0.00093 (ema 0.00406) σ 0.7500→0.5006 [idx 1] cm_err 0.0796 tgt 0.0789 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:04:01] step 4420/8000 cd 0.00049 (ema 0.00351) σ 0.5006→0.2516 [idx 2] cm_err 0.0505 tgt 0.0496 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:05:43] step 4440/8000 cd 0.01184 (ema 0.00279) σ 1.0000→0.7500 [idx 0] cm_err 0.2598 tgt 0.2582 lr 2.00e-06 gnorm 0.277 decay 0.99 5.07s mem 56.4GB +[2026-09-10 08:07:25] step 4460/8000 cd 0.00090 (ema 0.00492) σ 0.7500→0.5006 [idx 1] cm_err 0.0466 tgt 0.0454 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +[2026-09-10 08:09:07] step 4480/8000 cd 0.00082 (ema 0.00312) σ 0.7500→0.5006 [idx 1] cm_err 0.0606 tgt 0.0602 lr 2.00e-06 gnorm 0.024 decay 0.99 5.07s mem 56.4GB +[2026-09-10 08:10:49] step 4500/8000 cd 0.01178 (ema 0.00317) σ 1.0000→0.7500 [idx 0] cm_err 0.1905 tgt 0.2081 lr 2.00e-06 gnorm 0.304 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:11:00] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step4500.safetensors 827 个张量 10.00 GB +[2026-09-10 08:11:16] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step4500.safetensors 827 个张量 10.00 GB +[2026-09-10 08:11:18] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 08:13:00] step 4520/8000 cd 0.00098 (ema 0.00445) σ 0.7500→0.5006 [idx 1] cm_err 0.0543 tgt 0.0535 lr 2.00e-06 gnorm 0.016 decay 0.99 5.07s mem 56.4GB +[2026-09-10 08:14:42] step 4540/8000 cd 0.00088 (ema 0.00255) σ 0.7500→0.5006 [idx 1] cm_err 0.0553 tgt 0.0549 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:16:24] step 4560/8000 cd 0.01320 (ema 0.00844) σ 1.0000→0.7500 [idx 0] cm_err 0.1088 tgt 0.1053 lr 2.00e-06 gnorm 0.342 decay 0.99 5.07s mem 56.4GB +[2026-09-10 08:18:06] step 4580/8000 cd 0.00098 (ema 0.00494) σ 0.7500→0.5006 [idx 1] cm_err 0.0585 tgt 0.0576 lr 2.00e-06 gnorm 0.031 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:19:49] step 4600/8000 cd 0.01044 (ema 0.00357) σ 1.0000→0.7500 [idx 0] cm_err 0.2378 tgt 0.2290 lr 2.00e-06 gnorm 0.227 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:21:31] step 4620/8000 cd 0.00082 (ema 0.00407) σ 0.7500→0.5006 [idx 1] cm_err 0.0815 tgt 0.0803 lr 2.00e-06 gnorm 0.015 decay 0.99 5.07s mem 56.4GB +[2026-09-10 08:23:13] step 4640/8000 cd 0.00059 (ema 0.00441) σ 0.5006→0.2516 [idx 2] cm_err 0.0419 tgt 0.0410 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:24:55] step 4660/8000 cd 0.01260 (ema 0.00903) σ 1.0000→0.7500 [idx 0] cm_err 0.2888 tgt 0.2917 lr 2.00e-06 gnorm 0.275 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:26:37] step 4680/8000 cd 0.00084 (ema 0.00365) σ 0.7500→0.5006 [idx 1] cm_err 0.0414 tgt 0.0408 lr 2.00e-06 gnorm 0.020 decay 0.99 5.05s mem 56.4GB +[2026-09-10 08:28:20] step 4700/8000 cd 0.01073 (ema 0.00275) σ 1.0000→0.7500 [idx 0] cm_err 0.2724 tgt 0.2789 lr 2.00e-06 gnorm 0.198 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:30:02] step 4720/8000 cd 0.00106 (ema 0.00331) σ 0.7500→0.5006 [idx 1] cm_err 0.0882 tgt 0.0871 lr 2.00e-06 gnorm 0.029 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:31:44] step 4740/8000 cd 0.00098 (ema 0.00419) σ 0.7500→0.5006 [idx 1] cm_err 0.0597 tgt 0.0590 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:33:26] step 4760/8000 cd 0.00087 (ema 0.00275) σ 0.7500→0.5006 [idx 1] cm_err 0.0468 tgt 0.0461 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:35:08] step 4780/8000 cd 0.00046 (ema 0.00459) σ 0.5006→0.2516 [idx 2] cm_err 0.0442 tgt 0.0430 lr 2.00e-06 gnorm 0.006 decay 0.99 5.05s mem 56.4GB +[2026-09-10 08:36:52] step 4800/8000 cd 0.00107 (ema 0.00555) σ 0.7500→0.5006 [idx 1] cm_err 0.0837 tgt 0.0817 lr 2.00e-06 gnorm 0.028 decay 0.99 5.07s mem 56.4GB +[2026-09-10 08:38:34] step 4820/8000 cd 0.00057 (ema 0.00439) σ 0.5006→0.2516 [idx 2] cm_err 0.0554 tgt 0.0542 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +[2026-09-10 08:40:17] step 4840/8000 cd 0.00095 (ema 0.00263) σ 0.7500→0.5006 [idx 1] cm_err 0.0713 tgt 0.0703 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:41:59] step 4860/8000 cd 0.00094 (ema 0.00579) σ 0.7500→0.5006 [idx 1] cm_err 0.0647 tgt 0.0637 lr 2.00e-06 gnorm 0.018 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:43:42] step 4880/8000 cd 0.00137 (ema 0.00566) σ 0.7500→0.5006 [idx 1] cm_err 0.0606 tgt 0.0587 lr 2.00e-06 gnorm 0.068 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:45:24] step 4900/8000 cd 0.00117 (ema 0.00430) σ 0.7500→0.5006 [idx 1] cm_err 0.0939 tgt 0.0924 lr 2.00e-06 gnorm 0.024 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:47:06] step 4920/8000 cd 0.00086 (ema 0.00368) σ 0.7500→0.5006 [idx 1] cm_err 0.1211 tgt 0.1198 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:48:48] step 4940/8000 cd 0.00094 (ema 0.00267) σ 0.7500→0.5006 [idx 1] cm_err 0.0603 tgt 0.0596 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +[2026-09-10 08:50:30] step 4960/8000 cd 0.00056 (ema 0.00259) σ 0.5006→0.2516 [idx 2] cm_err 0.0395 tgt 0.0387 lr 2.00e-06 gnorm 0.004 decay 0.99 5.07s mem 56.4GB +[2026-09-10 08:52:12] step 4980/8000 cd 0.00054 (ema 0.00462) σ 0.5006→0.2516 [idx 2] cm_err 0.0781 tgt 0.0773 lr 2.00e-06 gnorm 0.007 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:53:54] step 5000/8000 cd 0.01469 (ema 0.00685) σ 1.0000→0.7500 [idx 0] cm_err 0.2082 tgt 0.2092 lr 2.00e-06 gnorm 0.407 decay 0.99 5.06s mem 56.4GB +[2026-09-10 08:54:06] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step5000.safetensors 827 个张量 10.00 GB +[2026-09-10 08:54:21] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step5000.safetensors 827 个张量 10.00 GB +[2026-09-10 08:54:22] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 08:56:04] step 5020/8000 cd 0.00056 (ema 0.00336) σ 0.5006→0.2516 [idx 2] cm_err 0.0483 tgt 0.0476 lr 2.00e-06 gnorm 0.009 decay 0.99 5.07s mem 56.4GB +[2026-09-10 08:57:47] step 5040/8000 cd 0.01108 (ema 0.00550) σ 1.0000→0.7500 [idx 0] cm_err 0.1684 tgt 0.1651 lr 2.00e-06 gnorm 0.264 decay 0.99 5.05s mem 56.4GB +[2026-09-10 08:59:29] step 5060/8000 cd 0.01288 (ema 0.00797) σ 1.0000→0.7500 [idx 0] cm_err 0.3076 tgt 0.3028 lr 2.00e-06 gnorm 0.239 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:01:11] step 5080/8000 cd 0.01043 (ema 0.00602) σ 1.0000→0.7500 [idx 0] cm_err 0.1665 tgt 0.1703 lr 2.00e-06 gnorm 0.273 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:02:53] step 5100/8000 cd 0.00077 (ema 0.00344) σ 0.7500→0.5006 [idx 1] cm_err 0.0708 tgt 0.0704 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:04:36] step 5120/8000 cd 0.00893 (ema 0.00363) σ 1.0000→0.7500 [idx 0] cm_err 0.2257 tgt 0.2337 lr 2.00e-06 gnorm 0.184 decay 0.99 5.08s mem 56.4GB +[2026-09-10 09:06:19] step 5140/8000 cd 0.00050 (ema 0.00207) σ 0.5006→0.2516 [idx 2] cm_err 0.0431 tgt 0.0425 lr 2.00e-06 gnorm 0.006 decay 0.99 5.05s mem 56.4GB +[2026-09-10 09:08:01] step 5160/8000 cd 0.00096 (ema 0.00261) σ 0.7500→0.5006 [idx 1] cm_err 0.0654 tgt 0.0646 lr 2.00e-06 gnorm 0.015 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:09:43] step 5180/8000 cd 0.00051 (ema 0.00195) σ 0.5006→0.2516 [idx 2] cm_err 0.0429 tgt 0.0420 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:11:25] step 5200/8000 cd 0.01234 (ema 0.00374) σ 1.0000→0.7500 [idx 0] cm_err 0.1777 tgt 0.1777 lr 2.00e-06 gnorm 0.307 decay 0.99 5.05s mem 56.4GB +[2026-09-10 09:13:07] step 5220/8000 cd 0.00085 (ema 0.00240) σ 0.7500→0.5006 [idx 1] cm_err 0.0767 tgt 0.0761 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +[2026-09-10 09:14:49] step 5240/8000 cd 0.00121 (ema 0.00545) σ 0.7500→0.5006 [idx 1] cm_err 0.0548 tgt 0.0531 lr 2.00e-06 gnorm 0.044 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:16:31] step 5260/8000 cd 0.00092 (ema 0.00284) σ 0.7500→0.5006 [idx 1] cm_err 0.0742 tgt 0.0728 lr 2.00e-06 gnorm 0.011 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:18:13] step 5280/8000 cd 0.00084 (ema 0.00456) σ 0.7500→0.5006 [idx 1] cm_err 0.0463 tgt 0.0455 lr 2.00e-06 gnorm 0.010 decay 0.99 5.07s mem 56.4GB +[2026-09-10 09:19:57] step 5300/8000 cd 0.01331 (ema 0.00397) σ 1.0000→0.7500 [idx 0] cm_err 0.2281 tgt 0.2382 lr 2.00e-06 gnorm 0.292 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:21:39] step 5320/8000 cd 0.00104 (ema 0.00478) σ 0.7500→0.5006 [idx 1] cm_err 0.0573 tgt 0.0561 lr 2.00e-06 gnorm 0.059 decay 0.99 5.07s mem 56.4GB +[2026-09-10 09:23:21] step 5340/8000 cd 0.00136 (ema 0.00744) σ 0.7500→0.5006 [idx 1] cm_err 0.0685 tgt 0.0673 lr 2.00e-06 gnorm 0.054 decay 0.99 5.07s mem 56.4GB +[2026-09-10 09:25:03] step 5360/8000 cd 0.01140 (ema 0.00500) σ 1.0000→0.7500 [idx 0] cm_err 0.0994 tgt 0.1027 lr 2.00e-06 gnorm 0.212 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:26:45] step 5380/8000 cd 0.00086 (ema 0.00275) σ 0.7500→0.5006 [idx 1] cm_err 0.0347 tgt 0.0343 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:28:27] step 5400/8000 cd 0.00776 (ema 0.00415) σ 1.0000→0.7500 [idx 0] cm_err 0.1232 tgt 0.1185 lr 2.00e-06 gnorm 0.185 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:30:11] step 5420/8000 cd 0.00052 (ema 0.00297) σ 0.5006→0.2516 [idx 2] cm_err 0.0369 tgt 0.0363 lr 2.00e-06 gnorm 0.009 decay 0.99 6.20s mem 56.4GB +[2026-09-10 09:31:53] step 5440/8000 cd 0.00079 (ema 0.00389) σ 0.7500→0.5006 [idx 1] cm_err 0.0198 tgt 0.0196 lr 2.00e-06 gnorm 0.009 decay 0.99 5.09s mem 56.4GB +[2026-09-10 09:33:35] step 5460/8000 cd 0.00139 (ema 0.00482) σ 0.7500→0.5006 [idx 1] cm_err 0.0516 tgt 0.0505 lr 2.00e-06 gnorm 0.055 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:35:17] step 5480/8000 cd 0.00044 (ema 0.00272) σ 0.5006→0.2516 [idx 2] cm_err 0.0682 tgt 0.0673 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:36:59] step 5500/8000 cd 0.01257 (ema 0.00361) σ 1.0000→0.7500 [idx 0] cm_err 0.1372 tgt 0.1424 lr 2.00e-06 gnorm 0.329 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:37:10] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step5500.safetensors 827 个张量 10.00 GB +[2026-09-10 09:37:25] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step5500.safetensors 827 个张量 10.00 GB +[2026-09-10 09:37:26] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 09:39:08] step 5520/8000 cd 0.00129 (ema 0.00401) σ 0.7500→0.5006 [idx 1] cm_err 0.0618 tgt 0.0609 lr 2.00e-06 gnorm 0.046 decay 0.99 5.07s mem 56.4GB +[2026-09-10 09:40:51] step 5540/8000 cd 0.00112 (ema 0.00503) σ 0.7500→0.5006 [idx 1] cm_err 0.0766 tgt 0.0760 lr 2.00e-06 gnorm 0.041 decay 0.99 5.07s mem 56.4GB +[2026-09-10 09:42:33] step 5560/8000 cd 0.00060 (ema 0.00512) σ 0.5006→0.2516 [idx 2] cm_err 0.0509 tgt 0.0496 lr 2.00e-06 gnorm 0.011 decay 0.99 5.05s mem 56.4GB +[2026-09-10 09:44:15] step 5580/8000 cd 0.01663 (ema 0.00585) σ 1.0000→0.7500 [idx 0] cm_err 0.1580 tgt 0.1557 lr 2.00e-06 gnorm 0.449 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:45:58] step 5600/8000 cd 0.00106 (ema 0.00448) σ 0.7500→0.5006 [idx 1] cm_err 0.0521 tgt 0.0516 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +[2026-09-10 09:47:40] step 5620/8000 cd 0.00087 (ema 0.00497) σ 0.7500→0.5006 [idx 1] cm_err 0.0438 tgt 0.0432 lr 2.00e-06 gnorm 0.020 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:49:22] step 5640/8000 cd 0.01473 (ema 0.00912) σ 1.0000→0.7500 [idx 0] cm_err 0.2025 tgt 0.2012 lr 2.00e-06 gnorm 0.324 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:51:04] step 5660/8000 cd 0.00058 (ema 0.00500) σ 0.5006→0.2516 [idx 2] cm_err 0.0513 tgt 0.0504 lr 2.00e-06 gnorm 0.014 decay 0.99 5.05s mem 56.4GB +[2026-09-10 09:52:47] step 5680/8000 cd 0.01229 (ema 0.00385) σ 1.0000→0.7500 [idx 0] cm_err 0.1477 tgt 0.1402 lr 2.00e-06 gnorm 0.321 decay 0.99 5.07s mem 56.4GB +[2026-09-10 09:54:29] step 5700/8000 cd 0.00948 (ema 0.00400) σ 1.0000→0.7500 [idx 0] cm_err 0.1595 tgt 0.1634 lr 2.00e-06 gnorm 0.185 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:56:12] step 5720/8000 cd 0.00050 (ema 0.00161) σ 0.5006→0.2516 [idx 2] cm_err 0.0327 tgt 0.0320 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:57:54] step 5740/8000 cd 0.00048 (ema 0.00313) σ 0.5006→0.2516 [idx 2] cm_err 0.0554 tgt 0.0544 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +[2026-09-10 09:59:37] step 5760/8000 cd 0.00053 (ema 0.00332) σ 0.5006→0.2516 [idx 2] cm_err 0.0427 tgt 0.0418 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:01:19] step 5780/8000 cd 0.00056 (ema 0.00496) σ 0.5006→0.2516 [idx 2] cm_err 0.0194 tgt 0.0187 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:03:02] step 5800/8000 cd 0.00081 (ema 0.00638) σ 0.7500→0.5006 [idx 1] cm_err 0.0556 tgt 0.0548 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +[2026-09-10 10:04:44] step 5820/8000 cd 0.00099 (ema 0.00298) σ 0.7500→0.5006 [idx 1] cm_err 0.0783 tgt 0.0768 lr 2.00e-06 gnorm 0.010 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:06:26] step 5840/8000 cd 0.00108 (ema 0.00467) σ 0.7500→0.5006 [idx 1] cm_err 0.0750 tgt 0.0742 lr 2.00e-06 gnorm 0.040 decay 0.99 5.07s mem 56.4GB +[2026-09-10 10:08:08] step 5860/8000 cd 0.00099 (ema 0.00541) σ 0.7500→0.5006 [idx 1] cm_err 0.0664 tgt 0.0660 lr 2.00e-06 gnorm 0.046 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:09:51] step 5880/8000 cd 0.01138 (ema 0.00470) σ 1.0000→0.7500 [idx 0] cm_err 0.1302 tgt 0.1294 lr 2.00e-06 gnorm 0.261 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:11:33] step 5900/8000 cd 0.01493 (ema 0.00483) σ 1.0000→0.7500 [idx 0] cm_err 0.2021 tgt 0.2025 lr 2.00e-06 gnorm 0.381 decay 0.99 5.05s mem 56.4GB +[2026-09-10 10:13:15] step 5920/8000 cd 0.00094 (ema 0.00359) σ 0.7500→0.5006 [idx 1] cm_err 0.1049 tgt 0.1035 lr 2.00e-06 gnorm 0.021 decay 0.99 5.07s mem 56.4GB +[2026-09-10 10:14:57] step 5940/8000 cd 0.01159 (ema 0.00328) σ 1.0000→0.7500 [idx 0] cm_err 0.2350 tgt 0.2379 lr 2.00e-06 gnorm 0.223 decay 0.99 5.05s mem 56.4GB +[2026-09-10 10:16:39] step 5960/8000 cd 0.00958 (ema 0.00297) σ 1.0000→0.7500 [idx 0] cm_err 0.2493 tgt 0.2507 lr 2.00e-06 gnorm 0.222 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:18:22] step 5980/8000 cd 0.00106 (ema 0.00426) σ 0.7500→0.5006 [idx 1] cm_err 0.0427 tgt 0.0422 lr 2.00e-06 gnorm 0.028 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:20:04] step 6000/8000 cd 0.01442 (ema 0.00680) σ 1.0000→0.7500 [idx 0] cm_err 0.1174 tgt 0.1134 lr 2.00e-06 gnorm 0.321 decay 0.99 5.05s mem 56.4GB +[2026-09-10 10:20:15] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step6000.safetensors 827 个张量 10.00 GB +[2026-09-10 10:20:30] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step6000.safetensors 827 个张量 10.00 GB +[2026-09-10 10:20:31] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 10:22:14] step 6020/8000 cd 0.00077 (ema 0.00584) σ 0.7500→0.5006 [idx 1] cm_err 0.0320 tgt 0.0313 lr 2.00e-06 gnorm 0.012 decay 0.99 5.07s mem 56.4GB +[2026-09-10 10:23:57] step 6040/8000 cd 0.00056 (ema 0.00432) σ 0.5006→0.2516 [idx 2] cm_err 0.0347 tgt 0.0337 lr 2.00e-06 gnorm 0.008 decay 0.99 5.05s mem 56.4GB +[2026-09-10 10:25:39] step 6060/8000 cd 0.00058 (ema 0.00469) σ 0.5006→0.2516 [idx 2] cm_err 0.0405 tgt 0.0396 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:27:21] step 6080/8000 cd 0.00055 (ema 0.00581) σ 0.5006→0.2516 [idx 2] cm_err 0.0359 tgt 0.0347 lr 2.00e-06 gnorm 0.007 decay 0.99 5.05s mem 56.4GB +[2026-09-10 10:29:03] step 6100/8000 cd 0.00058 (ema 0.00308) σ 0.5006→0.2516 [idx 2] cm_err 0.0664 tgt 0.0650 lr 2.00e-06 gnorm 0.009 decay 0.99 5.05s mem 56.4GB +[2026-09-10 10:30:47] step 6120/8000 cd 0.00104 (ema 0.00364) σ 0.7500→0.5006 [idx 1] cm_err 0.0621 tgt 0.0608 lr 2.00e-06 gnorm 0.023 decay 0.99 5.07s mem 56.4GB +[2026-09-10 10:32:29] step 6140/8000 cd 0.01080 (ema 0.00607) σ 1.0000→0.7500 [idx 0] cm_err 0.1918 tgt 0.1914 lr 2.00e-06 gnorm 0.212 decay 0.99 5.07s mem 56.4GB +[2026-09-10 10:34:11] step 6160/8000 cd 0.01188 (ema 0.00819) σ 1.0000→0.7500 [idx 0] cm_err 0.2502 tgt 0.2539 lr 2.00e-06 gnorm 0.237 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:35:53] step 6180/8000 cd 0.00133 (ema 0.00517) σ 0.7500→0.5006 [idx 1] cm_err 0.0589 tgt 0.0582 lr 2.00e-06 gnorm 0.055 decay 0.99 5.07s mem 56.4GB +[2026-09-10 10:37:35] step 6200/8000 cd 0.00051 (ema 0.00344) σ 0.5006→0.2516 [idx 2] cm_err 0.0405 tgt 0.0398 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:39:17] step 6220/8000 cd 0.00091 (ema 0.00231) σ 0.7500→0.5006 [idx 1] cm_err 0.0503 tgt 0.0493 lr 2.00e-06 gnorm 0.034 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:40:59] step 6240/8000 cd 0.00088 (ema 0.00500) σ 0.7500→0.5006 [idx 1] cm_err 0.0713 tgt 0.0706 lr 2.00e-06 gnorm 0.009 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:42:41] step 6260/8000 cd 0.00125 (ema 0.00526) σ 0.7500→0.5006 [idx 1] cm_err 0.0484 tgt 0.0469 lr 2.00e-06 gnorm 0.066 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:44:24] step 6280/8000 cd 0.00053 (ema 0.00449) σ 0.5006→0.2516 [idx 2] cm_err 0.0580 tgt 0.0572 lr 2.00e-06 gnorm 0.005 decay 0.99 5.05s mem 56.4GB +[2026-09-10 10:46:06] step 6300/8000 cd 0.00055 (ema 0.00501) σ 0.5006→0.2516 [idx 2] cm_err 0.0422 tgt 0.0411 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:47:48] step 6320/8000 cd 0.00839 (ema 0.00393) σ 1.0000→0.7500 [idx 0] cm_err 0.0791 tgt 0.0784 lr 2.00e-06 gnorm 0.178 decay 0.99 5.05s mem 56.4GB +[2026-09-10 10:49:30] step 6340/8000 cd 0.00142 (ema 0.00283) σ 0.7500→0.5006 [idx 1] cm_err 0.0793 tgt 0.0774 lr 2.00e-06 gnorm 0.050 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:51:12] step 6360/8000 cd 0.01346 (ema 0.00543) σ 1.0000→0.7500 [idx 0] cm_err 0.1882 tgt 0.1928 lr 2.00e-06 gnorm 0.323 decay 0.99 5.07s mem 56.4GB +[2026-09-10 10:52:54] step 6380/8000 cd 0.00084 (ema 0.00352) σ 0.7500→0.5006 [idx 1] cm_err 0.0474 tgt 0.0467 lr 2.00e-06 gnorm 0.012 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:54:36] step 6400/8000 cd 0.00049 (ema 0.00451) σ 0.5006→0.2516 [idx 2] cm_err 0.0577 tgt 0.0564 lr 2.00e-06 gnorm 0.005 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:56:19] step 6420/8000 cd 0.00052 (ema 0.00428) σ 0.5006→0.2516 [idx 2] cm_err 0.0665 tgt 0.0654 lr 2.00e-06 gnorm 0.006 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:58:01] step 6440/8000 cd 0.01540 (ema 0.00701) σ 1.0000→0.7500 [idx 0] cm_err 0.2276 tgt 0.2388 lr 2.00e-06 gnorm 0.285 decay 0.99 5.06s mem 56.4GB +[2026-09-10 10:59:43] step 6460/8000 cd 0.00119 (ema 0.00556) σ 0.7500→0.5006 [idx 1] cm_err 0.0688 tgt 0.0668 lr 2.00e-06 gnorm 0.029 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:01:25] step 6480/8000 cd 0.00057 (ema 0.00390) σ 0.5006→0.2516 [idx 2] cm_err 0.0660 tgt 0.0646 lr 2.00e-06 gnorm 0.007 decay 0.99 5.07s mem 56.4GB +[2026-09-10 11:03:07] step 6500/8000 cd 0.00676 (ema 0.00373) σ 1.0000→0.7500 [idx 0] cm_err 0.1278 tgt 0.1353 lr 2.00e-06 gnorm 0.132 decay 0.99 5.07s mem 56.4GB +[2026-09-10 11:03:18] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step6500.safetensors 827 个张量 10.00 GB +[2026-09-10 11:03:33] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step6500.safetensors 827 个张量 10.00 GB +[2026-09-10 11:03:35] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) +[2026-09-10 11:05:17] step 6520/8000 cd 0.00112 (ema 0.00632) σ 0.7500→0.5006 [idx 1] cm_err 0.0622 tgt 0.0609 lr 2.00e-06 gnorm 0.034 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:06:59] step 6540/8000 cd 0.00988 (ema 0.00446) σ 1.0000→0.7500 [idx 0] cm_err 0.0971 tgt 0.0896 lr 2.00e-06 gnorm 0.184 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:08:41] step 6560/8000 cd 0.00088 (ema 0.00271) σ 0.7500→0.5006 [idx 1] cm_err 0.0621 tgt 0.0610 lr 2.00e-06 gnorm 0.014 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:10:23] step 6580/8000 cd 0.01266 (ema 0.00320) σ 1.0000→0.7500 [idx 0] cm_err 0.1525 tgt 0.1590 lr 2.00e-06 gnorm 0.334 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:12:06] step 6600/8000 cd 0.00090 (ema 0.00284) σ 0.7500→0.5006 [idx 1] cm_err 0.0618 tgt 0.0610 lr 2.00e-06 gnorm 0.015 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:13:48] step 6620/8000 cd 0.00048 (ema 0.00296) σ 0.5006→0.2516 [idx 2] cm_err 0.0370 tgt 0.0362 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:15:31] step 6640/8000 cd 0.01536 (ema 0.00645) σ 1.0000→0.7500 [idx 0] cm_err 0.1734 tgt 0.1719 lr 2.00e-06 gnorm 0.373 decay 0.99 5.07s mem 56.4GB +[2026-09-10 11:17:13] step 6660/8000 cd 0.00121 (ema 0.00425) σ 0.7500→0.5006 [idx 1] cm_err 0.0752 tgt 0.0739 lr 2.00e-06 gnorm 0.054 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:18:57] step 6680/8000 cd 0.00047 (ema 0.00204) σ 0.5006→0.2516 [idx 2] cm_err 0.0549 tgt 0.0538 lr 2.00e-06 gnorm 0.004 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:20:39] step 6700/8000 cd 0.01336 (ema 0.00589) σ 1.0000→0.7500 [idx 0] cm_err 0.2160 tgt 0.2173 lr 2.00e-06 gnorm 0.294 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:22:22] step 6720/8000 cd 0.00046 (ema 0.00477) σ 0.5006→0.2516 [idx 2] cm_err 0.0496 tgt 0.0485 lr 2.00e-06 gnorm 0.004 decay 0.99 5.05s mem 56.4GB +[2026-09-10 11:24:05] step 6740/8000 cd 0.00955 (ema 0.00533) σ 1.0000→0.7500 [idx 0] cm_err 0.2307 tgt 0.2325 lr 2.00e-06 gnorm 0.216 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:25:47] step 6760/8000 cd 0.00058 (ema 0.00384) σ 0.5006→0.2516 [idx 2] cm_err 0.0435 tgt 0.0423 lr 2.00e-06 gnorm 0.017 decay 0.99 5.07s mem 56.4GB +[2026-09-10 11:27:29] step 6780/8000 cd 0.00053 (ema 0.00415) σ 0.5006→0.2516 [idx 2] cm_err 0.0400 tgt 0.0389 lr 2.00e-06 gnorm 0.008 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:29:11] step 6800/8000 cd 0.01733 (ema 0.00754) σ 1.0000→0.7500 [idx 0] cm_err 0.2233 tgt 0.2111 lr 2.00e-06 gnorm 0.346 decay 0.99 5.05s mem 56.4GB +[2026-09-10 11:30:53] step 6820/8000 cd 0.00127 (ema 0.00488) σ 0.7500→0.5006 [idx 1] cm_err 0.0711 tgt 0.0698 lr 2.00e-06 gnorm 0.017 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:32:36] step 6840/8000 cd 0.01192 (ema 0.00530) σ 1.0000→0.7500 [idx 0] cm_err 0.2127 tgt 0.2123 lr 2.00e-06 gnorm 0.245 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:34:18] step 6860/8000 cd 0.00842 (ema 0.00579) σ 1.0000→0.7500 [idx 0] cm_err 0.1606 tgt 0.1612 lr 2.00e-06 gnorm 0.154 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:36:02] step 6880/8000 cd 0.00131 (ema 0.00435) σ 0.7500→0.5006 [idx 1] cm_err 0.0491 tgt 0.0476 lr 2.00e-06 gnorm 0.034 decay 0.99 5.07s mem 56.4GB +[2026-09-10 11:37:44] step 6900/8000 cd 0.01266 (ema 0.00535) σ 1.0000→0.7500 [idx 0] cm_err 0.1372 tgt 0.1378 lr 2.00e-06 gnorm 0.283 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:39:26] step 6920/8000 cd 0.00098 (ema 0.00694) σ 0.7500→0.5006 [idx 1] cm_err 0.1273 tgt 0.1259 lr 2.00e-06 gnorm 0.021 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:41:08] step 6940/8000 cd 0.00053 (ema 0.00307) σ 0.5006→0.2516 [idx 2] cm_err 0.0327 tgt 0.0319 lr 2.00e-06 gnorm 0.008 decay 0.99 5.08s mem 56.4GB +[2026-09-10 11:42:52] step 6960/8000 cd 0.01088 (ema 0.00377) σ 1.0000→0.7500 [idx 0] cm_err 0.1689 tgt 0.1653 lr 2.00e-06 gnorm 0.301 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:44:34] step 6980/8000 cd 0.01076 (ema 0.00451) σ 1.0000→0.7500 [idx 0] cm_err 0.1134 tgt 0.1148 lr 2.00e-06 gnorm 0.223 decay 0.99 5.05s mem 56.4GB +[2026-09-10 11:46:16] step 7000/8000 cd 0.00065 (ema 0.00490) σ 0.5006→0.2516 [idx 2] cm_err 0.0461 tgt 0.0447 lr 2.00e-06 gnorm 0.013 decay 0.99 5.06s mem 56.4GB +[2026-09-10 11:46:27] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/dits/dit_step7000.safetensors 827 个张量 10.00 GB +[2026-09-10 11:46:42] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step7000.safetensors 827 个张量 10.00 GB +[2026-09-10 11:46:43] [rotate] 删掉 1 个旧 dit(留 2)、0 个旧 ema(留 25) diff --git a/backup_2026-09-14/runs/distill__stage2_cd/train_log.csv b/backup_2026-09-14/runs/distill__stage2_cd/train_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..a5964a210ac2944d1d9980aa70940219dec98a96 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage2_cd/train_log.csv @@ -0,0 +1,351 @@ +step,cd,cm_err,tgt_err,idx,sigma_t,sigma_tn,ema_decay,lr,grad_norm,step_time,mem_gb,epoch +20,0.01827838644385338,0.09716010838747025,0.11210180073976517,0,1.0,0.7500000596046448,0.0,4e-07,0.3673185110092163,5.060669660568237,56.38771200180054,0 +40,0.003406259696930647,0.04690786078572273,0.04869311302900314,1,0.7500000596046448,0.5005995631217957,0.0,8e-07,0.06457383185625076,5.051936388015747,56.38771200180054,0 +60,0.0032868762500584126,0.04812023043632507,0.05084490403532982,1,0.7500000596046448,0.5005995631217957,0.0,1.2e-06,0.055386386811733246,5.058555364608765,56.38771200180054,0 +80,0.035025689750909805,0.2446930855512619,0.23502548038959503,0,1.0,0.7500000596046448,0.0,1.6e-06,1.3743236064910889,5.238378047943115,56.38771200180054,0 +100,0.022290494292974472,0.3274001181125641,0.3252542018890381,0,1.0,0.7500000596046448,0.0,2e-06,0.6360182762145996,5.0505592823028564,56.38771200180054,0 +120,0.001048450474627316,0.04244422912597656,0.04365476220846176,2,0.5005995631217957,0.25159743428230286,0.0,2e-06,0.021713808178901672,5.058173894882202,56.38771200180054,0 +140,0.0010765150655061007,0.05179610848426819,0.05080118775367737,2,0.5005995631217957,0.25159743428230286,0.0,2e-06,0.030220208689570427,5.0684428215026855,56.38771200180054,0 +160,0.02082497626543045,0.15522539615631104,0.14423605799674988,0,1.0,0.7500000596046448,0.0,2e-06,0.6941612362861633,5.062642574310303,56.38771200180054,0 +180,0.01940074749290943,0.2187945693731308,0.21998712420463562,0,1.0,0.7500000596046448,0.0,2e-06,0.543795108795166,5.05155873298645,56.38771200180054,0 +200,0.0011022898834198713,0.05482785403728485,0.05091198906302452,2,0.5005995631217957,0.25159743428230286,0.0,2e-06,0.026264557614922523,5.059942007064819,56.38771200180054,0 +220,0.0019404774066060781,0.07163272798061371,0.07139050215482712,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03184139356017113,5.056513071060181,56.38771200180054,0 +240,0.01537327654659748,0.10758252441883087,0.11604785174131393,0,1.0,0.7500000596046448,0.99,2e-06,0.4506058990955353,5.062234401702881,56.38771200180054,0 +260,0.0008996270480565727,0.06675225496292114,0.06446336209774017,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.015989745035767555,5.0597083568573,56.38771200180054,0 +280,0.0010805745841935277,0.08440084755420685,0.08517728000879288,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.013144209049642086,5.059044361114502,56.38771200180054,0 +300,0.0011238089064136147,0.04780145734548569,0.045558083802461624,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.025494243949651718,5.0615174770355225,56.38771200180054,0 +320,0.0008328570984303951,0.060081128031015396,0.05890467390418053,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.009995515458285809,5.066356182098389,56.38771200180054,0 +340,0.016631970182061195,0.17775505781173706,0.18773314356803894,0,1.0,0.7500000596046448,0.99,2e-06,0.4158477783203125,5.055193185806274,56.38771200180054,0 +360,0.001682050060480833,0.10635417699813843,0.10517356544733047,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.04309070482850075,5.0638415813446045,56.38771200180054,0 +380,0.013907892629504204,0.2778439521789551,0.2906274199485779,0,1.0,0.7500000596046448,0.99,2e-06,0.35930508375167847,5.064307451248169,56.38771200180054,0 +400,0.0020589090418070555,0.07262993603944778,0.07047944515943527,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.04977040737867355,5.06887412071228,56.38771200180054,0 +420,0.0010337396524846554,0.07155134528875351,0.06945569813251495,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.014175884425640106,5.0642125606536865,56.38771200180054,0 +440,0.0012568202801048756,0.057593755424022675,0.057558540254831314,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.030823104083538055,5.055058240890503,56.38771200180054,0 +460,0.0009244830580428243,0.05842915177345276,0.05551374703645706,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.019046805799007416,5.062133550643921,56.38771200180054,0 +480,0.01890374720096588,0.2567084729671478,0.2469038963317871,0,1.0,0.7500000596046448,0.99,2e-06,0.5884650349617004,5.064032316207886,56.38771200180054,0 +500,0.0011976907262578607,0.07407093048095703,0.07410448044538498,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.01215167436748743,5.05858039855957,56.38771200180054,0 +520,0.0012601769994944334,0.056109972298145294,0.056312546133995056,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.032193977385759354,5.072680234909058,56.38771200180054,0 +540,0.0008222705218940973,0.034352995455265045,0.033442310988903046,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.008410682901740074,5.063419580459595,56.38771200180054,0 +560,0.0008178128628060222,0.0463779978454113,0.0450718030333519,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.01128112617880106,5.063088417053223,56.38771200180054,0 +580,0.0007711322978138924,0.03369623050093651,0.03277071565389633,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.008260955102741718,5.054129362106323,56.38771200180054,0 +600,0.0010095484321936965,0.0710928663611412,0.06975628435611725,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.01514104288071394,5.0535972118377686,56.38771200180054,0 +620,0.014359503984451294,0.13757069408893585,0.1407361477613449,0,1.0,0.7500000596046448,0.99,2e-06,0.2861105799674988,5.065933704376221,56.38771200180054,0 +640,0.012152640148997307,0.09776665270328522,0.10334203392267227,0,1.0,0.7500000596046448,0.99,2e-06,0.33500808477401733,5.068272113800049,56.38771200180054,0 +660,0.012676159851253033,0.19334207475185394,0.19118385016918182,0,1.0,0.7500000596046448,0.99,2e-06,0.3471643328666687,5.060567855834961,56.38771200180054,0 +680,0.01612100377678871,0.11352086067199707,0.11493761092424393,0,1.0,0.7500000596046448,0.99,2e-06,0.5542276501655579,5.0629284381866455,56.38771200180054,0 +700,0.0011317915050312877,0.038320399820804596,0.037972304970026016,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.01563861407339573,5.068158864974976,56.38771200180054,0 +720,0.01525923516601324,0.19531604647636414,0.20552344620227814,0,1.0,0.7500000596046448,0.99,2e-06,0.465323805809021,5.064419507980347,56.38771200180054,0 +740,0.001048605889081955,0.06794850528240204,0.06775812804698944,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.014100970700383186,5.071784496307373,56.38771200180054,0 +760,0.0010670543415471911,0.0536823496222496,0.05397908389568329,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.015774141997098923,5.059787034988403,56.38771200180054,0 +780,0.0007669265032745898,0.01694578491151333,0.016433773562312126,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.010533615946769714,5.058711290359497,56.38771200180054,0 +800,0.0007780274609103799,0.03447554260492325,0.03384784981608391,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.009975644759833813,5.060992002487183,56.38771200180054,0 +820,0.01183614693582058,0.3708093762397766,0.3898044228553772,0,1.0,0.7500000596046448,0.99,2e-06,0.24261516332626343,5.062435626983643,56.38771200180054,0 +840,0.014863220974802971,0.13549675047397614,0.1355631798505783,0,1.0,0.7500000596046448,0.99,2e-06,0.4878523647785187,5.056114435195923,56.38771200180054,0 +860,0.0010631310287863016,0.06554722785949707,0.06506453454494476,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.01378917321562767,5.059438705444336,56.38771200180054,0 +880,0.0008867374272085726,0.07878604531288147,0.07799538224935532,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.01115897111594677,5.060117959976196,56.38771200180054,0 +900,0.0011625972110778093,0.11506462097167969,0.11381230503320694,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.032396718859672546,5.063167333602905,56.38771200180054,0 +920,0.0010128853609785438,0.06643103063106537,0.06588007509708405,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.023282648995518684,5.055160999298096,56.38771200180054,0 +940,0.024296540766954422,0.1247347816824913,0.10986850410699844,0,1.0,0.7500000596046448,0.99,2e-06,0.8151572346687317,5.056500434875488,56.38771200180054,0 +960,0.0010570569429546595,0.08382797986268997,0.08379434794187546,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.027212973684072495,5.063722372055054,56.38771200180054,0 +980,0.0009713540785014629,0.03850819170475006,0.03832164406776428,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.018173592165112495,5.053111553192139,56.38771200180054,0 +1000,0.010825924575328827,0.13927966356277466,0.14418081939220428,0,1.0,0.7500000596046448,0.99,2e-06,0.25783678889274597,5.0613226890563965,56.38771200180054,0 +1020,0.001055444823578,0.08802896738052368,0.08685727417469025,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.012018009088933468,5.068908214569092,56.38771200180054,0 +1040,0.020598117262125015,0.2940708100795746,0.3140166401863098,0,1.0,0.7500000596046448,0.99,2e-06,0.5526158213615417,5.053521156311035,56.38771200180054,0 +1060,0.0011654243571683764,0.057740747928619385,0.057193562388420105,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.022052710875868797,5.061650991439819,56.38771200180054,0 +1080,0.0010861668270081282,0.06616777181625366,0.0653689056634903,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.021072136238217354,5.0628790855407715,56.38771200180054,0 +1100,0.001177732483483851,0.06417758762836456,0.06408531963825226,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.020482320338487625,5.076736211776733,56.38771200180054,0 +1120,0.0006771426415070891,0.04326954856514931,0.04230382293462753,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.00907924398779869,5.062955141067505,56.38771200180054,0 +1140,0.0010889674304053187,0.09440385550260544,0.09315575659275055,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02881621941924095,5.148689031600952,56.38771200180054,0 +1160,0.014185917563736439,0.21675121784210205,0.21788932383060455,0,1.0,0.7500000596046448,0.99,2e-06,0.45246779918670654,5.059247016906738,56.38771200180054,0 +1180,0.0006254066247493029,0.029027899727225304,0.028424719348549843,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.0065567768178880215,5.068078994750977,56.38771200180054,0 +1200,0.0007011267589405179,0.04256269708275795,0.04151264205574989,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.011261158622801304,5.059755563735962,56.38771200180054,0 +1220,0.000590375391766429,0.039838992059230804,0.03878261521458626,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.012864967808127403,5.062994003295898,56.38771200180054,0 +1240,0.009421873837709427,0.21421055495738983,0.21643440425395966,0,1.0,0.7500000596046448,0.99,2e-06,0.2928905487060547,5.055883884429932,56.38771200180054,0 +1260,0.011799059808254242,0.15732453763484955,0.16221663355827332,0,1.0,0.7500000596046448,0.99,2e-06,0.3493827283382416,5.064734697341919,56.38771200180054,0 +1280,0.0006340479012578726,0.038308802992105484,0.037743646651506424,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.009033526293933392,5.059248208999634,56.38771200180054,0 +1300,0.000997594790533185,0.04221211373806,0.041811663657426834,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.010971725918352604,5.062187910079956,56.38771200180054,0 +1320,0.010550612583756447,0.1694936603307724,0.17210662364959717,0,1.0,0.7500000596046448,0.99,2e-06,0.31959688663482666,5.063008069992065,56.38771200180054,0 +1340,0.0012640922795981169,0.05801603943109512,0.05746092647314072,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.0320579893887043,5.060144662857056,56.38771200180054,0 +1360,0.0005872668698430061,0.04754013568162918,0.04644814133644104,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.008514315821230412,5.066190481185913,56.38771200180054,0 +1380,0.01047357264906168,0.1503176987171173,0.15400691330432892,0,1.0,0.7500000596046448,0.99,2e-06,0.19216816127300262,5.063100099563599,56.38771200180054,0 +1400,0.01681935042142868,0.14467734098434448,0.14019295573234558,0,1.0,0.7500000596046448,0.99,2e-06,0.6383833289146423,5.065027952194214,56.38771200180054,0 +1420,0.0006193367298692465,0.04834633320569992,0.04746940732002258,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.008151284419000149,5.068614482879639,56.38771200180054,0 +1440,0.010484333150088787,0.1541564166545868,0.1544545441865921,0,1.0,0.7500000596046448,0.99,2e-06,0.37412935495376587,5.0611536502838135,56.38771200180054,0 +1460,0.0009787153685465455,0.03852106258273125,0.03833712637424469,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.027493637055158615,5.070557594299316,56.38771200180054,0 +1480,0.012242655269801617,0.18115974962711334,0.17821218073368073,0,1.0,0.7500000596046448,0.99,2e-06,0.3936578333377838,5.06015944480896,56.38771200180054,0 +1500,0.001189732225611806,0.05756925791501999,0.05670394375920296,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03844234719872475,5.063022613525391,56.38771200180054,0 +1520,0.0005849719746038318,0.03923720493912697,0.03871762380003929,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.007198174484074116,5.052259683609009,56.38771200180054,0 +1540,0.0008363510714843869,0.048767004162073135,0.04841926321387291,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.014147319830954075,5.0509421825408936,56.38771200180054,0 +1560,0.0009557782905176282,0.10412389039993286,0.1021152138710022,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.029684945940971375,5.064115524291992,56.38771200180054,0 +1580,0.0006110453978180885,0.03623628243803978,0.03546812757849693,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.00998839084059,5.073540687561035,56.38771200180054,0 +1600,0.011184336617588997,0.16577591001987457,0.16764752566814423,0,1.0,0.7500000596046448,0.99,2e-06,0.22185198962688446,5.059337139129639,56.38771200180054,0 +1620,0.0006478576106019318,0.04245228320360184,0.0412106029689312,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.009389813989400864,5.8790647983551025,56.38771200180054,0 +1640,0.010235603898763657,0.3046947717666626,0.2987469434738159,0,1.0,0.7500000596046448,0.99,2e-06,0.19364309310913086,5.061208009719849,56.38771200180054,0 +1660,0.016307881101965904,0.17965102195739746,0.18026980757713318,0,1.0,0.7500000596046448,0.99,2e-06,0.5114054083824158,5.066022872924805,56.38771200180054,0 +1680,0.000823465408757329,0.05700196698307991,0.05618280917406082,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.013040866702795029,5.064005613327026,56.38771200180054,0 +1700,0.000613836687989533,0.06135471910238266,0.06051967293024063,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.007739753928035498,5.061410903930664,56.38771200180054,0 +1720,0.0006683884421363473,0.04166693240404129,0.04107964038848877,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.01182146929204464,5.057540655136108,56.38771200180054,0 +1740,0.0010542256059125066,0.06154580041766167,0.06091490015387535,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.012629344128072262,5.0661890506744385,56.38771200180054,0 +1760,0.021157361567020416,0.23337802290916443,0.2316107451915741,0,1.0,0.7500000596046448,0.99,2e-06,0.7113266587257385,5.062011003494263,56.38771200180054,0 +1780,0.0009101604809984565,0.04544875770807266,0.045119449496269226,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02312169224023819,5.060841083526611,56.38771200180054,0 +1800,0.0012046336196362972,0.09195134788751602,0.0910838395357132,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.027986256405711174,5.0715625286102295,56.38771200180054,0 +1820,0.0009238782804459333,0.06092608720064163,0.060439180582761765,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.016486430540680885,5.069711446762085,56.38771200180054,0 +1840,0.001091929618269205,0.08967430889606476,0.08834826946258545,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.029808329418301582,5.060809135437012,56.38771200180054,0 +1860,0.00096363655757159,0.055600959807634354,0.05499744415283203,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.031059451401233673,5.058576345443726,56.38771200180054,0 +1880,0.0006110554677434266,0.0354740284383297,0.03466542437672615,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.009621180593967438,5.064002990722656,56.38771200180054,0 +1900,0.0009708545403555036,0.06025996804237366,0.05968809500336647,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.012677202932536602,5.066894054412842,56.38771200180054,0 +1920,0.010420628823339939,0.15504494309425354,0.16077107191085815,0,1.0,0.7500000596046448,0.99,2e-06,0.22452406585216522,5.057934045791626,56.38771200180054,0 +1940,0.0010680063860490918,0.038030240684747696,0.03776043280959129,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.016922052949666977,5.0557873249053955,56.38771200180054,0 +1960,0.000606600078754127,0.048530157655477524,0.04765024036169052,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.007799726445227861,5.073480129241943,56.38771200180054,0 +1980,0.0012016945984214544,0.054850947111845016,0.05439111217856407,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02113170176744461,5.064334392547607,56.38771200180054,0 +2000,0.0009612760040909052,0.06768635660409927,0.06689360737800598,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.017021533101797104,5.065054893493652,56.38771200180054,0 +2020,0.01544116996228695,0.2528165876865387,0.2615910768508911,0,1.0,0.7500000596046448,0.99,2e-06,0.3175307512283325,5.054285764694214,56.38771200180054,0 +2040,0.0008695375872775912,0.04919774830341339,0.04945218563079834,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.012270614504814148,5.063606262207031,56.38771200180054,0 +2060,0.014646925032138824,0.1456320583820343,0.14285512268543243,0,1.0,0.7500000596046448,0.99,2e-06,0.41076862812042236,5.06771183013916,56.38771200180054,0 +2080,0.0008741579949855804,0.047254420816898346,0.046610597521066666,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.01000580657273531,5.067353010177612,56.38771200180054,0 +2100,0.0005808873102068901,0.04456717148423195,0.043786510825157166,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005920877680182457,5.058941125869751,56.38771200180054,0 +2120,0.0014807147672399879,0.04660264775156975,0.04593783989548683,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.052813559770584106,5.064321279525757,56.38771200180054,0 +2140,0.0007155337953008711,0.05131537467241287,0.05004637688398361,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.015280653722584248,5.055006504058838,56.38771200180054,0 +2160,0.0005658860318362713,0.04575396701693535,0.044842351227998734,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005156466271728277,5.0599963665008545,56.38771200180054,0 +2180,0.029093194752931595,0.33514443039894104,0.33143359422683716,0,1.0,0.7500000596046448,0.99,2e-06,0.52040696144104,5.06105899810791,56.38771200180054,0 +2200,0.0011636660201475024,0.09017688781023026,0.08942927420139313,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03780451416969299,5.060491323471069,56.38771200180054,0 +2220,0.012009272351861,0.24459189176559448,0.25886330008506775,0,1.0,0.7500000596046448,0.99,2e-06,0.29403311014175415,5.061809062957764,56.38771200180054,0 +2240,0.018010541796684265,0.062258247286081314,0.06202968955039978,0,1.0,0.7500000596046448,0.99,2e-06,0.4652538001537323,5.054781436920166,56.38771200180054,0 +2260,0.010479619726538658,0.18462711572647095,0.19265207648277283,0,1.0,0.7500000596046448,0.99,2e-06,0.21897722780704498,5.055635452270508,56.38771200180054,0 +2280,0.0007658180547878146,0.06345418840646744,0.0628809705376625,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.009392944164574146,5.06856369972229,56.38771200180054,0 +2300,0.0006635135505348444,0.046871401369571686,0.04594692215323448,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.006323561072349548,5.070437908172607,56.38771200180054,0 +2320,0.010767115280032158,0.19491970539093018,0.19887879490852356,0,1.0,0.7500000596046448,0.99,2e-06,0.20683036744594574,5.0642290115356445,56.38771200180054,1 +2340,0.0010049553820863366,0.13002395629882812,0.12804053723812103,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.028073012828826904,5.058224439620972,56.38771200180054,1 +2360,0.0009561302722431719,0.05031692981719971,0.04980551078915596,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.0182854812592268,5.064601898193359,56.38771200180054,1 +2380,0.011295095086097717,0.14819128811359406,0.1488056480884552,0,1.0,0.7500000596046448,0.99,2e-06,0.34139880537986755,5.059497117996216,56.38771200180054,1 +2400,0.0006078648148104548,0.032437097281217575,0.03169967234134674,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.010131518356502056,5.058937072753906,56.38771200180054,1 +2420,0.0005698833847418427,0.023019572719931602,0.022576695308089256,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.008887439034879208,5.070709943771362,56.38771200180054,1 +2440,0.0008842228562571108,0.06507683545351028,0.06439052522182465,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011105579324066639,5.061678409576416,56.38771200180054,1 +2460,0.012408901937305927,0.33337676525115967,0.34632810950279236,0,1.0,0.7500000596046448,0.99,2e-06,0.2658180594444275,5.067145586013794,56.38771200180054,1 +2480,0.012552551925182343,0.30600252747535706,0.3188140094280243,0,1.0,0.7500000596046448,0.99,2e-06,0.2502790689468384,5.06211519241333,56.38771200180054,1 +2500,0.01256629265844822,0.13558249175548553,0.13538935780525208,0,1.0,0.7500000596046448,0.99,2e-06,0.36425501108169556,5.0591044425964355,56.38771200180054,1 +2520,0.000929803354665637,0.07568717002868652,0.07485201209783554,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.017696131020784378,5.062560319900513,56.38771200180054,1 +2540,0.0010276060784235597,0.057584937661886215,0.05711369216442108,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.017533881589770317,5.061218023300171,56.38771200180054,1 +2560,0.0005290332483127713,0.038915347307920456,0.03813331946730614,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.00827897246927023,5.062098264694214,56.38771200180054,1 +2580,0.0009528399095870554,0.052059356123209,0.05115938559174538,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.024441637098789215,5.059697151184082,56.38771200180054,1 +2600,0.0010812925174832344,0.05801090970635414,0.05703580752015114,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.010146668180823326,5.063089370727539,56.38771200180054,1 +2620,0.00860743410885334,0.11716074496507645,0.1208263412117958,0,1.0,0.7500000596046448,0.99,2e-06,0.2796608507633209,5.059341907501221,56.38771200180054,1 +2640,0.0019306337926536798,0.1274002492427826,0.12437094748020172,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.07504304498434067,5.06626558303833,56.38771200180054,1 +2660,0.01073644869029522,0.22634750604629517,0.22172030806541443,0,1.0,0.7500000596046448,0.99,2e-06,0.27313950657844543,5.054538726806641,56.38771200180054,1 +2680,0.0009657965274527669,0.0788058340549469,0.07771987468004227,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.016288815066218376,5.060086965560913,56.38771200180054,1 +2700,0.0008373342570848763,0.030961375683546066,0.030328525230288506,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.013210942968726158,5.067880153656006,56.38771200180054,1 +2720,0.0009697524947114289,0.07394779473543167,0.0733167976140976,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02162245102226734,5.057621717453003,56.38771200180054,1 +2740,0.0011195387924090028,0.06699588149785995,0.06587514281272888,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03035837598145008,5.090397596359253,56.38771200180054,1 +2760,0.0005239140009507537,0.04127097129821777,0.04074548929929733,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.004790979437530041,5.060705900192261,56.38771200180054,1 +2780,0.0009562819031998515,0.062388405203819275,0.06186763942241669,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.01073712483048439,5.057812929153442,56.38771200180054,1 +2800,0.001245915307663381,0.06249675527215004,0.06096513569355011,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03466729447245598,5.062829494476318,56.38771200180054,1 +2820,0.000519353139679879,0.022424060851335526,0.021724257618188858,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.006807949393987656,5.0526628494262695,56.38771200180054,1 +2840,0.009509282186627388,0.2601481080055237,0.2693132162094116,0,1.0,0.7500000596046448,0.99,2e-06,0.14211001992225647,5.064896106719971,56.38771200180054,1 +2860,0.0005494898650795221,0.04520736262202263,0.04462487995624542,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.004835042636841536,5.053674221038818,56.38771200180054,1 +2880,0.008623247966170311,0.08119063079357147,0.0814361572265625,0,1.0,0.7500000596046448,0.99,2e-06,0.19698281586170197,5.057736873626709,56.38771200180054,1 +2900,0.0009263716638088226,0.08586885780096054,0.08499511331319809,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.008506977930665016,5.157921075820923,56.38771200180054,1 +2920,0.0005109858466312289,0.03181673586368561,0.031214745715260506,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.006659648846834898,5.0640411376953125,56.38771200180054,1 +2940,0.0007394165731966496,0.05192045122385025,0.05099868029356003,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.016935920342803,5.055063724517822,56.38771200180054,1 +2960,0.0009346787119284272,0.06176777556538582,0.061012379825115204,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.009078874252736568,5.058701753616333,56.38771200180054,1 +2980,0.012291941791772842,0.16917186975479126,0.1662353128194809,0,1.0,0.7500000596046448,0.99,2e-06,0.33994629979133606,5.0510194301605225,56.38771200180054,1 +3000,0.008241433650255203,0.24394409358501434,0.24766303598880768,0,1.0,0.7500000596046448,0.99,2e-06,0.2011115550994873,5.0543389320373535,56.38771200180054,1 +3020,0.0009050903609022498,0.0422515794634819,0.04156965762376785,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.023958781734108925,5.061312675476074,56.38771200180054,1 +3040,0.00916388351470232,0.3137814998626709,0.31995710730552673,0,1.0,0.7500000596046448,0.99,2e-06,0.19364593923091888,5.0611701011657715,56.38771200180054,1 +3060,0.009146288968622684,0.17547588050365448,0.17618927359580994,0,1.0,0.7500000596046448,0.99,2e-06,0.27693071961402893,5.064642667770386,56.38771200180054,1 +3080,0.010152108035981655,0.18922826647758484,0.1907459795475006,0,1.0,0.7500000596046448,0.99,2e-06,0.2978287637233734,5.064574241638184,56.38771200180054,1 +3100,0.0014291161205619574,0.042820174247026443,0.042218733578920364,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.04523439705371857,5.0594093799591064,56.38771200180054,1 +3120,0.0005694905412383378,0.04571829363703728,0.04466211423277855,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.004539474844932556,5.06084132194519,56.38771200180054,1 +3140,0.011104116216301918,0.24828658998012543,0.24788904190063477,0,1.0,0.7500000596046448,0.99,2e-06,0.25214308500289917,5.054645538330078,56.38771200180054,1 +3160,0.0005923707503825426,0.048904694616794586,0.04793832451105118,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005649378523230553,5.069479465484619,56.38771200180054,1 +3180,0.014748908579349518,0.21526102721691132,0.2205415964126587,0,1.0,0.7500000596046448,0.99,2e-06,0.4120456278324127,5.055433750152588,56.38771200180054,1 +3200,0.0005562839796766639,0.04383109137415886,0.04297938570380211,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.013030430302023888,5.963607549667358,56.38771200180054,1 +3220,0.018660493195056915,0.2698647677898407,0.2559719681739807,0,1.0,0.7500000596046448,0.99,2e-06,0.48874691128730774,5.070037364959717,56.38771200180054,1 +3240,0.0006083443877287209,0.04144035279750824,0.04079555720090866,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.004620192106813192,5.064998388290405,56.38771200180054,1 +3260,0.012002556584775448,0.14370442926883698,0.14545093476772308,0,1.0,0.7500000596046448,0.99,2e-06,0.3233167231082916,5.055517673492432,56.38771200180054,1 +3280,0.007590288296341896,0.12920375168323517,0.13023699820041656,0,1.0,0.7500000596046448,0.99,2e-06,0.2179732769727707,5.06210732460022,56.38771200180054,1 +3300,0.01885918900370598,0.20803454518318176,0.19608773291110992,0,1.0,0.7500000596046448,0.99,2e-06,0.4153673052787781,5.071369171142578,56.38771200180054,1 +3320,0.0009192632278427482,0.050802018493413925,0.05056607350707054,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.0232150349766016,5.061207056045532,56.38771200180054,1 +3340,0.008457032032310963,0.315839946269989,0.3272708058357239,0,1.0,0.7500000596046448,0.99,2e-06,0.18947917222976685,5.061925888061523,56.38771200180054,1 +3360,0.0006414042436517775,0.04699088633060455,0.0456698015332222,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.01677154190838337,5.065008640289307,56.38771200180054,1 +3380,0.00065956125035882,0.08429210633039474,0.08275076746940613,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.008738297037780285,5.062710523605347,56.38771200180054,1 +3400,0.030684715136885643,0.2464066594839096,0.2539760172367096,0,1.0,0.7500000596046448,0.99,2e-06,0.44213125109672546,5.064715385437012,56.38771200180054,1 +3420,0.0010165049461647868,0.04551756754517555,0.044416457414627075,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02147577330470085,5.0664122104644775,56.38771200180054,1 +3440,0.0007802406908012927,0.0595581978559494,0.05895444005727768,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.008647589944303036,5.058807134628296,56.38771200180054,1 +3460,0.0009419292910024524,0.07518661022186279,0.07447471469640732,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.022169454023241997,5.061892509460449,56.38771200180054,1 +3480,0.010412978008389473,0.15859809517860413,0.15507973730564117,0,1.0,0.7500000596046448,0.99,2e-06,0.28392016887664795,5.064546823501587,56.38771200180054,1 +3500,0.0005506200832314789,0.047970931977033615,0.046850867569446564,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005616833921521902,5.066096305847168,56.38771200180054,1 +3520,0.0008803460514172912,0.0545177236199379,0.05402153730392456,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011257604695856571,5.066094875335693,56.38771200180054,1 +3540,0.012265413999557495,0.10984887927770615,0.10978805273771286,0,1.0,0.7500000596046448,0.99,2e-06,0.36217832565307617,5.059243440628052,56.38771200180054,1 +3560,0.01495078019797802,0.20275461673736572,0.192142516374588,0,1.0,0.7500000596046448,0.99,2e-06,0.37917226552963257,5.068431377410889,56.38771200180054,1 +3580,0.017249057069420815,0.13349169492721558,0.1342991292476654,0,1.0,0.7500000596046448,0.99,2e-06,0.4230024814605713,5.059803009033203,56.38771200180054,1 +3600,0.012225274927914143,0.2894558012485504,0.29749149084091187,0,1.0,0.7500000596046448,0.99,2e-06,0.2739367187023163,5.063302755355835,56.38771200180054,1 +3620,0.000567674171179533,0.038936637341976166,0.03805459663271904,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.006105348467826843,5.0598297119140625,56.38771200180054,1 +3640,0.001017908682115376,0.057763054966926575,0.05706019327044487,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.022046109661459923,5.064643621444702,56.38771200180054,1 +3660,0.0006325655267573893,0.0686098262667656,0.06762504577636719,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.01252914872020483,5.06798791885376,56.38771200180054,1 +3680,0.010357745923101902,0.14741884171962738,0.14254142343997955,0,1.0,0.7500000596046448,0.99,2e-06,0.2518216371536255,5.062629222869873,56.38771200180054,1 +3700,0.0009017152478918433,0.05986059829592705,0.05859268084168434,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.010595773346722126,5.063277244567871,56.38771200180054,1 +3720,0.0010199041571468115,0.05270032584667206,0.0519779808819294,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.015440419316291809,5.067992925643921,56.38771200180054,1 +3740,0.015697594732046127,0.15538345277309418,0.1433132141828537,0,1.0,0.7500000596046448,0.99,2e-06,0.42347845435142517,5.060793399810791,56.38771200180054,1 +3760,0.0008670458337292075,0.08488186448812485,0.08371292799711227,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011613368056714535,5.0626208782196045,56.38771200180054,1 +3780,0.0005735052982345223,0.03614116087555885,0.035166822373867035,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.006035343743860722,5.062826156616211,56.38771200180054,1 +3800,0.0011510567273944616,0.052970852702856064,0.051486194133758545,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03922879695892334,5.055853605270386,56.38771200180054,1 +3820,0.001075186999514699,0.05437479168176651,0.053689226508140564,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.026740964502096176,5.058966159820557,56.38771200180054,1 +3840,0.0011713157873600721,0.06137072294950485,0.06025834381580353,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.04436686635017395,5.062925815582275,56.38771200180054,1 +3860,0.001021661562845111,0.08172792196273804,0.08086597919464111,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011688591912388802,5.0638720989227295,56.38771200180054,1 +3880,0.0009695059270597994,0.10792340338230133,0.10648213326931,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.014839310199022293,5.066259384155273,56.38771200180054,1 +3900,0.0006275931955315173,0.04581834003329277,0.04435858875513077,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.01032137218862772,5.074292182922363,56.38771200180054,1 +3920,0.0005284425569698215,0.05152151733636856,0.05045991390943527,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.009197903797030449,5.059990167617798,56.38771200180054,1 +3940,0.012537277303636074,0.1955956220626831,0.18650883436203003,0,1.0,0.7500000596046448,0.99,2e-06,0.3281916677951813,5.054157018661499,56.38771200180054,1 +3960,0.008628036826848984,0.08382334560155869,0.08496914803981781,0,1.0,0.7500000596046448,0.99,2e-06,0.15681582689285278,5.05617094039917,56.38771200180054,1 +3980,0.0009106311481446028,0.07384733110666275,0.07295186072587967,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.008073736913502216,5.084397315979004,56.38771200180054,1 +4000,0.0008951619965955615,0.0633259043097496,0.06250808387994766,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.009005460888147354,5.057635307312012,56.38771200180054,1 +4020,0.000512242317199707,0.035669248551130295,0.03464065492153168,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005537994671612978,5.058117151260376,56.38771200180054,1 +4040,0.01014096662402153,0.09884356707334518,0.10233081877231598,0,1.0,0.7500000596046448,0.99,2e-06,0.2959540784358978,5.055139780044556,56.38771200180054,1 +4060,0.009335855022072792,0.1293080747127533,0.135202094912529,0,1.0,0.7500000596046448,0.99,2e-06,0.25325798988342285,5.056272029876709,56.38771200180054,1 +4080,0.001048112055286765,0.03515445813536644,0.03405122831463814,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03813660889863968,5.063548803329468,56.38771200180054,1 +4100,0.020406324416399002,0.24817760288715363,0.25690358877182007,0,1.0,0.7500000596046448,0.99,2e-06,0.5180724859237671,5.063803672790527,56.38771200180054,1 +4120,0.005904040765017271,0.05420231819152832,0.05339391529560089,0,1.0,0.7500000596046448,0.99,2e-06,0.0991416871547699,5.056149244308472,56.38771200180054,1 +4140,0.0008331214776262641,0.031634215265512466,0.03135523200035095,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011435769498348236,5.064835548400879,56.38771200180054,1 +4160,0.0005082936841063201,0.028426656499505043,0.027768658474087715,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.007926513440907001,5.067916393280029,56.38771200180054,1 +4180,0.0004912807489745319,0.04465042054653168,0.04357317090034485,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005676545202732086,5.064542293548584,56.38771200180054,1 +4200,0.011097135953605175,0.0994868203997612,0.0953713208436966,0,1.0,0.7500000596046448,0.99,2e-06,0.23018530011177063,5.062283515930176,56.38771200180054,1 +4220,0.0009552716510370374,0.07424218207597733,0.07314147055149078,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02011999301612377,5.061142444610596,56.38771200180054,1 +4240,0.0006093357224017382,0.060596663504838943,0.0591544434428215,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.011372062377631664,5.066261053085327,56.38771200180054,1 +4260,0.0010587256401777267,0.04395662248134613,0.04338680952787399,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.04742158576846123,5.059890508651733,56.38771200180054,1 +4280,0.0006500838790088892,0.07151880115270615,0.07046061009168625,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.0056821610778570175,5.05872917175293,56.38771200180054,1 +4300,0.0008342443034052849,0.05989781394600868,0.05910466983914375,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.007943402975797653,5.058414697647095,56.38771200180054,1 +4320,0.009901202283799648,0.1269804984331131,0.12075542658567429,0,1.0,0.7500000596046448,0.99,2e-06,0.28692349791526794,5.056571006774902,56.38771200180054,1 +4340,0.0005642179166898131,0.04775036871433258,0.04705990105867386,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.0070756589993834496,5.065481424331665,56.38771200180054,1 +4360,0.011043733917176723,0.15533418953418732,0.15754525363445282,0,1.0,0.7500000596046448,0.99,2e-06,0.34521204233169556,5.063107490539551,56.38771200180054,1 +4380,0.001663686940446496,0.05685168132185936,0.055714767426252365,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.06694743782281876,5.063305854797363,56.38771200180054,1 +4400,0.0009272271418012679,0.07957632094621658,0.07892921566963196,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011624627746641636,5.057339191436768,56.38771200180054,1 +4420,0.0004888598923571408,0.05053623393177986,0.0496392659842968,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005037867464125156,5.060957670211792,56.38771200180054,1 +4440,0.011841069906949997,0.2598453760147095,0.25819486379623413,0,1.0,0.7500000596046448,0.99,2e-06,0.27718502283096313,5.068220853805542,56.38771200180054,1 +4460,0.0008988740737549961,0.04660302400588989,0.045363035053014755,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.016457347199320793,5.071640253067017,56.38771200180054,1 +4480,0.0008234328124672174,0.060623928904533386,0.060164157301187515,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.023859115317463875,5.068544387817383,56.38771200180054,1 +4500,0.01178030390292406,0.19045203924179077,0.20805008709430695,0,1.0,0.7500000596046448,0.99,2e-06,0.3038722276687622,5.0635247230529785,56.38771200180054,1 +4520,0.0009787462186068296,0.054322876036167145,0.05349850282073021,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.016364270821213722,5.067758798599243,56.38771200180054,1 +4540,0.0008751576533541083,0.05528469383716583,0.054922010749578476,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.0075068422593176365,5.055350303649902,56.38771200180054,1 +4560,0.013197717256844044,0.10882177203893661,0.10527563095092773,0,1.0,0.7500000596046448,0.99,2e-06,0.34164509177207947,5.065127611160278,56.38771200180054,1 +4580,0.0009803486755117774,0.05852792412042618,0.05756749212741852,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03126610442996025,5.062413454055786,56.38771200180054,1 +4600,0.010438008233904839,0.23782601952552795,0.22900642454624176,0,1.0,0.7500000596046448,0.99,2e-06,0.22745874524116516,5.056220293045044,56.38771200180054,1 +4620,0.0008247740915976465,0.08145055174827576,0.0803067535161972,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.014980053529143333,5.066350698471069,56.38771200180054,1 +4640,0.0005917821545153856,0.041942622512578964,0.040988121181726456,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.009624138474464417,5.059652328491211,56.38771200180054,2 +4660,0.012601676397025585,0.2887839674949646,0.29173704981803894,0,1.0,0.7500000596046448,0.99,2e-06,0.27472469210624695,5.058666229248047,56.38771200180054,2 +4680,0.0008405620465055108,0.041352227330207825,0.04076484218239784,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.019810926169157028,5.052232027053833,56.38771200180054,2 +4700,0.010732261463999748,0.2723722755908966,0.2789357602596283,0,1.0,0.7500000596046448,0.99,2e-06,0.1976768970489502,5.056168556213379,56.38771200180054,2 +4720,0.00106441683601588,0.08823812007904053,0.08707422763109207,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02922748401761055,5.0590574741363525,56.38771200180054,2 +4740,0.0009829208720475435,0.059713445603847504,0.05899115279316902,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011126186698675156,5.0566394329071045,56.38771200180054,2 +4760,0.0008728526881895959,0.04682607203722,0.04612234607338905,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.007930507883429527,5.0607733726501465,56.38771200180054,2 +4780,0.00045582535676658154,0.04422285407781601,0.04299274459481239,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005746451672166586,5.054745197296143,56.38771200180054,2 +4800,0.0010712295770645142,0.08372066915035248,0.08168963342905045,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02805330604314804,5.066725254058838,56.38771200180054,2 +4820,0.0005666707293130457,0.05535654351115227,0.054159488528966904,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.0068098995834589005,5.053342342376709,56.38771200180054,2 +4840,0.0009545261273160577,0.07130579650402069,0.0703289657831192,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011230872012674809,5.064991235733032,56.38771200180054,2 +4860,0.000944875122513622,0.06465128809213638,0.06372559815645218,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.01773991994559765,5.059379816055298,56.38771200180054,2 +4880,0.0013662312412634492,0.06056738644838333,0.05874864384531975,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.06840239465236664,5.059441328048706,56.38771200180054,2 +4900,0.0011723135830834508,0.0939280167222023,0.0923546627163887,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02404286526143551,5.060399055480957,56.38771200180054,2 +4920,0.0008578142151236534,0.12112223356962204,0.11977925151586533,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.012692461721599102,5.063267946243286,56.38771200180054,2 +4940,0.0009362085838802159,0.060309235006570816,0.0595814548432827,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011584315448999405,5.065763711929321,56.38771200180054,2 +4960,0.0005643924232572317,0.03952531889081001,0.03865886107087135,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.00415859604254365,5.066878080368042,56.38771200180054,2 +4980,0.0005380889633670449,0.07813812792301178,0.07726185768842697,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.007159811910241842,5.059826850891113,56.38771200180054,2 +5000,0.014691933058202267,0.20818637311458588,0.20924533903598785,0,1.0,0.7500000596046448,0.99,2e-06,0.4065082371234894,5.0628345012664795,56.38771200180054,2 +5020,0.0005613394314423203,0.048303503543138504,0.04759649932384491,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.008665085770189762,5.06869912147522,56.38771200180054,2 +5040,0.011080694384872913,0.16835781931877136,0.16507892310619354,0,1.0,0.7500000596046448,0.99,2e-06,0.2637902796268463,5.054494142532349,56.38771200180054,2 +5060,0.012883211486041546,0.30763956904411316,0.3028458058834076,0,1.0,0.7500000596046448,0.99,2e-06,0.23933163285255432,5.056548595428467,56.38771200180054,2 +5080,0.010434918105602264,0.1665261834859848,0.1702822595834732,0,1.0,0.7500000596046448,0.99,2e-06,0.27251672744750977,5.055638790130615,56.38771200180054,2 +5100,0.0007670499035157263,0.07075560092926025,0.07035433501005173,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.008587239310145378,5.060681343078613,56.38771200180054,2 +5120,0.008931342512369156,0.2256678193807602,0.2336854785680771,0,1.0,0.7500000596046448,0.99,2e-06,0.18369822204113007,5.077457666397095,56.38771200180054,2 +5140,0.0004993891343474388,0.043097373098134995,0.04253312200307846,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005642247386276722,5.053673505783081,56.38771200180054,2 +5160,0.0009614696027711034,0.06537224352359772,0.06457342952489853,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.015235752798616886,5.058578729629517,56.38771200180054,2 +5180,0.0005060893599875271,0.04294409602880478,0.0420016385614872,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.004838111810386181,5.058799982070923,56.38771200180054,2 +5200,0.012339784763753414,0.17770539224147797,0.177664116024971,0,1.0,0.7500000596046448,0.99,2e-06,0.3067754805088043,5.0548765659332275,56.38771200180054,2 +5220,0.0008480303222313523,0.0767185166478157,0.07613126933574677,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011523142457008362,5.065016269683838,56.38771200180054,2 +5240,0.0012050727382302284,0.054844845086336136,0.053075242787599564,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.04410894215106964,5.058746576309204,56.38771200180054,2 +5260,0.000923885265365243,0.0741887241601944,0.0728394165635109,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011327520944178104,5.056455373764038,56.38771200180054,2 +5280,0.0008364702807739377,0.04627450183033943,0.0455106757581234,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.009678099304437637,5.071713924407959,56.38771200180054,2 +5300,0.013307849876582623,0.2280721664428711,0.23815062642097473,0,1.0,0.7500000596046448,0.99,2e-06,0.2916553318500519,5.058743476867676,56.38771200180054,2 +5320,0.0010412855772301555,0.05726078525185585,0.056050077080726624,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.059066612273454666,5.0665059089660645,56.38771200180054,2 +5340,0.0013550184667110443,0.06851834803819656,0.06728105247020721,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.05376351252198219,5.072747707366943,56.38771200180054,2 +5360,0.01139626931399107,0.09936109185218811,0.10270503908395767,0,1.0,0.7500000596046448,0.99,2e-06,0.21249254047870636,5.061496257781982,56.38771200180054,2 +5380,0.0008595497929491103,0.03467801585793495,0.034264326095581055,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.009716140106320381,5.05959153175354,56.38771200180054,2 +5400,0.007764827460050583,0.12322887033224106,0.11854689568281174,0,1.0,0.7500000596046448,0.99,2e-06,0.18540896475315094,5.059280633926392,56.38771200180054,2 +5420,0.0005223120097070932,0.03686259686946869,0.03634748235344887,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.008785859681665897,6.201565265655518,56.38771200180054,2 +5440,0.0007946076802909374,0.019817393273115158,0.01960078813135624,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.008988667279481888,5.08617639541626,56.38771200180054,2 +5460,0.0013858083402737975,0.051635824143886566,0.050466038286685944,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.05539199709892273,5.05837869644165,56.38771200180054,2 +5480,0.00043914708658121526,0.06818012148141861,0.06727109849452972,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005991313140839338,5.05527925491333,56.38771200180054,2 +5500,0.012565352022647858,0.1371580809354782,0.14243006706237793,0,1.0,0.7500000596046448,0.99,2e-06,0.3293812572956085,5.0557334423065186,56.38771200180054,2 +5520,0.0012887606862932444,0.061772242188453674,0.060921039432287216,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.046074554324150085,5.066145420074463,56.38771200180054,2 +5540,0.0011211334494873881,0.07656565308570862,0.07598944008350372,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.04066187143325806,5.072248697280884,56.38771200180054,2 +5560,0.0006040534935891628,0.050884492695331573,0.04956464096903801,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.011227129027247429,5.048751592636108,56.38771200180054,2 +5580,0.01663399115204811,0.15798677504062653,0.15569469332695007,0,1.0,0.7500000596046448,0.99,2e-06,0.4494188725948334,5.064303159713745,56.38771200180054,2 +5600,0.0010575049091130495,0.052109166979789734,0.05155591666698456,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.016740651801228523,5.0705907344818115,56.38771200180054,2 +5620,0.0008653531549498439,0.04380495101213455,0.04319363087415695,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.020426709204912186,5.0648417472839355,56.38771200180054,2 +5640,0.01472960039973259,0.20251724123954773,0.20115526020526886,0,1.0,0.7500000596046448,0.99,2e-06,0.32399940490722656,5.05525279045105,56.38771200180054,2 +5660,0.0005831328453496099,0.05128499120473862,0.050360362976789474,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.013639052398502827,5.048763275146484,56.38771200180054,2 +5680,0.012293255887925625,0.14766375720500946,0.14021030068397522,0,1.0,0.7500000596046448,0.99,2e-06,0.3208130896091461,5.0665552616119385,56.38771200180054,2 +5700,0.00948075670748949,0.1594533920288086,0.16342711448669434,0,1.0,0.7500000596046448,0.99,2e-06,0.18476200103759766,5.063478231430054,56.38771200180054,2 +5720,0.000500779424328357,0.03266791254281998,0.031979240477085114,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.00420603109523654,5.058710098266602,56.38771200180054,2 +5740,0.0004829620593227446,0.05540725588798523,0.05442629009485245,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.0043064896017313,5.062854290008545,56.38771200180054,2 +5760,0.0005337068578228354,0.04268955439329147,0.04179146885871887,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005012644454836845,5.064911127090454,56.38771200180054,2 +5780,0.0005585897015407681,0.019365187734365463,0.01866880990564823,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.016515063121914864,5.059882402420044,56.38771200180054,2 +5800,0.0008101434796117246,0.055573854595422745,0.05481555685400963,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011727596633136272,5.06596302986145,56.38771200180054,2 +5820,0.0009859881829470396,0.07828324288129807,0.07684867829084396,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.009838203899562359,5.063064336776733,56.38771200180054,2 +5840,0.0010764162288978696,0.07502581924200058,0.07419951260089874,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.040250714868307114,5.067485570907593,56.38771200180054,2 +5860,0.0009934373665601015,0.06641972064971924,0.0660238116979599,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.045972585678100586,5.0626060962677,56.38771200180054,2 +5880,0.011384047567844391,0.13022859394550323,0.12941549718379974,0,1.0,0.7500000596046448,0.99,2e-06,0.2609627842903137,5.058787822723389,56.38771200180054,2 +5900,0.014927203767001629,0.2020854651927948,0.20251882076263428,0,1.0,0.7500000596046448,0.99,2e-06,0.380825400352478,5.054861068725586,56.38771200180054,2 +5920,0.0009386871242895722,0.10493671149015427,0.10351072251796722,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02090667374432087,5.066349983215332,56.38771200180054,2 +5940,0.01158827543258667,0.23503337800502777,0.2379463016986847,0,1.0,0.7500000596046448,0.99,2e-06,0.22306816279888153,5.0547263622283936,56.38771200180054,2 +5960,0.009583264589309692,0.2493068277835846,0.25065186619758606,0,1.0,0.7500000596046448,0.99,2e-06,0.2217947095632553,5.05912446975708,56.38771200180054,2 +5980,0.001061977120116353,0.04272869974374771,0.04222428426146507,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.02792784385383129,5.061586856842041,56.38771200180054,2 +6000,0.014420066960155964,0.11742875725030899,0.11337395757436752,0,1.0,0.7500000596046448,0.99,2e-06,0.320695161819458,5.054695129394531,56.38771200180054,2 +6020,0.0007741424487903714,0.03202572464942932,0.031292624771595,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011973152868449688,5.065645933151245,56.38771200180054,2 +6040,0.000564252317417413,0.03465507552027702,0.03367885574698448,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.008007621392607689,5.054047346115112,56.38771200180054,2 +6060,0.0005777270998805761,0.04053902253508568,0.0396161824464798,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.013594734482467175,5.063011646270752,56.38771200180054,2 +6080,0.0005520423874258995,0.0358554907143116,0.034734372049570084,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.0072081433609128,5.054680824279785,56.38771200180054,2 +6100,0.0005763680092059076,0.0663987547159195,0.06503399461507797,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.009375166147947311,5.054086446762085,56.38771200180054,2 +6120,0.001043974538333714,0.06212214380502701,0.06080516427755356,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.023134563118219376,5.067590951919556,56.38771200180054,2 +6140,0.010799629613757133,0.1917901188135147,0.19141948223114014,0,1.0,0.7500000596046448,0.99,2e-06,0.21246673166751862,5.065551519393921,56.38771200180054,2 +6160,0.0118789691478014,0.2502089738845825,0.2538715600967407,0,1.0,0.7500000596046448,0.99,2e-06,0.23722276091575623,5.058990716934204,56.38771200180054,2 +6180,0.001328738173469901,0.058869633823633194,0.05823887884616852,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.05501440912485123,5.068241596221924,56.38771200180054,2 +6200,0.0005084526492282748,0.04054967686533928,0.039777275174856186,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.005093740299344063,5.056608438491821,56.38771200180054,2 +6220,0.0009053231915459037,0.05030398443341255,0.04931192100048065,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03395301476120949,5.059701442718506,56.38771200180054,2 +6240,0.000882559223100543,0.07134188711643219,0.07060406357049942,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.009267237968742847,5.063471078872681,56.38771200180054,2 +6260,0.001248708926141262,0.048403654247522354,0.046903278678655624,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.06573355942964554,5.0582053661346436,56.38771200180054,2 +6280,0.000534428225364536,0.05802047625184059,0.05722204968333244,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.004967367742210627,5.052910566329956,56.38771200180054,2 +6300,0.000552034005522728,0.04220107942819595,0.04112992063164711,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.012504249811172485,5.057844877243042,56.38771200180054,2 +6320,0.008386056870222092,0.07909481972455978,0.0784037858247757,0,1.0,0.7500000596046448,0.99,2e-06,0.17801466584205627,5.053519248962402,56.38771200180054,2 +6340,0.001423293026164174,0.0792950689792633,0.07735203206539154,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.04977888613939285,5.063972234725952,56.38771200180054,2 +6360,0.013463897630572319,0.18821531534194946,0.19279906153678894,0,1.0,0.7500000596046448,0.99,2e-06,0.3232056498527527,5.065289497375488,56.38771200180054,2 +6380,0.000839793705381453,0.047367945313453674,0.046694543212652206,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.011751426383852959,5.06492280960083,56.38771200180054,2 +6400,0.0004861492197960615,0.057692427188158035,0.05642131343483925,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.004911467432975769,5.055845260620117,56.38771200180054,2 +6420,0.0005201222957111895,0.06649311631917953,0.06539564579725266,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.006009671371430159,5.06078577041626,56.38771200180054,2 +6440,0.015403269790112972,0.227638840675354,0.23877891898155212,0,1.0,0.7500000596046448,0.99,2e-06,0.2845522463321686,5.0587897300720215,56.38771200180054,2 +6460,0.0011939671821892262,0.06876838207244873,0.06680420786142349,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.029187185689806938,5.057390928268433,56.38771200180054,2 +6480,0.0005714878207072616,0.06602355092763901,0.06462109833955765,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.007155806291848421,5.0652618408203125,56.38771200180054,2 +6500,0.0067581250332295895,0.12778912484645844,0.13533344864845276,0,1.0,0.7500000596046448,0.99,2e-06,0.13228243589401245,5.0654096603393555,56.38771200180054,2 +6520,0.0011241850443184376,0.062161680310964584,0.06087970361113548,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03422418236732483,5.062279939651489,56.38771200180054,2 +6540,0.00987568311393261,0.09707260876893997,0.08958681672811508,0,1.0,0.7500000596046448,0.99,2e-06,0.18409046530723572,5.056823492050171,56.38771200180054,2 +6560,0.0008768893894739449,0.062111128121614456,0.0609971359372139,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.014455431140959263,5.05772066116333,56.38771200180054,2 +6580,0.012656179256737232,0.15245825052261353,0.15900206565856934,0,1.0,0.7500000596046448,0.99,2e-06,0.33436670899391174,5.063738822937012,56.38771200180054,2 +6600,0.0008984694140963256,0.06181909888982773,0.0609792023897171,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.014898053370416164,5.06207275390625,56.38771200180054,2 +6620,0.00047623581485822797,0.036981042474508286,0.03619895502924919,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.003958475776016712,5.058070659637451,56.38771200180054,2 +6640,0.015356341376900673,0.17343246936798096,0.17194312810897827,0,1.0,0.7500000596046448,0.99,2e-06,0.3733937442302704,5.074883222579956,56.38771200180054,2 +6660,0.0012141080806031823,0.07524246722459793,0.0738847553730011,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.05391047149896622,5.064269065856934,56.38771200180054,2 +6680,0.0004711213114205748,0.05491112172603607,0.05384913831949234,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.0037990978453308344,5.064637184143066,56.38771200180054,2 +6700,0.013356763869524002,0.21596591174602509,0.21726363897323608,0,1.0,0.7500000596046448,0.99,2e-06,0.29448696970939636,5.055668830871582,56.38771200180054,2 +6720,0.00046294403728097677,0.04956430196762085,0.048471976071596146,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.004282674286514521,5.054750919342041,56.38771200180054,2 +6740,0.009550473652780056,0.23066630959510803,0.23249365389347076,0,1.0,0.7500000596046448,0.99,2e-06,0.21565578877925873,5.058454751968384,56.38771200180054,2 +6760,0.0005825625266879797,0.043492816388607025,0.04231956973671913,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.01663454808294773,5.07295823097229,56.38771200180054,2 +6780,0.000529926735907793,0.04000772163271904,0.03890618681907654,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.008430074900388718,5.059959650039673,56.38771200180054,2 +6800,0.01733345352113247,0.22332248091697693,0.211096853017807,0,1.0,0.7500000596046448,0.99,2e-06,0.3460531234741211,5.053991794586182,56.38771200180054,2 +6820,0.0012667773989960551,0.07110463827848434,0.06982559710741043,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.016516391187906265,5.061548471450806,56.38771200180054,2 +6840,0.011920553632080555,0.21268999576568604,0.21231716871261597,0,1.0,0.7500000596046448,0.99,2e-06,0.245081827044487,5.063338994979858,56.38771200180054,2 +6860,0.008424516767263412,0.16057930886745453,0.16118550300598145,0,1.0,0.7500000596046448,0.99,2e-06,0.15414869785308838,5.060790777206421,56.38771200180054,2 +6880,0.0013060035416856408,0.04906054958701134,0.047626201063394547,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.03446747735142708,5.066277742385864,56.38771200180054,2 +6900,0.012658903375267982,0.1372191607952118,0.13780249655246735,0,1.0,0.7500000596046448,0.99,2e-06,0.2833116948604584,5.058000564575195,56.38771200180054,2 +6920,0.0009840811835601926,0.12725947797298431,0.12586042284965515,1,0.7500000596046448,0.5005995631217957,0.99,2e-06,0.020808616653084755,5.064213514328003,56.38771200180054,2 +6940,0.0005251189577393234,0.03272724524140358,0.031919077038764954,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.007791096344590187,5.0785980224609375,56.38771200180054,2 +6960,0.010881230235099792,0.16894644498825073,0.16534076631069183,0,1.0,0.7500000596046448,0.99,2e-06,0.3008408546447754,5.059436559677124,56.38771200180054,3 +6980,0.010758589953184128,0.11336933076381683,0.11482888460159302,0,1.0,0.7500000596046448,0.99,2e-06,0.2231176197528839,5.051692247390747,56.38771200180054,3 +7000,0.0006539164460264146,0.04613319784402847,0.04468526691198349,2,0.5005995631217957,0.25159743428230286,0.99,2e-06,0.013152019120752811,5.0637922286987305,56.38771200180054,3 diff --git a/backup_2026-09-14/runs/distill__stage3_dmd/config.json b/backup_2026-09-14/runs/distill__stage3_dmd/config.json new file mode 100644 index 0000000000000000000000000000000000000000..c6f75190997d93469679c4a8d71d71928c9aee94 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage3_dmd/config.json @@ -0,0 +1,257 @@ +{ + "stage": "stage3_dmd", + "args": { + "student_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step7000.safetensors", + "teacher_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/arope_10k_ga2/step-10000.safetensors", + "model_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B", + "output": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd", + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx", + "val_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx", + "sidecar": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "text_table": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "limit": null, + "min_rt_ratio": 0.8, + "scene_dropout": 0.0, + "denoise_list": "1000,750,500,250", + "real_guidance_scale": 1.0, + "kv_window": 17, + "sink_size": 3, + "rope_cap": 20, + "sink_anchor": "absolute", + "rollout_min": 21, + "rollout_max": 27, + "num_gen_cells": null, + "offset_extend": "resample", + "offset_chunk_cells": 5, + "context_extend": "hold", + "reanchor_every": 0, + "dmd_score_frames": 20, + "grad_horizon": 20, + "grad_pass": "streamed", + "exit_step": null, + "frankenstein": 0, + "dmd_timestep_clamp": "20,980", + "critic_steps": 5, + "lr": 2e-06, + "lr_critic": 1e-06, + "weight_decay": 0.01, + "adam_betas": "0.0,0.999", + "warmup": 100, + "grad_clip": 10.0, + "batch_size": 1, + "max_steps": 500, + "gradient_checkpointing": true, + "opt8bit": 0, + "num_workers": 2, + "seed": 0, + "use_ema": 1, + "ema_decay": 0.99, + "ema_start": 100, + "save_every": 50, + "keep_last_dits": 3, + "keep_last_emas": 25, + "keep_last_critics": 3, + "log_every": 10, + "profile_mem": 0, + "resume": "auto", + "force_run_dir": false, + "dry_run": false, + "clamp": [ + 20, + 980 + ], + "denoise": [ + 1000.0, + 750.0, + 500.0, + 250.0 + ] + }, + "betas": [ + 0.0, + 0.999 + ], + "preflight": { + "checked": true, + "sink_size": 3, + "kv_window": 17, + "rope_cap": 20, + "n_frames": 22, + "n_cached_max": 20, + "n_evictions": 2, + "cache_cells_final": 20, + "evict_effect": 0.012256205081939697, + "ms": 168.2717800140381, + "retained_last": [ + 0, + 1, + 2, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20 + ] + }, + "deploy_schedule": { + "t": [ + 1000.0, + 750.0000610351562, + 500.59954833984375, + 251.59742736816406 + ], + "sigma": [ + 1.0, + 0.7500000596046448, + 0.5005995631217957, + 0.25159743428230286 + ], + "idx": [ + 0, + 625, + 833, + 937 + ] + }, + "dataset": { + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx", + "train_used": 18528, + "text_table_keys": 361, + "walk_speed_px_s": [ + 69.24106392992304, + 46.012630371093756 + ] + }, + "model": { + "n_params": 4999803072, + "student_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step7000.safetensors", + "teacher_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/arope_10k_ga2/step-10000.safetensors", + "start_step": 0 + }, + "env": { + "world_size": 8, + "distributed_type": "DistributedType.FSDP", + "mixed_precision": "bf16", + "torch": "2.11.0+cu128", + "cuda": "12.8", + "gpu": "NVIDIA H200", + "python": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/python3.12", + "platform": "Linux-6.12.94-123.192.amzn2023.x86_64-x86_64-with-glibc2.34", + "hostname": "ip-172-16-244-218.ap-southeast-3.compute.internal", + "argv": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/distill/stage3_dmd/dmd_arope.py", + "--student_ckpt", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step7000.safetensors", + "--teacher_ckpt", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/arope_10k_ga2/step-10000.safetensors", + "--train_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx", + "--val_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/val_eybx", + "--sidecar", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "--text_table", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "--denoise_list", + "1000,750,500,250", + "--real_guidance_scale", + "1.0", + "--kv_window", + "17", + "--sink_size", + "3", + "--rope_cap", + "20", + "--sink_anchor", + "absolute", + "--rollout_min", + "21", + "--rollout_max", + "27", + "--dmd_score_frames", + "20", + "--grad_horizon", + "20", + "--grad_pass", + "streamed", + "--offset_extend", + "resample", + "--offset_chunk_cells", + "5", + "--context_extend", + "hold", + "--reanchor_every", + "0", + "--frankenstein", + "0", + "--dmd_timestep_clamp", + "20,980", + "--critic_steps", + "5", + "--lr", + "2e-6", + "--lr_critic", + "1e-6", + "--weight_decay", + "0.01", + "--adam_betas", + "0.0,0.999", + "--warmup", + "100", + "--grad_clip", + "10.0", + "--batch_size", + "1", + "--max_steps", + "500", + "--gradient_checkpointing", + "--opt8bit", + "0", + "--scene_dropout", + "0.0", + "--min_rt_ratio", + "0.8", + "--use_ema", + "1", + "--ema_decay", + "0.99", + "--ema_start", + "100", + "--save_every", + "50", + "--keep_last_dits", + "3", + "--keep_last_emas", + "25", + "--keep_last_critics", + "3", + "--log_every", + "10", + "--profile_mem", + "0", + "--num_workers", + "2", + "--seed", + "0", + "--output", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd", + "--resume", + "auto" + ], + "started": "2026-09-10 12:45:59", + "cuda_visible_devices": "0,1,2,3,4,5,6,7", + "accelerate": "1.14.0" + } +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/distill__stage3_dmd/launch.log b/backup_2026-09-14/runs/distill__stage3_dmd/launch.log new file mode 100644 index 0000000000000000000000000000000000000000..2e58ccef8c7d3b422ecf6d80bc54af7dae3a7912 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage3_dmd/launch.log @@ -0,0 +1,1523 @@ +=== stage3_dmd | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd world=8 dist=DistributedType.FSDP mp=bf16 === +[preflight] 警告:sink_size=3 > 0。ARoPE 的 h/w RoPE 位是一直在漂的世界坐标,被永久钉住的 sink cell 在长 rollout 之后会落在训练分布之外(实测 21 cell 内最大位移 373 px = 11.66 token)。部署配置是 sink_size=0。 +[preflight] 滑窗 KV OK: sink=3 window=17 cap=20;22 cell、n_cached 饱和在 20、驱逐 2 次、缓存收在 20 cell;驱逐对末帧的影响 1.226e-02;168 ms +[fsdp] use_orig_params=True reshard=None version=1 +[recipe] denoise=[1000.0, 750.0, 500.0, 250.0] ⇒ 网格 t=[1000.0, 750.0, 500.6, 251.6] sigma=[1.0, 0.75, 0.5006, 0.2516] +[recipe] kv_window=17 sink=3 cap=20 rollout=21..27 K=20 horizon=20 grad_pass=streamed critic_steps=5 lr_g=2e-06 lr_c=1e-06 betas=(0.0, 0.999) clip=10.0 cfg=1.0 ema=1/0.99@100 max_steps=500 +[budget] 每卡预估峰值 65.8 GiB / 140 GiB(静态 51.2 + KV 2.7 + 打分 5.4 + 1 帧图 × 6.46)[grad_pass=streamed horizon=20] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +[AropeLatentDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx: 20983 个 .pt,sidecar 缺失 0,valid=False 剔除 1,src 在 val_eybx 的转场剔除 257,rt_ratio<0.8 剔除 2197,可用 18528;text_mode=scene,文本表 361 键,scene_dropout=0.0 +[data] train 18528 clip,实测步速 (69.24106392992304, 46.012630371093756) px/s +[resume] 没有 progress.json,从头开始 +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] student←ema_step7000.safetensors critic/teacher←step-10000.safetensors +[model] 4 × 4,999,803,072 参数(student fp32 可训 / critic fp32 可训 / teacher bf16 冻结不分片 / ema fp32 冻结),加载 33s +[train] 从 step 0 到 500 +[probe] rollout 梯度可达性自检 gnorm=4.2919e+00 +[note] step 0 的 dmd 会恰好是 0:critic 与 teacher 是同一份双向 SFT 初值,pred_fake ≡ pred_real。它应当随 critic 被拉开而升到 +0.15…+0.68,不是单调下降。 +step 10/500 dmd +0.0015 critic 0.0951 dmd_gnorm 65.5 gnorm_g 0.01 gnorm_c 0.24 N 23 grad 4..24 exit 3 n_eval 20 26.9s mem 38.7GB +step 20/500 dmd +0.0017 critic 0.1165 dmd_gnorm 69.8 gnorm_g 0.02 gnorm_c 0.41 N 26 grad 7..27 exit 1 n_eval 20 22.3s mem 38.7GB +step 30/500 dmd +0.0064 critic 0.0644 dmd_gnorm 139.0 gnorm_g 0.10 gnorm_c 0.16 N 25 grad 6..26 exit 0 n_eval 20 20.7s mem 38.7GB +step 40/500 dmd +0.0169 critic 0.1109 dmd_gnorm 216.6 gnorm_g 0.04 gnorm_c 0.13 N 23 grad 4..24 exit 3 n_eval 20 22.5s mem 38.7GB +step 50/500 dmd +0.0388 critic 0.3142 dmd_gnorm 314.2 gnorm_g 0.16 gnorm_c 0.28 N 27 grad 8..28 exit 1 n_eval 20 22.5s mem 38.7GB +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step50.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step50.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step50.safetensors 827 个张量 10.00 GB +step 60/500 dmd +0.0519 critic 0.1979 dmd_gnorm 349.4 gnorm_g 0.21 gnorm_c 0.12 N 25 grad 6..26 exit 0 n_eval 20 28.6s mem 38.7GB +step 70/500 dmd +0.0418 critic 0.2291 dmd_gnorm 301.0 gnorm_g 0.09 gnorm_c 0.14 N 26 grad 7..27 exit 3 n_eval 20 22.4s mem 38.7GB +step 80/500 dmd +0.0658 critic 0.1763 dmd_gnorm 411.0 gnorm_g 0.17 gnorm_c 0.42 N 23 grad 4..24 exit 0 n_eval 20 23.8s mem 38.7GB +step 90/500 dmd +0.0282 critic 0.2333 dmd_gnorm 297.0 gnorm_g 0.06 gnorm_c 0.09 N 24 grad 5..25 exit 1 n_eval 20 23.3s mem 38.7GB +step 100/500 dmd +0.0796 critic 0.3206 dmd_gnorm 485.8 gnorm_g 0.19 gnorm_c 0.85 N 23 grad 4..24 exit 2 n_eval 20 22.5s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step100.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step100.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step100.safetensors 827 个张量 10.00 GB +step 110/500 dmd +0.0358 critic 0.2238 dmd_gnorm 362.3 gnorm_g 0.06 gnorm_c 0.28 N 26 grad 7..27 exit 2 n_eval 20 30.5s mem 38.7GB +step 120/500 dmd +0.0478 critic 0.3371 dmd_gnorm 425.8 gnorm_g 0.09 gnorm_c 1.14 N 24 grad 5..25 exit 1 n_eval 20 23.2s mem 38.7GB +step 130/500 dmd +0.0351 critic 0.5022 dmd_gnorm 376.9 gnorm_g 0.06 gnorm_c 0.19 N 27 grad 8..28 exit 2 n_eval 20 22.3s mem 38.7GB +step 140/500 dmd +0.0885 critic 0.2637 dmd_gnorm 416.1 gnorm_g 0.17 gnorm_c 0.13 N 24 grad 5..25 exit 1 n_eval 20 22.0s mem 38.7GB +step 150/500 dmd +0.1660 critic 0.3567 dmd_gnorm 623.0 gnorm_g 0.64 gnorm_c 0.08 N 22 grad 3..23 exit 1 n_eval 20 24.6s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step150.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step150.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step150.safetensors 827 个张量 10.00 GB +step 160/500 dmd +0.0443 critic 0.3136 dmd_gnorm 450.3 gnorm_g 0.06 gnorm_c 0.53 N 25 grad 6..26 exit 3 n_eval 20 29.7s mem 38.7GB +step 170/500 dmd +0.0417 critic 0.3126 dmd_gnorm 327.5 gnorm_g 0.16 gnorm_c 0.77 N 26 grad 7..27 exit 0 n_eval 20 25.2s mem 38.7GB +step 180/500 dmd +0.0241 critic 0.2283 dmd_gnorm 251.6 gnorm_g 0.05 gnorm_c 0.11 N 24 grad 5..25 exit 2 n_eval 20 24.3s mem 38.7GB +step 190/500 dmd +0.0360 critic 0.2081 dmd_gnorm 310.4 gnorm_g 0.07 gnorm_c 0.12 N 24 grad 5..25 exit 1 n_eval 20 22.5s mem 38.7GB +step 200/500 dmd +0.0391 critic 0.2197 dmd_gnorm 436.9 gnorm_g 0.04 gnorm_c 0.09 N 26 grad 7..27 exit 3 n_eval 20 22.4s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step200.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step200.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step200.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 210/500 dmd +0.1322 critic 0.7703 dmd_gnorm 605.8 gnorm_g 0.46 gnorm_c 0.32 N 21 grad 2..22 exit 0 n_eval 20 40.1s mem 38.7GB +step 220/500 dmd +0.0281 critic 0.2364 dmd_gnorm 246.0 gnorm_g 0.10 gnorm_c 0.09 N 26 grad 7..27 exit 0 n_eval 20 33.0s mem 38.7GB +step 230/500 dmd +0.0354 critic 0.2666 dmd_gnorm 279.7 gnorm_g 0.04 gnorm_c 0.54 N 25 grad 6..26 exit 3 n_eval 20 50.9s mem 38.7GB +step 240/500 dmd +0.0316 critic 0.2926 dmd_gnorm 364.4 gnorm_g 0.14 gnorm_c 0.97 N 25 grad 6..26 exit 0 n_eval 20 46.5s mem 38.7GB +step 250/500 dmd +0.0675 critic 0.2522 dmd_gnorm 535.4 gnorm_g 0.06 gnorm_c 0.26 N 23 grad 4..24 exit 2 n_eval 20 22.7s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step250.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step250.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step250.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 260/500 dmd +0.0269 critic 0.2860 dmd_gnorm 281.4 gnorm_g 0.05 gnorm_c 0.45 N 26 grad 7..27 exit 1 n_eval 20 30.5s mem 38.7GB +step 270/500 dmd +0.0334 critic 0.2445 dmd_gnorm 346.9 gnorm_g 0.05 gnorm_c 0.36 N 21 grad 2..22 exit 2 n_eval 20 37.8s mem 38.7GB +step 280/500 dmd +0.0191 critic 0.2438 dmd_gnorm 272.4 gnorm_g 0.07 gnorm_c 0.10 N 26 grad 7..27 exit 1 n_eval 20 51.7s mem 38.7GB +step 290/500 dmd +0.0288 critic 0.2497 dmd_gnorm 261.3 gnorm_g 0.03 gnorm_c 0.06 N 22 grad 3..23 exit 3 n_eval 20 39.5s mem 38.7GB +step 300/500 dmd +0.0633 critic 0.2224 dmd_gnorm 379.8 gnorm_g 0.04 gnorm_c 0.23 N 26 grad 7..27 exit 3 n_eval 20 24.4s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step300.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step300.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step300.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 310/500 dmd +0.0238 critic 0.2360 dmd_gnorm 227.2 gnorm_g 0.03 gnorm_c 0.10 N 23 grad 4..24 exit 2 n_eval 20 29.8s mem 38.7GB +step 320/500 dmd +0.0564 critic 0.2428 dmd_gnorm 439.0 gnorm_g 0.15 gnorm_c 0.64 N 25 grad 6..26 exit 0 n_eval 20 24.3s mem 38.7GB +step 330/500 dmd +0.1132 critic 0.2233 dmd_gnorm 708.4 gnorm_g 0.33 gnorm_c 0.41 N 23 grad 4..24 exit 0 n_eval 20 21.8s mem 38.7GB +step 340/500 dmd +0.0890 critic 0.2084 dmd_gnorm 647.5 gnorm_g 0.04 gnorm_c 0.23 N 24 grad 5..25 exit 3 n_eval 20 23.2s mem 38.7GB +step 350/500 dmd +0.0379 critic 0.3029 dmd_gnorm 332.7 gnorm_g 0.09 gnorm_c 0.07 N 22 grad 3..23 exit 1 n_eval 20 23.3s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step350.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step350.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step350.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 360/500 dmd +0.0256 critic 0.2926 dmd_gnorm 283.7 gnorm_g 0.05 gnorm_c 0.22 N 22 grad 3..23 exit 2 n_eval 20 31.2s mem 38.7GB +step 370/500 dmd +0.0423 critic 0.2519 dmd_gnorm 388.1 gnorm_g 0.03 gnorm_c 0.40 N 23 grad 4..24 exit 3 n_eval 20 23.6s mem 38.7GB +step 380/500 dmd +0.0126 critic 0.3917 dmd_gnorm 175.0 gnorm_g 0.05 gnorm_c 0.07 N 21 grad 2..22 exit 1 n_eval 20 22.6s mem 38.7GB +step 390/500 dmd +0.0232 critic 0.5628 dmd_gnorm 252.8 gnorm_g 0.08 gnorm_c 0.13 N 26 grad 7..27 exit 0 n_eval 20 25.2s mem 38.7GB +step 400/500 dmd +0.0556 critic 0.3694 dmd_gnorm 393.6 gnorm_g 0.04 gnorm_c 0.08 N 22 grad 3..23 exit 3 n_eval 20 24.1s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step400.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step400.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step400.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 410/500 dmd +0.1178 critic 0.3837 dmd_gnorm 476.4 gnorm_g 0.45 gnorm_c 0.09 N 25 grad 6..26 exit 1 n_eval 20 32.1s mem 38.7GB +step 420/500 dmd +0.0259 critic 0.3672 dmd_gnorm 221.0 gnorm_g 0.08 gnorm_c 1.24 N 21 grad 2..22 exit 0 n_eval 20 23.0s mem 38.7GB +step 430/500 dmd +0.0611 critic 0.2124 dmd_gnorm 561.1 gnorm_g 0.14 gnorm_c 0.12 N 23 grad 4..24 exit 1 n_eval 20 22.0s mem 38.7GB +step 440/500 dmd +0.0447 critic 0.2812 dmd_gnorm 402.2 gnorm_g 0.04 gnorm_c 0.78 N 27 grad 8..28 exit 3 n_eval 20 22.9s mem 38.7GB +step 450/500 dmd +0.0406 critic 0.2945 dmd_gnorm 303.9 gnorm_g 0.19 gnorm_c 0.20 N 26 grad 7..27 exit 0 n_eval 20 24.0s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step450.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step450.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step450.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 460/500 dmd +0.0412 critic 0.2302 dmd_gnorm 274.4 gnorm_g 0.09 gnorm_c 0.25 N 23 grad 4..24 exit 1 n_eval 20 32.3s mem 38.7GB +step 470/500 dmd +0.0381 critic 0.3932 dmd_gnorm 369.3 gnorm_g 0.04 gnorm_c 3.53 N 24 grad 5..25 exit 3 n_eval 20 23.5s mem 38.7GB +step 480/500 dmd +0.0308 critic 0.2864 dmd_gnorm 327.8 gnorm_g 0.03 gnorm_c 0.20 N 22 grad 3..23 exit 3 n_eval 20 24.8s mem 38.7GB +step 490/500 dmd +0.0262 critic 0.4138 dmd_gnorm 315.5 gnorm_g 0.03 gnorm_c 1.90 N 21 grad 2..22 exit 2 n_eval 20 23.8s mem 38.7GB +step 500/500 dmd +0.0312 critic 0.3182 dmd_gnorm 242.5 gnorm_g 0.04 gnorm_c 0.09 N 25 grad 6..26 exit 3 n_eval 20 24.3s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +[done] step 500,各进程峰值显存 38.7 GB。部署权重按 ema/ema_step*.safetensors **逐个里程碑挑**(不是拿最后一步),用 distill/eval/rollout_eval.py 在 4 步部署表上量背景位移。 diff --git a/backup_2026-09-14/runs/distill__stage3_dmd/progress.json b/backup_2026-09-14/runs/distill__stage3_dmd/progress.json new file mode 100644 index 0000000000000000000000000000000000000000..3533677effcff49aa0f5604dde0b802722f87eba --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage3_dmd/progress.json @@ -0,0 +1 @@ +{"step": 500, "wall": 1789058036.5746195, "time": "2026-09-10 16:33:56", "stage": "stage3_dmd", "finished": true, "peak_mem_gb": 38.73616027832031, "last": {"dmd": 0.019633139774668962, "critic": 0.40991222858428955, "gnorm_g": 0.036448631435632706, "gnorm_c": 0.09302487969398499, "N": 25, "grad_start": 6, "exit_step": 3, "n_eval": 20, "dmd_gnorm": 242.49249267578125, "dmd_t": 333.5777282714844, "dmd_norm": 0.17335252463817596}} \ No newline at end of file diff --git a/backup_2026-09-14/runs/distill__stage3_dmd/stdout.log b/backup_2026-09-14/runs/distill__stage3_dmd/stdout.log new file mode 100644 index 0000000000000000000000000000000000000000..14114ea2f6894e562b64e053b70fc69ae7ef1ec2 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage3_dmd/stdout.log @@ -0,0 +1,1529 @@ +[guard] GPU 0,1,2,3,4,5,6,7 空闲(每张 <= 500 MiB),可以启动。 +[stage3] student(生成器) = /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage2_cd/ema/ema_step7000.safetensors +[stage3] teacher/critic = /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/arope_10k_ga2/step-10000.safetensors (双向 SFT,不是 stage1 的因果 ckpt) +[stage3] out=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd port=29536 cfg=accelerate_fsdp_dmd_8gpu.yaml 8 卡 FSDP1 FULL_SHARD 等效 batch=8(无 GA) +[stage3] 采样表 1000,750,500,250 · 窗口 17/sink 3/cap 20/anchor absolute · rollout 21..27 +[stage3] K=20 horizon=20 pass=streamed critic_steps=5 lr=2e-6/1e-6 max_steps=500 +=== stage3_dmd | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd world=8 dist=DistributedType.FSDP mp=bf16 === +[preflight] 警告:sink_size=3 > 0。ARoPE 的 h/w RoPE 位是一直在漂的世界坐标,被永久钉住的 sink cell 在长 rollout 之后会落在训练分布之外(实测 21 cell 内最大位移 373 px = 11.66 token)。部署配置是 sink_size=0。 +[preflight] 滑窗 KV OK: sink=3 window=17 cap=20;22 cell、n_cached 饱和在 20、驱逐 2 次、缓存收在 20 cell;驱逐对末帧的影响 1.226e-02;168 ms +[fsdp] use_orig_params=True reshard=None version=1 +[recipe] denoise=[1000.0, 750.0, 500.0, 250.0] ⇒ 网格 t=[1000.0, 750.0, 500.6, 251.6] sigma=[1.0, 0.75, 0.5006, 0.2516] +[recipe] kv_window=17 sink=3 cap=20 rollout=21..27 K=20 horizon=20 grad_pass=streamed critic_steps=5 lr_g=2e-06 lr_c=1e-06 betas=(0.0, 0.999) clip=10.0 cfg=1.0 ema=1/0.99@100 max_steps=500 +[budget] 每卡预估峰值 65.8 GiB / 140 GiB(静态 51.2 + KV 2.7 + 打分 5.4 + 1 帧图 × 6.46)[grad_pass=streamed horizon=20] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +[AropeLatentDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/train_eybx: 20983 个 .pt,sidecar 缺失 0,valid=False 剔除 1,src 在 val_eybx 的转场剔除 257,rt_ratio<0.8 剔除 2197,可用 18528;text_mode=scene,文本表 361 键,scene_dropout=0.0 +[data] train 18528 clip,实测步速 (69.24106392992304, 46.012630371093756) px/s +[resume] 没有 progress.json,从头开始 +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] student←ema_step7000.safetensors critic/teacher←step-10000.safetensors +[model] 4 × 4,999,803,072 参数(student fp32 可训 / critic fp32 可训 / teacher bf16 冻结不分片 / ema fp32 冻结),加载 33s +[train] 从 step 0 到 500 +[probe] rollout 梯度可达性自检 gnorm=4.2919e+00 +[note] step 0 的 dmd 会恰好是 0:critic 与 teacher 是同一份双向 SFT 初值,pred_fake ≡ pred_real。它应当随 critic 被拉开而升到 +0.15…+0.68,不是单调下降。 +step 10/500 dmd +0.0015 critic 0.0951 dmd_gnorm 65.5 gnorm_g 0.01 gnorm_c 0.24 N 23 grad 4..24 exit 3 n_eval 20 26.9s mem 38.7GB +step 20/500 dmd +0.0017 critic 0.1165 dmd_gnorm 69.8 gnorm_g 0.02 gnorm_c 0.41 N 26 grad 7..27 exit 1 n_eval 20 22.3s mem 38.7GB +step 30/500 dmd +0.0064 critic 0.0644 dmd_gnorm 139.0 gnorm_g 0.10 gnorm_c 0.16 N 25 grad 6..26 exit 0 n_eval 20 20.7s mem 38.7GB +step 40/500 dmd +0.0169 critic 0.1109 dmd_gnorm 216.6 gnorm_g 0.04 gnorm_c 0.13 N 23 grad 4..24 exit 3 n_eval 20 22.5s mem 38.7GB +step 50/500 dmd +0.0388 critic 0.3142 dmd_gnorm 314.2 gnorm_g 0.16 gnorm_c 0.28 N 27 grad 8..28 exit 1 n_eval 20 22.5s mem 38.7GB +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step50.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step50.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step50.safetensors 827 个张量 10.00 GB +step 60/500 dmd +0.0519 critic 0.1979 dmd_gnorm 349.4 gnorm_g 0.21 gnorm_c 0.12 N 25 grad 6..26 exit 0 n_eval 20 28.6s mem 38.7GB +step 70/500 dmd +0.0418 critic 0.2291 dmd_gnorm 301.0 gnorm_g 0.09 gnorm_c 0.14 N 26 grad 7..27 exit 3 n_eval 20 22.4s mem 38.7GB +step 80/500 dmd +0.0658 critic 0.1763 dmd_gnorm 411.0 gnorm_g 0.17 gnorm_c 0.42 N 23 grad 4..24 exit 0 n_eval 20 23.8s mem 38.7GB +step 90/500 dmd +0.0282 critic 0.2333 dmd_gnorm 297.0 gnorm_g 0.06 gnorm_c 0.09 N 24 grad 5..25 exit 1 n_eval 20 23.3s mem 38.7GB +step 100/500 dmd +0.0796 critic 0.3206 dmd_gnorm 485.8 gnorm_g 0.19 gnorm_c 0.85 N 23 grad 4..24 exit 2 n_eval 20 22.5s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step100.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step100.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step100.safetensors 827 个张量 10.00 GB +step 110/500 dmd +0.0358 critic 0.2238 dmd_gnorm 362.3 gnorm_g 0.06 gnorm_c 0.28 N 26 grad 7..27 exit 2 n_eval 20 30.5s mem 38.7GB +step 120/500 dmd +0.0478 critic 0.3371 dmd_gnorm 425.8 gnorm_g 0.09 gnorm_c 1.14 N 24 grad 5..25 exit 1 n_eval 20 23.2s mem 38.7GB +step 130/500 dmd +0.0351 critic 0.5022 dmd_gnorm 376.9 gnorm_g 0.06 gnorm_c 0.19 N 27 grad 8..28 exit 2 n_eval 20 22.3s mem 38.7GB +step 140/500 dmd +0.0885 critic 0.2637 dmd_gnorm 416.1 gnorm_g 0.17 gnorm_c 0.13 N 24 grad 5..25 exit 1 n_eval 20 22.0s mem 38.7GB +step 150/500 dmd +0.1660 critic 0.3567 dmd_gnorm 623.0 gnorm_g 0.64 gnorm_c 0.08 N 22 grad 3..23 exit 1 n_eval 20 24.6s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step150.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step150.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step150.safetensors 827 个张量 10.00 GB +step 160/500 dmd +0.0443 critic 0.3136 dmd_gnorm 450.3 gnorm_g 0.06 gnorm_c 0.53 N 25 grad 6..26 exit 3 n_eval 20 29.7s mem 38.7GB +step 170/500 dmd +0.0417 critic 0.3126 dmd_gnorm 327.5 gnorm_g 0.16 gnorm_c 0.77 N 26 grad 7..27 exit 0 n_eval 20 25.2s mem 38.7GB +step 180/500 dmd +0.0241 critic 0.2283 dmd_gnorm 251.6 gnorm_g 0.05 gnorm_c 0.11 N 24 grad 5..25 exit 2 n_eval 20 24.3s mem 38.7GB +step 190/500 dmd +0.0360 critic 0.2081 dmd_gnorm 310.4 gnorm_g 0.07 gnorm_c 0.12 N 24 grad 5..25 exit 1 n_eval 20 22.5s mem 38.7GB +step 200/500 dmd +0.0391 critic 0.2197 dmd_gnorm 436.9 gnorm_g 0.04 gnorm_c 0.09 N 26 grad 7..27 exit 3 n_eval 20 22.4s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step200.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step200.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step200.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 210/500 dmd +0.1322 critic 0.7703 dmd_gnorm 605.8 gnorm_g 0.46 gnorm_c 0.32 N 21 grad 2..22 exit 0 n_eval 20 40.1s mem 38.7GB +step 220/500 dmd +0.0281 critic 0.2364 dmd_gnorm 246.0 gnorm_g 0.10 gnorm_c 0.09 N 26 grad 7..27 exit 0 n_eval 20 33.0s mem 38.7GB +step 230/500 dmd +0.0354 critic 0.2666 dmd_gnorm 279.7 gnorm_g 0.04 gnorm_c 0.54 N 25 grad 6..26 exit 3 n_eval 20 50.9s mem 38.7GB +step 240/500 dmd +0.0316 critic 0.2926 dmd_gnorm 364.4 gnorm_g 0.14 gnorm_c 0.97 N 25 grad 6..26 exit 0 n_eval 20 46.5s mem 38.7GB +step 250/500 dmd +0.0675 critic 0.2522 dmd_gnorm 535.4 gnorm_g 0.06 gnorm_c 0.26 N 23 grad 4..24 exit 2 n_eval 20 22.7s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step250.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step250.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step250.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 260/500 dmd +0.0269 critic 0.2860 dmd_gnorm 281.4 gnorm_g 0.05 gnorm_c 0.45 N 26 grad 7..27 exit 1 n_eval 20 30.5s mem 38.7GB +step 270/500 dmd +0.0334 critic 0.2445 dmd_gnorm 346.9 gnorm_g 0.05 gnorm_c 0.36 N 21 grad 2..22 exit 2 n_eval 20 37.8s mem 38.7GB +step 280/500 dmd +0.0191 critic 0.2438 dmd_gnorm 272.4 gnorm_g 0.07 gnorm_c 0.10 N 26 grad 7..27 exit 1 n_eval 20 51.7s mem 38.7GB +step 290/500 dmd +0.0288 critic 0.2497 dmd_gnorm 261.3 gnorm_g 0.03 gnorm_c 0.06 N 22 grad 3..23 exit 3 n_eval 20 39.5s mem 38.7GB +step 300/500 dmd +0.0633 critic 0.2224 dmd_gnorm 379.8 gnorm_g 0.04 gnorm_c 0.23 N 26 grad 7..27 exit 3 n_eval 20 24.4s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step300.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step300.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step300.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 310/500 dmd +0.0238 critic 0.2360 dmd_gnorm 227.2 gnorm_g 0.03 gnorm_c 0.10 N 23 grad 4..24 exit 2 n_eval 20 29.8s mem 38.7GB +step 320/500 dmd +0.0564 critic 0.2428 dmd_gnorm 439.0 gnorm_g 0.15 gnorm_c 0.64 N 25 grad 6..26 exit 0 n_eval 20 24.3s mem 38.7GB +step 330/500 dmd +0.1132 critic 0.2233 dmd_gnorm 708.4 gnorm_g 0.33 gnorm_c 0.41 N 23 grad 4..24 exit 0 n_eval 20 21.8s mem 38.7GB +step 340/500 dmd +0.0890 critic 0.2084 dmd_gnorm 647.5 gnorm_g 0.04 gnorm_c 0.23 N 24 grad 5..25 exit 3 n_eval 20 23.2s mem 38.7GB +step 350/500 dmd +0.0379 critic 0.3029 dmd_gnorm 332.7 gnorm_g 0.09 gnorm_c 0.07 N 22 grad 3..23 exit 1 n_eval 20 23.3s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step350.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step350.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step350.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 360/500 dmd +0.0256 critic 0.2926 dmd_gnorm 283.7 gnorm_g 0.05 gnorm_c 0.22 N 22 grad 3..23 exit 2 n_eval 20 31.2s mem 38.7GB +step 370/500 dmd +0.0423 critic 0.2519 dmd_gnorm 388.1 gnorm_g 0.03 gnorm_c 0.40 N 23 grad 4..24 exit 3 n_eval 20 23.6s mem 38.7GB +step 380/500 dmd +0.0126 critic 0.3917 dmd_gnorm 175.0 gnorm_g 0.05 gnorm_c 0.07 N 21 grad 2..22 exit 1 n_eval 20 22.6s mem 38.7GB +step 390/500 dmd +0.0232 critic 0.5628 dmd_gnorm 252.8 gnorm_g 0.08 gnorm_c 0.13 N 26 grad 7..27 exit 0 n_eval 20 25.2s mem 38.7GB +step 400/500 dmd +0.0556 critic 0.3694 dmd_gnorm 393.6 gnorm_g 0.04 gnorm_c 0.08 N 22 grad 3..23 exit 3 n_eval 20 24.1s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step400.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step400.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step400.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 410/500 dmd +0.1178 critic 0.3837 dmd_gnorm 476.4 gnorm_g 0.45 gnorm_c 0.09 N 25 grad 6..26 exit 1 n_eval 20 32.1s mem 38.7GB +step 420/500 dmd +0.0259 critic 0.3672 dmd_gnorm 221.0 gnorm_g 0.08 gnorm_c 1.24 N 21 grad 2..22 exit 0 n_eval 20 23.0s mem 38.7GB +step 430/500 dmd +0.0611 critic 0.2124 dmd_gnorm 561.1 gnorm_g 0.14 gnorm_c 0.12 N 23 grad 4..24 exit 1 n_eval 20 22.0s mem 38.7GB +step 440/500 dmd +0.0447 critic 0.2812 dmd_gnorm 402.2 gnorm_g 0.04 gnorm_c 0.78 N 27 grad 8..28 exit 3 n_eval 20 22.9s mem 38.7GB +step 450/500 dmd +0.0406 critic 0.2945 dmd_gnorm 303.9 gnorm_g 0.19 gnorm_c 0.20 N 26 grad 7..27 exit 0 n_eval 20 24.0s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step450.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step450.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step450.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +step 460/500 dmd +0.0412 critic 0.2302 dmd_gnorm 274.4 gnorm_g 0.09 gnorm_c 0.25 N 23 grad 4..24 exit 1 n_eval 20 32.3s mem 38.7GB +step 470/500 dmd +0.0381 critic 0.3932 dmd_gnorm 369.3 gnorm_g 0.04 gnorm_c 3.53 N 24 grad 5..25 exit 3 n_eval 20 23.5s mem 38.7GB +step 480/500 dmd +0.0308 critic 0.2864 dmd_gnorm 327.8 gnorm_g 0.03 gnorm_c 0.20 N 22 grad 3..23 exit 3 n_eval 20 24.8s mem 38.7GB +step 490/500 dmd +0.0262 critic 0.4138 dmd_gnorm 315.5 gnorm_g 0.03 gnorm_c 1.90 N 21 grad 2..22 exit 2 n_eval 20 23.8s mem 38.7GB +step 500/500 dmd +0.0312 critic 0.3182 dmd_gnorm 242.5 gnorm_g 0.04 gnorm_c 0.09 N 25 grad 6..26 exit 3 n_eval 20 24.3s mem 38.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step500.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step500.safetensors 827 个张量 10.00 GB +[rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +[done] step 500,各进程峰值显存 38.7 GB。部署权重按 ema/ema_step*.safetensors **逐个里程碑挑**(不是拿最后一步),用 distill/eval/rollout_eval.py 在 4 步部署表上量背景位移。 diff --git a/backup_2026-09-14/runs/distill__stage3_dmd/train.log b/backup_2026-09-14/runs/distill__stage3_dmd/train.log new file mode 100644 index 0000000000000000000000000000000000000000..0fdf5522a92252498a1d1280d5ca82dc71cf35d6 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage3_dmd/train.log @@ -0,0 +1,102 @@ +[2026-09-10 12:45:11] === stage3_dmd | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd world=8 dist=DistributedType.FSDP mp=bf16 === +[2026-09-10 12:45:11] [preflight] 警告:sink_size=3 > 0。ARoPE 的 h/w RoPE 位是一直在漂的世界坐标,被永久钉住的 sink cell 在长 rollout 之后会落在训练分布之外(实测 21 cell 内最大位移 373 px = 11.66 token)。部署配置是 sink_size=0。 +[2026-09-10 12:45:11] [preflight] 滑窗 KV OK: sink=3 window=17 cap=20;22 cell、n_cached 饱和在 20、驱逐 2 次、缓存收在 20 cell;驱逐对末帧的影响 1.226e-02;168 ms +[2026-09-10 12:45:11] [fsdp] use_orig_params=True reshard=None version=1 +[2026-09-10 12:45:11] [recipe] denoise=[1000.0, 750.0, 500.0, 250.0] ⇒ 网格 t=[1000.0, 750.0, 500.6, 251.6] sigma=[1.0, 0.75, 0.5006, 0.2516] +[2026-09-10 12:45:11] [recipe] kv_window=17 sink=3 cap=20 rollout=21..27 K=20 horizon=20 grad_pass=streamed critic_steps=5 lr_g=2e-06 lr_c=1e-06 betas=(0.0, 0.999) clip=10.0 cfg=1.0 ema=1/0.99@100 max_steps=500 +[2026-09-10 12:45:11] [budget] 每卡预估峰值 65.8 GiB / 140 GiB(静态 51.2 + KV 2.7 + 打分 5.4 + 1 帧图 × 6.46)[grad_pass=streamed horizon=20] +[2026-09-10 12:45:15] [data] train 18528 clip,实测步速 (69.24106392992304, 46.012630371093756) px/s +[2026-09-10 12:45:15] [resume] 没有 progress.json,从头开始 +[2026-09-10 12:45:41] [model] student←ema_step7000.safetensors critic/teacher←step-10000.safetensors +[2026-09-10 12:45:48] [model] 4 × 4,999,803,072 参数(student fp32 可训 / critic fp32 可训 / teacher bf16 冻结不分片 / ema fp32 冻结),加载 33s +[2026-09-10 12:45:59] [train] 从 step 0 到 500 +[2026-09-10 12:46:12] [probe] rollout 梯度可达性自检 gnorm=4.2919e+00 +[2026-09-10 12:46:12] [note] step 0 的 dmd 会恰好是 0:critic 与 teacher 是同一份双向 SFT 初值,pred_fake ≡ pred_real。它应当随 critic 被拉开而升到 +0.15…+0.68,不是单调下降。 +[2026-09-10 12:50:28] step 10/500 dmd +0.0015 critic 0.0951 dmd_gnorm 65.5 gnorm_g 0.01 gnorm_c 0.24 N 23 grad 4..24 exit 3 n_eval 20 26.9s mem 38.7GB +[2026-09-10 12:54:11] step 20/500 dmd +0.0017 critic 0.1165 dmd_gnorm 69.8 gnorm_g 0.02 gnorm_c 0.41 N 26 grad 7..27 exit 1 n_eval 20 22.3s mem 38.7GB +[2026-09-10 12:57:38] step 30/500 dmd +0.0064 critic 0.0644 dmd_gnorm 139.0 gnorm_g 0.10 gnorm_c 0.16 N 25 grad 6..26 exit 0 n_eval 20 20.7s mem 38.7GB +[2026-09-10 13:01:23] step 40/500 dmd +0.0169 critic 0.1109 dmd_gnorm 216.6 gnorm_g 0.04 gnorm_c 0.13 N 23 grad 4..24 exit 3 n_eval 20 22.5s mem 38.7GB +[2026-09-10 13:05:07] step 50/500 dmd +0.0388 critic 0.3142 dmd_gnorm 314.2 gnorm_g 0.16 gnorm_c 0.28 N 27 grad 8..28 exit 1 n_eval 20 22.5s mem 38.7GB +[2026-09-10 13:05:38] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step50.safetensors 827 个张量 10.00 GB +[2026-09-10 13:05:59] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step50.safetensors 827 个张量 10.00 GB +[2026-09-10 13:06:21] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step50.safetensors 827 个张量 10.00 GB +[2026-09-10 13:09:53] step 60/500 dmd +0.0519 critic 0.1979 dmd_gnorm 349.4 gnorm_g 0.21 gnorm_c 0.12 N 25 grad 6..26 exit 0 n_eval 20 28.6s mem 38.7GB +[2026-09-10 13:13:37] step 70/500 dmd +0.0418 critic 0.2291 dmd_gnorm 301.0 gnorm_g 0.09 gnorm_c 0.14 N 26 grad 7..27 exit 3 n_eval 20 22.4s mem 38.7GB +[2026-09-10 13:17:35] step 80/500 dmd +0.0658 critic 0.1763 dmd_gnorm 411.0 gnorm_g 0.17 gnorm_c 0.42 N 23 grad 4..24 exit 0 n_eval 20 23.8s mem 38.7GB +[2026-09-10 13:21:28] step 90/500 dmd +0.0282 critic 0.2333 dmd_gnorm 297.0 gnorm_g 0.06 gnorm_c 0.09 N 24 grad 5..25 exit 1 n_eval 20 23.3s mem 38.7GB +[2026-09-10 13:25:13] step 100/500 dmd +0.0796 critic 0.3206 dmd_gnorm 485.8 gnorm_g 0.19 gnorm_c 0.85 N 23 grad 4..24 exit 2 n_eval 20 22.5s mem 38.7GB +[2026-09-10 13:25:34] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step100.safetensors 827 个张量 10.00 GB +[2026-09-10 13:25:55] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step100.safetensors 827 个张量 10.00 GB +[2026-09-10 13:26:16] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step100.safetensors 827 个张量 10.00 GB +[2026-09-10 13:30:18] step 110/500 dmd +0.0358 critic 0.2238 dmd_gnorm 362.3 gnorm_g 0.06 gnorm_c 0.28 N 26 grad 7..27 exit 2 n_eval 20 30.5s mem 38.7GB +[2026-09-10 13:34:10] step 120/500 dmd +0.0478 critic 0.3371 dmd_gnorm 425.8 gnorm_g 0.09 gnorm_c 1.14 N 24 grad 5..25 exit 1 n_eval 20 23.2s mem 38.7GB +[2026-09-10 13:37:53] step 130/500 dmd +0.0351 critic 0.5022 dmd_gnorm 376.9 gnorm_g 0.06 gnorm_c 0.19 N 27 grad 8..28 exit 2 n_eval 20 22.3s mem 38.7GB +[2026-09-10 13:41:33] step 140/500 dmd +0.0885 critic 0.2637 dmd_gnorm 416.1 gnorm_g 0.17 gnorm_c 0.13 N 24 grad 5..25 exit 1 n_eval 20 22.0s mem 38.7GB +[2026-09-10 13:45:39] step 150/500 dmd +0.1660 critic 0.3567 dmd_gnorm 623.0 gnorm_g 0.64 gnorm_c 0.08 N 22 grad 3..23 exit 1 n_eval 20 24.6s mem 38.7GB +[2026-09-10 13:46:00] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step150.safetensors 827 个张量 10.00 GB +[2026-09-10 13:46:21] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step150.safetensors 827 个张量 10.00 GB +[2026-09-10 13:46:43] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step150.safetensors 827 个张量 10.00 GB +[2026-09-10 13:50:36] step 160/500 dmd +0.0443 critic 0.3136 dmd_gnorm 450.3 gnorm_g 0.06 gnorm_c 0.53 N 25 grad 6..26 exit 3 n_eval 20 29.7s mem 38.7GB +[2026-09-10 13:54:48] step 170/500 dmd +0.0417 critic 0.3126 dmd_gnorm 327.5 gnorm_g 0.16 gnorm_c 0.77 N 26 grad 7..27 exit 0 n_eval 20 25.2s mem 38.7GB +[2026-09-10 13:58:50] step 180/500 dmd +0.0241 critic 0.2283 dmd_gnorm 251.6 gnorm_g 0.05 gnorm_c 0.11 N 24 grad 5..25 exit 2 n_eval 20 24.3s mem 38.7GB +[2026-09-10 14:02:35] step 190/500 dmd +0.0360 critic 0.2081 dmd_gnorm 310.4 gnorm_g 0.07 gnorm_c 0.12 N 24 grad 5..25 exit 1 n_eval 20 22.5s mem 38.7GB +[2026-09-10 14:06:20] step 200/500 dmd +0.0391 critic 0.2197 dmd_gnorm 436.9 gnorm_g 0.04 gnorm_c 0.09 N 26 grad 7..27 exit 3 n_eval 20 22.4s mem 38.7GB +[2026-09-10 14:06:42] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step200.safetensors 827 个张量 10.00 GB +[2026-09-10 14:07:04] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step200.safetensors 827 个张量 10.00 GB +[2026-09-10 14:07:32] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step200.safetensors 827 个张量 10.00 GB +[2026-09-10 14:07:36] [rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +[2026-09-10 14:13:00] step 210/500 dmd +0.1322 critic 0.7703 dmd_gnorm 605.8 gnorm_g 0.46 gnorm_c 0.32 N 21 grad 2..22 exit 0 n_eval 20 40.1s mem 38.7GB +[2026-09-10 14:18:30] step 220/500 dmd +0.0281 critic 0.2364 dmd_gnorm 246.0 gnorm_g 0.10 gnorm_c 0.09 N 26 grad 7..27 exit 0 n_eval 20 33.0s mem 38.7GB +[2026-09-10 14:26:59] step 230/500 dmd +0.0354 critic 0.2666 dmd_gnorm 279.7 gnorm_g 0.04 gnorm_c 0.54 N 25 grad 6..26 exit 3 n_eval 20 50.9s mem 38.7GB +[2026-09-10 14:34:44] step 240/500 dmd +0.0316 critic 0.2926 dmd_gnorm 364.4 gnorm_g 0.14 gnorm_c 0.97 N 25 grad 6..26 exit 0 n_eval 20 46.5s mem 38.7GB +[2026-09-10 14:38:31] step 250/500 dmd +0.0675 critic 0.2522 dmd_gnorm 535.4 gnorm_g 0.06 gnorm_c 0.26 N 23 grad 4..24 exit 2 n_eval 20 22.7s mem 38.7GB +[2026-09-10 14:38:57] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step250.safetensors 827 个张量 10.00 GB +[2026-09-10 14:39:21] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step250.safetensors 827 个张量 10.00 GB +[2026-09-10 14:39:45] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step250.safetensors 827 个张量 10.00 GB +[2026-09-10 14:39:49] [rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +[2026-09-10 14:43:35] step 260/500 dmd +0.0269 critic 0.2860 dmd_gnorm 281.4 gnorm_g 0.05 gnorm_c 0.45 N 26 grad 7..27 exit 1 n_eval 20 30.5s mem 38.7GB +[2026-09-10 14:49:53] step 270/500 dmd +0.0334 critic 0.2445 dmd_gnorm 346.9 gnorm_g 0.05 gnorm_c 0.36 N 21 grad 2..22 exit 2 n_eval 20 37.8s mem 38.7GB +[2026-09-10 14:58:30] step 280/500 dmd +0.0191 critic 0.2438 dmd_gnorm 272.4 gnorm_g 0.07 gnorm_c 0.10 N 26 grad 7..27 exit 1 n_eval 20 51.7s mem 38.7GB +[2026-09-10 15:05:05] step 290/500 dmd +0.0288 critic 0.2497 dmd_gnorm 261.3 gnorm_g 0.03 gnorm_c 0.06 N 22 grad 3..23 exit 3 n_eval 20 39.5s mem 38.7GB +[2026-09-10 15:09:09] step 300/500 dmd +0.0633 critic 0.2224 dmd_gnorm 379.8 gnorm_g 0.04 gnorm_c 0.23 N 26 grad 7..27 exit 3 n_eval 20 24.4s mem 38.7GB +[2026-09-10 15:09:32] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step300.safetensors 827 个张量 10.00 GB +[2026-09-10 15:09:55] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step300.safetensors 827 个张量 10.00 GB +[2026-09-10 15:10:17] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step300.safetensors 827 个张量 10.00 GB +[2026-09-10 15:10:21] [rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +[2026-09-10 15:14:08] step 310/500 dmd +0.0238 critic 0.2360 dmd_gnorm 227.2 gnorm_g 0.03 gnorm_c 0.10 N 23 grad 4..24 exit 2 n_eval 20 29.8s mem 38.7GB +[2026-09-10 15:18:11] step 320/500 dmd +0.0564 critic 0.2428 dmd_gnorm 439.0 gnorm_g 0.15 gnorm_c 0.64 N 25 grad 6..26 exit 0 n_eval 20 24.3s mem 38.7GB +[2026-09-10 15:21:49] step 330/500 dmd +0.1132 critic 0.2233 dmd_gnorm 708.4 gnorm_g 0.33 gnorm_c 0.41 N 23 grad 4..24 exit 0 n_eval 20 21.8s mem 38.7GB +[2026-09-10 15:25:40] step 340/500 dmd +0.0890 critic 0.2084 dmd_gnorm 647.5 gnorm_g 0.04 gnorm_c 0.23 N 24 grad 5..25 exit 3 n_eval 20 23.2s mem 38.7GB +[2026-09-10 15:29:33] step 350/500 dmd +0.0379 critic 0.3029 dmd_gnorm 332.7 gnorm_g 0.09 gnorm_c 0.07 N 22 grad 3..23 exit 1 n_eval 20 23.3s mem 38.7GB +[2026-09-10 15:29:59] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step350.safetensors 827 个张量 10.00 GB +[2026-09-10 15:30:21] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step350.safetensors 827 个张量 10.00 GB +[2026-09-10 15:30:43] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step350.safetensors 827 个张量 10.00 GB +[2026-09-10 15:30:47] [rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +[2026-09-10 15:34:45] step 360/500 dmd +0.0256 critic 0.2926 dmd_gnorm 283.7 gnorm_g 0.05 gnorm_c 0.22 N 22 grad 3..23 exit 2 n_eval 20 31.2s mem 38.7GB +[2026-09-10 15:38:41] step 370/500 dmd +0.0423 critic 0.2519 dmd_gnorm 388.1 gnorm_g 0.03 gnorm_c 0.40 N 23 grad 4..24 exit 3 n_eval 20 23.6s mem 38.7GB +[2026-09-10 15:42:27] step 380/500 dmd +0.0126 critic 0.3917 dmd_gnorm 175.0 gnorm_g 0.05 gnorm_c 0.07 N 21 grad 2..22 exit 1 n_eval 20 22.6s mem 38.7GB +[2026-09-10 15:46:40] step 390/500 dmd +0.0232 critic 0.5628 dmd_gnorm 252.8 gnorm_g 0.08 gnorm_c 0.13 N 26 grad 7..27 exit 0 n_eval 20 25.2s mem 38.7GB +[2026-09-10 15:50:40] step 400/500 dmd +0.0556 critic 0.3694 dmd_gnorm 393.6 gnorm_g 0.04 gnorm_c 0.08 N 22 grad 3..23 exit 3 n_eval 20 24.1s mem 38.7GB +[2026-09-10 15:51:03] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step400.safetensors 827 个张量 10.00 GB +[2026-09-10 15:51:25] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step400.safetensors 827 个张量 10.00 GB +[2026-09-10 15:51:46] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step400.safetensors 827 个张量 10.00 GB +[2026-09-10 15:51:50] [rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +[2026-09-10 15:56:01] step 410/500 dmd +0.1178 critic 0.3837 dmd_gnorm 476.4 gnorm_g 0.45 gnorm_c 0.09 N 25 grad 6..26 exit 1 n_eval 20 32.1s mem 38.7GB +[2026-09-10 15:59:51] step 420/500 dmd +0.0259 critic 0.3672 dmd_gnorm 221.0 gnorm_g 0.08 gnorm_c 1.24 N 21 grad 2..22 exit 0 n_eval 20 23.0s mem 38.7GB +[2026-09-10 16:03:32] step 430/500 dmd +0.0611 critic 0.2124 dmd_gnorm 561.1 gnorm_g 0.14 gnorm_c 0.12 N 23 grad 4..24 exit 1 n_eval 20 22.0s mem 38.7GB +[2026-09-10 16:07:21] step 440/500 dmd +0.0447 critic 0.2812 dmd_gnorm 402.2 gnorm_g 0.04 gnorm_c 0.78 N 27 grad 8..28 exit 3 n_eval 20 22.9s mem 38.7GB +[2026-09-10 16:11:20] step 450/500 dmd +0.0406 critic 0.2945 dmd_gnorm 303.9 gnorm_g 0.19 gnorm_c 0.20 N 26 grad 7..27 exit 0 n_eval 20 24.0s mem 38.7GB +[2026-09-10 16:11:43] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step450.safetensors 827 个张量 10.00 GB +[2026-09-10 16:12:05] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step450.safetensors 827 个张量 10.00 GB +[2026-09-10 16:12:28] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step450.safetensors 827 个张量 10.00 GB +[2026-09-10 16:12:32] [rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +[2026-09-10 16:16:43] step 460/500 dmd +0.0412 critic 0.2302 dmd_gnorm 274.4 gnorm_g 0.09 gnorm_c 0.25 N 23 grad 4..24 exit 1 n_eval 20 32.3s mem 38.7GB +[2026-09-10 16:20:39] step 470/500 dmd +0.0381 critic 0.3932 dmd_gnorm 369.3 gnorm_g 0.04 gnorm_c 3.53 N 24 grad 5..25 exit 3 n_eval 20 23.5s mem 38.7GB +[2026-09-10 16:24:47] step 480/500 dmd +0.0308 critic 0.2864 dmd_gnorm 327.8 gnorm_g 0.03 gnorm_c 0.20 N 22 grad 3..23 exit 3 n_eval 20 24.8s mem 38.7GB +[2026-09-10 16:28:45] step 490/500 dmd +0.0262 critic 0.4138 dmd_gnorm 315.5 gnorm_g 0.03 gnorm_c 1.90 N 21 grad 2..22 exit 2 n_eval 20 23.8s mem 38.7GB +[2026-09-10 16:32:47] step 500/500 dmd +0.0312 critic 0.3182 dmd_gnorm 242.5 gnorm_g 0.04 gnorm_c 0.09 N 25 grad 6..26 exit 3 n_eval 20 24.3s mem 38.7GB +[2026-09-10 16:33:10] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/dits/dit_step500.safetensors 827 个张量 10.00 GB +[2026-09-10 16:33:31] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/critic/critic_step500.safetensors 827 个张量 10.00 GB +[2026-09-10 16:33:52] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step500.safetensors 827 个张量 10.00 GB +[2026-09-10 16:33:56] [rotate] 删掉 2 个旧 ckpt(dits 3 / ema 25 / critic 3) +[2026-09-10 16:33:56] [done] step 500,各进程峰值显存 38.7 GB。部署权重按 ema/ema_step*.safetensors **逐个里程碑挑**(不是拿最后一步),用 distill/eval/rollout_eval.py 在 4 步部署表上量背景位移。 diff --git a/backup_2026-09-14/runs/distill__stage3_dmd/train_log.csv b/backup_2026-09-14/runs/distill__stage3_dmd/train_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..dfa34992d6d2b14e655ede866907166e0d6b88ae --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage3_dmd/train_log.csv @@ -0,0 +1,51 @@ +step,dmd,critic,dmd_gnorm,gnorm_g,gnorm_c,N,grad_start,exit_step,n_eval,lr_g,step_time,mem_gb,epoch +10,0.0015402126591652632,0.09513305872678757,65.4871597290039,0.007697447203099728,0.24054501950740814,23,4,3,20,2.1999999999999998e-07,26.863239336013795,38.73588180541992,0 +20,0.0017243468901142478,0.11648713052272797,69.7898941040039,0.015977168455719948,0.4148799180984497,26,7,1,20,4.1999999999999995e-07,22.28788843154907,38.73588180541992,0 +30,0.006379372905939817,0.06442342698574066,138.99624633789062,0.10074087232351303,0.16371378302574158,25,6,0,20,6.2e-07,20.729605031013488,38.73588180541992,0 +40,0.016916640102863312,0.11090793460607529,216.61712646484375,0.039874810725450516,0.1275499314069748,23,4,3,20,8.199999999999999e-07,22.453020095825195,38.73588180541992,0 +50,0.03876376152038574,0.31417137384414673,314.1788024902344,0.16068382561206818,0.27995407581329346,27,8,1,20,1.02e-06,22.455890893936157,38.73588180541992,0 +60,0.05185623839497566,0.19794270396232605,349.3730773925781,0.21236969530582428,0.12489728629589081,25,6,0,20,1.22e-06,28.573068571090698,38.73588180541992,0 +70,0.04175002872943878,0.22913284599781036,300.99273681640625,0.09167361259460449,0.13505572080612183,26,7,3,20,1.42e-06,22.378698110580444,38.73588180541992,0 +80,0.06581991165876389,0.17626820504665375,411.0033264160156,0.16967131197452545,0.42258602380752563,23,4,0,20,1.62e-06,23.77787778377533,38.73588180541992,0 +90,0.028184927999973297,0.23330143094062805,297.0289611816406,0.060845136642456055,0.09071896225214005,24,5,1,20,1.82e-06,23.33628854751587,38.73588180541992,0 +100,0.07962946593761444,0.32060492038726807,485.8177795410156,0.18769685924053192,0.847069263458252,23,4,2,20,2e-06,22.48130557537079,38.73588180541992,0 +110,0.035807378590106964,0.22383809089660645,362.2605895996094,0.05737719312310219,0.27689164876937866,26,7,2,20,2e-06,30.526620054244994,38.73616075515747,0 +120,0.04777626693248749,0.33712831139564514,425.8436584472656,0.08520032465457916,1.1414048671722412,24,5,1,20,2e-06,23.23415768146515,38.73616075515747,0 +130,0.035104479640722275,0.5022424459457397,376.9306945800781,0.06062616407871246,0.18968699872493744,27,8,2,20,2e-06,22.29133858680725,38.73616075515747,0 +140,0.08854899555444717,0.2637435793876648,416.1383972167969,0.17367954552173615,0.12751923501491547,24,5,1,20,2e-06,21.985672402381898,38.73616075515747,0 +150,0.16598519682884216,0.3567017912864685,623.0083618164062,0.6441164016723633,0.08105309307575226,22,3,1,20,2e-06,24.58764259815216,38.73616075515747,0 +160,0.04431591182947159,0.31356281042099,450.25726318359375,0.05693047121167183,0.5327889919281006,25,6,3,20,2e-06,29.693169951438904,38.73616075515747,0 +170,0.041650302708148956,0.3125934302806854,327.53753662109375,0.15636684000492096,0.7664799094200134,26,7,0,20,2e-06,25.16620659828186,38.73616075515747,0 +180,0.024092381820082664,0.22832657396793365,251.5541229248047,0.05375458672642708,0.11382464319467545,24,5,2,20,2e-06,24.263686108589173,38.73616075515747,0 +190,0.03595169261097908,0.20809930562973022,310.374755859375,0.07397616654634476,0.11567345261573792,24,5,1,20,2e-06,22.510964250564577,38.73616075515747,0 +200,0.03905334696173668,0.2197382003068924,436.9189453125,0.04235547035932541,0.08671227097511292,26,7,3,20,2e-06,22.42804889678955,38.73616075515747,0 +210,0.13222257792949677,0.7702742218971252,605.7918090820312,0.45528528094291687,0.3160451054573059,21,2,0,20,2e-06,40.059164094924924,38.73616075515747,0 +220,0.028120655566453934,0.23643627762794495,245.99179077148438,0.10149899870157242,0.0920526310801506,26,7,0,20,2e-06,33.03132197856903,38.73616075515747,0 +230,0.0353512205183506,0.266571044921875,279.7417907714844,0.036588799208402634,0.5373775959014893,25,6,3,20,2e-06,50.86128177642822,38.73616075515747,0 +240,0.03159210830926895,0.29262590408325195,364.4468994140625,0.1447407454252243,0.9737749099731445,25,6,0,20,2e-06,46.49895050525665,38.73616075515747,0 +250,0.06751822680234909,0.2522243857383728,535.4334106445312,0.06301552057266235,0.25536811351776123,23,4,2,20,2e-06,22.683226227760315,38.73616075515747,0 +260,0.02690376341342926,0.2860286831855774,281.4474182128906,0.05127508193254471,0.4461703300476074,26,7,1,20,2e-06,30.458125948905945,38.73616075515747,0 +270,0.033350568264722824,0.24446658790111542,346.89794921875,0.04924615100026131,0.35876524448394775,21,2,2,20,2e-06,37.768597316741946,38.73616075515747,0 +280,0.019119461998343468,0.24375730752944946,272.40411376953125,0.067052461206913,0.09807876497507095,26,7,1,20,2e-06,51.70729031562805,38.73616075515747,0 +290,0.028787801042199135,0.24965350329875946,261.25457763671875,0.028031451627612114,0.06177804246544838,22,3,3,20,2e-06,39.52290816307068,38.73616075515747,0 +300,0.06328582018613815,0.22238056361675262,379.7905578613281,0.03845369070768356,0.22729268670082092,26,7,3,20,2e-06,24.383290910720824,38.73616075515747,0 +310,0.023838886991143227,0.2359919548034668,227.1869354248047,0.03354017436504364,0.09786304831504822,23,4,2,20,2e-06,29.839007925987243,38.73616075515747,0 +320,0.05641133338212967,0.24275605380535126,439.04327392578125,0.1525212824344635,0.6399098038673401,25,6,0,20,2e-06,24.34343547821045,38.73616075515747,0 +330,0.11320873349905014,0.22333019971847534,708.3594360351562,0.3324994742870331,0.40528738498687744,23,4,0,20,2e-06,21.767632937431337,38.73616075515747,0 +340,0.08901095390319824,0.2084299623966217,647.4999389648438,0.044473469257354736,0.2272455245256424,24,5,3,20,2e-06,23.15800783634186,38.73616075515747,0 +350,0.037946514785289764,0.3028504252433777,332.6913757324219,0.09220390021800995,0.07240188121795654,22,3,1,20,2e-06,23.274546098709106,38.73616075515747,0 +360,0.025576423853635788,0.2925824820995331,283.6510314941406,0.05326934531331062,0.22277094423770905,22,3,2,20,2e-06,31.165888166427614,38.73616075515747,0 +370,0.04232224449515343,0.25189754366874695,388.05499267578125,0.030331432819366455,0.4031970798969269,23,4,3,20,2e-06,23.626538276672363,38.73616075515747,0 +380,0.01262982003390789,0.3917022943496704,175.03506469726562,0.046178873628377914,0.06859485059976578,21,2,1,20,2e-06,22.63448829650879,38.73616075515747,0 +390,0.023233482614159584,0.5627567172050476,252.79879760742188,0.08412514626979828,0.1255982667207718,26,7,0,20,2e-06,25.226407837867736,38.73616075515747,0 +400,0.05560564622282982,0.3694002330303192,393.63262939453125,0.04097304493188858,0.07635899633169174,22,3,3,20,2e-06,24.05507640838623,38.73616075515747,0 +410,0.1177726686000824,0.3837335705757141,476.433349609375,0.45271697640419006,0.08976290374994278,25,6,1,20,2e-06,32.0726699590683,38.73616075515747,0 +420,0.025949519127607346,0.3671574890613556,221.02044677734375,0.0842948779463768,1.2399357557296753,21,2,0,20,2e-06,23.034889650344848,38.73616075515747,0 +430,0.06105482205748558,0.21240398287773132,561.1405639648438,0.14027021825313568,0.11835784465074539,23,4,1,20,2e-06,22.038195610046387,38.73616075515747,0 +440,0.04466128349304199,0.2812204957008362,402.17474365234375,0.03781316056847572,0.7842267155647278,27,8,3,20,2e-06,22.915445113182066,38.73616075515747,0 +450,0.04061897099018097,0.29445284605026245,303.8952331542969,0.18579182028770447,0.20181049406528473,26,7,0,20,2e-06,23.959732675552367,38.73616075515747,0 +460,0.0411653108894825,0.230205237865448,274.37994384765625,0.08779390156269073,0.2451409548521042,23,4,1,20,2e-06,32.287599658966066,38.73616075515747,0 +470,0.038078222423791885,0.3932263255119324,369.2795715332031,0.038929909467697144,3.5325992107391357,24,5,3,20,2e-06,23.535721278190614,38.73616075515747,0 +480,0.030840378254652023,0.28644904494285583,327.83428955078125,0.03441259637475014,0.19601081311702728,22,3,3,20,2e-06,24.821724438667296,38.73616075515747,0 +490,0.026166722178459167,0.4138016104698181,315.4535217285156,0.02544950135052204,1.9023053646087646,21,2,2,20,2e-06,23.79639105796814,38.73616075515747,0 +500,0.031214259564876556,0.3182380199432373,242.49249267578125,0.036448631435632706,0.09302487969398499,25,6,3,20,2e-06,24.254297924041747,38.73616075515747,0 diff --git a/backup_2026-09-14/runs/distill__stage4_opsd/config.json b/backup_2026-09-14/runs/distill__stage4_opsd/config.json new file mode 100644 index 0000000000000000000000000000000000000000..fed74be660419e3f5b2d7a40cde9635eac1c9b63 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage4_opsd/config.json @@ -0,0 +1,223 @@ +{ + "stage": "stage4_opsd", + "args": { + "smoke": false, + "dry_run": false, + "init_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step300.safetensors", + "allow_raw_student": false, + "model_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B", + "output": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd", + "seg_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3", + "text_table": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "limit": 0, + "scene_dropout": 0.0, + "rollout_cells": 61, + "denoise_list": "1000,750,500,250", + "kv_window": 17, + "sink_size": 3, + "rope_cap": 20, + "sink_anchor": "absolute", + "loss_type": "flow", + "loss_start_frame": 12, + "teacher_context": "real", + "teacher_keep_last": 1, + "teacher_last_chunk": "teacher", + "loss_norm": "window", + "backward_per_chunk": 1, + "ema_decay": 0.0, + "lr": 1e-06, + "weight_decay": 0.0, + "adam_betas": "0.0,0.999", + "warmup": 50, + "grad_clip": 10.0, + "batch_size": 1, + "grad_accum": 1, + "max_steps": 300, + "num_workers": 2, + "seed": 0, + "use_ema": 1, + "student_ema_decay": 0.99, + "ema_start": 50, + "save_every": 50, + "keep_last_dits": 25, + "keep_last_emas": 25, + "log_every": 10, + "profile_mem": 0, + "resume": "auto", + "force_run_dir": false, + "denoise": [ + 1000.0, + 750.0, + 500.0, + 250.0 + ] + }, + "betas": [ + 0.0, + 0.999 + ], + "preflight": { + "checked": true, + "sink_size": 3, + "kv_window": 17, + "rope_cap": 20, + "n_frames": 22, + "n_cached_max": 20, + "n_evictions": 2, + "cache_cells_final": 20, + "evict_effect": 0.012256205081939697, + "ms": 148.42748641967773, + "retained_last": [ + 0, + 1, + 2, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20 + ] + }, + "deploy_schedule": { + "t": [ + 1000.0, + 750.0000610351562, + 500.59954833984375, + 251.59742736816406 + ], + "sigma": [ + 1.0, + 0.7500000596046448, + 0.5005995631217957, + 0.25159743428230286 + ], + "idx": [ + 0, + 625, + 833, + 937 + ] + }, + "scored_cells": 49, + "scored_states": 196, + "dataset": { + "seg_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3", + "n_segments": 3000, + "segment_cells": 61, + "text_table_keys": 361 + }, + "model": { + "n_params": 4999803072, + "init_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step300.safetensors", + "start_step": 0, + "teacher": "frozen copy of init_ckpt (bfloat16, not sharded)", + "artifacts": "dits/ = student (upstream's deploy artifact); ema/ = our fp32 EMA shadow (deploy candidate)" + }, + "env": { + "world_size": 8, + "distributed_type": "DistributedType.FSDP", + "mixed_precision": "bf16", + "torch": "2.11.0+cu128", + "cuda": "12.8", + "gpu": "NVIDIA H200", + "python": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/python3.12", + "platform": "Linux-6.12.94-123.192.amzn2023.x86_64-x86_64-with-glibc2.34", + "hostname": "ip-172-16-244-218.ap-southeast-3.compute.internal", + "argv": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/distill/stage4_opsd/opsd_arope.py", + "--init_ckpt", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step300.safetensors", + "--seg_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3", + "--text_table", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "--denoise_list", + "1000,750,500,250", + "--kv_window", + "17", + "--sink_size", + "3", + "--rope_cap", + "20", + "--sink_anchor", + "absolute", + "--rollout_cells", + "61", + "--loss_start_frame", + "12", + "--loss_type", + "flow", + "--teacher_context", + "real", + "--teacher_keep_last", + "1", + "--teacher_last_chunk", + "teacher", + "--loss_norm", + "window", + "--backward_per_chunk", + "1", + "--ema_decay", + "0.0", + "--lr", + "1e-6", + "--weight_decay", + "0.0", + "--adam_betas", + "0.0,0.999", + "--warmup", + "50", + "--grad_clip", + "10.0", + "--batch_size", + "1", + "--grad_accum", + "1", + "--max_steps", + "300", + "--use_ema", + "1", + "--student_ema_decay", + "0.99", + "--ema_start", + "50", + "--save_every", + "50", + "--keep_last_dits", + "25", + "--keep_last_emas", + "25", + "--log_every", + "10", + "--profile_mem", + "0", + "--num_workers", + "2", + "--seed", + "0", + "--limit", + "0", + "--scene_dropout", + "0.0", + "--output", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd", + "--resume", + "auto" + ], + "started": "2026-09-10 17:54:26", + "cuda_visible_devices": "0,1,2,3,4,5,6,7", + "accelerate": "1.14.0" + } +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/distill__stage4_opsd/launch.log b/backup_2026-09-14/runs/distill__stage4_opsd/launch.log new file mode 100644 index 0000000000000000000000000000000000000000..11e64b919687a5605d84850d847350bc1601a7fd --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage4_opsd/launch.log @@ -0,0 +1,1139 @@ +=== stage4_opsd | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd world=8 dist=DistributedType.FSDP mp=bf16 === +[preflight] 警告:sink_size=3 > 0。ARoPE 的 h/w RoPE 位是一直在漂的世界坐标,被永久钉住的 sink cell 在长 rollout 之后会落在训练分布之外(实测 21 cell 内最大位移 373 px = 11.66 token)。stage3 正式训练与部署用的是 sink 3 / window 17 / cap 20。 +[preflight] 滑窗 KV OK: sink=3 window=17 cap=20;22 cell、n_cached 饱和在 20、驱逐 2 次、缓存收在 20 cell;驱逐对末帧的影响 1.226e-02;148 ms +[fsdp] use_orig_params=True reshard=None version=1 +[recipe] denoise=[1000.0, 750.0, 500.0, 250.0] ⇒ 网格 t=[1000.0, 750.0, 500.6, 251.6] sigma=[1.0, 0.75, 0.5006, 0.2516] +[recipe] kv_window=17 sink=3 cap=20 anchor=absolute rollout=61 cells loss_start=12 ⇒ scored 49 cells × 4 states loss=flow ctx=real keep_last=1 last_chunk=teacher norm=window lr=1e-06 betas=(0.0, 0.999) wd=0.0 clip=10.0 warmup=50 ga=1 teacher_ema=0.0 student_ema=1/0.99@50 max_steps=300 +[budget] 每步 ≈ 学生 60×4 读 + 60 提交 + 49×4 反向;教师 49×4 打分 + ~61 提交。活化值峰值 ≈ 4 个单 cell 图(stage3 实测 6.46 GiB/图)。墙钟按 stage3 的 22 s/27 cell 外推是 60–160 s/步 —— **先用 20 步 PROFILE_MEM=1 冒烟量到再信**。 +[AropeLongDatasetTF] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3: 3000 段,latent (48, 61, 30, 52),文本表 361 键,scene_dropout=0.0 +[data] 3000 段 × 61 cell(用前 61 个),文本表 361 键 +[resume] 没有 progress.json,从头开始 +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] student/teacher/ema ← ema_step300.safetensors +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] 3 × 4,999,803,072 参数(student fp32 可训 / teacher bfloat16 冻结不分片 / ema fp32 冻结),加载 26s +[model] mask-channel ||W||: student 0.0734 teacher 0.0734 +[train] 从 step 0 到 300 +[first-step] opsd 0.089020 (cell 12: 0.082923 → cell 60: 0.077027) gnorm 5.6352e-01 rollout 117.6s —— 期望:opsd 小但非零、gnorm 有限 > 0 +step 10/300 opsd 0.09975 (cell12 0.0995 … cell60 0.1180) gnorm 0.560 lr 2.20e-07 scored 49c/196s 90.2s mem 67.7GB +step 20/300 opsd 0.09629 (cell12 0.1245 … cell60 0.0989) gnorm 0.561 lr 4.20e-07 scored 49c/196s 77.1s mem 67.7GB +step 30/300 opsd 0.07548 (cell12 0.1082 … cell60 0.0866) gnorm 0.400 lr 6.20e-07 scored 49c/196s 86.3s mem 67.7GB +step 40/300 opsd 0.07143 (cell12 0.0508 … cell60 0.0512) gnorm 0.296 lr 8.20e-07 scored 49c/196s 75.9s mem 67.7GB +step 50/300 opsd 0.05388 (cell12 0.0804 … cell60 0.0465) gnorm 0.149 lr 1.00e-06 scored 49c/196s 76.2s mem 67.7GB +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd/dits/dit_step50.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd/ema/ema_step50.safetensors 827 个张量 10.00 GB +step 60/300 opsd 0.04109 (cell12 0.0386 … cell60 0.0533) gnorm 0.090 lr 1.00e-06 scored 49c/196s 88.1s mem 67.7GB +step 70/300 opsd 0.04611 (cell12 0.0427 … cell60 0.0367) gnorm 0.106 lr 1.00e-06 scored 49c/196s 76.2s mem 67.7GB +step 80/300 opsd 0.03955 (cell12 0.0729 … cell60 0.0300) gnorm 0.086 lr 1.00e-06 scored 49c/196s 76.0s mem 67.7GB +step 90/300 opsd 0.03372 (cell12 0.0269 … cell60 0.0296) gnorm 0.114 lr 1.00e-06 scored 49c/196s 75.3s mem 67.7GB +step 100/300 opsd 0.03799 (cell12 0.0279 … cell60 0.0436) gnorm 0.094 lr 1.00e-06 scored 49c/196s 75.5s mem 67.7GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd/dits/dit_step100.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd/ema/ema_step100.safetensors 827 个张量 10.00 GB +W0910 20:18:12.994000 1412014 .venv/lib/python3.12/site-packages/torch/distributed/elastic/agent/server/api.py:739] Received 15 death signal, shutting down workers +W0910 20:18:12.996000 1412014 .venv/lib/python3.12/site-packages/torch/distributed/elastic/multiprocessing/api.py:1012] Sending process 1413232 closing signal SIGTERM +W0910 20:18:12.997000 1412014 .venv/lib/python3.12/site-packages/torch/distributed/elastic/multiprocessing/api.py:1012] Sending process 1413233 closing signal SIGTERM +W0910 20:18:12.997000 1412014 .venv/lib/python3.12/site-packages/torch/distributed/elastic/multiprocessing/api.py:1012] Sending process 1413234 closing signal SIGTERM +W0910 20:18:12.997000 1412014 .venv/lib/python3.12/site-packages/torch/distributed/elastic/multiprocessing/api.py:1012] Sending process 1413235 closing signal SIGTERM +Traceback (most recent call last): + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/accelerate", line 6, in + sys.exit(main()) + ^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/accelerate/commands/accelerate_cli.py", line 50, in main + args.func(args) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/accelerate/commands/launch.py", line 1394, in launch_command + multi_gpu_launcher(args) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/accelerate/commands/launch.py", line 1023, in multi_gpu_launcher + distrib_run.run(args) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/run.py", line 981, in run + elastic_launch( + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/launcher/api.py", line 170, in __call__ + return launch_agent(self._config, self._entrypoint, list(args)) + ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/launcher/api.py", line 308, in launch_agent + result = agent.run() + ^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/metrics/api.py", line 134, in wrapper + result = f(*args, **kwargs) + ^^^^^^^^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/agent/server/api.py", line 731, in run + result = self._invoke_run(role) + ^^^^^^^^^^^^^^^^^^^^^^ + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/agent/server/api.py", line 908, in _invoke_run + time.sleep(monitor_interval) + File "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/elastic/multiprocessing/api.py", line 86, in _terminate_process_handler + raise SignalException(f"Process {os.getpid()} got signal: {sigval}", sigval=sigval) +torch.distributed.elastic.multiprocessing.api.SignalException: Process 1412014 got signal: 15 diff --git a/backup_2026-09-14/runs/distill__stage4_opsd/progress.json b/backup_2026-09-14/runs/distill__stage4_opsd/progress.json new file mode 100644 index 0000000000000000000000000000000000000000..54295f9e582d094f63223ff1598157c5c4acfc60 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage4_opsd/progress.json @@ -0,0 +1 @@ +{"step": 100, "wall": 1789070864.6916044, "time": "2026-09-10 20:07:44", "stage": "stage4_opsd"} \ No newline at end of file diff --git a/backup_2026-09-14/runs/distill__stage4_opsd/train.log b/backup_2026-09-14/runs/distill__stage4_opsd/train.log new file mode 100644 index 0000000000000000000000000000000000000000..f5d49a815c70ae38e8391403bf49fc5a50a45f98 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage4_opsd/train.log @@ -0,0 +1,28 @@ +[2026-09-10 17:53:49] === stage4_opsd | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd world=8 dist=DistributedType.FSDP mp=bf16 === +[2026-09-10 17:53:49] [preflight] 警告:sink_size=3 > 0。ARoPE 的 h/w RoPE 位是一直在漂的世界坐标,被永久钉住的 sink cell 在长 rollout 之后会落在训练分布之外(实测 21 cell 内最大位移 373 px = 11.66 token)。stage3 正式训练与部署用的是 sink 3 / window 17 / cap 20。 +[2026-09-10 17:53:49] [preflight] 滑窗 KV OK: sink=3 window=17 cap=20;22 cell、n_cached 饱和在 20、驱逐 2 次、缓存收在 20 cell;驱逐对末帧的影响 1.226e-02;148 ms +[2026-09-10 17:53:49] [fsdp] use_orig_params=True reshard=None version=1 +[2026-09-10 17:53:49] [recipe] denoise=[1000.0, 750.0, 500.0, 250.0] ⇒ 网格 t=[1000.0, 750.0, 500.6, 251.6] sigma=[1.0, 0.75, 0.5006, 0.2516] +[2026-09-10 17:53:49] [recipe] kv_window=17 sink=3 cap=20 anchor=absolute rollout=61 cells loss_start=12 ⇒ scored 49 cells × 4 states loss=flow ctx=real keep_last=1 last_chunk=teacher norm=window lr=1e-06 betas=(0.0, 0.999) wd=0.0 clip=10.0 warmup=50 ga=1 teacher_ema=0.0 student_ema=1/0.99@50 max_steps=300 +[2026-09-10 17:53:49] [budget] 每步 ≈ 学生 60×4 读 + 60 提交 + 49×4 反向;教师 49×4 打分 + ~61 提交。活化值峰值 ≈ 4 个单 cell 图(stage3 实测 6.46 GiB/图)。墙钟按 stage3 的 22 s/27 cell 外推是 60–160 s/步 —— **先用 20 步 PROFILE_MEM=1 冒烟量到再信**。 +[2026-09-10 17:53:50] [data] 3000 段 × 61 cell(用前 61 个),文本表 361 键 +[2026-09-10 17:53:50] [resume] 没有 progress.json,从头开始 +[2026-09-10 17:54:04] [model] student/teacher/ema ← ema_step300.safetensors +[2026-09-10 17:54:16] [model] 3 × 4,999,803,072 参数(student fp32 可训 / teacher bfloat16 冻结不分片 / ema fp32 冻结),加载 26s +[2026-09-10 17:54:16] [model] mask-channel ||W||: student 0.0734 teacher 0.0734 +[2026-09-10 17:54:26] [train] 从 step 0 到 300 +[2026-09-10 17:56:25] [first-step] opsd 0.089020 (cell 12: 0.082923 → cell 60: 0.077027) gnorm 5.6352e-01 rollout 117.6s —— 期望:opsd 小但非零、gnorm 有限 > 0 +[2026-09-10 18:09:28] step 10/300 opsd 0.09975 (cell12 0.0995 … cell60 0.1180) gnorm 0.560 lr 2.20e-07 scored 49c/196s 90.2s mem 67.7GB +[2026-09-10 18:22:20] step 20/300 opsd 0.09629 (cell12 0.1245 … cell60 0.0989) gnorm 0.561 lr 4.20e-07 scored 49c/196s 77.1s mem 67.7GB +[2026-09-10 18:36:42] step 30/300 opsd 0.07548 (cell12 0.1082 … cell60 0.0866) gnorm 0.400 lr 6.20e-07 scored 49c/196s 86.3s mem 67.7GB +[2026-09-10 18:49:22] step 40/300 opsd 0.07143 (cell12 0.0508 … cell60 0.0512) gnorm 0.296 lr 8.20e-07 scored 49c/196s 75.9s mem 67.7GB +[2026-09-10 19:02:04] step 50/300 opsd 0.05388 (cell12 0.0804 … cell60 0.0465) gnorm 0.149 lr 1.00e-06 scored 49c/196s 76.2s mem 67.7GB +[2026-09-10 19:02:24] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd/dits/dit_step50.safetensors 827 个张量 10.00 GB +[2026-09-10 19:02:39] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd/ema/ema_step50.safetensors 827 个张量 10.00 GB +[2026-09-10 19:16:45] step 60/300 opsd 0.04109 (cell12 0.0386 … cell60 0.0533) gnorm 0.090 lr 1.00e-06 scored 49c/196s 88.1s mem 67.7GB +[2026-09-10 19:29:27] step 70/300 opsd 0.04611 (cell12 0.0427 … cell60 0.0367) gnorm 0.106 lr 1.00e-06 scored 49c/196s 76.2s mem 67.7GB +[2026-09-10 19:42:08] step 80/300 opsd 0.03955 (cell12 0.0729 … cell60 0.0300) gnorm 0.086 lr 1.00e-06 scored 49c/196s 76.0s mem 67.7GB +[2026-09-10 19:54:40] step 90/300 opsd 0.03372 (cell12 0.0269 … cell60 0.0296) gnorm 0.114 lr 1.00e-06 scored 49c/196s 75.3s mem 67.7GB +[2026-09-10 20:07:16] step 100/300 opsd 0.03799 (cell12 0.0279 … cell60 0.0436) gnorm 0.094 lr 1.00e-06 scored 49c/196s 75.5s mem 67.7GB +[2026-09-10 20:07:29] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd/dits/dit_step100.safetensors 827 个张量 10.00 GB +[2026-09-10 20:07:43] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd/ema/ema_step100.safetensors 827 个张量 10.00 GB diff --git a/backup_2026-09-14/runs/distill__stage4_opsd/train_log.csv b/backup_2026-09-14/runs/distill__stage4_opsd/train_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..90c1c5590525a6971ff02677b4728a493c1bd1d8 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage4_opsd/train_log.csv @@ -0,0 +1,11 @@ +step,opsd,gnorm,lr,n_scored_cells,n_scored_states,first_cell,last_cell,step_time,mem_gb,epoch +10,0.09974665939807892,0.5597752332687378,2.1999999999999998e-07,49,196,0.09951475262641907,0.1180247813463211,90.23504617214203,67.73509645462036,0 +20,0.09628939628601074,0.5611482262611389,4.1999999999999995e-07,49,196,0.12448903173208237,0.09891052544116974,77.14460318088531,67.73509645462036,0 +30,0.07547610253095627,0.4004954993724823,6.2e-07,49,196,0.10818423330783844,0.08664890378713608,86.27687046527862,67.73509645462036,0 +40,0.0714307650923729,0.29638493061065674,8.199999999999999e-07,49,196,0.05079763010144234,0.05115228146314621,75.91043066978455,67.73509645462036,0 +50,0.053882598876953125,0.14904078841209412,1e-06,49,196,0.0803791731595993,0.04653956741094589,76.2173600435257,67.73509645462036,0 +60,0.04108764976263046,0.08967377245426178,1e-06,49,196,0.03858102113008499,0.053265370428562164,88.14108550548553,67.73509645462036,0 +70,0.04610796272754669,0.10592803359031677,1e-06,49,196,0.04274926707148552,0.036689527332782745,76.23242015838623,67.73509645462036,0 +80,0.039553798735141754,0.08614633977413177,1e-06,49,196,0.07290668040513992,0.029951399192214012,76.03486287593842,67.73509645462036,0 +90,0.033719319850206375,0.11410117894411087,1e-06,49,196,0.026925839483737946,0.02955792285501957,75.26925201416016,67.73509645462036,0 +100,0.03799053654074669,0.09376213699579239,1e-06,49,196,0.027933575212955475,0.043592870235443115,75.5217916727066,67.73509645462036,0 diff --git a/backup_2026-09-14/runs/distill__stage4_opsd_lora/config.json b/backup_2026-09-14/runs/distill__stage4_opsd_lora/config.json new file mode 100644 index 0000000000000000000000000000000000000000..f6fdc022a36c52c40cd66039da8de9cd0e46bfa3 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage4_opsd_lora/config.json @@ -0,0 +1,230 @@ +{ + "stage": "stage4_opsd", + "args": { + "smoke": false, + "dry_run": false, + "init_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step300.safetensors", + "allow_raw_student": false, + "model_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B", + "output": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora", + "seg_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3", + "text_table": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "limit": 0, + "scene_dropout": 0.0, + "rollout_cells": 61, + "denoise_list": "1000,750,500,250", + "kv_window": 17, + "sink_size": 3, + "rope_cap": 20, + "sink_anchor": "absolute", + "loss_type": "flow", + "loss_start_frame": 12, + "teacher_context": "real", + "teacher_keep_last": 1, + "teacher_last_chunk": "teacher", + "loss_norm": "window", + "backward_per_chunk": 1, + "ema_decay": 0.0, + "lora_rank": 256, + "lora_alpha": 0, + "lr": 1e-05, + "weight_decay": 0.0, + "adam_betas": "0.0,0.999", + "warmup": 50, + "grad_clip": 10.0, + "batch_size": 1, + "grad_accum": 1, + "max_steps": 300, + "num_workers": 2, + "seed": 0, + "use_ema": 1, + "student_ema_decay": 0.99, + "ema_start": 50, + "save_every": 50, + "keep_last_dits": 25, + "keep_last_emas": 25, + "log_every": 10, + "profile_mem": 0, + "resume": "auto", + "force_run_dir": false, + "denoise": [ + 1000.0, + 750.0, + 500.0, + 250.0 + ] + }, + "betas": [ + 0.0, + 0.999 + ], + "preflight": { + "checked": true, + "sink_size": 3, + "kv_window": 17, + "rope_cap": 20, + "n_frames": 22, + "n_cached_max": 20, + "n_evictions": 2, + "cache_cells_final": 20, + "evict_effect": 0.012256205081939697, + "ms": 170.31216621398926, + "retained_last": [ + 0, + 1, + 2, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20 + ] + }, + "deploy_schedule": { + "t": [ + 1000.0, + 750.0000610351562, + 500.59954833984375, + 251.59742736816406 + ], + "sigma": [ + 1.0, + 0.7500000596046448, + 0.5005995631217957, + 0.25159743428230286 + ], + "idx": [ + 0, + 625, + 833, + 937 + ] + }, + "scored_cells": 49, + "scored_states": 196, + "dataset": { + "seg_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3", + "n_segments": 3000, + "segment_cells": 61, + "text_table_keys": 361 + }, + "model": { + "n_params": 5455933632, + "init_ckpt": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step300.safetensors", + "start_step": 0, + "teacher": "teacher = 学生关掉 LoRA 补丁(恒为 init_ckpt,不另占显存)", + "lora_rank": 256, + "artifacts": "dits/ = student (upstream's deploy artifact); ema/ = our fp32 EMA shadow (deploy candidate)" + }, + "env": { + "world_size": 8, + "distributed_type": "DistributedType.FSDP", + "mixed_precision": "bf16", + "torch": "2.11.0+cu128", + "cuda": "12.8", + "gpu": "NVIDIA H200", + "python": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/python3.12", + "platform": "Linux-6.12.94-123.192.amzn2023.x86_64-x86_64-with-glibc2.34", + "hostname": "ip-172-16-244-218.ap-southeast-3.compute.internal", + "argv": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/distill/stage4_opsd/opsd_arope.py", + "--init_ckpt", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage3_dmd/ema/ema_step300.safetensors", + "--seg_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3", + "--text_table", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "--denoise_list", + "1000,750,500,250", + "--kv_window", + "17", + "--sink_size", + "3", + "--rope_cap", + "20", + "--sink_anchor", + "absolute", + "--rollout_cells", + "61", + "--loss_start_frame", + "12", + "--loss_type", + "flow", + "--teacher_context", + "real", + "--teacher_keep_last", + "1", + "--teacher_last_chunk", + "teacher", + "--loss_norm", + "window", + "--backward_per_chunk", + "1", + "--ema_decay", + "0.0", + "--lora_rank", + "256", + "--lora_alpha", + "0", + "--lr", + "1e-5", + "--weight_decay", + "0.0", + "--adam_betas", + "0.0,0.999", + "--warmup", + "50", + "--grad_clip", + "10.0", + "--batch_size", + "1", + "--grad_accum", + "1", + "--max_steps", + "300", + "--use_ema", + "1", + "--student_ema_decay", + "0.99", + "--ema_start", + "50", + "--save_every", + "50", + "--keep_last_dits", + "25", + "--keep_last_emas", + "25", + "--log_every", + "10", + "--profile_mem", + "0", + "--num_workers", + "2", + "--seed", + "0", + "--limit", + "0", + "--scene_dropout", + "0.0", + "--output", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora", + "--resume", + "auto" + ], + "started": "2026-09-10 21:35:20", + "cuda_visible_devices": "0,1,2,3,4,5,6,7", + "accelerate": "1.14.0" + } +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/distill__stage4_opsd_lora/launch.log b/backup_2026-09-14/runs/distill__stage4_opsd_lora/launch.log new file mode 100644 index 0000000000000000000000000000000000000000..31dbe93968468c45b419398e1361054a5ca6e08e --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage4_opsd_lora/launch.log @@ -0,0 +1,797 @@ +=== stage4_opsd | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora world=8 dist=DistributedType.FSDP mp=bf16 === +[preflight] 警告:sink_size=3 > 0。ARoPE 的 h/w RoPE 位是一直在漂的世界坐标,被永久钉住的 sink cell 在长 rollout 之后会落在训练分布之外(实测 21 cell 内最大位移 373 px = 11.66 token)。stage3 正式训练与部署用的是 sink 3 / window 17 / cap 20。 +[preflight] 滑窗 KV OK: sink=3 window=17 cap=20;22 cell、n_cached 饱和在 20、驱逐 2 次、缓存收在 20 cell;驱逐对末帧的影响 1.226e-02;170 ms +[fsdp] use_orig_params=True reshard=None version=1 +[recipe] denoise=[1000.0, 750.0, 500.0, 250.0] ⇒ 网格 t=[1000.0, 750.0, 500.6, 251.6] sigma=[1.0, 0.75, 0.5006, 0.2516] +[recipe] kv_window=17 sink=3 cap=20 anchor=absolute rollout=61 cells loss_start=12 ⇒ scored 49 cells × 4 states loss=flow ctx=real keep_last=1 last_chunk=teacher norm=window lora=256 lr=1e-05 betas=(0.0, 0.999) wd=0.0 clip=10.0 warmup=50 ga=1 teacher_ema=0.0 student_ema=1/0.99@50 max_steps=300 +[budget] 每步 ≈ 学生 60×4 读 + 60 提交 + 49×4 反向;教师 49×4 打分 + ~61 提交。活化值峰值 ≈ 4 个单 cell 图(stage3 实测 6.46 GiB/图)。墙钟按 stage3 的 22 s/27 cell 外推是 60–160 s/步 —— **先用 20 步 PROFILE_MEM=1 冒烟量到再信**。 +[AropeLongDatasetTF] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_long/K3: 3000 段,latent (48, 61, 30, 52),文本表 361 键,scene_dropout=0.0 +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +[data] 3000 段 × 61 cell(用前 61 个),文本表 361 键 +[resume] 没有 progress.json,从头开始 +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loading models from: [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +] +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[model] student/teacher/ema ← ema_step300.safetensors +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +Loaded model: { + "model_name": "wan_video_dit", + "model_class": "diffsynth.models.wan_video_dit.WanModel", + "extra_kwargs": { + "has_image_input": false, + "patch_size": [ + 1, + 2, + 2 + ], + "in_dim": 48, + "dim": 3072, + "ffn_dim": 14336, + "freq_dim": 256, + "text_dim": 4096, + "out_dim": 48, + "num_heads": 24, + "num_layers": 30, + "eps": 1e-06, + "seperated_timestep": true, + "require_clip_embedding": false, + "require_vae_embedding": false, + "fuse_vae_embedding_in_latents": true + } +} +No wan_video_text_encoder models available. This is not an error. +Using wan_video_dit from [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00001-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00002-of-00003.safetensors", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/Wan2.2-TI2V-5B/diffusion_pytorch_model-00003-of-00003.safetensors" +]. +No wan_video_vae models available. This is not an error. +No wan_video_image_encoder models available. This is not an error. +No wan_video_motion_controller models available. This is not an error. +No wan_video_vace models available. This is not an error. +No wan_video_vap models available. This is not an error. +No wans2v_audio_encoder models available. This is not an error. +No wan_video_animate_adapter models available. This is not an error. +[lora] critic:包了 180 个 Linear (rank=256 alpha=256 scale=1),可训 456.1M / 5456M = 8.36% +[model] 5,455,933,632 参数,可训 456,130,560(8.36%,LoRA rank 256)/ teacher = 学生关掉 LoRA 补丁(恒为 init_ckpt,不另占显存) / ema fp32 冻结,加载 16s +[model] mask-channel ||W||: student 0.0734 teacher 0.0734 +[train] 从 step 0 到 300 +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/utils/_contextlib.py:124: UserWarning: Called FSDP.clip_grad_norm_() on rank 7 with no gradients -- returning the total norm in the default dtype torch.float32 + return func(*args, **kwargs) +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/utils/_contextlib.py:124: UserWarning: Called FSDP.clip_grad_norm_() on rank 2 with no gradients -- returning the total norm in the default dtype torch.float32 + return func(*args, **kwargs) +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/utils/_contextlib.py:124: UserWarning: Called FSDP.clip_grad_norm_() on rank 4 with no gradients -- returning the total norm in the default dtype torch.float32 + return func(*args, **kwargs) +[first-step] opsd 0.084172 (cell 12: 0.071072 → cell 60: 0.047005) gnorm 3.8919e-02 rollout 143.3s —— 期望:opsd 小但非零、gnorm 有限 > 0 +step 10/300 opsd 0.10010 (cell12 0.0699 … cell60 0.0576) gnorm 0.034 lr 2.20e-06 scored 49c/196s 112.4s mem 57.5GB +step 20/300 opsd 0.07684 (cell12 0.0362 … cell60 0.0911) gnorm 0.032 lr 4.20e-06 scored 49c/196s 108.3s mem 57.5GB +step 30/300 opsd 0.05720 (cell12 0.0575 … cell60 0.0630) gnorm 0.029 lr 6.20e-06 scored 49c/196s 108.1s mem 57.5GB +step 40/300 opsd 0.04181 (cell12 0.0608 … cell60 0.0386) gnorm 0.026 lr 8.20e-06 scored 49c/196s 108.1s mem 57.5GB +step 50/300 opsd 0.03849 (cell12 0.0404 … cell60 0.0315) gnorm 0.022 lr 1.00e-05 scored 49c/196s 109.0s mem 57.5GB +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:821: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + prev_state_dict_settings = FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/lib64/python3.12/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:828: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . + FullyShardedDataParallel.set_state_dict_type( +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step50.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step50.safetensors 827 个张量 10.00 GB +step 60/300 opsd 0.03899 (cell12 0.0455 … cell60 0.0219) gnorm 0.022 lr 1.00e-05 scored 49c/196s 126.1s mem 57.5GB +step 70/300 opsd 0.03538 (cell12 0.0334 … cell60 0.0281) gnorm 0.022 lr 1.00e-05 scored 49c/196s 108.5s mem 57.5GB +step 80/300 opsd 0.03546 (cell12 0.0372 … cell60 0.0304) gnorm 0.019 lr 1.00e-05 scored 49c/196s 108.4s mem 57.5GB +step 90/300 opsd 0.03435 (cell12 0.0396 … cell60 0.0381) gnorm 0.032 lr 1.00e-05 scored 49c/196s 108.3s mem 57.5GB +step 100/300 opsd 0.03892 (cell12 0.0251 … cell60 0.0376) gnorm 0.025 lr 1.00e-05 scored 49c/196s 108.7s mem 57.5GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step100.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step100.safetensors 827 个张量 10.00 GB +step 110/300 opsd 0.03293 (cell12 0.0424 … cell60 0.0262) gnorm 0.030 lr 1.00e-05 scored 49c/196s 123.6s mem 57.5GB +step 120/300 opsd 0.03451 (cell12 0.0319 … cell60 0.0284) gnorm 0.021 lr 1.00e-05 scored 49c/196s 108.1s mem 57.5GB +step 130/300 opsd 0.03488 (cell12 0.0304 … cell60 0.0227) gnorm 0.019 lr 1.00e-05 scored 49c/196s 108.9s mem 57.5GB +step 140/300 opsd 0.03370 (cell12 0.0436 … cell60 0.0510) gnorm 0.026 lr 1.00e-05 scored 49c/196s 108.2s mem 57.5GB +step 150/300 opsd 0.03403 (cell12 0.0294 … cell60 0.0356) gnorm 0.030 lr 1.00e-05 scored 49c/196s 108.4s mem 57.5GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step150.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step150.safetensors 827 个张量 10.00 GB +step 160/300 opsd 0.03080 (cell12 0.0345 … cell60 0.0242) gnorm 0.023 lr 1.00e-05 scored 49c/196s 116.0s mem 57.5GB +step 170/300 opsd 0.03128 (cell12 0.0344 … cell60 0.0429) gnorm 0.027 lr 1.00e-05 scored 49c/196s 108.9s mem 57.5GB +step 180/300 opsd 0.03475 (cell12 0.0304 … cell60 0.0392) gnorm 0.023 lr 1.00e-05 scored 49c/196s 107.5s mem 57.5GB +step 190/300 opsd 0.03148 (cell12 0.0314 … cell60 0.0306) gnorm 0.014 lr 1.00e-05 scored 49c/196s 107.5s mem 57.5GB +step 200/300 opsd 0.03225 (cell12 0.0238 … cell60 0.0376) gnorm 0.020 lr 1.00e-05 scored 49c/196s 106.7s mem 57.5GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step200.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step200.safetensors 827 个张量 10.00 GB +step 210/300 opsd 0.03252 (cell12 0.0326 … cell60 0.0309) gnorm 0.029 lr 1.00e-05 scored 49c/196s 114.4s mem 57.5GB +step 220/300 opsd 0.03250 (cell12 0.0320 … cell60 0.0384) gnorm 0.024 lr 1.00e-05 scored 49c/196s 107.9s mem 57.5GB +step 230/300 opsd 0.03069 (cell12 0.0375 … cell60 0.0423) gnorm 0.025 lr 1.00e-05 scored 49c/196s 107.6s mem 57.5GB +step 240/300 opsd 0.03305 (cell12 0.0482 … cell60 0.0277) gnorm 0.029 lr 1.00e-05 scored 49c/196s 108.2s mem 57.5GB +step 250/300 opsd 0.03159 (cell12 0.0249 … cell60 0.0290) gnorm 0.021 lr 1.00e-05 scored 49c/196s 107.6s mem 57.5GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step250.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step250.safetensors 827 个张量 10.00 GB +step 260/300 opsd 0.03247 (cell12 0.0243 … cell60 0.0269) gnorm 0.023 lr 1.00e-05 scored 49c/196s 115.1s mem 57.5GB +step 270/300 opsd 0.03198 (cell12 0.0548 … cell60 0.0325) gnorm 0.019 lr 1.00e-05 scored 49c/196s 106.5s mem 57.5GB +step 280/300 opsd 0.02913 (cell12 0.0294 … cell60 0.0287) gnorm 0.022 lr 1.00e-05 scored 49c/196s 106.6s mem 57.5GB +step 290/300 opsd 0.03559 (cell12 0.0176 … cell60 0.0207) gnorm 0.037 lr 1.00e-05 scored 49c/196s 107.0s mem 57.5GB +step 300/300 opsd 0.04084 (cell12 0.0486 … cell60 0.0379) gnorm 0.056 lr 1.00e-05 scored 49c/196s 106.9s mem 57.5GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step300.safetensors 827 个张量 10.00 GB +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step300.safetensors 827 个张量 10.00 GB +[done] step 300,各进程峰值显存 57.7 GB。dits/ 是学生本体(上游的部署产物),ema/ 是 fp32 影子;两者都按里程碑用 distill/eval/rollout_eval.py 在 60+ cell 上量远端漂移来挑 —— OPSD 的全部主张都在 rollout 的远端,与 pre-OPSD 的 stage3 EMA 对比才是交付物。 diff --git a/backup_2026-09-14/runs/distill__stage4_opsd_lora/progress.json b/backup_2026-09-14/runs/distill__stage4_opsd_lora/progress.json new file mode 100644 index 0000000000000000000000000000000000000000..782c3729ba93b19122a16491d8188150fa3a95c5 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage4_opsd_lora/progress.json @@ -0,0 +1 @@ +{"step": 300, "wall": 1789109162.494311, "time": "2026-09-11 06:46:02", "stage": "stage4_opsd", "finished": true, "peak_mem_gb": 57.72789764404297, "last": {"opsd": 0.04865096079907855, "gnorm": 0.05644448846578598, "n_scored_cells": 49, "n_scored_states": 196, "first_cell": 0.048566997051239014, "last_cell": 0.0379190593957901}} \ No newline at end of file diff --git a/backup_2026-09-14/runs/distill__stage4_opsd_lora/train.log b/backup_2026-09-14/runs/distill__stage4_opsd_lora/train.log new file mode 100644 index 0000000000000000000000000000000000000000..ee76e50933ac0104aa158b456e222b69ae1c1fd5 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage4_opsd_lora/train.log @@ -0,0 +1,58 @@ +[2026-09-10 21:34:54] === stage4_opsd | run=/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora world=8 dist=DistributedType.FSDP mp=bf16 === +[2026-09-10 21:34:54] [preflight] 警告:sink_size=3 > 0。ARoPE 的 h/w RoPE 位是一直在漂的世界坐标,被永久钉住的 sink cell 在长 rollout 之后会落在训练分布之外(实测 21 cell 内最大位移 373 px = 11.66 token)。stage3 正式训练与部署用的是 sink 3 / window 17 / cap 20。 +[2026-09-10 21:34:54] [preflight] 滑窗 KV OK: sink=3 window=17 cap=20;22 cell、n_cached 饱和在 20、驱逐 2 次、缓存收在 20 cell;驱逐对末帧的影响 1.226e-02;170 ms +[2026-09-10 21:34:54] [fsdp] use_orig_params=True reshard=None version=1 +[2026-09-10 21:34:54] [recipe] denoise=[1000.0, 750.0, 500.0, 250.0] ⇒ 网格 t=[1000.0, 750.0, 500.6, 251.6] sigma=[1.0, 0.75, 0.5006, 0.2516] +[2026-09-10 21:34:54] [recipe] kv_window=17 sink=3 cap=20 anchor=absolute rollout=61 cells loss_start=12 ⇒ scored 49 cells × 4 states loss=flow ctx=real keep_last=1 last_chunk=teacher norm=window lora=256 lr=1e-05 betas=(0.0, 0.999) wd=0.0 clip=10.0 warmup=50 ga=1 teacher_ema=0.0 student_ema=1/0.99@50 max_steps=300 +[2026-09-10 21:34:54] [budget] 每步 ≈ 学生 60×4 读 + 60 提交 + 49×4 反向;教师 49×4 打分 + ~61 提交。活化值峰值 ≈ 4 个单 cell 图(stage3 实测 6.46 GiB/图)。墙钟按 stage3 的 22 s/27 cell 外推是 60–160 s/步 —— **先用 20 步 PROFILE_MEM=1 冒烟量到再信**。 +[2026-09-10 21:34:55] [data] 3000 段 × 61 cell(用前 61 个),文本表 361 键 +[2026-09-10 21:34:55] [resume] 没有 progress.json,从头开始 +[2026-09-10 21:35:05] [model] student/teacher/ema ← ema_step300.safetensors +[2026-09-10 21:35:06] [lora] critic:包了 180 个 Linear (rank=256 alpha=256 scale=1),可训 456.1M / 5456M = 8.36% +[2026-09-10 21:35:12] [model] 5,455,933,632 参数,可训 456,130,560(8.36%,LoRA rank 256)/ teacher = 学生关掉 LoRA 补丁(恒为 init_ckpt,不另占显存) / ema fp32 冻结,加载 16s +[2026-09-10 21:35:12] [model] mask-channel ||W||: student 0.0734 teacher 0.0734 +[2026-09-10 21:35:20] [train] 从 step 0 到 300 +[2026-09-10 21:37:45] [first-step] opsd 0.084172 (cell 12: 0.071072 → cell 60: 0.047005) gnorm 3.8919e-02 rollout 143.3s —— 期望:opsd 小但非零、gnorm 有限 > 0 +[2026-09-10 21:54:04] step 10/300 opsd 0.10010 (cell12 0.0699 … cell60 0.0576) gnorm 0.034 lr 2.20e-06 scored 49c/196s 112.4s mem 57.5GB +[2026-09-10 22:12:07] step 20/300 opsd 0.07684 (cell12 0.0362 … cell60 0.0911) gnorm 0.032 lr 4.20e-06 scored 49c/196s 108.3s mem 57.5GB +[2026-09-10 22:30:07] step 30/300 opsd 0.05720 (cell12 0.0575 … cell60 0.0630) gnorm 0.029 lr 6.20e-06 scored 49c/196s 108.1s mem 57.5GB +[2026-09-10 22:48:08] step 40/300 opsd 0.04181 (cell12 0.0608 … cell60 0.0386) gnorm 0.026 lr 8.20e-06 scored 49c/196s 108.1s mem 57.5GB +[2026-09-10 23:06:18] step 50/300 opsd 0.03849 (cell12 0.0404 … cell60 0.0315) gnorm 0.022 lr 1.00e-05 scored 49c/196s 109.0s mem 57.5GB +[2026-09-10 23:06:57] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step50.safetensors 827 个张量 10.00 GB +[2026-09-10 23:07:35] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step50.safetensors 827 个张量 10.00 GB +[2026-09-10 23:27:19] step 60/300 opsd 0.03899 (cell12 0.0455 … cell60 0.0219) gnorm 0.022 lr 1.00e-05 scored 49c/196s 126.1s mem 57.5GB +[2026-09-10 23:45:24] step 70/300 opsd 0.03538 (cell12 0.0334 … cell60 0.0281) gnorm 0.022 lr 1.00e-05 scored 49c/196s 108.5s mem 57.5GB +[2026-09-11 00:03:28] step 80/300 opsd 0.03546 (cell12 0.0372 … cell60 0.0304) gnorm 0.019 lr 1.00e-05 scored 49c/196s 108.4s mem 57.5GB +[2026-09-11 00:21:31] step 90/300 opsd 0.03435 (cell12 0.0396 … cell60 0.0381) gnorm 0.032 lr 1.00e-05 scored 49c/196s 108.3s mem 57.5GB +[2026-09-11 00:39:38] step 100/300 opsd 0.03892 (cell12 0.0251 … cell60 0.0376) gnorm 0.025 lr 1.00e-05 scored 49c/196s 108.7s mem 57.5GB +[2026-09-11 00:40:11] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step100.safetensors 827 个张量 10.00 GB +[2026-09-11 00:40:46] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step100.safetensors 827 个张量 10.00 GB +[2026-09-11 01:00:14] step 110/300 opsd 0.03293 (cell12 0.0424 … cell60 0.0262) gnorm 0.030 lr 1.00e-05 scored 49c/196s 123.6s mem 57.5GB +[2026-09-11 01:18:15] step 120/300 opsd 0.03451 (cell12 0.0319 … cell60 0.0284) gnorm 0.021 lr 1.00e-05 scored 49c/196s 108.1s mem 57.5GB +[2026-09-11 01:36:23] step 130/300 opsd 0.03488 (cell12 0.0304 … cell60 0.0227) gnorm 0.019 lr 1.00e-05 scored 49c/196s 108.9s mem 57.5GB +[2026-09-11 01:54:25] step 140/300 opsd 0.03370 (cell12 0.0436 … cell60 0.0510) gnorm 0.026 lr 1.00e-05 scored 49c/196s 108.2s mem 57.5GB +[2026-09-11 02:12:29] step 150/300 opsd 0.03403 (cell12 0.0294 … cell60 0.0356) gnorm 0.030 lr 1.00e-05 scored 49c/196s 108.4s mem 57.5GB +[2026-09-11 02:13:04] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step150.safetensors 827 个张量 10.00 GB +[2026-09-11 02:13:40] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step150.safetensors 827 个张量 10.00 GB +[2026-09-11 02:31:50] step 160/300 opsd 0.03080 (cell12 0.0345 … cell60 0.0242) gnorm 0.023 lr 1.00e-05 scored 49c/196s 116.0s mem 57.5GB +[2026-09-11 02:49:59] step 170/300 opsd 0.03128 (cell12 0.0344 … cell60 0.0429) gnorm 0.027 lr 1.00e-05 scored 49c/196s 108.9s mem 57.5GB +[2026-09-11 03:07:54] step 180/300 opsd 0.03475 (cell12 0.0304 … cell60 0.0392) gnorm 0.023 lr 1.00e-05 scored 49c/196s 107.5s mem 57.5GB +[2026-09-11 03:25:49] step 190/300 opsd 0.03148 (cell12 0.0314 … cell60 0.0306) gnorm 0.014 lr 1.00e-05 scored 49c/196s 107.5s mem 57.5GB +[2026-09-11 03:43:35] step 200/300 opsd 0.03225 (cell12 0.0238 … cell60 0.0376) gnorm 0.020 lr 1.00e-05 scored 49c/196s 106.7s mem 57.5GB +[2026-09-11 03:44:10] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step200.safetensors 827 个张量 10.00 GB +[2026-09-11 03:44:46] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step200.safetensors 827 个张量 10.00 GB +[2026-09-11 04:02:39] step 210/300 opsd 0.03252 (cell12 0.0326 … cell60 0.0309) gnorm 0.029 lr 1.00e-05 scored 49c/196s 114.4s mem 57.5GB +[2026-09-11 04:20:38] step 220/300 opsd 0.03250 (cell12 0.0320 … cell60 0.0384) gnorm 0.024 lr 1.00e-05 scored 49c/196s 107.9s mem 57.5GB +[2026-09-11 04:38:34] step 230/300 opsd 0.03069 (cell12 0.0375 … cell60 0.0423) gnorm 0.025 lr 1.00e-05 scored 49c/196s 107.6s mem 57.5GB +[2026-09-11 04:56:36] step 240/300 opsd 0.03305 (cell12 0.0482 … cell60 0.0277) gnorm 0.029 lr 1.00e-05 scored 49c/196s 108.2s mem 57.5GB +[2026-09-11 05:14:31] step 250/300 opsd 0.03159 (cell12 0.0249 … cell60 0.0290) gnorm 0.021 lr 1.00e-05 scored 49c/196s 107.6s mem 57.5GB +[2026-09-11 05:15:05] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step250.safetensors 827 个张量 10.00 GB +[2026-09-11 05:15:39] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step250.safetensors 827 个张量 10.00 GB +[2026-09-11 05:33:43] step 260/300 opsd 0.03247 (cell12 0.0243 … cell60 0.0269) gnorm 0.023 lr 1.00e-05 scored 49c/196s 115.1s mem 57.5GB +[2026-09-11 05:51:28] step 270/300 opsd 0.03198 (cell12 0.0548 … cell60 0.0325) gnorm 0.019 lr 1.00e-05 scored 49c/196s 106.5s mem 57.5GB +[2026-09-11 06:09:13] step 280/300 opsd 0.02913 (cell12 0.0294 … cell60 0.0287) gnorm 0.022 lr 1.00e-05 scored 49c/196s 106.6s mem 57.5GB +[2026-09-11 06:27:03] step 290/300 opsd 0.03559 (cell12 0.0176 … cell60 0.0207) gnorm 0.037 lr 1.00e-05 scored 49c/196s 107.0s mem 57.5GB +[2026-09-11 06:44:52] step 300/300 opsd 0.04084 (cell12 0.0486 … cell60 0.0379) gnorm 0.056 lr 1.00e-05 scored 49c/196s 106.9s mem 57.5GB +[2026-09-11 06:45:26] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/dits/dit_step300.safetensors 827 个张量 10.00 GB +[2026-09-11 06:46:00] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/distill/stage4_opsd_lora/ema/ema_step300.safetensors 827 个张量 10.00 GB +[2026-09-11 06:46:02] [done] step 300,各进程峰值显存 57.7 GB。dits/ 是学生本体(上游的部署产物),ema/ 是 fp32 影子;两者都按里程碑用 distill/eval/rollout_eval.py 在 60+ cell 上量远端漂移来挑 —— OPSD 的全部主张都在 rollout 的远端,与 pre-OPSD 的 stage3 EMA 对比才是交付物。 diff --git a/backup_2026-09-14/runs/distill__stage4_opsd_lora/train_log.csv b/backup_2026-09-14/runs/distill__stage4_opsd_lora/train_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..3d15816d9321538277e74d1bf1dd39e571319a73 --- /dev/null +++ b/backup_2026-09-14/runs/distill__stage4_opsd_lora/train_log.csv @@ -0,0 +1,31 @@ +step,opsd,gnorm,lr,n_scored_cells,n_scored_states,first_cell,last_cell,step_time,mem_gb,epoch +10,0.10010124742984772,0.03408004343509674,2.2e-06,49,196,0.0698900818824768,0.05760294944047928,112.38986899852753,57.504881381988525,0 +20,0.07683581113815308,0.031609032303094864,4.2000000000000004e-06,49,196,0.03620238974690437,0.09109921753406525,108.26674625873565,57.504881381988525,0 +30,0.05719931051135063,0.029286574572324753,6.200000000000001e-06,49,196,0.05746378377079964,0.06303055584430695,108.06545062065125,57.504881381988525,0 +40,0.04181460663676262,0.026372846215963364,8.2e-06,49,196,0.06080019474029541,0.03864502161741257,108.11644146442413,57.504881381988525,0 +50,0.03849449008703232,0.02188676781952381,1e-05,49,196,0.0404328778386116,0.03145535662770271,108.98635723590851,57.504881381988525,0 +60,0.038991529494524,0.022389139980077744,1e-05,49,196,0.04552670568227768,0.02192917838692665,126.08773107528687,57.504881381988525,0 +70,0.035376932471990585,0.022127706557512283,1e-05,49,196,0.033403221517801285,0.028092285618185997,108.52579975128174,57.504881381988525,0 +80,0.035459987819194794,0.019322365522384644,1e-05,49,196,0.03718546777963638,0.03039095178246498,108.40841681957245,57.504881381988525,0 +90,0.03434845805168152,0.03173426538705826,1e-05,49,196,0.03956463932991028,0.03808218613266945,108.28445076942444,57.504881381988525,0 +100,0.03892459720373154,0.024577206000685692,1e-05,49,196,0.025116223841905594,0.03755278140306473,108.6971203327179,57.504881381988525,0 +110,0.03293247148394585,0.0296479482203722,1e-05,49,196,0.04237336292862892,0.02621930092573166,123.5875688791275,57.504881381988525,0 +120,0.03450803458690643,0.021476974710822105,1e-05,49,196,0.031910885125398636,0.028399862349033356,108.07376823425292,57.504881381988525,0 +130,0.0348818376660347,0.018837982788681984,1e-05,49,196,0.030391713604331017,0.022687582299113274,108.85796201229095,57.504881381988525,0 +140,0.03369557857513428,0.026252301409840584,1e-05,49,196,0.043579958379268646,0.050961144268512726,108.19547636508942,57.504881381988525,0 +150,0.034033745527267456,0.030218444764614105,1e-05,49,196,0.02936621382832527,0.03560668230056763,108.40093994140625,57.504881381988525,0 +160,0.03080223873257637,0.023365965113043785,1e-05,49,196,0.034508440643548965,0.02418675646185875,116.03387312889099,57.504881381988525,0 +170,0.03127779811620712,0.02671680971980095,1e-05,49,196,0.034359462559223175,0.042884711176157,108.93240427970886,57.504881381988525,0 +180,0.034748390316963196,0.023096498101949692,1e-05,49,196,0.03038848005235195,0.03924986347556114,107.47958331108093,57.504881381988525,0 +190,0.031480539590120316,0.01413124892860651,1e-05,49,196,0.03144296258687973,0.03061608038842678,107.46256501674652,57.504881381988525,0 +200,0.03224998340010643,0.019876353442668915,1e-05,49,196,0.02384677343070507,0.03763239458203316,106.66719689369202,57.504881381988525,0 +210,0.03251933306455612,0.029262416064739227,1e-05,49,196,0.03263986110687256,0.030942054465413094,114.40580701828003,57.504881381988525,0 +220,0.032502271234989166,0.02386164292693138,1e-05,49,196,0.031965430825948715,0.038434211164712906,107.87899951934814,57.504881381988525,0 +230,0.0306948721408844,0.02543060854077339,1e-05,49,196,0.037471260875463486,0.04234442487359047,107.56180458068847,57.504881381988525,0 +240,0.03305257484316826,0.02945382334291935,1e-05,49,196,0.04824736341834068,0.02774129807949066,108.19767272472382,57.504881381988525,0 +250,0.03158873692154884,0.021362271159887314,1e-05,49,196,0.024883441627025604,0.02903074026107788,107.57934541702271,57.504881381988525,0 +260,0.032467715442180634,0.023261766880750656,1e-05,49,196,0.02427644282579422,0.02689211443066597,115.14304811954499,57.504881381988525,0 +270,0.03198311850428581,0.01933971419930458,1e-05,49,196,0.05484189838171005,0.03251311182975769,106.48253314495086,57.504881381988525,0 +280,0.029133126139640808,0.02233712188899517,1e-05,49,196,0.0293875839561224,0.02870864048600197,106.56719830036164,57.504881381988525,0 +290,0.03558992221951485,0.03707842528820038,1e-05,49,196,0.017625955864787102,0.020729651674628258,107.00251173973083,57.504881381988525,0 +300,0.04084005951881409,0.05644448846578598,1e-05,49,196,0.048566997051239014,0.0379190593957901,106.85536694526672,57.504881381988525,0 diff --git a/backup_2026-09-14/runs/ltx__arope_5k/accelerate_ga2.yaml b/backup_2026-09-14/runs/ltx__arope_5k/accelerate_ga2.yaml new file mode 100644 index 0000000000000000000000000000000000000000..965e26f1d2ec822dcf168db52ce4ee1732d4b79c --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k/accelerate_ga2.yaml @@ -0,0 +1,22 @@ +compute_environment: LOCAL_MACHINE +debug: false +deepspeed_config: + gradient_accumulation_steps: 2 + offload_optimizer_device: 'none' + offload_param_device: 'none' + zero3_init_flag: false + zero_stage: 2 +distributed_type: DEEPSPEED +downcast_bf16: 'no' +enable_cpu_affinity: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 8 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/runs/ltx__arope_5k/config.json b/backup_2026-09-14/runs/ltx__arope_5k/config.json new file mode 100644 index 0000000000000000000000000000000000000000..cff8b89143dd5c7bf8342bf8a50487db3d02eb3a --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k/config.json @@ -0,0 +1,197 @@ +{ + "args": { + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/train", + "val_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/val", + "text_table": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/text_table_ltx.pt", + "sidecar": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "meta_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/meta", + "model_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5", + "repack_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5-Repackage", + "limit": null, + "min_rt_ratio": 0.8, + "val_min_rt_ratio": 0.9, + "mask_channel": true, + "new_weight": 2.0, + "scene_dropout": 0.1, + "lr": 1e-05, + "weight_decay": 0.01, + "warmup_steps": 200, + "grad_clip": 1.0, + "max_steps": 5000, + "batch_size": 1, + "grad_accum": 2, + "num_workers": 2, + "gradient_checkpointing": true, + "save_every": 500, + "val_every": 500, + "val_n": 16, + "val_timesteps": [ + 200.0, + 500.0, + 800.0 + ], + "log_every": 1, + "output": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k", + "resume": null, + "seed": 0, + "self_test": false, + "dry_run": false + }, + "sidecar_meta": { + "version": "arope_sidecar_v1", + "gain_correction": [ + -1.1223353683364354, + -1.12 + ], + "walk_speed_px_s": [ + 69.24106392992304, + 46.012630371093756 + ], + "M_px832": [ + [ + -26.562482341426065, + -0.10811496854140469 + ], + [ + -2.730642040963448, + 11.486215518608526 + ], + [ + 0.4151829271053684, + 16.944469913263354 + ] + ], + "n_clips": 22782, + "n_valid": 22781, + "max_sample_dt": 0.5 + }, + "dataset": { + "train_total": 20983, + "train_missing": 0, + "train_invalid": 1, + "train_leak_excluded": 257, + "train_low_rt_excluded": 2197, + "train_used": 18528, + "text_table_keys": 1473, + "val_used": 16, + "val_clip_ids": [ + "clip_Eybx_100000255_000042", + "clip_Eybx_100000496_000000", + "clip_Eybx_100000680_000063", + "clip_Eybx_100000737_000063", + "clip_Eybx_100000737_000168", + "clip_Eybx_100000751_000231", + "clip_Eybx_100000751_000546", + "clip_Eybx_100000752_000000", + "clip_Eybx_100000838_000168", + "clip_Eybx_100001216_000000", + "clip_Eybx_100001217_000105", + "clip_Eybx_100002599_000000", + "clip_Eybx_100002875_000147", + "clip_Eybx_200000624_000000", + "clip_Eybx_200001033_000126", + "clip_Eybx_200001197_000063" + ] + }, + "model": { + "dit_safetensors": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors", + "n_params": 18987867392, + "n_state_dict_keys": 4093, + "mask_channel": true, + "resume_info": null + }, + "env": { + "world_size": 8, + "distributed_type": "DistributedType.DEEPSPEED", + "mixed_precision": "bf16", + "torch": "2.11.0+cu128", + "cuda": "12.8", + "gpu": "NVIDIA H200", + "python": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/python3.12", + "platform": "Linux-6.12.94-123.192.amzn2023.x86_64-x86_64-with-glibc2.34", + "hostname": "ip-172-16-244-218.ap-southeast-3.compute.internal", + "argv": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/ltx/train_ltx_arope.py", + "--train_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/train", + "--val_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/val", + "--text_table", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/text_table_ltx.pt", + "--sidecar", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "--meta_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/meta", + "--model_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5", + "--repack_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5-Repackage", + "--new_weight", + "2.0", + "--scene_dropout", + "0.1", + "--lr", + "1e-5", + "--weight_decay", + "0.01", + "--warmup_steps", + "200", + "--grad_clip", + "1.0", + "--max_steps", + "5000", + "--batch_size", + "1", + "--grad_accum", + "2", + "--num_workers", + "2", + "--save_every", + "500", + "--val_every", + "500", + "--val_n", + "16", + "--val_timesteps", + "200,500,800", + "--min_rt_ratio", + "0.8", + "--val_min_rt_ratio", + "0.9", + "--seed", + "0", + "--output", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k" + ], + "started": "2026-09-12 05:47:34", + "cuda_visible_devices": null, + "accelerate": "1.14.0", + "deepspeed": "0.19.6" + }, + "deepspeed_config": { + "train_batch_size": 16, + "train_micro_batch_size_per_gpu": 1, + "gradient_accumulation_steps": 2, + "zero_optimization": { + "stage": 2, + "offload_optimizer": { + "device": "none", + "nvme_path": null + }, + "offload_param": { + "device": "none", + "nvme_path": null + }, + "stage3_gather_16bit_weights_on_model_save": false + }, + "gradient_clipping": 1.0, + "steps_per_print": Infinity, + "bf16": { + "enabled": true + }, + "fp16": { + "enabled": false + }, + "zero_allow_untested_optimizer": true + } +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/ltx__arope_5k/done.json b/backup_2026-09-14/runs/ltx__arope_5k/done.json new file mode 100644 index 0000000000000000000000000000000000000000..e5f33d290c4c6c167b977fb62a2dfcdc374f40ed --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k/done.json @@ -0,0 +1,4 @@ +{ + "step": 5000, + "finished": "2026-09-12 10:14:36" +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/ltx__arope_5k/launch.log b/backup_2026-09-14/runs/ltx__arope_5k/launch.log new file mode 100644 index 0000000000000000000000000000000000000000..1b15e728610d3793ac3baf4de65a1344d5091d53 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k/launch.log @@ -0,0 +1,5237 @@ +W0912 05:46:15.389000 913606 torch/distributed/run.py:851] +W0912 05:46:15.389000 913606 torch/distributed/run.py:851] ***************************************** +W0912 05:46:15.389000 913606 torch/distributed/run.py:851] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. +W0912 05:46:15.389000 913606 torch/distributed/run.py:851] ***************************************** +[env] world=8 distributed=DistributedType.DEEPSPEED mixed_precision=bf16 device=cuda:0 +[LtxAropeDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/train: 20983 个 .pt,sidecar 缺失 0,valid=False 剔除 1,转场泄漏剔除 257,rt_ratio<0.8 剔除 2197,可用 18528;文本表 1473 键,scene_dropout=0.1 +[LtxAropeDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/val: 1175 个 .pt,sidecar 缺失 0,valid=False 剔除 0,rt_ratio<0.9 剔除 193,可用 16(limit=16);文本表 1473 键,scene_dropout=0.0 +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +[arope] 装 arope_mask_embed:Linear(1, 4096),零初始化 +[arope] patchify_proj 挂了 forward hook(+ arope_mask_embed(mask)) +[model] DiT 加载 27s,18,987,867,392 参数,4093 个 state_dict 键,mask_channel=True,has arope_mask_embed=True +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +[env] grad_clip=1.0 +[train] 18528 个 clip,每进程 batch 1,8 进程,到 5000 步 +step 1/5000 loss 0.5363 (w 0.6323 mse 0.6233 t 965 new 0.18) lr 5.00e-08 gnorm 2.607 8.37s mem 79.7GB +step 2/5000 loss 0.6235 (w 0.3950 mse 0.4333 t 737 new 0.24) lr 1.00e-07 gnorm 2.522 3.51s mem 81.1GB +step 3/5000 loss 0.4312 (w 0.5014 mse 0.5038 t 934 new 0.21) lr 1.50e-07 gnorm 1.474 2.80s mem 81.1GB +step 4/5000 loss 0.4329 (w 0.4527 mse 0.4633 t 895 new 0.24) lr 2.00e-07 gnorm 2.453 2.82s mem 81.1GB +step 5/5000 loss 0.4775 (w 0.4608 mse 0.4757 t 803 new 0.24) lr 2.50e-07 gnorm 3.025 2.81s mem 81.1GB +step 6/5000 loss 0.5511 (w 0.4086 mse 0.4284 t 588 new 0.22) lr 3.00e-07 gnorm 2.722 2.82s mem 81.1GB +step 7/5000 loss 0.4423 (w 0.5673 mse 0.5725 t 929 new 0.23) lr 3.50e-07 gnorm 2.207 2.82s mem 81.1GB +step 8/5000 loss 0.3947 (w 0.4758 mse 0.4905 t 935 new 0.22) lr 4.00e-07 gnorm 2.001 3.63s mem 81.1GB +step 9/5000 loss 0.6274 (w 0.4900 mse 0.4852 t 584 new 0.24) lr 4.50e-07 gnorm 2.522 2.81s mem 81.1GB +step 10/5000 loss 0.7414 (w 0.8197 mse 0.8178 t 996 new 0.24) lr 5.00e-07 gnorm 3.099 2.82s mem 81.1GB +step 11/5000 loss 0.3447 (w 0.6631 mse 0.6555 t 984 new 0.18) lr 5.50e-07 gnorm 1.628 2.83s mem 81.1GB +step 12/5000 loss 0.4070 (w 0.4745 mse 0.4850 t 962 new 0.17) lr 6.00e-07 gnorm 2.564 2.83s mem 81.1GB +step 13/5000 loss 0.6093 (w 0.4131 mse 0.4104 t 633 new 0.19) lr 6.50e-07 gnorm 2.466 2.82s mem 81.1GB +step 14/5000 loss 0.8383 (w 0.7714 mse 0.7832 t 274 new 0.16) lr 7.00e-07 gnorm 2.493 3.63s mem 81.1GB +step 15/5000 loss 0.4739 (w 0.4373 mse 0.4284 t 904 new 0.14) lr 7.50e-07 gnorm 1.843 2.83s mem 81.1GB +step 16/5000 loss 0.7048 (w 0.8395 mse 0.8447 t 999 new 0.23) lr 8.00e-07 gnorm 3.501 2.84s mem 81.1GB +step 17/5000 loss 0.4554 (w 0.4747 mse 0.4803 t 939 new 0.18) lr 8.50e-07 gnorm 1.372 2.84s mem 81.1GB +step 18/5000 loss 0.3417 (w 0.5592 mse 0.5815 t 989 new 0.15) lr 9.00e-07 gnorm 1.034 2.84s mem 81.1GB +step 19/5000 loss 0.4326 (w 0.7293 mse 0.7527 t 100 new 0.20) lr 9.50e-07 gnorm 1.652 2.83s mem 81.1GB +step 20/5000 loss 0.2939 (w 0.4511 mse 0.4512 t 955 new 0.25) lr 1.00e-06 gnorm 6.012 3.48s mem 81.1GB +step 21/5000 loss 0.6403 (w 0.8014 mse 0.7932 t 995 new 0.20) lr 1.05e-06 gnorm 1.642 2.82s mem 81.1GB +step 22/5000 loss 0.3560 (w 0.4561 mse 0.4567 t 901 new 0.24) lr 1.10e-06 gnorm 1.653 2.82s mem 81.1GB +step 23/5000 loss 0.5306 (w 0.4540 mse 0.4685 t 740 new 0.17) lr 1.15e-06 gnorm 1.261 2.82s mem 81.1GB +step 24/5000 loss 0.4190 (w 0.4998 mse 0.5355 t 930 new 0.22) lr 1.20e-06 gnorm 0.779 2.82s mem 81.1GB +step 25/5000 loss 0.2567 (w 0.3168 mse 0.3273 t 811 new 0.27) lr 1.25e-06 gnorm 1.356 3.16s mem 81.1GB +step 26/5000 loss 0.4472 (w 0.4153 mse 0.4431 t 274 new 0.19) lr 1.30e-06 gnorm 0.945 3.35s mem 81.1GB +step 27/5000 loss 0.3460 (w 0.3942 mse 0.4016 t 916 new 0.22) lr 1.35e-06 gnorm 0.891 2.82s mem 81.1GB +step 28/5000 loss 0.3522 (w 0.5136 mse 0.5160 t 957 new 0.23) lr 1.40e-06 gnorm 0.537 2.84s mem 81.1GB +step 29/5000 loss 0.2648 (w 0.2581 mse 0.2773 t 786 new 0.16) lr 1.45e-06 gnorm 1.909 2.83s mem 81.1GB +step 30/5000 loss 0.3942 (w 0.4339 mse 0.4277 t 947 new 0.21) lr 1.50e-06 gnorm 0.541 3.04s mem 81.1GB +step 31/5000 loss 0.5916 (w 0.5219 mse 0.5400 t 947 new 0.20) lr 1.55e-06 gnorm 0.711 3.19s mem 81.1GB +step 32/5000 loss 0.3298 (w 0.3939 mse 0.4105 t 906 new 0.23) lr 1.60e-06 gnorm 0.844 3.34s mem 81.1GB +step 33/5000 loss 0.4124 (w 0.3672 mse 0.3575 t 790 new 0.15) lr 1.65e-06 gnorm 0.787 2.84s mem 81.1GB +step 34/5000 loss 0.2268 (w 0.3746 mse 0.4102 t 836 new 0.24) lr 1.70e-06 gnorm 0.577 2.84s mem 81.1GB +step 35/5000 loss 0.5096 (w 0.7768 mse 0.7640 t 999 new 0.23) lr 1.75e-06 gnorm 0.665 2.84s mem 81.1GB +step 36/5000 loss 0.3648 (w 0.4134 mse 0.4152 t 828 new 0.25) lr 1.80e-06 gnorm 0.321 2.83s mem 81.1GB +step 37/5000 loss 0.3169 (w 0.7923 mse 0.7765 t 990 new 0.21) lr 1.85e-06 gnorm 0.303 3.17s mem 81.1GB +step 38/5000 loss 0.5476 (w 0.3213 mse 0.3373 t 889 new 0.24) lr 1.90e-06 gnorm 0.513 3.47s mem 81.1GB +step 39/5000 loss 0.6256 (w 0.4898 mse 0.4970 t 470 new 0.23) lr 1.95e-06 gnorm 0.468 2.82s mem 81.1GB +step 40/5000 loss 0.4321 (w 0.3783 mse 0.3837 t 900 new 0.19) lr 2.00e-06 gnorm 0.434 2.81s mem 81.1GB +step 41/5000 loss 0.7097 (w 0.2399 mse 0.2438 t 889 new 0.10) lr 2.05e-06 gnorm 0.493 2.83s mem 81.1GB +step 42/5000 loss 0.2718 (w 0.3860 mse 0.3852 t 835 new 0.09) lr 2.10e-06 gnorm 0.692 2.83s mem 81.1GB +step 43/5000 loss 0.7165 (w 0.4850 mse 0.5047 t 594 new 0.23) lr 2.15e-06 gnorm 0.372 3.35s mem 81.1GB +step 44/5000 loss 0.2842 (w 0.4857 mse 0.4902 t 966 new 0.22) lr 2.20e-06 gnorm 0.308 3.46s mem 81.1GB +step 45/5000 loss 0.2851 (w 0.6802 mse 0.6806 t 990 new 0.23) lr 2.25e-06 gnorm 0.251 2.82s mem 81.1GB +step 46/5000 loss 0.3524 (w 0.4785 mse 0.4838 t 990 new 0.17) lr 2.30e-06 gnorm 0.404 2.82s mem 81.1GB +step 47/5000 loss 0.4647 (w 0.3068 mse 0.3193 t 603 new 0.10) lr 2.35e-06 gnorm 0.313 2.82s mem 81.1GB +step 48/5000 loss 0.2228 (w 0.3695 mse 0.3755 t 924 new 0.13) lr 2.40e-06 gnorm 0.401 2.82s mem 81.1GB +step 49/5000 loss 0.3398 (w 0.4140 mse 0.4235 t 642 new 0.26) lr 2.45e-06 gnorm 0.322 3.41s mem 81.1GB +step 50/5000 loss 0.2755 (w 0.4589 mse 0.4613 t 970 new 0.06) lr 2.50e-06 gnorm 0.319 3.18s mem 81.1GB +step 51/5000 loss 0.5596 (w 0.4937 mse 0.4923 t 372 new 0.21) lr 2.55e-06 gnorm 0.343 2.82s mem 81.1GB +step 52/5000 loss 0.2614 (w 0.2566 mse 0.2692 t 949 new 0.20) lr 2.60e-06 gnorm 0.281 2.83s mem 81.1GB +step 53/5000 loss 0.3945 (w 0.3725 mse 0.3681 t 747 new 0.09) lr 2.65e-06 gnorm 0.313 2.83s mem 81.1GB +step 54/5000 loss 0.3634 (w 0.4111 mse 0.4145 t 991 new 0.14) lr 2.70e-06 gnorm 0.268 2.83s mem 81.1GB +step 55/5000 loss 0.4265 (w 0.5230 mse 0.5344 t 986 new 0.28) lr 2.75e-06 gnorm 0.298 3.30s mem 81.1GB +step 56/5000 loss 0.3979 (w 0.4682 mse 0.4817 t 989 new 0.10) lr 2.80e-06 gnorm 0.256 3.11s mem 81.1GB +step 57/5000 loss 0.5587 (w 0.4983 mse 0.5017 t 980 new 0.19) lr 2.85e-06 gnorm 0.382 2.82s mem 81.1GB +step 58/5000 loss 0.3125 (w 0.3755 mse 0.4031 t 883 new 0.17) lr 2.90e-06 gnorm 0.260 2.83s mem 81.1GB +step 59/5000 loss 0.4170 (w 0.4793 mse 0.4854 t 961 new 0.21) lr 2.95e-06 gnorm 0.259 2.82s mem 81.1GB +step 60/5000 loss 0.3413 (w 0.3699 mse 0.3894 t 891 new 0.21) lr 3.00e-06 gnorm 0.259 3.09s mem 81.1GB +step 61/5000 loss 0.5783 (w 0.4234 mse 0.4310 t 817 new 0.17) lr 3.05e-06 gnorm 1.900 3.11s mem 81.1GB +step 62/5000 loss 0.5033 (w 0.3275 mse 0.3403 t 979 new 0.11) lr 3.10e-06 gnorm 10.118 3.13s mem 81.1GB +step 63/5000 loss 0.3430 (w 0.5809 mse 0.5674 t 984 new 0.16) lr 3.15e-06 gnorm 0.242 2.82s mem 81.1GB +step 64/5000 loss 0.1600 (w 0.4669 mse 0.4773 t 931 new 0.19) lr 3.20e-06 gnorm 0.779 2.82s mem 81.1GB +step 65/5000 loss 0.4561 (w 0.3161 mse 0.3304 t 847 new 0.22) lr 3.25e-06 gnorm 0.421 2.83s mem 81.1GB +step 66/5000 loss 0.2372 (w 0.2725 mse 0.3074 t 966 new 0.19) lr 3.30e-06 gnorm 0.265 3.12s mem 81.1GB +step 67/5000 loss 0.3723 (w 0.2306 mse 0.2409 t 739 new 0.06) lr 3.35e-06 gnorm 0.247 3.40s mem 81.1GB +step 68/5000 loss 0.3684 (w 0.2808 mse 0.2844 t 853 new 0.10) lr 3.40e-06 gnorm 0.318 2.82s mem 81.1GB +step 69/5000 loss 0.5184 (w 0.5820 mse 0.5693 t 989 new 0.23) lr 3.45e-06 gnorm 0.247 2.82s mem 81.1GB +step 70/5000 loss 0.4137 (w 0.5353 mse 0.5571 t 195 new 0.18) lr 3.50e-06 gnorm 0.724 2.82s mem 81.1GB +step 71/5000 loss 0.4252 (w 0.4284 mse 0.4198 t 967 new 0.24) lr 3.55e-06 gnorm 2.396 2.82s mem 81.1GB +step 72/5000 loss 0.4352 (w 0.6867 mse 0.6943 t 999 new 0.26) lr 3.60e-06 gnorm 0.348 3.12s mem 81.1GB +step 73/5000 loss 0.4373 (w 0.3017 mse 0.3004 t 711 new 0.11) lr 3.65e-06 gnorm 0.305 3.34s mem 81.1GB +step 74/5000 loss 0.4069 (w 0.5921 mse 0.5922 t 991 new 0.24) lr 3.70e-06 gnorm 0.212 2.83s mem 81.1GB +step 75/5000 loss 0.4013 (w 0.3639 mse 0.3623 t 929 new 0.08) lr 3.75e-06 gnorm 0.435 2.83s mem 81.1GB +step 76/5000 loss 0.3637 (w 0.5879 mse 0.6054 t 306 new 0.19) lr 3.80e-06 gnorm 0.200 2.84s mem 81.1GB +step 77/5000 loss 0.4770 (w 0.5110 mse 0.5284 t 264 new 0.24) lr 3.85e-06 gnorm 0.181 2.82s mem 81.1GB +step 78/5000 loss 0.3336 (w 0.3988 mse 0.3969 t 965 new 0.23) lr 3.90e-06 gnorm 0.141 3.36s mem 81.1GB +step 79/5000 loss 0.4967 (w 0.5578 mse 0.5502 t 999 new 0.19) lr 3.95e-06 gnorm 0.171 3.52s mem 81.1GB +step 80/5000 loss 0.4570 (w 0.3948 mse 0.3977 t 958 new 0.16) lr 4.00e-06 gnorm 0.513 2.83s mem 81.1GB +step 81/5000 loss 0.2366 (w 0.4586 mse 0.4667 t 977 new 0.22) lr 4.05e-06 gnorm 0.256 2.84s mem 81.1GB +step 82/5000 loss 0.3981 (w 0.3527 mse 0.3648 t 947 new 0.21) lr 4.10e-06 gnorm 0.285 2.84s mem 81.1GB +step 83/5000 loss 0.5242 (w 0.5387 mse 0.5380 t 264 new 0.22) lr 4.15e-06 gnorm 0.192 3.12s mem 81.1GB +step 84/5000 loss 0.5241 (w 0.4359 mse 0.4513 t 795 new 0.25) lr 4.20e-06 gnorm 0.335 3.31s mem 81.1GB +step 85/5000 loss 0.1357 (w 0.3280 mse 0.3428 t 968 new 0.23) lr 4.25e-06 gnorm 0.136 3.25s mem 81.1GB +step 86/5000 loss 0.2142 (w 0.4909 mse 0.4946 t 995 new 0.19) lr 4.30e-06 gnorm 0.199 2.83s mem 81.1GB +step 87/5000 loss 0.2504 (w 0.3625 mse 0.3597 t 985 new 0.14) lr 4.35e-06 gnorm 0.178 2.83s mem 81.1GB +step 88/5000 loss 0.5070 (w 0.3085 mse 0.3034 t 668 new 0.12) lr 4.40e-06 gnorm 0.185 2.83s mem 81.1GB +step 89/5000 loss 0.1284 (w 0.3823 mse 0.3962 t 925 new 0.20) lr 4.45e-06 gnorm 0.196 3.10s mem 81.1GB +step 90/5000 loss 0.2651 (w 0.5736 mse 0.5684 t 980 new 0.24) lr 4.50e-06 gnorm 0.137 3.30s mem 81.1GB +step 91/5000 loss 0.4291 (w 0.4760 mse 0.4727 t 768 new 0.23) lr 4.55e-06 gnorm 0.162 3.11s mem 81.1GB +step 92/5000 loss 0.6680 (w 0.3442 mse 0.3524 t 804 new 0.19) lr 4.60e-06 gnorm 0.215 2.82s mem 81.1GB +step 93/5000 loss 0.3281 (w 0.2935 mse 0.3111 t 737 new 0.11) lr 4.65e-06 gnorm 0.237 2.82s mem 81.1GB +step 94/5000 loss 0.4752 (w 0.2285 mse 0.2641 t 564 new 0.19) lr 4.70e-06 gnorm 0.208 2.82s mem 81.1GB +step 95/5000 loss 0.3622 (w 0.3355 mse 0.3477 t 929 new 0.18) lr 4.75e-06 gnorm 0.256 3.10s mem 81.1GB +step 96/5000 loss 0.2879 (w 0.4680 mse 0.4848 t 985 new 0.22) lr 4.80e-06 gnorm 0.143 3.38s mem 81.1GB +step 97/5000 loss 0.3335 (w 0.5062 mse 0.4981 t 973 new 0.22) lr 4.85e-06 gnorm 0.151 3.31s mem 81.1GB +step 98/5000 loss 0.5028 (w 0.4424 mse 0.4595 t 551 new 0.23) lr 4.90e-06 gnorm 0.190 2.82s mem 81.1GB +step 99/5000 loss 0.3849 (w 0.2592 mse 0.2858 t 807 new 0.19) lr 4.95e-06 gnorm 0.138 2.83s mem 81.1GB +step 100/5000 loss 0.5456 (w 0.3864 mse 0.3922 t 861 new 0.20) lr 5.00e-06 gnorm 0.229 2.83s mem 81.1GB +step 101/5000 loss 0.3661 (w 0.3444 mse 0.3562 t 923 new 0.22) lr 5.05e-06 gnorm 0.248 3.43s mem 81.1GB +step 102/5000 loss 0.4231 (w 0.3979 mse 0.4158 t 850 new 0.20) lr 5.10e-06 gnorm 0.256 3.53s mem 81.1GB +step 103/5000 loss 0.3775 (w 0.2252 mse 0.2516 t 629 new 0.20) lr 5.15e-06 gnorm 0.412 2.84s mem 81.1GB +step 104/5000 loss 0.2362 (w 0.3505 mse 0.3656 t 992 new 0.14) lr 5.20e-06 gnorm 0.305 2.83s mem 81.1GB +step 105/5000 loss 0.2428 (w 0.2154 mse 0.2339 t 892 new 0.23) lr 5.25e-06 gnorm 0.500 2.84s mem 81.1GB +step 106/5000 loss 0.3175 (w 0.3565 mse 0.3719 t 980 new 0.12) lr 5.30e-06 gnorm 0.200 2.84s mem 81.1GB +step 107/5000 loss 0.5245 (w 0.2977 mse 0.3159 t 864 new 0.22) lr 5.35e-06 gnorm 0.197 3.29s mem 81.1GB +step 108/5000 loss 0.2898 (w 0.6562 mse 0.6340 t 981 new 0.23) lr 5.40e-06 gnorm 0.307 3.52s mem 81.1GB +step 109/5000 loss 0.3864 (w 0.2586 mse 0.2947 t 984 new 0.21) lr 5.45e-06 gnorm 0.234 2.82s mem 81.1GB +step 110/5000 loss 0.6231 (w 0.4664 mse 0.4633 t 915 new 0.21) lr 5.50e-06 gnorm 0.297 2.84s mem 81.1GB +step 111/5000 loss 0.3048 (w 0.3727 mse 0.3767 t 869 new 0.22) lr 5.55e-06 gnorm 0.181 2.83s mem 81.1GB +step 112/5000 loss 0.2949 (w 0.4792 mse 0.4802 t 985 new 0.18) lr 5.60e-06 gnorm 0.144 2.82s mem 81.1GB +step 113/5000 loss 0.3911 (w 0.2804 mse 0.3099 t 927 new 0.27) lr 5.65e-06 gnorm 0.224 3.39s mem 81.1GB +step 114/5000 loss 0.5574 (w 0.3542 mse 0.3570 t 776 new 0.20) lr 5.70e-06 gnorm 0.194 3.44s mem 81.1GB +step 115/5000 loss 0.3213 (w 0.4330 mse 0.4192 t 995 new 0.13) lr 5.75e-06 gnorm 0.428 2.84s mem 81.1GB +step 116/5000 loss 0.4918 (w 0.3969 mse 0.4048 t 750 new 0.21) lr 5.80e-06 gnorm 0.171 2.83s mem 81.1GB +step 117/5000 loss 0.4022 (w 0.3648 mse 0.3904 t 647 new 0.23) lr 5.85e-06 gnorm 0.275 2.83s mem 81.1GB +step 118/5000 loss 0.5102 (w 0.3878 mse 0.3934 t 899 new 0.18) lr 5.90e-06 gnorm 0.157 3.07s mem 81.1GB +step 119/5000 loss 0.3551 (w 0.5060 mse 0.5103 t 989 new 0.21) lr 5.95e-06 gnorm 0.640 3.13s mem 81.1GB +step 120/5000 loss 0.4053 (w 0.4339 mse 0.4327 t 955 new 0.19) lr 6.00e-06 gnorm 0.173 3.18s mem 81.1GB +step 121/5000 loss 0.4493 (w 0.4318 mse 0.4283 t 960 new 0.20) lr 6.05e-06 gnorm 0.167 2.82s mem 81.1GB +step 122/5000 loss 0.2645 (w 0.3415 mse 0.3395 t 925 new 0.19) lr 6.10e-06 gnorm 0.497 2.83s mem 81.1GB +step 123/5000 loss 0.3069 (w 0.3751 mse 0.3864 t 698 new 0.17) lr 6.15e-06 gnorm 0.277 2.83s mem 81.1GB +step 124/5000 loss 0.4455 (w 0.3259 mse 0.3418 t 794 new 0.26) lr 6.20e-06 gnorm 0.756 3.12s mem 81.1GB +step 125/5000 loss 0.4469 (w 0.2873 mse 0.2888 t 884 new 0.15) lr 6.25e-06 gnorm 0.246 3.37s mem 81.1GB +step 126/5000 loss 0.4827 (w 0.3182 mse 0.3088 t 905 new 0.15) lr 6.30e-06 gnorm 0.488 3.29s mem 81.1GB +step 127/5000 loss 0.4163 (w 0.3545 mse 0.3716 t 935 new 0.20) lr 6.35e-06 gnorm 0.178 2.83s mem 81.1GB +step 128/5000 loss 0.3880 (w 0.2712 mse 0.2803 t 788 new 0.22) lr 6.40e-06 gnorm 0.204 2.82s mem 81.1GB +step 129/5000 loss 0.4120 (w 0.4253 mse 0.4451 t 383 new 0.21) lr 6.45e-06 gnorm 0.163 2.83s mem 81.1GB +step 130/5000 loss 0.4880 (w 0.2548 mse 0.2638 t 774 new 0.22) lr 6.50e-06 gnorm 0.329 3.08s mem 81.1GB +step 131/5000 loss 0.4368 (w 0.4756 mse 0.4875 t 375 new 0.25) lr 6.55e-06 gnorm 0.160 3.36s mem 81.1GB +step 132/5000 loss 0.4380 (w 0.3244 mse 0.3404 t 919 new 0.24) lr 6.60e-06 gnorm 0.187 3.29s mem 81.1GB +step 133/5000 loss 0.2900 (w 0.3114 mse 0.3256 t 730 new 0.25) lr 6.65e-06 gnorm 0.185 2.83s mem 81.1GB +step 134/5000 loss 0.5923 (w 0.4016 mse 0.4256 t 662 new 0.27) lr 6.70e-06 gnorm 0.160 2.83s mem 81.1GB +step 135/5000 loss 0.4838 (w 0.4354 mse 0.4347 t 626 new 0.19) lr 6.75e-06 gnorm 0.192 2.84s mem 81.1GB +step 136/5000 loss 0.3334 (w 0.3819 mse 0.3820 t 728 new 0.19) lr 6.80e-06 gnorm 0.302 3.12s mem 81.1GB +step 137/5000 loss 0.4558 (w 0.4012 mse 0.4064 t 807 new 0.26) lr 6.85e-06 gnorm 0.349 3.68s mem 81.1GB +step 138/5000 loss 0.3196 (w 0.3338 mse 0.3498 t 988 new 0.27) lr 6.90e-06 gnorm 0.189 2.83s mem 81.1GB +step 139/5000 loss 0.3305 (w 0.3267 mse 0.3462 t 816 new 0.24) lr 6.95e-06 gnorm 0.204 2.84s mem 81.1GB +step 140/5000 loss 0.3557 (w 0.7298 mse 0.7412 t 183 new 0.26) lr 7.00e-06 gnorm 0.149 2.84s mem 81.1GB +step 141/5000 loss 0.4062 (w 0.3428 mse 0.3566 t 629 new 0.21) lr 7.05e-06 gnorm 0.150 3.13s mem 81.1GB +step 142/5000 loss 0.2367 (w 0.3179 mse 0.3144 t 971 new 0.14) lr 7.10e-06 gnorm 0.321 3.01s mem 81.1GB +step 143/5000 loss 0.4597 (w 0.4259 mse 0.4367 t 968 new 0.22) lr 7.15e-06 gnorm 0.448 3.38s mem 81.1GB +step 144/5000 loss 0.6212 (w 0.3487 mse 0.3611 t 722 new 0.19) lr 7.20e-06 gnorm 0.199 2.83s mem 81.1GB +step 145/5000 loss 0.2251 (w 0.2186 mse 0.2261 t 980 new 0.10) lr 7.25e-06 gnorm 0.160 2.83s mem 81.1GB +step 146/5000 loss 0.2118 (w 0.3141 mse 0.3219 t 959 new 0.23) lr 7.30e-06 gnorm 0.204 2.82s mem 81.1GB +step 147/5000 loss 0.3870 (w 0.4205 mse 0.4409 t 301 new 0.18) lr 7.35e-06 gnorm 0.155 3.13s mem 81.1GB +step 148/5000 loss 0.3807 (w 0.5723 mse 0.5732 t 993 new 0.14) lr 7.40e-06 gnorm 0.141 3.05s mem 81.1GB +step 149/5000 loss 0.3466 (w 0.3690 mse 0.3758 t 624 new 0.24) lr 7.45e-06 gnorm 0.177 3.37s mem 81.1GB +step 150/5000 loss 0.2525 (w 0.3529 mse 0.3639 t 941 new 0.21) lr 7.50e-06 gnorm 0.149 2.82s mem 81.1GB +step 151/5000 loss 0.3107 (w 0.3316 mse 0.3366 t 905 new 0.22) lr 7.55e-06 gnorm 0.272 2.83s mem 81.1GB +step 152/5000 loss 0.3093 (w 0.3173 mse 0.3335 t 946 new 0.15) lr 7.60e-06 gnorm 0.264 2.83s mem 81.1GB +step 153/5000 loss 0.4883 (w 0.4255 mse 0.4263 t 965 new 0.22) lr 7.65e-06 gnorm 0.263 3.06s mem 81.1GB +step 154/5000 loss 0.2861 (w 0.3404 mse 0.3419 t 835 new 0.26) lr 7.70e-06 gnorm 0.165 3.04s mem 81.1GB +step 155/5000 loss 0.3852 (w 0.3295 mse 0.3442 t 828 new 0.22) lr 7.75e-06 gnorm 0.206 3.53s mem 81.1GB +step 156/5000 loss 0.3915 (w 0.2761 mse 0.3013 t 971 new 0.22) lr 7.80e-06 gnorm 0.189 2.82s mem 81.1GB +step 157/5000 loss 0.1055 (w 0.2425 mse 0.2615 t 905 new 0.10) lr 7.85e-06 gnorm 0.192 2.83s mem 81.1GB +step 158/5000 loss 0.5937 (w 0.3007 mse 0.3085 t 814 new 0.22) lr 7.90e-06 gnorm 0.188 2.84s mem 81.1GB +step 159/5000 loss 0.1146 (w 0.4136 mse 0.4184 t 992 new 0.17) lr 7.95e-06 gnorm 0.140 3.10s mem 81.1GB +step 160/5000 loss 0.5139 (w 0.3687 mse 0.3770 t 951 new 0.19) lr 8.00e-06 gnorm 0.149 3.33s mem 81.1GB +step 161/5000 loss 0.3501 (w 0.3392 mse 0.3359 t 865 new 0.20) lr 8.05e-06 gnorm 0.186 3.18s mem 81.1GB +step 162/5000 loss 0.2698 (w 0.5432 mse 0.5592 t 288 new 0.22) lr 8.10e-06 gnorm 0.197 2.82s mem 81.1GB +step 163/5000 loss 0.4278 (w 0.3151 mse 0.3322 t 955 new 0.21) lr 8.15e-06 gnorm 0.176 2.82s mem 81.1GB +step 164/5000 loss 0.5241 (w 0.3237 mse 0.3356 t 698 new 0.25) lr 8.20e-06 gnorm 0.144 2.82s mem 81.1GB +step 165/5000 loss 0.4143 (w 0.3457 mse 0.3442 t 861 new 0.19) lr 8.25e-06 gnorm 0.526 3.06s mem 81.1GB +step 166/5000 loss 0.4288 (w 0.2750 mse 0.2914 t 677 new 0.21) lr 8.30e-06 gnorm 0.166 3.29s mem 81.1GB +step 167/5000 loss 0.2386 (w 0.2500 mse 0.2615 t 768 new 0.23) lr 8.35e-06 gnorm 0.164 3.21s mem 81.1GB +step 168/5000 loss 0.2891 (w 0.3180 mse 0.3254 t 828 new 0.27) lr 8.40e-06 gnorm 0.132 2.82s mem 81.1GB +step 169/5000 loss 0.4761 (w 0.3584 mse 0.3751 t 964 new 0.18) lr 8.45e-06 gnorm 0.244 2.82s mem 81.1GB +step 170/5000 loss 0.2431 (w 0.3564 mse 0.3600 t 955 new 0.25) lr 8.50e-06 gnorm 0.177 2.83s mem 81.1GB +step 171/5000 loss 0.3341 (w 0.3120 mse 0.3336 t 794 new 0.13) lr 8.55e-06 gnorm 0.180 3.12s mem 81.1GB +step 172/5000 loss 0.4992 (w 0.7415 mse 0.7498 t 165 new 0.12) lr 8.60e-06 gnorm 0.191 3.33s mem 81.1GB +step 173/5000 loss 0.4993 (w 0.3364 mse 0.3541 t 648 new 0.15) lr 8.65e-06 gnorm 0.210 3.11s mem 81.1GB +step 174/5000 loss 0.5771 (w 0.4014 mse 0.4085 t 659 new 0.23) lr 8.70e-06 gnorm 0.179 2.83s mem 81.1GB +step 175/5000 loss 0.3588 (w 0.3311 mse 0.3377 t 709 new 0.17) lr 8.75e-06 gnorm 3.218 2.84s mem 81.1GB +step 176/5000 loss 0.3974 (w 0.3284 mse 0.3345 t 959 new 0.24) lr 8.80e-06 gnorm 0.124 3.06s mem 81.1GB +step 177/5000 loss 0.4290 (w 0.3697 mse 0.3623 t 912 new 0.12) lr 8.85e-06 gnorm 0.262 3.12s mem 81.1GB +step 178/5000 loss 0.2475 (w 0.4779 mse 0.4796 t 976 new 0.17) lr 8.90e-06 gnorm 0.206 3.39s mem 81.1GB +step 179/5000 loss 0.3596 (w 0.2455 mse 0.2729 t 902 new 0.26) lr 8.95e-06 gnorm 0.177 3.09s mem 81.1GB +step 180/5000 loss 0.3161 (w 0.2761 mse 0.2952 t 924 new 0.19) lr 9.00e-06 gnorm 0.260 2.83s mem 81.1GB +step 181/5000 loss 0.4172 (w 0.2613 mse 0.2651 t 864 new 0.20) lr 9.05e-06 gnorm 0.155 2.82s mem 81.1GB +step 182/5000 loss 0.4098 (w 0.3624 mse 0.3623 t 742 new 0.23) lr 9.10e-06 gnorm 0.192 3.11s mem 81.1GB +step 183/5000 loss 0.4779 (w 0.3684 mse 0.3766 t 934 new 0.15) lr 9.15e-06 gnorm 0.196 3.11s mem 81.1GB +step 184/5000 loss 0.4515 (w 0.4121 mse 0.4275 t 992 new 0.09) lr 9.20e-06 gnorm 0.211 3.34s mem 81.1GB +step 185/5000 loss 0.5085 (w 0.3616 mse 0.3618 t 629 new 0.24) lr 9.25e-06 gnorm 0.556 3.09s mem 81.1GB +step 186/5000 loss 0.5286 (w 0.6183 mse 0.6271 t 120 new 0.24) lr 9.30e-06 gnorm 14.425 2.82s mem 81.1GB +step 187/5000 loss 0.2719 (w 0.2532 mse 0.2745 t 885 new 0.23) lr 9.35e-06 gnorm 0.198 2.82s mem 81.1GB +step 188/5000 loss 0.2801 (w 0.2806 mse 0.3012 t 902 new 0.21) lr 9.40e-06 gnorm 0.143 3.18s mem 81.1GB +step 189/5000 loss 0.5079 (w 0.5038 mse 0.4961 t 1000 new 0.19) lr 9.45e-06 gnorm 0.149 3.32s mem 81.1GB +step 190/5000 loss 0.2243 (w 0.5265 mse 0.5623 t 982 new 0.18) lr 9.50e-06 gnorm 0.175 3.27s mem 81.1GB +step 191/5000 loss 0.2655 (w 0.4489 mse 0.4544 t 961 new 0.18) lr 9.55e-06 gnorm 0.139 3.24s mem 81.1GB +step 192/5000 loss 0.2925 (w 0.3794 mse 0.3854 t 936 new 0.22) lr 9.60e-06 gnorm 0.136 2.84s mem 81.1GB +step 193/5000 loss 0.1979 (w 0.3339 mse 0.3302 t 933 new 0.16) lr 9.65e-06 gnorm 0.135 2.83s mem 81.1GB +step 194/5000 loss 0.3960 (w 0.3129 mse 0.3156 t 797 new 0.26) lr 9.70e-06 gnorm 0.304 3.09s mem 81.1GB +step 195/5000 loss 0.3713 (w 0.2676 mse 0.2881 t 884 new 0.13) lr 9.75e-06 gnorm 0.186 3.31s mem 81.1GB +step 196/5000 loss 0.5777 (w 0.3760 mse 0.3799 t 648 new 0.20) lr 9.80e-06 gnorm 0.235 3.48s mem 81.1GB +step 197/5000 loss 0.3182 (w 0.5756 mse 0.5750 t 971 new 0.20) lr 9.85e-06 gnorm 0.161 2.83s mem 81.1GB +step 198/5000 loss 0.1725 (w 0.2905 mse 0.3028 t 811 new 0.10) lr 9.90e-06 gnorm 0.122 2.84s mem 81.1GB +step 199/5000 loss 0.5976 (w 0.2980 mse 0.3040 t 508 new 0.21) lr 9.95e-06 gnorm 0.444 3.13s mem 81.1GB +step 200/5000 loss 0.4357 (w 0.7554 mse 0.7517 t 140 new 0.26) lr 1.00e-05 gnorm 0.195 3.05s mem 81.1GB +step 201/5000 loss 0.4776 (w 0.3128 mse 0.3236 t 730 new 0.19) lr 1.00e-05 gnorm 0.156 3.36s mem 81.1GB +step 202/5000 loss 0.3982 (w 0.4559 mse 0.4541 t 447 new 0.19) lr 1.00e-05 gnorm 0.149 3.29s mem 81.1GB +step 203/5000 loss 0.2301 (w 0.2839 mse 0.2914 t 871 new 0.16) lr 1.00e-05 gnorm 0.176 2.83s mem 81.1GB +step 204/5000 loss 0.3266 (w 0.3475 mse 0.3451 t 895 new 0.12) lr 1.00e-05 gnorm 0.197 2.83s mem 81.1GB +step 205/5000 loss 0.2993 (w 0.4032 mse 0.4140 t 931 new 0.20) lr 1.00e-05 gnorm 0.159 2.83s mem 81.1GB +step 206/5000 loss 0.3796 (w 0.5182 mse 0.5157 t 996 new 0.22) lr 1.00e-05 gnorm 2.235 3.06s mem 81.1GB +step 207/5000 loss 0.3722 (w 0.2473 mse 0.2587 t 868 new 0.22) lr 1.00e-05 gnorm 0.907 3.32s mem 81.1GB +step 208/5000 loss 0.3872 (w 0.3678 mse 0.3931 t 967 new 0.23) lr 1.00e-05 gnorm 0.139 3.35s mem 81.1GB +step 209/5000 loss 0.2784 (w 0.3308 mse 0.3343 t 802 new 0.19) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +step 210/5000 loss 0.3319 (w 0.3621 mse 0.3868 t 344 new 0.22) lr 1.00e-05 gnorm 2.006 2.82s mem 81.1GB +step 211/5000 loss 0.1477 (w 0.3602 mse 0.3749 t 992 new 0.10) lr 1.00e-05 gnorm 0.180 3.12s mem 81.1GB +step 212/5000 loss 0.4832 (w 0.3948 mse 0.4004 t 528 new 0.26) lr 1.00e-05 gnorm 0.258 3.08s mem 81.1GB +step 213/5000 loss 0.1203 (w 0.4566 mse 0.4797 t 994 new 0.17) lr 1.00e-05 gnorm 0.253 3.38s mem 81.1GB +step 214/5000 loss 0.4009 (w 0.3338 mse 0.3370 t 968 new 0.05) lr 1.00e-05 gnorm 0.189 3.24s mem 81.1GB +step 215/5000 loss 0.2735 (w 0.2714 mse 0.2710 t 898 new 0.22) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +step 216/5000 loss 0.3790 (w 0.4002 mse 0.4195 t 904 new 0.21) lr 1.00e-05 gnorm 0.200 2.82s mem 81.1GB +step 217/5000 loss 0.4329 (w 0.3618 mse 0.3635 t 791 new 0.28) lr 1.00e-05 gnorm 0.355 2.83s mem 81.1GB +step 218/5000 loss 0.2245 (w 0.2023 mse 0.2144 t 760 new 0.20) lr 1.00e-05 gnorm 0.195 3.06s mem 81.1GB +step 219/5000 loss 0.3726 (w 0.2572 mse 0.2719 t 748 new 0.25) lr 1.00e-05 gnorm 0.135 3.27s mem 81.1GB +step 220/5000 loss 0.3765 (w 0.3236 mse 0.3319 t 866 new 0.23) lr 1.00e-05 gnorm 0.169 3.13s mem 81.1GB +step 221/5000 loss 0.2770 (w 0.2694 mse 0.2824 t 768 new 0.21) lr 1.00e-05 gnorm 0.129 2.81s mem 81.1GB +step 222/5000 loss 0.4249 (w 0.2938 mse 0.3030 t 914 new 0.08) lr 1.00e-05 gnorm 0.146 2.81s mem 81.1GB +step 223/5000 loss 0.3561 (w 0.3295 mse 0.3303 t 917 new 0.07) lr 1.00e-05 gnorm 0.187 3.03s mem 81.1GB +step 224/5000 loss 0.4887 (w 0.3687 mse 0.3640 t 950 new 0.23) lr 1.00e-05 gnorm 0.151 3.37s mem 81.1GB +step 225/5000 loss 0.1095 (w 0.6205 mse 0.5968 t 997 new 0.25) lr 1.00e-05 gnorm 0.229 3.28s mem 81.1GB +step 226/5000 loss 0.3660 (w 0.3514 mse 0.3599 t 912 new 0.24) lr 1.00e-05 gnorm 0.221 3.19s mem 81.1GB +step 227/5000 loss 0.2411 (w 0.4148 mse 0.4124 t 971 new 0.21) lr 1.00e-05 gnorm 0.187 3.05s mem 81.1GB +step 228/5000 loss 0.4365 (w 0.4578 mse 0.4598 t 998 new 0.22) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +step 229/5000 loss 0.2238 (w 0.3206 mse 0.3369 t 980 new 0.11) lr 1.00e-05 gnorm 0.146 3.08s mem 81.1GB +step 230/5000 loss 0.1577 (w 0.2394 mse 0.2606 t 922 new 0.24) lr 1.00e-05 gnorm 0.138 3.37s mem 81.1GB +step 231/5000 loss 0.1819 (w 0.3830 mse 0.3802 t 859 new 0.15) lr 1.00e-05 gnorm 0.287 3.30s mem 81.1GB +step 232/5000 loss 0.6243 (w 0.4171 mse 0.4235 t 985 new 0.22) lr 1.00e-05 gnorm 0.336 3.19s mem 81.1GB +step 233/5000 loss 0.2959 (w 0.3141 mse 0.3261 t 858 new 0.27) lr 1.00e-05 gnorm 0.136 2.82s mem 81.1GB +step 234/5000 loss 0.3949 (w 0.4284 mse 0.4369 t 964 new 0.18) lr 1.00e-05 gnorm 1.098 2.81s mem 81.1GB +step 235/5000 loss 0.4433 (w 0.2974 mse 0.3418 t 999 new 0.20) lr 1.00e-05 gnorm 0.218 3.32s mem 81.1GB +step 236/5000 loss 0.2984 (w 0.3887 mse 0.4090 t 957 new 0.18) lr 1.00e-05 gnorm 0.205 3.05s mem 81.1GB +step 237/5000 loss 0.3273 (w 0.3455 mse 0.3408 t 846 new 0.18) lr 1.00e-05 gnorm 0.200 3.34s mem 81.1GB +step 238/5000 loss 0.4010 (w 0.2610 mse 0.2658 t 760 new 0.10) lr 1.00e-05 gnorm 0.220 3.13s mem 81.1GB +step 239/5000 loss 0.2391 (w 0.2964 mse 0.3127 t 352 new 0.09) lr 1.00e-05 gnorm 0.156 2.82s mem 81.1GB +step 240/5000 loss 0.4343 (w 0.3132 mse 0.3076 t 654 new 0.14) lr 1.00e-05 gnorm 0.568 2.82s mem 81.1GB +step 241/5000 loss 0.5987 (w 0.3797 mse 0.3836 t 525 new 0.22) lr 1.00e-05 gnorm 0.328 3.35s mem 81.1GB +step 242/5000 loss 0.2625 (w 0.3475 mse 0.3661 t 957 new 0.21) lr 1.00e-05 gnorm 0.170 3.34s mem 81.1GB +step 243/5000 loss 0.3742 (w 0.3496 mse 0.3607 t 848 new 0.20) lr 1.00e-05 gnorm 0.161 3.06s mem 81.1GB +step 244/5000 loss 0.5973 (w 0.2806 mse 0.2957 t 546 new 0.23) lr 1.00e-05 gnorm 0.267 3.16s mem 81.1GB +step 245/5000 loss 0.3690 (w 0.3390 mse 0.3481 t 473 new 0.11) lr 1.00e-05 gnorm 0.181 2.83s mem 81.1GB +step 246/5000 loss 0.4236 (w 0.4850 mse 0.4811 t 368 new 0.23) lr 1.00e-05 gnorm 0.188 2.83s mem 81.1GB +step 247/5000 loss 0.3839 (w 0.6577 mse 0.6339 t 991 new 0.22) lr 1.00e-05 gnorm 0.129 3.43s mem 81.1GB +step 248/5000 loss 0.4431 (w 0.3606 mse 0.3601 t 751 new 0.22) lr 1.00e-05 gnorm 0.142 3.30s mem 81.1GB +step 249/5000 loss 0.3808 (w 0.3654 mse 0.3879 t 323 new 0.25) lr 1.00e-05 gnorm 0.222 3.22s mem 81.1GB +step 250/5000 loss 0.2752 (w 0.3102 mse 0.3260 t 476 new 0.12) lr 1.00e-05 gnorm 0.176 2.82s mem 81.1GB +step 251/5000 loss 0.4542 (w 0.3551 mse 0.3637 t 660 new 0.18) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +step 252/5000 loss 0.2895 (w 0.3651 mse 0.3748 t 899 new 0.23) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +step 253/5000 loss 0.4399 (w 0.3251 mse 0.3281 t 663 new 0.27) lr 1.00e-05 gnorm 0.156 3.13s mem 81.1GB +step 254/5000 loss 0.3045 (w 0.3313 mse 0.3400 t 906 new 0.20) lr 1.00e-05 gnorm 0.163 3.32s mem 81.1GB +step 255/5000 loss 0.4954 (w 0.3147 mse 0.3275 t 735 new 0.21) lr 1.00e-05 gnorm 0.430 3.11s mem 81.1GB +step 256/5000 loss 0.2573 (w 0.2093 mse 0.2236 t 969 new 0.13) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 257/5000 loss 0.1900 (w 0.2617 mse 0.2670 t 734 new 0.12) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +step 258/5000 loss 0.3816 (w 0.3858 mse 0.3900 t 936 new 0.25) lr 1.00e-05 gnorm 0.185 3.09s mem 81.1GB +step 259/5000 loss 0.3420 (w 0.3422 mse 0.3516 t 856 new 0.23) lr 1.00e-05 gnorm 0.163 3.14s mem 81.1GB +step 260/5000 loss 0.4554 (w 0.2510 mse 0.2770 t 760 new 0.17) lr 1.00e-05 gnorm 0.141 3.32s mem 81.1GB +step 261/5000 loss 0.4435 (w 0.3551 mse 0.3616 t 744 new 0.20) lr 1.00e-05 gnorm 0.158 3.15s mem 81.1GB +step 262/5000 loss 0.1948 (w 0.3369 mse 0.3383 t 927 new 0.22) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +step 263/5000 loss 0.2951 (w 0.4216 mse 0.4203 t 952 new 0.22) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +step 264/5000 loss 0.2089 (w 0.2481 mse 0.2677 t 693 new 0.23) lr 1.00e-05 gnorm 0.201 3.09s mem 81.1GB +step 265/5000 loss 0.4685 (w 0.3404 mse 0.3702 t 935 new 0.26) lr 1.00e-05 gnorm 0.208 3.04s mem 81.1GB +step 266/5000 loss 0.1701 (w 0.3021 mse 0.3128 t 768 new 0.16) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +step 267/5000 loss 0.3139 (w 0.4210 mse 0.4340 t 988 new 0.15) lr 1.00e-05 gnorm 0.183 3.17s mem 81.1GB +step 268/5000 loss 0.3140 (w 0.2810 mse 0.2970 t 989 new 0.18) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +step 269/5000 loss 0.3798 (w 0.5247 mse 0.5356 t 976 new 0.18) lr 1.00e-05 gnorm 0.159 2.81s mem 81.1GB +step 270/5000 loss 0.3477 (w 0.3365 mse 0.3456 t 916 new 0.15) lr 1.00e-05 gnorm 0.247 3.05s mem 81.1GB +step 271/5000 loss 0.3464 (w 0.3839 mse 0.3839 t 700 new 0.28) lr 1.00e-05 gnorm 1.218 3.05s mem 81.1GB +step 272/5000 loss 0.4029 (w 0.3770 mse 0.3814 t 958 new 0.08) lr 1.00e-05 gnorm 0.209 3.08s mem 81.1GB +step 273/5000 loss 0.3669 (w 0.2501 mse 0.2630 t 989 new 0.22) lr 1.00e-05 gnorm 0.159 3.16s mem 81.1GB +step 274/5000 loss 0.4200 (w 0.3008 mse 0.3088 t 974 new 0.16) lr 1.00e-05 gnorm 0.261 2.81s mem 81.1GB +step 275/5000 loss 0.4257 (w 0.3397 mse 0.3473 t 709 new 0.19) lr 1.00e-05 gnorm 0.191 2.81s mem 81.1GB +step 276/5000 loss 0.2518 (w 0.4318 mse 0.4682 t 153 new 0.16) lr 1.00e-05 gnorm 0.185 3.07s mem 81.1GB +step 277/5000 loss 0.4111 (w 0.2172 mse 0.2277 t 749 new 0.20) lr 1.00e-05 gnorm 0.306 3.35s mem 81.1GB +step 278/5000 loss 0.4250 (w 0.2488 mse 0.2741 t 927 new 0.20) lr 1.00e-05 gnorm 0.162 2.82s mem 81.1GB +step 279/5000 loss 0.3466 (w 0.3702 mse 0.3641 t 983 new 0.23) lr 1.00e-05 gnorm 0.242 3.10s mem 81.1GB +step 280/5000 loss 0.5123 (w 0.5355 mse 0.5549 t 159 new 0.21) lr 1.00e-05 gnorm 0.149 2.83s mem 81.1GB +step 281/5000 loss 0.3517 (w 0.3540 mse 0.3764 t 297 new 0.29) lr 1.00e-05 gnorm 0.516 2.83s mem 81.1GB +step 282/5000 loss 0.1727 (w 0.2437 mse 0.2553 t 905 new 0.20) lr 1.00e-05 gnorm 0.171 3.10s mem 81.1GB +step 283/5000 loss 0.4495 (w 0.5094 mse 0.5100 t 383 new 0.19) lr 1.00e-05 gnorm 0.162 3.30s mem 81.1GB +step 284/5000 loss 0.1376 (w 0.2392 mse 0.2560 t 985 new 0.12) lr 1.00e-05 gnorm 0.177 2.83s mem 81.1GB +step 285/5000 loss 0.3322 (w 0.2820 mse 0.2954 t 951 new 0.08) lr 1.00e-05 gnorm 0.162 3.14s mem 81.1GB +step 286/5000 loss 0.2903 (w 0.2797 mse 0.3064 t 411 new 0.22) lr 1.00e-05 gnorm 0.295 2.82s mem 81.1GB +step 287/5000 loss 0.4645 (w 0.3453 mse 0.3404 t 920 new 0.21) lr 1.00e-05 gnorm 0.281 2.82s mem 81.1GB +step 288/5000 loss 0.3020 (w 0.2103 mse 0.2298 t 683 new 0.23) lr 1.00e-05 gnorm 0.171 3.10s mem 81.1GB +step 289/5000 loss 0.4052 (w 0.3574 mse 0.3587 t 903 new 0.23) lr 1.00e-05 gnorm 0.177 3.36s mem 81.1GB +step 290/5000 loss 0.1024 (w 0.3671 mse 0.3674 t 937 new 0.24) lr 1.00e-05 gnorm 0.183 2.82s mem 81.1GB +step 291/5000 loss 0.3863 (w 0.2949 mse 0.3054 t 948 new 0.20) lr 1.00e-05 gnorm 0.159 3.12s mem 81.1GB +step 292/5000 loss 0.1858 (w 0.2599 mse 0.2807 t 945 new 0.25) lr 1.00e-05 gnorm 1.237 2.83s mem 81.1GB +step 293/5000 loss 0.4475 (w 0.3134 mse 0.3370 t 551 new 0.23) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +step 294/5000 loss 0.2815 (w 0.2518 mse 0.2771 t 955 new 0.14) lr 1.00e-05 gnorm 0.125 3.33s mem 81.1GB +step 295/5000 loss 0.2896 (w 0.3217 mse 0.3283 t 610 new 0.26) lr 1.00e-05 gnorm 0.156 3.31s mem 81.1GB +step 296/5000 loss 0.1518 (w 0.5041 mse 0.5202 t 997 new 0.17) lr 1.00e-05 gnorm 0.166 3.08s mem 81.1GB +step 297/5000 loss 0.3480 (w 0.4527 mse 0.4560 t 970 new 0.19) lr 1.00e-05 gnorm 0.218 2.82s mem 81.1GB +step 298/5000 loss 0.3550 (w 0.2692 mse 0.2951 t 861 new 0.22) lr 1.00e-05 gnorm 0.160 2.82s mem 81.1GB +step 299/5000 loss 0.3922 (w 0.3592 mse 0.3477 t 933 new 0.20) lr 1.00e-05 gnorm 0.173 2.82s mem 81.1GB +step 300/5000 loss 0.4232 (w 0.3539 mse 0.3521 t 732 new 0.18) lr 1.00e-05 gnorm 0.387 3.32s mem 81.1GB +step 301/5000 loss 0.2149 (w 0.4109 mse 0.4235 t 991 new 0.25) lr 1.00e-05 gnorm 0.292 3.29s mem 81.1GB +step 302/5000 loss 0.2898 (w 0.6982 mse 0.7025 t 177 new 0.22) lr 1.00e-05 gnorm 0.228 3.11s mem 81.1GB +step 303/5000 loss 0.4141 (w 0.2817 mse 0.2932 t 712 new 0.14) lr 1.00e-05 gnorm 0.187 2.82s mem 81.1GB +step 304/5000 loss 0.3898 (w 0.2664 mse 0.2742 t 762 new 0.16) lr 1.00e-05 gnorm 0.193 2.82s mem 81.1GB +step 305/5000 loss 0.3555 (w 0.2292 mse 0.2390 t 847 new 0.20) lr 1.00e-05 gnorm 0.177 2.82s mem 81.1GB +step 306/5000 loss 0.2794 (w 0.2546 mse 0.2691 t 962 new 0.25) lr 1.00e-05 gnorm 0.145 3.32s mem 81.1GB +step 307/5000 loss 0.2519 (w 0.3256 mse 0.3436 t 982 new 0.27) lr 1.00e-05 gnorm 0.204 3.26s mem 81.1GB +step 308/5000 loss 0.2259 (w 0.3374 mse 0.3380 t 936 new 0.20) lr 1.00e-05 gnorm 0.150 3.16s mem 81.1GB +step 309/5000 loss 0.1963 (w 0.4165 mse 0.4330 t 476 new 0.23) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +step 310/5000 loss 0.3470 (w 0.2857 mse 0.2853 t 835 new 0.18) lr 1.00e-05 gnorm 0.215 2.83s mem 81.1GB +step 311/5000 loss 0.4653 (w 0.4181 mse 0.4249 t 601 new 0.25) lr 1.00e-05 gnorm 0.174 3.13s mem 81.1GB +step 312/5000 loss 0.3850 (w 0.2883 mse 0.2959 t 665 new 0.22) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +step 313/5000 loss 0.5025 (w 0.3493 mse 0.3565 t 932 new 0.20) lr 1.00e-05 gnorm 0.164 3.29s mem 81.1GB +step 314/5000 loss 0.3145 (w 0.2769 mse 0.3119 t 836 new 0.25) lr 1.00e-05 gnorm 0.182 3.13s mem 81.1GB +step 315/5000 loss 0.3829 (w 0.5574 mse 0.5720 t 195 new 0.09) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +step 316/5000 loss 0.3518 (w 0.2736 mse 0.2864 t 764 new 0.20) lr 1.00e-05 gnorm 0.230 2.83s mem 81.1GB +step 317/5000 loss 0.3178 (w 0.3072 mse 0.3111 t 979 new 0.23) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +step 318/5000 loss 0.1647 (w 0.2844 mse 0.2856 t 897 new 0.26) lr 1.00e-05 gnorm 0.175 3.07s mem 81.1GB +step 319/5000 loss 0.2991 (w 0.3160 mse 0.3227 t 821 new 0.21) lr 1.00e-05 gnorm 0.137 3.39s mem 81.1GB +step 320/5000 loss 0.2515 (w 0.3969 mse 0.3991 t 918 new 0.18) lr 1.00e-05 gnorm 0.139 2.82s mem 81.1GB +step 321/5000 loss 0.2136 (w 0.3259 mse 0.3366 t 983 new 0.22) lr 1.00e-05 gnorm 0.183 2.82s mem 81.1GB +step 322/5000 loss 0.2633 (w 0.2167 mse 0.2389 t 977 new 0.19) lr 1.00e-05 gnorm 0.548 2.83s mem 81.1GB +step 323/5000 loss 0.2356 (w 0.3138 mse 0.3459 t 999 new 0.18) lr 1.00e-05 gnorm 0.153 3.09s mem 81.1GB +step 324/5000 loss 0.2618 (w 0.4141 mse 0.4260 t 997 new 0.16) lr 1.00e-05 gnorm 0.167 3.37s mem 81.1GB +step 325/5000 loss 0.1177 (w 0.4700 mse 0.4755 t 998 new 0.24) lr 1.00e-05 gnorm 0.364 3.14s mem 81.1GB +step 326/5000 loss 0.4344 (w 0.3878 mse 0.3805 t 983 new 0.22) lr 1.00e-05 gnorm 0.172 2.82s mem 81.1GB +step 327/5000 loss 0.2633 (w 0.3765 mse 0.3808 t 943 new 0.13) lr 1.00e-05 gnorm 0.252 2.84s mem 81.1GB +step 328/5000 loss 0.3651 (w 0.3293 mse 0.3317 t 986 new 0.21) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +step 329/5000 loss 0.3013 (w 0.5496 mse 0.5170 t 967 new 0.22) lr 1.00e-05 gnorm 0.231 3.14s mem 81.1GB +step 330/5000 loss 0.1724 (w 0.3037 mse 0.3258 t 974 new 0.26) lr 1.00e-05 gnorm 0.167 3.35s mem 81.1GB +step 331/5000 loss 0.5060 (w 0.3276 mse 0.3273 t 891 new 0.18) lr 1.00e-05 gnorm 1.074 3.33s mem 81.1GB +step 332/5000 loss 0.1936 (w 0.2597 mse 0.2725 t 951 new 0.19) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +step 333/5000 loss 0.3850 (w 0.2043 mse 0.2289 t 843 new 0.23) lr 1.00e-05 gnorm 0.175 2.85s mem 81.1GB +step 334/5000 loss 0.1744 (w 0.4373 mse 0.4268 t 991 new 0.23) lr 1.00e-05 gnorm 0.185 2.83s mem 81.1GB +step 335/5000 loss 0.4109 (w 0.3465 mse 0.3409 t 720 new 0.20) lr 1.00e-05 gnorm 0.155 3.08s mem 81.1GB +step 336/5000 loss 0.3131 (w 0.2431 mse 0.2726 t 973 new 0.24) lr 1.00e-05 gnorm 0.149 3.37s mem 81.1GB +step 337/5000 loss 0.3755 (w 0.4428 mse 0.4424 t 356 new 0.19) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 338/5000 loss 0.1054 (w 0.2276 mse 0.2519 t 973 new 0.19) lr 1.00e-05 gnorm 3.020 2.83s mem 81.1GB +step 339/5000 loss 0.3236 (w 0.3320 mse 0.3389 t 931 new 0.23) lr 1.00e-05 gnorm 0.176 2.82s mem 81.1GB +step 340/5000 loss 0.3642 (w 0.3721 mse 0.3755 t 984 new 0.08) lr 1.00e-05 gnorm 0.373 2.83s mem 81.1GB +step 341/5000 loss 0.4861 (w 0.3321 mse 0.3359 t 779 new 0.27) lr 1.00e-05 gnorm 0.165 3.35s mem 81.1GB +step 342/5000 loss 0.1535 (w 0.2992 mse 0.3020 t 996 new 0.25) lr 1.00e-05 gnorm 0.159 3.08s mem 81.1GB +step 343/5000 loss 0.3613 (w 0.3172 mse 0.3343 t 809 new 0.18) lr 1.00e-05 gnorm 0.187 3.10s mem 81.1GB +step 344/5000 loss 0.2869 (w 0.3325 mse 0.3311 t 944 new 0.29) lr 1.00e-05 gnorm 0.181 2.82s mem 81.1GB +step 345/5000 loss 0.3504 (w 0.3773 mse 0.3865 t 495 new 0.23) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +step 346/5000 loss 0.5498 (w 0.3107 mse 0.3255 t 586 new 0.27) lr 1.00e-05 gnorm 0.194 3.04s mem 81.1GB +step 347/5000 loss 0.3144 (w 0.2628 mse 0.2913 t 889 new 0.20) lr 1.00e-05 gnorm 0.178 3.04s mem 81.1GB +step 348/5000 loss 0.2547 (w 0.3370 mse 0.3354 t 964 new 0.21) lr 1.00e-05 gnorm 0.597 3.38s mem 81.1GB +step 349/5000 loss 0.5124 (w 0.3135 mse 0.3291 t 737 new 0.24) lr 1.00e-05 gnorm 0.180 3.16s mem 81.1GB +step 350/5000 loss 0.4154 (w 0.4239 mse 0.4195 t 983 new 0.24) lr 1.00e-05 gnorm 0.195 2.82s mem 81.1GB +step 351/5000 loss 0.5759 (w 0.2879 mse 0.2963 t 843 new 0.26) lr 1.00e-05 gnorm 0.206 2.82s mem 81.1GB +step 352/5000 loss 0.3441 (w 0.2218 mse 0.2438 t 930 new 0.26) lr 1.00e-05 gnorm 3.308 3.06s mem 81.1GB +step 353/5000 loss 0.2502 (w 0.4330 mse 0.4380 t 974 new 0.17) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +step 354/5000 loss 0.4098 (w 0.2707 mse 0.2826 t 568 new 0.23) lr 1.00e-05 gnorm 0.202 3.33s mem 81.1GB +step 355/5000 loss 0.3402 (w 0.3094 mse 0.3145 t 920 new 0.23) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +step 356/5000 loss 0.3361 (w 0.3833 mse 0.3750 t 903 new 0.27) lr 1.00e-05 gnorm 0.204 2.84s mem 81.1GB +step 357/5000 loss 0.2233 (w 0.2209 mse 0.2330 t 779 new 0.12) lr 1.00e-05 gnorm 0.215 2.84s mem 81.1GB +step 358/5000 loss 0.4013 (w 0.3567 mse 0.3480 t 922 new 0.17) lr 1.00e-05 gnorm 0.223 3.09s mem 81.1GB +step 359/5000 loss 0.3173 (w 0.2266 mse 0.2447 t 609 new 0.26) lr 1.00e-05 gnorm 0.382 3.12s mem 81.1GB +step 360/5000 loss 0.1801 (w 0.2685 mse 0.2725 t 784 new 0.25) lr 1.00e-05 gnorm 0.175 3.10s mem 81.1GB +step 361/5000 loss 0.3930 (w 0.3077 mse 0.3152 t 739 new 0.22) lr 1.00e-05 gnorm 0.176 2.83s mem 81.1GB +step 362/5000 loss 0.2806 (w 0.3148 mse 0.3174 t 774 new 0.23) lr 1.00e-05 gnorm 0.147 2.82s mem 81.1GB +step 363/5000 loss 0.3165 (w 0.2437 mse 0.2560 t 925 new 0.24) lr 1.00e-05 gnorm 0.135 2.82s mem 81.1GB +step 364/5000 loss 0.4408 (w 0.3086 mse 0.3089 t 705 new 0.17) lr 1.00e-05 gnorm 0.184 3.05s mem 81.1GB +step 365/5000 loss 0.4513 (w 0.4230 mse 0.4259 t 428 new 0.21) lr 1.00e-05 gnorm 0.465 3.42s mem 81.1GB +step 366/5000 loss 0.3159 (w 0.2913 mse 0.3027 t 951 new 0.24) lr 1.00e-05 gnorm 0.168 3.42s mem 81.1GB +step 367/5000 loss 0.3348 (w 0.2355 mse 0.2468 t 660 new 0.17) lr 1.00e-05 gnorm 0.267 2.82s mem 81.1GB +step 368/5000 loss 0.1243 (w 0.3160 mse 0.3181 t 952 new 0.20) lr 1.00e-05 gnorm 0.184 2.83s mem 81.1GB +step 369/5000 loss 0.3334 (w 0.2167 mse 0.2270 t 687 new 0.22) lr 1.00e-05 gnorm 0.177 2.82s mem 81.1GB +step 370/5000 loss 0.2351 (w 0.3600 mse 0.3532 t 953 new 0.17) lr 1.00e-05 gnorm 0.196 3.11s mem 81.1GB +step 371/5000 loss 0.3999 (w 0.3014 mse 0.2902 t 852 new 0.22) lr 1.00e-05 gnorm 0.162 3.37s mem 81.1GB +step 372/5000 loss 0.3723 (w 0.4534 mse 0.4402 t 954 new 0.17) lr 1.00e-05 gnorm 0.126 3.14s mem 81.1GB +step 373/5000 loss 0.1594 (w 0.3140 mse 0.3267 t 925 new 0.24) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +step 374/5000 loss 0.2314 (w 0.3394 mse 0.3493 t 817 new 0.20) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +step 375/5000 loss 0.1348 (w 0.3383 mse 0.3403 t 976 new 0.10) lr 1.00e-05 gnorm 0.161 2.82s mem 81.1GB +step 376/5000 loss 0.3711 (w 0.4223 mse 0.4178 t 894 new 0.22) lr 1.00e-05 gnorm 0.248 3.07s mem 81.1GB +step 377/5000 loss 0.4951 (w 0.6172 mse 0.6192 t 165 new 0.21) lr 1.00e-05 gnorm 0.203 3.42s mem 81.1GB +step 378/5000 loss 0.2762 (w 0.3405 mse 0.3458 t 854 new 0.14) lr 1.00e-05 gnorm 0.382 3.08s mem 81.1GB +step 379/5000 loss 0.1904 (w 0.3480 mse 0.3560 t 945 new 0.25) lr 1.00e-05 gnorm 0.148 2.83s mem 81.1GB +step 380/5000 loss 0.3280 (w 0.2898 mse 0.3035 t 981 new 0.25) lr 1.00e-05 gnorm 0.214 2.82s mem 81.1GB +step 381/5000 loss 0.4456 (w 0.4423 mse 0.4451 t 955 new 0.18) lr 1.00e-05 gnorm 0.423 2.83s mem 81.1GB +step 382/5000 loss 0.3640 (w 0.2611 mse 0.2636 t 663 new 0.23) lr 1.00e-05 gnorm 0.182 3.37s mem 81.1GB +step 383/5000 loss 0.2831 (w 0.2773 mse 0.2903 t 709 new 0.24) lr 1.00e-05 gnorm 0.222 3.44s mem 81.1GB +step 384/5000 loss 0.3541 (w 0.2917 mse 0.3165 t 470 new 0.24) lr 1.00e-05 gnorm 0.835 2.84s mem 81.1GB +step 385/5000 loss 0.3558 (w 0.2249 mse 0.2432 t 914 new 0.16) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +step 386/5000 loss 0.3584 (w 0.3088 mse 0.3324 t 944 new 0.20) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 387/5000 loss 0.4072 (w 0.2279 mse 0.2477 t 673 new 0.29) lr 1.00e-05 gnorm 0.169 3.06s mem 81.1GB +step 388/5000 loss 0.2541 (w 0.2260 mse 0.2389 t 819 new 0.24) lr 1.00e-05 gnorm 0.232 3.09s mem 81.1GB +step 389/5000 loss 0.2728 (w 0.2733 mse 0.2948 t 979 new 0.14) lr 1.00e-05 gnorm 0.163 3.39s mem 81.1GB +step 390/5000 loss 0.1885 (w 0.2724 mse 0.2925 t 838 new 0.11) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +step 391/5000 loss 0.5033 (w 0.2658 mse 0.2730 t 902 new 0.09) lr 1.00e-05 gnorm 0.399 2.82s mem 81.1GB +step 392/5000 loss 0.2969 (w 0.3901 mse 0.4014 t 977 new 0.21) lr 1.00e-05 gnorm 0.238 2.82s mem 81.1GB +step 393/5000 loss 0.3902 (w 0.5160 mse 0.5300 t 274 new 0.25) lr 1.00e-05 gnorm 0.156 3.09s mem 81.1GB +step 394/5000 loss 0.2786 (w 0.3654 mse 0.3735 t 634 new 0.24) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +step 395/5000 loss 0.3215 (w 0.3741 mse 0.3931 t 993 new 0.24) lr 1.00e-05 gnorm 0.243 3.36s mem 81.1GB +step 396/5000 loss 0.4669 (w 0.3479 mse 0.3682 t 997 new 0.21) lr 1.00e-05 gnorm 0.285 2.84s mem 81.1GB +step 397/5000 loss 0.3284 (w 0.3902 mse 0.3977 t 925 new 0.21) lr 1.00e-05 gnorm 0.300 2.83s mem 81.1GB +step 398/5000 loss 0.4346 (w 0.3156 mse 0.3230 t 503 new 0.16) lr 1.00e-05 gnorm 0.197 2.84s mem 81.1GB +step 399/5000 loss 0.2709 (w 0.2264 mse 0.2453 t 629 new 0.29) lr 1.00e-05 gnorm 0.156 3.14s mem 81.1GB +step 400/5000 loss 0.2836 (w 0.2603 mse 0.2797 t 849 new 0.19) lr 1.00e-05 gnorm 0.189 3.12s mem 81.1GB +step 401/5000 loss 0.4054 (w 0.3876 mse 0.3917 t 853 new 0.11) lr 1.00e-05 gnorm 0.193 3.14s mem 81.1GB +step 402/5000 loss 0.4200 (w 0.4231 mse 0.4156 t 991 new 0.26) lr 1.00e-05 gnorm 0.198 2.83s mem 81.1GB +step 403/5000 loss 0.2301 (w 0.2219 mse 0.2358 t 721 new 0.17) lr 1.00e-05 gnorm 0.192 2.82s mem 81.1GB +step 404/5000 loss 0.3520 (w 0.1784 mse 0.2123 t 687 new 0.24) lr 1.00e-05 gnorm 0.338 2.83s mem 81.1GB +step 405/5000 loss 0.2661 (w 0.2314 mse 0.2467 t 910 new 0.18) lr 1.00e-05 gnorm 0.144 3.04s mem 81.1GB +step 406/5000 loss 0.3041 (w 0.3258 mse 0.3295 t 925 new 0.12) lr 1.00e-05 gnorm 0.200 3.41s mem 81.1GB +step 407/5000 loss 0.2033 (w 0.3416 mse 0.3358 t 969 new 0.26) lr 1.00e-05 gnorm 0.183 3.07s mem 81.1GB +step 408/5000 loss 0.2565 (w 0.2417 mse 0.2661 t 887 new 0.16) lr 1.00e-05 gnorm 0.466 2.82s mem 81.1GB +step 409/5000 loss 0.3748 (w 0.2883 mse 0.2991 t 742 new 0.27) lr 1.00e-05 gnorm 0.179 2.83s mem 81.1GB +step 410/5000 loss 0.3304 (w 0.2684 mse 0.2799 t 940 new 0.16) lr 1.00e-05 gnorm 0.210 2.82s mem 81.1GB +step 411/5000 loss 0.3987 (w 0.3438 mse 0.3543 t 725 new 0.24) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +step 412/5000 loss 0.2136 (w 0.2494 mse 0.2584 t 990 new 0.15) lr 1.00e-05 gnorm 0.139 3.45s mem 81.1GB +step 413/5000 loss 0.2355 (w 0.7515 mse 0.7489 t 999 new 0.23) lr 1.00e-05 gnorm 0.169 2.84s mem 81.1GB +step 414/5000 loss 0.3895 (w 0.2340 mse 0.2641 t 932 new 0.20) lr 1.00e-05 gnorm 0.517 2.83s mem 81.1GB +step 415/5000 loss 0.3817 (w 0.2912 mse 0.3103 t 817 new 0.17) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +step 416/5000 loss 0.5178 (w 0.3844 mse 0.3871 t 961 new 0.15) lr 1.00e-05 gnorm 0.172 2.82s mem 81.1GB +step 417/5000 loss 0.3957 (w 0.3545 mse 0.3523 t 594 new 0.23) lr 1.00e-05 gnorm 0.302 3.08s mem 81.1GB +step 418/5000 loss 0.2613 (w 0.3495 mse 0.3654 t 971 new 0.25) lr 1.00e-05 gnorm 0.120 3.36s mem 81.1GB +step 419/5000 loss 0.3014 (w 0.2712 mse 0.2886 t 948 new 0.23) lr 1.00e-05 gnorm 0.303 2.82s mem 81.1GB +step 420/5000 loss 0.2332 (w 0.2255 mse 0.2518 t 692 new 0.17) lr 1.00e-05 gnorm 0.554 2.82s mem 81.1GB +step 421/5000 loss 0.2334 (w 0.1927 mse 0.2161 t 557 new 0.19) lr 1.00e-05 gnorm 0.138 2.82s mem 81.1GB +step 422/5000 loss 0.4305 (w 0.2253 mse 0.2346 t 813 new 0.23) lr 1.00e-05 gnorm 0.174 3.05s mem 81.1GB +step 423/5000 loss 0.3121 (w 0.2877 mse 0.2946 t 931 new 0.18) lr 1.00e-05 gnorm 0.279 3.08s mem 81.1GB +step 424/5000 loss 0.3047 (w 0.3583 mse 0.3648 t 835 new 0.25) lr 1.00e-05 gnorm 0.154 3.42s mem 81.1GB +step 425/5000 loss 0.4496 (w 0.3124 mse 0.3184 t 794 new 0.26) lr 1.00e-05 gnorm 0.254 3.14s mem 81.1GB +step 426/5000 loss 0.2542 (w 0.2050 mse 0.2125 t 672 new 0.24) lr 1.00e-05 gnorm 0.150 2.83s mem 81.1GB +step 427/5000 loss 0.3520 (w 0.3139 mse 0.3289 t 715 new 0.23) lr 1.00e-05 gnorm 0.263 2.83s mem 81.1GB +step 428/5000 loss 0.1996 (w 0.5265 mse 0.5145 t 978 new 0.18) lr 1.00e-05 gnorm 0.251 3.14s mem 81.1GB +step 429/5000 loss 0.4830 (w 0.3733 mse 0.4004 t 995 new 0.13) lr 1.00e-05 gnorm 0.206 3.29s mem 81.1GB +step 430/5000 loss 0.2986 (w 0.2434 mse 0.2581 t 935 new 0.17) lr 1.00e-05 gnorm 0.164 3.32s mem 81.1GB +step 431/5000 loss 0.3435 (w 0.3739 mse 0.3715 t 890 new 0.21) lr 1.00e-05 gnorm 0.272 2.83s mem 81.1GB +step 432/5000 loss 0.3342 (w 0.2243 mse 0.2293 t 822 new 0.16) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +step 433/5000 loss 0.2426 (w 0.2751 mse 0.2723 t 783 new 0.17) lr 1.00e-05 gnorm 0.399 2.83s mem 81.1GB +step 434/5000 loss 0.2455 (w 0.2104 mse 0.2425 t 932 new 0.23) lr 1.00e-05 gnorm 0.158 3.14s mem 81.1GB +step 435/5000 loss 0.2822 (w 0.3714 mse 0.3785 t 586 new 0.22) lr 1.00e-05 gnorm 0.118 3.24s mem 81.1GB +step 436/5000 loss 0.4364 (w 0.2525 mse 0.2679 t 830 new 0.13) lr 1.00e-05 gnorm 0.164 3.35s mem 81.1GB +step 437/5000 loss 0.2349 (w 0.3301 mse 0.3206 t 803 new 0.22) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +step 438/5000 loss 0.2056 (w 0.2967 mse 0.3160 t 450 new 0.21) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +step 439/5000 loss 0.1507 (w 0.2766 mse 0.2895 t 997 new 0.22) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +step 440/5000 loss 0.4075 (w 0.3153 mse 0.3309 t 977 new 0.24) lr 1.00e-05 gnorm 0.296 3.05s mem 81.1GB +step 441/5000 loss 0.2865 (w 0.3626 mse 0.3700 t 614 new 0.25) lr 1.00e-05 gnorm 0.151 3.32s mem 81.1GB +step 442/5000 loss 0.3266 (w 0.1763 mse 0.1924 t 790 new 0.22) lr 1.00e-05 gnorm 0.173 3.08s mem 81.1GB +step 443/5000 loss 0.2603 (w 0.2670 mse 0.2716 t 935 new 0.14) lr 1.00e-05 gnorm 0.234 2.82s mem 81.1GB +step 444/5000 loss 0.3254 (w 0.3598 mse 0.3596 t 601 new 0.21) lr 1.00e-05 gnorm 0.859 2.82s mem 81.1GB +step 445/5000 loss 0.3128 (w 0.3000 mse 0.3073 t 836 new 0.18) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +step 446/5000 loss 0.3146 (w 0.3303 mse 0.3408 t 798 new 0.23) lr 1.00e-05 gnorm 0.138 3.11s mem 81.1GB +step 447/5000 loss 0.1973 (w 0.2010 mse 0.2124 t 929 new 0.20) lr 1.00e-05 gnorm 0.152 3.32s mem 81.1GB +step 448/5000 loss 0.4745 (w 0.3716 mse 0.3705 t 605 new 0.23) lr 1.00e-05 gnorm 0.190 3.10s mem 81.1GB +step 449/5000 loss 0.3783 (w 0.2565 mse 0.2605 t 924 new 0.16) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +step 450/5000 loss 0.3885 (w 0.3162 mse 0.3264 t 728 new 0.28) lr 1.00e-05 gnorm 0.887 2.83s mem 81.1GB +step 451/5000 loss 0.4468 (w 0.2128 mse 0.2450 t 969 new 0.20) lr 1.00e-05 gnorm 1.301 3.06s mem 81.1GB +step 452/5000 loss 0.4201 (w 0.2367 mse 0.2713 t 650 new 0.24) lr 1.00e-05 gnorm 0.181 3.01s mem 81.1GB +step 453/5000 loss 0.3023 (w 0.2625 mse 0.2744 t 741 new 0.16) lr 1.00e-05 gnorm 0.172 3.31s mem 81.1GB +step 454/5000 loss 0.2672 (w 0.1427 mse 0.1702 t 885 new 0.19) lr 1.00e-05 gnorm 0.177 3.02s mem 81.1GB +step 455/5000 loss 0.2794 (w 0.3111 mse 0.3260 t 732 new 0.15) lr 1.00e-05 gnorm 0.141 2.82s mem 81.1GB +step 456/5000 loss 0.4213 (w 0.3116 mse 0.3259 t 528 new 0.26) lr 1.00e-05 gnorm 0.213 2.82s mem 81.1GB +step 457/5000 loss 0.3749 (w 0.3147 mse 0.3478 t 982 new 0.21) lr 1.00e-05 gnorm 0.221 3.05s mem 81.1GB +step 458/5000 loss 0.3604 (w 0.3266 mse 0.3282 t 878 new 0.23) lr 1.00e-05 gnorm 0.200 3.00s mem 81.1GB +step 459/5000 loss 0.2608 (w 0.2111 mse 0.2149 t 754 new 0.12) lr 1.00e-05 gnorm 0.133 3.08s mem 81.1GB +step 460/5000 loss 0.2718 (w 0.2704 mse 0.2901 t 865 new 0.24) lr 1.00e-05 gnorm 0.338 3.06s mem 81.1GB +step 461/5000 loss 0.2998 (w 0.5690 mse 0.5739 t 990 new 0.20) lr 1.00e-05 gnorm 0.221 2.82s mem 81.1GB +step 462/5000 loss 0.5441 (w 0.3487 mse 0.3555 t 964 new 0.24) lr 1.00e-05 gnorm 0.179 2.81s mem 81.1GB +step 463/5000 loss 0.2259 (w 0.4699 mse 0.4653 t 959 new 0.18) lr 1.00e-05 gnorm 0.166 3.06s mem 81.1GB +step 464/5000 loss 0.2414 (w 0.5578 mse 0.5642 t 120 new 0.27) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +step 465/5000 loss 0.4657 (w 0.2065 mse 0.2275 t 774 new 0.23) lr 1.00e-05 gnorm 0.145 3.34s mem 81.1GB +step 466/5000 loss 0.3492 (w 0.2069 mse 0.2309 t 936 new 0.20) lr 1.00e-05 gnorm 0.162 3.02s mem 81.1GB +step 467/5000 loss 0.2141 (w 0.3898 mse 0.3802 t 938 new 0.24) lr 1.00e-05 gnorm 0.721 2.83s mem 81.1GB +step 468/5000 loss 0.4458 (w 0.4188 mse 0.4309 t 332 new 0.24) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +step 469/5000 loss 0.2129 (w 0.2191 mse 0.2391 t 871 new 0.19) lr 1.00e-05 gnorm 0.179 3.13s mem 81.1GB +step 470/5000 loss 0.1951 (w 0.3045 mse 0.3045 t 941 new 0.23) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +step 471/5000 loss 0.4009 (w 0.2168 mse 0.2310 t 914 new 0.12) lr 1.00e-05 gnorm 0.171 3.28s mem 81.1GB +step 472/5000 loss 0.3753 (w 0.6930 mse 0.6949 t 189 new 0.20) lr 1.00e-05 gnorm 0.196 3.01s mem 81.1GB +step 473/5000 loss 0.3737 (w 0.2355 mse 0.2521 t 864 new 0.21) lr 1.00e-05 gnorm 0.322 2.83s mem 81.1GB +step 474/5000 loss 0.3262 (w 0.2156 mse 0.2424 t 386 new 0.17) lr 1.00e-05 gnorm 0.302 2.83s mem 81.1GB +step 475/5000 loss 0.3644 (w 0.3268 mse 0.3422 t 985 new 0.22) lr 1.00e-05 gnorm 0.243 3.07s mem 81.1GB +step 476/5000 loss 0.4472 (w 0.3694 mse 0.3629 t 492 new 0.20) lr 1.00e-05 gnorm 0.222 3.28s mem 81.1GB +step 477/5000 loss 0.2897 (w 0.3504 mse 0.3602 t 310 new 0.07) lr 1.00e-05 gnorm 0.114 3.26s mem 81.1GB +step 478/5000 loss 0.2387 (w 0.2978 mse 0.3174 t 975 new 0.22) lr 1.00e-05 gnorm 0.139 3.01s mem 81.1GB +step 479/5000 loss 0.2416 (w 0.2462 mse 0.2556 t 942 new 0.10) lr 1.00e-05 gnorm 0.251 2.82s mem 81.1GB +step 480/5000 loss 0.3268 (w 0.3022 mse 0.3067 t 871 new 0.17) lr 1.00e-05 gnorm 0.186 2.83s mem 81.1GB +step 481/5000 loss 0.4240 (w 0.3366 mse 0.3335 t 915 new 0.26) lr 1.00e-05 gnorm 0.184 3.08s mem 81.1GB +step 482/5000 loss 0.4523 (w 0.2185 mse 0.2350 t 811 new 0.13) lr 1.00e-05 gnorm 3.163 3.10s mem 81.1GB +step 483/5000 loss 0.2629 (w 0.3587 mse 0.3966 t 997 new 0.19) lr 1.00e-05 gnorm 0.131 3.26s mem 81.1GB +step 484/5000 loss 0.2507 (w 0.1827 mse 0.2152 t 809 new 0.22) lr 1.00e-05 gnorm 0.149 3.01s mem 81.1GB +step 485/5000 loss 0.3583 (w 0.2847 mse 0.2878 t 925 new 0.24) lr 1.00e-05 gnorm 0.508 2.83s mem 81.1GB +step 486/5000 loss 0.2352 (w 0.2614 mse 0.2660 t 930 new 0.14) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +step 487/5000 loss 0.1547 (w 0.2914 mse 0.3028 t 905 new 0.22) lr 1.00e-05 gnorm 0.136 3.31s mem 81.1GB +step 488/5000 loss 0.3275 (w 0.3496 mse 0.3508 t 864 new 0.24) lr 1.00e-05 gnorm 0.190 3.08s mem 81.1GB +step 489/5000 loss 0.1836 (w 0.3610 mse 0.3688 t 909 new 0.14) lr 1.00e-05 gnorm 0.175 3.36s mem 81.1GB +step 490/5000 loss 0.2249 (w 0.3610 mse 0.3685 t 989 new 0.17) lr 1.00e-05 gnorm 0.169 3.02s mem 81.1GB +step 491/5000 loss 0.2772 (w 0.2564 mse 0.2815 t 892 new 0.19) lr 1.00e-05 gnorm 0.176 2.82s mem 81.1GB +step 492/5000 loss 0.3598 (w 0.6867 mse 0.6851 t 153 new 0.20) lr 1.00e-05 gnorm 0.162 3.07s mem 81.1GB +step 493/5000 loss 0.3368 (w 0.3054 mse 0.3177 t 970 new 0.16) lr 1.00e-05 gnorm 0.137 3.03s mem 81.1GB +step 494/5000 loss 0.2226 (w 0.3329 mse 0.3379 t 699 new 0.24) lr 1.00e-05 gnorm 0.161 3.31s mem 81.1GB +step 495/5000 loss 0.2829 (w 0.2699 mse 0.2695 t 857 new 0.23) lr 1.00e-05 gnorm 0.173 3.30s mem 81.1GB +step 496/5000 loss 0.1517 (w 0.3294 mse 0.3393 t 950 new 0.23) lr 1.00e-05 gnorm 0.580 2.83s mem 81.1GB +step 497/5000 loss 0.1649 (w 0.2897 mse 0.3018 t 771 new 0.26) lr 1.00e-05 gnorm 0.227 2.83s mem 81.1GB +step 498/5000 loss 0.1263 (w 0.3464 mse 0.3383 t 953 new 0.17) lr 1.00e-05 gnorm 0.156 3.06s mem 81.1GB +step 499/5000 loss 0.3102 (w 0.3231 mse 0.3236 t 809 new 0.17) lr 1.00e-05 gnorm 0.155 3.08s mem 81.1GB +step 500/5000 loss 0.3408 (w 0.2270 mse 0.2407 t 692 new 0.16) lr 1.00e-05 gnorm 0.280 3.29s mem 81.1GB +[val] step 500 t=200: w=0.4996 mse=0.5183 (n=16) t=500: w=0.3024 mse=0.3181 (n=16) t=800: w=0.2550 mse=0.2678 (n=16) | mean w=0.3523 mse=0.3681 3s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step500.safetensors 4093 个张量 37.98 GB +step 501/5000 loss 0.3460 (w 0.2647 mse 0.2777 t 631 new 0.08) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +step 502/5000 loss 0.1841 (w 0.3146 mse 0.3183 t 979 new 0.23) lr 1.00e-05 gnorm 0.144 2.81s mem 81.1GB +step 503/5000 loss 0.2477 (w 0.2769 mse 0.2829 t 900 new 0.13) lr 1.00e-05 gnorm 0.240 2.82s mem 81.1GB +step 504/5000 loss 0.3876 (w 0.3854 mse 0.3883 t 676 new 0.20) lr 1.00e-05 gnorm 0.158 3.07s mem 81.1GB +step 505/5000 loss 0.3627 (w 0.1992 mse 0.2132 t 980 new 0.22) lr 1.00e-05 gnorm 0.146 3.39s mem 81.1GB +step 506/5000 loss 0.1958 (w 0.1840 mse 0.1952 t 853 new 0.09) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +step 507/5000 loss 0.4221 (w 0.2938 mse 0.3071 t 980 new 0.13) lr 1.00e-05 gnorm 0.164 3.34s mem 81.1GB +step 508/5000 loss 0.5129 (w 0.2905 mse 0.2909 t 301 new 0.23) lr 1.00e-05 gnorm 1.384 2.82s mem 81.1GB +step 509/5000 loss 0.3319 (w 0.3486 mse 0.3468 t 633 new 0.21) lr 1.00e-05 gnorm 0.186 2.83s mem 81.1GB +step 510/5000 loss 0.2147 (w 0.4890 mse 0.4966 t 994 new 0.12) lr 1.00e-05 gnorm 0.176 3.24s mem 81.1GB +step 511/5000 loss 0.3302 (w 0.4136 mse 0.4106 t 984 new 0.21) lr 1.00e-05 gnorm 0.179 3.32s mem 81.1GB +step 512/5000 loss 0.3385 (w 0.2177 mse 0.2322 t 917 new 0.26) lr 1.00e-05 gnorm 0.206 3.09s mem 81.1GB +step 513/5000 loss 0.3616 (w 0.4960 mse 0.4994 t 301 new 0.21) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +step 514/5000 loss 0.2775 (w 0.2039 mse 0.2061 t 840 new 0.16) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +step 515/5000 loss 0.4343 (w 0.2634 mse 0.2806 t 770 new 0.11) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +step 516/5000 loss 0.3003 (w 0.4090 mse 0.4091 t 980 new 0.11) lr 1.00e-05 gnorm 0.165 3.24s mem 81.1GB +step 517/5000 loss 0.1568 (w 0.3674 mse 0.3674 t 971 new 0.21) lr 1.00e-05 gnorm 0.240 3.38s mem 81.1GB +step 518/5000 loss 0.3390 (w 0.3922 mse 0.3849 t 776 new 0.22) lr 1.00e-05 gnorm 0.195 3.00s mem 81.1GB +step 519/5000 loss 0.2896 (w 0.3071 mse 0.3305 t 999 new 0.11) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +step 520/5000 loss 0.2626 (w 0.3446 mse 0.3505 t 992 new 0.19) lr 1.00e-05 gnorm 0.144 2.82s mem 81.1GB +step 521/5000 loss 0.4256 (w 0.3604 mse 0.3771 t 310 new 0.22) lr 1.00e-05 gnorm 0.197 2.82s mem 81.1GB +step 522/5000 loss 0.4424 (w 0.2306 mse 0.2511 t 956 new 0.14) lr 1.00e-05 gnorm 0.145 3.36s mem 81.1GB +step 523/5000 loss 0.1394 (w 0.5365 mse 0.5172 t 977 new 0.22) lr 1.00e-05 gnorm 0.127 3.02s mem 81.1GB +step 524/5000 loss 0.2405 (w 0.5651 mse 0.5499 t 998 new 0.22) lr 1.00e-05 gnorm 0.291 3.10s mem 81.1GB +step 525/5000 loss 0.2204 (w 0.3236 mse 0.3353 t 856 new 0.21) lr 1.00e-05 gnorm 0.193 2.84s mem 81.1GB +step 526/5000 loss 0.2119 (w 0.2952 mse 0.2993 t 933 new 0.22) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +step 527/5000 loss 0.5856 (w 0.2910 mse 0.3042 t 942 new 0.21) lr 1.00e-05 gnorm 0.178 2.84s mem 81.1GB +step 528/5000 loss 0.2554 (w 0.2517 mse 0.2875 t 340 new 0.20) lr 1.00e-05 gnorm 0.267 3.37s mem 81.1GB +step 529/5000 loss 0.2214 (w 0.4120 mse 0.4391 t 994 new 0.22) lr 1.00e-05 gnorm 0.131 3.06s mem 81.1GB +step 530/5000 loss 0.2793 (w 0.3433 mse 0.3665 t 959 new 0.15) lr 1.00e-05 gnorm 0.190 3.09s mem 81.1GB +step 531/5000 loss 0.3951 (w 0.1678 mse 0.1865 t 933 new 0.17) lr 1.00e-05 gnorm 0.153 2.82s mem 81.1GB +step 532/5000 loss 0.4416 (w 0.2449 mse 0.2540 t 922 new 0.21) lr 1.00e-05 gnorm 0.197 2.82s mem 81.1GB +step 533/5000 loss 0.4049 (w 0.5409 mse 0.5591 t 140 new 0.17) lr 1.00e-05 gnorm 0.662 2.82s mem 81.1GB +step 534/5000 loss 0.2455 (w 0.2648 mse 0.2696 t 836 new 0.08) lr 1.00e-05 gnorm 0.151 3.27s mem 81.1GB +step 535/5000 loss 0.3110 (w 0.4147 mse 0.4087 t 297 new 0.22) lr 1.00e-05 gnorm 0.156 2.82s mem 81.1GB +step 536/5000 loss 0.4225 (w 0.3070 mse 0.3371 t 979 new 0.20) lr 1.00e-05 gnorm 0.179 3.30s mem 81.1GB +step 537/5000 loss 0.4482 (w 0.3712 mse 0.3843 t 482 new 0.24) lr 1.00e-05 gnorm 0.198 2.83s mem 81.1GB +step 538/5000 loss 0.2471 (w 0.3171 mse 0.3213 t 961 new 0.24) lr 1.00e-05 gnorm 0.455 2.82s mem 81.1GB +step 539/5000 loss 0.2993 (w 0.2285 mse 0.2477 t 947 new 0.25) lr 1.00e-05 gnorm 0.154 3.05s mem 81.1GB +step 540/5000 loss 0.3610 (w 0.3577 mse 0.3647 t 492 new 0.25) lr 1.00e-05 gnorm 0.264 3.31s mem 81.1GB +step 541/5000 loss 0.2757 (w 0.2326 mse 0.2539 t 967 new 0.24) lr 1.00e-05 gnorm 0.165 2.83s mem 81.1GB +step 542/5000 loss 0.3031 (w 0.3990 mse 0.4124 t 954 new 0.21) lr 1.00e-05 gnorm 0.142 3.27s mem 81.1GB +step 543/5000 loss 0.2066 (w 0.2689 mse 0.2824 t 869 new 0.27) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +step 544/5000 loss 0.2677 (w 0.3060 mse 0.3004 t 994 new 0.25) lr 1.00e-05 gnorm 0.217 2.84s mem 81.1GB +step 545/5000 loss 0.3663 (w 0.5311 mse 0.5447 t 200 new 0.24) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +step 546/5000 loss 0.3335 (w 0.3335 mse 0.3340 t 870 new 0.23) lr 1.00e-05 gnorm 0.562 3.31s mem 81.1GB +step 547/5000 loss 0.3721 (w 0.3705 mse 0.3668 t 911 new 0.20) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +step 548/5000 loss 0.2617 (w 0.3824 mse 0.3751 t 782 new 0.22) lr 1.00e-05 gnorm 0.172 3.27s mem 81.1GB +step 549/5000 loss 0.1799 (w 0.3402 mse 0.3370 t 886 new 0.19) lr 1.00e-05 gnorm 0.127 2.82s mem 81.1GB +step 550/5000 loss 0.2605 (w 0.3785 mse 0.3859 t 861 new 0.21) lr 1.00e-05 gnorm 0.152 2.82s mem 81.1GB +step 551/5000 loss 0.2391 (w 0.3895 mse 0.3866 t 914 new 0.19) lr 1.00e-05 gnorm 0.267 3.14s mem 81.1GB +step 552/5000 loss 0.3397 (w 0.4054 mse 0.4028 t 987 new 0.25) lr 1.00e-05 gnorm 0.135 3.27s mem 81.1GB +step 553/5000 loss 0.5272 (w 0.6061 mse 0.6083 t 165 new 0.12) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +step 554/5000 loss 0.3311 (w 0.4313 mse 0.4356 t 935 new 0.21) lr 1.00e-05 gnorm 0.152 3.10s mem 81.1GB +step 555/5000 loss 0.2683 (w 0.2967 mse 0.2982 t 932 new 0.02) lr 1.00e-05 gnorm 0.147 2.83s mem 81.1GB +step 556/5000 loss 0.2828 (w 0.3268 mse 0.3359 t 962 new 0.10) lr 1.00e-05 gnorm 0.870 2.84s mem 81.1GB +step 557/5000 loss 0.4745 (w 0.6022 mse 0.6087 t 244 new 0.21) lr 1.00e-05 gnorm 0.182 3.40s mem 81.1GB +step 558/5000 loss 0.2896 (w 0.2929 mse 0.3071 t 976 new 0.16) lr 1.00e-05 gnorm 0.135 3.05s mem 81.1GB +step 559/5000 loss 0.3203 (w 0.2797 mse 0.2947 t 913 new 0.18) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +step 560/5000 loss 0.1369 (w 0.3328 mse 0.3375 t 973 new 0.17) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +step 561/5000 loss 0.5064 (w 0.5006 mse 0.4929 t 217 new 0.21) lr 1.00e-05 gnorm 0.149 2.82s mem 81.1GB +step 562/5000 loss 0.2441 (w 0.2423 mse 0.2614 t 562 new 0.15) lr 1.00e-05 gnorm 0.115 3.06s mem 81.1GB +step 563/5000 loss 0.4567 (w 0.1908 mse 0.2032 t 865 new 0.16) lr 1.00e-05 gnorm 0.478 3.29s mem 81.1GB +step 564/5000 loss 0.3047 (w 0.2814 mse 0.2841 t 821 new 0.23) lr 1.00e-05 gnorm 0.176 3.09s mem 81.1GB +step 565/5000 loss 0.2253 (w 0.3966 mse 0.4071 t 411 new 0.22) lr 1.00e-05 gnorm 0.118 3.04s mem 81.1GB +step 566/5000 loss 0.3441 (w 0.4102 mse 0.4034 t 956 new 0.24) lr 1.00e-05 gnorm 0.337 3.12s mem 81.1GB +step 567/5000 loss 0.4149 (w 0.3267 mse 0.3239 t 790 new 0.25) lr 1.00e-05 gnorm 0.177 2.84s mem 81.1GB +step 568/5000 loss 0.2375 (w 0.3354 mse 0.3470 t 937 new 0.16) lr 1.00e-05 gnorm 0.215 3.07s mem 81.1GB +step 569/5000 loss 0.4068 (w 0.2394 mse 0.2471 t 669 new 0.15) lr 1.00e-05 gnorm 0.151 3.33s mem 81.1GB +step 570/5000 loss 0.1686 (w 0.3463 mse 0.3542 t 961 new 0.22) lr 1.00e-05 gnorm 0.414 3.10s mem 81.1GB +step 571/5000 loss 0.1513 (w 0.1939 mse 0.2004 t 858 new 0.18) lr 1.00e-05 gnorm 0.142 3.04s mem 81.1GB +step 572/5000 loss 0.2716 (w 0.3746 mse 0.3881 t 624 new 0.29) lr 1.00e-05 gnorm 0.294 3.11s mem 81.1GB +step 573/5000 loss 0.4208 (w 0.4097 mse 0.4055 t 960 new 0.15) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +step 574/5000 loss 0.4515 (w 0.2917 mse 0.2908 t 582 new 0.18) lr 1.00e-05 gnorm 0.178 3.16s mem 81.1GB +step 575/5000 loss 0.2613 (w 0.3333 mse 0.3445 t 985 new 0.17) lr 1.00e-05 gnorm 0.247 3.01s mem 81.1GB +step 576/5000 loss 0.3673 (w 0.3364 mse 0.3450 t 704 new 0.23) lr 1.00e-05 gnorm 0.204 3.09s mem 81.1GB +step 577/5000 loss 0.4185 (w 0.3119 mse 0.3321 t 972 new 0.19) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +step 578/5000 loss 0.3468 (w 0.2762 mse 0.2827 t 799 new 0.17) lr 1.00e-05 gnorm 0.184 3.07s mem 81.1GB +step 579/5000 loss 0.2713 (w 0.2997 mse 0.3134 t 982 new 0.13) lr 1.00e-05 gnorm 0.179 2.83s mem 81.1GB +step 580/5000 loss 0.3819 (w 0.2968 mse 0.3146 t 623 new 0.22) lr 1.00e-05 gnorm 0.153 3.10s mem 81.1GB +step 581/5000 loss 0.4465 (w 0.2675 mse 0.2782 t 880 new 0.25) lr 1.00e-05 gnorm 0.202 3.30s mem 81.1GB +step 582/5000 loss 0.2512 (w 0.4275 mse 0.4233 t 990 new 0.19) lr 1.00e-05 gnorm 0.176 3.05s mem 81.1GB +step 583/5000 loss 0.1895 (w 0.3901 mse 0.3969 t 971 new 0.21) lr 1.00e-05 gnorm 0.138 3.30s mem 81.1GB +step 584/5000 loss 0.2100 (w 0.3224 mse 0.3447 t 992 new 0.24) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +step 585/5000 loss 0.4961 (w 0.2045 mse 0.2162 t 929 new 0.20) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +step 586/5000 loss 0.2843 (w 0.4339 mse 0.4547 t 985 new 0.17) lr 1.00e-05 gnorm 0.208 3.12s mem 81.1GB +step 587/5000 loss 0.2827 (w 0.4154 mse 0.3941 t 998 new 0.21) lr 1.00e-05 gnorm 0.162 3.05s mem 81.1GB +step 588/5000 loss 0.2202 (w 0.5089 mse 0.5029 t 994 new 0.12) lr 1.00e-05 gnorm 0.211 3.07s mem 81.1GB +step 589/5000 loss 0.3127 (w 0.3262 mse 0.3376 t 907 new 0.21) lr 1.00e-05 gnorm 0.272 3.27s mem 81.1GB +step 590/5000 loss 0.4353 (w 0.2361 mse 0.2645 t 947 new 0.24) lr 1.00e-05 gnorm 0.223 2.82s mem 81.1GB +step 591/5000 loss 0.5709 (w 0.2126 mse 0.2313 t 773 new 0.24) lr 1.00e-05 gnorm 0.366 2.83s mem 81.1GB +step 592/5000 loss 0.2163 (w 0.3027 mse 0.3122 t 921 new 0.15) lr 1.00e-05 gnorm 0.152 3.34s mem 81.1GB +step 593/5000 loss 0.2804 (w 0.3743 mse 0.3799 t 963 new 0.19) lr 1.00e-05 gnorm 0.249 3.01s mem 81.1GB +step 594/5000 loss 0.2735 (w 0.3495 mse 0.3633 t 940 new 0.26) lr 1.00e-05 gnorm 1.773 2.83s mem 81.1GB +step 595/5000 loss 0.3979 (w 0.2582 mse 0.2616 t 866 new 0.18) lr 1.00e-05 gnorm 0.278 3.31s mem 81.1GB +step 596/5000 loss 0.1832 (w 0.2700 mse 0.2869 t 918 new 0.27) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +step 597/5000 loss 0.2710 (w 0.2761 mse 0.2868 t 863 new 0.21) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +step 598/5000 loss 0.2873 (w 0.3736 mse 0.3817 t 968 new 0.26) lr 1.00e-05 gnorm 0.221 3.41s mem 81.1GB +step 599/5000 loss 0.3048 (w 0.3986 mse 0.4060 t 963 new 0.22) lr 1.00e-05 gnorm 0.185 3.22s mem 81.1GB +step 600/5000 loss 0.4407 (w 0.2435 mse 0.2552 t 467 new 0.19) lr 1.00e-05 gnorm 0.149 3.03s mem 81.1GB +step 601/5000 loss 0.2546 (w 0.3267 mse 0.3307 t 995 new 0.25) lr 1.00e-05 gnorm 0.142 3.11s mem 81.1GB +step 602/5000 loss 0.3232 (w 0.2452 mse 0.2630 t 838 new 0.20) lr 1.00e-05 gnorm 0.202 2.82s mem 81.1GB +step 603/5000 loss 0.2076 (w 0.2068 mse 0.2250 t 969 new 0.13) lr 1.00e-05 gnorm 0.187 3.13s mem 81.1GB +step 604/5000 loss 0.3332 (w 0.3042 mse 0.3109 t 912 new 0.21) lr 1.00e-05 gnorm 0.242 3.29s mem 81.1GB +step 605/5000 loss 0.1700 (w 0.3971 mse 0.3862 t 977 new 0.14) lr 1.00e-05 gnorm 0.206 3.29s mem 81.1GB +step 606/5000 loss 0.3902 (w 0.3404 mse 0.3441 t 956 new 0.16) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +step 607/5000 loss 0.2412 (w 0.2812 mse 0.2852 t 839 new 0.25) lr 1.00e-05 gnorm 0.157 3.10s mem 81.1GB +step 608/5000 loss 0.3998 (w 0.3645 mse 0.3612 t 797 new 0.20) lr 1.00e-05 gnorm 0.197 2.82s mem 81.1GB +step 609/5000 loss 0.5544 (w 0.4083 mse 0.4133 t 979 new 0.21) lr 1.00e-05 gnorm 0.230 3.07s mem 81.1GB +step 610/5000 loss 0.4324 (w 0.6265 mse 0.6593 t 127 new 0.23) lr 1.00e-05 gnorm 0.148 3.36s mem 81.1GB +step 611/5000 loss 0.1745 (w 0.3642 mse 0.3662 t 987 new 0.24) lr 1.00e-05 gnorm 0.140 3.03s mem 81.1GB +step 612/5000 loss 0.3757 (w 0.3226 mse 0.3254 t 982 new 0.20) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +step 613/5000 loss 0.2515 (w 0.3303 mse 0.3382 t 557 new 0.24) lr 1.00e-05 gnorm 0.321 3.07s mem 81.1GB +step 614/5000 loss 0.3420 (w 0.3491 mse 0.3690 t 421 new 0.22) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 615/5000 loss 0.3348 (w 0.2505 mse 0.2636 t 913 new 0.12) lr 1.00e-05 gnorm 0.184 3.18s mem 81.1GB +step 616/5000 loss 0.3108 (w 0.2716 mse 0.2806 t 839 new 0.16) lr 1.00e-05 gnorm 0.152 3.28s mem 81.1GB +step 617/5000 loss 0.2592 (w 0.3287 mse 0.3418 t 937 new 0.26) lr 1.00e-05 gnorm 0.188 3.03s mem 81.1GB +step 618/5000 loss 0.2590 (w 0.4138 mse 0.4251 t 994 new 0.13) lr 1.00e-05 gnorm 0.337 3.10s mem 81.1GB +step 619/5000 loss 0.2807 (w 0.3392 mse 0.3465 t 822 new 0.18) lr 1.00e-05 gnorm 0.170 2.82s mem 81.1GB +step 620/5000 loss 0.3921 (w 0.3066 mse 0.3151 t 832 new 0.12) lr 1.00e-05 gnorm 0.476 2.82s mem 81.1GB +step 621/5000 loss 0.5368 (w 0.3093 mse 0.3202 t 692 new 0.22) lr 1.00e-05 gnorm 0.181 3.11s mem 81.1GB +step 622/5000 loss 0.2905 (w 0.2976 mse 0.3035 t 845 new 0.23) lr 1.00e-05 gnorm 0.149 3.05s mem 81.1GB +step 623/5000 loss 0.2179 (w 0.3148 mse 0.3158 t 938 new 0.12) lr 1.00e-05 gnorm 0.158 3.05s mem 81.1GB +step 624/5000 loss 0.2797 (w 0.2826 mse 0.2870 t 939 new 0.21) lr 1.00e-05 gnorm 0.235 3.33s mem 81.1GB +step 625/5000 loss 0.3390 (w 0.3363 mse 0.3536 t 348 new 0.20) lr 1.00e-05 gnorm 0.198 2.82s mem 81.1GB +step 626/5000 loss 0.2153 (w 0.1577 mse 0.1695 t 675 new 0.12) lr 1.00e-05 gnorm 0.202 2.82s mem 81.1GB +step 627/5000 loss 0.1754 (w 0.3279 mse 0.3308 t 952 new 0.12) lr 1.00e-05 gnorm 0.155 3.45s mem 81.1GB +step 628/5000 loss 0.1098 (w 0.3878 mse 0.3818 t 969 new 0.21) lr 1.00e-05 gnorm 0.147 3.27s mem 81.1GB +step 629/5000 loss 0.1953 (w 0.1698 mse 0.1862 t 945 new 0.10) lr 1.00e-05 gnorm 0.163 2.83s mem 81.1GB +step 630/5000 loss 0.1961 (w 0.3472 mse 0.3658 t 980 new 0.20) lr 1.00e-05 gnorm 1.292 3.26s mem 81.1GB +step 631/5000 loss 0.4186 (w 0.2830 mse 0.2943 t 939 new 0.18) lr 1.00e-05 gnorm 0.201 2.83s mem 81.1GB +step 632/5000 loss 0.3687 (w 0.4455 mse 0.4558 t 992 new 0.23) lr 1.00e-05 gnorm 0.153 2.85s mem 81.1GB +step 633/5000 loss 0.2823 (w 0.2444 mse 0.2629 t 853 new 0.15) lr 1.00e-05 gnorm 0.340 3.39s mem 81.1GB +step 634/5000 loss 0.2817 (w 0.3570 mse 0.3739 t 980 new 0.26) lr 1.00e-05 gnorm 0.170 3.03s mem 81.1GB +step 635/5000 loss 0.1763 (w 0.3172 mse 0.3112 t 935 new 0.15) lr 1.00e-05 gnorm 0.221 2.82s mem 81.1GB +step 636/5000 loss 0.4460 (w 0.7383 mse 0.7328 t 100 new 0.20) lr 1.00e-05 gnorm 0.204 3.59s mem 81.1GB +step 637/5000 loss 0.4792 (w 0.4044 mse 0.4053 t 695 new 0.27) lr 1.00e-05 gnorm 0.199 2.83s mem 81.1GB +step 638/5000 loss 0.3902 (w 0.2455 mse 0.2557 t 516 new 0.18) lr 1.00e-05 gnorm 0.154 2.82s mem 81.1GB +step 639/5000 loss 0.4961 (w 0.3463 mse 0.3508 t 623 new 0.16) lr 1.00e-05 gnorm 0.184 3.39s mem 81.1GB +step 640/5000 loss 0.1954 (w 0.3521 mse 0.3579 t 911 new 0.23) lr 1.00e-05 gnorm 0.244 3.05s mem 81.1GB +step 641/5000 loss 0.3078 (w 0.2781 mse 0.2873 t 636 new 0.17) lr 1.00e-05 gnorm 0.145 2.82s mem 81.1GB +step 642/5000 loss 0.1740 (w 0.2214 mse 0.2501 t 962 new 0.23) lr 1.00e-05 gnorm 0.129 3.09s mem 81.1GB +step 643/5000 loss 0.3373 (w 0.4788 mse 0.4862 t 259 new 0.08) lr 1.00e-05 gnorm 0.199 2.83s mem 81.1GB +step 644/5000 loss 0.4216 (w 0.3266 mse 0.3253 t 800 new 0.14) lr 1.00e-05 gnorm 0.132 3.07s mem 81.1GB +step 645/5000 loss 0.2639 (w 0.2062 mse 0.2130 t 972 new 0.21) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +step 646/5000 loss 0.2116 (w 0.2596 mse 0.2762 t 984 new 0.25) lr 1.00e-05 gnorm 0.188 3.11s mem 81.1GB +step 647/5000 loss 0.4085 (w 0.3450 mse 0.3581 t 444 new 0.21) lr 1.00e-05 gnorm 0.159 3.04s mem 81.1GB +step 648/5000 loss 0.2131 (w 0.4560 mse 0.4620 t 998 new 0.16) lr 1.00e-05 gnorm 0.175 3.11s mem 81.1GB +step 649/5000 loss 0.1834 (w 0.2645 mse 0.2661 t 901 new 0.19) lr 1.00e-05 gnorm 0.148 2.85s mem 81.1GB +step 650/5000 loss 0.2441 (w 0.1869 mse 0.1930 t 785 new 0.11) lr 1.00e-05 gnorm 0.162 3.09s mem 81.1GB +step 651/5000 loss 0.4092 (w 0.2988 mse 0.3017 t 598 new 0.08) lr 1.00e-05 gnorm 0.192 3.42s mem 81.1GB +step 652/5000 loss 0.3895 (w 0.2036 mse 0.2154 t 776 new 0.25) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +step 653/5000 loss 0.4439 (w 0.3263 mse 0.3199 t 921 new 0.14) lr 1.00e-05 gnorm 0.200 3.04s mem 81.1GB +step 654/5000 loss 0.2767 (w 0.2286 mse 0.2479 t 945 new 0.23) lr 1.00e-05 gnorm 0.306 3.15s mem 81.1GB +step 655/5000 loss 0.2069 (w 0.4160 mse 0.4206 t 974 new 0.21) lr 1.00e-05 gnorm 0.119 2.82s mem 81.1GB +step 656/5000 loss 0.2828 (w 0.4817 mse 0.4992 t 978 new 0.19) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +step 657/5000 loss 0.4149 (w 0.1981 mse 0.2206 t 700 new 0.20) lr 1.00e-05 gnorm 0.164 3.35s mem 81.1GB +step 658/5000 loss 0.4045 (w 0.3419 mse 0.3408 t 972 new 0.10) lr 1.00e-05 gnorm 0.153 3.14s mem 81.1GB +step 659/5000 loss 0.2076 (w 0.4793 mse 0.4581 t 990 new 0.20) lr 1.00e-05 gnorm 0.158 3.03s mem 81.1GB +step 660/5000 loss 0.2215 (w 0.3865 mse 0.3940 t 989 new 0.24) lr 1.00e-05 gnorm 0.170 3.10s mem 81.1GB +step 661/5000 loss 0.2771 (w 0.2432 mse 0.2537 t 881 new 0.22) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +step 662/5000 loss 0.2928 (w 0.2993 mse 0.3042 t 921 new 0.26) lr 1.00e-05 gnorm 0.386 3.14s mem 81.1GB +step 663/5000 loss 0.3131 (w 0.2911 mse 0.2928 t 920 new 0.25) lr 1.00e-05 gnorm 0.168 3.07s mem 81.1GB +step 664/5000 loss 0.3446 (w 0.3133 mse 0.3143 t 911 new 0.23) lr 1.00e-05 gnorm 0.163 3.07s mem 81.1GB +step 665/5000 loss 0.2306 (w 0.4085 mse 0.4173 t 967 new 0.23) lr 1.00e-05 gnorm 0.130 3.07s mem 81.1GB +step 666/5000 loss 0.3968 (w 0.4429 mse 0.4597 t 372 new 0.20) lr 1.00e-05 gnorm 0.185 2.83s mem 81.1GB +step 667/5000 loss 0.3668 (w 0.2261 mse 0.2547 t 767 new 0.26) lr 1.00e-05 gnorm 0.164 2.85s mem 81.1GB +step 668/5000 loss 0.2180 (w 0.3368 mse 0.3286 t 728 new 0.17) lr 1.00e-05 gnorm 0.200 3.45s mem 81.1GB +step 669/5000 loss 0.4734 (w 0.3042 mse 0.3238 t 954 new 0.23) lr 1.00e-05 gnorm 0.218 3.10s mem 81.1GB +step 670/5000 loss 0.2663 (w 0.2480 mse 0.2565 t 954 new 0.25) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +step 671/5000 loss 0.2394 (w 0.3619 mse 0.3576 t 994 new 0.25) lr 1.00e-05 gnorm 0.130 3.11s mem 81.1GB +step 672/5000 loss 0.3696 (w 0.2899 mse 0.2905 t 852 new 0.26) lr 1.00e-05 gnorm 0.243 2.83s mem 81.1GB +step 673/5000 loss 0.2550 (w 0.2600 mse 0.2820 t 815 new 0.24) lr 1.00e-05 gnorm 0.750 2.83s mem 81.1GB +step 674/5000 loss 0.1285 (w 0.3616 mse 0.3647 t 999 new 0.23) lr 1.00e-05 gnorm 0.163 3.62s mem 81.1GB +step 675/5000 loss 0.2274 (w 0.2726 mse 0.2861 t 934 new 0.23) lr 1.00e-05 gnorm 0.131 3.03s mem 81.1GB +step 676/5000 loss 0.2861 (w 0.2167 mse 0.2266 t 875 new 0.13) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +step 677/5000 loss 0.2464 (w 0.2708 mse 0.2896 t 865 new 0.25) lr 1.00e-05 gnorm 0.127 3.13s mem 81.1GB +step 678/5000 loss 0.2792 (w 0.3661 mse 0.3733 t 896 new 0.21) lr 1.00e-05 gnorm 0.209 2.84s mem 81.1GB +step 679/5000 loss 0.2993 (w 0.4225 mse 0.4212 t 980 new 0.22) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +step 680/5000 loss 0.3061 (w 0.2727 mse 0.2824 t 915 new 0.20) lr 1.00e-05 gnorm 0.133 3.35s mem 81.1GB +step 681/5000 loss 0.3423 (w 0.3319 mse 0.3417 t 692 new 0.23) lr 1.00e-05 gnorm 0.201 3.03s mem 81.1GB +step 682/5000 loss 0.2861 (w 0.5016 mse 0.5046 t 228 new 0.16) lr 1.00e-05 gnorm 0.140 3.12s mem 81.1GB +step 683/5000 loss 0.2583 (w 0.2391 mse 0.2533 t 993 new 0.15) lr 1.00e-05 gnorm 0.172 3.14s mem 81.1GB +step 684/5000 loss 0.3988 (w 0.2829 mse 0.2921 t 779 new 0.21) lr 1.00e-05 gnorm 0.194 2.82s mem 81.1GB +step 685/5000 loss 0.1860 (w 0.3143 mse 0.3230 t 555 new 0.22) lr 1.00e-05 gnorm 0.166 2.83s mem 81.1GB +step 686/5000 loss 0.4262 (w 0.2441 mse 0.2435 t 970 new 0.26) lr 1.00e-05 gnorm 0.164 3.37s mem 81.1GB +step 687/5000 loss 0.3811 (w 0.9218 mse 0.8794 t 990 new 0.19) lr 1.00e-05 gnorm 0.149 3.04s mem 81.1GB +step 688/5000 loss 0.3423 (w 0.3572 mse 0.3527 t 878 new 0.22) lr 1.00e-05 gnorm 0.153 3.06s mem 81.1GB +step 689/5000 loss 0.4231 (w 0.4456 mse 0.4458 t 383 new 0.19) lr 1.00e-05 gnorm 0.203 3.08s mem 81.1GB +step 690/5000 loss 0.4377 (w 0.3073 mse 0.3074 t 854 new 0.16) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +step 691/5000 loss 0.2743 (w 0.5094 mse 0.5456 t 159 new 0.17) lr 1.00e-05 gnorm 0.216 3.14s mem 81.1GB +step 692/5000 loss 0.1697 (w 0.2871 mse 0.2962 t 903 new 0.24) lr 1.00e-05 gnorm 0.144 3.12s mem 81.1GB +step 693/5000 loss 0.2905 (w 0.3710 mse 0.3644 t 969 new 0.23) lr 1.00e-05 gnorm 0.210 3.09s mem 81.1GB +step 694/5000 loss 0.3346 (w 0.2334 mse 0.2381 t 734 new 0.14) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +step 695/5000 loss 0.2284 (w 0.2646 mse 0.2834 t 639 new 0.22) lr 1.00e-05 gnorm 0.198 3.08s mem 81.1GB +step 696/5000 loss 0.2491 (w 0.2154 mse 0.2329 t 768 new 0.17) lr 1.00e-05 gnorm 0.344 2.82s mem 81.1GB +step 697/5000 loss 0.3153 (w 0.2700 mse 0.2830 t 834 new 0.26) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +step 698/5000 loss 0.2347 (w 0.2661 mse 0.2947 t 970 new 0.23) lr 1.00e-05 gnorm 0.154 3.11s mem 81.1GB +step 699/5000 loss 0.2677 (w 0.1951 mse 0.2091 t 748 new 0.20) lr 1.00e-05 gnorm 0.112 3.09s mem 81.1GB +step 700/5000 loss 0.2075 (w 0.2897 mse 0.3027 t 982 new 0.12) lr 1.00e-05 gnorm 0.125 3.35s mem 81.1GB +step 701/5000 loss 0.4390 (w 0.3639 mse 0.4015 t 292 new 0.20) lr 1.00e-05 gnorm 0.182 2.83s mem 81.1GB +step 702/5000 loss 0.1821 (w 0.3056 mse 0.3187 t 934 new 0.10) lr 1.00e-05 gnorm 0.117 3.36s mem 81.1GB +step 703/5000 loss 0.4637 (w 0.2157 mse 0.2307 t 603 new 0.17) lr 1.00e-05 gnorm 0.203 3.30s mem 81.1GB +step 704/5000 loss 0.3691 (w 0.2325 mse 0.2541 t 599 new 0.24) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +step 705/5000 loss 0.4749 (w 0.2959 mse 0.3127 t 467 new 0.24) lr 1.00e-05 gnorm 0.133 3.10s mem 81.1GB +step 706/5000 loss 0.4106 (w 0.2834 mse 0.2809 t 695 new 0.18) lr 1.00e-05 gnorm 0.226 3.31s mem 81.1GB +step 707/5000 loss 0.3171 (w 0.5479 mse 0.5409 t 991 new 0.14) lr 1.00e-05 gnorm 0.103 2.83s mem 81.1GB +step 708/5000 loss 0.2522 (w 0.2826 mse 0.3024 t 961 new 0.19) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +step 709/5000 loss 0.2020 (w 0.2566 mse 0.2529 t 881 new 0.08) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +step 710/5000 loss 0.3216 (w 0.2675 mse 0.2937 t 980 new 0.18) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +step 711/5000 loss 0.3887 (w 0.4353 mse 0.4430 t 301 new 0.21) lr 1.00e-05 gnorm 0.213 3.10s mem 81.1GB +step 712/5000 loss 0.2143 (w 0.4415 mse 0.4501 t 1000 new 0.13) lr 1.00e-05 gnorm 0.108 3.28s mem 81.1GB +step 713/5000 loss 0.2965 (w 0.2628 mse 0.2694 t 913 new 0.10) lr 1.00e-05 gnorm 0.136 2.82s mem 81.1GB +step 714/5000 loss 0.3830 (w 0.2083 mse 0.2204 t 790 new 0.26) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +step 715/5000 loss 0.2530 (w 0.3754 mse 0.3912 t 1000 new 0.19) lr 1.00e-05 gnorm 1.752 3.39s mem 81.1GB +step 716/5000 loss 0.3794 (w 0.2798 mse 0.2841 t 888 new 0.23) lr 1.00e-05 gnorm 0.182 2.83s mem 81.1GB +step 717/5000 loss 0.3194 (w 0.8060 mse 0.8023 t 120 new 0.23) lr 1.00e-05 gnorm 0.142 3.04s mem 81.1GB +step 718/5000 loss 0.2687 (w 0.3340 mse 0.3489 t 956 new 0.21) lr 1.00e-05 gnorm 0.592 3.10s mem 81.1GB +step 719/5000 loss 0.2445 (w 0.2934 mse 0.2928 t 969 new 0.13) lr 1.00e-05 gnorm 0.122 2.82s mem 81.1GB +step 720/5000 loss 0.2963 (w 0.1739 mse 0.1971 t 932 new 0.18) lr 1.00e-05 gnorm 0.133 2.83s mem 81.1GB +step 721/5000 loss 0.2040 (w 0.6620 mse 0.6563 t 146 new 0.17) lr 1.00e-05 gnorm 0.136 3.34s mem 81.1GB +step 722/5000 loss 0.3764 (w 0.4586 mse 0.4471 t 998 new 0.24) lr 1.00e-05 gnorm 0.156 2.83s mem 81.1GB +step 723/5000 loss 0.2639 (w 0.2666 mse 0.2716 t 770 new 0.23) lr 1.00e-05 gnorm 0.170 3.08s mem 81.1GB +step 724/5000 loss 0.1920 (w 0.3114 mse 0.3216 t 959 new 0.23) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +step 725/5000 loss 0.3440 (w 0.3718 mse 0.3816 t 568 new 0.17) lr 1.00e-05 gnorm 0.118 2.83s mem 81.1GB +step 726/5000 loss 0.2749 (w 0.3228 mse 0.3270 t 924 new 0.20) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +step 727/5000 loss 0.4246 (w 0.2564 mse 0.2633 t 932 new 0.16) lr 1.00e-05 gnorm 0.254 3.32s mem 81.1GB +step 728/5000 loss 0.2454 (w 0.2895 mse 0.3013 t 530 new 0.13) lr 1.00e-05 gnorm 0.137 3.02s mem 81.1GB +step 729/5000 loss 0.2384 (w 0.2725 mse 0.2759 t 909 new 0.15) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +step 730/5000 loss 0.4165 (w 0.1723 mse 0.1866 t 560 new 0.17) lr 1.00e-05 gnorm 0.218 3.08s mem 81.1GB +step 731/5000 loss 0.2183 (w 0.2626 mse 0.2749 t 737 new 0.23) lr 1.00e-05 gnorm 0.339 2.83s mem 81.1GB +step 732/5000 loss 0.3536 (w 0.8572 mse 0.8871 t 994 new 0.21) lr 1.00e-05 gnorm 0.199 2.82s mem 81.1GB +step 733/5000 loss 0.3567 (w 0.3573 mse 0.3693 t 465 new 0.26) lr 1.00e-05 gnorm 0.346 3.47s mem 81.1GB +step 734/5000 loss 0.1201 (w 0.3131 mse 0.3421 t 982 new 0.23) lr 1.00e-05 gnorm 0.172 3.03s mem 81.1GB +step 735/5000 loss 0.2852 (w 0.2309 mse 0.2395 t 786 new 0.23) lr 1.00e-05 gnorm 0.369 2.81s mem 81.1GB +step 736/5000 loss 0.3988 (w 0.3732 mse 0.3751 t 979 new 0.25) lr 1.00e-05 gnorm 0.178 3.08s mem 81.1GB +step 737/5000 loss 0.4329 (w 0.3923 mse 0.4038 t 506 new 0.25) lr 1.00e-05 gnorm 0.144 2.81s mem 81.1GB +step 738/5000 loss 0.4810 (w 0.3316 mse 0.3396 t 683 new 0.19) lr 1.00e-05 gnorm 0.268 3.08s mem 81.1GB +step 739/5000 loss 0.3036 (w 0.2800 mse 0.2948 t 681 new 0.24) lr 1.00e-05 gnorm 0.158 3.46s mem 81.1GB +step 740/5000 loss 0.4017 (w 0.2436 mse 0.2540 t 817 new 0.19) lr 1.00e-05 gnorm 0.124 3.04s mem 81.1GB +step 741/5000 loss 0.2959 (w 0.1760 mse 0.1866 t 852 new 0.08) lr 1.00e-05 gnorm 0.241 3.01s mem 81.1GB +step 742/5000 loss 0.2830 (w 0.3082 mse 0.3152 t 677 new 0.22) lr 1.00e-05 gnorm 0.205 3.04s mem 81.1GB +step 743/5000 loss 0.2684 (w 0.3590 mse 0.3712 t 974 new 0.23) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +step 744/5000 loss 0.3675 (w 0.3347 mse 0.3329 t 974 new 0.21) lr 1.00e-05 gnorm 0.196 3.09s mem 81.1GB +step 745/5000 loss 0.2986 (w 0.2771 mse 0.2792 t 930 new 0.19) lr 1.00e-05 gnorm 0.184 3.48s mem 81.1GB +step 746/5000 loss 0.3359 (w 0.3455 mse 0.3387 t 883 new 0.23) lr 1.00e-05 gnorm 0.326 3.09s mem 81.1GB +step 747/5000 loss 0.4005 (w 0.3336 mse 0.3465 t 684 new 0.28) lr 1.00e-05 gnorm 0.251 3.02s mem 81.1GB +step 748/5000 loss 0.4386 (w 0.3500 mse 0.3587 t 945 new 0.16) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +step 749/5000 loss 0.3959 (w 0.2586 mse 0.2715 t 645 new 0.24) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +step 750/5000 loss 0.3273 (w 0.2400 mse 0.2525 t 904 new 0.25) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +step 751/5000 loss 0.3220 (w 0.3674 mse 0.3694 t 979 new 0.24) lr 1.00e-05 gnorm 0.256 3.42s mem 81.1GB +step 752/5000 loss 0.4784 (w 0.2105 mse 0.2220 t 718 new 0.21) lr 1.00e-05 gnorm 0.209 3.06s mem 81.1GB +step 753/5000 loss 0.3460 (w 0.2461 mse 0.2537 t 528 new 0.15) lr 1.00e-05 gnorm 0.307 3.10s mem 81.1GB +step 754/5000 loss 0.3319 (w 0.3062 mse 0.3078 t 609 new 0.16) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +step 755/5000 loss 0.2017 (w 0.2185 mse 0.2267 t 754 new 0.22) lr 1.00e-05 gnorm 0.157 2.84s mem 81.1GB +step 756/5000 loss 0.2449 (w 0.3575 mse 0.3709 t 977 new 0.10) lr 1.00e-05 gnorm 0.129 3.16s mem 81.1GB +step 757/5000 loss 0.3186 (w 0.3276 mse 0.3364 t 428 new 0.16) lr 1.00e-05 gnorm 0.253 3.42s mem 81.1GB +step 758/5000 loss 0.3761 (w 0.3102 mse 0.3188 t 808 new 0.16) lr 1.00e-05 gnorm 0.212 3.08s mem 81.1GB +step 759/5000 loss 0.2351 (w 0.2824 mse 0.2901 t 779 new 0.25) lr 1.00e-05 gnorm 0.194 3.06s mem 81.1GB +step 760/5000 loss 0.2930 (w 0.2079 mse 0.2246 t 762 new 0.17) lr 1.00e-05 gnorm 0.167 2.82s mem 81.1GB +step 761/5000 loss 0.1744 (w 0.3136 mse 0.3107 t 947 new 0.19) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +step 762/5000 loss 0.3119 (w 0.3137 mse 0.3253 t 951 new 0.20) lr 1.00e-05 gnorm 0.172 3.11s mem 81.1GB +step 763/5000 loss 0.2803 (w 0.3103 mse 0.3269 t 842 new 0.22) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +step 764/5000 loss 0.2307 (w 0.2394 mse 0.2510 t 784 new 0.21) lr 1.00e-05 gnorm 0.198 3.14s mem 81.1GB +step 765/5000 loss 0.2286 (w 0.3124 mse 0.3202 t 974 new 0.24) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +step 766/5000 loss 0.3227 (w 0.3157 mse 0.3187 t 973 new 0.10) lr 1.00e-05 gnorm 0.286 2.83s mem 81.1GB +step 767/5000 loss 0.2935 (w 0.3502 mse 0.3600 t 947 new 0.21) lr 1.00e-05 gnorm 0.175 2.83s mem 81.1GB +step 768/5000 loss 0.2658 (w 0.5745 mse 0.6024 t 200 new 0.21) lr 1.00e-05 gnorm 0.157 3.28s mem 81.1GB +step 769/5000 loss 0.2310 (w 0.3146 mse 0.3157 t 984 new 0.18) lr 1.00e-05 gnorm 0.195 3.13s mem 81.1GB +step 770/5000 loss 0.4614 (w 0.2662 mse 0.2867 t 394 new 0.22) lr 1.00e-05 gnorm 0.250 2.82s mem 81.1GB +step 771/5000 loss 0.2063 (w 0.3168 mse 0.3183 t 948 new 0.17) lr 1.00e-05 gnorm 0.103 3.34s mem 81.1GB +step 772/5000 loss 0.2814 (w 0.2996 mse 0.3023 t 845 new 0.24) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +step 773/5000 loss 0.3256 (w 0.4667 mse 0.4699 t 348 new 0.23) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +step 774/5000 loss 0.4822 (w 0.3617 mse 0.3663 t 987 new 0.25) lr 1.00e-05 gnorm 0.342 3.36s mem 81.1GB +step 775/5000 loss 0.3210 (w 0.2880 mse 0.3015 t 773 new 0.19) lr 1.00e-05 gnorm 0.268 3.15s mem 81.1GB +step 776/5000 loss 0.2264 (w 0.3317 mse 0.3386 t 767 new 0.26) lr 1.00e-05 gnorm 0.147 3.13s mem 81.1GB +step 777/5000 loss 0.3542 (w 0.2088 mse 0.2313 t 832 new 0.24) lr 1.00e-05 gnorm 0.169 3.34s mem 81.1GB +step 778/5000 loss 0.4616 (w 0.2136 mse 0.2265 t 846 new 0.25) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +step 779/5000 loss 0.2935 (w 0.3182 mse 0.3172 t 827 new 0.16) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +step 780/5000 loss 0.2850 (w 0.2598 mse 0.2723 t 518 new 0.22) lr 1.00e-05 gnorm 0.124 3.45s mem 81.1GB +step 781/5000 loss 0.2625 (w 0.1991 mse 0.2241 t 941 new 0.17) lr 1.00e-05 gnorm 0.156 3.12s mem 81.1GB +step 782/5000 loss 0.3021 (w 0.4110 mse 0.4226 t 465 new 0.18) lr 1.00e-05 gnorm 0.162 3.05s mem 81.1GB +step 783/5000 loss 0.1695 (w 0.4050 mse 0.4139 t 979 new 0.08) lr 1.00e-05 gnorm 0.128 3.10s mem 81.1GB +step 784/5000 loss 0.2532 (w 0.4676 mse 0.4612 t 989 new 0.19) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +step 785/5000 loss 0.3731 (w 0.2945 mse 0.2914 t 712 new 0.21) lr 1.00e-05 gnorm 0.246 3.10s mem 81.1GB +step 786/5000 loss 0.2279 (w 0.3467 mse 0.3463 t 954 new 0.21) lr 1.00e-05 gnorm 0.223 3.18s mem 81.1GB +step 787/5000 loss 0.2497 (w 0.2834 mse 0.2920 t 983 new 0.08) lr 1.00e-05 gnorm 0.251 3.41s mem 81.1GB +step 788/5000 loss 0.3575 (w 0.4384 mse 0.4480 t 962 new 0.19) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +step 789/5000 loss 0.3706 (w 0.2302 mse 0.2408 t 928 new 0.18) lr 1.00e-05 gnorm 0.154 3.35s mem 81.1GB +step 790/5000 loss 0.4335 (w 0.3747 mse 0.3748 t 453 new 0.15) lr 1.00e-05 gnorm 0.213 2.82s mem 81.1GB +step 791/5000 loss 0.1562 (w 0.2802 mse 0.2826 t 974 new 0.19) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +step 792/5000 loss 0.2939 (w 0.3193 mse 0.3223 t 828 new 0.19) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +step 793/5000 loss 0.2122 (w 0.4085 mse 0.4114 t 996 new 0.23) lr 1.00e-05 gnorm 0.231 3.43s mem 81.1GB +step 794/5000 loss 0.1920 (w 0.2544 mse 0.2715 t 929 new 0.22) lr 1.00e-05 gnorm 0.170 3.06s mem 81.1GB +step 795/5000 loss 0.1101 (w 0.3028 mse 0.3118 t 991 new 0.25) lr 1.00e-05 gnorm 0.121 3.06s mem 81.1GB +step 796/5000 loss 0.5763 (w 0.3921 mse 0.3971 t 453 new 0.20) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +step 797/5000 loss 0.3611 (w 0.2807 mse 0.3018 t 808 new 0.16) lr 1.00e-05 gnorm 0.179 3.06s mem 81.1GB +step 798/5000 loss 0.2794 (w 0.2778 mse 0.2943 t 938 new 0.20) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +step 799/5000 loss 0.1545 (w 0.2948 mse 0.3046 t 979 new 0.10) lr 1.00e-05 gnorm 0.198 3.13s mem 81.1GB +step 800/5000 loss 0.1379 (w 0.2352 mse 0.2581 t 816 new 0.21) lr 1.00e-05 gnorm 0.123 3.35s mem 81.1GB +step 801/5000 loss 0.3087 (w 0.4857 mse 0.4809 t 976 new 0.24) lr 1.00e-05 gnorm 0.241 2.83s mem 81.1GB +step 802/5000 loss 0.2865 (w 0.2965 mse 0.2955 t 834 new 0.28) lr 1.00e-05 gnorm 0.204 2.82s mem 81.1GB +step 803/5000 loss 0.2984 (w 0.1640 mse 0.1897 t 832 new 0.18) lr 1.00e-05 gnorm 0.162 3.08s mem 81.1GB +step 804/5000 loss 0.2367 (w 0.1757 mse 0.1857 t 845 new 0.09) lr 1.00e-05 gnorm 0.209 3.09s mem 81.1GB +step 805/5000 loss 0.2622 (w 0.3346 mse 0.3385 t 835 new 0.22) lr 1.00e-05 gnorm 0.338 3.12s mem 81.1GB +step 806/5000 loss 0.1827 (w 0.2482 mse 0.2686 t 875 new 0.21) lr 1.00e-05 gnorm 0.125 3.26s mem 81.1GB +step 807/5000 loss 0.2862 (w 0.5011 mse 0.5050 t 998 new 0.19) lr 1.00e-05 gnorm 0.177 2.82s mem 81.1GB +step 808/5000 loss 0.2674 (w 0.3554 mse 0.3535 t 971 new 0.25) lr 1.00e-05 gnorm 0.165 2.82s mem 81.1GB +step 809/5000 loss 0.2441 (w 0.2605 mse 0.2682 t 901 new 0.24) lr 1.00e-05 gnorm 0.275 3.13s mem 81.1GB +step 810/5000 loss 0.1743 (w 0.2688 mse 0.2580 t 835 new 0.20) lr 1.00e-05 gnorm 0.168 3.04s mem 81.1GB +step 811/5000 loss 0.1381 (w 0.5636 mse 0.5550 t 991 new 0.19) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +step 812/5000 loss 0.4779 (w 0.3070 mse 0.3071 t 847 new 0.20) lr 1.00e-05 gnorm 0.137 3.32s mem 81.1GB +step 813/5000 loss 0.1788 (w 0.4604 mse 0.4449 t 982 new 0.23) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 814/5000 loss 0.2558 (w 0.2152 mse 0.2205 t 822 new 0.22) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +step 815/5000 loss 0.3712 (w 0.3279 mse 0.3342 t 549 new 0.20) lr 1.00e-05 gnorm 0.139 3.30s mem 81.1GB +step 816/5000 loss 0.4622 (w 0.3752 mse 0.3805 t 383 new 0.19) lr 1.00e-05 gnorm 0.116 3.02s mem 81.1GB +step 817/5000 loss 0.2082 (w 0.3329 mse 0.3325 t 956 new 0.23) lr 1.00e-05 gnorm 0.134 3.11s mem 81.1GB +step 818/5000 loss 0.4093 (w 0.2126 mse 0.2354 t 930 new 0.17) lr 1.00e-05 gnorm 0.193 3.08s mem 81.1GB +step 819/5000 loss 0.1717 (w 0.3515 mse 0.3544 t 998 new 0.23) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +step 820/5000 loss 0.1966 (w 0.3740 mse 0.3668 t 1000 new 0.13) lr 1.00e-05 gnorm 0.330 2.83s mem 81.1GB +step 821/5000 loss 0.2283 (w 0.2617 mse 0.2843 t 757 new 0.19) lr 1.00e-05 gnorm 0.138 3.14s mem 81.1GB +step 822/5000 loss 0.3158 (w 0.4697 mse 0.4725 t 984 new 0.28) lr 1.00e-05 gnorm 0.098 3.13s mem 81.1GB +step 823/5000 loss 0.2298 (w 0.5225 mse 0.5194 t 978 new 0.17) lr 1.00e-05 gnorm 0.096 3.01s mem 81.1GB +step 824/5000 loss 0.1794 (w 0.2810 mse 0.2846 t 872 new 0.21) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +step 825/5000 loss 0.5546 (w 0.3628 mse 0.3735 t 623 new 0.26) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +step 826/5000 loss 0.2016 (w 0.3094 mse 0.3167 t 952 new 0.24) lr 1.00e-05 gnorm 0.180 3.01s mem 81.1GB +step 827/5000 loss 0.4270 (w 0.3151 mse 0.3136 t 845 new 0.27) lr 1.00e-05 gnorm 0.151 3.12s mem 81.1GB +step 828/5000 loss 0.2680 (w 0.2827 mse 0.2868 t 922 new 0.13) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +step 829/5000 loss 0.1844 (w 0.3068 mse 0.3206 t 720 new 0.17) lr 1.00e-05 gnorm 0.150 3.04s mem 81.1GB +step 830/5000 loss 0.3812 (w 0.3631 mse 0.3713 t 923 new 0.15) lr 1.00e-05 gnorm 0.188 2.83s mem 81.1GB +step 831/5000 loss 0.3044 (w 0.3720 mse 0.3716 t 859 new 0.26) lr 1.00e-05 gnorm 0.191 2.83s mem 81.1GB +step 832/5000 loss 0.3164 (w 0.2737 mse 0.2738 t 729 new 0.22) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +step 833/5000 loss 0.5013 (w 0.3310 mse 0.3370 t 582 new 0.20) lr 1.00e-05 gnorm 0.230 3.12s mem 81.1GB +step 834/5000 loss 0.3673 (w 0.3131 mse 0.3167 t 927 new 0.20) lr 1.00e-05 gnorm 0.219 3.33s mem 81.1GB +step 835/5000 loss 0.2388 (w 0.4350 mse 0.4269 t 980 new 0.24) lr 1.00e-05 gnorm 0.152 3.29s mem 81.1GB +step 836/5000 loss 0.1597 (w 0.4474 mse 0.4626 t 975 new 0.19) lr 1.00e-05 gnorm 0.356 2.82s mem 81.1GB +step 837/5000 loss 0.1945 (w 0.2751 mse 0.2789 t 716 new 0.19) lr 1.00e-05 gnorm 0.109 2.83s mem 81.1GB +step 838/5000 loss 0.3711 (w 0.1685 mse 0.1846 t 797 new 0.21) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +step 839/5000 loss 0.1463 (w 0.3017 mse 0.3040 t 943 new 0.03) lr 1.00e-05 gnorm 0.134 2.82s mem 81.1GB +step 840/5000 loss 0.5151 (w 0.2114 mse 0.2359 t 774 new 0.19) lr 1.00e-05 gnorm 0.154 3.29s mem 81.1GB +step 841/5000 loss 0.2048 (w 0.4143 mse 0.4202 t 957 new 0.18) lr 1.00e-05 gnorm 0.132 3.24s mem 81.1GB +step 842/5000 loss 0.2821 (w 0.3150 mse 0.3454 t 974 new 0.19) lr 1.00e-05 gnorm 0.136 2.82s mem 81.1GB +step 843/5000 loss 0.1473 (w 0.3385 mse 0.3398 t 967 new 0.23) lr 1.00e-05 gnorm 0.113 2.83s mem 81.1GB +step 844/5000 loss 0.5042 (w 0.2666 mse 0.2794 t 967 new 0.24) lr 1.00e-05 gnorm 0.164 3.34s mem 81.1GB +step 845/5000 loss 0.2204 (w 0.3743 mse 0.3822 t 999 new 0.23) lr 1.00e-05 gnorm 0.124 2.82s mem 81.1GB +step 846/5000 loss 0.3237 (w 0.2930 mse 0.3013 t 962 new 0.24) lr 1.00e-05 gnorm 0.160 3.34s mem 81.1GB +step 847/5000 loss 0.1848 (w 0.1902 mse 0.2028 t 926 new 0.20) lr 1.00e-05 gnorm 0.143 3.29s mem 81.1GB +step 848/5000 loss 0.2434 (w 0.2570 mse 0.2643 t 735 new 0.19) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 849/5000 loss 0.3259 (w 0.2324 mse 0.2567 t 849 new 0.17) lr 1.00e-05 gnorm 0.162 2.83s mem 81.1GB +step 850/5000 loss 0.1859 (w 0.4079 mse 0.4132 t 974 new 0.27) lr 1.00e-05 gnorm 0.197 3.37s mem 81.1GB +step 851/5000 loss 0.2799 (w 0.4418 mse 0.4277 t 984 new 0.19) lr 1.00e-05 gnorm 0.165 3.13s mem 81.1GB +step 852/5000 loss 0.2322 (w 0.2616 mse 0.2782 t 741 new 0.20) lr 1.00e-05 gnorm 0.164 3.07s mem 81.1GB +step 853/5000 loss 0.3061 (w 0.2379 mse 0.2604 t 850 new 0.19) lr 1.00e-05 gnorm 0.169 3.29s mem 81.1GB +step 854/5000 loss 0.3958 (w 0.2298 mse 0.2423 t 837 new 0.23) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +step 855/5000 loss 0.1998 (w 0.3488 mse 0.3472 t 666 new 0.21) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +step 856/5000 loss 0.3762 (w 0.3808 mse 0.3901 t 953 new 0.22) lr 1.00e-05 gnorm 0.161 3.34s mem 81.1GB +step 857/5000 loss 0.5430 (w 0.1637 mse 0.1888 t 893 new 0.27) lr 1.00e-05 gnorm 0.152 2.82s mem 81.1GB +step 858/5000 loss 0.2435 (w 0.4247 mse 0.4193 t 988 new 0.18) lr 1.00e-05 gnorm 0.192 3.37s mem 81.1GB +step 859/5000 loss 0.4436 (w 0.3438 mse 0.3455 t 876 new 0.14) lr 1.00e-05 gnorm 0.159 3.11s mem 81.1GB +step 860/5000 loss 0.3650 (w 0.3456 mse 0.3525 t 944 new 0.22) lr 1.00e-05 gnorm 0.443 2.83s mem 81.1GB +step 861/5000 loss 0.3279 (w 0.2543 mse 0.2631 t 852 new 0.08) lr 1.00e-05 gnorm 0.294 3.04s mem 81.1GB +step 862/5000 loss 0.3210 (w 0.2549 mse 0.2657 t 857 new 0.23) lr 1.00e-05 gnorm 1.152 3.39s mem 81.1GB +step 863/5000 loss 0.3475 (w 0.4187 mse 0.4236 t 979 new 0.10) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +step 864/5000 loss 0.3809 (w 0.3645 mse 0.3543 t 936 new 0.21) lr 1.00e-05 gnorm 0.196 3.39s mem 81.1GB +step 865/5000 loss 0.2049 (w 0.3215 mse 0.3370 t 1000 new 0.22) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +step 866/5000 loss 0.2925 (w 0.3104 mse 0.3136 t 922 new 0.11) lr 1.00e-05 gnorm 0.167 2.83s mem 81.1GB +step 867/5000 loss 0.1952 (w 0.2582 mse 0.2611 t 984 new 0.22) lr 1.00e-05 gnorm 0.185 3.09s mem 81.1GB +step 868/5000 loss 0.2584 (w 0.1856 mse 0.2107 t 857 new 0.21) lr 1.00e-05 gnorm 0.165 3.04s mem 81.1GB +step 869/5000 loss 0.2361 (w 0.3129 mse 0.3211 t 855 new 0.22) lr 1.00e-05 gnorm 0.259 2.82s mem 81.1GB +step 870/5000 loss 0.3143 (w 0.2811 mse 0.2782 t 768 new 0.21) lr 1.00e-05 gnorm 0.140 3.32s mem 81.1GB +step 871/5000 loss 0.3562 (w 0.1761 mse 0.1849 t 886 new 0.10) lr 1.00e-05 gnorm 0.124 3.12s mem 81.1GB +step 872/5000 loss 0.3593 (w 0.2849 mse 0.2904 t 676 new 0.21) lr 1.00e-05 gnorm 0.159 2.82s mem 81.1GB +step 873/5000 loss 0.3016 (w 0.2724 mse 0.2763 t 742 new 0.21) lr 1.00e-05 gnorm 0.129 3.09s mem 81.1GB +step 874/5000 loss 0.3773 (w 0.4912 mse 0.4989 t 989 new 0.15) lr 1.00e-05 gnorm 0.150 3.08s mem 81.1GB +step 875/5000 loss 0.3076 (w 0.3703 mse 0.3665 t 668 new 0.08) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +step 876/5000 loss 0.3417 (w 0.3533 mse 0.3626 t 992 new 0.18) lr 1.00e-05 gnorm 0.142 3.31s mem 81.1GB +step 877/5000 loss 0.2615 (w 0.3633 mse 0.3757 t 964 new 0.21) lr 1.00e-05 gnorm 0.154 3.01s mem 81.1GB +step 878/5000 loss 0.3663 (w 0.3880 mse 0.3926 t 414 new 0.18) lr 1.00e-05 gnorm 0.174 2.82s mem 81.1GB +step 879/5000 loss 0.1375 (w 0.2470 mse 0.2536 t 899 new 0.21) lr 1.00e-05 gnorm 0.139 3.43s mem 81.1GB +step 880/5000 loss 0.3306 (w 0.3599 mse 0.3700 t 690 new 0.15) lr 1.00e-05 gnorm 0.150 2.82s mem 81.1GB +step 881/5000 loss 0.2202 (w 0.2381 mse 0.2533 t 860 new 0.22) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +step 882/5000 loss 0.2069 (w 0.3547 mse 0.3601 t 970 new 0.24) lr 1.00e-05 gnorm 0.168 3.28s mem 81.1GB +step 883/5000 loss 0.3213 (w 0.2632 mse 0.2826 t 991 new 0.14) lr 1.00e-05 gnorm 0.138 3.06s mem 81.1GB +step 884/5000 loss 0.3171 (w 0.3182 mse 0.3309 t 950 new 0.28) lr 1.00e-05 gnorm 0.168 2.82s mem 81.1GB +step 885/5000 loss 0.1686 (w 0.2802 mse 0.2787 t 845 new 0.21) lr 1.00e-05 gnorm 0.163 3.38s mem 81.1GB +step 886/5000 loss 0.1900 (w 0.2401 mse 0.2538 t 568 new 0.21) lr 1.00e-05 gnorm 0.197 2.83s mem 81.1GB +step 887/5000 loss 0.2112 (w 0.8238 mse 0.7721 t 996 new 0.19) lr 1.00e-05 gnorm 0.238 3.04s mem 81.1GB +step 888/5000 loss 0.3130 (w 0.2658 mse 0.2828 t 574 new 0.13) lr 1.00e-05 gnorm 0.234 3.28s mem 81.1GB +step 889/5000 loss 0.3112 (w 0.3198 mse 0.3159 t 881 new 0.27) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +step 890/5000 loss 0.2798 (w 0.3295 mse 0.3314 t 990 new 0.16) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +step 891/5000 loss 0.1622 (w 0.2825 mse 0.2912 t 827 new 0.19) lr 1.00e-05 gnorm 0.136 3.40s mem 81.1GB +step 892/5000 loss 0.1646 (w 0.3410 mse 0.3539 t 981 new 0.22) lr 1.00e-05 gnorm 0.214 2.83s mem 81.1GB +step 893/5000 loss 0.2670 (w 0.2330 mse 0.2440 t 858 new 0.24) lr 1.00e-05 gnorm 0.204 3.04s mem 81.1GB +step 894/5000 loss 0.2920 (w 0.3302 mse 0.3473 t 390 new 0.21) lr 1.00e-05 gnorm 0.135 3.30s mem 81.1GB +step 895/5000 loss 0.3311 (w 0.3888 mse 0.3835 t 259 new 0.21) lr 1.00e-05 gnorm 0.135 2.82s mem 81.1GB +step 896/5000 loss 0.2061 (w 0.2013 mse 0.2154 t 835 new 0.21) lr 1.00e-05 gnorm 0.149 3.02s mem 81.1GB +step 897/5000 loss 0.4151 (w 0.4013 mse 0.4093 t 292 new 0.17) lr 1.00e-05 gnorm 0.157 3.38s mem 81.1GB +step 898/5000 loss 0.3216 (w 0.2393 mse 0.2543 t 758 new 0.19) lr 1.00e-05 gnorm 0.117 2.82s mem 81.1GB +step 899/5000 loss 0.3530 (w 0.3506 mse 0.3468 t 903 new 0.19) lr 1.00e-05 gnorm 0.147 3.09s mem 81.1GB +step 900/5000 loss 0.4817 (w 0.2272 mse 0.2319 t 901 new 0.23) lr 1.00e-05 gnorm 0.154 3.33s mem 81.1GB +step 901/5000 loss 0.2919 (w 0.3840 mse 0.3816 t 958 new 0.08) lr 1.00e-05 gnorm 0.187 2.83s mem 81.1GB +step 902/5000 loss 0.3349 (w 0.3479 mse 0.3423 t 924 new 0.23) lr 1.00e-05 gnorm 0.168 3.14s mem 81.1GB +step 903/5000 loss 0.1514 (w 0.3481 mse 0.3577 t 964 new 0.23) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +step 904/5000 loss 0.1817 (w 0.3362 mse 0.3444 t 969 new 0.30) lr 1.00e-05 gnorm 0.203 2.83s mem 81.1GB +step 905/5000 loss 0.1222 (w 0.1824 mse 0.2097 t 924 new 0.18) lr 1.00e-05 gnorm 0.147 3.29s mem 81.1GB +step 906/5000 loss 0.3481 (w 0.1409 mse 0.1527 t 727 new 0.14) lr 1.00e-05 gnorm 0.359 3.37s mem 81.1GB +step 907/5000 loss 0.2745 (w 0.2695 mse 0.2663 t 852 new 0.18) lr 1.00e-05 gnorm 0.111 2.81s mem 81.1GB +step 908/5000 loss 0.1803 (w 0.4088 mse 0.4191 t 411 new 0.16) lr 1.00e-05 gnorm 0.147 3.06s mem 81.1GB +step 909/5000 loss 0.4308 (w 0.3097 mse 0.3265 t 447 new 0.23) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +step 910/5000 loss 0.1975 (w 0.2373 mse 0.2475 t 943 new 0.21) lr 1.00e-05 gnorm 0.110 2.83s mem 81.1GB +step 911/5000 loss 0.4077 (w 0.3515 mse 0.3532 t 905 new 0.22) lr 1.00e-05 gnorm 0.127 3.29s mem 81.1GB +step 912/5000 loss 0.2761 (w 0.2610 mse 0.2699 t 945 new 0.20) lr 1.00e-05 gnorm 0.106 3.08s mem 81.1GB +step 913/5000 loss 0.3844 (w 0.3290 mse 0.3338 t 670 new 0.20) lr 1.00e-05 gnorm 0.349 2.83s mem 81.1GB +step 914/5000 loss 0.3168 (w 0.2498 mse 0.2563 t 319 new 0.19) lr 1.00e-05 gnorm 0.120 3.11s mem 81.1GB +step 915/5000 loss 0.4752 (w 0.2605 mse 0.2804 t 698 new 0.23) lr 1.00e-05 gnorm 0.185 3.04s mem 81.1GB +step 916/5000 loss 0.5209 (w 0.3145 mse 0.3140 t 883 new 0.19) lr 1.00e-05 gnorm 0.140 2.82s mem 81.1GB +step 917/5000 loss 0.3409 (w 0.3222 mse 0.3138 t 910 new 0.19) lr 1.00e-05 gnorm 0.173 3.31s mem 81.1GB +step 918/5000 loss 0.2486 (w 0.3437 mse 0.3441 t 839 new 0.13) lr 1.00e-05 gnorm 0.134 3.20s mem 81.1GB +step 919/5000 loss 0.3179 (w 0.6294 mse 0.6491 t 120 new 0.23) lr 1.00e-05 gnorm 0.549 2.83s mem 81.1GB +step 920/5000 loss 0.3488 (w 0.4031 mse 0.3960 t 607 new 0.08) lr 1.00e-05 gnorm 0.205 3.12s mem 81.1GB +step 921/5000 loss 0.3287 (w 0.2605 mse 0.2757 t 999 new 0.10) lr 1.00e-05 gnorm 0.180 3.12s mem 81.1GB +step 922/5000 loss 0.4492 (w 0.3225 mse 0.3304 t 953 new 0.17) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +step 923/5000 loss 0.3772 (w 0.2421 mse 0.2565 t 943 new 0.22) lr 1.00e-05 gnorm 0.212 3.15s mem 81.1GB +step 924/5000 loss 0.3355 (w 0.2403 mse 0.2436 t 551 new 0.08) lr 1.00e-05 gnorm 0.144 3.07s mem 81.1GB +step 925/5000 loss 0.4454 (w 0.2729 mse 0.2919 t 935 new 0.28) lr 1.00e-05 gnorm 0.160 2.82s mem 81.1GB +step 926/5000 loss 0.2828 (w 0.3487 mse 0.3521 t 572 new 0.16) lr 1.00e-05 gnorm 0.135 3.13s mem 81.1GB +step 927/5000 loss 0.3141 (w 0.3116 mse 0.3128 t 950 new 0.24) lr 1.00e-05 gnorm 0.205 3.10s mem 81.1GB +step 928/5000 loss 0.2443 (w 0.3443 mse 0.3457 t 973 new 0.16) lr 1.00e-05 gnorm 0.133 3.11s mem 81.1GB +step 929/5000 loss 0.2929 (w 0.4036 mse 0.3958 t 953 new 0.28) lr 1.00e-05 gnorm 0.145 3.23s mem 81.1GB +step 930/5000 loss 0.2743 (w 0.2708 mse 0.2642 t 832 new 0.19) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +step 931/5000 loss 0.2351 (w 0.3697 mse 0.3732 t 994 new 0.22) lr 1.00e-05 gnorm 0.165 3.07s mem 81.1GB +step 932/5000 loss 0.2579 (w 0.1886 mse 0.2021 t 876 new 0.19) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 933/5000 loss 0.2323 (w 0.4131 mse 0.4125 t 999 new 0.16) lr 1.00e-05 gnorm 0.653 3.15s mem 81.1GB +step 934/5000 loss 0.2238 (w 0.3525 mse 0.3891 t 183 new 0.20) lr 1.00e-05 gnorm 0.178 3.07s mem 81.1GB +step 935/5000 loss 0.2954 (w 0.3190 mse 0.3264 t 283 new 0.09) lr 1.00e-05 gnorm 0.153 3.32s mem 81.1GB +step 936/5000 loss 0.3415 (w 0.2252 mse 0.2386 t 748 new 0.22) lr 1.00e-05 gnorm 0.175 2.83s mem 81.1GB +step 937/5000 loss 0.3776 (w 0.3056 mse 0.3162 t 562 new 0.10) lr 1.00e-05 gnorm 0.127 3.12s mem 81.1GB +step 938/5000 loss 0.1861 (w 0.2783 mse 0.2858 t 977 new 0.11) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +step 939/5000 loss 0.2554 (w 0.2810 mse 0.2861 t 836 new 0.21) lr 1.00e-05 gnorm 0.128 3.12s mem 81.1GB +step 940/5000 loss 0.2521 (w 0.1947 mse 0.2155 t 853 new 0.18) lr 1.00e-05 gnorm 0.148 3.28s mem 81.1GB +step 941/5000 loss 0.2292 (w 0.3808 mse 0.3689 t 981 new 0.20) lr 1.00e-05 gnorm 0.149 3.33s mem 81.1GB +step 942/5000 loss 0.3385 (w 0.2812 mse 0.2965 t 901 new 0.19) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +step 943/5000 loss 0.2098 (w 0.2706 mse 0.2841 t 933 new 0.20) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +step 944/5000 loss 0.1980 (w 0.4773 mse 0.4781 t 975 new 0.24) lr 1.00e-05 gnorm 0.252 2.84s mem 81.1GB +step 945/5000 loss 0.3220 (w 0.4334 mse 0.4376 t 991 new 0.22) lr 1.00e-05 gnorm 0.142 3.08s mem 81.1GB +step 946/5000 loss 0.3101 (w 0.3793 mse 0.3792 t 932 new 0.25) lr 1.00e-05 gnorm 0.137 3.24s mem 81.1GB +step 947/5000 loss 0.2364 (w 0.3357 mse 0.3302 t 913 new 0.11) lr 1.00e-05 gnorm 0.144 3.37s mem 81.1GB +step 948/5000 loss 0.2730 (w 0.2885 mse 0.2922 t 663 new 0.14) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +step 949/5000 loss 0.1942 (w 0.3309 mse 0.3444 t 965 new 0.24) lr 1.00e-05 gnorm 0.137 3.05s mem 81.1GB +step 950/5000 loss 0.3049 (w 0.2566 mse 0.2892 t 431 new 0.23) lr 1.00e-05 gnorm 0.144 2.82s mem 81.1GB +step 951/5000 loss 0.2379 (w 0.1894 mse 0.1905 t 909 new 0.12) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +step 952/5000 loss 0.4214 (w 0.3185 mse 0.3263 t 927 new 0.22) lr 1.00e-05 gnorm 0.149 3.25s mem 81.1GB +step 953/5000 loss 0.1463 (w 0.4674 mse 0.4706 t 996 new 0.19) lr 1.00e-05 gnorm 0.119 3.09s mem 81.1GB +step 954/5000 loss 0.1768 (w 0.4057 mse 0.4043 t 983 new 0.23) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +step 955/5000 loss 0.2643 (w 0.2113 mse 0.2122 t 839 new 0.24) lr 1.00e-05 gnorm 0.144 3.06s mem 81.1GB +step 956/5000 loss 0.2622 (w 0.3075 mse 0.3170 t 916 new 0.24) lr 1.00e-05 gnorm 0.126 3.09s mem 81.1GB +step 957/5000 loss 0.3224 (w 0.2882 mse 0.2921 t 833 new 0.24) lr 1.00e-05 gnorm 0.291 2.81s mem 81.1GB +step 958/5000 loss 0.4315 (w 0.3699 mse 0.3823 t 977 new 0.17) lr 1.00e-05 gnorm 0.128 3.34s mem 81.1GB +step 959/5000 loss 0.2884 (w 0.2629 mse 0.2822 t 951 new 0.20) lr 1.00e-05 gnorm 0.289 3.35s mem 81.1GB +step 960/5000 loss 0.3341 (w 0.2993 mse 0.3053 t 601 new 0.16) lr 1.00e-05 gnorm 0.173 3.05s mem 81.1GB +step 961/5000 loss 0.2710 (w 0.2427 mse 0.2547 t 819 new 0.18) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +step 962/5000 loss 0.1705 (w 0.2654 mse 0.2818 t 983 new 0.18) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +step 963/5000 loss 0.3964 (w 0.4955 mse 0.4859 t 986 new 0.23) lr 1.00e-05 gnorm 0.190 2.84s mem 81.1GB +step 964/5000 loss 0.2241 (w 0.2585 mse 0.2569 t 900 new 0.09) lr 1.00e-05 gnorm 0.141 3.61s mem 81.1GB +step 965/5000 loss 0.3295 (w 0.3069 mse 0.3017 t 813 new 0.25) lr 1.00e-05 gnorm 0.166 3.04s mem 81.1GB +step 966/5000 loss 0.2044 (w 0.2233 mse 0.2427 t 941 new 0.28) lr 1.00e-05 gnorm 0.153 3.06s mem 81.1GB +step 967/5000 loss 0.2094 (w 0.3270 mse 0.3335 t 925 new 0.27) lr 1.00e-05 gnorm 0.146 2.84s mem 81.1GB +step 968/5000 loss 0.3077 (w 0.2087 mse 0.2192 t 907 new 0.20) lr 1.00e-05 gnorm 0.144 3.09s mem 81.1GB +step 969/5000 loss 0.2344 (w 0.3181 mse 0.3220 t 936 new 0.21) lr 1.00e-05 gnorm 0.228 3.07s mem 81.1GB +step 970/5000 loss 0.2448 (w 0.2026 mse 0.2202 t 905 new 0.22) lr 1.00e-05 gnorm 0.157 3.22s mem 81.1GB +step 971/5000 loss 0.3141 (w 0.3628 mse 0.3710 t 973 new 0.25) lr 1.00e-05 gnorm 0.177 3.07s mem 81.1GB +step 972/5000 loss 0.2982 (w 0.2567 mse 0.2690 t 781 new 0.23) lr 1.00e-05 gnorm 0.130 3.09s mem 81.1GB +step 973/5000 loss 0.4410 (w 0.3558 mse 0.3640 t 428 new 0.19) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +step 974/5000 loss 0.2571 (w 0.2959 mse 0.2970 t 851 new 0.20) lr 1.00e-05 gnorm 0.712 3.10s mem 81.1GB +step 975/5000 loss 0.4602 (w 0.2431 mse 0.2643 t 811 new 0.12) lr 1.00e-05 gnorm 0.324 3.09s mem 81.1GB +step 976/5000 loss 0.3452 (w 0.2614 mse 0.2713 t 872 new 0.23) lr 1.00e-05 gnorm 0.129 3.34s mem 81.1GB +step 977/5000 loss 0.4087 (w 0.2797 mse 0.2960 t 498 new 0.09) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +step 978/5000 loss 0.2946 (w 0.2081 mse 0.2277 t 861 new 0.20) lr 1.00e-05 gnorm 0.126 3.09s mem 81.1GB +step 979/5000 loss 0.2374 (w 0.3533 mse 0.3557 t 803 new 0.21) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +step 980/5000 loss 0.2168 (w 0.2719 mse 0.2736 t 788 new 0.23) lr 1.00e-05 gnorm 0.230 3.10s mem 81.1GB +step 981/5000 loss 0.1947 (w 0.2533 mse 0.2610 t 884 new 0.21) lr 1.00e-05 gnorm 0.184 3.40s mem 81.1GB +step 982/5000 loss 0.1614 (w 0.3206 mse 0.3211 t 590 new 0.27) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +step 983/5000 loss 0.3772 (w 0.2077 mse 0.2279 t 964 new 0.23) lr 1.00e-05 gnorm 0.188 3.10s mem 81.1GB +step 984/5000 loss 0.4255 (w 0.3459 mse 0.3486 t 621 new 0.20) lr 1.00e-05 gnorm 0.186 3.10s mem 81.1GB +step 985/5000 loss 0.1443 (w 0.3304 mse 0.3311 t 963 new 0.21) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +step 986/5000 loss 0.4207 (w 0.3133 mse 0.3042 t 763 new 0.17) lr 1.00e-05 gnorm 0.156 3.02s mem 81.1GB +step 987/5000 loss 0.3421 (w 0.2736 mse 0.2741 t 934 new 0.20) lr 1.00e-05 gnorm 0.150 3.23s mem 81.1GB +step 988/5000 loss 0.2935 (w 0.3166 mse 0.3250 t 974 new 0.25) lr 1.00e-05 gnorm 0.133 3.39s mem 81.1GB +step 989/5000 loss 0.3592 (w 0.3493 mse 0.3642 t 633 new 0.21) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +step 990/5000 loss 0.5152 (w 0.2154 mse 0.2218 t 889 new 0.11) lr 1.00e-05 gnorm 0.146 3.34s mem 81.1GB +step 991/5000 loss 0.4374 (w 0.2535 mse 0.2622 t 624 new 0.20) lr 1.00e-05 gnorm 0.149 2.82s mem 81.1GB +step 992/5000 loss 0.2319 (w 0.2058 mse 0.2151 t 873 new 0.12) lr 1.00e-05 gnorm 0.170 3.03s mem 81.1GB +step 993/5000 loss 0.3935 (w 0.4379 mse 0.4269 t 998 new 0.19) lr 1.00e-05 gnorm 0.117 3.33s mem 81.1GB +step 994/5000 loss 0.3989 (w 0.2468 mse 0.2555 t 913 new 0.11) lr 1.00e-05 gnorm 0.136 3.37s mem 81.1GB +step 995/5000 loss 0.2318 (w 0.2541 mse 0.2584 t 754 new 0.23) lr 1.00e-05 gnorm 0.142 2.82s mem 81.1GB +step 996/5000 loss 0.2893 (w 0.2766 mse 0.2975 t 946 new 0.25) lr 1.00e-05 gnorm 0.115 3.10s mem 81.1GB +step 997/5000 loss 0.1639 (w 0.2747 mse 0.2823 t 968 new 0.24) lr 1.00e-05 gnorm 0.116 2.83s mem 81.1GB +step 998/5000 loss 0.2652 (w 0.2587 mse 0.2734 t 875 new 0.24) lr 1.00e-05 gnorm 0.173 3.43s mem 81.1GB +step 999/5000 loss 0.3188 (w 0.2095 mse 0.2302 t 870 new 0.25) lr 1.00e-05 gnorm 0.170 3.12s mem 81.1GB +step 1000/5000 loss 0.1964 (w 0.2870 mse 0.2886 t 933 new 0.16) lr 1.00e-05 gnorm 0.113 3.38s mem 81.1GB +[val] step 1000 t=200: w=0.4800 mse=0.4984 (n=16) t=500: w=0.2916 mse=0.3069 (n=16) t=800: w=0.2466 mse=0.2590 (n=16) | mean w=0.3394 mse=0.3548 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step1000.safetensors 4093 个张量 37.98 GB +step 1001/5000 loss 0.4024 (w 0.4649 mse 0.4596 t 985 new 0.19) lr 1.00e-05 gnorm 0.165 3.49s mem 81.1GB +step 1002/5000 loss 0.0887 (w 0.3109 mse 0.3109 t 932 new 0.24) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +step 1003/5000 loss 0.2652 (w 0.6791 mse 0.6730 t 114 new 0.16) lr 1.00e-05 gnorm 0.236 3.15s mem 81.1GB +step 1004/5000 loss 0.3610 (w 0.3592 mse 0.3641 t 923 new 0.22) lr 1.00e-05 gnorm 0.187 2.83s mem 81.1GB +step 1005/5000 loss 0.2568 (w 0.3383 mse 0.3604 t 484 new 0.25) lr 1.00e-05 gnorm 0.206 3.27s mem 81.1GB +step 1006/5000 loss 0.2994 (w 0.3348 mse 0.3438 t 967 new 0.20) lr 1.00e-05 gnorm 0.183 3.09s mem 81.1GB +step 1007/5000 loss 0.2819 (w 0.3367 mse 0.3506 t 976 new 0.25) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +step 1008/5000 loss 0.2561 (w 0.3207 mse 0.3222 t 964 new 0.20) lr 1.00e-05 gnorm 0.209 3.10s mem 81.1GB +step 1009/5000 loss 0.1970 (w 0.3008 mse 0.3090 t 762 new 0.25) lr 1.00e-05 gnorm 0.159 3.14s mem 81.1GB +step 1010/5000 loss 0.1867 (w 0.2862 mse 0.2931 t 924 new 0.29) lr 1.00e-05 gnorm 0.164 2.83s mem 81.1GB +step 1011/5000 loss 0.3554 (w 0.3303 mse 0.3528 t 670 new 0.17) lr 1.00e-05 gnorm 0.127 3.28s mem 81.1GB +step 1012/5000 loss 0.2475 (w 0.2816 mse 0.2846 t 715 new 0.16) lr 1.00e-05 gnorm 0.130 3.02s mem 81.1GB +step 1013/5000 loss 0.2259 (w 0.3242 mse 0.3365 t 885 new 0.25) lr 1.00e-05 gnorm 0.123 3.06s mem 81.1GB +step 1014/5000 loss 0.4618 (w 0.4265 mse 0.4375 t 283 new 0.20) lr 1.00e-05 gnorm 0.232 2.84s mem 81.1GB +step 1015/5000 loss 0.3337 (w 0.3530 mse 0.3575 t 966 new 0.23) lr 1.00e-05 gnorm 0.140 3.36s mem 81.1GB +step 1016/5000 loss 0.2933 (w 0.3117 mse 0.3197 t 973 new 0.22) lr 1.00e-05 gnorm 0.119 2.82s mem 81.1GB +step 1017/5000 loss 0.4360 (w 0.3145 mse 0.3151 t 670 new 0.20) lr 1.00e-05 gnorm 0.164 3.30s mem 81.1GB +step 1018/5000 loss 0.3810 (w 0.2429 mse 0.2634 t 902 new 0.23) lr 1.00e-05 gnorm 0.152 3.07s mem 81.1GB +step 1019/5000 loss 0.1221 (w 0.3444 mse 0.3507 t 975 new 0.22) lr 1.00e-05 gnorm 0.096 3.11s mem 81.1GB +step 1020/5000 loss 0.2618 (w 0.2802 mse 0.2926 t 865 new 0.24) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +step 1021/5000 loss 0.3100 (w 0.3444 mse 0.3580 t 918 new 0.19) lr 1.00e-05 gnorm 0.141 3.34s mem 81.1GB +step 1022/5000 loss 0.3742 (w 0.2805 mse 0.2885 t 871 new 0.18) lr 1.00e-05 gnorm 0.210 3.05s mem 81.1GB +step 1023/5000 loss 0.3310 (w 0.6634 mse 0.6848 t 120 new 0.19) lr 1.00e-05 gnorm 0.121 3.07s mem 81.1GB +step 1024/5000 loss 0.2645 (w 0.3439 mse 0.3559 t 986 new 0.21) lr 1.00e-05 gnorm 0.245 3.15s mem 81.1GB +step 1025/5000 loss 0.2368 (w 0.2835 mse 0.2951 t 895 new 0.22) lr 1.00e-05 gnorm 0.202 3.07s mem 81.1GB +step 1026/5000 loss 0.1927 (w 0.3379 mse 0.3353 t 933 new 0.18) lr 1.00e-05 gnorm 0.142 2.82s mem 81.1GB +step 1027/5000 loss 0.3357 (w 0.4082 mse 0.4141 t 310 new 0.18) lr 1.00e-05 gnorm 0.131 3.35s mem 81.1GB +step 1028/5000 loss 0.2605 (w 0.4893 mse 0.4637 t 997 new 0.25) lr 1.00e-05 gnorm 0.122 3.09s mem 81.1GB +step 1029/5000 loss 0.3494 (w 0.3599 mse 0.3490 t 749 new 0.23) lr 1.00e-05 gnorm 0.132 3.26s mem 81.1GB +step 1030/5000 loss 0.1843 (w 0.2386 mse 0.2651 t 966 new 0.21) lr 1.00e-05 gnorm 0.165 3.09s mem 81.1GB +step 1031/5000 loss 0.3626 (w 0.5229 mse 0.5307 t 297 new 0.14) lr 1.00e-05 gnorm 0.184 3.10s mem 81.1GB +step 1032/5000 loss 0.2277 (w 0.3508 mse 0.3575 t 932 new 0.07) lr 1.00e-05 gnorm 0.125 2.83s mem 81.1GB +step 1033/5000 loss 0.2812 (w 0.2814 mse 0.2835 t 822 new 0.18) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +step 1034/5000 loss 0.2708 (w 0.3110 mse 0.3143 t 978 new 0.21) lr 1.00e-05 gnorm 0.169 3.16s mem 81.1GB +step 1035/5000 loss 0.2997 (w 0.3992 mse 0.3785 t 933 new 0.23) lr 1.00e-05 gnorm 0.133 3.31s mem 81.1GB +step 1036/5000 loss 0.2178 (w 0.2179 mse 0.2296 t 913 new 0.21) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +step 1037/5000 loss 0.3743 (w 0.1947 mse 0.2065 t 923 new 0.17) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +step 1038/5000 loss 0.2522 (w 0.2686 mse 0.2732 t 829 new 0.18) lr 1.00e-05 gnorm 0.119 3.05s mem 81.1GB +step 1039/5000 loss 0.2426 (w 0.2492 mse 0.2528 t 802 new 0.06) lr 1.00e-05 gnorm 0.177 3.10s mem 81.1GB +step 1040/5000 loss 0.4220 (w 0.3410 mse 0.3576 t 644 new 0.27) lr 1.00e-05 gnorm 0.169 3.03s mem 81.1GB +step 1041/5000 loss 0.3684 (w 0.3662 mse 0.3639 t 768 new 0.17) lr 1.00e-05 gnorm 0.182 3.35s mem 81.1GB +step 1042/5000 loss 0.3363 (w 0.2149 mse 0.2208 t 807 new 0.11) lr 1.00e-05 gnorm 0.126 3.08s mem 81.1GB +step 1043/5000 loss 0.3732 (w 0.2205 mse 0.2277 t 668 new 0.21) lr 1.00e-05 gnorm 0.258 2.82s mem 81.1GB +step 1044/5000 loss 0.2641 (w 0.2488 mse 0.2716 t 490 new 0.14) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +step 1045/5000 loss 0.1119 (w 0.2515 mse 0.2627 t 922 new 0.18) lr 1.00e-05 gnorm 0.111 3.07s mem 81.1GB +step 1046/5000 loss 0.5440 (w 0.2674 mse 0.2720 t 683 new 0.24) lr 1.00e-05 gnorm 0.142 3.29s mem 81.1GB +step 1047/5000 loss 0.3042 (w 0.3170 mse 0.3381 t 976 new 0.21) lr 1.00e-05 gnorm 0.212 3.13s mem 81.1GB +step 1048/5000 loss 0.1781 (w 0.2352 mse 0.2563 t 914 new 0.20) lr 1.00e-05 gnorm 0.142 3.47s mem 81.1GB +step 1049/5000 loss 0.2557 (w 0.3344 mse 0.3391 t 915 new 0.27) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +step 1050/5000 loss 0.2952 (w 0.3455 mse 0.3437 t 820 new 0.11) lr 1.00e-05 gnorm 0.222 3.10s mem 81.1GB +step 1051/5000 loss 0.3615 (w 0.2679 mse 0.2798 t 397 new 0.17) lr 1.00e-05 gnorm 0.390 3.11s mem 81.1GB +step 1052/5000 loss 0.3632 (w 0.3904 mse 0.3937 t 336 new 0.24) lr 1.00e-05 gnorm 0.592 3.06s mem 81.1GB +step 1053/5000 loss 0.2610 (w 0.3734 mse 0.3834 t 428 new 0.19) lr 1.00e-05 gnorm 0.120 3.09s mem 81.1GB +step 1054/5000 loss 0.3044 (w 0.3697 mse 0.3770 t 983 new 0.17) lr 1.00e-05 gnorm 0.144 3.06s mem 81.1GB +step 1055/5000 loss 0.3133 (w 0.2161 mse 0.2230 t 741 new 0.13) lr 1.00e-05 gnorm 0.203 2.82s mem 81.1GB +step 1056/5000 loss 0.4306 (w 0.4387 mse 0.4360 t 964 new 0.12) lr 1.00e-05 gnorm 0.155 3.28s mem 81.1GB +step 1057/5000 loss 0.2620 (w 0.2772 mse 0.2782 t 891 new 0.20) lr 1.00e-05 gnorm 0.156 3.11s mem 81.1GB +step 1058/5000 loss 0.2357 (w 0.3781 mse 0.3734 t 971 new 0.23) lr 1.00e-05 gnorm 0.129 3.06s mem 81.1GB +step 1059/5000 loss 0.1555 (w 0.2297 mse 0.2555 t 586 new 0.20) lr 1.00e-05 gnorm 1.062 3.09s mem 81.1GB +step 1060/5000 loss 0.2872 (w 0.2497 mse 0.2559 t 975 new 0.17) lr 1.00e-05 gnorm 0.143 3.15s mem 81.1GB +step 1061/5000 loss 0.3545 (w 0.2439 mse 0.2610 t 946 new 0.25) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +step 1062/5000 loss 0.2753 (w 0.1986 mse 0.2208 t 761 new 0.23) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +step 1063/5000 loss 0.2399 (w 0.1991 mse 0.1929 t 827 new 0.13) lr 1.00e-05 gnorm 0.100 3.14s mem 81.1GB +step 1064/5000 loss 0.3105 (w 0.3966 mse 0.3874 t 984 new 0.21) lr 1.00e-05 gnorm 0.148 3.22s mem 81.1GB +step 1065/5000 loss 0.2472 (w 0.1952 mse 0.1971 t 790 new 0.15) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +step 1066/5000 loss 0.3478 (w 0.2824 mse 0.3132 t 973 new 0.22) lr 1.00e-05 gnorm 0.136 3.05s mem 81.1GB +step 1067/5000 loss 0.4717 (w 0.3265 mse 0.3320 t 987 new 0.18) lr 1.00e-05 gnorm 0.186 3.03s mem 81.1GB +step 1068/5000 loss 0.3116 (w 0.2599 mse 0.2865 t 989 new 0.28) lr 1.00e-05 gnorm 0.156 3.07s mem 81.1GB +step 1069/5000 loss 0.3058 (w 0.6740 mse 0.7002 t 999 new 0.16) lr 1.00e-05 gnorm 0.147 3.06s mem 81.1GB +step 1070/5000 loss 0.2498 (w 0.3133 mse 0.3222 t 962 new 0.25) lr 1.00e-05 gnorm 0.165 3.24s mem 81.1GB +step 1071/5000 loss 0.2676 (w 0.4726 mse 0.4784 t 986 new 0.29) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +step 1072/5000 loss 0.3150 (w 0.2407 mse 0.2565 t 753 new 0.11) lr 1.00e-05 gnorm 0.183 3.04s mem 81.1GB +step 1073/5000 loss 0.2653 (w 0.3892 mse 0.4141 t 249 new 0.12) lr 1.00e-05 gnorm 0.141 3.05s mem 81.1GB +step 1074/5000 loss 0.1923 (w 0.3188 mse 0.3243 t 960 new 0.25) lr 1.00e-05 gnorm 0.100 2.84s mem 81.1GB +step 1075/5000 loss 0.3819 (w 0.3914 mse 0.4053 t 970 new 0.25) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +step 1076/5000 loss 0.4051 (w 0.2728 mse 0.2716 t 983 new 0.19) lr 1.00e-05 gnorm 0.156 3.25s mem 81.1GB +step 1077/5000 loss 0.3782 (w 0.3164 mse 0.3242 t 915 new 0.24) lr 1.00e-05 gnorm 0.173 3.15s mem 81.1GB +step 1078/5000 loss 0.2628 (w 0.3171 mse 0.3256 t 610 new 0.23) lr 1.00e-05 gnorm 0.232 3.04s mem 81.1GB +step 1079/5000 loss 0.3292 (w 0.2942 mse 0.3152 t 939 new 0.19) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +step 1080/5000 loss 0.3338 (w 0.2697 mse 0.2695 t 798 new 0.14) lr 1.00e-05 gnorm 0.187 2.83s mem 81.1GB +step 1081/5000 loss 0.3615 (w 0.2869 mse 0.2780 t 742 new 0.24) lr 1.00e-05 gnorm 0.412 3.03s mem 81.1GB +step 1082/5000 loss 0.3182 (w 0.2842 mse 0.2968 t 852 new 0.24) lr 1.00e-05 gnorm 0.122 3.29s mem 81.1GB +step 1083/5000 loss 0.1073 (w 0.3563 mse 0.3566 t 993 new 0.26) lr 1.00e-05 gnorm 0.137 3.28s mem 81.1GB +step 1084/5000 loss 0.2322 (w 0.3299 mse 0.3334 t 984 new 0.14) lr 1.00e-05 gnorm 0.242 2.83s mem 81.1GB +step 1085/5000 loss 0.3876 (w 0.2574 mse 0.2717 t 913 new 0.23) lr 1.00e-05 gnorm 0.187 3.05s mem 81.1GB +step 1086/5000 loss 0.1943 (w 0.2144 mse 0.2254 t 690 new 0.25) lr 1.00e-05 gnorm 0.167 2.83s mem 81.1GB +step 1087/5000 loss 0.2980 (w 0.2240 mse 0.2456 t 914 new 0.22) lr 1.00e-05 gnorm 0.135 3.05s mem 81.1GB +step 1088/5000 loss 0.2036 (w 0.1375 mse 0.1555 t 730 new 0.13) lr 1.00e-05 gnorm 0.162 3.08s mem 81.1GB +step 1089/5000 loss 0.1823 (w 0.2529 mse 0.2568 t 801 new 0.22) lr 1.00e-05 gnorm 0.165 3.35s mem 81.1GB +step 1090/5000 loss 0.3193 (w 0.3134 mse 0.3172 t 992 new 0.16) lr 1.00e-05 gnorm 0.996 2.85s mem 81.1GB +step 1091/5000 loss 0.2272 (w 0.2611 mse 0.2691 t 986 new 0.25) lr 1.00e-05 gnorm 0.133 3.10s mem 81.1GB +step 1092/5000 loss 0.2800 (w 0.2641 mse 0.2700 t 850 new 0.21) lr 1.00e-05 gnorm 0.157 3.17s mem 81.1GB +step 1093/5000 loss 0.2488 (w 0.2076 mse 0.2273 t 669 new 0.21) lr 1.00e-05 gnorm 0.157 3.05s mem 81.1GB +step 1094/5000 loss 0.1636 (w 0.3123 mse 0.3286 t 965 new 0.17) lr 1.00e-05 gnorm 0.136 3.43s mem 81.1GB +step 1095/5000 loss 0.4119 (w 0.4282 mse 0.4280 t 418 new 0.16) lr 1.00e-05 gnorm 0.139 3.06s mem 81.1GB +step 1096/5000 loss 0.3237 (w 0.3172 mse 0.3610 t 986 new 0.26) lr 1.00e-05 gnorm 0.148 2.83s mem 81.1GB +step 1097/5000 loss 0.3841 (w 0.4161 mse 0.4007 t 976 new 0.14) lr 1.00e-05 gnorm 0.875 3.25s mem 81.1GB +step 1098/5000 loss 0.1688 (w 0.3314 mse 0.3460 t 939 new 0.14) lr 1.00e-05 gnorm 0.123 3.11s mem 81.1GB +step 1099/5000 loss 0.1892 (w 0.2621 mse 0.2791 t 482 new 0.21) lr 1.00e-05 gnorm 0.170 3.04s mem 81.1GB +step 1100/5000 loss 0.1545 (w 0.3351 mse 0.3209 t 970 new 0.27) lr 1.00e-05 gnorm 0.165 3.18s mem 81.1GB +step 1101/5000 loss 0.1460 (w 0.3172 mse 0.3373 t 999 new 0.24) lr 1.00e-05 gnorm 0.141 3.04s mem 81.1GB +step 1102/5000 loss 0.2245 (w 0.2579 mse 0.2716 t 974 new 0.10) lr 1.00e-05 gnorm 0.114 2.85s mem 81.1GB +step 1103/5000 loss 0.3169 (w 0.2605 mse 0.2733 t 820 new 0.23) lr 1.00e-05 gnorm 0.107 3.29s mem 81.1GB +step 1104/5000 loss 0.3522 (w 0.2701 mse 0.2866 t 959 new 0.20) lr 1.00e-05 gnorm 0.162 3.39s mem 81.1GB +step 1105/5000 loss 0.5682 (w 0.3158 mse 0.3150 t 592 new 0.20) lr 1.00e-05 gnorm 0.132 3.03s mem 81.1GB +step 1106/5000 loss 0.4583 (w 0.3261 mse 0.3416 t 982 new 0.15) lr 1.00e-05 gnorm 0.169 3.38s mem 81.1GB +step 1107/5000 loss 0.2816 (w 0.3372 mse 0.3433 t 680 new 0.20) lr 1.00e-05 gnorm 0.155 3.04s mem 81.1GB +step 1108/5000 loss 0.4457 (w 0.3847 mse 0.4094 t 288 new 0.21) lr 1.00e-05 gnorm 0.140 3.04s mem 81.1GB +step 1109/5000 loss 0.3860 (w 0.2784 mse 0.2765 t 921 new 0.16) lr 1.00e-05 gnorm 0.184 3.04s mem 81.1GB +step 1110/5000 loss 0.2374 (w 0.2349 mse 0.2393 t 954 new 0.10) lr 1.00e-05 gnorm 0.132 3.37s mem 81.1GB +step 1111/5000 loss 0.4531 (w 0.2977 mse 0.2955 t 713 new 0.23) lr 1.00e-05 gnorm 0.171 3.11s mem 81.1GB +step 1112/5000 loss 0.2775 (w 0.4658 mse 0.4546 t 992 new 0.23) lr 1.00e-05 gnorm 0.154 3.09s mem 81.1GB +step 1113/5000 loss 0.4564 (w 0.2533 mse 0.2638 t 656 new 0.12) lr 1.00e-05 gnorm 0.201 3.08s mem 81.1GB +step 1114/5000 loss 0.4119 (w 0.5551 mse 0.5598 t 228 new 0.12) lr 1.00e-05 gnorm 0.493 3.09s mem 81.1GB +step 1115/5000 loss 0.4028 (w 0.3314 mse 0.3312 t 684 new 0.22) lr 1.00e-05 gnorm 0.238 3.12s mem 81.1GB +step 1116/5000 loss 0.3353 (w 0.2308 mse 0.2467 t 855 new 0.16) lr 1.00e-05 gnorm 0.369 3.18s mem 81.1GB +step 1117/5000 loss 0.4637 (w 0.2928 mse 0.2952 t 947 new 0.22) lr 1.00e-05 gnorm 0.190 3.33s mem 81.1GB +step 1118/5000 loss 0.3188 (w 0.3386 mse 0.3489 t 978 new 0.19) lr 1.00e-05 gnorm 0.152 3.13s mem 81.1GB +step 1119/5000 loss 0.2595 (w 0.3589 mse 0.3629 t 982 new 0.23) lr 1.00e-05 gnorm 0.159 3.05s mem 81.1GB +step 1120/5000 loss 0.3903 (w 0.2979 mse 0.3071 t 722 new 0.20) lr 1.00e-05 gnorm 0.145 3.04s mem 81.1GB +step 1121/5000 loss 0.2830 (w 0.2929 mse 0.2850 t 875 new 0.21) lr 1.00e-05 gnorm 0.142 3.05s mem 81.1GB +step 1122/5000 loss 0.2526 (w 0.4984 mse 0.4747 t 998 new 0.17) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +step 1123/5000 loss 0.2507 (w 0.2826 mse 0.2891 t 752 new 0.22) lr 1.00e-05 gnorm 0.136 3.34s mem 81.1GB +step 1124/5000 loss 0.3662 (w 0.2202 mse 0.2246 t 669 new 0.05) lr 1.00e-05 gnorm 0.159 2.82s mem 81.1GB +step 1125/5000 loss 0.2516 (w 0.1879 mse 0.1990 t 962 new 0.11) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +step 1126/5000 loss 0.2696 (w 0.3980 mse 0.3964 t 983 new 0.15) lr 1.00e-05 gnorm 0.209 3.07s mem 81.1GB +step 1127/5000 loss 0.2947 (w 0.3688 mse 0.3719 t 530 new 0.24) lr 1.00e-05 gnorm 0.180 3.05s mem 81.1GB +step 1128/5000 loss 0.2649 (w 0.3308 mse 0.3330 t 897 new 0.21) lr 1.00e-05 gnorm 0.208 3.07s mem 81.1GB +step 1129/5000 loss 0.2534 (w 0.2862 mse 0.2964 t 832 new 0.24) lr 1.00e-05 gnorm 0.142 3.06s mem 81.1GB +step 1130/5000 loss 0.3713 (w 0.2695 mse 0.2644 t 782 new 0.13) lr 1.00e-05 gnorm 0.134 3.04s mem 81.1GB +step 1131/5000 loss 0.2329 (w 0.4444 mse 0.4344 t 999 new 0.19) lr 1.00e-05 gnorm 0.198 3.08s mem 81.1GB +step 1132/5000 loss 0.3298 (w 0.3153 mse 0.3168 t 850 new 0.24) lr 1.00e-05 gnorm 0.189 2.82s mem 81.1GB +step 1133/5000 loss 0.2976 (w 0.3743 mse 0.3762 t 989 new 0.24) lr 1.00e-05 gnorm 0.141 3.37s mem 81.1GB +step 1134/5000 loss 0.2342 (w 0.1410 mse 0.1592 t 745 new 0.13) lr 1.00e-05 gnorm 0.153 3.05s mem 81.1GB +step 1135/5000 loss 0.2378 (w 0.3025 mse 0.3081 t 965 new 0.21) lr 1.00e-05 gnorm 0.185 3.28s mem 81.1GB +step 1136/5000 loss 0.3533 (w 0.2178 mse 0.2377 t 937 new 0.15) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +step 1137/5000 loss 0.2362 (w 0.3986 mse 0.3964 t 914 new 0.24) lr 1.00e-05 gnorm 0.100 3.01s mem 81.1GB +step 1138/5000 loss 0.2959 (w 0.2468 mse 0.2515 t 665 new 0.09) lr 1.00e-05 gnorm 0.127 3.13s mem 81.1GB +step 1139/5000 loss 0.3280 (w 0.3334 mse 0.3562 t 372 new 0.20) lr 1.00e-05 gnorm 0.129 3.02s mem 81.1GB +step 1140/5000 loss 0.2267 (w 0.3099 mse 0.3195 t 947 new 0.19) lr 1.00e-05 gnorm 0.167 3.05s mem 81.1GB +step 1141/5000 loss 0.5012 (w 0.3811 mse 0.3930 t 421 new 0.22) lr 1.00e-05 gnorm 0.207 3.07s mem 81.1GB +step 1142/5000 loss 0.3741 (w 0.3116 mse 0.3231 t 951 new 0.23) lr 1.00e-05 gnorm 0.186 3.33s mem 81.1GB +step 1143/5000 loss 0.2439 (w 0.3326 mse 0.3496 t 274 new 0.23) lr 1.00e-05 gnorm 0.129 3.00s mem 81.1GB +step 1144/5000 loss 0.2895 (w 0.2811 mse 0.2849 t 889 new 0.21) lr 1.00e-05 gnorm 0.258 3.05s mem 81.1GB +step 1145/5000 loss 0.2389 (w 0.1511 mse 0.1543 t 578 new 0.02) lr 1.00e-05 gnorm 0.136 3.08s mem 81.1GB +step 1146/5000 loss 0.4596 (w 0.3412 mse 0.3455 t 961 new 0.20) lr 1.00e-05 gnorm 0.186 3.30s mem 81.1GB +step 1147/5000 loss 0.2010 (w 0.4278 mse 0.4163 t 930 new 0.24) lr 1.00e-05 gnorm 0.194 3.04s mem 81.1GB +step 1148/5000 loss 0.2162 (w 0.2683 mse 0.2871 t 647 new 0.22) lr 1.00e-05 gnorm 0.126 3.05s mem 81.1GB +step 1149/5000 loss 0.2718 (w 0.3501 mse 0.3584 t 852 new 0.21) lr 1.00e-05 gnorm 0.166 3.04s mem 81.1GB +step 1150/5000 loss 0.1937 (w 0.3077 mse 0.3196 t 612 new 0.20) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +step 1151/5000 loss 0.1917 (w 0.3439 mse 0.3506 t 958 new 0.18) lr 1.00e-05 gnorm 0.196 3.03s mem 81.1GB +step 1152/5000 loss 0.2432 (w 0.1946 mse 0.2098 t 725 new 0.22) lr 1.00e-05 gnorm 0.183 3.28s mem 81.1GB +step 1153/5000 loss 0.4169 (w 0.3510 mse 0.3476 t 506 new 0.17) lr 1.00e-05 gnorm 0.197 2.83s mem 81.1GB +step 1154/5000 loss 0.2399 (w 0.4916 mse 0.4869 t 974 new 0.24) lr 1.00e-05 gnorm 0.177 3.12s mem 81.1GB +step 1155/5000 loss 0.1511 (w 0.1731 mse 0.1807 t 672 new 0.20) lr 1.00e-05 gnorm 0.124 3.03s mem 81.1GB +step 1156/5000 loss 0.3071 (w 0.2637 mse 0.2880 t 995 new 0.16) lr 1.00e-05 gnorm 0.158 3.05s mem 81.1GB +step 1157/5000 loss 0.3013 (w 0.3662 mse 0.3677 t 233 new 0.10) lr 1.00e-05 gnorm 0.187 3.06s mem 81.1GB +step 1158/5000 loss 0.3422 (w 0.2205 mse 0.2485 t 940 new 0.23) lr 1.00e-05 gnorm 0.213 3.30s mem 81.1GB +step 1159/5000 loss 0.3815 (w 0.3540 mse 0.3651 t 450 new 0.21) lr 1.00e-05 gnorm 0.183 2.84s mem 81.1GB +step 1160/5000 loss 0.1549 (w 0.3763 mse 0.3801 t 945 new 0.18) lr 1.00e-05 gnorm 0.139 3.13s mem 81.1GB +step 1161/5000 loss 0.1841 (w 0.3254 mse 0.3247 t 934 new 0.17) lr 1.00e-05 gnorm 0.109 3.01s mem 81.1GB +step 1162/5000 loss 0.2900 (w 0.2444 mse 0.2559 t 970 new 0.24) lr 1.00e-05 gnorm 0.114 3.34s mem 81.1GB +step 1163/5000 loss 0.1808 (w 0.4399 mse 0.4391 t 960 new 0.21) lr 1.00e-05 gnorm 0.214 3.11s mem 81.1GB +step 1164/5000 loss 0.2711 (w 0.2619 mse 0.2606 t 977 new 0.24) lr 1.00e-05 gnorm 4.211 3.33s mem 81.1GB +step 1165/5000 loss 0.3117 (w 0.2821 mse 0.2889 t 683 new 0.26) lr 1.00e-05 gnorm 0.160 3.07s mem 81.1GB +step 1166/5000 loss 0.2656 (w 0.3548 mse 0.3518 t 918 new 0.24) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +step 1167/5000 loss 0.1881 (w 0.1849 mse 0.2010 t 911 new 0.25) lr 1.00e-05 gnorm 0.105 3.03s mem 81.1GB +step 1168/5000 loss 0.3059 (w 0.4604 mse 0.4542 t 963 new 0.22) lr 1.00e-05 gnorm 0.965 3.35s mem 81.1GB +step 1169/5000 loss 0.3399 (w 0.3833 mse 0.3711 t 998 new 0.27) lr 1.00e-05 gnorm 0.126 3.09s mem 81.1GB +step 1170/5000 loss 0.2266 (w 0.3518 mse 0.3515 t 922 new 0.19) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +step 1171/5000 loss 0.2964 (w 0.2660 mse 0.2732 t 897 new 0.29) lr 1.00e-05 gnorm 0.148 3.13s mem 81.1GB +step 1172/5000 loss 0.3515 (w 0.3924 mse 0.3974 t 328 new 0.10) lr 1.00e-05 gnorm 0.420 2.82s mem 81.1GB +step 1173/5000 loss 0.3594 (w 0.3455 mse 0.3466 t 948 new 0.24) lr 1.00e-05 gnorm 0.160 3.06s mem 81.1GB +step 1174/5000 loss 0.3156 (w 0.1312 mse 0.1564 t 800 new 0.19) lr 1.00e-05 gnorm 0.208 3.26s mem 81.1GB +step 1175/5000 loss 0.3458 (w 0.3941 mse 0.3950 t 988 new 0.20) lr 1.00e-05 gnorm 0.193 3.05s mem 81.1GB +step 1176/5000 loss 0.2338 (w 0.2765 mse 0.2748 t 874 new 0.10) lr 1.00e-05 gnorm 0.184 3.12s mem 81.1GB +step 1177/5000 loss 0.1599 (w 0.4833 mse 0.4883 t 995 new 0.14) lr 1.00e-05 gnorm 0.114 3.34s mem 81.1GB +step 1178/5000 loss 0.3244 (w 0.3000 mse 0.3092 t 909 new 0.23) lr 1.00e-05 gnorm 0.206 2.83s mem 81.1GB +step 1179/5000 loss 0.2126 (w 0.2905 mse 0.2919 t 892 new 0.22) lr 1.00e-05 gnorm 0.134 2.82s mem 81.1GB +step 1180/5000 loss 0.2103 (w 0.2739 mse 0.2772 t 952 new 0.15) lr 1.00e-05 gnorm 0.105 3.27s mem 81.1GB +step 1181/5000 loss 0.2742 (w 0.2848 mse 0.2922 t 900 new 0.24) lr 1.00e-05 gnorm 0.188 3.37s mem 81.1GB +step 1182/5000 loss 0.2551 (w 0.2960 mse 0.2842 t 879 new 0.19) lr 1.00e-05 gnorm 0.162 3.07s mem 81.1GB +step 1183/5000 loss 0.1303 (w 0.3358 mse 0.3427 t 976 new 0.20) lr 1.00e-05 gnorm 0.144 3.33s mem 81.1GB +step 1184/5000 loss 0.2953 (w 0.4031 mse 0.4162 t 998 new 0.15) lr 1.00e-05 gnorm 0.161 3.04s mem 81.1GB +step 1185/5000 loss 0.1536 (w 0.3852 mse 0.3825 t 995 new 0.22) lr 1.00e-05 gnorm 0.163 2.83s mem 81.1GB +step 1186/5000 loss 0.2151 (w 0.3942 mse 0.3985 t 971 new 0.19) lr 1.00e-05 gnorm 0.134 3.58s mem 81.1GB +step 1187/5000 loss 0.1496 (w 0.2337 mse 0.2623 t 946 new 0.27) lr 1.00e-05 gnorm 0.130 3.28s mem 81.1GB +step 1188/5000 loss 0.3532 (w 0.4092 mse 0.4103 t 984 new 0.20) lr 1.00e-05 gnorm 0.152 3.16s mem 81.1GB +step 1189/5000 loss 0.4197 (w 0.3064 mse 0.3223 t 955 new 0.20) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +step 1190/5000 loss 0.2374 (w 0.4377 mse 0.4380 t 979 new 0.20) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +step 1191/5000 loss 0.3126 (w 0.2848 mse 0.2824 t 849 new 0.22) lr 1.00e-05 gnorm 0.203 3.04s mem 81.1GB +step 1192/5000 loss 0.2096 (w 0.3679 mse 0.3589 t 948 new 0.23) lr 1.00e-05 gnorm 0.263 3.26s mem 81.1GB +step 1193/5000 loss 0.3776 (w 0.2837 mse 0.2866 t 771 new 0.16) lr 1.00e-05 gnorm 0.150 3.31s mem 81.1GB +step 1194/5000 loss 0.2254 (w 0.3366 mse 0.3620 t 980 new 0.13) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +step 1195/5000 loss 0.2121 (w 0.3388 mse 0.3433 t 976 new 0.14) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +step 1196/5000 loss 0.1823 (w 0.2863 mse 0.3031 t 424 new 0.20) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +step 1197/5000 loss 0.3423 (w 0.3048 mse 0.3253 t 660 new 0.22) lr 1.00e-05 gnorm 0.130 3.11s mem 81.1GB +step 1198/5000 loss 0.2900 (w 0.3243 mse 0.3173 t 894 new 0.20) lr 1.00e-05 gnorm 0.148 3.45s mem 81.1GB +step 1199/5000 loss 0.1539 (w 0.3513 mse 0.3476 t 895 new 0.20) lr 1.00e-05 gnorm 0.121 3.29s mem 81.1GB +step 1200/5000 loss 0.4265 (w 0.3429 mse 0.3553 t 264 new 0.17) lr 1.00e-05 gnorm 0.159 3.15s mem 81.1GB +step 1201/5000 loss 0.2248 (w 0.2942 mse 0.3046 t 948 new 0.13) lr 1.00e-05 gnorm 0.177 2.83s mem 81.1GB +step 1202/5000 loss 0.3113 (w 0.3287 mse 0.3296 t 855 new 0.21) lr 1.00e-05 gnorm 0.134 3.06s mem 81.1GB +step 1203/5000 loss 0.3809 (w 0.2158 mse 0.2321 t 890 new 0.17) lr 1.00e-05 gnorm 0.250 3.12s mem 81.1GB +step 1204/5000 loss 0.3466 (w 0.2665 mse 0.2768 t 626 new 0.17) lr 1.00e-05 gnorm 0.186 3.50s mem 81.1GB +step 1205/5000 loss 0.3488 (w 0.2494 mse 0.2633 t 428 new 0.18) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +step 1206/5000 loss 0.3500 (w 0.1562 mse 0.1707 t 731 new 0.11) lr 1.00e-05 gnorm 0.130 3.09s mem 81.1GB +step 1207/5000 loss 0.3008 (w 0.4967 mse 0.5160 t 206 new 0.22) lr 1.00e-05 gnorm 0.227 2.83s mem 81.1GB +step 1208/5000 loss 0.2475 (w 0.2214 mse 0.2310 t 953 new 0.24) lr 1.00e-05 gnorm 0.184 3.06s mem 81.1GB +step 1209/5000 loss 0.2466 (w 0.2793 mse 0.3095 t 998 new 0.22) lr 1.00e-05 gnorm 0.176 3.19s mem 81.1GB +step 1210/5000 loss 0.2275 (w 0.2069 mse 0.2204 t 803 new 0.19) lr 1.00e-05 gnorm 0.145 3.11s mem 81.1GB +step 1211/5000 loss 0.5491 (w 0.3265 mse 0.3342 t 610 new 0.22) lr 1.00e-05 gnorm 0.226 3.30s mem 81.1GB +step 1212/5000 loss 0.2757 (w 0.2273 mse 0.2507 t 892 new 0.17) lr 1.00e-05 gnorm 0.471 3.07s mem 81.1GB +step 1213/5000 loss 0.1983 (w 0.2414 mse 0.2532 t 987 new 0.22) lr 1.00e-05 gnorm 0.168 2.82s mem 81.1GB +step 1214/5000 loss 0.2593 (w 0.2554 mse 0.2621 t 904 new 0.20) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +step 1215/5000 loss 0.2444 (w 0.6008 mse 0.6071 t 134 new 0.20) lr 1.00e-05 gnorm 0.184 3.35s mem 81.1GB +step 1216/5000 loss 0.1389 (w 0.3650 mse 0.3726 t 984 new 0.19) lr 1.00e-05 gnorm 0.106 3.23s mem 81.1GB +step 1217/5000 loss 0.3334 (w 0.3042 mse 0.3083 t 949 new 0.20) lr 1.00e-05 gnorm 0.169 3.29s mem 81.1GB +step 1218/5000 loss 0.1508 (w 0.3682 mse 0.3767 t 968 new 0.20) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +step 1219/5000 loss 0.1381 (w 0.3269 mse 0.3360 t 914 new 0.17) lr 1.00e-05 gnorm 0.133 3.04s mem 81.1GB +step 1220/5000 loss 0.3321 (w 0.2500 mse 0.2481 t 951 new 0.12) lr 1.00e-05 gnorm 0.185 2.84s mem 81.1GB +step 1221/5000 loss 0.2871 (w 0.3160 mse 0.3222 t 919 new 0.22) lr 1.00e-05 gnorm 0.191 3.60s mem 81.1GB +step 1222/5000 loss 0.2308 (w 0.4649 mse 0.4593 t 974 new 0.22) lr 1.00e-05 gnorm 0.125 3.28s mem 81.1GB +step 1223/5000 loss 0.2166 (w 0.2345 mse 0.2628 t 971 new 0.22) lr 1.00e-05 gnorm 0.163 3.37s mem 81.1GB +step 1224/5000 loss 0.2817 (w 0.3353 mse 0.3352 t 804 new 0.19) lr 1.00e-05 gnorm 0.169 2.82s mem 81.1GB +step 1225/5000 loss 0.2239 (w 0.3739 mse 0.3772 t 951 new 0.28) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +step 1226/5000 loss 0.2824 (w 0.3780 mse 0.3845 t 996 new 0.22) lr 1.00e-05 gnorm 0.134 3.03s mem 81.1GB +step 1227/5000 loss 0.2665 (w 0.2951 mse 0.2974 t 844 new 0.24) lr 1.00e-05 gnorm 0.216 3.13s mem 81.1GB +step 1228/5000 loss 0.3663 (w 0.2557 mse 0.2707 t 889 new 0.15) lr 1.00e-05 gnorm 0.134 3.01s mem 81.1GB +step 1229/5000 loss 0.4046 (w 0.2247 mse 0.2475 t 965 new 0.20) lr 1.00e-05 gnorm 0.645 3.05s mem 81.1GB +step 1230/5000 loss 0.2864 (w 0.3363 mse 0.3366 t 665 new 0.21) lr 1.00e-05 gnorm 0.850 3.70s mem 81.1GB +step 1231/5000 loss 0.2126 (w 0.3061 mse 0.3109 t 809 new 0.23) lr 1.00e-05 gnorm 0.263 3.05s mem 81.1GB +step 1232/5000 loss 0.2469 (w 0.3532 mse 0.3585 t 984 new 0.21) lr 1.00e-05 gnorm 0.144 3.06s mem 81.1GB +step 1233/5000 loss 0.2362 (w 0.3520 mse 0.3552 t 437 new 0.16) lr 1.00e-05 gnorm 0.147 3.12s mem 81.1GB +step 1234/5000 loss 0.1630 (w 0.2590 mse 0.2714 t 987 new 0.15) lr 1.00e-05 gnorm 0.130 3.25s mem 81.1GB +step 1235/5000 loss 0.2552 (w 0.2907 mse 0.2946 t 967 new 0.12) lr 1.00e-05 gnorm 0.120 3.09s mem 81.1GB +step 1236/5000 loss 0.2927 (w 0.2757 mse 0.2772 t 809 new 0.26) lr 1.00e-05 gnorm 0.211 2.83s mem 81.1GB +step 1237/5000 loss 0.3485 (w 0.3338 mse 0.3227 t 889 new 0.27) lr 1.00e-05 gnorm 0.183 3.07s mem 81.1GB +step 1238/5000 loss 0.1923 (w 0.3059 mse 0.3060 t 952 new 0.21) lr 1.00e-05 gnorm 0.151 3.12s mem 81.1GB +step 1239/5000 loss 0.3896 (w 0.2830 mse 0.2936 t 809 new 0.24) lr 1.00e-05 gnorm 0.267 3.39s mem 81.1GB +step 1240/5000 loss 0.2852 (w 0.4019 mse 0.4030 t 920 new 0.19) lr 1.00e-05 gnorm 0.195 3.03s mem 81.1GB +step 1241/5000 loss 0.2631 (w 0.3298 mse 0.3337 t 766 new 0.18) lr 1.00e-05 gnorm 0.205 3.11s mem 81.1GB +step 1242/5000 loss 0.3549 (w 0.2255 mse 0.2394 t 794 new 0.22) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +step 1243/5000 loss 0.1994 (w 0.3212 mse 0.3244 t 960 new 0.19) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +step 1244/5000 loss 0.2140 (w 0.2957 mse 0.3038 t 992 new 0.26) lr 1.00e-05 gnorm 0.128 3.13s mem 81.1GB +step 1245/5000 loss 0.2285 (w 0.2792 mse 0.2781 t 901 new 0.20) lr 1.00e-05 gnorm 0.151 3.31s mem 81.1GB +step 1246/5000 loss 0.3269 (w 0.2190 mse 0.2413 t 421 new 0.16) lr 1.00e-05 gnorm 0.196 3.05s mem 81.1GB +step 1247/5000 loss 0.2760 (w 0.6852 mse 0.6543 t 998 new 0.19) lr 1.00e-05 gnorm 0.235 3.12s mem 81.1GB +step 1248/5000 loss 0.2018 (w 0.2813 mse 0.2896 t 663 new 0.15) lr 1.00e-05 gnorm 0.205 2.83s mem 81.1GB +step 1249/5000 loss 0.3265 (w 0.3907 mse 0.4110 t 288 new 0.27) lr 1.00e-05 gnorm 0.162 3.13s mem 81.1GB +step 1250/5000 loss 0.2037 (w 0.1920 mse 0.1998 t 906 new 0.19) lr 1.00e-05 gnorm 0.157 3.07s mem 81.1GB +step 1251/5000 loss 0.1337 (w 0.4284 mse 0.4225 t 983 new 0.21) lr 1.00e-05 gnorm 0.137 3.46s mem 81.1GB +step 1252/5000 loss 0.2175 (w 0.4469 mse 0.4705 t 140 new 0.24) lr 1.00e-05 gnorm 0.292 3.05s mem 81.1GB +step 1253/5000 loss 0.4981 (w 0.3588 mse 0.3569 t 819 new 0.23) lr 1.00e-05 gnorm 0.184 3.04s mem 81.1GB +step 1254/5000 loss 0.2155 (w 0.2919 mse 0.3238 t 973 new 0.15) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +step 1255/5000 loss 0.2763 (w 0.3386 mse 0.3509 t 990 new 0.20) lr 1.00e-05 gnorm 0.149 2.82s mem 81.1GB +step 1256/5000 loss 0.3463 (w 0.2238 mse 0.2343 t 925 new 0.27) lr 1.00e-05 gnorm 0.174 3.39s mem 81.1GB +step 1257/5000 loss 0.2852 (w 0.3517 mse 0.3576 t 929 new 0.22) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +step 1258/5000 loss 0.2133 (w 0.2731 mse 0.2697 t 849 new 0.18) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +step 1259/5000 loss 0.1851 (w 0.1911 mse 0.2003 t 750 new 0.21) lr 1.00e-05 gnorm 0.139 3.06s mem 81.1GB +step 1260/5000 loss 0.1969 (w 0.4363 mse 0.4311 t 975 new 0.22) lr 1.00e-05 gnorm 0.170 3.12s mem 81.1GB +step 1261/5000 loss 0.2998 (w 0.3807 mse 0.3857 t 981 new 0.23) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +step 1262/5000 loss 0.4686 (w 0.1790 mse 0.1886 t 590 new 0.14) lr 1.00e-05 gnorm 0.119 3.39s mem 81.1GB +step 1263/5000 loss 0.2650 (w 0.1864 mse 0.1952 t 862 new 0.14) lr 1.00e-05 gnorm 0.155 3.04s mem 81.1GB +step 1264/5000 loss 0.2122 (w 0.2643 mse 0.2740 t 926 new 0.26) lr 1.00e-05 gnorm 0.286 3.29s mem 81.1GB +step 1265/5000 loss 0.1936 (w 0.3078 mse 0.3122 t 390 new 0.22) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +step 1266/5000 loss 0.2572 (w 0.2654 mse 0.2734 t 904 new 0.22) lr 1.00e-05 gnorm 0.172 3.03s mem 81.1GB +step 1267/5000 loss 0.2230 (w 0.3135 mse 0.3311 t 993 new 0.17) lr 1.00e-05 gnorm 0.122 2.82s mem 81.1GB +step 1268/5000 loss 0.2298 (w 0.4222 mse 0.4293 t 935 new 0.19) lr 1.00e-05 gnorm 0.205 3.10s mem 81.1GB +step 1269/5000 loss 0.2198 (w 0.3209 mse 0.3207 t 839 new 0.19) lr 1.00e-05 gnorm 0.348 3.08s mem 81.1GB +step 1270/5000 loss 0.2396 (w 0.1989 mse 0.2232 t 829 new 0.24) lr 1.00e-05 gnorm 0.152 3.31s mem 81.1GB +step 1271/5000 loss 0.3130 (w 0.3476 mse 0.3399 t 988 new 0.18) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +step 1272/5000 loss 0.1836 (w 0.4587 mse 0.4557 t 970 new 0.19) lr 1.00e-05 gnorm 0.121 3.03s mem 81.1GB +step 1273/5000 loss 0.2473 (w 0.2954 mse 0.3171 t 983 new 0.19) lr 1.00e-05 gnorm 0.320 3.05s mem 81.1GB +step 1274/5000 loss 0.2759 (w 0.2363 mse 0.2559 t 924 new 0.23) lr 1.00e-05 gnorm 0.102 3.15s mem 81.1GB +step 1275/5000 loss 0.2476 (w 0.4005 mse 0.4128 t 977 new 0.23) lr 1.00e-05 gnorm 0.159 3.30s mem 81.1GB +step 1276/5000 loss 0.4547 (w 0.3099 mse 0.3167 t 616 new 0.27) lr 1.00e-05 gnorm 0.163 3.42s mem 81.1GB +step 1277/5000 loss 0.4315 (w 0.2932 mse 0.2946 t 954 new 0.21) lr 1.00e-05 gnorm 0.138 2.81s mem 81.1GB +step 1278/5000 loss 0.4227 (w 0.3621 mse 0.3512 t 862 new 0.22) lr 1.00e-05 gnorm 0.283 3.11s mem 81.1GB +step 1279/5000 loss 0.1835 (w 0.3186 mse 0.3373 t 963 new 0.27) lr 1.00e-05 gnorm 0.130 3.15s mem 81.1GB +step 1280/5000 loss 0.3077 (w 0.3306 mse 0.3279 t 963 new 0.26) lr 1.00e-05 gnorm 0.506 3.09s mem 81.1GB +step 1281/5000 loss 0.3009 (w 0.2529 mse 0.2710 t 984 new 0.12) lr 1.00e-05 gnorm 0.104 3.10s mem 81.1GB +step 1282/5000 loss 0.1012 (w 0.3239 mse 0.3314 t 891 new 0.16) lr 1.00e-05 gnorm 0.127 3.34s mem 81.1GB +step 1283/5000 loss 0.4483 (w 0.3047 mse 0.2997 t 878 new 0.07) lr 1.00e-05 gnorm 0.134 3.05s mem 81.1GB +step 1284/5000 loss 0.2674 (w 0.2904 mse 0.2794 t 927 new 0.19) lr 1.00e-05 gnorm 0.118 2.83s mem 81.1GB +step 1285/5000 loss 0.2895 (w 0.2882 mse 0.2895 t 692 new 0.15) lr 1.00e-05 gnorm 0.165 3.30s mem 81.1GB +step 1286/5000 loss 0.1949 (w 0.2982 mse 0.3042 t 949 new 0.22) lr 1.00e-05 gnorm 0.111 3.06s mem 81.1GB +step 1287/5000 loss 0.2750 (w 0.3509 mse 0.3523 t 953 new 0.18) lr 1.00e-05 gnorm 0.187 3.04s mem 81.1GB +step 1288/5000 loss 0.4244 (w 0.2923 mse 0.3080 t 855 new 0.22) lr 1.00e-05 gnorm 0.136 3.13s mem 81.1GB +step 1289/5000 loss 0.2846 (w 0.2104 mse 0.2158 t 702 new 0.07) lr 1.00e-05 gnorm 0.216 3.09s mem 81.1GB +step 1290/5000 loss 0.2563 (w 0.2040 mse 0.2261 t 866 new 0.24) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +step 1291/5000 loss 0.3470 (w 0.2678 mse 0.2764 t 995 new 0.23) lr 1.00e-05 gnorm 0.170 3.38s mem 81.1GB +step 1292/5000 loss 0.1658 (w 0.2744 mse 0.2832 t 892 new 0.25) lr 1.00e-05 gnorm 0.132 3.05s mem 81.1GB +step 1293/5000 loss 0.3716 (w 0.2056 mse 0.2052 t 940 new 0.18) lr 1.00e-05 gnorm 0.155 3.07s mem 81.1GB +step 1294/5000 loss 0.2639 (w 0.2687 mse 0.2844 t 826 new 0.23) lr 1.00e-05 gnorm 0.172 3.13s mem 81.1GB +step 1295/5000 loss 0.2525 (w 0.2677 mse 0.2704 t 899 new 0.26) lr 1.00e-05 gnorm 0.132 3.11s mem 81.1GB +step 1296/5000 loss 0.5694 (w 0.3790 mse 0.3775 t 553 new 0.09) lr 1.00e-05 gnorm 0.171 3.13s mem 81.1GB +step 1297/5000 loss 0.2503 (w 0.2589 mse 0.2575 t 890 new 0.19) lr 1.00e-05 gnorm 0.169 3.14s mem 81.1GB +step 1298/5000 loss 0.4131 (w 0.2597 mse 0.2691 t 876 new 0.18) lr 1.00e-05 gnorm 0.202 3.08s mem 81.1GB +step 1299/5000 loss 0.2874 (w 0.2412 mse 0.2594 t 619 new 0.15) lr 1.00e-05 gnorm 0.172 3.34s mem 81.1GB +step 1300/5000 loss 0.2899 (w 0.2294 mse 0.2437 t 939 new 0.18) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +step 1301/5000 loss 0.3180 (w 0.1827 mse 0.1894 t 720 new 0.14) lr 1.00e-05 gnorm 0.213 3.12s mem 81.1GB +step 1302/5000 loss 0.3184 (w 0.2319 mse 0.2405 t 820 new 0.09) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +step 1303/5000 loss 0.5292 (w 0.4103 mse 0.4199 t 390 new 0.19) lr 1.00e-05 gnorm 0.129 3.12s mem 81.1GB +step 1304/5000 loss 0.3693 (w 0.3852 mse 0.4031 t 995 new 0.16) lr 1.00e-05 gnorm 0.240 3.10s mem 81.1GB +step 1305/5000 loss 0.2721 (w 0.2505 mse 0.2524 t 717 new 0.14) lr 1.00e-05 gnorm 0.160 3.29s mem 81.1GB +step 1306/5000 loss 0.2713 (w 0.2907 mse 0.2997 t 989 new 0.24) lr 1.00e-05 gnorm 0.159 3.16s mem 81.1GB +step 1307/5000 loss 0.2617 (w 0.2808 mse 0.2876 t 982 new 0.23) lr 1.00e-05 gnorm 0.168 3.04s mem 81.1GB +step 1308/5000 loss 0.2865 (w 0.3355 mse 0.3426 t 912 new 0.23) lr 1.00e-05 gnorm 0.185 3.39s mem 81.1GB +step 1309/5000 loss 0.4043 (w 0.2402 mse 0.2511 t 884 new 0.23) lr 1.00e-05 gnorm 0.181 3.08s mem 81.1GB +step 1310/5000 loss 0.1669 (w 0.3793 mse 0.3840 t 997 new 0.22) lr 1.00e-05 gnorm 0.142 3.14s mem 81.1GB +step 1311/5000 loss 0.1436 (w 0.4086 mse 0.3987 t 988 new 0.22) lr 1.00e-05 gnorm 0.111 3.33s mem 81.1GB +step 1312/5000 loss 0.1801 (w 0.2970 mse 0.3012 t 786 new 0.23) lr 1.00e-05 gnorm 0.146 2.82s mem 81.1GB +step 1313/5000 loss 0.3412 (w 0.2872 mse 0.3015 t 473 new 0.19) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +step 1314/5000 loss 0.2768 (w 0.5647 mse 0.5521 t 986 new 0.18) lr 1.00e-05 gnorm 0.202 3.10s mem 81.1GB +step 1315/5000 loss 0.4068 (w 0.2382 mse 0.2486 t 992 new 0.19) lr 1.00e-05 gnorm 0.271 3.35s mem 81.1GB +step 1316/5000 loss 0.2346 (w 0.3538 mse 0.3617 t 601 new 0.18) lr 1.00e-05 gnorm 0.265 3.02s mem 81.1GB +step 1317/5000 loss 0.3120 (w 0.3789 mse 0.3707 t 776 new 0.23) lr 1.00e-05 gnorm 0.129 3.38s mem 81.1GB +step 1318/5000 loss 0.2844 (w 0.2916 mse 0.2984 t 914 new 0.16) lr 1.00e-05 gnorm 0.148 3.01s mem 81.1GB +step 1319/5000 loss 0.2545 (w 0.2988 mse 0.3062 t 885 new 0.23) lr 1.00e-05 gnorm 0.196 2.83s mem 81.1GB +step 1320/5000 loss 0.3192 (w 0.4581 mse 0.4771 t 983 new 0.19) lr 1.00e-05 gnorm 0.144 3.36s mem 81.1GB +step 1321/5000 loss 0.3075 (w 0.2889 mse 0.2870 t 885 new 0.21) lr 1.00e-05 gnorm 8.285 3.04s mem 81.1GB +step 1322/5000 loss 0.4932 (w 0.2480 mse 0.2600 t 814 new 0.21) lr 1.00e-05 gnorm 0.157 3.06s mem 81.1GB +step 1323/5000 loss 0.3987 (w 0.4260 mse 0.4480 t 228 new 0.17) lr 1.00e-05 gnorm 0.195 3.43s mem 81.1GB +step 1324/5000 loss 0.2217 (w 0.4478 mse 0.4271 t 998 new 0.20) lr 1.00e-05 gnorm 0.129 3.00s mem 81.1GB +step 1325/5000 loss 0.2225 (w 0.4797 mse 0.4684 t 998 new 0.23) lr 1.00e-05 gnorm 0.324 2.82s mem 81.1GB +step 1326/5000 loss 0.4015 (w 0.3420 mse 0.3285 t 974 new 0.18) lr 1.00e-05 gnorm 0.217 3.37s mem 81.1GB +step 1327/5000 loss 0.3541 (w 0.2803 mse 0.2859 t 710 new 0.09) lr 1.00e-05 gnorm 0.203 3.02s mem 81.1GB +step 1328/5000 loss 0.3163 (w 0.4561 mse 0.4721 t 297 new 0.29) lr 1.00e-05 gnorm 0.217 3.09s mem 81.1GB +step 1329/5000 loss 0.3222 (w 0.2847 mse 0.2929 t 959 new 0.20) lr 1.00e-05 gnorm 0.168 3.44s mem 81.1GB +step 1330/5000 loss 0.3100 (w 0.4301 mse 0.4511 t 985 new 0.20) lr 1.00e-05 gnorm 0.312 3.00s mem 81.1GB +step 1331/5000 loss 0.1338 (w 0.4169 mse 0.4181 t 968 new 0.18) lr 1.00e-05 gnorm 0.140 2.82s mem 81.1GB +step 1332/5000 loss 0.3846 (w 0.2721 mse 0.2751 t 866 new 0.20) lr 1.00e-05 gnorm 0.174 3.15s mem 81.1GB +step 1333/5000 loss 0.1816 (w 0.2462 mse 0.2606 t 975 new 0.10) lr 1.00e-05 gnorm 0.213 3.00s mem 81.1GB +step 1334/5000 loss 0.2024 (w 0.2698 mse 0.2841 t 863 new 0.18) lr 1.00e-05 gnorm 0.181 3.01s mem 81.1GB +step 1335/5000 loss 0.2460 (w 0.4803 mse 0.4614 t 992 new 0.20) lr 1.00e-05 gnorm 0.210 3.07s mem 81.1GB +step 1336/5000 loss 0.3955 (w 0.3226 mse 0.3215 t 737 new 0.15) lr 1.00e-05 gnorm 0.142 3.04s mem 81.1GB +step 1337/5000 loss 0.1977 (w 0.2677 mse 0.2631 t 718 new 0.20) lr 1.00e-05 gnorm 0.123 3.07s mem 81.1GB +step 1338/5000 loss 0.1262 (w 0.2907 mse 0.3008 t 956 new 0.11) lr 1.00e-05 gnorm 0.156 3.10s mem 81.1GB +step 1339/5000 loss 0.3243 (w 0.3689 mse 0.3618 t 663 new 0.19) lr 1.00e-05 gnorm 0.160 3.04s mem 81.1GB +step 1340/5000 loss 0.4938 (w 0.3406 mse 0.3440 t 973 new 0.12) lr 1.00e-05 gnorm 0.155 3.07s mem 81.1GB +step 1341/5000 loss 0.3289 (w 0.3247 mse 0.3225 t 881 new 0.21) lr 1.00e-05 gnorm 0.152 3.08s mem 81.1GB +step 1342/5000 loss 0.1014 (w 0.3690 mse 0.3915 t 987 new 0.23) lr 1.00e-05 gnorm 0.115 3.03s mem 81.1GB +step 1343/5000 loss 0.2516 (w 0.3750 mse 0.3829 t 986 new 0.21) lr 1.00e-05 gnorm 0.141 3.07s mem 81.1GB +step 1344/5000 loss 0.3735 (w 0.2785 mse 0.3060 t 578 new 0.18) lr 1.00e-05 gnorm 0.135 3.10s mem 81.1GB +step 1345/5000 loss 0.3557 (w 0.2510 mse 0.2570 t 927 new 0.21) lr 1.00e-05 gnorm 0.157 3.00s mem 81.1GB +step 1346/5000 loss 0.3608 (w 0.4709 mse 0.4813 t 348 new 0.13) lr 1.00e-05 gnorm 0.116 3.27s mem 81.1GB +step 1347/5000 loss 0.4436 (w 0.2610 mse 0.2725 t 817 new 0.22) lr 1.00e-05 gnorm 0.146 3.08s mem 81.1GB +step 1348/5000 loss 0.2148 (w 0.3025 mse 0.3199 t 966 new 0.15) lr 1.00e-05 gnorm 0.116 3.02s mem 81.1GB +step 1349/5000 loss 0.2617 (w 0.2997 mse 0.2933 t 948 new 0.21) lr 1.00e-05 gnorm 0.168 3.13s mem 81.1GB +step 1350/5000 loss 0.2947 (w 0.2085 mse 0.2176 t 850 new 0.15) lr 1.00e-05 gnorm 0.187 2.82s mem 81.1GB +step 1351/5000 loss 0.2623 (w 0.2113 mse 0.2118 t 677 new 0.01) lr 1.00e-05 gnorm 0.206 3.04s mem 81.1GB +step 1352/5000 loss 0.4126 (w 0.3406 mse 0.3418 t 871 new 0.17) lr 1.00e-05 gnorm 0.211 3.34s mem 81.1GB +step 1353/5000 loss 0.3724 (w 0.3420 mse 0.3405 t 540 new 0.27) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +step 1354/5000 loss 0.1541 (w 0.4365 mse 0.4434 t 987 new 0.19) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +step 1355/5000 loss 0.4526 (w 0.2761 mse 0.2870 t 884 new 0.17) lr 1.00e-05 gnorm 0.158 3.09s mem 81.1GB +step 1356/5000 loss 0.4262 (w 0.3656 mse 0.3550 t 978 new 0.22) lr 1.00e-05 gnorm 0.260 3.01s mem 81.1GB +step 1357/5000 loss 0.2470 (w 0.2650 mse 0.2673 t 898 new 0.19) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +step 1358/5000 loss 0.2851 (w 0.3846 mse 0.3866 t 999 new 0.20) lr 1.00e-05 gnorm 0.141 3.30s mem 81.1GB +step 1359/5000 loss 0.1438 (w 0.2540 mse 0.2547 t 875 new 0.10) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +step 1360/5000 loss 0.3895 (w 0.2658 mse 0.2700 t 890 new 0.21) lr 1.00e-05 gnorm 0.143 3.04s mem 81.1GB +step 1361/5000 loss 0.2179 (w 0.1662 mse 0.1929 t 904 new 0.19) lr 1.00e-05 gnorm 0.139 3.11s mem 81.1GB +step 1362/5000 loss 0.2077 (w 0.2272 mse 0.2357 t 923 new 0.22) lr 1.00e-05 gnorm 0.161 3.01s mem 81.1GB +step 1363/5000 loss 0.3094 (w 0.4531 mse 0.4394 t 972 new 0.19) lr 1.00e-05 gnorm 0.139 2.81s mem 81.1GB +step 1364/5000 loss 0.4137 (w 0.3253 mse 0.3453 t 980 new 0.14) lr 1.00e-05 gnorm 0.150 3.29s mem 81.1GB +step 1365/5000 loss 0.4314 (w 0.3289 mse 0.3302 t 562 new 0.21) lr 1.00e-05 gnorm 0.156 3.09s mem 81.1GB +step 1366/5000 loss 0.3442 (w 0.2847 mse 0.2807 t 841 new 0.21) lr 1.00e-05 gnorm 0.106 3.02s mem 81.1GB +step 1367/5000 loss 0.3213 (w 0.5129 mse 0.5252 t 212 new 0.18) lr 1.00e-05 gnorm 0.210 3.14s mem 81.1GB +step 1368/5000 loss 0.4513 (w 0.2390 mse 0.2470 t 719 new 0.12) lr 1.00e-05 gnorm 0.135 3.03s mem 81.1GB +step 1369/5000 loss 0.1059 (w 0.2383 mse 0.2496 t 969 new 0.22) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 1370/5000 loss 0.3608 (w 0.1946 mse 0.2097 t 666 new 0.21) lr 1.00e-05 gnorm 0.183 3.34s mem 81.1GB +step 1371/5000 loss 0.3795 (w 0.2830 mse 0.2903 t 931 new 0.22) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +step 1372/5000 loss 0.3204 (w 0.2948 mse 0.3023 t 815 new 0.24) lr 1.00e-05 gnorm 0.151 3.05s mem 81.1GB +step 1373/5000 loss 0.3319 (w 0.3379 mse 0.3346 t 878 new 0.20) lr 1.00e-05 gnorm 0.137 3.08s mem 81.1GB +step 1374/5000 loss 0.2787 (w 0.3173 mse 0.3161 t 955 new 0.28) lr 1.00e-05 gnorm 0.124 3.01s mem 81.1GB +step 1375/5000 loss 0.3877 (w 0.2771 mse 0.2820 t 999 new 0.10) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +step 1376/5000 loss 0.2967 (w 0.2646 mse 0.2829 t 944 new 0.21) lr 1.00e-05 gnorm 0.158 3.07s mem 81.1GB +step 1377/5000 loss 0.3711 (w 0.2985 mse 0.3122 t 808 new 0.26) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +step 1378/5000 loss 0.3529 (w 0.2493 mse 0.2595 t 950 new 0.19) lr 1.00e-05 gnorm 0.145 3.09s mem 81.1GB +step 1379/5000 loss 0.2446 (w 0.2704 mse 0.2869 t 790 new 0.17) lr 1.00e-05 gnorm 0.161 3.09s mem 81.1GB +step 1380/5000 loss 0.2413 (w 0.3437 mse 0.3521 t 970 new 0.07) lr 1.00e-05 gnorm 0.103 3.03s mem 81.1GB +step 1381/5000 loss 0.2720 (w 0.3647 mse 0.3646 t 892 new 0.21) lr 1.00e-05 gnorm 0.142 2.82s mem 81.1GB +step 1382/5000 loss 0.2683 (w 0.2507 mse 0.2707 t 941 new 0.22) lr 1.00e-05 gnorm 0.141 3.13s mem 81.1GB +step 1383/5000 loss 0.3576 (w 0.3294 mse 0.3381 t 479 new 0.19) lr 1.00e-05 gnorm 0.196 3.27s mem 81.1GB +step 1384/5000 loss 0.4502 (w 0.2193 mse 0.2238 t 815 new 0.23) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +step 1385/5000 loss 0.4046 (w 0.7409 mse 0.7296 t 100 new 0.15) lr 1.00e-05 gnorm 0.181 3.24s mem 81.1GB +step 1386/5000 loss 0.2443 (w 0.2801 mse 0.2836 t 836 new 0.21) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 1387/5000 loss 0.2334 (w 0.2572 mse 0.2702 t 906 new 0.23) lr 1.00e-05 gnorm 0.109 3.14s mem 81.1GB +step 1388/5000 loss 0.1515 (w 0.2095 mse 0.2243 t 886 new 0.24) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +step 1389/5000 loss 0.3476 (w 0.2757 mse 0.2999 t 988 new 0.25) lr 1.00e-05 gnorm 0.138 3.31s mem 81.1GB +step 1390/5000 loss 0.2805 (w 0.2155 mse 0.2195 t 897 new 0.21) lr 1.00e-05 gnorm 0.138 3.07s mem 81.1GB +step 1391/5000 loss 0.3702 (w 0.2257 mse 0.2422 t 712 new 0.18) lr 1.00e-05 gnorm 0.129 3.28s mem 81.1GB +step 1392/5000 loss 0.3597 (w 0.1735 mse 0.1917 t 916 new 0.14) lr 1.00e-05 gnorm 0.212 2.82s mem 81.1GB +step 1393/5000 loss 0.2704 (w 0.2464 mse 0.2515 t 858 new 0.20) lr 1.00e-05 gnorm 0.784 3.07s mem 81.1GB +step 1394/5000 loss 0.3388 (w 0.2768 mse 0.2985 t 983 new 0.27) lr 1.00e-05 gnorm 0.108 3.09s mem 81.1GB +step 1395/5000 loss 0.2850 (w 0.2579 mse 0.2725 t 758 new 0.13) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +step 1396/5000 loss 0.1361 (w 0.3029 mse 0.3261 t 974 new 0.22) lr 1.00e-05 gnorm 0.137 3.45s mem 81.1GB +step 1397/5000 loss 0.3715 (w 0.2217 mse 0.2341 t 908 new 0.24) lr 1.00e-05 gnorm 0.181 3.01s mem 81.1GB +step 1398/5000 loss 0.4238 (w 0.3699 mse 0.3930 t 200 new 0.26) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +step 1399/5000 loss 0.2508 (w 0.3009 mse 0.3075 t 773 new 0.22) lr 1.00e-05 gnorm 0.519 3.36s mem 81.1GB +step 1400/5000 loss 0.1985 (w 0.3801 mse 0.3891 t 983 new 0.24) lr 1.00e-05 gnorm 0.179 3.01s mem 81.1GB +step 1401/5000 loss 0.1364 (w 0.2887 mse 0.3021 t 953 new 0.21) lr 1.00e-05 gnorm 0.205 3.04s mem 81.1GB +step 1402/5000 loss 0.1759 (w 0.4103 mse 0.4022 t 715 new 0.20) lr 1.00e-05 gnorm 0.275 3.33s mem 81.1GB +step 1403/5000 loss 0.1725 (w 0.2647 mse 0.2723 t 945 new 0.15) lr 1.00e-05 gnorm 0.149 3.05s mem 81.1GB +step 1404/5000 loss 0.4354 (w 0.2349 mse 0.2591 t 570 new 0.16) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +step 1405/5000 loss 0.2751 (w 0.3158 mse 0.3200 t 959 new 0.20) lr 1.00e-05 gnorm 0.119 3.38s mem 81.1GB +step 1406/5000 loss 0.2030 (w 0.4913 mse 0.5002 t 985 new 0.22) lr 1.00e-05 gnorm 0.120 3.02s mem 81.1GB +step 1407/5000 loss 0.1951 (w 0.2527 mse 0.2581 t 951 new 0.20) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +step 1408/5000 loss 0.2010 (w 0.2607 mse 0.2836 t 981 new 0.22) lr 1.00e-05 gnorm 0.110 3.40s mem 81.1GB +step 1409/5000 loss 0.3493 (w 0.3110 mse 0.3354 t 975 new 0.25) lr 1.00e-05 gnorm 0.113 3.01s mem 81.1GB +step 1410/5000 loss 0.4956 (w 0.4181 mse 0.4325 t 233 new 0.20) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +step 1411/5000 loss 0.2617 (w 0.2275 mse 0.2417 t 731 new 0.27) lr 1.00e-05 gnorm 0.135 3.32s mem 81.1GB +step 1412/5000 loss 0.2144 (w 0.1878 mse 0.2054 t 924 new 0.15) lr 1.00e-05 gnorm 0.203 3.03s mem 81.1GB +step 1413/5000 loss 0.2518 (w 0.2375 mse 0.2361 t 819 new 0.19) lr 1.00e-05 gnorm 0.139 3.15s mem 81.1GB +step 1414/5000 loss 0.2783 (w 0.2125 mse 0.2253 t 899 new 0.13) lr 1.00e-05 gnorm 0.170 3.06s mem 81.1GB +step 1415/5000 loss 0.1747 (w 0.5367 mse 0.5497 t 987 new 0.25) lr 1.00e-05 gnorm 0.239 3.03s mem 81.1GB +step 1416/5000 loss 0.2661 (w 0.5771 mse 0.5710 t 200 new 0.19) lr 1.00e-05 gnorm 0.202 2.82s mem 81.1GB +step 1417/5000 loss 0.2943 (w 0.2087 mse 0.2242 t 890 new 0.23) lr 1.00e-05 gnorm 0.159 3.05s mem 81.1GB +step 1418/5000 loss 0.1870 (w 0.2907 mse 0.2997 t 760 new 0.20) lr 1.00e-05 gnorm 0.113 3.30s mem 81.1GB +step 1419/5000 loss 0.1110 (w 0.3036 mse 0.3074 t 980 new 0.22) lr 1.00e-05 gnorm 0.147 3.12s mem 81.1GB +step 1420/5000 loss 0.2578 (w 0.2413 mse 0.2378 t 727 new 0.09) lr 1.00e-05 gnorm 0.120 3.07s mem 81.1GB +step 1421/5000 loss 0.2196 (w 0.4053 mse 0.3937 t 953 new 0.16) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +step 1422/5000 loss 0.4448 (w 0.4151 mse 0.4315 t 301 new 0.25) lr 1.00e-05 gnorm 0.147 3.00s mem 81.1GB +step 1423/5000 loss 0.3849 (w 0.4013 mse 0.4253 t 383 new 0.21) lr 1.00e-05 gnorm 0.158 3.13s mem 81.1GB +step 1424/5000 loss 0.2667 (w 0.2996 mse 0.2998 t 799 new 0.10) lr 1.00e-05 gnorm 0.127 3.31s mem 81.1GB +step 1425/5000 loss 0.1484 (w 0.2486 mse 0.2555 t 744 new 0.23) lr 1.00e-05 gnorm 0.130 3.12s mem 81.1GB +step 1426/5000 loss 0.4222 (w 0.2848 mse 0.2855 t 506 new 0.20) lr 1.00e-05 gnorm 0.151 3.11s mem 81.1GB +step 1427/5000 loss 0.2912 (w 0.3244 mse 0.3214 t 841 new 0.18) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +step 1428/5000 loss 0.2309 (w 0.2325 mse 0.2364 t 747 new 0.21) lr 1.00e-05 gnorm 0.100 3.05s mem 81.1GB +step 1429/5000 loss 0.4846 (w 0.4769 mse 0.4924 t 233 new 0.14) lr 1.00e-05 gnorm 0.118 3.01s mem 81.1GB +step 1430/5000 loss 0.2944 (w 0.2720 mse 0.2738 t 949 new 0.21) lr 1.00e-05 gnorm 0.105 3.28s mem 81.1GB +step 1431/5000 loss 0.3167 (w 0.2675 mse 0.2831 t 920 new 0.21) lr 1.00e-05 gnorm 0.126 3.11s mem 81.1GB +step 1432/5000 loss 0.2590 (w 0.2589 mse 0.2591 t 931 new 0.12) lr 1.00e-05 gnorm 0.160 2.82s mem 81.1GB +step 1433/5000 loss 0.2024 (w 0.3218 mse 0.3327 t 942 new 0.22) lr 1.00e-05 gnorm 0.448 3.04s mem 81.1GB +step 1434/5000 loss 0.3523 (w 0.3118 mse 0.3106 t 906 new 0.08) lr 1.00e-05 gnorm 0.151 3.08s mem 81.1GB +step 1435/5000 loss 0.1635 (w 0.3585 mse 0.3559 t 983 new 0.27) lr 1.00e-05 gnorm 0.164 3.28s mem 81.1GB +step 1436/5000 loss 0.2892 (w 0.3389 mse 0.3422 t 672 new 0.21) lr 1.00e-05 gnorm 0.178 3.05s mem 81.1GB +step 1437/5000 loss 0.1873 (w 0.2714 mse 0.2808 t 942 new 0.21) lr 1.00e-05 gnorm 0.110 3.12s mem 81.1GB +step 1438/5000 loss 0.3684 (w 0.3691 mse 0.3802 t 465 new 0.19) lr 1.00e-05 gnorm 0.167 2.83s mem 81.1GB +step 1439/5000 loss 0.2974 (w 0.2860 mse 0.3015 t 795 new 0.17) lr 1.00e-05 gnorm 0.126 3.05s mem 81.1GB +step 1440/5000 loss 0.3372 (w 0.2047 mse 0.2155 t 945 new 0.22) lr 1.00e-05 gnorm 0.148 3.08s mem 81.1GB +step 1441/5000 loss 0.2480 (w 0.3485 mse 0.3451 t 702 new 0.25) lr 1.00e-05 gnorm 0.139 3.32s mem 81.1GB +step 1442/5000 loss 0.2901 (w 0.1890 mse 0.2083 t 740 new 0.22) lr 1.00e-05 gnorm 0.309 2.82s mem 81.1GB +step 1443/5000 loss 0.3342 (w 0.3301 mse 0.3413 t 773 new 0.25) lr 1.00e-05 gnorm 0.199 3.14s mem 81.1GB +step 1444/5000 loss 0.2938 (w 0.3062 mse 0.3119 t 790 new 0.21) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +step 1445/5000 loss 0.2758 (w 0.4202 mse 0.4451 t 254 new 0.17) lr 1.00e-05 gnorm 0.114 3.08s mem 81.1GB +step 1446/5000 loss 0.3019 (w 0.2619 mse 0.2748 t 973 new 0.10) lr 1.00e-05 gnorm 0.127 3.30s mem 81.1GB +step 1447/5000 loss 0.2208 (w 0.2030 mse 0.2080 t 938 new 0.08) lr 1.00e-05 gnorm 0.141 3.24s mem 81.1GB +step 1448/5000 loss 0.3013 (w 0.2346 mse 0.2413 t 537 new 0.16) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +step 1449/5000 loss 0.1510 (w 0.3903 mse 0.3939 t 982 new 0.21) lr 1.00e-05 gnorm 0.142 3.38s mem 81.1GB +step 1450/5000 loss 0.3370 (w 0.3473 mse 0.3508 t 576 new 0.22) lr 1.00e-05 gnorm 0.300 2.82s mem 81.1GB +step 1451/5000 loss 0.3256 (w 0.1634 mse 0.1877 t 720 new 0.22) lr 1.00e-05 gnorm 0.128 3.03s mem 81.1GB +step 1452/5000 loss 0.2128 (w 0.3186 mse 0.3293 t 957 new 0.23) lr 1.00e-05 gnorm 0.395 3.36s mem 81.1GB +step 1453/5000 loss 0.4669 (w 0.2888 mse 0.2892 t 462 new 0.11) lr 1.00e-05 gnorm 0.152 3.28s mem 81.1GB +step 1454/5000 loss 0.3409 (w 0.3763 mse 0.3806 t 368 new 0.10) lr 1.00e-05 gnorm 0.107 2.84s mem 81.1GB +step 1455/5000 loss 0.2608 (w 0.2812 mse 0.2870 t 628 new 0.18) lr 1.00e-05 gnorm 0.162 3.40s mem 81.1GB +step 1456/5000 loss 0.3523 (w 0.3293 mse 0.3407 t 768 new 0.18) lr 1.00e-05 gnorm 0.126 3.01s mem 81.1GB +step 1457/5000 loss 0.2701 (w 0.2534 mse 0.2592 t 818 new 0.20) lr 1.00e-05 gnorm 0.234 2.83s mem 81.1GB +step 1458/5000 loss 0.2335 (w 0.2928 mse 0.2986 t 902 new 0.23) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +step 1459/5000 loss 0.2780 (w 0.4004 mse 0.4128 t 972 new 0.13) lr 1.00e-05 gnorm 0.146 3.34s mem 81.1GB +step 1460/5000 loss 0.3497 (w 0.4026 mse 0.3965 t 982 new 0.26) lr 1.00e-05 gnorm 0.128 3.05s mem 81.1GB +step 1461/5000 loss 0.3051 (w 0.2996 mse 0.2986 t 939 new 0.19) lr 1.00e-05 gnorm 0.126 3.11s mem 81.1GB +step 1462/5000 loss 0.1931 (w 0.3405 mse 0.3383 t 933 new 0.21) lr 1.00e-05 gnorm 0.142 3.00s mem 81.1GB +step 1463/5000 loss 0.3208 (w 0.3493 mse 0.3413 t 942 new 0.23) lr 1.00e-05 gnorm 0.158 3.02s mem 81.1GB +step 1464/5000 loss 0.3218 (w 0.3391 mse 0.3659 t 998 new 0.21) lr 1.00e-05 gnorm 0.149 3.11s mem 81.1GB +step 1465/5000 loss 0.4380 (w 0.2847 mse 0.2960 t 518 new 0.13) lr 1.00e-05 gnorm 0.131 3.27s mem 81.1GB +step 1466/5000 loss 0.2989 (w 0.2864 mse 0.2816 t 779 new 0.17) lr 1.00e-05 gnorm 0.225 3.04s mem 81.1GB +step 1467/5000 loss 0.3514 (w 0.2546 mse 0.2571 t 902 new 0.15) lr 1.00e-05 gnorm 0.250 3.13s mem 81.1GB +step 1468/5000 loss 0.3181 (w 0.3872 mse 0.3837 t 975 new 0.23) lr 1.00e-05 gnorm 0.257 3.02s mem 81.1GB +step 1469/5000 loss 0.3611 (w 0.3210 mse 0.3239 t 833 new 0.21) lr 1.00e-05 gnorm 0.153 3.10s mem 81.1GB +step 1470/5000 loss 0.3541 (w 0.2765 mse 0.2735 t 798 new 0.10) lr 1.00e-05 gnorm 0.105 2.83s mem 81.1GB +step 1471/5000 loss 0.2424 (w 0.1809 mse 0.1984 t 976 new 0.11) lr 1.00e-05 gnorm 0.115 3.08s mem 81.1GB +step 1472/5000 loss 0.3435 (w 0.2243 mse 0.2311 t 695 new 0.22) lr 1.00e-05 gnorm 0.151 3.11s mem 81.1GB +step 1473/5000 loss 0.2385 (w 0.2653 mse 0.2799 t 883 new 0.18) lr 1.00e-05 gnorm 0.151 3.14s mem 81.1GB +step 1474/5000 loss 0.2674 (w 0.2344 mse 0.2514 t 875 new 0.25) lr 1.00e-05 gnorm 0.166 3.07s mem 81.1GB +step 1475/5000 loss 0.2402 (w 0.2421 mse 0.2528 t 952 new 0.19) lr 1.00e-05 gnorm 0.163 3.35s mem 81.1GB +step 1476/5000 loss 0.2467 (w 0.3244 mse 0.3194 t 815 new 0.20) lr 1.00e-05 gnorm 0.166 3.04s mem 81.1GB +step 1477/5000 loss 0.3218 (w 0.3617 mse 0.3719 t 932 new 0.13) lr 1.00e-05 gnorm 0.160 3.06s mem 81.1GB +step 1478/5000 loss 0.4458 (w 0.5164 mse 0.5228 t 306 new 0.17) lr 1.00e-05 gnorm 0.116 3.07s mem 81.1GB +step 1479/5000 loss 0.2764 (w 0.3493 mse 0.3491 t 987 new 0.10) lr 1.00e-05 gnorm 0.125 3.17s mem 81.1GB +step 1480/5000 loss 0.3208 (w 0.3802 mse 0.3936 t 982 new 0.22) lr 1.00e-05 gnorm 0.124 3.02s mem 81.1GB +step 1481/5000 loss 0.3906 (w 0.3157 mse 0.3303 t 336 new 0.28) lr 1.00e-05 gnorm 0.136 3.13s mem 81.1GB +step 1482/5000 loss 0.2729 (w 0.3231 mse 0.3236 t 492 new 0.19) lr 1.00e-05 gnorm 0.111 3.07s mem 81.1GB +step 1483/5000 loss 0.3466 (w 0.3396 mse 0.3418 t 703 new 0.16) lr 1.00e-05 gnorm 0.168 3.05s mem 81.1GB +step 1484/5000 loss 0.4804 (w 0.3339 mse 0.3384 t 669 new 0.25) lr 1.00e-05 gnorm 0.183 3.10s mem 81.1GB +step 1485/5000 loss 0.2719 (w 0.1394 mse 0.1588 t 828 new 0.21) lr 1.00e-05 gnorm 0.144 3.14s mem 81.1GB +step 1486/5000 loss 0.2050 (w 0.2881 mse 0.2922 t 939 new 0.24) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +step 1487/5000 loss 0.3445 (w 0.3017 mse 0.3087 t 892 new 0.21) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +step 1488/5000 loss 0.2677 (w 0.3682 mse 0.3716 t 990 new 0.20) lr 1.00e-05 gnorm 0.157 3.27s mem 81.1GB +step 1489/5000 loss 0.2981 (w 0.1658 mse 0.1849 t 852 new 0.23) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +step 1490/5000 loss 0.1933 (w 0.2348 mse 0.2336 t 906 new 0.25) lr 1.00e-05 gnorm 0.169 3.11s mem 81.1GB +step 1491/5000 loss 0.2885 (w 0.2970 mse 0.2858 t 684 new 0.21) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +step 1492/5000 loss 0.1513 (w 0.4349 mse 0.4404 t 965 new 0.21) lr 1.00e-05 gnorm 0.112 2.82s mem 81.1GB +step 1493/5000 loss 0.4312 (w 0.3593 mse 0.3787 t 968 new 0.19) lr 1.00e-05 gnorm 0.297 3.10s mem 81.1GB +step 1494/5000 loss 0.3433 (w 0.4152 mse 0.4061 t 946 new 0.21) lr 1.00e-05 gnorm 0.223 3.33s mem 81.1GB +step 1495/5000 loss 0.3197 (w 0.3499 mse 0.3534 t 996 new 0.28) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +step 1496/5000 loss 0.5690 (w 0.3269 mse 0.3327 t 981 new 0.23) lr 1.00e-05 gnorm 0.128 2.82s mem 81.1GB +step 1497/5000 loss 0.2857 (w 0.2369 mse 0.2535 t 770 new 0.25) lr 1.00e-05 gnorm 0.132 3.14s mem 81.1GB +step 1498/5000 loss 0.3403 (w 0.2584 mse 0.2589 t 824 new 0.15) lr 1.00e-05 gnorm 0.133 2.82s mem 81.1GB +step 1499/5000 loss 0.1506 (w 0.3541 mse 0.3602 t 947 new 0.13) lr 1.00e-05 gnorm 0.196 3.09s mem 81.1GB +step 1500/5000 loss 0.4402 (w 0.3066 mse 0.3102 t 566 new 0.19) lr 1.00e-05 gnorm 0.106 3.35s mem 81.1GB +[val] step 1500 t=200: w=0.4724 mse=0.4908 (n=16) t=500: w=0.2872 mse=0.3023 (n=16) t=800: w=0.2419 mse=0.2541 (n=16) | mean w=0.3338 mse=0.3491 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step1500.safetensors 4093 个张量 37.98 GB +step 1501/5000 loss 0.3711 (w 0.2985 mse 0.3052 t 973 new 0.20) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +step 1502/5000 loss 0.2898 (w 0.3365 mse 0.3492 t 975 new 0.14) lr 1.00e-05 gnorm 0.090 3.11s mem 81.1GB +step 1503/5000 loss 0.3513 (w 0.2961 mse 0.2994 t 769 new 0.21) lr 1.00e-05 gnorm 0.175 3.05s mem 81.1GB +step 1504/5000 loss 0.2948 (w 0.2583 mse 0.2658 t 883 new 0.17) lr 1.00e-05 gnorm 0.227 3.12s mem 81.1GB +step 1505/5000 loss 0.2858 (w 0.2625 mse 0.2730 t 994 new 0.22) lr 1.00e-05 gnorm 0.148 3.24s mem 81.1GB +step 1506/5000 loss 0.2935 (w 0.1711 mse 0.1986 t 933 new 0.22) lr 1.00e-05 gnorm 0.134 3.10s mem 81.1GB +step 1507/5000 loss 0.2711 (w 0.3627 mse 0.3650 t 328 new 0.19) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +step 1508/5000 loss 0.1250 (w 0.1665 mse 0.1888 t 765 new 0.19) lr 1.00e-05 gnorm 0.118 2.83s mem 81.1GB +step 1509/5000 loss 0.2377 (w 0.3633 mse 0.3479 t 987 new 0.22) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +step 1510/5000 loss 0.3164 (w 0.1636 mse 0.1800 t 802 new 0.15) lr 1.00e-05 gnorm 0.182 3.42s mem 81.1GB +step 1511/5000 loss 0.2306 (w 0.2229 mse 0.2431 t 811 new 0.22) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +step 1512/5000 loss 0.2077 (w 0.3720 mse 0.3675 t 966 new 0.15) lr 1.00e-05 gnorm 0.151 3.05s mem 81.1GB +step 1513/5000 loss 0.4002 (w 0.2634 mse 0.2712 t 783 new 0.19) lr 1.00e-05 gnorm 0.125 3.07s mem 81.1GB +step 1514/5000 loss 0.2946 (w 0.3709 mse 0.3770 t 269 new 0.20) lr 1.00e-05 gnorm 0.213 2.82s mem 81.1GB +step 1515/5000 loss 0.1470 (w 0.3348 mse 0.3447 t 926 new 0.25) lr 1.00e-05 gnorm 0.130 3.05s mem 81.1GB +step 1516/5000 loss 0.3421 (w 0.2220 mse 0.2309 t 826 new 0.22) lr 1.00e-05 gnorm 0.219 3.35s mem 81.1GB +step 1517/5000 loss 0.3070 (w 0.2678 mse 0.2713 t 760 new 0.21) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +step 1518/5000 loss 0.2834 (w 0.2741 mse 0.2851 t 917 new 0.21) lr 1.00e-05 gnorm 0.118 3.13s mem 81.1GB +step 1519/5000 loss 0.3289 (w 0.2825 mse 0.2962 t 659 new 0.29) lr 1.00e-05 gnorm 0.115 3.10s mem 81.1GB +step 1520/5000 loss 0.3655 (w 0.2820 mse 0.2937 t 301 new 0.06) lr 1.00e-05 gnorm 0.281 2.81s mem 81.1GB +step 1521/5000 loss 0.2360 (w 0.1904 mse 0.2083 t 871 new 0.21) lr 1.00e-05 gnorm 0.202 3.09s mem 81.1GB +step 1522/5000 loss 0.2982 (w 0.3466 mse 0.3510 t 958 new 0.17) lr 1.00e-05 gnorm 0.148 3.39s mem 81.1GB +step 1523/5000 loss 0.3773 (w 0.3606 mse 0.3696 t 568 new 0.17) lr 1.00e-05 gnorm 0.105 3.12s mem 81.1GB +step 1524/5000 loss 0.3640 (w 0.2922 mse 0.2994 t 586 new 0.20) lr 1.00e-05 gnorm 0.101 2.83s mem 81.1GB +step 1525/5000 loss 0.3388 (w 0.2889 mse 0.3097 t 959 new 0.19) lr 1.00e-05 gnorm 0.154 3.31s mem 81.1GB +step 1526/5000 loss 0.5537 (w 0.3353 mse 0.3325 t 709 new 0.25) lr 1.00e-05 gnorm 0.139 3.04s mem 81.1GB +step 1527/5000 loss 0.3055 (w 0.2304 mse 0.2453 t 727 new 0.22) lr 1.00e-05 gnorm 0.169 2.84s mem 81.1GB +step 1528/5000 loss 0.3067 (w 0.3241 mse 0.3368 t 710 new 0.14) lr 1.00e-05 gnorm 0.141 3.13s mem 81.1GB +step 1529/5000 loss 0.3764 (w 0.3182 mse 0.3266 t 626 new 0.25) lr 1.00e-05 gnorm 0.178 3.33s mem 81.1GB +step 1530/5000 loss 0.2495 (w 0.3148 mse 0.3197 t 634 new 0.21) lr 1.00e-05 gnorm 0.759 2.83s mem 81.1GB +step 1531/5000 loss 0.1992 (w 0.3465 mse 0.3455 t 939 new 0.19) lr 1.00e-05 gnorm 0.163 3.35s mem 81.1GB +step 1532/5000 loss 0.2619 (w 0.2086 mse 0.2251 t 925 new 0.10) lr 1.00e-05 gnorm 0.177 3.04s mem 81.1GB +step 1533/5000 loss 0.3152 (w 0.3310 mse 0.3389 t 995 new 0.24) lr 1.00e-05 gnorm 0.177 2.82s mem 81.1GB +step 1534/5000 loss 0.4022 (w 0.2651 mse 0.2717 t 728 new 0.16) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +step 1535/5000 loss 0.2505 (w 0.3009 mse 0.3039 t 875 new 0.24) lr 1.00e-05 gnorm 0.161 3.36s mem 81.1GB +step 1536/5000 loss 0.0992 (w 0.3247 mse 0.3187 t 856 new 0.13) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +step 1537/5000 loss 0.3369 (w 0.2664 mse 0.2787 t 890 new 0.22) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +step 1538/5000 loss 0.2747 (w 0.2818 mse 0.2907 t 813 new 0.29) lr 1.00e-05 gnorm 0.375 3.00s mem 81.1GB +step 1539/5000 loss 0.3993 (w 0.1911 mse 0.2065 t 781 new 0.21) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +step 1540/5000 loss 0.2894 (w 0.3191 mse 0.3241 t 961 new 0.20) lr 1.00e-05 gnorm 0.228 3.09s mem 81.1GB +step 1541/5000 loss 0.3058 (w 0.5165 mse 0.5055 t 994 new 0.23) lr 1.00e-05 gnorm 0.127 3.13s mem 81.1GB +step 1542/5000 loss 0.4305 (w 0.1834 mse 0.1958 t 669 new 0.13) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +step 1543/5000 loss 0.2439 (w 0.2079 mse 0.2402 t 996 new 0.22) lr 1.00e-05 gnorm 0.149 3.06s mem 81.1GB +step 1544/5000 loss 0.4328 (w 0.2992 mse 0.2898 t 743 new 0.22) lr 1.00e-05 gnorm 0.159 3.03s mem 81.1GB +step 1545/5000 loss 0.4366 (w 0.3032 mse 0.3209 t 967 new 0.16) lr 1.00e-05 gnorm 0.167 3.04s mem 81.1GB +step 1546/5000 loss 0.2653 (w 0.2708 mse 0.2770 t 506 new 0.21) lr 1.00e-05 gnorm 0.131 3.38s mem 81.1GB +step 1547/5000 loss 0.2674 (w 0.2048 mse 0.2157 t 938 new 0.06) lr 1.00e-05 gnorm 0.207 3.09s mem 81.1GB +step 1548/5000 loss 0.2422 (w 0.3114 mse 0.3388 t 669 new 0.15) lr 1.00e-05 gnorm 0.146 3.09s mem 81.1GB +step 1549/5000 loss 0.3421 (w 0.3135 mse 0.3231 t 932 new 0.28) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +step 1550/5000 loss 0.1443 (w 0.5199 mse 0.5160 t 981 new 0.22) lr 1.00e-05 gnorm 0.125 3.09s mem 81.1GB +step 1551/5000 loss 0.4859 (w 0.2506 mse 0.2830 t 390 new 0.28) lr 1.00e-05 gnorm 0.112 3.17s mem 81.1GB +step 1552/5000 loss 0.3044 (w 0.2438 mse 0.2517 t 826 new 0.13) lr 1.00e-05 gnorm 0.114 3.11s mem 81.1GB +step 1553/5000 loss 0.3711 (w 0.3057 mse 0.3099 t 734 new 0.22) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +step 1554/5000 loss 0.2234 (w 0.1291 mse 0.1510 t 842 new 0.17) lr 1.00e-05 gnorm 0.135 3.22s mem 81.1GB +step 1555/5000 loss 0.3500 (w 0.4408 mse 0.4488 t 955 new 0.20) lr 1.00e-05 gnorm 0.145 3.11s mem 81.1GB +step 1556/5000 loss 0.3857 (w 0.1958 mse 0.2194 t 777 new 0.23) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +step 1557/5000 loss 0.1761 (w 0.3006 mse 0.3078 t 998 new 0.18) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +step 1558/5000 loss 0.2633 (w 0.4870 mse 0.4850 t 994 new 0.23) lr 1.00e-05 gnorm 0.124 3.34s mem 81.1GB +step 1559/5000 loss 0.2194 (w 0.3712 mse 0.3730 t 984 new 0.21) lr 1.00e-05 gnorm 0.131 3.01s mem 81.1GB +step 1560/5000 loss 0.3385 (w 0.2888 mse 0.2950 t 868 new 0.26) lr 1.00e-05 gnorm 0.184 3.13s mem 81.1GB +step 1561/5000 loss 0.2160 (w 0.2138 mse 0.2224 t 866 new 0.19) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +step 1562/5000 loss 0.2385 (w 0.2950 mse 0.2992 t 850 new 0.16) lr 1.00e-05 gnorm 0.248 2.83s mem 81.1GB +step 1563/5000 loss 0.2813 (w 0.2678 mse 0.2857 t 997 new 0.18) lr 1.00e-05 gnorm 0.121 3.13s mem 81.1GB +step 1564/5000 loss 0.1714 (w 0.2907 mse 0.2923 t 808 new 0.23) lr 1.00e-05 gnorm 0.188 3.37s mem 81.1GB +step 1565/5000 loss 0.3577 (w 0.5060 mse 0.4930 t 998 new 0.19) lr 1.00e-05 gnorm 0.120 3.06s mem 81.1GB +step 1566/5000 loss 0.2583 (w 0.3267 mse 0.3510 t 954 new 0.20) lr 1.00e-05 gnorm 0.167 3.32s mem 81.1GB +step 1567/5000 loss 0.1223 (w 0.2632 mse 0.2818 t 981 new 0.24) lr 1.00e-05 gnorm 0.153 3.13s mem 81.1GB +step 1568/5000 loss 0.3423 (w 0.3338 mse 0.3324 t 621 new 0.18) lr 1.00e-05 gnorm 0.189 2.82s mem 81.1GB +step 1569/5000 loss 0.3443 (w 0.2385 mse 0.2409 t 777 new 0.20) lr 1.00e-05 gnorm 0.162 3.16s mem 81.1GB +step 1570/5000 loss 0.3967 (w 0.3373 mse 0.3327 t 969 new 0.12) lr 1.00e-05 gnorm 0.134 3.40s mem 81.1GB +step 1571/5000 loss 0.3326 (w 0.2336 mse 0.2489 t 779 new 0.22) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +step 1572/5000 loss 0.2768 (w 0.1978 mse 0.2164 t 865 new 0.26) lr 1.00e-05 gnorm 0.112 3.37s mem 81.1GB +step 1573/5000 loss 0.3204 (w 0.2663 mse 0.2631 t 851 new 0.21) lr 1.00e-05 gnorm 0.319 3.05s mem 81.1GB +step 1574/5000 loss 0.3703 (w 0.2093 mse 0.2209 t 782 new 0.22) lr 1.00e-05 gnorm 0.203 2.83s mem 81.1GB +step 1575/5000 loss 0.3246 (w 0.3662 mse 0.3703 t 953 new 0.23) lr 1.00e-05 gnorm 0.131 3.17s mem 81.1GB +step 1576/5000 loss 0.2476 (w 0.2353 mse 0.2440 t 883 new 0.22) lr 1.00e-05 gnorm 0.120 3.33s mem 81.1GB +step 1577/5000 loss 0.3818 (w 0.2699 mse 0.2772 t 852 new 0.21) lr 1.00e-05 gnorm 0.187 2.82s mem 81.1GB +step 1578/5000 loss 0.2972 (w 0.2257 mse 0.2435 t 962 new 0.17) lr 1.00e-05 gnorm 0.107 3.15s mem 81.1GB +step 1579/5000 loss 0.2359 (w 0.3935 mse 0.3785 t 959 new 0.24) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +step 1580/5000 loss 0.2027 (w 0.1618 mse 0.1728 t 795 new 0.08) lr 1.00e-05 gnorm 0.155 2.82s mem 81.1GB +step 1581/5000 loss 0.3498 (w 0.3575 mse 0.3643 t 977 new 0.30) lr 1.00e-05 gnorm 0.129 3.09s mem 81.1GB +step 1582/5000 loss 0.2138 (w 0.3379 mse 0.3417 t 964 new 0.20) lr 1.00e-05 gnorm 0.119 4.07s mem 81.1GB +step 1583/5000 loss 0.3946 (w 0.1503 mse 0.1635 t 776 new 0.17) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +step 1584/5000 loss 0.2325 (w 0.2723 mse 0.2723 t 888 new 0.18) lr 1.00e-05 gnorm 0.194 3.08s mem 81.1GB +step 1585/5000 loss 0.3504 (w 0.7169 mse 0.7173 t 127 new 0.07) lr 1.00e-05 gnorm 0.179 3.10s mem 81.1GB +step 1586/5000 loss 0.4483 (w 0.3140 mse 0.3112 t 951 new 0.25) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +step 1587/5000 loss 0.4090 (w 0.3161 mse 0.3265 t 533 new 0.19) lr 1.00e-05 gnorm 0.229 3.12s mem 81.1GB +step 1588/5000 loss 0.2261 (w 0.1840 mse 0.1975 t 695 new 0.12) lr 1.00e-05 gnorm 0.121 3.11s mem 81.1GB +step 1589/5000 loss 0.2262 (w 0.3830 mse 0.3830 t 961 new 0.28) lr 1.00e-05 gnorm 0.128 3.39s mem 81.1GB +step 1590/5000 loss 0.2706 (w 0.2183 mse 0.2415 t 920 new 0.22) lr 1.00e-05 gnorm 0.150 3.02s mem 81.1GB +step 1591/5000 loss 0.3568 (w 0.2366 mse 0.2482 t 849 new 0.21) lr 1.00e-05 gnorm 0.135 3.03s mem 81.1GB +step 1592/5000 loss 0.2192 (w 0.4525 mse 0.4475 t 979 new 0.15) lr 1.00e-05 gnorm 0.108 3.14s mem 81.1GB +step 1593/5000 loss 0.3674 (w 0.3145 mse 0.3162 t 570 new 0.15) lr 1.00e-05 gnorm 0.115 3.05s mem 81.1GB +step 1594/5000 loss 0.1327 (w 0.3500 mse 0.3582 t 990 new 0.11) lr 1.00e-05 gnorm 0.192 3.11s mem 81.1GB +step 1595/5000 loss 0.3393 (w 0.1688 mse 0.1791 t 875 new 0.08) lr 1.00e-05 gnorm 0.174 3.29s mem 81.1GB +step 1596/5000 loss 0.2604 (w 0.2653 mse 0.2756 t 978 new 0.18) lr 1.00e-05 gnorm 0.282 3.02s mem 81.1GB +step 1597/5000 loss 0.2558 (w 0.3906 mse 0.4029 t 984 new 0.21) lr 1.00e-05 gnorm 0.153 3.07s mem 81.1GB +step 1598/5000 loss 0.3976 (w 0.2686 mse 0.2778 t 809 new 0.22) lr 1.00e-05 gnorm 0.143 3.12s mem 81.1GB +step 1599/5000 loss 0.2127 (w 0.1871 mse 0.2111 t 802 new 0.20) lr 1.00e-05 gnorm 0.110 3.11s mem 81.1GB +step 1600/5000 loss 0.2752 (w 0.3391 mse 0.3436 t 916 new 0.17) lr 1.00e-05 gnorm 0.137 2.82s mem 81.1GB +step 1601/5000 loss 0.2599 (w 0.2331 mse 0.2369 t 917 new 0.15) lr 1.00e-05 gnorm 0.139 3.37s mem 81.1GB +step 1602/5000 loss 0.3692 (w 0.5276 mse 0.5307 t 244 new 0.21) lr 1.00e-05 gnorm 0.282 3.06s mem 81.1GB +step 1603/5000 loss 0.3063 (w 0.2736 mse 0.2738 t 824 new 0.19) lr 1.00e-05 gnorm 0.140 3.07s mem 81.1GB +step 1604/5000 loss 0.2065 (w 0.4770 mse 0.4749 t 988 new 0.22) lr 1.00e-05 gnorm 0.172 3.04s mem 81.1GB +step 1605/5000 loss 0.1192 (w 0.3402 mse 0.3419 t 959 new 0.23) lr 1.00e-05 gnorm 0.130 3.25s mem 81.1GB +step 1606/5000 loss 0.1219 (w 0.2150 mse 0.2265 t 808 new 0.27) lr 1.00e-05 gnorm 0.118 2.82s mem 81.1GB +step 1607/5000 loss 0.4483 (w 0.2957 mse 0.3026 t 657 new 0.19) lr 1.00e-05 gnorm 0.151 3.38s mem 81.1GB +step 1608/5000 loss 0.2755 (w 0.3172 mse 0.3229 t 973 new 0.08) lr 1.00e-05 gnorm 0.132 3.01s mem 81.1GB +step 1609/5000 loss 0.3620 (w 0.1752 mse 0.1970 t 788 new 0.27) lr 1.00e-05 gnorm 1.426 2.82s mem 81.1GB +step 1610/5000 loss 0.2595 (w 0.2520 mse 0.2751 t 998 new 0.17) lr 1.00e-05 gnorm 0.168 3.10s mem 81.1GB +step 1611/5000 loss 0.1766 (w 0.2690 mse 0.2693 t 838 new 0.18) lr 1.00e-05 gnorm 0.112 3.27s mem 81.1GB +step 1612/5000 loss 0.1903 (w 0.2483 mse 0.2577 t 785 new 0.21) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +step 1613/5000 loss 0.3604 (w 0.2398 mse 0.2561 t 777 new 0.19) lr 1.00e-05 gnorm 0.282 3.27s mem 81.1GB +step 1614/5000 loss 0.2905 (w 0.2336 mse 0.2478 t 774 new 0.22) lr 1.00e-05 gnorm 0.222 3.05s mem 81.1GB +step 1615/5000 loss 0.2226 (w 0.3370 mse 0.3410 t 975 new 0.25) lr 1.00e-05 gnorm 0.197 2.83s mem 81.1GB +step 1616/5000 loss 0.1658 (w 0.2890 mse 0.2995 t 977 new 0.20) lr 1.00e-05 gnorm 0.276 3.13s mem 81.1GB +step 1617/5000 loss 0.2753 (w 0.3197 mse 0.3298 t 503 new 0.26) lr 1.00e-05 gnorm 0.129 3.35s mem 81.1GB +step 1618/5000 loss 0.3017 (w 0.3109 mse 0.3076 t 918 new 0.18) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +step 1619/5000 loss 0.2025 (w 0.3442 mse 0.3437 t 989 new 0.27) lr 1.00e-05 gnorm 0.118 3.31s mem 81.1GB +step 1620/5000 loss 0.3830 (w 0.3211 mse 0.3407 t 846 new 0.21) lr 1.00e-05 gnorm 0.152 3.09s mem 81.1GB +step 1621/5000 loss 0.3092 (w 0.1807 mse 0.1906 t 943 new 0.13) lr 1.00e-05 gnorm 0.145 2.83s mem 81.1GB +step 1622/5000 loss 0.3316 (w 0.3620 mse 0.3512 t 688 new 0.20) lr 1.00e-05 gnorm 0.122 3.32s mem 81.1GB +step 1623/5000 loss 0.1626 (w 0.3065 mse 0.3116 t 884 new 0.20) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +step 1624/5000 loss 0.4729 (w 0.2146 mse 0.2260 t 553 new 0.17) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +step 1625/5000 loss 0.2508 (w 0.2026 mse 0.2025 t 850 new 0.13) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +step 1626/5000 loss 0.1834 (w 0.2833 mse 0.2868 t 659 new 0.19) lr 1.00e-05 gnorm 0.276 3.07s mem 81.1GB +step 1627/5000 loss 0.3413 (w 0.2636 mse 0.2852 t 557 new 0.19) lr 1.00e-05 gnorm 0.250 2.82s mem 81.1GB +step 1628/5000 loss 0.3140 (w 0.2560 mse 0.2671 t 692 new 0.13) lr 1.00e-05 gnorm 0.156 3.27s mem 81.1GB +step 1629/5000 loss 0.1791 (w 0.3990 mse 0.4013 t 963 new 0.18) lr 1.00e-05 gnorm 0.130 2.82s mem 81.1GB +step 1630/5000 loss 0.3239 (w 0.2688 mse 0.2767 t 728 new 0.13) lr 1.00e-05 gnorm 0.319 3.03s mem 81.1GB +step 1631/5000 loss 0.2112 (w 0.2475 mse 0.2596 t 942 new 0.22) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +step 1632/5000 loss 0.3592 (w 0.2488 mse 0.2551 t 894 new 0.25) lr 1.00e-05 gnorm 0.163 3.01s mem 81.1GB +step 1633/5000 loss 0.3093 (w 0.3275 mse 0.3554 t 973 new 0.22) lr 1.00e-05 gnorm 0.150 2.82s mem 81.1GB +step 1634/5000 loss 0.2228 (w 0.3219 mse 0.3328 t 926 new 0.18) lr 1.00e-05 gnorm 0.142 3.29s mem 81.1GB +step 1635/5000 loss 0.0952 (w 0.3028 mse 0.3065 t 984 new 0.22) lr 1.00e-05 gnorm 0.099 2.83s mem 81.1GB +step 1636/5000 loss 0.3490 (w 0.3375 mse 0.3557 t 998 new 0.24) lr 1.00e-05 gnorm 0.163 3.08s mem 81.1GB +step 1637/5000 loss 0.2009 (w 0.3356 mse 0.3506 t 976 new 0.22) lr 1.00e-05 gnorm 0.140 3.11s mem 81.1GB +step 1638/5000 loss 0.3640 (w 0.2640 mse 0.2719 t 586 new 0.11) lr 1.00e-05 gnorm 0.143 3.04s mem 81.1GB +step 1639/5000 loss 0.4364 (w 0.3291 mse 0.3400 t 592 new 0.22) lr 1.00e-05 gnorm 0.205 3.07s mem 81.1GB +step 1640/5000 loss 0.1582 (w 0.3574 mse 0.3744 t 989 new 0.14) lr 1.00e-05 gnorm 0.129 3.06s mem 81.1GB +step 1641/5000 loss 0.2862 (w 0.4512 mse 0.4384 t 994 new 0.20) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 1642/5000 loss 0.2973 (w 0.2093 mse 0.2218 t 863 new 0.11) lr 1.00e-05 gnorm 0.094 3.34s mem 81.1GB +step 1643/5000 loss 0.4349 (w 0.5171 mse 0.5177 t 259 new 0.16) lr 1.00e-05 gnorm 0.151 3.09s mem 81.1GB +step 1644/5000 loss 0.3208 (w 0.4327 mse 0.4364 t 283 new 0.25) lr 1.00e-05 gnorm 0.147 2.82s mem 81.1GB +step 1645/5000 loss 0.2694 (w 0.2845 mse 0.2901 t 804 new 0.27) lr 1.00e-05 gnorm 0.180 3.06s mem 81.1GB +step 1646/5000 loss 0.2927 (w 0.3227 mse 0.3141 t 862 new 0.24) lr 1.00e-05 gnorm 0.158 3.08s mem 81.1GB +step 1647/5000 loss 0.2801 (w 0.3051 mse 0.3115 t 961 new 0.12) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +step 1648/5000 loss 0.3021 (w 0.2665 mse 0.2760 t 917 new 0.27) lr 1.00e-05 gnorm 0.150 3.31s mem 81.1GB +step 1649/5000 loss 0.2516 (w 0.2158 mse 0.2280 t 816 new 0.18) lr 1.00e-05 gnorm 0.132 3.10s mem 81.1GB +step 1650/5000 loss 0.3201 (w 0.3278 mse 0.3260 t 689 new 0.24) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +step 1651/5000 loss 0.1747 (w 0.2079 mse 0.2051 t 941 new 0.17) lr 1.00e-05 gnorm 0.136 3.09s mem 81.1GB +step 1652/5000 loss 0.2812 (w 0.2991 mse 0.3059 t 875 new 0.15) lr 1.00e-05 gnorm 0.155 3.27s mem 81.1GB +step 1653/5000 loss 0.3989 (w 0.3537 mse 0.3570 t 898 new 0.22) lr 1.00e-05 gnorm 0.136 2.82s mem 81.1GB +step 1654/5000 loss 0.3895 (w 0.2282 mse 0.2528 t 939 new 0.16) lr 1.00e-05 gnorm 0.210 3.29s mem 81.1GB +step 1655/5000 loss 0.3445 (w 0.5061 mse 0.4866 t 991 new 0.25) lr 1.00e-05 gnorm 0.150 3.11s mem 81.1GB +step 1656/5000 loss 0.2246 (w 0.4177 mse 0.4350 t 200 new 0.21) lr 1.00e-05 gnorm 0.119 2.82s mem 81.1GB +step 1657/5000 loss 0.2341 (w 0.2090 mse 0.2204 t 669 new 0.17) lr 1.00e-05 gnorm 0.190 3.27s mem 81.1GB +step 1658/5000 loss 0.4736 (w 0.3634 mse 0.3593 t 983 new 0.22) lr 1.00e-05 gnorm 0.147 3.06s mem 81.1GB +step 1659/5000 loss 0.3660 (w 0.2513 mse 0.2595 t 904 new 0.24) lr 1.00e-05 gnorm 0.126 3.09s mem 81.1GB +step 1660/5000 loss 0.2400 (w 0.6152 mse 0.6188 t 990 new 0.27) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +step 1661/5000 loss 0.4417 (w 0.3989 mse 0.4039 t 484 new 0.30) lr 1.00e-05 gnorm 0.182 3.02s mem 81.1GB +step 1662/5000 loss 0.1374 (w 0.2476 mse 0.2470 t 891 new 0.13) lr 1.00e-05 gnorm 0.138 2.82s mem 81.1GB +step 1663/5000 loss 0.2659 (w 0.4292 mse 0.4459 t 319 new 0.26) lr 1.00e-05 gnorm 0.179 3.23s mem 81.1GB +step 1664/5000 loss 0.2760 (w 0.4344 mse 0.4251 t 996 new 0.23) lr 1.00e-05 gnorm 0.126 3.08s mem 81.1GB +step 1665/5000 loss 0.3465 (w 0.3962 mse 0.4054 t 987 new 0.21) lr 1.00e-05 gnorm 0.132 3.27s mem 81.1GB +step 1666/5000 loss 0.3356 (w 0.3979 mse 0.3906 t 976 new 0.24) lr 1.00e-05 gnorm 0.226 3.05s mem 81.1GB +step 1667/5000 loss 0.5303 (w 0.3935 mse 0.4068 t 340 new 0.19) lr 1.00e-05 gnorm 0.116 3.01s mem 81.1GB +step 1668/5000 loss 0.2532 (w 0.3839 mse 0.3673 t 950 new 0.27) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +step 1669/5000 loss 0.2938 (w 0.3462 mse 0.3505 t 1000 new 0.25) lr 1.00e-05 gnorm 0.236 3.32s mem 81.1GB +step 1670/5000 loss 0.3831 (w 0.3686 mse 0.3695 t 722 new 0.22) lr 1.00e-05 gnorm 0.165 2.83s mem 81.1GB +step 1671/5000 loss 0.4406 (w 0.2710 mse 0.3027 t 998 new 0.22) lr 1.00e-05 gnorm 0.130 3.12s mem 81.1GB +step 1672/5000 loss 0.1009 (w 0.3624 mse 0.3643 t 932 new 0.14) lr 1.00e-05 gnorm 0.097 2.82s mem 81.1GB +step 1673/5000 loss 0.3545 (w 0.2486 mse 0.2535 t 904 new 0.13) lr 1.00e-05 gnorm 0.122 3.04s mem 81.1GB +step 1674/5000 loss 0.3635 (w 0.3900 mse 0.4015 t 983 new 0.18) lr 1.00e-05 gnorm 0.187 3.07s mem 81.1GB +step 1675/5000 loss 0.3660 (w 0.3068 mse 0.3096 t 557 new 0.09) lr 1.00e-05 gnorm 0.211 3.33s mem 81.1GB +step 1676/5000 loss 0.2653 (w 0.3948 mse 0.3934 t 946 new 0.16) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 1677/5000 loss 0.1975 (w 0.3336 mse 0.3286 t 972 new 0.28) lr 1.00e-05 gnorm 0.137 3.13s mem 81.1GB +step 1678/5000 loss 0.3189 (w 0.2761 mse 0.2717 t 993 new 0.17) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +step 1679/5000 loss 0.1791 (w 0.3025 mse 0.3220 t 752 new 0.20) lr 1.00e-05 gnorm 0.175 3.85s mem 81.1GB +step 1680/5000 loss 0.3895 (w 0.2544 mse 0.2651 t 822 new 0.27) lr 1.00e-05 gnorm 0.111 3.07s mem 81.1GB +step 1681/5000 loss 0.4259 (w 0.2934 mse 0.2991 t 959 new 0.19) lr 1.00e-05 gnorm 0.174 3.46s mem 81.1GB +step 1682/5000 loss 0.1639 (w 0.2378 mse 0.2451 t 920 new 0.24) lr 1.00e-05 gnorm 0.121 2.84s mem 81.1GB +step 1683/5000 loss 0.3310 (w 0.2490 mse 0.2700 t 920 new 0.21) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +step 1684/5000 loss 0.3020 (w 0.2107 mse 0.2239 t 930 new 0.25) lr 1.00e-05 gnorm 0.507 2.84s mem 81.1GB +step 1685/5000 loss 0.2377 (w 0.2925 mse 0.3019 t 977 new 0.23) lr 1.00e-05 gnorm 0.134 3.10s mem 81.1GB +step 1686/5000 loss 0.2256 (w 0.2500 mse 0.2668 t 988 new 0.12) lr 1.00e-05 gnorm 0.136 3.11s mem 81.1GB +step 1687/5000 loss 0.3409 (w 0.3366 mse 0.3339 t 902 new 0.18) lr 1.00e-05 gnorm 0.247 3.08s mem 81.1GB +step 1688/5000 loss 0.2601 (w 0.3026 mse 0.2914 t 966 new 0.10) lr 1.00e-05 gnorm 0.106 2.82s mem 81.1GB +step 1689/5000 loss 0.4980 (w 0.2319 mse 0.2422 t 793 new 0.19) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +step 1690/5000 loss 0.3671 (w 0.3059 mse 0.3149 t 523 new 0.19) lr 1.00e-05 gnorm 0.098 2.82s mem 81.1GB +step 1691/5000 loss 0.4302 (w 0.3276 mse 0.3291 t 872 new 0.19) lr 1.00e-05 gnorm 0.250 3.03s mem 81.1GB +step 1692/5000 loss 0.3414 (w 0.2964 mse 0.2894 t 915 new 0.28) lr 1.00e-05 gnorm 0.149 3.09s mem 81.1GB +step 1693/5000 loss 0.2934 (w 0.2650 mse 0.2780 t 985 new 0.16) lr 1.00e-05 gnorm 0.110 3.04s mem 81.1GB +step 1694/5000 loss 0.3646 (w 0.3221 mse 0.3216 t 542 new 0.26) lr 1.00e-05 gnorm 2.241 2.82s mem 81.1GB +step 1695/5000 loss 0.3504 (w 0.3249 mse 0.3151 t 981 new 0.16) lr 1.00e-05 gnorm 0.127 3.11s mem 81.1GB +step 1696/5000 loss 0.2348 (w 0.2267 mse 0.2479 t 795 new 0.22) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +step 1697/5000 loss 0.4559 (w 0.2184 mse 0.2383 t 404 new 0.21) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +step 1698/5000 loss 0.4393 (w 0.2778 mse 0.2833 t 915 new 0.16) lr 1.00e-05 gnorm 0.157 3.40s mem 81.1GB +step 1699/5000 loss 0.2874 (w 0.2266 mse 0.2426 t 959 new 0.27) lr 1.00e-05 gnorm 0.105 3.05s mem 81.1GB +step 1700/5000 loss 0.3210 (w 0.3284 mse 0.3396 t 981 new 0.21) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +step 1701/5000 loss 0.3176 (w 0.3348 mse 0.3312 t 979 new 0.23) lr 1.00e-05 gnorm 0.411 3.10s mem 81.1GB +step 1702/5000 loss 0.3223 (w 0.3354 mse 0.3403 t 453 new 0.17) lr 1.00e-05 gnorm 0.313 2.84s mem 81.1GB +step 1703/5000 loss 0.3529 (w 0.2827 mse 0.2928 t 749 new 0.24) lr 1.00e-05 gnorm 0.123 3.04s mem 81.1GB +step 1704/5000 loss 0.2557 (w 0.2355 mse 0.2366 t 888 new 0.10) lr 1.00e-05 gnorm 0.114 3.34s mem 81.1GB +step 1705/5000 loss 0.1404 (w 0.4201 mse 0.4323 t 988 new 0.18) lr 1.00e-05 gnorm 0.116 3.03s mem 81.1GB +step 1706/5000 loss 0.2758 (w 0.2030 mse 0.1983 t 684 new 0.13) lr 1.00e-05 gnorm 0.120 2.82s mem 81.1GB +step 1707/5000 loss 0.3336 (w 0.2579 mse 0.2572 t 980 new 0.21) lr 1.00e-05 gnorm 0.298 3.13s mem 81.1GB +step 1708/5000 loss 0.4617 (w 0.3159 mse 0.3164 t 523 new 0.18) lr 1.00e-05 gnorm 0.113 2.82s mem 81.1GB +step 1709/5000 loss 0.3256 (w 0.2888 mse 0.2935 t 954 new 0.25) lr 1.00e-05 gnorm 0.125 3.02s mem 81.1GB +step 1710/5000 loss 0.2931 (w 0.3137 mse 0.3124 t 933 new 0.21) lr 1.00e-05 gnorm 0.335 3.11s mem 81.1GB +step 1711/5000 loss 0.2488 (w 0.3403 mse 0.3380 t 594 new 0.22) lr 1.00e-05 gnorm 0.123 3.03s mem 81.1GB +step 1712/5000 loss 0.1977 (w 0.3399 mse 0.3406 t 948 new 0.28) lr 1.00e-05 gnorm 0.155 3.09s mem 81.1GB +step 1713/5000 loss 0.3423 (w 0.2753 mse 0.2817 t 626 new 0.17) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +step 1714/5000 loss 0.1879 (w 0.1735 mse 0.1838 t 858 new 0.09) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +step 1715/5000 loss 0.2674 (w 0.3220 mse 0.3369 t 895 new 0.21) lr 1.00e-05 gnorm 0.134 3.28s mem 81.1GB +step 1716/5000 loss 0.2127 (w 0.5330 mse 0.5431 t 998 new 0.19) lr 1.00e-05 gnorm 0.107 2.83s mem 81.1GB +step 1717/5000 loss 0.3860 (w 0.2983 mse 0.3082 t 930 new 0.22) lr 1.00e-05 gnorm 0.206 3.10s mem 81.1GB +step 1718/5000 loss 0.2854 (w 0.3799 mse 0.3735 t 983 new 0.13) lr 1.00e-05 gnorm 0.189 3.31s mem 81.1GB +step 1719/5000 loss 0.2658 (w 0.3026 mse 0.3126 t 981 new 0.08) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +step 1720/5000 loss 0.3959 (w 0.3275 mse 0.3392 t 969 new 0.23) lr 1.00e-05 gnorm 1.195 2.83s mem 81.1GB +step 1721/5000 loss 0.2556 (w 0.3345 mse 0.3410 t 999 new 0.19) lr 1.00e-05 gnorm 0.118 3.31s mem 81.1GB +step 1722/5000 loss 0.3504 (w 0.2570 mse 0.2671 t 897 new 0.20) lr 1.00e-05 gnorm 0.184 3.10s mem 81.1GB +step 1723/5000 loss 0.2179 (w 0.1967 mse 0.2093 t 870 new 0.24) lr 1.00e-05 gnorm 0.104 2.83s mem 81.1GB +step 1724/5000 loss 0.2950 (w 0.3251 mse 0.3208 t 726 new 0.24) lr 1.00e-05 gnorm 0.151 3.33s mem 81.1GB +step 1725/5000 loss 0.2887 (w 0.3260 mse 0.3203 t 864 new 0.23) lr 1.00e-05 gnorm 0.154 3.06s mem 81.1GB +step 1726/5000 loss 0.5207 (w 0.3595 mse 0.3634 t 523 new 0.21) lr 1.00e-05 gnorm 0.153 3.00s mem 81.1GB +step 1727/5000 loss 0.3076 (w 0.2579 mse 0.2807 t 881 new 0.28) lr 1.00e-05 gnorm 0.205 3.08s mem 81.1GB +step 1728/5000 loss 0.2512 (w 0.2765 mse 0.2834 t 861 new 0.25) lr 1.00e-05 gnorm 0.186 3.10s mem 81.1GB +step 1729/5000 loss 0.3650 (w 0.3619 mse 0.3782 t 998 new 0.25) lr 1.00e-05 gnorm 0.154 2.84s mem 81.1GB +step 1730/5000 loss 0.2105 (w 0.2517 mse 0.2499 t 835 new 0.10) lr 1.00e-05 gnorm 0.134 3.29s mem 81.1GB +step 1731/5000 loss 0.2232 (w 0.4098 mse 0.4004 t 868 new 0.25) lr 1.00e-05 gnorm 0.276 3.06s mem 81.1GB +step 1732/5000 loss 0.2219 (w 0.2065 mse 0.2236 t 864 new 0.22) lr 1.00e-05 gnorm 0.095 3.01s mem 81.1GB +step 1733/5000 loss 0.2816 (w 0.2118 mse 0.2263 t 703 new 0.25) lr 1.00e-05 gnorm 0.115 3.12s mem 81.1GB +step 1734/5000 loss 0.5024 (w 0.1729 mse 0.1948 t 697 new 0.24) lr 1.00e-05 gnorm 0.142 3.30s mem 81.1GB +step 1735/5000 loss 0.2905 (w 0.2963 mse 0.3018 t 639 new 0.21) lr 1.00e-05 gnorm 0.244 2.83s mem 81.1GB +step 1736/5000 loss 0.5410 (w 0.3453 mse 0.3533 t 375 new 0.23) lr 1.00e-05 gnorm 0.412 3.16s mem 81.1GB +step 1737/5000 loss 0.2811 (w 0.4082 mse 0.4198 t 997 new 0.22) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +step 1738/5000 loss 0.4675 (w 0.2974 mse 0.3042 t 580 new 0.21) lr 1.00e-05 gnorm 0.199 3.02s mem 81.1GB +step 1739/5000 loss 0.5542 (w 0.2891 mse 0.2965 t 779 new 0.23) lr 1.00e-05 gnorm 0.212 3.37s mem 81.1GB +step 1740/5000 loss 0.2344 (w 0.3405 mse 0.3543 t 964 new 0.24) lr 1.00e-05 gnorm 0.123 3.36s mem 81.1GB +step 1741/5000 loss 0.4154 (w 0.3246 mse 0.3407 t 982 new 0.22) lr 1.00e-05 gnorm 0.140 2.82s mem 81.1GB +step 1742/5000 loss 0.2045 (w 0.3661 mse 0.3686 t 988 new 0.14) lr 1.00e-05 gnorm 0.094 3.07s mem 81.1GB +step 1743/5000 loss 0.5827 (w 0.3850 mse 0.4280 t 233 new 0.23) lr 1.00e-05 gnorm 0.152 3.10s mem 81.1GB +step 1744/5000 loss 0.3141 (w 0.3259 mse 0.3233 t 823 new 0.24) lr 1.00e-05 gnorm 0.141 3.07s mem 81.1GB +step 1745/5000 loss 0.1594 (w 0.2395 mse 0.2541 t 697 new 0.15) lr 1.00e-05 gnorm 0.154 3.08s mem 81.1GB +step 1746/5000 loss 0.2294 (w 0.2202 mse 0.2287 t 937 new 0.16) lr 1.00e-05 gnorm 0.130 3.11s mem 81.1GB +step 1747/5000 loss 0.5173 (w 0.3512 mse 0.3581 t 473 new 0.21) lr 1.00e-05 gnorm 0.227 3.01s mem 81.1GB +step 1748/5000 loss 0.2787 (w 0.2973 mse 0.3087 t 980 new 0.22) lr 1.00e-05 gnorm 0.154 3.14s mem 81.1GB +step 1749/5000 loss 0.3743 (w 0.3137 mse 0.3121 t 944 new 0.23) lr 1.00e-05 gnorm 0.159 3.10s mem 81.1GB +step 1750/5000 loss 0.3278 (w 0.3842 mse 0.3823 t 960 new 0.22) lr 1.00e-05 gnorm 0.168 3.07s mem 81.1GB +step 1751/5000 loss 0.3149 (w 0.3295 mse 0.3275 t 694 new 0.23) lr 1.00e-05 gnorm 0.232 3.11s mem 81.1GB +step 1752/5000 loss 0.1838 (w 0.2023 mse 0.2113 t 808 new 0.20) lr 1.00e-05 gnorm 0.146 3.15s mem 81.1GB +step 1753/5000 loss 0.1162 (w 0.3332 mse 0.3350 t 979 new 0.19) lr 1.00e-05 gnorm 0.187 3.06s mem 81.1GB +step 1754/5000 loss 0.0979 (w 0.5060 mse 0.5074 t 993 new 0.27) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +step 1755/5000 loss 0.3518 (w 0.2247 mse 0.2396 t 934 new 0.24) lr 1.00e-05 gnorm 0.125 3.08s mem 81.1GB +step 1756/5000 loss 0.3970 (w 0.2580 mse 0.2602 t 802 new 0.21) lr 1.00e-05 gnorm 0.182 3.10s mem 81.1GB +step 1757/5000 loss 0.1594 (w 0.3699 mse 0.3774 t 942 new 0.25) lr 1.00e-05 gnorm 0.191 3.05s mem 81.1GB +step 1758/5000 loss 0.2367 (w 0.3754 mse 0.3763 t 921 new 0.21) lr 1.00e-05 gnorm 0.161 3.08s mem 81.1GB +step 1759/5000 loss 0.2135 (w 0.4492 mse 0.4428 t 379 new 0.19) lr 1.00e-05 gnorm 0.195 3.10s mem 81.1GB +step 1760/5000 loss 0.2787 (w 0.2619 mse 0.2661 t 844 new 0.24) lr 1.00e-05 gnorm 0.406 2.82s mem 81.1GB +step 1761/5000 loss 0.2302 (w 0.2087 mse 0.2274 t 931 new 0.20) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +step 1762/5000 loss 0.2222 (w 0.3149 mse 0.3121 t 884 new 0.16) lr 1.00e-05 gnorm 0.139 3.32s mem 81.1GB +step 1763/5000 loss 0.2679 (w 0.3347 mse 0.3392 t 893 new 0.18) lr 1.00e-05 gnorm 0.155 3.11s mem 81.1GB +step 1764/5000 loss 0.2195 (w 0.2748 mse 0.3026 t 971 new 0.23) lr 1.00e-05 gnorm 0.132 3.05s mem 81.1GB +step 1765/5000 loss 0.2521 (w 0.3568 mse 0.3616 t 939 new 0.22) lr 1.00e-05 gnorm 0.136 3.15s mem 81.1GB +step 1766/5000 loss 0.2581 (w 0.3021 mse 0.3167 t 584 new 0.20) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +step 1767/5000 loss 0.4369 (w 0.3795 mse 0.3914 t 954 new 0.20) lr 1.00e-05 gnorm 0.148 3.09s mem 81.1GB +step 1768/5000 loss 0.3378 (w 0.3724 mse 0.3874 t 996 new 0.23) lr 1.00e-05 gnorm 0.399 3.37s mem 81.1GB +step 1769/5000 loss 0.3089 (w 0.3726 mse 0.3734 t 500 new 0.22) lr 1.00e-05 gnorm 0.264 3.06s mem 81.1GB +step 1770/5000 loss 0.3488 (w 0.2847 mse 0.2908 t 912 new 0.22) lr 1.00e-05 gnorm 0.233 3.05s mem 81.1GB +step 1771/5000 loss 0.1689 (w 0.3183 mse 0.3330 t 998 new 0.21) lr 1.00e-05 gnorm 0.117 3.15s mem 81.1GB +step 1772/5000 loss 0.2644 (w 1.0017 mse 0.9972 t 999 new 0.23) lr 1.00e-05 gnorm 0.229 2.84s mem 81.1GB +step 1773/5000 loss 0.5303 (w 0.2574 mse 0.2651 t 757 new 0.23) lr 1.00e-05 gnorm 0.181 3.33s mem 81.1GB +step 1774/5000 loss 0.2666 (w 0.3196 mse 0.3141 t 872 new 0.23) lr 1.00e-05 gnorm 0.154 3.24s mem 81.1GB +step 1775/5000 loss 0.3520 (w 0.3046 mse 0.3179 t 642 new 0.21) lr 1.00e-05 gnorm 0.107 3.02s mem 81.1GB +step 1776/5000 loss 0.2114 (w 0.4124 mse 0.4181 t 340 new 0.16) lr 1.00e-05 gnorm 0.127 3.03s mem 81.1GB +step 1777/5000 loss 0.3096 (w 0.3123 mse 0.3100 t 975 new 0.20) lr 1.00e-05 gnorm 0.159 3.07s mem 81.1GB +step 1778/5000 loss 0.2699 (w 0.3677 mse 0.3678 t 942 new 0.24) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +step 1779/5000 loss 0.1906 (w 0.3036 mse 0.3016 t 862 new 0.23) lr 1.00e-05 gnorm 0.225 3.44s mem 81.1GB +step 1780/5000 loss 0.2526 (w 0.3444 mse 0.3479 t 716 new 0.19) lr 1.00e-05 gnorm 0.112 3.28s mem 81.1GB +step 1781/5000 loss 0.2574 (w 0.2991 mse 0.2917 t 878 new 0.19) lr 1.00e-05 gnorm 0.204 3.01s mem 81.1GB +step 1782/5000 loss 0.3441 (w 0.2837 mse 0.2768 t 879 new 0.21) lr 1.00e-05 gnorm 0.215 3.35s mem 81.1GB +step 1783/5000 loss 0.2292 (w 0.3672 mse 0.3548 t 492 new 0.17) lr 1.00e-05 gnorm 0.164 3.05s mem 81.1GB +step 1784/5000 loss 0.2745 (w 0.3510 mse 0.3415 t 867 new 0.20) lr 1.00e-05 gnorm 0.102 2.84s mem 81.1GB +step 1785/5000 loss 0.2851 (w 0.2878 mse 0.2934 t 616 new 0.18) lr 1.00e-05 gnorm 0.138 3.15s mem 81.1GB +step 1786/5000 loss 0.3883 (w 0.3461 mse 0.3407 t 833 new 0.21) lr 1.00e-05 gnorm 0.169 3.34s mem 81.1GB +step 1787/5000 loss 0.3396 (w 0.2343 mse 0.2603 t 965 new 0.23) lr 1.00e-05 gnorm 0.530 3.06s mem 81.1GB +step 1788/5000 loss 0.2909 (w 0.3670 mse 0.3577 t 956 new 0.22) lr 1.00e-05 gnorm 0.117 3.41s mem 81.1GB +step 1789/5000 loss 0.1689 (w 0.2291 mse 0.2339 t 911 new 0.25) lr 1.00e-05 gnorm 0.185 3.24s mem 81.1GB +step 1790/5000 loss 0.2389 (w 0.3196 mse 0.3197 t 911 new 0.27) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +step 1791/5000 loss 0.2181 (w 0.2581 mse 0.2520 t 729 new 0.09) lr 1.00e-05 gnorm 0.196 3.29s mem 81.1GB +step 1792/5000 loss 0.2949 (w 0.3421 mse 0.3512 t 986 new 0.24) lr 1.00e-05 gnorm 0.191 3.10s mem 81.1GB +step 1793/5000 loss 0.2465 (w 0.2254 mse 0.2406 t 759 new 0.22) lr 1.00e-05 gnorm 0.263 3.15s mem 81.1GB +step 1794/5000 loss 0.3452 (w 0.2443 mse 0.2490 t 891 new 0.16) lr 1.00e-05 gnorm 0.138 3.29s mem 81.1GB +step 1795/5000 loss 0.3136 (w 0.3390 mse 0.3474 t 631 new 0.24) lr 1.00e-05 gnorm 0.144 3.06s mem 81.1GB +step 1796/5000 loss 0.4171 (w 0.1900 mse 0.2030 t 818 new 0.23) lr 1.00e-05 gnorm 0.159 2.83s mem 81.1GB +step 1797/5000 loss 0.3460 (w 0.1730 mse 0.2010 t 924 new 0.18) lr 1.00e-05 gnorm 0.166 3.32s mem 81.1GB +step 1798/5000 loss 0.2768 (w 0.2822 mse 0.2832 t 926 new 0.20) lr 1.00e-05 gnorm 0.170 3.06s mem 81.1GB +step 1799/5000 loss 0.2606 (w 0.2813 mse 0.2942 t 970 new 0.18) lr 1.00e-05 gnorm 0.236 3.15s mem 81.1GB +step 1800/5000 loss 0.3107 (w 0.3532 mse 0.3482 t 908 new 0.21) lr 1.00e-05 gnorm 0.124 3.27s mem 81.1GB +step 1801/5000 loss 0.2509 (w 0.2569 mse 0.2629 t 883 new 0.19) lr 1.00e-05 gnorm 0.136 3.05s mem 81.1GB +step 1802/5000 loss 0.1999 (w 0.2404 mse 0.2641 t 949 new 0.14) lr 1.00e-05 gnorm 0.126 3.13s mem 81.1GB +step 1803/5000 loss 0.3614 (w 0.2053 mse 0.2141 t 839 new 0.24) lr 1.00e-05 gnorm 0.136 3.27s mem 81.1GB +step 1804/5000 loss 0.3842 (w 0.2364 mse 0.2461 t 680 new 0.24) lr 1.00e-05 gnorm 0.153 3.13s mem 81.1GB +step 1805/5000 loss 0.4615 (w 0.3148 mse 0.3176 t 639 new 0.19) lr 1.00e-05 gnorm 0.415 3.21s mem 81.1GB +step 1806/5000 loss 0.2827 (w 0.1826 mse 0.1938 t 680 new 0.15) lr 1.00e-05 gnorm 0.167 3.33s mem 81.1GB +step 1807/5000 loss 0.2877 (w 0.2230 mse 0.2255 t 953 new 0.15) lr 1.00e-05 gnorm 0.105 3.35s mem 81.1GB +step 1808/5000 loss 0.2091 (w 0.3083 mse 0.3005 t 918 new 0.19) lr 1.00e-05 gnorm 0.287 3.04s mem 81.1GB +step 1809/5000 loss 0.1595 (w 0.2247 mse 0.2336 t 946 new 0.21) lr 1.00e-05 gnorm 0.123 3.40s mem 81.1GB +step 1810/5000 loss 0.4501 (w 0.2085 mse 0.2108 t 698 new 0.08) lr 1.00e-05 gnorm 0.201 2.83s mem 81.1GB +step 1811/5000 loss 0.3266 (w 0.2298 mse 0.2420 t 896 new 0.20) lr 1.00e-05 gnorm 0.168 3.11s mem 81.1GB +step 1812/5000 loss 0.1039 (w 0.2273 mse 0.2464 t 929 new 0.18) lr 1.00e-05 gnorm 0.283 3.35s mem 81.1GB +step 1813/5000 loss 0.2357 (w 0.3032 mse 0.3221 t 973 new 0.15) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +step 1814/5000 loss 0.2614 (w 0.6248 mse 0.6317 t 183 new 0.23) lr 1.00e-05 gnorm 0.091 3.05s mem 81.1GB +step 1815/5000 loss 0.1156 (w 0.3474 mse 0.3318 t 956 new 0.21) lr 1.00e-05 gnorm 0.227 3.43s mem 81.1GB +step 1816/5000 loss 0.2081 (w 0.3009 mse 0.3158 t 949 new 0.23) lr 1.00e-05 gnorm 0.245 3.22s mem 81.1GB +step 1817/5000 loss 0.1337 (w 0.2708 mse 0.2765 t 851 new 0.15) lr 1.00e-05 gnorm 0.186 3.10s mem 81.1GB +step 1818/5000 loss 0.2891 (w 0.2612 mse 0.2863 t 685 new 0.18) lr 1.00e-05 gnorm 0.264 3.32s mem 81.1GB +step 1819/5000 loss 0.1988 (w 0.3175 mse 0.3207 t 875 new 0.23) lr 1.00e-05 gnorm 0.181 2.82s mem 81.1GB +step 1820/5000 loss 0.2428 (w 0.2476 mse 0.2697 t 873 new 0.22) lr 1.00e-05 gnorm 0.154 3.07s mem 81.1GB +step 1821/5000 loss 0.5127 (w 0.3004 mse 0.3191 t 476 new 0.18) lr 1.00e-05 gnorm 0.154 3.29s mem 81.1GB +step 1822/5000 loss 0.2968 (w 0.3440 mse 0.3539 t 849 new 0.15) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +step 1823/5000 loss 0.4118 (w 0.2217 mse 0.2373 t 631 new 0.17) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +step 1824/5000 loss 0.3040 (w 0.4067 mse 0.4003 t 954 new 0.24) lr 1.00e-05 gnorm 0.156 3.33s mem 81.1GB +step 1825/5000 loss 0.2482 (w 0.3008 mse 0.2977 t 918 new 0.12) lr 1.00e-05 gnorm 0.180 2.84s mem 81.1GB +step 1826/5000 loss 0.2611 (w 0.3117 mse 0.3130 t 958 new 0.17) lr 1.00e-05 gnorm 0.147 3.05s mem 81.1GB +step 1827/5000 loss 0.3349 (w 0.3146 mse 0.3149 t 925 new 0.22) lr 1.00e-05 gnorm 0.183 3.35s mem 81.1GB +step 1828/5000 loss 0.4628 (w 0.2427 mse 0.2446 t 513 new 0.22) lr 1.00e-05 gnorm 0.307 3.03s mem 81.1GB +step 1829/5000 loss 0.1755 (w 0.3726 mse 0.3835 t 960 new 0.11) lr 1.00e-05 gnorm 0.273 2.82s mem 81.1GB +step 1830/5000 loss 0.3693 (w 0.3119 mse 0.3199 t 444 new 0.24) lr 1.00e-05 gnorm 0.188 3.33s mem 81.1GB +step 1831/5000 loss 0.3571 (w 0.3415 mse 0.3474 t 858 new 0.16) lr 1.00e-05 gnorm 0.178 2.82s mem 81.1GB +step 1832/5000 loss 0.1317 (w 0.3293 mse 0.3374 t 998 new 0.17) lr 1.00e-05 gnorm 0.178 3.09s mem 81.1GB +step 1833/5000 loss 0.2613 (w 0.3676 mse 0.3854 t 988 new 0.21) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +step 1834/5000 loss 0.1931 (w 0.3475 mse 0.3385 t 997 new 0.22) lr 1.00e-05 gnorm 0.333 3.03s mem 81.1GB +step 1835/5000 loss 0.1592 (w 0.2620 mse 0.2637 t 855 new 0.25) lr 1.00e-05 gnorm 0.222 3.09s mem 81.1GB +step 1836/5000 loss 0.4063 (w 0.7170 mse 0.7180 t 992 new 0.21) lr 1.00e-05 gnorm 0.169 3.07s mem 81.1GB +step 1837/5000 loss 0.2766 (w 0.2721 mse 0.2752 t 821 new 0.22) lr 1.00e-05 gnorm 0.128 3.06s mem 81.1GB +step 1838/5000 loss 0.2982 (w 0.2421 mse 0.2415 t 865 new 0.23) lr 1.00e-05 gnorm 0.119 3.12s mem 81.1GB +step 1839/5000 loss 0.2835 (w 0.3847 mse 0.3947 t 976 new 0.21) lr 1.00e-05 gnorm 0.147 3.10s mem 81.1GB +step 1840/5000 loss 0.1806 (w 0.2557 mse 0.2833 t 991 new 0.19) lr 1.00e-05 gnorm 0.276 3.05s mem 81.1GB +step 1841/5000 loss 0.2210 (w 0.2447 mse 0.2633 t 993 new 0.12) lr 1.00e-05 gnorm 0.619 2.83s mem 81.1GB +step 1842/5000 loss 0.3978 (w 0.3400 mse 0.3508 t 988 new 0.20) lr 1.00e-05 gnorm 0.266 3.14s mem 81.1GB +step 1843/5000 loss 0.3095 (w 0.3960 mse 0.4004 t 982 new 0.24) lr 1.00e-05 gnorm 0.129 3.06s mem 81.1GB +step 1844/5000 loss 0.2624 (w 0.3798 mse 0.3843 t 979 new 0.24) lr 1.00e-05 gnorm 0.183 3.10s mem 81.1GB +step 1845/5000 loss 0.1326 (w 0.2857 mse 0.2980 t 994 new 0.12) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +step 1846/5000 loss 0.2300 (w 0.3596 mse 0.3614 t 984 new 0.20) lr 1.00e-05 gnorm 0.239 3.04s mem 81.1GB +step 1847/5000 loss 0.3128 (w 0.3041 mse 0.3070 t 830 new 0.24) lr 1.00e-05 gnorm 0.159 3.05s mem 81.1GB +step 1848/5000 loss 0.3916 (w 0.3868 mse 0.3833 t 476 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +step 1849/5000 loss 0.2337 (w 0.2505 mse 0.2641 t 925 new 0.23) lr 1.00e-05 gnorm 0.253 3.05s mem 81.1GB +step 1850/5000 loss 0.2570 (w 0.3061 mse 0.3129 t 873 new 0.26) lr 1.00e-05 gnorm 0.188 3.03s mem 81.1GB +step 1851/5000 loss 0.1544 (w 0.3284 mse 0.3407 t 903 new 0.20) lr 1.00e-05 gnorm 0.291 3.09s mem 81.1GB +step 1852/5000 loss 0.3789 (w 0.3674 mse 0.3729 t 859 new 0.26) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +step 1853/5000 loss 0.1299 (w 0.2046 mse 0.2183 t 766 new 0.21) lr 1.00e-05 gnorm 0.144 3.24s mem 81.1GB +step 1854/5000 loss 0.3347 (w 0.3347 mse 0.3294 t 859 new 0.17) lr 1.00e-05 gnorm 0.136 2.82s mem 81.1GB +step 1855/5000 loss 0.2131 (w 0.3487 mse 0.3558 t 609 new 0.24) lr 1.00e-05 gnorm 0.111 3.09s mem 81.1GB +step 1856/5000 loss 0.2575 (w 0.2289 mse 0.2333 t 894 new 0.10) lr 1.00e-05 gnorm 0.244 3.06s mem 81.1GB +step 1857/5000 loss 0.3726 (w 0.1701 mse 0.1877 t 706 new 0.15) lr 1.00e-05 gnorm 0.150 3.27s mem 81.1GB +step 1858/5000 loss 0.3152 (w 0.3811 mse 0.3747 t 908 new 0.21) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +step 1859/5000 loss 0.1497 (w 0.4198 mse 0.4114 t 991 new 0.25) lr 1.00e-05 gnorm 0.112 3.25s mem 81.1GB +step 1860/5000 loss 0.2347 (w 0.2684 mse 0.2742 t 881 new 0.23) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +step 1861/5000 loss 0.2798 (w 0.2828 mse 0.2838 t 862 new 0.21) lr 1.00e-05 gnorm 0.119 3.13s mem 81.1GB +step 1862/5000 loss 0.3690 (w 0.2544 mse 0.2584 t 778 new 0.08) lr 1.00e-05 gnorm 0.121 3.11s mem 81.1GB +step 1863/5000 loss 0.1276 (w 0.2594 mse 0.2546 t 838 new 0.10) lr 1.00e-05 gnorm 0.127 3.31s mem 81.1GB +step 1864/5000 loss 0.2713 (w 0.2967 mse 0.3288 t 428 new 0.19) lr 1.00e-05 gnorm 0.146 2.82s mem 81.1GB +step 1865/5000 loss 0.4391 (w 0.2288 mse 0.2396 t 794 new 0.21) lr 1.00e-05 gnorm 0.143 3.26s mem 81.1GB +step 1866/5000 loss 0.2633 (w 0.2833 mse 0.2843 t 967 new 0.22) lr 1.00e-05 gnorm 0.152 2.82s mem 81.1GB +step 1867/5000 loss 0.3376 (w 0.3334 mse 0.3405 t 444 new 0.18) lr 1.00e-05 gnorm 0.148 3.12s mem 81.1GB +step 1868/5000 loss 0.1694 (w 0.3652 mse 0.3651 t 997 new 0.23) lr 1.00e-05 gnorm 0.127 3.27s mem 81.1GB +step 1869/5000 loss 0.4768 (w 0.4576 mse 0.4703 t 375 new 0.28) lr 1.00e-05 gnorm 0.202 3.07s mem 81.1GB +step 1870/5000 loss 0.2257 (w 0.3312 mse 0.3316 t 917 new 0.25) lr 1.00e-05 gnorm 0.135 3.09s mem 81.1GB +step 1871/5000 loss 0.3569 (w 0.3603 mse 0.3555 t 404 new 0.21) lr 1.00e-05 gnorm 0.165 3.04s mem 81.1GB +step 1872/5000 loss 0.2089 (w 0.3497 mse 0.3400 t 889 new 0.15) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +step 1873/5000 loss 0.2659 (w 0.2783 mse 0.2927 t 999 new 0.20) lr 1.00e-05 gnorm 0.159 3.31s mem 81.1GB +step 1874/5000 loss 0.2347 (w 0.2992 mse 0.3013 t 937 new 0.27) lr 1.00e-05 gnorm 0.141 3.04s mem 81.1GB +step 1875/5000 loss 0.3329 (w 0.2984 mse 0.3061 t 624 new 0.16) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +step 1876/5000 loss 0.1853 (w 0.3764 mse 0.3676 t 960 new 0.22) lr 1.00e-05 gnorm 0.120 3.09s mem 81.1GB +step 1877/5000 loss 0.2631 (w 0.2735 mse 0.2702 t 949 new 0.08) lr 1.00e-05 gnorm 0.104 3.09s mem 81.1GB +step 1878/5000 loss 0.2206 (w 0.5688 mse 0.5590 t 978 new 0.19) lr 1.00e-05 gnorm 0.248 2.83s mem 81.1GB +step 1879/5000 loss 0.2099 (w 0.2416 mse 0.2544 t 819 new 0.11) lr 1.00e-05 gnorm 0.138 3.23s mem 81.1GB +step 1880/5000 loss 0.2780 (w 0.4350 mse 0.4250 t 989 new 0.24) lr 1.00e-05 gnorm 0.176 3.10s mem 81.1GB +step 1881/5000 loss 0.1806 (w 0.2593 mse 0.2765 t 947 new 0.24) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 1882/5000 loss 0.3259 (w 0.3617 mse 0.3644 t 999 new 0.21) lr 1.00e-05 gnorm 0.154 3.07s mem 81.1GB +step 1883/5000 loss 0.4770 (w 0.2857 mse 0.2887 t 710 new 0.21) lr 1.00e-05 gnorm 0.168 3.11s mem 81.1GB +step 1884/5000 loss 0.2266 (w 0.1743 mse 0.1868 t 918 new 0.20) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +step 1885/5000 loss 0.2303 (w 0.3259 mse 0.3319 t 663 new 0.26) lr 1.00e-05 gnorm 0.548 3.27s mem 81.1GB +step 1886/5000 loss 0.4172 (w 0.2963 mse 0.2958 t 977 new 0.21) lr 1.00e-05 gnorm 0.150 3.28s mem 81.1GB +step 1887/5000 loss 0.3739 (w 0.2823 mse 0.3276 t 993 new 0.19) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +step 1888/5000 loss 0.2556 (w 0.3071 mse 0.3190 t 922 new 0.13) lr 1.00e-05 gnorm 0.409 3.55s mem 81.1GB +step 1889/5000 loss 0.2201 (w 0.2753 mse 0.2761 t 987 new 0.25) lr 1.00e-05 gnorm 0.121 3.04s mem 81.1GB +step 1890/5000 loss 0.3887 (w 0.3275 mse 0.3460 t 932 new 0.24) lr 1.00e-05 gnorm 0.148 2.84s mem 81.1GB +step 1891/5000 loss 0.2738 (w 0.6715 mse 0.6644 t 995 new 0.17) lr 1.00e-05 gnorm 0.122 3.12s mem 81.1GB +step 1892/5000 loss 0.3363 (w 0.2250 mse 0.2503 t 804 new 0.21) lr 1.00e-05 gnorm 0.122 3.26s mem 81.1GB +step 1893/5000 loss 0.3655 (w 0.3414 mse 0.3608 t 929 new 0.21) lr 1.00e-05 gnorm 0.131 3.08s mem 81.1GB +step 1894/5000 loss 0.3797 (w 0.2387 mse 0.2495 t 841 new 0.19) lr 1.00e-05 gnorm 1.196 3.55s mem 81.1GB +step 1895/5000 loss 0.4000 (w 0.2744 mse 0.2839 t 891 new 0.19) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +step 1896/5000 loss 0.3536 (w 0.2115 mse 0.2167 t 967 new 0.19) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +step 1897/5000 loss 0.2988 (w 0.2540 mse 0.2646 t 679 new 0.26) lr 1.00e-05 gnorm 0.161 3.29s mem 81.1GB +step 1898/5000 loss 0.3069 (w 0.2042 mse 0.2096 t 713 new 0.17) lr 1.00e-05 gnorm 0.107 3.05s mem 81.1GB +step 1899/5000 loss 0.2893 (w 0.2743 mse 0.2706 t 875 new 0.16) lr 1.00e-05 gnorm 0.134 3.36s mem 81.1GB +step 1900/5000 loss 0.3336 (w 0.2030 mse 0.2356 t 926 new 0.19) lr 1.00e-05 gnorm 0.373 3.01s mem 81.1GB +step 1901/5000 loss 0.2622 (w 0.2129 mse 0.2288 t 935 new 0.27) lr 1.00e-05 gnorm 0.125 3.13s mem 81.1GB +step 1902/5000 loss 0.3879 (w 0.2571 mse 0.2646 t 839 new 0.17) lr 1.00e-05 gnorm 0.141 3.04s mem 81.1GB +step 1903/5000 loss 0.1412 (w 0.3216 mse 0.3108 t 934 new 0.13) lr 1.00e-05 gnorm 0.164 3.22s mem 81.1GB +step 1904/5000 loss 0.1532 (w 0.3889 mse 0.3819 t 979 new 0.23) lr 1.00e-05 gnorm 0.887 3.05s mem 81.1GB +step 1905/5000 loss 0.2940 (w 0.4467 mse 0.4370 t 274 new 0.18) lr 1.00e-05 gnorm 0.130 3.59s mem 81.1GB +step 1906/5000 loss 0.2767 (w 0.5005 mse 0.4985 t 379 new 0.26) lr 1.00e-05 gnorm 0.645 3.39s mem 81.1GB +step 1907/5000 loss 0.2390 (w 0.2162 mse 0.2345 t 977 new 0.12) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +step 1908/5000 loss 0.1758 (w 0.2581 mse 0.2750 t 930 new 0.16) lr 1.00e-05 gnorm 0.144 3.07s mem 81.1GB +step 1909/5000 loss 0.3410 (w 0.2902 mse 0.2960 t 870 new 0.22) lr 1.00e-05 gnorm 0.107 3.32s mem 81.1GB +step 1910/5000 loss 0.2020 (w 0.3496 mse 0.3339 t 906 new 0.16) lr 1.00e-05 gnorm 0.144 3.10s mem 81.1GB +step 1911/5000 loss 0.2491 (w 0.2163 mse 0.2329 t 761 new 0.22) lr 1.00e-05 gnorm 0.142 3.46s mem 81.1GB +step 1912/5000 loss 0.3113 (w 0.2489 mse 0.2438 t 838 new 0.21) lr 1.00e-05 gnorm 0.241 3.07s mem 81.1GB +step 1913/5000 loss 0.3286 (w 0.3164 mse 0.3221 t 847 new 0.16) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +step 1914/5000 loss 0.2742 (w 0.2615 mse 0.2693 t 889 new 0.22) lr 1.00e-05 gnorm 0.199 3.08s mem 81.1GB +step 1915/5000 loss 0.2920 (w 0.2531 mse 0.2663 t 847 new 0.18) lr 1.00e-05 gnorm 0.170 3.01s mem 81.1GB +step 1916/5000 loss 0.4191 (w 0.4831 mse 0.4933 t 344 new 0.21) lr 1.00e-05 gnorm 0.184 3.06s mem 81.1GB +step 1917/5000 loss 0.1430 (w 0.2045 mse 0.2172 t 859 new 0.14) lr 1.00e-05 gnorm 0.121 3.39s mem 81.1GB +step 1918/5000 loss 0.3531 (w 0.3075 mse 0.3161 t 948 new 0.18) lr 1.00e-05 gnorm 0.140 3.09s mem 81.1GB +step 1919/5000 loss 0.2030 (w 0.9987 mse 1.0763 t 994 new 0.18) lr 1.00e-05 gnorm 0.193 2.85s mem 81.1GB +step 1920/5000 loss 0.4660 (w 0.4411 mse 0.4459 t 437 new 0.14) lr 1.00e-05 gnorm 0.129 3.13s mem 81.1GB +step 1921/5000 loss 0.1727 (w 0.4389 mse 0.4292 t 962 new 0.13) lr 1.00e-05 gnorm 0.123 3.05s mem 81.1GB +step 1922/5000 loss 0.1594 (w 0.3698 mse 0.3744 t 982 new 0.16) lr 1.00e-05 gnorm 0.145 3.07s mem 81.1GB +step 1923/5000 loss 0.2000 (w 0.3147 mse 0.3199 t 929 new 0.19) lr 1.00e-05 gnorm 0.121 3.48s mem 81.1GB +step 1924/5000 loss 0.3955 (w 0.3119 mse 0.3114 t 965 new 0.15) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +step 1925/5000 loss 0.3892 (w 0.2636 mse 0.2796 t 549 new 0.22) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +step 1926/5000 loss 0.4240 (w 0.2742 mse 0.2785 t 945 new 0.14) lr 1.00e-05 gnorm 0.183 3.13s mem 81.1GB +step 1927/5000 loss 0.3786 (w 0.3501 mse 0.3693 t 315 new 0.24) lr 1.00e-05 gnorm 0.234 3.09s mem 81.1GB +step 1928/5000 loss 0.2180 (w 0.2980 mse 0.2944 t 839 new 0.23) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +step 1929/5000 loss 0.2467 (w 0.2098 mse 0.2222 t 944 new 0.10) lr 1.00e-05 gnorm 0.158 3.45s mem 81.1GB +step 1930/5000 loss 0.2023 (w 0.3435 mse 0.3518 t 916 new 0.23) lr 1.00e-05 gnorm 0.161 3.06s mem 81.1GB +step 1931/5000 loss 0.3802 (w 0.2319 mse 0.2344 t 915 new 0.19) lr 1.00e-05 gnorm 0.124 2.85s mem 81.1GB +step 1932/5000 loss 0.2796 (w 0.2646 mse 0.2759 t 939 new 0.27) lr 1.00e-05 gnorm 0.186 3.44s mem 81.1GB +step 1933/5000 loss 0.1500 (w 0.2967 mse 0.2991 t 908 new 0.21) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 1934/5000 loss 0.3019 (w 0.6830 mse 0.7053 t 107 new 0.17) lr 1.00e-05 gnorm 0.174 3.07s mem 81.1GB +step 1935/5000 loss 0.2482 (w 0.3449 mse 0.3470 t 982 new 0.22) lr 1.00e-05 gnorm 0.142 3.26s mem 81.1GB +step 1936/5000 loss 0.4837 (w 0.3118 mse 0.3099 t 909 new 0.19) lr 1.00e-05 gnorm 0.151 3.08s mem 81.1GB +step 1937/5000 loss 0.1242 (w 0.3506 mse 0.3559 t 926 new 0.23) lr 1.00e-05 gnorm 0.210 2.83s mem 81.1GB +step 1938/5000 loss 0.1111 (w 0.3638 mse 0.3640 t 998 new 0.24) lr 1.00e-05 gnorm 0.140 3.31s mem 81.1GB +step 1939/5000 loss 0.3379 (w 0.2981 mse 0.2972 t 689 new 0.18) lr 1.00e-05 gnorm 0.208 2.83s mem 81.1GB +step 1940/5000 loss 0.4000 (w 0.3421 mse 0.3411 t 873 new 0.25) lr 1.00e-05 gnorm 0.322 3.39s mem 81.1GB +step 1941/5000 loss 0.3062 (w 0.3954 mse 0.3903 t 933 new 0.22) lr 1.00e-05 gnorm 0.169 3.04s mem 81.1GB +step 1942/5000 loss 0.2861 (w 0.3156 mse 0.3199 t 794 new 0.25) lr 1.00e-05 gnorm 0.173 3.08s mem 81.1GB +step 1943/5000 loss 0.3511 (w 0.2384 mse 0.2387 t 913 new 0.12) lr 1.00e-05 gnorm 0.194 3.11s mem 81.1GB +step 1944/5000 loss 0.2264 (w 0.2554 mse 0.2623 t 956 new 0.11) lr 1.00e-05 gnorm 0.105 3.34s mem 81.1GB +step 1945/5000 loss 0.3520 (w 0.2155 mse 0.2219 t 660 new 0.22) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +step 1946/5000 loss 0.3129 (w 0.1890 mse 0.2111 t 810 new 0.21) lr 1.00e-05 gnorm 0.177 3.40s mem 81.1GB +step 1947/5000 loss 0.3763 (w 0.2400 mse 0.2432 t 950 new 0.10) lr 1.00e-05 gnorm 0.201 3.05s mem 81.1GB +step 1948/5000 loss 0.1567 (w 0.4615 mse 0.4582 t 990 new 0.12) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +step 1949/5000 loss 0.2986 (w 0.3298 mse 0.3347 t 933 new 0.26) lr 1.00e-05 gnorm 0.154 3.02s mem 81.1GB +step 1950/5000 loss 0.2999 (w 0.3892 mse 0.3834 t 437 new 0.19) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +step 1951/5000 loss 0.1381 (w 0.2461 mse 0.2573 t 968 new 0.18) lr 1.00e-05 gnorm 0.163 2.86s mem 81.1GB +step 1952/5000 loss 0.2634 (w 0.2019 mse 0.2176 t 916 new 0.24) lr 1.00e-05 gnorm 0.128 3.42s mem 81.1GB +step 1953/5000 loss 0.2587 (w 0.2705 mse 0.2745 t 896 new 0.16) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +step 1954/5000 loss 0.3224 (w 0.1825 mse 0.2077 t 754 new 0.20) lr 1.00e-05 gnorm 0.272 3.08s mem 81.1GB +step 1955/5000 loss 0.3148 (w 0.4739 mse 0.4747 t 991 new 0.28) lr 1.00e-05 gnorm 0.148 3.07s mem 81.1GB +step 1956/5000 loss 0.2856 (w 0.2766 mse 0.2929 t 941 new 0.19) lr 1.00e-05 gnorm 1.848 3.09s mem 81.1GB +step 1957/5000 loss 0.6420 (w 0.3045 mse 0.3085 t 717 new 0.22) lr 1.00e-05 gnorm 0.348 2.83s mem 81.1GB +step 1958/5000 loss 0.2090 (w 0.3287 mse 0.3317 t 783 new 0.26) lr 1.00e-05 gnorm 0.137 3.39s mem 81.1GB +step 1959/5000 loss 0.2978 (w 0.3301 mse 0.3449 t 518 new 0.11) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +step 1960/5000 loss 0.2707 (w 0.7453 mse 0.7498 t 120 new 0.22) lr 1.00e-05 gnorm 0.150 3.10s mem 81.1GB +step 1961/5000 loss 0.1838 (w 0.4007 mse 0.4073 t 951 new 0.16) lr 1.00e-05 gnorm 0.178 3.31s mem 81.1GB +step 1962/5000 loss 0.3868 (w 0.2969 mse 0.3056 t 811 new 0.21) lr 1.00e-05 gnorm 0.150 3.15s mem 81.1GB +step 1963/5000 loss 0.4043 (w 0.2715 mse 0.2894 t 953 new 0.18) lr 1.00e-05 gnorm 0.166 3.07s mem 81.1GB +step 1964/5000 loss 0.3183 (w 0.2590 mse 0.2763 t 677 new 0.24) lr 1.00e-05 gnorm 0.672 3.17s mem 81.1GB +step 1965/5000 loss 0.2808 (w 0.2984 mse 0.3284 t 997 new 0.23) lr 1.00e-05 gnorm 0.459 3.08s mem 81.1GB +step 1966/5000 loss 0.2416 (w 0.2734 mse 0.2771 t 866 new 0.19) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +step 1967/5000 loss 0.1027 (w 0.3051 mse 0.3022 t 870 new 0.22) lr 1.00e-05 gnorm 0.144 3.38s mem 81.1GB +step 1968/5000 loss 0.3176 (w 0.2238 mse 0.2464 t 860 new 0.22) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +step 1969/5000 loss 0.3026 (w 0.2531 mse 0.2638 t 931 new 0.23) lr 1.00e-05 gnorm 0.156 3.40s mem 81.1GB +step 1970/5000 loss 0.2062 (w 0.3602 mse 0.3535 t 975 new 0.27) lr 1.00e-05 gnorm 0.184 3.14s mem 81.1GB +step 1971/5000 loss 0.4009 (w 0.2158 mse 0.2488 t 572 new 0.24) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +step 1972/5000 loss 0.2854 (w 0.3112 mse 0.3175 t 942 new 0.16) lr 1.00e-05 gnorm 0.181 3.02s mem 81.1GB +step 1973/5000 loss 0.2025 (w 0.2482 mse 0.2589 t 871 new 0.22) lr 1.00e-05 gnorm 0.129 3.10s mem 81.1GB +step 1974/5000 loss 0.3877 (w 0.3604 mse 0.3741 t 249 new 0.08) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +step 1975/5000 loss 0.2912 (w 0.2828 mse 0.2885 t 939 new 0.23) lr 1.00e-05 gnorm 0.136 3.06s mem 81.1GB +step 1976/5000 loss 0.2602 (w 0.2034 mse 0.2281 t 800 new 0.26) lr 1.00e-05 gnorm 0.143 3.16s mem 81.1GB +step 1977/5000 loss 0.4921 (w 0.3103 mse 0.3152 t 551 new 0.23) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +step 1978/5000 loss 0.2479 (w 0.2681 mse 0.2888 t 639 new 0.24) lr 1.00e-05 gnorm 0.181 3.05s mem 81.1GB +step 1979/5000 loss 0.3231 (w 0.3619 mse 0.3595 t 968 new 0.14) lr 1.00e-05 gnorm 0.257 3.10s mem 81.1GB +step 1980/5000 loss 0.2075 (w 0.3259 mse 0.3388 t 675 new 0.23) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 1981/5000 loss 0.3067 (w 0.3308 mse 0.3333 t 987 new 0.21) lr 1.00e-05 gnorm 1.556 3.50s mem 81.1GB +step 1982/5000 loss 0.1493 (w 0.2205 mse 0.2202 t 909 new 0.16) lr 1.00e-05 gnorm 0.121 3.02s mem 81.1GB +step 1983/5000 loss 0.4650 (w 0.4251 mse 0.4311 t 397 new 0.23) lr 1.00e-05 gnorm 0.470 3.05s mem 81.1GB +step 1984/5000 loss 0.1717 (w 0.2879 mse 0.2823 t 968 new 0.21) lr 1.00e-05 gnorm 0.113 3.04s mem 81.1GB +step 1985/5000 loss 0.2513 (w 0.2188 mse 0.2397 t 853 new 0.22) lr 1.00e-05 gnorm 0.134 3.34s mem 81.1GB +step 1986/5000 loss 0.2294 (w 0.2515 mse 0.2622 t 773 new 0.23) lr 1.00e-05 gnorm 0.216 2.84s mem 81.1GB +step 1987/5000 loss 0.2985 (w 0.2755 mse 0.2865 t 647 new 0.23) lr 1.00e-05 gnorm 0.264 3.52s mem 81.1GB +step 1988/5000 loss 0.2984 (w 0.3438 mse 0.3379 t 835 new 0.22) lr 1.00e-05 gnorm 0.127 3.33s mem 81.1GB +step 1989/5000 loss 0.3788 (w 0.2619 mse 0.2972 t 928 new 0.18) lr 1.00e-05 gnorm 0.134 2.85s mem 81.1GB +step 1990/5000 loss 0.1885 (w 0.2819 mse 0.2951 t 921 new 0.19) lr 1.00e-05 gnorm 0.128 3.02s mem 81.1GB +step 1991/5000 loss 0.2279 (w 0.3126 mse 0.3422 t 278 new 0.14) lr 1.00e-05 gnorm 0.147 3.12s mem 81.1GB +step 1992/5000 loss 0.2662 (w 0.2928 mse 0.3037 t 979 new 0.20) lr 1.00e-05 gnorm 0.154 3.06s mem 81.1GB +step 1993/5000 loss 0.2597 (w 0.2600 mse 0.2572 t 945 new 0.15) lr 1.00e-05 gnorm 0.164 3.27s mem 81.1GB +step 1994/5000 loss 0.3209 (w 0.3000 mse 0.3015 t 940 new 0.24) lr 1.00e-05 gnorm 0.175 3.24s mem 81.1GB +step 1995/5000 loss 0.1768 (w 0.2685 mse 0.2702 t 872 new 0.25) lr 1.00e-05 gnorm 0.133 2.83s mem 81.1GB +step 1996/5000 loss 0.2467 (w 0.1760 mse 0.1916 t 888 new 0.16) lr 1.00e-05 gnorm 0.178 3.08s mem 81.1GB +step 1997/5000 loss 0.2048 (w 0.2695 mse 0.2765 t 927 new 0.16) lr 1.00e-05 gnorm 0.160 3.09s mem 81.1GB +step 1998/5000 loss 0.3962 (w 0.4066 mse 0.4184 t 394 new 0.27) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +step 1999/5000 loss 0.2947 (w 0.2771 mse 0.2790 t 807 new 0.24) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +step 2000/5000 loss 0.2520 (w 0.3904 mse 0.3826 t 976 new 0.24) lr 1.00e-05 gnorm 0.120 3.34s mem 81.1GB +[val] step 2000 t=200: w=0.4675 mse=0.4858 (n=16) t=500: w=0.2840 mse=0.2991 (n=16) t=800: w=0.2397 mse=0.2518 (n=16) | mean w=0.3304 mse=0.3455 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step2000.safetensors 4093 个张量 37.98 GB +step 2001/5000 loss 0.5637 (w 0.1915 mse 0.1976 t 814 new 0.25) lr 1.00e-05 gnorm 0.208 2.83s mem 81.1GB +step 2002/5000 loss 0.2977 (w 0.3566 mse 0.3538 t 968 new 0.24) lr 1.00e-05 gnorm 0.180 3.27s mem 81.1GB +step 2003/5000 loss 0.2096 (w 0.3578 mse 0.3635 t 976 new 0.21) lr 1.00e-05 gnorm 0.240 2.83s mem 81.1GB +step 2004/5000 loss 0.4615 (w 0.3813 mse 0.3903 t 386 new 0.09) lr 1.00e-05 gnorm 18.898 3.10s mem 81.1GB +step 2005/5000 loss 0.3042 (w 0.2460 mse 0.2665 t 987 new 0.26) lr 1.00e-05 gnorm 0.184 3.15s mem 81.1GB +step 2006/5000 loss 0.3677 (w 0.4733 mse 0.4850 t 228 new 0.23) lr 1.00e-05 gnorm 0.165 3.06s mem 81.1GB +step 2007/5000 loss 0.2745 (w 0.2526 mse 0.2603 t 891 new 0.24) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +step 2008/5000 loss 0.3829 (w 0.3138 mse 0.3189 t 886 new 0.22) lr 1.00e-05 gnorm 0.164 3.32s mem 81.1GB +step 2009/5000 loss 0.2455 (w 0.4898 mse 0.4854 t 980 new 0.27) lr 1.00e-05 gnorm 0.202 2.84s mem 81.1GB +step 2010/5000 loss 0.3065 (w 0.1992 mse 0.2102 t 877 new 0.21) lr 1.00e-05 gnorm 0.661 3.14s mem 81.1GB +step 2011/5000 loss 0.2219 (w 0.3788 mse 0.3784 t 944 new 0.25) lr 1.00e-05 gnorm 0.155 3.25s mem 81.1GB +step 2012/5000 loss 0.1209 (w 0.3392 mse 0.3492 t 929 new 0.18) lr 1.00e-05 gnorm 0.097 3.04s mem 81.1GB +step 2013/5000 loss 0.4184 (w 0.3007 mse 0.2969 t 781 new 0.22) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +step 2014/5000 loss 0.1138 (w 0.3104 mse 0.3090 t 950 new 0.21) lr 1.00e-05 gnorm 0.167 3.15s mem 81.1GB +step 2015/5000 loss 0.4323 (w 0.2938 mse 0.2997 t 928 new 0.21) lr 1.00e-05 gnorm 0.180 3.06s mem 81.1GB +step 2016/5000 loss 0.3023 (w 0.2118 mse 0.2406 t 821 new 0.23) lr 1.00e-05 gnorm 0.122 2.82s mem 81.1GB +step 2017/5000 loss 0.3258 (w 0.4979 mse 0.4971 t 288 new 0.05) lr 1.00e-05 gnorm 0.170 3.17s mem 81.1GB +step 2018/5000 loss 0.2508 (w 0.3730 mse 0.3684 t 665 new 0.19) lr 1.00e-05 gnorm 0.107 3.05s mem 81.1GB +step 2019/5000 loss 0.2663 (w 0.2751 mse 0.2861 t 840 new 0.23) lr 1.00e-05 gnorm 0.215 2.84s mem 81.1GB +step 2020/5000 loss 0.1797 (w 0.2259 mse 0.2318 t 675 new 0.22) lr 1.00e-05 gnorm 0.162 3.13s mem 81.1GB +step 2021/5000 loss 0.1914 (w 0.3059 mse 0.3183 t 846 new 0.14) lr 1.00e-05 gnorm 0.128 3.11s mem 81.1GB +step 2022/5000 loss 0.2179 (w 0.3580 mse 0.3664 t 970 new 0.22) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +step 2023/5000 loss 0.2458 (w 0.3853 mse 0.3868 t 988 new 0.22) lr 1.00e-05 gnorm 0.245 3.18s mem 81.1GB +step 2024/5000 loss 0.5348 (w 0.4734 mse 0.4929 t 223 new 0.21) lr 1.00e-05 gnorm 0.153 3.11s mem 81.1GB +step 2025/5000 loss 0.2362 (w 0.2330 mse 0.2376 t 886 new 0.19) lr 1.00e-05 gnorm 0.163 3.13s mem 81.1GB +step 2026/5000 loss 0.2587 (w 0.2524 mse 0.2606 t 813 new 0.22) lr 1.00e-05 gnorm 0.135 3.07s mem 81.1GB +step 2027/5000 loss 0.3685 (w 0.3565 mse 0.3608 t 992 new 0.09) lr 1.00e-05 gnorm 0.132 3.07s mem 81.1GB +step 2028/5000 loss 0.4844 (w 0.3368 mse 0.3549 t 444 new 0.17) lr 1.00e-05 gnorm 0.190 2.84s mem 81.1GB +step 2029/5000 loss 0.3362 (w 0.2897 mse 0.2907 t 957 new 0.12) lr 1.00e-05 gnorm 0.126 3.47s mem 81.1GB +step 2030/5000 loss 0.4408 (w 0.5135 mse 0.5100 t 306 new 0.20) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +step 2031/5000 loss 0.1786 (w 0.3885 mse 0.4012 t 283 new 0.09) lr 1.00e-05 gnorm 0.476 3.63s mem 81.1GB +step 2032/5000 loss 0.2476 (w 0.2357 mse 0.2484 t 926 new 0.22) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +step 2033/5000 loss 0.3173 (w 0.8098 mse 0.8077 t 100 new 0.23) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +step 2034/5000 loss 0.3425 (w 0.3646 mse 0.3794 t 348 new 0.17) lr 1.00e-05 gnorm 0.143 3.06s mem 81.1GB +step 2035/5000 loss 0.0995 (w 0.1725 mse 0.2022 t 819 new 0.25) lr 1.00e-05 gnorm 0.119 3.44s mem 81.1GB +step 2036/5000 loss 0.3224 (w 0.2728 mse 0.2789 t 542 new 0.21) lr 1.00e-05 gnorm 0.174 2.85s mem 81.1GB +step 2037/5000 loss 0.3416 (w 0.2341 mse 0.2505 t 677 new 0.21) lr 1.00e-05 gnorm 0.142 3.08s mem 81.1GB +step 2038/5000 loss 0.2924 (w 0.3982 mse 0.4129 t 954 new 0.25) lr 1.00e-05 gnorm 0.149 3.36s mem 81.1GB +step 2039/5000 loss 0.2675 (w 0.2636 mse 0.2648 t 800 new 0.15) lr 1.00e-05 gnorm 0.541 2.85s mem 81.1GB +step 2040/5000 loss 0.5118 (w 0.5190 mse 0.5117 t 171 new 0.22) lr 1.00e-05 gnorm 0.239 3.11s mem 81.1GB +step 2041/5000 loss 0.1513 (w 0.2716 mse 0.2735 t 981 new 0.24) lr 1.00e-05 gnorm 0.109 3.29s mem 81.1GB +step 2042/5000 loss 0.2289 (w 0.2474 mse 0.2670 t 965 new 0.22) lr 1.00e-05 gnorm 0.169 2.83s mem 81.1GB +step 2043/5000 loss 0.4988 (w 0.2939 mse 0.2907 t 959 new 0.14) lr 1.00e-05 gnorm 0.136 3.11s mem 81.1GB +step 2044/5000 loss 0.2386 (w 0.3211 mse 0.3342 t 956 new 0.17) lr 1.00e-05 gnorm 0.101 3.36s mem 81.1GB +step 2045/5000 loss 0.3324 (w 0.2209 mse 0.2216 t 946 new 0.17) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +step 2046/5000 loss 0.1512 (w 0.2477 mse 0.2628 t 999 new 0.19) lr 1.00e-05 gnorm 0.203 3.42s mem 81.1GB +step 2047/5000 loss 0.1232 (w 0.2326 mse 0.2429 t 965 new 0.17) lr 1.00e-05 gnorm 0.112 3.22s mem 81.1GB +step 2048/5000 loss 0.1960 (w 0.2078 mse 0.2292 t 939 new 0.22) lr 1.00e-05 gnorm 0.165 2.85s mem 81.1GB +step 2049/5000 loss 0.3897 (w 0.5299 mse 0.5366 t 264 new 0.19) lr 1.00e-05 gnorm 0.121 3.32s mem 81.1GB +step 2050/5000 loss 0.2242 (w 0.2082 mse 0.2242 t 983 new 0.26) lr 1.00e-05 gnorm 0.174 3.38s mem 81.1GB +step 2051/5000 loss 0.4346 (w 0.2613 mse 0.2660 t 826 new 0.18) lr 1.00e-05 gnorm 0.153 2.85s mem 81.1GB +step 2052/5000 loss 0.3595 (w 0.3201 mse 0.3248 t 996 new 0.22) lr 1.00e-05 gnorm 0.194 3.44s mem 81.1GB +step 2053/5000 loss 0.1810 (w 0.2140 mse 0.2194 t 816 new 0.12) lr 1.00e-05 gnorm 0.180 3.27s mem 81.1GB +step 2054/5000 loss 0.4055 (w 0.2547 mse 0.2622 t 624 new 0.19) lr 1.00e-05 gnorm 0.134 3.04s mem 81.1GB +step 2055/5000 loss 0.1383 (w 0.2665 mse 0.2685 t 927 new 0.25) lr 1.00e-05 gnorm 0.426 3.07s mem 81.1GB +step 2056/5000 loss 0.2273 (w 0.4591 mse 0.4709 t 278 new 0.23) lr 1.00e-05 gnorm 0.147 3.36s mem 81.1GB +step 2057/5000 loss 0.4212 (w 0.2925 mse 0.3014 t 869 new 0.19) lr 1.00e-05 gnorm 0.173 2.83s mem 81.1GB +step 2058/5000 loss 0.1079 (w 0.2517 mse 0.2557 t 906 new 0.21) lr 1.00e-05 gnorm 0.146 3.11s mem 81.1GB +step 2059/5000 loss 0.2147 (w 0.2581 mse 0.2679 t 826 new 0.21) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +step 2060/5000 loss 0.4425 (w 0.2990 mse 0.3065 t 822 new 0.21) lr 1.00e-05 gnorm 0.155 3.04s mem 81.1GB +step 2061/5000 loss 0.1016 (w 0.2327 mse 0.2596 t 914 new 0.22) lr 1.00e-05 gnorm 0.165 3.11s mem 81.1GB +step 2062/5000 loss 0.2783 (w 0.3580 mse 0.3656 t 975 new 0.20) lr 1.00e-05 gnorm 0.148 3.08s mem 81.1GB +step 2063/5000 loss 0.1572 (w 0.2730 mse 0.2912 t 991 new 0.18) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +step 2064/5000 loss 0.3855 (w 0.2446 mse 0.2464 t 875 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +step 2065/5000 loss 0.4706 (w 0.2892 mse 0.2813 t 782 new 0.18) lr 1.00e-05 gnorm 7.288 3.06s mem 81.1GB +step 2066/5000 loss 0.1503 (w 0.5217 mse 0.5112 t 982 new 0.22) lr 1.00e-05 gnorm 0.170 3.02s mem 81.1GB +step 2067/5000 loss 0.1937 (w 0.2696 mse 0.2800 t 967 new 0.16) lr 1.00e-05 gnorm 0.156 3.15s mem 81.1GB +step 2068/5000 loss 0.3192 (w 0.3022 mse 0.3162 t 972 new 0.17) lr 1.00e-05 gnorm 0.100 3.11s mem 81.1GB +step 2069/5000 loss 0.2987 (w 0.2488 mse 0.2599 t 878 new 0.12) lr 1.00e-05 gnorm 0.143 3.07s mem 81.1GB +step 2070/5000 loss 0.2711 (w 0.2850 mse 0.2944 t 697 new 0.20) lr 1.00e-05 gnorm 0.148 3.34s mem 81.1GB +step 2071/5000 loss 0.4222 (w 0.3286 mse 0.3362 t 651 new 0.22) lr 1.00e-05 gnorm 0.129 3.04s mem 81.1GB +step 2072/5000 loss 0.1742 (w 0.2633 mse 0.2658 t 948 new 0.13) lr 1.00e-05 gnorm 0.123 3.03s mem 81.1GB +step 2073/5000 loss 0.4034 (w 0.3858 mse 0.3946 t 546 new 0.27) lr 1.00e-05 gnorm 0.150 3.09s mem 81.1GB +step 2074/5000 loss 0.3661 (w 0.3686 mse 0.3613 t 985 new 0.17) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +step 2075/5000 loss 0.1872 (w 0.3075 mse 0.3212 t 904 new 0.25) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +step 2076/5000 loss 0.3894 (w 0.3216 mse 0.3354 t 866 new 0.21) lr 1.00e-05 gnorm 0.160 3.31s mem 81.1GB +step 2077/5000 loss 0.2900 (w 0.1881 mse 0.2026 t 787 new 0.20) lr 1.00e-05 gnorm 0.132 3.07s mem 81.1GB +step 2078/5000 loss 0.1669 (w 0.2695 mse 0.2715 t 878 new 0.21) lr 1.00e-05 gnorm 0.127 3.04s mem 81.1GB +step 2079/5000 loss 0.1940 (w 0.2868 mse 0.3054 t 999 new 0.22) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +step 2080/5000 loss 0.4505 (w 0.2380 mse 0.2540 t 967 new 0.21) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +step 2081/5000 loss 0.3593 (w 0.2823 mse 0.2879 t 352 new 0.14) lr 1.00e-05 gnorm 0.145 3.15s mem 81.1GB +step 2082/5000 loss 0.4309 (w 0.2901 mse 0.2992 t 653 new 0.25) lr 1.00e-05 gnorm 0.125 3.31s mem 81.1GB +step 2083/5000 loss 0.2465 (w 0.2523 mse 0.2637 t 851 new 0.24) lr 1.00e-05 gnorm 0.183 3.09s mem 81.1GB +step 2084/5000 loss 0.2418 (w 0.2290 mse 0.2428 t 759 new 0.28) lr 1.00e-05 gnorm 0.155 3.18s mem 81.1GB +step 2085/5000 loss 0.5279 (w 0.2604 mse 0.2760 t 913 new 0.24) lr 1.00e-05 gnorm 0.174 2.83s mem 81.1GB +step 2086/5000 loss 0.2470 (w 0.3021 mse 0.3112 t 836 new 0.24) lr 1.00e-05 gnorm 1.357 3.11s mem 81.1GB +step 2087/5000 loss 0.3606 (w 0.1353 mse 0.1497 t 925 new 0.11) lr 1.00e-05 gnorm 0.215 3.05s mem 81.1GB +step 2088/5000 loss 0.4161 (w 0.3624 mse 0.3610 t 787 new 0.16) lr 1.00e-05 gnorm 0.131 3.40s mem 81.1GB +step 2089/5000 loss 0.2623 (w 0.2318 mse 0.2559 t 965 new 0.12) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +step 2090/5000 loss 0.2736 (w 0.2635 mse 0.2692 t 935 new 0.17) lr 1.00e-05 gnorm 0.166 3.17s mem 81.1GB +step 2091/5000 loss 0.2331 (w 0.2828 mse 0.2849 t 935 new 0.09) lr 1.00e-05 gnorm 0.119 3.06s mem 81.1GB +step 2092/5000 loss 0.3781 (w 0.2852 mse 0.2859 t 935 new 0.01) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +step 2093/5000 loss 0.4875 (w 0.4157 mse 0.4171 t 348 new 0.20) lr 1.00e-05 gnorm 0.137 3.39s mem 81.1GB +step 2094/5000 loss 0.3164 (w 0.3400 mse 0.3570 t 851 new 0.28) lr 1.00e-05 gnorm 0.146 3.34s mem 81.1GB +step 2095/5000 loss 0.2107 (w 0.2091 mse 0.2242 t 932 new 0.12) lr 1.00e-05 gnorm 0.239 2.84s mem 81.1GB +step 2096/5000 loss 0.2063 (w 0.3172 mse 0.3234 t 962 new 0.13) lr 1.00e-05 gnorm 0.134 3.30s mem 81.1GB +step 2097/5000 loss 0.3376 (w 0.2921 mse 0.2956 t 847 new 0.26) lr 1.00e-05 gnorm 0.106 3.07s mem 81.1GB +step 2098/5000 loss 0.2877 (w 0.2569 mse 0.2800 t 684 new 0.23) lr 1.00e-05 gnorm 0.212 2.83s mem 81.1GB +step 2099/5000 loss 0.2827 (w 0.2190 mse 0.2428 t 874 new 0.23) lr 1.00e-05 gnorm 0.147 3.35s mem 81.1GB +step 2100/5000 loss 0.2104 (w 0.1669 mse 0.1929 t 844 new 0.19) lr 1.00e-05 gnorm 0.178 3.37s mem 81.1GB +step 2101/5000 loss 0.2424 (w 0.3316 mse 0.3405 t 984 new 0.22) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +step 2102/5000 loss 0.4812 (w 0.2026 mse 0.2066 t 819 new 0.17) lr 1.00e-05 gnorm 0.166 3.36s mem 81.1GB +step 2103/5000 loss 0.3856 (w 0.4389 mse 0.4666 t 249 new 0.19) lr 1.00e-05 gnorm 0.214 3.11s mem 81.1GB +step 2104/5000 loss 0.2146 (w 0.1845 mse 0.1964 t 902 new 0.14) lr 1.00e-05 gnorm 0.260 2.84s mem 81.1GB +step 2105/5000 loss 0.2580 (w 0.3291 mse 0.3310 t 944 new 0.17) lr 1.00e-05 gnorm 0.131 3.37s mem 81.1GB +step 2106/5000 loss 0.4039 (w 0.3464 mse 0.3493 t 989 new 0.23) lr 1.00e-05 gnorm 0.200 3.02s mem 81.1GB +step 2107/5000 loss 0.4203 (w 0.2506 mse 0.2563 t 918 new 0.21) lr 1.00e-05 gnorm 0.164 2.83s mem 81.1GB +step 2108/5000 loss 0.2653 (w 0.2985 mse 0.2799 t 858 new 0.21) lr 1.00e-05 gnorm 0.134 3.13s mem 81.1GB +step 2109/5000 loss 0.2847 (w 0.4022 mse 0.4151 t 972 new 0.28) lr 1.00e-05 gnorm 0.154 3.07s mem 81.1GB +step 2110/5000 loss 0.3947 (w 0.3318 mse 0.3302 t 523 new 0.12) lr 1.00e-05 gnorm 0.172 2.83s mem 81.1GB +step 2111/5000 loss 0.4759 (w 0.6206 mse 0.6191 t 217 new 0.23) lr 1.00e-05 gnorm 0.150 3.08s mem 81.1GB +step 2112/5000 loss 0.2364 (w 0.3149 mse 0.3225 t 883 new 0.17) lr 1.00e-05 gnorm 0.115 3.05s mem 81.1GB +step 2113/5000 loss 0.1539 (w 0.2296 mse 0.2489 t 851 new 0.25) lr 1.00e-05 gnorm 0.106 3.05s mem 81.1GB +step 2114/5000 loss 0.2011 (w 0.3745 mse 0.3987 t 971 new 0.19) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +step 2115/5000 loss 0.2093 (w 0.2146 mse 0.2352 t 960 new 0.18) lr 1.00e-05 gnorm 0.121 3.13s mem 81.1GB +step 2116/5000 loss 0.2238 (w 0.3617 mse 0.3772 t 348 new 0.21) lr 1.00e-05 gnorm 0.113 3.12s mem 81.1GB +step 2117/5000 loss 0.2276 (w 0.2206 mse 0.2363 t 916 new 0.14) lr 1.00e-05 gnorm 0.548 3.30s mem 81.1GB +step 2118/5000 loss 0.2960 (w 0.3830 mse 0.4032 t 390 new 0.23) lr 1.00e-05 gnorm 0.202 3.05s mem 81.1GB +step 2119/5000 loss 0.2875 (w 0.3204 mse 0.3269 t 872 new 0.25) lr 1.00e-05 gnorm 0.143 3.15s mem 81.1GB +step 2120/5000 loss 0.3010 (w 0.2694 mse 0.3068 t 968 new 0.26) lr 1.00e-05 gnorm 0.273 3.35s mem 81.1GB +step 2121/5000 loss 0.1642 (w 0.1744 mse 0.1903 t 989 new 0.23) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +step 2122/5000 loss 0.2554 (w 0.3942 mse 0.4030 t 1000 new 0.17) lr 1.00e-05 gnorm 0.146 3.13s mem 81.1GB +step 2123/5000 loss 0.2529 (w 0.3143 mse 0.3121 t 927 new 0.18) lr 1.00e-05 gnorm 0.189 3.02s mem 81.1GB +step 2124/5000 loss 0.3381 (w 0.4084 mse 0.4118 t 394 new 0.18) lr 1.00e-05 gnorm 0.114 3.04s mem 81.1GB +step 2125/5000 loss 0.2578 (w 0.3709 mse 0.3620 t 895 new 0.18) lr 1.00e-05 gnorm 0.505 3.35s mem 81.1GB +step 2126/5000 loss 0.3096 (w 0.2344 mse 0.2472 t 822 new 0.25) lr 1.00e-05 gnorm 0.144 3.14s mem 81.1GB +step 2127/5000 loss 0.4366 (w 0.2371 mse 0.2448 t 681 new 0.19) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +step 2128/5000 loss 0.3555 (w 0.2780 mse 0.2792 t 772 new 0.19) lr 1.00e-05 gnorm 0.193 3.13s mem 81.1GB +step 2129/5000 loss 0.4245 (w 0.4339 mse 0.4283 t 980 new 0.25) lr 1.00e-05 gnorm 0.164 3.03s mem 81.1GB +step 2130/5000 loss 0.3783 (w 0.3571 mse 0.3686 t 998 new 0.26) lr 1.00e-05 gnorm 0.130 3.01s mem 81.1GB +step 2131/5000 loss 0.3250 (w 0.2492 mse 0.2567 t 763 new 0.14) lr 1.00e-05 gnorm 0.146 3.35s mem 81.1GB +step 2132/5000 loss 0.2380 (w 0.2321 mse 0.2355 t 904 new 0.19) lr 1.00e-05 gnorm 0.187 3.06s mem 81.1GB +step 2133/5000 loss 0.2851 (w 0.3662 mse 0.3616 t 750 new 0.19) lr 1.00e-05 gnorm 0.724 2.86s mem 81.1GB +step 2134/5000 loss 0.1955 (w 0.2565 mse 0.2714 t 872 new 0.17) lr 1.00e-05 gnorm 0.205 3.37s mem 81.1GB +step 2135/5000 loss 0.4465 (w 0.1777 mse 0.2031 t 797 new 0.27) lr 1.00e-05 gnorm 0.162 3.08s mem 81.1GB +step 2136/5000 loss 0.1944 (w 0.3953 mse 0.3867 t 974 new 0.22) lr 1.00e-05 gnorm 0.117 3.05s mem 81.1GB +step 2137/5000 loss 0.3225 (w 0.3631 mse 0.3790 t 992 new 0.24) lr 1.00e-05 gnorm 0.363 3.46s mem 81.1GB +step 2138/5000 loss 0.4957 (w 0.2099 mse 0.2097 t 849 new 0.05) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +step 2139/5000 loss 0.1804 (w 0.2761 mse 0.2967 t 428 new 0.25) lr 1.00e-05 gnorm 0.121 2.84s mem 81.1GB +step 2140/5000 loss 0.1225 (w 0.3198 mse 0.3185 t 939 new 0.19) lr 1.00e-05 gnorm 0.141 3.42s mem 81.1GB +step 2141/5000 loss 0.2270 (w 0.5963 mse 0.5985 t 159 new 0.22) lr 1.00e-05 gnorm 0.226 3.04s mem 81.1GB +step 2142/5000 loss 0.3073 (w 0.2322 mse 0.2450 t 951 new 0.20) lr 1.00e-05 gnorm 0.119 3.28s mem 81.1GB +step 2143/5000 loss 0.2376 (w 0.1942 mse 0.2164 t 715 new 0.27) lr 1.00e-05 gnorm 0.121 3.36s mem 81.1GB +step 2144/5000 loss 0.2957 (w 0.2524 mse 0.2597 t 695 new 0.16) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +step 2145/5000 loss 0.2820 (w 0.3282 mse 0.3305 t 846 new 0.23) lr 1.00e-05 gnorm 0.120 3.17s mem 81.1GB +step 2146/5000 loss 0.3069 (w 0.2657 mse 0.2813 t 977 new 0.23) lr 1.00e-05 gnorm 0.158 3.18s mem 81.1GB +step 2147/5000 loss 0.3729 (w 0.3684 mse 0.3737 t 431 new 0.23) lr 1.00e-05 gnorm 0.143 3.13s mem 81.1GB +step 2148/5000 loss 0.3467 (w 0.3381 mse 0.3441 t 431 new 0.27) lr 1.00e-05 gnorm 0.153 3.33s mem 81.1GB +step 2149/5000 loss 0.2322 (w 0.3020 mse 0.3062 t 962 new 0.19) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +step 2150/5000 loss 0.2148 (w 0.2928 mse 0.2923 t 961 new 0.09) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +step 2151/5000 loss 0.1100 (w 0.3173 mse 0.3235 t 972 new 0.09) lr 1.00e-05 gnorm 0.742 3.06s mem 81.1GB +step 2152/5000 loss 0.2785 (w 0.2426 mse 0.2494 t 925 new 0.19) lr 1.00e-05 gnorm 0.211 3.63s mem 81.1GB +step 2153/5000 loss 0.3097 (w 0.2505 mse 0.2502 t 950 new 0.22) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 2154/5000 loss 0.4764 (w 0.2522 mse 0.2598 t 703 new 0.18) lr 1.00e-05 gnorm 0.150 3.35s mem 81.1GB +step 2155/5000 loss 0.2371 (w 0.2391 mse 0.2639 t 939 new 0.19) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +step 2156/5000 loss 0.2797 (w 0.3221 mse 0.3327 t 976 new 0.19) lr 1.00e-05 gnorm 0.503 2.85s mem 81.1GB +step 2157/5000 loss 0.4669 (w 0.2561 mse 0.2693 t 975 new 0.24) lr 1.00e-05 gnorm 0.139 3.05s mem 81.1GB +step 2158/5000 loss 0.3374 (w 0.2785 mse 0.2839 t 817 new 0.20) lr 1.00e-05 gnorm 1.082 3.49s mem 81.1GB +step 2159/5000 loss 0.4101 (w 0.2608 mse 0.2683 t 926 new 0.23) lr 1.00e-05 gnorm 0.104 2.83s mem 81.1GB +step 2160/5000 loss 0.4337 (w 0.3201 mse 0.3268 t 599 new 0.18) lr 1.00e-05 gnorm 0.245 3.29s mem 81.1GB +step 2161/5000 loss 0.5249 (w 0.6058 mse 0.6200 t 177 new 0.23) lr 1.00e-05 gnorm 0.793 3.13s mem 81.1GB +step 2162/5000 loss 0.3908 (w 0.3093 mse 0.3106 t 566 new 0.19) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +step 2163/5000 loss 0.1617 (w 0.2000 mse 0.2037 t 832 new 0.10) lr 1.00e-05 gnorm 0.124 3.06s mem 81.1GB +step 2164/5000 loss 0.2323 (w 0.2665 mse 0.2727 t 728 new 0.21) lr 1.00e-05 gnorm 0.100 3.41s mem 81.1GB +step 2165/5000 loss 0.1792 (w 0.2290 mse 0.2468 t 962 new 0.19) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +step 2166/5000 loss 0.2119 (w 0.3339 mse 0.3369 t 909 new 0.19) lr 1.00e-05 gnorm 0.291 3.34s mem 81.1GB +step 2167/5000 loss 0.3464 (w 0.1981 mse 0.2044 t 873 new 0.23) lr 1.00e-05 gnorm 0.152 3.06s mem 81.1GB +step 2168/5000 loss 0.1858 (w 0.2009 mse 0.2297 t 885 new 0.28) lr 1.00e-05 gnorm 0.154 2.84s mem 81.1GB +step 2169/5000 loss 0.3852 (w 0.2958 mse 0.3083 t 807 new 0.20) lr 1.00e-05 gnorm 0.166 3.06s mem 81.1GB +step 2170/5000 loss 0.2271 (w 0.3521 mse 0.3586 t 986 new 0.18) lr 1.00e-05 gnorm 0.135 3.45s mem 81.1GB +step 2171/5000 loss 0.3371 (w 0.3066 mse 0.3111 t 965 new 0.18) lr 1.00e-05 gnorm 0.119 3.16s mem 81.1GB +step 2172/5000 loss 0.3050 (w 0.3901 mse 0.3883 t 983 new 0.16) lr 1.00e-05 gnorm 0.113 3.27s mem 81.1GB +step 2173/5000 loss 0.2080 (w 0.2266 mse 0.2533 t 974 new 0.21) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +step 2174/5000 loss 0.2971 (w 0.4056 mse 0.4171 t 991 new 0.20) lr 1.00e-05 gnorm 0.186 2.84s mem 81.1GB +step 2175/5000 loss 0.3561 (w 0.2855 mse 0.2906 t 952 new 0.19) lr 1.00e-05 gnorm 0.224 3.16s mem 81.1GB +step 2176/5000 loss 0.2672 (w 0.3157 mse 0.3454 t 986 new 0.24) lr 1.00e-05 gnorm 0.129 3.05s mem 81.1GB +step 2177/5000 loss 0.4152 (w 0.3540 mse 0.3728 t 986 new 0.19) lr 1.00e-05 gnorm 0.147 3.19s mem 81.1GB +step 2178/5000 loss 0.3480 (w 0.2956 mse 0.2979 t 698 new 0.27) lr 1.00e-05 gnorm 0.143 3.04s mem 81.1GB +step 2179/5000 loss 0.2811 (w 0.4356 mse 0.4261 t 978 new 0.19) lr 1.00e-05 gnorm 0.232 3.14s mem 81.1GB +step 2180/5000 loss 0.2985 (w 0.4760 mse 0.4813 t 976 new 0.21) lr 1.00e-05 gnorm 0.287 2.84s mem 81.1GB +step 2181/5000 loss 0.3357 (w 0.2778 mse 0.2881 t 404 new 0.21) lr 1.00e-05 gnorm 0.128 3.47s mem 81.1GB +step 2182/5000 loss 0.2505 (w 0.4914 mse 0.4914 t 177 new 0.00) lr 1.00e-05 gnorm 0.326 3.05s mem 81.1GB +step 2183/5000 loss 0.3181 (w 0.3788 mse 0.3701 t 904 new 0.09) lr 1.00e-05 gnorm 0.125 3.09s mem 81.1GB +step 2184/5000 loss 0.1492 (w 0.4766 mse 0.4635 t 986 new 0.17) lr 1.00e-05 gnorm 0.111 3.09s mem 81.1GB +step 2185/5000 loss 0.1757 (w 0.2658 mse 0.2754 t 880 new 0.24) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 2186/5000 loss 0.3317 (w 0.3877 mse 0.3846 t 927 new 0.23) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +step 2187/5000 loss 0.2973 (w 0.3030 mse 0.3055 t 915 new 0.22) lr 1.00e-05 gnorm 0.118 3.48s mem 81.1GB +step 2188/5000 loss 0.3482 (w 0.3147 mse 0.3070 t 972 new 0.15) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +step 2189/5000 loss 0.3459 (w 0.3022 mse 0.3033 t 590 new 0.11) lr 1.00e-05 gnorm 0.192 3.10s mem 81.1GB +step 2190/5000 loss 0.4067 (w 0.4111 mse 0.4152 t 383 new 0.18) lr 1.00e-05 gnorm 0.103 3.14s mem 81.1GB +step 2191/5000 loss 0.2560 (w 0.2216 mse 0.2274 t 897 new 0.14) lr 1.00e-05 gnorm 0.103 2.85s mem 81.1GB +step 2192/5000 loss 0.1916 (w 0.2614 mse 0.2672 t 799 new 0.17) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +step 2193/5000 loss 0.4357 (w 0.3591 mse 0.3560 t 660 new 0.23) lr 1.00e-05 gnorm 0.149 3.47s mem 81.1GB +step 2194/5000 loss 0.2062 (w 0.2716 mse 0.2838 t 966 new 0.24) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +step 2195/5000 loss 0.4302 (w 0.3093 mse 0.3111 t 854 new 0.14) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +step 2196/5000 loss 0.0774 (w 0.3355 mse 0.3472 t 982 new 0.26) lr 1.00e-05 gnorm 0.273 3.36s mem 81.1GB +step 2197/5000 loss 0.3988 (w 0.3354 mse 0.3271 t 876 new 0.16) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +step 2198/5000 loss 0.1740 (w 0.4018 mse 0.4103 t 989 new 0.19) lr 1.00e-05 gnorm 0.113 3.12s mem 81.1GB +step 2199/5000 loss 0.2913 (w 0.2626 mse 0.2743 t 935 new 0.17) lr 1.00e-05 gnorm 0.145 3.40s mem 81.1GB +step 2200/5000 loss 0.3130 (w 0.4100 mse 0.3889 t 950 new 0.20) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +step 2201/5000 loss 0.3236 (w 0.3222 mse 0.3224 t 935 new 0.19) lr 1.00e-05 gnorm 0.133 3.13s mem 81.1GB +step 2202/5000 loss 0.2718 (w 0.3030 mse 0.3047 t 874 new 0.19) lr 1.00e-05 gnorm 0.168 3.11s mem 81.1GB +step 2203/5000 loss 0.2309 (w 0.2502 mse 0.2532 t 852 new 0.22) lr 1.00e-05 gnorm 0.104 2.83s mem 81.1GB +step 2204/5000 loss 0.2795 (w 0.2776 mse 0.2795 t 977 new 0.26) lr 1.00e-05 gnorm 0.116 3.12s mem 81.1GB +step 2205/5000 loss 0.3506 (w 0.3218 mse 0.3278 t 695 new 0.24) lr 1.00e-05 gnorm 0.119 3.44s mem 81.1GB +step 2206/5000 loss 0.2551 (w 0.2882 mse 0.2828 t 958 new 0.16) lr 1.00e-05 gnorm 0.190 2.84s mem 81.1GB +step 2207/5000 loss 0.3074 (w 0.3249 mse 0.3489 t 956 new 0.19) lr 1.00e-05 gnorm 1.146 3.28s mem 81.1GB +step 2208/5000 loss 0.2486 (w 0.3036 mse 0.3076 t 946 new 0.24) lr 1.00e-05 gnorm 0.128 3.14s mem 81.1GB +step 2209/5000 loss 0.2296 (w 0.3088 mse 0.3139 t 903 new 0.20) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +step 2210/5000 loss 0.2350 (w 0.3332 mse 0.3372 t 980 new 0.12) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +step 2211/5000 loss 0.3552 (w 0.2602 mse 0.2613 t 860 new 0.10) lr 1.00e-05 gnorm 0.158 3.13s mem 81.1GB +step 2212/5000 loss 0.3549 (w 0.2837 mse 0.2805 t 952 new 0.14) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +step 2213/5000 loss 0.2858 (w 0.2818 mse 0.2911 t 852 new 0.18) lr 1.00e-05 gnorm 0.123 3.41s mem 81.1GB +step 2214/5000 loss 0.2883 (w 0.3275 mse 0.3308 t 988 new 0.15) lr 1.00e-05 gnorm 0.119 3.05s mem 81.1GB +step 2215/5000 loss 0.2919 (w 0.2394 mse 0.2524 t 706 new 0.21) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +step 2216/5000 loss 0.1204 (w 0.4251 mse 0.4304 t 985 new 0.21) lr 1.00e-05 gnorm 0.159 3.42s mem 81.1GB +step 2217/5000 loss 0.2313 (w 0.3262 mse 0.3179 t 917 new 0.12) lr 1.00e-05 gnorm 0.104 3.07s mem 81.1GB +step 2218/5000 loss 0.3518 (w 0.2954 mse 0.3112 t 988 new 0.19) lr 1.00e-05 gnorm 0.146 3.04s mem 81.1GB +step 2219/5000 loss 0.3493 (w 0.3281 mse 0.3317 t 933 new 0.16) lr 1.00e-05 gnorm 0.145 3.14s mem 81.1GB +step 2220/5000 loss 0.4106 (w 0.2305 mse 0.2481 t 976 new 0.25) lr 1.00e-05 gnorm 0.131 3.08s mem 81.1GB +step 2221/5000 loss 0.3176 (w 0.3142 mse 0.3134 t 957 new 0.27) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +step 2222/5000 loss 0.2337 (w 0.1883 mse 0.2069 t 908 new 0.15) lr 1.00e-05 gnorm 0.141 3.37s mem 81.1GB +step 2223/5000 loss 0.2932 (w 0.1662 mse 0.1910 t 692 new 0.21) lr 1.00e-05 gnorm 0.124 3.08s mem 81.1GB +step 2224/5000 loss 0.3303 (w 0.5953 mse 0.6065 t 159 new 0.16) lr 1.00e-05 gnorm 0.107 3.07s mem 81.1GB +step 2225/5000 loss 0.2081 (w 0.3394 mse 0.3344 t 936 new 0.20) lr 1.00e-05 gnorm 0.139 3.46s mem 81.1GB +step 2226/5000 loss 0.3579 (w 0.3697 mse 0.3728 t 980 new 0.24) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +step 2227/5000 loss 0.4289 (w 0.1822 mse 0.2044 t 845 new 0.24) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +step 2228/5000 loss 0.3010 (w 0.1869 mse 0.2003 t 720 new 0.22) lr 1.00e-05 gnorm 0.153 3.38s mem 81.1GB +step 2229/5000 loss 0.2577 (w 0.3817 mse 0.3994 t 336 new 0.19) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +step 2230/5000 loss 0.3505 (w 0.2982 mse 0.2945 t 809 new 0.23) lr 1.00e-05 gnorm 0.133 3.09s mem 81.1GB +step 2231/5000 loss 0.2777 (w 0.2476 mse 0.2522 t 578 new 0.19) lr 1.00e-05 gnorm 0.130 3.46s mem 81.1GB +step 2232/5000 loss 0.1625 (w 0.5664 mse 0.5434 t 989 new 0.17) lr 1.00e-05 gnorm 0.102 2.83s mem 81.1GB +step 2233/5000 loss 0.2889 (w 0.3266 mse 0.3246 t 838 new 0.23) lr 1.00e-05 gnorm 0.216 3.07s mem 81.1GB +step 2234/5000 loss 0.1586 (w 0.2283 mse 0.2557 t 986 new 0.21) lr 1.00e-05 gnorm 0.116 3.04s mem 81.1GB +step 2235/5000 loss 0.3216 (w 0.3803 mse 0.3765 t 926 new 0.20) lr 1.00e-05 gnorm 0.136 3.21s mem 81.1GB +step 2236/5000 loss 0.2900 (w 0.1994 mse 0.2157 t 841 new 0.21) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +step 2237/5000 loss 0.4899 (w 0.3019 mse 0.3088 t 866 new 0.13) lr 1.00e-05 gnorm 0.153 3.40s mem 81.1GB +step 2238/5000 loss 0.1757 (w 0.2626 mse 0.2928 t 996 new 0.20) lr 1.00e-05 gnorm 0.252 2.85s mem 81.1GB +step 2239/5000 loss 0.4170 (w 0.1984 mse 0.2032 t 819 new 0.05) lr 1.00e-05 gnorm 0.144 3.12s mem 81.1GB +step 2240/5000 loss 0.2441 (w 0.4277 mse 0.4377 t 408 new 0.18) lr 1.00e-05 gnorm 0.122 3.15s mem 81.1GB +step 2241/5000 loss 0.2129 (w 0.2505 mse 0.2654 t 887 new 0.22) lr 1.00e-05 gnorm 0.599 2.84s mem 81.1GB +step 2242/5000 loss 0.2812 (w 0.2151 mse 0.2157 t 928 new 0.01) lr 1.00e-05 gnorm 0.163 3.10s mem 81.1GB +step 2243/5000 loss 0.2320 (w 0.3683 mse 0.3672 t 847 new 0.18) lr 1.00e-05 gnorm 0.173 3.70s mem 81.1GB +step 2244/5000 loss 0.4091 (w 0.4235 mse 0.4225 t 379 new 0.22) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +step 2245/5000 loss 0.2840 (w 0.3096 mse 0.3252 t 897 new 0.17) lr 1.00e-05 gnorm 0.153 3.14s mem 81.1GB +step 2246/5000 loss 0.2767 (w 0.3039 mse 0.2953 t 930 new 0.22) lr 1.00e-05 gnorm 0.219 3.17s mem 81.1GB +step 2247/5000 loss 0.3757 (w 0.3543 mse 0.3549 t 918 new 0.11) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +step 2248/5000 loss 0.1645 (w 0.2725 mse 0.2793 t 948 new 0.14) lr 1.00e-05 gnorm 0.152 3.33s mem 81.1GB +step 2249/5000 loss 0.3469 (w 0.3214 mse 0.3119 t 928 new 0.21) lr 1.00e-05 gnorm 0.151 3.06s mem 81.1GB +step 2250/5000 loss 0.2963 (w 0.2871 mse 0.2759 t 886 new 0.18) lr 1.00e-05 gnorm 0.183 2.85s mem 81.1GB +step 2251/5000 loss 0.2931 (w 0.2983 mse 0.3127 t 982 new 0.23) lr 1.00e-05 gnorm 0.164 3.06s mem 81.1GB +step 2252/5000 loss 0.1510 (w 0.2160 mse 0.2421 t 983 new 0.17) lr 1.00e-05 gnorm 0.132 3.20s mem 81.1GB +step 2253/5000 loss 0.2887 (w 0.1830 mse 0.1934 t 628 new 0.11) lr 1.00e-05 gnorm 1.545 2.85s mem 81.1GB +step 2254/5000 loss 0.4080 (w 0.3522 mse 0.3576 t 609 new 0.22) lr 1.00e-05 gnorm 0.178 3.33s mem 81.1GB +step 2255/5000 loss 0.4384 (w 0.1953 mse 0.2034 t 742 new 0.10) lr 1.00e-05 gnorm 0.161 3.34s mem 81.1GB +step 2256/5000 loss 0.4262 (w 0.3343 mse 0.3428 t 978 new 0.24) lr 1.00e-05 gnorm 0.133 3.13s mem 81.1GB +step 2257/5000 loss 0.2151 (w 0.3179 mse 0.3331 t 961 new 0.15) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +step 2258/5000 loss 0.2150 (w 0.2212 mse 0.2332 t 798 new 0.15) lr 1.00e-05 gnorm 0.200 3.47s mem 81.1GB +step 2259/5000 loss 0.4365 (w 0.2478 mse 0.2588 t 824 new 0.25) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +step 2260/5000 loss 0.2238 (w 0.3344 mse 0.3313 t 675 new 0.23) lr 1.00e-05 gnorm 0.091 3.14s mem 81.1GB +step 2261/5000 loss 0.2402 (w 0.2483 mse 0.2672 t 819 new 0.13) lr 1.00e-05 gnorm 0.091 3.28s mem 81.1GB +step 2262/5000 loss 0.3285 (w 0.3157 mse 0.3161 t 819 new 0.28) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +step 2263/5000 loss 0.1646 (w 0.2065 mse 0.2130 t 895 new 0.24) lr 1.00e-05 gnorm 0.133 2.85s mem 81.1GB +step 2264/5000 loss 0.3456 (w 0.4038 mse 0.4112 t 976 new 0.20) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +step 2265/5000 loss 0.3398 (w 0.5256 mse 0.5304 t 997 new 0.22) lr 1.00e-05 gnorm 0.148 3.08s mem 81.1GB +step 2266/5000 loss 0.3647 (w 0.4629 mse 0.4695 t 323 new 0.25) lr 1.00e-05 gnorm 0.133 3.22s mem 81.1GB +step 2267/5000 loss 0.2595 (w 0.2512 mse 0.2591 t 979 new 0.20) lr 1.00e-05 gnorm 0.097 3.28s mem 81.1GB +step 2268/5000 loss 0.3046 (w 0.2542 mse 0.2621 t 884 new 0.20) lr 1.00e-05 gnorm 0.269 3.10s mem 81.1GB +step 2269/5000 loss 0.2401 (w 0.3442 mse 0.3417 t 911 new 0.27) lr 1.00e-05 gnorm 0.223 3.05s mem 81.1GB +step 2270/5000 loss 0.3878 (w 0.1428 mse 0.1612 t 653 new 0.16) lr 1.00e-05 gnorm 0.354 3.13s mem 81.1GB +step 2271/5000 loss 0.3213 (w 0.2845 mse 0.2893 t 876 new 0.22) lr 1.00e-05 gnorm 0.165 3.10s mem 81.1GB +step 2272/5000 loss 0.2380 (w 0.3393 mse 0.3309 t 943 new 0.25) lr 1.00e-05 gnorm 0.191 3.26s mem 81.1GB +step 2273/5000 loss 0.3893 (w 0.3802 mse 0.3811 t 994 new 0.21) lr 1.00e-05 gnorm 0.157 3.28s mem 81.1GB +step 2274/5000 loss 0.2338 (w 0.3076 mse 0.3043 t 883 new 0.21) lr 1.00e-05 gnorm 0.165 3.12s mem 81.1GB +step 2275/5000 loss 0.2652 (w 0.1780 mse 0.1983 t 970 new 0.13) lr 1.00e-05 gnorm 0.179 3.08s mem 81.1GB +step 2276/5000 loss 0.2154 (w 0.3492 mse 0.3523 t 995 new 0.15) lr 1.00e-05 gnorm 0.190 2.85s mem 81.1GB +step 2277/5000 loss 0.3775 (w 0.4169 mse 0.4425 t 340 new 0.23) lr 1.00e-05 gnorm 0.142 3.07s mem 81.1GB +step 2278/5000 loss 0.2883 (w 0.3183 mse 0.3246 t 956 new 0.13) lr 1.00e-05 gnorm 0.139 3.22s mem 81.1GB +step 2279/5000 loss 0.2438 (w 0.3031 mse 0.2988 t 462 new 0.19) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +step 2280/5000 loss 0.3417 (w 0.3469 mse 0.3412 t 749 new 0.20) lr 1.00e-05 gnorm 0.173 3.07s mem 81.1GB +step 2281/5000 loss 0.1889 (w 0.5252 mse 0.5355 t 989 new 0.21) lr 1.00e-05 gnorm 0.198 3.11s mem 81.1GB +step 2282/5000 loss 0.2047 (w 0.1949 mse 0.1998 t 781 new 0.15) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +step 2283/5000 loss 0.4025 (w 0.2367 mse 0.2559 t 937 new 0.21) lr 1.00e-05 gnorm 0.175 3.26s mem 81.1GB +step 2284/5000 loss 0.1689 (w 0.3696 mse 0.3714 t 962 new 0.20) lr 1.00e-05 gnorm 0.158 3.28s mem 81.1GB +step 2285/5000 loss 0.1750 (w 0.2328 mse 0.2411 t 873 new 0.24) lr 1.00e-05 gnorm 0.171 3.05s mem 81.1GB +step 2286/5000 loss 0.5107 (w 0.4463 mse 0.4534 t 319 new 0.15) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +step 2287/5000 loss 0.3008 (w 0.4545 mse 0.4564 t 994 new 0.17) lr 1.00e-05 gnorm 0.161 3.14s mem 81.1GB +step 2288/5000 loss 0.2879 (w 0.2913 mse 0.2902 t 880 new 0.13) lr 1.00e-05 gnorm 1.331 2.84s mem 81.1GB +step 2289/5000 loss 0.4787 (w 0.2686 mse 0.2770 t 950 new 0.20) lr 1.00e-05 gnorm 0.136 3.36s mem 81.1GB +step 2290/5000 loss 0.3544 (w 0.3179 mse 0.3411 t 476 new 0.28) lr 1.00e-05 gnorm 0.156 3.06s mem 81.1GB +step 2291/5000 loss 0.3905 (w 0.6436 mse 0.6491 t 992 new 0.21) lr 1.00e-05 gnorm 0.143 3.13s mem 81.1GB +step 2292/5000 loss 0.2571 (w 0.2013 mse 0.2095 t 845 new 0.23) lr 1.00e-05 gnorm 0.163 2.84s mem 81.1GB +step 2293/5000 loss 0.2349 (w 0.3377 mse 0.3452 t 999 new 0.24) lr 1.00e-05 gnorm 0.141 3.36s mem 81.1GB +step 2294/5000 loss 0.3150 (w 0.1719 mse 0.1850 t 586 new 0.20) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +step 2295/5000 loss 0.2485 (w 0.3116 mse 0.3136 t 954 new 0.23) lr 1.00e-05 gnorm 0.209 3.41s mem 81.1GB +step 2296/5000 loss 0.1813 (w 0.4427 mse 0.4452 t 982 new 0.21) lr 1.00e-05 gnorm 0.112 3.07s mem 81.1GB +step 2297/5000 loss 0.2156 (w 0.2520 mse 0.2670 t 746 new 0.23) lr 1.00e-05 gnorm 0.099 3.27s mem 81.1GB +step 2298/5000 loss 0.3014 (w 0.2687 mse 0.2842 t 902 new 0.25) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +step 2299/5000 loss 0.3324 (w 0.1997 mse 0.2242 t 528 new 0.23) lr 1.00e-05 gnorm 0.743 3.43s mem 81.1GB +step 2300/5000 loss 0.2360 (w 0.4605 mse 0.4402 t 996 new 0.24) lr 1.00e-05 gnorm 0.149 3.07s mem 81.1GB +step 2301/5000 loss 0.2102 (w 0.2426 mse 0.2525 t 898 new 0.12) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +step 2302/5000 loss 0.3194 (w 0.3423 mse 0.3404 t 948 new 0.26) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +step 2303/5000 loss 0.3970 (w 0.3055 mse 0.3177 t 490 new 0.14) lr 1.00e-05 gnorm 0.100 3.36s mem 81.1GB +step 2304/5000 loss 0.5272 (w 0.3073 mse 0.3096 t 516 new 0.12) lr 1.00e-05 gnorm 0.164 2.85s mem 81.1GB +step 2305/5000 loss 0.1939 (w 0.2903 mse 0.2860 t 808 new 0.22) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +step 2306/5000 loss 0.2950 (w 0.2193 mse 0.2260 t 897 new 0.18) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +step 2307/5000 loss 0.2168 (w 0.2774 mse 0.2888 t 958 new 0.19) lr 1.00e-05 gnorm 0.160 3.26s mem 81.1GB +step 2308/5000 loss 0.3173 (w 0.2783 mse 0.2737 t 900 new 0.22) lr 1.00e-05 gnorm 0.135 3.33s mem 81.1GB +step 2309/5000 loss 0.2060 (w 0.2481 mse 0.2595 t 904 new 0.20) lr 1.00e-05 gnorm 0.105 3.09s mem 81.1GB +step 2310/5000 loss 0.2439 (w 0.2592 mse 0.2592 t 568 new 0.16) lr 1.00e-05 gnorm 0.134 2.82s mem 81.1GB +step 2311/5000 loss 0.4179 (w 0.2849 mse 0.2971 t 639 new 0.18) lr 1.00e-05 gnorm 0.259 3.11s mem 81.1GB +step 2312/5000 loss 0.2901 (w 0.2202 mse 0.2333 t 907 new 0.13) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +step 2313/5000 loss 0.3517 (w 0.3191 mse 0.3309 t 960 new 0.22) lr 1.00e-05 gnorm 0.125 3.34s mem 81.1GB +step 2314/5000 loss 0.2146 (w 0.3566 mse 0.3524 t 942 new 0.20) lr 1.00e-05 gnorm 0.122 3.29s mem 81.1GB +step 2315/5000 loss 0.3140 (w 0.2796 mse 0.2809 t 503 new 0.11) lr 1.00e-05 gnorm 0.156 3.06s mem 81.1GB +step 2316/5000 loss 0.1984 (w 0.1882 mse 0.1969 t 698 new 0.17) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +step 2317/5000 loss 0.4342 (w 0.3501 mse 0.3536 t 992 new 0.10) lr 1.00e-05 gnorm 0.145 3.07s mem 81.1GB +step 2318/5000 loss 0.3688 (w 0.4401 mse 0.4423 t 980 new 0.14) lr 1.00e-05 gnorm 0.160 3.13s mem 81.1GB +step 2319/5000 loss 0.2538 (w 0.2616 mse 0.2653 t 922 new 0.21) lr 1.00e-05 gnorm 0.098 3.26s mem 81.1GB +step 2320/5000 loss 0.3014 (w 0.2671 mse 0.2722 t 867 new 0.17) lr 1.00e-05 gnorm 0.281 3.11s mem 81.1GB +step 2321/5000 loss 0.4212 (w 0.2300 mse 0.2442 t 865 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +step 2322/5000 loss 0.1010 (w 0.2598 mse 0.2693 t 967 new 0.21) lr 1.00e-05 gnorm 0.108 3.11s mem 81.1GB +step 2323/5000 loss 0.2669 (w 0.3302 mse 0.3414 t 964 new 0.21) lr 1.00e-05 gnorm 1.215 3.07s mem 81.1GB +step 2324/5000 loss 0.2950 (w 0.2678 mse 0.2676 t 636 new 0.21) lr 1.00e-05 gnorm 0.144 3.38s mem 81.1GB +step 2325/5000 loss 0.1924 (w 0.3620 mse 0.3745 t 979 new 0.20) lr 1.00e-05 gnorm 0.158 3.26s mem 81.1GB +step 2326/5000 loss 0.4309 (w 0.1970 mse 0.2030 t 805 new 0.21) lr 1.00e-05 gnorm 0.178 3.43s mem 81.1GB +step 2327/5000 loss 0.6088 (w 0.4155 mse 0.4278 t 297 new 0.20) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +step 2328/5000 loss 0.2984 (w 0.2849 mse 0.2907 t 930 new 0.16) lr 1.00e-05 gnorm 0.106 3.13s mem 81.1GB +step 2329/5000 loss 0.3358 (w 0.2214 mse 0.2396 t 993 new 0.18) lr 1.00e-05 gnorm 0.243 3.08s mem 81.1GB +step 2330/5000 loss 0.3024 (w 0.3210 mse 0.3296 t 866 new 0.28) lr 1.00e-05 gnorm 0.129 3.29s mem 81.1GB +step 2331/5000 loss 0.2527 (w 0.2441 mse 0.2576 t 860 new 0.22) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +step 2332/5000 loss 0.2141 (w 0.2503 mse 0.2524 t 757 new 0.25) lr 1.00e-05 gnorm 0.106 3.37s mem 81.1GB +step 2333/5000 loss 0.2599 (w 0.2945 mse 0.3055 t 889 new 0.19) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +step 2334/5000 loss 0.3167 (w 0.2755 mse 0.2895 t 508 new 0.24) lr 1.00e-05 gnorm 0.180 3.11s mem 81.1GB +step 2335/5000 loss 0.1988 (w 0.2998 mse 0.3036 t 942 new 0.21) lr 1.00e-05 gnorm 0.177 3.06s mem 81.1GB +step 2336/5000 loss 0.3126 (w 0.2154 mse 0.2205 t 855 new 0.11) lr 1.00e-05 gnorm 0.122 3.31s mem 81.1GB +step 2337/5000 loss 0.2507 (w 0.3833 mse 0.3902 t 974 new 0.21) lr 1.00e-05 gnorm 0.120 3.30s mem 81.1GB +step 2338/5000 loss 0.4093 (w 0.1671 mse 0.1781 t 603 new 0.13) lr 1.00e-05 gnorm 0.123 3.41s mem 81.1GB +step 2339/5000 loss 0.2158 (w 0.2054 mse 0.2167 t 705 new 0.16) lr 1.00e-05 gnorm 0.157 2.84s mem 81.1GB +step 2340/5000 loss 0.2724 (w 0.2701 mse 0.2734 t 953 new 0.26) lr 1.00e-05 gnorm 0.111 3.10s mem 81.1GB +step 2341/5000 loss 0.3679 (w 0.2622 mse 0.2670 t 886 new 0.20) lr 1.00e-05 gnorm 0.372 3.06s mem 81.1GB +step 2342/5000 loss 0.1738 (w 0.2411 mse 0.2516 t 979 new 0.26) lr 1.00e-05 gnorm 0.101 3.62s mem 81.1GB +step 2343/5000 loss 0.2858 (w 0.2339 mse 0.2373 t 873 new 0.19) lr 1.00e-05 gnorm 0.128 3.11s mem 81.1GB +step 2344/5000 loss 0.3550 (w 0.2757 mse 0.2885 t 918 new 0.22) lr 1.00e-05 gnorm 0.353 3.13s mem 81.1GB +step 2345/5000 loss 0.3502 (w 0.2873 mse 0.2915 t 901 new 0.20) lr 1.00e-05 gnorm 0.193 2.84s mem 81.1GB +step 2346/5000 loss 0.1819 (w 0.2501 mse 0.2673 t 893 new 0.22) lr 1.00e-05 gnorm 0.113 3.11s mem 81.1GB +step 2347/5000 loss 0.3729 (w 0.3880 mse 0.3899 t 269 new 0.22) lr 1.00e-05 gnorm 0.171 3.07s mem 81.1GB +step 2348/5000 loss 0.3534 (w 0.2752 mse 0.2756 t 662 new 0.19) lr 1.00e-05 gnorm 0.152 3.33s mem 81.1GB +step 2349/5000 loss 0.2660 (w 0.3114 mse 0.3200 t 925 new 0.18) lr 1.00e-05 gnorm 0.160 3.06s mem 81.1GB +step 2350/5000 loss 0.1630 (w 0.3289 mse 0.3343 t 876 new 0.21) lr 1.00e-05 gnorm 0.137 3.14s mem 81.1GB +step 2351/5000 loss 0.4017 (w 0.4554 mse 0.4471 t 992 new 0.21) lr 1.00e-05 gnorm 3.602 3.09s mem 81.1GB +step 2352/5000 loss 0.2447 (w 0.3994 mse 0.3842 t 895 new 0.22) lr 1.00e-05 gnorm 0.141 2.85s mem 81.1GB +step 2353/5000 loss 0.3165 (w 0.1941 mse 0.1997 t 894 new 0.21) lr 1.00e-05 gnorm 0.158 3.34s mem 81.1GB +step 2354/5000 loss 0.1729 (w 0.2062 mse 0.2202 t 610 new 0.25) lr 1.00e-05 gnorm 0.121 3.29s mem 81.1GB +step 2355/5000 loss 0.4303 (w 0.2669 mse 0.2802 t 672 new 0.24) lr 1.00e-05 gnorm 0.150 3.13s mem 81.1GB +step 2356/5000 loss 0.2122 (w 0.3149 mse 0.3113 t 910 new 0.28) lr 1.00e-05 gnorm 0.144 3.13s mem 81.1GB +step 2357/5000 loss 0.3617 (w 0.3885 mse 0.3896 t 264 new 0.01) lr 1.00e-05 gnorm 0.111 3.14s mem 81.1GB +step 2358/5000 loss 0.1941 (w 0.3603 mse 0.3760 t 996 new 0.23) lr 1.00e-05 gnorm 0.150 2.82s mem 81.1GB +step 2359/5000 loss 0.3851 (w 0.3715 mse 0.3845 t 421 new 0.18) lr 1.00e-05 gnorm 0.148 3.40s mem 81.1GB +step 2360/5000 loss 0.2715 (w 0.3037 mse 0.3054 t 854 new 0.29) lr 1.00e-05 gnorm 0.116 3.08s mem 81.1GB +step 2361/5000 loss 0.2585 (w 0.2551 mse 0.2542 t 726 new 0.09) lr 1.00e-05 gnorm 0.108 3.12s mem 81.1GB +step 2362/5000 loss 0.2444 (w 0.3909 mse 0.3987 t 973 new 0.16) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +step 2363/5000 loss 0.3544 (w 0.2358 mse 0.2400 t 770 new 0.21) lr 1.00e-05 gnorm 0.140 3.16s mem 81.1GB +step 2364/5000 loss 0.3030 (w 0.2085 mse 0.2302 t 894 new 0.23) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +step 2365/5000 loss 0.2761 (w 0.4071 mse 0.4130 t 979 new 0.25) lr 1.00e-05 gnorm 0.108 3.37s mem 81.1GB +step 2366/5000 loss 0.4413 (w 0.3465 mse 0.3551 t 970 new 0.18) lr 1.00e-05 gnorm 0.161 3.20s mem 81.1GB +step 2367/5000 loss 0.2194 (w 0.3068 mse 0.3134 t 925 new 0.10) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +step 2368/5000 loss 0.1948 (w 0.3588 mse 0.3496 t 921 new 0.16) lr 1.00e-05 gnorm 0.157 3.14s mem 81.1GB +step 2369/5000 loss 0.3751 (w 0.2801 mse 0.2784 t 911 new 0.11) lr 1.00e-05 gnorm 0.199 3.09s mem 81.1GB +step 2370/5000 loss 0.3075 (w 0.2741 mse 0.2749 t 895 new 0.22) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +step 2371/5000 loss 0.3981 (w 0.2290 mse 0.2402 t 733 new 0.24) lr 1.00e-05 gnorm 0.242 3.35s mem 81.1GB +step 2372/5000 loss 0.3246 (w 0.3216 mse 0.3186 t 960 new 0.14) lr 1.00e-05 gnorm 0.161 3.18s mem 81.1GB +step 2373/5000 loss 0.4189 (w 0.2857 mse 0.2920 t 905 new 0.19) lr 1.00e-05 gnorm 0.198 3.12s mem 81.1GB +step 2374/5000 loss 0.4863 (w 0.4862 mse 0.4917 t 165 new 0.23) lr 1.00e-05 gnorm 0.113 3.11s mem 81.1GB +step 2375/5000 loss 0.2350 (w 0.5378 mse 0.5497 t 134 new 0.09) lr 1.00e-05 gnorm 0.141 3.16s mem 81.1GB +step 2376/5000 loss 0.2752 (w 0.3698 mse 0.3647 t 980 new 0.23) lr 1.00e-05 gnorm 0.198 2.83s mem 81.1GB +step 2377/5000 loss 0.3102 (w 0.2880 mse 0.2964 t 994 new 0.20) lr 1.00e-05 gnorm 0.261 3.33s mem 81.1GB +step 2378/5000 loss 0.0891 (w 0.2638 mse 0.2741 t 955 new 0.13) lr 1.00e-05 gnorm 0.182 3.20s mem 81.1GB +step 2379/5000 loss 0.4914 (w 0.2763 mse 0.2825 t 882 new 0.23) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +step 2380/5000 loss 0.2490 (w 0.3324 mse 0.3449 t 966 new 0.15) lr 1.00e-05 gnorm 0.193 3.34s mem 81.1GB +step 2381/5000 loss 0.2918 (w 0.3394 mse 0.3350 t 566 new 0.20) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +step 2382/5000 loss 0.3341 (w 0.2663 mse 0.2735 t 940 new 0.20) lr 1.00e-05 gnorm 0.135 2.85s mem 81.1GB +step 2383/5000 loss 0.2842 (w 0.3244 mse 0.3137 t 953 new 0.15) lr 1.00e-05 gnorm 0.174 3.39s mem 81.1GB +step 2384/5000 loss 0.3509 (w 0.3306 mse 0.3239 t 936 new 0.24) lr 1.00e-05 gnorm 0.153 3.25s mem 81.1GB +step 2385/5000 loss 0.3293 (w 0.2970 mse 0.2995 t 708 new 0.24) lr 1.00e-05 gnorm 0.113 3.13s mem 81.1GB +step 2386/5000 loss 0.2167 (w 0.3179 mse 0.3187 t 908 new 0.25) lr 1.00e-05 gnorm 0.128 3.36s mem 81.1GB +step 2387/5000 loss 0.3832 (w 0.3939 mse 0.4056 t 976 new 0.15) lr 1.00e-05 gnorm 0.155 2.85s mem 81.1GB +step 2388/5000 loss 0.2148 (w 0.3282 mse 0.3324 t 975 new 0.18) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 2389/5000 loss 0.3316 (w 0.2321 mse 0.2467 t 612 new 0.13) lr 1.00e-05 gnorm 0.172 3.38s mem 81.1GB +step 2390/5000 loss 0.2698 (w 0.1959 mse 0.2011 t 884 new 0.06) lr 1.00e-05 gnorm 0.133 3.01s mem 81.1GB +step 2391/5000 loss 0.2777 (w 0.3389 mse 0.3427 t 444 new 0.22) lr 1.00e-05 gnorm 0.145 3.30s mem 81.1GB +step 2392/5000 loss 0.2883 (w 0.3911 mse 0.3847 t 965 new 0.25) lr 1.00e-05 gnorm 0.173 3.13s mem 81.1GB +step 2393/5000 loss 0.3171 (w 0.2927 mse 0.2752 t 885 new 0.22) lr 1.00e-05 gnorm 0.243 2.84s mem 81.1GB +step 2394/5000 loss 0.3148 (w 0.2888 mse 0.2945 t 637 new 0.26) lr 1.00e-05 gnorm 0.135 2.83s mem 81.1GB +step 2395/5000 loss 0.5081 (w 0.2569 mse 0.2679 t 737 new 0.22) lr 1.00e-05 gnorm 0.128 4.02s mem 81.1GB +step 2396/5000 loss 0.1508 (w 0.1768 mse 0.1864 t 869 new 0.09) lr 1.00e-05 gnorm 0.125 3.04s mem 81.1GB +step 2397/5000 loss 0.2092 (w 0.2479 mse 0.2450 t 995 new 0.16) lr 1.00e-05 gnorm 0.126 3.43s mem 81.1GB +step 2398/5000 loss 0.3479 (w 0.2637 mse 0.2795 t 633 new 0.25) lr 1.00e-05 gnorm 0.117 3.15s mem 81.1GB +step 2399/5000 loss 0.1846 (w 0.3369 mse 0.3527 t 919 new 0.23) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +step 2400/5000 loss 0.3176 (w 0.2741 mse 0.2771 t 930 new 0.26) lr 1.00e-05 gnorm 0.131 3.16s mem 81.1GB +step 2401/5000 loss 0.4157 (w 0.3339 mse 0.3402 t 942 new 0.22) lr 1.00e-05 gnorm 0.261 3.27s mem 81.1GB +step 2402/5000 loss 0.2191 (w 0.2773 mse 0.2861 t 996 new 0.20) lr 1.00e-05 gnorm 0.231 3.15s mem 81.1GB +step 2403/5000 loss 0.3100 (w 0.2113 mse 0.2189 t 566 new 0.11) lr 1.00e-05 gnorm 0.130 3.16s mem 81.1GB +step 2404/5000 loss 0.3380 (w 0.2990 mse 0.3088 t 447 new 0.21) lr 1.00e-05 gnorm 0.135 3.13s mem 81.1GB +step 2405/5000 loss 0.2575 (w 0.2731 mse 0.2757 t 826 new 0.21) lr 1.00e-05 gnorm 0.170 2.84s mem 81.1GB +step 2406/5000 loss 0.5494 (w 0.2813 mse 0.2831 t 926 new 0.21) lr 1.00e-05 gnorm 1.224 3.04s mem 81.1GB +step 2407/5000 loss 0.2389 (w 0.2091 mse 0.2378 t 959 new 0.24) lr 1.00e-05 gnorm 0.183 3.06s mem 81.1GB +step 2408/5000 loss 0.1723 (w 0.1682 mse 0.1803 t 650 new 0.08) lr 1.00e-05 gnorm 0.176 3.39s mem 81.1GB +step 2409/5000 loss 0.3988 (w 0.2736 mse 0.2797 t 850 new 0.22) lr 1.00e-05 gnorm 0.297 3.08s mem 81.1GB +step 2410/5000 loss 0.3442 (w 0.3016 mse 0.2991 t 751 new 0.17) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +step 2411/5000 loss 0.4147 (w 0.3375 mse 0.3325 t 813 new 0.25) lr 1.00e-05 gnorm 0.172 2.84s mem 81.1GB +step 2412/5000 loss 0.2401 (w 0.2299 mse 0.2263 t 774 new 0.18) lr 1.00e-05 gnorm 0.140 3.06s mem 81.1GB +step 2413/5000 loss 0.3036 (w 0.2835 mse 0.2893 t 741 new 0.21) lr 1.00e-05 gnorm 0.120 3.10s mem 81.1GB +step 2414/5000 loss 0.2034 (w 0.2192 mse 0.2302 t 932 new 0.18) lr 1.00e-05 gnorm 0.094 4.00s mem 81.1GB +step 2415/5000 loss 0.2707 (w 0.2393 mse 0.2757 t 434 new 0.24) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 2416/5000 loss 0.3532 (w 0.2743 mse 0.2844 t 945 new 0.22) lr 1.00e-05 gnorm 0.132 3.16s mem 81.1GB +step 2417/5000 loss 0.3422 (w 0.3800 mse 0.3886 t 989 new 0.22) lr 1.00e-05 gnorm 0.120 2.84s mem 81.1GB +step 2418/5000 loss 0.1859 (w 0.2633 mse 0.2844 t 957 new 0.25) lr 1.00e-05 gnorm 0.118 3.39s mem 81.1GB +step 2419/5000 loss 0.1744 (w 0.2317 mse 0.2375 t 898 new 0.14) lr 1.00e-05 gnorm 0.170 3.09s mem 81.1GB +step 2420/5000 loss 0.2278 (w 0.3810 mse 0.3836 t 981 new 0.23) lr 1.00e-05 gnorm 0.289 3.39s mem 81.1GB +step 2421/5000 loss 0.3059 (w 0.4184 mse 0.4013 t 975 new 0.23) lr 1.00e-05 gnorm 0.136 3.15s mem 81.1GB +step 2422/5000 loss 0.2526 (w 0.3384 mse 0.3646 t 978 new 0.21) lr 1.00e-05 gnorm 0.484 3.15s mem 81.1GB +step 2423/5000 loss 0.1762 (w 0.2864 mse 0.2849 t 650 new 0.16) lr 1.00e-05 gnorm 0.205 2.84s mem 81.1GB +step 2424/5000 loss 0.3208 (w 0.2889 mse 0.2904 t 935 new 0.10) lr 1.00e-05 gnorm 0.146 3.15s mem 81.1GB +step 2425/5000 loss 0.1221 (w 0.2905 mse 0.3021 t 907 new 0.16) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +step 2426/5000 loss 0.1847 (w 0.2569 mse 0.2686 t 798 new 0.21) lr 1.00e-05 gnorm 0.112 3.33s mem 81.1GB +step 2427/5000 loss 0.2875 (w 0.2596 mse 0.2734 t 863 new 0.23) lr 1.00e-05 gnorm 0.160 3.11s mem 81.1GB +step 2428/5000 loss 0.4774 (w 0.1966 mse 0.2150 t 747 new 0.28) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +step 2429/5000 loss 0.3958 (w 0.3493 mse 0.3274 t 939 new 0.23) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +step 2430/5000 loss 0.3193 (w 0.3362 mse 0.3381 t 959 new 0.19) lr 1.00e-05 gnorm 0.133 3.13s mem 81.1GB +step 2431/5000 loss 0.3186 (w 0.2737 mse 0.2922 t 940 new 0.22) lr 1.00e-05 gnorm 0.143 3.06s mem 81.1GB +step 2432/5000 loss 0.2844 (w 0.2172 mse 0.2279 t 886 new 0.21) lr 1.00e-05 gnorm 0.092 3.40s mem 81.1GB +step 2433/5000 loss 0.3105 (w 0.1923 mse 0.2007 t 731 new 0.22) lr 1.00e-05 gnorm 0.147 3.15s mem 81.1GB +step 2434/5000 loss 0.2544 (w 0.2457 mse 0.2619 t 870 new 0.22) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +step 2435/5000 loss 0.3518 (w 0.4132 mse 0.4308 t 306 new 0.23) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 2436/5000 loss 0.1815 (w 0.3797 mse 0.3954 t 966 new 0.16) lr 1.00e-05 gnorm 0.135 3.32s mem 81.1GB +step 2437/5000 loss 0.3628 (w 0.3010 mse 0.3131 t 859 new 0.11) lr 1.00e-05 gnorm 0.226 3.05s mem 81.1GB +step 2438/5000 loss 0.3510 (w 0.3048 mse 0.3079 t 892 new 0.21) lr 1.00e-05 gnorm 0.860 3.07s mem 81.1GB +step 2439/5000 loss 0.3319 (w 0.3102 mse 0.3185 t 913 new 0.19) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +step 2440/5000 loss 0.2474 (w 0.2033 mse 0.2210 t 943 new 0.22) lr 1.00e-05 gnorm 0.131 2.85s mem 81.1GB +step 2441/5000 loss 0.4003 (w 0.1961 mse 0.2287 t 969 new 0.21) lr 1.00e-05 gnorm 0.127 3.06s mem 81.1GB +step 2442/5000 loss 0.4282 (w 0.2973 mse 0.3140 t 1000 new 0.21) lr 1.00e-05 gnorm 0.156 3.39s mem 81.1GB +step 2443/5000 loss 0.2241 (w 0.3802 mse 0.3662 t 961 new 0.20) lr 1.00e-05 gnorm 0.140 3.06s mem 81.1GB +step 2444/5000 loss 0.4397 (w 0.2884 mse 0.2937 t 872 new 0.20) lr 1.00e-05 gnorm 0.183 3.08s mem 81.1GB +step 2445/5000 loss 0.2676 (w 0.2416 mse 0.2406 t 802 new 0.18) lr 1.00e-05 gnorm 0.165 3.08s mem 81.1GB +step 2446/5000 loss 0.3740 (w 0.2929 mse 0.3073 t 896 new 0.19) lr 1.00e-05 gnorm 0.180 2.85s mem 81.1GB +step 2447/5000 loss 0.2557 (w 0.3719 mse 0.3641 t 962 new 0.26) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +step 2448/5000 loss 0.3826 (w 0.4320 mse 0.4568 t 183 new 0.22) lr 1.00e-05 gnorm 0.112 3.13s mem 81.1GB +step 2449/5000 loss 0.2416 (w 0.2438 mse 0.2523 t 862 new 0.22) lr 1.00e-05 gnorm 0.894 3.09s mem 81.1GB +step 2450/5000 loss 0.1895 (w 0.2759 mse 0.2855 t 953 new 0.18) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +step 2451/5000 loss 0.2897 (w 0.3594 mse 0.3755 t 428 new 0.26) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +step 2452/5000 loss 0.3248 (w 0.2411 mse 0.2556 t 670 new 0.22) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +step 2453/5000 loss 0.3578 (w 0.2350 mse 0.2604 t 931 new 0.16) lr 1.00e-05 gnorm 0.158 3.05s mem 81.1GB +step 2454/5000 loss 0.2538 (w 0.2114 mse 0.2284 t 968 new 0.23) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +step 2455/5000 loss 0.4167 (w 0.3897 mse 0.3924 t 390 new 0.21) lr 1.00e-05 gnorm 0.126 3.29s mem 81.1GB +step 2456/5000 loss 0.4001 (w 0.2188 mse 0.2414 t 892 new 0.18) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +step 2457/5000 loss 0.3336 (w 0.3555 mse 0.3482 t 966 new 0.22) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +step 2458/5000 loss 0.3529 (w 0.3015 mse 0.3148 t 562 new 0.19) lr 1.00e-05 gnorm 0.215 2.85s mem 81.1GB +step 2459/5000 loss 0.2914 (w 0.2661 mse 0.2726 t 663 new 0.24) lr 1.00e-05 gnorm 0.620 3.12s mem 81.1GB +step 2460/5000 loss 0.1613 (w 0.3375 mse 0.3438 t 936 new 0.07) lr 1.00e-05 gnorm 0.194 3.15s mem 81.1GB +step 2461/5000 loss 0.2207 (w 0.3339 mse 0.3296 t 980 new 0.18) lr 1.00e-05 gnorm 0.106 3.27s mem 81.1GB +step 2462/5000 loss 0.2228 (w 0.1902 mse 0.2061 t 967 new 0.09) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +step 2463/5000 loss 0.2739 (w 0.2349 mse 0.2454 t 570 new 0.20) lr 1.00e-05 gnorm 0.111 3.10s mem 81.1GB +step 2464/5000 loss 0.1579 (w 0.3200 mse 0.3183 t 979 new 0.21) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +step 2465/5000 loss 0.4265 (w 0.4597 mse 0.4613 t 249 new 0.17) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +step 2466/5000 loss 0.2147 (w 0.2902 mse 0.2891 t 731 new 0.24) lr 1.00e-05 gnorm 0.362 3.20s mem 81.1GB +step 2467/5000 loss 0.1423 (w 0.2715 mse 0.2703 t 927 new 0.23) lr 1.00e-05 gnorm 0.110 3.11s mem 81.1GB +step 2468/5000 loss 0.1863 (w 0.4448 mse 0.4351 t 988 new 0.21) lr 1.00e-05 gnorm 0.279 2.84s mem 81.1GB +step 2469/5000 loss 0.3419 (w 0.2417 mse 0.2490 t 790 new 0.16) lr 1.00e-05 gnorm 0.201 3.16s mem 81.1GB +step 2470/5000 loss 0.3800 (w 0.4411 mse 0.4495 t 323 new 0.22) lr 1.00e-05 gnorm 0.218 3.16s mem 81.1GB +step 2471/5000 loss 0.2693 (w 0.3693 mse 0.3845 t 942 new 0.17) lr 1.00e-05 gnorm 0.121 3.30s mem 81.1GB +step 2472/5000 loss 0.1791 (w 0.2470 mse 0.2628 t 841 new 0.21) lr 1.00e-05 gnorm 0.093 3.30s mem 81.1GB +step 2473/5000 loss 0.4008 (w 0.2747 mse 0.2780 t 730 new 0.23) lr 1.00e-05 gnorm 0.123 3.65s mem 81.1GB +step 2474/5000 loss 0.2979 (w 0.3212 mse 0.3178 t 993 new 0.23) lr 1.00e-05 gnorm 0.122 3.11s mem 81.1GB +step 2475/5000 loss 0.2223 (w 0.3389 mse 0.3278 t 920 new 0.23) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +step 2476/5000 loss 0.5211 (w 0.3197 mse 0.3204 t 959 new 0.19) lr 1.00e-05 gnorm 0.165 3.08s mem 81.1GB +step 2477/5000 loss 0.2321 (w 0.2442 mse 0.2549 t 840 new 0.26) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +step 2478/5000 loss 0.2906 (w 0.3163 mse 0.3178 t 982 new 0.10) lr 1.00e-05 gnorm 0.173 3.06s mem 81.1GB +step 2479/5000 loss 0.1408 (w 0.2536 mse 0.2658 t 912 new 0.19) lr 1.00e-05 gnorm 0.484 3.08s mem 81.1GB +step 2480/5000 loss 0.3760 (w 0.2063 mse 0.2293 t 825 new 0.16) lr 1.00e-05 gnorm 0.120 3.16s mem 81.1GB +step 2481/5000 loss 0.5502 (w 0.1935 mse 0.2006 t 751 new 0.11) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +step 2482/5000 loss 0.5333 (w 0.2804 mse 0.2833 t 776 new 0.24) lr 1.00e-05 gnorm 0.195 3.06s mem 81.1GB +step 2483/5000 loss 0.3277 (w 0.2348 mse 0.2370 t 737 new 0.10) lr 1.00e-05 gnorm 0.133 3.12s mem 81.1GB +step 2484/5000 loss 0.3368 (w 0.2659 mse 0.2760 t 924 new 0.23) lr 1.00e-05 gnorm 0.181 3.06s mem 81.1GB +step 2485/5000 loss 0.1881 (w 0.2379 mse 0.2305 t 901 new 0.22) lr 1.00e-05 gnorm 0.265 3.10s mem 81.1GB +step 2486/5000 loss 0.3104 (w 0.3082 mse 0.3186 t 942 new 0.25) lr 1.00e-05 gnorm 0.105 3.14s mem 81.1GB +step 2487/5000 loss 0.3254 (w 0.2527 mse 0.2603 t 933 new 0.24) lr 1.00e-05 gnorm 0.235 2.85s mem 81.1GB +step 2488/5000 loss 0.2327 (w 0.2132 mse 0.2331 t 881 new 0.23) lr 1.00e-05 gnorm 0.132 3.12s mem 81.1GB +step 2489/5000 loss 0.4827 (w 0.3582 mse 0.3695 t 447 new 0.20) lr 1.00e-05 gnorm 0.243 3.25s mem 81.1GB +step 2490/5000 loss 0.3554 (w 0.2100 mse 0.2236 t 733 new 0.09) lr 1.00e-05 gnorm 0.186 3.11s mem 81.1GB +step 2491/5000 loss 0.2534 (w 0.3190 mse 0.3182 t 931 new 0.20) lr 1.00e-05 gnorm 0.148 3.34s mem 81.1GB +step 2492/5000 loss 0.2774 (w 0.3559 mse 0.3607 t 513 new 0.23) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 2493/5000 loss 0.2516 (w 0.2817 mse 0.2812 t 923 new 0.20) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 2494/5000 loss 0.1711 (w 0.3011 mse 0.3099 t 931 new 0.26) lr 1.00e-05 gnorm 0.123 3.27s mem 81.1GB +step 2495/5000 loss 0.3462 (w 0.3312 mse 0.3456 t 964 new 0.25) lr 1.00e-05 gnorm 0.159 3.34s mem 81.1GB +step 2496/5000 loss 0.3277 (w 0.2998 mse 0.3031 t 795 new 0.19) lr 1.00e-05 gnorm 0.257 3.34s mem 81.1GB +step 2497/5000 loss 0.3267 (w 0.2090 mse 0.2216 t 946 new 0.17) lr 1.00e-05 gnorm 0.302 3.35s mem 81.1GB +step 2498/5000 loss 0.2983 (w 0.3174 mse 0.3141 t 918 new 0.17) lr 1.00e-05 gnorm 0.193 2.85s mem 81.1GB +step 2499/5000 loss 0.1935 (w 0.2531 mse 0.2624 t 931 new 0.13) lr 1.00e-05 gnorm 0.133 2.85s mem 81.1GB +step 2500/5000 loss 0.2282 (w 0.3200 mse 0.3296 t 904 new 0.13) lr 1.00e-05 gnorm 0.291 3.10s mem 81.1GB +[val] step 2500 t=200: w=0.4640 mse=0.4822 (n=16) t=500: w=0.2820 mse=0.2969 (n=16) t=800: w=0.2377 mse=0.2497 (n=16) | mean w=0.3279 mse=0.3429 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step2500.safetensors 4093 个张量 37.98 GB +step 2501/5000 loss 0.3213 (w 0.3149 mse 0.3239 t 895 new 0.20) lr 1.00e-05 gnorm 0.173 3.17s mem 81.1GB +step 2502/5000 loss 0.1573 (w 0.3169 mse 0.3364 t 969 new 0.21) lr 1.00e-05 gnorm 0.112 3.10s mem 81.1GB +step 2503/5000 loss 0.2466 (w 0.3702 mse 0.3686 t 397 new 0.20) lr 1.00e-05 gnorm 0.125 3.39s mem 81.1GB +step 2504/5000 loss 0.1705 (w 0.3161 mse 0.3120 t 968 new 0.22) lr 1.00e-05 gnorm 0.092 2.83s mem 81.1GB +step 2505/5000 loss 0.2375 (w 0.3151 mse 0.3178 t 939 new 0.22) lr 1.00e-05 gnorm 0.127 3.18s mem 81.1GB +step 2506/5000 loss 0.1705 (w 0.4059 mse 0.3898 t 979 new 0.17) lr 1.00e-05 gnorm 0.113 3.34s mem 81.1GB +step 2507/5000 loss 0.3372 (w 0.2510 mse 0.2537 t 774 new 0.08) lr 1.00e-05 gnorm 0.158 3.44s mem 81.1GB +step 2508/5000 loss 0.3502 (w 0.2265 mse 0.2327 t 513 new 0.14) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +step 2509/5000 loss 0.2093 (w 0.2749 mse 0.2805 t 906 new 0.14) lr 1.00e-05 gnorm 0.270 3.44s mem 81.1GB +step 2510/5000 loss 0.3369 (w 0.3502 mse 0.3419 t 856 new 0.15) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +step 2511/5000 loss 0.2802 (w 0.2696 mse 0.2840 t 996 new 0.22) lr 1.00e-05 gnorm 0.261 3.11s mem 81.1GB +step 2512/5000 loss 0.4110 (w 0.3058 mse 0.3200 t 977 new 0.19) lr 1.00e-05 gnorm 0.126 3.29s mem 81.1GB +step 2513/5000 loss 0.2042 (w 0.3371 mse 0.3466 t 966 new 0.22) lr 1.00e-05 gnorm 0.103 3.71s mem 81.1GB +step 2514/5000 loss 0.3746 (w 0.4315 mse 0.4340 t 254 new 0.12) lr 1.00e-05 gnorm 0.100 3.13s mem 81.1GB +step 2515/5000 loss 0.3743 (w 0.4202 mse 0.4206 t 967 new 0.15) lr 1.00e-05 gnorm 0.132 3.17s mem 81.1GB +step 2516/5000 loss 0.3395 (w 0.2909 mse 0.3078 t 944 new 0.22) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 2517/5000 loss 0.4297 (w 0.2945 mse 0.3094 t 557 new 0.23) lr 1.00e-05 gnorm 0.146 3.05s mem 81.1GB +step 2518/5000 loss 0.3330 (w 0.3928 mse 0.4053 t 283 new 0.19) lr 1.00e-05 gnorm 0.107 3.08s mem 81.1GB +step 2519/5000 loss 0.2881 (w 0.2255 mse 0.2482 t 981 new 0.17) lr 1.00e-05 gnorm 0.102 3.32s mem 81.1GB +step 2520/5000 loss 0.1769 (w 0.2844 mse 0.2893 t 849 new 0.15) lr 1.00e-05 gnorm 0.255 3.07s mem 81.1GB +step 2521/5000 loss 0.2492 (w 0.1979 mse 0.2097 t 804 new 0.10) lr 1.00e-05 gnorm 0.303 3.09s mem 81.1GB +step 2522/5000 loss 0.3668 (w 0.2633 mse 0.2819 t 835 new 0.23) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +step 2523/5000 loss 0.1815 (w 0.2399 mse 0.2476 t 849 new 0.21) lr 1.00e-05 gnorm 0.087 3.14s mem 81.1GB +step 2524/5000 loss 0.2119 (w 0.3219 mse 0.3144 t 926 new 0.22) lr 1.00e-05 gnorm 0.192 3.35s mem 81.1GB +step 2525/5000 loss 0.4477 (w 0.1670 mse 0.1806 t 881 new 0.24) lr 1.00e-05 gnorm 0.170 3.39s mem 81.1GB +step 2526/5000 loss 0.2387 (w 0.2009 mse 0.2089 t 917 new 0.21) lr 1.00e-05 gnorm 0.204 3.10s mem 81.1GB +step 2527/5000 loss 0.3035 (w 0.4038 mse 0.4140 t 292 new 0.24) lr 1.00e-05 gnorm 0.112 3.16s mem 81.1GB +step 2528/5000 loss 0.2981 (w 0.1687 mse 0.1821 t 914 new 0.18) lr 1.00e-05 gnorm 0.143 3.07s mem 81.1GB +step 2529/5000 loss 0.3275 (w 0.4070 mse 0.4177 t 1000 new 0.16) lr 1.00e-05 gnorm 0.188 3.03s mem 81.1GB +step 2530/5000 loss 0.1202 (w 0.2310 mse 0.2432 t 977 new 0.20) lr 1.00e-05 gnorm 0.115 3.38s mem 81.1GB +step 2531/5000 loss 0.3523 (w 0.2742 mse 0.2788 t 737 new 0.18) lr 1.00e-05 gnorm 0.143 3.02s mem 81.1GB +step 2532/5000 loss 0.3066 (w 0.3036 mse 0.3047 t 758 new 0.15) lr 1.00e-05 gnorm 0.112 3.43s mem 81.1GB +step 2533/5000 loss 0.3017 (w 0.3135 mse 0.3117 t 759 new 0.24) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 2534/5000 loss 0.1992 (w 0.3122 mse 0.3121 t 883 new 0.23) lr 1.00e-05 gnorm 0.104 3.05s mem 81.1GB +step 2535/5000 loss 0.1862 (w 0.2088 mse 0.2257 t 668 new 0.19) lr 1.00e-05 gnorm 0.143 3.02s mem 81.1GB +step 2536/5000 loss 0.2084 (w 0.2919 mse 0.3011 t 950 new 0.08) lr 1.00e-05 gnorm 0.172 3.43s mem 81.1GB +step 2537/5000 loss 0.3591 (w 0.2971 mse 0.2983 t 937 new 0.28) lr 1.00e-05 gnorm 0.158 3.05s mem 81.1GB +step 2538/5000 loss 0.2361 (w 0.2614 mse 0.2770 t 940 new 0.13) lr 1.00e-05 gnorm 0.183 3.37s mem 81.1GB +step 2539/5000 loss 0.1263 (w 0.3120 mse 0.3200 t 944 new 0.15) lr 1.00e-05 gnorm 0.108 2.83s mem 81.1GB +step 2540/5000 loss 0.3727 (w 0.6101 mse 0.6228 t 107 new 0.21) lr 1.00e-05 gnorm 0.195 3.10s mem 81.1GB +step 2541/5000 loss 0.3838 (w 0.4151 mse 0.4202 t 269 new 0.25) lr 1.00e-05 gnorm 0.295 3.05s mem 81.1GB +step 2542/5000 loss 0.1380 (w 0.4578 mse 0.4452 t 990 new 0.20) lr 1.00e-05 gnorm 0.136 3.38s mem 81.1GB +step 2543/5000 loss 0.2288 (w 0.2214 mse 0.2467 t 961 new 0.23) lr 1.00e-05 gnorm 0.149 2.83s mem 81.1GB +step 2544/5000 loss 0.2259 (w 0.2025 mse 0.2031 t 945 new 0.19) lr 1.00e-05 gnorm 0.151 3.13s mem 81.1GB +step 2545/5000 loss 0.2240 (w 0.3350 mse 0.3412 t 965 new 0.08) lr 1.00e-05 gnorm 0.410 2.83s mem 81.1GB +step 2546/5000 loss 0.3035 (w 0.3398 mse 0.3537 t 636 new 0.15) lr 1.00e-05 gnorm 0.110 3.02s mem 81.1GB +step 2547/5000 loss 0.3865 (w 0.2095 mse 0.2141 t 799 new 0.23) lr 1.00e-05 gnorm 0.249 3.10s mem 81.1GB +step 2548/5000 loss 0.1981 (w 0.2502 mse 0.2540 t 914 new 0.24) lr 1.00e-05 gnorm 0.099 3.37s mem 81.1GB +step 2549/5000 loss 0.2816 (w 0.4659 mse 0.4883 t 233 new 0.22) lr 1.00e-05 gnorm 0.208 2.84s mem 81.1GB +step 2550/5000 loss 0.1578 (w 0.3146 mse 0.3134 t 934 new 0.15) lr 1.00e-05 gnorm 0.158 3.15s mem 81.1GB +step 2551/5000 loss 0.2678 (w 0.3563 mse 0.3579 t 621 new 0.06) lr 1.00e-05 gnorm 0.124 3.27s mem 81.1GB +step 2552/5000 loss 0.3516 (w 0.3736 mse 0.3889 t 983 new 0.20) lr 1.00e-05 gnorm 0.117 3.03s mem 81.1GB +step 2553/5000 loss 0.2579 (w 0.2366 mse 0.2531 t 942 new 0.11) lr 1.00e-05 gnorm 0.131 3.10s mem 81.1GB +step 2554/5000 loss 0.1793 (w 0.2623 mse 0.2604 t 962 new 0.25) lr 1.00e-05 gnorm 0.308 3.27s mem 81.1GB +step 2555/5000 loss 0.3179 (w 0.5949 mse 0.6086 t 183 new 0.28) lr 1.00e-05 gnorm 0.151 3.15s mem 81.1GB +step 2556/5000 loss 0.2313 (w 0.3146 mse 0.3176 t 913 new 0.21) lr 1.00e-05 gnorm 0.127 3.14s mem 81.1GB +step 2557/5000 loss 0.3806 (w 0.2689 mse 0.2601 t 860 new 0.23) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +step 2558/5000 loss 0.2601 (w 0.3175 mse 0.3373 t 712 new 0.18) lr 1.00e-05 gnorm 0.158 3.08s mem 81.1GB +step 2559/5000 loss 0.3798 (w 0.3394 mse 0.3413 t 269 new 0.26) lr 1.00e-05 gnorm 0.136 3.23s mem 81.1GB +step 2560/5000 loss 0.2572 (w 0.3677 mse 0.3705 t 996 new 0.22) lr 1.00e-05 gnorm 0.298 3.30s mem 81.1GB +step 2561/5000 loss 0.2190 (w 0.3225 mse 0.3190 t 922 new 0.19) lr 1.00e-05 gnorm 0.129 3.14s mem 81.1GB +step 2562/5000 loss 0.3238 (w 0.4775 mse 0.4846 t 368 new 0.20) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +step 2563/5000 loss 0.2589 (w 0.2576 mse 0.2480 t 954 new 0.12) lr 1.00e-05 gnorm 0.170 3.05s mem 81.1GB +step 2564/5000 loss 0.2676 (w 0.2555 mse 0.2541 t 862 new 0.10) lr 1.00e-05 gnorm 0.127 2.85s mem 81.1GB +step 2565/5000 loss 0.2166 (w 0.3393 mse 0.3365 t 794 new 0.16) lr 1.00e-05 gnorm 0.300 3.28s mem 81.1GB +step 2566/5000 loss 0.3622 (w 0.2884 mse 0.3009 t 779 new 0.22) lr 1.00e-05 gnorm 0.158 3.07s mem 81.1GB +step 2567/5000 loss 0.2299 (w 0.2455 mse 0.2493 t 938 new 0.24) lr 1.00e-05 gnorm 0.126 3.15s mem 81.1GB +step 2568/5000 loss 0.1980 (w 0.4400 mse 0.4483 t 990 new 0.29) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +step 2569/5000 loss 0.2718 (w 0.2407 mse 0.2433 t 884 new 0.16) lr 1.00e-05 gnorm 0.155 3.07s mem 81.1GB +step 2570/5000 loss 0.2704 (w 0.1970 mse 0.2129 t 487 new 0.15) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +step 2571/5000 loss 0.3824 (w 0.2750 mse 0.2949 t 462 new 0.26) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +step 2572/5000 loss 0.2298 (w 0.1723 mse 0.1993 t 926 new 0.24) lr 1.00e-05 gnorm 0.108 3.09s mem 81.1GB +step 2573/5000 loss 0.3545 (w 0.2498 mse 0.2519 t 905 new 0.24) lr 1.00e-05 gnorm 0.124 3.17s mem 81.1GB +step 2574/5000 loss 0.0661 (w 0.3638 mse 0.3452 t 989 new 0.17) lr 1.00e-05 gnorm 0.221 2.83s mem 81.1GB +step 2575/5000 loss 0.4848 (w 0.2825 mse 0.2869 t 386 new 0.14) lr 1.00e-05 gnorm 0.155 3.21s mem 81.1GB +step 2576/5000 loss 0.3228 (w 0.2645 mse 0.2662 t 484 new 0.10) lr 1.00e-05 gnorm 0.110 3.07s mem 81.1GB +step 2577/5000 loss 0.1600 (w 0.3070 mse 0.3109 t 942 new 0.24) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +step 2578/5000 loss 0.1878 (w 0.2923 mse 0.2952 t 828 new 0.22) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +step 2579/5000 loss 0.1138 (w 0.4135 mse 0.4040 t 989 new 0.21) lr 1.00e-05 gnorm 0.120 3.66s mem 81.1GB +step 2580/5000 loss 0.3342 (w 0.2208 mse 0.2399 t 740 new 0.20) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +step 2581/5000 loss 0.4550 (w 0.2322 mse 0.2373 t 710 new 0.11) lr 1.00e-05 gnorm 0.138 3.19s mem 81.1GB +step 2582/5000 loss 0.3458 (w 0.2678 mse 0.2754 t 882 new 0.23) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +step 2583/5000 loss 0.3568 (w 0.2243 mse 0.2327 t 855 new 0.22) lr 1.00e-05 gnorm 0.129 3.21s mem 81.1GB +step 2584/5000 loss 0.1533 (w 0.2673 mse 0.2700 t 946 new 0.12) lr 1.00e-05 gnorm 0.198 3.07s mem 81.1GB +step 2585/5000 loss 0.3890 (w 0.2056 mse 0.2177 t 868 new 0.22) lr 1.00e-05 gnorm 0.148 3.28s mem 81.1GB +step 2586/5000 loss 0.1653 (w 0.3039 mse 0.3049 t 711 new 0.22) lr 1.00e-05 gnorm 0.087 2.83s mem 81.1GB +step 2587/5000 loss 0.2064 (w 0.1578 mse 0.1741 t 864 new 0.23) lr 1.00e-05 gnorm 0.141 3.14s mem 81.1GB +step 2588/5000 loss 0.3489 (w 0.3357 mse 0.3363 t 557 new 0.15) lr 1.00e-05 gnorm 0.135 3.10s mem 81.1GB +step 2589/5000 loss 0.2963 (w 0.3296 mse 0.3287 t 754 new 0.21) lr 1.00e-05 gnorm 0.206 3.30s mem 81.1GB +step 2590/5000 loss 0.3447 (w 0.3393 mse 0.3481 t 998 new 0.24) lr 1.00e-05 gnorm 0.163 3.10s mem 81.1GB +step 2591/5000 loss 0.1065 (w 0.2509 mse 0.2513 t 976 new 0.21) lr 1.00e-05 gnorm 0.210 3.37s mem 81.1GB +step 2592/5000 loss 0.2804 (w 0.2744 mse 0.2819 t 915 new 0.19) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +step 2593/5000 loss 0.4115 (w 0.2665 mse 0.2756 t 969 new 0.18) lr 1.00e-05 gnorm 0.132 3.11s mem 81.1GB +step 2594/5000 loss 0.2309 (w 0.2649 mse 0.2746 t 562 new 0.24) lr 1.00e-05 gnorm 0.110 3.12s mem 81.1GB +step 2595/5000 loss 0.2700 (w 0.2233 mse 0.2212 t 853 new 0.17) lr 1.00e-05 gnorm 0.112 3.17s mem 81.1GB +step 2596/5000 loss 0.2650 (w 0.4488 mse 0.4639 t 960 new 0.27) lr 1.00e-05 gnorm 0.263 3.12s mem 81.1GB +step 2597/5000 loss 0.4295 (w 0.2873 mse 0.2914 t 943 new 0.17) lr 1.00e-05 gnorm 0.117 3.12s mem 81.1GB +step 2598/5000 loss 0.3515 (w 0.2484 mse 0.2733 t 970 new 0.12) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +step 2599/5000 loss 0.2041 (w 0.2668 mse 0.2858 t 979 new 0.26) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +step 2600/5000 loss 0.3045 (w 0.2245 mse 0.2347 t 578 new 0.09) lr 1.00e-05 gnorm 0.134 3.52s mem 81.1GB +step 2601/5000 loss 0.3040 (w 0.2709 mse 0.2691 t 899 new 0.20) lr 1.00e-05 gnorm 0.126 3.26s mem 81.1GB +step 2602/5000 loss 0.2580 (w 0.2654 mse 0.3017 t 948 new 0.18) lr 1.00e-05 gnorm 0.151 3.26s mem 81.1GB +step 2603/5000 loss 0.3035 (w 0.3135 mse 0.3186 t 864 new 0.19) lr 1.00e-05 gnorm 0.183 3.14s mem 81.1GB +step 2604/5000 loss 0.1032 (w 0.2592 mse 0.2657 t 855 new 0.20) lr 1.00e-05 gnorm 0.106 2.84s mem 81.1GB +step 2605/5000 loss 0.1850 (w 0.2675 mse 0.2678 t 700 new 0.19) lr 1.00e-05 gnorm 0.112 3.07s mem 81.1GB +step 2606/5000 loss 0.2749 (w 0.2558 mse 0.2662 t 730 new 0.24) lr 1.00e-05 gnorm 0.103 3.32s mem 81.1GB +step 2607/5000 loss 0.2809 (w 0.2252 mse 0.2327 t 948 new 0.21) lr 1.00e-05 gnorm 0.129 3.36s mem 81.1GB +step 2608/5000 loss 0.1390 (w 0.3151 mse 0.3218 t 955 new 0.24) lr 1.00e-05 gnorm 0.150 3.29s mem 81.1GB +step 2609/5000 loss 0.2182 (w 0.5385 mse 0.5159 t 988 new 0.26) lr 1.00e-05 gnorm 0.136 3.13s mem 81.1GB +step 2610/5000 loss 0.2893 (w 0.2175 mse 0.2322 t 815 new 0.22) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +step 2611/5000 loss 0.2433 (w 0.2731 mse 0.2765 t 670 new 0.20) lr 1.00e-05 gnorm 0.108 3.06s mem 81.1GB +step 2612/5000 loss 0.3367 (w 0.2362 mse 0.2508 t 903 new 0.23) lr 1.00e-05 gnorm 0.101 3.36s mem 81.1GB +step 2613/5000 loss 0.1744 (w 0.3440 mse 0.3469 t 991 new 0.26) lr 1.00e-05 gnorm 0.230 3.04s mem 81.1GB +step 2614/5000 loss 0.3017 (w 0.3008 mse 0.3189 t 570 new 0.19) lr 1.00e-05 gnorm 0.227 3.09s mem 81.1GB +step 2615/5000 loss 0.3096 (w 0.2598 mse 0.2753 t 807 new 0.16) lr 1.00e-05 gnorm 0.162 3.15s mem 81.1GB +step 2616/5000 loss 0.3666 (w 0.1945 mse 0.2080 t 979 new 0.25) lr 1.00e-05 gnorm 0.104 3.06s mem 81.1GB +step 2617/5000 loss 0.1691 (w 0.4101 mse 0.4095 t 978 new 0.13) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +step 2618/5000 loss 0.3360 (w 0.3643 mse 0.3691 t 1000 new 0.23) lr 1.00e-05 gnorm 0.417 3.08s mem 81.1GB +step 2619/5000 loss 0.2903 (w 0.2090 mse 0.2241 t 937 new 0.25) lr 1.00e-05 gnorm 0.104 3.22s mem 81.1GB +step 2620/5000 loss 0.3092 (w 0.3134 mse 0.3412 t 973 new 0.19) lr 1.00e-05 gnorm 0.094 3.07s mem 81.1GB +step 2621/5000 loss 0.2633 (w 0.2509 mse 0.2586 t 516 new 0.13) lr 1.00e-05 gnorm 0.104 3.10s mem 81.1GB +step 2622/5000 loss 0.1998 (w 0.3569 mse 0.3561 t 936 new 0.18) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +step 2623/5000 loss 0.2705 (w 0.2821 mse 0.3013 t 523 new 0.23) lr 1.00e-05 gnorm 0.117 3.02s mem 81.1GB +step 2624/5000 loss 0.3192 (w 0.1860 mse 0.2057 t 813 new 0.25) lr 1.00e-05 gnorm 0.138 3.36s mem 81.1GB +step 2625/5000 loss 0.3850 (w 0.1808 mse 0.1909 t 683 new 0.10) lr 1.00e-05 gnorm 0.105 3.25s mem 81.1GB +step 2626/5000 loss 0.3492 (w 0.2237 mse 0.2247 t 840 new 0.13) lr 1.00e-05 gnorm 0.163 3.09s mem 81.1GB +step 2627/5000 loss 0.2685 (w 0.2811 mse 0.2851 t 781 new 0.23) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +step 2628/5000 loss 0.4211 (w 0.2346 mse 0.2505 t 858 new 0.24) lr 1.00e-05 gnorm 0.150 3.05s mem 81.1GB +step 2629/5000 loss 0.2609 (w 0.4783 mse 0.4920 t 973 new 0.14) lr 1.00e-05 gnorm 0.147 3.05s mem 81.1GB +step 2630/5000 loss 0.4716 (w 0.3028 mse 0.3201 t 479 new 0.17) lr 1.00e-05 gnorm 0.139 3.30s mem 81.1GB +step 2631/5000 loss 0.1857 (w 0.4299 mse 0.4336 t 992 new 0.23) lr 1.00e-05 gnorm 0.259 3.30s mem 81.1GB +step 2632/5000 loss 0.2640 (w 0.3066 mse 0.3147 t 702 new 0.22) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +step 2633/5000 loss 0.2951 (w 0.2890 mse 0.2881 t 972 new 0.11) lr 1.00e-05 gnorm 0.109 3.11s mem 81.1GB +step 2634/5000 loss 0.4202 (w 0.2912 mse 0.3056 t 827 new 0.15) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +step 2635/5000 loss 0.3324 (w 0.2607 mse 0.2679 t 883 new 0.23) lr 1.00e-05 gnorm 0.093 3.03s mem 81.1GB +step 2636/5000 loss 0.1822 (w 0.3768 mse 0.3728 t 954 new 0.20) lr 1.00e-05 gnorm 0.118 3.37s mem 81.1GB +step 2637/5000 loss 0.1645 (w 0.3204 mse 0.3210 t 940 new 0.20) lr 1.00e-05 gnorm 0.193 3.09s mem 81.1GB +step 2638/5000 loss 0.4105 (w 0.2938 mse 0.2997 t 735 new 0.25) lr 1.00e-05 gnorm 0.130 3.14s mem 81.1GB +step 2639/5000 loss 0.1322 (w 0.3283 mse 0.3383 t 990 new 0.22) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +step 2640/5000 loss 0.2815 (w 0.2934 mse 0.2988 t 771 new 0.22) lr 1.00e-05 gnorm 0.176 3.06s mem 81.1GB +step 2641/5000 loss 0.1457 (w 0.3403 mse 0.3481 t 993 new 0.24) lr 1.00e-05 gnorm 0.116 3.05s mem 81.1GB +step 2642/5000 loss 0.2177 (w 0.2670 mse 0.2841 t 985 new 0.22) lr 1.00e-05 gnorm 0.155 3.33s mem 81.1GB +step 2643/5000 loss 0.2081 (w 0.3740 mse 0.3668 t 845 new 0.22) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 2644/5000 loss 0.2984 (w 0.3138 mse 0.3284 t 927 new 0.20) lr 1.00e-05 gnorm 0.152 3.30s mem 81.1GB +step 2645/5000 loss 0.1797 (w 0.2974 mse 0.3012 t 988 new 0.22) lr 1.00e-05 gnorm 0.195 3.08s mem 81.1GB +step 2646/5000 loss 0.3193 (w 0.2520 mse 0.2567 t 792 new 0.13) lr 1.00e-05 gnorm 0.163 3.07s mem 81.1GB +step 2647/5000 loss 0.3004 (w 0.3597 mse 0.3462 t 950 new 0.21) lr 1.00e-05 gnorm 0.106 3.31s mem 81.1GB +step 2648/5000 loss 0.1826 (w 0.2823 mse 0.2889 t 914 new 0.21) lr 1.00e-05 gnorm 0.106 3.32s mem 81.1GB +step 2649/5000 loss 0.3519 (w 0.3022 mse 0.3034 t 788 new 0.25) lr 1.00e-05 gnorm 0.120 2.84s mem 81.1GB +step 2650/5000 loss 0.1774 (w 0.2297 mse 0.2433 t 641 new 0.16) lr 1.00e-05 gnorm 0.143 3.10s mem 81.1GB +step 2651/5000 loss 0.2148 (w 0.1844 mse 0.2027 t 882 new 0.21) lr 1.00e-05 gnorm 0.227 3.09s mem 81.1GB +step 2652/5000 loss 0.2759 (w 0.3761 mse 0.3713 t 980 new 0.21) lr 1.00e-05 gnorm 0.138 3.27s mem 81.1GB +step 2653/5000 loss 0.3970 (w 0.3200 mse 0.3434 t 503 new 0.25) lr 1.00e-05 gnorm 0.156 3.10s mem 81.1GB +step 2654/5000 loss 0.3064 (w 0.2741 mse 0.2826 t 773 new 0.25) lr 1.00e-05 gnorm 0.171 3.37s mem 81.1GB +step 2655/5000 loss 0.2227 (w 0.4642 mse 0.4558 t 134 new 0.21) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 2656/5000 loss 0.3215 (w 0.2369 mse 0.2437 t 776 new 0.13) lr 1.00e-05 gnorm 0.129 3.46s mem 81.1GB +step 2657/5000 loss 0.5149 (w 0.2171 mse 0.2324 t 508 new 0.16) lr 1.00e-05 gnorm 0.180 2.83s mem 81.1GB +step 2658/5000 loss 0.3810 (w 0.3031 mse 0.2990 t 761 new 0.17) lr 1.00e-05 gnorm 0.184 3.29s mem 81.1GB +step 2659/5000 loss 0.1813 (w 0.3298 mse 0.3389 t 983 new 0.23) lr 1.00e-05 gnorm 0.148 3.09s mem 81.1GB +step 2660/5000 loss 0.2039 (w 0.2513 mse 0.2633 t 948 new 0.15) lr 1.00e-05 gnorm 0.360 3.08s mem 81.1GB +step 2661/5000 loss 0.3385 (w 0.2465 mse 0.2669 t 974 new 0.13) lr 1.00e-05 gnorm 0.144 3.27s mem 81.1GB +step 2662/5000 loss 0.4924 (w 0.5881 mse 0.5908 t 189 new 0.18) lr 1.00e-05 gnorm 0.156 3.08s mem 81.1GB +step 2663/5000 loss 0.2593 (w 0.4355 mse 0.4360 t 973 new 0.19) lr 1.00e-05 gnorm 0.106 3.05s mem 81.1GB +step 2664/5000 loss 0.2533 (w 0.2071 mse 0.2173 t 796 new 0.13) lr 1.00e-05 gnorm 0.164 3.06s mem 81.1GB +step 2665/5000 loss 0.2417 (w 0.3853 mse 0.3821 t 981 new 0.24) lr 1.00e-05 gnorm 0.123 3.12s mem 81.1GB +step 2666/5000 loss 0.2683 (w 0.2879 mse 0.2982 t 990 new 0.23) lr 1.00e-05 gnorm 0.154 3.05s mem 81.1GB +step 2667/5000 loss 0.2063 (w 0.2786 mse 0.2816 t 797 new 0.26) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +step 2668/5000 loss 0.2058 (w 0.3580 mse 0.3549 t 951 new 0.19) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +step 2669/5000 loss 0.1769 (w 0.3139 mse 0.3144 t 905 new 0.25) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +step 2670/5000 loss 0.1330 (w 0.3915 mse 0.3945 t 997 new 0.23) lr 1.00e-05 gnorm 0.128 3.10s mem 81.1GB +step 2671/5000 loss 0.3803 (w 0.3536 mse 0.3389 t 956 new 0.22) lr 1.00e-05 gnorm 0.147 3.35s mem 81.1GB +step 2672/5000 loss 0.2009 (w 0.2192 mse 0.2387 t 968 new 0.12) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +step 2673/5000 loss 0.3729 (w 0.1964 mse 0.2019 t 863 new 0.20) lr 1.00e-05 gnorm 0.172 3.14s mem 81.1GB +step 2674/5000 loss 0.2110 (w 0.2983 mse 0.3081 t 966 new 0.22) lr 1.00e-05 gnorm 0.097 3.07s mem 81.1GB +step 2675/5000 loss 0.5540 (w 0.2942 mse 0.3003 t 537 new 0.14) lr 1.00e-05 gnorm 0.259 3.03s mem 81.1GB +step 2676/5000 loss 0.4183 (w 0.2594 mse 0.2698 t 518 new 0.21) lr 1.00e-05 gnorm 0.230 3.11s mem 81.1GB +step 2677/5000 loss 0.3255 (w 0.2844 mse 0.2860 t 706 new 0.25) lr 1.00e-05 gnorm 0.254 3.38s mem 81.1GB +step 2678/5000 loss 0.3681 (w 0.3450 mse 0.3448 t 973 new 0.07) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +step 2679/5000 loss 0.2221 (w 0.2500 mse 0.2659 t 862 new 0.18) lr 1.00e-05 gnorm 0.143 3.16s mem 81.1GB +step 2680/5000 loss 0.5088 (w 0.3314 mse 0.3337 t 631 new 0.24) lr 1.00e-05 gnorm 0.296 3.09s mem 81.1GB +step 2681/5000 loss 0.4223 (w 0.3518 mse 0.3574 t 315 new 0.26) lr 1.00e-05 gnorm 0.121 3.10s mem 81.1GB +step 2682/5000 loss 0.1958 (w 0.1553 mse 0.1756 t 996 new 0.24) lr 1.00e-05 gnorm 0.185 3.02s mem 81.1GB +step 2683/5000 loss 0.3777 (w 0.2936 mse 0.2968 t 708 new 0.23) lr 1.00e-05 gnorm 0.148 3.35s mem 81.1GB +step 2684/5000 loss 0.2888 (w 0.3027 mse 0.3001 t 781 new 0.23) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +step 2685/5000 loss 0.1404 (w 0.3065 mse 0.3183 t 945 new 0.20) lr 1.00e-05 gnorm 0.161 3.17s mem 81.1GB +step 2686/5000 loss 0.1267 (w 0.4304 mse 0.4376 t 990 new 0.13) lr 1.00e-05 gnorm 0.136 3.12s mem 81.1GB +step 2687/5000 loss 0.4478 (w 0.3184 mse 0.3289 t 470 new 0.21) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +step 2688/5000 loss 0.2961 (w 0.3000 mse 0.3002 t 847 new 0.24) lr 1.00e-05 gnorm 0.142 3.25s mem 81.1GB +step 2689/5000 loss 0.3479 (w 0.3099 mse 0.3218 t 945 new 0.20) lr 1.00e-05 gnorm 0.136 3.34s mem 81.1GB +step 2690/5000 loss 0.3399 (w 0.2532 mse 0.2530 t 836 new 0.20) lr 1.00e-05 gnorm 0.196 2.82s mem 81.1GB +step 2691/5000 loss 0.1909 (w 0.2777 mse 0.2972 t 995 new 0.19) lr 1.00e-05 gnorm 0.152 3.53s mem 81.1GB +step 2692/5000 loss 0.2125 (w 0.3468 mse 0.3364 t 922 new 0.26) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +step 2693/5000 loss 0.1553 (w 0.2150 mse 0.2387 t 724 new 0.18) lr 1.00e-05 gnorm 0.230 3.27s mem 81.1GB +step 2694/5000 loss 0.2937 (w 0.2110 mse 0.2323 t 482 new 0.18) lr 1.00e-05 gnorm 0.193 3.08s mem 81.1GB +step 2695/5000 loss 0.4318 (w 0.2584 mse 0.2637 t 799 new 0.19) lr 1.00e-05 gnorm 0.186 3.11s mem 81.1GB +step 2696/5000 loss 0.3340 (w 0.2840 mse 0.2914 t 440 new 0.07) lr 1.00e-05 gnorm 0.210 2.84s mem 81.1GB +step 2697/5000 loss 0.2541 (w 0.2319 mse 0.2515 t 698 new 0.18) lr 1.00e-05 gnorm 0.125 3.54s mem 81.1GB +step 2698/5000 loss 0.2463 (w 0.2081 mse 0.2367 t 933 new 0.19) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +step 2699/5000 loss 0.3542 (w 0.1867 mse 0.2149 t 730 new 0.21) lr 1.00e-05 gnorm 0.159 3.23s mem 81.1GB +step 2700/5000 loss 0.3517 (w 0.3056 mse 0.3036 t 899 new 0.23) lr 1.00e-05 gnorm 0.150 3.27s mem 81.1GB +step 2701/5000 loss 0.2406 (w 0.3245 mse 0.3281 t 929 new 0.18) lr 1.00e-05 gnorm 0.115 3.08s mem 81.1GB +step 2702/5000 loss 0.2958 (w 0.3527 mse 0.3472 t 988 new 0.15) lr 1.00e-05 gnorm 0.228 2.85s mem 81.1GB +step 2703/5000 loss 0.1777 (w 0.2889 mse 0.3062 t 961 new 0.22) lr 1.00e-05 gnorm 0.115 3.52s mem 81.1GB +step 2704/5000 loss 0.2544 (w 0.2603 mse 0.2671 t 817 new 0.22) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +step 2705/5000 loss 0.5212 (w 0.3812 mse 0.4059 t 553 new 0.18) lr 1.00e-05 gnorm 0.153 3.33s mem 81.1GB +step 2706/5000 loss 0.2786 (w 0.2325 mse 0.2452 t 760 new 0.19) lr 1.00e-05 gnorm 0.248 3.31s mem 81.1GB +step 2707/5000 loss 0.2690 (w 0.2466 mse 0.2608 t 964 new 0.20) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +step 2708/5000 loss 0.3672 (w 0.4309 mse 0.4302 t 344 new 0.22) lr 1.00e-05 gnorm 0.198 2.84s mem 81.1GB +step 2709/5000 loss 0.1995 (w 0.3274 mse 0.3283 t 944 new 0.16) lr 1.00e-05 gnorm 0.141 3.18s mem 81.1GB +step 2710/5000 loss 0.2062 (w 0.2355 mse 0.2331 t 934 new 0.11) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +step 2711/5000 loss 0.3517 (w 0.3538 mse 0.3689 t 195 new 0.09) lr 1.00e-05 gnorm 0.147 3.31s mem 81.1GB +step 2712/5000 loss 0.2112 (w 0.4280 mse 0.4132 t 991 new 0.21) lr 1.00e-05 gnorm 0.101 3.32s mem 81.1GB +step 2713/5000 loss 0.2748 (w 0.2533 mse 0.2804 t 996 new 0.19) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 2714/5000 loss 0.3139 (w 0.2001 mse 0.2128 t 948 new 0.22) lr 1.00e-05 gnorm 0.105 3.30s mem 81.1GB +step 2715/5000 loss 0.3357 (w 0.4138 mse 0.4142 t 978 new 0.24) lr 1.00e-05 gnorm 0.122 3.09s mem 81.1GB +step 2716/5000 loss 0.1427 (w 0.2385 mse 0.2366 t 642 new 0.16) lr 1.00e-05 gnorm 0.145 2.82s mem 81.1GB +step 2717/5000 loss 0.3591 (w 0.2419 mse 0.2471 t 830 new 0.13) lr 1.00e-05 gnorm 0.344 3.27s mem 81.1GB +step 2718/5000 loss 0.3445 (w 0.3329 mse 0.3340 t 601 new 0.11) lr 1.00e-05 gnorm 0.113 3.10s mem 81.1GB +step 2719/5000 loss 0.3424 (w 0.2800 mse 0.2824 t 966 new 0.14) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 2720/5000 loss 0.2470 (w 0.4120 mse 0.4047 t 673 new 0.20) lr 1.00e-05 gnorm 0.102 3.11s mem 81.1GB +step 2721/5000 loss 0.2588 (w 0.2679 mse 0.2672 t 641 new 0.16) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 2722/5000 loss 0.3316 (w 0.2471 mse 0.2618 t 927 new 0.17) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +step 2723/5000 loss 0.2310 (w 0.3337 mse 0.3382 t 922 new 0.22) lr 1.00e-05 gnorm 0.168 3.30s mem 81.1GB +step 2724/5000 loss 0.2798 (w 0.2451 mse 0.2615 t 702 new 0.21) lr 1.00e-05 gnorm 0.131 3.10s mem 81.1GB +step 2725/5000 loss 0.3101 (w 0.2295 mse 0.2378 t 647 new 0.17) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +step 2726/5000 loss 0.1705 (w 0.2183 mse 0.2376 t 899 new 0.24) lr 1.00e-05 gnorm 0.128 3.16s mem 81.1GB +step 2727/5000 loss 0.2490 (w 0.3849 mse 0.3792 t 998 new 0.25) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +step 2728/5000 loss 0.3883 (w 0.3455 mse 0.3545 t 428 new 0.22) lr 1.00e-05 gnorm 0.148 3.06s mem 81.1GB +step 2729/5000 loss 0.3343 (w 0.2756 mse 0.2729 t 899 new 0.14) lr 1.00e-05 gnorm 0.121 3.23s mem 81.1GB +step 2730/5000 loss 0.3804 (w 0.2618 mse 0.2713 t 781 new 0.23) lr 1.00e-05 gnorm 0.124 3.06s mem 81.1GB +step 2731/5000 loss 0.2538 (w 0.2385 mse 0.2491 t 859 new 0.17) lr 1.00e-05 gnorm 0.169 2.83s mem 81.1GB +step 2732/5000 loss 0.2246 (w 0.3781 mse 0.3817 t 983 new 0.20) lr 1.00e-05 gnorm 0.234 3.54s mem 81.1GB +step 2733/5000 loss 0.3083 (w 0.6859 mse 0.6915 t 140 new 0.21) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +step 2734/5000 loss 0.2941 (w 0.2350 mse 0.2416 t 681 new 0.21) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +step 2735/5000 loss 0.3331 (w 0.1783 mse 0.2065 t 967 new 0.19) lr 1.00e-05 gnorm 0.119 3.34s mem 81.1GB +step 2736/5000 loss 0.2938 (w 0.2446 mse 0.2365 t 860 new 0.14) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +step 2737/5000 loss 0.2073 (w 0.4211 mse 0.4083 t 989 new 0.19) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +step 2738/5000 loss 0.3177 (w 0.4550 mse 0.4723 t 992 new 0.18) lr 1.00e-05 gnorm 0.185 3.55s mem 81.1GB +step 2739/5000 loss 0.1046 (w 0.2700 mse 0.2995 t 997 new 0.22) lr 1.00e-05 gnorm 0.112 2.85s mem 81.1GB +step 2740/5000 loss 0.2581 (w 0.2704 mse 0.2973 t 364 new 0.21) lr 1.00e-05 gnorm 0.156 3.33s mem 81.1GB +step 2741/5000 loss 0.1652 (w 0.2722 mse 0.2723 t 776 new 0.25) lr 1.00e-05 gnorm 0.157 3.06s mem 81.1GB +step 2742/5000 loss 0.2040 (w 0.3218 mse 0.3186 t 880 new 0.24) lr 1.00e-05 gnorm 0.108 2.85s mem 81.1GB +step 2743/5000 loss 0.1496 (w 0.1579 mse 0.1691 t 975 new 0.22) lr 1.00e-05 gnorm 0.102 2.85s mem 81.1GB +step 2744/5000 loss 0.1895 (w 0.2182 mse 0.2199 t 849 new 0.14) lr 1.00e-05 gnorm 0.184 3.18s mem 81.1GB +step 2745/5000 loss 0.1502 (w 0.3348 mse 0.3353 t 984 new 0.23) lr 1.00e-05 gnorm 0.095 2.84s mem 81.1GB +step 2746/5000 loss 0.3291 (w 0.3463 mse 0.3478 t 982 new 0.17) lr 1.00e-05 gnorm 0.174 3.34s mem 81.1GB +step 2747/5000 loss 0.2548 (w 0.2731 mse 0.2764 t 800 new 0.18) lr 1.00e-05 gnorm 0.211 3.47s mem 81.1GB +step 2748/5000 loss 0.5088 (w 0.2640 mse 0.2642 t 888 new 0.19) lr 1.00e-05 gnorm 0.148 2.84s mem 81.1GB +step 2749/5000 loss 0.2481 (w 0.2290 mse 0.2450 t 959 new 0.17) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +step 2750/5000 loss 0.2254 (w 0.2439 mse 0.2584 t 945 new 0.21) lr 1.00e-05 gnorm 0.161 3.15s mem 81.1GB +step 2751/5000 loss 0.2989 (w 0.2406 mse 0.2635 t 989 new 0.17) lr 1.00e-05 gnorm 0.150 3.18s mem 81.1GB +step 2752/5000 loss 0.2489 (w 0.2538 mse 0.2559 t 944 new 0.18) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +step 2753/5000 loss 0.2018 (w 0.2421 mse 0.2656 t 986 new 0.22) lr 1.00e-05 gnorm 0.141 3.24s mem 81.1GB +step 2754/5000 loss 0.3790 (w 0.3405 mse 0.3430 t 734 new 0.20) lr 1.00e-05 gnorm 0.103 2.84s mem 81.1GB +step 2755/5000 loss 0.3334 (w 0.2923 mse 0.3047 t 710 new 0.30) lr 1.00e-05 gnorm 0.165 2.85s mem 81.1GB +step 2756/5000 loss 0.3933 (w 0.3930 mse 0.3973 t 348 new 0.22) lr 1.00e-05 gnorm 0.130 3.08s mem 81.1GB +step 2757/5000 loss 0.3670 (w 0.2803 mse 0.2786 t 712 new 0.10) lr 1.00e-05 gnorm 0.125 3.04s mem 81.1GB +step 2758/5000 loss 0.1422 (w 0.3055 mse 0.3188 t 951 new 0.17) lr 1.00e-05 gnorm 0.122 2.85s mem 81.1GB +step 2759/5000 loss 0.2585 (w 0.2008 mse 0.2119 t 755 new 0.20) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +step 2760/5000 loss 0.2228 (w 0.1903 mse 0.2090 t 703 new 0.16) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +step 2761/5000 loss 0.2158 (w 0.2151 mse 0.2228 t 822 new 0.13) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +step 2762/5000 loss 0.2868 (w 0.2998 mse 0.3169 t 977 new 0.19) lr 1.00e-05 gnorm 0.101 3.09s mem 81.1GB +step 2763/5000 loss 0.1809 (w 0.2619 mse 0.2782 t 891 new 0.22) lr 1.00e-05 gnorm 0.108 3.13s mem 81.1GB +step 2764/5000 loss 0.4353 (w 0.3358 mse 0.3262 t 949 new 0.19) lr 1.00e-05 gnorm 0.231 3.14s mem 81.1GB +step 2765/5000 loss 0.3692 (w 0.2361 mse 0.2436 t 553 new 0.23) lr 1.00e-05 gnorm 0.215 3.13s mem 81.1GB +step 2766/5000 loss 0.3271 (w 0.2707 mse 0.2693 t 971 new 0.14) lr 1.00e-05 gnorm 0.200 2.84s mem 81.1GB +step 2767/5000 loss 0.4016 (w 0.2273 mse 0.2441 t 782 new 0.25) lr 1.00e-05 gnorm 0.158 3.14s mem 81.1GB +step 2768/5000 loss 0.3078 (w 0.3032 mse 0.3097 t 444 new 0.21) lr 1.00e-05 gnorm 0.137 3.17s mem 81.1GB +step 2769/5000 loss 0.2753 (w 0.2307 mse 0.2368 t 927 new 0.15) lr 1.00e-05 gnorm 0.139 3.13s mem 81.1GB +step 2770/5000 loss 0.1450 (w 0.2329 mse 0.2457 t 865 new 0.27) lr 1.00e-05 gnorm 0.114 3.27s mem 81.1GB +step 2771/5000 loss 0.2257 (w 0.1967 mse 0.2057 t 904 new 0.12) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +step 2772/5000 loss 0.2815 (w 0.2678 mse 0.2771 t 910 new 0.19) lr 1.00e-05 gnorm 0.262 2.83s mem 81.1GB +step 2773/5000 loss 0.3516 (w 0.4590 mse 0.4553 t 297 new 0.12) lr 1.00e-05 gnorm 0.205 3.17s mem 81.1GB +step 2774/5000 loss 0.2614 (w 0.2016 mse 0.2160 t 954 new 0.22) lr 1.00e-05 gnorm 0.116 2.84s mem 81.1GB +step 2775/5000 loss 0.2419 (w 0.2377 mse 0.2457 t 792 new 0.17) lr 1.00e-05 gnorm 0.127 3.06s mem 81.1GB +step 2776/5000 loss 0.3144 (w 0.2796 mse 0.2872 t 924 new 0.26) lr 1.00e-05 gnorm 0.126 3.20s mem 81.1GB +step 2777/5000 loss 0.1939 (w 0.2664 mse 0.2748 t 911 new 0.19) lr 1.00e-05 gnorm 0.212 2.83s mem 81.1GB +step 2778/5000 loss 0.2973 (w 0.3762 mse 0.3922 t 947 new 0.17) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +step 2779/5000 loss 0.2496 (w 0.3789 mse 0.4014 t 238 new 0.28) lr 1.00e-05 gnorm 0.160 3.45s mem 81.1GB +step 2780/5000 loss 0.2468 (w 0.2514 mse 0.2645 t 898 new 0.17) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 2781/5000 loss 0.2848 (w 0.2801 mse 0.2920 t 949 new 0.18) lr 1.00e-05 gnorm 0.106 3.08s mem 81.1GB +step 2782/5000 loss 0.2762 (w 0.2597 mse 0.2840 t 974 new 0.10) lr 1.00e-05 gnorm 1.115 3.40s mem 81.1GB +step 2783/5000 loss 0.4001 (w 0.3286 mse 0.3346 t 440 new 0.14) lr 1.00e-05 gnorm 0.109 2.83s mem 81.1GB +step 2784/5000 loss 0.1327 (w 0.2409 mse 0.2457 t 913 new 0.15) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +step 2785/5000 loss 0.4609 (w 0.3701 mse 0.3764 t 310 new 0.19) lr 1.00e-05 gnorm 0.265 3.10s mem 81.1GB +step 2786/5000 loss 0.3119 (w 0.2813 mse 0.2883 t 827 new 0.24) lr 1.00e-05 gnorm 0.115 3.05s mem 81.1GB +step 2787/5000 loss 0.3751 (w 0.2096 mse 0.2214 t 717 new 0.23) lr 1.00e-05 gnorm 0.236 2.84s mem 81.1GB +step 2788/5000 loss 0.2250 (w 0.3183 mse 0.3410 t 982 new 0.23) lr 1.00e-05 gnorm 0.134 3.42s mem 81.1GB +step 2789/5000 loss 0.3325 (w 0.2620 mse 0.2627 t 910 new 0.21) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +step 2790/5000 loss 0.2735 (w 0.1878 mse 0.2065 t 800 new 0.24) lr 1.00e-05 gnorm 0.148 2.84s mem 81.1GB +step 2791/5000 loss 0.1819 (w 0.2267 mse 0.2368 t 977 new 0.22) lr 1.00e-05 gnorm 0.116 3.12s mem 81.1GB +step 2792/5000 loss 0.3471 (w 0.1777 mse 0.1914 t 886 new 0.20) lr 1.00e-05 gnorm 0.131 3.04s mem 81.1GB +step 2793/5000 loss 0.2732 (w 0.2487 mse 0.2556 t 960 new 0.26) lr 1.00e-05 gnorm 0.129 2.82s mem 81.1GB +step 2794/5000 loss 0.2428 (w 0.3082 mse 0.3163 t 808 new 0.17) lr 1.00e-05 gnorm 0.098 3.41s mem 81.1GB +step 2795/5000 loss 0.2905 (w 0.3791 mse 0.3928 t 972 new 0.13) lr 1.00e-05 gnorm 0.238 2.82s mem 81.1GB +step 2796/5000 loss 0.4422 (w 0.2178 mse 0.2288 t 722 new 0.22) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +step 2797/5000 loss 0.2398 (w 0.3330 mse 0.3369 t 968 new 0.14) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +step 2798/5000 loss 0.3278 (w 0.4190 mse 0.4101 t 978 new 0.22) lr 1.00e-05 gnorm 0.189 3.06s mem 81.1GB +step 2799/5000 loss 0.3150 (w 0.2123 mse 0.2296 t 781 new 0.22) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +step 2800/5000 loss 0.2112 (w 0.1537 mse 0.1743 t 492 new 0.26) lr 1.00e-05 gnorm 0.125 3.43s mem 81.1GB +step 2801/5000 loss 0.3218 (w 0.2314 mse 0.2541 t 809 new 0.22) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 2802/5000 loss 0.3998 (w 0.3552 mse 0.3609 t 653 new 0.22) lr 1.00e-05 gnorm 0.131 3.13s mem 81.1GB +step 2803/5000 loss 0.2196 (w 0.3852 mse 0.4068 t 238 new 0.17) lr 1.00e-05 gnorm 0.134 3.17s mem 81.1GB +step 2804/5000 loss 0.2773 (w 0.2118 mse 0.2269 t 725 new 0.25) lr 1.00e-05 gnorm 0.181 3.06s mem 81.1GB +step 2805/5000 loss 0.3057 (w 0.4908 mse 0.4837 t 998 new 0.21) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +step 2806/5000 loss 0.2554 (w 0.5157 mse 0.5063 t 988 new 0.22) lr 1.00e-05 gnorm 0.117 3.27s mem 81.1GB +step 2807/5000 loss 0.2909 (w 0.2895 mse 0.3048 t 623 new 0.21) lr 1.00e-05 gnorm 0.104 2.82s mem 81.1GB +step 2808/5000 loss 0.1286 (w 0.2048 mse 0.2113 t 914 new 0.21) lr 1.00e-05 gnorm 0.118 3.14s mem 81.1GB +step 2809/5000 loss 0.5996 (w 0.3789 mse 0.3827 t 440 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +step 2810/5000 loss 0.3765 (w 0.2436 mse 0.2466 t 677 new 0.22) lr 1.00e-05 gnorm 0.097 3.12s mem 81.1GB +step 2811/5000 loss 0.3902 (w 0.2815 mse 0.2889 t 975 new 0.20) lr 1.00e-05 gnorm 0.259 3.09s mem 81.1GB +step 2812/5000 loss 0.4378 (w 0.2819 mse 0.2842 t 888 new 0.21) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +step 2813/5000 loss 0.4071 (w 0.2804 mse 0.2869 t 865 new 0.16) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +step 2814/5000 loss 0.4235 (w 0.2952 mse 0.3063 t 434 new 0.19) lr 1.00e-05 gnorm 0.123 3.50s mem 81.1GB +step 2815/5000 loss 0.3099 (w 0.3221 mse 0.3295 t 557 new 0.18) lr 1.00e-05 gnorm 0.106 2.83s mem 81.1GB +step 2816/5000 loss 0.1350 (w 0.1948 mse 0.2086 t 936 new 0.15) lr 1.00e-05 gnorm 0.234 3.12s mem 81.1GB +step 2817/5000 loss 0.2709 (w 0.2060 mse 0.2230 t 927 new 0.22) lr 1.00e-05 gnorm 0.188 3.28s mem 81.1GB +step 2818/5000 loss 0.2700 (w 0.2931 mse 0.3058 t 765 new 0.20) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +step 2819/5000 loss 0.2373 (w 0.2211 mse 0.2339 t 932 new 0.18) lr 1.00e-05 gnorm 0.162 2.82s mem 81.1GB +step 2820/5000 loss 0.1237 (w 0.2613 mse 0.2619 t 933 new 0.21) lr 1.00e-05 gnorm 0.123 3.53s mem 81.1GB +step 2821/5000 loss 0.3953 (w 0.2873 mse 0.2878 t 729 new 0.18) lr 1.00e-05 gnorm 0.250 3.12s mem 81.1GB +step 2822/5000 loss 0.2636 (w 0.3188 mse 0.3365 t 401 new 0.19) lr 1.00e-05 gnorm 1.777 2.83s mem 81.1GB +step 2823/5000 loss 0.3851 (w 0.4291 mse 0.4465 t 1000 new 0.23) lr 1.00e-05 gnorm 0.176 3.31s mem 81.1GB +step 2824/5000 loss 0.3378 (w 0.3396 mse 0.3538 t 535 new 0.17) lr 1.00e-05 gnorm 0.174 3.09s mem 81.1GB +step 2825/5000 loss 0.3006 (w 0.3354 mse 0.3389 t 564 new 0.24) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +step 2826/5000 loss 0.4178 (w 0.3238 mse 0.3197 t 557 new 0.21) lr 1.00e-05 gnorm 0.126 3.25s mem 81.1GB +step 2827/5000 loss 0.3110 (w 0.3279 mse 0.3280 t 617 new 0.14) lr 1.00e-05 gnorm 0.147 3.13s mem 81.1GB +step 2828/5000 loss 0.4972 (w 0.4437 mse 0.4496 t 364 new 0.14) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +step 2829/5000 loss 0.3109 (w 0.2829 mse 0.2857 t 703 new 0.20) lr 1.00e-05 gnorm 0.163 3.34s mem 81.1GB +step 2830/5000 loss 0.3767 (w 0.2560 mse 0.2540 t 840 new 0.23) lr 1.00e-05 gnorm 0.160 3.13s mem 81.1GB +step 2831/5000 loss 0.2679 (w 0.3714 mse 0.3877 t 975 new 0.17) lr 1.00e-05 gnorm 0.118 3.14s mem 81.1GB +step 2832/5000 loss 0.1657 (w 0.2613 mse 0.2847 t 985 new 0.27) lr 1.00e-05 gnorm 0.526 3.25s mem 81.1GB +step 2833/5000 loss 0.3003 (w 0.3008 mse 0.2951 t 941 new 0.15) lr 1.00e-05 gnorm 0.112 3.07s mem 81.1GB +step 2834/5000 loss 0.4598 (w 0.2662 mse 0.2683 t 702 new 0.13) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +step 2835/5000 loss 0.4979 (w 0.2506 mse 0.2736 t 702 new 0.22) lr 1.00e-05 gnorm 0.119 3.36s mem 81.1GB +step 2836/5000 loss 0.3075 (w 0.3603 mse 0.3537 t 936 new 0.24) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 2837/5000 loss 0.3994 (w 0.2269 mse 0.2292 t 799 new 0.21) lr 1.00e-05 gnorm 0.146 3.05s mem 81.1GB +step 2838/5000 loss 0.1987 (w 0.2301 mse 0.2379 t 933 new 0.23) lr 1.00e-05 gnorm 0.126 3.21s mem 81.1GB +step 2839/5000 loss 0.4009 (w 0.2651 mse 0.2712 t 865 new 0.20) lr 1.00e-05 gnorm 0.133 3.10s mem 81.1GB +step 2840/5000 loss 0.1134 (w 0.2903 mse 0.2878 t 943 new 0.13) lr 1.00e-05 gnorm 0.122 3.12s mem 81.1GB +step 2841/5000 loss 0.2556 (w 0.2023 mse 0.2244 t 936 new 0.23) lr 1.00e-05 gnorm 0.138 3.35s mem 81.1GB +step 2842/5000 loss 0.2941 (w 0.2089 mse 0.2173 t 870 new 0.24) lr 1.00e-05 gnorm 0.157 2.84s mem 81.1GB +step 2843/5000 loss 0.3005 (w 0.4843 mse 0.4943 t 988 new 0.20) lr 1.00e-05 gnorm 0.120 3.06s mem 81.1GB +step 2844/5000 loss 0.3491 (w 0.2064 mse 0.2160 t 775 new 0.17) lr 1.00e-05 gnorm 0.113 3.19s mem 81.1GB +step 2845/5000 loss 0.3738 (w 0.2659 mse 0.2766 t 726 new 0.22) lr 1.00e-05 gnorm 0.138 3.20s mem 81.1GB +step 2846/5000 loss 0.2158 (w 0.2827 mse 0.2861 t 931 new 0.27) lr 1.00e-05 gnorm 0.150 3.10s mem 81.1GB +step 2847/5000 loss 0.2515 (w 0.4335 mse 0.4296 t 983 new 0.17) lr 1.00e-05 gnorm 0.155 3.29s mem 81.1GB +step 2848/5000 loss 0.2390 (w 0.2453 mse 0.2535 t 889 new 0.20) lr 1.00e-05 gnorm 0.680 2.84s mem 81.1GB +step 2849/5000 loss 0.2644 (w 0.4346 mse 0.4402 t 999 new 0.24) lr 1.00e-05 gnorm 0.122 3.06s mem 81.1GB +step 2850/5000 loss 0.2700 (w 0.2978 mse 0.3038 t 974 new 0.21) lr 1.00e-05 gnorm 0.145 3.23s mem 81.1GB +step 2851/5000 loss 0.2498 (w 0.3035 mse 0.3005 t 872 new 0.22) lr 1.00e-05 gnorm 0.139 3.13s mem 81.1GB +step 2852/5000 loss 0.2010 (w 0.2343 mse 0.2460 t 866 new 0.21) lr 1.00e-05 gnorm 0.197 3.12s mem 81.1GB +step 2853/5000 loss 0.2238 (w 0.2436 mse 0.2545 t 887 new 0.21) lr 1.00e-05 gnorm 0.250 3.08s mem 81.1GB +step 2854/5000 loss 0.4694 (w 0.3460 mse 0.3424 t 462 new 0.15) lr 1.00e-05 gnorm 0.117 2.83s mem 81.1GB +step 2855/5000 loss 0.4569 (w 0.2077 mse 0.2217 t 821 new 0.15) lr 1.00e-05 gnorm 0.144 3.06s mem 81.1GB +step 2856/5000 loss 0.3311 (w 0.3591 mse 0.3750 t 473 new 0.27) lr 1.00e-05 gnorm 0.094 3.22s mem 81.1GB +step 2857/5000 loss 0.4763 (w 0.2851 mse 0.3049 t 440 new 0.24) lr 1.00e-05 gnorm 0.129 3.10s mem 81.1GB +step 2858/5000 loss 0.3201 (w 0.3115 mse 0.3112 t 923 new 0.22) lr 1.00e-05 gnorm 0.152 3.09s mem 81.1GB +step 2859/5000 loss 0.3246 (w 0.3298 mse 0.3306 t 892 new 0.23) lr 1.00e-05 gnorm 0.109 3.07s mem 81.1GB +step 2860/5000 loss 0.3623 (w 0.3224 mse 0.3466 t 973 new 0.21) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +step 2861/5000 loss 0.3252 (w 0.2605 mse 0.2646 t 838 new 0.23) lr 1.00e-05 gnorm 0.130 3.05s mem 81.1GB +step 2862/5000 loss 0.3136 (w 0.3425 mse 0.3444 t 933 new 0.16) lr 1.00e-05 gnorm 0.096 3.19s mem 81.1GB +step 2863/5000 loss 0.3829 (w 0.2357 mse 0.2634 t 967 new 0.21) lr 1.00e-05 gnorm 0.153 3.14s mem 81.1GB +step 2864/5000 loss 0.2445 (w 0.2756 mse 0.2790 t 903 new 0.23) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +step 2865/5000 loss 0.3007 (w 0.2547 mse 0.2749 t 562 new 0.21) lr 1.00e-05 gnorm 0.119 3.07s mem 81.1GB +step 2866/5000 loss 0.4012 (w 0.2362 mse 0.2440 t 834 new 0.16) lr 1.00e-05 gnorm 0.110 2.84s mem 81.1GB +step 2867/5000 loss 0.2764 (w 0.2432 mse 0.2710 t 978 new 0.22) lr 1.00e-05 gnorm 0.127 3.08s mem 81.1GB +step 2868/5000 loss 0.2750 (w 0.1971 mse 0.2024 t 802 new 0.13) lr 1.00e-05 gnorm 0.145 3.21s mem 81.1GB +step 2869/5000 loss 0.2857 (w 0.4071 mse 0.3999 t 940 new 0.17) lr 1.00e-05 gnorm 0.289 2.84s mem 81.1GB +step 2870/5000 loss 0.2765 (w 0.2368 mse 0.2488 t 983 new 0.21) lr 1.00e-05 gnorm 0.192 3.35s mem 81.1GB +step 2871/5000 loss 0.4045 (w 0.3023 mse 0.3007 t 753 new 0.17) lr 1.00e-05 gnorm 0.204 3.17s mem 81.1GB +step 2872/5000 loss 0.3365 (w 0.3013 mse 0.2935 t 923 new 0.21) lr 1.00e-05 gnorm 0.152 3.07s mem 81.1GB +step 2873/5000 loss 0.3462 (w 0.3344 mse 0.3339 t 921 new 0.24) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +step 2874/5000 loss 0.1354 (w 0.3078 mse 0.3120 t 949 new 0.26) lr 1.00e-05 gnorm 0.121 3.51s mem 81.1GB +step 2875/5000 loss 0.4511 (w 0.2898 mse 0.2853 t 694 new 0.21) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +step 2876/5000 loss 0.2520 (w 0.2793 mse 0.3083 t 953 new 0.19) lr 1.00e-05 gnorm 0.120 3.38s mem 81.1GB +step 2877/5000 loss 0.1925 (w 0.2424 mse 0.2612 t 821 new 0.19) lr 1.00e-05 gnorm 0.127 2.85s mem 81.1GB +step 2878/5000 loss 0.2001 (w 0.3752 mse 0.3823 t 954 new 0.23) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +step 2879/5000 loss 0.2354 (w 0.3210 mse 0.3251 t 974 new 0.22) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +step 2880/5000 loss 0.4476 (w 0.2319 mse 0.2544 t 981 new 0.11) lr 1.00e-05 gnorm 0.138 3.58s mem 81.1GB +step 2881/5000 loss 0.2385 (w 0.1756 mse 0.1900 t 972 new 0.25) lr 1.00e-05 gnorm 0.155 2.83s mem 81.1GB +step 2882/5000 loss 0.1900 (w 0.2100 mse 0.2238 t 858 new 0.15) lr 1.00e-05 gnorm 0.260 3.43s mem 81.1GB +step 2883/5000 loss 0.1881 (w 0.2508 mse 0.2542 t 961 new 0.16) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +step 2884/5000 loss 0.1524 (w 0.2978 mse 0.3027 t 991 new 0.24) lr 1.00e-05 gnorm 0.522 2.83s mem 81.1GB +step 2885/5000 loss 0.3296 (w 0.3442 mse 0.3521 t 992 new 0.18) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +step 2886/5000 loss 0.2926 (w 0.2034 mse 0.2034 t 901 new 0.00) lr 1.00e-05 gnorm 0.151 3.32s mem 81.1GB +step 2887/5000 loss 0.2747 (w 0.2624 mse 0.2797 t 979 new 0.24) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +step 2888/5000 loss 0.4502 (w 0.3279 mse 0.3352 t 830 new 0.18) lr 1.00e-05 gnorm 0.330 3.11s mem 81.1GB +step 2889/5000 loss 0.2516 (w 0.2929 mse 0.2950 t 921 new 0.22) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +step 2890/5000 loss 0.2050 (w 0.2743 mse 0.2898 t 748 new 0.14) lr 1.00e-05 gnorm 0.105 3.12s mem 81.1GB +step 2891/5000 loss 0.4818 (w 0.5739 mse 0.6024 t 134 new 0.16) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +step 2892/5000 loss 0.1914 (w 0.3258 mse 0.3362 t 979 new 0.22) lr 1.00e-05 gnorm 0.133 3.32s mem 81.1GB +step 2893/5000 loss 0.1569 (w 0.2110 mse 0.2180 t 926 new 0.18) lr 1.00e-05 gnorm 0.113 3.15s mem 81.1GB +step 2894/5000 loss 0.2032 (w 0.2877 mse 0.2756 t 974 new 0.11) lr 1.00e-05 gnorm 0.163 3.11s mem 81.1GB +step 2895/5000 loss 0.3364 (w 0.1743 mse 0.1965 t 910 new 0.17) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +step 2896/5000 loss 0.1564 (w 0.3521 mse 0.3553 t 993 new 0.24) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +step 2897/5000 loss 0.2593 (w 0.2167 mse 0.2268 t 997 new 0.22) lr 1.00e-05 gnorm 0.146 3.29s mem 81.1GB +step 2898/5000 loss 0.4339 (w 0.2926 mse 0.2937 t 762 new 0.10) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +step 2899/5000 loss 0.3356 (w 0.3124 mse 0.3235 t 709 new 0.18) lr 1.00e-05 gnorm 0.127 3.12s mem 81.1GB +step 2900/5000 loss 0.3466 (w 0.3071 mse 0.3062 t 877 new 0.19) lr 1.00e-05 gnorm 0.217 3.07s mem 81.1GB +step 2901/5000 loss 0.1515 (w 0.3190 mse 0.3319 t 984 new 0.28) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +step 2902/5000 loss 0.3188 (w 0.3953 mse 0.3977 t 244 new 0.01) lr 1.00e-05 gnorm 0.100 3.12s mem 81.1GB +step 2903/5000 loss 0.3832 (w 0.4913 mse 0.4835 t 981 new 0.21) lr 1.00e-05 gnorm 0.213 3.28s mem 81.1GB +step 2904/5000 loss 0.3364 (w 0.1837 mse 0.1922 t 998 new 0.14) lr 1.00e-05 gnorm 0.196 3.11s mem 81.1GB +step 2905/5000 loss 0.2152 (w 0.2895 mse 0.2902 t 993 new 0.24) lr 1.00e-05 gnorm 0.159 3.08s mem 81.1GB +step 2906/5000 loss 0.1625 (w 0.2774 mse 0.2826 t 892 new 0.09) lr 1.00e-05 gnorm 0.150 3.10s mem 81.1GB +step 2907/5000 loss 0.0484 (w 0.3125 mse 0.3451 t 999 new 0.17) lr 1.00e-05 gnorm 0.105 3.05s mem 81.1GB +step 2908/5000 loss 0.1457 (w 0.2701 mse 0.2750 t 1000 new 0.08) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +step 2909/5000 loss 0.2984 (w 0.2973 mse 0.3052 t 875 new 0.20) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +step 2910/5000 loss 0.2233 (w 0.1865 mse 0.2144 t 981 new 0.16) lr 1.00e-05 gnorm 0.115 3.04s mem 81.1GB +step 2911/5000 loss 0.2757 (w 0.2222 mse 0.2515 t 926 new 0.24) lr 1.00e-05 gnorm 0.111 3.41s mem 81.1GB +step 2912/5000 loss 0.4092 (w 0.1970 mse 0.2097 t 557 new 0.09) lr 1.00e-05 gnorm 0.189 2.83s mem 81.1GB +step 2913/5000 loss 0.1710 (w 0.3133 mse 0.3105 t 768 new 0.24) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +step 2914/5000 loss 0.1577 (w 0.3748 mse 0.3910 t 946 new 0.19) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +step 2915/5000 loss 0.3943 (w 0.3222 mse 0.3326 t 748 new 0.23) lr 1.00e-05 gnorm 0.172 3.14s mem 81.1GB +step 2916/5000 loss 0.2566 (w 0.3673 mse 0.3602 t 957 new 0.26) lr 1.00e-05 gnorm 0.116 3.08s mem 81.1GB +step 2917/5000 loss 0.2861 (w 0.2652 mse 0.2741 t 850 new 0.22) lr 1.00e-05 gnorm 0.198 3.32s mem 81.1GB +step 2918/5000 loss 0.2747 (w 0.3227 mse 0.3246 t 944 new 0.16) lr 1.00e-05 gnorm 0.104 2.83s mem 81.1GB +step 2919/5000 loss 0.2583 (w 0.3699 mse 0.3588 t 988 new 0.23) lr 1.00e-05 gnorm 0.201 3.11s mem 81.1GB +step 2920/5000 loss 0.3455 (w 0.3880 mse 0.3923 t 967 new 0.12) lr 1.00e-05 gnorm 0.209 2.83s mem 81.1GB +step 2921/5000 loss 0.1983 (w 0.1919 mse 0.1996 t 923 new 0.11) lr 1.00e-05 gnorm 0.147 3.33s mem 81.1GB +step 2922/5000 loss 0.4018 (w 0.2109 mse 0.2354 t 677 new 0.19) lr 1.00e-05 gnorm 0.156 3.14s mem 81.1GB +step 2923/5000 loss 0.4392 (w 0.1880 mse 0.2094 t 815 new 0.27) lr 1.00e-05 gnorm 0.220 3.32s mem 81.1GB +step 2924/5000 loss 0.5513 (w 0.3622 mse 0.3612 t 390 new 0.22) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +step 2925/5000 loss 0.4026 (w 0.2559 mse 0.2594 t 885 new 0.14) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +step 2926/5000 loss 0.2951 (w 0.1980 mse 0.2099 t 790 new 0.23) lr 1.00e-05 gnorm 0.395 2.84s mem 81.1GB +step 2927/5000 loss 0.2852 (w 0.2817 mse 0.2821 t 910 new 0.21) lr 1.00e-05 gnorm 0.318 3.41s mem 81.1GB +step 2928/5000 loss 0.2930 (w 0.2125 mse 0.2249 t 963 new 0.08) lr 1.00e-05 gnorm 0.113 3.05s mem 81.1GB +step 2929/5000 loss 0.1879 (w 0.2791 mse 0.2943 t 927 new 0.16) lr 1.00e-05 gnorm 0.140 3.38s mem 81.1GB +step 2930/5000 loss 0.4309 (w 0.4269 mse 0.4211 t 995 new 0.25) lr 1.00e-05 gnorm 0.422 2.82s mem 81.1GB +step 2931/5000 loss 0.3497 (w 0.2052 mse 0.2108 t 768 new 0.25) lr 1.00e-05 gnorm 0.178 3.10s mem 81.1GB +step 2932/5000 loss 0.2012 (w 0.3437 mse 0.3481 t 978 new 0.24) lr 1.00e-05 gnorm 0.276 2.82s mem 81.1GB +step 2933/5000 loss 0.2324 (w 0.2013 mse 0.2221 t 873 new 0.24) lr 1.00e-05 gnorm 0.136 3.33s mem 81.1GB +step 2934/5000 loss 0.3972 (w 0.2744 mse 0.2728 t 584 new 0.17) lr 1.00e-05 gnorm 0.233 3.13s mem 81.1GB +step 2935/5000 loss 0.3002 (w 0.2381 mse 0.2567 t 566 new 0.26) lr 1.00e-05 gnorm 0.148 3.07s mem 81.1GB +step 2936/5000 loss 0.1452 (w 0.2389 mse 0.2450 t 817 new 0.19) lr 1.00e-05 gnorm 0.132 3.04s mem 81.1GB +step 2937/5000 loss 0.3445 (w 0.3072 mse 0.3122 t 666 new 0.30) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +step 2938/5000 loss 0.1891 (w 0.1865 mse 0.2133 t 951 new 0.20) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +step 2939/5000 loss 0.2582 (w 0.2406 mse 0.2659 t 955 new 0.23) lr 1.00e-05 gnorm 0.131 3.16s mem 81.1GB +step 2940/5000 loss 0.4623 (w 0.3337 mse 0.3408 t 323 new 0.17) lr 1.00e-05 gnorm 0.112 3.44s mem 81.1GB +step 2941/5000 loss 0.1353 (w 0.2883 mse 0.3054 t 951 new 0.22) lr 1.00e-05 gnorm 0.224 3.07s mem 81.1GB +step 2942/5000 loss 0.2354 (w 0.3638 mse 0.3621 t 971 new 0.20) lr 1.00e-05 gnorm 0.134 3.11s mem 81.1GB +step 2943/5000 loss 0.2142 (w 0.3373 mse 0.3545 t 988 new 0.20) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +step 2944/5000 loss 0.4666 (w 0.4210 mse 0.4223 t 998 new 0.18) lr 1.00e-05 gnorm 0.150 3.30s mem 81.1GB +step 2945/5000 loss 0.3705 (w 0.2299 mse 0.2497 t 890 new 0.18) lr 1.00e-05 gnorm 0.130 3.04s mem 81.1GB +step 2946/5000 loss 0.2809 (w 0.3529 mse 0.3476 t 961 new 0.21) lr 1.00e-05 gnorm 0.172 3.36s mem 81.1GB +step 2947/5000 loss 0.2666 (w 0.2014 mse 0.2117 t 693 new 0.17) lr 1.00e-05 gnorm 0.129 3.26s mem 81.1GB +step 2948/5000 loss 0.1907 (w 0.3633 mse 0.3600 t 921 new 0.18) lr 1.00e-05 gnorm 0.164 3.13s mem 81.1GB +step 2949/5000 loss 0.3253 (w 0.3565 mse 0.3458 t 934 new 0.15) lr 1.00e-05 gnorm 0.202 2.84s mem 81.1GB +step 2950/5000 loss 0.2298 (w 0.2869 mse 0.3029 t 991 new 0.18) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +step 2951/5000 loss 0.2089 (w 0.2585 mse 0.2582 t 997 new 0.22) lr 1.00e-05 gnorm 0.646 3.10s mem 81.1GB +step 2952/5000 loss 0.3090 (w 0.2342 mse 0.2529 t 965 new 0.13) lr 1.00e-05 gnorm 0.105 3.39s mem 81.1GB +step 2953/5000 loss 0.2868 (w 0.3267 mse 0.3317 t 916 new 0.17) lr 1.00e-05 gnorm 0.282 3.27s mem 81.1GB +step 2954/5000 loss 0.4351 (w 0.1988 mse 0.2038 t 816 new 0.22) lr 1.00e-05 gnorm 0.134 3.15s mem 81.1GB +step 2955/5000 loss 0.2210 (w 0.3651 mse 0.3647 t 899 new 0.18) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +step 2956/5000 loss 0.1928 (w 0.3796 mse 0.3846 t 964 new 0.21) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +step 2957/5000 loss 0.2090 (w 0.2984 mse 0.3062 t 988 new 0.17) lr 1.00e-05 gnorm 0.174 2.83s mem 81.1GB +step 2958/5000 loss 0.3314 (w 0.4164 mse 0.4121 t 434 new 0.19) lr 1.00e-05 gnorm 0.148 3.41s mem 81.1GB +step 2959/5000 loss 0.2759 (w 0.3787 mse 0.3724 t 962 new 0.24) lr 1.00e-05 gnorm 0.157 3.09s mem 81.1GB +step 2960/5000 loss 0.4644 (w 0.2790 mse 0.2883 t 975 new 0.20) lr 1.00e-05 gnorm 0.157 3.08s mem 81.1GB +step 2961/5000 loss 0.4711 (w 0.2370 mse 0.2515 t 850 new 0.22) lr 1.00e-05 gnorm 0.195 2.84s mem 81.1GB +step 2962/5000 loss 0.3772 (w 0.2267 mse 0.2530 t 521 new 0.20) lr 1.00e-05 gnorm 0.115 3.10s mem 81.1GB +step 2963/5000 loss 0.1728 (w 0.3237 mse 0.3315 t 958 new 0.21) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +step 2964/5000 loss 0.2485 (w 0.3090 mse 0.2980 t 981 new 0.25) lr 1.00e-05 gnorm 0.111 3.42s mem 81.1GB +step 2965/5000 loss 0.3214 (w 0.2167 mse 0.2315 t 887 new 0.10) lr 1.00e-05 gnorm 0.130 3.14s mem 81.1GB +step 2966/5000 loss 0.3658 (w 0.2973 mse 0.3067 t 961 new 0.16) lr 1.00e-05 gnorm 0.347 3.11s mem 81.1GB +step 2967/5000 loss 0.3895 (w 0.2550 mse 0.2559 t 731 new 0.21) lr 1.00e-05 gnorm 0.186 2.82s mem 81.1GB +step 2968/5000 loss 0.3381 (w 0.3599 mse 0.3716 t 328 new 0.18) lr 1.00e-05 gnorm 0.119 3.12s mem 81.1GB +step 2969/5000 loss 0.3212 (w 0.2861 mse 0.2851 t 872 new 0.18) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +step 2970/5000 loss 0.4384 (w 0.2216 mse 0.2431 t 653 new 0.23) lr 1.00e-05 gnorm 0.203 3.30s mem 81.1GB +step 2971/5000 loss 0.3197 (w 0.2649 mse 0.2778 t 988 new 0.19) lr 1.00e-05 gnorm 0.126 3.39s mem 81.1GB +step 2972/5000 loss 0.3065 (w 0.3301 mse 0.3305 t 942 new 0.19) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 2973/5000 loss 0.2163 (w 0.3458 mse 0.3507 t 631 new 0.30) lr 1.00e-05 gnorm 0.280 2.83s mem 81.1GB +step 2974/5000 loss 0.4036 (w 0.3112 mse 0.3181 t 459 new 0.19) lr 1.00e-05 gnorm 0.206 3.45s mem 81.1GB +step 2975/5000 loss 0.2519 (w 0.2420 mse 0.2443 t 999 new 0.18) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +step 2976/5000 loss 0.3179 (w 0.2607 mse 0.2810 t 911 new 0.23) lr 1.00e-05 gnorm 0.170 3.33s mem 81.1GB +step 2977/5000 loss 0.1860 (w 0.2802 mse 0.2825 t 976 new 0.12) lr 1.00e-05 gnorm 0.118 3.08s mem 81.1GB +step 2978/5000 loss 0.2395 (w 0.1884 mse 0.1937 t 797 new 0.06) lr 1.00e-05 gnorm 0.415 2.84s mem 81.1GB +step 2979/5000 loss 0.3715 (w 0.3095 mse 0.3130 t 804 new 0.26) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 2980/5000 loss 0.5029 (w 0.2417 mse 0.2474 t 757 new 0.23) lr 1.00e-05 gnorm 0.136 3.16s mem 81.1GB +step 2981/5000 loss 0.3261 (w 0.4497 mse 0.4383 t 1000 new 0.23) lr 1.00e-05 gnorm 0.124 3.01s mem 81.1GB +step 2982/5000 loss 0.1510 (w 0.2727 mse 0.2809 t 906 new 0.18) lr 1.00e-05 gnorm 0.148 3.09s mem 81.1GB +step 2983/5000 loss 0.1736 (w 0.5765 mse 0.6095 t 146 new 0.19) lr 1.00e-05 gnorm 0.264 3.33s mem 81.1GB +step 2984/5000 loss 0.2519 (w 0.2873 mse 0.2940 t 842 new 0.21) lr 1.00e-05 gnorm 0.178 2.84s mem 81.1GB +step 2985/5000 loss 0.2760 (w 0.3139 mse 0.3001 t 945 new 0.18) lr 1.00e-05 gnorm 0.110 2.84s mem 81.1GB +step 2986/5000 loss 0.2793 (w 0.3159 mse 0.3248 t 960 new 0.25) lr 1.00e-05 gnorm 0.103 3.15s mem 81.1GB +step 2987/5000 loss 0.3334 (w 0.3551 mse 0.3773 t 956 new 0.18) lr 1.00e-05 gnorm 0.117 3.04s mem 81.1GB +step 2988/5000 loss 0.4440 (w 0.2442 mse 0.2517 t 771 new 0.23) lr 1.00e-05 gnorm 0.118 3.37s mem 81.1GB +step 2989/5000 loss 0.3423 (w 0.3734 mse 0.4004 t 332 new 0.23) lr 1.00e-05 gnorm 0.099 3.08s mem 81.1GB +step 2990/5000 loss 0.3259 (w 0.2127 mse 0.2228 t 915 new 0.23) lr 1.00e-05 gnorm 0.164 2.82s mem 81.1GB +step 2991/5000 loss 0.2073 (w 0.1522 mse 0.1813 t 959 new 0.20) lr 1.00e-05 gnorm 0.113 3.35s mem 81.1GB +step 2992/5000 loss 0.3910 (w 0.2086 mse 0.2156 t 821 new 0.19) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +step 2993/5000 loss 0.1350 (w 0.3300 mse 0.3270 t 987 new 0.24) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +step 2994/5000 loss 0.1377 (w 0.3035 mse 0.3147 t 993 new 0.09) lr 1.00e-05 gnorm 0.097 3.29s mem 81.1GB +step 2995/5000 loss 0.2339 (w 0.2613 mse 0.2549 t 841 new 0.21) lr 1.00e-05 gnorm 0.145 3.14s mem 81.1GB +step 2996/5000 loss 0.3697 (w 0.3063 mse 0.3083 t 730 new 0.14) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +step 2997/5000 loss 0.2631 (w 0.3547 mse 0.3443 t 899 new 0.20) lr 1.00e-05 gnorm 0.202 3.17s mem 81.1GB +step 2998/5000 loss 0.4811 (w 0.2342 mse 0.2529 t 871 new 0.20) lr 1.00e-05 gnorm 0.191 3.07s mem 81.1GB +step 2999/5000 loss 0.3369 (w 0.4988 mse 0.4865 t 978 new 0.24) lr 1.00e-05 gnorm 0.143 3.24s mem 81.1GB +step 3000/5000 loss 0.2658 (w 0.3039 mse 0.3103 t 936 new 0.23) lr 1.00e-05 gnorm 0.208 3.33s mem 81.1GB +[val] step 3000 t=200: w=0.4594 mse=0.4776 (n=16) t=500: w=0.2790 mse=0.2939 (n=16) t=800: w=0.2352 mse=0.2470 (n=16) | mean w=0.3246 mse=0.3395 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step3000.safetensors 4093 个张量 37.98 GB +step 3001/5000 loss 0.2964 (w 0.3190 mse 0.3259 t 942 new 0.26) lr 1.00e-05 gnorm 0.164 3.07s mem 81.1GB +step 3002/5000 loss 0.2319 (w 0.2861 mse 0.2881 t 804 new 0.24) lr 1.00e-05 gnorm 0.947 2.83s mem 81.1GB +step 3003/5000 loss 0.2326 (w 0.2425 mse 0.2517 t 861 new 0.17) lr 1.00e-05 gnorm 0.117 3.34s mem 81.1GB +step 3004/5000 loss 0.0697 (w 0.2481 mse 0.2727 t 969 new 0.16) lr 1.00e-05 gnorm 0.101 2.82s mem 81.1GB +step 3005/5000 loss 0.2886 (w 0.3188 mse 0.3286 t 972 new 0.25) lr 1.00e-05 gnorm 0.140 3.56s mem 81.1GB +step 3006/5000 loss 0.2682 (w 0.2660 mse 0.2696 t 942 new 0.09) lr 1.00e-05 gnorm 0.179 2.83s mem 81.1GB +step 3007/5000 loss 0.2797 (w 0.2783 mse 0.2786 t 821 new 0.21) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +step 3008/5000 loss 0.2432 (w 0.2641 mse 0.2704 t 868 new 0.22) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 3009/5000 loss 0.1914 (w 0.3497 mse 0.3618 t 921 new 0.20) lr 1.00e-05 gnorm 0.127 3.38s mem 81.1GB +step 3010/5000 loss 0.3532 (w 0.2463 mse 0.2452 t 706 new 0.09) lr 1.00e-05 gnorm 0.175 2.83s mem 81.1GB +step 3011/5000 loss 0.3181 (w 0.3059 mse 0.3139 t 979 new 0.16) lr 1.00e-05 gnorm 0.196 3.37s mem 81.1GB +step 3012/5000 loss 0.2262 (w 0.2427 mse 0.2499 t 948 new 0.07) lr 1.00e-05 gnorm 0.617 2.84s mem 81.1GB +step 3013/5000 loss 0.2431 (w 0.2892 mse 0.2938 t 960 new 0.23) lr 1.00e-05 gnorm 0.117 3.09s mem 81.1GB +step 3014/5000 loss 0.4702 (w 0.2645 mse 0.2812 t 958 new 0.24) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +step 3015/5000 loss 0.2432 (w 0.2445 mse 0.2621 t 876 new 0.16) lr 1.00e-05 gnorm 0.121 3.31s mem 81.1GB +step 3016/5000 loss 0.3435 (w 0.2702 mse 0.2745 t 875 new 0.16) lr 1.00e-05 gnorm 0.117 3.05s mem 81.1GB +step 3017/5000 loss 0.2991 (w 0.3821 mse 0.4165 t 254 new 0.26) lr 1.00e-05 gnorm 0.162 3.34s mem 81.1GB +step 3018/5000 loss 0.3830 (w 0.2399 mse 0.2444 t 626 new 0.20) lr 1.00e-05 gnorm 0.126 2.83s mem 81.1GB +step 3019/5000 loss 0.2737 (w 0.2995 mse 0.2954 t 881 new 0.15) lr 1.00e-05 gnorm 0.169 3.07s mem 81.1GB +step 3020/5000 loss 0.3302 (w 0.2902 mse 0.2939 t 659 new 0.25) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +step 3021/5000 loss 0.4017 (w 0.3235 mse 0.3346 t 947 new 0.21) lr 1.00e-05 gnorm 0.135 3.35s mem 81.1GB +step 3022/5000 loss 0.2374 (w 0.2452 mse 0.2525 t 822 new 0.21) lr 1.00e-05 gnorm 0.159 3.07s mem 81.1GB +step 3023/5000 loss 0.1511 (w 0.2986 mse 0.3038 t 970 new 0.18) lr 1.00e-05 gnorm 0.146 3.09s mem 81.1GB +step 3024/5000 loss 0.4016 (w 0.2985 mse 0.2993 t 960 new 0.27) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +step 3025/5000 loss 0.2360 (w 0.4176 mse 0.4129 t 993 new 0.24) lr 1.00e-05 gnorm 0.126 3.07s mem 81.1GB +step 3026/5000 loss 0.1481 (w 0.2839 mse 0.3069 t 993 new 0.11) lr 1.00e-05 gnorm 0.149 3.09s mem 81.1GB +step 3027/5000 loss 0.3124 (w 0.2899 mse 0.3162 t 999 new 0.18) lr 1.00e-05 gnorm 0.110 3.07s mem 81.1GB +step 3028/5000 loss 0.2564 (w 0.3451 mse 0.3599 t 977 new 0.24) lr 1.00e-05 gnorm 0.135 3.36s mem 81.1GB +step 3029/5000 loss 0.2304 (w 0.1701 mse 0.1866 t 629 new 0.10) lr 1.00e-05 gnorm 0.228 3.13s mem 81.1GB +step 3030/5000 loss 0.1131 (w 0.3228 mse 0.3279 t 980 new 0.24) lr 1.00e-05 gnorm 0.101 2.84s mem 81.1GB +step 3031/5000 loss 0.2227 (w 0.2929 mse 0.2983 t 796 new 0.16) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +step 3032/5000 loss 0.2957 (w 0.2640 mse 0.2611 t 943 new 0.16) lr 1.00e-05 gnorm 0.141 3.13s mem 81.1GB +step 3033/5000 loss 0.1998 (w 0.3080 mse 0.3145 t 974 new 0.23) lr 1.00e-05 gnorm 0.246 3.06s mem 81.1GB +step 3034/5000 loss 0.1930 (w 0.2520 mse 0.2588 t 858 new 0.24) lr 1.00e-05 gnorm 0.150 3.35s mem 81.1GB +step 3035/5000 loss 0.2346 (w 0.3993 mse 0.4051 t 278 new 0.23) lr 1.00e-05 gnorm 0.123 3.05s mem 81.1GB +step 3036/5000 loss 0.3075 (w 0.3609 mse 0.3686 t 969 new 0.24) lr 1.00e-05 gnorm 0.160 2.82s mem 81.1GB +step 3037/5000 loss 0.3481 (w 0.2164 mse 0.2235 t 913 new 0.24) lr 1.00e-05 gnorm 0.124 3.17s mem 81.1GB +step 3038/5000 loss 0.2508 (w 0.3375 mse 0.3454 t 936 new 0.21) lr 1.00e-05 gnorm 0.099 3.14s mem 81.1GB +step 3039/5000 loss 0.2550 (w 0.3642 mse 0.3759 t 958 new 0.22) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +step 3040/5000 loss 0.2971 (w 0.1599 mse 0.1741 t 641 new 0.20) lr 1.00e-05 gnorm 0.155 3.37s mem 81.1GB +step 3041/5000 loss 0.1657 (w 0.2403 mse 0.2633 t 977 new 0.23) lr 1.00e-05 gnorm 0.137 3.09s mem 81.1GB +step 3042/5000 loss 0.2288 (w 0.3553 mse 0.3744 t 956 new 0.20) lr 1.00e-05 gnorm 0.140 3.09s mem 81.1GB +step 3043/5000 loss 0.3280 (w 0.3333 mse 0.3273 t 741 new 0.13) lr 1.00e-05 gnorm 0.125 2.83s mem 81.1GB +step 3044/5000 loss 0.2681 (w 0.2477 mse 0.2486 t 901 new 0.02) lr 1.00e-05 gnorm 0.125 3.08s mem 81.1GB +step 3045/5000 loss 0.2792 (w 0.2045 mse 0.2141 t 854 new 0.20) lr 1.00e-05 gnorm 0.124 3.35s mem 81.1GB +step 3046/5000 loss 0.4308 (w 0.3250 mse 0.3281 t 418 new 0.14) lr 1.00e-05 gnorm 0.184 3.36s mem 81.1GB +step 3047/5000 loss 0.2238 (w 0.2737 mse 0.2748 t 983 new 0.12) lr 1.00e-05 gnorm 0.186 3.09s mem 81.1GB +step 3048/5000 loss 0.2599 (w 0.3012 mse 0.3300 t 375 new 0.17) lr 1.00e-05 gnorm 0.146 3.14s mem 81.1GB +step 3049/5000 loss 0.4100 (w 0.3740 mse 0.3799 t 897 new 0.19) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +step 3050/5000 loss 0.1365 (w 0.2364 mse 0.2576 t 994 new 0.23) lr 1.00e-05 gnorm 0.108 3.10s mem 81.1GB +step 3051/5000 loss 0.2417 (w 0.2260 mse 0.2320 t 865 new 0.20) lr 1.00e-05 gnorm 0.150 3.40s mem 81.1GB +step 3052/5000 loss 0.3591 (w 0.2108 mse 0.2208 t 945 new 0.15) lr 1.00e-05 gnorm 0.129 2.86s mem 81.1GB +step 3053/5000 loss 0.2303 (w 0.3316 mse 0.3442 t 987 new 0.22) lr 1.00e-05 gnorm 0.112 3.15s mem 81.1GB +step 3054/5000 loss 0.3790 (w 0.3637 mse 0.3659 t 492 new 0.25) lr 1.00e-05 gnorm 0.112 3.10s mem 81.1GB +step 3055/5000 loss 0.2218 (w 0.3084 mse 0.3181 t 992 new 0.22) lr 1.00e-05 gnorm 0.534 2.85s mem 81.1GB +step 3056/5000 loss 0.3683 (w 0.2781 mse 0.2880 t 869 new 0.18) lr 1.00e-05 gnorm 0.120 3.17s mem 81.1GB +step 3057/5000 loss 0.4333 (w 0.2818 mse 0.2968 t 917 new 0.23) lr 1.00e-05 gnorm 0.115 3.37s mem 81.1GB +step 3058/5000 loss 0.2540 (w 0.3127 mse 0.3242 t 673 new 0.27) lr 1.00e-05 gnorm 0.160 3.09s mem 81.1GB +step 3059/5000 loss 0.3787 (w 0.3479 mse 0.3441 t 881 new 0.15) lr 1.00e-05 gnorm 0.183 2.84s mem 81.1GB +step 3060/5000 loss 0.2422 (w 0.3873 mse 0.3941 t 945 new 0.26) lr 1.00e-05 gnorm 0.125 3.13s mem 81.1GB +step 3061/5000 loss 0.3327 (w 0.2106 mse 0.2165 t 833 new 0.10) lr 1.00e-05 gnorm 0.107 3.10s mem 81.1GB +step 3062/5000 loss 0.2107 (w 0.2986 mse 0.3059 t 898 new 0.22) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 3063/5000 loss 0.4047 (w 0.2151 mse 0.2256 t 762 new 0.20) lr 1.00e-05 gnorm 0.126 3.38s mem 81.1GB +step 3064/5000 loss 0.2655 (w 0.2246 mse 0.2429 t 663 new 0.15) lr 1.00e-05 gnorm 0.116 3.09s mem 81.1GB +step 3065/5000 loss 0.2184 (w 0.2907 mse 0.3048 t 957 new 0.23) lr 1.00e-05 gnorm 0.240 3.09s mem 81.1GB +step 3066/5000 loss 0.3172 (w 0.3608 mse 0.3486 t 945 new 0.21) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +step 3067/5000 loss 0.1994 (w 0.3330 mse 0.3494 t 997 new 0.18) lr 1.00e-05 gnorm 0.089 3.11s mem 81.1GB +step 3068/5000 loss 0.1737 (w 0.2291 mse 0.2379 t 893 new 0.14) lr 1.00e-05 gnorm 0.287 2.84s mem 81.1GB +step 3069/5000 loss 0.2494 (w 0.2348 mse 0.2485 t 821 new 0.15) lr 1.00e-05 gnorm 0.109 3.36s mem 81.1GB +step 3070/5000 loss 0.4544 (w 0.3064 mse 0.3123 t 837 new 0.23) lr 1.00e-05 gnorm 0.157 3.29s mem 81.1GB +step 3071/5000 loss 0.1832 (w 0.2372 mse 0.2701 t 971 new 0.20) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 3072/5000 loss 0.3301 (w 0.3009 mse 0.3116 t 931 new 0.09) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +step 3073/5000 loss 0.4151 (w 0.5009 mse 0.5176 t 988 new 0.16) lr 1.00e-05 gnorm 0.139 3.17s mem 81.1GB +step 3074/5000 loss 0.2875 (w 0.2538 mse 0.2638 t 994 new 0.19) lr 1.00e-05 gnorm 0.164 3.12s mem 81.1GB +step 3075/5000 loss 0.3541 (w 0.3035 mse 0.2989 t 955 new 0.22) lr 1.00e-05 gnorm 0.114 3.11s mem 81.1GB +step 3076/5000 loss 0.3536 (w 0.2499 mse 0.2594 t 882 new 0.22) lr 1.00e-05 gnorm 0.113 3.13s mem 81.1GB +step 3077/5000 loss 0.2569 (w 0.3744 mse 0.3609 t 988 new 0.22) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +step 3078/5000 loss 0.3723 (w 0.3137 mse 0.3252 t 924 new 0.21) lr 1.00e-05 gnorm 0.290 2.85s mem 81.1GB +step 3079/5000 loss 0.3215 (w 0.2199 mse 0.2332 t 856 new 0.18) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +step 3080/5000 loss 0.2980 (w 0.2679 mse 0.2647 t 875 new 0.21) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +step 3081/5000 loss 0.3730 (w 0.2606 mse 0.2626 t 582 new 0.14) lr 1.00e-05 gnorm 0.156 3.06s mem 81.1GB +step 3082/5000 loss 0.1327 (w 0.2611 mse 0.2780 t 915 new 0.17) lr 1.00e-05 gnorm 0.106 3.15s mem 81.1GB +step 3083/5000 loss 0.1936 (w 0.2952 mse 0.3005 t 919 new 0.20) lr 1.00e-05 gnorm 0.105 3.11s mem 81.1GB +step 3084/5000 loss 0.2143 (w 0.2468 mse 0.2565 t 783 new 0.17) lr 1.00e-05 gnorm 0.133 2.85s mem 81.1GB +step 3085/5000 loss 0.3394 (w 0.3655 mse 0.3769 t 447 new 0.23) lr 1.00e-05 gnorm 0.157 3.16s mem 81.1GB +step 3086/5000 loss 0.3838 (w 0.2476 mse 0.2519 t 743 new 0.22) lr 1.00e-05 gnorm 0.196 3.11s mem 81.1GB +step 3087/5000 loss 0.2440 (w 0.4488 mse 0.4387 t 989 new 0.19) lr 1.00e-05 gnorm 0.124 3.32s mem 81.1GB +step 3088/5000 loss 0.4394 (w 0.2318 mse 0.2398 t 792 new 0.20) lr 1.00e-05 gnorm 0.143 3.21s mem 81.1GB +step 3089/5000 loss 0.1235 (w 0.2623 mse 0.2721 t 885 new 0.22) lr 1.00e-05 gnorm 0.135 3.07s mem 81.1GB +step 3090/5000 loss 0.3466 (w 0.1856 mse 0.1892 t 628 new 0.16) lr 1.00e-05 gnorm 0.089 3.11s mem 81.1GB +step 3091/5000 loss 0.2514 (w 0.2530 mse 0.2653 t 908 new 0.23) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +step 3092/5000 loss 0.2914 (w 0.2530 mse 0.2608 t 717 new 0.22) lr 1.00e-05 gnorm 0.135 3.32s mem 81.1GB +step 3093/5000 loss 0.2296 (w 0.2714 mse 0.2757 t 887 new 0.23) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +step 3094/5000 loss 0.2987 (w 0.2939 mse 0.3166 t 424 new 0.25) lr 1.00e-05 gnorm 0.133 3.14s mem 81.1GB +step 3095/5000 loss 0.1549 (w 0.4333 mse 0.4213 t 994 new 0.25) lr 1.00e-05 gnorm 0.104 3.06s mem 81.1GB +step 3096/5000 loss 0.3850 (w 0.2733 mse 0.2745 t 657 new 0.24) lr 1.00e-05 gnorm 0.122 3.13s mem 81.1GB +step 3097/5000 loss 0.2638 (w 0.2916 mse 0.2980 t 850 new 0.18) lr 1.00e-05 gnorm 0.209 2.84s mem 81.1GB +step 3098/5000 loss 0.2080 (w 0.3015 mse 0.3079 t 976 new 0.26) lr 1.00e-05 gnorm 0.104 3.43s mem 81.1GB +step 3099/5000 loss 0.1897 (w 0.3106 mse 0.3251 t 981 new 0.21) lr 1.00e-05 gnorm 0.124 3.08s mem 81.1GB +step 3100/5000 loss 0.3954 (w 0.3402 mse 0.3420 t 876 new 0.22) lr 1.00e-05 gnorm 0.148 3.06s mem 81.1GB +step 3101/5000 loss 0.2185 (w 0.2994 mse 0.2948 t 916 new 0.18) lr 1.00e-05 gnorm 0.263 3.10s mem 81.1GB +step 3102/5000 loss 0.1667 (w 0.1862 mse 0.2147 t 987 new 0.26) lr 1.00e-05 gnorm 0.115 3.16s mem 81.1GB +step 3103/5000 loss 0.1683 (w 0.3108 mse 0.3125 t 917 new 0.18) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +step 3104/5000 loss 0.3065 (w 0.2318 mse 0.2397 t 816 new 0.22) lr 1.00e-05 gnorm 0.192 3.37s mem 81.1GB +step 3105/5000 loss 0.3608 (w 0.3111 mse 0.3079 t 768 new 0.21) lr 1.00e-05 gnorm 0.158 3.12s mem 81.1GB +step 3106/5000 loss 0.3008 (w 0.2783 mse 0.2840 t 999 new 0.02) lr 1.00e-05 gnorm 0.174 3.42s mem 81.1GB +step 3107/5000 loss 0.1850 (w 0.2557 mse 0.2700 t 873 new 0.15) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +step 3108/5000 loss 0.3182 (w 0.2965 mse 0.2908 t 834 new 0.21) lr 1.00e-05 gnorm 0.164 3.15s mem 81.1GB +step 3109/5000 loss 0.1803 (w 0.2073 mse 0.2212 t 1000 new 0.24) lr 1.00e-05 gnorm 0.124 3.01s mem 81.1GB +step 3110/5000 loss 0.4276 (w 0.2695 mse 0.2802 t 668 new 0.21) lr 1.00e-05 gnorm 0.121 3.39s mem 81.1GB +step 3111/5000 loss 0.2295 (w 0.3222 mse 0.3377 t 938 new 0.25) lr 1.00e-05 gnorm 0.104 3.15s mem 81.1GB +step 3112/5000 loss 0.2642 (w 0.4158 mse 0.4236 t 971 new 0.22) lr 1.00e-05 gnorm 0.092 3.05s mem 81.1GB +step 3113/5000 loss 0.1763 (w 0.3268 mse 0.3209 t 863 new 0.21) lr 1.00e-05 gnorm 0.485 2.85s mem 81.1GB +step 3114/5000 loss 0.3714 (w 0.3108 mse 0.3098 t 901 new 0.18) lr 1.00e-05 gnorm 0.107 3.17s mem 81.1GB +step 3115/5000 loss 0.2233 (w 0.2814 mse 0.2950 t 973 new 0.18) lr 1.00e-05 gnorm 0.181 3.15s mem 81.1GB +step 3116/5000 loss 0.2021 (w 0.3857 mse 0.3887 t 962 new 0.22) lr 1.00e-05 gnorm 0.113 3.03s mem 81.1GB +step 3117/5000 loss 0.2372 (w 0.2871 mse 0.2994 t 996 new 0.12) lr 1.00e-05 gnorm 0.114 3.31s mem 81.1GB +step 3118/5000 loss 0.1701 (w 0.1818 mse 0.2060 t 991 new 0.14) lr 1.00e-05 gnorm 0.085 3.06s mem 81.1GB +step 3119/5000 loss 0.2216 (w 0.2761 mse 0.2766 t 915 new 0.19) lr 1.00e-05 gnorm 0.103 3.11s mem 81.1GB +step 3120/5000 loss 0.4052 (w 0.3189 mse 0.3274 t 506 new 0.23) lr 1.00e-05 gnorm 0.135 2.83s mem 81.1GB +step 3121/5000 loss 0.2332 (w 0.4256 mse 0.4425 t 990 new 0.25) lr 1.00e-05 gnorm 0.126 3.05s mem 81.1GB +step 3122/5000 loss 0.2556 (w 0.3075 mse 0.3036 t 923 new 0.23) lr 1.00e-05 gnorm 0.180 3.08s mem 81.1GB +step 3123/5000 loss 0.4274 (w 0.3693 mse 0.3745 t 386 new 0.22) lr 1.00e-05 gnorm 0.165 3.14s mem 81.1GB +step 3124/5000 loss 0.3391 (w 0.2903 mse 0.2881 t 914 new 0.21) lr 1.00e-05 gnorm 0.108 3.07s mem 81.1GB +step 3125/5000 loss 0.4453 (w 0.3230 mse 0.3155 t 943 new 0.17) lr 1.00e-05 gnorm 0.162 3.17s mem 81.1GB +step 3126/5000 loss 0.2597 (w 0.2939 mse 0.3011 t 656 new 0.25) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +step 3127/5000 loss 0.2722 (w 0.2416 mse 0.2567 t 865 new 0.24) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +step 3128/5000 loss 0.3720 (w 0.2430 mse 0.2540 t 899 new 0.27) lr 1.00e-05 gnorm 0.142 3.20s mem 81.1GB +step 3129/5000 loss 0.3008 (w 0.2150 mse 0.2291 t 607 new 0.21) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +step 3130/5000 loss 0.3551 (w 0.3241 mse 0.3260 t 946 new 0.15) lr 1.00e-05 gnorm 0.156 3.13s mem 81.1GB +step 3131/5000 loss 0.3489 (w 0.2794 mse 0.2784 t 907 new 0.21) lr 1.00e-05 gnorm 0.143 3.16s mem 81.1GB +step 3132/5000 loss 0.2846 (w 0.3382 mse 0.3457 t 607 new 0.23) lr 1.00e-05 gnorm 0.105 2.83s mem 81.1GB +step 3133/5000 loss 0.3622 (w 0.2504 mse 0.2742 t 705 new 0.15) lr 1.00e-05 gnorm 0.120 3.33s mem 81.1GB +step 3134/5000 loss 0.3163 (w 0.2240 mse 0.2483 t 379 new 0.23) lr 1.00e-05 gnorm 0.115 3.23s mem 81.1GB +step 3135/5000 loss 0.3058 (w 0.2647 mse 0.2797 t 839 new 0.18) lr 1.00e-05 gnorm 0.148 3.13s mem 81.1GB +step 3136/5000 loss 0.2089 (w 0.1699 mse 0.1931 t 937 new 0.22) lr 1.00e-05 gnorm 0.129 3.10s mem 81.1GB +step 3137/5000 loss 0.3759 (w 0.3858 mse 0.3889 t 537 new 0.06) lr 1.00e-05 gnorm 0.163 3.10s mem 81.1GB +step 3138/5000 loss 0.2903 (w 0.2737 mse 0.2771 t 948 new 0.19) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +step 3139/5000 loss 0.2557 (w 0.2334 mse 0.2619 t 948 new 0.17) lr 1.00e-05 gnorm 0.113 3.08s mem 81.1GB +step 3140/5000 loss 0.3651 (w 0.9800 mse 0.9937 t 1000 new 0.19) lr 1.00e-05 gnorm 0.116 3.39s mem 81.1GB +step 3141/5000 loss 0.3305 (w 0.6843 mse 0.6884 t 134 new 0.19) lr 1.00e-05 gnorm 0.146 2.85s mem 81.1GB +step 3142/5000 loss 0.4161 (w 0.4632 mse 0.4656 t 991 new 0.19) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +step 3143/5000 loss 0.1889 (w 0.3555 mse 0.3891 t 999 new 0.19) lr 1.00e-05 gnorm 0.143 3.18s mem 81.1GB +step 3144/5000 loss 0.2065 (w 0.2853 mse 0.3050 t 827 new 0.22) lr 1.00e-05 gnorm 0.090 2.83s mem 81.1GB +step 3145/5000 loss 0.2745 (w 0.2903 mse 0.2907 t 828 new 0.23) lr 1.00e-05 gnorm 0.143 3.10s mem 81.1GB +step 3146/5000 loss 0.3987 (w 0.2780 mse 0.2790 t 835 new 0.13) lr 1.00e-05 gnorm 0.139 3.30s mem 81.1GB +step 3147/5000 loss 0.3286 (w 0.2612 mse 0.2719 t 647 new 0.27) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 3148/5000 loss 0.3896 (w 0.4496 mse 0.4560 t 292 new 0.20) lr 1.00e-05 gnorm 0.127 3.42s mem 81.1GB +step 3149/5000 loss 0.1410 (w 0.2896 mse 0.3034 t 992 new 0.21) lr 1.00e-05 gnorm 0.333 2.84s mem 81.1GB +step 3150/5000 loss 0.2673 (w 0.3449 mse 0.3647 t 973 new 0.23) lr 1.00e-05 gnorm 0.117 3.06s mem 81.1GB +step 3151/5000 loss 0.4763 (w 0.5494 mse 0.5672 t 159 new 0.25) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +step 3152/5000 loss 0.2206 (w 0.2828 mse 0.3012 t 982 new 0.19) lr 1.00e-05 gnorm 0.127 3.29s mem 81.1GB +step 3153/5000 loss 0.4016 (w 0.3177 mse 0.3124 t 766 new 0.20) lr 1.00e-05 gnorm 0.200 2.85s mem 81.1GB +step 3154/5000 loss 0.2975 (w 0.3176 mse 0.3299 t 948 new 0.20) lr 1.00e-05 gnorm 0.127 3.46s mem 81.1GB +step 3155/5000 loss 0.4052 (w 0.3573 mse 0.3480 t 947 new 0.12) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +step 3156/5000 loss 0.2009 (w 0.3117 mse 0.3069 t 931 new 0.14) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +step 3157/5000 loss 0.2730 (w 0.4492 mse 0.4585 t 984 new 0.19) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +step 3158/5000 loss 0.2326 (w 0.2005 mse 0.2188 t 753 new 0.18) lr 1.00e-05 gnorm 0.119 3.38s mem 81.1GB +step 3159/5000 loss 0.2455 (w 0.2463 mse 0.2683 t 853 new 0.22) lr 1.00e-05 gnorm 0.112 3.14s mem 81.1GB +step 3160/5000 loss 0.1949 (w 0.2744 mse 0.2858 t 868 new 0.23) lr 1.00e-05 gnorm 0.323 3.31s mem 81.1GB +step 3161/5000 loss 0.2035 (w 0.3886 mse 0.4165 t 980 new 0.20) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +step 3162/5000 loss 0.3390 (w 0.2971 mse 0.3263 t 975 new 0.21) lr 1.00e-05 gnorm 0.180 3.38s mem 81.1GB +step 3163/5000 loss 0.3294 (w 0.2314 mse 0.2427 t 875 new 0.23) lr 1.00e-05 gnorm 0.129 3.03s mem 81.1GB +step 3164/5000 loss 0.1786 (w 0.3747 mse 0.3699 t 960 new 0.26) lr 1.00e-05 gnorm 0.101 3.12s mem 81.1GB +step 3165/5000 loss 0.3230 (w 0.2804 mse 0.2857 t 965 new 0.20) lr 1.00e-05 gnorm 0.108 3.04s mem 81.1GB +step 3166/5000 loss 0.3280 (w 0.3558 mse 0.3664 t 450 new 0.25) lr 1.00e-05 gnorm 0.126 3.12s mem 81.1GB +step 3167/5000 loss 0.2670 (w 0.3597 mse 0.3551 t 949 new 0.20) lr 1.00e-05 gnorm 0.356 2.83s mem 81.1GB +step 3168/5000 loss 0.1457 (w 0.2381 mse 0.2472 t 954 new 0.22) lr 1.00e-05 gnorm 0.097 3.28s mem 81.1GB +step 3169/5000 loss 0.4229 (w 0.2898 mse 0.3107 t 968 new 0.20) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +step 3170/5000 loss 0.3045 (w 0.3175 mse 0.3189 t 984 new 0.19) lr 1.00e-05 gnorm 0.152 3.13s mem 81.1GB +step 3171/5000 loss 0.2133 (w 0.3913 mse 0.3973 t 990 new 0.17) lr 1.00e-05 gnorm 0.152 3.11s mem 81.1GB +step 3172/5000 loss 0.3589 (w 0.2658 mse 0.2704 t 902 new 0.27) lr 1.00e-05 gnorm 0.115 3.17s mem 81.1GB +step 3173/5000 loss 0.2181 (w 0.3518 mse 0.3530 t 624 new 0.20) lr 1.00e-05 gnorm 0.281 2.83s mem 81.1GB +step 3174/5000 loss 0.3096 (w 0.2069 mse 0.2162 t 942 new 0.18) lr 1.00e-05 gnorm 0.202 3.09s mem 81.1GB +step 3175/5000 loss 0.3077 (w 0.2330 mse 0.2302 t 675 new 0.24) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +step 3176/5000 loss 0.4479 (w 0.2632 mse 0.2813 t 328 new 0.10) lr 1.00e-05 gnorm 0.194 3.05s mem 81.1GB +step 3177/5000 loss 0.2864 (w 0.3286 mse 0.3163 t 868 new 0.21) lr 1.00e-05 gnorm 0.176 3.42s mem 81.1GB +step 3178/5000 loss 0.3276 (w 0.2324 mse 0.2438 t 921 new 0.21) lr 1.00e-05 gnorm 0.250 2.84s mem 81.1GB +step 3179/5000 loss 0.2891 (w 0.2390 mse 0.2501 t 803 new 0.27) lr 1.00e-05 gnorm 0.100 2.84s mem 81.1GB +step 3180/5000 loss 0.4226 (w 0.3803 mse 0.3947 t 978 new 0.13) lr 1.00e-05 gnorm 0.105 3.11s mem 81.1GB +step 3181/5000 loss 0.2660 (w 0.2916 mse 0.3033 t 977 new 0.21) lr 1.00e-05 gnorm 0.083 3.10s mem 81.1GB +step 3182/5000 loss 0.3209 (w 0.2430 mse 0.2482 t 783 new 0.21) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 3183/5000 loss 0.3302 (w 0.2683 mse 0.2761 t 693 new 0.22) lr 1.00e-05 gnorm 0.112 3.38s mem 81.1GB +step 3184/5000 loss 0.4005 (w 0.2831 mse 0.2988 t 976 new 0.26) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +step 3185/5000 loss 0.3229 (w 0.2026 mse 0.2216 t 856 new 0.14) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +step 3186/5000 loss 0.2444 (w 0.2360 mse 0.2434 t 607 new 0.12) lr 1.00e-05 gnorm 0.092 3.10s mem 81.1GB +step 3187/5000 loss 0.1974 (w 0.2213 mse 0.2297 t 898 new 0.20) lr 1.00e-05 gnorm 0.168 3.32s mem 81.1GB +step 3188/5000 loss 0.2834 (w 0.3264 mse 0.3293 t 969 new 0.07) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +step 3189/5000 loss 0.2818 (w 0.3374 mse 0.3342 t 995 new 0.22) lr 1.00e-05 gnorm 0.138 3.38s mem 81.1GB +step 3190/5000 loss 0.2964 (w 0.3419 mse 0.3516 t 310 new 0.20) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +step 3191/5000 loss 0.2555 (w 0.2409 mse 0.2491 t 891 new 0.19) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +step 3192/5000 loss 0.2626 (w 0.2794 mse 0.2838 t 861 new 0.19) lr 1.00e-05 gnorm 0.161 3.29s mem 81.1GB +step 3193/5000 loss 0.3710 (w 0.2913 mse 0.3001 t 944 new 0.20) lr 1.00e-05 gnorm 0.180 3.25s mem 81.1GB +step 3194/5000 loss 0.1949 (w 0.2515 mse 0.2615 t 911 new 0.25) lr 1.00e-05 gnorm 0.122 3.06s mem 81.1GB +step 3195/5000 loss 0.3931 (w 0.6974 mse 0.6994 t 146 new 0.25) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +step 3196/5000 loss 0.4944 (w 0.3018 mse 0.3129 t 973 new 0.20) lr 1.00e-05 gnorm 0.134 2.86s mem 81.1GB +step 3197/5000 loss 0.2783 (w 0.2197 mse 0.2298 t 713 new 0.21) lr 1.00e-05 gnorm 0.163 3.30s mem 81.1GB +step 3198/5000 loss 0.5690 (w 0.3567 mse 0.3567 t 968 new 0.18) lr 1.00e-05 gnorm 0.111 3.31s mem 81.1GB +step 3199/5000 loss 0.4046 (w 0.3560 mse 0.3610 t 465 new 0.15) lr 1.00e-05 gnorm 0.104 3.30s mem 81.1GB +step 3200/5000 loss 0.4428 (w 0.4130 mse 0.4120 t 264 new 0.19) lr 1.00e-05 gnorm 0.141 3.11s mem 81.1GB +step 3201/5000 loss 0.2406 (w 0.3696 mse 0.3802 t 904 new 0.19) lr 1.00e-05 gnorm 0.132 3.10s mem 81.1GB +step 3202/5000 loss 0.4442 (w 0.3309 mse 0.3255 t 857 new 0.24) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +step 3203/5000 loss 0.3319 (w 0.2957 mse 0.3053 t 871 new 0.23) lr 1.00e-05 gnorm 0.240 3.19s mem 81.1GB +step 3204/5000 loss 0.2917 (w 0.2976 mse 0.3026 t 874 new 0.22) lr 1.00e-05 gnorm 0.115 3.24s mem 81.1GB +step 3205/5000 loss 0.1462 (w 0.3126 mse 0.3184 t 949 new 0.23) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +step 3206/5000 loss 0.2212 (w 0.2472 mse 0.2563 t 729 new 0.23) lr 1.00e-05 gnorm 0.110 3.13s mem 81.1GB +step 3207/5000 loss 0.3822 (w 0.2269 mse 0.2427 t 637 new 0.21) lr 1.00e-05 gnorm 0.135 3.12s mem 81.1GB +step 3208/5000 loss 0.5066 (w 0.2485 mse 0.2638 t 773 new 0.13) lr 1.00e-05 gnorm 0.205 3.12s mem 81.1GB +step 3209/5000 loss 0.2999 (w 0.2956 mse 0.2949 t 760 new 0.14) lr 1.00e-05 gnorm 0.609 3.20s mem 81.1GB +step 3210/5000 loss 0.2589 (w 0.4458 mse 0.4388 t 1000 new 0.19) lr 1.00e-05 gnorm 0.131 3.31s mem 81.1GB +step 3211/5000 loss 0.2768 (w 0.2506 mse 0.2596 t 743 new 0.23) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +step 3212/5000 loss 0.3038 (w 0.3861 mse 0.3807 t 968 new 0.15) lr 1.00e-05 gnorm 0.121 3.11s mem 81.1GB +step 3213/5000 loss 0.2350 (w 0.2399 mse 0.2478 t 871 new 0.18) lr 1.00e-05 gnorm 1.553 3.08s mem 81.1GB +step 3214/5000 loss 0.1586 (w 0.3426 mse 0.3519 t 966 new 0.10) lr 1.00e-05 gnorm 0.155 3.16s mem 81.1GB +step 3215/5000 loss 0.2611 (w 0.4636 mse 0.4597 t 990 new 0.24) lr 1.00e-05 gnorm 0.133 3.31s mem 81.1GB +step 3216/5000 loss 0.2280 (w 0.2600 mse 0.2699 t 562 new 0.18) lr 1.00e-05 gnorm 0.108 3.09s mem 81.1GB +step 3217/5000 loss 0.2956 (w 0.4076 mse 0.4193 t 332 new 0.21) lr 1.00e-05 gnorm 0.127 3.19s mem 81.1GB +step 3218/5000 loss 0.3302 (w 0.2338 mse 0.2376 t 927 new 0.11) lr 1.00e-05 gnorm 0.137 3.10s mem 81.1GB +step 3219/5000 loss 0.5154 (w 0.3739 mse 0.3735 t 424 new 0.22) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +step 3220/5000 loss 0.2365 (w 0.2549 mse 0.2605 t 782 new 0.14) lr 1.00e-05 gnorm 0.140 3.12s mem 81.1GB +step 3221/5000 loss 0.1738 (w 0.2786 mse 0.2801 t 936 new 0.21) lr 1.00e-05 gnorm 1.309 3.32s mem 81.1GB +step 3222/5000 loss 0.2429 (w 0.3117 mse 0.3113 t 877 new 0.21) lr 1.00e-05 gnorm 0.146 3.28s mem 81.1GB +step 3223/5000 loss 0.4607 (w 0.2334 mse 0.2484 t 777 new 0.27) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +step 3224/5000 loss 0.3680 (w 0.2793 mse 0.2895 t 859 new 0.19) lr 1.00e-05 gnorm 0.292 3.14s mem 81.1GB +step 3225/5000 loss 0.1333 (w 0.2681 mse 0.2733 t 988 new 0.23) lr 1.00e-05 gnorm 0.110 3.10s mem 81.1GB +step 3226/5000 loss 0.3705 (w 0.3591 mse 0.3551 t 688 new 0.13) lr 1.00e-05 gnorm 0.225 3.16s mem 81.1GB +step 3227/5000 loss 0.2057 (w 0.2632 mse 0.2728 t 987 new 0.18) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +step 3228/5000 loss 0.2292 (w 0.2473 mse 0.2558 t 887 new 0.19) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +step 3229/5000 loss 0.2434 (w 0.2611 mse 0.2722 t 973 new 0.22) lr 1.00e-05 gnorm 0.168 3.05s mem 81.1GB +step 3230/5000 loss 0.3160 (w 0.2620 mse 0.2692 t 852 new 0.23) lr 1.00e-05 gnorm 0.100 3.09s mem 81.1GB +step 3231/5000 loss 0.4260 (w 0.2541 mse 0.2549 t 926 new 0.22) lr 1.00e-05 gnorm 0.153 3.13s mem 81.1GB +step 3232/5000 loss 0.2577 (w 0.3536 mse 0.3589 t 873 new 0.24) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +step 3233/5000 loss 0.3057 (w 0.3300 mse 0.3281 t 605 new 0.25) lr 1.00e-05 gnorm 0.094 3.12s mem 81.1GB +step 3234/5000 loss 0.2368 (w 0.1440 mse 0.1593 t 786 new 0.14) lr 1.00e-05 gnorm 0.096 3.08s mem 81.1GB +step 3235/5000 loss 0.2632 (w 0.2750 mse 0.2822 t 621 new 0.22) lr 1.00e-05 gnorm 0.116 3.10s mem 81.1GB +step 3236/5000 loss 0.2555 (w 0.3337 mse 0.3293 t 958 new 0.27) lr 1.00e-05 gnorm 0.177 3.12s mem 81.1GB +step 3237/5000 loss 0.3197 (w 0.4275 mse 0.4569 t 127 new 0.21) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +step 3238/5000 loss 0.4248 (w 0.2713 mse 0.2612 t 730 new 0.26) lr 1.00e-05 gnorm 0.135 3.14s mem 81.1GB +step 3239/5000 loss 0.2706 (w 0.2776 mse 0.2819 t 927 new 0.19) lr 1.00e-05 gnorm 0.105 3.11s mem 81.1GB +step 3240/5000 loss 0.4210 (w 0.2432 mse 0.2534 t 922 new 0.16) lr 1.00e-05 gnorm 1.359 3.14s mem 81.1GB +step 3241/5000 loss 0.1626 (w 0.3820 mse 0.3958 t 966 new 0.22) lr 1.00e-05 gnorm 0.100 2.84s mem 81.1GB +step 3242/5000 loss 0.2649 (w 0.2759 mse 0.2864 t 886 new 0.23) lr 1.00e-05 gnorm 0.130 3.11s mem 81.1GB +step 3243/5000 loss 0.3244 (w 0.2382 mse 0.2638 t 440 new 0.27) lr 1.00e-05 gnorm 0.146 3.11s mem 81.1GB +step 3244/5000 loss 0.2169 (w 0.3020 mse 0.3027 t 919 new 0.27) lr 1.00e-05 gnorm 0.198 3.06s mem 81.1GB +step 3245/5000 loss 0.2987 (w 0.1941 mse 0.2020 t 669 new 0.11) lr 1.00e-05 gnorm 0.118 3.20s mem 81.1GB +step 3246/5000 loss 0.4383 (w 0.3080 mse 0.3179 t 820 new 0.23) lr 1.00e-05 gnorm 0.290 3.07s mem 81.1GB +step 3247/5000 loss 0.3380 (w 0.4795 mse 0.4967 t 206 new 0.28) lr 1.00e-05 gnorm 0.141 3.05s mem 81.1GB +step 3248/5000 loss 0.1863 (w 0.2704 mse 0.2827 t 945 new 0.15) lr 1.00e-05 gnorm 0.113 2.85s mem 81.1GB +step 3249/5000 loss 0.2451 (w 0.2529 mse 0.2553 t 864 new 0.25) lr 1.00e-05 gnorm 0.103 3.17s mem 81.1GB +step 3250/5000 loss 0.3591 (w 0.3059 mse 0.3048 t 908 new 0.23) lr 1.00e-05 gnorm 0.133 3.11s mem 81.1GB +step 3251/5000 loss 0.1652 (w 0.2092 mse 0.2125 t 945 new 0.17) lr 1.00e-05 gnorm 0.122 3.26s mem 81.1GB +step 3252/5000 loss 0.2749 (w 0.4885 mse 0.4952 t 973 new 0.19) lr 1.00e-05 gnorm 0.183 3.09s mem 81.1GB +step 3253/5000 loss 0.3100 (w 0.1792 mse 0.2080 t 969 new 0.18) lr 1.00e-05 gnorm 0.342 3.04s mem 81.1GB +step 3254/5000 loss 0.0967 (w 0.2078 mse 0.2091 t 913 new 0.08) lr 1.00e-05 gnorm 0.102 3.12s mem 81.1GB +step 3255/5000 loss 0.3394 (w 0.2741 mse 0.2855 t 980 new 0.26) lr 1.00e-05 gnorm 0.108 3.04s mem 81.1GB +step 3256/5000 loss 0.4129 (w 0.3028 mse 0.3085 t 998 new 0.21) lr 1.00e-05 gnorm 0.116 3.31s mem 81.1GB +step 3257/5000 loss 0.2868 (w 0.2537 mse 0.2735 t 992 new 0.25) lr 1.00e-05 gnorm 0.104 3.03s mem 81.1GB +step 3258/5000 loss 0.2649 (w 0.1846 mse 0.1952 t 982 new 0.06) lr 1.00e-05 gnorm 0.215 3.11s mem 81.1GB +step 3259/5000 loss 0.0878 (w 0.4065 mse 0.3879 t 990 new 0.22) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +step 3260/5000 loss 0.2404 (w 0.2214 mse 0.2397 t 963 new 0.16) lr 1.00e-05 gnorm 0.127 3.09s mem 81.1GB +step 3261/5000 loss 0.1478 (w 0.2760 mse 0.2829 t 902 new 0.24) lr 1.00e-05 gnorm 0.124 3.05s mem 81.1GB +step 3262/5000 loss 0.3452 (w 0.6101 mse 0.6092 t 146 new 0.15) lr 1.00e-05 gnorm 0.242 3.03s mem 81.1GB +step 3263/5000 loss 0.3218 (w 0.2576 mse 0.2745 t 980 new 0.25) lr 1.00e-05 gnorm 0.113 3.32s mem 81.1GB +step 3264/5000 loss 0.3896 (w 0.2914 mse 0.2854 t 787 new 0.22) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +step 3265/5000 loss 0.1754 (w 0.4086 mse 0.3999 t 997 new 0.21) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +step 3266/5000 loss 0.2462 (w 0.2338 mse 0.2545 t 944 new 0.23) lr 1.00e-05 gnorm 0.626 3.13s mem 81.1GB +step 3267/5000 loss 0.1945 (w 0.1826 mse 0.2040 t 944 new 0.13) lr 1.00e-05 gnorm 0.111 3.11s mem 81.1GB +step 3268/5000 loss 0.2551 (w 0.3388 mse 0.3366 t 953 new 0.26) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +step 3269/5000 loss 0.2013 (w 0.2663 mse 0.2699 t 851 new 0.21) lr 1.00e-05 gnorm 0.126 3.11s mem 81.1GB +step 3270/5000 loss 0.3130 (w 0.1698 mse 0.1759 t 907 new 0.08) lr 1.00e-05 gnorm 0.304 3.08s mem 81.1GB +step 3271/5000 loss 0.2651 (w 0.3101 mse 0.3236 t 997 new 0.26) lr 1.00e-05 gnorm 0.301 3.10s mem 81.1GB +step 3272/5000 loss 0.1138 (w 0.3095 mse 0.3079 t 990 new 0.19) lr 1.00e-05 gnorm 0.132 3.15s mem 81.1GB +step 3273/5000 loss 0.2009 (w 0.2947 mse 0.2970 t 978 new 0.18) lr 1.00e-05 gnorm 0.103 3.05s mem 81.1GB +step 3274/5000 loss 0.3426 (w 0.2756 mse 0.2877 t 950 new 0.20) lr 1.00e-05 gnorm 0.192 3.05s mem 81.1GB +step 3275/5000 loss 0.1592 (w 0.2744 mse 0.2873 t 938 new 0.19) lr 1.00e-05 gnorm 0.115 3.25s mem 81.1GB +step 3276/5000 loss 0.2574 (w 0.3184 mse 0.3192 t 829 new 0.28) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +step 3277/5000 loss 0.3173 (w 0.2624 mse 0.2803 t 984 new 0.20) lr 1.00e-05 gnorm 0.308 3.14s mem 81.1GB +step 3278/5000 loss 0.3013 (w 0.3741 mse 0.3871 t 348 new 0.26) lr 1.00e-05 gnorm 0.138 3.37s mem 81.1GB +step 3279/5000 loss 0.2883 (w 0.2461 mse 0.2524 t 793 new 0.25) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +step 3280/5000 loss 0.3864 (w 0.3601 mse 0.3691 t 500 new 0.21) lr 1.00e-05 gnorm 0.107 3.04s mem 81.1GB +step 3281/5000 loss 0.2888 (w 0.2891 mse 0.2994 t 974 new 0.22) lr 1.00e-05 gnorm 0.108 3.25s mem 81.1GB +step 3282/5000 loss 0.1455 (w 0.2781 mse 0.2767 t 969 new 0.09) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +step 3283/5000 loss 0.2487 (w 0.2587 mse 0.2701 t 660 new 0.15) lr 1.00e-05 gnorm 0.131 3.07s mem 81.1GB +step 3284/5000 loss 0.4790 (w 0.2780 mse 0.3057 t 968 new 0.19) lr 1.00e-05 gnorm 0.127 3.19s mem 81.1GB +step 3285/5000 loss 0.1845 (w 0.2718 mse 0.2846 t 932 new 0.17) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +step 3286/5000 loss 0.2749 (w 0.2019 mse 0.2116 t 741 new 0.19) lr 1.00e-05 gnorm 0.158 3.09s mem 81.1GB +step 3287/5000 loss 0.2649 (w 0.2608 mse 0.2719 t 706 new 0.28) lr 1.00e-05 gnorm 0.109 3.29s mem 81.1GB +step 3288/5000 loss 0.1876 (w 0.3044 mse 0.3127 t 968 new 0.22) lr 1.00e-05 gnorm 0.159 2.83s mem 81.1GB +step 3289/5000 loss 0.2432 (w 0.2719 mse 0.2647 t 921 new 0.22) lr 1.00e-05 gnorm 0.118 3.12s mem 81.1GB +step 3290/5000 loss 0.2542 (w 0.3617 mse 0.3679 t 999 new 0.23) lr 1.00e-05 gnorm 0.149 3.46s mem 81.1GB +step 3291/5000 loss 0.3208 (w 0.2312 mse 0.2517 t 662 new 0.17) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +step 3292/5000 loss 0.3987 (w 0.3015 mse 0.3000 t 950 new 0.20) lr 1.00e-05 gnorm 0.105 3.29s mem 81.1GB +step 3293/5000 loss 0.3331 (w 0.4847 mse 0.4668 t 969 new 0.23) lr 1.00e-05 gnorm 0.157 3.32s mem 81.1GB +step 3294/5000 loss 0.2610 (w 0.3541 mse 0.3726 t 983 new 0.11) lr 1.00e-05 gnorm 0.106 3.06s mem 81.1GB +step 3295/5000 loss 0.3338 (w 0.3065 mse 0.3179 t 951 new 0.22) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 3296/5000 loss 0.4606 (w 0.2916 mse 0.2904 t 973 new 0.21) lr 1.00e-05 gnorm 0.141 3.42s mem 81.1GB +step 3297/5000 loss 0.2116 (w 0.3471 mse 0.3433 t 947 new 0.19) lr 1.00e-05 gnorm 0.110 2.84s mem 81.1GB +step 3298/5000 loss 0.3611 (w 0.5888 mse 0.5895 t 171 new 0.25) lr 1.00e-05 gnorm 0.129 3.28s mem 81.1GB +step 3299/5000 loss 0.3890 (w 0.2546 mse 0.2679 t 918 new 0.22) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +step 3300/5000 loss 0.2717 (w 0.2338 mse 0.2433 t 702 new 0.10) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +step 3301/5000 loss 0.2074 (w 0.2602 mse 0.2636 t 917 new 0.21) lr 1.00e-05 gnorm 0.114 3.33s mem 81.1GB +step 3302/5000 loss 0.4478 (w 0.2162 mse 0.2333 t 743 new 0.25) lr 1.00e-05 gnorm 0.104 3.46s mem 81.1GB +step 3303/5000 loss 0.1933 (w 0.1676 mse 0.1878 t 894 new 0.29) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +step 3304/5000 loss 0.3253 (w 0.2820 mse 0.2941 t 963 new 0.24) lr 1.00e-05 gnorm 0.138 3.10s mem 81.1GB +step 3305/5000 loss 0.1522 (w 0.3104 mse 0.3169 t 736 new 0.26) lr 1.00e-05 gnorm 0.110 3.14s mem 81.1GB +step 3306/5000 loss 0.3549 (w 0.2855 mse 0.3002 t 738 new 0.18) lr 1.00e-05 gnorm 0.127 3.07s mem 81.1GB +step 3307/5000 loss 0.1998 (w 0.2955 mse 0.3004 t 940 new 0.21) lr 1.00e-05 gnorm 0.142 3.36s mem 81.1GB +step 3308/5000 loss 0.2673 (w 0.3217 mse 0.3184 t 987 new 0.20) lr 1.00e-05 gnorm 0.117 3.42s mem 81.1GB +step 3309/5000 loss 0.1271 (w 0.3149 mse 0.3198 t 977 new 0.20) lr 1.00e-05 gnorm 0.111 3.08s mem 81.1GB +step 3310/5000 loss 0.1554 (w 0.2441 mse 0.2596 t 913 new 0.20) lr 1.00e-05 gnorm 0.284 3.33s mem 81.1GB +step 3311/5000 loss 0.2304 (w 0.1924 mse 0.2105 t 947 new 0.25) lr 1.00e-05 gnorm 0.284 3.11s mem 81.1GB +step 3312/5000 loss 0.2679 (w 0.3729 mse 0.3766 t 966 new 0.28) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +step 3313/5000 loss 0.3704 (w 0.3575 mse 0.3544 t 1000 new 0.20) lr 1.00e-05 gnorm 0.099 3.37s mem 81.1GB +step 3314/5000 loss 0.2755 (w 0.2736 mse 0.2783 t 884 new 0.16) lr 1.00e-05 gnorm 0.139 3.03s mem 81.1GB +step 3315/5000 loss 0.3338 (w 0.2573 mse 0.2829 t 984 new 0.20) lr 1.00e-05 gnorm 0.129 3.05s mem 81.1GB +step 3316/5000 loss 0.4595 (w 0.1542 mse 0.1801 t 725 new 0.19) lr 1.00e-05 gnorm 0.203 3.26s mem 81.1GB +step 3317/5000 loss 0.2920 (w 0.2443 mse 0.2665 t 521 new 0.15) lr 1.00e-05 gnorm 0.272 3.17s mem 81.1GB +step 3318/5000 loss 0.2998 (w 0.2600 mse 0.2781 t 584 new 0.23) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +step 3319/5000 loss 0.3652 (w 0.3077 mse 0.3145 t 648 new 0.24) lr 1.00e-05 gnorm 0.127 3.31s mem 81.1GB +step 3320/5000 loss 0.4149 (w 0.2175 mse 0.2260 t 610 new 0.19) lr 1.00e-05 gnorm 0.137 3.08s mem 81.1GB +step 3321/5000 loss 0.2520 (w 0.3293 mse 0.3382 t 878 new 0.13) lr 1.00e-05 gnorm 0.146 3.08s mem 81.1GB +step 3322/5000 loss 0.4276 (w 0.2284 mse 0.2363 t 989 new 0.13) lr 1.00e-05 gnorm 0.163 3.30s mem 81.1GB +step 3323/5000 loss 0.2503 (w 0.1979 mse 0.2187 t 813 new 0.15) lr 1.00e-05 gnorm 0.105 2.83s mem 81.1GB +step 3324/5000 loss 0.2035 (w 0.2928 mse 0.2976 t 961 new 0.20) lr 1.00e-05 gnorm 0.108 3.11s mem 81.1GB +step 3325/5000 loss 0.1529 (w 0.2083 mse 0.2262 t 966 new 0.10) lr 1.00e-05 gnorm 0.176 3.15s mem 81.1GB +step 3326/5000 loss 0.3428 (w 0.4074 mse 0.4158 t 434 new 0.18) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +step 3327/5000 loss 0.2318 (w 0.3008 mse 0.3152 t 796 new 0.21) lr 1.00e-05 gnorm 0.199 3.11s mem 81.1GB +step 3328/5000 loss 0.3082 (w 0.3438 mse 0.3532 t 954 new 0.20) lr 1.00e-05 gnorm 0.114 3.29s mem 81.1GB +step 3329/5000 loss 0.1784 (w 0.2784 mse 0.2798 t 873 new 0.16) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +step 3330/5000 loss 0.4314 (w 0.2721 mse 0.2765 t 728 new 0.11) lr 1.00e-05 gnorm 0.134 3.10s mem 81.1GB +step 3331/5000 loss 0.2505 (w 0.2365 mse 0.2513 t 948 new 0.24) lr 1.00e-05 gnorm 0.260 3.42s mem 81.1GB +step 3332/5000 loss 0.2923 (w 0.3060 mse 0.3155 t 913 new 0.23) lr 1.00e-05 gnorm 0.178 2.84s mem 81.1GB +step 3333/5000 loss 0.3399 (w 0.5420 mse 0.5598 t 998 new 0.19) lr 1.00e-05 gnorm 0.098 3.11s mem 81.1GB +step 3334/5000 loss 0.3595 (w 0.2318 mse 0.2576 t 859 new 0.19) lr 1.00e-05 gnorm 0.109 3.28s mem 81.1GB +step 3335/5000 loss 0.3197 (w 0.5710 mse 0.5782 t 183 new 0.14) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +step 3336/5000 loss 0.2912 (w 0.2162 mse 0.2376 t 746 new 0.16) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +step 3337/5000 loss 0.3517 (w 0.1980 mse 0.2066 t 623 new 0.10) lr 1.00e-05 gnorm 0.129 3.48s mem 81.1GB +step 3338/5000 loss 0.2293 (w 0.2905 mse 0.3008 t 950 new 0.24) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +step 3339/5000 loss 0.1696 (w 0.2011 mse 0.2063 t 787 new 0.24) lr 1.00e-05 gnorm 0.192 3.05s mem 81.1GB +step 3340/5000 loss 0.4692 (w 0.3176 mse 0.3190 t 687 new 0.22) lr 1.00e-05 gnorm 0.137 3.31s mem 81.1GB +step 3341/5000 loss 0.3463 (w 0.4291 mse 0.4595 t 238 new 0.20) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +step 3342/5000 loss 0.1942 (w 0.2937 mse 0.3067 t 966 new 0.24) lr 1.00e-05 gnorm 0.344 3.06s mem 81.1GB +step 3343/5000 loss 0.2852 (w 0.3214 mse 0.3228 t 871 new 0.26) lr 1.00e-05 gnorm 0.211 3.48s mem 81.1GB +step 3344/5000 loss 0.5138 (w 0.2201 mse 0.2367 t 773 new 0.18) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +step 3345/5000 loss 0.2016 (w 0.2376 mse 0.2559 t 553 new 0.21) lr 1.00e-05 gnorm 0.132 4.39s mem 81.1GB +step 3346/5000 loss 0.3526 (w 0.3409 mse 0.3460 t 397 new 0.18) lr 1.00e-05 gnorm 0.110 3.08s mem 81.1GB +step 3347/5000 loss 0.2358 (w 0.1880 mse 0.2092 t 883 new 0.15) lr 1.00e-05 gnorm 0.894 2.83s mem 81.1GB +step 3348/5000 loss 0.4934 (w 0.2913 mse 0.2885 t 729 new 0.17) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +step 3349/5000 loss 0.2021 (w 0.2889 mse 0.2870 t 929 new 0.23) lr 1.00e-05 gnorm 0.114 3.15s mem 81.1GB +step 3350/5000 loss 0.2000 (w 0.2795 mse 0.2935 t 983 new 0.08) lr 1.00e-05 gnorm 0.117 3.03s mem 81.1GB +step 3351/5000 loss 0.2792 (w 0.2546 mse 0.2569 t 804 new 0.12) lr 1.00e-05 gnorm 0.300 2.84s mem 81.1GB +step 3352/5000 loss 0.3064 (w 0.2872 mse 0.3162 t 987 new 0.14) lr 1.00e-05 gnorm 0.112 3.17s mem 81.1GB +step 3353/5000 loss 0.2882 (w 0.1875 mse 0.2046 t 670 new 0.24) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +step 3354/5000 loss 0.3300 (w 0.1960 mse 0.2015 t 660 new 0.13) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +step 3355/5000 loss 0.2005 (w 0.2517 mse 0.2683 t 991 new 0.18) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +step 3356/5000 loss 0.2357 (w 0.2217 mse 0.2298 t 508 new 0.14) lr 1.00e-05 gnorm 0.147 3.04s mem 81.1GB +step 3357/5000 loss 0.1709 (w 0.3951 mse 0.4084 t 998 new 0.20) lr 1.00e-05 gnorm 0.107 2.84s mem 81.1GB +step 3358/5000 loss 0.2877 (w 0.3702 mse 0.3759 t 340 new 0.25) lr 1.00e-05 gnorm 0.105 3.16s mem 81.1GB +step 3359/5000 loss 0.3894 (w 0.2853 mse 0.3031 t 909 new 0.18) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +step 3360/5000 loss 0.4677 (w 0.2917 mse 0.2939 t 861 new 0.23) lr 1.00e-05 gnorm 0.506 3.15s mem 81.1GB +step 3361/5000 loss 0.1836 (w 0.5301 mse 0.5525 t 996 new 0.17) lr 1.00e-05 gnorm 0.137 3.13s mem 81.1GB +step 3362/5000 loss 0.2191 (w 0.2899 mse 0.2902 t 795 new 0.20) lr 1.00e-05 gnorm 0.117 3.01s mem 81.1GB +step 3363/5000 loss 0.2515 (w 0.2833 mse 0.2781 t 893 new 0.21) lr 1.00e-05 gnorm 0.133 3.08s mem 81.1GB +step 3364/5000 loss 0.2202 (w 0.2964 mse 0.3047 t 990 new 0.23) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +step 3365/5000 loss 0.3558 (w 0.5601 mse 0.5925 t 120 new 0.26) lr 1.00e-05 gnorm 0.115 2.85s mem 81.1GB +step 3366/5000 loss 0.1487 (w 0.2969 mse 0.3059 t 938 new 0.23) lr 1.00e-05 gnorm 0.112 3.60s mem 81.1GB +step 3367/5000 loss 0.2382 (w 0.3165 mse 0.3223 t 895 new 0.19) lr 1.00e-05 gnorm 1.038 2.85s mem 81.1GB +step 3368/5000 loss 0.1626 (w 0.2951 mse 0.3016 t 753 new 0.18) lr 1.00e-05 gnorm 0.107 3.06s mem 81.1GB +step 3369/5000 loss 0.4903 (w 0.7307 mse 0.7473 t 107 new 0.21) lr 1.00e-05 gnorm 0.227 3.10s mem 81.1GB +step 3370/5000 loss 0.2377 (w 0.3187 mse 0.3152 t 768 new 0.23) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +step 3371/5000 loss 0.3025 (w 0.2328 mse 0.2389 t 940 new 0.20) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +step 3372/5000 loss 0.3756 (w 0.3250 mse 0.3340 t 836 new 0.29) lr 1.00e-05 gnorm 0.131 3.58s mem 81.1GB +step 3373/5000 loss 0.2603 (w 0.2950 mse 0.2881 t 914 new 0.20) lr 1.00e-05 gnorm 0.102 2.83s mem 81.1GB +step 3374/5000 loss 0.3294 (w 0.2423 mse 0.2527 t 921 new 0.24) lr 1.00e-05 gnorm 0.130 3.09s mem 81.1GB +step 3375/5000 loss 0.2228 (w 0.1981 mse 0.2229 t 855 new 0.26) lr 1.00e-05 gnorm 0.133 3.30s mem 81.1GB +step 3376/5000 loss 0.4210 (w 0.2503 mse 0.2603 t 893 new 0.22) lr 1.00e-05 gnorm 0.121 2.84s mem 81.1GB +step 3377/5000 loss 0.2058 (w 0.3600 mse 0.3608 t 996 new 0.05) lr 1.00e-05 gnorm 0.151 3.08s mem 81.1GB +step 3378/5000 loss 0.2879 (w 0.1910 mse 0.2219 t 811 new 0.19) lr 1.00e-05 gnorm 0.100 3.23s mem 81.1GB +step 3379/5000 loss 0.2719 (w 0.2918 mse 0.2912 t 685 new 0.25) lr 1.00e-05 gnorm 0.167 2.83s mem 81.1GB +step 3380/5000 loss 0.1658 (w 0.2906 mse 0.2931 t 742 new 0.10) lr 1.00e-05 gnorm 0.111 3.11s mem 81.1GB +step 3381/5000 loss 0.3626 (w 0.2780 mse 0.2708 t 826 new 0.21) lr 1.00e-05 gnorm 0.129 3.36s mem 81.1GB +step 3382/5000 loss 0.3613 (w 0.2866 mse 0.2914 t 939 new 0.22) lr 1.00e-05 gnorm 0.116 2.83s mem 81.1GB +step 3383/5000 loss 0.3162 (w 0.3773 mse 0.3756 t 798 new 0.25) lr 1.00e-05 gnorm 0.103 3.15s mem 81.1GB +step 3384/5000 loss 0.2269 (w 0.2971 mse 0.2978 t 745 new 0.03) lr 1.00e-05 gnorm 0.097 3.23s mem 81.1GB +step 3385/5000 loss 0.3549 (w 0.1954 mse 0.2089 t 673 new 0.15) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +step 3386/5000 loss 0.1423 (w 0.2867 mse 0.2912 t 924 new 0.19) lr 1.00e-05 gnorm 0.144 3.36s mem 81.1GB +step 3387/5000 loss 0.1766 (w 0.2353 mse 0.2431 t 897 new 0.22) lr 1.00e-05 gnorm 0.138 3.21s mem 81.1GB +step 3388/5000 loss 0.2818 (w 0.3882 mse 0.3845 t 977 new 0.20) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 3389/5000 loss 0.1418 (w 0.3407 mse 0.3502 t 969 new 0.22) lr 1.00e-05 gnorm 0.126 3.16s mem 81.1GB +step 3390/5000 loss 0.1825 (w 0.2744 mse 0.2687 t 830 new 0.21) lr 1.00e-05 gnorm 0.105 3.49s mem 81.1GB +step 3391/5000 loss 0.1866 (w 0.3097 mse 0.3096 t 965 new 0.27) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +step 3392/5000 loss 0.2656 (w 0.2460 mse 0.2576 t 876 new 0.18) lr 1.00e-05 gnorm 0.151 3.29s mem 81.1GB +step 3393/5000 loss 0.3432 (w 0.4210 mse 0.4462 t 206 new 0.11) lr 1.00e-05 gnorm 0.169 3.11s mem 81.1GB +step 3394/5000 loss 0.1552 (w 0.2297 mse 0.2406 t 875 new 0.10) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +step 3395/5000 loss 0.4619 (w 0.5390 mse 0.5336 t 283 new 0.24) lr 1.00e-05 gnorm 0.140 3.14s mem 81.1GB +step 3396/5000 loss 0.2031 (w 0.3267 mse 0.3204 t 733 new 0.17) lr 1.00e-05 gnorm 0.126 3.45s mem 81.1GB +step 3397/5000 loss 0.1838 (w 0.4137 mse 0.4100 t 987 new 0.21) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +step 3398/5000 loss 0.1799 (w 0.2782 mse 0.2819 t 998 new 0.13) lr 1.00e-05 gnorm 0.102 3.27s mem 81.1GB +step 3399/5000 loss 0.3597 (w 0.3177 mse 0.3356 t 599 new 0.16) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +step 3400/5000 loss 0.1226 (w 0.4179 mse 0.4023 t 986 new 0.20) lr 1.00e-05 gnorm 0.133 2.83s mem 81.1GB +step 3401/5000 loss 0.3657 (w 0.2533 mse 0.2609 t 769 new 0.22) lr 1.00e-05 gnorm 0.112 3.36s mem 81.1GB +step 3402/5000 loss 0.2942 (w 0.2738 mse 0.2746 t 985 new 0.14) lr 1.00e-05 gnorm 0.800 3.32s mem 81.1GB +step 3403/5000 loss 0.1367 (w 0.3489 mse 0.3633 t 962 new 0.22) lr 1.00e-05 gnorm 0.186 3.10s mem 81.1GB +step 3404/5000 loss 0.1782 (w 0.3418 mse 0.3409 t 987 new 0.24) lr 1.00e-05 gnorm 0.083 3.06s mem 81.1GB +step 3405/5000 loss 0.1532 (w 0.2193 mse 0.2364 t 924 new 0.20) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +step 3406/5000 loss 0.1783 (w 0.2258 mse 0.2407 t 882 new 0.19) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 3407/5000 loss 0.1687 (w 0.2690 mse 0.2773 t 850 new 0.12) lr 1.00e-05 gnorm 0.125 3.40s mem 81.1GB +step 3408/5000 loss 0.1449 (w 0.2819 mse 0.2869 t 903 new 0.26) lr 1.00e-05 gnorm 0.129 3.17s mem 81.1GB +step 3409/5000 loss 0.1901 (w 0.3006 mse 0.2993 t 830 new 0.19) lr 1.00e-05 gnorm 0.182 3.10s mem 81.1GB +step 3410/5000 loss 0.3541 (w 0.3622 mse 0.3676 t 418 new 0.21) lr 1.00e-05 gnorm 0.195 3.08s mem 81.1GB +step 3411/5000 loss 0.1719 (w 0.3691 mse 0.3787 t 972 new 0.24) lr 1.00e-05 gnorm 0.172 2.84s mem 81.1GB +step 3412/5000 loss 0.2253 (w 0.1613 mse 0.1891 t 754 new 0.22) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +step 3413/5000 loss 0.2084 (w 0.2859 mse 0.2778 t 874 new 0.16) lr 1.00e-05 gnorm 0.127 3.44s mem 81.1GB +step 3414/5000 loss 0.4243 (w 0.3972 mse 0.4054 t 952 new 0.27) lr 1.00e-05 gnorm 0.407 3.14s mem 81.1GB +step 3415/5000 loss 0.3629 (w 0.3459 mse 0.3466 t 948 new 0.18) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +step 3416/5000 loss 0.2886 (w 0.3757 mse 0.3802 t 970 new 0.24) lr 1.00e-05 gnorm 0.345 3.36s mem 81.1GB +step 3417/5000 loss 0.2418 (w 0.4050 mse 0.4041 t 956 new 0.24) lr 1.00e-05 gnorm 0.315 2.84s mem 81.1GB +step 3418/5000 loss 0.2261 (w 0.2487 mse 0.2580 t 944 new 0.08) lr 1.00e-05 gnorm 0.116 2.85s mem 81.1GB +step 3419/5000 loss 0.2249 (w 0.3877 mse 0.3920 t 974 new 0.28) lr 1.00e-05 gnorm 0.295 3.40s mem 81.1GB +step 3420/5000 loss 0.2455 (w 0.2453 mse 0.2593 t 963 new 0.20) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +step 3421/5000 loss 0.3787 (w 0.2744 mse 0.2806 t 875 new 0.27) lr 1.00e-05 gnorm 0.221 3.13s mem 81.1GB +step 3422/5000 loss 0.4568 (w 0.2940 mse 0.3051 t 818 new 0.19) lr 1.00e-05 gnorm 0.126 3.30s mem 81.1GB +step 3423/5000 loss 0.2968 (w 0.4810 mse 0.5002 t 238 new 0.08) lr 1.00e-05 gnorm 1.676 3.16s mem 81.1GB +step 3424/5000 loss 0.3063 (w 0.2793 mse 0.2768 t 779 new 0.14) lr 1.00e-05 gnorm 0.203 3.14s mem 81.1GB +step 3425/5000 loss 0.2077 (w 0.2652 mse 0.2876 t 948 new 0.18) lr 1.00e-05 gnorm 0.101 3.41s mem 81.1GB +step 3426/5000 loss 0.4320 (w 0.3029 mse 0.3152 t 278 new 0.19) lr 1.00e-05 gnorm 0.141 2.85s mem 81.1GB +step 3427/5000 loss 0.2385 (w 0.3387 mse 0.3478 t 931 new 0.17) lr 1.00e-05 gnorm 0.439 3.07s mem 81.1GB +step 3428/5000 loss 0.2953 (w 0.2870 mse 0.2857 t 873 new 0.14) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +step 3429/5000 loss 0.3389 (w 0.2706 mse 0.2702 t 846 new 0.13) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 3430/5000 loss 0.1546 (w 0.3969 mse 0.3922 t 991 new 0.14) lr 1.00e-05 gnorm 0.117 3.08s mem 81.1GB +step 3431/5000 loss 0.1268 (w 0.1580 mse 0.1704 t 811 new 0.20) lr 1.00e-05 gnorm 0.106 3.41s mem 81.1GB +step 3432/5000 loss 0.1880 (w 0.2493 mse 0.2545 t 794 new 0.21) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +step 3433/5000 loss 0.2047 (w 0.2852 mse 0.2906 t 919 new 0.16) lr 1.00e-05 gnorm 0.190 3.12s mem 81.1GB +step 3434/5000 loss 0.3190 (w 0.3826 mse 0.3749 t 969 new 0.26) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +step 3435/5000 loss 0.1824 (w 0.2355 mse 0.2497 t 862 new 0.28) lr 1.00e-05 gnorm 0.089 2.83s mem 81.1GB +step 3436/5000 loss 0.2296 (w 0.2385 mse 0.2422 t 819 new 0.23) lr 1.00e-05 gnorm 0.142 3.06s mem 81.1GB +step 3437/5000 loss 0.2957 (w 0.2556 mse 0.2767 t 991 new 0.23) lr 1.00e-05 gnorm 0.154 3.28s mem 81.1GB +step 3438/5000 loss 0.2799 (w 0.2807 mse 0.2896 t 654 new 0.20) lr 1.00e-05 gnorm 0.212 2.83s mem 81.1GB +step 3439/5000 loss 0.1276 (w 0.2040 mse 0.2215 t 935 new 0.26) lr 1.00e-05 gnorm 0.184 3.12s mem 81.1GB +step 3440/5000 loss 0.2928 (w 0.4603 mse 0.4705 t 1000 new 0.20) lr 1.00e-05 gnorm 0.202 2.85s mem 81.1GB +step 3441/5000 loss 0.4125 (w 0.2369 mse 0.2550 t 465 new 0.10) lr 1.00e-05 gnorm 0.164 2.85s mem 81.1GB +step 3442/5000 loss 0.2917 (w 0.3035 mse 0.3156 t 418 new 0.15) lr 1.00e-05 gnorm 0.487 3.08s mem 81.1GB +step 3443/5000 loss 0.1552 (w 0.2975 mse 0.3124 t 886 new 0.24) lr 1.00e-05 gnorm 0.172 3.04s mem 81.1GB +step 3444/5000 loss 0.4393 (w 0.2163 mse 0.2221 t 901 new 0.08) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +step 3445/5000 loss 0.2984 (w 0.3097 mse 0.3040 t 763 new 0.23) lr 1.00e-05 gnorm 0.205 3.41s mem 81.1GB +step 3446/5000 loss 0.2572 (w 0.2373 mse 0.2460 t 766 new 0.15) lr 1.00e-05 gnorm 0.155 2.83s mem 81.1GB +step 3447/5000 loss 0.3713 (w 0.2712 mse 0.2811 t 641 new 0.23) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +step 3448/5000 loss 0.2028 (w 0.3547 mse 0.3668 t 967 new 0.21) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +step 3449/5000 loss 0.3052 (w 0.2857 mse 0.3183 t 962 new 0.22) lr 1.00e-05 gnorm 0.170 3.07s mem 81.1GB +step 3450/5000 loss 0.3927 (w 0.3567 mse 0.3581 t 979 new 0.18) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 3451/5000 loss 0.1712 (w 0.2110 mse 0.2195 t 941 new 0.17) lr 1.00e-05 gnorm 0.135 3.15s mem 81.1GB +step 3452/5000 loss 0.2482 (w 0.1669 mse 0.1699 t 883 new 0.13) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +step 3453/5000 loss 0.2652 (w 0.2903 mse 0.3044 t 434 new 0.12) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +step 3454/5000 loss 0.1872 (w 0.2823 mse 0.2835 t 879 new 0.24) lr 1.00e-05 gnorm 0.119 3.17s mem 81.1GB +step 3455/5000 loss 0.1932 (w 0.3729 mse 0.3579 t 971 new 0.23) lr 1.00e-05 gnorm 0.119 3.12s mem 81.1GB +step 3456/5000 loss 0.2767 (w 0.2694 mse 0.2768 t 914 new 0.26) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +step 3457/5000 loss 0.2968 (w 0.3290 mse 0.3212 t 997 new 0.26) lr 1.00e-05 gnorm 0.165 3.39s mem 81.1GB +step 3458/5000 loss 0.3624 (w 0.3308 mse 0.3293 t 795 new 0.22) lr 1.00e-05 gnorm 0.110 2.84s mem 81.1GB +step 3459/5000 loss 0.2378 (w 0.2432 mse 0.2470 t 882 new 0.11) lr 1.00e-05 gnorm 0.874 2.84s mem 81.1GB +step 3460/5000 loss 0.2540 (w 0.3063 mse 0.3232 t 988 new 0.23) lr 1.00e-05 gnorm 0.136 3.33s mem 81.1GB +step 3461/5000 loss 0.3277 (w 0.3577 mse 0.3510 t 916 new 0.20) lr 1.00e-05 gnorm 0.152 3.04s mem 81.1GB +step 3462/5000 loss 0.3250 (w 0.3094 mse 0.3234 t 997 new 0.20) lr 1.00e-05 gnorm 0.107 2.84s mem 81.1GB +step 3463/5000 loss 0.0887 (w 0.3170 mse 0.3279 t 967 new 0.24) lr 1.00e-05 gnorm 0.167 3.34s mem 81.1GB +step 3464/5000 loss 0.3492 (w 0.3677 mse 0.3652 t 779 new 0.23) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +step 3465/5000 loss 0.1197 (w 0.3248 mse 0.3334 t 965 new 0.18) lr 1.00e-05 gnorm 0.162 2.83s mem 81.1GB +step 3466/5000 loss 0.2490 (w 0.2522 mse 0.2609 t 968 new 0.21) lr 1.00e-05 gnorm 0.103 3.40s mem 81.1GB +step 3467/5000 loss 0.3186 (w 0.2567 mse 0.2738 t 942 new 0.24) lr 1.00e-05 gnorm 0.149 3.05s mem 81.1GB +step 3468/5000 loss 0.2415 (w 0.3242 mse 0.3234 t 858 new 0.26) lr 1.00e-05 gnorm 0.145 3.06s mem 81.1GB +step 3469/5000 loss 0.2600 (w 0.2629 mse 0.2728 t 768 new 0.24) lr 1.00e-05 gnorm 0.197 3.39s mem 81.1GB +step 3470/5000 loss 0.4131 (w 0.3023 mse 0.3152 t 535 new 0.18) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +step 3471/5000 loss 0.3034 (w 0.5637 mse 0.5816 t 100 new 0.22) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 3472/5000 loss 0.1849 (w 0.2596 mse 0.2764 t 958 new 0.24) lr 1.00e-05 gnorm 0.178 3.27s mem 81.1GB +step 3473/5000 loss 0.2587 (w 0.2183 mse 0.2270 t 704 new 0.26) lr 1.00e-05 gnorm 0.207 3.09s mem 81.1GB +step 3474/5000 loss 0.1904 (w 0.2758 mse 0.2743 t 843 new 0.23) lr 1.00e-05 gnorm 1.107 3.10s mem 81.1GB +step 3475/5000 loss 0.2429 (w 0.3022 mse 0.3067 t 970 new 0.11) lr 1.00e-05 gnorm 0.204 3.11s mem 81.1GB +step 3476/5000 loss 0.1605 (w 0.3244 mse 0.3288 t 966 new 0.25) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +step 3477/5000 loss 0.3034 (w 0.3348 mse 0.3422 t 990 new 0.21) lr 1.00e-05 gnorm 0.127 3.11s mem 81.1GB +step 3478/5000 loss 0.4017 (w 0.2626 mse 0.2723 t 586 new 0.10) lr 1.00e-05 gnorm 0.295 3.39s mem 81.1GB +step 3479/5000 loss 0.2790 (w 0.3819 mse 0.3813 t 998 new 0.22) lr 1.00e-05 gnorm 0.187 2.84s mem 81.1GB +step 3480/5000 loss 0.2106 (w 0.2384 mse 0.2418 t 908 new 0.12) lr 1.00e-05 gnorm 0.116 3.27s mem 81.1GB +step 3481/5000 loss 0.2822 (w 0.3298 mse 0.3359 t 844 new 0.26) lr 1.00e-05 gnorm 0.152 3.60s mem 81.1GB +step 3482/5000 loss 0.3697 (w 0.2793 mse 0.2934 t 976 new 0.19) lr 1.00e-05 gnorm 0.199 2.84s mem 81.1GB +step 3483/5000 loss 0.3400 (w 0.2527 mse 0.2626 t 731 new 0.23) lr 1.00e-05 gnorm 0.194 3.07s mem 81.1GB +step 3484/5000 loss 0.1358 (w 0.2586 mse 0.2721 t 920 new 0.22) lr 1.00e-05 gnorm 0.121 3.35s mem 81.1GB +step 3485/5000 loss 0.1305 (w 0.2633 mse 0.2919 t 976 new 0.16) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 3486/5000 loss 0.3498 (w 0.3627 mse 0.3791 t 964 new 0.22) lr 1.00e-05 gnorm 0.163 3.29s mem 81.1GB +step 3487/5000 loss 0.3805 (w 0.2183 mse 0.2385 t 940 new 0.17) lr 1.00e-05 gnorm 0.145 3.03s mem 81.1GB +step 3488/5000 loss 0.2350 (w 0.2597 mse 0.2663 t 939 new 0.22) lr 1.00e-05 gnorm 0.116 2.85s mem 81.1GB +step 3489/5000 loss 0.1255 (w 0.2737 mse 0.2747 t 899 new 0.16) lr 1.00e-05 gnorm 0.108 3.10s mem 81.1GB +step 3490/5000 loss 0.2722 (w 0.5874 mse 0.5764 t 989 new 0.18) lr 1.00e-05 gnorm 0.153 3.12s mem 81.1GB +step 3491/5000 loss 0.1513 (w 0.2983 mse 0.2969 t 976 new 0.08) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +step 3492/5000 loss 0.3181 (w 0.2615 mse 0.2703 t 799 new 0.24) lr 1.00e-05 gnorm 0.135 3.32s mem 81.1GB +step 3493/5000 loss 0.1891 (w 0.3349 mse 0.3354 t 996 new 0.06) lr 1.00e-05 gnorm 0.126 3.07s mem 81.1GB +step 3494/5000 loss 0.3179 (w 0.1556 mse 0.1739 t 760 new 0.27) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +step 3495/5000 loss 0.3347 (w 0.6017 mse 0.6292 t 114 new 0.13) lr 1.00e-05 gnorm 0.126 3.14s mem 81.1GB +step 3496/5000 loss 0.2969 (w 0.2590 mse 0.2613 t 815 new 0.28) lr 1.00e-05 gnorm 0.117 3.14s mem 81.1GB +step 3497/5000 loss 0.1590 (w 0.4640 mse 0.5012 t 986 new 0.26) lr 1.00e-05 gnorm 0.123 3.06s mem 81.1GB +step 3498/5000 loss 0.4501 (w 0.2794 mse 0.2664 t 961 new 0.09) lr 1.00e-05 gnorm 0.145 3.28s mem 81.1GB +step 3499/5000 loss 0.3004 (w 0.2766 mse 0.2974 t 631 new 0.19) lr 1.00e-05 gnorm 0.231 2.84s mem 81.1GB +step 3500/5000 loss 0.3904 (w 0.2118 mse 0.2367 t 910 new 0.21) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +[val] step 3500 t=200: w=0.4575 mse=0.4756 (n=16) t=500: w=0.2781 mse=0.2929 (n=16) t=800: w=0.2340 mse=0.2458 (n=16) | mean w=0.3232 mse=0.3381 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step3500.safetensors 4093 个张量 37.98 GB +step 3501/5000 loss 0.2644 (w 0.2647 mse 0.2777 t 933 new 0.23) lr 1.00e-05 gnorm 0.103 3.43s mem 81.1GB +step 3502/5000 loss 0.3094 (w 0.2686 mse 0.2749 t 836 new 0.21) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +step 3503/5000 loss 0.2616 (w 0.3878 mse 0.4000 t 994 new 0.17) lr 1.00e-05 gnorm 0.108 3.04s mem 81.1GB +step 3504/5000 loss 0.2325 (w 0.3506 mse 0.3767 t 995 new 0.13) lr 1.00e-05 gnorm 0.098 3.13s mem 81.1GB +step 3505/5000 loss 0.2852 (w 0.2474 mse 0.2590 t 557 new 0.11) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +step 3506/5000 loss 0.3231 (w 0.2996 mse 0.3179 t 992 new 0.22) lr 1.00e-05 gnorm 0.898 2.83s mem 81.1GB +step 3507/5000 loss 0.2146 (w 0.4368 mse 0.4322 t 997 new 0.25) lr 1.00e-05 gnorm 0.212 3.38s mem 81.1GB +step 3508/5000 loss 0.3153 (w 0.2622 mse 0.2684 t 842 new 0.22) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +step 3509/5000 loss 0.2758 (w 0.4020 mse 0.4127 t 999 new 0.21) lr 1.00e-05 gnorm 0.127 3.24s mem 81.1GB +step 3510/5000 loss 0.1657 (w 0.3704 mse 0.3717 t 975 new 0.23) lr 1.00e-05 gnorm 0.117 3.32s mem 81.1GB +step 3511/5000 loss 0.2527 (w 0.3129 mse 0.3300 t 957 new 0.21) lr 1.00e-05 gnorm 0.162 2.85s mem 81.1GB +step 3512/5000 loss 0.2266 (w 0.1905 mse 0.2122 t 922 new 0.22) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +step 3513/5000 loss 0.3339 (w 0.3411 mse 0.3573 t 238 new 0.15) lr 1.00e-05 gnorm 0.122 3.27s mem 81.1GB +step 3514/5000 loss 0.2668 (w 0.3289 mse 0.3462 t 996 new 0.23) lr 1.00e-05 gnorm 0.180 2.85s mem 81.1GB +step 3515/5000 loss 0.3654 (w 0.2626 mse 0.2717 t 866 new 0.11) lr 1.00e-05 gnorm 0.279 3.42s mem 81.1GB +step 3516/5000 loss 0.2375 (w 0.2605 mse 0.2619 t 609 new 0.21) lr 1.00e-05 gnorm 0.151 3.11s mem 81.1GB +step 3517/5000 loss 0.4018 (w 0.2221 mse 0.2352 t 864 new 0.24) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +step 3518/5000 loss 0.2606 (w 0.5001 mse 0.4962 t 996 new 0.28) lr 1.00e-05 gnorm 0.137 3.12s mem 81.1GB +step 3519/5000 loss 0.4545 (w 0.2336 mse 0.2326 t 845 new 0.21) lr 1.00e-05 gnorm 0.112 3.04s mem 81.1GB +step 3520/5000 loss 0.2582 (w 0.3380 mse 0.3456 t 996 new 0.22) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +step 3521/5000 loss 0.4482 (w 0.3920 mse 0.3861 t 264 new 0.22) lr 1.00e-05 gnorm 0.111 3.33s mem 81.1GB +step 3522/5000 loss 0.2844 (w 0.2821 mse 0.2791 t 804 new 0.16) lr 1.00e-05 gnorm 0.132 3.06s mem 81.1GB +step 3523/5000 loss 0.0882 (w 0.2211 mse 0.2335 t 996 new 0.22) lr 1.00e-05 gnorm 0.267 2.98s mem 81.1GB +step 3524/5000 loss 0.3659 (w 0.3233 mse 0.3291 t 872 new 0.25) lr 1.00e-05 gnorm 0.289 3.38s mem 81.1GB +step 3525/5000 loss 0.2283 (w 0.2703 mse 0.2812 t 798 new 0.22) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +step 3526/5000 loss 0.2186 (w 0.3621 mse 0.3729 t 987 new 0.10) lr 1.00e-05 gnorm 0.106 2.84s mem 81.1GB +step 3527/5000 loss 0.3464 (w 0.2501 mse 0.2541 t 829 new 0.22) lr 1.00e-05 gnorm 0.173 3.30s mem 81.1GB +step 3528/5000 loss 0.4040 (w 0.2638 mse 0.2739 t 948 new 0.22) lr 1.00e-05 gnorm 0.116 2.85s mem 81.1GB +step 3529/5000 loss 0.3926 (w 0.2491 mse 0.2614 t 748 new 0.18) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +step 3530/5000 loss 0.2178 (w 0.4140 mse 0.4245 t 995 new 0.13) lr 1.00e-05 gnorm 0.167 3.14s mem 81.1GB +step 3531/5000 loss 0.3492 (w 0.3447 mse 0.3448 t 570 new 0.21) lr 1.00e-05 gnorm 0.113 3.06s mem 81.1GB +step 3532/5000 loss 0.2135 (w 0.3994 mse 0.4041 t 961 new 0.26) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +step 3533/5000 loss 0.2917 (w 0.2922 mse 0.3017 t 931 new 0.23) lr 1.00e-05 gnorm 0.143 3.20s mem 81.1GB +step 3534/5000 loss 0.3855 (w 0.3021 mse 0.3142 t 470 new 0.23) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +step 3535/5000 loss 0.1928 (w 0.2091 mse 0.2150 t 839 new 0.12) lr 1.00e-05 gnorm 0.098 3.12s mem 81.1GB +step 3536/5000 loss 0.2923 (w 0.3827 mse 0.3832 t 995 new 0.18) lr 1.00e-05 gnorm 0.195 3.07s mem 81.1GB +step 3537/5000 loss 0.2857 (w 0.2776 mse 0.2828 t 732 new 0.19) lr 1.00e-05 gnorm 0.162 3.05s mem 81.1GB +step 3538/5000 loss 0.2361 (w 0.3969 mse 0.3899 t 982 new 0.25) lr 1.00e-05 gnorm 0.118 3.08s mem 81.1GB +step 3539/5000 loss 0.2024 (w 0.4080 mse 0.4181 t 999 new 0.19) lr 1.00e-05 gnorm 0.142 3.32s mem 81.1GB +step 3540/5000 loss 0.1051 (w 0.2194 mse 0.2293 t 894 new 0.23) lr 1.00e-05 gnorm 0.281 2.84s mem 81.1GB +step 3541/5000 loss 0.4155 (w 0.3399 mse 0.3464 t 957 new 0.20) lr 1.00e-05 gnorm 0.100 3.11s mem 81.1GB +step 3542/5000 loss 0.3425 (w 0.2586 mse 0.2634 t 823 new 0.19) lr 1.00e-05 gnorm 0.292 3.12s mem 81.1GB +step 3543/5000 loss 0.2886 (w 0.3668 mse 0.3804 t 998 new 0.26) lr 1.00e-05 gnorm 0.121 3.06s mem 81.1GB +step 3544/5000 loss 0.3069 (w 0.2406 mse 0.2522 t 672 new 0.18) lr 1.00e-05 gnorm 0.117 3.08s mem 81.1GB +step 3545/5000 loss 0.2301 (w 0.2045 mse 0.2283 t 879 new 0.25) lr 1.00e-05 gnorm 0.120 3.34s mem 81.1GB +step 3546/5000 loss 0.2470 (w 0.1743 mse 0.1924 t 955 new 0.15) lr 1.00e-05 gnorm 0.399 2.84s mem 81.1GB +step 3547/5000 loss 0.1827 (w 0.3382 mse 0.3408 t 927 new 0.24) lr 1.00e-05 gnorm 0.124 3.16s mem 81.1GB +step 3548/5000 loss 0.2474 (w 0.3114 mse 0.3266 t 981 new 0.17) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +step 3549/5000 loss 0.2298 (w 0.2066 mse 0.2260 t 911 new 0.24) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +step 3550/5000 loss 0.3753 (w 0.3910 mse 0.3874 t 934 new 0.24) lr 1.00e-05 gnorm 0.219 3.10s mem 81.1GB +step 3551/5000 loss 0.3479 (w 0.2506 mse 0.2677 t 826 new 0.21) lr 1.00e-05 gnorm 0.131 3.36s mem 81.1GB +step 3552/5000 loss 0.3804 (w 0.3358 mse 0.3617 t 988 new 0.20) lr 1.00e-05 gnorm 0.127 2.86s mem 81.1GB +step 3553/5000 loss 0.2816 (w 0.2145 mse 0.2236 t 851 new 0.19) lr 1.00e-05 gnorm 0.140 3.35s mem 81.1GB +step 3554/5000 loss 0.2572 (w 0.4485 mse 0.4564 t 996 new 0.23) lr 1.00e-05 gnorm 0.120 3.02s mem 81.1GB +step 3555/5000 loss 0.3204 (w 0.3265 mse 0.3393 t 981 new 0.26) lr 1.00e-05 gnorm 0.317 2.83s mem 81.1GB +step 3556/5000 loss 0.1892 (w 0.3555 mse 0.3524 t 923 new 0.21) lr 1.00e-05 gnorm 0.103 3.28s mem 81.1GB +step 3557/5000 loss 0.3140 (w 0.1408 mse 0.1593 t 910 new 0.13) lr 1.00e-05 gnorm 0.138 3.05s mem 81.1GB +step 3558/5000 loss 0.1463 (w 0.4473 mse 0.4432 t 995 new 0.23) lr 1.00e-05 gnorm 0.139 2.82s mem 81.1GB +step 3559/5000 loss 0.4283 (w 0.2454 mse 0.2695 t 588 new 0.19) lr 1.00e-05 gnorm 0.207 3.37s mem 81.1GB +step 3560/5000 loss 0.3057 (w 0.2620 mse 0.2685 t 865 new 0.14) lr 1.00e-05 gnorm 0.166 3.09s mem 81.1GB +step 3561/5000 loss 0.3001 (w 0.2610 mse 0.2649 t 878 new 0.21) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +step 3562/5000 loss 0.2491 (w 0.3139 mse 0.3325 t 978 new 0.21) lr 1.00e-05 gnorm 0.136 3.35s mem 81.1GB +step 3563/5000 loss 0.1902 (w 0.2876 mse 0.2966 t 956 new 0.24) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +step 3564/5000 loss 0.2373 (w 0.1884 mse 0.2127 t 719 new 0.19) lr 1.00e-05 gnorm 0.395 2.83s mem 81.1GB +step 3565/5000 loss 0.1301 (w 0.3635 mse 0.3640 t 984 new 0.22) lr 1.00e-05 gnorm 0.165 3.38s mem 81.1GB +step 3566/5000 loss 0.2525 (w 0.2610 mse 0.2609 t 933 new 0.15) lr 1.00e-05 gnorm 0.151 3.15s mem 81.1GB +step 3567/5000 loss 0.4658 (w 0.3060 mse 0.3195 t 456 new 0.23) lr 1.00e-05 gnorm 0.242 3.11s mem 81.1GB +step 3568/5000 loss 0.2121 (w 0.2440 mse 0.2520 t 830 new 0.25) lr 1.00e-05 gnorm 0.116 3.10s mem 81.1GB +step 3569/5000 loss 0.2580 (w 0.2134 mse 0.2327 t 939 new 0.15) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +step 3570/5000 loss 0.2139 (w 0.2827 mse 0.2907 t 775 new 0.25) lr 1.00e-05 gnorm 0.119 3.09s mem 81.1GB +step 3571/5000 loss 0.1812 (w 0.2139 mse 0.2250 t 916 new 0.23) lr 1.00e-05 gnorm 0.157 3.28s mem 81.1GB +step 3572/5000 loss 0.1807 (w 0.2396 mse 0.2694 t 973 new 0.21) lr 1.00e-05 gnorm 0.102 3.08s mem 81.1GB +step 3573/5000 loss 0.2003 (w 0.2713 mse 0.2712 t 928 new 0.27) lr 1.00e-05 gnorm 0.102 3.13s mem 81.1GB +step 3574/5000 loss 0.2846 (w 0.3091 mse 0.3227 t 999 new 0.14) lr 1.00e-05 gnorm 0.105 3.33s mem 81.1GB +step 3575/5000 loss 0.3213 (w 0.2097 mse 0.2176 t 740 new 0.22) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +step 3576/5000 loss 0.2096 (w 0.2381 mse 0.2592 t 979 new 0.23) lr 1.00e-05 gnorm 0.157 3.13s mem 81.1GB +step 3577/5000 loss 0.3137 (w 0.2139 mse 0.2259 t 854 new 0.10) lr 1.00e-05 gnorm 0.132 3.36s mem 81.1GB +step 3578/5000 loss 0.2100 (w 0.2647 mse 0.2710 t 920 new 0.18) lr 1.00e-05 gnorm 0.225 3.10s mem 81.1GB +step 3579/5000 loss 0.3089 (w 0.2622 mse 0.2587 t 828 new 0.20) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 3580/5000 loss 0.3393 (w 0.3587 mse 0.3611 t 700 new 0.24) lr 1.00e-05 gnorm 0.129 3.35s mem 81.1GB +step 3581/5000 loss 0.1622 (w 0.2875 mse 0.3047 t 992 new 0.16) lr 1.00e-05 gnorm 0.099 2.85s mem 81.1GB +step 3582/5000 loss 0.4485 (w 0.1321 mse 0.1400 t 634 new 0.06) lr 1.00e-05 gnorm 0.177 3.16s mem 81.1GB +step 3583/5000 loss 0.2154 (w 0.2885 mse 0.2931 t 768 new 0.21) lr 1.00e-05 gnorm 0.117 3.15s mem 81.1GB +step 3584/5000 loss 0.2482 (w 0.2902 mse 0.2833 t 628 new 0.16) lr 1.00e-05 gnorm 0.120 3.12s mem 81.1GB +step 3585/5000 loss 0.2320 (w 0.2965 mse 0.2954 t 680 new 0.23) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +step 3586/5000 loss 0.1921 (w 0.2563 mse 0.2602 t 705 new 0.14) lr 1.00e-05 gnorm 0.102 3.13s mem 81.1GB +step 3587/5000 loss 0.2808 (w 0.1873 mse 0.2028 t 904 new 0.23) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +step 3588/5000 loss 0.2614 (w 0.3638 mse 0.3678 t 356 new 0.19) lr 1.00e-05 gnorm 0.099 3.40s mem 81.1GB +step 3589/5000 loss 0.2025 (w 0.2294 mse 0.2526 t 923 new 0.24) lr 1.00e-05 gnorm 0.173 3.14s mem 81.1GB +step 3590/5000 loss 0.2155 (w 0.2451 mse 0.2499 t 948 new 0.21) lr 1.00e-05 gnorm 0.156 2.85s mem 81.1GB +step 3591/5000 loss 0.1810 (w 0.1877 mse 0.2061 t 884 new 0.26) lr 1.00e-05 gnorm 0.230 3.09s mem 81.1GB +step 3592/5000 loss 0.2298 (w 0.3082 mse 0.3063 t 950 new 0.22) lr 1.00e-05 gnorm 0.157 3.09s mem 81.1GB +step 3593/5000 loss 0.3962 (w 0.5213 mse 0.5282 t 288 new 0.21) lr 1.00e-05 gnorm 0.124 2.85s mem 81.1GB +step 3594/5000 loss 0.2862 (w 0.5304 mse 0.5788 t 127 new 0.23) lr 1.00e-05 gnorm 0.130 3.12s mem 81.1GB +step 3595/5000 loss 0.2770 (w 0.3065 mse 0.3094 t 758 new 0.19) lr 1.00e-05 gnorm 0.152 3.29s mem 81.1GB +step 3596/5000 loss 0.2139 (w 0.3603 mse 0.3711 t 967 new 0.20) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +step 3597/5000 loss 0.3060 (w 0.2329 mse 0.2512 t 975 new 0.26) lr 1.00e-05 gnorm 0.129 3.12s mem 81.1GB +step 3598/5000 loss 0.2733 (w 0.2696 mse 0.2735 t 728 new 0.23) lr 1.00e-05 gnorm 0.687 2.83s mem 81.1GB +step 3599/5000 loss 0.1449 (w 0.2750 mse 0.2833 t 972 new 0.20) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 3600/5000 loss 0.3817 (w 0.4787 mse 0.4831 t 269 new 0.24) lr 1.00e-05 gnorm 0.131 3.11s mem 81.1GB +step 3601/5000 loss 0.2853 (w 0.1941 mse 0.2102 t 657 new 0.24) lr 1.00e-05 gnorm 0.101 3.35s mem 81.1GB +step 3602/5000 loss 0.3389 (w 0.1587 mse 0.1692 t 612 new 0.13) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +step 3603/5000 loss 0.2632 (w 0.2998 mse 0.3043 t 937 new 0.22) lr 1.00e-05 gnorm 0.122 3.28s mem 81.1GB +step 3604/5000 loss 0.3831 (w 0.4431 mse 0.4548 t 310 new 0.14) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +step 3605/5000 loss 0.3013 (w 0.3230 mse 0.3186 t 909 new 0.26) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 3606/5000 loss 0.2163 (w 0.2439 mse 0.2463 t 868 new 0.22) lr 1.00e-05 gnorm 0.162 3.33s mem 81.1GB +step 3607/5000 loss 0.4379 (w 0.3936 mse 0.3988 t 973 new 0.17) lr 1.00e-05 gnorm 0.121 3.12s mem 81.1GB +step 3608/5000 loss 0.3745 (w 0.2552 mse 0.2512 t 725 new 0.06) lr 1.00e-05 gnorm 0.235 2.84s mem 81.1GB +step 3609/5000 loss 0.3003 (w 0.5529 mse 0.5638 t 140 new 0.13) lr 1.00e-05 gnorm 0.148 3.35s mem 81.1GB +step 3610/5000 loss 0.2481 (w 0.2077 mse 0.2124 t 822 new 0.21) lr 1.00e-05 gnorm 0.283 2.85s mem 81.1GB +step 3611/5000 loss 0.2312 (w 0.2380 mse 0.2637 t 976 new 0.16) lr 1.00e-05 gnorm 0.133 3.06s mem 81.1GB +step 3612/5000 loss 0.1824 (w 0.2523 mse 0.2760 t 954 new 0.20) lr 1.00e-05 gnorm 0.161 3.12s mem 81.1GB +step 3613/5000 loss 0.1536 (w 0.2395 mse 0.2580 t 729 new 0.21) lr 1.00e-05 gnorm 0.096 3.14s mem 81.1GB +step 3614/5000 loss 0.0799 (w 0.1938 mse 0.2192 t 915 new 0.22) lr 1.00e-05 gnorm 0.133 3.30s mem 81.1GB +step 3615/5000 loss 0.2325 (w 0.2646 mse 0.2644 t 781 new 0.19) lr 1.00e-05 gnorm 0.119 3.38s mem 81.1GB +step 3616/5000 loss 0.1975 (w 0.3149 mse 0.3209 t 676 new 0.24) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +step 3617/5000 loss 0.1639 (w 0.1947 mse 0.2165 t 844 new 0.22) lr 1.00e-05 gnorm 0.110 3.09s mem 81.1GB +step 3618/5000 loss 0.3312 (w 0.2426 mse 0.2583 t 947 new 0.19) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +step 3619/5000 loss 0.3264 (w 0.1913 mse 0.1950 t 772 new 0.07) lr 1.00e-05 gnorm 0.113 3.06s mem 81.1GB +step 3620/5000 loss 0.2694 (w 0.3132 mse 0.3255 t 721 new 0.19) lr 1.00e-05 gnorm 0.148 3.16s mem 81.1GB +step 3621/5000 loss 0.3613 (w 0.2790 mse 0.2800 t 811 new 0.26) lr 1.00e-05 gnorm 0.123 3.13s mem 81.1GB +step 3622/5000 loss 0.3515 (w 0.3696 mse 0.3766 t 479 new 0.19) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +step 3623/5000 loss 0.3882 (w 0.2525 mse 0.2625 t 642 new 0.23) lr 1.00e-05 gnorm 0.423 3.46s mem 81.1GB +step 3624/5000 loss 0.3809 (w 0.3377 mse 0.3398 t 970 new 0.18) lr 1.00e-05 gnorm 0.266 3.07s mem 81.1GB +step 3625/5000 loss 0.3576 (w 0.2464 mse 0.2584 t 760 new 0.20) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +step 3626/5000 loss 0.4837 (w 0.6295 mse 0.6236 t 153 new 0.24) lr 1.00e-05 gnorm 0.149 3.21s mem 81.1GB +step 3627/5000 loss 0.2705 (w 0.2834 mse 0.2870 t 997 new 0.23) lr 1.00e-05 gnorm 0.282 3.12s mem 81.1GB +step 3628/5000 loss 0.3179 (w 0.3285 mse 0.3320 t 945 new 0.23) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +step 3629/5000 loss 0.2350 (w 0.2144 mse 0.2290 t 865 new 0.21) lr 1.00e-05 gnorm 0.140 3.38s mem 81.1GB +step 3630/5000 loss 0.2531 (w 0.3818 mse 0.3866 t 969 new 0.19) lr 1.00e-05 gnorm 0.108 3.40s mem 81.1GB +step 3631/5000 loss 0.4321 (w 0.3447 mse 0.3478 t 787 new 0.18) lr 1.00e-05 gnorm 0.570 2.83s mem 81.1GB +step 3632/5000 loss 0.2028 (w 0.2597 mse 0.2716 t 959 new 0.15) lr 1.00e-05 gnorm 0.125 3.14s mem 81.1GB +step 3633/5000 loss 0.2461 (w 0.2672 mse 0.2672 t 444 new 0.17) lr 1.00e-05 gnorm 0.350 3.06s mem 81.1GB +step 3634/5000 loss 0.2986 (w 0.2869 mse 0.2843 t 890 new 0.22) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +step 3635/5000 loss 0.1958 (w 0.2579 mse 0.2628 t 885 new 0.25) lr 1.00e-05 gnorm 0.134 3.36s mem 81.1GB +step 3636/5000 loss 0.3646 (w 0.2119 mse 0.2272 t 975 new 0.12) lr 1.00e-05 gnorm 0.207 3.41s mem 81.1GB +step 3637/5000 loss 0.0916 (w 0.2612 mse 0.2745 t 972 new 0.24) lr 1.00e-05 gnorm 0.103 2.84s mem 81.1GB +step 3638/5000 loss 0.3959 (w 0.4142 mse 0.4012 t 936 new 0.25) lr 1.00e-05 gnorm 0.231 3.43s mem 81.1GB +step 3639/5000 loss 0.1607 (w 0.2476 mse 0.2582 t 817 new 0.23) lr 1.00e-05 gnorm 0.160 3.11s mem 81.1GB +step 3640/5000 loss 0.2403 (w 0.2290 mse 0.2411 t 947 new 0.21) lr 1.00e-05 gnorm 0.132 3.18s mem 81.1GB +step 3641/5000 loss 0.2551 (w 0.3247 mse 0.3308 t 836 new 0.26) lr 1.00e-05 gnorm 0.103 3.13s mem 81.1GB +step 3642/5000 loss 0.2059 (w 0.2368 mse 0.2465 t 962 new 0.21) lr 1.00e-05 gnorm 0.192 3.07s mem 81.1GB +step 3643/5000 loss 0.4091 (w 0.3623 mse 0.3855 t 955 new 0.25) lr 1.00e-05 gnorm 0.109 2.83s mem 81.1GB +step 3644/5000 loss 0.1616 (w 0.2982 mse 0.3201 t 957 new 0.23) lr 1.00e-05 gnorm 0.138 3.07s mem 81.1GB +step 3645/5000 loss 0.1415 (w 0.2051 mse 0.2066 t 629 new 0.10) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +step 3646/5000 loss 0.2868 (w 0.2737 mse 0.2860 t 704 new 0.19) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +step 3647/5000 loss 0.2687 (w 0.2626 mse 0.2622 t 774 new 0.19) lr 1.00e-05 gnorm 0.141 3.35s mem 81.1GB +step 3648/5000 loss 0.3689 (w 0.3346 mse 0.3272 t 918 new 0.24) lr 1.00e-05 gnorm 0.126 3.06s mem 81.1GB +step 3649/5000 loss 0.1905 (w 0.2644 mse 0.2830 t 926 new 0.26) lr 1.00e-05 gnorm 0.101 3.03s mem 81.1GB +step 3650/5000 loss 0.2192 (w 0.2704 mse 0.2823 t 934 new 0.22) lr 1.00e-05 gnorm 0.126 3.25s mem 81.1GB +step 3651/5000 loss 0.3782 (w 0.2343 mse 0.2436 t 865 new 0.16) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +step 3652/5000 loss 0.2623 (w 0.1746 mse 0.1771 t 817 new 0.17) lr 1.00e-05 gnorm 0.111 3.05s mem 81.1GB +step 3653/5000 loss 0.1287 (w 0.3152 mse 0.3182 t 997 new 0.27) lr 1.00e-05 gnorm 0.197 3.37s mem 81.1GB +step 3654/5000 loss 0.2425 (w 0.3085 mse 0.3271 t 975 new 0.16) lr 1.00e-05 gnorm 0.118 3.03s mem 81.1GB +step 3655/5000 loss 0.1646 (w 0.3180 mse 0.3453 t 962 new 0.21) lr 1.00e-05 gnorm 0.106 3.03s mem 81.1GB +step 3656/5000 loss 0.1998 (w 0.2820 mse 0.2916 t 492 new 0.24) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +step 3657/5000 loss 0.4615 (w 0.3350 mse 0.3427 t 915 new 0.18) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +step 3658/5000 loss 0.2285 (w 0.3109 mse 0.3096 t 966 new 0.16) lr 1.00e-05 gnorm 0.143 3.31s mem 81.1GB +step 3659/5000 loss 0.2068 (w 0.2863 mse 0.2885 t 973 new 0.24) lr 1.00e-05 gnorm 0.187 3.07s mem 81.1GB +step 3660/5000 loss 0.3288 (w 0.2944 mse 0.2923 t 917 new 0.19) lr 1.00e-05 gnorm 0.335 3.04s mem 81.1GB +step 3661/5000 loss 0.2855 (w 0.4412 mse 0.4362 t 941 new 0.18) lr 1.00e-05 gnorm 0.125 3.07s mem 81.1GB +step 3662/5000 loss 0.2867 (w 0.2783 mse 0.2931 t 836 new 0.20) lr 1.00e-05 gnorm 0.198 3.01s mem 81.1GB +step 3663/5000 loss 0.4308 (w 0.3184 mse 0.3216 t 709 new 0.19) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +step 3664/5000 loss 0.2854 (w 0.3382 mse 0.3464 t 348 new 0.23) lr 1.00e-05 gnorm 0.150 3.27s mem 81.1GB +step 3665/5000 loss 0.2884 (w 0.3578 mse 0.3688 t 372 new 0.17) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +step 3666/5000 loss 0.1774 (w 0.2348 mse 0.2555 t 847 new 0.22) lr 1.00e-05 gnorm 0.119 3.05s mem 81.1GB +step 3667/5000 loss 0.3578 (w 0.3017 mse 0.3105 t 848 new 0.15) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 3668/5000 loss 0.2932 (w 0.2184 mse 0.2439 t 944 new 0.17) lr 1.00e-05 gnorm 0.136 3.03s mem 81.1GB +step 3669/5000 loss 0.4403 (w 0.2442 mse 0.2525 t 690 new 0.17) lr 1.00e-05 gnorm 0.156 2.83s mem 81.1GB +step 3670/5000 loss 0.3405 (w 0.2873 mse 0.2944 t 574 new 0.21) lr 1.00e-05 gnorm 0.107 3.17s mem 81.1GB +step 3671/5000 loss 0.1833 (w 0.2857 mse 0.2996 t 987 new 0.20) lr 1.00e-05 gnorm 0.218 3.06s mem 81.1GB +step 3672/5000 loss 0.2713 (w 0.2610 mse 0.2845 t 988 new 0.25) lr 1.00e-05 gnorm 0.183 3.10s mem 81.1GB +step 3673/5000 loss 0.2151 (w 0.2189 mse 0.2227 t 887 new 0.09) lr 1.00e-05 gnorm 0.116 3.33s mem 81.1GB +step 3674/5000 loss 0.1919 (w 0.2374 mse 0.2531 t 903 new 0.14) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +step 3675/5000 loss 0.2612 (w 0.3216 mse 0.3179 t 903 new 0.24) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +step 3676/5000 loss 0.1791 (w 0.1885 mse 0.2130 t 936 new 0.25) lr 1.00e-05 gnorm 0.139 3.18s mem 81.1GB +step 3677/5000 loss 0.4204 (w 0.2670 mse 0.2637 t 774 new 0.08) lr 1.00e-05 gnorm 0.119 3.10s mem 81.1GB +step 3678/5000 loss 0.4044 (w 0.2695 mse 0.2862 t 953 new 0.20) lr 1.00e-05 gnorm 0.164 3.33s mem 81.1GB +step 3679/5000 loss 0.4716 (w 0.3304 mse 0.3408 t 672 new 0.22) lr 1.00e-05 gnorm 0.105 3.33s mem 81.1GB +step 3680/5000 loss 0.1952 (w 0.3295 mse 0.3362 t 977 new 0.10) lr 1.00e-05 gnorm 0.185 2.84s mem 81.1GB +step 3681/5000 loss 0.2310 (w 0.2150 mse 0.2422 t 866 new 0.23) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 3682/5000 loss 0.2690 (w 0.2664 mse 0.2700 t 947 new 0.18) lr 1.00e-05 gnorm 0.164 3.49s mem 81.1GB +step 3683/5000 loss 0.2682 (w 0.3125 mse 0.3099 t 961 new 0.18) lr 1.00e-05 gnorm 0.115 3.37s mem 81.1GB +step 3684/5000 loss 0.3639 (w 0.4005 mse 0.4042 t 930 new 0.18) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +step 3685/5000 loss 0.2128 (w 0.3576 mse 0.3676 t 999 new 0.19) lr 1.00e-05 gnorm 0.235 3.26s mem 81.1GB +step 3686/5000 loss 0.2248 (w 0.3071 mse 0.3149 t 979 new 0.29) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +step 3687/5000 loss 0.2505 (w 0.2184 mse 0.2408 t 781 new 0.16) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 3688/5000 loss 0.2864 (w 0.2639 mse 0.2695 t 840 new 0.12) lr 1.00e-05 gnorm 0.131 3.37s mem 81.1GB +step 3689/5000 loss 0.5251 (w 0.2402 mse 0.2487 t 796 new 0.19) lr 1.00e-05 gnorm 0.236 3.09s mem 81.1GB +step 3690/5000 loss 0.2874 (w 0.2450 mse 0.2563 t 730 new 0.16) lr 1.00e-05 gnorm 0.170 3.10s mem 81.1GB +step 3691/5000 loss 0.2334 (w 0.3394 mse 0.3404 t 607 new 0.15) lr 1.00e-05 gnorm 0.245 3.33s mem 81.1GB +step 3692/5000 loss 0.2896 (w 0.1883 mse 0.2085 t 718 new 0.20) lr 1.00e-05 gnorm 0.111 2.85s mem 81.1GB +step 3693/5000 loss 0.2992 (w 0.3065 mse 0.3162 t 712 new 0.23) lr 1.00e-05 gnorm 0.184 2.85s mem 81.1GB +step 3694/5000 loss 0.1760 (w 0.2119 mse 0.2267 t 921 new 0.25) lr 1.00e-05 gnorm 0.128 3.43s mem 81.1GB +step 3695/5000 loss 0.3117 (w 0.2737 mse 0.2666 t 929 new 0.19) lr 1.00e-05 gnorm 0.265 3.07s mem 81.1GB +step 3696/5000 loss 0.2160 (w 0.4350 mse 0.4407 t 983 new 0.27) lr 1.00e-05 gnorm 0.190 3.12s mem 81.1GB +step 3697/5000 loss 0.4231 (w 0.1916 mse 0.2068 t 820 new 0.15) lr 1.00e-05 gnorm 0.113 3.46s mem 81.1GB +step 3698/5000 loss 0.3269 (w 0.1741 mse 0.1817 t 787 new 0.19) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +step 3699/5000 loss 0.4176 (w 0.3904 mse 0.3963 t 991 new 0.15) lr 1.00e-05 gnorm 0.163 2.83s mem 81.1GB +step 3700/5000 loss 0.2322 (w 0.2151 mse 0.2268 t 672 new 0.07) lr 1.00e-05 gnorm 0.149 3.35s mem 81.1GB +step 3701/5000 loss 0.4727 (w 0.2788 mse 0.2770 t 912 new 0.23) lr 1.00e-05 gnorm 0.131 3.08s mem 81.1GB +step 3702/5000 loss 0.2614 (w 0.2739 mse 0.2741 t 785 new 0.27) lr 1.00e-05 gnorm 0.127 3.48s mem 81.1GB +step 3703/5000 loss 0.3660 (w 0.3186 mse 0.3292 t 866 new 0.16) lr 1.00e-05 gnorm 0.131 3.08s mem 81.1GB +step 3704/5000 loss 0.2857 (w 0.6451 mse 0.6395 t 120 new 0.22) lr 1.00e-05 gnorm 0.183 2.86s mem 81.1GB +step 3705/5000 loss 0.1410 (w 0.3555 mse 0.3536 t 962 new 0.27) lr 1.00e-05 gnorm 0.101 3.37s mem 81.1GB +step 3706/5000 loss 0.3333 (w 0.4073 mse 0.4071 t 977 new 0.18) lr 1.00e-05 gnorm 0.115 3.10s mem 81.1GB +step 3707/5000 loss 0.3168 (w 0.3306 mse 0.3326 t 557 new 0.21) lr 1.00e-05 gnorm 0.140 3.12s mem 81.1GB +step 3708/5000 loss 0.1570 (w 0.2217 mse 0.2186 t 650 new 0.16) lr 1.00e-05 gnorm 0.113 3.51s mem 81.1GB +step 3709/5000 loss 0.3172 (w 0.6204 mse 0.6293 t 159 new 0.21) lr 1.00e-05 gnorm 0.113 2.83s mem 81.1GB +step 3710/5000 loss 0.3410 (w 0.2554 mse 0.2674 t 961 new 0.17) lr 1.00e-05 gnorm 0.247 2.84s mem 81.1GB +step 3711/5000 loss 0.1966 (w 0.1967 mse 0.2042 t 873 new 0.22) lr 1.00e-05 gnorm 0.138 3.09s mem 81.1GB +step 3712/5000 loss 0.2808 (w 0.1798 mse 0.1840 t 909 new 0.17) lr 1.00e-05 gnorm 0.110 3.27s mem 81.1GB +step 3713/5000 loss 0.2588 (w 0.2502 mse 0.2677 t 991 new 0.12) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 3714/5000 loss 0.3345 (w 0.2534 mse 0.2558 t 946 new 0.19) lr 1.00e-05 gnorm 0.123 3.24s mem 81.1GB +step 3715/5000 loss 0.2472 (w 0.5333 mse 0.5529 t 140 new 0.08) lr 1.00e-05 gnorm 0.085 2.84s mem 81.1GB +step 3716/5000 loss 0.3992 (w 0.4236 mse 0.3953 t 964 new 0.23) lr 1.00e-05 gnorm 0.117 2.85s mem 81.1GB +step 3717/5000 loss 0.3748 (w 0.2410 mse 0.2555 t 981 new 0.19) lr 1.00e-05 gnorm 0.169 3.38s mem 81.1GB +step 3718/5000 loss 0.3179 (w 0.4139 mse 0.4072 t 977 new 0.18) lr 1.00e-05 gnorm 0.101 3.39s mem 81.1GB +step 3719/5000 loss 0.2255 (w 0.2940 mse 0.3067 t 959 new 0.26) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +step 3720/5000 loss 0.1384 (w 0.2142 mse 0.2357 t 721 new 0.20) lr 1.00e-05 gnorm 0.113 3.30s mem 81.1GB +step 3721/5000 loss 0.2898 (w 0.3649 mse 0.3621 t 960 new 0.26) lr 1.00e-05 gnorm 0.325 2.84s mem 81.1GB +step 3722/5000 loss 0.3220 (w 0.3237 mse 0.3137 t 963 new 0.21) lr 1.00e-05 gnorm 0.154 2.85s mem 81.1GB +step 3723/5000 loss 0.3200 (w 0.3821 mse 0.3977 t 249 new 0.18) lr 1.00e-05 gnorm 0.127 3.42s mem 81.1GB +step 3724/5000 loss 0.3940 (w 0.4837 mse 0.4901 t 992 new 0.21) lr 1.00e-05 gnorm 0.090 3.28s mem 81.1GB +step 3725/5000 loss 0.2583 (w 0.2014 mse 0.2267 t 923 new 0.22) lr 1.00e-05 gnorm 0.106 3.03s mem 81.1GB +step 3726/5000 loss 0.1102 (w 0.2713 mse 0.2805 t 918 new 0.23) lr 1.00e-05 gnorm 0.109 3.09s mem 81.1GB +step 3727/5000 loss 0.1927 (w 0.3118 mse 0.3224 t 980 new 0.20) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +step 3728/5000 loss 0.2352 (w 0.2782 mse 0.2684 t 934 new 0.21) lr 1.00e-05 gnorm 0.242 3.04s mem 81.1GB +step 3729/5000 loss 0.3286 (w 0.4526 mse 0.4572 t 368 new 0.20) lr 1.00e-05 gnorm 0.141 3.11s mem 81.1GB +step 3730/5000 loss 0.2580 (w 0.2244 mse 0.2389 t 878 new 0.19) lr 1.00e-05 gnorm 0.128 3.34s mem 81.1GB +step 3731/5000 loss 0.4195 (w 0.2512 mse 0.2590 t 619 new 0.16) lr 1.00e-05 gnorm 0.109 3.04s mem 81.1GB +step 3732/5000 loss 0.2905 (w 0.2803 mse 0.2889 t 695 new 0.24) lr 1.00e-05 gnorm 0.209 3.15s mem 81.1GB +step 3733/5000 loss 0.2576 (w 0.3283 mse 0.3205 t 872 new 0.23) lr 1.00e-05 gnorm 0.234 2.85s mem 81.1GB +step 3734/5000 loss 0.2103 (w 0.2727 mse 0.2709 t 827 new 0.22) lr 1.00e-05 gnorm 0.198 3.06s mem 81.1GB +step 3735/5000 loss 0.4057 (w 0.2781 mse 0.2843 t 619 new 0.16) lr 1.00e-05 gnorm 0.356 3.11s mem 81.1GB +step 3736/5000 loss 0.0937 (w 0.3286 mse 0.3365 t 954 new 0.24) lr 1.00e-05 gnorm 0.109 3.14s mem 81.1GB +step 3737/5000 loss 0.4021 (w 0.2865 mse 0.2857 t 829 new 0.22) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +step 3738/5000 loss 0.2346 (w 0.2821 mse 0.2870 t 730 new 0.23) lr 1.00e-05 gnorm 0.195 3.13s mem 81.1GB +step 3739/5000 loss 0.3671 (w 0.2804 mse 0.2941 t 948 new 0.17) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +step 3740/5000 loss 0.2733 (w 0.2618 mse 0.2696 t 977 new 0.21) lr 1.00e-05 gnorm 0.193 3.37s mem 81.1GB +step 3741/5000 loss 0.2928 (w 0.1794 mse 0.1919 t 942 new 0.20) lr 1.00e-05 gnorm 0.362 2.85s mem 81.1GB +step 3742/5000 loss 0.2268 (w 0.2824 mse 0.2885 t 901 new 0.24) lr 1.00e-05 gnorm 0.206 3.07s mem 81.1GB +step 3743/5000 loss 0.2882 (w 0.3422 mse 0.3532 t 348 new 0.19) lr 1.00e-05 gnorm 0.486 3.10s mem 81.1GB +step 3744/5000 loss 0.3643 (w 0.1922 mse 0.1997 t 870 new 0.17) lr 1.00e-05 gnorm 0.114 3.11s mem 81.1GB +step 3745/5000 loss 0.4469 (w 0.2988 mse 0.3004 t 943 new 0.19) lr 1.00e-05 gnorm 0.199 2.84s mem 81.1GB +step 3746/5000 loss 0.2846 (w 0.1930 mse 0.2069 t 659 new 0.21) lr 1.00e-05 gnorm 0.119 3.60s mem 81.1GB +step 3747/5000 loss 0.5676 (w 0.2293 mse 0.2489 t 702 new 0.24) lr 1.00e-05 gnorm 0.116 3.07s mem 81.1GB +step 3748/5000 loss 0.3515 (w 0.2619 mse 0.2698 t 892 new 0.19) lr 1.00e-05 gnorm 0.268 3.10s mem 81.1GB +step 3749/5000 loss 0.2858 (w 0.2053 mse 0.2107 t 802 new 0.20) lr 1.00e-05 gnorm 0.181 3.14s mem 81.1GB +step 3750/5000 loss 0.2402 (w 0.3245 mse 0.3148 t 863 new 0.19) lr 1.00e-05 gnorm 0.125 3.09s mem 81.1GB +step 3751/5000 loss 0.2478 (w 0.3655 mse 0.3677 t 942 new 0.25) lr 1.00e-05 gnorm 0.196 2.85s mem 81.1GB +step 3752/5000 loss 0.3722 (w 0.3213 mse 0.3211 t 692 new 0.09) lr 1.00e-05 gnorm 0.142 3.49s mem 81.1GB +step 3753/5000 loss 0.1663 (w 0.2894 mse 0.2973 t 953 new 0.17) lr 1.00e-05 gnorm 0.116 3.13s mem 81.1GB +step 3754/5000 loss 0.4096 (w 0.2275 mse 0.2327 t 711 new 0.11) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +step 3755/5000 loss 0.2741 (w 0.2625 mse 0.2654 t 264 new 0.10) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +step 3756/5000 loss 0.3586 (w 0.5939 mse 0.6053 t 171 new 0.22) lr 1.00e-05 gnorm 0.157 3.11s mem 81.1GB +step 3757/5000 loss 0.2749 (w 0.2277 mse 0.2451 t 680 new 0.17) lr 1.00e-05 gnorm 0.110 2.84s mem 81.1GB +step 3758/5000 loss 0.3256 (w 0.4100 mse 0.4224 t 288 new 0.19) lr 1.00e-05 gnorm 0.137 3.36s mem 81.1GB +step 3759/5000 loss 0.3358 (w 0.3271 mse 0.3275 t 972 new 0.18) lr 1.00e-05 gnorm 0.118 3.08s mem 81.1GB +step 3760/5000 loss 0.2454 (w 0.4204 mse 0.4225 t 301 new 0.26) lr 1.00e-05 gnorm 0.092 2.83s mem 81.1GB +step 3761/5000 loss 0.3428 (w 0.4223 mse 0.4239 t 969 new 0.24) lr 1.00e-05 gnorm 0.130 3.35s mem 81.1GB +step 3762/5000 loss 0.2049 (w 0.2920 mse 0.2838 t 901 new 0.17) lr 1.00e-05 gnorm 0.113 3.03s mem 81.1GB +step 3763/5000 loss 0.3235 (w 0.2470 mse 0.2479 t 908 new 0.19) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +step 3764/5000 loss 0.2196 (w 0.2343 mse 0.2504 t 943 new 0.24) lr 1.00e-05 gnorm 0.163 3.29s mem 81.1GB +step 3765/5000 loss 0.2362 (w 0.1501 mse 0.1669 t 832 new 0.16) lr 1.00e-05 gnorm 0.143 3.39s mem 81.1GB +step 3766/5000 loss 0.1686 (w 0.2424 mse 0.2556 t 933 new 0.22) lr 1.00e-05 gnorm 0.134 3.02s mem 81.1GB +step 3767/5000 loss 0.3723 (w 0.2226 mse 0.2259 t 789 new 0.23) lr 1.00e-05 gnorm 0.168 3.32s mem 81.1GB +step 3768/5000 loss 0.2147 (w 0.2384 mse 0.2491 t 882 new 0.22) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +step 3769/5000 loss 0.2770 (w 0.3271 mse 0.3177 t 982 new 0.15) lr 1.00e-05 gnorm 0.141 3.03s mem 81.1GB +step 3770/5000 loss 0.4311 (w 0.2303 mse 0.2631 t 958 new 0.22) lr 1.00e-05 gnorm 0.111 3.18s mem 81.1GB +step 3771/5000 loss 0.2164 (w 0.3661 mse 0.3659 t 988 new 0.17) lr 1.00e-05 gnorm 0.142 3.44s mem 81.1GB +step 3772/5000 loss 0.4074 (w 0.2273 mse 0.2365 t 914 new 0.20) lr 1.00e-05 gnorm 0.145 3.07s mem 81.1GB +step 3773/5000 loss 0.2282 (w 0.2363 mse 0.2433 t 936 new 0.21) lr 1.00e-05 gnorm 0.226 3.10s mem 81.1GB +step 3774/5000 loss 0.3732 (w 0.3012 mse 0.3035 t 969 new 0.23) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +step 3775/5000 loss 0.4809 (w 0.2654 mse 0.2828 t 987 new 0.20) lr 1.00e-05 gnorm 0.122 3.05s mem 81.1GB +step 3776/5000 loss 0.3658 (w 0.1732 mse 0.1827 t 677 new 0.22) lr 1.00e-05 gnorm 0.108 3.15s mem 81.1GB +step 3777/5000 loss 0.5564 (w 0.3716 mse 0.3813 t 379 new 0.28) lr 1.00e-05 gnorm 0.112 3.15s mem 81.1GB +step 3778/5000 loss 0.1842 (w 0.2646 mse 0.2672 t 923 new 0.11) lr 1.00e-05 gnorm 0.110 3.26s mem 81.1GB +step 3779/5000 loss 0.2110 (w 0.2386 mse 0.2319 t 881 new 0.07) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +step 3780/5000 loss 0.1853 (w 0.2696 mse 0.2807 t 875 new 0.16) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +step 3781/5000 loss 0.3565 (w 0.2179 mse 0.2332 t 490 new 0.10) lr 1.00e-05 gnorm 0.154 3.06s mem 81.1GB +step 3782/5000 loss 0.2741 (w 0.2127 mse 0.2209 t 680 new 0.15) lr 1.00e-05 gnorm 0.108 3.18s mem 81.1GB +step 3783/5000 loss 0.3688 (w 0.2495 mse 0.2703 t 915 new 0.20) lr 1.00e-05 gnorm 0.128 3.11s mem 81.1GB +step 3784/5000 loss 0.3196 (w 0.2375 mse 0.2436 t 328 new 0.13) lr 1.00e-05 gnorm 0.119 3.28s mem 81.1GB +step 3785/5000 loss 0.1673 (w 0.2363 mse 0.2605 t 983 new 0.17) lr 1.00e-05 gnorm 0.115 3.05s mem 81.1GB +step 3786/5000 loss 0.2844 (w 0.2577 mse 0.2671 t 838 new 0.26) lr 1.00e-05 gnorm 0.135 2.83s mem 81.1GB +step 3787/5000 loss 0.0979 (w 0.2935 mse 0.2879 t 941 new 0.09) lr 1.00e-05 gnorm 0.362 3.10s mem 81.1GB +step 3788/5000 loss 0.1810 (w 0.3241 mse 0.3268 t 957 new 0.24) lr 1.00e-05 gnorm 0.308 3.14s mem 81.1GB +step 3789/5000 loss 0.3670 (w 0.3409 mse 0.3576 t 965 new 0.23) lr 1.00e-05 gnorm 0.151 3.13s mem 81.1GB +step 3790/5000 loss 0.2577 (w 0.3455 mse 0.3488 t 495 new 0.24) lr 1.00e-05 gnorm 0.146 3.40s mem 81.1GB +step 3791/5000 loss 0.3202 (w 0.3465 mse 0.3527 t 929 new 0.23) lr 1.00e-05 gnorm 0.099 3.33s mem 81.1GB +step 3792/5000 loss 0.3633 (w 0.3427 mse 0.3460 t 994 new 0.22) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +step 3793/5000 loss 0.2664 (w 0.3090 mse 0.3081 t 970 new 0.18) lr 1.00e-05 gnorm 0.094 3.54s mem 81.1GB +step 3794/5000 loss 0.3192 (w 0.2315 mse 0.2476 t 770 new 0.18) lr 1.00e-05 gnorm 0.164 3.06s mem 81.1GB +step 3795/5000 loss 0.2821 (w 0.2795 mse 0.2857 t 930 new 0.12) lr 1.00e-05 gnorm 0.243 3.05s mem 81.1GB +step 3796/5000 loss 0.2240 (w 0.2705 mse 0.2765 t 961 new 0.16) lr 1.00e-05 gnorm 0.105 3.08s mem 81.1GB +step 3797/5000 loss 0.1349 (w 0.1738 mse 0.1811 t 894 new 0.17) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +step 3798/5000 loss 0.1651 (w 0.2207 mse 0.2455 t 540 new 0.28) lr 1.00e-05 gnorm 0.116 2.85s mem 81.1GB +step 3799/5000 loss 0.1388 (w 0.2585 mse 0.2582 t 855 new 0.20) lr 1.00e-05 gnorm 0.111 3.40s mem 81.1GB +step 3800/5000 loss 0.1331 (w 0.3458 mse 0.3443 t 998 new 0.23) lr 1.00e-05 gnorm 0.149 3.11s mem 81.1GB +step 3801/5000 loss 0.2326 (w 0.2253 mse 0.2301 t 937 new 0.23) lr 1.00e-05 gnorm 0.113 3.04s mem 81.1GB +step 3802/5000 loss 0.1860 (w 0.3070 mse 0.3077 t 929 new 0.24) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +step 3803/5000 loss 0.2865 (w 0.2814 mse 0.2914 t 735 new 0.23) lr 1.00e-05 gnorm 0.128 3.12s mem 81.1GB +step 3804/5000 loss 0.1894 (w 0.3266 mse 0.3397 t 958 new 0.18) lr 1.00e-05 gnorm 0.127 3.30s mem 81.1GB +step 3805/5000 loss 0.1847 (w 0.1754 mse 0.1942 t 842 new 0.13) lr 1.00e-05 gnorm 0.118 3.15s mem 81.1GB +step 3806/5000 loss 0.1807 (w 0.2600 mse 0.2643 t 887 new 0.17) lr 1.00e-05 gnorm 0.147 3.39s mem 81.1GB +step 3807/5000 loss 0.2868 (w 0.2937 mse 0.2852 t 846 new 0.22) lr 1.00e-05 gnorm 0.130 3.09s mem 81.1GB +step 3808/5000 loss 0.2814 (w 0.2800 mse 0.2874 t 972 new 0.21) lr 1.00e-05 gnorm 0.155 3.08s mem 81.1GB +step 3809/5000 loss 0.3820 (w 0.3304 mse 0.3373 t 964 new 0.24) lr 1.00e-05 gnorm 0.388 3.08s mem 81.1GB +step 3810/5000 loss 0.2491 (w 0.2639 mse 0.2716 t 925 new 0.19) lr 1.00e-05 gnorm 0.157 3.04s mem 81.1GB +step 3811/5000 loss 0.3445 (w 0.2510 mse 0.2626 t 684 new 0.16) lr 1.00e-05 gnorm 0.263 3.18s mem 81.1GB +step 3812/5000 loss 0.4400 (w 0.2796 mse 0.3065 t 379 new 0.23) lr 1.00e-05 gnorm 0.134 3.33s mem 81.1GB +step 3813/5000 loss 0.4447 (w 0.4166 mse 0.4209 t 411 new 0.16) lr 1.00e-05 gnorm 0.177 3.11s mem 81.1GB +step 3814/5000 loss 0.1813 (w 0.2851 mse 0.2852 t 923 new 0.22) lr 1.00e-05 gnorm 0.123 3.34s mem 81.1GB +step 3815/5000 loss 0.3592 (w 0.2192 mse 0.2394 t 867 new 0.22) lr 1.00e-05 gnorm 0.119 3.03s mem 81.1GB +step 3816/5000 loss 0.2652 (w 0.3046 mse 0.3040 t 921 new 0.10) lr 1.00e-05 gnorm 0.101 3.09s mem 81.1GB +step 3817/5000 loss 0.2232 (w 0.3042 mse 0.2986 t 780 new 0.18) lr 1.00e-05 gnorm 0.136 3.12s mem 81.1GB +step 3818/5000 loss 0.4732 (w 0.2415 mse 0.2435 t 834 new 0.07) lr 1.00e-05 gnorm 0.141 3.35s mem 81.1GB +step 3819/5000 loss 0.2460 (w 0.3987 mse 0.4115 t 996 new 0.16) lr 1.00e-05 gnorm 0.138 3.04s mem 81.1GB +step 3820/5000 loss 0.2561 (w 0.2267 mse 0.2364 t 969 new 0.13) lr 1.00e-05 gnorm 0.101 3.33s mem 81.1GB +step 3821/5000 loss 0.2062 (w 0.2910 mse 0.2990 t 621 new 0.21) lr 1.00e-05 gnorm 0.125 3.03s mem 81.1GB +step 3822/5000 loss 0.1260 (w 0.3327 mse 0.3322 t 972 new 0.18) lr 1.00e-05 gnorm 0.102 3.06s mem 81.1GB +step 3823/5000 loss 0.1486 (w 0.1884 mse 0.2185 t 992 new 0.18) lr 1.00e-05 gnorm 0.138 3.15s mem 81.1GB +step 3824/5000 loss 0.1779 (w 0.5320 mse 0.5470 t 120 new 0.21) lr 1.00e-05 gnorm 0.115 3.46s mem 81.1GB +step 3825/5000 loss 0.2963 (w 0.2715 mse 0.2830 t 866 new 0.24) lr 1.00e-05 gnorm 0.226 3.07s mem 81.1GB +step 3826/5000 loss 0.1809 (w 0.1298 mse 0.1384 t 840 new 0.07) lr 1.00e-05 gnorm 0.113 3.05s mem 81.1GB +step 3827/5000 loss 0.2645 (w 0.2574 mse 0.2605 t 992 new 0.12) lr 1.00e-05 gnorm 0.443 3.28s mem 81.1GB +step 3828/5000 loss 0.1614 (w 0.3697 mse 0.3723 t 978 new 0.20) lr 1.00e-05 gnorm 0.182 3.33s mem 81.1GB +step 3829/5000 loss 0.1714 (w 0.2086 mse 0.2119 t 919 new 0.21) lr 1.00e-05 gnorm 0.116 3.16s mem 81.1GB +step 3830/5000 loss 0.3742 (w 0.2670 mse 0.2853 t 910 new 0.23) lr 1.00e-05 gnorm 0.119 3.29s mem 81.1GB +step 3831/5000 loss 0.2496 (w 0.2362 mse 0.2527 t 847 new 0.12) lr 1.00e-05 gnorm 0.162 2.85s mem 81.1GB +step 3832/5000 loss 0.2614 (w 0.3590 mse 0.3640 t 945 new 0.20) lr 1.00e-05 gnorm 0.124 3.31s mem 81.1GB +step 3833/5000 loss 0.3195 (w 0.2960 mse 0.3044 t 530 new 0.25) lr 1.00e-05 gnorm 0.114 3.30s mem 81.1GB +step 3834/5000 loss 0.3380 (w 0.1814 mse 0.2065 t 790 new 0.21) lr 1.00e-05 gnorm 0.123 3.30s mem 81.1GB +step 3835/5000 loss 0.2780 (w 0.2735 mse 0.2773 t 516 new 0.16) lr 1.00e-05 gnorm 0.155 3.15s mem 81.1GB +step 3836/5000 loss 0.2854 (w 0.2364 mse 0.2398 t 759 new 0.20) lr 1.00e-05 gnorm 0.118 3.30s mem 81.1GB +step 3837/5000 loss 0.1372 (w 0.1963 mse 0.2052 t 826 new 0.07) lr 1.00e-05 gnorm 0.108 2.83s mem 81.1GB +step 3838/5000 loss 0.1859 (w 0.3129 mse 0.3190 t 961 new 0.21) lr 1.00e-05 gnorm 0.109 3.27s mem 81.1GB +step 3839/5000 loss 0.2281 (w 0.2802 mse 0.2864 t 930 new 0.13) lr 1.00e-05 gnorm 0.132 3.34s mem 81.1GB +step 3840/5000 loss 0.3423 (w 0.3548 mse 0.3515 t 919 new 0.18) lr 1.00e-05 gnorm 0.132 3.31s mem 81.1GB +step 3841/5000 loss 0.3059 (w 0.2765 mse 0.2903 t 913 new 0.22) lr 1.00e-05 gnorm 0.103 3.09s mem 81.1GB +step 3842/5000 loss 0.2521 (w 0.3354 mse 0.3243 t 977 new 0.16) lr 1.00e-05 gnorm 0.109 3.33s mem 81.1GB +step 3843/5000 loss 0.2996 (w 0.4071 mse 0.3979 t 983 new 0.20) lr 1.00e-05 gnorm 0.112 3.14s mem 81.1GB +step 3844/5000 loss 0.5299 (w 0.2860 mse 0.2923 t 356 new 0.13) lr 1.00e-05 gnorm 0.117 3.07s mem 81.1GB +step 3845/5000 loss 0.3680 (w 0.3033 mse 0.3279 t 992 new 0.15) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +step 3846/5000 loss 0.1801 (w 0.3841 mse 0.3782 t 962 new 0.23) lr 1.00e-05 gnorm 0.096 3.12s mem 81.1GB +step 3847/5000 loss 0.4341 (w 0.3244 mse 0.3264 t 890 new 0.27) lr 1.00e-05 gnorm 0.182 3.11s mem 81.1GB +step 3848/5000 loss 0.3702 (w 0.6754 mse 0.6750 t 107 new 0.22) lr 1.00e-05 gnorm 0.120 3.08s mem 81.1GB +step 3849/5000 loss 0.1976 (w 0.2894 mse 0.3036 t 942 new 0.19) lr 1.00e-05 gnorm 0.129 3.05s mem 81.1GB +step 3850/5000 loss 0.4341 (w 0.2588 mse 0.2671 t 546 new 0.23) lr 1.00e-05 gnorm 0.216 3.05s mem 81.1GB +step 3851/5000 loss 0.3193 (w 0.2792 mse 0.2955 t 689 new 0.23) lr 1.00e-05 gnorm 0.139 3.04s mem 81.1GB +step 3852/5000 loss 0.1651 (w 0.2868 mse 0.2907 t 871 new 0.18) lr 1.00e-05 gnorm 0.122 3.16s mem 81.1GB +step 3853/5000 loss 0.4616 (w 0.2535 mse 0.2688 t 724 new 0.24) lr 1.00e-05 gnorm 0.122 3.16s mem 81.1GB +step 3854/5000 loss 0.1617 (w 0.1368 mse 0.1405 t 889 new 0.05) lr 1.00e-05 gnorm 0.102 3.04s mem 81.1GB +step 3855/5000 loss 0.3078 (w 0.2332 mse 0.2429 t 928 new 0.18) lr 1.00e-05 gnorm 0.162 3.10s mem 81.1GB +step 3856/5000 loss 0.3107 (w 0.3168 mse 0.3101 t 784 new 0.19) lr 1.00e-05 gnorm 0.138 3.07s mem 81.1GB +step 3857/5000 loss 0.3220 (w 0.3304 mse 0.3349 t 991 new 0.22) lr 1.00e-05 gnorm 0.106 3.09s mem 81.1GB +step 3858/5000 loss 0.4561 (w 0.3009 mse 0.2968 t 930 new 0.20) lr 1.00e-05 gnorm 0.133 3.27s mem 81.1GB +step 3859/5000 loss 0.2387 (w 0.3795 mse 0.3831 t 677 new 0.23) lr 1.00e-05 gnorm 0.181 3.13s mem 81.1GB +step 3860/5000 loss 0.3206 (w 0.2698 mse 0.2865 t 989 new 0.23) lr 1.00e-05 gnorm 0.147 3.06s mem 81.1GB +step 3861/5000 loss 0.2860 (w 0.2367 mse 0.2387 t 866 new 0.18) lr 1.00e-05 gnorm 0.224 3.22s mem 81.1GB +step 3862/5000 loss 0.2978 (w 0.2796 mse 0.2834 t 920 new 0.24) lr 1.00e-05 gnorm 0.103 3.30s mem 81.1GB +step 3863/5000 loss 0.3283 (w 0.2638 mse 0.2712 t 943 new 0.16) lr 1.00e-05 gnorm 0.145 2.83s mem 81.1GB +step 3864/5000 loss 0.3232 (w 0.4131 mse 0.4170 t 987 new 0.11) lr 1.00e-05 gnorm 0.192 3.13s mem 81.1GB +step 3865/5000 loss 0.2036 (w 0.2054 mse 0.2099 t 853 new 0.08) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 3866/5000 loss 0.3741 (w 0.2138 mse 0.2414 t 888 new 0.18) lr 1.00e-05 gnorm 0.158 3.08s mem 81.1GB +step 3867/5000 loss 0.3964 (w 0.2825 mse 0.2901 t 853 new 0.22) lr 1.00e-05 gnorm 0.127 3.12s mem 81.1GB +step 3868/5000 loss 0.2279 (w 0.2769 mse 0.2949 t 987 new 0.22) lr 1.00e-05 gnorm 0.095 3.27s mem 81.1GB +step 3869/5000 loss 0.2484 (w 0.2606 mse 0.2556 t 919 new 0.23) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +step 3870/5000 loss 0.2764 (w 0.2220 mse 0.2227 t 826 new 0.16) lr 1.00e-05 gnorm 0.134 3.36s mem 81.1GB +step 3871/5000 loss 0.3369 (w 0.3229 mse 0.3402 t 997 new 0.17) lr 1.00e-05 gnorm 0.152 3.38s mem 81.1GB +step 3872/5000 loss 0.2343 (w 0.2739 mse 0.2679 t 865 new 0.21) lr 1.00e-05 gnorm 0.100 2.84s mem 81.1GB +step 3873/5000 loss 0.2512 (w 0.2247 mse 0.2381 t 892 new 0.23) lr 1.00e-05 gnorm 0.114 3.13s mem 81.1GB +step 3874/5000 loss 0.3625 (w 0.2112 mse 0.2312 t 761 new 0.13) lr 1.00e-05 gnorm 0.179 3.13s mem 81.1GB +step 3875/5000 loss 0.1944 (w 0.2638 mse 0.2780 t 816 new 0.15) lr 1.00e-05 gnorm 0.405 2.84s mem 81.1GB +step 3876/5000 loss 0.3321 (w 0.2916 mse 0.3045 t 580 new 0.23) lr 1.00e-05 gnorm 0.143 3.12s mem 81.1GB +step 3877/5000 loss 0.2497 (w 0.3457 mse 0.3498 t 980 new 0.22) lr 1.00e-05 gnorm 0.923 3.03s mem 81.1GB +step 3878/5000 loss 0.4217 (w 0.2600 mse 0.2710 t 462 new 0.18) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +step 3879/5000 loss 0.2850 (w 0.3431 mse 0.3405 t 964 new 0.27) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +step 3880/5000 loss 0.3970 (w 0.4465 mse 0.4521 t 424 new 0.10) lr 1.00e-05 gnorm 0.118 3.12s mem 81.1GB +step 3881/5000 loss 0.2365 (w 0.3326 mse 0.3369 t 934 new 0.22) lr 1.00e-05 gnorm 0.089 3.12s mem 81.1GB +step 3882/5000 loss 0.1978 (w 0.1970 mse 0.2150 t 926 new 0.21) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +step 3883/5000 loss 0.1942 (w 0.3075 mse 0.3241 t 983 new 0.21) lr 1.00e-05 gnorm 0.091 3.10s mem 81.1GB +step 3884/5000 loss 0.1991 (w 0.3419 mse 0.3617 t 959 new 0.15) lr 1.00e-05 gnorm 0.131 3.06s mem 81.1GB +step 3885/5000 loss 0.2202 (w 0.3057 mse 0.3077 t 811 new 0.26) lr 1.00e-05 gnorm 0.134 3.10s mem 81.1GB +step 3886/5000 loss 0.2503 (w 0.3113 mse 0.3243 t 979 new 0.26) lr 1.00e-05 gnorm 0.137 3.20s mem 81.1GB +step 3887/5000 loss 0.3362 (w 0.2865 mse 0.2944 t 465 new 0.18) lr 1.00e-05 gnorm 1.506 3.16s mem 81.1GB +step 3888/5000 loss 0.3051 (w 0.2017 mse 0.2273 t 544 new 0.23) lr 1.00e-05 gnorm 0.132 3.10s mem 81.1GB +step 3889/5000 loss 0.1295 (w 0.2350 mse 0.2533 t 836 new 0.21) lr 1.00e-05 gnorm 0.230 3.11s mem 81.1GB +step 3890/5000 loss 0.4714 (w 0.2590 mse 0.2586 t 986 new 0.21) lr 1.00e-05 gnorm 0.139 3.05s mem 81.1GB +step 3891/5000 loss 0.2263 (w 0.2530 mse 0.2625 t 949 new 0.15) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +step 3892/5000 loss 0.2744 (w 0.2355 mse 0.2387 t 817 new 0.14) lr 1.00e-05 gnorm 0.147 3.25s mem 81.1GB +step 3893/5000 loss 0.3533 (w 0.2461 mse 0.2482 t 725 new 0.12) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +step 3894/5000 loss 0.2860 (w 0.5559 mse 0.5553 t 223 new 0.03) lr 1.00e-05 gnorm 0.112 3.28s mem 81.1GB +step 3895/5000 loss 0.3502 (w 0.4294 mse 0.4407 t 998 new 0.14) lr 1.00e-05 gnorm 0.171 3.03s mem 81.1GB +step 3896/5000 loss 0.3422 (w 0.3247 mse 0.3364 t 544 new 0.26) lr 1.00e-05 gnorm 0.144 3.07s mem 81.1GB +step 3897/5000 loss 0.2910 (w 0.2543 mse 0.2605 t 940 new 0.22) lr 1.00e-05 gnorm 0.335 3.25s mem 81.1GB +step 3898/5000 loss 0.2466 (w 0.3830 mse 0.3898 t 989 new 0.19) lr 1.00e-05 gnorm 0.181 3.24s mem 81.1GB +step 3899/5000 loss 0.1346 (w 0.2287 mse 0.2307 t 918 new 0.21) lr 1.00e-05 gnorm 0.142 3.16s mem 81.1GB +step 3900/5000 loss 0.1963 (w 0.2019 mse 0.2125 t 772 new 0.27) lr 1.00e-05 gnorm 0.342 3.09s mem 81.1GB +step 3901/5000 loss 0.3409 (w 0.2544 mse 0.2649 t 913 new 0.24) lr 1.00e-05 gnorm 0.188 3.06s mem 81.1GB +step 3902/5000 loss 0.3162 (w 0.3546 mse 0.3807 t 383 new 0.14) lr 1.00e-05 gnorm 0.149 3.11s mem 81.1GB +step 3903/5000 loss 0.3490 (w 0.2618 mse 0.2584 t 811 new 0.19) lr 1.00e-05 gnorm 0.110 3.33s mem 81.1GB +step 3904/5000 loss 0.1337 (w 0.3388 mse 0.3375 t 963 new 0.23) lr 1.00e-05 gnorm 0.136 3.59s mem 81.1GB +step 3905/5000 loss 0.2618 (w 0.3375 mse 0.3319 t 936 new 0.21) lr 1.00e-05 gnorm 0.254 3.05s mem 81.1GB +step 3906/5000 loss 0.3372 (w 0.2044 mse 0.2189 t 824 new 0.24) lr 1.00e-05 gnorm 0.179 3.31s mem 81.1GB +step 3907/5000 loss 0.2259 (w 0.4400 mse 0.4409 t 991 new 0.17) lr 1.00e-05 gnorm 0.132 2.85s mem 81.1GB +step 3908/5000 loss 0.2769 (w 0.2433 mse 0.2457 t 764 new 0.22) lr 1.00e-05 gnorm 0.105 3.35s mem 81.1GB +step 3909/5000 loss 0.3342 (w 0.2740 mse 0.2884 t 956 new 0.22) lr 1.00e-05 gnorm 0.180 3.42s mem 81.1GB +step 3910/5000 loss 0.2486 (w 0.3028 mse 0.3043 t 880 new 0.26) lr 1.00e-05 gnorm 0.126 3.29s mem 81.1GB +step 3911/5000 loss 0.2176 (w 0.2184 mse 0.2201 t 919 new 0.22) lr 1.00e-05 gnorm 0.130 3.07s mem 81.1GB +step 3912/5000 loss 0.2891 (w 0.1745 mse 0.2007 t 823 new 0.20) lr 1.00e-05 gnorm 0.125 3.29s mem 81.1GB +step 3913/5000 loss 0.4352 (w 0.3143 mse 0.3295 t 982 new 0.21) lr 1.00e-05 gnorm 0.117 3.13s mem 81.1GB +step 3914/5000 loss 0.3580 (w 0.2995 mse 0.3094 t 506 new 0.24) lr 1.00e-05 gnorm 0.143 3.03s mem 81.1GB +step 3915/5000 loss 0.2674 (w 0.3989 mse 0.3808 t 892 new 0.13) lr 1.00e-05 gnorm 0.144 3.34s mem 81.1GB +step 3916/5000 loss 0.2328 (w 0.2473 mse 0.2570 t 999 new 0.18) lr 1.00e-05 gnorm 0.103 3.18s mem 81.1GB +step 3917/5000 loss 0.3206 (w 0.3126 mse 0.3214 t 972 new 0.13) lr 1.00e-05 gnorm 0.182 3.08s mem 81.1GB +step 3918/5000 loss 0.2312 (w 0.5177 mse 0.5049 t 1000 new 0.21) lr 1.00e-05 gnorm 0.239 3.05s mem 81.1GB +step 3919/5000 loss 0.3115 (w 0.1948 mse 0.2164 t 677 new 0.20) lr 1.00e-05 gnorm 0.117 3.03s mem 81.1GB +step 3920/5000 loss 0.2138 (w 0.2591 mse 0.2767 t 995 new 0.23) lr 1.00e-05 gnorm 0.099 3.06s mem 81.1GB +step 3921/5000 loss 0.3665 (w 0.1996 mse 0.2178 t 823 new 0.14) lr 1.00e-05 gnorm 0.212 3.32s mem 81.1GB +step 3922/5000 loss 0.2567 (w 0.2298 mse 0.2438 t 942 new 0.09) lr 1.00e-05 gnorm 0.133 3.18s mem 81.1GB +step 3923/5000 loss 0.3063 (w 0.1887 mse 0.2101 t 729 new 0.27) lr 1.00e-05 gnorm 0.126 3.27s mem 81.1GB +step 3924/5000 loss 0.1874 (w 0.4244 mse 0.4213 t 945 new 0.22) lr 1.00e-05 gnorm 0.289 3.07s mem 81.1GB +step 3925/5000 loss 0.2795 (w 0.2702 mse 0.2760 t 889 new 0.17) lr 1.00e-05 gnorm 0.109 3.05s mem 81.1GB +step 3926/5000 loss 0.1188 (w 0.2115 mse 0.2281 t 968 new 0.12) lr 1.00e-05 gnorm 0.184 3.09s mem 81.1GB +step 3927/5000 loss 0.4524 (w 0.2102 mse 0.2282 t 724 new 0.25) lr 1.00e-05 gnorm 0.139 3.32s mem 81.1GB +step 3928/5000 loss 0.3061 (w 0.3588 mse 0.3797 t 993 new 0.24) lr 1.00e-05 gnorm 0.120 3.17s mem 81.1GB +step 3929/5000 loss 0.4154 (w 0.2598 mse 0.2785 t 516 new 0.24) lr 1.00e-05 gnorm 0.123 3.30s mem 81.1GB +step 3930/5000 loss 0.3015 (w 0.2482 mse 0.2661 t 546 new 0.27) lr 1.00e-05 gnorm 0.153 3.11s mem 81.1GB +step 3931/5000 loss 0.1940 (w 0.2708 mse 0.2999 t 961 new 0.20) lr 1.00e-05 gnorm 0.112 3.05s mem 81.1GB +step 3932/5000 loss 0.1760 (w 0.1988 mse 0.2127 t 858 new 0.25) lr 1.00e-05 gnorm 0.111 3.02s mem 81.1GB +step 3933/5000 loss 0.2720 (w 0.3347 mse 0.3329 t 966 new 0.22) lr 1.00e-05 gnorm 0.116 3.09s mem 81.1GB +step 3934/5000 loss 0.1497 (w 0.2979 mse 0.3056 t 944 new 0.25) lr 1.00e-05 gnorm 0.098 3.29s mem 81.1GB +step 3935/5000 loss 0.2965 (w 0.2411 mse 0.2599 t 887 new 0.17) lr 1.00e-05 gnorm 0.134 3.32s mem 81.1GB +step 3936/5000 loss 0.2875 (w 0.3028 mse 0.3072 t 980 new 0.17) lr 1.00e-05 gnorm 0.107 3.06s mem 81.1GB +step 3937/5000 loss 0.2167 (w 0.3100 mse 0.3169 t 878 new 0.21) lr 1.00e-05 gnorm 0.103 3.10s mem 81.1GB +step 3938/5000 loss 0.2278 (w 0.2665 mse 0.2885 t 976 new 0.17) lr 1.00e-05 gnorm 0.138 3.25s mem 81.1GB +step 3939/5000 loss 0.2884 (w 0.2413 mse 0.2527 t 856 new 0.28) lr 1.00e-05 gnorm 0.161 3.07s mem 81.1GB +step 3940/5000 loss 0.5141 (w 0.3218 mse 0.3307 t 767 new 0.23) lr 1.00e-05 gnorm 0.130 3.24s mem 81.1GB +step 3941/5000 loss 0.2870 (w 0.3765 mse 0.3915 t 264 new 0.13) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +step 3942/5000 loss 0.2950 (w 0.5741 mse 0.5761 t 177 new 0.16) lr 1.00e-05 gnorm 0.106 3.09s mem 81.1GB +step 3943/5000 loss 0.3315 (w 0.3162 mse 0.3040 t 958 new 0.25) lr 1.00e-05 gnorm 0.185 3.26s mem 81.1GB +step 3944/5000 loss 0.2136 (w 0.2539 mse 0.2563 t 788 new 0.15) lr 1.00e-05 gnorm 0.098 3.05s mem 81.1GB +step 3945/5000 loss 0.2017 (w 0.1625 mse 0.1658 t 943 new 0.02) lr 1.00e-05 gnorm 0.181 4.03s mem 81.1GB +step 3946/5000 loss 0.2106 (w 0.2802 mse 0.2873 t 990 new 0.21) lr 1.00e-05 gnorm 0.179 3.21s mem 81.1GB +step 3947/5000 loss 0.2793 (w 0.3388 mse 0.3332 t 969 new 0.13) lr 1.00e-05 gnorm 0.141 3.26s mem 81.1GB +step 3948/5000 loss 0.2616 (w 0.2721 mse 0.2789 t 693 new 0.20) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +step 3949/5000 loss 0.2330 (w 0.3553 mse 0.3825 t 997 new 0.21) lr 1.00e-05 gnorm 0.114 3.26s mem 81.1GB +step 3950/5000 loss 0.1370 (w 0.2319 mse 0.2549 t 914 new 0.21) lr 1.00e-05 gnorm 0.197 3.03s mem 81.1GB +step 3951/5000 loss 0.3558 (w 0.4124 mse 0.4280 t 999 new 0.24) lr 1.00e-05 gnorm 0.098 3.13s mem 81.1GB +step 3952/5000 loss 0.3043 (w 0.2037 mse 0.2096 t 828 new 0.10) lr 1.00e-05 gnorm 0.116 3.22s mem 81.1GB +step 3953/5000 loss 0.2649 (w 0.1995 mse 0.2265 t 867 new 0.20) lr 1.00e-05 gnorm 0.143 3.34s mem 81.1GB +step 3954/5000 loss 0.1764 (w 0.2673 mse 0.2657 t 651 new 0.15) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +step 3955/5000 loss 0.2760 (w 0.4475 mse 0.4322 t 978 new 0.19) lr 1.00e-05 gnorm 0.127 3.25s mem 81.1GB +step 3956/5000 loss 0.2555 (w 0.2473 mse 0.2621 t 891 new 0.22) lr 1.00e-05 gnorm 0.092 3.02s mem 81.1GB +step 3957/5000 loss 0.1045 (w 0.2423 mse 0.2449 t 926 new 0.24) lr 1.00e-05 gnorm 0.115 3.14s mem 81.1GB +step 3958/5000 loss 0.3648 (w 0.3476 mse 0.3505 t 980 new 0.19) lr 1.00e-05 gnorm 0.129 3.27s mem 81.1GB +step 3959/5000 loss 0.3196 (w 0.3013 mse 0.3025 t 628 new 0.20) lr 1.00e-05 gnorm 0.172 3.07s mem 81.1GB +step 3960/5000 loss 0.2222 (w 0.2904 mse 0.3122 t 926 new 0.19) lr 1.00e-05 gnorm 0.119 2.85s mem 81.1GB +step 3961/5000 loss 0.4188 (w 0.2459 mse 0.2574 t 780 new 0.18) lr 1.00e-05 gnorm 0.102 3.29s mem 81.1GB +step 3962/5000 loss 0.2713 (w 0.1845 mse 0.2132 t 802 new 0.24) lr 1.00e-05 gnorm 0.118 3.03s mem 81.1GB +step 3963/5000 loss 0.2855 (w 0.4564 mse 0.4737 t 987 new 0.20) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +step 3964/5000 loss 0.1396 (w 0.3362 mse 0.3408 t 980 new 0.18) lr 1.00e-05 gnorm 0.190 3.26s mem 81.1GB +step 3965/5000 loss 0.3511 (w 0.3049 mse 0.3094 t 897 new 0.21) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 3966/5000 loss 0.2175 (w 0.1844 mse 0.1977 t 894 new 0.12) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +step 3967/5000 loss 0.3423 (w 0.4092 mse 0.4295 t 992 new 0.20) lr 1.00e-05 gnorm 0.302 3.05s mem 81.1GB +step 3968/5000 loss 0.2649 (w 0.3668 mse 0.3717 t 987 new 0.17) lr 1.00e-05 gnorm 0.115 3.04s mem 81.1GB +step 3969/5000 loss 0.2601 (w 0.3161 mse 0.3228 t 957 new 0.17) lr 1.00e-05 gnorm 0.128 3.14s mem 81.1GB +step 3970/5000 loss 0.3457 (w 0.1924 mse 0.2140 t 679 new 0.27) lr 1.00e-05 gnorm 0.190 3.46s mem 81.1GB +step 3971/5000 loss 0.2174 (w 0.2795 mse 0.2860 t 631 new 0.22) lr 1.00e-05 gnorm 0.249 3.08s mem 81.1GB +step 3972/5000 loss 0.3873 (w 0.4324 mse 0.4278 t 459 new 0.22) lr 1.00e-05 gnorm 0.131 2.85s mem 81.1GB +step 3973/5000 loss 0.1389 (w 0.3255 mse 0.3263 t 971 new 0.20) lr 1.00e-05 gnorm 0.190 3.09s mem 81.1GB +step 3974/5000 loss 0.3004 (w 0.2249 mse 0.2351 t 898 new 0.23) lr 1.00e-05 gnorm 0.205 3.20s mem 81.1GB +step 3975/5000 loss 0.1922 (w 0.2318 mse 0.2367 t 849 new 0.15) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +step 3976/5000 loss 0.2879 (w 0.3384 mse 0.3355 t 981 new 0.27) lr 1.00e-05 gnorm 0.131 3.38s mem 81.1GB +step 3977/5000 loss 0.1870 (w 0.2843 mse 0.2799 t 924 new 0.11) lr 1.00e-05 gnorm 0.093 2.83s mem 81.1GB +step 3978/5000 loss 0.3521 (w 0.5747 mse 0.5809 t 171 new 0.24) lr 1.00e-05 gnorm 0.129 3.13s mem 81.1GB +step 3979/5000 loss 0.4056 (w 0.3355 mse 0.3329 t 815 new 0.20) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 3980/5000 loss 0.2425 (w 0.3600 mse 0.3647 t 940 new 0.26) lr 1.00e-05 gnorm 0.125 3.05s mem 81.1GB +step 3981/5000 loss 0.2526 (w 0.3938 mse 0.4041 t 969 new 0.27) lr 1.00e-05 gnorm 0.097 2.83s mem 81.1GB +step 3982/5000 loss 0.2609 (w 0.2588 mse 0.2714 t 887 new 0.21) lr 1.00e-05 gnorm 0.127 3.44s mem 81.1GB +step 3983/5000 loss 0.2740 (w 0.1921 mse 0.2018 t 920 new 0.22) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +step 3984/5000 loss 0.2082 (w 0.3142 mse 0.3246 t 644 new 0.24) lr 1.00e-05 gnorm 0.124 3.18s mem 81.1GB +step 3985/5000 loss 0.2428 (w 0.4605 mse 0.4681 t 288 new 0.24) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +step 3986/5000 loss 0.2357 (w 0.2918 mse 0.2912 t 907 new 0.28) lr 1.00e-05 gnorm 0.125 3.11s mem 81.1GB +step 3987/5000 loss 0.3390 (w 0.9287 mse 0.9247 t 993 new 0.21) lr 1.00e-05 gnorm 0.147 3.18s mem 81.1GB +step 3988/5000 loss 0.3150 (w 0.2029 mse 0.2129 t 826 new 0.23) lr 1.00e-05 gnorm 0.304 3.36s mem 81.1GB +step 3989/5000 loss 0.3032 (w 0.2327 mse 0.2392 t 951 new 0.25) lr 1.00e-05 gnorm 0.106 2.85s mem 81.1GB +step 3990/5000 loss 0.1863 (w 0.3411 mse 0.3392 t 965 new 0.23) lr 1.00e-05 gnorm 0.104 3.11s mem 81.1GB +step 3991/5000 loss 0.4299 (w 0.3031 mse 0.3172 t 957 new 0.16) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +step 3992/5000 loss 0.2557 (w 0.2996 mse 0.3005 t 983 new 0.10) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +step 3993/5000 loss 0.2381 (w 0.3041 mse 0.3202 t 549 new 0.23) lr 1.00e-05 gnorm 0.122 3.22s mem 81.1GB +step 3994/5000 loss 0.3781 (w 0.3429 mse 0.3415 t 909 new 0.21) lr 1.00e-05 gnorm 0.109 3.11s mem 81.1GB +step 3995/5000 loss 0.3316 (w 0.2829 mse 0.2854 t 920 new 0.22) lr 1.00e-05 gnorm 0.236 2.84s mem 81.1GB +step 3996/5000 loss 0.2182 (w 0.2651 mse 0.2668 t 814 new 0.23) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +step 3997/5000 loss 0.2909 (w 0.2396 mse 0.2448 t 984 new 0.16) lr 1.00e-05 gnorm 0.209 2.84s mem 81.1GB +step 3998/5000 loss 0.1415 (w 0.2358 mse 0.2422 t 937 new 0.13) lr 1.00e-05 gnorm 0.124 3.34s mem 81.1GB +step 3999/5000 loss 0.2525 (w 0.4442 mse 0.4578 t 983 new 0.13) lr 1.00e-05 gnorm 0.099 3.40s mem 81.1GB +step 4000/5000 loss 0.1272 (w 0.2424 mse 0.2605 t 1000 new 0.17) lr 1.00e-05 gnorm 0.100 3.14s mem 81.1GB +[val] step 4000 t=200: w=0.4554 mse=0.4735 (n=16) t=500: w=0.2766 mse=0.2914 (n=16) t=800: w=0.2325 mse=0.2443 (n=16) | mean w=0.3215 mse=0.3364 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step4000.safetensors 4093 个张量 37.98 GB +step 4001/5000 loss 0.3486 (w 0.1517 mse 0.1673 t 881 new 0.14) lr 1.00e-05 gnorm 0.205 2.84s mem 81.1GB +step 4002/5000 loss 0.1950 (w 0.2870 mse 0.2884 t 939 new 0.22) lr 1.00e-05 gnorm 0.105 3.10s mem 81.1GB +step 4003/5000 loss 0.2585 (w 0.3261 mse 0.3349 t 940 new 0.11) lr 1.00e-05 gnorm 0.112 2.82s mem 81.1GB +step 4004/5000 loss 0.2969 (w 0.2436 mse 0.2633 t 394 new 0.20) lr 1.00e-05 gnorm 0.114 3.33s mem 81.1GB +step 4005/5000 loss 0.3181 (w 0.3016 mse 0.3017 t 934 new 0.23) lr 1.00e-05 gnorm 0.127 3.47s mem 81.1GB +step 4006/5000 loss 0.2210 (w 0.3437 mse 0.3420 t 698 new 0.13) lr 1.00e-05 gnorm 0.101 2.83s mem 81.1GB +step 4007/5000 loss 0.5101 (w 0.2708 mse 0.2669 t 634 new 0.20) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +step 4008/5000 loss 0.4271 (w 0.2864 mse 0.3002 t 586 new 0.18) lr 1.00e-05 gnorm 0.163 3.13s mem 81.1GB +step 4009/5000 loss 0.1677 (w 0.3143 mse 0.3342 t 978 new 0.17) lr 1.00e-05 gnorm 0.097 3.04s mem 81.1GB +step 4010/5000 loss 0.1746 (w 0.3258 mse 0.3424 t 955 new 0.19) lr 1.00e-05 gnorm 0.166 3.44s mem 81.1GB +step 4011/5000 loss 0.3263 (w 0.1675 mse 0.1791 t 819 new 0.13) lr 1.00e-05 gnorm 0.233 3.34s mem 81.1GB +step 4012/5000 loss 0.2477 (w 0.1826 mse 0.1950 t 689 new 0.18) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +step 4013/5000 loss 0.3861 (w 0.2649 mse 0.2730 t 641 new 0.20) lr 1.00e-05 gnorm 0.110 3.24s mem 81.1GB +step 4014/5000 loss 0.2287 (w 0.3206 mse 0.3275 t 889 new 0.22) lr 1.00e-05 gnorm 0.094 3.03s mem 81.1GB +step 4015/5000 loss 0.4593 (w 0.3742 mse 0.3787 t 375 new 0.12) lr 1.00e-05 gnorm 0.127 3.08s mem 81.1GB +step 4016/5000 loss 0.2164 (w 0.3537 mse 0.3546 t 964 new 0.20) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 4017/5000 loss 0.3734 (w 0.2876 mse 0.2898 t 942 new 0.23) lr 1.00e-05 gnorm 0.145 3.43s mem 81.1GB +step 4018/5000 loss 0.3498 (w 1.7048 mse 1.7592 t 996 new 0.27) lr 1.00e-05 gnorm 0.111 2.85s mem 81.1GB +step 4019/5000 loss 0.1647 (w 0.2879 mse 0.2896 t 950 new 0.20) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +step 4020/5000 loss 0.2740 (w 0.3467 mse 0.3511 t 894 new 0.21) lr 1.00e-05 gnorm 0.137 3.05s mem 81.1GB +step 4021/5000 loss 0.2454 (w 0.2023 mse 0.2143 t 873 new 0.24) lr 1.00e-05 gnorm 0.158 3.30s mem 81.1GB +step 4022/5000 loss 0.1530 (w 0.2007 mse 0.2301 t 962 new 0.27) lr 1.00e-05 gnorm 0.137 3.09s mem 81.1GB +step 4023/5000 loss 0.4235 (w 0.2270 mse 0.2357 t 603 new 0.19) lr 1.00e-05 gnorm 0.131 3.45s mem 81.1GB +step 4024/5000 loss 0.3845 (w 0.2483 mse 0.2608 t 500 new 0.08) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +step 4025/5000 loss 0.3057 (w 0.1908 mse 0.1944 t 883 new 0.16) lr 1.00e-05 gnorm 0.249 3.15s mem 81.1GB +step 4026/5000 loss 0.3301 (w 0.4442 mse 0.4491 t 995 new 0.19) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +step 4027/5000 loss 0.1744 (w 0.3833 mse 0.3665 t 961 new 0.24) lr 1.00e-05 gnorm 0.112 3.31s mem 81.1GB +step 4028/5000 loss 0.2271 (w 0.1780 mse 0.2069 t 633 new 0.17) lr 1.00e-05 gnorm 0.131 3.13s mem 81.1GB +step 4029/5000 loss 0.2892 (w 0.3108 mse 0.3098 t 718 new 0.14) lr 1.00e-05 gnorm 0.094 3.18s mem 81.1GB +step 4030/5000 loss 0.1847 (w 0.3261 mse 0.3353 t 980 new 0.19) lr 1.00e-05 gnorm 0.097 2.83s mem 81.1GB +step 4031/5000 loss 0.4559 (w 0.3985 mse 0.4147 t 356 new 0.18) lr 1.00e-05 gnorm 0.119 3.12s mem 81.1GB +step 4032/5000 loss 0.2695 (w 0.3328 mse 0.3301 t 958 new 0.22) lr 1.00e-05 gnorm 0.116 3.12s mem 81.1GB +step 4033/5000 loss 0.2316 (w 0.3570 mse 0.3560 t 941 new 0.17) lr 1.00e-05 gnorm 0.100 3.08s mem 81.1GB +step 4034/5000 loss 0.2033 (w 0.1867 mse 0.1867 t 742 new 0.00) lr 1.00e-05 gnorm 0.136 3.05s mem 81.1GB +step 4035/5000 loss 0.4510 (w 0.3100 mse 0.3128 t 659 new 0.20) lr 1.00e-05 gnorm 0.169 3.18s mem 81.1GB +step 4036/5000 loss 0.2005 (w 0.3242 mse 0.3379 t 974 new 0.17) lr 1.00e-05 gnorm 0.098 2.84s mem 81.1GB +step 4037/5000 loss 0.2425 (w 0.4058 mse 0.4072 t 954 new 0.26) lr 1.00e-05 gnorm 0.160 3.27s mem 81.1GB +step 4038/5000 loss 0.3052 (w 0.2470 mse 0.2523 t 930 new 0.17) lr 1.00e-05 gnorm 0.152 3.12s mem 81.1GB +step 4039/5000 loss 0.3884 (w 0.1660 mse 0.1705 t 424 new 0.16) lr 1.00e-05 gnorm 0.168 3.33s mem 81.1GB +step 4040/5000 loss 0.3277 (w 0.3306 mse 0.3266 t 844 new 0.22) lr 1.00e-05 gnorm 0.111 3.09s mem 81.1GB +step 4041/5000 loss 0.2170 (w 0.2091 mse 0.2219 t 977 new 0.22) lr 1.00e-05 gnorm 0.136 3.17s mem 81.1GB +step 4042/5000 loss 0.2283 (w 0.3104 mse 0.3226 t 979 new 0.21) lr 1.00e-05 gnorm 0.102 3.16s mem 81.1GB +step 4043/5000 loss 0.4468 (w 0.5125 mse 0.5232 t 259 new 0.15) lr 1.00e-05 gnorm 0.134 3.02s mem 81.1GB +step 4044/5000 loss 0.3063 (w 0.2473 mse 0.2688 t 424 new 0.27) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +step 4045/5000 loss 0.4046 (w 0.5576 mse 0.5678 t 212 new 0.22) lr 1.00e-05 gnorm 0.111 3.30s mem 81.1GB +step 4046/5000 loss 0.3438 (w 0.2029 mse 0.2049 t 768 new 0.10) lr 1.00e-05 gnorm 0.111 3.31s mem 81.1GB +step 4047/5000 loss 0.3866 (w 0.3118 mse 0.3202 t 609 new 0.19) lr 1.00e-05 gnorm 0.141 3.18s mem 81.1GB +step 4048/5000 loss 0.2014 (w 0.2336 mse 0.2387 t 979 new 0.15) lr 1.00e-05 gnorm 0.375 3.07s mem 81.1GB +step 4049/5000 loss 0.3718 (w 0.1837 mse 0.1982 t 821 new 0.22) lr 1.00e-05 gnorm 0.135 3.03s mem 81.1GB +step 4050/5000 loss 0.1353 (w 0.2313 mse 0.2512 t 867 new 0.20) lr 1.00e-05 gnorm 0.208 3.05s mem 81.1GB +step 4051/5000 loss 0.1648 (w 0.2935 mse 0.2837 t 965 new 0.21) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +step 4052/5000 loss 0.2737 (w 0.1956 mse 0.2106 t 962 new 0.15) lr 1.00e-05 gnorm 0.140 3.28s mem 81.1GB +step 4053/5000 loss 0.2615 (w 0.4252 mse 0.4195 t 977 new 0.16) lr 1.00e-05 gnorm 0.107 3.15s mem 81.1GB +step 4054/5000 loss 0.2672 (w 0.1823 mse 0.1961 t 969 new 0.09) lr 1.00e-05 gnorm 0.111 3.10s mem 81.1GB +step 4055/5000 loss 0.2999 (w 0.4911 mse 0.5263 t 1000 new 0.19) lr 1.00e-05 gnorm 0.084 2.84s mem 81.1GB +step 4056/5000 loss 0.2499 (w 0.1798 mse 0.2009 t 970 new 0.13) lr 1.00e-05 gnorm 0.103 3.10s mem 81.1GB +step 4057/5000 loss 0.3176 (w 0.2843 mse 0.2976 t 974 new 0.26) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +step 4058/5000 loss 0.3166 (w 0.2357 mse 0.2573 t 956 new 0.22) lr 1.00e-05 gnorm 0.116 3.34s mem 81.1GB +step 4059/5000 loss 0.1475 (w 0.3093 mse 0.3131 t 835 new 0.23) lr 1.00e-05 gnorm 0.119 3.17s mem 81.1GB +step 4060/5000 loss 0.1714 (w 0.2622 mse 0.2699 t 598 new 0.17) lr 1.00e-05 gnorm 0.097 3.18s mem 81.1GB +step 4061/5000 loss 0.2700 (w 0.2640 mse 0.2560 t 993 new 0.13) lr 1.00e-05 gnorm 0.128 2.85s mem 81.1GB +step 4062/5000 loss 0.3571 (w 0.2438 mse 0.2500 t 578 new 0.18) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +step 4063/5000 loss 0.1883 (w 0.2421 mse 0.2471 t 948 new 0.20) lr 1.00e-05 gnorm 0.107 3.41s mem 81.1GB +step 4064/5000 loss 0.3795 (w 0.3398 mse 0.3529 t 375 new 0.24) lr 1.00e-05 gnorm 0.243 3.08s mem 81.1GB +step 4065/5000 loss 0.4038 (w 0.2846 mse 0.2920 t 847 new 0.23) lr 1.00e-05 gnorm 0.101 3.22s mem 81.1GB +step 4066/5000 loss 0.5043 (w 0.1668 mse 0.1760 t 639 new 0.10) lr 1.00e-05 gnorm 0.123 3.38s mem 81.1GB +step 4067/5000 loss 0.3264 (w 0.2399 mse 0.2541 t 971 new 0.22) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +step 4068/5000 loss 0.3534 (w 0.1366 mse 0.1544 t 709 new 0.22) lr 1.00e-05 gnorm 0.132 3.24s mem 81.1GB +step 4069/5000 loss 0.2649 (w 0.3177 mse 0.3179 t 810 new 0.24) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 4070/5000 loss 0.3168 (w 0.2461 mse 0.2527 t 965 new 0.25) lr 1.00e-05 gnorm 0.150 3.49s mem 81.1GB +step 4071/5000 loss 0.2561 (w 0.2743 mse 0.2944 t 958 new 0.20) lr 1.00e-05 gnorm 0.103 2.85s mem 81.1GB +step 4072/5000 loss 0.2085 (w 0.2721 mse 0.2734 t 889 new 0.22) lr 1.00e-05 gnorm 0.155 3.39s mem 81.1GB +step 4073/5000 loss 0.2052 (w 0.1756 mse 0.1903 t 768 new 0.23) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 4074/5000 loss 0.1396 (w 0.2041 mse 0.2126 t 871 new 0.18) lr 1.00e-05 gnorm 0.143 3.45s mem 81.1GB +step 4075/5000 loss 0.1738 (w 0.2561 mse 0.2747 t 931 new 0.24) lr 1.00e-05 gnorm 0.204 3.13s mem 81.1GB +step 4076/5000 loss 0.2694 (w 0.3546 mse 0.3398 t 987 new 0.18) lr 1.00e-05 gnorm 0.121 3.16s mem 81.1GB +step 4077/5000 loss 0.3306 (w 0.3051 mse 0.3188 t 688 new 0.24) lr 1.00e-05 gnorm 0.117 3.04s mem 81.1GB +step 4078/5000 loss 0.3521 (w 0.3971 mse 0.3928 t 444 new 0.22) lr 1.00e-05 gnorm 0.232 3.04s mem 81.1GB +step 4079/5000 loss 0.2817 (w 0.2316 mse 0.2443 t 839 new 0.27) lr 1.00e-05 gnorm 0.104 3.02s mem 81.1GB +step 4080/5000 loss 0.3713 (w 0.3723 mse 0.3794 t 981 new 0.19) lr 1.00e-05 gnorm 0.186 3.17s mem 81.1GB +step 4081/5000 loss 0.2703 (w 0.2545 mse 0.2670 t 805 new 0.19) lr 1.00e-05 gnorm 0.109 3.07s mem 81.1GB +step 4082/5000 loss 0.2926 (w 0.2052 mse 0.2222 t 631 new 0.27) lr 1.00e-05 gnorm 0.120 3.15s mem 81.1GB +step 4083/5000 loss 0.2908 (w 0.5758 mse 0.6072 t 127 new 0.18) lr 1.00e-05 gnorm 0.102 3.09s mem 81.1GB +step 4084/5000 loss 0.2835 (w 0.1917 mse 0.2082 t 869 new 0.26) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +step 4085/5000 loss 0.3854 (w 0.3696 mse 0.3670 t 979 new 0.19) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +step 4086/5000 loss 0.2887 (w 0.4357 mse 0.4272 t 990 new 0.13) lr 1.00e-05 gnorm 0.141 3.33s mem 81.1GB +step 4087/5000 loss 0.1999 (w 0.1926 mse 0.2077 t 924 new 0.12) lr 1.00e-05 gnorm 0.127 3.09s mem 81.1GB +step 4088/5000 loss 0.3507 (w 0.2977 mse 0.3118 t 401 new 0.11) lr 1.00e-05 gnorm 0.140 3.11s mem 81.1GB +step 4089/5000 loss 0.2884 (w 0.3073 mse 0.3049 t 623 new 0.23) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +step 4090/5000 loss 0.4102 (w 0.2980 mse 0.3135 t 693 new 0.17) lr 1.00e-05 gnorm 0.141 3.10s mem 81.1GB +step 4091/5000 loss 0.2008 (w 0.3636 mse 0.3766 t 980 new 0.16) lr 1.00e-05 gnorm 0.120 3.06s mem 81.1GB +step 4092/5000 loss 0.2575 (w 0.2913 mse 0.3036 t 924 new 0.22) lr 1.00e-05 gnorm 0.115 3.30s mem 81.1GB +step 4093/5000 loss 0.2942 (w 0.1922 mse 0.2210 t 940 new 0.23) lr 1.00e-05 gnorm 0.213 3.35s mem 81.1GB +step 4094/5000 loss 0.0727 (w 0.3043 mse 0.3198 t 962 new 0.27) lr 1.00e-05 gnorm 0.077 3.12s mem 81.1GB +step 4095/5000 loss 0.3202 (w 0.3648 mse 0.3796 t 978 new 0.19) lr 1.00e-05 gnorm 0.110 3.06s mem 81.1GB +step 4096/5000 loss 0.3954 (w 0.3843 mse 0.3850 t 965 new 0.24) lr 1.00e-05 gnorm 0.172 3.04s mem 81.1GB +step 4097/5000 loss 0.4017 (w 0.5118 mse 0.4925 t 992 new 0.24) lr 1.00e-05 gnorm 0.135 3.10s mem 81.1GB +step 4098/5000 loss 0.4468 (w 0.2142 mse 0.2198 t 861 new 0.14) lr 1.00e-05 gnorm 0.121 3.38s mem 81.1GB +step 4099/5000 loss 0.3458 (w 0.2509 mse 0.2626 t 980 new 0.21) lr 1.00e-05 gnorm 0.147 3.09s mem 81.1GB +step 4100/5000 loss 0.3337 (w 0.2022 mse 0.2147 t 783 new 0.22) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +step 4101/5000 loss 0.1708 (w 0.3036 mse 0.3015 t 905 new 0.21) lr 1.00e-05 gnorm 0.115 3.06s mem 81.1GB +step 4102/5000 loss 0.4314 (w 0.3699 mse 0.3577 t 992 new 0.23) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +step 4103/5000 loss 0.4171 (w 0.2835 mse 0.2939 t 986 new 0.27) lr 1.00e-05 gnorm 0.134 3.27s mem 81.1GB +step 4104/5000 loss 0.4231 (w 0.3055 mse 0.3069 t 894 new 0.23) lr 1.00e-05 gnorm 0.095 3.11s mem 81.1GB +step 4105/5000 loss 0.4334 (w 0.2395 mse 0.2590 t 394 new 0.10) lr 1.00e-05 gnorm 0.219 3.14s mem 81.1GB +step 4106/5000 loss 0.2065 (w 0.4150 mse 0.4168 t 994 new 0.19) lr 1.00e-05 gnorm 0.102 3.12s mem 81.1GB +step 4107/5000 loss 0.2923 (w 0.1759 mse 0.1874 t 742 new 0.22) lr 1.00e-05 gnorm 0.096 3.04s mem 81.1GB +step 4108/5000 loss 0.2778 (w 0.2939 mse 0.2964 t 928 new 0.21) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +step 4109/5000 loss 0.2804 (w 0.2426 mse 0.2533 t 893 new 0.23) lr 1.00e-05 gnorm 0.128 3.33s mem 81.1GB +step 4110/5000 loss 0.3091 (w 0.2531 mse 0.2565 t 797 new 0.19) lr 1.00e-05 gnorm 0.130 3.05s mem 81.1GB +step 4111/5000 loss 0.1878 (w 0.3060 mse 0.3131 t 700 new 0.24) lr 1.00e-05 gnorm 0.115 3.37s mem 81.1GB +step 4112/5000 loss 0.3604 (w 0.2793 mse 0.2837 t 708 new 0.19) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +step 4113/5000 loss 0.1905 (w 0.2273 mse 0.2404 t 824 new 0.20) lr 1.00e-05 gnorm 0.146 3.31s mem 81.1GB +step 4114/5000 loss 0.3053 (w 0.2475 mse 0.2716 t 973 new 0.19) lr 1.00e-05 gnorm 0.114 3.08s mem 81.1GB +step 4115/5000 loss 0.2212 (w 0.2030 mse 0.2088 t 922 new 0.19) lr 1.00e-05 gnorm 0.110 3.06s mem 81.1GB +step 4116/5000 loss 0.2595 (w 0.2576 mse 0.2751 t 790 new 0.22) lr 1.00e-05 gnorm 0.151 3.06s mem 81.1GB +step 4117/5000 loss 0.3662 (w 0.2512 mse 0.2525 t 871 new 0.18) lr 1.00e-05 gnorm 0.174 3.44s mem 81.1GB +step 4118/5000 loss 0.3097 (w 0.2357 mse 0.2474 t 760 new 0.27) lr 1.00e-05 gnorm 0.209 2.82s mem 81.1GB +step 4119/5000 loss 0.2187 (w 0.2164 mse 0.2344 t 762 new 0.26) lr 1.00e-05 gnorm 0.133 3.35s mem 81.1GB +step 4120/5000 loss 0.3281 (w 0.2279 mse 0.2359 t 865 new 0.07) lr 1.00e-05 gnorm 0.122 3.39s mem 81.1GB +step 4121/5000 loss 0.1173 (w 0.3378 mse 0.3677 t 983 new 0.17) lr 1.00e-05 gnorm 0.155 3.13s mem 81.1GB +step 4122/5000 loss 0.2475 (w 0.2837 mse 0.2781 t 720 new 0.22) lr 1.00e-05 gnorm 0.237 3.45s mem 81.1GB +step 4123/5000 loss 0.4415 (w 0.3414 mse 0.3443 t 459 new 0.20) lr 1.00e-05 gnorm 0.127 3.23s mem 81.1GB +step 4124/5000 loss 0.2866 (w 0.1641 mse 0.1728 t 790 new 0.21) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +step 4125/5000 loss 0.2196 (w 0.3359 mse 0.3526 t 998 new 0.20) lr 1.00e-05 gnorm 0.112 3.16s mem 81.1GB +step 4126/5000 loss 0.2230 (w 0.1603 mse 0.1723 t 891 new 0.22) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +step 4127/5000 loss 0.1215 (w 0.1796 mse 0.1973 t 995 new 0.11) lr 1.00e-05 gnorm 0.089 3.05s mem 81.1GB +step 4128/5000 loss 0.4707 (w 0.3230 mse 0.3127 t 963 new 0.24) lr 1.00e-05 gnorm 0.160 3.32s mem 81.1GB +step 4129/5000 loss 0.3969 (w 0.3555 mse 0.3573 t 872 new 0.27) lr 1.00e-05 gnorm 0.165 3.16s mem 81.1GB +step 4130/5000 loss 0.3563 (w 0.3967 mse 0.4529 t 159 new 0.19) lr 1.00e-05 gnorm 0.213 2.84s mem 81.1GB +step 4131/5000 loss 0.2276 (w 0.3462 mse 0.3507 t 991 new 0.17) lr 1.00e-05 gnorm 0.118 3.28s mem 81.1GB +step 4132/5000 loss 0.5046 (w 0.3014 mse 0.3044 t 528 new 0.14) lr 1.00e-05 gnorm 0.130 3.09s mem 81.1GB +step 4133/5000 loss 0.2605 (w 0.4122 mse 0.4111 t 973 new 0.20) lr 1.00e-05 gnorm 0.439 3.07s mem 81.1GB +step 4134/5000 loss 0.2818 (w 0.2412 mse 0.2490 t 951 new 0.18) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +step 4135/5000 loss 0.1541 (w 0.4680 mse 0.4802 t 983 new 0.13) lr 1.00e-05 gnorm 0.120 3.18s mem 81.1GB +step 4136/5000 loss 0.2125 (w 0.2573 mse 0.2652 t 840 new 0.26) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +step 4137/5000 loss 0.2771 (w 0.4003 mse 0.4195 t 966 new 0.21) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +step 4138/5000 loss 0.1860 (w 0.3633 mse 0.3560 t 975 new 0.28) lr 1.00e-05 gnorm 0.151 3.10s mem 81.1GB +step 4139/5000 loss 0.4036 (w 0.3501 mse 0.3475 t 642 new 0.24) lr 1.00e-05 gnorm 0.119 3.11s mem 81.1GB +step 4140/5000 loss 0.2915 (w 0.2331 mse 0.2367 t 672 new 0.21) lr 1.00e-05 gnorm 0.150 3.32s mem 81.1GB +step 4141/5000 loss 0.3514 (w 0.2327 mse 0.2454 t 914 new 0.20) lr 1.00e-05 gnorm 0.202 2.83s mem 81.1GB +step 4142/5000 loss 0.2848 (w 0.2849 mse 0.2952 t 495 new 0.13) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +step 4143/5000 loss 0.2212 (w 0.1552 mse 0.1718 t 935 new 0.13) lr 1.00e-05 gnorm 0.141 3.02s mem 81.1GB +step 4144/5000 loss 0.2908 (w 0.2078 mse 0.2271 t 807 new 0.25) lr 1.00e-05 gnorm 0.130 3.08s mem 81.1GB +step 4145/5000 loss 0.3115 (w 0.2714 mse 0.2795 t 688 new 0.25) lr 1.00e-05 gnorm 0.135 3.35s mem 81.1GB +step 4146/5000 loss 0.3503 (w 0.2523 mse 0.2518 t 871 new 0.19) lr 1.00e-05 gnorm 0.122 3.16s mem 81.1GB +step 4147/5000 loss 0.2049 (w 0.3246 mse 0.3314 t 490 new 0.25) lr 1.00e-05 gnorm 0.100 2.84s mem 81.1GB +step 4148/5000 loss 0.1889 (w 0.2574 mse 0.2846 t 788 new 0.21) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +step 4149/5000 loss 0.2841 (w 0.3141 mse 0.3156 t 800 new 0.22) lr 1.00e-05 gnorm 0.151 3.10s mem 81.1GB +step 4150/5000 loss 0.3024 (w 0.3109 mse 0.3276 t 865 new 0.17) lr 1.00e-05 gnorm 0.102 3.30s mem 81.1GB +step 4151/5000 loss 0.2731 (w 0.2663 mse 0.2697 t 645 new 0.22) lr 1.00e-05 gnorm 0.179 3.33s mem 81.1GB +step 4152/5000 loss 0.3055 (w 0.4989 mse 0.5089 t 999 new 0.17) lr 1.00e-05 gnorm 0.111 3.37s mem 81.1GB +step 4153/5000 loss 0.2451 (w 0.3534 mse 0.3473 t 984 new 0.20) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +step 4154/5000 loss 0.3446 (w 0.3082 mse 0.3174 t 937 new 0.22) lr 1.00e-05 gnorm 0.181 3.06s mem 81.1GB +step 4155/5000 loss 0.4187 (w 0.3686 mse 0.3723 t 306 new 0.17) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +step 4156/5000 loss 0.2380 (w 0.3348 mse 0.3279 t 984 new 0.23) lr 1.00e-05 gnorm 0.093 3.03s mem 81.1GB +step 4157/5000 loss 0.3208 (w 0.2846 mse 0.2984 t 946 new 0.18) lr 1.00e-05 gnorm 0.178 3.12s mem 81.1GB +step 4158/5000 loss 0.2307 (w 0.3687 mse 0.3483 t 948 new 0.18) lr 1.00e-05 gnorm 0.139 3.25s mem 81.1GB +step 4159/5000 loss 0.2590 (w 0.1334 mse 0.1560 t 840 new 0.18) lr 1.00e-05 gnorm 0.118 2.94s mem 81.1GB +step 4160/5000 loss 0.2837 (w 0.2694 mse 0.2718 t 729 new 0.20) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 4161/5000 loss 0.2435 (w 0.2931 mse 0.2883 t 972 new 0.20) lr 1.00e-05 gnorm 0.165 2.83s mem 81.1GB +step 4162/5000 loss 0.3562 (w 0.4199 mse 0.4161 t 988 new 0.21) lr 1.00e-05 gnorm 0.126 3.25s mem 81.1GB +step 4163/5000 loss 0.4054 (w 0.3135 mse 0.3230 t 966 new 0.20) lr 1.00e-05 gnorm 0.250 3.12s mem 81.1GB +step 4164/5000 loss 0.1969 (w 0.3594 mse 0.3700 t 977 new 0.05) lr 1.00e-05 gnorm 0.191 3.31s mem 81.1GB +step 4165/5000 loss 0.2540 (w 0.2824 mse 0.2890 t 508 new 0.07) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 4166/5000 loss 0.2787 (w 0.2496 mse 0.2495 t 599 new 0.20) lr 1.00e-05 gnorm 0.196 3.22s mem 81.1GB +step 4167/5000 loss 0.1915 (w 0.3557 mse 0.3690 t 935 new 0.18) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 4168/5000 loss 0.4905 (w 0.3539 mse 0.3547 t 555 new 0.22) lr 1.00e-05 gnorm 0.125 3.37s mem 81.1GB +step 4169/5000 loss 0.3192 (w 0.1383 mse 0.1544 t 837 new 0.14) lr 1.00e-05 gnorm 0.116 3.13s mem 81.1GB +step 4170/5000 loss 0.3492 (w 0.2298 mse 0.2363 t 947 new 0.17) lr 1.00e-05 gnorm 0.148 3.27s mem 81.1GB +step 4171/5000 loss 0.2375 (w 0.2372 mse 0.2374 t 506 new 0.00) lr 1.00e-05 gnorm 0.116 2.83s mem 81.1GB +step 4172/5000 loss 0.1541 (w 0.1788 mse 0.1999 t 774 new 0.17) lr 1.00e-05 gnorm 0.136 3.37s mem 81.1GB +step 4173/5000 loss 0.3558 (w 0.6873 mse 0.6909 t 159 new 0.21) lr 1.00e-05 gnorm 0.128 3.04s mem 81.1GB +step 4174/5000 loss 0.2239 (w 0.2831 mse 0.2816 t 927 new 0.16) lr 1.00e-05 gnorm 0.134 3.11s mem 81.1GB +step 4175/5000 loss 0.4048 (w 0.2433 mse 0.2477 t 802 new 0.22) lr 1.00e-05 gnorm 0.154 3.26s mem 81.1GB +step 4176/5000 loss 0.3618 (w 0.2305 mse 0.2503 t 737 new 0.21) lr 1.00e-05 gnorm 0.149 3.09s mem 81.1GB +step 4177/5000 loss 0.3640 (w 0.2787 mse 0.2850 t 386 new 0.24) lr 1.00e-05 gnorm 0.137 2.82s mem 81.1GB +step 4178/5000 loss 0.2542 (w 0.4184 mse 0.3996 t 1000 new 0.17) lr 1.00e-05 gnorm 0.113 3.09s mem 81.1GB +step 4179/5000 loss 0.2088 (w 0.2124 mse 0.2410 t 920 new 0.25) lr 1.00e-05 gnorm 0.122 3.37s mem 81.1GB +step 4180/5000 loss 0.2573 (w 0.2983 mse 0.3003 t 909 new 0.21) lr 1.00e-05 gnorm 0.099 3.12s mem 81.1GB +step 4181/5000 loss 0.2219 (w 0.2388 mse 0.2470 t 805 new 0.21) lr 1.00e-05 gnorm 0.203 3.33s mem 81.1GB +step 4182/5000 loss 0.2811 (w 0.3298 mse 0.3306 t 930 new 0.17) lr 1.00e-05 gnorm 0.114 3.15s mem 81.1GB +step 4183/5000 loss 0.2455 (w 0.2808 mse 0.2878 t 935 new 0.23) lr 1.00e-05 gnorm 0.116 3.01s mem 81.1GB +step 4184/5000 loss 0.1829 (w 0.3762 mse 0.3872 t 970 new 0.21) lr 1.00e-05 gnorm 0.108 3.13s mem 81.1GB +step 4185/5000 loss 0.2227 (w 0.3676 mse 0.3760 t 411 new 0.13) lr 1.00e-05 gnorm 0.107 3.26s mem 81.1GB +step 4186/5000 loss 0.2849 (w 0.2552 mse 0.2587 t 790 new 0.20) lr 1.00e-05 gnorm 0.101 3.11s mem 81.1GB +step 4187/5000 loss 0.2188 (w 0.3152 mse 0.3103 t 854 new 0.25) lr 1.00e-05 gnorm 0.098 3.10s mem 81.1GB +step 4188/5000 loss 0.1557 (w 0.2126 mse 0.2206 t 990 new 0.14) lr 1.00e-05 gnorm 0.095 2.82s mem 81.1GB +step 4189/5000 loss 0.1800 (w 0.1247 mse 0.1334 t 834 new 0.11) lr 1.00e-05 gnorm 0.106 3.20s mem 81.1GB +step 4190/5000 loss 0.3549 (w 0.2211 mse 0.2375 t 945 new 0.20) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 4191/5000 loss 0.3379 (w 0.3016 mse 0.3030 t 594 new 0.22) lr 1.00e-05 gnorm 0.202 3.27s mem 81.1GB +step 4192/5000 loss 0.2462 (w 0.2616 mse 0.2657 t 816 new 0.23) lr 1.00e-05 gnorm 0.131 3.12s mem 81.1GB +step 4193/5000 loss 0.2134 (w 0.3481 mse 0.3431 t 939 new 0.18) lr 1.00e-05 gnorm 0.112 3.16s mem 81.1GB +step 4194/5000 loss 0.3603 (w 0.1936 mse 0.2073 t 957 new 0.18) lr 1.00e-05 gnorm 0.157 2.85s mem 81.1GB +step 4195/5000 loss 0.2156 (w 0.2396 mse 0.2442 t 836 new 0.22) lr 1.00e-05 gnorm 0.103 3.14s mem 81.1GB +step 4196/5000 loss 0.2496 (w 0.2616 mse 0.2647 t 930 new 0.22) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +step 4197/5000 loss 0.1881 (w 0.4635 mse 0.4767 t 980 new 0.17) lr 1.00e-05 gnorm 0.669 3.19s mem 81.1GB +step 4198/5000 loss 0.3053 (w 0.2542 mse 0.2698 t 465 new 0.20) lr 1.00e-05 gnorm 0.119 3.13s mem 81.1GB +step 4199/5000 loss 0.2804 (w 0.1880 mse 0.1989 t 708 new 0.14) lr 1.00e-05 gnorm 0.111 3.24s mem 81.1GB +step 4200/5000 loss 0.1751 (w 0.3326 mse 0.3420 t 987 new 0.21) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 4201/5000 loss 0.3571 (w 0.7582 mse 0.7805 t 107 new 0.21) lr 1.00e-05 gnorm 0.125 3.28s mem 81.1GB +step 4202/5000 loss 0.1384 (w 0.2972 mse 0.2965 t 884 new 0.12) lr 1.00e-05 gnorm 0.324 3.12s mem 81.1GB +step 4203/5000 loss 0.1818 (w 0.1878 mse 0.2041 t 896 new 0.23) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +step 4204/5000 loss 0.3289 (w 0.4938 mse 0.4924 t 993 new 0.21) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +step 4205/5000 loss 0.2132 (w 0.8018 mse 0.7887 t 997 new 0.23) lr 1.00e-05 gnorm 0.172 3.23s mem 81.1GB +step 4206/5000 loss 0.4029 (w 0.2017 mse 0.2148 t 734 new 0.18) lr 1.00e-05 gnorm 0.243 2.82s mem 81.1GB +step 4207/5000 loss 0.1835 (w 0.3961 mse 0.4147 t 993 new 0.20) lr 1.00e-05 gnorm 0.138 3.31s mem 81.1GB +step 4208/5000 loss 0.3358 (w 0.2109 mse 0.2237 t 1000 new 0.18) lr 1.00e-05 gnorm 0.143 3.05s mem 81.1GB +step 4209/5000 loss 0.1339 (w 0.2541 mse 0.2507 t 840 new 0.21) lr 1.00e-05 gnorm 0.110 3.02s mem 81.1GB +step 4210/5000 loss 0.3584 (w 0.3449 mse 0.3418 t 963 new 0.26) lr 1.00e-05 gnorm 0.132 3.35s mem 81.1GB +step 4211/5000 loss 0.2257 (w 0.2799 mse 0.2791 t 920 new 0.16) lr 1.00e-05 gnorm 0.423 3.12s mem 81.1GB +step 4212/5000 loss 0.3484 (w 0.2738 mse 0.2741 t 860 new 0.21) lr 1.00e-05 gnorm 0.145 3.09s mem 81.1GB +step 4213/5000 loss 0.2839 (w 0.5408 mse 0.5481 t 996 new 0.20) lr 1.00e-05 gnorm 0.136 3.11s mem 81.1GB +step 4214/5000 loss 0.2740 (w 0.3200 mse 0.3288 t 979 new 0.13) lr 1.00e-05 gnorm 0.189 3.04s mem 81.1GB +step 4215/5000 loss 0.1298 (w 0.2327 mse 0.2326 t 902 new 0.21) lr 1.00e-05 gnorm 0.106 3.07s mem 81.1GB +step 4216/5000 loss 0.2894 (w 0.2323 mse 0.2400 t 875 new 0.22) lr 1.00e-05 gnorm 0.136 3.43s mem 81.1GB +step 4217/5000 loss 0.4061 (w 0.4032 mse 0.4154 t 259 new 0.22) lr 1.00e-05 gnorm 0.105 3.15s mem 81.1GB +step 4218/5000 loss 0.4790 (w 0.4887 mse 0.4922 t 297 new 0.23) lr 1.00e-05 gnorm 0.131 3.03s mem 81.1GB +step 4219/5000 loss 0.2622 (w 0.2855 mse 0.2978 t 911 new 0.18) lr 1.00e-05 gnorm 0.141 3.09s mem 81.1GB +step 4220/5000 loss 0.2767 (w 0.3382 mse 0.3462 t 490 new 0.19) lr 1.00e-05 gnorm 0.164 3.00s mem 81.1GB +step 4221/5000 loss 0.3932 (w 0.1464 mse 0.1584 t 868 new 0.17) lr 1.00e-05 gnorm 0.171 3.02s mem 81.1GB +step 4222/5000 loss 0.2316 (w 0.4155 mse 0.4133 t 998 new 0.22) lr 1.00e-05 gnorm 0.121 3.48s mem 81.1GB +step 4223/5000 loss 0.4227 (w 0.3775 mse 0.3917 t 997 new 0.20) lr 1.00e-05 gnorm 0.229 2.82s mem 81.1GB +step 4224/5000 loss 0.2209 (w 0.2360 mse 0.2362 t 865 new 0.23) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +step 4225/5000 loss 0.2333 (w 0.2009 mse 0.2070 t 861 new 0.21) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +step 4226/5000 loss 0.1671 (w 0.2978 mse 0.2965 t 278 new 0.27) lr 1.00e-05 gnorm 0.089 3.01s mem 81.1GB +step 4227/5000 loss 0.1453 (w 0.3998 mse 0.4111 t 997 new 0.10) lr 1.00e-05 gnorm 0.095 3.04s mem 81.1GB +step 4228/5000 loss 0.2237 (w 0.1865 mse 0.2109 t 917 new 0.18) lr 1.00e-05 gnorm 0.115 3.41s mem 81.1GB +step 4229/5000 loss 0.3728 (w 0.2772 mse 0.2818 t 937 new 0.17) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +step 4230/5000 loss 0.4500 (w 0.3787 mse 0.3666 t 911 new 0.25) lr 1.00e-05 gnorm 0.119 3.32s mem 81.1GB +step 4231/5000 loss 0.2807 (w 0.2203 mse 0.2404 t 704 new 0.19) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +step 4232/5000 loss 0.4338 (w 0.3344 mse 0.3467 t 421 new 0.21) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +step 4233/5000 loss 0.3474 (w 0.3376 mse 0.3402 t 715 new 0.19) lr 1.00e-05 gnorm 0.111 3.13s mem 81.1GB +step 4234/5000 loss 0.2835 (w 0.2879 mse 0.2987 t 976 new 0.14) lr 1.00e-05 gnorm 0.131 3.48s mem 81.1GB +step 4235/5000 loss 0.1358 (w 0.3871 mse 0.3829 t 990 new 0.23) lr 1.00e-05 gnorm 0.244 2.84s mem 81.1GB +step 4236/5000 loss 0.2458 (w 0.2059 mse 0.2207 t 839 new 0.17) lr 1.00e-05 gnorm 0.101 3.09s mem 81.1GB +step 4237/5000 loss 0.2357 (w 0.2602 mse 0.2674 t 726 new 0.14) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +step 4238/5000 loss 0.1695 (w 0.2400 mse 0.2443 t 906 new 0.23) lr 1.00e-05 gnorm 0.125 3.26s mem 81.1GB +step 4239/5000 loss 0.3109 (w 0.3702 mse 0.3753 t 980 new 0.25) lr 1.00e-05 gnorm 0.193 3.41s mem 81.1GB +step 4240/5000 loss 0.1896 (w 0.3530 mse 0.3816 t 315 new 0.14) lr 1.00e-05 gnorm 0.141 3.31s mem 81.1GB +step 4241/5000 loss 0.2450 (w 0.3227 mse 0.3357 t 508 new 0.18) lr 1.00e-05 gnorm 0.128 2.85s mem 81.1GB +step 4242/5000 loss 0.3933 (w 0.2048 mse 0.2192 t 969 new 0.11) lr 1.00e-05 gnorm 0.191 3.30s mem 81.1GB +step 4243/5000 loss 0.2603 (w 0.2728 mse 0.2859 t 715 new 0.22) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +step 4244/5000 loss 0.1813 (w 0.3735 mse 0.3588 t 930 new 0.22) lr 1.00e-05 gnorm 0.125 3.11s mem 81.1GB +step 4245/5000 loss 0.3208 (w 0.2502 mse 0.2632 t 947 new 0.20) lr 1.00e-05 gnorm 0.102 3.35s mem 81.1GB +step 4246/5000 loss 0.2469 (w 0.3989 mse 0.4119 t 973 new 0.27) lr 1.00e-05 gnorm 0.114 3.27s mem 81.1GB +step 4247/5000 loss 0.3056 (w 0.3191 mse 0.3148 t 953 new 0.16) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +step 4248/5000 loss 0.2597 (w 0.1929 mse 0.2141 t 765 new 0.23) lr 1.00e-05 gnorm 0.100 3.10s mem 81.1GB +step 4249/5000 loss 0.1172 (w 0.3092 mse 0.3079 t 940 new 0.24) lr 1.00e-05 gnorm 0.100 3.06s mem 81.1GB +step 4250/5000 loss 0.3241 (w 0.2928 mse 0.3002 t 954 new 0.23) lr 1.00e-05 gnorm 0.111 3.06s mem 81.1GB +step 4251/5000 loss 0.3237 (w 0.2472 mse 0.2575 t 939 new 0.11) lr 1.00e-05 gnorm 0.225 3.32s mem 81.1GB +step 4252/5000 loss 0.2119 (w 0.3109 mse 0.3195 t 948 new 0.23) lr 1.00e-05 gnorm 0.126 3.31s mem 81.1GB +step 4253/5000 loss 0.2755 (w 0.2718 mse 0.2899 t 348 new 0.17) lr 1.00e-05 gnorm 0.156 2.82s mem 81.1GB +step 4254/5000 loss 0.3399 (w 0.3165 mse 0.3202 t 854 new 0.16) lr 1.00e-05 gnorm 0.131 3.07s mem 81.1GB +step 4255/5000 loss 0.2853 (w 0.2459 mse 0.2706 t 986 new 0.26) lr 1.00e-05 gnorm 0.149 3.04s mem 81.1GB +step 4256/5000 loss 0.1601 (w 0.3293 mse 0.3361 t 839 new 0.22) lr 1.00e-05 gnorm 0.127 3.41s mem 81.1GB +step 4257/5000 loss 0.2308 (w 0.2880 mse 0.2763 t 799 new 0.21) lr 1.00e-05 gnorm 0.170 3.14s mem 81.1GB +step 4258/5000 loss 0.4703 (w 0.3360 mse 0.3332 t 710 new 0.26) lr 1.00e-05 gnorm 0.149 3.18s mem 81.1GB +step 4259/5000 loss 0.2129 (w 0.3146 mse 0.3139 t 670 new 0.19) lr 1.00e-05 gnorm 0.142 3.15s mem 81.1GB +step 4260/5000 loss 0.2743 (w 0.2521 mse 0.2610 t 898 new 0.23) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +step 4261/5000 loss 0.4900 (w 0.2243 mse 0.2316 t 951 new 0.15) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +step 4262/5000 loss 0.1906 (w 0.3581 mse 0.3470 t 951 new 0.25) lr 1.00e-05 gnorm 0.178 3.03s mem 81.1GB +step 4263/5000 loss 0.3355 (w 0.2124 mse 0.2127 t 916 new 0.00) lr 1.00e-05 gnorm 0.271 3.57s mem 81.1GB +step 4264/5000 loss 0.3213 (w 0.3310 mse 0.3329 t 895 new 0.17) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +step 4265/5000 loss 0.4317 (w 0.2785 mse 0.2810 t 763 new 0.13) lr 1.00e-05 gnorm 0.113 3.13s mem 81.1GB +step 4266/5000 loss 0.2645 (w 0.3520 mse 0.3488 t 988 new 0.22) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +step 4267/5000 loss 0.3048 (w 0.3053 mse 0.3103 t 767 new 0.23) lr 1.00e-05 gnorm 0.126 3.40s mem 81.1GB +step 4268/5000 loss 0.3068 (w 0.2338 mse 0.2372 t 942 new 0.09) lr 1.00e-05 gnorm 0.116 3.01s mem 81.1GB +step 4269/5000 loss 0.2511 (w 0.2722 mse 0.2988 t 963 new 0.19) lr 1.00e-05 gnorm 0.116 3.37s mem 81.1GB +step 4270/5000 loss 0.3089 (w 0.2528 mse 0.2637 t 778 new 0.23) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +step 4271/5000 loss 0.2969 (w 0.3245 mse 0.3227 t 653 new 0.23) lr 1.00e-05 gnorm 0.151 3.13s mem 81.1GB +step 4272/5000 loss 0.1979 (w 0.3058 mse 0.3104 t 973 new 0.24) lr 1.00e-05 gnorm 0.132 2.85s mem 81.1GB +step 4273/5000 loss 0.2092 (w 0.2001 mse 0.2156 t 894 new 0.24) lr 1.00e-05 gnorm 0.140 3.13s mem 81.1GB +step 4274/5000 loss 0.2704 (w 0.2135 mse 0.2190 t 724 new 0.15) lr 1.00e-05 gnorm 0.126 3.27s mem 81.1GB +step 4275/5000 loss 0.2599 (w 0.4190 mse 0.4148 t 978 new 0.24) lr 1.00e-05 gnorm 0.125 3.47s mem 81.1GB +step 4276/5000 loss 0.3391 (w 0.2403 mse 0.2490 t 779 new 0.25) lr 1.00e-05 gnorm 0.114 2.84s mem 81.1GB +step 4277/5000 loss 0.2584 (w 0.2742 mse 0.2743 t 857 new 0.22) lr 1.00e-05 gnorm 0.121 3.31s mem 81.1GB +step 4278/5000 loss 0.4586 (w 0.1714 mse 0.1916 t 804 new 0.16) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +step 4279/5000 loss 0.2852 (w 0.2180 mse 0.2321 t 933 new 0.19) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +step 4280/5000 loss 0.4591 (w 0.1906 mse 0.2046 t 683 new 0.18) lr 1.00e-05 gnorm 0.235 3.20s mem 81.1GB +step 4281/5000 loss 0.1757 (w 0.2393 mse 0.2445 t 965 new 0.26) lr 1.00e-05 gnorm 0.112 3.18s mem 81.1GB +step 4282/5000 loss 0.1668 (w 0.3984 mse 0.3908 t 985 new 0.21) lr 1.00e-05 gnorm 0.107 2.83s mem 81.1GB +step 4283/5000 loss 0.3028 (w 0.3172 mse 0.3202 t 683 new 0.16) lr 1.00e-05 gnorm 0.108 3.35s mem 81.1GB +step 4284/5000 loss 0.2348 (w 0.5614 mse 0.5672 t 989 new 0.19) lr 1.00e-05 gnorm 0.121 3.10s mem 81.1GB +step 4285/5000 loss 0.3344 (w 0.2648 mse 0.2649 t 598 new 0.09) lr 1.00e-05 gnorm 0.132 3.05s mem 81.1GB +step 4286/5000 loss 0.1494 (w 0.2619 mse 0.2675 t 926 new 0.20) lr 1.00e-05 gnorm 0.272 3.33s mem 81.1GB +step 4287/5000 loss 0.2071 (w 0.4651 mse 0.4546 t 994 new 0.19) lr 1.00e-05 gnorm 0.128 3.10s mem 81.1GB +step 4288/5000 loss 0.4558 (w 0.2599 mse 0.2809 t 942 new 0.16) lr 1.00e-05 gnorm 0.099 3.00s mem 81.1GB +step 4289/5000 loss 0.1633 (w 0.4572 mse 0.4265 t 970 new 0.19) lr 1.00e-05 gnorm 0.296 3.05s mem 81.1GB +step 4290/5000 loss 0.2871 (w 0.2520 mse 0.2649 t 940 new 0.25) lr 1.00e-05 gnorm 0.191 3.13s mem 81.1GB +step 4291/5000 loss 0.1970 (w 0.2838 mse 0.2812 t 817 new 0.20) lr 1.00e-05 gnorm 0.121 3.03s mem 81.1GB +step 4292/5000 loss 0.4131 (w 0.2030 mse 0.2141 t 663 new 0.26) lr 1.00e-05 gnorm 0.125 3.14s mem 81.1GB +step 4293/5000 loss 0.2154 (w 0.4097 mse 0.4523 t 177 new 0.23) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +step 4294/5000 loss 0.3918 (w 0.1614 mse 0.1830 t 741 new 0.18) lr 1.00e-05 gnorm 0.122 3.03s mem 81.1GB +step 4295/5000 loss 0.1545 (w 0.3424 mse 0.3650 t 976 new 0.22) lr 1.00e-05 gnorm 0.102 3.08s mem 81.1GB +step 4296/5000 loss 0.2405 (w 0.1914 mse 0.2110 t 861 new 0.26) lr 1.00e-05 gnorm 0.167 3.11s mem 81.1GB +step 4297/5000 loss 0.3913 (w 0.9390 mse 1.0065 t 998 new 0.18) lr 1.00e-05 gnorm 0.174 3.04s mem 81.1GB +step 4298/5000 loss 0.1887 (w 0.2025 mse 0.2270 t 775 new 0.25) lr 1.00e-05 gnorm 0.190 3.13s mem 81.1GB +step 4299/5000 loss 0.3438 (w 0.3014 mse 0.3020 t 904 new 0.22) lr 1.00e-05 gnorm 0.151 2.84s mem 81.1GB +step 4300/5000 loss 0.1937 (w 0.2404 mse 0.2458 t 882 new 0.19) lr 1.00e-05 gnorm 0.118 3.04s mem 81.1GB +step 4301/5000 loss 0.2639 (w 0.1896 mse 0.2134 t 907 new 0.24) lr 1.00e-05 gnorm 0.121 3.13s mem 81.1GB +step 4302/5000 loss 0.1962 (w 0.2850 mse 0.2853 t 873 new 0.23) lr 1.00e-05 gnorm 0.105 3.05s mem 81.1GB +step 4303/5000 loss 0.3364 (w 0.3194 mse 0.3387 t 931 new 0.20) lr 1.00e-05 gnorm 0.106 3.11s mem 81.1GB +step 4304/5000 loss 0.3134 (w 0.4079 mse 0.4128 t 278 new 0.22) lr 1.00e-05 gnorm 0.116 3.29s mem 81.1GB +step 4305/5000 loss 0.2214 (w 0.3554 mse 0.3555 t 962 new 0.20) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +step 4306/5000 loss 0.2911 (w 0.2347 mse 0.2330 t 879 new 0.07) lr 1.00e-05 gnorm 0.108 3.04s mem 81.1GB +step 4307/5000 loss 0.2712 (w 0.3096 mse 0.3256 t 830 new 0.21) lr 1.00e-05 gnorm 0.100 3.08s mem 81.1GB +step 4308/5000 loss 0.4168 (w 0.4194 mse 0.4381 t 238 new 0.18) lr 1.00e-05 gnorm 0.162 3.09s mem 81.1GB +step 4309/5000 loss 0.4195 (w 0.2501 mse 0.2611 t 829 new 0.29) lr 1.00e-05 gnorm 0.191 3.05s mem 81.1GB +step 4310/5000 loss 0.2903 (w 0.6026 mse 0.6090 t 127 new 0.11) lr 1.00e-05 gnorm 0.207 3.26s mem 81.1GB +step 4311/5000 loss 0.4300 (w 0.2959 mse 0.2929 t 653 new 0.19) lr 1.00e-05 gnorm 0.873 2.83s mem 81.1GB +step 4312/5000 loss 0.2150 (w 0.4333 mse 0.4324 t 990 new 0.19) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 4313/5000 loss 0.1962 (w 0.2606 mse 0.2708 t 911 new 0.18) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +step 4314/5000 loss 0.3318 (w 0.1919 mse 0.2142 t 540 new 0.16) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +step 4315/5000 loss 0.3530 (w 0.2455 mse 0.2578 t 977 new 0.21) lr 1.00e-05 gnorm 0.118 3.05s mem 81.1GB +step 4316/5000 loss 0.2697 (w 0.2751 mse 0.2825 t 925 new 0.24) lr 1.00e-05 gnorm 0.165 3.55s mem 81.1GB +step 4317/5000 loss 0.2970 (w 0.1838 mse 0.2137 t 383 new 0.18) lr 1.00e-05 gnorm 0.106 2.83s mem 81.1GB +step 4318/5000 loss 0.3955 (w 0.3919 mse 0.3879 t 989 new 0.18) lr 1.00e-05 gnorm 0.249 3.30s mem 81.1GB +step 4319/5000 loss 0.4363 (w 0.4296 mse 0.4253 t 988 new 0.22) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +step 4320/5000 loss 0.1985 (w 0.1860 mse 0.1981 t 890 new 0.26) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +step 4321/5000 loss 0.3405 (w 0.3623 mse 0.3514 t 938 new 0.19) lr 1.00e-05 gnorm 0.178 3.06s mem 81.1GB +step 4322/5000 loss 0.2203 (w 0.2915 mse 0.2905 t 720 new 0.12) lr 1.00e-05 gnorm 0.140 3.50s mem 81.1GB +step 4323/5000 loss 0.4747 (w 0.3156 mse 0.3189 t 586 new 0.21) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 4324/5000 loss 0.0888 (w 0.3266 mse 0.3439 t 983 new 0.19) lr 1.00e-05 gnorm 0.143 3.30s mem 81.1GB +step 4325/5000 loss 0.1981 (w 0.2533 mse 0.2704 t 861 new 0.13) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +step 4326/5000 loss 0.2790 (w 0.2059 mse 0.2236 t 977 new 0.20) lr 1.00e-05 gnorm 0.087 2.83s mem 81.1GB +step 4327/5000 loss 0.2720 (w 0.2358 mse 0.2529 t 735 new 0.24) lr 1.00e-05 gnorm 0.118 3.05s mem 81.1GB +step 4328/5000 loss 0.3214 (w 0.4398 mse 0.4437 t 999 new 0.20) lr 1.00e-05 gnorm 0.091 3.40s mem 81.1GB +step 4329/5000 loss 0.3196 (w 0.3965 mse 0.3905 t 971 new 0.19) lr 1.00e-05 gnorm 0.291 2.82s mem 81.1GB +step 4330/5000 loss 0.2441 (w 0.2229 mse 0.2274 t 921 new 0.14) lr 1.00e-05 gnorm 0.134 3.31s mem 81.1GB +step 4331/5000 loss 0.2567 (w 0.3805 mse 0.3790 t 1000 new 0.27) lr 1.00e-05 gnorm 0.116 3.09s mem 81.1GB +step 4332/5000 loss 0.4106 (w 0.6229 mse 0.6268 t 177 new 0.21) lr 1.00e-05 gnorm 0.115 2.83s mem 81.1GB +step 4333/5000 loss 0.1286 (w 0.4104 mse 0.4068 t 991 new 0.25) lr 1.00e-05 gnorm 0.101 3.04s mem 81.1GB +step 4334/5000 loss 0.2884 (w 0.2452 mse 0.2523 t 917 new 0.12) lr 1.00e-05 gnorm 0.142 3.41s mem 81.1GB +step 4335/5000 loss 0.0962 (w 0.3218 mse 0.3188 t 949 new 0.19) lr 1.00e-05 gnorm 0.115 2.82s mem 81.1GB +step 4336/5000 loss 0.2199 (w 0.4169 mse 0.4219 t 996 new 0.16) lr 1.00e-05 gnorm 0.118 3.50s mem 81.1GB +step 4337/5000 loss 0.2530 (w 0.2782 mse 0.2889 t 641 new 0.28) lr 1.00e-05 gnorm 0.152 3.11s mem 81.1GB +step 4338/5000 loss 0.2863 (w 0.2099 mse 0.2278 t 872 new 0.17) lr 1.00e-05 gnorm 0.159 2.82s mem 81.1GB +step 4339/5000 loss 0.2932 (w 0.2945 mse 0.2963 t 969 new 0.13) lr 1.00e-05 gnorm 0.127 3.06s mem 81.1GB +step 4340/5000 loss 0.3677 (w 0.3172 mse 0.3198 t 980 new 0.18) lr 1.00e-05 gnorm 0.123 3.46s mem 81.1GB +step 4341/5000 loss 0.1417 (w 0.2256 mse 0.2310 t 774 new 0.20) lr 1.00e-05 gnorm 0.100 3.02s mem 81.1GB +step 4342/5000 loss 0.3724 (w 0.4181 mse 0.4441 t 233 new 0.22) lr 1.00e-05 gnorm 0.120 3.21s mem 81.1GB +step 4343/5000 loss 0.2218 (w 0.2758 mse 0.2769 t 948 new 0.24) lr 1.00e-05 gnorm 0.107 3.10s mem 81.1GB +step 4344/5000 loss 0.3033 (w 0.2590 mse 0.2664 t 883 new 0.25) lr 1.00e-05 gnorm 0.116 2.83s mem 81.1GB +step 4345/5000 loss 0.2334 (w 0.4356 mse 0.4264 t 986 new 0.21) lr 1.00e-05 gnorm 0.182 3.33s mem 81.1GB +step 4346/5000 loss 0.3241 (w 0.2233 mse 0.2277 t 936 new 0.17) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +step 4347/5000 loss 0.2694 (w 0.2944 mse 0.2993 t 978 new 0.24) lr 1.00e-05 gnorm 0.121 3.07s mem 81.1GB +step 4348/5000 loss 0.1939 (w 0.3131 mse 0.3263 t 946 new 0.24) lr 1.00e-05 gnorm 0.133 3.11s mem 81.1GB +step 4349/5000 loss 0.2143 (w 0.2477 mse 0.2745 t 997 new 0.13) lr 1.00e-05 gnorm 0.282 3.20s mem 81.1GB +step 4350/5000 loss 0.5006 (w 0.3128 mse 0.3193 t 506 new 0.28) lr 1.00e-05 gnorm 0.147 2.82s mem 81.1GB +step 4351/5000 loss 0.3582 (w 0.1925 mse 0.2012 t 737 new 0.16) lr 1.00e-05 gnorm 0.155 3.34s mem 81.1GB +step 4352/5000 loss 0.2184 (w 0.2166 mse 0.2381 t 840 new 0.19) lr 1.00e-05 gnorm 0.108 3.40s mem 81.1GB +step 4353/5000 loss 0.2128 (w 0.3520 mse 0.3640 t 961 new 0.15) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +step 4354/5000 loss 0.4003 (w 0.2540 mse 0.2651 t 624 new 0.21) lr 1.00e-05 gnorm 0.159 3.14s mem 81.1GB +step 4355/5000 loss 0.2299 (w 0.3980 mse 0.4071 t 979 new 0.15) lr 1.00e-05 gnorm 0.085 3.28s mem 81.1GB +step 4356/5000 loss 0.1646 (w 0.3077 mse 0.3063 t 938 new 0.16) lr 1.00e-05 gnorm 0.097 3.03s mem 81.1GB +step 4357/5000 loss 0.1674 (w 0.2113 mse 0.2168 t 871 new 0.19) lr 1.00e-05 gnorm 0.188 3.17s mem 81.1GB +step 4358/5000 loss 0.5065 (w 0.2523 mse 0.2618 t 578 new 0.23) lr 1.00e-05 gnorm 0.149 3.23s mem 81.1GB +step 4359/5000 loss 0.2282 (w 0.2580 mse 0.2621 t 756 new 0.18) lr 1.00e-05 gnorm 0.106 3.14s mem 81.1GB +step 4360/5000 loss 0.2272 (w 0.2653 mse 0.2733 t 971 new 0.23) lr 1.00e-05 gnorm 0.122 3.31s mem 81.1GB +step 4361/5000 loss 0.2488 (w 0.3605 mse 0.3540 t 997 new 0.20) lr 1.00e-05 gnorm 0.120 3.11s mem 81.1GB +step 4362/5000 loss 0.2451 (w 0.3776 mse 0.3859 t 976 new 0.22) lr 1.00e-05 gnorm 0.122 3.04s mem 81.1GB +step 4363/5000 loss 0.3582 (w 0.3234 mse 0.3271 t 935 new 0.16) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +step 4364/5000 loss 0.1331 (w 0.2358 mse 0.2495 t 950 new 0.23) lr 1.00e-05 gnorm 0.152 3.21s mem 81.1GB +step 4365/5000 loss 0.2762 (w 0.3276 mse 0.3279 t 465 new 0.21) lr 1.00e-05 gnorm 0.123 3.58s mem 81.1GB +step 4366/5000 loss 0.2167 (w 0.2381 mse 0.2527 t 939 new 0.19) lr 1.00e-05 gnorm 0.111 3.06s mem 81.1GB +step 4367/5000 loss 0.2703 (w 0.3193 mse 0.3341 t 958 new 0.25) lr 1.00e-05 gnorm 0.126 3.10s mem 81.1GB +step 4368/5000 loss 0.3525 (w 0.1887 mse 0.2072 t 728 new 0.20) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +step 4369/5000 loss 0.5157 (w 0.2942 mse 0.3030 t 434 new 0.17) lr 1.00e-05 gnorm 0.123 3.57s mem 81.1GB +step 4370/5000 loss 0.2663 (w 0.2124 mse 0.2116 t 698 new 0.18) lr 1.00e-05 gnorm 0.180 3.69s mem 81.1GB +step 4371/5000 loss 0.3188 (w 0.3087 mse 0.3035 t 894 new 0.20) lr 1.00e-05 gnorm 0.119 3.43s mem 81.1GB +step 4372/5000 loss 0.3033 (w 0.2750 mse 0.2705 t 830 new 0.18) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +step 4373/5000 loss 0.3944 (w 0.2677 mse 0.2728 t 884 new 0.20) lr 1.00e-05 gnorm 0.146 3.02s mem 81.1GB +step 4374/5000 loss 0.4218 (w 0.3041 mse 0.2964 t 584 new 0.22) lr 1.00e-05 gnorm 0.121 3.38s mem 81.1GB +step 4375/5000 loss 0.1748 (w 0.2849 mse 0.3077 t 840 new 0.16) lr 1.00e-05 gnorm 0.107 3.24s mem 81.1GB +step 4376/5000 loss 0.3019 (w 0.3463 mse 0.3482 t 913 new 0.27) lr 1.00e-05 gnorm 0.105 3.10s mem 81.1GB +step 4377/5000 loss 0.2508 (w 0.4161 mse 0.4084 t 994 new 0.18) lr 1.00e-05 gnorm 0.113 3.36s mem 81.1GB +step 4378/5000 loss 0.3046 (w 0.3036 mse 0.3069 t 768 new 0.21) lr 1.00e-05 gnorm 0.161 3.08s mem 81.1GB +step 4379/5000 loss 0.2707 (w 0.3734 mse 0.3753 t 958 new 0.21) lr 1.00e-05 gnorm 0.221 3.10s mem 81.1GB +step 4380/5000 loss 0.1512 (w 0.3458 mse 0.3425 t 961 new 0.24) lr 1.00e-05 gnorm 0.124 3.42s mem 81.1GB +step 4381/5000 loss 0.2661 (w 0.2501 mse 0.2643 t 733 new 0.23) lr 1.00e-05 gnorm 0.220 3.54s mem 81.1GB +step 4382/5000 loss 0.2158 (w 0.1949 mse 0.2237 t 914 new 0.18) lr 1.00e-05 gnorm 0.167 3.11s mem 81.1GB +step 4383/5000 loss 0.2023 (w 0.4215 mse 0.4268 t 991 new 0.23) lr 1.00e-05 gnorm 0.136 3.17s mem 81.1GB +step 4384/5000 loss 0.2755 (w 0.2994 mse 0.3103 t 957 new 0.22) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +step 4385/5000 loss 0.3136 (w 0.3498 mse 0.3458 t 844 new 0.17) lr 1.00e-05 gnorm 0.111 3.10s mem 81.1GB +step 4386/5000 loss 0.1796 (w 0.2040 mse 0.2114 t 882 new 0.11) lr 1.00e-05 gnorm 0.111 3.32s mem 81.1GB +step 4387/5000 loss 0.2543 (w 0.2866 mse 0.2916 t 990 new 0.18) lr 1.00e-05 gnorm 0.114 3.43s mem 81.1GB +step 4388/5000 loss 0.2528 (w 0.5849 mse 0.5747 t 994 new 0.23) lr 1.00e-05 gnorm 0.172 3.10s mem 81.1GB +step 4389/5000 loss 0.3022 (w 0.2099 mse 0.2341 t 972 new 0.19) lr 1.00e-05 gnorm 0.106 3.19s mem 81.1GB +step 4390/5000 loss 0.2412 (w 0.3087 mse 0.3038 t 987 new 0.20) lr 1.00e-05 gnorm 0.134 3.23s mem 81.1GB +step 4391/5000 loss 0.3547 (w 0.2464 mse 0.2680 t 992 new 0.10) lr 1.00e-05 gnorm 0.134 3.04s mem 81.1GB +step 4392/5000 loss 0.0716 (w 0.2139 mse 0.2265 t 908 new 0.22) lr 1.00e-05 gnorm 0.106 3.06s mem 81.1GB +step 4393/5000 loss 0.2569 (w 0.1979 mse 0.2185 t 750 new 0.23) lr 1.00e-05 gnorm 0.109 3.45s mem 81.1GB +step 4394/5000 loss 0.4291 (w 0.2554 mse 0.2512 t 929 new 0.20) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +step 4395/5000 loss 0.1449 (w 0.2084 mse 0.2084 t 942 new 0.00) lr 1.00e-05 gnorm 0.215 3.04s mem 81.1GB +step 4396/5000 loss 0.3798 (w 0.3430 mse 0.3488 t 453 new 0.25) lr 1.00e-05 gnorm 0.102 3.38s mem 81.1GB +step 4397/5000 loss 0.1805 (w 0.3134 mse 0.3122 t 926 new 0.09) lr 1.00e-05 gnorm 0.117 3.09s mem 81.1GB +step 4398/5000 loss 0.2108 (w 0.3735 mse 0.3713 t 959 new 0.21) lr 1.00e-05 gnorm 0.133 3.30s mem 81.1GB +step 4399/5000 loss 0.2460 (w 0.2590 mse 0.2668 t 712 new 0.12) lr 1.00e-05 gnorm 0.118 3.12s mem 81.1GB +step 4400/5000 loss 0.3773 (w 0.5740 mse 0.5704 t 177 new 0.26) lr 1.00e-05 gnorm 0.113 3.01s mem 81.1GB +step 4401/5000 loss 0.4353 (w 0.4643 mse 0.4631 t 470 new 0.20) lr 1.00e-05 gnorm 0.141 3.35s mem 81.1GB +step 4402/5000 loss 0.3148 (w 0.2845 mse 0.2845 t 752 new 0.26) lr 1.00e-05 gnorm 0.145 3.05s mem 81.1GB +step 4403/5000 loss 0.2535 (w 0.1740 mse 0.1964 t 851 new 0.22) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +step 4404/5000 loss 0.2167 (w 0.2835 mse 0.3007 t 944 new 0.25) lr 1.00e-05 gnorm 0.087 3.14s mem 81.1GB +step 4405/5000 loss 0.2002 (w 0.3984 mse 0.4045 t 980 new 0.23) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +step 4406/5000 loss 0.2885 (w 0.2378 mse 0.2439 t 775 new 0.19) lr 1.00e-05 gnorm 0.317 3.04s mem 81.1GB +step 4407/5000 loss 0.3216 (w 0.2374 mse 0.2488 t 935 new 0.15) lr 1.00e-05 gnorm 0.140 3.37s mem 81.1GB +step 4408/5000 loss 0.3635 (w 0.2226 mse 0.2244 t 869 new 0.13) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 4409/5000 loss 0.2866 (w 0.3083 mse 0.3252 t 959 new 0.20) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +step 4410/5000 loss 0.2193 (w 0.2634 mse 0.2622 t 866 new 0.15) lr 1.00e-05 gnorm 0.132 3.27s mem 81.1GB +step 4411/5000 loss 0.3625 (w 0.2868 mse 0.2849 t 932 new 0.20) lr 1.00e-05 gnorm 0.133 3.07s mem 81.1GB +step 4412/5000 loss 0.3498 (w 0.2398 mse 0.2517 t 662 new 0.24) lr 1.00e-05 gnorm 0.170 3.29s mem 81.1GB +step 4413/5000 loss 0.3046 (w 0.4617 mse 0.4629 t 274 new 0.19) lr 1.00e-05 gnorm 0.409 3.08s mem 81.1GB +step 4414/5000 loss 0.3671 (w 0.2862 mse 0.3010 t 301 new 0.16) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +step 4415/5000 loss 0.2267 (w 0.3945 mse 0.4160 t 964 new 0.15) lr 1.00e-05 gnorm 0.112 3.10s mem 81.1GB +step 4416/5000 loss 0.3155 (w 0.2796 mse 0.2811 t 731 new 0.22) lr 1.00e-05 gnorm 0.101 3.35s mem 81.1GB +step 4417/5000 loss 0.4817 (w 0.1840 mse 0.1846 t 787 new 0.09) lr 1.00e-05 gnorm 0.117 3.32s mem 81.1GB +step 4418/5000 loss 0.3395 (w 0.2876 mse 0.2906 t 991 new 0.14) lr 1.00e-05 gnorm 0.115 3.34s mem 81.1GB +step 4419/5000 loss 0.3403 (w 0.2085 mse 0.2216 t 574 new 0.13) lr 1.00e-05 gnorm 0.254 3.08s mem 81.1GB +step 4420/5000 loss 0.2926 (w 0.2216 mse 0.2388 t 918 new 0.23) lr 1.00e-05 gnorm 0.242 3.13s mem 81.1GB +step 4421/5000 loss 0.2150 (w 0.1513 mse 0.1738 t 922 new 0.18) lr 1.00e-05 gnorm 0.113 3.06s mem 81.1GB +step 4422/5000 loss 0.3112 (w 0.2973 mse 0.3052 t 747 new 0.19) lr 1.00e-05 gnorm 0.116 3.38s mem 81.1GB +step 4423/5000 loss 0.3312 (w 0.2837 mse 0.2836 t 733 new 0.21) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +step 4424/5000 loss 0.2478 (w 0.2899 mse 0.3058 t 758 new 0.17) lr 1.00e-05 gnorm 0.126 3.34s mem 81.1GB +step 4425/5000 loss 0.1848 (w 0.4339 mse 0.4325 t 980 new 0.21) lr 1.00e-05 gnorm 0.533 3.08s mem 81.1GB +step 4426/5000 loss 0.4186 (w 0.3427 mse 0.3631 t 437 new 0.21) lr 1.00e-05 gnorm 0.140 2.82s mem 81.1GB +step 4427/5000 loss 0.3984 (w 0.2968 mse 0.2915 t 642 new 0.18) lr 1.00e-05 gnorm 0.125 3.30s mem 81.1GB +step 4428/5000 loss 0.2308 (w 0.3683 mse 0.3788 t 996 new 0.20) lr 1.00e-05 gnorm 0.134 3.33s mem 81.1GB +step 4429/5000 loss 0.2745 (w 0.2638 mse 0.2707 t 975 new 0.23) lr 1.00e-05 gnorm 0.107 3.01s mem 81.1GB +step 4430/5000 loss 0.2578 (w 0.2096 mse 0.2307 t 789 new 0.15) lr 1.00e-05 gnorm 0.130 3.12s mem 81.1GB +step 4431/5000 loss 0.2650 (w 0.3808 mse 0.3955 t 989 new 0.24) lr 1.00e-05 gnorm 0.148 3.11s mem 81.1GB +step 4432/5000 loss 0.1732 (w 0.2711 mse 0.2704 t 915 new 0.17) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +step 4433/5000 loss 0.2492 (w 0.3028 mse 0.3166 t 911 new 0.18) lr 1.00e-05 gnorm 0.099 3.37s mem 81.1GB +step 4434/5000 loss 0.1676 (w 0.2556 mse 0.2646 t 864 new 0.15) lr 1.00e-05 gnorm 0.099 3.35s mem 81.1GB +step 4435/5000 loss 0.3756 (w 0.1851 mse 0.2013 t 742 new 0.23) lr 1.00e-05 gnorm 1.162 3.02s mem 81.1GB +step 4436/5000 loss 0.4675 (w 0.2456 mse 0.2603 t 725 new 0.27) lr 1.00e-05 gnorm 0.112 3.15s mem 81.1GB +step 4437/5000 loss 0.2793 (w 0.3877 mse 0.3928 t 997 new 0.20) lr 1.00e-05 gnorm 0.126 3.06s mem 81.1GB +step 4438/5000 loss 0.2869 (w 0.2810 mse 0.2851 t 941 new 0.16) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +step 4439/5000 loss 0.3030 (w 0.2452 mse 0.2420 t 812 new 0.06) lr 1.00e-05 gnorm 0.248 3.09s mem 81.1GB +step 4440/5000 loss 0.5157 (w 0.3735 mse 0.3820 t 319 new 0.25) lr 1.00e-05 gnorm 0.116 3.03s mem 81.1GB +step 4441/5000 loss 0.1943 (w 0.2456 mse 0.2489 t 761 new 0.22) lr 1.00e-05 gnorm 0.204 3.04s mem 81.1GB +step 4442/5000 loss 0.2333 (w 0.2605 mse 0.2731 t 564 new 0.19) lr 1.00e-05 gnorm 0.097 3.06s mem 81.1GB +step 4443/5000 loss 0.2110 (w 0.2186 mse 0.2264 t 787 new 0.17) lr 1.00e-05 gnorm 0.107 3.10s mem 81.1GB +step 4444/5000 loss 0.1779 (w 0.3114 mse 0.3092 t 922 new 0.24) lr 1.00e-05 gnorm 0.111 3.06s mem 81.1GB +step 4445/5000 loss 0.2479 (w 0.3603 mse 0.3620 t 989 new 0.22) lr 1.00e-05 gnorm 0.091 3.28s mem 81.1GB +step 4446/5000 loss 0.3317 (w 0.3028 mse 0.2977 t 975 new 0.19) lr 1.00e-05 gnorm 0.154 3.03s mem 81.1GB +step 4447/5000 loss 0.2861 (w 0.3338 mse 0.3251 t 789 new 0.22) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 4448/5000 loss 0.1494 (w 0.2335 mse 0.2505 t 923 new 0.27) lr 1.00e-05 gnorm 0.119 3.31s mem 81.1GB +step 4449/5000 loss 0.3970 (w 0.3406 mse 0.3513 t 979 new 0.22) lr 1.00e-05 gnorm 0.140 3.09s mem 81.1GB +step 4450/5000 loss 0.1699 (w 0.3260 mse 0.3341 t 954 new 0.23) lr 1.00e-05 gnorm 0.100 3.10s mem 81.1GB +step 4451/5000 loss 0.3000 (w 0.2588 mse 0.2656 t 906 new 0.18) lr 1.00e-05 gnorm 0.110 3.33s mem 81.1GB +step 4452/5000 loss 0.3531 (w 0.2528 mse 0.2638 t 940 new 0.23) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +step 4453/5000 loss 0.2570 (w 0.1940 mse 0.2004 t 877 new 0.20) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +step 4454/5000 loss 0.3490 (w 0.5318 mse 0.5344 t 217 new 0.23) lr 1.00e-05 gnorm 0.103 3.04s mem 81.1GB +step 4455/5000 loss 0.3543 (w 0.1898 mse 0.2121 t 656 new 0.23) lr 1.00e-05 gnorm 0.106 2.82s mem 81.1GB +step 4456/5000 loss 0.2362 (w 0.2871 mse 0.2919 t 829 new 0.23) lr 1.00e-05 gnorm 0.109 3.13s mem 81.1GB +step 4457/5000 loss 0.3449 (w 0.1958 mse 0.2172 t 835 new 0.20) lr 1.00e-05 gnorm 0.120 3.38s mem 81.1GB +step 4458/5000 loss 0.1856 (w 0.2909 mse 0.2918 t 780 new 0.26) lr 1.00e-05 gnorm 0.146 2.81s mem 81.1GB +step 4459/5000 loss 0.2322 (w 0.4018 mse 0.3990 t 984 new 0.17) lr 1.00e-05 gnorm 0.098 3.22s mem 81.1GB +step 4460/5000 loss 0.3129 (w 0.2234 mse 0.2260 t 870 new 0.18) lr 1.00e-05 gnorm 0.122 3.06s mem 81.1GB +step 4461/5000 loss 0.3224 (w 0.2859 mse 0.3189 t 965 new 0.22) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +step 4462/5000 loss 0.2298 (w 0.2022 mse 0.2055 t 897 new 0.10) lr 1.00e-05 gnorm 0.126 3.07s mem 81.1GB +step 4463/5000 loss 0.1793 (w 0.4078 mse 0.4218 t 966 new 0.20) lr 1.00e-05 gnorm 0.114 3.39s mem 81.1GB +step 4464/5000 loss 0.2370 (w 0.1877 mse 0.2179 t 919 new 0.19) lr 1.00e-05 gnorm 0.153 2.85s mem 81.1GB +step 4465/5000 loss 0.3308 (w 0.3392 mse 0.3535 t 934 new 0.26) lr 1.00e-05 gnorm 0.108 3.27s mem 81.1GB +step 4466/5000 loss 0.4476 (w 0.4276 mse 0.4347 t 301 new 0.24) lr 1.00e-05 gnorm 0.125 3.25s mem 81.1GB +step 4467/5000 loss 0.3097 (w 0.2180 mse 0.2427 t 881 new 0.24) lr 1.00e-05 gnorm 0.102 2.81s mem 81.1GB +step 4468/5000 loss 0.2730 (w 0.1971 mse 0.2175 t 854 new 0.21) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +step 4469/5000 loss 0.1375 (w 0.2883 mse 0.2944 t 972 new 0.18) lr 1.00e-05 gnorm 0.162 3.35s mem 81.1GB +step 4470/5000 loss 0.3242 (w 0.3707 mse 0.3638 t 737 new 0.20) lr 1.00e-05 gnorm 0.649 2.82s mem 81.1GB +step 4471/5000 loss 0.2001 (w 0.3216 mse 0.3096 t 628 new 0.17) lr 1.00e-05 gnorm 0.113 3.06s mem 81.1GB +step 4472/5000 loss 0.2739 (w 0.3037 mse 0.3109 t 758 new 0.21) lr 1.00e-05 gnorm 0.136 3.34s mem 81.1GB +step 4473/5000 loss 0.3457 (w 0.1445 mse 0.1557 t 820 new 0.12) lr 1.00e-05 gnorm 0.273 2.83s mem 81.1GB +step 4474/5000 loss 0.2424 (w 0.2997 mse 0.2980 t 868 new 0.21) lr 1.00e-05 gnorm 0.103 3.12s mem 81.1GB +step 4475/5000 loss 0.5727 (w 0.3286 mse 0.3279 t 456 new 0.25) lr 1.00e-05 gnorm 0.173 3.38s mem 81.1GB +step 4476/5000 loss 0.2541 (w 0.2366 mse 0.2499 t 961 new 0.18) lr 1.00e-05 gnorm 0.097 3.01s mem 81.1GB +step 4477/5000 loss 0.2521 (w 0.2627 mse 0.2749 t 973 new 0.18) lr 1.00e-05 gnorm 0.114 3.11s mem 81.1GB +step 4478/5000 loss 0.3985 (w 0.3059 mse 0.3138 t 599 new 0.21) lr 1.00e-05 gnorm 0.408 3.02s mem 81.1GB +step 4479/5000 loss 0.2741 (w 0.2812 mse 0.2759 t 939 new 0.19) lr 1.00e-05 gnorm 0.122 3.04s mem 81.1GB +step 4480/5000 loss 0.3633 (w 0.2056 mse 0.2071 t 782 new 0.10) lr 1.00e-05 gnorm 0.093 2.82s mem 81.1GB +step 4481/5000 loss 0.2318 (w 0.2777 mse 0.2874 t 951 new 0.20) lr 1.00e-05 gnorm 0.124 3.07s mem 81.1GB +step 4482/5000 loss 0.1907 (w 0.2165 mse 0.2214 t 963 new 0.22) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +step 4483/5000 loss 0.1907 (w 0.1982 mse 0.2133 t 912 new 0.19) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +step 4484/5000 loss 0.3220 (w 0.2716 mse 0.2878 t 943 new 0.22) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +step 4485/5000 loss 0.4299 (w 0.2378 mse 0.2502 t 858 new 0.19) lr 1.00e-05 gnorm 0.161 3.06s mem 81.1GB +step 4486/5000 loss 0.3185 (w 0.2785 mse 0.2873 t 712 new 0.21) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +step 4487/5000 loss 0.3177 (w 0.3119 mse 0.3347 t 356 new 0.20) lr 1.00e-05 gnorm 0.198 3.10s mem 81.1GB +step 4488/5000 loss 0.3661 (w 0.3223 mse 0.3189 t 889 new 0.26) lr 1.00e-05 gnorm 0.107 3.09s mem 81.1GB +step 4489/5000 loss 0.4410 (w 0.6689 mse 0.6666 t 114 new 0.17) lr 1.00e-05 gnorm 0.095 3.25s mem 81.1GB +step 4490/5000 loss 0.4088 (w 0.2816 mse 0.2852 t 993 new 0.11) lr 1.00e-05 gnorm 1.439 2.83s mem 81.1GB +step 4491/5000 loss 0.1498 (w 0.2817 mse 0.2964 t 915 new 0.18) lr 1.00e-05 gnorm 0.118 3.05s mem 81.1GB +step 4492/5000 loss 0.2698 (w 0.2533 mse 0.2592 t 603 new 0.23) lr 1.00e-05 gnorm 0.101 3.16s mem 81.1GB +step 4493/5000 loss 0.1744 (w 0.2885 mse 0.2917 t 939 new 0.13) lr 1.00e-05 gnorm 0.245 3.36s mem 81.1GB +step 4494/5000 loss 0.2410 (w 0.3152 mse 0.3262 t 765 new 0.17) lr 1.00e-05 gnorm 0.127 3.08s mem 81.1GB +step 4495/5000 loss 0.4701 (w 0.1855 mse 0.2120 t 981 new 0.16) lr 1.00e-05 gnorm 0.121 3.29s mem 81.1GB +step 4496/5000 loss 0.2968 (w 0.1847 mse 0.2031 t 724 new 0.25) lr 1.00e-05 gnorm 0.107 2.82s mem 81.1GB +step 4497/5000 loss 0.3935 (w 0.3928 mse 0.3864 t 959 new 0.26) lr 1.00e-05 gnorm 0.146 3.08s mem 81.1GB +step 4498/5000 loss 0.3286 (w 0.2678 mse 0.2765 t 964 new 0.19) lr 1.00e-05 gnorm 0.108 3.05s mem 81.1GB +step 4499/5000 loss 0.2000 (w 0.1891 mse 0.1971 t 659 new 0.18) lr 1.00e-05 gnorm 0.102 3.07s mem 81.1GB +step 4500/5000 loss 0.3127 (w 0.3313 mse 0.3374 t 997 new 0.22) lr 1.00e-05 gnorm 0.137 3.02s mem 81.1GB +[val] step 4500 t=200: w=0.4548 mse=0.4729 (n=16) t=500: w=0.2768 mse=0.2915 (n=16) t=800: w=0.2328 mse=0.2444 (n=16) | mean w=0.3215 mse=0.3362 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step4500.safetensors 4093 个张量 37.98 GB +step 4501/5000 loss 0.2657 (w 0.2494 mse 0.2648 t 841 new 0.14) lr 1.00e-05 gnorm 0.148 3.13s mem 81.1GB +step 4502/5000 loss 0.2238 (w 0.3121 mse 0.3140 t 879 new 0.17) lr 1.00e-05 gnorm 0.127 2.82s mem 81.1GB +step 4503/5000 loss 0.3070 (w 0.2998 mse 0.3199 t 824 new 0.17) lr 1.00e-05 gnorm 0.103 3.38s mem 81.1GB +step 4504/5000 loss 0.2231 (w 0.3310 mse 0.3702 t 140 new 0.18) lr 1.00e-05 gnorm 0.126 3.16s mem 81.1GB +step 4505/5000 loss 0.4745 (w 0.2379 mse 0.2446 t 727 new 0.08) lr 1.00e-05 gnorm 0.124 2.99s mem 81.1GB +step 4506/5000 loss 0.2447 (w 0.2275 mse 0.2364 t 741 new 0.17) lr 1.00e-05 gnorm 0.210 2.81s mem 81.1GB +step 4507/5000 loss 0.1379 (w 0.3523 mse 0.3521 t 974 new 0.15) lr 1.00e-05 gnorm 0.221 3.09s mem 81.1GB +step 4508/5000 loss 0.2892 (w 0.2794 mse 0.3010 t 379 new 0.21) lr 1.00e-05 gnorm 0.103 2.82s mem 81.1GB +step 4509/5000 loss 0.1749 (w 0.2609 mse 0.2684 t 940 new 0.25) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +step 4510/5000 loss 0.1905 (w 0.2889 mse 0.2929 t 931 new 0.24) lr 1.00e-05 gnorm 0.147 3.17s mem 81.1GB +step 4511/5000 loss 0.2035 (w 0.2633 mse 0.2759 t 942 new 0.16) lr 1.00e-05 gnorm 0.114 3.02s mem 81.1GB +step 4512/5000 loss 0.1168 (w 0.2159 mse 0.2328 t 808 new 0.22) lr 1.00e-05 gnorm 0.101 3.04s mem 81.1GB +step 4513/5000 loss 0.4000 (w 0.2642 mse 0.2726 t 938 new 0.13) lr 1.00e-05 gnorm 0.100 3.08s mem 81.1GB +step 4514/5000 loss 0.2490 (w 0.2887 mse 0.2897 t 928 new 0.22) lr 1.00e-05 gnorm 0.105 3.07s mem 81.1GB +step 4515/5000 loss 0.3871 (w 0.3729 mse 0.3674 t 963 new 0.20) lr 1.00e-05 gnorm 0.148 3.16s mem 81.1GB +step 4516/5000 loss 0.2331 (w 0.2228 mse 0.2457 t 995 new 0.14) lr 1.00e-05 gnorm 0.128 3.30s mem 81.1GB +step 4517/5000 loss 0.3055 (w 0.3055 mse 0.3321 t 986 new 0.19) lr 1.00e-05 gnorm 0.119 3.06s mem 81.1GB +step 4518/5000 loss 0.2966 (w 0.2966 mse 0.3230 t 984 new 0.22) lr 1.00e-05 gnorm 0.119 3.10s mem 81.1GB +step 4519/5000 loss 0.2525 (w 0.3594 mse 0.3463 t 995 new 0.23) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +step 4520/5000 loss 0.2505 (w 0.2329 mse 0.2554 t 952 new 0.13) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +step 4521/5000 loss 0.2571 (w 0.3055 mse 0.3008 t 970 new 0.22) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +step 4522/5000 loss 0.1570 (w 0.2998 mse 0.3048 t 995 new 0.23) lr 1.00e-05 gnorm 0.119 3.20s mem 81.1GB +step 4523/5000 loss 0.2747 (w 0.6317 mse 0.6284 t 153 new 0.15) lr 1.00e-05 gnorm 0.116 3.05s mem 81.1GB +step 4524/5000 loss 0.1532 (w 0.3840 mse 0.3820 t 994 new 0.16) lr 1.00e-05 gnorm 0.126 3.10s mem 81.1GB +step 4525/5000 loss 0.2553 (w 0.2998 mse 0.3240 t 977 new 0.20) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +step 4526/5000 loss 0.1440 (w 0.2854 mse 0.2985 t 980 new 0.24) lr 1.00e-05 gnorm 0.260 3.40s mem 81.1GB +step 4527/5000 loss 0.2580 (w 0.2936 mse 0.3085 t 980 new 0.19) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +step 4528/5000 loss 0.2952 (w 0.2703 mse 0.2711 t 689 new 0.12) lr 1.00e-05 gnorm 0.130 3.51s mem 81.1GB +step 4529/5000 loss 0.2949 (w 0.4088 mse 0.3969 t 954 new 0.25) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +step 4530/5000 loss 0.2236 (w 0.1505 mse 0.1709 t 914 new 0.14) lr 1.00e-05 gnorm 0.122 3.31s mem 81.1GB +step 4531/5000 loss 0.2264 (w 0.2144 mse 0.2303 t 988 new 0.18) lr 1.00e-05 gnorm 0.108 2.84s mem 81.1GB +step 4532/5000 loss 0.3739 (w 0.2648 mse 0.2736 t 936 new 0.19) lr 1.00e-05 gnorm 0.144 3.16s mem 81.1GB +step 4533/5000 loss 0.3278 (w 0.2903 mse 0.3021 t 774 new 0.19) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 4534/5000 loss 0.3255 (w 0.2190 mse 0.2360 t 962 new 0.25) lr 1.00e-05 gnorm 0.114 3.15s mem 81.1GB +step 4535/5000 loss 0.3677 (w 0.3759 mse 0.3823 t 943 new 0.21) lr 1.00e-05 gnorm 0.120 3.06s mem 81.1GB +step 4536/5000 loss 0.2953 (w 0.2544 mse 0.2925 t 356 new 0.25) lr 1.00e-05 gnorm 0.098 3.33s mem 81.1GB +step 4537/5000 loss 0.1658 (w 0.3643 mse 0.3743 t 996 new 0.10) lr 1.00e-05 gnorm 0.092 2.83s mem 81.1GB +step 4538/5000 loss 0.2448 (w 0.4182 mse 0.4188 t 310 new 0.25) lr 1.00e-05 gnorm 0.113 3.14s mem 81.1GB +step 4539/5000 loss 0.3070 (w 0.6804 mse 0.6530 t 988 new 0.28) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +step 4540/5000 loss 0.3023 (w 0.3114 mse 0.3070 t 903 new 0.22) lr 1.00e-05 gnorm 0.122 3.20s mem 81.1GB +step 4541/5000 loss 0.4554 (w 0.1840 mse 0.1969 t 839 new 0.19) lr 1.00e-05 gnorm 0.128 3.10s mem 81.1GB +step 4542/5000 loss 0.2701 (w 0.2186 mse 0.2414 t 741 new 0.16) lr 1.00e-05 gnorm 0.096 3.31s mem 81.1GB +step 4543/5000 loss 0.3725 (w 0.2364 mse 0.2352 t 722 new 0.06) lr 1.00e-05 gnorm 0.139 2.85s mem 81.1GB +step 4544/5000 loss 0.1837 (w 0.2704 mse 0.2930 t 948 new 0.19) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +step 4545/5000 loss 0.1534 (w 0.2625 mse 0.2695 t 918 new 0.23) lr 1.00e-05 gnorm 0.132 3.49s mem 81.1GB +step 4546/5000 loss 0.1830 (w 0.2660 mse 0.2709 t 926 new 0.13) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +step 4547/5000 loss 0.2486 (w 0.3416 mse 0.3455 t 916 new 0.19) lr 1.00e-05 gnorm 0.199 3.07s mem 81.1GB +step 4548/5000 loss 0.2688 (w 0.2730 mse 0.2759 t 976 new 0.25) lr 1.00e-05 gnorm 0.124 3.15s mem 81.1GB +step 4549/5000 loss 0.2410 (w 0.2352 mse 0.2463 t 943 new 0.21) lr 1.00e-05 gnorm 0.176 3.05s mem 81.1GB +step 4550/5000 loss 0.1231 (w 0.3543 mse 0.3492 t 937 new 0.19) lr 1.00e-05 gnorm 0.089 3.13s mem 81.1GB +step 4551/5000 loss 0.3923 (w 0.2187 mse 0.2352 t 612 new 0.22) lr 1.00e-05 gnorm 0.150 3.17s mem 81.1GB +step 4552/5000 loss 0.2392 (w 0.1705 mse 0.1809 t 651 new 0.13) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +step 4553/5000 loss 0.3478 (w 0.2343 mse 0.2391 t 905 new 0.11) lr 1.00e-05 gnorm 0.165 3.36s mem 81.1GB +step 4554/5000 loss 0.3550 (w 0.2591 mse 0.2609 t 768 new 0.23) lr 1.00e-05 gnorm 0.301 3.06s mem 81.1GB +step 4555/5000 loss 0.2084 (w 0.3750 mse 0.3808 t 966 new 0.20) lr 1.00e-05 gnorm 0.115 3.16s mem 81.1GB +step 4556/5000 loss 0.4145 (w 0.3098 mse 0.3103 t 969 new 0.24) lr 1.00e-05 gnorm 0.133 2.83s mem 81.1GB +step 4557/5000 loss 0.2653 (w 0.2776 mse 0.3127 t 171 new 0.16) lr 1.00e-05 gnorm 0.110 3.13s mem 81.1GB +step 4558/5000 loss 0.2389 (w 0.2803 mse 0.3025 t 386 new 0.21) lr 1.00e-05 gnorm 0.136 3.05s mem 81.1GB +step 4559/5000 loss 0.4346 (w 0.5562 mse 0.5543 t 189 new 0.17) lr 1.00e-05 gnorm 0.109 3.09s mem 81.1GB +step 4560/5000 loss 0.2001 (w 0.3939 mse 0.4034 t 992 new 0.21) lr 1.00e-05 gnorm 0.133 3.09s mem 81.1GB +step 4561/5000 loss 0.3475 (w 0.2583 mse 0.2586 t 720 new 0.12) lr 1.00e-05 gnorm 0.119 3.14s mem 81.1GB +step 4562/5000 loss 0.2964 (w 0.2220 mse 0.2376 t 860 new 0.19) lr 1.00e-05 gnorm 0.099 2.82s mem 81.1GB +step 4563/5000 loss 0.2786 (w 0.2117 mse 0.2239 t 826 new 0.13) lr 1.00e-05 gnorm 0.107 3.17s mem 81.1GB +step 4564/5000 loss 0.3929 (w 0.3394 mse 0.3451 t 804 new 0.26) lr 1.00e-05 gnorm 0.114 3.04s mem 81.1GB +step 4565/5000 loss 0.2367 (w 0.2229 mse 0.2419 t 836 new 0.22) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +step 4566/5000 loss 0.2122 (w 0.3408 mse 0.3486 t 962 new 0.19) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +step 4567/5000 loss 0.3849 (w 0.2859 mse 0.3005 t 747 new 0.19) lr 1.00e-05 gnorm 0.109 3.12s mem 81.1GB +step 4568/5000 loss 0.2683 (w 0.2445 mse 0.2514 t 977 new 0.18) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 4569/5000 loss 0.2642 (w 0.2710 mse 0.2756 t 923 new 0.23) lr 1.00e-05 gnorm 0.408 3.14s mem 81.1GB +step 4570/5000 loss 0.2914 (w 0.3195 mse 0.3217 t 921 new 0.16) lr 1.00e-05 gnorm 0.104 3.09s mem 81.1GB +step 4571/5000 loss 0.1174 (w 0.3373 mse 0.3406 t 995 new 0.23) lr 1.00e-05 gnorm 0.134 3.10s mem 81.1GB +step 4572/5000 loss 0.2409 (w 0.2194 mse 0.2288 t 903 new 0.25) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +step 4573/5000 loss 0.3136 (w 0.3081 mse 0.3163 t 889 new 0.21) lr 1.00e-05 gnorm 0.177 3.16s mem 81.1GB +step 4574/5000 loss 0.3387 (w 0.2879 mse 0.2877 t 875 new 0.19) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +step 4575/5000 loss 0.4602 (w 0.3200 mse 0.3230 t 634 new 0.19) lr 1.00e-05 gnorm 0.107 3.16s mem 81.1GB +step 4576/5000 loss 0.2848 (w 0.2061 mse 0.2273 t 729 new 0.21) lr 1.00e-05 gnorm 0.114 3.06s mem 81.1GB +step 4577/5000 loss 0.3993 (w 0.2576 mse 0.2682 t 750 new 0.23) lr 1.00e-05 gnorm 0.180 3.28s mem 81.1GB +step 4578/5000 loss 0.2434 (w 0.3121 mse 0.3142 t 924 new 0.22) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +step 4579/5000 loss 0.2307 (w 0.1713 mse 0.1823 t 431 new 0.09) lr 1.00e-05 gnorm 0.128 3.36s mem 81.1GB +step 4580/5000 loss 0.1555 (w 0.2971 mse 0.3049 t 911 new 0.13) lr 1.00e-05 gnorm 0.207 3.23s mem 81.1GB +step 4581/5000 loss 0.2063 (w 0.2892 mse 0.3015 t 951 new 0.09) lr 1.00e-05 gnorm 0.124 3.06s mem 81.1GB +step 4582/5000 loss 0.1997 (w 0.2084 mse 0.2320 t 907 new 0.24) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 4583/5000 loss 0.3778 (w 0.2688 mse 0.2740 t 825 new 0.23) lr 1.00e-05 gnorm 0.094 3.31s mem 81.1GB +step 4584/5000 loss 0.2304 (w 0.3176 mse 0.3243 t 953 new 0.22) lr 1.00e-05 gnorm 0.446 3.70s mem 81.1GB +step 4585/5000 loss 0.2063 (w 0.2475 mse 0.2549 t 804 new 0.19) lr 1.00e-05 gnorm 0.120 3.41s mem 81.1GB +step 4586/5000 loss 0.3158 (w 0.2405 mse 0.2412 t 726 new 0.20) lr 1.00e-05 gnorm 0.110 3.23s mem 81.1GB +step 4587/5000 loss 0.0982 (w 0.3780 mse 0.3777 t 1000 new 0.17) lr 1.00e-05 gnorm 0.185 3.04s mem 81.1GB +step 4588/5000 loss 0.2694 (w 0.2582 mse 0.2673 t 511 new 0.10) lr 1.00e-05 gnorm 0.108 2.84s mem 81.1GB +step 4589/5000 loss 0.3095 (w 0.3332 mse 0.3426 t 958 new 0.15) lr 1.00e-05 gnorm 0.114 3.14s mem 81.1GB +step 4590/5000 loss 0.2203 (w 0.3746 mse 0.3684 t 683 new 0.24) lr 1.00e-05 gnorm 0.297 2.84s mem 81.1GB +step 4591/5000 loss 0.2272 (w 0.2738 mse 0.2690 t 802 new 0.18) lr 1.00e-05 gnorm 0.143 3.39s mem 81.1GB +step 4592/5000 loss 0.2368 (w 0.2815 mse 0.2775 t 815 new 0.22) lr 1.00e-05 gnorm 0.114 3.23s mem 81.1GB +step 4593/5000 loss 0.4763 (w 0.2612 mse 0.2720 t 917 new 0.23) lr 1.00e-05 gnorm 0.145 3.28s mem 81.1GB +step 4594/5000 loss 0.3163 (w 0.3166 mse 0.3266 t 568 new 0.24) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +step 4595/5000 loss 0.4807 (w 0.2772 mse 0.2962 t 978 new 0.23) lr 1.00e-05 gnorm 0.119 3.16s mem 81.1GB +step 4596/5000 loss 0.3819 (w 0.3192 mse 0.3230 t 927 new 0.20) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +step 4597/5000 loss 0.1888 (w 0.2205 mse 0.2369 t 948 new 0.19) lr 1.00e-05 gnorm 0.377 3.42s mem 81.1GB +step 4598/5000 loss 0.4275 (w 0.4109 mse 0.4117 t 288 new 0.21) lr 1.00e-05 gnorm 0.112 2.85s mem 81.1GB +step 4599/5000 loss 0.3463 (w 0.2572 mse 0.2574 t 937 new 0.24) lr 1.00e-05 gnorm 0.131 3.31s mem 81.1GB +step 4600/5000 loss 0.3087 (w 0.3259 mse 0.3473 t 998 new 0.24) lr 1.00e-05 gnorm 0.106 3.12s mem 81.1GB +step 4601/5000 loss 0.4292 (w 0.3060 mse 0.3082 t 404 new 0.19) lr 1.00e-05 gnorm 0.121 2.84s mem 81.1GB +step 4602/5000 loss 0.3961 (w 0.3332 mse 0.3365 t 492 new 0.20) lr 1.00e-05 gnorm 0.094 3.05s mem 81.1GB +step 4603/5000 loss 0.1583 (w 0.2661 mse 0.2764 t 955 new 0.20) lr 1.00e-05 gnorm 0.109 3.14s mem 81.1GB +step 4604/5000 loss 0.1462 (w 0.2460 mse 0.2475 t 975 new 0.26) lr 1.00e-05 gnorm 0.083 3.16s mem 81.1GB +step 4605/5000 loss 0.3376 (w 0.3480 mse 0.3525 t 315 new 0.19) lr 1.00e-05 gnorm 0.104 3.09s mem 81.1GB +step 4606/5000 loss 0.2599 (w 0.2358 mse 0.2450 t 942 new 0.26) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +step 4607/5000 loss 0.1910 (w 0.2457 mse 0.2625 t 778 new 0.21) lr 1.00e-05 gnorm 0.260 2.83s mem 81.1GB +step 4608/5000 loss 0.2126 (w 0.1700 mse 0.1795 t 715 new 0.07) lr 1.00e-05 gnorm 0.097 3.09s mem 81.1GB +step 4609/5000 loss 0.1490 (w 0.2333 mse 0.2525 t 941 new 0.19) lr 1.00e-05 gnorm 0.138 3.14s mem 81.1GB +step 4610/5000 loss 0.2334 (w 0.2810 mse 0.2994 t 979 new 0.18) lr 1.00e-05 gnorm 0.192 3.17s mem 81.1GB +step 4611/5000 loss 0.3381 (w 0.3099 mse 0.3127 t 537 new 0.15) lr 1.00e-05 gnorm 0.109 3.07s mem 81.1GB +step 4612/5000 loss 0.2324 (w 0.2172 mse 0.2322 t 720 new 0.15) lr 1.00e-05 gnorm 0.113 3.09s mem 81.1GB +step 4613/5000 loss 0.2903 (w 0.3347 mse 0.3347 t 909 new 0.16) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +step 4614/5000 loss 0.2388 (w 0.2233 mse 0.2389 t 599 new 0.23) lr 1.00e-05 gnorm 0.112 3.12s mem 81.1GB +step 4615/5000 loss 0.2463 (w 0.2905 mse 0.2838 t 948 new 0.18) lr 1.00e-05 gnorm 0.122 3.12s mem 81.1GB +step 4616/5000 loss 0.2804 (w 0.3837 mse 0.4041 t 189 new 0.17) lr 1.00e-05 gnorm 0.112 3.30s mem 81.1GB +step 4617/5000 loss 0.2229 (w 0.3142 mse 0.3205 t 544 new 0.22) lr 1.00e-05 gnorm 0.569 3.08s mem 81.1GB +step 4618/5000 loss 0.3335 (w 0.2267 mse 0.2455 t 952 new 0.24) lr 1.00e-05 gnorm 0.107 3.51s mem 81.1GB +step 4619/5000 loss 0.3787 (w 0.2780 mse 0.2898 t 596 new 0.20) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 4620/5000 loss 0.2974 (w 0.2242 mse 0.2247 t 839 new 0.25) lr 1.00e-05 gnorm 0.235 3.05s mem 81.1GB +step 4621/5000 loss 0.3888 (w 0.2187 mse 0.2315 t 836 new 0.24) lr 1.00e-05 gnorm 0.193 3.15s mem 81.1GB +step 4622/5000 loss 0.2220 (w 0.3494 mse 0.3521 t 827 new 0.17) lr 1.00e-05 gnorm 0.131 3.38s mem 81.1GB +step 4623/5000 loss 0.4601 (w 0.3054 mse 0.2989 t 809 new 0.13) lr 1.00e-05 gnorm 0.127 3.07s mem 81.1GB +step 4624/5000 loss 0.3217 (w 0.3394 mse 0.3340 t 909 new 0.15) lr 1.00e-05 gnorm 0.154 3.16s mem 81.1GB +step 4625/5000 loss 0.1824 (w 0.2797 mse 0.2902 t 992 new 0.25) lr 1.00e-05 gnorm 0.091 2.83s mem 81.1GB +step 4626/5000 loss 0.3815 (w 0.1894 mse 0.1992 t 838 new 0.20) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +step 4627/5000 loss 0.3368 (w 0.3643 mse 0.3702 t 999 new 0.24) lr 1.00e-05 gnorm 0.123 3.12s mem 81.1GB +step 4628/5000 loss 0.3761 (w 0.3608 mse 0.3485 t 957 new 0.20) lr 1.00e-05 gnorm 0.230 3.20s mem 81.1GB +step 4629/5000 loss 0.3712 (w 0.2910 mse 0.2917 t 769 new 0.25) lr 1.00e-05 gnorm 0.119 3.07s mem 81.1GB +step 4630/5000 loss 0.2616 (w 0.3223 mse 0.3226 t 693 new 0.16) lr 1.00e-05 gnorm 0.143 3.43s mem 81.1GB +step 4631/5000 loss 0.2354 (w 0.2817 mse 0.2999 t 990 new 0.20) lr 1.00e-05 gnorm 0.155 3.14s mem 81.1GB +step 4632/5000 loss 0.2457 (w 0.3427 mse 0.3366 t 920 new 0.22) lr 1.00e-05 gnorm 0.198 2.84s mem 81.1GB +step 4633/5000 loss 0.2875 (w 0.3154 mse 0.3179 t 975 new 0.27) lr 1.00e-05 gnorm 0.114 3.17s mem 81.1GB +step 4634/5000 loss 0.4407 (w 0.1979 mse 0.2187 t 748 new 0.26) lr 1.00e-05 gnorm 0.193 3.28s mem 81.1GB +step 4635/5000 loss 0.1351 (w 0.2293 mse 0.2404 t 940 new 0.24) lr 1.00e-05 gnorm 0.101 2.84s mem 81.1GB +step 4636/5000 loss 0.2724 (w 0.2672 mse 0.2664 t 886 new 0.22) lr 1.00e-05 gnorm 0.231 3.11s mem 81.1GB +step 4637/5000 loss 0.3334 (w 0.3283 mse 0.3363 t 950 new 0.20) lr 1.00e-05 gnorm 0.151 3.06s mem 81.1GB +step 4638/5000 loss 0.1977 (w 0.1826 mse 0.1951 t 614 new 0.09) lr 1.00e-05 gnorm 0.098 2.84s mem 81.1GB +step 4639/5000 loss 0.2654 (w 0.3005 mse 0.3041 t 732 new 0.19) lr 1.00e-05 gnorm 0.107 3.10s mem 81.1GB +step 4640/5000 loss 0.2823 (w 0.3697 mse 0.3669 t 997 new 0.17) lr 1.00e-05 gnorm 0.148 3.33s mem 81.1GB +step 4641/5000 loss 0.3245 (w 0.3657 mse 0.3670 t 989 new 0.01) lr 1.00e-05 gnorm 0.148 2.83s mem 81.1GB +step 4642/5000 loss 0.2014 (w 0.3136 mse 0.3143 t 932 new 0.22) lr 1.00e-05 gnorm 0.188 3.10s mem 81.1GB +step 4643/5000 loss 0.0867 (w 0.2238 mse 0.2366 t 979 new 0.22) lr 1.00e-05 gnorm 0.227 3.11s mem 81.1GB +step 4644/5000 loss 0.2088 (w 0.2355 mse 0.2509 t 657 new 0.22) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +step 4645/5000 loss 0.2882 (w 0.2403 mse 0.2483 t 935 new 0.17) lr 1.00e-05 gnorm 0.104 3.14s mem 81.1GB +step 4646/5000 loss 0.3333 (w 0.3531 mse 0.3566 t 960 new 0.20) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 4647/5000 loss 0.3506 (w 0.2195 mse 0.2354 t 775 new 0.18) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +step 4648/5000 loss 0.2852 (w 0.3173 mse 0.3357 t 978 new 0.21) lr 1.00e-05 gnorm 0.156 3.10s mem 81.1GB +step 4649/5000 loss 0.3639 (w 0.3708 mse 0.3727 t 506 new 0.23) lr 1.00e-05 gnorm 0.105 3.15s mem 81.1GB +step 4650/5000 loss 0.3003 (w 0.3091 mse 0.3060 t 810 new 0.19) lr 1.00e-05 gnorm 0.166 2.83s mem 81.1GB +step 4651/5000 loss 0.2888 (w 0.2017 mse 0.2109 t 868 new 0.20) lr 1.00e-05 gnorm 0.201 3.41s mem 81.1GB +step 4652/5000 loss 0.2724 (w 0.1942 mse 0.2084 t 580 new 0.16) lr 1.00e-05 gnorm 0.114 3.02s mem 81.1GB +step 4653/5000 loss 0.5017 (w 0.3253 mse 0.3266 t 712 new 0.12) lr 1.00e-05 gnorm 0.270 3.08s mem 81.1GB +step 4654/5000 loss 0.2759 (w 0.4368 mse 0.4496 t 996 new 0.26) lr 1.00e-05 gnorm 0.108 3.09s mem 81.1GB +step 4655/5000 loss 0.1930 (w 0.3705 mse 0.3762 t 962 new 0.16) lr 1.00e-05 gnorm 0.094 3.05s mem 81.1GB +step 4656/5000 loss 0.2939 (w 0.3175 mse 0.3221 t 623 new 0.25) lr 1.00e-05 gnorm 0.149 2.82s mem 81.1GB +step 4657/5000 loss 0.2428 (w 0.1693 mse 0.2027 t 925 new 0.26) lr 1.00e-05 gnorm 0.113 3.32s mem 81.1GB +step 4658/5000 loss 0.3283 (w 0.2877 mse 0.2924 t 792 new 0.22) lr 1.00e-05 gnorm 0.108 3.04s mem 81.1GB +step 4659/5000 loss 0.2117 (w 0.2683 mse 0.2908 t 328 new 0.23) lr 1.00e-05 gnorm 0.131 3.09s mem 81.1GB +step 4660/5000 loss 0.4318 (w 0.6485 mse 0.6551 t 114 new 0.19) lr 1.00e-05 gnorm 0.254 3.03s mem 81.1GB +step 4661/5000 loss 0.3329 (w 0.2543 mse 0.2622 t 951 new 0.17) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +step 4662/5000 loss 0.1986 (w 0.4747 mse 0.4547 t 978 new 0.19) lr 1.00e-05 gnorm 0.174 3.13s mem 81.1GB +step 4663/5000 loss 0.3272 (w 0.2143 mse 0.2379 t 861 new 0.24) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +step 4664/5000 loss 0.2819 (w 0.3142 mse 0.3280 t 999 new 0.25) lr 1.00e-05 gnorm 0.165 3.02s mem 81.1GB +step 4665/5000 loss 0.2409 (w 0.3008 mse 0.3191 t 990 new 0.15) lr 1.00e-05 gnorm 0.111 3.14s mem 81.1GB +step 4666/5000 loss 0.1474 (w 0.1615 mse 0.1895 t 890 new 0.23) lr 1.00e-05 gnorm 0.132 3.10s mem 81.1GB +step 4667/5000 loss 0.2668 (w 0.3017 mse 0.3080 t 975 new 0.19) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +step 4668/5000 loss 0.2884 (w 0.3734 mse 0.3861 t 323 new 0.20) lr 1.00e-05 gnorm 0.130 3.16s mem 81.1GB +step 4669/5000 loss 0.2231 (w 0.3043 mse 0.2880 t 987 new 0.23) lr 1.00e-05 gnorm 0.111 3.05s mem 81.1GB +step 4670/5000 loss 0.1999 (w 0.1920 mse 0.1920 t 829 new 0.00) lr 1.00e-05 gnorm 0.115 3.05s mem 81.1GB +step 4671/5000 loss 0.3833 (w 0.2767 mse 0.2702 t 626 new 0.21) lr 1.00e-05 gnorm 0.290 3.28s mem 81.1GB +step 4672/5000 loss 0.3767 (w 0.3252 mse 0.3288 t 982 new 0.13) lr 1.00e-05 gnorm 0.134 3.07s mem 81.1GB +step 4673/5000 loss 0.1729 (w 0.2779 mse 0.2887 t 821 new 0.22) lr 1.00e-05 gnorm 0.155 2.83s mem 81.1GB +step 4674/5000 loss 0.4107 (w 0.2281 mse 0.2298 t 624 new 0.19) lr 1.00e-05 gnorm 0.146 3.61s mem 81.1GB +step 4675/5000 loss 0.3231 (w 0.4235 mse 0.4122 t 968 new 0.21) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +step 4676/5000 loss 0.2279 (w 0.3883 mse 0.3721 t 987 new 0.25) lr 1.00e-05 gnorm 1.013 3.09s mem 81.1GB +step 4677/5000 loss 0.1894 (w 0.3521 mse 0.3566 t 989 new 0.22) lr 1.00e-05 gnorm 0.124 3.36s mem 81.1GB +step 4678/5000 loss 0.2703 (w 0.2407 mse 0.2451 t 947 new 0.17) lr 1.00e-05 gnorm 0.241 3.12s mem 81.1GB +step 4679/5000 loss 0.2840 (w 0.1882 mse 0.2026 t 835 new 0.23) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +step 4680/5000 loss 0.2505 (w 0.2334 mse 0.2508 t 528 new 0.24) lr 1.00e-05 gnorm 0.108 3.48s mem 81.1GB +step 4681/5000 loss 0.2417 (w 0.1728 mse 0.1879 t 907 new 0.12) lr 1.00e-05 gnorm 0.119 3.06s mem 81.1GB +step 4682/5000 loss 0.4301 (w 0.3134 mse 0.3303 t 981 new 0.22) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +step 4683/5000 loss 0.4179 (w 0.2663 mse 0.2639 t 786 new 0.25) lr 1.00e-05 gnorm 0.085 3.10s mem 81.1GB +step 4684/5000 loss 0.1853 (w 0.3127 mse 0.3214 t 999 new 0.14) lr 1.00e-05 gnorm 0.129 3.16s mem 81.1GB +step 4685/5000 loss 0.1015 (w 0.2387 mse 0.2668 t 997 new 0.21) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +step 4686/5000 loss 0.3184 (w 0.1755 mse 0.1942 t 797 new 0.25) lr 1.00e-05 gnorm 0.155 3.43s mem 81.1GB +step 4687/5000 loss 0.2316 (w 0.2582 mse 0.2617 t 884 new 0.24) lr 1.00e-05 gnorm 0.101 3.05s mem 81.1GB +step 4688/5000 loss 0.1897 (w 0.2326 mse 0.2462 t 880 new 0.22) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 4689/5000 loss 0.2445 (w 0.2944 mse 0.3127 t 984 new 0.23) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +step 4690/5000 loss 0.3307 (w 0.3361 mse 0.3430 t 535 new 0.23) lr 1.00e-05 gnorm 0.622 3.06s mem 81.1GB +step 4691/5000 loss 0.3619 (w 0.3420 mse 0.3325 t 928 new 0.19) lr 1.00e-05 gnorm 0.119 3.13s mem 81.1GB +step 4692/5000 loss 0.2486 (w 0.2532 mse 0.2599 t 973 new 0.09) lr 1.00e-05 gnorm 0.120 3.38s mem 81.1GB +step 4693/5000 loss 0.2031 (w 0.2148 mse 0.2286 t 956 new 0.22) lr 1.00e-05 gnorm 0.122 3.12s mem 81.1GB +step 4694/5000 loss 0.5091 (w 0.2490 mse 0.2576 t 811 new 0.23) lr 1.00e-05 gnorm 0.166 3.09s mem 81.1GB +step 4695/5000 loss 0.3071 (w 0.3585 mse 0.3707 t 813 new 0.25) lr 1.00e-05 gnorm 0.136 3.08s mem 81.1GB +step 4696/5000 loss 0.3574 (w 0.2872 mse 0.2845 t 923 new 0.18) lr 1.00e-05 gnorm 0.167 3.09s mem 81.1GB +step 4697/5000 loss 0.3025 (w 0.2352 mse 0.2487 t 859 new 0.20) lr 1.00e-05 gnorm 0.114 3.13s mem 81.1GB +step 4698/5000 loss 0.1250 (w 0.2092 mse 0.2303 t 973 new 0.16) lr 1.00e-05 gnorm 0.104 3.12s mem 81.1GB +step 4699/5000 loss 0.2184 (w 0.3705 mse 0.3769 t 949 new 0.20) lr 1.00e-05 gnorm 0.107 3.13s mem 81.1GB +step 4700/5000 loss 0.2989 (w 0.2350 mse 0.2673 t 996 new 0.24) lr 1.00e-05 gnorm 0.120 3.23s mem 81.1GB +step 4701/5000 loss 0.2936 (w 0.3673 mse 0.3847 t 244 new 0.15) lr 1.00e-05 gnorm 0.135 3.05s mem 81.1GB +step 4702/5000 loss 0.3946 (w 0.3358 mse 0.3416 t 525 new 0.20) lr 1.00e-05 gnorm 0.137 2.83s mem 81.1GB +step 4703/5000 loss 0.1054 (w 0.2076 mse 0.2224 t 843 new 0.27) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 4704/5000 loss 0.3959 (w 0.4574 mse 0.4863 t 171 new 0.24) lr 1.00e-05 gnorm 0.108 3.40s mem 81.1GB +step 4705/5000 loss 0.3665 (w 0.3153 mse 0.3240 t 840 new 0.22) lr 1.00e-05 gnorm 0.134 3.13s mem 81.1GB +step 4706/5000 loss 0.3423 (w 0.2552 mse 0.2664 t 807 new 0.21) lr 1.00e-05 gnorm 0.113 3.30s mem 81.1GB +step 4707/5000 loss 0.3100 (w 0.3280 mse 0.3305 t 470 new 0.23) lr 1.00e-05 gnorm 0.100 3.05s mem 81.1GB +step 4708/5000 loss 0.1895 (w 0.2244 mse 0.2379 t 966 new 0.23) lr 1.00e-05 gnorm 0.278 2.84s mem 81.1GB +step 4709/5000 loss 0.4045 (w 0.3693 mse 0.3736 t 511 new 0.17) lr 1.00e-05 gnorm 0.190 3.13s mem 81.1GB +step 4710/5000 loss 0.2681 (w 0.3280 mse 0.3146 t 875 new 0.19) lr 1.00e-05 gnorm 0.116 3.12s mem 81.1GB +step 4711/5000 loss 0.3445 (w 0.2391 mse 0.2394 t 949 new 0.23) lr 1.00e-05 gnorm 0.105 3.32s mem 81.1GB +step 4712/5000 loss 0.2939 (w 0.2757 mse 0.2800 t 688 new 0.08) lr 1.00e-05 gnorm 0.112 3.06s mem 81.1GB +step 4713/5000 loss 0.2328 (w 0.2773 mse 0.2838 t 873 new 0.20) lr 1.00e-05 gnorm 0.195 3.07s mem 81.1GB +step 4714/5000 loss 0.1989 (w 0.2398 mse 0.2508 t 742 new 0.24) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 4715/5000 loss 0.3288 (w 0.2428 mse 0.2502 t 990 new 0.21) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +step 4716/5000 loss 0.2311 (w 0.2078 mse 0.2234 t 868 new 0.27) lr 1.00e-05 gnorm 0.126 3.12s mem 81.1GB +step 4717/5000 loss 0.2647 (w 0.2816 mse 0.2849 t 869 new 0.17) lr 1.00e-05 gnorm 0.125 3.35s mem 81.1GB +step 4718/5000 loss 0.2867 (w 0.4606 mse 0.4389 t 997 new 0.19) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 4719/5000 loss 0.3610 (w 0.2889 mse 0.2871 t 673 new 0.22) lr 1.00e-05 gnorm 0.121 3.14s mem 81.1GB +step 4720/5000 loss 0.3855 (w 0.1922 mse 0.2075 t 607 new 0.12) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +step 4721/5000 loss 0.3247 (w 0.3624 mse 0.3468 t 946 new 0.15) lr 1.00e-05 gnorm 0.110 3.30s mem 81.1GB +step 4722/5000 loss 0.2881 (w 0.3416 mse 0.3390 t 972 new 0.25) lr 1.00e-05 gnorm 0.155 3.32s mem 81.1GB +step 4723/5000 loss 0.2279 (w 0.2618 mse 0.2684 t 898 new 0.12) lr 1.00e-05 gnorm 0.173 3.13s mem 81.1GB +step 4724/5000 loss 0.3555 (w 0.1662 mse 0.1878 t 785 new 0.23) lr 1.00e-05 gnorm 0.239 3.08s mem 81.1GB +step 4725/5000 loss 0.2531 (w 0.2680 mse 0.2769 t 940 new 0.21) lr 1.00e-05 gnorm 0.143 3.13s mem 81.1GB +step 4726/5000 loss 0.2645 (w 0.2879 mse 0.3022 t 444 new 0.16) lr 1.00e-05 gnorm 0.202 3.09s mem 81.1GB +step 4727/5000 loss 0.2292 (w 0.1832 mse 0.2187 t 988 new 0.22) lr 1.00e-05 gnorm 0.160 3.03s mem 81.1GB +step 4728/5000 loss 0.2966 (w 0.2369 mse 0.2441 t 609 new 0.23) lr 1.00e-05 gnorm 0.192 3.32s mem 81.1GB +step 4729/5000 loss 0.2558 (w 0.2835 mse 0.2875 t 994 new 0.16) lr 1.00e-05 gnorm 0.303 3.10s mem 81.1GB +step 4730/5000 loss 0.4428 (w 0.3169 mse 0.3169 t 336 new 0.00) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +step 4731/5000 loss 0.3501 (w 0.2950 mse 0.3295 t 328 new 0.17) lr 1.00e-05 gnorm 0.124 3.07s mem 81.1GB +step 4732/5000 loss 0.1683 (w 0.2406 mse 0.2658 t 966 new 0.16) lr 1.00e-05 gnorm 0.522 3.11s mem 81.1GB +step 4733/5000 loss 0.2336 (w 0.4180 mse 0.3977 t 989 new 0.23) lr 1.00e-05 gnorm 0.097 3.04s mem 81.1GB +step 4734/5000 loss 0.1887 (w 0.2432 mse 0.2480 t 946 new 0.08) lr 1.00e-05 gnorm 0.123 3.33s mem 81.1GB +step 4735/5000 loss 0.2290 (w 0.2612 mse 0.2743 t 995 new 0.20) lr 1.00e-05 gnorm 0.235 3.38s mem 81.1GB +step 4736/5000 loss 0.3895 (w 0.3129 mse 0.3418 t 959 new 0.25) lr 1.00e-05 gnorm 0.110 2.83s mem 81.1GB +step 4737/5000 loss 0.2246 (w 0.3067 mse 0.3181 t 921 new 0.24) lr 1.00e-05 gnorm 0.113 3.14s mem 81.1GB +step 4738/5000 loss 0.2629 (w 0.2719 mse 0.2770 t 940 new 0.15) lr 1.00e-05 gnorm 0.095 3.29s mem 81.1GB +step 4739/5000 loss 0.2589 (w 0.3546 mse 0.3576 t 921 new 0.29) lr 1.00e-05 gnorm 0.136 3.06s mem 81.1GB +step 4740/5000 loss 0.2615 (w 0.2117 mse 0.2323 t 834 new 0.19) lr 1.00e-05 gnorm 0.119 3.35s mem 81.1GB +step 4741/5000 loss 0.1620 (w 0.3823 mse 0.3802 t 995 new 0.23) lr 1.00e-05 gnorm 0.140 3.32s mem 81.1GB +step 4742/5000 loss 0.2738 (w 0.3342 mse 0.3423 t 975 new 0.22) lr 1.00e-05 gnorm 0.513 2.82s mem 81.1GB +step 4743/5000 loss 0.2266 (w 0.4224 mse 0.4169 t 974 new 0.23) lr 1.00e-05 gnorm 0.117 3.14s mem 81.1GB +step 4744/5000 loss 0.2448 (w 0.3306 mse 0.3318 t 551 new 0.21) lr 1.00e-05 gnorm 0.207 3.13s mem 81.1GB +step 4745/5000 loss 0.2469 (w 0.2926 mse 0.2967 t 955 new 0.26) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +step 4746/5000 loss 0.2461 (w 0.2991 mse 0.3004 t 599 new 0.23) lr 1.00e-05 gnorm 0.145 3.06s mem 81.1GB +step 4747/5000 loss 0.2413 (w 0.2747 mse 0.2781 t 937 new 0.20) lr 1.00e-05 gnorm 0.148 3.11s mem 81.1GB +step 4748/5000 loss 0.4377 (w 0.5341 mse 0.5576 t 200 new 0.20) lr 1.00e-05 gnorm 0.149 3.04s mem 81.1GB +step 4749/5000 loss 0.3480 (w 0.2426 mse 0.2572 t 962 new 0.22) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +step 4750/5000 loss 0.2596 (w 0.1964 mse 0.2115 t 720 new 0.20) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 4751/5000 loss 0.3009 (w 0.2541 mse 0.2533 t 754 new 0.12) lr 1.00e-05 gnorm 0.212 3.11s mem 81.1GB +step 4752/5000 loss 0.3232 (w 0.2839 mse 0.2870 t 582 new 0.13) lr 1.00e-05 gnorm 0.153 3.28s mem 81.1GB +step 4753/5000 loss 0.4680 (w 0.3470 mse 0.3565 t 747 new 0.23) lr 1.00e-05 gnorm 0.138 3.30s mem 81.1GB +step 4754/5000 loss 0.2520 (w 0.2063 mse 0.2176 t 869 new 0.15) lr 1.00e-05 gnorm 0.264 3.07s mem 81.1GB +step 4755/5000 loss 0.1551 (w 0.3407 mse 0.3419 t 956 new 0.16) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +step 4756/5000 loss 0.3290 (w 0.2858 mse 0.2852 t 846 new 0.24) lr 1.00e-05 gnorm 0.133 3.15s mem 81.1GB +step 4757/5000 loss 0.2747 (w 0.2670 mse 0.2737 t 977 new 0.13) lr 1.00e-05 gnorm 0.119 3.22s mem 81.1GB +step 4758/5000 loss 0.3155 (w 0.2798 mse 0.2838 t 962 new 0.18) lr 1.00e-05 gnorm 0.124 3.28s mem 81.1GB +step 4759/5000 loss 0.2976 (w 0.2976 mse 0.3000 t 892 new 0.21) lr 1.00e-05 gnorm 0.113 3.08s mem 81.1GB +step 4760/5000 loss 0.2974 (w 0.3206 mse 0.3208 t 953 new 0.21) lr 1.00e-05 gnorm 0.149 3.06s mem 81.1GB +step 4761/5000 loss 0.3101 (w 0.1788 mse 0.1873 t 885 new 0.11) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +step 4762/5000 loss 0.1401 (w 0.2209 mse 0.2332 t 798 new 0.23) lr 1.00e-05 gnorm 0.103 2.83s mem 81.1GB +step 4763/5000 loss 0.3319 (w 0.3414 mse 0.3371 t 779 new 0.18) lr 1.00e-05 gnorm 0.154 3.27s mem 81.1GB +step 4764/5000 loss 0.1977 (w 0.3691 mse 0.3679 t 980 new 0.18) lr 1.00e-05 gnorm 0.171 3.06s mem 81.1GB +step 4765/5000 loss 0.3139 (w 0.1884 mse 0.2040 t 824 new 0.22) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +step 4766/5000 loss 0.3245 (w 0.2533 mse 0.2668 t 851 new 0.21) lr 1.00e-05 gnorm 0.095 3.12s mem 81.1GB +step 4767/5000 loss 0.2712 (w 0.2935 mse 0.3083 t 998 new 0.20) lr 1.00e-05 gnorm 0.121 3.13s mem 81.1GB +step 4768/5000 loss 0.2913 (w 0.1841 mse 0.2012 t 861 new 0.20) lr 1.00e-05 gnorm 0.098 2.84s mem 81.1GB +step 4769/5000 loss 0.3432 (w 0.2505 mse 0.2647 t 917 new 0.23) lr 1.00e-05 gnorm 0.168 3.08s mem 81.1GB +step 4770/5000 loss 0.1080 (w 0.2524 mse 0.2563 t 918 new 0.24) lr 1.00e-05 gnorm 0.092 3.10s mem 81.1GB +step 4771/5000 loss 0.2697 (w 0.2477 mse 0.2511 t 926 new 0.13) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +step 4772/5000 loss 0.4174 (w 0.2832 mse 0.2973 t 479 new 0.23) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +step 4773/5000 loss 0.3705 (w 0.2207 mse 0.2341 t 918 new 0.17) lr 1.00e-05 gnorm 0.099 3.13s mem 81.1GB +step 4774/5000 loss 0.2615 (w 0.3263 mse 0.3264 t 937 new 0.21) lr 1.00e-05 gnorm 0.382 3.01s mem 81.1GB +step 4775/5000 loss 0.4174 (w 0.2560 mse 0.2630 t 835 new 0.21) lr 1.00e-05 gnorm 0.119 3.28s mem 81.1GB +step 4776/5000 loss 0.4099 (w 0.2710 mse 0.2647 t 601 new 0.22) lr 1.00e-05 gnorm 0.168 3.33s mem 81.1GB +step 4777/5000 loss 0.1608 (w 0.3727 mse 0.3745 t 974 new 0.20) lr 1.00e-05 gnorm 0.168 3.07s mem 81.1GB +step 4778/5000 loss 0.2772 (w 0.2261 mse 0.2360 t 945 new 0.12) lr 1.00e-05 gnorm 0.123 2.83s mem 81.1GB +step 4779/5000 loss 0.1361 (w 0.3579 mse 0.3502 t 971 new 0.20) lr 1.00e-05 gnorm 0.096 3.09s mem 81.1GB +step 4780/5000 loss 0.3534 (w 0.2530 mse 0.2579 t 830 new 0.13) lr 1.00e-05 gnorm 0.155 3.04s mem 81.1GB +step 4781/5000 loss 0.2150 (w 0.1968 mse 0.2011 t 887 new 0.23) lr 1.00e-05 gnorm 0.086 3.07s mem 81.1GB +step 4782/5000 loss 0.2729 (w 0.2551 mse 0.2506 t 808 new 0.11) lr 1.00e-05 gnorm 0.164 3.31s mem 81.1GB +step 4783/5000 loss 0.2736 (w 0.2662 mse 0.2882 t 459 new 0.26) lr 1.00e-05 gnorm 0.175 3.09s mem 81.1GB +step 4784/5000 loss 0.3801 (w 0.4098 mse 0.4180 t 992 new 0.20) lr 1.00e-05 gnorm 0.164 2.82s mem 81.1GB +step 4785/5000 loss 0.4225 (w 0.2806 mse 0.2878 t 637 new 0.14) lr 1.00e-05 gnorm 0.175 3.13s mem 81.1GB +step 4786/5000 loss 0.4161 (w 0.2953 mse 0.3121 t 431 new 0.25) lr 1.00e-05 gnorm 0.120 3.01s mem 81.1GB +step 4787/5000 loss 0.2897 (w 0.2651 mse 0.2721 t 580 new 0.23) lr 1.00e-05 gnorm 0.125 3.32s mem 81.1GB +step 4788/5000 loss 0.2320 (w 0.2371 mse 0.2447 t 578 new 0.18) lr 1.00e-05 gnorm 0.237 3.10s mem 81.1GB +step 4789/5000 loss 0.1912 (w 0.3124 mse 0.3142 t 467 new 0.27) lr 1.00e-05 gnorm 0.133 3.08s mem 81.1GB +step 4790/5000 loss 0.4581 (w 0.1744 mse 0.1915 t 752 new 0.17) lr 1.00e-05 gnorm 0.122 3.11s mem 81.1GB +step 4791/5000 loss 0.3054 (w 0.2976 mse 0.3093 t 651 new 0.17) lr 1.00e-05 gnorm 0.242 2.84s mem 81.1GB +step 4792/5000 loss 0.3291 (w 0.2892 mse 0.2979 t 404 new 0.15) lr 1.00e-05 gnorm 0.110 3.33s mem 81.1GB +step 4793/5000 loss 0.2932 (w 0.1746 mse 0.1952 t 965 new 0.13) lr 1.00e-05 gnorm 0.107 3.26s mem 81.1GB +step 4794/5000 loss 0.2087 (w 0.2522 mse 0.2662 t 836 new 0.25) lr 1.00e-05 gnorm 0.112 3.31s mem 81.1GB +step 4795/5000 loss 0.2514 (w 0.5239 mse 0.5231 t 982 new 0.19) lr 1.00e-05 gnorm 0.116 3.13s mem 81.1GB +step 4796/5000 loss 0.2348 (w 0.2364 mse 0.2416 t 833 new 0.14) lr 1.00e-05 gnorm 0.118 3.13s mem 81.1GB +step 4797/5000 loss 0.1596 (w 0.2256 mse 0.2344 t 895 new 0.20) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +step 4798/5000 loss 0.2754 (w 0.2838 mse 0.2861 t 962 new 0.25) lr 1.00e-05 gnorm 0.147 3.37s mem 81.1GB +step 4799/5000 loss 0.2032 (w 0.3174 mse 0.3210 t 852 new 0.21) lr 1.00e-05 gnorm 0.090 3.30s mem 81.1GB +step 4800/5000 loss 0.2183 (w 0.3255 mse 0.3328 t 973 new 0.23) lr 1.00e-05 gnorm 0.115 3.38s mem 81.1GB +step 4801/5000 loss 0.2049 (w 0.2764 mse 0.2801 t 915 new 0.22) lr 1.00e-05 gnorm 0.165 2.83s mem 81.1GB +step 4802/5000 loss 0.3015 (w 0.3362 mse 0.3386 t 917 new 0.16) lr 1.00e-05 gnorm 0.218 3.14s mem 81.1GB +step 4803/5000 loss 0.2729 (w 0.3302 mse 0.3248 t 651 new 0.23) lr 1.00e-05 gnorm 0.115 3.03s mem 81.1GB +step 4804/5000 loss 0.2572 (w 0.2425 mse 0.2519 t 761 new 0.13) lr 1.00e-05 gnorm 0.126 3.07s mem 81.1GB +step 4805/5000 loss 0.2313 (w 0.2740 mse 0.2849 t 921 new 0.23) lr 1.00e-05 gnorm 0.095 3.09s mem 81.1GB +step 4806/5000 loss 0.1914 (w 0.3305 mse 0.3383 t 966 new 0.28) lr 1.00e-05 gnorm 0.089 3.34s mem 81.1GB +step 4807/5000 loss 0.1713 (w 0.2757 mse 0.2770 t 816 new 0.11) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +step 4808/5000 loss 0.3153 (w 0.4438 mse 0.4295 t 1000 new 0.23) lr 1.00e-05 gnorm 0.166 3.35s mem 81.1GB +step 4809/5000 loss 0.1386 (w 0.2868 mse 0.2767 t 946 new 0.21) lr 1.00e-05 gnorm 0.146 3.03s mem 81.1GB +step 4810/5000 loss 0.2342 (w 0.3534 mse 0.3489 t 997 new 0.16) lr 1.00e-05 gnorm 0.145 3.29s mem 81.1GB +step 4811/5000 loss 0.3330 (w 0.2515 mse 0.2634 t 697 new 0.24) lr 1.00e-05 gnorm 0.117 3.36s mem 81.1GB +step 4812/5000 loss 0.3765 (w 0.3784 mse 0.3785 t 375 new 0.07) lr 1.00e-05 gnorm 0.126 3.29s mem 81.1GB +step 4813/5000 loss 0.3469 (w 0.2659 mse 0.2795 t 774 new 0.24) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +step 4814/5000 loss 0.3564 (w 0.2778 mse 0.2818 t 805 new 0.24) lr 1.00e-05 gnorm 0.192 3.10s mem 81.1GB +step 4815/5000 loss 0.1502 (w 0.3860 mse 0.3905 t 984 new 0.19) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +step 4816/5000 loss 0.3110 (w 0.3088 mse 0.3211 t 858 new 0.19) lr 1.00e-05 gnorm 0.189 3.08s mem 81.1GB +step 4817/5000 loss 0.2551 (w 0.2953 mse 0.3079 t 980 new 0.17) lr 1.00e-05 gnorm 0.110 3.12s mem 81.1GB +step 4818/5000 loss 0.2409 (w 0.3284 mse 0.3206 t 941 new 0.21) lr 1.00e-05 gnorm 0.163 3.37s mem 81.1GB +step 4819/5000 loss 0.2593 (w 0.3784 mse 0.3895 t 988 new 0.18) lr 1.00e-05 gnorm 0.093 2.83s mem 81.1GB +step 4820/5000 loss 0.1743 (w 0.1942 mse 0.2140 t 823 new 0.24) lr 1.00e-05 gnorm 0.124 3.13s mem 81.1GB +step 4821/5000 loss 0.3398 (w 0.3239 mse 0.3476 t 511 new 0.17) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +step 4822/5000 loss 0.1835 (w 0.1954 mse 0.2171 t 938 new 0.28) lr 1.00e-05 gnorm 0.107 3.06s mem 81.1GB +step 4823/5000 loss 0.1632 (w 0.2923 mse 0.3012 t 849 new 0.20) lr 1.00e-05 gnorm 0.112 3.13s mem 81.1GB +step 4824/5000 loss 0.2813 (w 0.3245 mse 0.3183 t 835 new 0.21) lr 1.00e-05 gnorm 0.134 3.07s mem 81.1GB +step 4825/5000 loss 0.3616 (w 0.3134 mse 0.3065 t 621 new 0.16) lr 1.00e-05 gnorm 0.120 3.29s mem 81.1GB +step 4826/5000 loss 0.3910 (w 0.3624 mse 0.3651 t 414 new 0.21) lr 1.00e-05 gnorm 0.103 2.83s mem 81.1GB +step 4827/5000 loss 0.5312 (w 0.6389 mse 0.6533 t 134 new 0.25) lr 1.00e-05 gnorm 0.172 3.37s mem 81.1GB +step 4828/5000 loss 0.2571 (w 0.3488 mse 0.3431 t 909 new 0.16) lr 1.00e-05 gnorm 0.155 3.33s mem 81.1GB +step 4829/5000 loss 0.1875 (w 0.2852 mse 0.2937 t 976 new 0.17) lr 1.00e-05 gnorm 0.116 3.11s mem 81.1GB +step 4830/5000 loss 0.2790 (w 0.1926 mse 0.2150 t 731 new 0.18) lr 1.00e-05 gnorm 0.268 3.11s mem 81.1GB +step 4831/5000 loss 0.1724 (w 0.2658 mse 0.2659 t 890 new 0.20) lr 1.00e-05 gnorm 0.111 3.27s mem 81.1GB +step 4832/5000 loss 0.2878 (w 0.3422 mse 0.3501 t 961 new 0.23) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +step 4833/5000 loss 0.2128 (w 0.3580 mse 0.3540 t 956 new 0.27) lr 1.00e-05 gnorm 0.125 3.33s mem 81.1GB +step 4834/5000 loss 0.2343 (w 0.2397 mse 0.2601 t 424 new 0.24) lr 1.00e-05 gnorm 0.114 3.30s mem 81.1GB +step 4835/5000 loss 0.3511 (w 0.3742 mse 0.3851 t 476 new 0.16) lr 1.00e-05 gnorm 0.149 3.31s mem 81.1GB +step 4836/5000 loss 0.3531 (w 0.2645 mse 0.2764 t 610 new 0.20) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +step 4837/5000 loss 0.2838 (w 0.2919 mse 0.2933 t 874 new 0.25) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +step 4838/5000 loss 0.3753 (w 0.3052 mse 0.3078 t 907 new 0.20) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +step 4839/5000 loss 0.4305 (w 0.2603 mse 0.2750 t 681 new 0.17) lr 1.00e-05 gnorm 0.103 3.13s mem 81.1GB +step 4840/5000 loss 0.3106 (w 0.2412 mse 0.2579 t 942 new 0.11) lr 1.00e-05 gnorm 0.124 3.12s mem 81.1GB +step 4841/5000 loss 0.1881 (w 0.2371 mse 0.2468 t 945 new 0.24) lr 1.00e-05 gnorm 0.129 3.29s mem 81.1GB +step 4842/5000 loss 0.3779 (w 0.3596 mse 0.3581 t 786 new 0.19) lr 1.00e-05 gnorm 0.092 2.83s mem 81.1GB +step 4843/5000 loss 0.3820 (w 0.3493 mse 0.3512 t 610 new 0.21) lr 1.00e-05 gnorm 0.132 3.12s mem 81.1GB +step 4844/5000 loss 0.3402 (w 0.2043 mse 0.2224 t 700 new 0.23) lr 1.00e-05 gnorm 0.115 3.06s mem 81.1GB +step 4845/5000 loss 0.2197 (w 0.2300 mse 0.2449 t 983 new 0.24) lr 1.00e-05 gnorm 0.130 3.05s mem 81.1GB +step 4846/5000 loss 0.1879 (w 0.2592 mse 0.2604 t 712 new 0.17) lr 1.00e-05 gnorm 0.118 3.04s mem 81.1GB +step 4847/5000 loss 0.3378 (w 0.5787 mse 0.5928 t 146 new 0.24) lr 1.00e-05 gnorm 0.102 3.33s mem 81.1GB +step 4848/5000 loss 0.2168 (w 0.3147 mse 0.3147 t 980 new 0.23) lr 1.00e-05 gnorm 0.113 2.82s mem 81.1GB +step 4849/5000 loss 0.3577 (w 0.2175 mse 0.2359 t 845 new 0.23) lr 1.00e-05 gnorm 0.096 3.14s mem 81.1GB +step 4850/5000 loss 0.3321 (w 0.3730 mse 0.3771 t 421 new 0.24) lr 1.00e-05 gnorm 0.103 3.06s mem 81.1GB +step 4851/5000 loss 0.3525 (w 0.2880 mse 0.2847 t 694 new 0.13) lr 1.00e-05 gnorm 0.111 3.03s mem 81.1GB +step 4852/5000 loss 0.2552 (w 0.3160 mse 0.3212 t 955 new 0.20) lr 1.00e-05 gnorm 0.263 3.34s mem 81.1GB +step 4853/5000 loss 0.2025 (w 0.3959 mse 0.3842 t 895 new 0.25) lr 1.00e-05 gnorm 0.129 3.30s mem 81.1GB +step 4854/5000 loss 0.2649 (w 0.6077 mse 0.6113 t 140 new 0.15) lr 1.00e-05 gnorm 0.121 2.84s mem 81.1GB +step 4855/5000 loss 0.1297 (w 0.3048 mse 0.3046 t 851 new 0.24) lr 1.00e-05 gnorm 0.098 3.16s mem 81.1GB +step 4856/5000 loss 0.2637 (w 0.3392 mse 0.3325 t 892 new 0.22) lr 1.00e-05 gnorm 0.203 3.08s mem 81.1GB +step 4857/5000 loss 0.1913 (w 0.3675 mse 0.3728 t 957 new 0.13) lr 1.00e-05 gnorm 0.106 3.06s mem 81.1GB +step 4858/5000 loss 0.2355 (w 0.2684 mse 0.2801 t 988 new 0.11) lr 1.00e-05 gnorm 0.086 3.09s mem 81.1GB +step 4859/5000 loss 0.3012 (w 0.3338 mse 0.3653 t 991 new 0.26) lr 1.00e-05 gnorm 0.140 3.32s mem 81.1GB +step 4860/5000 loss 0.3108 (w 0.3507 mse 0.3524 t 955 new 0.19) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +step 4861/5000 loss 0.4112 (w 0.3148 mse 0.3261 t 695 new 0.14) lr 1.00e-05 gnorm 0.124 3.15s mem 81.1GB +step 4862/5000 loss 0.1762 (w 0.2432 mse 0.2633 t 777 new 0.22) lr 1.00e-05 gnorm 0.104 3.24s mem 81.1GB +step 4863/5000 loss 0.2842 (w 0.2551 mse 0.2706 t 840 new 0.18) lr 1.00e-05 gnorm 0.114 3.06s mem 81.1GB +step 4864/5000 loss 0.2523 (w 0.5148 mse 0.5008 t 994 new 0.24) lr 1.00e-05 gnorm 0.127 3.12s mem 81.1GB +step 4865/5000 loss 0.1920 (w 0.2683 mse 0.2836 t 992 new 0.22) lr 1.00e-05 gnorm 0.102 3.09s mem 81.1GB +step 4866/5000 loss 0.3076 (w 0.4110 mse 0.4317 t 292 new 0.24) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +step 4867/5000 loss 0.1538 (w 0.3885 mse 0.3971 t 989 new 0.30) lr 1.00e-05 gnorm 0.098 3.19s mem 81.1GB +step 4868/5000 loss 0.2548 (w 0.3484 mse 0.3566 t 976 new 0.19) lr 1.00e-05 gnorm 0.160 3.32s mem 81.1GB +step 4869/5000 loss 0.1910 (w 0.4630 mse 0.4407 t 996 new 0.23) lr 1.00e-05 gnorm 0.102 3.11s mem 81.1GB +step 4870/5000 loss 0.3329 (w 0.3291 mse 0.3320 t 871 new 0.20) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +step 4871/5000 loss 0.2315 (w 0.2104 mse 0.2302 t 976 new 0.18) lr 1.00e-05 gnorm 0.135 3.10s mem 81.1GB +step 4872/5000 loss 0.0897 (w 0.2113 mse 0.2143 t 878 new 0.22) lr 1.00e-05 gnorm 0.170 3.13s mem 81.1GB +step 4873/5000 loss 0.1909 (w 0.3742 mse 0.3777 t 965 new 0.21) lr 1.00e-05 gnorm 0.124 3.12s mem 81.1GB +step 4874/5000 loss 0.1745 (w 0.2371 mse 0.2508 t 857 new 0.20) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +step 4875/5000 loss 0.2197 (w 0.2161 mse 0.2271 t 997 new 0.23) lr 1.00e-05 gnorm 0.163 3.34s mem 81.1GB +step 4876/5000 loss 0.2618 (w 0.2387 mse 0.2455 t 907 new 0.25) lr 1.00e-05 gnorm 0.138 3.28s mem 81.1GB +step 4877/5000 loss 0.1676 (w 0.2055 mse 0.2323 t 936 new 0.24) lr 1.00e-05 gnorm 0.098 3.13s mem 81.1GB +step 4878/5000 loss 0.3591 (w 0.2627 mse 0.2812 t 986 new 0.22) lr 1.00e-05 gnorm 0.237 3.10s mem 81.1GB +step 4879/5000 loss 0.2244 (w 0.3776 mse 0.3664 t 843 new 0.26) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +step 4880/5000 loss 0.2257 (w 0.3913 mse 0.3893 t 985 new 0.20) lr 1.00e-05 gnorm 0.116 3.10s mem 81.1GB +step 4881/5000 loss 0.4803 (w 0.3210 mse 0.3263 t 885 new 0.25) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +step 4882/5000 loss 0.2580 (w 0.2961 mse 0.3017 t 876 new 0.24) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +step 4883/5000 loss 0.2397 (w 0.2604 mse 0.2698 t 928 new 0.25) lr 1.00e-05 gnorm 0.117 3.12s mem 81.1GB +step 4884/5000 loss 0.3778 (w 0.3887 mse 0.3892 t 963 new 0.16) lr 1.00e-05 gnorm 0.138 3.13s mem 81.1GB +step 4885/5000 loss 0.3791 (w 0.6231 mse 0.6293 t 146 new 0.22) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +step 4886/5000 loss 0.2668 (w 0.3041 mse 0.3041 t 868 new 0.22) lr 1.00e-05 gnorm 0.102 3.22s mem 81.1GB +step 4887/5000 loss 0.3522 (w 0.1686 mse 0.1814 t 906 new 0.24) lr 1.00e-05 gnorm 0.125 3.35s mem 81.1GB +step 4888/5000 loss 0.2056 (w 0.2804 mse 0.2926 t 817 new 0.17) lr 1.00e-05 gnorm 0.119 3.29s mem 81.1GB +step 4889/5000 loss 0.4097 (w 0.2776 mse 0.2806 t 749 new 0.24) lr 1.00e-05 gnorm 0.181 2.83s mem 81.1GB +step 4890/5000 loss 0.3269 (w 0.2348 mse 0.2515 t 950 new 0.15) lr 1.00e-05 gnorm 0.145 3.32s mem 81.1GB +step 4891/5000 loss 0.2047 (w 0.4587 mse 0.4723 t 979 new 0.19) lr 1.00e-05 gnorm 0.119 3.13s mem 81.1GB +step 4892/5000 loss 0.3757 (w 0.2537 mse 0.2614 t 592 new 0.18) lr 1.00e-05 gnorm 0.420 3.27s mem 81.1GB +step 4893/5000 loss 0.4246 (w 0.2477 mse 0.2620 t 939 new 0.20) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 4894/5000 loss 0.2719 (w 0.3296 mse 0.3352 t 990 new 0.26) lr 1.00e-05 gnorm 0.106 3.34s mem 81.1GB +step 4895/5000 loss 0.2725 (w 0.3225 mse 0.3296 t 479 new 0.19) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +step 4896/5000 loss 0.2524 (w 0.4144 mse 0.4428 t 238 new 0.22) lr 1.00e-05 gnorm 0.108 3.15s mem 81.1GB +step 4897/5000 loss 0.3871 (w 0.2391 mse 0.2367 t 740 new 0.25) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +step 4898/5000 loss 0.2252 (w 0.3068 mse 0.3067 t 976 new 0.22) lr 1.00e-05 gnorm 0.252 3.06s mem 81.1GB +step 4899/5000 loss 0.2625 (w 0.2974 mse 0.3015 t 865 new 0.25) lr 1.00e-05 gnorm 0.158 3.03s mem 81.1GB +step 4900/5000 loss 0.4087 (w 0.5635 mse 0.5838 t 165 new 0.18) lr 1.00e-05 gnorm 0.146 3.06s mem 81.1GB +step 4901/5000 loss 0.2287 (w 0.2562 mse 0.2598 t 705 new 0.26) lr 1.00e-05 gnorm 0.192 2.83s mem 81.1GB +step 4902/5000 loss 0.2981 (w 0.2867 mse 0.2842 t 668 new 0.11) lr 1.00e-05 gnorm 0.133 3.11s mem 81.1GB +step 4903/5000 loss 0.3465 (w 0.3006 mse 0.3007 t 787 new 0.21) lr 1.00e-05 gnorm 0.108 3.10s mem 81.1GB +step 4904/5000 loss 0.2369 (w 0.3061 mse 0.3107 t 904 new 0.19) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +step 4905/5000 loss 0.3863 (w 0.2450 mse 0.2624 t 881 new 0.19) lr 1.00e-05 gnorm 0.218 3.05s mem 81.1GB +step 4906/5000 loss 0.4015 (w 0.3186 mse 0.3234 t 500 new 0.24) lr 1.00e-05 gnorm 0.429 3.04s mem 81.1GB +step 4907/5000 loss 0.3358 (w 0.1953 mse 0.1973 t 988 new 0.09) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 4908/5000 loss 0.3104 (w 0.3281 mse 0.3158 t 988 new 0.23) lr 1.00e-05 gnorm 0.131 3.18s mem 81.1GB +step 4909/5000 loss 0.5462 (w 0.2838 mse 0.2896 t 621 new 0.12) lr 1.00e-05 gnorm 0.139 3.24s mem 81.1GB +step 4910/5000 loss 0.2553 (w 0.3719 mse 0.3673 t 965 new 0.25) lr 1.00e-05 gnorm 0.086 3.05s mem 81.1GB +step 4911/5000 loss 0.2194 (w 0.3956 mse 0.3869 t 979 new 0.29) lr 1.00e-05 gnorm 0.090 3.07s mem 81.1GB +step 4912/5000 loss 0.2552 (w 0.2209 mse 0.2438 t 999 new 0.20) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +step 4913/5000 loss 0.1929 (w 0.2327 mse 0.2432 t 803 new 0.17) lr 1.00e-05 gnorm 0.128 3.14s mem 81.1GB +step 4914/5000 loss 0.1693 (w 0.2844 mse 0.3078 t 972 new 0.23) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +step 4915/5000 loss 0.3490 (w 0.2909 mse 0.2935 t 605 new 0.18) lr 1.00e-05 gnorm 0.167 3.09s mem 81.1GB +step 4916/5000 loss 0.2295 (w 0.1820 mse 0.1965 t 769 new 0.15) lr 1.00e-05 gnorm 0.126 3.09s mem 81.1GB +step 4917/5000 loss 0.3560 (w 0.3215 mse 0.3415 t 301 new 0.26) lr 1.00e-05 gnorm 0.119 3.27s mem 81.1GB +step 4918/5000 loss 0.3913 (w 0.3255 mse 0.3282 t 450 new 0.16) lr 1.00e-05 gnorm 0.147 3.14s mem 81.1GB +step 4919/5000 loss 0.2976 (w 0.2751 mse 0.2854 t 920 new 0.16) lr 1.00e-05 gnorm 0.143 3.12s mem 81.1GB +step 4920/5000 loss 0.2242 (w 0.3695 mse 0.3761 t 983 new 0.25) lr 1.00e-05 gnorm 0.163 2.83s mem 81.1GB +step 4921/5000 loss 0.3621 (w 0.3106 mse 0.3182 t 987 new 0.25) lr 1.00e-05 gnorm 0.188 3.33s mem 81.1GB +step 4922/5000 loss 0.2558 (w 0.2099 mse 0.2395 t 982 new 0.20) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +step 4923/5000 loss 0.2870 (w 0.2799 mse 0.2824 t 560 new 0.13) lr 1.00e-05 gnorm 0.109 3.36s mem 81.1GB +step 4924/5000 loss 0.2140 (w 0.2756 mse 0.2779 t 976 new 0.21) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +step 4925/5000 loss 0.4082 (w 0.2964 mse 0.2964 t 957 new 0.18) lr 1.00e-05 gnorm 0.152 3.11s mem 81.1GB +step 4926/5000 loss 0.2687 (w 0.2061 mse 0.2214 t 914 new 0.14) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +step 4927/5000 loss 0.2386 (w 0.2370 mse 0.2485 t 969 new 0.17) lr 1.00e-05 gnorm 0.112 3.37s mem 81.1GB +step 4928/5000 loss 0.2521 (w 0.3596 mse 0.3631 t 980 new 0.09) lr 1.00e-05 gnorm 0.138 3.05s mem 81.1GB +step 4929/5000 loss 0.2747 (w 0.3352 mse 0.3531 t 965 new 0.21) lr 1.00e-05 gnorm 0.146 3.33s mem 81.1GB +step 4930/5000 loss 0.2631 (w 0.2137 mse 0.2217 t 818 new 0.18) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +step 4931/5000 loss 0.1856 (w 0.2866 mse 0.2974 t 977 new 0.26) lr 1.00e-05 gnorm 0.116 3.15s mem 81.1GB +step 4932/5000 loss 0.1673 (w 0.4512 mse 0.4347 t 962 new 0.24) lr 1.00e-05 gnorm 0.098 3.06s mem 81.1GB +step 4933/5000 loss 0.3205 (w 0.3368 mse 0.3289 t 929 new 0.22) lr 1.00e-05 gnorm 0.115 3.13s mem 81.1GB +step 4934/5000 loss 0.2684 (w 0.3646 mse 0.3648 t 950 new 0.26) lr 1.00e-05 gnorm 0.124 3.03s mem 81.1GB +step 4935/5000 loss 0.2761 (w 0.6250 mse 0.6437 t 177 new 0.20) lr 1.00e-05 gnorm 0.188 3.08s mem 81.1GB +step 4936/5000 loss 0.2279 (w 0.2788 mse 0.2781 t 831 new 0.20) lr 1.00e-05 gnorm 0.118 2.83s mem 81.1GB +step 4937/5000 loss 0.2302 (w 0.1787 mse 0.1849 t 797 new 0.22) lr 1.00e-05 gnorm 0.090 3.28s mem 81.1GB +step 4938/5000 loss 0.2330 (w 0.2836 mse 0.2914 t 995 new 0.19) lr 1.00e-05 gnorm 0.147 3.09s mem 81.1GB +step 4939/5000 loss 0.2556 (w 0.2806 mse 0.2935 t 624 new 0.22) lr 1.00e-05 gnorm 0.128 3.06s mem 81.1GB +step 4940/5000 loss 0.2139 (w 0.3240 mse 0.3253 t 964 new 0.15) lr 1.00e-05 gnorm 0.163 3.09s mem 81.1GB +step 4941/5000 loss 0.3153 (w 0.3367 mse 0.3356 t 910 new 0.22) lr 1.00e-05 gnorm 0.182 3.06s mem 81.1GB +step 4942/5000 loss 0.2109 (w 0.2705 mse 0.2827 t 961 new 0.22) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +step 4943/5000 loss 0.4026 (w 0.2938 mse 0.3121 t 826 new 0.18) lr 1.00e-05 gnorm 0.208 3.28s mem 81.1GB +step 4944/5000 loss 0.2849 (w 0.3071 mse 0.3203 t 945 new 0.19) lr 1.00e-05 gnorm 0.201 3.33s mem 81.1GB +step 4945/5000 loss 0.2218 (w 0.2771 mse 0.2786 t 800 new 0.17) lr 1.00e-05 gnorm 0.397 3.29s mem 81.1GB +step 4946/5000 loss 0.1909 (w 0.2715 mse 0.2707 t 829 new 0.18) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +step 4947/5000 loss 0.2706 (w 0.3497 mse 0.3497 t 479 new 0.20) lr 1.00e-05 gnorm 0.094 3.14s mem 81.1GB +step 4948/5000 loss 0.3599 (w 0.2483 mse 0.2662 t 992 new 0.10) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +step 4949/5000 loss 0.3452 (w 0.2209 mse 0.2342 t 870 new 0.22) lr 1.00e-05 gnorm 0.121 3.29s mem 81.1GB +step 4950/5000 loss 0.4048 (w 0.2441 mse 0.2479 t 809 new 0.21) lr 1.00e-05 gnorm 0.142 3.30s mem 81.1GB +step 4951/5000 loss 0.1322 (w 0.3109 mse 0.3341 t 994 new 0.19) lr 1.00e-05 gnorm 0.089 3.30s mem 81.1GB +step 4952/5000 loss 0.1770 (w 0.2594 mse 0.2735 t 854 new 0.20) lr 1.00e-05 gnorm 0.101 3.18s mem 81.1GB +step 4953/5000 loss 0.3397 (w 0.3740 mse 0.3733 t 998 new 0.26) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +step 4954/5000 loss 0.2834 (w 0.2557 mse 0.2709 t 932 new 0.20) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +step 4955/5000 loss 0.3177 (w 0.3979 mse 0.4055 t 997 new 0.16) lr 1.00e-05 gnorm 0.208 3.10s mem 81.1GB +step 4956/5000 loss 0.1440 (w 0.2764 mse 0.2890 t 533 new 0.26) lr 1.00e-05 gnorm 0.105 3.16s mem 81.1GB +step 4957/5000 loss 0.2942 (w 0.2500 mse 0.2602 t 832 new 0.23) lr 1.00e-05 gnorm 0.092 3.08s mem 81.1GB +step 4958/5000 loss 0.3938 (w 0.2855 mse 0.3037 t 948 new 0.25) lr 1.00e-05 gnorm 0.165 3.18s mem 81.1GB +step 4959/5000 loss 0.3148 (w 0.3449 mse 0.3536 t 440 new 0.29) lr 1.00e-05 gnorm 0.108 2.84s mem 81.1GB +step 4960/5000 loss 0.3136 (w 0.3880 mse 0.3763 t 947 new 0.13) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +step 4961/5000 loss 0.2181 (w 0.2238 mse 0.2310 t 836 new 0.22) lr 1.00e-05 gnorm 0.117 3.31s mem 81.1GB +step 4962/5000 loss 0.2689 (w 0.2378 mse 0.2484 t 802 new 0.19) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +step 4963/5000 loss 0.2149 (w 0.1920 mse 0.2009 t 938 new 0.11) lr 1.00e-05 gnorm 0.291 3.07s mem 81.1GB +step 4964/5000 loss 0.3782 (w 0.3118 mse 0.3131 t 764 new 0.25) lr 1.00e-05 gnorm 0.218 3.45s mem 81.1GB +step 4965/5000 loss 0.2677 (w 0.1614 mse 0.1872 t 867 new 0.23) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +step 4966/5000 loss 0.3154 (w 0.2581 mse 0.2673 t 644 new 0.21) lr 1.00e-05 gnorm 0.107 2.83s mem 81.1GB +step 4967/5000 loss 0.3281 (w 0.3204 mse 0.3224 t 885 new 0.20) lr 1.00e-05 gnorm 0.125 3.05s mem 81.1GB +step 4968/5000 loss 0.3141 (w 0.2970 mse 0.2931 t 832 new 0.17) lr 1.00e-05 gnorm 0.128 3.26s mem 81.1GB +step 4969/5000 loss 0.1952 (w 0.2758 mse 0.2994 t 984 new 0.12) lr 1.00e-05 gnorm 0.124 3.09s mem 81.1GB +step 4970/5000 loss 0.3692 (w 0.2921 mse 0.2903 t 898 new 0.15) lr 1.00e-05 gnorm 0.139 3.55s mem 81.1GB +step 4971/5000 loss 0.3731 (w 0.2562 mse 0.2621 t 546 new 0.14) lr 1.00e-05 gnorm 0.090 2.84s mem 81.1GB +step 4972/5000 loss 0.3687 (w 0.2021 mse 0.2175 t 794 new 0.25) lr 1.00e-05 gnorm 0.185 3.29s mem 81.1GB +step 4973/5000 loss 0.2635 (w 0.4680 mse 0.4627 t 444 new 0.20) lr 1.00e-05 gnorm 0.129 3.13s mem 81.1GB +step 4974/5000 loss 0.2691 (w 0.2772 mse 0.2793 t 843 new 0.17) lr 1.00e-05 gnorm 0.111 3.27s mem 81.1GB +step 4975/5000 loss 0.2542 (w 0.3533 mse 0.3601 t 375 new 0.09) lr 1.00e-05 gnorm 0.109 3.11s mem 81.1GB +step 4976/5000 loss 0.3019 (w 0.3174 mse 0.3266 t 553 new 0.23) lr 1.00e-05 gnorm 0.177 3.41s mem 81.1GB +step 4977/5000 loss 0.3511 (w 0.2416 mse 0.2508 t 960 new 0.14) lr 1.00e-05 gnorm 0.252 2.84s mem 81.1GB +step 4978/5000 loss 0.3719 (w 0.3797 mse 0.3859 t 586 new 0.21) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +step 4979/5000 loss 0.3563 (w 0.1738 mse 0.1998 t 837 new 0.21) lr 1.00e-05 gnorm 0.118 3.25s mem 81.1GB +step 4980/5000 loss 0.2741 (w 0.2375 mse 0.2479 t 940 new 0.12) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +step 4981/5000 loss 0.2189 (w 0.2352 mse 0.2448 t 890 new 0.20) lr 1.00e-05 gnorm 0.123 3.11s mem 81.1GB +step 4982/5000 loss 0.3340 (w 0.1911 mse 0.1955 t 852 new 0.20) lr 1.00e-05 gnorm 0.194 3.13s mem 81.1GB +step 4983/5000 loss 0.3438 (w 0.2715 mse 0.2661 t 800 new 0.24) lr 1.00e-05 gnorm 0.195 2.83s mem 81.1GB +step 4984/5000 loss 0.1857 (w 0.3479 mse 0.3342 t 914 new 0.19) lr 1.00e-05 gnorm 0.132 3.07s mem 81.1GB +step 4985/5000 loss 0.2772 (w 0.3030 mse 0.3066 t 975 new 0.20) lr 1.00e-05 gnorm 0.106 3.29s mem 81.1GB +step 4986/5000 loss 0.2588 (w 0.2907 mse 0.2969 t 786 new 0.17) lr 1.00e-05 gnorm 0.116 3.26s mem 81.1GB +step 4987/5000 loss 0.2471 (w 0.2771 mse 0.2865 t 954 new 0.20) lr 1.00e-05 gnorm 0.116 3.10s mem 81.1GB +step 4988/5000 loss 0.1859 (w 0.3975 mse 0.3915 t 992 new 0.10) lr 1.00e-05 gnorm 0.079 3.04s mem 81.1GB +step 4989/5000 loss 0.1386 (w 0.3024 mse 0.3050 t 919 new 0.22) lr 1.00e-05 gnorm 0.165 2.83s mem 81.1GB +step 4990/5000 loss 0.3318 (w 0.2247 mse 0.2375 t 609 new 0.21) lr 1.00e-05 gnorm 0.129 3.11s mem 81.1GB +step 4991/5000 loss 0.2015 (w 0.2969 mse 0.2949 t 940 new 0.18) lr 1.00e-05 gnorm 0.134 3.02s mem 81.1GB +step 4992/5000 loss 0.2889 (w 0.3151 mse 0.3174 t 987 new 0.25) lr 1.00e-05 gnorm 0.094 3.12s mem 81.1GB +step 4993/5000 loss 0.2205 (w 0.3349 mse 0.3260 t 891 new 0.27) lr 1.00e-05 gnorm 0.107 3.08s mem 81.1GB +step 4994/5000 loss 0.2345 (w 0.3291 mse 0.3319 t 978 new 0.20) lr 1.00e-05 gnorm 0.091 3.13s mem 81.1GB +step 4995/5000 loss 0.3143 (w 0.2347 mse 0.2346 t 909 new 0.14) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +step 4996/5000 loss 0.1918 (w 0.2496 mse 0.2666 t 993 new 0.22) lr 1.00e-05 gnorm 0.098 3.31s mem 81.1GB +step 4997/5000 loss 0.2010 (w 0.2496 mse 0.2519 t 960 new 0.12) lr 1.00e-05 gnorm 0.092 3.07s mem 81.1GB +step 4998/5000 loss 0.2845 (w 0.3949 mse 0.3803 t 985 new 0.21) lr 1.00e-05 gnorm 0.092 3.10s mem 81.1GB +step 4999/5000 loss 0.1935 (w 0.2335 mse 0.2437 t 920 new 0.21) lr 1.00e-05 gnorm 0.130 3.38s mem 81.1GB +step 5000/5000 loss 0.1800 (w 0.1601 mse 0.1703 t 781 new 0.15) lr 1.00e-05 gnorm 0.104 3.12s mem 81.1GB +[val] step 5000 t=200: w=0.4515 mse=0.4696 (n=16) t=500: w=0.2739 mse=0.2886 (n=16) t=800: w=0.2298 mse=0.2415 (n=16) | mean w=0.3184 mse=0.3332 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step5000.safetensors 4093 个张量 37.98 GB +[done] step 5000 diff --git a/backup_2026-09-14/runs/ltx__arope_5k/progress.json b/backup_2026-09-14/runs/ltx__arope_5k/progress.json new file mode 100644 index 0000000000000000000000000000000000000000..ca0b9b11d62fa9f95567189b1d5786a56293d2a8 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k/progress.json @@ -0,0 +1 @@ +{"step": 5000, "wall": 1789208076.082995, "time": "2026-09-12 10:14:36"} \ No newline at end of file diff --git a/backup_2026-09-14/runs/ltx__arope_5k/train.log b/backup_2026-09-14/runs/ltx__arope_5k/train.log new file mode 100644 index 0000000000000000000000000000000000000000..05ba52b26abdd12e73779614eaf0205fd1da0900 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k/train.log @@ -0,0 +1,5027 @@ +[2026-09-12 05:46:33] [env] world=8 distributed=DistributedType.DEEPSPEED mixed_precision=bf16 device=cuda:0 +[2026-09-12 05:47:09] [arope] 装 arope_mask_embed:Linear(1, 4096),零初始化 +[2026-09-12 05:47:09] [arope] patchify_proj 挂了 forward hook(+ arope_mask_embed(mask)) +[2026-09-12 05:47:09] [model] DiT 加载 27s,18,987,867,392 参数,4093 个 state_dict 键,mask_channel=True,has arope_mask_embed=True +[2026-09-12 05:47:34] [env] grad_clip=1.0 +[2026-09-12 05:47:34] [train] 18528 个 clip,每进程 batch 1,8 进程,到 5000 步 +[2026-09-12 05:47:44] step 1/5000 loss 0.5363 (w 0.6323 mse 0.6233 t 965 new 0.18) lr 5.00e-08 gnorm 2.607 8.37s mem 79.7GB +[2026-09-12 05:47:47] step 2/5000 loss 0.6235 (w 0.3950 mse 0.4333 t 737 new 0.24) lr 1.00e-07 gnorm 2.522 3.51s mem 81.1GB +[2026-09-12 05:47:50] step 3/5000 loss 0.4312 (w 0.5014 mse 0.5038 t 934 new 0.21) lr 1.50e-07 gnorm 1.474 2.80s mem 81.1GB +[2026-09-12 05:47:53] step 4/5000 loss 0.4329 (w 0.4527 mse 0.4633 t 895 new 0.24) lr 2.00e-07 gnorm 2.453 2.82s mem 81.1GB +[2026-09-12 05:47:56] step 5/5000 loss 0.4775 (w 0.4608 mse 0.4757 t 803 new 0.24) lr 2.50e-07 gnorm 3.025 2.81s mem 81.1GB +[2026-09-12 05:47:58] step 6/5000 loss 0.5511 (w 0.4086 mse 0.4284 t 588 new 0.22) lr 3.00e-07 gnorm 2.722 2.82s mem 81.1GB +[2026-09-12 05:48:01] step 7/5000 loss 0.4423 (w 0.5673 mse 0.5725 t 929 new 0.23) lr 3.50e-07 gnorm 2.207 2.82s mem 81.1GB +[2026-09-12 05:48:05] step 8/5000 loss 0.3947 (w 0.4758 mse 0.4905 t 935 new 0.22) lr 4.00e-07 gnorm 2.001 3.63s mem 81.1GB +[2026-09-12 05:48:08] step 9/5000 loss 0.6274 (w 0.4900 mse 0.4852 t 584 new 0.24) lr 4.50e-07 gnorm 2.522 2.81s mem 81.1GB +[2026-09-12 05:48:10] step 10/5000 loss 0.7414 (w 0.8197 mse 0.8178 t 996 new 0.24) lr 5.00e-07 gnorm 3.099 2.82s mem 81.1GB +[2026-09-12 05:48:13] step 11/5000 loss 0.3447 (w 0.6631 mse 0.6555 t 984 new 0.18) lr 5.50e-07 gnorm 1.628 2.83s mem 81.1GB +[2026-09-12 05:48:16] step 12/5000 loss 0.4070 (w 0.4745 mse 0.4850 t 962 new 0.17) lr 6.00e-07 gnorm 2.564 2.83s mem 81.1GB +[2026-09-12 05:48:19] step 13/5000 loss 0.6093 (w 0.4131 mse 0.4104 t 633 new 0.19) lr 6.50e-07 gnorm 2.466 2.82s mem 81.1GB +[2026-09-12 05:48:23] step 14/5000 loss 0.8383 (w 0.7714 mse 0.7832 t 274 new 0.16) lr 7.00e-07 gnorm 2.493 3.63s mem 81.1GB +[2026-09-12 05:48:25] step 15/5000 loss 0.4739 (w 0.4373 mse 0.4284 t 904 new 0.14) lr 7.50e-07 gnorm 1.843 2.83s mem 81.1GB +[2026-09-12 05:48:28] step 16/5000 loss 0.7048 (w 0.8395 mse 0.8447 t 999 new 0.23) lr 8.00e-07 gnorm 3.501 2.84s mem 81.1GB +[2026-09-12 05:48:31] step 17/5000 loss 0.4554 (w 0.4747 mse 0.4803 t 939 new 0.18) lr 8.50e-07 gnorm 1.372 2.84s mem 81.1GB +[2026-09-12 05:48:34] step 18/5000 loss 0.3417 (w 0.5592 mse 0.5815 t 989 new 0.15) lr 9.00e-07 gnorm 1.034 2.84s mem 81.1GB +[2026-09-12 05:48:37] step 19/5000 loss 0.4326 (w 0.7293 mse 0.7527 t 100 new 0.20) lr 9.50e-07 gnorm 1.652 2.83s mem 81.1GB +[2026-09-12 05:48:40] step 20/5000 loss 0.2939 (w 0.4511 mse 0.4512 t 955 new 0.25) lr 1.00e-06 gnorm 6.012 3.48s mem 81.1GB +[2026-09-12 05:48:43] step 21/5000 loss 0.6403 (w 0.8014 mse 0.7932 t 995 new 0.20) lr 1.05e-06 gnorm 1.642 2.82s mem 81.1GB +[2026-09-12 05:48:46] step 22/5000 loss 0.3560 (w 0.4561 mse 0.4567 t 901 new 0.24) lr 1.10e-06 gnorm 1.653 2.82s mem 81.1GB +[2026-09-12 05:48:49] step 23/5000 loss 0.5306 (w 0.4540 mse 0.4685 t 740 new 0.17) lr 1.15e-06 gnorm 1.261 2.82s mem 81.1GB +[2026-09-12 05:48:52] step 24/5000 loss 0.4190 (w 0.4998 mse 0.5355 t 930 new 0.22) lr 1.20e-06 gnorm 0.779 2.82s mem 81.1GB +[2026-09-12 05:48:55] step 25/5000 loss 0.2567 (w 0.3168 mse 0.3273 t 811 new 0.27) lr 1.25e-06 gnorm 1.356 3.16s mem 81.1GB +[2026-09-12 05:48:58] step 26/5000 loss 0.4472 (w 0.4153 mse 0.4431 t 274 new 0.19) lr 1.30e-06 gnorm 0.945 3.35s mem 81.1GB +[2026-09-12 05:49:01] step 27/5000 loss 0.3460 (w 0.3942 mse 0.4016 t 916 new 0.22) lr 1.35e-06 gnorm 0.891 2.82s mem 81.1GB +[2026-09-12 05:49:04] step 28/5000 loss 0.3522 (w 0.5136 mse 0.5160 t 957 new 0.23) lr 1.40e-06 gnorm 0.537 2.84s mem 81.1GB +[2026-09-12 05:49:07] step 29/5000 loss 0.2648 (w 0.2581 mse 0.2773 t 786 new 0.16) lr 1.45e-06 gnorm 1.909 2.83s mem 81.1GB +[2026-09-12 05:49:10] step 30/5000 loss 0.3942 (w 0.4339 mse 0.4277 t 947 new 0.21) lr 1.50e-06 gnorm 0.541 3.04s mem 81.1GB +[2026-09-12 05:49:13] step 31/5000 loss 0.5916 (w 0.5219 mse 0.5400 t 947 new 0.20) lr 1.55e-06 gnorm 0.711 3.19s mem 81.1GB +[2026-09-12 05:49:16] step 32/5000 loss 0.3298 (w 0.3939 mse 0.4105 t 906 new 0.23) lr 1.60e-06 gnorm 0.844 3.34s mem 81.1GB +[2026-09-12 05:49:19] step 33/5000 loss 0.4124 (w 0.3672 mse 0.3575 t 790 new 0.15) lr 1.65e-06 gnorm 0.787 2.84s mem 81.1GB +[2026-09-12 05:49:22] step 34/5000 loss 0.2268 (w 0.3746 mse 0.4102 t 836 new 0.24) lr 1.70e-06 gnorm 0.577 2.84s mem 81.1GB +[2026-09-12 05:49:25] step 35/5000 loss 0.5096 (w 0.7768 mse 0.7640 t 999 new 0.23) lr 1.75e-06 gnorm 0.665 2.84s mem 81.1GB +[2026-09-12 05:49:28] step 36/5000 loss 0.3648 (w 0.4134 mse 0.4152 t 828 new 0.25) lr 1.80e-06 gnorm 0.321 2.83s mem 81.1GB +[2026-09-12 05:49:31] step 37/5000 loss 0.3169 (w 0.7923 mse 0.7765 t 990 new 0.21) lr 1.85e-06 gnorm 0.303 3.17s mem 81.1GB +[2026-09-12 05:49:34] step 38/5000 loss 0.5476 (w 0.3213 mse 0.3373 t 889 new 0.24) lr 1.90e-06 gnorm 0.513 3.47s mem 81.1GB +[2026-09-12 05:49:37] step 39/5000 loss 0.6256 (w 0.4898 mse 0.4970 t 470 new 0.23) lr 1.95e-06 gnorm 0.468 2.82s mem 81.1GB +[2026-09-12 05:49:40] step 40/5000 loss 0.4321 (w 0.3783 mse 0.3837 t 900 new 0.19) lr 2.00e-06 gnorm 0.434 2.81s mem 81.1GB +[2026-09-12 05:49:43] step 41/5000 loss 0.7097 (w 0.2399 mse 0.2438 t 889 new 0.10) lr 2.05e-06 gnorm 0.493 2.83s mem 81.1GB +[2026-09-12 05:49:46] step 42/5000 loss 0.2718 (w 0.3860 mse 0.3852 t 835 new 0.09) lr 2.10e-06 gnorm 0.692 2.83s mem 81.1GB +[2026-09-12 05:49:49] step 43/5000 loss 0.7165 (w 0.4850 mse 0.5047 t 594 new 0.23) lr 2.15e-06 gnorm 0.372 3.35s mem 81.1GB +[2026-09-12 05:49:53] step 44/5000 loss 0.2842 (w 0.4857 mse 0.4902 t 966 new 0.22) lr 2.20e-06 gnorm 0.308 3.46s mem 81.1GB +[2026-09-12 05:49:55] step 45/5000 loss 0.2851 (w 0.6802 mse 0.6806 t 990 new 0.23) lr 2.25e-06 gnorm 0.251 2.82s mem 81.1GB +[2026-09-12 05:49:58] step 46/5000 loss 0.3524 (w 0.4785 mse 0.4838 t 990 new 0.17) lr 2.30e-06 gnorm 0.404 2.82s mem 81.1GB +[2026-09-12 05:50:01] step 47/5000 loss 0.4647 (w 0.3068 mse 0.3193 t 603 new 0.10) lr 2.35e-06 gnorm 0.313 2.82s mem 81.1GB +[2026-09-12 05:50:04] step 48/5000 loss 0.2228 (w 0.3695 mse 0.3755 t 924 new 0.13) lr 2.40e-06 gnorm 0.401 2.82s mem 81.1GB +[2026-09-12 05:50:07] step 49/5000 loss 0.3398 (w 0.4140 mse 0.4235 t 642 new 0.26) lr 2.45e-06 gnorm 0.322 3.41s mem 81.1GB +[2026-09-12 05:50:11] step 50/5000 loss 0.2755 (w 0.4589 mse 0.4613 t 970 new 0.06) lr 2.50e-06 gnorm 0.319 3.18s mem 81.1GB +[2026-09-12 05:50:13] step 51/5000 loss 0.5596 (w 0.4937 mse 0.4923 t 372 new 0.21) lr 2.55e-06 gnorm 0.343 2.82s mem 81.1GB +[2026-09-12 05:50:16] step 52/5000 loss 0.2614 (w 0.2566 mse 0.2692 t 949 new 0.20) lr 2.60e-06 gnorm 0.281 2.83s mem 81.1GB +[2026-09-12 05:50:19] step 53/5000 loss 0.3945 (w 0.3725 mse 0.3681 t 747 new 0.09) lr 2.65e-06 gnorm 0.313 2.83s mem 81.1GB +[2026-09-12 05:50:22] step 54/5000 loss 0.3634 (w 0.4111 mse 0.4145 t 991 new 0.14) lr 2.70e-06 gnorm 0.268 2.83s mem 81.1GB +[2026-09-12 05:50:25] step 55/5000 loss 0.4265 (w 0.5230 mse 0.5344 t 986 new 0.28) lr 2.75e-06 gnorm 0.298 3.30s mem 81.1GB +[2026-09-12 05:50:28] step 56/5000 loss 0.3979 (w 0.4682 mse 0.4817 t 989 new 0.10) lr 2.80e-06 gnorm 0.256 3.11s mem 81.1GB +[2026-09-12 05:50:31] step 57/5000 loss 0.5587 (w 0.4983 mse 0.5017 t 980 new 0.19) lr 2.85e-06 gnorm 0.382 2.82s mem 81.1GB +[2026-09-12 05:50:34] step 58/5000 loss 0.3125 (w 0.3755 mse 0.4031 t 883 new 0.17) lr 2.90e-06 gnorm 0.260 2.83s mem 81.1GB +[2026-09-12 05:50:37] step 59/5000 loss 0.4170 (w 0.4793 mse 0.4854 t 961 new 0.21) lr 2.95e-06 gnorm 0.259 2.82s mem 81.1GB +[2026-09-12 05:50:40] step 60/5000 loss 0.3413 (w 0.3699 mse 0.3894 t 891 new 0.21) lr 3.00e-06 gnorm 0.259 3.09s mem 81.1GB +[2026-09-12 05:50:43] step 61/5000 loss 0.5783 (w 0.4234 mse 0.4310 t 817 new 0.17) lr 3.05e-06 gnorm 1.900 3.11s mem 81.1GB +[2026-09-12 05:50:46] step 62/5000 loss 0.5033 (w 0.3275 mse 0.3403 t 979 new 0.11) lr 3.10e-06 gnorm 10.118 3.13s mem 81.1GB +[2026-09-12 05:50:49] step 63/5000 loss 0.3430 (w 0.5809 mse 0.5674 t 984 new 0.16) lr 3.15e-06 gnorm 0.242 2.82s mem 81.1GB +[2026-09-12 05:50:52] step 64/5000 loss 0.1600 (w 0.4669 mse 0.4773 t 931 new 0.19) lr 3.20e-06 gnorm 0.779 2.82s mem 81.1GB +[2026-09-12 05:50:55] step 65/5000 loss 0.4561 (w 0.3161 mse 0.3304 t 847 new 0.22) lr 3.25e-06 gnorm 0.421 2.83s mem 81.1GB +[2026-09-12 05:50:58] step 66/5000 loss 0.2372 (w 0.2725 mse 0.3074 t 966 new 0.19) lr 3.30e-06 gnorm 0.265 3.12s mem 81.1GB +[2026-09-12 05:51:01] step 67/5000 loss 0.3723 (w 0.2306 mse 0.2409 t 739 new 0.06) lr 3.35e-06 gnorm 0.247 3.40s mem 81.1GB +[2026-09-12 05:51:04] step 68/5000 loss 0.3684 (w 0.2808 mse 0.2844 t 853 new 0.10) lr 3.40e-06 gnorm 0.318 2.82s mem 81.1GB +[2026-09-12 05:51:07] step 69/5000 loss 0.5184 (w 0.5820 mse 0.5693 t 989 new 0.23) lr 3.45e-06 gnorm 0.247 2.82s mem 81.1GB +[2026-09-12 05:51:10] step 70/5000 loss 0.4137 (w 0.5353 mse 0.5571 t 195 new 0.18) lr 3.50e-06 gnorm 0.724 2.82s mem 81.1GB +[2026-09-12 05:51:13] step 71/5000 loss 0.4252 (w 0.4284 mse 0.4198 t 967 new 0.24) lr 3.55e-06 gnorm 2.396 2.82s mem 81.1GB +[2026-09-12 05:51:16] step 72/5000 loss 0.4352 (w 0.6867 mse 0.6943 t 999 new 0.26) lr 3.60e-06 gnorm 0.348 3.12s mem 81.1GB +[2026-09-12 05:51:19] step 73/5000 loss 0.4373 (w 0.3017 mse 0.3004 t 711 new 0.11) lr 3.65e-06 gnorm 0.305 3.34s mem 81.1GB +[2026-09-12 05:51:22] step 74/5000 loss 0.4069 (w 0.5921 mse 0.5922 t 991 new 0.24) lr 3.70e-06 gnorm 0.212 2.83s mem 81.1GB +[2026-09-12 05:51:25] step 75/5000 loss 0.4013 (w 0.3639 mse 0.3623 t 929 new 0.08) lr 3.75e-06 gnorm 0.435 2.83s mem 81.1GB +[2026-09-12 05:51:28] step 76/5000 loss 0.3637 (w 0.5879 mse 0.6054 t 306 new 0.19) lr 3.80e-06 gnorm 0.200 2.84s mem 81.1GB +[2026-09-12 05:51:30] step 77/5000 loss 0.4770 (w 0.5110 mse 0.5284 t 264 new 0.24) lr 3.85e-06 gnorm 0.181 2.82s mem 81.1GB +[2026-09-12 05:51:34] step 78/5000 loss 0.3336 (w 0.3988 mse 0.3969 t 965 new 0.23) lr 3.90e-06 gnorm 0.141 3.36s mem 81.1GB +[2026-09-12 05:51:37] step 79/5000 loss 0.4967 (w 0.5578 mse 0.5502 t 999 new 0.19) lr 3.95e-06 gnorm 0.171 3.52s mem 81.1GB +[2026-09-12 05:51:40] step 80/5000 loss 0.4570 (w 0.3948 mse 0.3977 t 958 new 0.16) lr 4.00e-06 gnorm 0.513 2.83s mem 81.1GB +[2026-09-12 05:51:43] step 81/5000 loss 0.2366 (w 0.4586 mse 0.4667 t 977 new 0.22) lr 4.05e-06 gnorm 0.256 2.84s mem 81.1GB +[2026-09-12 05:51:46] step 82/5000 loss 0.3981 (w 0.3527 mse 0.3648 t 947 new 0.21) lr 4.10e-06 gnorm 0.285 2.84s mem 81.1GB +[2026-09-12 05:51:49] step 83/5000 loss 0.5242 (w 0.5387 mse 0.5380 t 264 new 0.22) lr 4.15e-06 gnorm 0.192 3.12s mem 81.1GB +[2026-09-12 05:51:52] step 84/5000 loss 0.5241 (w 0.4359 mse 0.4513 t 795 new 0.25) lr 4.20e-06 gnorm 0.335 3.31s mem 81.1GB +[2026-09-12 05:51:55] step 85/5000 loss 0.1357 (w 0.3280 mse 0.3428 t 968 new 0.23) lr 4.25e-06 gnorm 0.136 3.25s mem 81.1GB +[2026-09-12 05:51:58] step 86/5000 loss 0.2142 (w 0.4909 mse 0.4946 t 995 new 0.19) lr 4.30e-06 gnorm 0.199 2.83s mem 81.1GB +[2026-09-12 05:52:01] step 87/5000 loss 0.2504 (w 0.3625 mse 0.3597 t 985 new 0.14) lr 4.35e-06 gnorm 0.178 2.83s mem 81.1GB +[2026-09-12 05:52:04] step 88/5000 loss 0.5070 (w 0.3085 mse 0.3034 t 668 new 0.12) lr 4.40e-06 gnorm 0.185 2.83s mem 81.1GB +[2026-09-12 05:52:07] step 89/5000 loss 0.1284 (w 0.3823 mse 0.3962 t 925 new 0.20) lr 4.45e-06 gnorm 0.196 3.10s mem 81.1GB +[2026-09-12 05:52:10] step 90/5000 loss 0.2651 (w 0.5736 mse 0.5684 t 980 new 0.24) lr 4.50e-06 gnorm 0.137 3.30s mem 81.1GB +[2026-09-12 05:52:13] step 91/5000 loss 0.4291 (w 0.4760 mse 0.4727 t 768 new 0.23) lr 4.55e-06 gnorm 0.162 3.11s mem 81.1GB +[2026-09-12 05:52:16] step 92/5000 loss 0.6680 (w 0.3442 mse 0.3524 t 804 new 0.19) lr 4.60e-06 gnorm 0.215 2.82s mem 81.1GB +[2026-09-12 05:52:19] step 93/5000 loss 0.3281 (w 0.2935 mse 0.3111 t 737 new 0.11) lr 4.65e-06 gnorm 0.237 2.82s mem 81.1GB +[2026-09-12 05:52:22] step 94/5000 loss 0.4752 (w 0.2285 mse 0.2641 t 564 new 0.19) lr 4.70e-06 gnorm 0.208 2.82s mem 81.1GB +[2026-09-12 05:52:25] step 95/5000 loss 0.3622 (w 0.3355 mse 0.3477 t 929 new 0.18) lr 4.75e-06 gnorm 0.256 3.10s mem 81.1GB +[2026-09-12 05:52:28] step 96/5000 loss 0.2879 (w 0.4680 mse 0.4848 t 985 new 0.22) lr 4.80e-06 gnorm 0.143 3.38s mem 81.1GB +[2026-09-12 05:52:32] step 97/5000 loss 0.3335 (w 0.5062 mse 0.4981 t 973 new 0.22) lr 4.85e-06 gnorm 0.151 3.31s mem 81.1GB +[2026-09-12 05:52:35] step 98/5000 loss 0.5028 (w 0.4424 mse 0.4595 t 551 new 0.23) lr 4.90e-06 gnorm 0.190 2.82s mem 81.1GB +[2026-09-12 05:52:37] step 99/5000 loss 0.3849 (w 0.2592 mse 0.2858 t 807 new 0.19) lr 4.95e-06 gnorm 0.138 2.83s mem 81.1GB +[2026-09-12 05:52:40] step 100/5000 loss 0.5456 (w 0.3864 mse 0.3922 t 861 new 0.20) lr 5.00e-06 gnorm 0.229 2.83s mem 81.1GB +[2026-09-12 05:52:44] step 101/5000 loss 0.3661 (w 0.3444 mse 0.3562 t 923 new 0.22) lr 5.05e-06 gnorm 0.248 3.43s mem 81.1GB +[2026-09-12 05:52:47] step 102/5000 loss 0.4231 (w 0.3979 mse 0.4158 t 850 new 0.20) lr 5.10e-06 gnorm 0.256 3.53s mem 81.1GB +[2026-09-12 05:52:50] step 103/5000 loss 0.3775 (w 0.2252 mse 0.2516 t 629 new 0.20) lr 5.15e-06 gnorm 0.412 2.84s mem 81.1GB +[2026-09-12 05:52:53] step 104/5000 loss 0.2362 (w 0.3505 mse 0.3656 t 992 new 0.14) lr 5.20e-06 gnorm 0.305 2.83s mem 81.1GB +[2026-09-12 05:52:56] step 105/5000 loss 0.2428 (w 0.2154 mse 0.2339 t 892 new 0.23) lr 5.25e-06 gnorm 0.500 2.84s mem 81.1GB +[2026-09-12 05:52:59] step 106/5000 loss 0.3175 (w 0.3565 mse 0.3719 t 980 new 0.12) lr 5.30e-06 gnorm 0.200 2.84s mem 81.1GB +[2026-09-12 05:53:02] step 107/5000 loss 0.5245 (w 0.2977 mse 0.3159 t 864 new 0.22) lr 5.35e-06 gnorm 0.197 3.29s mem 81.1GB +[2026-09-12 05:53:05] step 108/5000 loss 0.2898 (w 0.6562 mse 0.6340 t 981 new 0.23) lr 5.40e-06 gnorm 0.307 3.52s mem 81.1GB +[2026-09-12 05:53:08] step 109/5000 loss 0.3864 (w 0.2586 mse 0.2947 t 984 new 0.21) lr 5.45e-06 gnorm 0.234 2.82s mem 81.1GB +[2026-09-12 05:53:11] step 110/5000 loss 0.6231 (w 0.4664 mse 0.4633 t 915 new 0.21) lr 5.50e-06 gnorm 0.297 2.84s mem 81.1GB +[2026-09-12 05:53:14] step 111/5000 loss 0.3048 (w 0.3727 mse 0.3767 t 869 new 0.22) lr 5.55e-06 gnorm 0.181 2.83s mem 81.1GB +[2026-09-12 05:53:17] step 112/5000 loss 0.2949 (w 0.4792 mse 0.4802 t 985 new 0.18) lr 5.60e-06 gnorm 0.144 2.82s mem 81.1GB +[2026-09-12 05:53:20] step 113/5000 loss 0.3911 (w 0.2804 mse 0.3099 t 927 new 0.27) lr 5.65e-06 gnorm 0.224 3.39s mem 81.1GB +[2026-09-12 05:53:24] step 114/5000 loss 0.5574 (w 0.3542 mse 0.3570 t 776 new 0.20) lr 5.70e-06 gnorm 0.194 3.44s mem 81.1GB +[2026-09-12 05:53:26] step 115/5000 loss 0.3213 (w 0.4330 mse 0.4192 t 995 new 0.13) lr 5.75e-06 gnorm 0.428 2.84s mem 81.1GB +[2026-09-12 05:53:29] step 116/5000 loss 0.4918 (w 0.3969 mse 0.4048 t 750 new 0.21) lr 5.80e-06 gnorm 0.171 2.83s mem 81.1GB +[2026-09-12 05:53:32] step 117/5000 loss 0.4022 (w 0.3648 mse 0.3904 t 647 new 0.23) lr 5.85e-06 gnorm 0.275 2.83s mem 81.1GB +[2026-09-12 05:53:35] step 118/5000 loss 0.5102 (w 0.3878 mse 0.3934 t 899 new 0.18) lr 5.90e-06 gnorm 0.157 3.07s mem 81.1GB +[2026-09-12 05:53:38] step 119/5000 loss 0.3551 (w 0.5060 mse 0.5103 t 989 new 0.21) lr 5.95e-06 gnorm 0.640 3.13s mem 81.1GB +[2026-09-12 05:53:41] step 120/5000 loss 0.4053 (w 0.4339 mse 0.4327 t 955 new 0.19) lr 6.00e-06 gnorm 0.173 3.18s mem 81.1GB +[2026-09-12 05:53:44] step 121/5000 loss 0.4493 (w 0.4318 mse 0.4283 t 960 new 0.20) lr 6.05e-06 gnorm 0.167 2.82s mem 81.1GB +[2026-09-12 05:53:47] step 122/5000 loss 0.2645 (w 0.3415 mse 0.3395 t 925 new 0.19) lr 6.10e-06 gnorm 0.497 2.83s mem 81.1GB +[2026-09-12 05:53:50] step 123/5000 loss 0.3069 (w 0.3751 mse 0.3864 t 698 new 0.17) lr 6.15e-06 gnorm 0.277 2.83s mem 81.1GB +[2026-09-12 05:53:53] step 124/5000 loss 0.4455 (w 0.3259 mse 0.3418 t 794 new 0.26) lr 6.20e-06 gnorm 0.756 3.12s mem 81.1GB +[2026-09-12 05:53:56] step 125/5000 loss 0.4469 (w 0.2873 mse 0.2888 t 884 new 0.15) lr 6.25e-06 gnorm 0.246 3.37s mem 81.1GB +[2026-09-12 05:54:00] step 126/5000 loss 0.4827 (w 0.3182 mse 0.3088 t 905 new 0.15) lr 6.30e-06 gnorm 0.488 3.29s mem 81.1GB +[2026-09-12 05:54:03] step 127/5000 loss 0.4163 (w 0.3545 mse 0.3716 t 935 new 0.20) lr 6.35e-06 gnorm 0.178 2.83s mem 81.1GB +[2026-09-12 05:54:05] step 128/5000 loss 0.3880 (w 0.2712 mse 0.2803 t 788 new 0.22) lr 6.40e-06 gnorm 0.204 2.82s mem 81.1GB +[2026-09-12 05:54:08] step 129/5000 loss 0.4120 (w 0.4253 mse 0.4451 t 383 new 0.21) lr 6.45e-06 gnorm 0.163 2.83s mem 81.1GB +[2026-09-12 05:54:11] step 130/5000 loss 0.4880 (w 0.2548 mse 0.2638 t 774 new 0.22) lr 6.50e-06 gnorm 0.329 3.08s mem 81.1GB +[2026-09-12 05:54:15] step 131/5000 loss 0.4368 (w 0.4756 mse 0.4875 t 375 new 0.25) lr 6.55e-06 gnorm 0.160 3.36s mem 81.1GB +[2026-09-12 05:54:18] step 132/5000 loss 0.4380 (w 0.3244 mse 0.3404 t 919 new 0.24) lr 6.60e-06 gnorm 0.187 3.29s mem 81.1GB +[2026-09-12 05:54:21] step 133/5000 loss 0.2900 (w 0.3114 mse 0.3256 t 730 new 0.25) lr 6.65e-06 gnorm 0.185 2.83s mem 81.1GB +[2026-09-12 05:54:24] step 134/5000 loss 0.5923 (w 0.4016 mse 0.4256 t 662 new 0.27) lr 6.70e-06 gnorm 0.160 2.83s mem 81.1GB +[2026-09-12 05:54:26] step 135/5000 loss 0.4838 (w 0.4354 mse 0.4347 t 626 new 0.19) lr 6.75e-06 gnorm 0.192 2.84s mem 81.1GB +[2026-09-12 05:54:30] step 136/5000 loss 0.3334 (w 0.3819 mse 0.3820 t 728 new 0.19) lr 6.80e-06 gnorm 0.302 3.12s mem 81.1GB +[2026-09-12 05:54:33] step 137/5000 loss 0.4558 (w 0.4012 mse 0.4064 t 807 new 0.26) lr 6.85e-06 gnorm 0.349 3.68s mem 81.1GB +[2026-09-12 05:54:36] step 138/5000 loss 0.3196 (w 0.3338 mse 0.3498 t 988 new 0.27) lr 6.90e-06 gnorm 0.189 2.83s mem 81.1GB +[2026-09-12 05:54:39] step 139/5000 loss 0.3305 (w 0.3267 mse 0.3462 t 816 new 0.24) lr 6.95e-06 gnorm 0.204 2.84s mem 81.1GB +[2026-09-12 05:54:42] step 140/5000 loss 0.3557 (w 0.7298 mse 0.7412 t 183 new 0.26) lr 7.00e-06 gnorm 0.149 2.84s mem 81.1GB +[2026-09-12 05:54:45] step 141/5000 loss 0.4062 (w 0.3428 mse 0.3566 t 629 new 0.21) lr 7.05e-06 gnorm 0.150 3.13s mem 81.1GB +[2026-09-12 05:54:48] step 142/5000 loss 0.2367 (w 0.3179 mse 0.3144 t 971 new 0.14) lr 7.10e-06 gnorm 0.321 3.01s mem 81.1GB +[2026-09-12 05:54:51] step 143/5000 loss 0.4597 (w 0.4259 mse 0.4367 t 968 new 0.22) lr 7.15e-06 gnorm 0.448 3.38s mem 81.1GB +[2026-09-12 05:54:54] step 144/5000 loss 0.6212 (w 0.3487 mse 0.3611 t 722 new 0.19) lr 7.20e-06 gnorm 0.199 2.83s mem 81.1GB +[2026-09-12 05:54:57] step 145/5000 loss 0.2251 (w 0.2186 mse 0.2261 t 980 new 0.10) lr 7.25e-06 gnorm 0.160 2.83s mem 81.1GB +[2026-09-12 05:55:00] step 146/5000 loss 0.2118 (w 0.3141 mse 0.3219 t 959 new 0.23) lr 7.30e-06 gnorm 0.204 2.82s mem 81.1GB +[2026-09-12 05:55:03] step 147/5000 loss 0.3870 (w 0.4205 mse 0.4409 t 301 new 0.18) lr 7.35e-06 gnorm 0.155 3.13s mem 81.1GB +[2026-09-12 05:55:06] step 148/5000 loss 0.3807 (w 0.5723 mse 0.5732 t 993 new 0.14) lr 7.40e-06 gnorm 0.141 3.05s mem 81.1GB +[2026-09-12 05:55:09] step 149/5000 loss 0.3466 (w 0.3690 mse 0.3758 t 624 new 0.24) lr 7.45e-06 gnorm 0.177 3.37s mem 81.1GB +[2026-09-12 05:55:12] step 150/5000 loss 0.2525 (w 0.3529 mse 0.3639 t 941 new 0.21) lr 7.50e-06 gnorm 0.149 2.82s mem 81.1GB +[2026-09-12 05:55:15] step 151/5000 loss 0.3107 (w 0.3316 mse 0.3366 t 905 new 0.22) lr 7.55e-06 gnorm 0.272 2.83s mem 81.1GB +[2026-09-12 05:55:18] step 152/5000 loss 0.3093 (w 0.3173 mse 0.3335 t 946 new 0.15) lr 7.60e-06 gnorm 0.264 2.83s mem 81.1GB +[2026-09-12 05:55:21] step 153/5000 loss 0.4883 (w 0.4255 mse 0.4263 t 965 new 0.22) lr 7.65e-06 gnorm 0.263 3.06s mem 81.1GB +[2026-09-12 05:55:24] step 154/5000 loss 0.2861 (w 0.3404 mse 0.3419 t 835 new 0.26) lr 7.70e-06 gnorm 0.165 3.04s mem 81.1GB +[2026-09-12 05:55:28] step 155/5000 loss 0.3852 (w 0.3295 mse 0.3442 t 828 new 0.22) lr 7.75e-06 gnorm 0.206 3.53s mem 81.1GB +[2026-09-12 05:55:30] step 156/5000 loss 0.3915 (w 0.2761 mse 0.3013 t 971 new 0.22) lr 7.80e-06 gnorm 0.189 2.82s mem 81.1GB +[2026-09-12 05:55:33] step 157/5000 loss 0.1055 (w 0.2425 mse 0.2615 t 905 new 0.10) lr 7.85e-06 gnorm 0.192 2.83s mem 81.1GB +[2026-09-12 05:55:36] step 158/5000 loss 0.5937 (w 0.3007 mse 0.3085 t 814 new 0.22) lr 7.90e-06 gnorm 0.188 2.84s mem 81.1GB +[2026-09-12 05:55:39] step 159/5000 loss 0.1146 (w 0.4136 mse 0.4184 t 992 new 0.17) lr 7.95e-06 gnorm 0.140 3.10s mem 81.1GB +[2026-09-12 05:55:42] step 160/5000 loss 0.5139 (w 0.3687 mse 0.3770 t 951 new 0.19) lr 8.00e-06 gnorm 0.149 3.33s mem 81.1GB +[2026-09-12 05:55:46] step 161/5000 loss 0.3501 (w 0.3392 mse 0.3359 t 865 new 0.20) lr 8.05e-06 gnorm 0.186 3.18s mem 81.1GB +[2026-09-12 05:55:48] step 162/5000 loss 0.2698 (w 0.5432 mse 0.5592 t 288 new 0.22) lr 8.10e-06 gnorm 0.197 2.82s mem 81.1GB +[2026-09-12 05:55:51] step 163/5000 loss 0.4278 (w 0.3151 mse 0.3322 t 955 new 0.21) lr 8.15e-06 gnorm 0.176 2.82s mem 81.1GB +[2026-09-12 05:55:54] step 164/5000 loss 0.5241 (w 0.3237 mse 0.3356 t 698 new 0.25) lr 8.20e-06 gnorm 0.144 2.82s mem 81.1GB +[2026-09-12 05:55:57] step 165/5000 loss 0.4143 (w 0.3457 mse 0.3442 t 861 new 0.19) lr 8.25e-06 gnorm 0.526 3.06s mem 81.1GB +[2026-09-12 05:56:00] step 166/5000 loss 0.4288 (w 0.2750 mse 0.2914 t 677 new 0.21) lr 8.30e-06 gnorm 0.166 3.29s mem 81.1GB +[2026-09-12 05:56:04] step 167/5000 loss 0.2386 (w 0.2500 mse 0.2615 t 768 new 0.23) lr 8.35e-06 gnorm 0.164 3.21s mem 81.1GB +[2026-09-12 05:56:06] step 168/5000 loss 0.2891 (w 0.3180 mse 0.3254 t 828 new 0.27) lr 8.40e-06 gnorm 0.132 2.82s mem 81.1GB +[2026-09-12 05:56:09] step 169/5000 loss 0.4761 (w 0.3584 mse 0.3751 t 964 new 0.18) lr 8.45e-06 gnorm 0.244 2.82s mem 81.1GB +[2026-09-12 05:56:12] step 170/5000 loss 0.2431 (w 0.3564 mse 0.3600 t 955 new 0.25) lr 8.50e-06 gnorm 0.177 2.83s mem 81.1GB +[2026-09-12 05:56:15] step 171/5000 loss 0.3341 (w 0.3120 mse 0.3336 t 794 new 0.13) lr 8.55e-06 gnorm 0.180 3.12s mem 81.1GB +[2026-09-12 05:56:19] step 172/5000 loss 0.4992 (w 0.7415 mse 0.7498 t 165 new 0.12) lr 8.60e-06 gnorm 0.191 3.33s mem 81.1GB +[2026-09-12 05:56:22] step 173/5000 loss 0.4993 (w 0.3364 mse 0.3541 t 648 new 0.15) lr 8.65e-06 gnorm 0.210 3.11s mem 81.1GB +[2026-09-12 05:56:25] step 174/5000 loss 0.5771 (w 0.4014 mse 0.4085 t 659 new 0.23) lr 8.70e-06 gnorm 0.179 2.83s mem 81.1GB +[2026-09-12 05:56:27] step 175/5000 loss 0.3588 (w 0.3311 mse 0.3377 t 709 new 0.17) lr 8.75e-06 gnorm 3.218 2.84s mem 81.1GB +[2026-09-12 05:56:30] step 176/5000 loss 0.3974 (w 0.3284 mse 0.3345 t 959 new 0.24) lr 8.80e-06 gnorm 0.124 3.06s mem 81.1GB +[2026-09-12 05:56:34] step 177/5000 loss 0.4290 (w 0.3697 mse 0.3623 t 912 new 0.12) lr 8.85e-06 gnorm 0.262 3.12s mem 81.1GB +[2026-09-12 05:56:37] step 178/5000 loss 0.2475 (w 0.4779 mse 0.4796 t 976 new 0.17) lr 8.90e-06 gnorm 0.206 3.39s mem 81.1GB +[2026-09-12 05:56:40] step 179/5000 loss 0.3596 (w 0.2455 mse 0.2729 t 902 new 0.26) lr 8.95e-06 gnorm 0.177 3.09s mem 81.1GB +[2026-09-12 05:56:43] step 180/5000 loss 0.3161 (w 0.2761 mse 0.2952 t 924 new 0.19) lr 9.00e-06 gnorm 0.260 2.83s mem 81.1GB +[2026-09-12 05:56:46] step 181/5000 loss 0.4172 (w 0.2613 mse 0.2651 t 864 new 0.20) lr 9.05e-06 gnorm 0.155 2.82s mem 81.1GB +[2026-09-12 05:56:49] step 182/5000 loss 0.4098 (w 0.3624 mse 0.3623 t 742 new 0.23) lr 9.10e-06 gnorm 0.192 3.11s mem 81.1GB +[2026-09-12 05:56:52] step 183/5000 loss 0.4779 (w 0.3684 mse 0.3766 t 934 new 0.15) lr 9.15e-06 gnorm 0.196 3.11s mem 81.1GB +[2026-09-12 05:56:55] step 184/5000 loss 0.4515 (w 0.4121 mse 0.4275 t 992 new 0.09) lr 9.20e-06 gnorm 0.211 3.34s mem 81.1GB +[2026-09-12 05:56:58] step 185/5000 loss 0.5085 (w 0.3616 mse 0.3618 t 629 new 0.24) lr 9.25e-06 gnorm 0.556 3.09s mem 81.1GB +[2026-09-12 05:57:01] step 186/5000 loss 0.5286 (w 0.6183 mse 0.6271 t 120 new 0.24) lr 9.30e-06 gnorm 14.425 2.82s mem 81.1GB +[2026-09-12 05:57:04] step 187/5000 loss 0.2719 (w 0.2532 mse 0.2745 t 885 new 0.23) lr 9.35e-06 gnorm 0.198 2.82s mem 81.1GB +[2026-09-12 05:57:07] step 188/5000 loss 0.2801 (w 0.2806 mse 0.3012 t 902 new 0.21) lr 9.40e-06 gnorm 0.143 3.18s mem 81.1GB +[2026-09-12 05:57:11] step 189/5000 loss 0.5079 (w 0.5038 mse 0.4961 t 1000 new 0.19) lr 9.45e-06 gnorm 0.149 3.32s mem 81.1GB +[2026-09-12 05:57:14] step 190/5000 loss 0.2243 (w 0.5265 mse 0.5623 t 982 new 0.18) lr 9.50e-06 gnorm 0.175 3.27s mem 81.1GB +[2026-09-12 05:57:17] step 191/5000 loss 0.2655 (w 0.4489 mse 0.4544 t 961 new 0.18) lr 9.55e-06 gnorm 0.139 3.24s mem 81.1GB +[2026-09-12 05:57:20] step 192/5000 loss 0.2925 (w 0.3794 mse 0.3854 t 936 new 0.22) lr 9.60e-06 gnorm 0.136 2.84s mem 81.1GB +[2026-09-12 05:57:23] step 193/5000 loss 0.1979 (w 0.3339 mse 0.3302 t 933 new 0.16) lr 9.65e-06 gnorm 0.135 2.83s mem 81.1GB +[2026-09-12 05:57:26] step 194/5000 loss 0.3960 (w 0.3129 mse 0.3156 t 797 new 0.26) lr 9.70e-06 gnorm 0.304 3.09s mem 81.1GB +[2026-09-12 05:57:29] step 195/5000 loss 0.3713 (w 0.2676 mse 0.2881 t 884 new 0.13) lr 9.75e-06 gnorm 0.186 3.31s mem 81.1GB +[2026-09-12 05:57:33] step 196/5000 loss 0.5777 (w 0.3760 mse 0.3799 t 648 new 0.20) lr 9.80e-06 gnorm 0.235 3.48s mem 81.1GB +[2026-09-12 05:57:35] step 197/5000 loss 0.3182 (w 0.5756 mse 0.5750 t 971 new 0.20) lr 9.85e-06 gnorm 0.161 2.83s mem 81.1GB +[2026-09-12 05:57:38] step 198/5000 loss 0.1725 (w 0.2905 mse 0.3028 t 811 new 0.10) lr 9.90e-06 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 05:57:41] step 199/5000 loss 0.5976 (w 0.2980 mse 0.3040 t 508 new 0.21) lr 9.95e-06 gnorm 0.444 3.13s mem 81.1GB +[2026-09-12 05:57:44] step 200/5000 loss 0.4357 (w 0.7554 mse 0.7517 t 140 new 0.26) lr 1.00e-05 gnorm 0.195 3.05s mem 81.1GB +[2026-09-12 05:57:48] step 201/5000 loss 0.4776 (w 0.3128 mse 0.3236 t 730 new 0.19) lr 1.00e-05 gnorm 0.156 3.36s mem 81.1GB +[2026-09-12 05:57:51] step 202/5000 loss 0.3982 (w 0.4559 mse 0.4541 t 447 new 0.19) lr 1.00e-05 gnorm 0.149 3.29s mem 81.1GB +[2026-09-12 05:57:54] step 203/5000 loss 0.2301 (w 0.2839 mse 0.2914 t 871 new 0.16) lr 1.00e-05 gnorm 0.176 2.83s mem 81.1GB +[2026-09-12 05:57:57] step 204/5000 loss 0.3266 (w 0.3475 mse 0.3451 t 895 new 0.12) lr 1.00e-05 gnorm 0.197 2.83s mem 81.1GB +[2026-09-12 05:58:00] step 205/5000 loss 0.2993 (w 0.4032 mse 0.4140 t 931 new 0.20) lr 1.00e-05 gnorm 0.159 2.83s mem 81.1GB +[2026-09-12 05:58:03] step 206/5000 loss 0.3796 (w 0.5182 mse 0.5157 t 996 new 0.22) lr 1.00e-05 gnorm 2.235 3.06s mem 81.1GB +[2026-09-12 05:58:06] step 207/5000 loss 0.3722 (w 0.2473 mse 0.2587 t 868 new 0.22) lr 1.00e-05 gnorm 0.907 3.32s mem 81.1GB +[2026-09-12 05:58:10] step 208/5000 loss 0.3872 (w 0.3678 mse 0.3931 t 967 new 0.23) lr 1.00e-05 gnorm 0.139 3.35s mem 81.1GB +[2026-09-12 05:58:13] step 209/5000 loss 0.2784 (w 0.3308 mse 0.3343 t 802 new 0.19) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +[2026-09-12 05:58:15] step 210/5000 loss 0.3319 (w 0.3621 mse 0.3868 t 344 new 0.22) lr 1.00e-05 gnorm 2.006 2.82s mem 81.1GB +[2026-09-12 05:58:18] step 211/5000 loss 0.1477 (w 0.3602 mse 0.3749 t 992 new 0.10) lr 1.00e-05 gnorm 0.180 3.12s mem 81.1GB +[2026-09-12 05:58:22] step 212/5000 loss 0.4832 (w 0.3948 mse 0.4004 t 528 new 0.26) lr 1.00e-05 gnorm 0.258 3.08s mem 81.1GB +[2026-09-12 05:58:25] step 213/5000 loss 0.1203 (w 0.4566 mse 0.4797 t 994 new 0.17) lr 1.00e-05 gnorm 0.253 3.38s mem 81.1GB +[2026-09-12 05:58:28] step 214/5000 loss 0.4009 (w 0.3338 mse 0.3370 t 968 new 0.05) lr 1.00e-05 gnorm 0.189 3.24s mem 81.1GB +[2026-09-12 05:58:31] step 215/5000 loss 0.2735 (w 0.2714 mse 0.2710 t 898 new 0.22) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +[2026-09-12 05:58:34] step 216/5000 loss 0.3790 (w 0.4002 mse 0.4195 t 904 new 0.21) lr 1.00e-05 gnorm 0.200 2.82s mem 81.1GB +[2026-09-12 05:58:37] step 217/5000 loss 0.4329 (w 0.3618 mse 0.3635 t 791 new 0.28) lr 1.00e-05 gnorm 0.355 2.83s mem 81.1GB +[2026-09-12 05:58:40] step 218/5000 loss 0.2245 (w 0.2023 mse 0.2144 t 760 new 0.20) lr 1.00e-05 gnorm 0.195 3.06s mem 81.1GB +[2026-09-12 05:58:43] step 219/5000 loss 0.3726 (w 0.2572 mse 0.2719 t 748 new 0.25) lr 1.00e-05 gnorm 0.135 3.27s mem 81.1GB +[2026-09-12 05:58:46] step 220/5000 loss 0.3765 (w 0.3236 mse 0.3319 t 866 new 0.23) lr 1.00e-05 gnorm 0.169 3.13s mem 81.1GB +[2026-09-12 05:58:49] step 221/5000 loss 0.2770 (w 0.2694 mse 0.2824 t 768 new 0.21) lr 1.00e-05 gnorm 0.129 2.81s mem 81.1GB +[2026-09-12 05:58:52] step 222/5000 loss 0.4249 (w 0.2938 mse 0.3030 t 914 new 0.08) lr 1.00e-05 gnorm 0.146 2.81s mem 81.1GB +[2026-09-12 05:58:55] step 223/5000 loss 0.3561 (w 0.3295 mse 0.3303 t 917 new 0.07) lr 1.00e-05 gnorm 0.187 3.03s mem 81.1GB +[2026-09-12 05:58:58] step 224/5000 loss 0.4887 (w 0.3687 mse 0.3640 t 950 new 0.23) lr 1.00e-05 gnorm 0.151 3.37s mem 81.1GB +[2026-09-12 05:59:02] step 225/5000 loss 0.1095 (w 0.6205 mse 0.5968 t 997 new 0.25) lr 1.00e-05 gnorm 0.229 3.28s mem 81.1GB +[2026-09-12 05:59:05] step 226/5000 loss 0.3660 (w 0.3514 mse 0.3599 t 912 new 0.24) lr 1.00e-05 gnorm 0.221 3.19s mem 81.1GB +[2026-09-12 05:59:08] step 227/5000 loss 0.2411 (w 0.4148 mse 0.4124 t 971 new 0.21) lr 1.00e-05 gnorm 0.187 3.05s mem 81.1GB +[2026-09-12 05:59:11] step 228/5000 loss 0.4365 (w 0.4578 mse 0.4598 t 998 new 0.22) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +[2026-09-12 05:59:14] step 229/5000 loss 0.2238 (w 0.3206 mse 0.3369 t 980 new 0.11) lr 1.00e-05 gnorm 0.146 3.08s mem 81.1GB +[2026-09-12 05:59:17] step 230/5000 loss 0.1577 (w 0.2394 mse 0.2606 t 922 new 0.24) lr 1.00e-05 gnorm 0.138 3.37s mem 81.1GB +[2026-09-12 05:59:20] step 231/5000 loss 0.1819 (w 0.3830 mse 0.3802 t 859 new 0.15) lr 1.00e-05 gnorm 0.287 3.30s mem 81.1GB +[2026-09-12 05:59:24] step 232/5000 loss 0.6243 (w 0.4171 mse 0.4235 t 985 new 0.22) lr 1.00e-05 gnorm 0.336 3.19s mem 81.1GB +[2026-09-12 05:59:26] step 233/5000 loss 0.2959 (w 0.3141 mse 0.3261 t 858 new 0.27) lr 1.00e-05 gnorm 0.136 2.82s mem 81.1GB +[2026-09-12 05:59:29] step 234/5000 loss 0.3949 (w 0.4284 mse 0.4369 t 964 new 0.18) lr 1.00e-05 gnorm 1.098 2.81s mem 81.1GB +[2026-09-12 05:59:33] step 235/5000 loss 0.4433 (w 0.2974 mse 0.3418 t 999 new 0.20) lr 1.00e-05 gnorm 0.218 3.32s mem 81.1GB +[2026-09-12 05:59:36] step 236/5000 loss 0.2984 (w 0.3887 mse 0.4090 t 957 new 0.18) lr 1.00e-05 gnorm 0.205 3.05s mem 81.1GB +[2026-09-12 05:59:39] step 237/5000 loss 0.3273 (w 0.3455 mse 0.3408 t 846 new 0.18) lr 1.00e-05 gnorm 0.200 3.34s mem 81.1GB +[2026-09-12 05:59:42] step 238/5000 loss 0.4010 (w 0.2610 mse 0.2658 t 760 new 0.10) lr 1.00e-05 gnorm 0.220 3.13s mem 81.1GB +[2026-09-12 05:59:45] step 239/5000 loss 0.2391 (w 0.2964 mse 0.3127 t 352 new 0.09) lr 1.00e-05 gnorm 0.156 2.82s mem 81.1GB +[2026-09-12 05:59:48] step 240/5000 loss 0.4343 (w 0.3132 mse 0.3076 t 654 new 0.14) lr 1.00e-05 gnorm 0.568 2.82s mem 81.1GB +[2026-09-12 05:59:51] step 241/5000 loss 0.5987 (w 0.3797 mse 0.3836 t 525 new 0.22) lr 1.00e-05 gnorm 0.328 3.35s mem 81.1GB +[2026-09-12 05:59:54] step 242/5000 loss 0.2625 (w 0.3475 mse 0.3661 t 957 new 0.21) lr 1.00e-05 gnorm 0.170 3.34s mem 81.1GB +[2026-09-12 05:59:58] step 243/5000 loss 0.3742 (w 0.3496 mse 0.3607 t 848 new 0.20) lr 1.00e-05 gnorm 0.161 3.06s mem 81.1GB +[2026-09-12 06:00:01] step 244/5000 loss 0.5973 (w 0.2806 mse 0.2957 t 546 new 0.23) lr 1.00e-05 gnorm 0.267 3.16s mem 81.1GB +[2026-09-12 06:00:04] step 245/5000 loss 0.3690 (w 0.3390 mse 0.3481 t 473 new 0.11) lr 1.00e-05 gnorm 0.181 2.83s mem 81.1GB +[2026-09-12 06:00:06] step 246/5000 loss 0.4236 (w 0.4850 mse 0.4811 t 368 new 0.23) lr 1.00e-05 gnorm 0.188 2.83s mem 81.1GB +[2026-09-12 06:00:10] step 247/5000 loss 0.3839 (w 0.6577 mse 0.6339 t 991 new 0.22) lr 1.00e-05 gnorm 0.129 3.43s mem 81.1GB +[2026-09-12 06:00:13] step 248/5000 loss 0.4431 (w 0.3606 mse 0.3601 t 751 new 0.22) lr 1.00e-05 gnorm 0.142 3.30s mem 81.1GB +[2026-09-12 06:00:16] step 249/5000 loss 0.3808 (w 0.3654 mse 0.3879 t 323 new 0.25) lr 1.00e-05 gnorm 0.222 3.22s mem 81.1GB +[2026-09-12 06:00:19] step 250/5000 loss 0.2752 (w 0.3102 mse 0.3260 t 476 new 0.12) lr 1.00e-05 gnorm 0.176 2.82s mem 81.1GB +[2026-09-12 06:00:22] step 251/5000 loss 0.4542 (w 0.3551 mse 0.3637 t 660 new 0.18) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +[2026-09-12 06:00:25] step 252/5000 loss 0.2895 (w 0.3651 mse 0.3748 t 899 new 0.23) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +[2026-09-12 06:00:28] step 253/5000 loss 0.4399 (w 0.3251 mse 0.3281 t 663 new 0.27) lr 1.00e-05 gnorm 0.156 3.13s mem 81.1GB +[2026-09-12 06:00:31] step 254/5000 loss 0.3045 (w 0.3313 mse 0.3400 t 906 new 0.20) lr 1.00e-05 gnorm 0.163 3.32s mem 81.1GB +[2026-09-12 06:00:35] step 255/5000 loss 0.4954 (w 0.3147 mse 0.3275 t 735 new 0.21) lr 1.00e-05 gnorm 0.430 3.11s mem 81.1GB +[2026-09-12 06:00:37] step 256/5000 loss 0.2573 (w 0.2093 mse 0.2236 t 969 new 0.13) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-12 06:00:40] step 257/5000 loss 0.1900 (w 0.2617 mse 0.2670 t 734 new 0.12) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +[2026-09-12 06:00:43] step 258/5000 loss 0.3816 (w 0.3858 mse 0.3900 t 936 new 0.25) lr 1.00e-05 gnorm 0.185 3.09s mem 81.1GB +[2026-09-12 06:00:46] step 259/5000 loss 0.3420 (w 0.3422 mse 0.3516 t 856 new 0.23) lr 1.00e-05 gnorm 0.163 3.14s mem 81.1GB +[2026-09-12 06:00:50] step 260/5000 loss 0.4554 (w 0.2510 mse 0.2770 t 760 new 0.17) lr 1.00e-05 gnorm 0.141 3.32s mem 81.1GB +[2026-09-12 06:00:53] step 261/5000 loss 0.4435 (w 0.3551 mse 0.3616 t 744 new 0.20) lr 1.00e-05 gnorm 0.158 3.15s mem 81.1GB +[2026-09-12 06:00:56] step 262/5000 loss 0.1948 (w 0.3369 mse 0.3383 t 927 new 0.22) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +[2026-09-12 06:00:59] step 263/5000 loss 0.2951 (w 0.4216 mse 0.4203 t 952 new 0.22) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +[2026-09-12 06:01:02] step 264/5000 loss 0.2089 (w 0.2481 mse 0.2677 t 693 new 0.23) lr 1.00e-05 gnorm 0.201 3.09s mem 81.1GB +[2026-09-12 06:01:05] step 265/5000 loss 0.4685 (w 0.3404 mse 0.3702 t 935 new 0.26) lr 1.00e-05 gnorm 0.208 3.04s mem 81.1GB +[2026-09-12 06:01:08] step 266/5000 loss 0.1701 (w 0.3021 mse 0.3128 t 768 new 0.16) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +[2026-09-12 06:01:11] step 267/5000 loss 0.3139 (w 0.4210 mse 0.4340 t 988 new 0.15) lr 1.00e-05 gnorm 0.183 3.17s mem 81.1GB +[2026-09-12 06:01:14] step 268/5000 loss 0.3140 (w 0.2810 mse 0.2970 t 989 new 0.18) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +[2026-09-12 06:01:17] step 269/5000 loss 0.3798 (w 0.5247 mse 0.5356 t 976 new 0.18) lr 1.00e-05 gnorm 0.159 2.81s mem 81.1GB +[2026-09-12 06:01:20] step 270/5000 loss 0.3477 (w 0.3365 mse 0.3456 t 916 new 0.15) lr 1.00e-05 gnorm 0.247 3.05s mem 81.1GB +[2026-09-12 06:01:23] step 271/5000 loss 0.3464 (w 0.3839 mse 0.3839 t 700 new 0.28) lr 1.00e-05 gnorm 1.218 3.05s mem 81.1GB +[2026-09-12 06:01:26] step 272/5000 loss 0.4029 (w 0.3770 mse 0.3814 t 958 new 0.08) lr 1.00e-05 gnorm 0.209 3.08s mem 81.1GB +[2026-09-12 06:01:29] step 273/5000 loss 0.3669 (w 0.2501 mse 0.2630 t 989 new 0.22) lr 1.00e-05 gnorm 0.159 3.16s mem 81.1GB +[2026-09-12 06:01:32] step 274/5000 loss 0.4200 (w 0.3008 mse 0.3088 t 974 new 0.16) lr 1.00e-05 gnorm 0.261 2.81s mem 81.1GB +[2026-09-12 06:01:35] step 275/5000 loss 0.4257 (w 0.3397 mse 0.3473 t 709 new 0.19) lr 1.00e-05 gnorm 0.191 2.81s mem 81.1GB +[2026-09-12 06:01:38] step 276/5000 loss 0.2518 (w 0.4318 mse 0.4682 t 153 new 0.16) lr 1.00e-05 gnorm 0.185 3.07s mem 81.1GB +[2026-09-12 06:01:41] step 277/5000 loss 0.4111 (w 0.2172 mse 0.2277 t 749 new 0.20) lr 1.00e-05 gnorm 0.306 3.35s mem 81.1GB +[2026-09-12 06:01:44] step 278/5000 loss 0.4250 (w 0.2488 mse 0.2741 t 927 new 0.20) lr 1.00e-05 gnorm 0.162 2.82s mem 81.1GB +[2026-09-12 06:01:47] step 279/5000 loss 0.3466 (w 0.3702 mse 0.3641 t 983 new 0.23) lr 1.00e-05 gnorm 0.242 3.10s mem 81.1GB +[2026-09-12 06:01:50] step 280/5000 loss 0.5123 (w 0.5355 mse 0.5549 t 159 new 0.21) lr 1.00e-05 gnorm 0.149 2.83s mem 81.1GB +[2026-09-12 06:01:53] step 281/5000 loss 0.3517 (w 0.3540 mse 0.3764 t 297 new 0.29) lr 1.00e-05 gnorm 0.516 2.83s mem 81.1GB +[2026-09-12 06:01:56] step 282/5000 loss 0.1727 (w 0.2437 mse 0.2553 t 905 new 0.20) lr 1.00e-05 gnorm 0.171 3.10s mem 81.1GB +[2026-09-12 06:01:59] step 283/5000 loss 0.4495 (w 0.5094 mse 0.5100 t 383 new 0.19) lr 1.00e-05 gnorm 0.162 3.30s mem 81.1GB +[2026-09-12 06:02:02] step 284/5000 loss 0.1376 (w 0.2392 mse 0.2560 t 985 new 0.12) lr 1.00e-05 gnorm 0.177 2.83s mem 81.1GB +[2026-09-12 06:02:05] step 285/5000 loss 0.3322 (w 0.2820 mse 0.2954 t 951 new 0.08) lr 1.00e-05 gnorm 0.162 3.14s mem 81.1GB +[2026-09-12 06:02:08] step 286/5000 loss 0.2903 (w 0.2797 mse 0.3064 t 411 new 0.22) lr 1.00e-05 gnorm 0.295 2.82s mem 81.1GB +[2026-09-12 06:02:11] step 287/5000 loss 0.4645 (w 0.3453 mse 0.3404 t 920 new 0.21) lr 1.00e-05 gnorm 0.281 2.82s mem 81.1GB +[2026-09-12 06:02:14] step 288/5000 loss 0.3020 (w 0.2103 mse 0.2298 t 683 new 0.23) lr 1.00e-05 gnorm 0.171 3.10s mem 81.1GB +[2026-09-12 06:02:17] step 289/5000 loss 0.4052 (w 0.3574 mse 0.3587 t 903 new 0.23) lr 1.00e-05 gnorm 0.177 3.36s mem 81.1GB +[2026-09-12 06:02:20] step 290/5000 loss 0.1024 (w 0.3671 mse 0.3674 t 937 new 0.24) lr 1.00e-05 gnorm 0.183 2.82s mem 81.1GB +[2026-09-12 06:02:23] step 291/5000 loss 0.3863 (w 0.2949 mse 0.3054 t 948 new 0.20) lr 1.00e-05 gnorm 0.159 3.12s mem 81.1GB +[2026-09-12 06:02:26] step 292/5000 loss 0.1858 (w 0.2599 mse 0.2807 t 945 new 0.25) lr 1.00e-05 gnorm 1.237 2.83s mem 81.1GB +[2026-09-12 06:02:29] step 293/5000 loss 0.4475 (w 0.3134 mse 0.3370 t 551 new 0.23) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +[2026-09-12 06:02:32] step 294/5000 loss 0.2815 (w 0.2518 mse 0.2771 t 955 new 0.14) lr 1.00e-05 gnorm 0.125 3.33s mem 81.1GB +[2026-09-12 06:02:35] step 295/5000 loss 0.2896 (w 0.3217 mse 0.3283 t 610 new 0.26) lr 1.00e-05 gnorm 0.156 3.31s mem 81.1GB +[2026-09-12 06:02:39] step 296/5000 loss 0.1518 (w 0.5041 mse 0.5202 t 997 new 0.17) lr 1.00e-05 gnorm 0.166 3.08s mem 81.1GB +[2026-09-12 06:02:41] step 297/5000 loss 0.3480 (w 0.4527 mse 0.4560 t 970 new 0.19) lr 1.00e-05 gnorm 0.218 2.82s mem 81.1GB +[2026-09-12 06:02:44] step 298/5000 loss 0.3550 (w 0.2692 mse 0.2951 t 861 new 0.22) lr 1.00e-05 gnorm 0.160 2.82s mem 81.1GB +[2026-09-12 06:02:47] step 299/5000 loss 0.3922 (w 0.3592 mse 0.3477 t 933 new 0.20) lr 1.00e-05 gnorm 0.173 2.82s mem 81.1GB +[2026-09-12 06:02:50] step 300/5000 loss 0.4232 (w 0.3539 mse 0.3521 t 732 new 0.18) lr 1.00e-05 gnorm 0.387 3.32s mem 81.1GB +[2026-09-12 06:02:54] step 301/5000 loss 0.2149 (w 0.4109 mse 0.4235 t 991 new 0.25) lr 1.00e-05 gnorm 0.292 3.29s mem 81.1GB +[2026-09-12 06:02:57] step 302/5000 loss 0.2898 (w 0.6982 mse 0.7025 t 177 new 0.22) lr 1.00e-05 gnorm 0.228 3.11s mem 81.1GB +[2026-09-12 06:03:00] step 303/5000 loss 0.4141 (w 0.2817 mse 0.2932 t 712 new 0.14) lr 1.00e-05 gnorm 0.187 2.82s mem 81.1GB +[2026-09-12 06:03:02] step 304/5000 loss 0.3898 (w 0.2664 mse 0.2742 t 762 new 0.16) lr 1.00e-05 gnorm 0.193 2.82s mem 81.1GB +[2026-09-12 06:03:05] step 305/5000 loss 0.3555 (w 0.2292 mse 0.2390 t 847 new 0.20) lr 1.00e-05 gnorm 0.177 2.82s mem 81.1GB +[2026-09-12 06:03:08] step 306/5000 loss 0.2794 (w 0.2546 mse 0.2691 t 962 new 0.25) lr 1.00e-05 gnorm 0.145 3.32s mem 81.1GB +[2026-09-12 06:03:12] step 307/5000 loss 0.2519 (w 0.3256 mse 0.3436 t 982 new 0.27) lr 1.00e-05 gnorm 0.204 3.26s mem 81.1GB +[2026-09-12 06:03:15] step 308/5000 loss 0.2259 (w 0.3374 mse 0.3380 t 936 new 0.20) lr 1.00e-05 gnorm 0.150 3.16s mem 81.1GB +[2026-09-12 06:03:18] step 309/5000 loss 0.1963 (w 0.4165 mse 0.4330 t 476 new 0.23) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +[2026-09-12 06:03:21] step 310/5000 loss 0.3470 (w 0.2857 mse 0.2853 t 835 new 0.18) lr 1.00e-05 gnorm 0.215 2.83s mem 81.1GB +[2026-09-12 06:03:24] step 311/5000 loss 0.4653 (w 0.4181 mse 0.4249 t 601 new 0.25) lr 1.00e-05 gnorm 0.174 3.13s mem 81.1GB +[2026-09-12 06:03:27] step 312/5000 loss 0.3850 (w 0.2883 mse 0.2959 t 665 new 0.22) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +[2026-09-12 06:03:30] step 313/5000 loss 0.5025 (w 0.3493 mse 0.3565 t 932 new 0.20) lr 1.00e-05 gnorm 0.164 3.29s mem 81.1GB +[2026-09-12 06:03:33] step 314/5000 loss 0.3145 (w 0.2769 mse 0.3119 t 836 new 0.25) lr 1.00e-05 gnorm 0.182 3.13s mem 81.1GB +[2026-09-12 06:03:36] step 315/5000 loss 0.3829 (w 0.5574 mse 0.5720 t 195 new 0.09) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +[2026-09-12 06:03:39] step 316/5000 loss 0.3518 (w 0.2736 mse 0.2864 t 764 new 0.20) lr 1.00e-05 gnorm 0.230 2.83s mem 81.1GB +[2026-09-12 06:03:42] step 317/5000 loss 0.3178 (w 0.3072 mse 0.3111 t 979 new 0.23) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +[2026-09-12 06:03:45] step 318/5000 loss 0.1647 (w 0.2844 mse 0.2856 t 897 new 0.26) lr 1.00e-05 gnorm 0.175 3.07s mem 81.1GB +[2026-09-12 06:03:49] step 319/5000 loss 0.2991 (w 0.3160 mse 0.3227 t 821 new 0.21) lr 1.00e-05 gnorm 0.137 3.39s mem 81.1GB +[2026-09-12 06:03:51] step 320/5000 loss 0.2515 (w 0.3969 mse 0.3991 t 918 new 0.18) lr 1.00e-05 gnorm 0.139 2.82s mem 81.1GB +[2026-09-12 06:03:54] step 321/5000 loss 0.2136 (w 0.3259 mse 0.3366 t 983 new 0.22) lr 1.00e-05 gnorm 0.183 2.82s mem 81.1GB +[2026-09-12 06:03:57] step 322/5000 loss 0.2633 (w 0.2167 mse 0.2389 t 977 new 0.19) lr 1.00e-05 gnorm 0.548 2.83s mem 81.1GB +[2026-09-12 06:04:00] step 323/5000 loss 0.2356 (w 0.3138 mse 0.3459 t 999 new 0.18) lr 1.00e-05 gnorm 0.153 3.09s mem 81.1GB +[2026-09-12 06:04:03] step 324/5000 loss 0.2618 (w 0.4141 mse 0.4260 t 997 new 0.16) lr 1.00e-05 gnorm 0.167 3.37s mem 81.1GB +[2026-09-12 06:04:07] step 325/5000 loss 0.1177 (w 0.4700 mse 0.4755 t 998 new 0.24) lr 1.00e-05 gnorm 0.364 3.14s mem 81.1GB +[2026-09-12 06:04:09] step 326/5000 loss 0.4344 (w 0.3878 mse 0.3805 t 983 new 0.22) lr 1.00e-05 gnorm 0.172 2.82s mem 81.1GB +[2026-09-12 06:04:12] step 327/5000 loss 0.2633 (w 0.3765 mse 0.3808 t 943 new 0.13) lr 1.00e-05 gnorm 0.252 2.84s mem 81.1GB +[2026-09-12 06:04:15] step 328/5000 loss 0.3651 (w 0.3293 mse 0.3317 t 986 new 0.21) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +[2026-09-12 06:04:18] step 329/5000 loss 0.3013 (w 0.5496 mse 0.5170 t 967 new 0.22) lr 1.00e-05 gnorm 0.231 3.14s mem 81.1GB +[2026-09-12 06:04:22] step 330/5000 loss 0.1724 (w 0.3037 mse 0.3258 t 974 new 0.26) lr 1.00e-05 gnorm 0.167 3.35s mem 81.1GB +[2026-09-12 06:04:25] step 331/5000 loss 0.5060 (w 0.3276 mse 0.3273 t 891 new 0.18) lr 1.00e-05 gnorm 1.074 3.33s mem 81.1GB +[2026-09-12 06:04:28] step 332/5000 loss 0.1936 (w 0.2597 mse 0.2725 t 951 new 0.19) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +[2026-09-12 06:04:31] step 333/5000 loss 0.3850 (w 0.2043 mse 0.2289 t 843 new 0.23) lr 1.00e-05 gnorm 0.175 2.85s mem 81.1GB +[2026-09-12 06:04:33] step 334/5000 loss 0.1744 (w 0.4373 mse 0.4268 t 991 new 0.23) lr 1.00e-05 gnorm 0.185 2.83s mem 81.1GB +[2026-09-12 06:04:37] step 335/5000 loss 0.4109 (w 0.3465 mse 0.3409 t 720 new 0.20) lr 1.00e-05 gnorm 0.155 3.08s mem 81.1GB +[2026-09-12 06:04:40] step 336/5000 loss 0.3131 (w 0.2431 mse 0.2726 t 973 new 0.24) lr 1.00e-05 gnorm 0.149 3.37s mem 81.1GB +[2026-09-12 06:04:43] step 337/5000 loss 0.3755 (w 0.4428 mse 0.4424 t 356 new 0.19) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-12 06:04:46] step 338/5000 loss 0.1054 (w 0.2276 mse 0.2519 t 973 new 0.19) lr 1.00e-05 gnorm 3.020 2.83s mem 81.1GB +[2026-09-12 06:04:49] step 339/5000 loss 0.3236 (w 0.3320 mse 0.3389 t 931 new 0.23) lr 1.00e-05 gnorm 0.176 2.82s mem 81.1GB +[2026-09-12 06:04:52] step 340/5000 loss 0.3642 (w 0.3721 mse 0.3755 t 984 new 0.08) lr 1.00e-05 gnorm 0.373 2.83s mem 81.1GB +[2026-09-12 06:04:55] step 341/5000 loss 0.4861 (w 0.3321 mse 0.3359 t 779 new 0.27) lr 1.00e-05 gnorm 0.165 3.35s mem 81.1GB +[2026-09-12 06:04:58] step 342/5000 loss 0.1535 (w 0.2992 mse 0.3020 t 996 new 0.25) lr 1.00e-05 gnorm 0.159 3.08s mem 81.1GB +[2026-09-12 06:05:01] step 343/5000 loss 0.3613 (w 0.3172 mse 0.3343 t 809 new 0.18) lr 1.00e-05 gnorm 0.187 3.10s mem 81.1GB +[2026-09-12 06:05:04] step 344/5000 loss 0.2869 (w 0.3325 mse 0.3311 t 944 new 0.29) lr 1.00e-05 gnorm 0.181 2.82s mem 81.1GB +[2026-09-12 06:05:07] step 345/5000 loss 0.3504 (w 0.3773 mse 0.3865 t 495 new 0.23) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +[2026-09-12 06:05:10] step 346/5000 loss 0.5498 (w 0.3107 mse 0.3255 t 586 new 0.27) lr 1.00e-05 gnorm 0.194 3.04s mem 81.1GB +[2026-09-12 06:05:13] step 347/5000 loss 0.3144 (w 0.2628 mse 0.2913 t 889 new 0.20) lr 1.00e-05 gnorm 0.178 3.04s mem 81.1GB +[2026-09-12 06:05:16] step 348/5000 loss 0.2547 (w 0.3370 mse 0.3354 t 964 new 0.21) lr 1.00e-05 gnorm 0.597 3.38s mem 81.1GB +[2026-09-12 06:05:19] step 349/5000 loss 0.5124 (w 0.3135 mse 0.3291 t 737 new 0.24) lr 1.00e-05 gnorm 0.180 3.16s mem 81.1GB +[2026-09-12 06:05:22] step 350/5000 loss 0.4154 (w 0.4239 mse 0.4195 t 983 new 0.24) lr 1.00e-05 gnorm 0.195 2.82s mem 81.1GB +[2026-09-12 06:05:25] step 351/5000 loss 0.5759 (w 0.2879 mse 0.2963 t 843 new 0.26) lr 1.00e-05 gnorm 0.206 2.82s mem 81.1GB +[2026-09-12 06:05:28] step 352/5000 loss 0.3441 (w 0.2218 mse 0.2438 t 930 new 0.26) lr 1.00e-05 gnorm 3.308 3.06s mem 81.1GB +[2026-09-12 06:05:31] step 353/5000 loss 0.2502 (w 0.4330 mse 0.4380 t 974 new 0.17) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +[2026-09-12 06:05:35] step 354/5000 loss 0.4098 (w 0.2707 mse 0.2826 t 568 new 0.23) lr 1.00e-05 gnorm 0.202 3.33s mem 81.1GB +[2026-09-12 06:05:37] step 355/5000 loss 0.3402 (w 0.3094 mse 0.3145 t 920 new 0.23) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +[2026-09-12 06:05:40] step 356/5000 loss 0.3361 (w 0.3833 mse 0.3750 t 903 new 0.27) lr 1.00e-05 gnorm 0.204 2.84s mem 81.1GB +[2026-09-12 06:05:43] step 357/5000 loss 0.2233 (w 0.2209 mse 0.2330 t 779 new 0.12) lr 1.00e-05 gnorm 0.215 2.84s mem 81.1GB +[2026-09-12 06:05:46] step 358/5000 loss 0.4013 (w 0.3567 mse 0.3480 t 922 new 0.17) lr 1.00e-05 gnorm 0.223 3.09s mem 81.1GB +[2026-09-12 06:05:49] step 359/5000 loss 0.3173 (w 0.2266 mse 0.2447 t 609 new 0.26) lr 1.00e-05 gnorm 0.382 3.12s mem 81.1GB +[2026-09-12 06:05:52] step 360/5000 loss 0.1801 (w 0.2685 mse 0.2725 t 784 new 0.25) lr 1.00e-05 gnorm 0.175 3.10s mem 81.1GB +[2026-09-12 06:05:55] step 361/5000 loss 0.3930 (w 0.3077 mse 0.3152 t 739 new 0.22) lr 1.00e-05 gnorm 0.176 2.83s mem 81.1GB +[2026-09-12 06:05:58] step 362/5000 loss 0.2806 (w 0.3148 mse 0.3174 t 774 new 0.23) lr 1.00e-05 gnorm 0.147 2.82s mem 81.1GB +[2026-09-12 06:06:01] step 363/5000 loss 0.3165 (w 0.2437 mse 0.2560 t 925 new 0.24) lr 1.00e-05 gnorm 0.135 2.82s mem 81.1GB +[2026-09-12 06:06:04] step 364/5000 loss 0.4408 (w 0.3086 mse 0.3089 t 705 new 0.17) lr 1.00e-05 gnorm 0.184 3.05s mem 81.1GB +[2026-09-12 06:06:07] step 365/5000 loss 0.4513 (w 0.4230 mse 0.4259 t 428 new 0.21) lr 1.00e-05 gnorm 0.465 3.42s mem 81.1GB +[2026-09-12 06:06:11] step 366/5000 loss 0.3159 (w 0.2913 mse 0.3027 t 951 new 0.24) lr 1.00e-05 gnorm 0.168 3.42s mem 81.1GB +[2026-09-12 06:06:14] step 367/5000 loss 0.3348 (w 0.2355 mse 0.2468 t 660 new 0.17) lr 1.00e-05 gnorm 0.267 2.82s mem 81.1GB +[2026-09-12 06:06:16] step 368/5000 loss 0.1243 (w 0.3160 mse 0.3181 t 952 new 0.20) lr 1.00e-05 gnorm 0.184 2.83s mem 81.1GB +[2026-09-12 06:06:19] step 369/5000 loss 0.3334 (w 0.2167 mse 0.2270 t 687 new 0.22) lr 1.00e-05 gnorm 0.177 2.82s mem 81.1GB +[2026-09-12 06:06:22] step 370/5000 loss 0.2351 (w 0.3600 mse 0.3532 t 953 new 0.17) lr 1.00e-05 gnorm 0.196 3.11s mem 81.1GB +[2026-09-12 06:06:26] step 371/5000 loss 0.3999 (w 0.3014 mse 0.2902 t 852 new 0.22) lr 1.00e-05 gnorm 0.162 3.37s mem 81.1GB +[2026-09-12 06:06:29] step 372/5000 loss 0.3723 (w 0.4534 mse 0.4402 t 954 new 0.17) lr 1.00e-05 gnorm 0.126 3.14s mem 81.1GB +[2026-09-12 06:06:32] step 373/5000 loss 0.1594 (w 0.3140 mse 0.3267 t 925 new 0.24) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +[2026-09-12 06:06:35] step 374/5000 loss 0.2314 (w 0.3394 mse 0.3493 t 817 new 0.20) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +[2026-09-12 06:06:37] step 375/5000 loss 0.1348 (w 0.3383 mse 0.3403 t 976 new 0.10) lr 1.00e-05 gnorm 0.161 2.82s mem 81.1GB +[2026-09-12 06:06:40] step 376/5000 loss 0.3711 (w 0.4223 mse 0.4178 t 894 new 0.22) lr 1.00e-05 gnorm 0.248 3.07s mem 81.1GB +[2026-09-12 06:06:44] step 377/5000 loss 0.4951 (w 0.6172 mse 0.6192 t 165 new 0.21) lr 1.00e-05 gnorm 0.203 3.42s mem 81.1GB +[2026-09-12 06:06:47] step 378/5000 loss 0.2762 (w 0.3405 mse 0.3458 t 854 new 0.14) lr 1.00e-05 gnorm 0.382 3.08s mem 81.1GB +[2026-09-12 06:06:50] step 379/5000 loss 0.1904 (w 0.3480 mse 0.3560 t 945 new 0.25) lr 1.00e-05 gnorm 0.148 2.83s mem 81.1GB +[2026-09-12 06:06:53] step 380/5000 loss 0.3280 (w 0.2898 mse 0.3035 t 981 new 0.25) lr 1.00e-05 gnorm 0.214 2.82s mem 81.1GB +[2026-09-12 06:06:55] step 381/5000 loss 0.4456 (w 0.4423 mse 0.4451 t 955 new 0.18) lr 1.00e-05 gnorm 0.423 2.83s mem 81.1GB +[2026-09-12 06:06:59] step 382/5000 loss 0.3640 (w 0.2611 mse 0.2636 t 663 new 0.23) lr 1.00e-05 gnorm 0.182 3.37s mem 81.1GB +[2026-09-12 06:07:02] step 383/5000 loss 0.2831 (w 0.2773 mse 0.2903 t 709 new 0.24) lr 1.00e-05 gnorm 0.222 3.44s mem 81.1GB +[2026-09-12 06:07:05] step 384/5000 loss 0.3541 (w 0.2917 mse 0.3165 t 470 new 0.24) lr 1.00e-05 gnorm 0.835 2.84s mem 81.1GB +[2026-09-12 06:07:08] step 385/5000 loss 0.3558 (w 0.2249 mse 0.2432 t 914 new 0.16) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +[2026-09-12 06:07:11] step 386/5000 loss 0.3584 (w 0.3088 mse 0.3324 t 944 new 0.20) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-12 06:07:14] step 387/5000 loss 0.4072 (w 0.2279 mse 0.2477 t 673 new 0.29) lr 1.00e-05 gnorm 0.169 3.06s mem 81.1GB +[2026-09-12 06:07:17] step 388/5000 loss 0.2541 (w 0.2260 mse 0.2389 t 819 new 0.24) lr 1.00e-05 gnorm 0.232 3.09s mem 81.1GB +[2026-09-12 06:07:20] step 389/5000 loss 0.2728 (w 0.2733 mse 0.2948 t 979 new 0.14) lr 1.00e-05 gnorm 0.163 3.39s mem 81.1GB +[2026-09-12 06:07:23] step 390/5000 loss 0.1885 (w 0.2724 mse 0.2925 t 838 new 0.11) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +[2026-09-12 06:07:26] step 391/5000 loss 0.5033 (w 0.2658 mse 0.2730 t 902 new 0.09) lr 1.00e-05 gnorm 0.399 2.82s mem 81.1GB +[2026-09-12 06:07:29] step 392/5000 loss 0.2969 (w 0.3901 mse 0.4014 t 977 new 0.21) lr 1.00e-05 gnorm 0.238 2.82s mem 81.1GB +[2026-09-12 06:07:32] step 393/5000 loss 0.3902 (w 0.5160 mse 0.5300 t 274 new 0.25) lr 1.00e-05 gnorm 0.156 3.09s mem 81.1GB +[2026-09-12 06:07:35] step 394/5000 loss 0.2786 (w 0.3654 mse 0.3735 t 634 new 0.24) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +[2026-09-12 06:07:39] step 395/5000 loss 0.3215 (w 0.3741 mse 0.3931 t 993 new 0.24) lr 1.00e-05 gnorm 0.243 3.36s mem 81.1GB +[2026-09-12 06:07:41] step 396/5000 loss 0.4669 (w 0.3479 mse 0.3682 t 997 new 0.21) lr 1.00e-05 gnorm 0.285 2.84s mem 81.1GB +[2026-09-12 06:07:44] step 397/5000 loss 0.3284 (w 0.3902 mse 0.3977 t 925 new 0.21) lr 1.00e-05 gnorm 0.300 2.83s mem 81.1GB +[2026-09-12 06:07:47] step 398/5000 loss 0.4346 (w 0.3156 mse 0.3230 t 503 new 0.16) lr 1.00e-05 gnorm 0.197 2.84s mem 81.1GB +[2026-09-12 06:07:50] step 399/5000 loss 0.2709 (w 0.2264 mse 0.2453 t 629 new 0.29) lr 1.00e-05 gnorm 0.156 3.14s mem 81.1GB +[2026-09-12 06:07:53] step 400/5000 loss 0.2836 (w 0.2603 mse 0.2797 t 849 new 0.19) lr 1.00e-05 gnorm 0.189 3.12s mem 81.1GB +[2026-09-12 06:07:57] step 401/5000 loss 0.4054 (w 0.3876 mse 0.3917 t 853 new 0.11) lr 1.00e-05 gnorm 0.193 3.14s mem 81.1GB +[2026-09-12 06:07:59] step 402/5000 loss 0.4200 (w 0.4231 mse 0.4156 t 991 new 0.26) lr 1.00e-05 gnorm 0.198 2.83s mem 81.1GB +[2026-09-12 06:08:02] step 403/5000 loss 0.2301 (w 0.2219 mse 0.2358 t 721 new 0.17) lr 1.00e-05 gnorm 0.192 2.82s mem 81.1GB +[2026-09-12 06:08:05] step 404/5000 loss 0.3520 (w 0.1784 mse 0.2123 t 687 new 0.24) lr 1.00e-05 gnorm 0.338 2.83s mem 81.1GB +[2026-09-12 06:08:08] step 405/5000 loss 0.2661 (w 0.2314 mse 0.2467 t 910 new 0.18) lr 1.00e-05 gnorm 0.144 3.04s mem 81.1GB +[2026-09-12 06:08:12] step 406/5000 loss 0.3041 (w 0.3258 mse 0.3295 t 925 new 0.12) lr 1.00e-05 gnorm 0.200 3.41s mem 81.1GB +[2026-09-12 06:08:15] step 407/5000 loss 0.2033 (w 0.3416 mse 0.3358 t 969 new 0.26) lr 1.00e-05 gnorm 0.183 3.07s mem 81.1GB +[2026-09-12 06:08:17] step 408/5000 loss 0.2565 (w 0.2417 mse 0.2661 t 887 new 0.16) lr 1.00e-05 gnorm 0.466 2.82s mem 81.1GB +[2026-09-12 06:08:20] step 409/5000 loss 0.3748 (w 0.2883 mse 0.2991 t 742 new 0.27) lr 1.00e-05 gnorm 0.179 2.83s mem 81.1GB +[2026-09-12 06:08:23] step 410/5000 loss 0.3304 (w 0.2684 mse 0.2799 t 940 new 0.16) lr 1.00e-05 gnorm 0.210 2.82s mem 81.1GB +[2026-09-12 06:08:26] step 411/5000 loss 0.3987 (w 0.3438 mse 0.3543 t 725 new 0.24) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +[2026-09-12 06:08:30] step 412/5000 loss 0.2136 (w 0.2494 mse 0.2584 t 990 new 0.15) lr 1.00e-05 gnorm 0.139 3.45s mem 81.1GB +[2026-09-12 06:08:32] step 413/5000 loss 0.2355 (w 0.7515 mse 0.7489 t 999 new 0.23) lr 1.00e-05 gnorm 0.169 2.84s mem 81.1GB +[2026-09-12 06:08:35] step 414/5000 loss 0.3895 (w 0.2340 mse 0.2641 t 932 new 0.20) lr 1.00e-05 gnorm 0.517 2.83s mem 81.1GB +[2026-09-12 06:08:38] step 415/5000 loss 0.3817 (w 0.2912 mse 0.3103 t 817 new 0.17) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +[2026-09-12 06:08:41] step 416/5000 loss 0.5178 (w 0.3844 mse 0.3871 t 961 new 0.15) lr 1.00e-05 gnorm 0.172 2.82s mem 81.1GB +[2026-09-12 06:08:44] step 417/5000 loss 0.3957 (w 0.3545 mse 0.3523 t 594 new 0.23) lr 1.00e-05 gnorm 0.302 3.08s mem 81.1GB +[2026-09-12 06:08:48] step 418/5000 loss 0.2613 (w 0.3495 mse 0.3654 t 971 new 0.25) lr 1.00e-05 gnorm 0.120 3.36s mem 81.1GB +[2026-09-12 06:08:50] step 419/5000 loss 0.3014 (w 0.2712 mse 0.2886 t 948 new 0.23) lr 1.00e-05 gnorm 0.303 2.82s mem 81.1GB +[2026-09-12 06:08:53] step 420/5000 loss 0.2332 (w 0.2255 mse 0.2518 t 692 new 0.17) lr 1.00e-05 gnorm 0.554 2.82s mem 81.1GB +[2026-09-12 06:08:56] step 421/5000 loss 0.2334 (w 0.1927 mse 0.2161 t 557 new 0.19) lr 1.00e-05 gnorm 0.138 2.82s mem 81.1GB +[2026-09-12 06:08:59] step 422/5000 loss 0.4305 (w 0.2253 mse 0.2346 t 813 new 0.23) lr 1.00e-05 gnorm 0.174 3.05s mem 81.1GB +[2026-09-12 06:09:02] step 423/5000 loss 0.3121 (w 0.2877 mse 0.2946 t 931 new 0.18) lr 1.00e-05 gnorm 0.279 3.08s mem 81.1GB +[2026-09-12 06:09:06] step 424/5000 loss 0.3047 (w 0.3583 mse 0.3648 t 835 new 0.25) lr 1.00e-05 gnorm 0.154 3.42s mem 81.1GB +[2026-09-12 06:09:09] step 425/5000 loss 0.4496 (w 0.3124 mse 0.3184 t 794 new 0.26) lr 1.00e-05 gnorm 0.254 3.14s mem 81.1GB +[2026-09-12 06:09:12] step 426/5000 loss 0.2542 (w 0.2050 mse 0.2125 t 672 new 0.24) lr 1.00e-05 gnorm 0.150 2.83s mem 81.1GB +[2026-09-12 06:09:14] step 427/5000 loss 0.3520 (w 0.3139 mse 0.3289 t 715 new 0.23) lr 1.00e-05 gnorm 0.263 2.83s mem 81.1GB +[2026-09-12 06:09:18] step 428/5000 loss 0.1996 (w 0.5265 mse 0.5145 t 978 new 0.18) lr 1.00e-05 gnorm 0.251 3.14s mem 81.1GB +[2026-09-12 06:09:21] step 429/5000 loss 0.4830 (w 0.3733 mse 0.4004 t 995 new 0.13) lr 1.00e-05 gnorm 0.206 3.29s mem 81.1GB +[2026-09-12 06:09:24] step 430/5000 loss 0.2986 (w 0.2434 mse 0.2581 t 935 new 0.17) lr 1.00e-05 gnorm 0.164 3.32s mem 81.1GB +[2026-09-12 06:09:27] step 431/5000 loss 0.3435 (w 0.3739 mse 0.3715 t 890 new 0.21) lr 1.00e-05 gnorm 0.272 2.83s mem 81.1GB +[2026-09-12 06:09:30] step 432/5000 loss 0.3342 (w 0.2243 mse 0.2293 t 822 new 0.16) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +[2026-09-12 06:09:33] step 433/5000 loss 0.2426 (w 0.2751 mse 0.2723 t 783 new 0.17) lr 1.00e-05 gnorm 0.399 2.83s mem 81.1GB +[2026-09-12 06:09:36] step 434/5000 loss 0.2455 (w 0.2104 mse 0.2425 t 932 new 0.23) lr 1.00e-05 gnorm 0.158 3.14s mem 81.1GB +[2026-09-12 06:09:39] step 435/5000 loss 0.2822 (w 0.3714 mse 0.3785 t 586 new 0.22) lr 1.00e-05 gnorm 0.118 3.24s mem 81.1GB +[2026-09-12 06:09:42] step 436/5000 loss 0.4364 (w 0.2525 mse 0.2679 t 830 new 0.13) lr 1.00e-05 gnorm 0.164 3.35s mem 81.1GB +[2026-09-12 06:09:45] step 437/5000 loss 0.2349 (w 0.3301 mse 0.3206 t 803 new 0.22) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +[2026-09-12 06:09:48] step 438/5000 loss 0.2056 (w 0.2967 mse 0.3160 t 450 new 0.21) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +[2026-09-12 06:09:51] step 439/5000 loss 0.1507 (w 0.2766 mse 0.2895 t 997 new 0.22) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +[2026-09-12 06:09:54] step 440/5000 loss 0.4075 (w 0.3153 mse 0.3309 t 977 new 0.24) lr 1.00e-05 gnorm 0.296 3.05s mem 81.1GB +[2026-09-12 06:09:57] step 441/5000 loss 0.2865 (w 0.3626 mse 0.3700 t 614 new 0.25) lr 1.00e-05 gnorm 0.151 3.32s mem 81.1GB +[2026-09-12 06:10:00] step 442/5000 loss 0.3266 (w 0.1763 mse 0.1924 t 790 new 0.22) lr 1.00e-05 gnorm 0.173 3.08s mem 81.1GB +[2026-09-12 06:10:03] step 443/5000 loss 0.2603 (w 0.2670 mse 0.2716 t 935 new 0.14) lr 1.00e-05 gnorm 0.234 2.82s mem 81.1GB +[2026-09-12 06:10:06] step 444/5000 loss 0.3254 (w 0.3598 mse 0.3596 t 601 new 0.21) lr 1.00e-05 gnorm 0.859 2.82s mem 81.1GB +[2026-09-12 06:10:09] step 445/5000 loss 0.3128 (w 0.3000 mse 0.3073 t 836 new 0.18) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +[2026-09-12 06:10:12] step 446/5000 loss 0.3146 (w 0.3303 mse 0.3408 t 798 new 0.23) lr 1.00e-05 gnorm 0.138 3.11s mem 81.1GB +[2026-09-12 06:10:15] step 447/5000 loss 0.1973 (w 0.2010 mse 0.2124 t 929 new 0.20) lr 1.00e-05 gnorm 0.152 3.32s mem 81.1GB +[2026-09-12 06:10:18] step 448/5000 loss 0.4745 (w 0.3716 mse 0.3705 t 605 new 0.23) lr 1.00e-05 gnorm 0.190 3.10s mem 81.1GB +[2026-09-12 06:10:21] step 449/5000 loss 0.3783 (w 0.2565 mse 0.2605 t 924 new 0.16) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +[2026-09-12 06:10:24] step 450/5000 loss 0.3885 (w 0.3162 mse 0.3264 t 728 new 0.28) lr 1.00e-05 gnorm 0.887 2.83s mem 81.1GB +[2026-09-12 06:10:27] step 451/5000 loss 0.4468 (w 0.2128 mse 0.2450 t 969 new 0.20) lr 1.00e-05 gnorm 1.301 3.06s mem 81.1GB +[2026-09-12 06:10:30] step 452/5000 loss 0.4201 (w 0.2367 mse 0.2713 t 650 new 0.24) lr 1.00e-05 gnorm 0.181 3.01s mem 81.1GB +[2026-09-12 06:10:33] step 453/5000 loss 0.3023 (w 0.2625 mse 0.2744 t 741 new 0.16) lr 1.00e-05 gnorm 0.172 3.31s mem 81.1GB +[2026-09-12 06:10:36] step 454/5000 loss 0.2672 (w 0.1427 mse 0.1702 t 885 new 0.19) lr 1.00e-05 gnorm 0.177 3.02s mem 81.1GB +[2026-09-12 06:10:39] step 455/5000 loss 0.2794 (w 0.3111 mse 0.3260 t 732 new 0.15) lr 1.00e-05 gnorm 0.141 2.82s mem 81.1GB +[2026-09-12 06:10:42] step 456/5000 loss 0.4213 (w 0.3116 mse 0.3259 t 528 new 0.26) lr 1.00e-05 gnorm 0.213 2.82s mem 81.1GB +[2026-09-12 06:10:45] step 457/5000 loss 0.3749 (w 0.3147 mse 0.3478 t 982 new 0.21) lr 1.00e-05 gnorm 0.221 3.05s mem 81.1GB +[2026-09-12 06:10:48] step 458/5000 loss 0.3604 (w 0.3266 mse 0.3282 t 878 new 0.23) lr 1.00e-05 gnorm 0.200 3.00s mem 81.1GB +[2026-09-12 06:10:51] step 459/5000 loss 0.2608 (w 0.2111 mse 0.2149 t 754 new 0.12) lr 1.00e-05 gnorm 0.133 3.08s mem 81.1GB +[2026-09-12 06:10:54] step 460/5000 loss 0.2718 (w 0.2704 mse 0.2901 t 865 new 0.24) lr 1.00e-05 gnorm 0.338 3.06s mem 81.1GB +[2026-09-12 06:10:57] step 461/5000 loss 0.2998 (w 0.5690 mse 0.5739 t 990 new 0.20) lr 1.00e-05 gnorm 0.221 2.82s mem 81.1GB +[2026-09-12 06:11:00] step 462/5000 loss 0.5441 (w 0.3487 mse 0.3555 t 964 new 0.24) lr 1.00e-05 gnorm 0.179 2.81s mem 81.1GB +[2026-09-12 06:11:03] step 463/5000 loss 0.2259 (w 0.4699 mse 0.4653 t 959 new 0.18) lr 1.00e-05 gnorm 0.166 3.06s mem 81.1GB +[2026-09-12 06:11:06] step 464/5000 loss 0.2414 (w 0.5578 mse 0.5642 t 120 new 0.27) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +[2026-09-12 06:11:09] step 465/5000 loss 0.4657 (w 0.2065 mse 0.2275 t 774 new 0.23) lr 1.00e-05 gnorm 0.145 3.34s mem 81.1GB +[2026-09-12 06:11:12] step 466/5000 loss 0.3492 (w 0.2069 mse 0.2309 t 936 new 0.20) lr 1.00e-05 gnorm 0.162 3.02s mem 81.1GB +[2026-09-12 06:11:15] step 467/5000 loss 0.2141 (w 0.3898 mse 0.3802 t 938 new 0.24) lr 1.00e-05 gnorm 0.721 2.83s mem 81.1GB +[2026-09-12 06:11:18] step 468/5000 loss 0.4458 (w 0.4188 mse 0.4309 t 332 new 0.24) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +[2026-09-12 06:11:21] step 469/5000 loss 0.2129 (w 0.2191 mse 0.2391 t 871 new 0.19) lr 1.00e-05 gnorm 0.179 3.13s mem 81.1GB +[2026-09-12 06:11:24] step 470/5000 loss 0.1951 (w 0.3045 mse 0.3045 t 941 new 0.23) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +[2026-09-12 06:11:28] step 471/5000 loss 0.4009 (w 0.2168 mse 0.2310 t 914 new 0.12) lr 1.00e-05 gnorm 0.171 3.28s mem 81.1GB +[2026-09-12 06:11:31] step 472/5000 loss 0.3753 (w 0.6930 mse 0.6949 t 189 new 0.20) lr 1.00e-05 gnorm 0.196 3.01s mem 81.1GB +[2026-09-12 06:11:34] step 473/5000 loss 0.3737 (w 0.2355 mse 0.2521 t 864 new 0.21) lr 1.00e-05 gnorm 0.322 2.83s mem 81.1GB +[2026-09-12 06:11:36] step 474/5000 loss 0.3262 (w 0.2156 mse 0.2424 t 386 new 0.17) lr 1.00e-05 gnorm 0.302 2.83s mem 81.1GB +[2026-09-12 06:11:39] step 475/5000 loss 0.3644 (w 0.3268 mse 0.3422 t 985 new 0.22) lr 1.00e-05 gnorm 0.243 3.07s mem 81.1GB +[2026-09-12 06:11:43] step 476/5000 loss 0.4472 (w 0.3694 mse 0.3629 t 492 new 0.20) lr 1.00e-05 gnorm 0.222 3.28s mem 81.1GB +[2026-09-12 06:11:46] step 477/5000 loss 0.2897 (w 0.3504 mse 0.3602 t 310 new 0.07) lr 1.00e-05 gnorm 0.114 3.26s mem 81.1GB +[2026-09-12 06:11:49] step 478/5000 loss 0.2387 (w 0.2978 mse 0.3174 t 975 new 0.22) lr 1.00e-05 gnorm 0.139 3.01s mem 81.1GB +[2026-09-12 06:11:52] step 479/5000 loss 0.2416 (w 0.2462 mse 0.2556 t 942 new 0.10) lr 1.00e-05 gnorm 0.251 2.82s mem 81.1GB +[2026-09-12 06:11:55] step 480/5000 loss 0.3268 (w 0.3022 mse 0.3067 t 871 new 0.17) lr 1.00e-05 gnorm 0.186 2.83s mem 81.1GB +[2026-09-12 06:11:58] step 481/5000 loss 0.4240 (w 0.3366 mse 0.3335 t 915 new 0.26) lr 1.00e-05 gnorm 0.184 3.08s mem 81.1GB +[2026-09-12 06:12:01] step 482/5000 loss 0.4523 (w 0.2185 mse 0.2350 t 811 new 0.13) lr 1.00e-05 gnorm 3.163 3.10s mem 81.1GB +[2026-09-12 06:12:04] step 483/5000 loss 0.2629 (w 0.3587 mse 0.3966 t 997 new 0.19) lr 1.00e-05 gnorm 0.131 3.26s mem 81.1GB +[2026-09-12 06:12:07] step 484/5000 loss 0.2507 (w 0.1827 mse 0.2152 t 809 new 0.22) lr 1.00e-05 gnorm 0.149 3.01s mem 81.1GB +[2026-09-12 06:12:10] step 485/5000 loss 0.3583 (w 0.2847 mse 0.2878 t 925 new 0.24) lr 1.00e-05 gnorm 0.508 2.83s mem 81.1GB +[2026-09-12 06:12:13] step 486/5000 loss 0.2352 (w 0.2614 mse 0.2660 t 930 new 0.14) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +[2026-09-12 06:12:16] step 487/5000 loss 0.1547 (w 0.2914 mse 0.3028 t 905 new 0.22) lr 1.00e-05 gnorm 0.136 3.31s mem 81.1GB +[2026-09-12 06:12:19] step 488/5000 loss 0.3275 (w 0.3496 mse 0.3508 t 864 new 0.24) lr 1.00e-05 gnorm 0.190 3.08s mem 81.1GB +[2026-09-12 06:12:23] step 489/5000 loss 0.1836 (w 0.3610 mse 0.3688 t 909 new 0.14) lr 1.00e-05 gnorm 0.175 3.36s mem 81.1GB +[2026-09-12 06:12:26] step 490/5000 loss 0.2249 (w 0.3610 mse 0.3685 t 989 new 0.17) lr 1.00e-05 gnorm 0.169 3.02s mem 81.1GB +[2026-09-12 06:12:28] step 491/5000 loss 0.2772 (w 0.2564 mse 0.2815 t 892 new 0.19) lr 1.00e-05 gnorm 0.176 2.82s mem 81.1GB +[2026-09-12 06:12:31] step 492/5000 loss 0.3598 (w 0.6867 mse 0.6851 t 153 new 0.20) lr 1.00e-05 gnorm 0.162 3.07s mem 81.1GB +[2026-09-12 06:12:34] step 493/5000 loss 0.3368 (w 0.3054 mse 0.3177 t 970 new 0.16) lr 1.00e-05 gnorm 0.137 3.03s mem 81.1GB +[2026-09-12 06:12:38] step 494/5000 loss 0.2226 (w 0.3329 mse 0.3379 t 699 new 0.24) lr 1.00e-05 gnorm 0.161 3.31s mem 81.1GB +[2026-09-12 06:12:41] step 495/5000 loss 0.2829 (w 0.2699 mse 0.2695 t 857 new 0.23) lr 1.00e-05 gnorm 0.173 3.30s mem 81.1GB +[2026-09-12 06:12:44] step 496/5000 loss 0.1517 (w 0.3294 mse 0.3393 t 950 new 0.23) lr 1.00e-05 gnorm 0.580 2.83s mem 81.1GB +[2026-09-12 06:12:47] step 497/5000 loss 0.1649 (w 0.2897 mse 0.3018 t 771 new 0.26) lr 1.00e-05 gnorm 0.227 2.83s mem 81.1GB +[2026-09-12 06:12:50] step 498/5000 loss 0.1263 (w 0.3464 mse 0.3383 t 953 new 0.17) lr 1.00e-05 gnorm 0.156 3.06s mem 81.1GB +[2026-09-12 06:12:53] step 499/5000 loss 0.3102 (w 0.3231 mse 0.3236 t 809 new 0.17) lr 1.00e-05 gnorm 0.155 3.08s mem 81.1GB +[2026-09-12 06:12:56] step 500/5000 loss 0.3408 (w 0.2270 mse 0.2407 t 692 new 0.16) lr 1.00e-05 gnorm 0.280 3.29s mem 81.1GB +[2026-09-12 06:12:59] [val] step 500 t=200: w=0.4996 mse=0.5183 (n=16) t=500: w=0.3024 mse=0.3181 (n=16) t=800: w=0.2550 mse=0.2678 (n=16) | mean w=0.3523 mse=0.3681 3s +[2026-09-12 06:13:47] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step500.safetensors 4093 个张量 37.98 GB +[2026-09-12 06:13:52] step 501/5000 loss 0.3460 (w 0.2647 mse 0.2777 t 631 new 0.08) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +[2026-09-12 06:13:55] step 502/5000 loss 0.1841 (w 0.3146 mse 0.3183 t 979 new 0.23) lr 1.00e-05 gnorm 0.144 2.81s mem 81.1GB +[2026-09-12 06:13:58] step 503/5000 loss 0.2477 (w 0.2769 mse 0.2829 t 900 new 0.13) lr 1.00e-05 gnorm 0.240 2.82s mem 81.1GB +[2026-09-12 06:14:01] step 504/5000 loss 0.3876 (w 0.3854 mse 0.3883 t 676 new 0.20) lr 1.00e-05 gnorm 0.158 3.07s mem 81.1GB +[2026-09-12 06:14:04] step 505/5000 loss 0.3627 (w 0.1992 mse 0.2132 t 980 new 0.22) lr 1.00e-05 gnorm 0.146 3.39s mem 81.1GB +[2026-09-12 06:14:07] step 506/5000 loss 0.1958 (w 0.1840 mse 0.1952 t 853 new 0.09) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +[2026-09-12 06:14:11] step 507/5000 loss 0.4221 (w 0.2938 mse 0.3071 t 980 new 0.13) lr 1.00e-05 gnorm 0.164 3.34s mem 81.1GB +[2026-09-12 06:14:13] step 508/5000 loss 0.5129 (w 0.2905 mse 0.2909 t 301 new 0.23) lr 1.00e-05 gnorm 1.384 2.82s mem 81.1GB +[2026-09-12 06:14:16] step 509/5000 loss 0.3319 (w 0.3486 mse 0.3468 t 633 new 0.21) lr 1.00e-05 gnorm 0.186 2.83s mem 81.1GB +[2026-09-12 06:14:19] step 510/5000 loss 0.2147 (w 0.4890 mse 0.4966 t 994 new 0.12) lr 1.00e-05 gnorm 0.176 3.24s mem 81.1GB +[2026-09-12 06:14:23] step 511/5000 loss 0.3302 (w 0.4136 mse 0.4106 t 984 new 0.21) lr 1.00e-05 gnorm 0.179 3.32s mem 81.1GB +[2026-09-12 06:14:26] step 512/5000 loss 0.3385 (w 0.2177 mse 0.2322 t 917 new 0.26) lr 1.00e-05 gnorm 0.206 3.09s mem 81.1GB +[2026-09-12 06:14:29] step 513/5000 loss 0.3616 (w 0.4960 mse 0.4994 t 301 new 0.21) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +[2026-09-12 06:14:32] step 514/5000 loss 0.2775 (w 0.2039 mse 0.2061 t 840 new 0.16) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +[2026-09-12 06:14:35] step 515/5000 loss 0.4343 (w 0.2634 mse 0.2806 t 770 new 0.11) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +[2026-09-12 06:14:38] step 516/5000 loss 0.3003 (w 0.4090 mse 0.4091 t 980 new 0.11) lr 1.00e-05 gnorm 0.165 3.24s mem 81.1GB +[2026-09-12 06:14:41] step 517/5000 loss 0.1568 (w 0.3674 mse 0.3674 t 971 new 0.21) lr 1.00e-05 gnorm 0.240 3.38s mem 81.1GB +[2026-09-12 06:14:44] step 518/5000 loss 0.3390 (w 0.3922 mse 0.3849 t 776 new 0.22) lr 1.00e-05 gnorm 0.195 3.00s mem 81.1GB +[2026-09-12 06:14:47] step 519/5000 loss 0.2896 (w 0.3071 mse 0.3305 t 999 new 0.11) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +[2026-09-12 06:14:50] step 520/5000 loss 0.2626 (w 0.3446 mse 0.3505 t 992 new 0.19) lr 1.00e-05 gnorm 0.144 2.82s mem 81.1GB +[2026-09-12 06:14:53] step 521/5000 loss 0.4256 (w 0.3604 mse 0.3771 t 310 new 0.22) lr 1.00e-05 gnorm 0.197 2.82s mem 81.1GB +[2026-09-12 06:14:56] step 522/5000 loss 0.4424 (w 0.2306 mse 0.2511 t 956 new 0.14) lr 1.00e-05 gnorm 0.145 3.36s mem 81.1GB +[2026-09-12 06:14:59] step 523/5000 loss 0.1394 (w 0.5365 mse 0.5172 t 977 new 0.22) lr 1.00e-05 gnorm 0.127 3.02s mem 81.1GB +[2026-09-12 06:15:02] step 524/5000 loss 0.2405 (w 0.5651 mse 0.5499 t 998 new 0.22) lr 1.00e-05 gnorm 0.291 3.10s mem 81.1GB +[2026-09-12 06:15:05] step 525/5000 loss 0.2204 (w 0.3236 mse 0.3353 t 856 new 0.21) lr 1.00e-05 gnorm 0.193 2.84s mem 81.1GB +[2026-09-12 06:15:08] step 526/5000 loss 0.2119 (w 0.2952 mse 0.2993 t 933 new 0.22) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +[2026-09-12 06:15:11] step 527/5000 loss 0.5856 (w 0.2910 mse 0.3042 t 942 new 0.21) lr 1.00e-05 gnorm 0.178 2.84s mem 81.1GB +[2026-09-12 06:15:14] step 528/5000 loss 0.2554 (w 0.2517 mse 0.2875 t 340 new 0.20) lr 1.00e-05 gnorm 0.267 3.37s mem 81.1GB +[2026-09-12 06:15:17] step 529/5000 loss 0.2214 (w 0.4120 mse 0.4391 t 994 new 0.22) lr 1.00e-05 gnorm 0.131 3.06s mem 81.1GB +[2026-09-12 06:15:20] step 530/5000 loss 0.2793 (w 0.3433 mse 0.3665 t 959 new 0.15) lr 1.00e-05 gnorm 0.190 3.09s mem 81.1GB +[2026-09-12 06:15:23] step 531/5000 loss 0.3951 (w 0.1678 mse 0.1865 t 933 new 0.17) lr 1.00e-05 gnorm 0.153 2.82s mem 81.1GB +[2026-09-12 06:15:26] step 532/5000 loss 0.4416 (w 0.2449 mse 0.2540 t 922 new 0.21) lr 1.00e-05 gnorm 0.197 2.82s mem 81.1GB +[2026-09-12 06:15:29] step 533/5000 loss 0.4049 (w 0.5409 mse 0.5591 t 140 new 0.17) lr 1.00e-05 gnorm 0.662 2.82s mem 81.1GB +[2026-09-12 06:15:32] step 534/5000 loss 0.2455 (w 0.2648 mse 0.2696 t 836 new 0.08) lr 1.00e-05 gnorm 0.151 3.27s mem 81.1GB +[2026-09-12 06:15:35] step 535/5000 loss 0.3110 (w 0.4147 mse 0.4087 t 297 new 0.22) lr 1.00e-05 gnorm 0.156 2.82s mem 81.1GB +[2026-09-12 06:15:38] step 536/5000 loss 0.4225 (w 0.3070 mse 0.3371 t 979 new 0.20) lr 1.00e-05 gnorm 0.179 3.30s mem 81.1GB +[2026-09-12 06:15:41] step 537/5000 loss 0.4482 (w 0.3712 mse 0.3843 t 482 new 0.24) lr 1.00e-05 gnorm 0.198 2.83s mem 81.1GB +[2026-09-12 06:15:44] step 538/5000 loss 0.2471 (w 0.3171 mse 0.3213 t 961 new 0.24) lr 1.00e-05 gnorm 0.455 2.82s mem 81.1GB +[2026-09-12 06:15:47] step 539/5000 loss 0.2993 (w 0.2285 mse 0.2477 t 947 new 0.25) lr 1.00e-05 gnorm 0.154 3.05s mem 81.1GB +[2026-09-12 06:15:50] step 540/5000 loss 0.3610 (w 0.3577 mse 0.3647 t 492 new 0.25) lr 1.00e-05 gnorm 0.264 3.31s mem 81.1GB +[2026-09-12 06:15:53] step 541/5000 loss 0.2757 (w 0.2326 mse 0.2539 t 967 new 0.24) lr 1.00e-05 gnorm 0.165 2.83s mem 81.1GB +[2026-09-12 06:15:57] step 542/5000 loss 0.3031 (w 0.3990 mse 0.4124 t 954 new 0.21) lr 1.00e-05 gnorm 0.142 3.27s mem 81.1GB +[2026-09-12 06:15:59] step 543/5000 loss 0.2066 (w 0.2689 mse 0.2824 t 869 new 0.27) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +[2026-09-12 06:16:02] step 544/5000 loss 0.2677 (w 0.3060 mse 0.3004 t 994 new 0.25) lr 1.00e-05 gnorm 0.217 2.84s mem 81.1GB +[2026-09-12 06:16:05] step 545/5000 loss 0.3663 (w 0.5311 mse 0.5447 t 200 new 0.24) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +[2026-09-12 06:16:09] step 546/5000 loss 0.3335 (w 0.3335 mse 0.3340 t 870 new 0.23) lr 1.00e-05 gnorm 0.562 3.31s mem 81.1GB +[2026-09-12 06:16:12] step 547/5000 loss 0.3721 (w 0.3705 mse 0.3668 t 911 new 0.20) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +[2026-09-12 06:16:15] step 548/5000 loss 0.2617 (w 0.3824 mse 0.3751 t 782 new 0.22) lr 1.00e-05 gnorm 0.172 3.27s mem 81.1GB +[2026-09-12 06:16:18] step 549/5000 loss 0.1799 (w 0.3402 mse 0.3370 t 886 new 0.19) lr 1.00e-05 gnorm 0.127 2.82s mem 81.1GB +[2026-09-12 06:16:20] step 550/5000 loss 0.2605 (w 0.3785 mse 0.3859 t 861 new 0.21) lr 1.00e-05 gnorm 0.152 2.82s mem 81.1GB +[2026-09-12 06:16:24] step 551/5000 loss 0.2391 (w 0.3895 mse 0.3866 t 914 new 0.19) lr 1.00e-05 gnorm 0.267 3.14s mem 81.1GB +[2026-09-12 06:16:27] step 552/5000 loss 0.3397 (w 0.4054 mse 0.4028 t 987 new 0.25) lr 1.00e-05 gnorm 0.135 3.27s mem 81.1GB +[2026-09-12 06:16:30] step 553/5000 loss 0.5272 (w 0.6061 mse 0.6083 t 165 new 0.12) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +[2026-09-12 06:16:33] step 554/5000 loss 0.3311 (w 0.4313 mse 0.4356 t 935 new 0.21) lr 1.00e-05 gnorm 0.152 3.10s mem 81.1GB +[2026-09-12 06:16:36] step 555/5000 loss 0.2683 (w 0.2967 mse 0.2982 t 932 new 0.02) lr 1.00e-05 gnorm 0.147 2.83s mem 81.1GB +[2026-09-12 06:16:38] step 556/5000 loss 0.2828 (w 0.3268 mse 0.3359 t 962 new 0.10) lr 1.00e-05 gnorm 0.870 2.84s mem 81.1GB +[2026-09-12 06:16:42] step 557/5000 loss 0.4745 (w 0.6022 mse 0.6087 t 244 new 0.21) lr 1.00e-05 gnorm 0.182 3.40s mem 81.1GB +[2026-09-12 06:16:45] step 558/5000 loss 0.2896 (w 0.2929 mse 0.3071 t 976 new 0.16) lr 1.00e-05 gnorm 0.135 3.05s mem 81.1GB +[2026-09-12 06:16:48] step 559/5000 loss 0.3203 (w 0.2797 mse 0.2947 t 913 new 0.18) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +[2026-09-12 06:16:51] step 560/5000 loss 0.1369 (w 0.3328 mse 0.3375 t 973 new 0.17) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +[2026-09-12 06:16:54] step 561/5000 loss 0.5064 (w 0.5006 mse 0.4929 t 217 new 0.21) lr 1.00e-05 gnorm 0.149 2.82s mem 81.1GB +[2026-09-12 06:16:57] step 562/5000 loss 0.2441 (w 0.2423 mse 0.2614 t 562 new 0.15) lr 1.00e-05 gnorm 0.115 3.06s mem 81.1GB +[2026-09-12 06:17:00] step 563/5000 loss 0.4567 (w 0.1908 mse 0.2032 t 865 new 0.16) lr 1.00e-05 gnorm 0.478 3.29s mem 81.1GB +[2026-09-12 06:17:03] step 564/5000 loss 0.3047 (w 0.2814 mse 0.2841 t 821 new 0.23) lr 1.00e-05 gnorm 0.176 3.09s mem 81.1GB +[2026-09-12 06:17:06] step 565/5000 loss 0.2253 (w 0.3966 mse 0.4071 t 411 new 0.22) lr 1.00e-05 gnorm 0.118 3.04s mem 81.1GB +[2026-09-12 06:17:10] step 566/5000 loss 0.3441 (w 0.4102 mse 0.4034 t 956 new 0.24) lr 1.00e-05 gnorm 0.337 3.12s mem 81.1GB +[2026-09-12 06:17:12] step 567/5000 loss 0.4149 (w 0.3267 mse 0.3239 t 790 new 0.25) lr 1.00e-05 gnorm 0.177 2.84s mem 81.1GB +[2026-09-12 06:17:16] step 568/5000 loss 0.2375 (w 0.3354 mse 0.3470 t 937 new 0.16) lr 1.00e-05 gnorm 0.215 3.07s mem 81.1GB +[2026-09-12 06:17:19] step 569/5000 loss 0.4068 (w 0.2394 mse 0.2471 t 669 new 0.15) lr 1.00e-05 gnorm 0.151 3.33s mem 81.1GB +[2026-09-12 06:17:22] step 570/5000 loss 0.1686 (w 0.3463 mse 0.3542 t 961 new 0.22) lr 1.00e-05 gnorm 0.414 3.10s mem 81.1GB +[2026-09-12 06:17:25] step 571/5000 loss 0.1513 (w 0.1939 mse 0.2004 t 858 new 0.18) lr 1.00e-05 gnorm 0.142 3.04s mem 81.1GB +[2026-09-12 06:17:28] step 572/5000 loss 0.2716 (w 0.3746 mse 0.3881 t 624 new 0.29) lr 1.00e-05 gnorm 0.294 3.11s mem 81.1GB +[2026-09-12 06:17:31] step 573/5000 loss 0.4208 (w 0.4097 mse 0.4055 t 960 new 0.15) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +[2026-09-12 06:17:34] step 574/5000 loss 0.4515 (w 0.2917 mse 0.2908 t 582 new 0.18) lr 1.00e-05 gnorm 0.178 3.16s mem 81.1GB +[2026-09-12 06:17:37] step 575/5000 loss 0.2613 (w 0.3333 mse 0.3445 t 985 new 0.17) lr 1.00e-05 gnorm 0.247 3.01s mem 81.1GB +[2026-09-12 06:17:40] step 576/5000 loss 0.3673 (w 0.3364 mse 0.3450 t 704 new 0.23) lr 1.00e-05 gnorm 0.204 3.09s mem 81.1GB +[2026-09-12 06:17:43] step 577/5000 loss 0.4185 (w 0.3119 mse 0.3321 t 972 new 0.19) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +[2026-09-12 06:17:46] step 578/5000 loss 0.3468 (w 0.2762 mse 0.2827 t 799 new 0.17) lr 1.00e-05 gnorm 0.184 3.07s mem 81.1GB +[2026-09-12 06:17:49] step 579/5000 loss 0.2713 (w 0.2997 mse 0.3134 t 982 new 0.13) lr 1.00e-05 gnorm 0.179 2.83s mem 81.1GB +[2026-09-12 06:17:52] step 580/5000 loss 0.3819 (w 0.2968 mse 0.3146 t 623 new 0.22) lr 1.00e-05 gnorm 0.153 3.10s mem 81.1GB +[2026-09-12 06:17:56] step 581/5000 loss 0.4465 (w 0.2675 mse 0.2782 t 880 new 0.25) lr 1.00e-05 gnorm 0.202 3.30s mem 81.1GB +[2026-09-12 06:17:59] step 582/5000 loss 0.2512 (w 0.4275 mse 0.4233 t 990 new 0.19) lr 1.00e-05 gnorm 0.176 3.05s mem 81.1GB +[2026-09-12 06:18:02] step 583/5000 loss 0.1895 (w 0.3901 mse 0.3969 t 971 new 0.21) lr 1.00e-05 gnorm 0.138 3.30s mem 81.1GB +[2026-09-12 06:18:05] step 584/5000 loss 0.2100 (w 0.3224 mse 0.3447 t 992 new 0.24) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +[2026-09-12 06:18:08] step 585/5000 loss 0.4961 (w 0.2045 mse 0.2162 t 929 new 0.20) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +[2026-09-12 06:18:11] step 586/5000 loss 0.2843 (w 0.4339 mse 0.4547 t 985 new 0.17) lr 1.00e-05 gnorm 0.208 3.12s mem 81.1GB +[2026-09-12 06:18:14] step 587/5000 loss 0.2827 (w 0.4154 mse 0.3941 t 998 new 0.21) lr 1.00e-05 gnorm 0.162 3.05s mem 81.1GB +[2026-09-12 06:18:17] step 588/5000 loss 0.2202 (w 0.5089 mse 0.5029 t 994 new 0.12) lr 1.00e-05 gnorm 0.211 3.07s mem 81.1GB +[2026-09-12 06:18:20] step 589/5000 loss 0.3127 (w 0.3262 mse 0.3376 t 907 new 0.21) lr 1.00e-05 gnorm 0.272 3.27s mem 81.1GB +[2026-09-12 06:18:23] step 590/5000 loss 0.4353 (w 0.2361 mse 0.2645 t 947 new 0.24) lr 1.00e-05 gnorm 0.223 2.82s mem 81.1GB +[2026-09-12 06:18:26] step 591/5000 loss 0.5709 (w 0.2126 mse 0.2313 t 773 new 0.24) lr 1.00e-05 gnorm 0.366 2.83s mem 81.1GB +[2026-09-12 06:18:29] step 592/5000 loss 0.2163 (w 0.3027 mse 0.3122 t 921 new 0.15) lr 1.00e-05 gnorm 0.152 3.34s mem 81.1GB +[2026-09-12 06:18:32] step 593/5000 loss 0.2804 (w 0.3743 mse 0.3799 t 963 new 0.19) lr 1.00e-05 gnorm 0.249 3.01s mem 81.1GB +[2026-09-12 06:18:35] step 594/5000 loss 0.2735 (w 0.3495 mse 0.3633 t 940 new 0.26) lr 1.00e-05 gnorm 1.773 2.83s mem 81.1GB +[2026-09-12 06:18:39] step 595/5000 loss 0.3979 (w 0.2582 mse 0.2616 t 866 new 0.18) lr 1.00e-05 gnorm 0.278 3.31s mem 81.1GB +[2026-09-12 06:18:41] step 596/5000 loss 0.1832 (w 0.2700 mse 0.2869 t 918 new 0.27) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +[2026-09-12 06:18:44] step 597/5000 loss 0.2710 (w 0.2761 mse 0.2868 t 863 new 0.21) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +[2026-09-12 06:18:48] step 598/5000 loss 0.2873 (w 0.3736 mse 0.3817 t 968 new 0.26) lr 1.00e-05 gnorm 0.221 3.41s mem 81.1GB +[2026-09-12 06:18:51] step 599/5000 loss 0.3048 (w 0.3986 mse 0.4060 t 963 new 0.22) lr 1.00e-05 gnorm 0.185 3.22s mem 81.1GB +[2026-09-12 06:18:54] step 600/5000 loss 0.4407 (w 0.2435 mse 0.2552 t 467 new 0.19) lr 1.00e-05 gnorm 0.149 3.03s mem 81.1GB +[2026-09-12 06:18:57] step 601/5000 loss 0.2546 (w 0.3267 mse 0.3307 t 995 new 0.25) lr 1.00e-05 gnorm 0.142 3.11s mem 81.1GB +[2026-09-12 06:19:00] step 602/5000 loss 0.3232 (w 0.2452 mse 0.2630 t 838 new 0.20) lr 1.00e-05 gnorm 0.202 2.82s mem 81.1GB +[2026-09-12 06:19:03] step 603/5000 loss 0.2076 (w 0.2068 mse 0.2250 t 969 new 0.13) lr 1.00e-05 gnorm 0.187 3.13s mem 81.1GB +[2026-09-12 06:19:06] step 604/5000 loss 0.3332 (w 0.3042 mse 0.3109 t 912 new 0.21) lr 1.00e-05 gnorm 0.242 3.29s mem 81.1GB +[2026-09-12 06:19:10] step 605/5000 loss 0.1700 (w 0.3971 mse 0.3862 t 977 new 0.14) lr 1.00e-05 gnorm 0.206 3.29s mem 81.1GB +[2026-09-12 06:19:13] step 606/5000 loss 0.3902 (w 0.3404 mse 0.3441 t 956 new 0.16) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +[2026-09-12 06:19:16] step 607/5000 loss 0.2412 (w 0.2812 mse 0.2852 t 839 new 0.25) lr 1.00e-05 gnorm 0.157 3.10s mem 81.1GB +[2026-09-12 06:19:19] step 608/5000 loss 0.3998 (w 0.3645 mse 0.3612 t 797 new 0.20) lr 1.00e-05 gnorm 0.197 2.82s mem 81.1GB +[2026-09-12 06:19:22] step 609/5000 loss 0.5544 (w 0.4083 mse 0.4133 t 979 new 0.21) lr 1.00e-05 gnorm 0.230 3.07s mem 81.1GB +[2026-09-12 06:19:25] step 610/5000 loss 0.4324 (w 0.6265 mse 0.6593 t 127 new 0.23) lr 1.00e-05 gnorm 0.148 3.36s mem 81.1GB +[2026-09-12 06:19:28] step 611/5000 loss 0.1745 (w 0.3642 mse 0.3662 t 987 new 0.24) lr 1.00e-05 gnorm 0.140 3.03s mem 81.1GB +[2026-09-12 06:19:31] step 612/5000 loss 0.3757 (w 0.3226 mse 0.3254 t 982 new 0.20) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +[2026-09-12 06:19:34] step 613/5000 loss 0.2515 (w 0.3303 mse 0.3382 t 557 new 0.24) lr 1.00e-05 gnorm 0.321 3.07s mem 81.1GB +[2026-09-12 06:19:37] step 614/5000 loss 0.3420 (w 0.3491 mse 0.3690 t 421 new 0.22) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-12 06:19:40] step 615/5000 loss 0.3348 (w 0.2505 mse 0.2636 t 913 new 0.12) lr 1.00e-05 gnorm 0.184 3.18s mem 81.1GB +[2026-09-12 06:19:44] step 616/5000 loss 0.3108 (w 0.2716 mse 0.2806 t 839 new 0.16) lr 1.00e-05 gnorm 0.152 3.28s mem 81.1GB +[2026-09-12 06:19:47] step 617/5000 loss 0.2592 (w 0.3287 mse 0.3418 t 937 new 0.26) lr 1.00e-05 gnorm 0.188 3.03s mem 81.1GB +[2026-09-12 06:19:50] step 618/5000 loss 0.2590 (w 0.4138 mse 0.4251 t 994 new 0.13) lr 1.00e-05 gnorm 0.337 3.10s mem 81.1GB +[2026-09-12 06:19:53] step 619/5000 loss 0.2807 (w 0.3392 mse 0.3465 t 822 new 0.18) lr 1.00e-05 gnorm 0.170 2.82s mem 81.1GB +[2026-09-12 06:19:55] step 620/5000 loss 0.3921 (w 0.3066 mse 0.3151 t 832 new 0.12) lr 1.00e-05 gnorm 0.476 2.82s mem 81.1GB +[2026-09-12 06:19:59] step 621/5000 loss 0.5368 (w 0.3093 mse 0.3202 t 692 new 0.22) lr 1.00e-05 gnorm 0.181 3.11s mem 81.1GB +[2026-09-12 06:20:02] step 622/5000 loss 0.2905 (w 0.2976 mse 0.3035 t 845 new 0.23) lr 1.00e-05 gnorm 0.149 3.05s mem 81.1GB +[2026-09-12 06:20:05] step 623/5000 loss 0.2179 (w 0.3148 mse 0.3158 t 938 new 0.12) lr 1.00e-05 gnorm 0.158 3.05s mem 81.1GB +[2026-09-12 06:20:08] step 624/5000 loss 0.2797 (w 0.2826 mse 0.2870 t 939 new 0.21) lr 1.00e-05 gnorm 0.235 3.33s mem 81.1GB +[2026-09-12 06:20:11] step 625/5000 loss 0.3390 (w 0.3363 mse 0.3536 t 348 new 0.20) lr 1.00e-05 gnorm 0.198 2.82s mem 81.1GB +[2026-09-12 06:20:14] step 626/5000 loss 0.2153 (w 0.1577 mse 0.1695 t 675 new 0.12) lr 1.00e-05 gnorm 0.202 2.82s mem 81.1GB +[2026-09-12 06:20:17] step 627/5000 loss 0.1754 (w 0.3279 mse 0.3308 t 952 new 0.12) lr 1.00e-05 gnorm 0.155 3.45s mem 81.1GB +[2026-09-12 06:20:21] step 628/5000 loss 0.1098 (w 0.3878 mse 0.3818 t 969 new 0.21) lr 1.00e-05 gnorm 0.147 3.27s mem 81.1GB +[2026-09-12 06:20:23] step 629/5000 loss 0.1953 (w 0.1698 mse 0.1862 t 945 new 0.10) lr 1.00e-05 gnorm 0.163 2.83s mem 81.1GB +[2026-09-12 06:20:27] step 630/5000 loss 0.1961 (w 0.3472 mse 0.3658 t 980 new 0.20) lr 1.00e-05 gnorm 1.292 3.26s mem 81.1GB +[2026-09-12 06:20:29] step 631/5000 loss 0.4186 (w 0.2830 mse 0.2943 t 939 new 0.18) lr 1.00e-05 gnorm 0.201 2.83s mem 81.1GB +[2026-09-12 06:20:32] step 632/5000 loss 0.3687 (w 0.4455 mse 0.4558 t 992 new 0.23) lr 1.00e-05 gnorm 0.153 2.85s mem 81.1GB +[2026-09-12 06:20:36] step 633/5000 loss 0.2823 (w 0.2444 mse 0.2629 t 853 new 0.15) lr 1.00e-05 gnorm 0.340 3.39s mem 81.1GB +[2026-09-12 06:20:39] step 634/5000 loss 0.2817 (w 0.3570 mse 0.3739 t 980 new 0.26) lr 1.00e-05 gnorm 0.170 3.03s mem 81.1GB +[2026-09-12 06:20:42] step 635/5000 loss 0.1763 (w 0.3172 mse 0.3112 t 935 new 0.15) lr 1.00e-05 gnorm 0.221 2.82s mem 81.1GB +[2026-09-12 06:20:45] step 636/5000 loss 0.4460 (w 0.7383 mse 0.7328 t 100 new 0.20) lr 1.00e-05 gnorm 0.204 3.59s mem 81.1GB +[2026-09-12 06:20:48] step 637/5000 loss 0.4792 (w 0.4044 mse 0.4053 t 695 new 0.27) lr 1.00e-05 gnorm 0.199 2.83s mem 81.1GB +[2026-09-12 06:20:51] step 638/5000 loss 0.3902 (w 0.2455 mse 0.2557 t 516 new 0.18) lr 1.00e-05 gnorm 0.154 2.82s mem 81.1GB +[2026-09-12 06:20:54] step 639/5000 loss 0.4961 (w 0.3463 mse 0.3508 t 623 new 0.16) lr 1.00e-05 gnorm 0.184 3.39s mem 81.1GB +[2026-09-12 06:20:57] step 640/5000 loss 0.1954 (w 0.3521 mse 0.3579 t 911 new 0.23) lr 1.00e-05 gnorm 0.244 3.05s mem 81.1GB +[2026-09-12 06:21:00] step 641/5000 loss 0.3078 (w 0.2781 mse 0.2873 t 636 new 0.17) lr 1.00e-05 gnorm 0.145 2.82s mem 81.1GB +[2026-09-12 06:21:03] step 642/5000 loss 0.1740 (w 0.2214 mse 0.2501 t 962 new 0.23) lr 1.00e-05 gnorm 0.129 3.09s mem 81.1GB +[2026-09-12 06:21:06] step 643/5000 loss 0.3373 (w 0.4788 mse 0.4862 t 259 new 0.08) lr 1.00e-05 gnorm 0.199 2.83s mem 81.1GB +[2026-09-12 06:21:09] step 644/5000 loss 0.4216 (w 0.3266 mse 0.3253 t 800 new 0.14) lr 1.00e-05 gnorm 0.132 3.07s mem 81.1GB +[2026-09-12 06:21:12] step 645/5000 loss 0.2639 (w 0.2062 mse 0.2130 t 972 new 0.21) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +[2026-09-12 06:21:15] step 646/5000 loss 0.2116 (w 0.2596 mse 0.2762 t 984 new 0.25) lr 1.00e-05 gnorm 0.188 3.11s mem 81.1GB +[2026-09-12 06:21:18] step 647/5000 loss 0.4085 (w 0.3450 mse 0.3581 t 444 new 0.21) lr 1.00e-05 gnorm 0.159 3.04s mem 81.1GB +[2026-09-12 06:21:21] step 648/5000 loss 0.2131 (w 0.4560 mse 0.4620 t 998 new 0.16) lr 1.00e-05 gnorm 0.175 3.11s mem 81.1GB +[2026-09-12 06:21:24] step 649/5000 loss 0.1834 (w 0.2645 mse 0.2661 t 901 new 0.19) lr 1.00e-05 gnorm 0.148 2.85s mem 81.1GB +[2026-09-12 06:21:27] step 650/5000 loss 0.2441 (w 0.1869 mse 0.1930 t 785 new 0.11) lr 1.00e-05 gnorm 0.162 3.09s mem 81.1GB +[2026-09-12 06:21:31] step 651/5000 loss 0.4092 (w 0.2988 mse 0.3017 t 598 new 0.08) lr 1.00e-05 gnorm 0.192 3.42s mem 81.1GB +[2026-09-12 06:21:34] step 652/5000 loss 0.3895 (w 0.2036 mse 0.2154 t 776 new 0.25) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +[2026-09-12 06:21:37] step 653/5000 loss 0.4439 (w 0.3263 mse 0.3199 t 921 new 0.14) lr 1.00e-05 gnorm 0.200 3.04s mem 81.1GB +[2026-09-12 06:21:40] step 654/5000 loss 0.2767 (w 0.2286 mse 0.2479 t 945 new 0.23) lr 1.00e-05 gnorm 0.306 3.15s mem 81.1GB +[2026-09-12 06:21:43] step 655/5000 loss 0.2069 (w 0.4160 mse 0.4206 t 974 new 0.21) lr 1.00e-05 gnorm 0.119 2.82s mem 81.1GB +[2026-09-12 06:21:46] step 656/5000 loss 0.2828 (w 0.4817 mse 0.4992 t 978 new 0.19) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +[2026-09-12 06:21:50] step 657/5000 loss 0.4149 (w 0.1981 mse 0.2206 t 700 new 0.20) lr 1.00e-05 gnorm 0.164 3.35s mem 81.1GB +[2026-09-12 06:21:53] step 658/5000 loss 0.4045 (w 0.3419 mse 0.3408 t 972 new 0.10) lr 1.00e-05 gnorm 0.153 3.14s mem 81.1GB +[2026-09-12 06:21:56] step 659/5000 loss 0.2076 (w 0.4793 mse 0.4581 t 990 new 0.20) lr 1.00e-05 gnorm 0.158 3.03s mem 81.1GB +[2026-09-12 06:21:59] step 660/5000 loss 0.2215 (w 0.3865 mse 0.3940 t 989 new 0.24) lr 1.00e-05 gnorm 0.170 3.10s mem 81.1GB +[2026-09-12 06:22:02] step 661/5000 loss 0.2771 (w 0.2432 mse 0.2537 t 881 new 0.22) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +[2026-09-12 06:22:05] step 662/5000 loss 0.2928 (w 0.2993 mse 0.3042 t 921 new 0.26) lr 1.00e-05 gnorm 0.386 3.14s mem 81.1GB +[2026-09-12 06:22:08] step 663/5000 loss 0.3131 (w 0.2911 mse 0.2928 t 920 new 0.25) lr 1.00e-05 gnorm 0.168 3.07s mem 81.1GB +[2026-09-12 06:22:11] step 664/5000 loss 0.3446 (w 0.3133 mse 0.3143 t 911 new 0.23) lr 1.00e-05 gnorm 0.163 3.07s mem 81.1GB +[2026-09-12 06:22:14] step 665/5000 loss 0.2306 (w 0.4085 mse 0.4173 t 967 new 0.23) lr 1.00e-05 gnorm 0.130 3.07s mem 81.1GB +[2026-09-12 06:22:17] step 666/5000 loss 0.3968 (w 0.4429 mse 0.4597 t 372 new 0.20) lr 1.00e-05 gnorm 0.185 2.83s mem 81.1GB +[2026-09-12 06:22:20] step 667/5000 loss 0.3668 (w 0.2261 mse 0.2547 t 767 new 0.26) lr 1.00e-05 gnorm 0.164 2.85s mem 81.1GB +[2026-09-12 06:22:23] step 668/5000 loss 0.2180 (w 0.3368 mse 0.3286 t 728 new 0.17) lr 1.00e-05 gnorm 0.200 3.45s mem 81.1GB +[2026-09-12 06:22:26] step 669/5000 loss 0.4734 (w 0.3042 mse 0.3238 t 954 new 0.23) lr 1.00e-05 gnorm 0.218 3.10s mem 81.1GB +[2026-09-12 06:22:29] step 670/5000 loss 0.2663 (w 0.2480 mse 0.2565 t 954 new 0.25) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +[2026-09-12 06:22:32] step 671/5000 loss 0.2394 (w 0.3619 mse 0.3576 t 994 new 0.25) lr 1.00e-05 gnorm 0.130 3.11s mem 81.1GB +[2026-09-12 06:22:35] step 672/5000 loss 0.3696 (w 0.2899 mse 0.2905 t 852 new 0.26) lr 1.00e-05 gnorm 0.243 2.83s mem 81.1GB +[2026-09-12 06:22:38] step 673/5000 loss 0.2550 (w 0.2600 mse 0.2820 t 815 new 0.24) lr 1.00e-05 gnorm 0.750 2.83s mem 81.1GB +[2026-09-12 06:22:42] step 674/5000 loss 0.1285 (w 0.3616 mse 0.3647 t 999 new 0.23) lr 1.00e-05 gnorm 0.163 3.62s mem 81.1GB +[2026-09-12 06:22:45] step 675/5000 loss 0.2274 (w 0.2726 mse 0.2861 t 934 new 0.23) lr 1.00e-05 gnorm 0.131 3.03s mem 81.1GB +[2026-09-12 06:22:48] step 676/5000 loss 0.2861 (w 0.2167 mse 0.2266 t 875 new 0.13) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +[2026-09-12 06:22:51] step 677/5000 loss 0.2464 (w 0.2708 mse 0.2896 t 865 new 0.25) lr 1.00e-05 gnorm 0.127 3.13s mem 81.1GB +[2026-09-12 06:22:54] step 678/5000 loss 0.2792 (w 0.3661 mse 0.3733 t 896 new 0.21) lr 1.00e-05 gnorm 0.209 2.84s mem 81.1GB +[2026-09-12 06:22:56] step 679/5000 loss 0.2993 (w 0.4225 mse 0.4212 t 980 new 0.22) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +[2026-09-12 06:23:00] step 680/5000 loss 0.3061 (w 0.2727 mse 0.2824 t 915 new 0.20) lr 1.00e-05 gnorm 0.133 3.35s mem 81.1GB +[2026-09-12 06:23:03] step 681/5000 loss 0.3423 (w 0.3319 mse 0.3417 t 692 new 0.23) lr 1.00e-05 gnorm 0.201 3.03s mem 81.1GB +[2026-09-12 06:23:06] step 682/5000 loss 0.2861 (w 0.5016 mse 0.5046 t 228 new 0.16) lr 1.00e-05 gnorm 0.140 3.12s mem 81.1GB +[2026-09-12 06:23:09] step 683/5000 loss 0.2583 (w 0.2391 mse 0.2533 t 993 new 0.15) lr 1.00e-05 gnorm 0.172 3.14s mem 81.1GB +[2026-09-12 06:23:12] step 684/5000 loss 0.3988 (w 0.2829 mse 0.2921 t 779 new 0.21) lr 1.00e-05 gnorm 0.194 2.82s mem 81.1GB +[2026-09-12 06:23:15] step 685/5000 loss 0.1860 (w 0.3143 mse 0.3230 t 555 new 0.22) lr 1.00e-05 gnorm 0.166 2.83s mem 81.1GB +[2026-09-12 06:23:18] step 686/5000 loss 0.4262 (w 0.2441 mse 0.2435 t 970 new 0.26) lr 1.00e-05 gnorm 0.164 3.37s mem 81.1GB +[2026-09-12 06:23:21] step 687/5000 loss 0.3811 (w 0.9218 mse 0.8794 t 990 new 0.19) lr 1.00e-05 gnorm 0.149 3.04s mem 81.1GB +[2026-09-12 06:23:24] step 688/5000 loss 0.3423 (w 0.3572 mse 0.3527 t 878 new 0.22) lr 1.00e-05 gnorm 0.153 3.06s mem 81.1GB +[2026-09-12 06:23:27] step 689/5000 loss 0.4231 (w 0.4456 mse 0.4458 t 383 new 0.19) lr 1.00e-05 gnorm 0.203 3.08s mem 81.1GB +[2026-09-12 06:23:30] step 690/5000 loss 0.4377 (w 0.3073 mse 0.3074 t 854 new 0.16) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +[2026-09-12 06:23:33] step 691/5000 loss 0.2743 (w 0.5094 mse 0.5456 t 159 new 0.17) lr 1.00e-05 gnorm 0.216 3.14s mem 81.1GB +[2026-09-12 06:23:36] step 692/5000 loss 0.1697 (w 0.2871 mse 0.2962 t 903 new 0.24) lr 1.00e-05 gnorm 0.144 3.12s mem 81.1GB +[2026-09-12 06:23:39] step 693/5000 loss 0.2905 (w 0.3710 mse 0.3644 t 969 new 0.23) lr 1.00e-05 gnorm 0.210 3.09s mem 81.1GB +[2026-09-12 06:23:43] step 694/5000 loss 0.3346 (w 0.2334 mse 0.2381 t 734 new 0.14) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +[2026-09-12 06:23:46] step 695/5000 loss 0.2284 (w 0.2646 mse 0.2834 t 639 new 0.22) lr 1.00e-05 gnorm 0.198 3.08s mem 81.1GB +[2026-09-12 06:23:48] step 696/5000 loss 0.2491 (w 0.2154 mse 0.2329 t 768 new 0.17) lr 1.00e-05 gnorm 0.344 2.82s mem 81.1GB +[2026-09-12 06:23:52] step 697/5000 loss 0.3153 (w 0.2700 mse 0.2830 t 834 new 0.26) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +[2026-09-12 06:23:55] step 698/5000 loss 0.2347 (w 0.2661 mse 0.2947 t 970 new 0.23) lr 1.00e-05 gnorm 0.154 3.11s mem 81.1GB +[2026-09-12 06:23:58] step 699/5000 loss 0.2677 (w 0.1951 mse 0.2091 t 748 new 0.20) lr 1.00e-05 gnorm 0.112 3.09s mem 81.1GB +[2026-09-12 06:24:01] step 700/5000 loss 0.2075 (w 0.2897 mse 0.3027 t 982 new 0.12) lr 1.00e-05 gnorm 0.125 3.35s mem 81.1GB +[2026-09-12 06:24:04] step 701/5000 loss 0.4390 (w 0.3639 mse 0.4015 t 292 new 0.20) lr 1.00e-05 gnorm 0.182 2.83s mem 81.1GB +[2026-09-12 06:24:08] step 702/5000 loss 0.1821 (w 0.3056 mse 0.3187 t 934 new 0.10) lr 1.00e-05 gnorm 0.117 3.36s mem 81.1GB +[2026-09-12 06:24:11] step 703/5000 loss 0.4637 (w 0.2157 mse 0.2307 t 603 new 0.17) lr 1.00e-05 gnorm 0.203 3.30s mem 81.1GB +[2026-09-12 06:24:14] step 704/5000 loss 0.3691 (w 0.2325 mse 0.2541 t 599 new 0.24) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +[2026-09-12 06:24:17] step 705/5000 loss 0.4749 (w 0.2959 mse 0.3127 t 467 new 0.24) lr 1.00e-05 gnorm 0.133 3.10s mem 81.1GB +[2026-09-12 06:24:20] step 706/5000 loss 0.4106 (w 0.2834 mse 0.2809 t 695 new 0.18) lr 1.00e-05 gnorm 0.226 3.31s mem 81.1GB +[2026-09-12 06:24:23] step 707/5000 loss 0.3171 (w 0.5479 mse 0.5409 t 991 new 0.14) lr 1.00e-05 gnorm 0.103 2.83s mem 81.1GB +[2026-09-12 06:24:26] step 708/5000 loss 0.2522 (w 0.2826 mse 0.3024 t 961 new 0.19) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +[2026-09-12 06:24:29] step 709/5000 loss 0.2020 (w 0.2566 mse 0.2529 t 881 new 0.08) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +[2026-09-12 06:24:32] step 710/5000 loss 0.3216 (w 0.2675 mse 0.2937 t 980 new 0.18) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +[2026-09-12 06:24:35] step 711/5000 loss 0.3887 (w 0.4353 mse 0.4430 t 301 new 0.21) lr 1.00e-05 gnorm 0.213 3.10s mem 81.1GB +[2026-09-12 06:24:38] step 712/5000 loss 0.2143 (w 0.4415 mse 0.4501 t 1000 new 0.13) lr 1.00e-05 gnorm 0.108 3.28s mem 81.1GB +[2026-09-12 06:24:41] step 713/5000 loss 0.2965 (w 0.2628 mse 0.2694 t 913 new 0.10) lr 1.00e-05 gnorm 0.136 2.82s mem 81.1GB +[2026-09-12 06:24:44] step 714/5000 loss 0.3830 (w 0.2083 mse 0.2204 t 790 new 0.26) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +[2026-09-12 06:24:47] step 715/5000 loss 0.2530 (w 0.3754 mse 0.3912 t 1000 new 0.19) lr 1.00e-05 gnorm 1.752 3.39s mem 81.1GB +[2026-09-12 06:24:50] step 716/5000 loss 0.3794 (w 0.2798 mse 0.2841 t 888 new 0.23) lr 1.00e-05 gnorm 0.182 2.83s mem 81.1GB +[2026-09-12 06:24:53] step 717/5000 loss 0.3194 (w 0.8060 mse 0.8023 t 120 new 0.23) lr 1.00e-05 gnorm 0.142 3.04s mem 81.1GB +[2026-09-12 06:24:56] step 718/5000 loss 0.2687 (w 0.3340 mse 0.3489 t 956 new 0.21) lr 1.00e-05 gnorm 0.592 3.10s mem 81.1GB +[2026-09-12 06:24:59] step 719/5000 loss 0.2445 (w 0.2934 mse 0.2928 t 969 new 0.13) lr 1.00e-05 gnorm 0.122 2.82s mem 81.1GB +[2026-09-12 06:25:02] step 720/5000 loss 0.2963 (w 0.1739 mse 0.1971 t 932 new 0.18) lr 1.00e-05 gnorm 0.133 2.83s mem 81.1GB +[2026-09-12 06:25:05] step 721/5000 loss 0.2040 (w 0.6620 mse 0.6563 t 146 new 0.17) lr 1.00e-05 gnorm 0.136 3.34s mem 81.1GB +[2026-09-12 06:25:08] step 722/5000 loss 0.3764 (w 0.4586 mse 0.4471 t 998 new 0.24) lr 1.00e-05 gnorm 0.156 2.83s mem 81.1GB +[2026-09-12 06:25:11] step 723/5000 loss 0.2639 (w 0.2666 mse 0.2716 t 770 new 0.23) lr 1.00e-05 gnorm 0.170 3.08s mem 81.1GB +[2026-09-12 06:25:14] step 724/5000 loss 0.1920 (w 0.3114 mse 0.3216 t 959 new 0.23) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +[2026-09-12 06:25:17] step 725/5000 loss 0.3440 (w 0.3718 mse 0.3816 t 568 new 0.17) lr 1.00e-05 gnorm 0.118 2.83s mem 81.1GB +[2026-09-12 06:25:20] step 726/5000 loss 0.2749 (w 0.3228 mse 0.3270 t 924 new 0.20) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +[2026-09-12 06:25:24] step 727/5000 loss 0.4246 (w 0.2564 mse 0.2633 t 932 new 0.16) lr 1.00e-05 gnorm 0.254 3.32s mem 81.1GB +[2026-09-12 06:25:27] step 728/5000 loss 0.2454 (w 0.2895 mse 0.3013 t 530 new 0.13) lr 1.00e-05 gnorm 0.137 3.02s mem 81.1GB +[2026-09-12 06:25:29] step 729/5000 loss 0.2384 (w 0.2725 mse 0.2759 t 909 new 0.15) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +[2026-09-12 06:25:32] step 730/5000 loss 0.4165 (w 0.1723 mse 0.1866 t 560 new 0.17) lr 1.00e-05 gnorm 0.218 3.08s mem 81.1GB +[2026-09-12 06:25:35] step 731/5000 loss 0.2183 (w 0.2626 mse 0.2749 t 737 new 0.23) lr 1.00e-05 gnorm 0.339 2.83s mem 81.1GB +[2026-09-12 06:25:38] step 732/5000 loss 0.3536 (w 0.8572 mse 0.8871 t 994 new 0.21) lr 1.00e-05 gnorm 0.199 2.82s mem 81.1GB +[2026-09-12 06:25:42] step 733/5000 loss 0.3567 (w 0.3573 mse 0.3693 t 465 new 0.26) lr 1.00e-05 gnorm 0.346 3.47s mem 81.1GB +[2026-09-12 06:25:45] step 734/5000 loss 0.1201 (w 0.3131 mse 0.3421 t 982 new 0.23) lr 1.00e-05 gnorm 0.172 3.03s mem 81.1GB +[2026-09-12 06:25:47] step 735/5000 loss 0.2852 (w 0.2309 mse 0.2395 t 786 new 0.23) lr 1.00e-05 gnorm 0.369 2.81s mem 81.1GB +[2026-09-12 06:25:51] step 736/5000 loss 0.3988 (w 0.3732 mse 0.3751 t 979 new 0.25) lr 1.00e-05 gnorm 0.178 3.08s mem 81.1GB +[2026-09-12 06:25:53] step 737/5000 loss 0.4329 (w 0.3923 mse 0.4038 t 506 new 0.25) lr 1.00e-05 gnorm 0.144 2.81s mem 81.1GB +[2026-09-12 06:25:56] step 738/5000 loss 0.4810 (w 0.3316 mse 0.3396 t 683 new 0.19) lr 1.00e-05 gnorm 0.268 3.08s mem 81.1GB +[2026-09-12 06:26:00] step 739/5000 loss 0.3036 (w 0.2800 mse 0.2948 t 681 new 0.24) lr 1.00e-05 gnorm 0.158 3.46s mem 81.1GB +[2026-09-12 06:26:03] step 740/5000 loss 0.4017 (w 0.2436 mse 0.2540 t 817 new 0.19) lr 1.00e-05 gnorm 0.124 3.04s mem 81.1GB +[2026-09-12 06:26:06] step 741/5000 loss 0.2959 (w 0.1760 mse 0.1866 t 852 new 0.08) lr 1.00e-05 gnorm 0.241 3.01s mem 81.1GB +[2026-09-12 06:26:09] step 742/5000 loss 0.2830 (w 0.3082 mse 0.3152 t 677 new 0.22) lr 1.00e-05 gnorm 0.205 3.04s mem 81.1GB +[2026-09-12 06:26:12] step 743/5000 loss 0.2684 (w 0.3590 mse 0.3712 t 974 new 0.23) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +[2026-09-12 06:26:15] step 744/5000 loss 0.3675 (w 0.3347 mse 0.3329 t 974 new 0.21) lr 1.00e-05 gnorm 0.196 3.09s mem 81.1GB +[2026-09-12 06:26:18] step 745/5000 loss 0.2986 (w 0.2771 mse 0.2792 t 930 new 0.19) lr 1.00e-05 gnorm 0.184 3.48s mem 81.1GB +[2026-09-12 06:26:21] step 746/5000 loss 0.3359 (w 0.3455 mse 0.3387 t 883 new 0.23) lr 1.00e-05 gnorm 0.326 3.09s mem 81.1GB +[2026-09-12 06:26:24] step 747/5000 loss 0.4005 (w 0.3336 mse 0.3465 t 684 new 0.28) lr 1.00e-05 gnorm 0.251 3.02s mem 81.1GB +[2026-09-12 06:26:28] step 748/5000 loss 0.4386 (w 0.3500 mse 0.3587 t 945 new 0.16) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +[2026-09-12 06:26:30] step 749/5000 loss 0.3959 (w 0.2586 mse 0.2715 t 645 new 0.24) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +[2026-09-12 06:26:33] step 750/5000 loss 0.3273 (w 0.2400 mse 0.2525 t 904 new 0.25) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +[2026-09-12 06:26:37] step 751/5000 loss 0.3220 (w 0.3674 mse 0.3694 t 979 new 0.24) lr 1.00e-05 gnorm 0.256 3.42s mem 81.1GB +[2026-09-12 06:26:40] step 752/5000 loss 0.4784 (w 0.2105 mse 0.2220 t 718 new 0.21) lr 1.00e-05 gnorm 0.209 3.06s mem 81.1GB +[2026-09-12 06:26:43] step 753/5000 loss 0.3460 (w 0.2461 mse 0.2537 t 528 new 0.15) lr 1.00e-05 gnorm 0.307 3.10s mem 81.1GB +[2026-09-12 06:26:46] step 754/5000 loss 0.3319 (w 0.3062 mse 0.3078 t 609 new 0.16) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +[2026-09-12 06:26:49] step 755/5000 loss 0.2017 (w 0.2185 mse 0.2267 t 754 new 0.22) lr 1.00e-05 gnorm 0.157 2.84s mem 81.1GB +[2026-09-12 06:26:52] step 756/5000 loss 0.2449 (w 0.3575 mse 0.3709 t 977 new 0.10) lr 1.00e-05 gnorm 0.129 3.16s mem 81.1GB +[2026-09-12 06:26:55] step 757/5000 loss 0.3186 (w 0.3276 mse 0.3364 t 428 new 0.16) lr 1.00e-05 gnorm 0.253 3.42s mem 81.1GB +[2026-09-12 06:26:59] step 758/5000 loss 0.3761 (w 0.3102 mse 0.3188 t 808 new 0.16) lr 1.00e-05 gnorm 0.212 3.08s mem 81.1GB +[2026-09-12 06:27:02] step 759/5000 loss 0.2351 (w 0.2824 mse 0.2901 t 779 new 0.25) lr 1.00e-05 gnorm 0.194 3.06s mem 81.1GB +[2026-09-12 06:27:04] step 760/5000 loss 0.2930 (w 0.2079 mse 0.2246 t 762 new 0.17) lr 1.00e-05 gnorm 0.167 2.82s mem 81.1GB +[2026-09-12 06:27:07] step 761/5000 loss 0.1744 (w 0.3136 mse 0.3107 t 947 new 0.19) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +[2026-09-12 06:27:10] step 762/5000 loss 0.3119 (w 0.3137 mse 0.3253 t 951 new 0.20) lr 1.00e-05 gnorm 0.172 3.11s mem 81.1GB +[2026-09-12 06:27:14] step 763/5000 loss 0.2803 (w 0.3103 mse 0.3269 t 842 new 0.22) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +[2026-09-12 06:27:17] step 764/5000 loss 0.2307 (w 0.2394 mse 0.2510 t 784 new 0.21) lr 1.00e-05 gnorm 0.198 3.14s mem 81.1GB +[2026-09-12 06:27:20] step 765/5000 loss 0.2286 (w 0.3124 mse 0.3202 t 974 new 0.24) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +[2026-09-12 06:27:23] step 766/5000 loss 0.3227 (w 0.3157 mse 0.3187 t 973 new 0.10) lr 1.00e-05 gnorm 0.286 2.83s mem 81.1GB +[2026-09-12 06:27:25] step 767/5000 loss 0.2935 (w 0.3502 mse 0.3600 t 947 new 0.21) lr 1.00e-05 gnorm 0.175 2.83s mem 81.1GB +[2026-09-12 06:27:29] step 768/5000 loss 0.2658 (w 0.5745 mse 0.6024 t 200 new 0.21) lr 1.00e-05 gnorm 0.157 3.28s mem 81.1GB +[2026-09-12 06:27:32] step 769/5000 loss 0.2310 (w 0.3146 mse 0.3157 t 984 new 0.18) lr 1.00e-05 gnorm 0.195 3.13s mem 81.1GB +[2026-09-12 06:27:35] step 770/5000 loss 0.4614 (w 0.2662 mse 0.2867 t 394 new 0.22) lr 1.00e-05 gnorm 0.250 2.82s mem 81.1GB +[2026-09-12 06:27:38] step 771/5000 loss 0.2063 (w 0.3168 mse 0.3183 t 948 new 0.17) lr 1.00e-05 gnorm 0.103 3.34s mem 81.1GB +[2026-09-12 06:27:41] step 772/5000 loss 0.2814 (w 0.2996 mse 0.3023 t 845 new 0.24) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +[2026-09-12 06:27:44] step 773/5000 loss 0.3256 (w 0.4667 mse 0.4699 t 348 new 0.23) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +[2026-09-12 06:27:47] step 774/5000 loss 0.4822 (w 0.3617 mse 0.3663 t 987 new 0.25) lr 1.00e-05 gnorm 0.342 3.36s mem 81.1GB +[2026-09-12 06:27:50] step 775/5000 loss 0.3210 (w 0.2880 mse 0.3015 t 773 new 0.19) lr 1.00e-05 gnorm 0.268 3.15s mem 81.1GB +[2026-09-12 06:27:53] step 776/5000 loss 0.2264 (w 0.3317 mse 0.3386 t 767 new 0.26) lr 1.00e-05 gnorm 0.147 3.13s mem 81.1GB +[2026-09-12 06:27:57] step 777/5000 loss 0.3542 (w 0.2088 mse 0.2313 t 832 new 0.24) lr 1.00e-05 gnorm 0.169 3.34s mem 81.1GB +[2026-09-12 06:28:00] step 778/5000 loss 0.4616 (w 0.2136 mse 0.2265 t 846 new 0.25) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +[2026-09-12 06:28:03] step 779/5000 loss 0.2935 (w 0.3182 mse 0.3172 t 827 new 0.16) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +[2026-09-12 06:28:06] step 780/5000 loss 0.2850 (w 0.2598 mse 0.2723 t 518 new 0.22) lr 1.00e-05 gnorm 0.124 3.45s mem 81.1GB +[2026-09-12 06:28:09] step 781/5000 loss 0.2625 (w 0.1991 mse 0.2241 t 941 new 0.17) lr 1.00e-05 gnorm 0.156 3.12s mem 81.1GB +[2026-09-12 06:28:12] step 782/5000 loss 0.3021 (w 0.4110 mse 0.4226 t 465 new 0.18) lr 1.00e-05 gnorm 0.162 3.05s mem 81.1GB +[2026-09-12 06:28:15] step 783/5000 loss 0.1695 (w 0.4050 mse 0.4139 t 979 new 0.08) lr 1.00e-05 gnorm 0.128 3.10s mem 81.1GB +[2026-09-12 06:28:18] step 784/5000 loss 0.2532 (w 0.4676 mse 0.4612 t 989 new 0.19) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +[2026-09-12 06:28:21] step 785/5000 loss 0.3731 (w 0.2945 mse 0.2914 t 712 new 0.21) lr 1.00e-05 gnorm 0.246 3.10s mem 81.1GB +[2026-09-12 06:28:24] step 786/5000 loss 0.2279 (w 0.3467 mse 0.3463 t 954 new 0.21) lr 1.00e-05 gnorm 0.223 3.18s mem 81.1GB +[2026-09-12 06:28:28] step 787/5000 loss 0.2497 (w 0.2834 mse 0.2920 t 983 new 0.08) lr 1.00e-05 gnorm 0.251 3.41s mem 81.1GB +[2026-09-12 06:28:31] step 788/5000 loss 0.3575 (w 0.4384 mse 0.4480 t 962 new 0.19) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +[2026-09-12 06:28:34] step 789/5000 loss 0.3706 (w 0.2302 mse 0.2408 t 928 new 0.18) lr 1.00e-05 gnorm 0.154 3.35s mem 81.1GB +[2026-09-12 06:28:37] step 790/5000 loss 0.4335 (w 0.3747 mse 0.3748 t 453 new 0.15) lr 1.00e-05 gnorm 0.213 2.82s mem 81.1GB +[2026-09-12 06:28:40] step 791/5000 loss 0.1562 (w 0.2802 mse 0.2826 t 974 new 0.19) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +[2026-09-12 06:28:44] step 792/5000 loss 0.2939 (w 0.3193 mse 0.3223 t 828 new 0.19) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +[2026-09-12 06:28:47] step 793/5000 loss 0.2122 (w 0.4085 mse 0.4114 t 996 new 0.23) lr 1.00e-05 gnorm 0.231 3.43s mem 81.1GB +[2026-09-12 06:28:50] step 794/5000 loss 0.1920 (w 0.2544 mse 0.2715 t 929 new 0.22) lr 1.00e-05 gnorm 0.170 3.06s mem 81.1GB +[2026-09-12 06:28:53] step 795/5000 loss 0.1101 (w 0.3028 mse 0.3118 t 991 new 0.25) lr 1.00e-05 gnorm 0.121 3.06s mem 81.1GB +[2026-09-12 06:28:56] step 796/5000 loss 0.5763 (w 0.3921 mse 0.3971 t 453 new 0.20) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +[2026-09-12 06:28:59] step 797/5000 loss 0.3611 (w 0.2807 mse 0.3018 t 808 new 0.16) lr 1.00e-05 gnorm 0.179 3.06s mem 81.1GB +[2026-09-12 06:29:02] step 798/5000 loss 0.2794 (w 0.2778 mse 0.2943 t 938 new 0.20) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +[2026-09-12 06:29:05] step 799/5000 loss 0.1545 (w 0.2948 mse 0.3046 t 979 new 0.10) lr 1.00e-05 gnorm 0.198 3.13s mem 81.1GB +[2026-09-12 06:29:09] step 800/5000 loss 0.1379 (w 0.2352 mse 0.2581 t 816 new 0.21) lr 1.00e-05 gnorm 0.123 3.35s mem 81.1GB +[2026-09-12 06:29:11] step 801/5000 loss 0.3087 (w 0.4857 mse 0.4809 t 976 new 0.24) lr 1.00e-05 gnorm 0.241 2.83s mem 81.1GB +[2026-09-12 06:29:14] step 802/5000 loss 0.2865 (w 0.2965 mse 0.2955 t 834 new 0.28) lr 1.00e-05 gnorm 0.204 2.82s mem 81.1GB +[2026-09-12 06:29:17] step 803/5000 loss 0.2984 (w 0.1640 mse 0.1897 t 832 new 0.18) lr 1.00e-05 gnorm 0.162 3.08s mem 81.1GB +[2026-09-12 06:29:20] step 804/5000 loss 0.2367 (w 0.1757 mse 0.1857 t 845 new 0.09) lr 1.00e-05 gnorm 0.209 3.09s mem 81.1GB +[2026-09-12 06:29:24] step 805/5000 loss 0.2622 (w 0.3346 mse 0.3385 t 835 new 0.22) lr 1.00e-05 gnorm 0.338 3.12s mem 81.1GB +[2026-09-12 06:29:27] step 806/5000 loss 0.1827 (w 0.2482 mse 0.2686 t 875 new 0.21) lr 1.00e-05 gnorm 0.125 3.26s mem 81.1GB +[2026-09-12 06:29:30] step 807/5000 loss 0.2862 (w 0.5011 mse 0.5050 t 998 new 0.19) lr 1.00e-05 gnorm 0.177 2.82s mem 81.1GB +[2026-09-12 06:29:32] step 808/5000 loss 0.2674 (w 0.3554 mse 0.3535 t 971 new 0.25) lr 1.00e-05 gnorm 0.165 2.82s mem 81.1GB +[2026-09-12 06:29:36] step 809/5000 loss 0.2441 (w 0.2605 mse 0.2682 t 901 new 0.24) lr 1.00e-05 gnorm 0.275 3.13s mem 81.1GB +[2026-09-12 06:29:39] step 810/5000 loss 0.1743 (w 0.2688 mse 0.2580 t 835 new 0.20) lr 1.00e-05 gnorm 0.168 3.04s mem 81.1GB +[2026-09-12 06:29:42] step 811/5000 loss 0.1381 (w 0.5636 mse 0.5550 t 991 new 0.19) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +[2026-09-12 06:29:45] step 812/5000 loss 0.4779 (w 0.3070 mse 0.3071 t 847 new 0.20) lr 1.00e-05 gnorm 0.137 3.32s mem 81.1GB +[2026-09-12 06:29:48] step 813/5000 loss 0.1788 (w 0.4604 mse 0.4449 t 982 new 0.23) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-12 06:29:51] step 814/5000 loss 0.2558 (w 0.2152 mse 0.2205 t 822 new 0.22) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +[2026-09-12 06:29:54] step 815/5000 loss 0.3712 (w 0.3279 mse 0.3342 t 549 new 0.20) lr 1.00e-05 gnorm 0.139 3.30s mem 81.1GB +[2026-09-12 06:29:57] step 816/5000 loss 0.4622 (w 0.3752 mse 0.3805 t 383 new 0.19) lr 1.00e-05 gnorm 0.116 3.02s mem 81.1GB +[2026-09-12 06:30:00] step 817/5000 loss 0.2082 (w 0.3329 mse 0.3325 t 956 new 0.23) lr 1.00e-05 gnorm 0.134 3.11s mem 81.1GB +[2026-09-12 06:30:03] step 818/5000 loss 0.4093 (w 0.2126 mse 0.2354 t 930 new 0.17) lr 1.00e-05 gnorm 0.193 3.08s mem 81.1GB +[2026-09-12 06:30:06] step 819/5000 loss 0.1717 (w 0.3515 mse 0.3544 t 998 new 0.23) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +[2026-09-12 06:30:09] step 820/5000 loss 0.1966 (w 0.3740 mse 0.3668 t 1000 new 0.13) lr 1.00e-05 gnorm 0.330 2.83s mem 81.1GB +[2026-09-12 06:30:12] step 821/5000 loss 0.2283 (w 0.2617 mse 0.2843 t 757 new 0.19) lr 1.00e-05 gnorm 0.138 3.14s mem 81.1GB +[2026-09-12 06:30:15] step 822/5000 loss 0.3158 (w 0.4697 mse 0.4725 t 984 new 0.28) lr 1.00e-05 gnorm 0.098 3.13s mem 81.1GB +[2026-09-12 06:30:18] step 823/5000 loss 0.2298 (w 0.5225 mse 0.5194 t 978 new 0.17) lr 1.00e-05 gnorm 0.096 3.01s mem 81.1GB +[2026-09-12 06:30:21] step 824/5000 loss 0.1794 (w 0.2810 mse 0.2846 t 872 new 0.21) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +[2026-09-12 06:30:24] step 825/5000 loss 0.5546 (w 0.3628 mse 0.3735 t 623 new 0.26) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +[2026-09-12 06:30:27] step 826/5000 loss 0.2016 (w 0.3094 mse 0.3167 t 952 new 0.24) lr 1.00e-05 gnorm 0.180 3.01s mem 81.1GB +[2026-09-12 06:30:30] step 827/5000 loss 0.4270 (w 0.3151 mse 0.3136 t 845 new 0.27) lr 1.00e-05 gnorm 0.151 3.12s mem 81.1GB +[2026-09-12 06:30:33] step 828/5000 loss 0.2680 (w 0.2827 mse 0.2868 t 922 new 0.13) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +[2026-09-12 06:30:37] step 829/5000 loss 0.1844 (w 0.3068 mse 0.3206 t 720 new 0.17) lr 1.00e-05 gnorm 0.150 3.04s mem 81.1GB +[2026-09-12 06:30:39] step 830/5000 loss 0.3812 (w 0.3631 mse 0.3713 t 923 new 0.15) lr 1.00e-05 gnorm 0.188 2.83s mem 81.1GB +[2026-09-12 06:30:42] step 831/5000 loss 0.3044 (w 0.3720 mse 0.3716 t 859 new 0.26) lr 1.00e-05 gnorm 0.191 2.83s mem 81.1GB +[2026-09-12 06:30:45] step 832/5000 loss 0.3164 (w 0.2737 mse 0.2738 t 729 new 0.22) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +[2026-09-12 06:30:48] step 833/5000 loss 0.5013 (w 0.3310 mse 0.3370 t 582 new 0.20) lr 1.00e-05 gnorm 0.230 3.12s mem 81.1GB +[2026-09-12 06:30:51] step 834/5000 loss 0.3673 (w 0.3131 mse 0.3167 t 927 new 0.20) lr 1.00e-05 gnorm 0.219 3.33s mem 81.1GB +[2026-09-12 06:30:55] step 835/5000 loss 0.2388 (w 0.4350 mse 0.4269 t 980 new 0.24) lr 1.00e-05 gnorm 0.152 3.29s mem 81.1GB +[2026-09-12 06:30:58] step 836/5000 loss 0.1597 (w 0.4474 mse 0.4626 t 975 new 0.19) lr 1.00e-05 gnorm 0.356 2.82s mem 81.1GB +[2026-09-12 06:31:00] step 837/5000 loss 0.1945 (w 0.2751 mse 0.2789 t 716 new 0.19) lr 1.00e-05 gnorm 0.109 2.83s mem 81.1GB +[2026-09-12 06:31:04] step 838/5000 loss 0.3711 (w 0.1685 mse 0.1846 t 797 new 0.21) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +[2026-09-12 06:31:06] step 839/5000 loss 0.1463 (w 0.3017 mse 0.3040 t 943 new 0.03) lr 1.00e-05 gnorm 0.134 2.82s mem 81.1GB +[2026-09-12 06:31:10] step 840/5000 loss 0.5151 (w 0.2114 mse 0.2359 t 774 new 0.19) lr 1.00e-05 gnorm 0.154 3.29s mem 81.1GB +[2026-09-12 06:31:13] step 841/5000 loss 0.2048 (w 0.4143 mse 0.4202 t 957 new 0.18) lr 1.00e-05 gnorm 0.132 3.24s mem 81.1GB +[2026-09-12 06:31:16] step 842/5000 loss 0.2821 (w 0.3150 mse 0.3454 t 974 new 0.19) lr 1.00e-05 gnorm 0.136 2.82s mem 81.1GB +[2026-09-12 06:31:19] step 843/5000 loss 0.1473 (w 0.3385 mse 0.3398 t 967 new 0.23) lr 1.00e-05 gnorm 0.113 2.83s mem 81.1GB +[2026-09-12 06:31:22] step 844/5000 loss 0.5042 (w 0.2666 mse 0.2794 t 967 new 0.24) lr 1.00e-05 gnorm 0.164 3.34s mem 81.1GB +[2026-09-12 06:31:25] step 845/5000 loss 0.2204 (w 0.3743 mse 0.3822 t 999 new 0.23) lr 1.00e-05 gnorm 0.124 2.82s mem 81.1GB +[2026-09-12 06:31:28] step 846/5000 loss 0.3237 (w 0.2930 mse 0.3013 t 962 new 0.24) lr 1.00e-05 gnorm 0.160 3.34s mem 81.1GB +[2026-09-12 06:31:31] step 847/5000 loss 0.1848 (w 0.1902 mse 0.2028 t 926 new 0.20) lr 1.00e-05 gnorm 0.143 3.29s mem 81.1GB +[2026-09-12 06:31:34] step 848/5000 loss 0.2434 (w 0.2570 mse 0.2643 t 735 new 0.19) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-12 06:31:37] step 849/5000 loss 0.3259 (w 0.2324 mse 0.2567 t 849 new 0.17) lr 1.00e-05 gnorm 0.162 2.83s mem 81.1GB +[2026-09-12 06:31:40] step 850/5000 loss 0.1859 (w 0.4079 mse 0.4132 t 974 new 0.27) lr 1.00e-05 gnorm 0.197 3.37s mem 81.1GB +[2026-09-12 06:31:44] step 851/5000 loss 0.2799 (w 0.4418 mse 0.4277 t 984 new 0.19) lr 1.00e-05 gnorm 0.165 3.13s mem 81.1GB +[2026-09-12 06:31:47] step 852/5000 loss 0.2322 (w 0.2616 mse 0.2782 t 741 new 0.20) lr 1.00e-05 gnorm 0.164 3.07s mem 81.1GB +[2026-09-12 06:31:50] step 853/5000 loss 0.3061 (w 0.2379 mse 0.2604 t 850 new 0.19) lr 1.00e-05 gnorm 0.169 3.29s mem 81.1GB +[2026-09-12 06:31:53] step 854/5000 loss 0.3958 (w 0.2298 mse 0.2423 t 837 new 0.23) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +[2026-09-12 06:31:56] step 855/5000 loss 0.1998 (w 0.3488 mse 0.3472 t 666 new 0.21) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +[2026-09-12 06:31:59] step 856/5000 loss 0.3762 (w 0.3808 mse 0.3901 t 953 new 0.22) lr 1.00e-05 gnorm 0.161 3.34s mem 81.1GB +[2026-09-12 06:32:02] step 857/5000 loss 0.5430 (w 0.1637 mse 0.1888 t 893 new 0.27) lr 1.00e-05 gnorm 0.152 2.82s mem 81.1GB +[2026-09-12 06:32:05] step 858/5000 loss 0.2435 (w 0.4247 mse 0.4193 t 988 new 0.18) lr 1.00e-05 gnorm 0.192 3.37s mem 81.1GB +[2026-09-12 06:32:08] step 859/5000 loss 0.4436 (w 0.3438 mse 0.3455 t 876 new 0.14) lr 1.00e-05 gnorm 0.159 3.11s mem 81.1GB +[2026-09-12 06:32:11] step 860/5000 loss 0.3650 (w 0.3456 mse 0.3525 t 944 new 0.22) lr 1.00e-05 gnorm 0.443 2.83s mem 81.1GB +[2026-09-12 06:32:14] step 861/5000 loss 0.3279 (w 0.2543 mse 0.2631 t 852 new 0.08) lr 1.00e-05 gnorm 0.294 3.04s mem 81.1GB +[2026-09-12 06:32:18] step 862/5000 loss 0.3210 (w 0.2549 mse 0.2657 t 857 new 0.23) lr 1.00e-05 gnorm 1.152 3.39s mem 81.1GB +[2026-09-12 06:32:20] step 863/5000 loss 0.3475 (w 0.4187 mse 0.4236 t 979 new 0.10) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +[2026-09-12 06:32:24] step 864/5000 loss 0.3809 (w 0.3645 mse 0.3543 t 936 new 0.21) lr 1.00e-05 gnorm 0.196 3.39s mem 81.1GB +[2026-09-12 06:32:27] step 865/5000 loss 0.2049 (w 0.3215 mse 0.3370 t 1000 new 0.22) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +[2026-09-12 06:32:30] step 866/5000 loss 0.2925 (w 0.3104 mse 0.3136 t 922 new 0.11) lr 1.00e-05 gnorm 0.167 2.83s mem 81.1GB +[2026-09-12 06:32:33] step 867/5000 loss 0.1952 (w 0.2582 mse 0.2611 t 984 new 0.22) lr 1.00e-05 gnorm 0.185 3.09s mem 81.1GB +[2026-09-12 06:32:36] step 868/5000 loss 0.2584 (w 0.1856 mse 0.2107 t 857 new 0.21) lr 1.00e-05 gnorm 0.165 3.04s mem 81.1GB +[2026-09-12 06:32:39] step 869/5000 loss 0.2361 (w 0.3129 mse 0.3211 t 855 new 0.22) lr 1.00e-05 gnorm 0.259 2.82s mem 81.1GB +[2026-09-12 06:32:42] step 870/5000 loss 0.3143 (w 0.2811 mse 0.2782 t 768 new 0.21) lr 1.00e-05 gnorm 0.140 3.32s mem 81.1GB +[2026-09-12 06:32:45] step 871/5000 loss 0.3562 (w 0.1761 mse 0.1849 t 886 new 0.10) lr 1.00e-05 gnorm 0.124 3.12s mem 81.1GB +[2026-09-12 06:32:48] step 872/5000 loss 0.3593 (w 0.2849 mse 0.2904 t 676 new 0.21) lr 1.00e-05 gnorm 0.159 2.82s mem 81.1GB +[2026-09-12 06:32:51] step 873/5000 loss 0.3016 (w 0.2724 mse 0.2763 t 742 new 0.21) lr 1.00e-05 gnorm 0.129 3.09s mem 81.1GB +[2026-09-12 06:32:54] step 874/5000 loss 0.3773 (w 0.4912 mse 0.4989 t 989 new 0.15) lr 1.00e-05 gnorm 0.150 3.08s mem 81.1GB +[2026-09-12 06:32:57] step 875/5000 loss 0.3076 (w 0.3703 mse 0.3665 t 668 new 0.08) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +[2026-09-12 06:33:00] step 876/5000 loss 0.3417 (w 0.3533 mse 0.3626 t 992 new 0.18) lr 1.00e-05 gnorm 0.142 3.31s mem 81.1GB +[2026-09-12 06:33:03] step 877/5000 loss 0.2615 (w 0.3633 mse 0.3757 t 964 new 0.21) lr 1.00e-05 gnorm 0.154 3.01s mem 81.1GB +[2026-09-12 06:33:06] step 878/5000 loss 0.3663 (w 0.3880 mse 0.3926 t 414 new 0.18) lr 1.00e-05 gnorm 0.174 2.82s mem 81.1GB +[2026-09-12 06:33:10] step 879/5000 loss 0.1375 (w 0.2470 mse 0.2536 t 899 new 0.21) lr 1.00e-05 gnorm 0.139 3.43s mem 81.1GB +[2026-09-12 06:33:13] step 880/5000 loss 0.3306 (w 0.3599 mse 0.3700 t 690 new 0.15) lr 1.00e-05 gnorm 0.150 2.82s mem 81.1GB +[2026-09-12 06:33:16] step 881/5000 loss 0.2202 (w 0.2381 mse 0.2533 t 860 new 0.22) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +[2026-09-12 06:33:19] step 882/5000 loss 0.2069 (w 0.3547 mse 0.3601 t 970 new 0.24) lr 1.00e-05 gnorm 0.168 3.28s mem 81.1GB +[2026-09-12 06:33:22] step 883/5000 loss 0.3213 (w 0.2632 mse 0.2826 t 991 new 0.14) lr 1.00e-05 gnorm 0.138 3.06s mem 81.1GB +[2026-09-12 06:33:25] step 884/5000 loss 0.3171 (w 0.3182 mse 0.3309 t 950 new 0.28) lr 1.00e-05 gnorm 0.168 2.82s mem 81.1GB +[2026-09-12 06:33:28] step 885/5000 loss 0.1686 (w 0.2802 mse 0.2787 t 845 new 0.21) lr 1.00e-05 gnorm 0.163 3.38s mem 81.1GB +[2026-09-12 06:33:31] step 886/5000 loss 0.1900 (w 0.2401 mse 0.2538 t 568 new 0.21) lr 1.00e-05 gnorm 0.197 2.83s mem 81.1GB +[2026-09-12 06:33:34] step 887/5000 loss 0.2112 (w 0.8238 mse 0.7721 t 996 new 0.19) lr 1.00e-05 gnorm 0.238 3.04s mem 81.1GB +[2026-09-12 06:33:37] step 888/5000 loss 0.3130 (w 0.2658 mse 0.2828 t 574 new 0.13) lr 1.00e-05 gnorm 0.234 3.28s mem 81.1GB +[2026-09-12 06:33:40] step 889/5000 loss 0.3112 (w 0.3198 mse 0.3159 t 881 new 0.27) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +[2026-09-12 06:33:43] step 890/5000 loss 0.2798 (w 0.3295 mse 0.3314 t 990 new 0.16) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +[2026-09-12 06:33:46] step 891/5000 loss 0.1622 (w 0.2825 mse 0.2912 t 827 new 0.19) lr 1.00e-05 gnorm 0.136 3.40s mem 81.1GB +[2026-09-12 06:33:49] step 892/5000 loss 0.1646 (w 0.3410 mse 0.3539 t 981 new 0.22) lr 1.00e-05 gnorm 0.214 2.83s mem 81.1GB +[2026-09-12 06:33:52] step 893/5000 loss 0.2670 (w 0.2330 mse 0.2440 t 858 new 0.24) lr 1.00e-05 gnorm 0.204 3.04s mem 81.1GB +[2026-09-12 06:33:56] step 894/5000 loss 0.2920 (w 0.3302 mse 0.3473 t 390 new 0.21) lr 1.00e-05 gnorm 0.135 3.30s mem 81.1GB +[2026-09-12 06:33:58] step 895/5000 loss 0.3311 (w 0.3888 mse 0.3835 t 259 new 0.21) lr 1.00e-05 gnorm 0.135 2.82s mem 81.1GB +[2026-09-12 06:34:01] step 896/5000 loss 0.2061 (w 0.2013 mse 0.2154 t 835 new 0.21) lr 1.00e-05 gnorm 0.149 3.02s mem 81.1GB +[2026-09-12 06:34:05] step 897/5000 loss 0.4151 (w 0.4013 mse 0.4093 t 292 new 0.17) lr 1.00e-05 gnorm 0.157 3.38s mem 81.1GB +[2026-09-12 06:34:08] step 898/5000 loss 0.3216 (w 0.2393 mse 0.2543 t 758 new 0.19) lr 1.00e-05 gnorm 0.117 2.82s mem 81.1GB +[2026-09-12 06:34:11] step 899/5000 loss 0.3530 (w 0.3506 mse 0.3468 t 903 new 0.19) lr 1.00e-05 gnorm 0.147 3.09s mem 81.1GB +[2026-09-12 06:34:14] step 900/5000 loss 0.4817 (w 0.2272 mse 0.2319 t 901 new 0.23) lr 1.00e-05 gnorm 0.154 3.33s mem 81.1GB +[2026-09-12 06:34:17] step 901/5000 loss 0.2919 (w 0.3840 mse 0.3816 t 958 new 0.08) lr 1.00e-05 gnorm 0.187 2.83s mem 81.1GB +[2026-09-12 06:34:20] step 902/5000 loss 0.3349 (w 0.3479 mse 0.3423 t 924 new 0.23) lr 1.00e-05 gnorm 0.168 3.14s mem 81.1GB +[2026-09-12 06:34:23] step 903/5000 loss 0.1514 (w 0.3481 mse 0.3577 t 964 new 0.23) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +[2026-09-12 06:34:26] step 904/5000 loss 0.1817 (w 0.3362 mse 0.3444 t 969 new 0.30) lr 1.00e-05 gnorm 0.203 2.83s mem 81.1GB +[2026-09-12 06:34:29] step 905/5000 loss 0.1222 (w 0.1824 mse 0.2097 t 924 new 0.18) lr 1.00e-05 gnorm 0.147 3.29s mem 81.1GB +[2026-09-12 06:34:33] step 906/5000 loss 0.3481 (w 0.1409 mse 0.1527 t 727 new 0.14) lr 1.00e-05 gnorm 0.359 3.37s mem 81.1GB +[2026-09-12 06:34:35] step 907/5000 loss 0.2745 (w 0.2695 mse 0.2663 t 852 new 0.18) lr 1.00e-05 gnorm 0.111 2.81s mem 81.1GB +[2026-09-12 06:34:38] step 908/5000 loss 0.1803 (w 0.4088 mse 0.4191 t 411 new 0.16) lr 1.00e-05 gnorm 0.147 3.06s mem 81.1GB +[2026-09-12 06:34:42] step 909/5000 loss 0.4308 (w 0.3097 mse 0.3265 t 447 new 0.23) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +[2026-09-12 06:34:44] step 910/5000 loss 0.1975 (w 0.2373 mse 0.2475 t 943 new 0.21) lr 1.00e-05 gnorm 0.110 2.83s mem 81.1GB +[2026-09-12 06:34:48] step 911/5000 loss 0.4077 (w 0.3515 mse 0.3532 t 905 new 0.22) lr 1.00e-05 gnorm 0.127 3.29s mem 81.1GB +[2026-09-12 06:34:51] step 912/5000 loss 0.2761 (w 0.2610 mse 0.2699 t 945 new 0.20) lr 1.00e-05 gnorm 0.106 3.08s mem 81.1GB +[2026-09-12 06:34:54] step 913/5000 loss 0.3844 (w 0.3290 mse 0.3338 t 670 new 0.20) lr 1.00e-05 gnorm 0.349 2.83s mem 81.1GB +[2026-09-12 06:34:57] step 914/5000 loss 0.3168 (w 0.2498 mse 0.2563 t 319 new 0.19) lr 1.00e-05 gnorm 0.120 3.11s mem 81.1GB +[2026-09-12 06:35:00] step 915/5000 loss 0.4752 (w 0.2605 mse 0.2804 t 698 new 0.23) lr 1.00e-05 gnorm 0.185 3.04s mem 81.1GB +[2026-09-12 06:35:03] step 916/5000 loss 0.5209 (w 0.3145 mse 0.3140 t 883 new 0.19) lr 1.00e-05 gnorm 0.140 2.82s mem 81.1GB +[2026-09-12 06:35:06] step 917/5000 loss 0.3409 (w 0.3222 mse 0.3138 t 910 new 0.19) lr 1.00e-05 gnorm 0.173 3.31s mem 81.1GB +[2026-09-12 06:35:09] step 918/5000 loss 0.2486 (w 0.3437 mse 0.3441 t 839 new 0.13) lr 1.00e-05 gnorm 0.134 3.20s mem 81.1GB +[2026-09-12 06:35:12] step 919/5000 loss 0.3179 (w 0.6294 mse 0.6491 t 120 new 0.23) lr 1.00e-05 gnorm 0.549 2.83s mem 81.1GB +[2026-09-12 06:35:15] step 920/5000 loss 0.3488 (w 0.4031 mse 0.3960 t 607 new 0.08) lr 1.00e-05 gnorm 0.205 3.12s mem 81.1GB +[2026-09-12 06:35:18] step 921/5000 loss 0.3287 (w 0.2605 mse 0.2757 t 999 new 0.10) lr 1.00e-05 gnorm 0.180 3.12s mem 81.1GB +[2026-09-12 06:35:21] step 922/5000 loss 0.4492 (w 0.3225 mse 0.3304 t 953 new 0.17) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +[2026-09-12 06:35:24] step 923/5000 loss 0.3772 (w 0.2421 mse 0.2565 t 943 new 0.22) lr 1.00e-05 gnorm 0.212 3.15s mem 81.1GB +[2026-09-12 06:35:28] step 924/5000 loss 0.3355 (w 0.2403 mse 0.2436 t 551 new 0.08) lr 1.00e-05 gnorm 0.144 3.07s mem 81.1GB +[2026-09-12 06:35:30] step 925/5000 loss 0.4454 (w 0.2729 mse 0.2919 t 935 new 0.28) lr 1.00e-05 gnorm 0.160 2.82s mem 81.1GB +[2026-09-12 06:35:34] step 926/5000 loss 0.2828 (w 0.3487 mse 0.3521 t 572 new 0.16) lr 1.00e-05 gnorm 0.135 3.13s mem 81.1GB +[2026-09-12 06:35:37] step 927/5000 loss 0.3141 (w 0.3116 mse 0.3128 t 950 new 0.24) lr 1.00e-05 gnorm 0.205 3.10s mem 81.1GB +[2026-09-12 06:35:40] step 928/5000 loss 0.2443 (w 0.3443 mse 0.3457 t 973 new 0.16) lr 1.00e-05 gnorm 0.133 3.11s mem 81.1GB +[2026-09-12 06:35:43] step 929/5000 loss 0.2929 (w 0.4036 mse 0.3958 t 953 new 0.28) lr 1.00e-05 gnorm 0.145 3.23s mem 81.1GB +[2026-09-12 06:35:46] step 930/5000 loss 0.2743 (w 0.2708 mse 0.2642 t 832 new 0.19) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +[2026-09-12 06:35:49] step 931/5000 loss 0.2351 (w 0.3697 mse 0.3732 t 994 new 0.22) lr 1.00e-05 gnorm 0.165 3.07s mem 81.1GB +[2026-09-12 06:35:52] step 932/5000 loss 0.2579 (w 0.1886 mse 0.2021 t 876 new 0.19) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-12 06:35:55] step 933/5000 loss 0.2323 (w 0.4131 mse 0.4125 t 999 new 0.16) lr 1.00e-05 gnorm 0.653 3.15s mem 81.1GB +[2026-09-12 06:35:58] step 934/5000 loss 0.2238 (w 0.3525 mse 0.3891 t 183 new 0.20) lr 1.00e-05 gnorm 0.178 3.07s mem 81.1GB +[2026-09-12 06:36:01] step 935/5000 loss 0.2954 (w 0.3190 mse 0.3264 t 283 new 0.09) lr 1.00e-05 gnorm 0.153 3.32s mem 81.1GB +[2026-09-12 06:36:04] step 936/5000 loss 0.3415 (w 0.2252 mse 0.2386 t 748 new 0.22) lr 1.00e-05 gnorm 0.175 2.83s mem 81.1GB +[2026-09-12 06:36:07] step 937/5000 loss 0.3776 (w 0.3056 mse 0.3162 t 562 new 0.10) lr 1.00e-05 gnorm 0.127 3.12s mem 81.1GB +[2026-09-12 06:36:10] step 938/5000 loss 0.1861 (w 0.2783 mse 0.2858 t 977 new 0.11) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +[2026-09-12 06:36:13] step 939/5000 loss 0.2554 (w 0.2810 mse 0.2861 t 836 new 0.21) lr 1.00e-05 gnorm 0.128 3.12s mem 81.1GB +[2026-09-12 06:36:16] step 940/5000 loss 0.2521 (w 0.1947 mse 0.2155 t 853 new 0.18) lr 1.00e-05 gnorm 0.148 3.28s mem 81.1GB +[2026-09-12 06:36:20] step 941/5000 loss 0.2292 (w 0.3808 mse 0.3689 t 981 new 0.20) lr 1.00e-05 gnorm 0.149 3.33s mem 81.1GB +[2026-09-12 06:36:23] step 942/5000 loss 0.3385 (w 0.2812 mse 0.2965 t 901 new 0.19) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +[2026-09-12 06:36:26] step 943/5000 loss 0.2098 (w 0.2706 mse 0.2841 t 933 new 0.20) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +[2026-09-12 06:36:29] step 944/5000 loss 0.1980 (w 0.4773 mse 0.4781 t 975 new 0.24) lr 1.00e-05 gnorm 0.252 2.84s mem 81.1GB +[2026-09-12 06:36:32] step 945/5000 loss 0.3220 (w 0.4334 mse 0.4376 t 991 new 0.22) lr 1.00e-05 gnorm 0.142 3.08s mem 81.1GB +[2026-09-12 06:36:35] step 946/5000 loss 0.3101 (w 0.3793 mse 0.3792 t 932 new 0.25) lr 1.00e-05 gnorm 0.137 3.24s mem 81.1GB +[2026-09-12 06:36:38] step 947/5000 loss 0.2364 (w 0.3357 mse 0.3302 t 913 new 0.11) lr 1.00e-05 gnorm 0.144 3.37s mem 81.1GB +[2026-09-12 06:36:41] step 948/5000 loss 0.2730 (w 0.2885 mse 0.2922 t 663 new 0.14) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +[2026-09-12 06:36:44] step 949/5000 loss 0.1942 (w 0.3309 mse 0.3444 t 965 new 0.24) lr 1.00e-05 gnorm 0.137 3.05s mem 81.1GB +[2026-09-12 06:36:47] step 950/5000 loss 0.3049 (w 0.2566 mse 0.2892 t 431 new 0.23) lr 1.00e-05 gnorm 0.144 2.82s mem 81.1GB +[2026-09-12 06:36:50] step 951/5000 loss 0.2379 (w 0.1894 mse 0.1905 t 909 new 0.12) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +[2026-09-12 06:36:53] step 952/5000 loss 0.4214 (w 0.3185 mse 0.3263 t 927 new 0.22) lr 1.00e-05 gnorm 0.149 3.25s mem 81.1GB +[2026-09-12 06:36:56] step 953/5000 loss 0.1463 (w 0.4674 mse 0.4706 t 996 new 0.19) lr 1.00e-05 gnorm 0.119 3.09s mem 81.1GB +[2026-09-12 06:36:59] step 954/5000 loss 0.1768 (w 0.4057 mse 0.4043 t 983 new 0.23) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +[2026-09-12 06:37:02] step 955/5000 loss 0.2643 (w 0.2113 mse 0.2122 t 839 new 0.24) lr 1.00e-05 gnorm 0.144 3.06s mem 81.1GB +[2026-09-12 06:37:05] step 956/5000 loss 0.2622 (w 0.3075 mse 0.3170 t 916 new 0.24) lr 1.00e-05 gnorm 0.126 3.09s mem 81.1GB +[2026-09-12 06:37:08] step 957/5000 loss 0.3224 (w 0.2882 mse 0.2921 t 833 new 0.24) lr 1.00e-05 gnorm 0.291 2.81s mem 81.1GB +[2026-09-12 06:37:12] step 958/5000 loss 0.4315 (w 0.3699 mse 0.3823 t 977 new 0.17) lr 1.00e-05 gnorm 0.128 3.34s mem 81.1GB +[2026-09-12 06:37:15] step 959/5000 loss 0.2884 (w 0.2629 mse 0.2822 t 951 new 0.20) lr 1.00e-05 gnorm 0.289 3.35s mem 81.1GB +[2026-09-12 06:37:18] step 960/5000 loss 0.3341 (w 0.2993 mse 0.3053 t 601 new 0.16) lr 1.00e-05 gnorm 0.173 3.05s mem 81.1GB +[2026-09-12 06:37:21] step 961/5000 loss 0.2710 (w 0.2427 mse 0.2547 t 819 new 0.18) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +[2026-09-12 06:37:24] step 962/5000 loss 0.1705 (w 0.2654 mse 0.2818 t 983 new 0.18) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +[2026-09-12 06:37:27] step 963/5000 loss 0.3964 (w 0.4955 mse 0.4859 t 986 new 0.23) lr 1.00e-05 gnorm 0.190 2.84s mem 81.1GB +[2026-09-12 06:37:30] step 964/5000 loss 0.2241 (w 0.2585 mse 0.2569 t 900 new 0.09) lr 1.00e-05 gnorm 0.141 3.61s mem 81.1GB +[2026-09-12 06:37:33] step 965/5000 loss 0.3295 (w 0.3069 mse 0.3017 t 813 new 0.25) lr 1.00e-05 gnorm 0.166 3.04s mem 81.1GB +[2026-09-12 06:37:36] step 966/5000 loss 0.2044 (w 0.2233 mse 0.2427 t 941 new 0.28) lr 1.00e-05 gnorm 0.153 3.06s mem 81.1GB +[2026-09-12 06:37:39] step 967/5000 loss 0.2094 (w 0.3270 mse 0.3335 t 925 new 0.27) lr 1.00e-05 gnorm 0.146 2.84s mem 81.1GB +[2026-09-12 06:37:42] step 968/5000 loss 0.3077 (w 0.2087 mse 0.2192 t 907 new 0.20) lr 1.00e-05 gnorm 0.144 3.09s mem 81.1GB +[2026-09-12 06:37:45] step 969/5000 loss 0.2344 (w 0.3181 mse 0.3220 t 936 new 0.21) lr 1.00e-05 gnorm 0.228 3.07s mem 81.1GB +[2026-09-12 06:37:49] step 970/5000 loss 0.2448 (w 0.2026 mse 0.2202 t 905 new 0.22) lr 1.00e-05 gnorm 0.157 3.22s mem 81.1GB +[2026-09-12 06:37:52] step 971/5000 loss 0.3141 (w 0.3628 mse 0.3710 t 973 new 0.25) lr 1.00e-05 gnorm 0.177 3.07s mem 81.1GB +[2026-09-12 06:37:55] step 972/5000 loss 0.2982 (w 0.2567 mse 0.2690 t 781 new 0.23) lr 1.00e-05 gnorm 0.130 3.09s mem 81.1GB +[2026-09-12 06:37:58] step 973/5000 loss 0.4410 (w 0.3558 mse 0.3640 t 428 new 0.19) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +[2026-09-12 06:38:01] step 974/5000 loss 0.2571 (w 0.2959 mse 0.2970 t 851 new 0.20) lr 1.00e-05 gnorm 0.712 3.10s mem 81.1GB +[2026-09-12 06:38:04] step 975/5000 loss 0.4602 (w 0.2431 mse 0.2643 t 811 new 0.12) lr 1.00e-05 gnorm 0.324 3.09s mem 81.1GB +[2026-09-12 06:38:07] step 976/5000 loss 0.3452 (w 0.2614 mse 0.2713 t 872 new 0.23) lr 1.00e-05 gnorm 0.129 3.34s mem 81.1GB +[2026-09-12 06:38:10] step 977/5000 loss 0.4087 (w 0.2797 mse 0.2960 t 498 new 0.09) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +[2026-09-12 06:38:13] step 978/5000 loss 0.2946 (w 0.2081 mse 0.2277 t 861 new 0.20) lr 1.00e-05 gnorm 0.126 3.09s mem 81.1GB +[2026-09-12 06:38:16] step 979/5000 loss 0.2374 (w 0.3533 mse 0.3557 t 803 new 0.21) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +[2026-09-12 06:38:19] step 980/5000 loss 0.2168 (w 0.2719 mse 0.2736 t 788 new 0.23) lr 1.00e-05 gnorm 0.230 3.10s mem 81.1GB +[2026-09-12 06:38:23] step 981/5000 loss 0.1947 (w 0.2533 mse 0.2610 t 884 new 0.21) lr 1.00e-05 gnorm 0.184 3.40s mem 81.1GB +[2026-09-12 06:38:26] step 982/5000 loss 0.1614 (w 0.3206 mse 0.3211 t 590 new 0.27) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +[2026-09-12 06:38:29] step 983/5000 loss 0.3772 (w 0.2077 mse 0.2279 t 964 new 0.23) lr 1.00e-05 gnorm 0.188 3.10s mem 81.1GB +[2026-09-12 06:38:32] step 984/5000 loss 0.4255 (w 0.3459 mse 0.3486 t 621 new 0.20) lr 1.00e-05 gnorm 0.186 3.10s mem 81.1GB +[2026-09-12 06:38:35] step 985/5000 loss 0.1443 (w 0.3304 mse 0.3311 t 963 new 0.21) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +[2026-09-12 06:38:38] step 986/5000 loss 0.4207 (w 0.3133 mse 0.3042 t 763 new 0.17) lr 1.00e-05 gnorm 0.156 3.02s mem 81.1GB +[2026-09-12 06:38:41] step 987/5000 loss 0.3421 (w 0.2736 mse 0.2741 t 934 new 0.20) lr 1.00e-05 gnorm 0.150 3.23s mem 81.1GB +[2026-09-12 06:38:45] step 988/5000 loss 0.2935 (w 0.3166 mse 0.3250 t 974 new 0.25) lr 1.00e-05 gnorm 0.133 3.39s mem 81.1GB +[2026-09-12 06:38:47] step 989/5000 loss 0.3592 (w 0.3493 mse 0.3642 t 633 new 0.21) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +[2026-09-12 06:38:51] step 990/5000 loss 0.5152 (w 0.2154 mse 0.2218 t 889 new 0.11) lr 1.00e-05 gnorm 0.146 3.34s mem 81.1GB +[2026-09-12 06:38:54] step 991/5000 loss 0.4374 (w 0.2535 mse 0.2622 t 624 new 0.20) lr 1.00e-05 gnorm 0.149 2.82s mem 81.1GB +[2026-09-12 06:38:57] step 992/5000 loss 0.2319 (w 0.2058 mse 0.2151 t 873 new 0.12) lr 1.00e-05 gnorm 0.170 3.03s mem 81.1GB +[2026-09-12 06:39:00] step 993/5000 loss 0.3935 (w 0.4379 mse 0.4269 t 998 new 0.19) lr 1.00e-05 gnorm 0.117 3.33s mem 81.1GB +[2026-09-12 06:39:03] step 994/5000 loss 0.3989 (w 0.2468 mse 0.2555 t 913 new 0.11) lr 1.00e-05 gnorm 0.136 3.37s mem 81.1GB +[2026-09-12 06:39:06] step 995/5000 loss 0.2318 (w 0.2541 mse 0.2584 t 754 new 0.23) lr 1.00e-05 gnorm 0.142 2.82s mem 81.1GB +[2026-09-12 06:39:09] step 996/5000 loss 0.2893 (w 0.2766 mse 0.2975 t 946 new 0.25) lr 1.00e-05 gnorm 0.115 3.10s mem 81.1GB +[2026-09-12 06:39:12] step 997/5000 loss 0.1639 (w 0.2747 mse 0.2823 t 968 new 0.24) lr 1.00e-05 gnorm 0.116 2.83s mem 81.1GB +[2026-09-12 06:39:15] step 998/5000 loss 0.2652 (w 0.2587 mse 0.2734 t 875 new 0.24) lr 1.00e-05 gnorm 0.173 3.43s mem 81.1GB +[2026-09-12 06:39:19] step 999/5000 loss 0.3188 (w 0.2095 mse 0.2302 t 870 new 0.25) lr 1.00e-05 gnorm 0.170 3.12s mem 81.1GB +[2026-09-12 06:39:22] step 1000/5000 loss 0.1964 (w 0.2870 mse 0.2886 t 933 new 0.16) lr 1.00e-05 gnorm 0.113 3.38s mem 81.1GB +[2026-09-12 06:39:24] [val] step 1000 t=200: w=0.4800 mse=0.4984 (n=16) t=500: w=0.2916 mse=0.3069 (n=16) t=800: w=0.2466 mse=0.2590 (n=16) | mean w=0.3394 mse=0.3548 2s +[2026-09-12 06:40:10] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step1000.safetensors 4093 个张量 37.98 GB +[2026-09-12 06:40:16] step 1001/5000 loss 0.4024 (w 0.4649 mse 0.4596 t 985 new 0.19) lr 1.00e-05 gnorm 0.165 3.49s mem 81.1GB +[2026-09-12 06:40:19] step 1002/5000 loss 0.0887 (w 0.3109 mse 0.3109 t 932 new 0.24) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +[2026-09-12 06:40:22] step 1003/5000 loss 0.2652 (w 0.6791 mse 0.6730 t 114 new 0.16) lr 1.00e-05 gnorm 0.236 3.15s mem 81.1GB +[2026-09-12 06:40:25] step 1004/5000 loss 0.3610 (w 0.3592 mse 0.3641 t 923 new 0.22) lr 1.00e-05 gnorm 0.187 2.83s mem 81.1GB +[2026-09-12 06:40:28] step 1005/5000 loss 0.2568 (w 0.3383 mse 0.3604 t 484 new 0.25) lr 1.00e-05 gnorm 0.206 3.27s mem 81.1GB +[2026-09-12 06:40:31] step 1006/5000 loss 0.2994 (w 0.3348 mse 0.3438 t 967 new 0.20) lr 1.00e-05 gnorm 0.183 3.09s mem 81.1GB +[2026-09-12 06:40:34] step 1007/5000 loss 0.2819 (w 0.3367 mse 0.3506 t 976 new 0.25) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +[2026-09-12 06:40:37] step 1008/5000 loss 0.2561 (w 0.3207 mse 0.3222 t 964 new 0.20) lr 1.00e-05 gnorm 0.209 3.10s mem 81.1GB +[2026-09-12 06:40:40] step 1009/5000 loss 0.1970 (w 0.3008 mse 0.3090 t 762 new 0.25) lr 1.00e-05 gnorm 0.159 3.14s mem 81.1GB +[2026-09-12 06:40:43] step 1010/5000 loss 0.1867 (w 0.2862 mse 0.2931 t 924 new 0.29) lr 1.00e-05 gnorm 0.164 2.83s mem 81.1GB +[2026-09-12 06:40:46] step 1011/5000 loss 0.3554 (w 0.3303 mse 0.3528 t 670 new 0.17) lr 1.00e-05 gnorm 0.127 3.28s mem 81.1GB +[2026-09-12 06:40:49] step 1012/5000 loss 0.2475 (w 0.2816 mse 0.2846 t 715 new 0.16) lr 1.00e-05 gnorm 0.130 3.02s mem 81.1GB +[2026-09-12 06:40:53] step 1013/5000 loss 0.2259 (w 0.3242 mse 0.3365 t 885 new 0.25) lr 1.00e-05 gnorm 0.123 3.06s mem 81.1GB +[2026-09-12 06:40:55] step 1014/5000 loss 0.4618 (w 0.4265 mse 0.4375 t 283 new 0.20) lr 1.00e-05 gnorm 0.232 2.84s mem 81.1GB +[2026-09-12 06:40:59] step 1015/5000 loss 0.3337 (w 0.3530 mse 0.3575 t 966 new 0.23) lr 1.00e-05 gnorm 0.140 3.36s mem 81.1GB +[2026-09-12 06:41:02] step 1016/5000 loss 0.2933 (w 0.3117 mse 0.3197 t 973 new 0.22) lr 1.00e-05 gnorm 0.119 2.82s mem 81.1GB +[2026-09-12 06:41:05] step 1017/5000 loss 0.4360 (w 0.3145 mse 0.3151 t 670 new 0.20) lr 1.00e-05 gnorm 0.164 3.30s mem 81.1GB +[2026-09-12 06:41:08] step 1018/5000 loss 0.3810 (w 0.2429 mse 0.2634 t 902 new 0.23) lr 1.00e-05 gnorm 0.152 3.07s mem 81.1GB +[2026-09-12 06:41:11] step 1019/5000 loss 0.1221 (w 0.3444 mse 0.3507 t 975 new 0.22) lr 1.00e-05 gnorm 0.096 3.11s mem 81.1GB +[2026-09-12 06:41:14] step 1020/5000 loss 0.2618 (w 0.2802 mse 0.2926 t 865 new 0.24) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +[2026-09-12 06:41:17] step 1021/5000 loss 0.3100 (w 0.3444 mse 0.3580 t 918 new 0.19) lr 1.00e-05 gnorm 0.141 3.34s mem 81.1GB +[2026-09-12 06:41:20] step 1022/5000 loss 0.3742 (w 0.2805 mse 0.2885 t 871 new 0.18) lr 1.00e-05 gnorm 0.210 3.05s mem 81.1GB +[2026-09-12 06:41:23] step 1023/5000 loss 0.3310 (w 0.6634 mse 0.6848 t 120 new 0.19) lr 1.00e-05 gnorm 0.121 3.07s mem 81.1GB +[2026-09-12 06:41:27] step 1024/5000 loss 0.2645 (w 0.3439 mse 0.3559 t 986 new 0.21) lr 1.00e-05 gnorm 0.245 3.15s mem 81.1GB +[2026-09-12 06:41:30] step 1025/5000 loss 0.2368 (w 0.2835 mse 0.2951 t 895 new 0.22) lr 1.00e-05 gnorm 0.202 3.07s mem 81.1GB +[2026-09-12 06:41:32] step 1026/5000 loss 0.1927 (w 0.3379 mse 0.3353 t 933 new 0.18) lr 1.00e-05 gnorm 0.142 2.82s mem 81.1GB +[2026-09-12 06:41:36] step 1027/5000 loss 0.3357 (w 0.4082 mse 0.4141 t 310 new 0.18) lr 1.00e-05 gnorm 0.131 3.35s mem 81.1GB +[2026-09-12 06:41:39] step 1028/5000 loss 0.2605 (w 0.4893 mse 0.4637 t 997 new 0.25) lr 1.00e-05 gnorm 0.122 3.09s mem 81.1GB +[2026-09-12 06:41:42] step 1029/5000 loss 0.3494 (w 0.3599 mse 0.3490 t 749 new 0.23) lr 1.00e-05 gnorm 0.132 3.26s mem 81.1GB +[2026-09-12 06:41:45] step 1030/5000 loss 0.1843 (w 0.2386 mse 0.2651 t 966 new 0.21) lr 1.00e-05 gnorm 0.165 3.09s mem 81.1GB +[2026-09-12 06:41:48] step 1031/5000 loss 0.3626 (w 0.5229 mse 0.5307 t 297 new 0.14) lr 1.00e-05 gnorm 0.184 3.10s mem 81.1GB +[2026-09-12 06:41:51] step 1032/5000 loss 0.2277 (w 0.3508 mse 0.3575 t 932 new 0.07) lr 1.00e-05 gnorm 0.125 2.83s mem 81.1GB +[2026-09-12 06:41:54] step 1033/5000 loss 0.2812 (w 0.2814 mse 0.2835 t 822 new 0.18) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +[2026-09-12 06:41:57] step 1034/5000 loss 0.2708 (w 0.3110 mse 0.3143 t 978 new 0.21) lr 1.00e-05 gnorm 0.169 3.16s mem 81.1GB +[2026-09-12 06:42:01] step 1035/5000 loss 0.2997 (w 0.3992 mse 0.3785 t 933 new 0.23) lr 1.00e-05 gnorm 0.133 3.31s mem 81.1GB +[2026-09-12 06:42:04] step 1036/5000 loss 0.2178 (w 0.2179 mse 0.2296 t 913 new 0.21) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +[2026-09-12 06:42:07] step 1037/5000 loss 0.3743 (w 0.1947 mse 0.2065 t 923 new 0.17) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +[2026-09-12 06:42:10] step 1038/5000 loss 0.2522 (w 0.2686 mse 0.2732 t 829 new 0.18) lr 1.00e-05 gnorm 0.119 3.05s mem 81.1GB +[2026-09-12 06:42:13] step 1039/5000 loss 0.2426 (w 0.2492 mse 0.2528 t 802 new 0.06) lr 1.00e-05 gnorm 0.177 3.10s mem 81.1GB +[2026-09-12 06:42:16] step 1040/5000 loss 0.4220 (w 0.3410 mse 0.3576 t 644 new 0.27) lr 1.00e-05 gnorm 0.169 3.03s mem 81.1GB +[2026-09-12 06:42:19] step 1041/5000 loss 0.3684 (w 0.3662 mse 0.3639 t 768 new 0.17) lr 1.00e-05 gnorm 0.182 3.35s mem 81.1GB +[2026-09-12 06:42:22] step 1042/5000 loss 0.3363 (w 0.2149 mse 0.2208 t 807 new 0.11) lr 1.00e-05 gnorm 0.126 3.08s mem 81.1GB +[2026-09-12 06:42:25] step 1043/5000 loss 0.3732 (w 0.2205 mse 0.2277 t 668 new 0.21) lr 1.00e-05 gnorm 0.258 2.82s mem 81.1GB +[2026-09-12 06:42:28] step 1044/5000 loss 0.2641 (w 0.2488 mse 0.2716 t 490 new 0.14) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +[2026-09-12 06:42:31] step 1045/5000 loss 0.1119 (w 0.2515 mse 0.2627 t 922 new 0.18) lr 1.00e-05 gnorm 0.111 3.07s mem 81.1GB +[2026-09-12 06:42:35] step 1046/5000 loss 0.5440 (w 0.2674 mse 0.2720 t 683 new 0.24) lr 1.00e-05 gnorm 0.142 3.29s mem 81.1GB +[2026-09-12 06:42:38] step 1047/5000 loss 0.3042 (w 0.3170 mse 0.3381 t 976 new 0.21) lr 1.00e-05 gnorm 0.212 3.13s mem 81.1GB +[2026-09-12 06:42:41] step 1048/5000 loss 0.1781 (w 0.2352 mse 0.2563 t 914 new 0.20) lr 1.00e-05 gnorm 0.142 3.47s mem 81.1GB +[2026-09-12 06:42:44] step 1049/5000 loss 0.2557 (w 0.3344 mse 0.3391 t 915 new 0.27) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +[2026-09-12 06:42:47] step 1050/5000 loss 0.2952 (w 0.3455 mse 0.3437 t 820 new 0.11) lr 1.00e-05 gnorm 0.222 3.10s mem 81.1GB +[2026-09-12 06:42:50] step 1051/5000 loss 0.3615 (w 0.2679 mse 0.2798 t 397 new 0.17) lr 1.00e-05 gnorm 0.390 3.11s mem 81.1GB +[2026-09-12 06:42:53] step 1052/5000 loss 0.3632 (w 0.3904 mse 0.3937 t 336 new 0.24) lr 1.00e-05 gnorm 0.592 3.06s mem 81.1GB +[2026-09-12 06:42:56] step 1053/5000 loss 0.2610 (w 0.3734 mse 0.3834 t 428 new 0.19) lr 1.00e-05 gnorm 0.120 3.09s mem 81.1GB +[2026-09-12 06:42:59] step 1054/5000 loss 0.3044 (w 0.3697 mse 0.3770 t 983 new 0.17) lr 1.00e-05 gnorm 0.144 3.06s mem 81.1GB +[2026-09-12 06:43:02] step 1055/5000 loss 0.3133 (w 0.2161 mse 0.2230 t 741 new 0.13) lr 1.00e-05 gnorm 0.203 2.82s mem 81.1GB +[2026-09-12 06:43:06] step 1056/5000 loss 0.4306 (w 0.4387 mse 0.4360 t 964 new 0.12) lr 1.00e-05 gnorm 0.155 3.28s mem 81.1GB +[2026-09-12 06:43:09] step 1057/5000 loss 0.2620 (w 0.2772 mse 0.2782 t 891 new 0.20) lr 1.00e-05 gnorm 0.156 3.11s mem 81.1GB +[2026-09-12 06:43:12] step 1058/5000 loss 0.2357 (w 0.3781 mse 0.3734 t 971 new 0.23) lr 1.00e-05 gnorm 0.129 3.06s mem 81.1GB +[2026-09-12 06:43:15] step 1059/5000 loss 0.1555 (w 0.2297 mse 0.2555 t 586 new 0.20) lr 1.00e-05 gnorm 1.062 3.09s mem 81.1GB +[2026-09-12 06:43:18] step 1060/5000 loss 0.2872 (w 0.2497 mse 0.2559 t 975 new 0.17) lr 1.00e-05 gnorm 0.143 3.15s mem 81.1GB +[2026-09-12 06:43:21] step 1061/5000 loss 0.3545 (w 0.2439 mse 0.2610 t 946 new 0.25) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +[2026-09-12 06:43:24] step 1062/5000 loss 0.2753 (w 0.1986 mse 0.2208 t 761 new 0.23) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +[2026-09-12 06:43:27] step 1063/5000 loss 0.2399 (w 0.1991 mse 0.1929 t 827 new 0.13) lr 1.00e-05 gnorm 0.100 3.14s mem 81.1GB +[2026-09-12 06:43:30] step 1064/5000 loss 0.3105 (w 0.3966 mse 0.3874 t 984 new 0.21) lr 1.00e-05 gnorm 0.148 3.22s mem 81.1GB +[2026-09-12 06:43:33] step 1065/5000 loss 0.2472 (w 0.1952 mse 0.1971 t 790 new 0.15) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +[2026-09-12 06:43:37] step 1066/5000 loss 0.3478 (w 0.2824 mse 0.3132 t 973 new 0.22) lr 1.00e-05 gnorm 0.136 3.05s mem 81.1GB +[2026-09-12 06:43:40] step 1067/5000 loss 0.4717 (w 0.3265 mse 0.3320 t 987 new 0.18) lr 1.00e-05 gnorm 0.186 3.03s mem 81.1GB +[2026-09-12 06:43:43] step 1068/5000 loss 0.3116 (w 0.2599 mse 0.2865 t 989 new 0.28) lr 1.00e-05 gnorm 0.156 3.07s mem 81.1GB +[2026-09-12 06:43:46] step 1069/5000 loss 0.3058 (w 0.6740 mse 0.7002 t 999 new 0.16) lr 1.00e-05 gnorm 0.147 3.06s mem 81.1GB +[2026-09-12 06:43:49] step 1070/5000 loss 0.2498 (w 0.3133 mse 0.3222 t 962 new 0.25) lr 1.00e-05 gnorm 0.165 3.24s mem 81.1GB +[2026-09-12 06:43:52] step 1071/5000 loss 0.2676 (w 0.4726 mse 0.4784 t 986 new 0.29) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +[2026-09-12 06:43:55] step 1072/5000 loss 0.3150 (w 0.2407 mse 0.2565 t 753 new 0.11) lr 1.00e-05 gnorm 0.183 3.04s mem 81.1GB +[2026-09-12 06:43:58] step 1073/5000 loss 0.2653 (w 0.3892 mse 0.4141 t 249 new 0.12) lr 1.00e-05 gnorm 0.141 3.05s mem 81.1GB +[2026-09-12 06:44:01] step 1074/5000 loss 0.1923 (w 0.3188 mse 0.3243 t 960 new 0.25) lr 1.00e-05 gnorm 0.100 2.84s mem 81.1GB +[2026-09-12 06:44:04] step 1075/5000 loss 0.3819 (w 0.3914 mse 0.4053 t 970 new 0.25) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +[2026-09-12 06:44:07] step 1076/5000 loss 0.4051 (w 0.2728 mse 0.2716 t 983 new 0.19) lr 1.00e-05 gnorm 0.156 3.25s mem 81.1GB +[2026-09-12 06:44:10] step 1077/5000 loss 0.3782 (w 0.3164 mse 0.3242 t 915 new 0.24) lr 1.00e-05 gnorm 0.173 3.15s mem 81.1GB +[2026-09-12 06:44:14] step 1078/5000 loss 0.2628 (w 0.3171 mse 0.3256 t 610 new 0.23) lr 1.00e-05 gnorm 0.232 3.04s mem 81.1GB +[2026-09-12 06:44:17] step 1079/5000 loss 0.3292 (w 0.2942 mse 0.3152 t 939 new 0.19) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +[2026-09-12 06:44:19] step 1080/5000 loss 0.3338 (w 0.2697 mse 0.2695 t 798 new 0.14) lr 1.00e-05 gnorm 0.187 2.83s mem 81.1GB +[2026-09-12 06:44:22] step 1081/5000 loss 0.3615 (w 0.2869 mse 0.2780 t 742 new 0.24) lr 1.00e-05 gnorm 0.412 3.03s mem 81.1GB +[2026-09-12 06:44:26] step 1082/5000 loss 0.3182 (w 0.2842 mse 0.2968 t 852 new 0.24) lr 1.00e-05 gnorm 0.122 3.29s mem 81.1GB +[2026-09-12 06:44:29] step 1083/5000 loss 0.1073 (w 0.3563 mse 0.3566 t 993 new 0.26) lr 1.00e-05 gnorm 0.137 3.28s mem 81.1GB +[2026-09-12 06:44:32] step 1084/5000 loss 0.2322 (w 0.3299 mse 0.3334 t 984 new 0.14) lr 1.00e-05 gnorm 0.242 2.83s mem 81.1GB +[2026-09-12 06:44:35] step 1085/5000 loss 0.3876 (w 0.2574 mse 0.2717 t 913 new 0.23) lr 1.00e-05 gnorm 0.187 3.05s mem 81.1GB +[2026-09-12 06:44:38] step 1086/5000 loss 0.1943 (w 0.2144 mse 0.2254 t 690 new 0.25) lr 1.00e-05 gnorm 0.167 2.83s mem 81.1GB +[2026-09-12 06:44:41] step 1087/5000 loss 0.2980 (w 0.2240 mse 0.2456 t 914 new 0.22) lr 1.00e-05 gnorm 0.135 3.05s mem 81.1GB +[2026-09-12 06:44:44] step 1088/5000 loss 0.2036 (w 0.1375 mse 0.1555 t 730 new 0.13) lr 1.00e-05 gnorm 0.162 3.08s mem 81.1GB +[2026-09-12 06:44:47] step 1089/5000 loss 0.1823 (w 0.2529 mse 0.2568 t 801 new 0.22) lr 1.00e-05 gnorm 0.165 3.35s mem 81.1GB +[2026-09-12 06:44:50] step 1090/5000 loss 0.3193 (w 0.3134 mse 0.3172 t 992 new 0.16) lr 1.00e-05 gnorm 0.996 2.85s mem 81.1GB +[2026-09-12 06:44:53] step 1091/5000 loss 0.2272 (w 0.2611 mse 0.2691 t 986 new 0.25) lr 1.00e-05 gnorm 0.133 3.10s mem 81.1GB +[2026-09-12 06:44:57] step 1092/5000 loss 0.2800 (w 0.2641 mse 0.2700 t 850 new 0.21) lr 1.00e-05 gnorm 0.157 3.17s mem 81.1GB +[2026-09-12 06:45:00] step 1093/5000 loss 0.2488 (w 0.2076 mse 0.2273 t 669 new 0.21) lr 1.00e-05 gnorm 0.157 3.05s mem 81.1GB +[2026-09-12 06:45:03] step 1094/5000 loss 0.1636 (w 0.3123 mse 0.3286 t 965 new 0.17) lr 1.00e-05 gnorm 0.136 3.43s mem 81.1GB +[2026-09-12 06:45:06] step 1095/5000 loss 0.4119 (w 0.4282 mse 0.4280 t 418 new 0.16) lr 1.00e-05 gnorm 0.139 3.06s mem 81.1GB +[2026-09-12 06:45:09] step 1096/5000 loss 0.3237 (w 0.3172 mse 0.3610 t 986 new 0.26) lr 1.00e-05 gnorm 0.148 2.83s mem 81.1GB +[2026-09-12 06:45:12] step 1097/5000 loss 0.3841 (w 0.4161 mse 0.4007 t 976 new 0.14) lr 1.00e-05 gnorm 0.875 3.25s mem 81.1GB +[2026-09-12 06:45:15] step 1098/5000 loss 0.1688 (w 0.3314 mse 0.3460 t 939 new 0.14) lr 1.00e-05 gnorm 0.123 3.11s mem 81.1GB +[2026-09-12 06:45:18] step 1099/5000 loss 0.1892 (w 0.2621 mse 0.2791 t 482 new 0.21) lr 1.00e-05 gnorm 0.170 3.04s mem 81.1GB +[2026-09-12 06:45:21] step 1100/5000 loss 0.1545 (w 0.3351 mse 0.3209 t 970 new 0.27) lr 1.00e-05 gnorm 0.165 3.18s mem 81.1GB +[2026-09-12 06:45:25] step 1101/5000 loss 0.1460 (w 0.3172 mse 0.3373 t 999 new 0.24) lr 1.00e-05 gnorm 0.141 3.04s mem 81.1GB +[2026-09-12 06:45:27] step 1102/5000 loss 0.2245 (w 0.2579 mse 0.2716 t 974 new 0.10) lr 1.00e-05 gnorm 0.114 2.85s mem 81.1GB +[2026-09-12 06:45:31] step 1103/5000 loss 0.3169 (w 0.2605 mse 0.2733 t 820 new 0.23) lr 1.00e-05 gnorm 0.107 3.29s mem 81.1GB +[2026-09-12 06:45:34] step 1104/5000 loss 0.3522 (w 0.2701 mse 0.2866 t 959 new 0.20) lr 1.00e-05 gnorm 0.162 3.39s mem 81.1GB +[2026-09-12 06:45:37] step 1105/5000 loss 0.5682 (w 0.3158 mse 0.3150 t 592 new 0.20) lr 1.00e-05 gnorm 0.132 3.03s mem 81.1GB +[2026-09-12 06:45:40] step 1106/5000 loss 0.4583 (w 0.3261 mse 0.3416 t 982 new 0.15) lr 1.00e-05 gnorm 0.169 3.38s mem 81.1GB +[2026-09-12 06:45:44] step 1107/5000 loss 0.2816 (w 0.3372 mse 0.3433 t 680 new 0.20) lr 1.00e-05 gnorm 0.155 3.04s mem 81.1GB +[2026-09-12 06:45:47] step 1108/5000 loss 0.4457 (w 0.3847 mse 0.4094 t 288 new 0.21) lr 1.00e-05 gnorm 0.140 3.04s mem 81.1GB +[2026-09-12 06:45:50] step 1109/5000 loss 0.3860 (w 0.2784 mse 0.2765 t 921 new 0.16) lr 1.00e-05 gnorm 0.184 3.04s mem 81.1GB +[2026-09-12 06:45:53] step 1110/5000 loss 0.2374 (w 0.2349 mse 0.2393 t 954 new 0.10) lr 1.00e-05 gnorm 0.132 3.37s mem 81.1GB +[2026-09-12 06:45:56] step 1111/5000 loss 0.4531 (w 0.2977 mse 0.2955 t 713 new 0.23) lr 1.00e-05 gnorm 0.171 3.11s mem 81.1GB +[2026-09-12 06:46:00] step 1112/5000 loss 0.2775 (w 0.4658 mse 0.4546 t 992 new 0.23) lr 1.00e-05 gnorm 0.154 3.09s mem 81.1GB +[2026-09-12 06:46:03] step 1113/5000 loss 0.4564 (w 0.2533 mse 0.2638 t 656 new 0.12) lr 1.00e-05 gnorm 0.201 3.08s mem 81.1GB +[2026-09-12 06:46:06] step 1114/5000 loss 0.4119 (w 0.5551 mse 0.5598 t 228 new 0.12) lr 1.00e-05 gnorm 0.493 3.09s mem 81.1GB +[2026-09-12 06:46:09] step 1115/5000 loss 0.4028 (w 0.3314 mse 0.3312 t 684 new 0.22) lr 1.00e-05 gnorm 0.238 3.12s mem 81.1GB +[2026-09-12 06:46:12] step 1116/5000 loss 0.3353 (w 0.2308 mse 0.2467 t 855 new 0.16) lr 1.00e-05 gnorm 0.369 3.18s mem 81.1GB +[2026-09-12 06:46:16] step 1117/5000 loss 0.4637 (w 0.2928 mse 0.2952 t 947 new 0.22) lr 1.00e-05 gnorm 0.190 3.33s mem 81.1GB +[2026-09-12 06:46:19] step 1118/5000 loss 0.3188 (w 0.3386 mse 0.3489 t 978 new 0.19) lr 1.00e-05 gnorm 0.152 3.13s mem 81.1GB +[2026-09-12 06:46:22] step 1119/5000 loss 0.2595 (w 0.3589 mse 0.3629 t 982 new 0.23) lr 1.00e-05 gnorm 0.159 3.05s mem 81.1GB +[2026-09-12 06:46:25] step 1120/5000 loss 0.3903 (w 0.2979 mse 0.3071 t 722 new 0.20) lr 1.00e-05 gnorm 0.145 3.04s mem 81.1GB +[2026-09-12 06:46:28] step 1121/5000 loss 0.2830 (w 0.2929 mse 0.2850 t 875 new 0.21) lr 1.00e-05 gnorm 0.142 3.05s mem 81.1GB +[2026-09-12 06:46:31] step 1122/5000 loss 0.2526 (w 0.4984 mse 0.4747 t 998 new 0.17) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +[2026-09-12 06:46:34] step 1123/5000 loss 0.2507 (w 0.2826 mse 0.2891 t 752 new 0.22) lr 1.00e-05 gnorm 0.136 3.34s mem 81.1GB +[2026-09-12 06:46:37] step 1124/5000 loss 0.3662 (w 0.2202 mse 0.2246 t 669 new 0.05) lr 1.00e-05 gnorm 0.159 2.82s mem 81.1GB +[2026-09-12 06:46:40] step 1125/5000 loss 0.2516 (w 0.1879 mse 0.1990 t 962 new 0.11) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +[2026-09-12 06:46:43] step 1126/5000 loss 0.2696 (w 0.3980 mse 0.3964 t 983 new 0.15) lr 1.00e-05 gnorm 0.209 3.07s mem 81.1GB +[2026-09-12 06:46:46] step 1127/5000 loss 0.2947 (w 0.3688 mse 0.3719 t 530 new 0.24) lr 1.00e-05 gnorm 0.180 3.05s mem 81.1GB +[2026-09-12 06:46:49] step 1128/5000 loss 0.2649 (w 0.3308 mse 0.3330 t 897 new 0.21) lr 1.00e-05 gnorm 0.208 3.07s mem 81.1GB +[2026-09-12 06:46:53] step 1129/5000 loss 0.2534 (w 0.2862 mse 0.2964 t 832 new 0.24) lr 1.00e-05 gnorm 0.142 3.06s mem 81.1GB +[2026-09-12 06:46:56] step 1130/5000 loss 0.3713 (w 0.2695 mse 0.2644 t 782 new 0.13) lr 1.00e-05 gnorm 0.134 3.04s mem 81.1GB +[2026-09-12 06:46:59] step 1131/5000 loss 0.2329 (w 0.4444 mse 0.4344 t 999 new 0.19) lr 1.00e-05 gnorm 0.198 3.08s mem 81.1GB +[2026-09-12 06:47:02] step 1132/5000 loss 0.3298 (w 0.3153 mse 0.3168 t 850 new 0.24) lr 1.00e-05 gnorm 0.189 2.82s mem 81.1GB +[2026-09-12 06:47:05] step 1133/5000 loss 0.2976 (w 0.3743 mse 0.3762 t 989 new 0.24) lr 1.00e-05 gnorm 0.141 3.37s mem 81.1GB +[2026-09-12 06:47:08] step 1134/5000 loss 0.2342 (w 0.1410 mse 0.1592 t 745 new 0.13) lr 1.00e-05 gnorm 0.153 3.05s mem 81.1GB +[2026-09-12 06:47:11] step 1135/5000 loss 0.2378 (w 0.3025 mse 0.3081 t 965 new 0.21) lr 1.00e-05 gnorm 0.185 3.28s mem 81.1GB +[2026-09-12 06:47:14] step 1136/5000 loss 0.3533 (w 0.2178 mse 0.2377 t 937 new 0.15) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +[2026-09-12 06:47:17] step 1137/5000 loss 0.2362 (w 0.3986 mse 0.3964 t 914 new 0.24) lr 1.00e-05 gnorm 0.100 3.01s mem 81.1GB +[2026-09-12 06:47:21] step 1138/5000 loss 0.2959 (w 0.2468 mse 0.2515 t 665 new 0.09) lr 1.00e-05 gnorm 0.127 3.13s mem 81.1GB +[2026-09-12 06:47:24] step 1139/5000 loss 0.3280 (w 0.3334 mse 0.3562 t 372 new 0.20) lr 1.00e-05 gnorm 0.129 3.02s mem 81.1GB +[2026-09-12 06:47:27] step 1140/5000 loss 0.2267 (w 0.3099 mse 0.3195 t 947 new 0.19) lr 1.00e-05 gnorm 0.167 3.05s mem 81.1GB +[2026-09-12 06:47:30] step 1141/5000 loss 0.5012 (w 0.3811 mse 0.3930 t 421 new 0.22) lr 1.00e-05 gnorm 0.207 3.07s mem 81.1GB +[2026-09-12 06:47:33] step 1142/5000 loss 0.3741 (w 0.3116 mse 0.3231 t 951 new 0.23) lr 1.00e-05 gnorm 0.186 3.33s mem 81.1GB +[2026-09-12 06:47:36] step 1143/5000 loss 0.2439 (w 0.3326 mse 0.3496 t 274 new 0.23) lr 1.00e-05 gnorm 0.129 3.00s mem 81.1GB +[2026-09-12 06:47:39] step 1144/5000 loss 0.2895 (w 0.2811 mse 0.2849 t 889 new 0.21) lr 1.00e-05 gnorm 0.258 3.05s mem 81.1GB +[2026-09-12 06:47:42] step 1145/5000 loss 0.2389 (w 0.1511 mse 0.1543 t 578 new 0.02) lr 1.00e-05 gnorm 0.136 3.08s mem 81.1GB +[2026-09-12 06:47:45] step 1146/5000 loss 0.4596 (w 0.3412 mse 0.3455 t 961 new 0.20) lr 1.00e-05 gnorm 0.186 3.30s mem 81.1GB +[2026-09-12 06:47:49] step 1147/5000 loss 0.2010 (w 0.4278 mse 0.4163 t 930 new 0.24) lr 1.00e-05 gnorm 0.194 3.04s mem 81.1GB +[2026-09-12 06:47:52] step 1148/5000 loss 0.2162 (w 0.2683 mse 0.2871 t 647 new 0.22) lr 1.00e-05 gnorm 0.126 3.05s mem 81.1GB +[2026-09-12 06:47:55] step 1149/5000 loss 0.2718 (w 0.3501 mse 0.3584 t 852 new 0.21) lr 1.00e-05 gnorm 0.166 3.04s mem 81.1GB +[2026-09-12 06:47:58] step 1150/5000 loss 0.1937 (w 0.3077 mse 0.3196 t 612 new 0.20) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +[2026-09-12 06:48:01] step 1151/5000 loss 0.1917 (w 0.3439 mse 0.3506 t 958 new 0.18) lr 1.00e-05 gnorm 0.196 3.03s mem 81.1GB +[2026-09-12 06:48:04] step 1152/5000 loss 0.2432 (w 0.1946 mse 0.2098 t 725 new 0.22) lr 1.00e-05 gnorm 0.183 3.28s mem 81.1GB +[2026-09-12 06:48:07] step 1153/5000 loss 0.4169 (w 0.3510 mse 0.3476 t 506 new 0.17) lr 1.00e-05 gnorm 0.197 2.83s mem 81.1GB +[2026-09-12 06:48:10] step 1154/5000 loss 0.2399 (w 0.4916 mse 0.4869 t 974 new 0.24) lr 1.00e-05 gnorm 0.177 3.12s mem 81.1GB +[2026-09-12 06:48:13] step 1155/5000 loss 0.1511 (w 0.1731 mse 0.1807 t 672 new 0.20) lr 1.00e-05 gnorm 0.124 3.03s mem 81.1GB +[2026-09-12 06:48:16] step 1156/5000 loss 0.3071 (w 0.2637 mse 0.2880 t 995 new 0.16) lr 1.00e-05 gnorm 0.158 3.05s mem 81.1GB +[2026-09-12 06:48:19] step 1157/5000 loss 0.3013 (w 0.3662 mse 0.3677 t 233 new 0.10) lr 1.00e-05 gnorm 0.187 3.06s mem 81.1GB +[2026-09-12 06:48:22] step 1158/5000 loss 0.3422 (w 0.2205 mse 0.2485 t 940 new 0.23) lr 1.00e-05 gnorm 0.213 3.30s mem 81.1GB +[2026-09-12 06:48:25] step 1159/5000 loss 0.3815 (w 0.3540 mse 0.3651 t 450 new 0.21) lr 1.00e-05 gnorm 0.183 2.84s mem 81.1GB +[2026-09-12 06:48:29] step 1160/5000 loss 0.1549 (w 0.3763 mse 0.3801 t 945 new 0.18) lr 1.00e-05 gnorm 0.139 3.13s mem 81.1GB +[2026-09-12 06:48:32] step 1161/5000 loss 0.1841 (w 0.3254 mse 0.3247 t 934 new 0.17) lr 1.00e-05 gnorm 0.109 3.01s mem 81.1GB +[2026-09-12 06:48:35] step 1162/5000 loss 0.2900 (w 0.2444 mse 0.2559 t 970 new 0.24) lr 1.00e-05 gnorm 0.114 3.34s mem 81.1GB +[2026-09-12 06:48:38] step 1163/5000 loss 0.1808 (w 0.4399 mse 0.4391 t 960 new 0.21) lr 1.00e-05 gnorm 0.214 3.11s mem 81.1GB +[2026-09-12 06:48:41] step 1164/5000 loss 0.2711 (w 0.2619 mse 0.2606 t 977 new 0.24) lr 1.00e-05 gnorm 4.211 3.33s mem 81.1GB +[2026-09-12 06:48:44] step 1165/5000 loss 0.3117 (w 0.2821 mse 0.2889 t 683 new 0.26) lr 1.00e-05 gnorm 0.160 3.07s mem 81.1GB +[2026-09-12 06:48:47] step 1166/5000 loss 0.2656 (w 0.3548 mse 0.3518 t 918 new 0.24) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +[2026-09-12 06:48:50] step 1167/5000 loss 0.1881 (w 0.1849 mse 0.2010 t 911 new 0.25) lr 1.00e-05 gnorm 0.105 3.03s mem 81.1GB +[2026-09-12 06:48:54] step 1168/5000 loss 0.3059 (w 0.4604 mse 0.4542 t 963 new 0.22) lr 1.00e-05 gnorm 0.965 3.35s mem 81.1GB +[2026-09-12 06:48:57] step 1169/5000 loss 0.3399 (w 0.3833 mse 0.3711 t 998 new 0.27) lr 1.00e-05 gnorm 0.126 3.09s mem 81.1GB +[2026-09-12 06:49:00] step 1170/5000 loss 0.2266 (w 0.3518 mse 0.3515 t 922 new 0.19) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +[2026-09-12 06:49:03] step 1171/5000 loss 0.2964 (w 0.2660 mse 0.2732 t 897 new 0.29) lr 1.00e-05 gnorm 0.148 3.13s mem 81.1GB +[2026-09-12 06:49:06] step 1172/5000 loss 0.3515 (w 0.3924 mse 0.3974 t 328 new 0.10) lr 1.00e-05 gnorm 0.420 2.82s mem 81.1GB +[2026-09-12 06:49:09] step 1173/5000 loss 0.3594 (w 0.3455 mse 0.3466 t 948 new 0.24) lr 1.00e-05 gnorm 0.160 3.06s mem 81.1GB +[2026-09-12 06:49:12] step 1174/5000 loss 0.3156 (w 0.1312 mse 0.1564 t 800 new 0.19) lr 1.00e-05 gnorm 0.208 3.26s mem 81.1GB +[2026-09-12 06:49:15] step 1175/5000 loss 0.3458 (w 0.3941 mse 0.3950 t 988 new 0.20) lr 1.00e-05 gnorm 0.193 3.05s mem 81.1GB +[2026-09-12 06:49:18] step 1176/5000 loss 0.2338 (w 0.2765 mse 0.2748 t 874 new 0.10) lr 1.00e-05 gnorm 0.184 3.12s mem 81.1GB +[2026-09-12 06:49:22] step 1177/5000 loss 0.1599 (w 0.4833 mse 0.4883 t 995 new 0.14) lr 1.00e-05 gnorm 0.114 3.34s mem 81.1GB +[2026-09-12 06:49:25] step 1178/5000 loss 0.3244 (w 0.3000 mse 0.3092 t 909 new 0.23) lr 1.00e-05 gnorm 0.206 2.83s mem 81.1GB +[2026-09-12 06:49:27] step 1179/5000 loss 0.2126 (w 0.2905 mse 0.2919 t 892 new 0.22) lr 1.00e-05 gnorm 0.134 2.82s mem 81.1GB +[2026-09-12 06:49:31] step 1180/5000 loss 0.2103 (w 0.2739 mse 0.2772 t 952 new 0.15) lr 1.00e-05 gnorm 0.105 3.27s mem 81.1GB +[2026-09-12 06:49:34] step 1181/5000 loss 0.2742 (w 0.2848 mse 0.2922 t 900 new 0.24) lr 1.00e-05 gnorm 0.188 3.37s mem 81.1GB +[2026-09-12 06:49:37] step 1182/5000 loss 0.2551 (w 0.2960 mse 0.2842 t 879 new 0.19) lr 1.00e-05 gnorm 0.162 3.07s mem 81.1GB +[2026-09-12 06:49:41] step 1183/5000 loss 0.1303 (w 0.3358 mse 0.3427 t 976 new 0.20) lr 1.00e-05 gnorm 0.144 3.33s mem 81.1GB +[2026-09-12 06:49:44] step 1184/5000 loss 0.2953 (w 0.4031 mse 0.4162 t 998 new 0.15) lr 1.00e-05 gnorm 0.161 3.04s mem 81.1GB +[2026-09-12 06:49:46] step 1185/5000 loss 0.1536 (w 0.3852 mse 0.3825 t 995 new 0.22) lr 1.00e-05 gnorm 0.163 2.83s mem 81.1GB +[2026-09-12 06:49:50] step 1186/5000 loss 0.2151 (w 0.3942 mse 0.3985 t 971 new 0.19) lr 1.00e-05 gnorm 0.134 3.58s mem 81.1GB +[2026-09-12 06:49:53] step 1187/5000 loss 0.1496 (w 0.2337 mse 0.2623 t 946 new 0.27) lr 1.00e-05 gnorm 0.130 3.28s mem 81.1GB +[2026-09-12 06:49:57] step 1188/5000 loss 0.3532 (w 0.4092 mse 0.4103 t 984 new 0.20) lr 1.00e-05 gnorm 0.152 3.16s mem 81.1GB +[2026-09-12 06:50:00] step 1189/5000 loss 0.4197 (w 0.3064 mse 0.3223 t 955 new 0.20) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +[2026-09-12 06:50:03] step 1190/5000 loss 0.2374 (w 0.4377 mse 0.4380 t 979 new 0.20) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +[2026-09-12 06:50:06] step 1191/5000 loss 0.3126 (w 0.2848 mse 0.2824 t 849 new 0.22) lr 1.00e-05 gnorm 0.203 3.04s mem 81.1GB +[2026-09-12 06:50:09] step 1192/5000 loss 0.2096 (w 0.3679 mse 0.3589 t 948 new 0.23) lr 1.00e-05 gnorm 0.263 3.26s mem 81.1GB +[2026-09-12 06:50:12] step 1193/5000 loss 0.3776 (w 0.2837 mse 0.2866 t 771 new 0.16) lr 1.00e-05 gnorm 0.150 3.31s mem 81.1GB +[2026-09-12 06:50:15] step 1194/5000 loss 0.2254 (w 0.3366 mse 0.3620 t 980 new 0.13) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +[2026-09-12 06:50:18] step 1195/5000 loss 0.2121 (w 0.3388 mse 0.3433 t 976 new 0.14) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +[2026-09-12 06:50:21] step 1196/5000 loss 0.1823 (w 0.2863 mse 0.3031 t 424 new 0.20) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +[2026-09-12 06:50:24] step 1197/5000 loss 0.3423 (w 0.3048 mse 0.3253 t 660 new 0.22) lr 1.00e-05 gnorm 0.130 3.11s mem 81.1GB +[2026-09-12 06:50:28] step 1198/5000 loss 0.2900 (w 0.3243 mse 0.3173 t 894 new 0.20) lr 1.00e-05 gnorm 0.148 3.45s mem 81.1GB +[2026-09-12 06:50:31] step 1199/5000 loss 0.1539 (w 0.3513 mse 0.3476 t 895 new 0.20) lr 1.00e-05 gnorm 0.121 3.29s mem 81.1GB +[2026-09-12 06:50:34] step 1200/5000 loss 0.4265 (w 0.3429 mse 0.3553 t 264 new 0.17) lr 1.00e-05 gnorm 0.159 3.15s mem 81.1GB +[2026-09-12 06:50:37] step 1201/5000 loss 0.2248 (w 0.2942 mse 0.3046 t 948 new 0.13) lr 1.00e-05 gnorm 0.177 2.83s mem 81.1GB +[2026-09-12 06:50:40] step 1202/5000 loss 0.3113 (w 0.3287 mse 0.3296 t 855 new 0.21) lr 1.00e-05 gnorm 0.134 3.06s mem 81.1GB +[2026-09-12 06:50:43] step 1203/5000 loss 0.3809 (w 0.2158 mse 0.2321 t 890 new 0.17) lr 1.00e-05 gnorm 0.250 3.12s mem 81.1GB +[2026-09-12 06:50:47] step 1204/5000 loss 0.3466 (w 0.2665 mse 0.2768 t 626 new 0.17) lr 1.00e-05 gnorm 0.186 3.50s mem 81.1GB +[2026-09-12 06:50:50] step 1205/5000 loss 0.3488 (w 0.2494 mse 0.2633 t 428 new 0.18) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +[2026-09-12 06:50:53] step 1206/5000 loss 0.3500 (w 0.1562 mse 0.1707 t 731 new 0.11) lr 1.00e-05 gnorm 0.130 3.09s mem 81.1GB +[2026-09-12 06:50:56] step 1207/5000 loss 0.3008 (w 0.4967 mse 0.5160 t 206 new 0.22) lr 1.00e-05 gnorm 0.227 2.83s mem 81.1GB +[2026-09-12 06:50:59] step 1208/5000 loss 0.2475 (w 0.2214 mse 0.2310 t 953 new 0.24) lr 1.00e-05 gnorm 0.184 3.06s mem 81.1GB +[2026-09-12 06:51:02] step 1209/5000 loss 0.2466 (w 0.2793 mse 0.3095 t 998 new 0.22) lr 1.00e-05 gnorm 0.176 3.19s mem 81.1GB +[2026-09-12 06:51:05] step 1210/5000 loss 0.2275 (w 0.2069 mse 0.2204 t 803 new 0.19) lr 1.00e-05 gnorm 0.145 3.11s mem 81.1GB +[2026-09-12 06:51:09] step 1211/5000 loss 0.5491 (w 0.3265 mse 0.3342 t 610 new 0.22) lr 1.00e-05 gnorm 0.226 3.30s mem 81.1GB +[2026-09-12 06:51:12] step 1212/5000 loss 0.2757 (w 0.2273 mse 0.2507 t 892 new 0.17) lr 1.00e-05 gnorm 0.471 3.07s mem 81.1GB +[2026-09-12 06:51:14] step 1213/5000 loss 0.1983 (w 0.2414 mse 0.2532 t 987 new 0.22) lr 1.00e-05 gnorm 0.168 2.82s mem 81.1GB +[2026-09-12 06:51:18] step 1214/5000 loss 0.2593 (w 0.2554 mse 0.2621 t 904 new 0.20) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +[2026-09-12 06:51:21] step 1215/5000 loss 0.2444 (w 0.6008 mse 0.6071 t 134 new 0.20) lr 1.00e-05 gnorm 0.184 3.35s mem 81.1GB +[2026-09-12 06:51:24] step 1216/5000 loss 0.1389 (w 0.3650 mse 0.3726 t 984 new 0.19) lr 1.00e-05 gnorm 0.106 3.23s mem 81.1GB +[2026-09-12 06:51:27] step 1217/5000 loss 0.3334 (w 0.3042 mse 0.3083 t 949 new 0.20) lr 1.00e-05 gnorm 0.169 3.29s mem 81.1GB +[2026-09-12 06:51:30] step 1218/5000 loss 0.1508 (w 0.3682 mse 0.3767 t 968 new 0.20) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +[2026-09-12 06:51:34] step 1219/5000 loss 0.1381 (w 0.3269 mse 0.3360 t 914 new 0.17) lr 1.00e-05 gnorm 0.133 3.04s mem 81.1GB +[2026-09-12 06:51:36] step 1220/5000 loss 0.3321 (w 0.2500 mse 0.2481 t 951 new 0.12) lr 1.00e-05 gnorm 0.185 2.84s mem 81.1GB +[2026-09-12 06:51:40] step 1221/5000 loss 0.2871 (w 0.3160 mse 0.3222 t 919 new 0.22) lr 1.00e-05 gnorm 0.191 3.60s mem 81.1GB +[2026-09-12 06:51:43] step 1222/5000 loss 0.2308 (w 0.4649 mse 0.4593 t 974 new 0.22) lr 1.00e-05 gnorm 0.125 3.28s mem 81.1GB +[2026-09-12 06:51:47] step 1223/5000 loss 0.2166 (w 0.2345 mse 0.2628 t 971 new 0.22) lr 1.00e-05 gnorm 0.163 3.37s mem 81.1GB +[2026-09-12 06:51:49] step 1224/5000 loss 0.2817 (w 0.3353 mse 0.3352 t 804 new 0.19) lr 1.00e-05 gnorm 0.169 2.82s mem 81.1GB +[2026-09-12 06:51:53] step 1225/5000 loss 0.2239 (w 0.3739 mse 0.3772 t 951 new 0.28) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +[2026-09-12 06:51:56] step 1226/5000 loss 0.2824 (w 0.3780 mse 0.3845 t 996 new 0.22) lr 1.00e-05 gnorm 0.134 3.03s mem 81.1GB +[2026-09-12 06:51:59] step 1227/5000 loss 0.2665 (w 0.2951 mse 0.2974 t 844 new 0.24) lr 1.00e-05 gnorm 0.216 3.13s mem 81.1GB +[2026-09-12 06:52:02] step 1228/5000 loss 0.3663 (w 0.2557 mse 0.2707 t 889 new 0.15) lr 1.00e-05 gnorm 0.134 3.01s mem 81.1GB +[2026-09-12 06:52:05] step 1229/5000 loss 0.4046 (w 0.2247 mse 0.2475 t 965 new 0.20) lr 1.00e-05 gnorm 0.645 3.05s mem 81.1GB +[2026-09-12 06:52:09] step 1230/5000 loss 0.2864 (w 0.3363 mse 0.3366 t 665 new 0.21) lr 1.00e-05 gnorm 0.850 3.70s mem 81.1GB +[2026-09-12 06:52:12] step 1231/5000 loss 0.2126 (w 0.3061 mse 0.3109 t 809 new 0.23) lr 1.00e-05 gnorm 0.263 3.05s mem 81.1GB +[2026-09-12 06:52:15] step 1232/5000 loss 0.2469 (w 0.3532 mse 0.3585 t 984 new 0.21) lr 1.00e-05 gnorm 0.144 3.06s mem 81.1GB +[2026-09-12 06:52:18] step 1233/5000 loss 0.2362 (w 0.3520 mse 0.3552 t 437 new 0.16) lr 1.00e-05 gnorm 0.147 3.12s mem 81.1GB +[2026-09-12 06:52:21] step 1234/5000 loss 0.1630 (w 0.2590 mse 0.2714 t 987 new 0.15) lr 1.00e-05 gnorm 0.130 3.25s mem 81.1GB +[2026-09-12 06:52:24] step 1235/5000 loss 0.2552 (w 0.2907 mse 0.2946 t 967 new 0.12) lr 1.00e-05 gnorm 0.120 3.09s mem 81.1GB +[2026-09-12 06:52:27] step 1236/5000 loss 0.2927 (w 0.2757 mse 0.2772 t 809 new 0.26) lr 1.00e-05 gnorm 0.211 2.83s mem 81.1GB +[2026-09-12 06:52:30] step 1237/5000 loss 0.3485 (w 0.3338 mse 0.3227 t 889 new 0.27) lr 1.00e-05 gnorm 0.183 3.07s mem 81.1GB +[2026-09-12 06:52:33] step 1238/5000 loss 0.1923 (w 0.3059 mse 0.3060 t 952 new 0.21) lr 1.00e-05 gnorm 0.151 3.12s mem 81.1GB +[2026-09-12 06:52:37] step 1239/5000 loss 0.3896 (w 0.2830 mse 0.2936 t 809 new 0.24) lr 1.00e-05 gnorm 0.267 3.39s mem 81.1GB +[2026-09-12 06:52:40] step 1240/5000 loss 0.2852 (w 0.4019 mse 0.4030 t 920 new 0.19) lr 1.00e-05 gnorm 0.195 3.03s mem 81.1GB +[2026-09-12 06:52:43] step 1241/5000 loss 0.2631 (w 0.3298 mse 0.3337 t 766 new 0.18) lr 1.00e-05 gnorm 0.205 3.11s mem 81.1GB +[2026-09-12 06:52:46] step 1242/5000 loss 0.3549 (w 0.2255 mse 0.2394 t 794 new 0.22) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +[2026-09-12 06:52:49] step 1243/5000 loss 0.1994 (w 0.3212 mse 0.3244 t 960 new 0.19) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +[2026-09-12 06:52:52] step 1244/5000 loss 0.2140 (w 0.2957 mse 0.3038 t 992 new 0.26) lr 1.00e-05 gnorm 0.128 3.13s mem 81.1GB +[2026-09-12 06:52:55] step 1245/5000 loss 0.2285 (w 0.2792 mse 0.2781 t 901 new 0.20) lr 1.00e-05 gnorm 0.151 3.31s mem 81.1GB +[2026-09-12 06:52:58] step 1246/5000 loss 0.3269 (w 0.2190 mse 0.2413 t 421 new 0.16) lr 1.00e-05 gnorm 0.196 3.05s mem 81.1GB +[2026-09-12 06:53:01] step 1247/5000 loss 0.2760 (w 0.6852 mse 0.6543 t 998 new 0.19) lr 1.00e-05 gnorm 0.235 3.12s mem 81.1GB +[2026-09-12 06:53:04] step 1248/5000 loss 0.2018 (w 0.2813 mse 0.2896 t 663 new 0.15) lr 1.00e-05 gnorm 0.205 2.83s mem 81.1GB +[2026-09-12 06:53:07] step 1249/5000 loss 0.3265 (w 0.3907 mse 0.4110 t 288 new 0.27) lr 1.00e-05 gnorm 0.162 3.13s mem 81.1GB +[2026-09-12 06:53:10] step 1250/5000 loss 0.2037 (w 0.1920 mse 0.1998 t 906 new 0.19) lr 1.00e-05 gnorm 0.157 3.07s mem 81.1GB +[2026-09-12 06:53:14] step 1251/5000 loss 0.1337 (w 0.4284 mse 0.4225 t 983 new 0.21) lr 1.00e-05 gnorm 0.137 3.46s mem 81.1GB +[2026-09-12 06:53:17] step 1252/5000 loss 0.2175 (w 0.4469 mse 0.4705 t 140 new 0.24) lr 1.00e-05 gnorm 0.292 3.05s mem 81.1GB +[2026-09-12 06:53:20] step 1253/5000 loss 0.4981 (w 0.3588 mse 0.3569 t 819 new 0.23) lr 1.00e-05 gnorm 0.184 3.04s mem 81.1GB +[2026-09-12 06:53:23] step 1254/5000 loss 0.2155 (w 0.2919 mse 0.3238 t 973 new 0.15) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +[2026-09-12 06:53:26] step 1255/5000 loss 0.2763 (w 0.3386 mse 0.3509 t 990 new 0.20) lr 1.00e-05 gnorm 0.149 2.82s mem 81.1GB +[2026-09-12 06:53:29] step 1256/5000 loss 0.3463 (w 0.2238 mse 0.2343 t 925 new 0.27) lr 1.00e-05 gnorm 0.174 3.39s mem 81.1GB +[2026-09-12 06:53:32] step 1257/5000 loss 0.2852 (w 0.3517 mse 0.3576 t 929 new 0.22) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +[2026-09-12 06:53:35] step 1258/5000 loss 0.2133 (w 0.2731 mse 0.2697 t 849 new 0.18) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +[2026-09-12 06:53:38] step 1259/5000 loss 0.1851 (w 0.1911 mse 0.2003 t 750 new 0.21) lr 1.00e-05 gnorm 0.139 3.06s mem 81.1GB +[2026-09-12 06:53:42] step 1260/5000 loss 0.1969 (w 0.4363 mse 0.4311 t 975 new 0.22) lr 1.00e-05 gnorm 0.170 3.12s mem 81.1GB +[2026-09-12 06:53:44] step 1261/5000 loss 0.2998 (w 0.3807 mse 0.3857 t 981 new 0.23) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +[2026-09-12 06:53:48] step 1262/5000 loss 0.4686 (w 0.1790 mse 0.1886 t 590 new 0.14) lr 1.00e-05 gnorm 0.119 3.39s mem 81.1GB +[2026-09-12 06:53:51] step 1263/5000 loss 0.2650 (w 0.1864 mse 0.1952 t 862 new 0.14) lr 1.00e-05 gnorm 0.155 3.04s mem 81.1GB +[2026-09-12 06:53:54] step 1264/5000 loss 0.2122 (w 0.2643 mse 0.2740 t 926 new 0.26) lr 1.00e-05 gnorm 0.286 3.29s mem 81.1GB +[2026-09-12 06:53:57] step 1265/5000 loss 0.1936 (w 0.3078 mse 0.3122 t 390 new 0.22) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +[2026-09-12 06:54:00] step 1266/5000 loss 0.2572 (w 0.2654 mse 0.2734 t 904 new 0.22) lr 1.00e-05 gnorm 0.172 3.03s mem 81.1GB +[2026-09-12 06:54:03] step 1267/5000 loss 0.2230 (w 0.3135 mse 0.3311 t 993 new 0.17) lr 1.00e-05 gnorm 0.122 2.82s mem 81.1GB +[2026-09-12 06:54:06] step 1268/5000 loss 0.2298 (w 0.4222 mse 0.4293 t 935 new 0.19) lr 1.00e-05 gnorm 0.205 3.10s mem 81.1GB +[2026-09-12 06:54:09] step 1269/5000 loss 0.2198 (w 0.3209 mse 0.3207 t 839 new 0.19) lr 1.00e-05 gnorm 0.348 3.08s mem 81.1GB +[2026-09-12 06:54:13] step 1270/5000 loss 0.2396 (w 0.1989 mse 0.2232 t 829 new 0.24) lr 1.00e-05 gnorm 0.152 3.31s mem 81.1GB +[2026-09-12 06:54:16] step 1271/5000 loss 0.3130 (w 0.3476 mse 0.3399 t 988 new 0.18) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +[2026-09-12 06:54:19] step 1272/5000 loss 0.1836 (w 0.4587 mse 0.4557 t 970 new 0.19) lr 1.00e-05 gnorm 0.121 3.03s mem 81.1GB +[2026-09-12 06:54:22] step 1273/5000 loss 0.2473 (w 0.2954 mse 0.3171 t 983 new 0.19) lr 1.00e-05 gnorm 0.320 3.05s mem 81.1GB +[2026-09-12 06:54:25] step 1274/5000 loss 0.2759 (w 0.2363 mse 0.2559 t 924 new 0.23) lr 1.00e-05 gnorm 0.102 3.15s mem 81.1GB +[2026-09-12 06:54:28] step 1275/5000 loss 0.2476 (w 0.4005 mse 0.4128 t 977 new 0.23) lr 1.00e-05 gnorm 0.159 3.30s mem 81.1GB +[2026-09-12 06:54:32] step 1276/5000 loss 0.4547 (w 0.3099 mse 0.3167 t 616 new 0.27) lr 1.00e-05 gnorm 0.163 3.42s mem 81.1GB +[2026-09-12 06:54:34] step 1277/5000 loss 0.4315 (w 0.2932 mse 0.2946 t 954 new 0.21) lr 1.00e-05 gnorm 0.138 2.81s mem 81.1GB +[2026-09-12 06:54:38] step 1278/5000 loss 0.4227 (w 0.3621 mse 0.3512 t 862 new 0.22) lr 1.00e-05 gnorm 0.283 3.11s mem 81.1GB +[2026-09-12 06:54:41] step 1279/5000 loss 0.1835 (w 0.3186 mse 0.3373 t 963 new 0.27) lr 1.00e-05 gnorm 0.130 3.15s mem 81.1GB +[2026-09-12 06:54:44] step 1280/5000 loss 0.3077 (w 0.3306 mse 0.3279 t 963 new 0.26) lr 1.00e-05 gnorm 0.506 3.09s mem 81.1GB +[2026-09-12 06:54:47] step 1281/5000 loss 0.3009 (w 0.2529 mse 0.2710 t 984 new 0.12) lr 1.00e-05 gnorm 0.104 3.10s mem 81.1GB +[2026-09-12 06:54:50] step 1282/5000 loss 0.1012 (w 0.3239 mse 0.3314 t 891 new 0.16) lr 1.00e-05 gnorm 0.127 3.34s mem 81.1GB +[2026-09-12 06:54:53] step 1283/5000 loss 0.4483 (w 0.3047 mse 0.2997 t 878 new 0.07) lr 1.00e-05 gnorm 0.134 3.05s mem 81.1GB +[2026-09-12 06:54:56] step 1284/5000 loss 0.2674 (w 0.2904 mse 0.2794 t 927 new 0.19) lr 1.00e-05 gnorm 0.118 2.83s mem 81.1GB +[2026-09-12 06:54:59] step 1285/5000 loss 0.2895 (w 0.2882 mse 0.2895 t 692 new 0.15) lr 1.00e-05 gnorm 0.165 3.30s mem 81.1GB +[2026-09-12 06:55:02] step 1286/5000 loss 0.1949 (w 0.2982 mse 0.3042 t 949 new 0.22) lr 1.00e-05 gnorm 0.111 3.06s mem 81.1GB +[2026-09-12 06:55:06] step 1287/5000 loss 0.2750 (w 0.3509 mse 0.3523 t 953 new 0.18) lr 1.00e-05 gnorm 0.187 3.04s mem 81.1GB +[2026-09-12 06:55:09] step 1288/5000 loss 0.4244 (w 0.2923 mse 0.3080 t 855 new 0.22) lr 1.00e-05 gnorm 0.136 3.13s mem 81.1GB +[2026-09-12 06:55:12] step 1289/5000 loss 0.2846 (w 0.2104 mse 0.2158 t 702 new 0.07) lr 1.00e-05 gnorm 0.216 3.09s mem 81.1GB +[2026-09-12 06:55:15] step 1290/5000 loss 0.2563 (w 0.2040 mse 0.2261 t 866 new 0.24) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +[2026-09-12 06:55:18] step 1291/5000 loss 0.3470 (w 0.2678 mse 0.2764 t 995 new 0.23) lr 1.00e-05 gnorm 0.170 3.38s mem 81.1GB +[2026-09-12 06:55:21] step 1292/5000 loss 0.1658 (w 0.2744 mse 0.2832 t 892 new 0.25) lr 1.00e-05 gnorm 0.132 3.05s mem 81.1GB +[2026-09-12 06:55:24] step 1293/5000 loss 0.3716 (w 0.2056 mse 0.2052 t 940 new 0.18) lr 1.00e-05 gnorm 0.155 3.07s mem 81.1GB +[2026-09-12 06:55:27] step 1294/5000 loss 0.2639 (w 0.2687 mse 0.2844 t 826 new 0.23) lr 1.00e-05 gnorm 0.172 3.13s mem 81.1GB +[2026-09-12 06:55:30] step 1295/5000 loss 0.2525 (w 0.2677 mse 0.2704 t 899 new 0.26) lr 1.00e-05 gnorm 0.132 3.11s mem 81.1GB +[2026-09-12 06:55:33] step 1296/5000 loss 0.5694 (w 0.3790 mse 0.3775 t 553 new 0.09) lr 1.00e-05 gnorm 0.171 3.13s mem 81.1GB +[2026-09-12 06:55:37] step 1297/5000 loss 0.2503 (w 0.2589 mse 0.2575 t 890 new 0.19) lr 1.00e-05 gnorm 0.169 3.14s mem 81.1GB +[2026-09-12 06:55:40] step 1298/5000 loss 0.4131 (w 0.2597 mse 0.2691 t 876 new 0.18) lr 1.00e-05 gnorm 0.202 3.08s mem 81.1GB +[2026-09-12 06:55:43] step 1299/5000 loss 0.2874 (w 0.2412 mse 0.2594 t 619 new 0.15) lr 1.00e-05 gnorm 0.172 3.34s mem 81.1GB +[2026-09-12 06:55:46] step 1300/5000 loss 0.2899 (w 0.2294 mse 0.2437 t 939 new 0.18) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +[2026-09-12 06:55:49] step 1301/5000 loss 0.3180 (w 0.1827 mse 0.1894 t 720 new 0.14) lr 1.00e-05 gnorm 0.213 3.12s mem 81.1GB +[2026-09-12 06:55:52] step 1302/5000 loss 0.3184 (w 0.2319 mse 0.2405 t 820 new 0.09) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +[2026-09-12 06:55:55] step 1303/5000 loss 0.5292 (w 0.4103 mse 0.4199 t 390 new 0.19) lr 1.00e-05 gnorm 0.129 3.12s mem 81.1GB +[2026-09-12 06:55:58] step 1304/5000 loss 0.3693 (w 0.3852 mse 0.4031 t 995 new 0.16) lr 1.00e-05 gnorm 0.240 3.10s mem 81.1GB +[2026-09-12 06:56:02] step 1305/5000 loss 0.2721 (w 0.2505 mse 0.2524 t 717 new 0.14) lr 1.00e-05 gnorm 0.160 3.29s mem 81.1GB +[2026-09-12 06:56:05] step 1306/5000 loss 0.2713 (w 0.2907 mse 0.2997 t 989 new 0.24) lr 1.00e-05 gnorm 0.159 3.16s mem 81.1GB +[2026-09-12 06:56:08] step 1307/5000 loss 0.2617 (w 0.2808 mse 0.2876 t 982 new 0.23) lr 1.00e-05 gnorm 0.168 3.04s mem 81.1GB +[2026-09-12 06:56:11] step 1308/5000 loss 0.2865 (w 0.3355 mse 0.3426 t 912 new 0.23) lr 1.00e-05 gnorm 0.185 3.39s mem 81.1GB +[2026-09-12 06:56:14] step 1309/5000 loss 0.4043 (w 0.2402 mse 0.2511 t 884 new 0.23) lr 1.00e-05 gnorm 0.181 3.08s mem 81.1GB +[2026-09-12 06:56:18] step 1310/5000 loss 0.1669 (w 0.3793 mse 0.3840 t 997 new 0.22) lr 1.00e-05 gnorm 0.142 3.14s mem 81.1GB +[2026-09-12 06:56:21] step 1311/5000 loss 0.1436 (w 0.4086 mse 0.3987 t 988 new 0.22) lr 1.00e-05 gnorm 0.111 3.33s mem 81.1GB +[2026-09-12 06:56:24] step 1312/5000 loss 0.1801 (w 0.2970 mse 0.3012 t 786 new 0.23) lr 1.00e-05 gnorm 0.146 2.82s mem 81.1GB +[2026-09-12 06:56:27] step 1313/5000 loss 0.3412 (w 0.2872 mse 0.3015 t 473 new 0.19) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +[2026-09-12 06:56:30] step 1314/5000 loss 0.2768 (w 0.5647 mse 0.5521 t 986 new 0.18) lr 1.00e-05 gnorm 0.202 3.10s mem 81.1GB +[2026-09-12 06:56:33] step 1315/5000 loss 0.4068 (w 0.2382 mse 0.2486 t 992 new 0.19) lr 1.00e-05 gnorm 0.271 3.35s mem 81.1GB +[2026-09-12 06:56:36] step 1316/5000 loss 0.2346 (w 0.3538 mse 0.3617 t 601 new 0.18) lr 1.00e-05 gnorm 0.265 3.02s mem 81.1GB +[2026-09-12 06:56:40] step 1317/5000 loss 0.3120 (w 0.3789 mse 0.3707 t 776 new 0.23) lr 1.00e-05 gnorm 0.129 3.38s mem 81.1GB +[2026-09-12 06:56:43] step 1318/5000 loss 0.2844 (w 0.2916 mse 0.2984 t 914 new 0.16) lr 1.00e-05 gnorm 0.148 3.01s mem 81.1GB +[2026-09-12 06:56:46] step 1319/5000 loss 0.2545 (w 0.2988 mse 0.3062 t 885 new 0.23) lr 1.00e-05 gnorm 0.196 2.83s mem 81.1GB +[2026-09-12 06:56:49] step 1320/5000 loss 0.3192 (w 0.4581 mse 0.4771 t 983 new 0.19) lr 1.00e-05 gnorm 0.144 3.36s mem 81.1GB +[2026-09-12 06:56:52] step 1321/5000 loss 0.3075 (w 0.2889 mse 0.2870 t 885 new 0.21) lr 1.00e-05 gnorm 8.285 3.04s mem 81.1GB +[2026-09-12 06:56:55] step 1322/5000 loss 0.4932 (w 0.2480 mse 0.2600 t 814 new 0.21) lr 1.00e-05 gnorm 0.157 3.06s mem 81.1GB +[2026-09-12 06:56:58] step 1323/5000 loss 0.3987 (w 0.4260 mse 0.4480 t 228 new 0.17) lr 1.00e-05 gnorm 0.195 3.43s mem 81.1GB +[2026-09-12 06:57:01] step 1324/5000 loss 0.2217 (w 0.4478 mse 0.4271 t 998 new 0.20) lr 1.00e-05 gnorm 0.129 3.00s mem 81.1GB +[2026-09-12 06:57:04] step 1325/5000 loss 0.2225 (w 0.4797 mse 0.4684 t 998 new 0.23) lr 1.00e-05 gnorm 0.324 2.82s mem 81.1GB +[2026-09-12 06:57:08] step 1326/5000 loss 0.4015 (w 0.3420 mse 0.3285 t 974 new 0.18) lr 1.00e-05 gnorm 0.217 3.37s mem 81.1GB +[2026-09-12 06:57:11] step 1327/5000 loss 0.3541 (w 0.2803 mse 0.2859 t 710 new 0.09) lr 1.00e-05 gnorm 0.203 3.02s mem 81.1GB +[2026-09-12 06:57:14] step 1328/5000 loss 0.3163 (w 0.4561 mse 0.4721 t 297 new 0.29) lr 1.00e-05 gnorm 0.217 3.09s mem 81.1GB +[2026-09-12 06:57:17] step 1329/5000 loss 0.3222 (w 0.2847 mse 0.2929 t 959 new 0.20) lr 1.00e-05 gnorm 0.168 3.44s mem 81.1GB +[2026-09-12 06:57:20] step 1330/5000 loss 0.3100 (w 0.4301 mse 0.4511 t 985 new 0.20) lr 1.00e-05 gnorm 0.312 3.00s mem 81.1GB +[2026-09-12 06:57:23] step 1331/5000 loss 0.1338 (w 0.4169 mse 0.4181 t 968 new 0.18) lr 1.00e-05 gnorm 0.140 2.82s mem 81.1GB +[2026-09-12 06:57:26] step 1332/5000 loss 0.3846 (w 0.2721 mse 0.2751 t 866 new 0.20) lr 1.00e-05 gnorm 0.174 3.15s mem 81.1GB +[2026-09-12 06:57:29] step 1333/5000 loss 0.1816 (w 0.2462 mse 0.2606 t 975 new 0.10) lr 1.00e-05 gnorm 0.213 3.00s mem 81.1GB +[2026-09-12 06:57:32] step 1334/5000 loss 0.2024 (w 0.2698 mse 0.2841 t 863 new 0.18) lr 1.00e-05 gnorm 0.181 3.01s mem 81.1GB +[2026-09-12 06:57:35] step 1335/5000 loss 0.2460 (w 0.4803 mse 0.4614 t 992 new 0.20) lr 1.00e-05 gnorm 0.210 3.07s mem 81.1GB +[2026-09-12 06:57:38] step 1336/5000 loss 0.3955 (w 0.3226 mse 0.3215 t 737 new 0.15) lr 1.00e-05 gnorm 0.142 3.04s mem 81.1GB +[2026-09-12 06:57:41] step 1337/5000 loss 0.1977 (w 0.2677 mse 0.2631 t 718 new 0.20) lr 1.00e-05 gnorm 0.123 3.07s mem 81.1GB +[2026-09-12 06:57:44] step 1338/5000 loss 0.1262 (w 0.2907 mse 0.3008 t 956 new 0.11) lr 1.00e-05 gnorm 0.156 3.10s mem 81.1GB +[2026-09-12 06:57:47] step 1339/5000 loss 0.3243 (w 0.3689 mse 0.3618 t 663 new 0.19) lr 1.00e-05 gnorm 0.160 3.04s mem 81.1GB +[2026-09-12 06:57:51] step 1340/5000 loss 0.4938 (w 0.3406 mse 0.3440 t 973 new 0.12) lr 1.00e-05 gnorm 0.155 3.07s mem 81.1GB +[2026-09-12 06:57:54] step 1341/5000 loss 0.3289 (w 0.3247 mse 0.3225 t 881 new 0.21) lr 1.00e-05 gnorm 0.152 3.08s mem 81.1GB +[2026-09-12 06:57:57] step 1342/5000 loss 0.1014 (w 0.3690 mse 0.3915 t 987 new 0.23) lr 1.00e-05 gnorm 0.115 3.03s mem 81.1GB +[2026-09-12 06:58:00] step 1343/5000 loss 0.2516 (w 0.3750 mse 0.3829 t 986 new 0.21) lr 1.00e-05 gnorm 0.141 3.07s mem 81.1GB +[2026-09-12 06:58:03] step 1344/5000 loss 0.3735 (w 0.2785 mse 0.3060 t 578 new 0.18) lr 1.00e-05 gnorm 0.135 3.10s mem 81.1GB +[2026-09-12 06:58:06] step 1345/5000 loss 0.3557 (w 0.2510 mse 0.2570 t 927 new 0.21) lr 1.00e-05 gnorm 0.157 3.00s mem 81.1GB +[2026-09-12 06:58:09] step 1346/5000 loss 0.3608 (w 0.4709 mse 0.4813 t 348 new 0.13) lr 1.00e-05 gnorm 0.116 3.27s mem 81.1GB +[2026-09-12 06:58:12] step 1347/5000 loss 0.4436 (w 0.2610 mse 0.2725 t 817 new 0.22) lr 1.00e-05 gnorm 0.146 3.08s mem 81.1GB +[2026-09-12 06:58:15] step 1348/5000 loss 0.2148 (w 0.3025 mse 0.3199 t 966 new 0.15) lr 1.00e-05 gnorm 0.116 3.02s mem 81.1GB +[2026-09-12 06:58:18] step 1349/5000 loss 0.2617 (w 0.2997 mse 0.2933 t 948 new 0.21) lr 1.00e-05 gnorm 0.168 3.13s mem 81.1GB +[2026-09-12 06:58:21] step 1350/5000 loss 0.2947 (w 0.2085 mse 0.2176 t 850 new 0.15) lr 1.00e-05 gnorm 0.187 2.82s mem 81.1GB +[2026-09-12 06:58:24] step 1351/5000 loss 0.2623 (w 0.2113 mse 0.2118 t 677 new 0.01) lr 1.00e-05 gnorm 0.206 3.04s mem 81.1GB +[2026-09-12 06:58:28] step 1352/5000 loss 0.4126 (w 0.3406 mse 0.3418 t 871 new 0.17) lr 1.00e-05 gnorm 0.211 3.34s mem 81.1GB +[2026-09-12 06:58:30] step 1353/5000 loss 0.3724 (w 0.3420 mse 0.3405 t 540 new 0.27) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +[2026-09-12 06:58:33] step 1354/5000 loss 0.1541 (w 0.4365 mse 0.4434 t 987 new 0.19) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +[2026-09-12 06:58:37] step 1355/5000 loss 0.4526 (w 0.2761 mse 0.2870 t 884 new 0.17) lr 1.00e-05 gnorm 0.158 3.09s mem 81.1GB +[2026-09-12 06:58:40] step 1356/5000 loss 0.4262 (w 0.3656 mse 0.3550 t 978 new 0.22) lr 1.00e-05 gnorm 0.260 3.01s mem 81.1GB +[2026-09-12 06:58:42] step 1357/5000 loss 0.2470 (w 0.2650 mse 0.2673 t 898 new 0.19) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +[2026-09-12 06:58:46] step 1358/5000 loss 0.2851 (w 0.3846 mse 0.3866 t 999 new 0.20) lr 1.00e-05 gnorm 0.141 3.30s mem 81.1GB +[2026-09-12 06:58:49] step 1359/5000 loss 0.1438 (w 0.2540 mse 0.2547 t 875 new 0.10) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +[2026-09-12 06:58:52] step 1360/5000 loss 0.3895 (w 0.2658 mse 0.2700 t 890 new 0.21) lr 1.00e-05 gnorm 0.143 3.04s mem 81.1GB +[2026-09-12 06:58:55] step 1361/5000 loss 0.2179 (w 0.1662 mse 0.1929 t 904 new 0.19) lr 1.00e-05 gnorm 0.139 3.11s mem 81.1GB +[2026-09-12 06:58:58] step 1362/5000 loss 0.2077 (w 0.2272 mse 0.2357 t 923 new 0.22) lr 1.00e-05 gnorm 0.161 3.01s mem 81.1GB +[2026-09-12 06:59:01] step 1363/5000 loss 0.3094 (w 0.4531 mse 0.4394 t 972 new 0.19) lr 1.00e-05 gnorm 0.139 2.81s mem 81.1GB +[2026-09-12 06:59:04] step 1364/5000 loss 0.4137 (w 0.3253 mse 0.3453 t 980 new 0.14) lr 1.00e-05 gnorm 0.150 3.29s mem 81.1GB +[2026-09-12 06:59:07] step 1365/5000 loss 0.4314 (w 0.3289 mse 0.3302 t 562 new 0.21) lr 1.00e-05 gnorm 0.156 3.09s mem 81.1GB +[2026-09-12 06:59:10] step 1366/5000 loss 0.3442 (w 0.2847 mse 0.2807 t 841 new 0.21) lr 1.00e-05 gnorm 0.106 3.02s mem 81.1GB +[2026-09-12 06:59:13] step 1367/5000 loss 0.3213 (w 0.5129 mse 0.5252 t 212 new 0.18) lr 1.00e-05 gnorm 0.210 3.14s mem 81.1GB +[2026-09-12 06:59:16] step 1368/5000 loss 0.4513 (w 0.2390 mse 0.2470 t 719 new 0.12) lr 1.00e-05 gnorm 0.135 3.03s mem 81.1GB +[2026-09-12 06:59:19] step 1369/5000 loss 0.1059 (w 0.2383 mse 0.2496 t 969 new 0.22) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-12 06:59:23] step 1370/5000 loss 0.3608 (w 0.1946 mse 0.2097 t 666 new 0.21) lr 1.00e-05 gnorm 0.183 3.34s mem 81.1GB +[2026-09-12 06:59:26] step 1371/5000 loss 0.3795 (w 0.2830 mse 0.2903 t 931 new 0.22) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +[2026-09-12 06:59:29] step 1372/5000 loss 0.3204 (w 0.2948 mse 0.3023 t 815 new 0.24) lr 1.00e-05 gnorm 0.151 3.05s mem 81.1GB +[2026-09-12 06:59:32] step 1373/5000 loss 0.3319 (w 0.3379 mse 0.3346 t 878 new 0.20) lr 1.00e-05 gnorm 0.137 3.08s mem 81.1GB +[2026-09-12 06:59:35] step 1374/5000 loss 0.2787 (w 0.3173 mse 0.3161 t 955 new 0.28) lr 1.00e-05 gnorm 0.124 3.01s mem 81.1GB +[2026-09-12 06:59:38] step 1375/5000 loss 0.3877 (w 0.2771 mse 0.2820 t 999 new 0.10) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +[2026-09-12 06:59:41] step 1376/5000 loss 0.2967 (w 0.2646 mse 0.2829 t 944 new 0.21) lr 1.00e-05 gnorm 0.158 3.07s mem 81.1GB +[2026-09-12 06:59:44] step 1377/5000 loss 0.3711 (w 0.2985 mse 0.3122 t 808 new 0.26) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +[2026-09-12 06:59:47] step 1378/5000 loss 0.3529 (w 0.2493 mse 0.2595 t 950 new 0.19) lr 1.00e-05 gnorm 0.145 3.09s mem 81.1GB +[2026-09-12 06:59:50] step 1379/5000 loss 0.2446 (w 0.2704 mse 0.2869 t 790 new 0.17) lr 1.00e-05 gnorm 0.161 3.09s mem 81.1GB +[2026-09-12 06:59:53] step 1380/5000 loss 0.2413 (w 0.3437 mse 0.3521 t 970 new 0.07) lr 1.00e-05 gnorm 0.103 3.03s mem 81.1GB +[2026-09-12 06:59:56] step 1381/5000 loss 0.2720 (w 0.3647 mse 0.3646 t 892 new 0.21) lr 1.00e-05 gnorm 0.142 2.82s mem 81.1GB +[2026-09-12 06:59:59] step 1382/5000 loss 0.2683 (w 0.2507 mse 0.2707 t 941 new 0.22) lr 1.00e-05 gnorm 0.141 3.13s mem 81.1GB +[2026-09-12 07:00:02] step 1383/5000 loss 0.3576 (w 0.3294 mse 0.3381 t 479 new 0.19) lr 1.00e-05 gnorm 0.196 3.27s mem 81.1GB +[2026-09-12 07:00:05] step 1384/5000 loss 0.4502 (w 0.2193 mse 0.2238 t 815 new 0.23) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +[2026-09-12 07:00:09] step 1385/5000 loss 0.4046 (w 0.7409 mse 0.7296 t 100 new 0.15) lr 1.00e-05 gnorm 0.181 3.24s mem 81.1GB +[2026-09-12 07:00:11] step 1386/5000 loss 0.2443 (w 0.2801 mse 0.2836 t 836 new 0.21) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-12 07:00:15] step 1387/5000 loss 0.2334 (w 0.2572 mse 0.2702 t 906 new 0.23) lr 1.00e-05 gnorm 0.109 3.14s mem 81.1GB +[2026-09-12 07:00:17] step 1388/5000 loss 0.1515 (w 0.2095 mse 0.2243 t 886 new 0.24) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +[2026-09-12 07:00:21] step 1389/5000 loss 0.3476 (w 0.2757 mse 0.2999 t 988 new 0.25) lr 1.00e-05 gnorm 0.138 3.31s mem 81.1GB +[2026-09-12 07:00:24] step 1390/5000 loss 0.2805 (w 0.2155 mse 0.2195 t 897 new 0.21) lr 1.00e-05 gnorm 0.138 3.07s mem 81.1GB +[2026-09-12 07:00:27] step 1391/5000 loss 0.3702 (w 0.2257 mse 0.2422 t 712 new 0.18) lr 1.00e-05 gnorm 0.129 3.28s mem 81.1GB +[2026-09-12 07:00:30] step 1392/5000 loss 0.3597 (w 0.1735 mse 0.1917 t 916 new 0.14) lr 1.00e-05 gnorm 0.212 2.82s mem 81.1GB +[2026-09-12 07:00:33] step 1393/5000 loss 0.2704 (w 0.2464 mse 0.2515 t 858 new 0.20) lr 1.00e-05 gnorm 0.784 3.07s mem 81.1GB +[2026-09-12 07:00:36] step 1394/5000 loss 0.3388 (w 0.2768 mse 0.2985 t 983 new 0.27) lr 1.00e-05 gnorm 0.108 3.09s mem 81.1GB +[2026-09-12 07:00:39] step 1395/5000 loss 0.2850 (w 0.2579 mse 0.2725 t 758 new 0.13) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +[2026-09-12 07:00:43] step 1396/5000 loss 0.1361 (w 0.3029 mse 0.3261 t 974 new 0.22) lr 1.00e-05 gnorm 0.137 3.45s mem 81.1GB +[2026-09-12 07:00:46] step 1397/5000 loss 0.3715 (w 0.2217 mse 0.2341 t 908 new 0.24) lr 1.00e-05 gnorm 0.181 3.01s mem 81.1GB +[2026-09-12 07:00:48] step 1398/5000 loss 0.4238 (w 0.3699 mse 0.3930 t 200 new 0.26) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +[2026-09-12 07:00:52] step 1399/5000 loss 0.2508 (w 0.3009 mse 0.3075 t 773 new 0.22) lr 1.00e-05 gnorm 0.519 3.36s mem 81.1GB +[2026-09-12 07:00:55] step 1400/5000 loss 0.1985 (w 0.3801 mse 0.3891 t 983 new 0.24) lr 1.00e-05 gnorm 0.179 3.01s mem 81.1GB +[2026-09-12 07:00:58] step 1401/5000 loss 0.1364 (w 0.2887 mse 0.3021 t 953 new 0.21) lr 1.00e-05 gnorm 0.205 3.04s mem 81.1GB +[2026-09-12 07:01:01] step 1402/5000 loss 0.1759 (w 0.4103 mse 0.4022 t 715 new 0.20) lr 1.00e-05 gnorm 0.275 3.33s mem 81.1GB +[2026-09-12 07:01:04] step 1403/5000 loss 0.1725 (w 0.2647 mse 0.2723 t 945 new 0.15) lr 1.00e-05 gnorm 0.149 3.05s mem 81.1GB +[2026-09-12 07:01:07] step 1404/5000 loss 0.4354 (w 0.2349 mse 0.2591 t 570 new 0.16) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +[2026-09-12 07:01:10] step 1405/5000 loss 0.2751 (w 0.3158 mse 0.3200 t 959 new 0.20) lr 1.00e-05 gnorm 0.119 3.38s mem 81.1GB +[2026-09-12 07:01:13] step 1406/5000 loss 0.2030 (w 0.4913 mse 0.5002 t 985 new 0.22) lr 1.00e-05 gnorm 0.120 3.02s mem 81.1GB +[2026-09-12 07:01:17] step 1407/5000 loss 0.1951 (w 0.2527 mse 0.2581 t 951 new 0.20) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +[2026-09-12 07:01:20] step 1408/5000 loss 0.2010 (w 0.2607 mse 0.2836 t 981 new 0.22) lr 1.00e-05 gnorm 0.110 3.40s mem 81.1GB +[2026-09-12 07:01:23] step 1409/5000 loss 0.3493 (w 0.3110 mse 0.3354 t 975 new 0.25) lr 1.00e-05 gnorm 0.113 3.01s mem 81.1GB +[2026-09-12 07:01:26] step 1410/5000 loss 0.4956 (w 0.4181 mse 0.4325 t 233 new 0.20) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +[2026-09-12 07:01:29] step 1411/5000 loss 0.2617 (w 0.2275 mse 0.2417 t 731 new 0.27) lr 1.00e-05 gnorm 0.135 3.32s mem 81.1GB +[2026-09-12 07:01:32] step 1412/5000 loss 0.2144 (w 0.1878 mse 0.2054 t 924 new 0.15) lr 1.00e-05 gnorm 0.203 3.03s mem 81.1GB +[2026-09-12 07:01:36] step 1413/5000 loss 0.2518 (w 0.2375 mse 0.2361 t 819 new 0.19) lr 1.00e-05 gnorm 0.139 3.15s mem 81.1GB +[2026-09-12 07:01:39] step 1414/5000 loss 0.2783 (w 0.2125 mse 0.2253 t 899 new 0.13) lr 1.00e-05 gnorm 0.170 3.06s mem 81.1GB +[2026-09-12 07:01:42] step 1415/5000 loss 0.1747 (w 0.5367 mse 0.5497 t 987 new 0.25) lr 1.00e-05 gnorm 0.239 3.03s mem 81.1GB +[2026-09-12 07:01:44] step 1416/5000 loss 0.2661 (w 0.5771 mse 0.5710 t 200 new 0.19) lr 1.00e-05 gnorm 0.202 2.82s mem 81.1GB +[2026-09-12 07:01:47] step 1417/5000 loss 0.2943 (w 0.2087 mse 0.2242 t 890 new 0.23) lr 1.00e-05 gnorm 0.159 3.05s mem 81.1GB +[2026-09-12 07:01:51] step 1418/5000 loss 0.1870 (w 0.2907 mse 0.2997 t 760 new 0.20) lr 1.00e-05 gnorm 0.113 3.30s mem 81.1GB +[2026-09-12 07:01:54] step 1419/5000 loss 0.1110 (w 0.3036 mse 0.3074 t 980 new 0.22) lr 1.00e-05 gnorm 0.147 3.12s mem 81.1GB +[2026-09-12 07:01:57] step 1420/5000 loss 0.2578 (w 0.2413 mse 0.2378 t 727 new 0.09) lr 1.00e-05 gnorm 0.120 3.07s mem 81.1GB +[2026-09-12 07:02:00] step 1421/5000 loss 0.2196 (w 0.4053 mse 0.3937 t 953 new 0.16) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +[2026-09-12 07:02:03] step 1422/5000 loss 0.4448 (w 0.4151 mse 0.4315 t 301 new 0.25) lr 1.00e-05 gnorm 0.147 3.00s mem 81.1GB +[2026-09-12 07:02:06] step 1423/5000 loss 0.3849 (w 0.4013 mse 0.4253 t 383 new 0.21) lr 1.00e-05 gnorm 0.158 3.13s mem 81.1GB +[2026-09-12 07:02:10] step 1424/5000 loss 0.2667 (w 0.2996 mse 0.2998 t 799 new 0.10) lr 1.00e-05 gnorm 0.127 3.31s mem 81.1GB +[2026-09-12 07:02:13] step 1425/5000 loss 0.1484 (w 0.2486 mse 0.2555 t 744 new 0.23) lr 1.00e-05 gnorm 0.130 3.12s mem 81.1GB +[2026-09-12 07:02:16] step 1426/5000 loss 0.4222 (w 0.2848 mse 0.2855 t 506 new 0.20) lr 1.00e-05 gnorm 0.151 3.11s mem 81.1GB +[2026-09-12 07:02:19] step 1427/5000 loss 0.2912 (w 0.3244 mse 0.3214 t 841 new 0.18) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +[2026-09-12 07:02:22] step 1428/5000 loss 0.2309 (w 0.2325 mse 0.2364 t 747 new 0.21) lr 1.00e-05 gnorm 0.100 3.05s mem 81.1GB +[2026-09-12 07:02:25] step 1429/5000 loss 0.4846 (w 0.4769 mse 0.4924 t 233 new 0.14) lr 1.00e-05 gnorm 0.118 3.01s mem 81.1GB +[2026-09-12 07:02:28] step 1430/5000 loss 0.2944 (w 0.2720 mse 0.2738 t 949 new 0.21) lr 1.00e-05 gnorm 0.105 3.28s mem 81.1GB +[2026-09-12 07:02:31] step 1431/5000 loss 0.3167 (w 0.2675 mse 0.2831 t 920 new 0.21) lr 1.00e-05 gnorm 0.126 3.11s mem 81.1GB +[2026-09-12 07:02:34] step 1432/5000 loss 0.2590 (w 0.2589 mse 0.2591 t 931 new 0.12) lr 1.00e-05 gnorm 0.160 2.82s mem 81.1GB +[2026-09-12 07:02:37] step 1433/5000 loss 0.2024 (w 0.3218 mse 0.3327 t 942 new 0.22) lr 1.00e-05 gnorm 0.448 3.04s mem 81.1GB +[2026-09-12 07:02:40] step 1434/5000 loss 0.3523 (w 0.3118 mse 0.3106 t 906 new 0.08) lr 1.00e-05 gnorm 0.151 3.08s mem 81.1GB +[2026-09-12 07:02:43] step 1435/5000 loss 0.1635 (w 0.3585 mse 0.3559 t 983 new 0.27) lr 1.00e-05 gnorm 0.164 3.28s mem 81.1GB +[2026-09-12 07:02:47] step 1436/5000 loss 0.2892 (w 0.3389 mse 0.3422 t 672 new 0.21) lr 1.00e-05 gnorm 0.178 3.05s mem 81.1GB +[2026-09-12 07:02:50] step 1437/5000 loss 0.1873 (w 0.2714 mse 0.2808 t 942 new 0.21) lr 1.00e-05 gnorm 0.110 3.12s mem 81.1GB +[2026-09-12 07:02:52] step 1438/5000 loss 0.3684 (w 0.3691 mse 0.3802 t 465 new 0.19) lr 1.00e-05 gnorm 0.167 2.83s mem 81.1GB +[2026-09-12 07:02:56] step 1439/5000 loss 0.2974 (w 0.2860 mse 0.3015 t 795 new 0.17) lr 1.00e-05 gnorm 0.126 3.05s mem 81.1GB +[2026-09-12 07:02:59] step 1440/5000 loss 0.3372 (w 0.2047 mse 0.2155 t 945 new 0.22) lr 1.00e-05 gnorm 0.148 3.08s mem 81.1GB +[2026-09-12 07:03:02] step 1441/5000 loss 0.2480 (w 0.3485 mse 0.3451 t 702 new 0.25) lr 1.00e-05 gnorm 0.139 3.32s mem 81.1GB +[2026-09-12 07:03:05] step 1442/5000 loss 0.2901 (w 0.1890 mse 0.2083 t 740 new 0.22) lr 1.00e-05 gnorm 0.309 2.82s mem 81.1GB +[2026-09-12 07:03:08] step 1443/5000 loss 0.3342 (w 0.3301 mse 0.3413 t 773 new 0.25) lr 1.00e-05 gnorm 0.199 3.14s mem 81.1GB +[2026-09-12 07:03:11] step 1444/5000 loss 0.2938 (w 0.3062 mse 0.3119 t 790 new 0.21) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +[2026-09-12 07:03:14] step 1445/5000 loss 0.2758 (w 0.4202 mse 0.4451 t 254 new 0.17) lr 1.00e-05 gnorm 0.114 3.08s mem 81.1GB +[2026-09-12 07:03:17] step 1446/5000 loss 0.3019 (w 0.2619 mse 0.2748 t 973 new 0.10) lr 1.00e-05 gnorm 0.127 3.30s mem 81.1GB +[2026-09-12 07:03:20] step 1447/5000 loss 0.2208 (w 0.2030 mse 0.2080 t 938 new 0.08) lr 1.00e-05 gnorm 0.141 3.24s mem 81.1GB +[2026-09-12 07:03:23] step 1448/5000 loss 0.3013 (w 0.2346 mse 0.2413 t 537 new 0.16) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +[2026-09-12 07:03:27] step 1449/5000 loss 0.1510 (w 0.3903 mse 0.3939 t 982 new 0.21) lr 1.00e-05 gnorm 0.142 3.38s mem 81.1GB +[2026-09-12 07:03:29] step 1450/5000 loss 0.3370 (w 0.3473 mse 0.3508 t 576 new 0.22) lr 1.00e-05 gnorm 0.300 2.82s mem 81.1GB +[2026-09-12 07:03:32] step 1451/5000 loss 0.3256 (w 0.1634 mse 0.1877 t 720 new 0.22) lr 1.00e-05 gnorm 0.128 3.03s mem 81.1GB +[2026-09-12 07:03:36] step 1452/5000 loss 0.2128 (w 0.3186 mse 0.3293 t 957 new 0.23) lr 1.00e-05 gnorm 0.395 3.36s mem 81.1GB +[2026-09-12 07:03:39] step 1453/5000 loss 0.4669 (w 0.2888 mse 0.2892 t 462 new 0.11) lr 1.00e-05 gnorm 0.152 3.28s mem 81.1GB +[2026-09-12 07:03:42] step 1454/5000 loss 0.3409 (w 0.3763 mse 0.3806 t 368 new 0.10) lr 1.00e-05 gnorm 0.107 2.84s mem 81.1GB +[2026-09-12 07:03:45] step 1455/5000 loss 0.2608 (w 0.2812 mse 0.2870 t 628 new 0.18) lr 1.00e-05 gnorm 0.162 3.40s mem 81.1GB +[2026-09-12 07:03:48] step 1456/5000 loss 0.3523 (w 0.3293 mse 0.3407 t 768 new 0.18) lr 1.00e-05 gnorm 0.126 3.01s mem 81.1GB +[2026-09-12 07:03:51] step 1457/5000 loss 0.2701 (w 0.2534 mse 0.2592 t 818 new 0.20) lr 1.00e-05 gnorm 0.234 2.83s mem 81.1GB +[2026-09-12 07:03:54] step 1458/5000 loss 0.2335 (w 0.2928 mse 0.2986 t 902 new 0.23) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +[2026-09-12 07:03:58] step 1459/5000 loss 0.2780 (w 0.4004 mse 0.4128 t 972 new 0.13) lr 1.00e-05 gnorm 0.146 3.34s mem 81.1GB +[2026-09-12 07:04:01] step 1460/5000 loss 0.3497 (w 0.4026 mse 0.3965 t 982 new 0.26) lr 1.00e-05 gnorm 0.128 3.05s mem 81.1GB +[2026-09-12 07:04:04] step 1461/5000 loss 0.3051 (w 0.2996 mse 0.2986 t 939 new 0.19) lr 1.00e-05 gnorm 0.126 3.11s mem 81.1GB +[2026-09-12 07:04:07] step 1462/5000 loss 0.1931 (w 0.3405 mse 0.3383 t 933 new 0.21) lr 1.00e-05 gnorm 0.142 3.00s mem 81.1GB +[2026-09-12 07:04:10] step 1463/5000 loss 0.3208 (w 0.3493 mse 0.3413 t 942 new 0.23) lr 1.00e-05 gnorm 0.158 3.02s mem 81.1GB +[2026-09-12 07:04:13] step 1464/5000 loss 0.3218 (w 0.3391 mse 0.3659 t 998 new 0.21) lr 1.00e-05 gnorm 0.149 3.11s mem 81.1GB +[2026-09-12 07:04:16] step 1465/5000 loss 0.4380 (w 0.2847 mse 0.2960 t 518 new 0.13) lr 1.00e-05 gnorm 0.131 3.27s mem 81.1GB +[2026-09-12 07:04:19] step 1466/5000 loss 0.2989 (w 0.2864 mse 0.2816 t 779 new 0.17) lr 1.00e-05 gnorm 0.225 3.04s mem 81.1GB +[2026-09-12 07:04:22] step 1467/5000 loss 0.3514 (w 0.2546 mse 0.2571 t 902 new 0.15) lr 1.00e-05 gnorm 0.250 3.13s mem 81.1GB +[2026-09-12 07:04:25] step 1468/5000 loss 0.3181 (w 0.3872 mse 0.3837 t 975 new 0.23) lr 1.00e-05 gnorm 0.257 3.02s mem 81.1GB +[2026-09-12 07:04:28] step 1469/5000 loss 0.3611 (w 0.3210 mse 0.3239 t 833 new 0.21) lr 1.00e-05 gnorm 0.153 3.10s mem 81.1GB +[2026-09-12 07:04:31] step 1470/5000 loss 0.3541 (w 0.2765 mse 0.2735 t 798 new 0.10) lr 1.00e-05 gnorm 0.105 2.83s mem 81.1GB +[2026-09-12 07:04:34] step 1471/5000 loss 0.2424 (w 0.1809 mse 0.1984 t 976 new 0.11) lr 1.00e-05 gnorm 0.115 3.08s mem 81.1GB +[2026-09-12 07:04:38] step 1472/5000 loss 0.3435 (w 0.2243 mse 0.2311 t 695 new 0.22) lr 1.00e-05 gnorm 0.151 3.11s mem 81.1GB +[2026-09-12 07:04:41] step 1473/5000 loss 0.2385 (w 0.2653 mse 0.2799 t 883 new 0.18) lr 1.00e-05 gnorm 0.151 3.14s mem 81.1GB +[2026-09-12 07:04:44] step 1474/5000 loss 0.2674 (w 0.2344 mse 0.2514 t 875 new 0.25) lr 1.00e-05 gnorm 0.166 3.07s mem 81.1GB +[2026-09-12 07:04:47] step 1475/5000 loss 0.2402 (w 0.2421 mse 0.2528 t 952 new 0.19) lr 1.00e-05 gnorm 0.163 3.35s mem 81.1GB +[2026-09-12 07:04:50] step 1476/5000 loss 0.2467 (w 0.3244 mse 0.3194 t 815 new 0.20) lr 1.00e-05 gnorm 0.166 3.04s mem 81.1GB +[2026-09-12 07:04:53] step 1477/5000 loss 0.3218 (w 0.3617 mse 0.3719 t 932 new 0.13) lr 1.00e-05 gnorm 0.160 3.06s mem 81.1GB +[2026-09-12 07:04:56] step 1478/5000 loss 0.4458 (w 0.5164 mse 0.5228 t 306 new 0.17) lr 1.00e-05 gnorm 0.116 3.07s mem 81.1GB +[2026-09-12 07:04:59] step 1479/5000 loss 0.2764 (w 0.3493 mse 0.3491 t 987 new 0.10) lr 1.00e-05 gnorm 0.125 3.17s mem 81.1GB +[2026-09-12 07:05:02] step 1480/5000 loss 0.3208 (w 0.3802 mse 0.3936 t 982 new 0.22) lr 1.00e-05 gnorm 0.124 3.02s mem 81.1GB +[2026-09-12 07:05:06] step 1481/5000 loss 0.3906 (w 0.3157 mse 0.3303 t 336 new 0.28) lr 1.00e-05 gnorm 0.136 3.13s mem 81.1GB +[2026-09-12 07:05:09] step 1482/5000 loss 0.2729 (w 0.3231 mse 0.3236 t 492 new 0.19) lr 1.00e-05 gnorm 0.111 3.07s mem 81.1GB +[2026-09-12 07:05:12] step 1483/5000 loss 0.3466 (w 0.3396 mse 0.3418 t 703 new 0.16) lr 1.00e-05 gnorm 0.168 3.05s mem 81.1GB +[2026-09-12 07:05:15] step 1484/5000 loss 0.4804 (w 0.3339 mse 0.3384 t 669 new 0.25) lr 1.00e-05 gnorm 0.183 3.10s mem 81.1GB +[2026-09-12 07:05:18] step 1485/5000 loss 0.2719 (w 0.1394 mse 0.1588 t 828 new 0.21) lr 1.00e-05 gnorm 0.144 3.14s mem 81.1GB +[2026-09-12 07:05:21] step 1486/5000 loss 0.2050 (w 0.2881 mse 0.2922 t 939 new 0.24) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +[2026-09-12 07:05:24] step 1487/5000 loss 0.3445 (w 0.3017 mse 0.3087 t 892 new 0.21) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +[2026-09-12 07:05:28] step 1488/5000 loss 0.2677 (w 0.3682 mse 0.3716 t 990 new 0.20) lr 1.00e-05 gnorm 0.157 3.27s mem 81.1GB +[2026-09-12 07:05:30] step 1489/5000 loss 0.2981 (w 0.1658 mse 0.1849 t 852 new 0.23) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +[2026-09-12 07:05:33] step 1490/5000 loss 0.1933 (w 0.2348 mse 0.2336 t 906 new 0.25) lr 1.00e-05 gnorm 0.169 3.11s mem 81.1GB +[2026-09-12 07:05:37] step 1491/5000 loss 0.2885 (w 0.2970 mse 0.2858 t 684 new 0.21) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +[2026-09-12 07:05:39] step 1492/5000 loss 0.1513 (w 0.4349 mse 0.4404 t 965 new 0.21) lr 1.00e-05 gnorm 0.112 2.82s mem 81.1GB +[2026-09-12 07:05:43] step 1493/5000 loss 0.4312 (w 0.3593 mse 0.3787 t 968 new 0.19) lr 1.00e-05 gnorm 0.297 3.10s mem 81.1GB +[2026-09-12 07:05:46] step 1494/5000 loss 0.3433 (w 0.4152 mse 0.4061 t 946 new 0.21) lr 1.00e-05 gnorm 0.223 3.33s mem 81.1GB +[2026-09-12 07:05:49] step 1495/5000 loss 0.3197 (w 0.3499 mse 0.3534 t 996 new 0.28) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +[2026-09-12 07:05:52] step 1496/5000 loss 0.5690 (w 0.3269 mse 0.3327 t 981 new 0.23) lr 1.00e-05 gnorm 0.128 2.82s mem 81.1GB +[2026-09-12 07:05:55] step 1497/5000 loss 0.2857 (w 0.2369 mse 0.2535 t 770 new 0.25) lr 1.00e-05 gnorm 0.132 3.14s mem 81.1GB +[2026-09-12 07:05:58] step 1498/5000 loss 0.3403 (w 0.2584 mse 0.2589 t 824 new 0.15) lr 1.00e-05 gnorm 0.133 2.82s mem 81.1GB +[2026-09-12 07:06:01] step 1499/5000 loss 0.1506 (w 0.3541 mse 0.3602 t 947 new 0.13) lr 1.00e-05 gnorm 0.196 3.09s mem 81.1GB +[2026-09-12 07:06:04] step 1500/5000 loss 0.4402 (w 0.3066 mse 0.3102 t 566 new 0.19) lr 1.00e-05 gnorm 0.106 3.35s mem 81.1GB +[2026-09-12 07:06:06] [val] step 1500 t=200: w=0.4724 mse=0.4908 (n=16) t=500: w=0.2872 mse=0.3023 (n=16) t=800: w=0.2419 mse=0.2541 (n=16) | mean w=0.3338 mse=0.3491 2s +[2026-09-12 07:06:52] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step1500.safetensors 4093 个张量 37.98 GB +[2026-09-12 07:06:57] step 1501/5000 loss 0.3711 (w 0.2985 mse 0.3052 t 973 new 0.20) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +[2026-09-12 07:07:01] step 1502/5000 loss 0.2898 (w 0.3365 mse 0.3492 t 975 new 0.14) lr 1.00e-05 gnorm 0.090 3.11s mem 81.1GB +[2026-09-12 07:07:04] step 1503/5000 loss 0.3513 (w 0.2961 mse 0.2994 t 769 new 0.21) lr 1.00e-05 gnorm 0.175 3.05s mem 81.1GB +[2026-09-12 07:07:07] step 1504/5000 loss 0.2948 (w 0.2583 mse 0.2658 t 883 new 0.17) lr 1.00e-05 gnorm 0.227 3.12s mem 81.1GB +[2026-09-12 07:07:10] step 1505/5000 loss 0.2858 (w 0.2625 mse 0.2730 t 994 new 0.22) lr 1.00e-05 gnorm 0.148 3.24s mem 81.1GB +[2026-09-12 07:07:13] step 1506/5000 loss 0.2935 (w 0.1711 mse 0.1986 t 933 new 0.22) lr 1.00e-05 gnorm 0.134 3.10s mem 81.1GB +[2026-09-12 07:07:16] step 1507/5000 loss 0.2711 (w 0.3627 mse 0.3650 t 328 new 0.19) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +[2026-09-12 07:07:19] step 1508/5000 loss 0.1250 (w 0.1665 mse 0.1888 t 765 new 0.19) lr 1.00e-05 gnorm 0.118 2.83s mem 81.1GB +[2026-09-12 07:07:22] step 1509/5000 loss 0.2377 (w 0.3633 mse 0.3479 t 987 new 0.22) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +[2026-09-12 07:07:25] step 1510/5000 loss 0.3164 (w 0.1636 mse 0.1800 t 802 new 0.15) lr 1.00e-05 gnorm 0.182 3.42s mem 81.1GB +[2026-09-12 07:07:29] step 1511/5000 loss 0.2306 (w 0.2229 mse 0.2431 t 811 new 0.22) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +[2026-09-12 07:07:32] step 1512/5000 loss 0.2077 (w 0.3720 mse 0.3675 t 966 new 0.15) lr 1.00e-05 gnorm 0.151 3.05s mem 81.1GB +[2026-09-12 07:07:35] step 1513/5000 loss 0.4002 (w 0.2634 mse 0.2712 t 783 new 0.19) lr 1.00e-05 gnorm 0.125 3.07s mem 81.1GB +[2026-09-12 07:07:37] step 1514/5000 loss 0.2946 (w 0.3709 mse 0.3770 t 269 new 0.20) lr 1.00e-05 gnorm 0.213 2.82s mem 81.1GB +[2026-09-12 07:07:41] step 1515/5000 loss 0.1470 (w 0.3348 mse 0.3447 t 926 new 0.25) lr 1.00e-05 gnorm 0.130 3.05s mem 81.1GB +[2026-09-12 07:07:44] step 1516/5000 loss 0.3421 (w 0.2220 mse 0.2309 t 826 new 0.22) lr 1.00e-05 gnorm 0.219 3.35s mem 81.1GB +[2026-09-12 07:07:47] step 1517/5000 loss 0.3070 (w 0.2678 mse 0.2713 t 760 new 0.21) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +[2026-09-12 07:07:50] step 1518/5000 loss 0.2834 (w 0.2741 mse 0.2851 t 917 new 0.21) lr 1.00e-05 gnorm 0.118 3.13s mem 81.1GB +[2026-09-12 07:07:53] step 1519/5000 loss 0.3289 (w 0.2825 mse 0.2962 t 659 new 0.29) lr 1.00e-05 gnorm 0.115 3.10s mem 81.1GB +[2026-09-12 07:07:56] step 1520/5000 loss 0.3655 (w 0.2820 mse 0.2937 t 301 new 0.06) lr 1.00e-05 gnorm 0.281 2.81s mem 81.1GB +[2026-09-12 07:07:59] step 1521/5000 loss 0.2360 (w 0.1904 mse 0.2083 t 871 new 0.21) lr 1.00e-05 gnorm 0.202 3.09s mem 81.1GB +[2026-09-12 07:08:02] step 1522/5000 loss 0.2982 (w 0.3466 mse 0.3510 t 958 new 0.17) lr 1.00e-05 gnorm 0.148 3.39s mem 81.1GB +[2026-09-12 07:08:06] step 1523/5000 loss 0.3773 (w 0.3606 mse 0.3696 t 568 new 0.17) lr 1.00e-05 gnorm 0.105 3.12s mem 81.1GB +[2026-09-12 07:08:08] step 1524/5000 loss 0.3640 (w 0.2922 mse 0.2994 t 586 new 0.20) lr 1.00e-05 gnorm 0.101 2.83s mem 81.1GB +[2026-09-12 07:08:12] step 1525/5000 loss 0.3388 (w 0.2889 mse 0.3097 t 959 new 0.19) lr 1.00e-05 gnorm 0.154 3.31s mem 81.1GB +[2026-09-12 07:08:15] step 1526/5000 loss 0.5537 (w 0.3353 mse 0.3325 t 709 new 0.25) lr 1.00e-05 gnorm 0.139 3.04s mem 81.1GB +[2026-09-12 07:08:18] step 1527/5000 loss 0.3055 (w 0.2304 mse 0.2453 t 727 new 0.22) lr 1.00e-05 gnorm 0.169 2.84s mem 81.1GB +[2026-09-12 07:08:21] step 1528/5000 loss 0.3067 (w 0.3241 mse 0.3368 t 710 new 0.14) lr 1.00e-05 gnorm 0.141 3.13s mem 81.1GB +[2026-09-12 07:08:24] step 1529/5000 loss 0.3764 (w 0.3182 mse 0.3266 t 626 new 0.25) lr 1.00e-05 gnorm 0.178 3.33s mem 81.1GB +[2026-09-12 07:08:27] step 1530/5000 loss 0.2495 (w 0.3148 mse 0.3197 t 634 new 0.21) lr 1.00e-05 gnorm 0.759 2.83s mem 81.1GB +[2026-09-12 07:08:30] step 1531/5000 loss 0.1992 (w 0.3465 mse 0.3455 t 939 new 0.19) lr 1.00e-05 gnorm 0.163 3.35s mem 81.1GB +[2026-09-12 07:08:33] step 1532/5000 loss 0.2619 (w 0.2086 mse 0.2251 t 925 new 0.10) lr 1.00e-05 gnorm 0.177 3.04s mem 81.1GB +[2026-09-12 07:08:36] step 1533/5000 loss 0.3152 (w 0.3310 mse 0.3389 t 995 new 0.24) lr 1.00e-05 gnorm 0.177 2.82s mem 81.1GB +[2026-09-12 07:08:39] step 1534/5000 loss 0.4022 (w 0.2651 mse 0.2717 t 728 new 0.16) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +[2026-09-12 07:08:43] step 1535/5000 loss 0.2505 (w 0.3009 mse 0.3039 t 875 new 0.24) lr 1.00e-05 gnorm 0.161 3.36s mem 81.1GB +[2026-09-12 07:08:45] step 1536/5000 loss 0.0992 (w 0.3247 mse 0.3187 t 856 new 0.13) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +[2026-09-12 07:08:48] step 1537/5000 loss 0.3369 (w 0.2664 mse 0.2787 t 890 new 0.22) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +[2026-09-12 07:08:51] step 1538/5000 loss 0.2747 (w 0.2818 mse 0.2907 t 813 new 0.29) lr 1.00e-05 gnorm 0.375 3.00s mem 81.1GB +[2026-09-12 07:08:54] step 1539/5000 loss 0.3993 (w 0.1911 mse 0.2065 t 781 new 0.21) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +[2026-09-12 07:08:58] step 1540/5000 loss 0.2894 (w 0.3191 mse 0.3241 t 961 new 0.20) lr 1.00e-05 gnorm 0.228 3.09s mem 81.1GB +[2026-09-12 07:09:01] step 1541/5000 loss 0.3058 (w 0.5165 mse 0.5055 t 994 new 0.23) lr 1.00e-05 gnorm 0.127 3.13s mem 81.1GB +[2026-09-12 07:09:04] step 1542/5000 loss 0.4305 (w 0.1834 mse 0.1958 t 669 new 0.13) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +[2026-09-12 07:09:07] step 1543/5000 loss 0.2439 (w 0.2079 mse 0.2402 t 996 new 0.22) lr 1.00e-05 gnorm 0.149 3.06s mem 81.1GB +[2026-09-12 07:09:10] step 1544/5000 loss 0.4328 (w 0.2992 mse 0.2898 t 743 new 0.22) lr 1.00e-05 gnorm 0.159 3.03s mem 81.1GB +[2026-09-12 07:09:13] step 1545/5000 loss 0.4366 (w 0.3032 mse 0.3209 t 967 new 0.16) lr 1.00e-05 gnorm 0.167 3.04s mem 81.1GB +[2026-09-12 07:09:16] step 1546/5000 loss 0.2653 (w 0.2708 mse 0.2770 t 506 new 0.21) lr 1.00e-05 gnorm 0.131 3.38s mem 81.1GB +[2026-09-12 07:09:19] step 1547/5000 loss 0.2674 (w 0.2048 mse 0.2157 t 938 new 0.06) lr 1.00e-05 gnorm 0.207 3.09s mem 81.1GB +[2026-09-12 07:09:22] step 1548/5000 loss 0.2422 (w 0.3114 mse 0.3388 t 669 new 0.15) lr 1.00e-05 gnorm 0.146 3.09s mem 81.1GB +[2026-09-12 07:09:25] step 1549/5000 loss 0.3421 (w 0.3135 mse 0.3231 t 932 new 0.28) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +[2026-09-12 07:09:28] step 1550/5000 loss 0.1443 (w 0.5199 mse 0.5160 t 981 new 0.22) lr 1.00e-05 gnorm 0.125 3.09s mem 81.1GB +[2026-09-12 07:09:32] step 1551/5000 loss 0.4859 (w 0.2506 mse 0.2830 t 390 new 0.28) lr 1.00e-05 gnorm 0.112 3.17s mem 81.1GB +[2026-09-12 07:09:35] step 1552/5000 loss 0.3044 (w 0.2438 mse 0.2517 t 826 new 0.13) lr 1.00e-05 gnorm 0.114 3.11s mem 81.1GB +[2026-09-12 07:09:38] step 1553/5000 loss 0.3711 (w 0.3057 mse 0.3099 t 734 new 0.22) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +[2026-09-12 07:09:41] step 1554/5000 loss 0.2234 (w 0.1291 mse 0.1510 t 842 new 0.17) lr 1.00e-05 gnorm 0.135 3.22s mem 81.1GB +[2026-09-12 07:09:44] step 1555/5000 loss 0.3500 (w 0.4408 mse 0.4488 t 955 new 0.20) lr 1.00e-05 gnorm 0.145 3.11s mem 81.1GB +[2026-09-12 07:09:47] step 1556/5000 loss 0.3857 (w 0.1958 mse 0.2194 t 777 new 0.23) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +[2026-09-12 07:09:50] step 1557/5000 loss 0.1761 (w 0.3006 mse 0.3078 t 998 new 0.18) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +[2026-09-12 07:09:53] step 1558/5000 loss 0.2633 (w 0.4870 mse 0.4850 t 994 new 0.23) lr 1.00e-05 gnorm 0.124 3.34s mem 81.1GB +[2026-09-12 07:09:56] step 1559/5000 loss 0.2194 (w 0.3712 mse 0.3730 t 984 new 0.21) lr 1.00e-05 gnorm 0.131 3.01s mem 81.1GB +[2026-09-12 07:10:00] step 1560/5000 loss 0.3385 (w 0.2888 mse 0.2950 t 868 new 0.26) lr 1.00e-05 gnorm 0.184 3.13s mem 81.1GB +[2026-09-12 07:10:03] step 1561/5000 loss 0.2160 (w 0.2138 mse 0.2224 t 866 new 0.19) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +[2026-09-12 07:10:06] step 1562/5000 loss 0.2385 (w 0.2950 mse 0.2992 t 850 new 0.16) lr 1.00e-05 gnorm 0.248 2.83s mem 81.1GB +[2026-09-12 07:10:09] step 1563/5000 loss 0.2813 (w 0.2678 mse 0.2857 t 997 new 0.18) lr 1.00e-05 gnorm 0.121 3.13s mem 81.1GB +[2026-09-12 07:10:12] step 1564/5000 loss 0.1714 (w 0.2907 mse 0.2923 t 808 new 0.23) lr 1.00e-05 gnorm 0.188 3.37s mem 81.1GB +[2026-09-12 07:10:15] step 1565/5000 loss 0.3577 (w 0.5060 mse 0.4930 t 998 new 0.19) lr 1.00e-05 gnorm 0.120 3.06s mem 81.1GB +[2026-09-12 07:10:18] step 1566/5000 loss 0.2583 (w 0.3267 mse 0.3510 t 954 new 0.20) lr 1.00e-05 gnorm 0.167 3.32s mem 81.1GB +[2026-09-12 07:10:22] step 1567/5000 loss 0.1223 (w 0.2632 mse 0.2818 t 981 new 0.24) lr 1.00e-05 gnorm 0.153 3.13s mem 81.1GB +[2026-09-12 07:10:24] step 1568/5000 loss 0.3423 (w 0.3338 mse 0.3324 t 621 new 0.18) lr 1.00e-05 gnorm 0.189 2.82s mem 81.1GB +[2026-09-12 07:10:28] step 1569/5000 loss 0.3443 (w 0.2385 mse 0.2409 t 777 new 0.20) lr 1.00e-05 gnorm 0.162 3.16s mem 81.1GB +[2026-09-12 07:10:31] step 1570/5000 loss 0.3967 (w 0.3373 mse 0.3327 t 969 new 0.12) lr 1.00e-05 gnorm 0.134 3.40s mem 81.1GB +[2026-09-12 07:10:34] step 1571/5000 loss 0.3326 (w 0.2336 mse 0.2489 t 779 new 0.22) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +[2026-09-12 07:10:37] step 1572/5000 loss 0.2768 (w 0.1978 mse 0.2164 t 865 new 0.26) lr 1.00e-05 gnorm 0.112 3.37s mem 81.1GB +[2026-09-12 07:10:40] step 1573/5000 loss 0.3204 (w 0.2663 mse 0.2631 t 851 new 0.21) lr 1.00e-05 gnorm 0.319 3.05s mem 81.1GB +[2026-09-12 07:10:43] step 1574/5000 loss 0.3703 (w 0.2093 mse 0.2209 t 782 new 0.22) lr 1.00e-05 gnorm 0.203 2.83s mem 81.1GB +[2026-09-12 07:10:46] step 1575/5000 loss 0.3246 (w 0.3662 mse 0.3703 t 953 new 0.23) lr 1.00e-05 gnorm 0.131 3.17s mem 81.1GB +[2026-09-12 07:10:50] step 1576/5000 loss 0.2476 (w 0.2353 mse 0.2440 t 883 new 0.22) lr 1.00e-05 gnorm 0.120 3.33s mem 81.1GB +[2026-09-12 07:10:53] step 1577/5000 loss 0.3818 (w 0.2699 mse 0.2772 t 852 new 0.21) lr 1.00e-05 gnorm 0.187 2.82s mem 81.1GB +[2026-09-12 07:10:56] step 1578/5000 loss 0.2972 (w 0.2257 mse 0.2435 t 962 new 0.17) lr 1.00e-05 gnorm 0.107 3.15s mem 81.1GB +[2026-09-12 07:10:59] step 1579/5000 loss 0.2359 (w 0.3935 mse 0.3785 t 959 new 0.24) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +[2026-09-12 07:11:02] step 1580/5000 loss 0.2027 (w 0.1618 mse 0.1728 t 795 new 0.08) lr 1.00e-05 gnorm 0.155 2.82s mem 81.1GB +[2026-09-12 07:11:05] step 1581/5000 loss 0.3498 (w 0.3575 mse 0.3643 t 977 new 0.30) lr 1.00e-05 gnorm 0.129 3.09s mem 81.1GB +[2026-09-12 07:11:09] step 1582/5000 loss 0.2138 (w 0.3379 mse 0.3417 t 964 new 0.20) lr 1.00e-05 gnorm 0.119 4.07s mem 81.1GB +[2026-09-12 07:11:12] step 1583/5000 loss 0.3946 (w 0.1503 mse 0.1635 t 776 new 0.17) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +[2026-09-12 07:11:15] step 1584/5000 loss 0.2325 (w 0.2723 mse 0.2723 t 888 new 0.18) lr 1.00e-05 gnorm 0.194 3.08s mem 81.1GB +[2026-09-12 07:11:18] step 1585/5000 loss 0.3504 (w 0.7169 mse 0.7173 t 127 new 0.07) lr 1.00e-05 gnorm 0.179 3.10s mem 81.1GB +[2026-09-12 07:11:21] step 1586/5000 loss 0.4483 (w 0.3140 mse 0.3112 t 951 new 0.25) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +[2026-09-12 07:11:24] step 1587/5000 loss 0.4090 (w 0.3161 mse 0.3265 t 533 new 0.19) lr 1.00e-05 gnorm 0.229 3.12s mem 81.1GB +[2026-09-12 07:11:27] step 1588/5000 loss 0.2261 (w 0.1840 mse 0.1975 t 695 new 0.12) lr 1.00e-05 gnorm 0.121 3.11s mem 81.1GB +[2026-09-12 07:11:31] step 1589/5000 loss 0.2262 (w 0.3830 mse 0.3830 t 961 new 0.28) lr 1.00e-05 gnorm 0.128 3.39s mem 81.1GB +[2026-09-12 07:11:34] step 1590/5000 loss 0.2706 (w 0.2183 mse 0.2415 t 920 new 0.22) lr 1.00e-05 gnorm 0.150 3.02s mem 81.1GB +[2026-09-12 07:11:37] step 1591/5000 loss 0.3568 (w 0.2366 mse 0.2482 t 849 new 0.21) lr 1.00e-05 gnorm 0.135 3.03s mem 81.1GB +[2026-09-12 07:11:40] step 1592/5000 loss 0.2192 (w 0.4525 mse 0.4475 t 979 new 0.15) lr 1.00e-05 gnorm 0.108 3.14s mem 81.1GB +[2026-09-12 07:11:43] step 1593/5000 loss 0.3674 (w 0.3145 mse 0.3162 t 570 new 0.15) lr 1.00e-05 gnorm 0.115 3.05s mem 81.1GB +[2026-09-12 07:11:46] step 1594/5000 loss 0.1327 (w 0.3500 mse 0.3582 t 990 new 0.11) lr 1.00e-05 gnorm 0.192 3.11s mem 81.1GB +[2026-09-12 07:11:49] step 1595/5000 loss 0.3393 (w 0.1688 mse 0.1791 t 875 new 0.08) lr 1.00e-05 gnorm 0.174 3.29s mem 81.1GB +[2026-09-12 07:11:52] step 1596/5000 loss 0.2604 (w 0.2653 mse 0.2756 t 978 new 0.18) lr 1.00e-05 gnorm 0.282 3.02s mem 81.1GB +[2026-09-12 07:11:55] step 1597/5000 loss 0.2558 (w 0.3906 mse 0.4029 t 984 new 0.21) lr 1.00e-05 gnorm 0.153 3.07s mem 81.1GB +[2026-09-12 07:11:58] step 1598/5000 loss 0.3976 (w 0.2686 mse 0.2778 t 809 new 0.22) lr 1.00e-05 gnorm 0.143 3.12s mem 81.1GB +[2026-09-12 07:12:02] step 1599/5000 loss 0.2127 (w 0.1871 mse 0.2111 t 802 new 0.20) lr 1.00e-05 gnorm 0.110 3.11s mem 81.1GB +[2026-09-12 07:12:04] step 1600/5000 loss 0.2752 (w 0.3391 mse 0.3436 t 916 new 0.17) lr 1.00e-05 gnorm 0.137 2.82s mem 81.1GB +[2026-09-12 07:12:08] step 1601/5000 loss 0.2599 (w 0.2331 mse 0.2369 t 917 new 0.15) lr 1.00e-05 gnorm 0.139 3.37s mem 81.1GB +[2026-09-12 07:12:11] step 1602/5000 loss 0.3692 (w 0.5276 mse 0.5307 t 244 new 0.21) lr 1.00e-05 gnorm 0.282 3.06s mem 81.1GB +[2026-09-12 07:12:14] step 1603/5000 loss 0.3063 (w 0.2736 mse 0.2738 t 824 new 0.19) lr 1.00e-05 gnorm 0.140 3.07s mem 81.1GB +[2026-09-12 07:12:17] step 1604/5000 loss 0.2065 (w 0.4770 mse 0.4749 t 988 new 0.22) lr 1.00e-05 gnorm 0.172 3.04s mem 81.1GB +[2026-09-12 07:12:20] step 1605/5000 loss 0.1192 (w 0.3402 mse 0.3419 t 959 new 0.23) lr 1.00e-05 gnorm 0.130 3.25s mem 81.1GB +[2026-09-12 07:12:23] step 1606/5000 loss 0.1219 (w 0.2150 mse 0.2265 t 808 new 0.27) lr 1.00e-05 gnorm 0.118 2.82s mem 81.1GB +[2026-09-12 07:12:26] step 1607/5000 loss 0.4483 (w 0.2957 mse 0.3026 t 657 new 0.19) lr 1.00e-05 gnorm 0.151 3.38s mem 81.1GB +[2026-09-12 07:12:29] step 1608/5000 loss 0.2755 (w 0.3172 mse 0.3229 t 973 new 0.08) lr 1.00e-05 gnorm 0.132 3.01s mem 81.1GB +[2026-09-12 07:12:32] step 1609/5000 loss 0.3620 (w 0.1752 mse 0.1970 t 788 new 0.27) lr 1.00e-05 gnorm 1.426 2.82s mem 81.1GB +[2026-09-12 07:12:35] step 1610/5000 loss 0.2595 (w 0.2520 mse 0.2751 t 998 new 0.17) lr 1.00e-05 gnorm 0.168 3.10s mem 81.1GB +[2026-09-12 07:12:39] step 1611/5000 loss 0.1766 (w 0.2690 mse 0.2693 t 838 new 0.18) lr 1.00e-05 gnorm 0.112 3.27s mem 81.1GB +[2026-09-12 07:12:41] step 1612/5000 loss 0.1903 (w 0.2483 mse 0.2577 t 785 new 0.21) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +[2026-09-12 07:12:45] step 1613/5000 loss 0.3604 (w 0.2398 mse 0.2561 t 777 new 0.19) lr 1.00e-05 gnorm 0.282 3.27s mem 81.1GB +[2026-09-12 07:12:48] step 1614/5000 loss 0.2905 (w 0.2336 mse 0.2478 t 774 new 0.22) lr 1.00e-05 gnorm 0.222 3.05s mem 81.1GB +[2026-09-12 07:12:51] step 1615/5000 loss 0.2226 (w 0.3370 mse 0.3410 t 975 new 0.25) lr 1.00e-05 gnorm 0.197 2.83s mem 81.1GB +[2026-09-12 07:12:54] step 1616/5000 loss 0.1658 (w 0.2890 mse 0.2995 t 977 new 0.20) lr 1.00e-05 gnorm 0.276 3.13s mem 81.1GB +[2026-09-12 07:12:57] step 1617/5000 loss 0.2753 (w 0.3197 mse 0.3298 t 503 new 0.26) lr 1.00e-05 gnorm 0.129 3.35s mem 81.1GB +[2026-09-12 07:13:00] step 1618/5000 loss 0.3017 (w 0.3109 mse 0.3076 t 918 new 0.18) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +[2026-09-12 07:13:03] step 1619/5000 loss 0.2025 (w 0.3442 mse 0.3437 t 989 new 0.27) lr 1.00e-05 gnorm 0.118 3.31s mem 81.1GB +[2026-09-12 07:13:06] step 1620/5000 loss 0.3830 (w 0.3211 mse 0.3407 t 846 new 0.21) lr 1.00e-05 gnorm 0.152 3.09s mem 81.1GB +[2026-09-12 07:13:09] step 1621/5000 loss 0.3092 (w 0.1807 mse 0.1906 t 943 new 0.13) lr 1.00e-05 gnorm 0.145 2.83s mem 81.1GB +[2026-09-12 07:13:13] step 1622/5000 loss 0.3316 (w 0.3620 mse 0.3512 t 688 new 0.20) lr 1.00e-05 gnorm 0.122 3.32s mem 81.1GB +[2026-09-12 07:13:16] step 1623/5000 loss 0.1626 (w 0.3065 mse 0.3116 t 884 new 0.20) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +[2026-09-12 07:13:19] step 1624/5000 loss 0.4729 (w 0.2146 mse 0.2260 t 553 new 0.17) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +[2026-09-12 07:13:22] step 1625/5000 loss 0.2508 (w 0.2026 mse 0.2025 t 850 new 0.13) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +[2026-09-12 07:13:25] step 1626/5000 loss 0.1834 (w 0.2833 mse 0.2868 t 659 new 0.19) lr 1.00e-05 gnorm 0.276 3.07s mem 81.1GB +[2026-09-12 07:13:28] step 1627/5000 loss 0.3413 (w 0.2636 mse 0.2852 t 557 new 0.19) lr 1.00e-05 gnorm 0.250 2.82s mem 81.1GB +[2026-09-12 07:13:31] step 1628/5000 loss 0.3140 (w 0.2560 mse 0.2671 t 692 new 0.13) lr 1.00e-05 gnorm 0.156 3.27s mem 81.1GB +[2026-09-12 07:13:34] step 1629/5000 loss 0.1791 (w 0.3990 mse 0.4013 t 963 new 0.18) lr 1.00e-05 gnorm 0.130 2.82s mem 81.1GB +[2026-09-12 07:13:37] step 1630/5000 loss 0.3239 (w 0.2688 mse 0.2767 t 728 new 0.13) lr 1.00e-05 gnorm 0.319 3.03s mem 81.1GB +[2026-09-12 07:13:40] step 1631/5000 loss 0.2112 (w 0.2475 mse 0.2596 t 942 new 0.22) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +[2026-09-12 07:13:43] step 1632/5000 loss 0.3592 (w 0.2488 mse 0.2551 t 894 new 0.25) lr 1.00e-05 gnorm 0.163 3.01s mem 81.1GB +[2026-09-12 07:13:46] step 1633/5000 loss 0.3093 (w 0.3275 mse 0.3554 t 973 new 0.22) lr 1.00e-05 gnorm 0.150 2.82s mem 81.1GB +[2026-09-12 07:13:49] step 1634/5000 loss 0.2228 (w 0.3219 mse 0.3328 t 926 new 0.18) lr 1.00e-05 gnorm 0.142 3.29s mem 81.1GB +[2026-09-12 07:13:52] step 1635/5000 loss 0.0952 (w 0.3028 mse 0.3065 t 984 new 0.22) lr 1.00e-05 gnorm 0.099 2.83s mem 81.1GB +[2026-09-12 07:13:55] step 1636/5000 loss 0.3490 (w 0.3375 mse 0.3557 t 998 new 0.24) lr 1.00e-05 gnorm 0.163 3.08s mem 81.1GB +[2026-09-12 07:13:58] step 1637/5000 loss 0.2009 (w 0.3356 mse 0.3506 t 976 new 0.22) lr 1.00e-05 gnorm 0.140 3.11s mem 81.1GB +[2026-09-12 07:14:01] step 1638/5000 loss 0.3640 (w 0.2640 mse 0.2719 t 586 new 0.11) lr 1.00e-05 gnorm 0.143 3.04s mem 81.1GB +[2026-09-12 07:14:05] step 1639/5000 loss 0.4364 (w 0.3291 mse 0.3400 t 592 new 0.22) lr 1.00e-05 gnorm 0.205 3.07s mem 81.1GB +[2026-09-12 07:14:08] step 1640/5000 loss 0.1582 (w 0.3574 mse 0.3744 t 989 new 0.14) lr 1.00e-05 gnorm 0.129 3.06s mem 81.1GB +[2026-09-12 07:14:10] step 1641/5000 loss 0.2862 (w 0.4512 mse 0.4384 t 994 new 0.20) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-12 07:14:14] step 1642/5000 loss 0.2973 (w 0.2093 mse 0.2218 t 863 new 0.11) lr 1.00e-05 gnorm 0.094 3.34s mem 81.1GB +[2026-09-12 07:14:17] step 1643/5000 loss 0.4349 (w 0.5171 mse 0.5177 t 259 new 0.16) lr 1.00e-05 gnorm 0.151 3.09s mem 81.1GB +[2026-09-12 07:14:20] step 1644/5000 loss 0.3208 (w 0.4327 mse 0.4364 t 283 new 0.25) lr 1.00e-05 gnorm 0.147 2.82s mem 81.1GB +[2026-09-12 07:14:23] step 1645/5000 loss 0.2694 (w 0.2845 mse 0.2901 t 804 new 0.27) lr 1.00e-05 gnorm 0.180 3.06s mem 81.1GB +[2026-09-12 07:14:26] step 1646/5000 loss 0.2927 (w 0.3227 mse 0.3141 t 862 new 0.24) lr 1.00e-05 gnorm 0.158 3.08s mem 81.1GB +[2026-09-12 07:14:29] step 1647/5000 loss 0.2801 (w 0.3051 mse 0.3115 t 961 new 0.12) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +[2026-09-12 07:14:32] step 1648/5000 loss 0.3021 (w 0.2665 mse 0.2760 t 917 new 0.27) lr 1.00e-05 gnorm 0.150 3.31s mem 81.1GB +[2026-09-12 07:14:35] step 1649/5000 loss 0.2516 (w 0.2158 mse 0.2280 t 816 new 0.18) lr 1.00e-05 gnorm 0.132 3.10s mem 81.1GB +[2026-09-12 07:14:38] step 1650/5000 loss 0.3201 (w 0.3278 mse 0.3260 t 689 new 0.24) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +[2026-09-12 07:14:41] step 1651/5000 loss 0.1747 (w 0.2079 mse 0.2051 t 941 new 0.17) lr 1.00e-05 gnorm 0.136 3.09s mem 81.1GB +[2026-09-12 07:14:44] step 1652/5000 loss 0.2812 (w 0.2991 mse 0.3059 t 875 new 0.15) lr 1.00e-05 gnorm 0.155 3.27s mem 81.1GB +[2026-09-12 07:14:47] step 1653/5000 loss 0.3989 (w 0.3537 mse 0.3570 t 898 new 0.22) lr 1.00e-05 gnorm 0.136 2.82s mem 81.1GB +[2026-09-12 07:14:51] step 1654/5000 loss 0.3895 (w 0.2282 mse 0.2528 t 939 new 0.16) lr 1.00e-05 gnorm 0.210 3.29s mem 81.1GB +[2026-09-12 07:14:54] step 1655/5000 loss 0.3445 (w 0.5061 mse 0.4866 t 991 new 0.25) lr 1.00e-05 gnorm 0.150 3.11s mem 81.1GB +[2026-09-12 07:14:57] step 1656/5000 loss 0.2246 (w 0.4177 mse 0.4350 t 200 new 0.21) lr 1.00e-05 gnorm 0.119 2.82s mem 81.1GB +[2026-09-12 07:15:00] step 1657/5000 loss 0.2341 (w 0.2090 mse 0.2204 t 669 new 0.17) lr 1.00e-05 gnorm 0.190 3.27s mem 81.1GB +[2026-09-12 07:15:03] step 1658/5000 loss 0.4736 (w 0.3634 mse 0.3593 t 983 new 0.22) lr 1.00e-05 gnorm 0.147 3.06s mem 81.1GB +[2026-09-12 07:15:06] step 1659/5000 loss 0.3660 (w 0.2513 mse 0.2595 t 904 new 0.24) lr 1.00e-05 gnorm 0.126 3.09s mem 81.1GB +[2026-09-12 07:15:09] step 1660/5000 loss 0.2400 (w 0.6152 mse 0.6188 t 990 new 0.27) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +[2026-09-12 07:15:12] step 1661/5000 loss 0.4417 (w 0.3989 mse 0.4039 t 484 new 0.30) lr 1.00e-05 gnorm 0.182 3.02s mem 81.1GB +[2026-09-12 07:15:15] step 1662/5000 loss 0.1374 (w 0.2476 mse 0.2470 t 891 new 0.13) lr 1.00e-05 gnorm 0.138 2.82s mem 81.1GB +[2026-09-12 07:15:18] step 1663/5000 loss 0.2659 (w 0.4292 mse 0.4459 t 319 new 0.26) lr 1.00e-05 gnorm 0.179 3.23s mem 81.1GB +[2026-09-12 07:15:21] step 1664/5000 loss 0.2760 (w 0.4344 mse 0.4251 t 996 new 0.23) lr 1.00e-05 gnorm 0.126 3.08s mem 81.1GB +[2026-09-12 07:15:24] step 1665/5000 loss 0.3465 (w 0.3962 mse 0.4054 t 987 new 0.21) lr 1.00e-05 gnorm 0.132 3.27s mem 81.1GB +[2026-09-12 07:15:28] step 1666/5000 loss 0.3356 (w 0.3979 mse 0.3906 t 976 new 0.24) lr 1.00e-05 gnorm 0.226 3.05s mem 81.1GB +[2026-09-12 07:15:31] step 1667/5000 loss 0.5303 (w 0.3935 mse 0.4068 t 340 new 0.19) lr 1.00e-05 gnorm 0.116 3.01s mem 81.1GB +[2026-09-12 07:15:33] step 1668/5000 loss 0.2532 (w 0.3839 mse 0.3673 t 950 new 0.27) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +[2026-09-12 07:15:37] step 1669/5000 loss 0.2938 (w 0.3462 mse 0.3505 t 1000 new 0.25) lr 1.00e-05 gnorm 0.236 3.32s mem 81.1GB +[2026-09-12 07:15:40] step 1670/5000 loss 0.3831 (w 0.3686 mse 0.3695 t 722 new 0.22) lr 1.00e-05 gnorm 0.165 2.83s mem 81.1GB +[2026-09-12 07:15:43] step 1671/5000 loss 0.4406 (w 0.2710 mse 0.3027 t 998 new 0.22) lr 1.00e-05 gnorm 0.130 3.12s mem 81.1GB +[2026-09-12 07:15:45] step 1672/5000 loss 0.1009 (w 0.3624 mse 0.3643 t 932 new 0.14) lr 1.00e-05 gnorm 0.097 2.82s mem 81.1GB +[2026-09-12 07:15:49] step 1673/5000 loss 0.3545 (w 0.2486 mse 0.2535 t 904 new 0.13) lr 1.00e-05 gnorm 0.122 3.04s mem 81.1GB +[2026-09-12 07:15:52] step 1674/5000 loss 0.3635 (w 0.3900 mse 0.4015 t 983 new 0.18) lr 1.00e-05 gnorm 0.187 3.07s mem 81.1GB +[2026-09-12 07:15:55] step 1675/5000 loss 0.3660 (w 0.3068 mse 0.3096 t 557 new 0.09) lr 1.00e-05 gnorm 0.211 3.33s mem 81.1GB +[2026-09-12 07:15:58] step 1676/5000 loss 0.2653 (w 0.3948 mse 0.3934 t 946 new 0.16) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-12 07:16:01] step 1677/5000 loss 0.1975 (w 0.3336 mse 0.3286 t 972 new 0.28) lr 1.00e-05 gnorm 0.137 3.13s mem 81.1GB +[2026-09-12 07:16:04] step 1678/5000 loss 0.3189 (w 0.2761 mse 0.2717 t 993 new 0.17) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +[2026-09-12 07:16:08] step 1679/5000 loss 0.1791 (w 0.3025 mse 0.3220 t 752 new 0.20) lr 1.00e-05 gnorm 0.175 3.85s mem 81.1GB +[2026-09-12 07:16:11] step 1680/5000 loss 0.3895 (w 0.2544 mse 0.2651 t 822 new 0.27) lr 1.00e-05 gnorm 0.111 3.07s mem 81.1GB +[2026-09-12 07:16:14] step 1681/5000 loss 0.4259 (w 0.2934 mse 0.2991 t 959 new 0.19) lr 1.00e-05 gnorm 0.174 3.46s mem 81.1GB +[2026-09-12 07:16:17] step 1682/5000 loss 0.1639 (w 0.2378 mse 0.2451 t 920 new 0.24) lr 1.00e-05 gnorm 0.121 2.84s mem 81.1GB +[2026-09-12 07:16:20] step 1683/5000 loss 0.3310 (w 0.2490 mse 0.2700 t 920 new 0.21) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +[2026-09-12 07:16:23] step 1684/5000 loss 0.3020 (w 0.2107 mse 0.2239 t 930 new 0.25) lr 1.00e-05 gnorm 0.507 2.84s mem 81.1GB +[2026-09-12 07:16:26] step 1685/5000 loss 0.2377 (w 0.2925 mse 0.3019 t 977 new 0.23) lr 1.00e-05 gnorm 0.134 3.10s mem 81.1GB +[2026-09-12 07:16:29] step 1686/5000 loss 0.2256 (w 0.2500 mse 0.2668 t 988 new 0.12) lr 1.00e-05 gnorm 0.136 3.11s mem 81.1GB +[2026-09-12 07:16:32] step 1687/5000 loss 0.3409 (w 0.3366 mse 0.3339 t 902 new 0.18) lr 1.00e-05 gnorm 0.247 3.08s mem 81.1GB +[2026-09-12 07:16:35] step 1688/5000 loss 0.2601 (w 0.3026 mse 0.2914 t 966 new 0.10) lr 1.00e-05 gnorm 0.106 2.82s mem 81.1GB +[2026-09-12 07:16:38] step 1689/5000 loss 0.4980 (w 0.2319 mse 0.2422 t 793 new 0.19) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +[2026-09-12 07:16:41] step 1690/5000 loss 0.3671 (w 0.3059 mse 0.3149 t 523 new 0.19) lr 1.00e-05 gnorm 0.098 2.82s mem 81.1GB +[2026-09-12 07:16:44] step 1691/5000 loss 0.4302 (w 0.3276 mse 0.3291 t 872 new 0.19) lr 1.00e-05 gnorm 0.250 3.03s mem 81.1GB +[2026-09-12 07:16:47] step 1692/5000 loss 0.3414 (w 0.2964 mse 0.2894 t 915 new 0.28) lr 1.00e-05 gnorm 0.149 3.09s mem 81.1GB +[2026-09-12 07:16:50] step 1693/5000 loss 0.2934 (w 0.2650 mse 0.2780 t 985 new 0.16) lr 1.00e-05 gnorm 0.110 3.04s mem 81.1GB +[2026-09-12 07:16:53] step 1694/5000 loss 0.3646 (w 0.3221 mse 0.3216 t 542 new 0.26) lr 1.00e-05 gnorm 2.241 2.82s mem 81.1GB +[2026-09-12 07:16:56] step 1695/5000 loss 0.3504 (w 0.3249 mse 0.3151 t 981 new 0.16) lr 1.00e-05 gnorm 0.127 3.11s mem 81.1GB +[2026-09-12 07:16:59] step 1696/5000 loss 0.2348 (w 0.2267 mse 0.2479 t 795 new 0.22) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +[2026-09-12 07:17:02] step 1697/5000 loss 0.4559 (w 0.2184 mse 0.2383 t 404 new 0.21) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +[2026-09-12 07:17:06] step 1698/5000 loss 0.4393 (w 0.2778 mse 0.2833 t 915 new 0.16) lr 1.00e-05 gnorm 0.157 3.40s mem 81.1GB +[2026-09-12 07:17:09] step 1699/5000 loss 0.2874 (w 0.2266 mse 0.2426 t 959 new 0.27) lr 1.00e-05 gnorm 0.105 3.05s mem 81.1GB +[2026-09-12 07:17:11] step 1700/5000 loss 0.3210 (w 0.3284 mse 0.3396 t 981 new 0.21) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +[2026-09-12 07:17:15] step 1701/5000 loss 0.3176 (w 0.3348 mse 0.3312 t 979 new 0.23) lr 1.00e-05 gnorm 0.411 3.10s mem 81.1GB +[2026-09-12 07:17:17] step 1702/5000 loss 0.3223 (w 0.3354 mse 0.3403 t 453 new 0.17) lr 1.00e-05 gnorm 0.313 2.84s mem 81.1GB +[2026-09-12 07:17:20] step 1703/5000 loss 0.3529 (w 0.2827 mse 0.2928 t 749 new 0.24) lr 1.00e-05 gnorm 0.123 3.04s mem 81.1GB +[2026-09-12 07:17:24] step 1704/5000 loss 0.2557 (w 0.2355 mse 0.2366 t 888 new 0.10) lr 1.00e-05 gnorm 0.114 3.34s mem 81.1GB +[2026-09-12 07:17:27] step 1705/5000 loss 0.1404 (w 0.4201 mse 0.4323 t 988 new 0.18) lr 1.00e-05 gnorm 0.116 3.03s mem 81.1GB +[2026-09-12 07:17:30] step 1706/5000 loss 0.2758 (w 0.2030 mse 0.1983 t 684 new 0.13) lr 1.00e-05 gnorm 0.120 2.82s mem 81.1GB +[2026-09-12 07:17:33] step 1707/5000 loss 0.3336 (w 0.2579 mse 0.2572 t 980 new 0.21) lr 1.00e-05 gnorm 0.298 3.13s mem 81.1GB +[2026-09-12 07:17:36] step 1708/5000 loss 0.4617 (w 0.3159 mse 0.3164 t 523 new 0.18) lr 1.00e-05 gnorm 0.113 2.82s mem 81.1GB +[2026-09-12 07:17:39] step 1709/5000 loss 0.3256 (w 0.2888 mse 0.2935 t 954 new 0.25) lr 1.00e-05 gnorm 0.125 3.02s mem 81.1GB +[2026-09-12 07:17:42] step 1710/5000 loss 0.2931 (w 0.3137 mse 0.3124 t 933 new 0.21) lr 1.00e-05 gnorm 0.335 3.11s mem 81.1GB +[2026-09-12 07:17:45] step 1711/5000 loss 0.2488 (w 0.3403 mse 0.3380 t 594 new 0.22) lr 1.00e-05 gnorm 0.123 3.03s mem 81.1GB +[2026-09-12 07:17:48] step 1712/5000 loss 0.1977 (w 0.3399 mse 0.3406 t 948 new 0.28) lr 1.00e-05 gnorm 0.155 3.09s mem 81.1GB +[2026-09-12 07:17:51] step 1713/5000 loss 0.3423 (w 0.2753 mse 0.2817 t 626 new 0.17) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +[2026-09-12 07:17:54] step 1714/5000 loss 0.1879 (w 0.1735 mse 0.1838 t 858 new 0.09) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +[2026-09-12 07:17:57] step 1715/5000 loss 0.2674 (w 0.3220 mse 0.3369 t 895 new 0.21) lr 1.00e-05 gnorm 0.134 3.28s mem 81.1GB +[2026-09-12 07:18:00] step 1716/5000 loss 0.2127 (w 0.5330 mse 0.5431 t 998 new 0.19) lr 1.00e-05 gnorm 0.107 2.83s mem 81.1GB +[2026-09-12 07:18:03] step 1717/5000 loss 0.3860 (w 0.2983 mse 0.3082 t 930 new 0.22) lr 1.00e-05 gnorm 0.206 3.10s mem 81.1GB +[2026-09-12 07:18:06] step 1718/5000 loss 0.2854 (w 0.3799 mse 0.3735 t 983 new 0.13) lr 1.00e-05 gnorm 0.189 3.31s mem 81.1GB +[2026-09-12 07:18:09] step 1719/5000 loss 0.2658 (w 0.3026 mse 0.3126 t 981 new 0.08) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +[2026-09-12 07:18:12] step 1720/5000 loss 0.3959 (w 0.3275 mse 0.3392 t 969 new 0.23) lr 1.00e-05 gnorm 1.195 2.83s mem 81.1GB +[2026-09-12 07:18:15] step 1721/5000 loss 0.2556 (w 0.3345 mse 0.3410 t 999 new 0.19) lr 1.00e-05 gnorm 0.118 3.31s mem 81.1GB +[2026-09-12 07:18:19] step 1722/5000 loss 0.3504 (w 0.2570 mse 0.2671 t 897 new 0.20) lr 1.00e-05 gnorm 0.184 3.10s mem 81.1GB +[2026-09-12 07:18:21] step 1723/5000 loss 0.2179 (w 0.1967 mse 0.2093 t 870 new 0.24) lr 1.00e-05 gnorm 0.104 2.83s mem 81.1GB +[2026-09-12 07:18:25] step 1724/5000 loss 0.2950 (w 0.3251 mse 0.3208 t 726 new 0.24) lr 1.00e-05 gnorm 0.151 3.33s mem 81.1GB +[2026-09-12 07:18:28] step 1725/5000 loss 0.2887 (w 0.3260 mse 0.3203 t 864 new 0.23) lr 1.00e-05 gnorm 0.154 3.06s mem 81.1GB +[2026-09-12 07:18:31] step 1726/5000 loss 0.5207 (w 0.3595 mse 0.3634 t 523 new 0.21) lr 1.00e-05 gnorm 0.153 3.00s mem 81.1GB +[2026-09-12 07:18:34] step 1727/5000 loss 0.3076 (w 0.2579 mse 0.2807 t 881 new 0.28) lr 1.00e-05 gnorm 0.205 3.08s mem 81.1GB +[2026-09-12 07:18:37] step 1728/5000 loss 0.2512 (w 0.2765 mse 0.2834 t 861 new 0.25) lr 1.00e-05 gnorm 0.186 3.10s mem 81.1GB +[2026-09-12 07:18:40] step 1729/5000 loss 0.3650 (w 0.3619 mse 0.3782 t 998 new 0.25) lr 1.00e-05 gnorm 0.154 2.84s mem 81.1GB +[2026-09-12 07:18:43] step 1730/5000 loss 0.2105 (w 0.2517 mse 0.2499 t 835 new 0.10) lr 1.00e-05 gnorm 0.134 3.29s mem 81.1GB +[2026-09-12 07:18:46] step 1731/5000 loss 0.2232 (w 0.4098 mse 0.4004 t 868 new 0.25) lr 1.00e-05 gnorm 0.276 3.06s mem 81.1GB +[2026-09-12 07:18:49] step 1732/5000 loss 0.2219 (w 0.2065 mse 0.2236 t 864 new 0.22) lr 1.00e-05 gnorm 0.095 3.01s mem 81.1GB +[2026-09-12 07:18:52] step 1733/5000 loss 0.2816 (w 0.2118 mse 0.2263 t 703 new 0.25) lr 1.00e-05 gnorm 0.115 3.12s mem 81.1GB +[2026-09-12 07:18:56] step 1734/5000 loss 0.5024 (w 0.1729 mse 0.1948 t 697 new 0.24) lr 1.00e-05 gnorm 0.142 3.30s mem 81.1GB +[2026-09-12 07:18:58] step 1735/5000 loss 0.2905 (w 0.2963 mse 0.3018 t 639 new 0.21) lr 1.00e-05 gnorm 0.244 2.83s mem 81.1GB +[2026-09-12 07:19:02] step 1736/5000 loss 0.5410 (w 0.3453 mse 0.3533 t 375 new 0.23) lr 1.00e-05 gnorm 0.412 3.16s mem 81.1GB +[2026-09-12 07:19:05] step 1737/5000 loss 0.2811 (w 0.4082 mse 0.4198 t 997 new 0.22) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +[2026-09-12 07:19:08] step 1738/5000 loss 0.4675 (w 0.2974 mse 0.3042 t 580 new 0.21) lr 1.00e-05 gnorm 0.199 3.02s mem 81.1GB +[2026-09-12 07:19:11] step 1739/5000 loss 0.5542 (w 0.2891 mse 0.2965 t 779 new 0.23) lr 1.00e-05 gnorm 0.212 3.37s mem 81.1GB +[2026-09-12 07:19:14] step 1740/5000 loss 0.2344 (w 0.3405 mse 0.3543 t 964 new 0.24) lr 1.00e-05 gnorm 0.123 3.36s mem 81.1GB +[2026-09-12 07:19:17] step 1741/5000 loss 0.4154 (w 0.3246 mse 0.3407 t 982 new 0.22) lr 1.00e-05 gnorm 0.140 2.82s mem 81.1GB +[2026-09-12 07:19:20] step 1742/5000 loss 0.2045 (w 0.3661 mse 0.3686 t 988 new 0.14) lr 1.00e-05 gnorm 0.094 3.07s mem 81.1GB +[2026-09-12 07:19:24] step 1743/5000 loss 0.5827 (w 0.3850 mse 0.4280 t 233 new 0.23) lr 1.00e-05 gnorm 0.152 3.10s mem 81.1GB +[2026-09-12 07:19:27] step 1744/5000 loss 0.3141 (w 0.3259 mse 0.3233 t 823 new 0.24) lr 1.00e-05 gnorm 0.141 3.07s mem 81.1GB +[2026-09-12 07:19:30] step 1745/5000 loss 0.1594 (w 0.2395 mse 0.2541 t 697 new 0.15) lr 1.00e-05 gnorm 0.154 3.08s mem 81.1GB +[2026-09-12 07:19:33] step 1746/5000 loss 0.2294 (w 0.2202 mse 0.2287 t 937 new 0.16) lr 1.00e-05 gnorm 0.130 3.11s mem 81.1GB +[2026-09-12 07:19:36] step 1747/5000 loss 0.5173 (w 0.3512 mse 0.3581 t 473 new 0.21) lr 1.00e-05 gnorm 0.227 3.01s mem 81.1GB +[2026-09-12 07:19:39] step 1748/5000 loss 0.2787 (w 0.2973 mse 0.3087 t 980 new 0.22) lr 1.00e-05 gnorm 0.154 3.14s mem 81.1GB +[2026-09-12 07:19:42] step 1749/5000 loss 0.3743 (w 0.3137 mse 0.3121 t 944 new 0.23) lr 1.00e-05 gnorm 0.159 3.10s mem 81.1GB +[2026-09-12 07:19:45] step 1750/5000 loss 0.3278 (w 0.3842 mse 0.3823 t 960 new 0.22) lr 1.00e-05 gnorm 0.168 3.07s mem 81.1GB +[2026-09-12 07:19:48] step 1751/5000 loss 0.3149 (w 0.3295 mse 0.3275 t 694 new 0.23) lr 1.00e-05 gnorm 0.232 3.11s mem 81.1GB +[2026-09-12 07:19:51] step 1752/5000 loss 0.1838 (w 0.2023 mse 0.2113 t 808 new 0.20) lr 1.00e-05 gnorm 0.146 3.15s mem 81.1GB +[2026-09-12 07:19:54] step 1753/5000 loss 0.1162 (w 0.3332 mse 0.3350 t 979 new 0.19) lr 1.00e-05 gnorm 0.187 3.06s mem 81.1GB +[2026-09-12 07:19:57] step 1754/5000 loss 0.0979 (w 0.5060 mse 0.5074 t 993 new 0.27) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +[2026-09-12 07:20:00] step 1755/5000 loss 0.3518 (w 0.2247 mse 0.2396 t 934 new 0.24) lr 1.00e-05 gnorm 0.125 3.08s mem 81.1GB +[2026-09-12 07:20:04] step 1756/5000 loss 0.3970 (w 0.2580 mse 0.2602 t 802 new 0.21) lr 1.00e-05 gnorm 0.182 3.10s mem 81.1GB +[2026-09-12 07:20:07] step 1757/5000 loss 0.1594 (w 0.3699 mse 0.3774 t 942 new 0.25) lr 1.00e-05 gnorm 0.191 3.05s mem 81.1GB +[2026-09-12 07:20:10] step 1758/5000 loss 0.2367 (w 0.3754 mse 0.3763 t 921 new 0.21) lr 1.00e-05 gnorm 0.161 3.08s mem 81.1GB +[2026-09-12 07:20:13] step 1759/5000 loss 0.2135 (w 0.4492 mse 0.4428 t 379 new 0.19) lr 1.00e-05 gnorm 0.195 3.10s mem 81.1GB +[2026-09-12 07:20:16] step 1760/5000 loss 0.2787 (w 0.2619 mse 0.2661 t 844 new 0.24) lr 1.00e-05 gnorm 0.406 2.82s mem 81.1GB +[2026-09-12 07:20:19] step 1761/5000 loss 0.2302 (w 0.2087 mse 0.2274 t 931 new 0.20) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +[2026-09-12 07:20:22] step 1762/5000 loss 0.2222 (w 0.3149 mse 0.3121 t 884 new 0.16) lr 1.00e-05 gnorm 0.139 3.32s mem 81.1GB +[2026-09-12 07:20:25] step 1763/5000 loss 0.2679 (w 0.3347 mse 0.3392 t 893 new 0.18) lr 1.00e-05 gnorm 0.155 3.11s mem 81.1GB +[2026-09-12 07:20:28] step 1764/5000 loss 0.2195 (w 0.2748 mse 0.3026 t 971 new 0.23) lr 1.00e-05 gnorm 0.132 3.05s mem 81.1GB +[2026-09-12 07:20:31] step 1765/5000 loss 0.2521 (w 0.3568 mse 0.3616 t 939 new 0.22) lr 1.00e-05 gnorm 0.136 3.15s mem 81.1GB +[2026-09-12 07:20:34] step 1766/5000 loss 0.2581 (w 0.3021 mse 0.3167 t 584 new 0.20) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +[2026-09-12 07:20:37] step 1767/5000 loss 0.4369 (w 0.3795 mse 0.3914 t 954 new 0.20) lr 1.00e-05 gnorm 0.148 3.09s mem 81.1GB +[2026-09-12 07:20:41] step 1768/5000 loss 0.3378 (w 0.3724 mse 0.3874 t 996 new 0.23) lr 1.00e-05 gnorm 0.399 3.37s mem 81.1GB +[2026-09-12 07:20:44] step 1769/5000 loss 0.3089 (w 0.3726 mse 0.3734 t 500 new 0.22) lr 1.00e-05 gnorm 0.264 3.06s mem 81.1GB +[2026-09-12 07:20:47] step 1770/5000 loss 0.3488 (w 0.2847 mse 0.2908 t 912 new 0.22) lr 1.00e-05 gnorm 0.233 3.05s mem 81.1GB +[2026-09-12 07:20:50] step 1771/5000 loss 0.1689 (w 0.3183 mse 0.3330 t 998 new 0.21) lr 1.00e-05 gnorm 0.117 3.15s mem 81.1GB +[2026-09-12 07:20:53] step 1772/5000 loss 0.2644 (w 1.0017 mse 0.9972 t 999 new 0.23) lr 1.00e-05 gnorm 0.229 2.84s mem 81.1GB +[2026-09-12 07:20:56] step 1773/5000 loss 0.5303 (w 0.2574 mse 0.2651 t 757 new 0.23) lr 1.00e-05 gnorm 0.181 3.33s mem 81.1GB +[2026-09-12 07:21:00] step 1774/5000 loss 0.2666 (w 0.3196 mse 0.3141 t 872 new 0.23) lr 1.00e-05 gnorm 0.154 3.24s mem 81.1GB +[2026-09-12 07:21:03] step 1775/5000 loss 0.3520 (w 0.3046 mse 0.3179 t 642 new 0.21) lr 1.00e-05 gnorm 0.107 3.02s mem 81.1GB +[2026-09-12 07:21:06] step 1776/5000 loss 0.2114 (w 0.4124 mse 0.4181 t 340 new 0.16) lr 1.00e-05 gnorm 0.127 3.03s mem 81.1GB +[2026-09-12 07:21:09] step 1777/5000 loss 0.3096 (w 0.3123 mse 0.3100 t 975 new 0.20) lr 1.00e-05 gnorm 0.159 3.07s mem 81.1GB +[2026-09-12 07:21:12] step 1778/5000 loss 0.2699 (w 0.3677 mse 0.3678 t 942 new 0.24) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +[2026-09-12 07:21:15] step 1779/5000 loss 0.1906 (w 0.3036 mse 0.3016 t 862 new 0.23) lr 1.00e-05 gnorm 0.225 3.44s mem 81.1GB +[2026-09-12 07:21:18] step 1780/5000 loss 0.2526 (w 0.3444 mse 0.3479 t 716 new 0.19) lr 1.00e-05 gnorm 0.112 3.28s mem 81.1GB +[2026-09-12 07:21:21] step 1781/5000 loss 0.2574 (w 0.2991 mse 0.2917 t 878 new 0.19) lr 1.00e-05 gnorm 0.204 3.01s mem 81.1GB +[2026-09-12 07:21:25] step 1782/5000 loss 0.3441 (w 0.2837 mse 0.2768 t 879 new 0.21) lr 1.00e-05 gnorm 0.215 3.35s mem 81.1GB +[2026-09-12 07:21:28] step 1783/5000 loss 0.2292 (w 0.3672 mse 0.3548 t 492 new 0.17) lr 1.00e-05 gnorm 0.164 3.05s mem 81.1GB +[2026-09-12 07:21:31] step 1784/5000 loss 0.2745 (w 0.3510 mse 0.3415 t 867 new 0.20) lr 1.00e-05 gnorm 0.102 2.84s mem 81.1GB +[2026-09-12 07:21:34] step 1785/5000 loss 0.2851 (w 0.2878 mse 0.2934 t 616 new 0.18) lr 1.00e-05 gnorm 0.138 3.15s mem 81.1GB +[2026-09-12 07:21:37] step 1786/5000 loss 0.3883 (w 0.3461 mse 0.3407 t 833 new 0.21) lr 1.00e-05 gnorm 0.169 3.34s mem 81.1GB +[2026-09-12 07:21:40] step 1787/5000 loss 0.3396 (w 0.2343 mse 0.2603 t 965 new 0.23) lr 1.00e-05 gnorm 0.530 3.06s mem 81.1GB +[2026-09-12 07:21:44] step 1788/5000 loss 0.2909 (w 0.3670 mse 0.3577 t 956 new 0.22) lr 1.00e-05 gnorm 0.117 3.41s mem 81.1GB +[2026-09-12 07:21:47] step 1789/5000 loss 0.1689 (w 0.2291 mse 0.2339 t 911 new 0.25) lr 1.00e-05 gnorm 0.185 3.24s mem 81.1GB +[2026-09-12 07:21:50] step 1790/5000 loss 0.2389 (w 0.3196 mse 0.3197 t 911 new 0.27) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +[2026-09-12 07:21:53] step 1791/5000 loss 0.2181 (w 0.2581 mse 0.2520 t 729 new 0.09) lr 1.00e-05 gnorm 0.196 3.29s mem 81.1GB +[2026-09-12 07:21:56] step 1792/5000 loss 0.2949 (w 0.3421 mse 0.3512 t 986 new 0.24) lr 1.00e-05 gnorm 0.191 3.10s mem 81.1GB +[2026-09-12 07:21:59] step 1793/5000 loss 0.2465 (w 0.2254 mse 0.2406 t 759 new 0.22) lr 1.00e-05 gnorm 0.263 3.15s mem 81.1GB +[2026-09-12 07:22:02] step 1794/5000 loss 0.3452 (w 0.2443 mse 0.2490 t 891 new 0.16) lr 1.00e-05 gnorm 0.138 3.29s mem 81.1GB +[2026-09-12 07:22:06] step 1795/5000 loss 0.3136 (w 0.3390 mse 0.3474 t 631 new 0.24) lr 1.00e-05 gnorm 0.144 3.06s mem 81.1GB +[2026-09-12 07:22:08] step 1796/5000 loss 0.4171 (w 0.1900 mse 0.2030 t 818 new 0.23) lr 1.00e-05 gnorm 0.159 2.83s mem 81.1GB +[2026-09-12 07:22:12] step 1797/5000 loss 0.3460 (w 0.1730 mse 0.2010 t 924 new 0.18) lr 1.00e-05 gnorm 0.166 3.32s mem 81.1GB +[2026-09-12 07:22:15] step 1798/5000 loss 0.2768 (w 0.2822 mse 0.2832 t 926 new 0.20) lr 1.00e-05 gnorm 0.170 3.06s mem 81.1GB +[2026-09-12 07:22:18] step 1799/5000 loss 0.2606 (w 0.2813 mse 0.2942 t 970 new 0.18) lr 1.00e-05 gnorm 0.236 3.15s mem 81.1GB +[2026-09-12 07:22:21] step 1800/5000 loss 0.3107 (w 0.3532 mse 0.3482 t 908 new 0.21) lr 1.00e-05 gnorm 0.124 3.27s mem 81.1GB +[2026-09-12 07:22:24] step 1801/5000 loss 0.2509 (w 0.2569 mse 0.2629 t 883 new 0.19) lr 1.00e-05 gnorm 0.136 3.05s mem 81.1GB +[2026-09-12 07:22:27] step 1802/5000 loss 0.1999 (w 0.2404 mse 0.2641 t 949 new 0.14) lr 1.00e-05 gnorm 0.126 3.13s mem 81.1GB +[2026-09-12 07:22:31] step 1803/5000 loss 0.3614 (w 0.2053 mse 0.2141 t 839 new 0.24) lr 1.00e-05 gnorm 0.136 3.27s mem 81.1GB +[2026-09-12 07:22:34] step 1804/5000 loss 0.3842 (w 0.2364 mse 0.2461 t 680 new 0.24) lr 1.00e-05 gnorm 0.153 3.13s mem 81.1GB +[2026-09-12 07:22:37] step 1805/5000 loss 0.4615 (w 0.3148 mse 0.3176 t 639 new 0.19) lr 1.00e-05 gnorm 0.415 3.21s mem 81.1GB +[2026-09-12 07:22:40] step 1806/5000 loss 0.2827 (w 0.1826 mse 0.1938 t 680 new 0.15) lr 1.00e-05 gnorm 0.167 3.33s mem 81.1GB +[2026-09-12 07:22:44] step 1807/5000 loss 0.2877 (w 0.2230 mse 0.2255 t 953 new 0.15) lr 1.00e-05 gnorm 0.105 3.35s mem 81.1GB +[2026-09-12 07:22:47] step 1808/5000 loss 0.2091 (w 0.3083 mse 0.3005 t 918 new 0.19) lr 1.00e-05 gnorm 0.287 3.04s mem 81.1GB +[2026-09-12 07:22:50] step 1809/5000 loss 0.1595 (w 0.2247 mse 0.2336 t 946 new 0.21) lr 1.00e-05 gnorm 0.123 3.40s mem 81.1GB +[2026-09-12 07:22:53] step 1810/5000 loss 0.4501 (w 0.2085 mse 0.2108 t 698 new 0.08) lr 1.00e-05 gnorm 0.201 2.83s mem 81.1GB +[2026-09-12 07:22:56] step 1811/5000 loss 0.3266 (w 0.2298 mse 0.2420 t 896 new 0.20) lr 1.00e-05 gnorm 0.168 3.11s mem 81.1GB +[2026-09-12 07:23:00] step 1812/5000 loss 0.1039 (w 0.2273 mse 0.2464 t 929 new 0.18) lr 1.00e-05 gnorm 0.283 3.35s mem 81.1GB +[2026-09-12 07:23:02] step 1813/5000 loss 0.2357 (w 0.3032 mse 0.3221 t 973 new 0.15) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +[2026-09-12 07:23:06] step 1814/5000 loss 0.2614 (w 0.6248 mse 0.6317 t 183 new 0.23) lr 1.00e-05 gnorm 0.091 3.05s mem 81.1GB +[2026-09-12 07:23:09] step 1815/5000 loss 0.1156 (w 0.3474 mse 0.3318 t 956 new 0.21) lr 1.00e-05 gnorm 0.227 3.43s mem 81.1GB +[2026-09-12 07:23:12] step 1816/5000 loss 0.2081 (w 0.3009 mse 0.3158 t 949 new 0.23) lr 1.00e-05 gnorm 0.245 3.22s mem 81.1GB +[2026-09-12 07:23:15] step 1817/5000 loss 0.1337 (w 0.2708 mse 0.2765 t 851 new 0.15) lr 1.00e-05 gnorm 0.186 3.10s mem 81.1GB +[2026-09-12 07:23:19] step 1818/5000 loss 0.2891 (w 0.2612 mse 0.2863 t 685 new 0.18) lr 1.00e-05 gnorm 0.264 3.32s mem 81.1GB +[2026-09-12 07:23:21] step 1819/5000 loss 0.1988 (w 0.3175 mse 0.3207 t 875 new 0.23) lr 1.00e-05 gnorm 0.181 2.82s mem 81.1GB +[2026-09-12 07:23:24] step 1820/5000 loss 0.2428 (w 0.2476 mse 0.2697 t 873 new 0.22) lr 1.00e-05 gnorm 0.154 3.07s mem 81.1GB +[2026-09-12 07:23:28] step 1821/5000 loss 0.5127 (w 0.3004 mse 0.3191 t 476 new 0.18) lr 1.00e-05 gnorm 0.154 3.29s mem 81.1GB +[2026-09-12 07:23:31] step 1822/5000 loss 0.2968 (w 0.3440 mse 0.3539 t 849 new 0.15) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +[2026-09-12 07:23:34] step 1823/5000 loss 0.4118 (w 0.2217 mse 0.2373 t 631 new 0.17) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +[2026-09-12 07:23:37] step 1824/5000 loss 0.3040 (w 0.4067 mse 0.4003 t 954 new 0.24) lr 1.00e-05 gnorm 0.156 3.33s mem 81.1GB +[2026-09-12 07:23:40] step 1825/5000 loss 0.2482 (w 0.3008 mse 0.2977 t 918 new 0.12) lr 1.00e-05 gnorm 0.180 2.84s mem 81.1GB +[2026-09-12 07:23:43] step 1826/5000 loss 0.2611 (w 0.3117 mse 0.3130 t 958 new 0.17) lr 1.00e-05 gnorm 0.147 3.05s mem 81.1GB +[2026-09-12 07:23:47] step 1827/5000 loss 0.3349 (w 0.3146 mse 0.3149 t 925 new 0.22) lr 1.00e-05 gnorm 0.183 3.35s mem 81.1GB +[2026-09-12 07:23:50] step 1828/5000 loss 0.4628 (w 0.2427 mse 0.2446 t 513 new 0.22) lr 1.00e-05 gnorm 0.307 3.03s mem 81.1GB +[2026-09-12 07:23:53] step 1829/5000 loss 0.1755 (w 0.3726 mse 0.3835 t 960 new 0.11) lr 1.00e-05 gnorm 0.273 2.82s mem 81.1GB +[2026-09-12 07:23:56] step 1830/5000 loss 0.3693 (w 0.3119 mse 0.3199 t 444 new 0.24) lr 1.00e-05 gnorm 0.188 3.33s mem 81.1GB +[2026-09-12 07:23:59] step 1831/5000 loss 0.3571 (w 0.3415 mse 0.3474 t 858 new 0.16) lr 1.00e-05 gnorm 0.178 2.82s mem 81.1GB +[2026-09-12 07:24:02] step 1832/5000 loss 0.1317 (w 0.3293 mse 0.3374 t 998 new 0.17) lr 1.00e-05 gnorm 0.178 3.09s mem 81.1GB +[2026-09-12 07:24:05] step 1833/5000 loss 0.2613 (w 0.3676 mse 0.3854 t 988 new 0.21) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +[2026-09-12 07:24:08] step 1834/5000 loss 0.1931 (w 0.3475 mse 0.3385 t 997 new 0.22) lr 1.00e-05 gnorm 0.333 3.03s mem 81.1GB +[2026-09-12 07:24:11] step 1835/5000 loss 0.1592 (w 0.2620 mse 0.2637 t 855 new 0.25) lr 1.00e-05 gnorm 0.222 3.09s mem 81.1GB +[2026-09-12 07:24:14] step 1836/5000 loss 0.4063 (w 0.7170 mse 0.7180 t 992 new 0.21) lr 1.00e-05 gnorm 0.169 3.07s mem 81.1GB +[2026-09-12 07:24:17] step 1837/5000 loss 0.2766 (w 0.2721 mse 0.2752 t 821 new 0.22) lr 1.00e-05 gnorm 0.128 3.06s mem 81.1GB +[2026-09-12 07:24:20] step 1838/5000 loss 0.2982 (w 0.2421 mse 0.2415 t 865 new 0.23) lr 1.00e-05 gnorm 0.119 3.12s mem 81.1GB +[2026-09-12 07:24:24] step 1839/5000 loss 0.2835 (w 0.3847 mse 0.3947 t 976 new 0.21) lr 1.00e-05 gnorm 0.147 3.10s mem 81.1GB +[2026-09-12 07:24:27] step 1840/5000 loss 0.1806 (w 0.2557 mse 0.2833 t 991 new 0.19) lr 1.00e-05 gnorm 0.276 3.05s mem 81.1GB +[2026-09-12 07:24:30] step 1841/5000 loss 0.2210 (w 0.2447 mse 0.2633 t 993 new 0.12) lr 1.00e-05 gnorm 0.619 2.83s mem 81.1GB +[2026-09-12 07:24:33] step 1842/5000 loss 0.3978 (w 0.3400 mse 0.3508 t 988 new 0.20) lr 1.00e-05 gnorm 0.266 3.14s mem 81.1GB +[2026-09-12 07:24:36] step 1843/5000 loss 0.3095 (w 0.3960 mse 0.4004 t 982 new 0.24) lr 1.00e-05 gnorm 0.129 3.06s mem 81.1GB +[2026-09-12 07:24:39] step 1844/5000 loss 0.2624 (w 0.3798 mse 0.3843 t 979 new 0.24) lr 1.00e-05 gnorm 0.183 3.10s mem 81.1GB +[2026-09-12 07:24:42] step 1845/5000 loss 0.1326 (w 0.2857 mse 0.2980 t 994 new 0.12) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +[2026-09-12 07:24:45] step 1846/5000 loss 0.2300 (w 0.3596 mse 0.3614 t 984 new 0.20) lr 1.00e-05 gnorm 0.239 3.04s mem 81.1GB +[2026-09-12 07:24:48] step 1847/5000 loss 0.3128 (w 0.3041 mse 0.3070 t 830 new 0.24) lr 1.00e-05 gnorm 0.159 3.05s mem 81.1GB +[2026-09-12 07:24:51] step 1848/5000 loss 0.3916 (w 0.3868 mse 0.3833 t 476 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +[2026-09-12 07:24:54] step 1849/5000 loss 0.2337 (w 0.2505 mse 0.2641 t 925 new 0.23) lr 1.00e-05 gnorm 0.253 3.05s mem 81.1GB +[2026-09-12 07:24:57] step 1850/5000 loss 0.2570 (w 0.3061 mse 0.3129 t 873 new 0.26) lr 1.00e-05 gnorm 0.188 3.03s mem 81.1GB +[2026-09-12 07:25:00] step 1851/5000 loss 0.1544 (w 0.3284 mse 0.3407 t 903 new 0.20) lr 1.00e-05 gnorm 0.291 3.09s mem 81.1GB +[2026-09-12 07:25:03] step 1852/5000 loss 0.3789 (w 0.3674 mse 0.3729 t 859 new 0.26) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +[2026-09-12 07:25:07] step 1853/5000 loss 0.1299 (w 0.2046 mse 0.2183 t 766 new 0.21) lr 1.00e-05 gnorm 0.144 3.24s mem 81.1GB +[2026-09-12 07:25:10] step 1854/5000 loss 0.3347 (w 0.3347 mse 0.3294 t 859 new 0.17) lr 1.00e-05 gnorm 0.136 2.82s mem 81.1GB +[2026-09-12 07:25:13] step 1855/5000 loss 0.2131 (w 0.3487 mse 0.3558 t 609 new 0.24) lr 1.00e-05 gnorm 0.111 3.09s mem 81.1GB +[2026-09-12 07:25:16] step 1856/5000 loss 0.2575 (w 0.2289 mse 0.2333 t 894 new 0.10) lr 1.00e-05 gnorm 0.244 3.06s mem 81.1GB +[2026-09-12 07:25:19] step 1857/5000 loss 0.3726 (w 0.1701 mse 0.1877 t 706 new 0.15) lr 1.00e-05 gnorm 0.150 3.27s mem 81.1GB +[2026-09-12 07:25:22] step 1858/5000 loss 0.3152 (w 0.3811 mse 0.3747 t 908 new 0.21) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +[2026-09-12 07:25:25] step 1859/5000 loss 0.1497 (w 0.4198 mse 0.4114 t 991 new 0.25) lr 1.00e-05 gnorm 0.112 3.25s mem 81.1GB +[2026-09-12 07:25:28] step 1860/5000 loss 0.2347 (w 0.2684 mse 0.2742 t 881 new 0.23) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +[2026-09-12 07:25:31] step 1861/5000 loss 0.2798 (w 0.2828 mse 0.2838 t 862 new 0.21) lr 1.00e-05 gnorm 0.119 3.13s mem 81.1GB +[2026-09-12 07:25:34] step 1862/5000 loss 0.3690 (w 0.2544 mse 0.2584 t 778 new 0.08) lr 1.00e-05 gnorm 0.121 3.11s mem 81.1GB +[2026-09-12 07:25:37] step 1863/5000 loss 0.1276 (w 0.2594 mse 0.2546 t 838 new 0.10) lr 1.00e-05 gnorm 0.127 3.31s mem 81.1GB +[2026-09-12 07:25:40] step 1864/5000 loss 0.2713 (w 0.2967 mse 0.3288 t 428 new 0.19) lr 1.00e-05 gnorm 0.146 2.82s mem 81.1GB +[2026-09-12 07:25:44] step 1865/5000 loss 0.4391 (w 0.2288 mse 0.2396 t 794 new 0.21) lr 1.00e-05 gnorm 0.143 3.26s mem 81.1GB +[2026-09-12 07:25:46] step 1866/5000 loss 0.2633 (w 0.2833 mse 0.2843 t 967 new 0.22) lr 1.00e-05 gnorm 0.152 2.82s mem 81.1GB +[2026-09-12 07:25:49] step 1867/5000 loss 0.3376 (w 0.3334 mse 0.3405 t 444 new 0.18) lr 1.00e-05 gnorm 0.148 3.12s mem 81.1GB +[2026-09-12 07:25:53] step 1868/5000 loss 0.1694 (w 0.3652 mse 0.3651 t 997 new 0.23) lr 1.00e-05 gnorm 0.127 3.27s mem 81.1GB +[2026-09-12 07:25:56] step 1869/5000 loss 0.4768 (w 0.4576 mse 0.4703 t 375 new 0.28) lr 1.00e-05 gnorm 0.202 3.07s mem 81.1GB +[2026-09-12 07:25:59] step 1870/5000 loss 0.2257 (w 0.3312 mse 0.3316 t 917 new 0.25) lr 1.00e-05 gnorm 0.135 3.09s mem 81.1GB +[2026-09-12 07:26:02] step 1871/5000 loss 0.3569 (w 0.3603 mse 0.3555 t 404 new 0.21) lr 1.00e-05 gnorm 0.165 3.04s mem 81.1GB +[2026-09-12 07:26:05] step 1872/5000 loss 0.2089 (w 0.3497 mse 0.3400 t 889 new 0.15) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +[2026-09-12 07:26:08] step 1873/5000 loss 0.2659 (w 0.2783 mse 0.2927 t 999 new 0.20) lr 1.00e-05 gnorm 0.159 3.31s mem 81.1GB +[2026-09-12 07:26:11] step 1874/5000 loss 0.2347 (w 0.2992 mse 0.3013 t 937 new 0.27) lr 1.00e-05 gnorm 0.141 3.04s mem 81.1GB +[2026-09-12 07:26:14] step 1875/5000 loss 0.3329 (w 0.2984 mse 0.3061 t 624 new 0.16) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +[2026-09-12 07:26:17] step 1876/5000 loss 0.1853 (w 0.3764 mse 0.3676 t 960 new 0.22) lr 1.00e-05 gnorm 0.120 3.09s mem 81.1GB +[2026-09-12 07:26:20] step 1877/5000 loss 0.2631 (w 0.2735 mse 0.2702 t 949 new 0.08) lr 1.00e-05 gnorm 0.104 3.09s mem 81.1GB +[2026-09-12 07:26:23] step 1878/5000 loss 0.2206 (w 0.5688 mse 0.5590 t 978 new 0.19) lr 1.00e-05 gnorm 0.248 2.83s mem 81.1GB +[2026-09-12 07:26:26] step 1879/5000 loss 0.2099 (w 0.2416 mse 0.2544 t 819 new 0.11) lr 1.00e-05 gnorm 0.138 3.23s mem 81.1GB +[2026-09-12 07:26:30] step 1880/5000 loss 0.2780 (w 0.4350 mse 0.4250 t 989 new 0.24) lr 1.00e-05 gnorm 0.176 3.10s mem 81.1GB +[2026-09-12 07:26:33] step 1881/5000 loss 0.1806 (w 0.2593 mse 0.2765 t 947 new 0.24) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-12 07:26:36] step 1882/5000 loss 0.3259 (w 0.3617 mse 0.3644 t 999 new 0.21) lr 1.00e-05 gnorm 0.154 3.07s mem 81.1GB +[2026-09-12 07:26:39] step 1883/5000 loss 0.4770 (w 0.2857 mse 0.2887 t 710 new 0.21) lr 1.00e-05 gnorm 0.168 3.11s mem 81.1GB +[2026-09-12 07:26:42] step 1884/5000 loss 0.2266 (w 0.1743 mse 0.1868 t 918 new 0.20) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +[2026-09-12 07:26:45] step 1885/5000 loss 0.2303 (w 0.3259 mse 0.3319 t 663 new 0.26) lr 1.00e-05 gnorm 0.548 3.27s mem 81.1GB +[2026-09-12 07:26:48] step 1886/5000 loss 0.4172 (w 0.2963 mse 0.2958 t 977 new 0.21) lr 1.00e-05 gnorm 0.150 3.28s mem 81.1GB +[2026-09-12 07:26:51] step 1887/5000 loss 0.3739 (w 0.2823 mse 0.3276 t 993 new 0.19) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +[2026-09-12 07:26:55] step 1888/5000 loss 0.2556 (w 0.3071 mse 0.3190 t 922 new 0.13) lr 1.00e-05 gnorm 0.409 3.55s mem 81.1GB +[2026-09-12 07:26:58] step 1889/5000 loss 0.2201 (w 0.2753 mse 0.2761 t 987 new 0.25) lr 1.00e-05 gnorm 0.121 3.04s mem 81.1GB +[2026-09-12 07:27:01] step 1890/5000 loss 0.3887 (w 0.3275 mse 0.3460 t 932 new 0.24) lr 1.00e-05 gnorm 0.148 2.84s mem 81.1GB +[2026-09-12 07:27:04] step 1891/5000 loss 0.2738 (w 0.6715 mse 0.6644 t 995 new 0.17) lr 1.00e-05 gnorm 0.122 3.12s mem 81.1GB +[2026-09-12 07:27:07] step 1892/5000 loss 0.3363 (w 0.2250 mse 0.2503 t 804 new 0.21) lr 1.00e-05 gnorm 0.122 3.26s mem 81.1GB +[2026-09-12 07:27:10] step 1893/5000 loss 0.3655 (w 0.3414 mse 0.3608 t 929 new 0.21) lr 1.00e-05 gnorm 0.131 3.08s mem 81.1GB +[2026-09-12 07:27:14] step 1894/5000 loss 0.3797 (w 0.2387 mse 0.2495 t 841 new 0.19) lr 1.00e-05 gnorm 1.196 3.55s mem 81.1GB +[2026-09-12 07:27:17] step 1895/5000 loss 0.4000 (w 0.2744 mse 0.2839 t 891 new 0.19) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +[2026-09-12 07:27:20] step 1896/5000 loss 0.3536 (w 0.2115 mse 0.2167 t 967 new 0.19) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +[2026-09-12 07:27:23] step 1897/5000 loss 0.2988 (w 0.2540 mse 0.2646 t 679 new 0.26) lr 1.00e-05 gnorm 0.161 3.29s mem 81.1GB +[2026-09-12 07:27:26] step 1898/5000 loss 0.3069 (w 0.2042 mse 0.2096 t 713 new 0.17) lr 1.00e-05 gnorm 0.107 3.05s mem 81.1GB +[2026-09-12 07:27:29] step 1899/5000 loss 0.2893 (w 0.2743 mse 0.2706 t 875 new 0.16) lr 1.00e-05 gnorm 0.134 3.36s mem 81.1GB +[2026-09-12 07:27:32] step 1900/5000 loss 0.3336 (w 0.2030 mse 0.2356 t 926 new 0.19) lr 1.00e-05 gnorm 0.373 3.01s mem 81.1GB +[2026-09-12 07:27:36] step 1901/5000 loss 0.2622 (w 0.2129 mse 0.2288 t 935 new 0.27) lr 1.00e-05 gnorm 0.125 3.13s mem 81.1GB +[2026-09-12 07:27:39] step 1902/5000 loss 0.3879 (w 0.2571 mse 0.2646 t 839 new 0.17) lr 1.00e-05 gnorm 0.141 3.04s mem 81.1GB +[2026-09-12 07:27:42] step 1903/5000 loss 0.1412 (w 0.3216 mse 0.3108 t 934 new 0.13) lr 1.00e-05 gnorm 0.164 3.22s mem 81.1GB +[2026-09-12 07:27:45] step 1904/5000 loss 0.1532 (w 0.3889 mse 0.3819 t 979 new 0.23) lr 1.00e-05 gnorm 0.887 3.05s mem 81.1GB +[2026-09-12 07:27:48] step 1905/5000 loss 0.2940 (w 0.4467 mse 0.4370 t 274 new 0.18) lr 1.00e-05 gnorm 0.130 3.59s mem 81.1GB +[2026-09-12 07:27:52] step 1906/5000 loss 0.2767 (w 0.5005 mse 0.4985 t 379 new 0.26) lr 1.00e-05 gnorm 0.645 3.39s mem 81.1GB +[2026-09-12 07:27:55] step 1907/5000 loss 0.2390 (w 0.2162 mse 0.2345 t 977 new 0.12) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +[2026-09-12 07:27:58] step 1908/5000 loss 0.1758 (w 0.2581 mse 0.2750 t 930 new 0.16) lr 1.00e-05 gnorm 0.144 3.07s mem 81.1GB +[2026-09-12 07:28:01] step 1909/5000 loss 0.3410 (w 0.2902 mse 0.2960 t 870 new 0.22) lr 1.00e-05 gnorm 0.107 3.32s mem 81.1GB +[2026-09-12 07:28:04] step 1910/5000 loss 0.2020 (w 0.3496 mse 0.3339 t 906 new 0.16) lr 1.00e-05 gnorm 0.144 3.10s mem 81.1GB +[2026-09-12 07:28:08] step 1911/5000 loss 0.2491 (w 0.2163 mse 0.2329 t 761 new 0.22) lr 1.00e-05 gnorm 0.142 3.46s mem 81.1GB +[2026-09-12 07:28:11] step 1912/5000 loss 0.3113 (w 0.2489 mse 0.2438 t 838 new 0.21) lr 1.00e-05 gnorm 0.241 3.07s mem 81.1GB +[2026-09-12 07:28:14] step 1913/5000 loss 0.3286 (w 0.3164 mse 0.3221 t 847 new 0.16) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +[2026-09-12 07:28:17] step 1914/5000 loss 0.2742 (w 0.2615 mse 0.2693 t 889 new 0.22) lr 1.00e-05 gnorm 0.199 3.08s mem 81.1GB +[2026-09-12 07:28:20] step 1915/5000 loss 0.2920 (w 0.2531 mse 0.2663 t 847 new 0.18) lr 1.00e-05 gnorm 0.170 3.01s mem 81.1GB +[2026-09-12 07:28:23] step 1916/5000 loss 0.4191 (w 0.4831 mse 0.4933 t 344 new 0.21) lr 1.00e-05 gnorm 0.184 3.06s mem 81.1GB +[2026-09-12 07:28:26] step 1917/5000 loss 0.1430 (w 0.2045 mse 0.2172 t 859 new 0.14) lr 1.00e-05 gnorm 0.121 3.39s mem 81.1GB +[2026-09-12 07:28:29] step 1918/5000 loss 0.3531 (w 0.3075 mse 0.3161 t 948 new 0.18) lr 1.00e-05 gnorm 0.140 3.09s mem 81.1GB +[2026-09-12 07:28:32] step 1919/5000 loss 0.2030 (w 0.9987 mse 1.0763 t 994 new 0.18) lr 1.00e-05 gnorm 0.193 2.85s mem 81.1GB +[2026-09-12 07:28:35] step 1920/5000 loss 0.4660 (w 0.4411 mse 0.4459 t 437 new 0.14) lr 1.00e-05 gnorm 0.129 3.13s mem 81.1GB +[2026-09-12 07:28:38] step 1921/5000 loss 0.1727 (w 0.4389 mse 0.4292 t 962 new 0.13) lr 1.00e-05 gnorm 0.123 3.05s mem 81.1GB +[2026-09-12 07:28:41] step 1922/5000 loss 0.1594 (w 0.3698 mse 0.3744 t 982 new 0.16) lr 1.00e-05 gnorm 0.145 3.07s mem 81.1GB +[2026-09-12 07:28:45] step 1923/5000 loss 0.2000 (w 0.3147 mse 0.3199 t 929 new 0.19) lr 1.00e-05 gnorm 0.121 3.48s mem 81.1GB +[2026-09-12 07:28:48] step 1924/5000 loss 0.3955 (w 0.3119 mse 0.3114 t 965 new 0.15) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +[2026-09-12 07:28:51] step 1925/5000 loss 0.3892 (w 0.2636 mse 0.2796 t 549 new 0.22) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +[2026-09-12 07:28:54] step 1926/5000 loss 0.4240 (w 0.2742 mse 0.2785 t 945 new 0.14) lr 1.00e-05 gnorm 0.183 3.13s mem 81.1GB +[2026-09-12 07:28:57] step 1927/5000 loss 0.3786 (w 0.3501 mse 0.3693 t 315 new 0.24) lr 1.00e-05 gnorm 0.234 3.09s mem 81.1GB +[2026-09-12 07:29:00] step 1928/5000 loss 0.2180 (w 0.2980 mse 0.2944 t 839 new 0.23) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +[2026-09-12 07:29:04] step 1929/5000 loss 0.2467 (w 0.2098 mse 0.2222 t 944 new 0.10) lr 1.00e-05 gnorm 0.158 3.45s mem 81.1GB +[2026-09-12 07:29:07] step 1930/5000 loss 0.2023 (w 0.3435 mse 0.3518 t 916 new 0.23) lr 1.00e-05 gnorm 0.161 3.06s mem 81.1GB +[2026-09-12 07:29:10] step 1931/5000 loss 0.3802 (w 0.2319 mse 0.2344 t 915 new 0.19) lr 1.00e-05 gnorm 0.124 2.85s mem 81.1GB +[2026-09-12 07:29:13] step 1932/5000 loss 0.2796 (w 0.2646 mse 0.2759 t 939 new 0.27) lr 1.00e-05 gnorm 0.186 3.44s mem 81.1GB +[2026-09-12 07:29:16] step 1933/5000 loss 0.1500 (w 0.2967 mse 0.2991 t 908 new 0.21) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-12 07:29:19] step 1934/5000 loss 0.3019 (w 0.6830 mse 0.7053 t 107 new 0.17) lr 1.00e-05 gnorm 0.174 3.07s mem 81.1GB +[2026-09-12 07:29:22] step 1935/5000 loss 0.2482 (w 0.3449 mse 0.3470 t 982 new 0.22) lr 1.00e-05 gnorm 0.142 3.26s mem 81.1GB +[2026-09-12 07:29:25] step 1936/5000 loss 0.4837 (w 0.3118 mse 0.3099 t 909 new 0.19) lr 1.00e-05 gnorm 0.151 3.08s mem 81.1GB +[2026-09-12 07:29:28] step 1937/5000 loss 0.1242 (w 0.3506 mse 0.3559 t 926 new 0.23) lr 1.00e-05 gnorm 0.210 2.83s mem 81.1GB +[2026-09-12 07:29:31] step 1938/5000 loss 0.1111 (w 0.3638 mse 0.3640 t 998 new 0.24) lr 1.00e-05 gnorm 0.140 3.31s mem 81.1GB +[2026-09-12 07:29:34] step 1939/5000 loss 0.3379 (w 0.2981 mse 0.2972 t 689 new 0.18) lr 1.00e-05 gnorm 0.208 2.83s mem 81.1GB +[2026-09-12 07:29:38] step 1940/5000 loss 0.4000 (w 0.3421 mse 0.3411 t 873 new 0.25) lr 1.00e-05 gnorm 0.322 3.39s mem 81.1GB +[2026-09-12 07:29:41] step 1941/5000 loss 0.3062 (w 0.3954 mse 0.3903 t 933 new 0.22) lr 1.00e-05 gnorm 0.169 3.04s mem 81.1GB +[2026-09-12 07:29:44] step 1942/5000 loss 0.2861 (w 0.3156 mse 0.3199 t 794 new 0.25) lr 1.00e-05 gnorm 0.173 3.08s mem 81.1GB +[2026-09-12 07:29:47] step 1943/5000 loss 0.3511 (w 0.2384 mse 0.2387 t 913 new 0.12) lr 1.00e-05 gnorm 0.194 3.11s mem 81.1GB +[2026-09-12 07:29:50] step 1944/5000 loss 0.2264 (w 0.2554 mse 0.2623 t 956 new 0.11) lr 1.00e-05 gnorm 0.105 3.34s mem 81.1GB +[2026-09-12 07:29:53] step 1945/5000 loss 0.3520 (w 0.2155 mse 0.2219 t 660 new 0.22) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +[2026-09-12 07:29:57] step 1946/5000 loss 0.3129 (w 0.1890 mse 0.2111 t 810 new 0.21) lr 1.00e-05 gnorm 0.177 3.40s mem 81.1GB +[2026-09-12 07:30:00] step 1947/5000 loss 0.3763 (w 0.2400 mse 0.2432 t 950 new 0.10) lr 1.00e-05 gnorm 0.201 3.05s mem 81.1GB +[2026-09-12 07:30:03] step 1948/5000 loss 0.1567 (w 0.4615 mse 0.4582 t 990 new 0.12) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +[2026-09-12 07:30:06] step 1949/5000 loss 0.2986 (w 0.3298 mse 0.3347 t 933 new 0.26) lr 1.00e-05 gnorm 0.154 3.02s mem 81.1GB +[2026-09-12 07:30:09] step 1950/5000 loss 0.2999 (w 0.3892 mse 0.3834 t 437 new 0.19) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +[2026-09-12 07:30:12] step 1951/5000 loss 0.1381 (w 0.2461 mse 0.2573 t 968 new 0.18) lr 1.00e-05 gnorm 0.163 2.86s mem 81.1GB +[2026-09-12 07:30:15] step 1952/5000 loss 0.2634 (w 0.2019 mse 0.2176 t 916 new 0.24) lr 1.00e-05 gnorm 0.128 3.42s mem 81.1GB +[2026-09-12 07:30:18] step 1953/5000 loss 0.2587 (w 0.2705 mse 0.2745 t 896 new 0.16) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +[2026-09-12 07:30:21] step 1954/5000 loss 0.3224 (w 0.1825 mse 0.2077 t 754 new 0.20) lr 1.00e-05 gnorm 0.272 3.08s mem 81.1GB +[2026-09-12 07:30:24] step 1955/5000 loss 0.3148 (w 0.4739 mse 0.4747 t 991 new 0.28) lr 1.00e-05 gnorm 0.148 3.07s mem 81.1GB +[2026-09-12 07:30:27] step 1956/5000 loss 0.2856 (w 0.2766 mse 0.2929 t 941 new 0.19) lr 1.00e-05 gnorm 1.848 3.09s mem 81.1GB +[2026-09-12 07:30:30] step 1957/5000 loss 0.6420 (w 0.3045 mse 0.3085 t 717 new 0.22) lr 1.00e-05 gnorm 0.348 2.83s mem 81.1GB +[2026-09-12 07:30:33] step 1958/5000 loss 0.2090 (w 0.3287 mse 0.3317 t 783 new 0.26) lr 1.00e-05 gnorm 0.137 3.39s mem 81.1GB +[2026-09-12 07:30:36] step 1959/5000 loss 0.2978 (w 0.3301 mse 0.3449 t 518 new 0.11) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +[2026-09-12 07:30:39] step 1960/5000 loss 0.2707 (w 0.7453 mse 0.7498 t 120 new 0.22) lr 1.00e-05 gnorm 0.150 3.10s mem 81.1GB +[2026-09-12 07:30:43] step 1961/5000 loss 0.1838 (w 0.4007 mse 0.4073 t 951 new 0.16) lr 1.00e-05 gnorm 0.178 3.31s mem 81.1GB +[2026-09-12 07:30:46] step 1962/5000 loss 0.3868 (w 0.2969 mse 0.3056 t 811 new 0.21) lr 1.00e-05 gnorm 0.150 3.15s mem 81.1GB +[2026-09-12 07:30:49] step 1963/5000 loss 0.4043 (w 0.2715 mse 0.2894 t 953 new 0.18) lr 1.00e-05 gnorm 0.166 3.07s mem 81.1GB +[2026-09-12 07:30:52] step 1964/5000 loss 0.3183 (w 0.2590 mse 0.2763 t 677 new 0.24) lr 1.00e-05 gnorm 0.672 3.17s mem 81.1GB +[2026-09-12 07:30:55] step 1965/5000 loss 0.2808 (w 0.2984 mse 0.3284 t 997 new 0.23) lr 1.00e-05 gnorm 0.459 3.08s mem 81.1GB +[2026-09-12 07:30:58] step 1966/5000 loss 0.2416 (w 0.2734 mse 0.2771 t 866 new 0.19) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +[2026-09-12 07:31:01] step 1967/5000 loss 0.1027 (w 0.3051 mse 0.3022 t 870 new 0.22) lr 1.00e-05 gnorm 0.144 3.38s mem 81.1GB +[2026-09-12 07:31:04] step 1968/5000 loss 0.3176 (w 0.2238 mse 0.2464 t 860 new 0.22) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +[2026-09-12 07:31:08] step 1969/5000 loss 0.3026 (w 0.2531 mse 0.2638 t 931 new 0.23) lr 1.00e-05 gnorm 0.156 3.40s mem 81.1GB +[2026-09-12 07:31:11] step 1970/5000 loss 0.2062 (w 0.3602 mse 0.3535 t 975 new 0.27) lr 1.00e-05 gnorm 0.184 3.14s mem 81.1GB +[2026-09-12 07:31:14] step 1971/5000 loss 0.4009 (w 0.2158 mse 0.2488 t 572 new 0.24) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +[2026-09-12 07:31:17] step 1972/5000 loss 0.2854 (w 0.3112 mse 0.3175 t 942 new 0.16) lr 1.00e-05 gnorm 0.181 3.02s mem 81.1GB +[2026-09-12 07:31:20] step 1973/5000 loss 0.2025 (w 0.2482 mse 0.2589 t 871 new 0.22) lr 1.00e-05 gnorm 0.129 3.10s mem 81.1GB +[2026-09-12 07:31:23] step 1974/5000 loss 0.3877 (w 0.3604 mse 0.3741 t 249 new 0.08) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +[2026-09-12 07:31:26] step 1975/5000 loss 0.2912 (w 0.2828 mse 0.2885 t 939 new 0.23) lr 1.00e-05 gnorm 0.136 3.06s mem 81.1GB +[2026-09-12 07:31:29] step 1976/5000 loss 0.2602 (w 0.2034 mse 0.2281 t 800 new 0.26) lr 1.00e-05 gnorm 0.143 3.16s mem 81.1GB +[2026-09-12 07:31:32] step 1977/5000 loss 0.4921 (w 0.3103 mse 0.3152 t 551 new 0.23) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +[2026-09-12 07:31:35] step 1978/5000 loss 0.2479 (w 0.2681 mse 0.2888 t 639 new 0.24) lr 1.00e-05 gnorm 0.181 3.05s mem 81.1GB +[2026-09-12 07:31:38] step 1979/5000 loss 0.3231 (w 0.3619 mse 0.3595 t 968 new 0.14) lr 1.00e-05 gnorm 0.257 3.10s mem 81.1GB +[2026-09-12 07:31:41] step 1980/5000 loss 0.2075 (w 0.3259 mse 0.3388 t 675 new 0.23) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-12 07:31:45] step 1981/5000 loss 0.3067 (w 0.3308 mse 0.3333 t 987 new 0.21) lr 1.00e-05 gnorm 1.556 3.50s mem 81.1GB +[2026-09-12 07:31:48] step 1982/5000 loss 0.1493 (w 0.2205 mse 0.2202 t 909 new 0.16) lr 1.00e-05 gnorm 0.121 3.02s mem 81.1GB +[2026-09-12 07:31:51] step 1983/5000 loss 0.4650 (w 0.4251 mse 0.4311 t 397 new 0.23) lr 1.00e-05 gnorm 0.470 3.05s mem 81.1GB +[2026-09-12 07:31:54] step 1984/5000 loss 0.1717 (w 0.2879 mse 0.2823 t 968 new 0.21) lr 1.00e-05 gnorm 0.113 3.04s mem 81.1GB +[2026-09-12 07:31:57] step 1985/5000 loss 0.2513 (w 0.2188 mse 0.2397 t 853 new 0.22) lr 1.00e-05 gnorm 0.134 3.34s mem 81.1GB +[2026-09-12 07:32:00] step 1986/5000 loss 0.2294 (w 0.2515 mse 0.2622 t 773 new 0.23) lr 1.00e-05 gnorm 0.216 2.84s mem 81.1GB +[2026-09-12 07:32:03] step 1987/5000 loss 0.2985 (w 0.2755 mse 0.2865 t 647 new 0.23) lr 1.00e-05 gnorm 0.264 3.52s mem 81.1GB +[2026-09-12 07:32:07] step 1988/5000 loss 0.2984 (w 0.3438 mse 0.3379 t 835 new 0.22) lr 1.00e-05 gnorm 0.127 3.33s mem 81.1GB +[2026-09-12 07:32:10] step 1989/5000 loss 0.3788 (w 0.2619 mse 0.2972 t 928 new 0.18) lr 1.00e-05 gnorm 0.134 2.85s mem 81.1GB +[2026-09-12 07:32:13] step 1990/5000 loss 0.1885 (w 0.2819 mse 0.2951 t 921 new 0.19) lr 1.00e-05 gnorm 0.128 3.02s mem 81.1GB +[2026-09-12 07:32:16] step 1991/5000 loss 0.2279 (w 0.3126 mse 0.3422 t 278 new 0.14) lr 1.00e-05 gnorm 0.147 3.12s mem 81.1GB +[2026-09-12 07:32:19] step 1992/5000 loss 0.2662 (w 0.2928 mse 0.3037 t 979 new 0.20) lr 1.00e-05 gnorm 0.154 3.06s mem 81.1GB +[2026-09-12 07:32:22] step 1993/5000 loss 0.2597 (w 0.2600 mse 0.2572 t 945 new 0.15) lr 1.00e-05 gnorm 0.164 3.27s mem 81.1GB +[2026-09-12 07:32:25] step 1994/5000 loss 0.3209 (w 0.3000 mse 0.3015 t 940 new 0.24) lr 1.00e-05 gnorm 0.175 3.24s mem 81.1GB +[2026-09-12 07:32:28] step 1995/5000 loss 0.1768 (w 0.2685 mse 0.2702 t 872 new 0.25) lr 1.00e-05 gnorm 0.133 2.83s mem 81.1GB +[2026-09-12 07:32:31] step 1996/5000 loss 0.2467 (w 0.1760 mse 0.1916 t 888 new 0.16) lr 1.00e-05 gnorm 0.178 3.08s mem 81.1GB +[2026-09-12 07:32:34] step 1997/5000 loss 0.2048 (w 0.2695 mse 0.2765 t 927 new 0.16) lr 1.00e-05 gnorm 0.160 3.09s mem 81.1GB +[2026-09-12 07:32:37] step 1998/5000 loss 0.3962 (w 0.4066 mse 0.4184 t 394 new 0.27) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +[2026-09-12 07:32:41] step 1999/5000 loss 0.2947 (w 0.2771 mse 0.2790 t 807 new 0.24) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +[2026-09-12 07:32:44] step 2000/5000 loss 0.2520 (w 0.3904 mse 0.3826 t 976 new 0.24) lr 1.00e-05 gnorm 0.120 3.34s mem 81.1GB +[2026-09-12 07:32:46] [val] step 2000 t=200: w=0.4675 mse=0.4858 (n=16) t=500: w=0.2840 mse=0.2991 (n=16) t=800: w=0.2397 mse=0.2518 (n=16) | mean w=0.3304 mse=0.3455 2s +[2026-09-12 07:33:33] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step2000.safetensors 4093 个张量 37.98 GB +[2026-09-12 07:33:38] step 2001/5000 loss 0.5637 (w 0.1915 mse 0.1976 t 814 new 0.25) lr 1.00e-05 gnorm 0.208 2.83s mem 81.1GB +[2026-09-12 07:33:41] step 2002/5000 loss 0.2977 (w 0.3566 mse 0.3538 t 968 new 0.24) lr 1.00e-05 gnorm 0.180 3.27s mem 81.1GB +[2026-09-12 07:33:44] step 2003/5000 loss 0.2096 (w 0.3578 mse 0.3635 t 976 new 0.21) lr 1.00e-05 gnorm 0.240 2.83s mem 81.1GB +[2026-09-12 07:33:47] step 2004/5000 loss 0.4615 (w 0.3813 mse 0.3903 t 386 new 0.09) lr 1.00e-05 gnorm 18.898 3.10s mem 81.1GB +[2026-09-12 07:33:50] step 2005/5000 loss 0.3042 (w 0.2460 mse 0.2665 t 987 new 0.26) lr 1.00e-05 gnorm 0.184 3.15s mem 81.1GB +[2026-09-12 07:33:54] step 2006/5000 loss 0.3677 (w 0.4733 mse 0.4850 t 228 new 0.23) lr 1.00e-05 gnorm 0.165 3.06s mem 81.1GB +[2026-09-12 07:33:56] step 2007/5000 loss 0.2745 (w 0.2526 mse 0.2603 t 891 new 0.24) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +[2026-09-12 07:34:00] step 2008/5000 loss 0.3829 (w 0.3138 mse 0.3189 t 886 new 0.22) lr 1.00e-05 gnorm 0.164 3.32s mem 81.1GB +[2026-09-12 07:34:03] step 2009/5000 loss 0.2455 (w 0.4898 mse 0.4854 t 980 new 0.27) lr 1.00e-05 gnorm 0.202 2.84s mem 81.1GB +[2026-09-12 07:34:06] step 2010/5000 loss 0.3065 (w 0.1992 mse 0.2102 t 877 new 0.21) lr 1.00e-05 gnorm 0.661 3.14s mem 81.1GB +[2026-09-12 07:34:09] step 2011/5000 loss 0.2219 (w 0.3788 mse 0.3784 t 944 new 0.25) lr 1.00e-05 gnorm 0.155 3.25s mem 81.1GB +[2026-09-12 07:34:12] step 2012/5000 loss 0.1209 (w 0.3392 mse 0.3492 t 929 new 0.18) lr 1.00e-05 gnorm 0.097 3.04s mem 81.1GB +[2026-09-12 07:34:15] step 2013/5000 loss 0.4184 (w 0.3007 mse 0.2969 t 781 new 0.22) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +[2026-09-12 07:34:18] step 2014/5000 loss 0.1138 (w 0.3104 mse 0.3090 t 950 new 0.21) lr 1.00e-05 gnorm 0.167 3.15s mem 81.1GB +[2026-09-12 07:34:21] step 2015/5000 loss 0.4323 (w 0.2938 mse 0.2997 t 928 new 0.21) lr 1.00e-05 gnorm 0.180 3.06s mem 81.1GB +[2026-09-12 07:34:24] step 2016/5000 loss 0.3023 (w 0.2118 mse 0.2406 t 821 new 0.23) lr 1.00e-05 gnorm 0.122 2.82s mem 81.1GB +[2026-09-12 07:34:27] step 2017/5000 loss 0.3258 (w 0.4979 mse 0.4971 t 288 new 0.05) lr 1.00e-05 gnorm 0.170 3.17s mem 81.1GB +[2026-09-12 07:34:30] step 2018/5000 loss 0.2508 (w 0.3730 mse 0.3684 t 665 new 0.19) lr 1.00e-05 gnorm 0.107 3.05s mem 81.1GB +[2026-09-12 07:34:33] step 2019/5000 loss 0.2663 (w 0.2751 mse 0.2861 t 840 new 0.23) lr 1.00e-05 gnorm 0.215 2.84s mem 81.1GB +[2026-09-12 07:34:36] step 2020/5000 loss 0.1797 (w 0.2259 mse 0.2318 t 675 new 0.22) lr 1.00e-05 gnorm 0.162 3.13s mem 81.1GB +[2026-09-12 07:34:39] step 2021/5000 loss 0.1914 (w 0.3059 mse 0.3183 t 846 new 0.14) lr 1.00e-05 gnorm 0.128 3.11s mem 81.1GB +[2026-09-12 07:34:42] step 2022/5000 loss 0.2179 (w 0.3580 mse 0.3664 t 970 new 0.22) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +[2026-09-12 07:34:45] step 2023/5000 loss 0.2458 (w 0.3853 mse 0.3868 t 988 new 0.22) lr 1.00e-05 gnorm 0.245 3.18s mem 81.1GB +[2026-09-12 07:34:48] step 2024/5000 loss 0.5348 (w 0.4734 mse 0.4929 t 223 new 0.21) lr 1.00e-05 gnorm 0.153 3.11s mem 81.1GB +[2026-09-12 07:34:51] step 2025/5000 loss 0.2362 (w 0.2330 mse 0.2376 t 886 new 0.19) lr 1.00e-05 gnorm 0.163 3.13s mem 81.1GB +[2026-09-12 07:34:54] step 2026/5000 loss 0.2587 (w 0.2524 mse 0.2606 t 813 new 0.22) lr 1.00e-05 gnorm 0.135 3.07s mem 81.1GB +[2026-09-12 07:34:58] step 2027/5000 loss 0.3685 (w 0.3565 mse 0.3608 t 992 new 0.09) lr 1.00e-05 gnorm 0.132 3.07s mem 81.1GB +[2026-09-12 07:35:00] step 2028/5000 loss 0.4844 (w 0.3368 mse 0.3549 t 444 new 0.17) lr 1.00e-05 gnorm 0.190 2.84s mem 81.1GB +[2026-09-12 07:35:04] step 2029/5000 loss 0.3362 (w 0.2897 mse 0.2907 t 957 new 0.12) lr 1.00e-05 gnorm 0.126 3.47s mem 81.1GB +[2026-09-12 07:35:07] step 2030/5000 loss 0.4408 (w 0.5135 mse 0.5100 t 306 new 0.20) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +[2026-09-12 07:35:10] step 2031/5000 loss 0.1786 (w 0.3885 mse 0.4012 t 283 new 0.09) lr 1.00e-05 gnorm 0.476 3.63s mem 81.1GB +[2026-09-12 07:35:13] step 2032/5000 loss 0.2476 (w 0.2357 mse 0.2484 t 926 new 0.22) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +[2026-09-12 07:35:17] step 2033/5000 loss 0.3173 (w 0.8098 mse 0.8077 t 100 new 0.23) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +[2026-09-12 07:35:20] step 2034/5000 loss 0.3425 (w 0.3646 mse 0.3794 t 348 new 0.17) lr 1.00e-05 gnorm 0.143 3.06s mem 81.1GB +[2026-09-12 07:35:23] step 2035/5000 loss 0.0995 (w 0.1725 mse 0.2022 t 819 new 0.25) lr 1.00e-05 gnorm 0.119 3.44s mem 81.1GB +[2026-09-12 07:35:26] step 2036/5000 loss 0.3224 (w 0.2728 mse 0.2789 t 542 new 0.21) lr 1.00e-05 gnorm 0.174 2.85s mem 81.1GB +[2026-09-12 07:35:29] step 2037/5000 loss 0.3416 (w 0.2341 mse 0.2505 t 677 new 0.21) lr 1.00e-05 gnorm 0.142 3.08s mem 81.1GB +[2026-09-12 07:35:33] step 2038/5000 loss 0.2924 (w 0.3982 mse 0.4129 t 954 new 0.25) lr 1.00e-05 gnorm 0.149 3.36s mem 81.1GB +[2026-09-12 07:35:35] step 2039/5000 loss 0.2675 (w 0.2636 mse 0.2648 t 800 new 0.15) lr 1.00e-05 gnorm 0.541 2.85s mem 81.1GB +[2026-09-12 07:35:39] step 2040/5000 loss 0.5118 (w 0.5190 mse 0.5117 t 171 new 0.22) lr 1.00e-05 gnorm 0.239 3.11s mem 81.1GB +[2026-09-12 07:35:42] step 2041/5000 loss 0.1513 (w 0.2716 mse 0.2735 t 981 new 0.24) lr 1.00e-05 gnorm 0.109 3.29s mem 81.1GB +[2026-09-12 07:35:45] step 2042/5000 loss 0.2289 (w 0.2474 mse 0.2670 t 965 new 0.22) lr 1.00e-05 gnorm 0.169 2.83s mem 81.1GB +[2026-09-12 07:35:48] step 2043/5000 loss 0.4988 (w 0.2939 mse 0.2907 t 959 new 0.14) lr 1.00e-05 gnorm 0.136 3.11s mem 81.1GB +[2026-09-12 07:35:51] step 2044/5000 loss 0.2386 (w 0.3211 mse 0.3342 t 956 new 0.17) lr 1.00e-05 gnorm 0.101 3.36s mem 81.1GB +[2026-09-12 07:35:54] step 2045/5000 loss 0.3324 (w 0.2209 mse 0.2216 t 946 new 0.17) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +[2026-09-12 07:35:57] step 2046/5000 loss 0.1512 (w 0.2477 mse 0.2628 t 999 new 0.19) lr 1.00e-05 gnorm 0.203 3.42s mem 81.1GB +[2026-09-12 07:36:01] step 2047/5000 loss 0.1232 (w 0.2326 mse 0.2429 t 965 new 0.17) lr 1.00e-05 gnorm 0.112 3.22s mem 81.1GB +[2026-09-12 07:36:03] step 2048/5000 loss 0.1960 (w 0.2078 mse 0.2292 t 939 new 0.22) lr 1.00e-05 gnorm 0.165 2.85s mem 81.1GB +[2026-09-12 07:36:07] step 2049/5000 loss 0.3897 (w 0.5299 mse 0.5366 t 264 new 0.19) lr 1.00e-05 gnorm 0.121 3.32s mem 81.1GB +[2026-09-12 07:36:10] step 2050/5000 loss 0.2242 (w 0.2082 mse 0.2242 t 983 new 0.26) lr 1.00e-05 gnorm 0.174 3.38s mem 81.1GB +[2026-09-12 07:36:13] step 2051/5000 loss 0.4346 (w 0.2613 mse 0.2660 t 826 new 0.18) lr 1.00e-05 gnorm 0.153 2.85s mem 81.1GB +[2026-09-12 07:36:16] step 2052/5000 loss 0.3595 (w 0.3201 mse 0.3248 t 996 new 0.22) lr 1.00e-05 gnorm 0.194 3.44s mem 81.1GB +[2026-09-12 07:36:20] step 2053/5000 loss 0.1810 (w 0.2140 mse 0.2194 t 816 new 0.12) lr 1.00e-05 gnorm 0.180 3.27s mem 81.1GB +[2026-09-12 07:36:23] step 2054/5000 loss 0.4055 (w 0.2547 mse 0.2622 t 624 new 0.19) lr 1.00e-05 gnorm 0.134 3.04s mem 81.1GB +[2026-09-12 07:36:26] step 2055/5000 loss 0.1383 (w 0.2665 mse 0.2685 t 927 new 0.25) lr 1.00e-05 gnorm 0.426 3.07s mem 81.1GB +[2026-09-12 07:36:29] step 2056/5000 loss 0.2273 (w 0.4591 mse 0.4709 t 278 new 0.23) lr 1.00e-05 gnorm 0.147 3.36s mem 81.1GB +[2026-09-12 07:36:32] step 2057/5000 loss 0.4212 (w 0.2925 mse 0.3014 t 869 new 0.19) lr 1.00e-05 gnorm 0.173 2.83s mem 81.1GB +[2026-09-12 07:36:35] step 2058/5000 loss 0.1079 (w 0.2517 mse 0.2557 t 906 new 0.21) lr 1.00e-05 gnorm 0.146 3.11s mem 81.1GB +[2026-09-12 07:36:38] step 2059/5000 loss 0.2147 (w 0.2581 mse 0.2679 t 826 new 0.21) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +[2026-09-12 07:36:41] step 2060/5000 loss 0.4425 (w 0.2990 mse 0.3065 t 822 new 0.21) lr 1.00e-05 gnorm 0.155 3.04s mem 81.1GB +[2026-09-12 07:36:44] step 2061/5000 loss 0.1016 (w 0.2327 mse 0.2596 t 914 new 0.22) lr 1.00e-05 gnorm 0.165 3.11s mem 81.1GB +[2026-09-12 07:36:48] step 2062/5000 loss 0.2783 (w 0.3580 mse 0.3656 t 975 new 0.20) lr 1.00e-05 gnorm 0.148 3.08s mem 81.1GB +[2026-09-12 07:36:51] step 2063/5000 loss 0.1572 (w 0.2730 mse 0.2912 t 991 new 0.18) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +[2026-09-12 07:36:54] step 2064/5000 loss 0.3855 (w 0.2446 mse 0.2464 t 875 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +[2026-09-12 07:36:57] step 2065/5000 loss 0.4706 (w 0.2892 mse 0.2813 t 782 new 0.18) lr 1.00e-05 gnorm 7.288 3.06s mem 81.1GB +[2026-09-12 07:37:00] step 2066/5000 loss 0.1503 (w 0.5217 mse 0.5112 t 982 new 0.22) lr 1.00e-05 gnorm 0.170 3.02s mem 81.1GB +[2026-09-12 07:37:03] step 2067/5000 loss 0.1937 (w 0.2696 mse 0.2800 t 967 new 0.16) lr 1.00e-05 gnorm 0.156 3.15s mem 81.1GB +[2026-09-12 07:37:06] step 2068/5000 loss 0.3192 (w 0.3022 mse 0.3162 t 972 new 0.17) lr 1.00e-05 gnorm 0.100 3.11s mem 81.1GB +[2026-09-12 07:37:09] step 2069/5000 loss 0.2987 (w 0.2488 mse 0.2599 t 878 new 0.12) lr 1.00e-05 gnorm 0.143 3.07s mem 81.1GB +[2026-09-12 07:37:13] step 2070/5000 loss 0.2711 (w 0.2850 mse 0.2944 t 697 new 0.20) lr 1.00e-05 gnorm 0.148 3.34s mem 81.1GB +[2026-09-12 07:37:16] step 2071/5000 loss 0.4222 (w 0.3286 mse 0.3362 t 651 new 0.22) lr 1.00e-05 gnorm 0.129 3.04s mem 81.1GB +[2026-09-12 07:37:19] step 2072/5000 loss 0.1742 (w 0.2633 mse 0.2658 t 948 new 0.13) lr 1.00e-05 gnorm 0.123 3.03s mem 81.1GB +[2026-09-12 07:37:22] step 2073/5000 loss 0.4034 (w 0.3858 mse 0.3946 t 546 new 0.27) lr 1.00e-05 gnorm 0.150 3.09s mem 81.1GB +[2026-09-12 07:37:25] step 2074/5000 loss 0.3661 (w 0.3686 mse 0.3613 t 985 new 0.17) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +[2026-09-12 07:37:28] step 2075/5000 loss 0.1872 (w 0.3075 mse 0.3212 t 904 new 0.25) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +[2026-09-12 07:37:31] step 2076/5000 loss 0.3894 (w 0.3216 mse 0.3354 t 866 new 0.21) lr 1.00e-05 gnorm 0.160 3.31s mem 81.1GB +[2026-09-12 07:37:34] step 2077/5000 loss 0.2900 (w 0.1881 mse 0.2026 t 787 new 0.20) lr 1.00e-05 gnorm 0.132 3.07s mem 81.1GB +[2026-09-12 07:37:37] step 2078/5000 loss 0.1669 (w 0.2695 mse 0.2715 t 878 new 0.21) lr 1.00e-05 gnorm 0.127 3.04s mem 81.1GB +[2026-09-12 07:37:41] step 2079/5000 loss 0.1940 (w 0.2868 mse 0.3054 t 999 new 0.22) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +[2026-09-12 07:37:44] step 2080/5000 loss 0.4505 (w 0.2380 mse 0.2540 t 967 new 0.21) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +[2026-09-12 07:37:47] step 2081/5000 loss 0.3593 (w 0.2823 mse 0.2879 t 352 new 0.14) lr 1.00e-05 gnorm 0.145 3.15s mem 81.1GB +[2026-09-12 07:37:50] step 2082/5000 loss 0.4309 (w 0.2901 mse 0.2992 t 653 new 0.25) lr 1.00e-05 gnorm 0.125 3.31s mem 81.1GB +[2026-09-12 07:37:53] step 2083/5000 loss 0.2465 (w 0.2523 mse 0.2637 t 851 new 0.24) lr 1.00e-05 gnorm 0.183 3.09s mem 81.1GB +[2026-09-12 07:37:56] step 2084/5000 loss 0.2418 (w 0.2290 mse 0.2428 t 759 new 0.28) lr 1.00e-05 gnorm 0.155 3.18s mem 81.1GB +[2026-09-12 07:37:59] step 2085/5000 loss 0.5279 (w 0.2604 mse 0.2760 t 913 new 0.24) lr 1.00e-05 gnorm 0.174 2.83s mem 81.1GB +[2026-09-12 07:38:02] step 2086/5000 loss 0.2470 (w 0.3021 mse 0.3112 t 836 new 0.24) lr 1.00e-05 gnorm 1.357 3.11s mem 81.1GB +[2026-09-12 07:38:05] step 2087/5000 loss 0.3606 (w 0.1353 mse 0.1497 t 925 new 0.11) lr 1.00e-05 gnorm 0.215 3.05s mem 81.1GB +[2026-09-12 07:38:09] step 2088/5000 loss 0.4161 (w 0.3624 mse 0.3610 t 787 new 0.16) lr 1.00e-05 gnorm 0.131 3.40s mem 81.1GB +[2026-09-12 07:38:12] step 2089/5000 loss 0.2623 (w 0.2318 mse 0.2559 t 965 new 0.12) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +[2026-09-12 07:38:15] step 2090/5000 loss 0.2736 (w 0.2635 mse 0.2692 t 935 new 0.17) lr 1.00e-05 gnorm 0.166 3.17s mem 81.1GB +[2026-09-12 07:38:18] step 2091/5000 loss 0.2331 (w 0.2828 mse 0.2849 t 935 new 0.09) lr 1.00e-05 gnorm 0.119 3.06s mem 81.1GB +[2026-09-12 07:38:21] step 2092/5000 loss 0.3781 (w 0.2852 mse 0.2859 t 935 new 0.01) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +[2026-09-12 07:38:24] step 2093/5000 loss 0.4875 (w 0.4157 mse 0.4171 t 348 new 0.20) lr 1.00e-05 gnorm 0.137 3.39s mem 81.1GB +[2026-09-12 07:38:27] step 2094/5000 loss 0.3164 (w 0.3400 mse 0.3570 t 851 new 0.28) lr 1.00e-05 gnorm 0.146 3.34s mem 81.1GB +[2026-09-12 07:38:30] step 2095/5000 loss 0.2107 (w 0.2091 mse 0.2242 t 932 new 0.12) lr 1.00e-05 gnorm 0.239 2.84s mem 81.1GB +[2026-09-12 07:38:34] step 2096/5000 loss 0.2063 (w 0.3172 mse 0.3234 t 962 new 0.13) lr 1.00e-05 gnorm 0.134 3.30s mem 81.1GB +[2026-09-12 07:38:37] step 2097/5000 loss 0.3376 (w 0.2921 mse 0.2956 t 847 new 0.26) lr 1.00e-05 gnorm 0.106 3.07s mem 81.1GB +[2026-09-12 07:38:39] step 2098/5000 loss 0.2877 (w 0.2569 mse 0.2800 t 684 new 0.23) lr 1.00e-05 gnorm 0.212 2.83s mem 81.1GB +[2026-09-12 07:38:43] step 2099/5000 loss 0.2827 (w 0.2190 mse 0.2428 t 874 new 0.23) lr 1.00e-05 gnorm 0.147 3.35s mem 81.1GB +[2026-09-12 07:38:46] step 2100/5000 loss 0.2104 (w 0.1669 mse 0.1929 t 844 new 0.19) lr 1.00e-05 gnorm 0.178 3.37s mem 81.1GB +[2026-09-12 07:38:49] step 2101/5000 loss 0.2424 (w 0.3316 mse 0.3405 t 984 new 0.22) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +[2026-09-12 07:38:52] step 2102/5000 loss 0.4812 (w 0.2026 mse 0.2066 t 819 new 0.17) lr 1.00e-05 gnorm 0.166 3.36s mem 81.1GB +[2026-09-12 07:38:55] step 2103/5000 loss 0.3856 (w 0.4389 mse 0.4666 t 249 new 0.19) lr 1.00e-05 gnorm 0.214 3.11s mem 81.1GB +[2026-09-12 07:38:58] step 2104/5000 loss 0.2146 (w 0.1845 mse 0.1964 t 902 new 0.14) lr 1.00e-05 gnorm 0.260 2.84s mem 81.1GB +[2026-09-12 07:39:02] step 2105/5000 loss 0.2580 (w 0.3291 mse 0.3310 t 944 new 0.17) lr 1.00e-05 gnorm 0.131 3.37s mem 81.1GB +[2026-09-12 07:39:05] step 2106/5000 loss 0.4039 (w 0.3464 mse 0.3493 t 989 new 0.23) lr 1.00e-05 gnorm 0.200 3.02s mem 81.1GB +[2026-09-12 07:39:08] step 2107/5000 loss 0.4203 (w 0.2506 mse 0.2563 t 918 new 0.21) lr 1.00e-05 gnorm 0.164 2.83s mem 81.1GB +[2026-09-12 07:39:11] step 2108/5000 loss 0.2653 (w 0.2985 mse 0.2799 t 858 new 0.21) lr 1.00e-05 gnorm 0.134 3.13s mem 81.1GB +[2026-09-12 07:39:14] step 2109/5000 loss 0.2847 (w 0.4022 mse 0.4151 t 972 new 0.28) lr 1.00e-05 gnorm 0.154 3.07s mem 81.1GB +[2026-09-12 07:39:17] step 2110/5000 loss 0.3947 (w 0.3318 mse 0.3302 t 523 new 0.12) lr 1.00e-05 gnorm 0.172 2.83s mem 81.1GB +[2026-09-12 07:39:20] step 2111/5000 loss 0.4759 (w 0.6206 mse 0.6191 t 217 new 0.23) lr 1.00e-05 gnorm 0.150 3.08s mem 81.1GB +[2026-09-12 07:39:23] step 2112/5000 loss 0.2364 (w 0.3149 mse 0.3225 t 883 new 0.17) lr 1.00e-05 gnorm 0.115 3.05s mem 81.1GB +[2026-09-12 07:39:26] step 2113/5000 loss 0.1539 (w 0.2296 mse 0.2489 t 851 new 0.25) lr 1.00e-05 gnorm 0.106 3.05s mem 81.1GB +[2026-09-12 07:39:29] step 2114/5000 loss 0.2011 (w 0.3745 mse 0.3987 t 971 new 0.19) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +[2026-09-12 07:39:32] step 2115/5000 loss 0.2093 (w 0.2146 mse 0.2352 t 960 new 0.18) lr 1.00e-05 gnorm 0.121 3.13s mem 81.1GB +[2026-09-12 07:39:35] step 2116/5000 loss 0.2238 (w 0.3617 mse 0.3772 t 348 new 0.21) lr 1.00e-05 gnorm 0.113 3.12s mem 81.1GB +[2026-09-12 07:39:38] step 2117/5000 loss 0.2276 (w 0.2206 mse 0.2363 t 916 new 0.14) lr 1.00e-05 gnorm 0.548 3.30s mem 81.1GB +[2026-09-12 07:39:41] step 2118/5000 loss 0.2960 (w 0.3830 mse 0.4032 t 390 new 0.23) lr 1.00e-05 gnorm 0.202 3.05s mem 81.1GB +[2026-09-12 07:39:45] step 2119/5000 loss 0.2875 (w 0.3204 mse 0.3269 t 872 new 0.25) lr 1.00e-05 gnorm 0.143 3.15s mem 81.1GB +[2026-09-12 07:39:48] step 2120/5000 loss 0.3010 (w 0.2694 mse 0.3068 t 968 new 0.26) lr 1.00e-05 gnorm 0.273 3.35s mem 81.1GB +[2026-09-12 07:39:51] step 2121/5000 loss 0.1642 (w 0.1744 mse 0.1903 t 989 new 0.23) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +[2026-09-12 07:39:54] step 2122/5000 loss 0.2554 (w 0.3942 mse 0.4030 t 1000 new 0.17) lr 1.00e-05 gnorm 0.146 3.13s mem 81.1GB +[2026-09-12 07:39:57] step 2123/5000 loss 0.2529 (w 0.3143 mse 0.3121 t 927 new 0.18) lr 1.00e-05 gnorm 0.189 3.02s mem 81.1GB +[2026-09-12 07:40:00] step 2124/5000 loss 0.3381 (w 0.4084 mse 0.4118 t 394 new 0.18) lr 1.00e-05 gnorm 0.114 3.04s mem 81.1GB +[2026-09-12 07:40:03] step 2125/5000 loss 0.2578 (w 0.3709 mse 0.3620 t 895 new 0.18) lr 1.00e-05 gnorm 0.505 3.35s mem 81.1GB +[2026-09-12 07:40:07] step 2126/5000 loss 0.3096 (w 0.2344 mse 0.2472 t 822 new 0.25) lr 1.00e-05 gnorm 0.144 3.14s mem 81.1GB +[2026-09-12 07:40:09] step 2127/5000 loss 0.4366 (w 0.2371 mse 0.2448 t 681 new 0.19) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +[2026-09-12 07:40:12] step 2128/5000 loss 0.3555 (w 0.2780 mse 0.2792 t 772 new 0.19) lr 1.00e-05 gnorm 0.193 3.13s mem 81.1GB +[2026-09-12 07:40:16] step 2129/5000 loss 0.4245 (w 0.4339 mse 0.4283 t 980 new 0.25) lr 1.00e-05 gnorm 0.164 3.03s mem 81.1GB +[2026-09-12 07:40:19] step 2130/5000 loss 0.3783 (w 0.3571 mse 0.3686 t 998 new 0.26) lr 1.00e-05 gnorm 0.130 3.01s mem 81.1GB +[2026-09-12 07:40:22] step 2131/5000 loss 0.3250 (w 0.2492 mse 0.2567 t 763 new 0.14) lr 1.00e-05 gnorm 0.146 3.35s mem 81.1GB +[2026-09-12 07:40:25] step 2132/5000 loss 0.2380 (w 0.2321 mse 0.2355 t 904 new 0.19) lr 1.00e-05 gnorm 0.187 3.06s mem 81.1GB +[2026-09-12 07:40:28] step 2133/5000 loss 0.2851 (w 0.3662 mse 0.3616 t 750 new 0.19) lr 1.00e-05 gnorm 0.724 2.86s mem 81.1GB +[2026-09-12 07:40:31] step 2134/5000 loss 0.1955 (w 0.2565 mse 0.2714 t 872 new 0.17) lr 1.00e-05 gnorm 0.205 3.37s mem 81.1GB +[2026-09-12 07:40:34] step 2135/5000 loss 0.4465 (w 0.1777 mse 0.2031 t 797 new 0.27) lr 1.00e-05 gnorm 0.162 3.08s mem 81.1GB +[2026-09-12 07:40:37] step 2136/5000 loss 0.1944 (w 0.3953 mse 0.3867 t 974 new 0.22) lr 1.00e-05 gnorm 0.117 3.05s mem 81.1GB +[2026-09-12 07:40:41] step 2137/5000 loss 0.3225 (w 0.3631 mse 0.3790 t 992 new 0.24) lr 1.00e-05 gnorm 0.363 3.46s mem 81.1GB +[2026-09-12 07:40:44] step 2138/5000 loss 0.4957 (w 0.2099 mse 0.2097 t 849 new 0.05) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +[2026-09-12 07:40:47] step 2139/5000 loss 0.1804 (w 0.2761 mse 0.2967 t 428 new 0.25) lr 1.00e-05 gnorm 0.121 2.84s mem 81.1GB +[2026-09-12 07:40:50] step 2140/5000 loss 0.1225 (w 0.3198 mse 0.3185 t 939 new 0.19) lr 1.00e-05 gnorm 0.141 3.42s mem 81.1GB +[2026-09-12 07:40:53] step 2141/5000 loss 0.2270 (w 0.5963 mse 0.5985 t 159 new 0.22) lr 1.00e-05 gnorm 0.226 3.04s mem 81.1GB +[2026-09-12 07:40:56] step 2142/5000 loss 0.3073 (w 0.2322 mse 0.2450 t 951 new 0.20) lr 1.00e-05 gnorm 0.119 3.28s mem 81.1GB +[2026-09-12 07:41:00] step 2143/5000 loss 0.2376 (w 0.1942 mse 0.2164 t 715 new 0.27) lr 1.00e-05 gnorm 0.121 3.36s mem 81.1GB +[2026-09-12 07:41:03] step 2144/5000 loss 0.2957 (w 0.2524 mse 0.2597 t 695 new 0.16) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +[2026-09-12 07:41:06] step 2145/5000 loss 0.2820 (w 0.3282 mse 0.3305 t 846 new 0.23) lr 1.00e-05 gnorm 0.120 3.17s mem 81.1GB +[2026-09-12 07:41:09] step 2146/5000 loss 0.3069 (w 0.2657 mse 0.2813 t 977 new 0.23) lr 1.00e-05 gnorm 0.158 3.18s mem 81.1GB +[2026-09-12 07:41:12] step 2147/5000 loss 0.3729 (w 0.3684 mse 0.3737 t 431 new 0.23) lr 1.00e-05 gnorm 0.143 3.13s mem 81.1GB +[2026-09-12 07:41:15] step 2148/5000 loss 0.3467 (w 0.3381 mse 0.3441 t 431 new 0.27) lr 1.00e-05 gnorm 0.153 3.33s mem 81.1GB +[2026-09-12 07:41:19] step 2149/5000 loss 0.2322 (w 0.3020 mse 0.3062 t 962 new 0.19) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +[2026-09-12 07:41:21] step 2150/5000 loss 0.2148 (w 0.2928 mse 0.2923 t 961 new 0.09) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +[2026-09-12 07:41:24] step 2151/5000 loss 0.1100 (w 0.3173 mse 0.3235 t 972 new 0.09) lr 1.00e-05 gnorm 0.742 3.06s mem 81.1GB +[2026-09-12 07:41:28] step 2152/5000 loss 0.2785 (w 0.2426 mse 0.2494 t 925 new 0.19) lr 1.00e-05 gnorm 0.211 3.63s mem 81.1GB +[2026-09-12 07:41:31] step 2153/5000 loss 0.3097 (w 0.2505 mse 0.2502 t 950 new 0.22) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-12 07:41:34] step 2154/5000 loss 0.4764 (w 0.2522 mse 0.2598 t 703 new 0.18) lr 1.00e-05 gnorm 0.150 3.35s mem 81.1GB +[2026-09-12 07:41:37] step 2155/5000 loss 0.2371 (w 0.2391 mse 0.2639 t 939 new 0.19) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +[2026-09-12 07:41:40] step 2156/5000 loss 0.2797 (w 0.3221 mse 0.3327 t 976 new 0.19) lr 1.00e-05 gnorm 0.503 2.85s mem 81.1GB +[2026-09-12 07:41:43] step 2157/5000 loss 0.4669 (w 0.2561 mse 0.2693 t 975 new 0.24) lr 1.00e-05 gnorm 0.139 3.05s mem 81.1GB +[2026-09-12 07:41:47] step 2158/5000 loss 0.3374 (w 0.2785 mse 0.2839 t 817 new 0.20) lr 1.00e-05 gnorm 1.082 3.49s mem 81.1GB +[2026-09-12 07:41:50] step 2159/5000 loss 0.4101 (w 0.2608 mse 0.2683 t 926 new 0.23) lr 1.00e-05 gnorm 0.104 2.83s mem 81.1GB +[2026-09-12 07:41:53] step 2160/5000 loss 0.4337 (w 0.3201 mse 0.3268 t 599 new 0.18) lr 1.00e-05 gnorm 0.245 3.29s mem 81.1GB +[2026-09-12 07:41:56] step 2161/5000 loss 0.5249 (w 0.6058 mse 0.6200 t 177 new 0.23) lr 1.00e-05 gnorm 0.793 3.13s mem 81.1GB +[2026-09-12 07:41:59] step 2162/5000 loss 0.3908 (w 0.3093 mse 0.3106 t 566 new 0.19) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +[2026-09-12 07:42:02] step 2163/5000 loss 0.1617 (w 0.2000 mse 0.2037 t 832 new 0.10) lr 1.00e-05 gnorm 0.124 3.06s mem 81.1GB +[2026-09-12 07:42:05] step 2164/5000 loss 0.2323 (w 0.2665 mse 0.2727 t 728 new 0.21) lr 1.00e-05 gnorm 0.100 3.41s mem 81.1GB +[2026-09-12 07:42:08] step 2165/5000 loss 0.1792 (w 0.2290 mse 0.2468 t 962 new 0.19) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +[2026-09-12 07:42:12] step 2166/5000 loss 0.2119 (w 0.3339 mse 0.3369 t 909 new 0.19) lr 1.00e-05 gnorm 0.291 3.34s mem 81.1GB +[2026-09-12 07:42:15] step 2167/5000 loss 0.3464 (w 0.1981 mse 0.2044 t 873 new 0.23) lr 1.00e-05 gnorm 0.152 3.06s mem 81.1GB +[2026-09-12 07:42:18] step 2168/5000 loss 0.1858 (w 0.2009 mse 0.2297 t 885 new 0.28) lr 1.00e-05 gnorm 0.154 2.84s mem 81.1GB +[2026-09-12 07:42:21] step 2169/5000 loss 0.3852 (w 0.2958 mse 0.3083 t 807 new 0.20) lr 1.00e-05 gnorm 0.166 3.06s mem 81.1GB +[2026-09-12 07:42:24] step 2170/5000 loss 0.2271 (w 0.3521 mse 0.3586 t 986 new 0.18) lr 1.00e-05 gnorm 0.135 3.45s mem 81.1GB +[2026-09-12 07:42:27] step 2171/5000 loss 0.3371 (w 0.3066 mse 0.3111 t 965 new 0.18) lr 1.00e-05 gnorm 0.119 3.16s mem 81.1GB +[2026-09-12 07:42:30] step 2172/5000 loss 0.3050 (w 0.3901 mse 0.3883 t 983 new 0.16) lr 1.00e-05 gnorm 0.113 3.27s mem 81.1GB +[2026-09-12 07:42:34] step 2173/5000 loss 0.2080 (w 0.2266 mse 0.2533 t 974 new 0.21) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +[2026-09-12 07:42:36] step 2174/5000 loss 0.2971 (w 0.4056 mse 0.4171 t 991 new 0.20) lr 1.00e-05 gnorm 0.186 2.84s mem 81.1GB +[2026-09-12 07:42:40] step 2175/5000 loss 0.3561 (w 0.2855 mse 0.2906 t 952 new 0.19) lr 1.00e-05 gnorm 0.224 3.16s mem 81.1GB +[2026-09-12 07:42:43] step 2176/5000 loss 0.2672 (w 0.3157 mse 0.3454 t 986 new 0.24) lr 1.00e-05 gnorm 0.129 3.05s mem 81.1GB +[2026-09-12 07:42:46] step 2177/5000 loss 0.4152 (w 0.3540 mse 0.3728 t 986 new 0.19) lr 1.00e-05 gnorm 0.147 3.19s mem 81.1GB +[2026-09-12 07:42:49] step 2178/5000 loss 0.3480 (w 0.2956 mse 0.2979 t 698 new 0.27) lr 1.00e-05 gnorm 0.143 3.04s mem 81.1GB +[2026-09-12 07:42:52] step 2179/5000 loss 0.2811 (w 0.4356 mse 0.4261 t 978 new 0.19) lr 1.00e-05 gnorm 0.232 3.14s mem 81.1GB +[2026-09-12 07:42:55] step 2180/5000 loss 0.2985 (w 0.4760 mse 0.4813 t 976 new 0.21) lr 1.00e-05 gnorm 0.287 2.84s mem 81.1GB +[2026-09-12 07:42:58] step 2181/5000 loss 0.3357 (w 0.2778 mse 0.2881 t 404 new 0.21) lr 1.00e-05 gnorm 0.128 3.47s mem 81.1GB +[2026-09-12 07:43:01] step 2182/5000 loss 0.2505 (w 0.4914 mse 0.4914 t 177 new 0.00) lr 1.00e-05 gnorm 0.326 3.05s mem 81.1GB +[2026-09-12 07:43:05] step 2183/5000 loss 0.3181 (w 0.3788 mse 0.3701 t 904 new 0.09) lr 1.00e-05 gnorm 0.125 3.09s mem 81.1GB +[2026-09-12 07:43:08] step 2184/5000 loss 0.1492 (w 0.4766 mse 0.4635 t 986 new 0.17) lr 1.00e-05 gnorm 0.111 3.09s mem 81.1GB +[2026-09-12 07:43:11] step 2185/5000 loss 0.1757 (w 0.2658 mse 0.2754 t 880 new 0.24) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-12 07:43:14] step 2186/5000 loss 0.3317 (w 0.3877 mse 0.3846 t 927 new 0.23) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +[2026-09-12 07:43:17] step 2187/5000 loss 0.2973 (w 0.3030 mse 0.3055 t 915 new 0.22) lr 1.00e-05 gnorm 0.118 3.48s mem 81.1GB +[2026-09-12 07:43:20] step 2188/5000 loss 0.3482 (w 0.3147 mse 0.3070 t 972 new 0.15) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +[2026-09-12 07:43:23] step 2189/5000 loss 0.3459 (w 0.3022 mse 0.3033 t 590 new 0.11) lr 1.00e-05 gnorm 0.192 3.10s mem 81.1GB +[2026-09-12 07:43:26] step 2190/5000 loss 0.4067 (w 0.4111 mse 0.4152 t 383 new 0.18) lr 1.00e-05 gnorm 0.103 3.14s mem 81.1GB +[2026-09-12 07:43:29] step 2191/5000 loss 0.2560 (w 0.2216 mse 0.2274 t 897 new 0.14) lr 1.00e-05 gnorm 0.103 2.85s mem 81.1GB +[2026-09-12 07:43:32] step 2192/5000 loss 0.1916 (w 0.2614 mse 0.2672 t 799 new 0.17) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +[2026-09-12 07:43:35] step 2193/5000 loss 0.4357 (w 0.3591 mse 0.3560 t 660 new 0.23) lr 1.00e-05 gnorm 0.149 3.47s mem 81.1GB +[2026-09-12 07:43:38] step 2194/5000 loss 0.2062 (w 0.2716 mse 0.2838 t 966 new 0.24) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +[2026-09-12 07:43:41] step 2195/5000 loss 0.4302 (w 0.3093 mse 0.3111 t 854 new 0.14) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +[2026-09-12 07:43:45] step 2196/5000 loss 0.0774 (w 0.3355 mse 0.3472 t 982 new 0.26) lr 1.00e-05 gnorm 0.273 3.36s mem 81.1GB +[2026-09-12 07:43:48] step 2197/5000 loss 0.3988 (w 0.3354 mse 0.3271 t 876 new 0.16) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +[2026-09-12 07:43:51] step 2198/5000 loss 0.1740 (w 0.4018 mse 0.4103 t 989 new 0.19) lr 1.00e-05 gnorm 0.113 3.12s mem 81.1GB +[2026-09-12 07:43:54] step 2199/5000 loss 0.2913 (w 0.2626 mse 0.2743 t 935 new 0.17) lr 1.00e-05 gnorm 0.145 3.40s mem 81.1GB +[2026-09-12 07:43:57] step 2200/5000 loss 0.3130 (w 0.4100 mse 0.3889 t 950 new 0.20) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +[2026-09-12 07:44:00] step 2201/5000 loss 0.3236 (w 0.3222 mse 0.3224 t 935 new 0.19) lr 1.00e-05 gnorm 0.133 3.13s mem 81.1GB +[2026-09-12 07:44:03] step 2202/5000 loss 0.2718 (w 0.3030 mse 0.3047 t 874 new 0.19) lr 1.00e-05 gnorm 0.168 3.11s mem 81.1GB +[2026-09-12 07:44:06] step 2203/5000 loss 0.2309 (w 0.2502 mse 0.2532 t 852 new 0.22) lr 1.00e-05 gnorm 0.104 2.83s mem 81.1GB +[2026-09-12 07:44:09] step 2204/5000 loss 0.2795 (w 0.2776 mse 0.2795 t 977 new 0.26) lr 1.00e-05 gnorm 0.116 3.12s mem 81.1GB +[2026-09-12 07:44:13] step 2205/5000 loss 0.3506 (w 0.3218 mse 0.3278 t 695 new 0.24) lr 1.00e-05 gnorm 0.119 3.44s mem 81.1GB +[2026-09-12 07:44:16] step 2206/5000 loss 0.2551 (w 0.2882 mse 0.2828 t 958 new 0.16) lr 1.00e-05 gnorm 0.190 2.84s mem 81.1GB +[2026-09-12 07:44:19] step 2207/5000 loss 0.3074 (w 0.3249 mse 0.3489 t 956 new 0.19) lr 1.00e-05 gnorm 1.146 3.28s mem 81.1GB +[2026-09-12 07:44:22] step 2208/5000 loss 0.2486 (w 0.3036 mse 0.3076 t 946 new 0.24) lr 1.00e-05 gnorm 0.128 3.14s mem 81.1GB +[2026-09-12 07:44:25] step 2209/5000 loss 0.2296 (w 0.3088 mse 0.3139 t 903 new 0.20) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +[2026-09-12 07:44:28] step 2210/5000 loss 0.2350 (w 0.3332 mse 0.3372 t 980 new 0.12) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +[2026-09-12 07:44:31] step 2211/5000 loss 0.3552 (w 0.2602 mse 0.2613 t 860 new 0.10) lr 1.00e-05 gnorm 0.158 3.13s mem 81.1GB +[2026-09-12 07:44:34] step 2212/5000 loss 0.3549 (w 0.2837 mse 0.2805 t 952 new 0.14) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +[2026-09-12 07:44:37] step 2213/5000 loss 0.2858 (w 0.2818 mse 0.2911 t 852 new 0.18) lr 1.00e-05 gnorm 0.123 3.41s mem 81.1GB +[2026-09-12 07:44:40] step 2214/5000 loss 0.2883 (w 0.3275 mse 0.3308 t 988 new 0.15) lr 1.00e-05 gnorm 0.119 3.05s mem 81.1GB +[2026-09-12 07:44:43] step 2215/5000 loss 0.2919 (w 0.2394 mse 0.2524 t 706 new 0.21) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +[2026-09-12 07:44:47] step 2216/5000 loss 0.1204 (w 0.4251 mse 0.4304 t 985 new 0.21) lr 1.00e-05 gnorm 0.159 3.42s mem 81.1GB +[2026-09-12 07:44:50] step 2217/5000 loss 0.2313 (w 0.3262 mse 0.3179 t 917 new 0.12) lr 1.00e-05 gnorm 0.104 3.07s mem 81.1GB +[2026-09-12 07:44:53] step 2218/5000 loss 0.3518 (w 0.2954 mse 0.3112 t 988 new 0.19) lr 1.00e-05 gnorm 0.146 3.04s mem 81.1GB +[2026-09-12 07:44:56] step 2219/5000 loss 0.3493 (w 0.3281 mse 0.3317 t 933 new 0.16) lr 1.00e-05 gnorm 0.145 3.14s mem 81.1GB +[2026-09-12 07:44:59] step 2220/5000 loss 0.4106 (w 0.2305 mse 0.2481 t 976 new 0.25) lr 1.00e-05 gnorm 0.131 3.08s mem 81.1GB +[2026-09-12 07:45:02] step 2221/5000 loss 0.3176 (w 0.3142 mse 0.3134 t 957 new 0.27) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +[2026-09-12 07:45:05] step 2222/5000 loss 0.2337 (w 0.1883 mse 0.2069 t 908 new 0.15) lr 1.00e-05 gnorm 0.141 3.37s mem 81.1GB +[2026-09-12 07:45:08] step 2223/5000 loss 0.2932 (w 0.1662 mse 0.1910 t 692 new 0.21) lr 1.00e-05 gnorm 0.124 3.08s mem 81.1GB +[2026-09-12 07:45:11] step 2224/5000 loss 0.3303 (w 0.5953 mse 0.6065 t 159 new 0.16) lr 1.00e-05 gnorm 0.107 3.07s mem 81.1GB +[2026-09-12 07:45:15] step 2225/5000 loss 0.2081 (w 0.3394 mse 0.3344 t 936 new 0.20) lr 1.00e-05 gnorm 0.139 3.46s mem 81.1GB +[2026-09-12 07:45:18] step 2226/5000 loss 0.3579 (w 0.3697 mse 0.3728 t 980 new 0.24) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +[2026-09-12 07:45:20] step 2227/5000 loss 0.4289 (w 0.1822 mse 0.2044 t 845 new 0.24) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +[2026-09-12 07:45:24] step 2228/5000 loss 0.3010 (w 0.1869 mse 0.2003 t 720 new 0.22) lr 1.00e-05 gnorm 0.153 3.38s mem 81.1GB +[2026-09-12 07:45:27] step 2229/5000 loss 0.2577 (w 0.3817 mse 0.3994 t 336 new 0.19) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +[2026-09-12 07:45:30] step 2230/5000 loss 0.3505 (w 0.2982 mse 0.2945 t 809 new 0.23) lr 1.00e-05 gnorm 0.133 3.09s mem 81.1GB +[2026-09-12 07:45:33] step 2231/5000 loss 0.2777 (w 0.2476 mse 0.2522 t 578 new 0.19) lr 1.00e-05 gnorm 0.130 3.46s mem 81.1GB +[2026-09-12 07:45:36] step 2232/5000 loss 0.1625 (w 0.5664 mse 0.5434 t 989 new 0.17) lr 1.00e-05 gnorm 0.102 2.83s mem 81.1GB +[2026-09-12 07:45:39] step 2233/5000 loss 0.2889 (w 0.3266 mse 0.3246 t 838 new 0.23) lr 1.00e-05 gnorm 0.216 3.07s mem 81.1GB +[2026-09-12 07:45:42] step 2234/5000 loss 0.1586 (w 0.2283 mse 0.2557 t 986 new 0.21) lr 1.00e-05 gnorm 0.116 3.04s mem 81.1GB +[2026-09-12 07:45:45] step 2235/5000 loss 0.3216 (w 0.3803 mse 0.3765 t 926 new 0.20) lr 1.00e-05 gnorm 0.136 3.21s mem 81.1GB +[2026-09-12 07:45:49] step 2236/5000 loss 0.2900 (w 0.1994 mse 0.2157 t 841 new 0.21) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +[2026-09-12 07:45:52] step 2237/5000 loss 0.4899 (w 0.3019 mse 0.3088 t 866 new 0.13) lr 1.00e-05 gnorm 0.153 3.40s mem 81.1GB +[2026-09-12 07:45:55] step 2238/5000 loss 0.1757 (w 0.2626 mse 0.2928 t 996 new 0.20) lr 1.00e-05 gnorm 0.252 2.85s mem 81.1GB +[2026-09-12 07:45:58] step 2239/5000 loss 0.4170 (w 0.1984 mse 0.2032 t 819 new 0.05) lr 1.00e-05 gnorm 0.144 3.12s mem 81.1GB +[2026-09-12 07:46:01] step 2240/5000 loss 0.2441 (w 0.4277 mse 0.4377 t 408 new 0.18) lr 1.00e-05 gnorm 0.122 3.15s mem 81.1GB +[2026-09-12 07:46:04] step 2241/5000 loss 0.2129 (w 0.2505 mse 0.2654 t 887 new 0.22) lr 1.00e-05 gnorm 0.599 2.84s mem 81.1GB +[2026-09-12 07:46:07] step 2242/5000 loss 0.2812 (w 0.2151 mse 0.2157 t 928 new 0.01) lr 1.00e-05 gnorm 0.163 3.10s mem 81.1GB +[2026-09-12 07:46:11] step 2243/5000 loss 0.2320 (w 0.3683 mse 0.3672 t 847 new 0.18) lr 1.00e-05 gnorm 0.173 3.70s mem 81.1GB +[2026-09-12 07:46:14] step 2244/5000 loss 0.4091 (w 0.4235 mse 0.4225 t 379 new 0.22) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +[2026-09-12 07:46:17] step 2245/5000 loss 0.2840 (w 0.3096 mse 0.3252 t 897 new 0.17) lr 1.00e-05 gnorm 0.153 3.14s mem 81.1GB +[2026-09-12 07:46:20] step 2246/5000 loss 0.2767 (w 0.3039 mse 0.2953 t 930 new 0.22) lr 1.00e-05 gnorm 0.219 3.17s mem 81.1GB +[2026-09-12 07:46:23] step 2247/5000 loss 0.3757 (w 0.3543 mse 0.3549 t 918 new 0.11) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +[2026-09-12 07:46:26] step 2248/5000 loss 0.1645 (w 0.2725 mse 0.2793 t 948 new 0.14) lr 1.00e-05 gnorm 0.152 3.33s mem 81.1GB +[2026-09-12 07:46:29] step 2249/5000 loss 0.3469 (w 0.3214 mse 0.3119 t 928 new 0.21) lr 1.00e-05 gnorm 0.151 3.06s mem 81.1GB +[2026-09-12 07:46:32] step 2250/5000 loss 0.2963 (w 0.2871 mse 0.2759 t 886 new 0.18) lr 1.00e-05 gnorm 0.183 2.85s mem 81.1GB +[2026-09-12 07:46:35] step 2251/5000 loss 0.2931 (w 0.2983 mse 0.3127 t 982 new 0.23) lr 1.00e-05 gnorm 0.164 3.06s mem 81.1GB +[2026-09-12 07:46:38] step 2252/5000 loss 0.1510 (w 0.2160 mse 0.2421 t 983 new 0.17) lr 1.00e-05 gnorm 0.132 3.20s mem 81.1GB +[2026-09-12 07:46:41] step 2253/5000 loss 0.2887 (w 0.1830 mse 0.1934 t 628 new 0.11) lr 1.00e-05 gnorm 1.545 2.85s mem 81.1GB +[2026-09-12 07:46:45] step 2254/5000 loss 0.4080 (w 0.3522 mse 0.3576 t 609 new 0.22) lr 1.00e-05 gnorm 0.178 3.33s mem 81.1GB +[2026-09-12 07:46:48] step 2255/5000 loss 0.4384 (w 0.1953 mse 0.2034 t 742 new 0.10) lr 1.00e-05 gnorm 0.161 3.34s mem 81.1GB +[2026-09-12 07:46:51] step 2256/5000 loss 0.4262 (w 0.3343 mse 0.3428 t 978 new 0.24) lr 1.00e-05 gnorm 0.133 3.13s mem 81.1GB +[2026-09-12 07:46:54] step 2257/5000 loss 0.2151 (w 0.3179 mse 0.3331 t 961 new 0.15) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +[2026-09-12 07:46:57] step 2258/5000 loss 0.2150 (w 0.2212 mse 0.2332 t 798 new 0.15) lr 1.00e-05 gnorm 0.200 3.47s mem 81.1GB +[2026-09-12 07:47:01] step 2259/5000 loss 0.4365 (w 0.2478 mse 0.2588 t 824 new 0.25) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +[2026-09-12 07:47:04] step 2260/5000 loss 0.2238 (w 0.3344 mse 0.3313 t 675 new 0.23) lr 1.00e-05 gnorm 0.091 3.14s mem 81.1GB +[2026-09-12 07:47:07] step 2261/5000 loss 0.2402 (w 0.2483 mse 0.2672 t 819 new 0.13) lr 1.00e-05 gnorm 0.091 3.28s mem 81.1GB +[2026-09-12 07:47:10] step 2262/5000 loss 0.3285 (w 0.3157 mse 0.3161 t 819 new 0.28) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +[2026-09-12 07:47:13] step 2263/5000 loss 0.1646 (w 0.2065 mse 0.2130 t 895 new 0.24) lr 1.00e-05 gnorm 0.133 2.85s mem 81.1GB +[2026-09-12 07:47:16] step 2264/5000 loss 0.3456 (w 0.4038 mse 0.4112 t 976 new 0.20) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +[2026-09-12 07:47:19] step 2265/5000 loss 0.3398 (w 0.5256 mse 0.5304 t 997 new 0.22) lr 1.00e-05 gnorm 0.148 3.08s mem 81.1GB +[2026-09-12 07:47:22] step 2266/5000 loss 0.3647 (w 0.4629 mse 0.4695 t 323 new 0.25) lr 1.00e-05 gnorm 0.133 3.22s mem 81.1GB +[2026-09-12 07:47:26] step 2267/5000 loss 0.2595 (w 0.2512 mse 0.2591 t 979 new 0.20) lr 1.00e-05 gnorm 0.097 3.28s mem 81.1GB +[2026-09-12 07:47:29] step 2268/5000 loss 0.3046 (w 0.2542 mse 0.2621 t 884 new 0.20) lr 1.00e-05 gnorm 0.269 3.10s mem 81.1GB +[2026-09-12 07:47:32] step 2269/5000 loss 0.2401 (w 0.3442 mse 0.3417 t 911 new 0.27) lr 1.00e-05 gnorm 0.223 3.05s mem 81.1GB +[2026-09-12 07:47:35] step 2270/5000 loss 0.3878 (w 0.1428 mse 0.1612 t 653 new 0.16) lr 1.00e-05 gnorm 0.354 3.13s mem 81.1GB +[2026-09-12 07:47:38] step 2271/5000 loss 0.3213 (w 0.2845 mse 0.2893 t 876 new 0.22) lr 1.00e-05 gnorm 0.165 3.10s mem 81.1GB +[2026-09-12 07:47:41] step 2272/5000 loss 0.2380 (w 0.3393 mse 0.3309 t 943 new 0.25) lr 1.00e-05 gnorm 0.191 3.26s mem 81.1GB +[2026-09-12 07:47:45] step 2273/5000 loss 0.3893 (w 0.3802 mse 0.3811 t 994 new 0.21) lr 1.00e-05 gnorm 0.157 3.28s mem 81.1GB +[2026-09-12 07:47:48] step 2274/5000 loss 0.2338 (w 0.3076 mse 0.3043 t 883 new 0.21) lr 1.00e-05 gnorm 0.165 3.12s mem 81.1GB +[2026-09-12 07:47:51] step 2275/5000 loss 0.2652 (w 0.1780 mse 0.1983 t 970 new 0.13) lr 1.00e-05 gnorm 0.179 3.08s mem 81.1GB +[2026-09-12 07:47:54] step 2276/5000 loss 0.2154 (w 0.3492 mse 0.3523 t 995 new 0.15) lr 1.00e-05 gnorm 0.190 2.85s mem 81.1GB +[2026-09-12 07:47:57] step 2277/5000 loss 0.3775 (w 0.4169 mse 0.4425 t 340 new 0.23) lr 1.00e-05 gnorm 0.142 3.07s mem 81.1GB +[2026-09-12 07:48:00] step 2278/5000 loss 0.2883 (w 0.3183 mse 0.3246 t 956 new 0.13) lr 1.00e-05 gnorm 0.139 3.22s mem 81.1GB +[2026-09-12 07:48:03] step 2279/5000 loss 0.2438 (w 0.3031 mse 0.2988 t 462 new 0.19) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +[2026-09-12 07:48:06] step 2280/5000 loss 0.3417 (w 0.3469 mse 0.3412 t 749 new 0.20) lr 1.00e-05 gnorm 0.173 3.07s mem 81.1GB +[2026-09-12 07:48:10] step 2281/5000 loss 0.1889 (w 0.5252 mse 0.5355 t 989 new 0.21) lr 1.00e-05 gnorm 0.198 3.11s mem 81.1GB +[2026-09-12 07:48:12] step 2282/5000 loss 0.2047 (w 0.1949 mse 0.1998 t 781 new 0.15) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +[2026-09-12 07:48:16] step 2283/5000 loss 0.4025 (w 0.2367 mse 0.2559 t 937 new 0.21) lr 1.00e-05 gnorm 0.175 3.26s mem 81.1GB +[2026-09-12 07:48:19] step 2284/5000 loss 0.1689 (w 0.3696 mse 0.3714 t 962 new 0.20) lr 1.00e-05 gnorm 0.158 3.28s mem 81.1GB +[2026-09-12 07:48:22] step 2285/5000 loss 0.1750 (w 0.2328 mse 0.2411 t 873 new 0.24) lr 1.00e-05 gnorm 0.171 3.05s mem 81.1GB +[2026-09-12 07:48:25] step 2286/5000 loss 0.5107 (w 0.4463 mse 0.4534 t 319 new 0.15) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +[2026-09-12 07:48:28] step 2287/5000 loss 0.3008 (w 0.4545 mse 0.4564 t 994 new 0.17) lr 1.00e-05 gnorm 0.161 3.14s mem 81.1GB +[2026-09-12 07:48:31] step 2288/5000 loss 0.2879 (w 0.2913 mse 0.2902 t 880 new 0.13) lr 1.00e-05 gnorm 1.331 2.84s mem 81.1GB +[2026-09-12 07:48:34] step 2289/5000 loss 0.4787 (w 0.2686 mse 0.2770 t 950 new 0.20) lr 1.00e-05 gnorm 0.136 3.36s mem 81.1GB +[2026-09-12 07:48:37] step 2290/5000 loss 0.3544 (w 0.3179 mse 0.3411 t 476 new 0.28) lr 1.00e-05 gnorm 0.156 3.06s mem 81.1GB +[2026-09-12 07:48:41] step 2291/5000 loss 0.3905 (w 0.6436 mse 0.6491 t 992 new 0.21) lr 1.00e-05 gnorm 0.143 3.13s mem 81.1GB +[2026-09-12 07:48:43] step 2292/5000 loss 0.2571 (w 0.2013 mse 0.2095 t 845 new 0.23) lr 1.00e-05 gnorm 0.163 2.84s mem 81.1GB +[2026-09-12 07:48:47] step 2293/5000 loss 0.2349 (w 0.3377 mse 0.3452 t 999 new 0.24) lr 1.00e-05 gnorm 0.141 3.36s mem 81.1GB +[2026-09-12 07:48:50] step 2294/5000 loss 0.3150 (w 0.1719 mse 0.1850 t 586 new 0.20) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +[2026-09-12 07:48:53] step 2295/5000 loss 0.2485 (w 0.3116 mse 0.3136 t 954 new 0.23) lr 1.00e-05 gnorm 0.209 3.41s mem 81.1GB +[2026-09-12 07:48:56] step 2296/5000 loss 0.1813 (w 0.4427 mse 0.4452 t 982 new 0.21) lr 1.00e-05 gnorm 0.112 3.07s mem 81.1GB +[2026-09-12 07:48:59] step 2297/5000 loss 0.2156 (w 0.2520 mse 0.2670 t 746 new 0.23) lr 1.00e-05 gnorm 0.099 3.27s mem 81.1GB +[2026-09-12 07:49:02] step 2298/5000 loss 0.3014 (w 0.2687 mse 0.2842 t 902 new 0.25) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +[2026-09-12 07:49:06] step 2299/5000 loss 0.3324 (w 0.1997 mse 0.2242 t 528 new 0.23) lr 1.00e-05 gnorm 0.743 3.43s mem 81.1GB +[2026-09-12 07:49:09] step 2300/5000 loss 0.2360 (w 0.4605 mse 0.4402 t 996 new 0.24) lr 1.00e-05 gnorm 0.149 3.07s mem 81.1GB +[2026-09-12 07:49:12] step 2301/5000 loss 0.2102 (w 0.2426 mse 0.2525 t 898 new 0.12) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +[2026-09-12 07:49:15] step 2302/5000 loss 0.3194 (w 0.3423 mse 0.3404 t 948 new 0.26) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +[2026-09-12 07:49:19] step 2303/5000 loss 0.3970 (w 0.3055 mse 0.3177 t 490 new 0.14) lr 1.00e-05 gnorm 0.100 3.36s mem 81.1GB +[2026-09-12 07:49:21] step 2304/5000 loss 0.5272 (w 0.3073 mse 0.3096 t 516 new 0.12) lr 1.00e-05 gnorm 0.164 2.85s mem 81.1GB +[2026-09-12 07:49:25] step 2305/5000 loss 0.1939 (w 0.2903 mse 0.2860 t 808 new 0.22) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +[2026-09-12 07:49:28] step 2306/5000 loss 0.2950 (w 0.2193 mse 0.2260 t 897 new 0.18) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +[2026-09-12 07:49:31] step 2307/5000 loss 0.2168 (w 0.2774 mse 0.2888 t 958 new 0.19) lr 1.00e-05 gnorm 0.160 3.26s mem 81.1GB +[2026-09-12 07:49:34] step 2308/5000 loss 0.3173 (w 0.2783 mse 0.2737 t 900 new 0.22) lr 1.00e-05 gnorm 0.135 3.33s mem 81.1GB +[2026-09-12 07:49:37] step 2309/5000 loss 0.2060 (w 0.2481 mse 0.2595 t 904 new 0.20) lr 1.00e-05 gnorm 0.105 3.09s mem 81.1GB +[2026-09-12 07:49:40] step 2310/5000 loss 0.2439 (w 0.2592 mse 0.2592 t 568 new 0.16) lr 1.00e-05 gnorm 0.134 2.82s mem 81.1GB +[2026-09-12 07:49:43] step 2311/5000 loss 0.4179 (w 0.2849 mse 0.2971 t 639 new 0.18) lr 1.00e-05 gnorm 0.259 3.11s mem 81.1GB +[2026-09-12 07:49:46] step 2312/5000 loss 0.2901 (w 0.2202 mse 0.2333 t 907 new 0.13) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +[2026-09-12 07:49:50] step 2313/5000 loss 0.3517 (w 0.3191 mse 0.3309 t 960 new 0.22) lr 1.00e-05 gnorm 0.125 3.34s mem 81.1GB +[2026-09-12 07:49:53] step 2314/5000 loss 0.2146 (w 0.3566 mse 0.3524 t 942 new 0.20) lr 1.00e-05 gnorm 0.122 3.29s mem 81.1GB +[2026-09-12 07:49:56] step 2315/5000 loss 0.3140 (w 0.2796 mse 0.2809 t 503 new 0.11) lr 1.00e-05 gnorm 0.156 3.06s mem 81.1GB +[2026-09-12 07:49:59] step 2316/5000 loss 0.1984 (w 0.1882 mse 0.1969 t 698 new 0.17) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +[2026-09-12 07:50:02] step 2317/5000 loss 0.4342 (w 0.3501 mse 0.3536 t 992 new 0.10) lr 1.00e-05 gnorm 0.145 3.07s mem 81.1GB +[2026-09-12 07:50:05] step 2318/5000 loss 0.3688 (w 0.4401 mse 0.4423 t 980 new 0.14) lr 1.00e-05 gnorm 0.160 3.13s mem 81.1GB +[2026-09-12 07:50:09] step 2319/5000 loss 0.2538 (w 0.2616 mse 0.2653 t 922 new 0.21) lr 1.00e-05 gnorm 0.098 3.26s mem 81.1GB +[2026-09-12 07:50:12] step 2320/5000 loss 0.3014 (w 0.2671 mse 0.2722 t 867 new 0.17) lr 1.00e-05 gnorm 0.281 3.11s mem 81.1GB +[2026-09-12 07:50:15] step 2321/5000 loss 0.4212 (w 0.2300 mse 0.2442 t 865 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +[2026-09-12 07:50:18] step 2322/5000 loss 0.1010 (w 0.2598 mse 0.2693 t 967 new 0.21) lr 1.00e-05 gnorm 0.108 3.11s mem 81.1GB +[2026-09-12 07:50:21] step 2323/5000 loss 0.2669 (w 0.3302 mse 0.3414 t 964 new 0.21) lr 1.00e-05 gnorm 1.215 3.07s mem 81.1GB +[2026-09-12 07:50:24] step 2324/5000 loss 0.2950 (w 0.2678 mse 0.2676 t 636 new 0.21) lr 1.00e-05 gnorm 0.144 3.38s mem 81.1GB +[2026-09-12 07:50:28] step 2325/5000 loss 0.1924 (w 0.3620 mse 0.3745 t 979 new 0.20) lr 1.00e-05 gnorm 0.158 3.26s mem 81.1GB +[2026-09-12 07:50:31] step 2326/5000 loss 0.4309 (w 0.1970 mse 0.2030 t 805 new 0.21) lr 1.00e-05 gnorm 0.178 3.43s mem 81.1GB +[2026-09-12 07:50:34] step 2327/5000 loss 0.6088 (w 0.4155 mse 0.4278 t 297 new 0.20) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +[2026-09-12 07:50:37] step 2328/5000 loss 0.2984 (w 0.2849 mse 0.2907 t 930 new 0.16) lr 1.00e-05 gnorm 0.106 3.13s mem 81.1GB +[2026-09-12 07:50:40] step 2329/5000 loss 0.3358 (w 0.2214 mse 0.2396 t 993 new 0.18) lr 1.00e-05 gnorm 0.243 3.08s mem 81.1GB +[2026-09-12 07:50:43] step 2330/5000 loss 0.3024 (w 0.3210 mse 0.3296 t 866 new 0.28) lr 1.00e-05 gnorm 0.129 3.29s mem 81.1GB +[2026-09-12 07:50:47] step 2331/5000 loss 0.2527 (w 0.2441 mse 0.2576 t 860 new 0.22) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +[2026-09-12 07:50:50] step 2332/5000 loss 0.2141 (w 0.2503 mse 0.2524 t 757 new 0.25) lr 1.00e-05 gnorm 0.106 3.37s mem 81.1GB +[2026-09-12 07:50:53] step 2333/5000 loss 0.2599 (w 0.2945 mse 0.3055 t 889 new 0.19) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +[2026-09-12 07:50:56] step 2334/5000 loss 0.3167 (w 0.2755 mse 0.2895 t 508 new 0.24) lr 1.00e-05 gnorm 0.180 3.11s mem 81.1GB +[2026-09-12 07:50:59] step 2335/5000 loss 0.1988 (w 0.2998 mse 0.3036 t 942 new 0.21) lr 1.00e-05 gnorm 0.177 3.06s mem 81.1GB +[2026-09-12 07:51:02] step 2336/5000 loss 0.3126 (w 0.2154 mse 0.2205 t 855 new 0.11) lr 1.00e-05 gnorm 0.122 3.31s mem 81.1GB +[2026-09-12 07:51:06] step 2337/5000 loss 0.2507 (w 0.3833 mse 0.3902 t 974 new 0.21) lr 1.00e-05 gnorm 0.120 3.30s mem 81.1GB +[2026-09-12 07:51:09] step 2338/5000 loss 0.4093 (w 0.1671 mse 0.1781 t 603 new 0.13) lr 1.00e-05 gnorm 0.123 3.41s mem 81.1GB +[2026-09-12 07:51:12] step 2339/5000 loss 0.2158 (w 0.2054 mse 0.2167 t 705 new 0.16) lr 1.00e-05 gnorm 0.157 2.84s mem 81.1GB +[2026-09-12 07:51:15] step 2340/5000 loss 0.2724 (w 0.2701 mse 0.2734 t 953 new 0.26) lr 1.00e-05 gnorm 0.111 3.10s mem 81.1GB +[2026-09-12 07:51:18] step 2341/5000 loss 0.3679 (w 0.2622 mse 0.2670 t 886 new 0.20) lr 1.00e-05 gnorm 0.372 3.06s mem 81.1GB +[2026-09-12 07:51:22] step 2342/5000 loss 0.1738 (w 0.2411 mse 0.2516 t 979 new 0.26) lr 1.00e-05 gnorm 0.101 3.62s mem 81.1GB +[2026-09-12 07:51:25] step 2343/5000 loss 0.2858 (w 0.2339 mse 0.2373 t 873 new 0.19) lr 1.00e-05 gnorm 0.128 3.11s mem 81.1GB +[2026-09-12 07:51:28] step 2344/5000 loss 0.3550 (w 0.2757 mse 0.2885 t 918 new 0.22) lr 1.00e-05 gnorm 0.353 3.13s mem 81.1GB +[2026-09-12 07:51:31] step 2345/5000 loss 0.3502 (w 0.2873 mse 0.2915 t 901 new 0.20) lr 1.00e-05 gnorm 0.193 2.84s mem 81.1GB +[2026-09-12 07:51:34] step 2346/5000 loss 0.1819 (w 0.2501 mse 0.2673 t 893 new 0.22) lr 1.00e-05 gnorm 0.113 3.11s mem 81.1GB +[2026-09-12 07:51:37] step 2347/5000 loss 0.3729 (w 0.3880 mse 0.3899 t 269 new 0.22) lr 1.00e-05 gnorm 0.171 3.07s mem 81.1GB +[2026-09-12 07:51:40] step 2348/5000 loss 0.3534 (w 0.2752 mse 0.2756 t 662 new 0.19) lr 1.00e-05 gnorm 0.152 3.33s mem 81.1GB +[2026-09-12 07:51:43] step 2349/5000 loss 0.2660 (w 0.3114 mse 0.3200 t 925 new 0.18) lr 1.00e-05 gnorm 0.160 3.06s mem 81.1GB +[2026-09-12 07:51:46] step 2350/5000 loss 0.1630 (w 0.3289 mse 0.3343 t 876 new 0.21) lr 1.00e-05 gnorm 0.137 3.14s mem 81.1GB +[2026-09-12 07:51:50] step 2351/5000 loss 0.4017 (w 0.4554 mse 0.4471 t 992 new 0.21) lr 1.00e-05 gnorm 3.602 3.09s mem 81.1GB +[2026-09-12 07:51:52] step 2352/5000 loss 0.2447 (w 0.3994 mse 0.3842 t 895 new 0.22) lr 1.00e-05 gnorm 0.141 2.85s mem 81.1GB +[2026-09-12 07:51:56] step 2353/5000 loss 0.3165 (w 0.1941 mse 0.1997 t 894 new 0.21) lr 1.00e-05 gnorm 0.158 3.34s mem 81.1GB +[2026-09-12 07:51:59] step 2354/5000 loss 0.1729 (w 0.2062 mse 0.2202 t 610 new 0.25) lr 1.00e-05 gnorm 0.121 3.29s mem 81.1GB +[2026-09-12 07:52:02] step 2355/5000 loss 0.4303 (w 0.2669 mse 0.2802 t 672 new 0.24) lr 1.00e-05 gnorm 0.150 3.13s mem 81.1GB +[2026-09-12 07:52:05] step 2356/5000 loss 0.2122 (w 0.3149 mse 0.3113 t 910 new 0.28) lr 1.00e-05 gnorm 0.144 3.13s mem 81.1GB +[2026-09-12 07:52:08] step 2357/5000 loss 0.3617 (w 0.3885 mse 0.3896 t 264 new 0.01) lr 1.00e-05 gnorm 0.111 3.14s mem 81.1GB +[2026-09-12 07:52:11] step 2358/5000 loss 0.1941 (w 0.3603 mse 0.3760 t 996 new 0.23) lr 1.00e-05 gnorm 0.150 2.82s mem 81.1GB +[2026-09-12 07:52:15] step 2359/5000 loss 0.3851 (w 0.3715 mse 0.3845 t 421 new 0.18) lr 1.00e-05 gnorm 0.148 3.40s mem 81.1GB +[2026-09-12 07:52:18] step 2360/5000 loss 0.2715 (w 0.3037 mse 0.3054 t 854 new 0.29) lr 1.00e-05 gnorm 0.116 3.08s mem 81.1GB +[2026-09-12 07:52:21] step 2361/5000 loss 0.2585 (w 0.2551 mse 0.2542 t 726 new 0.09) lr 1.00e-05 gnorm 0.108 3.12s mem 81.1GB +[2026-09-12 07:52:24] step 2362/5000 loss 0.2444 (w 0.3909 mse 0.3987 t 973 new 0.16) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +[2026-09-12 07:52:27] step 2363/5000 loss 0.3544 (w 0.2358 mse 0.2400 t 770 new 0.21) lr 1.00e-05 gnorm 0.140 3.16s mem 81.1GB +[2026-09-12 07:52:30] step 2364/5000 loss 0.3030 (w 0.2085 mse 0.2302 t 894 new 0.23) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +[2026-09-12 07:52:33] step 2365/5000 loss 0.2761 (w 0.4071 mse 0.4130 t 979 new 0.25) lr 1.00e-05 gnorm 0.108 3.37s mem 81.1GB +[2026-09-12 07:52:37] step 2366/5000 loss 0.4413 (w 0.3465 mse 0.3551 t 970 new 0.18) lr 1.00e-05 gnorm 0.161 3.20s mem 81.1GB +[2026-09-12 07:52:40] step 2367/5000 loss 0.2194 (w 0.3068 mse 0.3134 t 925 new 0.10) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +[2026-09-12 07:52:43] step 2368/5000 loss 0.1948 (w 0.3588 mse 0.3496 t 921 new 0.16) lr 1.00e-05 gnorm 0.157 3.14s mem 81.1GB +[2026-09-12 07:52:46] step 2369/5000 loss 0.3751 (w 0.2801 mse 0.2784 t 911 new 0.11) lr 1.00e-05 gnorm 0.199 3.09s mem 81.1GB +[2026-09-12 07:52:49] step 2370/5000 loss 0.3075 (w 0.2741 mse 0.2749 t 895 new 0.22) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +[2026-09-12 07:52:52] step 2371/5000 loss 0.3981 (w 0.2290 mse 0.2402 t 733 new 0.24) lr 1.00e-05 gnorm 0.242 3.35s mem 81.1GB +[2026-09-12 07:52:55] step 2372/5000 loss 0.3246 (w 0.3216 mse 0.3186 t 960 new 0.14) lr 1.00e-05 gnorm 0.161 3.18s mem 81.1GB +[2026-09-12 07:52:58] step 2373/5000 loss 0.4189 (w 0.2857 mse 0.2920 t 905 new 0.19) lr 1.00e-05 gnorm 0.198 3.12s mem 81.1GB +[2026-09-12 07:53:02] step 2374/5000 loss 0.4863 (w 0.4862 mse 0.4917 t 165 new 0.23) lr 1.00e-05 gnorm 0.113 3.11s mem 81.1GB +[2026-09-12 07:53:05] step 2375/5000 loss 0.2350 (w 0.5378 mse 0.5497 t 134 new 0.09) lr 1.00e-05 gnorm 0.141 3.16s mem 81.1GB +[2026-09-12 07:53:08] step 2376/5000 loss 0.2752 (w 0.3698 mse 0.3647 t 980 new 0.23) lr 1.00e-05 gnorm 0.198 2.83s mem 81.1GB +[2026-09-12 07:53:11] step 2377/5000 loss 0.3102 (w 0.2880 mse 0.2964 t 994 new 0.20) lr 1.00e-05 gnorm 0.261 3.33s mem 81.1GB +[2026-09-12 07:53:14] step 2378/5000 loss 0.0891 (w 0.2638 mse 0.2741 t 955 new 0.13) lr 1.00e-05 gnorm 0.182 3.20s mem 81.1GB +[2026-09-12 07:53:17] step 2379/5000 loss 0.4914 (w 0.2763 mse 0.2825 t 882 new 0.23) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +[2026-09-12 07:53:20] step 2380/5000 loss 0.2490 (w 0.3324 mse 0.3449 t 966 new 0.15) lr 1.00e-05 gnorm 0.193 3.34s mem 81.1GB +[2026-09-12 07:53:23] step 2381/5000 loss 0.2918 (w 0.3394 mse 0.3350 t 566 new 0.20) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +[2026-09-12 07:53:26] step 2382/5000 loss 0.3341 (w 0.2663 mse 0.2735 t 940 new 0.20) lr 1.00e-05 gnorm 0.135 2.85s mem 81.1GB +[2026-09-12 07:53:30] step 2383/5000 loss 0.2842 (w 0.3244 mse 0.3137 t 953 new 0.15) lr 1.00e-05 gnorm 0.174 3.39s mem 81.1GB +[2026-09-12 07:53:33] step 2384/5000 loss 0.3509 (w 0.3306 mse 0.3239 t 936 new 0.24) lr 1.00e-05 gnorm 0.153 3.25s mem 81.1GB +[2026-09-12 07:53:36] step 2385/5000 loss 0.3293 (w 0.2970 mse 0.2995 t 708 new 0.24) lr 1.00e-05 gnorm 0.113 3.13s mem 81.1GB +[2026-09-12 07:53:39] step 2386/5000 loss 0.2167 (w 0.3179 mse 0.3187 t 908 new 0.25) lr 1.00e-05 gnorm 0.128 3.36s mem 81.1GB +[2026-09-12 07:53:42] step 2387/5000 loss 0.3832 (w 0.3939 mse 0.4056 t 976 new 0.15) lr 1.00e-05 gnorm 0.155 2.85s mem 81.1GB +[2026-09-12 07:53:45] step 2388/5000 loss 0.2148 (w 0.3282 mse 0.3324 t 975 new 0.18) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 07:53:48] step 2389/5000 loss 0.3316 (w 0.2321 mse 0.2467 t 612 new 0.13) lr 1.00e-05 gnorm 0.172 3.38s mem 81.1GB +[2026-09-12 07:53:51] step 2390/5000 loss 0.2698 (w 0.1959 mse 0.2011 t 884 new 0.06) lr 1.00e-05 gnorm 0.133 3.01s mem 81.1GB +[2026-09-12 07:53:55] step 2391/5000 loss 0.2777 (w 0.3389 mse 0.3427 t 444 new 0.22) lr 1.00e-05 gnorm 0.145 3.30s mem 81.1GB +[2026-09-12 07:53:58] step 2392/5000 loss 0.2883 (w 0.3911 mse 0.3847 t 965 new 0.25) lr 1.00e-05 gnorm 0.173 3.13s mem 81.1GB +[2026-09-12 07:54:01] step 2393/5000 loss 0.3171 (w 0.2927 mse 0.2752 t 885 new 0.22) lr 1.00e-05 gnorm 0.243 2.84s mem 81.1GB +[2026-09-12 07:54:04] step 2394/5000 loss 0.3148 (w 0.2888 mse 0.2945 t 637 new 0.26) lr 1.00e-05 gnorm 0.135 2.83s mem 81.1GB +[2026-09-12 07:54:08] step 2395/5000 loss 0.5081 (w 0.2569 mse 0.2679 t 737 new 0.22) lr 1.00e-05 gnorm 0.128 4.02s mem 81.1GB +[2026-09-12 07:54:11] step 2396/5000 loss 0.1508 (w 0.1768 mse 0.1864 t 869 new 0.09) lr 1.00e-05 gnorm 0.125 3.04s mem 81.1GB +[2026-09-12 07:54:14] step 2397/5000 loss 0.2092 (w 0.2479 mse 0.2450 t 995 new 0.16) lr 1.00e-05 gnorm 0.126 3.43s mem 81.1GB +[2026-09-12 07:54:17] step 2398/5000 loss 0.3479 (w 0.2637 mse 0.2795 t 633 new 0.25) lr 1.00e-05 gnorm 0.117 3.15s mem 81.1GB +[2026-09-12 07:54:20] step 2399/5000 loss 0.1846 (w 0.3369 mse 0.3527 t 919 new 0.23) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +[2026-09-12 07:54:23] step 2400/5000 loss 0.3176 (w 0.2741 mse 0.2771 t 930 new 0.26) lr 1.00e-05 gnorm 0.131 3.16s mem 81.1GB +[2026-09-12 07:54:26] step 2401/5000 loss 0.4157 (w 0.3339 mse 0.3402 t 942 new 0.22) lr 1.00e-05 gnorm 0.261 3.27s mem 81.1GB +[2026-09-12 07:54:30] step 2402/5000 loss 0.2191 (w 0.2773 mse 0.2861 t 996 new 0.20) lr 1.00e-05 gnorm 0.231 3.15s mem 81.1GB +[2026-09-12 07:54:33] step 2403/5000 loss 0.3100 (w 0.2113 mse 0.2189 t 566 new 0.11) lr 1.00e-05 gnorm 0.130 3.16s mem 81.1GB +[2026-09-12 07:54:36] step 2404/5000 loss 0.3380 (w 0.2990 mse 0.3088 t 447 new 0.21) lr 1.00e-05 gnorm 0.135 3.13s mem 81.1GB +[2026-09-12 07:54:39] step 2405/5000 loss 0.2575 (w 0.2731 mse 0.2757 t 826 new 0.21) lr 1.00e-05 gnorm 0.170 2.84s mem 81.1GB +[2026-09-12 07:54:42] step 2406/5000 loss 0.5494 (w 0.2813 mse 0.2831 t 926 new 0.21) lr 1.00e-05 gnorm 1.224 3.04s mem 81.1GB +[2026-09-12 07:54:45] step 2407/5000 loss 0.2389 (w 0.2091 mse 0.2378 t 959 new 0.24) lr 1.00e-05 gnorm 0.183 3.06s mem 81.1GB +[2026-09-12 07:54:48] step 2408/5000 loss 0.1723 (w 0.1682 mse 0.1803 t 650 new 0.08) lr 1.00e-05 gnorm 0.176 3.39s mem 81.1GB +[2026-09-12 07:54:52] step 2409/5000 loss 0.3988 (w 0.2736 mse 0.2797 t 850 new 0.22) lr 1.00e-05 gnorm 0.297 3.08s mem 81.1GB +[2026-09-12 07:54:55] step 2410/5000 loss 0.3442 (w 0.3016 mse 0.2991 t 751 new 0.17) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +[2026-09-12 07:54:57] step 2411/5000 loss 0.4147 (w 0.3375 mse 0.3325 t 813 new 0.25) lr 1.00e-05 gnorm 0.172 2.84s mem 81.1GB +[2026-09-12 07:55:01] step 2412/5000 loss 0.2401 (w 0.2299 mse 0.2263 t 774 new 0.18) lr 1.00e-05 gnorm 0.140 3.06s mem 81.1GB +[2026-09-12 07:55:04] step 2413/5000 loss 0.3036 (w 0.2835 mse 0.2893 t 741 new 0.21) lr 1.00e-05 gnorm 0.120 3.10s mem 81.1GB +[2026-09-12 07:55:08] step 2414/5000 loss 0.2034 (w 0.2192 mse 0.2302 t 932 new 0.18) lr 1.00e-05 gnorm 0.094 4.00s mem 81.1GB +[2026-09-12 07:55:11] step 2415/5000 loss 0.2707 (w 0.2393 mse 0.2757 t 434 new 0.24) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-12 07:55:14] step 2416/5000 loss 0.3532 (w 0.2743 mse 0.2844 t 945 new 0.22) lr 1.00e-05 gnorm 0.132 3.16s mem 81.1GB +[2026-09-12 07:55:17] step 2417/5000 loss 0.3422 (w 0.3800 mse 0.3886 t 989 new 0.22) lr 1.00e-05 gnorm 0.120 2.84s mem 81.1GB +[2026-09-12 07:55:20] step 2418/5000 loss 0.1859 (w 0.2633 mse 0.2844 t 957 new 0.25) lr 1.00e-05 gnorm 0.118 3.39s mem 81.1GB +[2026-09-12 07:55:23] step 2419/5000 loss 0.1744 (w 0.2317 mse 0.2375 t 898 new 0.14) lr 1.00e-05 gnorm 0.170 3.09s mem 81.1GB +[2026-09-12 07:55:27] step 2420/5000 loss 0.2278 (w 0.3810 mse 0.3836 t 981 new 0.23) lr 1.00e-05 gnorm 0.289 3.39s mem 81.1GB +[2026-09-12 07:55:30] step 2421/5000 loss 0.3059 (w 0.4184 mse 0.4013 t 975 new 0.23) lr 1.00e-05 gnorm 0.136 3.15s mem 81.1GB +[2026-09-12 07:55:33] step 2422/5000 loss 0.2526 (w 0.3384 mse 0.3646 t 978 new 0.21) lr 1.00e-05 gnorm 0.484 3.15s mem 81.1GB +[2026-09-12 07:55:36] step 2423/5000 loss 0.1762 (w 0.2864 mse 0.2849 t 650 new 0.16) lr 1.00e-05 gnorm 0.205 2.84s mem 81.1GB +[2026-09-12 07:55:39] step 2424/5000 loss 0.3208 (w 0.2889 mse 0.2904 t 935 new 0.10) lr 1.00e-05 gnorm 0.146 3.15s mem 81.1GB +[2026-09-12 07:55:42] step 2425/5000 loss 0.1221 (w 0.2905 mse 0.3021 t 907 new 0.16) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +[2026-09-12 07:55:45] step 2426/5000 loss 0.1847 (w 0.2569 mse 0.2686 t 798 new 0.21) lr 1.00e-05 gnorm 0.112 3.33s mem 81.1GB +[2026-09-12 07:55:48] step 2427/5000 loss 0.2875 (w 0.2596 mse 0.2734 t 863 new 0.23) lr 1.00e-05 gnorm 0.160 3.11s mem 81.1GB +[2026-09-12 07:55:51] step 2428/5000 loss 0.4774 (w 0.1966 mse 0.2150 t 747 new 0.28) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +[2026-09-12 07:55:54] step 2429/5000 loss 0.3958 (w 0.3493 mse 0.3274 t 939 new 0.23) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +[2026-09-12 07:55:57] step 2430/5000 loss 0.3193 (w 0.3362 mse 0.3381 t 959 new 0.19) lr 1.00e-05 gnorm 0.133 3.13s mem 81.1GB +[2026-09-12 07:56:00] step 2431/5000 loss 0.3186 (w 0.2737 mse 0.2922 t 940 new 0.22) lr 1.00e-05 gnorm 0.143 3.06s mem 81.1GB +[2026-09-12 07:56:04] step 2432/5000 loss 0.2844 (w 0.2172 mse 0.2279 t 886 new 0.21) lr 1.00e-05 gnorm 0.092 3.40s mem 81.1GB +[2026-09-12 07:56:07] step 2433/5000 loss 0.3105 (w 0.1923 mse 0.2007 t 731 new 0.22) lr 1.00e-05 gnorm 0.147 3.15s mem 81.1GB +[2026-09-12 07:56:10] step 2434/5000 loss 0.2544 (w 0.2457 mse 0.2619 t 870 new 0.22) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +[2026-09-12 07:56:13] step 2435/5000 loss 0.3518 (w 0.4132 mse 0.4308 t 306 new 0.23) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-12 07:56:16] step 2436/5000 loss 0.1815 (w 0.3797 mse 0.3954 t 966 new 0.16) lr 1.00e-05 gnorm 0.135 3.32s mem 81.1GB +[2026-09-12 07:56:19] step 2437/5000 loss 0.3628 (w 0.3010 mse 0.3131 t 859 new 0.11) lr 1.00e-05 gnorm 0.226 3.05s mem 81.1GB +[2026-09-12 07:56:22] step 2438/5000 loss 0.3510 (w 0.3048 mse 0.3079 t 892 new 0.21) lr 1.00e-05 gnorm 0.860 3.07s mem 81.1GB +[2026-09-12 07:56:25] step 2439/5000 loss 0.3319 (w 0.3102 mse 0.3185 t 913 new 0.19) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +[2026-09-12 07:56:28] step 2440/5000 loss 0.2474 (w 0.2033 mse 0.2210 t 943 new 0.22) lr 1.00e-05 gnorm 0.131 2.85s mem 81.1GB +[2026-09-12 07:56:31] step 2441/5000 loss 0.4003 (w 0.1961 mse 0.2287 t 969 new 0.21) lr 1.00e-05 gnorm 0.127 3.06s mem 81.1GB +[2026-09-12 07:56:35] step 2442/5000 loss 0.4282 (w 0.2973 mse 0.3140 t 1000 new 0.21) lr 1.00e-05 gnorm 0.156 3.39s mem 81.1GB +[2026-09-12 07:56:38] step 2443/5000 loss 0.2241 (w 0.3802 mse 0.3662 t 961 new 0.20) lr 1.00e-05 gnorm 0.140 3.06s mem 81.1GB +[2026-09-12 07:56:41] step 2444/5000 loss 0.4397 (w 0.2884 mse 0.2937 t 872 new 0.20) lr 1.00e-05 gnorm 0.183 3.08s mem 81.1GB +[2026-09-12 07:56:44] step 2445/5000 loss 0.2676 (w 0.2416 mse 0.2406 t 802 new 0.18) lr 1.00e-05 gnorm 0.165 3.08s mem 81.1GB +[2026-09-12 07:56:47] step 2446/5000 loss 0.3740 (w 0.2929 mse 0.3073 t 896 new 0.19) lr 1.00e-05 gnorm 0.180 2.85s mem 81.1GB +[2026-09-12 07:56:50] step 2447/5000 loss 0.2557 (w 0.3719 mse 0.3641 t 962 new 0.26) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +[2026-09-12 07:56:53] step 2448/5000 loss 0.3826 (w 0.4320 mse 0.4568 t 183 new 0.22) lr 1.00e-05 gnorm 0.112 3.13s mem 81.1GB +[2026-09-12 07:56:56] step 2449/5000 loss 0.2416 (w 0.2438 mse 0.2523 t 862 new 0.22) lr 1.00e-05 gnorm 0.894 3.09s mem 81.1GB +[2026-09-12 07:56:59] step 2450/5000 loss 0.1895 (w 0.2759 mse 0.2855 t 953 new 0.18) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +[2026-09-12 07:57:02] step 2451/5000 loss 0.2897 (w 0.3594 mse 0.3755 t 428 new 0.26) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +[2026-09-12 07:57:05] step 2452/5000 loss 0.3248 (w 0.2411 mse 0.2556 t 670 new 0.22) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +[2026-09-12 07:57:08] step 2453/5000 loss 0.3578 (w 0.2350 mse 0.2604 t 931 new 0.16) lr 1.00e-05 gnorm 0.158 3.05s mem 81.1GB +[2026-09-12 07:57:11] step 2454/5000 loss 0.2538 (w 0.2114 mse 0.2284 t 968 new 0.23) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +[2026-09-12 07:57:15] step 2455/5000 loss 0.4167 (w 0.3897 mse 0.3924 t 390 new 0.21) lr 1.00e-05 gnorm 0.126 3.29s mem 81.1GB +[2026-09-12 07:57:18] step 2456/5000 loss 0.4001 (w 0.2188 mse 0.2414 t 892 new 0.18) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +[2026-09-12 07:57:21] step 2457/5000 loss 0.3336 (w 0.3555 mse 0.3482 t 966 new 0.22) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +[2026-09-12 07:57:24] step 2458/5000 loss 0.3529 (w 0.3015 mse 0.3148 t 562 new 0.19) lr 1.00e-05 gnorm 0.215 2.85s mem 81.1GB +[2026-09-12 07:57:27] step 2459/5000 loss 0.2914 (w 0.2661 mse 0.2726 t 663 new 0.24) lr 1.00e-05 gnorm 0.620 3.12s mem 81.1GB +[2026-09-12 07:57:30] step 2460/5000 loss 0.1613 (w 0.3375 mse 0.3438 t 936 new 0.07) lr 1.00e-05 gnorm 0.194 3.15s mem 81.1GB +[2026-09-12 07:57:33] step 2461/5000 loss 0.2207 (w 0.3339 mse 0.3296 t 980 new 0.18) lr 1.00e-05 gnorm 0.106 3.27s mem 81.1GB +[2026-09-12 07:57:36] step 2462/5000 loss 0.2228 (w 0.1902 mse 0.2061 t 967 new 0.09) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +[2026-09-12 07:57:39] step 2463/5000 loss 0.2739 (w 0.2349 mse 0.2454 t 570 new 0.20) lr 1.00e-05 gnorm 0.111 3.10s mem 81.1GB +[2026-09-12 07:57:42] step 2464/5000 loss 0.1579 (w 0.3200 mse 0.3183 t 979 new 0.21) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +[2026-09-12 07:57:45] step 2465/5000 loss 0.4265 (w 0.4597 mse 0.4613 t 249 new 0.17) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +[2026-09-12 07:57:48] step 2466/5000 loss 0.2147 (w 0.2902 mse 0.2891 t 731 new 0.24) lr 1.00e-05 gnorm 0.362 3.20s mem 81.1GB +[2026-09-12 07:57:51] step 2467/5000 loss 0.1423 (w 0.2715 mse 0.2703 t 927 new 0.23) lr 1.00e-05 gnorm 0.110 3.11s mem 81.1GB +[2026-09-12 07:57:54] step 2468/5000 loss 0.1863 (w 0.4448 mse 0.4351 t 988 new 0.21) lr 1.00e-05 gnorm 0.279 2.84s mem 81.1GB +[2026-09-12 07:57:57] step 2469/5000 loss 0.3419 (w 0.2417 mse 0.2490 t 790 new 0.16) lr 1.00e-05 gnorm 0.201 3.16s mem 81.1GB +[2026-09-12 07:58:01] step 2470/5000 loss 0.3800 (w 0.4411 mse 0.4495 t 323 new 0.22) lr 1.00e-05 gnorm 0.218 3.16s mem 81.1GB +[2026-09-12 07:58:04] step 2471/5000 loss 0.2693 (w 0.3693 mse 0.3845 t 942 new 0.17) lr 1.00e-05 gnorm 0.121 3.30s mem 81.1GB +[2026-09-12 07:58:07] step 2472/5000 loss 0.1791 (w 0.2470 mse 0.2628 t 841 new 0.21) lr 1.00e-05 gnorm 0.093 3.30s mem 81.1GB +[2026-09-12 07:58:11] step 2473/5000 loss 0.4008 (w 0.2747 mse 0.2780 t 730 new 0.23) lr 1.00e-05 gnorm 0.123 3.65s mem 81.1GB +[2026-09-12 07:58:14] step 2474/5000 loss 0.2979 (w 0.3212 mse 0.3178 t 993 new 0.23) lr 1.00e-05 gnorm 0.122 3.11s mem 81.1GB +[2026-09-12 07:58:17] step 2475/5000 loss 0.2223 (w 0.3389 mse 0.3278 t 920 new 0.23) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +[2026-09-12 07:58:20] step 2476/5000 loss 0.5211 (w 0.3197 mse 0.3204 t 959 new 0.19) lr 1.00e-05 gnorm 0.165 3.08s mem 81.1GB +[2026-09-12 07:58:23] step 2477/5000 loss 0.2321 (w 0.2442 mse 0.2549 t 840 new 0.26) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +[2026-09-12 07:58:26] step 2478/5000 loss 0.2906 (w 0.3163 mse 0.3178 t 982 new 0.10) lr 1.00e-05 gnorm 0.173 3.06s mem 81.1GB +[2026-09-12 07:58:29] step 2479/5000 loss 0.1408 (w 0.2536 mse 0.2658 t 912 new 0.19) lr 1.00e-05 gnorm 0.484 3.08s mem 81.1GB +[2026-09-12 07:58:32] step 2480/5000 loss 0.3760 (w 0.2063 mse 0.2293 t 825 new 0.16) lr 1.00e-05 gnorm 0.120 3.16s mem 81.1GB +[2026-09-12 07:58:35] step 2481/5000 loss 0.5502 (w 0.1935 mse 0.2006 t 751 new 0.11) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +[2026-09-12 07:58:38] step 2482/5000 loss 0.5333 (w 0.2804 mse 0.2833 t 776 new 0.24) lr 1.00e-05 gnorm 0.195 3.06s mem 81.1GB +[2026-09-12 07:58:41] step 2483/5000 loss 0.3277 (w 0.2348 mse 0.2370 t 737 new 0.10) lr 1.00e-05 gnorm 0.133 3.12s mem 81.1GB +[2026-09-12 07:58:44] step 2484/5000 loss 0.3368 (w 0.2659 mse 0.2760 t 924 new 0.23) lr 1.00e-05 gnorm 0.181 3.06s mem 81.1GB +[2026-09-12 07:58:48] step 2485/5000 loss 0.1881 (w 0.2379 mse 0.2305 t 901 new 0.22) lr 1.00e-05 gnorm 0.265 3.10s mem 81.1GB +[2026-09-12 07:58:51] step 2486/5000 loss 0.3104 (w 0.3082 mse 0.3186 t 942 new 0.25) lr 1.00e-05 gnorm 0.105 3.14s mem 81.1GB +[2026-09-12 07:58:54] step 2487/5000 loss 0.3254 (w 0.2527 mse 0.2603 t 933 new 0.24) lr 1.00e-05 gnorm 0.235 2.85s mem 81.1GB +[2026-09-12 07:58:57] step 2488/5000 loss 0.2327 (w 0.2132 mse 0.2331 t 881 new 0.23) lr 1.00e-05 gnorm 0.132 3.12s mem 81.1GB +[2026-09-12 07:59:00] step 2489/5000 loss 0.4827 (w 0.3582 mse 0.3695 t 447 new 0.20) lr 1.00e-05 gnorm 0.243 3.25s mem 81.1GB +[2026-09-12 07:59:03] step 2490/5000 loss 0.3554 (w 0.2100 mse 0.2236 t 733 new 0.09) lr 1.00e-05 gnorm 0.186 3.11s mem 81.1GB +[2026-09-12 07:59:06] step 2491/5000 loss 0.2534 (w 0.3190 mse 0.3182 t 931 new 0.20) lr 1.00e-05 gnorm 0.148 3.34s mem 81.1GB +[2026-09-12 07:59:09] step 2492/5000 loss 0.2774 (w 0.3559 mse 0.3607 t 513 new 0.23) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-12 07:59:12] step 2493/5000 loss 0.2516 (w 0.2817 mse 0.2812 t 923 new 0.20) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-12 07:59:15] step 2494/5000 loss 0.1711 (w 0.3011 mse 0.3099 t 931 new 0.26) lr 1.00e-05 gnorm 0.123 3.27s mem 81.1GB +[2026-09-12 07:59:19] step 2495/5000 loss 0.3462 (w 0.3312 mse 0.3456 t 964 new 0.25) lr 1.00e-05 gnorm 0.159 3.34s mem 81.1GB +[2026-09-12 07:59:22] step 2496/5000 loss 0.3277 (w 0.2998 mse 0.3031 t 795 new 0.19) lr 1.00e-05 gnorm 0.257 3.34s mem 81.1GB +[2026-09-12 07:59:25] step 2497/5000 loss 0.3267 (w 0.2090 mse 0.2216 t 946 new 0.17) lr 1.00e-05 gnorm 0.302 3.35s mem 81.1GB +[2026-09-12 07:59:28] step 2498/5000 loss 0.2983 (w 0.3174 mse 0.3141 t 918 new 0.17) lr 1.00e-05 gnorm 0.193 2.85s mem 81.1GB +[2026-09-12 07:59:31] step 2499/5000 loss 0.1935 (w 0.2531 mse 0.2624 t 931 new 0.13) lr 1.00e-05 gnorm 0.133 2.85s mem 81.1GB +[2026-09-12 07:59:34] step 2500/5000 loss 0.2282 (w 0.3200 mse 0.3296 t 904 new 0.13) lr 1.00e-05 gnorm 0.291 3.10s mem 81.1GB +[2026-09-12 07:59:36] [val] step 2500 t=200: w=0.4640 mse=0.4822 (n=16) t=500: w=0.2820 mse=0.2969 (n=16) t=800: w=0.2377 mse=0.2497 (n=16) | mean w=0.3279 mse=0.3429 2s +[2026-09-12 08:00:26] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step2500.safetensors 4093 个张量 37.98 GB +[2026-09-12 08:00:31] step 2501/5000 loss 0.3213 (w 0.3149 mse 0.3239 t 895 new 0.20) lr 1.00e-05 gnorm 0.173 3.17s mem 81.1GB +[2026-09-12 08:00:34] step 2502/5000 loss 0.1573 (w 0.3169 mse 0.3364 t 969 new 0.21) lr 1.00e-05 gnorm 0.112 3.10s mem 81.1GB +[2026-09-12 08:00:38] step 2503/5000 loss 0.2466 (w 0.3702 mse 0.3686 t 397 new 0.20) lr 1.00e-05 gnorm 0.125 3.39s mem 81.1GB +[2026-09-12 08:00:40] step 2504/5000 loss 0.1705 (w 0.3161 mse 0.3120 t 968 new 0.22) lr 1.00e-05 gnorm 0.092 2.83s mem 81.1GB +[2026-09-12 08:00:44] step 2505/5000 loss 0.2375 (w 0.3151 mse 0.3178 t 939 new 0.22) lr 1.00e-05 gnorm 0.127 3.18s mem 81.1GB +[2026-09-12 08:00:47] step 2506/5000 loss 0.1705 (w 0.4059 mse 0.3898 t 979 new 0.17) lr 1.00e-05 gnorm 0.113 3.34s mem 81.1GB +[2026-09-12 08:00:50] step 2507/5000 loss 0.3372 (w 0.2510 mse 0.2537 t 774 new 0.08) lr 1.00e-05 gnorm 0.158 3.44s mem 81.1GB +[2026-09-12 08:00:53] step 2508/5000 loss 0.3502 (w 0.2265 mse 0.2327 t 513 new 0.14) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +[2026-09-12 08:00:57] step 2509/5000 loss 0.2093 (w 0.2749 mse 0.2805 t 906 new 0.14) lr 1.00e-05 gnorm 0.270 3.44s mem 81.1GB +[2026-09-12 08:01:00] step 2510/5000 loss 0.3369 (w 0.3502 mse 0.3419 t 856 new 0.15) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +[2026-09-12 08:01:03] step 2511/5000 loss 0.2802 (w 0.2696 mse 0.2840 t 996 new 0.22) lr 1.00e-05 gnorm 0.261 3.11s mem 81.1GB +[2026-09-12 08:01:06] step 2512/5000 loss 0.4110 (w 0.3058 mse 0.3200 t 977 new 0.19) lr 1.00e-05 gnorm 0.126 3.29s mem 81.1GB +[2026-09-12 08:01:10] step 2513/5000 loss 0.2042 (w 0.3371 mse 0.3466 t 966 new 0.22) lr 1.00e-05 gnorm 0.103 3.71s mem 81.1GB +[2026-09-12 08:01:13] step 2514/5000 loss 0.3746 (w 0.4315 mse 0.4340 t 254 new 0.12) lr 1.00e-05 gnorm 0.100 3.13s mem 81.1GB +[2026-09-12 08:01:16] step 2515/5000 loss 0.3743 (w 0.4202 mse 0.4206 t 967 new 0.15) lr 1.00e-05 gnorm 0.132 3.17s mem 81.1GB +[2026-09-12 08:01:19] step 2516/5000 loss 0.3395 (w 0.2909 mse 0.3078 t 944 new 0.22) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-12 08:01:22] step 2517/5000 loss 0.4297 (w 0.2945 mse 0.3094 t 557 new 0.23) lr 1.00e-05 gnorm 0.146 3.05s mem 81.1GB +[2026-09-12 08:01:25] step 2518/5000 loss 0.3330 (w 0.3928 mse 0.4053 t 283 new 0.19) lr 1.00e-05 gnorm 0.107 3.08s mem 81.1GB +[2026-09-12 08:01:28] step 2519/5000 loss 0.2881 (w 0.2255 mse 0.2482 t 981 new 0.17) lr 1.00e-05 gnorm 0.102 3.32s mem 81.1GB +[2026-09-12 08:01:31] step 2520/5000 loss 0.1769 (w 0.2844 mse 0.2893 t 849 new 0.15) lr 1.00e-05 gnorm 0.255 3.07s mem 81.1GB +[2026-09-12 08:01:34] step 2521/5000 loss 0.2492 (w 0.1979 mse 0.2097 t 804 new 0.10) lr 1.00e-05 gnorm 0.303 3.09s mem 81.1GB +[2026-09-12 08:01:37] step 2522/5000 loss 0.3668 (w 0.2633 mse 0.2819 t 835 new 0.23) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +[2026-09-12 08:01:40] step 2523/5000 loss 0.1815 (w 0.2399 mse 0.2476 t 849 new 0.21) lr 1.00e-05 gnorm 0.087 3.14s mem 81.1GB +[2026-09-12 08:01:44] step 2524/5000 loss 0.2119 (w 0.3219 mse 0.3144 t 926 new 0.22) lr 1.00e-05 gnorm 0.192 3.35s mem 81.1GB +[2026-09-12 08:01:47] step 2525/5000 loss 0.4477 (w 0.1670 mse 0.1806 t 881 new 0.24) lr 1.00e-05 gnorm 0.170 3.39s mem 81.1GB +[2026-09-12 08:01:50] step 2526/5000 loss 0.2387 (w 0.2009 mse 0.2089 t 917 new 0.21) lr 1.00e-05 gnorm 0.204 3.10s mem 81.1GB +[2026-09-12 08:01:53] step 2527/5000 loss 0.3035 (w 0.4038 mse 0.4140 t 292 new 0.24) lr 1.00e-05 gnorm 0.112 3.16s mem 81.1GB +[2026-09-12 08:01:56] step 2528/5000 loss 0.2981 (w 0.1687 mse 0.1821 t 914 new 0.18) lr 1.00e-05 gnorm 0.143 3.07s mem 81.1GB +[2026-09-12 08:02:00] step 2529/5000 loss 0.3275 (w 0.4070 mse 0.4177 t 1000 new 0.16) lr 1.00e-05 gnorm 0.188 3.03s mem 81.1GB +[2026-09-12 08:02:03] step 2530/5000 loss 0.1202 (w 0.2310 mse 0.2432 t 977 new 0.20) lr 1.00e-05 gnorm 0.115 3.38s mem 81.1GB +[2026-09-12 08:02:06] step 2531/5000 loss 0.3523 (w 0.2742 mse 0.2788 t 737 new 0.18) lr 1.00e-05 gnorm 0.143 3.02s mem 81.1GB +[2026-09-12 08:02:09] step 2532/5000 loss 0.3066 (w 0.3036 mse 0.3047 t 758 new 0.15) lr 1.00e-05 gnorm 0.112 3.43s mem 81.1GB +[2026-09-12 08:02:12] step 2533/5000 loss 0.3017 (w 0.3135 mse 0.3117 t 759 new 0.24) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-12 08:02:15] step 2534/5000 loss 0.1992 (w 0.3122 mse 0.3121 t 883 new 0.23) lr 1.00e-05 gnorm 0.104 3.05s mem 81.1GB +[2026-09-12 08:02:18] step 2535/5000 loss 0.1862 (w 0.2088 mse 0.2257 t 668 new 0.19) lr 1.00e-05 gnorm 0.143 3.02s mem 81.1GB +[2026-09-12 08:02:22] step 2536/5000 loss 0.2084 (w 0.2919 mse 0.3011 t 950 new 0.08) lr 1.00e-05 gnorm 0.172 3.43s mem 81.1GB +[2026-09-12 08:02:25] step 2537/5000 loss 0.3591 (w 0.2971 mse 0.2983 t 937 new 0.28) lr 1.00e-05 gnorm 0.158 3.05s mem 81.1GB +[2026-09-12 08:02:28] step 2538/5000 loss 0.2361 (w 0.2614 mse 0.2770 t 940 new 0.13) lr 1.00e-05 gnorm 0.183 3.37s mem 81.1GB +[2026-09-12 08:02:31] step 2539/5000 loss 0.1263 (w 0.3120 mse 0.3200 t 944 new 0.15) lr 1.00e-05 gnorm 0.108 2.83s mem 81.1GB +[2026-09-12 08:02:34] step 2540/5000 loss 0.3727 (w 0.6101 mse 0.6228 t 107 new 0.21) lr 1.00e-05 gnorm 0.195 3.10s mem 81.1GB +[2026-09-12 08:02:37] step 2541/5000 loss 0.3838 (w 0.4151 mse 0.4202 t 269 new 0.25) lr 1.00e-05 gnorm 0.295 3.05s mem 81.1GB +[2026-09-12 08:02:41] step 2542/5000 loss 0.1380 (w 0.4578 mse 0.4452 t 990 new 0.20) lr 1.00e-05 gnorm 0.136 3.38s mem 81.1GB +[2026-09-12 08:02:43] step 2543/5000 loss 0.2288 (w 0.2214 mse 0.2467 t 961 new 0.23) lr 1.00e-05 gnorm 0.149 2.83s mem 81.1GB +[2026-09-12 08:02:47] step 2544/5000 loss 0.2259 (w 0.2025 mse 0.2031 t 945 new 0.19) lr 1.00e-05 gnorm 0.151 3.13s mem 81.1GB +[2026-09-12 08:02:49] step 2545/5000 loss 0.2240 (w 0.3350 mse 0.3412 t 965 new 0.08) lr 1.00e-05 gnorm 0.410 2.83s mem 81.1GB +[2026-09-12 08:02:52] step 2546/5000 loss 0.3035 (w 0.3398 mse 0.3537 t 636 new 0.15) lr 1.00e-05 gnorm 0.110 3.02s mem 81.1GB +[2026-09-12 08:02:56] step 2547/5000 loss 0.3865 (w 0.2095 mse 0.2141 t 799 new 0.23) lr 1.00e-05 gnorm 0.249 3.10s mem 81.1GB +[2026-09-12 08:02:59] step 2548/5000 loss 0.1981 (w 0.2502 mse 0.2540 t 914 new 0.24) lr 1.00e-05 gnorm 0.099 3.37s mem 81.1GB +[2026-09-12 08:03:02] step 2549/5000 loss 0.2816 (w 0.4659 mse 0.4883 t 233 new 0.22) lr 1.00e-05 gnorm 0.208 2.84s mem 81.1GB +[2026-09-12 08:03:05] step 2550/5000 loss 0.1578 (w 0.3146 mse 0.3134 t 934 new 0.15) lr 1.00e-05 gnorm 0.158 3.15s mem 81.1GB +[2026-09-12 08:03:08] step 2551/5000 loss 0.2678 (w 0.3563 mse 0.3579 t 621 new 0.06) lr 1.00e-05 gnorm 0.124 3.27s mem 81.1GB +[2026-09-12 08:03:11] step 2552/5000 loss 0.3516 (w 0.3736 mse 0.3889 t 983 new 0.20) lr 1.00e-05 gnorm 0.117 3.03s mem 81.1GB +[2026-09-12 08:03:14] step 2553/5000 loss 0.2579 (w 0.2366 mse 0.2531 t 942 new 0.11) lr 1.00e-05 gnorm 0.131 3.10s mem 81.1GB +[2026-09-12 08:03:18] step 2554/5000 loss 0.1793 (w 0.2623 mse 0.2604 t 962 new 0.25) lr 1.00e-05 gnorm 0.308 3.27s mem 81.1GB +[2026-09-12 08:03:21] step 2555/5000 loss 0.3179 (w 0.5949 mse 0.6086 t 183 new 0.28) lr 1.00e-05 gnorm 0.151 3.15s mem 81.1GB +[2026-09-12 08:03:24] step 2556/5000 loss 0.2313 (w 0.3146 mse 0.3176 t 913 new 0.21) lr 1.00e-05 gnorm 0.127 3.14s mem 81.1GB +[2026-09-12 08:03:27] step 2557/5000 loss 0.3806 (w 0.2689 mse 0.2601 t 860 new 0.23) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +[2026-09-12 08:03:30] step 2558/5000 loss 0.2601 (w 0.3175 mse 0.3373 t 712 new 0.18) lr 1.00e-05 gnorm 0.158 3.08s mem 81.1GB +[2026-09-12 08:03:33] step 2559/5000 loss 0.3798 (w 0.3394 mse 0.3413 t 269 new 0.26) lr 1.00e-05 gnorm 0.136 3.23s mem 81.1GB +[2026-09-12 08:03:36] step 2560/5000 loss 0.2572 (w 0.3677 mse 0.3705 t 996 new 0.22) lr 1.00e-05 gnorm 0.298 3.30s mem 81.1GB +[2026-09-12 08:03:40] step 2561/5000 loss 0.2190 (w 0.3225 mse 0.3190 t 922 new 0.19) lr 1.00e-05 gnorm 0.129 3.14s mem 81.1GB +[2026-09-12 08:03:42] step 2562/5000 loss 0.3238 (w 0.4775 mse 0.4846 t 368 new 0.20) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +[2026-09-12 08:03:45] step 2563/5000 loss 0.2589 (w 0.2576 mse 0.2480 t 954 new 0.12) lr 1.00e-05 gnorm 0.170 3.05s mem 81.1GB +[2026-09-12 08:03:48] step 2564/5000 loss 0.2676 (w 0.2555 mse 0.2541 t 862 new 0.10) lr 1.00e-05 gnorm 0.127 2.85s mem 81.1GB +[2026-09-12 08:03:52] step 2565/5000 loss 0.2166 (w 0.3393 mse 0.3365 t 794 new 0.16) lr 1.00e-05 gnorm 0.300 3.28s mem 81.1GB +[2026-09-12 08:03:55] step 2566/5000 loss 0.3622 (w 0.2884 mse 0.3009 t 779 new 0.22) lr 1.00e-05 gnorm 0.158 3.07s mem 81.1GB +[2026-09-12 08:03:58] step 2567/5000 loss 0.2299 (w 0.2455 mse 0.2493 t 938 new 0.24) lr 1.00e-05 gnorm 0.126 3.15s mem 81.1GB +[2026-09-12 08:04:01] step 2568/5000 loss 0.1980 (w 0.4400 mse 0.4483 t 990 new 0.29) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +[2026-09-12 08:04:04] step 2569/5000 loss 0.2718 (w 0.2407 mse 0.2433 t 884 new 0.16) lr 1.00e-05 gnorm 0.155 3.07s mem 81.1GB +[2026-09-12 08:04:07] step 2570/5000 loss 0.2704 (w 0.1970 mse 0.2129 t 487 new 0.15) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +[2026-09-12 08:04:10] step 2571/5000 loss 0.3824 (w 0.2750 mse 0.2949 t 462 new 0.26) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +[2026-09-12 08:04:13] step 2572/5000 loss 0.2298 (w 0.1723 mse 0.1993 t 926 new 0.24) lr 1.00e-05 gnorm 0.108 3.09s mem 81.1GB +[2026-09-12 08:04:16] step 2573/5000 loss 0.3545 (w 0.2498 mse 0.2519 t 905 new 0.24) lr 1.00e-05 gnorm 0.124 3.17s mem 81.1GB +[2026-09-12 08:04:19] step 2574/5000 loss 0.0661 (w 0.3638 mse 0.3452 t 989 new 0.17) lr 1.00e-05 gnorm 0.221 2.83s mem 81.1GB +[2026-09-12 08:04:22] step 2575/5000 loss 0.4848 (w 0.2825 mse 0.2869 t 386 new 0.14) lr 1.00e-05 gnorm 0.155 3.21s mem 81.1GB +[2026-09-12 08:04:25] step 2576/5000 loss 0.3228 (w 0.2645 mse 0.2662 t 484 new 0.10) lr 1.00e-05 gnorm 0.110 3.07s mem 81.1GB +[2026-09-12 08:04:28] step 2577/5000 loss 0.1600 (w 0.3070 mse 0.3109 t 942 new 0.24) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +[2026-09-12 08:04:31] step 2578/5000 loss 0.1878 (w 0.2923 mse 0.2952 t 828 new 0.22) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +[2026-09-12 08:04:35] step 2579/5000 loss 0.1138 (w 0.4135 mse 0.4040 t 989 new 0.21) lr 1.00e-05 gnorm 0.120 3.66s mem 81.1GB +[2026-09-12 08:04:38] step 2580/5000 loss 0.3342 (w 0.2208 mse 0.2399 t 740 new 0.20) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +[2026-09-12 08:04:41] step 2581/5000 loss 0.4550 (w 0.2322 mse 0.2373 t 710 new 0.11) lr 1.00e-05 gnorm 0.138 3.19s mem 81.1GB +[2026-09-12 08:04:44] step 2582/5000 loss 0.3458 (w 0.2678 mse 0.2754 t 882 new 0.23) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +[2026-09-12 08:04:47] step 2583/5000 loss 0.3568 (w 0.2243 mse 0.2327 t 855 new 0.22) lr 1.00e-05 gnorm 0.129 3.21s mem 81.1GB +[2026-09-12 08:04:50] step 2584/5000 loss 0.1533 (w 0.2673 mse 0.2700 t 946 new 0.12) lr 1.00e-05 gnorm 0.198 3.07s mem 81.1GB +[2026-09-12 08:04:54] step 2585/5000 loss 0.3890 (w 0.2056 mse 0.2177 t 868 new 0.22) lr 1.00e-05 gnorm 0.148 3.28s mem 81.1GB +[2026-09-12 08:04:57] step 2586/5000 loss 0.1653 (w 0.3039 mse 0.3049 t 711 new 0.22) lr 1.00e-05 gnorm 0.087 2.83s mem 81.1GB +[2026-09-12 08:05:00] step 2587/5000 loss 0.2064 (w 0.1578 mse 0.1741 t 864 new 0.23) lr 1.00e-05 gnorm 0.141 3.14s mem 81.1GB +[2026-09-12 08:05:03] step 2588/5000 loss 0.3489 (w 0.3357 mse 0.3363 t 557 new 0.15) lr 1.00e-05 gnorm 0.135 3.10s mem 81.1GB +[2026-09-12 08:05:06] step 2589/5000 loss 0.2963 (w 0.3296 mse 0.3287 t 754 new 0.21) lr 1.00e-05 gnorm 0.206 3.30s mem 81.1GB +[2026-09-12 08:05:09] step 2590/5000 loss 0.3447 (w 0.3393 mse 0.3481 t 998 new 0.24) lr 1.00e-05 gnorm 0.163 3.10s mem 81.1GB +[2026-09-12 08:05:13] step 2591/5000 loss 0.1065 (w 0.2509 mse 0.2513 t 976 new 0.21) lr 1.00e-05 gnorm 0.210 3.37s mem 81.1GB +[2026-09-12 08:05:15] step 2592/5000 loss 0.2804 (w 0.2744 mse 0.2819 t 915 new 0.19) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +[2026-09-12 08:05:19] step 2593/5000 loss 0.4115 (w 0.2665 mse 0.2756 t 969 new 0.18) lr 1.00e-05 gnorm 0.132 3.11s mem 81.1GB +[2026-09-12 08:05:22] step 2594/5000 loss 0.2309 (w 0.2649 mse 0.2746 t 562 new 0.24) lr 1.00e-05 gnorm 0.110 3.12s mem 81.1GB +[2026-09-12 08:05:25] step 2595/5000 loss 0.2700 (w 0.2233 mse 0.2212 t 853 new 0.17) lr 1.00e-05 gnorm 0.112 3.17s mem 81.1GB +[2026-09-12 08:05:28] step 2596/5000 loss 0.2650 (w 0.4488 mse 0.4639 t 960 new 0.27) lr 1.00e-05 gnorm 0.263 3.12s mem 81.1GB +[2026-09-12 08:05:31] step 2597/5000 loss 0.4295 (w 0.2873 mse 0.2914 t 943 new 0.17) lr 1.00e-05 gnorm 0.117 3.12s mem 81.1GB +[2026-09-12 08:05:34] step 2598/5000 loss 0.3515 (w 0.2484 mse 0.2733 t 970 new 0.12) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +[2026-09-12 08:05:37] step 2599/5000 loss 0.2041 (w 0.2668 mse 0.2858 t 979 new 0.26) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +[2026-09-12 08:05:41] step 2600/5000 loss 0.3045 (w 0.2245 mse 0.2347 t 578 new 0.09) lr 1.00e-05 gnorm 0.134 3.52s mem 81.1GB +[2026-09-12 08:05:44] step 2601/5000 loss 0.3040 (w 0.2709 mse 0.2691 t 899 new 0.20) lr 1.00e-05 gnorm 0.126 3.26s mem 81.1GB +[2026-09-12 08:05:47] step 2602/5000 loss 0.2580 (w 0.2654 mse 0.3017 t 948 new 0.18) lr 1.00e-05 gnorm 0.151 3.26s mem 81.1GB +[2026-09-12 08:05:50] step 2603/5000 loss 0.3035 (w 0.3135 mse 0.3186 t 864 new 0.19) lr 1.00e-05 gnorm 0.183 3.14s mem 81.1GB +[2026-09-12 08:05:53] step 2604/5000 loss 0.1032 (w 0.2592 mse 0.2657 t 855 new 0.20) lr 1.00e-05 gnorm 0.106 2.84s mem 81.1GB +[2026-09-12 08:05:56] step 2605/5000 loss 0.1850 (w 0.2675 mse 0.2678 t 700 new 0.19) lr 1.00e-05 gnorm 0.112 3.07s mem 81.1GB +[2026-09-12 08:05:59] step 2606/5000 loss 0.2749 (w 0.2558 mse 0.2662 t 730 new 0.24) lr 1.00e-05 gnorm 0.103 3.32s mem 81.1GB +[2026-09-12 08:06:03] step 2607/5000 loss 0.2809 (w 0.2252 mse 0.2327 t 948 new 0.21) lr 1.00e-05 gnorm 0.129 3.36s mem 81.1GB +[2026-09-12 08:06:06] step 2608/5000 loss 0.1390 (w 0.3151 mse 0.3218 t 955 new 0.24) lr 1.00e-05 gnorm 0.150 3.29s mem 81.1GB +[2026-09-12 08:06:09] step 2609/5000 loss 0.2182 (w 0.5385 mse 0.5159 t 988 new 0.26) lr 1.00e-05 gnorm 0.136 3.13s mem 81.1GB +[2026-09-12 08:06:12] step 2610/5000 loss 0.2893 (w 0.2175 mse 0.2322 t 815 new 0.22) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +[2026-09-12 08:06:15] step 2611/5000 loss 0.2433 (w 0.2731 mse 0.2765 t 670 new 0.20) lr 1.00e-05 gnorm 0.108 3.06s mem 81.1GB +[2026-09-12 08:06:19] step 2612/5000 loss 0.3367 (w 0.2362 mse 0.2508 t 903 new 0.23) lr 1.00e-05 gnorm 0.101 3.36s mem 81.1GB +[2026-09-12 08:06:22] step 2613/5000 loss 0.1744 (w 0.3440 mse 0.3469 t 991 new 0.26) lr 1.00e-05 gnorm 0.230 3.04s mem 81.1GB +[2026-09-12 08:06:25] step 2614/5000 loss 0.3017 (w 0.3008 mse 0.3189 t 570 new 0.19) lr 1.00e-05 gnorm 0.227 3.09s mem 81.1GB +[2026-09-12 08:06:28] step 2615/5000 loss 0.3096 (w 0.2598 mse 0.2753 t 807 new 0.16) lr 1.00e-05 gnorm 0.162 3.15s mem 81.1GB +[2026-09-12 08:06:31] step 2616/5000 loss 0.3666 (w 0.1945 mse 0.2080 t 979 new 0.25) lr 1.00e-05 gnorm 0.104 3.06s mem 81.1GB +[2026-09-12 08:06:34] step 2617/5000 loss 0.1691 (w 0.4101 mse 0.4095 t 978 new 0.13) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +[2026-09-12 08:06:37] step 2618/5000 loss 0.3360 (w 0.3643 mse 0.3691 t 1000 new 0.23) lr 1.00e-05 gnorm 0.417 3.08s mem 81.1GB +[2026-09-12 08:06:41] step 2619/5000 loss 0.2903 (w 0.2090 mse 0.2241 t 937 new 0.25) lr 1.00e-05 gnorm 0.104 3.22s mem 81.1GB +[2026-09-12 08:06:44] step 2620/5000 loss 0.3092 (w 0.3134 mse 0.3412 t 973 new 0.19) lr 1.00e-05 gnorm 0.094 3.07s mem 81.1GB +[2026-09-12 08:06:47] step 2621/5000 loss 0.2633 (w 0.2509 mse 0.2586 t 516 new 0.13) lr 1.00e-05 gnorm 0.104 3.10s mem 81.1GB +[2026-09-12 08:06:50] step 2622/5000 loss 0.1998 (w 0.3569 mse 0.3561 t 936 new 0.18) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +[2026-09-12 08:06:53] step 2623/5000 loss 0.2705 (w 0.2821 mse 0.3013 t 523 new 0.23) lr 1.00e-05 gnorm 0.117 3.02s mem 81.1GB +[2026-09-12 08:06:56] step 2624/5000 loss 0.3192 (w 0.1860 mse 0.2057 t 813 new 0.25) lr 1.00e-05 gnorm 0.138 3.36s mem 81.1GB +[2026-09-12 08:06:59] step 2625/5000 loss 0.3850 (w 0.1808 mse 0.1909 t 683 new 0.10) lr 1.00e-05 gnorm 0.105 3.25s mem 81.1GB +[2026-09-12 08:07:02] step 2626/5000 loss 0.3492 (w 0.2237 mse 0.2247 t 840 new 0.13) lr 1.00e-05 gnorm 0.163 3.09s mem 81.1GB +[2026-09-12 08:07:06] step 2627/5000 loss 0.2685 (w 0.2811 mse 0.2851 t 781 new 0.23) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +[2026-09-12 08:07:09] step 2628/5000 loss 0.4211 (w 0.2346 mse 0.2505 t 858 new 0.24) lr 1.00e-05 gnorm 0.150 3.05s mem 81.1GB +[2026-09-12 08:07:12] step 2629/5000 loss 0.2609 (w 0.4783 mse 0.4920 t 973 new 0.14) lr 1.00e-05 gnorm 0.147 3.05s mem 81.1GB +[2026-09-12 08:07:15] step 2630/5000 loss 0.4716 (w 0.3028 mse 0.3201 t 479 new 0.17) lr 1.00e-05 gnorm 0.139 3.30s mem 81.1GB +[2026-09-12 08:07:18] step 2631/5000 loss 0.1857 (w 0.4299 mse 0.4336 t 992 new 0.23) lr 1.00e-05 gnorm 0.259 3.30s mem 81.1GB +[2026-09-12 08:07:21] step 2632/5000 loss 0.2640 (w 0.3066 mse 0.3147 t 702 new 0.22) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +[2026-09-12 08:07:25] step 2633/5000 loss 0.2951 (w 0.2890 mse 0.2881 t 972 new 0.11) lr 1.00e-05 gnorm 0.109 3.11s mem 81.1GB +[2026-09-12 08:07:28] step 2634/5000 loss 0.4202 (w 0.2912 mse 0.3056 t 827 new 0.15) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +[2026-09-12 08:07:31] step 2635/5000 loss 0.3324 (w 0.2607 mse 0.2679 t 883 new 0.23) lr 1.00e-05 gnorm 0.093 3.03s mem 81.1GB +[2026-09-12 08:07:34] step 2636/5000 loss 0.1822 (w 0.3768 mse 0.3728 t 954 new 0.20) lr 1.00e-05 gnorm 0.118 3.37s mem 81.1GB +[2026-09-12 08:07:37] step 2637/5000 loss 0.1645 (w 0.3204 mse 0.3210 t 940 new 0.20) lr 1.00e-05 gnorm 0.193 3.09s mem 81.1GB +[2026-09-12 08:07:40] step 2638/5000 loss 0.4105 (w 0.2938 mse 0.2997 t 735 new 0.25) lr 1.00e-05 gnorm 0.130 3.14s mem 81.1GB +[2026-09-12 08:07:43] step 2639/5000 loss 0.1322 (w 0.3283 mse 0.3383 t 990 new 0.22) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +[2026-09-12 08:07:46] step 2640/5000 loss 0.2815 (w 0.2934 mse 0.2988 t 771 new 0.22) lr 1.00e-05 gnorm 0.176 3.06s mem 81.1GB +[2026-09-12 08:07:49] step 2641/5000 loss 0.1457 (w 0.3403 mse 0.3481 t 993 new 0.24) lr 1.00e-05 gnorm 0.116 3.05s mem 81.1GB +[2026-09-12 08:07:53] step 2642/5000 loss 0.2177 (w 0.2670 mse 0.2841 t 985 new 0.22) lr 1.00e-05 gnorm 0.155 3.33s mem 81.1GB +[2026-09-12 08:07:56] step 2643/5000 loss 0.2081 (w 0.3740 mse 0.3668 t 845 new 0.22) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-12 08:07:59] step 2644/5000 loss 0.2984 (w 0.3138 mse 0.3284 t 927 new 0.20) lr 1.00e-05 gnorm 0.152 3.30s mem 81.1GB +[2026-09-12 08:08:02] step 2645/5000 loss 0.1797 (w 0.2974 mse 0.3012 t 988 new 0.22) lr 1.00e-05 gnorm 0.195 3.08s mem 81.1GB +[2026-09-12 08:08:05] step 2646/5000 loss 0.3193 (w 0.2520 mse 0.2567 t 792 new 0.13) lr 1.00e-05 gnorm 0.163 3.07s mem 81.1GB +[2026-09-12 08:08:08] step 2647/5000 loss 0.3004 (w 0.3597 mse 0.3462 t 950 new 0.21) lr 1.00e-05 gnorm 0.106 3.31s mem 81.1GB +[2026-09-12 08:08:12] step 2648/5000 loss 0.1826 (w 0.2823 mse 0.2889 t 914 new 0.21) lr 1.00e-05 gnorm 0.106 3.32s mem 81.1GB +[2026-09-12 08:08:15] step 2649/5000 loss 0.3519 (w 0.3022 mse 0.3034 t 788 new 0.25) lr 1.00e-05 gnorm 0.120 2.84s mem 81.1GB +[2026-09-12 08:08:18] step 2650/5000 loss 0.1774 (w 0.2297 mse 0.2433 t 641 new 0.16) lr 1.00e-05 gnorm 0.143 3.10s mem 81.1GB +[2026-09-12 08:08:21] step 2651/5000 loss 0.2148 (w 0.1844 mse 0.2027 t 882 new 0.21) lr 1.00e-05 gnorm 0.227 3.09s mem 81.1GB +[2026-09-12 08:08:24] step 2652/5000 loss 0.2759 (w 0.3761 mse 0.3713 t 980 new 0.21) lr 1.00e-05 gnorm 0.138 3.27s mem 81.1GB +[2026-09-12 08:08:27] step 2653/5000 loss 0.3970 (w 0.3200 mse 0.3434 t 503 new 0.25) lr 1.00e-05 gnorm 0.156 3.10s mem 81.1GB +[2026-09-12 08:08:30] step 2654/5000 loss 0.3064 (w 0.2741 mse 0.2826 t 773 new 0.25) lr 1.00e-05 gnorm 0.171 3.37s mem 81.1GB +[2026-09-12 08:08:33] step 2655/5000 loss 0.2227 (w 0.4642 mse 0.4558 t 134 new 0.21) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-12 08:08:37] step 2656/5000 loss 0.3215 (w 0.2369 mse 0.2437 t 776 new 0.13) lr 1.00e-05 gnorm 0.129 3.46s mem 81.1GB +[2026-09-12 08:08:40] step 2657/5000 loss 0.5149 (w 0.2171 mse 0.2324 t 508 new 0.16) lr 1.00e-05 gnorm 0.180 2.83s mem 81.1GB +[2026-09-12 08:08:43] step 2658/5000 loss 0.3810 (w 0.3031 mse 0.2990 t 761 new 0.17) lr 1.00e-05 gnorm 0.184 3.29s mem 81.1GB +[2026-09-12 08:08:46] step 2659/5000 loss 0.1813 (w 0.3298 mse 0.3389 t 983 new 0.23) lr 1.00e-05 gnorm 0.148 3.09s mem 81.1GB +[2026-09-12 08:08:49] step 2660/5000 loss 0.2039 (w 0.2513 mse 0.2633 t 948 new 0.15) lr 1.00e-05 gnorm 0.360 3.08s mem 81.1GB +[2026-09-12 08:08:52] step 2661/5000 loss 0.3385 (w 0.2465 mse 0.2669 t 974 new 0.13) lr 1.00e-05 gnorm 0.144 3.27s mem 81.1GB +[2026-09-12 08:08:55] step 2662/5000 loss 0.4924 (w 0.5881 mse 0.5908 t 189 new 0.18) lr 1.00e-05 gnorm 0.156 3.08s mem 81.1GB +[2026-09-12 08:08:59] step 2663/5000 loss 0.2593 (w 0.4355 mse 0.4360 t 973 new 0.19) lr 1.00e-05 gnorm 0.106 3.05s mem 81.1GB +[2026-09-12 08:09:02] step 2664/5000 loss 0.2533 (w 0.2071 mse 0.2173 t 796 new 0.13) lr 1.00e-05 gnorm 0.164 3.06s mem 81.1GB +[2026-09-12 08:09:05] step 2665/5000 loss 0.2417 (w 0.3853 mse 0.3821 t 981 new 0.24) lr 1.00e-05 gnorm 0.123 3.12s mem 81.1GB +[2026-09-12 08:09:08] step 2666/5000 loss 0.2683 (w 0.2879 mse 0.2982 t 990 new 0.23) lr 1.00e-05 gnorm 0.154 3.05s mem 81.1GB +[2026-09-12 08:09:11] step 2667/5000 loss 0.2063 (w 0.2786 mse 0.2816 t 797 new 0.26) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +[2026-09-12 08:09:14] step 2668/5000 loss 0.2058 (w 0.3580 mse 0.3549 t 951 new 0.19) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +[2026-09-12 08:09:17] step 2669/5000 loss 0.1769 (w 0.3139 mse 0.3144 t 905 new 0.25) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +[2026-09-12 08:09:20] step 2670/5000 loss 0.1330 (w 0.3915 mse 0.3945 t 997 new 0.23) lr 1.00e-05 gnorm 0.128 3.10s mem 81.1GB +[2026-09-12 08:09:24] step 2671/5000 loss 0.3803 (w 0.3536 mse 0.3389 t 956 new 0.22) lr 1.00e-05 gnorm 0.147 3.35s mem 81.1GB +[2026-09-12 08:09:26] step 2672/5000 loss 0.2009 (w 0.2192 mse 0.2387 t 968 new 0.12) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +[2026-09-12 08:09:30] step 2673/5000 loss 0.3729 (w 0.1964 mse 0.2019 t 863 new 0.20) lr 1.00e-05 gnorm 0.172 3.14s mem 81.1GB +[2026-09-12 08:09:33] step 2674/5000 loss 0.2110 (w 0.2983 mse 0.3081 t 966 new 0.22) lr 1.00e-05 gnorm 0.097 3.07s mem 81.1GB +[2026-09-12 08:09:36] step 2675/5000 loss 0.5540 (w 0.2942 mse 0.3003 t 537 new 0.14) lr 1.00e-05 gnorm 0.259 3.03s mem 81.1GB +[2026-09-12 08:09:39] step 2676/5000 loss 0.4183 (w 0.2594 mse 0.2698 t 518 new 0.21) lr 1.00e-05 gnorm 0.230 3.11s mem 81.1GB +[2026-09-12 08:09:42] step 2677/5000 loss 0.3255 (w 0.2844 mse 0.2860 t 706 new 0.25) lr 1.00e-05 gnorm 0.254 3.38s mem 81.1GB +[2026-09-12 08:09:45] step 2678/5000 loss 0.3681 (w 0.3450 mse 0.3448 t 973 new 0.07) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +[2026-09-12 08:09:48] step 2679/5000 loss 0.2221 (w 0.2500 mse 0.2659 t 862 new 0.18) lr 1.00e-05 gnorm 0.143 3.16s mem 81.1GB +[2026-09-12 08:09:51] step 2680/5000 loss 0.5088 (w 0.3314 mse 0.3337 t 631 new 0.24) lr 1.00e-05 gnorm 0.296 3.09s mem 81.1GB +[2026-09-12 08:09:54] step 2681/5000 loss 0.4223 (w 0.3518 mse 0.3574 t 315 new 0.26) lr 1.00e-05 gnorm 0.121 3.10s mem 81.1GB +[2026-09-12 08:09:57] step 2682/5000 loss 0.1958 (w 0.1553 mse 0.1756 t 996 new 0.24) lr 1.00e-05 gnorm 0.185 3.02s mem 81.1GB +[2026-09-12 08:10:01] step 2683/5000 loss 0.3777 (w 0.2936 mse 0.2968 t 708 new 0.23) lr 1.00e-05 gnorm 0.148 3.35s mem 81.1GB +[2026-09-12 08:10:04] step 2684/5000 loss 0.2888 (w 0.3027 mse 0.3001 t 781 new 0.23) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +[2026-09-12 08:10:07] step 2685/5000 loss 0.1404 (w 0.3065 mse 0.3183 t 945 new 0.20) lr 1.00e-05 gnorm 0.161 3.17s mem 81.1GB +[2026-09-12 08:10:10] step 2686/5000 loss 0.1267 (w 0.4304 mse 0.4376 t 990 new 0.13) lr 1.00e-05 gnorm 0.136 3.12s mem 81.1GB +[2026-09-12 08:10:13] step 2687/5000 loss 0.4478 (w 0.3184 mse 0.3289 t 470 new 0.21) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +[2026-09-12 08:10:16] step 2688/5000 loss 0.2961 (w 0.3000 mse 0.3002 t 847 new 0.24) lr 1.00e-05 gnorm 0.142 3.25s mem 81.1GB +[2026-09-12 08:10:20] step 2689/5000 loss 0.3479 (w 0.3099 mse 0.3218 t 945 new 0.20) lr 1.00e-05 gnorm 0.136 3.34s mem 81.1GB +[2026-09-12 08:10:22] step 2690/5000 loss 0.3399 (w 0.2532 mse 0.2530 t 836 new 0.20) lr 1.00e-05 gnorm 0.196 2.82s mem 81.1GB +[2026-09-12 08:10:26] step 2691/5000 loss 0.1909 (w 0.2777 mse 0.2972 t 995 new 0.19) lr 1.00e-05 gnorm 0.152 3.53s mem 81.1GB +[2026-09-12 08:10:29] step 2692/5000 loss 0.2125 (w 0.3468 mse 0.3364 t 922 new 0.26) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +[2026-09-12 08:10:32] step 2693/5000 loss 0.1553 (w 0.2150 mse 0.2387 t 724 new 0.18) lr 1.00e-05 gnorm 0.230 3.27s mem 81.1GB +[2026-09-12 08:10:35] step 2694/5000 loss 0.2937 (w 0.2110 mse 0.2323 t 482 new 0.18) lr 1.00e-05 gnorm 0.193 3.08s mem 81.1GB +[2026-09-12 08:10:38] step 2695/5000 loss 0.4318 (w 0.2584 mse 0.2637 t 799 new 0.19) lr 1.00e-05 gnorm 0.186 3.11s mem 81.1GB +[2026-09-12 08:10:41] step 2696/5000 loss 0.3340 (w 0.2840 mse 0.2914 t 440 new 0.07) lr 1.00e-05 gnorm 0.210 2.84s mem 81.1GB +[2026-09-12 08:10:45] step 2697/5000 loss 0.2541 (w 0.2319 mse 0.2515 t 698 new 0.18) lr 1.00e-05 gnorm 0.125 3.54s mem 81.1GB +[2026-09-12 08:10:47] step 2698/5000 loss 0.2463 (w 0.2081 mse 0.2367 t 933 new 0.19) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +[2026-09-12 08:10:51] step 2699/5000 loss 0.3542 (w 0.1867 mse 0.2149 t 730 new 0.21) lr 1.00e-05 gnorm 0.159 3.23s mem 81.1GB +[2026-09-12 08:10:54] step 2700/5000 loss 0.3517 (w 0.3056 mse 0.3036 t 899 new 0.23) lr 1.00e-05 gnorm 0.150 3.27s mem 81.1GB +[2026-09-12 08:10:57] step 2701/5000 loss 0.2406 (w 0.3245 mse 0.3281 t 929 new 0.18) lr 1.00e-05 gnorm 0.115 3.08s mem 81.1GB +[2026-09-12 08:11:00] step 2702/5000 loss 0.2958 (w 0.3527 mse 0.3472 t 988 new 0.15) lr 1.00e-05 gnorm 0.228 2.85s mem 81.1GB +[2026-09-12 08:11:03] step 2703/5000 loss 0.1777 (w 0.2889 mse 0.3062 t 961 new 0.22) lr 1.00e-05 gnorm 0.115 3.52s mem 81.1GB +[2026-09-12 08:11:06] step 2704/5000 loss 0.2544 (w 0.2603 mse 0.2671 t 817 new 0.22) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +[2026-09-12 08:11:10] step 2705/5000 loss 0.5212 (w 0.3812 mse 0.4059 t 553 new 0.18) lr 1.00e-05 gnorm 0.153 3.33s mem 81.1GB +[2026-09-12 08:11:13] step 2706/5000 loss 0.2786 (w 0.2325 mse 0.2452 t 760 new 0.19) lr 1.00e-05 gnorm 0.248 3.31s mem 81.1GB +[2026-09-12 08:11:16] step 2707/5000 loss 0.2690 (w 0.2466 mse 0.2608 t 964 new 0.20) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +[2026-09-12 08:11:19] step 2708/5000 loss 0.3672 (w 0.4309 mse 0.4302 t 344 new 0.22) lr 1.00e-05 gnorm 0.198 2.84s mem 81.1GB +[2026-09-12 08:11:22] step 2709/5000 loss 0.1995 (w 0.3274 mse 0.3283 t 944 new 0.16) lr 1.00e-05 gnorm 0.141 3.18s mem 81.1GB +[2026-09-12 08:11:25] step 2710/5000 loss 0.2062 (w 0.2355 mse 0.2331 t 934 new 0.11) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +[2026-09-12 08:11:28] step 2711/5000 loss 0.3517 (w 0.3538 mse 0.3689 t 195 new 0.09) lr 1.00e-05 gnorm 0.147 3.31s mem 81.1GB +[2026-09-12 08:11:31] step 2712/5000 loss 0.2112 (w 0.4280 mse 0.4132 t 991 new 0.21) lr 1.00e-05 gnorm 0.101 3.32s mem 81.1GB +[2026-09-12 08:11:34] step 2713/5000 loss 0.2748 (w 0.2533 mse 0.2804 t 996 new 0.19) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-12 08:11:37] step 2714/5000 loss 0.3139 (w 0.2001 mse 0.2128 t 948 new 0.22) lr 1.00e-05 gnorm 0.105 3.30s mem 81.1GB +[2026-09-12 08:11:40] step 2715/5000 loss 0.3357 (w 0.4138 mse 0.4142 t 978 new 0.24) lr 1.00e-05 gnorm 0.122 3.09s mem 81.1GB +[2026-09-12 08:11:43] step 2716/5000 loss 0.1427 (w 0.2385 mse 0.2366 t 642 new 0.16) lr 1.00e-05 gnorm 0.145 2.82s mem 81.1GB +[2026-09-12 08:11:47] step 2717/5000 loss 0.3591 (w 0.2419 mse 0.2471 t 830 new 0.13) lr 1.00e-05 gnorm 0.344 3.27s mem 81.1GB +[2026-09-12 08:11:50] step 2718/5000 loss 0.3445 (w 0.3329 mse 0.3340 t 601 new 0.11) lr 1.00e-05 gnorm 0.113 3.10s mem 81.1GB +[2026-09-12 08:11:53] step 2719/5000 loss 0.3424 (w 0.2800 mse 0.2824 t 966 new 0.14) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-12 08:11:56] step 2720/5000 loss 0.2470 (w 0.4120 mse 0.4047 t 673 new 0.20) lr 1.00e-05 gnorm 0.102 3.11s mem 81.1GB +[2026-09-12 08:11:58] step 2721/5000 loss 0.2588 (w 0.2679 mse 0.2672 t 641 new 0.16) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 08:12:01] step 2722/5000 loss 0.3316 (w 0.2471 mse 0.2618 t 927 new 0.17) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +[2026-09-12 08:12:05] step 2723/5000 loss 0.2310 (w 0.3337 mse 0.3382 t 922 new 0.22) lr 1.00e-05 gnorm 0.168 3.30s mem 81.1GB +[2026-09-12 08:12:08] step 2724/5000 loss 0.2798 (w 0.2451 mse 0.2615 t 702 new 0.21) lr 1.00e-05 gnorm 0.131 3.10s mem 81.1GB +[2026-09-12 08:12:11] step 2725/5000 loss 0.3101 (w 0.2295 mse 0.2378 t 647 new 0.17) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +[2026-09-12 08:12:14] step 2726/5000 loss 0.1705 (w 0.2183 mse 0.2376 t 899 new 0.24) lr 1.00e-05 gnorm 0.128 3.16s mem 81.1GB +[2026-09-12 08:12:17] step 2727/5000 loss 0.2490 (w 0.3849 mse 0.3792 t 998 new 0.25) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +[2026-09-12 08:12:20] step 2728/5000 loss 0.3883 (w 0.3455 mse 0.3545 t 428 new 0.22) lr 1.00e-05 gnorm 0.148 3.06s mem 81.1GB +[2026-09-12 08:12:23] step 2729/5000 loss 0.3343 (w 0.2756 mse 0.2729 t 899 new 0.14) lr 1.00e-05 gnorm 0.121 3.23s mem 81.1GB +[2026-09-12 08:12:26] step 2730/5000 loss 0.3804 (w 0.2618 mse 0.2713 t 781 new 0.23) lr 1.00e-05 gnorm 0.124 3.06s mem 81.1GB +[2026-09-12 08:12:29] step 2731/5000 loss 0.2538 (w 0.2385 mse 0.2491 t 859 new 0.17) lr 1.00e-05 gnorm 0.169 2.83s mem 81.1GB +[2026-09-12 08:12:32] step 2732/5000 loss 0.2246 (w 0.3781 mse 0.3817 t 983 new 0.20) lr 1.00e-05 gnorm 0.234 3.54s mem 81.1GB +[2026-09-12 08:12:35] step 2733/5000 loss 0.3083 (w 0.6859 mse 0.6915 t 140 new 0.21) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +[2026-09-12 08:12:38] step 2734/5000 loss 0.2941 (w 0.2350 mse 0.2416 t 681 new 0.21) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +[2026-09-12 08:12:42] step 2735/5000 loss 0.3331 (w 0.1783 mse 0.2065 t 967 new 0.19) lr 1.00e-05 gnorm 0.119 3.34s mem 81.1GB +[2026-09-12 08:12:45] step 2736/5000 loss 0.2938 (w 0.2446 mse 0.2365 t 860 new 0.14) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +[2026-09-12 08:12:47] step 2737/5000 loss 0.2073 (w 0.4211 mse 0.4083 t 989 new 0.19) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +[2026-09-12 08:12:51] step 2738/5000 loss 0.3177 (w 0.4550 mse 0.4723 t 992 new 0.18) lr 1.00e-05 gnorm 0.185 3.55s mem 81.1GB +[2026-09-12 08:12:54] step 2739/5000 loss 0.1046 (w 0.2700 mse 0.2995 t 997 new 0.22) lr 1.00e-05 gnorm 0.112 2.85s mem 81.1GB +[2026-09-12 08:12:57] step 2740/5000 loss 0.2581 (w 0.2704 mse 0.2973 t 364 new 0.21) lr 1.00e-05 gnorm 0.156 3.33s mem 81.1GB +[2026-09-12 08:13:00] step 2741/5000 loss 0.1652 (w 0.2722 mse 0.2723 t 776 new 0.25) lr 1.00e-05 gnorm 0.157 3.06s mem 81.1GB +[2026-09-12 08:13:03] step 2742/5000 loss 0.2040 (w 0.3218 mse 0.3186 t 880 new 0.24) lr 1.00e-05 gnorm 0.108 2.85s mem 81.1GB +[2026-09-12 08:13:06] step 2743/5000 loss 0.1496 (w 0.1579 mse 0.1691 t 975 new 0.22) lr 1.00e-05 gnorm 0.102 2.85s mem 81.1GB +[2026-09-12 08:13:09] step 2744/5000 loss 0.1895 (w 0.2182 mse 0.2199 t 849 new 0.14) lr 1.00e-05 gnorm 0.184 3.18s mem 81.1GB +[2026-09-12 08:13:12] step 2745/5000 loss 0.1502 (w 0.3348 mse 0.3353 t 984 new 0.23) lr 1.00e-05 gnorm 0.095 2.84s mem 81.1GB +[2026-09-12 08:13:15] step 2746/5000 loss 0.3291 (w 0.3463 mse 0.3478 t 982 new 0.17) lr 1.00e-05 gnorm 0.174 3.34s mem 81.1GB +[2026-09-12 08:13:19] step 2747/5000 loss 0.2548 (w 0.2731 mse 0.2764 t 800 new 0.18) lr 1.00e-05 gnorm 0.211 3.47s mem 81.1GB +[2026-09-12 08:13:22] step 2748/5000 loss 0.5088 (w 0.2640 mse 0.2642 t 888 new 0.19) lr 1.00e-05 gnorm 0.148 2.84s mem 81.1GB +[2026-09-12 08:13:24] step 2749/5000 loss 0.2481 (w 0.2290 mse 0.2450 t 959 new 0.17) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +[2026-09-12 08:13:28] step 2750/5000 loss 0.2254 (w 0.2439 mse 0.2584 t 945 new 0.21) lr 1.00e-05 gnorm 0.161 3.15s mem 81.1GB +[2026-09-12 08:13:31] step 2751/5000 loss 0.2989 (w 0.2406 mse 0.2635 t 989 new 0.17) lr 1.00e-05 gnorm 0.150 3.18s mem 81.1GB +[2026-09-12 08:13:34] step 2752/5000 loss 0.2489 (w 0.2538 mse 0.2559 t 944 new 0.18) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +[2026-09-12 08:13:37] step 2753/5000 loss 0.2018 (w 0.2421 mse 0.2656 t 986 new 0.22) lr 1.00e-05 gnorm 0.141 3.24s mem 81.1GB +[2026-09-12 08:13:40] step 2754/5000 loss 0.3790 (w 0.3405 mse 0.3430 t 734 new 0.20) lr 1.00e-05 gnorm 0.103 2.84s mem 81.1GB +[2026-09-12 08:13:43] step 2755/5000 loss 0.3334 (w 0.2923 mse 0.3047 t 710 new 0.30) lr 1.00e-05 gnorm 0.165 2.85s mem 81.1GB +[2026-09-12 08:13:46] step 2756/5000 loss 0.3933 (w 0.3930 mse 0.3973 t 348 new 0.22) lr 1.00e-05 gnorm 0.130 3.08s mem 81.1GB +[2026-09-12 08:13:49] step 2757/5000 loss 0.3670 (w 0.2803 mse 0.2786 t 712 new 0.10) lr 1.00e-05 gnorm 0.125 3.04s mem 81.1GB +[2026-09-12 08:13:52] step 2758/5000 loss 0.1422 (w 0.3055 mse 0.3188 t 951 new 0.17) lr 1.00e-05 gnorm 0.122 2.85s mem 81.1GB +[2026-09-12 08:13:55] step 2759/5000 loss 0.2585 (w 0.2008 mse 0.2119 t 755 new 0.20) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +[2026-09-12 08:13:58] step 2760/5000 loss 0.2228 (w 0.1903 mse 0.2090 t 703 new 0.16) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +[2026-09-12 08:14:01] step 2761/5000 loss 0.2158 (w 0.2151 mse 0.2228 t 822 new 0.13) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +[2026-09-12 08:14:04] step 2762/5000 loss 0.2868 (w 0.2998 mse 0.3169 t 977 new 0.19) lr 1.00e-05 gnorm 0.101 3.09s mem 81.1GB +[2026-09-12 08:14:07] step 2763/5000 loss 0.1809 (w 0.2619 mse 0.2782 t 891 new 0.22) lr 1.00e-05 gnorm 0.108 3.13s mem 81.1GB +[2026-09-12 08:14:10] step 2764/5000 loss 0.4353 (w 0.3358 mse 0.3262 t 949 new 0.19) lr 1.00e-05 gnorm 0.231 3.14s mem 81.1GB +[2026-09-12 08:14:13] step 2765/5000 loss 0.3692 (w 0.2361 mse 0.2436 t 553 new 0.23) lr 1.00e-05 gnorm 0.215 3.13s mem 81.1GB +[2026-09-12 08:14:16] step 2766/5000 loss 0.3271 (w 0.2707 mse 0.2693 t 971 new 0.14) lr 1.00e-05 gnorm 0.200 2.84s mem 81.1GB +[2026-09-12 08:14:19] step 2767/5000 loss 0.4016 (w 0.2273 mse 0.2441 t 782 new 0.25) lr 1.00e-05 gnorm 0.158 3.14s mem 81.1GB +[2026-09-12 08:14:23] step 2768/5000 loss 0.3078 (w 0.3032 mse 0.3097 t 444 new 0.21) lr 1.00e-05 gnorm 0.137 3.17s mem 81.1GB +[2026-09-12 08:14:26] step 2769/5000 loss 0.2753 (w 0.2307 mse 0.2368 t 927 new 0.15) lr 1.00e-05 gnorm 0.139 3.13s mem 81.1GB +[2026-09-12 08:14:29] step 2770/5000 loss 0.1450 (w 0.2329 mse 0.2457 t 865 new 0.27) lr 1.00e-05 gnorm 0.114 3.27s mem 81.1GB +[2026-09-12 08:14:32] step 2771/5000 loss 0.2257 (w 0.1967 mse 0.2057 t 904 new 0.12) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +[2026-09-12 08:14:35] step 2772/5000 loss 0.2815 (w 0.2678 mse 0.2771 t 910 new 0.19) lr 1.00e-05 gnorm 0.262 2.83s mem 81.1GB +[2026-09-12 08:14:38] step 2773/5000 loss 0.3516 (w 0.4590 mse 0.4553 t 297 new 0.12) lr 1.00e-05 gnorm 0.205 3.17s mem 81.1GB +[2026-09-12 08:14:41] step 2774/5000 loss 0.2614 (w 0.2016 mse 0.2160 t 954 new 0.22) lr 1.00e-05 gnorm 0.116 2.84s mem 81.1GB +[2026-09-12 08:14:44] step 2775/5000 loss 0.2419 (w 0.2377 mse 0.2457 t 792 new 0.17) lr 1.00e-05 gnorm 0.127 3.06s mem 81.1GB +[2026-09-12 08:14:47] step 2776/5000 loss 0.3144 (w 0.2796 mse 0.2872 t 924 new 0.26) lr 1.00e-05 gnorm 0.126 3.20s mem 81.1GB +[2026-09-12 08:14:50] step 2777/5000 loss 0.1939 (w 0.2664 mse 0.2748 t 911 new 0.19) lr 1.00e-05 gnorm 0.212 2.83s mem 81.1GB +[2026-09-12 08:14:53] step 2778/5000 loss 0.2973 (w 0.3762 mse 0.3922 t 947 new 0.17) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +[2026-09-12 08:14:56] step 2779/5000 loss 0.2496 (w 0.3789 mse 0.4014 t 238 new 0.28) lr 1.00e-05 gnorm 0.160 3.45s mem 81.1GB +[2026-09-12 08:14:59] step 2780/5000 loss 0.2468 (w 0.2514 mse 0.2645 t 898 new 0.17) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-12 08:15:02] step 2781/5000 loss 0.2848 (w 0.2801 mse 0.2920 t 949 new 0.18) lr 1.00e-05 gnorm 0.106 3.08s mem 81.1GB +[2026-09-12 08:15:05] step 2782/5000 loss 0.2762 (w 0.2597 mse 0.2840 t 974 new 0.10) lr 1.00e-05 gnorm 1.115 3.40s mem 81.1GB +[2026-09-12 08:15:08] step 2783/5000 loss 0.4001 (w 0.3286 mse 0.3346 t 440 new 0.14) lr 1.00e-05 gnorm 0.109 2.83s mem 81.1GB +[2026-09-12 08:15:11] step 2784/5000 loss 0.1327 (w 0.2409 mse 0.2457 t 913 new 0.15) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +[2026-09-12 08:15:14] step 2785/5000 loss 0.4609 (w 0.3701 mse 0.3764 t 310 new 0.19) lr 1.00e-05 gnorm 0.265 3.10s mem 81.1GB +[2026-09-12 08:15:17] step 2786/5000 loss 0.3119 (w 0.2813 mse 0.2883 t 827 new 0.24) lr 1.00e-05 gnorm 0.115 3.05s mem 81.1GB +[2026-09-12 08:15:20] step 2787/5000 loss 0.3751 (w 0.2096 mse 0.2214 t 717 new 0.23) lr 1.00e-05 gnorm 0.236 2.84s mem 81.1GB +[2026-09-12 08:15:23] step 2788/5000 loss 0.2250 (w 0.3183 mse 0.3410 t 982 new 0.23) lr 1.00e-05 gnorm 0.134 3.42s mem 81.1GB +[2026-09-12 08:15:26] step 2789/5000 loss 0.3325 (w 0.2620 mse 0.2627 t 910 new 0.21) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +[2026-09-12 08:15:29] step 2790/5000 loss 0.2735 (w 0.1878 mse 0.2065 t 800 new 0.24) lr 1.00e-05 gnorm 0.148 2.84s mem 81.1GB +[2026-09-12 08:15:32] step 2791/5000 loss 0.1819 (w 0.2267 mse 0.2368 t 977 new 0.22) lr 1.00e-05 gnorm 0.116 3.12s mem 81.1GB +[2026-09-12 08:15:35] step 2792/5000 loss 0.3471 (w 0.1777 mse 0.1914 t 886 new 0.20) lr 1.00e-05 gnorm 0.131 3.04s mem 81.1GB +[2026-09-12 08:15:38] step 2793/5000 loss 0.2732 (w 0.2487 mse 0.2556 t 960 new 0.26) lr 1.00e-05 gnorm 0.129 2.82s mem 81.1GB +[2026-09-12 08:15:41] step 2794/5000 loss 0.2428 (w 0.3082 mse 0.3163 t 808 new 0.17) lr 1.00e-05 gnorm 0.098 3.41s mem 81.1GB +[2026-09-12 08:15:44] step 2795/5000 loss 0.2905 (w 0.3791 mse 0.3928 t 972 new 0.13) lr 1.00e-05 gnorm 0.238 2.82s mem 81.1GB +[2026-09-12 08:15:47] step 2796/5000 loss 0.4422 (w 0.2178 mse 0.2288 t 722 new 0.22) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +[2026-09-12 08:15:50] step 2797/5000 loss 0.2398 (w 0.3330 mse 0.3369 t 968 new 0.14) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +[2026-09-12 08:15:54] step 2798/5000 loss 0.3278 (w 0.4190 mse 0.4101 t 978 new 0.22) lr 1.00e-05 gnorm 0.189 3.06s mem 81.1GB +[2026-09-12 08:15:57] step 2799/5000 loss 0.3150 (w 0.2123 mse 0.2296 t 781 new 0.22) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +[2026-09-12 08:16:00] step 2800/5000 loss 0.2112 (w 0.1537 mse 0.1743 t 492 new 0.26) lr 1.00e-05 gnorm 0.125 3.43s mem 81.1GB +[2026-09-12 08:16:03] step 2801/5000 loss 0.3218 (w 0.2314 mse 0.2541 t 809 new 0.22) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-12 08:16:06] step 2802/5000 loss 0.3998 (w 0.3552 mse 0.3609 t 653 new 0.22) lr 1.00e-05 gnorm 0.131 3.13s mem 81.1GB +[2026-09-12 08:16:09] step 2803/5000 loss 0.2196 (w 0.3852 mse 0.4068 t 238 new 0.17) lr 1.00e-05 gnorm 0.134 3.17s mem 81.1GB +[2026-09-12 08:16:12] step 2804/5000 loss 0.2773 (w 0.2118 mse 0.2269 t 725 new 0.25) lr 1.00e-05 gnorm 0.181 3.06s mem 81.1GB +[2026-09-12 08:16:15] step 2805/5000 loss 0.3057 (w 0.4908 mse 0.4837 t 998 new 0.21) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +[2026-09-12 08:16:19] step 2806/5000 loss 0.2554 (w 0.5157 mse 0.5063 t 988 new 0.22) lr 1.00e-05 gnorm 0.117 3.27s mem 81.1GB +[2026-09-12 08:16:21] step 2807/5000 loss 0.2909 (w 0.2895 mse 0.3048 t 623 new 0.21) lr 1.00e-05 gnorm 0.104 2.82s mem 81.1GB +[2026-09-12 08:16:25] step 2808/5000 loss 0.1286 (w 0.2048 mse 0.2113 t 914 new 0.21) lr 1.00e-05 gnorm 0.118 3.14s mem 81.1GB +[2026-09-12 08:16:28] step 2809/5000 loss 0.5996 (w 0.3789 mse 0.3827 t 440 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +[2026-09-12 08:16:31] step 2810/5000 loss 0.3765 (w 0.2436 mse 0.2466 t 677 new 0.22) lr 1.00e-05 gnorm 0.097 3.12s mem 81.1GB +[2026-09-12 08:16:34] step 2811/5000 loss 0.3902 (w 0.2815 mse 0.2889 t 975 new 0.20) lr 1.00e-05 gnorm 0.259 3.09s mem 81.1GB +[2026-09-12 08:16:37] step 2812/5000 loss 0.4378 (w 0.2819 mse 0.2842 t 888 new 0.21) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +[2026-09-12 08:16:40] step 2813/5000 loss 0.4071 (w 0.2804 mse 0.2869 t 865 new 0.16) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +[2026-09-12 08:16:43] step 2814/5000 loss 0.4235 (w 0.2952 mse 0.3063 t 434 new 0.19) lr 1.00e-05 gnorm 0.123 3.50s mem 81.1GB +[2026-09-12 08:16:46] step 2815/5000 loss 0.3099 (w 0.3221 mse 0.3295 t 557 new 0.18) lr 1.00e-05 gnorm 0.106 2.83s mem 81.1GB +[2026-09-12 08:16:49] step 2816/5000 loss 0.1350 (w 0.1948 mse 0.2086 t 936 new 0.15) lr 1.00e-05 gnorm 0.234 3.12s mem 81.1GB +[2026-09-12 08:16:53] step 2817/5000 loss 0.2709 (w 0.2060 mse 0.2230 t 927 new 0.22) lr 1.00e-05 gnorm 0.188 3.28s mem 81.1GB +[2026-09-12 08:16:56] step 2818/5000 loss 0.2700 (w 0.2931 mse 0.3058 t 765 new 0.20) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +[2026-09-12 08:16:58] step 2819/5000 loss 0.2373 (w 0.2211 mse 0.2339 t 932 new 0.18) lr 1.00e-05 gnorm 0.162 2.82s mem 81.1GB +[2026-09-12 08:17:02] step 2820/5000 loss 0.1237 (w 0.2613 mse 0.2619 t 933 new 0.21) lr 1.00e-05 gnorm 0.123 3.53s mem 81.1GB +[2026-09-12 08:17:05] step 2821/5000 loss 0.3953 (w 0.2873 mse 0.2878 t 729 new 0.18) lr 1.00e-05 gnorm 0.250 3.12s mem 81.1GB +[2026-09-12 08:17:08] step 2822/5000 loss 0.2636 (w 0.3188 mse 0.3365 t 401 new 0.19) lr 1.00e-05 gnorm 1.777 2.83s mem 81.1GB +[2026-09-12 08:17:11] step 2823/5000 loss 0.3851 (w 0.4291 mse 0.4465 t 1000 new 0.23) lr 1.00e-05 gnorm 0.176 3.31s mem 81.1GB +[2026-09-12 08:17:14] step 2824/5000 loss 0.3378 (w 0.3396 mse 0.3538 t 535 new 0.17) lr 1.00e-05 gnorm 0.174 3.09s mem 81.1GB +[2026-09-12 08:17:17] step 2825/5000 loss 0.3006 (w 0.3354 mse 0.3389 t 564 new 0.24) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +[2026-09-12 08:17:21] step 2826/5000 loss 0.4178 (w 0.3238 mse 0.3197 t 557 new 0.21) lr 1.00e-05 gnorm 0.126 3.25s mem 81.1GB +[2026-09-12 08:17:24] step 2827/5000 loss 0.3110 (w 0.3279 mse 0.3280 t 617 new 0.14) lr 1.00e-05 gnorm 0.147 3.13s mem 81.1GB +[2026-09-12 08:17:27] step 2828/5000 loss 0.4972 (w 0.4437 mse 0.4496 t 364 new 0.14) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +[2026-09-12 08:17:30] step 2829/5000 loss 0.3109 (w 0.2829 mse 0.2857 t 703 new 0.20) lr 1.00e-05 gnorm 0.163 3.34s mem 81.1GB +[2026-09-12 08:17:33] step 2830/5000 loss 0.3767 (w 0.2560 mse 0.2540 t 840 new 0.23) lr 1.00e-05 gnorm 0.160 3.13s mem 81.1GB +[2026-09-12 08:17:36] step 2831/5000 loss 0.2679 (w 0.3714 mse 0.3877 t 975 new 0.17) lr 1.00e-05 gnorm 0.118 3.14s mem 81.1GB +[2026-09-12 08:17:39] step 2832/5000 loss 0.1657 (w 0.2613 mse 0.2847 t 985 new 0.27) lr 1.00e-05 gnorm 0.526 3.25s mem 81.1GB +[2026-09-12 08:17:43] step 2833/5000 loss 0.3003 (w 0.3008 mse 0.2951 t 941 new 0.15) lr 1.00e-05 gnorm 0.112 3.07s mem 81.1GB +[2026-09-12 08:17:45] step 2834/5000 loss 0.4598 (w 0.2662 mse 0.2683 t 702 new 0.13) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +[2026-09-12 08:17:49] step 2835/5000 loss 0.4979 (w 0.2506 mse 0.2736 t 702 new 0.22) lr 1.00e-05 gnorm 0.119 3.36s mem 81.1GB +[2026-09-12 08:17:52] step 2836/5000 loss 0.3075 (w 0.3603 mse 0.3537 t 936 new 0.24) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-12 08:17:55] step 2837/5000 loss 0.3994 (w 0.2269 mse 0.2292 t 799 new 0.21) lr 1.00e-05 gnorm 0.146 3.05s mem 81.1GB +[2026-09-12 08:17:58] step 2838/5000 loss 0.1987 (w 0.2301 mse 0.2379 t 933 new 0.23) lr 1.00e-05 gnorm 0.126 3.21s mem 81.1GB +[2026-09-12 08:18:01] step 2839/5000 loss 0.4009 (w 0.2651 mse 0.2712 t 865 new 0.20) lr 1.00e-05 gnorm 0.133 3.10s mem 81.1GB +[2026-09-12 08:18:04] step 2840/5000 loss 0.1134 (w 0.2903 mse 0.2878 t 943 new 0.13) lr 1.00e-05 gnorm 0.122 3.12s mem 81.1GB +[2026-09-12 08:18:07] step 2841/5000 loss 0.2556 (w 0.2023 mse 0.2244 t 936 new 0.23) lr 1.00e-05 gnorm 0.138 3.35s mem 81.1GB +[2026-09-12 08:18:10] step 2842/5000 loss 0.2941 (w 0.2089 mse 0.2173 t 870 new 0.24) lr 1.00e-05 gnorm 0.157 2.84s mem 81.1GB +[2026-09-12 08:18:13] step 2843/5000 loss 0.3005 (w 0.4843 mse 0.4943 t 988 new 0.20) lr 1.00e-05 gnorm 0.120 3.06s mem 81.1GB +[2026-09-12 08:18:17] step 2844/5000 loss 0.3491 (w 0.2064 mse 0.2160 t 775 new 0.17) lr 1.00e-05 gnorm 0.113 3.19s mem 81.1GB +[2026-09-12 08:18:20] step 2845/5000 loss 0.3738 (w 0.2659 mse 0.2766 t 726 new 0.22) lr 1.00e-05 gnorm 0.138 3.20s mem 81.1GB +[2026-09-12 08:18:23] step 2846/5000 loss 0.2158 (w 0.2827 mse 0.2861 t 931 new 0.27) lr 1.00e-05 gnorm 0.150 3.10s mem 81.1GB +[2026-09-12 08:18:26] step 2847/5000 loss 0.2515 (w 0.4335 mse 0.4296 t 983 new 0.17) lr 1.00e-05 gnorm 0.155 3.29s mem 81.1GB +[2026-09-12 08:18:29] step 2848/5000 loss 0.2390 (w 0.2453 mse 0.2535 t 889 new 0.20) lr 1.00e-05 gnorm 0.680 2.84s mem 81.1GB +[2026-09-12 08:18:32] step 2849/5000 loss 0.2644 (w 0.4346 mse 0.4402 t 999 new 0.24) lr 1.00e-05 gnorm 0.122 3.06s mem 81.1GB +[2026-09-12 08:18:35] step 2850/5000 loss 0.2700 (w 0.2978 mse 0.3038 t 974 new 0.21) lr 1.00e-05 gnorm 0.145 3.23s mem 81.1GB +[2026-09-12 08:18:38] step 2851/5000 loss 0.2498 (w 0.3035 mse 0.3005 t 872 new 0.22) lr 1.00e-05 gnorm 0.139 3.13s mem 81.1GB +[2026-09-12 08:18:42] step 2852/5000 loss 0.2010 (w 0.2343 mse 0.2460 t 866 new 0.21) lr 1.00e-05 gnorm 0.197 3.12s mem 81.1GB +[2026-09-12 08:18:45] step 2853/5000 loss 0.2238 (w 0.2436 mse 0.2545 t 887 new 0.21) lr 1.00e-05 gnorm 0.250 3.08s mem 81.1GB +[2026-09-12 08:18:48] step 2854/5000 loss 0.4694 (w 0.3460 mse 0.3424 t 462 new 0.15) lr 1.00e-05 gnorm 0.117 2.83s mem 81.1GB +[2026-09-12 08:18:51] step 2855/5000 loss 0.4569 (w 0.2077 mse 0.2217 t 821 new 0.15) lr 1.00e-05 gnorm 0.144 3.06s mem 81.1GB +[2026-09-12 08:18:54] step 2856/5000 loss 0.3311 (w 0.3591 mse 0.3750 t 473 new 0.27) lr 1.00e-05 gnorm 0.094 3.22s mem 81.1GB +[2026-09-12 08:18:57] step 2857/5000 loss 0.4763 (w 0.2851 mse 0.3049 t 440 new 0.24) lr 1.00e-05 gnorm 0.129 3.10s mem 81.1GB +[2026-09-12 08:19:00] step 2858/5000 loss 0.3201 (w 0.3115 mse 0.3112 t 923 new 0.22) lr 1.00e-05 gnorm 0.152 3.09s mem 81.1GB +[2026-09-12 08:19:03] step 2859/5000 loss 0.3246 (w 0.3298 mse 0.3306 t 892 new 0.23) lr 1.00e-05 gnorm 0.109 3.07s mem 81.1GB +[2026-09-12 08:19:06] step 2860/5000 loss 0.3623 (w 0.3224 mse 0.3466 t 973 new 0.21) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +[2026-09-12 08:19:09] step 2861/5000 loss 0.3252 (w 0.2605 mse 0.2646 t 838 new 0.23) lr 1.00e-05 gnorm 0.130 3.05s mem 81.1GB +[2026-09-12 08:19:12] step 2862/5000 loss 0.3136 (w 0.3425 mse 0.3444 t 933 new 0.16) lr 1.00e-05 gnorm 0.096 3.19s mem 81.1GB +[2026-09-12 08:19:15] step 2863/5000 loss 0.3829 (w 0.2357 mse 0.2634 t 967 new 0.21) lr 1.00e-05 gnorm 0.153 3.14s mem 81.1GB +[2026-09-12 08:19:18] step 2864/5000 loss 0.2445 (w 0.2756 mse 0.2790 t 903 new 0.23) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +[2026-09-12 08:19:22] step 2865/5000 loss 0.3007 (w 0.2547 mse 0.2749 t 562 new 0.21) lr 1.00e-05 gnorm 0.119 3.07s mem 81.1GB +[2026-09-12 08:19:24] step 2866/5000 loss 0.4012 (w 0.2362 mse 0.2440 t 834 new 0.16) lr 1.00e-05 gnorm 0.110 2.84s mem 81.1GB +[2026-09-12 08:19:27] step 2867/5000 loss 0.2764 (w 0.2432 mse 0.2710 t 978 new 0.22) lr 1.00e-05 gnorm 0.127 3.08s mem 81.1GB +[2026-09-12 08:19:31] step 2868/5000 loss 0.2750 (w 0.1971 mse 0.2024 t 802 new 0.13) lr 1.00e-05 gnorm 0.145 3.21s mem 81.1GB +[2026-09-12 08:19:34] step 2869/5000 loss 0.2857 (w 0.4071 mse 0.3999 t 940 new 0.17) lr 1.00e-05 gnorm 0.289 2.84s mem 81.1GB +[2026-09-12 08:19:37] step 2870/5000 loss 0.2765 (w 0.2368 mse 0.2488 t 983 new 0.21) lr 1.00e-05 gnorm 0.192 3.35s mem 81.1GB +[2026-09-12 08:19:40] step 2871/5000 loss 0.4045 (w 0.3023 mse 0.3007 t 753 new 0.17) lr 1.00e-05 gnorm 0.204 3.17s mem 81.1GB +[2026-09-12 08:19:43] step 2872/5000 loss 0.3365 (w 0.3013 mse 0.2935 t 923 new 0.21) lr 1.00e-05 gnorm 0.152 3.07s mem 81.1GB +[2026-09-12 08:19:46] step 2873/5000 loss 0.3462 (w 0.3344 mse 0.3339 t 921 new 0.24) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +[2026-09-12 08:19:50] step 2874/5000 loss 0.1354 (w 0.3078 mse 0.3120 t 949 new 0.26) lr 1.00e-05 gnorm 0.121 3.51s mem 81.1GB +[2026-09-12 08:19:52] step 2875/5000 loss 0.4511 (w 0.2898 mse 0.2853 t 694 new 0.21) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +[2026-09-12 08:19:56] step 2876/5000 loss 0.2520 (w 0.2793 mse 0.3083 t 953 new 0.19) lr 1.00e-05 gnorm 0.120 3.38s mem 81.1GB +[2026-09-12 08:19:59] step 2877/5000 loss 0.1925 (w 0.2424 mse 0.2612 t 821 new 0.19) lr 1.00e-05 gnorm 0.127 2.85s mem 81.1GB +[2026-09-12 08:20:02] step 2878/5000 loss 0.2001 (w 0.3752 mse 0.3823 t 954 new 0.23) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +[2026-09-12 08:20:05] step 2879/5000 loss 0.2354 (w 0.3210 mse 0.3251 t 974 new 0.22) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +[2026-09-12 08:20:08] step 2880/5000 loss 0.4476 (w 0.2319 mse 0.2544 t 981 new 0.11) lr 1.00e-05 gnorm 0.138 3.58s mem 81.1GB +[2026-09-12 08:20:11] step 2881/5000 loss 0.2385 (w 0.1756 mse 0.1900 t 972 new 0.25) lr 1.00e-05 gnorm 0.155 2.83s mem 81.1GB +[2026-09-12 08:20:14] step 2882/5000 loss 0.1900 (w 0.2100 mse 0.2238 t 858 new 0.15) lr 1.00e-05 gnorm 0.260 3.43s mem 81.1GB +[2026-09-12 08:20:17] step 2883/5000 loss 0.1881 (w 0.2508 mse 0.2542 t 961 new 0.16) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +[2026-09-12 08:20:20] step 2884/5000 loss 0.1524 (w 0.2978 mse 0.3027 t 991 new 0.24) lr 1.00e-05 gnorm 0.522 2.83s mem 81.1GB +[2026-09-12 08:20:23] step 2885/5000 loss 0.3296 (w 0.3442 mse 0.3521 t 992 new 0.18) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +[2026-09-12 08:20:27] step 2886/5000 loss 0.2926 (w 0.2034 mse 0.2034 t 901 new 0.00) lr 1.00e-05 gnorm 0.151 3.32s mem 81.1GB +[2026-09-12 08:20:30] step 2887/5000 loss 0.2747 (w 0.2624 mse 0.2797 t 979 new 0.24) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +[2026-09-12 08:20:33] step 2888/5000 loss 0.4502 (w 0.3279 mse 0.3352 t 830 new 0.18) lr 1.00e-05 gnorm 0.330 3.11s mem 81.1GB +[2026-09-12 08:20:36] step 2889/5000 loss 0.2516 (w 0.2929 mse 0.2950 t 921 new 0.22) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +[2026-09-12 08:20:39] step 2890/5000 loss 0.2050 (w 0.2743 mse 0.2898 t 748 new 0.14) lr 1.00e-05 gnorm 0.105 3.12s mem 81.1GB +[2026-09-12 08:20:42] step 2891/5000 loss 0.4818 (w 0.5739 mse 0.6024 t 134 new 0.16) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +[2026-09-12 08:20:45] step 2892/5000 loss 0.1914 (w 0.3258 mse 0.3362 t 979 new 0.22) lr 1.00e-05 gnorm 0.133 3.32s mem 81.1GB +[2026-09-12 08:20:48] step 2893/5000 loss 0.1569 (w 0.2110 mse 0.2180 t 926 new 0.18) lr 1.00e-05 gnorm 0.113 3.15s mem 81.1GB +[2026-09-12 08:20:51] step 2894/5000 loss 0.2032 (w 0.2877 mse 0.2756 t 974 new 0.11) lr 1.00e-05 gnorm 0.163 3.11s mem 81.1GB +[2026-09-12 08:20:54] step 2895/5000 loss 0.3364 (w 0.1743 mse 0.1965 t 910 new 0.17) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +[2026-09-12 08:20:57] step 2896/5000 loss 0.1564 (w 0.3521 mse 0.3553 t 993 new 0.24) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +[2026-09-12 08:21:00] step 2897/5000 loss 0.2593 (w 0.2167 mse 0.2268 t 997 new 0.22) lr 1.00e-05 gnorm 0.146 3.29s mem 81.1GB +[2026-09-12 08:21:04] step 2898/5000 loss 0.4339 (w 0.2926 mse 0.2937 t 762 new 0.10) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +[2026-09-12 08:21:07] step 2899/5000 loss 0.3356 (w 0.3124 mse 0.3235 t 709 new 0.18) lr 1.00e-05 gnorm 0.127 3.12s mem 81.1GB +[2026-09-12 08:21:10] step 2900/5000 loss 0.3466 (w 0.3071 mse 0.3062 t 877 new 0.19) lr 1.00e-05 gnorm 0.217 3.07s mem 81.1GB +[2026-09-12 08:21:13] step 2901/5000 loss 0.1515 (w 0.3190 mse 0.3319 t 984 new 0.28) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +[2026-09-12 08:21:16] step 2902/5000 loss 0.3188 (w 0.3953 mse 0.3977 t 244 new 0.01) lr 1.00e-05 gnorm 0.100 3.12s mem 81.1GB +[2026-09-12 08:21:19] step 2903/5000 loss 0.3832 (w 0.4913 mse 0.4835 t 981 new 0.21) lr 1.00e-05 gnorm 0.213 3.28s mem 81.1GB +[2026-09-12 08:21:22] step 2904/5000 loss 0.3364 (w 0.1837 mse 0.1922 t 998 new 0.14) lr 1.00e-05 gnorm 0.196 3.11s mem 81.1GB +[2026-09-12 08:21:25] step 2905/5000 loss 0.2152 (w 0.2895 mse 0.2902 t 993 new 0.24) lr 1.00e-05 gnorm 0.159 3.08s mem 81.1GB +[2026-09-12 08:21:28] step 2906/5000 loss 0.1625 (w 0.2774 mse 0.2826 t 892 new 0.09) lr 1.00e-05 gnorm 0.150 3.10s mem 81.1GB +[2026-09-12 08:21:31] step 2907/5000 loss 0.0484 (w 0.3125 mse 0.3451 t 999 new 0.17) lr 1.00e-05 gnorm 0.105 3.05s mem 81.1GB +[2026-09-12 08:21:34] step 2908/5000 loss 0.1457 (w 0.2701 mse 0.2750 t 1000 new 0.08) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +[2026-09-12 08:21:37] step 2909/5000 loss 0.2984 (w 0.2973 mse 0.3052 t 875 new 0.20) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +[2026-09-12 08:21:40] step 2910/5000 loss 0.2233 (w 0.1865 mse 0.2144 t 981 new 0.16) lr 1.00e-05 gnorm 0.115 3.04s mem 81.1GB +[2026-09-12 08:21:44] step 2911/5000 loss 0.2757 (w 0.2222 mse 0.2515 t 926 new 0.24) lr 1.00e-05 gnorm 0.111 3.41s mem 81.1GB +[2026-09-12 08:21:47] step 2912/5000 loss 0.4092 (w 0.1970 mse 0.2097 t 557 new 0.09) lr 1.00e-05 gnorm 0.189 2.83s mem 81.1GB +[2026-09-12 08:21:50] step 2913/5000 loss 0.1710 (w 0.3133 mse 0.3105 t 768 new 0.24) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +[2026-09-12 08:21:52] step 2914/5000 loss 0.1577 (w 0.3748 mse 0.3910 t 946 new 0.19) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +[2026-09-12 08:21:56] step 2915/5000 loss 0.3943 (w 0.3222 mse 0.3326 t 748 new 0.23) lr 1.00e-05 gnorm 0.172 3.14s mem 81.1GB +[2026-09-12 08:21:59] step 2916/5000 loss 0.2566 (w 0.3673 mse 0.3602 t 957 new 0.26) lr 1.00e-05 gnorm 0.116 3.08s mem 81.1GB +[2026-09-12 08:22:02] step 2917/5000 loss 0.2861 (w 0.2652 mse 0.2741 t 850 new 0.22) lr 1.00e-05 gnorm 0.198 3.32s mem 81.1GB +[2026-09-12 08:22:05] step 2918/5000 loss 0.2747 (w 0.3227 mse 0.3246 t 944 new 0.16) lr 1.00e-05 gnorm 0.104 2.83s mem 81.1GB +[2026-09-12 08:22:08] step 2919/5000 loss 0.2583 (w 0.3699 mse 0.3588 t 988 new 0.23) lr 1.00e-05 gnorm 0.201 3.11s mem 81.1GB +[2026-09-12 08:22:11] step 2920/5000 loss 0.3455 (w 0.3880 mse 0.3923 t 967 new 0.12) lr 1.00e-05 gnorm 0.209 2.83s mem 81.1GB +[2026-09-12 08:22:14] step 2921/5000 loss 0.1983 (w 0.1919 mse 0.1996 t 923 new 0.11) lr 1.00e-05 gnorm 0.147 3.33s mem 81.1GB +[2026-09-12 08:22:17] step 2922/5000 loss 0.4018 (w 0.2109 mse 0.2354 t 677 new 0.19) lr 1.00e-05 gnorm 0.156 3.14s mem 81.1GB +[2026-09-12 08:22:21] step 2923/5000 loss 0.4392 (w 0.1880 mse 0.2094 t 815 new 0.27) lr 1.00e-05 gnorm 0.220 3.32s mem 81.1GB +[2026-09-12 08:22:24] step 2924/5000 loss 0.5513 (w 0.3622 mse 0.3612 t 390 new 0.22) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +[2026-09-12 08:22:27] step 2925/5000 loss 0.4026 (w 0.2559 mse 0.2594 t 885 new 0.14) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +[2026-09-12 08:22:29] step 2926/5000 loss 0.2951 (w 0.1980 mse 0.2099 t 790 new 0.23) lr 1.00e-05 gnorm 0.395 2.84s mem 81.1GB +[2026-09-12 08:22:33] step 2927/5000 loss 0.2852 (w 0.2817 mse 0.2821 t 910 new 0.21) lr 1.00e-05 gnorm 0.318 3.41s mem 81.1GB +[2026-09-12 08:22:36] step 2928/5000 loss 0.2930 (w 0.2125 mse 0.2249 t 963 new 0.08) lr 1.00e-05 gnorm 0.113 3.05s mem 81.1GB +[2026-09-12 08:22:39] step 2929/5000 loss 0.1879 (w 0.2791 mse 0.2943 t 927 new 0.16) lr 1.00e-05 gnorm 0.140 3.38s mem 81.1GB +[2026-09-12 08:22:42] step 2930/5000 loss 0.4309 (w 0.4269 mse 0.4211 t 995 new 0.25) lr 1.00e-05 gnorm 0.422 2.82s mem 81.1GB +[2026-09-12 08:22:45] step 2931/5000 loss 0.3497 (w 0.2052 mse 0.2108 t 768 new 0.25) lr 1.00e-05 gnorm 0.178 3.10s mem 81.1GB +[2026-09-12 08:22:48] step 2932/5000 loss 0.2012 (w 0.3437 mse 0.3481 t 978 new 0.24) lr 1.00e-05 gnorm 0.276 2.82s mem 81.1GB +[2026-09-12 08:22:51] step 2933/5000 loss 0.2324 (w 0.2013 mse 0.2221 t 873 new 0.24) lr 1.00e-05 gnorm 0.136 3.33s mem 81.1GB +[2026-09-12 08:22:55] step 2934/5000 loss 0.3972 (w 0.2744 mse 0.2728 t 584 new 0.17) lr 1.00e-05 gnorm 0.233 3.13s mem 81.1GB +[2026-09-12 08:22:58] step 2935/5000 loss 0.3002 (w 0.2381 mse 0.2567 t 566 new 0.26) lr 1.00e-05 gnorm 0.148 3.07s mem 81.1GB +[2026-09-12 08:23:01] step 2936/5000 loss 0.1452 (w 0.2389 mse 0.2450 t 817 new 0.19) lr 1.00e-05 gnorm 0.132 3.04s mem 81.1GB +[2026-09-12 08:23:03] step 2937/5000 loss 0.3445 (w 0.3072 mse 0.3122 t 666 new 0.30) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +[2026-09-12 08:23:06] step 2938/5000 loss 0.1891 (w 0.1865 mse 0.2133 t 951 new 0.20) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +[2026-09-12 08:23:09] step 2939/5000 loss 0.2582 (w 0.2406 mse 0.2659 t 955 new 0.23) lr 1.00e-05 gnorm 0.131 3.16s mem 81.1GB +[2026-09-12 08:23:13] step 2940/5000 loss 0.4623 (w 0.3337 mse 0.3408 t 323 new 0.17) lr 1.00e-05 gnorm 0.112 3.44s mem 81.1GB +[2026-09-12 08:23:16] step 2941/5000 loss 0.1353 (w 0.2883 mse 0.3054 t 951 new 0.22) lr 1.00e-05 gnorm 0.224 3.07s mem 81.1GB +[2026-09-12 08:23:19] step 2942/5000 loss 0.2354 (w 0.3638 mse 0.3621 t 971 new 0.20) lr 1.00e-05 gnorm 0.134 3.11s mem 81.1GB +[2026-09-12 08:23:22] step 2943/5000 loss 0.2142 (w 0.3373 mse 0.3545 t 988 new 0.20) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +[2026-09-12 08:23:25] step 2944/5000 loss 0.4666 (w 0.4210 mse 0.4223 t 998 new 0.18) lr 1.00e-05 gnorm 0.150 3.30s mem 81.1GB +[2026-09-12 08:23:28] step 2945/5000 loss 0.3705 (w 0.2299 mse 0.2497 t 890 new 0.18) lr 1.00e-05 gnorm 0.130 3.04s mem 81.1GB +[2026-09-12 08:23:32] step 2946/5000 loss 0.2809 (w 0.3529 mse 0.3476 t 961 new 0.21) lr 1.00e-05 gnorm 0.172 3.36s mem 81.1GB +[2026-09-12 08:23:35] step 2947/5000 loss 0.2666 (w 0.2014 mse 0.2117 t 693 new 0.17) lr 1.00e-05 gnorm 0.129 3.26s mem 81.1GB +[2026-09-12 08:23:38] step 2948/5000 loss 0.1907 (w 0.3633 mse 0.3600 t 921 new 0.18) lr 1.00e-05 gnorm 0.164 3.13s mem 81.1GB +[2026-09-12 08:23:41] step 2949/5000 loss 0.3253 (w 0.3565 mse 0.3458 t 934 new 0.15) lr 1.00e-05 gnorm 0.202 2.84s mem 81.1GB +[2026-09-12 08:23:44] step 2950/5000 loss 0.2298 (w 0.2869 mse 0.3029 t 991 new 0.18) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +[2026-09-12 08:23:47] step 2951/5000 loss 0.2089 (w 0.2585 mse 0.2582 t 997 new 0.22) lr 1.00e-05 gnorm 0.646 3.10s mem 81.1GB +[2026-09-12 08:23:50] step 2952/5000 loss 0.3090 (w 0.2342 mse 0.2529 t 965 new 0.13) lr 1.00e-05 gnorm 0.105 3.39s mem 81.1GB +[2026-09-12 08:23:54] step 2953/5000 loss 0.2868 (w 0.3267 mse 0.3317 t 916 new 0.17) lr 1.00e-05 gnorm 0.282 3.27s mem 81.1GB +[2026-09-12 08:23:57] step 2954/5000 loss 0.4351 (w 0.1988 mse 0.2038 t 816 new 0.22) lr 1.00e-05 gnorm 0.134 3.15s mem 81.1GB +[2026-09-12 08:24:00] step 2955/5000 loss 0.2210 (w 0.3651 mse 0.3647 t 899 new 0.18) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +[2026-09-12 08:24:03] step 2956/5000 loss 0.1928 (w 0.3796 mse 0.3846 t 964 new 0.21) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +[2026-09-12 08:24:06] step 2957/5000 loss 0.2090 (w 0.2984 mse 0.3062 t 988 new 0.17) lr 1.00e-05 gnorm 0.174 2.83s mem 81.1GB +[2026-09-12 08:24:09] step 2958/5000 loss 0.3314 (w 0.4164 mse 0.4121 t 434 new 0.19) lr 1.00e-05 gnorm 0.148 3.41s mem 81.1GB +[2026-09-12 08:24:12] step 2959/5000 loss 0.2759 (w 0.3787 mse 0.3724 t 962 new 0.24) lr 1.00e-05 gnorm 0.157 3.09s mem 81.1GB +[2026-09-12 08:24:15] step 2960/5000 loss 0.4644 (w 0.2790 mse 0.2883 t 975 new 0.20) lr 1.00e-05 gnorm 0.157 3.08s mem 81.1GB +[2026-09-12 08:24:18] step 2961/5000 loss 0.4711 (w 0.2370 mse 0.2515 t 850 new 0.22) lr 1.00e-05 gnorm 0.195 2.84s mem 81.1GB +[2026-09-12 08:24:21] step 2962/5000 loss 0.3772 (w 0.2267 mse 0.2530 t 521 new 0.20) lr 1.00e-05 gnorm 0.115 3.10s mem 81.1GB +[2026-09-12 08:24:24] step 2963/5000 loss 0.1728 (w 0.3237 mse 0.3315 t 958 new 0.21) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +[2026-09-12 08:24:28] step 2964/5000 loss 0.2485 (w 0.3090 mse 0.2980 t 981 new 0.25) lr 1.00e-05 gnorm 0.111 3.42s mem 81.1GB +[2026-09-12 08:24:31] step 2965/5000 loss 0.3214 (w 0.2167 mse 0.2315 t 887 new 0.10) lr 1.00e-05 gnorm 0.130 3.14s mem 81.1GB +[2026-09-12 08:24:34] step 2966/5000 loss 0.3658 (w 0.2973 mse 0.3067 t 961 new 0.16) lr 1.00e-05 gnorm 0.347 3.11s mem 81.1GB +[2026-09-12 08:24:37] step 2967/5000 loss 0.3895 (w 0.2550 mse 0.2559 t 731 new 0.21) lr 1.00e-05 gnorm 0.186 2.82s mem 81.1GB +[2026-09-12 08:24:40] step 2968/5000 loss 0.3381 (w 0.3599 mse 0.3716 t 328 new 0.18) lr 1.00e-05 gnorm 0.119 3.12s mem 81.1GB +[2026-09-12 08:24:43] step 2969/5000 loss 0.3212 (w 0.2861 mse 0.2851 t 872 new 0.18) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +[2026-09-12 08:24:46] step 2970/5000 loss 0.4384 (w 0.2216 mse 0.2431 t 653 new 0.23) lr 1.00e-05 gnorm 0.203 3.30s mem 81.1GB +[2026-09-12 08:24:49] step 2971/5000 loss 0.3197 (w 0.2649 mse 0.2778 t 988 new 0.19) lr 1.00e-05 gnorm 0.126 3.39s mem 81.1GB +[2026-09-12 08:24:52] step 2972/5000 loss 0.3065 (w 0.3301 mse 0.3305 t 942 new 0.19) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 08:24:55] step 2973/5000 loss 0.2163 (w 0.3458 mse 0.3507 t 631 new 0.30) lr 1.00e-05 gnorm 0.280 2.83s mem 81.1GB +[2026-09-12 08:24:58] step 2974/5000 loss 0.4036 (w 0.3112 mse 0.3181 t 459 new 0.19) lr 1.00e-05 gnorm 0.206 3.45s mem 81.1GB +[2026-09-12 08:25:01] step 2975/5000 loss 0.2519 (w 0.2420 mse 0.2443 t 999 new 0.18) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +[2026-09-12 08:25:05] step 2976/5000 loss 0.3179 (w 0.2607 mse 0.2810 t 911 new 0.23) lr 1.00e-05 gnorm 0.170 3.33s mem 81.1GB +[2026-09-12 08:25:08] step 2977/5000 loss 0.1860 (w 0.2802 mse 0.2825 t 976 new 0.12) lr 1.00e-05 gnorm 0.118 3.08s mem 81.1GB +[2026-09-12 08:25:11] step 2978/5000 loss 0.2395 (w 0.1884 mse 0.1937 t 797 new 0.06) lr 1.00e-05 gnorm 0.415 2.84s mem 81.1GB +[2026-09-12 08:25:14] step 2979/5000 loss 0.3715 (w 0.3095 mse 0.3130 t 804 new 0.26) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-12 08:25:17] step 2980/5000 loss 0.5029 (w 0.2417 mse 0.2474 t 757 new 0.23) lr 1.00e-05 gnorm 0.136 3.16s mem 81.1GB +[2026-09-12 08:25:20] step 2981/5000 loss 0.3261 (w 0.4497 mse 0.4383 t 1000 new 0.23) lr 1.00e-05 gnorm 0.124 3.01s mem 81.1GB +[2026-09-12 08:25:23] step 2982/5000 loss 0.1510 (w 0.2727 mse 0.2809 t 906 new 0.18) lr 1.00e-05 gnorm 0.148 3.09s mem 81.1GB +[2026-09-12 08:25:26] step 2983/5000 loss 0.1736 (w 0.5765 mse 0.6095 t 146 new 0.19) lr 1.00e-05 gnorm 0.264 3.33s mem 81.1GB +[2026-09-12 08:25:29] step 2984/5000 loss 0.2519 (w 0.2873 mse 0.2940 t 842 new 0.21) lr 1.00e-05 gnorm 0.178 2.84s mem 81.1GB +[2026-09-12 08:25:32] step 2985/5000 loss 0.2760 (w 0.3139 mse 0.3001 t 945 new 0.18) lr 1.00e-05 gnorm 0.110 2.84s mem 81.1GB +[2026-09-12 08:25:35] step 2986/5000 loss 0.2793 (w 0.3159 mse 0.3248 t 960 new 0.25) lr 1.00e-05 gnorm 0.103 3.15s mem 81.1GB +[2026-09-12 08:25:38] step 2987/5000 loss 0.3334 (w 0.3551 mse 0.3773 t 956 new 0.18) lr 1.00e-05 gnorm 0.117 3.04s mem 81.1GB +[2026-09-12 08:25:41] step 2988/5000 loss 0.4440 (w 0.2442 mse 0.2517 t 771 new 0.23) lr 1.00e-05 gnorm 0.118 3.37s mem 81.1GB +[2026-09-12 08:25:45] step 2989/5000 loss 0.3423 (w 0.3734 mse 0.4004 t 332 new 0.23) lr 1.00e-05 gnorm 0.099 3.08s mem 81.1GB +[2026-09-12 08:25:47] step 2990/5000 loss 0.3259 (w 0.2127 mse 0.2228 t 915 new 0.23) lr 1.00e-05 gnorm 0.164 2.82s mem 81.1GB +[2026-09-12 08:25:51] step 2991/5000 loss 0.2073 (w 0.1522 mse 0.1813 t 959 new 0.20) lr 1.00e-05 gnorm 0.113 3.35s mem 81.1GB +[2026-09-12 08:25:54] step 2992/5000 loss 0.3910 (w 0.2086 mse 0.2156 t 821 new 0.19) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +[2026-09-12 08:25:57] step 2993/5000 loss 0.1350 (w 0.3300 mse 0.3270 t 987 new 0.24) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +[2026-09-12 08:26:00] step 2994/5000 loss 0.1377 (w 0.3035 mse 0.3147 t 993 new 0.09) lr 1.00e-05 gnorm 0.097 3.29s mem 81.1GB +[2026-09-12 08:26:03] step 2995/5000 loss 0.2339 (w 0.2613 mse 0.2549 t 841 new 0.21) lr 1.00e-05 gnorm 0.145 3.14s mem 81.1GB +[2026-09-12 08:26:06] step 2996/5000 loss 0.3697 (w 0.3063 mse 0.3083 t 730 new 0.14) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +[2026-09-12 08:26:09] step 2997/5000 loss 0.2631 (w 0.3547 mse 0.3443 t 899 new 0.20) lr 1.00e-05 gnorm 0.202 3.17s mem 81.1GB +[2026-09-12 08:26:12] step 2998/5000 loss 0.4811 (w 0.2342 mse 0.2529 t 871 new 0.20) lr 1.00e-05 gnorm 0.191 3.07s mem 81.1GB +[2026-09-12 08:26:16] step 2999/5000 loss 0.3369 (w 0.4988 mse 0.4865 t 978 new 0.24) lr 1.00e-05 gnorm 0.143 3.24s mem 81.1GB +[2026-09-12 08:26:19] step 3000/5000 loss 0.2658 (w 0.3039 mse 0.3103 t 936 new 0.23) lr 1.00e-05 gnorm 0.208 3.33s mem 81.1GB +[2026-09-12 08:26:21] [val] step 3000 t=200: w=0.4594 mse=0.4776 (n=16) t=500: w=0.2790 mse=0.2939 (n=16) t=800: w=0.2352 mse=0.2470 (n=16) | mean w=0.3246 mse=0.3395 2s +[2026-09-12 08:27:12] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step3000.safetensors 4093 个张量 37.98 GB +[2026-09-12 08:27:17] step 3001/5000 loss 0.2964 (w 0.3190 mse 0.3259 t 942 new 0.26) lr 1.00e-05 gnorm 0.164 3.07s mem 81.1GB +[2026-09-12 08:27:20] step 3002/5000 loss 0.2319 (w 0.2861 mse 0.2881 t 804 new 0.24) lr 1.00e-05 gnorm 0.947 2.83s mem 81.1GB +[2026-09-12 08:27:24] step 3003/5000 loss 0.2326 (w 0.2425 mse 0.2517 t 861 new 0.17) lr 1.00e-05 gnorm 0.117 3.34s mem 81.1GB +[2026-09-12 08:27:26] step 3004/5000 loss 0.0697 (w 0.2481 mse 0.2727 t 969 new 0.16) lr 1.00e-05 gnorm 0.101 2.82s mem 81.1GB +[2026-09-12 08:27:30] step 3005/5000 loss 0.2886 (w 0.3188 mse 0.3286 t 972 new 0.25) lr 1.00e-05 gnorm 0.140 3.56s mem 81.1GB +[2026-09-12 08:27:33] step 3006/5000 loss 0.2682 (w 0.2660 mse 0.2696 t 942 new 0.09) lr 1.00e-05 gnorm 0.179 2.83s mem 81.1GB +[2026-09-12 08:27:36] step 3007/5000 loss 0.2797 (w 0.2783 mse 0.2786 t 821 new 0.21) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +[2026-09-12 08:27:39] step 3008/5000 loss 0.2432 (w 0.2641 mse 0.2704 t 868 new 0.22) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-12 08:27:42] step 3009/5000 loss 0.1914 (w 0.3497 mse 0.3618 t 921 new 0.20) lr 1.00e-05 gnorm 0.127 3.38s mem 81.1GB +[2026-09-12 08:27:45] step 3010/5000 loss 0.3532 (w 0.2463 mse 0.2452 t 706 new 0.09) lr 1.00e-05 gnorm 0.175 2.83s mem 81.1GB +[2026-09-12 08:27:48] step 3011/5000 loss 0.3181 (w 0.3059 mse 0.3139 t 979 new 0.16) lr 1.00e-05 gnorm 0.196 3.37s mem 81.1GB +[2026-09-12 08:27:51] step 3012/5000 loss 0.2262 (w 0.2427 mse 0.2499 t 948 new 0.07) lr 1.00e-05 gnorm 0.617 2.84s mem 81.1GB +[2026-09-12 08:27:54] step 3013/5000 loss 0.2431 (w 0.2892 mse 0.2938 t 960 new 0.23) lr 1.00e-05 gnorm 0.117 3.09s mem 81.1GB +[2026-09-12 08:27:57] step 3014/5000 loss 0.4702 (w 0.2645 mse 0.2812 t 958 new 0.24) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +[2026-09-12 08:28:00] step 3015/5000 loss 0.2432 (w 0.2445 mse 0.2621 t 876 new 0.16) lr 1.00e-05 gnorm 0.121 3.31s mem 81.1GB +[2026-09-12 08:28:04] step 3016/5000 loss 0.3435 (w 0.2702 mse 0.2745 t 875 new 0.16) lr 1.00e-05 gnorm 0.117 3.05s mem 81.1GB +[2026-09-12 08:28:07] step 3017/5000 loss 0.2991 (w 0.3821 mse 0.4165 t 254 new 0.26) lr 1.00e-05 gnorm 0.162 3.34s mem 81.1GB +[2026-09-12 08:28:10] step 3018/5000 loss 0.3830 (w 0.2399 mse 0.2444 t 626 new 0.20) lr 1.00e-05 gnorm 0.126 2.83s mem 81.1GB +[2026-09-12 08:28:13] step 3019/5000 loss 0.2737 (w 0.2995 mse 0.2954 t 881 new 0.15) lr 1.00e-05 gnorm 0.169 3.07s mem 81.1GB +[2026-09-12 08:28:16] step 3020/5000 loss 0.3302 (w 0.2902 mse 0.2939 t 659 new 0.25) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +[2026-09-12 08:28:19] step 3021/5000 loss 0.4017 (w 0.3235 mse 0.3346 t 947 new 0.21) lr 1.00e-05 gnorm 0.135 3.35s mem 81.1GB +[2026-09-12 08:28:22] step 3022/5000 loss 0.2374 (w 0.2452 mse 0.2525 t 822 new 0.21) lr 1.00e-05 gnorm 0.159 3.07s mem 81.1GB +[2026-09-12 08:28:25] step 3023/5000 loss 0.1511 (w 0.2986 mse 0.3038 t 970 new 0.18) lr 1.00e-05 gnorm 0.146 3.09s mem 81.1GB +[2026-09-12 08:28:28] step 3024/5000 loss 0.4016 (w 0.2985 mse 0.2993 t 960 new 0.27) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +[2026-09-12 08:28:31] step 3025/5000 loss 0.2360 (w 0.4176 mse 0.4129 t 993 new 0.24) lr 1.00e-05 gnorm 0.126 3.07s mem 81.1GB +[2026-09-12 08:28:34] step 3026/5000 loss 0.1481 (w 0.2839 mse 0.3069 t 993 new 0.11) lr 1.00e-05 gnorm 0.149 3.09s mem 81.1GB +[2026-09-12 08:28:37] step 3027/5000 loss 0.3124 (w 0.2899 mse 0.3162 t 999 new 0.18) lr 1.00e-05 gnorm 0.110 3.07s mem 81.1GB +[2026-09-12 08:28:41] step 3028/5000 loss 0.2564 (w 0.3451 mse 0.3599 t 977 new 0.24) lr 1.00e-05 gnorm 0.135 3.36s mem 81.1GB +[2026-09-12 08:28:44] step 3029/5000 loss 0.2304 (w 0.1701 mse 0.1866 t 629 new 0.10) lr 1.00e-05 gnorm 0.228 3.13s mem 81.1GB +[2026-09-12 08:28:47] step 3030/5000 loss 0.1131 (w 0.3228 mse 0.3279 t 980 new 0.24) lr 1.00e-05 gnorm 0.101 2.84s mem 81.1GB +[2026-09-12 08:28:50] step 3031/5000 loss 0.2227 (w 0.2929 mse 0.2983 t 796 new 0.16) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +[2026-09-12 08:28:53] step 3032/5000 loss 0.2957 (w 0.2640 mse 0.2611 t 943 new 0.16) lr 1.00e-05 gnorm 0.141 3.13s mem 81.1GB +[2026-09-12 08:28:56] step 3033/5000 loss 0.1998 (w 0.3080 mse 0.3145 t 974 new 0.23) lr 1.00e-05 gnorm 0.246 3.06s mem 81.1GB +[2026-09-12 08:28:59] step 3034/5000 loss 0.1930 (w 0.2520 mse 0.2588 t 858 new 0.24) lr 1.00e-05 gnorm 0.150 3.35s mem 81.1GB +[2026-09-12 08:29:02] step 3035/5000 loss 0.2346 (w 0.3993 mse 0.4051 t 278 new 0.23) lr 1.00e-05 gnorm 0.123 3.05s mem 81.1GB +[2026-09-12 08:29:05] step 3036/5000 loss 0.3075 (w 0.3609 mse 0.3686 t 969 new 0.24) lr 1.00e-05 gnorm 0.160 2.82s mem 81.1GB +[2026-09-12 08:29:08] step 3037/5000 loss 0.3481 (w 0.2164 mse 0.2235 t 913 new 0.24) lr 1.00e-05 gnorm 0.124 3.17s mem 81.1GB +[2026-09-12 08:29:11] step 3038/5000 loss 0.2508 (w 0.3375 mse 0.3454 t 936 new 0.21) lr 1.00e-05 gnorm 0.099 3.14s mem 81.1GB +[2026-09-12 08:29:15] step 3039/5000 loss 0.2550 (w 0.3642 mse 0.3759 t 958 new 0.22) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +[2026-09-12 08:29:18] step 3040/5000 loss 0.2971 (w 0.1599 mse 0.1741 t 641 new 0.20) lr 1.00e-05 gnorm 0.155 3.37s mem 81.1GB +[2026-09-12 08:29:21] step 3041/5000 loss 0.1657 (w 0.2403 mse 0.2633 t 977 new 0.23) lr 1.00e-05 gnorm 0.137 3.09s mem 81.1GB +[2026-09-12 08:29:24] step 3042/5000 loss 0.2288 (w 0.3553 mse 0.3744 t 956 new 0.20) lr 1.00e-05 gnorm 0.140 3.09s mem 81.1GB +[2026-09-12 08:29:27] step 3043/5000 loss 0.3280 (w 0.3333 mse 0.3273 t 741 new 0.13) lr 1.00e-05 gnorm 0.125 2.83s mem 81.1GB +[2026-09-12 08:29:30] step 3044/5000 loss 0.2681 (w 0.2477 mse 0.2486 t 901 new 0.02) lr 1.00e-05 gnorm 0.125 3.08s mem 81.1GB +[2026-09-12 08:29:33] step 3045/5000 loss 0.2792 (w 0.2045 mse 0.2141 t 854 new 0.20) lr 1.00e-05 gnorm 0.124 3.35s mem 81.1GB +[2026-09-12 08:29:37] step 3046/5000 loss 0.4308 (w 0.3250 mse 0.3281 t 418 new 0.14) lr 1.00e-05 gnorm 0.184 3.36s mem 81.1GB +[2026-09-12 08:29:40] step 3047/5000 loss 0.2238 (w 0.2737 mse 0.2748 t 983 new 0.12) lr 1.00e-05 gnorm 0.186 3.09s mem 81.1GB +[2026-09-12 08:29:43] step 3048/5000 loss 0.2599 (w 0.3012 mse 0.3300 t 375 new 0.17) lr 1.00e-05 gnorm 0.146 3.14s mem 81.1GB +[2026-09-12 08:29:46] step 3049/5000 loss 0.4100 (w 0.3740 mse 0.3799 t 897 new 0.19) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +[2026-09-12 08:29:49] step 3050/5000 loss 0.1365 (w 0.2364 mse 0.2576 t 994 new 0.23) lr 1.00e-05 gnorm 0.108 3.10s mem 81.1GB +[2026-09-12 08:29:52] step 3051/5000 loss 0.2417 (w 0.2260 mse 0.2320 t 865 new 0.20) lr 1.00e-05 gnorm 0.150 3.40s mem 81.1GB +[2026-09-12 08:29:55] step 3052/5000 loss 0.3591 (w 0.2108 mse 0.2208 t 945 new 0.15) lr 1.00e-05 gnorm 0.129 2.86s mem 81.1GB +[2026-09-12 08:29:58] step 3053/5000 loss 0.2303 (w 0.3316 mse 0.3442 t 987 new 0.22) lr 1.00e-05 gnorm 0.112 3.15s mem 81.1GB +[2026-09-12 08:30:02] step 3054/5000 loss 0.3790 (w 0.3637 mse 0.3659 t 492 new 0.25) lr 1.00e-05 gnorm 0.112 3.10s mem 81.1GB +[2026-09-12 08:30:04] step 3055/5000 loss 0.2218 (w 0.3084 mse 0.3181 t 992 new 0.22) lr 1.00e-05 gnorm 0.534 2.85s mem 81.1GB +[2026-09-12 08:30:08] step 3056/5000 loss 0.3683 (w 0.2781 mse 0.2880 t 869 new 0.18) lr 1.00e-05 gnorm 0.120 3.17s mem 81.1GB +[2026-09-12 08:30:11] step 3057/5000 loss 0.4333 (w 0.2818 mse 0.2968 t 917 new 0.23) lr 1.00e-05 gnorm 0.115 3.37s mem 81.1GB +[2026-09-12 08:30:14] step 3058/5000 loss 0.2540 (w 0.3127 mse 0.3242 t 673 new 0.27) lr 1.00e-05 gnorm 0.160 3.09s mem 81.1GB +[2026-09-12 08:30:17] step 3059/5000 loss 0.3787 (w 0.3479 mse 0.3441 t 881 new 0.15) lr 1.00e-05 gnorm 0.183 2.84s mem 81.1GB +[2026-09-12 08:30:20] step 3060/5000 loss 0.2422 (w 0.3873 mse 0.3941 t 945 new 0.26) lr 1.00e-05 gnorm 0.125 3.13s mem 81.1GB +[2026-09-12 08:30:23] step 3061/5000 loss 0.3327 (w 0.2106 mse 0.2165 t 833 new 0.10) lr 1.00e-05 gnorm 0.107 3.10s mem 81.1GB +[2026-09-12 08:30:26] step 3062/5000 loss 0.2107 (w 0.2986 mse 0.3059 t 898 new 0.22) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 08:30:29] step 3063/5000 loss 0.4047 (w 0.2151 mse 0.2256 t 762 new 0.20) lr 1.00e-05 gnorm 0.126 3.38s mem 81.1GB +[2026-09-12 08:30:32] step 3064/5000 loss 0.2655 (w 0.2246 mse 0.2429 t 663 new 0.15) lr 1.00e-05 gnorm 0.116 3.09s mem 81.1GB +[2026-09-12 08:30:36] step 3065/5000 loss 0.2184 (w 0.2907 mse 0.3048 t 957 new 0.23) lr 1.00e-05 gnorm 0.240 3.09s mem 81.1GB +[2026-09-12 08:30:38] step 3066/5000 loss 0.3172 (w 0.3608 mse 0.3486 t 945 new 0.21) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +[2026-09-12 08:30:41] step 3067/5000 loss 0.1994 (w 0.3330 mse 0.3494 t 997 new 0.18) lr 1.00e-05 gnorm 0.089 3.11s mem 81.1GB +[2026-09-12 08:30:44] step 3068/5000 loss 0.1737 (w 0.2291 mse 0.2379 t 893 new 0.14) lr 1.00e-05 gnorm 0.287 2.84s mem 81.1GB +[2026-09-12 08:30:48] step 3069/5000 loss 0.2494 (w 0.2348 mse 0.2485 t 821 new 0.15) lr 1.00e-05 gnorm 0.109 3.36s mem 81.1GB +[2026-09-12 08:30:51] step 3070/5000 loss 0.4544 (w 0.3064 mse 0.3123 t 837 new 0.23) lr 1.00e-05 gnorm 0.157 3.29s mem 81.1GB +[2026-09-12 08:30:54] step 3071/5000 loss 0.1832 (w 0.2372 mse 0.2701 t 971 new 0.20) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-12 08:30:57] step 3072/5000 loss 0.3301 (w 0.3009 mse 0.3116 t 931 new 0.09) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +[2026-09-12 08:31:00] step 3073/5000 loss 0.4151 (w 0.5009 mse 0.5176 t 988 new 0.16) lr 1.00e-05 gnorm 0.139 3.17s mem 81.1GB +[2026-09-12 08:31:03] step 3074/5000 loss 0.2875 (w 0.2538 mse 0.2638 t 994 new 0.19) lr 1.00e-05 gnorm 0.164 3.12s mem 81.1GB +[2026-09-12 08:31:06] step 3075/5000 loss 0.3541 (w 0.3035 mse 0.2989 t 955 new 0.22) lr 1.00e-05 gnorm 0.114 3.11s mem 81.1GB +[2026-09-12 08:31:09] step 3076/5000 loss 0.3536 (w 0.2499 mse 0.2594 t 882 new 0.22) lr 1.00e-05 gnorm 0.113 3.13s mem 81.1GB +[2026-09-12 08:31:13] step 3077/5000 loss 0.2569 (w 0.3744 mse 0.3609 t 988 new 0.22) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +[2026-09-12 08:31:15] step 3078/5000 loss 0.3723 (w 0.3137 mse 0.3252 t 924 new 0.21) lr 1.00e-05 gnorm 0.290 2.85s mem 81.1GB +[2026-09-12 08:31:19] step 3079/5000 loss 0.3215 (w 0.2199 mse 0.2332 t 856 new 0.18) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +[2026-09-12 08:31:22] step 3080/5000 loss 0.2980 (w 0.2679 mse 0.2647 t 875 new 0.21) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +[2026-09-12 08:31:25] step 3081/5000 loss 0.3730 (w 0.2606 mse 0.2626 t 582 new 0.14) lr 1.00e-05 gnorm 0.156 3.06s mem 81.1GB +[2026-09-12 08:31:28] step 3082/5000 loss 0.1327 (w 0.2611 mse 0.2780 t 915 new 0.17) lr 1.00e-05 gnorm 0.106 3.15s mem 81.1GB +[2026-09-12 08:31:31] step 3083/5000 loss 0.1936 (w 0.2952 mse 0.3005 t 919 new 0.20) lr 1.00e-05 gnorm 0.105 3.11s mem 81.1GB +[2026-09-12 08:31:34] step 3084/5000 loss 0.2143 (w 0.2468 mse 0.2565 t 783 new 0.17) lr 1.00e-05 gnorm 0.133 2.85s mem 81.1GB +[2026-09-12 08:31:37] step 3085/5000 loss 0.3394 (w 0.3655 mse 0.3769 t 447 new 0.23) lr 1.00e-05 gnorm 0.157 3.16s mem 81.1GB +[2026-09-12 08:31:40] step 3086/5000 loss 0.3838 (w 0.2476 mse 0.2519 t 743 new 0.22) lr 1.00e-05 gnorm 0.196 3.11s mem 81.1GB +[2026-09-12 08:31:43] step 3087/5000 loss 0.2440 (w 0.4488 mse 0.4387 t 989 new 0.19) lr 1.00e-05 gnorm 0.124 3.32s mem 81.1GB +[2026-09-12 08:31:47] step 3088/5000 loss 0.4394 (w 0.2318 mse 0.2398 t 792 new 0.20) lr 1.00e-05 gnorm 0.143 3.21s mem 81.1GB +[2026-09-12 08:31:50] step 3089/5000 loss 0.1235 (w 0.2623 mse 0.2721 t 885 new 0.22) lr 1.00e-05 gnorm 0.135 3.07s mem 81.1GB +[2026-09-12 08:31:53] step 3090/5000 loss 0.3466 (w 0.1856 mse 0.1892 t 628 new 0.16) lr 1.00e-05 gnorm 0.089 3.11s mem 81.1GB +[2026-09-12 08:31:56] step 3091/5000 loss 0.2514 (w 0.2530 mse 0.2653 t 908 new 0.23) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +[2026-09-12 08:31:59] step 3092/5000 loss 0.2914 (w 0.2530 mse 0.2608 t 717 new 0.22) lr 1.00e-05 gnorm 0.135 3.32s mem 81.1GB +[2026-09-12 08:32:02] step 3093/5000 loss 0.2296 (w 0.2714 mse 0.2757 t 887 new 0.23) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +[2026-09-12 08:32:05] step 3094/5000 loss 0.2987 (w 0.2939 mse 0.3166 t 424 new 0.25) lr 1.00e-05 gnorm 0.133 3.14s mem 81.1GB +[2026-09-12 08:32:08] step 3095/5000 loss 0.1549 (w 0.4333 mse 0.4213 t 994 new 0.25) lr 1.00e-05 gnorm 0.104 3.06s mem 81.1GB +[2026-09-12 08:32:11] step 3096/5000 loss 0.3850 (w 0.2733 mse 0.2745 t 657 new 0.24) lr 1.00e-05 gnorm 0.122 3.13s mem 81.1GB +[2026-09-12 08:32:14] step 3097/5000 loss 0.2638 (w 0.2916 mse 0.2980 t 850 new 0.18) lr 1.00e-05 gnorm 0.209 2.84s mem 81.1GB +[2026-09-12 08:32:18] step 3098/5000 loss 0.2080 (w 0.3015 mse 0.3079 t 976 new 0.26) lr 1.00e-05 gnorm 0.104 3.43s mem 81.1GB +[2026-09-12 08:32:21] step 3099/5000 loss 0.1897 (w 0.3106 mse 0.3251 t 981 new 0.21) lr 1.00e-05 gnorm 0.124 3.08s mem 81.1GB +[2026-09-12 08:32:24] step 3100/5000 loss 0.3954 (w 0.3402 mse 0.3420 t 876 new 0.22) lr 1.00e-05 gnorm 0.148 3.06s mem 81.1GB +[2026-09-12 08:32:27] step 3101/5000 loss 0.2185 (w 0.2994 mse 0.2948 t 916 new 0.18) lr 1.00e-05 gnorm 0.263 3.10s mem 81.1GB +[2026-09-12 08:32:30] step 3102/5000 loss 0.1667 (w 0.1862 mse 0.2147 t 987 new 0.26) lr 1.00e-05 gnorm 0.115 3.16s mem 81.1GB +[2026-09-12 08:32:33] step 3103/5000 loss 0.1683 (w 0.3108 mse 0.3125 t 917 new 0.18) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +[2026-09-12 08:32:36] step 3104/5000 loss 0.3065 (w 0.2318 mse 0.2397 t 816 new 0.22) lr 1.00e-05 gnorm 0.192 3.37s mem 81.1GB +[2026-09-12 08:32:39] step 3105/5000 loss 0.3608 (w 0.3111 mse 0.3079 t 768 new 0.21) lr 1.00e-05 gnorm 0.158 3.12s mem 81.1GB +[2026-09-12 08:32:43] step 3106/5000 loss 0.3008 (w 0.2783 mse 0.2840 t 999 new 0.02) lr 1.00e-05 gnorm 0.174 3.42s mem 81.1GB +[2026-09-12 08:32:46] step 3107/5000 loss 0.1850 (w 0.2557 mse 0.2700 t 873 new 0.15) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +[2026-09-12 08:32:49] step 3108/5000 loss 0.3182 (w 0.2965 mse 0.2908 t 834 new 0.21) lr 1.00e-05 gnorm 0.164 3.15s mem 81.1GB +[2026-09-12 08:32:52] step 3109/5000 loss 0.1803 (w 0.2073 mse 0.2212 t 1000 new 0.24) lr 1.00e-05 gnorm 0.124 3.01s mem 81.1GB +[2026-09-12 08:32:55] step 3110/5000 loss 0.4276 (w 0.2695 mse 0.2802 t 668 new 0.21) lr 1.00e-05 gnorm 0.121 3.39s mem 81.1GB +[2026-09-12 08:32:58] step 3111/5000 loss 0.2295 (w 0.3222 mse 0.3377 t 938 new 0.25) lr 1.00e-05 gnorm 0.104 3.15s mem 81.1GB +[2026-09-12 08:33:01] step 3112/5000 loss 0.2642 (w 0.4158 mse 0.4236 t 971 new 0.22) lr 1.00e-05 gnorm 0.092 3.05s mem 81.1GB +[2026-09-12 08:33:04] step 3113/5000 loss 0.1763 (w 0.3268 mse 0.3209 t 863 new 0.21) lr 1.00e-05 gnorm 0.485 2.85s mem 81.1GB +[2026-09-12 08:33:07] step 3114/5000 loss 0.3714 (w 0.3108 mse 0.3098 t 901 new 0.18) lr 1.00e-05 gnorm 0.107 3.17s mem 81.1GB +[2026-09-12 08:33:11] step 3115/5000 loss 0.2233 (w 0.2814 mse 0.2950 t 973 new 0.18) lr 1.00e-05 gnorm 0.181 3.15s mem 81.1GB +[2026-09-12 08:33:14] step 3116/5000 loss 0.2021 (w 0.3857 mse 0.3887 t 962 new 0.22) lr 1.00e-05 gnorm 0.113 3.03s mem 81.1GB +[2026-09-12 08:33:17] step 3117/5000 loss 0.2372 (w 0.2871 mse 0.2994 t 996 new 0.12) lr 1.00e-05 gnorm 0.114 3.31s mem 81.1GB +[2026-09-12 08:33:20] step 3118/5000 loss 0.1701 (w 0.1818 mse 0.2060 t 991 new 0.14) lr 1.00e-05 gnorm 0.085 3.06s mem 81.1GB +[2026-09-12 08:33:23] step 3119/5000 loss 0.2216 (w 0.2761 mse 0.2766 t 915 new 0.19) lr 1.00e-05 gnorm 0.103 3.11s mem 81.1GB +[2026-09-12 08:33:26] step 3120/5000 loss 0.4052 (w 0.3189 mse 0.3274 t 506 new 0.23) lr 1.00e-05 gnorm 0.135 2.83s mem 81.1GB +[2026-09-12 08:33:29] step 3121/5000 loss 0.2332 (w 0.4256 mse 0.4425 t 990 new 0.25) lr 1.00e-05 gnorm 0.126 3.05s mem 81.1GB +[2026-09-12 08:33:32] step 3122/5000 loss 0.2556 (w 0.3075 mse 0.3036 t 923 new 0.23) lr 1.00e-05 gnorm 0.180 3.08s mem 81.1GB +[2026-09-12 08:33:35] step 3123/5000 loss 0.4274 (w 0.3693 mse 0.3745 t 386 new 0.22) lr 1.00e-05 gnorm 0.165 3.14s mem 81.1GB +[2026-09-12 08:33:38] step 3124/5000 loss 0.3391 (w 0.2903 mse 0.2881 t 914 new 0.21) lr 1.00e-05 gnorm 0.108 3.07s mem 81.1GB +[2026-09-12 08:33:41] step 3125/5000 loss 0.4453 (w 0.3230 mse 0.3155 t 943 new 0.17) lr 1.00e-05 gnorm 0.162 3.17s mem 81.1GB +[2026-09-12 08:33:44] step 3126/5000 loss 0.2597 (w 0.2939 mse 0.3011 t 656 new 0.25) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +[2026-09-12 08:33:47] step 3127/5000 loss 0.2722 (w 0.2416 mse 0.2567 t 865 new 0.24) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +[2026-09-12 08:33:51] step 3128/5000 loss 0.3720 (w 0.2430 mse 0.2540 t 899 new 0.27) lr 1.00e-05 gnorm 0.142 3.20s mem 81.1GB +[2026-09-12 08:33:54] step 3129/5000 loss 0.3008 (w 0.2150 mse 0.2291 t 607 new 0.21) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +[2026-09-12 08:33:57] step 3130/5000 loss 0.3551 (w 0.3241 mse 0.3260 t 946 new 0.15) lr 1.00e-05 gnorm 0.156 3.13s mem 81.1GB +[2026-09-12 08:34:00] step 3131/5000 loss 0.3489 (w 0.2794 mse 0.2784 t 907 new 0.21) lr 1.00e-05 gnorm 0.143 3.16s mem 81.1GB +[2026-09-12 08:34:03] step 3132/5000 loss 0.2846 (w 0.3382 mse 0.3457 t 607 new 0.23) lr 1.00e-05 gnorm 0.105 2.83s mem 81.1GB +[2026-09-12 08:34:06] step 3133/5000 loss 0.3622 (w 0.2504 mse 0.2742 t 705 new 0.15) lr 1.00e-05 gnorm 0.120 3.33s mem 81.1GB +[2026-09-12 08:34:09] step 3134/5000 loss 0.3163 (w 0.2240 mse 0.2483 t 379 new 0.23) lr 1.00e-05 gnorm 0.115 3.23s mem 81.1GB +[2026-09-12 08:34:13] step 3135/5000 loss 0.3058 (w 0.2647 mse 0.2797 t 839 new 0.18) lr 1.00e-05 gnorm 0.148 3.13s mem 81.1GB +[2026-09-12 08:34:16] step 3136/5000 loss 0.2089 (w 0.1699 mse 0.1931 t 937 new 0.22) lr 1.00e-05 gnorm 0.129 3.10s mem 81.1GB +[2026-09-12 08:34:19] step 3137/5000 loss 0.3759 (w 0.3858 mse 0.3889 t 537 new 0.06) lr 1.00e-05 gnorm 0.163 3.10s mem 81.1GB +[2026-09-12 08:34:22] step 3138/5000 loss 0.2903 (w 0.2737 mse 0.2771 t 948 new 0.19) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +[2026-09-12 08:34:25] step 3139/5000 loss 0.2557 (w 0.2334 mse 0.2619 t 948 new 0.17) lr 1.00e-05 gnorm 0.113 3.08s mem 81.1GB +[2026-09-12 08:34:28] step 3140/5000 loss 0.3651 (w 0.9800 mse 0.9937 t 1000 new 0.19) lr 1.00e-05 gnorm 0.116 3.39s mem 81.1GB +[2026-09-12 08:34:31] step 3141/5000 loss 0.3305 (w 0.6843 mse 0.6884 t 134 new 0.19) lr 1.00e-05 gnorm 0.146 2.85s mem 81.1GB +[2026-09-12 08:34:34] step 3142/5000 loss 0.4161 (w 0.4632 mse 0.4656 t 991 new 0.19) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +[2026-09-12 08:34:37] step 3143/5000 loss 0.1889 (w 0.3555 mse 0.3891 t 999 new 0.19) lr 1.00e-05 gnorm 0.143 3.18s mem 81.1GB +[2026-09-12 08:34:40] step 3144/5000 loss 0.2065 (w 0.2853 mse 0.3050 t 827 new 0.22) lr 1.00e-05 gnorm 0.090 2.83s mem 81.1GB +[2026-09-12 08:34:43] step 3145/5000 loss 0.2745 (w 0.2903 mse 0.2907 t 828 new 0.23) lr 1.00e-05 gnorm 0.143 3.10s mem 81.1GB +[2026-09-12 08:34:46] step 3146/5000 loss 0.3987 (w 0.2780 mse 0.2790 t 835 new 0.13) lr 1.00e-05 gnorm 0.139 3.30s mem 81.1GB +[2026-09-12 08:34:49] step 3147/5000 loss 0.3286 (w 0.2612 mse 0.2719 t 647 new 0.27) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-12 08:34:53] step 3148/5000 loss 0.3896 (w 0.4496 mse 0.4560 t 292 new 0.20) lr 1.00e-05 gnorm 0.127 3.42s mem 81.1GB +[2026-09-12 08:34:56] step 3149/5000 loss 0.1410 (w 0.2896 mse 0.3034 t 992 new 0.21) lr 1.00e-05 gnorm 0.333 2.84s mem 81.1GB +[2026-09-12 08:34:59] step 3150/5000 loss 0.2673 (w 0.3449 mse 0.3647 t 973 new 0.23) lr 1.00e-05 gnorm 0.117 3.06s mem 81.1GB +[2026-09-12 08:35:02] step 3151/5000 loss 0.4763 (w 0.5494 mse 0.5672 t 159 new 0.25) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +[2026-09-12 08:35:05] step 3152/5000 loss 0.2206 (w 0.2828 mse 0.3012 t 982 new 0.19) lr 1.00e-05 gnorm 0.127 3.29s mem 81.1GB +[2026-09-12 08:35:08] step 3153/5000 loss 0.4016 (w 0.3177 mse 0.3124 t 766 new 0.20) lr 1.00e-05 gnorm 0.200 2.85s mem 81.1GB +[2026-09-12 08:35:11] step 3154/5000 loss 0.2975 (w 0.3176 mse 0.3299 t 948 new 0.20) lr 1.00e-05 gnorm 0.127 3.46s mem 81.1GB +[2026-09-12 08:35:14] step 3155/5000 loss 0.4052 (w 0.3573 mse 0.3480 t 947 new 0.12) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +[2026-09-12 08:35:17] step 3156/5000 loss 0.2009 (w 0.3117 mse 0.3069 t 931 new 0.14) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +[2026-09-12 08:35:20] step 3157/5000 loss 0.2730 (w 0.4492 mse 0.4585 t 984 new 0.19) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +[2026-09-12 08:35:23] step 3158/5000 loss 0.2326 (w 0.2005 mse 0.2188 t 753 new 0.18) lr 1.00e-05 gnorm 0.119 3.38s mem 81.1GB +[2026-09-12 08:35:26] step 3159/5000 loss 0.2455 (w 0.2463 mse 0.2683 t 853 new 0.22) lr 1.00e-05 gnorm 0.112 3.14s mem 81.1GB +[2026-09-12 08:35:30] step 3160/5000 loss 0.1949 (w 0.2744 mse 0.2858 t 868 new 0.23) lr 1.00e-05 gnorm 0.323 3.31s mem 81.1GB +[2026-09-12 08:35:33] step 3161/5000 loss 0.2035 (w 0.3886 mse 0.4165 t 980 new 0.20) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +[2026-09-12 08:35:36] step 3162/5000 loss 0.3390 (w 0.2971 mse 0.3263 t 975 new 0.21) lr 1.00e-05 gnorm 0.180 3.38s mem 81.1GB +[2026-09-12 08:35:39] step 3163/5000 loss 0.3294 (w 0.2314 mse 0.2427 t 875 new 0.23) lr 1.00e-05 gnorm 0.129 3.03s mem 81.1GB +[2026-09-12 08:35:42] step 3164/5000 loss 0.1786 (w 0.3747 mse 0.3699 t 960 new 0.26) lr 1.00e-05 gnorm 0.101 3.12s mem 81.1GB +[2026-09-12 08:35:45] step 3165/5000 loss 0.3230 (w 0.2804 mse 0.2857 t 965 new 0.20) lr 1.00e-05 gnorm 0.108 3.04s mem 81.1GB +[2026-09-12 08:35:48] step 3166/5000 loss 0.3280 (w 0.3558 mse 0.3664 t 450 new 0.25) lr 1.00e-05 gnorm 0.126 3.12s mem 81.1GB +[2026-09-12 08:35:51] step 3167/5000 loss 0.2670 (w 0.3597 mse 0.3551 t 949 new 0.20) lr 1.00e-05 gnorm 0.356 2.83s mem 81.1GB +[2026-09-12 08:35:54] step 3168/5000 loss 0.1457 (w 0.2381 mse 0.2472 t 954 new 0.22) lr 1.00e-05 gnorm 0.097 3.28s mem 81.1GB +[2026-09-12 08:35:58] step 3169/5000 loss 0.4229 (w 0.2898 mse 0.3107 t 968 new 0.20) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +[2026-09-12 08:36:01] step 3170/5000 loss 0.3045 (w 0.3175 mse 0.3189 t 984 new 0.19) lr 1.00e-05 gnorm 0.152 3.13s mem 81.1GB +[2026-09-12 08:36:04] step 3171/5000 loss 0.2133 (w 0.3913 mse 0.3973 t 990 new 0.17) lr 1.00e-05 gnorm 0.152 3.11s mem 81.1GB +[2026-09-12 08:36:07] step 3172/5000 loss 0.3589 (w 0.2658 mse 0.2704 t 902 new 0.27) lr 1.00e-05 gnorm 0.115 3.17s mem 81.1GB +[2026-09-12 08:36:10] step 3173/5000 loss 0.2181 (w 0.3518 mse 0.3530 t 624 new 0.20) lr 1.00e-05 gnorm 0.281 2.83s mem 81.1GB +[2026-09-12 08:36:13] step 3174/5000 loss 0.3096 (w 0.2069 mse 0.2162 t 942 new 0.18) lr 1.00e-05 gnorm 0.202 3.09s mem 81.1GB +[2026-09-12 08:36:16] step 3175/5000 loss 0.3077 (w 0.2330 mse 0.2302 t 675 new 0.24) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +[2026-09-12 08:36:19] step 3176/5000 loss 0.4479 (w 0.2632 mse 0.2813 t 328 new 0.10) lr 1.00e-05 gnorm 0.194 3.05s mem 81.1GB +[2026-09-12 08:36:22] step 3177/5000 loss 0.2864 (w 0.3286 mse 0.3163 t 868 new 0.21) lr 1.00e-05 gnorm 0.176 3.42s mem 81.1GB +[2026-09-12 08:36:25] step 3178/5000 loss 0.3276 (w 0.2324 mse 0.2438 t 921 new 0.21) lr 1.00e-05 gnorm 0.250 2.84s mem 81.1GB +[2026-09-12 08:36:28] step 3179/5000 loss 0.2891 (w 0.2390 mse 0.2501 t 803 new 0.27) lr 1.00e-05 gnorm 0.100 2.84s mem 81.1GB +[2026-09-12 08:36:31] step 3180/5000 loss 0.4226 (w 0.3803 mse 0.3947 t 978 new 0.13) lr 1.00e-05 gnorm 0.105 3.11s mem 81.1GB +[2026-09-12 08:36:34] step 3181/5000 loss 0.2660 (w 0.2916 mse 0.3033 t 977 new 0.21) lr 1.00e-05 gnorm 0.083 3.10s mem 81.1GB +[2026-09-12 08:36:37] step 3182/5000 loss 0.3209 (w 0.2430 mse 0.2482 t 783 new 0.21) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-12 08:36:41] step 3183/5000 loss 0.3302 (w 0.2683 mse 0.2761 t 693 new 0.22) lr 1.00e-05 gnorm 0.112 3.38s mem 81.1GB +[2026-09-12 08:36:44] step 3184/5000 loss 0.4005 (w 0.2831 mse 0.2988 t 976 new 0.26) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +[2026-09-12 08:36:47] step 3185/5000 loss 0.3229 (w 0.2026 mse 0.2216 t 856 new 0.14) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +[2026-09-12 08:36:50] step 3186/5000 loss 0.2444 (w 0.2360 mse 0.2434 t 607 new 0.12) lr 1.00e-05 gnorm 0.092 3.10s mem 81.1GB +[2026-09-12 08:36:53] step 3187/5000 loss 0.1974 (w 0.2213 mse 0.2297 t 898 new 0.20) lr 1.00e-05 gnorm 0.168 3.32s mem 81.1GB +[2026-09-12 08:36:56] step 3188/5000 loss 0.2834 (w 0.3264 mse 0.3293 t 969 new 0.07) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +[2026-09-12 08:37:00] step 3189/5000 loss 0.2818 (w 0.3374 mse 0.3342 t 995 new 0.22) lr 1.00e-05 gnorm 0.138 3.38s mem 81.1GB +[2026-09-12 08:37:02] step 3190/5000 loss 0.2964 (w 0.3419 mse 0.3516 t 310 new 0.20) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +[2026-09-12 08:37:06] step 3191/5000 loss 0.2555 (w 0.2409 mse 0.2491 t 891 new 0.19) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +[2026-09-12 08:37:09] step 3192/5000 loss 0.2626 (w 0.2794 mse 0.2838 t 861 new 0.19) lr 1.00e-05 gnorm 0.161 3.29s mem 81.1GB +[2026-09-12 08:37:12] step 3193/5000 loss 0.3710 (w 0.2913 mse 0.3001 t 944 new 0.20) lr 1.00e-05 gnorm 0.180 3.25s mem 81.1GB +[2026-09-12 08:37:15] step 3194/5000 loss 0.1949 (w 0.2515 mse 0.2615 t 911 new 0.25) lr 1.00e-05 gnorm 0.122 3.06s mem 81.1GB +[2026-09-12 08:37:18] step 3195/5000 loss 0.3931 (w 0.6974 mse 0.6994 t 146 new 0.25) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +[2026-09-12 08:37:21] step 3196/5000 loss 0.4944 (w 0.3018 mse 0.3129 t 973 new 0.20) lr 1.00e-05 gnorm 0.134 2.86s mem 81.1GB +[2026-09-12 08:37:24] step 3197/5000 loss 0.2783 (w 0.2197 mse 0.2298 t 713 new 0.21) lr 1.00e-05 gnorm 0.163 3.30s mem 81.1GB +[2026-09-12 08:37:28] step 3198/5000 loss 0.5690 (w 0.3567 mse 0.3567 t 968 new 0.18) lr 1.00e-05 gnorm 0.111 3.31s mem 81.1GB +[2026-09-12 08:37:31] step 3199/5000 loss 0.4046 (w 0.3560 mse 0.3610 t 465 new 0.15) lr 1.00e-05 gnorm 0.104 3.30s mem 81.1GB +[2026-09-12 08:37:34] step 3200/5000 loss 0.4428 (w 0.4130 mse 0.4120 t 264 new 0.19) lr 1.00e-05 gnorm 0.141 3.11s mem 81.1GB +[2026-09-12 08:37:37] step 3201/5000 loss 0.2406 (w 0.3696 mse 0.3802 t 904 new 0.19) lr 1.00e-05 gnorm 0.132 3.10s mem 81.1GB +[2026-09-12 08:37:40] step 3202/5000 loss 0.4442 (w 0.3309 mse 0.3255 t 857 new 0.24) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +[2026-09-12 08:37:43] step 3203/5000 loss 0.3319 (w 0.2957 mse 0.3053 t 871 new 0.23) lr 1.00e-05 gnorm 0.240 3.19s mem 81.1GB +[2026-09-12 08:37:47] step 3204/5000 loss 0.2917 (w 0.2976 mse 0.3026 t 874 new 0.22) lr 1.00e-05 gnorm 0.115 3.24s mem 81.1GB +[2026-09-12 08:37:50] step 3205/5000 loss 0.1462 (w 0.3126 mse 0.3184 t 949 new 0.23) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +[2026-09-12 08:37:53] step 3206/5000 loss 0.2212 (w 0.2472 mse 0.2563 t 729 new 0.23) lr 1.00e-05 gnorm 0.110 3.13s mem 81.1GB +[2026-09-12 08:37:56] step 3207/5000 loss 0.3822 (w 0.2269 mse 0.2427 t 637 new 0.21) lr 1.00e-05 gnorm 0.135 3.12s mem 81.1GB +[2026-09-12 08:37:59] step 3208/5000 loss 0.5066 (w 0.2485 mse 0.2638 t 773 new 0.13) lr 1.00e-05 gnorm 0.205 3.12s mem 81.1GB +[2026-09-12 08:38:02] step 3209/5000 loss 0.2999 (w 0.2956 mse 0.2949 t 760 new 0.14) lr 1.00e-05 gnorm 0.609 3.20s mem 81.1GB +[2026-09-12 08:38:06] step 3210/5000 loss 0.2589 (w 0.4458 mse 0.4388 t 1000 new 0.19) lr 1.00e-05 gnorm 0.131 3.31s mem 81.1GB +[2026-09-12 08:38:09] step 3211/5000 loss 0.2768 (w 0.2506 mse 0.2596 t 743 new 0.23) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +[2026-09-12 08:38:12] step 3212/5000 loss 0.3038 (w 0.3861 mse 0.3807 t 968 new 0.15) lr 1.00e-05 gnorm 0.121 3.11s mem 81.1GB +[2026-09-12 08:38:15] step 3213/5000 loss 0.2350 (w 0.2399 mse 0.2478 t 871 new 0.18) lr 1.00e-05 gnorm 1.553 3.08s mem 81.1GB +[2026-09-12 08:38:18] step 3214/5000 loss 0.1586 (w 0.3426 mse 0.3519 t 966 new 0.10) lr 1.00e-05 gnorm 0.155 3.16s mem 81.1GB +[2026-09-12 08:38:21] step 3215/5000 loss 0.2611 (w 0.4636 mse 0.4597 t 990 new 0.24) lr 1.00e-05 gnorm 0.133 3.31s mem 81.1GB +[2026-09-12 08:38:25] step 3216/5000 loss 0.2280 (w 0.2600 mse 0.2699 t 562 new 0.18) lr 1.00e-05 gnorm 0.108 3.09s mem 81.1GB +[2026-09-12 08:38:28] step 3217/5000 loss 0.2956 (w 0.4076 mse 0.4193 t 332 new 0.21) lr 1.00e-05 gnorm 0.127 3.19s mem 81.1GB +[2026-09-12 08:38:31] step 3218/5000 loss 0.3302 (w 0.2338 mse 0.2376 t 927 new 0.11) lr 1.00e-05 gnorm 0.137 3.10s mem 81.1GB +[2026-09-12 08:38:34] step 3219/5000 loss 0.5154 (w 0.3739 mse 0.3735 t 424 new 0.22) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +[2026-09-12 08:38:37] step 3220/5000 loss 0.2365 (w 0.2549 mse 0.2605 t 782 new 0.14) lr 1.00e-05 gnorm 0.140 3.12s mem 81.1GB +[2026-09-12 08:38:40] step 3221/5000 loss 0.1738 (w 0.2786 mse 0.2801 t 936 new 0.21) lr 1.00e-05 gnorm 1.309 3.32s mem 81.1GB +[2026-09-12 08:38:44] step 3222/5000 loss 0.2429 (w 0.3117 mse 0.3113 t 877 new 0.21) lr 1.00e-05 gnorm 0.146 3.28s mem 81.1GB +[2026-09-12 08:38:47] step 3223/5000 loss 0.4607 (w 0.2334 mse 0.2484 t 777 new 0.27) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +[2026-09-12 08:38:50] step 3224/5000 loss 0.3680 (w 0.2793 mse 0.2895 t 859 new 0.19) lr 1.00e-05 gnorm 0.292 3.14s mem 81.1GB +[2026-09-12 08:38:53] step 3225/5000 loss 0.1333 (w 0.2681 mse 0.2733 t 988 new 0.23) lr 1.00e-05 gnorm 0.110 3.10s mem 81.1GB +[2026-09-12 08:38:56] step 3226/5000 loss 0.3705 (w 0.3591 mse 0.3551 t 688 new 0.13) lr 1.00e-05 gnorm 0.225 3.16s mem 81.1GB +[2026-09-12 08:38:59] step 3227/5000 loss 0.2057 (w 0.2632 mse 0.2728 t 987 new 0.18) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +[2026-09-12 08:39:02] step 3228/5000 loss 0.2292 (w 0.2473 mse 0.2558 t 887 new 0.19) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +[2026-09-12 08:39:05] step 3229/5000 loss 0.2434 (w 0.2611 mse 0.2722 t 973 new 0.22) lr 1.00e-05 gnorm 0.168 3.05s mem 81.1GB +[2026-09-12 08:39:09] step 3230/5000 loss 0.3160 (w 0.2620 mse 0.2692 t 852 new 0.23) lr 1.00e-05 gnorm 0.100 3.09s mem 81.1GB +[2026-09-12 08:39:12] step 3231/5000 loss 0.4260 (w 0.2541 mse 0.2549 t 926 new 0.22) lr 1.00e-05 gnorm 0.153 3.13s mem 81.1GB +[2026-09-12 08:39:15] step 3232/5000 loss 0.2577 (w 0.3536 mse 0.3589 t 873 new 0.24) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +[2026-09-12 08:39:18] step 3233/5000 loss 0.3057 (w 0.3300 mse 0.3281 t 605 new 0.25) lr 1.00e-05 gnorm 0.094 3.12s mem 81.1GB +[2026-09-12 08:39:21] step 3234/5000 loss 0.2368 (w 0.1440 mse 0.1593 t 786 new 0.14) lr 1.00e-05 gnorm 0.096 3.08s mem 81.1GB +[2026-09-12 08:39:24] step 3235/5000 loss 0.2632 (w 0.2750 mse 0.2822 t 621 new 0.22) lr 1.00e-05 gnorm 0.116 3.10s mem 81.1GB +[2026-09-12 08:39:27] step 3236/5000 loss 0.2555 (w 0.3337 mse 0.3293 t 958 new 0.27) lr 1.00e-05 gnorm 0.177 3.12s mem 81.1GB +[2026-09-12 08:39:30] step 3237/5000 loss 0.3197 (w 0.4275 mse 0.4569 t 127 new 0.21) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +[2026-09-12 08:39:34] step 3238/5000 loss 0.4248 (w 0.2713 mse 0.2612 t 730 new 0.26) lr 1.00e-05 gnorm 0.135 3.14s mem 81.1GB +[2026-09-12 08:39:37] step 3239/5000 loss 0.2706 (w 0.2776 mse 0.2819 t 927 new 0.19) lr 1.00e-05 gnorm 0.105 3.11s mem 81.1GB +[2026-09-12 08:39:40] step 3240/5000 loss 0.4210 (w 0.2432 mse 0.2534 t 922 new 0.16) lr 1.00e-05 gnorm 1.359 3.14s mem 81.1GB +[2026-09-12 08:39:43] step 3241/5000 loss 0.1626 (w 0.3820 mse 0.3958 t 966 new 0.22) lr 1.00e-05 gnorm 0.100 2.84s mem 81.1GB +[2026-09-12 08:39:46] step 3242/5000 loss 0.2649 (w 0.2759 mse 0.2864 t 886 new 0.23) lr 1.00e-05 gnorm 0.130 3.11s mem 81.1GB +[2026-09-12 08:39:49] step 3243/5000 loss 0.3244 (w 0.2382 mse 0.2638 t 440 new 0.27) lr 1.00e-05 gnorm 0.146 3.11s mem 81.1GB +[2026-09-12 08:39:52] step 3244/5000 loss 0.2169 (w 0.3020 mse 0.3027 t 919 new 0.27) lr 1.00e-05 gnorm 0.198 3.06s mem 81.1GB +[2026-09-12 08:39:55] step 3245/5000 loss 0.2987 (w 0.1941 mse 0.2020 t 669 new 0.11) lr 1.00e-05 gnorm 0.118 3.20s mem 81.1GB +[2026-09-12 08:39:58] step 3246/5000 loss 0.4383 (w 0.3080 mse 0.3179 t 820 new 0.23) lr 1.00e-05 gnorm 0.290 3.07s mem 81.1GB +[2026-09-12 08:40:01] step 3247/5000 loss 0.3380 (w 0.4795 mse 0.4967 t 206 new 0.28) lr 1.00e-05 gnorm 0.141 3.05s mem 81.1GB +[2026-09-12 08:40:04] step 3248/5000 loss 0.1863 (w 0.2704 mse 0.2827 t 945 new 0.15) lr 1.00e-05 gnorm 0.113 2.85s mem 81.1GB +[2026-09-12 08:40:07] step 3249/5000 loss 0.2451 (w 0.2529 mse 0.2553 t 864 new 0.25) lr 1.00e-05 gnorm 0.103 3.17s mem 81.1GB +[2026-09-12 08:40:10] step 3250/5000 loss 0.3591 (w 0.3059 mse 0.3048 t 908 new 0.23) lr 1.00e-05 gnorm 0.133 3.11s mem 81.1GB +[2026-09-12 08:40:14] step 3251/5000 loss 0.1652 (w 0.2092 mse 0.2125 t 945 new 0.17) lr 1.00e-05 gnorm 0.122 3.26s mem 81.1GB +[2026-09-12 08:40:17] step 3252/5000 loss 0.2749 (w 0.4885 mse 0.4952 t 973 new 0.19) lr 1.00e-05 gnorm 0.183 3.09s mem 81.1GB +[2026-09-12 08:40:20] step 3253/5000 loss 0.3100 (w 0.1792 mse 0.2080 t 969 new 0.18) lr 1.00e-05 gnorm 0.342 3.04s mem 81.1GB +[2026-09-12 08:40:23] step 3254/5000 loss 0.0967 (w 0.2078 mse 0.2091 t 913 new 0.08) lr 1.00e-05 gnorm 0.102 3.12s mem 81.1GB +[2026-09-12 08:40:26] step 3255/5000 loss 0.3394 (w 0.2741 mse 0.2855 t 980 new 0.26) lr 1.00e-05 gnorm 0.108 3.04s mem 81.1GB +[2026-09-12 08:40:29] step 3256/5000 loss 0.4129 (w 0.3028 mse 0.3085 t 998 new 0.21) lr 1.00e-05 gnorm 0.116 3.31s mem 81.1GB +[2026-09-12 08:40:32] step 3257/5000 loss 0.2868 (w 0.2537 mse 0.2735 t 992 new 0.25) lr 1.00e-05 gnorm 0.104 3.03s mem 81.1GB +[2026-09-12 08:40:35] step 3258/5000 loss 0.2649 (w 0.1846 mse 0.1952 t 982 new 0.06) lr 1.00e-05 gnorm 0.215 3.11s mem 81.1GB +[2026-09-12 08:40:38] step 3259/5000 loss 0.0878 (w 0.4065 mse 0.3879 t 990 new 0.22) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +[2026-09-12 08:40:42] step 3260/5000 loss 0.2404 (w 0.2214 mse 0.2397 t 963 new 0.16) lr 1.00e-05 gnorm 0.127 3.09s mem 81.1GB +[2026-09-12 08:40:45] step 3261/5000 loss 0.1478 (w 0.2760 mse 0.2829 t 902 new 0.24) lr 1.00e-05 gnorm 0.124 3.05s mem 81.1GB +[2026-09-12 08:40:48] step 3262/5000 loss 0.3452 (w 0.6101 mse 0.6092 t 146 new 0.15) lr 1.00e-05 gnorm 0.242 3.03s mem 81.1GB +[2026-09-12 08:40:51] step 3263/5000 loss 0.3218 (w 0.2576 mse 0.2745 t 980 new 0.25) lr 1.00e-05 gnorm 0.113 3.32s mem 81.1GB +[2026-09-12 08:40:54] step 3264/5000 loss 0.3896 (w 0.2914 mse 0.2854 t 787 new 0.22) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +[2026-09-12 08:40:57] step 3265/5000 loss 0.1754 (w 0.4086 mse 0.3999 t 997 new 0.21) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +[2026-09-12 08:41:00] step 3266/5000 loss 0.2462 (w 0.2338 mse 0.2545 t 944 new 0.23) lr 1.00e-05 gnorm 0.626 3.13s mem 81.1GB +[2026-09-12 08:41:03] step 3267/5000 loss 0.1945 (w 0.1826 mse 0.2040 t 944 new 0.13) lr 1.00e-05 gnorm 0.111 3.11s mem 81.1GB +[2026-09-12 08:41:06] step 3268/5000 loss 0.2551 (w 0.3388 mse 0.3366 t 953 new 0.26) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +[2026-09-12 08:41:10] step 3269/5000 loss 0.2013 (w 0.2663 mse 0.2699 t 851 new 0.21) lr 1.00e-05 gnorm 0.126 3.11s mem 81.1GB +[2026-09-12 08:41:13] step 3270/5000 loss 0.3130 (w 0.1698 mse 0.1759 t 907 new 0.08) lr 1.00e-05 gnorm 0.304 3.08s mem 81.1GB +[2026-09-12 08:41:16] step 3271/5000 loss 0.2651 (w 0.3101 mse 0.3236 t 997 new 0.26) lr 1.00e-05 gnorm 0.301 3.10s mem 81.1GB +[2026-09-12 08:41:19] step 3272/5000 loss 0.1138 (w 0.3095 mse 0.3079 t 990 new 0.19) lr 1.00e-05 gnorm 0.132 3.15s mem 81.1GB +[2026-09-12 08:41:22] step 3273/5000 loss 0.2009 (w 0.2947 mse 0.2970 t 978 new 0.18) lr 1.00e-05 gnorm 0.103 3.05s mem 81.1GB +[2026-09-12 08:41:25] step 3274/5000 loss 0.3426 (w 0.2756 mse 0.2877 t 950 new 0.20) lr 1.00e-05 gnorm 0.192 3.05s mem 81.1GB +[2026-09-12 08:41:28] step 3275/5000 loss 0.1592 (w 0.2744 mse 0.2873 t 938 new 0.19) lr 1.00e-05 gnorm 0.115 3.25s mem 81.1GB +[2026-09-12 08:41:31] step 3276/5000 loss 0.2574 (w 0.3184 mse 0.3192 t 829 new 0.28) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +[2026-09-12 08:41:34] step 3277/5000 loss 0.3173 (w 0.2624 mse 0.2803 t 984 new 0.20) lr 1.00e-05 gnorm 0.308 3.14s mem 81.1GB +[2026-09-12 08:41:38] step 3278/5000 loss 0.3013 (w 0.3741 mse 0.3871 t 348 new 0.26) lr 1.00e-05 gnorm 0.138 3.37s mem 81.1GB +[2026-09-12 08:41:41] step 3279/5000 loss 0.2883 (w 0.2461 mse 0.2524 t 793 new 0.25) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +[2026-09-12 08:41:44] step 3280/5000 loss 0.3864 (w 0.3601 mse 0.3691 t 500 new 0.21) lr 1.00e-05 gnorm 0.107 3.04s mem 81.1GB +[2026-09-12 08:41:47] step 3281/5000 loss 0.2888 (w 0.2891 mse 0.2994 t 974 new 0.22) lr 1.00e-05 gnorm 0.108 3.25s mem 81.1GB +[2026-09-12 08:41:50] step 3282/5000 loss 0.1455 (w 0.2781 mse 0.2767 t 969 new 0.09) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +[2026-09-12 08:41:53] step 3283/5000 loss 0.2487 (w 0.2587 mse 0.2701 t 660 new 0.15) lr 1.00e-05 gnorm 0.131 3.07s mem 81.1GB +[2026-09-12 08:41:56] step 3284/5000 loss 0.4790 (w 0.2780 mse 0.3057 t 968 new 0.19) lr 1.00e-05 gnorm 0.127 3.19s mem 81.1GB +[2026-09-12 08:41:59] step 3285/5000 loss 0.1845 (w 0.2718 mse 0.2846 t 932 new 0.17) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +[2026-09-12 08:42:02] step 3286/5000 loss 0.2749 (w 0.2019 mse 0.2116 t 741 new 0.19) lr 1.00e-05 gnorm 0.158 3.09s mem 81.1GB +[2026-09-12 08:42:05] step 3287/5000 loss 0.2649 (w 0.2608 mse 0.2719 t 706 new 0.28) lr 1.00e-05 gnorm 0.109 3.29s mem 81.1GB +[2026-09-12 08:42:08] step 3288/5000 loss 0.1876 (w 0.3044 mse 0.3127 t 968 new 0.22) lr 1.00e-05 gnorm 0.159 2.83s mem 81.1GB +[2026-09-12 08:42:11] step 3289/5000 loss 0.2432 (w 0.2719 mse 0.2647 t 921 new 0.22) lr 1.00e-05 gnorm 0.118 3.12s mem 81.1GB +[2026-09-12 08:42:15] step 3290/5000 loss 0.2542 (w 0.3617 mse 0.3679 t 999 new 0.23) lr 1.00e-05 gnorm 0.149 3.46s mem 81.1GB +[2026-09-12 08:42:18] step 3291/5000 loss 0.3208 (w 0.2312 mse 0.2517 t 662 new 0.17) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +[2026-09-12 08:42:21] step 3292/5000 loss 0.3987 (w 0.3015 mse 0.3000 t 950 new 0.20) lr 1.00e-05 gnorm 0.105 3.29s mem 81.1GB +[2026-09-12 08:42:24] step 3293/5000 loss 0.3331 (w 0.4847 mse 0.4668 t 969 new 0.23) lr 1.00e-05 gnorm 0.157 3.32s mem 81.1GB +[2026-09-12 08:42:27] step 3294/5000 loss 0.2610 (w 0.3541 mse 0.3726 t 983 new 0.11) lr 1.00e-05 gnorm 0.106 3.06s mem 81.1GB +[2026-09-12 08:42:30] step 3295/5000 loss 0.3338 (w 0.3065 mse 0.3179 t 951 new 0.22) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-12 08:42:34] step 3296/5000 loss 0.4606 (w 0.2916 mse 0.2904 t 973 new 0.21) lr 1.00e-05 gnorm 0.141 3.42s mem 81.1GB +[2026-09-12 08:42:36] step 3297/5000 loss 0.2116 (w 0.3471 mse 0.3433 t 947 new 0.19) lr 1.00e-05 gnorm 0.110 2.84s mem 81.1GB +[2026-09-12 08:42:40] step 3298/5000 loss 0.3611 (w 0.5888 mse 0.5895 t 171 new 0.25) lr 1.00e-05 gnorm 0.129 3.28s mem 81.1GB +[2026-09-12 08:42:43] step 3299/5000 loss 0.3890 (w 0.2546 mse 0.2679 t 918 new 0.22) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +[2026-09-12 08:42:46] step 3300/5000 loss 0.2717 (w 0.2338 mse 0.2433 t 702 new 0.10) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +[2026-09-12 08:42:49] step 3301/5000 loss 0.2074 (w 0.2602 mse 0.2636 t 917 new 0.21) lr 1.00e-05 gnorm 0.114 3.33s mem 81.1GB +[2026-09-12 08:42:53] step 3302/5000 loss 0.4478 (w 0.2162 mse 0.2333 t 743 new 0.25) lr 1.00e-05 gnorm 0.104 3.46s mem 81.1GB +[2026-09-12 08:42:56] step 3303/5000 loss 0.1933 (w 0.1676 mse 0.1878 t 894 new 0.29) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +[2026-09-12 08:42:59] step 3304/5000 loss 0.3253 (w 0.2820 mse 0.2941 t 963 new 0.24) lr 1.00e-05 gnorm 0.138 3.10s mem 81.1GB +[2026-09-12 08:43:02] step 3305/5000 loss 0.1522 (w 0.3104 mse 0.3169 t 736 new 0.26) lr 1.00e-05 gnorm 0.110 3.14s mem 81.1GB +[2026-09-12 08:43:05] step 3306/5000 loss 0.3549 (w 0.2855 mse 0.3002 t 738 new 0.18) lr 1.00e-05 gnorm 0.127 3.07s mem 81.1GB +[2026-09-12 08:43:08] step 3307/5000 loss 0.1998 (w 0.2955 mse 0.3004 t 940 new 0.21) lr 1.00e-05 gnorm 0.142 3.36s mem 81.1GB +[2026-09-12 08:43:12] step 3308/5000 loss 0.2673 (w 0.3217 mse 0.3184 t 987 new 0.20) lr 1.00e-05 gnorm 0.117 3.42s mem 81.1GB +[2026-09-12 08:43:15] step 3309/5000 loss 0.1271 (w 0.3149 mse 0.3198 t 977 new 0.20) lr 1.00e-05 gnorm 0.111 3.08s mem 81.1GB +[2026-09-12 08:43:18] step 3310/5000 loss 0.1554 (w 0.2441 mse 0.2596 t 913 new 0.20) lr 1.00e-05 gnorm 0.284 3.33s mem 81.1GB +[2026-09-12 08:43:21] step 3311/5000 loss 0.2304 (w 0.1924 mse 0.2105 t 947 new 0.25) lr 1.00e-05 gnorm 0.284 3.11s mem 81.1GB +[2026-09-12 08:43:24] step 3312/5000 loss 0.2679 (w 0.3729 mse 0.3766 t 966 new 0.28) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +[2026-09-12 08:43:28] step 3313/5000 loss 0.3704 (w 0.3575 mse 0.3544 t 1000 new 0.20) lr 1.00e-05 gnorm 0.099 3.37s mem 81.1GB +[2026-09-12 08:43:31] step 3314/5000 loss 0.2755 (w 0.2736 mse 0.2783 t 884 new 0.16) lr 1.00e-05 gnorm 0.139 3.03s mem 81.1GB +[2026-09-12 08:43:34] step 3315/5000 loss 0.3338 (w 0.2573 mse 0.2829 t 984 new 0.20) lr 1.00e-05 gnorm 0.129 3.05s mem 81.1GB +[2026-09-12 08:43:37] step 3316/5000 loss 0.4595 (w 0.1542 mse 0.1801 t 725 new 0.19) lr 1.00e-05 gnorm 0.203 3.26s mem 81.1GB +[2026-09-12 08:43:40] step 3317/5000 loss 0.2920 (w 0.2443 mse 0.2665 t 521 new 0.15) lr 1.00e-05 gnorm 0.272 3.17s mem 81.1GB +[2026-09-12 08:43:43] step 3318/5000 loss 0.2998 (w 0.2600 mse 0.2781 t 584 new 0.23) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +[2026-09-12 08:43:47] step 3319/5000 loss 0.3652 (w 0.3077 mse 0.3145 t 648 new 0.24) lr 1.00e-05 gnorm 0.127 3.31s mem 81.1GB +[2026-09-12 08:43:50] step 3320/5000 loss 0.4149 (w 0.2175 mse 0.2260 t 610 new 0.19) lr 1.00e-05 gnorm 0.137 3.08s mem 81.1GB +[2026-09-12 08:43:53] step 3321/5000 loss 0.2520 (w 0.3293 mse 0.3382 t 878 new 0.13) lr 1.00e-05 gnorm 0.146 3.08s mem 81.1GB +[2026-09-12 08:43:56] step 3322/5000 loss 0.4276 (w 0.2284 mse 0.2363 t 989 new 0.13) lr 1.00e-05 gnorm 0.163 3.30s mem 81.1GB +[2026-09-12 08:43:59] step 3323/5000 loss 0.2503 (w 0.1979 mse 0.2187 t 813 new 0.15) lr 1.00e-05 gnorm 0.105 2.83s mem 81.1GB +[2026-09-12 08:44:02] step 3324/5000 loss 0.2035 (w 0.2928 mse 0.2976 t 961 new 0.20) lr 1.00e-05 gnorm 0.108 3.11s mem 81.1GB +[2026-09-12 08:44:06] step 3325/5000 loss 0.1529 (w 0.2083 mse 0.2262 t 966 new 0.10) lr 1.00e-05 gnorm 0.176 3.15s mem 81.1GB +[2026-09-12 08:44:08] step 3326/5000 loss 0.3428 (w 0.4074 mse 0.4158 t 434 new 0.18) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +[2026-09-12 08:44:11] step 3327/5000 loss 0.2318 (w 0.3008 mse 0.3152 t 796 new 0.21) lr 1.00e-05 gnorm 0.199 3.11s mem 81.1GB +[2026-09-12 08:44:15] step 3328/5000 loss 0.3082 (w 0.3438 mse 0.3532 t 954 new 0.20) lr 1.00e-05 gnorm 0.114 3.29s mem 81.1GB +[2026-09-12 08:44:18] step 3329/5000 loss 0.1784 (w 0.2784 mse 0.2798 t 873 new 0.16) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +[2026-09-12 08:44:21] step 3330/5000 loss 0.4314 (w 0.2721 mse 0.2765 t 728 new 0.11) lr 1.00e-05 gnorm 0.134 3.10s mem 81.1GB +[2026-09-12 08:44:24] step 3331/5000 loss 0.2505 (w 0.2365 mse 0.2513 t 948 new 0.24) lr 1.00e-05 gnorm 0.260 3.42s mem 81.1GB +[2026-09-12 08:44:27] step 3332/5000 loss 0.2923 (w 0.3060 mse 0.3155 t 913 new 0.23) lr 1.00e-05 gnorm 0.178 2.84s mem 81.1GB +[2026-09-12 08:44:30] step 3333/5000 loss 0.3399 (w 0.5420 mse 0.5598 t 998 new 0.19) lr 1.00e-05 gnorm 0.098 3.11s mem 81.1GB +[2026-09-12 08:44:33] step 3334/5000 loss 0.3595 (w 0.2318 mse 0.2576 t 859 new 0.19) lr 1.00e-05 gnorm 0.109 3.28s mem 81.1GB +[2026-09-12 08:44:36] step 3335/5000 loss 0.3197 (w 0.5710 mse 0.5782 t 183 new 0.14) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +[2026-09-12 08:44:39] step 3336/5000 loss 0.2912 (w 0.2162 mse 0.2376 t 746 new 0.16) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +[2026-09-12 08:44:43] step 3337/5000 loss 0.3517 (w 0.1980 mse 0.2066 t 623 new 0.10) lr 1.00e-05 gnorm 0.129 3.48s mem 81.1GB +[2026-09-12 08:44:46] step 3338/5000 loss 0.2293 (w 0.2905 mse 0.3008 t 950 new 0.24) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +[2026-09-12 08:44:49] step 3339/5000 loss 0.1696 (w 0.2011 mse 0.2063 t 787 new 0.24) lr 1.00e-05 gnorm 0.192 3.05s mem 81.1GB +[2026-09-12 08:44:52] step 3340/5000 loss 0.4692 (w 0.3176 mse 0.3190 t 687 new 0.22) lr 1.00e-05 gnorm 0.137 3.31s mem 81.1GB +[2026-09-12 08:44:55] step 3341/5000 loss 0.3463 (w 0.4291 mse 0.4595 t 238 new 0.20) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +[2026-09-12 08:44:58] step 3342/5000 loss 0.1942 (w 0.2937 mse 0.3067 t 966 new 0.24) lr 1.00e-05 gnorm 0.344 3.06s mem 81.1GB +[2026-09-12 08:45:01] step 3343/5000 loss 0.2852 (w 0.3214 mse 0.3228 t 871 new 0.26) lr 1.00e-05 gnorm 0.211 3.48s mem 81.1GB +[2026-09-12 08:45:04] step 3344/5000 loss 0.5138 (w 0.2201 mse 0.2367 t 773 new 0.18) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +[2026-09-12 08:45:09] step 3345/5000 loss 0.2016 (w 0.2376 mse 0.2559 t 553 new 0.21) lr 1.00e-05 gnorm 0.132 4.39s mem 81.1GB +[2026-09-12 08:45:12] step 3346/5000 loss 0.3526 (w 0.3409 mse 0.3460 t 397 new 0.18) lr 1.00e-05 gnorm 0.110 3.08s mem 81.1GB +[2026-09-12 08:45:15] step 3347/5000 loss 0.2358 (w 0.1880 mse 0.2092 t 883 new 0.15) lr 1.00e-05 gnorm 0.894 2.83s mem 81.1GB +[2026-09-12 08:45:18] step 3348/5000 loss 0.4934 (w 0.2913 mse 0.2885 t 729 new 0.17) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +[2026-09-12 08:45:21] step 3349/5000 loss 0.2021 (w 0.2889 mse 0.2870 t 929 new 0.23) lr 1.00e-05 gnorm 0.114 3.15s mem 81.1GB +[2026-09-12 08:45:24] step 3350/5000 loss 0.2000 (w 0.2795 mse 0.2935 t 983 new 0.08) lr 1.00e-05 gnorm 0.117 3.03s mem 81.1GB +[2026-09-12 08:45:27] step 3351/5000 loss 0.2792 (w 0.2546 mse 0.2569 t 804 new 0.12) lr 1.00e-05 gnorm 0.300 2.84s mem 81.1GB +[2026-09-12 08:45:30] step 3352/5000 loss 0.3064 (w 0.2872 mse 0.3162 t 987 new 0.14) lr 1.00e-05 gnorm 0.112 3.17s mem 81.1GB +[2026-09-12 08:45:33] step 3353/5000 loss 0.2882 (w 0.1875 mse 0.2046 t 670 new 0.24) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +[2026-09-12 08:45:36] step 3354/5000 loss 0.3300 (w 0.1960 mse 0.2015 t 660 new 0.13) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +[2026-09-12 08:45:39] step 3355/5000 loss 0.2005 (w 0.2517 mse 0.2683 t 991 new 0.18) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +[2026-09-12 08:45:42] step 3356/5000 loss 0.2357 (w 0.2217 mse 0.2298 t 508 new 0.14) lr 1.00e-05 gnorm 0.147 3.04s mem 81.1GB +[2026-09-12 08:45:45] step 3357/5000 loss 0.1709 (w 0.3951 mse 0.4084 t 998 new 0.20) lr 1.00e-05 gnorm 0.107 2.84s mem 81.1GB +[2026-09-12 08:45:48] step 3358/5000 loss 0.2877 (w 0.3702 mse 0.3759 t 340 new 0.25) lr 1.00e-05 gnorm 0.105 3.16s mem 81.1GB +[2026-09-12 08:45:51] step 3359/5000 loss 0.3894 (w 0.2853 mse 0.3031 t 909 new 0.18) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +[2026-09-12 08:45:54] step 3360/5000 loss 0.4677 (w 0.2917 mse 0.2939 t 861 new 0.23) lr 1.00e-05 gnorm 0.506 3.15s mem 81.1GB +[2026-09-12 08:45:57] step 3361/5000 loss 0.1836 (w 0.5301 mse 0.5525 t 996 new 0.17) lr 1.00e-05 gnorm 0.137 3.13s mem 81.1GB +[2026-09-12 08:46:00] step 3362/5000 loss 0.2191 (w 0.2899 mse 0.2902 t 795 new 0.20) lr 1.00e-05 gnorm 0.117 3.01s mem 81.1GB +[2026-09-12 08:46:03] step 3363/5000 loss 0.2515 (w 0.2833 mse 0.2781 t 893 new 0.21) lr 1.00e-05 gnorm 0.133 3.08s mem 81.1GB +[2026-09-12 08:46:06] step 3364/5000 loss 0.2202 (w 0.2964 mse 0.3047 t 990 new 0.23) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +[2026-09-12 08:46:09] step 3365/5000 loss 0.3558 (w 0.5601 mse 0.5925 t 120 new 0.26) lr 1.00e-05 gnorm 0.115 2.85s mem 81.1GB +[2026-09-12 08:46:13] step 3366/5000 loss 0.1487 (w 0.2969 mse 0.3059 t 938 new 0.23) lr 1.00e-05 gnorm 0.112 3.60s mem 81.1GB +[2026-09-12 08:46:15] step 3367/5000 loss 0.2382 (w 0.3165 mse 0.3223 t 895 new 0.19) lr 1.00e-05 gnorm 1.038 2.85s mem 81.1GB +[2026-09-12 08:46:18] step 3368/5000 loss 0.1626 (w 0.2951 mse 0.3016 t 753 new 0.18) lr 1.00e-05 gnorm 0.107 3.06s mem 81.1GB +[2026-09-12 08:46:22] step 3369/5000 loss 0.4903 (w 0.7307 mse 0.7473 t 107 new 0.21) lr 1.00e-05 gnorm 0.227 3.10s mem 81.1GB +[2026-09-12 08:46:24] step 3370/5000 loss 0.2377 (w 0.3187 mse 0.3152 t 768 new 0.23) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +[2026-09-12 08:46:27] step 3371/5000 loss 0.3025 (w 0.2328 mse 0.2389 t 940 new 0.20) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +[2026-09-12 08:46:31] step 3372/5000 loss 0.3756 (w 0.3250 mse 0.3340 t 836 new 0.29) lr 1.00e-05 gnorm 0.131 3.58s mem 81.1GB +[2026-09-12 08:46:34] step 3373/5000 loss 0.2603 (w 0.2950 mse 0.2881 t 914 new 0.20) lr 1.00e-05 gnorm 0.102 2.83s mem 81.1GB +[2026-09-12 08:46:37] step 3374/5000 loss 0.3294 (w 0.2423 mse 0.2527 t 921 new 0.24) lr 1.00e-05 gnorm 0.130 3.09s mem 81.1GB +[2026-09-12 08:46:40] step 3375/5000 loss 0.2228 (w 0.1981 mse 0.2229 t 855 new 0.26) lr 1.00e-05 gnorm 0.133 3.30s mem 81.1GB +[2026-09-12 08:46:43] step 3376/5000 loss 0.4210 (w 0.2503 mse 0.2603 t 893 new 0.22) lr 1.00e-05 gnorm 0.121 2.84s mem 81.1GB +[2026-09-12 08:46:46] step 3377/5000 loss 0.2058 (w 0.3600 mse 0.3608 t 996 new 0.05) lr 1.00e-05 gnorm 0.151 3.08s mem 81.1GB +[2026-09-12 08:46:49] step 3378/5000 loss 0.2879 (w 0.1910 mse 0.2219 t 811 new 0.19) lr 1.00e-05 gnorm 0.100 3.23s mem 81.1GB +[2026-09-12 08:46:52] step 3379/5000 loss 0.2719 (w 0.2918 mse 0.2912 t 685 new 0.25) lr 1.00e-05 gnorm 0.167 2.83s mem 81.1GB +[2026-09-12 08:46:55] step 3380/5000 loss 0.1658 (w 0.2906 mse 0.2931 t 742 new 0.10) lr 1.00e-05 gnorm 0.111 3.11s mem 81.1GB +[2026-09-12 08:46:59] step 3381/5000 loss 0.3626 (w 0.2780 mse 0.2708 t 826 new 0.21) lr 1.00e-05 gnorm 0.129 3.36s mem 81.1GB +[2026-09-12 08:47:01] step 3382/5000 loss 0.3613 (w 0.2866 mse 0.2914 t 939 new 0.22) lr 1.00e-05 gnorm 0.116 2.83s mem 81.1GB +[2026-09-12 08:47:05] step 3383/5000 loss 0.3162 (w 0.3773 mse 0.3756 t 798 new 0.25) lr 1.00e-05 gnorm 0.103 3.15s mem 81.1GB +[2026-09-12 08:47:08] step 3384/5000 loss 0.2269 (w 0.2971 mse 0.2978 t 745 new 0.03) lr 1.00e-05 gnorm 0.097 3.23s mem 81.1GB +[2026-09-12 08:47:11] step 3385/5000 loss 0.3549 (w 0.1954 mse 0.2089 t 673 new 0.15) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +[2026-09-12 08:47:14] step 3386/5000 loss 0.1423 (w 0.2867 mse 0.2912 t 924 new 0.19) lr 1.00e-05 gnorm 0.144 3.36s mem 81.1GB +[2026-09-12 08:47:17] step 3387/5000 loss 0.1766 (w 0.2353 mse 0.2431 t 897 new 0.22) lr 1.00e-05 gnorm 0.138 3.21s mem 81.1GB +[2026-09-12 08:47:20] step 3388/5000 loss 0.2818 (w 0.3882 mse 0.3845 t 977 new 0.20) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-12 08:47:23] step 3389/5000 loss 0.1418 (w 0.3407 mse 0.3502 t 969 new 0.22) lr 1.00e-05 gnorm 0.126 3.16s mem 81.1GB +[2026-09-12 08:47:27] step 3390/5000 loss 0.1825 (w 0.2744 mse 0.2687 t 830 new 0.21) lr 1.00e-05 gnorm 0.105 3.49s mem 81.1GB +[2026-09-12 08:47:29] step 3391/5000 loss 0.1866 (w 0.3097 mse 0.3096 t 965 new 0.27) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +[2026-09-12 08:47:33] step 3392/5000 loss 0.2656 (w 0.2460 mse 0.2576 t 876 new 0.18) lr 1.00e-05 gnorm 0.151 3.29s mem 81.1GB +[2026-09-12 08:47:36] step 3393/5000 loss 0.3432 (w 0.4210 mse 0.4462 t 206 new 0.11) lr 1.00e-05 gnorm 0.169 3.11s mem 81.1GB +[2026-09-12 08:47:39] step 3394/5000 loss 0.1552 (w 0.2297 mse 0.2406 t 875 new 0.10) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +[2026-09-12 08:47:42] step 3395/5000 loss 0.4619 (w 0.5390 mse 0.5336 t 283 new 0.24) lr 1.00e-05 gnorm 0.140 3.14s mem 81.1GB +[2026-09-12 08:47:45] step 3396/5000 loss 0.2031 (w 0.3267 mse 0.3204 t 733 new 0.17) lr 1.00e-05 gnorm 0.126 3.45s mem 81.1GB +[2026-09-12 08:47:48] step 3397/5000 loss 0.1838 (w 0.4137 mse 0.4100 t 987 new 0.21) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +[2026-09-12 08:47:51] step 3398/5000 loss 0.1799 (w 0.2782 mse 0.2819 t 998 new 0.13) lr 1.00e-05 gnorm 0.102 3.27s mem 81.1GB +[2026-09-12 08:47:55] step 3399/5000 loss 0.3597 (w 0.3177 mse 0.3356 t 599 new 0.16) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +[2026-09-12 08:47:57] step 3400/5000 loss 0.1226 (w 0.4179 mse 0.4023 t 986 new 0.20) lr 1.00e-05 gnorm 0.133 2.83s mem 81.1GB +[2026-09-12 08:48:01] step 3401/5000 loss 0.3657 (w 0.2533 mse 0.2609 t 769 new 0.22) lr 1.00e-05 gnorm 0.112 3.36s mem 81.1GB +[2026-09-12 08:48:04] step 3402/5000 loss 0.2942 (w 0.2738 mse 0.2746 t 985 new 0.14) lr 1.00e-05 gnorm 0.800 3.32s mem 81.1GB +[2026-09-12 08:48:07] step 3403/5000 loss 0.1367 (w 0.3489 mse 0.3633 t 962 new 0.22) lr 1.00e-05 gnorm 0.186 3.10s mem 81.1GB +[2026-09-12 08:48:10] step 3404/5000 loss 0.1782 (w 0.3418 mse 0.3409 t 987 new 0.24) lr 1.00e-05 gnorm 0.083 3.06s mem 81.1GB +[2026-09-12 08:48:13] step 3405/5000 loss 0.1532 (w 0.2193 mse 0.2364 t 924 new 0.20) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +[2026-09-12 08:48:16] step 3406/5000 loss 0.1783 (w 0.2258 mse 0.2407 t 882 new 0.19) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 08:48:19] step 3407/5000 loss 0.1687 (w 0.2690 mse 0.2773 t 850 new 0.12) lr 1.00e-05 gnorm 0.125 3.40s mem 81.1GB +[2026-09-12 08:48:22] step 3408/5000 loss 0.1449 (w 0.2819 mse 0.2869 t 903 new 0.26) lr 1.00e-05 gnorm 0.129 3.17s mem 81.1GB +[2026-09-12 08:48:26] step 3409/5000 loss 0.1901 (w 0.3006 mse 0.2993 t 830 new 0.19) lr 1.00e-05 gnorm 0.182 3.10s mem 81.1GB +[2026-09-12 08:48:29] step 3410/5000 loss 0.3541 (w 0.3622 mse 0.3676 t 418 new 0.21) lr 1.00e-05 gnorm 0.195 3.08s mem 81.1GB +[2026-09-12 08:48:31] step 3411/5000 loss 0.1719 (w 0.3691 mse 0.3787 t 972 new 0.24) lr 1.00e-05 gnorm 0.172 2.84s mem 81.1GB +[2026-09-12 08:48:34] step 3412/5000 loss 0.2253 (w 0.1613 mse 0.1891 t 754 new 0.22) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +[2026-09-12 08:48:38] step 3413/5000 loss 0.2084 (w 0.2859 mse 0.2778 t 874 new 0.16) lr 1.00e-05 gnorm 0.127 3.44s mem 81.1GB +[2026-09-12 08:48:41] step 3414/5000 loss 0.4243 (w 0.3972 mse 0.4054 t 952 new 0.27) lr 1.00e-05 gnorm 0.407 3.14s mem 81.1GB +[2026-09-12 08:48:44] step 3415/5000 loss 0.3629 (w 0.3459 mse 0.3466 t 948 new 0.18) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +[2026-09-12 08:48:47] step 3416/5000 loss 0.2886 (w 0.3757 mse 0.3802 t 970 new 0.24) lr 1.00e-05 gnorm 0.345 3.36s mem 81.1GB +[2026-09-12 08:48:50] step 3417/5000 loss 0.2418 (w 0.4050 mse 0.4041 t 956 new 0.24) lr 1.00e-05 gnorm 0.315 2.84s mem 81.1GB +[2026-09-12 08:48:53] step 3418/5000 loss 0.2261 (w 0.2487 mse 0.2580 t 944 new 0.08) lr 1.00e-05 gnorm 0.116 2.85s mem 81.1GB +[2026-09-12 08:48:56] step 3419/5000 loss 0.2249 (w 0.3877 mse 0.3920 t 974 new 0.28) lr 1.00e-05 gnorm 0.295 3.40s mem 81.1GB +[2026-09-12 08:48:59] step 3420/5000 loss 0.2455 (w 0.2453 mse 0.2593 t 963 new 0.20) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +[2026-09-12 08:49:02] step 3421/5000 loss 0.3787 (w 0.2744 mse 0.2806 t 875 new 0.27) lr 1.00e-05 gnorm 0.221 3.13s mem 81.1GB +[2026-09-12 08:49:06] step 3422/5000 loss 0.4568 (w 0.2940 mse 0.3051 t 818 new 0.19) lr 1.00e-05 gnorm 0.126 3.30s mem 81.1GB +[2026-09-12 08:49:09] step 3423/5000 loss 0.2968 (w 0.4810 mse 0.5002 t 238 new 0.08) lr 1.00e-05 gnorm 1.676 3.16s mem 81.1GB +[2026-09-12 08:49:12] step 3424/5000 loss 0.3063 (w 0.2793 mse 0.2768 t 779 new 0.14) lr 1.00e-05 gnorm 0.203 3.14s mem 81.1GB +[2026-09-12 08:49:15] step 3425/5000 loss 0.2077 (w 0.2652 mse 0.2876 t 948 new 0.18) lr 1.00e-05 gnorm 0.101 3.41s mem 81.1GB +[2026-09-12 08:49:18] step 3426/5000 loss 0.4320 (w 0.3029 mse 0.3152 t 278 new 0.19) lr 1.00e-05 gnorm 0.141 2.85s mem 81.1GB +[2026-09-12 08:49:21] step 3427/5000 loss 0.2385 (w 0.3387 mse 0.3478 t 931 new 0.17) lr 1.00e-05 gnorm 0.439 3.07s mem 81.1GB +[2026-09-12 08:49:24] step 3428/5000 loss 0.2953 (w 0.2870 mse 0.2857 t 873 new 0.14) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +[2026-09-12 08:49:27] step 3429/5000 loss 0.3389 (w 0.2706 mse 0.2702 t 846 new 0.13) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 08:49:30] step 3430/5000 loss 0.1546 (w 0.3969 mse 0.3922 t 991 new 0.14) lr 1.00e-05 gnorm 0.117 3.08s mem 81.1GB +[2026-09-12 08:49:34] step 3431/5000 loss 0.1268 (w 0.1580 mse 0.1704 t 811 new 0.20) lr 1.00e-05 gnorm 0.106 3.41s mem 81.1GB +[2026-09-12 08:49:37] step 3432/5000 loss 0.1880 (w 0.2493 mse 0.2545 t 794 new 0.21) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +[2026-09-12 08:49:40] step 3433/5000 loss 0.2047 (w 0.2852 mse 0.2906 t 919 new 0.16) lr 1.00e-05 gnorm 0.190 3.12s mem 81.1GB +[2026-09-12 08:49:43] step 3434/5000 loss 0.3190 (w 0.3826 mse 0.3749 t 969 new 0.26) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +[2026-09-12 08:49:46] step 3435/5000 loss 0.1824 (w 0.2355 mse 0.2497 t 862 new 0.28) lr 1.00e-05 gnorm 0.089 2.83s mem 81.1GB +[2026-09-12 08:49:49] step 3436/5000 loss 0.2296 (w 0.2385 mse 0.2422 t 819 new 0.23) lr 1.00e-05 gnorm 0.142 3.06s mem 81.1GB +[2026-09-12 08:49:52] step 3437/5000 loss 0.2957 (w 0.2556 mse 0.2767 t 991 new 0.23) lr 1.00e-05 gnorm 0.154 3.28s mem 81.1GB +[2026-09-12 08:49:55] step 3438/5000 loss 0.2799 (w 0.2807 mse 0.2896 t 654 new 0.20) lr 1.00e-05 gnorm 0.212 2.83s mem 81.1GB +[2026-09-12 08:49:58] step 3439/5000 loss 0.1276 (w 0.2040 mse 0.2215 t 935 new 0.26) lr 1.00e-05 gnorm 0.184 3.12s mem 81.1GB +[2026-09-12 08:50:01] step 3440/5000 loss 0.2928 (w 0.4603 mse 0.4705 t 1000 new 0.20) lr 1.00e-05 gnorm 0.202 2.85s mem 81.1GB +[2026-09-12 08:50:04] step 3441/5000 loss 0.4125 (w 0.2369 mse 0.2550 t 465 new 0.10) lr 1.00e-05 gnorm 0.164 2.85s mem 81.1GB +[2026-09-12 08:50:07] step 3442/5000 loss 0.2917 (w 0.3035 mse 0.3156 t 418 new 0.15) lr 1.00e-05 gnorm 0.487 3.08s mem 81.1GB +[2026-09-12 08:50:10] step 3443/5000 loss 0.1552 (w 0.2975 mse 0.3124 t 886 new 0.24) lr 1.00e-05 gnorm 0.172 3.04s mem 81.1GB +[2026-09-12 08:50:13] step 3444/5000 loss 0.4393 (w 0.2163 mse 0.2221 t 901 new 0.08) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +[2026-09-12 08:50:16] step 3445/5000 loss 0.2984 (w 0.3097 mse 0.3040 t 763 new 0.23) lr 1.00e-05 gnorm 0.205 3.41s mem 81.1GB +[2026-09-12 08:50:19] step 3446/5000 loss 0.2572 (w 0.2373 mse 0.2460 t 766 new 0.15) lr 1.00e-05 gnorm 0.155 2.83s mem 81.1GB +[2026-09-12 08:50:22] step 3447/5000 loss 0.3713 (w 0.2712 mse 0.2811 t 641 new 0.23) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +[2026-09-12 08:50:25] step 3448/5000 loss 0.2028 (w 0.3547 mse 0.3668 t 967 new 0.21) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +[2026-09-12 08:50:28] step 3449/5000 loss 0.3052 (w 0.2857 mse 0.3183 t 962 new 0.22) lr 1.00e-05 gnorm 0.170 3.07s mem 81.1GB +[2026-09-12 08:50:31] step 3450/5000 loss 0.3927 (w 0.3567 mse 0.3581 t 979 new 0.18) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-12 08:50:34] step 3451/5000 loss 0.1712 (w 0.2110 mse 0.2195 t 941 new 0.17) lr 1.00e-05 gnorm 0.135 3.15s mem 81.1GB +[2026-09-12 08:50:37] step 3452/5000 loss 0.2482 (w 0.1669 mse 0.1699 t 883 new 0.13) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +[2026-09-12 08:50:40] step 3453/5000 loss 0.2652 (w 0.2903 mse 0.3044 t 434 new 0.12) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +[2026-09-12 08:50:43] step 3454/5000 loss 0.1872 (w 0.2823 mse 0.2835 t 879 new 0.24) lr 1.00e-05 gnorm 0.119 3.17s mem 81.1GB +[2026-09-12 08:50:46] step 3455/5000 loss 0.1932 (w 0.3729 mse 0.3579 t 971 new 0.23) lr 1.00e-05 gnorm 0.119 3.12s mem 81.1GB +[2026-09-12 08:50:49] step 3456/5000 loss 0.2767 (w 0.2694 mse 0.2768 t 914 new 0.26) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +[2026-09-12 08:50:52] step 3457/5000 loss 0.2968 (w 0.3290 mse 0.3212 t 997 new 0.26) lr 1.00e-05 gnorm 0.165 3.39s mem 81.1GB +[2026-09-12 08:50:55] step 3458/5000 loss 0.3624 (w 0.3308 mse 0.3293 t 795 new 0.22) lr 1.00e-05 gnorm 0.110 2.84s mem 81.1GB +[2026-09-12 08:50:58] step 3459/5000 loss 0.2378 (w 0.2432 mse 0.2470 t 882 new 0.11) lr 1.00e-05 gnorm 0.874 2.84s mem 81.1GB +[2026-09-12 08:51:01] step 3460/5000 loss 0.2540 (w 0.3063 mse 0.3232 t 988 new 0.23) lr 1.00e-05 gnorm 0.136 3.33s mem 81.1GB +[2026-09-12 08:51:04] step 3461/5000 loss 0.3277 (w 0.3577 mse 0.3510 t 916 new 0.20) lr 1.00e-05 gnorm 0.152 3.04s mem 81.1GB +[2026-09-12 08:51:07] step 3462/5000 loss 0.3250 (w 0.3094 mse 0.3234 t 997 new 0.20) lr 1.00e-05 gnorm 0.107 2.84s mem 81.1GB +[2026-09-12 08:51:11] step 3463/5000 loss 0.0887 (w 0.3170 mse 0.3279 t 967 new 0.24) lr 1.00e-05 gnorm 0.167 3.34s mem 81.1GB +[2026-09-12 08:51:13] step 3464/5000 loss 0.3492 (w 0.3677 mse 0.3652 t 779 new 0.23) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +[2026-09-12 08:51:16] step 3465/5000 loss 0.1197 (w 0.3248 mse 0.3334 t 965 new 0.18) lr 1.00e-05 gnorm 0.162 2.83s mem 81.1GB +[2026-09-12 08:51:20] step 3466/5000 loss 0.2490 (w 0.2522 mse 0.2609 t 968 new 0.21) lr 1.00e-05 gnorm 0.103 3.40s mem 81.1GB +[2026-09-12 08:51:23] step 3467/5000 loss 0.3186 (w 0.2567 mse 0.2738 t 942 new 0.24) lr 1.00e-05 gnorm 0.149 3.05s mem 81.1GB +[2026-09-12 08:51:26] step 3468/5000 loss 0.2415 (w 0.3242 mse 0.3234 t 858 new 0.26) lr 1.00e-05 gnorm 0.145 3.06s mem 81.1GB +[2026-09-12 08:51:29] step 3469/5000 loss 0.2600 (w 0.2629 mse 0.2728 t 768 new 0.24) lr 1.00e-05 gnorm 0.197 3.39s mem 81.1GB +[2026-09-12 08:51:32] step 3470/5000 loss 0.4131 (w 0.3023 mse 0.3152 t 535 new 0.18) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +[2026-09-12 08:51:35] step 3471/5000 loss 0.3034 (w 0.5637 mse 0.5816 t 100 new 0.22) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-12 08:51:38] step 3472/5000 loss 0.1849 (w 0.2596 mse 0.2764 t 958 new 0.24) lr 1.00e-05 gnorm 0.178 3.27s mem 81.1GB +[2026-09-12 08:51:42] step 3473/5000 loss 0.2587 (w 0.2183 mse 0.2270 t 704 new 0.26) lr 1.00e-05 gnorm 0.207 3.09s mem 81.1GB +[2026-09-12 08:51:45] step 3474/5000 loss 0.1904 (w 0.2758 mse 0.2743 t 843 new 0.23) lr 1.00e-05 gnorm 1.107 3.10s mem 81.1GB +[2026-09-12 08:51:48] step 3475/5000 loss 0.2429 (w 0.3022 mse 0.3067 t 970 new 0.11) lr 1.00e-05 gnorm 0.204 3.11s mem 81.1GB +[2026-09-12 08:51:51] step 3476/5000 loss 0.1605 (w 0.3244 mse 0.3288 t 966 new 0.25) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +[2026-09-12 08:51:54] step 3477/5000 loss 0.3034 (w 0.3348 mse 0.3422 t 990 new 0.21) lr 1.00e-05 gnorm 0.127 3.11s mem 81.1GB +[2026-09-12 08:51:57] step 3478/5000 loss 0.4017 (w 0.2626 mse 0.2723 t 586 new 0.10) lr 1.00e-05 gnorm 0.295 3.39s mem 81.1GB +[2026-09-12 08:52:00] step 3479/5000 loss 0.2790 (w 0.3819 mse 0.3813 t 998 new 0.22) lr 1.00e-05 gnorm 0.187 2.84s mem 81.1GB +[2026-09-12 08:52:03] step 3480/5000 loss 0.2106 (w 0.2384 mse 0.2418 t 908 new 0.12) lr 1.00e-05 gnorm 0.116 3.27s mem 81.1GB +[2026-09-12 08:52:07] step 3481/5000 loss 0.2822 (w 0.3298 mse 0.3359 t 844 new 0.26) lr 1.00e-05 gnorm 0.152 3.60s mem 81.1GB +[2026-09-12 08:52:10] step 3482/5000 loss 0.3697 (w 0.2793 mse 0.2934 t 976 new 0.19) lr 1.00e-05 gnorm 0.199 2.84s mem 81.1GB +[2026-09-12 08:52:13] step 3483/5000 loss 0.3400 (w 0.2527 mse 0.2626 t 731 new 0.23) lr 1.00e-05 gnorm 0.194 3.07s mem 81.1GB +[2026-09-12 08:52:16] step 3484/5000 loss 0.1358 (w 0.2586 mse 0.2721 t 920 new 0.22) lr 1.00e-05 gnorm 0.121 3.35s mem 81.1GB +[2026-09-12 08:52:19] step 3485/5000 loss 0.1305 (w 0.2633 mse 0.2919 t 976 new 0.16) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 08:52:22] step 3486/5000 loss 0.3498 (w 0.3627 mse 0.3791 t 964 new 0.22) lr 1.00e-05 gnorm 0.163 3.29s mem 81.1GB +[2026-09-12 08:52:25] step 3487/5000 loss 0.3805 (w 0.2183 mse 0.2385 t 940 new 0.17) lr 1.00e-05 gnorm 0.145 3.03s mem 81.1GB +[2026-09-12 08:52:28] step 3488/5000 loss 0.2350 (w 0.2597 mse 0.2663 t 939 new 0.22) lr 1.00e-05 gnorm 0.116 2.85s mem 81.1GB +[2026-09-12 08:52:31] step 3489/5000 loss 0.1255 (w 0.2737 mse 0.2747 t 899 new 0.16) lr 1.00e-05 gnorm 0.108 3.10s mem 81.1GB +[2026-09-12 08:52:34] step 3490/5000 loss 0.2722 (w 0.5874 mse 0.5764 t 989 new 0.18) lr 1.00e-05 gnorm 0.153 3.12s mem 81.1GB +[2026-09-12 08:52:37] step 3491/5000 loss 0.1513 (w 0.2983 mse 0.2969 t 976 new 0.08) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +[2026-09-12 08:52:41] step 3492/5000 loss 0.3181 (w 0.2615 mse 0.2703 t 799 new 0.24) lr 1.00e-05 gnorm 0.135 3.32s mem 81.1GB +[2026-09-12 08:52:44] step 3493/5000 loss 0.1891 (w 0.3349 mse 0.3354 t 996 new 0.06) lr 1.00e-05 gnorm 0.126 3.07s mem 81.1GB +[2026-09-12 08:52:46] step 3494/5000 loss 0.3179 (w 0.1556 mse 0.1739 t 760 new 0.27) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +[2026-09-12 08:52:50] step 3495/5000 loss 0.3347 (w 0.6017 mse 0.6292 t 114 new 0.13) lr 1.00e-05 gnorm 0.126 3.14s mem 81.1GB +[2026-09-12 08:52:53] step 3496/5000 loss 0.2969 (w 0.2590 mse 0.2613 t 815 new 0.28) lr 1.00e-05 gnorm 0.117 3.14s mem 81.1GB +[2026-09-12 08:52:56] step 3497/5000 loss 0.1590 (w 0.4640 mse 0.5012 t 986 new 0.26) lr 1.00e-05 gnorm 0.123 3.06s mem 81.1GB +[2026-09-12 08:52:59] step 3498/5000 loss 0.4501 (w 0.2794 mse 0.2664 t 961 new 0.09) lr 1.00e-05 gnorm 0.145 3.28s mem 81.1GB +[2026-09-12 08:53:02] step 3499/5000 loss 0.3004 (w 0.2766 mse 0.2974 t 631 new 0.19) lr 1.00e-05 gnorm 0.231 2.84s mem 81.1GB +[2026-09-12 08:53:05] step 3500/5000 loss 0.3904 (w 0.2118 mse 0.2367 t 910 new 0.21) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +[2026-09-12 08:53:06] [val] step 3500 t=200: w=0.4575 mse=0.4756 (n=16) t=500: w=0.2781 mse=0.2929 (n=16) t=800: w=0.2340 mse=0.2458 (n=16) | mean w=0.3232 mse=0.3381 2s +[2026-09-12 08:53:57] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step3500.safetensors 4093 个张量 37.98 GB +[2026-09-12 08:54:02] step 3501/5000 loss 0.2644 (w 0.2647 mse 0.2777 t 933 new 0.23) lr 1.00e-05 gnorm 0.103 3.43s mem 81.1GB +[2026-09-12 08:54:05] step 3502/5000 loss 0.3094 (w 0.2686 mse 0.2749 t 836 new 0.21) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +[2026-09-12 08:54:08] step 3503/5000 loss 0.2616 (w 0.3878 mse 0.4000 t 994 new 0.17) lr 1.00e-05 gnorm 0.108 3.04s mem 81.1GB +[2026-09-12 08:54:11] step 3504/5000 loss 0.2325 (w 0.3506 mse 0.3767 t 995 new 0.13) lr 1.00e-05 gnorm 0.098 3.13s mem 81.1GB +[2026-09-12 08:54:14] step 3505/5000 loss 0.2852 (w 0.2474 mse 0.2590 t 557 new 0.11) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +[2026-09-12 08:54:17] step 3506/5000 loss 0.3231 (w 0.2996 mse 0.3179 t 992 new 0.22) lr 1.00e-05 gnorm 0.898 2.83s mem 81.1GB +[2026-09-12 08:54:21] step 3507/5000 loss 0.2146 (w 0.4368 mse 0.4322 t 997 new 0.25) lr 1.00e-05 gnorm 0.212 3.38s mem 81.1GB +[2026-09-12 08:54:24] step 3508/5000 loss 0.3153 (w 0.2622 mse 0.2684 t 842 new 0.22) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +[2026-09-12 08:54:27] step 3509/5000 loss 0.2758 (w 0.4020 mse 0.4127 t 999 new 0.21) lr 1.00e-05 gnorm 0.127 3.24s mem 81.1GB +[2026-09-12 08:54:30] step 3510/5000 loss 0.1657 (w 0.3704 mse 0.3717 t 975 new 0.23) lr 1.00e-05 gnorm 0.117 3.32s mem 81.1GB +[2026-09-12 08:54:33] step 3511/5000 loss 0.2527 (w 0.3129 mse 0.3300 t 957 new 0.21) lr 1.00e-05 gnorm 0.162 2.85s mem 81.1GB +[2026-09-12 08:54:36] step 3512/5000 loss 0.2266 (w 0.1905 mse 0.2122 t 922 new 0.22) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +[2026-09-12 08:54:39] step 3513/5000 loss 0.3339 (w 0.3411 mse 0.3573 t 238 new 0.15) lr 1.00e-05 gnorm 0.122 3.27s mem 81.1GB +[2026-09-12 08:54:42] step 3514/5000 loss 0.2668 (w 0.3289 mse 0.3462 t 996 new 0.23) lr 1.00e-05 gnorm 0.180 2.85s mem 81.1GB +[2026-09-12 08:54:46] step 3515/5000 loss 0.3654 (w 0.2626 mse 0.2717 t 866 new 0.11) lr 1.00e-05 gnorm 0.279 3.42s mem 81.1GB +[2026-09-12 08:54:49] step 3516/5000 loss 0.2375 (w 0.2605 mse 0.2619 t 609 new 0.21) lr 1.00e-05 gnorm 0.151 3.11s mem 81.1GB +[2026-09-12 08:54:52] step 3517/5000 loss 0.4018 (w 0.2221 mse 0.2352 t 864 new 0.24) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +[2026-09-12 08:54:55] step 3518/5000 loss 0.2606 (w 0.5001 mse 0.4962 t 996 new 0.28) lr 1.00e-05 gnorm 0.137 3.12s mem 81.1GB +[2026-09-12 08:54:58] step 3519/5000 loss 0.4545 (w 0.2336 mse 0.2326 t 845 new 0.21) lr 1.00e-05 gnorm 0.112 3.04s mem 81.1GB +[2026-09-12 08:55:01] step 3520/5000 loss 0.2582 (w 0.3380 mse 0.3456 t 996 new 0.22) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +[2026-09-12 08:55:04] step 3521/5000 loss 0.4482 (w 0.3920 mse 0.3861 t 264 new 0.22) lr 1.00e-05 gnorm 0.111 3.33s mem 81.1GB +[2026-09-12 08:55:07] step 3522/5000 loss 0.2844 (w 0.2821 mse 0.2791 t 804 new 0.16) lr 1.00e-05 gnorm 0.132 3.06s mem 81.1GB +[2026-09-12 08:55:10] step 3523/5000 loss 0.0882 (w 0.2211 mse 0.2335 t 996 new 0.22) lr 1.00e-05 gnorm 0.267 2.98s mem 81.1GB +[2026-09-12 08:55:14] step 3524/5000 loss 0.3659 (w 0.3233 mse 0.3291 t 872 new 0.25) lr 1.00e-05 gnorm 0.289 3.38s mem 81.1GB +[2026-09-12 08:55:17] step 3525/5000 loss 0.2283 (w 0.2703 mse 0.2812 t 798 new 0.22) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +[2026-09-12 08:55:20] step 3526/5000 loss 0.2186 (w 0.3621 mse 0.3729 t 987 new 0.10) lr 1.00e-05 gnorm 0.106 2.84s mem 81.1GB +[2026-09-12 08:55:23] step 3527/5000 loss 0.3464 (w 0.2501 mse 0.2541 t 829 new 0.22) lr 1.00e-05 gnorm 0.173 3.30s mem 81.1GB +[2026-09-12 08:55:26] step 3528/5000 loss 0.4040 (w 0.2638 mse 0.2739 t 948 new 0.22) lr 1.00e-05 gnorm 0.116 2.85s mem 81.1GB +[2026-09-12 08:55:29] step 3529/5000 loss 0.3926 (w 0.2491 mse 0.2614 t 748 new 0.18) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +[2026-09-12 08:55:32] step 3530/5000 loss 0.2178 (w 0.4140 mse 0.4245 t 995 new 0.13) lr 1.00e-05 gnorm 0.167 3.14s mem 81.1GB +[2026-09-12 08:55:35] step 3531/5000 loss 0.3492 (w 0.3447 mse 0.3448 t 570 new 0.21) lr 1.00e-05 gnorm 0.113 3.06s mem 81.1GB +[2026-09-12 08:55:38] step 3532/5000 loss 0.2135 (w 0.3994 mse 0.4041 t 961 new 0.26) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +[2026-09-12 08:55:41] step 3533/5000 loss 0.2917 (w 0.2922 mse 0.3017 t 931 new 0.23) lr 1.00e-05 gnorm 0.143 3.20s mem 81.1GB +[2026-09-12 08:55:44] step 3534/5000 loss 0.3855 (w 0.3021 mse 0.3142 t 470 new 0.23) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +[2026-09-12 08:55:47] step 3535/5000 loss 0.1928 (w 0.2091 mse 0.2150 t 839 new 0.12) lr 1.00e-05 gnorm 0.098 3.12s mem 81.1GB +[2026-09-12 08:55:50] step 3536/5000 loss 0.2923 (w 0.3827 mse 0.3832 t 995 new 0.18) lr 1.00e-05 gnorm 0.195 3.07s mem 81.1GB +[2026-09-12 08:55:53] step 3537/5000 loss 0.2857 (w 0.2776 mse 0.2828 t 732 new 0.19) lr 1.00e-05 gnorm 0.162 3.05s mem 81.1GB +[2026-09-12 08:55:56] step 3538/5000 loss 0.2361 (w 0.3969 mse 0.3899 t 982 new 0.25) lr 1.00e-05 gnorm 0.118 3.08s mem 81.1GB +[2026-09-12 08:56:00] step 3539/5000 loss 0.2024 (w 0.4080 mse 0.4181 t 999 new 0.19) lr 1.00e-05 gnorm 0.142 3.32s mem 81.1GB +[2026-09-12 08:56:02] step 3540/5000 loss 0.1051 (w 0.2194 mse 0.2293 t 894 new 0.23) lr 1.00e-05 gnorm 0.281 2.84s mem 81.1GB +[2026-09-12 08:56:05] step 3541/5000 loss 0.4155 (w 0.3399 mse 0.3464 t 957 new 0.20) lr 1.00e-05 gnorm 0.100 3.11s mem 81.1GB +[2026-09-12 08:56:09] step 3542/5000 loss 0.3425 (w 0.2586 mse 0.2634 t 823 new 0.19) lr 1.00e-05 gnorm 0.292 3.12s mem 81.1GB +[2026-09-12 08:56:12] step 3543/5000 loss 0.2886 (w 0.3668 mse 0.3804 t 998 new 0.26) lr 1.00e-05 gnorm 0.121 3.06s mem 81.1GB +[2026-09-12 08:56:15] step 3544/5000 loss 0.3069 (w 0.2406 mse 0.2522 t 672 new 0.18) lr 1.00e-05 gnorm 0.117 3.08s mem 81.1GB +[2026-09-12 08:56:18] step 3545/5000 loss 0.2301 (w 0.2045 mse 0.2283 t 879 new 0.25) lr 1.00e-05 gnorm 0.120 3.34s mem 81.1GB +[2026-09-12 08:56:21] step 3546/5000 loss 0.2470 (w 0.1743 mse 0.1924 t 955 new 0.15) lr 1.00e-05 gnorm 0.399 2.84s mem 81.1GB +[2026-09-12 08:56:24] step 3547/5000 loss 0.1827 (w 0.3382 mse 0.3408 t 927 new 0.24) lr 1.00e-05 gnorm 0.124 3.16s mem 81.1GB +[2026-09-12 08:56:27] step 3548/5000 loss 0.2474 (w 0.3114 mse 0.3266 t 981 new 0.17) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +[2026-09-12 08:56:30] step 3549/5000 loss 0.2298 (w 0.2066 mse 0.2260 t 911 new 0.24) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +[2026-09-12 08:56:33] step 3550/5000 loss 0.3753 (w 0.3910 mse 0.3874 t 934 new 0.24) lr 1.00e-05 gnorm 0.219 3.10s mem 81.1GB +[2026-09-12 08:56:37] step 3551/5000 loss 0.3479 (w 0.2506 mse 0.2677 t 826 new 0.21) lr 1.00e-05 gnorm 0.131 3.36s mem 81.1GB +[2026-09-12 08:56:39] step 3552/5000 loss 0.3804 (w 0.3358 mse 0.3617 t 988 new 0.20) lr 1.00e-05 gnorm 0.127 2.86s mem 81.1GB +[2026-09-12 08:56:43] step 3553/5000 loss 0.2816 (w 0.2145 mse 0.2236 t 851 new 0.19) lr 1.00e-05 gnorm 0.140 3.35s mem 81.1GB +[2026-09-12 08:56:46] step 3554/5000 loss 0.2572 (w 0.4485 mse 0.4564 t 996 new 0.23) lr 1.00e-05 gnorm 0.120 3.02s mem 81.1GB +[2026-09-12 08:56:49] step 3555/5000 loss 0.3204 (w 0.3265 mse 0.3393 t 981 new 0.26) lr 1.00e-05 gnorm 0.317 2.83s mem 81.1GB +[2026-09-12 08:56:52] step 3556/5000 loss 0.1892 (w 0.3555 mse 0.3524 t 923 new 0.21) lr 1.00e-05 gnorm 0.103 3.28s mem 81.1GB +[2026-09-12 08:56:55] step 3557/5000 loss 0.3140 (w 0.1408 mse 0.1593 t 910 new 0.13) lr 1.00e-05 gnorm 0.138 3.05s mem 81.1GB +[2026-09-12 08:56:58] step 3558/5000 loss 0.1463 (w 0.4473 mse 0.4432 t 995 new 0.23) lr 1.00e-05 gnorm 0.139 2.82s mem 81.1GB +[2026-09-12 08:57:01] step 3559/5000 loss 0.4283 (w 0.2454 mse 0.2695 t 588 new 0.19) lr 1.00e-05 gnorm 0.207 3.37s mem 81.1GB +[2026-09-12 08:57:04] step 3560/5000 loss 0.3057 (w 0.2620 mse 0.2685 t 865 new 0.14) lr 1.00e-05 gnorm 0.166 3.09s mem 81.1GB +[2026-09-12 08:57:07] step 3561/5000 loss 0.3001 (w 0.2610 mse 0.2649 t 878 new 0.21) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +[2026-09-12 08:57:10] step 3562/5000 loss 0.2491 (w 0.3139 mse 0.3325 t 978 new 0.21) lr 1.00e-05 gnorm 0.136 3.35s mem 81.1GB +[2026-09-12 08:57:14] step 3563/5000 loss 0.1902 (w 0.2876 mse 0.2966 t 956 new 0.24) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +[2026-09-12 08:57:16] step 3564/5000 loss 0.2373 (w 0.1884 mse 0.2127 t 719 new 0.19) lr 1.00e-05 gnorm 0.395 2.83s mem 81.1GB +[2026-09-12 08:57:20] step 3565/5000 loss 0.1301 (w 0.3635 mse 0.3640 t 984 new 0.22) lr 1.00e-05 gnorm 0.165 3.38s mem 81.1GB +[2026-09-12 08:57:23] step 3566/5000 loss 0.2525 (w 0.2610 mse 0.2609 t 933 new 0.15) lr 1.00e-05 gnorm 0.151 3.15s mem 81.1GB +[2026-09-12 08:57:26] step 3567/5000 loss 0.4658 (w 0.3060 mse 0.3195 t 456 new 0.23) lr 1.00e-05 gnorm 0.242 3.11s mem 81.1GB +[2026-09-12 08:57:29] step 3568/5000 loss 0.2121 (w 0.2440 mse 0.2520 t 830 new 0.25) lr 1.00e-05 gnorm 0.116 3.10s mem 81.1GB +[2026-09-12 08:57:32] step 3569/5000 loss 0.2580 (w 0.2134 mse 0.2327 t 939 new 0.15) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +[2026-09-12 08:57:35] step 3570/5000 loss 0.2139 (w 0.2827 mse 0.2907 t 775 new 0.25) lr 1.00e-05 gnorm 0.119 3.09s mem 81.1GB +[2026-09-12 08:57:38] step 3571/5000 loss 0.1812 (w 0.2139 mse 0.2250 t 916 new 0.23) lr 1.00e-05 gnorm 0.157 3.28s mem 81.1GB +[2026-09-12 08:57:41] step 3572/5000 loss 0.1807 (w 0.2396 mse 0.2694 t 973 new 0.21) lr 1.00e-05 gnorm 0.102 3.08s mem 81.1GB +[2026-09-12 08:57:45] step 3573/5000 loss 0.2003 (w 0.2713 mse 0.2712 t 928 new 0.27) lr 1.00e-05 gnorm 0.102 3.13s mem 81.1GB +[2026-09-12 08:57:48] step 3574/5000 loss 0.2846 (w 0.3091 mse 0.3227 t 999 new 0.14) lr 1.00e-05 gnorm 0.105 3.33s mem 81.1GB +[2026-09-12 08:57:51] step 3575/5000 loss 0.3213 (w 0.2097 mse 0.2176 t 740 new 0.22) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +[2026-09-12 08:57:54] step 3576/5000 loss 0.2096 (w 0.2381 mse 0.2592 t 979 new 0.23) lr 1.00e-05 gnorm 0.157 3.13s mem 81.1GB +[2026-09-12 08:57:57] step 3577/5000 loss 0.3137 (w 0.2139 mse 0.2259 t 854 new 0.10) lr 1.00e-05 gnorm 0.132 3.36s mem 81.1GB +[2026-09-12 08:58:00] step 3578/5000 loss 0.2100 (w 0.2647 mse 0.2710 t 920 new 0.18) lr 1.00e-05 gnorm 0.225 3.10s mem 81.1GB +[2026-09-12 08:58:03] step 3579/5000 loss 0.3089 (w 0.2622 mse 0.2587 t 828 new 0.20) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-12 08:58:07] step 3580/5000 loss 0.3393 (w 0.3587 mse 0.3611 t 700 new 0.24) lr 1.00e-05 gnorm 0.129 3.35s mem 81.1GB +[2026-09-12 08:58:10] step 3581/5000 loss 0.1622 (w 0.2875 mse 0.3047 t 992 new 0.16) lr 1.00e-05 gnorm 0.099 2.85s mem 81.1GB +[2026-09-12 08:58:13] step 3582/5000 loss 0.4485 (w 0.1321 mse 0.1400 t 634 new 0.06) lr 1.00e-05 gnorm 0.177 3.16s mem 81.1GB +[2026-09-12 08:58:16] step 3583/5000 loss 0.2154 (w 0.2885 mse 0.2931 t 768 new 0.21) lr 1.00e-05 gnorm 0.117 3.15s mem 81.1GB +[2026-09-12 08:58:19] step 3584/5000 loss 0.2482 (w 0.2902 mse 0.2833 t 628 new 0.16) lr 1.00e-05 gnorm 0.120 3.12s mem 81.1GB +[2026-09-12 08:58:22] step 3585/5000 loss 0.2320 (w 0.2965 mse 0.2954 t 680 new 0.23) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +[2026-09-12 08:58:25] step 3586/5000 loss 0.1921 (w 0.2563 mse 0.2602 t 705 new 0.14) lr 1.00e-05 gnorm 0.102 3.13s mem 81.1GB +[2026-09-12 08:58:28] step 3587/5000 loss 0.2808 (w 0.1873 mse 0.2028 t 904 new 0.23) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +[2026-09-12 08:58:32] step 3588/5000 loss 0.2614 (w 0.3638 mse 0.3678 t 356 new 0.19) lr 1.00e-05 gnorm 0.099 3.40s mem 81.1GB +[2026-09-12 08:58:35] step 3589/5000 loss 0.2025 (w 0.2294 mse 0.2526 t 923 new 0.24) lr 1.00e-05 gnorm 0.173 3.14s mem 81.1GB +[2026-09-12 08:58:37] step 3590/5000 loss 0.2155 (w 0.2451 mse 0.2499 t 948 new 0.21) lr 1.00e-05 gnorm 0.156 2.85s mem 81.1GB +[2026-09-12 08:58:41] step 3591/5000 loss 0.1810 (w 0.1877 mse 0.2061 t 884 new 0.26) lr 1.00e-05 gnorm 0.230 3.09s mem 81.1GB +[2026-09-12 08:58:44] step 3592/5000 loss 0.2298 (w 0.3082 mse 0.3063 t 950 new 0.22) lr 1.00e-05 gnorm 0.157 3.09s mem 81.1GB +[2026-09-12 08:58:47] step 3593/5000 loss 0.3962 (w 0.5213 mse 0.5282 t 288 new 0.21) lr 1.00e-05 gnorm 0.124 2.85s mem 81.1GB +[2026-09-12 08:58:50] step 3594/5000 loss 0.2862 (w 0.5304 mse 0.5788 t 127 new 0.23) lr 1.00e-05 gnorm 0.130 3.12s mem 81.1GB +[2026-09-12 08:58:53] step 3595/5000 loss 0.2770 (w 0.3065 mse 0.3094 t 758 new 0.19) lr 1.00e-05 gnorm 0.152 3.29s mem 81.1GB +[2026-09-12 08:58:56] step 3596/5000 loss 0.2139 (w 0.3603 mse 0.3711 t 967 new 0.20) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +[2026-09-12 08:58:59] step 3597/5000 loss 0.3060 (w 0.2329 mse 0.2512 t 975 new 0.26) lr 1.00e-05 gnorm 0.129 3.12s mem 81.1GB +[2026-09-12 08:59:02] step 3598/5000 loss 0.2733 (w 0.2696 mse 0.2735 t 728 new 0.23) lr 1.00e-05 gnorm 0.687 2.83s mem 81.1GB +[2026-09-12 08:59:05] step 3599/5000 loss 0.1449 (w 0.2750 mse 0.2833 t 972 new 0.20) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-12 08:59:08] step 3600/5000 loss 0.3817 (w 0.4787 mse 0.4831 t 269 new 0.24) lr 1.00e-05 gnorm 0.131 3.11s mem 81.1GB +[2026-09-12 08:59:11] step 3601/5000 loss 0.2853 (w 0.1941 mse 0.2102 t 657 new 0.24) lr 1.00e-05 gnorm 0.101 3.35s mem 81.1GB +[2026-09-12 08:59:14] step 3602/5000 loss 0.3389 (w 0.1587 mse 0.1692 t 612 new 0.13) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +[2026-09-12 08:59:17] step 3603/5000 loss 0.2632 (w 0.2998 mse 0.3043 t 937 new 0.22) lr 1.00e-05 gnorm 0.122 3.28s mem 81.1GB +[2026-09-12 08:59:20] step 3604/5000 loss 0.3831 (w 0.4431 mse 0.4548 t 310 new 0.14) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +[2026-09-12 08:59:23] step 3605/5000 loss 0.3013 (w 0.3230 mse 0.3186 t 909 new 0.26) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-12 08:59:26] step 3606/5000 loss 0.2163 (w 0.2439 mse 0.2463 t 868 new 0.22) lr 1.00e-05 gnorm 0.162 3.33s mem 81.1GB +[2026-09-12 08:59:29] step 3607/5000 loss 0.4379 (w 0.3936 mse 0.3988 t 973 new 0.17) lr 1.00e-05 gnorm 0.121 3.12s mem 81.1GB +[2026-09-12 08:59:32] step 3608/5000 loss 0.3745 (w 0.2552 mse 0.2512 t 725 new 0.06) lr 1.00e-05 gnorm 0.235 2.84s mem 81.1GB +[2026-09-12 08:59:36] step 3609/5000 loss 0.3003 (w 0.5529 mse 0.5638 t 140 new 0.13) lr 1.00e-05 gnorm 0.148 3.35s mem 81.1GB +[2026-09-12 08:59:38] step 3610/5000 loss 0.2481 (w 0.2077 mse 0.2124 t 822 new 0.21) lr 1.00e-05 gnorm 0.283 2.85s mem 81.1GB +[2026-09-12 08:59:41] step 3611/5000 loss 0.2312 (w 0.2380 mse 0.2637 t 976 new 0.16) lr 1.00e-05 gnorm 0.133 3.06s mem 81.1GB +[2026-09-12 08:59:45] step 3612/5000 loss 0.1824 (w 0.2523 mse 0.2760 t 954 new 0.20) lr 1.00e-05 gnorm 0.161 3.12s mem 81.1GB +[2026-09-12 08:59:48] step 3613/5000 loss 0.1536 (w 0.2395 mse 0.2580 t 729 new 0.21) lr 1.00e-05 gnorm 0.096 3.14s mem 81.1GB +[2026-09-12 08:59:51] step 3614/5000 loss 0.0799 (w 0.1938 mse 0.2192 t 915 new 0.22) lr 1.00e-05 gnorm 0.133 3.30s mem 81.1GB +[2026-09-12 08:59:54] step 3615/5000 loss 0.2325 (w 0.2646 mse 0.2644 t 781 new 0.19) lr 1.00e-05 gnorm 0.119 3.38s mem 81.1GB +[2026-09-12 08:59:57] step 3616/5000 loss 0.1975 (w 0.3149 mse 0.3209 t 676 new 0.24) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +[2026-09-12 09:00:00] step 3617/5000 loss 0.1639 (w 0.1947 mse 0.2165 t 844 new 0.22) lr 1.00e-05 gnorm 0.110 3.09s mem 81.1GB +[2026-09-12 09:00:03] step 3618/5000 loss 0.3312 (w 0.2426 mse 0.2583 t 947 new 0.19) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +[2026-09-12 09:00:06] step 3619/5000 loss 0.3264 (w 0.1913 mse 0.1950 t 772 new 0.07) lr 1.00e-05 gnorm 0.113 3.06s mem 81.1GB +[2026-09-12 09:00:10] step 3620/5000 loss 0.2694 (w 0.3132 mse 0.3255 t 721 new 0.19) lr 1.00e-05 gnorm 0.148 3.16s mem 81.1GB +[2026-09-12 09:00:13] step 3621/5000 loss 0.3613 (w 0.2790 mse 0.2800 t 811 new 0.26) lr 1.00e-05 gnorm 0.123 3.13s mem 81.1GB +[2026-09-12 09:00:16] step 3622/5000 loss 0.3515 (w 0.3696 mse 0.3766 t 479 new 0.19) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +[2026-09-12 09:00:19] step 3623/5000 loss 0.3882 (w 0.2525 mse 0.2625 t 642 new 0.23) lr 1.00e-05 gnorm 0.423 3.46s mem 81.1GB +[2026-09-12 09:00:22] step 3624/5000 loss 0.3809 (w 0.3377 mse 0.3398 t 970 new 0.18) lr 1.00e-05 gnorm 0.266 3.07s mem 81.1GB +[2026-09-12 09:00:25] step 3625/5000 loss 0.3576 (w 0.2464 mse 0.2584 t 760 new 0.20) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +[2026-09-12 09:00:28] step 3626/5000 loss 0.4837 (w 0.6295 mse 0.6236 t 153 new 0.24) lr 1.00e-05 gnorm 0.149 3.21s mem 81.1GB +[2026-09-12 09:00:32] step 3627/5000 loss 0.2705 (w 0.2834 mse 0.2870 t 997 new 0.23) lr 1.00e-05 gnorm 0.282 3.12s mem 81.1GB +[2026-09-12 09:00:34] step 3628/5000 loss 0.3179 (w 0.3285 mse 0.3320 t 945 new 0.23) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +[2026-09-12 09:00:38] step 3629/5000 loss 0.2350 (w 0.2144 mse 0.2290 t 865 new 0.21) lr 1.00e-05 gnorm 0.140 3.38s mem 81.1GB +[2026-09-12 09:00:41] step 3630/5000 loss 0.2531 (w 0.3818 mse 0.3866 t 969 new 0.19) lr 1.00e-05 gnorm 0.108 3.40s mem 81.1GB +[2026-09-12 09:00:44] step 3631/5000 loss 0.4321 (w 0.3447 mse 0.3478 t 787 new 0.18) lr 1.00e-05 gnorm 0.570 2.83s mem 81.1GB +[2026-09-12 09:00:47] step 3632/5000 loss 0.2028 (w 0.2597 mse 0.2716 t 959 new 0.15) lr 1.00e-05 gnorm 0.125 3.14s mem 81.1GB +[2026-09-12 09:00:50] step 3633/5000 loss 0.2461 (w 0.2672 mse 0.2672 t 444 new 0.17) lr 1.00e-05 gnorm 0.350 3.06s mem 81.1GB +[2026-09-12 09:00:53] step 3634/5000 loss 0.2986 (w 0.2869 mse 0.2843 t 890 new 0.22) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +[2026-09-12 09:00:56] step 3635/5000 loss 0.1958 (w 0.2579 mse 0.2628 t 885 new 0.25) lr 1.00e-05 gnorm 0.134 3.36s mem 81.1GB +[2026-09-12 09:01:00] step 3636/5000 loss 0.3646 (w 0.2119 mse 0.2272 t 975 new 0.12) lr 1.00e-05 gnorm 0.207 3.41s mem 81.1GB +[2026-09-12 09:01:03] step 3637/5000 loss 0.0916 (w 0.2612 mse 0.2745 t 972 new 0.24) lr 1.00e-05 gnorm 0.103 2.84s mem 81.1GB +[2026-09-12 09:01:06] step 3638/5000 loss 0.3959 (w 0.4142 mse 0.4012 t 936 new 0.25) lr 1.00e-05 gnorm 0.231 3.43s mem 81.1GB +[2026-09-12 09:01:09] step 3639/5000 loss 0.1607 (w 0.2476 mse 0.2582 t 817 new 0.23) lr 1.00e-05 gnorm 0.160 3.11s mem 81.1GB +[2026-09-12 09:01:12] step 3640/5000 loss 0.2403 (w 0.2290 mse 0.2411 t 947 new 0.21) lr 1.00e-05 gnorm 0.132 3.18s mem 81.1GB +[2026-09-12 09:01:16] step 3641/5000 loss 0.2551 (w 0.3247 mse 0.3308 t 836 new 0.26) lr 1.00e-05 gnorm 0.103 3.13s mem 81.1GB +[2026-09-12 09:01:19] step 3642/5000 loss 0.2059 (w 0.2368 mse 0.2465 t 962 new 0.21) lr 1.00e-05 gnorm 0.192 3.07s mem 81.1GB +[2026-09-12 09:01:21] step 3643/5000 loss 0.4091 (w 0.3623 mse 0.3855 t 955 new 0.25) lr 1.00e-05 gnorm 0.109 2.83s mem 81.1GB +[2026-09-12 09:01:25] step 3644/5000 loss 0.1616 (w 0.2982 mse 0.3201 t 957 new 0.23) lr 1.00e-05 gnorm 0.138 3.07s mem 81.1GB +[2026-09-12 09:01:28] step 3645/5000 loss 0.1415 (w 0.2051 mse 0.2066 t 629 new 0.10) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +[2026-09-12 09:01:30] step 3646/5000 loss 0.2868 (w 0.2737 mse 0.2860 t 704 new 0.19) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +[2026-09-12 09:01:34] step 3647/5000 loss 0.2687 (w 0.2626 mse 0.2622 t 774 new 0.19) lr 1.00e-05 gnorm 0.141 3.35s mem 81.1GB +[2026-09-12 09:01:37] step 3648/5000 loss 0.3689 (w 0.3346 mse 0.3272 t 918 new 0.24) lr 1.00e-05 gnorm 0.126 3.06s mem 81.1GB +[2026-09-12 09:01:40] step 3649/5000 loss 0.1905 (w 0.2644 mse 0.2830 t 926 new 0.26) lr 1.00e-05 gnorm 0.101 3.03s mem 81.1GB +[2026-09-12 09:01:43] step 3650/5000 loss 0.2192 (w 0.2704 mse 0.2823 t 934 new 0.22) lr 1.00e-05 gnorm 0.126 3.25s mem 81.1GB +[2026-09-12 09:01:46] step 3651/5000 loss 0.3782 (w 0.2343 mse 0.2436 t 865 new 0.16) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +[2026-09-12 09:01:49] step 3652/5000 loss 0.2623 (w 0.1746 mse 0.1771 t 817 new 0.17) lr 1.00e-05 gnorm 0.111 3.05s mem 81.1GB +[2026-09-12 09:01:52] step 3653/5000 loss 0.1287 (w 0.3152 mse 0.3182 t 997 new 0.27) lr 1.00e-05 gnorm 0.197 3.37s mem 81.1GB +[2026-09-12 09:01:55] step 3654/5000 loss 0.2425 (w 0.3085 mse 0.3271 t 975 new 0.16) lr 1.00e-05 gnorm 0.118 3.03s mem 81.1GB +[2026-09-12 09:01:58] step 3655/5000 loss 0.1646 (w 0.3180 mse 0.3453 t 962 new 0.21) lr 1.00e-05 gnorm 0.106 3.03s mem 81.1GB +[2026-09-12 09:02:01] step 3656/5000 loss 0.1998 (w 0.2820 mse 0.2916 t 492 new 0.24) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +[2026-09-12 09:02:04] step 3657/5000 loss 0.4615 (w 0.3350 mse 0.3427 t 915 new 0.18) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +[2026-09-12 09:02:08] step 3658/5000 loss 0.2285 (w 0.3109 mse 0.3096 t 966 new 0.16) lr 1.00e-05 gnorm 0.143 3.31s mem 81.1GB +[2026-09-12 09:02:11] step 3659/5000 loss 0.2068 (w 0.2863 mse 0.2885 t 973 new 0.24) lr 1.00e-05 gnorm 0.187 3.07s mem 81.1GB +[2026-09-12 09:02:14] step 3660/5000 loss 0.3288 (w 0.2944 mse 0.2923 t 917 new 0.19) lr 1.00e-05 gnorm 0.335 3.04s mem 81.1GB +[2026-09-12 09:02:17] step 3661/5000 loss 0.2855 (w 0.4412 mse 0.4362 t 941 new 0.18) lr 1.00e-05 gnorm 0.125 3.07s mem 81.1GB +[2026-09-12 09:02:20] step 3662/5000 loss 0.2867 (w 0.2783 mse 0.2931 t 836 new 0.20) lr 1.00e-05 gnorm 0.198 3.01s mem 81.1GB +[2026-09-12 09:02:23] step 3663/5000 loss 0.4308 (w 0.3184 mse 0.3216 t 709 new 0.19) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +[2026-09-12 09:02:26] step 3664/5000 loss 0.2854 (w 0.3382 mse 0.3464 t 348 new 0.23) lr 1.00e-05 gnorm 0.150 3.27s mem 81.1GB +[2026-09-12 09:02:29] step 3665/5000 loss 0.2884 (w 0.3578 mse 0.3688 t 372 new 0.17) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +[2026-09-12 09:02:32] step 3666/5000 loss 0.1774 (w 0.2348 mse 0.2555 t 847 new 0.22) lr 1.00e-05 gnorm 0.119 3.05s mem 81.1GB +[2026-09-12 09:02:35] step 3667/5000 loss 0.3578 (w 0.3017 mse 0.3105 t 848 new 0.15) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-12 09:02:38] step 3668/5000 loss 0.2932 (w 0.2184 mse 0.2439 t 944 new 0.17) lr 1.00e-05 gnorm 0.136 3.03s mem 81.1GB +[2026-09-12 09:02:41] step 3669/5000 loss 0.4403 (w 0.2442 mse 0.2525 t 690 new 0.17) lr 1.00e-05 gnorm 0.156 2.83s mem 81.1GB +[2026-09-12 09:02:44] step 3670/5000 loss 0.3405 (w 0.2873 mse 0.2944 t 574 new 0.21) lr 1.00e-05 gnorm 0.107 3.17s mem 81.1GB +[2026-09-12 09:02:47] step 3671/5000 loss 0.1833 (w 0.2857 mse 0.2996 t 987 new 0.20) lr 1.00e-05 gnorm 0.218 3.06s mem 81.1GB +[2026-09-12 09:02:50] step 3672/5000 loss 0.2713 (w 0.2610 mse 0.2845 t 988 new 0.25) lr 1.00e-05 gnorm 0.183 3.10s mem 81.1GB +[2026-09-12 09:02:54] step 3673/5000 loss 0.2151 (w 0.2189 mse 0.2227 t 887 new 0.09) lr 1.00e-05 gnorm 0.116 3.33s mem 81.1GB +[2026-09-12 09:02:57] step 3674/5000 loss 0.1919 (w 0.2374 mse 0.2531 t 903 new 0.14) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +[2026-09-12 09:03:00] step 3675/5000 loss 0.2612 (w 0.3216 mse 0.3179 t 903 new 0.24) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +[2026-09-12 09:03:03] step 3676/5000 loss 0.1791 (w 0.1885 mse 0.2130 t 936 new 0.25) lr 1.00e-05 gnorm 0.139 3.18s mem 81.1GB +[2026-09-12 09:03:06] step 3677/5000 loss 0.4204 (w 0.2670 mse 0.2637 t 774 new 0.08) lr 1.00e-05 gnorm 0.119 3.10s mem 81.1GB +[2026-09-12 09:03:09] step 3678/5000 loss 0.4044 (w 0.2695 mse 0.2862 t 953 new 0.20) lr 1.00e-05 gnorm 0.164 3.33s mem 81.1GB +[2026-09-12 09:03:13] step 3679/5000 loss 0.4716 (w 0.3304 mse 0.3408 t 672 new 0.22) lr 1.00e-05 gnorm 0.105 3.33s mem 81.1GB +[2026-09-12 09:03:15] step 3680/5000 loss 0.1952 (w 0.3295 mse 0.3362 t 977 new 0.10) lr 1.00e-05 gnorm 0.185 2.84s mem 81.1GB +[2026-09-12 09:03:18] step 3681/5000 loss 0.2310 (w 0.2150 mse 0.2422 t 866 new 0.23) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-12 09:03:22] step 3682/5000 loss 0.2690 (w 0.2664 mse 0.2700 t 947 new 0.18) lr 1.00e-05 gnorm 0.164 3.49s mem 81.1GB +[2026-09-12 09:03:25] step 3683/5000 loss 0.2682 (w 0.3125 mse 0.3099 t 961 new 0.18) lr 1.00e-05 gnorm 0.115 3.37s mem 81.1GB +[2026-09-12 09:03:28] step 3684/5000 loss 0.3639 (w 0.4005 mse 0.4042 t 930 new 0.18) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +[2026-09-12 09:03:31] step 3685/5000 loss 0.2128 (w 0.3576 mse 0.3676 t 999 new 0.19) lr 1.00e-05 gnorm 0.235 3.26s mem 81.1GB +[2026-09-12 09:03:34] step 3686/5000 loss 0.2248 (w 0.3071 mse 0.3149 t 979 new 0.29) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +[2026-09-12 09:03:37] step 3687/5000 loss 0.2505 (w 0.2184 mse 0.2408 t 781 new 0.16) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-12 09:03:41] step 3688/5000 loss 0.2864 (w 0.2639 mse 0.2695 t 840 new 0.12) lr 1.00e-05 gnorm 0.131 3.37s mem 81.1GB +[2026-09-12 09:03:44] step 3689/5000 loss 0.5251 (w 0.2402 mse 0.2487 t 796 new 0.19) lr 1.00e-05 gnorm 0.236 3.09s mem 81.1GB +[2026-09-12 09:03:47] step 3690/5000 loss 0.2874 (w 0.2450 mse 0.2563 t 730 new 0.16) lr 1.00e-05 gnorm 0.170 3.10s mem 81.1GB +[2026-09-12 09:03:50] step 3691/5000 loss 0.2334 (w 0.3394 mse 0.3404 t 607 new 0.15) lr 1.00e-05 gnorm 0.245 3.33s mem 81.1GB +[2026-09-12 09:03:53] step 3692/5000 loss 0.2896 (w 0.1883 mse 0.2085 t 718 new 0.20) lr 1.00e-05 gnorm 0.111 2.85s mem 81.1GB +[2026-09-12 09:03:56] step 3693/5000 loss 0.2992 (w 0.3065 mse 0.3162 t 712 new 0.23) lr 1.00e-05 gnorm 0.184 2.85s mem 81.1GB +[2026-09-12 09:03:59] step 3694/5000 loss 0.1760 (w 0.2119 mse 0.2267 t 921 new 0.25) lr 1.00e-05 gnorm 0.128 3.43s mem 81.1GB +[2026-09-12 09:04:02] step 3695/5000 loss 0.3117 (w 0.2737 mse 0.2666 t 929 new 0.19) lr 1.00e-05 gnorm 0.265 3.07s mem 81.1GB +[2026-09-12 09:04:06] step 3696/5000 loss 0.2160 (w 0.4350 mse 0.4407 t 983 new 0.27) lr 1.00e-05 gnorm 0.190 3.12s mem 81.1GB +[2026-09-12 09:04:10] step 3697/5000 loss 0.4231 (w 0.1916 mse 0.2068 t 820 new 0.15) lr 1.00e-05 gnorm 0.113 3.46s mem 81.1GB +[2026-09-12 09:04:13] step 3698/5000 loss 0.3269 (w 0.1741 mse 0.1817 t 787 new 0.19) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +[2026-09-12 09:04:16] step 3699/5000 loss 0.4176 (w 0.3904 mse 0.3963 t 991 new 0.15) lr 1.00e-05 gnorm 0.163 2.83s mem 81.1GB +[2026-09-12 09:04:19] step 3700/5000 loss 0.2322 (w 0.2151 mse 0.2268 t 672 new 0.07) lr 1.00e-05 gnorm 0.149 3.35s mem 81.1GB +[2026-09-12 09:04:22] step 3701/5000 loss 0.4727 (w 0.2788 mse 0.2770 t 912 new 0.23) lr 1.00e-05 gnorm 0.131 3.08s mem 81.1GB +[2026-09-12 09:04:26] step 3702/5000 loss 0.2614 (w 0.2739 mse 0.2741 t 785 new 0.27) lr 1.00e-05 gnorm 0.127 3.48s mem 81.1GB +[2026-09-12 09:04:29] step 3703/5000 loss 0.3660 (w 0.3186 mse 0.3292 t 866 new 0.16) lr 1.00e-05 gnorm 0.131 3.08s mem 81.1GB +[2026-09-12 09:04:32] step 3704/5000 loss 0.2857 (w 0.6451 mse 0.6395 t 120 new 0.22) lr 1.00e-05 gnorm 0.183 2.86s mem 81.1GB +[2026-09-12 09:04:35] step 3705/5000 loss 0.1410 (w 0.3555 mse 0.3536 t 962 new 0.27) lr 1.00e-05 gnorm 0.101 3.37s mem 81.1GB +[2026-09-12 09:04:38] step 3706/5000 loss 0.3333 (w 0.4073 mse 0.4071 t 977 new 0.18) lr 1.00e-05 gnorm 0.115 3.10s mem 81.1GB +[2026-09-12 09:04:41] step 3707/5000 loss 0.3168 (w 0.3306 mse 0.3326 t 557 new 0.21) lr 1.00e-05 gnorm 0.140 3.12s mem 81.1GB +[2026-09-12 09:04:45] step 3708/5000 loss 0.1570 (w 0.2217 mse 0.2186 t 650 new 0.16) lr 1.00e-05 gnorm 0.113 3.51s mem 81.1GB +[2026-09-12 09:04:48] step 3709/5000 loss 0.3172 (w 0.6204 mse 0.6293 t 159 new 0.21) lr 1.00e-05 gnorm 0.113 2.83s mem 81.1GB +[2026-09-12 09:04:50] step 3710/5000 loss 0.3410 (w 0.2554 mse 0.2674 t 961 new 0.17) lr 1.00e-05 gnorm 0.247 2.84s mem 81.1GB +[2026-09-12 09:04:54] step 3711/5000 loss 0.1966 (w 0.1967 mse 0.2042 t 873 new 0.22) lr 1.00e-05 gnorm 0.138 3.09s mem 81.1GB +[2026-09-12 09:04:57] step 3712/5000 loss 0.2808 (w 0.1798 mse 0.1840 t 909 new 0.17) lr 1.00e-05 gnorm 0.110 3.27s mem 81.1GB +[2026-09-12 09:05:00] step 3713/5000 loss 0.2588 (w 0.2502 mse 0.2677 t 991 new 0.12) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-12 09:05:03] step 3714/5000 loss 0.3345 (w 0.2534 mse 0.2558 t 946 new 0.19) lr 1.00e-05 gnorm 0.123 3.24s mem 81.1GB +[2026-09-12 09:05:06] step 3715/5000 loss 0.2472 (w 0.5333 mse 0.5529 t 140 new 0.08) lr 1.00e-05 gnorm 0.085 2.84s mem 81.1GB +[2026-09-12 09:05:09] step 3716/5000 loss 0.3992 (w 0.4236 mse 0.3953 t 964 new 0.23) lr 1.00e-05 gnorm 0.117 2.85s mem 81.1GB +[2026-09-12 09:05:12] step 3717/5000 loss 0.3748 (w 0.2410 mse 0.2555 t 981 new 0.19) lr 1.00e-05 gnorm 0.169 3.38s mem 81.1GB +[2026-09-12 09:05:16] step 3718/5000 loss 0.3179 (w 0.4139 mse 0.4072 t 977 new 0.18) lr 1.00e-05 gnorm 0.101 3.39s mem 81.1GB +[2026-09-12 09:05:19] step 3719/5000 loss 0.2255 (w 0.2940 mse 0.3067 t 959 new 0.26) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +[2026-09-12 09:05:22] step 3720/5000 loss 0.1384 (w 0.2142 mse 0.2357 t 721 new 0.20) lr 1.00e-05 gnorm 0.113 3.30s mem 81.1GB +[2026-09-12 09:05:25] step 3721/5000 loss 0.2898 (w 0.3649 mse 0.3621 t 960 new 0.26) lr 1.00e-05 gnorm 0.325 2.84s mem 81.1GB +[2026-09-12 09:05:28] step 3722/5000 loss 0.3220 (w 0.3237 mse 0.3137 t 963 new 0.21) lr 1.00e-05 gnorm 0.154 2.85s mem 81.1GB +[2026-09-12 09:05:31] step 3723/5000 loss 0.3200 (w 0.3821 mse 0.3977 t 249 new 0.18) lr 1.00e-05 gnorm 0.127 3.42s mem 81.1GB +[2026-09-12 09:05:34] step 3724/5000 loss 0.3940 (w 0.4837 mse 0.4901 t 992 new 0.21) lr 1.00e-05 gnorm 0.090 3.28s mem 81.1GB +[2026-09-12 09:05:37] step 3725/5000 loss 0.2583 (w 0.2014 mse 0.2267 t 923 new 0.22) lr 1.00e-05 gnorm 0.106 3.03s mem 81.1GB +[2026-09-12 09:05:40] step 3726/5000 loss 0.1102 (w 0.2713 mse 0.2805 t 918 new 0.23) lr 1.00e-05 gnorm 0.109 3.09s mem 81.1GB +[2026-09-12 09:05:43] step 3727/5000 loss 0.1927 (w 0.3118 mse 0.3224 t 980 new 0.20) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +[2026-09-12 09:05:46] step 3728/5000 loss 0.2352 (w 0.2782 mse 0.2684 t 934 new 0.21) lr 1.00e-05 gnorm 0.242 3.04s mem 81.1GB +[2026-09-12 09:05:49] step 3729/5000 loss 0.3286 (w 0.4526 mse 0.4572 t 368 new 0.20) lr 1.00e-05 gnorm 0.141 3.11s mem 81.1GB +[2026-09-12 09:05:53] step 3730/5000 loss 0.2580 (w 0.2244 mse 0.2389 t 878 new 0.19) lr 1.00e-05 gnorm 0.128 3.34s mem 81.1GB +[2026-09-12 09:05:56] step 3731/5000 loss 0.4195 (w 0.2512 mse 0.2590 t 619 new 0.16) lr 1.00e-05 gnorm 0.109 3.04s mem 81.1GB +[2026-09-12 09:05:59] step 3732/5000 loss 0.2905 (w 0.2803 mse 0.2889 t 695 new 0.24) lr 1.00e-05 gnorm 0.209 3.15s mem 81.1GB +[2026-09-12 09:06:02] step 3733/5000 loss 0.2576 (w 0.3283 mse 0.3205 t 872 new 0.23) lr 1.00e-05 gnorm 0.234 2.85s mem 81.1GB +[2026-09-12 09:06:05] step 3734/5000 loss 0.2103 (w 0.2727 mse 0.2709 t 827 new 0.22) lr 1.00e-05 gnorm 0.198 3.06s mem 81.1GB +[2026-09-12 09:06:08] step 3735/5000 loss 0.4057 (w 0.2781 mse 0.2843 t 619 new 0.16) lr 1.00e-05 gnorm 0.356 3.11s mem 81.1GB +[2026-09-12 09:06:11] step 3736/5000 loss 0.0937 (w 0.3286 mse 0.3365 t 954 new 0.24) lr 1.00e-05 gnorm 0.109 3.14s mem 81.1GB +[2026-09-12 09:06:14] step 3737/5000 loss 0.4021 (w 0.2865 mse 0.2857 t 829 new 0.22) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +[2026-09-12 09:06:17] step 3738/5000 loss 0.2346 (w 0.2821 mse 0.2870 t 730 new 0.23) lr 1.00e-05 gnorm 0.195 3.13s mem 81.1GB +[2026-09-12 09:06:20] step 3739/5000 loss 0.3671 (w 0.2804 mse 0.2941 t 948 new 0.17) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +[2026-09-12 09:06:23] step 3740/5000 loss 0.2733 (w 0.2618 mse 0.2696 t 977 new 0.21) lr 1.00e-05 gnorm 0.193 3.37s mem 81.1GB +[2026-09-12 09:06:27] step 3741/5000 loss 0.2928 (w 0.1794 mse 0.1919 t 942 new 0.20) lr 1.00e-05 gnorm 0.362 2.85s mem 81.1GB +[2026-09-12 09:06:30] step 3742/5000 loss 0.2268 (w 0.2824 mse 0.2885 t 901 new 0.24) lr 1.00e-05 gnorm 0.206 3.07s mem 81.1GB +[2026-09-12 09:06:33] step 3743/5000 loss 0.2882 (w 0.3422 mse 0.3532 t 348 new 0.19) lr 1.00e-05 gnorm 0.486 3.10s mem 81.1GB +[2026-09-12 09:06:36] step 3744/5000 loss 0.3643 (w 0.1922 mse 0.1997 t 870 new 0.17) lr 1.00e-05 gnorm 0.114 3.11s mem 81.1GB +[2026-09-12 09:06:39] step 3745/5000 loss 0.4469 (w 0.2988 mse 0.3004 t 943 new 0.19) lr 1.00e-05 gnorm 0.199 2.84s mem 81.1GB +[2026-09-12 09:06:42] step 3746/5000 loss 0.2846 (w 0.1930 mse 0.2069 t 659 new 0.21) lr 1.00e-05 gnorm 0.119 3.60s mem 81.1GB +[2026-09-12 09:06:45] step 3747/5000 loss 0.5676 (w 0.2293 mse 0.2489 t 702 new 0.24) lr 1.00e-05 gnorm 0.116 3.07s mem 81.1GB +[2026-09-12 09:06:48] step 3748/5000 loss 0.3515 (w 0.2619 mse 0.2698 t 892 new 0.19) lr 1.00e-05 gnorm 0.268 3.10s mem 81.1GB +[2026-09-12 09:06:52] step 3749/5000 loss 0.2858 (w 0.2053 mse 0.2107 t 802 new 0.20) lr 1.00e-05 gnorm 0.181 3.14s mem 81.1GB +[2026-09-12 09:06:55] step 3750/5000 loss 0.2402 (w 0.3245 mse 0.3148 t 863 new 0.19) lr 1.00e-05 gnorm 0.125 3.09s mem 81.1GB +[2026-09-12 09:06:58] step 3751/5000 loss 0.2478 (w 0.3655 mse 0.3677 t 942 new 0.25) lr 1.00e-05 gnorm 0.196 2.85s mem 81.1GB +[2026-09-12 09:07:01] step 3752/5000 loss 0.3722 (w 0.3213 mse 0.3211 t 692 new 0.09) lr 1.00e-05 gnorm 0.142 3.49s mem 81.1GB +[2026-09-12 09:07:04] step 3753/5000 loss 0.1663 (w 0.2894 mse 0.2973 t 953 new 0.17) lr 1.00e-05 gnorm 0.116 3.13s mem 81.1GB +[2026-09-12 09:07:07] step 3754/5000 loss 0.4096 (w 0.2275 mse 0.2327 t 711 new 0.11) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +[2026-09-12 09:07:10] step 3755/5000 loss 0.2741 (w 0.2625 mse 0.2654 t 264 new 0.10) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +[2026-09-12 09:07:13] step 3756/5000 loss 0.3586 (w 0.5939 mse 0.6053 t 171 new 0.22) lr 1.00e-05 gnorm 0.157 3.11s mem 81.1GB +[2026-09-12 09:07:16] step 3757/5000 loss 0.2749 (w 0.2277 mse 0.2451 t 680 new 0.17) lr 1.00e-05 gnorm 0.110 2.84s mem 81.1GB +[2026-09-12 09:07:19] step 3758/5000 loss 0.3256 (w 0.4100 mse 0.4224 t 288 new 0.19) lr 1.00e-05 gnorm 0.137 3.36s mem 81.1GB +[2026-09-12 09:07:23] step 3759/5000 loss 0.3358 (w 0.3271 mse 0.3275 t 972 new 0.18) lr 1.00e-05 gnorm 0.118 3.08s mem 81.1GB +[2026-09-12 09:07:25] step 3760/5000 loss 0.2454 (w 0.4204 mse 0.4225 t 301 new 0.26) lr 1.00e-05 gnorm 0.092 2.83s mem 81.1GB +[2026-09-12 09:07:29] step 3761/5000 loss 0.3428 (w 0.4223 mse 0.4239 t 969 new 0.24) lr 1.00e-05 gnorm 0.130 3.35s mem 81.1GB +[2026-09-12 09:07:32] step 3762/5000 loss 0.2049 (w 0.2920 mse 0.2838 t 901 new 0.17) lr 1.00e-05 gnorm 0.113 3.03s mem 81.1GB +[2026-09-12 09:07:35] step 3763/5000 loss 0.3235 (w 0.2470 mse 0.2479 t 908 new 0.19) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +[2026-09-12 09:07:38] step 3764/5000 loss 0.2196 (w 0.2343 mse 0.2504 t 943 new 0.24) lr 1.00e-05 gnorm 0.163 3.29s mem 81.1GB +[2026-09-12 09:07:41] step 3765/5000 loss 0.2362 (w 0.1501 mse 0.1669 t 832 new 0.16) lr 1.00e-05 gnorm 0.143 3.39s mem 81.1GB +[2026-09-12 09:07:44] step 3766/5000 loss 0.1686 (w 0.2424 mse 0.2556 t 933 new 0.22) lr 1.00e-05 gnorm 0.134 3.02s mem 81.1GB +[2026-09-12 09:07:48] step 3767/5000 loss 0.3723 (w 0.2226 mse 0.2259 t 789 new 0.23) lr 1.00e-05 gnorm 0.168 3.32s mem 81.1GB +[2026-09-12 09:07:51] step 3768/5000 loss 0.2147 (w 0.2384 mse 0.2491 t 882 new 0.22) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +[2026-09-12 09:07:54] step 3769/5000 loss 0.2770 (w 0.3271 mse 0.3177 t 982 new 0.15) lr 1.00e-05 gnorm 0.141 3.03s mem 81.1GB +[2026-09-12 09:07:57] step 3770/5000 loss 0.4311 (w 0.2303 mse 0.2631 t 958 new 0.22) lr 1.00e-05 gnorm 0.111 3.18s mem 81.1GB +[2026-09-12 09:08:00] step 3771/5000 loss 0.2164 (w 0.3661 mse 0.3659 t 988 new 0.17) lr 1.00e-05 gnorm 0.142 3.44s mem 81.1GB +[2026-09-12 09:08:04] step 3772/5000 loss 0.4074 (w 0.2273 mse 0.2365 t 914 new 0.20) lr 1.00e-05 gnorm 0.145 3.07s mem 81.1GB +[2026-09-12 09:08:07] step 3773/5000 loss 0.2282 (w 0.2363 mse 0.2433 t 936 new 0.21) lr 1.00e-05 gnorm 0.226 3.10s mem 81.1GB +[2026-09-12 09:08:09] step 3774/5000 loss 0.3732 (w 0.3012 mse 0.3035 t 969 new 0.23) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +[2026-09-12 09:08:13] step 3775/5000 loss 0.4809 (w 0.2654 mse 0.2828 t 987 new 0.20) lr 1.00e-05 gnorm 0.122 3.05s mem 81.1GB +[2026-09-12 09:08:16] step 3776/5000 loss 0.3658 (w 0.1732 mse 0.1827 t 677 new 0.22) lr 1.00e-05 gnorm 0.108 3.15s mem 81.1GB +[2026-09-12 09:08:19] step 3777/5000 loss 0.5564 (w 0.3716 mse 0.3813 t 379 new 0.28) lr 1.00e-05 gnorm 0.112 3.15s mem 81.1GB +[2026-09-12 09:08:22] step 3778/5000 loss 0.1842 (w 0.2646 mse 0.2672 t 923 new 0.11) lr 1.00e-05 gnorm 0.110 3.26s mem 81.1GB +[2026-09-12 09:08:25] step 3779/5000 loss 0.2110 (w 0.2386 mse 0.2319 t 881 new 0.07) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +[2026-09-12 09:08:28] step 3780/5000 loss 0.1853 (w 0.2696 mse 0.2807 t 875 new 0.16) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +[2026-09-12 09:08:31] step 3781/5000 loss 0.3565 (w 0.2179 mse 0.2332 t 490 new 0.10) lr 1.00e-05 gnorm 0.154 3.06s mem 81.1GB +[2026-09-12 09:08:34] step 3782/5000 loss 0.2741 (w 0.2127 mse 0.2209 t 680 new 0.15) lr 1.00e-05 gnorm 0.108 3.18s mem 81.1GB +[2026-09-12 09:08:37] step 3783/5000 loss 0.3688 (w 0.2495 mse 0.2703 t 915 new 0.20) lr 1.00e-05 gnorm 0.128 3.11s mem 81.1GB +[2026-09-12 09:08:41] step 3784/5000 loss 0.3196 (w 0.2375 mse 0.2436 t 328 new 0.13) lr 1.00e-05 gnorm 0.119 3.28s mem 81.1GB +[2026-09-12 09:08:44] step 3785/5000 loss 0.1673 (w 0.2363 mse 0.2605 t 983 new 0.17) lr 1.00e-05 gnorm 0.115 3.05s mem 81.1GB +[2026-09-12 09:08:47] step 3786/5000 loss 0.2844 (w 0.2577 mse 0.2671 t 838 new 0.26) lr 1.00e-05 gnorm 0.135 2.83s mem 81.1GB +[2026-09-12 09:08:50] step 3787/5000 loss 0.0979 (w 0.2935 mse 0.2879 t 941 new 0.09) lr 1.00e-05 gnorm 0.362 3.10s mem 81.1GB +[2026-09-12 09:08:53] step 3788/5000 loss 0.1810 (w 0.3241 mse 0.3268 t 957 new 0.24) lr 1.00e-05 gnorm 0.308 3.14s mem 81.1GB +[2026-09-12 09:08:56] step 3789/5000 loss 0.3670 (w 0.3409 mse 0.3576 t 965 new 0.23) lr 1.00e-05 gnorm 0.151 3.13s mem 81.1GB +[2026-09-12 09:08:59] step 3790/5000 loss 0.2577 (w 0.3455 mse 0.3488 t 495 new 0.24) lr 1.00e-05 gnorm 0.146 3.40s mem 81.1GB +[2026-09-12 09:09:03] step 3791/5000 loss 0.3202 (w 0.3465 mse 0.3527 t 929 new 0.23) lr 1.00e-05 gnorm 0.099 3.33s mem 81.1GB +[2026-09-12 09:09:06] step 3792/5000 loss 0.3633 (w 0.3427 mse 0.3460 t 994 new 0.22) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +[2026-09-12 09:09:09] step 3793/5000 loss 0.2664 (w 0.3090 mse 0.3081 t 970 new 0.18) lr 1.00e-05 gnorm 0.094 3.54s mem 81.1GB +[2026-09-12 09:09:12] step 3794/5000 loss 0.3192 (w 0.2315 mse 0.2476 t 770 new 0.18) lr 1.00e-05 gnorm 0.164 3.06s mem 81.1GB +[2026-09-12 09:09:15] step 3795/5000 loss 0.2821 (w 0.2795 mse 0.2857 t 930 new 0.12) lr 1.00e-05 gnorm 0.243 3.05s mem 81.1GB +[2026-09-12 09:09:18] step 3796/5000 loss 0.2240 (w 0.2705 mse 0.2765 t 961 new 0.16) lr 1.00e-05 gnorm 0.105 3.08s mem 81.1GB +[2026-09-12 09:09:21] step 3797/5000 loss 0.1349 (w 0.1738 mse 0.1811 t 894 new 0.17) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +[2026-09-12 09:09:24] step 3798/5000 loss 0.1651 (w 0.2207 mse 0.2455 t 540 new 0.28) lr 1.00e-05 gnorm 0.116 2.85s mem 81.1GB +[2026-09-12 09:09:28] step 3799/5000 loss 0.1388 (w 0.2585 mse 0.2582 t 855 new 0.20) lr 1.00e-05 gnorm 0.111 3.40s mem 81.1GB +[2026-09-12 09:09:31] step 3800/5000 loss 0.1331 (w 0.3458 mse 0.3443 t 998 new 0.23) lr 1.00e-05 gnorm 0.149 3.11s mem 81.1GB +[2026-09-12 09:09:34] step 3801/5000 loss 0.2326 (w 0.2253 mse 0.2301 t 937 new 0.23) lr 1.00e-05 gnorm 0.113 3.04s mem 81.1GB +[2026-09-12 09:09:37] step 3802/5000 loss 0.1860 (w 0.3070 mse 0.3077 t 929 new 0.24) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +[2026-09-12 09:09:40] step 3803/5000 loss 0.2865 (w 0.2814 mse 0.2914 t 735 new 0.23) lr 1.00e-05 gnorm 0.128 3.12s mem 81.1GB +[2026-09-12 09:09:43] step 3804/5000 loss 0.1894 (w 0.3266 mse 0.3397 t 958 new 0.18) lr 1.00e-05 gnorm 0.127 3.30s mem 81.1GB +[2026-09-12 09:09:47] step 3805/5000 loss 0.1847 (w 0.1754 mse 0.1942 t 842 new 0.13) lr 1.00e-05 gnorm 0.118 3.15s mem 81.1GB +[2026-09-12 09:09:50] step 3806/5000 loss 0.1807 (w 0.2600 mse 0.2643 t 887 new 0.17) lr 1.00e-05 gnorm 0.147 3.39s mem 81.1GB +[2026-09-12 09:09:53] step 3807/5000 loss 0.2868 (w 0.2937 mse 0.2852 t 846 new 0.22) lr 1.00e-05 gnorm 0.130 3.09s mem 81.1GB +[2026-09-12 09:09:56] step 3808/5000 loss 0.2814 (w 0.2800 mse 0.2874 t 972 new 0.21) lr 1.00e-05 gnorm 0.155 3.08s mem 81.1GB +[2026-09-12 09:09:59] step 3809/5000 loss 0.3820 (w 0.3304 mse 0.3373 t 964 new 0.24) lr 1.00e-05 gnorm 0.388 3.08s mem 81.1GB +[2026-09-12 09:10:02] step 3810/5000 loss 0.2491 (w 0.2639 mse 0.2716 t 925 new 0.19) lr 1.00e-05 gnorm 0.157 3.04s mem 81.1GB +[2026-09-12 09:10:05] step 3811/5000 loss 0.3445 (w 0.2510 mse 0.2626 t 684 new 0.16) lr 1.00e-05 gnorm 0.263 3.18s mem 81.1GB +[2026-09-12 09:10:09] step 3812/5000 loss 0.4400 (w 0.2796 mse 0.3065 t 379 new 0.23) lr 1.00e-05 gnorm 0.134 3.33s mem 81.1GB +[2026-09-12 09:10:12] step 3813/5000 loss 0.4447 (w 0.4166 mse 0.4209 t 411 new 0.16) lr 1.00e-05 gnorm 0.177 3.11s mem 81.1GB +[2026-09-12 09:10:15] step 3814/5000 loss 0.1813 (w 0.2851 mse 0.2852 t 923 new 0.22) lr 1.00e-05 gnorm 0.123 3.34s mem 81.1GB +[2026-09-12 09:10:18] step 3815/5000 loss 0.3592 (w 0.2192 mse 0.2394 t 867 new 0.22) lr 1.00e-05 gnorm 0.119 3.03s mem 81.1GB +[2026-09-12 09:10:21] step 3816/5000 loss 0.2652 (w 0.3046 mse 0.3040 t 921 new 0.10) lr 1.00e-05 gnorm 0.101 3.09s mem 81.1GB +[2026-09-12 09:10:24] step 3817/5000 loss 0.2232 (w 0.3042 mse 0.2986 t 780 new 0.18) lr 1.00e-05 gnorm 0.136 3.12s mem 81.1GB +[2026-09-12 09:10:28] step 3818/5000 loss 0.4732 (w 0.2415 mse 0.2435 t 834 new 0.07) lr 1.00e-05 gnorm 0.141 3.35s mem 81.1GB +[2026-09-12 09:10:31] step 3819/5000 loss 0.2460 (w 0.3987 mse 0.4115 t 996 new 0.16) lr 1.00e-05 gnorm 0.138 3.04s mem 81.1GB +[2026-09-12 09:10:34] step 3820/5000 loss 0.2561 (w 0.2267 mse 0.2364 t 969 new 0.13) lr 1.00e-05 gnorm 0.101 3.33s mem 81.1GB +[2026-09-12 09:10:37] step 3821/5000 loss 0.2062 (w 0.2910 mse 0.2990 t 621 new 0.21) lr 1.00e-05 gnorm 0.125 3.03s mem 81.1GB +[2026-09-12 09:10:40] step 3822/5000 loss 0.1260 (w 0.3327 mse 0.3322 t 972 new 0.18) lr 1.00e-05 gnorm 0.102 3.06s mem 81.1GB +[2026-09-12 09:10:43] step 3823/5000 loss 0.1486 (w 0.1884 mse 0.2185 t 992 new 0.18) lr 1.00e-05 gnorm 0.138 3.15s mem 81.1GB +[2026-09-12 09:10:47] step 3824/5000 loss 0.1779 (w 0.5320 mse 0.5470 t 120 new 0.21) lr 1.00e-05 gnorm 0.115 3.46s mem 81.1GB +[2026-09-12 09:10:50] step 3825/5000 loss 0.2963 (w 0.2715 mse 0.2830 t 866 new 0.24) lr 1.00e-05 gnorm 0.226 3.07s mem 81.1GB +[2026-09-12 09:10:53] step 3826/5000 loss 0.1809 (w 0.1298 mse 0.1384 t 840 new 0.07) lr 1.00e-05 gnorm 0.113 3.05s mem 81.1GB +[2026-09-12 09:10:56] step 3827/5000 loss 0.2645 (w 0.2574 mse 0.2605 t 992 new 0.12) lr 1.00e-05 gnorm 0.443 3.28s mem 81.1GB +[2026-09-12 09:11:00] step 3828/5000 loss 0.1614 (w 0.3697 mse 0.3723 t 978 new 0.20) lr 1.00e-05 gnorm 0.182 3.33s mem 81.1GB +[2026-09-12 09:11:03] step 3829/5000 loss 0.1714 (w 0.2086 mse 0.2119 t 919 new 0.21) lr 1.00e-05 gnorm 0.116 3.16s mem 81.1GB +[2026-09-12 09:11:06] step 3830/5000 loss 0.3742 (w 0.2670 mse 0.2853 t 910 new 0.23) lr 1.00e-05 gnorm 0.119 3.29s mem 81.1GB +[2026-09-12 09:11:09] step 3831/5000 loss 0.2496 (w 0.2362 mse 0.2527 t 847 new 0.12) lr 1.00e-05 gnorm 0.162 2.85s mem 81.1GB +[2026-09-12 09:11:12] step 3832/5000 loss 0.2614 (w 0.3590 mse 0.3640 t 945 new 0.20) lr 1.00e-05 gnorm 0.124 3.31s mem 81.1GB +[2026-09-12 09:11:16] step 3833/5000 loss 0.3195 (w 0.2960 mse 0.3044 t 530 new 0.25) lr 1.00e-05 gnorm 0.114 3.30s mem 81.1GB +[2026-09-12 09:11:19] step 3834/5000 loss 0.3380 (w 0.1814 mse 0.2065 t 790 new 0.21) lr 1.00e-05 gnorm 0.123 3.30s mem 81.1GB +[2026-09-12 09:11:22] step 3835/5000 loss 0.2780 (w 0.2735 mse 0.2773 t 516 new 0.16) lr 1.00e-05 gnorm 0.155 3.15s mem 81.1GB +[2026-09-12 09:11:25] step 3836/5000 loss 0.2854 (w 0.2364 mse 0.2398 t 759 new 0.20) lr 1.00e-05 gnorm 0.118 3.30s mem 81.1GB +[2026-09-12 09:11:28] step 3837/5000 loss 0.1372 (w 0.1963 mse 0.2052 t 826 new 0.07) lr 1.00e-05 gnorm 0.108 2.83s mem 81.1GB +[2026-09-12 09:11:31] step 3838/5000 loss 0.1859 (w 0.3129 mse 0.3190 t 961 new 0.21) lr 1.00e-05 gnorm 0.109 3.27s mem 81.1GB +[2026-09-12 09:11:35] step 3839/5000 loss 0.2281 (w 0.2802 mse 0.2864 t 930 new 0.13) lr 1.00e-05 gnorm 0.132 3.34s mem 81.1GB +[2026-09-12 09:11:38] step 3840/5000 loss 0.3423 (w 0.3548 mse 0.3515 t 919 new 0.18) lr 1.00e-05 gnorm 0.132 3.31s mem 81.1GB +[2026-09-12 09:11:41] step 3841/5000 loss 0.3059 (w 0.2765 mse 0.2903 t 913 new 0.22) lr 1.00e-05 gnorm 0.103 3.09s mem 81.1GB +[2026-09-12 09:11:44] step 3842/5000 loss 0.2521 (w 0.3354 mse 0.3243 t 977 new 0.16) lr 1.00e-05 gnorm 0.109 3.33s mem 81.1GB +[2026-09-12 09:11:48] step 3843/5000 loss 0.2996 (w 0.4071 mse 0.3979 t 983 new 0.20) lr 1.00e-05 gnorm 0.112 3.14s mem 81.1GB +[2026-09-12 09:11:51] step 3844/5000 loss 0.5299 (w 0.2860 mse 0.2923 t 356 new 0.13) lr 1.00e-05 gnorm 0.117 3.07s mem 81.1GB +[2026-09-12 09:11:54] step 3845/5000 loss 0.3680 (w 0.3033 mse 0.3279 t 992 new 0.15) lr 1.00e-05 gnorm 0.119 3.04s mem 81.1GB +[2026-09-12 09:11:57] step 3846/5000 loss 0.1801 (w 0.3841 mse 0.3782 t 962 new 0.23) lr 1.00e-05 gnorm 0.096 3.12s mem 81.1GB +[2026-09-12 09:12:00] step 3847/5000 loss 0.4341 (w 0.3244 mse 0.3264 t 890 new 0.27) lr 1.00e-05 gnorm 0.182 3.11s mem 81.1GB +[2026-09-12 09:12:03] step 3848/5000 loss 0.3702 (w 0.6754 mse 0.6750 t 107 new 0.22) lr 1.00e-05 gnorm 0.120 3.08s mem 81.1GB +[2026-09-12 09:12:06] step 3849/5000 loss 0.1976 (w 0.2894 mse 0.3036 t 942 new 0.19) lr 1.00e-05 gnorm 0.129 3.05s mem 81.1GB +[2026-09-12 09:12:09] step 3850/5000 loss 0.4341 (w 0.2588 mse 0.2671 t 546 new 0.23) lr 1.00e-05 gnorm 0.216 3.05s mem 81.1GB +[2026-09-12 09:12:12] step 3851/5000 loss 0.3193 (w 0.2792 mse 0.2955 t 689 new 0.23) lr 1.00e-05 gnorm 0.139 3.04s mem 81.1GB +[2026-09-12 09:12:15] step 3852/5000 loss 0.1651 (w 0.2868 mse 0.2907 t 871 new 0.18) lr 1.00e-05 gnorm 0.122 3.16s mem 81.1GB +[2026-09-12 09:12:19] step 3853/5000 loss 0.4616 (w 0.2535 mse 0.2688 t 724 new 0.24) lr 1.00e-05 gnorm 0.122 3.16s mem 81.1GB +[2026-09-12 09:12:22] step 3854/5000 loss 0.1617 (w 0.1368 mse 0.1405 t 889 new 0.05) lr 1.00e-05 gnorm 0.102 3.04s mem 81.1GB +[2026-09-12 09:12:25] step 3855/5000 loss 0.3078 (w 0.2332 mse 0.2429 t 928 new 0.18) lr 1.00e-05 gnorm 0.162 3.10s mem 81.1GB +[2026-09-12 09:12:28] step 3856/5000 loss 0.3107 (w 0.3168 mse 0.3101 t 784 new 0.19) lr 1.00e-05 gnorm 0.138 3.07s mem 81.1GB +[2026-09-12 09:12:31] step 3857/5000 loss 0.3220 (w 0.3304 mse 0.3349 t 991 new 0.22) lr 1.00e-05 gnorm 0.106 3.09s mem 81.1GB +[2026-09-12 09:12:34] step 3858/5000 loss 0.4561 (w 0.3009 mse 0.2968 t 930 new 0.20) lr 1.00e-05 gnorm 0.133 3.27s mem 81.1GB +[2026-09-12 09:12:37] step 3859/5000 loss 0.2387 (w 0.3795 mse 0.3831 t 677 new 0.23) lr 1.00e-05 gnorm 0.181 3.13s mem 81.1GB +[2026-09-12 09:12:40] step 3860/5000 loss 0.3206 (w 0.2698 mse 0.2865 t 989 new 0.23) lr 1.00e-05 gnorm 0.147 3.06s mem 81.1GB +[2026-09-12 09:12:44] step 3861/5000 loss 0.2860 (w 0.2367 mse 0.2387 t 866 new 0.18) lr 1.00e-05 gnorm 0.224 3.22s mem 81.1GB +[2026-09-12 09:12:47] step 3862/5000 loss 0.2978 (w 0.2796 mse 0.2834 t 920 new 0.24) lr 1.00e-05 gnorm 0.103 3.30s mem 81.1GB +[2026-09-12 09:12:50] step 3863/5000 loss 0.3283 (w 0.2638 mse 0.2712 t 943 new 0.16) lr 1.00e-05 gnorm 0.145 2.83s mem 81.1GB +[2026-09-12 09:12:53] step 3864/5000 loss 0.3232 (w 0.4131 mse 0.4170 t 987 new 0.11) lr 1.00e-05 gnorm 0.192 3.13s mem 81.1GB +[2026-09-12 09:12:56] step 3865/5000 loss 0.2036 (w 0.2054 mse 0.2099 t 853 new 0.08) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-12 09:12:59] step 3866/5000 loss 0.3741 (w 0.2138 mse 0.2414 t 888 new 0.18) lr 1.00e-05 gnorm 0.158 3.08s mem 81.1GB +[2026-09-12 09:13:02] step 3867/5000 loss 0.3964 (w 0.2825 mse 0.2901 t 853 new 0.22) lr 1.00e-05 gnorm 0.127 3.12s mem 81.1GB +[2026-09-12 09:13:05] step 3868/5000 loss 0.2279 (w 0.2769 mse 0.2949 t 987 new 0.22) lr 1.00e-05 gnorm 0.095 3.27s mem 81.1GB +[2026-09-12 09:13:08] step 3869/5000 loss 0.2484 (w 0.2606 mse 0.2556 t 919 new 0.23) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +[2026-09-12 09:13:12] step 3870/5000 loss 0.2764 (w 0.2220 mse 0.2227 t 826 new 0.16) lr 1.00e-05 gnorm 0.134 3.36s mem 81.1GB +[2026-09-12 09:13:15] step 3871/5000 loss 0.3369 (w 0.3229 mse 0.3402 t 997 new 0.17) lr 1.00e-05 gnorm 0.152 3.38s mem 81.1GB +[2026-09-12 09:13:18] step 3872/5000 loss 0.2343 (w 0.2739 mse 0.2679 t 865 new 0.21) lr 1.00e-05 gnorm 0.100 2.84s mem 81.1GB +[2026-09-12 09:13:21] step 3873/5000 loss 0.2512 (w 0.2247 mse 0.2381 t 892 new 0.23) lr 1.00e-05 gnorm 0.114 3.13s mem 81.1GB +[2026-09-12 09:13:24] step 3874/5000 loss 0.3625 (w 0.2112 mse 0.2312 t 761 new 0.13) lr 1.00e-05 gnorm 0.179 3.13s mem 81.1GB +[2026-09-12 09:13:27] step 3875/5000 loss 0.1944 (w 0.2638 mse 0.2780 t 816 new 0.15) lr 1.00e-05 gnorm 0.405 2.84s mem 81.1GB +[2026-09-12 09:13:30] step 3876/5000 loss 0.3321 (w 0.2916 mse 0.3045 t 580 new 0.23) lr 1.00e-05 gnorm 0.143 3.12s mem 81.1GB +[2026-09-12 09:13:33] step 3877/5000 loss 0.2497 (w 0.3457 mse 0.3498 t 980 new 0.22) lr 1.00e-05 gnorm 0.923 3.03s mem 81.1GB +[2026-09-12 09:13:36] step 3878/5000 loss 0.4217 (w 0.2600 mse 0.2710 t 462 new 0.18) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +[2026-09-12 09:13:39] step 3879/5000 loss 0.2850 (w 0.3431 mse 0.3405 t 964 new 0.27) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +[2026-09-12 09:13:43] step 3880/5000 loss 0.3970 (w 0.4465 mse 0.4521 t 424 new 0.10) lr 1.00e-05 gnorm 0.118 3.12s mem 81.1GB +[2026-09-12 09:13:46] step 3881/5000 loss 0.2365 (w 0.3326 mse 0.3369 t 934 new 0.22) lr 1.00e-05 gnorm 0.089 3.12s mem 81.1GB +[2026-09-12 09:13:49] step 3882/5000 loss 0.1978 (w 0.1970 mse 0.2150 t 926 new 0.21) lr 1.00e-05 gnorm 0.144 3.08s mem 81.1GB +[2026-09-12 09:13:52] step 3883/5000 loss 0.1942 (w 0.3075 mse 0.3241 t 983 new 0.21) lr 1.00e-05 gnorm 0.091 3.10s mem 81.1GB +[2026-09-12 09:13:55] step 3884/5000 loss 0.1991 (w 0.3419 mse 0.3617 t 959 new 0.15) lr 1.00e-05 gnorm 0.131 3.06s mem 81.1GB +[2026-09-12 09:13:58] step 3885/5000 loss 0.2202 (w 0.3057 mse 0.3077 t 811 new 0.26) lr 1.00e-05 gnorm 0.134 3.10s mem 81.1GB +[2026-09-12 09:14:01] step 3886/5000 loss 0.2503 (w 0.3113 mse 0.3243 t 979 new 0.26) lr 1.00e-05 gnorm 0.137 3.20s mem 81.1GB +[2026-09-12 09:14:04] step 3887/5000 loss 0.3362 (w 0.2865 mse 0.2944 t 465 new 0.18) lr 1.00e-05 gnorm 1.506 3.16s mem 81.1GB +[2026-09-12 09:14:07] step 3888/5000 loss 0.3051 (w 0.2017 mse 0.2273 t 544 new 0.23) lr 1.00e-05 gnorm 0.132 3.10s mem 81.1GB +[2026-09-12 09:14:11] step 3889/5000 loss 0.1295 (w 0.2350 mse 0.2533 t 836 new 0.21) lr 1.00e-05 gnorm 0.230 3.11s mem 81.1GB +[2026-09-12 09:14:14] step 3890/5000 loss 0.4714 (w 0.2590 mse 0.2586 t 986 new 0.21) lr 1.00e-05 gnorm 0.139 3.05s mem 81.1GB +[2026-09-12 09:14:17] step 3891/5000 loss 0.2263 (w 0.2530 mse 0.2625 t 949 new 0.15) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +[2026-09-12 09:14:20] step 3892/5000 loss 0.2744 (w 0.2355 mse 0.2387 t 817 new 0.14) lr 1.00e-05 gnorm 0.147 3.25s mem 81.1GB +[2026-09-12 09:14:23] step 3893/5000 loss 0.3533 (w 0.2461 mse 0.2482 t 725 new 0.12) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +[2026-09-12 09:14:26] step 3894/5000 loss 0.2860 (w 0.5559 mse 0.5553 t 223 new 0.03) lr 1.00e-05 gnorm 0.112 3.28s mem 81.1GB +[2026-09-12 09:14:29] step 3895/5000 loss 0.3502 (w 0.4294 mse 0.4407 t 998 new 0.14) lr 1.00e-05 gnorm 0.171 3.03s mem 81.1GB +[2026-09-12 09:14:33] step 3896/5000 loss 0.3422 (w 0.3247 mse 0.3364 t 544 new 0.26) lr 1.00e-05 gnorm 0.144 3.07s mem 81.1GB +[2026-09-12 09:14:36] step 3897/5000 loss 0.2910 (w 0.2543 mse 0.2605 t 940 new 0.22) lr 1.00e-05 gnorm 0.335 3.25s mem 81.1GB +[2026-09-12 09:14:39] step 3898/5000 loss 0.2466 (w 0.3830 mse 0.3898 t 989 new 0.19) lr 1.00e-05 gnorm 0.181 3.24s mem 81.1GB +[2026-09-12 09:14:42] step 3899/5000 loss 0.1346 (w 0.2287 mse 0.2307 t 918 new 0.21) lr 1.00e-05 gnorm 0.142 3.16s mem 81.1GB +[2026-09-12 09:14:45] step 3900/5000 loss 0.1963 (w 0.2019 mse 0.2125 t 772 new 0.27) lr 1.00e-05 gnorm 0.342 3.09s mem 81.1GB +[2026-09-12 09:14:48] step 3901/5000 loss 0.3409 (w 0.2544 mse 0.2649 t 913 new 0.24) lr 1.00e-05 gnorm 0.188 3.06s mem 81.1GB +[2026-09-12 09:14:51] step 3902/5000 loss 0.3162 (w 0.3546 mse 0.3807 t 383 new 0.14) lr 1.00e-05 gnorm 0.149 3.11s mem 81.1GB +[2026-09-12 09:14:55] step 3903/5000 loss 0.3490 (w 0.2618 mse 0.2584 t 811 new 0.19) lr 1.00e-05 gnorm 0.110 3.33s mem 81.1GB +[2026-09-12 09:14:58] step 3904/5000 loss 0.1337 (w 0.3388 mse 0.3375 t 963 new 0.23) lr 1.00e-05 gnorm 0.136 3.59s mem 81.1GB +[2026-09-12 09:15:01] step 3905/5000 loss 0.2618 (w 0.3375 mse 0.3319 t 936 new 0.21) lr 1.00e-05 gnorm 0.254 3.05s mem 81.1GB +[2026-09-12 09:15:05] step 3906/5000 loss 0.3372 (w 0.2044 mse 0.2189 t 824 new 0.24) lr 1.00e-05 gnorm 0.179 3.31s mem 81.1GB +[2026-09-12 09:15:08] step 3907/5000 loss 0.2259 (w 0.4400 mse 0.4409 t 991 new 0.17) lr 1.00e-05 gnorm 0.132 2.85s mem 81.1GB +[2026-09-12 09:15:11] step 3908/5000 loss 0.2769 (w 0.2433 mse 0.2457 t 764 new 0.22) lr 1.00e-05 gnorm 0.105 3.35s mem 81.1GB +[2026-09-12 09:15:14] step 3909/5000 loss 0.3342 (w 0.2740 mse 0.2884 t 956 new 0.22) lr 1.00e-05 gnorm 0.180 3.42s mem 81.1GB +[2026-09-12 09:15:18] step 3910/5000 loss 0.2486 (w 0.3028 mse 0.3043 t 880 new 0.26) lr 1.00e-05 gnorm 0.126 3.29s mem 81.1GB +[2026-09-12 09:15:21] step 3911/5000 loss 0.2176 (w 0.2184 mse 0.2201 t 919 new 0.22) lr 1.00e-05 gnorm 0.130 3.07s mem 81.1GB +[2026-09-12 09:15:24] step 3912/5000 loss 0.2891 (w 0.1745 mse 0.2007 t 823 new 0.20) lr 1.00e-05 gnorm 0.125 3.29s mem 81.1GB +[2026-09-12 09:15:27] step 3913/5000 loss 0.4352 (w 0.3143 mse 0.3295 t 982 new 0.21) lr 1.00e-05 gnorm 0.117 3.13s mem 81.1GB +[2026-09-12 09:15:30] step 3914/5000 loss 0.3580 (w 0.2995 mse 0.3094 t 506 new 0.24) lr 1.00e-05 gnorm 0.143 3.03s mem 81.1GB +[2026-09-12 09:15:34] step 3915/5000 loss 0.2674 (w 0.3989 mse 0.3808 t 892 new 0.13) lr 1.00e-05 gnorm 0.144 3.34s mem 81.1GB +[2026-09-12 09:15:37] step 3916/5000 loss 0.2328 (w 0.2473 mse 0.2570 t 999 new 0.18) lr 1.00e-05 gnorm 0.103 3.18s mem 81.1GB +[2026-09-12 09:15:40] step 3917/5000 loss 0.3206 (w 0.3126 mse 0.3214 t 972 new 0.13) lr 1.00e-05 gnorm 0.182 3.08s mem 81.1GB +[2026-09-12 09:15:43] step 3918/5000 loss 0.2312 (w 0.5177 mse 0.5049 t 1000 new 0.21) lr 1.00e-05 gnorm 0.239 3.05s mem 81.1GB +[2026-09-12 09:15:46] step 3919/5000 loss 0.3115 (w 0.1948 mse 0.2164 t 677 new 0.20) lr 1.00e-05 gnorm 0.117 3.03s mem 81.1GB +[2026-09-12 09:15:49] step 3920/5000 loss 0.2138 (w 0.2591 mse 0.2767 t 995 new 0.23) lr 1.00e-05 gnorm 0.099 3.06s mem 81.1GB +[2026-09-12 09:15:52] step 3921/5000 loss 0.3665 (w 0.1996 mse 0.2178 t 823 new 0.14) lr 1.00e-05 gnorm 0.212 3.32s mem 81.1GB +[2026-09-12 09:15:55] step 3922/5000 loss 0.2567 (w 0.2298 mse 0.2438 t 942 new 0.09) lr 1.00e-05 gnorm 0.133 3.18s mem 81.1GB +[2026-09-12 09:15:59] step 3923/5000 loss 0.3063 (w 0.1887 mse 0.2101 t 729 new 0.27) lr 1.00e-05 gnorm 0.126 3.27s mem 81.1GB +[2026-09-12 09:16:02] step 3924/5000 loss 0.1874 (w 0.4244 mse 0.4213 t 945 new 0.22) lr 1.00e-05 gnorm 0.289 3.07s mem 81.1GB +[2026-09-12 09:16:05] step 3925/5000 loss 0.2795 (w 0.2702 mse 0.2760 t 889 new 0.17) lr 1.00e-05 gnorm 0.109 3.05s mem 81.1GB +[2026-09-12 09:16:08] step 3926/5000 loss 0.1188 (w 0.2115 mse 0.2281 t 968 new 0.12) lr 1.00e-05 gnorm 0.184 3.09s mem 81.1GB +[2026-09-12 09:16:11] step 3927/5000 loss 0.4524 (w 0.2102 mse 0.2282 t 724 new 0.25) lr 1.00e-05 gnorm 0.139 3.32s mem 81.1GB +[2026-09-12 09:16:14] step 3928/5000 loss 0.3061 (w 0.3588 mse 0.3797 t 993 new 0.24) lr 1.00e-05 gnorm 0.120 3.17s mem 81.1GB +[2026-09-12 09:16:18] step 3929/5000 loss 0.4154 (w 0.2598 mse 0.2785 t 516 new 0.24) lr 1.00e-05 gnorm 0.123 3.30s mem 81.1GB +[2026-09-12 09:16:21] step 3930/5000 loss 0.3015 (w 0.2482 mse 0.2661 t 546 new 0.27) lr 1.00e-05 gnorm 0.153 3.11s mem 81.1GB +[2026-09-12 09:16:24] step 3931/5000 loss 0.1940 (w 0.2708 mse 0.2999 t 961 new 0.20) lr 1.00e-05 gnorm 0.112 3.05s mem 81.1GB +[2026-09-12 09:16:27] step 3932/5000 loss 0.1760 (w 0.1988 mse 0.2127 t 858 new 0.25) lr 1.00e-05 gnorm 0.111 3.02s mem 81.1GB +[2026-09-12 09:16:30] step 3933/5000 loss 0.2720 (w 0.3347 mse 0.3329 t 966 new 0.22) lr 1.00e-05 gnorm 0.116 3.09s mem 81.1GB +[2026-09-12 09:16:34] step 3934/5000 loss 0.1497 (w 0.2979 mse 0.3056 t 944 new 0.25) lr 1.00e-05 gnorm 0.098 3.29s mem 81.1GB +[2026-09-12 09:16:37] step 3935/5000 loss 0.2965 (w 0.2411 mse 0.2599 t 887 new 0.17) lr 1.00e-05 gnorm 0.134 3.32s mem 81.1GB +[2026-09-12 09:16:40] step 3936/5000 loss 0.2875 (w 0.3028 mse 0.3072 t 980 new 0.17) lr 1.00e-05 gnorm 0.107 3.06s mem 81.1GB +[2026-09-12 09:16:43] step 3937/5000 loss 0.2167 (w 0.3100 mse 0.3169 t 878 new 0.21) lr 1.00e-05 gnorm 0.103 3.10s mem 81.1GB +[2026-09-12 09:16:46] step 3938/5000 loss 0.2278 (w 0.2665 mse 0.2885 t 976 new 0.17) lr 1.00e-05 gnorm 0.138 3.25s mem 81.1GB +[2026-09-12 09:16:49] step 3939/5000 loss 0.2884 (w 0.2413 mse 0.2527 t 856 new 0.28) lr 1.00e-05 gnorm 0.161 3.07s mem 81.1GB +[2026-09-12 09:16:53] step 3940/5000 loss 0.5141 (w 0.3218 mse 0.3307 t 767 new 0.23) lr 1.00e-05 gnorm 0.130 3.24s mem 81.1GB +[2026-09-12 09:16:56] step 3941/5000 loss 0.2870 (w 0.3765 mse 0.3915 t 264 new 0.13) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +[2026-09-12 09:16:59] step 3942/5000 loss 0.2950 (w 0.5741 mse 0.5761 t 177 new 0.16) lr 1.00e-05 gnorm 0.106 3.09s mem 81.1GB +[2026-09-12 09:17:02] step 3943/5000 loss 0.3315 (w 0.3162 mse 0.3040 t 958 new 0.25) lr 1.00e-05 gnorm 0.185 3.26s mem 81.1GB +[2026-09-12 09:17:05] step 3944/5000 loss 0.2136 (w 0.2539 mse 0.2563 t 788 new 0.15) lr 1.00e-05 gnorm 0.098 3.05s mem 81.1GB +[2026-09-12 09:17:09] step 3945/5000 loss 0.2017 (w 0.1625 mse 0.1658 t 943 new 0.02) lr 1.00e-05 gnorm 0.181 4.03s mem 81.1GB +[2026-09-12 09:17:12] step 3946/5000 loss 0.2106 (w 0.2802 mse 0.2873 t 990 new 0.21) lr 1.00e-05 gnorm 0.179 3.21s mem 81.1GB +[2026-09-12 09:17:16] step 3947/5000 loss 0.2793 (w 0.3388 mse 0.3332 t 969 new 0.13) lr 1.00e-05 gnorm 0.141 3.26s mem 81.1GB +[2026-09-12 09:17:19] step 3948/5000 loss 0.2616 (w 0.2721 mse 0.2789 t 693 new 0.20) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +[2026-09-12 09:17:22] step 3949/5000 loss 0.2330 (w 0.3553 mse 0.3825 t 997 new 0.21) lr 1.00e-05 gnorm 0.114 3.26s mem 81.1GB +[2026-09-12 09:17:25] step 3950/5000 loss 0.1370 (w 0.2319 mse 0.2549 t 914 new 0.21) lr 1.00e-05 gnorm 0.197 3.03s mem 81.1GB +[2026-09-12 09:17:28] step 3951/5000 loss 0.3558 (w 0.4124 mse 0.4280 t 999 new 0.24) lr 1.00e-05 gnorm 0.098 3.13s mem 81.1GB +[2026-09-12 09:17:31] step 3952/5000 loss 0.3043 (w 0.2037 mse 0.2096 t 828 new 0.10) lr 1.00e-05 gnorm 0.116 3.22s mem 81.1GB +[2026-09-12 09:17:35] step 3953/5000 loss 0.2649 (w 0.1995 mse 0.2265 t 867 new 0.20) lr 1.00e-05 gnorm 0.143 3.34s mem 81.1GB +[2026-09-12 09:17:37] step 3954/5000 loss 0.1764 (w 0.2673 mse 0.2657 t 651 new 0.15) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +[2026-09-12 09:17:41] step 3955/5000 loss 0.2760 (w 0.4475 mse 0.4322 t 978 new 0.19) lr 1.00e-05 gnorm 0.127 3.25s mem 81.1GB +[2026-09-12 09:17:44] step 3956/5000 loss 0.2555 (w 0.2473 mse 0.2621 t 891 new 0.22) lr 1.00e-05 gnorm 0.092 3.02s mem 81.1GB +[2026-09-12 09:17:47] step 3957/5000 loss 0.1045 (w 0.2423 mse 0.2449 t 926 new 0.24) lr 1.00e-05 gnorm 0.115 3.14s mem 81.1GB +[2026-09-12 09:17:50] step 3958/5000 loss 0.3648 (w 0.3476 mse 0.3505 t 980 new 0.19) lr 1.00e-05 gnorm 0.129 3.27s mem 81.1GB +[2026-09-12 09:17:53] step 3959/5000 loss 0.3196 (w 0.3013 mse 0.3025 t 628 new 0.20) lr 1.00e-05 gnorm 0.172 3.07s mem 81.1GB +[2026-09-12 09:17:56] step 3960/5000 loss 0.2222 (w 0.2904 mse 0.3122 t 926 new 0.19) lr 1.00e-05 gnorm 0.119 2.85s mem 81.1GB +[2026-09-12 09:17:59] step 3961/5000 loss 0.4188 (w 0.2459 mse 0.2574 t 780 new 0.18) lr 1.00e-05 gnorm 0.102 3.29s mem 81.1GB +[2026-09-12 09:18:02] step 3962/5000 loss 0.2713 (w 0.1845 mse 0.2132 t 802 new 0.24) lr 1.00e-05 gnorm 0.118 3.03s mem 81.1GB +[2026-09-12 09:18:05] step 3963/5000 loss 0.2855 (w 0.4564 mse 0.4737 t 987 new 0.20) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +[2026-09-12 09:18:09] step 3964/5000 loss 0.1396 (w 0.3362 mse 0.3408 t 980 new 0.18) lr 1.00e-05 gnorm 0.190 3.26s mem 81.1GB +[2026-09-12 09:18:12] step 3965/5000 loss 0.3511 (w 0.3049 mse 0.3094 t 897 new 0.21) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-12 09:18:15] step 3966/5000 loss 0.2175 (w 0.1844 mse 0.1977 t 894 new 0.12) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +[2026-09-12 09:18:18] step 3967/5000 loss 0.3423 (w 0.4092 mse 0.4295 t 992 new 0.20) lr 1.00e-05 gnorm 0.302 3.05s mem 81.1GB +[2026-09-12 09:18:21] step 3968/5000 loss 0.2649 (w 0.3668 mse 0.3717 t 987 new 0.17) lr 1.00e-05 gnorm 0.115 3.04s mem 81.1GB +[2026-09-12 09:18:24] step 3969/5000 loss 0.2601 (w 0.3161 mse 0.3228 t 957 new 0.17) lr 1.00e-05 gnorm 0.128 3.14s mem 81.1GB +[2026-09-12 09:18:27] step 3970/5000 loss 0.3457 (w 0.1924 mse 0.2140 t 679 new 0.27) lr 1.00e-05 gnorm 0.190 3.46s mem 81.1GB +[2026-09-12 09:18:30] step 3971/5000 loss 0.2174 (w 0.2795 mse 0.2860 t 631 new 0.22) lr 1.00e-05 gnorm 0.249 3.08s mem 81.1GB +[2026-09-12 09:18:33] step 3972/5000 loss 0.3873 (w 0.4324 mse 0.4278 t 459 new 0.22) lr 1.00e-05 gnorm 0.131 2.85s mem 81.1GB +[2026-09-12 09:18:36] step 3973/5000 loss 0.1389 (w 0.3255 mse 0.3263 t 971 new 0.20) lr 1.00e-05 gnorm 0.190 3.09s mem 81.1GB +[2026-09-12 09:18:40] step 3974/5000 loss 0.3004 (w 0.2249 mse 0.2351 t 898 new 0.23) lr 1.00e-05 gnorm 0.205 3.20s mem 81.1GB +[2026-09-12 09:18:42] step 3975/5000 loss 0.1922 (w 0.2318 mse 0.2367 t 849 new 0.15) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +[2026-09-12 09:18:46] step 3976/5000 loss 0.2879 (w 0.3384 mse 0.3355 t 981 new 0.27) lr 1.00e-05 gnorm 0.131 3.38s mem 81.1GB +[2026-09-12 09:18:49] step 3977/5000 loss 0.1870 (w 0.2843 mse 0.2799 t 924 new 0.11) lr 1.00e-05 gnorm 0.093 2.83s mem 81.1GB +[2026-09-12 09:18:52] step 3978/5000 loss 0.3521 (w 0.5747 mse 0.5809 t 171 new 0.24) lr 1.00e-05 gnorm 0.129 3.13s mem 81.1GB +[2026-09-12 09:18:55] step 3979/5000 loss 0.4056 (w 0.3355 mse 0.3329 t 815 new 0.20) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-12 09:18:58] step 3980/5000 loss 0.2425 (w 0.3600 mse 0.3647 t 940 new 0.26) lr 1.00e-05 gnorm 0.125 3.05s mem 81.1GB +[2026-09-12 09:19:00] step 3981/5000 loss 0.2526 (w 0.3938 mse 0.4041 t 969 new 0.27) lr 1.00e-05 gnorm 0.097 2.83s mem 81.1GB +[2026-09-12 09:19:04] step 3982/5000 loss 0.2609 (w 0.2588 mse 0.2714 t 887 new 0.21) lr 1.00e-05 gnorm 0.127 3.44s mem 81.1GB +[2026-09-12 09:19:07] step 3983/5000 loss 0.2740 (w 0.1921 mse 0.2018 t 920 new 0.22) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +[2026-09-12 09:19:10] step 3984/5000 loss 0.2082 (w 0.3142 mse 0.3246 t 644 new 0.24) lr 1.00e-05 gnorm 0.124 3.18s mem 81.1GB +[2026-09-12 09:19:13] step 3985/5000 loss 0.2428 (w 0.4605 mse 0.4681 t 288 new 0.24) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +[2026-09-12 09:19:16] step 3986/5000 loss 0.2357 (w 0.2918 mse 0.2912 t 907 new 0.28) lr 1.00e-05 gnorm 0.125 3.11s mem 81.1GB +[2026-09-12 09:19:19] step 3987/5000 loss 0.3390 (w 0.9287 mse 0.9247 t 993 new 0.21) lr 1.00e-05 gnorm 0.147 3.18s mem 81.1GB +[2026-09-12 09:19:22] step 3988/5000 loss 0.3150 (w 0.2029 mse 0.2129 t 826 new 0.23) lr 1.00e-05 gnorm 0.304 3.36s mem 81.1GB +[2026-09-12 09:19:25] step 3989/5000 loss 0.3032 (w 0.2327 mse 0.2392 t 951 new 0.25) lr 1.00e-05 gnorm 0.106 2.85s mem 81.1GB +[2026-09-12 09:19:29] step 3990/5000 loss 0.1863 (w 0.3411 mse 0.3392 t 965 new 0.23) lr 1.00e-05 gnorm 0.104 3.11s mem 81.1GB +[2026-09-12 09:19:32] step 3991/5000 loss 0.4299 (w 0.3031 mse 0.3172 t 957 new 0.16) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +[2026-09-12 09:19:35] step 3992/5000 loss 0.2557 (w 0.2996 mse 0.3005 t 983 new 0.10) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +[2026-09-12 09:19:38] step 3993/5000 loss 0.2381 (w 0.3041 mse 0.3202 t 549 new 0.23) lr 1.00e-05 gnorm 0.122 3.22s mem 81.1GB +[2026-09-12 09:19:41] step 3994/5000 loss 0.3781 (w 0.3429 mse 0.3415 t 909 new 0.21) lr 1.00e-05 gnorm 0.109 3.11s mem 81.1GB +[2026-09-12 09:19:44] step 3995/5000 loss 0.3316 (w 0.2829 mse 0.2854 t 920 new 0.22) lr 1.00e-05 gnorm 0.236 2.84s mem 81.1GB +[2026-09-12 09:19:47] step 3996/5000 loss 0.2182 (w 0.2651 mse 0.2668 t 814 new 0.23) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +[2026-09-12 09:19:50] step 3997/5000 loss 0.2909 (w 0.2396 mse 0.2448 t 984 new 0.16) lr 1.00e-05 gnorm 0.209 2.84s mem 81.1GB +[2026-09-12 09:19:53] step 3998/5000 loss 0.1415 (w 0.2358 mse 0.2422 t 937 new 0.13) lr 1.00e-05 gnorm 0.124 3.34s mem 81.1GB +[2026-09-12 09:19:57] step 3999/5000 loss 0.2525 (w 0.4442 mse 0.4578 t 983 new 0.13) lr 1.00e-05 gnorm 0.099 3.40s mem 81.1GB +[2026-09-12 09:20:00] step 4000/5000 loss 0.1272 (w 0.2424 mse 0.2605 t 1000 new 0.17) lr 1.00e-05 gnorm 0.100 3.14s mem 81.1GB +[2026-09-12 09:20:02] [val] step 4000 t=200: w=0.4554 mse=0.4735 (n=16) t=500: w=0.2766 mse=0.2914 (n=16) t=800: w=0.2325 mse=0.2443 (n=16) | mean w=0.3215 mse=0.3364 2s +[2026-09-12 09:20:51] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step4000.safetensors 4093 个张量 37.98 GB +[2026-09-12 09:20:56] step 4001/5000 loss 0.3486 (w 0.1517 mse 0.1673 t 881 new 0.14) lr 1.00e-05 gnorm 0.205 2.84s mem 81.1GB +[2026-09-12 09:20:59] step 4002/5000 loss 0.1950 (w 0.2870 mse 0.2884 t 939 new 0.22) lr 1.00e-05 gnorm 0.105 3.10s mem 81.1GB +[2026-09-12 09:21:02] step 4003/5000 loss 0.2585 (w 0.3261 mse 0.3349 t 940 new 0.11) lr 1.00e-05 gnorm 0.112 2.82s mem 81.1GB +[2026-09-12 09:21:05] step 4004/5000 loss 0.2969 (w 0.2436 mse 0.2633 t 394 new 0.20) lr 1.00e-05 gnorm 0.114 3.33s mem 81.1GB +[2026-09-12 09:21:09] step 4005/5000 loss 0.3181 (w 0.3016 mse 0.3017 t 934 new 0.23) lr 1.00e-05 gnorm 0.127 3.47s mem 81.1GB +[2026-09-12 09:21:11] step 4006/5000 loss 0.2210 (w 0.3437 mse 0.3420 t 698 new 0.13) lr 1.00e-05 gnorm 0.101 2.83s mem 81.1GB +[2026-09-12 09:21:14] step 4007/5000 loss 0.5101 (w 0.2708 mse 0.2669 t 634 new 0.20) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +[2026-09-12 09:21:17] step 4008/5000 loss 0.4271 (w 0.2864 mse 0.3002 t 586 new 0.18) lr 1.00e-05 gnorm 0.163 3.13s mem 81.1GB +[2026-09-12 09:21:21] step 4009/5000 loss 0.1677 (w 0.3143 mse 0.3342 t 978 new 0.17) lr 1.00e-05 gnorm 0.097 3.04s mem 81.1GB +[2026-09-12 09:21:24] step 4010/5000 loss 0.1746 (w 0.3258 mse 0.3424 t 955 new 0.19) lr 1.00e-05 gnorm 0.166 3.44s mem 81.1GB +[2026-09-12 09:21:27] step 4011/5000 loss 0.3263 (w 0.1675 mse 0.1791 t 819 new 0.13) lr 1.00e-05 gnorm 0.233 3.34s mem 81.1GB +[2026-09-12 09:21:30] step 4012/5000 loss 0.2477 (w 0.1826 mse 0.1950 t 689 new 0.18) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +[2026-09-12 09:21:33] step 4013/5000 loss 0.3861 (w 0.2649 mse 0.2730 t 641 new 0.20) lr 1.00e-05 gnorm 0.110 3.24s mem 81.1GB +[2026-09-12 09:21:36] step 4014/5000 loss 0.2287 (w 0.3206 mse 0.3275 t 889 new 0.22) lr 1.00e-05 gnorm 0.094 3.03s mem 81.1GB +[2026-09-12 09:21:39] step 4015/5000 loss 0.4593 (w 0.3742 mse 0.3787 t 375 new 0.12) lr 1.00e-05 gnorm 0.127 3.08s mem 81.1GB +[2026-09-12 09:21:43] step 4016/5000 loss 0.2164 (w 0.3537 mse 0.3546 t 964 new 0.20) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-12 09:21:46] step 4017/5000 loss 0.3734 (w 0.2876 mse 0.2898 t 942 new 0.23) lr 1.00e-05 gnorm 0.145 3.43s mem 81.1GB +[2026-09-12 09:21:49] step 4018/5000 loss 0.3498 (w 1.7048 mse 1.7592 t 996 new 0.27) lr 1.00e-05 gnorm 0.111 2.85s mem 81.1GB +[2026-09-12 09:21:52] step 4019/5000 loss 0.1647 (w 0.2879 mse 0.2896 t 950 new 0.20) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +[2026-09-12 09:21:55] step 4020/5000 loss 0.2740 (w 0.3467 mse 0.3511 t 894 new 0.21) lr 1.00e-05 gnorm 0.137 3.05s mem 81.1GB +[2026-09-12 09:21:58] step 4021/5000 loss 0.2454 (w 0.2023 mse 0.2143 t 873 new 0.24) lr 1.00e-05 gnorm 0.158 3.30s mem 81.1GB +[2026-09-12 09:22:01] step 4022/5000 loss 0.1530 (w 0.2007 mse 0.2301 t 962 new 0.27) lr 1.00e-05 gnorm 0.137 3.09s mem 81.1GB +[2026-09-12 09:22:05] step 4023/5000 loss 0.4235 (w 0.2270 mse 0.2357 t 603 new 0.19) lr 1.00e-05 gnorm 0.131 3.45s mem 81.1GB +[2026-09-12 09:22:08] step 4024/5000 loss 0.3845 (w 0.2483 mse 0.2608 t 500 new 0.08) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +[2026-09-12 09:22:11] step 4025/5000 loss 0.3057 (w 0.1908 mse 0.1944 t 883 new 0.16) lr 1.00e-05 gnorm 0.249 3.15s mem 81.1GB +[2026-09-12 09:22:14] step 4026/5000 loss 0.3301 (w 0.4442 mse 0.4491 t 995 new 0.19) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +[2026-09-12 09:22:17] step 4027/5000 loss 0.1744 (w 0.3833 mse 0.3665 t 961 new 0.24) lr 1.00e-05 gnorm 0.112 3.31s mem 81.1GB +[2026-09-12 09:22:20] step 4028/5000 loss 0.2271 (w 0.1780 mse 0.2069 t 633 new 0.17) lr 1.00e-05 gnorm 0.131 3.13s mem 81.1GB +[2026-09-12 09:22:24] step 4029/5000 loss 0.2892 (w 0.3108 mse 0.3098 t 718 new 0.14) lr 1.00e-05 gnorm 0.094 3.18s mem 81.1GB +[2026-09-12 09:22:26] step 4030/5000 loss 0.1847 (w 0.3261 mse 0.3353 t 980 new 0.19) lr 1.00e-05 gnorm 0.097 2.83s mem 81.1GB +[2026-09-12 09:22:29] step 4031/5000 loss 0.4559 (w 0.3985 mse 0.4147 t 356 new 0.18) lr 1.00e-05 gnorm 0.119 3.12s mem 81.1GB +[2026-09-12 09:22:33] step 4032/5000 loss 0.2695 (w 0.3328 mse 0.3301 t 958 new 0.22) lr 1.00e-05 gnorm 0.116 3.12s mem 81.1GB +[2026-09-12 09:22:36] step 4033/5000 loss 0.2316 (w 0.3570 mse 0.3560 t 941 new 0.17) lr 1.00e-05 gnorm 0.100 3.08s mem 81.1GB +[2026-09-12 09:22:39] step 4034/5000 loss 0.2033 (w 0.1867 mse 0.1867 t 742 new 0.00) lr 1.00e-05 gnorm 0.136 3.05s mem 81.1GB +[2026-09-12 09:22:42] step 4035/5000 loss 0.4510 (w 0.3100 mse 0.3128 t 659 new 0.20) lr 1.00e-05 gnorm 0.169 3.18s mem 81.1GB +[2026-09-12 09:22:45] step 4036/5000 loss 0.2005 (w 0.3242 mse 0.3379 t 974 new 0.17) lr 1.00e-05 gnorm 0.098 2.84s mem 81.1GB +[2026-09-12 09:22:48] step 4037/5000 loss 0.2425 (w 0.4058 mse 0.4072 t 954 new 0.26) lr 1.00e-05 gnorm 0.160 3.27s mem 81.1GB +[2026-09-12 09:22:51] step 4038/5000 loss 0.3052 (w 0.2470 mse 0.2523 t 930 new 0.17) lr 1.00e-05 gnorm 0.152 3.12s mem 81.1GB +[2026-09-12 09:22:54] step 4039/5000 loss 0.3884 (w 0.1660 mse 0.1705 t 424 new 0.16) lr 1.00e-05 gnorm 0.168 3.33s mem 81.1GB +[2026-09-12 09:22:58] step 4040/5000 loss 0.3277 (w 0.3306 mse 0.3266 t 844 new 0.22) lr 1.00e-05 gnorm 0.111 3.09s mem 81.1GB +[2026-09-12 09:23:01] step 4041/5000 loss 0.2170 (w 0.2091 mse 0.2219 t 977 new 0.22) lr 1.00e-05 gnorm 0.136 3.17s mem 81.1GB +[2026-09-12 09:23:04] step 4042/5000 loss 0.2283 (w 0.3104 mse 0.3226 t 979 new 0.21) lr 1.00e-05 gnorm 0.102 3.16s mem 81.1GB +[2026-09-12 09:23:07] step 4043/5000 loss 0.4468 (w 0.5125 mse 0.5232 t 259 new 0.15) lr 1.00e-05 gnorm 0.134 3.02s mem 81.1GB +[2026-09-12 09:23:10] step 4044/5000 loss 0.3063 (w 0.2473 mse 0.2688 t 424 new 0.27) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +[2026-09-12 09:23:13] step 4045/5000 loss 0.4046 (w 0.5576 mse 0.5678 t 212 new 0.22) lr 1.00e-05 gnorm 0.111 3.30s mem 81.1GB +[2026-09-12 09:23:17] step 4046/5000 loss 0.3438 (w 0.2029 mse 0.2049 t 768 new 0.10) lr 1.00e-05 gnorm 0.111 3.31s mem 81.1GB +[2026-09-12 09:23:20] step 4047/5000 loss 0.3866 (w 0.3118 mse 0.3202 t 609 new 0.19) lr 1.00e-05 gnorm 0.141 3.18s mem 81.1GB +[2026-09-12 09:23:23] step 4048/5000 loss 0.2014 (w 0.2336 mse 0.2387 t 979 new 0.15) lr 1.00e-05 gnorm 0.375 3.07s mem 81.1GB +[2026-09-12 09:23:26] step 4049/5000 loss 0.3718 (w 0.1837 mse 0.1982 t 821 new 0.22) lr 1.00e-05 gnorm 0.135 3.03s mem 81.1GB +[2026-09-12 09:23:29] step 4050/5000 loss 0.1353 (w 0.2313 mse 0.2512 t 867 new 0.20) lr 1.00e-05 gnorm 0.208 3.05s mem 81.1GB +[2026-09-12 09:23:32] step 4051/5000 loss 0.1648 (w 0.2935 mse 0.2837 t 965 new 0.21) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +[2026-09-12 09:23:35] step 4052/5000 loss 0.2737 (w 0.1956 mse 0.2106 t 962 new 0.15) lr 1.00e-05 gnorm 0.140 3.28s mem 81.1GB +[2026-09-12 09:23:38] step 4053/5000 loss 0.2615 (w 0.4252 mse 0.4195 t 977 new 0.16) lr 1.00e-05 gnorm 0.107 3.15s mem 81.1GB +[2026-09-12 09:23:42] step 4054/5000 loss 0.2672 (w 0.1823 mse 0.1961 t 969 new 0.09) lr 1.00e-05 gnorm 0.111 3.10s mem 81.1GB +[2026-09-12 09:23:44] step 4055/5000 loss 0.2999 (w 0.4911 mse 0.5263 t 1000 new 0.19) lr 1.00e-05 gnorm 0.084 2.84s mem 81.1GB +[2026-09-12 09:23:48] step 4056/5000 loss 0.2499 (w 0.1798 mse 0.2009 t 970 new 0.13) lr 1.00e-05 gnorm 0.103 3.10s mem 81.1GB +[2026-09-12 09:23:51] step 4057/5000 loss 0.3176 (w 0.2843 mse 0.2976 t 974 new 0.26) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +[2026-09-12 09:23:54] step 4058/5000 loss 0.3166 (w 0.2357 mse 0.2573 t 956 new 0.22) lr 1.00e-05 gnorm 0.116 3.34s mem 81.1GB +[2026-09-12 09:23:57] step 4059/5000 loss 0.1475 (w 0.3093 mse 0.3131 t 835 new 0.23) lr 1.00e-05 gnorm 0.119 3.17s mem 81.1GB +[2026-09-12 09:24:00] step 4060/5000 loss 0.1714 (w 0.2622 mse 0.2699 t 598 new 0.17) lr 1.00e-05 gnorm 0.097 3.18s mem 81.1GB +[2026-09-12 09:24:03] step 4061/5000 loss 0.2700 (w 0.2640 mse 0.2560 t 993 new 0.13) lr 1.00e-05 gnorm 0.128 2.85s mem 81.1GB +[2026-09-12 09:24:06] step 4062/5000 loss 0.3571 (w 0.2438 mse 0.2500 t 578 new 0.18) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +[2026-09-12 09:24:10] step 4063/5000 loss 0.1883 (w 0.2421 mse 0.2471 t 948 new 0.20) lr 1.00e-05 gnorm 0.107 3.41s mem 81.1GB +[2026-09-12 09:24:13] step 4064/5000 loss 0.3795 (w 0.3398 mse 0.3529 t 375 new 0.24) lr 1.00e-05 gnorm 0.243 3.08s mem 81.1GB +[2026-09-12 09:24:16] step 4065/5000 loss 0.4038 (w 0.2846 mse 0.2920 t 847 new 0.23) lr 1.00e-05 gnorm 0.101 3.22s mem 81.1GB +[2026-09-12 09:24:20] step 4066/5000 loss 0.5043 (w 0.1668 mse 0.1760 t 639 new 0.10) lr 1.00e-05 gnorm 0.123 3.38s mem 81.1GB +[2026-09-12 09:24:22] step 4067/5000 loss 0.3264 (w 0.2399 mse 0.2541 t 971 new 0.22) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +[2026-09-12 09:24:26] step 4068/5000 loss 0.3534 (w 0.1366 mse 0.1544 t 709 new 0.22) lr 1.00e-05 gnorm 0.132 3.24s mem 81.1GB +[2026-09-12 09:24:29] step 4069/5000 loss 0.2649 (w 0.3177 mse 0.3179 t 810 new 0.24) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-12 09:24:32] step 4070/5000 loss 0.3168 (w 0.2461 mse 0.2527 t 965 new 0.25) lr 1.00e-05 gnorm 0.150 3.49s mem 81.1GB +[2026-09-12 09:24:35] step 4071/5000 loss 0.2561 (w 0.2743 mse 0.2944 t 958 new 0.20) lr 1.00e-05 gnorm 0.103 2.85s mem 81.1GB +[2026-09-12 09:24:38] step 4072/5000 loss 0.2085 (w 0.2721 mse 0.2734 t 889 new 0.22) lr 1.00e-05 gnorm 0.155 3.39s mem 81.1GB +[2026-09-12 09:24:41] step 4073/5000 loss 0.2052 (w 0.1756 mse 0.1903 t 768 new 0.23) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-12 09:24:45] step 4074/5000 loss 0.1396 (w 0.2041 mse 0.2126 t 871 new 0.18) lr 1.00e-05 gnorm 0.143 3.45s mem 81.1GB +[2026-09-12 09:24:48] step 4075/5000 loss 0.1738 (w 0.2561 mse 0.2747 t 931 new 0.24) lr 1.00e-05 gnorm 0.204 3.13s mem 81.1GB +[2026-09-12 09:24:51] step 4076/5000 loss 0.2694 (w 0.3546 mse 0.3398 t 987 new 0.18) lr 1.00e-05 gnorm 0.121 3.16s mem 81.1GB +[2026-09-12 09:24:54] step 4077/5000 loss 0.3306 (w 0.3051 mse 0.3188 t 688 new 0.24) lr 1.00e-05 gnorm 0.117 3.04s mem 81.1GB +[2026-09-12 09:24:57] step 4078/5000 loss 0.3521 (w 0.3971 mse 0.3928 t 444 new 0.22) lr 1.00e-05 gnorm 0.232 3.04s mem 81.1GB +[2026-09-12 09:25:00] step 4079/5000 loss 0.2817 (w 0.2316 mse 0.2443 t 839 new 0.27) lr 1.00e-05 gnorm 0.104 3.02s mem 81.1GB +[2026-09-12 09:25:03] step 4080/5000 loss 0.3713 (w 0.3723 mse 0.3794 t 981 new 0.19) lr 1.00e-05 gnorm 0.186 3.17s mem 81.1GB +[2026-09-12 09:25:06] step 4081/5000 loss 0.2703 (w 0.2545 mse 0.2670 t 805 new 0.19) lr 1.00e-05 gnorm 0.109 3.07s mem 81.1GB +[2026-09-12 09:25:10] step 4082/5000 loss 0.2926 (w 0.2052 mse 0.2222 t 631 new 0.27) lr 1.00e-05 gnorm 0.120 3.15s mem 81.1GB +[2026-09-12 09:25:13] step 4083/5000 loss 0.2908 (w 0.5758 mse 0.6072 t 127 new 0.18) lr 1.00e-05 gnorm 0.102 3.09s mem 81.1GB +[2026-09-12 09:25:16] step 4084/5000 loss 0.2835 (w 0.1917 mse 0.2082 t 869 new 0.26) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +[2026-09-12 09:25:19] step 4085/5000 loss 0.3854 (w 0.3696 mse 0.3670 t 979 new 0.19) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +[2026-09-12 09:25:22] step 4086/5000 loss 0.2887 (w 0.4357 mse 0.4272 t 990 new 0.13) lr 1.00e-05 gnorm 0.141 3.33s mem 81.1GB +[2026-09-12 09:25:25] step 4087/5000 loss 0.1999 (w 0.1926 mse 0.2077 t 924 new 0.12) lr 1.00e-05 gnorm 0.127 3.09s mem 81.1GB +[2026-09-12 09:25:28] step 4088/5000 loss 0.3507 (w 0.2977 mse 0.3118 t 401 new 0.11) lr 1.00e-05 gnorm 0.140 3.11s mem 81.1GB +[2026-09-12 09:25:31] step 4089/5000 loss 0.2884 (w 0.3073 mse 0.3049 t 623 new 0.23) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +[2026-09-12 09:25:35] step 4090/5000 loss 0.4102 (w 0.2980 mse 0.3135 t 693 new 0.17) lr 1.00e-05 gnorm 0.141 3.10s mem 81.1GB +[2026-09-12 09:25:38] step 4091/5000 loss 0.2008 (w 0.3636 mse 0.3766 t 980 new 0.16) lr 1.00e-05 gnorm 0.120 3.06s mem 81.1GB +[2026-09-12 09:25:41] step 4092/5000 loss 0.2575 (w 0.2913 mse 0.3036 t 924 new 0.22) lr 1.00e-05 gnorm 0.115 3.30s mem 81.1GB +[2026-09-12 09:25:44] step 4093/5000 loss 0.2942 (w 0.1922 mse 0.2210 t 940 new 0.23) lr 1.00e-05 gnorm 0.213 3.35s mem 81.1GB +[2026-09-12 09:25:47] step 4094/5000 loss 0.0727 (w 0.3043 mse 0.3198 t 962 new 0.27) lr 1.00e-05 gnorm 0.077 3.12s mem 81.1GB +[2026-09-12 09:25:50] step 4095/5000 loss 0.3202 (w 0.3648 mse 0.3796 t 978 new 0.19) lr 1.00e-05 gnorm 0.110 3.06s mem 81.1GB +[2026-09-12 09:25:54] step 4096/5000 loss 0.3954 (w 0.3843 mse 0.3850 t 965 new 0.24) lr 1.00e-05 gnorm 0.172 3.04s mem 81.1GB +[2026-09-12 09:25:57] step 4097/5000 loss 0.4017 (w 0.5118 mse 0.4925 t 992 new 0.24) lr 1.00e-05 gnorm 0.135 3.10s mem 81.1GB +[2026-09-12 09:26:00] step 4098/5000 loss 0.4468 (w 0.2142 mse 0.2198 t 861 new 0.14) lr 1.00e-05 gnorm 0.121 3.38s mem 81.1GB +[2026-09-12 09:26:03] step 4099/5000 loss 0.3458 (w 0.2509 mse 0.2626 t 980 new 0.21) lr 1.00e-05 gnorm 0.147 3.09s mem 81.1GB +[2026-09-12 09:26:06] step 4100/5000 loss 0.3337 (w 0.2022 mse 0.2147 t 783 new 0.22) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +[2026-09-12 09:26:09] step 4101/5000 loss 0.1708 (w 0.3036 mse 0.3015 t 905 new 0.21) lr 1.00e-05 gnorm 0.115 3.06s mem 81.1GB +[2026-09-12 09:26:12] step 4102/5000 loss 0.4314 (w 0.3699 mse 0.3577 t 992 new 0.23) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +[2026-09-12 09:26:16] step 4103/5000 loss 0.4171 (w 0.2835 mse 0.2939 t 986 new 0.27) lr 1.00e-05 gnorm 0.134 3.27s mem 81.1GB +[2026-09-12 09:26:19] step 4104/5000 loss 0.4231 (w 0.3055 mse 0.3069 t 894 new 0.23) lr 1.00e-05 gnorm 0.095 3.11s mem 81.1GB +[2026-09-12 09:26:22] step 4105/5000 loss 0.4334 (w 0.2395 mse 0.2590 t 394 new 0.10) lr 1.00e-05 gnorm 0.219 3.14s mem 81.1GB +[2026-09-12 09:26:25] step 4106/5000 loss 0.2065 (w 0.4150 mse 0.4168 t 994 new 0.19) lr 1.00e-05 gnorm 0.102 3.12s mem 81.1GB +[2026-09-12 09:26:28] step 4107/5000 loss 0.2923 (w 0.1759 mse 0.1874 t 742 new 0.22) lr 1.00e-05 gnorm 0.096 3.04s mem 81.1GB +[2026-09-12 09:26:31] step 4108/5000 loss 0.2778 (w 0.2939 mse 0.2964 t 928 new 0.21) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +[2026-09-12 09:26:34] step 4109/5000 loss 0.2804 (w 0.2426 mse 0.2533 t 893 new 0.23) lr 1.00e-05 gnorm 0.128 3.33s mem 81.1GB +[2026-09-12 09:26:37] step 4110/5000 loss 0.3091 (w 0.2531 mse 0.2565 t 797 new 0.19) lr 1.00e-05 gnorm 0.130 3.05s mem 81.1GB +[2026-09-12 09:26:41] step 4111/5000 loss 0.1878 (w 0.3060 mse 0.3131 t 700 new 0.24) lr 1.00e-05 gnorm 0.115 3.37s mem 81.1GB +[2026-09-12 09:26:44] step 4112/5000 loss 0.3604 (w 0.2793 mse 0.2837 t 708 new 0.19) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +[2026-09-12 09:26:47] step 4113/5000 loss 0.1905 (w 0.2273 mse 0.2404 t 824 new 0.20) lr 1.00e-05 gnorm 0.146 3.31s mem 81.1GB +[2026-09-12 09:26:50] step 4114/5000 loss 0.3053 (w 0.2475 mse 0.2716 t 973 new 0.19) lr 1.00e-05 gnorm 0.114 3.08s mem 81.1GB +[2026-09-12 09:26:53] step 4115/5000 loss 0.2212 (w 0.2030 mse 0.2088 t 922 new 0.19) lr 1.00e-05 gnorm 0.110 3.06s mem 81.1GB +[2026-09-12 09:26:56] step 4116/5000 loss 0.2595 (w 0.2576 mse 0.2751 t 790 new 0.22) lr 1.00e-05 gnorm 0.151 3.06s mem 81.1GB +[2026-09-12 09:27:00] step 4117/5000 loss 0.3662 (w 0.2512 mse 0.2525 t 871 new 0.18) lr 1.00e-05 gnorm 0.174 3.44s mem 81.1GB +[2026-09-12 09:27:02] step 4118/5000 loss 0.3097 (w 0.2357 mse 0.2474 t 760 new 0.27) lr 1.00e-05 gnorm 0.209 2.82s mem 81.1GB +[2026-09-12 09:27:06] step 4119/5000 loss 0.2187 (w 0.2164 mse 0.2344 t 762 new 0.26) lr 1.00e-05 gnorm 0.133 3.35s mem 81.1GB +[2026-09-12 09:27:09] step 4120/5000 loss 0.3281 (w 0.2279 mse 0.2359 t 865 new 0.07) lr 1.00e-05 gnorm 0.122 3.39s mem 81.1GB +[2026-09-12 09:27:12] step 4121/5000 loss 0.1173 (w 0.3378 mse 0.3677 t 983 new 0.17) lr 1.00e-05 gnorm 0.155 3.13s mem 81.1GB +[2026-09-12 09:27:16] step 4122/5000 loss 0.2475 (w 0.2837 mse 0.2781 t 720 new 0.22) lr 1.00e-05 gnorm 0.237 3.45s mem 81.1GB +[2026-09-12 09:27:19] step 4123/5000 loss 0.4415 (w 0.3414 mse 0.3443 t 459 new 0.20) lr 1.00e-05 gnorm 0.127 3.23s mem 81.1GB +[2026-09-12 09:27:22] step 4124/5000 loss 0.2866 (w 0.1641 mse 0.1728 t 790 new 0.21) lr 1.00e-05 gnorm 0.111 2.84s mem 81.1GB +[2026-09-12 09:27:25] step 4125/5000 loss 0.2196 (w 0.3359 mse 0.3526 t 998 new 0.20) lr 1.00e-05 gnorm 0.112 3.16s mem 81.1GB +[2026-09-12 09:27:28] step 4126/5000 loss 0.2230 (w 0.1603 mse 0.1723 t 891 new 0.22) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +[2026-09-12 09:27:31] step 4127/5000 loss 0.1215 (w 0.1796 mse 0.1973 t 995 new 0.11) lr 1.00e-05 gnorm 0.089 3.05s mem 81.1GB +[2026-09-12 09:27:35] step 4128/5000 loss 0.4707 (w 0.3230 mse 0.3127 t 963 new 0.24) lr 1.00e-05 gnorm 0.160 3.32s mem 81.1GB +[2026-09-12 09:27:38] step 4129/5000 loss 0.3969 (w 0.3555 mse 0.3573 t 872 new 0.27) lr 1.00e-05 gnorm 0.165 3.16s mem 81.1GB +[2026-09-12 09:27:41] step 4130/5000 loss 0.3563 (w 0.3967 mse 0.4529 t 159 new 0.19) lr 1.00e-05 gnorm 0.213 2.84s mem 81.1GB +[2026-09-12 09:27:44] step 4131/5000 loss 0.2276 (w 0.3462 mse 0.3507 t 991 new 0.17) lr 1.00e-05 gnorm 0.118 3.28s mem 81.1GB +[2026-09-12 09:27:47] step 4132/5000 loss 0.5046 (w 0.3014 mse 0.3044 t 528 new 0.14) lr 1.00e-05 gnorm 0.130 3.09s mem 81.1GB +[2026-09-12 09:27:50] step 4133/5000 loss 0.2605 (w 0.4122 mse 0.4111 t 973 new 0.20) lr 1.00e-05 gnorm 0.439 3.07s mem 81.1GB +[2026-09-12 09:27:53] step 4134/5000 loss 0.2818 (w 0.2412 mse 0.2490 t 951 new 0.18) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +[2026-09-12 09:27:57] step 4135/5000 loss 0.1541 (w 0.4680 mse 0.4802 t 983 new 0.13) lr 1.00e-05 gnorm 0.120 3.18s mem 81.1GB +[2026-09-12 09:27:59] step 4136/5000 loss 0.2125 (w 0.2573 mse 0.2652 t 840 new 0.26) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +[2026-09-12 09:28:03] step 4137/5000 loss 0.2771 (w 0.4003 mse 0.4195 t 966 new 0.21) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +[2026-09-12 09:28:06] step 4138/5000 loss 0.1860 (w 0.3633 mse 0.3560 t 975 new 0.28) lr 1.00e-05 gnorm 0.151 3.10s mem 81.1GB +[2026-09-12 09:28:09] step 4139/5000 loss 0.4036 (w 0.3501 mse 0.3475 t 642 new 0.24) lr 1.00e-05 gnorm 0.119 3.11s mem 81.1GB +[2026-09-12 09:28:12] step 4140/5000 loss 0.2915 (w 0.2331 mse 0.2367 t 672 new 0.21) lr 1.00e-05 gnorm 0.150 3.32s mem 81.1GB +[2026-09-12 09:28:15] step 4141/5000 loss 0.3514 (w 0.2327 mse 0.2454 t 914 new 0.20) lr 1.00e-05 gnorm 0.202 2.83s mem 81.1GB +[2026-09-12 09:28:18] step 4142/5000 loss 0.2848 (w 0.2849 mse 0.2952 t 495 new 0.13) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +[2026-09-12 09:28:21] step 4143/5000 loss 0.2212 (w 0.1552 mse 0.1718 t 935 new 0.13) lr 1.00e-05 gnorm 0.141 3.02s mem 81.1GB +[2026-09-12 09:28:24] step 4144/5000 loss 0.2908 (w 0.2078 mse 0.2271 t 807 new 0.25) lr 1.00e-05 gnorm 0.130 3.08s mem 81.1GB +[2026-09-12 09:28:28] step 4145/5000 loss 0.3115 (w 0.2714 mse 0.2795 t 688 new 0.25) lr 1.00e-05 gnorm 0.135 3.35s mem 81.1GB +[2026-09-12 09:28:31] step 4146/5000 loss 0.3503 (w 0.2523 mse 0.2518 t 871 new 0.19) lr 1.00e-05 gnorm 0.122 3.16s mem 81.1GB +[2026-09-12 09:28:34] step 4147/5000 loss 0.2049 (w 0.3246 mse 0.3314 t 490 new 0.25) lr 1.00e-05 gnorm 0.100 2.84s mem 81.1GB +[2026-09-12 09:28:37] step 4148/5000 loss 0.1889 (w 0.2574 mse 0.2846 t 788 new 0.21) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +[2026-09-12 09:28:40] step 4149/5000 loss 0.2841 (w 0.3141 mse 0.3156 t 800 new 0.22) lr 1.00e-05 gnorm 0.151 3.10s mem 81.1GB +[2026-09-12 09:28:43] step 4150/5000 loss 0.3024 (w 0.3109 mse 0.3276 t 865 new 0.17) lr 1.00e-05 gnorm 0.102 3.30s mem 81.1GB +[2026-09-12 09:28:46] step 4151/5000 loss 0.2731 (w 0.2663 mse 0.2697 t 645 new 0.22) lr 1.00e-05 gnorm 0.179 3.33s mem 81.1GB +[2026-09-12 09:28:50] step 4152/5000 loss 0.3055 (w 0.4989 mse 0.5089 t 999 new 0.17) lr 1.00e-05 gnorm 0.111 3.37s mem 81.1GB +[2026-09-12 09:28:53] step 4153/5000 loss 0.2451 (w 0.3534 mse 0.3473 t 984 new 0.20) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +[2026-09-12 09:28:56] step 4154/5000 loss 0.3446 (w 0.3082 mse 0.3174 t 937 new 0.22) lr 1.00e-05 gnorm 0.181 3.06s mem 81.1GB +[2026-09-12 09:28:59] step 4155/5000 loss 0.4187 (w 0.3686 mse 0.3723 t 306 new 0.17) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +[2026-09-12 09:29:02] step 4156/5000 loss 0.2380 (w 0.3348 mse 0.3279 t 984 new 0.23) lr 1.00e-05 gnorm 0.093 3.03s mem 81.1GB +[2026-09-12 09:29:05] step 4157/5000 loss 0.3208 (w 0.2846 mse 0.2984 t 946 new 0.18) lr 1.00e-05 gnorm 0.178 3.12s mem 81.1GB +[2026-09-12 09:29:08] step 4158/5000 loss 0.2307 (w 0.3687 mse 0.3483 t 948 new 0.18) lr 1.00e-05 gnorm 0.139 3.25s mem 81.1GB +[2026-09-12 09:29:11] step 4159/5000 loss 0.2590 (w 0.1334 mse 0.1560 t 840 new 0.18) lr 1.00e-05 gnorm 0.118 2.94s mem 81.1GB +[2026-09-12 09:29:14] step 4160/5000 loss 0.2837 (w 0.2694 mse 0.2718 t 729 new 0.20) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-12 09:29:17] step 4161/5000 loss 0.2435 (w 0.2931 mse 0.2883 t 972 new 0.20) lr 1.00e-05 gnorm 0.165 2.83s mem 81.1GB +[2026-09-12 09:29:20] step 4162/5000 loss 0.3562 (w 0.4199 mse 0.4161 t 988 new 0.21) lr 1.00e-05 gnorm 0.126 3.25s mem 81.1GB +[2026-09-12 09:29:23] step 4163/5000 loss 0.4054 (w 0.3135 mse 0.3230 t 966 new 0.20) lr 1.00e-05 gnorm 0.250 3.12s mem 81.1GB +[2026-09-12 09:29:27] step 4164/5000 loss 0.1969 (w 0.3594 mse 0.3700 t 977 new 0.05) lr 1.00e-05 gnorm 0.191 3.31s mem 81.1GB +[2026-09-12 09:29:29] step 4165/5000 loss 0.2540 (w 0.2824 mse 0.2890 t 508 new 0.07) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-12 09:29:33] step 4166/5000 loss 0.2787 (w 0.2496 mse 0.2495 t 599 new 0.20) lr 1.00e-05 gnorm 0.196 3.22s mem 81.1GB +[2026-09-12 09:29:36] step 4167/5000 loss 0.1915 (w 0.3557 mse 0.3690 t 935 new 0.18) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-12 09:29:39] step 4168/5000 loss 0.4905 (w 0.3539 mse 0.3547 t 555 new 0.22) lr 1.00e-05 gnorm 0.125 3.37s mem 81.1GB +[2026-09-12 09:29:42] step 4169/5000 loss 0.3192 (w 0.1383 mse 0.1544 t 837 new 0.14) lr 1.00e-05 gnorm 0.116 3.13s mem 81.1GB +[2026-09-12 09:29:46] step 4170/5000 loss 0.3492 (w 0.2298 mse 0.2363 t 947 new 0.17) lr 1.00e-05 gnorm 0.148 3.27s mem 81.1GB +[2026-09-12 09:29:48] step 4171/5000 loss 0.2375 (w 0.2372 mse 0.2374 t 506 new 0.00) lr 1.00e-05 gnorm 0.116 2.83s mem 81.1GB +[2026-09-12 09:29:52] step 4172/5000 loss 0.1541 (w 0.1788 mse 0.1999 t 774 new 0.17) lr 1.00e-05 gnorm 0.136 3.37s mem 81.1GB +[2026-09-12 09:29:55] step 4173/5000 loss 0.3558 (w 0.6873 mse 0.6909 t 159 new 0.21) lr 1.00e-05 gnorm 0.128 3.04s mem 81.1GB +[2026-09-12 09:29:58] step 4174/5000 loss 0.2239 (w 0.2831 mse 0.2816 t 927 new 0.16) lr 1.00e-05 gnorm 0.134 3.11s mem 81.1GB +[2026-09-12 09:30:01] step 4175/5000 loss 0.4048 (w 0.2433 mse 0.2477 t 802 new 0.22) lr 1.00e-05 gnorm 0.154 3.26s mem 81.1GB +[2026-09-12 09:30:04] step 4176/5000 loss 0.3618 (w 0.2305 mse 0.2503 t 737 new 0.21) lr 1.00e-05 gnorm 0.149 3.09s mem 81.1GB +[2026-09-12 09:30:07] step 4177/5000 loss 0.3640 (w 0.2787 mse 0.2850 t 386 new 0.24) lr 1.00e-05 gnorm 0.137 2.82s mem 81.1GB +[2026-09-12 09:30:10] step 4178/5000 loss 0.2542 (w 0.4184 mse 0.3996 t 1000 new 0.17) lr 1.00e-05 gnorm 0.113 3.09s mem 81.1GB +[2026-09-12 09:30:14] step 4179/5000 loss 0.2088 (w 0.2124 mse 0.2410 t 920 new 0.25) lr 1.00e-05 gnorm 0.122 3.37s mem 81.1GB +[2026-09-12 09:30:17] step 4180/5000 loss 0.2573 (w 0.2983 mse 0.3003 t 909 new 0.21) lr 1.00e-05 gnorm 0.099 3.12s mem 81.1GB +[2026-09-12 09:30:20] step 4181/5000 loss 0.2219 (w 0.2388 mse 0.2470 t 805 new 0.21) lr 1.00e-05 gnorm 0.203 3.33s mem 81.1GB +[2026-09-12 09:30:23] step 4182/5000 loss 0.2811 (w 0.3298 mse 0.3306 t 930 new 0.17) lr 1.00e-05 gnorm 0.114 3.15s mem 81.1GB +[2026-09-12 09:30:26] step 4183/5000 loss 0.2455 (w 0.2808 mse 0.2878 t 935 new 0.23) lr 1.00e-05 gnorm 0.116 3.01s mem 81.1GB +[2026-09-12 09:30:29] step 4184/5000 loss 0.1829 (w 0.3762 mse 0.3872 t 970 new 0.21) lr 1.00e-05 gnorm 0.108 3.13s mem 81.1GB +[2026-09-12 09:30:33] step 4185/5000 loss 0.2227 (w 0.3676 mse 0.3760 t 411 new 0.13) lr 1.00e-05 gnorm 0.107 3.26s mem 81.1GB +[2026-09-12 09:30:36] step 4186/5000 loss 0.2849 (w 0.2552 mse 0.2587 t 790 new 0.20) lr 1.00e-05 gnorm 0.101 3.11s mem 81.1GB +[2026-09-12 09:30:39] step 4187/5000 loss 0.2188 (w 0.3152 mse 0.3103 t 854 new 0.25) lr 1.00e-05 gnorm 0.098 3.10s mem 81.1GB +[2026-09-12 09:30:42] step 4188/5000 loss 0.1557 (w 0.2126 mse 0.2206 t 990 new 0.14) lr 1.00e-05 gnorm 0.095 2.82s mem 81.1GB +[2026-09-12 09:30:45] step 4189/5000 loss 0.1800 (w 0.1247 mse 0.1334 t 834 new 0.11) lr 1.00e-05 gnorm 0.106 3.20s mem 81.1GB +[2026-09-12 09:30:48] step 4190/5000 loss 0.3549 (w 0.2211 mse 0.2375 t 945 new 0.20) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-12 09:30:51] step 4191/5000 loss 0.3379 (w 0.3016 mse 0.3030 t 594 new 0.22) lr 1.00e-05 gnorm 0.202 3.27s mem 81.1GB +[2026-09-12 09:30:54] step 4192/5000 loss 0.2462 (w 0.2616 mse 0.2657 t 816 new 0.23) lr 1.00e-05 gnorm 0.131 3.12s mem 81.1GB +[2026-09-12 09:30:57] step 4193/5000 loss 0.2134 (w 0.3481 mse 0.3431 t 939 new 0.18) lr 1.00e-05 gnorm 0.112 3.16s mem 81.1GB +[2026-09-12 09:31:00] step 4194/5000 loss 0.3603 (w 0.1936 mse 0.2073 t 957 new 0.18) lr 1.00e-05 gnorm 0.157 2.85s mem 81.1GB +[2026-09-12 09:31:03] step 4195/5000 loss 0.2156 (w 0.2396 mse 0.2442 t 836 new 0.22) lr 1.00e-05 gnorm 0.103 3.14s mem 81.1GB +[2026-09-12 09:31:06] step 4196/5000 loss 0.2496 (w 0.2616 mse 0.2647 t 930 new 0.22) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +[2026-09-12 09:31:09] step 4197/5000 loss 0.1881 (w 0.4635 mse 0.4767 t 980 new 0.17) lr 1.00e-05 gnorm 0.669 3.19s mem 81.1GB +[2026-09-12 09:31:13] step 4198/5000 loss 0.3053 (w 0.2542 mse 0.2698 t 465 new 0.20) lr 1.00e-05 gnorm 0.119 3.13s mem 81.1GB +[2026-09-12 09:31:16] step 4199/5000 loss 0.2804 (w 0.1880 mse 0.1989 t 708 new 0.14) lr 1.00e-05 gnorm 0.111 3.24s mem 81.1GB +[2026-09-12 09:31:19] step 4200/5000 loss 0.1751 (w 0.3326 mse 0.3420 t 987 new 0.21) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-12 09:31:22] step 4201/5000 loss 0.3571 (w 0.7582 mse 0.7805 t 107 new 0.21) lr 1.00e-05 gnorm 0.125 3.28s mem 81.1GB +[2026-09-12 09:31:25] step 4202/5000 loss 0.1384 (w 0.2972 mse 0.2965 t 884 new 0.12) lr 1.00e-05 gnorm 0.324 3.12s mem 81.1GB +[2026-09-12 09:31:28] step 4203/5000 loss 0.1818 (w 0.1878 mse 0.2041 t 896 new 0.23) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +[2026-09-12 09:31:31] step 4204/5000 loss 0.3289 (w 0.4938 mse 0.4924 t 993 new 0.21) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +[2026-09-12 09:31:34] step 4205/5000 loss 0.2132 (w 0.8018 mse 0.7887 t 997 new 0.23) lr 1.00e-05 gnorm 0.172 3.23s mem 81.1GB +[2026-09-12 09:31:37] step 4206/5000 loss 0.4029 (w 0.2017 mse 0.2148 t 734 new 0.18) lr 1.00e-05 gnorm 0.243 2.82s mem 81.1GB +[2026-09-12 09:31:41] step 4207/5000 loss 0.1835 (w 0.3961 mse 0.4147 t 993 new 0.20) lr 1.00e-05 gnorm 0.138 3.31s mem 81.1GB +[2026-09-12 09:31:44] step 4208/5000 loss 0.3358 (w 0.2109 mse 0.2237 t 1000 new 0.18) lr 1.00e-05 gnorm 0.143 3.05s mem 81.1GB +[2026-09-12 09:31:47] step 4209/5000 loss 0.1339 (w 0.2541 mse 0.2507 t 840 new 0.21) lr 1.00e-05 gnorm 0.110 3.02s mem 81.1GB +[2026-09-12 09:31:50] step 4210/5000 loss 0.3584 (w 0.3449 mse 0.3418 t 963 new 0.26) lr 1.00e-05 gnorm 0.132 3.35s mem 81.1GB +[2026-09-12 09:31:53] step 4211/5000 loss 0.2257 (w 0.2799 mse 0.2791 t 920 new 0.16) lr 1.00e-05 gnorm 0.423 3.12s mem 81.1GB +[2026-09-12 09:31:56] step 4212/5000 loss 0.3484 (w 0.2738 mse 0.2741 t 860 new 0.21) lr 1.00e-05 gnorm 0.145 3.09s mem 81.1GB +[2026-09-12 09:31:59] step 4213/5000 loss 0.2839 (w 0.5408 mse 0.5481 t 996 new 0.20) lr 1.00e-05 gnorm 0.136 3.11s mem 81.1GB +[2026-09-12 09:32:02] step 4214/5000 loss 0.2740 (w 0.3200 mse 0.3288 t 979 new 0.13) lr 1.00e-05 gnorm 0.189 3.04s mem 81.1GB +[2026-09-12 09:32:05] step 4215/5000 loss 0.1298 (w 0.2327 mse 0.2326 t 902 new 0.21) lr 1.00e-05 gnorm 0.106 3.07s mem 81.1GB +[2026-09-12 09:32:09] step 4216/5000 loss 0.2894 (w 0.2323 mse 0.2400 t 875 new 0.22) lr 1.00e-05 gnorm 0.136 3.43s mem 81.1GB +[2026-09-12 09:32:12] step 4217/5000 loss 0.4061 (w 0.4032 mse 0.4154 t 259 new 0.22) lr 1.00e-05 gnorm 0.105 3.15s mem 81.1GB +[2026-09-12 09:32:15] step 4218/5000 loss 0.4790 (w 0.4887 mse 0.4922 t 297 new 0.23) lr 1.00e-05 gnorm 0.131 3.03s mem 81.1GB +[2026-09-12 09:32:18] step 4219/5000 loss 0.2622 (w 0.2855 mse 0.2978 t 911 new 0.18) lr 1.00e-05 gnorm 0.141 3.09s mem 81.1GB +[2026-09-12 09:32:21] step 4220/5000 loss 0.2767 (w 0.3382 mse 0.3462 t 490 new 0.19) lr 1.00e-05 gnorm 0.164 3.00s mem 81.1GB +[2026-09-12 09:32:24] step 4221/5000 loss 0.3932 (w 0.1464 mse 0.1584 t 868 new 0.17) lr 1.00e-05 gnorm 0.171 3.02s mem 81.1GB +[2026-09-12 09:32:28] step 4222/5000 loss 0.2316 (w 0.4155 mse 0.4133 t 998 new 0.22) lr 1.00e-05 gnorm 0.121 3.48s mem 81.1GB +[2026-09-12 09:32:31] step 4223/5000 loss 0.4227 (w 0.3775 mse 0.3917 t 997 new 0.20) lr 1.00e-05 gnorm 0.229 2.82s mem 81.1GB +[2026-09-12 09:32:34] step 4224/5000 loss 0.2209 (w 0.2360 mse 0.2362 t 865 new 0.23) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +[2026-09-12 09:32:37] step 4225/5000 loss 0.2333 (w 0.2009 mse 0.2070 t 861 new 0.21) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +[2026-09-12 09:32:40] step 4226/5000 loss 0.1671 (w 0.2978 mse 0.2965 t 278 new 0.27) lr 1.00e-05 gnorm 0.089 3.01s mem 81.1GB +[2026-09-12 09:32:43] step 4227/5000 loss 0.1453 (w 0.3998 mse 0.4111 t 997 new 0.10) lr 1.00e-05 gnorm 0.095 3.04s mem 81.1GB +[2026-09-12 09:32:46] step 4228/5000 loss 0.2237 (w 0.1865 mse 0.2109 t 917 new 0.18) lr 1.00e-05 gnorm 0.115 3.41s mem 81.1GB +[2026-09-12 09:32:49] step 4229/5000 loss 0.3728 (w 0.2772 mse 0.2818 t 937 new 0.17) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +[2026-09-12 09:32:52] step 4230/5000 loss 0.4500 (w 0.3787 mse 0.3666 t 911 new 0.25) lr 1.00e-05 gnorm 0.119 3.32s mem 81.1GB +[2026-09-12 09:32:55] step 4231/5000 loss 0.2807 (w 0.2203 mse 0.2404 t 704 new 0.19) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +[2026-09-12 09:32:58] step 4232/5000 loss 0.4338 (w 0.3344 mse 0.3467 t 421 new 0.21) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +[2026-09-12 09:33:01] step 4233/5000 loss 0.3474 (w 0.3376 mse 0.3402 t 715 new 0.19) lr 1.00e-05 gnorm 0.111 3.13s mem 81.1GB +[2026-09-12 09:33:05] step 4234/5000 loss 0.2835 (w 0.2879 mse 0.2987 t 976 new 0.14) lr 1.00e-05 gnorm 0.131 3.48s mem 81.1GB +[2026-09-12 09:33:08] step 4235/5000 loss 0.1358 (w 0.3871 mse 0.3829 t 990 new 0.23) lr 1.00e-05 gnorm 0.244 2.84s mem 81.1GB +[2026-09-12 09:33:11] step 4236/5000 loss 0.2458 (w 0.2059 mse 0.2207 t 839 new 0.17) lr 1.00e-05 gnorm 0.101 3.09s mem 81.1GB +[2026-09-12 09:33:13] step 4237/5000 loss 0.2357 (w 0.2602 mse 0.2674 t 726 new 0.14) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +[2026-09-12 09:33:17] step 4238/5000 loss 0.1695 (w 0.2400 mse 0.2443 t 906 new 0.23) lr 1.00e-05 gnorm 0.125 3.26s mem 81.1GB +[2026-09-12 09:33:20] step 4239/5000 loss 0.3109 (w 0.3702 mse 0.3753 t 980 new 0.25) lr 1.00e-05 gnorm 0.193 3.41s mem 81.1GB +[2026-09-12 09:33:23] step 4240/5000 loss 0.1896 (w 0.3530 mse 0.3816 t 315 new 0.14) lr 1.00e-05 gnorm 0.141 3.31s mem 81.1GB +[2026-09-12 09:33:26] step 4241/5000 loss 0.2450 (w 0.3227 mse 0.3357 t 508 new 0.18) lr 1.00e-05 gnorm 0.128 2.85s mem 81.1GB +[2026-09-12 09:33:30] step 4242/5000 loss 0.3933 (w 0.2048 mse 0.2192 t 969 new 0.11) lr 1.00e-05 gnorm 0.191 3.30s mem 81.1GB +[2026-09-12 09:33:32] step 4243/5000 loss 0.2603 (w 0.2728 mse 0.2859 t 715 new 0.22) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +[2026-09-12 09:33:36] step 4244/5000 loss 0.1813 (w 0.3735 mse 0.3588 t 930 new 0.22) lr 1.00e-05 gnorm 0.125 3.11s mem 81.1GB +[2026-09-12 09:33:39] step 4245/5000 loss 0.3208 (w 0.2502 mse 0.2632 t 947 new 0.20) lr 1.00e-05 gnorm 0.102 3.35s mem 81.1GB +[2026-09-12 09:33:42] step 4246/5000 loss 0.2469 (w 0.3989 mse 0.4119 t 973 new 0.27) lr 1.00e-05 gnorm 0.114 3.27s mem 81.1GB +[2026-09-12 09:33:45] step 4247/5000 loss 0.3056 (w 0.3191 mse 0.3148 t 953 new 0.16) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +[2026-09-12 09:33:48] step 4248/5000 loss 0.2597 (w 0.1929 mse 0.2141 t 765 new 0.23) lr 1.00e-05 gnorm 0.100 3.10s mem 81.1GB +[2026-09-12 09:33:51] step 4249/5000 loss 0.1172 (w 0.3092 mse 0.3079 t 940 new 0.24) lr 1.00e-05 gnorm 0.100 3.06s mem 81.1GB +[2026-09-12 09:33:54] step 4250/5000 loss 0.3241 (w 0.2928 mse 0.3002 t 954 new 0.23) lr 1.00e-05 gnorm 0.111 3.06s mem 81.1GB +[2026-09-12 09:33:58] step 4251/5000 loss 0.3237 (w 0.2472 mse 0.2575 t 939 new 0.11) lr 1.00e-05 gnorm 0.225 3.32s mem 81.1GB +[2026-09-12 09:34:01] step 4252/5000 loss 0.2119 (w 0.3109 mse 0.3195 t 948 new 0.23) lr 1.00e-05 gnorm 0.126 3.31s mem 81.1GB +[2026-09-12 09:34:04] step 4253/5000 loss 0.2755 (w 0.2718 mse 0.2899 t 348 new 0.17) lr 1.00e-05 gnorm 0.156 2.82s mem 81.1GB +[2026-09-12 09:34:07] step 4254/5000 loss 0.3399 (w 0.3165 mse 0.3202 t 854 new 0.16) lr 1.00e-05 gnorm 0.131 3.07s mem 81.1GB +[2026-09-12 09:34:10] step 4255/5000 loss 0.2853 (w 0.2459 mse 0.2706 t 986 new 0.26) lr 1.00e-05 gnorm 0.149 3.04s mem 81.1GB +[2026-09-12 09:34:13] step 4256/5000 loss 0.1601 (w 0.3293 mse 0.3361 t 839 new 0.22) lr 1.00e-05 gnorm 0.127 3.41s mem 81.1GB +[2026-09-12 09:34:16] step 4257/5000 loss 0.2308 (w 0.2880 mse 0.2763 t 799 new 0.21) lr 1.00e-05 gnorm 0.170 3.14s mem 81.1GB +[2026-09-12 09:34:20] step 4258/5000 loss 0.4703 (w 0.3360 mse 0.3332 t 710 new 0.26) lr 1.00e-05 gnorm 0.149 3.18s mem 81.1GB +[2026-09-12 09:34:23] step 4259/5000 loss 0.2129 (w 0.3146 mse 0.3139 t 670 new 0.19) lr 1.00e-05 gnorm 0.142 3.15s mem 81.1GB +[2026-09-12 09:34:26] step 4260/5000 loss 0.2743 (w 0.2521 mse 0.2610 t 898 new 0.23) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +[2026-09-12 09:34:29] step 4261/5000 loss 0.4900 (w 0.2243 mse 0.2316 t 951 new 0.15) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +[2026-09-12 09:34:32] step 4262/5000 loss 0.1906 (w 0.3581 mse 0.3470 t 951 new 0.25) lr 1.00e-05 gnorm 0.178 3.03s mem 81.1GB +[2026-09-12 09:34:35] step 4263/5000 loss 0.3355 (w 0.2124 mse 0.2127 t 916 new 0.00) lr 1.00e-05 gnorm 0.271 3.57s mem 81.1GB +[2026-09-12 09:34:38] step 4264/5000 loss 0.3213 (w 0.3310 mse 0.3329 t 895 new 0.17) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +[2026-09-12 09:34:41] step 4265/5000 loss 0.4317 (w 0.2785 mse 0.2810 t 763 new 0.13) lr 1.00e-05 gnorm 0.113 3.13s mem 81.1GB +[2026-09-12 09:34:44] step 4266/5000 loss 0.2645 (w 0.3520 mse 0.3488 t 988 new 0.22) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +[2026-09-12 09:34:47] step 4267/5000 loss 0.3048 (w 0.3053 mse 0.3103 t 767 new 0.23) lr 1.00e-05 gnorm 0.126 3.40s mem 81.1GB +[2026-09-12 09:34:50] step 4268/5000 loss 0.3068 (w 0.2338 mse 0.2372 t 942 new 0.09) lr 1.00e-05 gnorm 0.116 3.01s mem 81.1GB +[2026-09-12 09:34:54] step 4269/5000 loss 0.2511 (w 0.2722 mse 0.2988 t 963 new 0.19) lr 1.00e-05 gnorm 0.116 3.37s mem 81.1GB +[2026-09-12 09:34:57] step 4270/5000 loss 0.3089 (w 0.2528 mse 0.2637 t 778 new 0.23) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +[2026-09-12 09:35:00] step 4271/5000 loss 0.2969 (w 0.3245 mse 0.3227 t 653 new 0.23) lr 1.00e-05 gnorm 0.151 3.13s mem 81.1GB +[2026-09-12 09:35:03] step 4272/5000 loss 0.1979 (w 0.3058 mse 0.3104 t 973 new 0.24) lr 1.00e-05 gnorm 0.132 2.85s mem 81.1GB +[2026-09-12 09:35:06] step 4273/5000 loss 0.2092 (w 0.2001 mse 0.2156 t 894 new 0.24) lr 1.00e-05 gnorm 0.140 3.13s mem 81.1GB +[2026-09-12 09:35:09] step 4274/5000 loss 0.2704 (w 0.2135 mse 0.2190 t 724 new 0.15) lr 1.00e-05 gnorm 0.126 3.27s mem 81.1GB +[2026-09-12 09:35:13] step 4275/5000 loss 0.2599 (w 0.4190 mse 0.4148 t 978 new 0.24) lr 1.00e-05 gnorm 0.125 3.47s mem 81.1GB +[2026-09-12 09:35:15] step 4276/5000 loss 0.3391 (w 0.2403 mse 0.2490 t 779 new 0.25) lr 1.00e-05 gnorm 0.114 2.84s mem 81.1GB +[2026-09-12 09:35:19] step 4277/5000 loss 0.2584 (w 0.2742 mse 0.2743 t 857 new 0.22) lr 1.00e-05 gnorm 0.121 3.31s mem 81.1GB +[2026-09-12 09:35:22] step 4278/5000 loss 0.4586 (w 0.1714 mse 0.1916 t 804 new 0.16) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +[2026-09-12 09:35:25] step 4279/5000 loss 0.2852 (w 0.2180 mse 0.2321 t 933 new 0.19) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +[2026-09-12 09:35:28] step 4280/5000 loss 0.4591 (w 0.1906 mse 0.2046 t 683 new 0.18) lr 1.00e-05 gnorm 0.235 3.20s mem 81.1GB +[2026-09-12 09:35:31] step 4281/5000 loss 0.1757 (w 0.2393 mse 0.2445 t 965 new 0.26) lr 1.00e-05 gnorm 0.112 3.18s mem 81.1GB +[2026-09-12 09:35:34] step 4282/5000 loss 0.1668 (w 0.3984 mse 0.3908 t 985 new 0.21) lr 1.00e-05 gnorm 0.107 2.83s mem 81.1GB +[2026-09-12 09:35:37] step 4283/5000 loss 0.3028 (w 0.3172 mse 0.3202 t 683 new 0.16) lr 1.00e-05 gnorm 0.108 3.35s mem 81.1GB +[2026-09-12 09:35:40] step 4284/5000 loss 0.2348 (w 0.5614 mse 0.5672 t 989 new 0.19) lr 1.00e-05 gnorm 0.121 3.10s mem 81.1GB +[2026-09-12 09:35:43] step 4285/5000 loss 0.3344 (w 0.2648 mse 0.2649 t 598 new 0.09) lr 1.00e-05 gnorm 0.132 3.05s mem 81.1GB +[2026-09-12 09:35:47] step 4286/5000 loss 0.1494 (w 0.2619 mse 0.2675 t 926 new 0.20) lr 1.00e-05 gnorm 0.272 3.33s mem 81.1GB +[2026-09-12 09:35:50] step 4287/5000 loss 0.2071 (w 0.4651 mse 0.4546 t 994 new 0.19) lr 1.00e-05 gnorm 0.128 3.10s mem 81.1GB +[2026-09-12 09:35:53] step 4288/5000 loss 0.4558 (w 0.2599 mse 0.2809 t 942 new 0.16) lr 1.00e-05 gnorm 0.099 3.00s mem 81.1GB +[2026-09-12 09:35:56] step 4289/5000 loss 0.1633 (w 0.4572 mse 0.4265 t 970 new 0.19) lr 1.00e-05 gnorm 0.296 3.05s mem 81.1GB +[2026-09-12 09:35:59] step 4290/5000 loss 0.2871 (w 0.2520 mse 0.2649 t 940 new 0.25) lr 1.00e-05 gnorm 0.191 3.13s mem 81.1GB +[2026-09-12 09:36:02] step 4291/5000 loss 0.1970 (w 0.2838 mse 0.2812 t 817 new 0.20) lr 1.00e-05 gnorm 0.121 3.03s mem 81.1GB +[2026-09-12 09:36:05] step 4292/5000 loss 0.4131 (w 0.2030 mse 0.2141 t 663 new 0.26) lr 1.00e-05 gnorm 0.125 3.14s mem 81.1GB +[2026-09-12 09:36:08] step 4293/5000 loss 0.2154 (w 0.4097 mse 0.4523 t 177 new 0.23) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +[2026-09-12 09:36:11] step 4294/5000 loss 0.3918 (w 0.1614 mse 0.1830 t 741 new 0.18) lr 1.00e-05 gnorm 0.122 3.03s mem 81.1GB +[2026-09-12 09:36:14] step 4295/5000 loss 0.1545 (w 0.3424 mse 0.3650 t 976 new 0.22) lr 1.00e-05 gnorm 0.102 3.08s mem 81.1GB +[2026-09-12 09:36:18] step 4296/5000 loss 0.2405 (w 0.1914 mse 0.2110 t 861 new 0.26) lr 1.00e-05 gnorm 0.167 3.11s mem 81.1GB +[2026-09-12 09:36:21] step 4297/5000 loss 0.3913 (w 0.9390 mse 1.0065 t 998 new 0.18) lr 1.00e-05 gnorm 0.174 3.04s mem 81.1GB +[2026-09-12 09:36:24] step 4298/5000 loss 0.1887 (w 0.2025 mse 0.2270 t 775 new 0.25) lr 1.00e-05 gnorm 0.190 3.13s mem 81.1GB +[2026-09-12 09:36:27] step 4299/5000 loss 0.3438 (w 0.3014 mse 0.3020 t 904 new 0.22) lr 1.00e-05 gnorm 0.151 2.84s mem 81.1GB +[2026-09-12 09:36:30] step 4300/5000 loss 0.1937 (w 0.2404 mse 0.2458 t 882 new 0.19) lr 1.00e-05 gnorm 0.118 3.04s mem 81.1GB +[2026-09-12 09:36:33] step 4301/5000 loss 0.2639 (w 0.1896 mse 0.2134 t 907 new 0.24) lr 1.00e-05 gnorm 0.121 3.13s mem 81.1GB +[2026-09-12 09:36:36] step 4302/5000 loss 0.1962 (w 0.2850 mse 0.2853 t 873 new 0.23) lr 1.00e-05 gnorm 0.105 3.05s mem 81.1GB +[2026-09-12 09:36:39] step 4303/5000 loss 0.3364 (w 0.3194 mse 0.3387 t 931 new 0.20) lr 1.00e-05 gnorm 0.106 3.11s mem 81.1GB +[2026-09-12 09:36:42] step 4304/5000 loss 0.3134 (w 0.4079 mse 0.4128 t 278 new 0.22) lr 1.00e-05 gnorm 0.116 3.29s mem 81.1GB +[2026-09-12 09:36:45] step 4305/5000 loss 0.2214 (w 0.3554 mse 0.3555 t 962 new 0.20) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +[2026-09-12 09:36:48] step 4306/5000 loss 0.2911 (w 0.2347 mse 0.2330 t 879 new 0.07) lr 1.00e-05 gnorm 0.108 3.04s mem 81.1GB +[2026-09-12 09:36:51] step 4307/5000 loss 0.2712 (w 0.3096 mse 0.3256 t 830 new 0.21) lr 1.00e-05 gnorm 0.100 3.08s mem 81.1GB +[2026-09-12 09:36:55] step 4308/5000 loss 0.4168 (w 0.4194 mse 0.4381 t 238 new 0.18) lr 1.00e-05 gnorm 0.162 3.09s mem 81.1GB +[2026-09-12 09:36:58] step 4309/5000 loss 0.4195 (w 0.2501 mse 0.2611 t 829 new 0.29) lr 1.00e-05 gnorm 0.191 3.05s mem 81.1GB +[2026-09-12 09:37:01] step 4310/5000 loss 0.2903 (w 0.6026 mse 0.6090 t 127 new 0.11) lr 1.00e-05 gnorm 0.207 3.26s mem 81.1GB +[2026-09-12 09:37:04] step 4311/5000 loss 0.4300 (w 0.2959 mse 0.2929 t 653 new 0.19) lr 1.00e-05 gnorm 0.873 2.83s mem 81.1GB +[2026-09-12 09:37:07] step 4312/5000 loss 0.2150 (w 0.4333 mse 0.4324 t 990 new 0.19) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-12 09:37:10] step 4313/5000 loss 0.1962 (w 0.2606 mse 0.2708 t 911 new 0.18) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +[2026-09-12 09:37:13] step 4314/5000 loss 0.3318 (w 0.1919 mse 0.2142 t 540 new 0.16) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +[2026-09-12 09:37:16] step 4315/5000 loss 0.3530 (w 0.2455 mse 0.2578 t 977 new 0.21) lr 1.00e-05 gnorm 0.118 3.05s mem 81.1GB +[2026-09-12 09:37:19] step 4316/5000 loss 0.2697 (w 0.2751 mse 0.2825 t 925 new 0.24) lr 1.00e-05 gnorm 0.165 3.55s mem 81.1GB +[2026-09-12 09:37:22] step 4317/5000 loss 0.2970 (w 0.1838 mse 0.2137 t 383 new 0.18) lr 1.00e-05 gnorm 0.106 2.83s mem 81.1GB +[2026-09-12 09:37:25] step 4318/5000 loss 0.3955 (w 0.3919 mse 0.3879 t 989 new 0.18) lr 1.00e-05 gnorm 0.249 3.30s mem 81.1GB +[2026-09-12 09:37:28] step 4319/5000 loss 0.4363 (w 0.4296 mse 0.4253 t 988 new 0.22) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +[2026-09-12 09:37:31] step 4320/5000 loss 0.1985 (w 0.1860 mse 0.1981 t 890 new 0.26) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +[2026-09-12 09:37:34] step 4321/5000 loss 0.3405 (w 0.3623 mse 0.3514 t 938 new 0.19) lr 1.00e-05 gnorm 0.178 3.06s mem 81.1GB +[2026-09-12 09:37:38] step 4322/5000 loss 0.2203 (w 0.2915 mse 0.2905 t 720 new 0.12) lr 1.00e-05 gnorm 0.140 3.50s mem 81.1GB +[2026-09-12 09:37:41] step 4323/5000 loss 0.4747 (w 0.3156 mse 0.3189 t 586 new 0.21) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 09:37:44] step 4324/5000 loss 0.0888 (w 0.3266 mse 0.3439 t 983 new 0.19) lr 1.00e-05 gnorm 0.143 3.30s mem 81.1GB +[2026-09-12 09:37:47] step 4325/5000 loss 0.1981 (w 0.2533 mse 0.2704 t 861 new 0.13) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +[2026-09-12 09:37:50] step 4326/5000 loss 0.2790 (w 0.2059 mse 0.2236 t 977 new 0.20) lr 1.00e-05 gnorm 0.087 2.83s mem 81.1GB +[2026-09-12 09:37:53] step 4327/5000 loss 0.2720 (w 0.2358 mse 0.2529 t 735 new 0.24) lr 1.00e-05 gnorm 0.118 3.05s mem 81.1GB +[2026-09-12 09:37:57] step 4328/5000 loss 0.3214 (w 0.4398 mse 0.4437 t 999 new 0.20) lr 1.00e-05 gnorm 0.091 3.40s mem 81.1GB +[2026-09-12 09:38:00] step 4329/5000 loss 0.3196 (w 0.3965 mse 0.3905 t 971 new 0.19) lr 1.00e-05 gnorm 0.291 2.82s mem 81.1GB +[2026-09-12 09:38:03] step 4330/5000 loss 0.2441 (w 0.2229 mse 0.2274 t 921 new 0.14) lr 1.00e-05 gnorm 0.134 3.31s mem 81.1GB +[2026-09-12 09:38:06] step 4331/5000 loss 0.2567 (w 0.3805 mse 0.3790 t 1000 new 0.27) lr 1.00e-05 gnorm 0.116 3.09s mem 81.1GB +[2026-09-12 09:38:09] step 4332/5000 loss 0.4106 (w 0.6229 mse 0.6268 t 177 new 0.21) lr 1.00e-05 gnorm 0.115 2.83s mem 81.1GB +[2026-09-12 09:38:12] step 4333/5000 loss 0.1286 (w 0.4104 mse 0.4068 t 991 new 0.25) lr 1.00e-05 gnorm 0.101 3.04s mem 81.1GB +[2026-09-12 09:38:15] step 4334/5000 loss 0.2884 (w 0.2452 mse 0.2523 t 917 new 0.12) lr 1.00e-05 gnorm 0.142 3.41s mem 81.1GB +[2026-09-12 09:38:18] step 4335/5000 loss 0.0962 (w 0.3218 mse 0.3188 t 949 new 0.19) lr 1.00e-05 gnorm 0.115 2.82s mem 81.1GB +[2026-09-12 09:38:22] step 4336/5000 loss 0.2199 (w 0.4169 mse 0.4219 t 996 new 0.16) lr 1.00e-05 gnorm 0.118 3.50s mem 81.1GB +[2026-09-12 09:38:25] step 4337/5000 loss 0.2530 (w 0.2782 mse 0.2889 t 641 new 0.28) lr 1.00e-05 gnorm 0.152 3.11s mem 81.1GB +[2026-09-12 09:38:28] step 4338/5000 loss 0.2863 (w 0.2099 mse 0.2278 t 872 new 0.17) lr 1.00e-05 gnorm 0.159 2.82s mem 81.1GB +[2026-09-12 09:38:31] step 4339/5000 loss 0.2932 (w 0.2945 mse 0.2963 t 969 new 0.13) lr 1.00e-05 gnorm 0.127 3.06s mem 81.1GB +[2026-09-12 09:38:34] step 4340/5000 loss 0.3677 (w 0.3172 mse 0.3198 t 980 new 0.18) lr 1.00e-05 gnorm 0.123 3.46s mem 81.1GB +[2026-09-12 09:38:37] step 4341/5000 loss 0.1417 (w 0.2256 mse 0.2310 t 774 new 0.20) lr 1.00e-05 gnorm 0.100 3.02s mem 81.1GB +[2026-09-12 09:38:40] step 4342/5000 loss 0.3724 (w 0.4181 mse 0.4441 t 233 new 0.22) lr 1.00e-05 gnorm 0.120 3.21s mem 81.1GB +[2026-09-12 09:38:43] step 4343/5000 loss 0.2218 (w 0.2758 mse 0.2769 t 948 new 0.24) lr 1.00e-05 gnorm 0.107 3.10s mem 81.1GB +[2026-09-12 09:38:46] step 4344/5000 loss 0.3033 (w 0.2590 mse 0.2664 t 883 new 0.25) lr 1.00e-05 gnorm 0.116 2.83s mem 81.1GB +[2026-09-12 09:38:50] step 4345/5000 loss 0.2334 (w 0.4356 mse 0.4264 t 986 new 0.21) lr 1.00e-05 gnorm 0.182 3.33s mem 81.1GB +[2026-09-12 09:38:53] step 4346/5000 loss 0.3241 (w 0.2233 mse 0.2277 t 936 new 0.17) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +[2026-09-12 09:38:56] step 4347/5000 loss 0.2694 (w 0.2944 mse 0.2993 t 978 new 0.24) lr 1.00e-05 gnorm 0.121 3.07s mem 81.1GB +[2026-09-12 09:38:59] step 4348/5000 loss 0.1939 (w 0.3131 mse 0.3263 t 946 new 0.24) lr 1.00e-05 gnorm 0.133 3.11s mem 81.1GB +[2026-09-12 09:39:02] step 4349/5000 loss 0.2143 (w 0.2477 mse 0.2745 t 997 new 0.13) lr 1.00e-05 gnorm 0.282 3.20s mem 81.1GB +[2026-09-12 09:39:05] step 4350/5000 loss 0.5006 (w 0.3128 mse 0.3193 t 506 new 0.28) lr 1.00e-05 gnorm 0.147 2.82s mem 81.1GB +[2026-09-12 09:39:08] step 4351/5000 loss 0.3582 (w 0.1925 mse 0.2012 t 737 new 0.16) lr 1.00e-05 gnorm 0.155 3.34s mem 81.1GB +[2026-09-12 09:39:12] step 4352/5000 loss 0.2184 (w 0.2166 mse 0.2381 t 840 new 0.19) lr 1.00e-05 gnorm 0.108 3.40s mem 81.1GB +[2026-09-12 09:39:15] step 4353/5000 loss 0.2128 (w 0.3520 mse 0.3640 t 961 new 0.15) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +[2026-09-12 09:39:18] step 4354/5000 loss 0.4003 (w 0.2540 mse 0.2651 t 624 new 0.21) lr 1.00e-05 gnorm 0.159 3.14s mem 81.1GB +[2026-09-12 09:39:21] step 4355/5000 loss 0.2299 (w 0.3980 mse 0.4071 t 979 new 0.15) lr 1.00e-05 gnorm 0.085 3.28s mem 81.1GB +[2026-09-12 09:39:24] step 4356/5000 loss 0.1646 (w 0.3077 mse 0.3063 t 938 new 0.16) lr 1.00e-05 gnorm 0.097 3.03s mem 81.1GB +[2026-09-12 09:39:27] step 4357/5000 loss 0.1674 (w 0.2113 mse 0.2168 t 871 new 0.19) lr 1.00e-05 gnorm 0.188 3.17s mem 81.1GB +[2026-09-12 09:39:31] step 4358/5000 loss 0.5065 (w 0.2523 mse 0.2618 t 578 new 0.23) lr 1.00e-05 gnorm 0.149 3.23s mem 81.1GB +[2026-09-12 09:39:34] step 4359/5000 loss 0.2282 (w 0.2580 mse 0.2621 t 756 new 0.18) lr 1.00e-05 gnorm 0.106 3.14s mem 81.1GB +[2026-09-12 09:39:37] step 4360/5000 loss 0.2272 (w 0.2653 mse 0.2733 t 971 new 0.23) lr 1.00e-05 gnorm 0.122 3.31s mem 81.1GB +[2026-09-12 09:39:40] step 4361/5000 loss 0.2488 (w 0.3605 mse 0.3540 t 997 new 0.20) lr 1.00e-05 gnorm 0.120 3.11s mem 81.1GB +[2026-09-12 09:39:43] step 4362/5000 loss 0.2451 (w 0.3776 mse 0.3859 t 976 new 0.22) lr 1.00e-05 gnorm 0.122 3.04s mem 81.1GB +[2026-09-12 09:39:46] step 4363/5000 loss 0.3582 (w 0.3234 mse 0.3271 t 935 new 0.16) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +[2026-09-12 09:39:50] step 4364/5000 loss 0.1331 (w 0.2358 mse 0.2495 t 950 new 0.23) lr 1.00e-05 gnorm 0.152 3.21s mem 81.1GB +[2026-09-12 09:39:53] step 4365/5000 loss 0.2762 (w 0.3276 mse 0.3279 t 465 new 0.21) lr 1.00e-05 gnorm 0.123 3.58s mem 81.1GB +[2026-09-12 09:39:56] step 4366/5000 loss 0.2167 (w 0.2381 mse 0.2527 t 939 new 0.19) lr 1.00e-05 gnorm 0.111 3.06s mem 81.1GB +[2026-09-12 09:39:59] step 4367/5000 loss 0.2703 (w 0.3193 mse 0.3341 t 958 new 0.25) lr 1.00e-05 gnorm 0.126 3.10s mem 81.1GB +[2026-09-12 09:40:02] step 4368/5000 loss 0.3525 (w 0.1887 mse 0.2072 t 728 new 0.20) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +[2026-09-12 09:40:06] step 4369/5000 loss 0.5157 (w 0.2942 mse 0.3030 t 434 new 0.17) lr 1.00e-05 gnorm 0.123 3.57s mem 81.1GB +[2026-09-12 09:40:10] step 4370/5000 loss 0.2663 (w 0.2124 mse 0.2116 t 698 new 0.18) lr 1.00e-05 gnorm 0.180 3.69s mem 81.1GB +[2026-09-12 09:40:13] step 4371/5000 loss 0.3188 (w 0.3087 mse 0.3035 t 894 new 0.20) lr 1.00e-05 gnorm 0.119 3.43s mem 81.1GB +[2026-09-12 09:40:16] step 4372/5000 loss 0.3033 (w 0.2750 mse 0.2705 t 830 new 0.18) lr 1.00e-05 gnorm 0.121 3.05s mem 81.1GB +[2026-09-12 09:40:19] step 4373/5000 loss 0.3944 (w 0.2677 mse 0.2728 t 884 new 0.20) lr 1.00e-05 gnorm 0.146 3.02s mem 81.1GB +[2026-09-12 09:40:23] step 4374/5000 loss 0.4218 (w 0.3041 mse 0.2964 t 584 new 0.22) lr 1.00e-05 gnorm 0.121 3.38s mem 81.1GB +[2026-09-12 09:40:26] step 4375/5000 loss 0.1748 (w 0.2849 mse 0.3077 t 840 new 0.16) lr 1.00e-05 gnorm 0.107 3.24s mem 81.1GB +[2026-09-12 09:40:29] step 4376/5000 loss 0.3019 (w 0.3463 mse 0.3482 t 913 new 0.27) lr 1.00e-05 gnorm 0.105 3.10s mem 81.1GB +[2026-09-12 09:40:32] step 4377/5000 loss 0.2508 (w 0.4161 mse 0.4084 t 994 new 0.18) lr 1.00e-05 gnorm 0.113 3.36s mem 81.1GB +[2026-09-12 09:40:35] step 4378/5000 loss 0.3046 (w 0.3036 mse 0.3069 t 768 new 0.21) lr 1.00e-05 gnorm 0.161 3.08s mem 81.1GB +[2026-09-12 09:40:38] step 4379/5000 loss 0.2707 (w 0.3734 mse 0.3753 t 958 new 0.21) lr 1.00e-05 gnorm 0.221 3.10s mem 81.1GB +[2026-09-12 09:40:42] step 4380/5000 loss 0.1512 (w 0.3458 mse 0.3425 t 961 new 0.24) lr 1.00e-05 gnorm 0.124 3.42s mem 81.1GB +[2026-09-12 09:40:45] step 4381/5000 loss 0.2661 (w 0.2501 mse 0.2643 t 733 new 0.23) lr 1.00e-05 gnorm 0.220 3.54s mem 81.1GB +[2026-09-12 09:40:49] step 4382/5000 loss 0.2158 (w 0.1949 mse 0.2237 t 914 new 0.18) lr 1.00e-05 gnorm 0.167 3.11s mem 81.1GB +[2026-09-12 09:40:52] step 4383/5000 loss 0.2023 (w 0.4215 mse 0.4268 t 991 new 0.23) lr 1.00e-05 gnorm 0.136 3.17s mem 81.1GB +[2026-09-12 09:40:55] step 4384/5000 loss 0.2755 (w 0.2994 mse 0.3103 t 957 new 0.22) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +[2026-09-12 09:40:58] step 4385/5000 loss 0.3136 (w 0.3498 mse 0.3458 t 844 new 0.17) lr 1.00e-05 gnorm 0.111 3.10s mem 81.1GB +[2026-09-12 09:41:01] step 4386/5000 loss 0.1796 (w 0.2040 mse 0.2114 t 882 new 0.11) lr 1.00e-05 gnorm 0.111 3.32s mem 81.1GB +[2026-09-12 09:41:05] step 4387/5000 loss 0.2543 (w 0.2866 mse 0.2916 t 990 new 0.18) lr 1.00e-05 gnorm 0.114 3.43s mem 81.1GB +[2026-09-12 09:41:08] step 4388/5000 loss 0.2528 (w 0.5849 mse 0.5747 t 994 new 0.23) lr 1.00e-05 gnorm 0.172 3.10s mem 81.1GB +[2026-09-12 09:41:11] step 4389/5000 loss 0.3022 (w 0.2099 mse 0.2341 t 972 new 0.19) lr 1.00e-05 gnorm 0.106 3.19s mem 81.1GB +[2026-09-12 09:41:14] step 4390/5000 loss 0.2412 (w 0.3087 mse 0.3038 t 987 new 0.20) lr 1.00e-05 gnorm 0.134 3.23s mem 81.1GB +[2026-09-12 09:41:17] step 4391/5000 loss 0.3547 (w 0.2464 mse 0.2680 t 992 new 0.10) lr 1.00e-05 gnorm 0.134 3.04s mem 81.1GB +[2026-09-12 09:41:20] step 4392/5000 loss 0.0716 (w 0.2139 mse 0.2265 t 908 new 0.22) lr 1.00e-05 gnorm 0.106 3.06s mem 81.1GB +[2026-09-12 09:41:24] step 4393/5000 loss 0.2569 (w 0.1979 mse 0.2185 t 750 new 0.23) lr 1.00e-05 gnorm 0.109 3.45s mem 81.1GB +[2026-09-12 09:41:27] step 4394/5000 loss 0.4291 (w 0.2554 mse 0.2512 t 929 new 0.20) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +[2026-09-12 09:41:30] step 4395/5000 loss 0.1449 (w 0.2084 mse 0.2084 t 942 new 0.00) lr 1.00e-05 gnorm 0.215 3.04s mem 81.1GB +[2026-09-12 09:41:33] step 4396/5000 loss 0.3798 (w 0.3430 mse 0.3488 t 453 new 0.25) lr 1.00e-05 gnorm 0.102 3.38s mem 81.1GB +[2026-09-12 09:41:36] step 4397/5000 loss 0.1805 (w 0.3134 mse 0.3122 t 926 new 0.09) lr 1.00e-05 gnorm 0.117 3.09s mem 81.1GB +[2026-09-12 09:41:40] step 4398/5000 loss 0.2108 (w 0.3735 mse 0.3713 t 959 new 0.21) lr 1.00e-05 gnorm 0.133 3.30s mem 81.1GB +[2026-09-12 09:41:43] step 4399/5000 loss 0.2460 (w 0.2590 mse 0.2668 t 712 new 0.12) lr 1.00e-05 gnorm 0.118 3.12s mem 81.1GB +[2026-09-12 09:41:46] step 4400/5000 loss 0.3773 (w 0.5740 mse 0.5704 t 177 new 0.26) lr 1.00e-05 gnorm 0.113 3.01s mem 81.1GB +[2026-09-12 09:41:49] step 4401/5000 loss 0.4353 (w 0.4643 mse 0.4631 t 470 new 0.20) lr 1.00e-05 gnorm 0.141 3.35s mem 81.1GB +[2026-09-12 09:41:52] step 4402/5000 loss 0.3148 (w 0.2845 mse 0.2845 t 752 new 0.26) lr 1.00e-05 gnorm 0.145 3.05s mem 81.1GB +[2026-09-12 09:41:55] step 4403/5000 loss 0.2535 (w 0.1740 mse 0.1964 t 851 new 0.22) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +[2026-09-12 09:41:58] step 4404/5000 loss 0.2167 (w 0.2835 mse 0.3007 t 944 new 0.25) lr 1.00e-05 gnorm 0.087 3.14s mem 81.1GB +[2026-09-12 09:42:01] step 4405/5000 loss 0.2002 (w 0.3984 mse 0.4045 t 980 new 0.23) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +[2026-09-12 09:42:04] step 4406/5000 loss 0.2885 (w 0.2378 mse 0.2439 t 775 new 0.19) lr 1.00e-05 gnorm 0.317 3.04s mem 81.1GB +[2026-09-12 09:42:08] step 4407/5000 loss 0.3216 (w 0.2374 mse 0.2488 t 935 new 0.15) lr 1.00e-05 gnorm 0.140 3.37s mem 81.1GB +[2026-09-12 09:42:11] step 4408/5000 loss 0.3635 (w 0.2226 mse 0.2244 t 869 new 0.13) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-12 09:42:14] step 4409/5000 loss 0.2866 (w 0.3083 mse 0.3252 t 959 new 0.20) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +[2026-09-12 09:42:17] step 4410/5000 loss 0.2193 (w 0.2634 mse 0.2622 t 866 new 0.15) lr 1.00e-05 gnorm 0.132 3.27s mem 81.1GB +[2026-09-12 09:42:20] step 4411/5000 loss 0.3625 (w 0.2868 mse 0.2849 t 932 new 0.20) lr 1.00e-05 gnorm 0.133 3.07s mem 81.1GB +[2026-09-12 09:42:23] step 4412/5000 loss 0.3498 (w 0.2398 mse 0.2517 t 662 new 0.24) lr 1.00e-05 gnorm 0.170 3.29s mem 81.1GB +[2026-09-12 09:42:26] step 4413/5000 loss 0.3046 (w 0.4617 mse 0.4629 t 274 new 0.19) lr 1.00e-05 gnorm 0.409 3.08s mem 81.1GB +[2026-09-12 09:42:29] step 4414/5000 loss 0.3671 (w 0.2862 mse 0.3010 t 301 new 0.16) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +[2026-09-12 09:42:32] step 4415/5000 loss 0.2267 (w 0.3945 mse 0.4160 t 964 new 0.15) lr 1.00e-05 gnorm 0.112 3.10s mem 81.1GB +[2026-09-12 09:42:36] step 4416/5000 loss 0.3155 (w 0.2796 mse 0.2811 t 731 new 0.22) lr 1.00e-05 gnorm 0.101 3.35s mem 81.1GB +[2026-09-12 09:42:39] step 4417/5000 loss 0.4817 (w 0.1840 mse 0.1846 t 787 new 0.09) lr 1.00e-05 gnorm 0.117 3.32s mem 81.1GB +[2026-09-12 09:42:42] step 4418/5000 loss 0.3395 (w 0.2876 mse 0.2906 t 991 new 0.14) lr 1.00e-05 gnorm 0.115 3.34s mem 81.1GB +[2026-09-12 09:42:45] step 4419/5000 loss 0.3403 (w 0.2085 mse 0.2216 t 574 new 0.13) lr 1.00e-05 gnorm 0.254 3.08s mem 81.1GB +[2026-09-12 09:42:49] step 4420/5000 loss 0.2926 (w 0.2216 mse 0.2388 t 918 new 0.23) lr 1.00e-05 gnorm 0.242 3.13s mem 81.1GB +[2026-09-12 09:42:52] step 4421/5000 loss 0.2150 (w 0.1513 mse 0.1738 t 922 new 0.18) lr 1.00e-05 gnorm 0.113 3.06s mem 81.1GB +[2026-09-12 09:42:55] step 4422/5000 loss 0.3112 (w 0.2973 mse 0.3052 t 747 new 0.19) lr 1.00e-05 gnorm 0.116 3.38s mem 81.1GB +[2026-09-12 09:42:58] step 4423/5000 loss 0.3312 (w 0.2837 mse 0.2836 t 733 new 0.21) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +[2026-09-12 09:43:01] step 4424/5000 loss 0.2478 (w 0.2899 mse 0.3058 t 758 new 0.17) lr 1.00e-05 gnorm 0.126 3.34s mem 81.1GB +[2026-09-12 09:43:04] step 4425/5000 loss 0.1848 (w 0.4339 mse 0.4325 t 980 new 0.21) lr 1.00e-05 gnorm 0.533 3.08s mem 81.1GB +[2026-09-12 09:43:07] step 4426/5000 loss 0.4186 (w 0.3427 mse 0.3631 t 437 new 0.21) lr 1.00e-05 gnorm 0.140 2.82s mem 81.1GB +[2026-09-12 09:43:10] step 4427/5000 loss 0.3984 (w 0.2968 mse 0.2915 t 642 new 0.18) lr 1.00e-05 gnorm 0.125 3.30s mem 81.1GB +[2026-09-12 09:43:14] step 4428/5000 loss 0.2308 (w 0.3683 mse 0.3788 t 996 new 0.20) lr 1.00e-05 gnorm 0.134 3.33s mem 81.1GB +[2026-09-12 09:43:17] step 4429/5000 loss 0.2745 (w 0.2638 mse 0.2707 t 975 new 0.23) lr 1.00e-05 gnorm 0.107 3.01s mem 81.1GB +[2026-09-12 09:43:20] step 4430/5000 loss 0.2578 (w 0.2096 mse 0.2307 t 789 new 0.15) lr 1.00e-05 gnorm 0.130 3.12s mem 81.1GB +[2026-09-12 09:43:23] step 4431/5000 loss 0.2650 (w 0.3808 mse 0.3955 t 989 new 0.24) lr 1.00e-05 gnorm 0.148 3.11s mem 81.1GB +[2026-09-12 09:43:26] step 4432/5000 loss 0.1732 (w 0.2711 mse 0.2704 t 915 new 0.17) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +[2026-09-12 09:43:29] step 4433/5000 loss 0.2492 (w 0.3028 mse 0.3166 t 911 new 0.18) lr 1.00e-05 gnorm 0.099 3.37s mem 81.1GB +[2026-09-12 09:43:33] step 4434/5000 loss 0.1676 (w 0.2556 mse 0.2646 t 864 new 0.15) lr 1.00e-05 gnorm 0.099 3.35s mem 81.1GB +[2026-09-12 09:43:36] step 4435/5000 loss 0.3756 (w 0.1851 mse 0.2013 t 742 new 0.23) lr 1.00e-05 gnorm 1.162 3.02s mem 81.1GB +[2026-09-12 09:43:39] step 4436/5000 loss 0.4675 (w 0.2456 mse 0.2603 t 725 new 0.27) lr 1.00e-05 gnorm 0.112 3.15s mem 81.1GB +[2026-09-12 09:43:42] step 4437/5000 loss 0.2793 (w 0.3877 mse 0.3928 t 997 new 0.20) lr 1.00e-05 gnorm 0.126 3.06s mem 81.1GB +[2026-09-12 09:43:45] step 4438/5000 loss 0.2869 (w 0.2810 mse 0.2851 t 941 new 0.16) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +[2026-09-12 09:43:48] step 4439/5000 loss 0.3030 (w 0.2452 mse 0.2420 t 812 new 0.06) lr 1.00e-05 gnorm 0.248 3.09s mem 81.1GB +[2026-09-12 09:43:51] step 4440/5000 loss 0.5157 (w 0.3735 mse 0.3820 t 319 new 0.25) lr 1.00e-05 gnorm 0.116 3.03s mem 81.1GB +[2026-09-12 09:43:54] step 4441/5000 loss 0.1943 (w 0.2456 mse 0.2489 t 761 new 0.22) lr 1.00e-05 gnorm 0.204 3.04s mem 81.1GB +[2026-09-12 09:43:57] step 4442/5000 loss 0.2333 (w 0.2605 mse 0.2731 t 564 new 0.19) lr 1.00e-05 gnorm 0.097 3.06s mem 81.1GB +[2026-09-12 09:44:00] step 4443/5000 loss 0.2110 (w 0.2186 mse 0.2264 t 787 new 0.17) lr 1.00e-05 gnorm 0.107 3.10s mem 81.1GB +[2026-09-12 09:44:03] step 4444/5000 loss 0.1779 (w 0.3114 mse 0.3092 t 922 new 0.24) lr 1.00e-05 gnorm 0.111 3.06s mem 81.1GB +[2026-09-12 09:44:07] step 4445/5000 loss 0.2479 (w 0.3603 mse 0.3620 t 989 new 0.22) lr 1.00e-05 gnorm 0.091 3.28s mem 81.1GB +[2026-09-12 09:44:10] step 4446/5000 loss 0.3317 (w 0.3028 mse 0.2977 t 975 new 0.19) lr 1.00e-05 gnorm 0.154 3.03s mem 81.1GB +[2026-09-12 09:44:13] step 4447/5000 loss 0.2861 (w 0.3338 mse 0.3251 t 789 new 0.22) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-12 09:44:16] step 4448/5000 loss 0.1494 (w 0.2335 mse 0.2505 t 923 new 0.27) lr 1.00e-05 gnorm 0.119 3.31s mem 81.1GB +[2026-09-12 09:44:19] step 4449/5000 loss 0.3970 (w 0.3406 mse 0.3513 t 979 new 0.22) lr 1.00e-05 gnorm 0.140 3.09s mem 81.1GB +[2026-09-12 09:44:22] step 4450/5000 loss 0.1699 (w 0.3260 mse 0.3341 t 954 new 0.23) lr 1.00e-05 gnorm 0.100 3.10s mem 81.1GB +[2026-09-12 09:44:25] step 4451/5000 loss 0.3000 (w 0.2588 mse 0.2656 t 906 new 0.18) lr 1.00e-05 gnorm 0.110 3.33s mem 81.1GB +[2026-09-12 09:44:29] step 4452/5000 loss 0.3531 (w 0.2528 mse 0.2638 t 940 new 0.23) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +[2026-09-12 09:44:32] step 4453/5000 loss 0.2570 (w 0.1940 mse 0.2004 t 877 new 0.20) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +[2026-09-12 09:44:35] step 4454/5000 loss 0.3490 (w 0.5318 mse 0.5344 t 217 new 0.23) lr 1.00e-05 gnorm 0.103 3.04s mem 81.1GB +[2026-09-12 09:44:38] step 4455/5000 loss 0.3543 (w 0.1898 mse 0.2121 t 656 new 0.23) lr 1.00e-05 gnorm 0.106 2.82s mem 81.1GB +[2026-09-12 09:44:41] step 4456/5000 loss 0.2362 (w 0.2871 mse 0.2919 t 829 new 0.23) lr 1.00e-05 gnorm 0.109 3.13s mem 81.1GB +[2026-09-12 09:44:44] step 4457/5000 loss 0.3449 (w 0.1958 mse 0.2172 t 835 new 0.20) lr 1.00e-05 gnorm 0.120 3.38s mem 81.1GB +[2026-09-12 09:44:47] step 4458/5000 loss 0.1856 (w 0.2909 mse 0.2918 t 780 new 0.26) lr 1.00e-05 gnorm 0.146 2.81s mem 81.1GB +[2026-09-12 09:44:50] step 4459/5000 loss 0.2322 (w 0.4018 mse 0.3990 t 984 new 0.17) lr 1.00e-05 gnorm 0.098 3.22s mem 81.1GB +[2026-09-12 09:44:53] step 4460/5000 loss 0.3129 (w 0.2234 mse 0.2260 t 870 new 0.18) lr 1.00e-05 gnorm 0.122 3.06s mem 81.1GB +[2026-09-12 09:44:56] step 4461/5000 loss 0.3224 (w 0.2859 mse 0.3189 t 965 new 0.22) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +[2026-09-12 09:44:59] step 4462/5000 loss 0.2298 (w 0.2022 mse 0.2055 t 897 new 0.10) lr 1.00e-05 gnorm 0.126 3.07s mem 81.1GB +[2026-09-12 09:45:02] step 4463/5000 loss 0.1793 (w 0.4078 mse 0.4218 t 966 new 0.20) lr 1.00e-05 gnorm 0.114 3.39s mem 81.1GB +[2026-09-12 09:45:05] step 4464/5000 loss 0.2370 (w 0.1877 mse 0.2179 t 919 new 0.19) lr 1.00e-05 gnorm 0.153 2.85s mem 81.1GB +[2026-09-12 09:45:09] step 4465/5000 loss 0.3308 (w 0.3392 mse 0.3535 t 934 new 0.26) lr 1.00e-05 gnorm 0.108 3.27s mem 81.1GB +[2026-09-12 09:45:12] step 4466/5000 loss 0.4476 (w 0.4276 mse 0.4347 t 301 new 0.24) lr 1.00e-05 gnorm 0.125 3.25s mem 81.1GB +[2026-09-12 09:45:15] step 4467/5000 loss 0.3097 (w 0.2180 mse 0.2427 t 881 new 0.24) lr 1.00e-05 gnorm 0.102 2.81s mem 81.1GB +[2026-09-12 09:45:18] step 4468/5000 loss 0.2730 (w 0.1971 mse 0.2175 t 854 new 0.21) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +[2026-09-12 09:45:21] step 4469/5000 loss 0.1375 (w 0.2883 mse 0.2944 t 972 new 0.18) lr 1.00e-05 gnorm 0.162 3.35s mem 81.1GB +[2026-09-12 09:45:24] step 4470/5000 loss 0.3242 (w 0.3707 mse 0.3638 t 737 new 0.20) lr 1.00e-05 gnorm 0.649 2.82s mem 81.1GB +[2026-09-12 09:45:27] step 4471/5000 loss 0.2001 (w 0.3216 mse 0.3096 t 628 new 0.17) lr 1.00e-05 gnorm 0.113 3.06s mem 81.1GB +[2026-09-12 09:45:30] step 4472/5000 loss 0.2739 (w 0.3037 mse 0.3109 t 758 new 0.21) lr 1.00e-05 gnorm 0.136 3.34s mem 81.1GB +[2026-09-12 09:45:33] step 4473/5000 loss 0.3457 (w 0.1445 mse 0.1557 t 820 new 0.12) lr 1.00e-05 gnorm 0.273 2.83s mem 81.1GB +[2026-09-12 09:45:36] step 4474/5000 loss 0.2424 (w 0.2997 mse 0.2980 t 868 new 0.21) lr 1.00e-05 gnorm 0.103 3.12s mem 81.1GB +[2026-09-12 09:45:40] step 4475/5000 loss 0.5727 (w 0.3286 mse 0.3279 t 456 new 0.25) lr 1.00e-05 gnorm 0.173 3.38s mem 81.1GB +[2026-09-12 09:45:43] step 4476/5000 loss 0.2541 (w 0.2366 mse 0.2499 t 961 new 0.18) lr 1.00e-05 gnorm 0.097 3.01s mem 81.1GB +[2026-09-12 09:45:46] step 4477/5000 loss 0.2521 (w 0.2627 mse 0.2749 t 973 new 0.18) lr 1.00e-05 gnorm 0.114 3.11s mem 81.1GB +[2026-09-12 09:45:49] step 4478/5000 loss 0.3985 (w 0.3059 mse 0.3138 t 599 new 0.21) lr 1.00e-05 gnorm 0.408 3.02s mem 81.1GB +[2026-09-12 09:45:52] step 4479/5000 loss 0.2741 (w 0.2812 mse 0.2759 t 939 new 0.19) lr 1.00e-05 gnorm 0.122 3.04s mem 81.1GB +[2026-09-12 09:45:55] step 4480/5000 loss 0.3633 (w 0.2056 mse 0.2071 t 782 new 0.10) lr 1.00e-05 gnorm 0.093 2.82s mem 81.1GB +[2026-09-12 09:45:58] step 4481/5000 loss 0.2318 (w 0.2777 mse 0.2874 t 951 new 0.20) lr 1.00e-05 gnorm 0.124 3.07s mem 81.1GB +[2026-09-12 09:46:01] step 4482/5000 loss 0.1907 (w 0.2165 mse 0.2214 t 963 new 0.22) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +[2026-09-12 09:46:04] step 4483/5000 loss 0.1907 (w 0.1982 mse 0.2133 t 912 new 0.19) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +[2026-09-12 09:46:07] step 4484/5000 loss 0.3220 (w 0.2716 mse 0.2878 t 943 new 0.22) lr 1.00e-05 gnorm 0.146 3.07s mem 81.1GB +[2026-09-12 09:46:10] step 4485/5000 loss 0.4299 (w 0.2378 mse 0.2502 t 858 new 0.19) lr 1.00e-05 gnorm 0.161 3.06s mem 81.1GB +[2026-09-12 09:46:13] step 4486/5000 loss 0.3185 (w 0.2785 mse 0.2873 t 712 new 0.21) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +[2026-09-12 09:46:16] step 4487/5000 loss 0.3177 (w 0.3119 mse 0.3347 t 356 new 0.20) lr 1.00e-05 gnorm 0.198 3.10s mem 81.1GB +[2026-09-12 09:46:19] step 4488/5000 loss 0.3661 (w 0.3223 mse 0.3189 t 889 new 0.26) lr 1.00e-05 gnorm 0.107 3.09s mem 81.1GB +[2026-09-12 09:46:23] step 4489/5000 loss 0.4410 (w 0.6689 mse 0.6666 t 114 new 0.17) lr 1.00e-05 gnorm 0.095 3.25s mem 81.1GB +[2026-09-12 09:46:25] step 4490/5000 loss 0.4088 (w 0.2816 mse 0.2852 t 993 new 0.11) lr 1.00e-05 gnorm 1.439 2.83s mem 81.1GB +[2026-09-12 09:46:28] step 4491/5000 loss 0.1498 (w 0.2817 mse 0.2964 t 915 new 0.18) lr 1.00e-05 gnorm 0.118 3.05s mem 81.1GB +[2026-09-12 09:46:32] step 4492/5000 loss 0.2698 (w 0.2533 mse 0.2592 t 603 new 0.23) lr 1.00e-05 gnorm 0.101 3.16s mem 81.1GB +[2026-09-12 09:46:35] step 4493/5000 loss 0.1744 (w 0.2885 mse 0.2917 t 939 new 0.13) lr 1.00e-05 gnorm 0.245 3.36s mem 81.1GB +[2026-09-12 09:46:38] step 4494/5000 loss 0.2410 (w 0.3152 mse 0.3262 t 765 new 0.17) lr 1.00e-05 gnorm 0.127 3.08s mem 81.1GB +[2026-09-12 09:46:41] step 4495/5000 loss 0.4701 (w 0.1855 mse 0.2120 t 981 new 0.16) lr 1.00e-05 gnorm 0.121 3.29s mem 81.1GB +[2026-09-12 09:46:44] step 4496/5000 loss 0.2968 (w 0.1847 mse 0.2031 t 724 new 0.25) lr 1.00e-05 gnorm 0.107 2.82s mem 81.1GB +[2026-09-12 09:46:47] step 4497/5000 loss 0.3935 (w 0.3928 mse 0.3864 t 959 new 0.26) lr 1.00e-05 gnorm 0.146 3.08s mem 81.1GB +[2026-09-12 09:46:50] step 4498/5000 loss 0.3286 (w 0.2678 mse 0.2765 t 964 new 0.19) lr 1.00e-05 gnorm 0.108 3.05s mem 81.1GB +[2026-09-12 09:46:53] step 4499/5000 loss 0.2000 (w 0.1891 mse 0.1971 t 659 new 0.18) lr 1.00e-05 gnorm 0.102 3.07s mem 81.1GB +[2026-09-12 09:46:56] step 4500/5000 loss 0.3127 (w 0.3313 mse 0.3374 t 997 new 0.22) lr 1.00e-05 gnorm 0.137 3.02s mem 81.1GB +[2026-09-12 09:46:58] [val] step 4500 t=200: w=0.4548 mse=0.4729 (n=16) t=500: w=0.2768 mse=0.2915 (n=16) t=800: w=0.2328 mse=0.2444 (n=16) | mean w=0.3215 mse=0.3362 2s +[2026-09-12 09:47:46] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step4500.safetensors 4093 个张量 37.98 GB +[2026-09-12 09:47:52] step 4501/5000 loss 0.2657 (w 0.2494 mse 0.2648 t 841 new 0.14) lr 1.00e-05 gnorm 0.148 3.13s mem 81.1GB +[2026-09-12 09:47:54] step 4502/5000 loss 0.2238 (w 0.3121 mse 0.3140 t 879 new 0.17) lr 1.00e-05 gnorm 0.127 2.82s mem 81.1GB +[2026-09-12 09:47:58] step 4503/5000 loss 0.3070 (w 0.2998 mse 0.3199 t 824 new 0.17) lr 1.00e-05 gnorm 0.103 3.38s mem 81.1GB +[2026-09-12 09:48:01] step 4504/5000 loss 0.2231 (w 0.3310 mse 0.3702 t 140 new 0.18) lr 1.00e-05 gnorm 0.126 3.16s mem 81.1GB +[2026-09-12 09:48:04] step 4505/5000 loss 0.4745 (w 0.2379 mse 0.2446 t 727 new 0.08) lr 1.00e-05 gnorm 0.124 2.99s mem 81.1GB +[2026-09-12 09:48:07] step 4506/5000 loss 0.2447 (w 0.2275 mse 0.2364 t 741 new 0.17) lr 1.00e-05 gnorm 0.210 2.81s mem 81.1GB +[2026-09-12 09:48:10] step 4507/5000 loss 0.1379 (w 0.3523 mse 0.3521 t 974 new 0.15) lr 1.00e-05 gnorm 0.221 3.09s mem 81.1GB +[2026-09-12 09:48:13] step 4508/5000 loss 0.2892 (w 0.2794 mse 0.3010 t 379 new 0.21) lr 1.00e-05 gnorm 0.103 2.82s mem 81.1GB +[2026-09-12 09:48:16] step 4509/5000 loss 0.1749 (w 0.2609 mse 0.2684 t 940 new 0.25) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +[2026-09-12 09:48:19] step 4510/5000 loss 0.1905 (w 0.2889 mse 0.2929 t 931 new 0.24) lr 1.00e-05 gnorm 0.147 3.17s mem 81.1GB +[2026-09-12 09:48:22] step 4511/5000 loss 0.2035 (w 0.2633 mse 0.2759 t 942 new 0.16) lr 1.00e-05 gnorm 0.114 3.02s mem 81.1GB +[2026-09-12 09:48:25] step 4512/5000 loss 0.1168 (w 0.2159 mse 0.2328 t 808 new 0.22) lr 1.00e-05 gnorm 0.101 3.04s mem 81.1GB +[2026-09-12 09:48:28] step 4513/5000 loss 0.4000 (w 0.2642 mse 0.2726 t 938 new 0.13) lr 1.00e-05 gnorm 0.100 3.08s mem 81.1GB +[2026-09-12 09:48:31] step 4514/5000 loss 0.2490 (w 0.2887 mse 0.2897 t 928 new 0.22) lr 1.00e-05 gnorm 0.105 3.07s mem 81.1GB +[2026-09-12 09:48:35] step 4515/5000 loss 0.3871 (w 0.3729 mse 0.3674 t 963 new 0.20) lr 1.00e-05 gnorm 0.148 3.16s mem 81.1GB +[2026-09-12 09:48:38] step 4516/5000 loss 0.2331 (w 0.2228 mse 0.2457 t 995 new 0.14) lr 1.00e-05 gnorm 0.128 3.30s mem 81.1GB +[2026-09-12 09:48:41] step 4517/5000 loss 0.3055 (w 0.3055 mse 0.3321 t 986 new 0.19) lr 1.00e-05 gnorm 0.119 3.06s mem 81.1GB +[2026-09-12 09:48:44] step 4518/5000 loss 0.2966 (w 0.2966 mse 0.3230 t 984 new 0.22) lr 1.00e-05 gnorm 0.119 3.10s mem 81.1GB +[2026-09-12 09:48:47] step 4519/5000 loss 0.2525 (w 0.3594 mse 0.3463 t 995 new 0.23) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +[2026-09-12 09:48:50] step 4520/5000 loss 0.2505 (w 0.2329 mse 0.2554 t 952 new 0.13) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +[2026-09-12 09:48:53] step 4521/5000 loss 0.2571 (w 0.3055 mse 0.3008 t 970 new 0.22) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +[2026-09-12 09:48:56] step 4522/5000 loss 0.1570 (w 0.2998 mse 0.3048 t 995 new 0.23) lr 1.00e-05 gnorm 0.119 3.20s mem 81.1GB +[2026-09-12 09:48:59] step 4523/5000 loss 0.2747 (w 0.6317 mse 0.6284 t 153 new 0.15) lr 1.00e-05 gnorm 0.116 3.05s mem 81.1GB +[2026-09-12 09:49:02] step 4524/5000 loss 0.1532 (w 0.3840 mse 0.3820 t 994 new 0.16) lr 1.00e-05 gnorm 0.126 3.10s mem 81.1GB +[2026-09-12 09:49:05] step 4525/5000 loss 0.2553 (w 0.2998 mse 0.3240 t 977 new 0.20) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +[2026-09-12 09:49:08] step 4526/5000 loss 0.1440 (w 0.2854 mse 0.2985 t 980 new 0.24) lr 1.00e-05 gnorm 0.260 3.40s mem 81.1GB +[2026-09-12 09:49:11] step 4527/5000 loss 0.2580 (w 0.2936 mse 0.3085 t 980 new 0.19) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +[2026-09-12 09:49:15] step 4528/5000 loss 0.2952 (w 0.2703 mse 0.2711 t 689 new 0.12) lr 1.00e-05 gnorm 0.130 3.51s mem 81.1GB +[2026-09-12 09:49:18] step 4529/5000 loss 0.2949 (w 0.4088 mse 0.3969 t 954 new 0.25) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +[2026-09-12 09:49:21] step 4530/5000 loss 0.2236 (w 0.1505 mse 0.1709 t 914 new 0.14) lr 1.00e-05 gnorm 0.122 3.31s mem 81.1GB +[2026-09-12 09:49:24] step 4531/5000 loss 0.2264 (w 0.2144 mse 0.2303 t 988 new 0.18) lr 1.00e-05 gnorm 0.108 2.84s mem 81.1GB +[2026-09-12 09:49:27] step 4532/5000 loss 0.3739 (w 0.2648 mse 0.2736 t 936 new 0.19) lr 1.00e-05 gnorm 0.144 3.16s mem 81.1GB +[2026-09-12 09:49:30] step 4533/5000 loss 0.3278 (w 0.2903 mse 0.3021 t 774 new 0.19) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 09:49:33] step 4534/5000 loss 0.3255 (w 0.2190 mse 0.2360 t 962 new 0.25) lr 1.00e-05 gnorm 0.114 3.15s mem 81.1GB +[2026-09-12 09:49:36] step 4535/5000 loss 0.3677 (w 0.3759 mse 0.3823 t 943 new 0.21) lr 1.00e-05 gnorm 0.120 3.06s mem 81.1GB +[2026-09-12 09:49:40] step 4536/5000 loss 0.2953 (w 0.2544 mse 0.2925 t 356 new 0.25) lr 1.00e-05 gnorm 0.098 3.33s mem 81.1GB +[2026-09-12 09:49:43] step 4537/5000 loss 0.1658 (w 0.3643 mse 0.3743 t 996 new 0.10) lr 1.00e-05 gnorm 0.092 2.83s mem 81.1GB +[2026-09-12 09:49:46] step 4538/5000 loss 0.2448 (w 0.4182 mse 0.4188 t 310 new 0.25) lr 1.00e-05 gnorm 0.113 3.14s mem 81.1GB +[2026-09-12 09:49:49] step 4539/5000 loss 0.3070 (w 0.6804 mse 0.6530 t 988 new 0.28) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +[2026-09-12 09:49:52] step 4540/5000 loss 0.3023 (w 0.3114 mse 0.3070 t 903 new 0.22) lr 1.00e-05 gnorm 0.122 3.20s mem 81.1GB +[2026-09-12 09:49:55] step 4541/5000 loss 0.4554 (w 0.1840 mse 0.1969 t 839 new 0.19) lr 1.00e-05 gnorm 0.128 3.10s mem 81.1GB +[2026-09-12 09:49:58] step 4542/5000 loss 0.2701 (w 0.2186 mse 0.2414 t 741 new 0.16) lr 1.00e-05 gnorm 0.096 3.31s mem 81.1GB +[2026-09-12 09:50:01] step 4543/5000 loss 0.3725 (w 0.2364 mse 0.2352 t 722 new 0.06) lr 1.00e-05 gnorm 0.139 2.85s mem 81.1GB +[2026-09-12 09:50:04] step 4544/5000 loss 0.1837 (w 0.2704 mse 0.2930 t 948 new 0.19) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +[2026-09-12 09:50:08] step 4545/5000 loss 0.1534 (w 0.2625 mse 0.2695 t 918 new 0.23) lr 1.00e-05 gnorm 0.132 3.49s mem 81.1GB +[2026-09-12 09:50:10] step 4546/5000 loss 0.1830 (w 0.2660 mse 0.2709 t 926 new 0.13) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +[2026-09-12 09:50:13] step 4547/5000 loss 0.2486 (w 0.3416 mse 0.3455 t 916 new 0.19) lr 1.00e-05 gnorm 0.199 3.07s mem 81.1GB +[2026-09-12 09:50:17] step 4548/5000 loss 0.2688 (w 0.2730 mse 0.2759 t 976 new 0.25) lr 1.00e-05 gnorm 0.124 3.15s mem 81.1GB +[2026-09-12 09:50:20] step 4549/5000 loss 0.2410 (w 0.2352 mse 0.2463 t 943 new 0.21) lr 1.00e-05 gnorm 0.176 3.05s mem 81.1GB +[2026-09-12 09:50:23] step 4550/5000 loss 0.1231 (w 0.3543 mse 0.3492 t 937 new 0.19) lr 1.00e-05 gnorm 0.089 3.13s mem 81.1GB +[2026-09-12 09:50:26] step 4551/5000 loss 0.3923 (w 0.2187 mse 0.2352 t 612 new 0.22) lr 1.00e-05 gnorm 0.150 3.17s mem 81.1GB +[2026-09-12 09:50:29] step 4552/5000 loss 0.2392 (w 0.1705 mse 0.1809 t 651 new 0.13) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +[2026-09-12 09:50:32] step 4553/5000 loss 0.3478 (w 0.2343 mse 0.2391 t 905 new 0.11) lr 1.00e-05 gnorm 0.165 3.36s mem 81.1GB +[2026-09-12 09:50:35] step 4554/5000 loss 0.3550 (w 0.2591 mse 0.2609 t 768 new 0.23) lr 1.00e-05 gnorm 0.301 3.06s mem 81.1GB +[2026-09-12 09:50:38] step 4555/5000 loss 0.2084 (w 0.3750 mse 0.3808 t 966 new 0.20) lr 1.00e-05 gnorm 0.115 3.16s mem 81.1GB +[2026-09-12 09:50:41] step 4556/5000 loss 0.4145 (w 0.3098 mse 0.3103 t 969 new 0.24) lr 1.00e-05 gnorm 0.133 2.83s mem 81.1GB +[2026-09-12 09:50:44] step 4557/5000 loss 0.2653 (w 0.2776 mse 0.3127 t 171 new 0.16) lr 1.00e-05 gnorm 0.110 3.13s mem 81.1GB +[2026-09-12 09:50:47] step 4558/5000 loss 0.2389 (w 0.2803 mse 0.3025 t 386 new 0.21) lr 1.00e-05 gnorm 0.136 3.05s mem 81.1GB +[2026-09-12 09:50:51] step 4559/5000 loss 0.4346 (w 0.5562 mse 0.5543 t 189 new 0.17) lr 1.00e-05 gnorm 0.109 3.09s mem 81.1GB +[2026-09-12 09:50:54] step 4560/5000 loss 0.2001 (w 0.3939 mse 0.4034 t 992 new 0.21) lr 1.00e-05 gnorm 0.133 3.09s mem 81.1GB +[2026-09-12 09:50:57] step 4561/5000 loss 0.3475 (w 0.2583 mse 0.2586 t 720 new 0.12) lr 1.00e-05 gnorm 0.119 3.14s mem 81.1GB +[2026-09-12 09:51:00] step 4562/5000 loss 0.2964 (w 0.2220 mse 0.2376 t 860 new 0.19) lr 1.00e-05 gnorm 0.099 2.82s mem 81.1GB +[2026-09-12 09:51:03] step 4563/5000 loss 0.2786 (w 0.2117 mse 0.2239 t 826 new 0.13) lr 1.00e-05 gnorm 0.107 3.17s mem 81.1GB +[2026-09-12 09:51:06] step 4564/5000 loss 0.3929 (w 0.3394 mse 0.3451 t 804 new 0.26) lr 1.00e-05 gnorm 0.114 3.04s mem 81.1GB +[2026-09-12 09:51:09] step 4565/5000 loss 0.2367 (w 0.2229 mse 0.2419 t 836 new 0.22) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +[2026-09-12 09:51:12] step 4566/5000 loss 0.2122 (w 0.3408 mse 0.3486 t 962 new 0.19) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +[2026-09-12 09:51:15] step 4567/5000 loss 0.3849 (w 0.2859 mse 0.3005 t 747 new 0.19) lr 1.00e-05 gnorm 0.109 3.12s mem 81.1GB +[2026-09-12 09:51:18] step 4568/5000 loss 0.2683 (w 0.2445 mse 0.2514 t 977 new 0.18) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 09:51:21] step 4569/5000 loss 0.2642 (w 0.2710 mse 0.2756 t 923 new 0.23) lr 1.00e-05 gnorm 0.408 3.14s mem 81.1GB +[2026-09-12 09:51:24] step 4570/5000 loss 0.2914 (w 0.3195 mse 0.3217 t 921 new 0.16) lr 1.00e-05 gnorm 0.104 3.09s mem 81.1GB +[2026-09-12 09:51:27] step 4571/5000 loss 0.1174 (w 0.3373 mse 0.3406 t 995 new 0.23) lr 1.00e-05 gnorm 0.134 3.10s mem 81.1GB +[2026-09-12 09:51:30] step 4572/5000 loss 0.2409 (w 0.2194 mse 0.2288 t 903 new 0.25) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +[2026-09-12 09:51:33] step 4573/5000 loss 0.3136 (w 0.3081 mse 0.3163 t 889 new 0.21) lr 1.00e-05 gnorm 0.177 3.16s mem 81.1GB +[2026-09-12 09:51:36] step 4574/5000 loss 0.3387 (w 0.2879 mse 0.2877 t 875 new 0.19) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +[2026-09-12 09:51:39] step 4575/5000 loss 0.4602 (w 0.3200 mse 0.3230 t 634 new 0.19) lr 1.00e-05 gnorm 0.107 3.16s mem 81.1GB +[2026-09-12 09:51:42] step 4576/5000 loss 0.2848 (w 0.2061 mse 0.2273 t 729 new 0.21) lr 1.00e-05 gnorm 0.114 3.06s mem 81.1GB +[2026-09-12 09:51:46] step 4577/5000 loss 0.3993 (w 0.2576 mse 0.2682 t 750 new 0.23) lr 1.00e-05 gnorm 0.180 3.28s mem 81.1GB +[2026-09-12 09:51:48] step 4578/5000 loss 0.2434 (w 0.3121 mse 0.3142 t 924 new 0.22) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +[2026-09-12 09:51:52] step 4579/5000 loss 0.2307 (w 0.1713 mse 0.1823 t 431 new 0.09) lr 1.00e-05 gnorm 0.128 3.36s mem 81.1GB +[2026-09-12 09:51:55] step 4580/5000 loss 0.1555 (w 0.2971 mse 0.3049 t 911 new 0.13) lr 1.00e-05 gnorm 0.207 3.23s mem 81.1GB +[2026-09-12 09:51:58] step 4581/5000 loss 0.2063 (w 0.2892 mse 0.3015 t 951 new 0.09) lr 1.00e-05 gnorm 0.124 3.06s mem 81.1GB +[2026-09-12 09:52:01] step 4582/5000 loss 0.1997 (w 0.2084 mse 0.2320 t 907 new 0.24) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-12 09:52:04] step 4583/5000 loss 0.3778 (w 0.2688 mse 0.2740 t 825 new 0.23) lr 1.00e-05 gnorm 0.094 3.31s mem 81.1GB +[2026-09-12 09:52:08] step 4584/5000 loss 0.2304 (w 0.3176 mse 0.3243 t 953 new 0.22) lr 1.00e-05 gnorm 0.446 3.70s mem 81.1GB +[2026-09-12 09:52:11] step 4585/5000 loss 0.2063 (w 0.2475 mse 0.2549 t 804 new 0.19) lr 1.00e-05 gnorm 0.120 3.41s mem 81.1GB +[2026-09-12 09:52:15] step 4586/5000 loss 0.3158 (w 0.2405 mse 0.2412 t 726 new 0.20) lr 1.00e-05 gnorm 0.110 3.23s mem 81.1GB +[2026-09-12 09:52:18] step 4587/5000 loss 0.0982 (w 0.3780 mse 0.3777 t 1000 new 0.17) lr 1.00e-05 gnorm 0.185 3.04s mem 81.1GB +[2026-09-12 09:52:20] step 4588/5000 loss 0.2694 (w 0.2582 mse 0.2673 t 511 new 0.10) lr 1.00e-05 gnorm 0.108 2.84s mem 81.1GB +[2026-09-12 09:52:24] step 4589/5000 loss 0.3095 (w 0.3332 mse 0.3426 t 958 new 0.15) lr 1.00e-05 gnorm 0.114 3.14s mem 81.1GB +[2026-09-12 09:52:26] step 4590/5000 loss 0.2203 (w 0.3746 mse 0.3684 t 683 new 0.24) lr 1.00e-05 gnorm 0.297 2.84s mem 81.1GB +[2026-09-12 09:52:30] step 4591/5000 loss 0.2272 (w 0.2738 mse 0.2690 t 802 new 0.18) lr 1.00e-05 gnorm 0.143 3.39s mem 81.1GB +[2026-09-12 09:52:33] step 4592/5000 loss 0.2368 (w 0.2815 mse 0.2775 t 815 new 0.22) lr 1.00e-05 gnorm 0.114 3.23s mem 81.1GB +[2026-09-12 09:52:36] step 4593/5000 loss 0.4763 (w 0.2612 mse 0.2720 t 917 new 0.23) lr 1.00e-05 gnorm 0.145 3.28s mem 81.1GB +[2026-09-12 09:52:39] step 4594/5000 loss 0.3163 (w 0.3166 mse 0.3266 t 568 new 0.24) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +[2026-09-12 09:52:42] step 4595/5000 loss 0.4807 (w 0.2772 mse 0.2962 t 978 new 0.23) lr 1.00e-05 gnorm 0.119 3.16s mem 81.1GB +[2026-09-12 09:52:45] step 4596/5000 loss 0.3819 (w 0.3192 mse 0.3230 t 927 new 0.20) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +[2026-09-12 09:52:49] step 4597/5000 loss 0.1888 (w 0.2205 mse 0.2369 t 948 new 0.19) lr 1.00e-05 gnorm 0.377 3.42s mem 81.1GB +[2026-09-12 09:52:52] step 4598/5000 loss 0.4275 (w 0.4109 mse 0.4117 t 288 new 0.21) lr 1.00e-05 gnorm 0.112 2.85s mem 81.1GB +[2026-09-12 09:52:55] step 4599/5000 loss 0.3463 (w 0.2572 mse 0.2574 t 937 new 0.24) lr 1.00e-05 gnorm 0.131 3.31s mem 81.1GB +[2026-09-12 09:52:58] step 4600/5000 loss 0.3087 (w 0.3259 mse 0.3473 t 998 new 0.24) lr 1.00e-05 gnorm 0.106 3.12s mem 81.1GB +[2026-09-12 09:53:01] step 4601/5000 loss 0.4292 (w 0.3060 mse 0.3082 t 404 new 0.19) lr 1.00e-05 gnorm 0.121 2.84s mem 81.1GB +[2026-09-12 09:53:04] step 4602/5000 loss 0.3961 (w 0.3332 mse 0.3365 t 492 new 0.20) lr 1.00e-05 gnorm 0.094 3.05s mem 81.1GB +[2026-09-12 09:53:07] step 4603/5000 loss 0.1583 (w 0.2661 mse 0.2764 t 955 new 0.20) lr 1.00e-05 gnorm 0.109 3.14s mem 81.1GB +[2026-09-12 09:53:10] step 4604/5000 loss 0.1462 (w 0.2460 mse 0.2475 t 975 new 0.26) lr 1.00e-05 gnorm 0.083 3.16s mem 81.1GB +[2026-09-12 09:53:13] step 4605/5000 loss 0.3376 (w 0.3480 mse 0.3525 t 315 new 0.19) lr 1.00e-05 gnorm 0.104 3.09s mem 81.1GB +[2026-09-12 09:53:17] step 4606/5000 loss 0.2599 (w 0.2358 mse 0.2450 t 942 new 0.26) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +[2026-09-12 09:53:19] step 4607/5000 loss 0.1910 (w 0.2457 mse 0.2625 t 778 new 0.21) lr 1.00e-05 gnorm 0.260 2.83s mem 81.1GB +[2026-09-12 09:53:22] step 4608/5000 loss 0.2126 (w 0.1700 mse 0.1795 t 715 new 0.07) lr 1.00e-05 gnorm 0.097 3.09s mem 81.1GB +[2026-09-12 09:53:26] step 4609/5000 loss 0.1490 (w 0.2333 mse 0.2525 t 941 new 0.19) lr 1.00e-05 gnorm 0.138 3.14s mem 81.1GB +[2026-09-12 09:53:29] step 4610/5000 loss 0.2334 (w 0.2810 mse 0.2994 t 979 new 0.18) lr 1.00e-05 gnorm 0.192 3.17s mem 81.1GB +[2026-09-12 09:53:32] step 4611/5000 loss 0.3381 (w 0.3099 mse 0.3127 t 537 new 0.15) lr 1.00e-05 gnorm 0.109 3.07s mem 81.1GB +[2026-09-12 09:53:35] step 4612/5000 loss 0.2324 (w 0.2172 mse 0.2322 t 720 new 0.15) lr 1.00e-05 gnorm 0.113 3.09s mem 81.1GB +[2026-09-12 09:53:38] step 4613/5000 loss 0.2903 (w 0.3347 mse 0.3347 t 909 new 0.16) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +[2026-09-12 09:53:41] step 4614/5000 loss 0.2388 (w 0.2233 mse 0.2389 t 599 new 0.23) lr 1.00e-05 gnorm 0.112 3.12s mem 81.1GB +[2026-09-12 09:53:44] step 4615/5000 loss 0.2463 (w 0.2905 mse 0.2838 t 948 new 0.18) lr 1.00e-05 gnorm 0.122 3.12s mem 81.1GB +[2026-09-12 09:53:47] step 4616/5000 loss 0.2804 (w 0.3837 mse 0.4041 t 189 new 0.17) lr 1.00e-05 gnorm 0.112 3.30s mem 81.1GB +[2026-09-12 09:53:50] step 4617/5000 loss 0.2229 (w 0.3142 mse 0.3205 t 544 new 0.22) lr 1.00e-05 gnorm 0.569 3.08s mem 81.1GB +[2026-09-12 09:53:54] step 4618/5000 loss 0.3335 (w 0.2267 mse 0.2455 t 952 new 0.24) lr 1.00e-05 gnorm 0.107 3.51s mem 81.1GB +[2026-09-12 09:53:57] step 4619/5000 loss 0.3787 (w 0.2780 mse 0.2898 t 596 new 0.20) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-12 09:54:00] step 4620/5000 loss 0.2974 (w 0.2242 mse 0.2247 t 839 new 0.25) lr 1.00e-05 gnorm 0.235 3.05s mem 81.1GB +[2026-09-12 09:54:03] step 4621/5000 loss 0.3888 (w 0.2187 mse 0.2315 t 836 new 0.24) lr 1.00e-05 gnorm 0.193 3.15s mem 81.1GB +[2026-09-12 09:54:06] step 4622/5000 loss 0.2220 (w 0.3494 mse 0.3521 t 827 new 0.17) lr 1.00e-05 gnorm 0.131 3.38s mem 81.1GB +[2026-09-12 09:54:09] step 4623/5000 loss 0.4601 (w 0.3054 mse 0.2989 t 809 new 0.13) lr 1.00e-05 gnorm 0.127 3.07s mem 81.1GB +[2026-09-12 09:54:13] step 4624/5000 loss 0.3217 (w 0.3394 mse 0.3340 t 909 new 0.15) lr 1.00e-05 gnorm 0.154 3.16s mem 81.1GB +[2026-09-12 09:54:15] step 4625/5000 loss 0.1824 (w 0.2797 mse 0.2902 t 992 new 0.25) lr 1.00e-05 gnorm 0.091 2.83s mem 81.1GB +[2026-09-12 09:54:19] step 4626/5000 loss 0.3815 (w 0.1894 mse 0.1992 t 838 new 0.20) lr 1.00e-05 gnorm 0.121 3.09s mem 81.1GB +[2026-09-12 09:54:22] step 4627/5000 loss 0.3368 (w 0.3643 mse 0.3702 t 999 new 0.24) lr 1.00e-05 gnorm 0.123 3.12s mem 81.1GB +[2026-09-12 09:54:25] step 4628/5000 loss 0.3761 (w 0.3608 mse 0.3485 t 957 new 0.20) lr 1.00e-05 gnorm 0.230 3.20s mem 81.1GB +[2026-09-12 09:54:28] step 4629/5000 loss 0.3712 (w 0.2910 mse 0.2917 t 769 new 0.25) lr 1.00e-05 gnorm 0.119 3.07s mem 81.1GB +[2026-09-12 09:54:31] step 4630/5000 loss 0.2616 (w 0.3223 mse 0.3226 t 693 new 0.16) lr 1.00e-05 gnorm 0.143 3.43s mem 81.1GB +[2026-09-12 09:54:35] step 4631/5000 loss 0.2354 (w 0.2817 mse 0.2999 t 990 new 0.20) lr 1.00e-05 gnorm 0.155 3.14s mem 81.1GB +[2026-09-12 09:54:37] step 4632/5000 loss 0.2457 (w 0.3427 mse 0.3366 t 920 new 0.22) lr 1.00e-05 gnorm 0.198 2.84s mem 81.1GB +[2026-09-12 09:54:41] step 4633/5000 loss 0.2875 (w 0.3154 mse 0.3179 t 975 new 0.27) lr 1.00e-05 gnorm 0.114 3.17s mem 81.1GB +[2026-09-12 09:54:44] step 4634/5000 loss 0.4407 (w 0.1979 mse 0.2187 t 748 new 0.26) lr 1.00e-05 gnorm 0.193 3.28s mem 81.1GB +[2026-09-12 09:54:47] step 4635/5000 loss 0.1351 (w 0.2293 mse 0.2404 t 940 new 0.24) lr 1.00e-05 gnorm 0.101 2.84s mem 81.1GB +[2026-09-12 09:54:50] step 4636/5000 loss 0.2724 (w 0.2672 mse 0.2664 t 886 new 0.22) lr 1.00e-05 gnorm 0.231 3.11s mem 81.1GB +[2026-09-12 09:54:53] step 4637/5000 loss 0.3334 (w 0.3283 mse 0.3363 t 950 new 0.20) lr 1.00e-05 gnorm 0.151 3.06s mem 81.1GB +[2026-09-12 09:54:56] step 4638/5000 loss 0.1977 (w 0.1826 mse 0.1951 t 614 new 0.09) lr 1.00e-05 gnorm 0.098 2.84s mem 81.1GB +[2026-09-12 09:54:59] step 4639/5000 loss 0.2654 (w 0.3005 mse 0.3041 t 732 new 0.19) lr 1.00e-05 gnorm 0.107 3.10s mem 81.1GB +[2026-09-12 09:55:02] step 4640/5000 loss 0.2823 (w 0.3697 mse 0.3669 t 997 new 0.17) lr 1.00e-05 gnorm 0.148 3.33s mem 81.1GB +[2026-09-12 09:55:05] step 4641/5000 loss 0.3245 (w 0.3657 mse 0.3670 t 989 new 0.01) lr 1.00e-05 gnorm 0.148 2.83s mem 81.1GB +[2026-09-12 09:55:08] step 4642/5000 loss 0.2014 (w 0.3136 mse 0.3143 t 932 new 0.22) lr 1.00e-05 gnorm 0.188 3.10s mem 81.1GB +[2026-09-12 09:55:11] step 4643/5000 loss 0.0867 (w 0.2238 mse 0.2366 t 979 new 0.22) lr 1.00e-05 gnorm 0.227 3.11s mem 81.1GB +[2026-09-12 09:55:14] step 4644/5000 loss 0.2088 (w 0.2355 mse 0.2509 t 657 new 0.22) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +[2026-09-12 09:55:17] step 4645/5000 loss 0.2882 (w 0.2403 mse 0.2483 t 935 new 0.17) lr 1.00e-05 gnorm 0.104 3.14s mem 81.1GB +[2026-09-12 09:55:20] step 4646/5000 loss 0.3333 (w 0.3531 mse 0.3566 t 960 new 0.20) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-12 09:55:23] step 4647/5000 loss 0.3506 (w 0.2195 mse 0.2354 t 775 new 0.18) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +[2026-09-12 09:55:26] step 4648/5000 loss 0.2852 (w 0.3173 mse 0.3357 t 978 new 0.21) lr 1.00e-05 gnorm 0.156 3.10s mem 81.1GB +[2026-09-12 09:55:29] step 4649/5000 loss 0.3639 (w 0.3708 mse 0.3727 t 506 new 0.23) lr 1.00e-05 gnorm 0.105 3.15s mem 81.1GB +[2026-09-12 09:55:32] step 4650/5000 loss 0.3003 (w 0.3091 mse 0.3060 t 810 new 0.19) lr 1.00e-05 gnorm 0.166 2.83s mem 81.1GB +[2026-09-12 09:55:36] step 4651/5000 loss 0.2888 (w 0.2017 mse 0.2109 t 868 new 0.20) lr 1.00e-05 gnorm 0.201 3.41s mem 81.1GB +[2026-09-12 09:55:39] step 4652/5000 loss 0.2724 (w 0.1942 mse 0.2084 t 580 new 0.16) lr 1.00e-05 gnorm 0.114 3.02s mem 81.1GB +[2026-09-12 09:55:42] step 4653/5000 loss 0.5017 (w 0.3253 mse 0.3266 t 712 new 0.12) lr 1.00e-05 gnorm 0.270 3.08s mem 81.1GB +[2026-09-12 09:55:45] step 4654/5000 loss 0.2759 (w 0.4368 mse 0.4496 t 996 new 0.26) lr 1.00e-05 gnorm 0.108 3.09s mem 81.1GB +[2026-09-12 09:55:48] step 4655/5000 loss 0.1930 (w 0.3705 mse 0.3762 t 962 new 0.16) lr 1.00e-05 gnorm 0.094 3.05s mem 81.1GB +[2026-09-12 09:55:51] step 4656/5000 loss 0.2939 (w 0.3175 mse 0.3221 t 623 new 0.25) lr 1.00e-05 gnorm 0.149 2.82s mem 81.1GB +[2026-09-12 09:55:54] step 4657/5000 loss 0.2428 (w 0.1693 mse 0.2027 t 925 new 0.26) lr 1.00e-05 gnorm 0.113 3.32s mem 81.1GB +[2026-09-12 09:55:57] step 4658/5000 loss 0.3283 (w 0.2877 mse 0.2924 t 792 new 0.22) lr 1.00e-05 gnorm 0.108 3.04s mem 81.1GB +[2026-09-12 09:56:00] step 4659/5000 loss 0.2117 (w 0.2683 mse 0.2908 t 328 new 0.23) lr 1.00e-05 gnorm 0.131 3.09s mem 81.1GB +[2026-09-12 09:56:03] step 4660/5000 loss 0.4318 (w 0.6485 mse 0.6551 t 114 new 0.19) lr 1.00e-05 gnorm 0.254 3.03s mem 81.1GB +[2026-09-12 09:56:07] step 4661/5000 loss 0.3329 (w 0.2543 mse 0.2622 t 951 new 0.17) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +[2026-09-12 09:56:10] step 4662/5000 loss 0.1986 (w 0.4747 mse 0.4547 t 978 new 0.19) lr 1.00e-05 gnorm 0.174 3.13s mem 81.1GB +[2026-09-12 09:56:13] step 4663/5000 loss 0.3272 (w 0.2143 mse 0.2379 t 861 new 0.24) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +[2026-09-12 09:56:16] step 4664/5000 loss 0.2819 (w 0.3142 mse 0.3280 t 999 new 0.25) lr 1.00e-05 gnorm 0.165 3.02s mem 81.1GB +[2026-09-12 09:56:19] step 4665/5000 loss 0.2409 (w 0.3008 mse 0.3191 t 990 new 0.15) lr 1.00e-05 gnorm 0.111 3.14s mem 81.1GB +[2026-09-12 09:56:22] step 4666/5000 loss 0.1474 (w 0.1615 mse 0.1895 t 890 new 0.23) lr 1.00e-05 gnorm 0.132 3.10s mem 81.1GB +[2026-09-12 09:56:25] step 4667/5000 loss 0.2668 (w 0.3017 mse 0.3080 t 975 new 0.19) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +[2026-09-12 09:56:28] step 4668/5000 loss 0.2884 (w 0.3734 mse 0.3861 t 323 new 0.20) lr 1.00e-05 gnorm 0.130 3.16s mem 81.1GB +[2026-09-12 09:56:31] step 4669/5000 loss 0.2231 (w 0.3043 mse 0.2880 t 987 new 0.23) lr 1.00e-05 gnorm 0.111 3.05s mem 81.1GB +[2026-09-12 09:56:34] step 4670/5000 loss 0.1999 (w 0.1920 mse 0.1920 t 829 new 0.00) lr 1.00e-05 gnorm 0.115 3.05s mem 81.1GB +[2026-09-12 09:56:38] step 4671/5000 loss 0.3833 (w 0.2767 mse 0.2702 t 626 new 0.21) lr 1.00e-05 gnorm 0.290 3.28s mem 81.1GB +[2026-09-12 09:56:41] step 4672/5000 loss 0.3767 (w 0.3252 mse 0.3288 t 982 new 0.13) lr 1.00e-05 gnorm 0.134 3.07s mem 81.1GB +[2026-09-12 09:56:43] step 4673/5000 loss 0.1729 (w 0.2779 mse 0.2887 t 821 new 0.22) lr 1.00e-05 gnorm 0.155 2.83s mem 81.1GB +[2026-09-12 09:56:47] step 4674/5000 loss 0.4107 (w 0.2281 mse 0.2298 t 624 new 0.19) lr 1.00e-05 gnorm 0.146 3.61s mem 81.1GB +[2026-09-12 09:56:50] step 4675/5000 loss 0.3231 (w 0.4235 mse 0.4122 t 968 new 0.21) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +[2026-09-12 09:56:53] step 4676/5000 loss 0.2279 (w 0.3883 mse 0.3721 t 987 new 0.25) lr 1.00e-05 gnorm 1.013 3.09s mem 81.1GB +[2026-09-12 09:56:56] step 4677/5000 loss 0.1894 (w 0.3521 mse 0.3566 t 989 new 0.22) lr 1.00e-05 gnorm 0.124 3.36s mem 81.1GB +[2026-09-12 09:57:00] step 4678/5000 loss 0.2703 (w 0.2407 mse 0.2451 t 947 new 0.17) lr 1.00e-05 gnorm 0.241 3.12s mem 81.1GB +[2026-09-12 09:57:02] step 4679/5000 loss 0.2840 (w 0.1882 mse 0.2026 t 835 new 0.23) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +[2026-09-12 09:57:06] step 4680/5000 loss 0.2505 (w 0.2334 mse 0.2508 t 528 new 0.24) lr 1.00e-05 gnorm 0.108 3.48s mem 81.1GB +[2026-09-12 09:57:09] step 4681/5000 loss 0.2417 (w 0.1728 mse 0.1879 t 907 new 0.12) lr 1.00e-05 gnorm 0.119 3.06s mem 81.1GB +[2026-09-12 09:57:12] step 4682/5000 loss 0.4301 (w 0.3134 mse 0.3303 t 981 new 0.22) lr 1.00e-05 gnorm 0.118 3.07s mem 81.1GB +[2026-09-12 09:57:15] step 4683/5000 loss 0.4179 (w 0.2663 mse 0.2639 t 786 new 0.25) lr 1.00e-05 gnorm 0.085 3.10s mem 81.1GB +[2026-09-12 09:57:18] step 4684/5000 loss 0.1853 (w 0.3127 mse 0.3214 t 999 new 0.14) lr 1.00e-05 gnorm 0.129 3.16s mem 81.1GB +[2026-09-12 09:57:21] step 4685/5000 loss 0.1015 (w 0.2387 mse 0.2668 t 997 new 0.21) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +[2026-09-12 09:57:25] step 4686/5000 loss 0.3184 (w 0.1755 mse 0.1942 t 797 new 0.25) lr 1.00e-05 gnorm 0.155 3.43s mem 81.1GB +[2026-09-12 09:57:28] step 4687/5000 loss 0.2316 (w 0.2582 mse 0.2617 t 884 new 0.24) lr 1.00e-05 gnorm 0.101 3.05s mem 81.1GB +[2026-09-12 09:57:31] step 4688/5000 loss 0.1897 (w 0.2326 mse 0.2462 t 880 new 0.22) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-12 09:57:34] step 4689/5000 loss 0.2445 (w 0.2944 mse 0.3127 t 984 new 0.23) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +[2026-09-12 09:57:37] step 4690/5000 loss 0.3307 (w 0.3361 mse 0.3430 t 535 new 0.23) lr 1.00e-05 gnorm 0.622 3.06s mem 81.1GB +[2026-09-12 09:57:40] step 4691/5000 loss 0.3619 (w 0.3420 mse 0.3325 t 928 new 0.19) lr 1.00e-05 gnorm 0.119 3.13s mem 81.1GB +[2026-09-12 09:57:43] step 4692/5000 loss 0.2486 (w 0.2532 mse 0.2599 t 973 new 0.09) lr 1.00e-05 gnorm 0.120 3.38s mem 81.1GB +[2026-09-12 09:57:46] step 4693/5000 loss 0.2031 (w 0.2148 mse 0.2286 t 956 new 0.22) lr 1.00e-05 gnorm 0.122 3.12s mem 81.1GB +[2026-09-12 09:57:50] step 4694/5000 loss 0.5091 (w 0.2490 mse 0.2576 t 811 new 0.23) lr 1.00e-05 gnorm 0.166 3.09s mem 81.1GB +[2026-09-12 09:57:53] step 4695/5000 loss 0.3071 (w 0.3585 mse 0.3707 t 813 new 0.25) lr 1.00e-05 gnorm 0.136 3.08s mem 81.1GB +[2026-09-12 09:57:56] step 4696/5000 loss 0.3574 (w 0.2872 mse 0.2845 t 923 new 0.18) lr 1.00e-05 gnorm 0.167 3.09s mem 81.1GB +[2026-09-12 09:57:59] step 4697/5000 loss 0.3025 (w 0.2352 mse 0.2487 t 859 new 0.20) lr 1.00e-05 gnorm 0.114 3.13s mem 81.1GB +[2026-09-12 09:58:02] step 4698/5000 loss 0.1250 (w 0.2092 mse 0.2303 t 973 new 0.16) lr 1.00e-05 gnorm 0.104 3.12s mem 81.1GB +[2026-09-12 09:58:05] step 4699/5000 loss 0.2184 (w 0.3705 mse 0.3769 t 949 new 0.20) lr 1.00e-05 gnorm 0.107 3.13s mem 81.1GB +[2026-09-12 09:58:08] step 4700/5000 loss 0.2989 (w 0.2350 mse 0.2673 t 996 new 0.24) lr 1.00e-05 gnorm 0.120 3.23s mem 81.1GB +[2026-09-12 09:58:11] step 4701/5000 loss 0.2936 (w 0.3673 mse 0.3847 t 244 new 0.15) lr 1.00e-05 gnorm 0.135 3.05s mem 81.1GB +[2026-09-12 09:58:14] step 4702/5000 loss 0.3946 (w 0.3358 mse 0.3416 t 525 new 0.20) lr 1.00e-05 gnorm 0.137 2.83s mem 81.1GB +[2026-09-12 09:58:17] step 4703/5000 loss 0.1054 (w 0.2076 mse 0.2224 t 843 new 0.27) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-12 09:58:21] step 4704/5000 loss 0.3959 (w 0.4574 mse 0.4863 t 171 new 0.24) lr 1.00e-05 gnorm 0.108 3.40s mem 81.1GB +[2026-09-12 09:58:24] step 4705/5000 loss 0.3665 (w 0.3153 mse 0.3240 t 840 new 0.22) lr 1.00e-05 gnorm 0.134 3.13s mem 81.1GB +[2026-09-12 09:58:27] step 4706/5000 loss 0.3423 (w 0.2552 mse 0.2664 t 807 new 0.21) lr 1.00e-05 gnorm 0.113 3.30s mem 81.1GB +[2026-09-12 09:58:30] step 4707/5000 loss 0.3100 (w 0.3280 mse 0.3305 t 470 new 0.23) lr 1.00e-05 gnorm 0.100 3.05s mem 81.1GB +[2026-09-12 09:58:33] step 4708/5000 loss 0.1895 (w 0.2244 mse 0.2379 t 966 new 0.23) lr 1.00e-05 gnorm 0.278 2.84s mem 81.1GB +[2026-09-12 09:58:36] step 4709/5000 loss 0.4045 (w 0.3693 mse 0.3736 t 511 new 0.17) lr 1.00e-05 gnorm 0.190 3.13s mem 81.1GB +[2026-09-12 09:58:39] step 4710/5000 loss 0.2681 (w 0.3280 mse 0.3146 t 875 new 0.19) lr 1.00e-05 gnorm 0.116 3.12s mem 81.1GB +[2026-09-12 09:58:43] step 4711/5000 loss 0.3445 (w 0.2391 mse 0.2394 t 949 new 0.23) lr 1.00e-05 gnorm 0.105 3.32s mem 81.1GB +[2026-09-12 09:58:46] step 4712/5000 loss 0.2939 (w 0.2757 mse 0.2800 t 688 new 0.08) lr 1.00e-05 gnorm 0.112 3.06s mem 81.1GB +[2026-09-12 09:58:49] step 4713/5000 loss 0.2328 (w 0.2773 mse 0.2838 t 873 new 0.20) lr 1.00e-05 gnorm 0.195 3.07s mem 81.1GB +[2026-09-12 09:58:52] step 4714/5000 loss 0.1989 (w 0.2398 mse 0.2508 t 742 new 0.24) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-12 09:58:55] step 4715/5000 loss 0.3288 (w 0.2428 mse 0.2502 t 990 new 0.21) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +[2026-09-12 09:58:58] step 4716/5000 loss 0.2311 (w 0.2078 mse 0.2234 t 868 new 0.27) lr 1.00e-05 gnorm 0.126 3.12s mem 81.1GB +[2026-09-12 09:59:01] step 4717/5000 loss 0.2647 (w 0.2816 mse 0.2849 t 869 new 0.17) lr 1.00e-05 gnorm 0.125 3.35s mem 81.1GB +[2026-09-12 09:59:04] step 4718/5000 loss 0.2867 (w 0.4606 mse 0.4389 t 997 new 0.19) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-12 09:59:07] step 4719/5000 loss 0.3610 (w 0.2889 mse 0.2871 t 673 new 0.22) lr 1.00e-05 gnorm 0.121 3.14s mem 81.1GB +[2026-09-12 09:59:10] step 4720/5000 loss 0.3855 (w 0.1922 mse 0.2075 t 607 new 0.12) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +[2026-09-12 09:59:14] step 4721/5000 loss 0.3247 (w 0.3624 mse 0.3468 t 946 new 0.15) lr 1.00e-05 gnorm 0.110 3.30s mem 81.1GB +[2026-09-12 09:59:17] step 4722/5000 loss 0.2881 (w 0.3416 mse 0.3390 t 972 new 0.25) lr 1.00e-05 gnorm 0.155 3.32s mem 81.1GB +[2026-09-12 09:59:20] step 4723/5000 loss 0.2279 (w 0.2618 mse 0.2684 t 898 new 0.12) lr 1.00e-05 gnorm 0.173 3.13s mem 81.1GB +[2026-09-12 09:59:23] step 4724/5000 loss 0.3555 (w 0.1662 mse 0.1878 t 785 new 0.23) lr 1.00e-05 gnorm 0.239 3.08s mem 81.1GB +[2026-09-12 09:59:26] step 4725/5000 loss 0.2531 (w 0.2680 mse 0.2769 t 940 new 0.21) lr 1.00e-05 gnorm 0.143 3.13s mem 81.1GB +[2026-09-12 09:59:29] step 4726/5000 loss 0.2645 (w 0.2879 mse 0.3022 t 444 new 0.16) lr 1.00e-05 gnorm 0.202 3.09s mem 81.1GB +[2026-09-12 09:59:32] step 4727/5000 loss 0.2292 (w 0.1832 mse 0.2187 t 988 new 0.22) lr 1.00e-05 gnorm 0.160 3.03s mem 81.1GB +[2026-09-12 09:59:36] step 4728/5000 loss 0.2966 (w 0.2369 mse 0.2441 t 609 new 0.23) lr 1.00e-05 gnorm 0.192 3.32s mem 81.1GB +[2026-09-12 09:59:39] step 4729/5000 loss 0.2558 (w 0.2835 mse 0.2875 t 994 new 0.16) lr 1.00e-05 gnorm 0.303 3.10s mem 81.1GB +[2026-09-12 09:59:42] step 4730/5000 loss 0.4428 (w 0.3169 mse 0.3169 t 336 new 0.00) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +[2026-09-12 09:59:45] step 4731/5000 loss 0.3501 (w 0.2950 mse 0.3295 t 328 new 0.17) lr 1.00e-05 gnorm 0.124 3.07s mem 81.1GB +[2026-09-12 09:59:48] step 4732/5000 loss 0.1683 (w 0.2406 mse 0.2658 t 966 new 0.16) lr 1.00e-05 gnorm 0.522 3.11s mem 81.1GB +[2026-09-12 09:59:51] step 4733/5000 loss 0.2336 (w 0.4180 mse 0.3977 t 989 new 0.23) lr 1.00e-05 gnorm 0.097 3.04s mem 81.1GB +[2026-09-12 09:59:54] step 4734/5000 loss 0.1887 (w 0.2432 mse 0.2480 t 946 new 0.08) lr 1.00e-05 gnorm 0.123 3.33s mem 81.1GB +[2026-09-12 09:59:58] step 4735/5000 loss 0.2290 (w 0.2612 mse 0.2743 t 995 new 0.20) lr 1.00e-05 gnorm 0.235 3.38s mem 81.1GB +[2026-09-12 10:00:00] step 4736/5000 loss 0.3895 (w 0.3129 mse 0.3418 t 959 new 0.25) lr 1.00e-05 gnorm 0.110 2.83s mem 81.1GB +[2026-09-12 10:00:04] step 4737/5000 loss 0.2246 (w 0.3067 mse 0.3181 t 921 new 0.24) lr 1.00e-05 gnorm 0.113 3.14s mem 81.1GB +[2026-09-12 10:00:07] step 4738/5000 loss 0.2629 (w 0.2719 mse 0.2770 t 940 new 0.15) lr 1.00e-05 gnorm 0.095 3.29s mem 81.1GB +[2026-09-12 10:00:10] step 4739/5000 loss 0.2589 (w 0.3546 mse 0.3576 t 921 new 0.29) lr 1.00e-05 gnorm 0.136 3.06s mem 81.1GB +[2026-09-12 10:00:13] step 4740/5000 loss 0.2615 (w 0.2117 mse 0.2323 t 834 new 0.19) lr 1.00e-05 gnorm 0.119 3.35s mem 81.1GB +[2026-09-12 10:00:17] step 4741/5000 loss 0.1620 (w 0.3823 mse 0.3802 t 995 new 0.23) lr 1.00e-05 gnorm 0.140 3.32s mem 81.1GB +[2026-09-12 10:00:19] step 4742/5000 loss 0.2738 (w 0.3342 mse 0.3423 t 975 new 0.22) lr 1.00e-05 gnorm 0.513 2.82s mem 81.1GB +[2026-09-12 10:00:23] step 4743/5000 loss 0.2266 (w 0.4224 mse 0.4169 t 974 new 0.23) lr 1.00e-05 gnorm 0.117 3.14s mem 81.1GB +[2026-09-12 10:00:26] step 4744/5000 loss 0.2448 (w 0.3306 mse 0.3318 t 551 new 0.21) lr 1.00e-05 gnorm 0.207 3.13s mem 81.1GB +[2026-09-12 10:00:29] step 4745/5000 loss 0.2469 (w 0.2926 mse 0.2967 t 955 new 0.26) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +[2026-09-12 10:00:32] step 4746/5000 loss 0.2461 (w 0.2991 mse 0.3004 t 599 new 0.23) lr 1.00e-05 gnorm 0.145 3.06s mem 81.1GB +[2026-09-12 10:00:35] step 4747/5000 loss 0.2413 (w 0.2747 mse 0.2781 t 937 new 0.20) lr 1.00e-05 gnorm 0.148 3.11s mem 81.1GB +[2026-09-12 10:00:38] step 4748/5000 loss 0.4377 (w 0.5341 mse 0.5576 t 200 new 0.20) lr 1.00e-05 gnorm 0.149 3.04s mem 81.1GB +[2026-09-12 10:00:41] step 4749/5000 loss 0.3480 (w 0.2426 mse 0.2572 t 962 new 0.22) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +[2026-09-12 10:00:44] step 4750/5000 loss 0.2596 (w 0.1964 mse 0.2115 t 720 new 0.20) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-12 10:00:47] step 4751/5000 loss 0.3009 (w 0.2541 mse 0.2533 t 754 new 0.12) lr 1.00e-05 gnorm 0.212 3.11s mem 81.1GB +[2026-09-12 10:00:50] step 4752/5000 loss 0.3232 (w 0.2839 mse 0.2870 t 582 new 0.13) lr 1.00e-05 gnorm 0.153 3.28s mem 81.1GB +[2026-09-12 10:00:54] step 4753/5000 loss 0.4680 (w 0.3470 mse 0.3565 t 747 new 0.23) lr 1.00e-05 gnorm 0.138 3.30s mem 81.1GB +[2026-09-12 10:00:57] step 4754/5000 loss 0.2520 (w 0.2063 mse 0.2176 t 869 new 0.15) lr 1.00e-05 gnorm 0.264 3.07s mem 81.1GB +[2026-09-12 10:01:00] step 4755/5000 loss 0.1551 (w 0.3407 mse 0.3419 t 956 new 0.16) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +[2026-09-12 10:01:03] step 4756/5000 loss 0.3290 (w 0.2858 mse 0.2852 t 846 new 0.24) lr 1.00e-05 gnorm 0.133 3.15s mem 81.1GB +[2026-09-12 10:01:06] step 4757/5000 loss 0.2747 (w 0.2670 mse 0.2737 t 977 new 0.13) lr 1.00e-05 gnorm 0.119 3.22s mem 81.1GB +[2026-09-12 10:01:09] step 4758/5000 loss 0.3155 (w 0.2798 mse 0.2838 t 962 new 0.18) lr 1.00e-05 gnorm 0.124 3.28s mem 81.1GB +[2026-09-12 10:01:12] step 4759/5000 loss 0.2976 (w 0.2976 mse 0.3000 t 892 new 0.21) lr 1.00e-05 gnorm 0.113 3.08s mem 81.1GB +[2026-09-12 10:01:15] step 4760/5000 loss 0.2974 (w 0.3206 mse 0.3208 t 953 new 0.21) lr 1.00e-05 gnorm 0.149 3.06s mem 81.1GB +[2026-09-12 10:01:18] step 4761/5000 loss 0.3101 (w 0.1788 mse 0.1873 t 885 new 0.11) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +[2026-09-12 10:01:21] step 4762/5000 loss 0.1401 (w 0.2209 mse 0.2332 t 798 new 0.23) lr 1.00e-05 gnorm 0.103 2.83s mem 81.1GB +[2026-09-12 10:01:25] step 4763/5000 loss 0.3319 (w 0.3414 mse 0.3371 t 779 new 0.18) lr 1.00e-05 gnorm 0.154 3.27s mem 81.1GB +[2026-09-12 10:01:28] step 4764/5000 loss 0.1977 (w 0.3691 mse 0.3679 t 980 new 0.18) lr 1.00e-05 gnorm 0.171 3.06s mem 81.1GB +[2026-09-12 10:01:31] step 4765/5000 loss 0.3139 (w 0.1884 mse 0.2040 t 824 new 0.22) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +[2026-09-12 10:01:34] step 4766/5000 loss 0.3245 (w 0.2533 mse 0.2668 t 851 new 0.21) lr 1.00e-05 gnorm 0.095 3.12s mem 81.1GB +[2026-09-12 10:01:37] step 4767/5000 loss 0.2712 (w 0.2935 mse 0.3083 t 998 new 0.20) lr 1.00e-05 gnorm 0.121 3.13s mem 81.1GB +[2026-09-12 10:01:40] step 4768/5000 loss 0.2913 (w 0.1841 mse 0.2012 t 861 new 0.20) lr 1.00e-05 gnorm 0.098 2.84s mem 81.1GB +[2026-09-12 10:01:43] step 4769/5000 loss 0.3432 (w 0.2505 mse 0.2647 t 917 new 0.23) lr 1.00e-05 gnorm 0.168 3.08s mem 81.1GB +[2026-09-12 10:01:46] step 4770/5000 loss 0.1080 (w 0.2524 mse 0.2563 t 918 new 0.24) lr 1.00e-05 gnorm 0.092 3.10s mem 81.1GB +[2026-09-12 10:01:49] step 4771/5000 loss 0.2697 (w 0.2477 mse 0.2511 t 926 new 0.13) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +[2026-09-12 10:01:52] step 4772/5000 loss 0.4174 (w 0.2832 mse 0.2973 t 479 new 0.23) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +[2026-09-12 10:01:55] step 4773/5000 loss 0.3705 (w 0.2207 mse 0.2341 t 918 new 0.17) lr 1.00e-05 gnorm 0.099 3.13s mem 81.1GB +[2026-09-12 10:01:58] step 4774/5000 loss 0.2615 (w 0.3263 mse 0.3264 t 937 new 0.21) lr 1.00e-05 gnorm 0.382 3.01s mem 81.1GB +[2026-09-12 10:02:02] step 4775/5000 loss 0.4174 (w 0.2560 mse 0.2630 t 835 new 0.21) lr 1.00e-05 gnorm 0.119 3.28s mem 81.1GB +[2026-09-12 10:02:05] step 4776/5000 loss 0.4099 (w 0.2710 mse 0.2647 t 601 new 0.22) lr 1.00e-05 gnorm 0.168 3.33s mem 81.1GB +[2026-09-12 10:02:08] step 4777/5000 loss 0.1608 (w 0.3727 mse 0.3745 t 974 new 0.20) lr 1.00e-05 gnorm 0.168 3.07s mem 81.1GB +[2026-09-12 10:02:11] step 4778/5000 loss 0.2772 (w 0.2261 mse 0.2360 t 945 new 0.12) lr 1.00e-05 gnorm 0.123 2.83s mem 81.1GB +[2026-09-12 10:02:14] step 4779/5000 loss 0.1361 (w 0.3579 mse 0.3502 t 971 new 0.20) lr 1.00e-05 gnorm 0.096 3.09s mem 81.1GB +[2026-09-12 10:02:17] step 4780/5000 loss 0.3534 (w 0.2530 mse 0.2579 t 830 new 0.13) lr 1.00e-05 gnorm 0.155 3.04s mem 81.1GB +[2026-09-12 10:02:20] step 4781/5000 loss 0.2150 (w 0.1968 mse 0.2011 t 887 new 0.23) lr 1.00e-05 gnorm 0.086 3.07s mem 81.1GB +[2026-09-12 10:02:23] step 4782/5000 loss 0.2729 (w 0.2551 mse 0.2506 t 808 new 0.11) lr 1.00e-05 gnorm 0.164 3.31s mem 81.1GB +[2026-09-12 10:02:27] step 4783/5000 loss 0.2736 (w 0.2662 mse 0.2882 t 459 new 0.26) lr 1.00e-05 gnorm 0.175 3.09s mem 81.1GB +[2026-09-12 10:02:29] step 4784/5000 loss 0.3801 (w 0.4098 mse 0.4180 t 992 new 0.20) lr 1.00e-05 gnorm 0.164 2.82s mem 81.1GB +[2026-09-12 10:02:33] step 4785/5000 loss 0.4225 (w 0.2806 mse 0.2878 t 637 new 0.14) lr 1.00e-05 gnorm 0.175 3.13s mem 81.1GB +[2026-09-12 10:02:36] step 4786/5000 loss 0.4161 (w 0.2953 mse 0.3121 t 431 new 0.25) lr 1.00e-05 gnorm 0.120 3.01s mem 81.1GB +[2026-09-12 10:02:39] step 4787/5000 loss 0.2897 (w 0.2651 mse 0.2721 t 580 new 0.23) lr 1.00e-05 gnorm 0.125 3.32s mem 81.1GB +[2026-09-12 10:02:42] step 4788/5000 loss 0.2320 (w 0.2371 mse 0.2447 t 578 new 0.18) lr 1.00e-05 gnorm 0.237 3.10s mem 81.1GB +[2026-09-12 10:02:45] step 4789/5000 loss 0.1912 (w 0.3124 mse 0.3142 t 467 new 0.27) lr 1.00e-05 gnorm 0.133 3.08s mem 81.1GB +[2026-09-12 10:02:48] step 4790/5000 loss 0.4581 (w 0.1744 mse 0.1915 t 752 new 0.17) lr 1.00e-05 gnorm 0.122 3.11s mem 81.1GB +[2026-09-12 10:02:51] step 4791/5000 loss 0.3054 (w 0.2976 mse 0.3093 t 651 new 0.17) lr 1.00e-05 gnorm 0.242 2.84s mem 81.1GB +[2026-09-12 10:02:54] step 4792/5000 loss 0.3291 (w 0.2892 mse 0.2979 t 404 new 0.15) lr 1.00e-05 gnorm 0.110 3.33s mem 81.1GB +[2026-09-12 10:02:58] step 4793/5000 loss 0.2932 (w 0.1746 mse 0.1952 t 965 new 0.13) lr 1.00e-05 gnorm 0.107 3.26s mem 81.1GB +[2026-09-12 10:03:01] step 4794/5000 loss 0.2087 (w 0.2522 mse 0.2662 t 836 new 0.25) lr 1.00e-05 gnorm 0.112 3.31s mem 81.1GB +[2026-09-12 10:03:04] step 4795/5000 loss 0.2514 (w 0.5239 mse 0.5231 t 982 new 0.19) lr 1.00e-05 gnorm 0.116 3.13s mem 81.1GB +[2026-09-12 10:03:07] step 4796/5000 loss 0.2348 (w 0.2364 mse 0.2416 t 833 new 0.14) lr 1.00e-05 gnorm 0.118 3.13s mem 81.1GB +[2026-09-12 10:03:10] step 4797/5000 loss 0.1596 (w 0.2256 mse 0.2344 t 895 new 0.20) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +[2026-09-12 10:03:13] step 4798/5000 loss 0.2754 (w 0.2838 mse 0.2861 t 962 new 0.25) lr 1.00e-05 gnorm 0.147 3.37s mem 81.1GB +[2026-09-12 10:03:17] step 4799/5000 loss 0.2032 (w 0.3174 mse 0.3210 t 852 new 0.21) lr 1.00e-05 gnorm 0.090 3.30s mem 81.1GB +[2026-09-12 10:03:20] step 4800/5000 loss 0.2183 (w 0.3255 mse 0.3328 t 973 new 0.23) lr 1.00e-05 gnorm 0.115 3.38s mem 81.1GB +[2026-09-12 10:03:23] step 4801/5000 loss 0.2049 (w 0.2764 mse 0.2801 t 915 new 0.22) lr 1.00e-05 gnorm 0.165 2.83s mem 81.1GB +[2026-09-12 10:03:26] step 4802/5000 loss 0.3015 (w 0.3362 mse 0.3386 t 917 new 0.16) lr 1.00e-05 gnorm 0.218 3.14s mem 81.1GB +[2026-09-12 10:03:29] step 4803/5000 loss 0.2729 (w 0.3302 mse 0.3248 t 651 new 0.23) lr 1.00e-05 gnorm 0.115 3.03s mem 81.1GB +[2026-09-12 10:03:32] step 4804/5000 loss 0.2572 (w 0.2425 mse 0.2519 t 761 new 0.13) lr 1.00e-05 gnorm 0.126 3.07s mem 81.1GB +[2026-09-12 10:03:35] step 4805/5000 loss 0.2313 (w 0.2740 mse 0.2849 t 921 new 0.23) lr 1.00e-05 gnorm 0.095 3.09s mem 81.1GB +[2026-09-12 10:03:39] step 4806/5000 loss 0.1914 (w 0.3305 mse 0.3383 t 966 new 0.28) lr 1.00e-05 gnorm 0.089 3.34s mem 81.1GB +[2026-09-12 10:03:41] step 4807/5000 loss 0.1713 (w 0.2757 mse 0.2770 t 816 new 0.11) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +[2026-09-12 10:03:45] step 4808/5000 loss 0.3153 (w 0.4438 mse 0.4295 t 1000 new 0.23) lr 1.00e-05 gnorm 0.166 3.35s mem 81.1GB +[2026-09-12 10:03:48] step 4809/5000 loss 0.1386 (w 0.2868 mse 0.2767 t 946 new 0.21) lr 1.00e-05 gnorm 0.146 3.03s mem 81.1GB +[2026-09-12 10:03:51] step 4810/5000 loss 0.2342 (w 0.3534 mse 0.3489 t 997 new 0.16) lr 1.00e-05 gnorm 0.145 3.29s mem 81.1GB +[2026-09-12 10:03:54] step 4811/5000 loss 0.3330 (w 0.2515 mse 0.2634 t 697 new 0.24) lr 1.00e-05 gnorm 0.117 3.36s mem 81.1GB +[2026-09-12 10:03:58] step 4812/5000 loss 0.3765 (w 0.3784 mse 0.3785 t 375 new 0.07) lr 1.00e-05 gnorm 0.126 3.29s mem 81.1GB +[2026-09-12 10:04:01] step 4813/5000 loss 0.3469 (w 0.2659 mse 0.2795 t 774 new 0.24) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +[2026-09-12 10:04:04] step 4814/5000 loss 0.3564 (w 0.2778 mse 0.2818 t 805 new 0.24) lr 1.00e-05 gnorm 0.192 3.10s mem 81.1GB +[2026-09-12 10:04:07] step 4815/5000 loss 0.1502 (w 0.3860 mse 0.3905 t 984 new 0.19) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +[2026-09-12 10:04:10] step 4816/5000 loss 0.3110 (w 0.3088 mse 0.3211 t 858 new 0.19) lr 1.00e-05 gnorm 0.189 3.08s mem 81.1GB +[2026-09-12 10:04:13] step 4817/5000 loss 0.2551 (w 0.2953 mse 0.3079 t 980 new 0.17) lr 1.00e-05 gnorm 0.110 3.12s mem 81.1GB +[2026-09-12 10:04:16] step 4818/5000 loss 0.2409 (w 0.3284 mse 0.3206 t 941 new 0.21) lr 1.00e-05 gnorm 0.163 3.37s mem 81.1GB +[2026-09-12 10:04:19] step 4819/5000 loss 0.2593 (w 0.3784 mse 0.3895 t 988 new 0.18) lr 1.00e-05 gnorm 0.093 2.83s mem 81.1GB +[2026-09-12 10:04:22] step 4820/5000 loss 0.1743 (w 0.1942 mse 0.2140 t 823 new 0.24) lr 1.00e-05 gnorm 0.124 3.13s mem 81.1GB +[2026-09-12 10:04:25] step 4821/5000 loss 0.3398 (w 0.3239 mse 0.3476 t 511 new 0.17) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +[2026-09-12 10:04:28] step 4822/5000 loss 0.1835 (w 0.1954 mse 0.2171 t 938 new 0.28) lr 1.00e-05 gnorm 0.107 3.06s mem 81.1GB +[2026-09-12 10:04:32] step 4823/5000 loss 0.1632 (w 0.2923 mse 0.3012 t 849 new 0.20) lr 1.00e-05 gnorm 0.112 3.13s mem 81.1GB +[2026-09-12 10:04:35] step 4824/5000 loss 0.2813 (w 0.3245 mse 0.3183 t 835 new 0.21) lr 1.00e-05 gnorm 0.134 3.07s mem 81.1GB +[2026-09-12 10:04:38] step 4825/5000 loss 0.3616 (w 0.3134 mse 0.3065 t 621 new 0.16) lr 1.00e-05 gnorm 0.120 3.29s mem 81.1GB +[2026-09-12 10:04:41] step 4826/5000 loss 0.3910 (w 0.3624 mse 0.3651 t 414 new 0.21) lr 1.00e-05 gnorm 0.103 2.83s mem 81.1GB +[2026-09-12 10:04:44] step 4827/5000 loss 0.5312 (w 0.6389 mse 0.6533 t 134 new 0.25) lr 1.00e-05 gnorm 0.172 3.37s mem 81.1GB +[2026-09-12 10:04:48] step 4828/5000 loss 0.2571 (w 0.3488 mse 0.3431 t 909 new 0.16) lr 1.00e-05 gnorm 0.155 3.33s mem 81.1GB +[2026-09-12 10:04:51] step 4829/5000 loss 0.1875 (w 0.2852 mse 0.2937 t 976 new 0.17) lr 1.00e-05 gnorm 0.116 3.11s mem 81.1GB +[2026-09-12 10:04:54] step 4830/5000 loss 0.2790 (w 0.1926 mse 0.2150 t 731 new 0.18) lr 1.00e-05 gnorm 0.268 3.11s mem 81.1GB +[2026-09-12 10:04:57] step 4831/5000 loss 0.1724 (w 0.2658 mse 0.2659 t 890 new 0.20) lr 1.00e-05 gnorm 0.111 3.27s mem 81.1GB +[2026-09-12 10:05:00] step 4832/5000 loss 0.2878 (w 0.3422 mse 0.3501 t 961 new 0.23) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +[2026-09-12 10:05:03] step 4833/5000 loss 0.2128 (w 0.3580 mse 0.3540 t 956 new 0.27) lr 1.00e-05 gnorm 0.125 3.33s mem 81.1GB +[2026-09-12 10:05:06] step 4834/5000 loss 0.2343 (w 0.2397 mse 0.2601 t 424 new 0.24) lr 1.00e-05 gnorm 0.114 3.30s mem 81.1GB +[2026-09-12 10:05:10] step 4835/5000 loss 0.3511 (w 0.3742 mse 0.3851 t 476 new 0.16) lr 1.00e-05 gnorm 0.149 3.31s mem 81.1GB +[2026-09-12 10:05:13] step 4836/5000 loss 0.3531 (w 0.2645 mse 0.2764 t 610 new 0.20) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +[2026-09-12 10:05:16] step 4837/5000 loss 0.2838 (w 0.2919 mse 0.2933 t 874 new 0.25) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +[2026-09-12 10:05:19] step 4838/5000 loss 0.3753 (w 0.3052 mse 0.3078 t 907 new 0.20) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +[2026-09-12 10:05:22] step 4839/5000 loss 0.4305 (w 0.2603 mse 0.2750 t 681 new 0.17) lr 1.00e-05 gnorm 0.103 3.13s mem 81.1GB +[2026-09-12 10:05:25] step 4840/5000 loss 0.3106 (w 0.2412 mse 0.2579 t 942 new 0.11) lr 1.00e-05 gnorm 0.124 3.12s mem 81.1GB +[2026-09-12 10:05:28] step 4841/5000 loss 0.1881 (w 0.2371 mse 0.2468 t 945 new 0.24) lr 1.00e-05 gnorm 0.129 3.29s mem 81.1GB +[2026-09-12 10:05:31] step 4842/5000 loss 0.3779 (w 0.3596 mse 0.3581 t 786 new 0.19) lr 1.00e-05 gnorm 0.092 2.83s mem 81.1GB +[2026-09-12 10:05:34] step 4843/5000 loss 0.3820 (w 0.3493 mse 0.3512 t 610 new 0.21) lr 1.00e-05 gnorm 0.132 3.12s mem 81.1GB +[2026-09-12 10:05:37] step 4844/5000 loss 0.3402 (w 0.2043 mse 0.2224 t 700 new 0.23) lr 1.00e-05 gnorm 0.115 3.06s mem 81.1GB +[2026-09-12 10:05:40] step 4845/5000 loss 0.2197 (w 0.2300 mse 0.2449 t 983 new 0.24) lr 1.00e-05 gnorm 0.130 3.05s mem 81.1GB +[2026-09-12 10:05:43] step 4846/5000 loss 0.1879 (w 0.2592 mse 0.2604 t 712 new 0.17) lr 1.00e-05 gnorm 0.118 3.04s mem 81.1GB +[2026-09-12 10:05:47] step 4847/5000 loss 0.3378 (w 0.5787 mse 0.5928 t 146 new 0.24) lr 1.00e-05 gnorm 0.102 3.33s mem 81.1GB +[2026-09-12 10:05:50] step 4848/5000 loss 0.2168 (w 0.3147 mse 0.3147 t 980 new 0.23) lr 1.00e-05 gnorm 0.113 2.82s mem 81.1GB +[2026-09-12 10:05:53] step 4849/5000 loss 0.3577 (w 0.2175 mse 0.2359 t 845 new 0.23) lr 1.00e-05 gnorm 0.096 3.14s mem 81.1GB +[2026-09-12 10:05:56] step 4850/5000 loss 0.3321 (w 0.3730 mse 0.3771 t 421 new 0.24) lr 1.00e-05 gnorm 0.103 3.06s mem 81.1GB +[2026-09-12 10:05:59] step 4851/5000 loss 0.3525 (w 0.2880 mse 0.2847 t 694 new 0.13) lr 1.00e-05 gnorm 0.111 3.03s mem 81.1GB +[2026-09-12 10:06:02] step 4852/5000 loss 0.2552 (w 0.3160 mse 0.3212 t 955 new 0.20) lr 1.00e-05 gnorm 0.263 3.34s mem 81.1GB +[2026-09-12 10:06:05] step 4853/5000 loss 0.2025 (w 0.3959 mse 0.3842 t 895 new 0.25) lr 1.00e-05 gnorm 0.129 3.30s mem 81.1GB +[2026-09-12 10:06:08] step 4854/5000 loss 0.2649 (w 0.6077 mse 0.6113 t 140 new 0.15) lr 1.00e-05 gnorm 0.121 2.84s mem 81.1GB +[2026-09-12 10:06:11] step 4855/5000 loss 0.1297 (w 0.3048 mse 0.3046 t 851 new 0.24) lr 1.00e-05 gnorm 0.098 3.16s mem 81.1GB +[2026-09-12 10:06:15] step 4856/5000 loss 0.2637 (w 0.3392 mse 0.3325 t 892 new 0.22) lr 1.00e-05 gnorm 0.203 3.08s mem 81.1GB +[2026-09-12 10:06:18] step 4857/5000 loss 0.1913 (w 0.3675 mse 0.3728 t 957 new 0.13) lr 1.00e-05 gnorm 0.106 3.06s mem 81.1GB +[2026-09-12 10:06:21] step 4858/5000 loss 0.2355 (w 0.2684 mse 0.2801 t 988 new 0.11) lr 1.00e-05 gnorm 0.086 3.09s mem 81.1GB +[2026-09-12 10:06:24] step 4859/5000 loss 0.3012 (w 0.3338 mse 0.3653 t 991 new 0.26) lr 1.00e-05 gnorm 0.140 3.32s mem 81.1GB +[2026-09-12 10:06:27] step 4860/5000 loss 0.3108 (w 0.3507 mse 0.3524 t 955 new 0.19) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +[2026-09-12 10:06:30] step 4861/5000 loss 0.4112 (w 0.3148 mse 0.3261 t 695 new 0.14) lr 1.00e-05 gnorm 0.124 3.15s mem 81.1GB +[2026-09-12 10:06:33] step 4862/5000 loss 0.1762 (w 0.2432 mse 0.2633 t 777 new 0.22) lr 1.00e-05 gnorm 0.104 3.24s mem 81.1GB +[2026-09-12 10:06:36] step 4863/5000 loss 0.2842 (w 0.2551 mse 0.2706 t 840 new 0.18) lr 1.00e-05 gnorm 0.114 3.06s mem 81.1GB +[2026-09-12 10:06:39] step 4864/5000 loss 0.2523 (w 0.5148 mse 0.5008 t 994 new 0.24) lr 1.00e-05 gnorm 0.127 3.12s mem 81.1GB +[2026-09-12 10:06:43] step 4865/5000 loss 0.1920 (w 0.2683 mse 0.2836 t 992 new 0.22) lr 1.00e-05 gnorm 0.102 3.09s mem 81.1GB +[2026-09-12 10:06:45] step 4866/5000 loss 0.3076 (w 0.4110 mse 0.4317 t 292 new 0.24) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +[2026-09-12 10:06:49] step 4867/5000 loss 0.1538 (w 0.3885 mse 0.3971 t 989 new 0.30) lr 1.00e-05 gnorm 0.098 3.19s mem 81.1GB +[2026-09-12 10:06:52] step 4868/5000 loss 0.2548 (w 0.3484 mse 0.3566 t 976 new 0.19) lr 1.00e-05 gnorm 0.160 3.32s mem 81.1GB +[2026-09-12 10:06:55] step 4869/5000 loss 0.1910 (w 0.4630 mse 0.4407 t 996 new 0.23) lr 1.00e-05 gnorm 0.102 3.11s mem 81.1GB +[2026-09-12 10:06:58] step 4870/5000 loss 0.3329 (w 0.3291 mse 0.3320 t 871 new 0.20) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +[2026-09-12 10:07:01] step 4871/5000 loss 0.2315 (w 0.2104 mse 0.2302 t 976 new 0.18) lr 1.00e-05 gnorm 0.135 3.10s mem 81.1GB +[2026-09-12 10:07:04] step 4872/5000 loss 0.0897 (w 0.2113 mse 0.2143 t 878 new 0.22) lr 1.00e-05 gnorm 0.170 3.13s mem 81.1GB +[2026-09-12 10:07:07] step 4873/5000 loss 0.1909 (w 0.3742 mse 0.3777 t 965 new 0.21) lr 1.00e-05 gnorm 0.124 3.12s mem 81.1GB +[2026-09-12 10:07:11] step 4874/5000 loss 0.1745 (w 0.2371 mse 0.2508 t 857 new 0.20) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +[2026-09-12 10:07:14] step 4875/5000 loss 0.2197 (w 0.2161 mse 0.2271 t 997 new 0.23) lr 1.00e-05 gnorm 0.163 3.34s mem 81.1GB +[2026-09-12 10:07:17] step 4876/5000 loss 0.2618 (w 0.2387 mse 0.2455 t 907 new 0.25) lr 1.00e-05 gnorm 0.138 3.28s mem 81.1GB +[2026-09-12 10:07:20] step 4877/5000 loss 0.1676 (w 0.2055 mse 0.2323 t 936 new 0.24) lr 1.00e-05 gnorm 0.098 3.13s mem 81.1GB +[2026-09-12 10:07:23] step 4878/5000 loss 0.3591 (w 0.2627 mse 0.2812 t 986 new 0.22) lr 1.00e-05 gnorm 0.237 3.10s mem 81.1GB +[2026-09-12 10:07:27] step 4879/5000 loss 0.2244 (w 0.3776 mse 0.3664 t 843 new 0.26) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +[2026-09-12 10:07:30] step 4880/5000 loss 0.2257 (w 0.3913 mse 0.3893 t 985 new 0.20) lr 1.00e-05 gnorm 0.116 3.10s mem 81.1GB +[2026-09-12 10:07:33] step 4881/5000 loss 0.4803 (w 0.3210 mse 0.3263 t 885 new 0.25) lr 1.00e-05 gnorm 0.136 3.07s mem 81.1GB +[2026-09-12 10:07:36] step 4882/5000 loss 0.2580 (w 0.2961 mse 0.3017 t 876 new 0.24) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +[2026-09-12 10:07:39] step 4883/5000 loss 0.2397 (w 0.2604 mse 0.2698 t 928 new 0.25) lr 1.00e-05 gnorm 0.117 3.12s mem 81.1GB +[2026-09-12 10:07:42] step 4884/5000 loss 0.3778 (w 0.3887 mse 0.3892 t 963 new 0.16) lr 1.00e-05 gnorm 0.138 3.13s mem 81.1GB +[2026-09-12 10:07:45] step 4885/5000 loss 0.3791 (w 0.6231 mse 0.6293 t 146 new 0.22) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +[2026-09-12 10:07:48] step 4886/5000 loss 0.2668 (w 0.3041 mse 0.3041 t 868 new 0.22) lr 1.00e-05 gnorm 0.102 3.22s mem 81.1GB +[2026-09-12 10:07:52] step 4887/5000 loss 0.3522 (w 0.1686 mse 0.1814 t 906 new 0.24) lr 1.00e-05 gnorm 0.125 3.35s mem 81.1GB +[2026-09-12 10:07:55] step 4888/5000 loss 0.2056 (w 0.2804 mse 0.2926 t 817 new 0.17) lr 1.00e-05 gnorm 0.119 3.29s mem 81.1GB +[2026-09-12 10:07:58] step 4889/5000 loss 0.4097 (w 0.2776 mse 0.2806 t 749 new 0.24) lr 1.00e-05 gnorm 0.181 2.83s mem 81.1GB +[2026-09-12 10:08:01] step 4890/5000 loss 0.3269 (w 0.2348 mse 0.2515 t 950 new 0.15) lr 1.00e-05 gnorm 0.145 3.32s mem 81.1GB +[2026-09-12 10:08:04] step 4891/5000 loss 0.2047 (w 0.4587 mse 0.4723 t 979 new 0.19) lr 1.00e-05 gnorm 0.119 3.13s mem 81.1GB +[2026-09-12 10:08:08] step 4892/5000 loss 0.3757 (w 0.2537 mse 0.2614 t 592 new 0.18) lr 1.00e-05 gnorm 0.420 3.27s mem 81.1GB +[2026-09-12 10:08:11] step 4893/5000 loss 0.4246 (w 0.2477 mse 0.2620 t 939 new 0.20) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-12 10:08:14] step 4894/5000 loss 0.2719 (w 0.3296 mse 0.3352 t 990 new 0.26) lr 1.00e-05 gnorm 0.106 3.34s mem 81.1GB +[2026-09-12 10:08:17] step 4895/5000 loss 0.2725 (w 0.3225 mse 0.3296 t 479 new 0.19) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +[2026-09-12 10:08:20] step 4896/5000 loss 0.2524 (w 0.4144 mse 0.4428 t 238 new 0.22) lr 1.00e-05 gnorm 0.108 3.15s mem 81.1GB +[2026-09-12 10:08:23] step 4897/5000 loss 0.3871 (w 0.2391 mse 0.2367 t 740 new 0.25) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +[2026-09-12 10:08:26] step 4898/5000 loss 0.2252 (w 0.3068 mse 0.3067 t 976 new 0.22) lr 1.00e-05 gnorm 0.252 3.06s mem 81.1GB +[2026-09-12 10:08:29] step 4899/5000 loss 0.2625 (w 0.2974 mse 0.3015 t 865 new 0.25) lr 1.00e-05 gnorm 0.158 3.03s mem 81.1GB +[2026-09-12 10:08:32] step 4900/5000 loss 0.4087 (w 0.5635 mse 0.5838 t 165 new 0.18) lr 1.00e-05 gnorm 0.146 3.06s mem 81.1GB +[2026-09-12 10:08:35] step 4901/5000 loss 0.2287 (w 0.2562 mse 0.2598 t 705 new 0.26) lr 1.00e-05 gnorm 0.192 2.83s mem 81.1GB +[2026-09-12 10:08:38] step 4902/5000 loss 0.2981 (w 0.2867 mse 0.2842 t 668 new 0.11) lr 1.00e-05 gnorm 0.133 3.11s mem 81.1GB +[2026-09-12 10:08:42] step 4903/5000 loss 0.3465 (w 0.3006 mse 0.3007 t 787 new 0.21) lr 1.00e-05 gnorm 0.108 3.10s mem 81.1GB +[2026-09-12 10:08:45] step 4904/5000 loss 0.2369 (w 0.3061 mse 0.3107 t 904 new 0.19) lr 1.00e-05 gnorm 0.115 3.07s mem 81.1GB +[2026-09-12 10:08:48] step 4905/5000 loss 0.3863 (w 0.2450 mse 0.2624 t 881 new 0.19) lr 1.00e-05 gnorm 0.218 3.05s mem 81.1GB +[2026-09-12 10:08:51] step 4906/5000 loss 0.4015 (w 0.3186 mse 0.3234 t 500 new 0.24) lr 1.00e-05 gnorm 0.429 3.04s mem 81.1GB +[2026-09-12 10:08:54] step 4907/5000 loss 0.3358 (w 0.1953 mse 0.1973 t 988 new 0.09) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-12 10:08:57] step 4908/5000 loss 0.3104 (w 0.3281 mse 0.3158 t 988 new 0.23) lr 1.00e-05 gnorm 0.131 3.18s mem 81.1GB +[2026-09-12 10:09:00] step 4909/5000 loss 0.5462 (w 0.2838 mse 0.2896 t 621 new 0.12) lr 1.00e-05 gnorm 0.139 3.24s mem 81.1GB +[2026-09-12 10:09:03] step 4910/5000 loss 0.2553 (w 0.3719 mse 0.3673 t 965 new 0.25) lr 1.00e-05 gnorm 0.086 3.05s mem 81.1GB +[2026-09-12 10:09:06] step 4911/5000 loss 0.2194 (w 0.3956 mse 0.3869 t 979 new 0.29) lr 1.00e-05 gnorm 0.090 3.07s mem 81.1GB +[2026-09-12 10:09:09] step 4912/5000 loss 0.2552 (w 0.2209 mse 0.2438 t 999 new 0.20) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +[2026-09-12 10:09:12] step 4913/5000 loss 0.1929 (w 0.2327 mse 0.2432 t 803 new 0.17) lr 1.00e-05 gnorm 0.128 3.14s mem 81.1GB +[2026-09-12 10:09:15] step 4914/5000 loss 0.1693 (w 0.2844 mse 0.3078 t 972 new 0.23) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +[2026-09-12 10:09:18] step 4915/5000 loss 0.3490 (w 0.2909 mse 0.2935 t 605 new 0.18) lr 1.00e-05 gnorm 0.167 3.09s mem 81.1GB +[2026-09-12 10:09:21] step 4916/5000 loss 0.2295 (w 0.1820 mse 0.1965 t 769 new 0.15) lr 1.00e-05 gnorm 0.126 3.09s mem 81.1GB +[2026-09-12 10:09:25] step 4917/5000 loss 0.3560 (w 0.3215 mse 0.3415 t 301 new 0.26) lr 1.00e-05 gnorm 0.119 3.27s mem 81.1GB +[2026-09-12 10:09:28] step 4918/5000 loss 0.3913 (w 0.3255 mse 0.3282 t 450 new 0.16) lr 1.00e-05 gnorm 0.147 3.14s mem 81.1GB +[2026-09-12 10:09:31] step 4919/5000 loss 0.2976 (w 0.2751 mse 0.2854 t 920 new 0.16) lr 1.00e-05 gnorm 0.143 3.12s mem 81.1GB +[2026-09-12 10:09:34] step 4920/5000 loss 0.2242 (w 0.3695 mse 0.3761 t 983 new 0.25) lr 1.00e-05 gnorm 0.163 2.83s mem 81.1GB +[2026-09-12 10:09:37] step 4921/5000 loss 0.3621 (w 0.3106 mse 0.3182 t 987 new 0.25) lr 1.00e-05 gnorm 0.188 3.33s mem 81.1GB +[2026-09-12 10:09:40] step 4922/5000 loss 0.2558 (w 0.2099 mse 0.2395 t 982 new 0.20) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +[2026-09-12 10:09:43] step 4923/5000 loss 0.2870 (w 0.2799 mse 0.2824 t 560 new 0.13) lr 1.00e-05 gnorm 0.109 3.36s mem 81.1GB +[2026-09-12 10:09:46] step 4924/5000 loss 0.2140 (w 0.2756 mse 0.2779 t 976 new 0.21) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +[2026-09-12 10:09:49] step 4925/5000 loss 0.4082 (w 0.2964 mse 0.2964 t 957 new 0.18) lr 1.00e-05 gnorm 0.152 3.11s mem 81.1GB +[2026-09-12 10:09:52] step 4926/5000 loss 0.2687 (w 0.2061 mse 0.2214 t 914 new 0.14) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +[2026-09-12 10:09:56] step 4927/5000 loss 0.2386 (w 0.2370 mse 0.2485 t 969 new 0.17) lr 1.00e-05 gnorm 0.112 3.37s mem 81.1GB +[2026-09-12 10:09:59] step 4928/5000 loss 0.2521 (w 0.3596 mse 0.3631 t 980 new 0.09) lr 1.00e-05 gnorm 0.138 3.05s mem 81.1GB +[2026-09-12 10:10:02] step 4929/5000 loss 0.2747 (w 0.3352 mse 0.3531 t 965 new 0.21) lr 1.00e-05 gnorm 0.146 3.33s mem 81.1GB +[2026-09-12 10:10:05] step 4930/5000 loss 0.2631 (w 0.2137 mse 0.2217 t 818 new 0.18) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +[2026-09-12 10:10:08] step 4931/5000 loss 0.1856 (w 0.2866 mse 0.2974 t 977 new 0.26) lr 1.00e-05 gnorm 0.116 3.15s mem 81.1GB +[2026-09-12 10:10:11] step 4932/5000 loss 0.1673 (w 0.4512 mse 0.4347 t 962 new 0.24) lr 1.00e-05 gnorm 0.098 3.06s mem 81.1GB +[2026-09-12 10:10:14] step 4933/5000 loss 0.3205 (w 0.3368 mse 0.3289 t 929 new 0.22) lr 1.00e-05 gnorm 0.115 3.13s mem 81.1GB +[2026-09-12 10:10:17] step 4934/5000 loss 0.2684 (w 0.3646 mse 0.3648 t 950 new 0.26) lr 1.00e-05 gnorm 0.124 3.03s mem 81.1GB +[2026-09-12 10:10:20] step 4935/5000 loss 0.2761 (w 0.6250 mse 0.6437 t 177 new 0.20) lr 1.00e-05 gnorm 0.188 3.08s mem 81.1GB +[2026-09-12 10:10:23] step 4936/5000 loss 0.2279 (w 0.2788 mse 0.2781 t 831 new 0.20) lr 1.00e-05 gnorm 0.118 2.83s mem 81.1GB +[2026-09-12 10:10:27] step 4937/5000 loss 0.2302 (w 0.1787 mse 0.1849 t 797 new 0.22) lr 1.00e-05 gnorm 0.090 3.28s mem 81.1GB +[2026-09-12 10:10:30] step 4938/5000 loss 0.2330 (w 0.2836 mse 0.2914 t 995 new 0.19) lr 1.00e-05 gnorm 0.147 3.09s mem 81.1GB +[2026-09-12 10:10:33] step 4939/5000 loss 0.2556 (w 0.2806 mse 0.2935 t 624 new 0.22) lr 1.00e-05 gnorm 0.128 3.06s mem 81.1GB +[2026-09-12 10:10:36] step 4940/5000 loss 0.2139 (w 0.3240 mse 0.3253 t 964 new 0.15) lr 1.00e-05 gnorm 0.163 3.09s mem 81.1GB +[2026-09-12 10:10:39] step 4941/5000 loss 0.3153 (w 0.3367 mse 0.3356 t 910 new 0.22) lr 1.00e-05 gnorm 0.182 3.06s mem 81.1GB +[2026-09-12 10:10:42] step 4942/5000 loss 0.2109 (w 0.2705 mse 0.2827 t 961 new 0.22) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +[2026-09-12 10:10:45] step 4943/5000 loss 0.4026 (w 0.2938 mse 0.3121 t 826 new 0.18) lr 1.00e-05 gnorm 0.208 3.28s mem 81.1GB +[2026-09-12 10:10:48] step 4944/5000 loss 0.2849 (w 0.3071 mse 0.3203 t 945 new 0.19) lr 1.00e-05 gnorm 0.201 3.33s mem 81.1GB +[2026-09-12 10:10:52] step 4945/5000 loss 0.2218 (w 0.2771 mse 0.2786 t 800 new 0.17) lr 1.00e-05 gnorm 0.397 3.29s mem 81.1GB +[2026-09-12 10:10:55] step 4946/5000 loss 0.1909 (w 0.2715 mse 0.2707 t 829 new 0.18) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +[2026-09-12 10:10:58] step 4947/5000 loss 0.2706 (w 0.3497 mse 0.3497 t 479 new 0.20) lr 1.00e-05 gnorm 0.094 3.14s mem 81.1GB +[2026-09-12 10:11:01] step 4948/5000 loss 0.3599 (w 0.2483 mse 0.2662 t 992 new 0.10) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +[2026-09-12 10:11:04] step 4949/5000 loss 0.3452 (w 0.2209 mse 0.2342 t 870 new 0.22) lr 1.00e-05 gnorm 0.121 3.29s mem 81.1GB +[2026-09-12 10:11:07] step 4950/5000 loss 0.4048 (w 0.2441 mse 0.2479 t 809 new 0.21) lr 1.00e-05 gnorm 0.142 3.30s mem 81.1GB +[2026-09-12 10:11:11] step 4951/5000 loss 0.1322 (w 0.3109 mse 0.3341 t 994 new 0.19) lr 1.00e-05 gnorm 0.089 3.30s mem 81.1GB +[2026-09-12 10:11:14] step 4952/5000 loss 0.1770 (w 0.2594 mse 0.2735 t 854 new 0.20) lr 1.00e-05 gnorm 0.101 3.18s mem 81.1GB +[2026-09-12 10:11:17] step 4953/5000 loss 0.3397 (w 0.3740 mse 0.3733 t 998 new 0.26) lr 1.00e-05 gnorm 0.115 2.84s mem 81.1GB +[2026-09-12 10:11:20] step 4954/5000 loss 0.2834 (w 0.2557 mse 0.2709 t 932 new 0.20) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +[2026-09-12 10:11:23] step 4955/5000 loss 0.3177 (w 0.3979 mse 0.4055 t 997 new 0.16) lr 1.00e-05 gnorm 0.208 3.10s mem 81.1GB +[2026-09-12 10:11:26] step 4956/5000 loss 0.1440 (w 0.2764 mse 0.2890 t 533 new 0.26) lr 1.00e-05 gnorm 0.105 3.16s mem 81.1GB +[2026-09-12 10:11:29] step 4957/5000 loss 0.2942 (w 0.2500 mse 0.2602 t 832 new 0.23) lr 1.00e-05 gnorm 0.092 3.08s mem 81.1GB +[2026-09-12 10:11:32] step 4958/5000 loss 0.3938 (w 0.2855 mse 0.3037 t 948 new 0.25) lr 1.00e-05 gnorm 0.165 3.18s mem 81.1GB +[2026-09-12 10:11:35] step 4959/5000 loss 0.3148 (w 0.3449 mse 0.3536 t 440 new 0.29) lr 1.00e-05 gnorm 0.108 2.84s mem 81.1GB +[2026-09-12 10:11:38] step 4960/5000 loss 0.3136 (w 0.3880 mse 0.3763 t 947 new 0.13) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +[2026-09-12 10:11:41] step 4961/5000 loss 0.2181 (w 0.2238 mse 0.2310 t 836 new 0.22) lr 1.00e-05 gnorm 0.117 3.31s mem 81.1GB +[2026-09-12 10:11:44] step 4962/5000 loss 0.2689 (w 0.2378 mse 0.2484 t 802 new 0.19) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +[2026-09-12 10:11:47] step 4963/5000 loss 0.2149 (w 0.1920 mse 0.2009 t 938 new 0.11) lr 1.00e-05 gnorm 0.291 3.07s mem 81.1GB +[2026-09-12 10:11:51] step 4964/5000 loss 0.3782 (w 0.3118 mse 0.3131 t 764 new 0.25) lr 1.00e-05 gnorm 0.218 3.45s mem 81.1GB +[2026-09-12 10:11:54] step 4965/5000 loss 0.2677 (w 0.1614 mse 0.1872 t 867 new 0.23) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +[2026-09-12 10:11:57] step 4966/5000 loss 0.3154 (w 0.2581 mse 0.2673 t 644 new 0.21) lr 1.00e-05 gnorm 0.107 2.83s mem 81.1GB +[2026-09-12 10:12:00] step 4967/5000 loss 0.3281 (w 0.3204 mse 0.3224 t 885 new 0.20) lr 1.00e-05 gnorm 0.125 3.05s mem 81.1GB +[2026-09-12 10:12:03] step 4968/5000 loss 0.3141 (w 0.2970 mse 0.2931 t 832 new 0.17) lr 1.00e-05 gnorm 0.128 3.26s mem 81.1GB +[2026-09-12 10:12:06] step 4969/5000 loss 0.1952 (w 0.2758 mse 0.2994 t 984 new 0.12) lr 1.00e-05 gnorm 0.124 3.09s mem 81.1GB +[2026-09-12 10:12:10] step 4970/5000 loss 0.3692 (w 0.2921 mse 0.2903 t 898 new 0.15) lr 1.00e-05 gnorm 0.139 3.55s mem 81.1GB +[2026-09-12 10:12:12] step 4971/5000 loss 0.3731 (w 0.2562 mse 0.2621 t 546 new 0.14) lr 1.00e-05 gnorm 0.090 2.84s mem 81.1GB +[2026-09-12 10:12:16] step 4972/5000 loss 0.3687 (w 0.2021 mse 0.2175 t 794 new 0.25) lr 1.00e-05 gnorm 0.185 3.29s mem 81.1GB +[2026-09-12 10:12:19] step 4973/5000 loss 0.2635 (w 0.4680 mse 0.4627 t 444 new 0.20) lr 1.00e-05 gnorm 0.129 3.13s mem 81.1GB +[2026-09-12 10:12:22] step 4974/5000 loss 0.2691 (w 0.2772 mse 0.2793 t 843 new 0.17) lr 1.00e-05 gnorm 0.111 3.27s mem 81.1GB +[2026-09-12 10:12:25] step 4975/5000 loss 0.2542 (w 0.3533 mse 0.3601 t 375 new 0.09) lr 1.00e-05 gnorm 0.109 3.11s mem 81.1GB +[2026-09-12 10:12:29] step 4976/5000 loss 0.3019 (w 0.3174 mse 0.3266 t 553 new 0.23) lr 1.00e-05 gnorm 0.177 3.41s mem 81.1GB +[2026-09-12 10:12:31] step 4977/5000 loss 0.3511 (w 0.2416 mse 0.2508 t 960 new 0.14) lr 1.00e-05 gnorm 0.252 2.84s mem 81.1GB +[2026-09-12 10:12:34] step 4978/5000 loss 0.3719 (w 0.3797 mse 0.3859 t 586 new 0.21) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +[2026-09-12 10:12:38] step 4979/5000 loss 0.3563 (w 0.1738 mse 0.1998 t 837 new 0.21) lr 1.00e-05 gnorm 0.118 3.25s mem 81.1GB +[2026-09-12 10:12:41] step 4980/5000 loss 0.2741 (w 0.2375 mse 0.2479 t 940 new 0.12) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +[2026-09-12 10:12:44] step 4981/5000 loss 0.2189 (w 0.2352 mse 0.2448 t 890 new 0.20) lr 1.00e-05 gnorm 0.123 3.11s mem 81.1GB +[2026-09-12 10:12:47] step 4982/5000 loss 0.3340 (w 0.1911 mse 0.1955 t 852 new 0.20) lr 1.00e-05 gnorm 0.194 3.13s mem 81.1GB +[2026-09-12 10:12:50] step 4983/5000 loss 0.3438 (w 0.2715 mse 0.2661 t 800 new 0.24) lr 1.00e-05 gnorm 0.195 2.83s mem 81.1GB +[2026-09-12 10:12:53] step 4984/5000 loss 0.1857 (w 0.3479 mse 0.3342 t 914 new 0.19) lr 1.00e-05 gnorm 0.132 3.07s mem 81.1GB +[2026-09-12 10:12:56] step 4985/5000 loss 0.2772 (w 0.3030 mse 0.3066 t 975 new 0.20) lr 1.00e-05 gnorm 0.106 3.29s mem 81.1GB +[2026-09-12 10:13:00] step 4986/5000 loss 0.2588 (w 0.2907 mse 0.2969 t 786 new 0.17) lr 1.00e-05 gnorm 0.116 3.26s mem 81.1GB +[2026-09-12 10:13:03] step 4987/5000 loss 0.2471 (w 0.2771 mse 0.2865 t 954 new 0.20) lr 1.00e-05 gnorm 0.116 3.10s mem 81.1GB +[2026-09-12 10:13:06] step 4988/5000 loss 0.1859 (w 0.3975 mse 0.3915 t 992 new 0.10) lr 1.00e-05 gnorm 0.079 3.04s mem 81.1GB +[2026-09-12 10:13:09] step 4989/5000 loss 0.1386 (w 0.3024 mse 0.3050 t 919 new 0.22) lr 1.00e-05 gnorm 0.165 2.83s mem 81.1GB +[2026-09-12 10:13:12] step 4990/5000 loss 0.3318 (w 0.2247 mse 0.2375 t 609 new 0.21) lr 1.00e-05 gnorm 0.129 3.11s mem 81.1GB +[2026-09-12 10:13:15] step 4991/5000 loss 0.2015 (w 0.2969 mse 0.2949 t 940 new 0.18) lr 1.00e-05 gnorm 0.134 3.02s mem 81.1GB +[2026-09-12 10:13:18] step 4992/5000 loss 0.2889 (w 0.3151 mse 0.3174 t 987 new 0.25) lr 1.00e-05 gnorm 0.094 3.12s mem 81.1GB +[2026-09-12 10:13:21] step 4993/5000 loss 0.2205 (w 0.3349 mse 0.3260 t 891 new 0.27) lr 1.00e-05 gnorm 0.107 3.08s mem 81.1GB +[2026-09-12 10:13:24] step 4994/5000 loss 0.2345 (w 0.3291 mse 0.3319 t 978 new 0.20) lr 1.00e-05 gnorm 0.091 3.13s mem 81.1GB +[2026-09-12 10:13:27] step 4995/5000 loss 0.3143 (w 0.2347 mse 0.2346 t 909 new 0.14) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +[2026-09-12 10:13:30] step 4996/5000 loss 0.1918 (w 0.2496 mse 0.2666 t 993 new 0.22) lr 1.00e-05 gnorm 0.098 3.31s mem 81.1GB +[2026-09-12 10:13:33] step 4997/5000 loss 0.2010 (w 0.2496 mse 0.2519 t 960 new 0.12) lr 1.00e-05 gnorm 0.092 3.07s mem 81.1GB +[2026-09-12 10:13:36] step 4998/5000 loss 0.2845 (w 0.3949 mse 0.3803 t 985 new 0.21) lr 1.00e-05 gnorm 0.092 3.10s mem 81.1GB +[2026-09-12 10:13:40] step 4999/5000 loss 0.1935 (w 0.2335 mse 0.2437 t 920 new 0.21) lr 1.00e-05 gnorm 0.130 3.38s mem 81.1GB +[2026-09-12 10:13:43] step 5000/5000 loss 0.1800 (w 0.1601 mse 0.1703 t 781 new 0.15) lr 1.00e-05 gnorm 0.104 3.12s mem 81.1GB +[2026-09-12 10:13:44] [val] step 5000 t=200: w=0.4515 mse=0.4696 (n=16) t=500: w=0.2739 mse=0.2886 (n=16) t=800: w=0.2298 mse=0.2415 (n=16) | mean w=0.3184 mse=0.3332 2s +[2026-09-12 10:14:33] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k/dits/dit_step5000.safetensors 4093 个张量 37.98 GB +[2026-09-12 10:14:36] [done] step 5000 diff --git a/backup_2026-09-14/runs/ltx__arope_5k/train_log.csv b/backup_2026-09-14/runs/ltx__arope_5k/train_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..c3a35079e3bd9a3c008d01d7425189792b33cde7 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k/train_log.csv @@ -0,0 +1,5001 @@ +step,loss,loss_w,mse,new_frac,timestep,lr,grad_norm,step_time,mem_gb,epoch +1,0.5362653732299805,0.6322532892227173,0.623264729976654,0.1806526780128479,964.7545166015625,5.0000000000000004e-08,2.60707950592041,8.370167255401611,79.65066432952881,0 +2,0.6235414147377014,0.39497214555740356,0.4332793951034546,0.24405594170093536,737.33203125,1.0000000000000001e-07,2.522200107574463,3.511624813079834,81.14050149917603,0 +3,0.4311682879924774,0.5013703107833862,0.5038360357284546,0.20652680099010468,933.9302368164062,1.5000000000000002e-07,1.4739664793014526,2.800663471221924,81.14050149917603,0 +4,0.4329162538051605,0.4527323544025421,0.46327531337738037,0.24149183928966522,895.4498291015625,2.0000000000000002e-07,2.4528238773345947,2.816668748855591,81.14050149917603,0 +5,0.4774792790412903,0.4607938230037689,0.47572261095046997,0.2426573485136032,803.0537109375,2.5000000000000004e-07,3.025428056716919,2.8060176372528076,81.14050149917603,0 +6,0.5510688424110413,0.4086371064186096,0.42844098806381226,0.2209790199995041,588.0953979492188,3.0000000000000004e-07,2.7217366695404053,2.8185551166534424,81.14050149917603,0 +7,0.44231098890304565,0.5672875046730042,0.5725179314613342,0.23449882864952087,928.5856323242188,3.5000000000000004e-07,2.2067949771881104,2.8159592151641846,81.14050149917603,0 +8,0.3947136402130127,0.47584325075149536,0.49053269624710083,0.2186480164527893,934.7079467773438,4.0000000000000003e-07,2.0009188652038574,3.627666473388672,81.14050149917603,0 +9,0.6274113655090332,0.48997870087623596,0.48519232869148254,0.23846153914928436,584.1925659179688,4.5000000000000003e-07,2.5217649936676025,2.812344551086426,81.14050149917603,0 +10,0.7413939237594604,0.8197147250175476,0.8178375959396362,0.23613053560256958,996.0327758789062,5.000000000000001e-07,3.09853196144104,2.823512077331543,81.14050149917603,0 +11,0.3446628451347351,0.663084089756012,0.655458390712738,0.18275058269500732,984.4981079101562,5.5e-07,1.6282765865325928,2.827648162841797,81.14050149917603,0 +12,0.40701279044151306,0.4745025336742401,0.4849909842014313,0.17179487645626068,961.9138793945312,6.000000000000001e-07,2.5644922256469727,2.8251700401306152,81.14050149917603,0 +13,0.6093363165855408,0.4131483733654022,0.41037672758102417,0.19230769574642181,632.5867309570312,6.5e-07,2.4658167362213135,2.822986125946045,81.14050149917603,0 +14,0.8383327126502991,0.7713544964790344,0.7831652760505676,0.16293705999851227,273.5347900390625,7.000000000000001e-07,2.4929068088531494,3.6273088455200195,81.14050149917603,0 +15,0.47385555505752563,0.4373425543308258,0.4284164607524872,0.1414918452501297,903.6668701171875,7.5e-07,1.8433793783187866,2.8325674533843994,81.14050149917603,0 +16,0.7048291563987732,0.8395010828971863,0.8447279930114746,0.22867132723331451,998.5840454101562,8.000000000000001e-07,3.501466751098633,2.8416545391082764,81.14050149917603,0 +17,0.4554417133331299,0.47468310594558716,0.4803192913532257,0.1818181872367859,938.756103515625,8.500000000000001e-07,1.3718645572662354,2.842819929122925,81.14050149917603,0 +18,0.34166064858436584,0.5591872930526733,0.5815306901931763,0.1459207385778427,989.2814331054688,9.000000000000001e-07,1.0344964265823364,2.8448750972747803,81.14050149917603,0 +19,0.4325985312461853,0.7292904257774353,0.7526770234107971,0.19720280170440674,100.0000228881836,9.500000000000001e-07,1.6517606973648071,2.8349459171295166,81.14050149917603,0 +20,0.2938529849052429,0.4511094391345978,0.4511932134628296,0.250582754611969,955.10791015625,1.0000000000000002e-06,6.011512756347656,3.4844870567321777,81.14050149917603,0 +21,0.6403096914291382,0.8013504147529602,0.7932000160217285,0.19930069148540497,994.7838134765625,1.0500000000000001e-06,1.6424275636672974,2.8166210651397705,81.14050149917603,0 +22,0.35598433017730713,0.4561404287815094,0.45665258169174194,0.23729602992534637,900.5198364257812,1.1e-06,1.6529392004013062,2.8196120262145996,81.14050149917603,0 +23,0.5305893421173096,0.4540466070175171,0.46850791573524475,0.1678321659564972,740.3775634765625,1.1500000000000002e-06,1.2608333826065063,2.816584348678589,81.14050149917603,0 +24,0.4190410077571869,0.4997730553150177,0.535514235496521,0.2181818187236786,929.6773681640625,1.2000000000000002e-06,0.7793104648590088,2.824004888534546,81.14050149917603,0 +25,0.256740003824234,0.3168015778064728,0.3272569477558136,0.26806527376174927,811.3840942382812,1.25e-06,1.355716586112976,3.155184745788574,81.14050149917603,0 +26,0.44723349809646606,0.4152671992778778,0.4430568218231201,0.18811188638210297,273.5347900390625,1.3e-06,0.944920003414154,3.3457751274108887,81.14050149917603,0 +27,0.3460119366645813,0.3942127227783203,0.4016399383544922,0.21771562099456787,916.3778686523438,1.3500000000000002e-06,0.8914296627044678,2.8229572772979736,81.14050149917603,0 +28,0.3521552085876465,0.5136091113090515,0.5159761309623718,0.23333333432674408,956.75732421875,1.4000000000000001e-06,0.5373201966285706,2.835646867752075,81.14050149917603,0 +29,0.2647716999053955,0.2580733895301819,0.2772642970085144,0.1582750529050827,785.822265625,1.45e-06,1.90939462184906,2.8260440826416016,81.14050149917603,0 +30,0.39416205883026123,0.4339004456996918,0.42765012383461,0.21445220708847046,946.6068115234375,1.5e-06,0.5408669710159302,3.0357518196105957,81.14050149917603,0 +31,0.5916262865066528,0.5219312310218811,0.5399755239486694,0.20279720425605774,946.8348388671875,1.5500000000000002e-06,0.7106330990791321,3.1871488094329834,81.14050149917603,0 +32,0.32975688576698303,0.39391329884529114,0.4105132520198822,0.2254079282283783,905.7181396484375,1.6000000000000001e-06,0.8441241383552551,3.3396530151367188,81.14050149917603,0 +33,0.41237977147102356,0.3672325313091278,0.3574989140033722,0.15221445262432098,790.488037109375,1.6500000000000003e-06,0.7874066233634949,2.836491107940674,81.14050149917603,0 +34,0.22681115567684174,0.3745965361595154,0.41023921966552734,0.23869463801383972,835.7803955078125,1.7000000000000002e-06,0.57686847448349,2.8449490070343018,81.14050149917603,0 +35,0.509646475315094,0.7767640948295593,0.7639665603637695,0.2254079282283783,998.5840454101562,1.75e-06,0.6648948788642883,2.837470531463623,81.14050149917603,0 +36,0.36475175619125366,0.4134466350078583,0.4151860475540161,0.2489510476589203,828.0687866210938,1.8000000000000001e-06,0.320585697889328,2.829526662826538,81.14050149917603,0 +37,0.31686633825302124,0.7922688722610474,0.7765226364135742,0.21095570921897888,989.9591064453125,1.85e-06,0.3028562068939209,3.1689248085021973,81.14050149917603,0 +38,0.5475914478302002,0.3213277757167816,0.3373357653617859,0.2405594438314438,888.5984497070312,1.9000000000000002e-06,0.5127938985824585,3.4744322299957275,81.14050149917603,0 +39,0.6256024837493896,0.48977333307266235,0.4970233142375946,0.23310023546218872,470.316650390625,1.9500000000000004e-06,0.4681277871131897,2.8236494064331055,81.14050149917603,0 +40,0.4321453869342804,0.378275066614151,0.38373932242393494,0.1878787875175476,900.1648559570312,2.0000000000000003e-06,0.4342910647392273,2.811386823654175,81.14050149917603,0 +41,0.709728479385376,0.2398509979248047,0.2437640279531479,0.10396270453929901,889.3790893554688,2.05e-06,0.4926338791847229,2.8320109844207764,81.14050149917603,0 +42,0.2717696726322174,0.3860441744327545,0.38518208265304565,0.08578088879585266,835.2010498046875,2.1000000000000002e-06,0.691920280456543,2.830556869506836,81.14050149917603,0 +43,0.7164530158042908,0.4850085973739624,0.5046729445457458,0.22960372269153595,593.8468017578125,2.15e-06,0.37193405628204346,3.346911907196045,81.14050149917603,0 +44,0.28416067361831665,0.4856850802898407,0.49015459418296814,0.2186480164527893,965.8648071289062,2.2e-06,0.30758458375930786,3.4594359397888184,81.14050149917603,0 +45,0.2850802540779114,0.6802409291267395,0.6805907487869263,0.22750583291053772,990.228515625,2.25e-06,0.2509475648403168,2.823131561279297,81.14050149917603,0 +46,0.3524042069911957,0.4784814417362213,0.48383471369743347,0.1738927662372589,989.5532836914062,2.3000000000000004e-06,0.4044657051563263,2.8165175914764404,81.14050149917603,0 +47,0.46472248435020447,0.30675894021987915,0.31930065155029297,0.10303030163049698,603.1679077148438,2.35e-06,0.31302765011787415,2.820300579071045,81.14050149917603,0 +48,0.22278226912021637,0.36953333020210266,0.37549999356269836,0.12820512056350708,923.8132934570312,2.4000000000000003e-06,0.40103253722190857,2.821488618850708,81.14050149917603,0 +49,0.3397897481918335,0.4140293598175049,0.42348170280456543,0.26363635063171387,642.2061767578125,2.4500000000000003e-06,0.32174432277679443,3.412900924682617,81.14050149917603,0 +50,0.27553948760032654,0.458890438079834,0.46130743622779846,0.05524475499987602,969.6383056640625,2.5e-06,0.3192543387413025,3.1819214820861816,81.14050149917603,0 +51,0.5596291422843933,0.49368560314178467,0.4922601282596588,0.21445220708847046,371.6285705566406,2.55e-06,0.34303411841392517,2.8191869258880615,81.14050149917603,0 +52,0.2613946199417114,0.2566165030002594,0.26924562454223633,0.19953380525112152,949.3074340820312,2.6e-06,0.28125882148742676,2.830487012863159,81.14050149917603,0 +53,0.39450255036354065,0.3724592626094818,0.3681406080722809,0.09207459539175034,747.3050537109375,2.6500000000000005e-06,0.31321731209754944,2.8298728466033936,81.14050149917603,0 +54,0.3634456992149353,0.4110795259475708,0.4144825339317322,0.1382284313440323,991.1632080078125,2.7000000000000004e-06,0.2682226598262787,2.8264946937561035,81.14050149917603,0 +55,0.42648765444755554,0.5229808688163757,0.5343607664108276,0.284149169921875,986.079833984375,2.7500000000000004e-06,0.29757070541381836,3.297548294067383,81.14050149917603,0 +56,0.39785078167915344,0.46820059418678284,0.48172786831855774,0.0979020968079567,989.41748046875,2.8000000000000003e-06,0.2560559809207916,3.1066763401031494,81.14050149917603,0 +57,0.5587233901023865,0.4982672929763794,0.501675546169281,0.19277389347553253,980.1610107421875,2.85e-06,0.38212844729423523,2.8213460445404053,81.14050149917603,0 +58,0.3124692738056183,0.37546175718307495,0.4030783474445343,0.16806526482105255,883.4002075195312,2.9e-06,0.2597871422767639,2.8258941173553467,81.14050149917603,0 +59,0.4169558584690094,0.479311466217041,0.48536133766174316,0.21235431730747223,960.7506713867188,2.95e-06,0.2587685286998749,2.8171138763427734,81.14050149917603,0 +60,0.341314435005188,0.3698842525482178,0.38944244384765625,0.21491841971874237,891.30908203125,3e-06,0.25941285490989685,3.086334705352783,81.14050149917603,0 +61,0.5783020853996277,0.4233771562576294,0.4309506118297577,0.17249417304992676,816.7084350585938,3.05e-06,1.8995169401168823,3.1058454513549805,81.14050149917603,0 +62,0.5033048391342163,0.32750579714775085,0.34028029441833496,0.11491841822862625,978.7633666992188,3.1000000000000004e-06,10.117510795593262,3.129101037979126,81.14050149917603,0 +63,0.3429872691631317,0.580885112285614,0.5673895478248596,0.16130536794662476,984.3526000976562,3.1500000000000003e-06,0.24196112155914307,2.8243906497955322,81.14050149917603,0 +64,0.15999962389469147,0.4669041931629181,0.4772513806819916,0.19277389347553253,931.2932739257812,3.2000000000000003e-06,0.7791174054145813,2.82353138923645,81.14050149917603,0 +65,0.45610183477401733,0.31605327129364014,0.33041366934776306,0.2242424190044403,847.4485473632812,3.2500000000000002e-06,0.42106643319129944,2.8251724243164062,81.14050149917603,0 +66,0.23718640208244324,0.27245867252349854,0.30744466185569763,0.18997669219970703,966.2316284179688,3.3000000000000006e-06,0.2649226784706116,3.118675470352173,81.14050149917603,0 +67,0.3723093271255493,0.23056764900684357,0.24094486236572266,0.0559440553188324,739.3676147460938,3.3500000000000005e-06,0.24746641516685486,3.400423765182495,81.14050149917603,0 +68,0.36842912435531616,0.280759334564209,0.28443095088005066,0.10139860212802887,852.6897583007812,3.4000000000000005e-06,0.31789630651474,2.822767496109009,81.14050149917603,0 +69,0.518436849117279,0.5820120573043823,0.5693359375,0.23170162737369537,989.41748046875,3.45e-06,0.2467864602804184,2.8249406814575195,81.14050149917603,0 +70,0.4136848449707031,0.5352551341056824,0.5570665001869202,0.18298368155956268,194.7152557373047,3.5e-06,0.724146842956543,2.8178467750549316,81.14050149917603,0 +71,0.4251559376716614,0.4283818304538727,0.41977307200431824,0.23519814014434814,966.9605712890625,3.5500000000000003e-06,2.3957812786102295,2.819171905517578,81.14050149917603,0 +72,0.43515515327453613,0.6866809725761414,0.6943256855010986,0.2594405710697174,998.8220825195312,3.6000000000000003e-06,0.3483547866344452,3.120598077774048,81.14050149917603,0 +73,0.43728598952293396,0.30170297622680664,0.3003861904144287,0.11002331227064133,711.1596069335938,3.65e-06,0.30505654215812683,3.3442702293395996,81.14050149917603,0 +74,0.40694963932037354,0.592141330242157,0.5922306180000305,0.2433566451072693,991.4281005859375,3.7e-06,0.21242719888687134,2.830994129180908,81.14050149917603,0 +75,0.40127161145210266,0.3638792037963867,0.3623485863208771,0.07622377574443817,928.5856323242188,3.7500000000000005e-06,0.4349077045917511,2.8268046379089355,81.14050149917603,0 +76,0.3636740446090698,0.5878759622573853,0.6054075360298157,0.18881118297576904,305.9609069824219,3.8000000000000005e-06,0.20016488432884216,2.8370513916015625,81.14050149917603,0 +77,0.4770437777042389,0.5109508037567139,0.5283715128898621,0.23636363446712494,263.79840087890625,3.85e-06,0.18149413168430328,2.82232666015625,81.14050149917603,0 +78,0.3335757255554199,0.39876148104667664,0.39690297842025757,0.23170162737369537,964.7545166015625,3.900000000000001e-06,0.14093497395515442,3.3556299209594727,81.14050149917603,0 +79,0.4966738224029541,0.557822585105896,0.5502193570137024,0.18531468510627747,998.7031860351562,3.95e-06,0.17148301005363464,3.523728847503662,81.14050149917603,0 +80,0.45698082447052,0.3947923481464386,0.3976907432079315,0.16083915531635284,958.17578125,4.000000000000001e-06,0.5126862525939941,2.8331165313720703,81.14050149917603,0 +81,0.2366124838590622,0.458649605512619,0.46670880913734436,0.2226107269525528,977.3401489257812,4.05e-06,0.2555638253688812,2.8369150161743164,81.14050149917603,0 +82,0.39806681871414185,0.3526932895183563,0.3647697865962982,0.2142191082239151,946.8348388671875,4.1e-06,0.28533312678337097,2.844498634338379,81.14050149917603,0 +83,0.5242204666137695,0.5386931300163269,0.5380364060401917,0.21771562099456787,263.79840087890625,4.15e-06,0.19168630242347717,3.124169111251831,81.14050149917603,0 +84,0.5240745544433594,0.43586185574531555,0.4512963593006134,0.25244754552841187,795.030517578125,4.2000000000000004e-06,0.335357129573822,3.3147799968719482,81.14050149917603,0 +85,0.135684072971344,0.3280179798603058,0.3428478538990021,0.22773893177509308,968.2208862304688,4.25e-06,0.13626840710639954,3.254659652709961,81.14050149917603,0 +86,0.2142399400472641,0.49085137248039246,0.4945957362651825,0.19114218652248383,994.9097900390625,4.3e-06,0.1991712599992752,2.8297882080078125,81.14050149917603,0 +87,0.2504022717475891,0.3624758720397949,0.3596667945384979,0.14219114184379578,984.643310546875,4.350000000000001e-06,0.17804798483848572,2.83005690574646,81.14050149917603,0 +88,0.5070254802703857,0.30851542949676514,0.3033638596534729,0.12004662305116653,667.560546875,4.4e-06,0.184503436088562,2.825859308242798,81.14050149917603,0 +89,0.12843751907348633,0.3822925090789795,0.39618465304374695,0.20000000298023224,924.9560546875,4.450000000000001e-06,0.19581001996994019,3.104522943496704,81.14050149917603,0 +90,0.265083909034729,0.5735998153686523,0.5683952569961548,0.23636363446712494,979.8526000976562,4.5e-06,0.13699303567409515,3.302450180053711,81.14050149917603,0 +91,0.4291028380393982,0.47600123286247253,0.4726753830909729,0.23030303418636322,767.5730590820312,4.5500000000000005e-06,0.1621151864528656,3.1070873737335205,81.14050149917603,0 +92,0.6679835319519043,0.34417790174484253,0.3524077534675598,0.18997669219970703,803.7642822265625,4.600000000000001e-06,0.21523788571357727,2.8226499557495117,81.14050149917603,0 +93,0.32807254791259766,0.29350605607032776,0.31113508343696594,0.11025641113519669,737.33203125,4.65e-06,0.23729367554187775,2.8195126056671143,81.14050149917603,0 +94,0.4752184748649597,0.22854290902614594,0.2641198933124542,0.19114218652248383,563.8103637695312,4.7e-06,0.2075466364622116,2.8213162422180176,81.14050149917603,0 +95,0.36218151450157166,0.33554476499557495,0.34769463539123535,0.17529137432575226,928.8597412109375,4.75e-06,0.25594085454940796,3.1008996963500977,81.14050149917603,0 +96,0.287861704826355,0.4680148661136627,0.4847838878631592,0.21958041191101074,984.643310546875,4.800000000000001e-06,0.1429559588432312,3.377779483795166,81.14050149917603,0 +97,0.3335338532924652,0.5061562657356262,0.4980863630771637,0.22494173049926758,972.5713500976562,4.85e-06,0.15142731368541718,3.3090498447418213,81.14050149917603,0 +98,0.5028403401374817,0.442436158657074,0.45949506759643555,0.2298368364572525,550.8392333984375,4.9000000000000005e-06,0.19013790786266327,2.82206130027771,81.14050149917603,0 +99,0.3849470913410187,0.2591531574726105,0.28583991527557373,0.1890442818403244,807.27197265625,4.95e-06,0.1382390260696411,2.8298161029815674,81.14050149917603,0 +100,0.5456168055534363,0.38641801476478577,0.3922293186187744,0.2046620100736618,861.1730346679688,5e-06,0.2294837087392807,2.8253157138824463,81.14050149917603,0 +101,0.36606699228286743,0.34443530440330505,0.3561963438987732,0.2226107269525528,923.2371215820312,5.050000000000001e-06,0.24762330949306488,3.4279110431671143,81.14050149917603,0 +102,0.4231320321559906,0.39791637659072876,0.4157906472682953,0.1958041936159134,850.0933227539062,5.1e-06,0.25594213604927063,3.525360584259033,81.14050149917603,0 +103,0.3774811327457428,0.22521235048770905,0.25158777832984924,0.19883449375629425,629.2960815429688,5.150000000000001e-06,0.41160711646080017,2.8433854579925537,81.14050149917603,0 +104,0.23617379367351532,0.35053199529647827,0.3655988872051239,0.1403263360261917,992.0859375,5.2e-06,0.3046196699142456,2.8298966884613037,81.14050149917603,0 +105,0.24282892048358917,0.21538209915161133,0.23391328752040863,0.23030303418636322,892.0726318359375,5.2500000000000006e-06,0.49991971254348755,2.8412582874298096,81.14050149917603,0 +106,0.31752461194992065,0.356496661901474,0.3719281554222107,0.116317018866539,979.6979370117188,5.300000000000001e-06,0.2002723515033722,2.836639404296875,81.14050149917603,0 +107,0.5244756937026978,0.29774951934814453,0.3158527910709381,0.21911421418190002,864.0462646484375,5.3500000000000004e-06,0.1971268504858017,3.2925920486450195,81.14050149917603,0 +108,0.2897554636001587,0.6561545133590698,0.6339991092681885,0.2254079282283783,980.7741088867188,5.400000000000001e-06,0.3066360652446747,3.521967887878418,81.14050149917603,0 +109,0.38643351197242737,0.25860923528671265,0.2946814000606537,0.20536130666732788,983.9144897460938,5.450000000000001e-06,0.23384295403957367,2.8205490112304688,81.14050149917603,0 +110,0.6231157779693604,0.4663938283920288,0.4632982611656189,0.20722611248493195,915.1390991210938,5.500000000000001e-06,0.2966921031475067,2.836080312728882,81.14050149917603,0 +111,0.3047756552696228,0.3726765513420105,0.37673649191856384,0.2209790199995041,868.7028198242188,5.550000000000001e-06,0.1810176521539688,2.826603889465332,81.14050149917603,0 +112,0.2948944568634033,0.4791984260082245,0.48021483421325684,0.17878787219524384,985.0772094726562,5.600000000000001e-06,0.1442040205001831,2.818298101425171,81.14050149917603,0 +113,0.391147643327713,0.2804250121116638,0.30989503860473633,0.26596736907958984,927.482421875,5.65e-06,0.22407947480678558,3.3947224617004395,81.14050149917603,0 +114,0.5574496388435364,0.35417646169662476,0.35699954628944397,0.19930069148540497,776.0996704101562,5.7e-06,0.19397291541099548,3.435526132583618,81.14050149917603,0 +115,0.3213047683238983,0.4329735338687897,0.4192383587360382,0.1263403296470642,995.035400390625,5.75e-06,0.42750707268714905,2.83553409576416,81.14050149917603,0 +116,0.4917893707752228,0.3969095051288605,0.40478643774986267,0.21491841971874237,750.1998901367188,5.8e-06,0.17132553458213806,2.8287651538848877,81.14050149917603,0 +117,0.40223199129104614,0.3648209571838379,0.39037150144577026,0.23356643319129944,646.8789672851562,5.85e-06,0.27464601397514343,2.831894636154175,81.14050149917603,0 +118,0.5102354288101196,0.3877834379673004,0.3933754861354828,0.18368297815322876,899.0933837890625,5.9e-06,0.15730643272399902,3.0717461109161377,81.14050149917603,0 +119,0.3551454246044159,0.505962073802948,0.5102872848510742,0.20792540907859802,989.1450805664062,5.950000000000001e-06,0.6399093270301819,3.1294217109680176,81.14050149917603,0 +120,0.4052581787109375,0.4339087903499603,0.4327135980129242,0.18578088283538818,955.10791015625,6e-06,0.17262011766433716,3.181377649307251,81.14050149917603,0 +121,0.44928064942359924,0.4317658245563507,0.42831939458847046,0.1958041936159134,959.7694091796875,6.0500000000000005e-06,0.16677124798297882,2.8232598304748535,81.14050149917603,0 +122,0.26446032524108887,0.3415248394012451,0.3395242989063263,0.1878787875175476,924.6715087890625,6.1e-06,0.4966496527194977,2.830791711807251,81.14050149917603,0 +123,0.30686154961586,0.37513959407806396,0.38641661405563354,0.17482517659664154,697.9737548828125,6.15e-06,0.2765401601791382,2.8336985111236572,81.14050149917603,0 +124,0.4455372095108032,0.3258729875087738,0.34178289771080017,0.2622377574443817,793.5297241210938,6.200000000000001e-06,0.75648033618927,3.1173477172851562,81.14050149917603,0 +125,0.4468982219696045,0.28734612464904785,0.2888259291648865,0.15337994694709778,884.2141723632812,6.25e-06,0.24625468254089355,3.373328447341919,81.14050149917603,0 +126,0.4827406704425812,0.31824225187301636,0.3087916374206543,0.14755244553089142,905.37890625,6.300000000000001e-06,0.48760363459587097,3.2912254333496094,81.14050149917603,0 +127,0.41629758477211,0.3545076847076416,0.37160524725914,0.19976690411567688,935.22314453125,6.35e-06,0.17751100659370422,2.8258168697357178,81.14050149917603,0 +128,0.3879561424255371,0.27124613523483276,0.28025147318840027,0.2186480164527893,788.1709594726562,6.4000000000000006e-06,0.20429293811321259,2.8193788528442383,81.14050149917603,0 +129,0.41200369596481323,0.42533427476882935,0.4451431930065155,0.2097902148962021,382.7987976074219,6.450000000000001e-06,0.1625012457370758,2.8272337913513184,81.14050149917603,0 +130,0.4879624545574188,0.25478634238243103,0.2637748122215271,0.2237762212753296,774.4262084960938,6.5000000000000004e-06,0.32937315106391907,3.083451509475708,81.14050149917603,0 +131,0.4368044435977936,0.4755919575691223,0.48754727840423584,0.2501165568828583,375.388671875,6.550000000000001e-06,0.1595010757446289,3.358241319656372,81.14050149917603,0 +132,0.43802571296691895,0.32435500621795654,0.34036266803741455,0.2354312390089035,919.1144409179688,6.600000000000001e-06,0.18744094669818878,3.293945789337158,81.14050149917603,0 +133,0.29001373052597046,0.3113749027252197,0.32555776834487915,0.25407925248146057,730.0392456054688,6.650000000000001e-06,0.18504676222801208,2.832846164703369,81.14050149917603,0 +134,0.5923095345497131,0.4016108810901642,0.4255593717098236,0.26713287830352783,661.8328857421875,6.700000000000001e-06,0.15979209542274475,2.827512264251709,81.14050149917603,0 +135,0.48378127813339233,0.4353737533092499,0.4347040057182312,0.19393938779830933,625.9617919921875,6.750000000000001e-06,0.19195593893527985,2.8371310234069824,81.14050149917603,0 +136,0.3334483504295349,0.38189345598220825,0.3819892108440399,0.18997669219970703,727.9061279296875,6.800000000000001e-06,0.3022500276565552,3.1186344623565674,81.14050149917603,0 +137,0.4558366537094116,0.4012429714202881,0.4063813388347626,0.2645687758922577,806.5763549804688,6.850000000000001e-06,0.3491232991218567,3.6829934120178223,81.14050149917603,0 +138,0.3195555806159973,0.3337846100330353,0.3498416841030121,0.26713287830352783,987.7676391601562,6.9e-06,0.18876110017299652,2.832561492919922,81.14050149917603,0 +139,0.3305108845233917,0.32667601108551025,0.3461519181728363,0.2354312390089035,816.0525512695312,6.95e-06,0.2038465142250061,2.8385372161865234,81.14050149917603,0 +140,0.3556593358516693,0.7297605872154236,0.7412497401237488,0.2599067687988281,183.10153198242188,7e-06,0.14928629994392395,2.8353676795959473,81.14050149917603,0 +141,0.4062281847000122,0.34282001852989197,0.35656917095184326,0.21165500581264496,629.2960815429688,7.05e-06,0.15011702477931976,3.130500078201294,81.14050149917603,0 +142,0.2366541028022766,0.3178958594799042,0.3144257664680481,0.14172494411468506,971.03173828125,7.100000000000001e-06,0.32073575258255005,3.010920763015747,81.14050149917603,0 +143,0.45970267057418823,0.42589980363845825,0.43669751286506653,0.2181818187236786,968.3995361328125,7.15e-06,0.44806888699531555,3.3786661624908447,81.14050149917603,0 +144,0.6211646795272827,0.3487050235271454,0.3611016571521759,0.18531468510627747,722.4732666015625,7.2000000000000005e-06,0.19928504526615143,2.825011730194092,81.14050149917603,0 +145,0.2251199334859848,0.21862849593162537,0.22605793178081512,0.09930069744586945,980.0068969726562,7.25e-06,0.16009743511676788,2.8269526958465576,81.14050149917603,0 +146,0.21178686618804932,0.31413450837135315,0.32190564274787903,0.2282051295042038,959.3736572265625,7.3e-06,0.20352844893932343,2.8246757984161377,81.14050149917603,0 +147,0.3870183825492859,0.4205320179462433,0.4409469664096832,0.1750582754611969,301.4790344238281,7.350000000000001e-06,0.1554160863161087,3.1268045902252197,81.14050149917603,0 +148,0.3807045519351959,0.5723007321357727,0.5732125639915466,0.13682983815670013,992.6078491210938,7.4e-06,0.14065629243850708,3.0544064044952393,81.14050149917603,0 +149,0.3466123342514038,0.36899250745773315,0.37580519914627075,0.24452213943004608,624.2781982421875,7.450000000000001e-06,0.176966592669487,3.3657772541046143,81.14050149917603,0 +150,0.2524626851081848,0.35286879539489746,0.36390969157218933,0.21072261035442352,941.445068359375,7.500000000000001e-06,0.14922495186328888,2.8238630294799805,81.14050149917603,0 +151,0.3107007145881653,0.33164623379707336,0.33660686016082764,0.22074592113494873,905.0384521484375,7.5500000000000006e-06,0.272489458322525,2.8296546936035156,81.14050149917603,0 +152,0.30926209688186646,0.31733736395835876,0.3335450291633606,0.15058274567127228,946.378173828125,7.600000000000001e-06,0.2641890347003937,2.8309249877929688,81.14050149917603,0 +153,0.48828694224357605,0.42550918459892273,0.4262518286705017,0.22214451432228088,965.4962768554688,7.650000000000001e-06,0.26264965534210205,3.0596718788146973,81.14050149917603,0 +154,0.28611570596694946,0.3404020369052887,0.34188809990882874,0.25757575035095215,835.2010498046875,7.7e-06,0.16504478454589844,3.04453182220459,81.14050149917603,0 +155,0.38521936535835266,0.32953691482543945,0.34421306848526,0.2170163094997406,828.0687866210938,7.75e-06,0.20571914315223694,3.528656005859375,81.14050149917603,0 +156,0.3914857804775238,0.2761073708534241,0.3012644052505493,0.22331002354621887,970.6856079101562,7.800000000000002e-06,0.18881674110889435,2.820967197418213,81.14050149917603,0 +157,0.10546465963125229,0.24250289797782898,0.261494904756546,0.09813519567251205,904.6971435546875,7.850000000000001e-06,0.19198569655418396,2.834554433822632,81.14050149917603,0 +158,0.5936620831489563,0.30065837502479553,0.30848613381385803,0.2158508151769638,814.068359375,7.9e-06,0.1882811337709427,2.8363256454467773,81.14050149917603,0 +159,0.11462683975696564,0.4136367440223694,0.41839203238487244,0.1650349646806717,992.2167358398438,7.950000000000002e-06,0.1395157277584076,3.101405382156372,81.14050149917603,0 +160,0.5138846635818481,0.3687047064304352,0.3769722878932953,0.18834498524665833,951.4989624023438,8.000000000000001e-06,0.14931176602840424,3.3272764682769775,81.14050149917603,0 +161,0.35012179613113403,0.3392270505428314,0.33587831258773804,0.20372959971427917,865.4603271484375,8.050000000000001e-06,0.18636387586593628,3.1802871227264404,81.14050149917603,0 +162,0.26975956559181213,0.5432023406028748,0.5591710805892944,0.2170163094997406,287.737548828125,8.1e-06,0.19701650738716125,2.820993661880493,81.14050149917603,0 +163,0.42778462171554565,0.3151106834411621,0.3322048485279083,0.21491841971874237,954.6907958984375,8.15e-06,0.17568500339984894,2.817614793777466,81.14050149917603,0 +164,0.5241044163703918,0.3237394392490387,0.3355603516101837,0.2477855533361435,697.9737548828125,8.2e-06,0.143830344080925,2.8244712352752686,81.14050149917603,0 +165,0.4143238961696625,0.34573960304260254,0.3441670835018158,0.19230769574642181,860.688232421875,8.25e-06,0.5260898470878601,3.0621635913848877,81.14050149917603,0 +166,0.4287804365158081,0.2749935984611511,0.29135143756866455,0.20606060326099396,677.2564697265625,8.3e-06,0.166494682431221,3.290217638015747,81.14050149917603,0 +167,0.23861664533615112,0.24999858438968658,0.26148849725723267,0.22610722482204437,768.4440307617188,8.35e-06,0.1641087681055069,3.2118921279907227,81.14050149917603,0 +168,0.289131224155426,0.31797459721565247,0.32538753747940063,0.269696980714798,828.0687866210938,8.400000000000001e-06,0.1318618357181549,2.817260265350342,81.14050149917603,0 +169,0.4760555922985077,0.3584221601486206,0.37506213784217834,0.17575757205486298,964.3812255859375,8.45e-06,0.24367818236351013,2.817859411239624,81.14050149917603,0 +170,0.2431206852197647,0.35635828971862793,0.36000367999076843,0.2482517510652542,954.6907958984375,8.5e-06,0.177164688706398,2.8260488510131836,81.14050149917603,0 +171,0.3341180980205536,0.3120259642601013,0.33364927768707275,0.13496503233909607,793.5297241210938,8.550000000000001e-06,0.17955410480499268,3.116346836090088,81.14050149917603,0 +172,0.49924206733703613,0.7414923310279846,0.7498102188110352,0.12004662305116653,165.13217163085938,8.6e-06,0.1910885125398636,3.3340368270874023,81.14050149917603,0 +173,0.4992562532424927,0.33636200428009033,0.3540709912776947,0.15454545617103577,648.4168090820312,8.65e-06,0.20966270565986633,3.109037399291992,81.14050149917603,0 +174,0.5770617127418518,0.4013828635215759,0.40846768021583557,0.2265734225511551,658.916015625,8.700000000000001e-06,0.1790282130241394,2.8326852321624756,81.14050149917603,0 +175,0.3588322699069977,0.3311310410499573,0.3376641869544983,0.1678321659564972,708.8218383789062,8.750000000000001e-06,3.2177774906158447,2.8407013416290283,81.14050149917603,0 +176,0.39737096428871155,0.3283724784851074,0.33451974391937256,0.23613053560256958,958.7767944335938,8.8e-06,0.12417174130678177,3.0617120265960693,81.14050149917603,0 +177,0.428996205329895,0.36968302726745605,0.36232131719589233,0.11888112127780914,912.2996826171875,8.85e-06,0.2615879476070404,3.1193361282348633,81.14050149917603,0 +178,0.24751172959804535,0.47790175676345825,0.4796443581581116,0.16899767518043518,976.0529174804688,8.900000000000001e-06,0.20591428875923157,3.3888845443725586,81.14050149917603,0 +179,0.3595922887325287,0.2454671412706375,0.2729416489601135,0.26317015290260315,901.9290771484375,8.95e-06,0.17651277780532837,3.092503070831299,81.14050149917603,0 +180,0.3161213994026184,0.27613478899002075,0.2951752245426178,0.1878787875175476,923.525634765625,9e-06,0.2595895826816559,2.8256640434265137,81.14050149917603,0 +181,0.4171675145626068,0.2612854838371277,0.26511088013648987,0.19930069148540497,863.5715942382812,9.050000000000001e-06,0.15518110990524292,2.8215010166168213,81.14050149917603,0 +182,0.40977656841278076,0.36241504549980164,0.36233359575271606,0.22610722482204437,742.382080078125,9.100000000000001e-06,0.19203706085681915,3.1136653423309326,81.14050149917603,0 +183,0.4779280722141266,0.36836546659469604,0.37659314274787903,0.14755244553089142,933.6696166992188,9.15e-06,0.1962619572877884,3.1124067306518555,81.14050149917603,0 +184,0.4515298902988434,0.4120502769947052,0.42746564745903015,0.09020978957414627,992.0859375,9.200000000000002e-06,0.2108047604560852,3.3388214111328125,81.14050149917603,0 +185,0.508499026298523,0.36155179142951965,0.36177390813827515,0.23706293106079102,629.2960815429688,9.250000000000001e-06,0.555927038192749,3.0894482135772705,81.14050149917603,0 +186,0.5285813808441162,0.6182982325553894,0.6271399855613708,0.2365967333316803,120.44096374511719,9.3e-06,14.425324440002441,2.8198704719543457,81.14050149917603,0 +187,0.27186739444732666,0.25317883491516113,0.27445197105407715,0.23030303418636322,885.0230102539062,9.350000000000002e-06,0.19795258343219757,2.821150302886963,81.14050149917603,0 +188,0.28010761737823486,0.2805686295032501,0.3012056350708008,0.2058275043964386,901.9290771484375,9.4e-06,0.14298364520072937,3.179036855697632,81.14050149917603,0 +189,0.5078593492507935,0.503818929195404,0.4960862398147583,0.18881118297576904,999.8831176757812,9.450000000000001e-06,0.14868707954883575,3.318981647491455,81.14050149917603,0 +190,0.22432348132133484,0.5264550447463989,0.5623428821563721,0.17762237787246704,981.8353881835938,9.5e-06,0.17525304853916168,3.2677290439605713,81.14050149917603,0 +191,0.26547157764434814,0.4489474892616272,0.4544336795806885,0.17529137432575226,960.7506713867188,9.55e-06,0.1385161429643631,3.237545967102051,81.14050149917603,0 +192,0.29249733686447144,0.3793587386608124,0.38542723655700684,0.2174825221300125,936.2454833984375,9.600000000000001e-06,0.13565780222415924,2.8378992080688477,81.14050149917603,0 +193,0.19792284071445465,0.3339279890060425,0.33021190762519836,0.15804195404052734,933.4083862304688,9.65e-06,0.13533183932304382,2.826425313949585,81.14050149917603,0 +194,0.3959636688232422,0.312932550907135,0.31559136509895325,0.26083916425704956,796.51806640625,9.7e-06,0.30391520261764526,3.092759847640991,81.14050149917603,0 +195,0.3713483214378357,0.2675713002681732,0.2880645990371704,0.13170163333415985,883.8079833984375,9.75e-06,0.1862889528274536,3.3060526847839355,81.14050149917603,0 +196,0.5776844024658203,0.3760373592376709,0.3798651397228241,0.19976690411567688,648.4168090820312,9.800000000000001e-06,0.2348981648683548,3.4755585193634033,81.14050149917603,0 +197,0.3181573152542114,0.5755931735038757,0.5750184655189514,0.20000000298023224,970.8588256835938,9.85e-06,0.16103677451610565,2.8340811729431152,81.14050149917603,0 +198,0.17245210707187653,0.2905440330505371,0.30280303955078125,0.09533799439668655,811.3840942382812,9.9e-06,0.1218927651643753,2.838027000427246,81.14050149917603,0 +199,0.5976058840751648,0.29804912209510803,0.3040356934070587,0.20839160680770874,508.12554931640625,9.950000000000001e-06,0.4437941312789917,3.1250925064086914,81.14050149917603,0 +200,0.43565472960472107,0.7553532719612122,0.7516712546348572,0.2610722482204437,140.08938598632812,1e-05,0.1950724571943283,3.054412364959717,81.14050149917603,0 +201,0.47756296396255493,0.31276488304138184,0.3235725164413452,0.1874125897884369,730.0392456054688,1e-05,0.15581947565078735,3.364496946334839,81.14050149917603,0 +202,0.3981838524341583,0.45594286918640137,0.4541204869747162,0.19230769574642181,446.5873107910156,1e-05,0.14857631921768188,3.292942523956299,81.14050149917603,0 +203,0.2300751656293869,0.28394952416419983,0.2913556694984436,0.1566433608531952,870.971435546875,1e-05,0.17642442882061005,2.8298888206481934,81.14050149917603,0 +204,0.3265802562236786,0.34748709201812744,0.3451402187347412,0.11701631546020508,894.70751953125,1e-05,0.19653958082199097,2.831880807876587,81.14050149917603,0 +205,0.2993169128894806,0.4032181203365326,0.4140093922615051,0.19836829602718353,931.025634765625,1e-05,0.15871122479438782,2.8276636600494385,81.14050149917603,0 +206,0.3796365559101105,0.5182041525840759,0.5157318711280823,0.22121211886405945,996.0327758789062,1e-05,2.2354822158813477,3.0587852001190186,81.14050149917603,0 +207,0.3722290098667145,0.2473219931125641,0.2587103545665741,0.22237762808799744,867.7844848632812,1e-05,0.9066340327262878,3.3198952674865723,81.14050149917603,0 +208,0.38722696900367737,0.3677901327610016,0.39305582642555237,0.22960372269153595,966.9605712890625,1e-05,0.13885991275310516,3.3454833030700684,81.14050149917603,0 +209,0.27838438749313354,0.33078131079673767,0.3342663645744324,0.18974359333515167,802.3400268554688,1e-05,0.13174642622470856,2.8211779594421387,81.14050149917603,0 +210,0.3318908214569092,0.3621214032173157,0.3867683410644531,0.2242424190044403,344.2266540527344,1e-05,2.0057363510131836,2.81522536277771,81.14050149917603,0 +211,0.14769099652767181,0.36017313599586487,0.374862402677536,0.10396270453929901,991.8234252929688,1e-05,0.17966128885746002,3.1201953887939453,81.14050149917603,0 +212,0.48316630721092224,0.39484137296676636,0.4004148244857788,0.26247087121009827,527.8575439453125,1e-05,0.25827842950820923,3.0797641277313232,81.14050149917603,0 +213,0.12030838429927826,0.4565894305706024,0.47966739535331726,0.17249417304992676,994.1507568359375,1e-05,0.2534927427768707,3.380188226699829,81.14050149917603,0 +214,0.40094995498657227,0.33382755517959595,0.33702948689460754,0.04731934890151024,968.2208862304688,1e-05,0.18901102244853973,3.238813877105713,81.14050149917603,0 +215,0.2734661102294922,0.2713685631752014,0.2710007429122925,0.22191141545772552,898.011962890625,1e-05,0.15226206183433533,2.830617666244507,81.14050149917603,0 +216,0.37895262241363525,0.4002210199832916,0.4195210635662079,0.20885780453681946,904.0114135742188,1e-05,0.20007680356502533,2.823585033416748,81.14050149917603,0 +217,0.4329289197921753,0.36176958680152893,0.36350610852241516,0.2836829721927643,791.2536010742188,1e-05,0.3552033007144928,2.8272337913513184,81.14050149917603,0 +218,0.22449709475040436,0.20232616364955902,0.21439878642559052,0.1958041936159134,760.4534912109375,1e-05,0.19521084427833557,3.0640006065368652,81.14050149917603,0 +219,0.3725776672363281,0.2571544349193573,0.2718779444694519,0.24522145092487335,748.2748413085938,1e-05,0.135238915681839,3.274339437484741,81.14050149917603,0 +220,0.376485139131546,0.32355475425720215,0.3319142162799835,0.2293706238269806,865.928466796875,1e-05,0.1686982363462448,3.125734329223633,81.14050149917603,0 +221,0.2770368158817291,0.269365131855011,0.2823807895183563,0.21095570921897888,767.5730590820312,1e-05,0.12851691246032715,2.8139870166778564,81.14050149917603,0 +222,0.42488473653793335,0.2938118278980255,0.3030410706996918,0.08251748234033585,914.2007446289062,1e-05,0.14645279943943024,2.813685178756714,81.14050149917603,0 +223,0.35610291361808777,0.3295189142227173,0.3302898705005646,0.06643356382846832,916.991943359375,1e-05,0.1874585747718811,3.0329227447509766,81.14050149917603,0 +224,0.4886572062969208,0.36872294545173645,0.36403688788414,0.23426572978496552,949.5288696289062,1e-05,0.1511247605085373,3.3663785457611084,81.14050149917603,0 +225,0.10947147756814957,0.6205413341522217,0.5968416333198547,0.24988344311714172,997.1378173828125,1e-05,0.22913934290409088,3.284334659576416,81.14050149917603,0 +226,0.36604511737823486,0.35140228271484375,0.35992005467414856,0.23636363446712494,911.9796752929688,1e-05,0.22107891738414764,3.1879005432128906,81.14050149917603,0 +227,0.24107444286346436,0.4147871434688568,0.4123882055282593,0.21445220708847046,971.2042846679688,1e-05,0.1873217225074768,3.0490944385528564,81.14050149917603,0 +228,0.43649834394454956,0.45777904987335205,0.45975232124328613,0.2209790199995041,997.6233520507812,1e-05,0.15107361972332,2.8324241638183594,81.14050149917603,0 +229,0.2237975001335144,0.32063642144203186,0.33693328499794006,0.10582750290632248,979.54296875,1e-05,0.14593447744846344,3.077547311782837,81.14050149917603,0 +230,0.15766625106334686,0.23944944143295288,0.26062989234924316,0.24289044737815857,922.0755004882812,1e-05,0.13820119202136993,3.3737361431121826,81.14050149917603,0 +231,0.18193531036376953,0.3830104172229767,0.3801738917827606,0.15174825489521027,859.223388671875,1e-05,0.2874048352241516,3.2962942123413086,81.14050149917603,0 +232,0.6242539882659912,0.41705596446990967,0.4234813451766968,0.21911421418190002,985.22119140625,1e-05,0.335953027009964,3.186066150665283,81.14050149917603,0 +233,0.295915812253952,0.314121276140213,0.326130211353302,0.26853147149086,858.2379760742188,1e-05,0.13567686080932617,2.8197946548461914,81.14050149917603,0 +234,0.3948702812194824,0.42842867970466614,0.43685218691825867,0.18251748383045197,964.1939697265625,1e-05,1.097593903541565,2.8148441314697266,81.14050149917603,0 +235,0.4432626962661743,0.2973962128162384,0.3418261706829071,0.19953380525112152,999.177734375,1e-05,0.2175290733575821,3.317497730255127,81.14050149917603,0 +236,0.29835155606269836,0.38872450590133667,0.4090365171432495,0.17832167446613312,957.3680419921875,1e-05,0.20545250177383423,3.051387310028076,81.14050149917603,0 +237,0.327316015958786,0.3454808294773102,0.34079378843307495,0.17762237787246704,846.3767700195312,1e-05,0.20049142837524414,3.33882212638855,81.14050149917603,0 +238,0.40098029375076294,0.2610270380973816,0.26582157611846924,0.1023310050368309,760.4534912109375,1e-05,0.22019466757774353,3.1318302154541016,81.14050149917603,0 +239,0.2391374111175537,0.29639503359794617,0.31268301606178284,0.09487179666757584,352.25469970703125,1e-05,0.1560976654291153,2.8158156871795654,81.14050149917603,0 +240,0.43433594703674316,0.31319016218185425,0.30763372778892517,0.13939394056797028,654.4724731445312,1e-05,0.5676911473274231,2.819178342819214,81.14050149917603,0 +241,0.5986763834953308,0.3796635866165161,0.3835848569869995,0.2181818187236786,525.4592895507812,1e-05,0.3284691870212555,3.345097064971924,81.14050149917603,0 +242,0.26252543926239014,0.34749335050582886,0.3660634756088257,0.214685320854187,957.3680419921875,1e-05,0.17018520832061768,3.3434715270996094,81.14050149917603,0 +243,0.37424612045288086,0.34959423542022705,0.36068251729011536,0.19650349020957947,847.9813842773438,1e-05,0.16060690581798553,3.0577340126037598,81.14050149917603,0 +244,0.5973415374755859,0.28064215183258057,0.2957054674625397,0.22517482936382294,546.3833618164062,1e-05,0.26711997389793396,3.1578876972198486,81.14050149917603,0 +245,0.36903518438339233,0.33901065587997437,0.34814149141311646,0.11375291645526886,473.1681213378906,1e-05,0.18100954592227936,2.828338861465454,81.14050149917603,0 +246,0.4236125946044922,0.48495447635650635,0.48112520575523376,0.23006993532180786,367.8310546875,1e-05,0.18779854476451874,2.8284919261932373,81.14050149917603,0 +247,0.38388291001319885,0.6576569676399231,0.6338838934898376,0.2242424190044403,990.76416015625,1e-05,0.12911643087863922,3.433011531829834,81.14050149917603,0 +248,0.44309189915657043,0.3606119751930237,0.36009344458580017,0.2181818187236786,751.1552734375,1e-05,0.1423766165971756,3.299064874649048,81.14050149917603,0 +249,0.3808392584323883,0.36542531847953796,0.3879186809062958,0.249417245388031,323.4160461425781,1e-05,0.22199326753616333,3.21852970123291,81.14050149917603,0 +250,0.275189071893692,0.3102198541164398,0.3260187804698944,0.12424242496490479,475.9952392578125,1e-05,0.17609374225139618,2.822640895843506,81.14050149917603,0 +251,0.45423057675361633,0.3551247715950012,0.36368250846862793,0.17715618014335632,660.37890625,1e-05,0.12059267610311508,2.829986333847046,81.14050149917603,0 +252,0.28954529762268066,0.3650895655155182,0.3748012185096741,0.22867132723331451,899.4515991210938,1e-05,0.14398829638957977,3.076831817626953,81.14050149917603,0 +253,0.439882755279541,0.3250998258590698,0.32808247208595276,0.2666666805744171,663.2779541015625,1e-05,0.15593691170215607,3.1301844120025635,81.14050149917603,0 +254,0.3044920265674591,0.3312731385231018,0.3400203287601471,0.20069929957389832,906.0565185546875,1e-05,0.16252823173999786,3.31864595413208,81.14050149917603,0 +255,0.4953795075416565,0.3147140443325043,0.32750025391578674,0.21328671276569366,735.275390625,1e-05,0.42994800209999084,3.107891321182251,81.14050149917603,0 +256,0.2572953402996063,0.20930534601211548,0.22363241016864777,0.12657342851161957,968.9326171875,1e-05,0.1319117397069931,2.8263087272644043,81.14050149917603,0 +257,0.1899718940258026,0.26171350479125977,0.26701846718788147,0.11724941432476044,734.2389526367188,1e-05,0.15777544677257538,2.8240933418273926,81.14050149917603,0 +258,0.38159969449043274,0.3857562243938446,0.39000219106674194,0.2533799409866333,936.2454833984375,1e-05,0.1852463334798813,3.085265636444092,81.14050149917603,0 +259,0.3419513702392578,0.3421502709388733,0.35155025124549866,0.2270396202802658,855.743408203125,1e-05,0.16265161335468292,3.14267635345459,81.14050149917603,0 +260,0.4554416537284851,0.25104156136512756,0.2769579589366913,0.1655011624097824,759.5440063476562,1e-05,0.14074748754501343,3.317875623703003,81.14050149917603,0 +261,0.44349923729896545,0.3550877571105957,0.361618310213089,0.20233100652694702,744.3661499023438,1e-05,0.1579582840204239,3.145317316055298,81.14050149917603,0 +262,0.19478043913841248,0.33690157532691956,0.3383403420448303,0.2209790199995041,926.9263305664062,1e-05,0.11723772436380386,2.8355627059936523,81.14050149917603,0 +263,0.2950980067253113,0.42162129282951355,0.4202665090560913,0.22121211886405945,952.1465454101562,1e-05,0.1433117538690567,2.8325235843658447,81.14050149917603,0 +264,0.20891022682189941,0.24806556105613708,0.2676716148853302,0.23030303418636322,692.97265625,1e-05,0.20051880180835724,3.0853447914123535,81.14050149917603,0 +265,0.4685238301753998,0.3403940796852112,0.37020647525787354,0.26317015290260315,935.4796752929688,1e-05,0.20809534192085266,3.036137342453003,81.14050149917603,0 +266,0.17008472979068756,0.30209845304489136,0.3127642273902893,0.1566433608531952,768.4440307617188,1e-05,0.14239372313022614,3.0936408042907715,81.14050149917603,0 +267,0.3139408826828003,0.4210430681705475,0.43396809697151184,0.15477855503559113,987.7676391601562,1e-05,0.18255837261676788,3.1669387817382812,81.14050149917603,0 +268,0.3139711916446686,0.28102654218673706,0.29698580503463745,0.18018648028373718,988.8717041015625,1e-05,0.13059160113334656,2.8208255767822266,81.14050149917603,0 +269,0.3797535002231598,0.5247040390968323,0.5356224775314331,0.1818181872367859,975.5648193359375,1e-05,0.1586935669183731,2.8143985271453857,81.14050149917603,0 +270,0.34769368171691895,0.33654090762138367,0.3456178307533264,0.15034964680671692,915.7601928710938,1e-05,0.2469453066587448,3.0509073734283447,81.14050149917603,0 +271,0.34641197323799133,0.38391247391700745,0.3838987946510315,0.2778554856777191,700.4320068359375,1e-05,1.218087911605835,3.0510334968566895,81.14050149917603,0 +272,0.4029103219509125,0.37700074911117554,0.38140520453453064,0.08135198056697845,957.5706176757812,1e-05,0.2093794345855713,3.0760562419891357,81.14050149917603,0 +273,0.3669174015522003,0.2500845193862915,0.26302406191825867,0.2242424190044403,988.5972900390625,1e-05,0.15933169424533844,3.1596245765686035,81.14050149917603,0 +274,0.4199508726596832,0.30075281858444214,0.30880624055862427,0.16037295758724213,974.4140625,1e-05,0.26088881492614746,2.813854455947876,81.14050149917603,0 +275,0.42568472027778625,0.33973580598831177,0.34727296233177185,0.1867132931947708,708.8218383789062,1e-05,0.19069057703018188,2.814427137374878,81.14050149917603,0 +276,0.2518462836742401,0.43184390664100647,0.4681938886642456,0.15780885517597198,152.77052307128906,1e-05,0.18543030321598053,3.0749197006225586,81.14050149917603,0 +277,0.4110962450504303,0.21724779903888702,0.22770385444164276,0.20046620070934296,749.2398071289062,1e-05,0.3060530424118042,3.3537039756774902,81.14050149917603,0 +278,0.42500925064086914,0.24882550537586212,0.27413883805274963,0.19720280170440674,927.2047729492188,1e-05,0.16202057898044586,2.8209941387176514,81.14050149917603,0 +279,0.34659913182258606,0.3702024221420288,0.3641250729560852,0.23403263092041016,983.3262329101562,1e-05,0.24230830371379852,3.1034531593322754,81.14050149917603,0 +280,0.5122885704040527,0.5355335474014282,0.5548672676086426,0.21351981163024902,158.9905548095703,1e-05,0.14869937300682068,2.8252627849578857,81.14050149917603,0 +281,0.3517119884490967,0.35398274660110474,0.3764147460460663,0.2913752794265747,296.9483642578125,1e-05,0.5157060623168945,2.8343732357025146,81.14050149917603,0 +282,0.17274785041809082,0.24369797110557556,0.25526607036590576,0.19813519716262817,904.6971435546875,1e-05,0.17051126062870026,3.095515489578247,81.14050149917603,0 +283,0.44945183396339417,0.5093854069709778,0.5100268125534058,0.1867132931947708,382.7987976074219,1e-05,0.16217240691184998,3.302168846130371,81.14050149917603,0 +284,0.13755972683429718,0.2391916662454605,0.25604861974716187,0.12494172155857086,984.7882080078125,1e-05,0.17737743258476257,2.8267433643341064,81.14050149917603,0 +285,0.3321883976459503,0.28196945786476135,0.2954274117946625,0.08158507943153381,951.0648803710938,1e-05,0.16236773133277893,3.1392385959625244,81.14050149917603,0 +286,0.2902749478816986,0.27970170974731445,0.3064152002334595,0.21888111531734467,411.0456848144531,1e-05,0.29455965757369995,2.821824789047241,81.14050149917603,0 +287,0.46449726819992065,0.34525638818740845,0.3404334485530853,0.21491841971874237,919.7131958007812,1e-05,0.28141939640045166,2.8173134326934814,81.14050149917603,0 +288,0.3019911050796509,0.21026696264743805,0.22976438701152802,0.2321678251028061,682.6182250976562,1e-05,0.17118726670742035,3.0958590507507324,81.14050149917603,0 +289,0.405150830745697,0.35740533471107483,0.35867467522621155,0.2270396202802658,903.3214111328125,1e-05,0.17684656381607056,3.359307050704956,81.14050149917603,0 +290,0.10243570804595947,0.36709994077682495,0.3674378991127014,0.24195803701877594,937.2574462890625,1e-05,0.18306706845760345,2.8212733268737793,81.14050149917603,0 +291,0.3862895369529724,0.2948858141899109,0.30542176961898804,0.20442891120910645,947.5157470703125,1e-05,0.1589934378862381,3.1161065101623535,81.14050149917603,0 +292,0.1857955902814865,0.25991636514663696,0.28070658445358276,0.25198134779930115,945.4581298828125,1e-05,1.2372667789459229,2.8270630836486816,81.14050149917603,0 +293,0.44754353165626526,0.31340473890304565,0.3370421230792999,0.2337995320558548,550.8392333984375,1e-05,0.16802747547626495,2.831467866897583,81.14050149917603,0 +294,0.28152960538864136,0.25179871916770935,0.2771468460559845,0.14475524425506592,955.10791015625,1e-05,0.12534327805042267,3.328847646713257,81.14050149917603,0 +295,0.28957685828208923,0.32166701555252075,0.3283241093158722,0.25874125957489014,610.396240234375,1e-05,0.15630081295967102,3.3142309188842773,81.14050149917603,0 +296,0.15181376039981842,0.5040781497955322,0.5201761722564697,0.16923077404499054,997.0159301757812,1e-05,0.16620585322380066,3.084155559539795,81.14050149917603,0 +297,0.34800297021865845,0.4526861608028412,0.4560220241546631,0.19114218652248383,969.6383056640625,1e-05,0.21825823187828064,2.8179407119750977,81.14050149917603,0 +298,0.3550381660461426,0.2691972553730011,0.2951255440711975,0.2158508151769638,861.1730346679688,1e-05,0.16019316017627716,2.8211562633514404,81.14050149917603,0 +299,0.39218199253082275,0.3592293858528137,0.3476737141609192,0.19696970283985138,932.8836669921875,1e-05,0.17278937995433807,2.815418243408203,81.14050149917603,0 +300,0.42319169640541077,0.35389474034309387,0.35210421681404114,0.18298368155956268,732.1500854492188,1e-05,0.38723164796829224,3.317570209503174,81.14050149917603,0 +301,0.2149040251970291,0.4108741879463196,0.423500657081604,0.2489510476589203,991.2958374023438,1e-05,0.29229283332824707,3.2856810092926025,81.14050149917603,0 +302,0.28977692127227783,0.6981956958770752,0.7025367021560669,0.2214452177286148,177.18624877929688,1e-05,0.2282668799161911,3.105003595352173,81.14050149917603,0 +303,0.4140557646751404,0.28168511390686035,0.29323944449424744,0.14335663616657257,712.31884765625,1e-05,0.18695497512817383,2.819340944290161,81.14050149917603,0 +304,0.38981255888938904,0.26639729738235474,0.27419260144233704,0.16456876695156097,762.2591552734375,1e-05,0.19289056956768036,2.8215019702911377,81.14050149917603,0 +305,0.35545408725738525,0.22915621101856232,0.23902010917663574,0.20396269857883453,846.9136352539062,1e-05,0.1771112084388733,2.824795961380005,81.14050149917603,0 +306,0.2794400751590729,0.2545821964740753,0.2690926492214203,0.2545454502105713,961.7210693359375,1e-05,0.1451350450515747,3.3232595920562744,81.14050149917603,0 +307,0.25189509987831116,0.32556426525115967,0.3436189293861389,0.2652680575847626,981.5336303710938,1e-05,0.20387741923332214,3.261472225189209,81.14050149917603,0 +308,0.22585883736610413,0.3373604714870453,0.3380034863948822,0.20442891120910645,936.2454833984375,1e-05,0.14965540170669556,3.1566555500030518,81.14050149917603,0 +309,0.196272075176239,0.41653963923454285,0.43295153975486755,0.23426572978496552,475.9952392578125,1e-05,0.1651005893945694,2.8394885063171387,81.14050149917603,0 +310,0.347042977809906,0.28566691279411316,0.2852885127067566,0.18484848737716675,835.2010498046875,1e-05,0.21502478420734406,2.8337371349334717,81.14050149917603,0 +311,0.4653399586677551,0.41812920570373535,0.4249270558357239,0.24731934070587158,601.3294677734375,1e-05,0.17369525134563446,3.132397174835205,81.14050149917603,0 +312,0.3849792182445526,0.2882569134235382,0.2958512008190155,0.2209790199995041,664.7142333984375,1e-05,0.15450075268745422,3.1239817142486572,81.14050149917603,0 +313,0.5025281310081482,0.349264919757843,0.3564589321613312,0.19953380525112152,932.3563232421875,1e-05,0.1639735847711563,3.2886555194854736,81.14050149917603,0 +314,0.3144809305667877,0.2769463062286377,0.3119349479675293,0.24918414652347565,835.7803955078125,1e-05,0.18172986805438995,3.129887342453003,81.14050149917603,0 +315,0.38294127583503723,0.5574218034744263,0.5719764232635498,0.08694638311862946,194.7152557373047,1e-05,0.15829113125801086,2.8261539936065674,81.14050149917603,0 +316,0.35176897048950195,0.2736266553401947,0.28644269704818726,0.20349650084972382,764.04736328125,1e-05,0.2297801524400711,2.8271381855010986,81.14050149917603,0 +317,0.31783586740493774,0.30723658204078674,0.3111130893230438,0.22517482936382294,978.7633666992188,1e-05,0.15515516698360443,3.1206037998199463,81.14050149917603,0 +318,0.1647254377603531,0.28441935777664185,0.2855655252933502,0.2582750618457794,896.920654296875,1e-05,0.174981027841568,3.072878360748291,81.14050149917603,0 +319,0.29913637042045593,0.3160054087638855,0.3227176070213318,0.2142191082239151,820.587890625,1e-05,0.13651043176651,3.3856959342956543,81.14050149917603,0 +320,0.2514936029911041,0.3968813419342041,0.3991073668003082,0.1818181872367859,917.9066772460938,1e-05,0.13936804234981537,2.823068618774414,81.14050149917603,0 +321,0.21360096335411072,0.3258751928806305,0.33658644556999207,0.2181818187236786,982.5844116210938,1e-05,0.18327410519123077,2.81950044631958,81.14050149917603,0 +322,0.26333072781562805,0.21667353808879852,0.23888255655765533,0.19207459688186646,976.69921875,1e-05,0.5475432276725769,2.826141595840454,81.14050149917603,0 +323,0.23555634915828705,0.31375670433044434,0.3459029197692871,0.1762237697839737,999.0592651367188,1e-05,0.153407022356987,3.0878987312316895,81.14050149917603,0 +324,0.26175177097320557,0.41409215331077576,0.4259670078754425,0.15874126553535461,996.771484375,1e-05,0.16696390509605408,3.3686420917510986,81.14050149917603,0 +325,0.1176692321896553,0.46999993920326233,0.47550398111343384,0.24032634496688843,998.4646606445312,1e-05,0.3639015853404999,3.139655113220215,81.14050149917603,0 +326,0.4344276487827301,0.38781049847602844,0.38051295280456543,0.22167831659317017,983.0303955078125,1e-05,0.1716000735759735,2.823789358139038,81.14050149917603,0 +327,0.26331818103790283,0.37649548053741455,0.3807958662509918,0.12937062978744507,943.3546142578125,1e-05,0.2515203058719635,2.8371801376342773,81.14050149917603,0 +328,0.3651229441165924,0.3293170630931854,0.33166834712028503,0.2097902148962021,985.5084838867188,1e-05,0.16785213351249695,2.8344316482543945,81.14050149917603,0 +329,0.30127400159835815,0.5496059060096741,0.5170131325721741,0.220279723405838,966.77880859375,1e-05,0.2308841496706009,3.1382691860198975,81.14050149917603,0 +330,0.1723984330892563,0.3037356436252594,0.3257829546928406,0.2554778456687927,973.9156494140625,1e-05,0.16668719053268433,3.3457446098327637,81.14050149917603,0 +331,0.5060230493545532,0.32757315039634705,0.32725945115089417,0.17529137432575226,890.9254760742188,1e-05,1.0739552974700928,3.3327279090881348,81.14050149917603,0 +332,0.1935655176639557,0.2596670985221863,0.2725224792957306,0.19417248666286469,951.0648803710938,1e-05,0.11753607541322708,2.850313901901245,81.14050149917603,0 +333,0.38499221205711365,0.20427855849266052,0.22886845469474792,0.23449882864952087,842.5615844726562,1e-05,0.1752542406320572,2.8472273349761963,81.14050149917603,0 +334,0.1744261384010315,0.43730929493904114,0.4268348813056946,0.225874125957489,990.630615234375,1e-05,0.1850653439760208,2.830354928970337,81.14050149917603,0 +335,0.4108644723892212,0.3464946448802948,0.34094876050949097,0.20396269857883453,720.25927734375,1e-05,0.1546715646982193,3.078474998474121,81.14050149917603,0 +336,0.31312838196754456,0.24312284588813782,0.27257513999938965,0.2433566451072693,972.5713500976562,1e-05,0.14868468046188354,3.3699138164520264,81.14050149917603,0 +337,0.37545686960220337,0.4428349435329437,0.44240397214889526,0.19324009120464325,356.2078552246094,1e-05,0.13856396079063416,3.1020681858062744,81.14050149917603,0 +338,0.10540448874235153,0.22762282192707062,0.2518651485443115,0.18554778397083282,972.5713500976562,1e-05,3.019737720489502,2.8300418853759766,81.14050149917603,0 +339,0.32357412576675415,0.3319733738899231,0.33893081545829773,0.2321678251028061,931.2932739257812,1e-05,0.17580609023571014,2.823017120361328,81.14050149917603,0 +340,0.36422428488731384,0.372106671333313,0.37548017501831055,0.07738927751779556,983.767822265625,1e-05,0.37261414527893066,2.8254222869873047,81.14050149917603,0 +341,0.4860779941082001,0.3321206867694855,0.33592328429222107,0.2657342553138733,778.5809936523438,1e-05,0.16509096324443817,3.348957061767578,81.14050149917603,0 +342,0.15347371995449066,0.2991616129875183,0.3019600510597229,0.25081583857536316,996.1564331054688,1e-05,0.15897415578365326,3.078531503677368,81.14050149917603,0 +343,0.3613260090351105,0.31719449162483215,0.33433112502098083,0.17832167446613312,808.654296875,1e-05,0.18736381828784943,3.096491813659668,81.14050149917603,0 +344,0.28693512082099915,0.33254310488700867,0.3311026096343994,0.2885780930519104,944.2952880859375,1e-05,0.18119579553604126,2.8249874114990234,81.14050149917603,0 +345,0.3503625690937042,0.37727999687194824,0.3864520788192749,0.22634032368659973,495.12713623046875,1e-05,0.14578159153461456,2.8286709785461426,81.14050149917603,0 +346,0.5497797131538391,0.3106926381587982,0.3255448639392853,0.269696980714798,586.15087890625,1e-05,0.19444149732589722,3.0352392196655273,81.14050149917603,0 +347,0.31441277265548706,0.26279938220977783,0.2913336157798767,0.20046620070934296,888.9893188476562,1e-05,0.17832162976264954,3.0399558544158936,81.14050149917603,0 +348,0.25471124053001404,0.3369951546192169,0.33535218238830566,0.2142191082239151,964.1939697265625,1e-05,0.5968493819236755,3.3786637783050537,81.14050149917603,0 +349,0.5123908519744873,0.31346023082733154,0.3291495740413666,0.23799534142017365,737.33203125,1e-05,0.18046478927135468,3.1644599437713623,81.14050149917603,0 +350,0.4153687059879303,0.4239440858364105,0.4195270836353302,0.2421911358833313,983.4736938476562,1e-05,0.19512495398521423,2.8187968730926514,81.14050149917603,0 +351,0.575855553150177,0.28794199228286743,0.2962910532951355,0.255011647939682,842.5615844726562,1e-05,0.20612965524196625,2.819841146469116,81.14050149917603,0 +352,0.34413406252861023,0.2217896729707718,0.24381490051746368,0.25757575035095215,930.2188720703125,1e-05,3.3081440925598145,3.056029796600342,81.14050149917603,0 +353,0.2501809895038605,0.4330264627933502,0.4379616379737854,0.16969697177410126,973.5816040039062,1e-05,0.1356925219297409,3.0665504932403564,81.14050149917603,0 +354,0.40983888506889343,0.2706604599952698,0.28256896138191223,0.22517482936382294,568.0068969726562,1e-05,0.20159190893173218,3.3321125507354736,81.14050149917603,0 +355,0.34020519256591797,0.3094277083873749,0.3144732415676117,0.225874125957489,920.0114135742188,1e-05,0.14133107662200928,2.8281052112579346,81.14050149917603,0 +356,0.33613714575767517,0.38326773047447205,0.37496790289878845,0.2745920717716217,903.3214111328125,1e-05,0.20442208647727966,2.8400464057922363,81.14050149917603,0 +357,0.2233133465051651,0.22094586491584778,0.23297739028930664,0.12097901850938797,779.4003295898438,1e-05,0.21497979760169983,2.8389689922332764,81.14050149917603,0 +358,0.4013136923313141,0.35666653513908386,0.34795036911964417,0.17039626836776733,922.3670654296875,1e-05,0.2231377363204956,3.087420701980591,81.14050149917603,0 +359,0.317259281873703,0.226571187376976,0.24471697211265564,0.264102578163147,608.6077880859375,1e-05,0.3821319043636322,3.123565196990967,81.14050149917603,0 +360,0.18006101250648499,0.26849016547203064,0.27251413464546204,0.2482517510652542,784.2387084960938,1e-05,0.17508314549922943,3.1046864986419678,81.14050149917603,0 +361,0.393045574426651,0.30770090222358704,0.31516748666763306,0.22284382581710815,739.3676147460938,1e-05,0.17571505904197693,2.8274950981140137,81.14050149917603,0 +362,0.28060460090637207,0.31480300426483154,0.3173886835575104,0.23146852850914001,773.583740234375,1e-05,0.14665617048740387,2.820664644241333,81.14050149917603,0 +363,0.31647902727127075,0.2436659336090088,0.2560492753982544,0.2377622425556183,924.6715087890625,1e-05,0.13457714021205902,2.8180718421936035,81.14050149917603,0 +364,0.44077008962631226,0.30857864022254944,0.30885767936706543,0.16573426127433777,705.2662353515625,1e-05,0.18363986909389496,3.0527634620666504,81.14050149917603,0 +365,0.451345294713974,0.4229621887207031,0.42593052983283997,0.20955711603164673,427.6461486816406,1e-05,0.46543288230895996,3.421553134918213,81.14050149917603,0 +366,0.31585022807121277,0.29127418994903564,0.3027101159095764,0.2354312390089035,951.4989624023438,1e-05,0.16795575618743896,3.4212961196899414,81.14050149917603,0 +367,0.33484017848968506,0.23549795150756836,0.2468448430299759,0.16643357276916504,660.37890625,1e-05,0.26740095019340515,2.8166913986206055,81.14050149917603,0 +368,0.12433507293462753,0.3159741163253784,0.3181340992450714,0.19720280170440674,952.1465454101562,1e-05,0.1836899071931839,2.827791452407837,81.14050149917603,0 +369,0.33337193727493286,0.21667352318763733,0.22695839405059814,0.21678321063518524,686.5575561523438,1e-05,0.1769568920135498,2.823944330215454,81.14050149917603,0 +370,0.23513881862163544,0.3599928319454193,0.3531912863254547,0.16573426127433777,953.0025024414062,1e-05,0.19617334008216858,3.113269805908203,81.14050149917603,0 +371,0.399897962808609,0.301440954208374,0.2901953458786011,0.22004662454128265,851.6567993164062,1e-05,0.16184809803962708,3.367764949798584,81.14050149917603,0 +372,0.3723334074020386,0.4534367322921753,0.44015252590179443,0.16526806354522705,953.8506469726562,1e-05,0.1256699413061142,3.1357486248016357,81.14050149917603,0 +373,0.15941648185253143,0.31400150060653687,0.3266725540161133,0.2405594438314438,924.6715087890625,1e-05,0.16815271973609924,2.8284590244293213,81.14050149917603,0 +374,0.23144899308681488,0.33944767713546753,0.3493461012840271,0.2013985961675644,816.7084350585938,1e-05,0.15314270555973053,2.8291127681732178,81.14050149917603,0 +375,0.13478749990463257,0.33826038241386414,0.34030628204345703,0.09580419212579727,975.7278442382812,1e-05,0.16142089664936066,2.821291923522949,81.14050149917603,0 +376,0.3710992634296417,0.4222731292247772,0.417763888835907,0.2209790199995041,894.3345947265625,1e-05,0.24771997332572937,3.0691263675689697,81.14050149917603,0 +377,0.4950711727142334,0.6172141432762146,0.6191545128822327,0.2097902148962021,165.13217163085938,1e-05,0.2032078206539154,3.420116424560547,81.14050149917603,0 +378,0.2761997580528259,0.34046289324760437,0.34577739238739014,0.14335663616657257,854.2249145507812,1e-05,0.38179662823677063,3.081714391708374,81.14050149917603,0 +379,0.19041332602500916,0.3479664623737335,0.356035053730011,0.2501165568828583,945.226806640625,1e-05,0.14836350083351135,2.825024127960205,81.14050149917603,0 +380,0.32804223895072937,0.2898141145706177,0.30351802706718445,0.250582754611969,981.0787963867188,1e-05,0.21423499286174774,2.8183884620666504,81.14050149917603,0 +381,0.44555428624153137,0.44227492809295654,0.44514235854148865,0.18484848737716675,954.8995971679688,1e-05,0.4225669503211975,2.8253960609436035,81.14050149917603,0 +382,0.36404168605804443,0.2611449062824249,0.2635590732097626,0.2298368364572525,663.2779541015625,1e-05,0.18231680989265442,3.370393753051758,81.14050149917603,0 +383,0.283075749874115,0.2772839069366455,0.29026341438293457,0.24195803701877594,708.8218383789062,1e-05,0.22167333960533142,3.435900926589966,81.14050149917603,0 +384,0.35405755043029785,0.2917446494102478,0.31654036045074463,0.23799534142017365,470.316650390625,1e-05,0.8347265720367432,2.8350043296813965,81.14050149917603,0 +385,0.3558334708213806,0.22494275867938995,0.2432336062192917,0.16083915531635284,913.8861694335938,1e-05,0.15408876538276672,2.830888032913208,81.14050149917603,0 +386,0.35837671160697937,0.3087800443172455,0.33243924379348755,0.19766899943351746,944.0609741210938,1e-05,0.14438758790493011,2.8423142433166504,81.14050149917603,0 +387,0.40724197030067444,0.22787868976593018,0.2476910799741745,0.28787878155708313,673.1508178710938,1e-05,0.16877461969852448,3.0562052726745605,81.14050149917603,0 +388,0.25407418608665466,0.22600694000720978,0.23893821239471436,0.24009324610233307,819.3053588867188,1e-05,0.23221832513809204,3.093682289123535,81.14050149917603,0 +389,0.2728431224822998,0.2733418047428131,0.2947843372821808,0.13519813120365143,978.9199829101562,1e-05,0.1633996069431305,3.3942010402679443,81.14050149917603,0 +390,0.18846240639686584,0.27239277958869934,0.2924555838108063,0.11142191290855408,837.505126953125,1e-05,0.13232176005840302,2.8227736949920654,81.14050149917603,0 +391,0.5033249855041504,0.2658005952835083,0.2729782164096832,0.08881118893623352,902.2786865234375,1e-05,0.39873337745666504,2.820659875869751,81.14050149917603,0 +392,0.2969037890434265,0.3901107907295227,0.4013756811618805,0.20722611248493195,977.4996337890625,1e-05,0.2375820428133011,2.823099374771118,81.14050149917603,0 +393,0.3901793360710144,0.5159600377082825,0.5299789905548096,0.25151515007019043,273.5347900390625,1e-05,0.15590016543865204,3.090946674346924,81.14050149917603,0 +394,0.2785712480545044,0.3653796315193176,0.37348854541778564,0.24382284283638,634.2159423828125,1e-05,0.15850286185741425,3.0926287174224854,81.14050149917603,0 +395,0.3215029239654541,0.37408143281936646,0.3930595815181732,0.23636363446712494,993.1259155273438,1e-05,0.24268773198127747,3.3561015129089355,81.14050149917603,0 +396,0.4669453501701355,0.34792545437812805,0.36817440390586853,0.21072261035442352,997.1378173828125,1e-05,0.2850762903690338,2.8388805389404297,81.14050149917603,0 +397,0.32844892144203186,0.3902210295200348,0.39774900674819946,0.20652680099010468,924.6715087890625,1e-05,0.29998570680618286,2.8344438076019287,81.14050149917603,0 +398,0.43459102511405945,0.3155898153781891,0.3230228126049042,0.15920746326446533,502.9901123046875,1e-05,0.1973809450864792,2.8410987854003906,81.14050149917603,0 +399,0.27088218927383423,0.22640646994113922,0.24533532559871674,0.28787878155708313,629.2960815429688,1e-05,0.15601147711277008,3.137993812561035,81.14050149917603,0 +400,0.28360795974731445,0.26025423407554626,0.27973759174346924,0.1878787875175476,849.041259765625,1e-05,0.1889539361000061,3.1173529624938965,81.14050149917603,0 +401,0.40539225935935974,0.38757601380348206,0.39171838760375977,0.11142191290855408,853.203369140625,1e-05,0.19295555353164673,3.1442456245422363,81.14050149917603,0 +402,0.419950395822525,0.42311760783195496,0.4156038165092468,0.25920745730400085,991.0303955078125,1e-05,0.1983073502779007,2.8265438079833984,81.14050149917603,0 +403,0.23010390996932983,0.22193601727485657,0.23577357828617096,0.16713286936283112,721.369140625,1e-05,0.1920057088136673,2.8216917514801025,81.14050149917603,0 +404,0.35204702615737915,0.17838424444198608,0.2123386114835739,0.2377622425556183,686.5575561523438,1e-05,0.33800098299980164,2.8256564140319824,81.14050149917603,0 +405,0.2660806179046631,0.2313867062330246,0.24674326181411743,0.18018648028373718,910.0397338867188,1e-05,0.14417357742786407,3.041541337966919,81.14050149917603,0 +406,0.3041248619556427,0.32578375935554504,0.3294510841369629,0.12051282078027725,925.2398681640625,1e-05,0.19957512617111206,3.40523624420166,81.14050149917603,0 +407,0.20331376791000366,0.3416382968425751,0.3358430862426758,0.2599067687988281,969.2862548828125,1e-05,0.18252642452716827,3.0725390911102295,81.14050149917603,0 +408,0.25648146867752075,0.24171705543994904,0.26611071825027466,0.1610722541809082,886.6248779296875,1e-05,0.46618232131004333,2.8234288692474365,81.14050149917603,0 +409,0.37481361627578735,0.2882763147354126,0.299122154712677,0.2713286578655243,742.382080078125,1e-05,0.17899054288864136,2.828216075897217,81.14050149917603,0 +410,0.33038443326950073,0.268390953540802,0.27993807196617126,0.1627039611339569,940.2321166992188,1e-05,0.21026906371116638,2.8221774101257324,81.14050149917603,0 +411,0.39873114228248596,0.3437938690185547,0.3542923927307129,0.23589743673801422,724.6637573242188,1e-05,0.13453839719295502,3.1109023094177246,81.14050149917603,0 +412,0.21355122327804565,0.2494024932384491,0.25835520029067993,0.14941725134849548,990.36279296875,1e-05,0.13914045691490173,3.454059362411499,81.14050149917603,0 +413,0.23549626767635345,0.7514728903770447,0.7489476203918457,0.23030303418636322,999.4136352539062,1e-05,0.16886690258979797,2.8381755352020264,81.14050149917603,0 +414,0.38950860500335693,0.2340480387210846,0.26411160826683044,0.19976690411567688,932.3563232421875,1e-05,0.5168572068214417,2.825591802597046,81.14050149917603,0 +415,0.38167887926101685,0.2912171185016632,0.31027981638908386,0.17132866382598877,817.3616943359375,1e-05,0.15096183121204376,2.8270063400268555,81.14050149917603,0 +416,0.5178435444831848,0.3843916356563568,0.3870638906955719,0.1515151560306549,960.5552368164062,1e-05,0.17243468761444092,2.824734687805176,81.14050149917603,0 +417,0.3956911563873291,0.3545226752758026,0.3523177206516266,0.2337995320558548,593.8468017578125,1e-05,0.30184295773506165,3.0841357707977295,81.14050149917603,0 +418,0.2613409757614136,0.3495252728462219,0.3653802275657654,0.2489510476589203,971.2042846679688,1e-05,0.12032128870487213,3.357555389404297,81.14050149917603,0 +419,0.30143508315086365,0.2711547613143921,0.2886204719543457,0.22960372269153595,947.5157470703125,1e-05,0.3033623695373535,2.8187782764434814,81.14050149917603,0 +420,0.2331685721874237,0.22552862763404846,0.25179123878479004,0.17016316950321198,691.7044067382812,1e-05,0.5536629557609558,2.823678493499756,81.14050149917603,0 +421,0.23342940211296082,0.19268015027046204,0.21614184975624084,0.18857808411121368,557.397705078125,1e-05,0.13808001577854156,2.8210651874542236,81.14050149917603,0 +422,0.43046805262565613,0.2253454476594925,0.2345617413520813,0.23333333432674408,812.7318115234375,1e-05,0.17352524399757385,3.0506811141967773,81.14050149917603,0 +423,0.3120573163032532,0.28765812516212463,0.29464036226272583,0.18298368155956268,931.025634765625,1e-05,0.2793522775173187,3.075652599334717,81.14050149917603,0 +424,0.3046640157699585,0.35831430554389954,0.364830881357193,0.25081583857536316,835.2010498046875,1e-05,0.15430885553359985,3.4217145442962646,81.14050149917603,0 +425,0.4495793581008911,0.3124169409275055,0.3184420168399811,0.255011647939682,794.2818603515625,1e-05,0.25408974289894104,3.1372320652008057,81.14050149917603,0 +426,0.2542388439178467,0.2049599587917328,0.21250882744789124,0.24428904056549072,671.7659301757812,1e-05,0.14971347153186798,2.825239419937134,81.14050149917603,0 +427,0.351982057094574,0.3138648569583893,0.3289076089859009,0.22610722482204437,714.6185302734375,1e-05,0.26284757256507874,2.830543041229248,81.14050149917603,0 +428,0.19959500432014465,0.5265432596206665,0.5144659876823425,0.17762237787246704,977.65869140625,1e-05,0.2511240243911743,3.14241886138916,81.14050149917603,0 +429,0.4830499291419983,0.37334349751472473,0.4003959894180298,0.1258741319179535,994.9097900390625,1e-05,0.20619945228099823,3.2894420623779297,81.14050149917603,0 +430,0.29863670468330383,0.24340128898620605,0.2580827474594116,0.17202797532081604,935.22314453125,1e-05,0.16375723481178284,3.3189525604248047,81.14050149917603,0 +431,0.3434745669364929,0.3739219605922699,0.3715463876724243,0.20675989985466003,889.7675170898438,1e-05,0.27208635210990906,2.831629991531372,81.14050149917603,0 +432,0.3342190682888031,0.22429239749908447,0.22932566702365875,0.1554778516292572,821.8599853515625,1e-05,0.15842224657535553,2.828951358795166,81.14050149917603,0 +433,0.2425958216190338,0.2751343250274658,0.2722935676574707,0.17202797532081604,783.4415283203125,1e-05,0.3985488712787628,2.831024408340454,81.14050149917603,0 +434,0.24553675949573517,0.21038903295993805,0.24253731966018677,0.225874125957489,931.826171875,1e-05,0.15768510103225708,3.1413559913635254,81.14050149917603,0 +435,0.2821704149246216,0.3713845908641815,0.3785466253757477,0.21888111531734467,586.15087890625,1e-05,0.11756690591573715,3.2429521083831787,81.14050149917603,0 +436,0.4364219605922699,0.2524695098400116,0.2678600549697876,0.1303030252456665,829.883544921875,1e-05,0.1640436351299286,3.3471574783325195,81.14050149917603,0 +437,0.23486706614494324,0.33008426427841187,0.3205675780773163,0.21608391404151917,803.0537109375,1e-05,0.15802690386772156,2.827378034591675,81.14050149917603,0 +438,0.20562788844108582,0.2967499792575836,0.31597334146499634,0.2114219069480896,449.6458740234375,1e-05,0.1600145548582077,2.8265230655670166,81.14050149917603,0 +439,0.1507016271352768,0.276610404253006,0.28954043984413147,0.21678321063518524,997.3809814453125,1e-05,0.1441088318824768,2.831434726715088,81.14050149917603,0 +440,0.4074943959712982,0.3152901530265808,0.33086609840393066,0.2354312390089035,977.4996337890625,1e-05,0.2964320480823517,3.0540244579315186,81.14050149917603,0 +441,0.28650999069213867,0.36261868476867676,0.3700328767299652,0.24848484992980957,613.9371337890625,1e-05,0.15102149546146393,3.3236923217773438,81.14050149917603,0 +442,0.3266417384147644,0.17626039683818817,0.19243912398815155,0.22447551786899567,789.71923828125,1e-05,0.17251864075660706,3.0789635181427,81.14050149917603,0 +443,0.2602521777153015,0.2669603228569031,0.271597683429718,0.13776223361492157,935.22314453125,1e-05,0.23356562852859497,2.815126419067383,81.14050149917603,0 +444,0.3253997564315796,0.3597539961338043,0.3595881760120392,0.20606060326099396,601.3294677734375,1e-05,0.8586739301681519,2.819653272628784,81.14050149917603,0 +445,0.3127663731575012,0.30004453659057617,0.3073137104511261,0.1818181872367859,835.7803955078125,1e-05,0.1433805227279663,2.8266944885253906,81.14050149917603,0 +446,0.31455400586128235,0.3303234577178955,0.34075480699539185,0.22610722482204437,797.99267578125,1e-05,0.13808795809745789,3.109943389892578,81.14050149917603,0 +447,0.1973268836736679,0.2009524255990982,0.2123730480670929,0.2030303031206131,928.5856323242188,1e-05,0.15213927626609802,3.31712007522583,81.14050149917603,0 +448,0.4744594693183899,0.37160491943359375,0.370492547750473,0.22867132723331451,604.99365234375,1e-05,0.1895080804824829,3.0967161655426025,81.14050149917603,0 +449,0.37827932834625244,0.2564869225025177,0.26053887605667114,0.15734265744686127,923.525634765625,1e-05,0.1658136546611786,2.8351752758026123,81.14050149917603,0 +450,0.3885272741317749,0.3161585032939911,0.3264245092868805,0.279720276594162,727.9061279296875,1e-05,0.8874546885490417,2.833984375,81.14050149917603,0 +451,0.44680777192115784,0.21275177597999573,0.24496902525424957,0.19883449375629425,969.4624633789062,1e-05,1.3007125854492188,3.0616633892059326,81.14050149917603,0 +452,0.42005500197410583,0.23669615387916565,0.2713349163532257,0.238228440284729,649.9450073242188,1e-05,0.1811627596616745,3.013941526412964,81.14050149917603,0 +453,0.3022654056549072,0.26252323389053345,0.27441850304603577,0.15804195404052734,741.38232421875,1e-05,0.1724032163619995,3.3093063831329346,81.14050149917603,0 +454,0.26723402738571167,0.14273014664649963,0.17020784318447113,0.1946386992931366,885.4254760742188,1e-05,0.17674583196640015,3.0166356563568115,81.14050149917603,0 +455,0.27935171127319336,0.31112125515937805,0.3260137736797333,0.1515151560306549,732.1500854492188,1e-05,0.14121265709400177,2.8248746395111084,81.14050149917603,0 +456,0.42129606008529663,0.31155458092689514,0.325883686542511,0.2596736550331116,527.8575439453125,1e-05,0.2132323831319809,2.820221424102783,81.14050149917603,0 +457,0.37486812472343445,0.31470954418182373,0.34782838821411133,0.20909090340137482,982.2857666015625,1e-05,0.2212052345275879,3.04986572265625,81.14050149917603,0 +458,0.3603946268558502,0.3266216814517975,0.32821017503738403,0.22610722482204437,878.402587890625,1e-05,0.20020517706871033,3.00465726852417,81.14050149917603,0 +459,0.26078084111213684,0.2110603302717209,0.21488361060619354,0.11515151709318161,753.992919921875,1e-05,0.13346338272094727,3.0801286697387695,81.14050149917603,0 +460,0.27182722091674805,0.2704053223133087,0.29014670848846436,0.2377622425556183,864.5192260742188,1e-05,0.3375239670276642,3.063800573348999,81.14050149917603,0 +461,0.2998088598251343,0.5690131783485413,0.5738910436630249,0.19510489702224731,989.6887817382812,1e-05,0.2214280664920807,2.819741725921631,81.14050149917603,0 +462,0.5441367030143738,0.348738431930542,0.3555360734462738,0.24452213943004608,963.818115234375,1e-05,0.17918585240840912,2.8141074180603027,81.14050149917603,0 +463,0.2259199470281601,0.46988198161125183,0.46528252959251404,0.18018648028373718,958.7767944335938,1e-05,0.16572347283363342,3.0628085136413574,81.14050149917603,0 +464,0.24142274260520935,0.5578375458717346,0.564176619052887,0.269696980714798,120.44096374511719,1e-05,0.13955295085906982,3.0494890213012695,81.14050149917603,0 +465,0.4656801223754883,0.20652760565280914,0.2275322675704956,0.23333333432674408,773.583740234375,1e-05,0.14490634202957153,3.341068983078003,81.14050149917603,0 +466,0.3491869270801544,0.20687168836593628,0.2309437096118927,0.1990675926208496,935.7356567382812,1e-05,0.1624203324317932,3.016950845718384,81.14050149917603,0 +467,0.21413323283195496,0.3897787630558014,0.3801799714565277,0.23752914369106293,938.0095825195312,1e-05,0.7209783792495728,2.8252923488616943,81.14050149917603,0 +468,0.4457559585571289,0.4187799394130707,0.43091002106666565,0.23892773687839508,331.87054443359375,1e-05,0.13792234659194946,2.83065128326416,81.14050149917603,0 +469,0.21293874084949493,0.2191266268491745,0.23908062279224396,0.18857808411121368,870.5208129882812,1e-05,0.17909841239452362,3.13004207611084,81.14050149917603,0 +470,0.19505219161510468,0.30446645617485046,0.3045090436935425,0.23170162737369537,940.7190551757812,1e-05,0.1383035033941269,3.1166749000549316,81.14050149917603,0 +471,0.4009167551994324,0.21676746010780334,0.23099291324615479,0.12237761914730072,913.5706787109375,1e-05,0.17052717506885529,3.2788844108581543,81.14050149917603,0 +472,0.3752966523170471,0.692969799041748,0.6949397325515747,0.2030303031206131,188.9440460205078,1e-05,0.19566577672958374,3.012324333190918,81.14050149917603,0 +473,0.3737124502658844,0.23550693690776825,0.25213783979415894,0.20629370212554932,864.0462646484375,1e-05,0.32201868295669556,2.83286452293396,81.14050149917603,0 +474,0.3262249231338501,0.21562202274799347,0.24237285554409027,0.16923077404499054,386.44976806640625,1e-05,0.30238106846809387,2.827786922454834,81.14050149917603,0 +475,0.36435937881469727,0.32683801651000977,0.34224626421928406,0.22284382581710815,985.0772094726562,1e-05,0.24315160512924194,3.0661935806274414,81.14050149917603,0 +476,0.4471657872200012,0.36936458945274353,0.362853467464447,0.19650349020957947,492.46246337890625,1e-05,0.22233246266841888,3.2785568237304688,81.14050149917603,0 +477,0.2896515130996704,0.3503629267215729,0.3601946532726288,0.07342657446861267,310.39483642578125,1e-05,0.11400846391916275,3.2562148571014404,81.14050149917603,0 +478,0.23868565261363983,0.29783639311790466,0.31738123297691345,0.21561771631240845,975.0736083984375,1e-05,0.13899120688438416,3.0083625316619873,81.14050149917603,0 +479,0.2416396141052246,0.24618946015834808,0.25557005405426025,0.1023310050368309,942.1655883789062,1e-05,0.25146839022636414,2.8193843364715576,81.14050149917603,0 +480,0.32676470279693604,0.30224353075027466,0.3066616952419281,0.17039626836776733,870.5208129882812,1e-05,0.18556936085224152,2.8279941082000732,81.14050149917603,0 +481,0.42395758628845215,0.3366357684135437,0.33353909850120544,0.26153844594955444,914.5143432617188,1e-05,0.18355393409729004,3.075831890106201,81.14050149917603,0 +482,0.45234739780426025,0.21847988665103912,0.23503528535366058,0.12820512056350708,810.7058715820312,1e-05,3.163438320159912,3.0957324504852295,81.14050149917603,0 +483,0.26290425658226013,0.3587039113044739,0.3965866267681122,0.1895104944705963,997.3809814453125,1e-05,0.13131219148635864,3.2573013305664062,81.14050149917603,0 +484,0.25072774291038513,0.1826523393392563,0.21517686545848846,0.22331002354621887,809.341064453125,1e-05,0.14876826107501984,3.0124566555023193,81.14050149917603,0 +485,0.35827457904815674,0.28471803665161133,0.2878400385379791,0.23636363446712494,924.9560546875,1e-05,0.5076504945755005,2.82718563079834,81.14050149917603,0 +486,0.2351517230272293,0.2614145874977112,0.26601916551589966,0.14195804297924042,930.2188720703125,1e-05,0.1278952658176422,2.825012445449829,81.14050149917603,0 +487,0.1546783745288849,0.29141488671302795,0.3027958273887634,0.21794871985912323,904.6971435546875,1e-05,0.13645082712173462,3.3118791580200195,81.14050149917603,0 +488,0.32753345370292664,0.34956228733062744,0.35078558325767517,0.23613053560256958,864.0462646484375,1e-05,0.19024698436260223,3.083322286605835,81.14050149917603,0 +489,0.18355664610862732,0.36095449328422546,0.3687633275985718,0.13519813120365143,908.7275390625,1e-05,0.1749199628829956,3.3582279682159424,81.14050149917603,0 +490,0.22487252950668335,0.36098170280456543,0.36852097511291504,0.1662004590034485,989.41748046875,1e-05,0.1689070612192154,3.021629571914673,81.14050149917603,0 +491,0.2772260308265686,0.25635582208633423,0.2814812660217285,0.19114218652248383,891.6915283203125,1e-05,0.17649126052856445,2.818305015563965,81.14050149917603,0 +492,0.3598175048828125,0.6867241859436035,0.6851354241371155,0.19976690411567688,152.77052307128906,1e-05,0.16237489879131317,3.068997621536255,81.14050149917603,0 +493,0.3367556929588318,0.30536526441574097,0.31768301129341125,0.15897436439990997,969.9888916015625,1e-05,0.1374475061893463,3.0266025066375732,81.14050149917603,0 +494,0.2225976288318634,0.33287811279296875,0.337930291891098,0.24242423474788666,699.2063598632812,1e-05,0.16129259765148163,3.309488296508789,81.14050149917603,0 +495,0.2828611731529236,0.2699284553527832,0.26946204900741577,0.22610722482204437,856.7466430664062,1e-05,0.17288324236869812,3.2962331771850586,81.14050149917603,0 +496,0.15167765319347382,0.3293938934803009,0.33929720520973206,0.2293706238269806,949.9702758789062,1e-05,0.579917848110199,2.8253262042999268,81.14050149917603,0 +497,0.16494058072566986,0.28973379731178284,0.30179885029792786,0.26247087121009827,771.0321044921875,1e-05,0.22677144408226013,2.8309035301208496,81.14050149917603,0 +498,0.12627935409545898,0.3463692367076874,0.3382570743560791,0.16573426127433777,952.5755615234375,1e-05,0.1556338369846344,3.063539981842041,81.14050149917603,0 +499,0.3102380037307739,0.3230611979961395,0.3236384689807892,0.16969697177410126,809.341064453125,1e-05,0.15531040728092194,3.0769970417022705,81.14050149917603,0 +500,0.3407678008079529,0.2269592434167862,0.24072600901126862,0.1594405621290207,691.7044067382812,1e-05,0.2798785865306854,3.294956922531128,81.14050149917603,0 +501,0.34602683782577515,0.26465603709220886,0.27773916721343994,0.07925407588481903,630.94677734375,1e-05,0.1550317257642746,3.1152164936065674,81.14050197601318,0 +502,0.1841001957654953,0.31459158658981323,0.3183009922504425,0.22843822836875916,978.9199829101562,1e-05,0.14441068470478058,2.8090715408325195,81.14050197601318,0 +503,0.24768783152103424,0.2769153416156769,0.2829228937625885,0.1291375309228897,900.1648559570312,1e-05,0.2401902973651886,2.8186721801757812,81.14050197601318,0 +504,0.3875916004180908,0.3854357898235321,0.38828933238983154,0.20000000298023224,675.8961181640625,1e-05,0.15784993767738342,3.07019305229187,81.14050197601318,0 +505,0.3626725375652313,0.1992352157831192,0.21315181255340576,0.220279723405838,980.0068969726562,1e-05,0.1459614634513855,3.3926639556884766,81.14050197601318,0 +506,0.19576427340507507,0.1839722990989685,0.19524502754211426,0.08857809007167816,853.203369140625,1e-05,0.12246754765510559,3.0986239910125732,81.14050197601318,0 +507,0.4220718741416931,0.29378578066825867,0.30709680914878845,0.12680652737617493,980.3147583007812,1e-05,0.16358567774295807,3.3398749828338623,81.14050197601318,0 +508,0.512883722782135,0.2905254662036896,0.2909454107284546,0.23356643319129944,301.4790344238281,1e-05,1.38388991355896,2.819995164871216,81.14050197601318,0 +509,0.3319265842437744,0.3485637903213501,0.3467882573604584,0.214685320854187,632.5867309570312,1e-05,0.1863129585981369,2.829230785369873,81.14050197601318,0 +510,0.21473687887191772,0.48897966742515564,0.49663278460502625,0.12331002205610275,993.7682495117188,1e-05,0.17635543644428253,3.2445502281188965,81.14050197601318,0 +511,0.33024877309799194,0.41363275051116943,0.41057106852531433,0.2114219069480896,984.0607299804688,1e-05,0.1790429800748825,3.321589708328247,81.14050197601318,0 +512,0.33854222297668457,0.21765455603599548,0.23220103979110718,0.25920745730400085,917.2977905273438,1e-05,0.20604944229125977,3.0853917598724365,81.14050197601318,0 +513,0.3616206645965576,0.4960179030895233,0.4994169771671295,0.20652680099010468,301.4790344238281,1e-05,0.15876494348049164,3.086660146713257,81.14050197601318,0 +514,0.27754342555999756,0.20388083159923553,0.2060611993074417,0.15594404935836792,840.3358154296875,1e-05,0.17824605107307434,2.83319354057312,81.14050197601318,0 +515,0.4342667758464813,0.2633665204048157,0.28062519431114197,0.10699300467967987,770.1734008789062,1e-05,0.17828665673732758,2.8274295330047607,81.14050197601318,0 +516,0.30034568905830383,0.4090273678302765,0.40913474559783936,0.11235430836677551,980.4682006835938,1e-05,0.1645880788564682,3.240422010421753,81.14050197601318,0 +517,0.1568000167608261,0.3674352169036865,0.3674173653125763,0.20955711603164673,971.03173828125,1e-05,0.23980864882469177,3.378109931945801,81.14050197601318,0 +518,0.3389926552772522,0.39219918847084045,0.3849460780620575,0.21794871985912323,776.0996704101562,1e-05,0.1954774111509323,3.0010883808135986,81.14050197601318,0 +519,0.2895897924900055,0.30710262060165405,0.3305008113384247,0.10862471163272858,999.177734375,1e-05,0.15822061896324158,2.8201303482055664,81.14050197601318,0 +520,0.2626309096813202,0.3445644676685333,0.3505183160305023,0.19254079461097717,992.477783203125,1e-05,0.14360924065113068,2.8188672065734863,81.14050197601318,0 +521,0.4255504310131073,0.36043134331703186,0.37709662318229675,0.21888111531734467,310.39483642578125,1e-05,0.19731201231479645,2.822967052459717,81.14050197601318,0 +522,0.4424189627170563,0.23059004545211792,0.25111934542655945,0.1414918452501297,955.523193359375,1e-05,0.14497868716716766,3.3563337326049805,81.14050197601318,0 +523,0.13943924009799957,0.5365355014801025,0.51722651720047,0.22494173049926758,977.3401489257812,1e-05,0.12691918015480042,3.0222253799438477,81.14050197601318,0 +524,0.2404913604259491,0.5650913715362549,0.549868106842041,0.22191141545772552,998.34521484375,1e-05,0.2914483845233917,3.095374345779419,81.14050197601318,0 +525,0.2204323410987854,0.32364755868911743,0.3352701961994171,0.20629370212554932,856.2459106445312,1e-05,0.19332805275917053,2.8355603218078613,81.14050197601318,0 +526,0.21186016499996185,0.29524970054626465,0.2992563545703888,0.22331002354621887,933.1463012695312,1e-05,0.1379096359014511,2.8403842449188232,81.14050197601318,0 +527,0.5856224298477173,0.29100197553634644,0.30421778559684753,0.2097902148962021,942.1655883789062,1e-05,0.17773452401161194,2.837690830230713,81.14050197601318,0 +528,0.255410373210907,0.2517123818397522,0.28748419880867004,0.19650349020957947,340.1504821777344,1e-05,0.2666127681732178,3.3665921688079834,81.14050197601318,0 +529,0.22137828171253204,0.41197073459625244,0.43905675411224365,0.21678321063518524,993.5120239257812,1e-05,0.130644753575325,3.064621686935425,81.14050197601318,0 +530,0.279345840215683,0.34328246116638184,0.3664794862270355,0.15454545617103577,959.3736572265625,1e-05,0.1900595724582672,3.089322090148926,81.14050197601318,0 +531,0.39505499601364136,0.16783057153224945,0.18652920424938202,0.17132866382598877,933.4083862304688,1e-05,0.15263818204402924,2.8215596675872803,81.14050197601318,0 +532,0.4416050314903259,0.24488332867622375,0.25398722290992737,0.20652680099010468,922.3670654296875,1e-05,0.19742554426193237,2.8170695304870605,81.14050197601318,0 +533,0.40489256381988525,0.5409344434738159,0.5591482520103455,0.1662004590034485,140.08938598632812,1e-05,0.6617043018341064,2.820655584335327,81.14050197601318,0 +534,0.24545416235923767,0.26476481556892395,0.2695918679237366,0.08484848588705063,836.3575439453125,1e-05,0.15068136155605316,3.2684926986694336,81.14050197601318,0 +535,0.311042457818985,0.41469717025756836,0.40870293974876404,0.22074592113494873,296.9483642578125,1e-05,0.15593434870243073,2.818880558013916,81.14050197601318,0 +536,0.4224710464477539,0.30699649453163147,0.3370925784111023,0.1958041936159134,978.9199829101562,1e-05,0.17872849106788635,3.303095579147339,81.14050197601318,0 +537,0.4482153654098511,0.3711581528186798,0.38432812690734863,0.2449883371591568,481.577392578125,1e-05,0.19786286354064941,2.8255746364593506,81.14050197601318,0 +538,0.24714575707912445,0.31711411476135254,0.32126113772392273,0.2393939346075058,961.334228515625,1e-05,0.45523324608802795,2.8233089447021484,81.14050197601318,0 +539,0.29928693175315857,0.22854508459568024,0.2476925551891327,0.25198134779930115,946.8348388671875,1e-05,0.15446743369102478,3.047703742980957,81.14050197601318,0 +540,0.3609779477119446,0.3576712906360626,0.36465662717819214,0.24801865220069885,492.46246337890625,1e-05,0.2636950612068176,3.313602924346924,81.14050197601318,0 +541,0.27568942308425903,0.2325555384159088,0.25393372774124146,0.23682983219623566,966.596923828125,1e-05,0.16451966762542725,2.8290419578552246,81.14050197601318,0 +542,0.3030979633331299,0.39901483058929443,0.4123894274234772,0.21491841971874237,954.271728515625,1e-05,0.14194373786449432,3.269216299057007,81.14050197601318,0 +543,0.20658493041992188,0.26889047026634216,0.28241828083992004,0.27365967631340027,868.7028198242188,1e-05,0.11415647715330124,2.8344357013702393,81.14050197601318,0 +544,0.2676885426044464,0.30596596002578735,0.3004409372806549,0.250582754611969,994.4046630859375,1e-05,0.21711024641990662,2.8385746479034424,81.14050197601318,0 +545,0.3663128912448883,0.5311008095741272,0.5447417497634888,0.2405594438314438,200.4163818359375,1e-05,0.13920874893665314,3.1158454418182373,81.14050197601318,0 +546,0.3335387110710144,0.33346062898635864,0.33404964208602905,0.23356643319129944,870.0686645507812,1e-05,0.5623235702514648,3.311805486679077,81.14050197601318,0 +547,0.3721323013305664,0.3705122768878937,0.36684125661849976,0.19813519716262817,910.6900634765625,1e-05,0.136457160115242,2.8269858360290527,81.14050197601318,0 +548,0.2616865634918213,0.382396936416626,0.3750838041305542,0.22470861673355103,781.836181640625,1e-05,0.17208793759346008,3.272592067718506,81.14050197601318,0 +549,0.17986316978931427,0.3402254283428192,0.33696696162223816,0.19393938779830933,885.8264770507812,1e-05,0.12703146040439606,2.8231937885284424,81.14050197601318,0 +550,0.26052016019821167,0.3784649074077606,0.38592782616615295,0.21212121844291687,861.1730346679688,1e-05,0.15156781673431396,2.8249142169952393,81.14050197601318,0 +551,0.23914600908756256,0.38952070474624634,0.38658997416496277,0.18881118297576904,913.5706787109375,1e-05,0.26711592078208923,3.1425232887268066,81.14050197601318,0 +552,0.33968910574913025,0.4053936302661896,0.40279829502105713,0.2461538463830948,987.069091796875,1e-05,0.13549183309078217,3.2677342891693115,81.14050197601318,0 +553,0.5272032618522644,0.6061407327651978,0.6083499193191528,0.12074591964483261,165.13217163085938,1e-05,0.15258662402629852,2.8331878185272217,81.14050197601318,0 +554,0.331118643283844,0.43129900097846985,0.43560975790023804,0.20606060326099396,934.9658203125,1e-05,0.15219104290008545,3.100647211074829,81.14050197601318,0 +555,0.2683470845222473,0.29671066999435425,0.29822733998298645,0.017482517287135124,931.826171875,1e-05,0.1468571126461029,2.827416181564331,81.14050197601318,0 +556,0.2827673852443695,0.32681944966316223,0.3359019160270691,0.09650349617004395,962.2981567382812,1e-05,0.8701900243759155,2.8424148559570312,81.14050197601318,0 +557,0.4744968116283417,0.6021789908409119,0.6087362766265869,0.21351981163024902,243.64947509765625,1e-05,0.18201851844787598,3.399463415145874,81.14050197601318,0 +558,0.28964468836784363,0.2928923964500427,0.30711281299591064,0.15524475276470184,976.2150268554688,1e-05,0.13538284599781036,3.0452330112457275,81.14050197601318,0 +559,0.3202548027038574,0.2797281742095947,0.2947394549846649,0.18135197460651398,912.93701171875,1e-05,0.15761110186576843,2.8243930339813232,81.14050197601318,0 +560,0.136890709400177,0.33282971382141113,0.3375343680381775,0.1666666716337204,972.9094848632812,1e-05,0.12063614279031754,3.088421583175659,81.14050197601318,0 +561,0.5063827633857727,0.5006360411643982,0.4929119646549225,0.21002331376075745,217.11199951171875,1e-05,0.1488880068063736,2.8229615688323975,81.14050197601318,0 +562,0.24407553672790527,0.24226780235767365,0.26137274503707886,0.1470862478017807,561.6887817382812,1e-05,0.11534615606069565,3.055941581726074,81.14050197601318,0 +563,0.4566975235939026,0.19079890847206116,0.20318494737148285,0.15571095049381256,864.9906616210938,1e-05,0.47807562351226807,3.2909204959869385,81.14050197601318,0 +564,0.3047489821910858,0.2813746929168701,0.2840576171875,0.2310023307800293,821.2252807617188,1e-05,0.1759568750858307,3.0937535762786865,81.14050197601318,0 +565,0.2253146469593048,0.39664289355278015,0.40714940428733826,0.2174825221300125,411.0456848144531,1e-05,0.1178952306509018,3.0360026359558105,81.14050197601318,0 +566,0.34406551718711853,0.41016727685928345,0.4033929407596588,0.23729602992534637,955.9364624023438,1e-05,0.33680635690689087,3.116015672683716,81.14050197601318,0 +567,0.4149084985256195,0.3267458975315094,0.3238748610019684,0.2543123662471771,789.71923828125,1e-05,0.17690962553024292,2.8366475105285645,81.14050197601318,0 +568,0.23754505813121796,0.33541014790534973,0.3469822108745575,0.15920746326446533,936.7528076171875,1e-05,0.21477898955345154,3.0720720291137695,81.14050197601318,0 +569,0.40676364302635193,0.239411398768425,0.24705535173416138,0.14755244553089142,668.9708251953125,1e-05,0.15054507553577423,3.333573579788208,81.14050197601318,0 +570,0.1685534417629242,0.34625494480133057,0.3541828393936157,0.21934731304645538,960.7506713867188,1e-05,0.41409948468208313,3.0976712703704834,81.14050197601318,0 +571,0.1512901932001114,0.19388465583324432,0.20043951272964478,0.1790209710597992,857.74267578125,1e-05,0.14161935448646545,3.04254150390625,81.14050197601318,0 +572,0.2715508043766022,0.3745746612548828,0.38814982771873474,0.28671327233314514,624.2781982421875,1e-05,0.29417407512664795,3.1131458282470703,81.14050197601318,0 +573,0.4207586348056793,0.40969932079315186,0.4054871201515198,0.15361304581165314,959.966552734375,1e-05,0.1408473402261734,2.8285975456237793,81.14050197601318,0 +574,0.45151248574256897,0.2917090356349945,0.2907598316669464,0.17575757205486298,582.22021484375,1e-05,0.1778055876493454,3.1580135822296143,81.14050197601318,0 +575,0.2612724006175995,0.3332572877407074,0.3445386588573456,0.16596736013889313,985.364990234375,1e-05,0.24711444973945618,3.005916118621826,81.14050197601318,0 +576,0.36730653047561646,0.33642202615737915,0.34502407908439636,0.22913752496242523,704.0678100585938,1e-05,0.20442940294742584,3.093461751937866,81.14050197601318,0 +577,0.4184902310371399,0.31188324093818665,0.33209118247032166,0.19230769574642181,972.0613403320312,1e-05,0.14061498641967773,3.0773122310638428,81.14050197601318,0 +578,0.34680068492889404,0.27617231011390686,0.28267407417297363,0.1722610741853714,798.72509765625,1e-05,0.18382883071899414,3.0725488662719727,81.14050197601318,0 +579,0.2713472545146942,0.29973432421684265,0.3133663237094879,0.12564101815223694,981.9857788085938,1e-05,0.17914418876171112,2.831115484237671,81.14050197601318,0 +580,0.3818584978580475,0.29679015278816223,0.3145722448825836,0.2181818187236786,622.5833740234375,1e-05,0.15260951220989227,3.09649920463562,81.14050197601318,0 +581,0.4464961290359497,0.2674519419670105,0.2781863510608673,0.2477855533361435,879.6704711914062,1e-05,0.20195285975933075,3.2960336208343506,81.14050197601318,0 +582,0.25115641951560974,0.4274502098560333,0.42334720492362976,0.18694639205932617,990.228515625,1e-05,0.17567691206932068,3.0523440837860107,81.14050197601318,0 +583,0.18945443630218506,0.39013636112213135,0.3969208300113678,0.2074592113494873,970.8588256835938,1e-05,0.13767071068286896,3.2991201877593994,81.14050197601318,0 +584,0.2099965363740921,0.3224165439605713,0.34465134143829346,0.24242423474788666,991.8234252929688,1e-05,0.11731292307376862,2.8395066261291504,81.14050197601318,0 +585,0.4960588216781616,0.204465851187706,0.2161892056465149,0.2030303031206131,928.8597412109375,1e-05,0.1807873696088791,2.8357315063476562,81.14050197601318,0 +586,0.2843272387981415,0.4338527023792267,0.45474773645401,0.1722610741853714,985.0772094726562,1e-05,0.20804674923419952,3.1188032627105713,81.14050197601318,0 +587,0.2827226221561432,0.41539716720581055,0.3940578103065491,0.21188810467720032,998.2254028320312,1e-05,0.1621660739183426,3.0470545291900635,81.14050197601318,0 +588,0.2201630026102066,0.5089499354362488,0.5029460787773132,0.12121211737394333,993.7682495117188,1e-05,0.21076399087905884,3.0705227851867676,81.14050197601318,0 +589,0.31272292137145996,0.326189786195755,0.3375820517539978,0.2097902148962021,907.0654907226562,1e-05,0.272399365901947,3.267549991607666,81.14050197601318,0 +590,0.4353191554546356,0.2360820323228836,0.2645007371902466,0.23729602992534637,946.8348388671875,1e-05,0.2232894003391266,2.818300724029541,81.14050197601318,0 +591,0.5709447860717773,0.21261997520923615,0.23125049471855164,0.23892773687839508,772.7371215820312,1e-05,0.3655378520488739,2.8307881355285645,81.14050197601318,0 +592,0.21633200347423553,0.30265066027641296,0.3122115731239319,0.15291374921798706,921.19580078125,1e-05,0.15173646807670593,3.34238862991333,81.14050197601318,0 +593,0.28037574887275696,0.37431079149246216,0.37991708517074585,0.1890442818403244,963.251220703125,1e-05,0.24905917048454285,3.0129404067993164,81.14050197601318,0 +594,0.27350687980651855,0.3495115041732788,0.36334726214408875,0.25874125957489014,939.9876098632812,1e-05,1.7725085020065308,2.830204963684082,81.14050197601318,0 +595,0.39790892601013184,0.2582222819328308,0.26158154010772705,0.1750582754611969,866.3948974609375,1e-05,0.27813971042633057,3.3086273670196533,81.14050197601318,0 +596,0.18321968615055084,0.2699672281742096,0.2869468331336975,0.2708624601364136,917.6026611328125,1e-05,0.14086245000362396,2.8395919799804688,81.14050197601318,0 +597,0.2710495591163635,0.27609288692474365,0.28679078817367554,0.20652680099010468,862.6173095703125,1e-05,0.15032631158828735,2.8399882316589355,81.14050197601318,0 +598,0.2872748076915741,0.37360909581184387,0.3816852867603302,0.25524476170539856,968.3995361328125,1e-05,0.22117525339126587,3.4107308387756348,81.14050197601318,0 +599,0.3048335611820221,0.3986159861087799,0.40604308247566223,0.22214451432228088,963.0614624023438,1e-05,0.18488605320453644,3.22255277633667,81.14050197601318,0 +600,0.44070157408714294,0.24348941445350647,0.25521230697631836,0.1850815862417221,467.44049072265625,1e-05,0.14872650802135468,3.0296528339385986,81.14050197601318,0 +601,0.2546016275882721,0.32665473222732544,0.33067193627357483,0.2522144615650177,994.6576538085938,1e-05,0.1417578011751175,3.1101953983306885,81.14050197601318,0 +602,0.32323014736175537,0.245195209980011,0.262995183467865,0.2046620100736618,837.505126953125,1e-05,0.20179767906665802,2.815192699432373,81.14050197601318,0 +603,0.20764422416687012,0.2067771852016449,0.22501249611377716,0.12727272510528564,969.4624633789062,1e-05,0.1868692934513092,3.134227752685547,81.14050197601318,0 +604,0.33318978548049927,0.3042248785495758,0.31090444326400757,0.20629370212554932,912.2996826171875,1e-05,0.2421974539756775,3.2911694049835205,81.14050197601318,0 +605,0.17000773549079895,0.39711815118789673,0.3862438499927521,0.1354312300682068,977.0203857421875,1e-05,0.20647519826889038,3.2910349369049072,81.14050197601318,0 +606,0.3901591897010803,0.3403765559196472,0.34410014748573303,0.16083915531635284,955.523193359375,1e-05,0.15592771768569946,3.0544488430023193,81.14050197601318,0 +607,0.2412404716014862,0.2812492549419403,0.2851898968219757,0.2466200441122055,838.6439208984375,1e-05,0.15741175413131714,3.097849130630493,81.14050197601318,0 +608,0.3997904360294342,0.3644523024559021,0.3611941337585449,0.2046620100736618,796.51806640625,1e-05,0.1965913325548172,2.823457956314087,81.14050197601318,0 +609,0.5544358491897583,0.4083026051521301,0.41326600313186646,0.2097902148962021,979.2321166992188,1e-05,0.2302432358264923,3.066789388656616,81.14050197601318,0 +610,0.4324256181716919,0.6264980435371399,0.6593478322029114,0.22564102709293365,127.0761489868164,1e-05,0.14789637923240662,3.3560638427734375,81.14050197601318,0 +611,0.17447073757648468,0.36421480774879456,0.3661939799785614,0.2426573485136032,987.2093505859375,1e-05,0.14047780632972717,3.032355308532715,81.14050197601318,0 +612,0.37572523951530457,0.32257920503616333,0.3253844976425171,0.20000000298023224,981.6846923828125,1e-05,0.14337490499019623,3.0846118927001953,81.14050197601318,0 +613,0.25148746371269226,0.33032944798469543,0.33815887570381165,0.24452213943004608,557.397705078125,1e-05,0.3208298683166504,3.0712170600891113,81.14050197601318,0 +614,0.34196874499320984,0.34912827610969543,0.36903852224349976,0.22121211886405945,421.0982971191406,1e-05,0.14385898411273956,2.839895009994507,81.14050197601318,0 +615,0.3347734212875366,0.25046175718307495,0.2635951042175293,0.12354312092065811,913.2542724609375,1e-05,0.18381837010383606,3.1752960681915283,81.14050197601318,0 +616,0.3108119070529938,0.27155232429504395,0.28058624267578125,0.16247086226940155,838.6439208984375,1e-05,0.15164948999881744,3.2828850746154785,81.14050197601318,0 +617,0.25920456647872925,0.32865285873413086,0.3417930006980896,0.25874125957489014,937.2574462890625,1e-05,0.18797321617603302,3.0295019149780273,81.14050197601318,0 +618,0.25902190804481506,0.4137534201145172,0.4251082241535187,0.1263403296470642,994.0235595703125,1e-05,0.3373526334762573,3.099552869796753,81.14050197601318,0 +619,0.28071722388267517,0.3391796946525574,0.34645095467567444,0.17692308127880096,822.4921875,1e-05,0.17043055593967438,2.8206567764282227,81.14050197601318,0 +620,0.39213716983795166,0.3066179156303406,0.31511008739471436,0.1191142201423645,832.2701416015625,1e-05,0.4760275185108185,2.821840524673462,81.14050197601318,0 +621,0.5367981195449829,0.3092692792415619,0.32023802399635315,0.21608391404151917,691.7044067382812,1e-05,0.18132789433002472,3.1095895767211914,81.14050197601318,0 +622,0.29047808051109314,0.2975713610649109,0.30348318815231323,0.23403263092041016,845.2969360351562,1e-05,0.14906832575798035,3.0487747192382812,81.14050197601318,0 +623,0.21794965863227844,0.31483325362205505,0.3157884478569031,0.12121211737394333,937.759521484375,1e-05,0.15756714344024658,3.0519306659698486,81.14050197601318,0 +624,0.27969789505004883,0.28261199593544006,0.2869517505168915,0.21002331376075745,939.0036010742188,1e-05,0.2349293977022171,3.32723331451416,81.14050197601318,0 +625,0.3390302360057831,0.3362841308116913,0.35363495349884033,0.19557109475135803,348.26116943359375,1e-05,0.19765889644622803,2.8166325092315674,81.14050197601318,0 +626,0.21533188223838806,0.1577281951904297,0.16947141289710999,0.11678321659564972,674.5276489257812,1e-05,0.2021617740392685,2.823244571685791,81.14050197601318,0 +627,0.1754218339920044,0.32786762714385986,0.3308173716068268,0.1191142201423645,951.93115234375,1e-05,0.1545521318912506,3.4498302936553955,81.14050197601318,0 +628,0.10984675586223602,0.3878423571586609,0.38182973861694336,0.21328671276569366,968.7553100585938,1e-05,0.14720256626605988,3.273037910461426,81.14050197601318,0 +629,0.1952502578496933,0.16983681917190552,0.18623322248458862,0.09720280021429062,944.9946899414062,1e-05,0.16346636414527893,2.8291637897491455,81.14050197601318,0 +630,0.19605273008346558,0.34722089767456055,0.3657526671886444,0.2018647938966751,979.6979370117188,1e-05,1.291913390159607,3.2564311027526855,81.14050197601318,0 +631,0.4186134934425354,0.2829650640487671,0.29427048563957214,0.1818181872367859,939.4969482421875,1e-05,0.20114445686340332,2.8336219787597656,81.14050197601318,0 +632,0.36869093775749207,0.44551873207092285,0.4557594954967499,0.22517482936382294,991.954833984375,1e-05,0.15344412624835968,2.845599889755249,81.14050197601318,0 +633,0.2823260724544525,0.2443932145833969,0.26292848587036133,0.15477855503559113,853.203369140625,1e-05,0.34027060866355896,3.387317419052124,81.14050197601318,0 +634,0.2817194163799286,0.357002317905426,0.3739347457885742,0.26153844594955444,979.8526000976562,1e-05,0.16982753574848175,3.034444570541382,81.14050197601318,0 +635,0.17629502713680267,0.3172248303890228,0.3111940920352936,0.15198135375976562,935.22314453125,1e-05,0.22072602808475494,2.8190762996673584,81.14050197601318,0 +636,0.4460047483444214,0.7383052706718445,0.7327572703361511,0.19603729248046875,100.0000228881836,1e-05,0.2038186639547348,3.594846487045288,81.14050197601318,0 +637,0.4792024493217468,0.40436801314353943,0.40525397658348083,0.26643356680870056,695.4873657226562,1e-05,0.19911052286624908,2.8264989852905273,81.14050197601318,0 +638,0.3901759684085846,0.24551093578338623,0.25572919845581055,0.18018648028373718,515.6737670898438,1e-05,0.15371844172477722,2.8194470405578613,81.14050197601318,0 +639,0.49608635902404785,0.3463346064090729,0.35077351331710815,0.16130536794662476,622.5833740234375,1e-05,0.18416403234004974,3.3893511295318604,81.14050197601318,0 +640,0.1953934282064438,0.35213229060173035,0.35786527395248413,0.23449882864952087,911.0138549804688,1e-05,0.2442033886909485,3.0471372604370117,81.14050197601318,0 +641,0.30784499645233154,0.2780778706073761,0.28725549578666687,0.16923077404499054,635.8348388671875,1e-05,0.14479567110538483,2.816662073135376,81.14050197601318,0 +642,0.17396624386310577,0.22144517302513123,0.2501279413700104,0.2298368364572525,961.9138793945312,1e-05,0.12939700484275818,3.09079647064209,81.14050197601318,0 +643,0.3372651934623718,0.4787694215774536,0.486221581697464,0.08484848588705063,258.84716796875,1e-05,0.19857852160930634,2.834491729736328,81.14050197601318,0 +644,0.4216335415840149,0.32657864689826965,0.3252650201320648,0.14452214539051056,800.1805419921875,1e-05,0.13168156147003174,3.0737338066101074,81.14050197601318,0 +645,0.2639469802379608,0.2062169909477234,0.21299703419208527,0.20885780453681946,972.0613403320312,1e-05,0.1600082367658615,3.1223599910736084,81.14050197601318,0 +646,0.2115887850522995,0.2596244215965271,0.2761951982975006,0.2526806592941284,984.3526000976562,1e-05,0.18821576237678528,3.1084582805633545,81.14050197601318,0 +647,0.4084879457950592,0.3449825942516327,0.35805511474609375,0.20606060326099396,443.50128173828125,1e-05,0.15901081264019012,3.044696092605591,81.14050197601318,0 +648,0.2130568027496338,0.45604223012924194,0.46197161078453064,0.16083915531635284,998.34521484375,1e-05,0.1745283007621765,3.114424228668213,81.14050197601318,0 +649,0.18336699903011322,0.2644633948802948,0.2661348283290863,0.19277389347553253,900.5198364257812,1e-05,0.14805497229099274,2.8450982570648193,81.14050197601318,0 +650,0.24411512911319733,0.18686263263225555,0.1929728090763092,0.11305361241102219,785.0322875976562,1e-05,0.16224409639835358,3.092360258102417,81.14050197601318,0 +651,0.40916353464126587,0.29883086681365967,0.3017243444919586,0.0839160829782486,597.6142578125,1e-05,0.1919867843389511,3.4232077598571777,81.14050197601318,0 +652,0.3894602656364441,0.20364795625209808,0.2153884917497635,0.25081583857536316,776.0996704101562,1e-05,0.14666156470775604,3.112651824951172,81.14050197601318,0 +653,0.4439410865306854,0.3262863755226135,0.3198908567428589,0.139860138297081,921.48974609375,1e-05,0.19968757033348083,3.0382721424102783,81.14050197601318,0 +654,0.2767440378665924,0.2286243885755539,0.24785147607326508,0.22913752496242523,944.7620849609375,1e-05,0.3063720762729645,3.14972186088562,81.14050197601318,0 +655,0.20691172778606415,0.4160340428352356,0.4206294119358063,0.2058275043964386,974.08203125,1e-05,0.11932290345430374,2.8240859508514404,81.14050197601318,0 +656,0.28278404474258423,0.48166343569755554,0.49916645884513855,0.1878787875175476,978.4493408203125,1e-05,0.1593332439661026,3.087289333343506,81.14050197601318,0 +657,0.4148578643798828,0.19807228446006775,0.22064509987831116,0.2041957974433899,700.4320068359375,1e-05,0.16370244324207306,3.3491299152374268,81.14050197601318,0 +658,0.40450525283813477,0.341927707195282,0.34083178639411926,0.10256410390138626,972.0613403320312,1e-05,0.15293610095977783,3.1389989852905273,81.14050197601318,0 +659,0.2075667828321457,0.47928160429000854,0.4580896198749542,0.19930069148540497,989.5532836914062,1e-05,0.15808427333831787,3.027150869369507,81.14050197601318,0 +660,0.2214662879705429,0.3864912986755371,0.3939814865589142,0.24032634496688843,989.2814331054688,1e-05,0.17040888965129852,3.099301815032959,81.14050197601318,0 +661,0.2770596444606781,0.24317075312137604,0.2537350058555603,0.2170163094997406,880.5089721679688,1e-05,0.12141584604978561,2.828782320022583,81.14050197601318,0 +662,0.2928287982940674,0.299314945936203,0.3042280375957489,0.2596736550331116,921.19580078125,1e-05,0.3862565755844116,3.135383367538452,81.14050197601318,0 +663,0.313137024641037,0.2911188304424286,0.29281410574913025,0.24918414652347565,919.7131958007812,1e-05,0.1682112216949463,3.073607921600342,81.14050197601318,0 +664,0.3446033298969269,0.3133072853088379,0.31426966190338135,0.22960372269153595,911.0138549804688,1e-05,0.16287073493003845,3.067960500717163,81.14050197601318,0 +665,0.2306397408246994,0.4085184335708618,0.41733163595199585,0.23123542964458466,966.77880859375,1e-05,0.12976080179214478,3.0656561851501465,81.14050197601318,0 +666,0.39684736728668213,0.4428999722003937,0.45973309874534607,0.19953380525112152,371.6285705566406,1e-05,0.18508951365947723,2.8250787258148193,81.14050197601318,0 +667,0.3668438792228699,0.22611646354198456,0.2547265291213989,0.25687646865844727,766.697998046875,1e-05,0.16448569297790527,2.847440004348755,81.14050197601318,0 +668,0.21798434853553772,0.33678752183914185,0.32860952615737915,0.1734265685081482,727.9061279296875,1e-05,0.19951294362545013,3.4548141956329346,81.14050197601318,0 +669,0.47335371375083923,0.3041791021823883,0.3237815201282501,0.23240093886852264,954.0613403320312,1e-05,0.21794943511486053,3.097651720046997,81.14050197601318,0 +670,0.26631686091423035,0.24799954891204834,0.25650718808174133,0.25314685702323914,954.271728515625,1e-05,0.14332635700702667,3.1067352294921875,81.14050197601318,0 +671,0.23940955102443695,0.36193448305130005,0.35763001441955566,0.2510489523410797,994.27783203125,1e-05,0.1296655237674713,3.1130459308624268,81.14050197601318,0 +672,0.369606614112854,0.2898947596549988,0.2905445694923401,0.2599067687988281,851.6567993164062,1e-05,0.2427750825881958,2.830672025680542,81.14050197601318,0 +673,0.25496232509613037,0.2600327134132385,0.2819738984107971,0.23986013233661652,815.3939208984375,1e-05,0.7499820590019226,2.8331475257873535,81.14050197601318,0 +674,0.12848344445228577,0.36159053444862366,0.3646683692932129,0.23193472623825073,998.7031860351562,1e-05,0.16302548348903656,3.6215591430664062,81.14050197601318,0 +675,0.227406308054924,0.2726365923881531,0.28611689805984497,0.22960372269153595,933.9302368164062,1e-05,0.13090096414089203,3.029475450515747,81.14050197601318,0 +676,0.2861035168170929,0.2166847139596939,0.22662048041820526,0.13076922297477722,875.3941650390625,1e-05,0.13898877799510956,2.835160255432129,81.14050197601318,0 +677,0.24635526537895203,0.270781934261322,0.289584219455719,0.25314685702323914,865.4603271484375,1e-05,0.1270541250705719,3.1305694580078125,81.14050197601318,0 +678,0.2792190611362457,0.36614611744880676,0.3733412027359009,0.21072261035442352,895.8192749023438,1e-05,0.20936429500579834,2.8391432762145996,81.14050197601318,0 +679,0.29933875799179077,0.42254820466041565,0.42120033502578735,0.2242424190044403,979.54296875,1e-05,0.11820949614048004,2.8358395099639893,81.14050197601318,0 +680,0.3061167299747467,0.2726776897907257,0.28238916397094727,0.19836829602718353,914.8272094726562,1e-05,0.1333015412092209,3.3464512825012207,81.14050197601318,0 +681,0.3422970771789551,0.331928014755249,0.3416842222213745,0.23333333432674408,691.7044067382812,1e-05,0.20123431086540222,3.0320651531219482,81.14050197601318,0 +682,0.2861400842666626,0.5015624165534973,0.5046274065971375,0.15804195404052734,227.91456604003906,1e-05,0.139775350689888,3.123077869415283,81.14050197601318,0 +683,0.25833389163017273,0.2390759140253067,0.2533223032951355,0.14755244553089142,992.8673706054688,1e-05,0.17198200523853302,3.1371684074401855,81.14050197601318,0 +684,0.39879143238067627,0.2829306721687317,0.2920807898044586,0.2142191082239151,779.4003295898438,1e-05,0.19393010437488556,2.8213014602661133,81.14050197601318,0 +685,0.18595805764198303,0.3143453299999237,0.3230289816856384,0.21678321063518524,555.2279663085938,1e-05,0.16606426239013672,2.8258583545684814,81.14050197601318,0 +686,0.42620140314102173,0.24412718415260315,0.24353653192520142,0.2589743435382843,970.1636352539062,1e-05,0.16417910158634186,3.367729902267456,81.14050197601318,0 +687,0.3810816705226898,0.9218012094497681,0.8793639540672302,0.19230769574642181,990.0938720703125,1e-05,0.14867380261421204,3.037949800491333,81.14050197601318,0 +688,0.3423005938529968,0.3572019636631012,0.35270488262176514,0.2242424190044403,877.97705078125,1e-05,0.15269407629966736,3.057945489883423,81.14050197601318,0 +689,0.42307931184768677,0.44564345479011536,0.4457917809486389,0.1878787875175476,382.7987976074219,1e-05,0.20304076373577118,3.0758771896362305,81.14050197601318,0 +690,0.4377139210700989,0.3072620928287506,0.30739539861679077,0.16363635659217834,853.715087890625,1e-05,0.15444517135620117,2.8263587951660156,81.14050197601318,0 +691,0.2742772102355957,0.509365439414978,0.5456326007843018,0.1734265685081482,158.9905548095703,1e-05,0.2155940681695938,3.142303466796875,81.14050197601318,0 +692,0.1696762591600418,0.28713294863700867,0.2962437570095062,0.2377622425556183,902.6273193359375,1e-05,0.14370442926883698,3.1178808212280273,81.14050197601318,0 +693,0.2905389070510864,0.37100204825401306,0.36435040831565857,0.22517482936382294,969.1096801757812,1e-05,0.20995505154132843,3.0860941410064697,81.14050197601318,0 +694,0.3345516324043274,0.23335787653923035,0.23806363344192505,0.13799533247947693,734.2389526367188,1e-05,0.13604778051376343,3.074742555618286,81.14050197601318,0 +695,0.2283819168806076,0.26461902260780334,0.2833651900291443,0.2242424190044403,639.041015625,1e-05,0.19781702756881714,3.0753116607666016,81.14050197601318,0 +696,0.24908511340618134,0.21535547077655792,0.2328619360923767,0.17296037077903748,768.4440307617188,1e-05,0.34401386976242065,2.816221237182617,81.14050197601318,0 +697,0.3152587115764618,0.2699865698814392,0.28295400738716125,0.26247087121009827,834.0355224609375,1e-05,0.14260223507881165,3.139843702316284,81.14050197601318,0 +698,0.23474743962287903,0.2661079168319702,0.2947004735469818,0.23193472623825073,970.3380126953125,1e-05,0.1539943665266037,3.109398365020752,81.14050197601318,0 +699,0.2676917016506195,0.19510795176029205,0.20913919806480408,0.1958041936159134,748.2748413085938,1e-05,0.11189532279968262,3.0902152061462402,81.14050197601318,0 +700,0.2074589729309082,0.2896808385848999,0.30267587304115295,0.12097901850938797,982.2857666015625,1e-05,0.12516726553440094,3.3489363193511963,81.14050197601318,0 +701,0.4390154480934143,0.363893985748291,0.4014931619167328,0.19766899943351746,292.3681640625,1e-05,0.1822640299797058,2.8283324241638184,81.14050197601318,0 +702,0.1820877194404602,0.3056284189224243,0.3187044858932495,0.10163170099258423,933.9302368164062,1e-05,0.11742998659610748,3.361154079437256,81.14050197601318,0 +703,0.4637197256088257,0.21569079160690308,0.2306729406118393,0.1722610741853714,603.1679077148438,1e-05,0.20306335389614105,3.3041415214538574,81.14050197601318,0 +704,0.3690633475780487,0.23251385986804962,0.25412824749946594,0.24382284283638,599.4783325195312,1e-05,0.1593758910894394,3.0930473804473877,81.14050197601318,0 +705,0.4749365448951721,0.2959260046482086,0.31265273690223694,0.24475523829460144,467.44049072265625,1e-05,0.1327800154685974,3.098489284515381,81.14050197601318,0 +706,0.41058477759361267,0.2834146320819855,0.28086602687835693,0.1818181872367859,695.4873657226562,1e-05,0.2260570228099823,3.3095462322235107,81.14050197601318,0 +707,0.31710681319236755,0.5478708744049072,0.5408695340156555,0.14382284879684448,990.630615234375,1e-05,0.10271070897579193,2.831202507019043,81.14050197601318,0 +708,0.2522061765193939,0.2825640141963959,0.3023647964000702,0.18811188638210297,960.9456176757812,1e-05,0.14427325129508972,2.8259832859039307,81.14050197601318,0 +709,0.20202866196632385,0.25655874609947205,0.2529427707195282,0.08484848588705063,880.926025390625,1e-05,0.13805334270000458,3.117866039276123,81.14050197601318,0 +710,0.3216090798377991,0.267525315284729,0.2936989665031433,0.17645686864852905,979.6979370117188,1e-05,0.13218069076538086,2.821800947189331,81.14050197601318,0 +711,0.38870251178741455,0.4353381395339966,0.4429931044578552,0.21165500581264496,301.4790344238281,1e-05,0.2130596935749054,3.0984201431274414,81.14050197601318,0 +712,0.21425212919712067,0.44151291251182556,0.45009759068489075,0.13333334028720856,999.7660522460938,1e-05,0.10794089734554291,3.284130096435547,81.14050197601318,0 +713,0.29652291536331177,0.2627515494823456,0.26937177777290344,0.10419580340385437,912.93701171875,1e-05,0.13615798950195312,2.8212928771972656,81.14050197601318,0 +714,0.3829687535762787,0.2082877904176712,0.2203897386789322,0.26083916425704956,789.71923828125,1e-05,0.13167187571525574,2.818131685256958,81.14050197601318,0 +715,0.2530372738838196,0.3753727674484253,0.391152024269104,0.18811188638210297,999.8831176757812,1e-05,1.7518341541290283,3.3919119834899902,81.14050197601318,0 +716,0.37939444184303284,0.27981144189834595,0.2841498553752899,0.23146852850914001,888.2062377929688,1e-05,0.18151609599590302,2.830721378326416,81.14050197601318,0 +717,0.3193618655204773,0.8059630393981934,0.8023263216018677,0.23193472623825073,120.44096374511719,1e-05,0.14164268970489502,3.0433425903320312,81.14050197601318,0 +718,0.26865360140800476,0.33400222659111023,0.34888383746147156,0.21235431730747223,956.142333984375,1e-05,0.591996431350708,3.0991249084472656,81.14050197601318,0 +719,0.24453499913215637,0.29336580634117126,0.2928018569946289,0.1258741319179535,969.1096801757812,1e-05,0.12204515933990479,2.822540521621704,81.14050197601318,0 +720,0.29633572697639465,0.1738848239183426,0.19713999330997467,0.1822843849658966,931.826171875,1e-05,0.1330319344997406,2.8263604640960693,81.14050197601318,0 +721,0.2040393203496933,0.6619641184806824,0.6562909483909607,0.16969697177410126,146.47067260742188,1e-05,0.13592782616615295,3.335629940032959,81.14050197601318,0 +722,0.37637224793434143,0.4585936963558197,0.4470846951007843,0.2426573485136032,997.6233520507812,1e-05,0.15566802024841309,2.8271331787109375,81.14050197601318,0 +723,0.26393944025039673,0.26658567786216736,0.27163171768188477,0.232634037733078,770.1734008789062,1e-05,0.17047151923179626,3.0756173133850098,81.14050197601318,0 +724,0.19200314581394196,0.3113915026187897,0.3216496706008911,0.22727273404598236,958.576904296875,1e-05,0.14319363236427307,3.0863239765167236,81.14050197601318,0 +725,0.3440197706222534,0.37182846665382385,0.3816177248954773,0.16993007063865662,568.0068969726562,1e-05,0.11795765161514282,2.828113079071045,81.14050197601318,0 +726,0.2749113142490387,0.32284876704216003,0.3270246088504791,0.1962703913450241,923.525634765625,1e-05,0.16816364228725433,2.830958843231201,81.14050197601318,0 +727,0.42463386058807373,0.25641292333602905,0.26325422525405884,0.16083915531635284,931.826171875,1e-05,0.25393906235694885,3.316194772720337,81.14050197601318,0 +728,0.2453542947769165,0.28946295380592346,0.3013198673725128,0.12540791928768158,530.23681640625,1e-05,0.13712796568870544,3.0157735347747803,81.14050197601318,0 +729,0.2384166717529297,0.27252495288848877,0.27590563893318176,0.14568763971328735,908.7275390625,1e-05,0.15731404721736908,2.825078010559082,81.14050197601318,0 +730,0.41654759645462036,0.17232337594032288,0.18663081526756287,0.17365966737270355,559.55126953125,1e-05,0.2175140231847763,3.0828778743743896,81.14050197601318,0 +731,0.21828101575374603,0.2625991106033325,0.2749174237251282,0.2321678251028061,737.33203125,1e-05,0.33866629004478455,2.826416015625,81.14050197601318,0 +732,0.35356125235557556,0.8571957945823669,0.8871045708656311,0.20629370212554932,994.0235595703125,1e-05,0.19891045987606049,2.8188719749450684,81.14050197601318,0 +733,0.3566887378692627,0.3573380708694458,0.36931079626083374,0.26037296652793884,464.5392150878906,1e-05,0.34644952416419983,3.471627950668335,81.14050197601318,0 +734,0.12006127089262009,0.3130543529987335,0.34214168787002563,0.23496504127979279,981.9857788085938,1e-05,0.17168539762496948,3.0315375328063965,81.14050197601318,0 +735,0.2852002680301666,0.23092013597488403,0.23949989676475525,0.23496504127979279,785.822265625,1e-05,0.3694709539413452,2.8143115043640137,81.14050197601318,0 +736,0.398840993642807,0.3732469379901886,0.37510913610458374,0.25477856397628784,979.2321166992188,1e-05,0.17765042185783386,3.0839531421661377,81.14050197601318,0 +737,0.4329477846622467,0.39233338832855225,0.4037761390209198,0.251748263835907,505.5683898925781,1e-05,0.14444872736930847,2.812988042831421,81.14050197601318,0 +738,0.48096275329589844,0.33159899711608887,0.3395867645740509,0.1930069923400879,682.6182250976562,1e-05,0.2678547501564026,3.080735206604004,81.14050197601318,0 +739,0.3036390542984009,0.27999576926231384,0.2947537899017334,0.2354312390089035,681.2896118164062,1e-05,0.15754298865795135,3.4601988792419434,81.14050197601318,0 +740,0.40167829394340515,0.24355056881904602,0.2539830505847931,0.1862470805644989,816.7084350585938,1e-05,0.12426649034023285,3.0421361923217773,81.14050197601318,0 +741,0.2958868741989136,0.17604930698871613,0.18663263320922852,0.08228438347578049,851.6567993164062,1e-05,0.24066609144210815,3.0141777992248535,81.14050197601318,0 +742,0.28295034170150757,0.3082427680492401,0.3152294158935547,0.21888111531734467,677.2564697265625,1e-05,0.20469039678573608,3.036569356918335,81.14050197601318,0 +743,0.2684399485588074,0.3590068221092224,0.37119260430336,0.23193472623825073,973.748779296875,1e-05,0.1784937083721161,2.83225154876709,81.14050197601318,0 +744,0.3675021231174469,0.33467525243759155,0.33292534947395325,0.2114219069480896,974.08203125,1e-05,0.19574302434921265,3.0860843658447266,81.14050197601318,0 +745,0.29857996106147766,0.2770785987377167,0.27923887968063354,0.1867132931947708,930.2188720703125,1e-05,0.1835964322090149,3.4798901081085205,81.14050197601318,0 +746,0.33594244718551636,0.3454897701740265,0.33871087431907654,0.23123542964458466,883.4002075195312,1e-05,0.3255387544631958,3.0881431102752686,81.14050197601318,0 +747,0.4005066454410553,0.33359280228614807,0.3464752435684204,0.2769230902194977,683.93896484375,1e-05,0.25100287795066833,3.0201590061187744,81.14050197601318,0 +748,0.43864697217941284,0.3499852418899536,0.35869866609573364,0.15897436439990997,944.529052734375,1e-05,0.15949462354183197,3.0850179195404053,81.14050197601318,0 +749,0.39592403173446655,0.25859901309013367,0.2714587152004242,0.2449883371591568,645.3312377929688,1e-05,0.16512198746204376,2.8395166397094727,81.14050197601318,0 +750,0.3272963762283325,0.23996557295322418,0.25245314836502075,0.25081583857536316,903.6668701171875,1e-05,0.13649797439575195,2.83011794090271,81.14050197601318,0 +751,0.3219618797302246,0.36740049719810486,0.3694309890270233,0.2393939346075058,979.0761108398438,1e-05,0.25633877515792847,3.4195034503936768,81.14050197601318,0 +752,0.4784219264984131,0.21049600839614868,0.2220134288072586,0.21095570921897888,718.021240234375,1e-05,0.20882642269134521,3.0571815967559814,81.14050197601318,0 +753,0.346002995967865,0.2461278736591339,0.2536569833755493,0.14801864326000214,527.8575439453125,1e-05,0.3071499764919281,3.095334529876709,81.14050197601318,0 +754,0.33189576864242554,0.3062320947647095,0.3077605366706848,0.16083915531635284,608.6077880859375,1e-05,0.1282653510570526,3.07426118850708,81.14050197601318,0 +755,0.20169492065906525,0.21848858892917633,0.22666829824447632,0.2242424190044403,753.992919921875,1e-05,0.15692918002605438,2.8433737754821777,81.14050197601318,0 +756,0.24488386511802673,0.3574818968772888,0.37093275785446167,0.09883449971675873,977.0203857421875,1e-05,0.1292017698287964,3.1550662517547607,81.14050197601318,0 +757,0.3185633718967438,0.32759979367256165,0.3363678455352783,0.16083915531635284,427.6461486816406,1e-05,0.2530970275402069,3.421938419342041,81.14050197601318,0 +758,0.3761342763900757,0.31019267439842224,0.3188474774360657,0.16037295758724213,807.9645385742188,1e-05,0.2124960869550705,3.0822229385375977,81.14050197601318,0 +759,0.23512545228004456,0.2823845148086548,0.2900533974170685,0.25198134779930115,779.4003295898438,1e-05,0.1939702332019806,3.0555970668792725,81.14050197601318,0 +760,0.29299479722976685,0.20786400139331818,0.2246362417936325,0.17435897886753082,762.2591552734375,1e-05,0.16714659333229065,2.8227009773254395,81.14050197601318,0 +761,0.17437362670898438,0.3135734796524048,0.3106980621814728,0.18857808411121368,946.6068115234375,1e-05,0.15486107766628265,2.843644857406616,81.14050197601318,0 +762,0.3118518888950348,0.31365522742271423,0.325269877910614,0.1986013948917389,950.8469848632812,1e-05,0.17218542098999023,3.1098670959472656,81.14050197601318,0 +763,0.280281662940979,0.31032270193099976,0.3269314467906952,0.21771562099456787,842.00830078125,1e-05,0.14846940338611603,3.1444272994995117,81.14050197601318,0 +764,0.23073692619800568,0.23944807052612305,0.25100091099739075,0.20932400226593018,784.2387084960938,1e-05,0.19831417500972748,3.1362228393554688,81.14050197601318,0 +765,0.22862692177295685,0.3123752474784851,0.32023829221725464,0.2354312390089035,973.5816040039062,1e-05,0.16594789922237396,3.103269338607788,81.14050197601318,0 +766,0.32266461849212646,0.3157183825969696,0.3186826705932617,0.10419580340385437,972.5713500976562,1e-05,0.28550028800964355,2.8275606632232666,81.14050197601318,0 +767,0.2935110032558441,0.3501705229282379,0.3600153625011444,0.20932400226593018,946.8348388671875,1e-05,0.17451496422290802,2.834642171859741,81.14050197601318,0 +768,0.26578301191329956,0.5744920372962952,0.6023635268211365,0.20885780453681946,200.4163818359375,1e-05,0.15736767649650574,3.2765157222747803,81.14050197601318,0 +769,0.2309676855802536,0.31462663412094116,0.3157326579093933,0.1818181872367859,984.0607299804688,1e-05,0.19549664855003357,3.1300909519195557,81.14050197601318,0 +770,0.46135473251342773,0.2661554515361786,0.28668642044067383,0.22447551786899567,393.64630126953125,1e-05,0.25003930926322937,2.816153049468994,81.14050197601318,0 +771,0.20628340542316437,0.31677553057670593,0.3182716965675354,0.16596736013889313,947.9669189453125,1e-05,0.10259842872619629,3.3434619903564453,81.14050197601318,0 +772,0.2813628911972046,0.2995966076850891,0.3023093044757843,0.23986013233661652,845.2969360351562,1e-05,0.13793081045150757,2.843060255050659,81.14050197601318,0 +773,0.32558274269104004,0.46666210889816284,0.46988338232040405,0.23473192751407623,348.26116943359375,1e-05,0.1737333983182907,2.836778402328491,81.14050197601318,0 +774,0.4821888208389282,0.36172226071357727,0.36626848578453064,0.25081583857536316,987.4890747070312,1e-05,0.3424133062362671,3.3592562675476074,81.14050197601318,0 +775,0.32102105021476746,0.2880072593688965,0.3015245795249939,0.19114218652248383,772.7371215820312,1e-05,0.26802486181259155,3.1499805450439453,81.14050197601318,0 +776,0.2264183759689331,0.331672728061676,0.33863532543182373,0.257342666387558,766.697998046875,1e-05,0.14664524793624878,3.1328866481781006,81.14050197601318,0 +777,0.3542053699493408,0.20882548391819,0.23131482303142548,0.23869463801383972,832.2701416015625,1e-05,0.1690063327550888,3.3379147052764893,81.14050197601318,0 +778,0.4615846276283264,0.2136104255914688,0.22651445865631104,0.25081583857536316,845.8379516601562,1e-05,0.1530119627714157,2.8315906524658203,81.14050197601318,0 +779,0.2935263216495514,0.318177193403244,0.3172367811203003,0.16363635659217834,827.4590454101562,1e-05,0.1383465975522995,3.079867362976074,81.14050197601318,0 +780,0.28495246171951294,0.2597849369049072,0.2723308801651001,0.22214451432228088,518.1495361328125,1e-05,0.12435954809188843,3.450937509536743,81.14050197601318,0 +781,0.2624722123146057,0.19907094538211823,0.22409750521183014,0.1734265685081482,940.7190551757812,1e-05,0.1562933623790741,3.1187920570373535,81.14050197601318,0 +782,0.3020853102207184,0.41099706292152405,0.422642320394516,0.17878787219524384,464.5392150878906,1e-05,0.16215276718139648,3.0491724014282227,81.14050197601318,0 +783,0.16949717700481415,0.40500304102897644,0.4138662815093994,0.07762237638235092,979.2321166992188,1e-05,0.12830018997192383,3.0997097492218018,81.14050197601318,0 +784,0.25320422649383545,0.4675690233707428,0.4612448513507843,0.18648017942905426,988.8717041015625,1e-05,0.1413983255624771,2.832472801208496,81.14050197601318,0 +785,0.37307506799697876,0.294480562210083,0.29136887192726135,0.20629370212554932,712.31884765625,1e-05,0.24593450129032135,3.097191095352173,81.14050197601318,0 +786,0.2279367446899414,0.3466958701610565,0.3462706506252289,0.21235431730747223,954.4815673828125,1e-05,0.2231808304786682,3.1814396381378174,81.14050197601318,0 +787,0.24967002868652344,0.2833991050720215,0.2919944226741791,0.07878787815570831,983.0303955078125,1e-05,0.25121283531188965,3.4057328701019287,81.14050197601318,0 +788,0.3575213551521301,0.4383995532989502,0.4480471909046173,0.18531468510627747,962.4896240234375,1e-05,0.1386641561985016,3.0814759731292725,81.14050197601318,0 +789,0.3705928921699524,0.230216845870018,0.24084700644016266,0.17925408482551575,928.31103515625,1e-05,0.15379761159420013,3.353372573852539,81.14050197601318,0 +790,0.4335194528102875,0.3747168481349945,0.37477901577949524,0.14848484098911285,452.67730712890625,1e-05,0.21283648908138275,2.822430372238159,81.14050197601318,0 +791,0.15619347989559174,0.28024911880493164,0.2826124429702759,0.19487179815769196,974.2481079101562,1e-05,0.12441783398389816,3.0950636863708496,81.14050197601318,0 +792,0.29391008615493774,0.31927844882011414,0.3222765624523163,0.1918414980173111,828.0687866210938,1e-05,0.11659232527017593,3.1128339767456055,81.14050197601318,0 +793,0.21215756237506866,0.4085029065608978,0.4114311933517456,0.23240093886852264,996.2799072265625,1e-05,0.23148415982723236,3.4263319969177246,81.14050197601318,0 +794,0.19204556941986084,0.25440335273742676,0.271519273519516,0.2242424190044403,928.8597412109375,1e-05,0.17021417617797852,3.061784267425537,81.14050197601318,0 +795,0.11012522131204605,0.3028484284877777,0.31183382868766785,0.24731934070587158,991.2958374023438,1e-05,0.12056174129247665,3.0631470680236816,81.14050197601318,0 +796,0.5763176083564758,0.39209166169166565,0.3971281051635742,0.19650349020957947,452.67730712890625,1e-05,0.15099342167377472,2.8305556774139404,81.14050197601318,0 +797,0.3610801100730896,0.2806994318962097,0.30178096890449524,0.16200466454029083,807.9645385742188,1e-05,0.17875665426254272,3.0587210655212402,81.14050197601318,0 +798,0.27939894795417786,0.27781328558921814,0.2943214178085327,0.19650349020957947,938.0095825195312,1e-05,0.14643095433712006,3.067854881286621,81.14050197601318,0 +799,0.15450696647167206,0.2948436737060547,0.3046399652957916,0.10303030163049698,979.3876342773438,1e-05,0.19762371480464935,3.1303372383117676,81.14050197601318,0 +800,0.13793398439884186,0.2351982742547989,0.25810301303863525,0.21118880808353424,816.0525512695312,1e-05,0.1232018992304802,3.3536229133605957,81.14050197601318,0 +801,0.3086884617805481,0.4856700003147125,0.4809184968471527,0.24405594170093536,975.5648193359375,1e-05,0.24103422462940216,2.8289530277252197,81.14050197601318,0 +802,0.28651925921440125,0.29651549458503723,0.2955491840839386,0.284149169921875,834.0355224609375,1e-05,0.2035360038280487,2.820891857147217,81.14050197601318,0 +803,0.29835212230682373,0.16402611136436462,0.18971386551856995,0.18391607701778412,832.2701416015625,1e-05,0.16236326098442078,3.0835235118865967,81.14050197601318,0 +804,0.2366831749677658,0.17573656141757965,0.18569785356521606,0.08997669070959091,845.2969360351562,1e-05,0.20948277413845062,3.091843605041504,81.14050197601318,0 +805,0.26220646500587463,0.33456432819366455,0.3384777009487152,0.2242424190044403,835.2010498046875,1e-05,0.33800244331359863,3.122478485107422,81.14050197601318,0 +806,0.18268343806266785,0.24816344678401947,0.2685543894767761,0.20955711603164673,875.3941650390625,1e-05,0.1251419633626938,3.259174346923828,81.14050197601318,0 +807,0.28622815012931824,0.5011148452758789,0.5050076842308044,0.1867132931947708,998.2254028320312,1e-05,0.17694707214832306,2.818108320236206,81.14050197601318,0 +808,0.26735320687294006,0.3553994297981262,0.35354432463645935,0.2454545497894287,970.8588256835938,1e-05,0.165228933095932,2.8224430084228516,81.14050197601318,0 +809,0.24414455890655518,0.2604808509349823,0.2681981325149536,0.2449883371591568,901.2266235351562,1e-05,0.2751067876815796,3.1263158321380615,81.14050197601318,0 +810,0.17434847354888916,0.2687508463859558,0.25797054171562195,0.1958041936159134,834.6194458007812,1e-05,0.168100044131279,3.039060592651367,81.14050197601318,0 +811,0.13809004426002502,0.56355220079422,0.5549585223197937,0.1890442818403244,991.4281005859375,1e-05,0.12122151255607605,3.0549750328063965,81.14050197601318,0 +812,0.4779044985771179,0.3070201277732849,0.30713459849357605,0.1958041936159134,846.9136352539062,1e-05,0.13689763844013214,3.315101385116577,81.14050197601318,0 +813,0.17884403467178345,0.4604375958442688,0.44492194056510925,0.22517482936382294,981.9857788085938,1e-05,0.14160363376140594,2.840378522872925,81.14050197601318,0 +814,0.25582024455070496,0.215230792760849,0.22047127783298492,0.2242424190044403,821.8599853515625,1e-05,0.12592890858650208,2.8366849422454834,81.14050197601318,0 +815,0.37120741605758667,0.3279058337211609,0.33418750762939453,0.19813519716262817,548.6198120117188,1e-05,0.13931159675121307,3.296860694885254,81.14050197601318,0 +816,0.462182879447937,0.37520086765289307,0.3804561197757721,0.18881118297576904,382.7987976074219,1e-05,0.11551661789417267,3.023380756378174,81.14050197601318,0 +817,0.20824290812015533,0.33285650610923767,0.33253008127212524,0.232634037733078,956.142333984375,1e-05,0.13356998562812805,3.10679292678833,81.14050197601318,0 +818,0.4092715382575989,0.21257974207401276,0.23543362319469452,0.1678321659564972,929.6773681640625,1e-05,0.1933242231607437,3.0803122520446777,81.14050197601318,0 +819,0.17167480289936066,0.3515367805957794,0.3544447124004364,0.23310023546218872,998.2254028320312,1e-05,0.1274651288986206,2.8291726112365723,81.14050197601318,0 +820,0.19661039113998413,0.37400585412979126,0.36676228046417236,0.12960372865200043,999.9999389648438,1e-05,0.3295201361179352,2.834596633911133,81.14050197601318,0 +821,0.22832489013671875,0.2617437243461609,0.28429046273231506,0.18531468510627747,756.7888793945312,1e-05,0.13785773515701294,3.1370673179626465,81.14050197601318,0 +822,0.3157516121864319,0.4696994423866272,0.47249746322631836,0.28041958808898926,984.0607299804688,1e-05,0.09787482768297195,3.1254796981811523,81.14050197601318,0 +823,0.22975508868694305,0.5225152373313904,0.5194014310836792,0.17179487645626068,978.4493408203125,1e-05,0.09558689594268799,3.0131418704986572,81.14050197601318,0 +824,0.17943254113197327,0.28100818395614624,0.28460291028022766,0.21282051503658295,871.8681030273438,1e-05,0.12807047367095947,3.082763195037842,81.14050197601318,0 +825,0.5545771718025208,0.3627551794052124,0.37351876497268677,0.2601398527622223,622.5833740234375,1e-05,0.1603986620903015,2.8254611492156982,81.14050197601318,0 +826,0.20160077512264252,0.3094358742237091,0.3167409300804138,0.23916083574295044,951.7153930664062,1e-05,0.17969712615013123,3.0120372772216797,81.14050197601318,0 +827,0.4269813299179077,0.3151177167892456,0.31359341740608215,0.2668997645378113,845.2969360351562,1e-05,0.15149377286434174,3.1178131103515625,81.14050197601318,0 +828,0.26798728108406067,0.2826671600341797,0.2867678701877594,0.1303030252456665,921.7830200195312,1e-05,0.14532527327537537,3.1037654876708984,81.14050197601318,0 +829,0.1843883991241455,0.306834876537323,0.32059532403945923,0.16993007063865662,720.25927734375,1e-05,0.15000368654727936,3.042158842086792,81.14050197601318,0 +830,0.38117772340774536,0.36305472254753113,0.37134218215942383,0.14638695120811462,922.947998046875,1e-05,0.18757027387619019,2.8334386348724365,81.14050197601318,0 +831,0.304371178150177,0.3719923198223114,0.3716420829296112,0.2596736550331116,858.7315673828125,1e-05,0.1914035677909851,2.8298592567443848,81.14050197601318,0 +832,0.3163689970970154,0.27371346950531006,0.273830384016037,0.21655011177062988,728.9754028320312,1e-05,0.12989212572574615,2.834233283996582,81.14050197601318,0 +833,0.5012610554695129,0.3309699296951294,0.33695703744888306,0.20396269857883453,582.22021484375,1e-05,0.22999270260334015,3.1237313747406006,81.14050197601318,0 +834,0.36730149388313293,0.3130727708339691,0.3167485296726227,0.20209790766239166,926.9263305664062,1e-05,0.2190922200679779,3.330137014389038,81.14050197601318,0 +835,0.2387543022632599,0.43503138422966003,0.42691296339035034,0.23566433787345886,979.6979370117188,1e-05,0.15164564549922943,3.2939133644104004,81.14050197601318,0 +836,0.15973767638206482,0.44744589924812317,0.46264705061912537,0.1862470805644989,974.5794677734375,1e-05,0.3564471900463104,2.8222274780273438,81.14050197601318,0 +837,0.1944698840379715,0.27514025568962097,0.2789076566696167,0.19044288992881775,715.7589111328125,1e-05,0.10867665708065033,2.8285412788391113,81.14050197601318,0 +838,0.3710775375366211,0.1685122549533844,0.18464620411396027,0.21282051503658295,796.51806640625,1e-05,0.14238014817237854,3.129974842071533,81.14050197601318,0 +839,0.1463010013103485,0.3016538619995117,0.3039685785770416,0.03146853297948837,942.8807373046875,1e-05,0.1338975578546524,2.8217411041259766,81.14050197601318,0 +840,0.5151112675666809,0.21137745678424835,0.2358754575252533,0.18601398169994354,774.4262084960938,1e-05,0.15368099510669708,3.285464286804199,81.14050197601318,0 +841,0.20475217700004578,0.41428545117378235,0.42021334171295166,0.17878787219524384,956.552734375,1e-05,0.13235414028167725,3.2399957180023193,81.14050197601318,0 +842,0.28209882974624634,0.3149612545967102,0.3454342484474182,0.18764568865299225,974.4140625,1e-05,0.13637496531009674,2.82084059715271,81.14050197601318,0 +843,0.14726422727108002,0.33847808837890625,0.33976301550865173,0.23473192751407623,966.596923828125,1e-05,0.11258045583963394,2.826345443725586,81.14050197601318,0 +844,0.504233717918396,0.26656463742256165,0.27939847111701965,0.24172493815422058,966.596923828125,1e-05,0.16386811435222626,3.3388116359710693,81.14050197601318,0 +845,0.2203850895166397,0.374276340007782,0.38222742080688477,0.22517482936382294,998.7031860351562,1e-05,0.12430788576602936,2.822267532348633,81.14050197601318,0 +846,0.32371094822883606,0.29302778840065,0.3013204336166382,0.24475523829460144,961.5278930664062,1e-05,0.1602763831615448,3.3365979194641113,81.14050197601318,0 +847,0.18480660021305084,0.19016708433628082,0.20281079411506653,0.2030303031206131,925.8049926757812,1e-05,0.1430090069770813,3.2919762134552,81.14050197601318,0 +848,0.24344249069690704,0.25695571303367615,0.2643060088157654,0.18974359333515167,735.275390625,1e-05,0.13186471164226532,2.8281638622283936,81.14050197601318,0 +849,0.325898677110672,0.23237577080726624,0.25671669840812683,0.1738927662372589,849.041259765625,1e-05,0.16189046204090118,2.8299543857574463,81.14050197601318,0 +850,0.18588148057460785,0.4078681468963623,0.41317346692085266,0.27435898780822754,973.748779296875,1e-05,0.19675132632255554,3.3655614852905273,81.14050197601318,0 +851,0.27991828322410583,0.4418231248855591,0.42774853110313416,0.1867132931947708,983.767822265625,1e-05,0.16517187654972076,3.134702205657959,81.14050197601318,0 +852,0.23216530680656433,0.26161468029022217,0.2782464921474457,0.2041957974433899,741.38232421875,1e-05,0.1638486236333847,3.0668537616729736,81.14050197601318,0 +853,0.3061448931694031,0.23787735402584076,0.2603530287742615,0.19090908765792847,850.0933227539062,1e-05,0.16925786435604095,3.2933189868927,81.14050197601318,0 +854,0.39584025740623474,0.22976899147033691,0.24225623905658722,0.23193472623825073,836.9324951171875,1e-05,0.12422892451286316,2.828212022781372,81.14050197601318,0 +855,0.1998429298400879,0.34877899289131165,0.34718629717826843,0.21398600935935974,666.1416625976562,1e-05,0.1598508059978485,2.8323230743408203,81.14050197601318,0 +856,0.37623706459999084,0.3808005154132843,0.39009666442871094,0.2174825221300125,952.5755615234375,1e-05,0.1614520251750946,3.344912052154541,81.14050197601318,0 +857,0.5429779887199402,0.16373910009860992,0.1888302117586136,0.26806527376174927,892.831298828125,1e-05,0.15180735290050507,2.8241634368896484,81.14050197601318,0 +858,0.24347101151943207,0.4246925711631775,0.41929733753204346,0.17552447319030762,988.4596557617188,1e-05,0.19247141480445862,3.366964340209961,81.14050197601318,0 +859,0.4436148405075073,0.3438238203525543,0.3454543352127075,0.1382284313440323,875.8281860351562,1e-05,0.15916503965854645,3.1145920753479004,81.14050197601318,0 +860,0.3649601340293884,0.3455859422683716,0.35250282287597656,0.21888111531734467,943.8261108398438,1e-05,0.4434114992618561,2.834507942199707,81.14050197601318,0 +861,0.327867716550827,0.25427722930908203,0.26309823989868164,0.0811188817024231,851.6567993164062,1e-05,0.29391172528266907,3.0437891483306885,81.14050197601318,0 +862,0.32104986906051636,0.2548508942127228,0.2656805217266083,0.22890442609786987,856.7466430664062,1e-05,1.15192449092865,3.3942160606384277,81.14050197601318,0 +863,0.34749048948287964,0.4186701774597168,0.42359474301338196,0.10489510744810104,979.0761108398438,1e-05,0.12228970974683762,2.8325717449188232,81.14050197601318,0 +864,0.38090768456459045,0.36451256275177,0.35427239537239075,0.21048951148986816,935.9909057617188,1e-05,0.19561347365379333,3.388678789138794,81.14050197601318,0 +865,0.204926535487175,0.32147541642189026,0.33703354001045227,0.2242424190044403,999.9999389648438,1e-05,0.13240309059619904,3.1267127990722656,81.14050197601318,0 +866,0.292476624250412,0.3104419708251953,0.313611775636673,0.11095570772886276,921.7830200195312,1e-05,0.16659444570541382,2.8298065662384033,81.14050197601318,0 +867,0.19522137939929962,0.2581712603569031,0.2611163854598999,0.21841491758823395,984.0607299804688,1e-05,0.18460258841514587,3.086543083190918,81.14050197601318,0 +868,0.258357971906662,0.18559867143630981,0.21069000661373138,0.21445220708847046,856.7466430664062,1e-05,0.1645144820213318,3.0440073013305664,81.14050197601318,0 +869,0.2360905557870865,0.312897264957428,0.32109618186950684,0.2181818187236786,854.7328491210938,1e-05,0.259473979473114,2.8167033195495605,81.14050197601318,0 +870,0.31429386138916016,0.28111109137535095,0.27824950218200684,0.21491841971874237,767.5730590820312,1e-05,0.13974493741989136,3.3181605339050293,81.14050197601318,0 +871,0.35618600249290466,0.17607291042804718,0.18489982187747955,0.0951048955321312,885.8264770507812,1e-05,0.1236284151673317,3.116260051727295,81.14050197601318,0 +872,0.3592720627784729,0.2848632037639618,0.29036784172058105,0.21212121844291687,675.8961181640625,1e-05,0.15917952358722687,2.8219525814056396,81.14050197601318,0 +873,0.3016307055950165,0.272366464138031,0.2763060927391052,0.20606060326099396,742.382080078125,1e-05,0.12852267920970917,3.093550205230713,81.14050197601318,0 +874,0.3773166537284851,0.4911961853504181,0.4988776445388794,0.1538461595773697,988.734619140625,1e-05,0.1504341959953308,3.0828490257263184,81.14050197601318,0 +875,0.3075926899909973,0.3702598810195923,0.36648428440093994,0.07878787815570831,667.560546875,1e-05,0.14229799807071686,2.83331036567688,81.14050197601318,0 +876,0.34169894456863403,0.3533497750759125,0.36261364817619324,0.1762237697839737,991.69189453125,1e-05,0.1422344595193863,3.3096323013305664,81.14050197601318,0 +877,0.26153117418289185,0.36326947808265686,0.37574824690818787,0.20909090340137482,964.1939697265625,1e-05,0.15390750765800476,3.0057356357574463,81.14050197601318,0 +878,0.36633339524269104,0.3880127966403961,0.3926335573196411,0.1778554767370224,414.4279479980469,1e-05,0.17424511909484863,2.816509962081909,81.14050197601318,0 +879,0.13747555017471313,0.24699369072914124,0.25355228781700134,0.20629370212554932,899.0933837890625,1e-05,0.13946177065372467,3.43129563331604,81.14050197601318,0 +880,0.3306214511394501,0.3598708510398865,0.37003546953201294,0.15058274567127228,690.4288330078125,1e-05,0.14972995221614838,2.824159860610962,81.14050197601318,0 +881,0.22022098302841187,0.23807884752750397,0.25328463315963745,0.2181818187236786,859.7134399414062,1e-05,0.11633682250976562,3.064375162124634,81.14050197601318,0 +882,0.20693551003932953,0.35468730330467224,0.36012032628059387,0.23589743673801422,970.1636352539062,1e-05,0.16786248981952667,3.2761642932891846,81.14050197601318,0 +883,0.3213224709033966,0.26320570707321167,0.28261440992355347,0.13566432893276215,990.8973388671875,1e-05,0.13766011595726013,3.0602777004241943,81.14050197601318,0 +884,0.31707534193992615,0.31816157698631287,0.33093926310539246,0.27715617418289185,949.5288696289062,1e-05,0.16817910969257355,2.8242111206054688,81.14050197601318,0 +885,0.1685929000377655,0.2802315950393677,0.2787359654903412,0.20629370212554932,844.7539672851562,1e-05,0.162924662232399,3.378312587738037,81.14050197601318,0 +886,0.1899842917919159,0.24005389213562012,0.2538442313671112,0.2069930136203766,568.0068969726562,1e-05,0.1968182623386383,2.833606481552124,81.14050197601318,0 +887,0.21123327314853668,0.8238195776939392,0.772088348865509,0.19393938779830933,995.9088745117188,1e-05,0.23831646144390106,3.042459726333618,81.14050197601318,0 +888,0.3130074143409729,0.2657632529735565,0.2827894687652588,0.12797202169895172,574.1869506835938,1e-05,0.23437510430812836,3.2821075916290283,81.14050197601318,0 +889,0.3111991882324219,0.3197903335094452,0.3158792555332184,0.27272728085517883,881.341796875,1e-05,0.14152683317661285,2.831756114959717,81.14050197601318,0 +890,0.2798023223876953,0.32952407002449036,0.33140337467193604,0.16153846681118011,989.8240966796875,1e-05,0.12732554972171783,2.8274295330047607,81.14050197601318,0 +891,0.16216100752353668,0.28252923488616943,0.2911827862262726,0.19230769574642181,826.846923828125,1e-05,0.13554327189922333,3.3975212574005127,81.14050197601318,0 +892,0.1645543873310089,0.34096279740333557,0.3539067208766937,0.2198135256767273,981.0787963867188,1e-05,0.21413671970367432,2.8270339965820312,81.14050197601318,0 +893,0.2670234441757202,0.23298399150371552,0.2439528852701187,0.23589743673801422,857.74267578125,1e-05,0.20360511541366577,3.0382556915283203,81.14050197601318,0 +894,0.2920461893081665,0.33018285036087036,0.3472621738910675,0.21328671276569366,390.0654296875,1e-05,0.13522930443286896,3.3000741004943848,81.14050197601318,0 +895,0.3310500979423523,0.3888190984725952,0.3835291564464569,0.20606060326099396,258.84716796875,1e-05,0.13458460569381714,2.8231639862060547,81.14050197601318,0 +896,0.20607389509677887,0.20132780075073242,0.21536938846111298,0.20512820780277252,834.6194458007812,1e-05,0.14932706952095032,3.0150623321533203,81.14050197601318,0 +897,0.41511398553848267,0.40128839015960693,0.40925681591033936,0.17132866382598877,292.3681640625,1e-05,0.1567668914794922,3.3785207271575928,81.14050197601318,0 +898,0.3215819299221039,0.23930539190769196,0.2542620897293091,0.1895104944705963,757.7117919921875,1e-05,0.11739358305931091,2.820358991622925,81.14050197601318,0 +899,0.3529621958732605,0.3506164252758026,0.3467935621738434,0.19254079461097717,902.6273193359375,1e-05,0.14734692871570587,3.0944700241088867,81.14050197601318,0 +900,0.4816724359989166,0.2271803766489029,0.23188501596450806,0.2282051295042038,901.2266235351562,1e-05,0.1537962108850479,3.3250889778137207,81.14050197601318,0 +901,0.2918531000614166,0.38396885991096497,0.38159897923469543,0.08298368006944656,957.7728271484375,1e-05,0.18715110421180725,2.8320107460021973,81.14050197601318,0 +902,0.3349038064479828,0.34792643785476685,0.3423270285129547,0.23473192751407623,923.8132934570312,1e-05,0.1677023470401764,3.1397790908813477,81.14050197601318,0 +903,0.15140436589717865,0.34808626770973206,0.3577459752559662,0.22750583291053772,963.818115234375,1e-05,0.14547790586948395,3.099832534790039,81.14050197601318,0 +904,0.1817481815814972,0.3362186551094055,0.34435707330703735,0.30233100056648254,968.7553100585938,1e-05,0.20292600989341736,2.833017587661743,81.14050197601318,0 +905,0.12215624749660492,0.1824168860912323,0.20969164371490479,0.17692308127880096,924.38623046875,1e-05,0.14716121554374695,3.2857723236083984,81.14050197601318,0 +906,0.34807202219963074,0.1409335434436798,0.1527266502380371,0.14289043843746185,726.8310546875,1e-05,0.3589051067829132,3.3716976642608643,81.14050197601318,0 +907,0.2745378315448761,0.269461989402771,0.26632481813430786,0.18298368155956268,852.1741943359375,1e-05,0.11143455654382706,2.8129022121429443,81.14050197601318,0 +908,0.18028759956359863,0.40880030393600464,0.4191090762615204,0.1638694703578949,411.0456848144531,1e-05,0.14704671502113342,3.059795379638672,81.14050197601318,0 +909,0.4307786226272583,0.30965811014175415,0.3264695703983307,0.23076923191547394,446.5873107910156,1e-05,0.15406624972820282,3.095823287963867,81.14050197601318,0 +910,0.19747474789619446,0.2373221516609192,0.24748454988002777,0.21072261035442352,943.1180419921875,1e-05,0.1095794215798378,2.8283092975616455,81.14050197601318,0 +911,0.40770578384399414,0.3515186011791229,0.35319122672080994,0.22004662454128265,905.37890625,1e-05,0.1267809122800827,3.290008544921875,81.14050197601318,0 +912,0.2761199176311493,0.2610020637512207,0.2698860168457031,0.20000000298023224,944.7620849609375,1e-05,0.10556227713823318,3.0827560424804688,81.14050197601318,0 +913,0.3843643367290497,0.32898321747779846,0.33378496766090393,0.19557109475135803,670.3726196289062,1e-05,0.3488253951072693,2.8348798751831055,81.14050197601318,0 +914,0.3167540431022644,0.2498030662536621,0.25633007287979126,0.19230769574642181,319.1216125488281,1e-05,0.11963027715682983,3.1078341007232666,81.14050197601318,0 +915,0.475178599357605,0.26047536730766296,0.28039807081222534,0.22610722482204437,697.9737548828125,1e-05,0.18527723848819733,3.0380055904388428,81.14050197601318,0 +916,0.5208587050437927,0.3145214915275574,0.3140322268009186,0.19090908765792847,882.9913330078125,1e-05,0.14004042744636536,2.8247246742248535,81.14050197601318,0 +917,0.3409210741519928,0.32224753499031067,0.31384631991386414,0.19230769574642181,910.0397338867188,1e-05,0.1731031984090805,3.3053030967712402,81.14050197601318,0 +918,0.24864213168621063,0.34372472763061523,0.3440828025341034,0.13286712765693665,839.2100219726562,1e-05,0.13373370468616486,3.2033486366271973,81.14050197601318,0 +919,0.3179119825363159,0.6293953657150269,0.6491190195083618,0.2254079282283783,120.44096374511719,1e-05,0.5494006872177124,2.8289833068847656,81.14050197601318,0 +920,0.34877723455429077,0.4031144678592682,0.39598920941352844,0.07599067687988281,606.806884765625,1e-05,0.20474117994308472,3.123494863510132,81.14050197601318,0 +921,0.3287486732006073,0.26048052310943604,0.27574437856674194,0.10442890226840973,999.177734375,1e-05,0.18002432584762573,3.1214404106140137,81.14050197601318,0 +922,0.4491657018661499,0.3225281536579132,0.330400675535202,0.1710955649614334,953.4276123046875,1e-05,0.139496847987175,3.1237900257110596,81.14050197601318,0 +923,0.37718743085861206,0.24208588898181915,0.25650227069854736,0.2214452177286148,942.8807373046875,1e-05,0.21187689900398254,3.152667999267578,81.14050197601318,0 +924,0.33545178174972534,0.24032960832118988,0.24364471435546875,0.08484848588705063,550.8392333984375,1e-05,0.14414919912815094,3.0743777751922607,81.14050197601318,0 +925,0.44535332918167114,0.27289775013923645,0.2918608784675598,0.28484848141670227,934.7079467773438,1e-05,0.15968342125415802,2.8239598274230957,81.14050197601318,0 +926,0.282824844121933,0.3487186133861542,0.3520751893520355,0.15734265744686127,572.1419677734375,1e-05,0.13516400754451752,3.132399559020996,81.14050197601318,0 +927,0.31405794620513916,0.3115527033805847,0.3127673864364624,0.2365967333316803,949.9702758789062,1e-05,0.20456106960773468,3.1013410091400146,81.14050197601318,0 +928,0.24432848393917084,0.3443432152271271,0.3457299768924713,0.15687645971775055,973.0780639648438,1e-05,0.1328638643026352,3.1137523651123047,81.14050197601318,0 +929,0.29290270805358887,0.4036293625831604,0.39580366015434265,0.28205129504203796,952.5755615234375,1e-05,0.14538142085075378,3.232703447341919,81.14050197601318,0 +930,0.2743210196495056,0.2707621455192566,0.26423218846321106,0.1895104944705963,831.677001953125,1e-05,0.1402178555727005,2.8339836597442627,81.14050197601318,0 +931,0.23505081236362457,0.36966562271118164,0.3732089102268219,0.2170163094997406,993.7682495117188,1e-05,0.16537341475486755,3.065962553024292,81.14050197601318,0 +932,0.2578825056552887,0.18863874673843384,0.20208416879177094,0.18834498524665833,876.2608642578125,1e-05,0.13404221832752228,2.8308820724487305,81.14050197601318,0 +933,0.2322983592748642,0.41306599974632263,0.41250988841056824,0.15571095049381256,998.7031860351562,1e-05,0.6533205509185791,3.150451421737671,81.14050197601318,0 +934,0.22378937900066376,0.35249075293540955,0.3891374468803406,0.19533799588680267,183.10153198242188,1e-05,0.17849285900592804,3.0651583671569824,81.14050197601318,0 +935,0.2953733205795288,0.31902721524238586,0.32642361521720886,0.0867132842540741,283.0556640625,1e-05,0.15282869338989258,3.3219988346099854,81.14050197601318,0 +936,0.34153449535369873,0.22521598637104034,0.2386322021484375,0.22400932013988495,748.2748413085938,1e-05,0.17521615326404572,2.827566146850586,81.14050197601318,0 +937,0.37759947776794434,0.30560871958732605,0.3161819875240326,0.09696969389915466,561.6887817382812,1e-05,0.12710025906562805,3.1226983070373535,81.14050197601318,0 +938,0.18608812987804413,0.2783295512199402,0.2857552766799927,0.11398601531982422,977.4996337890625,1e-05,0.1388988047838211,2.825786590576172,81.14050197601318,0 +939,0.2553540766239166,0.28096070885658264,0.28605979681015015,0.20606060326099396,836.3575439453125,1e-05,0.12849168479442596,3.118375301361084,81.14050197601318,0 +940,0.25205138325691223,0.19468989968299866,0.21547569334506989,0.18251748383045197,852.6897583007812,1e-05,0.14835242927074432,3.2758965492248535,81.14050197601318,0 +941,0.22923582792282104,0.3808082640171051,0.3688960373401642,0.19673658907413483,981.38232421875,1e-05,0.14875343441963196,3.3280718326568604,81.14050197601318,0 +942,0.3385227918624878,0.28116774559020996,0.2965066432952881,0.18601398169994354,900.5198364257812,1e-05,0.119987353682518,2.8289926052093506,81.14050197601318,0 +943,0.2098081260919571,0.27055883407592773,0.28413277864456177,0.1990675926208496,933.4083862304688,1e-05,0.11597704142332077,3.1403346061706543,81.14050197601318,0 +944,0.19797749817371368,0.4772668480873108,0.4781220257282257,0.23636363446712494,975.0736083984375,1e-05,0.25168049335479736,2.8410425186157227,81.14050197601318,0 +945,0.3220146894454956,0.43339452147483826,0.4376489818096161,0.21631701290607452,990.8973388671875,1e-05,0.14222802221775055,3.0797314643859863,81.14050197601318,0 +946,0.3101494312286377,0.37933292984962463,0.3791998624801636,0.24965034425258636,931.826171875,1e-05,0.13743138313293457,3.2380664348602295,81.14050197601318,0 +947,0.23635564744472504,0.3357286751270294,0.33017945289611816,0.11328671127557755,913.2542724609375,1e-05,0.1436661034822464,3.3744890689849854,81.14050197601318,0 +948,0.2730261981487274,0.2884518504142761,0.2921930253505707,0.1370629370212555,663.2779541015625,1e-05,0.14306123554706573,2.8298842906951904,81.14050197601318,0 +949,0.19419240951538086,0.3309258818626404,0.344447523355484,0.2405594438314438,965.4962768554688,1e-05,0.13654035329818726,3.0499088764190674,81.14050197601318,0 +950,0.304874062538147,0.25655657052993774,0.28918612003326416,0.23146852850914001,430.87518310546875,1e-05,0.14355486631393433,2.8236632347106934,81.14050197601318,0 +951,0.23788434267044067,0.1893686205148697,0.19054847955703735,0.12074591964483261,909.3855590820312,1e-05,0.16420745849609375,3.100271701812744,81.14050197601318,0 +952,0.4213767349720001,0.3185027539730072,0.32630351185798645,0.2158508151769638,927.2047729492188,1e-05,0.14869272708892822,3.252269983291626,81.14050197601318,0 +953,0.14629915356636047,0.467419296503067,0.4705714285373688,0.18531468510627747,995.6604614257812,1e-05,0.1190863624215126,3.090712547302246,81.14050197601318,0 +954,0.1768217533826828,0.405714213848114,0.40427637100219727,0.22564102709293365,982.7333984375,1e-05,0.13113677501678467,2.8177952766418457,81.14050197601318,0 +955,0.2643178105354309,0.211280956864357,0.21222776174545288,0.238228440284729,838.6439208984375,1e-05,0.143910214304924,3.0618741512298584,81.14050197601318,0 +956,0.26217418909072876,0.3074606657028198,0.3169748783111572,0.24242423474788666,916.0694580078125,1e-05,0.12615075707435608,3.093214511871338,81.14050197601318,0 +957,0.322366863489151,0.2882183790206909,0.2921247184276581,0.2410256415605545,833.4493408203125,1e-05,0.2906299829483032,2.812689781188965,81.14050197601318,0 +958,0.43154624104499817,0.36987778544425964,0.3822678327560425,0.1734265685081482,977.0203857421875,1e-05,0.12781843543052673,3.3370649814605713,81.14050197601318,0 +959,0.2883884906768799,0.2629365921020508,0.28215038776397705,0.2013985961675644,951.4989624023438,1e-05,0.28891709446907043,3.349916458129883,81.14050197601318,0 +960,0.3340545892715454,0.2992514669895172,0.3053242862224579,0.16363635659217834,601.3294677734375,1e-05,0.17307476699352264,3.0532312393188477,81.14050197601318,0 +961,0.2710435390472412,0.24267570674419403,0.2546704411506653,0.17715618014335632,819.3053588867188,1e-05,0.15967097878456116,2.8384456634521484,81.14050197601318,0 +962,0.17047858238220215,0.2653502821922302,0.2818157970905304,0.1794871836900711,983.178466796875,1e-05,0.11907824873924255,3.0397660732269287,81.14050197601318,0 +963,0.39636531472206116,0.49545523524284363,0.4859280586242676,0.22727273404598236,986.079833984375,1e-05,0.19031912088394165,2.841412305831909,81.14050197601318,0 +964,0.22413906455039978,0.2585231363773346,0.25686120986938477,0.08974359184503555,900.1648559570312,1e-05,0.1411542296409607,3.6120452880859375,81.14050197601318,0 +965,0.3295303285121918,0.30688223242759705,0.30169588327407837,0.24965034425258636,812.7318115234375,1e-05,0.1663311868906021,3.0429983139038086,81.14050197601318,0 +966,0.2044176161289215,0.22327104210853577,0.24274207651615143,0.2762237787246704,940.7190551757812,1e-05,0.15286915004253387,3.0612006187438965,81.14050197601318,0 +967,0.20936040580272675,0.3270210921764374,0.33347412943840027,0.2701631784439087,924.6715087890625,1e-05,0.14576706290245056,2.838456869125366,81.14050197601318,0 +968,0.30773162841796875,0.20865017175674438,0.21923644840717316,0.2018647938966751,906.7301635742188,1e-05,0.14394433796405792,3.094897747039795,81.14050197601318,0 +969,0.23440220952033997,0.3181270360946655,0.3219813406467438,0.21375291049480438,935.9909057617188,1e-05,0.2284703403711319,3.0718743801116943,81.14050197601318,0 +970,0.24476468563079834,0.20258763432502747,0.22017833590507507,0.2242424190044403,905.0384521484375,1e-05,0.15712550282478333,3.216907501220703,81.14050197601318,0 +971,0.3140619993209839,0.36279886960983276,0.37103596329689026,0.2529137432575226,973.2462768554688,1e-05,0.17674721777439117,3.0658860206604004,81.14050197601318,0 +972,0.29817742109298706,0.2567298412322998,0.2689526081085205,0.2265734225511551,781.0278930664062,1e-05,0.12998656928539276,3.0943753719329834,81.14050197601318,0 +973,0.4409765601158142,0.3558213412761688,0.36401796340942383,0.19393938779830933,427.6461486816406,1e-05,0.14216026663780212,2.8290889263153076,81.14050197601318,0 +974,0.2571398913860321,0.29585251212120056,0.2970288395881653,0.19836829602718353,850.6163940429688,1e-05,0.7121469974517822,3.0973215103149414,81.14050197601318,0 +975,0.460178405046463,0.2430684119462967,0.2642962336540222,0.11818181723356247,811.3840942382812,1e-05,0.32448092103004456,3.0850322246551514,81.14050197601318,0 +976,0.3451547622680664,0.2613878548145294,0.27125728130340576,0.23146852850914001,871.8681030273438,1e-05,0.12891335785388947,3.336688280105591,81.14050197601318,0 +977,0.40868523716926575,0.2797219157218933,0.2960202097892761,0.09044288843870163,497.7698974609375,1e-05,0.14062228798866272,3.080249547958374,81.14050197601318,0 +978,0.29460766911506653,0.20812217891216278,0.22765296697616577,0.20069929957389832,861.1730346679688,1e-05,0.12586261332035065,3.094398021697998,81.14050197601318,0 +979,0.23735572397708893,0.3533037006855011,0.3556663990020752,0.20815850794315338,803.0537109375,1e-05,0.1639184206724167,2.837977170944214,81.14050197601318,0 +980,0.21678856015205383,0.271918922662735,0.2735874652862549,0.2310023307800293,788.1709594726562,1e-05,0.23009157180786133,3.10307240486145,81.14050197601318,0 +981,0.19469499588012695,0.25330114364624023,0.2610202431678772,0.21212121844291687,883.8079833984375,1e-05,0.18418502807617188,3.398672103881836,81.14050197601318,0 +982,0.16136085987091064,0.3205879330635071,0.3210611939430237,0.26596736907958984,590.026123046875,1e-05,0.135231614112854,3.1089138984680176,81.14050197601318,0 +983,0.37720468640327454,0.2077246904373169,0.22792208194732666,0.23053613305091858,964.3812255859375,1e-05,0.18806785345077515,3.10038423538208,81.14050197601318,0 +984,0.425548255443573,0.3459346294403076,0.3486131727695465,0.20279720425605774,620.8772583007812,1e-05,0.18626675009727478,3.1048271656036377,81.14050197601318,0 +985,0.1442543864250183,0.3304430842399597,0.33113306760787964,0.20629370212554932,963.0614624023438,1e-05,0.11927110701799393,2.8292009830474854,81.14050197601318,0 +986,0.4207150936126709,0.3132990896701813,0.3042423129081726,0.16876456141471863,763.1554565429688,1e-05,0.15620318055152893,3.020918369293213,81.14050197601318,0 +987,0.34212711453437805,0.27360427379608154,0.2741135358810425,0.19696970283985138,934.1901245117188,1e-05,0.1503840535879135,3.234391927719116,81.14050197601318,0 +988,0.29350677132606506,0.3165738582611084,0.3249882757663727,0.2512820363044739,974.08203125,1e-05,0.13325661420822144,3.3925905227661133,81.14050197601318,0 +989,0.35921597480773926,0.34933239221572876,0.36418765783309937,0.21491841971874237,632.5867309570312,1e-05,0.14244405925273895,2.829897403717041,81.14050197601318,0 +990,0.5151969790458679,0.21537454426288605,0.22178471088409424,0.11118881404399872,888.9893188476562,1e-05,0.14597922563552856,3.3446693420410156,81.14050197601318,0 +991,0.4374068081378937,0.2535058557987213,0.2622383236885071,0.20163169503211975,624.2781982421875,1e-05,0.14900432527065277,2.8234832286834717,81.14050197601318,0 +992,0.23191027343273163,0.20576539635658264,0.21514679491519928,0.12097901850938797,873.2015991210938,1e-05,0.17009292542934418,3.0251691341400146,81.14050197601318,0 +993,0.3935237526893616,0.4378727972507477,0.42690104246139526,0.18997669219970703,997.5022583007812,1e-05,0.1170550137758255,3.330993413925171,81.14050197601318,0 +994,0.3988964259624481,0.24682796001434326,0.2554958462715149,0.11328671127557755,912.6188354492188,1e-05,0.13643819093704224,3.367696762084961,81.14050197601318,0 +995,0.23181520402431488,0.2541249692440033,0.25843894481658936,0.2254079282283783,753.992919921875,1e-05,0.1418667584657669,2.8249056339263916,81.14050197601318,0 +996,0.2892952263355255,0.27660447359085083,0.2974805235862732,0.2461538463830948,945.68896484375,1e-05,0.11474674195051193,3.0972790718078613,81.14050197601318,0 +997,0.16391867399215698,0.2747351825237274,0.28229576349258423,0.2449883371591568,968.2208862304688,1e-05,0.11591657996177673,2.8291454315185547,81.14050197601318,0 +998,0.2651677429676056,0.258683443069458,0.27336767315864563,0.24475523829460144,875.3941650390625,1e-05,0.17348523437976837,3.4287831783294678,81.14050197601318,0 +999,0.31879907846450806,0.20945142209529877,0.23020640015602112,0.2543123662471771,870.0686645507812,1e-05,0.16972552239894867,3.117128372192383,81.14050197601318,0 +1000,0.19635242223739624,0.28698211908340454,0.28863972425460815,0.16083915531635284,933.4083862304688,1e-05,0.11307497322559357,3.382737398147583,81.14050197601318,0 +1001,0.4023851156234741,0.4648665189743042,0.45957645773887634,0.19440560042858124,984.7882080078125,1e-05,0.1648317575454712,3.4935619831085205,81.14050197601318,0 +1002,0.0886833667755127,0.310864120721817,0.310908704996109,0.24149183928966522,931.56005859375,1e-05,0.14557771384716034,3.0665814876556396,81.14050197601318,0 +1003,0.2651781439781189,0.6791305541992188,0.6729996204376221,0.16153846681118011,113.7176742553711,1e-05,0.23640650510787964,3.1474270820617676,81.14050197601318,0 +1004,0.36097055673599243,0.3591747283935547,0.3641173541545868,0.21561771631240845,922.657958984375,1e-05,0.18662884831428528,2.834552526473999,81.14050197601318,0 +1005,0.25678586959838867,0.33828869462013245,0.3604033887386322,0.24708624184131622,484.3331604003906,1e-05,0.20601454377174377,3.26996111869812,81.14050197601318,0 +1006,0.29936039447784424,0.33475223183631897,0.34383055567741394,0.20326340198516846,967.1416625976562,1e-05,0.1827138215303421,3.0915815830230713,81.14050197601318,0 +1007,0.28189817070961,0.3367231488227844,0.35062965750694275,0.24708624184131622,976.2150268554688,1e-05,0.11909134685993195,3.037201404571533,81.14050197601318,0 +1008,0.2560965418815613,0.3207184076309204,0.3221757113933563,0.19813519716262817,964.0061645507812,1e-05,0.20861585438251495,3.1026017665863037,81.14050197601318,0 +1009,0.19696903228759766,0.30084002017974854,0.30896779894828796,0.2529137432575226,762.2591552734375,1e-05,0.1591198891401291,3.1359424591064453,81.14050197601318,0 +1010,0.18666253983974457,0.286216139793396,0.2930584251880646,0.2937062978744507,924.38623046875,1e-05,0.16390208899974823,2.8311164379119873,81.14050197601318,0 +1011,0.35536545515060425,0.33029335737228394,0.3527824580669403,0.16736596822738647,670.3726196289062,1e-05,0.1271667629480362,3.2793636322021484,81.14050197601318,0 +1012,0.247484028339386,0.28159284591674805,0.2845868766307831,0.15757575631141663,714.6185302734375,1e-05,0.130055770277977,3.0239036083221436,81.14050197601318,0 +1013,0.2258877009153366,0.3241991102695465,0.3365330398082733,0.2512820363044739,885.4254760742188,1e-05,0.12315471470355988,3.0573952198028564,81.14050197601318,0 +1014,0.46183785796165466,0.4265180826187134,0.43753892183303833,0.19720280170440674,283.0556640625,1e-05,0.232040673494339,2.836300849914551,81.14050197601318,0 +1015,0.33372166752815247,0.3530001640319824,0.35752803087234497,0.23146852850914001,966.2316284179688,1e-05,0.14026862382888794,3.356722593307495,81.14050197601318,0 +1016,0.29327335953712463,0.3116711676120758,0.3197384178638458,0.2153846174478531,972.9094848632812,1e-05,0.11902476847171783,2.8237152099609375,81.14050197601318,0 +1017,0.43596041202545166,0.3145400881767273,0.31509530544281006,0.1958041936159134,670.3726196289062,1e-05,0.1642751693725586,3.298516035079956,81.14050197601318,0 +1018,0.3809565007686615,0.2429252415895462,0.2634371221065521,0.2293706238269806,901.5783081054688,1e-05,0.15220950543880463,3.071575164794922,81.14050197601318,0 +1019,0.12212574481964111,0.34443768858909607,0.3506682217121124,0.21911421418190002,974.9092407226562,1e-05,0.09632579982280731,3.1080851554870605,81.14050197601318,0 +1020,0.26182034611701965,0.2801987826824188,0.2926104664802551,0.23799534142017365,864.5192260742188,1e-05,0.12655146420001984,2.83237886428833,81.14050197601318,0 +1021,0.3099953234195709,0.34444835782051086,0.35803115367889404,0.1946386992931366,917.9066772460938,1e-05,0.1407211273908615,3.3441848754882812,81.14050197601318,0 +1022,0.37421879172325134,0.2805328667163849,0.2885116636753082,0.1766899824142456,870.971435546875,1e-05,0.20952343940734863,3.0548012256622314,81.14050197601318,0 +1023,0.3310167193412781,0.6634035706520081,0.684820830821991,0.18764568865299225,120.44096374511719,1e-05,0.12091173231601715,3.070742130279541,81.14050197601318,0 +1024,0.2644630968570709,0.34391191601753235,0.3558550477027893,0.20932400226593018,986.3638916015625,1e-05,0.24485556781291962,3.1489906311035156,81.14050197601318,0 +1025,0.23683232069015503,0.28352758288383484,0.29513421654701233,0.2209790199995041,894.70751953125,1e-05,0.20211215317249298,3.073961019515991,81.14050197601318,0 +1026,0.1926582306623459,0.33792147040367126,0.33527514338493347,0.18484848737716675,932.6204223632812,1e-05,0.14169995486736298,2.8225603103637695,81.14050197601318,0 +1027,0.33574119210243225,0.4082293212413788,0.4140738248825073,0.17692308127880096,310.39483642578125,1e-05,0.13120049238204956,3.3456637859344482,81.14050197601318,0 +1028,0.2604973316192627,0.48926419019699097,0.4637477993965149,0.2466200441122055,997.1378173828125,1e-05,0.12247858941555023,3.0864927768707275,81.14050197601318,0 +1029,0.3494422137737274,0.35986292362213135,0.34903767704963684,0.23193472623825073,749.2398071289062,1e-05,0.13177530467510223,3.264589309692383,81.14050197601318,0 +1030,0.18430238962173462,0.23860067129135132,0.26507464051246643,0.21282051503658295,966.414306640625,1e-05,0.16508302092552185,3.086366891860962,81.14050197601318,0 +1031,0.3626050353050232,0.5229225158691406,0.5306794047355652,0.14055943489074707,296.9483642578125,1e-05,0.1836598962545395,3.097522497177124,81.14050197601318,0 +1032,0.2276964783668518,0.35076048970222473,0.3575355112552643,0.06666667014360428,931.826171875,1e-05,0.12458459287881851,2.826719045639038,81.14050197601318,0 +1033,0.2812469005584717,0.28144189715385437,0.28347349166870117,0.17855477333068848,822.4921875,1e-05,0.15481339395046234,3.098565101623535,81.14050197601318,0 +1034,0.270844966173172,0.3109951615333557,0.3143312335014343,0.21235431730747223,978.4493408203125,1e-05,0.16924993693828583,3.1557886600494385,81.14050197601318,0 +1035,0.29969918727874756,0.39922162890434265,0.3784836530685425,0.22960372269153595,932.6204223632812,1e-05,0.13269664347171783,3.3137409687042236,81.14050197601318,0 +1036,0.21784034371376038,0.21789918839931488,0.22961454093456268,0.214685320854187,913.2542724609375,1e-05,0.115786612033844,3.0643467903137207,81.14050197601318,0 +1037,0.37434032559394836,0.1946723908185959,0.2065470814704895,0.16969697177410126,923.2371215820312,1e-05,0.13587211072444916,2.8373193740844727,81.14050197601318,0 +1038,0.25219985842704773,0.2686392664909363,0.27317169308662415,0.1822843849658966,828.6761474609375,1e-05,0.11942456662654877,3.051948308944702,81.14050197601318,0 +1039,0.24257895350456238,0.24920566380023956,0.25280675292015076,0.060606058686971664,801.6233520507812,1e-05,0.17671307921409607,3.099855422973633,81.14050197601318,0 +1040,0.42203474044799805,0.34104853868484497,0.35762423276901245,0.274125874042511,643.773681640625,1e-05,0.16855311393737793,3.0280721187591553,81.14050197601318,0 +1041,0.3683740496635437,0.3661555051803589,0.36388036608695984,0.1666666716337204,768.4440307617188,1e-05,0.1815178543329239,3.346830368041992,81.14050197601318,0 +1042,0.33626073598861694,0.2149420976638794,0.22080180048942566,0.10536130517721176,807.27197265625,1e-05,0.1256287395954132,3.0801706314086914,81.14050197601318,0 +1043,0.37323588132858276,0.22050164639949799,0.22765782475471497,0.2097902148962021,667.560546875,1e-05,0.25841575860977173,2.823676586151123,81.14050197601318,0 +1044,0.2640875279903412,0.24876493215560913,0.27161508798599243,0.13659673929214478,489.7753601074219,1e-05,0.14687056839466095,3.080125093460083,81.14050197601318,0 +1045,0.11186078190803528,0.2514905333518982,0.26274821162223816,0.1778554767370224,922.0755004882812,1e-05,0.11083917319774628,3.0719757080078125,81.14050197601318,0 +1046,0.5439659953117371,0.2674063444137573,0.27204596996307373,0.2377622425556183,682.6182250976562,1e-05,0.14183616638183594,3.287397623062134,81.14050197601318,0 +1047,0.30423933267593384,0.31699901819229126,0.3380715250968933,0.2097902148962021,975.5648193359375,1e-05,0.21153207123279572,3.1304640769958496,81.14050197601318,0 +1048,0.17810463905334473,0.23519431054592133,0.25633004307746887,0.19603729248046875,914.2007446289062,1e-05,0.14191921055316925,3.471560478210449,81.14050197601318,0 +1049,0.2557436227798462,0.3344256579875946,0.3391333520412445,0.2668997645378113,915.1390991210938,1e-05,0.12240452319383621,2.829256057739258,81.14050197601318,0 +1050,0.2951948940753937,0.3454888164997101,0.3437175154685974,0.11258741468191147,819.9478759765625,1e-05,0.22163942456245422,3.104785442352295,81.14050197601318,0 +1051,0.3615265488624573,0.26789581775665283,0.2798040509223938,0.17319346964359283,397.1928405761719,1e-05,0.38962632417678833,3.1113152503967285,81.14050197601318,0 +1052,0.36316385865211487,0.39037108421325684,0.3937338888645172,0.24032634496688843,336.031982421875,1e-05,0.5922231078147888,3.056985855102539,81.14050197601318,0 +1053,0.26100850105285645,0.37336626648902893,0.38344570994377136,0.18927739560604095,427.6461486816406,1e-05,0.12040817737579346,3.093177318572998,81.14050197601318,0 +1054,0.30438971519470215,0.3696712255477905,0.3769769072532654,0.16573426127433777,983.178466796875,1e-05,0.14363405108451843,3.0585837364196777,81.14050197601318,0 +1055,0.3132505714893341,0.21606525778770447,0.22298236191272736,0.12937062978744507,741.38232421875,1e-05,0.20289744436740875,2.8205740451812744,81.14050197601318,0 +1056,0.43057781457901,0.43869516253471375,0.43596962094306946,0.11841491609811783,963.818115234375,1e-05,0.1545487642288208,3.280770778656006,81.14050197601318,0 +1057,0.26195552945137024,0.27717870473861694,0.27823880314826965,0.19883449375629425,890.5407104492188,1e-05,0.1559017300605774,3.111966848373413,81.14050197601318,0 +1058,0.23566913604736328,0.3780800700187683,0.3734428584575653,0.22680652141571045,971.3762817382812,1e-05,0.12925301492214203,3.0596203804016113,81.14050197601318,0 +1059,0.15547320246696472,0.22970432043075562,0.25551924109458923,0.20372959971427917,586.15087890625,1e-05,1.0621238946914673,3.0939736366271973,81.14050197601318,0 +1060,0.2872067093849182,0.2496565282344818,0.25594985485076904,0.17272727191448212,974.5794677734375,1e-05,0.14280125498771667,3.1546072959899902,81.14050197601318,0 +1061,0.3544923961162567,0.24389997124671936,0.26101040840148926,0.2477855533361435,945.9192504882812,1e-05,0.15368719398975372,2.833292007446289,81.14050197601318,0 +1062,0.275287002325058,0.1985504925251007,0.22077040374279022,0.23473192751407623,761.3585205078125,1e-05,0.14947257936000824,3.082575559616089,81.14050197601318,0 +1063,0.23985199630260468,0.1991468071937561,0.19288480281829834,0.1319347321987152,826.846923828125,1e-05,0.10045529156923294,3.136364698410034,81.14050197601318,0 +1064,0.3105092942714691,0.3966178894042969,0.38737303018569946,0.20536130666732788,984.4981079101562,1e-05,0.14790518581867218,3.220343589782715,81.14050197601318,0 +1065,0.24724748730659485,0.1951799988746643,0.19713476300239563,0.15011654794216156,789.71923828125,1e-05,0.13722212612628937,3.0734071731567383,81.14050197601318,0 +1066,0.347764790058136,0.28238487243652344,0.31322354078292847,0.22447551786899567,972.9094848632812,1e-05,0.13638342916965485,3.046513557434082,81.14050197601318,0 +1067,0.4717021584510803,0.3265390396118164,0.33195266127586365,0.1806526780128479,986.6468505859375,1e-05,0.18590489029884338,3.0330543518066406,81.14050197601318,0 +1068,0.311619371175766,0.2598930299282074,0.2864663302898407,0.2829836905002594,989.0084838867188,1e-05,0.15561378002166748,3.070981025695801,81.14050197601318,0 +1069,0.30582287907600403,0.6739813685417175,0.7002431154251099,0.16037295758724213,999.4136352539062,1e-05,0.14650216698646545,3.0631797313690186,81.14050197601318,0 +1070,0.24983914196491241,0.31326448917388916,0.32222312688827515,0.25034964084625244,961.5278930664062,1e-05,0.16513961553573608,3.242750644683838,81.14050197601318,0 +1071,0.2676190733909607,0.4726432263851166,0.47841477394104004,0.28601399064064026,986.079833984375,1e-05,0.12789447605609894,3.08952260017395,81.14050197601318,0 +1072,0.3149612843990326,0.24067598581314087,0.25645580887794495,0.10652680695056915,753.0517578125,1e-05,0.18312063813209534,3.042752504348755,81.14050197601318,0 +1073,0.26532721519470215,0.38918358087539673,0.4140990376472473,0.12237761914730072,248.77369689941406,1e-05,0.14123313128948212,3.051626205444336,81.14050197601318,0 +1074,0.1922980099916458,0.31883490085601807,0.32433104515075684,0.250582754611969,960.3594970703125,1e-05,0.09952855110168457,2.8391618728637695,81.14050197601318,0 +1075,0.3819032907485962,0.391367107629776,0.40534675121307373,0.250582754611969,969.9888916015625,1e-05,0.1399773210287094,3.078749895095825,81.14050197601318,0 +1076,0.40509283542633057,0.27282437682151794,0.2716241180896759,0.19277389347553253,983.4736938476562,1e-05,0.15574324131011963,3.2457118034362793,81.14050197601318,0 +1077,0.37821534276008606,0.31638869643211365,0.3242405354976654,0.2354312390089035,915.1390991210938,1e-05,0.17292794585227966,3.1495590209960938,81.14050197601318,0 +1078,0.2628237009048462,0.31711938977241516,0.3255525231361389,0.22867132723331451,610.396240234375,1e-05,0.23189906775951385,3.043426752090454,81.14050197601318,0 +1079,0.32921844720840454,0.294175922870636,0.3152395486831665,0.19160838425159454,939.4969482421875,1e-05,0.15607231855392456,3.0543086528778076,81.14050197601318,0 +1080,0.3338243365287781,0.26973050832748413,0.2695443034172058,0.13613054156303406,797.99267578125,1e-05,0.1866711974143982,2.8276207447052,81.14050197601318,0 +1081,0.3614741563796997,0.28691965341567993,0.2779519855976105,0.23752914369106293,742.382080078125,1e-05,0.41188257932662964,3.0333402156829834,81.14050197601318,0 +1082,0.31816366314888,0.28420791029930115,0.29680028557777405,0.24032634496688843,851.6567993164062,1e-05,0.12179678678512573,3.2891807556152344,81.14050197601318,0 +1083,0.10725980997085571,0.35628578066825867,0.3566494584083557,0.2566433548927307,993.383544921875,1e-05,0.1370568573474884,3.278376817703247,81.14050197601318,0 +1084,0.23217234015464783,0.32991674542427063,0.33344966173171997,0.14335663616657257,983.767822265625,1e-05,0.24155238270759583,2.8320231437683105,81.14050197601318,0 +1085,0.3875671327114105,0.25735366344451904,0.271737277507782,0.22960372269153595,912.6188354492188,1e-05,0.1870056688785553,3.0544023513793945,81.14050197601318,0 +1086,0.1942659318447113,0.21440212428569794,0.2254381775856018,0.2454545497894287,690.4288330078125,1e-05,0.16705414652824402,2.831580877304077,81.14050197601318,0 +1087,0.2979918420314789,0.2240380197763443,0.2456173598766327,0.2158508151769638,914.2007446289062,1e-05,0.13542260229587555,3.050102949142456,81.14050197601318,0 +1088,0.20357882976531982,0.13749518990516663,0.15552133321762085,0.13496503233909607,730.0392456054688,1e-05,0.16213583946228027,3.0826966762542725,81.14050197601318,0 +1089,0.18234854936599731,0.2528698742389679,0.2567923367023468,0.2226107269525528,800.9034423828125,1e-05,0.16495856642723083,3.3539669513702393,81.14050197601318,0 +1090,0.31934410333633423,0.31343990564346313,0.31723687052726746,0.1599067598581314,991.8234252929688,1e-05,0.9961827397346497,2.851597785949707,81.14050197601318,0 +1091,0.22716613113880157,0.26106590032577515,0.2690960466861725,0.25081583857536316,985.794677734375,1e-05,0.13339729607105255,3.102191925048828,81.14050197601318,0 +1092,0.2799954116344452,0.2640875577926636,0.26997238397598267,0.20909090340137482,850.0933227539062,1e-05,0.15668484568595886,3.1677703857421875,81.14050197601318,0 +1093,0.24877123534679413,0.20755663514137268,0.22729317843914032,0.21165500581264496,668.9708251953125,1e-05,0.1574188619852066,3.051337718963623,81.14050197601318,0 +1094,0.16361021995544434,0.3123268783092499,0.3286265432834625,0.1650349646806717,965.3115234375,1e-05,0.1358323097229004,3.4285478591918945,81.14050197601318,0 +1095,0.4118565320968628,0.4281501770019531,0.42803263664245605,0.15594404935836792,417.7786560058594,1e-05,0.13883312046527863,3.0551681518554688,81.14050197601318,0 +1096,0.3237031102180481,0.31716904044151306,0.36101558804512024,0.26247087121009827,985.6517944335938,1e-05,0.14839570224285126,2.826972484588623,81.14050197601318,0 +1097,0.38414162397384644,0.4160645008087158,0.40069761872291565,0.13519813120365143,976.3768310546875,1e-05,0.8748040795326233,3.2496891021728516,81.14050197601318,0 +1098,0.1687697470188141,0.3314487338066101,0.34601858258247375,0.14335663616657257,938.756103515625,1e-05,0.12292825430631638,3.110841989517212,81.14050197601318,0 +1099,0.18915969133377075,0.2621488869190216,0.279136061668396,0.2097902148962021,481.577392578125,1e-05,0.17012068629264832,3.039771795272827,81.14050197601318,0 +1100,0.15450133383274078,0.3351280689239502,0.3208557665348053,0.2708624601364136,970.1636352539062,1e-05,0.16504934430122375,3.1792948246002197,81.14050197601318,0 +1101,0.14601673185825348,0.3171558976173401,0.3372729420661926,0.2365967333316803,999.177734375,1e-05,0.14080551266670227,3.044055700302124,81.14050197601318,0 +1102,0.2245042771100998,0.25785359740257263,0.2716449201107025,0.09696969389915466,973.748779296875,1e-05,0.1138412356376648,2.8480355739593506,81.14050197601318,0 +1103,0.31694331765174866,0.2605190575122833,0.273345410823822,0.23030303418636322,819.9478759765625,1e-05,0.10747388750314713,3.2857916355133057,81.14050197601318,0 +1104,0.35220053791999817,0.27011650800704956,0.2866247892379761,0.19696970283985138,959.1751708984375,1e-05,0.16181263327598572,3.3864169120788574,81.14050197601318,0 +1105,0.5681815147399902,0.31581273674964905,0.3150314390659332,0.2002331018447876,591.9431762695312,1e-05,0.13249358534812927,3.029094696044922,81.14050197601318,0 +1106,0.45829376578330994,0.32614457607269287,0.3416236340999603,0.1482517421245575,982.2857666015625,1e-05,0.16893060505390167,3.3754265308380127,81.14050197601318,0 +1107,0.2815779447555542,0.3371847867965698,0.343274861574173,0.20163169503211975,679.9532470703125,1e-05,0.15469512343406677,3.043508768081665,81.14050197601318,0 +1108,0.44566771388053894,0.38466396927833557,0.40944090485572815,0.20512820780277252,287.737548828125,1e-05,0.1396641731262207,3.040079355239868,81.14050197601318,0 +1109,0.3859998881816864,0.2784130871295929,0.27649083733558655,0.15874126553535461,920.9009399414062,1e-05,0.18386323750019073,3.0372135639190674,81.14050197601318,0 +1110,0.23738518357276917,0.2348625659942627,0.23931612074375153,0.10279720276594162,953.8506469726562,1e-05,0.13215869665145874,3.3681347370147705,81.14050197601318,0 +1111,0.4530697464942932,0.2977481186389923,0.2954966723918915,0.23076923191547394,713.4717407226562,1e-05,0.1709688901901245,3.114922523498535,81.14050197601318,0 +1112,0.27745237946510315,0.46577006578445435,0.4546114504337311,0.23473192751407623,991.954833984375,1e-05,0.15356704592704773,3.089381217956543,81.14050197601318,0 +1113,0.4564434587955475,0.2533215582370758,0.26382526755332947,0.11794871836900711,655.9628295898438,1e-05,0.20080189406871796,3.084545612335205,81.14050197601318,0 +1114,0.41187340021133423,0.5551117658615112,0.559848427772522,0.12354312092065811,227.91456604003906,1e-05,0.4925391674041748,3.0880234241485596,81.14050197601318,0 +1115,0.4027860462665558,0.33143410086631775,0.33116447925567627,0.2209790199995041,683.93896484375,1e-05,0.23842111229896545,3.121579647064209,81.14050197601318,0 +1116,0.3352610468864441,0.2308335155248642,0.24672183394432068,0.1599067598581314,854.7328491210938,1e-05,0.3687324821949005,3.1791908740997314,81.14050197601318,0 +1117,0.46371540427207947,0.2928427457809448,0.2952275276184082,0.2242424190044403,946.6068115234375,1e-05,0.18958960473537445,3.332003355026245,81.14050197601318,0 +1118,0.3187788128852844,0.3386422097682953,0.3489093482494354,0.19207459688186646,977.9759521484375,1e-05,0.15167468786239624,3.13285231590271,81.14050197601318,0 +1119,0.25950729846954346,0.3589319586753845,0.36291003227233887,0.23193472623825073,982.2857666015625,1e-05,0.15922664105892181,3.051344156265259,81.14050197601318,0 +1120,0.3902939558029175,0.29792681336402893,0.307085245847702,0.20163169503211975,722.4732666015625,1e-05,0.1446155160665512,3.0427074432373047,81.14050197601318,0 +1121,0.28304752707481384,0.2929271161556244,0.28497692942619324,0.21375291049480438,875.3941650390625,1e-05,0.1420184224843979,3.0484423637390137,81.14050197601318,0 +1122,0.2525879442691803,0.498411625623703,0.4747360050678253,0.16969697177410126,998.4646606445312,1e-05,0.15453757345676422,3.0553526878356934,81.14050197601318,0 +1123,0.25074368715286255,0.2825655937194824,0.28905925154685974,0.2198135256767273,752.1058349609375,1e-05,0.13569317758083344,3.342010498046875,81.14050197601318,0 +1124,0.3662148714065552,0.2201557755470276,0.22464652359485626,0.04895104840397835,668.9708251953125,1e-05,0.15904434025287628,2.8247532844543457,81.14050197601318,0 +1125,0.2516250014305115,0.18787749111652374,0.19899055361747742,0.11002331227064133,961.5278930664062,1e-05,0.11832991987466812,3.0669209957122803,81.14050197601318,0 +1126,0.2696111798286438,0.3979550302028656,0.39638441801071167,0.1526806503534317,982.7333984375,1e-05,0.20925307273864746,3.07259464263916,81.14050197601318,0 +1127,0.29466918110847473,0.368843674659729,0.37187591195106506,0.23519814014434814,530.23681640625,1e-05,0.18012790381908417,3.0466315746307373,81.14050197601318,0 +1128,0.2648862600326538,0.33078786730766296,0.33300143480300903,0.20652680099010468,896.5547485351562,1e-05,0.20787708461284637,3.0718772411346436,81.14050197601318,0 +1129,0.25343412160873413,0.28619086742401123,0.2964012324810028,0.23636363446712494,832.2701416015625,1e-05,0.1423051953315735,3.05509090423584,81.14050197601318,0 +1130,0.3713420033454895,0.2694815993309021,0.26437515020370483,0.1298368275165558,781.836181640625,1e-05,0.13351795077323914,3.0402016639709473,81.14050197601318,0 +1131,0.23292218148708344,0.44435685873031616,0.43437930941581726,0.19137528538703918,998.5840454101562,1e-05,0.19791115820407867,3.083670139312744,81.14050197601318,0 +1132,0.3297835886478424,0.3153354525566101,0.3167773187160492,0.23986013233661652,850.0933227539062,1e-05,0.18900753557682037,2.8200385570526123,81.14050197601318,0 +1133,0.2976478934288025,0.3742803633213043,0.37617531418800354,0.23799534142017365,988.734619140625,1e-05,0.14117836952209473,3.3724145889282227,81.14050197601318,0 +1134,0.23423349857330322,0.14102450013160706,0.15919607877731323,0.1326340287923813,745.3507080078125,1e-05,0.1525852531194687,3.048466682434082,81.14050197601318,0 +1135,0.23778392374515533,0.302493691444397,0.3081446886062622,0.21445220708847046,965.126220703125,1e-05,0.18484407663345337,3.281205177307129,81.14050197601318,0 +1136,0.3532988727092743,0.2177717536687851,0.23766827583312988,0.1515151560306549,937.2574462890625,1e-05,0.1318853199481964,3.0756568908691406,81.14050197601318,0 +1137,0.23622512817382812,0.39859887957572937,0.396442711353302,0.2433566451072693,914.2007446289062,1e-05,0.10047315806150436,3.014296293258667,81.14050197601318,0 +1138,0.2958596646785736,0.2467779815196991,0.2515210807323456,0.09347319602966309,664.7142333984375,1e-05,0.12740802764892578,3.133201837539673,81.14050197601318,0 +1139,0.32798969745635986,0.3334078788757324,0.3561767339706421,0.20279720425605774,371.6285705566406,1e-05,0.12947218120098114,3.0186257362365723,81.14050197601318,0 +1140,0.2266615927219391,0.3099459409713745,0.31949731707572937,0.1906759887933731,947.2893676757812,1e-05,0.16655877232551575,3.0518765449523926,81.14050197601318,0 +1141,0.5012221336364746,0.3811049461364746,0.3930237889289856,0.2214452177286148,421.0982971191406,1e-05,0.20656396448612213,3.0702710151672363,81.14050197601318,0 +1142,0.3741215467453003,0.3116450607776642,0.32305148243904114,0.2310023307800293,951.2822265625,1e-05,0.18559782207012177,3.331867218017578,81.14050197601318,0 +1143,0.24393510818481445,0.33257216215133667,0.3496410846710205,0.23076923191547394,273.5347900390625,1e-05,0.1287095695734024,3.004345655441284,81.14050197601318,0 +1144,0.28954529762268066,0.2811422646045685,0.2849011719226837,0.20606060326099396,889.3790893554688,1e-05,0.2575046718120575,3.047767162322998,81.14050197601318,0 +1145,0.23886507749557495,0.1511322408914566,0.15427155792713165,0.02097902074456215,578.2326049804688,1e-05,0.13626843690872192,3.0814967155456543,81.14050197601318,0 +1146,0.45957034826278687,0.34120744466781616,0.3455001711845398,0.1990675926208496,960.5552368164062,1e-05,0.18575428426265717,3.303957939147949,81.14050197601318,0 +1147,0.20097032189369202,0.42779141664505005,0.41631826758384705,0.238228440284729,930.488525390625,1e-05,0.19419072568416595,3.0407984256744385,81.14050197601318,0 +1148,0.21623314917087555,0.2682710289955139,0.2871006429195404,0.2242424190044403,646.8789672851562,1e-05,0.1263200342655182,3.047410726547241,81.14050197601318,0 +1149,0.2718273103237152,0.35009822249412537,0.3583827316761017,0.2069930136203766,851.6567993164062,1e-05,0.16597411036491394,3.0426366329193115,81.14050197601318,0 +1150,0.19367147982120514,0.30766892433166504,0.3195751905441284,0.19976690411567688,612.1727294921875,1e-05,0.12114474177360535,3.0848426818847656,81.14050197601318,0 +1151,0.1916579008102417,0.3438989222049713,0.3505704402923584,0.17995338141918182,957.5706176757812,1e-05,0.19575849175453186,3.0338950157165527,81.14050197601318,0 +1152,0.2431596964597702,0.19461564719676971,0.20978806912899017,0.2242424190044403,724.6637573242188,1e-05,0.18331784009933472,3.2795069217681885,81.14050197601318,0 +1153,0.41691645979881287,0.350973516702652,0.34762924909591675,0.17156177759170532,505.5683898925781,1e-05,0.19735005497932434,2.831777811050415,81.14050197601318,0 +1154,0.2399270385503769,0.4916157126426697,0.4868919849395752,0.24312354624271393,974.4140625,1e-05,0.17748282849788666,3.1214613914489746,81.14050197601318,0 +1155,0.15107809007167816,0.1730692982673645,0.18073201179504395,0.19930069148540497,671.7659301757812,1e-05,0.12352672219276428,3.02842116355896,81.14050197601318,0 +1156,0.3070714473724365,0.2637050449848175,0.2880008816719055,0.15687645971775055,995.2861328125,1e-05,0.15768994390964508,3.0516159534454346,81.14050197601318,0 +1157,0.30133920907974243,0.36617735028266907,0.3676915168762207,0.1034965068101883,233.2209930419922,1e-05,0.1867745965719223,3.064263343811035,81.14050197601318,0 +1158,0.34217843413352966,0.2204519361257553,0.2485322803258896,0.23473192751407623,940.4759521484375,1e-05,0.2127169817686081,3.301513195037842,81.14050197601318,0 +1159,0.3815065324306488,0.35401785373687744,0.3651040494441986,0.21375291049480438,449.6458740234375,1e-05,0.1825011521577835,2.8379547595977783,81.14050197601318,1 +1160,0.15493462979793549,0.3763163685798645,0.38010045886039734,0.18088577687740326,945.226806640625,1e-05,0.13908694684505463,3.1310372352600098,81.14050197601318,1 +1161,0.1841493546962738,0.3254011273384094,0.3246573209762573,0.16969697177410126,933.9302368164062,1e-05,0.10893738269805908,3.0126307010650635,81.14050197601318,1 +1162,0.2900087237358093,0.2444118857383728,0.2558729648590088,0.24009324610233307,969.8138427734375,1e-05,0.11392318457365036,3.3403689861297607,81.14050197601318,1 +1163,0.18076813220977783,0.439898818731308,0.4391413927078247,0.21212121844291687,960.1631469726562,1e-05,0.21401667594909668,3.1068050861358643,81.14050197601318,1 +1164,0.27109619975090027,0.26189324259757996,0.26057323813438416,0.2405594438314438,976.69921875,1e-05,4.211085319519043,3.329378843307495,81.14050197601318,1 +1165,0.31170564889907837,0.2820774018764496,0.28885817527770996,0.2599067687988281,682.6182250976562,1e-05,0.16020163893699646,3.0744686126708984,81.14050197601318,1 +1166,0.2656289041042328,0.35476261377334595,0.35175150632858276,0.2405594438314438,918.2099609375,1e-05,0.11973760277032852,2.8311455249786377,81.14050197601318,1 +1167,0.18814828991889954,0.18489417433738708,0.20103754103183746,0.2489510476589203,911.3367309570312,1e-05,0.10493001341819763,3.032350540161133,81.14050197601318,1 +1168,0.30588263273239136,0.46037718653678894,0.45417895913124084,0.21515151858329773,963.251220703125,1e-05,0.9653593301773071,3.347334384918213,81.14050197601318,1 +1169,0.3399263024330139,0.38325902819633484,0.37105539441108704,0.2734265625476837,997.86474609375,1e-05,0.125925213098526,3.088451385498047,81.14050197601318,1 +1170,0.22664344310760498,0.3517557680606842,0.35151922702789307,0.19114218652248383,921.7830200195312,1e-05,0.13858623802661896,3.086702585220337,81.14050197601318,1 +1171,0.2964438498020172,0.26596131920814514,0.27318504452705383,0.28671327233314514,896.920654296875,1e-05,0.14846166968345642,3.1347973346710205,81.14050197601318,1 +1172,0.35147297382354736,0.3923504650592804,0.39743879437446594,0.10139860212802887,327.6654357910156,1e-05,0.42011669278144836,2.819489002227783,81.14050197601318,1 +1173,0.35938525199890137,0.34546199440956116,0.3466395139694214,0.24172493815422058,948.4158325195312,1e-05,0.16046203672885895,3.0573067665100098,81.14050197601318,1 +1174,0.31556370854377747,0.1311536431312561,0.15637995302677155,0.1946386992931366,800.1805419921875,1e-05,0.2077372968196869,3.2588307857513428,81.14050197601318,1 +1175,0.34582751989364624,0.3940577208995819,0.3949684500694275,0.20279720425605774,987.906494140625,1e-05,0.19281567633152008,3.0500998497009277,81.14050197601318,1 +1176,0.2338196486234665,0.27647683024406433,0.2748108208179474,0.0951048955321312,873.64306640625,1e-05,0.18366654217243195,3.1170127391815186,81.14050197601318,1 +1177,0.15991446375846863,0.48331794142723083,0.4883117973804474,0.139860138297081,994.7838134765625,1e-05,0.11367406696081161,3.342434883117676,81.14050197601318,1 +1178,0.32443660497665405,0.30000007152557373,0.3091847002506256,0.2270396202802658,909.0570068359375,1e-05,0.2060924917459488,2.826143503189087,81.14050197601318,1 +1179,0.2125784456729889,0.2904813885688782,0.29193487763404846,0.22214451432228088,892.0726318359375,1e-05,0.13430404663085938,2.824059247970581,81.14050197601318,1 +1180,0.2103450745344162,0.27392929792404175,0.27723264694213867,0.145454540848732,952.3612670898438,1e-05,0.10453920811414719,3.26822566986084,81.14050197601318,1 +1181,0.27415192127227783,0.28479477763175964,0.292223185300827,0.24032634496688843,900.1648559570312,1e-05,0.18785309791564941,3.368635416030884,81.14050197601318,1 +1182,0.2551151216030121,0.29599088430404663,0.2842271625995636,0.18811188638210297,878.82666015625,1e-05,0.16155320405960083,3.071047306060791,81.14050197601318,1 +1183,0.13030588626861572,0.33581385016441345,0.34273120760917664,0.20000000298023224,976.2150268554688,1e-05,0.1443101167678833,3.3283419609069824,81.14050197601318,1 +1184,0.2952853739261627,0.40310755372047424,0.41622039675712585,0.151048943400383,998.1053466796875,1e-05,0.16072751581668854,3.0350711345672607,81.14050197601318,1 +1185,0.15357883274555206,0.3852270841598511,0.38246649503707886,0.2230769246816635,994.9097900390625,1e-05,0.16334372758865356,2.8259737491607666,81.14050197601318,1 +1186,0.2151288092136383,0.39423808455467224,0.39846163988113403,0.19417248666286469,970.5119018554688,1e-05,0.1339617371559143,3.5789239406585693,81.14050197601318,1 +1187,0.14955827593803406,0.23371589183807373,0.26230791211128235,0.2717948853969574,946.378173828125,1e-05,0.12972669303417206,3.2805984020233154,81.14050197601318,1 +1188,0.3531646132469177,0.4092276394367218,0.41029199957847595,0.19533799588680267,984.4981079101562,1e-05,0.15157300233840942,3.162306070327759,81.14050197601318,1 +1189,0.41972628235816956,0.30641916394233704,0.32226306200027466,0.20000000298023224,955.10791015625,1e-05,0.1411539614200592,2.829052686691284,81.14050197601318,1 +1190,0.2374093234539032,0.43765756487846375,0.43804308772087097,0.20279720425605774,979.3876342773438,1e-05,0.1213054433465004,3.0472545623779297,81.14050197601318,1 +1191,0.3126397430896759,0.28482598066329956,0.282400518655777,0.22191141545772552,848.5123291015625,1e-05,0.20311513543128967,3.042560577392578,81.14050197601318,1 +1192,0.20957888662815094,0.3679027855396271,0.35886305570602417,0.2282051295042038,947.7415161132812,1e-05,0.2631942927837372,3.2638416290283203,81.14050197601318,1 +1193,0.3776084780693054,0.2836698293685913,0.2866399884223938,0.1594405621290207,771.0321044921875,1e-05,0.1502493917942047,3.310581922531128,81.14050197601318,1 +1194,0.2254253327846527,0.3366207778453827,0.3620087802410126,0.12937062978744507,980.4682006835938,1e-05,0.1251724362373352,3.1028499603271484,81.14050197601318,1 +1195,0.21207274496555328,0.3387501835823059,0.34331727027893066,0.13682983815670013,975.7278442382812,1e-05,0.14891284704208374,2.837186813354492,81.14050197601318,1 +1196,0.18228888511657715,0.2863234281539917,0.303059846162796,0.20163169503211975,424.38739013671875,1e-05,0.12725071609020233,3.10256290435791,81.14050197601318,1 +1197,0.34231671690940857,0.30483901500701904,0.325254887342453,0.2209790199995041,660.37890625,1e-05,0.1301095187664032,3.1094772815704346,81.14050197601318,1 +1198,0.2899726927280426,0.3242752254009247,0.31733620166778564,0.20000000298023224,893.5853271484375,1e-05,0.14772945642471313,3.4497671127319336,81.14050197601318,1 +1199,0.1538800597190857,0.3513493239879608,0.3476288616657257,0.19696970283985138,895.0792846679688,1e-05,0.1211186870932579,3.2871017456054688,81.14050197601318,1 +1200,0.4265390634536743,0.3428950309753418,0.3552597761154175,0.16736596822738647,263.79840087890625,1e-05,0.1585969775915146,3.1470682621002197,81.14050197601318,1 +1201,0.22480948269367218,0.2942352592945099,0.3045787513256073,0.13403263688087463,947.9669189453125,1e-05,0.1768476814031601,2.826557159423828,81.14050197601318,1 +1202,0.31130510568618774,0.32871681451797485,0.3295551836490631,0.21095570921897888,854.7328491210938,1e-05,0.13382521271705627,3.0579001903533936,81.14050197601318,1 +1203,0.380907267332077,0.21584826707839966,0.23207896947860718,0.17272727191448212,890.15478515625,1e-05,0.25040891766548157,3.1206116676330566,81.14050197601318,1 +1204,0.3466184437274933,0.26645326614379883,0.2767733335494995,0.16969697177410126,625.9617919921875,1e-05,0.18600372970104218,3.5012173652648926,81.14050197601318,1 +1205,0.3487529456615448,0.2493777573108673,0.26327142119407654,0.1790209710597992,427.6461486816406,1e-05,0.13527728617191315,3.1137638092041016,81.14050197601318,1 +1206,0.3499990701675415,0.15621766448020935,0.1707347184419632,0.1107226088643074,731.0974731445312,1e-05,0.1295812726020813,3.0896363258361816,81.14050197601318,1 +1207,0.30075448751449585,0.49665436148643494,0.5160132646560669,0.2242424190044403,206.04872131347656,1e-05,0.22705066204071045,2.834998369216919,81.14050197601318,1 +1208,0.24748660624027252,0.22140005230903625,0.23102010786533356,0.2354312390089035,953.0025024414062,1e-05,0.18405432999134064,3.0633838176727295,81.14050197601318,1 +1209,0.24657146632671356,0.2793290615081787,0.3094537556171417,0.2158508151769638,997.86474609375,1e-05,0.17603370547294617,3.1945457458496094,81.14050197601318,1 +1210,0.22752949595451355,0.20691603422164917,0.22042441368103027,0.19487179815769196,803.0537109375,1e-05,0.14476792514324188,3.105774402618408,81.14050197601318,1 +1211,0.549111008644104,0.3264574706554413,0.3342016637325287,0.22167831659317017,610.396240234375,1e-05,0.2262827306985855,3.30411696434021,81.14050197601318,1 +1212,0.27573713660240173,0.2273215353488922,0.25070369243621826,0.16759906709194183,891.6915283203125,1e-05,0.47126203775405884,3.0721499919891357,81.14050197601318,1 +1213,0.19832360744476318,0.24141348898410797,0.2532019317150116,0.22191141545772552,986.6468505859375,1e-05,0.16848692297935486,2.824176549911499,81.14050197601318,1 +1214,0.2592620551586151,0.2554369866847992,0.2620673179626465,0.19720280170440674,903.6668701171875,1e-05,0.15894323587417603,3.094308853149414,81.14050197601318,1 +1215,0.24435332417488098,0.6008318066596985,0.6070607900619507,0.2018647938966751,133.62509155273438,1e-05,0.18366321921348572,3.3536276817321777,81.14050197601318,1 +1216,0.13886292278766632,0.3649754524230957,0.37263569235801697,0.19393938779830933,983.9144897460938,1e-05,0.10563743859529495,3.228236436843872,81.14050197601318,1 +1217,0.3333802819252014,0.30418136715888977,0.30825185775756836,0.20372959971427917,949.3074340820312,1e-05,0.16854295134544373,3.2905049324035645,81.14050197601318,1 +1218,0.1508428156375885,0.36821064352989197,0.3766780197620392,0.19836829602718353,968.2208862304688,1e-05,0.1446673423051834,3.076342821121216,81.14050197601318,1 +1219,0.13811911642551422,0.32689881324768066,0.3360220789909363,0.16643357276916504,913.8861694335938,1e-05,0.13301905989646912,3.0441064834594727,81.14050197601318,1 +1220,0.33208149671554565,0.2500276267528534,0.24807259440422058,0.12144522368907928,951.4989624023438,1e-05,0.185124471783638,2.8369367122650146,81.14050197601318,1 +1221,0.2870783507823944,0.31604933738708496,0.3222044110298157,0.21515151858329773,918.5123291015625,1e-05,0.1909334808588028,3.5996017456054688,81.14050197601318,1 +1222,0.23079872131347656,0.4648799002170563,0.4593248665332794,0.21561771631240845,974.08203125,1e-05,0.12461281567811966,3.2780942916870117,81.14050197601318,1 +1223,0.2166459560394287,0.2345336526632309,0.26276037096977234,0.22284382581710815,970.8588256835938,1e-05,0.16260787844657898,3.3716516494750977,81.14050197601318,1 +1224,0.2817312479019165,0.33526837825775146,0.3351835608482361,0.1874125897884369,803.7642822265625,1e-05,0.16909924149513245,2.8210160732269287,81.14050197601318,1 +1225,0.22391630709171295,0.3738754689693451,0.37721094489097595,0.27832168340682983,951.4989624023438,1e-05,0.14327092468738556,3.1069176197052,81.14050197601318,1 +1226,0.2823950946331024,0.37796273827552795,0.3844629228115082,0.2158508151769638,996.1564331054688,1e-05,0.13424508273601532,3.0310730934143066,81.14050197601318,1 +1227,0.2664814293384552,0.29506874084472656,0.2973693013191223,0.238228440284729,843.6619262695312,1e-05,0.2161482274532318,3.129014253616333,81.14050197601318,1 +1228,0.3662657141685486,0.25565189123153687,0.2707030177116394,0.15314684808254242,889.3790893554688,1e-05,0.13426053524017334,3.0078752040863037,81.14050197601318,1 +1229,0.40455731749534607,0.22471052408218384,0.24754971265792847,0.20349650084972382,964.940673828125,1e-05,0.6454606652259827,3.046788454055786,81.14050197601318,1 +1230,0.2863823175430298,0.3363317549228668,0.33660921454429626,0.20629370212554932,664.7142333984375,1e-05,0.8499429225921631,3.697972536087036,81.14050197601318,1 +1231,0.21261051297187805,0.30610236525535583,0.31085994839668274,0.23076923191547394,809.341064453125,1e-05,0.2628636956214905,3.0463545322418213,81.14050197601318,1 +1232,0.24693304300308228,0.3531906008720398,0.35848671197891235,0.20815850794315338,983.9144897460938,1e-05,0.14396630227565765,3.06076717376709,81.14050197601318,1 +1233,0.23620784282684326,0.35195744037628174,0.355192631483078,0.1638694703578949,437.2454833984375,1e-05,0.14650288224220276,3.124636173248291,81.14050197601318,1 +1234,0.1629955768585205,0.2589975595474243,0.2713921070098877,0.14638695120811462,987.069091796875,1e-05,0.12992730736732483,3.245918035507202,81.14050197601318,1 +1235,0.25523674488067627,0.2907215356826782,0.2945902943611145,0.11515151709318161,966.77880859375,1e-05,0.11964152753353119,3.089695692062378,81.14050197601318,1 +1236,0.2927008271217346,0.2757355272769928,0.2772431969642639,0.2610722482204437,808.654296875,1e-05,0.21119223535060883,2.8270957469940186,81.14050197601318,1 +1237,0.34851574897766113,0.3338492214679718,0.32266655564308167,0.2668997645378113,888.9893188476562,1e-05,0.1831640601158142,3.0693976879119873,81.14050197601318,1 +1238,0.19231173396110535,0.30589282512664795,0.3059556484222412,0.20629370212554932,951.93115234375,1e-05,0.15067510306835175,3.124907970428467,81.14050197601318,1 +1239,0.3896358013153076,0.28297483921051025,0.2936267852783203,0.24149183928966522,808.654296875,1e-05,0.26746508479118347,3.392791509628296,81.14050197601318,1 +1240,0.28522801399230957,0.40186071395874023,0.402989000082016,0.19114218652248383,920.3087768554688,1e-05,0.19475409388542175,3.031407117843628,81.14050197601318,1 +1241,0.2631359100341797,0.32982125878334045,0.33369719982147217,0.18018648028373718,765.8187255859375,1e-05,0.20495720207691193,3.106390953063965,81.14050197601318,1 +1242,0.35493963956832886,0.22553451359272003,0.2393525093793869,0.22494173049926758,793.5297241210938,1e-05,0.1394612044095993,2.8287627696990967,81.14050197601318,1 +1243,0.19940783083438873,0.3212128281593323,0.3244471848011017,0.1890442818403244,960.3594970703125,1e-05,0.1322939693927765,3.082529067993164,81.14050197601318,1 +1244,0.21396446228027344,0.295707643032074,0.30379340052604675,0.260606050491333,991.954833984375,1e-05,0.1281166821718216,3.1258721351623535,81.14050197601318,1 +1245,0.2285490483045578,0.27922865748405457,0.2780895233154297,0.20069929957389832,901.2266235351562,1e-05,0.15107659995555878,3.3092551231384277,81.14050197601318,1 +1246,0.3268568515777588,0.2189711630344391,0.24133875966072083,0.15687645971775055,421.0982971191406,1e-05,0.19602471590042114,3.0472207069396973,81.14050197601318,1 +1247,0.27595874667167664,0.6852374076843262,0.6542525887489319,0.19393938779830933,997.7442626953125,1e-05,0.23547573387622833,3.1190359592437744,81.14050197601318,1 +1248,0.20177212357521057,0.2813297510147095,0.28963181376457214,0.14941725134849548,663.2779541015625,1e-05,0.20464813709259033,2.8303911685943604,81.14050197601318,1 +1249,0.3264574110507965,0.3906807005405426,0.410983681678772,0.2710955739021301,287.737548828125,1e-05,0.1624927520751953,3.130474805831909,81.14050197601318,1 +1250,0.20367394387722015,0.19195404648780823,0.19981592893600464,0.19393938779830933,905.7181396484375,1e-05,0.1572871208190918,3.0716872215270996,81.14050197601318,1 +1251,0.13374607264995575,0.42840737104415894,0.4224712550640106,0.20652680099010468,983.3262329101562,1e-05,0.13693132996559143,3.4573581218719482,81.14050197601318,1 +1252,0.21748870611190796,0.4469361901283264,0.4704810082912445,0.23916083574295044,140.08938598632812,1e-05,0.29196450114250183,3.0512020587921143,81.14050197601318,1 +1253,0.4980998635292053,0.3588462471961975,0.35689347982406616,0.23356643319129944,819.3053588867188,1e-05,0.18421150743961334,3.0411548614501953,81.14050197601318,1 +1254,0.215506449341774,0.29191213846206665,0.3238012194633484,0.15081584453582764,973.2462768554688,1e-05,0.11917009204626083,3.040733575820923,81.14050197601318,1 +1255,0.27631303668022156,0.3385895788669586,0.35089096426963806,0.1990675926208496,989.8240966796875,1e-05,0.14868411421775818,2.8240857124328613,81.14050197601318,1 +1256,0.34631112217903137,0.22382031381130219,0.23431825637817383,0.26806527376174927,924.6715087890625,1e-05,0.17446719110012054,3.391587972640991,81.14050197601318,1 +1257,0.28523361682891846,0.3517414927482605,0.3576463758945465,0.22494173049926758,929.1331176757812,1e-05,0.12827689945697784,3.088104009628296,81.14050197601318,1 +1258,0.2133110612630844,0.2730967700481415,0.2696501314640045,0.17878787219524384,849.041259765625,1e-05,0.15635116398334503,3.0533950328826904,81.14050197601318,1 +1259,0.18508310616016388,0.19112561643123627,0.20030978322029114,0.21212121844291687,750.1998901367188,1e-05,0.13867561519145966,3.0647475719451904,81.14050197601318,1 +1260,0.1969415247440338,0.4363194406032562,0.4311228096485138,0.2174825221300125,975.4014282226562,1e-05,0.17002986371517181,3.1165242195129395,81.14050197601318,1 +1261,0.29984772205352783,0.3806524872779846,0.38572824001312256,0.22564102709293365,981.230712890625,1e-05,0.1378123015165329,2.8368475437164307,81.14050197601318,1 +1262,0.46858668327331543,0.17900602519512177,0.18857444822788239,0.13659673929214478,590.026123046875,1e-05,0.11854945123195648,3.38810658454895,81.14050197601318,1 +1263,0.264999657869339,0.1863759309053421,0.1952063888311386,0.13613054156303406,862.1375732421875,1e-05,0.15485508739948273,3.0413434505462646,81.14050197601318,1 +1264,0.21222612261772156,0.26433899998664856,0.27395641803741455,0.2622377574443817,926.3671875,1e-05,0.28569260239601135,3.2854995727539062,81.14050197601318,1 +1265,0.19361457228660583,0.30784133076667786,0.31218186020851135,0.22004662454128265,390.0654296875,1e-05,0.11848003417253494,3.066310167312622,81.14050197601318,1 +1266,0.25721475481987,0.2653958201408386,0.27339738607406616,0.21911421418190002,904.354736328125,1e-05,0.17223259806632996,3.031575918197632,81.14050197601318,1 +1267,0.22304672002792358,0.313497930765152,0.3311226963996887,0.16899767518043518,992.6078491210938,1e-05,0.12199044972658157,2.823460340499878,81.14050197601318,1 +1268,0.22984713315963745,0.422161340713501,0.429251104593277,0.1867132931947708,935.22314453125,1e-05,0.20500874519348145,3.100022077560425,81.14050197601318,1 +1269,0.21982473134994507,0.3209283649921417,0.32066214084625244,0.19440560042858124,839.2100219726562,1e-05,0.3482290804386139,3.076742649078369,81.14050197601318,1 +1270,0.23960430920124054,0.19894704222679138,0.22324597835540771,0.2405594438314438,828.6761474609375,1e-05,0.15242625772953033,3.3052971363067627,81.14050197601318,1 +1271,0.3129594922065735,0.34762686491012573,0.3398866355419159,0.1818181872367859,988.18359375,1e-05,0.14651870727539062,3.1117160320281982,81.14050197601318,1 +1272,0.18355968594551086,0.4586660861968994,0.4557076096534729,0.1878787875175476,969.9888916015625,1e-05,0.12069687247276306,3.0300819873809814,81.14050197601318,1 +1273,0.2472807615995407,0.2954428791999817,0.31712961196899414,0.1890442818403244,983.4736938476562,1e-05,0.31958624720573425,3.0549259185791016,81.14050197601318,1 +1274,0.2758732736110687,0.23629315197467804,0.2558634579181671,0.23030303418636322,923.8132934570312,1e-05,0.10172678530216217,3.146575450897217,81.14050197601318,1 +1275,0.24755318462848663,0.40045830607414246,0.4128490090370178,0.23123542964458466,976.69921875,1e-05,0.15876366198062897,3.3015222549438477,81.14050197601318,1 +1276,0.4546581208705902,0.30987054109573364,0.31674185395240784,0.26806527376174927,615.6897583007812,1e-05,0.16311632096767426,3.4150402545928955,81.14050197601318,1 +1277,0.43149131536483765,0.2931711971759796,0.2946150302886963,0.20885780453681946,953.8506469726562,1e-05,0.13777542114257812,2.81485652923584,81.14050197601318,1 +1278,0.4226993918418884,0.362100213766098,0.35122808814048767,0.2174825221300125,861.6561889648438,1e-05,0.2828098237514496,3.1148242950439453,81.14050197601318,1 +1279,0.18347617983818054,0.3186231851577759,0.337308794260025,0.27389276027679443,963.251220703125,1e-05,0.1297566443681717,3.1488752365112305,81.14050197601318,1 +1280,0.30772268772125244,0.33062323927879333,0.32789695262908936,0.2596736550331116,962.6806640625,1e-05,0.5058388113975525,3.0887832641601562,81.14050197601318,1 +1281,0.300873339176178,0.25285494327545166,0.2709815204143524,0.1202797219157219,984.0607299804688,1e-05,0.1035974770784378,3.1019508838653564,81.14050197601318,1 +1282,0.10115913301706314,0.3239400088787079,0.3313990533351898,0.16083915531635284,891.30908203125,1e-05,0.12704533338546753,3.3426079750061035,81.14050197601318,1 +1283,0.44834813475608826,0.30466416478157043,0.2996690571308136,0.07365967333316803,877.5501708984375,1e-05,0.1343439668416977,3.0519464015960693,81.14050197601318,1 +1284,0.26740169525146484,0.29035764932632446,0.27937737107276917,0.18764568865299225,927.2047729492188,1e-05,0.11826019734144211,2.83243465423584,81.14050197601318,1 +1285,0.2894538640975952,0.28823122382164,0.2895144820213318,0.14568763971328735,691.7044067382812,1e-05,0.16492679715156555,3.2984297275543213,81.14050197601318,1 +1286,0.19492369890213013,0.298157274723053,0.30415767431259155,0.21794871985912323,948.6395874023438,1e-05,0.11148099601268768,3.0616824626922607,81.14050197601318,1 +1287,0.27500319480895996,0.3509121239185333,0.3522951602935791,0.17832167446613312,953.4276123046875,1e-05,0.18686629831790924,3.041017770767212,81.14050197601318,1 +1288,0.4243965446949005,0.2922824025154114,0.30795368552207947,0.2181818187236786,855.2390747070312,1e-05,0.13572964072227478,3.128833770751953,81.14050197601318,1 +1289,0.28463712334632874,0.21038095653057098,0.21579869091510773,0.06969697028398514,701.6507568359375,1e-05,0.2160530835390091,3.0873470306396484,81.14050197601318,1 +1290,0.25633496046066284,0.20401351153850555,0.2260894626379013,0.23869463801383972,866.3948974609375,1e-05,0.15778546035289764,2.821986675262451,81.14050197601318,1 +1291,0.34702426195144653,0.2677657902240753,0.27639874815940857,0.23449882864952087,995.035400390625,1e-05,0.16958284378051758,3.3829660415649414,81.14050197601318,1 +1292,0.165788933634758,0.2743988633155823,0.2832050621509552,0.25477856397628784,892.0726318359375,1e-05,0.13226106762886047,3.0471410751342773,81.14050197601318,1 +1293,0.3716200292110443,0.20557738840579987,0.20521698892116547,0.1766899824142456,939.7424926757812,1e-05,0.15463446080684662,3.069145679473877,81.14050197601318,1 +1294,0.2639450430870056,0.2687453329563141,0.28436079621315,0.23426572978496552,826.2322387695312,1e-05,0.1716621071100235,3.128678321838379,81.14050197601318,1 +1295,0.2524929642677307,0.26765573024749756,0.2704199552536011,0.2610722482204437,899.4515991210938,1e-05,0.13227666914463043,3.1053810119628906,81.14050197601318,1 +1296,0.5693939328193665,0.3789515793323517,0.37745797634124756,0.08601398766040802,553.0419311523438,1e-05,0.17095817625522614,3.12528920173645,81.14050197601318,1 +1297,0.2502611577510834,0.25892579555511475,0.2574729919433594,0.19044288992881775,890.15478515625,1e-05,0.16853459179401398,3.143874168395996,81.14050197601318,1 +1298,0.41306036710739136,0.25970447063446045,0.2690606713294983,0.17529137432575226,876.2608642578125,1e-05,0.20215736329555511,3.0794949531555176,81.14050197601318,1 +1299,0.2873609960079193,0.24118821322917938,0.25941747426986694,0.15198135375976562,619.15966796875,1e-05,0.1717398315668106,3.3354604244232178,81.14050197601318,1 +1300,0.2899044156074524,0.2293834090232849,0.24370083212852478,0.1822843849658966,939.0036010742188,1e-05,0.14626166224479675,3.06630277633667,81.14050197601318,1 +1301,0.3180466592311859,0.1826925128698349,0.18943819403648376,0.14498834311962128,720.25927734375,1e-05,0.2126312255859375,3.115422487258911,81.14050197601318,1 +1302,0.31840866804122925,0.23190976679325104,0.24045191705226898,0.08881118893623352,819.9478759765625,1e-05,0.15633894503116608,3.045022487640381,81.14050197601318,1 +1303,0.5292352437973022,0.410327285528183,0.41985467076301575,0.18927739560604095,390.0654296875,1e-05,0.12949489057064056,3.12426495552063,81.14050197601318,1 +1304,0.369305819272995,0.3852390646934509,0.40305083990097046,0.1622377634048462,994.9097900390625,1e-05,0.23983973264694214,3.097602605819702,81.14050197601318,1 +1305,0.27205613255500793,0.2505432963371277,0.2524135112762451,0.14079253375530243,716.8931274414062,1e-05,0.16036342084407806,3.288949489593506,81.14050197601318,1 +1306,0.2712509334087372,0.2906630039215088,0.2997208535671234,0.23519814014434814,988.5972900390625,1e-05,0.15925869345664978,3.1600382328033447,81.14050197601318,1 +1307,0.261691153049469,0.2807721197605133,0.2875964045524597,0.22727273404598236,982.1359252929688,1e-05,0.16759997606277466,3.044976234436035,81.14050197601318,1 +1308,0.2865012288093567,0.33549195528030396,0.34258899092674255,0.22517482936382294,912.2996826171875,1e-05,0.1853027492761612,3.387535572052002,81.14050197601318,1 +1309,0.40428879857063293,0.24015186727046967,0.2511483132839203,0.22773893177509308,884.2141723632812,1e-05,0.18101687729358673,3.079622507095337,81.14050197601318,1 +1310,0.16688354313373566,0.3793008029460907,0.38396167755126953,0.2242424190044403,996.771484375,1e-05,0.14204086363315582,3.1356379985809326,81.14050197601318,1 +1311,0.1435575783252716,0.4085831046104431,0.39868345856666565,0.2242424190044403,988.0452880859375,1e-05,0.11136690527200699,3.329373359680176,81.14050197601318,1 +1312,0.180124431848526,0.2970460057258606,0.3012048900127411,0.22610722482204437,785.822265625,1e-05,0.14621490240097046,2.8196563720703125,81.14050197601318,1 +1313,0.34124910831451416,0.28720468282699585,0.3014772832393646,0.1890442818403244,473.1681213378906,1e-05,0.10858365148305893,3.061771869659424,81.14050197601318,1 +1314,0.2768351435661316,0.5646551847457886,0.5521348714828491,0.17855477333068848,986.221923828125,1e-05,0.20157597959041595,3.0967438220977783,81.14050197601318,1 +1315,0.40680813789367676,0.2381678819656372,0.24862685799598694,0.1930069923400879,992.3473510742188,1e-05,0.2705208361148834,3.3514626026153564,81.14050197601318,1 +1316,0.23459750413894653,0.3538483679294586,0.3617027699947357,0.1818181872367859,601.3294677734375,1e-05,0.26486822962760925,3.0165793895721436,81.14050197601318,1 +1317,0.3119678795337677,0.3788681626319885,0.3707404136657715,0.22890442609786987,776.0996704101562,1e-05,0.12900681793689728,3.375857353210449,81.14050197601318,1 +1318,0.2844281494617462,0.2915570139884949,0.2983899712562561,0.15594404935836792,913.8861694335938,1e-05,0.14774464070796967,3.0136256217956543,81.14050197601318,1 +1319,0.2545247972011566,0.29875439405441284,0.306233286857605,0.2293706238269806,885.4254760742188,1e-05,0.19647668302059174,2.828799247741699,81.14050197601318,1 +1320,0.3192354142665863,0.4580821692943573,0.47707420587539673,0.1862470805644989,982.5844116210938,1e-05,0.14414390921592712,3.357011318206787,81.14050197601318,1 +1321,0.30745819211006165,0.2888583838939667,0.2869718670845032,0.21118880808353424,884.6192626953125,1e-05,8.284660339355469,3.035059928894043,81.14050197601318,1 +1322,0.4932316541671753,0.24803999066352844,0.2599553167819977,0.21491841971874237,814.068359375,1e-05,0.15693527460098267,3.0623183250427246,81.14050197601318,1 +1323,0.3987313508987427,0.4259600341320038,0.44803789258003235,0.1662004590034485,227.91456604003906,1e-05,0.1950027495622635,3.426114797592163,81.14050197601318,1 +1324,0.221745103597641,0.44778844714164734,0.42709943652153015,0.20279720425605774,997.5022583007812,1e-05,0.12926466763019562,3.00116229057312,81.14050197601318,1 +1325,0.22248899936676025,0.47965794801712036,0.4684256613254547,0.22797203063964844,997.6233520507812,1e-05,0.3237778842449188,2.8178417682647705,81.14050197601318,1 +1326,0.40146756172180176,0.34201255440711975,0.3284544348716736,0.17575757205486298,974.08203125,1e-05,0.21666868031024933,3.372251033782959,81.14050197601318,1 +1327,0.35411956906318665,0.28033649921417236,0.28594228625297546,0.0855477824807167,709.9939575195312,1e-05,0.20346617698669434,3.0153472423553467,81.14050197601318,1 +1328,0.31626635789871216,0.45608949661254883,0.4721263647079468,0.2913752794265747,296.9483642578125,1e-05,0.21678248047828674,3.0864064693450928,81.14050197601318,1 +1329,0.3222368359565735,0.28472575545310974,0.2929447889328003,0.1958041936159134,958.576904296875,1e-05,0.1679498255252838,3.435692071914673,81.14050197601318,1 +1330,0.309976726770401,0.4301174581050873,0.4511393904685974,0.20000000298023224,985.364990234375,1e-05,0.31208929419517517,3.0026204586029053,81.14050197601318,1 +1331,0.13381993770599365,0.41693103313446045,0.4181059002876282,0.18391607701778412,968.0419921875,1e-05,0.14028887450695038,2.8167543411254883,81.14050197601318,1 +1332,0.38460227847099304,0.2721156179904938,0.27508336305618286,0.20209790766239166,865.928466796875,1e-05,0.1736738681793213,3.147901773452759,81.14050197601318,1 +1333,0.18159812688827515,0.24615256488323212,0.260550856590271,0.10116550326347351,975.2377319335938,1e-05,0.2125738263130188,2.998239517211914,81.14050197601318,1 +1334,0.20241302251815796,0.26980844140052795,0.2841249406337738,0.1834498792886734,862.6173095703125,1e-05,0.1807994693517685,3.012289047241211,81.14050197601318,1 +1335,0.24602390825748444,0.4803072512149811,0.46137940883636475,0.19603729248046875,992.2167358398438,1e-05,0.2104863077402115,3.0676262378692627,81.14050197601318,1 +1336,0.3954721987247467,0.3226478397846222,0.32148316502571106,0.1515151560306549,737.33203125,1e-05,0.14218617975711823,3.041292190551758,81.14050197601318,1 +1337,0.19768568873405457,0.2677181363105774,0.2631262242794037,0.19766899943351746,718.021240234375,1e-05,0.12293877452611923,3.0693254470825195,81.14050197601318,1 +1338,0.12616756558418274,0.2907409965991974,0.30076128244400024,0.10839160531759262,955.523193359375,1e-05,0.1564810872077942,3.096757650375366,81.14050197601318,1 +1339,0.32432979345321655,0.36889854073524475,0.36180469393730164,0.18927739560604095,663.2779541015625,1e-05,0.15990987420082092,3.0445690155029297,81.14050197601318,1 +1340,0.49382391571998596,0.34064722061157227,0.34403830766677856,0.11701631546020508,972.9094848632812,1e-05,0.1548987478017807,3.0663254261016846,81.14050197601318,1 +1341,0.32891225814819336,0.3247252404689789,0.32253292202949524,0.2058275043964386,880.5089721679688,1e-05,0.1520015448331833,3.0842039585113525,81.14050197601318,1 +1342,0.1013650894165039,0.36904212832450867,0.39149269461631775,0.22890442609786987,987.3492431640625,1e-05,0.11465530097484589,3.034454107284546,81.14050197601318,1 +1343,0.2516031861305237,0.37499409914016724,0.3828836977481842,0.21328671276569366,986.221923828125,1e-05,0.14050713181495667,3.070530652999878,81.14050197601318,1 +1344,0.3735334873199463,0.2785361111164093,0.3060245215892792,0.18041957914829254,578.2326049804688,1e-05,0.13460643589496613,3.0978291034698486,81.14050197601318,1 +1345,0.35567498207092285,0.250971257686615,0.25700175762176514,0.2142191082239151,926.6471557617188,1e-05,0.1574731171131134,3.0041298866271973,81.14050197601318,1 +1346,0.36080271005630493,0.4708692729473114,0.4812513589859009,0.12937062978744507,348.26116943359375,1e-05,0.11593981832265854,3.2721219062805176,81.14050197601318,1 +1347,0.4435914158821106,0.26097604632377625,0.27251768112182617,0.21678321063518524,816.7084350585938,1e-05,0.1457367092370987,3.08341646194458,81.14050197601318,1 +1348,0.21484355628490448,0.30245527625083923,0.31988391280174255,0.14755244553089142,966.414306640625,1e-05,0.1164013221859932,3.0151360034942627,81.14050197601318,1 +1349,0.26171064376831055,0.29966092109680176,0.29327765107154846,0.21328671276569366,947.5157470703125,1e-05,0.16818496584892273,3.130960464477539,81.14050197601318,1 +1350,0.29473575949668884,0.20845259726047516,0.2175830900669098,0.1538461595773697,849.5682373046875,1e-05,0.18721993267536163,2.822157144546509,81.14050197601318,1 +1351,0.2623385787010193,0.2113451212644577,0.21183612942695618,0.00699300691485405,677.2564697265625,1e-05,0.20623691380023956,3.0360612869262695,81.14050197601318,1 +1352,0.41256392002105713,0.34055325388908386,0.3417626917362213,0.16526806354522705,871.4204711914062,1e-05,0.21051625907421112,3.3437886238098145,81.14050197601318,1 +1353,0.37244582176208496,0.34198999404907227,0.3404925465583801,0.2678321599960327,539.5704345703125,1e-05,0.13963264226913452,2.826376438140869,81.14050197601318,1 +1354,0.1541263461112976,0.43653327226638794,0.44338056445121765,0.19044288992881775,987.069091796875,1e-05,0.1369490921497345,3.0721616744995117,81.14050197601318,1 +1355,0.45259612798690796,0.2761436700820923,0.28697434067726135,0.16736596822738647,884.2141723632812,1e-05,0.15806151926517487,3.094918727874756,81.14050197601318,1 +1356,0.42620915174484253,0.3655516803264618,0.35499218106269836,0.2242424190044403,978.2918701171875,1e-05,0.2604040205478668,3.0104238986968994,81.14050197601318,1 +1357,0.24703991413116455,0.26504164934158325,0.2673235535621643,0.18764568865299225,898.011962890625,1e-05,0.17839433252811432,2.8260607719421387,81.14050197601318,1 +1358,0.2850797772407532,0.3846442699432373,0.38662102818489075,0.19813519716262817,998.9408569335938,1e-05,0.1406383365392685,3.3032565116882324,81.14050197601318,1 +1359,0.143839031457901,0.25399261713027954,0.2547265291213989,0.10489510744810104,874.9585571289062,1e-05,0.12212665379047394,3.0957534313201904,81.14050197601318,1 +1360,0.38953110575675964,0.2657875716686249,0.26995760202407837,0.20815850794315338,890.15478515625,1e-05,0.14338931441307068,3.044532537460327,81.14050197601318,1 +1361,0.2178778499364853,0.1661875694990158,0.19294919073581696,0.1906759887933731,904.354736328125,1e-05,0.1388365775346756,3.111084222793579,81.14050197601318,1 +1362,0.20768055319786072,0.22715745866298676,0.23573297262191772,0.2242424190044403,923.2371215820312,1e-05,0.1606428474187851,3.014030933380127,81.14050197601318,1 +1363,0.30942466855049133,0.45313113927841187,0.4394005835056305,0.18648017942905426,972.0613403320312,1e-05,0.1392642855644226,2.811577558517456,81.14050197601318,1 +1364,0.41372254490852356,0.3252609968185425,0.3453224003314972,0.14195804297924042,980.3147583007812,1e-05,0.14961741864681244,3.2927300930023193,81.14050197601318,1 +1365,0.43140333890914917,0.328880250453949,0.3302266299724579,0.21351981163024902,561.6887817382812,1e-05,0.15636391937732697,3.085355281829834,81.14050197601318,1 +1366,0.34420347213745117,0.2847052216529846,0.280737042427063,0.21002331376075745,841.452880859375,1e-05,0.10562720894813538,3.022371768951416,81.14050197601318,1 +1367,0.32128390669822693,0.5128527879714966,0.5252253413200378,0.17832167446613312,211.61354064941406,1e-05,0.21043850481510162,3.1406030654907227,81.14050197601318,1 +1368,0.4513404071331024,0.23901262879371643,0.2470041811466217,0.11724941432476044,719.1432495117188,1e-05,0.13470099866390228,3.0263476371765137,81.14050197601318,1 +1369,0.10585746169090271,0.23831576108932495,0.24960817396640778,0.22331002354621887,969.2862548828125,1e-05,0.13064178824424744,2.828350067138672,81.14050197601318,1 +1370,0.36078351736068726,0.1945527344942093,0.2096569836139679,0.20606060326099396,666.1416625976562,1e-05,0.18336516618728638,3.336296796798706,81.14050197601318,1 +1371,0.379517138004303,0.2829633057117462,0.29030948877334595,0.21841491758823395,931.2932739257812,1e-05,0.143472820520401,3.0934531688690186,81.14050197601318,1 +1372,0.3203769624233246,0.2947749197483063,0.30228784680366516,0.24009324610233307,814.732421875,1e-05,0.1506199985742569,3.0544769763946533,81.14050197601318,1 +1373,0.3318859338760376,0.3379412591457367,0.33456161618232727,0.19836829602718353,877.5501708984375,1e-05,0.1366596519947052,3.08392071723938,81.14050197601318,1 +1374,0.27874964475631714,0.31730422377586365,0.3160533308982849,0.2846153974533081,954.8995971679688,1e-05,0.12418705224990845,3.0143373012542725,81.14050197601318,1 +1375,0.3876569867134094,0.277057409286499,0.28198304772377014,0.09930069744586945,998.9408569335938,1e-05,0.1696990728378296,2.826009511947632,81.14050197601318,1 +1376,0.2967289388179779,0.26461413502693176,0.282871276140213,0.2058275043964386,944.2952880859375,1e-05,0.15788991749286652,3.070221185684204,81.14050197601318,1 +1377,0.3711424469947815,0.2984504699707031,0.31224730610847473,0.264102578163147,807.9645385742188,1e-05,0.14564651250839233,3.0659139156341553,81.14050197601318,1 +1378,0.35287970304489136,0.24926282465457916,0.2595483362674713,0.19137528538703918,950.1903076171875,1e-05,0.14508047699928284,3.0890378952026367,81.14050197601318,1 +1379,0.2445797324180603,0.27039945125579834,0.28686273097991943,0.17132866382598877,789.71923828125,1e-05,0.16054698824882507,3.0861093997955322,81.14050197601318,1 +1380,0.24129261076450348,0.3437020480632782,0.35207638144493103,0.07412587106227875,969.9888916015625,1e-05,0.10288345068693161,3.0300822257995605,81.14050197601318,1 +1381,0.2719935178756714,0.3646842837333679,0.36461231112480164,0.20955711603164673,892.0726318359375,1e-05,0.1415894478559494,2.8212578296661377,81.14050197601318,1 +1382,0.26827356219291687,0.2507247030735016,0.2707068920135498,0.2181818187236786,940.7190551757812,1e-05,0.1405431628227234,3.1324381828308105,81.14050197601318,1 +1383,0.35759636759757996,0.3293885290622711,0.3381100594997406,0.18997669219970703,478.7982177734375,1e-05,0.19611532986164093,3.2742910385131836,81.14050197601318,1 +1384,0.4502143859863281,0.2192857265472412,0.22375044226646423,0.23006993532180786,815.3939208984375,1e-05,0.1272733062505722,3.0543627738952637,81.14050197601318,1 +1385,0.40461865067481995,0.7408567070960999,0.7295588850975037,0.1515151560306549,100.0000228881836,1e-05,0.18058018386363983,3.2372233867645264,81.14050197601318,1 +1386,0.24429871141910553,0.28006306290626526,0.283637136220932,0.20512820780277252,835.7803955078125,1e-05,0.13397227227687836,2.831249952316284,81.14050197601318,1 +1387,0.23338213562965393,0.25715819001197815,0.2702343165874481,0.23193472623825073,906.0565185546875,1e-05,0.10914167016744614,3.1389944553375244,81.14050197601318,1 +1388,0.1514595001935959,0.209467351436615,0.22427697479724884,0.23519814014434814,886.226318359375,1e-05,0.12437649071216583,2.8258955478668213,81.14050197601318,1 +1389,0.3476494252681732,0.27573347091674805,0.29990679025650024,0.24708624184131622,987.7676391601562,1e-05,0.1381373405456543,3.312664270401001,81.14050197601318,1 +1390,0.2804511487483978,0.21546009182929993,0.21945253014564514,0.2114219069480896,896.5547485351562,1e-05,0.1380966454744339,3.072077512741089,81.14050197601318,1 +1391,0.3701549172401428,0.22567309439182281,0.24223865568637848,0.17529137432575226,712.31884765625,1e-05,0.12927047908306122,3.2789807319641113,81.14050197601318,1 +1392,0.359691321849823,0.17346486449241638,0.19172890484333038,0.13729603588581085,916.0694580078125,1e-05,0.2115519493818283,2.823089361190796,81.14050197601318,1 +1393,0.2704288363456726,0.24644671380519867,0.25145313143730164,0.20349650084972382,857.74267578125,1e-05,0.7843663096427917,3.0696732997894287,81.14050197601318,1 +1394,0.3387771248817444,0.2768162786960602,0.29845014214515686,0.2652680575847626,982.5844116210938,1e-05,0.10808173567056656,3.088560104370117,81.14050197601318,1 +1395,0.28504103422164917,0.2578658163547516,0.2725343704223633,0.13333334028720856,757.7117919921875,1e-05,0.14948046207427979,3.101513385772705,81.14050197601318,1 +1396,0.13614815473556519,0.30289578437805176,0.32608702778816223,0.2242424190044403,973.5816040039062,1e-05,0.13722288608551025,3.4537951946258545,81.14050197601318,1 +1397,0.3715047240257263,0.22166180610656738,0.23406493663787842,0.23636363446712494,907.7332763671875,1e-05,0.18069623410701752,3.0108416080474854,81.14050197601318,1 +1398,0.42382097244262695,0.36987224221229553,0.39301440119743347,0.264102578163147,200.4163818359375,1e-05,0.15401582419872284,2.826904535293579,81.14050197601318,1 +1399,0.2507667541503906,0.3009331524372101,0.30745092034339905,0.2242424190044403,772.7371215820312,1e-05,0.5191840529441833,3.3566830158233643,81.14050197601318,1 +1400,0.19854098558425903,0.3801186680793762,0.38909682631492615,0.24149183928966522,983.178466796875,1e-05,0.17878857254981995,3.0137534141540527,81.14050197601318,1 +1401,0.1363917887210846,0.2887478768825531,0.302133709192276,0.21002331376075745,952.789306640625,1e-05,0.2048034518957138,3.041816473007202,81.14050197601318,1 +1402,0.17586396634578705,0.4102853834629059,0.40217941999435425,0.19603729248046875,714.6185302734375,1e-05,0.2746987044811249,3.330695629119873,81.14050197601318,1 +1403,0.17246761918067932,0.26470211148262024,0.2722839117050171,0.1515151560306549,944.529052734375,1e-05,0.14885948598384857,3.0472922325134277,81.14050197601318,1 +1404,0.4353503882884979,0.23494188487529755,0.2590670585632324,0.15617716312408447,570.0819702148438,1e-05,0.1427362859249115,2.8273024559020996,81.14050197601318,1 +1405,0.2751353979110718,0.3158399164676666,0.3200036585330963,0.20093239843845367,959.1751708984375,1e-05,0.11883639544248581,3.378859043121338,81.14050197601318,1 +1406,0.20299339294433594,0.49134060740470886,0.5002015829086304,0.2226107269525528,984.643310546875,1e-05,0.11983773857355118,3.0204110145568848,81.14050197601318,1 +1407,0.1950598657131195,0.252703458070755,0.25810426473617554,0.2030303031206131,951.4989624023438,1e-05,0.134050652384758,3.089656114578247,81.14050197601318,1 +1408,0.20101602375507355,0.26066145300865173,0.2836058437824249,0.22237762808799744,981.230712890625,1e-05,0.11014271527528763,3.402440309524536,81.14050197601318,1 +1409,0.34933167695999146,0.3110005259513855,0.3353912830352783,0.25081583857536316,974.9092407226562,1e-05,0.11271824687719345,3.014068365097046,81.14050197601318,1 +1410,0.4956388771533966,0.4181419909000397,0.432475209236145,0.19836829602718353,233.2209930419922,1e-05,0.10870949178934097,2.8362655639648438,81.14050197601318,1 +1411,0.26167550683021545,0.22751650214195251,0.2417496144771576,0.26596736907958984,731.0974731445312,1e-05,0.13468416035175323,3.323122024536133,81.14050197601318,1 +1412,0.21443691849708557,0.18780124187469482,0.20543591678142548,0.14568763971328735,924.38623046875,1e-05,0.2030750960111618,3.0327141284942627,81.14050197601318,1 +1413,0.251762330532074,0.23752157390117645,0.23609553277492523,0.18927739560604095,819.3053588867188,1e-05,0.13873416185379028,3.150790214538574,81.14050197601318,1 +1414,0.2782765030860901,0.2124875783920288,0.22534394264221191,0.12564101815223694,899.0933837890625,1e-05,0.16955341398715973,3.0643177032470703,81.14050197601318,1 +1415,0.17467768490314484,0.5367140769958496,0.5497385859489441,0.24871794879436493,987.2093505859375,1e-05,0.2391081303358078,3.031222343444824,81.14050197601318,1 +1416,0.26608920097351074,0.5771383047103882,0.5710022449493408,0.19393938779830933,200.4163818359375,1e-05,0.20183368027210236,2.824951410293579,81.14050197601318,1 +1417,0.2943364381790161,0.20870009064674377,0.2241668552160263,0.22773893177509308,890.15478515625,1e-05,0.1593511700630188,3.0468642711639404,81.14050197601318,1 +1418,0.18702766299247742,0.29074063897132874,0.2996842861175537,0.20163169503211975,760.4534912109375,1e-05,0.11254660040140152,3.2997217178344727,81.14050197601318,1 +1419,0.11096995323896408,0.3036010265350342,0.3073887228965759,0.2242424190044403,980.0068969726562,1e-05,0.14742030203342438,3.119436502456665,81.14050197601318,1 +1420,0.25782838463783264,0.241282120347023,0.23782970011234283,0.09440559148788452,726.8310546875,1e-05,0.11975862085819244,3.0684704780578613,81.14050197601318,1 +1421,0.21961472928524017,0.4053226709365845,0.39365679025650024,0.15734265744686127,952.789306640625,1e-05,0.11622799187898636,3.0597176551818848,81.14050197601318,1 +1422,0.4447503983974457,0.41509535908699036,0.43151700496673584,0.2454545497894287,301.4790344238281,1e-05,0.1466187685728073,3.0029187202453613,81.14050197601318,1 +1423,0.3849011957645416,0.40128347277641296,0.42529749870300293,0.20885780453681946,382.7987976074219,1e-05,0.15812459588050842,3.1304807662963867,81.14050197601318,1 +1424,0.26666173338890076,0.2996324598789215,0.299810528755188,0.1023310050368309,799.454345703125,1e-05,0.12717899680137634,3.3058900833129883,81.14050197601318,1 +1425,0.1483740657567978,0.24856974184513092,0.25549283623695374,0.2310023307800293,744.3661499023438,1e-05,0.12981896102428436,3.1232047080993652,81.14050197601318,1 +1426,0.4221796691417694,0.28484100103378296,0.28549104928970337,0.19673658907413483,505.5683898925781,1e-05,0.1512659341096878,3.110933780670166,81.14050197601318,1 +1427,0.2912241816520691,0.32436731457710266,0.32141995429992676,0.1818181872367859,840.8953247070312,1e-05,0.12672147154808044,3.0496177673339844,81.14050197601318,1 +1428,0.23089294135570526,0.23250167071819305,0.2364346981048584,0.20839160680770874,747.3050537109375,1e-05,0.10039050132036209,3.046135425567627,81.14050197601318,1 +1429,0.48455163836479187,0.4769299626350403,0.4924412667751312,0.13939394056797028,233.2209930419922,1e-05,0.11757982522249222,3.0110433101654053,81.14050197601318,1 +1430,0.2943885624408722,0.2719765603542328,0.27383342385292053,0.2114219069480896,948.8626708984375,1e-05,0.1046409010887146,3.282477855682373,81.14050197601318,1 +1431,0.3167183995246887,0.26751190423965454,0.2831440567970276,0.20536130666732788,920.0114135742188,1e-05,0.12577489018440247,3.1100471019744873,81.14050197601318,1 +1432,0.2589835822582245,0.2588692903518677,0.2590874433517456,0.11515151709318161,930.7574462890625,1e-05,0.15992651879787445,2.8214073181152344,81.14050197601318,1 +1433,0.2024489939212799,0.32175302505493164,0.3326610028743744,0.2209790199995041,941.926025390625,1e-05,0.44772252440452576,3.038087844848633,81.14050197601318,1 +1434,0.3523067533969879,0.3118419647216797,0.31060394644737244,0.07575757801532745,905.7181396484375,1e-05,0.15104831755161285,3.075847625732422,81.14050197601318,1 +1435,0.16352957487106323,0.35848116874694824,0.3559449017047882,0.2655011713504791,983.4736938476562,1e-05,0.16403242945671082,3.2789394855499268,81.14050197601318,1 +1436,0.2891980707645416,0.3388507664203644,0.3422304689884186,0.20606060326099396,671.7659301757812,1e-05,0.17819096148014069,3.0504415035247803,81.14050197601318,1 +1437,0.18734261393547058,0.27137812972068787,0.28080564737319946,0.21165500581264496,942.1655883789062,1e-05,0.11027757823467255,3.1186065673828125,81.14050197601318,1 +1438,0.36842912435531616,0.36907196044921875,0.3801793158054352,0.19160838425159454,464.5392150878906,1e-05,0.16662882268428802,2.8292648792266846,81.14050197601318,1 +1439,0.29743558168411255,0.286001592874527,0.3014827072620392,0.1662004590034485,795.030517578125,1e-05,0.12571798264980316,3.04522967338562,81.14050197601318,1 +1440,0.33720099925994873,0.20471088588237762,0.2154798060655594,0.2242424190044403,944.529052734375,1e-05,0.14844970405101776,3.078545093536377,81.14050197601318,1 +1441,0.24803712964057922,0.34852901101112366,0.3451433777809143,0.2477855533361435,701.6507568359375,1e-05,0.13868601620197296,3.3160157203674316,81.14050197601318,1 +1442,0.29013076424598694,0.188990980386734,0.20828257501125336,0.22331002354621887,740.3775634765625,1e-05,0.3090484142303467,2.8226072788238525,81.14050197601318,1 +1443,0.33421590924263,0.33011531829833984,0.3412879407405853,0.2545454502105713,772.7371215820312,1e-05,0.19872279465198517,3.144054412841797,81.14050197601318,1 +1444,0.2938268184661865,0.30624449253082275,0.31192100048065186,0.21212121844291687,789.71923828125,1e-05,0.16146619617938995,2.829514503479004,81.14050197601318,1 +1445,0.275777667760849,0.42018458247184753,0.44506973028182983,0.1678321659564972,253.83924865722656,1e-05,0.11426154524087906,3.076045513153076,81.14050197601318,1 +1446,0.3019443154335022,0.2618680000305176,0.2747642695903778,0.0951048955321312,972.7406005859375,1e-05,0.1271803379058838,3.2952191829681396,81.14050197601318,1 +1447,0.22084394097328186,0.20303118228912354,0.20802325010299683,0.07972028106451035,938.0095825195312,1e-05,0.14146767556667328,3.2408218383789062,81.14050197601318,1 +1448,0.3013145327568054,0.23457877337932587,0.24131552875041962,0.1638694703578949,537.2642211914062,1e-05,0.12388752400875092,2.8266518115997314,81.14050197601318,1 +1449,0.15104258060455322,0.3902871310710907,0.3939054608345032,0.2097902148962021,981.8353881835938,1e-05,0.14249548316001892,3.3844752311706543,81.14050197601318,1 +1450,0.3370324969291687,0.3472531735897064,0.3507690131664276,0.22167831659317017,576.2171630859375,1e-05,0.29968616366386414,2.8228185176849365,81.14050197601318,1 +1451,0.32558441162109375,0.16343747079372406,0.1876911222934723,0.2174825221300125,720.25927734375,1e-05,0.12757040560245514,3.032331705093384,81.14050197601318,1 +1452,0.2128416746854782,0.31856662034988403,0.32926419377326965,0.22610722482204437,956.552734375,1e-05,0.39486441016197205,3.3578619956970215,81.14050197601318,1 +1453,0.46686339378356934,0.28875553607940674,0.28920239210128784,0.10862471163272858,461.6126403808594,1e-05,0.1520128697156906,3.2838549613952637,81.14050197601318,1 +1454,0.3409290313720703,0.3763292729854584,0.3806009888648987,0.10372960567474365,367.8310546875,1e-05,0.10694067180156708,2.8386478424072266,81.14050197601318,1 +1455,0.26081061363220215,0.2811737656593323,0.28698045015335083,0.17575757205486298,627.6343994140625,1e-05,0.16221560537815094,3.398792028427124,81.14050197601318,1 +1456,0.35232335329055786,0.3293296992778778,0.340730220079422,0.1778554767370224,768.4440307617188,1e-05,0.1255127191543579,3.011270523071289,81.14050197601318,1 +1457,0.270072340965271,0.253423810005188,0.2591618597507477,0.1990675926208496,818.01220703125,1e-05,0.23350244760513306,2.832564353942871,81.14050197601318,1 +1458,0.23349890112876892,0.29283463954925537,0.29864129424095154,0.23496504127979279,901.9290771484375,1e-05,0.1640981286764145,3.0956873893737793,81.14050197601318,1 +1459,0.2779962420463562,0.4003564715385437,0.4128111004829407,0.13286712765693665,971.7196655273438,1e-05,0.14580106735229492,3.3358922004699707,81.14050197601318,1 +1460,0.34966835379600525,0.40256524085998535,0.39645010232925415,0.26200467348098755,982.1359252929688,1e-05,0.12774457037448883,3.0518147945404053,81.14050197601318,1 +1461,0.30508989095687866,0.2996186912059784,0.2985956072807312,0.18834498524665833,939.4969482421875,1e-05,0.12579841911792755,3.1088571548461914,81.14050197601318,1 +1462,0.19314439594745636,0.34053826332092285,0.33827853202819824,0.21445220708847046,932.8836669921875,1e-05,0.1417599618434906,3.003237247467041,81.14050197601318,1 +1463,0.32080206274986267,0.3493269681930542,0.3412731885910034,0.22960372269153595,941.926025390625,1e-05,0.1581687033176422,3.0151991844177246,81.14050197601318,1 +1464,0.32180729508399963,0.33909350633621216,0.3659491240978241,0.2142191082239151,998.4646606445312,1e-05,0.14872166514396667,3.1130106449127197,81.14050197601318,1 +1465,0.4380474090576172,0.2847190201282501,0.29598817229270935,0.12540791928768158,518.1495361328125,1e-05,0.13116686046123505,3.271277666091919,81.14050197601318,1 +1466,0.29890894889831543,0.28639742732048035,0.28159260749816895,0.1666666716337204,778.5809936523438,1e-05,0.22516140341758728,3.0446395874023438,81.14050197601318,1 +1467,0.35136815905570984,0.2546183466911316,0.25714007019996643,0.15337994694709778,901.9290771484375,1e-05,0.2495620995759964,3.1258716583251953,81.14050197601318,1 +1468,0.3180500566959381,0.3871757388114929,0.38369396328926086,0.23123542964458466,974.9092407226562,1e-05,0.25732582807540894,3.020382881164551,81.14050197601318,1 +1469,0.36111798882484436,0.32097890973091125,0.3238758444786072,0.2074592113494873,832.8609008789062,1e-05,0.15279823541641235,3.096531867980957,81.14050197601318,1 +1470,0.3541146218776703,0.2764897048473358,0.2734869122505188,0.10442890226840973,797.99267578125,1e-05,0.10471855849027634,2.8335916996002197,81.14050197601318,1 +1471,0.24241049587726593,0.18087737262248993,0.198447123169899,0.1090909093618393,975.8905029296875,1e-05,0.1147315725684166,3.0828778743743896,81.14050197601318,1 +1472,0.3434517979621887,0.2242627739906311,0.23109661042690277,0.2242424190044403,695.4873657226562,1e-05,0.15118692815303802,3.110050678253174,81.14050197601318,1 +1473,0.2384571135044098,0.2652822434902191,0.2799443304538727,0.1822843849658966,882.5809936523438,1e-05,0.15082977712154388,3.1413018703460693,81.14050197601318,1 +1474,0.26735252141952515,0.2344338297843933,0.2514408230781555,0.24801865220069885,875.3941650390625,1e-05,0.165767103433609,3.073866605758667,81.14050197601318,1 +1475,0.2402150183916092,0.24214182794094086,0.25279298424720764,0.18997669219970703,952.1465454101562,1e-05,0.16296401619911194,3.347811460494995,81.14050197601318,1 +1476,0.24671612679958344,0.3243580162525177,0.31940507888793945,0.20000000298023224,814.732421875,1e-05,0.16552133858203888,3.043198585510254,81.14050197601318,1 +1477,0.3217916786670685,0.361737459897995,0.3719004988670349,0.1326340287923813,932.3563232421875,1e-05,0.16035768389701843,3.063009023666382,81.14050197601318,1 +1478,0.445762574672699,0.5163537263870239,0.5228114128112793,0.16969697177410126,305.9609069824219,1e-05,0.11613153666257858,3.071800708770752,81.14050197601318,1 +1479,0.2764493227005005,0.3493168354034424,0.34912192821502686,0.10023310035467148,986.9286499023438,1e-05,0.12485595792531967,3.172614336013794,81.14050197601318,1 +1480,0.320781409740448,0.3802265226840973,0.3935909867286682,0.22470861673355103,982.2857666015625,1e-05,0.12354909628629684,3.0162670612335205,81.14050197601318,1 +1481,0.39062803983688354,0.3156587779521942,0.33028000593185425,0.2790209650993347,336.031982421875,1e-05,0.135725736618042,3.1260392665863037,81.14050197601318,1 +1482,0.27292782068252563,0.32312360405921936,0.3235557973384857,0.1930069923400879,492.46246337890625,1e-05,0.11099709570407867,3.0692903995513916,81.14050197601318,1 +1483,0.3466205298900604,0.33962082862854004,0.3417893648147583,0.16456876695156097,702.8627319335938,1e-05,0.16771858930587769,3.048091173171997,81.14050197601318,1 +1484,0.48038506507873535,0.3338674008846283,0.3383757174015045,0.24848484992980957,668.9708251953125,1e-05,0.18285006284713745,3.0955145359039307,81.14050197601318,1 +1485,0.2718777060508728,0.1394365131855011,0.15884383022785187,0.20629370212554932,828.0687866210938,1e-05,0.1444597840309143,3.144780158996582,81.14050197601318,1 +1486,0.20499813556671143,0.28812456130981445,0.2921540439128876,0.24242423474788666,939.4969482421875,1e-05,0.13585053384304047,3.0676655769348145,81.14050197601318,1 +1487,0.34445419907569885,0.30172428488731384,0.3087013363838196,0.21398600935935974,892.4525146484375,1e-05,0.14350514113903046,3.078850030899048,81.14050197601318,1 +1488,0.26771029829978943,0.36816534399986267,0.371576726436615,0.20442891120910645,989.9591064453125,1e-05,0.157377228140831,3.2668612003326416,81.14050197601318,1 +1489,0.29813435673713684,0.16576124727725983,0.1849135309457779,0.2310023307800293,852.1741943359375,1e-05,0.11952309310436249,2.8281993865966797,81.14050197601318,1 +1490,0.19332771003246307,0.23484490811824799,0.2335602045059204,0.2501165568828583,905.7181396484375,1e-05,0.1686021387577057,3.1106395721435547,81.14050197601318,1 +1491,0.28851908445358276,0.2969549894332886,0.2857539653778076,0.20792540907859802,683.93896484375,1e-05,0.11744540929794312,3.095695972442627,81.14050197601318,1 +1492,0.15125393867492676,0.43488308787345886,0.4404350221157074,0.20652680099010468,964.7545166015625,1e-05,0.11198677122592926,2.824535608291626,81.14050197601318,1 +1493,0.43116840720176697,0.3593306243419647,0.37865567207336426,0.18531468510627747,968.3995361328125,1e-05,0.29733243584632874,3.097482204437256,81.14050197601318,1 +1494,0.3433429002761841,0.4152422845363617,0.40613245964050293,0.20839160680770874,946.1489868164062,1e-05,0.222681924700737,3.332232713699341,81.14050197601318,1 +1495,0.3197019100189209,0.34992367029190063,0.35335394740104675,0.2825174927711487,996.2799072265625,1e-05,0.1317177712917328,3.0927650928497314,81.14050197601318,1 +1496,0.5689595937728882,0.3268730640411377,0.3327457010746002,0.23030303418636322,980.9265747070312,1e-05,0.12839415669441223,2.8163719177246094,81.14050197601318,1 +1497,0.28570079803466797,0.23685142397880554,0.253471702337265,0.253846138715744,770.1734008789062,1e-05,0.13233092427253723,3.137226104736328,81.14050197601318,1 +1498,0.34031227231025696,0.2583690285682678,0.2588578760623932,0.1538461595773697,824.37353515625,1e-05,0.13341571390628815,2.817455768585205,81.14050197601318,1 +1499,0.15056446194648743,0.3540906310081482,0.3602328896522522,0.13333334028720856,946.8348388671875,1e-05,0.19559186697006226,3.087615728378296,81.14050197601318,1 +1500,0.44024473428726196,0.3066343069076538,0.3102162182331085,0.18881118297576904,565.9164428710938,1e-05,0.10594946146011353,3.347005605697632,81.14050197601318,1 +1501,0.3711368441581726,0.2984507977962494,0.3051610291004181,0.19557109475135803,972.9094848632812,1e-05,0.13712726533412933,3.0573549270629883,81.14050197601318,1 +1502,0.28980138897895813,0.33645880222320557,0.3491835594177246,0.13892774283885956,975.0736083984375,1e-05,0.09001161903142929,3.108081102371216,81.14050197601318,1 +1503,0.35134974122047424,0.29611024260520935,0.2994224429130554,0.20722611248493195,769.3107299804688,1e-05,0.174997940659523,3.0522501468658447,81.14050197601318,1 +1504,0.2948192059993744,0.25832152366638184,0.2658320963382721,0.16596736013889313,882.5809936523438,1e-05,0.22695693373680115,3.121654987335205,81.14050197601318,1 +1505,0.28580760955810547,0.262462317943573,0.2729983329772949,0.2242424190044403,994.0235595703125,1e-05,0.14756721258163452,3.2423408031463623,81.14050197601318,1 +1506,0.293465256690979,0.17112095654010773,0.1986418515443802,0.22447551786899567,933.1463012695312,1e-05,0.13413533568382263,3.0981268882751465,81.14050197601318,1 +1507,0.27110713720321655,0.3626895844936371,0.3649863004684448,0.19324009120464325,327.6654357910156,1e-05,0.13803404569625854,3.075270175933838,81.14050197601318,1 +1508,0.12504571676254272,0.1665482372045517,0.18879544734954834,0.1850815862417221,764.9352416992188,1e-05,0.11776895821094513,2.830833911895752,81.14050197601318,1 +1509,0.2376951426267624,0.36326026916503906,0.3479052484035492,0.22074592113494873,987.4890747070312,1e-05,0.13025890290737152,3.064213752746582,81.14050197601318,1 +1510,0.31643733382225037,0.16362273693084717,0.1799616664648056,0.14965035021305084,802.3400268554688,1e-05,0.1815091371536255,3.423262596130371,81.14050197601318,1 +1511,0.23058870434761047,0.22290512919425964,0.2430756539106369,0.22494173049926758,810.7058715820312,1e-05,0.13784159719944,3.0756547451019287,81.14050197601318,1 +1512,0.20769765973091125,0.3720445930957794,0.3674662411212921,0.14685314893722534,966.2316284179688,1e-05,0.15138065814971924,3.047590970993042,81.14050197601318,1 +1513,0.4002128839492798,0.2633589804172516,0.27119964361190796,0.1918414980173111,783.4415283203125,1e-05,0.12504389882087708,3.066821813583374,81.14050197601318,1 +1514,0.2945650815963745,0.37089091539382935,0.37703585624694824,0.19836829602718353,268.69403076171875,1e-05,0.21303708851337433,2.8240842819213867,81.14050197601318,1 +1515,0.1470065414905548,0.334831565618515,0.34473514556884766,0.24848484992980957,926.3671875,1e-05,0.12951788306236267,3.047360897064209,81.14050197601318,1 +1516,0.3420966863632202,0.2220086008310318,0.2309071272611618,0.2242424190044403,826.2322387695312,1e-05,0.21917510032653809,3.3482704162597656,81.14050197601318,1 +1517,0.3069605529308319,0.26782745122909546,0.27129319310188293,0.2097902148962021,759.5440063476562,1e-05,0.13366976380348206,3.076070785522461,81.14050197601318,1 +1518,0.28335312008857727,0.2740977704524994,0.285149484872818,0.20512820780277252,917.2977905273438,1e-05,0.11809659004211426,3.1302826404571533,81.14050197601318,1 +1519,0.3288746476173401,0.28253817558288574,0.2961937189102173,0.285314679145813,658.916015625,1e-05,0.1149846687912941,3.1039817333221436,81.14050197601318,1 +1520,0.36550548672676086,0.2820207178592682,0.2937079668045044,0.06340326368808746,301.4790344238281,1e-05,0.2805697023868561,2.8136236667633057,81.14050197601318,1 +1521,0.2360496073961258,0.19039811193943024,0.20829831063747406,0.21491841971874237,870.5208129882812,1e-05,0.20238791406154633,3.0868611335754395,81.14050197601318,1 +1522,0.29824012517929077,0.3465594947338104,0.35102930665016174,0.17039626836776733,958.3765258789062,1e-05,0.14840580523014069,3.3913991451263428,81.14050197601318,1 +1523,0.3773113787174225,0.36063531041145325,0.36964526772499084,0.16713286936283112,568.0068969726562,1e-05,0.10510998964309692,3.1230580806732178,81.14050197601318,1 +1524,0.36403191089630127,0.2922143042087555,0.2993861734867096,0.19813519716262817,586.15087890625,1e-05,0.10118303447961807,2.8285675048828125,81.14050197601318,1 +1525,0.33878469467163086,0.28890976309776306,0.3097116947174072,0.19160838425159454,958.9761352539062,1e-05,0.15408672392368317,3.3096718788146973,81.14050197601318,1 +1526,0.5537416338920593,0.33530354499816895,0.33253005146980286,0.24801865220069885,708.8218383789062,1e-05,0.13874490559101105,3.0366063117980957,81.14050197601318,1 +1527,0.305525004863739,0.23037086427211761,0.24531011283397675,0.21561771631240845,726.8310546875,1e-05,0.16864444315433502,2.8384931087493896,81.14050197601318,1 +1528,0.30674946308135986,0.32414165139198303,0.3368476629257202,0.1442890465259552,709.9939575195312,1e-05,0.14115658402442932,3.1320271492004395,81.14050197601318,1 +1529,0.37637507915496826,0.31822264194488525,0.3265553414821625,0.24522145092487335,625.9617919921875,1e-05,0.1780313402414322,3.3339879512786865,81.14050197601318,1 +1530,0.2494833916425705,0.3148064911365509,0.31965872645378113,0.2086247056722641,634.2159423828125,1e-05,0.7587335109710693,2.8295180797576904,81.14050197601318,1 +1531,0.19921404123306274,0.34652411937713623,0.3455439507961273,0.18531468510627747,939.4969482421875,1e-05,0.16259968280792236,3.3462586402893066,81.14050197601318,1 +1532,0.2619325816631317,0.20860496163368225,0.22512014210224152,0.09813519567251205,924.6715087890625,1e-05,0.17662681639194489,3.0416016578674316,81.14050197601318,1 +1533,0.31516602635383606,0.3309688866138458,0.33892542123794556,0.24242423474788666,994.7838134765625,1e-05,0.1774328351020813,2.824206590652466,81.14050197601318,1 +1534,0.40224945545196533,0.26508885622024536,0.27166232466697693,0.1627039611339569,727.9061279296875,1e-05,0.15403683483600616,3.0959689617156982,81.14050197601318,1 +1535,0.250542551279068,0.30091652274131775,0.30390650033950806,0.23636363446712494,874.9585571289062,1e-05,0.1607573926448822,3.363117218017578,81.14050197601318,1 +1536,0.09918501228094101,0.3246734142303467,0.3186577260494232,0.12773892283439636,855.743408203125,1e-05,0.1310819536447525,2.8171844482421875,81.14050197601318,1 +1537,0.33693477511405945,0.2664319574832916,0.2786673307418823,0.2242424190044403,890.15478515625,1e-05,0.1260320097208023,3.0402464866638184,81.14050197601318,1 +1538,0.27474501729011536,0.28181833028793335,0.29074108600616455,0.28951048851013184,812.7318115234375,1e-05,0.3746355473995209,3.0045063495635986,81.14050197601318,1 +1539,0.39926987886428833,0.1910925805568695,0.20645110309123993,0.21212121844291687,781.0278930664062,1e-05,0.17001695930957794,2.826451301574707,81.14050197601318,1 +1540,0.2893904745578766,0.3190667927265167,0.3241380751132965,0.20372959971427917,961.14013671875,1e-05,0.22763416171073914,3.0874483585357666,81.14050197601318,1 +1541,0.3057878613471985,0.5165467858314514,0.5055246353149414,0.23356643319129944,994.4046630859375,1e-05,0.12651024758815765,3.1269023418426514,81.14050197601318,1 +1542,0.4304683208465576,0.18344926834106445,0.19577892124652863,0.128671333193779,668.9708251953125,1e-05,0.13644422590732574,2.831078290939331,81.14050197601318,1 +1543,0.24386899173259735,0.20787763595581055,0.24023699760437012,0.22400932013988495,995.535888671875,1e-05,0.14903375506401062,3.0640971660614014,81.14050197601318,1 +1544,0.4327831268310547,0.2992023229598999,0.2898196280002594,0.21631701290607452,743.3765869140625,1e-05,0.15928207337856293,3.0304160118103027,81.14050197601318,1 +1545,0.43655991554260254,0.3032284080982208,0.3209201693534851,0.15897436439990997,966.77880859375,1e-05,0.16669198870658875,3.038137912750244,81.14050197601318,1 +1546,0.2652786374092102,0.2707739770412445,0.276994913816452,0.2097902148962021,505.5683898925781,1e-05,0.13099519908428192,3.3777806758880615,81.14050197601318,1 +1547,0.2673737406730652,0.20481398701667786,0.21570399403572083,0.05944056063890457,937.5089111328125,1e-05,0.20663554966449738,3.092606544494629,81.14050197601318,1 +1548,0.24218353629112244,0.3114162087440491,0.3387673795223236,0.14965035021305084,668.9708251953125,1e-05,0.14643754065036774,3.0882999897003174,81.14050197601318,1 +1549,0.34205693006515503,0.3134610950946808,0.32307299971580505,0.279720276594162,932.0916137695312,1e-05,0.15822969377040863,3.097947120666504,81.14050197601318,1 +1550,0.14431127905845642,0.5199335813522339,0.5159646272659302,0.2242424190044403,981.0787963867188,1e-05,0.1246790885925293,3.091341495513916,81.14050197601318,1 +1551,0.48593151569366455,0.25057291984558105,0.283021479845047,0.27599066495895386,390.0654296875,1e-05,0.11176230758428574,3.1709887981414795,81.14050197601318,1 +1552,0.30436351895332336,0.2437584549188614,0.25174278020858765,0.13006992638111115,826.2322387695312,1e-05,0.11436791718006134,3.107236623764038,81.14050197601318,1 +1553,0.3711198568344116,0.30572813749313354,0.3098504841327667,0.22331002354621887,734.2389526367188,1e-05,0.12301722168922424,3.097095012664795,81.14050197601318,1 +1554,0.22341905534267426,0.12913303077220917,0.15104715526103973,0.1706293672323227,842.00830078125,1e-05,0.13543619215488434,3.2249069213867188,81.14050197601318,1 +1555,0.34997621178627014,0.4408402442932129,0.44877684116363525,0.20233100652694702,954.8995971679688,1e-05,0.14480048418045044,3.113579511642456,81.14050197601318,1 +1556,0.38567450642585754,0.1957913041114807,0.21944129467010498,0.22843822836875916,776.9306030273438,1e-05,0.17107389867305756,2.8305203914642334,81.14050197601318,1 +1557,0.1761167198419571,0.3005564510822296,0.30782344937324524,0.18205128610134125,998.1053466796875,1e-05,0.1377730518579483,3.082085132598877,81.14050197601318,1 +1558,0.26331156492233276,0.4870147705078125,0.48498061299324036,0.2254079282283783,994.27783203125,1e-05,0.12403153628110886,3.3360912799835205,81.14050197601318,1 +1559,0.21939095854759216,0.37121808528900146,0.37298986315727234,0.2097902148962021,984.4981079101562,1e-05,0.13053235411643982,3.009690284729004,81.14050197601318,1 +1560,0.33853527903556824,0.2888270914554596,0.29497355222702026,0.2557109594345093,868.2445068359375,1e-05,0.18412178754806519,3.130608320236206,81.14050197601318,1 +1561,0.2160414308309555,0.21378403902053833,0.22239872813224792,0.1902097910642624,865.928466796875,1e-05,0.11073292046785355,3.1201725006103516,81.14050197601318,1 +1562,0.23851485550403595,0.2950424551963806,0.29919296503067017,0.16433566808700562,849.5682373046875,1e-05,0.2481316775083542,2.8318188190460205,81.14050197601318,1 +1563,0.28132206201553345,0.26780399680137634,0.28569743037223816,0.18321678042411804,997.3809814453125,1e-05,0.12081508338451385,3.128216505050659,81.14050197601318,1 +1564,0.17138507962226868,0.2906862795352936,0.29233142733573914,0.22843822836875916,807.9645385742188,1e-05,0.18831902742385864,3.3729968070983887,81.14050197601318,1 +1565,0.35769447684288025,0.5059594511985779,0.4929611086845398,0.19393938779830933,998.4646606445312,1e-05,0.12022332102060318,3.0595808029174805,81.14050197601318,1 +1566,0.2583247721195221,0.32670798897743225,0.35098859667778015,0.2041957974433899,953.8506469726562,1e-05,0.1667114794254303,3.3176987171173096,81.14050197601318,1 +1567,0.12231829762458801,0.2631629705429077,0.2817520499229431,0.2421911358833313,981.230712890625,1e-05,0.15308350324630737,3.1266233921051025,81.14050197601318,1 +1568,0.34227490425109863,0.3338044583797455,0.3323509693145752,0.17855477333068848,620.8772583007812,1e-05,0.1885439157485962,2.8247978687286377,81.14050197601318,1 +1569,0.34434404969215393,0.23845027387142181,0.24086177349090576,0.19813519716262817,776.9306030273438,1e-05,0.1623125821352005,3.159682273864746,81.14050197601318,1 +1570,0.3967125415802002,0.337272971868515,0.33270972967147827,0.11841491609811783,969.2862548828125,1e-05,0.13371723890304565,3.4049389362335205,81.14050197601318,1 +1571,0.33260083198547363,0.23359999060630798,0.24892558157444,0.2242424190044403,778.5809936523438,1e-05,0.13544392585754395,3.076721668243408,81.14050197601318,1 +1572,0.27684807777404785,0.19779303669929504,0.21641948819160461,0.26247087121009827,865.4603271484375,1e-05,0.11241811513900757,3.369755744934082,81.14050197601318,1 +1573,0.320404976606369,0.2662579417228699,0.26312798261642456,0.2086247056722641,851.1375732421875,1e-05,0.31904733180999756,3.0491511821746826,81.14050197601318,1 +1574,0.37033262848854065,0.20930899679660797,0.22094203531742096,0.2170163094997406,781.836181640625,1e-05,0.20314355194568634,2.826887369155884,81.14050197601318,1 +1575,0.3246416747570038,0.36624661087989807,0.37033411860466003,0.22634032368659973,953.0025024414062,1e-05,0.13137970864772797,3.167539596557617,81.14050197601318,1 +1576,0.24759149551391602,0.23532900214195251,0.24397359788417816,0.2198135256767273,883.4002075195312,1e-05,0.11979564279317856,3.3273537158966064,81.14050197601318,1 +1577,0.38178056478500366,0.26989302039146423,0.27724170684814453,0.2142191082239151,851.6567993164062,1e-05,0.1873512715101242,2.8213095664978027,81.14050197601318,1 +1578,0.2972103953361511,0.22567211091518402,0.2435474544763565,0.1678321659564972,961.7210693359375,1e-05,0.10736653208732605,3.14723801612854,81.14050197601318,1 +1579,0.23594647645950317,0.3935021162033081,0.3785153031349182,0.2405594438314438,958.9761352539062,1e-05,0.12840253114700317,3.0664830207824707,81.14050197601318,1 +1580,0.20265251398086548,0.16179825365543365,0.17284569144248962,0.0811188817024231,795.030517578125,1e-05,0.15536482632160187,2.8218562602996826,81.14050197601318,1 +1581,0.34978029131889343,0.3575136661529541,0.3643340766429901,0.29673659801483154,976.5382080078125,1e-05,0.12853378057479858,3.087432861328125,81.14050197601318,1 +1582,0.21380949020385742,0.3379019796848297,0.3417279124259949,0.20163169503211975,964.0061645507812,1e-05,0.11869616061449051,4.072778224945068,81.14050197601318,1 +1583,0.39464306831359863,0.150327667593956,0.1634894162416458,0.17365966737270355,776.0996704101562,1e-05,0.13609722256660461,3.098356008529663,81.14050197601318,1 +1584,0.2324649691581726,0.2722996473312378,0.2722812592983246,0.17762237787246704,888.2062377929688,1e-05,0.19443945586681366,3.0763115882873535,81.14050197601318,1 +1585,0.35042354464530945,0.7169203758239746,0.7172644138336182,0.06969697028398514,127.0761489868164,1e-05,0.17922692000865936,3.1037306785583496,81.14050197601318,1 +1586,0.4483085572719574,0.3139618933200836,0.31115487217903137,0.25244754552841187,951.2822265625,1e-05,0.13261422514915466,2.8357791900634766,81.14050197601318,1 +1587,0.4090482294559479,0.31608670949935913,0.3265206813812256,0.18857808411121368,532.5975952148438,1e-05,0.22904925048351288,3.120630979537964,81.14050197601318,1 +1588,0.22609484195709229,0.1840071827173233,0.1975482702255249,0.12424242496490479,695.4873657226562,1e-05,0.12069429457187653,3.11069655418396,81.14050197601318,1 +1589,0.22623352706432343,0.38302043080329895,0.3830081820487976,0.2773892879486084,961.334228515625,1e-05,0.1284302920103073,3.3935325145721436,81.14050197601318,1 +1590,0.2705577611923218,0.2182982712984085,0.2415142059326172,0.22074592113494873,920.3087768554688,1e-05,0.15011033415794373,3.019488573074341,81.14050197601318,1 +1591,0.3567959666252136,0.2366292029619217,0.24821537733078003,0.20675989985466003,848.5123291015625,1e-05,0.1347997635602951,3.0339701175689697,81.14050197601318,1 +1592,0.21920979022979736,0.4524756073951721,0.4475207030773163,0.1526806503534317,979.0761108398438,1e-05,0.10750552266836166,3.1370201110839844,81.14050197601318,1 +1593,0.36735260486602783,0.31446075439453125,0.3161962628364563,0.1515151560306549,570.0819702148438,1e-05,0.11472461372613907,3.0537238121032715,81.14050197601318,1 +1594,0.13273835182189941,0.34998276829719543,0.35818058252334595,0.11165501177310944,990.228515625,1e-05,0.19158627092838287,3.1130058765411377,81.14050197601318,1 +1595,0.33930978178977966,0.16875027120113373,0.17906783521175385,0.0839160829782486,874.521484375,1e-05,0.17430418729782104,3.2869741916656494,81.14050197601318,1 +1596,0.260426789522171,0.2653349041938782,0.27560654282569885,0.17925408482551575,977.9759521484375,1e-05,0.2815206050872803,3.0150437355041504,81.14050197601318,1 +1597,0.25580093264579773,0.3906083405017853,0.40285947918891907,0.2142191082239151,984.2067260742188,1e-05,0.15314944088459015,3.0725648403167725,81.14050197601318,1 +1598,0.3976176083087921,0.2685811519622803,0.27783286571502686,0.2214452177286148,809.341064453125,1e-05,0.1432376205921173,3.1238231658935547,81.14050197601318,1 +1599,0.21269351243972778,0.18707507848739624,0.2111220806837082,0.20209790766239166,801.6233520507812,1e-05,0.1101447269320488,3.11190128326416,81.14050197601318,1 +1600,0.27515777945518494,0.33913931250572205,0.3436163663864136,0.1678321659564972,915.7601928710938,1e-05,0.1371527761220932,2.823336362838745,81.14050197601318,1 +1601,0.25985729694366455,0.23307719826698303,0.23692649602890015,0.14918415248394012,917.2977905273438,1e-05,0.13924871385097504,3.3748857975006104,81.14050197601318,1 +1602,0.36922988295555115,0.5275866985321045,0.5306921601295471,0.21212121844291687,243.64947509765625,1e-05,0.2821948826313019,3.062279462814331,81.14050197601318,1 +1603,0.3062744438648224,0.27356505393981934,0.2738102674484253,0.18531468510627747,824.37353515625,1e-05,0.1396084427833557,3.065662384033203,81.14050197601318,1 +1604,0.20654286444187164,0.4770175516605377,0.4749431312084198,0.2158508151769638,987.7676391601562,1e-05,0.17161814868450165,3.036996841430664,81.14050197601318,1 +1605,0.11915097385644913,0.34020188450813293,0.34192609786987305,0.23170162737369537,958.576904296875,1e-05,0.13046781718730927,3.2507522106170654,81.14050197601318,1 +1606,0.12188846617937088,0.21502897143363953,0.22652111947536469,0.274125874042511,807.9645385742188,1e-05,0.11826923489570618,2.8213374614715576,81.14050197601318,1 +1607,0.44828832149505615,0.29571738839149475,0.3026459515094757,0.1934731900691986,657.4439697265625,1e-05,0.1514241099357605,3.379988193511963,81.14050197601318,1 +1608,0.2755168080329895,0.31716635823249817,0.3229445815086365,0.07855477929115295,973.2462768554688,1e-05,0.13223524391651154,3.0069074630737305,81.14050197601318,1 +1609,0.3620169162750244,0.175160750746727,0.1969754695892334,0.26876455545425415,788.1709594726562,1e-05,1.4262125492095947,2.8170480728149414,81.14050197601318,1 +1610,0.25953924655914307,0.2519911229610443,0.27511343359947205,0.1655011624097824,997.86474609375,1e-05,0.16771337389945984,3.0992095470428467,81.14050197601318,1 +1611,0.1765616089105606,0.268991619348526,0.2692737877368927,0.1846153885126114,838.0756225585938,1e-05,0.11186280846595764,3.274076223373413,81.14050197601318,1 +1612,0.19030475616455078,0.2483340948820114,0.2577170431613922,0.20722611248493195,785.0322875976562,1e-05,0.1280544251203537,2.830166816711426,81.14050197601318,1 +1613,0.3604307472705841,0.23975327610969543,0.25605759024620056,0.1878787875175476,776.9306030273438,1e-05,0.2823898196220398,3.268522024154663,81.14050197601318,1 +1614,0.2905452847480774,0.2335571050643921,0.24776235222816467,0.2198135256767273,774.4262084960938,1e-05,0.2219732105731964,3.0483667850494385,81.14050197601318,1 +1615,0.22260892391204834,0.3369901180267334,0.3409546911716461,0.2526806592941284,974.7445068359375,1e-05,0.19703985750675201,2.8279197216033936,81.14050197601318,1 +1616,0.1657910943031311,0.2890072762966156,0.29952481389045715,0.20046620070934296,976.69921875,1e-05,0.2755092680454254,3.128796339035034,81.14050197601318,1 +1617,0.27527284622192383,0.3197336792945862,0.32979652285575867,0.25757575035095215,502.9901123046875,1e-05,0.12949778139591217,3.3465540409088135,81.14050197601318,1 +1618,0.30171647667884827,0.31094416975975037,0.3075997531414032,0.1762237697839737,917.6026611328125,1e-05,0.1394699066877365,2.830343246459961,81.14050197601318,1 +1619,0.20252731442451477,0.3441583216190338,0.34369611740112305,0.2722610831260681,989.0084838867188,1e-05,0.11816015094518661,3.314832925796509,81.14050197601318,1 +1620,0.38298264145851135,0.3210943043231964,0.34069421887397766,0.20512820780277252,846.3767700195312,1e-05,0.15241776406764984,3.0888869762420654,81.14050197601318,1 +1621,0.30924561619758606,0.1806919127702713,0.19059418141841888,0.12890443205833435,943.3546142578125,1e-05,0.14473776519298553,2.8320415019989014,81.14050197601318,1 +1622,0.3316349387168884,0.36195215582847595,0.35121244192123413,0.20372959971427917,687.85546875,1e-05,0.12167701125144958,3.321780204772949,81.14050197601318,1 +1623,0.1625998616218567,0.3065187633037567,0.3115916848182678,0.20326340198516846,884.2141723632812,1e-05,0.10610071569681168,3.10103178024292,81.14050197601318,1 +1624,0.4728904366493225,0.21460185945034027,0.22596964240074158,0.1655011624097824,553.0419311523438,1e-05,0.145194873213768,3.0951056480407715,81.14050197601318,1 +1625,0.250775009393692,0.2025802880525589,0.20249566435813904,0.1298368275165558,850.0933227539062,1e-05,0.1321810930967331,3.128727436065674,81.14050197601318,1 +1626,0.18339493870735168,0.28332075476646423,0.28682637214660645,0.18974359333515167,658.916015625,1e-05,0.27603843808174133,3.073782444000244,81.14050197601318,1 +1627,0.341336190700531,0.26361653208732605,0.2852267324924469,0.19207459688186646,557.397705078125,1e-05,0.25007742643356323,2.82151460647583,81.14050197601318,1 +1628,0.3140336871147156,0.2559736371040344,0.26710349321365356,0.12773892283439636,691.7044067382812,1e-05,0.15552997589111328,3.2699570655822754,81.14050197601318,1 +1629,0.17910242080688477,0.39902985095977783,0.40126514434814453,0.1750582754611969,963.0614624023438,1e-05,0.1297931969165802,2.824075698852539,81.14050197601318,1 +1630,0.3238750398159027,0.2687637507915497,0.2766534686088562,0.13123543560504913,727.9061279296875,1e-05,0.3185385763645172,3.033628225326538,81.14050197601318,1 +1631,0.21116700768470764,0.24750369787216187,0.2595522105693817,0.22284382581710815,941.685791015625,1e-05,0.13687542080879211,3.0552685260772705,81.14050197601318,1 +1632,0.35921549797058105,0.24876995384693146,0.25511670112609863,0.2545454502105713,893.5853271484375,1e-05,0.16293425858020782,3.005546808242798,81.14050197601318,1 +1633,0.3092837929725647,0.3274868130683899,0.3553668260574341,0.22074592113494873,972.7406005859375,1e-05,0.1498737633228302,2.8234105110168457,81.14050197601318,1 +1634,0.22275276482105255,0.3219432234764099,0.3327905237674713,0.18205128610134125,925.8049926757812,1e-05,0.1418178230524063,3.2911646366119385,81.14050197601318,1 +1635,0.09519538283348083,0.3027645945549011,0.3064650893211365,0.21678321063518524,984.3526000976562,1e-05,0.09878398478031158,2.8318581581115723,81.14050197601318,1 +1636,0.34904566407203674,0.3375171422958374,0.35574981570243835,0.24195803701877594,997.7442626953125,1e-05,0.16342562437057495,3.082784652709961,81.14050197601318,1 +1637,0.2008758932352066,0.33557718992233276,0.35057538747787476,0.22284382581710815,976.3768310546875,1e-05,0.1396489292383194,3.112957000732422,81.14050197601318,1 +1638,0.36401301622390747,0.26396864652633667,0.2719300389289856,0.11491841822862625,586.15087890625,1e-05,0.14304563403129578,3.0423572063446045,81.14050197601318,1 +1639,0.4364283084869385,0.3291233479976654,0.34001174569129944,0.21515151858329773,591.9431762695312,1e-05,0.20492766797542572,3.072950601577759,81.14050197601318,1 +1640,0.1581697314977646,0.3574424684047699,0.37444305419921875,0.14405594766139984,989.1450805664062,1e-05,0.12864024937152863,3.059077262878418,81.14050197601318,1 +1641,0.28615206480026245,0.4511626958847046,0.43837878108024597,0.19650349020957947,993.5120239257812,1e-05,0.1344810426235199,2.831188201904297,81.14050197601318,1 +1642,0.29732728004455566,0.20931315422058105,0.22184114158153534,0.11118881404399872,863.0953369140625,1e-05,0.09449713677167892,3.3352739810943604,81.14050197601318,1 +1643,0.4349392354488373,0.5170625448226929,0.5177121162414551,0.1627039611339569,258.84716796875,1e-05,0.15147478878498077,3.0944302082061768,81.14050197601318,1 +1644,0.32077139616012573,0.432693749666214,0.43636688590049744,0.25314685702323914,283.0556640625,1e-05,0.14690087735652924,2.823505163192749,81.14050197601318,1 +1645,0.2694496512413025,0.284496545791626,0.29006773233413696,0.2666666805744171,804.4718627929688,1e-05,0.1801062971353531,3.058302879333496,81.14050197601318,1 +1646,0.29268068075180054,0.3226797878742218,0.3141118586063385,0.2410256415605545,862.1375732421875,1e-05,0.15834058821201324,3.081486701965332,81.14050197601318,1 +1647,0.2801060676574707,0.30514857172966003,0.3115185499191284,0.1230769231915474,960.7506713867188,1e-05,0.1530952900648117,2.8305320739746094,81.14050197601318,1 +1648,0.3020990490913391,0.266504168510437,0.27600809931755066,0.26853147149086,916.6853637695312,1e-05,0.15037693083286285,3.310015916824341,81.14050197601318,1 +1649,0.2516280710697174,0.21576526761054993,0.22799919545650482,0.17972028255462646,816.0525512695312,1e-05,0.13231100142002106,3.0975069999694824,81.14050197601318,1 +1650,0.320137619972229,0.3278120160102844,0.32598304748535156,0.23752914369106293,689.1459350585938,1e-05,0.15311597287654877,2.82968807220459,81.14050197601318,1 +1651,0.17470447719097137,0.20794305205345154,0.20509999990463257,0.17272727191448212,940.961669921875,1e-05,0.13607735931873322,3.085939884185791,81.14050197601318,1 +1652,0.2811792492866516,0.29912421107292175,0.30586305260658264,0.14522144198417664,874.521484375,1e-05,0.15469145774841309,3.271653413772583,81.14050197601318,1 +1653,0.39893144369125366,0.35372358560562134,0.3570365905761719,0.21561771631240845,898.011962890625,1e-05,0.1362752467393875,2.8203890323638916,81.14050197601318,1 +1654,0.38947227597236633,0.22815322875976562,0.25282546877861023,0.15571095049381256,939.2506103515625,1e-05,0.2097271829843521,3.294935941696167,81.14050197601318,1 +1655,0.34448808431625366,0.5061118602752686,0.48659747838974,0.2461538463830948,991.1632080078125,1e-05,0.15031665563583374,3.1050188541412354,81.14050197601318,1 +1656,0.22459352016448975,0.417722225189209,0.43504664301872253,0.2114219069480896,200.4163818359375,1e-05,0.11947114765644073,2.819002151489258,81.14050197601318,1 +1657,0.23407931625843048,0.2090408056974411,0.22037681937217712,0.16993007063865662,668.9708251953125,1e-05,0.1897810399532318,3.2666265964508057,81.14050197601318,1 +1658,0.47362786531448364,0.3633744716644287,0.3593115508556366,0.2186480164527893,982.8820190429688,1e-05,0.14698033034801483,3.0580153465270996,81.14050197601318,1 +1659,0.3660005033016205,0.25133848190307617,0.2595333158969879,0.24079254269599915,904.0114135742188,1e-05,0.12611182034015656,3.085263252258301,81.14050197601318,1 +1660,0.2399715930223465,0.6151896119117737,0.6187856197357178,0.2694638669490814,989.6887817382812,1e-05,0.14003032445907593,3.0827596187591553,81.14050197601318,1 +1661,0.4416813254356384,0.39891499280929565,0.4038640856742859,0.29720279574394226,484.3331604003906,1e-05,0.18226368725299835,3.017642021179199,81.14050197601318,1 +1662,0.1374436318874359,0.2476407289505005,0.24695080518722534,0.13286712765693665,890.9254760742188,1e-05,0.13762019574642181,2.8243215084075928,81.14050197601318,1 +1663,0.2659229636192322,0.429206520318985,0.4459339380264282,0.26247087121009827,319.1216125488281,1e-05,0.17869384586811066,3.226393222808838,81.14050197601318,1 +1664,0.2759762704372406,0.434396356344223,0.4251317083835602,0.22750583291053772,996.0327758789062,1e-05,0.12601907551288605,3.0770506858825684,81.14050197601318,1 +1665,0.34646767377853394,0.3961648643016815,0.4053971469402313,0.214685320854187,987.2093505859375,1e-05,0.13160492479801178,3.2727456092834473,81.14050197601318,1 +1666,0.33559083938598633,0.39793071150779724,0.3906439542770386,0.23613053560256958,976.0529174804688,1e-05,0.22580090165138245,3.0487749576568604,81.14050197601318,1 +1667,0.5303376913070679,0.39352691173553467,0.4068162143230438,0.19090908765792847,340.1504821777344,1e-05,0.11605148017406464,3.0113956928253174,81.14050197601318,1 +1668,0.253168523311615,0.3838809132575989,0.3673039376735687,0.26759907603263855,950.4097290039062,1e-05,0.15715321898460388,2.834606885910034,81.14050197601318,1 +1669,0.2937644124031067,0.3462199866771698,0.35049620270729065,0.25081583857536316,999.9999389648438,1e-05,0.23636138439178467,3.323443651199341,81.14050197601318,1 +1670,0.3830902874469757,0.3685520887374878,0.36945846676826477,0.2242424190044403,722.4732666015625,1e-05,0.1648118495941162,2.8324949741363525,81.14050197601318,1 +1671,0.44058459997177124,0.27102747559547424,0.30268293619155884,0.22191141545772552,997.6233520507812,1e-05,0.1300750970840454,3.1153852939605713,81.14050197601318,1 +1672,0.1008928120136261,0.36244791746139526,0.36429351568222046,0.139860138297081,931.56005859375,1e-05,0.09666530787944794,2.823180675506592,81.14050197601318,1 +1673,0.3544574975967407,0.24858984351158142,0.25348302721977234,0.13333334028720856,904.354736328125,1e-05,0.12243581563234329,3.0415894985198975,81.14050197601318,1 +1674,0.36345380544662476,0.39001771807670593,0.4014570116996765,0.1822843849658966,982.7333984375,1e-05,0.1865081936120987,3.0660181045532227,81.14050197601318,1 +1675,0.3660218417644501,0.30679547786712646,0.30961868166923523,0.09440559148788452,557.397705078125,1e-05,0.21141579747200012,3.3282244205474854,81.14050197601318,1 +1676,0.2653196454048157,0.39481478929519653,0.39337486028671265,0.1571095585823059,945.9192504882812,1e-05,0.13091060519218445,2.83320951461792,81.14050197601318,1 +1677,0.1975385844707489,0.3335936963558197,0.3285786211490631,0.2846153974533081,971.7196655273438,1e-05,0.1369761824607849,3.1311864852905273,81.14050197601318,1 +1678,0.3189060688018799,0.276111364364624,0.2716984450817108,0.16969697177410126,992.8673706054688,1e-05,0.13080137968063354,2.837366819381714,81.14050197601318,1 +1679,0.17908290028572083,0.30254867672920227,0.32199209928512573,0.20326340198516846,752.1058349609375,1e-05,0.17500612139701843,3.8469955921173096,81.14050197601318,1 +1680,0.38953250646591187,0.2543562948703766,0.26510122418403625,0.27435898780822754,821.8599853515625,1e-05,0.11055848747491837,3.072615385055542,81.14050197601318,1 +1681,0.4258630573749542,0.29343363642692566,0.2991035580635071,0.18764568865299225,958.7767944335938,1e-05,0.17405205965042114,3.458178758621216,81.14050197601318,1 +1682,0.16390478610992432,0.23777078092098236,0.24507226049900055,0.24358974397182465,920.0114135742188,1e-05,0.12095509469509125,2.8418986797332764,81.14050197601318,1 +1683,0.3310064673423767,0.2490117847919464,0.2699529230594635,0.21072261035442352,920.0114135742188,1e-05,0.11549324542284012,3.0729851722717285,81.14050197601318,1 +1684,0.30202800035476685,0.21065030992031097,0.2238527238368988,0.25314685702323914,930.488525390625,1e-05,0.5074451565742493,2.836648464202881,81.14050197601318,1 +1685,0.23768280446529388,0.2924526631832123,0.30193307995796204,0.2265734225511551,976.8599853515625,1e-05,0.13449689745903015,3.1014175415039062,81.14050197601318,1 +1686,0.22564376890659332,0.24996957182884216,0.26683616638183594,0.12237761914730072,987.6286010742188,1e-05,0.13559746742248535,3.1073741912841797,81.14050197601318,1 +1687,0.34090447425842285,0.33662036061286926,0.33386778831481934,0.17552447319030762,902.2786865234375,1e-05,0.24723432958126068,3.076554536819458,81.14050197601318,1 +1688,0.2601432204246521,0.30263254046440125,0.291403591632843,0.10489510744810104,966.2316284179688,1e-05,0.10571270436048508,2.8243167400360107,81.14050197601318,1 +1689,0.49796175956726074,0.2319110780954361,0.24221086502075195,0.1906759887933731,792.7744140625,1e-05,0.15381748974323273,3.1024272441864014,81.14050197601318,1 +1690,0.36706534028053284,0.30588865280151367,0.3149116039276123,0.1862470805644989,523.0420532226562,1e-05,0.09759898483753204,2.8239028453826904,81.14050197601318,1 +1691,0.43015599250793457,0.3275996148586273,0.3290643095970154,0.19207459688186646,872.3140258789062,1e-05,0.24977834522724152,3.0287258625030518,81.14050197601318,1 +1692,0.3414310812950134,0.2963850498199463,0.2893868386745453,0.2773892879486084,914.8272094726562,1e-05,0.1490592062473297,3.089210033416748,81.14050197601318,1 +1693,0.29339832067489624,0.2649688720703125,0.27799803018569946,0.15757575631141663,984.7882080078125,1e-05,0.10996667295694351,3.035984516143799,81.14050197601318,1 +1694,0.3645591139793396,0.322117418050766,0.3215829133987427,0.25757575035095215,541.85888671875,1e-05,2.2413108348846436,2.8217597007751465,81.14050197601318,1 +1695,0.35043105483055115,0.3248666822910309,0.3150864541530609,0.15804195404052734,981.0787963867188,1e-05,0.12730927765369415,3.114881753921509,81.14050197601318,1 +1696,0.23481965065002441,0.22665022313594818,0.24788685142993927,0.21958041191101074,795.030517578125,1e-05,0.1290156990289688,2.8307855129241943,81.14050197601318,1 +1697,0.45591816306114197,0.21841786801815033,0.23827771842479706,0.2125874161720276,404.18499755859375,1e-05,0.13860353827476501,3.086663246154785,81.14050197601318,1 +1698,0.4392986297607422,0.2778472602367401,0.2832805812358856,0.16363635659217834,914.5143432617188,1e-05,0.15715381503105164,3.4005022048950195,81.14050197601318,1 +1699,0.2874232232570648,0.22656996548175812,0.2426193207502365,0.26806527376174927,958.9761352539062,1e-05,0.10468866676092148,3.0450122356414795,81.14050197601318,1 +1700,0.321038156747818,0.3284454643726349,0.33964216709136963,0.20629370212554932,981.0787963867188,1e-05,0.17337197065353394,2.840405225753784,81.14050197601318,1 +1701,0.3175617456436157,0.3347761034965515,0.3311847746372223,0.2293706238269806,978.6064453125,1e-05,0.4112103581428528,3.0969672203063965,81.14050197601318,1 +1702,0.32231220602989197,0.3354209363460541,0.34028729796409607,0.16969697177410126,452.67730712890625,1e-05,0.31286436319351196,2.8367202281951904,81.14050197601318,1 +1703,0.3529282212257385,0.2827235162258148,0.29275453090667725,0.2449883371591568,749.2398071289062,1e-05,0.12335596233606339,3.0382421016693115,81.14050197601318,1 +1704,0.2556648850440979,0.23551622033119202,0.23659010231494904,0.09557109326124191,888.2062377929688,1e-05,0.11430367827415466,3.339707612991333,81.14050197601318,1 +1705,0.14044591784477234,0.42007771134376526,0.43229907751083374,0.1794871836900711,988.0452880859375,1e-05,0.11599575728178024,3.034985065460205,81.14050197601318,1 +1706,0.27581629157066345,0.20301951467990875,0.19830293953418732,0.1319347321987152,683.93896484375,1e-05,0.12003488093614578,2.8229329586029053,81.14050197601318,1 +1707,0.3335553705692291,0.2578843832015991,0.2572402060031891,0.21212121844291687,980.1610107421875,1e-05,0.29760921001434326,3.1283082962036133,81.14050197601318,1 +1708,0.46172845363616943,0.31585413217544556,0.3164066970348358,0.1766899824142456,523.0420532226562,1e-05,0.11260684579610825,2.822164535522461,81.14050197601318,1 +1709,0.32559189200401306,0.2887524366378784,0.2935483157634735,0.2501165568828583,954.271728515625,1e-05,0.1254725158214569,3.015065908432007,81.14050197601318,1 +1710,0.29307666420936584,0.3136782944202423,0.31244876980781555,0.21002331376075745,933.1463012695312,1e-05,0.3353976309299469,3.106494665145874,81.14050197601318,1 +1711,0.2488214373588562,0.3402935862541199,0.3380473256111145,0.2181818187236786,593.8468017578125,1e-05,0.12265703082084656,3.0302419662475586,81.14050197601318,1 +1712,0.19772405922412872,0.33986252546310425,0.3406132757663727,0.2769230902194977,947.5157470703125,1e-05,0.1550983041524887,3.091919422149658,81.14050197601318,1 +1713,0.3423187732696533,0.27526867389678955,0.281650185585022,0.16853146255016327,625.9617919921875,1e-05,0.13801522552967072,2.837176561355591,81.14050197601318,1 +1714,0.1879185438156128,0.1735309511423111,0.18379825353622437,0.09487179666757584,857.74267578125,1e-05,0.17126666009426117,2.8317577838897705,81.14050197601318,1 +1715,0.2673840820789337,0.32198038697242737,0.33694466948509216,0.21398600935935974,894.70751953125,1e-05,0.13366752862930298,3.276108503341675,81.14050197601318,1 +1716,0.2127041220664978,0.533011794090271,0.5430973768234253,0.18811188638210297,997.86474609375,1e-05,0.10738052427768707,2.830906391143799,81.14050197601318,1 +1717,0.3859536051750183,0.29827597737312317,0.30815941095352173,0.2181818187236786,929.9484252929688,1e-05,0.20581164956092834,3.098621368408203,81.14050197601318,1 +1718,0.28535717725753784,0.37985244393348694,0.3735105097293854,0.13216783106327057,983.0303955078125,1e-05,0.18891121447086334,3.3104093074798584,81.14050197601318,1 +1719,0.26581987738609314,0.30257418751716614,0.3125830590724945,0.08181817829608917,981.230712890625,1e-05,0.1409851461648941,3.0639350414276123,81.14050197601318,1 +1720,0.39590024948120117,0.32747912406921387,0.33924180269241333,0.22773893177509308,968.57763671875,1e-05,1.194534420967102,2.830641508102417,81.14050197601318,1 +1721,0.2556222975254059,0.3345049321651459,0.34099873900413513,0.1918414980173111,998.7031860351562,1e-05,0.11773736774921417,3.3121886253356934,81.14050197601318,1 +1722,0.3503716289997101,0.256990522146225,0.26708653569221497,0.19510489702224731,897.28564453125,1e-05,0.18371020257472992,3.1043031215667725,81.14050197601318,1 +1723,0.21791242063045502,0.1966944932937622,0.20934750139713287,0.24428904056549072,870.0686645507812,1e-05,0.10446741431951523,2.826843500137329,81.14050197601318,1 +1724,0.29504069685935974,0.32511386275291443,0.32084885239601135,0.2421911358833313,725.7503051757812,1e-05,0.1513437032699585,3.3336446285247803,81.14050197601318,1 +1725,0.28867030143737793,0.32598036527633667,0.32028430700302124,0.23356643319129944,863.5715942382812,1e-05,0.15430980920791626,3.0554399490356445,81.14050197601318,1 +1726,0.5207244157791138,0.35949984192848206,0.3634316027164459,0.20606060326099396,523.0420532226562,1e-05,0.153461292386055,3.0033624172210693,81.14050197601318,1 +1727,0.30759626626968384,0.25791436433792114,0.28069859743118286,0.2801864743232727,880.926025390625,1e-05,0.20459188520908356,3.083320379257202,81.14050197601318,1 +1728,0.2512160539627075,0.27654150128364563,0.2834194004535675,0.25361305475234985,861.1730346679688,1e-05,0.1858867108821869,3.0991432666778564,81.14050197601318,1 +1729,0.36495089530944824,0.36186543107032776,0.3781949281692505,0.2533799409866333,997.9851684570312,1e-05,0.15380913019180298,2.8409924507141113,81.14050197601318,1 +1730,0.21045422554016113,0.251743882894516,0.24991460144519806,0.10396270453929901,835.2010498046875,1e-05,0.1338830590248108,3.2881059646606445,81.14050197601318,1 +1731,0.2231701910495758,0.4097743034362793,0.4003896117210388,0.25407925248146057,868.2445068359375,1e-05,0.2763456404209137,3.0610392093658447,81.14050197601318,1 +1732,0.22190004587173462,0.20652297139167786,0.22362366318702698,0.21561771631240845,864.0462646484375,1e-05,0.09506246447563171,3.0113370418548584,81.14050197601318,1 +1733,0.2816137969493866,0.21179768443107605,0.22630411386489868,0.2543123662471771,702.8627319335938,1e-05,0.1152421161532402,3.117274284362793,81.14050197601318,1 +1734,0.5024089813232422,0.1728840321302414,0.19483602046966553,0.238228440284729,696.7341918945312,1e-05,0.141811802983284,3.2997498512268066,81.14050197601318,1 +1735,0.2904528081417084,0.29633912444114685,0.3017549514770508,0.21491841971874237,639.041015625,1e-05,0.2441726177930832,2.8336942195892334,81.14050197601318,1 +1736,0.5410097241401672,0.3452933728694916,0.3532894551753998,0.23030303418636322,375.388671875,1e-05,0.4124371409416199,3.160536050796509,81.14050197601318,1 +1737,0.28113996982574463,0.4081614017486572,0.4198244512081146,0.21561771631240845,997.259521484375,1e-05,0.1438692808151245,3.0810635089874268,81.14050197601318,1 +1738,0.46748074889183044,0.2973945438861847,0.3042317032814026,0.21095570921897888,580.2335815429688,1e-05,0.19865387678146362,3.0152370929718018,81.14050197601318,1 +1739,0.5541504621505737,0.2890527844429016,0.2965227961540222,0.22797203063964844,778.5809936523438,1e-05,0.21162839233875275,3.3715720176696777,81.14050197601318,1 +1740,0.23442819714546204,0.34054383635520935,0.3543209433555603,0.24242423474788666,963.818115234375,1e-05,0.12298393249511719,3.3559863567352295,81.14050197601318,1 +1741,0.41542813181877136,0.3246462047100067,0.34073713421821594,0.2230769246816635,981.5336303710938,1e-05,0.14017313718795776,2.8220577239990234,81.14050197601318,1 +1742,0.20447970926761627,0.36612841486930847,0.3685588836669922,0.1375291347503662,988.18359375,1e-05,0.09421797096729279,3.0704004764556885,81.14050197601318,1 +1743,0.5827039480209351,0.3850390613079071,0.42796996235847473,0.2282051295042038,233.2209930419922,1e-05,0.1521572768688202,3.1000816822052,81.14050197601318,1 +1744,0.3140815496444702,0.32592082023620605,0.3233118951320648,0.2426573485136032,823.121826171875,1e-05,0.14074917137622833,3.0681350231170654,81.14050197601318,1 +1745,0.1593570113182068,0.2394859343767166,0.25413650274276733,0.151048943400383,696.7341918945312,1e-05,0.1536187082529068,3.0754647254943848,81.14050197601318,1 +1746,0.22937610745429993,0.22018598020076752,0.22865577042102814,0.15734265744686127,936.7528076171875,1e-05,0.13021934032440186,3.1123201847076416,81.14050197601318,1 +1747,0.5172571539878845,0.35124078392982483,0.35813209414482117,0.21212121844291687,473.1681213378906,1e-05,0.227004736661911,3.0120346546173096,81.14050197601318,1 +1748,0.2787083387374878,0.297267884016037,0.30871710181236267,0.22167831659317017,980.3147583007812,1e-05,0.15403403341770172,3.1377437114715576,81.14050197601318,1 +1749,0.3743238151073456,0.3137195110321045,0.312097430229187,0.232634037733078,943.8261108398438,1e-05,0.15939995646476746,3.095165729522705,81.14050197601318,1 +1750,0.3277663588523865,0.3841668367385864,0.38231945037841797,0.2170163094997406,960.1631469726562,1e-05,0.16815494000911713,3.068307638168335,81.14050197601318,1 +1751,0.31486624479293823,0.32954514026641846,0.3274804949760437,0.23193472623825073,694.233642578125,1e-05,0.23158620297908783,3.10872483253479,81.14050197601318,1 +1752,0.1838207244873047,0.20227086544036865,0.21128882467746735,0.2046620100736618,807.9645385742188,1e-05,0.14589601755142212,3.1515958309173584,81.14050197601318,1 +1753,0.11616083979606628,0.3331865072250366,0.33504146337509155,0.1890442818403244,978.6064453125,1e-05,0.18685762584209442,3.0580456256866455,81.14050197601318,1 +1754,0.09789802879095078,0.5059677362442017,0.5074493885040283,0.274125874042511,993.383544921875,1e-05,0.13970384001731873,2.8373734951019287,81.14050197601318,1 +1755,0.3518245220184326,0.22474193572998047,0.2396186739206314,0.23729602992534637,934.449462890625,1e-05,0.1254027634859085,3.0786075592041016,81.14050197601318,1 +1756,0.3969634771347046,0.25797489285469055,0.2602201998233795,0.21398600935935974,802.3400268554688,1e-05,0.18207523226737976,3.1048099994659424,81.14050197601318,1 +1757,0.15935713052749634,0.3698563873767853,0.37738749384880066,0.25081583857536316,941.685791015625,1e-05,0.19098664820194244,3.046102523803711,81.14050197601318,1 +1758,0.2367383986711502,0.375384122133255,0.3763088881969452,0.21282051503658295,920.9009399414062,1e-05,0.16130870580673218,3.0813262462615967,81.14050197601318,1 +1759,0.21352621912956238,0.4491593539714813,0.4427812397480011,0.19277389347553253,379.11187744140625,1e-05,0.1945951133966446,3.0964138507843018,81.14050197601318,1 +1760,0.2786509096622467,0.26191097497940063,0.26610174775123596,0.23962703347206116,843.6619262695312,1e-05,0.4056730270385742,2.820013999938965,81.14050197601318,1 +1761,0.230219766497612,0.20868773758411407,0.22738102078437805,0.19557109475135803,931.025634765625,1e-05,0.14308984577655792,3.0942482948303223,81.14050197601318,1 +1762,0.2221526950597763,0.3148858845233917,0.3121088445186615,0.1610722541809082,884.2141723632812,1e-05,0.13865478336811066,3.3165581226348877,81.14050197601318,1 +1763,0.26789194345474243,0.33466216921806335,0.3392327129840851,0.17855477333068848,892.831298828125,1e-05,0.1550559103488922,3.1051483154296875,81.14050197601318,1 +1764,0.21950596570968628,0.27475619316101074,0.30255231261253357,0.23053613305091858,970.8588256835938,1e-05,0.13249929249286652,3.048720359802246,81.14050197601318,1 +1765,0.25210151076316833,0.3567568063735962,0.36162450909614563,0.2170163094997406,939.2506103515625,1e-05,0.13640688359737396,3.150907516479492,81.14050197601318,1 +1766,0.2581493854522705,0.30214694142341614,0.31667932868003845,0.20000000298023224,584.1925659179688,1e-05,0.16378280520439148,2.8385426998138428,81.14050197601318,1 +1767,0.4368874728679657,0.3795202374458313,0.39136606454849243,0.19836829602718353,954.0613403320312,1e-05,0.1478421986103058,3.086202383041382,81.14050197601318,1 +1768,0.3378284275531769,0.37244686484336853,0.38735583424568176,0.2254079282283783,995.7847900390625,1e-05,0.3988212049007416,3.367157459259033,81.14050197601318,1 +1769,0.3088737428188324,0.3725786805152893,0.37340521812438965,0.22074592113494873,500.3907775878906,1e-05,0.26360660791397095,3.0610733032226562,81.14050197601318,1 +1770,0.3488384187221527,0.28466105461120605,0.29075008630752563,0.2186480164527893,911.6586303710938,1e-05,0.2328595519065857,3.0518341064453125,81.14050197601318,1 +1771,0.16890758275985718,0.31831419467926025,0.3330084979534149,0.21048951148986816,998.1053466796875,1e-05,0.11681979149580002,3.146385908126831,81.14050197601318,1 +1772,0.2644094228744507,1.0017051696777344,0.9971572756767273,0.22634032368659973,999.2957763671875,1e-05,0.2288728952407837,2.837096929550171,81.14050197601318,1 +1773,0.5302621126174927,0.2574361264705658,0.2650570571422577,0.23076923191547394,756.7888793945312,1e-05,0.1806010752916336,3.3269307613372803,81.14050197601318,1 +1774,0.2666361629962921,0.31957772374153137,0.3141070008277893,0.2321678251028061,872.3140258789062,1e-05,0.15420183539390564,3.235668659210205,81.14050197601318,1 +1775,0.3519742488861084,0.3045910894870758,0.31794261932373047,0.20629370212554932,642.2061767578125,1e-05,0.10717697441577911,3.0197317600250244,81.14050197601318,1 +1776,0.21141713857650757,0.4123598635196686,0.41810286045074463,0.15641026198863983,340.1504821777344,1e-05,0.1272318959236145,3.029573678970337,81.14050197601318,1 +1777,0.30964553356170654,0.3123253583908081,0.31003689765930176,0.19813519716262817,975.2377319335938,1e-05,0.15896180272102356,3.072801113128662,81.14050197601318,1 +1778,0.26990950107574463,0.3677104711532593,0.36784884333610535,0.23519814014434814,942.4046020507812,1e-05,0.1600797027349472,2.8268589973449707,81.14050197601318,1 +1779,0.1906120479106903,0.3036397695541382,0.30162283778190613,0.225874125957489,862.1375732421875,1e-05,0.22532641887664795,3.4400739669799805,81.14050197601318,1 +1780,0.25258907675743103,0.34444451332092285,0.3478890359401703,0.19487179815769196,715.7589111328125,1e-05,0.11225499212741852,3.280580520629883,81.14050197601318,1 +1781,0.2574184536933899,0.29911497235298157,0.29170694947242737,0.1902097910642624,877.97705078125,1e-05,0.2040875405073166,3.0105984210968018,81.14050197601318,1 +1782,0.3440518379211426,0.2837429940700531,0.27675509452819824,0.21212121844291687,879.2493286132812,1e-05,0.21465761959552765,3.351789951324463,81.14050197601318,1 +1783,0.22916029393672943,0.36715707182884216,0.3547579348087311,0.17132866382598877,492.46246337890625,1e-05,0.16361479461193085,3.0487966537475586,81.14050197601318,1 +1784,0.2744508981704712,0.35098087787628174,0.34153640270233154,0.19696970283985138,867.3228149414062,1e-05,0.10220564156770706,2.8410091400146484,81.14050197601318,1 +1785,0.28512871265411377,0.2877950370311737,0.29337871074676514,0.18205128610134125,615.6897583007812,1e-05,0.13819685578346252,3.1486945152282715,81.14050197601318,1 +1786,0.3883007764816284,0.3460869789123535,0.34071871638298035,0.20512820780277252,833.4493408203125,1e-05,0.1687401682138443,3.3419389724731445,81.14050197601318,1 +1787,0.3396493196487427,0.23425760865211487,0.26025500893592834,0.23449882864952087,964.940673828125,1e-05,0.5303013920783997,3.0574471950531006,81.14050197601318,1 +1788,0.2908775806427002,0.36704689264297485,0.35774871706962585,0.2230769246816635,955.523193359375,1e-05,0.11737876385450363,3.407203435897827,81.14050197601318,1 +1789,0.1689147651195526,0.22907422482967377,0.23391856253147125,0.24592074751853943,910.6900634765625,1e-05,0.185237318277359,3.2427268028259277,81.14050197601318,1 +1790,0.23894202709197998,0.3196186423301697,0.31968891620635986,0.2710955739021301,911.0138549804688,1e-05,0.17093992233276367,2.8349125385284424,81.14050197601318,1 +1791,0.21808603405952454,0.25807279348373413,0.25196170806884766,0.08741258829832077,728.9754028320312,1e-05,0.19586414098739624,3.2921299934387207,81.14050197601318,1 +1792,0.29485511779785156,0.34207379817962646,0.35115665197372437,0.24452213943004608,985.6517944335938,1e-05,0.19061054289340973,3.1047310829162598,81.14050197601318,1 +1793,0.2465386539697647,0.22537414729595184,0.2405834197998047,0.21561771631240845,758.630126953125,1e-05,0.2631263732910156,3.1465415954589844,81.14050197601318,1 +1794,0.34517404437065125,0.24427500367164612,0.24900326132774353,0.15524475276470184,890.9254760742188,1e-05,0.13840214908123016,3.2858660221099854,81.14050197601318,1 +1795,0.3135938346385956,0.33898094296455383,0.34737086296081543,0.23752914369106293,630.94677734375,1e-05,0.14429831504821777,3.055560350418091,81.14050197601318,1 +1796,0.41713806986808777,0.19002719223499298,0.20296135544776917,0.23030303418636322,818.01220703125,1e-05,0.1589491069316864,2.8308260440826416,81.14050197601318,1 +1797,0.3460412323474884,0.17299871146678925,0.20097343623638153,0.18251748383045197,923.8132934570312,1e-05,0.16645586490631104,3.3236641883850098,81.14050197601318,1 +1798,0.2767799496650696,0.28224802017211914,0.2831583023071289,0.19930069148540497,925.8049926757812,1e-05,0.1701139211654663,3.0648839473724365,81.14050197601318,1 +1799,0.2606452405452728,0.2812863886356354,0.29422757029533386,0.17995338141918182,969.6383056640625,1e-05,0.23557783663272858,3.1464312076568604,81.14050197601318,1 +1800,0.3106796443462372,0.3531973361968994,0.3481823801994324,0.2097902148962021,908.0657348632812,1e-05,0.12400208413600922,3.267439126968384,81.14050197601318,1 +1801,0.250899076461792,0.2569034695625305,0.2628922164440155,0.1906759887933731,883.4002075195312,1e-05,0.13602584600448608,3.052015781402588,81.14050197601318,1 +1802,0.19987650215625763,0.24036799371242523,0.2640864849090576,0.13892774283885956,948.6395874023438,1e-05,0.12587092816829681,3.130995988845825,81.14050197601318,1 +1803,0.36143171787261963,0.20528651773929596,0.214092418551445,0.2354312390089035,839.2100219726562,1e-05,0.13576896488666534,3.269261360168457,81.14050197601318,1 +1804,0.38421863317489624,0.2363724559545517,0.24611599743366241,0.2433566451072693,679.9532470703125,1e-05,0.15342235565185547,3.129279851913452,81.14050197601318,1 +1805,0.4615451395511627,0.3148009777069092,0.3175542652606964,0.19254079461097717,639.041015625,1e-05,0.4153258502483368,3.2146155834198,81.14050197601318,1 +1806,0.28268691897392273,0.18256956338882446,0.1938120275735855,0.15058274567127228,679.9532470703125,1e-05,0.16745053231716156,3.3254194259643555,81.14050197601318,1 +1807,0.28774604201316833,0.22295132279396057,0.2255052626132965,0.15407925844192505,952.5755615234375,1e-05,0.10455837100744247,3.3512167930603027,81.14050197601318,1 +1808,0.2090795636177063,0.3083384335041046,0.30047836899757385,0.19230769574642181,918.2099609375,1e-05,0.28732332587242126,3.038949966430664,81.14050197601318,1 +1809,0.15953044593334198,0.22468385100364685,0.23363617062568665,0.21351981163024902,945.68896484375,1e-05,0.12280983477830887,3.3986992835998535,81.14050197601318,1 +1810,0.45005494356155396,0.20845597982406616,0.21083395183086395,0.07738927751779556,697.9737548828125,1e-05,0.20062781870365143,2.8320417404174805,81.14050197601318,1 +1811,0.32657691836357117,0.22977901995182037,0.241999551653862,0.2018647938966751,895.8192749023438,1e-05,0.16764973104000092,3.114628553390503,81.14050197601318,1 +1812,0.10385752469301224,0.22731006145477295,0.2463846057653427,0.18251748383045197,928.8597412109375,1e-05,0.2826373279094696,3.3526854515075684,81.14050197601318,1 +1813,0.23566968739032745,0.3031527101993561,0.3220842182636261,0.14778554439544678,973.0780639648438,1e-05,0.15954148769378662,2.8357667922973633,81.14050197601318,1 +1814,0.26136472821235657,0.6247549057006836,0.6316764950752258,0.22867132723331451,183.10153198242188,1e-05,0.09086057543754578,3.0548830032348633,81.14050197601318,1 +1815,0.11562947183847427,0.34735533595085144,0.33175182342529297,0.21002331376075745,955.523193359375,1e-05,0.2269725799560547,3.4332056045532227,81.14050197601318,1 +1816,0.20806798338890076,0.30088716745376587,0.3157672584056854,0.23053613305091858,949.3074340820312,1e-05,0.24532543122768402,3.2168781757354736,81.14050197601318,1 +1817,0.1337365210056305,0.2707814872264862,0.27646011114120483,0.15291374921798706,850.6163940429688,1e-05,0.1855703890323639,3.0969150066375732,81.14050197601318,1 +1818,0.2890620827674866,0.26122617721557617,0.28629598021507263,0.18041957914829254,685.2521362304688,1e-05,0.2644345462322235,3.315650463104248,81.14050197601318,1 +1819,0.1987876296043396,0.31754663586616516,0.3206789195537567,0.22610722482204437,874.9585571289062,1e-05,0.18106402456760406,2.824950933456421,81.14050197601318,1 +1820,0.2428227961063385,0.2476002424955368,0.26973164081573486,0.22004662454128265,873.2015991210938,1e-05,0.15390445291996002,3.072892427444458,81.14050197601318,1 +1821,0.5127407312393188,0.3004266321659088,0.31912171840667725,0.17692308127880096,475.9952392578125,1e-05,0.15361551940441132,3.2904441356658936,81.14050197601318,1 +1822,0.29678887128829956,0.34400200843811035,0.3538660705089569,0.145454540848732,848.5123291015625,1e-05,0.12334439158439636,2.8400657176971436,81.14050197601318,1 +1823,0.41183167695999146,0.22172211110591888,0.23726363480091095,0.17435897886753082,630.94677734375,1e-05,0.1315975934267044,3.091327428817749,81.14050197601318,1 +1824,0.30399197340011597,0.4067000448703766,0.4003419876098633,0.23682983219623566,953.639404296875,1e-05,0.15582966804504395,3.331918954849243,81.14050197601318,1 +1825,0.24822552502155304,0.30078181624412537,0.2976865768432617,0.11981351673603058,918.2099609375,1e-05,0.1800653487443924,2.837350368499756,81.14050197601318,1 +1826,0.2610708773136139,0.31171751022338867,0.31296506524086,0.17435897886753082,957.7728271484375,1e-05,0.1471792459487915,3.048842430114746,81.14050197601318,1 +1827,0.3349434733390808,0.31455737352371216,0.3148811459541321,0.22074592113494873,925.2398681640625,1e-05,0.18297578394412994,3.349191665649414,81.14050197601318,1 +1828,0.462805837392807,0.24271057546138763,0.24464917182922363,0.21771562099456787,513.177978515625,1e-05,0.3073751628398895,3.0254085063934326,81.14050197601318,1 +1829,0.1754741072654724,0.3725515305995941,0.3835219442844391,0.11118881404399872,959.7694091796875,1e-05,0.27309924364089966,2.8189620971679688,81.14050197601318,1 +1830,0.3693481683731079,0.3119271695613861,0.3199358582496643,0.2377622425556183,443.50128173828125,1e-05,0.18832391500473022,3.3303825855255127,81.14050197601318,1 +1831,0.3570713996887207,0.34154582023620605,0.3473828434944153,0.16153846681118011,858.2379760742188,1e-05,0.17791056632995605,2.8223917484283447,81.14050197601318,1 +1832,0.1317194104194641,0.3293074071407318,0.3374321758747101,0.16526806354522705,997.86474609375,1e-05,0.17786632478237152,3.0881311893463135,81.14050197601318,1 +1833,0.26126667857170105,0.3676271140575409,0.38537177443504333,0.20512820780277252,988.4596557617188,1e-05,0.13864098489284515,3.1163501739501953,81.14050197601318,1 +1834,0.19305557012557983,0.3475014269351959,0.338462769985199,0.22074592113494873,996.5260620117188,1e-05,0.3325265645980835,3.0260446071624756,81.14050197601318,1 +1835,0.15919476747512817,0.2619931399822235,0.26373061537742615,0.2543123662471771,855.2390747070312,1e-05,0.22177810966968536,3.0919578075408936,81.14050197601318,1 +1836,0.40633708238601685,0.7170026898384094,0.7179681658744812,0.20629370212554932,992.3473510742188,1e-05,0.16915848851203918,3.069243907928467,81.14050197601318,1 +1837,0.27659961581230164,0.2721022069454193,0.27515271306037903,0.2181818187236786,821.2252807617188,1e-05,0.12770749628543854,3.056464433670044,81.14050197601318,1 +1838,0.29816576838493347,0.24209579825401306,0.24148210883140564,0.22960372269153595,864.5192260742188,1e-05,0.11902184039354324,3.117420196533203,81.14050197601318,1 +1839,0.2834767997264862,0.38465335965156555,0.3946959972381592,0.21212121844291687,976.0529174804688,1e-05,0.147395059466362,3.100524425506592,81.14050197601318,1 +1840,0.1806127429008484,0.2557336986064911,0.28334683179855347,0.19160838425159454,991.2958374023438,1e-05,0.2755964696407318,3.0479443073272705,81.14050197601318,1 +1841,0.22095824778079987,0.2446550726890564,0.26333874464035034,0.12214452028274536,992.6078491210938,1e-05,0.6194901466369629,2.834090232849121,81.14050197601318,1 +1842,0.3977876305580139,0.3399548828601837,0.3508222699165344,0.19813519716262817,987.7676391601562,1e-05,0.26621919870376587,3.1416306495666504,81.14050197601318,1 +1843,0.30952727794647217,0.3960028886795044,0.40041929483413696,0.23706293106079102,981.5336303710938,1e-05,0.1290423423051834,3.064199447631836,81.14050197601318,1 +1844,0.2623686194419861,0.37983939051628113,0.38432809710502625,0.23566433787345886,979.3876342773438,1e-05,0.18321503698825836,3.103529453277588,81.14050197601318,1 +1845,0.1325889229774475,0.28566983342170715,0.298031747341156,0.12284382432699203,993.89599609375,1e-05,0.10639432817697525,3.103778839111328,81.14050197601318,1 +1846,0.2299676090478897,0.35960644483566284,0.3613756597042084,0.1958041936159134,983.6209716796875,1e-05,0.23887427151203156,3.037975549697876,81.14050197601318,1 +1847,0.3128332793712616,0.3040563464164734,0.3070204257965088,0.23986013233661652,830.4837646484375,1e-05,0.1589421033859253,3.04624342918396,81.14050197601318,1 +1848,0.39159566164016724,0.3867734670639038,0.38328900933265686,0.22004662454128265,475.9952392578125,1e-05,0.14505451917648315,3.121117115020752,81.14050197601318,1 +1849,0.23367303609848022,0.250487357378006,0.26408445835113525,0.22960372269153595,924.6715087890625,1e-05,0.252733051776886,3.053764820098877,81.14050197601318,1 +1850,0.25704988837242126,0.3060567378997803,0.31285667419433594,0.25641024112701416,873.2015991210938,1e-05,0.1878173053264618,3.028834581375122,81.14050197601318,1 +1851,0.15436261892318726,0.32837650179862976,0.34071826934814453,0.19673658907413483,902.6273193359375,1e-05,0.29107892513275146,3.090879201889038,81.14050197601318,1 +1852,0.3788624703884125,0.367416650056839,0.3728641867637634,0.26247087121009827,859.223388671875,1e-05,0.14746062457561493,3.080843448638916,81.14050197601318,1 +1853,0.12994754314422607,0.20459052920341492,0.218314066529274,0.21328671276569366,765.8187255859375,1e-05,0.14392967522144318,3.2363688945770264,81.14050197601318,1 +1854,0.3346679210662842,0.33471620082855225,0.32936233282089233,0.17482517659664154,859.223388671875,1e-05,0.13601350784301758,2.822462797164917,81.14050197601318,1 +1855,0.21313747763633728,0.34869909286499023,0.35584941506385803,0.23892773687839508,608.6077880859375,1e-05,0.11131814122200012,3.093282699584961,81.14050197601318,1 +1856,0.25752827525138855,0.22893516719341278,0.23334629833698273,0.10186479985713959,893.5853271484375,1e-05,0.24433329701423645,3.0574188232421875,81.14050197601318,1 +1857,0.372589111328125,0.17010560631752014,0.18772585690021515,0.14918415248394012,706.4580688476562,1e-05,0.15008574724197388,3.2716426849365234,81.14050197601318,1 +1858,0.3152342736721039,0.3811298608779907,0.374679833650589,0.2114219069480896,908.0657348632812,1e-05,0.15156589448451996,2.827840805053711,81.14050197601318,1 +1859,0.1497233510017395,0.41982075572013855,0.4113997220993042,0.2501165568828583,990.8973388671875,1e-05,0.11229263246059418,3.2546260356903076,81.14050197601318,1 +1860,0.2347410023212433,0.2684270441532135,0.2741544246673584,0.2265734225511551,880.5089721679688,1e-05,0.17277272045612335,2.838151454925537,81.14050197601318,1 +1861,0.27977806329727173,0.28275054693222046,0.2837707996368408,0.21095570921897888,861.6561889648438,1e-05,0.11907918751239777,3.1295368671417236,81.14050197601318,1 +1862,0.36900845170021057,0.25443723797798157,0.2583507001399994,0.08321678638458252,777.7576293945312,1e-05,0.12113778293132782,3.107529878616333,81.14050197601318,1 +1863,0.1276177614927292,0.25937002897262573,0.2545967400074005,0.10466200113296509,837.505126953125,1e-05,0.1271868795156479,3.3089001178741455,81.14050197601318,1 +1864,0.2713358700275421,0.2967047095298767,0.3288441002368927,0.1895104944705963,427.6461486816406,1e-05,0.14579999446868896,2.8199870586395264,81.14050197601318,1 +1865,0.43907466530799866,0.22881779074668884,0.23955294489860535,0.20629370212554932,793.5297241210938,1e-05,0.1426265984773636,3.2641451358795166,81.14050197601318,1 +1866,0.26334455609321594,0.2833401560783386,0.2842881679534912,0.2242424190044403,967.322509765625,1e-05,0.151667520403862,2.823868751525879,81.14050197601318,1 +1867,0.3375885784626007,0.33340582251548767,0.3404664695262909,0.17575757205486298,443.50128173828125,1e-05,0.14751984179019928,3.121309280395508,81.14050197601318,1 +1868,0.16939949989318848,0.3652087450027466,0.3651167154312134,0.23473192751407623,996.8938598632812,1e-05,0.12729808688163757,3.2655134201049805,81.14050197601318,1 +1869,0.4767512083053589,0.45760154724121094,0.4702509939670563,0.275291383266449,375.388671875,1e-05,0.202296182513237,3.0745317935943604,81.14050197601318,1 +1870,0.2257351577281952,0.3311673700809479,0.33158889412879944,0.24988344311714172,916.6853637695312,1e-05,0.1349203735589981,3.093099594116211,81.14050197601318,1 +1871,0.3568839728832245,0.3602956533432007,0.35545146465301514,0.2102564126253128,404.18499755859375,1e-05,0.16473142802715302,3.0365190505981445,81.14050197601318,1 +1872,0.20890480279922485,0.3497215807437897,0.34000465273857117,0.14965035021305084,888.5984497070312,1e-05,0.11156970262527466,2.832534074783325,81.14050197601318,1 +1873,0.26589834690093994,0.27828216552734375,0.2927408218383789,0.20349650084972382,999.0592651367188,1e-05,0.15936525166034698,3.306806802749634,81.14050197601318,1 +1874,0.23466052114963531,0.29922667145729065,0.301259845495224,0.26806527376174927,937.2574462890625,1e-05,0.1410200297832489,3.0380172729492188,81.14050197601318,1 +1875,0.3329397737979889,0.29843369126319885,0.3060953915119171,0.16177156567573547,624.2781982421875,1e-05,0.1284157931804657,3.088380813598633,81.14050197601318,1 +1876,0.18531297147274017,0.3764360845088959,0.36756783723831177,0.22331002354621887,959.966552734375,1e-05,0.11984638124704361,3.094075918197632,81.14050197601318,1 +1877,0.26305368542671204,0.27353236079216003,0.2701796889305115,0.08484848588705063,949.3074340820312,1e-05,0.10357886552810669,3.085000514984131,81.14050197601318,1 +1878,0.2205650359392166,0.5687928199768066,0.5590007305145264,0.19393938779830933,978.134033203125,1e-05,0.2478029876947403,2.8328545093536377,81.14050197601318,1 +1879,0.20991462469100952,0.2416117638349533,0.2544236183166504,0.11235430836677551,818.6600952148438,1e-05,0.13757002353668213,3.225402355194092,81.14050197601318,1 +1880,0.2779909670352936,0.43503838777542114,0.42495930194854736,0.2393939346075058,989.2814331054688,1e-05,0.17601603269577026,3.09989070892334,81.14050197601318,1 +1881,0.1806078851222992,0.259325236082077,0.27654555439949036,0.2365967333316803,946.8348388671875,1e-05,0.12975181639194489,3.100301504135132,81.14050197601318,1 +1882,0.3259112238883972,0.3616999685764313,0.36444318294525146,0.20792540907859802,999.2957763671875,1e-05,0.1543070524930954,3.0740537643432617,81.14050197601318,1 +1883,0.4769951105117798,0.28565749526023865,0.28867995738983154,0.21048951148986816,709.9939575195312,1e-05,0.16763567924499512,3.112375259399414,81.14050197601318,1 +1884,0.2266019731760025,0.17428699135780334,0.18681402504444122,0.2030303031206131,917.9066772460938,1e-05,0.13189224898815155,2.8206169605255127,81.14050197601318,1 +1885,0.23034769296646118,0.3258730173110962,0.3318753242492676,0.26247087121009827,663.2779541015625,1e-05,0.5478534698486328,3.2651102542877197,81.14050197601318,1 +1886,0.4172309339046478,0.2963314950466156,0.29582923650741577,0.2142191082239151,976.8599853515625,1e-05,0.15007977187633514,3.27846097946167,81.14050197601318,1 +1887,0.3738892376422882,0.282289981842041,0.32757478952407837,0.19370628893375397,993.1259155273438,1e-05,0.1441245675086975,3.0773510932922363,81.14050197601318,1 +1888,0.25560462474823,0.3071068823337555,0.3189992606639862,0.12937062978744507,922.0755004882812,1e-05,0.4093514084815979,3.547344207763672,81.14050197601318,1 +1889,0.2201322466135025,0.27534806728363037,0.27612870931625366,0.250582754611969,986.5054321289062,1e-05,0.12078724801540375,3.0448031425476074,81.14050197601318,1 +1890,0.38874202966690063,0.327494353055954,0.34603336453437805,0.23519814014434814,931.826171875,1e-05,0.14785972237586975,2.8356430530548096,81.14050197601318,1 +1891,0.2737750709056854,0.6714843511581421,0.6644039750099182,0.17482517659664154,994.9097900390625,1e-05,0.1217581182718277,3.1233208179473877,81.14050197601318,1 +1892,0.336346298456192,0.22504164278507233,0.2503320276737213,0.2114219069480896,803.7642822265625,1e-05,0.12199337035417557,3.2618772983551025,81.14050197601318,1 +1893,0.3654521405696869,0.341350257396698,0.3608244061470032,0.21188810467720032,928.5856323242188,1e-05,0.13132472336292267,3.076536178588867,81.14050197601318,1 +1894,0.37966448068618774,0.23868821561336517,0.24947401881217957,0.19114218652248383,841.452880859375,1e-05,1.1960779428482056,3.5511741638183594,81.14050197601318,1 +1895,0.400003045797348,0.2743850350379944,0.2839004695415497,0.18974359333515167,890.5407104492188,1e-05,0.15839408338069916,3.102665424346924,81.14050197601318,1 +1896,0.35363566875457764,0.21153363585472107,0.21673299372196198,0.19254079461097717,967.1416625976562,1e-05,0.13469816744327545,2.8403897285461426,81.14050197601318,1 +1897,0.29880550503730774,0.2539907991886139,0.2645725905895233,0.26317015290260315,678.60888671875,1e-05,0.16144567728042603,3.2934553623199463,81.14050197601318,1 +1898,0.30689728260040283,0.20419171452522278,0.2095927596092224,0.1722610741853714,713.4717407226562,1e-05,0.10669116675853729,3.0522994995117188,81.14050197601318,1 +1899,0.28927117586135864,0.27425646781921387,0.2705874741077423,0.1566433608531952,875.3941650390625,1e-05,0.13357585668563843,3.356287956237793,81.14050197601318,1 +1900,0.33363771438598633,0.20297692716121674,0.23563803732395172,0.19417248666286469,926.3671875,1e-05,0.37258732318878174,3.0137417316436768,81.14050197601318,1 +1901,0.2622322738170624,0.21289093792438507,0.22878247499465942,0.2666666805744171,934.7079467773438,1e-05,0.12473997473716736,3.1279218196868896,81.14050197601318,1 +1902,0.3879169821739197,0.25708508491516113,0.26456940174102783,0.17412588000297546,838.6439208984375,1e-05,0.14099684357643127,3.0357630252838135,81.14050197601318,1 +1903,0.14115537703037262,0.32155102491378784,0.3108327388763428,0.13449883460998535,933.9302368164062,1e-05,0.16379670798778534,3.2184011936187744,81.14050197601318,1 +1904,0.15323953330516815,0.3888990581035614,0.38185346126556396,0.232634037733078,979.2321166992188,1e-05,0.8866583704948425,3.0479512214660645,81.14050197601318,1 +1905,0.29399287700653076,0.4467052221298218,0.43698495626449585,0.18041957914829254,273.5347900390625,1e-05,0.13014627993106842,3.592344045639038,81.14050197601318,1 +1906,0.2766917645931244,0.5004748106002808,0.49846503138542175,0.26083916425704956,379.11187744140625,1e-05,0.6450809240341187,3.3925399780273438,81.14050197601318,1 +1907,0.23903760313987732,0.21615581214427948,0.23451241850852966,0.1191142201423645,976.69921875,1e-05,0.13289619982242584,2.842869758605957,81.14050197601318,1 +1908,0.17577840387821198,0.25811317563056946,0.27504420280456543,0.16363635659217834,930.488525390625,1e-05,0.14362733066082,3.0731608867645264,81.14050197601318,1 +1909,0.3409917950630188,0.2902229428291321,0.29601845145225525,0.2186480164527893,869.614990234375,1e-05,0.1070663332939148,3.321418285369873,81.14050197601318,1 +1910,0.2019670605659485,0.3495672047138214,0.33385130763053894,0.16363635659217834,906.3938598632812,1e-05,0.14366881549358368,3.1003100872039795,81.14050197601318,1 +1911,0.24905669689178467,0.2163437455892563,0.23292236030101776,0.21724942326545715,761.3585205078125,1e-05,0.14176663756370544,3.455965995788574,81.14050197601318,1 +1912,0.3113144040107727,0.2488563507795334,0.2437828630208969,0.20675989985466003,838.0756225585938,1e-05,0.24060405790805817,3.0743987560272217,81.14050197601318,1 +1913,0.3286285996437073,0.3163807988166809,0.3221377730369568,0.16013985872268677,847.4485473632812,1e-05,0.15762737393379211,2.821622133255005,81.14050197601318,1 +1914,0.2741715610027313,0.2615041732788086,0.2692958116531372,0.2181818187236786,888.9893188476562,1e-05,0.19865605235099792,3.076730728149414,81.14050197601318,1 +1915,0.29202383756637573,0.25314268469810486,0.26626908779144287,0.17855477333068848,847.4485473632812,1e-05,0.16998274624347687,3.013786554336548,81.14050197601318,1 +1916,0.4191398620605469,0.4831046462059021,0.4933077096939087,0.21491841971874237,344.2266540527344,1e-05,0.18430931866168976,3.056809425354004,81.14050197601318,1 +1917,0.14298474788665771,0.20451867580413818,0.21716542541980743,0.1442890465259552,859.223388671875,1e-05,0.12078920006752014,3.3885834217071533,81.14050197601318,1 +1918,0.35313600301742554,0.30754050612449646,0.3161066770553589,0.17832167446613312,948.4158325195312,1e-05,0.13995957374572754,3.086458921432495,81.14050197601318,1 +1919,0.20302440226078033,0.998749315738678,1.0762609243392944,0.17575757205486298,994.27783203125,1e-05,0.19268693029880524,2.8453211784362793,81.14050197601318,1 +1920,0.46598634123802185,0.4410881996154785,0.44588831067085266,0.13729603588581085,437.2454833984375,1e-05,0.12851983308792114,3.134449005126953,81.14050197601318,1 +1921,0.17269647121429443,0.4389022886753082,0.4292313754558563,0.13379953801631927,961.7210693359375,1e-05,0.12266986072063446,3.053565263748169,81.14050197601318,1 +1922,0.1593697965145111,0.3698360323905945,0.37439340353012085,0.16200466454029083,982.4352416992188,1e-05,0.14463624358177185,3.0726778507232666,81.14050197601318,1 +1923,0.199987530708313,0.3147376477718353,0.31991708278656006,0.19230769574642181,928.5856323242188,1e-05,0.12134391069412231,3.481799602508545,81.14050197601318,1 +1924,0.39547860622406006,0.31190910935401917,0.3114233911037445,0.1470862478017807,964.5680541992188,1e-05,0.15542782843112946,3.1034107208251953,81.14050197601318,1 +1925,0.3892357349395752,0.2636069357395172,0.2795707881450653,0.2181818187236786,548.6198120117188,1e-05,0.12178027629852295,2.8261544704437256,81.14050197601318,1 +1926,0.4239851236343384,0.27418890595436096,0.2784893810749054,0.1442890465259552,944.529052734375,1e-05,0.1825406849384308,3.132117509841919,81.14050197601318,1 +1927,0.37862905859947205,0.3501383662223816,0.3692542612552643,0.238228440284729,314.781494140625,1e-05,0.23420098423957825,3.0928702354431152,81.14050197601318,1 +1928,0.2179543673992157,0.29795292019844055,0.2944471836090088,0.23030303418636322,838.6439208984375,1e-05,0.14153510332107544,3.093073844909668,81.14050197601318,1 +1929,0.2466709017753601,0.2097875475883484,0.22222793102264404,0.10396270453929901,943.8261108398438,1e-05,0.1579873412847519,3.45426082611084,81.14050197601318,1 +1930,0.2022992968559265,0.3434842526912689,0.35181188583374023,0.22960372269153595,916.0694580078125,1e-05,0.1610649824142456,3.0614969730377197,81.14050197601318,1 +1931,0.38024428486824036,0.23193342983722687,0.23441313207149506,0.18531468510627747,915.4500122070312,1e-05,0.12420748174190521,2.848217248916626,81.14050197601318,1 +1932,0.2796187400817871,0.2646355628967285,0.2759476602077484,0.26713287830352783,939.4969482421875,1e-05,0.1857677847146988,3.4414937496185303,81.14050197601318,1 +1933,0.14996963739395142,0.2967439591884613,0.2990545928478241,0.20955711603164673,908.3971557617188,1e-05,0.14238671958446503,2.8434970378875732,81.14050197601318,1 +1934,0.30185022950172424,0.6829766631126404,0.7052655816078186,0.16573426127433777,106.90462493896484,1e-05,0.17369255423545837,3.0703508853912354,81.14050197601318,1 +1935,0.24817635118961334,0.34492069482803345,0.3469751477241516,0.22331002354621887,981.6846923828125,1e-05,0.14185552299022675,3.257524013519287,81.14050197601318,1 +1936,0.4837123155593872,0.3117692470550537,0.3099043071269989,0.19393938779830933,909.3855590820312,1e-05,0.15137599408626556,3.083141565322876,81.14050197601318,1 +1937,0.12417496740818024,0.35062992572784424,0.355940043926239,0.2265734225511551,926.0864868164062,1e-05,0.20966024696826935,2.829533338546753,81.14050197601318,1 +1938,0.11107687652111053,0.3637630343437195,0.3640362620353699,0.2449883371591568,997.5022583007812,1e-05,0.1398608684539795,3.306793451309204,81.14050197601318,1 +1939,0.33789098262786865,0.29814666509628296,0.29719632863998413,0.18298368155956268,689.1459350585938,1e-05,0.20816244184970856,2.827958106994629,81.14050197601318,1 +1940,0.39996016025543213,0.3420710861682892,0.3411298990249634,0.2526806592941284,873.2015991210938,1e-05,0.3224228322505951,3.388181447982788,81.14050197601318,1 +1941,0.3061929941177368,0.3954108953475952,0.39029353857040405,0.22470861673355103,932.6204223632812,1e-05,0.16928817331790924,3.036963701248169,81.14050197601318,1 +1942,0.28614237904548645,0.31557777523994446,0.31986185908317566,0.251748263835907,794.2818603515625,1e-05,0.17317964136600494,3.0799007415771484,81.14050197601318,1 +1943,0.3510667681694031,0.23840558528900146,0.23869919776916504,0.11585081368684769,913.2542724609375,1e-05,0.19377876818180084,3.107802391052246,81.14050197601318,1 +1944,0.22644007205963135,0.2553960978984833,0.26231521368026733,0.10885781049728394,955.9364624023438,1e-05,0.10499224066734314,3.336782455444336,81.14050197601318,1 +1945,0.3520195186138153,0.2155347466468811,0.2219230830669403,0.22051282227039337,660.37890625,1e-05,0.13670149445533752,2.8371589183807373,81.14050197601318,1 +1946,0.312901109457016,0.18897387385368347,0.21112549304962158,0.20955711603164673,810.0248413085938,1e-05,0.17708943784236908,3.39650297164917,81.14050197601318,1 +1947,0.3762921690940857,0.24001707136631012,0.24321451783180237,0.09627039730548859,949.5288696289062,1e-05,0.20068944990634918,3.0529890060424805,81.14050197601318,1 +1948,0.1566590964794159,0.46152999997138977,0.4582105576992035,0.12331002205610275,989.8240966796875,1e-05,0.14620546996593475,3.073652982711792,81.14050197601318,1 +1949,0.2985984683036804,0.3298265039920807,0.3347252607345581,0.2554778456687927,932.8836669921875,1e-05,0.15418024361133575,3.0206708908081055,81.14050197601318,1 +1950,0.29986903071403503,0.3891857862472534,0.3833559453487396,0.19393938779830933,437.2454833984375,1e-05,0.14460356533527374,3.0805881023406982,81.14050197601318,1 +1951,0.1380554735660553,0.24609068036079407,0.2572757601737976,0.18391607701778412,968.3995361328125,1e-05,0.1632399559020996,2.8551714420318604,81.14050197601318,1 +1952,0.2633897364139557,0.2019139677286148,0.21763575077056885,0.24382284283638,915.7601928710938,1e-05,0.12844301760196686,3.417806386947632,81.14050197601318,1 +1953,0.25869396328926086,0.27046868205070496,0.27446448802948,0.16363635659217834,895.8192749023438,1e-05,0.13600674271583557,2.832094192504883,81.14050197601318,1 +1954,0.322404682636261,0.18252798914909363,0.20766094326972961,0.2002331018447876,753.992919921875,1e-05,0.27174171805381775,3.0751941204071045,81.14050197601318,1 +1955,0.3147970736026764,0.4739232659339905,0.4746949076652527,0.2813519835472107,991.1632080078125,1e-05,0.14781002700328827,3.0741593837738037,81.14050197601318,1 +1956,0.28560417890548706,0.27661508321762085,0.29291534423828125,0.1934731900691986,940.7190551757812,1e-05,1.847951889038086,3.0853993892669678,81.14050197601318,1 +1957,0.642042875289917,0.30447623133659363,0.3084612190723419,0.22214451432228088,716.8931274414062,1e-05,0.3484874665737152,2.8336479663848877,81.14050197601318,1 +1958,0.20901259779930115,0.3286761939525604,0.3317497968673706,0.25687646865844727,782.640625,1e-05,0.1366228461265564,3.394246816635132,81.14050197601318,1 +1959,0.29782921075820923,0.3300791382789612,0.34492433071136475,0.1107226088643074,518.1495361328125,1e-05,0.12722249329090118,2.8382558822631836,81.14050197601318,1 +1960,0.27072781324386597,0.7452768087387085,0.7498359680175781,0.21631701290607452,120.44096374511719,1e-05,0.14958304166793823,3.100679636001587,81.14050197601318,1 +1961,0.1838289499282837,0.4007039964199066,0.4072815179824829,0.15850815176963806,950.8469848632812,1e-05,0.1779230535030365,3.3117690086364746,81.14050197601318,1 +1962,0.3867665231227875,0.29694250226020813,0.30561891198158264,0.2114219069480896,811.3840942382812,1e-05,0.1497408151626587,3.1467812061309814,81.14050197601318,1 +1963,0.40427109599113464,0.27148929238319397,0.2894490957260132,0.17529137432575226,952.789306640625,1e-05,0.16583876311779022,3.0718319416046143,81.14050197601318,1 +1964,0.3183329701423645,0.25904765725135803,0.27632978558540344,0.2365967333316803,677.2564697265625,1e-05,0.6718701124191284,3.165552854537964,81.14050197601318,1 +1965,0.2807787358760834,0.29841557145118713,0.3283540606498718,0.2310023307800293,996.5260620117188,1e-05,0.4593309462070465,3.0754432678222656,81.14050197601318,1 +1966,0.2416074275970459,0.2734379768371582,0.2771422863006592,0.1918414980173111,866.3948974609375,1e-05,0.16027279198169708,2.846437454223633,81.14050197601318,1 +1967,0.10273271054029465,0.3050634264945984,0.3022080063819885,0.2242424190044403,869.614990234375,1e-05,0.14361487329006195,3.3830556869506836,81.14050197601318,1 +1968,0.317596435546875,0.2237936109304428,0.24636344611644745,0.21958041191101074,859.7134399414062,1e-05,0.12762749195098877,2.8388290405273438,81.14050197601318,1 +1969,0.30258727073669434,0.25310009717941284,0.2637813687324524,0.2293706238269806,931.025634765625,1e-05,0.1557030826807022,3.3958535194396973,81.14050197601318,1 +1970,0.2061559110879898,0.3602215051651001,0.3535367250442505,0.26923078298568726,975.2377319335938,1e-05,0.18435817956924438,3.139068841934204,81.14050197601318,1 +1971,0.4008916914463043,0.21575872600078583,0.2488260120153427,0.238228440284729,572.1419677734375,1e-05,0.1408940702676773,3.0613861083984375,81.14050197601318,1 +1972,0.28536736965179443,0.31124135851860046,0.3175464868545532,0.16363635659217834,941.926025390625,1e-05,0.18119050562381744,3.020876169204712,81.14050197601318,1 +1973,0.20254388451576233,0.24822869896888733,0.2589227855205536,0.2214452177286148,870.5208129882812,1e-05,0.12898026406764984,3.1044607162475586,81.14050197601318,1 +1974,0.38772833347320557,0.3604435324668884,0.37412235140800476,0.07738927751779556,248.77369689941406,1e-05,0.16646301746368408,2.8353068828582764,81.14050197601318,1 +1975,0.291230171918869,0.28284814953804016,0.2884860932826996,0.23006993532180786,938.5079956054688,1e-05,0.13558168709278107,3.0580055713653564,81.14050197601318,1 +1976,0.26018574833869934,0.2033858597278595,0.22807151079177856,0.25920745730400085,800.1805419921875,1e-05,0.1434543877840042,3.1605329513549805,81.14050197601318,1 +1977,0.4920923113822937,0.31029123067855835,0.3151847720146179,0.2282051295042038,550.8392333984375,1e-05,0.12240966409444809,3.1018755435943604,81.14050197601318,1 +1978,0.24789078533649445,0.2680571675300598,0.28878316283226013,0.24009324610233307,639.041015625,1e-05,0.18080130219459534,3.047584295272827,81.14050197601318,1 +1979,0.32310718297958374,0.3619340658187866,0.35949578881263733,0.14335663616657257,967.5030517578125,1e-05,0.2565110921859741,3.103564500808716,81.14050197601318,1 +1980,0.20751115679740906,0.3259226381778717,0.3387869894504547,0.22867132723331451,674.5276489257812,1e-05,0.12927299737930298,2.8362090587615967,81.14050197601318,1 +1981,0.3067311644554138,0.3308165669441223,0.33333781361579895,0.20909090340137482,986.6468505859375,1e-05,1.556488037109375,3.498013734817505,81.14050197601318,1 +1982,0.14931383728981018,0.22049090266227722,0.22015702724456787,0.15967366099357605,909.0570068359375,1e-05,0.12101048231124878,3.0177223682403564,81.14050197601318,1 +1983,0.46503114700317383,0.4251253008842468,0.43106549978256226,0.2310023307800293,397.1928405761719,1e-05,0.4701041579246521,3.049630880355835,81.14050197601318,1 +1984,0.17170216143131256,0.28790757060050964,0.28231948614120483,0.2097902148962021,968.0419921875,1e-05,0.11317875981330872,3.035501480102539,81.14050197601318,1 +1985,0.25134068727493286,0.21877539157867432,0.2397199124097824,0.21958041191101074,852.6897583007812,1e-05,0.13370531797409058,3.3368895053863525,81.14050197601318,1 +1986,0.22935102880001068,0.25154075026512146,0.2621755003929138,0.2265734225511551,772.7371215820312,1e-05,0.21555903553962708,2.836679697036743,81.14050197601318,1 +1987,0.2984602749347687,0.27551499009132385,0.28654393553733826,0.23356643319129944,646.8789672851562,1e-05,0.2641947865486145,3.5200002193450928,81.14050197601318,1 +1988,0.29841047525405884,0.34377071261405945,0.33788272738456726,0.2226107269525528,835.2010498046875,1e-05,0.12717129290103912,3.326436996459961,81.14050197601318,1 +1989,0.37878817319869995,0.26192760467529297,0.2971937954425812,0.17855477333068848,928.03564453125,1e-05,0.13371269404888153,2.8470420837402344,81.14050197601318,1 +1990,0.1885378211736679,0.2819146513938904,0.29505932331085205,0.1918414980173111,920.9009399414062,1e-05,0.12779757380485535,3.0214498043060303,81.14050197601318,1 +1991,0.22786331176757812,0.31261324882507324,0.3421877324581146,0.14498834311962128,278.3217468261719,1e-05,0.14708556234836578,3.1210148334503174,81.14050197601318,1 +1992,0.2661968767642975,0.29279065132141113,0.3037313222885132,0.19766899943351746,978.9199829101562,1e-05,0.15351229906082153,3.056804895401001,81.14050197601318,1 +1993,0.2596929371356964,0.2600248157978058,0.2571752369403839,0.15407925844192505,945.226806640625,1e-05,0.1636822521686554,3.2687597274780273,81.14050197601318,1 +1994,0.3209467828273773,0.2999604344367981,0.30150464177131653,0.24405594170093536,940.2321166992188,1e-05,0.17521639168262482,3.2431347370147705,81.14050197601318,1 +1995,0.17676645517349243,0.2684946060180664,0.2701902389526367,0.2482517510652542,872.3140258789062,1e-05,0.1327706128358841,2.833676338195801,81.14050197601318,1 +1996,0.2466934472322464,0.17597003281116486,0.19157512485980988,0.16130536794662476,887.812744140625,1e-05,0.1780814826488495,3.0767040252685547,81.14050197601318,1 +1997,0.20475703477859497,0.2695282995700836,0.27649691700935364,0.15734265744686127,927.2047729492188,1e-05,0.16020062565803528,3.088253974914551,81.14050197601318,1 +1998,0.3962126076221466,0.4065774977207184,0.41839054226875305,0.2745920717716217,393.64630126953125,1e-05,0.12799471616744995,3.079127550125122,81.14050197601318,1 +1999,0.2946544885635376,0.2771155834197998,0.27896660566329956,0.2377622425556183,807.27197265625,1e-05,0.11824444681406021,3.0745882987976074,81.14050197601318,1 +2000,0.2519696056842804,0.39042311906814575,0.38257071375846863,0.24009324610233307,976.3768310546875,1e-05,0.11980723589658737,3.3422389030456543,81.14050197601318,1 +2001,0.5636950731277466,0.19149646162986755,0.1975896954536438,0.2510489523410797,814.068359375,1e-05,0.2081078290939331,2.8315720558166504,81.14050197601318,1 +2002,0.29773202538490295,0.3566191792488098,0.35375651717185974,0.24428904056549072,968.3995361328125,1e-05,0.1797637939453125,3.2700397968292236,81.14050197601318,1 +2003,0.20958226919174194,0.35782384872436523,0.3634873628616333,0.214685320854187,976.3768310546875,1e-05,0.23998518288135529,2.827570915222168,81.14050197601318,1 +2004,0.46147972345352173,0.3813004195690155,0.39025673270225525,0.08741258829832077,386.44976806640625,1e-05,18.898235321044922,3.10089111328125,81.14050197601318,1 +2005,0.30420249700546265,0.24599793553352356,0.2665238380432129,0.26270395517349243,987.2093505859375,1e-05,0.18442939221858978,3.15354585647583,81.14050197601318,1 +2006,0.36771029233932495,0.4733300805091858,0.4849834740161896,0.2293706238269806,227.91456604003906,1e-05,0.16461580991744995,3.058826208114624,81.14050197601318,1 +2007,0.27452993392944336,0.2526229918003082,0.26032117009162903,0.2354312390089035,890.5407104492188,1e-05,0.11698747426271439,2.8354761600494385,81.14050197601318,1 +2008,0.38291335105895996,0.31377431750297546,0.31892669200897217,0.2214452177286148,886.226318359375,1e-05,0.16400198638439178,3.3176047801971436,81.14050197601318,1 +2009,0.24553005397319794,0.4898442029953003,0.4853809177875519,0.2650349736213684,979.6979370117188,1e-05,0.2024020254611969,2.8436431884765625,81.14050197601318,1 +2010,0.30650007724761963,0.1992395520210266,0.21024978160858154,0.214685320854187,877.1219482421875,1e-05,0.6607810854911804,3.1422910690307617,81.14050197601318,1 +2011,0.22194375097751617,0.3787592947483063,0.37835052609443665,0.2512820363044739,944.0609741210938,1e-05,0.15505607426166534,3.2491605281829834,81.14050197601318,1 +2012,0.12090639770030975,0.33917760848999023,0.34916695952415466,0.18298368155956268,929.405517578125,1e-05,0.09718557447195053,3.035114049911499,81.14050197601318,1 +2013,0.41842737793922424,0.30070799589157104,0.29694846272468567,0.21888111531734467,781.0278930664062,1e-05,0.15186473727226257,2.8306093215942383,81.14050197601318,1 +2014,0.11378463357686996,0.310361385345459,0.30902618169784546,0.20629370212554932,949.9702758789062,1e-05,0.16676932573318481,3.1508634090423584,81.14050197601318,1 +2015,0.4322616159915924,0.29380473494529724,0.2997117042541504,0.21048951148986816,927.7593383789062,1e-05,0.18036165833473206,3.0598130226135254,81.14050197601318,1 +2016,0.30230969190597534,0.21181833744049072,0.24055887758731842,0.2282051295042038,821.2252807617188,1e-05,0.12153568863868713,2.822681427001953,81.14050197601318,1 +2017,0.3257676362991333,0.49790331721305847,0.49712198972702026,0.04545454680919647,287.737548828125,1e-05,0.169691801071167,3.17073130607605,81.14050197601318,1 +2018,0.25080785155296326,0.3729636073112488,0.3683911859989166,0.1878787875175476,664.7142333984375,1e-05,0.10713588446378708,3.054180860519409,81.14050197601318,1 +2019,0.2663026452064514,0.2750992774963379,0.286093533039093,0.22750583291053772,839.7739868164062,1e-05,0.21538931131362915,2.8430874347686768,81.14050197601318,1 +2020,0.1797090768814087,0.2258538007736206,0.2317637801170349,0.21631701290607452,674.5276489257812,1e-05,0.1620129495859146,3.1339287757873535,81.14050197601318,1 +2021,0.19143927097320557,0.3058837950229645,0.318324476480484,0.139860138297081,846.3767700195312,1e-05,0.1279423087835312,3.1135430335998535,81.14050197601318,1 +2022,0.2178546041250229,0.3580329716205597,0.36640802025794983,0.2181818187236786,969.8138427734375,1e-05,0.12717194855213165,2.840251922607422,81.14050197601318,1 +2023,0.24578410387039185,0.38531607389450073,0.38682058453559875,0.2158508151769638,988.4596557617188,1e-05,0.24492080509662628,3.1773040294647217,81.14050197601318,1 +2024,0.5348010659217834,0.47338199615478516,0.49292925000190735,0.21072261035442352,222.54527282714844,1e-05,0.15309584140777588,3.1115007400512695,81.14050197601318,1 +2025,0.23617030680179596,0.23301005363464355,0.23759709298610687,0.18997669219970703,886.226318359375,1e-05,0.16263429820537567,3.125364303588867,81.14050197601318,1 +2026,0.2587175667285919,0.25236839056015015,0.26060616970062256,0.2181818187236786,812.7318115234375,1e-05,0.13453933596611023,3.0688908100128174,81.14050197601318,1 +2027,0.36852002143859863,0.35649609565734863,0.36075666546821594,0.09300699084997177,991.69189453125,1e-05,0.13181394338607788,3.0717828273773193,81.14050197601318,1 +2028,0.48440220952033997,0.336750864982605,0.3548601567745209,0.17132866382598877,443.50128173828125,1e-05,0.1904226690530777,2.8382322788238525,81.14050197601318,1 +2029,0.33621853590011597,0.28968530893325806,0.2907469868659973,0.11818181723356247,957.3680419921875,1e-05,0.12554404139518738,3.4664571285247803,81.14050197601318,1 +2030,0.44084709882736206,0.5135483741760254,0.5099855661392212,0.20326340198516846,305.9609069824219,1e-05,0.1283995658159256,2.831549644470215,81.14050197601318,1 +2031,0.17862781882286072,0.38846129179000854,0.4011532664299011,0.08578088879585266,283.0556640625,1e-05,0.47628462314605713,3.634593963623047,81.14050197601318,1 +2032,0.24761058390140533,0.23566365242004395,0.24841102957725525,0.2209790199995041,925.8049926757812,1e-05,0.13915997743606567,3.117703914642334,81.14050197601318,1 +2033,0.31731507182121277,0.809813380241394,0.8077133893966675,0.23333333432674408,100.0000228881836,1e-05,0.11652140319347382,3.113006114959717,81.14050197601318,1 +2034,0.34247058629989624,0.3645904064178467,0.3793666362762451,0.1678321659564972,348.26116943359375,1e-05,0.1425788402557373,3.062375783920288,81.14050197601318,1 +2035,0.09949624538421631,0.1724781095981598,0.20217345654964447,0.2466200441122055,818.6600952148438,1e-05,0.11946948617696762,3.4416565895080566,81.14050197601318,1 +2036,0.3224354684352875,0.27278468012809753,0.27892547845840454,0.20792540907859802,541.85888671875,1e-05,0.17432625591754913,2.8484630584716797,81.14050197601318,1 +2037,0.341633141040802,0.23411531746387482,0.2505227029323578,0.2102564126253128,677.2564697265625,1e-05,0.14205922186374664,3.079481601715088,81.14050197601318,1 +2038,0.29235756397247314,0.39821135997772217,0.41291406750679016,0.25244754552841187,954.271728515625,1e-05,0.1488441526889801,3.3610944747924805,81.14050197601318,1 +2039,0.2675133943557739,0.2635861933231354,0.26480767130851746,0.15058274567127228,800.1805419921875,1e-05,0.5412546396255493,2.8451831340789795,81.14050197601318,1 +2040,0.5117868185043335,0.5189942717552185,0.5116716027259827,0.2242424190044403,171.19692993164062,1e-05,0.23910729587078094,3.1106650829315186,81.14050197601318,1 +2041,0.1512887179851532,0.27159973978996277,0.2734673321247101,0.24032634496688843,980.7741088867188,1e-05,0.10898714512586594,3.287815809249878,81.14050197601318,1 +2042,0.22890610992908478,0.24739037454128265,0.26695331931114197,0.2214452177286148,964.940673828125,1e-05,0.16851365566253662,2.8324790000915527,81.14050197601318,1 +2043,0.49875593185424805,0.2938987910747528,0.29066795110702515,0.14242424070835114,958.576904296875,1e-05,0.1359482705593109,3.1110095977783203,81.14050197601318,1 +2044,0.23861153423786163,0.3210624158382416,0.33415576815605164,0.16876456141471863,955.9364624023438,1e-05,0.10053979605436325,3.3608195781707764,81.14050197601318,1 +2045,0.33242136240005493,0.2209150493144989,0.22161753475666046,0.16596736013889313,945.9192504882812,1e-05,0.1508246511220932,2.8326163291931152,81.14050197601318,1 +2046,0.15122391283512115,0.2476641982793808,0.26275932788848877,0.18717949092388153,999.0592651367188,1e-05,0.20338337123394012,3.4197278022766113,81.14050197601318,1 +2047,0.12322656810283661,0.23259040713310242,0.24290962517261505,0.17202797532081604,964.940673828125,1e-05,0.1122315376996994,3.223494291305542,81.14050197601318,1 +2048,0.19604025781154633,0.20777124166488647,0.22921544313430786,0.22284382581710815,939.2506103515625,1e-05,0.16515009105205536,2.8516571521759033,81.14050197601318,1 +2049,0.3897489905357361,0.5299411416053772,0.5366100072860718,0.18648017942905426,263.79840087890625,1e-05,0.1206994503736496,3.323274850845337,81.14050197601318,1 +2050,0.22418132424354553,0.20820210874080658,0.22418108582496643,0.2638694643974304,983.3262329101562,1e-05,0.17407530546188354,3.3830363750457764,81.14050197601318,1 +2051,0.4345969259738922,0.2613241374492645,0.2660396099090576,0.17925408482551575,825.6151733398438,1e-05,0.15341545641422272,2.8515424728393555,81.14050197601318,1 +2052,0.35948827862739563,0.3201374411582947,0.32476502656936646,0.22214451432228088,996.4030151367188,1e-05,0.19402733445167542,3.4403278827667236,81.14050197601318,1 +2053,0.18096552789211273,0.21395611763000488,0.21942201256752014,0.11864801496267319,816.0525512695312,1e-05,0.18015503883361816,3.273111581802368,81.14050197601318,1 +2054,0.4054660201072693,0.2546835243701935,0.26223093271255493,0.19230769574642181,624.2781982421875,1e-05,0.13381800055503845,3.0428054332733154,81.14050197601318,1 +2055,0.13826264441013336,0.26647770404815674,0.26850414276123047,0.24848484992980957,926.6471557617188,1e-05,0.42550691962242126,3.0734379291534424,81.14050197601318,1 +2056,0.2272729128599167,0.45906856656074524,0.47091343998908997,0.22960372269153595,278.3217468261719,1e-05,0.14654743671417236,3.3610475063323975,81.14050197601318,1 +2057,0.42124927043914795,0.29247862100601196,0.30144548416137695,0.19370628893375397,869.15966796875,1e-05,0.1730535924434662,2.8277432918548584,81.14050197601318,1 +2058,0.10794134438037872,0.25165605545043945,0.25566717982292175,0.2142191082239151,906.0565185546875,1e-05,0.14641985297203064,3.1131856441497803,81.14050197601318,1 +2059,0.21468724310398102,0.25809478759765625,0.26792341470718384,0.21398600935935974,825.6151733398438,1e-05,0.14701303839683533,3.114408493041992,81.14050197601318,1 +2060,0.4425441324710846,0.29897788166999817,0.3065347969532013,0.21235431730747223,821.8599853515625,1e-05,0.15526437759399414,3.041985034942627,81.14050197601318,1 +2061,0.101563960313797,0.23266534507274628,0.2595655918121338,0.22494173049926758,914.2007446289062,1e-05,0.16452442109584808,3.10603666305542,81.14050197601318,1 +2062,0.2783442735671997,0.35803085565567017,0.36558762192726135,0.2041957974433899,975.4014282226562,1e-05,0.14792294800281525,3.07751202583313,81.14050197601318,1 +2063,0.15718287229537964,0.2730405628681183,0.29124924540519714,0.18298368155956268,991.1632080078125,1e-05,0.13885623216629028,3.123833417892456,81.14050197601318,1 +2064,0.3854566216468811,0.24464651942253113,0.24641892313957214,0.2242424190044403,874.9585571289062,1e-05,0.145499587059021,3.123929262161255,81.14050197601318,1 +2065,0.47055280208587646,0.28919705748558044,0.28133079409599304,0.18205128610134125,781.836181640625,1e-05,7.288308620452881,3.0562236309051514,81.14050197601318,1 +2066,0.15032552182674408,0.52171790599823,0.5112411379814148,0.2242424190044403,982.4352416992188,1e-05,0.1702699214220047,3.01961088180542,81.14050197601318,1 +2067,0.19374942779541016,0.26961803436279297,0.27995195984840393,0.15874126553535461,966.9605712890625,1e-05,0.15570363402366638,3.1537861824035645,81.14050197601318,1 +2068,0.31916913390159607,0.3022022247314453,0.31624671816825867,0.17412588000297546,972.4016723632812,1e-05,0.10026422888040543,3.1124942302703857,81.14050197601318,1 +2069,0.29869914054870605,0.24875016510486603,0.2599217891693115,0.11538461595773697,878.402587890625,1e-05,0.14349757134914398,3.0742616653442383,81.14050197601318,1 +2070,0.2710583508014679,0.2849999666213989,0.2944417893886566,0.19650349020957947,696.7341918945312,1e-05,0.14777135848999023,3.336449146270752,81.14050197601318,1 +2071,0.4222254455089569,0.32864001393318176,0.33622580766677856,0.2209790199995041,651.463623046875,1e-05,0.1287027895450592,3.0385968685150146,81.14050197601318,1 +2072,0.17419582605361938,0.2632797956466675,0.26583608984947205,0.1258741319179535,948.4158325195312,1e-05,0.12260949611663818,3.0322751998901367,81.14050197601318,1 +2073,0.4034009277820587,0.38583749532699585,0.39459463953971863,0.2710955739021301,546.3833618164062,1e-05,0.14961788058280945,3.09108829498291,81.14050197601318,1 +2074,0.3660600185394287,0.368643581867218,0.3613271117210388,0.16923077404499054,985.0772094726562,1e-05,0.12970535457134247,3.127552032470703,81.14050197601318,1 +2075,0.18720169365406036,0.3075251281261444,0.321162611246109,0.25034964084625244,904.0114135742188,1e-05,0.11546953022480011,3.088120460510254,81.14050197601318,1 +2076,0.38937726616859436,0.3215523064136505,0.3354460597038269,0.20606060326099396,865.928466796875,1e-05,0.16012705862522125,3.3078176975250244,81.14050197601318,1 +2077,0.29004770517349243,0.1881449967622757,0.20263509452342987,0.20233100652694702,786.6087036132812,1e-05,0.13205814361572266,3.06514310836792,81.14050197601318,1 +2078,0.16687335073947906,0.2694867253303528,0.2715391218662262,0.21282051503658295,878.402587890625,1e-05,0.12688736617565155,3.0438790321350098,81.14050197601318,1 +2079,0.19404089450836182,0.28680312633514404,0.30543893575668335,0.22331002354621887,998.5840454101562,1e-05,0.12189113348722458,3.138782262802124,81.14050197601318,1 +2080,0.4504847526550293,0.2380097359418869,0.2539985477924347,0.20815850794315338,966.9605712890625,1e-05,0.1547814905643463,3.096233367919922,81.14050197601318,1 +2081,0.3593209981918335,0.2823069393634796,0.28792646527290344,0.13939394056797028,352.25469970703125,1e-05,0.1449112892150879,3.1470906734466553,81.14050197601318,1 +2082,0.43087729811668396,0.2900874614715576,0.29919734597206116,0.24638694524765015,652.9728393554688,1e-05,0.12514527142047882,3.311330556869507,81.14050197601318,1 +2083,0.2465454638004303,0.2522851228713989,0.26366952061653137,0.23706293106079102,850.6163940429688,1e-05,0.18347704410552979,3.0913522243499756,81.14050197601318,1 +2084,0.24181008338928223,0.2289627641439438,0.2427777349948883,0.28205129504203796,758.630126953125,1e-05,0.15474873781204224,3.178426504135132,81.14050197601318,1 +2085,0.5279415249824524,0.2603507339954376,0.27598080039024353,0.2405594438314438,913.2542724609375,1e-05,0.1744776964187622,2.8319222927093506,81.14050197601318,1 +2086,0.24703150987625122,0.30209115147590637,0.31121280789375305,0.2421911358833313,836.3575439453125,1e-05,1.3573375940322876,3.110375165939331,81.14050197601318,1 +2087,0.36057525873184204,0.13532184064388275,0.1496993899345398,0.10675990581512451,925.2398681640625,1e-05,0.2150530070066452,3.050727367401123,81.14050197601318,1 +2088,0.4160732626914978,0.36242395639419556,0.3609665334224701,0.16317015886306763,787.3915405273438,1e-05,0.13095766305923462,3.3954315185546875,81.14050197601318,1 +2089,0.2623342275619507,0.23180435597896576,0.2559462785720825,0.12377621978521347,964.5680541992188,1e-05,0.1412384808063507,2.838865280151367,81.14050197601318,1 +2090,0.2735864818096161,0.26352038979530334,0.2692001760005951,0.17179487645626068,935.22314453125,1e-05,0.16646301746368408,3.1681294441223145,81.14050197601318,1 +2091,0.23309047520160675,0.28277868032455444,0.2849005460739136,0.08601398766040802,934.7079467773438,1e-05,0.1192287802696228,3.0573549270629883,81.14050197601318,1 +2092,0.3780750036239624,0.28516167402267456,0.2858850061893463,0.0139860138297081,935.22314453125,1e-05,0.13888667523860931,2.837615489959717,81.14050197601318,1 +2093,0.48745736479759216,0.41571933031082153,0.41712382435798645,0.19510489702224731,348.26116943359375,1e-05,0.13736870884895325,3.389948606491089,81.14050197601318,1 +2094,0.316406786441803,0.3400232791900635,0.35703614354133606,0.27762237191200256,851.1375732421875,1e-05,0.14631956815719604,3.3430261611938477,81.14050197601318,1 +2095,0.21072840690612793,0.20909474790096283,0.22420622408390045,0.11888112127780914,931.826171875,1e-05,0.2390156388282776,2.8395137786865234,81.14050197601318,1 +2096,0.20627951622009277,0.3172292113304138,0.323361873626709,0.12773892283439636,961.9138793945312,1e-05,0.13396604359149933,3.2983357906341553,81.14050197601318,1 +2097,0.3376199007034302,0.29214826226234436,0.29561030864715576,0.260606050491333,847.4485473632812,1e-05,0.10627902299165726,3.0723750591278076,81.14050197601318,1 +2098,0.28773757815361023,0.2569151818752289,0.2800026535987854,0.23076923191547394,683.93896484375,1e-05,0.21211466193199158,2.829601764678955,81.14050197601318,1 +2099,0.28268611431121826,0.21898649632930756,0.24282050132751465,0.22867132723331451,874.0830688476562,1e-05,0.14715270698070526,3.351111888885498,81.14050197601318,1 +2100,0.21040382981300354,0.16692475974559784,0.1929166167974472,0.1934731900691986,843.6619262695312,1e-05,0.17783887684345245,3.3652868270874023,81.14050197601318,1 +2101,0.24238049983978271,0.33160778880119324,0.3404759168624878,0.21678321063518524,984.4981079101562,1e-05,0.1112121194601059,2.834594964981079,81.14050197601318,1 +2102,0.4811975359916687,0.2026059478521347,0.20661020278930664,0.16899767518043518,818.6600952148438,1e-05,0.16616889834403992,3.357168197631836,81.14050197601318,1 +2103,0.3855797052383423,0.4389098882675171,0.46658945083618164,0.19114218652248383,248.77369689941406,1e-05,0.21446043252944946,3.105388879776001,81.14050197601318,1 +2104,0.2146078199148178,0.1845361292362213,0.19644321501255035,0.1370629370212555,901.5783081054688,1e-05,0.2598091959953308,2.8439486026763916,81.14050197601318,1 +2105,0.2579595744609833,0.32909807562828064,0.3309946358203888,0.17482517659664154,944.2952880859375,1e-05,0.1306702345609665,3.3655991554260254,81.14050197601318,1 +2106,0.4038686752319336,0.34639161825180054,0.3492749333381653,0.22564102709293365,988.734619140625,1e-05,0.19997267425060272,3.018950939178467,81.14050197601318,1 +2107,0.4202571511268616,0.2505842447280884,0.25632596015930176,0.21212121844291687,917.6026611328125,1e-05,0.16409184038639069,2.8303463459014893,81.14050197601318,1 +2108,0.2653355598449707,0.2985031306743622,0.27992427349090576,0.20559440553188324,857.74267578125,1e-05,0.13435257971286774,3.1282272338867188,81.14050197601318,1 +2109,0.2846730947494507,0.4022098481655121,0.4150858521461487,0.2750582695007324,972.231689453125,1e-05,0.1538751721382141,3.0650758743286133,81.14050197601318,1 +2110,0.3946720361709595,0.33179280161857605,0.3301961123943329,0.11864801496267319,523.0420532226562,1e-05,0.17157931625843048,2.82710862159729,81.14050197601318,1 +2111,0.4759005904197693,0.6206148862838745,0.6190827488899231,0.23286713659763336,217.11199951171875,1e-05,0.15024259686470032,3.0819101333618164,81.14050197601318,1 +2112,0.23636725544929504,0.3149333596229553,0.32254844903945923,0.16689977049827576,882.5809936523438,1e-05,0.11532905697822571,3.054034948348999,81.14050197601318,1 +2113,0.15385329723358154,0.22958029806613922,0.248925119638443,0.24988344311714172,850.6163940429688,1e-05,0.10594692081212997,3.0489354133605957,81.14050197601318,1 +2114,0.20107480883598328,0.37452659010887146,0.39868414402008057,0.18531468510627747,970.6856079101562,1e-05,0.14112845063209534,3.0570147037506104,81.14050197601318,1 +2115,0.20931662619113922,0.21458932757377625,0.23522190749645233,0.17575757205486298,959.7694091796875,1e-05,0.12064224481582642,3.128221273422241,81.14050197601318,1 +2116,0.22384032607078552,0.36167144775390625,0.3772309422492981,0.2125874161720276,348.26116943359375,1e-05,0.11303573101758957,3.1165859699249268,81.14050197601318,1 +2117,0.22763776779174805,0.22057561576366425,0.23629030585289001,0.13916084170341492,916.3778686523438,1e-05,0.5475250482559204,3.2953224182128906,81.14050197601318,1 +2118,0.2960189878940582,0.38302797079086304,0.4031658172607422,0.23473192751407623,390.0654296875,1e-05,0.2023918181657791,3.0538508892059326,81.14050197601318,1 +2119,0.2874827980995178,0.32041454315185547,0.3269035518169403,0.25314685702323914,871.8681030273438,1e-05,0.1428222358226776,3.150212526321411,81.14050197601318,1 +2120,0.3009997308254242,0.2694169282913208,0.30678650736808777,0.26247087121009827,967.6831665039062,1e-05,0.2734636068344116,3.353337287902832,81.14050197601318,1 +2121,0.1642240285873413,0.174445241689682,0.19034697115421295,0.2270396202802658,988.5972900390625,1e-05,0.10048095136880875,2.8343698978424072,81.14050197601318,1 +2122,0.25536030530929565,0.39424291253089905,0.40298908948898315,0.17039626836776733,999.53125,1e-05,0.1457636058330536,3.1280603408813477,81.14050197601318,1 +2123,0.2528761625289917,0.31431254744529724,0.31210681796073914,0.17692308127880096,926.6471557617188,1e-05,0.1894914209842682,3.0216915607452393,81.14050197601318,1 +2124,0.33813756704330444,0.408378928899765,0.41179391741752625,0.17599067091941833,393.64630126953125,1e-05,0.11445978283882141,3.0447723865509033,81.14050197601318,1 +2125,0.2578156590461731,0.3709016740322113,0.3619511127471924,0.1818181872367859,894.70751953125,1e-05,0.5045891404151917,3.351500988006592,81.14050197601318,1 +2126,0.30955055356025696,0.23441658914089203,0.2472456991672516,0.25081583857536316,821.8599853515625,1e-05,0.14424268901348114,3.1395204067230225,81.14050197601318,1 +2127,0.4365772008895874,0.23707985877990723,0.2448285073041916,0.1934731900691986,681.2896118164062,1e-05,0.1597214937210083,2.8329617977142334,81.14050197601318,1 +2128,0.355452299118042,0.2780040502548218,0.2792447507381439,0.19207459688186646,771.8865966796875,1e-05,0.1928381323814392,3.128870964050293,81.14050197601318,1 +2129,0.42446160316467285,0.43389832973480225,0.42832183837890625,0.24871794879436493,980.0068969726562,1e-05,0.16447405517101288,3.033212423324585,81.14050197601318,1 +2130,0.3783114552497864,0.35711637139320374,0.3685728907585144,0.26247087121009827,998.2254028320312,1e-05,0.13044852018356323,3.012856960296631,81.14050197601318,1 +2131,0.3250461518764496,0.2492394596338272,0.2567060589790344,0.1375291347503662,763.1554565429688,1e-05,0.1455059051513672,3.348381519317627,81.14050197601318,1 +2132,0.23803958296775818,0.23212407529354095,0.23550951480865479,0.18881118297576904,903.6668701171875,1e-05,0.18666425347328186,3.062988758087158,81.14050197601318,1 +2133,0.2851170599460602,0.3662263751029968,0.3616243898868561,0.1934731900691986,750.1998901367188,1e-05,0.724406361579895,2.8614470958709717,81.14050197601318,1 +2134,0.19550354778766632,0.2565207779407501,0.27137288451194763,0.1734265685081482,872.3140258789062,1e-05,0.20492281019687653,3.3669779300689697,81.14050197601318,1 +2135,0.44645267724990845,0.17773041129112244,0.20305420458316803,0.2745920717716217,797.257080078125,1e-05,0.16215218603610992,3.0802462100982666,81.14050197601318,1 +2136,0.19435875117778778,0.3953242301940918,0.386651873588562,0.21608391404151917,973.9156494140625,1e-05,0.1171652227640152,3.047544479370117,81.14050197601318,1 +2137,0.3224601447582245,0.36308279633522034,0.37896493077278137,0.24172493815422058,991.69189453125,1e-05,0.3632246255874634,3.4644668102264404,81.14050197601318,1 +2138,0.49569639563560486,0.20992836356163025,0.2097187042236328,0.053613051772117615,848.5123291015625,1e-05,0.13460898399353027,3.0828843116760254,81.14050197601318,1 +2139,0.18044376373291016,0.2760825753211975,0.2966563105583191,0.25244754552841187,427.6461486816406,1e-05,0.12083558738231659,2.8364973068237305,81.14050197601318,1 +2140,0.12251074612140656,0.3197733759880066,0.3185098171234131,0.1878787875175476,939.0036010742188,1e-05,0.1408405303955078,3.418081521987915,81.14050197601318,1 +2141,0.22700706124305725,0.5962912440299988,0.5984655022621155,0.2186480164527893,158.9905548095703,1e-05,0.22645136713981628,3.038639783859253,81.14050197601318,1 +2142,0.30725255608558655,0.23219998180866241,0.24497944116592407,0.20256410539150238,951.0648803710938,1e-05,0.11900205165147781,3.276033639907837,81.14050197601318,1 +2143,0.23763516545295715,0.19423379004001617,0.21644537150859833,0.2652680575847626,714.6185302734375,1e-05,0.12054291367530823,3.3637514114379883,81.14050197601318,1 +2144,0.2956596612930298,0.25243401527404785,0.2596924901008606,0.15571095049381256,695.4873657226562,1e-05,0.13649027049541473,2.8408093452453613,81.14050197601318,1 +2145,0.2819660007953644,0.32820820808410645,0.33054423332214355,0.23240093886852264,846.3767700195312,1e-05,0.1197560653090477,3.172612428665161,81.14050197601318,1 +2146,0.30686190724372864,0.26569288969039917,0.28127673268318176,0.23123542964458466,976.5382080078125,1e-05,0.15770402550697327,3.175347328186035,81.14050197601318,1 +2147,0.37286376953125,0.368402361869812,0.3736596405506134,0.22773893177509308,430.87518310546875,1e-05,0.14259937405586243,3.131078004837036,81.14050197601318,1 +2148,0.3467439115047455,0.33807000517845154,0.34411299228668213,0.26643356680870056,430.87518310546875,1e-05,0.1526218056678772,3.329773426055908,81.14050197601318,1 +2149,0.23218759894371033,0.3020091652870178,0.3061767816543579,0.1930069923400879,962.1061401367188,1e-05,0.14891228079795837,3.100965738296509,81.14050197601318,1 +2150,0.2148352861404419,0.2927938997745514,0.2922895550727844,0.08974359184503555,961.14013671875,1e-05,0.12468469142913818,2.837597131729126,81.14050197601318,1 +2151,0.11003593355417252,0.31734198331832886,0.3235244154930115,0.08624708652496338,971.5481567382812,1e-05,0.7419196367263794,3.0618982315063477,81.14050197601318,1 +2152,0.27845996618270874,0.2425922304391861,0.24942371249198914,0.19393938779830933,925.2398681640625,1e-05,0.21091827750205994,3.62532377243042,81.14050197601318,1 +2153,0.3096945583820343,0.25047266483306885,0.25024959444999695,0.21841491758823395,949.5288696289062,1e-05,0.12901590764522552,2.8448009490966797,81.14050197601318,1 +2154,0.47639793157577515,0.25218671560287476,0.2598363757133484,0.18088577687740326,702.8627319335938,1e-05,0.14957959949970245,3.3473753929138184,81.14050197601318,1 +2155,0.23710742592811584,0.23914726078510284,0.2638671100139618,0.18834498524665833,938.756103515625,1e-05,0.13413916528224945,3.12202525138855,81.14050197601318,1 +2156,0.2796865999698639,0.3221159875392914,0.3326929211616516,0.19114218652248383,976.2150268554688,1e-05,0.5030909180641174,2.8473422527313232,81.14050197601318,1 +2157,0.4669332504272461,0.25614893436431885,0.26926669478416443,0.23892773687839508,975.2377319335938,1e-05,0.1386634111404419,3.0520079135894775,81.14050197601318,1 +2158,0.33738550543785095,0.2784591019153595,0.2838646471500397,0.19650349020957947,816.7084350585938,1e-05,1.081847071647644,3.4909095764160156,81.14050197601318,1 +2159,0.4100627601146698,0.2607922852039337,0.2682762145996094,0.23286713659763336,926.0864868164062,1e-05,0.1038440614938736,2.831191301345825,81.14050197601318,1 +2160,0.43367451429367065,0.32009485363960266,0.3267573118209839,0.17715618014335632,599.4783325195312,1e-05,0.2454417198896408,3.2883596420288086,81.14050197601318,1 +2161,0.5249320864677429,0.6058348417282104,0.6200364828109741,0.23123542964458466,177.18624877929688,1e-05,0.793419599533081,3.134897470474243,81.14050197601318,1 +2162,0.39083415269851685,0.3092978298664093,0.31059640645980835,0.1895104944705963,565.9164428710938,1e-05,0.13297255337238312,2.8401906490325928,81.14050197601318,1 +2163,0.1617497354745865,0.1999547928571701,0.2037459760904312,0.10209789872169495,832.2701416015625,1e-05,0.12416769564151764,3.0551679134368896,81.14050197601318,1 +2164,0.23228737711906433,0.2664879858493805,0.27265387773513794,0.2130536139011383,727.9061279296875,1e-05,0.09965270757675171,3.414297342300415,81.14050197601318,1 +2165,0.17919452488422394,0.22902324795722961,0.24677489697933197,0.1918414980173111,961.7210693359375,1e-05,0.1426035761833191,2.840637683868408,81.14050197601318,1 +2166,0.21194955706596375,0.3339146077632904,0.3369179666042328,0.1850815862417221,909.3855590820312,1e-05,0.291099488735199,3.344447612762451,81.14050197601318,1 +2167,0.3463691473007202,0.1980869174003601,0.2043682038784027,0.2282051295042038,872.758544921875,1e-05,0.151510089635849,3.0558457374572754,81.14050197601318,1 +2168,0.18576407432556152,0.2009241282939911,0.22965547442436218,0.27599066495895386,884.6192626953125,1e-05,0.15440085530281067,2.8381173610687256,81.14050197601318,1 +2169,0.38519713282585144,0.2958301603794098,0.3083474338054657,0.20000000298023224,807.27197265625,1e-05,0.16644440591335297,3.061359167098999,81.14050197601318,1 +2170,0.22712711989879608,0.3521369993686676,0.3586185574531555,0.18158508837223053,986.3638916015625,1e-05,0.13507622480392456,3.4473748207092285,81.14050197601318,1 +2171,0.33705204725265503,0.3066263496875763,0.3111162483692169,0.18321678042411804,964.7545166015625,1e-05,0.11945539712905884,3.159764289855957,81.14050197601318,1 +2172,0.3049964904785156,0.3900813162326813,0.3883175253868103,0.15734265744686127,983.0303955078125,1e-05,0.11265352368354797,3.2702386379241943,81.14050197601318,1 +2173,0.20796146988868713,0.22660209238529205,0.2533266544342041,0.20606060326099396,974.4140625,1e-05,0.125065878033638,3.1009621620178223,81.14050197601318,1 +2174,0.29705652594566345,0.4056197702884674,0.41712433099746704,0.1974359005689621,990.630615234375,1e-05,0.1863466203212738,2.8360135555267334,81.14050197601318,1 +2175,0.3561360836029053,0.28553324937820435,0.29063495993614197,0.19370628893375397,952.3612670898438,1e-05,0.22403238713741302,3.157463312149048,81.14050197601318,1 +2176,0.2671697437763214,0.3156607747077942,0.34542423486709595,0.24382284283638,986.079833984375,1e-05,0.1288369596004486,3.047177314758301,81.14050197601318,1 +2177,0.4151574969291687,0.354023814201355,0.3727928400039673,0.18834498524665833,986.3638916015625,1e-05,0.14744363725185394,3.191030502319336,81.14050197601318,1 +2178,0.34801191091537476,0.29556816816329956,0.29789671301841736,0.2668997645378113,697.9737548828125,1e-05,0.14308376610279083,3.0355708599090576,81.14050197601318,1 +2179,0.2810599207878113,0.4355851411819458,0.42607319355010986,0.1902097910642624,977.9759521484375,1e-05,0.23150591552257538,3.141448736190796,81.14050197601318,1 +2180,0.29846861958503723,0.4760485291481018,0.4813099205493927,0.21351981163024902,976.0529174804688,1e-05,0.28684619069099426,2.8392810821533203,81.14050197601318,1 +2181,0.33570098876953125,0.27782294154167175,0.28811487555503845,0.2097902148962021,404.18499755859375,1e-05,0.12781871855258942,3.46811580657959,81.14050197601318,1 +2182,0.25054678320884705,0.49140438437461853,0.49140438437461853,0.0,177.18624877929688,1e-05,0.32578983902931213,3.053558588027954,81.14050197601318,1 +2183,0.3180602788925171,0.378780722618103,0.37007033824920654,0.09417249262332916,904.0114135742188,1e-05,0.12481411546468735,3.0866262912750244,81.14050197601318,1 +2184,0.14921554923057556,0.47661292552948,0.4634559750556946,0.16596736013889313,986.221923828125,1e-05,0.1110602468252182,3.0899124145507812,81.14050197601318,1 +2185,0.1757047176361084,0.26578694581985474,0.27537503838539124,0.2421911358833313,879.6704711914062,1e-05,0.13118702173233032,2.8287644386291504,81.14050197601318,1 +2186,0.3316931426525116,0.38774374127388,0.3846037685871124,0.22843822836875916,927.482421875,1e-05,0.146314337849617,2.8288135528564453,81.14050197601318,1 +2187,0.2972729504108429,0.30304649472236633,0.30552762746810913,0.2186480164527893,915.4500122070312,1e-05,0.1178002581000328,3.484473466873169,81.14050197601318,1 +2188,0.34824034571647644,0.3146875202655792,0.30699124932289124,0.1487179547548294,972.0613403320312,1e-05,0.11515355855226517,2.839505672454834,81.14050197601318,1 +2189,0.3459200859069824,0.3021962344646454,0.3033468425273895,0.1118881106376648,590.026123046875,1e-05,0.19200153648853302,3.10076642036438,81.14050197601318,1 +2190,0.4067169725894928,0.41114386916160583,0.41522112488746643,0.18414919078350067,382.7987976074219,1e-05,0.102611243724823,3.1369147300720215,81.14050197601318,1 +2191,0.2560045123100281,0.22155168652534485,0.22740191221237183,0.1382284313440323,896.5547485351562,1e-05,0.10253598541021347,2.8479926586151123,81.14050197601318,1 +2192,0.19158557057380676,0.261433869600296,0.26719269156455994,0.1722610741853714,799.454345703125,1e-05,0.1355859339237213,2.8439455032348633,81.14050197601318,1 +2193,0.4357393980026245,0.3590514361858368,0.35597214102745056,0.2265734225511551,660.37890625,1e-05,0.14898242056369781,3.4704549312591553,81.14050197601318,1 +2194,0.2062491774559021,0.27159056067466736,0.2837649881839752,0.2426573485136032,966.2316284179688,1e-05,0.15958744287490845,2.8396353721618652,81.14050197601318,1 +2195,0.4301627278327942,0.3092604875564575,0.3110556900501251,0.13939394056797028,853.715087890625,1e-05,0.1996716856956482,3.1023731231689453,81.14050197601318,1 +2196,0.07737991958856583,0.33548611402511597,0.34718814492225647,0.2554778456687927,981.9857788085938,1e-05,0.2732773423194885,3.357264757156372,81.14050197601318,1 +2197,0.3988170623779297,0.3354460895061493,0.327075719833374,0.16433566808700562,875.8281860351562,1e-05,0.1402667611837387,2.8262739181518555,81.14050197601318,1 +2198,0.17396999895572662,0.4018101990222931,0.4102833867073059,0.18554778397083282,989.0084838867188,1e-05,0.11293190717697144,3.1205830574035645,81.14050197601318,1 +2199,0.29125404357910156,0.26264771819114685,0.2742985486984253,0.17179487645626068,935.4796752929688,1e-05,0.14503028988838196,3.3964295387268066,81.14050197601318,1 +2200,0.3129880428314209,0.4099666178226471,0.38892391324043274,0.2018647938966751,950.4097290039062,1e-05,0.157060906291008,2.829509735107422,81.14050197601318,1 +2201,0.32362979650497437,0.3221668303012848,0.32236576080322266,0.1946386992931366,934.7079467773438,1e-05,0.13318432867527008,3.125157594680786,81.14050197601318,1 +2202,0.27182504534721375,0.30299028754234314,0.3047313690185547,0.1946386992931366,873.64306640625,1e-05,0.16808320581912994,3.1121866703033447,81.14050197601318,1 +2203,0.23091048002243042,0.2501925528049469,0.2532444894313812,0.2209790199995041,851.6567993164062,1e-05,0.1041356697678566,2.834197759628296,81.14050197601318,1 +2204,0.27947360277175903,0.27762526273727417,0.2794564962387085,0.25617715716362,977.4996337890625,1e-05,0.11647605150938034,3.116110324859619,81.14050197601318,1 +2205,0.350639283657074,0.3217654824256897,0.3277815580368042,0.24125874042510986,695.4873657226562,1e-05,0.11861668527126312,3.4359583854675293,81.14050197601318,1 +2206,0.25507649779319763,0.28821131587028503,0.28278809785842896,0.15967366099357605,957.5706176757812,1e-05,0.18955610692501068,2.8376431465148926,81.14050197601318,1 +2207,0.3073882460594177,0.32486826181411743,0.34885162115097046,0.18554778397083282,956.142333984375,1e-05,1.146005392074585,3.275022506713867,81.14050197601318,1 +2208,0.24856692552566528,0.30358198285102844,0.30760398507118225,0.23519814014434814,945.68896484375,1e-05,0.12822747230529785,3.143251895904541,81.14050197601318,1 +2209,0.22956493496894836,0.3087581694126129,0.3139093518257141,0.19976690411567688,903.3214111328125,1e-05,0.15321214497089386,2.833811044692993,81.14050197601318,1 +2210,0.23500312864780426,0.33319780230522156,0.33716005086898804,0.12121211737394333,980.3147583007812,1e-05,0.11965274810791016,3.1296932697296143,81.14050197601318,1 +2211,0.35517042875289917,0.260224848985672,0.26133596897125244,0.10256410390138626,859.7134399414062,1e-05,0.15808503329753876,3.1267855167388916,81.14050197601318,1 +2212,0.35487207770347595,0.28369712829589844,0.28051233291625977,0.14102564752101898,952.1465454101562,1e-05,0.16074693202972412,2.8310914039611816,81.14050197601318,1 +2213,0.28575316071510315,0.2818317115306854,0.2910933494567871,0.18111887574195862,852.1741943359375,1e-05,0.12302140146493912,3.4090819358825684,81.14050197601318,1 +2214,0.2883143723011017,0.3275257647037506,0.33080539107322693,0.15198135375976562,988.18359375,1e-05,0.11946862190961838,3.051379442214966,81.14050197601318,1 +2215,0.2919098436832428,0.239375501871109,0.2523997724056244,0.21002331376075745,706.4580688476562,1e-05,0.13301657140254974,2.8438684940338135,81.14050197601318,1 +2216,0.12036822736263275,0.42510417103767395,0.43040910363197327,0.2142191082239151,984.643310546875,1e-05,0.1591627597808838,3.420952558517456,81.14050197601318,1 +2217,0.23133757710456848,0.326215922832489,0.3179318308830261,0.1230769231915474,916.991943359375,1e-05,0.10417725890874863,3.0719408988952637,81.14050197601318,1 +2218,0.3518279790878296,0.29544249176979065,0.31120285391807556,0.19137528538703918,987.6286010742188,1e-05,0.1455105096101761,3.037381887435913,81.14050197601318,1 +2219,0.3492860794067383,0.3281165361404419,0.3317323625087738,0.16083915531635284,932.6204223632812,1e-05,0.14507874846458435,3.144663095474243,81.14050197601318,1 +2220,0.410614013671875,0.2304663211107254,0.24808913469314575,0.25244754552841187,975.7278442382812,1e-05,0.13134630024433136,3.0768144130706787,81.14050197601318,1 +2221,0.3176145851612091,0.3141670227050781,0.3133866786956787,0.2708624601364136,956.75732421875,1e-05,0.1403001993894577,2.8382396697998047,81.14050197601318,1 +2222,0.23368343710899353,0.1882895827293396,0.2068575918674469,0.14685314893722534,907.7332763671875,1e-05,0.1405910700559616,3.3655710220336914,81.14050197601318,1 +2223,0.2931828200817108,0.16619528830051422,0.19098815321922302,0.2142191082239151,691.7044067382812,1e-05,0.12359444797039032,3.0796823501586914,81.14050197601318,1 +2224,0.33028894662857056,0.5952607989311218,0.606450080871582,0.16317015886306763,158.9905548095703,1e-05,0.10700509697198868,3.0712854862213135,81.14050197601318,1 +2225,0.20811115205287933,0.3393942415714264,0.3344324231147766,0.20372959971427917,935.9909057617188,1e-05,0.13858400285243988,3.464407205581665,81.14050197601318,1 +2226,0.35785001516342163,0.36968114972114563,0.37280264496803284,0.24312354624271393,979.6979370117188,1e-05,0.14718712866306305,2.8420417308807373,81.14050197601318,1 +2227,0.4289012849330902,0.18216738104820251,0.20440219342708588,0.23729602992534637,845.2969360351562,1e-05,0.16024963557720184,2.8543365001678467,81.14050197601318,1 +2228,0.30097630620002747,0.18693171441555023,0.20031863451004028,0.2170163094997406,720.25927734375,1e-05,0.15258775651454926,3.3824217319488525,81.14050197601318,1 +2229,0.2576783299446106,0.3816690742969513,0.3993993103504181,0.19114218652248383,336.031982421875,1e-05,0.11482872068881989,2.841386556625366,81.14050197601318,1 +2230,0.3504975438117981,0.2982407212257385,0.2944502532482147,0.22517482936382294,808.654296875,1e-05,0.13344749808311462,3.085784435272217,81.14050197601318,1 +2231,0.27772772312164307,0.24758540093898773,0.2522076368331909,0.18974359333515167,578.2326049804688,1e-05,0.12999041378498077,3.4561848640441895,81.14050197601318,1 +2232,0.1624792516231537,0.5663722157478333,0.5433658957481384,0.1678321659564972,989.1450805664062,1e-05,0.10190737247467041,2.829479694366455,81.14050197601318,1 +2233,0.28894126415252686,0.3265742063522339,0.3246488869190216,0.23030303418636322,837.505126953125,1e-05,0.21565453708171844,3.0733635425567627,81.14050197601318,1 +2234,0.15857195854187012,0.22826047241687775,0.2556816339492798,0.21398600935935974,985.6517944335938,1e-05,0.11582116037607193,3.04388689994812,81.14050197601318,1 +2235,0.32159221172332764,0.3803018629550934,0.3765489459037781,0.2041957974433899,926.3671875,1e-05,0.13596045970916748,3.2087244987487793,81.14050197601318,1 +2236,0.2900277376174927,0.19939745962619781,0.21574877202510834,0.21165500581264496,841.452880859375,1e-05,0.1599564552307129,3.1194939613342285,81.14050197601318,1 +2237,0.48989129066467285,0.3018973171710968,0.30879196524620056,0.13356643915176392,865.928466796875,1e-05,0.1527089774608612,3.3996262550354004,81.14050197601318,1 +2238,0.17573249340057373,0.26257988810539246,0.2928387522697449,0.20046620070934296,996.2799072265625,1e-05,0.25198444724082947,2.8500514030456543,81.14050197601318,1 +2239,0.4170187711715698,0.19841811060905457,0.20320764183998108,0.05244755372405052,819.3053588867188,1e-05,0.1436241716146469,3.1183078289031982,81.14050197601318,1 +2240,0.24407164752483368,0.42773035168647766,0.4376612901687622,0.18438228964805603,407.6315612792969,1e-05,0.12227338552474976,3.1497550010681152,81.14050197601318,1 +2241,0.21292540431022644,0.2504550814628601,0.26543861627578735,0.22354312241077423,887.0220336914062,1e-05,0.599146842956543,2.8429019451141357,81.14050197601318,1 +2242,0.2812255620956421,0.21514517068862915,0.2157219499349594,0.010489510372281075,928.03564453125,1e-05,0.1631736308336258,3.096395969390869,81.14050197601318,1 +2243,0.23202776908874512,0.3683087229728699,0.36722126603126526,0.1818181872367859,847.4485473632812,1e-05,0.17253701388835907,3.695707321166992,81.14050197601318,1 +2244,0.40913838148117065,0.42347216606140137,0.42253461480140686,0.2214452177286148,379.11187744140625,1e-05,0.12580084800720215,2.8371834754943848,81.14050197601318,1 +2245,0.28399550914764404,0.309619665145874,0.325246661901474,0.17179487645626068,897.28564453125,1e-05,0.15275593101978302,3.141157865524292,81.14050197601318,1 +2246,0.2767127752304077,0.30385467410087585,0.29527708888053894,0.2242424190044403,930.488525390625,1e-05,0.2194821834564209,3.171522617340088,81.14050197601318,1 +2247,0.37567177414894104,0.3542923033237457,0.354906290769577,0.11305361241102219,917.6026611328125,1e-05,0.13020004332065582,2.848780870437622,81.14050197601318,1 +2248,0.16449759900569916,0.2725246846675873,0.2793097496032715,0.13939394056797028,947.7415161132812,1e-05,0.15160800516605377,3.3300530910491943,81.14050197601318,1 +2249,0.3469383120536804,0.3214331269264221,0.31188714504241943,0.2142191082239151,928.31103515625,1e-05,0.15104003250598907,3.05828857421875,81.14050197601318,1 +2250,0.296267569065094,0.28714683651924133,0.27587220072746277,0.17832167446613312,886.226318359375,1e-05,0.1830061376094818,2.8459115028381348,81.14050197601318,1 +2251,0.29307761788368225,0.298255056142807,0.3126765489578247,0.23146852850914001,982.1359252929688,1e-05,0.16373640298843384,3.055155038833618,81.14050197601318,1 +2252,0.1510211080312729,0.21598151326179504,0.24214820563793182,0.1662004590034485,983.178466796875,1e-05,0.13205759227275848,3.197554111480713,81.14050197601318,1 +2253,0.28872331976890564,0.1829797923564911,0.19343264400959015,0.10979020595550537,627.6343994140625,1e-05,1.5452204942703247,2.849888563156128,81.14050197601318,1 +2254,0.40800419449806213,0.3522235155105591,0.35759520530700684,0.22004662454128265,608.6077880859375,1e-05,0.1781536042690277,3.330716609954834,81.14050197601318,1 +2255,0.43843090534210205,0.19533683359622955,0.20339930057525635,0.09906759858131409,742.382080078125,1e-05,0.160942941904068,3.3372304439544678,81.14050197601318,1 +2256,0.4262349009513855,0.3343041241168976,0.34281015396118164,0.24125874042510986,978.2918701171875,1e-05,0.132573664188385,3.1323375701904297,81.14050197601318,1 +2257,0.21505072712898254,0.3179410398006439,0.3330824673175812,0.14895105361938477,961.334228515625,1e-05,0.1436658799648285,2.851167678833008,81.14050197601318,1 +2258,0.21502453088760376,0.22122767567634583,0.23319686949253082,0.1515151560306549,797.99267578125,1e-05,0.19959473609924316,3.4706528186798096,81.14050197601318,1 +2259,0.43654486536979675,0.24775786697864532,0.2587752342224121,0.24801865220069885,824.37353515625,1e-05,0.15546965599060059,3.103835105895996,81.14050197601318,1 +2260,0.22381223738193512,0.3343622088432312,0.3312840163707733,0.22867132723331451,674.5276489257812,1e-05,0.09061872214078903,3.13539981842041,81.14050197601318,1 +2261,0.24021965265274048,0.24830633401870728,0.2672066390514374,0.1258741319179535,818.6600952148438,1e-05,0.09146632254123688,3.284318447113037,81.14050197601318,1 +2262,0.3285231292247772,0.31570181250572205,0.3161420524120331,0.28275057673454285,819.3053588867188,1e-05,0.11458934098482132,3.066889762878418,81.14050197601318,1 +2263,0.1646212488412857,0.20652490854263306,0.2130148708820343,0.24428904056549072,895.0792846679688,1e-05,0.13262566924095154,2.8491947650909424,81.14050197601318,1 +2264,0.34558624029159546,0.4037625789642334,0.41118472814559937,0.19953380525112152,976.2150268554688,1e-05,0.1483827531337738,3.1416938304901123,81.14050197601318,1 +2265,0.3398321270942688,0.5255605578422546,0.5303997993469238,0.22494173049926758,997.1378173828125,1e-05,0.14780445396900177,3.0807409286499023,81.14050197601318,1 +2266,0.36474645137786865,0.46294358372688293,0.46947023272514343,0.250582754611969,323.4160461425781,1e-05,0.1330564320087433,3.2206361293792725,81.14050197601318,1 +2267,0.25954893231391907,0.2512470781803131,0.2590715289115906,0.2013985961675644,978.6064453125,1e-05,0.09729737043380737,3.284409523010254,81.14050197601318,1 +2268,0.30455484986305237,0.2542448937892914,0.26213210821151733,0.20163169503211975,884.2141723632812,1e-05,0.26918044686317444,3.099238157272339,81.14050197601318,1 +2269,0.24012607336044312,0.3441934585571289,0.3416590988636017,0.26923078298568726,911.3367309570312,1e-05,0.22307085990905762,3.045314311981201,81.14050197601318,1 +2270,0.3877730071544647,0.14279721677303314,0.16122034192085266,0.16293705999851227,652.9728393554688,1e-05,0.35415521264076233,3.132990837097168,81.14050197601318,1 +2271,0.3212810754776001,0.28450170159339905,0.28930342197418213,0.22400932013988495,876.2608642578125,1e-05,0.16515305638313293,3.101640462875366,81.14050197601318,1 +2272,0.23796957731246948,0.33934080600738525,0.3308861255645752,0.2543123662471771,943.1180419921875,1e-05,0.19058619439601898,3.263747453689575,81.14050197601318,1 +2273,0.3892577290534973,0.3802439570426941,0.38114529848098755,0.2058275043964386,993.5120239257812,1e-05,0.1568002849817276,3.2827134132385254,81.14050197601318,1 +2274,0.23380064964294434,0.3076123595237732,0.30428606271743774,0.20769231021404266,882.9913330078125,1e-05,0.16466563940048218,3.124915361404419,81.14050197601318,1 +2275,0.2652234733104706,0.17804020643234253,0.1982610523700714,0.13333334028720856,969.6383056640625,1e-05,0.1787320375442505,3.0817623138427734,81.14050197601318,1 +2276,0.21544484794139862,0.3491685092449188,0.35229960083961487,0.15407925844192505,995.4110107421875,1e-05,0.1904216706752777,2.854051113128662,81.14050197601318,1 +2277,0.37751391530036926,0.4168850779533386,0.44245338439941406,0.22960372269153595,340.1504821777344,1e-05,0.14164572954177856,3.0721418857574463,81.14050197601318,1 +2278,0.28828999400138855,0.31833791732788086,0.32458704710006714,0.1298368275165558,955.9364624023438,1e-05,0.13870038092136383,3.2224366664886475,81.14050197601318,1 +2279,0.24383202195167542,0.3031308650970459,0.29880717396736145,0.19370628893375397,461.6126403808594,1e-05,0.14127638936042786,3.0757157802581787,81.14050197601318,1 +2280,0.34173721075057983,0.34688621759414673,0.341158390045166,0.19953380525112152,749.2398071289062,1e-05,0.1727057844400406,3.0662364959716797,81.14050197601318,1 +2281,0.18892084062099457,0.5251821875572205,0.5354588031768799,0.20606060326099396,988.5972900390625,1e-05,0.198165163397789,3.1074373722076416,81.14050197601318,1 +2282,0.20468850433826447,0.19493751227855682,0.19977666437625885,0.14731934666633606,781.0278930664062,1e-05,0.16103993356227875,2.8340117931365967,81.14050197601318,1 +2283,0.40249383449554443,0.23673637211322784,0.25593897700309753,0.21165500581264496,936.7528076171875,1e-05,0.17470292747020721,3.2567954063415527,81.14050197601318,1 +2284,0.16885708272457123,0.369586318731308,0.37137964367866516,0.19696970283985138,961.5278930664062,1e-05,0.15764647722244263,3.2840850353240967,81.14050197601318,1 +2285,0.1750280112028122,0.23280714452266693,0.24111442267894745,0.23636363446712494,873.2015991210938,1e-05,0.17100541293621063,3.054109811782837,81.14050197601318,1 +2286,0.5106577277183533,0.4463338851928711,0.4534378945827484,0.145454540848732,319.1216125488281,1e-05,0.15909048914909363,3.092158794403076,81.14050197601318,1 +2287,0.3008091151714325,0.4544672966003418,0.45643073320388794,0.16876456141471863,993.5120239257812,1e-05,0.16118893027305603,3.1395323276519775,81.14050197601318,1 +2288,0.2879071831703186,0.29126766324043274,0.29016515612602234,0.1319347321987152,879.6704711914062,1e-05,1.3306715488433838,2.838017463684082,81.14050197601318,1 +2289,0.47874748706817627,0.268634170293808,0.2770288288593292,0.1958041936159134,949.9702758789062,1e-05,0.135748490691185,3.362999439239502,81.14050197601318,1 +2290,0.3543916344642639,0.31787195801734924,0.3411254584789276,0.2778554856777191,475.9952392578125,1e-05,0.1558808535337448,3.055126667022705,81.14050197601318,1 +2291,0.3904965817928314,0.6435903310775757,0.6491341590881348,0.20792540907859802,992.3473510742188,1e-05,0.1426672786474228,3.1288902759552,81.14050197601318,1 +2292,0.257144033908844,0.2013206034898758,0.2094922959804535,0.2298368364572525,844.7539672851562,1e-05,0.16338883340358734,2.8387207984924316,81.14050197601318,1 +2293,0.23485301434993744,0.3377109467983246,0.34522414207458496,0.24242423474788666,999.177734375,1e-05,0.1405838131904602,3.358396530151367,81.14050197601318,1 +2294,0.3150286376476288,0.1719069927930832,0.18501929938793182,0.20163169503211975,586.15087890625,1e-05,0.1944289654493332,2.8378915786743164,81.14050197601318,1 +2295,0.2485167533159256,0.31160661578178406,0.3136447072029114,0.22867132723331451,953.8506469726562,1e-05,0.20919327437877655,3.409189224243164,81.14050197601318,1 +2296,0.18127049505710602,0.44271883368492126,0.445167601108551,0.20722611248493195,982.1359252929688,1e-05,0.11199117451906204,3.0660293102264404,81.14050197601318,1 +2297,0.21557092666625977,0.25202786922454834,0.2670428156852722,0.22564102709293365,746.3303833007812,1e-05,0.0986037328839302,3.266875743865967,81.14050197601318,1 +2298,0.30137911438941956,0.26869139075279236,0.2842046022415161,0.25407925248146057,901.5783081054688,1e-05,0.12846575677394867,2.8357603549957275,81.14050197601318,1 +2299,0.3324429392814636,0.19972163438796997,0.22416648268699646,0.22773893177509308,527.8575439453125,1e-05,0.7426185011863708,3.434891939163208,81.14050197601318,1 +2300,0.23599840700626373,0.4605337381362915,0.4401794970035553,0.24428904056549072,995.6604614257812,1e-05,0.14877647161483765,3.0712125301361084,81.14050197601318,1 +2301,0.21022149920463562,0.24264083802700043,0.2525184750556946,0.1202797219157219,898.011962890625,1e-05,0.1420271396636963,3.3426284790039062,81.14050197601318,1 +2302,0.31942930817604065,0.34229719638824463,0.3404039442539215,0.25874125957489014,947.5157470703125,1e-05,0.11844825744628906,3.103710889816284,81.14050197601318,1 +2303,0.39698219299316406,0.30554860830307007,0.3177114725112915,0.14172494411468506,489.7753601074219,1e-05,0.10005956143140793,3.3574321269989014,81.14050197601318,1 +2304,0.5272222757339478,0.30732864141464233,0.30961886048316956,0.11864801496267319,515.6737670898438,1e-05,0.16413645446300507,2.845189094543457,81.14050197601318,1 +2305,0.19393104314804077,0.29031887650489807,0.2860470414161682,0.22494173049926758,807.9645385742188,1e-05,0.11788845807313919,3.1024115085601807,81.14050197601318,1 +2306,0.29502129554748535,0.21925269067287445,0.2259545624256134,0.1846153885126114,896.5547485351562,1e-05,0.11752951145172119,3.0633914470672607,81.14050197601318,1 +2307,0.2167644500732422,0.2773824632167816,0.28879162669181824,0.18927739560604095,957.9745483398438,1e-05,0.16005435585975647,3.257228136062622,81.14050197601318,1 +2308,0.31730106472969055,0.2783344089984894,0.27365005016326904,0.21655011177062988,900.1648559570312,1e-05,0.13539202511310577,3.334275245666504,81.14050197601318,1 +2309,0.2059548795223236,0.2480737864971161,0.2594532072544098,0.19720280170440674,904.0114135742188,1e-05,0.1053958460688591,3.0944325923919678,81.14050197601318,1 +2310,0.24387554824352264,0.25916844606399536,0.25922009348869324,0.15967366099357605,568.0068969726562,1e-05,0.13350744545459747,2.8214128017425537,81.14050197601318,1 +2311,0.4178985357284546,0.2849230468273163,0.29713279008865356,0.1834498792886734,639.041015625,1e-05,0.25905948877334595,3.1131551265716553,81.14050197601318,1 +2312,0.2900550365447998,0.22022128105163574,0.23334158957004547,0.13100233674049377,906.7301635742188,1e-05,0.14101311564445496,3.059763193130493,81.14050197601318,1 +2313,0.35172438621520996,0.31905022263526917,0.33092597126960754,0.22494173049926758,959.7694091796875,1e-05,0.12503857910633087,3.343860626220703,81.14050197601318,1 +2314,0.2145642787218094,0.356580525636673,0.35239753127098083,0.20209790766239166,941.685791015625,1e-05,0.12200925499200821,3.2903897762298584,81.14050197601318,1 +2315,0.3140363097190857,0.2796432077884674,0.28088703751564026,0.11305361241102219,502.9901123046875,1e-05,0.1558070331811905,3.056556463241577,81.14050197601318,1 +2316,0.19837963581085205,0.18815618753433228,0.19692687690258026,0.1694638729095459,697.9737548828125,1e-05,0.11086197197437286,3.1156558990478516,81.14050197601318,1 +2317,0.4342179298400879,0.3501095771789551,0.3535735011100769,0.09627039730548859,991.8234252929688,1e-05,0.14519190788269043,3.0653443336486816,81.14050197601318,2 +2318,0.36877402663230896,0.4401356279850006,0.4423395097255707,0.139860138297081,979.54296875,1e-05,0.15990008413791656,3.1303892135620117,81.14050197601318,2 +2319,0.25380852818489075,0.2615523338317871,0.2652653753757477,0.20932400226593018,921.7830200195312,1e-05,0.09755772352218628,3.2569973468780518,81.14050197601318,2 +2320,0.30137112736701965,0.26705291867256165,0.27223533391952515,0.17319346964359283,866.8596801757812,1e-05,0.2811022698879242,3.105909824371338,81.14050197601318,2 +2321,0.4212259352207184,0.23002922534942627,0.2441823035478592,0.2242424190044403,864.5192260742188,1e-05,0.14529773592948914,3.120612382888794,81.14050197601318,2 +2322,0.10098143666982651,0.25979381799697876,0.26930248737335205,0.214685320854187,967.322509765625,1e-05,0.10820840299129486,3.1109304428100586,81.14050197601318,2 +2323,0.26687195897102356,0.3302079141139984,0.3414419889450073,0.21328671276569366,964.1939697265625,1e-05,1.214754581451416,3.0695347785949707,81.14050197601318,2 +2324,0.29497742652893066,0.267788290977478,0.26763975620269775,0.21235431730747223,635.8348388671875,1e-05,0.14441877603530884,3.3768646717071533,81.14050197601318,2 +2325,0.19235089421272278,0.36204248666763306,0.37448766827583313,0.2041957974433899,978.6064453125,1e-05,0.15827345848083496,3.260514259338379,81.14050197601318,2 +2326,0.4308892786502838,0.1970445215702057,0.20295798778533936,0.20955711603164673,805.1764526367188,1e-05,0.17835360765457153,3.4345133304595947,81.14050197601318,2 +2327,0.6088466048240662,0.415539413690567,0.42782917618751526,0.2030303031206131,296.9483642578125,1e-05,0.12398544698953629,2.8289504051208496,81.14050197601318,2 +2328,0.2983786463737488,0.28489652276039124,0.29073771834373474,0.16083915531635284,929.6773681640625,1e-05,0.10636987537145615,3.1277074813842773,81.14050197601318,2 +2329,0.3358464539051056,0.2214086800813675,0.23961184918880463,0.17692308127880096,993.383544921875,1e-05,0.24271772801876068,3.0805275440216064,81.14050197601318,2 +2330,0.3024370074272156,0.3210131824016571,0.3296178877353668,0.28321677446365356,865.928466796875,1e-05,0.12935954332351685,3.2921013832092285,81.14050197601318,2 +2331,0.252689391374588,0.2440708428621292,0.2575699985027313,0.21841491758823395,860.2017211914062,1e-05,0.10557430237531662,3.096428871154785,81.14050197601318,2 +2332,0.21408239006996155,0.25027185678482056,0.2524300813674927,0.24568764865398407,756.7888793945312,1e-05,0.10617434978485107,3.3655307292938232,81.14050197601318,2 +2333,0.2598879039287567,0.2944522500038147,0.30554646253585815,0.18694639205932617,888.9893188476562,1e-05,0.1132989302277565,2.840759515762329,81.14050197601318,2 +2334,0.316710889339447,0.2754783630371094,0.2894587218761444,0.23962703347206116,508.12554931640625,1e-05,0.18022730946540833,3.110142469406128,81.14050197601318,2 +2335,0.19883239269256592,0.29984912276268005,0.30364328622817993,0.21048951148986816,942.1655883789062,1e-05,0.17660215497016907,3.0634450912475586,81.14050197601318,2 +2336,0.31260883808135986,0.2153751254081726,0.22048936784267426,0.10862471163272858,855.2390747070312,1e-05,0.12165013700723648,3.309340000152588,81.14050197601318,2 +2337,0.25065240263938904,0.38331419229507446,0.39020219445228577,0.21235431730747223,973.5816040039062,1e-05,0.12020178884267807,3.3028430938720703,81.14050197601318,2 +2338,0.4092574417591095,0.16707363724708557,0.17813345789909363,0.1291375309228897,603.1679077148438,1e-05,0.12315971404314041,3.4125616550445557,81.14050197601318,2 +2339,0.2157505750656128,0.20535142719745636,0.21670882403850555,0.15897436439990997,705.2662353515625,1e-05,0.1566651612520218,2.8397905826568604,81.14050197601318,2 +2340,0.2724250257015228,0.27014198899269104,0.27343249320983887,0.25757575035095215,953.0025024414062,1e-05,0.11055944859981537,3.1021108627319336,81.14050197601318,2 +2341,0.3679409921169281,0.26223501563072205,0.2669980823993683,0.20326340198516846,885.8264770507812,1e-05,0.3720153272151947,3.0645010471343994,81.14050197601318,2 +2342,0.1737958788871765,0.24107426404953003,0.2515552043914795,0.2554778456687927,979.2321166992188,1e-05,0.10095187276601791,3.615027666091919,81.14050197601318,2 +2343,0.28581157326698303,0.23391711711883545,0.2373376339673996,0.19370628893375397,872.758544921875,1e-05,0.12784640491008759,3.111027479171753,81.14050197601318,2 +2344,0.35504478216171265,0.2756522297859192,0.2884531319141388,0.2209790199995041,917.6026611328125,1e-05,0.35329607129096985,3.131993055343628,81.14050197601318,2 +2345,0.3502335548400879,0.2872655987739563,0.29145392775535583,0.2018647938966751,901.2266235351562,1e-05,0.1928180307149887,2.84329891204834,81.14050197601318,2 +2346,0.18187269568443298,0.25006458163261414,0.26729562878608704,0.220279723405838,893.2089233398438,1e-05,0.11271365731954575,3.113757371902466,81.14050197601318,2 +2347,0.3728944659233093,0.3879633843898773,0.3898622393608093,0.2242424190044403,268.69403076171875,1e-05,0.17088556289672852,3.0652902126312256,81.14050197601318,2 +2348,0.35342514514923096,0.275187224149704,0.2756245732307434,0.18881118297576904,661.8328857421875,1e-05,0.15196378529071808,3.3257803916931152,81.14050197601318,2 +2349,0.2660057544708252,0.3113587200641632,0.3200133144855499,0.18158508837223053,924.6715087890625,1e-05,0.15956024825572968,3.056833028793335,81.14050197601318,2 +2350,0.16300037503242493,0.3288760781288147,0.3342529535293579,0.21351981163024902,876.2608642578125,1e-05,0.13699355721473694,3.138739824295044,81.14050197601318,2 +2351,0.4016605019569397,0.4553746283054352,0.4470716118812561,0.20606060326099396,991.69189453125,1e-05,3.6015865802764893,3.0949935913085938,81.14050197601318,2 +2352,0.24465519189834595,0.399446964263916,0.384177029132843,0.2214452177286148,895.4498291015625,1e-05,0.1412060707807541,2.8541014194488525,81.14050197601318,2 +2353,0.31647059321403503,0.19409950077533722,0.19967640936374664,0.20629370212554932,894.3345947265625,1e-05,0.15822140872478485,3.3404009342193604,81.14050197601318,2 +2354,0.1728924661874771,0.2062280923128128,0.2201521247625351,0.24871794879436493,610.396240234375,1e-05,0.121235691010952,3.2870211601257324,81.14050197601318,2 +2355,0.4302806854248047,0.2668561637401581,0.28018835186958313,0.24405594170093536,671.7659301757812,1e-05,0.14995382726192474,3.125474452972412,81.14050197601318,2 +2356,0.2122015804052353,0.3149387240409851,0.3113457262516022,0.2769230902194977,910.0397338867188,1e-05,0.14412999153137207,3.132412910461426,81.14050197601318,2 +2357,0.3616575300693512,0.3884744644165039,0.389617919921875,0.012820512987673283,263.79840087890625,1e-05,0.11149854958057404,3.1395299434661865,81.14050197601318,2 +2358,0.1941489726305008,0.36027052998542786,0.37599194049835205,0.22890442609786987,996.0327758789062,1e-05,0.1500941812992096,2.8212225437164307,81.14050197601318,2 +2359,0.3850763440132141,0.3714770972728729,0.38452666997909546,0.18158508837223053,421.0982971191406,1e-05,0.14810658991336823,3.3988637924194336,81.14050197601318,2 +2360,0.2715087831020355,0.3037097156047821,0.3053593039512634,0.29440557956695557,854.2249145507812,1e-05,0.11590874195098877,3.079314947128296,81.14050197601318,2 +2361,0.25852301716804504,0.25507211685180664,0.25422152876853943,0.09254079312086105,725.7503051757812,1e-05,0.10806233435869217,3.123898983001709,81.14050197601318,2 +2362,0.2444266676902771,0.39088431000709534,0.39871346950531006,0.16317015886306763,973.4141235351562,1e-05,0.11988279968500137,3.1264286041259766,81.14050197601318,2 +2363,0.35440972447395325,0.2357940524816513,0.24000537395477295,0.21491841971874237,770.1734008789062,1e-05,0.13973169028759003,3.1608786582946777,81.14050197601318,2 +2364,0.3030080497264862,0.20852044224739075,0.2301546335220337,0.22960372269153595,894.3345947265625,1e-05,0.15009856224060059,2.8443758487701416,81.14050197601318,2 +2365,0.2760694622993469,0.4071428179740906,0.4129646122455597,0.24848484992980957,978.7633666992188,1e-05,0.10838151723146439,3.367438793182373,81.14050197601318,2 +2366,0.4412868916988373,0.3465486168861389,0.3550526797771454,0.18251748383045197,969.9888916015625,1e-05,0.1607845425605774,3.1973605155944824,81.14050197601318,2 +2367,0.21944960951805115,0.3068338930606842,0.3134286403656006,0.09580419212579727,924.9560546875,1e-05,0.13905340433120728,3.1436877250671387,81.14050197601318,2 +2368,0.19478420913219452,0.3587542474269867,0.3495629131793976,0.15780885517597198,920.605224609375,1e-05,0.15717872977256775,3.136195182800293,81.14050197601318,2 +2369,0.3750796616077423,0.28011196851730347,0.2783830463886261,0.1090909093618393,911.3367309570312,1e-05,0.19866472482681274,3.0906033515930176,81.14050197601318,2 +2370,0.3074977993965149,0.27406421303749084,0.27487069368362427,0.2209790199995041,895.0792846679688,1e-05,0.12642501294612885,2.8449747562408447,81.14050197601318,2 +2371,0.39810580015182495,0.22898171842098236,0.240169957280159,0.23846153914928436,733.1973266601562,1e-05,0.242300346493721,3.350680351257324,81.14050197601318,2 +2372,0.32456567883491516,0.3215729296207428,0.31859877705574036,0.13916084170341492,959.7694091796875,1e-05,0.16124071180820465,3.1810481548309326,81.14050197601318,2 +2373,0.4188688099384308,0.28566643595695496,0.2919843792915344,0.1850815862417221,905.37890625,1e-05,0.19791826605796814,3.117621660232544,81.14050197601318,2 +2374,0.48627838492393494,0.48623186349868774,0.49167412519454956,0.22680652141571045,165.13217163085938,1e-05,0.11294744163751602,3.106311559677124,81.14050197601318,2 +2375,0.23503528535366058,0.5378158092498779,0.5497384667396545,0.09370629489421844,133.62509155273438,1e-05,0.14115101099014282,3.1590495109558105,81.14050197601318,2 +2376,0.2751725912094116,0.369804710149765,0.36473819613456726,0.23310023546218872,979.54296875,1e-05,0.19808140397071838,2.8297269344329834,81.14050197601318,2 +2377,0.31018370389938354,0.2880017161369324,0.29642176628112793,0.20000000298023224,993.5120239257812,1e-05,0.26133471727371216,3.330432653427124,81.14050197601318,2 +2378,0.08914849907159805,0.2638111710548401,0.2740769386291504,0.12890443205833435,954.6907958984375,1e-05,0.18220193684101105,3.1964523792266846,81.14050197601318,2 +2379,0.4913928508758545,0.2762754559516907,0.28253743052482605,0.23449882864952087,882.1692504882812,1e-05,0.11802195757627487,3.0715625286102295,81.14050197601318,2 +2380,0.2489556074142456,0.33238327503204346,0.34486573934555054,0.14615385234355927,965.6807250976562,1e-05,0.1930481493473053,3.33520245552063,81.14050197601318,2 +2381,0.2917591631412506,0.33942437171936035,0.3349980115890503,0.19813519716262817,565.9164428710938,1e-05,0.12966078519821167,2.8425164222717285,81.14050197601318,2 +2382,0.3341165781021118,0.26630333065986633,0.27350300550460815,0.19953380525112152,940.2321166992188,1e-05,0.1354350596666336,2.847031831741333,81.14050197601318,2 +2383,0.28422531485557556,0.3244083821773529,0.3136933445930481,0.1526806503534317,953.0025024414062,1e-05,0.17368902266025543,3.39499568939209,81.14050197601318,2 +2384,0.350861132144928,0.3305602967739105,0.3239428699016571,0.2421911358833313,936.49951171875,1e-05,0.15340162813663483,3.2471213340759277,81.14050197601318,2 +2385,0.32934802770614624,0.29703277349472046,0.2995053827762604,0.2365967333316803,707.6432495117188,1e-05,0.1127287894487381,3.1308114528656006,81.14050197601318,2 +2386,0.2166808396577835,0.31785592436790466,0.31868410110473633,0.2529137432575226,907.7332763671875,1e-05,0.12845200300216675,3.3550949096679688,81.14050197601318,2 +2387,0.3832271695137024,0.39390915632247925,0.40556764602661133,0.15081584453582764,976.3768310546875,1e-05,0.1547468602657318,2.8479976654052734,81.14050197601318,2 +2388,0.21475325524806976,0.3281829059123993,0.33242568373680115,0.18205128610134125,975.0736083984375,1e-05,0.12201675027608871,2.842581033706665,81.14050197601318,2 +2389,0.331565797328949,0.2321191430091858,0.24672125279903412,0.13100233674049377,612.1727294921875,1e-05,0.17178238928318024,3.3823626041412354,81.14050197601318,2 +2390,0.26984748244285583,0.19594800472259521,0.20113062858581543,0.056410256773233414,883.8079833984375,1e-05,0.13299940526485443,3.0082075595855713,81.14050197601318,2 +2391,0.2776927351951599,0.338899165391922,0.3427101969718933,0.21678321063518524,443.50128173828125,1e-05,0.1445426195859909,3.296769380569458,81.14050197601318,2 +2392,0.2883222699165344,0.3910861909389496,0.38467681407928467,0.2526806592941284,964.5680541992188,1e-05,0.1733504831790924,3.1343414783477783,81.14050197601318,2 +2393,0.3171127736568451,0.29273635149002075,0.2752174139022827,0.21631701290607452,885.4254760742188,1e-05,0.24267162382602692,2.838559627532959,81.14050197601318,2 +2394,0.3147556781768799,0.2887674570083618,0.2944782078266144,0.25524476170539856,637.4429931640625,1e-05,0.1353062093257904,2.8337509632110596,81.14050197601318,2 +2395,0.508141279220581,0.2568833827972412,0.2678688168525696,0.2209790199995041,737.33203125,1e-05,0.12787991762161255,4.020544052124023,81.14050197601318,2 +2396,0.15082301199436188,0.17678627371788025,0.18637900054454803,0.0855477824807167,869.15966796875,1e-05,0.1250813752412796,3.039437770843506,81.14050197601318,2 +2397,0.20919650793075562,0.24785707890987396,0.24501542747020721,0.1638694703578949,995.035400390625,1e-05,0.12642650306224823,3.426292657852173,81.14050197601318,2 +2398,0.34788164496421814,0.2637026309967041,0.279496967792511,0.24568764865398407,632.5867309570312,1e-05,0.11687363684177399,3.153555393218994,81.14050197601318,2 +2399,0.18458357453346252,0.3369351923465729,0.35265281796455383,0.23473192751407623,918.8137817382812,1e-05,0.12333659827709198,2.8518357276916504,81.14050197601318,2 +2400,0.31758254766464233,0.27409979701042175,0.27707669138908386,0.2578088641166687,930.2188720703125,1e-05,0.13085252046585083,3.157315731048584,81.14050197601318,2 +2401,0.41572752594947815,0.333943635225296,0.34023115038871765,0.22051282227039337,942.4046020507812,1e-05,0.26062512397766113,3.272904396057129,81.14050197601318,2 +2402,0.21908122301101685,0.27733370661735535,0.2860664129257202,0.2030303031206131,995.9088745117188,1e-05,0.2312002032995224,3.149475574493408,81.14050197601318,2 +2403,0.3099784553050995,0.21125870943069458,0.21894146502017975,0.10722610354423523,565.9164428710938,1e-05,0.12999558448791504,3.163593292236328,81.14050197601318,2 +2404,0.3379921615123749,0.29896584153175354,0.30877813696861267,0.21398600935935974,446.5873107910156,1e-05,0.13519665598869324,3.1300950050354004,81.14050197601318,2 +2405,0.25748562812805176,0.27310505509376526,0.27573299407958984,0.2142191082239151,825.6151733398438,1e-05,0.17041513323783875,2.8405230045318604,81.14050197601318,2 +2406,0.5493625402450562,0.281322181224823,0.28311043977737427,0.2142191082239151,925.8049926757812,1e-05,1.2240519523620605,3.043287754058838,81.14050197601318,2 +2407,0.23889197409152985,0.20911575853824615,0.2378142923116684,0.24405594170093536,959.3736572265625,1e-05,0.18268848955631256,3.056770086288452,81.14050197601318,2 +2408,0.17226572334766388,0.1681719571352005,0.18033139407634735,0.07948718219995499,649.9450073242188,1e-05,0.17584151029586792,3.3931047916412354,81.14050197601318,2 +2409,0.39884504675865173,0.27357056736946106,0.2796575129032135,0.22400932013988495,850.0933227539062,1e-05,0.2973037362098694,3.0752720832824707,81.14050197601318,2 +2410,0.3441919684410095,0.30155304074287415,0.29907140135765076,0.17482517659664154,751.1552734375,1e-05,0.1340770572423935,3.115295648574829,81.14050197601318,2 +2411,0.41467049717903137,0.33752569556236267,0.33246946334838867,0.2526806592941284,813.4014892578125,1e-05,0.17159207165241241,2.8377151489257812,81.14050197601318,2 +2412,0.24009063839912415,0.2299022078514099,0.226312056183815,0.1822843849658966,774.4262084960938,1e-05,0.1401437222957611,3.064028024673462,81.14050197601318,2 +2413,0.3035506010055542,0.2834717631340027,0.28931888937950134,0.2097902148962021,741.38232421875,1e-05,0.11968455463647842,3.0983498096466064,81.14050197601318,2 +2414,0.2033880203962326,0.21922630071640015,0.23017744719982147,0.1806526780128479,931.56005859375,1e-05,0.09432808309793472,3.9952492713928223,81.14050197601318,2 +2415,0.2706649899482727,0.23931284248828888,0.27567774057388306,0.238228440284729,434.07476806640625,1e-05,0.12457198649644852,3.1179420948028564,81.14050197601318,2 +2416,0.35324957966804504,0.2742552161216736,0.2844376266002655,0.21608391404151917,944.7620849609375,1e-05,0.1321108490228653,3.162659168243408,81.14050197601318,2 +2417,0.34219974279403687,0.37999218702316284,0.38861119747161865,0.21794871985912323,988.8717041015625,1e-05,0.11972888559103012,2.83976674079895,81.14050197601318,2 +2418,0.1858559548854828,0.26332393288612366,0.2843618392944336,0.25314685702323914,957.1648559570312,1e-05,0.11814714968204498,3.388814687728882,81.14050197601318,2 +2419,0.17439095675945282,0.23165759444236755,0.2374865859746933,0.139860138297081,897.6493530273438,1e-05,0.16976472735404968,3.0932769775390625,81.14050197601318,2 +2420,0.2277982383966446,0.3810240924358368,0.3836451470851898,0.2265734225511551,981.38232421875,1e-05,0.2890431582927704,3.3885655403137207,81.14050197601318,2 +2421,0.30589520931243896,0.4183937907218933,0.401347815990448,0.23170162737369537,975.0736083984375,1e-05,0.13572657108306885,3.1490237712860107,81.14050197601318,2 +2422,0.2526111900806427,0.338358610868454,0.36456894874572754,0.20839160680770874,978.4493408203125,1e-05,0.4841122329235077,3.1514337062835693,81.14050197601318,2 +2423,0.17620690166950226,0.2863626480102539,0.2849147915840149,0.16456876695156097,649.9450073242188,1e-05,0.20473900437355042,2.8416476249694824,81.14050197601318,2 +2424,0.3207656443119049,0.28891777992248535,0.2903834283351898,0.10419580340385437,935.22314453125,1e-05,0.1458364576101303,3.1521852016448975,81.14050197601318,2 +2425,0.12208837270736694,0.29049262404441833,0.30211305618286133,0.16363635659217834,906.7301635742188,1e-05,0.12080484628677368,3.0526938438415527,81.14050197601318,2 +2426,0.18474137783050537,0.2568689286708832,0.26855653524398804,0.21398600935935974,797.99267578125,1e-05,0.1119886189699173,3.3316378593444824,81.14050197601318,2 +2427,0.28754284977912903,0.25958865880966187,0.2734091877937317,0.23006993532180786,862.6173095703125,1e-05,0.15965670347213745,3.1092429161071777,81.14050197601318,2 +2428,0.47740063071250916,0.19655713438987732,0.21501030027866364,0.2780885696411133,747.3050537109375,1e-05,0.1395295262336731,2.8415756225585938,81.14050197601318,2 +2429,0.3957677483558655,0.34933990240097046,0.3274298906326294,0.22610722482204437,938.756103515625,1e-05,0.11887261271476746,2.8369901180267334,81.14050197601318,2 +2430,0.3192633390426636,0.3362271189689636,0.3380798101425171,0.18694639205932617,958.576904296875,1e-05,0.13262993097305298,3.126014232635498,81.14050197601318,2 +2431,0.3186183571815491,0.2736797630786896,0.29224687814712524,0.2181818187236786,939.7424926757812,1e-05,0.14292794466018677,3.063380241394043,81.14050197601318,2 +2432,0.28444361686706543,0.21717190742492676,0.22785304486751556,0.21351981163024902,885.8264770507812,1e-05,0.09159491956233978,3.4043078422546387,81.14050197601318,2 +2433,0.31051403284072876,0.19227957725524902,0.20066484808921814,0.22331002354621887,731.0974731445312,1e-05,0.14741258323192596,3.151449203491211,81.14050197601318,2 +2434,0.2544468641281128,0.24565254151821136,0.2619454264640808,0.22121211886405945,870.0686645507812,1e-05,0.11107255518436432,2.83831787109375,81.14050197601318,2 +2435,0.3518179953098297,0.4132060706615448,0.43084263801574707,0.23123542964458466,305.9609069824219,1e-05,0.14244593679904938,2.841878890991211,81.14050197601318,2 +2436,0.18154683709144592,0.3797430098056793,0.3954429626464844,0.16433566808700562,966.414306640625,1e-05,0.13502368330955505,3.315152168273926,81.14050197601318,2 +2437,0.3627968728542328,0.3009707033634186,0.31310683488845825,0.1107226088643074,858.7315673828125,1e-05,0.22594128549098969,3.0494091510772705,81.14050197601318,2 +2438,0.3510288894176483,0.30475249886512756,0.3079165816307068,0.21072261035442352,892.0726318359375,1e-05,0.8603584170341492,3.07218861579895,81.14050197601318,2 +2439,0.33190107345581055,0.3101523518562317,0.318468302488327,0.19393938779830933,912.6188354492188,1e-05,0.1144598051905632,3.100393295288086,81.14050197601318,2 +2440,0.2474229782819748,0.20331674814224243,0.22104014456272125,0.2242424190044403,943.1180419921875,1e-05,0.13053807616233826,2.8540103435516357,81.14050197601318,2 +2441,0.4003024995326996,0.19611161947250366,0.2286972552537918,0.2074592113494873,969.2862548828125,1e-05,0.12712261080741882,3.055433988571167,81.14050197601318,2 +2442,0.4281863272190094,0.2972593605518341,0.3139953911304474,0.21351981163024902,999.53125,1e-05,0.15617914497852325,3.3893401622772217,81.14050197601318,2 +2443,0.22408901154994965,0.3801635801792145,0.36618080735206604,0.19766899943351746,960.9456176757812,1e-05,0.1397343873977661,3.0558907985687256,81.14050197601318,2 +2444,0.4397091865539551,0.2884118854999542,0.2937272787094116,0.20279720425605774,871.8681030273438,1e-05,0.18344561755657196,3.0817668437957764,81.14050197601318,2 +2445,0.26764732599258423,0.2415962666273117,0.24061711132526398,0.18298368155956268,801.6233520507812,1e-05,0.1654512584209442,3.0770866870880127,81.14050197601318,2 +2446,0.373988538980484,0.2928506135940552,0.3072783648967743,0.1850815862417221,896.1876220703125,1e-05,0.17988356947898865,2.8478024005889893,81.14050197601318,2 +2447,0.25574997067451477,0.37188196182250977,0.36406388878822327,0.2554778456687927,962.1061401367188,1e-05,0.15066401660442352,3.066938877105713,81.14050197601318,2 +2448,0.3826442360877991,0.43197476863861084,0.45676156878471375,0.2214452177286148,183.10153198242188,1e-05,0.11170870065689087,3.13275146484375,81.14050197601318,2 +2449,0.2416389435529709,0.2437521070241928,0.25234559178352356,0.22237762808799744,861.6561889648438,1e-05,0.8944622278213501,3.09196400642395,81.14050197601318,2 +2450,0.18950027227401733,0.2758747637271881,0.2854617238044739,0.1818181872367859,952.5755615234375,1e-05,0.14503882825374603,3.118769645690918,81.14050197601318,2 +2451,0.28968191146850586,0.3594455122947693,0.3754946291446686,0.25524476170539856,427.6461486816406,1e-05,0.11449914425611496,3.096808910369873,81.14050197601318,2 +2452,0.3248082995414734,0.2410995364189148,0.25560835003852844,0.22400932013988495,670.3726196289062,1e-05,0.13943658769130707,2.8359153270721436,81.14050197601318,2 +2453,0.3578473925590515,0.2350204437971115,0.2603853940963745,0.15617716312408447,931.2932739257812,1e-05,0.15772609412670135,3.0480198860168457,81.14050197601318,2 +2454,0.25383633375167847,0.2113763391971588,0.22843864560127258,0.2282051295042038,968.3995361328125,1e-05,0.12412053346633911,3.104426383972168,81.14050197601318,2 +2455,0.41673338413238525,0.38968420028686523,0.3923579752445221,0.21212121844291687,390.0654296875,1e-05,0.12637794017791748,3.294487476348877,81.14050197601318,2 +2456,0.4000643789768219,0.21884270012378693,0.24144087731838226,0.18391607701778412,891.6915283203125,1e-05,0.1518338918685913,2.8407142162323,81.14050197601318,2 +2457,0.3335725665092468,0.3554576337337494,0.34822627902030945,0.220279723405838,965.6807250976562,1e-05,0.12794247269630432,3.0819344520568848,81.14050197601318,2 +2458,0.35288935899734497,0.30151891708374023,0.31476277112960815,0.1895104944705963,561.6887817382812,1e-05,0.21499237418174744,2.8475708961486816,81.14050197601318,2 +2459,0.2913511395454407,0.26609888672828674,0.27262264490127563,0.2365967333316803,663.2779541015625,1e-05,0.6201706528663635,3.1202521324157715,81.14050197601318,2 +2460,0.16130147874355316,0.3374791443347931,0.3437754511833191,0.06666667014360428,935.9909057617188,1e-05,0.19443851709365845,3.151931047439575,81.14050197601318,2 +2461,0.2207273244857788,0.3339461088180542,0.3296431005001068,0.1762237697839737,979.54296875,1e-05,0.10631432384252548,3.2671146392822266,81.14050197601318,2 +2462,0.22281908988952637,0.19023346900939941,0.2061372548341751,0.09347319602966309,967.322509765625,1e-05,0.13461792469024658,2.8417840003967285,81.14050197601318,2 +2463,0.2739378809928894,0.2349262833595276,0.24539123475551605,0.1986013948917389,570.0819702148438,1e-05,0.11149585992097855,3.1026086807250977,81.14050197601318,2 +2464,0.1579076200723648,0.319985032081604,0.31828704476356506,0.21351981163024902,978.6064453125,1e-05,0.11867205798625946,2.8358728885650635,81.14050197601318,2 +2465,0.4264953136444092,0.4596599340438843,0.46125829219818115,0.16969697177410126,248.77369689941406,1e-05,0.13604570925235748,3.070422410964966,81.14050197601318,2 +2466,0.2146829217672348,0.2901887595653534,0.28914546966552734,0.24009324610233307,731.0974731445312,1e-05,0.36151695251464844,3.2042477130889893,81.14050197601318,2 +2467,0.14234715700149536,0.27148380875587463,0.27029991149902344,0.22960372269153595,926.9263305664062,1e-05,0.10975923389196396,3.110238790512085,81.14050197601318,2 +2468,0.18627552688121796,0.4447787404060364,0.4351162910461426,0.20629370212554932,988.18359375,1e-05,0.27874302864074707,2.8419277667999268,81.14050197601318,2 +2469,0.3418654799461365,0.24167264997959137,0.24900060892105103,0.15571095049381256,790.488037109375,1e-05,0.20117591321468353,3.1564762592315674,81.14050197601318,2 +2470,0.38000914454460144,0.44112005829811096,0.4494899809360504,0.21631701290607452,323.4160461425781,1e-05,0.2180788516998291,3.160468816757202,81.14050197601318,2 +2471,0.26925620436668396,0.36931708455085754,0.3845103979110718,0.17132866382598877,942.1655883789062,1e-05,0.1206478700041771,3.297947883605957,81.14050197601318,2 +2472,0.17906057834625244,0.2469688355922699,0.26280057430267334,0.2114219069480896,841.452880859375,1e-05,0.09321437031030655,3.299710750579834,81.14050197601318,2 +2473,0.4007652699947357,0.2746545970439911,0.27800390124320984,0.23286713659763336,730.0392456054688,1e-05,0.12310132384300232,3.64795184135437,81.14050197601318,2 +2474,0.2978692054748535,0.3211567997932434,0.3177925646305084,0.22517482936382294,992.7376708984375,1e-05,0.12187241017818451,3.1138105392456055,81.14050197601318,2 +2475,0.22233140468597412,0.338945597410202,0.3277609050273895,0.22610722482204437,919.7131958007812,1e-05,0.14029836654663086,2.8435544967651367,81.14050197601318,2 +2476,0.5211237072944641,0.3196921944618225,0.3204171359539032,0.18531468510627747,958.9761352539062,1e-05,0.16481530666351318,3.0821375846862793,81.14050197601318,2 +2477,0.23212428390979767,0.2442421168088913,0.2549246549606323,0.260606050491333,840.3358154296875,1e-05,0.13630886375904083,3.1034624576568604,81.14050197601318,2 +2478,0.2905755639076233,0.3163377046585083,0.31784695386886597,0.0979020968079567,982.1359252929688,1e-05,0.17295007407665253,3.0627310276031494,81.14050197601318,2 +2479,0.14080710709095,0.2535935044288635,0.26580870151519775,0.19393938779830933,911.9796752929688,1e-05,0.4842471480369568,3.0777456760406494,81.14050197601318,2 +2480,0.376009464263916,0.20629653334617615,0.22929030656814575,0.16480186581611633,824.99560546875,1e-05,0.11953514069318771,3.1594386100769043,81.14050197601318,2 +2481,0.5501930117607117,0.19351857900619507,0.2006048858165741,0.11002331227064133,751.1552734375,1e-05,0.1578599065542221,2.8308348655700684,81.14050197601318,2 +2482,0.5332567691802979,0.28044572472572327,0.2832754850387573,0.24475523829460144,776.0996704101562,1e-05,0.19461371004581451,3.0634605884552,81.14050197601318,2 +2483,0.32769858837127686,0.23478373885154724,0.23699304461479187,0.1034965068101883,737.33203125,1e-05,0.13271021842956543,3.1163454055786133,81.14050197601318,2 +2484,0.3367575705051422,0.26592156291007996,0.27604928612709045,0.2282051295042038,923.8132934570312,1e-05,0.1809462308883667,3.060753345489502,81.14050197601318,2 +2485,0.1881159245967865,0.23792095482349396,0.23049262166023254,0.220279723405838,900.8737182617188,1e-05,0.2646513283252716,3.1036176681518555,81.14050197601318,2 +2486,0.31039485335350037,0.3082100749015808,0.31858575344085693,0.25361305475234985,941.685791015625,1e-05,0.10495379567146301,3.140817880630493,81.14050197601318,2 +2487,0.32544705271720886,0.25270724296569824,0.2602570354938507,0.238228440284729,932.6204223632812,1e-05,0.23450620472431183,2.8481719493865967,81.14050197601318,2 +2488,0.23274748027324677,0.2131790965795517,0.23311340808868408,0.22610722482204437,880.5089721679688,1e-05,0.1323615461587906,3.1152915954589844,81.14050197601318,2 +2489,0.48271143436431885,0.35816314816474915,0.3694975674152374,0.20093239843845367,446.5873107910156,1e-05,0.24255190789699554,3.2483973503112793,81.14050197601318,2 +2490,0.3554309904575348,0.20995254814624786,0.22355717420578003,0.09417249262332916,733.1973266601562,1e-05,0.1861760914325714,3.1050937175750732,81.14050197601318,2 +2491,0.25340786576271057,0.31896597146987915,0.3182407319545746,0.19720280170440674,931.025634765625,1e-05,0.14841389656066895,3.344320297241211,81.14050197601318,2 +2492,0.27743497490882874,0.3558896481990814,0.3606650233268738,0.2265734225511551,513.177978515625,1e-05,0.13434547185897827,2.8346312046051025,81.14050197601318,2 +2493,0.2515910267829895,0.28174254298210144,0.28118211030960083,0.20279720425605774,922.947998046875,1e-05,0.13232624530792236,2.833493947982788,81.14050197601318,2 +2494,0.17107419669628143,0.3011304438114166,0.3099038898944855,0.2594405710697174,931.025634765625,1e-05,0.12323339283466339,3.2674365043640137,81.14050197601318,2 +2495,0.3462374210357666,0.33118605613708496,0.3455873727798462,0.25151515007019043,963.818115234375,1e-05,0.15898704528808594,3.337143659591675,81.14050197601318,2 +2496,0.3277430832386017,0.29983827471733093,0.3031129240989685,0.1874125897884369,795.030517578125,1e-05,0.2572145462036133,3.3374974727630615,81.14050197601318,2 +2497,0.32669076323509216,0.20895445346832275,0.22164657711982727,0.1694638729095459,946.378173828125,1e-05,0.3020370602607727,3.3544344902038574,81.14050197601318,2 +2498,0.2983378767967224,0.3174125850200653,0.31413179636001587,0.16969697177410126,918.2099609375,1e-05,0.1930312216281891,2.853508710861206,81.14050197601318,2 +2499,0.19354604184627533,0.25314393639564514,0.26244959235191345,0.12727272510528564,930.7574462890625,1e-05,0.13288573920726776,2.8522233963012695,81.14050197601318,2 +2500,0.22820313274860382,0.32002702355384827,0.3295823037624359,0.13286712765693665,904.0114135742188,1e-05,0.2914348244667053,3.1008400917053223,81.14050197601318,2 +2501,0.32128921151161194,0.3148847818374634,0.32389992475509644,0.1958041936159134,895.0792846679688,1e-05,0.1729608029127121,3.170833110809326,81.14050197601318,2 +2502,0.15731357038021088,0.3169403374195099,0.33644118905067444,0.2086247056722641,968.7553100585938,1e-05,0.1119120642542839,3.0987966060638428,81.14050197601318,2 +2503,0.2465588003396988,0.37015119194984436,0.368634968996048,0.19696970283985138,397.1928405761719,1e-05,0.12511859834194183,3.391950845718384,81.14050197601318,2 +2504,0.1704806536436081,0.3161433935165405,0.31204962730407715,0.2230769246816635,967.5030517578125,1e-05,0.09167961031198502,2.825056552886963,81.14050197601318,2 +2505,0.2374516874551773,0.3150528073310852,0.31784501671791077,0.22331002354621887,938.5079956054688,1e-05,0.12703214585781097,3.1811599731445312,81.14050197601318,2 +2506,0.17052964866161346,0.4058590531349182,0.38983821868896484,0.16899767518043518,978.9199829101562,1e-05,0.11282122880220413,3.338334321975708,81.14050197601318,2 +2507,0.33721256256103516,0.2509689927101135,0.2536935806274414,0.0839160829782486,774.4262084960938,1e-05,0.1580328494310379,3.4422225952148438,81.14050197601318,2 +2508,0.3501749336719513,0.22645440697669983,0.23269887268543243,0.1382284313440323,513.177978515625,1e-05,0.15796352922916412,2.8367912769317627,81.14050197601318,2 +2509,0.20925775170326233,0.2748693823814392,0.28053998947143555,0.1442890465259552,905.7181396484375,1e-05,0.2696302533149719,3.443480968475342,81.14050197601318,2 +2510,0.336856484413147,0.35021379590034485,0.3419284224510193,0.14965035021305084,856.2459106445312,1e-05,0.1699347048997879,2.83123517036438,81.14050197601318,2 +2511,0.28024953603744507,0.26958537101745605,0.2840125858783722,0.21561771631240845,996.2799072265625,1e-05,0.2611737549304962,3.1051909923553467,81.14050197601318,2 +2512,0.411029577255249,0.305774986743927,0.31995823979377747,0.19393938779830933,976.5382080078125,1e-05,0.12572930753231049,3.2944633960723877,81.14050197601318,2 +2513,0.2042018175125122,0.33705785870552063,0.346643328666687,0.21934731304645538,965.6807250976562,1e-05,0.10331136733293533,3.710232973098755,81.14050197601318,2 +2514,0.3746190071105957,0.43151360750198364,0.4339839816093445,0.12284382432699203,253.83924865722656,1e-05,0.09998975694179535,3.1301662921905518,81.14050197601318,2 +2515,0.37425708770751953,0.4202151596546173,0.42056843638420105,0.14848484098911285,967.1416625976562,1e-05,0.13169057667255402,3.1740036010742188,81.14050197601318,2 +2516,0.33953046798706055,0.29091498255729675,0.3077956438064575,0.22074592113494873,943.8261108398438,1e-05,0.1306193470954895,2.8334803581237793,81.14050197601318,2 +2517,0.42974355816841125,0.2944946587085724,0.30943259596824646,0.2321678251028061,557.397705078125,1e-05,0.14628227055072784,3.0535848140716553,81.14050197601318,2 +2518,0.3329787850379944,0.39275187253952026,0.40533071756362915,0.1862470805644989,283.0556640625,1e-05,0.10723013430833817,3.0765349864959717,81.14050197601318,2 +2519,0.28807082772254944,0.22550421953201294,0.24819022417068481,0.17132866382598877,981.38232421875,1e-05,0.10181248933076859,3.3166372776031494,81.14050197601318,2 +2520,0.1768568754196167,0.28438878059387207,0.28930607438087463,0.151048943400383,848.5123291015625,1e-05,0.2553809881210327,3.0661048889160156,81.14050197601318,2 +2521,0.24915049970149994,0.1978573054075241,0.20965655148029327,0.10372960567474365,804.4718627929688,1e-05,0.30335164070129395,3.0882389545440674,81.14050197601318,2 +2522,0.36680400371551514,0.26326432824134827,0.28188177943229675,0.22773893177509308,834.6194458007812,1e-05,0.17423664033412933,2.8372397422790527,81.14050197601318,2 +2523,0.18149715662002563,0.2398868203163147,0.24759487807750702,0.20769231021404266,848.5123291015625,1e-05,0.0866219773888588,3.13967227935791,81.14050197601318,2 +2524,0.21193186938762665,0.32190123200416565,0.3143651783466339,0.21911421418190002,926.0864868164062,1e-05,0.19219185411930084,3.3532724380493164,81.14050197601318,2 +2525,0.44767290353775024,0.1669807881116867,0.18063127994537354,0.24242423474788666,880.5089721679688,1e-05,0.1701246052980423,3.3899450302124023,81.14050197601318,2 +2526,0.23866698145866394,0.20088107883930206,0.20890302956104279,0.2142191082239151,916.991943359375,1e-05,0.2036503106355667,3.1005361080169678,81.14050197601318,2 +2527,0.3035227656364441,0.4037506580352783,0.41395944356918335,0.2354312390089035,292.3681640625,1e-05,0.11197253316640854,3.1560235023498535,81.14050197601318,2 +2528,0.298125296831131,0.16867250204086304,0.18211285769939423,0.17878787219524384,913.5706787109375,1e-05,0.14274564385414124,3.069997787475586,81.14050197601318,2 +2529,0.32752954959869385,0.40701135993003845,0.41769853234291077,0.16037295758724213,999.8831176757812,1e-05,0.18836621940135956,3.0332539081573486,81.14050197601318,2 +2530,0.12022358924150467,0.23102982342243195,0.24324777722358704,0.19533799588680267,977.4996337890625,1e-05,0.1147821843624115,3.38420033454895,81.14050197601318,2 +2531,0.3522915244102478,0.274166077375412,0.27882716059684753,0.18018648028373718,737.33203125,1e-05,0.14278101921081543,3.0208780765533447,81.14050197601318,2 +2532,0.3066399097442627,0.3036423325538635,0.30474400520324707,0.14685314893722534,757.7117919921875,1e-05,0.11213615536689758,3.430506706237793,81.14050197601318,2 +2533,0.3016560673713684,0.31352752447128296,0.3116910755634308,0.24428904056549072,758.630126953125,1e-05,0.12385106086730957,2.841501235961914,81.14050197601318,2 +2534,0.19924822449684143,0.3122256398200989,0.31209924817085266,0.23170162737369537,882.9913330078125,1e-05,0.10406430810689926,3.0537796020507812,81.14050197601318,2 +2535,0.18623244762420654,0.20876726508140564,0.22574400901794434,0.1946386992931366,667.560546875,1e-05,0.14338400959968567,3.0183157920837402,81.14050197601318,2 +2536,0.20837874710559845,0.29185229539871216,0.3011426031589508,0.08041957765817642,949.5288696289062,1e-05,0.17175503075122833,3.426177740097046,81.14050197601318,2 +2537,0.35913026332855225,0.29709938168525696,0.2982748746871948,0.2846153974533081,936.7528076171875,1e-05,0.1581277698278427,3.0491526126861572,81.14050197601318,2 +2538,0.23605184257030487,0.26135876774787903,0.27697834372520447,0.12657342851161957,939.9876098632812,1e-05,0.18297624588012695,3.369776487350464,81.14050197601318,2 +2539,0.12633275985717773,0.3119877874851227,0.3199807107448578,0.14801864326000214,944.2952880859375,1e-05,0.10764658451080322,2.8331663608551025,81.14050197601318,2 +2540,0.37271806597709656,0.6101172566413879,0.6228227615356445,0.2097902148962021,106.90462493896484,1e-05,0.19524379074573517,3.1017651557922363,81.14050197601318,2 +2541,0.38381141424179077,0.41507408022880554,0.4201550781726837,0.24638694524765015,268.69403076171875,1e-05,0.29517245292663574,3.0544137954711914,81.14050197601318,2 +2542,0.1379919797182083,0.45775479078292847,0.445200115442276,0.19696970283985138,989.8240966796875,1e-05,0.1355871558189392,3.3838255405426025,81.14050197601318,2 +2543,0.22876225411891937,0.2214457243680954,0.2466837614774704,0.2310023307800293,960.7506713867188,1e-05,0.14854703843593597,2.827406406402588,81.14050197601318,2 +2544,0.22587931156158447,0.20246584713459015,0.20305725932121277,0.19137528538703918,944.7620849609375,1e-05,0.15147550404071808,3.125321626663208,81.14050197601318,2 +2545,0.2240077704191208,0.33502471446990967,0.3411591053009033,0.07529137283563614,964.5680541992188,1e-05,0.4104045033454895,2.828397750854492,81.14050197601318,2 +2546,0.3034704029560089,0.3398328721523285,0.35371077060699463,0.14965035021305084,635.8348388671875,1e-05,0.10950981825590134,3.0249454975128174,81.14050197601318,2 +2547,0.3865230977535248,0.2095239907503128,0.21410231292247772,0.2282051295042038,798.72509765625,1e-05,0.24928797781467438,3.102642059326172,81.14050197601318,2 +2548,0.1981438547372818,0.2501712739467621,0.25397783517837524,0.23706293106079102,913.5706787109375,1e-05,0.09893770515918732,3.3716723918914795,81.14050197601318,2 +2549,0.28155598044395447,0.4658823311328888,0.48829665780067444,0.21678321063518524,233.2209930419922,1e-05,0.208126962184906,2.8381357192993164,81.14050197601318,2 +2550,0.15779219567775726,0.3146331310272217,0.31337013840675354,0.15198135375976562,934.1901245117188,1e-05,0.15814051032066345,3.1515085697174072,81.14050197601318,2 +2551,0.2677997052669525,0.3563210070133209,0.3578719198703766,0.06480186432600021,620.8772583007812,1e-05,0.12367331981658936,3.27494215965271,81.14050197601318,2 +2552,0.35159948468208313,0.37364351749420166,0.38892146944999695,0.19720280170440674,982.5844116210938,1e-05,0.11696536839008331,3.0340335369110107,81.14050197601318,2 +2553,0.2578636109828949,0.23659667372703552,0.2530772089958191,0.10652680695056915,942.4046020507812,1e-05,0.13130508363246918,3.095015287399292,81.14050197601318,2 +2554,0.17932680249214172,0.2622813880443573,0.2604109048843384,0.2526806592941284,961.5278930664062,1e-05,0.3077973425388336,3.2742090225219727,81.14050197601318,2 +2555,0.31788671016693115,0.594944953918457,0.6085788607597351,0.2764568626880646,183.10153198242188,1e-05,0.15067680180072784,3.1544554233551025,81.14050197601318,2 +2556,0.23131601512432098,0.314573734998703,0.31759923696517944,0.21072261035442352,913.2542724609375,1e-05,0.12717263400554657,3.1404478549957275,81.14050197601318,2 +2557,0.3805629312992096,0.2689380347728729,0.26012349128723145,0.2310023307800293,859.7134399414062,1e-05,0.12330283224582672,2.8353192806243896,81.14050197601318,2 +2558,0.2600540518760681,0.3175082802772522,0.3372915983200073,0.17529137432575226,712.31884765625,1e-05,0.15770700573921204,3.077366590499878,81.14050197601318,2 +2559,0.3798241913318634,0.33939939737319946,0.3412967026233673,0.25874125957489014,268.69403076171875,1e-05,0.1356775462627411,3.2312889099121094,81.14050197601318,2 +2560,0.2572382986545563,0.3677026331424713,0.3705046474933624,0.220279723405838,995.9088745117188,1e-05,0.2981189787387848,3.296761989593506,81.14050197601318,2 +2561,0.21895822882652283,0.3225395679473877,0.31904301047325134,0.18578088283538818,922.0755004882812,1e-05,0.12928439676761627,3.1354894638061523,81.14050197601318,2 +2562,0.3237835168838501,0.4775102138519287,0.48464730381965637,0.20372959971427917,367.8310546875,1e-05,0.11113099008798599,2.83791184425354,81.14050197601318,2 +2563,0.25890523195266724,0.25757303833961487,0.24803176522254944,0.11888112127780914,953.639404296875,1e-05,0.16973045468330383,3.04502534866333,81.14050197601318,2 +2564,0.26763230562210083,0.2554955780506134,0.25408828258514404,0.09696969389915466,861.6561889648438,1e-05,0.1266385316848755,2.849397659301758,81.14050197601318,2 +2565,0.2165929675102234,0.33931413292884827,0.33651217818260193,0.16363635659217834,793.5297241210938,1e-05,0.3003025949001312,3.2833778858184814,81.14050197601318,2 +2566,0.3622392416000366,0.2884461581707001,0.30092328786849976,0.2230769246816635,779.4003295898438,1e-05,0.15829798579216003,3.0665438175201416,81.14050197601318,2 +2567,0.22990380227565765,0.24548517167568207,0.24927856028079987,0.23846153914928436,938.0095825195312,1e-05,0.1262415200471878,3.1536240577697754,81.14050197601318,2 +2568,0.19797910749912262,0.4399665594100952,0.44833120703697205,0.2902098000049591,990.36279296875,1e-05,0.1393064260482788,2.8326218128204346,81.14050197601318,2 +2569,0.27175888419151306,0.24072152376174927,0.2432830035686493,0.1610722541809082,883.8079833984375,1e-05,0.1545996516942978,3.070559024810791,81.14050197601318,2 +2570,0.27042752504348755,0.19697493314743042,0.21291027963161469,0.14778554439544678,487.06573486328125,1e-05,0.14026181399822235,3.0498554706573486,81.14050197601318,2 +2571,0.382373183965683,0.2749532163143158,0.2948947250843048,0.2599067687988281,461.6126403808594,1e-05,0.11371796578168869,3.0995590686798096,81.14050197601318,2 +2572,0.22980205714702606,0.17232467234134674,0.1993185430765152,0.23752914369106293,926.0864868164062,1e-05,0.10762619227170944,3.086637496948242,81.14050197601318,2 +2573,0.3544551730155945,0.24984221160411835,0.251932293176651,0.238228440284729,905.37890625,1e-05,0.12386095523834229,3.1687428951263428,81.14050197601318,2 +2574,0.06611912697553635,0.3638231158256531,0.3452300429344177,0.16923077404499054,989.2814331054688,1e-05,0.221272811293602,2.8325984477996826,81.14050197601318,2 +2575,0.4848162531852722,0.28253689408302307,0.28687384724617004,0.14172494411468506,386.44976806640625,1e-05,0.15533310174942017,3.20501446723938,81.14050197601318,2 +2576,0.3228326439857483,0.26448842883110046,0.2662090063095093,0.0951048955321312,484.3331604003906,1e-05,0.1097620353102684,3.066483497619629,81.14050197601318,2 +2577,0.1600119173526764,0.3069744110107422,0.3109419643878937,0.24032634496688843,942.1655883789062,1e-05,0.1179564818739891,3.104304552078247,81.14050197601318,2 +2578,0.18779245018959045,0.2923031449317932,0.2951681911945343,0.21958041191101074,828.0687866210938,1e-05,0.1275288164615631,3.0923006534576416,81.14050197601318,2 +2579,0.11384440213441849,0.41347455978393555,0.40403637290000916,0.20792540907859802,989.1450805664062,1e-05,0.11953124403953552,3.663628339767456,81.14050197601318,2 +2580,0.3342265188694,0.22082406282424927,0.23985598981380463,0.20000000298023224,740.3775634765625,1e-05,0.13361945748329163,2.8370766639709473,81.14050197601318,2 +2581,0.455002099275589,0.23219241201877594,0.23733749985694885,0.11445221304893494,709.9939575195312,1e-05,0.13774874806404114,3.1852405071258545,81.14050197601318,2 +2582,0.3457724153995514,0.2677707374095917,0.27538397908210754,0.22843822836875916,882.1692504882812,1e-05,0.1474674940109253,3.0753941535949707,81.14050197601318,2 +2583,0.35679149627685547,0.22427067160606384,0.23269209265708923,0.22237762808799744,854.7328491210938,1e-05,0.12899543344974518,3.2104320526123047,81.14050197601318,2 +2584,0.1533423811197281,0.2672596573829651,0.2700124680995941,0.11655011773109436,946.1489868164062,1e-05,0.19778038561344147,3.0683951377868652,81.14050197601318,2 +2585,0.3889677822589874,0.2055698037147522,0.2176988571882248,0.22284382581710815,868.2445068359375,1e-05,0.1477803885936737,3.2789511680603027,81.14050197601318,2 +2586,0.16529445350170135,0.30393755435943604,0.30493998527526855,0.21771562099456787,711.1596069335938,1e-05,0.08700032532215118,2.8291327953338623,81.14050197601318,2 +2587,0.20637919008731842,0.1578231006860733,0.17414356768131256,0.22890442609786987,864.0462646484375,1e-05,0.14137959480285645,3.142308235168457,81.14050197601318,2 +2588,0.34891974925994873,0.33570152521133423,0.3363298773765564,0.14801864326000214,557.397705078125,1e-05,0.1352325975894928,3.098357915878296,81.14050197601318,2 +2589,0.2963387370109558,0.3295888900756836,0.3287356495857239,0.21048951148986816,753.992919921875,1e-05,0.20613276958465576,3.2993552684783936,81.14050197601318,2 +2590,0.34469619393348694,0.33932533860206604,0.34808364510536194,0.2433566451072693,998.2254028320312,1e-05,0.1627652645111084,3.1007847785949707,81.14050197601318,2 +2591,0.10646304488182068,0.25085100531578064,0.25133639574050903,0.21282051503658295,975.5648193359375,1e-05,0.21002836525440216,3.371915340423584,81.14050197601318,2 +2592,0.2803904414176941,0.27436989545822144,0.28192511200904846,0.1878787875175476,914.8272094726562,1e-05,0.10367263108491898,2.842197895050049,81.14050197601318,2 +2593,0.41151416301727295,0.26654183864593506,0.2756447196006775,0.17575757205486298,969.1096801757812,1e-05,0.1315596103668213,3.1082515716552734,81.14050197601318,2 +2594,0.23090974986553192,0.26488834619522095,0.2746233642101288,0.23962703347206116,561.6887817382812,1e-05,0.11000844091176987,3.117079019546509,81.14050197601318,2 +2595,0.26997828483581543,0.22325143218040466,0.22123482823371887,0.17412588000297546,853.203369140625,1e-05,0.11223329603672028,3.1669204235076904,81.14050197601318,2 +2596,0.2650425136089325,0.4488004744052887,0.4638814628124237,0.272960364818573,959.7694091796875,1e-05,0.26283273100852966,3.120950698852539,81.14050197601318,2 +2597,0.42954379320144653,0.28730976581573486,0.29141196608543396,0.16596736013889313,943.1180419921875,1e-05,0.11700819432735443,3.1225528717041016,81.14050197601318,2 +2598,0.35153618454933167,0.24841143190860748,0.2732793390750885,0.11794871836900711,970.3380126953125,1e-05,0.1215459331870079,2.8292317390441895,81.14050197601318,2 +2599,0.20407763123512268,0.266775906085968,0.2858160138130188,0.26363635063171387,978.6064453125,1e-05,0.1180504560470581,3.055659532546997,81.14050197601318,2 +2600,0.30449923872947693,0.2244638353586197,0.23472341895103455,0.08531468361616135,578.2326049804688,1e-05,0.13441549241542816,3.517242908477783,81.14050197601318,2 +2601,0.3039908707141876,0.2709049880504608,0.2690831422805786,0.2002331018447876,898.7340087890625,1e-05,0.12643802165985107,3.264842987060547,81.14050197601318,2 +2602,0.25798434019088745,0.2654471695423126,0.3017301559448242,0.17855477333068848,948.1915893554688,1e-05,0.15071150660514832,3.2625720500946045,81.14050197601318,2 +2603,0.3034602999687195,0.31348565220832825,0.318566232919693,0.18974359333515167,863.5715942382812,1e-05,0.18304269015789032,3.136535406112671,81.14050197601318,2 +2604,0.10318112373352051,0.2591853737831116,0.2656779885292053,0.2013985961675644,855.2390747070312,1e-05,0.10645152628421783,2.841984748840332,81.14050197601318,2 +2605,0.1849709153175354,0.26749691367149353,0.2677992880344391,0.18694639205932617,700.4320068359375,1e-05,0.11233538389205933,3.0692074298858643,81.14050197601318,2 +2606,0.2749207317829132,0.2557551860809326,0.26619091629981995,0.2365967333316803,730.0392456054688,1e-05,0.10250396281480789,3.3183019161224365,81.14050197601318,2 +2607,0.2809422016143799,0.22519466280937195,0.23267972469329834,0.21328671276569366,948.1915893554688,1e-05,0.1290493756532669,3.361793041229248,81.14050197601318,2 +2608,0.13895204663276672,0.3150901794433594,0.32178768515586853,0.23636363446712494,955.3157958984375,1e-05,0.15010914206504822,3.289710521697998,81.14050197601318,2 +2609,0.21820273995399475,0.538463830947876,0.5159450769424438,0.2566433548927307,987.906494140625,1e-05,0.13622719049453735,3.131828546524048,81.14050197601318,2 +2610,0.28925949335098267,0.21750563383102417,0.23222680389881134,0.21678321063518524,814.732421875,1e-05,0.11265801638364792,2.836751937866211,81.14050197601318,2 +2611,0.24325114488601685,0.27313968539237976,0.2765344977378845,0.20000000298023224,670.3726196289062,1e-05,0.10822523385286331,3.061673641204834,81.14050197601318,2 +2612,0.3366581201553345,0.2361719310283661,0.25075075030326843,0.232634037733078,902.6273193359375,1e-05,0.10126488655805588,3.357257604598999,81.14050197601318,2 +2613,0.17441155016422272,0.34398147463798523,0.3468582034111023,0.2578088641166687,990.630615234375,1e-05,0.22959774732589722,3.039095163345337,81.14050197601318,2 +2614,0.30172714591026306,0.3007895052433014,0.3189094364643097,0.19207459688186646,570.0819702148438,1e-05,0.22681181132793427,3.089324951171875,81.14050197601318,2 +2615,0.3095741271972656,0.2597711980342865,0.27525562047958374,0.15687645971775055,806.5763549804688,1e-05,0.16184929013252258,3.1547691822052,81.14050197601318,2 +2616,0.3665779232978821,0.1944902390241623,0.2079795002937317,0.2529137432575226,978.9199829101562,1e-05,0.10356275737285614,3.055654287338257,81.14050197601318,2 +2617,0.16906693577766418,0.41011765599250793,0.40952354669570923,0.12657342851161957,978.4493408203125,1e-05,0.11243679374456406,2.8440840244293213,81.14050197601318,2 +2618,0.3360469341278076,0.36430004239082336,0.36907681822776794,0.23170162737369537,999.9999389648438,1e-05,0.4166770279407501,3.084426164627075,81.14050197601318,2 +2619,0.29029256105422974,0.20897577702999115,0.22405703365802765,0.251748263835907,937.2574462890625,1e-05,0.10394463688135147,3.217116594314575,81.14050197601318,2 +2620,0.30918988585472107,0.31337761878967285,0.341244101524353,0.19090908765792847,973.2462768554688,1e-05,0.09405038505792618,3.071538209915161,81.14050197601318,2 +2621,0.26325902342796326,0.25087565183639526,0.25856831669807434,0.12797202169895172,515.6737670898438,1e-05,0.10366381704807281,3.099885940551758,81.14050197601318,2 +2622,0.19982756674289703,0.3569457232952118,0.35606589913368225,0.18368297815322876,936.2454833984375,1e-05,0.1561160683631897,3.0518579483032227,81.14050197601318,2 +2623,0.2704620063304901,0.28208860754966736,0.3013290464878082,0.23426572978496552,523.0420532226562,1e-05,0.11650921404361725,3.021268844604492,81.14050197601318,2 +2624,0.3192369341850281,0.18604755401611328,0.20570623874664307,0.25151515007019043,812.7318115234375,1e-05,0.13783909380435944,3.3646583557128906,81.14050197601318,2 +2625,0.38503164052963257,0.18084263801574707,0.1909104436635971,0.0995337963104248,682.6182250976562,1e-05,0.10462826490402222,3.252516508102417,81.14050197601318,2 +2626,0.3492415249347687,0.22366313636302948,0.2246943712234497,0.13286712765693665,839.7739868164062,1e-05,0.1625124216079712,3.0873868465423584,81.14050197601318,2 +2627,0.2684648633003235,0.2811139225959778,0.2850568890571594,0.22610722482204437,781.0278930664062,1e-05,0.16436973214149475,3.110686779022217,81.14050197601318,2 +2628,0.4211108386516571,0.2346135526895523,0.250502347946167,0.24312354624271393,857.74267578125,1e-05,0.15049351751804352,3.0479862689971924,81.14050197601318,2 +2629,0.2608524560928345,0.4782558083534241,0.4920256435871124,0.13636364042758942,972.9094848632812,1e-05,0.14684249460697174,3.0482776165008545,81.14050197601318,2 +2630,0.47163087129592896,0.30277886986732483,0.32010510563850403,0.16736596822738647,478.7982177734375,1e-05,0.1394704282283783,3.3009800910949707,81.14050197601318,2 +2631,0.18569669127464294,0.4299127757549286,0.4335700571537018,0.23123542964458466,992.477783203125,1e-05,0.2593235969543457,3.3025617599487305,81.14050197601318,2 +2632,0.26404568552970886,0.3066401481628418,0.31468600034713745,0.2242424190044403,701.6507568359375,1e-05,0.12719854712486267,3.095337390899658,81.14050197601318,2 +2633,0.29507988691329956,0.2890354096889496,0.2880745232105255,0.1146853119134903,971.5481567382812,1e-05,0.10891357064247131,3.108489990234375,81.14050197601318,2 +2634,0.4201709032058716,0.29121115803718567,0.30562758445739746,0.1515151560306549,827.4590454101562,1e-05,0.14317595958709717,3.0826244354248047,81.14050197601318,2 +2635,0.33240801095962524,0.2606644928455353,0.2679060995578766,0.2298368364572525,882.5809936523438,1e-05,0.09279856830835342,3.028080701828003,81.14050197601318,2 +2636,0.18222421407699585,0.376803994178772,0.3728128671646118,0.20396269857883453,953.8506469726562,1e-05,0.11845092475414276,3.3668863773345947,81.14050197601318,2 +2637,0.1645239293575287,0.32039639353752136,0.3210110068321228,0.19650349020957947,939.7424926757812,1e-05,0.1929461807012558,3.094101667404175,81.14050197601318,2 +2638,0.41051626205444336,0.2937665283679962,0.2996840178966522,0.2477855533361435,735.275390625,1e-05,0.1296515166759491,3.1404359340667725,81.14050197601318,2 +2639,0.13218507170677185,0.32825717329978943,0.33831101655960083,0.2153846174478531,990.0938720703125,1e-05,0.1322258561849594,3.0878148078918457,81.14050197601318,2 +2640,0.28150245547294617,0.2933626174926758,0.29875266551971436,0.21724942326545715,771.0321044921875,1e-05,0.17557014524936676,3.058833122253418,81.14050197601318,2 +2641,0.1457132250070572,0.3402557075023651,0.34812846779823303,0.23752914369106293,992.996826171875,1e-05,0.11647321283817291,3.0460140705108643,81.14050197601318,2 +2642,0.21767227351665497,0.2670317590236664,0.2841128408908844,0.21561771631240845,985.0772094726562,1e-05,0.1545216292142868,3.326840877532959,81.14050197601318,2 +2643,0.2080608606338501,0.37401553988456726,0.3668009638786316,0.22004662454128265,845.2969360351562,1e-05,0.12362086027860641,2.8407328128814697,81.14050197601318,2 +2644,0.29836544394493103,0.3138388991355896,0.32842326164245605,0.20000000298023224,926.6471557617188,1e-05,0.15175923705101013,3.3005313873291016,81.14050197601318,2 +2645,0.17967775464057922,0.29736030101776123,0.30124351382255554,0.2209790199995041,988.32177734375,1e-05,0.19537444412708282,3.0834431648254395,81.14050197601318,2 +2646,0.3193349838256836,0.2520331144332886,0.25672489404678345,0.12820512056350708,792.0157470703125,1e-05,0.1631121188402176,3.0704102516174316,81.14050197601318,2 +2647,0.30042147636413574,0.35967355966567993,0.34615519642829895,0.20606060326099396,950.1903076171875,1e-05,0.10570681840181351,3.3118414878845215,81.14050197601318,2 +2648,0.1825854778289795,0.2823227643966675,0.28890183568000793,0.20652680099010468,913.8861694335938,1e-05,0.1056583970785141,3.3215136528015137,81.14050197601318,2 +2649,0.35187292098999023,0.302150696516037,0.3034214377403259,0.2533799409866333,788.1709594726562,1e-05,0.11976435035467148,2.8353826999664307,81.14050197601318,2 +2650,0.17743295431137085,0.22967027127742767,0.2432551234960556,0.15874126553535461,640.6287231445312,1e-05,0.14344152808189392,3.0987436771392822,81.14050197601318,2 +2651,0.21476991474628448,0.18436646461486816,0.20266056060791016,0.2125874161720276,882.1692504882812,1e-05,0.22681733965873718,3.090986967086792,81.14050197601318,2 +2652,0.27594974637031555,0.37614744901657104,0.3712741434574127,0.21445220708847046,980.1610107421875,1e-05,0.13761208951473236,3.26621413230896,81.14050197601318,2 +2653,0.39704883098602295,0.3200090527534485,0.34338903427124023,0.24965034425258636,502.9901123046875,1e-05,0.15641938149929047,3.101658344268799,81.14050197601318,2 +2654,0.30641746520996094,0.27405840158462524,0.2825932204723358,0.2501165568828583,772.7371215820312,1e-05,0.17074698209762573,3.374662160873413,81.14050197601318,2 +2655,0.22271659970283508,0.46416404843330383,0.4557883143424988,0.21095570921897888,133.62509155273438,1e-05,0.14373564720153809,2.835341691970825,81.14050197601318,2 +2656,0.32151544094085693,0.23694691061973572,0.24365553259849548,0.1263403296470642,776.0996704101562,1e-05,0.1292744129896164,3.459303379058838,81.14050197601318,2 +2657,0.5148957967758179,0.21711911261081696,0.2324363887310028,0.15571095049381256,508.12554931640625,1e-05,0.18048253655433655,2.8341526985168457,81.14050197601318,2 +2658,0.3809782862663269,0.3031041622161865,0.29902318120002747,0.17249417304992676,761.3585205078125,1e-05,0.18447110056877136,3.294940710067749,81.14050197601318,2 +2659,0.18130333721637726,0.32977280020713806,0.3388618230819702,0.23449882864952087,983.3262329101562,1e-05,0.1484336405992508,3.091552734375,81.14050197601318,2 +2660,0.203949436545372,0.25125083327293396,0.263291597366333,0.1498834490776062,947.9669189453125,1e-05,0.35991495847702026,3.0783510208129883,81.14050197601318,2 +2661,0.3385426104068756,0.2464846521615982,0.2669491171836853,0.12960372865200043,973.748779296875,1e-05,0.14419324696063995,3.265029191970825,81.14050197601318,2 +2662,0.4923960566520691,0.5881311893463135,0.5908209085464478,0.18275058269500732,188.9440460205078,1e-05,0.15580026805400848,3.080457925796509,81.14050197601318,2 +2663,0.2593119442462921,0.435522198677063,0.43601885437965393,0.19393938779830933,972.9094848632812,1e-05,0.10613790154457092,3.0536577701568604,81.14050197601318,2 +2664,0.25331783294677734,0.20705118775367737,0.21727558970451355,0.12703962624073029,795.77587890625,1e-05,0.1642340123653412,3.0628163814544678,81.14050197601318,2 +2665,0.24171513319015503,0.38534799218177795,0.3820997476577759,0.2449883371591568,980.7741088867188,1e-05,0.12342369556427002,3.1158037185668945,81.14050197601318,2 +2666,0.26826679706573486,0.28793811798095703,0.2981981039047241,0.2337995320558548,990.4967651367188,1e-05,0.15388409793376923,3.051114082336426,81.14050197601318,2 +2667,0.2062845528125763,0.27860546112060547,0.28155842423439026,0.2596736550331116,797.257080078125,1e-05,0.12407606095075607,3.0990395545959473,81.14050197601318,2 +2668,0.20582222938537598,0.3580043613910675,0.354857474565506,0.18601398169994354,951.0648803710938,1e-05,0.11994711309671402,3.12859845161438,81.14050197601318,2 +2669,0.17694558203220367,0.3138716518878937,0.3144303560256958,0.24988344311714172,904.6971435546875,1e-05,0.10609455406665802,3.1029186248779297,81.14050197601318,2 +2670,0.1330096572637558,0.3914521336555481,0.39447057247161865,0.23006993532180786,997.3809814453125,1e-05,0.12798045575618744,3.1006646156311035,81.14050197601318,2 +2671,0.3802865147590637,0.3536375164985657,0.3388911485671997,0.2214452177286148,956.142333984375,1e-05,0.146690234541893,3.351675033569336,81.14050197601318,2 +2672,0.20086824893951416,0.21924826502799988,0.23872710764408112,0.12261072546243668,967.5030517578125,1e-05,0.14537808299064636,2.841193199157715,81.14050197601318,2 +2673,0.3729100525379181,0.19636760652065277,0.20186986029148102,0.19813519716262817,863.0953369140625,1e-05,0.1717577874660492,3.1403791904449463,81.14050197601318,2 +2674,0.2109857201576233,0.2983291745185852,0.3081440329551697,0.22004662454128265,965.6807250976562,1e-05,0.09677297621965408,3.0726780891418457,81.14050197601318,2 +2675,0.5539937019348145,0.29424431920051575,0.3003341555595398,0.13682983815670013,537.2642211914062,1e-05,0.2588822543621063,3.0314669609069824,81.14050197601318,2 +2676,0.4182959198951721,0.2593768537044525,0.2698115408420563,0.20652680099010468,518.1495361328125,1e-05,0.2300327569246292,3.1056604385375977,81.14050197601318,2 +2677,0.32549282908439636,0.28436699509620667,0.2860187292098999,0.2489510476589203,706.4580688476562,1e-05,0.2537815272808075,3.3777973651885986,81.14050197601318,2 +2678,0.3681143820285797,0.34499454498291016,0.34477099776268005,0.0699300691485405,973.4141235351562,1e-05,0.12206162512302399,2.8313651084899902,81.14050197601318,2 +2679,0.2221372127532959,0.2500138580799103,0.26587724685668945,0.17645686864852905,861.6561889648438,1e-05,0.14292548596858978,3.1594316959381104,81.14050197601318,2 +2680,0.5088217258453369,0.3314260244369507,0.33366313576698303,0.23613053560256958,630.94677734375,1e-05,0.29601287841796875,3.091770648956299,81.14050197601318,2 +2681,0.4223465323448181,0.3518083989620209,0.3574448525905609,0.257342666387558,314.781494140625,1e-05,0.12050293385982513,3.1042683124542236,81.14050197601318,2 +2682,0.19583500921726227,0.1553041934967041,0.17555390298366547,0.23706293106079102,996.1564331054688,1e-05,0.18512387573719025,3.024613380432129,81.14050197601318,2 +2683,0.37770938873291016,0.2935546934604645,0.296815425157547,0.2265734225511551,707.6432495117188,1e-05,0.14803211390972137,3.345627784729004,81.14050197601318,2 +2684,0.28878098726272583,0.3026512861251831,0.30010339617729187,0.22890442609786987,781.0278930664062,1e-05,0.13503055274486542,2.8411056995391846,81.14050197601318,2 +2685,0.1404065638780594,0.30647024512290955,0.31829574704170227,0.20116549730300903,945.4581298828125,1e-05,0.16129246354103088,3.173750877380371,81.14050197601318,2 +2686,0.12670040130615234,0.43039530515670776,0.43759679794311523,0.13333334028720856,989.6887817382812,1e-05,0.13575488328933716,3.120697259902954,81.14050197601318,2 +2687,0.4477861225605011,0.3183974325656891,0.3289205729961395,0.21235431730747223,470.316650390625,1e-05,0.12831518054008484,3.088980197906494,81.14050197601318,2 +2688,0.29607802629470825,0.3000164031982422,0.3001618981361389,0.24452213943004608,846.9136352539062,1e-05,0.14220644533634186,3.2468411922454834,81.14050197601318,2 +2689,0.34791427850723267,0.3098619282245636,0.32183268666267395,0.1974359005689621,944.9946899414062,1e-05,0.1355735808610916,3.3405582904815674,81.14050197601318,2 +2690,0.33990126848220825,0.25317519903182983,0.25297024846076965,0.19883449375629425,836.3575439453125,1e-05,0.19582974910736084,2.8182923793792725,81.14050197601318,2 +2691,0.1908615082502365,0.2777203619480133,0.2972318232059479,0.19137528538703918,994.7838134765625,1e-05,0.15230728685855865,3.5336108207702637,81.14050197601318,2 +2692,0.21247945725917816,0.3468245565891266,0.3364410996437073,0.26247087121009827,922.3670654296875,1e-05,0.13141284883022308,2.8198180198669434,81.14050197601318,2 +2693,0.1553480476140976,0.2149827778339386,0.23874381184577942,0.17762237787246704,723.5714111328125,1e-05,0.23047293722629547,3.2692666053771973,81.14050197601318,2 +2694,0.29374152421951294,0.2110113501548767,0.23234401643276215,0.17599067091941833,481.577392578125,1e-05,0.19265000522136688,3.0758066177368164,81.14050197601318,2 +2695,0.4318324327468872,0.2583971619606018,0.2637231647968292,0.1862470805644989,798.72509765625,1e-05,0.18614323437213898,3.1070995330810547,81.14050197601318,2 +2696,0.3340483605861664,0.2839697003364563,0.2913987338542938,0.0699300691485405,440.3874816894531,1e-05,0.20981864631175995,2.8351082801818848,81.14050197601318,2 +2697,0.2540784776210785,0.23191098868846893,0.25149211287498474,0.18205128610134125,697.9737548828125,1e-05,0.12466108053922653,3.542912483215332,81.14050197601318,2 +2698,0.24626947939395905,0.20805518329143524,0.23665344715118408,0.19044288992881775,932.6204223632812,1e-05,0.15859614312648773,2.843630075454712,81.14050197601318,2 +2699,0.3541698753833771,0.1866786926984787,0.21493183076381683,0.20792540907859802,730.0392456054688,1e-05,0.1592346876859665,3.2298052310943604,81.14050197601318,2 +2700,0.3516846001148224,0.3055702745914459,0.3035842478275299,0.23170162737369537,899.4515991210938,1e-05,0.1496318280696869,3.2698709964752197,81.14050197601318,2 +2701,0.24061527848243713,0.3245171308517456,0.32812532782554626,0.17529137432575226,928.5856323242188,1e-05,0.11452849209308624,3.078977584838867,81.14050197601318,2 +2702,0.2957848012447357,0.3526584208011627,0.34719622135162354,0.1526806503534317,987.7676391601562,1e-05,0.22758595645427704,2.851553201675415,81.14050197601318,2 +2703,0.17772163450717926,0.28892239928245544,0.30615541338920593,0.21911421418190002,960.5552368164062,1e-05,0.1145685613155365,3.5155036449432373,81.14050197601318,2 +2704,0.25437232851982117,0.2602686285972595,0.2671458423137665,0.21841491758823395,817.3616943359375,1e-05,0.13885007798671722,2.834897994995117,81.14050197601318,2 +2705,0.5212438702583313,0.3812253773212433,0.40588685870170593,0.18438228964805603,553.0419311523438,1e-05,0.15346971154212952,3.327082872390747,81.14050197601318,2 +2706,0.278618186712265,0.2325364053249359,0.24518001079559326,0.18857808411121368,760.4534912109375,1e-05,0.24845729768276215,3.310640335083008,81.14050197601318,2 +2707,0.26902440190315247,0.2465822845697403,0.2607905864715576,0.20233100652694702,963.6295776367188,1e-05,0.15138551592826843,2.8338921070098877,81.14050197601318,2 +2708,0.36716189980506897,0.43085041642189026,0.43022993206977844,0.2214452177286148,344.2266540527344,1e-05,0.19834163784980774,2.840383529663086,81.14050197601318,2 +2709,0.19948722422122955,0.3274441361427307,0.3282925486564636,0.15874126553535461,943.5906372070312,1e-05,0.14060938358306885,3.1813747882843018,81.14050197601318,2 +2710,0.20624779164791107,0.23545435070991516,0.2330968976020813,0.11002331227064133,933.9302368164062,1e-05,0.11261891573667526,2.8426270484924316,81.14050197601318,2 +2711,0.3517400622367859,0.3537566363811493,0.3688786029815674,0.09370629489421844,194.7152557373047,1e-05,0.1468520313501358,3.3118834495544434,81.14050197601318,2 +2712,0.21118775010108948,0.42798691987991333,0.41320398449897766,0.2130536139011383,991.4281005859375,1e-05,0.10075847059488297,3.3229191303253174,81.14050197601318,2 +2713,0.2748398780822754,0.25331005454063416,0.28043133020401,0.1918414980173111,995.535888671875,1e-05,0.128659188747406,2.8363163471221924,81.14050197601318,2 +2714,0.31385040283203125,0.20007719099521637,0.21280403435230255,0.2242424190044403,947.5157470703125,1e-05,0.10492835938930511,3.3015167713165283,81.14050197601318,2 +2715,0.33570483326911926,0.4138316214084625,0.41419681906700134,0.23986013233661652,978.134033203125,1e-05,0.12210970371961594,3.091679573059082,81.14050197601318,2 +2716,0.14271877706050873,0.23847468197345734,0.2365998923778534,0.16060605645179749,642.2061767578125,1e-05,0.14520585536956787,2.8226470947265625,81.14050197601318,2 +2717,0.3591076135635376,0.2419443428516388,0.24712637066841125,0.13449883460998535,830.4837646484375,1e-05,0.343635231256485,3.2744877338409424,81.14050197601318,2 +2718,0.34446823596954346,0.33294594287872314,0.33402687311172485,0.1090909093618393,601.3294677734375,1e-05,0.11342290043830872,3.0981709957122803,81.14050197601318,2 +2719,0.3424017131328583,0.2799844741821289,0.2823679745197296,0.139860138297081,966.414306640625,1e-05,0.12387707829475403,2.8444840908050537,81.14050197601318,2 +2720,0.24697834253311157,0.412047415971756,0.40469950437545776,0.19603729248046875,673.1508178710938,1e-05,0.10150008648633957,3.1081771850585938,81.14050197601318,2 +2721,0.25878092646598816,0.26786428689956665,0.2671754062175751,0.1554778516292572,640.6287231445312,1e-05,0.12232842296361923,2.842888832092285,81.14050197601318,2 +2722,0.33158862590789795,0.24708694219589233,0.2617899477481842,0.17086246609687805,926.9263305664062,1e-05,0.10357297211885452,2.844533920288086,81.14050197601318,2 +2723,0.2309912145137787,0.3336593806743622,0.3381776809692383,0.2209790199995041,922.3670654296875,1e-05,0.16843479871749878,3.302518129348755,81.14050197601318,2 +2724,0.27984699606895447,0.24508078396320343,0.26150429248809814,0.21398600935935974,701.6507568359375,1e-05,0.13093747198581696,3.1046950817108154,81.14050197601318,2 +2725,0.31011930108070374,0.22945839166641235,0.23781509697437286,0.17132866382598877,646.8789672851562,1e-05,0.10019051283597946,2.8342127799987793,81.14050197601318,2 +2726,0.17053183913230896,0.21827644109725952,0.2376338094472885,0.23706293106079102,899.4515991210938,1e-05,0.12825912237167358,3.155686616897583,81.14050197601318,2 +2727,0.24896469712257385,0.3849242031574249,0.3792458474636078,0.24568764865398407,997.5022583007812,1e-05,0.1110776737332344,2.8333687782287598,81.14050197601318,2 +2728,0.38826096057891846,0.34548628330230713,0.35449251532554626,0.22121211886405945,427.6461486816406,1e-05,0.14835011959075928,3.0574378967285156,81.14050197601318,2 +2729,0.3343485891819,0.27558159828186035,0.27287808060646057,0.139860138297081,899.0933837890625,1e-05,0.12121042609214783,3.233875274658203,81.14050197601318,2 +2730,0.3804056644439697,0.26180344820022583,0.27131813764572144,0.22727273404598236,781.0278930664062,1e-05,0.12370587140321732,3.057218074798584,81.14050197601318,2 +2731,0.2537585198879242,0.23847344517707825,0.24914465844631195,0.1662004590034485,859.223388671875,1e-05,0.168527290225029,2.8282902240753174,81.14050197601318,2 +2732,0.22461602091789246,0.37813800573349,0.3816709518432617,0.19790209829807281,983.3262329101562,1e-05,0.23354892432689667,3.5393683910369873,81.14050197601318,2 +2733,0.3083326518535614,0.6858661770820618,0.6915404796600342,0.2125874161720276,140.08938598632812,1e-05,0.1457902193069458,2.831399440765381,81.14050197601318,2 +2734,0.29414263367652893,0.2350192815065384,0.2415972352027893,0.20652680099010468,681.2896118164062,1e-05,0.1418178528547287,3.132258415222168,81.14050197601318,2 +2735,0.3330678939819336,0.17831452190876007,0.20651847124099731,0.1906759887933731,966.9605712890625,1e-05,0.1192774772644043,3.343693494796753,81.14050197601318,2 +2736,0.2937667965888977,0.2446294128894806,0.23649871349334717,0.1354312300682068,859.7134399414062,1e-05,0.12670260667800903,2.8414645195007324,81.14050197601318,2 +2737,0.20725437998771667,0.4210973083972931,0.4082942306995392,0.18648017942905426,989.41748046875,1e-05,0.16474314033985138,2.8380565643310547,81.14050197601318,2 +2738,0.3177342414855957,0.454980731010437,0.4723058044910431,0.17575757205486298,991.5601806640625,1e-05,0.18458066880702972,3.550473690032959,81.14050197601318,2 +2739,0.1046023815870285,0.2700238525867462,0.29946446418762207,0.21841491758823395,997.0159301757812,1e-05,0.11200402677059174,2.84503436088562,81.14050197601318,2 +2740,0.25814002752304077,0.2704387307167053,0.297276109457016,0.20815850794315338,363.995361328125,1e-05,0.15638978779315948,3.326129913330078,81.14050197601318,2 +2741,0.1652112901210785,0.27215099334716797,0.2722625434398651,0.25244754552841187,776.0996704101562,1e-05,0.15697042644023895,3.0637168884277344,81.14050197601318,2 +2742,0.20398074388504028,0.3218483328819275,0.3185943067073822,0.2426573485136032,879.6704711914062,1e-05,0.1079716607928276,2.847748041152954,81.14050197601318,2 +2743,0.14960235357284546,0.15788081288337708,0.16909632086753845,0.21794871985912323,974.9092407226562,1e-05,0.10213303565979004,2.851635217666626,81.14050197601318,2 +2744,0.18948037922382355,0.21819019317626953,0.21989256143569946,0.1354312300682068,849.041259765625,1e-05,0.18362151086330414,3.1762092113494873,81.14050197601318,2 +2745,0.15016350150108337,0.33479082584381104,0.3353135287761688,0.22634032368659973,984.2067260742188,1e-05,0.09529653191566467,2.8392462730407715,81.14050197601318,2 +2746,0.32905855774879456,0.34634125232696533,0.3477602005004883,0.1694638729095459,981.9857788085938,1e-05,0.17433923482894897,3.336576461791992,81.14050197601318,2 +2747,0.25480982661247253,0.27306893467903137,0.276383638381958,0.17832167446613312,800.1805419921875,1e-05,0.21126674115657806,3.47360897064209,81.14050197601318,2 +2748,0.5088279843330383,0.2640330493450165,0.2641903758049011,0.18648017942905426,888.2062377929688,1e-05,0.14766833186149597,2.83528208732605,81.14050197601318,2 +2749,0.248134583234787,0.22900453209877014,0.24503760039806366,0.16969697177410126,958.9761352539062,1e-05,0.1254548579454422,2.8400135040283203,81.14050197601318,2 +2750,0.22536031901836395,0.24389347434043884,0.2583988904953003,0.21235431730747223,945.226806640625,1e-05,0.16102860867977142,3.1525423526763916,81.14050197601318,2 +2751,0.29892498254776,0.2405947893857956,0.2635001242160797,0.16689977049827576,988.734619140625,1e-05,0.14988422393798828,3.1780314445495605,81.14050197601318,2 +2752,0.24891521036624908,0.25382331013679504,0.2558630108833313,0.18298368155956268,944.0609741210938,1e-05,0.11711625009775162,2.836791753768921,81.14050197601318,2 +2753,0.20178638398647308,0.24207109212875366,0.2656215727329254,0.21515151858329773,986.221923828125,1e-05,0.14137551188468933,3.236055612564087,81.14050197601318,2 +2754,0.3789716958999634,0.3404601216316223,0.34302377700805664,0.19650349020957947,734.2389526367188,1e-05,0.10283631086349487,2.841456413269043,81.14050197601318,2 +2755,0.33344224095344543,0.29230403900146484,0.30469658970832825,0.29510489106178284,709.9939575195312,1e-05,0.16521969437599182,2.8516845703125,81.14050197601318,2 +2756,0.3932825028896332,0.39295831322669983,0.3972970247268677,0.2242424190044403,348.26116943359375,1e-05,0.12989017367362976,3.0829904079437256,81.14050197601318,2 +2757,0.3670310974121094,0.2802687883377075,0.2785833179950714,0.10489510744810104,712.31884765625,1e-05,0.12529729306697845,3.0440526008605957,81.14050197601318,2 +2758,0.1421767622232437,0.30552420020103455,0.3188018202781677,0.16969697177410126,951.2822265625,1e-05,0.12234030663967133,2.8473007678985596,81.14050197601318,2 +2759,0.25851336121559143,0.2008238285779953,0.2118784785270691,0.19790209829807281,754.9295654296875,1e-05,0.13033577799797058,3.1304235458374023,81.14050197601318,2 +2760,0.222800612449646,0.19029541313648224,0.20898090302944183,0.16060605645179749,702.8627319335938,1e-05,0.14897997677326202,2.848237991333008,81.14050197601318,2 +2761,0.21579545736312866,0.21506570279598236,0.22279226779937744,0.127505823969841,821.8599853515625,1e-05,0.13673630356788635,3.1134822368621826,81.14050197601318,2 +2762,0.2868248224258423,0.29984942078590393,0.3169489800930023,0.1918414980173111,976.8599853515625,1e-05,0.10079816728830338,3.0948855876922607,81.14050197601318,2 +2763,0.1809348165988922,0.261883944272995,0.2782033681869507,0.2181818187236786,890.5407104492188,1e-05,0.10841093957424164,3.127041816711426,81.14050197601318,2 +2764,0.4352579116821289,0.3358185589313507,0.3261621594429016,0.1867132931947708,949.0853271484375,1e-05,0.23085534572601318,3.137272596359253,81.14050197601318,2 +2765,0.3691769540309906,0.2361408919095993,0.24362537264823914,0.22610722482204437,553.0419311523438,1e-05,0.21495972573757172,3.131814479827881,81.14050197601318,2 +2766,0.3270784318447113,0.270707368850708,0.2692602574825287,0.14195804297924042,970.8588256835938,1e-05,0.19963912665843964,2.8386070728302,81.14050197601318,2 +2767,0.40159428119659424,0.22730685770511627,0.24405992031097412,0.253846138715744,781.836181640625,1e-05,0.15761663019657135,3.1391332149505615,81.14050197601318,2 +2768,0.3078491687774658,0.30323150753974915,0.3096815049648285,0.20792540907859802,443.50128173828125,1e-05,0.1367446929216385,3.1694459915161133,81.14050197601318,2 +2769,0.2752857208251953,0.23066593706607819,0.2368355542421341,0.15011654794216156,926.6471557617188,1e-05,0.13907159864902496,3.1262359619140625,81.14050197601318,2 +2770,0.1449987292289734,0.2329196035861969,0.245711550116539,0.26759907603263855,864.9906616210938,1e-05,0.11358039826154709,3.271357297897339,81.14050197601318,2 +2771,0.22566035389900208,0.19670729339122772,0.20571930706501007,0.12237761914730072,904.354736328125,1e-05,0.1275070756673813,2.8335368633270264,81.14050197601318,2 +2772,0.2815381586551666,0.26779165863990784,0.277135968208313,0.19393938779830933,910.0397338867188,1e-05,0.26246994733810425,2.831977605819702,81.14050197601318,2 +2773,0.35155561566352844,0.4589585065841675,0.4553246796131134,0.11794871836900711,296.9483642578125,1e-05,0.20507921278476715,3.166041374206543,81.14050197601318,2 +2774,0.2613787055015564,0.20158328115940094,0.21600782871246338,0.22447551786899567,953.8506469726562,1e-05,0.11560393869876862,2.8397598266601562,81.14050197601318,2 +2775,0.24192488193511963,0.23773370683193207,0.24565674364566803,0.17296037077903748,792.0157470703125,1e-05,0.1265168935060501,3.060245990753174,81.14050197601318,2 +2776,0.3144282400608063,0.27964627742767334,0.2871719300746918,0.2557109594345093,924.38623046875,1e-05,0.12638337910175323,3.19600510597229,81.14050197601318,2 +2777,0.19394075870513916,0.2664105296134949,0.27482175827026367,0.18974359333515167,911.3367309570312,1e-05,0.21153764426708221,2.83498215675354,81.14050197601318,2 +2778,0.297313928604126,0.3761601746082306,0.3922421634197235,0.17156177759170532,947.2893676757812,1e-05,0.17635902762413025,2.836843967437744,81.14050197601318,2 +2779,0.24961747229099274,0.37887558341026306,0.4014069139957428,0.2780885696411133,238.46560668945312,1e-05,0.16030557453632355,3.4517269134521484,81.14050197601318,2 +2780,0.24683889746665955,0.251430481672287,0.2644909620285034,0.16923077404499054,898.37353515625,1e-05,0.14411289989948273,2.8384265899658203,81.14050197601318,2 +2781,0.28482162952423096,0.2801017761230469,0.2920287549495697,0.18088577687740326,948.8626708984375,1e-05,0.10582773387432098,3.0781078338623047,81.14050197601318,2 +2782,0.27617794275283813,0.25968173146247864,0.28397566080093384,0.0995337963104248,974.2481079101562,1e-05,1.114931583404541,3.400175094604492,81.14050197601318,2 +2783,0.4000511169433594,0.3285646140575409,0.3346438407897949,0.13682983815670013,440.3874816894531,1e-05,0.10927371680736542,2.834019660949707,81.14050197601318,2 +2784,0.13269378244876862,0.24088653922080994,0.24568599462509155,0.145454540848732,913.2542724609375,1e-05,0.18090946972370148,2.837740421295166,81.14050197601318,2 +2785,0.46094343066215515,0.3700519800186157,0.3764091432094574,0.18927739560604095,310.39483642578125,1e-05,0.2649814188480377,3.1004326343536377,81.14050197601318,2 +2786,0.31191927194595337,0.28130412101745605,0.28830116987228394,0.2405594438314438,827.4590454101562,1e-05,0.11541678011417389,3.046678304672241,81.14050197601318,2 +2787,0.37510058283805847,0.20958800613880157,0.22140470147132874,0.22727273404598236,716.8931274414062,1e-05,0.235756516456604,2.8366317749023438,81.14050197601318,2 +2788,0.2250256985425949,0.3183085322380066,0.34102529287338257,0.2337995320558548,982.2857666015625,1e-05,0.13415125012397766,3.417593002319336,81.14050197601318,2 +2789,0.33248013257980347,0.2619662284851074,0.2626703381538391,0.2102564126253128,910.3654174804688,1e-05,0.15971630811691284,2.8431146144866943,81.14050197601318,2 +2790,0.2734946608543396,0.1878122240304947,0.20650239288806915,0.23916083574295044,800.1805419921875,1e-05,0.14844317734241486,2.838008403778076,81.14050197601318,2 +2791,0.1818518042564392,0.22671213746070862,0.23677338659763336,0.22191141545772552,977.0203857421875,1e-05,0.11603880673646927,3.119586944580078,81.14050197601318,2 +2792,0.3470979332923889,0.17767639458179474,0.1914370357990265,0.2041957974433899,886.226318359375,1e-05,0.1309397965669632,3.044039487838745,81.14050197601318,2 +2793,0.27322858572006226,0.24873003363609314,0.2556140422821045,0.26363635063171387,959.966552734375,1e-05,0.12886978685855865,2.823953151702881,81.14050197601318,2 +2794,0.2428469955921173,0.30823254585266113,0.3162660300731659,0.1738927662372589,807.9645385742188,1e-05,0.0980030745267868,3.405195474624634,81.14050197601318,2 +2795,0.29049786925315857,0.37910473346710205,0.3927924335002899,0.12937062978744507,972.0613403320312,1e-05,0.23763631284236908,2.82358455657959,81.14050197601318,2 +2796,0.44222500920295715,0.21779416501522064,0.22878707945346832,0.2186480164527893,722.4732666015625,1e-05,0.1451321244239807,3.08211088180542,81.14050197601318,2 +2797,0.23975658416748047,0.3330031633377075,0.3368690013885498,0.13729603588581085,967.8626708984375,1e-05,0.12845535576343536,3.0806260108947754,81.14050197601318,2 +2798,0.3277568221092224,0.41901156306266785,0.4101075828075409,0.21958041191101074,978.4493408203125,1e-05,0.18883347511291504,3.0602121353149414,81.14050197601318,2 +2799,0.3149718642234802,0.2123166024684906,0.22959138453006744,0.21724942326545715,781.0278930664062,1e-05,0.1488073617219925,2.8363444805145264,81.14050197601318,2 +2800,0.21117517352104187,0.15366242825984955,0.17425325512886047,0.2566433548927307,492.46246337890625,1e-05,0.12523382902145386,3.4305014610290527,81.14050197601318,2 +2801,0.3218013346195221,0.23135671019554138,0.2540934681892395,0.2242424190044403,808.654296875,1e-05,0.12944667041301727,2.838763952255249,81.14050197601318,2 +2802,0.39982783794403076,0.35522791743278503,0.3609229624271393,0.22331002354621887,652.9728393554688,1e-05,0.13064219057559967,3.1284639835357666,81.14050197601318,2 +2803,0.21956127882003784,0.38524729013442993,0.40684401988983154,0.16526806354522705,238.46560668945312,1e-05,0.13399256765842438,3.167478561401367,81.14050197601318,2 +2804,0.2772742509841919,0.21179285645484924,0.22688090801239014,0.249417245388031,724.6637573242188,1e-05,0.18082265555858612,3.0624680519104004,81.14050197601318,2 +2805,0.30572327971458435,0.4908103346824646,0.4836704730987549,0.21328671276569366,997.6233520507812,1e-05,0.12371847033500671,3.1046905517578125,81.14050197601318,2 +2806,0.2553689181804657,0.515693724155426,0.5062975883483887,0.21678321063518524,988.0452880859375,1e-05,0.11680431663990021,3.2713916301727295,81.14050197601318,2 +2807,0.2908768653869629,0.28945231437683105,0.3048025071620941,0.21212121844291687,622.5833740234375,1e-05,0.10387557744979858,2.823657751083374,81.14050197601318,2 +2808,0.12863312661647797,0.20478807389736176,0.21125906705856323,0.21118880808353424,913.5706787109375,1e-05,0.11799540370702744,3.1432666778564453,81.14050197601318,2 +2809,0.5995759963989258,0.37888219952583313,0.38268300890922546,0.2214452177286148,440.3874816894531,1e-05,0.144904226064682,3.11793851852417,81.14050197601318,2 +2810,0.37653467059135437,0.24357649683952332,0.24661144614219666,0.22004662454128265,677.2564697265625,1e-05,0.0970839411020279,3.118687152862549,81.14050197601318,2 +2811,0.3902117609977722,0.28147897124290466,0.2889035642147064,0.1962703913450241,975.4014282226562,1e-05,0.25891366600990295,3.0919454097747803,81.14050197601318,2 +2812,0.43775859475135803,0.2819080352783203,0.28424882888793945,0.21002331376075745,888.2062377929688,1e-05,0.13482949137687683,3.081681966781616,81.14050197601318,2 +2813,0.4070703685283661,0.2804168462753296,0.2868686616420746,0.15757575631141663,864.5192260742188,1e-05,0.11910334974527359,2.8303465843200684,81.14050197601318,2 +2814,0.42354175448417664,0.29522383213043213,0.30628255009651184,0.19440560042858124,434.07476806640625,1e-05,0.12284255772829056,3.502502679824829,81.14050197601318,2 +2815,0.3098968267440796,0.32212671637535095,0.3294684588909149,0.17832167446613312,557.397705078125,1e-05,0.1058182567358017,2.833024501800537,81.14050197601318,2 +2816,0.13499538600444794,0.19476847350597382,0.20863153040409088,0.14731934666633606,935.7356567382812,1e-05,0.23411881923675537,3.1178696155548096,81.14050197601318,2 +2817,0.27086833119392395,0.206014022231102,0.22301946580410004,0.22331002354621887,927.482421875,1e-05,0.18801215291023254,3.2795355319976807,81.14050197601318,2 +2818,0.2700040936470032,0.29312628507614136,0.30577751994132996,0.19650349020957947,764.9352416992188,1e-05,0.14712773263454437,3.0807833671569824,81.14050197601318,2 +2819,0.23734167218208313,0.22110940515995026,0.23390817642211914,0.17972028255462646,931.56005859375,1e-05,0.16225968301296234,2.823986053466797,81.14050197601318,2 +2820,0.12368215620517731,0.2612696588039398,0.2618863582611084,0.2097902148962021,933.4083862304688,1e-05,0.12269122153520584,3.5304739475250244,81.14050197601318,2 +2821,0.3953161835670471,0.2873225212097168,0.28775638341903687,0.1750582754611969,728.9754028320312,1e-05,0.2504538297653198,3.1226797103881836,81.14050197601318,2 +2822,0.263552725315094,0.3188154995441437,0.33651766180992126,0.18531468510627747,400.70562744140625,1e-05,1.7765158414840698,2.8335158824920654,81.14050197601318,2 +2823,0.3850676417350769,0.42914390563964844,0.4464832842350006,0.23053613305091858,999.8831176757812,1e-05,0.17622266709804535,3.313796281814575,81.14050197601318,2 +2824,0.33782583475112915,0.33958035707473755,0.3537769019603729,0.1678321659564972,534.9400024414062,1e-05,0.17381742596626282,3.0908994674682617,81.14050197601318,2 +2825,0.30062782764434814,0.3353917598724365,0.3389405906200409,0.238228440284729,563.8103637695312,1e-05,0.12308414280414581,2.838310956954956,81.14050197601318,2 +2826,0.4178324341773987,0.32384201884269714,0.31969982385635376,0.21328671276569366,557.397705078125,1e-05,0.1255718171596527,3.25026535987854,81.14050197601318,2 +2827,0.31096628308296204,0.32788604497909546,0.3280176818370819,0.14195804297924042,617.430419921875,1e-05,0.14673970639705658,3.1255457401275635,81.14050197601318,2 +2828,0.4972093403339386,0.44368651509284973,0.4496298134326935,0.1403263360261917,363.995361328125,1e-05,0.1541573852300644,2.825169324874878,81.14050197601318,2 +2829,0.3108665943145752,0.2828731834888458,0.28571420907974243,0.1974359005689621,702.8627319335938,1e-05,0.1633179485797882,3.34163236618042,81.14050197601318,2 +2830,0.3766672611236572,0.25603851675987244,0.2539650797843933,0.23170162737369537,839.7739868164062,1e-05,0.1596575230360031,3.1311557292938232,81.14050197601318,2 +2831,0.267949640750885,0.3714029788970947,0.38766756653785706,0.1678321659564972,974.5794677734375,1e-05,0.11791440844535828,3.1436238288879395,81.14050197601318,2 +2832,0.16568464040756226,0.26127099990844727,0.28469279408454895,0.26829835772514343,985.364990234375,1e-05,0.5263875722885132,3.247213363647461,81.14050197601318,2 +2833,0.3003453314304352,0.3008481562137604,0.29514074325561523,0.14918415248394012,941.2037353515625,1e-05,0.1116776391863823,3.0679097175598145,81.14050197601318,2 +2834,0.4597589373588562,0.26620927453041077,0.26826050877571106,0.133100226521492,701.6507568359375,1e-05,0.15742994844913483,2.8308825492858887,81.14050197601318,2 +2835,0.4979493021965027,0.250553697347641,0.2736465334892273,0.21724942326545715,701.6507568359375,1e-05,0.11924922466278076,3.3640806674957275,81.14050197601318,2 +2836,0.30752795934677124,0.3603081703186035,0.3536919355392456,0.2410256415605545,936.2454833984375,1e-05,0.13187120854854584,2.831914186477661,81.14050197601318,2 +2837,0.39938682317733765,0.22688809037208557,0.2291569858789444,0.20606060326099396,798.72509765625,1e-05,0.14644645154476166,3.050438165664673,81.14050197601318,2 +2838,0.19871850311756134,0.23007160425186157,0.2379029393196106,0.225874125957489,933.1463012695312,1e-05,0.12634240090847015,3.213817834854126,81.14050197601318,2 +2839,0.4009448289871216,0.2651422321796417,0.2711654305458069,0.2041957974433899,864.9906616210938,1e-05,0.13336075842380524,3.1039366722106934,81.14050197601318,2 +2840,0.11339017748832703,0.29027771949768066,0.28776490688323975,0.12960372865200043,942.6430053710938,1e-05,0.12198929488658905,3.124127149581909,81.14050197601318,2 +2841,0.25557562708854675,0.20230376720428467,0.22435817122459412,0.23449882864952087,935.9909057617188,1e-05,0.13763225078582764,3.3460755348205566,81.14050197601318,2 +2842,0.29406648874282837,0.20890085399150848,0.21725818514823914,0.2354312390089035,869.614990234375,1e-05,0.1570705622434616,2.8440301418304443,81.14050197601318,2 +2843,0.30053597688674927,0.4843018352985382,0.49429404735565186,0.19766899943351746,988.18359375,1e-05,0.12017016857862473,3.055325508117676,81.14050197601318,2 +2844,0.3491365909576416,0.20637720823287964,0.21603383123874664,0.16969697177410126,775.2649536132812,1e-05,0.11340559273958206,3.1929373741149902,81.14050197601318,2 +2845,0.3737899959087372,0.26592275500297546,0.2765863239765167,0.21608391404151917,725.7503051757812,1e-05,0.1384606659412384,3.195394515991211,81.14050197601318,2 +2846,0.2158346027135849,0.28265902400016785,0.2860739529132843,0.27039626240730286,931.2932739257812,1e-05,0.15039944648742676,3.0992093086242676,81.14050197601318,2 +2847,0.25150442123413086,0.4335181415081024,0.4296453297138214,0.16969697177410126,982.5844116210938,1e-05,0.15520907938480377,3.290416955947876,81.14050197601318,2 +2848,0.23898981511592865,0.24529927968978882,0.253478080034256,0.20000000298023224,889.3790893554688,1e-05,0.6796932220458984,2.8406543731689453,81.14050197601318,2 +2849,0.26436927914619446,0.4345722496509552,0.4402327537536621,0.24125874042510986,998.8220825195312,1e-05,0.12197704613208771,3.0640969276428223,81.14050197601318,2 +2850,0.2699897289276123,0.29779478907585144,0.30375874042510986,0.20722611248493195,973.748779296875,1e-05,0.14494822919368744,3.231139659881592,81.14050197601318,2 +2851,0.24978391826152802,0.3035043478012085,0.3004911243915558,0.21934731304645538,871.8681030273438,1e-05,0.13910919427871704,3.125370740890503,81.14050197601318,2 +2852,0.2010289579629898,0.23433426022529602,0.24595297873020172,0.21398600935935974,866.3948974609375,1e-05,0.19657516479492188,3.1231725215911865,81.14050197601318,2 +2853,0.22375866770744324,0.24356859922409058,0.25448060035705566,0.20815850794315338,886.6248779296875,1e-05,0.2495448887348175,3.083822011947632,81.14050197601318,2 +2854,0.4694126844406128,0.34604018926620483,0.3423521816730499,0.1515151560306549,461.6126403808594,1e-05,0.11697623133659363,2.828796148300171,81.14050197601318,2 +2855,0.45689260959625244,0.2076992392539978,0.22167262434959412,0.15314684808254242,821.2252807617188,1e-05,0.14422264695167542,3.0639243125915527,81.14050197601318,2 +2856,0.3311294615268707,0.3590816855430603,0.3749888837337494,0.27319347858428955,473.1681213378906,1e-05,0.0940871462225914,3.2178001403808594,81.14050197601318,2 +2857,0.4763179123401642,0.285072922706604,0.304910808801651,0.23729602992534637,440.3874816894531,1e-05,0.12909598648548126,3.103623390197754,81.14050197601318,2 +2858,0.32008737325668335,0.31151944398880005,0.3111797571182251,0.2242424190044403,922.657958984375,1e-05,0.1515303999185562,3.0927908420562744,81.14050197601318,2 +2859,0.32462650537490845,0.3297690749168396,0.3306002914905548,0.2298368364572525,892.4525146484375,1e-05,0.10947468131780624,3.0653445720672607,81.14050197601318,2 +2860,0.3623043894767761,0.3224319517612457,0.34663718938827515,0.21165500581264496,973.4141235351562,1e-05,0.1266034096479416,2.8434736728668213,81.14050197601318,2 +2861,0.3252318799495697,0.26051169633865356,0.2645609378814697,0.23449882864952087,838.0756225585938,1e-05,0.12956427037715912,3.0463500022888184,81.14050197601318,2 +2862,0.31364208459854126,0.3424815535545349,0.34440627694129944,0.16083915531635284,932.6204223632812,1e-05,0.0963355079293251,3.188640832901001,81.14050197601318,2 +2863,0.38289564847946167,0.23573794960975647,0.26340651512145996,0.2125874161720276,966.596923828125,1e-05,0.15330660343170166,3.137356758117676,81.14050197601318,2 +2864,0.24448902904987335,0.2755979895591736,0.27898237109184265,0.22913752496242523,902.6273193359375,1e-05,0.12136794626712799,3.085329294204712,81.14050197601318,2 +2865,0.30069515109062195,0.25470995903015137,0.2748982906341553,0.21188810467720032,561.6887817382812,1e-05,0.11887413263320923,3.066957950592041,81.14050197601318,2 +2866,0.4012354016304016,0.23622605204582214,0.24401402473449707,0.15804195404052734,834.0355224609375,1e-05,0.10995977371931076,2.8353185653686523,81.14050197601318,2 +2867,0.27642226219177246,0.24317145347595215,0.2710011601448059,0.22074592113494873,977.65869140625,1e-05,0.12670330703258514,3.083589553833008,81.14050197601318,2 +2868,0.27503007650375366,0.19707760214805603,0.20237849652767181,0.13403263688087463,802.3400268554688,1e-05,0.1447887420654297,3.2146265506744385,81.14050197601318,2 +2869,0.2856995761394501,0.40712273120880127,0.39990127086639404,0.16853146255016327,939.9876098632812,1e-05,0.2889234125614166,2.835604429244995,81.14050197601318,2 +2870,0.2764749526977539,0.23678939044475555,0.24882659316062927,0.20675989985466003,982.7333984375,1e-05,0.19199655950069427,3.354865312576294,81.14050197601318,2 +2871,0.40452665090560913,0.3022894561290741,0.3006581664085388,0.17272727191448212,753.0517578125,1e-05,0.203633114695549,3.172422170639038,81.14050197601318,2 +2872,0.33652493357658386,0.30133211612701416,0.2935478687286377,0.20606060326099396,922.947998046875,1e-05,0.15241093933582306,3.065840482711792,81.14050197601318,2 +2873,0.34620776772499084,0.33437657356262207,0.33386901021003723,0.23636363446712494,921.19580078125,1e-05,0.17942824959754944,2.846259832382202,81.14050197601318,2 +2874,0.13535147905349731,0.30776453018188477,0.31202080845832825,0.2582750618457794,949.0853271484375,1e-05,0.12064175307750702,3.5142788887023926,81.14050197601318,2 +2875,0.4510578215122223,0.28978440165519714,0.2852952778339386,0.2069930136203766,694.233642578125,1e-05,0.17646628618240356,2.844688892364502,81.14050197601318,2 +2876,0.2520250380039215,0.27933788299560547,0.30833518505096436,0.19324009120464325,953.4276123046875,1e-05,0.11966945230960846,3.38134503364563,81.14050197601318,2 +2877,0.1925077587366104,0.2423686683177948,0.26122182607650757,0.19393938779830933,821.2252807617188,1e-05,0.1268305778503418,2.851165533065796,81.14050197601318,2 +2878,0.20006263256072998,0.37520918250083923,0.3822946846485138,0.22890442609786987,954.0613403320312,1e-05,0.11397508531808853,3.0534942150115967,81.14050197601318,2 +2879,0.23537808656692505,0.3210088014602661,0.32505762577056885,0.21608391404151917,973.9156494140625,1e-05,0.15919660031795502,2.8368706703186035,81.14050197601318,2 +2880,0.4476468563079834,0.23185791075229645,0.2543768584728241,0.11282051354646683,980.7741088867188,1e-05,0.13793036341667175,3.5819859504699707,81.14050197601318,2 +2881,0.2384893000125885,0.17556852102279663,0.19004641473293304,0.24918414652347565,972.0613403320312,1e-05,0.15539345145225525,2.8268837928771973,81.14050197601318,2 +2882,0.19002202153205872,0.20996694266796112,0.2237786203622818,0.15011654794216156,858.2379760742188,1e-05,0.2597030997276306,3.4277150630950928,81.14050197601318,2 +2883,0.1880948841571808,0.2507578730583191,0.2541603446006775,0.15874126553535461,961.14013671875,1e-05,0.12052733451128006,2.825953960418701,81.14050197601318,2 +2884,0.15242266654968262,0.2978006899356842,0.3027094900608063,0.24475523829460144,991.4281005859375,1e-05,0.5221564769744873,2.8345842361450195,81.14050197601318,2 +2885,0.3295746147632599,0.3442225158214569,0.35205164551734924,0.1846153885126114,992.2167358398438,1e-05,0.14780515432357788,3.135680913925171,81.14050197601318,2 +2886,0.29263660311698914,0.20337113738059998,0.20337113738059998,0.0,900.8737182617188,1e-05,0.15148970484733582,3.319929599761963,81.14050197601318,2 +2887,0.27467620372772217,0.2623884081840515,0.2797200083732605,0.24312354624271393,979.2321166992188,1e-05,0.1171867698431015,3.09975528717041,81.14050197601318,2 +2888,0.4501737058162689,0.3279256820678711,0.33520933985710144,0.17599067091941833,830.4837646484375,1e-05,0.32952797412872314,3.112586736679077,81.14050197601318,2 +2889,0.25164133310317993,0.2928808331489563,0.2949691116809845,0.2242424190044403,921.48974609375,1e-05,0.1250540316104889,2.842813730239868,81.14050197601318,2 +2890,0.20502914488315582,0.27426213026046753,0.28980404138565063,0.14242424070835114,748.2748413085938,1e-05,0.10522384196519852,3.116929292678833,81.14050197601318,2 +2891,0.48183491826057434,0.5739168524742126,0.6024020910263062,0.1638694703578949,133.62509155273438,1e-05,0.1573335975408554,2.8347325325012207,81.14050197601318,2 +2892,0.19142375886440277,0.325772225856781,0.3362176716327667,0.21794871985912323,978.9199829101562,1e-05,0.13266542553901672,3.31807804107666,81.14050197601318,2 +2893,0.15689091384410858,0.21096564829349518,0.2180282175540924,0.1846153885126114,926.3671875,1e-05,0.11337228119373322,3.148977041244507,81.14050197601318,2 +2894,0.20320644974708557,0.2877415716648102,0.2755699157714844,0.1051282063126564,974.4140625,1e-05,0.16260679066181183,3.105862855911255,81.14050197601318,2 +2895,0.33641913533210754,0.17428864538669586,0.19645677506923676,0.1734265685081482,910.0397338867188,1e-05,0.12785403430461884,2.8356385231018066,81.14050197601318,2 +2896,0.1564054787158966,0.35211020708084106,0.35533663630485535,0.2449883371591568,992.996826171875,1e-05,0.13975827395915985,3.096501350402832,81.14050197601318,2 +2897,0.2592525780200958,0.21667753159999847,0.22677914798259735,0.22354312241077423,996.64892578125,1e-05,0.1461310237646103,3.2938201427459717,81.14050197601318,2 +2898,0.43392473459243774,0.2925679087638855,0.2937193810939789,0.09930069744586945,762.2591552734375,1e-05,0.12858332693576813,3.0831892490386963,81.14050197601318,2 +2899,0.33563774824142456,0.31237921118736267,0.32351934909820557,0.17552447319030762,708.8218383789062,1e-05,0.12671519815921783,3.124176263809204,81.14050197601318,2 +2900,0.3465823531150818,0.3070725202560425,0.3062484562397003,0.1930069923400879,876.692138671875,1e-05,0.2172396034002304,3.067141532897949,81.14050197601318,2 +2901,0.15146787464618683,0.3190380930900574,0.33193689584732056,0.2829836905002594,984.2067260742188,1e-05,0.10427606850862503,2.8444042205810547,81.14050197601318,2 +2902,0.31875312328338623,0.39532285928726196,0.3976614475250244,0.0139860138297081,243.64947509765625,1e-05,0.09968987107276917,3.1176650524139404,81.14050197601318,2 +2903,0.3831985890865326,0.4912528395652771,0.48352932929992676,0.20606060326099396,980.6212768554688,1e-05,0.21298369765281677,3.28383731842041,81.14050197601318,2 +2904,0.33636224269866943,0.18371494114398956,0.19217318296432495,0.13799533247947693,998.2254028320312,1e-05,0.19571177661418915,3.10817551612854,81.14050197601318,2 +2905,0.21515271067619324,0.28953635692596436,0.29018092155456543,0.23519814014434814,992.8673706054688,1e-05,0.15859784185886383,3.076446294784546,81.14050197601318,2 +2906,0.16246607899665833,0.2774191200733185,0.28263163566589355,0.08578088879585266,892.4525146484375,1e-05,0.14989136159420013,3.096554756164551,81.14050197601318,2 +2907,0.04836082458496094,0.3124787211418152,0.345053493976593,0.17086246609687805,999.177734375,1e-05,0.10500172525644302,3.04848575592041,81.14050197601318,2 +2908,0.14573343098163605,0.2701125144958496,0.2750132381916046,0.07878787815570831,999.7660522460938,1e-05,0.1502750664949417,2.837207317352295,81.14050197601318,2 +2909,0.2983613908290863,0.297286719083786,0.30521440505981445,0.1962703913450241,875.3941650390625,1e-05,0.1168384701013565,3.0979342460632324,81.14050197601318,2 +2910,0.22330111265182495,0.1864803433418274,0.2144167274236679,0.1571095585823059,981.230712890625,1e-05,0.11465146392583847,3.0435755252838135,81.14050197601318,2 +2911,0.27566179633140564,0.22222648561000824,0.2514818608760834,0.24009324610233307,926.0864868164062,1e-05,0.11071629822254181,3.4052579402923584,81.14050197601318,2 +2912,0.4091782867908478,0.19704413414001465,0.2097373753786087,0.08508158475160599,557.397705078125,1e-05,0.18851254880428314,2.830976963043213,81.14050197601318,2 +2913,0.1710151582956314,0.31333330273628235,0.31045278906822205,0.2405594438314438,768.4440307617188,1e-05,0.13646674156188965,3.070143699645996,81.14050197601318,2 +2914,0.15773744881153107,0.3747577369213104,0.3910115957260132,0.1878787875175476,945.68896484375,1e-05,0.11453065276145935,2.8429431915283203,81.14050197601318,2 +2915,0.39429500699043274,0.32221075892448425,0.33264097571372986,0.2270396202802658,748.2748413085938,1e-05,0.17174233496189117,3.136209726333618,81.14050197601318,2 +2916,0.2566182315349579,0.36730802059173584,0.36023756861686707,0.2554778456687927,956.75732421875,1e-05,0.11649665981531143,3.0751125812530518,81.14050197601318,2 +2917,0.2860848009586334,0.26522576808929443,0.27410709857940674,0.21934731304645538,849.5682373046875,1e-05,0.19770735502243042,3.3219728469848633,81.14050197601318,2 +2918,0.2747102975845337,0.3227180242538452,0.3245997726917267,0.15920746326446533,944.2952880859375,1e-05,0.10383111983537674,2.831045150756836,81.14050197601318,2 +2919,0.25827720761299133,0.3699173927307129,0.35879337787628174,0.2282051295042038,988.4596557617188,1e-05,0.20091503858566284,3.113332509994507,81.14050197601318,2 +2920,0.3455151617527008,0.3880205452442169,0.3922584354877472,0.12097901850938797,967.322509765625,1e-05,0.2089453637599945,2.8277158737182617,81.14050197601318,2 +2921,0.19828884303569794,0.1919146031141281,0.1995987892150879,0.10699300467967987,923.2371215820312,1e-05,0.1468052864074707,3.332676410675049,81.14050197601318,2 +2922,0.4017738103866577,0.21088744699954987,0.23538027703762054,0.19044288992881775,677.2564697265625,1e-05,0.1560143530368805,3.141761302947998,81.14050197601318,2 +2923,0.4392329752445221,0.1879558563232422,0.20944969356060028,0.2652680575847626,814.732421875,1e-05,0.21991853415966034,3.3230180740356445,81.14050197601318,2 +2924,0.5513300895690918,0.362170547246933,0.3611997961997986,0.2230769246816635,390.0654296875,1e-05,0.16553975641727448,2.835343599319458,81.14050197601318,2 +2925,0.4025697708129883,0.2558644711971283,0.25940313935279846,0.14195804297924042,885.0230102539062,1e-05,0.12928128242492676,3.079378366470337,81.14050197601318,2 +2926,0.29513680934906006,0.1979825794696808,0.20988085865974426,0.23403263092041016,790.488037109375,1e-05,0.3945194184780121,2.835132598876953,81.14050197601318,2 +2927,0.28519317507743835,0.28172001242637634,0.28206703066825867,0.21398600935935974,909.7130737304688,1e-05,0.3181009590625763,3.407329797744751,81.14050197601318,2 +2928,0.2929680049419403,0.21246832609176636,0.22488529980182648,0.08228438347578049,963.0614624023438,1e-05,0.11258651316165924,3.050485372543335,81.14050197601318,2 +2929,0.18791574239730835,0.2791493833065033,0.29429325461387634,0.15874126553535461,926.9263305664062,1e-05,0.1399390995502472,3.3833730220794678,81.14050197601318,2 +2930,0.43090564012527466,0.4268544316291809,0.4210856556892395,0.2461538463830948,995.160888671875,1e-05,0.4215671122074127,2.8191306591033936,81.14050197601318,2 +2931,0.3497456908226013,0.20515881478786469,0.21075868606567383,0.2501165568828583,767.5730590820312,1e-05,0.17755459249019623,3.101491928100586,81.14050197601318,2 +2932,0.20120573043823242,0.34370338916778564,0.34806814789772034,0.23962703347206116,977.65869140625,1e-05,0.27647098898887634,2.81927752494812,81.14050197601318,2 +2933,0.23236492276191711,0.20134297013282776,0.222068652510643,0.24428904056549072,872.758544921875,1e-05,0.135596364736557,3.3301501274108887,81.14050197601318,2 +2934,0.39720284938812256,0.27443909645080566,0.2727685272693634,0.17482517659664154,584.1925659179688,1e-05,0.23330558836460114,3.1278748512268066,81.14050197601318,2 +2935,0.3002297580242157,0.23810279369354248,0.25671055912971497,0.25804194808006287,565.9164428710938,1e-05,0.14769986271858215,3.0737321376800537,81.14050197601318,2 +2936,0.14522522687911987,0.23889286816120148,0.24497343599796295,0.1862470805644989,817.3616943359375,1e-05,0.13231495022773743,3.0364956855773926,81.14050197601318,2 +2937,0.3445069193840027,0.3071793019771576,0.3122105598449707,0.302097886800766,666.1416625976562,1e-05,0.1441282033920288,2.8275818824768066,81.14050197601318,2 +2938,0.18908552825450897,0.18646016716957092,0.21327047049999237,0.19883449375629425,950.628662109375,1e-05,0.14575698971748352,2.8281350135803223,81.14050197601318,2 +2939,0.2582450807094574,0.24056772887706757,0.26590695977211,0.2282051295042038,955.10791015625,1e-05,0.13072888553142548,3.1558830738067627,81.14050197601318,2 +2940,0.4622880518436432,0.3336939513683319,0.34082794189453125,0.17296037077903748,323.4160461425781,1e-05,0.11240164935588837,3.4444315433502197,81.14050197601318,2 +2941,0.13529600203037262,0.28833040595054626,0.30539795756340027,0.2226107269525528,950.8469848632812,1e-05,0.22391721606254578,3.0674057006835938,81.14050197601318,2 +2942,0.2353900521993637,0.36381348967552185,0.36209195852279663,0.2046620100736618,970.8588256835938,1e-05,0.1344880312681198,3.107164144515991,81.14050197601318,2 +2943,0.21423077583312988,0.337348997592926,0.3544982969760895,0.2046620100736618,987.7676391601562,1e-05,0.1572950929403305,2.8307719230651855,81.14050197601318,2 +2944,0.46657875180244446,0.4210248589515686,0.4223030209541321,0.1766899824142456,997.5022583007812,1e-05,0.1502731442451477,3.3021843433380127,81.14050197601318,2 +2945,0.3705034852027893,0.22993645071983337,0.24970395863056183,0.17972028255462646,889.7675170898438,1e-05,0.12962386012077332,3.04249906539917,81.14050197601318,2 +2946,0.2808830142021179,0.3528999090194702,0.3475785255432129,0.21491841971874237,960.7506713867188,1e-05,0.17195604741573334,3.35931658744812,81.14050197601318,2 +2947,0.2665717899799347,0.20137351751327515,0.21170727908611298,0.16923077404499054,692.97265625,1e-05,0.12913228571414948,3.2553091049194336,81.14050197601318,2 +2948,0.19071635603904724,0.3633156716823578,0.359998881816864,0.17599067091941833,920.605224609375,1e-05,0.16430115699768066,3.1275548934936523,81.14050197601318,2 +2949,0.3252754509449005,0.35650238394737244,0.3457801938056946,0.14941725134849548,933.9302368164062,1e-05,0.20156817138195038,2.8391292095184326,81.14050197601318,2 +2950,0.2298070639371872,0.28693097829818726,0.3028702139854431,0.1818181872367859,990.8973388671875,1e-05,0.11381690204143524,3.0927722454071045,81.14050197601318,2 +2951,0.20886680483818054,0.2585238516330719,0.2581568658351898,0.2242424190044403,997.1378173828125,1e-05,0.6462177038192749,3.0951895713806152,81.14050197601318,2 +2952,0.30904704332351685,0.23420223593711853,0.25288495421409607,0.1298368275165558,965.3115234375,1e-05,0.10481550544500351,3.385268449783325,81.14050197601318,2 +2953,0.286843866109848,0.326677143573761,0.331704705953598,0.16969697177410126,916.0694580078125,1e-05,0.28217101097106934,3.2749505043029785,81.14050197601318,2 +2954,0.4350537061691284,0.1988067924976349,0.2037721425294876,0.21724942326545715,816.0525512695312,1e-05,0.13395684957504272,3.1548211574554443,81.14050197601318,2 +2955,0.22102679312229156,0.3651461899280548,0.36473819613456726,0.17692308127880096,899.4515991210938,1e-05,0.17089927196502686,2.826479196548462,81.14050197601318,2 +2956,0.19281357526779175,0.379566490650177,0.3845590353012085,0.20675989985466003,963.6295776367188,1e-05,0.11659600585699081,3.108919620513916,81.14050197601318,2 +2957,0.2090158760547638,0.29835033416748047,0.30617755651474,0.1678321659564972,988.0452880859375,1e-05,0.17432411015033722,2.828554153442383,81.14050197601318,2 +2958,0.331382691860199,0.4164048135280609,0.4120981693267822,0.19393938779830933,434.07476806640625,1e-05,0.14795741438865662,3.409534215927124,81.14050197601318,2 +2959,0.2759403884410858,0.37874653935432434,0.37236106395721436,0.23613053560256958,962.4896240234375,1e-05,0.15670514106750488,3.0942628383636475,81.14050197601318,2 +2960,0.46444979310035706,0.27901726961135864,0.2882975935935974,0.2018647938966751,975.2377319335938,1e-05,0.15654930472373962,3.082172155380249,81.14050197601318,2 +2961,0.4711363911628723,0.23696288466453552,0.25147485733032227,0.22051282227039337,850.0933227539062,1e-05,0.1954105645418167,2.8379287719726562,81.14050197601318,2 +2962,0.3771652281284332,0.22672581672668457,0.25304216146469116,0.20046620070934296,520.6055908203125,1e-05,0.11542098969221115,3.0974810123443604,81.14050197601318,2 +2963,0.17276741564273834,0.32372456789016724,0.33148354291915894,0.214685320854187,958.17578125,1e-05,0.13826310634613037,2.835629463195801,81.14050197601318,2 +2964,0.2484876960515976,0.30895012617111206,0.29798537492752075,0.2543123662471771,980.9265747070312,1e-05,0.1111351028084755,3.4165186882019043,81.14050197601318,2 +2965,0.32137325406074524,0.21671362221240997,0.23149561882019043,0.10326340049505234,887.0220336914062,1e-05,0.13027840852737427,3.1404483318328857,81.14050197601318,2 +2966,0.36577820777893066,0.2972995936870575,0.3067338764667511,0.1627039611339569,961.334228515625,1e-05,0.3465038239955902,3.108109712600708,81.14050197601318,2 +2967,0.3894879221916199,0.2550475299358368,0.25590619444847107,0.20629370212554932,731.0974731445312,1e-05,0.18621991574764252,2.8244948387145996,81.14050197601318,2 +2968,0.3381437659263611,0.3598804771900177,0.3715791702270508,0.17832167446613312,327.6654357910156,1e-05,0.11855562031269073,3.1157920360565186,81.14050197601318,2 +2969,0.32116299867630005,0.28614911437034607,0.2851397395133972,0.17552447319030762,872.3140258789062,1e-05,0.14939755201339722,2.8386309146881104,81.14050197601318,2 +2970,0.4384393095970154,0.22164154052734375,0.24311134219169617,0.22680652141571045,652.9728393554688,1e-05,0.2029356211423874,3.296398162841797,81.14050197601318,2 +2971,0.3197118043899536,0.26485204696655273,0.27778810262680054,0.1878787875175476,987.906494140625,1e-05,0.12583942711353302,3.38639497756958,81.14050197601318,2 +2972,0.3064780533313751,0.3300928771495819,0.3305140435695648,0.19137528538703918,942.4046020507812,1e-05,0.12164343893527985,2.835724115371704,81.14050197601318,2 +2973,0.21632324159145355,0.34584566950798035,0.3506760001182556,0.29720279574394226,630.94677734375,1e-05,0.2802632451057434,2.834716796875,81.14050197601318,2 +2974,0.4036497473716736,0.3111550211906433,0.31810227036476135,0.19324009120464325,458.6604309082031,1e-05,0.20566290616989136,3.4522197246551514,81.14050197601318,2 +2975,0.2519170343875885,0.24203990399837494,0.2443273663520813,0.1818181872367859,998.9408569335938,1e-05,0.11174315959215164,2.837730646133423,81.14050197601318,2 +2976,0.3179440200328827,0.2607114613056183,0.28096023201942444,0.22517482936382294,910.6900634765625,1e-05,0.1698809266090393,3.331899881362915,81.14050197601318,2 +2977,0.18599970638751984,0.28015679121017456,0.28252652287483215,0.12051282078027725,975.8905029296875,1e-05,0.11820060014724731,3.0829896926879883,81.14050197601318,2 +2978,0.23951156437397003,0.18835610151290894,0.19371873140335083,0.056410256773233414,796.51806640625,1e-05,0.4152819812297821,2.841019868850708,81.14050197601318,2 +2979,0.3715203106403351,0.30950671434402466,0.312974214553833,0.2582750618457794,804.4718627929688,1e-05,0.14187557995319366,2.836045742034912,81.14050197601318,2 +2980,0.502934455871582,0.24171334505081177,0.24742645025253296,0.23240093886852264,756.7888793945312,1e-05,0.1355748027563095,3.158273458480835,81.14050197601318,2 +2981,0.3260980248451233,0.4497393071651459,0.43833428621292114,0.23076923191547394,999.53125,1e-05,0.12386415153741837,3.013155460357666,81.14050197601318,2 +2982,0.15104572474956512,0.27274376153945923,0.28089892864227295,0.17808857560157776,905.7181396484375,1e-05,0.1481294184923172,3.0896105766296387,81.14050197601318,2 +2983,0.1736319661140442,0.5765246748924255,0.6094872951507568,0.1930069923400879,146.47067260742188,1e-05,0.26422005891799927,3.3308663368225098,81.14050197601318,2 +2984,0.25187644362449646,0.28731855750083923,0.2940317690372467,0.2130536139011383,842.00830078125,1e-05,0.17828525602817535,2.8392393589019775,81.14050197601318,2 +2985,0.276040643453598,0.31391605734825134,0.3000655472278595,0.17832167446613312,944.529052734375,1e-05,0.11027441173791885,2.835773229598999,81.14050197601318,2 +2986,0.2793247699737549,0.31587764620780945,0.324847012758255,0.24848484992980957,960.1631469726562,1e-05,0.10343369096517563,3.150343656539917,81.14050197601318,2 +2987,0.3334071934223175,0.3551408350467682,0.3773089349269867,0.18298368155956268,955.9364624023438,1e-05,0.11692614108324051,3.039419651031494,81.14050197601318,2 +2988,0.4440053105354309,0.24423648416996002,0.2517463266849518,0.23076923191547394,771.0321044921875,1e-05,0.11790011823177338,3.3700594902038574,81.14050197601318,2 +2989,0.3422868549823761,0.3733974099159241,0.4004095792770386,0.23356643319129944,331.87054443359375,1e-05,0.09863404184579849,3.0785117149353027,81.14050197601318,2 +2990,0.3259206712245941,0.21266108751296997,0.22279763221740723,0.22750583291053772,915.4500122070312,1e-05,0.16410882771015167,2.8217508792877197,81.14050197601318,2 +2991,0.20729024708271027,0.15222814679145813,0.1813027262687683,0.20000000298023224,958.9761352539062,1e-05,0.11285574734210968,3.3461058139801025,81.14050197601318,2 +2992,0.39101216197013855,0.2085564136505127,0.21556954085826874,0.18601398169994354,821.2252807617188,1e-05,0.1434089094400406,3.0783960819244385,81.14050197601318,2 +2993,0.13496606051921844,0.33002564311027527,0.32700812816619873,0.23706293106079102,987.2093505859375,1e-05,0.11597280204296112,3.0599308013916016,81.14050197601318,2 +2994,0.13771262764930725,0.30345186591148376,0.314662903547287,0.08881118893623352,992.8673706054688,1e-05,0.09745927900075912,3.2868974208831787,81.14050197601318,2 +2995,0.23391938209533691,0.2613202929496765,0.2549138367176056,0.2058275043964386,840.8953247070312,1e-05,0.14511902630329132,3.1356499195098877,81.14050197601318,2 +2996,0.3697457015514374,0.30629706382751465,0.3082616925239563,0.13636364042758942,730.0392456054688,1e-05,0.11478379368782043,2.839691638946533,81.14050197601318,2 +2997,0.263123095035553,0.35468217730522156,0.3442744314670563,0.20116549730300903,899.0933837890625,1e-05,0.20240364968776703,3.1704933643341064,81.14050197601318,2 +2998,0.4811117351055145,0.23415741324424744,0.25288718938827515,0.2013985961675644,870.5208129882812,1e-05,0.19144763052463531,3.0683064460754395,81.14050197601318,2 +2999,0.3368605971336365,0.49880632758140564,0.486462265253067,0.23986013233661652,978.134033203125,1e-05,0.14306314289569855,3.237791061401367,81.14050197601318,2 +3000,0.2657579779624939,0.3038652539253235,0.310263454914093,0.23240093886852264,936.49951171875,1e-05,0.20796515047550201,3.3324356079101562,81.14050197601318,2 +3001,0.2964015007019043,0.319003164768219,0.32593005895614624,0.26037296652793884,941.685791015625,1e-05,0.16356626152992249,3.0738437175750732,81.14050197601318,2 +3002,0.23192225396633148,0.28614553809165955,0.2880796790122986,0.24032634496688843,804.4718627929688,1e-05,0.9474918246269226,2.834761142730713,81.14050197601318,2 +3003,0.23258139193058014,0.24249176681041718,0.25168493390083313,0.1662004590034485,860.688232421875,1e-05,0.11691874265670776,3.3400979042053223,81.14050197601318,2 +3004,0.06974988430738449,0.24809624254703522,0.2726540267467499,0.15571095049381256,968.9326171875,1e-05,0.10115941613912582,2.8158586025238037,81.14050197601318,2 +3005,0.28861767053604126,0.3188403248786926,0.32855454087257385,0.2526806592941284,971.8906860351562,1e-05,0.140255406498909,3.5601611137390137,81.14050197601318,2 +3006,0.26822566986083984,0.26601094007492065,0.26955515146255493,0.09090909361839294,942.1655883789062,1e-05,0.17919766902923584,2.8259506225585938,81.14050197601318,2 +3007,0.2796687185764313,0.2783370018005371,0.2785956859588623,0.20536130666732788,820.587890625,1e-05,0.1439109891653061,3.0780956745147705,81.14050197601318,2 +3008,0.24316242337226868,0.26411232352256775,0.27038875222206116,0.21678321063518524,867.7844848632812,1e-05,0.13352327048778534,2.8263909816741943,81.14050197601318,2 +3009,0.19140802323818207,0.3497214615345001,0.36175715923309326,0.19533799588680267,921.19580078125,1e-05,0.12682659924030304,3.376535415649414,81.14050197601318,2 +3010,0.35317137837409973,0.24634180963039398,0.2452380657196045,0.09487179666757584,706.4580688476562,1e-05,0.1751360148191452,2.8326406478881836,81.14050197601318,2 +3011,0.31812894344329834,0.3059212863445282,0.31390348076820374,0.15734265744686127,979.2321166992188,1e-05,0.1963903307914734,3.371103286743164,81.14050197601318,2 +3012,0.22615334391593933,0.242689311504364,0.24994246661663055,0.06806527078151703,947.9669189453125,1e-05,0.6173096895217896,2.8424386978149414,81.14050197601318,2 +3013,0.2431052029132843,0.28924402594566345,0.2937530279159546,0.22634032368659973,959.7694091796875,1e-05,0.11683402210474014,3.0926547050476074,81.14050197601318,2 +3014,0.4701530933380127,0.2645353078842163,0.28121986985206604,0.24382284283638,957.5706176757812,1e-05,0.12524104118347168,2.842089891433716,81.14050197601318,2 +3015,0.24319680035114288,0.244503915309906,0.2621040344238281,0.1622377634048462,876.2608642578125,1e-05,0.12066390365362167,3.3149609565734863,81.14050197601318,2 +3016,0.3434661328792572,0.2701576352119446,0.27449262142181396,0.16153846681118011,875.3941650390625,1e-05,0.11703797429800034,3.0502874851226807,81.14050197601318,2 +3017,0.29907143115997314,0.3821191191673279,0.41645264625549316,0.26247087121009827,253.83924865722656,1e-05,0.16214266419410706,3.3427734375,81.14050197601318,2 +3018,0.3830164074897766,0.2399168461561203,0.24435488879680634,0.20279720425605774,625.9617919921875,1e-05,0.12569952011108398,2.833421468734741,81.14050197601318,2 +3019,0.27372482419013977,0.2994760274887085,0.2954283058643341,0.14755244553089142,881.341796875,1e-05,0.1692642718553543,3.0747265815734863,81.14050197601318,2 +3020,0.3302023708820343,0.29024413228034973,0.29389333724975586,0.24708624184131622,658.916015625,1e-05,0.14532537758350372,2.841014862060547,81.14050197601318,2 +3021,0.40168067812919617,0.32354971766471863,0.3345624506473541,0.21002331376075745,947.0624389648438,1e-05,0.13520224392414093,3.3512039184570312,81.14050197601318,2 +3022,0.23740538954734802,0.2452143281698227,0.252504825592041,0.21328671276569366,821.8599853515625,1e-05,0.15889008343219757,3.071845531463623,81.14050197601318,2 +3023,0.1510501205921173,0.29856109619140625,0.3038290739059448,0.17832167446613312,970.1636352539062,1e-05,0.14558206498622894,3.0912392139434814,81.14050197601318,2 +3024,0.40159258246421814,0.2985296845436096,0.29934608936309814,0.2678321599960327,959.7694091796875,1e-05,0.13981884717941284,2.834069013595581,81.14050197601318,2 +3025,0.23598076403141022,0.41758832335472107,0.4129311442375183,0.24312354624271393,992.996826171875,1e-05,0.1258416473865509,3.0669026374816895,81.14050197601318,2 +3026,0.14808662235736847,0.2839221954345703,0.3069293200969696,0.1118881106376648,993.2548217773438,1e-05,0.1490631252527237,3.0930957794189453,81.14050197601318,2 +3027,0.31238481402397156,0.2898556888103485,0.31622061133384705,0.17878787219524384,999.177734375,1e-05,0.11036241054534912,3.069812297821045,81.14050197601318,2 +3028,0.25643783807754517,0.3451351523399353,0.3599223494529724,0.24172493815422058,976.69921875,1e-05,0.13534432649612427,3.363511085510254,81.14050197601318,2 +3029,0.23039716482162476,0.17005613446235657,0.18657590448856354,0.10419580340385437,629.2960815429688,1e-05,0.2284569889307022,3.13407301902771,81.14050197601318,2 +3030,0.11314000189304352,0.32284867763519287,0.3279355466365814,0.2410256415605545,980.3147583007812,1e-05,0.10110028833150864,2.839930534362793,81.14050197601318,2 +3031,0.22267721593379974,0.29286685585975647,0.29831400513648987,0.16293705999851227,795.77587890625,1e-05,0.1400102823972702,3.077019453048706,81.14050197601318,2 +3032,0.2957039475440979,0.2640359103679657,0.2611490488052368,0.15967366099357605,943.1180419921875,1e-05,0.14063701033592224,3.134186267852783,81.14050197601318,2 +3033,0.1998411864042282,0.30799204111099243,0.31447845697402954,0.232634037733078,974.4140625,1e-05,0.24552331864833832,3.0586345195770264,81.14050197601318,2 +3034,0.19295325875282288,0.2519725561141968,0.2588444650173187,0.23916083574295044,858.2379760742188,1e-05,0.15047723054885864,3.351196765899658,81.14050197601318,2 +3035,0.23459888994693756,0.3992694914340973,0.40512514114379883,0.22610722482204437,278.3217468261719,1e-05,0.12332085520029068,3.049884080886841,81.14050197601318,2 +3036,0.3075036406517029,0.36094892024993896,0.3685617744922638,0.2377622425556183,968.9326171875,1e-05,0.16047462821006775,2.822084903717041,81.14050197601318,2 +3037,0.34810301661491394,0.21637962758541107,0.2235434651374817,0.2354312390089035,913.2542724609375,1e-05,0.12392429262399673,3.167288064956665,81.14050197601318,2 +3038,0.25081396102905273,0.3375154435634613,0.3454224467277527,0.20722611248493195,936.2454833984375,1e-05,0.09928545355796814,3.1387107372283936,81.14050197601318,2 +3039,0.25497376918792725,0.36415669322013855,0.37585967779159546,0.21771562099456787,958.17578125,1e-05,0.12768429517745972,3.081681489944458,81.14050197601318,2 +3040,0.29711592197418213,0.15987201035022736,0.1741338074207306,0.1986013948917389,640.6287231445312,1e-05,0.1554660201072693,3.3691189289093018,81.14050197601318,2 +3041,0.16567973792552948,0.2403373271226883,0.26334863901138306,0.2265734225511551,977.0203857421875,1e-05,0.13716202974319458,3.0939218997955322,81.14050197601318,2 +3042,0.2288406789302826,0.35530003905296326,0.3744325637817383,0.20163169503211975,955.523193359375,1e-05,0.1400073915719986,3.0874502658843994,81.14050197601318,2 +3043,0.32801955938339233,0.33325088024139404,0.32731932401657104,0.1258741319179535,741.38232421875,1e-05,0.12510812282562256,2.8334908485412598,81.14050197601318,2 +3044,0.2681390047073364,0.24768231809139252,0.24857556819915771,0.017482517287135124,901.2266235351562,1e-05,0.12461746484041214,3.0820553302764893,81.14050197601318,2 +3045,0.2791883945465088,0.20453272759914398,0.214110866189003,0.1986013948917389,853.715087890625,1e-05,0.12380797415971756,3.351652145385742,81.14050197601318,2 +3046,0.4308180809020996,0.3250034749507904,0.3281036615371704,0.1382284313440323,417.7786560058594,1e-05,0.1837582290172577,3.364352226257324,81.14050197601318,2 +3047,0.22382855415344238,0.27374786138534546,0.2748316824436188,0.12237761914730072,982.8820190429688,1e-05,0.18638022243976593,3.0930049419403076,81.14050197601318,2 +3048,0.25986719131469727,0.30124378204345703,0.3300184905529022,0.17482517659664154,375.388671875,1e-05,0.1462956666946411,3.1422760486602783,81.14050197601318,2 +3049,0.41000989079475403,0.3740217983722687,0.379914790391922,0.1906759887933731,896.920654296875,1e-05,0.15575818717479706,2.84169602394104,81.14050197601318,2 +3050,0.13645263016223907,0.23637744784355164,0.25764358043670654,0.2270396202802658,994.4046630859375,1e-05,0.10836359858512878,3.1019749641418457,81.14050197601318,2 +3051,0.24168162047863007,0.22596055269241333,0.23202234506607056,0.1986013948917389,864.5192260742188,1e-05,0.1503749042749405,3.398977041244507,81.14050197601318,2 +3052,0.35912901163101196,0.2108033299446106,0.2208133488893509,0.14568763971328735,944.529052734375,1e-05,0.12860192358493805,2.856639862060547,81.14050197601318,2 +3053,0.23027989268302917,0.3316347301006317,0.34424546360969543,0.21841491758823395,987.4890747070312,1e-05,0.1115657165646553,3.152269124984741,81.14050197601318,2 +3054,0.3790411055088043,0.36370375752449036,0.36589059233665466,0.2543123662471771,492.46246337890625,1e-05,0.11155584454536438,3.101466178894043,81.14050197601318,2 +3055,0.22183972597122192,0.3083775043487549,0.3180815279483795,0.2181818187236786,991.69189453125,1e-05,0.5342198610305786,2.847691774368286,81.14050197601318,2 +3056,0.3682800531387329,0.27813485264778137,0.28800058364868164,0.17552447319030762,868.7028198242188,1e-05,0.12005341798067093,3.173196792602539,81.14050197601318,2 +3057,0.4332684874534607,0.28180360794067383,0.29677650332450867,0.22517482936382294,917.2977905273438,1e-05,0.11453060805797577,3.3733479976654053,81.14050197601318,2 +3058,0.2539754807949066,0.3127008080482483,0.3242039084434509,0.274125874042511,673.1508178710938,1e-05,0.1603172868490219,3.089118242263794,81.14050197601318,2 +3059,0.37872737646102905,0.3478539288043976,0.34409964084625244,0.14522144198417664,881.341796875,1e-05,0.1829373836517334,2.836427927017212,81.14050197601318,2 +3060,0.2421824038028717,0.3872911036014557,0.3940581679344177,0.260606050491333,945.226806640625,1e-05,0.12474171817302704,3.1279938220977783,81.14050197601318,2 +3061,0.3327106535434723,0.210613414645195,0.21652795374393463,0.10442890226840973,832.8609008789062,1e-05,0.1074303463101387,3.1022720336914062,81.14050197601318,2 +3062,0.21073460578918457,0.2986227869987488,0.30590876936912537,0.22494173049926758,898.37353515625,1e-05,0.12184327095746994,2.8433589935302734,81.14050197601318,2 +3063,0.404712051153183,0.21512506902217865,0.2256077080965042,0.19790209829807281,762.2591552734375,1e-05,0.1257140040397644,3.3809351921081543,81.14050197601318,2 +3064,0.26547762751579285,0.2246318906545639,0.242943674325943,0.14848484098911285,663.2779541015625,1e-05,0.11642835289239883,3.088186740875244,81.14050197601318,2 +3065,0.21835176646709442,0.290720671415329,0.30480286478996277,0.22610722482204437,957.3680419921875,1e-05,0.24040982127189636,3.085329294204712,81.14050197601318,2 +3066,0.31717026233673096,0.3607581555843353,0.34860357642173767,0.20885780453681946,944.529052734375,1e-05,0.11168444901704788,2.8329696655273438,81.14050197601318,2 +3067,0.19935856759548187,0.33299365639686584,0.3493661880493164,0.18111887574195862,997.0159301757812,1e-05,0.0894412025809288,3.112799882888794,81.14050197601318,2 +3068,0.17366960644721985,0.22908613085746765,0.23791173100471497,0.14125874638557434,893.2089233398438,1e-05,0.28707244992256165,2.83732008934021,81.14050197601318,2 +3069,0.24941948056221008,0.23480285704135895,0.2485443502664566,0.15361304581165314,821.2252807617188,1e-05,0.10923296213150024,3.3567452430725098,81.14050197601318,2 +3070,0.45440948009490967,0.30639779567718506,0.3123408854007721,0.22634032368659973,836.9324951171875,1e-05,0.15718436241149902,3.2926456928253174,81.14050197601318,2 +3071,0.183238685131073,0.23721656203269958,0.27012577652931213,0.19930069148540497,970.6856079101562,1e-05,0.13015344738960266,3.102339267730713,81.14050197601318,2 +3072,0.33005374670028687,0.3008982837200165,0.3115505874156952,0.0867132842540741,930.7574462890625,1e-05,0.13827970623970032,2.844102144241333,81.14050197601318,2 +3073,0.41513943672180176,0.5008907318115234,0.5176473259925842,0.15617716312408447,987.6286010742188,1e-05,0.138625368475914,3.1712300777435303,81.14050197601318,2 +3074,0.2875393033027649,0.2537940442562103,0.2637903392314911,0.19487179815769196,994.0235595703125,1e-05,0.16434839367866516,3.121396064758301,81.14050197601318,2 +3075,0.35411056876182556,0.3035189211368561,0.29885005950927734,0.2242424190044403,955.10791015625,1e-05,0.11376658082008362,3.1145689487457275,81.14050197601318,2 +3076,0.35363122820854187,0.2499011904001236,0.2593836784362793,0.22167831659317017,882.1692504882812,1e-05,0.11328611522912979,3.1315255165100098,81.14050197601318,2 +3077,0.2568778097629547,0.3744274079799652,0.3608516454696655,0.2242424190044403,987.7676391601562,1e-05,0.12869161367416382,3.0776188373565674,81.14050197601318,2 +3078,0.37234655022621155,0.3136847913265228,0.325168639421463,0.21212121844291687,923.8132934570312,1e-05,0.2895265519618988,2.8451626300811768,81.14050197601318,2 +3079,0.3214520812034607,0.219872385263443,0.23324942588806152,0.18368297815322876,856.2459106445312,1e-05,0.1215425357222557,3.1381351947784424,81.14050197601318,2 +3080,0.29801106452941895,0.26787471771240234,0.2646905183792114,0.21375291049480438,875.3941650390625,1e-05,0.1374310553073883,3.062307834625244,81.14050197601318,2 +3081,0.37304821610450745,0.26063889265060425,0.2626272141933441,0.1358974426984787,582.22021484375,1e-05,0.1557776927947998,3.0613720417022705,81.14050197601318,2 +3082,0.13265156745910645,0.26108285784721375,0.2779788374900818,0.16689977049827576,914.8272094726562,1e-05,0.10602524131536484,3.150547504425049,81.14050197601318,2 +3083,0.1935673952102661,0.29516103863716125,0.30049026012420654,0.20000000298023224,918.8137817382812,1e-05,0.10495147109031677,3.1082160472869873,81.14050197601318,2 +3084,0.21431052684783936,0.24676600098609924,0.25649207830429077,0.17179487645626068,782.640625,1e-05,0.13300073146820068,2.8543405532836914,81.14050197601318,2 +3085,0.3394218683242798,0.3654976785182953,0.37694448232650757,0.2270396202802658,446.5873107910156,1e-05,0.15735884010791779,3.160923957824707,81.14050197601318,2 +3086,0.38383379578590393,0.2476424127817154,0.2519192397594452,0.21771562099456787,743.3765869140625,1e-05,0.19624073803424835,3.1100008487701416,81.14050197601318,2 +3087,0.24398812651634216,0.44875532388687134,0.4386884272098541,0.1862470805644989,989.1450805664062,1e-05,0.12369786202907562,3.3156888484954834,81.14050197601318,2 +3088,0.43941131234169006,0.2318376749753952,0.2398463636636734,0.2013985961675644,792.0157470703125,1e-05,0.1426628977060318,3.207827568054199,81.14050197601318,2 +3089,0.12350008636713028,0.2623273730278015,0.27206167578697205,0.2226107269525528,884.6192626953125,1e-05,0.1348302960395813,3.065068006515503,81.14050197601318,2 +3090,0.34660980105400085,0.18556009232997894,0.18918465077877045,0.1594405621290207,627.6343994140625,1e-05,0.08910687267780304,3.1106810569763184,81.14050197601318,2 +3091,0.2513994574546814,0.25303152203559875,0.26534774899482727,0.23286713659763336,908.3971557617188,1e-05,0.12344944477081299,2.8397247791290283,81.14050197601318,2 +3092,0.29143211245536804,0.2529708445072174,0.2607709765434265,0.21934731304645538,716.8931274414062,1e-05,0.1346464902162552,3.3243331909179688,81.14050197601318,2 +3093,0.22957517206668854,0.2713526487350464,0.2756872773170471,0.23006993532180786,886.6248779296875,1e-05,0.13738766312599182,3.063770294189453,81.14050197601318,2 +3094,0.29874780774116516,0.29394662380218506,0.31659895181655884,0.25081583857536316,424.38739013671875,1e-05,0.13277044892311096,3.1389873027801514,81.14050197601318,2 +3095,0.15492966771125793,0.4333355724811554,0.42130351066589355,0.25244754552841187,994.1507568359375,1e-05,0.1040271446108818,3.058817148208618,81.14050197601318,2 +3096,0.38502851128578186,0.27325183153152466,0.27451375126838684,0.24382284283638,657.4439697265625,1e-05,0.12166444212198257,3.130141496658325,81.14050197601318,2 +3097,0.2637989819049835,0.2916092276573181,0.2980489134788513,0.17832167446613312,849.5682373046875,1e-05,0.2086656093597412,2.8355934619903564,81.14050197601318,2 +3098,0.2079819142818451,0.30146524310112,0.30790993571281433,0.2610722482204437,976.2150268554688,1e-05,0.10433769226074219,3.43461275100708,81.14050197601318,2 +3099,0.1897045522928238,0.3106391429901123,0.32511019706726074,0.20629370212554932,980.7741088867188,1e-05,0.12426494807004929,3.078216791152954,81.14050197601318,2 +3100,0.39543354511260986,0.3402172029018402,0.34201523661613464,0.2242424190044403,875.8281860351562,1e-05,0.14776107668876648,3.059777021408081,81.14050197601318,2 +3101,0.2185186743736267,0.2993771433830261,0.29483562707901,0.17529137432575226,916.0694580078125,1e-05,0.2633174955844879,3.0955400466918945,81.14050197601318,2 +3102,0.16670721769332886,0.18624833226203918,0.21466073393821716,0.26247087121009827,987.3492431640625,1e-05,0.11516715586185455,3.1575467586517334,81.14050197601318,2 +3103,0.16825184226036072,0.3108106255531311,0.3124570846557617,0.1750582754611969,916.991943359375,1e-05,0.16801367700099945,2.830909490585327,81.14050197601318,2 +3104,0.3064633309841156,0.23179879784584045,0.2396896928548813,0.2214452177286148,816.0525512695312,1e-05,0.19152392446994781,3.373903751373291,81.14050197601318,2 +3105,0.3608451783657074,0.31111735105514526,0.3078606426715851,0.20815850794315338,767.5730590820312,1e-05,0.15783362090587616,3.1200573444366455,81.14050197601318,2 +3106,0.3007570505142212,0.2783135771751404,0.2839585244655609,0.02097902074456215,999.0592651367188,1e-05,0.1740131825208664,3.4177744388580322,81.14050197601318,2 +3107,0.18501272797584534,0.25569766759872437,0.26995745301246643,0.15221445262432098,873.2015991210938,1e-05,0.1431155949831009,2.837883472442627,81.14050197601318,2 +3108,0.3182353675365448,0.2964687943458557,0.2908487617969513,0.20629370212554932,834.0355224609375,1e-05,0.16382111608982086,3.148535966873169,81.14050197601318,2 +3109,0.18029756844043732,0.207275852560997,0.221191868185997,0.24358974397182465,999.8831176757812,1e-05,0.1236063539981842,3.008122682571411,81.14050197601318,2 +3110,0.42757076025009155,0.2695181369781494,0.2801929712295532,0.2142191082239151,667.560546875,1e-05,0.12082888185977936,3.3869707584381104,81.14050197601318,2 +3111,0.22947575151920319,0.3222474157810211,0.33773863315582275,0.2454545497894287,938.0095825195312,1e-05,0.10443105548620224,3.151834011077881,81.14050197601318,2 +3112,0.26422473788261414,0.41576138138771057,0.4236034154891968,0.2158508151769638,970.8588256835938,1e-05,0.09218069911003113,3.0526201725006104,81.14050197601318,2 +3113,0.17632518708705902,0.3267592787742615,0.3209404945373535,0.2058275043964386,863.0953369140625,1e-05,0.4848899841308594,2.846102476119995,81.14050197601318,2 +3114,0.3714497685432434,0.3108106255531311,0.3098498582839966,0.1806526780128479,900.5198364257812,1e-05,0.1065220758318901,3.1714272499084473,81.14050197601318,2 +3115,0.22325371205806732,0.28138017654418945,0.2949513792991638,0.17878787219524384,972.7406005859375,1e-05,0.18080078065395355,3.153738021850586,81.14050197601318,2 +3116,0.20209139585494995,0.3857320249080658,0.38868412375450134,0.220279723405838,961.9138793945312,1e-05,0.11323028802871704,3.029203176498413,81.14050197601318,2 +3117,0.23717941343784332,0.2870936691761017,0.29939380288124084,0.116317018866539,996.4030151367188,1e-05,0.1136896163225174,3.30780029296875,81.14050197601318,2 +3118,0.17011138796806335,0.18178749084472656,0.20603105425834656,0.13729603588581085,991.1632080078125,1e-05,0.08480193465948105,3.0624918937683105,81.14050197601318,2 +3119,0.22160302102565765,0.2760639786720276,0.27655714750289917,0.19230769574642181,915.1390991210938,1e-05,0.10289568454027176,3.108619451522827,81.14050197601318,2 +3120,0.40520724654197693,0.3188781142234802,0.3274034559726715,0.2282051295042038,505.5683898925781,1e-05,0.13461346924304962,2.8327653408050537,81.14050197601318,2 +3121,0.2331572324037552,0.4256095290184021,0.44246000051498413,0.2454545497894287,990.0938720703125,1e-05,0.12584011256694794,3.053781509399414,81.14050197601318,2 +3122,0.25557127594947815,0.307512104511261,0.30355507135391235,0.22750583291053772,922.657958984375,1e-05,0.17984916269779205,3.0828537940979004,81.14050197601318,2 +3123,0.4274170994758606,0.36929649114608765,0.3745059669017792,0.22331002354621887,386.44976806640625,1e-05,0.16485309600830078,3.136249303817749,81.14050197601318,2 +3124,0.3390701413154602,0.2903486490249634,0.28810420632362366,0.21375291049480438,914.2007446289062,1e-05,0.10843874514102936,3.067713499069214,81.14050197601318,2 +3125,0.4452752470970154,0.322957843542099,0.3155398964881897,0.16526806354522705,943.1180419921875,1e-05,0.16203470528125763,3.172837734222412,81.14050197601318,2 +3126,0.2597411870956421,0.2939028739929199,0.3011307716369629,0.25151515007019043,655.9628295898438,1e-05,0.10886451601982117,2.8350343704223633,81.14050197601318,2 +3127,0.272174209356308,0.2416028082370758,0.25668302178382874,0.2377622425556183,864.9906616210938,1e-05,0.1209239587187767,3.0788896083831787,81.14050197601318,2 +3128,0.37202203273773193,0.24304746091365814,0.25397783517837524,0.2694638669490814,899.4515991210938,1e-05,0.14202599227428436,3.1997499465942383,81.14050197601318,2 +3129,0.30076849460601807,0.21497896313667297,0.22914907336235046,0.214685320854187,606.806884765625,1e-05,0.14313822984695435,3.087101459503174,81.14050197601318,2 +3130,0.35508397221565247,0.3241324722766876,0.32599639892578125,0.1515151560306549,946.378173828125,1e-05,0.15617157518863678,3.1300296783447266,81.14050197601318,2 +3131,0.34888482093811035,0.2793661057949066,0.2784217894077301,0.21212121844291687,907.39990234375,1e-05,0.14299538731575012,3.163717031478882,81.14050197601318,2 +3132,0.28461727499961853,0.3381620943546295,0.3456859886646271,0.2337995320558548,606.806884765625,1e-05,0.10539823770523071,2.826021671295166,81.14050197601318,2 +3133,0.36223936080932617,0.25039413571357727,0.2742103338241577,0.15011654794216156,705.2662353515625,1e-05,0.11976902931928635,3.326061487197876,81.14050197601318,2 +3134,0.31628021597862244,0.2239527702331543,0.24830381572246552,0.23240093886852264,379.11187744140625,1e-05,0.11545176059007645,3.2301619052886963,81.14050197601318,2 +3135,0.30581381916999817,0.26471787691116333,0.2797371447086334,0.18368297815322876,838.6439208984375,1e-05,0.1479472666978836,3.1331260204315186,81.14050197601318,2 +3136,0.2088526338338852,0.16989000141620636,0.19311858713626862,0.2186480164527893,937.2574462890625,1e-05,0.1287890374660492,3.0994112491607666,81.14050197601318,2 +3137,0.37591516971588135,0.3858165442943573,0.38893991708755493,0.06480186432600021,537.2642211914062,1e-05,0.16297096014022827,3.0982606410980225,81.14050197601318,2 +3138,0.2903197705745697,0.2736770808696747,0.27711132168769836,0.1906759887933731,947.7415161132812,1e-05,0.10924968868494034,2.8396458625793457,81.14050197601318,2 +3139,0.2556910514831543,0.23335929214954376,0.26192501187324524,0.1722610741853714,947.9669189453125,1e-05,0.11270646005868912,3.0798590183258057,81.14050197601318,2 +3140,0.3650754392147064,0.9799606204032898,0.9937334656715393,0.18554778397083282,999.53125,1e-05,0.11569222062826157,3.385674476623535,81.14050197601318,2 +3141,0.3304888606071472,0.6842673420906067,0.6884241104125977,0.19230769574642181,133.62509155273438,1e-05,0.14614596962928772,2.8498902320861816,81.14050197601318,2 +3142,0.416146457195282,0.46322178840637207,0.4656282067298889,0.18881118297576904,991.0303955078125,1e-05,0.1356724202632904,3.0995678901672363,81.14050197601318,2 +3143,0.18888625502586365,0.35552433133125305,0.3891191780567169,0.19417248666286469,999.0592651367188,1e-05,0.14303350448608398,3.175546884536743,81.14050197601318,2 +3144,0.2065468728542328,0.28531819581985474,0.3050110638141632,0.2242424190044403,826.846923828125,1e-05,0.09028037637472153,2.8336074352264404,81.14050197601318,2 +3145,0.2744714319705963,0.29034101963043213,0.2907080352306366,0.22843822836875916,828.0687866210938,1e-05,0.14254744350910187,3.098661422729492,81.14050197601318,2 +3146,0.3987179696559906,0.2779783308506012,0.27898547053337097,0.12937062978744507,835.2010498046875,1e-05,0.13928964734077454,3.302852153778076,81.14050197601318,2 +3147,0.3285659849643707,0.26119744777679443,0.27188926935195923,0.27435898780822754,646.8789672851562,1e-05,0.14201223850250244,2.836897373199463,81.14050197601318,2 +3148,0.38955628871917725,0.44956254959106445,0.45597177743911743,0.1958041936159134,292.3681640625,1e-05,0.12739089131355286,3.4247028827667236,81.14050197601318,2 +3149,0.14103713631629944,0.2895691990852356,0.303378164768219,0.20606060326099396,991.69189453125,1e-05,0.33348509669303894,2.843186140060425,81.14050197601318,2 +3150,0.2673037648200989,0.3449203670024872,0.36472663283348083,0.22750583291053772,973.0780639648438,1e-05,0.11668417602777481,3.0571343898773193,81.14050197601318,2 +3151,0.4762776494026184,0.5493870377540588,0.5671508312225342,0.2477855533361435,158.9905548095703,1e-05,0.14048896729946136,2.8348357677459717,81.14050197601318,2 +3152,0.22055967152118683,0.28284260630607605,0.30119088292121887,0.19230769574642181,981.9857788085938,1e-05,0.12733356654644012,3.294870615005493,81.14050197601318,2 +3153,0.4015515446662903,0.31771206855773926,0.31241780519485474,0.20000000298023224,765.8187255859375,1e-05,0.20025086402893066,2.8497583866119385,81.14050197601318,2 +3154,0.2975146174430847,0.3176034092903137,0.32994791865348816,0.20326340198516846,947.5157470703125,1e-05,0.1273622065782547,3.4553165435791016,81.14050197601318,2 +3155,0.4051613211631775,0.35728344321250916,0.3479633927345276,0.11888112127780914,946.6068115234375,1e-05,0.13439808785915375,2.8423304557800293,81.14050197601318,2 +3156,0.20092156529426575,0.31171509623527527,0.3068697452545166,0.13939394056797028,930.7574462890625,1e-05,0.12789812684059143,3.078784942626953,81.14050197601318,2 +3157,0.27296021580696106,0.44919347763061523,0.45846042037010193,0.1930069923400879,983.6209716796875,1e-05,0.11483635008335114,2.838489532470703,81.14050197601318,2 +3158,0.23262512683868408,0.20053642988204956,0.21880125999450684,0.17808857560157776,753.0517578125,1e-05,0.1186651811003685,3.3756062984466553,81.14050197601318,2 +3159,0.24554944038391113,0.2463255673646927,0.2683158218860626,0.2242424190044403,852.6897583007812,1e-05,0.11174362152814865,3.143340826034546,81.14050197601318,2 +3160,0.19489289820194244,0.27437010407447815,0.28578701615333557,0.22750583291053772,868.2445068359375,1e-05,0.3230534493923187,3.3131847381591797,81.14050197601318,2 +3161,0.20345105230808258,0.3886249363422394,0.41653627157211304,0.20046620070934296,979.8526000976562,1e-05,0.1279265135526657,2.839653253555298,81.14050197601318,2 +3162,0.33896806836128235,0.2971195876598358,0.32633766531944275,0.2069930136203766,975.4014282226562,1e-05,0.18029353022575378,3.37713623046875,81.14050197601318,2 +3163,0.32935184240341187,0.2313843071460724,0.24274250864982605,0.2270396202802658,874.9585571289062,1e-05,0.12911128997802734,3.025313377380371,81.14050197601318,2 +3164,0.1785612255334854,0.37473705410957336,0.36986562609672546,0.260606050491333,960.1631469726562,1e-05,0.10102206468582153,3.1200530529022217,81.14050197601318,2 +3165,0.3229885697364807,0.28036412596702576,0.285654753446579,0.2046620100736618,965.126220703125,1e-05,0.10838162899017334,3.040224075317383,81.14050197601318,2 +3166,0.3279992341995239,0.35578614473342896,0.3664115369319916,0.250582754611969,449.6458740234375,1e-05,0.12587527930736542,3.1224327087402344,81.14050197601318,2 +3167,0.2670186758041382,0.35967448353767395,0.3551102876663208,0.19533799588680267,948.8626708984375,1e-05,0.35582390427589417,2.828953981399536,81.14050197601318,2 +3168,0.14566078782081604,0.23807455599308014,0.2472003549337387,0.2174825221300125,953.8506469726562,1e-05,0.09719428420066833,3.282846212387085,81.14050197601318,2 +3169,0.422872930765152,0.2898182272911072,0.31069955229759216,0.20069929957389832,968.3995361328125,1e-05,0.1207103282213211,3.051151752471924,81.14050197601318,2 +3170,0.3044781982898712,0.3175289034843445,0.31893688440322876,0.1890442818403244,984.4981079101562,1e-05,0.1518900990486145,3.132805585861206,81.14050197601318,2 +3171,0.21325552463531494,0.39133399724960327,0.3972614109516144,0.17039626836776733,990.4967651367188,1e-05,0.15227319300174713,3.1059207916259766,81.14050197601318,2 +3172,0.358926922082901,0.2657790780067444,0.2703610360622406,0.2717948853969574,902.2786865234375,1e-05,0.1154075488448143,3.1717562675476074,81.14050197601318,2 +3173,0.21807146072387695,0.35178127884864807,0.35301825404167175,0.19930069148540497,624.2781982421875,1e-05,0.28077641129493713,2.8306944370269775,81.14050197601318,2 +3174,0.30959442257881165,0.20692981779575348,0.21622709929943085,0.17575757205486298,942.4046020507812,1e-05,0.20208603143692017,3.0872697830200195,81.14050197601318,2 +3175,0.3077434003353119,0.23295649886131287,0.23021192848682404,0.23706293106079102,674.5276489257812,1e-05,0.15750189125537872,3.096137285232544,81.14050197601318,2 +3176,0.44792428612709045,0.26316919922828674,0.28132733702659607,0.10396270453929901,327.6654357910156,1e-05,0.19392427802085876,3.052382469177246,81.14050197601318,2 +3177,0.2864324450492859,0.32862070202827454,0.31634610891342163,0.20606060326099396,867.7844848632812,1e-05,0.17615452408790588,3.4206671714782715,81.14050197601318,2 +3178,0.32764381170272827,0.23240618407726288,0.24379250407218933,0.20769231021404266,920.9009399414062,1e-05,0.2501460015773773,2.842906951904297,81.14050197601318,2 +3179,0.2891164720058441,0.2389763444662094,0.2500695288181305,0.2708624601364136,803.0537109375,1e-05,0.10009342432022095,2.841290235519409,81.14050197601318,2 +3180,0.4226270914077759,0.3803436756134033,0.3946850299835205,0.12727272510528564,977.65869140625,1e-05,0.10471449047327042,3.112274408340454,81.14050197601318,2 +3181,0.26604583859443665,0.29163050651550293,0.30331888794898987,0.21398600935935974,976.8599853515625,1e-05,0.08332416415214539,3.101475477218628,81.14050197601318,2 +3182,0.32092931866645813,0.24298729002475739,0.2482016682624817,0.2097902148962021,782.640625,1e-05,0.12956874072551727,3.1049742698669434,81.14050197601318,2 +3183,0.33016592264175415,0.2682555913925171,0.27612656354904175,0.2242424190044403,692.97265625,1e-05,0.11243396997451782,3.3823513984680176,81.14050197601318,2 +3184,0.4004533886909485,0.28310972452163696,0.2987661361694336,0.26247087121009827,975.8905029296875,1e-05,0.12958014011383057,2.8499510288238525,81.14050197601318,2 +3185,0.3228726387023926,0.20257726311683655,0.2216082364320755,0.13682983815670013,855.743408203125,1e-05,0.11826557666063309,3.0695619583129883,81.14050197601318,2 +3186,0.24444741010665894,0.2359534651041031,0.24337507784366608,0.12051282078027725,606.806884765625,1e-05,0.09177858382463455,3.0978002548217773,81.14050197601318,2 +3187,0.19739040732383728,0.2213432639837265,0.22968465089797974,0.20093239843845367,898.011962890625,1e-05,0.16768592596054077,3.3201794624328613,81.14050197601318,2 +3188,0.2834358811378479,0.32641130685806274,0.32925906777381897,0.07319347560405731,968.9326171875,1e-05,0.14067436754703522,2.8405816555023193,81.14050197601318,2 +3189,0.28180861473083496,0.33739328384399414,0.334246426820755,0.21724942326545715,994.53125,1e-05,0.13800957798957825,3.3780596256256104,81.14050197601318,2 +3190,0.29639387130737305,0.34194034337997437,0.3516179919242859,0.20279720425605774,310.39483642578125,1e-05,0.1390271931886673,2.8433399200439453,81.14050197601318,2 +3191,0.25545698404312134,0.2409115731716156,0.2491166591644287,0.19440560042858124,890.5407104492188,1e-05,0.11572641879320145,3.138791799545288,81.14050197601318,2 +3192,0.26257649064064026,0.2793582081794739,0.2838367223739624,0.1862470805644989,861.1730346679688,1e-05,0.16080628335475922,3.2866053581237793,81.14050197601318,2 +3193,0.37095916271209717,0.29134172201156616,0.30010125041007996,0.19766899943351746,944.0609741210938,1e-05,0.1799299269914627,3.2546274662017822,81.14050197601318,2 +3194,0.1948731392621994,0.2515285015106201,0.2615111768245697,0.24708624184131622,910.6900634765625,1e-05,0.12191502004861832,3.0609285831451416,81.14050197601318,2 +3195,0.39309415221214294,0.6974064707756042,0.6994379758834839,0.24755243957042694,146.47067260742188,1e-05,0.11421818286180496,3.1024296283721924,81.14050197601318,2 +3196,0.49436354637145996,0.30177244544029236,0.3129390776157379,0.19510489702224731,972.5713500976562,1e-05,0.13437438011169434,2.8556272983551025,81.14050197601318,2 +3197,0.2783212661743164,0.21965952217578888,0.22983196377754211,0.21048951148986816,713.4717407226562,1e-05,0.16322481632232666,3.30433988571167,81.14050197601318,2 +3198,0.569005012512207,0.3566991090774536,0.3566760718822479,0.17925408482551575,968.0419921875,1e-05,0.11074460297822952,3.307004451751709,81.14050197601318,2 +3199,0.40457600355148315,0.35604777932167053,0.36103349924087524,0.14685314893722534,464.5392150878906,1e-05,0.10354334115982056,3.303234338760376,81.14050197601318,2 +3200,0.4428410530090332,0.4130096137523651,0.41199108958244324,0.19230769574642181,263.79840087890625,1e-05,0.14113573729991913,3.1086816787719727,81.14050197601318,2 +3201,0.24059371650218964,0.36959707736968994,0.3802247643470764,0.19207459688186646,903.6668701171875,1e-05,0.13208773732185364,3.103163719177246,81.14050197601318,2 +3202,0.444230854511261,0.3308972716331482,0.3255109488964081,0.23752914369106293,857.2454833984375,1e-05,0.11790196597576141,2.8452517986297607,81.14050197601318,2 +3203,0.33190351724624634,0.29568418860435486,0.3053014278411865,0.23286713659763336,870.5208129882812,1e-05,0.24042947590351105,3.1890640258789062,81.14050197601318,2 +3204,0.2916857600212097,0.29759350419044495,0.3026101887226105,0.21771562099456787,873.64306640625,1e-05,0.1154983788728714,3.242091655731201,81.14050197601318,2 +3205,0.14616909623146057,0.31262442469596863,0.3183702528476715,0.22564102709293365,948.6395874023438,1e-05,0.11684414744377136,3.1129419803619385,81.14050197601318,2 +3206,0.22121059894561768,0.24721921980381012,0.25627028942108154,0.22890442609786987,728.9754028320312,1e-05,0.10960116237401962,3.1342780590057373,81.14050197601318,2 +3207,0.3822450637817383,0.22686950862407684,0.2427356243133545,0.2058275043964386,637.4429931640625,1e-05,0.1351703703403473,3.1246798038482666,81.14050197601318,2 +3208,0.5065714716911316,0.24852371215820312,0.26376399397850037,0.1258741319179535,772.7371215820312,1e-05,0.20517997443675995,3.1247150897979736,81.14050197601318,2 +3209,0.2998889982700348,0.2955831289291382,0.2948946952819824,0.1375291347503662,760.4534912109375,1e-05,0.6088874340057373,3.2044410705566406,81.14050197601318,2 +3210,0.2589084208011627,0.4458279609680176,0.43883174657821655,0.18554778397083282,999.7660522460938,1e-05,0.13082289695739746,3.3078725337982178,81.14050197601318,2 +3211,0.276822954416275,0.2506011128425598,0.2595500946044922,0.22960372269153595,743.3765869140625,1e-05,0.16373595595359802,3.1088383197784424,81.14050197601318,2 +3212,0.3037888705730438,0.38606950640678406,0.3807179033756256,0.15128205716609955,967.5030517578125,1e-05,0.1206175833940506,3.114183187484741,81.14050197601318,2 +3213,0.23500248789787292,0.2399245947599411,0.2478240430355072,0.17575757205486298,871.4204711914062,1e-05,1.5527561902999878,3.0818557739257812,81.14050197601318,2 +3214,0.15862083435058594,0.3425956070423126,0.35188227891921997,0.09696969389915466,966.04833984375,1e-05,0.15507052838802338,3.159815549850464,81.14050197601318,2 +3215,0.2610760033130646,0.4636085331439972,0.45970532298088074,0.23613053560256958,989.8240966796875,1e-05,0.1330348402261734,3.313925266265869,81.14050197601318,2 +3216,0.22802700102329254,0.26004931330680847,0.2698959708213806,0.1818181872367859,561.6887817382812,1e-05,0.10821659862995148,3.0919623374938965,81.14050197601318,2 +3217,0.2956364154815674,0.40755775570869446,0.419330358505249,0.21398600935935974,331.87054443359375,1e-05,0.12732917070388794,3.1946520805358887,81.14050197601318,2 +3218,0.33023521304130554,0.23384134471416473,0.23755869269371033,0.11375291645526886,926.9263305664062,1e-05,0.13698679208755493,3.103698968887329,81.14050197601318,2 +3219,0.5153958797454834,0.37389159202575684,0.37354615330696106,0.21515151858329773,424.38739013671875,1e-05,0.139666348695755,3.09549880027771,81.14050197601318,2 +3220,0.23654472827911377,0.25494080781936646,0.2604891061782837,0.14452214539051056,781.836181640625,1e-05,0.13971245288848877,3.1198625564575195,81.14050197601318,2 +3221,0.17380662262439728,0.27861979603767395,0.28012147545814514,0.21328671276569366,935.7356567382812,1e-05,1.309084177017212,3.3193483352661133,81.14050197601318,2 +3222,0.24291235208511353,0.31170201301574707,0.31126126646995544,0.20932400226593018,877.1219482421875,1e-05,0.1460537314414978,3.2835350036621094,81.14050197601318,2 +3223,0.460678368806839,0.2334102988243103,0.2484244704246521,0.2708624601364136,776.9306030273438,1e-05,0.12968015670776367,3.125180959701538,81.14050197601318,2 +3224,0.3680354952812195,0.2793287932872772,0.28949254751205444,0.1878787875175476,858.7315673828125,1e-05,0.2920231223106384,3.1375174522399902,81.14050197601318,2 +3225,0.13334739208221436,0.2681325376033783,0.27325984835624695,0.23310023546218872,988.4596557617188,1e-05,0.11024954169988632,3.097919225692749,81.14050197601318,2 +3226,0.3705424666404724,0.3590894937515259,0.35514217615127563,0.13379953801631927,687.85546875,1e-05,0.22473202645778656,3.1641042232513428,81.14050197601318,2 +3227,0.20572243630886078,0.2631799280643463,0.27276694774627686,0.1846153885126114,987.069091796875,1e-05,0.1421043872833252,3.099215269088745,81.14050197601318,2 +3228,0.22915536165237427,0.24727320671081543,0.25584515929222107,0.1878787875175476,887.0220336914062,1e-05,0.11457094550132751,3.0736124515533447,81.14050197601318,2 +3229,0.24335338175296783,0.26112815737724304,0.2722448408603668,0.22191141545772552,972.5713500976562,1e-05,0.16822731494903564,3.046428918838501,81.14050197601318,2 +3230,0.31598007678985596,0.2619861960411072,0.2692185938358307,0.23123542964458466,851.6567993164062,1e-05,0.10015351325273514,3.0941226482391357,81.14050197601318,2 +3231,0.4259604513645172,0.25409287214279175,0.2548818588256836,0.22284382581710815,926.0864868164062,1e-05,0.15314975380897522,3.1328043937683105,81.14050197601318,2 +3232,0.25765860080718994,0.3536168932914734,0.35889047384262085,0.23636363446712494,872.758544921875,1e-05,0.13043443858623505,3.060112953186035,81.14050197601318,2 +3233,0.30569225549697876,0.33002904057502747,0.3281339704990387,0.24731934070587158,604.99365234375,1e-05,0.09436008334159851,3.117642879486084,81.14050197601318,2 +3234,0.23681555688381195,0.14402161538600922,0.1593228429555893,0.14102564752101898,785.822265625,1e-05,0.09584365785121918,3.0773212909698486,81.14050197601318,2 +3235,0.2631532847881317,0.2750103175640106,0.2821565270423889,0.22074592113494873,620.8772583007812,1e-05,0.11570263653993607,3.103321075439453,81.14050197601318,2 +3236,0.2555220425128937,0.33369743824005127,0.3292965888977051,0.27272728085517883,958.17578125,1e-05,0.1768866628408432,3.115028142929077,81.14050197601318,2 +3237,0.31969669461250305,0.4275466203689575,0.4568926692008972,0.21235431730747223,127.0761489868164,1e-05,0.1418602615594864,3.0910487174987793,81.14050197601318,2 +3238,0.4247673749923706,0.2713451385498047,0.26124072074890137,0.25594404339790344,730.0392456054688,1e-05,0.13503095507621765,3.1371281147003174,81.14050197601318,2 +3239,0.2705719769001007,0.2776464819908142,0.28193262219429016,0.1906759887933731,926.9263305664062,1e-05,0.10460428893566132,3.113409996032715,81.14050197601318,2 +3240,0.4210147261619568,0.24316619336605072,0.25343409180641174,0.16200466454029083,922.0755004882812,1e-05,1.3588358163833618,3.143986940383911,81.14050197601318,2 +3241,0.16264623403549194,0.38199418783187866,0.39583879709243774,0.2170163094997406,966.04833984375,1e-05,0.09963209927082062,2.8400449752807617,81.14050197601318,2 +3242,0.26492470502853394,0.2758556604385376,0.28643229603767395,0.23426572978496552,885.8264770507812,1e-05,0.12985999882221222,3.1107594966888428,81.14050197601318,2 +3243,0.32436999678611755,0.23816390335559845,0.2638349235057831,0.2652680575847626,440.3874816894531,1e-05,0.14591675996780396,3.106044292449951,81.14050197601318,2 +3244,0.2169065922498703,0.3020358979701996,0.30268242955207825,0.2710955739021301,919.414306640625,1e-05,0.19839999079704285,3.0569405555725098,81.14050197601318,2 +3245,0.2987001836299896,0.19414889812469482,0.2020304948091507,0.10932400822639465,668.9708251953125,1e-05,0.1183181032538414,3.2028255462646484,81.14050197601318,2 +3246,0.43830838799476624,0.30802375078201294,0.3179348111152649,0.2298368364572525,819.9478759765625,1e-05,0.2898247241973877,3.069716691970825,81.14050197601318,2 +3247,0.3379773497581482,0.47949475049972534,0.49666398763656616,0.2825174927711487,206.04872131347656,1e-05,0.14086686074733734,3.0527281761169434,81.14050197601318,2 +3248,0.1863388568162918,0.27035000920295715,0.2827068865299225,0.14895105361938477,944.7620849609375,1e-05,0.11342740803956985,2.8482537269592285,81.14050197601318,2 +3249,0.24514321982860565,0.2528654932975769,0.25532597303390503,0.2545454502105713,863.5715942382812,1e-05,0.10341685265302658,3.1702845096588135,81.14050197601318,2 +3250,0.35906192660331726,0.30589473247528076,0.3047634959220886,0.22843822836875916,907.7332763671875,1e-05,0.13274870812892914,3.11186146736145,81.14050197601318,2 +3251,0.16520749032497406,0.20923270285129547,0.21253523230552673,0.16969697177410126,944.9946899414062,1e-05,0.1219329684972763,3.2620842456817627,81.14050197601318,2 +3252,0.2748575508594513,0.4884774386882782,0.49519503116607666,0.19044288992881775,973.2462768554688,1e-05,0.18334420025348663,3.0931739807128906,81.14050197601318,2 +3253,0.3099605441093445,0.17923876643180847,0.20804521441459656,0.17645686864852905,969.1096801757812,1e-05,0.34206241369247437,3.036407709121704,81.14050197601318,2 +3254,0.09668681025505066,0.20783217251300812,0.2091071605682373,0.07878787815570831,912.6188354492188,1e-05,0.10216014087200165,3.1170976161956787,81.14050197601318,2 +3255,0.3394071161746979,0.2740625739097595,0.2854689657688141,0.260606050491333,980.3147583007812,1e-05,0.10832091420888901,3.036600351333618,81.14050197601318,2 +3256,0.4129457473754883,0.30280524492263794,0.3084906041622162,0.21212121844291687,998.4646606445312,1e-05,0.11621589958667755,3.30955171585083,81.14050197601318,2 +3257,0.286769300699234,0.25373339653015137,0.2734508216381073,0.25314685702323914,991.5601806640625,1e-05,0.10385623574256897,3.034153461456299,81.14050197601318,2 +3258,0.26486194133758545,0.184610515832901,0.1951955258846283,0.06386946141719818,982.4352416992188,1e-05,0.21451811492443085,3.1082468032836914,81.14050197601318,2 +3259,0.08778003603219986,0.4064926505088806,0.3878805935382843,0.2242424190044403,990.36279296875,1e-05,0.15893104672431946,3.092714309692383,81.14050197601318,2 +3260,0.24043016135692596,0.22135929763317108,0.23973064124584198,0.16177156567573547,963.0614624023438,1e-05,0.12682826817035675,3.0931625366210938,81.14050197601318,2 +3261,0.1478131115436554,0.2760426998138428,0.2829475998878479,0.24289044737815857,902.2786865234375,1e-05,0.12444382905960083,3.046771764755249,81.14050197601318,2 +3262,0.3451823592185974,0.6100826263427734,0.6091655492782593,0.1515151560306549,146.47067260742188,1e-05,0.24160711467266083,3.025693655014038,81.14050197601318,2 +3263,0.32179826498031616,0.25760114192962646,0.27448293566703796,0.25034964084625244,979.8526000976562,1e-05,0.1129741296172142,3.322343587875366,81.14050197601318,2 +3264,0.3895670771598816,0.2914499044418335,0.2853794991970062,0.21771562099456787,787.3915405273438,1e-05,0.15544192492961884,3.061307430267334,81.14050197601318,2 +3265,0.17540845274925232,0.4085811674594879,0.39992260932922363,0.2086247056722641,997.1378173828125,1e-05,0.14870698750019073,3.0792691707611084,81.14050197601318,2 +3266,0.2462257742881775,0.2337605506181717,0.2545328438282013,0.2282051295042038,943.5906372070312,1e-05,0.6262639760971069,3.1343777179718018,81.14050197601318,2 +3267,0.19453968107700348,0.1825615018606186,0.20397426187992096,0.13426573574543,944.0609741210938,1e-05,0.11128620058298111,3.1124236583709717,81.14050197601318,2 +3268,0.2550950050354004,0.3387987017631531,0.3365938663482666,0.2557109594345093,953.2152709960938,1e-05,0.12846505641937256,3.075155019760132,81.14050197601318,2 +3269,0.2013370394706726,0.2663210332393646,0.26994580030441284,0.21095570921897888,850.6163940429688,1e-05,0.1257275491952896,3.105045795440674,81.14050197601318,2 +3270,0.3129575550556183,0.1697586178779602,0.17585349082946777,0.07622377574443817,906.7301635742188,1e-05,0.3038371801376343,3.084465265274048,81.14050197601318,2 +3271,0.2650596797466278,0.3101394474506378,0.3236089050769806,0.26083916425704956,997.0159301757812,1e-05,0.30124422907829285,3.09696102142334,81.14050197601318,2 +3272,0.11380233615636826,0.30946609377861023,0.30786487460136414,0.1878787875175476,990.36279296875,1e-05,0.13233023881912231,3.149947166442871,81.14050197601318,2 +3273,0.2009352296590805,0.2947179079055786,0.2969714403152466,0.18321678042411804,978.4493408203125,1e-05,0.10272353887557983,3.0473766326904297,81.14050197601318,2 +3274,0.34257882833480835,0.27557799220085144,0.28769248723983765,0.20163169503211975,950.4097290039062,1e-05,0.19216863811016083,3.0530292987823486,81.14050197601318,2 +3275,0.15916253626346588,0.2743796706199646,0.2872638702392578,0.19230769574642181,938.2591552734375,1e-05,0.11455594748258591,3.248979330062866,81.14050197601318,2 +3276,0.2574469745159149,0.31835809350013733,0.3192223310470581,0.279720276594162,828.6761474609375,1e-05,0.1419118195772171,2.830789566040039,81.14050197601318,2 +3277,0.3173061013221741,0.26236340403556824,0.28027400374412537,0.20233100652694702,984.2067260742188,1e-05,0.30842870473861694,3.137441635131836,81.14050197601318,2 +3278,0.3013482987880707,0.3740790784358978,0.38714155554771423,0.26083916425704956,348.26116943359375,1e-05,0.13787154853343964,3.3691368103027344,81.14050197601318,2 +3279,0.2882676124572754,0.2460608035326004,0.25238528847694397,0.24871794879436493,792.7744140625,1e-05,0.14943239092826843,3.1035654544830322,81.14050197601318,2 +3280,0.3863832652568817,0.3600514233112335,0.3690933287143707,0.21212121844291687,500.3907775878906,1e-05,0.10742756724357605,3.036081314086914,81.14050197601318,2 +3281,0.2887529134750366,0.28906524181365967,0.2993982434272766,0.22354312241077423,974.4140625,1e-05,0.10764965415000916,3.2510368824005127,81.14050197601318,2 +3282,0.14554250240325928,0.27810919284820557,0.27673181891441345,0.09067598730325699,968.7553100585938,1e-05,0.11873452365398407,2.8417372703552246,81.14050197601318,2 +3283,0.24865411221981049,0.2587463855743408,0.2700903117656708,0.15361304581165314,660.37890625,1e-05,0.13126465678215027,3.074793815612793,81.14050197601318,2 +3284,0.47900253534317017,0.27804335951805115,0.3056638836860657,0.19090908765792847,967.5030517578125,1e-05,0.12651342153549194,3.189190626144409,81.14050197601318,2 +3285,0.18453913927078247,0.27178850769996643,0.2846471965312958,0.17435897886753082,931.826171875,1e-05,0.11086763441562653,2.840489387512207,81.14050197601318,2 +3286,0.2749479115009308,0.20189908146858215,0.21161897480487823,0.19044288992881775,741.38232421875,1e-05,0.1579933911561966,3.088555097579956,81.14050197601318,2 +3287,0.2648699879646301,0.26084020733833313,0.27193889021873474,0.2829836905002594,706.4580688476562,1e-05,0.10882040858268738,3.2914493083953857,81.14050197601318,2 +3288,0.18759164214134216,0.3043663203716278,0.3126846253871918,0.2242424190044403,968.2208862304688,1e-05,0.1594482809305191,2.832730531692505,81.14050197601318,2 +3289,0.243168443441391,0.2718749940395355,0.26473185420036316,0.2242424190044403,920.9009399414062,1e-05,0.1177019253373146,3.1159987449645996,81.14050197601318,2 +3290,0.254189133644104,0.361733615398407,0.36793774366378784,0.22564102709293365,998.8220825195312,1e-05,0.14870962500572205,3.4646995067596436,81.14050197601318,2 +3291,0.3207691013813019,0.23118968307971954,0.25167301297187805,0.16969697177410126,661.8328857421875,1e-05,0.12423887848854065,2.83396577835083,81.14050197601318,2 +3292,0.3986823856830597,0.30146071314811707,0.29998886585235596,0.20163169503211975,949.7498168945312,1e-05,0.10465973615646362,3.2925777435302734,81.14050197601318,2 +3293,0.33314165472984314,0.4847327768802643,0.4668000638484955,0.23333333432674408,968.57763671875,1e-05,0.15677881240844727,3.31697940826416,81.14050197601318,2 +3294,0.2609621286392212,0.35407981276512146,0.3725806474685669,0.10722610354423523,982.7333984375,1e-05,0.1055305153131485,3.0608675479888916,81.14050197601318,2 +3295,0.3338152766227722,0.30648374557495117,0.31793612241744995,0.21631701290607452,951.0648803710938,1e-05,0.12397580593824387,2.8427648544311523,81.14050197601318,2 +3296,0.4606459438800812,0.2915553152561188,0.2903998792171478,0.2097902148962021,973.4141235351562,1e-05,0.14100684225559235,3.4211678504943848,81.14050197601318,2 +3297,0.2116163820028305,0.3471298813819885,0.34329891204833984,0.1878787875175476,947.2893676757812,1e-05,0.11001553386449814,2.8423023223876953,81.14050197601318,2 +3298,0.3610660433769226,0.5887772440910339,0.5895137786865234,0.25244754552841187,171.19692993164062,1e-05,0.12880882620811462,3.275822401046753,81.14050197601318,2 +3299,0.3890208899974823,0.2546432316303253,0.2678585648536682,0.22400932013988495,918.2099609375,1e-05,0.1340433806180954,3.124694347381592,81.14050197601318,2 +3300,0.2717302739620209,0.2338012456893921,0.2433142513036728,0.10256410390138626,701.6507568359375,1e-05,0.14043690264225006,3.0520806312561035,81.14050197601318,2 +3301,0.2073899656534195,0.26016002893447876,0.2635636031627655,0.20722611248493195,916.6853637695312,1e-05,0.11389189958572388,3.333117723464966,81.14050197601318,2 +3302,0.4477546215057373,0.21620747447013855,0.23325105011463165,0.2522144615650177,743.3765869140625,1e-05,0.10448019206523895,3.4569947719573975,81.14050197601318,2 +3303,0.1932850182056427,0.16762427985668182,0.18779437243938446,0.28601399064064026,893.9605712890625,1e-05,0.11873292922973633,3.0369651317596436,81.14050197601318,2 +3304,0.3253290355205536,0.2819898724555969,0.2940930426120758,0.2354312390089035,962.6806640625,1e-05,0.13778945803642273,3.0987322330474854,81.14050197601318,2 +3305,0.15219545364379883,0.310356080532074,0.3168545365333557,0.25594404339790344,736.306396484375,1e-05,0.11039985716342926,3.1359376907348633,81.14050197601318,2 +3306,0.3549190163612366,0.28554773330688477,0.3002259433269501,0.17575757205486298,738.3524169921875,1e-05,0.12713301181793213,3.074640989303589,81.14050197601318,2 +3307,0.19980263710021973,0.2954658567905426,0.30043843388557434,0.2058275043964386,939.9876098632812,1e-05,0.14164988696575165,3.3564703464508057,81.14050197601318,2 +3308,0.2673327326774597,0.32166770100593567,0.31843239068984985,0.20069929957389832,986.6468505859375,1e-05,0.11721222847700119,3.4212489128112793,81.14050197601318,2 +3309,0.12714901566505432,0.3149028420448303,0.31980589032173157,0.1986013948917389,977.0203857421875,1e-05,0.11089541018009186,3.080185651779175,81.14050197601318,2 +3310,0.15544988214969635,0.24409832060337067,0.25962790846824646,0.19720280170440674,912.93701171875,1e-05,0.28361570835113525,3.326427698135376,81.14050197601318,2 +3311,0.23036663234233856,0.19237546622753143,0.21054504811763763,0.2543123662471771,946.8348388671875,1e-05,0.2842748463153839,3.1146926879882812,81.14050197601318,2 +3312,0.2678954005241394,0.37289226055145264,0.3765513598918915,0.279720276594162,966.04833984375,1e-05,0.1493871808052063,3.078982353210449,81.14050197601318,2 +3313,0.37037214636802673,0.3575267791748047,0.3543899655342102,0.2041957974433899,999.7660522460938,1e-05,0.09854135662317276,3.370199203491211,81.14050197601318,2 +3314,0.275535523891449,0.2735556960105896,0.27831193804740906,0.16083915531635284,883.8079833984375,1e-05,0.13894659280776978,3.0341529846191406,81.14050197601318,2 +3315,0.333801805973053,0.2573114037513733,0.2828935980796814,0.1958041936159134,983.9144897460938,1e-05,0.12933287024497986,3.0524842739105225,81.14050197601318,2 +3316,0.4594915807247162,0.15420736372470856,0.1800587922334671,0.19370628893375397,724.6637573242188,1e-05,0.2029423713684082,3.26002836227417,81.14050197601318,2 +3317,0.2919756770133972,0.2442665696144104,0.2664554715156555,0.15291374921798706,520.6055908203125,1e-05,0.2716469466686249,3.1685760021209717,81.14050197601318,2 +3318,0.2998460531234741,0.2599985599517822,0.2781210243701935,0.23240093886852264,584.1925659179688,1e-05,0.12435174733400345,3.1080245971679688,81.14050197601318,2 +3319,0.36518871784210205,0.30772411823272705,0.31450748443603516,0.24452213943004608,648.4168090820312,1e-05,0.12732833623886108,3.3107211589813232,81.14050197601318,2 +3320,0.41491061449050903,0.2175108939409256,0.2259654551744461,0.19044288992881775,610.396240234375,1e-05,0.1372791826725006,3.0807785987854004,81.14050197601318,2 +3321,0.25199779868125916,0.3292813003063202,0.3381536602973938,0.1314685344696045,877.97705078125,1e-05,0.1459389328956604,3.0834174156188965,81.14050197601318,2 +3322,0.4275955855846405,0.2284289002418518,0.2363000065088272,0.13286712765693665,989.0084838867188,1e-05,0.162650004029274,3.298128604888916,81.14050197601318,2 +3323,0.2502692937850952,0.19785484671592712,0.21866406500339508,0.15337994694709778,812.7318115234375,1e-05,0.10496286302804947,2.832397937774658,81.14050197601318,2 +3324,0.2035209834575653,0.29275330901145935,0.29755905270576477,0.2030303031206131,960.5552368164062,1e-05,0.10815174877643585,3.1054582595825195,81.14050197601318,2 +3325,0.15294446051120758,0.2082924246788025,0.2261572778224945,0.10303030163049698,965.8648071289062,1e-05,0.17596054077148438,3.1451125144958496,81.14050197601318,2 +3326,0.3428422808647156,0.4074053466320038,0.41580528020858765,0.17575757205486298,434.07476806640625,1e-05,0.12457186728715897,2.8392908573150635,81.14050197601318,2 +3327,0.23177260160446167,0.300820529460907,0.3151545226573944,0.21282051503658295,795.77587890625,1e-05,0.19925090670585632,3.1070785522460938,81.14050197601318,2 +3328,0.30816537141799927,0.3437722325325012,0.3532072901725769,0.1974359005689621,954.4815673828125,1e-05,0.11422453820705414,3.293574571609497,81.14050197601318,2 +3329,0.17840301990509033,0.2783712148666382,0.27984854578971863,0.16480186581611633,873.2015991210938,1e-05,0.1295044869184494,2.8317770957946777,81.14050197601318,2 +3330,0.4314359724521637,0.27214741706848145,0.2764599919319153,0.10559440404176712,727.9061279296875,1e-05,0.1342708319425583,3.095625162124634,81.14050197601318,2 +3331,0.2504773437976837,0.236476331949234,0.25133317708969116,0.24125874042510986,948.4158325195312,1e-05,0.2598017156124115,3.4160192012786865,81.14050197601318,2 +3332,0.29229363799095154,0.30602675676345825,0.3155173063278198,0.225874125957489,913.2542724609375,1e-05,0.17813223600387573,2.8382887840270996,81.14050197601318,2 +3333,0.33994191884994507,0.5420433282852173,0.5598236918449402,0.19114218652248383,997.6233520507812,1e-05,0.09775631874799728,3.1094088554382324,81.14050197601318,2 +3334,0.35948294401168823,0.23183152079582214,0.25761765241622925,0.1895104944705963,859.223388671875,1e-05,0.10928168892860413,3.2844021320343018,81.14050197601318,2 +3335,0.31969842314720154,0.5710142254829407,0.5782354474067688,0.1426573395729065,183.10153198242188,1e-05,0.11307966709136963,2.842562437057495,81.14050197601318,2 +3336,0.29120907187461853,0.21624307334423065,0.2376313954591751,0.16083915531635284,746.3303833007812,1e-05,0.12674720585346222,3.0978622436523438,81.14050197601318,2 +3337,0.35174065828323364,0.19796107709407806,0.20662681758403778,0.10093239694833755,622.5833740234375,1e-05,0.12871362268924713,3.4782121181488037,81.14050197601318,2 +3338,0.22929231822490692,0.2904909551143646,0.3008202016353607,0.23799534142017365,950.1903076171875,1e-05,0.11489363014698029,2.842684507369995,81.14050197601318,2 +3339,0.1695532351732254,0.20109206438064575,0.20632082223892212,0.24428904056549072,787.3915405273438,1e-05,0.192213773727417,3.0511131286621094,81.14050197601318,2 +3340,0.46919769048690796,0.31755053997039795,0.3190322518348694,0.22004662454128265,686.5575561523438,1e-05,0.1371912658214569,3.3075478076934814,81.14050197601318,2 +3341,0.34628191590309143,0.4290549159049988,0.45945531129837036,0.1958041936159134,238.46560668945312,1e-05,0.1362646222114563,2.841747999191284,81.14050197601318,2 +3342,0.19422250986099243,0.2936936914920807,0.3067214787006378,0.2426573485136032,966.2316284179688,1e-05,0.34434905648231506,3.0611205101013184,81.14050197601318,2 +3343,0.285189151763916,0.32140693068504333,0.32280996441841125,0.2601398527622223,870.5208129882812,1e-05,0.21117547154426575,3.4754273891448975,81.14050197601318,2 +3344,0.5138462781906128,0.22011275589466095,0.23670044541358948,0.1762237697839737,772.7371215820312,1e-05,0.11942379921674728,2.836456537246704,81.14050197601318,2 +3345,0.2016141414642334,0.2376316487789154,0.25594523549079895,0.21235431730747223,553.0419311523438,1e-05,0.13218146562576294,4.3910462856292725,81.14050197601318,2 +3346,0.3525957465171814,0.34090733528137207,0.34604156017303467,0.17972028255462646,397.1928405761719,1e-05,0.11041752249002457,3.0838027000427246,81.14050197601318,2 +3347,0.23576675355434418,0.18803387880325317,0.20917735993862152,0.15337994694709778,882.9913330078125,1e-05,0.8941500186920166,2.83321475982666,81.14050197601318,2 +3348,0.4933837354183197,0.2912670969963074,0.2885434925556183,0.1734265685081482,728.9754028320312,1e-05,0.13164985179901123,3.0852012634277344,81.14050197601318,2 +3349,0.20207691192626953,0.28888627886772156,0.2869831621646881,0.23286713659763336,929.1331176757812,1e-05,0.11355707049369812,3.147641181945801,81.14050197601318,2 +3350,0.200033500790596,0.2794901728630066,0.2935045063495636,0.07668997347354889,983.178466796875,1e-05,0.11653274297714233,3.026106357574463,81.14050197601318,2 +3351,0.2792079448699951,0.25461462140083313,0.25690844655036926,0.12121211737394333,804.4718627929688,1e-05,0.29971936345100403,2.8368465900421143,81.14050197601318,2 +3352,0.3063536286354065,0.28715530037879944,0.31617218255996704,0.1354312300682068,986.6468505859375,1e-05,0.11181837320327759,3.16618013381958,81.14050197601318,2 +3353,0.288158655166626,0.18746475875377655,0.20457425713539124,0.23752914369106293,670.3726196289062,1e-05,0.13324929773807526,2.835689067840576,81.14050197601318,2 +3354,0.3299989402294159,0.19597099721431732,0.2014703005552292,0.1298368275165558,660.37890625,1e-05,0.16435030102729797,3.096083641052246,81.14050197601318,2 +3355,0.20050877332687378,0.251681387424469,0.268309623003006,0.18251748383045197,990.630615234375,1e-05,0.11118709295988083,3.120623826980591,81.14050197601318,2 +3356,0.23566411435604095,0.22166423499584198,0.2298496961593628,0.14172494411468506,508.12554931640625,1e-05,0.14749576151371002,3.0406742095947266,81.14050197601318,2 +3357,0.17090024054050446,0.3950776159763336,0.40840616822242737,0.19720280170440674,997.6233520507812,1e-05,0.10672537982463837,2.8360321521759033,81.14050197601318,2 +3358,0.28767335414886475,0.370247483253479,0.37594112753868103,0.24522145092487335,340.1504821777344,1e-05,0.10494989901781082,3.1631479263305664,81.14050197601318,2 +3359,0.38938960433006287,0.2853490114212036,0.3031226098537445,0.17599067091941833,908.7275390625,1e-05,0.17302149534225464,2.835899829864502,81.14050197601318,2 +3360,0.46774235367774963,0.2917129397392273,0.2938537299633026,0.225874125957489,860.688232421875,1e-05,0.5063357949256897,3.148144483566284,81.14050197601318,2 +3361,0.18357039988040924,0.53007972240448,0.5525065064430237,0.16969697177410126,995.9088745117188,1e-05,0.1368059664964676,3.1255078315734863,81.14050197601318,2 +3362,0.21914246678352356,0.2899107336997986,0.29016369581222534,0.20000000298023224,795.030517578125,1e-05,0.1169516071677208,3.0121397972106934,81.14050197601318,2 +3363,0.2514684796333313,0.28331083059310913,0.2780822515487671,0.20815850794315338,892.831298828125,1e-05,0.13250409066677094,3.0776326656341553,81.14050197601318,2 +3364,0.2201632261276245,0.2963656485080719,0.3046736419200897,0.23240093886852264,989.5532836914062,1e-05,0.11672181636095047,2.8396618366241455,81.14050197601318,2 +3365,0.355837881565094,0.5601118206977844,0.5924645662307739,0.26363635063171387,120.44096374511719,1e-05,0.11512812227010727,2.84552264213562,81.14050197601318,2 +3366,0.14868338406085968,0.2968941628932953,0.30594417452812195,0.23496504127979279,938.2591552734375,1e-05,0.1117466613650322,3.5970802307128906,81.14050197601318,2 +3367,0.23815587162971497,0.31647148728370667,0.3223426640033722,0.1878787875175476,895.4498291015625,1e-05,1.037936806678772,2.845594882965088,81.14050197601318,2 +3368,0.162552148103714,0.29505348205566406,0.3016277253627777,0.17552447319030762,753.0517578125,1e-05,0.10720080882310867,3.0561282634735107,81.14050197601318,2 +3369,0.4903181791305542,0.7307094931602478,0.747348427772522,0.20512820780277252,106.90462493896484,1e-05,0.22743047773838043,3.097893476486206,81.14050197601318,2 +3370,0.23766134679317474,0.31866249442100525,0.3151877224445343,0.23193472623825073,767.5730590820312,1e-05,0.13816212117671967,2.839726686477661,81.14050197601318,2 +3371,0.30254223942756653,0.23278792202472687,0.23888787627220154,0.19510489702224731,940.2321166992188,1e-05,0.13703197240829468,2.837587833404541,81.14050197601318,2 +3372,0.3756448030471802,0.3249732255935669,0.3340095579624176,0.29277390241622925,836.3575439453125,1e-05,0.13062894344329834,3.5836329460144043,81.14050197601318,2 +3373,0.26026225090026855,0.2949846386909485,0.2881386876106262,0.20163169503211975,913.5706787109375,1e-05,0.10150109976530075,2.8317739963531494,81.14050197601318,2 +3374,0.3294139504432678,0.24229730665683746,0.2527156472206116,0.23892773687839508,920.605224609375,1e-05,0.13035140931606293,3.086047887802124,81.14050197601318,2 +3375,0.22275368869304657,0.198131263256073,0.22288024425506592,0.264102578163147,855.2390747070312,1e-05,0.13255296647548676,3.2977492809295654,81.14050197601318,2 +3376,0.421016663312912,0.2502844035625458,0.26029589772224426,0.22447551786899567,892.831298828125,1e-05,0.12102976441383362,2.8380887508392334,81.14050197601318,2 +3377,0.2058032900094986,0.3599850833415985,0.3607969284057617,0.04545454680919647,995.535888671875,1e-05,0.15077205002307892,3.0843348503112793,81.14050197601318,2 +3378,0.2878689169883728,0.19102990627288818,0.221897155046463,0.19137528538703918,811.3840942382812,1e-05,0.1004602238535881,3.2255494594573975,81.14050197601318,2 +3379,0.27191007137298584,0.2918223738670349,0.2912312150001526,0.25314685702323914,685.2521362304688,1e-05,0.16691768169403076,2.8336286544799805,81.14050197601318,2 +3380,0.16580361127853394,0.2906079888343811,0.2930981516838074,0.10116550326347351,742.382080078125,1e-05,0.11072999238967896,3.1083741188049316,81.14050197601318,2 +3381,0.36262911558151245,0.27798977494239807,0.27075138688087463,0.20629370212554932,825.6151733398438,1e-05,0.12912967801094055,3.360028028488159,81.14050197601318,2 +3382,0.3612886071205139,0.2865881323814392,0.29136237502098083,0.2226107269525528,938.5079956054688,1e-05,0.11553089320659637,2.8280415534973145,81.14050197601318,2 +3383,0.31619495153427124,0.3772539496421814,0.3755834400653839,0.24801865220069885,797.99267578125,1e-05,0.10349027067422867,3.149397611618042,81.14050197601318,2 +3384,0.22689512372016907,0.29712972044944763,0.29777565598487854,0.02750582806766033,745.3507080078125,1e-05,0.09700126945972443,3.228747606277466,81.14050197601318,2 +3385,0.35486602783203125,0.19541314244270325,0.2088501900434494,0.15011654794216156,673.1508178710938,1e-05,0.14307953417301178,2.839670181274414,81.14050197601318,2 +3386,0.14234475791454315,0.28668293356895447,0.2911917567253113,0.19044288992881775,923.525634765625,1e-05,0.1435655802488327,3.3558244705200195,81.14050197601318,2 +3387,0.1765713095664978,0.23525992035865784,0.2431376874446869,0.2242424190044403,896.920654296875,1e-05,0.13811704516410828,3.20552134513855,81.14050197601318,2 +3388,0.2818022668361664,0.38817110657691956,0.38450419902801514,0.19976690411567688,976.5382080078125,1e-05,0.1308692991733551,2.827371597290039,81.14050197601318,2 +3389,0.14177508652210236,0.3407362699508667,0.3502141237258911,0.21771562099456787,968.57763671875,1e-05,0.1263047605752945,3.1585023403167725,81.14050197601318,2 +3390,0.18248285353183746,0.27438005805015564,0.26870208978652954,0.2130536139011383,830.4837646484375,1e-05,0.10492796450853348,3.488131284713745,81.14050197601318,2 +3391,0.18657219409942627,0.30973514914512634,0.30956172943115234,0.27482518553733826,965.4962768554688,1e-05,0.09967596083879471,2.825418472290039,81.14050197601318,2 +3392,0.2655858099460602,0.24599187076091766,0.2575873136520386,0.17575757205486298,875.8281860351562,1e-05,0.15076804161071777,3.292828321456909,81.14050197601318,2 +3393,0.3432398736476898,0.4209906756877899,0.4462451934814453,0.10699300467967987,206.04872131347656,1e-05,0.1689462959766388,3.1070430278778076,81.14050197601318,2 +3394,0.1552427113056183,0.22970382869243622,0.24059028923511505,0.09696969389915466,874.9585571289062,1e-05,0.14374326169490814,2.826305866241455,81.14050197601318,2 +3395,0.46188920736312866,0.5390267968177795,0.5335930585861206,0.24405594170093536,283.0556640625,1e-05,0.1404871791601181,3.142881393432617,81.14050197601318,2 +3396,0.20311999320983887,0.3267177641391754,0.3204275369644165,0.17482517659664154,733.1973266601562,1e-05,0.12569446861743927,3.4462199211120605,81.14050197601318,2 +3397,0.1837807595729828,0.4137164354324341,0.40998348593711853,0.21002331376075745,987.4890747070312,1e-05,0.11862418800592422,2.8303141593933105,81.14050197601318,2 +3398,0.179914653301239,0.2781597673892975,0.2819496691226959,0.13426573574543,997.86474609375,1e-05,0.10152250528335571,3.270979166030884,81.14050197601318,2 +3399,0.3597285747528076,0.3176778554916382,0.33563360571861267,0.16480186581611633,599.4783325195312,1e-05,0.14514479041099548,3.104428291320801,81.14050197601318,2 +3400,0.12261908501386642,0.4179289937019348,0.4022690951824188,0.19930069148540497,985.9375,1e-05,0.13349352777004242,2.8268332481384277,81.14050197601318,2 +3401,0.36571377515792847,0.2532758116722107,0.2608965039253235,0.2186480164527893,769.3107299804688,1e-05,0.11214308440685272,3.364577531814575,81.14050197601318,2 +3402,0.2942335605621338,0.27380630373954773,0.27456286549568176,0.13519813120365143,984.643310546875,1e-05,0.8003756999969482,3.3163816928863525,81.14050197601318,2 +3403,0.13668888807296753,0.3488636910915375,0.3633214831352234,0.21958041191101074,962.4896240234375,1e-05,0.18627916276454926,3.100343942642212,81.14050197601318,2 +3404,0.17822909355163574,0.34182968735694885,0.3409002423286438,0.23799534142017365,987.069091796875,1e-05,0.08301863074302673,3.055189609527588,81.14050197601318,2 +3405,0.15319418907165527,0.21930883824825287,0.23635439574718475,0.19813519716262817,924.38623046875,1e-05,0.14674422144889832,2.837636947631836,81.14050197601318,2 +3406,0.17826008796691895,0.225772425532341,0.2406575232744217,0.18811188638210297,881.756103515625,1e-05,0.12174087762832642,2.839508295059204,81.14050197601318,2 +3407,0.16868169605731964,0.26898062229156494,0.27729901671409607,0.12377621978521347,850.0933227539062,1e-05,0.12514658272266388,3.3968427181243896,81.14050197601318,2 +3408,0.14494943618774414,0.2818760573863983,0.28689447045326233,0.26153844594955444,902.6273193359375,1e-05,0.1290249526500702,3.1652956008911133,81.14050197601318,2 +3409,0.1901349574327469,0.3006271421909332,0.2993427515029907,0.18927739560604095,830.4837646484375,1e-05,0.18183934688568115,3.102618455886841,81.14050197601318,2 +3410,0.35409265756607056,0.36223238706588745,0.3675616979598999,0.21212121844291687,417.7786560058594,1e-05,0.19508039951324463,3.081906318664551,81.14050197601318,2 +3411,0.1718929558992386,0.3690813481807709,0.37870410084724426,0.24195803701877594,971.5481567382812,1e-05,0.17165614664554596,2.8361730575561523,81.14050197601318,2 +3412,0.22527869045734406,0.1613440215587616,0.18911112844944,0.22400932013988495,753.992919921875,1e-05,0.12332195043563843,2.836577892303467,81.14050197601318,2 +3413,0.20840761065483093,0.2859174609184265,0.2778412997722626,0.16153846681118011,874.0830688476562,1e-05,0.12731465697288513,3.4379615783691406,81.14050197601318,2 +3414,0.4242801368236542,0.3971709609031677,0.4054027497768402,0.2678321599960327,952.3612670898438,1e-05,0.40720096230506897,3.136014938354492,81.14050197601318,2 +3415,0.3628503084182739,0.34586670994758606,0.3465517461299896,0.18251748383045197,947.5157470703125,1e-05,0.16626298427581787,3.100647449493408,81.14050197601318,2 +3416,0.2886229455471039,0.37571433186531067,0.3801586925983429,0.24428904056549072,969.6383056640625,1e-05,0.34509482979774475,3.356106996536255,81.14050197601318,2 +3417,0.2418304979801178,0.4050304889678955,0.40405213832855225,0.23636363446712494,955.7301025390625,1e-05,0.3152998685836792,2.8406217098236084,81.14050197601318,2 +3418,0.2261427491903305,0.24871107935905457,0.25804299116134644,0.08484848588705063,944.0609741210938,1e-05,0.11577943712472916,2.8516929149627686,81.14050197601318,2 +3419,0.22494426369667053,0.38765189051628113,0.3920232951641083,0.27668997645378113,973.9156494140625,1e-05,0.2951532006263733,3.4000463485717773,81.14050197601318,2 +3420,0.24554140865802765,0.24534086883068085,0.25933077931404114,0.19650349020957947,962.6806640625,1e-05,0.11301695555448532,2.835360050201416,81.14050197601318,2 +3421,0.3787078559398651,0.2744378447532654,0.2805877923965454,0.26923078298568726,875.3941650390625,1e-05,0.22146140038967133,3.1280994415283203,81.14050197601318,2 +3422,0.45682114362716675,0.2940222918987274,0.30508971214294434,0.19393938779830933,818.01220703125,1e-05,0.12592832744121552,3.303217649459839,81.14050197601318,2 +3423,0.2967871129512787,0.4809822738170624,0.5001633167266846,0.08484848588705063,238.46560668945312,1e-05,1.6760797500610352,3.160503625869751,81.14050197601318,2 +3424,0.3063340187072754,0.2792576253414154,0.2767656147480011,0.14219114184379578,779.4003295898438,1e-05,0.203388050198555,3.136094331741333,81.14050197601318,2 +3425,0.20771335065364838,0.265153169631958,0.2876085638999939,0.1750582754611969,947.9669189453125,1e-05,0.10094562917947769,3.406292676925659,81.14050197601318,2 +3426,0.4320034384727478,0.30287373065948486,0.31519654393196106,0.1850815862417221,278.3217468261719,1e-05,0.14096955955028534,2.8486077785491943,81.14050197601318,2 +3427,0.23847705125808716,0.3386683166027069,0.34777599573135376,0.17156177759170532,931.025634765625,1e-05,0.43930062651634216,3.071533203125,81.14050197601318,2 +3428,0.29534977674484253,0.2870137393474579,0.2857449948787689,0.1414918452501297,873.2015991210938,1e-05,0.11692878603935242,3.101675271987915,81.14050197601318,2 +3429,0.33887121081352234,0.2706219553947449,0.27020883560180664,0.12890443205833435,845.8379516601562,1e-05,0.12180860340595245,2.835357904434204,81.14050197601318,2 +3430,0.1545841097831726,0.39687812328338623,0.392210990190506,0.14195804297924042,991.4281005859375,1e-05,0.11687667667865753,3.079793930053711,81.14050197601318,2 +3431,0.12675884366035461,0.15796083211898804,0.17041757702827454,0.2030303031206131,810.7058715820312,1e-05,0.10590722411870956,3.409092903137207,81.14050197601318,2 +3432,0.18798421323299408,0.24929200112819672,0.25448358058929443,0.2130536139011383,794.2818603515625,1e-05,0.15471228957176208,2.8438940048217773,81.14050197601318,2 +3433,0.2047155499458313,0.28524065017700195,0.29056820273399353,0.16247086226940155,918.8137817382812,1e-05,0.18953882157802582,3.1224238872528076,81.14050197601318,2 +3434,0.31899726390838623,0.38263460993766785,0.374921053647995,0.25594404339790344,968.57763671875,1e-05,0.12242864072322845,3.100393056869507,81.14050197601318,2 +3435,0.18242070078849792,0.2355119287967682,0.24972228705883026,0.278554767370224,861.6561889648438,1e-05,0.08930070698261261,2.8347055912017822,81.14050197601318,2 +3436,0.2295849323272705,0.23846356570720673,0.24221406877040863,0.23146852850914001,819.3053588867188,1e-05,0.14224576950073242,3.0645387172698975,81.14050197601318,2 +3437,0.2957229018211365,0.25559884309768677,0.2767399847507477,0.2282051295042038,991.1632080078125,1e-05,0.1542235165834427,3.2775864601135254,81.14050197601318,2 +3438,0.27991142868995667,0.2807413935661316,0.2895609140396118,0.1958041936159134,654.4724731445312,1e-05,0.2117471694946289,2.833836793899536,81.14050197601318,2 +3439,0.12763048708438873,0.2040218859910965,0.22146739065647125,0.26247087121009827,935.22314453125,1e-05,0.18419213593006134,3.117785692214966,81.14050197601318,2 +3440,0.2927701473236084,0.4603460431098938,0.4705256521701813,0.19976690411567688,999.53125,1e-05,0.20165613293647766,2.8470420837402344,81.14050197601318,2 +3441,0.4125159978866577,0.2368648648262024,0.2550191581249237,0.10326340049505234,464.5392150878906,1e-05,0.16363084316253662,2.8504910469055176,81.14050197601318,2 +3442,0.2917200028896332,0.3034953474998474,0.315577894449234,0.1515151560306549,417.7786560058594,1e-05,0.4865831434726715,3.0848779678344727,81.14050197601318,2 +3443,0.15515545010566711,0.2974657416343689,0.3124292492866516,0.23986013233661652,885.8264770507812,1e-05,0.17221228778362274,3.0356431007385254,81.14050197601318,2 +3444,0.43933942914009094,0.2162894904613495,0.22209128737449646,0.08321678638458252,900.5198364257812,1e-05,0.12643934786319733,2.8407270908355713,81.14050197601318,2 +3445,0.29839974641799927,0.3097088932991028,0.3040044605731964,0.22727273404598236,763.1554565429688,1e-05,0.20505307614803314,3.4129467010498047,81.14050197601318,2 +3446,0.25723057985305786,0.2373485565185547,0.245988130569458,0.14918415248394012,765.8187255859375,1e-05,0.15488123893737793,2.828321933746338,81.14050197601318,2 +3447,0.3713127374649048,0.27115851640701294,0.2811393737792969,0.2293706238269806,640.6287231445312,1e-05,0.13575585186481476,2.8317294120788574,81.14050197601318,2 +3448,0.20284678041934967,0.35472434759140015,0.3668237328529358,0.20606060326099396,967.1416625976562,1e-05,0.1404726803302765,3.096331834793091,81.14050197601318,2 +3449,0.305159330368042,0.28569352626800537,0.31834572553634644,0.2158508151769638,961.9138793945312,1e-05,0.17003804445266724,3.073209047317505,81.14050197601318,2 +3450,0.39273300766944885,0.3567284047603607,0.35813894867897034,0.1846153885126114,979.0761108398438,1e-05,0.12869226932525635,2.843127489089966,81.14050197601318,2 +3451,0.17118732631206512,0.21096037328243256,0.2195286601781845,0.16689977049827576,940.7190551757812,1e-05,0.13468194007873535,3.1513748168945312,81.14050197601318,2 +3452,0.24823617935180664,0.16685837507247925,0.16994421184062958,0.13449883460998535,882.9913330078125,1e-05,0.13975849747657776,2.8408713340759277,81.14050197601318,2 +3453,0.26524025201797485,0.2902817130088806,0.304388165473938,0.11818181723356247,434.07476806640625,1e-05,0.15457329154014587,2.8379409313201904,81.14050197601318,2 +3454,0.1871529370546341,0.28231924772262573,0.28353333473205566,0.23892773687839508,879.2493286132812,1e-05,0.11924663931131363,3.165281295776367,81.14050197601318,2 +3455,0.1931774914264679,0.3728552460670471,0.3579067289829254,0.23193472623825073,971.2042846679688,1e-05,0.1187686175107956,3.115907669067383,81.14050197601318,2 +3456,0.27673253417015076,0.2693539261817932,0.2768424451351166,0.2599067687988281,913.5706787109375,1e-05,0.14502519369125366,2.836369752883911,81.14050197601318,2 +3457,0.2967984974384308,0.32903510332107544,0.32117119431495667,0.2613053619861603,997.3809814453125,1e-05,0.16504915058612823,3.3875443935394287,81.14050197601318,2 +3458,0.3624032139778137,0.33083879947662354,0.3293381929397583,0.21888111531734467,795.030517578125,1e-05,0.1098094955086708,2.8371922969818115,81.14050197601318,2 +3459,0.2378288358449936,0.2431792914867401,0.2470449060201645,0.10606060922145844,882.1692504882812,1e-05,0.8738004565238953,2.8445942401885986,81.14050197601318,2 +3460,0.25402989983558655,0.30633366107940674,0.32315459847450256,0.23146852850914001,988.18359375,1e-05,0.1358977109193802,3.3309340476989746,81.14050197601318,2 +3461,0.32768431305885315,0.3576762080192566,0.35096171498298645,0.20489510893821716,916.3778686523438,1e-05,0.15222539007663727,3.044679641723633,81.14050197601318,2 +3462,0.32503369450569153,0.3094295561313629,0.32339292764663696,0.20396269857883453,996.771484375,1e-05,0.10699500143527985,2.8360798358917236,81.14050197601318,2 +3463,0.08867435157299042,0.3170192837715149,0.327940970659256,0.238228440284729,966.596923828125,1e-05,0.16660454869270325,3.3407628536224365,81.14050197601318,2 +3464,0.3491500914096832,0.36774811148643494,0.3652198612689972,0.23030303418636322,778.5809936523438,1e-05,0.13776883482933044,2.842677354812622,81.14050197601318,2 +3465,0.11972346156835556,0.32478225231170654,0.3333885967731476,0.18111887574195862,964.940673828125,1e-05,0.16167008876800537,2.828725814819336,81.14050197601318,2 +3466,0.24895082414150238,0.2521507441997528,0.2609328329563141,0.20955711603164673,968.3995361328125,1e-05,0.10256170481443405,3.3974080085754395,81.14050197601318,2 +3467,0.31856808066368103,0.2567172050476074,0.2737884521484375,0.2410256415605545,941.926025390625,1e-05,0.1494717001914978,3.0481340885162354,81.14050197601318,2 +3468,0.24153292179107666,0.32422366738319397,0.3233627676963806,0.2613053619861603,858.2379760742188,1e-05,0.14505702257156372,3.059298515319824,81.14050197601318,2 +3469,0.25998106598854065,0.26289111375808716,0.2728228271007538,0.24195803701877594,768.4440307617188,1e-05,0.19694891571998596,3.389056444168091,81.14050197601318,2 +3470,0.413132905960083,0.30230215191841125,0.31517109274864197,0.18298368155956268,534.9400024414062,1e-05,0.14470434188842773,2.8426012992858887,81.14050197601318,2 +3471,0.30340057611465454,0.563702404499054,0.5816301703453064,0.22447551786899567,100.0000228881836,1e-05,0.1254989206790924,3.1217117309570312,81.14050197601318,2 +3472,0.18494153022766113,0.25956234335899353,0.27638307213783264,0.2433566451072693,958.17578125,1e-05,0.17755812406539917,3.274088144302368,81.14050197601318,2 +3473,0.25872522592544556,0.21825820207595825,0.2270495593547821,0.262937068939209,704.0678100585938,1e-05,0.20712457597255707,3.088459014892578,81.14050197601318,2 +3474,0.19036048650741577,0.2758488655090332,0.2743276357650757,0.22750583291053772,842.5615844726562,1e-05,1.1071608066558838,3.0992743968963623,81.14050197601318,2 +3475,0.24289722740650177,0.302193820476532,0.3067008852958679,0.1090909093618393,969.8138427734375,1e-05,0.20365263521671295,3.11487078666687,81.14050197601318,3 +3476,0.16047850251197815,0.3244292140007019,0.3287586569786072,0.24685314297676086,966.2316284179688,1e-05,0.1791786402463913,2.8538925647735596,81.14050197601318,3 +3477,0.3034333288669586,0.3348209857940674,0.3422211706638336,0.21328671276569366,990.228515625,1e-05,0.1269957572221756,3.108281373977661,81.14050197601318,3 +3478,0.40166327357292175,0.2626013159751892,0.2722800374031067,0.09696969389915466,586.15087890625,1e-05,0.2948724031448364,3.3921494483947754,81.14050197601318,3 +3479,0.2789831757545471,0.38188549876213074,0.3812592327594757,0.2198135256767273,997.86474609375,1e-05,0.18685531616210938,2.8388936519622803,81.14050197601318,3 +3480,0.21064835786819458,0.23836565017700195,0.24175046384334564,0.12097901850938797,908.0657348632812,1e-05,0.11560872197151184,3.2677695751190186,81.14050197601318,3 +3481,0.28222575783729553,0.3298482596874237,0.33588674664497375,0.2596736550331116,843.6619262695312,1e-05,0.15172168612480164,3.6016135215759277,81.14050197601318,3 +3482,0.3696977496147156,0.27925416827201843,0.29336005449295044,0.18694639205932617,976.0529174804688,1e-05,0.19886967539787292,2.840891122817993,81.14050197601318,3 +3483,0.3400334119796753,0.2526702582836151,0.26264888048171997,0.2293706238269806,731.0974731445312,1e-05,0.1940130740404129,3.068889856338501,81.14050197601318,3 +3484,0.13578243553638458,0.2586243152618408,0.27208009362220764,0.21678321063518524,920.0114135742188,1e-05,0.12073344737291336,3.352349042892456,81.14050197601318,3 +3485,0.13045480847358704,0.2633492648601532,0.2919178009033203,0.16200466454029083,976.3768310546875,1e-05,0.12190565466880798,2.8351054191589355,81.14050197601318,3 +3486,0.34981033205986023,0.3626788556575775,0.37911295890808105,0.22074592113494873,964.0061645507812,1e-05,0.163184255361557,3.290552854537964,81.14050197601318,3 +3487,0.3805028796195984,0.21829737722873688,0.23848694562911987,0.17202797532081604,940.4759521484375,1e-05,0.1451389193534851,3.0268943309783936,81.14050197601318,3 +3488,0.23496253788471222,0.25970780849456787,0.26629093289375305,0.2242424190044403,939.2506103515625,1e-05,0.11573467403650284,2.8479604721069336,81.14050197601318,3 +3489,0.12551678717136383,0.2737257778644562,0.27471280097961426,0.15804195404052734,898.7340087890625,1e-05,0.10766302794218063,3.0995125770568848,81.14050197601318,3 +3490,0.2721792161464691,0.5874398350715637,0.576441764831543,0.17575757205486298,988.8717041015625,1e-05,0.1528216451406479,3.116163969039917,81.14050197601318,3 +3491,0.15132679045200348,0.29830580949783325,0.2968848943710327,0.07738927751779556,976.2150268554688,1e-05,0.12567390501499176,2.8366236686706543,81.14050197601318,3 +3492,0.31812724471092224,0.2615438401699066,0.27026233077049255,0.23729602992534637,799.454345703125,1e-05,0.1351567655801773,3.323920965194702,81.14050197601318,3 +3493,0.18912839889526367,0.33487260341644287,0.33537107706069946,0.06480186432600021,996.4030151367188,1e-05,0.1260603368282318,3.0713698863983154,81.14050197601318,3 +3494,0.3178647756576538,0.15557998418807983,0.17390085756778717,0.2717948853969574,759.5440063476562,1e-05,0.13148878514766693,2.8381617069244385,81.14050197601318,3 +3495,0.33471444249153137,0.6016702651977539,0.6292382478713989,0.127505823969841,113.7176742553711,1e-05,0.12557625770568848,3.140136957168579,81.14050197601318,3 +3496,0.29693517088890076,0.25896963477134705,0.2612936794757843,0.2818181812763214,815.3939208984375,1e-05,0.11704541742801666,3.1412339210510254,81.14050197601318,3 +3497,0.15900075435638428,0.4640476107597351,0.5011999607086182,0.2566433548927307,986.221923828125,1e-05,0.12299324572086334,3.0623016357421875,81.14050197601318,3 +3498,0.4501115083694458,0.2793582081794739,0.2664395868778229,0.09044288843870163,961.334228515625,1e-05,0.1453794687986374,3.284982204437256,81.14050197601318,3 +3499,0.30035555362701416,0.27655965089797974,0.2973550260066986,0.19230769574642181,630.94677734375,1e-05,0.23052458465099335,2.838459014892578,81.14050197601318,3 +3500,0.3903887867927551,0.21181824803352356,0.23666270077228546,0.21351981163024902,910.0397338867188,1e-05,0.1303662806749344,2.8433501720428467,81.14050197601318,3 +3501,0.26443517208099365,0.2646724283695221,0.27769625186920166,0.23030303418636322,933.1463012695312,1e-05,0.1032160073518753,3.4292826652526855,81.14050197601318,3 +3502,0.30936145782470703,0.26862138509750366,0.2748661935329437,0.2142191082239151,835.7803955078125,1e-05,0.11085404455661774,2.8319454193115234,81.14050197601318,3 +3503,0.261622816324234,0.38780370354652405,0.39997559785842896,0.16573426127433777,993.6402587890625,1e-05,0.10835403203964233,3.0430450439453125,81.14050197601318,3 +3504,0.23249290883541107,0.35059812664985657,0.37669262290000916,0.1258741319179535,995.4110107421875,1e-05,0.09771166741847992,3.1257925033569336,81.14050197601318,3 +3505,0.2852317690849304,0.2474229484796524,0.2590387463569641,0.10885781049728394,557.397705078125,1e-05,0.15179623663425446,2.8267438411712646,81.14050197601318,3 +3506,0.3230782747268677,0.29964789748191833,0.3178849220275879,0.2214452177286148,992.3473510742188,1e-05,0.8980472683906555,2.826277017593384,81.14050197601318,3 +3507,0.2146034836769104,0.4367595613002777,0.4322437644004822,0.24708624184131622,996.5260620117188,1e-05,0.21201954782009125,3.3832061290740967,81.14050197601318,3 +3508,0.31526559591293335,0.2622072398662567,0.2684003412723541,0.2242424190044403,842.00830078125,1e-05,0.1194014772772789,2.8345701694488525,81.14050197601318,3 +3509,0.27580609917640686,0.40201976895332336,0.41270607709884644,0.20536130666732788,998.7031860351562,1e-05,0.12718309462070465,3.2427334785461426,81.14050197601318,3 +3510,0.16574200987815857,0.37040865421295166,0.37172389030456543,0.22797203063964844,974.7445068359375,1e-05,0.11743774265050888,3.321301221847534,81.14050197601318,3 +3511,0.25271886587142944,0.3129238486289978,0.3300231397151947,0.21002331376075745,956.9613647460938,1e-05,0.16199634969234467,2.8451573848724365,81.14050197601318,3 +3512,0.22662603855133057,0.1904849112033844,0.2121850848197937,0.2158508151769638,922.3670654296875,1e-05,0.17384988069534302,3.1133241653442383,81.14050197601318,3 +3513,0.3338724970817566,0.3411225974559784,0.3572891056537628,0.14848484098911285,238.46560668945312,1e-05,0.12228666990995407,3.273242712020874,81.14050197601318,3 +3514,0.26677119731903076,0.32887527346611023,0.34618866443634033,0.22727273404598236,996.4030151367188,1e-05,0.18030643463134766,2.849762201309204,81.14050197601318,3 +3515,0.36539289355278015,0.26263561844825745,0.2716708779335022,0.11142191290855408,866.3948974609375,1e-05,0.27899494767189026,3.420182228088379,81.14050197601318,3 +3516,0.23754113912582397,0.26051685214042664,0.2619003653526306,0.2102564126253128,608.6077880859375,1e-05,0.15121343731880188,3.112212896347046,81.14050197601318,3 +3517,0.401799738407135,0.22213612496852875,0.2352362424135208,0.24195803701877594,864.0462646484375,1e-05,0.18541200459003448,2.8486385345458984,81.14050197601318,3 +3518,0.2605983316898346,0.5001375675201416,0.49616488814353943,0.2780885696411133,995.9088745117188,1e-05,0.136628657579422,3.1208622455596924,81.14050197601318,3 +3519,0.4545309543609619,0.23358683288097382,0.23256106674671173,0.20885780453681946,844.7539672851562,1e-05,0.11238764226436615,3.041935443878174,81.14050197601318,3 +3520,0.25818076729774475,0.3380172550678253,0.3456399142742157,0.21888111531734467,995.6604614257812,1e-05,0.12825293838977814,2.833209276199341,81.14050197601318,3 +3521,0.4482146203517914,0.3920259177684784,0.3860602080821991,0.22494173049926758,263.79840087890625,1e-05,0.11127535998821259,3.330932378768921,81.14050197601318,3 +3522,0.28435540199279785,0.2821044921875,0.2791181206703186,0.16293705999851227,804.4718627929688,1e-05,0.13150545954704285,3.06374454498291,81.14050197601318,3 +3523,0.08824006468057632,0.22109661996364594,0.23352880775928497,0.2242424190044403,995.9088745117188,1e-05,0.26721397042274475,2.9805283546447754,81.14050197601318,3 +3524,0.36589735746383667,0.3232532739639282,0.3291263282299042,0.24638694524765015,871.8681030273438,1e-05,0.2894863784313202,3.38378643989563,81.14050197601318,3 +3525,0.22831247746944427,0.2703322470188141,0.28117167949676514,0.22167831659317017,797.99267578125,1e-05,0.13911965489387512,3.078127384185791,81.14050197601318,3 +3526,0.2186441570520401,0.3620775043964386,0.37288162112236023,0.10163170099258423,986.787841796875,1e-05,0.10606594383716583,2.8442821502685547,81.14050197601318,3 +3527,0.34635767340660095,0.25013914704322815,0.2541080713272095,0.2198135256767273,829.2810668945312,1e-05,0.17308062314987183,3.299382209777832,81.14050197601318,3 +3528,0.4040047228336334,0.2638058662414551,0.2738647758960724,0.2158508151769638,948.4158325195312,1e-05,0.11562687158584595,2.8532092571258545,81.14050197601318,3 +3529,0.3925752639770508,0.24906380474567413,0.26144206523895264,0.17855477333068848,748.2748413085938,1e-05,0.14985516667366028,2.850179672241211,81.14050197601318,3 +3530,0.2178248018026352,0.41403505206108093,0.42454952001571655,0.12937062978744507,995.4110107421875,1e-05,0.16693459451198578,3.1405341625213623,81.14050197601318,3 +3531,0.3492472767829895,0.34465306997299194,0.3447891175746918,0.20815850794315338,570.0819702148438,1e-05,0.11314339190721512,3.055936098098755,81.14050197601318,3 +3532,0.21354812383651733,0.3994249701499939,0.4041491746902466,0.2613053619861603,961.14013671875,1e-05,0.15458758175373077,3.0598161220550537,81.14050197601318,3 +3533,0.29166924953460693,0.2922448515892029,0.30165979266166687,0.23496504127979279,930.7574462890625,1e-05,0.14284761250019073,3.201134204864502,81.14050197601318,3 +3534,0.3855484426021576,0.3020612299442291,0.3141826391220093,0.22960372269153595,470.316650390625,1e-05,0.13029365241527557,2.84584641456604,81.14050197601318,3 +3535,0.19276927411556244,0.20907245576381683,0.2150336503982544,0.12097901850938797,838.6439208984375,1e-05,0.09762971103191376,3.1194846630096436,81.14050197601318,3 +3536,0.2923431992530823,0.3827400207519531,0.3831978738307953,0.1762237697839737,994.7838134765625,1e-05,0.1948528289794922,3.070882558822632,81.14050197601318,3 +3537,0.2857019901275635,0.27761903405189514,0.2828253507614136,0.1906759887933731,732.1500854492188,1e-05,0.16234859824180603,3.0479652881622314,81.14050197601318,3 +3538,0.23607783019542694,0.39688488841056824,0.3899117410182953,0.250582754611969,981.8353881835938,1e-05,0.11828921735286713,3.083317756652832,81.14050197601318,3 +3539,0.20240344107151031,0.40798893570899963,0.4181251525878906,0.1890442818403244,999.0592651367188,1e-05,0.14244675636291504,3.3186569213867188,81.14050197601318,3 +3540,0.10507520288228989,0.219400554895401,0.22927160561084747,0.2337995320558548,893.5853271484375,1e-05,0.28069865703582764,2.8376450538635254,81.14050197601318,3 +3541,0.4155232310295105,0.3399272859096527,0.3463919758796692,0.19930069148540497,957.3680419921875,1e-05,0.09997013956308365,3.109109401702881,81.14050197601318,3 +3542,0.3425164818763733,0.2585911154747009,0.26344338059425354,0.1862470805644989,823.121826171875,1e-05,0.29207462072372437,3.116976261138916,81.14050197601318,3 +3543,0.2885504961013794,0.3668310046195984,0.3803866505622864,0.2610722482204437,998.1053466796875,1e-05,0.12134698778390884,3.0622496604919434,81.14050197601318,3 +3544,0.30686500668525696,0.24057607352733612,0.2522474229335785,0.1818181872367859,671.7659301757812,1e-05,0.11694104224443436,3.081158399581909,81.14050197601318,3 +3545,0.2301379293203354,0.20453116297721863,0.22830581665039062,0.2482517510652542,879.2493286132812,1e-05,0.12026605010032654,3.3374221324920654,81.14050197601318,3 +3546,0.24697059392929077,0.17429062724113464,0.19237540662288666,0.14568763971328735,954.6907958984375,1e-05,0.39883992075920105,2.8424723148345947,81.14050197601318,3 +3547,0.18270932137966156,0.33817875385284424,0.34077489376068115,0.23706293106079102,927.482421875,1e-05,0.12352392077445984,3.1620543003082275,81.14050197601318,3 +3548,0.24735799431800842,0.31140977144241333,0.3265833258628845,0.1738927662372589,980.9265747070312,1e-05,0.11105693131685257,2.8390228748321533,81.14050197601318,3 +3549,0.22976747155189514,0.20661386847496033,0.225967675447464,0.24405594170093536,911.3367309570312,1e-05,0.12147832661867142,3.092301845550537,81.14050197601318,3 +3550,0.37529513239860535,0.39095816016197205,0.3873695135116577,0.23636363446712494,933.9302368164062,1e-05,0.21907545626163483,3.101828098297119,81.14050197601318,3 +3551,0.3479090631008148,0.2506067752838135,0.2677454948425293,0.2130536139011383,826.2322387695312,1e-05,0.13062646985054016,3.3620989322662354,81.14050197601318,3 +3552,0.3803923428058624,0.33579638600349426,0.36170050501823425,0.1990675926208496,988.32177734375,1e-05,0.127300426363945,2.858677625656128,81.14050197601318,3 +3553,0.28159254789352417,0.21453407406806946,0.2235773801803589,0.19440560042858124,851.1375732421875,1e-05,0.13970008492469788,3.3507754802703857,81.14050197601318,3 +3554,0.2571909725666046,0.44849148392677307,0.4563928544521332,0.2265734225511551,996.4030151367188,1e-05,0.11972113698720932,3.0170998573303223,81.14050197601318,3 +3555,0.32040780782699585,0.32650867104530334,0.3393447995185852,0.26037296652793884,981.0787963867188,1e-05,0.3165284991264343,2.82820463180542,81.14050197601318,3 +3556,0.18920782208442688,0.355471134185791,0.3523957133293152,0.2102564126253128,922.947998046875,1e-05,0.10317889600992203,3.2818667888641357,81.14050197601318,3 +3557,0.3140047490596771,0.140793576836586,0.1592659056186676,0.13496503233909607,909.7130737304688,1e-05,0.13818949460983276,3.0530786514282227,81.14050197601318,3 +3558,0.14630943536758423,0.4473198354244232,0.4432425796985626,0.23333333432674408,994.9097900390625,1e-05,0.13922178745269775,2.821418285369873,81.14050197601318,3 +3559,0.42828869819641113,0.24538198113441467,0.26954352855682373,0.1946386992931366,588.0953979492188,1e-05,0.20691132545471191,3.3694615364074707,81.14050197601318,3 +3560,0.3057292401790619,0.26202648878097534,0.26846587657928467,0.14335663616657257,864.9906616210938,1e-05,0.16646791994571686,3.085292100906372,81.14050197601318,3 +3561,0.30009812116622925,0.26100122928619385,0.26486316323280334,0.20792540907859802,877.5501708984375,1e-05,0.14588026702404022,2.829798460006714,81.14050197601318,3 +3562,0.24905075132846832,0.3138986825942993,0.3325161039829254,0.21445220708847046,978.134033203125,1e-05,0.13648375868797302,3.3544092178344727,81.14050197601318,3 +3563,0.19018961489200592,0.28758102655410767,0.29657021164894104,0.24289044737815857,956.3478393554688,1e-05,0.14179727435112,3.1271259784698486,81.14050197601318,3 +3564,0.23732151091098785,0.18843798339366913,0.2126559019088745,0.1934731900691986,719.1432495117188,1e-05,0.3945431113243103,2.833467721939087,81.14050197601318,3 +3565,0.13013747334480286,0.36347588896751404,0.363995224237442,0.22004662454128265,983.6209716796875,1e-05,0.16480284929275513,3.377453565597534,81.14050197601318,3 +3566,0.2525120675563812,0.2610470652580261,0.26086676120758057,0.14755244553089142,933.4083862304688,1e-05,0.15148510038852692,3.1469671726226807,81.14050197601318,3 +3567,0.4657815992832184,0.3060242533683777,0.3194614350795746,0.23240093886852264,455.6820373535156,1e-05,0.24217231571674347,3.114959478378296,81.14050197601318,3 +3568,0.21213243901729584,0.24401246011257172,0.2519926428794861,0.25081583857536316,830.4837646484375,1e-05,0.11645706743001938,3.1037020683288574,81.14050197601318,3 +3569,0.25797581672668457,0.21341432631015778,0.232667475938797,0.15034964680671692,938.5079956054688,1e-05,0.10878873616456985,2.8412539958953857,81.14050197601318,3 +3570,0.2138780653476715,0.28273189067840576,0.2907111942768097,0.2461538463830948,775.2649536132812,1e-05,0.11858699470758438,3.092961072921753,81.14050197601318,3 +3571,0.1812383234500885,0.21386203169822693,0.22501534223556519,0.22610722482204437,916.0694580078125,1e-05,0.157490074634552,3.2787892818450928,81.14050197601318,3 +3572,0.1806809902191162,0.2395925223827362,0.2693837285041809,0.20955711603164673,972.5713500976562,1e-05,0.1016807034611702,3.0762417316436768,81.14050197601318,3 +3573,0.2003404051065445,0.27134424448013306,0.27117881178855896,0.2666666805744171,928.31103515625,1e-05,0.10238438099622726,3.129786252975464,81.14050197601318,3 +3574,0.2846478521823883,0.30912208557128906,0.32267820835113525,0.14102564752101898,998.7031860351562,1e-05,0.10474678128957748,3.3305718898773193,81.14050197601318,3 +3575,0.32129040360450745,0.20970794558525085,0.21763621270656586,0.2242424190044403,740.3775634765625,1e-05,0.10892286151647568,2.8431646823883057,81.14050197601318,3 +3576,0.20959986746311188,0.23813357949256897,0.25922322273254395,0.23356643319129944,978.9199829101562,1e-05,0.15706872940063477,3.1304142475128174,81.14050197601318,3 +3577,0.31365031003952026,0.21393486857414246,0.22587785124778748,0.10000000149011612,853.715087890625,1e-05,0.13232645392417908,3.355334520339966,81.14050197601318,3 +3578,0.21004346013069153,0.26472896337509155,0.27096766233444214,0.1846153885126114,920.3087768554688,1e-05,0.2246893048286438,3.0999369621276855,81.14050197601318,3 +3579,0.3089085817337036,0.26223224401474,0.25867724418640137,0.1958041936159134,828.0687866210938,1e-05,0.1245235726237297,3.122811794281006,81.14050197601318,3 +3580,0.3392922878265381,0.35869795083999634,0.36112797260284424,0.23729602992534637,700.4320068359375,1e-05,0.12923263013362885,3.3497776985168457,81.14050197601318,3 +3581,0.16218167543411255,0.2874697148799896,0.30467018485069275,0.15897436439990997,992.477783203125,1e-05,0.09919458627700806,2.847208261489868,81.14050197601318,3 +3582,0.44849345088005066,0.1320890188217163,0.14000433683395386,0.06223776191473007,634.2159423828125,1e-05,0.17665745317935944,3.1617698669433594,81.14050197601318,3 +3583,0.21538633108139038,0.2884867191314697,0.2931239902973175,0.21351981163024902,767.5730590820312,1e-05,0.1171831339597702,3.149688243865967,81.14050197601318,3 +3584,0.24815016984939575,0.2901856005191803,0.28327521681785583,0.16153846681118011,627.6343994140625,1e-05,0.11980254203081131,3.117466449737549,81.14050197601318,3 +3585,0.23196572065353394,0.2965347468852997,0.29542210698127747,0.2337995320558548,679.9532470703125,1e-05,0.1205521747469902,3.051492929458618,81.14050197601318,3 +3586,0.19208143651485443,0.25625044107437134,0.2602342963218689,0.13939394056797028,705.2662353515625,1e-05,0.1017976626753807,3.125063419342041,81.14050197601318,3 +3587,0.28080323338508606,0.18730030953884125,0.20275984704494476,0.22913752496242523,904.0114135742188,1e-05,0.15816132724285126,2.834704637527466,81.14050197601318,3 +3588,0.26138946413993835,0.36381784081459045,0.36782965064048767,0.18974359333515167,356.2078552246094,1e-05,0.09862012416124344,3.4012563228607178,81.14050197601318,3 +3589,0.2024625539779663,0.229369655251503,0.2526065707206726,0.23869463801383972,922.657958984375,1e-05,0.17318981885910034,3.1406965255737305,81.14050197601318,3 +3590,0.21545331180095673,0.24512848258018494,0.24993762373924255,0.20606060326099396,948.4158325195312,1e-05,0.155743807554245,2.8450465202331543,81.14050197601318,3 +3591,0.18100745975971222,0.18766352534294128,0.20608197152614594,0.26317015290260315,883.8079833984375,1e-05,0.23030780255794525,3.0937957763671875,81.14050197601318,3 +3592,0.22983746230602264,0.3082145154476166,0.3062659204006195,0.22004662454128265,949.9702758789062,1e-05,0.15721654891967773,3.094144582748413,81.14050197601318,3 +3593,0.39623361825942993,0.5212738513946533,0.5282092690467834,0.21445220708847046,287.737548828125,1e-05,0.12369969487190247,2.8492674827575684,81.14050197601318,3 +3594,0.28619760274887085,0.530352771282196,0.578765332698822,0.2282051295042038,127.0761489868164,1e-05,0.13003967702388763,3.1194403171539307,81.14050197601318,3 +3595,0.2770210802555084,0.30647099018096924,0.3094176650047302,0.1930069923400879,757.7117919921875,1e-05,0.1518157571554184,3.2902908325195312,81.14050197601318,3 +3596,0.2139173448085785,0.3603481650352478,0.3711030185222626,0.2041957974433899,967.322509765625,1e-05,0.12331774085760117,2.8399908542633057,81.14050197601318,3 +3597,0.30595600605010986,0.23290801048278809,0.251193106174469,0.2589743435382843,974.9092407226562,1e-05,0.12943734228610992,3.1183881759643555,81.14050197601318,3 +3598,0.2733311951160431,0.2696477770805359,0.27345314621925354,0.22727273404598236,727.9061279296875,1e-05,0.6867708563804626,2.834709405899048,81.14050197601318,3 +3599,0.1449071168899536,0.27499791979789734,0.2832637429237366,0.20233100652694702,972.0613403320312,1e-05,0.13134895265102386,2.8271021842956543,81.14050197601318,3 +3600,0.38174062967300415,0.47867080569267273,0.4831327199935913,0.2354312390089035,268.69403076171875,1e-05,0.13124650716781616,3.1060783863067627,81.14050197601318,3 +3601,0.28525564074516296,0.1941356062889099,0.210152730345726,0.2433566451072693,657.4439697265625,1e-05,0.10066355019807816,3.3542492389678955,81.14050197601318,3 +3602,0.33885350823402405,0.15874142944812775,0.1692223995923996,0.1291375309228897,612.1727294921875,1e-05,0.13043422996997833,2.8305063247680664,81.14050197601318,3 +3603,0.26321691274642944,0.2997501492500305,0.30433890223503113,0.2226107269525528,937.0054321289062,1e-05,0.12156753242015839,3.282925605773926,81.14050197601318,3 +3604,0.3831326365470886,0.4431065022945404,0.45477405190467834,0.13962703943252563,310.39483642578125,1e-05,0.10014434903860092,2.834331512451172,81.14050197601318,3 +3605,0.3012691140174866,0.3229914903640747,0.3186030387878418,0.25641024112701416,908.7275390625,1e-05,0.1423623263835907,2.837900400161743,81.14050197601318,3 +3606,0.2162543535232544,0.24393264949321747,0.2462594360113144,0.2209790199995041,868.2445068359375,1e-05,0.16185589134693146,3.328447103500366,81.14050197601318,3 +3607,0.43785279989242554,0.39357003569602966,0.3987833857536316,0.1682983636856079,972.9094848632812,1e-05,0.12139496952295303,3.1165149211883545,81.14050197601318,3 +3608,0.37447047233581543,0.2551651895046234,0.25120601058006287,0.0643356665968895,724.6637573242188,1e-05,0.23481538891792297,2.8393585681915283,81.14050197601318,3 +3609,0.30029410123825073,0.5529205203056335,0.563785970211029,0.12680652737617493,140.08938598632812,1e-05,0.1477566659450531,3.353785753250122,81.14050197601318,3 +3610,0.24813786149024963,0.20770737528800964,0.21243859827518463,0.2114219069480896,822.4921875,1e-05,0.2826918363571167,2.8475544452667236,81.14050197601318,3 +3611,0.23124660551548004,0.23796328902244568,0.2637476325035095,0.16480186581611633,976.2150268554688,1e-05,0.13339880108833313,3.056595802307129,81.14050197601318,3 +3612,0.18241581320762634,0.25227150321006775,0.2760131061077118,0.20279720425605774,954.4815673828125,1e-05,0.1606196165084839,3.124831199645996,81.14050197601318,3 +3613,0.15357857942581177,0.2394677996635437,0.25803905725479126,0.20885780453681946,728.9754028320312,1e-05,0.09576321393251419,3.143282651901245,81.14050197601318,3 +3614,0.07994383573532104,0.1937980204820633,0.21923474967479706,0.21724942326545715,915.4500122070312,1e-05,0.13310077786445618,3.302569627761841,81.14050197601318,3 +3615,0.23248755931854248,0.2646064758300781,0.26441025733947754,0.18694639205932617,781.0278930664062,1e-05,0.11889679729938507,3.3769571781158447,81.14050197601318,3 +3616,0.19747278094291687,0.3149470090866089,0.3208678662776947,0.238228440284729,675.8961181640625,1e-05,0.12826891243457794,2.8357040882110596,81.14050197601318,3 +3617,0.1638955920934677,0.1946646124124527,0.216487854719162,0.22331002354621887,843.6619262695312,1e-05,0.10997623205184937,3.0898630619049072,81.14050197601318,3 +3618,0.3311620354652405,0.2425738126039505,0.2583152949810028,0.19044288992881775,947.0624389648438,1e-05,0.11504264920949936,3.0695815086364746,81.14050197601318,3 +3619,0.3263857662677765,0.19126100838184357,0.19497475028038025,0.07202797383069992,771.8865966796875,1e-05,0.11288987845182419,3.0553812980651855,81.14050197601318,3 +3620,0.2694185674190521,0.31318289041519165,0.3254895508289337,0.1890442818403244,721.369140625,1e-05,0.1483524739742279,3.1593668460845947,81.14050197601318,3 +3621,0.3612811863422394,0.27895060181617737,0.27999868988990784,0.260606050491333,811.3840942382812,1e-05,0.1228255107998848,3.130742073059082,81.14050197601318,3 +3622,0.3515346050262451,0.36962592601776123,0.3766134977340698,0.19044288992881775,478.7982177734375,1e-05,0.1250257045030594,2.83894681930542,81.14050197601318,3 +3623,0.38822484016418457,0.25252339243888855,0.2625488340854645,0.23473192751407623,642.2061767578125,1e-05,0.422844260931015,3.464066505432129,81.14050197601318,3 +3624,0.38086479902267456,0.33770236372947693,0.33975040912628174,0.1806526780128479,970.3380126953125,1e-05,0.26640039682388306,3.071922779083252,81.14050197601318,3 +3625,0.35756808519363403,0.24637804925441742,0.2584494650363922,0.20046620070934296,759.5440063476562,1e-05,0.16578049957752228,3.099203109741211,81.14050197601318,3 +3626,0.4836518168449402,0.6295125484466553,0.6235535144805908,0.2405594438314438,152.77052307128906,1e-05,0.1486165076494217,3.205181360244751,81.14050197601318,3 +3627,0.2704566419124603,0.28338101506233215,0.28698810935020447,0.2298368364572525,996.64892578125,1e-05,0.28195086121559143,3.123735189437866,81.14050197601318,3 +3628,0.31792300939559937,0.32847878336906433,0.33203789591789246,0.2337995320558548,944.529052734375,1e-05,0.11107208579778671,2.8390817642211914,81.14050197601318,3 +3629,0.2349717617034912,0.21441076695919037,0.22899724543094635,0.21282051503658295,864.5192260742188,1e-05,0.13968777656555176,3.384214162826538,81.14050197601318,3 +3630,0.2531117796897888,0.3818451166152954,0.38661181926727295,0.19230769574642181,969.4624633789062,1e-05,0.10847345739603043,3.400886297225952,81.14050197601318,3 +3631,0.43206465244293213,0.3447217345237732,0.3478364944458008,0.1794871836900711,787.3915405273438,1e-05,0.5696292519569397,2.8296544551849365,81.14050197601318,3 +3632,0.20283496379852295,0.25968125462532043,0.27159613370895386,0.15058274567127228,958.576904296875,1e-05,0.12509971857070923,3.1350529193878174,81.14050197601318,3 +3633,0.24613019824028015,0.2672450542449951,0.26720836758613586,0.17412588000297546,443.50128173828125,1e-05,0.3502030670642853,3.0559027194976807,81.14050197601318,3 +3634,0.29855507612228394,0.2868812382221222,0.28426602482795715,0.21888111531734467,890.15478515625,1e-05,0.13691774010658264,2.83805513381958,81.14050197601318,3 +3635,0.19580131769180298,0.2578829526901245,0.26275768876075745,0.2543123662471771,885.0230102539062,1e-05,0.1342211663722992,3.361055374145508,81.14050197601318,3 +3636,0.36459341645240784,0.21185451745986938,0.22722302377223969,0.11888112127780914,974.9092407226562,1e-05,0.20662035048007965,3.4111905097961426,81.14050197601318,3 +3637,0.091605544090271,0.26117706298828125,0.27450433373451233,0.23729602992534637,972.231689453125,1e-05,0.10316935181617737,2.8394341468811035,81.14050197601318,3 +3638,0.39591532945632935,0.4141542613506317,0.40116071701049805,0.2461538463830948,936.2454833984375,1e-05,0.23123997449874878,3.4344544410705566,81.14050197601318,3 +3639,0.1606995314359665,0.2475592941045761,0.2581597566604614,0.22610722482204437,816.7084350585938,1e-05,0.1600111871957779,3.1064841747283936,81.14050197601318,3 +3640,0.24030162394046783,0.22896932065486908,0.2411116063594818,0.20606060326099396,947.2893676757812,1e-05,0.1324390321969986,3.182770252227783,81.14050197601318,3 +3641,0.2551122307777405,0.32469165325164795,0.3308350145816803,0.2645687758922577,835.7803955078125,1e-05,0.10314726829528809,3.1256115436553955,81.14050197601318,3 +3642,0.2058519721031189,0.23675772547721863,0.24647748470306396,0.2114219069480896,962.4896240234375,1e-05,0.19158059358596802,3.070596933364868,81.14050197601318,3 +3643,0.40910810232162476,0.3622543215751648,0.385478138923645,0.25477856397628784,954.8995971679688,1e-05,0.10947336256504059,2.825968027114868,81.14050197601318,3 +3644,0.1615563929080963,0.2982211709022522,0.3200795650482178,0.23030303418636322,956.75732421875,1e-05,0.13793276250362396,3.0740435123443604,81.14050197601318,3 +3645,0.14147457480430603,0.2051178365945816,0.20664606988430023,0.10279720276594162,629.2960815429688,1e-05,0.17031943798065186,2.832536220550537,81.14050197601318,3 +3646,0.2867777943611145,0.2737334072589874,0.2860296368598938,0.19370628893375397,704.0678100585938,1e-05,0.15178880095481873,2.837575674057007,81.14050197601318,3 +3647,0.26874443888664246,0.2625616192817688,0.2621995210647583,0.18694639205932617,773.583740234375,1e-05,0.14112086594104767,3.3513712882995605,81.14050197601318,3 +3648,0.3689444661140442,0.3346414268016815,0.32715553045272827,0.2426573485136032,917.9066772460938,1e-05,0.12643149495124817,3.0573863983154297,81.14050197601318,3 +3649,0.1904546618461609,0.26437056064605713,0.28300100564956665,0.26363635063171387,925.8049926757812,1e-05,0.10051855444908142,3.029334545135498,81.14050197601318,3 +3650,0.21918003261089325,0.2704235315322876,0.28232792019844055,0.2242424190044403,934.1901245117188,1e-05,0.12647566199302673,3.245530843734741,81.14050197601318,3 +3651,0.37820252776145935,0.234291672706604,0.24361558258533478,0.15734265744686127,864.5192260742188,1e-05,0.16635115444660187,2.8389017581939697,81.14050197601318,3 +3652,0.26233014464378357,0.17462509870529175,0.17708720266819,0.16689977049827576,816.7084350585938,1e-05,0.11076178401708603,3.0461645126342773,81.14050197601318,3 +3653,0.1286977231502533,0.3152427077293396,0.3181522786617279,0.2652680575847626,997.1378173828125,1e-05,0.19657203555107117,3.3719565868377686,81.14050197601318,3 +3654,0.24249662458896637,0.30847692489624023,0.3271178901195526,0.16363635659217834,975.4014282226562,1e-05,0.11813719570636749,3.0303544998168945,81.14050197601318,3 +3655,0.16461259126663208,0.31801527738571167,0.34534502029418945,0.2097902148962021,961.9138793945312,1e-05,0.10565117746591568,3.031327486038208,81.14050197601318,3 +3656,0.19984695315361023,0.2819683253765106,0.29164978861808777,0.23869463801383972,492.46246337890625,1e-05,0.11940557509660721,3.0392870903015137,81.14050197601318,3 +3657,0.4614611566066742,0.3350173234939575,0.34271517395973206,0.17808857560157776,914.5143432617188,1e-05,0.13468565046787262,2.8449697494506836,81.14050197601318,3 +3658,0.2285211831331253,0.31090986728668213,0.3096238672733307,0.1627039611339569,966.04833984375,1e-05,0.14261400699615479,3.3116724491119385,81.14050197601318,3 +3659,0.20683281123638153,0.2863351106643677,0.28849461674690247,0.23752914369106293,972.5713500976562,1e-05,0.1866283267736435,3.068636178970337,81.14050197601318,3 +3660,0.3288172483444214,0.2943679988384247,0.29227903485298157,0.1930069923400879,917.2977905273438,1e-05,0.3349643051624298,3.0373032093048096,81.14050197601318,3 +3661,0.285500705242157,0.44121310114860535,0.43619436025619507,0.18391607701778412,941.445068359375,1e-05,0.12528857588768005,3.069368600845337,81.14050197601318,3 +3662,0.28669473528862,0.2783207893371582,0.2931044101715088,0.1958041936159134,836.3575439453125,1e-05,0.19814924895763397,3.013903856277466,81.14050197601318,3 +3663,0.4307524561882019,0.31835493445396423,0.32159578800201416,0.18974359333515167,708.8218383789062,1e-05,0.12325245141983032,2.8467934131622314,81.14050197601318,3 +3664,0.28544163703918457,0.3381653130054474,0.346397340297699,0.22634032368659973,348.26116943359375,1e-05,0.15023572742938995,3.266181230545044,81.14050197601318,3 +3665,0.28842854499816895,0.3578183948993683,0.36880946159362793,0.16643357276916504,371.6285705566406,1e-05,0.10626164823770523,3.096959114074707,81.14050197601318,3 +3666,0.1774323582649231,0.2348191738128662,0.2555061876773834,0.2242424190044403,846.9136352539062,1e-05,0.11920247972011566,3.051185369491577,81.14050197601318,3 +3667,0.35776689648628235,0.3017096221446991,0.3105434477329254,0.145454540848732,847.9813842773438,1e-05,0.12457620352506638,3.120990514755249,81.14050197601318,3 +3668,0.2931828200817108,0.2184114158153534,0.24391645193099976,0.17016316950321198,943.5906372070312,1e-05,0.13594764471054077,3.030831813812256,81.14050197601318,3 +3669,0.4402812123298645,0.24422521889209747,0.25251439213752747,0.16923077404499054,690.4288330078125,1e-05,0.1558055579662323,2.8272593021392822,81.14050197601318,3 +3670,0.34051087498664856,0.28725379705429077,0.29444336891174316,0.2069930136203766,574.1869506835938,1e-05,0.10747244209051132,3.167067050933838,81.14050197601318,3 +3671,0.18327191472053528,0.2856912910938263,0.2995983958244324,0.20116549730300903,986.6468505859375,1e-05,0.21836034953594208,3.056591272354126,81.14050197601318,3 +3672,0.2712983787059784,0.26096922159194946,0.2844925820827484,0.24708624184131622,988.18359375,1e-05,0.18325810134410858,3.095771074295044,81.14050197601318,3 +3673,0.21512891352176666,0.218895822763443,0.22269529104232788,0.08741258829832077,887.0220336914062,1e-05,0.11646691709756851,3.3334507942199707,81.14050197601318,3 +3674,0.1919189840555191,0.23743924498558044,0.25312966108322144,0.13962703943252563,902.6273193359375,1e-05,0.12093080580234528,3.0546083450317383,81.14050197601318,3 +3675,0.26124006509780884,0.3215717077255249,0.3178694248199463,0.2365967333316803,902.6273193359375,1e-05,0.169515460729599,2.8347067832946777,81.14050197601318,3 +3676,0.17913144826889038,0.18848484754562378,0.21297280490398407,0.24708624184131622,935.9909057617188,1e-05,0.13884221017360687,3.179504632949829,81.14050197601318,3 +3677,0.42038434743881226,0.26695477962493896,0.2637138366699219,0.0771561786532402,774.4262084960938,1e-05,0.11850173026323318,3.101238250732422,81.14050197601318,3 +3678,0.40437448024749756,0.2694675624370575,0.28623613715171814,0.2018647938966751,953.0025024414062,1e-05,0.16400304436683655,3.3266284465789795,81.14050197601318,3 +3679,0.47156667709350586,0.3303799629211426,0.34079858660697937,0.2230769246816635,671.7659301757812,1e-05,0.10497048497200012,3.3337020874023438,81.14050197601318,3 +3680,0.19518563151359558,0.3294502794742584,0.33620843291282654,0.0979020968079567,976.8599853515625,1e-05,0.18499478697776794,2.8403992652893066,81.14050197601318,3 +3681,0.23100546002388,0.21498744189739227,0.24220576882362366,0.2282051295042038,866.3948974609375,1e-05,0.14155521988868713,2.842933177947998,81.14050197601318,3 +3682,0.2689778804779053,0.26642969250679016,0.27002447843551636,0.1818181872367859,946.8348388671875,1e-05,0.16441188752651215,3.4863505363464355,81.14050197601318,3 +3683,0.2682029604911804,0.3125430941581726,0.3098506033420563,0.17832167446613312,961.14013671875,1e-05,0.11508794873952866,3.367161512374878,81.14050197601318,3 +3684,0.3639105558395386,0.4004811644554138,0.4041995108127594,0.18298368155956268,930.488525390625,1e-05,0.14914937317371368,3.099041223526001,81.14050197601318,3 +3685,0.21275433897972107,0.3576483726501465,0.36755257844924927,0.18648017942905426,999.0592651367188,1e-05,0.23522138595581055,3.26198410987854,81.14050197601318,3 +3686,0.22478832304477692,0.3070942163467407,0.3148960471153259,0.28671327233314514,978.7633666992188,1e-05,0.11429703235626221,2.827362298965454,81.14050197601318,3 +3687,0.2505222260951996,0.21836327016353607,0.24080590903759003,0.15780885517597198,781.0278930664062,1e-05,0.12418056279420853,2.8389320373535156,81.14050197601318,3 +3688,0.28638699650764465,0.26394596695899963,0.26947078108787537,0.12121211737394333,840.3358154296875,1e-05,0.13142725825309753,3.3743274211883545,81.14050197601318,3 +3689,0.5250553488731384,0.24016578495502472,0.24866870045661926,0.19230769574642181,795.77587890625,1e-05,0.23556356132030487,3.0872764587402344,81.14050197601318,3 +3690,0.2873987853527069,0.24504315853118896,0.2562583088874817,0.15734265744686127,730.0392456054688,1e-05,0.16962404549121857,3.09856915473938,81.14050197601318,3 +3691,0.2334338128566742,0.33939749002456665,0.340434193611145,0.15081584453582764,606.806884765625,1e-05,0.24516162276268005,3.328580379486084,81.14050197601318,3 +3692,0.2896305322647095,0.1883404552936554,0.2085038423538208,0.20233100652694702,718.021240234375,1e-05,0.11119627952575684,2.847733497619629,81.14050197601318,3 +3693,0.2992367744445801,0.3064952790737152,0.31619125604629517,0.2321678251028061,712.31884765625,1e-05,0.18367432057857513,2.8494367599487305,81.14050197601318,3 +3694,0.17602217197418213,0.21192462742328644,0.2266933023929596,0.2526806592941284,921.48974609375,1e-05,0.1279495805501938,3.4305713176727295,81.14050197601318,3 +3695,0.3117435872554779,0.2737402617931366,0.26661181449890137,0.1895104944705963,928.5856323242188,1e-05,0.26456791162490845,3.0725228786468506,81.14050197601318,3 +3696,0.215985506772995,0.4349621832370758,0.44073551893234253,0.26806527376174927,982.8820190429688,1e-05,0.18980371952056885,3.116050958633423,81.14050197601318,3 +3697,0.42308640480041504,0.191589817404747,0.20679889619350433,0.1526806503534317,819.9478759765625,1e-05,0.11303292214870453,3.4614996910095215,81.14050197601318,3 +3698,0.32689905166625977,0.174092635512352,0.1816805750131607,0.19254079461097717,787.3915405273438,1e-05,0.10868287831544876,2.8361663818359375,81.14050197601318,3 +3699,0.4175785183906555,0.3903525471687317,0.396319180727005,0.15034964680671692,991.1632080078125,1e-05,0.16336461901664734,2.8307573795318604,81.14050197601318,3 +3700,0.23215146362781525,0.21509823203086853,0.22679178416728973,0.07016316801309586,671.7659301757812,1e-05,0.14915919303894043,3.3511714935302734,81.14050197601318,3 +3701,0.472717821598053,0.27879253029823303,0.2770044803619385,0.23286713659763336,912.2996826171875,1e-05,0.13064339756965637,3.0796291828155518,81.14050197601318,3 +3702,0.26135802268981934,0.2739378809928894,0.27409330010414124,0.26643356680870056,785.0322875976562,1e-05,0.1269136369228363,3.478116989135742,81.14050197601318,3 +3703,0.3660481572151184,0.31861984729766846,0.32916146516799927,0.15617716312408447,866.3948974609375,1e-05,0.13093388080596924,3.083214521408081,81.14050197601318,3 +3704,0.28566208481788635,0.6450964212417603,0.6395254135131836,0.22004662454128265,120.44096374511719,1e-05,0.18342630565166473,2.8558807373046875,81.14050197601318,3 +3705,0.1409713178873062,0.3555314540863037,0.35360875725746155,0.26993006467819214,962.2981567382812,1e-05,0.1012512668967247,3.3705453872680664,81.14050197601318,3 +3706,0.3333010971546173,0.40730753540992737,0.40708494186401367,0.17529137432575226,977.1804809570312,1e-05,0.11517763882875443,3.1000852584838867,81.14050197601318,3 +3707,0.3168242573738098,0.3306110203266144,0.33264467120170593,0.21048951148986816,557.397705078125,1e-05,0.13968227803707123,3.120917558670044,81.14050197601318,3 +3708,0.15695461630821228,0.22168610990047455,0.21861532330513,0.16083915531635284,649.9450073242188,1e-05,0.1127614974975586,3.509399890899658,81.14050197601318,3 +3709,0.3172276020050049,0.6204290390014648,0.6293274164199829,0.21235431730747223,158.9905548095703,1e-05,0.11278007179498672,2.8322839736938477,81.14050197601318,3 +3710,0.34099042415618896,0.255386620759964,0.2674107551574707,0.16736596822738647,960.9456176757812,1e-05,0.24721890687942505,2.8363239765167236,81.14050197601318,3 +3711,0.19661933183670044,0.19665858149528503,0.20416761934757233,0.22331002354621887,872.758544921875,1e-05,0.13775072991847992,3.0921313762664795,81.14050197601318,3 +3712,0.2807723581790924,0.17980040609836578,0.18402083218097687,0.16969697177410126,908.7275390625,1e-05,0.10960587859153748,3.269193410873413,81.14050197601318,3 +3713,0.2588219940662384,0.2502279281616211,0.26769590377807617,0.12004662305116653,990.76416015625,1e-05,0.1344899833202362,2.8283257484436035,81.14050197601318,3 +3714,0.3345218896865845,0.25336313247680664,0.25580286979675293,0.1874125897884369,946.1489868164062,1e-05,0.1227167472243309,3.238665819168091,81.14050197601318,3 +3715,0.24721264839172363,0.533337414264679,0.5529417991638184,0.07645687460899353,140.08938598632812,1e-05,0.08511141687631607,2.8419933319091797,81.14050197601318,3 +3716,0.39921513199806213,0.4235922694206238,0.3953152894973755,0.23006993532180786,964.0061645507812,1e-05,0.11726588755846024,2.8468148708343506,81.14050197601318,3 +3717,0.3747679889202118,0.24102897942066193,0.25550779700279236,0.1902097910642624,980.7741088867188,1e-05,0.16855810582637787,3.3842599391937256,81.14050197601318,3 +3718,0.317903608083725,0.41390106081962585,0.40723633766174316,0.18414919078350067,977.4996337890625,1e-05,0.10099700093269348,3.389498710632324,81.14050197601318,3 +3719,0.2255047857761383,0.2939656972885132,0.3067484498023987,0.2557109594345093,959.3736572265625,1e-05,0.11092979460954666,2.8355026245117188,81.14050197601318,3 +3720,0.13843567669391632,0.21422182023525238,0.23570877313613892,0.19673658907413483,721.369140625,1e-05,0.11297251284122467,3.303858518600464,81.14050197601318,3 +3721,0.28982850909233093,0.36489319801330566,0.3620993494987488,0.2601398527622223,959.966552734375,1e-05,0.3253747224807739,2.8382792472839355,81.14050197601318,3 +3722,0.32203200459480286,0.32369092106819153,0.3137170672416687,0.2130536139011383,963.0614624023438,1e-05,0.15377677977085114,2.850207805633545,81.14050197601318,3 +3723,0.32003268599510193,0.38213270902633667,0.3977455198764801,0.17972028255462646,248.77369689941406,1e-05,0.12668870389461517,3.4192965030670166,81.14050197601318,3 +3724,0.3939545452594757,0.4837172329425812,0.4900539219379425,0.20815850794315338,991.8234252929688,1e-05,0.09043952822685242,3.2814505100250244,81.14050197601318,3 +3725,0.2582555413246155,0.20137053728103638,0.22666014730930328,0.22004662454128265,923.2371215820312,1e-05,0.10594165325164795,3.032317876815796,81.14050197601318,3 +3726,0.11020860821008682,0.27133628726005554,0.28048598766326904,0.23356643319129944,917.6026611328125,1e-05,0.10886649787425995,3.0887296199798584,81.14050197601318,3 +3727,0.1926550269126892,0.3117958605289459,0.3224380612373352,0.1974359005689621,980.4682006835938,1e-05,0.15011535584926605,2.8386566638946533,81.14050197601318,3 +3728,0.23519554734230042,0.2782105505466461,0.2684488296508789,0.20675989985466003,934.449462890625,1e-05,0.24162143468856812,3.043726921081543,81.14050197601318,3 +3729,0.3286151587963104,0.4525998532772064,0.45720839500427246,0.20209790766239166,367.8310546875,1e-05,0.14088928699493408,3.1106746196746826,81.14050197601318,3 +3730,0.25798454880714417,0.2243729680776596,0.23893502354621887,0.19254079461097717,877.5501708984375,1e-05,0.12757231295108795,3.340670108795166,81.14050197601318,3 +3731,0.4195278286933899,0.2511962652206421,0.2589789032936096,0.1599067598581314,619.15966796875,1e-05,0.10893574357032776,3.042551040649414,81.14050197601318,3 +3732,0.2905438542366028,0.2803160548210144,0.2888912558555603,0.24032634496688843,695.4873657226562,1e-05,0.20875073969364166,3.1520400047302246,81.14050197601318,3 +3733,0.2576032876968384,0.32831376791000366,0.3205493092536926,0.23240093886852264,871.8681030273438,1e-05,0.2337404191493988,2.845097541809082,81.14050197601318,3 +3734,0.21032807230949402,0.27266764640808105,0.27093395590782166,0.21958041191101074,827.4590454101562,1e-05,0.19849054515361786,3.058124542236328,81.14050197601318,3 +3735,0.4057106077671051,0.2780647873878479,0.2843345105648041,0.1554778516292572,619.15966796875,1e-05,0.3558742105960846,3.111419439315796,81.14050197601318,3 +3736,0.09372559934854507,0.32860201597213745,0.3364638388156891,0.23752914369106293,953.639404296875,1e-05,0.10878366231918335,3.143245220184326,81.14050197601318,3 +3737,0.40206781029701233,0.28650036454200745,0.28569141030311584,0.21911421418190002,829.2810668945312,1e-05,0.12064766883850098,3.0767722129821777,81.14050197601318,3 +3738,0.23459240794181824,0.2820822596549988,0.28700387477874756,0.22610722482204437,730.0392456054688,1e-05,0.19526974856853485,3.1321866512298584,81.14050197601318,3 +3739,0.3670506477355957,0.280426025390625,0.29413411021232605,0.1694638729095459,948.1915893554688,1e-05,0.14529451727867126,2.8354697227478027,81.14050197601318,3 +3740,0.2733169198036194,0.26184937357902527,0.26958832144737244,0.20559440553188324,976.69921875,1e-05,0.19307199120521545,3.365171194076538,81.14050197601318,3 +3741,0.2927967607975006,0.17936386168003082,0.19188858568668365,0.2030303031206131,942.4046020507812,1e-05,0.36233893036842346,2.846923351287842,81.14050197601318,3 +3742,0.22677478194236755,0.2824333608150482,0.28852665424346924,0.23566433787345886,900.8737182617188,1e-05,0.20605960488319397,3.0655362606048584,81.14050197601318,3 +3743,0.28819501399993896,0.34219059348106384,0.3532358407974243,0.18974359333515167,348.26116943359375,1e-05,0.48594939708709717,3.0997557640075684,81.14050197601318,3 +3744,0.36434149742126465,0.1921994984149933,0.19966481626033783,0.1655011624097824,869.614990234375,1e-05,0.11401355266571045,3.1106832027435303,81.14050197601318,3 +3745,0.4468531906604767,0.29877156019210815,0.3003542125225067,0.18811188638210297,943.1180419921875,1e-05,0.19855986535549164,2.8416624069213867,81.14050197601318,3 +3746,0.2845807671546936,0.19300445914268494,0.20694856345653534,0.21212121844291687,658.916015625,1e-05,0.11870576441287994,3.595592498779297,81.14050197601318,3 +3747,0.5676425099372864,0.2292592078447342,0.2488640397787094,0.2433566451072693,701.6507568359375,1e-05,0.1157364621758461,3.066787004470825,81.14050197601318,3 +3748,0.35150647163391113,0.2618992328643799,0.26978275179862976,0.18927739560604095,892.4525146484375,1e-05,0.2682254910469055,3.101346015930176,81.14050197601318,3 +3749,0.2858031392097473,0.20531770586967468,0.2107180655002594,0.20372959971427917,802.3400268554688,1e-05,0.1806173473596573,3.1429195404052734,81.14050197601318,3 +3750,0.24020390212535858,0.3245220184326172,0.31483376026153564,0.18531468510627747,863.0953369140625,1e-05,0.12485802173614502,3.08890438079834,81.14050197601318,3 +3751,0.2478308230638504,0.3654577136039734,0.3676917254924774,0.25081583857536316,941.685791015625,1e-05,0.19637048244476318,2.851334810256958,81.14050197601318,3 +3752,0.3721584379673004,0.3212817907333374,0.3210759460926056,0.08881118893623352,691.7044067382812,1e-05,0.1420612633228302,3.487015724182129,81.14050197601318,3 +3753,0.16630730032920837,0.28938746452331543,0.2972854971885681,0.17179487645626068,952.789306640625,1e-05,0.1156274676322937,3.1339244842529297,81.14050197601318,3 +3754,0.4095912277698517,0.22749479115009308,0.23269326984882355,0.11328671127557755,711.1596069335938,1e-05,0.12428462505340576,2.834737539291382,81.14050197601318,3 +3755,0.27411434054374695,0.26248061656951904,0.26542627811431885,0.10326340049505234,263.79840087890625,1e-05,0.122183658182621,3.1380302906036377,81.14050197601318,3 +3756,0.35861730575561523,0.5939299464225769,0.6053402423858643,0.21841491758823395,171.19692993164062,1e-05,0.15714554488658905,3.113097906112671,81.14050197601318,3 +3757,0.27493613958358765,0.2277250736951828,0.24509075284004211,0.17249417304992676,679.9532470703125,1e-05,0.10960322618484497,2.8389928340911865,81.14050197601318,3 +3758,0.32560262084007263,0.4099951982498169,0.42239925265312195,0.1902097910642624,287.737548828125,1e-05,0.13726182281970978,3.361210346221924,81.14050197601318,3 +3759,0.33580324053764343,0.32713720202445984,0.32746759057044983,0.17529137432575226,971.5481567382812,1e-05,0.1183323785662651,3.0802273750305176,81.14050197601318,3 +3760,0.24537935853004456,0.42038607597351074,0.42246362566947937,0.26433566212654114,301.4790344238281,1e-05,0.09202399104833603,2.830482244491577,81.14050197601318,3 +3761,0.34278470277786255,0.42225316166877747,0.4239165186882019,0.23519814014434814,969.1096801757812,1e-05,0.1299889087677002,3.351886510848999,81.14050197601318,3 +3762,0.2048638015985489,0.2920423448085785,0.28383868932724,0.1666666716337204,900.5198364257812,1e-05,0.11271927505731583,3.029414653778076,81.14050197601318,3 +3763,0.3234933316707611,0.24695810675621033,0.24792568385601044,0.19393938779830933,908.3971557617188,1e-05,0.13557380437850952,2.8300602436065674,81.14050197601318,3 +3764,0.2195993959903717,0.23428702354431152,0.25038886070251465,0.23916083574295044,942.6430053710938,1e-05,0.1631258726119995,3.2909319400787354,81.14050197601318,3 +3765,0.236168771982193,0.1501053124666214,0.16693297028541565,0.15571095049381256,832.2701416015625,1e-05,0.1429358869791031,3.394712448120117,81.14050197601318,3 +3766,0.16862483322620392,0.24242748320102692,0.25557389855384827,0.2181818187236786,932.6204223632812,1e-05,0.1343090832233429,3.0225276947021484,81.14050197601318,3 +3767,0.37225696444511414,0.22261498868465424,0.22585004568099976,0.2270396202802658,788.94677734375,1e-05,0.16793091595172882,3.3202881813049316,81.14050197601318,3 +3768,0.2147030234336853,0.23841047286987305,0.2491099089384079,0.22074592113494873,882.1692504882812,1e-05,0.12095135450363159,3.077850341796875,81.14050197601318,3 +3769,0.2770404815673828,0.32708609104156494,0.317695289850235,0.15034964680671692,982.1359252929688,1e-05,0.14137618243694305,3.027871608734131,81.14050197601318,3 +3770,0.4310900568962097,0.23034833371639252,0.26311883330345154,0.2237762212753296,958.17578125,1e-05,0.11072748899459839,3.1788644790649414,81.14050197601318,3 +3771,0.21636322140693665,0.3661203682422638,0.36590731143951416,0.1662004590034485,988.4596557617188,1e-05,0.1419362723827362,3.4352426528930664,81.14050197601318,3 +3772,0.4074457585811615,0.22730867564678192,0.2364719957113266,0.2013985961675644,913.5706787109375,1e-05,0.145341157913208,3.066216468811035,81.14050197601318,3 +3773,0.22821272909641266,0.23626601696014404,0.24325773119926453,0.20815850794315338,936.2454833984375,1e-05,0.22562938928604126,3.1017119884490967,81.14050197601318,3 +3774,0.3732474446296692,0.3011850416660309,0.3035476505756378,0.23449882864952087,968.9326171875,1e-05,0.14438997209072113,2.8315892219543457,81.14050197601318,3 +3775,0.4809092581272125,0.2653590440750122,0.282800555229187,0.19976690411567688,986.787841796875,1e-05,0.12224588543176651,3.0510802268981934,81.14050197601318,3 +3776,0.3658003807067871,0.17321012914180756,0.1827230006456375,0.2181818187236786,677.2564697265625,1e-05,0.10756946355104446,3.149735450744629,81.14050197601318,3 +3777,0.556389570236206,0.37156444787979126,0.38130930066108704,0.2825174927711487,379.11187744140625,1e-05,0.11223113536834717,3.152297258377075,81.14050197601318,3 +3778,0.18424071371555328,0.26457247138023376,0.267172247171402,0.10582750290632248,922.657958984375,1e-05,0.11008332669734955,3.2621419429779053,81.14050197601318,3 +3779,0.2110394686460495,0.23856306076049805,0.23185408115386963,0.06643356382846832,881.341796875,1e-05,0.1388721466064453,3.11712908744812,81.14050197601318,3 +3780,0.18531839549541473,0.2696053385734558,0.28070876002311707,0.15920746326446533,875.3941650390625,1e-05,0.1600230187177658,2.8479912281036377,81.14050197601318,3 +3781,0.3565024137496948,0.21786713600158691,0.2331695258617401,0.10023310035467148,489.7753601074219,1e-05,0.15374566614627838,3.059791326522827,81.14050197601318,3 +3782,0.27407267689704895,0.2126845419406891,0.22094620764255524,0.1515151560306549,679.9532470703125,1e-05,0.10770018398761749,3.177635431289673,81.14050197601318,3 +3783,0.3687846064567566,0.24948914349079132,0.27025213837623596,0.20279720425605774,914.8272094726562,1e-05,0.12784425914287567,3.107470750808716,81.14050197601318,3 +3784,0.31958040595054626,0.2375393807888031,0.243575319647789,0.12703962624073029,327.6654357910156,1e-05,0.11897609382867813,3.281677484512329,81.14050197601318,3 +3785,0.16726528108119965,0.2362557351589203,0.260483056306839,0.17132866382598877,983.178466796875,1e-05,0.11502108722925186,3.051168441772461,81.14050197601318,3 +3786,0.284376859664917,0.25768497586250305,0.2670518457889557,0.26480185985565186,838.0756225585938,1e-05,0.13485600054264069,2.8303842544555664,81.14050197601318,3 +3787,0.09785867482423782,0.29346969723701477,0.2879306375980377,0.0883449912071228,941.2037353515625,1e-05,0.3615759015083313,3.096269130706787,81.14050197601318,3 +3788,0.18097808957099915,0.3240836262702942,0.3267820477485657,0.24149183928966522,956.75732421875,1e-05,0.30818042159080505,3.1407229900360107,81.14050197601318,3 +3789,0.3670434355735779,0.34091001749038696,0.3576001822948456,0.2270396202802658,965.126220703125,1e-05,0.15142954885959625,3.1294753551483154,81.14050197601318,3 +3790,0.2576945424079895,0.34553372859954834,0.34878793358802795,0.2405594438314438,495.12713623046875,1e-05,0.14597833156585693,3.398374080657959,81.14050197601318,3 +3791,0.320173054933548,0.3465398848056793,0.35268670320510864,0.23496504127979279,928.8597412109375,1e-05,0.09860927611589432,3.332648277282715,81.14050197601318,3 +3792,0.36333343386650085,0.34270358085632324,0.34598612785339355,0.22400932013988495,993.89599609375,1e-05,0.11891639977693558,2.835343599319458,81.14050197601318,3 +3793,0.2664420008659363,0.30903205275535583,0.3080941438674927,0.18205128610134125,970.1636352539062,1e-05,0.09364631026983261,3.543666124343872,81.14050197601318,3 +3794,0.31922081112861633,0.2315359115600586,0.2475670725107193,0.17692308127880096,770.1734008789062,1e-05,0.16363760828971863,3.057608127593994,81.14050197601318,3 +3795,0.28208911418914795,0.27947017550468445,0.28565454483032227,0.12167832255363464,929.6773681640625,1e-05,0.24272345006465912,3.0549674034118652,81.14050197601318,3 +3796,0.22401641309261322,0.2705244719982147,0.27646365761756897,0.15734265744686127,961.334228515625,1e-05,0.10522627085447311,3.082736015319824,81.14050197601318,3 +3797,0.13488462567329407,0.17375704646110535,0.18108683824539185,0.16643357276916504,894.3345947265625,1e-05,0.14171458780765533,3.1031837463378906,81.14050197601318,3 +3798,0.16509614884853363,0.22070623934268951,0.24546831846237183,0.2769230902194977,539.5704345703125,1e-05,0.11607443541288376,2.8529763221740723,81.14050197601318,3 +3799,0.1387673020362854,0.25852084159851074,0.2581867575645447,0.19930069148540497,854.7328491210938,1e-05,0.11097244173288345,3.3997442722320557,81.14050197601318,3 +3800,0.13314282894134521,0.3458424210548401,0.3442530333995819,0.23473192751407623,997.7442626953125,1e-05,0.14937058091163635,3.111269235610962,81.14050197601318,3 +3801,0.232561394572258,0.22530429065227509,0.23010633885860443,0.225874125957489,937.0054321289062,1e-05,0.11314933001995087,3.0377981662750244,81.14050197601318,3 +3802,0.1859866827726364,0.3070043921470642,0.30773159861564636,0.2426573485136032,929.1331176757812,1e-05,0.1165224239230156,3.100421190261841,81.14050197601318,3 +3803,0.2865431606769562,0.28137218952178955,0.29140591621398926,0.22634032368659973,735.275390625,1e-05,0.12840181589126587,3.1169726848602295,81.14050197601318,3 +3804,0.18939800560474396,0.326590895652771,0.3396509885787964,0.17972028255462646,958.17578125,1e-05,0.12695327401161194,3.301292657852173,81.14050197601318,3 +3805,0.18468262255191803,0.17541532218456268,0.19421258568763733,0.12680652737617493,842.00830078125,1e-05,0.1181720718741417,3.153076410293579,81.14050197601318,3 +3806,0.1807127147912979,0.2600291669368744,0.2643392086029053,0.16993007063865662,887.0220336914062,1e-05,0.1469998061656952,3.3893535137176514,81.14050197601318,3 +3807,0.2868186831474304,0.29374128580093384,0.28524452447891235,0.2181818187236786,845.8379516601562,1e-05,0.1302463263273239,3.0855751037597656,81.14050197601318,3 +3808,0.2813863456249237,0.2799508571624756,0.2874448299407959,0.21445220708847046,971.7196655273438,1e-05,0.15494273602962494,3.082179546356201,81.14050197601318,3 +3809,0.3819994330406189,0.3304005265235901,0.33729854226112366,0.23706293106079102,964.0061645507812,1e-05,0.3877013325691223,3.082726240158081,81.14050197601318,3 +3810,0.24911026656627655,0.2638535499572754,0.2715781629085541,0.19370628893375397,924.6715087890625,1e-05,0.15725478529930115,3.0356342792510986,81.14050197601318,3 +3811,0.34450867772102356,0.25099486112594604,0.26262831687927246,0.15757575631141663,683.93896484375,1e-05,0.2629154324531555,3.184363842010498,81.14050197601318,3 +3812,0.44003674387931824,0.27958282828330994,0.30654215812683105,0.23053613305091858,379.11187744140625,1e-05,0.13383276760578156,3.3279976844787598,81.14050197601318,3 +3813,0.4446637034416199,0.41657644510269165,0.4208795130252838,0.15501165390014648,411.0456848144531,1e-05,0.1773056834936142,3.108591318130493,81.14050197601318,3 +3814,0.18134911358356476,0.28509411215782166,0.2852199077606201,0.22331002354621887,922.657958984375,1e-05,0.12266600131988525,3.342378616333008,81.14050197601318,3 +3815,0.359150767326355,0.2191580981016159,0.23944833874702454,0.21794871985912323,866.8596801757812,1e-05,0.11894261091947556,3.0288023948669434,81.14050197601318,3 +3816,0.26524436473846436,0.3045791983604431,0.3039541244506836,0.10303030163049698,920.605224609375,1e-05,0.10133838653564453,3.087843418121338,81.14050197601318,3 +3817,0.22324097156524658,0.3041609227657318,0.29855281114578247,0.18298368155956268,780.2160034179688,1e-05,0.13582147657871246,3.1219866275787354,81.14050197601318,3 +3818,0.47317424416542053,0.24154841899871826,0.2434801608324051,0.06643356382846832,834.0355224609375,1e-05,0.14066722989082336,3.3450238704681396,81.14050197601318,3 +3819,0.24597716331481934,0.39871567487716675,0.4115324914455414,0.15524475276470184,996.1564331054688,1e-05,0.1382489651441574,3.0407795906066895,81.14050197601318,3 +3820,0.2560608386993408,0.22667653858661652,0.23642322421073914,0.12727272510528564,969.1096801757812,1e-05,0.10096766799688339,3.3310089111328125,81.14050197601318,3 +3821,0.20622751116752625,0.2909776270389557,0.2989949882030487,0.2142191082239151,620.8772583007812,1e-05,0.12535029649734497,3.034898519515991,81.14050197601318,3 +3822,0.12602245807647705,0.3327045142650604,0.3321742117404938,0.17972028255462646,972.4016723632812,1e-05,0.10162194073200226,3.060507297515869,81.14050197601318,3 +3823,0.14863541722297668,0.18836259841918945,0.21846312284469604,0.18205128610134125,991.8234252929688,1e-05,0.138456791639328,3.148543119430542,81.14050197601318,3 +3824,0.1779044270515442,0.5319591164588928,0.546958863735199,0.21165500581264496,120.44096374511719,1e-05,0.11499432474374771,3.4562010765075684,81.14050197601318,3 +3825,0.29628637433052063,0.2714639902114868,0.28301361203193665,0.23892773687839508,865.928466796875,1e-05,0.2256583273410797,3.0671277046203613,81.14050197601318,3 +3826,0.1808645874261856,0.12976689636707306,0.13839034736156464,0.0687645673751831,839.7739868164062,1e-05,0.11275448650121689,3.045354127883911,81.14050197601318,3 +3827,0.26445913314819336,0.2574341297149658,0.26053646206855774,0.12051282078027725,991.8234252929688,1e-05,0.44298020005226135,3.277886152267456,81.14050197601318,3 +3828,0.16138309240341187,0.36974412202835083,0.37228772044181824,0.1962703913450241,978.134033203125,1e-05,0.18192709982395172,3.332663059234619,81.14050197601318,3 +3829,0.1713801771402359,0.20861174166202545,0.21193772554397583,0.20955711603164673,919.414306640625,1e-05,0.11626793444156647,3.1645665168762207,81.14050197601318,3 +3830,0.3742412328720093,0.26701873540878296,0.285318523645401,0.23240093886852264,909.7130737304688,1e-05,0.11911202222108841,3.2890753746032715,81.14050197601318,3 +3831,0.24956819415092468,0.2362273931503296,0.2526777386665344,0.12261072546243668,847.4485473632812,1e-05,0.1618204265832901,2.853402614593506,81.14050197601318,3 +3832,0.2614176571369171,0.3590092957019806,0.36401090025901794,0.2030303031206131,945.4581298828125,1e-05,0.12376324087381363,3.3149447441101074,81.14050197601318,3 +3833,0.31949135661125183,0.295994371175766,0.3043929934501648,0.24801865220069885,530.23681640625,1e-05,0.11354660987854004,3.301284074783325,81.14050197601318,3 +3834,0.33801910281181335,0.1814325898885727,0.20653243362903595,0.2114219069480896,790.488037109375,1e-05,0.12321910262107849,3.299729585647583,81.14050197601318,3 +3835,0.2780139148235321,0.27345314621925354,0.2772774398326874,0.16083915531635284,515.6737670898438,1e-05,0.15494608879089355,3.1472837924957275,81.14050197601318,3 +3836,0.28535225987434387,0.23639851808547974,0.23975948989391327,0.1986013948917389,758.630126953125,1e-05,0.11816217005252838,3.3022239208221436,81.14050197601318,3 +3837,0.1371760368347168,0.19626912474632263,0.20517432689666748,0.06759906560182571,825.6151733398438,1e-05,0.1084422916173935,2.8324668407440186,81.14050197601318,3 +3838,0.18586060404777527,0.3129391372203827,0.3189964294433594,0.20629370212554932,961.334228515625,1e-05,0.10882645100355148,3.269152879714966,81.14050197601318,3 +3839,0.22814661264419556,0.2802492082118988,0.28638163208961487,0.13123543560504913,930.2188720703125,1e-05,0.13205842673778534,3.3352673053741455,81.14050197601318,3 +3840,0.34229743480682373,0.35481613874435425,0.3515072166919708,0.1806526780128479,918.8137817382812,1e-05,0.13152141869068146,3.305023431777954,81.14050197601318,3 +3841,0.3059169352054596,0.2764759361743927,0.2903183102607727,0.2158508151769638,912.93701171875,1e-05,0.10293407738208771,3.088895559310913,81.14050197601318,3 +3842,0.2520560920238495,0.3353992700576782,0.3242521584033966,0.15734265744686127,977.0203857421875,1e-05,0.10860041528940201,3.334088087081909,81.14050197601318,3 +3843,0.2996217608451843,0.40709975361824036,0.3979123830795288,0.19557109475135803,982.7333984375,1e-05,0.11168013513088226,3.135165214538574,81.14050197601318,3 +3844,0.5298795700073242,0.28601083159446716,0.2922687828540802,0.13286712765693665,356.2078552246094,1e-05,0.11705876886844635,3.0697882175445557,81.14050197601318,3 +3845,0.3679848611354828,0.30326953530311584,0.3278912603855133,0.15477855503559113,992.477783203125,1e-05,0.11925111711025238,3.0405983924865723,81.14050197601318,3 +3846,0.18014448881149292,0.384133517742157,0.37822088599205017,0.23286713659763336,962.2981567382812,1e-05,0.09639769792556763,3.1177985668182373,81.14050197601318,3 +3847,0.4340609908103943,0.3244316875934601,0.32642632722854614,0.2689976692199707,890.15478515625,1e-05,0.18158988654613495,3.1131532192230225,81.14050197601318,3 +3848,0.3701756000518799,0.6754421591758728,0.6749535202980042,0.2242424190044403,106.90462493896484,1e-05,0.11991432309150696,3.0785908699035645,81.14050197601318,3 +3849,0.1975557953119278,0.2893984317779541,0.3035973608493805,0.18974359333515167,942.1655883789062,1e-05,0.12914076447486877,3.0477774143218994,81.14050197601318,3 +3850,0.43407630920410156,0.25883641839027405,0.2671208679676056,0.2293706238269806,546.3833618164062,1e-05,0.2163248360157013,3.047621250152588,81.14050197601318,3 +3851,0.3192712664604187,0.27918580174446106,0.29550421237945557,0.2310023307800293,689.1459350585938,1e-05,0.13858181238174438,3.0352790355682373,81.14050197601318,3 +3852,0.16513876616954803,0.28675973415374756,0.2906590402126312,0.1790209710597992,870.971435546875,1e-05,0.12246327102184296,3.159071683883667,81.14050197601318,3 +3853,0.46156877279281616,0.2535344064235687,0.268805593252182,0.24079254269599915,723.5714111328125,1e-05,0.12247855216264725,3.1585428714752197,81.14050197601318,3 +3854,0.16174592077732086,0.13678576052188873,0.1405491679906845,0.05128205195069313,888.5984497070312,1e-05,0.10158279538154602,3.0378785133361816,81.14050197601318,3 +3855,0.30779656767845154,0.2332364320755005,0.24292191863059998,0.17645686864852905,928.03564453125,1e-05,0.1624978929758072,3.098457098007202,81.14050197601318,3 +3856,0.3106893002986908,0.31677117943763733,0.310128390789032,0.18531468510627747,784.2387084960938,1e-05,0.13829779624938965,3.0730245113372803,81.14050197601318,3 +3857,0.3220316469669342,0.33037862181663513,0.3348778486251831,0.22284382581710815,991.2958374023438,1e-05,0.10561519861221313,3.0889201164245605,81.14050197601318,3 +3858,0.4561336636543274,0.3009447157382965,0.29679110646247864,0.19696970283985138,930.488525390625,1e-05,0.13332153856754303,3.265404462814331,81.14050197601318,3 +3859,0.23869143426418304,0.3795076608657837,0.38314324617385864,0.23449882864952087,677.2564697265625,1e-05,0.1807958334684372,3.132512331008911,81.14050197601318,3 +3860,0.32062122225761414,0.2698274850845337,0.2864784300327301,0.22867132723331451,989.1450805664062,1e-05,0.14744696021080017,3.055575370788574,81.14050197601318,3 +3861,0.28599077463150024,0.23671434819698334,0.23870442807674408,0.17995338141918182,866.3948974609375,1e-05,0.22383065521717072,3.222599506378174,81.14050197601318,3 +3862,0.2977917790412903,0.2795841693878174,0.28337720036506653,0.2354312390089035,920.0114135742188,1e-05,0.1031021848320961,3.3028712272644043,81.14050197601318,3 +3863,0.32833170890808105,0.26380640268325806,0.271247535943985,0.1566433608531952,942.8807373046875,1e-05,0.14469262957572937,2.833566665649414,81.14050197601318,3 +3864,0.3232440948486328,0.41306963562965393,0.4169679284095764,0.10932400822639465,987.069091796875,1e-05,0.19207054376602173,3.126323938369751,81.14050197601318,3 +3865,0.20357242226600647,0.20540891587734222,0.20993094146251678,0.0839160829782486,852.6897583007812,1e-05,0.1387549191713333,3.0996510982513428,81.14050197601318,3 +3866,0.3740607500076294,0.21375572681427002,0.2414444386959076,0.18205128610134125,888.2062377929688,1e-05,0.15844976902008057,3.0838608741760254,81.14050197601318,3 +3867,0.3964087963104248,0.28250691294670105,0.290112167596817,0.2214452177286148,852.6897583007812,1e-05,0.12722112238407135,3.1177494525909424,81.14050197601318,3 +3868,0.22788554430007935,0.2768959701061249,0.29490840435028076,0.2153846174478531,986.5054321289062,1e-05,0.0946144163608551,3.268256902694702,81.14050197601318,3 +3869,0.24843913316726685,0.26064395904541016,0.2555546164512634,0.22750583291053772,918.5123291015625,1e-05,0.12111569195985794,2.8318698406219482,81.14050197601318,3 +3870,0.2764167785644531,0.22197939455509186,0.22268114984035492,0.15524475276470184,826.2322387695312,1e-05,0.13406157493591309,3.361585855484009,81.14050197601318,3 +3871,0.3368805944919586,0.32291871309280396,0.34022897481918335,0.17156177759170532,996.8938598632812,1e-05,0.15165852010250092,3.379976272583008,81.14050197601318,3 +3872,0.2343338578939438,0.2739086449146271,0.267932265996933,0.2097902148962021,865.4603271484375,1e-05,0.10012085735797882,2.841705560684204,81.14050197601318,3 +3873,0.25122764706611633,0.2246575802564621,0.2381456047296524,0.23030303418636322,891.6915283203125,1e-05,0.11420197784900665,3.125579595565796,81.14050197601318,3 +3874,0.36246389150619507,0.2112322896718979,0.23117366433143616,0.13216783106327057,761.3585205078125,1e-05,0.17923136055469513,3.1284823417663574,81.14050197601318,3 +3875,0.19443368911743164,0.2637927234172821,0.27803361415863037,0.1538461595773697,816.0525512695312,1e-05,0.4048764705657959,2.8398122787475586,81.14050197601318,3 +3876,0.33209994435310364,0.2915533185005188,0.3044714629650116,0.23030303418636322,580.2335815429688,1e-05,0.14297854900360107,3.120891571044922,81.14050197601318,3 +3877,0.2497159242630005,0.3456677198410034,0.34978532791137695,0.22004662454128265,979.8526000976562,1e-05,0.9228979349136353,3.0275866985321045,81.14050197601318,3 +3878,0.4216539263725281,0.2600027918815613,0.27104708552360535,0.18298368155956268,461.6126403808594,1e-05,0.12560652196407318,2.8397514820098877,81.14050197601318,3 +3879,0.28496280312538147,0.34307894110679626,0.34052255749702454,0.2650349736213684,964.1939697265625,1e-05,0.1270708441734314,3.103991985321045,81.14050197601318,3 +3880,0.39698612689971924,0.4465244710445404,0.4521329402923584,0.09603729844093323,424.38739013671875,1e-05,0.11804564297199249,3.1219189167022705,81.14050197601318,3 +3881,0.2364501953125,0.33262526988983154,0.33694660663604736,0.22331002354621887,934.1901245117188,1e-05,0.08918651193380356,3.119176149368286,81.14050197601318,3 +3882,0.1978425234556198,0.19699440896511078,0.21497666835784912,0.21048951148986816,925.8049926757812,1e-05,0.14353047311306,3.08017897605896,81.14050197601318,3 +3883,0.19418951869010925,0.30752602219581604,0.3240894079208374,0.2102564126253128,983.4736938476562,1e-05,0.09085215628147125,3.095691204071045,81.14050197601318,3 +3884,0.1991138756275177,0.341938853263855,0.3616718351840973,0.14965035021305084,959.3736572265625,1e-05,0.1314760446548462,3.059063196182251,81.14050197601318,3 +3885,0.22016757726669312,0.305664598941803,0.3076722025871277,0.25687646865844727,811.3840942382812,1e-05,0.13392023742198944,3.1017398834228516,81.14050197601318,3 +3886,0.25026020407676697,0.31125059723854065,0.3242919445037842,0.2599067687988281,978.7633666992188,1e-05,0.13698206841945648,3.196514368057251,81.14050197601318,3 +3887,0.33624929189682007,0.2864898145198822,0.29436779022216797,0.1818181872367859,464.5392150878906,1e-05,1.505552887916565,3.1615548133850098,81.14050197601318,3 +3888,0.30507656931877136,0.20171301066875458,0.2273007035255432,0.22750583291053772,544.1298217773438,1e-05,0.13158628344535828,3.1021015644073486,81.14050197601318,3 +3889,0.12949369847774506,0.23502887785434723,0.2532638609409332,0.20885780453681946,835.7803955078125,1e-05,0.23002630472183228,3.1064913272857666,81.14050197601318,3 +3890,0.4714398682117462,0.25896596908569336,0.25860050320625305,0.20722611248493195,986.079833984375,1e-05,0.13880541920661926,3.046935558319092,81.14050197601318,3 +3891,0.2263447791337967,0.2530481219291687,0.2624523937702179,0.1515151560306549,949.0853271484375,1e-05,0.12809813022613525,3.0917184352874756,81.14050197601318,3 +3892,0.2743668854236603,0.23553840816020966,0.23869454860687256,0.1382284313440323,817.3616943359375,1e-05,0.1466740518808365,3.246175765991211,81.14050197601318,3 +3893,0.3533075749874115,0.24607598781585693,0.24817031621932983,0.11818181723356247,724.6637573242188,1e-05,0.1354275643825531,3.1090617179870605,81.14050197601318,3 +3894,0.2860024869441986,0.555900514125824,0.5553380846977234,0.0279720276594162,222.54527282714844,1e-05,0.11204157769680023,3.278918981552124,81.14050197601318,3 +3895,0.3501673936843872,0.4293637275695801,0.44073063135147095,0.1442890465259552,997.86474609375,1e-05,0.1705464869737625,3.0322494506835938,81.14050197601318,3 +3896,0.34219375252723694,0.32468247413635254,0.33637121319770813,0.25874125957489014,544.1298217773438,1e-05,0.14419905841350555,3.071483850479126,81.14050197601318,3 +3897,0.29098406434059143,0.25432223081588745,0.260536253452301,0.22494173049926758,939.7424926757812,1e-05,0.33455368876457214,3.24611234664917,81.14050197601318,3 +3898,0.24655701220035553,0.3830161690711975,0.38981592655181885,0.18648017942905426,988.8717041015625,1e-05,0.18119758367538452,3.2444674968719482,81.14050197601318,3 +3899,0.1346224695444107,0.2287372648715973,0.23069694638252258,0.20675989985466003,917.6026611328125,1e-05,0.1421622633934021,3.1569952964782715,81.14050197601318,3 +3900,0.19631822407245636,0.20191362500190735,0.21252423524856567,0.274125874042511,771.8865966796875,1e-05,0.3419748544692993,3.0879218578338623,81.14050197601318,3 +3901,0.3409382700920105,0.2543972432613373,0.264949768781662,0.23613053560256958,912.6188354492188,1e-05,0.18755580484867096,3.0622801780700684,81.14050197601318,3 +3902,0.31615763902664185,0.3546469509601593,0.38066989183425903,0.14405594766139984,382.7987976074219,1e-05,0.14938639104366302,3.111506223678589,81.14050197601318,3 +3903,0.34899306297302246,0.26182448863983154,0.25840190052986145,0.19254079461097717,810.7058715820312,1e-05,0.10978398472070694,3.334198236465454,81.14050197601318,3 +3904,0.133713960647583,0.3388270139694214,0.3375226855278015,0.2254079282283783,963.4406127929688,1e-05,0.1356096714735031,3.58872389793396,81.14050197601318,3 +3905,0.2617884874343872,0.33752456307411194,0.331906259059906,0.20815850794315338,935.9909057617188,1e-05,0.2538207471370697,3.049643039703369,81.14050197601318,3 +3906,0.33720624446868896,0.20443248748779297,0.2188730090856552,0.23613053560256958,823.7489624023438,1e-05,0.1788412183523178,3.313446283340454,81.14050197601318,3 +3907,0.22586782276630402,0.440000981092453,0.440908819437027,0.16736596822738647,990.630615234375,1e-05,0.1315070241689682,2.8505938053131104,81.14050197601318,3 +3908,0.2769160866737366,0.2433071881532669,0.24566516280174255,0.2242424190044403,764.04736328125,1e-05,0.10506577044725418,3.3543739318847656,81.14050197601318,3 +3909,0.3341922461986542,0.27403855323791504,0.2883826792240143,0.21515151858329773,956.3478393554688,1e-05,0.18017756938934326,3.42330002784729,81.14050197601318,3 +3910,0.24858790636062622,0.30280542373657227,0.30430370569229126,0.25594404339790344,880.0903930664062,1e-05,0.12550431489944458,3.2921080589294434,81.14050197601318,3 +3911,0.217603400349617,0.21836954355239868,0.220100998878479,0.2170163094997406,919.414306640625,1e-05,0.12978363037109375,3.0699212551116943,81.14050197601318,3 +3912,0.28911489248275757,0.17452864348888397,0.2007094919681549,0.19603729248046875,823.121826171875,1e-05,0.12523595988750458,3.2870032787323,81.14050197601318,3 +3913,0.43516698479652405,0.31427377462387085,0.3295244574546814,0.2058275043964386,981.5336303710938,1e-05,0.11676047742366791,3.129150152206421,81.14050197601318,3 +3914,0.35801297426223755,0.2994605004787445,0.3093952238559723,0.2393939346075058,505.5683898925781,1e-05,0.1429678350687027,3.030242443084717,81.14050197601318,3 +3915,0.267415314912796,0.398879736661911,0.3808259963989258,0.13379953801631927,892.0726318359375,1e-05,0.14350605010986328,3.3425540924072266,81.14050197601318,3 +3916,0.2328130155801773,0.24726198613643646,0.2569524049758911,0.17575757205486298,999.177734375,1e-05,0.1029900461435318,3.1832385063171387,81.14050197601318,3 +3917,0.32057666778564453,0.31262028217315674,0.3213976323604584,0.13076922297477722,972.231689453125,1e-05,0.18235397338867188,3.0787739753723145,81.14050197601318,3 +3918,0.23119258880615234,0.5176569819450378,0.5048837065696716,0.20769231021404266,999.6487426757812,1e-05,0.23895004391670227,3.0542895793914795,81.14050197601318,3 +3919,0.3115008473396301,0.1947944313287735,0.2163800597190857,0.1990675926208496,677.2564697265625,1e-05,0.1173037588596344,3.0341312885284424,81.14050197601318,3 +3920,0.2138126790523529,0.259099543094635,0.276749849319458,0.2282051295042038,995.035400390625,1e-05,0.09911395609378815,3.0562217235565186,81.14050197601318,3 +3921,0.366508811712265,0.19959507882595062,0.21784864366054535,0.13682983815670013,823.121826171875,1e-05,0.2124546766281128,3.3190388679504395,81.14050197601318,3 +3922,0.25667694211006165,0.22976525127887726,0.2438279092311859,0.09417249262332916,942.1655883789062,1e-05,0.132634237408638,3.1806390285491943,81.14050197601318,3 +3923,0.30631178617477417,0.18871359527111053,0.2101346254348755,0.2652680575847626,728.9754028320312,1e-05,0.12558668851852417,3.2726798057556152,81.14050197601318,3 +3924,0.18743257224559784,0.4243733584880829,0.4212707579135895,0.2230769246816635,945.226806640625,1e-05,0.28902050852775574,3.0734949111938477,81.14050197601318,3 +3925,0.27952224016189575,0.2701511085033417,0.2759937345981598,0.17459207773208618,888.5984497070312,1e-05,0.10945171117782593,3.0489108562469482,81.14050197601318,3 +3926,0.11876373738050461,0.21148639917373657,0.22807730734348297,0.1247086226940155,968.0419921875,1e-05,0.18402186036109924,3.0863068103790283,81.14050197601318,3 +3927,0.4524381160736084,0.21024535596370697,0.22819191217422485,0.24638694524765015,723.5714111328125,1e-05,0.13883477449417114,3.3195910453796387,81.14050197601318,3 +3928,0.306102991104126,0.3587587773799896,0.37969258427619934,0.23846153914928436,993.2548217773438,1e-05,0.11977356672286987,3.174558401107788,81.14050197601318,3 +3929,0.4153818190097809,0.25982606410980225,0.2784990072250366,0.24312354624271393,515.6737670898438,1e-05,0.12282072752714157,3.3040030002593994,81.14050197601318,3 +3930,0.30150488018989563,0.24816423654556274,0.26607751846313477,0.2745920717716217,546.3833618164062,1e-05,0.15331003069877625,3.107783794403076,81.14050197601318,3 +3931,0.1940039098262787,0.27079033851623535,0.29992249608039856,0.20046620070934296,960.9456176757812,1e-05,0.1123678907752037,3.0479092597961426,81.14050197601318,3 +3932,0.17599225044250488,0.19882136583328247,0.2126818597316742,0.24848484992980957,857.74267578125,1e-05,0.11056617647409439,3.0210087299346924,81.14050197601318,3 +3933,0.27201545238494873,0.33470267057418823,0.3329489231109619,0.2237762212753296,965.6807250976562,1e-05,0.11592841148376465,3.0924620628356934,81.14050197601318,3 +3934,0.14967364072799683,0.29789403080940247,0.30558469891548157,0.2533799409866333,943.8261108398438,1e-05,0.09791524708271027,3.2869362831115723,81.14050197601318,3 +3935,0.296540230512619,0.24105629324913025,0.2599400579929352,0.16689977049827576,887.4180297851562,1e-05,0.13409990072250366,3.3242790699005127,81.14050197601318,3 +3936,0.28752952814102173,0.3028235137462616,0.3071678578853607,0.16899767518043518,979.6979370117188,1e-05,0.1071925237774849,3.0559897422790527,81.14050197601318,3 +3937,0.21666425466537476,0.31000158190727234,0.3169042766094208,0.2097902148962021,877.97705078125,1e-05,0.10267961770296097,3.1031906604766846,81.14050197601318,3 +3938,0.22780780494213104,0.26645562052726746,0.2885391116142273,0.17412588000297546,976.3768310546875,1e-05,0.13793843984603882,3.254725694656372,81.14050197601318,3 +3939,0.28841325640678406,0.24134479463100433,0.25268054008483887,0.27668997645378113,856.2459106445312,1e-05,0.1605018675327301,3.07308030128479,81.14050197601318,3 +3940,0.5141379833221436,0.3218340277671814,0.330730140209198,0.2310023307800293,766.697998046875,1e-05,0.1302289515733719,3.237338066101074,81.14050197601318,3 +3941,0.28698402643203735,0.3764588534832001,0.3915390968322754,0.13333334028720856,263.79840087890625,1e-05,0.12367921322584152,3.1000118255615234,81.14050197601318,3 +3942,0.29500651359558105,0.5740683674812317,0.5761263370513916,0.16037295758724213,177.18624877929688,1e-05,0.10600844770669937,3.0940475463867188,81.14050197601318,3 +3943,0.33154505491256714,0.31616950035095215,0.3039952516555786,0.2466200441122055,958.3765258789062,1e-05,0.18536587059497833,3.259629726409912,81.14050197601318,3 +3944,0.21363565325737,0.25390079617500305,0.2562604546546936,0.15011654794216156,788.1709594726562,1e-05,0.09827152639627457,3.047464609146118,81.14050197601318,3 +3945,0.20167231559753418,0.16247636079788208,0.16583067178726196,0.02097902074456215,942.8807373046875,1e-05,0.18085825443267822,4.032418727874756,81.14050197601318,3 +3946,0.2106226235628128,0.2802126407623291,0.2872888743877411,0.20606060326099396,989.5532836914062,1e-05,0.17943120002746582,3.2118008136749268,81.14050197601318,3 +3947,0.2793310880661011,0.3387937843799591,0.3331586420536041,0.128671333193779,968.57763671875,1e-05,0.14069534838199615,3.2613956928253174,81.14050197601318,3 +3948,0.2616288661956787,0.2720823884010315,0.27888229489326477,0.19813519716262817,692.97265625,1e-05,0.09993992745876312,2.8329312801361084,81.14050197601318,3 +3949,0.23303638398647308,0.35528481006622314,0.382525235414505,0.21165500581264496,997.1378173828125,1e-05,0.11364258825778961,3.2616777420043945,81.14050197601318,3 +3950,0.13697212934494019,0.2318771928548813,0.2548949718475342,0.20815850794315338,913.5706787109375,1e-05,0.1967552751302719,3.0258328914642334,81.14050197601318,3 +3951,0.35584530234336853,0.41238003969192505,0.4279554784297943,0.23962703347206116,998.5840454101562,1e-05,0.09791920334100723,3.133805513381958,81.14050197601318,3 +3952,0.30432817339897156,0.20373955368995667,0.20957793295383453,0.09533799439668655,828.0687866210938,1e-05,0.11569911986589432,3.2194783687591553,81.14050197601318,3 +3953,0.26493579149246216,0.19951164722442627,0.22650930285453796,0.19533799588680267,867.3228149414062,1e-05,0.1430545449256897,3.336782455444336,81.14050197601318,3 +3954,0.176430344581604,0.26729902625083923,0.2656647264957428,0.15221445262432098,651.463623046875,1e-05,0.13961170613765717,2.8366222381591797,81.14050197601318,3 +3955,0.27604585886001587,0.4474724233150482,0.43216025829315186,0.19440560042858124,977.8174438476562,1e-05,0.12743818759918213,3.2459986209869385,81.14050197601318,3 +3956,0.2554824650287628,0.2473340928554535,0.2621239423751831,0.2198135256767273,890.9254760742188,1e-05,0.09186732023954391,3.0203442573547363,81.14050197601318,3 +3957,0.104493647813797,0.2423204928636551,0.24485386908054352,0.24032634496688843,926.3671875,1e-05,0.11541710793972015,3.1405107975006104,81.14050197601318,3 +3958,0.36484819650650024,0.347628116607666,0.3505266308784485,0.19370628893375397,980.4682006835938,1e-05,0.12889975309371948,3.2650628089904785,81.14050197601318,3 +3959,0.31960827112197876,0.30129265785217285,0.302543967962265,0.20163169503211975,627.6343994140625,1e-05,0.17222964763641357,3.069807767868042,81.14050197601318,3 +3960,0.22218093276023865,0.2903708219528198,0.3121624290943146,0.18554778397083282,926.0864868164062,1e-05,0.11859790235757828,2.8480141162872314,81.14050197601318,3 +3961,0.4187914729118347,0.24589194357395172,0.2574346661567688,0.18041957914829254,780.2160034179688,1e-05,0.1024375706911087,3.294459104537964,81.14050197601318,3 +3962,0.2713050842285156,0.18449266254901886,0.21320024132728577,0.238228440284729,801.6233520507812,1e-05,0.11775359511375427,3.026083469390869,81.14050197601318,3 +3963,0.2854715883731842,0.45635220408439636,0.47374024987220764,0.20279720425605774,987.069091796875,1e-05,0.10901854187250137,3.063978910446167,81.14050197601318,3 +3964,0.13956798613071442,0.3362148404121399,0.34082067012786865,0.17645686864852905,979.54296875,1e-05,0.18967899680137634,3.2561209201812744,81.14050197601318,3 +3965,0.3510555624961853,0.3048931956291199,0.3093748688697815,0.21188810467720032,896.5547485351562,1e-05,0.12479520589113235,3.120842695236206,81.14050197601318,3 +3966,0.2175128161907196,0.18441683053970337,0.19770176708698273,0.12074591964483261,893.9605712890625,1e-05,0.16032640635967255,2.8291735649108887,81.14050197601318,3 +3967,0.34228193759918213,0.4091906249523163,0.42946475744247437,0.20256410539150238,991.69189453125,1e-05,0.30226296186447144,3.0531482696533203,81.14050197601318,3 +3968,0.2649343013763428,0.3667537569999695,0.3716509938240051,0.16899767518043518,987.069091796875,1e-05,0.11472528427839279,3.038813352584839,81.14050197601318,3 +3969,0.2601233422756195,0.31612518429756165,0.32276636362075806,0.17459207773208618,956.75732421875,1e-05,0.1283833086490631,3.139822483062744,81.14050197601318,3 +3970,0.3456606864929199,0.19243890047073364,0.2139948308467865,0.2652680575847626,678.60888671875,1e-05,0.18985028564929962,3.4636242389678955,81.14050197601318,3 +3971,0.21737506985664368,0.2794550359249115,0.2860410809516907,0.2214452177286148,630.94677734375,1e-05,0.24924106895923615,3.081488847732544,81.14050197601318,3 +3972,0.3873404860496521,0.43241599202156067,0.4277907907962799,0.22191141545772552,458.6604309082031,1e-05,0.13065823912620544,2.8472156524658203,81.14050197601318,3 +3973,0.13887618482112885,0.32548603415489197,0.3263252377510071,0.20372959971427917,970.8588256835938,1e-05,0.19018180668354034,3.093477249145508,81.14050197601318,3 +3974,0.3004056215286255,0.22490479052066803,0.23513509333133698,0.22960372269153595,898.011962890625,1e-05,0.20480653643608093,3.203620195388794,81.14050197601318,3 +3975,0.19221460819244385,0.23182159662246704,0.23665276169776917,0.14731934666633606,848.5123291015625,1e-05,0.13190296292304993,2.8413922786712646,81.14050197601318,3 +3976,0.2878616154193878,0.3384198546409607,0.3354780375957489,0.27319347858428955,981.230712890625,1e-05,0.13060331344604492,3.384352684020996,81.14050197601318,3 +3977,0.18696476519107819,0.2843432128429413,0.27985072135925293,0.10839160531759262,924.38623046875,1e-05,0.09277185797691345,2.829495906829834,81.14050197601318,3 +3978,0.35207599401474,0.5747409462928772,0.5808502435684204,0.24172493815422058,171.19692993164062,1e-05,0.12888222932815552,3.1311817169189453,81.14050197601318,3 +3979,0.4055863618850708,0.33549708127975464,0.3329384922981262,0.19976690411567688,814.732421875,1e-05,0.12423115223646164,2.837101936340332,81.14050197601318,3 +3980,0.2424929291009903,0.3599770665168762,0.36474609375,0.26433566212654114,939.9876098632812,1e-05,0.12497644871473312,3.050987958908081,81.14050197601318,3 +3981,0.252557635307312,0.3938138782978058,0.4040570557117462,0.2678321599960327,968.7553100585938,1e-05,0.09725470840930939,2.826401710510254,81.14050197601318,3 +3982,0.2609313726425171,0.2588367760181427,0.2714468240737915,0.21328671276569366,887.0220336914062,1e-05,0.1266753226518631,3.4413979053497314,81.14050197601318,3 +3983,0.27401116490364075,0.19206266105175018,0.20175695419311523,0.2242424190044403,919.7131958007812,1e-05,0.14452488720417023,2.8420045375823975,81.14050197601318,3 +3984,0.20822128653526306,0.3142099678516388,0.32460200786590576,0.23636363446712494,643.773681640625,1e-05,0.12413455545902252,3.1820032596588135,81.14050197601318,3 +3985,0.24284876883029938,0.4604616165161133,0.46805888414382935,0.23869463801383972,287.737548828125,1e-05,0.1811266839504242,2.841327428817749,81.14050197601318,3 +3986,0.23565728962421417,0.291779488325119,0.2912089228630066,0.2769230902194977,906.7301635742188,1e-05,0.1248968169093132,3.1119611263275146,81.14050197601318,3 +3987,0.3390447199344635,0.9286991953849792,0.9246976971626282,0.21212121844291687,992.996826171875,1e-05,0.14651551842689514,3.1840317249298096,81.14050197601318,3 +3988,0.31497424840927124,0.2028578668832779,0.2128966599702835,0.22750583291053772,825.6151733398438,1e-05,0.30442553758621216,3.361355781555176,81.14050197601318,3 +3989,0.3032182455062866,0.23271135985851288,0.23919571936130524,0.2454545497894287,950.8469848632812,1e-05,0.10576885938644409,2.8452484607696533,81.14050197601318,3 +3990,0.18628093600273132,0.341062992811203,0.33924248814582825,0.23240093886852264,965.4962768554688,1e-05,0.10384490340948105,3.109755516052246,81.14050197601318,3 +3991,0.4298897981643677,0.30314040184020996,0.3171614110469818,0.1638694703578949,957.3680419921875,1e-05,0.19386491179466248,2.8410537242889404,81.14050197601318,3 +3992,0.25574925541877747,0.2996270954608917,0.3005165755748749,0.10419580340385437,982.7333984375,1e-05,0.13210824131965637,3.133608102798462,81.14050197601318,3 +3993,0.23810975253582,0.3041309714317322,0.3201737403869629,0.2310023307800293,548.6198120117188,1e-05,0.12209343910217285,3.2158493995666504,81.14050197601318,3 +3994,0.3780979812145233,0.3429352045059204,0.3414607644081116,0.21095570921897888,909.3855590820312,1e-05,0.10938625782728195,3.1121270656585693,81.14050197601318,3 +3995,0.33160600066185,0.2828783690929413,0.2853587567806244,0.21794871985912323,919.7131958007812,1e-05,0.23577409982681274,2.8365318775177,81.14050197601318,3 +3996,0.2182479053735733,0.2650758624076843,0.26675379276275635,0.22960372269153595,814.068359375,1e-05,0.1302184760570526,3.056476354598999,81.14050197601318,3 +3997,0.29090702533721924,0.23955267667770386,0.244821235537529,0.15734265744686127,983.6209716796875,1e-05,0.20860356092453003,2.836536407470703,81.14050197601318,3 +3998,0.1414956897497177,0.23581363260746002,0.24216820299625397,0.13333334028720856,937.0054321289062,1e-05,0.12396997958421707,3.342916965484619,81.14050197601318,3 +3999,0.252514511346817,0.44415855407714844,0.4577556848526001,0.13216783106327057,983.0303955078125,1e-05,0.09934987872838974,3.399019479751587,81.14050197601318,3 +4000,0.12715736031532288,0.2424081265926361,0.2605368494987488,0.1738927662372589,999.53125,1e-05,0.09994088113307953,3.1404552459716797,81.14050197601318,3 +4001,0.3485546112060547,0.15167656540870667,0.16733872890472412,0.13729603588581085,880.5089721679688,1e-05,0.20518812537193298,2.8447704315185547,81.14050197601318,3 +4002,0.19503284990787506,0.2869980037212372,0.28843745589256287,0.21794871985912323,939.4969482421875,1e-05,0.10472021251916885,3.101569414138794,81.14050197601318,3 +4003,0.2585088014602661,0.3260537087917328,0.3349156379699707,0.11328671127557755,939.9876098632812,1e-05,0.11237133294343948,2.8205978870391846,81.14050197601318,3 +4004,0.2969217598438263,0.24363486468791962,0.26332953572273254,0.20000000298023224,393.64630126953125,1e-05,0.11415497213602066,3.333993911743164,81.14050197601318,3 +4005,0.3180882930755615,0.30155155062675476,0.3017386198043823,0.22610722482204437,934.449462890625,1e-05,0.12704437971115112,3.4696238040924072,81.14050197601318,3 +4006,0.2210458666086197,0.3437412977218628,0.34197720885276794,0.13403263688087463,697.9737548828125,1e-05,0.10126564651727676,2.8305912017822266,81.14050197601318,3 +4007,0.5100867748260498,0.2707580029964447,0.26685842871665955,0.2018647938966751,634.2159423828125,1e-05,0.1335102915763855,2.837383270263672,81.14050197601318,3 +4008,0.42712950706481934,0.28644710779190063,0.30020958185195923,0.17808857560157776,586.15087890625,1e-05,0.16318339109420776,3.12951397895813,81.14050197601318,3 +4009,0.1677050143480301,0.31433728337287903,0.334150105714798,0.16736596822738647,977.9759521484375,1e-05,0.09724249690771103,3.0437917709350586,81.14050197601318,3 +4010,0.17458567023277283,0.32579582929611206,0.34240448474884033,0.1878787875175476,955.10791015625,1e-05,0.16614939272403717,3.442087411880493,81.14050197601318,3 +4011,0.3263469934463501,0.16745543479919434,0.17913484573364258,0.12820512056350708,819.3053588867188,1e-05,0.23328223824501038,3.343858242034912,81.14050197601318,3 +4012,0.24767452478408813,0.1826341152191162,0.19498059153556824,0.1790209710597992,689.1459350585938,1e-05,0.1222618967294693,2.8325679302215576,81.14050197601318,3 +4013,0.38611793518066406,0.26487740874290466,0.2729801833629608,0.19766899943351746,640.6287231445312,1e-05,0.11028949916362762,3.24127197265625,81.14050197601318,3 +4014,0.22865936160087585,0.32060983777046204,0.32753434777259827,0.2214452177286148,888.5984497070312,1e-05,0.09443201124668121,3.0254619121551514,81.14050197601318,3 +4015,0.45931416749954224,0.37422528862953186,0.3786865770816803,0.11701631546020508,375.388671875,1e-05,0.1267528533935547,3.078279733657837,81.14050197601318,3 +4016,0.2163565456867218,0.35374942421913147,0.35463741421699524,0.20233100652694702,964.3812255859375,1e-05,0.12969104945659637,3.0973360538482666,81.14050197601318,3 +4017,0.373389333486557,0.28762170672416687,0.28976842761039734,0.23449882864952087,941.685791015625,1e-05,0.14474458992481232,3.4311137199401855,81.14050197601318,3 +4018,0.3498210310935974,1.7048453092575073,1.7592146396636963,0.2668997645378113,995.6604614257812,1e-05,0.11064605414867401,2.84657621383667,81.14050197601318,3 +4019,0.16466715931892395,0.287930965423584,0.28956323862075806,0.19696970283985138,950.1903076171875,1e-05,0.11968967318534851,3.132037401199341,81.14050197601318,3 +4020,0.27404820919036865,0.34671956300735474,0.35109513998031616,0.21165500581264496,893.5853271484375,1e-05,0.13655386865139008,3.054215431213379,81.14050197601318,3 +4021,0.2453521192073822,0.20232079923152924,0.21429632604122162,0.23636363446712494,872.758544921875,1e-05,0.15803180634975433,3.300436496734619,81.14050197601318,3 +4022,0.15297238528728485,0.20067185163497925,0.23013195395469666,0.2745920717716217,961.7210693359375,1e-05,0.1365184336900711,3.085801601409912,81.14050197601318,3 +4023,0.42345497012138367,0.22701586782932281,0.23569779098033905,0.1946386992931366,603.1679077148438,1e-05,0.13075563311576843,3.4473767280578613,81.14050197601318,3 +4024,0.3845370411872864,0.24828974902629852,0.2608340382575989,0.0839160829782486,500.3907775878906,1e-05,0.1297311782836914,2.8447909355163574,81.14050197601318,3 +4025,0.30574965476989746,0.19082346558570862,0.1944175511598587,0.15687645971775055,883.4002075195312,1e-05,0.24911701679229736,3.1511476039886475,81.14050197601318,3 +4026,0.3301047086715698,0.44417324662208557,0.4490807354450226,0.18857808411121368,994.9097900390625,1e-05,0.12923775613307953,2.8340539932250977,81.14050197601318,3 +4027,0.17436043918132782,0.3833237588405609,0.36648911237716675,0.23752914369106293,961.14013671875,1e-05,0.11223641782999039,3.305335283279419,81.14050197601318,3 +4028,0.2271168828010559,0.17800378799438477,0.20692618191242218,0.1734265685081482,632.5867309570312,1e-05,0.1312999576330185,3.1257596015930176,81.14050197601318,3 +4029,0.28920814394950867,0.31083744764328003,0.3098096251487732,0.13799533247947693,718.021240234375,1e-05,0.09427535533905029,3.1780049800872803,81.14050197601318,3 +4030,0.1847001314163208,0.3260926902294159,0.33528411388397217,0.18694639205932617,979.8526000976562,1e-05,0.09672084450721741,2.8271875381469727,81.14050197601318,3 +4031,0.4558825194835663,0.39847156405448914,0.4147493839263916,0.17692308127880096,356.2078552246094,1e-05,0.11865285038948059,3.1182851791381836,81.14050197601318,3 +4032,0.2694944441318512,0.3328062891960144,0.3301236629486084,0.2153846174478531,957.5706176757812,1e-05,0.11618877202272415,3.124943494796753,81.14050197601318,3 +4033,0.23164667189121246,0.35700076818466187,0.356048583984375,0.17435897886753082,941.445068359375,1e-05,0.0996818020939827,3.0831429958343506,81.14050197601318,3 +4034,0.2032640278339386,0.1867353916168213,0.1867353916168213,0.0,742.382080078125,1e-05,0.1364130973815918,3.0522689819335938,81.14050197601318,3 +4035,0.4509890079498291,0.3100356459617615,0.31284499168395996,0.20233100652694702,658.916015625,1e-05,0.1693960428237915,3.180722951889038,81.14050197601318,3 +4036,0.20050698518753052,0.3242143988609314,0.33787378668785095,0.16689977049827576,974.4140625,1e-05,0.09791895002126694,2.8352394104003906,81.14050197601318,3 +4037,0.2425464242696762,0.4057619869709015,0.40718594193458557,0.257342666387558,953.639404296875,1e-05,0.16038088500499725,3.267155408859253,81.14050197601318,3 +4038,0.30521419644355774,0.24696418642997742,0.25229108333587646,0.17482517659664154,930.2188720703125,1e-05,0.15197470784187317,3.1172258853912354,81.14050197601318,3 +4039,0.38835006952285767,0.16598397493362427,0.17048943042755127,0.16433566808700562,424.38739013671875,1e-05,0.1682237833738327,3.330444812774658,81.14050197601318,3 +4040,0.32771116495132446,0.3305882513523102,0.3265853226184845,0.2242424190044403,844.2090454101562,1e-05,0.11137591302394867,3.0918221473693848,81.14050197601318,3 +4041,0.21695634722709656,0.20906218886375427,0.22186455130577087,0.2242424190044403,976.69921875,1e-05,0.13632403314113617,3.170016288757324,81.14050197601318,3 +4042,0.22827757894992828,0.3103558123111725,0.32260799407958984,0.20512820780277252,978.6064453125,1e-05,0.10230830311775208,3.15566086769104,81.14050197601318,3 +4043,0.4467998743057251,0.5125223398208618,0.5231752395629883,0.15058274567127228,258.84716796875,1e-05,0.13350814580917358,3.021963119506836,81.14050197601318,3 +4044,0.3062703311443329,0.24731728434562683,0.2687794864177704,0.2666666805744171,424.38739013671875,1e-05,0.14341644942760468,3.0769941806793213,81.14050197601318,3 +4045,0.40462052822113037,0.5576285123825073,0.5677940249443054,0.2242424190044403,211.61354064941406,1e-05,0.11116794496774673,3.3049042224884033,81.14050197601318,3 +4046,0.3438253700733185,0.20292818546295166,0.20487888157367706,0.10419580340385437,767.5730590820312,1e-05,0.11085302382707596,3.311264991760254,81.14050197601318,3 +4047,0.3865848779678345,0.31179550290107727,0.3201836049556732,0.19114218652248383,608.6077880859375,1e-05,0.14123490452766418,3.1815671920776367,81.14050197601318,3 +4048,0.20143547654151917,0.23361697793006897,0.23869429528713226,0.1538461595773697,978.6064453125,1e-05,0.3751818835735321,3.0703442096710205,81.14050197601318,3 +4049,0.37183937430381775,0.1837429702281952,0.19821380078792572,0.2242424190044403,821.2252807617188,1e-05,0.13535504043102264,3.031562566757202,81.14050197601318,3 +4050,0.13532371819019318,0.23130092024803162,0.25116807222366333,0.19720280170440674,866.8596801757812,1e-05,0.20832088589668274,3.0485963821411133,81.14050197601318,3 +4051,0.16481855511665344,0.29349732398986816,0.28373080492019653,0.20629370212554932,965.4962768554688,1e-05,0.12995021045207977,3.0634660720825195,81.14050197601318,3 +4052,0.27365463972091675,0.1956026405096054,0.2106035202741623,0.14731934666633606,961.5278930664062,1e-05,0.13985846936702728,3.283141613006592,81.14050197601318,3 +4053,0.2614898383617401,0.4252167344093323,0.41948628425598145,0.16433566808700562,976.69921875,1e-05,0.10702473670244217,3.150775909423828,81.14050197601318,3 +4054,0.2671918272972107,0.1823296844959259,0.19607244431972504,0.09067598730325699,969.4624633789062,1e-05,0.11146744340658188,3.104306697845459,81.14050197601318,3 +4055,0.29988136887550354,0.49111559987068176,0.5263108015060425,0.19487179815769196,999.7660522460938,1e-05,0.08440664410591125,2.8376617431640625,81.14050197601318,3 +4056,0.24988175928592682,0.1798125058412552,0.2009303867816925,0.13100233674049377,970.1636352539062,1e-05,0.10328229516744614,3.1007602214813232,81.14050197601318,3 +4057,0.3175690174102783,0.28432729840278625,0.2976188659667969,0.2594405710697174,973.9156494140625,1e-05,0.1359769105911255,3.095287561416626,81.14050197601318,3 +4058,0.31657326221466064,0.23574110865592957,0.2573167085647583,0.21561771631240845,955.523193359375,1e-05,0.11603798717260361,3.3425002098083496,81.14050197601318,3 +4059,0.14747276902198792,0.3093116283416748,0.31307363510131836,0.22773893177509308,835.2010498046875,1e-05,0.11900971084833145,3.1733057498931885,81.14050197601318,3 +4060,0.17144599556922913,0.2621839940547943,0.26993224024772644,0.1710955649614334,597.6142578125,1e-05,0.09735801815986633,3.1846423149108887,81.14050197601318,3 +4061,0.2700045704841614,0.2640213668346405,0.25602951645851135,0.13449883460998535,993.1259155273438,1e-05,0.12786288559436798,2.8508107662200928,81.14050197601318,3 +4062,0.3570646345615387,0.24375030398368835,0.2500164806842804,0.17529137432575226,578.2326049804688,1e-05,0.12830209732055664,3.083660364151001,81.14050197601318,3 +4063,0.18831615149974823,0.24210001528263092,0.2470579594373703,0.19603729248046875,947.7415161132812,1e-05,0.10748076438903809,3.413097858428955,81.14050197601318,3 +4064,0.37949299812316895,0.3397783041000366,0.35287490487098694,0.24312354624271393,375.388671875,1e-05,0.24328173696994781,3.0784366130828857,81.14050197601318,3 +4065,0.40377646684646606,0.2845512330532074,0.2920267581939697,0.22797203063964844,847.4485473632812,1e-05,0.10090494155883789,3.2224209308624268,81.14050197601318,3 +4066,0.504328191280365,0.16684883832931519,0.1760088950395584,0.0951048955321312,639.041015625,1e-05,0.12305731326341629,3.37581205368042,81.14050197601318,3 +4067,0.32636693120002747,0.23986884951591492,0.2541353702545166,0.21655011177062988,971.03173828125,1e-05,0.16073010861873627,2.8339014053344727,81.14050197601318,3 +4068,0.3534310758113861,0.1365799903869629,0.15440809726715088,0.220279723405838,708.8218383789062,1e-05,0.13163979351520538,3.2350668907165527,81.14050197601318,3 +4069,0.2648637294769287,0.31768059730529785,0.3179190456867218,0.24195803701877594,810.0248413085938,1e-05,0.12487980723381042,3.122718334197998,81.14050197601318,3 +4070,0.3168238401412964,0.246076762676239,0.2527455687522888,0.2510489523410797,964.5680541992188,1e-05,0.15001562237739563,3.4907970428466797,81.14050197601318,3 +4071,0.2561035752296448,0.2743200659751892,0.2943677008152008,0.1974359005689621,958.17578125,1e-05,0.1034499779343605,2.8482930660247803,81.14050197601318,3 +4072,0.2084822654724121,0.2720557451248169,0.2733764350414276,0.22074592113494873,889.3790893554688,1e-05,0.15466536581516266,3.393355131149292,81.14050197601318,3 +4073,0.2051992267370224,0.17560990154743195,0.19030648469924927,0.2298368364572525,767.5730590820312,1e-05,0.1417614072561264,2.843348503112793,81.14050197601318,3 +4074,0.13956215977668762,0.20405025780200958,0.21263612806797028,0.1790209710597992,870.5208129882812,1e-05,0.14257249236106873,3.4471523761749268,81.14050197601318,3 +4075,0.1738402545452118,0.25613853335380554,0.27473270893096924,0.2433566451072693,931.2932739257812,1e-05,0.20433440804481506,3.1284289360046387,81.14050197601318,3 +4076,0.26940199732780457,0.3545871078968048,0.3398030698299408,0.17832167446613312,987.2093505859375,1e-05,0.12115620821714401,3.1572086811065674,81.14050197601318,3 +4077,0.3305930197238922,0.30508890748023987,0.31882593035697937,0.2405594438314438,687.85546875,1e-05,0.11727660894393921,3.0381569862365723,81.14050197601318,3 +4078,0.35207709670066833,0.39710816740989685,0.3927592933177948,0.2174825221300125,443.50128173828125,1e-05,0.23165613412857056,3.0430469512939453,81.14050197601318,3 +4079,0.28166335821151733,0.23163355886936188,0.24433667957782745,0.26596736907958984,839.2100219726562,1e-05,0.10419032722711563,3.019587278366089,81.14050197601318,3 +4080,0.3712565302848816,0.37233787775039673,0.3794472813606262,0.18857808411121368,980.6212768554688,1e-05,0.18644097447395325,3.1666576862335205,81.14050197601318,3 +4081,0.2702813148498535,0.2544628381729126,0.26698073744773865,0.1895104944705963,805.1764526367188,1e-05,0.10894165933132172,3.066685438156128,81.14050197601318,3 +4082,0.29262369871139526,0.20518197119235992,0.22218331694602966,0.2745920717716217,630.94677734375,1e-05,0.12016072869300842,3.146071434020996,81.14050197601318,3 +4083,0.2908218801021576,0.5758391618728638,0.607196033000946,0.18018648028373718,127.0761489868164,1e-05,0.10184658318758011,3.088826894760132,81.14050197601318,3 +4084,0.2834937870502472,0.19173352420330048,0.20823772251605988,0.25920745730400085,868.7028198242188,1e-05,0.14865264296531677,3.077662467956543,81.14050197601318,3 +4085,0.3853749930858612,0.36964258551597595,0.36704525351524353,0.1895104944705963,979.3876342773438,1e-05,0.13209931552410126,3.09281849861145,81.14050197601318,3 +4086,0.2886559069156647,0.4356582462787628,0.4271754026412964,0.12820512056350708,989.8240966796875,1e-05,0.14115676283836365,3.3298888206481934,81.14050197601318,3 +4087,0.19985364377498627,0.1926496922969818,0.20768031477928162,0.11794871836900711,923.525634765625,1e-05,0.1266617625951767,3.09423565864563,81.14050197601318,3 +4088,0.35068151354789734,0.2976529002189636,0.31182634830474854,0.11328671127557755,400.70562744140625,1e-05,0.13971726596355438,3.110506057739258,81.14050197601318,3 +4089,0.2884111702442169,0.3072742819786072,0.3049151301383972,0.23193472623825073,622.5833740234375,1e-05,0.11447866261005402,3.0979413986206055,81.14050197601318,3 +4090,0.4102031886577606,0.29802852869033813,0.3135043978691101,0.17272727191448212,692.97265625,1e-05,0.1410398781299591,3.095024585723877,81.14050197601318,3 +4091,0.20076924562454224,0.3636226952075958,0.37661170959472656,0.15617716312408447,980.0068969726562,1e-05,0.12010747194290161,3.0606274604797363,81.14050197601318,3 +4092,0.2574644684791565,0.2913062870502472,0.30361974239349365,0.21631701290607452,923.8132934570312,1e-05,0.1149955689907074,3.298682451248169,81.14050197601318,3 +4093,0.2941930592060089,0.19220612943172455,0.22095739841461182,0.225874125957489,940.4759521484375,1e-05,0.2133185714483261,3.3530447483062744,81.14050197601318,3 +4094,0.07274402678012848,0.3043102025985718,0.3197703957557678,0.27389276027679443,962.2981567382812,1e-05,0.07733464986085892,3.1236729621887207,81.14050197601318,3 +4095,0.32023316621780396,0.36475011706352234,0.37957945466041565,0.1895104944705963,978.2918701171875,1e-05,0.1099001094698906,3.056706428527832,81.14050197601318,3 +4096,0.39540883898735046,0.3843174874782562,0.38501250743865967,0.23799534142017365,964.5680541992188,1e-05,0.17218907177448273,3.03842830657959,81.14050197601318,3 +4097,0.40167078375816345,0.5118343830108643,0.4925057291984558,0.23916083574295044,991.954833984375,1e-05,0.13476331532001495,3.103933572769165,81.14050197601318,3 +4098,0.446795254945755,0.21416530013084412,0.21982185542583466,0.139860138297081,861.1730346679688,1e-05,0.12146949768066406,3.376040458679199,81.14050197601318,3 +4099,0.34581929445266724,0.2508734464645386,0.2626272141933441,0.2142191082239151,980.1610107421875,1e-05,0.14679670333862305,3.0905511379241943,81.14050197601318,3 +4100,0.3336963355541229,0.2022363394498825,0.21472938358783722,0.220279723405838,782.640625,1e-05,0.12117032706737518,3.092207908630371,81.14050197601318,3 +4101,0.170820951461792,0.30359140038490295,0.3014829754829407,0.21212121844291687,904.6971435546875,1e-05,0.11460049450397491,3.057584285736084,81.14050197601318,3 +4102,0.431403249502182,0.3699112832546234,0.3576897382736206,0.23123542964458466,991.954833984375,1e-05,0.128508061170578,3.080444097518921,81.14050197601318,3 +4103,0.41710859537124634,0.28354310989379883,0.29387813806533813,0.2689976692199707,986.221923828125,1e-05,0.1342286914587021,3.2724711894989014,81.14050197601318,3 +4104,0.4231144189834595,0.30547019839286804,0.3069237470626831,0.23076923191547394,893.9605712890625,1e-05,0.09548976272344589,3.1128695011138916,81.14050197601318,3 +4105,0.4334027171134949,0.2395319789648056,0.2589820921421051,0.10303030163049698,393.64630126953125,1e-05,0.21857398748397827,3.142110586166382,81.14050197601318,3 +4106,0.20646043121814728,0.4150218069553375,0.4168302118778229,0.19417248666286469,993.7682495117188,1e-05,0.10194381326436996,3.1159770488739014,81.14050197601318,3 +4107,0.29228323698043823,0.17592602968215942,0.1874113380908966,0.2242424190044403,742.382080078125,1e-05,0.09641492366790771,3.0389978885650635,81.14050197601318,3 +4108,0.2778194546699524,0.2939152717590332,0.29641979932785034,0.2142191082239151,928.31103515625,1e-05,0.15349341928958893,2.8359246253967285,81.14050197601318,3 +4109,0.28042954206466675,0.24261614680290222,0.25329190492630005,0.23286713659763336,892.831298828125,1e-05,0.12812849879264832,3.3326828479766846,81.14050197601318,3 +4110,0.30911681056022644,0.2530757784843445,0.25651219487190247,0.19393938779830933,797.257080078125,1e-05,0.13002605736255646,3.0469627380371094,81.14050197601318,3 +4111,0.18782025575637817,0.3060021698474884,0.3130933940410614,0.2449883371591568,700.4320068359375,1e-05,0.1152476817369461,3.3694987297058105,81.14050197601318,3 +4112,0.360358327627182,0.2793315649032593,0.28366538882255554,0.1878787875175476,707.6432495117188,1e-05,0.11133817583322525,2.8271994590759277,81.14050197601318,3 +4113,0.19051076471805573,0.22728480398654938,0.240404412150383,0.20000000298023224,823.7489624023438,1e-05,0.1455114632844925,3.3053677082061768,81.14050197601318,3 +4114,0.305316299200058,0.24748705327510834,0.27155423164367676,0.19160838425159454,973.2462768554688,1e-05,0.11398598551750183,3.0848162174224854,81.14050197601318,3 +4115,0.22122739255428314,0.20298510789871216,0.2087516188621521,0.18974359333515167,922.0755004882812,1e-05,0.11032024770975113,3.0550637245178223,81.14050197601318,3 +4116,0.2594960927963257,0.2576046884059906,0.27511847019195557,0.22470861673355103,790.488037109375,1e-05,0.15115727484226227,3.055288314819336,81.14050197601318,3 +4117,0.36616694927215576,0.25119733810424805,0.2524522542953491,0.1766899824142456,871.4204711914062,1e-05,0.17416730523109436,3.440143346786499,81.14050197601318,3 +4118,0.3096948266029358,0.23574604094028473,0.24742726981639862,0.2722610831260681,759.5440063476562,1e-05,0.20948028564453125,2.824211359024048,81.14050197601318,3 +4119,0.21869872510433197,0.216401144862175,0.2344355285167694,0.2599067687988281,762.2591552734375,1e-05,0.13301602005958557,3.3461508750915527,81.14050197601318,3 +4120,0.3281046152114868,0.22793282568454742,0.23591360449790955,0.07389277219772339,864.9906616210938,1e-05,0.1221596896648407,3.389021635055542,81.14050197601318,3 +4121,0.11731307208538055,0.3378477990627289,0.36774536967277527,0.17039626836776733,982.5844116210938,1e-05,0.15519961714744568,3.1295571327209473,81.14050197601318,3 +4122,0.24745513498783112,0.28370535373687744,0.27813416719436646,0.21888111531734467,720.25927734375,1e-05,0.23667553067207336,3.4501442909240723,81.14050197601318,3 +4123,0.4414899945259094,0.3414387106895447,0.3442614674568176,0.20093239843845367,458.6604309082031,1e-05,0.12688763439655304,3.2261416912078857,81.14050197601318,3 +4124,0.2866215407848358,0.16408716142177582,0.1728077381849289,0.20629370212554932,790.488037109375,1e-05,0.11056045442819595,2.8441619873046875,81.14050197601318,3 +4125,0.21957972645759583,0.3359195291996002,0.35262125730514526,0.20233100652694702,998.4646606445312,1e-05,0.11153978854417801,3.156167984008789,81.14050197601318,3 +4126,0.2229805439710617,0.16028285026550293,0.1723010540008545,0.2242424190044403,890.5407104492188,1e-05,0.14208941161632538,3.1285839080810547,81.14050197601318,3 +4127,0.12154226750135422,0.17957547307014465,0.19727075099945068,0.10699300467967987,995.035400390625,1e-05,0.08944597095251083,3.045606851577759,81.14050197601318,3 +4128,0.47067445516586304,0.32304733991622925,0.3126782178878784,0.2433566451072693,962.6806640625,1e-05,0.16025389730930328,3.324779510498047,81.14050197601318,3 +4129,0.3968806266784668,0.35549506545066833,0.3573448657989502,0.26806527376174927,872.3140258789062,1e-05,0.1650204062461853,3.158360481262207,81.14050197601318,3 +4130,0.35631778836250305,0.3967154026031494,0.4528638422489166,0.1934731900691986,158.9905548095703,1e-05,0.21252094209194183,2.8400444984436035,81.14050197601318,3 +4131,0.2275772988796234,0.3461584746837616,0.35070499777793884,0.16876456141471863,991.4281005859375,1e-05,0.11797121167182922,3.2844104766845703,81.14050197601318,3 +4132,0.5045978426933289,0.3013523519039154,0.30444249510765076,0.14219114184379578,527.8575439453125,1e-05,0.1299825757741928,3.094277858734131,81.14050197601318,3 +4133,0.2605307400226593,0.4122091233730316,0.4110910892486572,0.2002331018447876,972.7406005859375,1e-05,0.4385959804058075,3.0704505443573,81.14050197601318,3 +4134,0.28178671002388,0.24118174612522125,0.24897725880146027,0.17972028255462646,950.8469848632812,1e-05,0.1421162337064743,3.343991756439209,81.14050197601318,3 +4135,0.15407538414001465,0.46799805760383606,0.4801652431488037,0.13100233674049377,982.5844116210938,1e-05,0.12034275382757187,3.1786398887634277,81.14050197601318,3 +4136,0.2125442624092102,0.25732386112213135,0.2652024030685425,0.2566433548927307,839.7739868164062,1e-05,0.16377902030944824,2.8367953300476074,81.14050197601318,3 +4137,0.27707982063293457,0.40027540922164917,0.419467955827713,0.2097902148962021,965.8648071289062,1e-05,0.1484968364238739,3.1357245445251465,81.14050197601318,3 +4138,0.185996413230896,0.36328235268592834,0.3560269773006439,0.2769230902194977,975.0736083984375,1e-05,0.1505221724510193,3.1021728515625,81.14050197601318,3 +4139,0.4035843312740326,0.35009241104125977,0.347489595413208,0.24428904056549072,642.2061767578125,1e-05,0.11868423968553543,3.1127817630767822,81.14050197601318,3 +4140,0.291482150554657,0.23311500251293182,0.2366982102394104,0.20792540907859802,671.7659301757812,1e-05,0.1496609002351761,3.3233110904693604,81.14050197601318,3 +4141,0.3513856828212738,0.23273153603076935,0.24536411464214325,0.20093239843845367,914.2007446289062,1e-05,0.20227225124835968,2.832049608230591,81.14050197601318,3 +4142,0.28481966257095337,0.2849007844924927,0.29518845677375793,0.13333334028720856,495.12713623046875,1e-05,0.14256314933300018,2.832284688949585,81.14050197601318,3 +4143,0.22123007476329803,0.15518145263195038,0.17183461785316467,0.13123543560504913,934.9658203125,1e-05,0.1405966579914093,3.0239830017089844,81.14050197601318,3 +4144,0.2907952666282654,0.20783942937850952,0.22708190977573395,0.2526806592941284,806.5763549804688,1e-05,0.12955324351787567,3.0820870399475098,81.14050197601318,3 +4145,0.311531662940979,0.2713751196861267,0.2795139253139496,0.24685314297676086,687.85546875,1e-05,0.13521333038806915,3.347507953643799,81.14050197601318,3 +4146,0.3502795696258545,0.2523140609264374,0.2517724931240082,0.19324009120464325,871.4204711914062,1e-05,0.12168293446302414,3.1641950607299805,81.14050197601318,3 +4147,0.20491866767406464,0.32456597685813904,0.33139312267303467,0.2461538463830948,489.7753601074219,1e-05,0.10016930848360062,2.8430027961730957,81.14050197601318,3 +4148,0.1889224797487259,0.257364422082901,0.2845797538757324,0.20512820780277252,788.1709594726562,1e-05,0.1428941786289215,3.139986753463745,81.14050197601318,3 +4149,0.28410017490386963,0.31411248445510864,0.3155723214149475,0.21888111531734467,800.1805419921875,1e-05,0.15089067816734314,3.10424542427063,81.14050197601318,3 +4150,0.30235645174980164,0.31088677048683167,0.32757195830345154,0.17132866382598877,864.5192260742188,1e-05,0.10152223706245422,3.2958972454071045,81.14050197601318,3 +4151,0.2731325030326843,0.2662694752216339,0.2697158753871918,0.220279723405838,645.3312377929688,1e-05,0.17943817377090454,3.326911449432373,81.14050197601318,3 +4152,0.3055418133735657,0.4988535940647125,0.5089452266693115,0.16876456141471863,999.2957763671875,1e-05,0.11135635524988174,3.372115135192871,81.14050197601318,3 +4153,0.24513792991638184,0.3534482717514038,0.3473424017429352,0.1958041936159134,983.9144897460938,1e-05,0.13011683523654938,2.833975315093994,81.14050197601318,3 +4154,0.34460213780403137,0.308178186416626,0.3173701763153076,0.2174825221300125,937.2574462890625,1e-05,0.1813499629497528,3.062325954437256,81.14050197601318,3 +4155,0.4186866283416748,0.3685905933380127,0.3722537159919739,0.17296037077903748,305.9609069824219,1e-05,0.1359989494085312,2.83489990234375,81.14050197601318,3 +4156,0.2379688173532486,0.3347833454608917,0.32793381810188293,0.22773893177509308,984.4981079101562,1e-05,0.09325873851776123,3.033010959625244,81.14050197601318,3 +4157,0.32075873017311096,0.28456544876098633,0.2984115779399872,0.18275058269500732,945.9192504882812,1e-05,0.17779827117919922,3.1170103549957275,81.14050197601318,3 +4158,0.23069563508033752,0.3687039315700531,0.3482983410358429,0.17692308127880096,947.9669189453125,1e-05,0.13939057290554047,3.2547338008880615,81.14050197601318,3 +4159,0.259021520614624,0.13343940675258636,0.15597836673259735,0.17832167446613312,840.3358154296875,1e-05,0.11845460534095764,2.9410481452941895,81.14050197601318,3 +4160,0.2836626172065735,0.2694166600704193,0.27177393436431885,0.1958041936159134,728.9754028320312,1e-05,0.12994851171970367,3.099120855331421,81.14050197601318,3 +4161,0.24346600472927094,0.2930775284767151,0.2883341610431671,0.20233100652694702,971.5481567382812,1e-05,0.16529728472232819,2.8311269283294678,81.14050197601318,3 +4162,0.3561735451221466,0.4198744595050812,0.4161146581172943,0.21072261035442352,987.906494140625,1e-05,0.1256011575460434,3.2536110877990723,81.14050197601318,3 +4163,0.40536725521087646,0.31353071331977844,0.3229621350765228,0.19510489702224731,965.8648071289062,1e-05,0.25045090913772583,3.1225030422210693,81.14050197601318,3 +4164,0.1969410926103592,0.35944902896881104,0.37002962827682495,0.04545454680919647,977.0203857421875,1e-05,0.19083017110824585,3.3099756240844727,81.14050197601318,3 +4165,0.25403353571891785,0.2824277877807617,0.2889759838581085,0.06666667014360428,508.12554931640625,1e-05,0.1317298412322998,2.8345346450805664,81.14050197601318,3 +4166,0.2787085473537445,0.24956685304641724,0.24949711561203003,0.19930069148540497,599.4783325195312,1e-05,0.19558650255203247,3.215007781982422,81.14050197601318,3 +4167,0.19149601459503174,0.3556603193283081,0.36901435256004333,0.1790209710597992,935.22314453125,1e-05,0.13914616405963898,3.104825258255005,81.14050197601318,3 +4168,0.4904615879058838,0.3539436161518097,0.3547060191631317,0.21771562099456787,555.2279663085938,1e-05,0.1254701316356659,3.3731002807617188,81.14050197601318,3 +4169,0.31916409730911255,0.13827267289161682,0.1544189304113388,0.13939394056797028,836.9324951171875,1e-05,0.11615703254938126,3.1300809383392334,81.14050197601318,3 +4170,0.34924614429473877,0.2298041731119156,0.23632484674453735,0.16759906709194183,947.2893676757812,1e-05,0.14757326245307922,3.274954080581665,81.14050197601318,3 +4171,0.23752912878990173,0.2372322529554367,0.23743122816085815,0.003496503457427025,505.5683898925781,1e-05,0.11647872626781464,2.832589626312256,81.14050197601318,3 +4172,0.15409797430038452,0.17878271639347076,0.19988101720809937,0.17296037077903748,774.4262084960938,1e-05,0.13594861328601837,3.3683254718780518,81.14050197601318,3 +4173,0.3558148145675659,0.6873385906219482,0.6909218430519104,0.20675989985466003,158.9905548095703,1e-05,0.12844087183475494,3.044463634490967,81.14050197601318,3 +4174,0.22393763065338135,0.28306618332862854,0.2815755009651184,0.16200466454029083,926.9263305664062,1e-05,0.13428887724876404,3.1130588054656982,81.14050197601318,3 +4175,0.4048280417919159,0.24331311881542206,0.24774986505508423,0.22331002354621887,801.6233520507812,1e-05,0.15423014760017395,3.264333724975586,81.14050197601318,3 +4176,0.3618345856666565,0.2305266112089157,0.25026196241378784,0.2102564126253128,737.33203125,1e-05,0.1491236835718155,3.0948221683502197,81.14050197601318,3 +4177,0.3639797568321228,0.2787292003631592,0.28499671816825867,0.24428904056549072,386.44976806640625,1e-05,0.13654710352420807,2.8213951587677,81.14050197601318,3 +4178,0.2541631758213043,0.4183928668498993,0.39957869052886963,0.17412588000297546,999.9999389648438,1e-05,0.11348667740821838,3.088461399078369,81.14050197601318,3 +4179,0.20878735184669495,0.21242807805538177,0.2410489171743393,0.25407925248146057,920.0114135742188,1e-05,0.12167250365018845,3.373941421508789,81.14050197601318,3 +4180,0.25734174251556396,0.29829245805740356,0.3002517819404602,0.21445220708847046,909.0570068359375,1e-05,0.09869204461574554,3.1186819076538086,81.14050197601318,3 +4181,0.22188180685043335,0.2388293594121933,0.24696269631385803,0.20792540907859802,805.1764526367188,1e-05,0.2030639797449112,3.3252651691436768,81.14050197601318,3 +4182,0.2811010479927063,0.3297671377658844,0.3306145668029785,0.1678321659564972,929.6773681640625,1e-05,0.11364845931529999,3.1477582454681396,81.14050197601318,3 +4183,0.24553638696670532,0.28082966804504395,0.28779345750808716,0.22890442609786987,934.7079467773438,1e-05,0.11601365357637405,3.010572910308838,81.14050197601318,3 +4184,0.1828797161579132,0.3761594593524933,0.3871825039386749,0.21002331376075745,970.1636352539062,1e-05,0.10772601515054703,3.1271302700042725,81.14050197601318,3 +4185,0.22268514335155487,0.36763685941696167,0.37601450085639954,0.13333334028720856,411.0456848144531,1e-05,0.10658510029315948,3.261253595352173,81.14050197601318,3 +4186,0.28493532538414,0.25522929430007935,0.2586742639541626,0.20209790766239166,790.488037109375,1e-05,0.1009456142783165,3.1123414039611816,81.14050197601318,3 +4187,0.21878476440906525,0.31521546840667725,0.31034815311431885,0.2466200441122055,854.2249145507812,1e-05,0.09770072996616364,3.0958290100097656,81.14050197601318,3 +4188,0.15566295385360718,0.21264474093914032,0.22061112523078918,0.13939394056797028,990.4967651367188,1e-05,0.09503757208585739,2.824286699295044,81.14050197601318,3 +4189,0.17996326088905334,0.12473186105489731,0.13344062864780426,0.10675990581512451,834.0355224609375,1e-05,0.10630501806735992,3.1974377632141113,81.14050197601318,3 +4190,0.35492387413978577,0.22108228504657745,0.2374754697084427,0.19533799588680267,944.9946899414062,1e-05,0.12385251373052597,2.8394994735717773,81.14050197601318,3 +4191,0.3379017114639282,0.3015737533569336,0.3029850721359253,0.22214451432228088,593.8468017578125,1e-05,0.20153886079788208,3.272918939590454,81.14050197601318,3 +4192,0.24618227779865265,0.2615504562854767,0.2656518220901489,0.2265734225511551,816.0525512695312,1e-05,0.13108251988887787,3.1202616691589355,81.14050197601318,3 +4193,0.21344955265522003,0.3481103479862213,0.34314557909965515,0.18041957914829254,939.2506103515625,1e-05,0.11192046105861664,3.1571927070617676,81.14050197601318,3 +4194,0.3602992594242096,0.19363746047019958,0.2073114663362503,0.1818181872367859,956.552734375,1e-05,0.1568748503923416,2.8456051349639893,81.14050197601318,3 +4195,0.21558964252471924,0.23958304524421692,0.24417895078659058,0.22191141545772552,836.3575439453125,1e-05,0.10263048112392426,3.1367621421813965,81.14050197601318,3 +4196,0.24956604838371277,0.2615929841995239,0.26470455527305603,0.22400932013988495,930.2188720703125,1e-05,0.11159825325012207,2.836221933364868,81.14050197601318,3 +4197,0.18807530403137207,0.4634823501110077,0.4767370820045471,0.16969697177410126,979.8526000976562,1e-05,0.6692364811897278,3.1895346641540527,81.14050197601318,3 +4198,0.30526524782180786,0.2541678845882416,0.26978257298469543,0.2013985961675644,464.5392150878906,1e-05,0.11912588775157928,3.1347076892852783,81.14050197601318,3 +4199,0.28041377663612366,0.188046395778656,0.19888105988502502,0.14242424070835114,707.6432495117188,1e-05,0.11136077344417572,3.2420308589935303,81.14050197601318,3 +4200,0.17509374022483826,0.33260905742645264,0.34196799993515015,0.20512820780277252,986.9286499023438,1e-05,0.1324903815984726,2.828043222427368,81.14050197601318,3 +4201,0.357086718082428,0.7582268714904785,0.7805256843566895,0.21048951148986816,106.90462493896484,1e-05,0.12467198818922043,3.2828311920166016,81.14050197601318,3 +4202,0.1384383738040924,0.2972496747970581,0.2965487241744995,0.12354312092065811,884.2141723632812,1e-05,0.32382282614707947,3.11826753616333,81.14050197601318,3 +4203,0.18175897002220154,0.18784646689891815,0.20405668020248413,0.23076923191547394,895.8192749023438,1e-05,0.13353785872459412,3.0826969146728516,81.14050197601318,3 +4204,0.3288803994655609,0.49377429485321045,0.49241456389427185,0.21048951148986816,993.2548217773438,1e-05,0.12747757136821747,3.0508010387420654,81.14050197601318,3 +4205,0.21318700909614563,0.8017942309379578,0.7886927127838135,0.225874125957489,996.64892578125,1e-05,0.17199821770191193,3.2314224243164062,81.14050197601318,3 +4206,0.40289145708084106,0.20171089470386505,0.21477994322776794,0.1818181872367859,734.2389526367188,1e-05,0.2428707480430603,2.817115068435669,81.14050197601318,3 +4207,0.18354567885398865,0.39610040187835693,0.4147406816482544,0.20233100652694702,992.6078491210938,1e-05,0.13812220096588135,3.3133785724639893,81.14050197601318,3 +4208,0.3358420431613922,0.21089638769626617,0.22367632389068604,0.17808857560157776,999.8831176757812,1e-05,0.1429804265499115,3.0473763942718506,81.14050197601318,3 +4209,0.1339453160762787,0.254124253988266,0.25071558356285095,0.21328671276569366,839.7739868164062,1e-05,0.10967735946178436,3.020939826965332,81.14050197601318,3 +4210,0.3583589196205139,0.3448551893234253,0.3417617380619049,0.260606050491333,963.0614624023438,1e-05,0.1317334771156311,3.3548662662506104,81.14050197601318,3 +4211,0.22565791010856628,0.27991047501564026,0.2791377007961273,0.15734265744686127,920.0114135742188,1e-05,0.4233381152153015,3.1185615062713623,81.14050197601318,3 +4212,0.3483724892139435,0.27384284138679504,0.27407675981521606,0.20536130666732788,859.7134399414062,1e-05,0.14469829201698303,3.0918850898742676,81.14050197601318,3 +4213,0.28393295407295227,0.5407689809799194,0.5481050610542297,0.20000000298023224,996.1564331054688,1e-05,0.13634155690670013,3.1064255237579346,81.14050197601318,3 +4214,0.2740211486816406,0.32003843784332275,0.32878124713897705,0.13333334028720856,979.0761108398438,1e-05,0.18924418091773987,3.036370038986206,81.14050197601318,3 +4215,0.1297709047794342,0.23266294598579407,0.23258864879608154,0.20606060326099396,902.2786865234375,1e-05,0.10576040297746658,3.069167375564575,81.14050197601318,3 +4216,0.2893627882003784,0.23229733109474182,0.24002505838871002,0.22214451432228088,875.3941650390625,1e-05,0.13586382567882538,3.433016300201416,81.14050197601318,3 +4217,0.40609025955200195,0.40322771668434143,0.4154306650161743,0.2242424190044403,258.84716796875,1e-05,0.10503635555505753,3.1477482318878174,81.14050197601318,3 +4218,0.4789627194404602,0.48871269822120667,0.4922145903110504,0.2298368364572525,296.9483642578125,1e-05,0.13066308200359344,3.0321712493896484,81.14050197601318,3 +4219,0.2622280716896057,0.2855413556098938,0.29775819182395935,0.1818181872367859,911.3367309570312,1e-05,0.14136818051338196,3.091630220413208,81.14050197601318,3 +4220,0.27668502926826477,0.3381524980068207,0.3462026119232178,0.1946386992931366,489.7753601074219,1e-05,0.16399574279785156,3.0010313987731934,81.14050197601318,3 +4221,0.39317941665649414,0.14636680483818054,0.15842731297016144,0.17039626836776733,868.2445068359375,1e-05,0.1706041693687439,3.0172479152679443,81.14050197601318,3 +4222,0.23161740601062775,0.41550201177597046,0.4132656753063202,0.2214452177286148,997.86474609375,1e-05,0.12137431651353836,3.4772348403930664,81.14050197601318,3 +4223,0.4226943254470825,0.37754181027412415,0.3916763961315155,0.20372959971427917,996.8938598632812,1e-05,0.22927941381931305,2.818995952606201,81.14050197601318,3 +4224,0.22094236314296722,0.23601587116718292,0.23615555465221405,0.23496504127979279,864.9906616210938,1e-05,0.1450972855091095,3.0844175815582275,81.14050197601318,3 +4225,0.23332783579826355,0.20093998312950134,0.20699459314346313,0.21445220708847046,860.688232421875,1e-05,0.12856100499629974,2.828641176223755,81.14050197601318,3 +4226,0.16710570454597473,0.29783186316490173,0.2964805066585541,0.26993006467819214,278.3217468261719,1e-05,0.08890265226364136,3.0124337673187256,81.14050197601318,3 +4227,0.14526325464248657,0.39975506067276,0.4111177325248718,0.1023310050368309,997.0159301757812,1e-05,0.09543213993310928,3.0371084213256836,81.14050197601318,3 +4228,0.2237190455198288,0.18651752173900604,0.2108820080757141,0.1794871836900711,916.6853637695312,1e-05,0.11524733155965805,3.408953905105591,81.14050197601318,3 +4229,0.37282106280326843,0.27724123001098633,0.28181192278862,0.17016316950321198,936.7528076171875,1e-05,0.11371807754039764,2.832961320877075,81.14050197601318,3 +4230,0.4499858617782593,0.3787047266960144,0.36660128831863403,0.2501165568828583,910.6900634765625,1e-05,0.11871368438005447,3.3177313804626465,81.14050197601318,3 +4231,0.280657559633255,0.2202877551317215,0.24042610824108124,0.18648017942905426,704.0678100585938,1e-05,0.11765038222074509,2.846904993057251,81.14050197601318,3 +4232,0.43375974893569946,0.3344200551509857,0.3466680943965912,0.21235431730747223,421.0982971191406,1e-05,0.13950292766094208,3.051050901412964,81.14050197601318,3 +4233,0.34742870926856995,0.3375631868839264,0.3402431011199951,0.1862470805644989,714.6185302734375,1e-05,0.11068353801965714,3.1289541721343994,81.14050197601318,3 +4234,0.28345373272895813,0.28788867592811584,0.29870158433914185,0.13636364042758942,976.3768310546875,1e-05,0.130562424659729,3.4830727577209473,81.14050197601318,3 +4235,0.13575561344623566,0.38711872696876526,0.38290831446647644,0.23426572978496552,990.36279296875,1e-05,0.24434621632099152,2.84232234954834,81.14050197601318,3 +4236,0.245761901140213,0.20589932799339294,0.22067072987556458,0.16526806354522705,839.2100219726562,1e-05,0.10127867013216019,3.085228204727173,81.14050197601318,3 +4237,0.23567728698253632,0.26021987199783325,0.26744672656059265,0.13682983815670013,725.7503051757812,1e-05,0.1167486160993576,2.8441832065582275,81.14050197601318,3 +4238,0.16950687766075134,0.23996175825595856,0.24433346092700958,0.2282051295042038,905.7181396484375,1e-05,0.12506957352161407,3.256370782852173,81.14050197601318,3 +4239,0.3109283447265625,0.3702130615711212,0.37532222270965576,0.24522145092487335,979.6979370117188,1e-05,0.1930055022239685,3.4066312313079834,81.14050197601318,3 +4240,0.1896241456270218,0.35303938388824463,0.3816334009170532,0.1382284313440323,314.781494140625,1e-05,0.1405983716249466,3.311483860015869,81.14050197601318,3 +4241,0.2450031042098999,0.32265791296958923,0.3357073664665222,0.18111887574195862,508.12554931640625,1e-05,0.12832778692245483,2.8478481769561768,81.14050197601318,3 +4242,0.3933194875717163,0.2048085629940033,0.2192215472459793,0.10652680695056915,968.57763671875,1e-05,0.19136247038841248,3.3030927181243896,81.14050197601318,3 +4243,0.2603134512901306,0.272816002368927,0.2858677804470062,0.22167831659317017,714.6185302734375,1e-05,0.13214850425720215,2.8403267860412598,81.14050197601318,3 +4244,0.18130949139595032,0.3734806776046753,0.3587699830532074,0.2198135256767273,929.6773681640625,1e-05,0.12477443367242813,3.1075494289398193,81.14050197601318,3 +4245,0.32078635692596436,0.2501894533634186,0.2631933391094208,0.20000000298023224,947.0624389648438,1e-05,0.10231839120388031,3.3479793071746826,81.14050197601318,3 +4246,0.24689923226833344,0.3988540470600128,0.41186806559562683,0.2722610831260681,972.9094848632812,1e-05,0.11388878524303436,3.2705390453338623,81.14050197601318,3 +4247,0.30555135011672974,0.31914860010147095,0.31481993198394775,0.16153846681118011,953.0025024414062,1e-05,0.1429697871208191,2.83811616897583,81.14050197601318,3 +4248,0.2597259283065796,0.19288627803325653,0.21410386264324188,0.23170162737369537,764.9352416992188,1e-05,0.10017997026443481,3.097212553024292,81.14050197601318,3 +4249,0.11723259091377258,0.30918943881988525,0.30786818265914917,0.24475523829460144,939.7424926757812,1e-05,0.10021398216485977,3.0554676055908203,81.14050197601318,3 +4250,0.3241111636161804,0.2928031086921692,0.3001664876937866,0.2298368364572525,954.0613403320312,1e-05,0.11075349897146225,3.0575459003448486,81.14050197601318,3 +4251,0.3237147629261017,0.2472119927406311,0.2574732005596161,0.10606060922145844,938.5079956054688,1e-05,0.22457826137542725,3.315838575363159,81.14050197601318,3 +4252,0.21191760897636414,0.31094256043434143,0.3194689452648163,0.2293706238269806,947.5157470703125,1e-05,0.12640400230884552,3.3147168159484863,81.14050197601318,3 +4253,0.27546393871307373,0.27184420824050903,0.2899463474750519,0.17272727191448212,348.26116943359375,1e-05,0.15574094653129578,2.8221938610076904,81.14050197601318,3 +4254,0.3399214446544647,0.31647253036499023,0.3201797306537628,0.16153846681118011,854.2249145507812,1e-05,0.13095460832118988,3.0724494457244873,81.14050197601318,3 +4255,0.28528937697410583,0.24585449695587158,0.270596444606781,0.264102578163147,986.079833984375,1e-05,0.14912629127502441,3.036287784576416,81.14050197601318,3 +4256,0.16013433039188385,0.32927197217941284,0.33614224195480347,0.2198135256767273,839.2100219726562,1e-05,0.12742096185684204,3.4050686359405518,81.14050197601318,3 +4257,0.23075464367866516,0.2879554331302643,0.27629315853118896,0.20652680099010468,798.72509765625,1e-05,0.1698964387178421,3.1366565227508545,81.14050197601318,3 +4258,0.47033584117889404,0.3359624445438385,0.3331899046897888,0.26363635063171387,709.9939575195312,1e-05,0.14865300059318542,3.17734694480896,81.14050197601318,3 +4259,0.21294289827346802,0.31460443139076233,0.3139006197452545,0.18927739560604095,670.3726196289062,1e-05,0.1421382576227188,3.14892840385437,81.14050197601318,3 +4260,0.2742789685726166,0.2520710825920105,0.2609750032424927,0.23473192751407623,898.011962890625,1e-05,0.12974385917186737,2.8257298469543457,81.14050197601318,3 +4261,0.4900091886520386,0.22432772815227509,0.23161689937114716,0.1515151560306549,950.8469848632812,1e-05,0.12495867162942886,3.1019256114959717,81.14050197601318,3 +4262,0.19055989384651184,0.35809940099716187,0.3470018208026886,0.24918414652347565,951.2822265625,1e-05,0.17774634063243866,3.0320181846618652,81.14050197601318,3 +4263,0.3354587256908417,0.21240833401679993,0.21273866295814514,0.003496503457427025,915.7601928710938,1e-05,0.2713242769241333,3.5743613243103027,81.14050197601318,3 +4264,0.3212910294532776,0.33102908730506897,0.3328920006752014,0.17296037077903748,894.70751953125,1e-05,0.13906188309192657,2.8372554779052734,81.14050197601318,3 +4265,0.43166202306747437,0.27846473455429077,0.2810373306274414,0.12657342851161957,763.1554565429688,1e-05,0.11319804191589355,3.1274921894073486,81.14050197601318,3 +4266,0.2644706666469574,0.3520366847515106,0.3488417863845825,0.2242424190044403,988.4596557617188,1e-05,0.12982983887195587,2.828904628753662,81.14050197601318,3 +4267,0.30476877093315125,0.3053104877471924,0.31032079458236694,0.23030303418636322,766.697998046875,1e-05,0.12580813467502594,3.4039053916931152,81.14050197601318,3 +4268,0.30682873725891113,0.23378127813339233,0.23718053102493286,0.08648018538951874,942.1655883789062,1e-05,0.11640285700559616,3.014385461807251,81.14050197601318,3 +4269,0.2510623335838318,0.27216994762420654,0.29875606298446655,0.1867132931947708,962.871337890625,1e-05,0.11582601815462112,3.373934745788574,81.14050197601318,3 +4270,0.30891937017440796,0.2528136670589447,0.2637213170528412,0.22727273404598236,777.7576293945312,1e-05,0.1301456093788147,2.833534002304077,81.14050197601318,3 +4271,0.29686105251312256,0.324485719203949,0.3227181136608124,0.2310023307800293,652.9728393554688,1e-05,0.15082396566867828,3.1302542686462402,81.14050197601318,3 +4272,0.19793668389320374,0.30582424998283386,0.3103890120983124,0.2365967333316803,973.2462768554688,1e-05,0.1324542760848999,2.8457343578338623,81.14050197601318,3 +4273,0.20921005308628082,0.20010776817798615,0.21562382578849792,0.2377622425556183,894.3345947265625,1e-05,0.1397992968559265,3.1318321228027344,81.14050197601318,3 +4274,0.27039235830307007,0.21353891491889954,0.21896116435527802,0.15034964680671692,723.5714111328125,1e-05,0.1258549690246582,3.274991750717163,81.14050197601318,3 +4275,0.2598980665206909,0.4190029203891754,0.41479992866516113,0.2410256415605545,977.8174438476562,1e-05,0.12450099736452103,3.4732751846313477,81.14050197601318,3 +4276,0.3390830457210541,0.2403079867362976,0.24897898733615875,0.2489510476589203,778.5809936523438,1e-05,0.11420664191246033,2.8363399505615234,81.14050197601318,3 +4277,0.2583935260772705,0.27419978380203247,0.27432772517204285,0.22191141545772552,857.2454833984375,1e-05,0.12130607664585114,3.308567762374878,81.14050197601318,3 +4278,0.4585683345794678,0.17140281200408936,0.19163675606250763,0.16293705999851227,803.7642822265625,1e-05,0.10376273095607758,2.842310667037964,81.14050197601318,3 +4279,0.28518179059028625,0.21797756850719452,0.23208437860012054,0.1946386992931366,933.1463012695312,1e-05,0.11431630700826645,3.0534658432006836,81.14050197601318,3 +4280,0.4591357409954071,0.19061926007270813,0.2045666128396988,0.17575757205486298,682.6182250976562,1e-05,0.23515485227108002,3.204606294631958,81.14050197601318,3 +4281,0.17572274804115295,0.23934724926948547,0.24449852108955383,0.26363635063171387,965.4962768554688,1e-05,0.11181876808404922,3.1786277294158936,81.14050197601318,3 +4282,0.16681048274040222,0.39840906858444214,0.39080700278282166,0.20885780453681946,984.7882080078125,1e-05,0.10724862664937973,2.828763961791992,81.14050197601318,3 +4283,0.30280521512031555,0.31724777817726135,0.3201800286769867,0.16130536794662476,682.6182250976562,1e-05,0.10763267427682877,3.3527944087982178,81.14050197601318,3 +4284,0.23482656478881836,0.5613764524459839,0.5671854615211487,0.19230769574642181,989.41748046875,1e-05,0.12060461193323135,3.102287530899048,81.14050197601318,3 +4285,0.3343653380870819,0.2648468017578125,0.2648794651031494,0.09440559148788452,597.6142578125,1e-05,0.13192389905452728,3.053168773651123,81.14050197601318,3 +4286,0.14938300848007202,0.26187196373939514,0.26746055483818054,0.20000000298023224,925.5228271484375,1e-05,0.27205631136894226,3.334798812866211,81.14050197601318,3 +4287,0.20705917477607727,0.46511638164520264,0.45457249879837036,0.18694639205932617,994.27783203125,1e-05,0.12763158977031708,3.09645938873291,81.14050197601318,3 +4288,0.45584288239479065,0.25985172390937805,0.28093671798706055,0.15967366099357605,942.4046020507812,1e-05,0.09915778040885925,2.998426914215088,81.14050197601318,3 +4289,0.16328862309455872,0.4571743607521057,0.4265390634536743,0.1930069923400879,969.8138427734375,1e-05,0.2958206534385681,3.0493547916412354,81.14050197601318,3 +4290,0.2870885729789734,0.25197234749794006,0.26489660143852234,0.25034964084625244,940.2321166992188,1e-05,0.19058506190776825,3.131453275680542,81.14050197601318,3 +4291,0.1969788670539856,0.2838250398635864,0.2812463641166687,0.20279720425605774,816.7084350585938,1e-05,0.12098700553178787,3.0340828895568848,81.14050197601318,3 +4292,0.41314220428466797,0.20302312076091766,0.2140592485666275,0.2613053619861603,663.2779541015625,1e-05,0.12510091066360474,3.1392927169799805,81.14050197601318,3 +4293,0.21541890501976013,0.4097258746623993,0.4523443281650543,0.22634032368659973,177.18624877929688,1e-05,0.13924136757850647,3.1193535327911377,81.14050197601318,3 +4294,0.39180150628089905,0.16137799620628357,0.1830017864704132,0.1762237697839737,741.38232421875,1e-05,0.12193850427865982,3.0318715572357178,81.14050197601318,3 +4295,0.15447130799293518,0.3424220681190491,0.36503684520721436,0.22074592113494873,975.5648193359375,1e-05,0.10161098092794418,3.0822091102600098,81.14050197601318,3 +4296,0.2405305802822113,0.19141212105751038,0.210957333445549,0.2589743435382843,860.688232421875,1e-05,0.16657723486423492,3.1071083545684814,81.14050197601318,3 +4297,0.39127710461616516,0.9390262961387634,1.0064858198165894,0.17575757205486298,997.5022583007812,1e-05,0.17369435727596283,3.041149616241455,81.14050197601318,3 +4298,0.18872565031051636,0.20248258113861084,0.22695617377758026,0.2512820363044739,775.2649536132812,1e-05,0.18963979184627533,3.1258676052093506,81.14050197601318,3 +4299,0.3438323438167572,0.3014355003833771,0.3019629120826721,0.22494173049926758,904.354736328125,1e-05,0.15114180743694305,2.835658073425293,81.14050197601318,3 +4300,0.19369983673095703,0.24043115973472595,0.24579940736293793,0.18857808411121368,882.1692504882812,1e-05,0.11782509088516235,3.0373408794403076,81.14050197601318,3 +4301,0.2639137804508209,0.1895826905965805,0.2133972942829132,0.24452213943004608,906.7301635742188,1e-05,0.12057830393314362,3.127314329147339,81.14050197601318,3 +4302,0.19617855548858643,0.28503209352493286,0.2852906286716461,0.22517482936382294,872.758544921875,1e-05,0.10475394129753113,3.0502779483795166,81.14050197601318,3 +4303,0.33643999695777893,0.31942498683929443,0.33868297934532166,0.19766899943351746,931.2932739257812,1e-05,0.10622614622116089,3.1061954498291016,81.14050197601318,3 +4304,0.31338128447532654,0.4078989624977112,0.4127925634384155,0.2209790199995041,278.3217468261719,1e-05,0.11644437909126282,3.2884538173675537,81.14050197601318,3 +4305,0.2214246541261673,0.35536882281303406,0.3554743826389313,0.20000000298023224,962.4896240234375,1e-05,0.13936437666416168,2.8354365825653076,81.14050197601318,3 +4306,0.2911362648010254,0.234691321849823,0.23298589885234833,0.06643356382846832,878.82666015625,1e-05,0.10798165947198868,3.035111665725708,81.14050197601318,3 +4307,0.2712264955043793,0.3095727562904358,0.32556334137916565,0.20885780453681946,830.4837646484375,1e-05,0.10028053820133209,3.0826756954193115,81.14050197601318,3 +4308,0.41677406430244446,0.41938817501068115,0.4381101727485657,0.18298368155956268,238.46560668945312,1e-05,0.16177898645401,3.08622670173645,81.14050197601318,3 +4309,0.4194982647895813,0.25011885166168213,0.2611028850078583,0.285314679145813,829.2810668945312,1e-05,0.1912405639886856,3.049191951751709,81.14050197601318,3 +4310,0.2903116047382355,0.602607786655426,0.608996570110321,0.10839160531759262,127.0761489868164,1e-05,0.20725013315677643,3.2584171295166016,81.14050197601318,3 +4311,0.4300174117088318,0.29585200548171997,0.29286646842956543,0.18648017942905426,652.9728393554688,1e-05,0.8727426528930664,2.8342483043670654,81.14050197601318,3 +4312,0.21497592329978943,0.43328312039375305,0.4323827028274536,0.1878787875175476,990.0938720703125,1e-05,0.125436469912529,3.1246254444122314,81.14050197601318,3 +4313,0.19624044001102448,0.26064369082450867,0.2707962989807129,0.1846153885126114,911.0138549804688,1e-05,0.11438513547182083,2.8268914222717285,81.14050197601318,3 +4314,0.33184969425201416,0.19191931188106537,0.21421194076538086,0.16456876695156097,539.5704345703125,1e-05,0.11364773660898209,3.054884433746338,81.14050197601318,3 +4315,0.35297420620918274,0.24545350670814514,0.25782012939453125,0.21398600935935974,977.3401489257812,1e-05,0.11768419295549393,3.0491840839385986,81.14050197601318,3 +4316,0.2696809470653534,0.2751345634460449,0.2824852764606476,0.24125874042510986,924.9560546875,1e-05,0.16509412229061127,3.5493526458740234,81.14050197601318,3 +4317,0.29695022106170654,0.18380330502986908,0.21369953453540802,0.18088577687740326,382.7987976074219,1e-05,0.106037937104702,2.830702781677246,81.14050197601318,3 +4318,0.39552566409111023,0.3919377624988556,0.3879050016403198,0.1822843849658966,988.5972900390625,1e-05,0.24896712601184845,3.2966103553771973,81.14050197601318,3 +4319,0.43630680441856384,0.4296477735042572,0.4252953827381134,0.22447551786899567,988.0452880859375,1e-05,0.1192808747291565,2.8326432704925537,81.14050197601318,3 +4320,0.1984853595495224,0.1859658807516098,0.19810380041599274,0.2582750618457794,889.7675170898438,1e-05,0.11830627918243408,3.1017050743103027,81.14050197601318,3 +4321,0.34045493602752686,0.36228978633880615,0.3513724207878113,0.1850815862417221,938.0095825195312,1e-05,0.1780514270067215,3.0611631870269775,81.14050197601318,3 +4322,0.22029787302017212,0.291531503200531,0.2904894948005676,0.12214452028274536,720.25927734375,1e-05,0.1396816223859787,3.4981343746185303,81.14050197601318,3 +4323,0.47471097111701965,0.3156030774116516,0.3189410865306854,0.21212121844291687,586.15087890625,1e-05,0.12181931734085083,2.8386552333831787,81.14050197601318,3 +4324,0.08882864564657211,0.32658421993255615,0.3438994884490967,0.19254079461097717,983.178466796875,1e-05,0.14297708868980408,3.3020639419555664,81.14050197601318,3 +4325,0.1980511099100113,0.2532803416252136,0.2703843116760254,0.12564101815223694,860.688232421875,1e-05,0.1552954614162445,3.1032934188842773,81.14050197601318,3 +4326,0.2789997458457947,0.2058793157339096,0.22358235716819763,0.2041957974433899,977.3401489257812,1e-05,0.08683329820632935,2.8250346183776855,81.14050197601318,3 +4327,0.2719990015029907,0.23580804467201233,0.25288593769073486,0.23869463801383972,735.275390625,1e-05,0.11768974363803864,3.0479214191436768,81.14050197601318,3 +4328,0.3214320242404938,0.4397503733634949,0.44367602467536926,0.2013985961675644,998.7031860351562,1e-05,0.09123466163873672,3.399106025695801,81.14050197601318,3 +4329,0.3196418881416321,0.39649561047554016,0.3905186355113983,0.19160838425159454,970.5119018554688,1e-05,0.2913682460784912,2.824467658996582,81.14050197601318,3 +4330,0.24409127235412598,0.22286632657051086,0.2274320125579834,0.14289043843746185,920.9009399414062,1e-05,0.13387101888656616,3.30785870552063,81.14050197601318,3 +4331,0.25674867630004883,0.3805009424686432,0.3789515793323517,0.2708624601364136,999.7660522460938,1e-05,0.11585167050361633,3.0927560329437256,81.14050197601318,3 +4332,0.4105873107910156,0.6228827238082886,0.6268300414085388,0.20675989985466003,177.18624877929688,1e-05,0.11468840390443802,2.8286054134368896,81.14050197601318,3 +4333,0.12864145636558533,0.41036519408226013,0.40678444504737854,0.2533799409866333,990.8973388671875,1e-05,0.1006370410323143,3.0400779247283936,81.14050197601318,3 +4334,0.2883634567260742,0.24518223106861115,0.25225135684013367,0.12354312092065811,917.2977905273438,1e-05,0.14171724021434784,3.4067490100860596,81.14050197601318,3 +4335,0.09616555273532867,0.32175153493881226,0.3188108801841736,0.1890442818403244,949.0853271484375,1e-05,0.11531863361597061,2.8168656826019287,81.14050197601318,3 +4336,0.21988877654075623,0.4169395864009857,0.42186886072158813,0.16083915531635284,996.0327758789062,1e-05,0.11757297068834305,3.500990390777588,81.14050197601318,3 +4337,0.25295954942703247,0.2781982123851776,0.28889942169189453,0.279720276594162,640.6287231445312,1e-05,0.15185707807540894,3.11091685295105,81.14050197601318,3 +4338,0.2863456606864929,0.20986536145210266,0.227822408080101,0.17296037077903748,872.3140258789062,1e-05,0.15931516885757446,2.822301149368286,81.14050197601318,3 +4339,0.29317381978034973,0.2944730222225189,0.29629555344581604,0.12727272510528564,968.57763671875,1e-05,0.12697376310825348,3.055832862854004,81.14050197601318,3 +4340,0.36769574880599976,0.31715261936187744,0.3197523355484009,0.1766899824142456,979.6979370117188,1e-05,0.12320125102996826,3.461226463317871,81.14050197601318,3 +4341,0.1417028158903122,0.22561299800872803,0.23104031383991241,0.19650349020957947,774.4262084960938,1e-05,0.10026034712791443,3.020056962966919,81.14050197601318,3 +4342,0.37237608432769775,0.418055921792984,0.44413477182388306,0.22004662454128265,233.2209930419922,1e-05,0.11990398168563843,3.207710027694702,81.14050197601318,3 +4343,0.22178345918655396,0.27583619952201843,0.2768574059009552,0.24428904056549072,948.1915893554688,1e-05,0.10712103545665741,3.097404956817627,81.14050197601318,3 +4344,0.3033180236816406,0.2589762210845947,0.26637956500053406,0.25361305475234985,882.5809936523438,1e-05,0.11609483510255814,2.8292267322540283,81.14050197601318,3 +4345,0.23335309326648712,0.4356059432029724,0.42644599080085754,0.21212121844291687,986.221923828125,1e-05,0.1820044070482254,3.3311963081359863,81.14050197601318,3 +4346,0.3240598440170288,0.223289355635643,0.2276635766029358,0.17435897886753082,936.2454833984375,1e-05,0.11064478009939194,3.1184682846069336,81.14050197601318,3 +4347,0.2694074213504791,0.2944209575653076,0.2993411719799042,0.23706293106079102,978.4493408203125,1e-05,0.120592400431633,3.072205066680908,81.14050197601318,3 +4348,0.19386041164398193,0.31313830614089966,0.32628244161605835,0.23706293106079102,946.1489868164062,1e-05,0.1327240914106369,3.1092007160186768,81.14050197601318,3 +4349,0.21430329978466034,0.24769610166549683,0.274468332529068,0.1314685344696045,996.8938598632812,1e-05,0.28158998489379883,3.19907808303833,81.14050197601318,3 +4350,0.5006065964698792,0.3127986192703247,0.3192928433418274,0.279720276594162,505.5683898925781,1e-05,0.14708217978477478,2.8192646503448486,81.14050197601318,3 +4351,0.3581937253475189,0.19252799451351166,0.20115335285663605,0.16083915531635284,737.33203125,1e-05,0.15524466335773468,3.3423943519592285,81.14050197601318,3 +4352,0.21840819716453552,0.21664100885391235,0.23805736005306244,0.19114218652248383,840.3358154296875,1e-05,0.10802185535430908,3.3991942405700684,81.14050197601318,3 +4353,0.21284519135951996,0.35202556848526,0.3640340566635132,0.15034964680671692,960.7506713867188,1e-05,0.11618433892726898,3.141179323196411,81.14050197601318,3 +4354,0.4002869725227356,0.2539573013782501,0.2651256322860718,0.2058275043964386,624.2781982421875,1e-05,0.15885090827941895,3.1354401111602783,81.14050197601318,3 +4355,0.22987650334835052,0.3979812264442444,0.40706074237823486,0.14731934666633606,979.2321166992188,1e-05,0.08471200615167618,3.282282829284668,81.14050197601318,3 +4356,0.16457447409629822,0.3076983094215393,0.30634674429893494,0.15804195404052734,937.5089111328125,1e-05,0.09732802212238312,3.030945301055908,81.14050197601318,3 +4357,0.1673813909292221,0.21133337914943695,0.21681039035320282,0.18531468510627747,870.5208129882812,1e-05,0.18796667456626892,3.1686320304870605,81.14050197601318,3 +4358,0.5064972043037415,0.25231561064720154,0.2618027925491333,0.23240093886852264,578.2326049804688,1e-05,0.14862054586410522,3.232923746109009,81.14050197601318,3 +4359,0.22820575535297394,0.2579870820045471,0.2621290683746338,0.18205128610134125,755.8615112304688,1e-05,0.10551583766937256,3.139753580093384,81.14050197601318,3 +4360,0.22715045511722565,0.26530832052230835,0.2732734978199005,0.2337995320558548,971.2042846679688,1e-05,0.12248194217681885,3.307621955871582,81.14050197601318,3 +4361,0.24876774847507477,0.3605272173881531,0.3539700210094452,0.19976690411567688,997.259521484375,1e-05,0.11961397528648376,3.111753225326538,81.14050197601318,3 +4362,0.24510446190834045,0.3776495158672333,0.3859432339668274,0.2226107269525528,975.5648193359375,1e-05,0.12159120291471481,3.0421619415283203,81.14050197601318,3 +4363,0.3581814765930176,0.3233535587787628,0.327139288187027,0.15897436439990997,935.4796752929688,1e-05,0.13480226695537567,3.080460548400879,81.14050197601318,3 +4364,0.133124440908432,0.23581479489803314,0.2494894415140152,0.22797203063964844,949.5288696289062,1e-05,0.1519160270690918,3.2080132961273193,81.14050197601318,3 +4365,0.27623093128204346,0.3276287615299225,0.32789868116378784,0.2097902148962021,464.5392150878906,1e-05,0.1228315457701683,3.5810859203338623,81.14050197601318,3 +4366,0.2166510820388794,0.23809826374053955,0.25270336866378784,0.19393938779830933,938.5079956054688,1e-05,0.11095895618200302,3.0587382316589355,81.14050197601318,3 +4367,0.2702845335006714,0.31926122307777405,0.3341226279735565,0.24708624184131622,957.9745483398438,1e-05,0.12582474946975708,3.101024627685547,81.14050197601318,3 +4368,0.35253798961639404,0.18874096870422363,0.20716021955013275,0.19976690411567688,727.9061279296875,1e-05,0.13432449102401733,3.0914905071258545,81.14050197601318,3 +4369,0.5156980156898499,0.29423511028289795,0.3029809594154358,0.16806526482105255,434.07476806640625,1e-05,0.12285681068897247,3.5744504928588867,81.14050197601318,3 +4370,0.2662971317768097,0.21239984035491943,0.21163101494312286,0.18484848737716675,697.9737548828125,1e-05,0.17968867719173431,3.687922477722168,81.14050197601318,3 +4371,0.31883639097213745,0.3086960017681122,0.3034891188144684,0.20000000298023224,893.9605712890625,1e-05,0.11862070113420486,3.4286675453186035,81.14050197601318,3 +4372,0.3033467233181,0.27497389912605286,0.2704949975013733,0.18438228964805603,830.4837646484375,1e-05,0.12068583071231842,3.0491979122161865,81.14050197601318,3 +4373,0.3943767845630646,0.2676982879638672,0.27280861139297485,0.2041957974433899,884.2141723632812,1e-05,0.14568836987018585,3.0240535736083984,81.14050197601318,3 +4374,0.4218030571937561,0.30407124757766724,0.296358585357666,0.21631701290607452,584.1925659179688,1e-05,0.12081804871559143,3.3763444423675537,81.14050197601318,3 +4375,0.1747845560312271,0.2848874032497406,0.3076886534690857,0.1610722541809082,840.3358154296875,1e-05,0.10665058344602585,3.238765001296997,81.14050197601318,3 +4376,0.30191919207572937,0.3463228940963745,0.34817445278167725,0.274125874042511,912.93701171875,1e-05,0.10464610904455185,3.1013762950897217,81.14050197601318,3 +4377,0.2507975101470947,0.4161171317100525,0.40836265683174133,0.17832167446613312,994.27783203125,1e-05,0.11291401088237762,3.355393409729004,81.14050197601318,3 +4378,0.30458056926727295,0.3036070466041565,0.3068546652793884,0.21212121844291687,767.5730590820312,1e-05,0.16140028834342957,3.0760161876678467,81.14050197601318,3 +4379,0.27071723341941833,0.3734329342842102,0.37531766295433044,0.21212121844291687,957.9745483398438,1e-05,0.22073085606098175,3.099675178527832,81.14050197601318,3 +4380,0.15115071833133698,0.34579700231552124,0.34248387813568115,0.24125874042510986,961.334228515625,1e-05,0.12374772876501083,3.4229748249053955,81.14050197601318,3 +4381,0.26610618829727173,0.2500857412815094,0.2642793357372284,0.23333333432674408,733.1973266601562,1e-05,0.21984805166721344,3.5392377376556396,81.14050197601318,3 +4382,0.21582061052322388,0.1948668360710144,0.22371530532836914,0.17832167446613312,913.5706787109375,1e-05,0.16691172122955322,3.10935378074646,81.14050197601318,3 +4383,0.20228104293346405,0.42154863476753235,0.42676082253456116,0.2265734225511551,991.0303955078125,1e-05,0.13571086525917053,3.1687614917755127,81.14050197601318,3 +4384,0.2754565477371216,0.29936227202415466,0.31025469303131104,0.2237762212753296,956.75732421875,1e-05,0.15800844132900238,3.1043293476104736,81.14050197601318,3 +4385,0.31363585591316223,0.34984833002090454,0.34584763646125793,0.17179487645626068,843.6619262695312,1e-05,0.11102333664894104,3.1010148525238037,81.14050197601318,3 +4386,0.17960290610790253,0.20398682355880737,0.2113780975341797,0.11095570772886276,881.756103515625,1e-05,0.11085733771324158,3.3240437507629395,81.14050197601318,3 +4387,0.25429266691207886,0.28663089871406555,0.29155978560447693,0.18391607701778412,989.9591064453125,1e-05,0.11420226842164993,3.431493043899536,81.14050197601318,3 +4388,0.2527698576450348,0.5848655700683594,0.5747255682945251,0.23310023546218872,993.7682495117188,1e-05,0.17163683474063873,3.1038877964019775,81.14050197601318,3 +4389,0.3021748960018158,0.20989005267620087,0.23412859439849854,0.1867132931947708,972.231689453125,1e-05,0.10608566552400589,3.1852529048919678,81.14050197601318,3 +4390,0.2412051409482956,0.30873528122901917,0.3038378953933716,0.19603729248046875,986.5054321289062,1e-05,0.1342799812555313,3.233412265777588,81.14050197601318,3 +4391,0.3546954095363617,0.24639151990413666,0.26803210377693176,0.10372960567474365,991.954833984375,1e-05,0.13426481187343597,3.0435314178466797,81.14050197601318,3 +4392,0.07158799469470978,0.21386167407035828,0.22654995322227478,0.22284382581710815,908.3971557617188,1e-05,0.10561622679233551,3.056204080581665,81.14050197601318,3 +4393,0.2569394111633301,0.19786620140075684,0.218499556183815,0.22750583291053772,750.1998901367188,1e-05,0.10915228724479675,3.4513518810272217,81.14050197601318,3 +4394,0.4290914833545685,0.2553790211677551,0.2512240707874298,0.20046620070934296,929.1331176757812,1e-05,0.15878872573375702,2.836869239807129,81.14050197601318,3 +4395,0.14488071203231812,0.20836736261844635,0.20836736261844635,0.0,941.926025390625,1e-05,0.2151375114917755,3.0414881706237793,81.14050197601318,3 +4396,0.379791259765625,0.3429715931415558,0.34875407814979553,0.24708624184131622,452.67730712890625,1e-05,0.10195671021938324,3.3836960792541504,81.14050197601318,3 +4397,0.18054169416427612,0.3134482502937317,0.3121768832206726,0.09487179666757584,925.8049926757812,1e-05,0.11714762449264526,3.088637590408325,81.14050197601318,3 +4398,0.2107776403427124,0.37350714206695557,0.3713187873363495,0.20652680099010468,959.3736572265625,1e-05,0.13348136842250824,3.2977852821350098,81.14050197601318,3 +4399,0.24597984552383423,0.2589969336986542,0.26683565974235535,0.12191142141819,712.31884765625,1e-05,0.11817464232444763,3.1217751502990723,81.14050197601318,3 +4400,0.3772875666618347,0.5739574432373047,0.5703792572021484,0.25757575035095215,177.18624877929688,1e-05,0.11328943818807602,3.0140011310577393,81.14050197601318,3 +4401,0.43530455231666565,0.4643087387084961,0.46312251687049866,0.20349650084972382,470.316650390625,1e-05,0.14144563674926758,3.346022605895996,81.14050197601318,3 +4402,0.3147904872894287,0.2844665050506592,0.2844708561897278,0.26247087121009827,752.1058349609375,1e-05,0.14518533647060394,3.0463948249816895,81.14050197601318,3 +4403,0.25352051854133606,0.173986554145813,0.19642126560211182,0.21841491758823395,850.6163940429688,1e-05,0.13824042677879333,3.1186113357543945,81.14050197601318,3 +4404,0.21673326194286346,0.2835048735141754,0.30073559284210205,0.25314685702323914,943.8261108398438,1e-05,0.08722127228975296,3.142026662826538,81.14050197601318,3 +4405,0.20021437108516693,0.3984070122241974,0.4045464098453522,0.23333333432674408,980.0068969726562,1e-05,0.1182916983962059,3.0573253631591797,81.14050197601318,3 +4406,0.28852182626724243,0.237845778465271,0.24388128519058228,0.1874125897884369,775.2649536132812,1e-05,0.316726416349411,3.037010908126831,81.14050197601318,3 +4407,0.32164135575294495,0.23740154504776,0.2488000988960266,0.14755244553089142,935.22314453125,1e-05,0.13962233066558838,3.3733251094818115,81.14050197601318,3 +4408,0.36347123980522156,0.22255977988243103,0.22443737089633942,0.12680652737617493,869.15966796875,1e-05,0.13154450058937073,2.8294262886047363,81.14050197601318,3 +4409,0.2865864634513855,0.30831852555274963,0.3252187669277191,0.19557109475135803,958.576904296875,1e-05,0.12577667832374573,3.044983148574829,81.14050197601318,3 +4410,0.21929068863391876,0.2633562684059143,0.2622060775756836,0.15058274567127228,866.3948974609375,1e-05,0.131796732544899,3.2691192626953125,81.14050197601318,3 +4411,0.3625038266181946,0.2868136167526245,0.284893274307251,0.2018647938966751,932.0916137695312,1e-05,0.1328015774488449,3.067966938018799,81.14050197601318,3 +4412,0.3497968912124634,0.23980538547039032,0.2517159879207611,0.2449883371591568,661.8328857421875,1e-05,0.17024123668670654,3.287283182144165,81.14050197601318,3 +4413,0.3046332895755768,0.4616912007331848,0.4629260301589966,0.1902097910642624,273.5347900390625,1e-05,0.40929487347602844,3.083472490310669,81.14050197601318,3 +4414,0.36708980798721313,0.28616413474082947,0.30104750394821167,0.15897436439990997,301.4790344238281,1e-05,0.13643603026866913,2.837045669555664,81.14050197601318,3 +4415,0.22673283517360687,0.39451679587364197,0.41596823930740356,0.15034964680671692,964.3812255859375,1e-05,0.11157220602035522,3.0964162349700928,81.14050197601318,3 +4416,0.3155331611633301,0.2796214818954468,0.2810654938220978,0.22214451432228088,731.0974731445312,1e-05,0.10056892782449722,3.3534860610961914,81.14050197601318,3 +4417,0.4816972315311432,0.1839783787727356,0.18462631106376648,0.09207459539175034,786.6087036132812,1e-05,0.11740553379058838,3.3150601387023926,81.14050197601318,3 +4418,0.339491069316864,0.2875705063343048,0.29064908623695374,0.13636364042758942,991.0303955078125,1e-05,0.11505728214979172,3.337949752807617,81.14050197601318,3 +4419,0.340300053358078,0.20854750275611877,0.22157925367355347,0.1263403296470642,574.1869506835938,1e-05,0.2540070116519928,3.0814919471740723,81.14050197601318,3 +4420,0.2926308214664459,0.22156135737895966,0.2388065755367279,0.23030303418636322,917.6026611328125,1e-05,0.241756409406662,3.1314778327941895,81.14050197601318,3 +4421,0.21501703560352325,0.1512778103351593,0.17378103733062744,0.18018648028373718,922.0755004882812,1e-05,0.11289015412330627,3.0587522983551025,81.14050197601318,3 +4422,0.31115931272506714,0.2972885072231293,0.3052274286746979,0.19230769574642181,747.3050537109375,1e-05,0.11583705991506577,3.3769593238830566,81.14050197601318,3 +4423,0.3312199115753174,0.283674955368042,0.28356441855430603,0.2097902148962021,733.1973266601562,1e-05,0.123249351978302,2.8392653465270996,81.14050197601318,3 +4424,0.24779900908470154,0.289933979511261,0.30578723549842834,0.17132866382598877,757.7117919921875,1e-05,0.1259772628545761,3.3367981910705566,81.14050197601318,3 +4425,0.18482109904289246,0.433931440114975,0.4325350224971771,0.21491841971874237,979.6979370117188,1e-05,0.5325159430503845,3.0788698196411133,81.14050197601318,3 +4426,0.41862452030181885,0.3426533341407776,0.3630869686603546,0.2125874161720276,437.2454833984375,1e-05,0.13956953585147858,2.824019193649292,81.14050197601318,3 +4427,0.39841505885124207,0.296810507774353,0.2915186583995819,0.18041957914829254,642.2061767578125,1e-05,0.12454461306333542,3.304807424545288,81.14050197601318,3 +4428,0.23084455728530884,0.36826667189598083,0.37880346179008484,0.19790209829807281,996.4030151367188,1e-05,0.134194478392601,3.3317136764526367,81.14050197601318,3 +4429,0.27447494864463806,0.263797789812088,0.2706828713417053,0.22564102709293365,975.0736083984375,1e-05,0.10737664997577667,3.0052733421325684,81.14050197601318,3 +4430,0.25778669118881226,0.2096422165632248,0.23069706559181213,0.15058274567127228,788.94677734375,1e-05,0.12981608510017395,3.121413230895996,81.14050197601318,3 +4431,0.26498425006866455,0.3808346092700958,0.39548563957214355,0.2449883371591568,989.1450805664062,1e-05,0.14809858798980713,3.110515832901001,81.14050197601318,3 +4432,0.17317929863929749,0.2710878551006317,0.2703750431537628,0.16596736013889313,915.4500122070312,1e-05,0.12392377853393555,2.8332252502441406,81.14050197601318,3 +4433,0.2492416948080063,0.30275627970695496,0.3166147768497467,0.18414919078350067,910.6900634765625,1e-05,0.0985768660902977,3.3689301013946533,81.14050197601318,3 +4434,0.1676124930381775,0.25560903549194336,0.2645789384841919,0.145454540848732,863.5715942382812,1e-05,0.098765529692173,3.3519349098205566,81.14050197601318,3 +4435,0.3755533993244171,0.18513166904449463,0.20125669240951538,0.22960372269153595,742.382080078125,1e-05,1.1618887186050415,3.0170516967773438,81.14050197601318,3 +4436,0.4675397574901581,0.24556195735931396,0.2602868974208832,0.2678321599960327,724.6637573242188,1e-05,0.11230608075857162,3.1484534740448,81.14050197601318,3 +4437,0.27925488352775574,0.3877328634262085,0.3928338289260864,0.20116549730300903,996.771484375,1e-05,0.1258573681116104,3.061661958694458,81.14050197601318,3 +4438,0.2869013845920563,0.28100305795669556,0.2850566506385803,0.1622377634048462,941.2037353515625,1e-05,0.15180692076683044,2.825364112854004,81.14050197601318,3 +4439,0.3029766082763672,0.245157390832901,0.24196231365203857,0.0559440553188324,812.0592651367188,1e-05,0.24841459095478058,3.089738368988037,81.14050197601318,3 +4440,0.5156829357147217,0.3735499083995819,0.38202351331710815,0.2543123662471771,319.1216125488281,1e-05,0.11643056571483612,3.0346567630767822,81.14050197601318,3 +4441,0.19429907202720642,0.24558445811271667,0.24890221655368805,0.21771562099456787,761.3585205078125,1e-05,0.20365411043167114,3.038691997528076,81.14050197601318,3 +4442,0.23326188325881958,0.26047518849372864,0.2731182277202606,0.19324009120464325,563.8103637695312,1e-05,0.09747248142957687,3.0611696243286133,81.14050197601318,3 +4443,0.21099554002285004,0.2186432182788849,0.22637999057769775,0.16526806354522705,787.3915405273438,1e-05,0.10734336823225021,3.0991158485412598,81.14050197601318,3 +4444,0.17789651453495026,0.31135958433151245,0.3092436194419861,0.2449883371591568,922.0755004882812,1e-05,0.1110244020819664,3.0606396198272705,81.14050197601318,3 +4445,0.24785824120044708,0.3603151738643646,0.3619919717311859,0.2181818187236786,988.5972900390625,1e-05,0.0905551090836525,3.280810594558716,81.14050197601318,3 +4446,0.33170458674430847,0.3027549684047699,0.2977140545845032,0.19160838425159454,975.2377319335938,1e-05,0.15440431237220764,3.034950017929077,81.14050197601318,3 +4447,0.2861165404319763,0.3337891101837158,0.3251279294490814,0.22447551786899567,788.94677734375,1e-05,0.13873440027236938,3.0962915420532227,81.14050197601318,3 +4448,0.1494063138961792,0.23350496590137482,0.2505054175853729,0.27482518553733826,922.947998046875,1e-05,0.11882848292589188,3.3141305446624756,81.14050197601318,3 +4449,0.39701396226882935,0.34056660532951355,0.3513159155845642,0.22074592113494873,978.7633666992188,1e-05,0.14018139243125916,3.0891687870025635,81.14050197601318,3 +4450,0.16985788941383362,0.3260297179222107,0.3340984284877777,0.22890442609786987,953.8506469726562,1e-05,0.10006865859031677,3.095947742462158,81.14050197601318,3 +4451,0.30001166462898254,0.25878316164016724,0.26563405990600586,0.18275058269500732,906.0565185546875,1e-05,0.11008989810943604,3.325984477996826,81.14050197601318,3 +4452,0.3530890643596649,0.2527894973754883,0.26383286714553833,0.22960372269153595,939.7424926757812,1e-05,0.12409579008817673,3.1012794971466064,81.14050197601318,3 +4453,0.256952166557312,0.19399988651275635,0.20043423771858215,0.19813519716262817,877.1219482421875,1e-05,0.13997478783130646,3.077380657196045,81.14050197601318,3 +4454,0.3489740490913391,0.5318001508712769,0.5343846678733826,0.2265734225511551,217.11199951171875,1e-05,0.10279858857393265,3.038581609725952,81.14050197601318,3 +4455,0.3543185889720917,0.18981879949569702,0.21210213005542755,0.23449882864952087,655.9628295898438,1e-05,0.1058945432305336,2.8249120712280273,81.14050197601318,3 +4456,0.23618169128894806,0.28712528944015503,0.29192492365837097,0.23426572978496552,828.6761474609375,1e-05,0.10863154381513596,3.1271839141845703,81.14050197601318,3 +4457,0.3449175953865051,0.19577252864837646,0.2171785533428192,0.19720280170440674,835.2010498046875,1e-05,0.1202225461602211,3.380082845687866,81.14050197601318,3 +4458,0.18559269607067108,0.29092565178871155,0.29176393151283264,0.2582750618457794,780.2160034179688,1e-05,0.14564748108386993,2.814592123031616,81.14050197601318,3 +4459,0.2322046160697937,0.40183648467063904,0.39901649951934814,0.16643357276916504,983.767822265625,1e-05,0.09766034036874771,3.2177939414978027,81.14050197601318,3 +4460,0.3129381239414215,0.22342291474342346,0.22598174214363098,0.18414919078350067,869.614990234375,1e-05,0.122459776699543,3.0581166744232178,81.14050197601318,3 +4461,0.32241901755332947,0.2859458327293396,0.3189486265182495,0.2158508151769638,965.126220703125,1e-05,0.1290275752544403,2.8295512199401855,81.14050197601318,3 +4462,0.22977836430072784,0.20223881304264069,0.2054908573627472,0.1034965068101883,897.28564453125,1e-05,0.1261703222990036,3.0678677558898926,81.14050197601318,3 +4463,0.17934851348400116,0.40782275795936584,0.4217846691608429,0.19930069148540497,965.6807250976562,1e-05,0.11400698870420456,3.390148401260376,81.14050197601318,3 +4464,0.23703604936599731,0.1876654326915741,0.21787779033184052,0.19417248666286469,919.414306640625,1e-05,0.15297773480415344,2.8460419178009033,81.14050197601318,3 +4465,0.3308471739292145,0.339218407869339,0.3535383343696594,0.25524476170539856,933.6696166992188,1e-05,0.10794679820537567,3.271989345550537,81.14050197601318,3 +4466,0.4475852847099304,0.4276043474674225,0.4347114562988281,0.2433566451072693,301.4790344238281,1e-05,0.12531788647174835,3.254610776901245,81.14050197601318,3 +4467,0.3097260892391205,0.21804311871528625,0.2426765263080597,0.24195803701877594,880.5089721679688,1e-05,0.10206165164709091,2.810567617416382,81.14050197601318,3 +4468,0.27302485704421997,0.19713358581066132,0.21747411787509918,0.2086247056722641,854.2249145507812,1e-05,0.10877632349729538,3.0591158866882324,81.14050197601318,3 +4469,0.1374538540840149,0.28833910822868347,0.2943860590457916,0.1846153885126114,972.0613403320312,1e-05,0.1616203933954239,3.3488190174102783,81.14050197601318,3 +4470,0.32423135638237,0.37074822187423706,0.3638017475605011,0.20349650084972382,737.33203125,1e-05,0.6490799188613892,2.821376085281372,81.14050197601318,3 +4471,0.20010170340538025,0.3215581178665161,0.3095528185367584,0.17132866382598877,627.6343994140625,1e-05,0.112666055560112,3.0602564811706543,81.14050197601318,3 +4472,0.2738872468471527,0.30369216203689575,0.3108961880207062,0.2102564126253128,757.7117919921875,1e-05,0.13558630645275116,3.3363771438598633,81.14050197601318,3 +4473,0.34571608901023865,0.14451852440834045,0.15571963787078857,0.12004662305116653,819.9478759765625,1e-05,0.27301156520843506,2.8251912593841553,81.14050197601318,3 +4474,0.2424449622631073,0.29965850710868835,0.2980188727378845,0.2114219069480896,868.2445068359375,1e-05,0.10339249670505524,3.116586923599243,81.14050197601318,3 +4475,0.5726804137229919,0.32858920097351074,0.32794061303138733,0.25314685702323914,455.6820373535156,1e-05,0.1734064221382141,3.3776910305023193,81.14050197601318,3 +4476,0.2540666162967682,0.23657403886318207,0.24990271031856537,0.1834498792886734,960.9456176757812,1e-05,0.09708879888057709,3.013627767562866,81.14050197601318,3 +4477,0.2521168291568756,0.2626503109931946,0.2748993933200836,0.1822843849658966,973.2462768554688,1e-05,0.11354134231805801,3.114180564880371,81.14050197601318,3 +4478,0.3985344469547272,0.3059489130973816,0.3138238489627838,0.2097902148962021,599.4783325195312,1e-05,0.40826576948165894,3.0217363834381104,81.14050197601318,3 +4479,0.27407217025756836,0.28122976422309875,0.2759428024291992,0.19230769574642181,939.4969482421875,1e-05,0.12175995111465454,3.0388476848602295,81.14050197601318,3 +4480,0.3632749915122986,0.20560310781002045,0.2071356475353241,0.09627039730548859,781.836181640625,1e-05,0.0928141176700592,2.821354866027832,81.14050197601318,3 +4481,0.23178863525390625,0.2777153551578522,0.2874055802822113,0.19557109475135803,950.8469848632812,1e-05,0.12448429316282272,3.074460029602051,81.14050197601318,3 +4482,0.19065223634243011,0.21645639836788177,0.22136147320270538,0.2181818187236786,962.6806640625,1e-05,0.13975253701210022,3.05332612991333,81.14050197601318,3 +4483,0.19066695868968964,0.19817298650741577,0.21327470242977142,0.1878787875175476,911.9796752929688,1e-05,0.11763592809438705,3.1040523052215576,81.14050197601318,3 +4484,0.321956068277359,0.27159038186073303,0.2877887785434723,0.2198135256767273,943.1180419921875,1e-05,0.14553262293338776,3.0717241764068604,81.14050197601318,3 +4485,0.42994529008865356,0.23775172233581543,0.2502436339855194,0.18648017942905426,858.2379760742188,1e-05,0.16066661477088928,3.062351703643799,81.14050197601318,3 +4486,0.31846100091934204,0.2784627079963684,0.28733450174331665,0.2058275043964386,712.31884765625,1e-05,0.13124296069145203,2.823493719100952,81.14050197601318,3 +4487,0.31767547130584717,0.31190505623817444,0.33474478125572205,0.20396269857883453,356.2078552246094,1e-05,0.19752870500087738,3.1049675941467285,81.14050197601318,3 +4488,0.366093248128891,0.3222607970237732,0.3188549280166626,0.2645687758922577,889.3790893554688,1e-05,0.10714025795459747,3.0903127193450928,81.14050197601318,3 +4489,0.44098103046417236,0.6688613891601562,0.6666355729103088,0.1650349646806717,113.7176742553711,1e-05,0.09529171139001846,3.2510600090026855,81.14050197601318,3 +4490,0.40880611538887024,0.28156495094299316,0.2851930558681488,0.10979020595550537,992.8673706054688,1e-05,1.439018726348877,2.8306117057800293,81.14050197601318,3 +4491,0.14976684749126434,0.2816693186759949,0.29641762375831604,0.1822843849658966,915.1390991210938,1e-05,0.11790799349546432,3.049278736114502,81.14050197601318,3 +4492,0.2697834372520447,0.2532741129398346,0.25920405983924866,0.2337995320558548,603.1679077148438,1e-05,0.10119377076625824,3.161506175994873,81.14050197601318,3 +4493,0.17439080774784088,0.2884541451931,0.2917367219924927,0.133100226521492,938.5079956054688,1e-05,0.24485957622528076,3.363891124725342,81.14050197601318,3 +4494,0.24101495742797852,0.31519249081611633,0.32620033621788025,0.17202797532081604,764.9352416992188,1e-05,0.12712053954601288,3.082639455795288,81.14050197601318,3 +4495,0.47005695104599,0.1854676902294159,0.21204261481761932,0.16363635659217834,980.7741088867188,1e-05,0.12066960334777832,3.287726402282715,81.14050197601318,3 +4496,0.29683807492256165,0.18467774987220764,0.20312801003456116,0.25314685702323914,723.5714111328125,1e-05,0.1070837751030922,2.8181674480438232,81.14050197601318,3 +4497,0.39352402091026306,0.39284059405326843,0.38638532161712646,0.2613053619861603,958.576904296875,1e-05,0.14580722153186798,3.0806784629821777,81.14050197601318,3 +4498,0.3285692036151886,0.26778486371040344,0.27648141980171204,0.19487179815769196,964.3812255859375,1e-05,0.10849112272262573,3.047611951828003,81.14050197601318,3 +4499,0.20002834498882294,0.18908123672008514,0.19710604846477509,0.1790209710597992,658.916015625,1e-05,0.10239489376544952,3.0735721588134766,81.14050197601318,3 +4500,0.3127455711364746,0.33125177025794983,0.33740535378456116,0.2242424190044403,996.5260620117188,1e-05,0.136601522564888,3.0161890983581543,81.14050197601318,3 +4501,0.2656609117984772,0.24938543140888214,0.26484304666519165,0.14009323716163635,841.452880859375,1e-05,0.14836399257183075,3.125178098678589,81.14050197601318,3 +4502,0.2237572968006134,0.31206896901130676,0.3140401542186737,0.16573426127433777,878.82666015625,1e-05,0.1273440271615982,2.818091869354248,81.14050197601318,3 +4503,0.3070003390312195,0.29975757002830505,0.31993526220321655,0.17039626836776733,823.7489624023438,1e-05,0.10268616676330566,3.384026050567627,81.14050197601318,3 +4504,0.22307725250720978,0.33103272318840027,0.37018418312072754,0.1822843849658966,140.08938598632812,1e-05,0.1262246072292328,3.1599507331848145,81.14050197601318,3 +4505,0.47447460889816284,0.23790015280246735,0.24461501836776733,0.08041957765817642,726.8310546875,1e-05,0.12354757636785507,2.988537073135376,81.14050197601318,3 +4506,0.24470287561416626,0.2274731993675232,0.23643426597118378,0.16899767518043518,741.38232421875,1e-05,0.20987512171268463,2.81477689743042,81.14050197601318,3 +4507,0.1378580927848816,0.3523370027542114,0.35206103324890137,0.14685314893722534,973.748779296875,1e-05,0.22111031413078308,3.0928311347961426,81.14050197601318,3 +4508,0.28923115134239197,0.2793750464916229,0.3010416030883789,0.2069930136203766,379.11187744140625,1e-05,0.10260441154241562,2.8215668201446533,81.14050197601318,3 +4509,0.1748906970024109,0.2608705461025238,0.2684153616428375,0.25081583857536316,940.4759521484375,1e-05,0.11623728275299072,3.1381888389587402,81.14050197601318,3 +4510,0.1904667317867279,0.28889042139053345,0.29289454221725464,0.238228440284729,930.7574462890625,1e-05,0.14723087847232819,3.1743180751800537,81.14050197601318,3 +4511,0.20346125960350037,0.2633199393749237,0.2758744955062866,0.16363635659217834,941.685791015625,1e-05,0.11441561579704285,3.023527145385742,81.14050197601318,3 +4512,0.1167597696185112,0.21586263179779053,0.2327882945537567,0.21515151858329773,807.9645385742188,1e-05,0.10070665925741196,3.03958797454834,81.14050197601318,3 +4513,0.39996737241744995,0.2642058730125427,0.2725679874420166,0.1263403296470642,937.5089111328125,1e-05,0.10047260671854019,3.0781524181365967,81.14050197601318,3 +4514,0.249025359749794,0.2886791527271271,0.2896566390991211,0.22447551786899567,928.31103515625,1e-05,0.10521063208580017,3.0731401443481445,81.14050197601318,3 +4515,0.38707250356674194,0.3728708028793335,0.3673660159111023,0.20116549730300903,963.251220703125,1e-05,0.14826001226902008,3.155784845352173,81.14050197601318,3 +4516,0.23306354880332947,0.22281695902347565,0.2456587851047516,0.14382284879684448,994.53125,1e-05,0.12821151316165924,3.2972588539123535,81.14050197601318,3 +4517,0.3054928183555603,0.3054794371128082,0.3320903778076172,0.18764568865299225,986.3638916015625,1e-05,0.11894179880619049,3.0577902793884277,81.14050197601318,3 +4518,0.29656001925468445,0.2966204285621643,0.32299187779426575,0.22284382581710815,984.3526000976562,1e-05,0.1188569888472557,3.104551315307617,81.14050197601318,3 +4519,0.25252342224121094,0.35935643315315247,0.34627223014831543,0.23170162737369537,995.160888671875,1e-05,0.11229070276021957,2.8255062103271484,81.14050197601318,3 +4520,0.2505071461200714,0.2329132854938507,0.2553972005844116,0.12773892283439636,952.1465454101562,1e-05,0.10887115448713303,3.099036931991577,81.14050197601318,3 +4521,0.25714024901390076,0.3055163621902466,0.30075085163116455,0.2242424190044403,970.1636352539062,1e-05,0.1526528149843216,2.83219051361084,81.14050197601318,3 +4522,0.1569669246673584,0.2998057007789612,0.3047873079776764,0.22680652141571045,995.2861328125,1e-05,0.11895227432250977,3.2029929161071777,81.14050197601318,3 +4523,0.27473801374435425,0.6317465901374817,0.6284219622612,0.15244755148887634,152.77052307128906,1e-05,0.1164586991071701,3.047459602355957,81.14050197601318,3 +4524,0.1532416194677353,0.3840153217315674,0.38199204206466675,0.15757575631141663,993.7682495117188,1e-05,0.12559370696544647,3.097888231277466,81.14050197601318,3 +4525,0.25534558296203613,0.2997881770133972,0.3239552974700928,0.1958041936159134,976.8599853515625,1e-05,0.14973554015159607,2.8375556468963623,81.14050197601318,3 +4526,0.14403124153614044,0.28537073731422424,0.2984679639339447,0.2421911358833313,979.54296875,1e-05,0.2596273720264435,3.4023399353027344,81.14050197601318,3 +4527,0.25802579522132874,0.2935852110385895,0.30851709842681885,0.18531468510627747,979.6979370117188,1e-05,0.1335504651069641,2.8417587280273438,81.14050197601318,3 +4528,0.2951624095439911,0.2702707350254059,0.27114570140838623,0.12121211737394333,689.1459350585938,1e-05,0.13034895062446594,3.508213996887207,81.14050197601318,3 +4529,0.29493090510368347,0.4087647497653961,0.39694881439208984,0.24755243957042694,954.0613403320312,1e-05,0.11458370089530945,3.066605806350708,81.14050197601318,3 +4530,0.22360089421272278,0.1505417823791504,0.1708613634109497,0.13776223361492157,914.2007446289062,1e-05,0.12169558554887772,3.311290740966797,81.14050197601318,3 +4531,0.22642096877098083,0.21444916725158691,0.23034587502479553,0.1794871836900711,988.4596557617188,1e-05,0.10759463906288147,2.84161114692688,81.14050197601318,3 +4532,0.37392157316207886,0.2648337781429291,0.2735850512981415,0.18974359333515167,935.7356567382812,1e-05,0.14365752041339874,3.15785813331604,81.14050197601318,3 +4533,0.32776179909706116,0.290288507938385,0.3020533621311188,0.18531468510627747,774.4262084960938,1e-05,0.12225627154111862,2.837925434112549,81.14050197601318,3 +4534,0.32547029852867126,0.2190474569797516,0.23597371578216553,0.25081583857536316,961.7210693359375,1e-05,0.11376431584358215,3.1539254188537598,81.14050197601318,3 +4535,0.36766374111175537,0.375894695520401,0.38232842087745667,0.21212121844291687,943.1180419921875,1e-05,0.11985746026039124,3.057464122772217,81.14050197601318,3 +4536,0.2953075170516968,0.25436848402023315,0.2924998700618744,0.2501165568828583,356.2078552246094,1e-05,0.09772725403308868,3.3279378414154053,81.14050197601318,3 +4537,0.16582807898521423,0.3642808198928833,0.3743296265602112,0.09557109326124191,996.1564331054688,1e-05,0.09167633205652237,2.8281235694885254,81.14050197601318,3 +4538,0.24479204416275024,0.4181506335735321,0.4187908470630646,0.24848484992980957,310.39483642578125,1e-05,0.11325866729021072,3.137303352355957,81.14050197601318,3 +4539,0.3069915771484375,0.6804051995277405,0.653003454208374,0.27668997645378113,987.906494140625,1e-05,0.15837107598781586,2.8375000953674316,81.14050197601318,3 +4540,0.3022839426994324,0.31136104464530945,0.3070302903652191,0.21771562099456787,902.9749755859375,1e-05,0.12207899987697601,3.197094440460205,81.14050197601318,3 +4541,0.4554015100002289,0.18402370810508728,0.19693276286125183,0.1878787875175476,838.6439208984375,1e-05,0.1281263679265976,3.0997047424316406,81.14050197601318,3 +4542,0.27009814977645874,0.2186434417963028,0.24138246476650238,0.16340325772762299,741.38232421875,1e-05,0.09566406160593033,3.305328607559204,81.14050197601318,3 +4543,0.3724622130393982,0.23635835945606232,0.2351825088262558,0.06247086077928543,722.4732666015625,1e-05,0.13919319212436676,2.8473989963531494,81.14050197601318,3 +4544,0.18366622924804688,0.27042150497436523,0.29303669929504395,0.18694639205932617,948.4158325195312,1e-05,0.10864588618278503,3.103367328643799,81.14050197601318,3 +4545,0.15338847041130066,0.2625439167022705,0.26945585012435913,0.22727273404598236,917.9066772460938,1e-05,0.13154786825180054,3.4892449378967285,81.14050197601318,3 +4546,0.1829637885093689,0.26602888107299805,0.2708905339241028,0.13333334028720856,925.8049926757812,1e-05,0.11837120354175568,2.836073875427246,81.14050197601318,3 +4547,0.24861666560173035,0.34159037470817566,0.34548577666282654,0.18811188638210297,915.7601928710938,1e-05,0.19896918535232544,3.0687947273254395,81.14050197601318,3 +4548,0.2688062787055969,0.27300453186035156,0.27594560384750366,0.2529137432575226,976.2150268554688,1e-05,0.12390398979187012,3.147451639175415,81.14050197601318,3 +4549,0.24104273319244385,0.2352122813463211,0.2463129609823227,0.2130536139011383,942.6430053710938,1e-05,0.1764771193265915,3.051506996154785,81.14050197601318,3 +4550,0.123131662607193,0.3543216586112976,0.34920355677604675,0.19254079461097717,937.0054321289062,1e-05,0.08885057270526886,3.130462169647217,81.14050197601318,3 +4551,0.3922513723373413,0.2186625748872757,0.23519060015678406,0.22121211886405945,612.1727294921875,1e-05,0.15048909187316895,3.1685492992401123,81.14050197601318,3 +4552,0.23919948935508728,0.17046311497688293,0.18085165321826935,0.12890443205833435,651.463623046875,1e-05,0.15517425537109375,2.837024688720703,81.14050197601318,3 +4553,0.3478328287601471,0.23430857062339783,0.2390914112329483,0.1090909093618393,904.6971435546875,1e-05,0.1649325042963028,3.358595848083496,81.14050197601318,3 +4554,0.35495585203170776,0.25911080837249756,0.2609134316444397,0.22517482936382294,767.5730590820312,1e-05,0.3009672164916992,3.0586633682250977,81.14050197601318,3 +4555,0.208433598279953,0.37501195073127747,0.38077184557914734,0.2030303031206131,965.8648071289062,1e-05,0.1149381697177887,3.156888961791992,81.14050197601318,3 +4556,0.4145042300224304,0.3097802996635437,0.31029221415519714,0.2365967333316803,968.9326171875,1e-05,0.13347087800502777,2.8328709602355957,81.14050197601318,3 +4557,0.2653067409992218,0.2775854170322418,0.3126648962497711,0.1582750529050827,171.19692993164062,1e-05,0.10955249518156052,3.1334409713745117,81.14050197601318,3 +4558,0.23886725306510925,0.2803220748901367,0.302497923374176,0.20629370212554932,386.44976806640625,1e-05,0.136404350399971,3.045987844467163,81.14050197601318,3 +4559,0.43459030985832214,0.5562069416046143,0.5542702674865723,0.17179487645626068,188.9440460205078,1e-05,0.10926249623298645,3.088322162628174,81.14050197601318,3 +4560,0.20010152459144592,0.39387473464012146,0.403374046087265,0.21212121844291687,991.954833984375,1e-05,0.13263770937919617,3.093538522720337,81.14050197601318,3 +4561,0.34746456146240234,0.2582564055919647,0.25861862301826477,0.11701631546020508,720.25927734375,1e-05,0.11918473243713379,3.1440279483795166,81.14050197601318,3 +4562,0.29639625549316406,0.22197452187538147,0.23762944340705872,0.19324009120464325,860.2017211914062,1e-05,0.09886641800403595,2.821420907974243,81.14050197601318,3 +4563,0.27864569425582886,0.21169641613960266,0.2239115834236145,0.13100233674049377,825.6151733398438,1e-05,0.10717443376779556,3.165297746658325,81.14050197601318,3 +4564,0.3929480016231537,0.3393622636795044,0.3450865149497986,0.2585081458091736,804.4718627929688,1e-05,0.11369725316762924,3.0446574687957764,81.14050197601318,3 +4565,0.23669229447841644,0.22288241982460022,0.24192997813224792,0.21561771631240845,835.7803955078125,1e-05,0.12070295214653015,3.094874858856201,81.14050197601318,3 +4566,0.21218672394752502,0.340835839509964,0.34856730699539185,0.18834498524665833,962.2981567382812,1e-05,0.14130516350269318,2.8257699012756348,81.14050197601318,3 +4567,0.384895384311676,0.28593283891677856,0.3004608452320099,0.19160838425159454,747.3050537109375,1e-05,0.10921292752027512,3.1178975105285645,81.14050197601318,3 +4568,0.2682858109474182,0.24452386796474457,0.2513810992240906,0.1794871836900711,976.69921875,1e-05,0.12206283956766129,2.8371260166168213,81.14050197601318,3 +4569,0.26424625515937805,0.271040678024292,0.2755836248397827,0.22913752496242523,922.947998046875,1e-05,0.40765705704689026,3.1411635875701904,81.14050197601318,3 +4570,0.29136523604393005,0.31953907012939453,0.3216559588909149,0.15734265744686127,921.48974609375,1e-05,0.10375998914241791,3.0891261100769043,81.14050197601318,3 +4571,0.117398701608181,0.337298721075058,0.3406481444835663,0.23449882864952087,995.2861328125,1e-05,0.133585587143898,3.100501775741577,81.14050197601318,3 +4572,0.24085810780525208,0.21936999261379242,0.22881636023521423,0.2512820363044739,902.9749755859375,1e-05,0.11884303390979767,2.839141368865967,81.14050197601318,3 +4573,0.31358209252357483,0.3081433176994324,0.31629693508148193,0.20769231021404266,888.9893188476562,1e-05,0.17720328271389008,3.159228563308716,81.14050197601318,3 +4574,0.33869218826293945,0.2878667116165161,0.28767266869544983,0.19230769574642181,875.3941650390625,1e-05,0.11915158480405807,2.8334643840789795,81.14050197601318,3 +4575,0.46017026901245117,0.3199585974216461,0.3229827582836151,0.1862470805644989,634.2159423828125,1e-05,0.10723518580198288,3.1593868732452393,81.14050197601318,3 +4576,0.28477606177330017,0.20606133341789246,0.22734476625919342,0.2074592113494873,728.9754028320312,1e-05,0.113828144967556,3.0579333305358887,81.14050197601318,3 +4577,0.39929020404815674,0.257560670375824,0.2681814730167389,0.23170162737369537,750.1998901367188,1e-05,0.18007974326610565,3.281930923461914,81.14050197601318,3 +4578,0.243435338139534,0.3121451437473297,0.31416746973991394,0.22191141545772552,923.525634765625,1e-05,0.16450785100460052,2.835029363632202,81.14050197601318,3 +4579,0.2307460457086563,0.171306312084198,0.18226438760757446,0.09254079312086105,430.87518310546875,1e-05,0.12820418179035187,3.360619306564331,81.14050197601318,3 +4580,0.15551318228244781,0.29707881808280945,0.3048960268497467,0.12727272510528564,911.0138549804688,1e-05,0.20735378563404083,3.233167886734009,81.14050197601318,3 +4581,0.2062755972146988,0.2892211675643921,0.3015162944793701,0.09020978957414627,951.2822265625,1e-05,0.12418835610151291,3.0648443698883057,81.14050197601318,3 +4582,0.19966913759708405,0.2084483951330185,0.2319689393043518,0.24242423474788666,907.39990234375,1e-05,0.13095320761203766,2.833489418029785,81.14050197601318,3 +4583,0.3777788579463959,0.2687560021877289,0.2740478813648224,0.23310023546218872,824.99560546875,1e-05,0.09439770877361298,3.308986186981201,81.14050197601318,3 +4584,0.23042789101600647,0.31762200593948364,0.32431846857070923,0.21678321063518524,953.0025024414062,1e-05,0.4457641839981079,3.70176362991333,81.14050197601318,3 +4585,0.2063453495502472,0.247514545917511,0.2548660337924957,0.18881118297576904,803.7642822265625,1e-05,0.11994178593158722,3.4130337238311768,81.14050197601318,3 +4586,0.31581366062164307,0.2405312955379486,0.24120239913463593,0.1986013948917389,725.7503051757812,1e-05,0.10964521765708923,3.231560707092285,81.14050197601318,3 +4587,0.09824144095182419,0.3780173659324646,0.37773606181144714,0.1662004590034485,999.8831176757812,1e-05,0.18501734733581543,3.0405938625335693,81.14050197601318,3 +4588,0.26939189434051514,0.25817087292671204,0.26733532547950745,0.09976690262556076,510.6620178222656,1e-05,0.10763371735811234,2.835099697113037,81.14050197601318,3 +4589,0.30953267216682434,0.3332165479660034,0.34255313873291016,0.14965035021305084,958.3765258789062,1e-05,0.11437547951936722,3.1382524967193604,81.14050197601318,3 +4590,0.22028625011444092,0.37456008791923523,0.3684028387069702,0.23962703347206116,682.6182250976562,1e-05,0.2965472936630249,2.841677188873291,81.14050197601318,3 +4591,0.22723889350891113,0.2738345265388489,0.2689788341522217,0.17529137432575226,802.3400268554688,1e-05,0.14274995028972626,3.39382266998291,81.14050197601318,3 +4592,0.23678530752658844,0.28153467178344727,0.2774769067764282,0.22470861673355103,814.732421875,1e-05,0.11375582963228226,3.2343485355377197,81.14050197601318,3 +4593,0.4763090908527374,0.2612084150314331,0.2720147669315338,0.23053613305091858,917.2977905273438,1e-05,0.14516034722328186,3.2750654220581055,81.14050197601318,3 +4594,0.3162817656993866,0.3166419565677643,0.32655760645866394,0.2421911358833313,568.0068969726562,1e-05,0.1806258112192154,2.8401706218719482,81.14050197601318,3 +4595,0.4807101786136627,0.2772268056869507,0.2961730360984802,0.22727273404598236,978.2918701171875,1e-05,0.1185985803604126,3.161623954772949,81.14050197601318,3 +4596,0.38193586468696594,0.3191525936126709,0.3229510486125946,0.20093239843845367,927.2047729492188,1e-05,0.11479953676462173,2.835784673690796,81.14050197601318,3 +4597,0.18883442878723145,0.22053572535514832,0.2368842363357544,0.18811188638210297,948.1915893554688,1e-05,0.37660741806030273,3.417137622833252,81.14050197601318,3 +4598,0.4275451600551605,0.4108744263648987,0.41171708703041077,0.2114219069480896,287.737548828125,1e-05,0.11237025260925293,2.847299575805664,81.14050197601318,3 +4599,0.346341609954834,0.25717511773109436,0.25738632678985596,0.2405594438314438,936.7528076171875,1e-05,0.1310161054134369,3.31426739692688,81.14050197601318,3 +4600,0.3087318539619446,0.325949102640152,0.3473127484321594,0.23636363446712494,997.6233520507812,1e-05,0.1055087149143219,3.1224558353424072,81.14050197601318,3 +4601,0.42919614911079407,0.30604225397109985,0.3082052767276764,0.19137528538703918,404.18499755859375,1e-05,0.12092015892267227,2.841038227081299,81.14050197601318,3 +4602,0.3960653245449066,0.3331837058067322,0.33648645877838135,0.19696970283985138,492.46246337890625,1e-05,0.09410727769136429,3.0537352561950684,81.14050197601318,3 +4603,0.15830719470977783,0.26613864302635193,0.2764235734939575,0.20163169503211975,955.10791015625,1e-05,0.10898285359144211,3.1354610919952393,81.14050197601318,3 +4604,0.1461637318134308,0.2460385262966156,0.2475336641073227,0.26247087121009827,975.0736083984375,1e-05,0.08255571871995926,3.159113645553589,81.14050197601318,3 +4605,0.337566614151001,0.34800565242767334,0.35247957706451416,0.1934731900691986,314.781494140625,1e-05,0.10412071645259857,3.094712972640991,81.14050197601318,3 +4606,0.25994470715522766,0.23584040999412537,0.24497829377651215,0.2566433548927307,941.685791015625,1e-05,0.13442708551883698,3.0803887844085693,81.14050197601318,3 +4607,0.19096866250038147,0.24571053683757782,0.2624528408050537,0.21165500581264496,777.7576293945312,1e-05,0.25992730259895325,2.8282620906829834,81.14050197601318,3 +4608,0.2126479297876358,0.16997379064559937,0.17945468425750732,0.07039626687765121,714.6185302734375,1e-05,0.09692598879337311,3.0888030529022217,81.14050197601318,3 +4609,0.14899678528308868,0.233321413397789,0.2525191009044647,0.19324009120464325,940.7190551757812,1e-05,0.1381366103887558,3.139244556427002,81.14050197601318,3 +4610,0.2333712875843048,0.2810186743736267,0.2993761897087097,0.18041957914829254,978.9199829101562,1e-05,0.19163787364959717,3.1704366207122803,81.14050197601318,3 +4611,0.3380902409553528,0.30993399024009705,0.31271064281463623,0.15011654794216156,537.2642211914062,1e-05,0.10946476459503174,3.065577983856201,81.14050197601318,3 +4612,0.23235462605953217,0.21716348826885223,0.23216475546360016,0.15011654794216156,720.25927734375,1e-05,0.11304373294115067,3.0873563289642334,81.14050197601318,3 +4613,0.2903035879135132,0.33473092317581177,0.33466264605522156,0.16363635659217834,909.3855590820312,1e-05,0.11782289296388626,2.851480007171631,81.14050197601318,3 +4614,0.23881766200065613,0.22331584990024567,0.23887498676776886,0.23240093886852264,599.4783325195312,1e-05,0.11161475628614426,3.1233632564544678,81.14050197601318,3 +4615,0.24632112681865692,0.29047179222106934,0.28380757570266724,0.17575757205486298,947.7415161132812,1e-05,0.12195835262537003,3.117259979248047,81.14050197601318,3 +4616,0.28041866421699524,0.38372471928596497,0.40405210852622986,0.17272727191448212,188.9440460205078,1e-05,0.11199364811182022,3.3006818294525146,81.14050197601318,3 +4617,0.2228688895702362,0.31417587399482727,0.32046788930892944,0.21655011177062988,544.1298217773438,1e-05,0.5685857534408569,3.0780837535858154,81.14050197601318,3 +4618,0.3335152566432953,0.22673243284225464,0.24551714956760406,0.23613053560256958,951.93115234375,1e-05,0.10670263320207596,3.511916399002075,81.14050197601318,3 +4619,0.3786868453025818,0.2780171036720276,0.2897815406322479,0.20000000298023224,595.7371826171875,1e-05,0.14246533811092377,2.842273712158203,81.14050197601318,3 +4620,0.29737645387649536,0.22417937219142914,0.2246669977903366,0.24755243957042694,838.6439208984375,1e-05,0.23488308489322662,3.054457902908325,81.14050197601318,3 +4621,0.3888322710990906,0.2187439352273941,0.23146142065525055,0.24289044737815857,835.7803955078125,1e-05,0.1934153288602829,3.1516666412353516,81.14050197601318,3 +4622,0.22203975915908813,0.3493756651878357,0.3520767390727997,0.16969697177410126,826.846923828125,1e-05,0.1313205063343048,3.3815693855285645,81.14050197601318,3 +4623,0.4600944221019745,0.30539751052856445,0.2989461123943329,0.12773892283439636,808.654296875,1e-05,0.1274041086435318,3.072453498840332,81.14050197601318,3 +4624,0.3216613233089447,0.33940038084983826,0.3340224623680115,0.1538461595773697,908.7275390625,1e-05,0.15382885932922363,3.162902593612671,81.14050197601318,3 +4625,0.18240085244178772,0.2797206938266754,0.2902238667011261,0.25034964084625244,992.0859375,1e-05,0.09105698019266129,2.832688570022583,81.14050197601318,3 +4626,0.381489098072052,0.1893809735774994,0.19922994077205658,0.20046620070934296,837.505126953125,1e-05,0.12114014476537704,3.0887351036071777,81.14050197601318,3 +4627,0.33684787154197693,0.3643270432949066,0.37024596333503723,0.24428904056549072,998.5840454101562,1e-05,0.12295342236757278,3.1187949180603027,81.14050197601318,3 +4628,0.3761214315891266,0.36081746220588684,0.3484838306903839,0.2030303031206131,956.9613647460938,1e-05,0.23009338974952698,3.203815221786499,81.14050197601318,3 +4629,0.3711914122104645,0.29096370935440063,0.2916986346244812,0.2543123662471771,769.3107299804688,1e-05,0.11913511157035828,3.0674400329589844,81.14050197601318,3 +4630,0.26155591011047363,0.3223020136356354,0.32264959812164307,0.16083915531635284,692.97265625,1e-05,0.14292220771312714,3.4318289756774902,81.14050197601318,3 +4631,0.2353881448507309,0.28172236680984497,0.2999321520328522,0.20489510893821716,989.5532836914062,1e-05,0.1554451286792755,3.1403450965881348,81.14050197601318,3 +4632,0.2457217127084732,0.342712938785553,0.33656612038612366,0.22004662454128265,919.7131958007812,1e-05,0.19787710905075073,2.844932794570923,81.14050197601318,3 +4633,0.2875022888183594,0.3153824806213379,0.3179227113723755,0.26759907603263855,974.5794677734375,1e-05,0.11364295333623886,3.171902656555176,81.14050197601318,4 +4634,0.44065535068511963,0.19785895943641663,0.21870818734169006,0.26363635063171387,748.2748413085938,1e-05,0.19331587851047516,3.2769131660461426,81.14050197601318,4 +4635,0.13509723544120789,0.2293083518743515,0.24039968848228455,0.23986013233661652,940.4759521484375,1e-05,0.10089961439371109,2.8448548316955566,81.14050197601318,4 +4636,0.2724097967147827,0.2672019600868225,0.26642170548439026,0.22191141545772552,886.226318359375,1e-05,0.23098468780517578,3.113135814666748,81.14050197601318,4 +4637,0.3333834707736969,0.3282945156097412,0.33627185225486755,0.20163169503211975,950.4097290039062,1e-05,0.15141969919204712,3.057251214981079,81.14050197601318,4 +4638,0.19771113991737366,0.1825745552778244,0.195071741938591,0.09137529134750366,613.9371337890625,1e-05,0.09777798503637314,2.837390184402466,81.14050197601318,4 +4639,0.2653667628765106,0.30048155784606934,0.3041153848171234,0.18531468510627747,732.1500854492188,1e-05,0.10666286945343018,3.100541830062866,81.14050197601318,4 +4640,0.2822703421115875,0.3697432279586792,0.3669443130493164,0.1694638729095459,996.8938598632812,1e-05,0.14822526276111603,3.333768606185913,81.14050197601318,4 +4641,0.32450249791145325,0.36570608615875244,0.3669895827770233,0.0139860138297081,988.5972900390625,1e-05,0.1481679379940033,2.8322083950042725,81.14050197601318,4 +4642,0.20136471092700958,0.31363973021507263,0.3143419921398163,0.22447551786899567,932.3563232421875,1e-05,0.18752257525920868,3.095996379852295,81.14050197601318,4 +4643,0.08666397631168365,0.22382277250289917,0.2365856170654297,0.2158508151769638,978.6064453125,1e-05,0.22687160968780518,3.1120221614837646,81.14050197601318,4 +4644,0.20881588757038116,0.2355492264032364,0.25093165040016174,0.2181818187236786,657.4439697265625,1e-05,0.10385091602802277,2.841449499130249,81.14050197601318,4 +4645,0.28816354274749756,0.2403249740600586,0.24828557670116425,0.17179487645626068,934.9658203125,1e-05,0.10359655320644379,3.142604112625122,81.14050197601318,4 +4646,0.33333417773246765,0.3531337082386017,0.35657450556755066,0.20396269857883453,960.1631469726562,1e-05,0.12220534682273865,2.8361878395080566,81.14050197601318,4 +4647,0.3506471514701843,0.21949675679206848,0.23543690145015717,0.17925408482551575,775.2649536132812,1e-05,0.12691153585910797,3.046811580657959,81.14050197601318,4 +4648,0.2851884067058563,0.31726178526878357,0.3356647789478302,0.21165500581264496,978.4493408203125,1e-05,0.1555037796497345,3.09546160697937,81.14050197601318,4 +4649,0.3639383018016815,0.37079912424087524,0.37265560030937195,0.2265734225511551,505.5683898925781,1e-05,0.10465851426124573,3.14729642868042,81.14050197601318,4 +4650,0.3003484010696411,0.30905401706695557,0.30600249767303467,0.19440560042858124,810.0248413085938,1e-05,0.1660173237323761,2.830916404724121,81.14050197601318,4 +4651,0.28881603479385376,0.2016696333885193,0.21085140109062195,0.19790209829807281,867.7844848632812,1e-05,0.2010684460401535,3.4110777378082275,81.14050197601318,4 +4652,0.27243825793266296,0.19424214959144592,0.20844891667366028,0.16363635659217834,580.2335815429688,1e-05,0.11414492130279541,3.0170764923095703,81.14050197601318,4 +4653,0.5016657114028931,0.32534685730934143,0.3265528976917267,0.12121211737394333,712.31884765625,1e-05,0.2696370482444763,3.0835888385772705,81.14050197601318,4 +4654,0.27593669295310974,0.4367896020412445,0.449575811624527,0.2566433548927307,995.7847900390625,1e-05,0.10832352936267853,3.092322587966919,81.14050197601318,4 +4655,0.1930169016122818,0.37051984667778015,0.37620866298675537,0.16433566808700562,961.5278930664062,1e-05,0.09399309754371643,3.0495681762695312,81.14050197601318,4 +4656,0.29392892122268677,0.3174554705619812,0.32206466794013977,0.24871794879436493,622.5833740234375,1e-05,0.14850692451000214,2.8176639080047607,81.14050197601318,4 +4657,0.24283592402935028,0.1692751795053482,0.20272843539714813,0.25757575035095215,924.6715087890625,1e-05,0.1131022721529007,3.3242483139038086,81.14050197601318,4 +4658,0.32828083634376526,0.28774887323379517,0.29239320755004883,0.2242424190044403,792.0157470703125,1e-05,0.10791415721178055,3.035828113555908,81.14050197601318,4 +4659,0.21167108416557312,0.26830539107322693,0.2907775044441223,0.22960372269153595,327.6654357910156,1e-05,0.1313752830028534,3.0884885787963867,81.14050197601318,4 +4660,0.4318183958530426,0.6485132575035095,0.6551117300987244,0.18881118297576904,113.7176742553711,1e-05,0.2541731297969818,3.0306761264801025,81.14050197601318,4 +4661,0.3329385817050934,0.25429099798202515,0.2621619999408722,0.16526806354522705,951.4989624023438,1e-05,0.12098973244428635,3.0843734741210938,81.14050197601318,4 +4662,0.19855016469955444,0.4746527671813965,0.4546898305416107,0.18578088283538818,977.9759521484375,1e-05,0.17394976317882538,3.1336276531219482,81.14050197601318,4 +4663,0.3272031843662262,0.21434366703033447,0.23788173496723175,0.24195803701877594,861.1730346679688,1e-05,0.15510328114032745,3.0629987716674805,81.14050197601318,4 +4664,0.28189364075660706,0.314238578081131,0.328043133020401,0.250582754611969,998.5840454101562,1e-05,0.16521109640598297,3.0173799991607666,81.14050197601318,4 +4665,0.24093195796012878,0.3008344769477844,0.31913214921951294,0.15198135375976562,990.228515625,1e-05,0.1107354611158371,3.136597156524658,81.14050197601318,4 +4666,0.14744308590888977,0.16151754558086395,0.18951009213924408,0.22797203063964844,890.15478515625,1e-05,0.13199737668037415,3.100369453430176,81.14050197601318,4 +4667,0.2667996883392334,0.3017273247241974,0.30797648429870605,0.19440560042858124,974.5794677734375,1e-05,0.15963058173656464,2.8365304470062256,81.14050197601318,4 +4668,0.2884129285812378,0.373386949300766,0.38613206148147583,0.1958041936159134,323.4160461425781,1e-05,0.13044147193431854,3.156277656555176,81.14050197601318,4 +4669,0.22312197089195251,0.304339200258255,0.2879970967769623,0.2321678251028061,986.787841796875,1e-05,0.11149589717388153,3.048929452896118,81.14050197601318,4 +4670,0.19987447559833527,0.19203606247901917,0.19203606247901917,0.0,828.6761474609375,1e-05,0.11545219272375107,3.052853584289551,81.14050197601318,4 +4671,0.3833045959472656,0.27665916085243225,0.27024614810943604,0.2097902148962021,625.9617919921875,1e-05,0.29037541151046753,3.280355930328369,81.14050197601318,4 +4672,0.37666255235671997,0.32518693804740906,0.3288365602493286,0.13449883460998535,981.9857788085938,1e-05,0.13422347605228424,3.0676841735839844,81.14050197601318,4 +4673,0.17287461459636688,0.27790358662605286,0.2886929214000702,0.21911421418190002,821.2252807617188,1e-05,0.15501168370246887,2.8256912231445312,81.14050197601318,4 +4674,0.4107154309749603,0.2280605584383011,0.22980253398418427,0.1890442818403244,624.2781982421875,1e-05,0.1457533836364746,3.6102981567382812,81.14050197601318,4 +4675,0.32311680912971497,0.4234897196292877,0.41222086548805237,0.21398600935935974,967.5030517578125,1e-05,0.12322204560041428,2.836317777633667,81.14050197601318,4 +4676,0.22790196537971497,0.38833174109458923,0.37210285663604736,0.2454545497894287,987.2093505859375,1e-05,1.0128332376480103,3.0935871601104736,81.14050197601318,4 +4677,0.18939584493637085,0.3520587682723999,0.3565948009490967,0.22004662454128265,988.5972900390625,1e-05,0.12431792169809341,3.361584186553955,81.14050197601318,4 +4678,0.27031219005584717,0.24066172540187836,0.24510914087295532,0.1678321659564972,947.2893676757812,1e-05,0.24100160598754883,3.1226136684417725,81.14050197601318,4 +4679,0.2839633524417877,0.1881793588399887,0.20255494117736816,0.2321678251028061,834.6194458007812,1e-05,0.11182161420583725,2.8313591480255127,81.14050197601318,4 +4680,0.25052332878112793,0.2334107607603073,0.25078117847442627,0.23519814014434814,527.8575439453125,1e-05,0.10807252675294876,3.4800634384155273,81.14050197601318,4 +4681,0.24169205129146576,0.17280064523220062,0.1878708153963089,0.12447552382946014,907.39990234375,1e-05,0.11905200034379959,3.0570836067199707,81.14050197601318,4 +4682,0.43007203936576843,0.3133641183376312,0.3302822411060333,0.22494173049926758,980.7741088867188,1e-05,0.11818182468414307,3.0694475173950195,81.14050197601318,4 +4683,0.4178965091705322,0.2662956416606903,0.26393064856529236,0.24731934070587158,785.822265625,1e-05,0.08452389389276505,3.103724479675293,81.14050197601318,4 +4684,0.1852838397026062,0.31274622678756714,0.32140448689460754,0.13939394056797028,999.2957763671875,1e-05,0.12936565279960632,3.16314959526062,81.14050197601318,4 +4685,0.10151086002588272,0.23868466913700104,0.2668311893939972,0.20606060326099396,997.259521484375,1e-05,0.1414564698934555,2.8397154808044434,81.14050197601318,4 +4686,0.31836846470832825,0.17551657557487488,0.19415396451950073,0.25034964084625244,797.257080078125,1e-05,0.15460708737373352,3.433683156967163,81.14050197601318,4 +4687,0.23159077763557434,0.2581636309623718,0.2616886794567108,0.2393939346075058,883.8079833984375,1e-05,0.10088088363409042,3.0513815879821777,81.14050197601318,4 +4688,0.18968236446380615,0.2326442450284958,0.24623209238052368,0.22191141545772552,879.6704711914062,1e-05,0.13886788487434387,3.103184223175049,81.14050197601318,4 +4689,0.24450354278087616,0.29440033435821533,0.3127487599849701,0.2254079282283783,983.767822265625,1e-05,0.12113570421934128,3.0776453018188477,81.14050197601318,4 +4690,0.3306773900985718,0.33612900972366333,0.342975914478302,0.22913752496242523,534.9400024414062,1e-05,0.6222125291824341,3.055867910385132,81.14050197601318,4 +4691,0.36190369725227356,0.3419664204120636,0.3325345516204834,0.18927739560604095,928.31103515625,1e-05,0.11867231130599976,3.132983446121216,81.14050197601318,4 +4692,0.2486068159341812,0.25315240025520325,0.25987160205841064,0.0923076942563057,972.7406005859375,1e-05,0.11958327144384384,3.380446434020996,81.14050197601318,4 +4693,0.20312418043613434,0.21475103497505188,0.22857743501663208,0.21771562099456787,955.7301025390625,1e-05,0.12206987291574478,3.121446371078491,81.14050197601318,4 +4694,0.5090814828872681,0.24899503588676453,0.257648229598999,0.23030303418636322,810.7058715820312,1e-05,0.1664697378873825,3.092074394226074,81.14050197601318,4 +4695,0.3070652484893799,0.3584930896759033,0.370667040348053,0.2510489523410797,812.7318115234375,1e-05,0.13627293705940247,3.0826597213745117,81.14050197601318,4 +4696,0.357378751039505,0.2872368395328522,0.28449469804763794,0.1806526780128479,922.657958984375,1e-05,0.16714172065258026,3.0948386192321777,81.14050197601318,4 +4697,0.30247923731803894,0.2352178543806076,0.24869228899478912,0.19510489702224731,858.7315673828125,1e-05,0.11356446892023087,3.1320459842681885,81.14050197601318,4 +4698,0.12503239512443542,0.20915664732456207,0.23027867078781128,0.16247086226940155,972.9094848632812,1e-05,0.10384076088666916,3.11734676361084,81.14050197601318,4 +4699,0.2184189110994339,0.37049123644828796,0.3768985867500305,0.20000000298023224,948.6395874023438,1e-05,0.10691297054290771,3.1262834072113037,81.14050197601318,4 +4700,0.2988928556442261,0.23504112660884857,0.2672935426235199,0.24289044737815857,995.7847900390625,1e-05,0.12019483745098114,3.230942726135254,81.14050197601318,4 +4701,0.2935878038406372,0.36726900935173035,0.38474446535110474,0.15128205716609955,243.64947509765625,1e-05,0.13506115972995758,3.0527093410491943,81.14050197601318,4 +4702,0.39455410838127136,0.3358146846294403,0.3415693938732147,0.19557109475135803,525.4592895507812,1e-05,0.13650290668010712,2.831216812133789,81.14050197601318,4 +4703,0.10539610683917999,0.20762547850608826,0.2223721146583557,0.274125874042511,842.5615844726562,1e-05,0.13026554882526398,3.103207588195801,81.14050197601318,4 +4704,0.3959060311317444,0.45735588669776917,0.4862518012523651,0.2421911358833313,171.19692993164062,1e-05,0.10836469382047653,3.4019105434417725,81.14050197601318,4 +4705,0.36653783917427063,0.3152953088283539,0.32395267486572266,0.2230769246816635,839.7739868164062,1e-05,0.13395507633686066,3.132845401763916,81.14050197601318,4 +4706,0.34233301877975464,0.2552163600921631,0.2664145231246948,0.20629370212554932,806.5763549804688,1e-05,0.11250509321689606,3.2987329959869385,81.14050197601318,4 +4707,0.30995994806289673,0.3279586732387543,0.3304795026779175,0.2254079282283783,470.316650390625,1e-05,0.09951142221689224,3.04563570022583,81.14050197601318,4 +4708,0.1894688457250595,0.22439585626125336,0.2378646433353424,0.2321678251028061,965.6807250976562,1e-05,0.27785179018974304,2.8421030044555664,81.14050197601318,4 +4709,0.4044787883758545,0.3693327009677887,0.37358444929122925,0.16643357276916504,510.6620178222656,1e-05,0.1898103654384613,3.133406639099121,81.14050197601318,4 +4710,0.268051415681839,0.32795000076293945,0.3145769238471985,0.18531468510627747,874.521484375,1e-05,0.11621315777301788,3.1174514293670654,81.14050197601318,4 +4711,0.3444729745388031,0.23906156420707703,0.23942674696445465,0.2321678251028061,949.0853271484375,1e-05,0.10542258620262146,3.32377552986145,81.14050197601318,4 +4712,0.29386502504348755,0.27565380930900574,0.28004881739616394,0.07855477929115295,687.85546875,1e-05,0.11164508014917374,3.0611934661865234,81.14050197601318,4 +4713,0.23283328115940094,0.27730849385261536,0.2838381230831146,0.20372959971427917,873.2015991210938,1e-05,0.19496089220046997,3.0711758136749268,81.14050197601318,4 +4714,0.19888651371002197,0.2397623211145401,0.250769704580307,0.23752914369106293,742.382080078125,1e-05,0.12353840470314026,2.8399782180786133,81.14050197601318,4 +4715,0.328800767660141,0.2428370714187622,0.2501574754714966,0.21445220708847046,990.0938720703125,1e-05,0.10871817171573639,3.0964183807373047,81.14050197601318,4 +4716,0.23114579916000366,0.2078324854373932,0.22338679432868958,0.27202796936035156,867.7844848632812,1e-05,0.12607580423355103,3.122194528579712,81.14050197601318,4 +4717,0.2646682560443878,0.28158146142959595,0.2848767936229706,0.17482517659664154,869.15966796875,1e-05,0.12458130717277527,3.3510382175445557,81.14050197601318,4 +4718,0.2867335379123688,0.46055641770362854,0.43891939520835876,0.1930069923400879,997.1378173828125,1e-05,0.13020987808704376,3.0956385135650635,81.14050197601318,4 +4719,0.3610245883464813,0.2889042794704437,0.2870821952819824,0.22051282227039337,673.1508178710938,1e-05,0.12097649276256561,3.1386566162109375,81.14050197601318,4 +4720,0.38553252816200256,0.1921505331993103,0.20752839744091034,0.11771561950445175,606.806884765625,1e-05,0.1474464386701584,2.8353283405303955,81.14050197601318,4 +4721,0.3247380554676056,0.3624233603477478,0.34677526354789734,0.14965035021305084,945.68896484375,1e-05,0.10974907875061035,3.2994017601013184,81.14050197601318,4 +4722,0.28814616799354553,0.34155023097991943,0.3390240967273712,0.253846138715744,972.4016723632812,1e-05,0.15497718751430511,3.321458578109741,81.14050197601318,4 +4723,0.2278909683227539,0.2618139088153839,0.2683930993080139,0.12191142141819,898.37353515625,1e-05,0.17300917208194733,3.1301045417785645,81.14050197601318,4 +4724,0.3554959297180176,0.16618943214416504,0.18784023821353912,0.2270396202802658,785.0322875976562,1e-05,0.23851191997528076,3.0812973976135254,81.14050197601318,4 +4725,0.25310230255126953,0.2679992616176605,0.2769005298614502,0.2114219069480896,940.4759521484375,1e-05,0.14281335473060608,3.1257901191711426,81.14050197601318,4 +4726,0.26453712582588196,0.2879459261894226,0.30223071575164795,0.15757575631141663,443.50128173828125,1e-05,0.20242121815681458,3.091451406478882,81.14050197601318,4 +4727,0.22915560007095337,0.18323586881160736,0.21869467198848724,0.21678321063518524,988.0452880859375,1e-05,0.15990854799747467,3.0286288261413574,81.14050197601318,4 +4728,0.2966462969779968,0.2368936687707901,0.24410104751586914,0.23006993532180786,608.6077880859375,1e-05,0.1922525316476822,3.3210244178771973,81.14050197601318,4 +4729,0.25577303767204285,0.28348711133003235,0.28746604919433594,0.15780885517597198,994.27783203125,1e-05,0.3032800853252411,3.104128837585449,81.14050197601318,4 +4730,0.44277268648147583,0.31692737340927124,0.31692737340927124,0.0,336.031982421875,1e-05,0.11749404668807983,2.8370566368103027,81.14050197601318,4 +4731,0.35014188289642334,0.294983834028244,0.32946595549583435,0.16573426127433777,327.6654357910156,1e-05,0.12377472221851349,3.0698838233947754,81.14050197601318,4 +4732,0.16833099722862244,0.24061326682567596,0.2657619118690491,0.16433566808700562,966.414306640625,1e-05,0.5217934250831604,3.107792377471924,81.14050197601318,4 +4733,0.2336292564868927,0.4179634749889374,0.39768680930137634,0.23030303418636322,988.734619140625,1e-05,0.09725135564804077,3.043076276779175,81.14050197601318,4 +4734,0.1887357383966446,0.24318383634090424,0.2479579746723175,0.08205128461122513,946.1489868164062,1e-05,0.12343361228704453,3.332188606262207,81.14050197601318,4 +4735,0.22897760570049286,0.2612017095088959,0.2743048667907715,0.20396269857883453,995.035400390625,1e-05,0.23453682661056519,3.3755698204040527,81.14050197601318,4 +4736,0.38953688740730286,0.31285446882247925,0.3418283462524414,0.2489510476589203,959.3736572265625,1e-05,0.11020015180110931,2.8333818912506104,81.14050197601318,4 +4737,0.22460870444774628,0.306704044342041,0.318077951669693,0.2421911358833313,920.9009399414062,1e-05,0.11296785622835159,3.140537738800049,81.14050197601318,4 +4738,0.2628743648529053,0.2719026505947113,0.2769901156425476,0.14685314893722534,939.9876098632812,1e-05,0.09510168433189392,3.288536548614502,81.14050197601318,4 +4739,0.25887030363082886,0.3545840084552765,0.3575541079044342,0.28601399064064026,921.48974609375,1e-05,0.1361633837223053,3.0609025955200195,81.14050197601318,4 +4740,0.2615279257297516,0.21174854040145874,0.23234957456588745,0.19114218652248383,834.0355224609375,1e-05,0.11917129158973694,3.3510582447052,81.14050197601318,4 +4741,0.1620301753282547,0.38233062624931335,0.3801581859588623,0.23193472623825073,994.7838134765625,1e-05,0.14029164612293243,3.3248305320739746,81.14050197601318,4 +4742,0.27376967668533325,0.334182471036911,0.34233927726745605,0.22121211886405945,975.4014282226562,1e-05,0.513475239276886,2.8223180770874023,81.14050197601318,4 +4743,0.22661373019218445,0.42238399386405945,0.41689327359199524,0.225874125957489,973.748779296875,1e-05,0.11691558361053467,3.1445391178131104,81.14050197601318,4 +4744,0.2448001205921173,0.3306339383125305,0.33180275559425354,0.20839160680770874,550.8392333984375,1e-05,0.20670945942401886,3.1320438385009766,81.14050197601318,4 +4745,0.24685893952846527,0.2925591468811035,0.29665395617485046,0.2554778456687927,955.10791015625,1e-05,0.11402440816164017,3.088587522506714,81.14050197601318,4 +4746,0.246058389544487,0.2990872263908386,0.300432413816452,0.23240093886852264,599.4783325195312,1e-05,0.1452137976884842,3.063946485519409,81.14050197601318,4 +4747,0.24130204319953918,0.27471494674682617,0.27809134125709534,0.2030303031206131,936.7528076171875,1e-05,0.1480315625667572,3.1091699600219727,81.14050197601318,4 +4748,0.437656044960022,0.5340666174888611,0.5576417446136475,0.20163169503211975,200.4163818359375,1e-05,0.14915454387664795,3.0407931804656982,81.14050197601318,4 +4749,0.3479715585708618,0.2425934076309204,0.25720709562301636,0.21934731304645538,962.2981567382812,1e-05,0.11176353693008423,2.8363852500915527,81.14050197601318,4 +4750,0.25959688425064087,0.19644573330879211,0.2115257978439331,0.19813519716262817,720.25927734375,1e-05,0.1394958347082138,3.1035141944885254,81.14050197601318,4 +4751,0.30089783668518066,0.254117488861084,0.25331032276153564,0.11701631546020508,753.992919921875,1e-05,0.21164526045322418,3.1067779064178467,81.14050197601318,4 +4752,0.3232216536998749,0.28391319513320923,0.28700289130210876,0.12657342851161957,582.22021484375,1e-05,0.15307705104351044,3.281630039215088,81.14050197601318,4 +4753,0.468006432056427,0.34702810645103455,0.3565012514591217,0.22517482936382294,747.3050537109375,1e-05,0.138387992978096,3.299266815185547,81.14050197601318,4 +4754,0.2520486116409302,0.2063349336385727,0.21764767169952393,0.151048943400383,869.15966796875,1e-05,0.26414451003074646,3.0684924125671387,81.14050197601318,4 +4755,0.15514050424098969,0.34073951840400696,0.3419184982776642,0.1566433608531952,956.3478393554688,1e-05,0.13208775222301483,2.824993848800659,81.14050197601318,4 +4756,0.32895076274871826,0.2858045995235443,0.28524190187454224,0.23962703347206116,846.3767700195312,1e-05,0.1334332972764969,3.150376319885254,81.14050197601318,4 +4757,0.2747128903865814,0.26702234148979187,0.2737089991569519,0.13076922297477722,977.1804809570312,1e-05,0.11864540725946426,3.2232658863067627,81.14050197601318,4 +4758,0.3154808580875397,0.2797807455062866,0.2837623655796051,0.18391607701778412,962.4896240234375,1e-05,0.12410284578800201,3.2820897102355957,81.14050197601318,4 +4759,0.29762837290763855,0.2976357340812683,0.3000238239765167,0.20815850794315338,892.0726318359375,1e-05,0.11315502226352692,3.0763845443725586,81.14050197601318,4 +4760,0.2974238395690918,0.3205668330192566,0.32083696126937866,0.20536130666732788,953.4276123046875,1e-05,0.14898158609867096,3.062309741973877,81.14050197601318,4 +4761,0.31008458137512207,0.17881537973880768,0.18734686076641083,0.10979020595550537,885.4254760742188,1e-05,0.12006931751966476,2.828913927078247,81.14050197601318,4 +4762,0.14010615646839142,0.22086934745311737,0.2331780046224594,0.22960372269153595,797.99267578125,1e-05,0.10324706882238388,2.8329076766967773,81.14050197601318,4 +4763,0.3319321870803833,0.3413850665092468,0.33710968494415283,0.1818181872367859,778.5809936523438,1e-05,0.15448954701423645,3.2704343795776367,81.14050197601318,4 +4764,0.19770994782447815,0.36906129121780396,0.3678954541683197,0.1818181872367859,980.1610107421875,1e-05,0.1708839237689972,3.0642192363739014,81.14050197601318,4 +4765,0.3139224648475647,0.1883792281150818,0.2039913535118103,0.2242424190044403,823.7489624023438,1e-05,0.12351607531309128,3.1050076484680176,81.14050197601318,4 +4766,0.3244965076446533,0.25332942605018616,0.2668168544769287,0.21282051503658295,851.1375732421875,1e-05,0.0952378585934639,3.1155598163604736,81.14050197601318,4 +4767,0.27116721868515015,0.29347342252731323,0.3082604706287384,0.19696970283985138,997.9851684570312,1e-05,0.12124047428369522,3.1300995349884033,81.14050197601318,4 +4768,0.2912672162055969,0.18407317996025085,0.20121583342552185,0.20000000298023224,861.1730346679688,1e-05,0.09816722571849823,2.8415567874908447,81.14050197601318,4 +4769,0.34316590428352356,0.250505268573761,0.264706015586853,0.23030303418636322,916.991943359375,1e-05,0.1684175729751587,3.079017400741577,81.14050197601318,4 +4770,0.10802659392356873,0.2524482309818268,0.2563496530056,0.2433566451072693,917.9066772460938,1e-05,0.09226828813552856,3.10166597366333,81.14050197601318,4 +4771,0.26972171664237976,0.24771705269813538,0.25108686089515686,0.13286712765693665,926.0864868164062,1e-05,0.11279886215925217,2.8360793590545654,81.14050197601318,4 +4772,0.4174101650714874,0.283243328332901,0.2972524166107178,0.22843822836875916,478.7982177734375,1e-05,0.12356140464544296,3.1141581535339355,81.14050197601318,4 +4773,0.37053266167640686,0.2207285761833191,0.23406729102134705,0.1650349646806717,917.9066772460938,1e-05,0.09949914366006851,3.1347289085388184,81.14050197601318,4 +4774,0.26146212220191956,0.32631716132164,0.326445996761322,0.20606060326099396,936.7528076171875,1e-05,0.3820716142654419,3.012449026107788,81.14050197601318,4 +4775,0.4174027144908905,0.2560456097126007,0.2630448341369629,0.20536130666732788,835.2010498046875,1e-05,0.11889957636594772,3.2772140502929688,81.14050197601318,4 +4776,0.4099327027797699,0.271005243062973,0.2647065818309784,0.2242424190044403,601.3294677734375,1e-05,0.1682095229625702,3.3269152641296387,81.14050197601318,4 +4777,0.1608312427997589,0.3726619780063629,0.37453246116638184,0.20372959971427917,973.748779296875,1e-05,0.16795587539672852,3.066897392272949,81.14050197601318,4 +4778,0.2772127091884613,0.22609181702136993,0.23602525889873505,0.11748252063989639,945.226806640625,1e-05,0.12321150302886963,2.828141450881958,81.14050197601318,4 +4779,0.13609325885772705,0.35791337490081787,0.3502337336540222,0.20326340198516846,970.6856079101562,1e-05,0.0963592529296875,3.0865824222564697,81.14050197601318,4 +4780,0.3534131944179535,0.25300315022468567,0.2579071819782257,0.12727272510528564,830.4837646484375,1e-05,0.1545490026473999,3.0388429164886475,81.14050197601318,4 +4781,0.21496663987636566,0.19680197536945343,0.2011396884918213,0.23006993532180786,887.0220336914062,1e-05,0.08602462708950043,3.0737504959106445,81.14050197601318,4 +4782,0.2729358375072479,0.2550806403160095,0.2506171762943268,0.10839160531759262,807.9645385742188,1e-05,0.16429510712623596,3.3062078952789307,81.14050197601318,4 +4783,0.27361929416656494,0.2662161588668823,0.288222074508667,0.2596736550331116,458.6604309082031,1e-05,0.17465177178382874,3.0910186767578125,81.14050197601318,4 +4784,0.3801249861717224,0.4098373353481293,0.41798684000968933,0.19510489702224731,992.0859375,1e-05,0.16374842822551727,2.8199634552001953,81.14050197601318,4 +4785,0.42252427339553833,0.2806076109409332,0.2878347635269165,0.13799533247947693,637.4429931640625,1e-05,0.17532667517662048,3.127932071685791,81.14050197601318,4 +4786,0.4160734713077545,0.2953258454799652,0.31208330392837524,0.24568764865398407,430.87518310546875,1e-05,0.11967020481824875,3.008695125579834,81.14050197601318,4 +4787,0.2897372543811798,0.26509708166122437,0.2720586359500885,0.23030303418636322,580.2335815429688,1e-05,0.12515893578529358,3.316380500793457,81.14050197601318,4 +4788,0.2320227473974228,0.23710282146930695,0.24469566345214844,0.1818181872367859,578.2326049804688,1e-05,0.23688513040542603,3.102961540222168,81.14050197601318,4 +4789,0.19117537140846252,0.31240907311439514,0.3142036199569702,0.26759907603263855,467.44049072265625,1e-05,0.13252027332782745,3.0791053771972656,81.14050197601318,4 +4790,0.4581010639667511,0.17441628873348236,0.19145308434963226,0.17482517659664154,752.1058349609375,1e-05,0.12206178903579712,3.109783411026001,81.14050197601318,4 +4791,0.3053869307041168,0.29757562279701233,0.30931779742240906,0.17249417304992676,651.463623046875,1e-05,0.2418002188205719,2.841836452484131,81.14050197601318,4 +4792,0.32912251353263855,0.28923356533050537,0.2978683412075043,0.15244755148887634,404.18499755859375,1e-05,0.10984917730093002,3.3252365589141846,81.14050197601318,4 +4793,0.29317742586135864,0.1745690554380417,0.19517822563648224,0.13449883460998535,965.4962768554688,1e-05,0.10676377266645432,3.256655216217041,81.14050197601318,4 +4794,0.2087460607290268,0.2521674633026123,0.26617422699928284,0.24918414652347565,836.3575439453125,1e-05,0.11210829764604568,3.3073012828826904,81.14050197601318,4 +4795,0.2513628602027893,0.5238944292068481,0.5231416821479797,0.1902097910642624,981.6846923828125,1e-05,0.11556791514158249,3.1251978874206543,81.14050197601318,4 +4796,0.23484310507774353,0.2363554686307907,0.24164146184921265,0.14079253375530243,832.8609008789062,1e-05,0.11764506250619888,3.1280152797698975,81.14050197601318,4 +4797,0.15956595540046692,0.22564548254013062,0.2344053089618683,0.19930069148540497,895.0792846679688,1e-05,0.11791422218084335,2.8383443355560303,81.14050197601318,4 +4798,0.27542784810066223,0.28379806876182556,0.28607887029647827,0.2482517510652542,961.9138793945312,1e-05,0.14704157412052155,3.3705475330352783,81.14050197601318,4 +4799,0.2031795233488083,0.3173787295818329,0.3209588825702667,0.2097902148962021,851.6567993164062,1e-05,0.0901661366224289,3.3044066429138184,81.14050197601318,4 +4800,0.21828030049800873,0.32552221417427063,0.33282405138015747,0.2337995320558548,972.5713500976562,1e-05,0.11496154218912125,3.377150535583496,81.14050197601318,4 +4801,0.2049282193183899,0.2764103412628174,0.28008130192756653,0.22004662454128265,914.8272094726562,1e-05,0.1654970794916153,2.8340749740600586,81.14050197601318,4 +4802,0.3014522194862366,0.3361714482307434,0.3385796844959259,0.16083915531635284,916.991943359375,1e-05,0.21816909313201904,3.1382012367248535,81.14050197601318,4 +4803,0.2728777527809143,0.3301934003829956,0.32478517293930054,0.22913752496242523,651.463623046875,1e-05,0.11454814672470093,3.0272068977355957,81.14050197601318,4 +4804,0.25720882415771484,0.24251605570316315,0.2518766224384308,0.12727272510528564,761.3585205078125,1e-05,0.12614652514457703,3.073317766189575,81.14050197601318,4 +4805,0.23132240772247314,0.2740214467048645,0.284921795129776,0.23123542964458466,920.605224609375,1e-05,0.09469132870435715,3.0942437648773193,81.14050197601318,4 +4806,0.19138754904270172,0.3305058181285858,0.33826327323913574,0.2829836905002594,966.2316284179688,1e-05,0.08860265463590622,3.3375370502471924,81.14050197601318,4 +4807,0.17133226990699768,0.2756844162940979,0.2769554853439331,0.10932400822639465,816.0525512695312,1e-05,0.1304943859577179,2.846383810043335,81.14050197601318,4 +4808,0.3152709901332855,0.4437701106071472,0.4295116364955902,0.2270396202802658,999.6487426757812,1e-05,0.16571348905563354,3.3450798988342285,81.14050197601318,4 +4809,0.13859932124614716,0.28683653473854065,0.27673831582069397,0.2114219069480896,946.378173828125,1e-05,0.1457982212305069,3.0303680896759033,81.14050197601318,4 +4810,0.23421387374401093,0.353445440530777,0.3488992750644684,0.16083915531635284,996.5260620117188,1e-05,0.14493820071220398,3.2859208583831787,81.14050197601318,4 +4811,0.3330194056034088,0.25153928995132446,0.26339346170425415,0.24428904056549072,696.7341918945312,1e-05,0.11692451685667038,3.362762689590454,81.14050197601318,4 +4812,0.37647387385368347,0.3783668875694275,0.37853842973709106,0.06969697028398514,375.388671875,1e-05,0.12590032815933228,3.286241292953491,81.14050197601318,4 +4813,0.34689104557037354,0.2658558487892151,0.27952080965042114,0.2421911358833313,774.4262084960938,1e-05,0.12226811796426773,2.8330211639404297,81.14050197601318,4 +4814,0.3564380407333374,0.2778207063674927,0.281830370426178,0.23799534142017365,805.1764526367188,1e-05,0.19159284234046936,3.1009159088134766,81.14050197601318,4 +4815,0.15020376443862915,0.38598042726516724,0.3904692530632019,0.19230769574642181,984.4981079101562,1e-05,0.11125509440898895,3.11902117729187,81.14050197601318,4 +4816,0.310955673456192,0.30877164006233215,0.32105356454849243,0.19114218652248383,858.2379760742188,1e-05,0.18885429203510284,3.075957775115967,81.14050197601318,4 +4817,0.2550502121448517,0.2952979803085327,0.30790287256240845,0.16853146255016327,980.1610107421875,1e-05,0.11041232198476791,3.119832754135132,81.14050197601318,4 +4818,0.24085286259651184,0.3284114897251129,0.3206033706665039,0.21002331376075745,940.7190551757812,1e-05,0.16314597427845,3.3664770126342773,81.14050197601318,4 +4819,0.259294331073761,0.37835344672203064,0.38953259587287903,0.18111887574195862,987.7676391601562,1e-05,0.09339267760515213,2.8337607383728027,81.14050197601318,4 +4820,0.17433448135852814,0.194208025932312,0.21398307383060455,0.23869463801383972,823.121826171875,1e-05,0.1243298351764679,3.132453680038452,81.14050197601318,4 +4821,0.33980458974838257,0.3238823711872101,0.34755945205688477,0.17179487645626068,510.6620178222656,1e-05,0.13219225406646729,3.0841197967529297,81.14050197601318,4 +4822,0.1834884136915207,0.19538147747516632,0.21710534393787384,0.2780885696411133,938.2591552734375,1e-05,0.10715792328119278,3.0602669715881348,81.14050197601318,4 +4823,0.1631789356470108,0.29231783747673035,0.30122560262680054,0.2041957974433899,849.041259765625,1e-05,0.11232771724462509,3.130894422531128,81.14050197601318,4 +4824,0.2812649607658386,0.3245002031326294,0.3182625472545624,0.2097902148962021,835.2010498046875,1e-05,0.13352112472057343,3.065312147140503,81.14050197601318,4 +4825,0.3616458773612976,0.31344902515411377,0.3065149784088135,0.16130536794662476,620.8772583007812,1e-05,0.12004499137401581,3.287344455718994,81.14050197601318,4 +4826,0.3910033106803894,0.3624483644962311,0.36507728695869446,0.2097902148962021,414.4279479980469,1e-05,0.10320781171321869,2.8302483558654785,81.14050197601318,4 +4827,0.5311757922172546,0.6389243602752686,0.6533300280570984,0.2501165568828583,133.62509155273438,1e-05,0.17158715426921844,3.369770050048828,81.14050197601318,4 +4828,0.2571341395378113,0.3488377034664154,0.3430512249469757,0.15734265744686127,909.3855590820312,1e-05,0.15529948472976685,3.3291776180267334,81.14050197601318,4 +4829,0.18750523030757904,0.2851946949958801,0.2936927080154419,0.17435897886753082,976.0529174804688,1e-05,0.11638890951871872,3.1128082275390625,81.14050197601318,4 +4830,0.27897974848747253,0.19261834025382996,0.21500642597675323,0.1818181872367859,731.0974731445312,1e-05,0.26780980825424194,3.1112990379333496,81.14050197601318,4 +4831,0.17241597175598145,0.26582562923431396,0.2658518850803375,0.2041957974433899,889.7675170898438,1e-05,0.1113186627626419,3.2684409618377686,81.14050197601318,4 +4832,0.28779974579811096,0.34218716621398926,0.35014447569847107,0.23030303418636322,960.7506713867188,1e-05,0.17767636477947235,2.8297390937805176,81.14050197601318,4 +4833,0.21275962889194489,0.3579827547073364,0.3540157973766327,0.2708624601364136,956.3478393554688,1e-05,0.12450987845659256,3.3268988132476807,81.14050197601318,4 +4834,0.23432523012161255,0.2396683394908905,0.2601148784160614,0.23986013233661652,424.38739013671875,1e-05,0.1136467307806015,3.30157732963562,81.14050197601318,4 +4835,0.3510545790195465,0.37420207262039185,0.3851012885570526,0.16480186581611633,475.9952392578125,1e-05,0.14945055544376373,3.3072993755340576,81.14050197601318,4 +4836,0.35311880707740784,0.26445838809013367,0.27641528844833374,0.2041957974433899,610.396240234375,1e-05,0.13167604804039001,2.8441662788391113,81.14050197601318,4 +4837,0.28384700417518616,0.29191523790359497,0.2932996153831482,0.250582754611969,873.64306640625,1e-05,0.14425551891326904,2.8538615703582764,81.14050197601318,4 +4838,0.3753421902656555,0.3051891624927521,0.30779680609703064,0.20000000298023224,907.39990234375,1e-05,0.131868377327919,2.8412728309631348,81.14050197601318,4 +4839,0.4304516911506653,0.26029306650161743,0.2750471532344818,0.16969697177410126,681.2896118164062,1e-05,0.10273953527212143,3.1261062622070312,81.14050197601318,4 +4840,0.31057342886924744,0.24117805063724518,0.2579153776168823,0.11118881404399872,941.685791015625,1e-05,0.12350080907344818,3.1180152893066406,81.14050197601318,4 +4841,0.18812936544418335,0.2371342033147812,0.24681684374809265,0.23613053560256958,944.7620849609375,1e-05,0.12851987779140472,3.2927181720733643,81.14050197601318,4 +4842,0.3779310882091522,0.3595742881298065,0.35806745290756226,0.1878787875175476,785.822265625,1e-05,0.09155747294425964,2.8348779678344727,81.14050197601318,4 +4843,0.3820103108882904,0.3492773473262787,0.3511808514595032,0.21212121844291687,610.396240234375,1e-05,0.13173718750476837,3.1188416481018066,81.14050197601318,4 +4844,0.3401683270931244,0.204263374209404,0.22237519919872284,0.2265734225511551,700.4320068359375,1e-05,0.11527987569570541,3.05810284614563,81.14050197601318,4 +4845,0.21967868506908417,0.2299657166004181,0.2448776513338089,0.23892773687839508,983.178466796875,1e-05,0.1300463229417801,3.050854206085205,81.14050197601318,4 +4846,0.18793800473213196,0.25922536849975586,0.2604173719882965,0.17156177759170532,712.31884765625,1e-05,0.118415467441082,3.039642572402954,81.14050197601318,4 +4847,0.33775854110717773,0.5787158608436584,0.5927627086639404,0.23682983219623566,146.47067260742188,1e-05,0.10196928679943085,3.326056957244873,81.14050197601318,4 +4848,0.21678020060062408,0.3147401213645935,0.31466129422187805,0.23076923191547394,979.6979370117188,1e-05,0.11259277909994125,2.824641466140747,81.14050197601318,4 +4849,0.35766714811325073,0.21746522188186646,0.23592181503772736,0.2337995320558548,844.7539672851562,1e-05,0.09580423682928085,3.1364428997039795,81.14050197601318,4 +4850,0.33206793665885925,0.37300238013267517,0.3771008551120758,0.24032634496688843,421.0982971191406,1e-05,0.10289563983678818,3.0589466094970703,81.14050197601318,4 +4851,0.35249263048171997,0.28803667426109314,0.28466561436653137,0.12960372865200043,694.233642578125,1e-05,0.1108897477388382,3.0300188064575195,81.14050197601318,4 +4852,0.2551710903644562,0.31603485345840454,0.3212377727031708,0.20000000298023224,955.10791015625,1e-05,0.2625666558742523,3.3363919258117676,81.14050197601318,4 +4853,0.20247510075569153,0.39588791131973267,0.38423120975494385,0.25407925248146057,895.0792846679688,1e-05,0.12850993871688843,3.3016445636749268,81.14050197601318,4 +4854,0.26492026448249817,0.6076537370681763,0.6112506985664368,0.15361304581165314,140.08938598632812,1e-05,0.12083743512630463,2.838252305984497,81.14050197601318,4 +4855,0.12972889840602875,0.30484539270401,0.30459702014923096,0.23962703347206116,850.6163940429688,1e-05,0.09820105135440826,3.1633591651916504,81.14050197601318,4 +4856,0.26366090774536133,0.33916544914245605,0.3324959874153137,0.2153846174478531,892.0726318359375,1e-05,0.20342978835105896,3.076484203338623,81.14050197601318,4 +4857,0.19132472574710846,0.3674981892108917,0.37283071875572205,0.1347319334745407,956.552734375,1e-05,0.10625535994768143,3.0559558868408203,81.14050197601318,4 +4858,0.23553279042243958,0.26844924688339233,0.2801145315170288,0.11118881404399872,988.18359375,1e-05,0.0860355943441391,3.0941829681396484,81.14050197601318,4 +4859,0.30121129751205444,0.3338024914264679,0.3653361201286316,0.2622377574443817,991.2958374023438,1e-05,0.1402512788772583,3.3229947090148926,81.14050197601318,4 +4860,0.3108314871788025,0.35066282749176025,0.35235047340393066,0.1946386992931366,955.10791015625,1e-05,0.1413087099790573,2.8337137699127197,81.14050197601318,4 +4861,0.4111785590648651,0.3148406744003296,0.32608240842819214,0.14475524425506592,695.4873657226562,1e-05,0.12355035543441772,3.150841236114502,81.14050197601318,4 +4862,0.1762215942144394,0.2431870400905609,0.2632603049278259,0.2181818187236786,776.9306030273438,1e-05,0.10393378138542175,3.2383296489715576,81.14050197601318,4 +4863,0.2842066287994385,0.2551219165325165,0.2706162631511688,0.17738927900791168,840.3358154296875,1e-05,0.11416604369878769,3.0648605823516846,81.14050197601318,4 +4864,0.25234994292259216,0.5147883892059326,0.5007664561271667,0.23962703347206116,994.27783203125,1e-05,0.12665951251983643,3.1215105056762695,81.14050197601318,4 +4865,0.19200344383716583,0.26834776997566223,0.2836472988128662,0.21888111531734467,991.8234252929688,1e-05,0.10239886492490768,3.091287851333618,81.14050197601318,4 +4866,0.30762583017349243,0.4109571576118469,0.43173596262931824,0.24079254269599915,292.3681640625,1e-05,0.14215482771396637,2.833669662475586,81.14050197601318,4 +4867,0.15376758575439453,0.38852179050445557,0.3970760703086853,0.302097886800766,989.1450805664062,1e-05,0.09759104251861572,3.191560745239258,81.14050197601318,4 +4868,0.254840612411499,0.3483516275882721,0.356563001871109,0.1878787875175476,976.2150268554688,1e-05,0.15974849462509155,3.3242008686065674,81.14050197601318,4 +4869,0.19099168479442596,0.4629836082458496,0.4407481551170349,0.23030303418636322,995.6604614257812,1e-05,0.10249648243188858,3.1076295375823975,81.14050197601318,4 +4870,0.3328668177127838,0.3290765583515167,0.3319859504699707,0.20489510893821716,870.5208129882812,1e-05,0.1247822642326355,3.1044604778289795,81.14050197601318,4 +4871,0.23152939975261688,0.21040017902851105,0.23016197979450226,0.17715618014335632,976.0529174804688,1e-05,0.13541196286678314,3.1043548583984375,81.14050197601318,4 +4872,0.08970403671264648,0.2113230973482132,0.21425019204616547,0.2209790199995041,877.97705078125,1e-05,0.16981932520866394,3.134636402130127,81.14050197601318,4 +4873,0.190928652882576,0.3742304742336273,0.37774473428726196,0.21351981163024902,964.940673828125,1e-05,0.12358903139829636,3.1197760105133057,81.14050197601318,4 +4874,0.1745385080575943,0.23710355162620544,0.25075089931488037,0.20349650084972382,856.7466430664062,1e-05,0.11498533934354782,3.093885898590088,81.14050197601318,4 +4875,0.21966247260570526,0.2161005139350891,0.22710002958774567,0.22960372269153595,997.0159301757812,1e-05,0.1631547212600708,3.3387160301208496,81.14050197601318,4 +4876,0.26184457540512085,0.23870934545993805,0.24547964334487915,0.2482517510652542,906.7301635742188,1e-05,0.1381511241197586,3.276313304901123,81.14050197601318,4 +4877,0.16759952902793884,0.20545443892478943,0.23234610259532928,0.24172493815422058,935.9909057617188,1e-05,0.09840256720781326,3.1327013969421387,81.14050197601318,4 +4878,0.3590922951698303,0.26268646121025085,0.2811815142631531,0.21794871985912323,986.079833984375,1e-05,0.23713494837284088,3.09765887260437,81.14050197601318,4 +4879,0.22436662018299103,0.3775714933872223,0.36636266112327576,0.2599067687988281,843.1128540039062,1e-05,0.1138206198811531,3.103482484817505,81.14050197601318,4 +4880,0.225676491856575,0.3912808299064636,0.3893011808395386,0.19976690411567688,985.364990234375,1e-05,0.11620314419269562,3.101773738861084,81.14050197601318,4 +4881,0.4803226888179779,0.3209519684314728,0.32632991671562195,0.24638694524765015,885.4254760742188,1e-05,0.1360357403755188,3.0685458183288574,81.14050197601318,4 +4882,0.2580348551273346,0.29611608386039734,0.30166152119636536,0.2405594438314438,876.2608642578125,1e-05,0.13845817744731903,3.1150169372558594,81.14050197601318,4 +4883,0.23972313106060028,0.2604103088378906,0.26983797550201416,0.2526806592941284,928.03564453125,1e-05,0.11716946959495544,3.118605136871338,81.14050197601318,4 +4884,0.3778093159198761,0.3887070417404175,0.3891906440258026,0.16317015886306763,962.871337890625,1e-05,0.13822786509990692,3.1276133060455322,81.14050197601318,4 +4885,0.379139244556427,0.6231381893157959,0.629347026348114,0.22447551786899567,146.47067260742188,1e-05,0.12414917349815369,3.114536762237549,81.14050197601318,4 +4886,0.26684653759002686,0.3041408360004425,0.3040941059589386,0.2242424190044403,867.7844848632812,1e-05,0.10223814845085144,3.221276044845581,81.14050197601318,4 +4887,0.35223761200904846,0.16861437261104584,0.18135622143745422,0.24405594170093536,906.0565185546875,1e-05,0.12542755901813507,3.3502345085144043,81.14050197601318,4 +4888,0.205571711063385,0.28041139245033264,0.2925877869129181,0.16969697177410126,817.3616943359375,1e-05,0.11880651116371155,3.2920033931732178,81.14050197601318,4 +4889,0.40972447395324707,0.2775627672672272,0.28060296177864075,0.24032634496688843,749.2398071289062,1e-05,0.18135012686252594,2.832165241241455,81.14050197601318,4 +4890,0.32693877816200256,0.2348385453224182,0.25148406624794006,0.15034964680671692,950.4097290039062,1e-05,0.14504826068878174,3.317098379135132,81.14050197601318,4 +4891,0.20473596453666687,0.45874831080436707,0.4723394811153412,0.1902097910642624,979.3876342773438,1e-05,0.11915130913257599,3.1279759407043457,81.14050197601318,4 +4892,0.3756622076034546,0.253688782453537,0.26138827204704285,0.18298368155956268,591.9431762695312,1e-05,0.4197981059551239,3.272059202194214,81.14050197601318,4 +4893,0.4246055781841278,0.2476748526096344,0.26197370886802673,0.20489510893821716,938.5079956054688,1e-05,0.139130100607872,3.1043407917022705,81.14050197601318,4 +4894,0.2718724012374878,0.3295536935329437,0.3352290391921997,0.2610722482204437,990.0938720703125,1e-05,0.10590841621160507,3.3351268768310547,81.14050197601318,4 +4895,0.2725411057472229,0.32249894738197327,0.3295736014842987,0.19370628893375397,478.7982177734375,1e-05,0.12955239415168762,2.8364036083221436,81.14050197601318,4 +4896,0.2524324655532837,0.4144182503223419,0.44275620579719543,0.220279723405838,238.46560668945312,1e-05,0.10796422511339188,3.1544573307037354,81.14050197601318,4 +4897,0.3870571255683899,0.23910388350486755,0.23669417202472687,0.25407925248146057,740.3775634765625,1e-05,0.13873136043548584,3.080709934234619,81.14050197601318,4 +4898,0.22515776753425598,0.3068062365055084,0.3066963851451874,0.22214451432228088,975.7278442382812,1e-05,0.25209811329841614,3.059152126312256,81.14050197601318,4 +4899,0.2625286281108856,0.29739275574684143,0.3015141785144806,0.250582754611969,864.5192260742188,1e-05,0.1576649695634842,3.03324818611145,81.14050197601318,4 +4900,0.40869805216789246,0.5634558796882629,0.5837734341621399,0.1822843849658966,165.13217163085938,1e-05,0.14625026285648346,3.0561938285827637,81.14050197601318,4 +4901,0.2287309467792511,0.256218284368515,0.25984278321266174,0.2578088641166687,705.2662353515625,1e-05,0.1917329579591751,2.8308510780334473,81.14050197601318,4 +4902,0.29807931184768677,0.28671640157699585,0.28422778844833374,0.10815850645303726,667.560546875,1e-05,0.13263414800167084,3.107415199279785,81.14050197601318,4 +4903,0.3465130925178528,0.3005990982055664,0.300694078207016,0.21445220708847046,786.6087036132812,1e-05,0.10787451267242432,3.100346326828003,81.14050197601318,4 +4904,0.23692631721496582,0.30614420771598816,0.3106626868247986,0.19137528538703918,903.6668701171875,1e-05,0.11493381857872009,3.0742387771606445,81.14050197601318,4 +4905,0.38634878396987915,0.24498634040355682,0.26237520575523376,0.18694639205932617,880.5089721679688,1e-05,0.21816067397594452,3.0493357181549072,81.14050197601318,4 +4906,0.4014682173728943,0.318638414144516,0.32339856028556824,0.24125874042510986,500.3907775878906,1e-05,0.4289731979370117,3.042591094970703,81.14050197601318,4 +4907,0.3358366787433624,0.1953386515378952,0.19734373688697815,0.08927738666534424,988.18359375,1e-05,0.13055546581745148,2.8308303356170654,81.14050197601318,4 +4908,0.31035271286964417,0.32808053493499756,0.3157755732536316,0.22610722482204437,988.18359375,1e-05,0.13056814670562744,3.177295684814453,81.14050197601318,4 +4909,0.546160876750946,0.28376853466033936,0.2895852029323578,0.12354312092065811,620.8772583007812,1e-05,0.13885188102722168,3.242762327194214,81.14050197601318,4 +4910,0.2553344964981079,0.3718523681163788,0.36734700202941895,0.25314685702323914,964.940673828125,1e-05,0.08593527227640152,3.0518908500671387,81.14050197601318,4 +4911,0.21941661834716797,0.395629346370697,0.3869304955005646,0.29324010014533997,979.0761108398438,1e-05,0.09043648838996887,3.0694689750671387,81.14050197601318,4 +4912,0.2552140951156616,0.2209353744983673,0.2438318282365799,0.19883449375629425,999.4136352539062,1e-05,0.12761643528938293,3.0913407802581787,81.14050197601318,4 +4913,0.1929452270269394,0.23270080983638763,0.24315255880355835,0.16923077404499054,803.0537109375,1e-05,0.1279197782278061,3.1370561122894287,81.14050197601318,4 +4914,0.1693388968706131,0.284443199634552,0.30776551365852356,0.22564102709293365,972.231689453125,1e-05,0.14875783026218414,2.838082790374756,81.14050197601318,4 +4915,0.3490159511566162,0.2908857464790344,0.2935079038143158,0.18484848737716675,604.99365234375,1e-05,0.1665126383304596,3.0937514305114746,81.14050197601318,4 +4916,0.2294543981552124,0.18195457756519318,0.19648951292037964,0.15314684808254242,769.3107299804688,1e-05,0.1264873743057251,3.090740442276001,81.14050197601318,4 +4917,0.35598254203796387,0.3215479850769043,0.3415210545063019,0.26037296652793884,301.4790344238281,1e-05,0.11914458870887756,3.2725026607513428,81.14050197601318,4 +4918,0.39130905270576477,0.32554876804351807,0.32819443941116333,0.1638694703578949,449.6458740234375,1e-05,0.14716076850891113,3.13944935798645,81.14050197601318,4 +4919,0.2975533902645111,0.2750895321369171,0.28535282611846924,0.16363635659217834,920.3087768554688,1e-05,0.14271967113018036,3.116546630859375,81.14050197601318,4 +4920,0.2242136150598526,0.3694797456264496,0.376112699508667,0.2543123662471771,983.0303955078125,1e-05,0.1633463054895401,2.8344504833221436,81.14050197601318,4 +4921,0.36205196380615234,0.31057173013687134,0.31815001368522644,0.2545454502105713,987.4890747070312,1e-05,0.18797972798347473,3.3288238048553467,81.14050197601318,4 +4922,0.25576356053352356,0.20985056459903717,0.2394978553056717,0.19510489702224731,981.6846923828125,1e-05,0.1268841177225113,2.8345258235931396,81.14050197601318,4 +4923,0.28703969717025757,0.2798707187175751,0.2823805510997772,0.133100226521492,559.55126953125,1e-05,0.10878165811300278,3.3612277507781982,81.14050197601318,4 +4924,0.2140292078256607,0.275615930557251,0.2779323160648346,0.21118880808353424,975.5648193359375,1e-05,0.1489642858505249,2.839529275894165,81.14050197601318,4 +4925,0.4081987738609314,0.296434223651886,0.2963762581348419,0.17529137432575226,956.552734375,1e-05,0.15227633714675903,3.1101067066192627,81.14050197601318,4 +4926,0.2687395215034485,0.20606084167957306,0.22142446041107178,0.14125874638557434,913.5706787109375,1e-05,0.15543733537197113,3.118539333343506,81.14050197601318,4 +4927,0.2385586053133011,0.23696781694889069,0.24847503006458282,0.16969697177410126,968.9326171875,1e-05,0.11201614886522293,3.3684592247009277,81.14050197601318,4 +4928,0.25214457511901855,0.3595844507217407,0.3631070554256439,0.0923076942563057,980.3147583007812,1e-05,0.13813892006874084,3.0547237396240234,81.14050197601318,4 +4929,0.27465012669563293,0.33523112535476685,0.3531439006328583,0.2125874161720276,965.3115234375,1e-05,0.14611996710300446,3.332040309906006,81.14050197601318,4 +4930,0.26306480169296265,0.2137128859758377,0.22172750532627106,0.17878787219524384,818.01220703125,1e-05,0.14658676087856293,2.842174768447876,81.14050197601318,4 +4931,0.18555185198783875,0.2865946292877197,0.2974441647529602,0.25617715716362,976.5382080078125,1e-05,0.11612963676452637,3.1532375812530518,81.14050197601318,4 +4932,0.16729126870632172,0.45119163393974304,0.4346908926963806,0.24405594170093536,961.7210693359375,1e-05,0.09827814251184464,3.057039737701416,81.14050197601318,4 +4933,0.3205070197582245,0.33676019310951233,0.32894283533096313,0.2181818187236786,928.8597412109375,1e-05,0.11469385027885437,3.129021406173706,81.14050197601318,4 +4934,0.26843416690826416,0.36455273628234863,0.3647799491882324,0.25524476170539856,949.5288696289062,1e-05,0.12427003681659698,3.029299259185791,81.14050197601318,4 +4935,0.2761473059654236,0.6249516010284424,0.6437305808067322,0.19510489702224731,177.18624877929688,1e-05,0.1884971410036087,3.075273036956787,81.14050197601318,4 +4936,0.2278858870267868,0.2788187563419342,0.2781045436859131,0.20279720425605774,831.0814819335938,1e-05,0.1175304502248764,2.829401731491089,81.14050197601318,4 +4937,0.2301827371120453,0.17874932289123535,0.18491119146347046,0.2181818187236786,796.51806640625,1e-05,0.09004227072000504,3.279513359069824,81.14050197601318,4 +4938,0.23297972977161407,0.2835544943809509,0.2913700044155121,0.19440560042858124,995.2861328125,1e-05,0.14712485671043396,3.088200807571411,81.14050197601318,4 +4939,0.255561888217926,0.28057387471199036,0.2934730648994446,0.22284382581710815,624.2781982421875,1e-05,0.12774613499641418,3.062028646469116,81.14050197601318,4 +4940,0.21393322944641113,0.3239555060863495,0.32527783513069153,0.1543123573064804,964.1939697265625,1e-05,0.1625511199235916,3.0861124992370605,81.14050197601318,4 +4941,0.31527772545814514,0.3367370367050171,0.33555471897125244,0.2242424190044403,910.3654174804688,1e-05,0.1815187931060791,3.0551724433898926,81.14050197601318,4 +4942,0.21089810132980347,0.27048587799072266,0.28269171714782715,0.21958041191101074,960.5552368164062,1e-05,0.10368471592664719,2.8388419151306152,81.14050197601318,4 +4943,0.4025736451148987,0.2937849164009094,0.3121403455734253,0.17575757205486298,826.2322387695312,1e-05,0.2079012542963028,3.284780979156494,81.14050197601318,4 +4944,0.2849254012107849,0.30707085132598877,0.3203055262565613,0.19440560042858124,945.226806640625,1e-05,0.20057281851768494,3.3264317512512207,81.14050197601318,4 +4945,0.22182148694992065,0.2770717442035675,0.2786082625389099,0.17412588000297546,800.1805419921875,1e-05,0.3972507119178772,3.292558431625366,81.14050197601318,4 +4946,0.19086763262748718,0.27151188254356384,0.27067995071411133,0.18298368155956268,829.2810668945312,1e-05,0.13679535686969757,3.065972089767456,81.14050197601318,4 +4947,0.2705615758895874,0.34974032640457153,0.34966138005256653,0.19510489702224731,478.7982177734375,1e-05,0.09382682293653488,3.1382598876953125,81.14050197601318,4 +4948,0.3599293828010559,0.248329296708107,0.2661587595939636,0.10023310035467148,992.0859375,1e-05,0.11345475167036057,2.8418524265289307,81.14050197601318,4 +4949,0.3451521098613739,0.22088700532913208,0.23418354988098145,0.2181818187236786,870.0686645507812,1e-05,0.12145710736513138,3.2873728275299072,81.14050197601318,4 +4950,0.4048326909542084,0.24409998953342438,0.2478533536195755,0.2114219069480896,809.341064453125,1e-05,0.1415698379278183,3.2962141036987305,81.14050197601318,4 +4951,0.1322002410888672,0.31086355447769165,0.3341338038444519,0.1902097910642624,993.7682495117188,1e-05,0.08856231719255447,3.2963972091674805,81.14050197601318,4 +4952,0.17701931297779083,0.25939908623695374,0.27347102761268616,0.20000000298023224,853.715087890625,1e-05,0.10115484148263931,3.182358980178833,81.14050197601318,4 +4953,0.3397064208984375,0.37403640151023865,0.3733476400375366,0.25617715716362,998.1053466796875,1e-05,0.11549001932144165,2.8356781005859375,81.14050197601318,4 +4954,0.2834354043006897,0.25574055314064026,0.2708699703216553,0.20000000298023224,932.0916137695312,1e-05,0.12241410464048386,2.830009698867798,81.14050197601318,4 +4955,0.31766730546951294,0.39792555570602417,0.40545332431793213,0.16293705999851227,996.5260620117188,1e-05,0.20831625163555145,3.100315809249878,81.14050197601318,4 +4956,0.14401711523532867,0.2764383852481842,0.289031982421875,0.26317015290260315,532.5975952148438,1e-05,0.10520078986883163,3.156144857406616,81.14050197601318,4 +4957,0.2941959798336029,0.2500048875808716,0.2602355182170868,0.23146852850914001,831.677001953125,1e-05,0.09169606119394302,3.0770115852355957,81.14050197601318,4 +4958,0.39379122853279114,0.28554096817970276,0.303706556558609,0.25361305475234985,948.4158325195312,1e-05,0.16465897858142853,3.1832008361816406,81.14050197601318,4 +4959,0.31483352184295654,0.3449089527130127,0.35357242822647095,0.2885780930519104,440.3874816894531,1e-05,0.10794178396463394,2.839116096496582,81.14050197601318,4 +4960,0.31360918283462524,0.3879508376121521,0.3762819170951843,0.1258741319179535,946.6068115234375,1e-05,0.1531558781862259,2.8410630226135254,81.14050197601318,4 +4961,0.2180694043636322,0.2238200157880783,0.23104330897331238,0.2242424190044403,835.7803955078125,1e-05,0.11734765768051147,3.3127059936523438,81.14050197601318,4 +4962,0.2688651382923126,0.23775574564933777,0.24837620556354523,0.19324009120464325,801.6233520507812,1e-05,0.12197703123092651,3.095123767852783,81.14050197601318,4 +4963,0.21491514146327972,0.19204582273960114,0.2009456902742386,0.10722610354423523,937.759521484375,1e-05,0.2905673086643219,3.074004650115967,81.14050197601318,4 +4964,0.37820085883140564,0.3117976188659668,0.3131374418735504,0.25081583857536316,764.04736328125,1e-05,0.2182663232088089,3.4517011642456055,81.14050197601318,4 +4965,0.26769644021987915,0.16141392290592194,0.18717382848262787,0.23403263092041016,866.8596801757812,1e-05,0.144435316324234,2.8292181491851807,81.14050197601318,4 +4966,0.31543874740600586,0.2580573856830597,0.26727890968322754,0.20606060326099396,643.773681640625,1e-05,0.10737704485654831,2.831855058670044,81.14050197601318,4 +4967,0.32808372378349304,0.320433646440506,0.32237115502357483,0.19930069148540497,885.4254760742188,1e-05,0.1251755952835083,3.052757978439331,81.14050197601318,4 +4968,0.3141290843486786,0.2970240116119385,0.2931053042411804,0.16573426127433777,831.677001953125,1e-05,0.12766413390636444,3.2561025619506836,81.14050197601318,4 +4969,0.19520063698291779,0.27579355239868164,0.29943859577178955,0.12284382432699203,983.9144897460938,1e-05,0.12448899447917938,3.088815927505493,81.14050197601318,4 +4970,0.3691800534725189,0.29205939173698425,0.29033181071281433,0.1515151560306549,898.37353515625,1e-05,0.13891728222370148,3.554910898208618,81.14050197601318,4 +4971,0.3731296956539154,0.25623899698257446,0.262146919965744,0.14009323716163635,546.3833618164062,1e-05,0.08984528481960297,2.841102361679077,81.14050197601318,4 +4972,0.3686692416667938,0.20206280052661896,0.2175329029560089,0.249417245388031,794.2818603515625,1e-05,0.18523141741752625,3.2878475189208984,81.14050197601318,4 +4973,0.263540655374527,0.46797889471054077,0.46272605657577515,0.1958041936159134,443.50128173828125,1e-05,0.12898777425289154,3.1317896842956543,81.14050197601318,4 +4974,0.26907140016555786,0.2772241532802582,0.2793167233467102,0.16969697177410126,842.5615844726562,1e-05,0.11116211861371994,3.2685134410858154,81.14050197601318,4 +4975,0.2542211711406708,0.35329413414001465,0.360122948884964,0.09324008971452713,375.388671875,1e-05,0.1091422513127327,3.1109707355499268,81.14050197601318,4 +4976,0.3018539845943451,0.31739404797554016,0.32655787467956543,0.22634032368659973,553.0419311523438,1e-05,0.17686259746551514,3.405092477798462,81.14050197601318,4 +4977,0.3511001467704773,0.241559699177742,0.25078117847442627,0.13659673929214478,959.966552734375,1e-05,0.25234803557395935,2.838888168334961,81.14050197601318,4 +4978,0.37187209725379944,0.37974128127098083,0.3858887255191803,0.21118880808353424,586.15087890625,1e-05,0.11753164976835251,2.8382656574249268,81.14050197601318,4 +4979,0.3563111424446106,0.17376847565174103,0.19979208707809448,0.2074592113494873,836.9324951171875,1e-05,0.11802643537521362,3.249257802963257,81.14050197601318,4 +4980,0.27406045794487,0.23747898638248444,0.24788832664489746,0.11864801496267319,939.9876098632812,1e-05,0.13511472940444946,3.0803236961364746,81.14050197601318,4 +4981,0.2188810259103775,0.23522937297821045,0.2448052316904068,0.19813519716262817,889.7675170898438,1e-05,0.12283001095056534,3.109908103942871,81.14050197601318,4 +4982,0.33403217792510986,0.1911126971244812,0.19552229344844818,0.2013985961675644,851.6567993164062,1e-05,0.1940310001373291,3.1288363933563232,81.14050197601318,4 +4983,0.34379270672798157,0.27148351073265076,0.26609373092651367,0.23846153914928436,800.1805419921875,1e-05,0.19545787572860718,2.8296356201171875,81.14050197601318,4 +4984,0.1856866478919983,0.34789302945137024,0.33415859937667847,0.18601398169994354,913.8861694335938,1e-05,0.13206081092357635,3.0739686489105225,81.14050197601318,4 +4985,0.2772243022918701,0.3029903471469879,0.3066323697566986,0.20349650084972382,974.7445068359375,1e-05,0.10635419189929962,3.289050340652466,81.14050197601318,4 +4986,0.2587960660457611,0.2907062768936157,0.29685238003730774,0.1678321659564972,785.822265625,1e-05,0.11569920927286148,3.2639455795288086,81.14050197601318,4 +4987,0.24714264273643494,0.27707934379577637,0.2865113615989685,0.19836829602718353,953.8506469726562,1e-05,0.1157437413930893,3.0971362590789795,81.14050197601318,4 +4988,0.18588997423648834,0.3974727690219879,0.3915135860443115,0.10139860212802887,992.2167358398438,1e-05,0.07895347476005554,3.0425162315368652,81.14050197601318,4 +4989,0.13859501481056213,0.3024080693721771,0.30498918890953064,0.2226107269525528,918.5123291015625,1e-05,0.164567768573761,2.8275067806243896,81.14050197601318,4 +4990,0.33177101612091064,0.22467230260372162,0.23748430609703064,0.20815850794315338,608.6077880859375,1e-05,0.12895610928535461,3.1125948429107666,81.14050197601318,4 +4991,0.2015497386455536,0.2968841791152954,0.2948783338069916,0.17575757205486298,939.9876098632812,1e-05,0.1340104043483734,3.020733118057251,81.14050197601318,4 +4992,0.28891274333000183,0.3150920569896698,0.3173620402812958,0.24708624184131622,987.069091796875,1e-05,0.09392572194337845,3.1152398586273193,81.14050197601318,4 +4993,0.2204897403717041,0.3348839282989502,0.32596340775489807,0.2689976692199707,890.5407104492188,1e-05,0.10736723244190216,3.084646701812744,81.14050197601318,4 +4994,0.23447997868061066,0.32908886671066284,0.33185529708862305,0.2046620100736618,978.2918701171875,1e-05,0.0913051962852478,3.127683639526367,81.14050197601318,4 +4995,0.31434890627861023,0.2346702516078949,0.2346259355545044,0.13846154510974884,909.3855590820312,1e-05,0.1434181034564972,2.8442821502685547,81.14050197601318,4 +4996,0.19182366132736206,0.24959295988082886,0.2665981948375702,0.21561771631240845,992.7376708984375,1e-05,0.09763125330209732,3.3094828128814697,81.14050197601318,4 +4997,0.20099887251853943,0.24964332580566406,0.2519112527370453,0.12424242496490479,960.3594970703125,1e-05,0.0922604501247406,3.0705225467681885,81.14050197601318,4 +4998,0.28446057438850403,0.3948872983455658,0.38027822971343994,0.2097902148962021,984.643310546875,1e-05,0.09216383099555969,3.0957047939300537,81.14050197601318,4 +4999,0.1934654861688614,0.2335149049758911,0.24373093247413635,0.20955711603164673,919.7131958007812,1e-05,0.1300644427537918,3.381566047668457,81.14050197601318,4 +5000,0.180038183927536,0.16012446582317352,0.17030459642410278,0.14685314893722534,781.0278930664062,1e-05,0.10429359972476959,3.123816967010498,81.14050197601318,4 diff --git a/backup_2026-09-14/runs/ltx__arope_5k/val_log.csv b/backup_2026-09-14/runs/ltx__arope_5k/val_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..176c7eb57b70a9db7e367f9ff83a4e1e166ab626 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k/val_log.csv @@ -0,0 +1,31 @@ +step,timestep,loss_w,mse,n +500,200.4163818359375,0.4995663333684206,0.5183262825012207,16 +500,500.3907775878906,0.30239616613835096,0.31810889672487974,16 +500,800.1805419921875,0.2550167813897133,0.26783186104148626,16 +1000,200.4163818359375,0.47996838204562664,0.49842265993356705,16 +1000,500.3907775878906,0.2916030092164874,0.3068994330242276,16 +1000,800.1805419921875,0.24656889401376247,0.2589742438867688,16 +1500,200.4163818359375,0.4723676238209009,0.4907504003494978,16 +1500,500.3907775878906,0.28718037996441126,0.3023439608514309,16 +1500,800.1805419921875,0.2418720368295908,0.2541029304265976,16 +2000,200.4163818359375,0.4674617573618889,0.4857571553438902,16 +2000,500.3907775878906,0.2840483309701085,0.2990799518302083,16 +2000,800.1805419921875,0.23971945978701115,0.2517663845792413,16 +2500,200.4163818359375,0.46400536224246025,0.4822213128209114,16 +2500,500.3907775878906,0.28200320433825254,0.2969102365896106,16 +2500,800.1805419921875,0.23772421665489674,0.24967137351632118,16 +3000,200.4163818359375,0.45942598953843117,0.47761655785143375,16 +3000,500.3907775878906,0.2789991609752178,0.2938622450456023,16 +3000,800.1805419921875,0.23524200730025768,0.24703630432486534,16 +3500,200.4163818359375,0.457468219101429,0.47557081282138824,16 +3500,500.3907775878906,0.27806178107857704,0.2929038405418396,16 +3500,800.1805419921875,0.2340489886701107,0.24579425621777773,16 +4000,200.4163818359375,0.45542872697114944,0.47351435758173466,16 +4000,500.3907775878906,0.27658444829285145,0.2913620350882411,16 +4000,800.1805419921875,0.23252948373556137,0.24434937350451946,16 +4500,200.4163818359375,0.45479862578213215,0.47286904603242874,16 +4500,500.3907775878906,0.27682485338300467,0.291461817920208,16 +4500,800.1805419921875,0.23278749268501997,0.24435846135020256,16 +5000,200.4163818359375,0.45154587365686893,0.46958155184984207,16 +5000,500.3907775878906,0.27386476192623377,0.28855046816170216,16 +5000,800.1805419921875,0.22977416031062603,0.24149093683809042,16 diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v2/accelerate_ga2.yaml b/backup_2026-09-14/runs/ltx__arope_5k_v2/accelerate_ga2.yaml new file mode 100644 index 0000000000000000000000000000000000000000..965e26f1d2ec822dcf168db52ce4ee1732d4b79c --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v2/accelerate_ga2.yaml @@ -0,0 +1,22 @@ +compute_environment: LOCAL_MACHINE +debug: false +deepspeed_config: + gradient_accumulation_steps: 2 + offload_optimizer_device: 'none' + offload_param_device: 'none' + zero3_init_flag: false + zero_stage: 2 +distributed_type: DEEPSPEED +downcast_bf16: 'no' +enable_cpu_affinity: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 8 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v2/config.json b/backup_2026-09-14/runs/ltx__arope_5k_v2/config.json new file mode 100644 index 0000000000000000000000000000000000000000..331e07929d3a5642564f33e25a8614317b86f052 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v2/config.json @@ -0,0 +1,197 @@ +{ + "args": { + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/train", + "val_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/val", + "text_table": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/text_table_ltx.pt", + "sidecar": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "meta_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/meta", + "model_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5", + "repack_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5-Repackage", + "limit": null, + "min_rt_ratio": 0.8, + "val_min_rt_ratio": 0.9, + "mask_channel": true, + "new_weight": 2.0, + "scene_dropout": 0.1, + "lr": 1e-05, + "weight_decay": 0.01, + "warmup_steps": 200, + "grad_clip": 1.0, + "max_steps": 5000, + "batch_size": 1, + "grad_accum": 2, + "num_workers": 2, + "gradient_checkpointing": true, + "save_every": 500, + "val_every": 500, + "val_n": 16, + "val_timesteps": [ + 200.0, + 500.0, + 800.0 + ], + "log_every": 1, + "output": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2", + "resume": null, + "seed": 0, + "self_test": false, + "dry_run": false + }, + "sidecar_meta": { + "version": "arope_sidecar_v1", + "gain_correction": [ + -1.1223353683364354, + -1.12 + ], + "walk_speed_px_s": [ + 69.24106392992304, + 46.012630371093756 + ], + "M_px832": [ + [ + -26.562482341426065, + -0.10811496854140469 + ], + [ + -2.730642040963448, + 11.486215518608526 + ], + [ + 0.4151829271053684, + 16.944469913263354 + ] + ], + "n_clips": 22782, + "n_valid": 22781, + "max_sample_dt": 0.5 + }, + "dataset": { + "train_total": 20983, + "train_missing": 0, + "train_invalid": 1, + "train_leak_excluded": 257, + "train_low_rt_excluded": 2197, + "train_used": 18528, + "text_table_keys": 1473, + "val_used": 16, + "val_clip_ids": [ + "clip_Eybx_100000255_000042", + "clip_Eybx_100000496_000000", + "clip_Eybx_100000680_000063", + "clip_Eybx_100000737_000063", + "clip_Eybx_100000737_000168", + "clip_Eybx_100000751_000231", + "clip_Eybx_100000751_000546", + "clip_Eybx_100000752_000000", + "clip_Eybx_100000838_000168", + "clip_Eybx_100001216_000000", + "clip_Eybx_100001217_000105", + "clip_Eybx_100002599_000000", + "clip_Eybx_100002875_000147", + "clip_Eybx_200000624_000000", + "clip_Eybx_200001033_000126", + "clip_Eybx_200001197_000063" + ] + }, + "model": { + "dit_safetensors": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors", + "n_params": 18987867392, + "n_state_dict_keys": 4093, + "mask_channel": true, + "resume_info": null + }, + "env": { + "world_size": 8, + "distributed_type": "DistributedType.DEEPSPEED", + "mixed_precision": "bf16", + "torch": "2.11.0+cu128", + "cuda": "12.8", + "gpu": "NVIDIA H200", + "python": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/python3.12", + "platform": "Linux-6.12.94-123.192.amzn2023.x86_64-x86_64-with-glibc2.34", + "hostname": "ip-172-16-244-218.ap-southeast-3.compute.internal", + "argv": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/ltx/train_ltx_arope.py", + "--train_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/train", + "--val_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/val", + "--text_table", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/text_table_ltx.pt", + "--sidecar", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "--meta_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/meta", + "--model_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5", + "--repack_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5-Repackage", + "--new_weight", + "2.0", + "--scene_dropout", + "0.1", + "--lr", + "1e-5", + "--weight_decay", + "0.01", + "--warmup_steps", + "200", + "--grad_clip", + "1.0", + "--max_steps", + "5000", + "--batch_size", + "1", + "--grad_accum", + "2", + "--num_workers", + "2", + "--save_every", + "500", + "--val_every", + "500", + "--val_n", + "16", + "--val_timesteps", + "200,500,800", + "--min_rt_ratio", + "0.8", + "--val_min_rt_ratio", + "0.9", + "--seed", + "0", + "--output", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2" + ], + "started": "2026-09-14 10:07:13", + "cuda_visible_devices": null, + "accelerate": "1.14.0", + "deepspeed": "0.19.6" + }, + "deepspeed_config": { + "train_batch_size": 16, + "train_micro_batch_size_per_gpu": 1, + "gradient_accumulation_steps": 2, + "zero_optimization": { + "stage": 2, + "offload_optimizer": { + "device": "none", + "nvme_path": null + }, + "offload_param": { + "device": "none", + "nvme_path": null + }, + "stage3_gather_16bit_weights_on_model_save": false + }, + "gradient_clipping": 1.0, + "steps_per_print": Infinity, + "bf16": { + "enabled": true + }, + "fp16": { + "enabled": false + }, + "zero_allow_untested_optimizer": true + } +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v2/done.json b/backup_2026-09-14/runs/ltx__arope_5k_v2/done.json new file mode 100644 index 0000000000000000000000000000000000000000..5242b2df27da37c2cde3fb5f4eee553e3b0eec8d --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v2/done.json @@ -0,0 +1,4 @@ +{ + "step": 5000, + "finished": "2026-09-14 14:44:52" +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v2/launch.log b/backup_2026-09-14/runs/ltx__arope_5k_v2/launch.log new file mode 100644 index 0000000000000000000000000000000000000000..6262d12189edd44390572d6f2eba5185ab5b56bb --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v2/launch.log @@ -0,0 +1,5237 @@ +W0914 10:05:46.030000 810610 torch/distributed/run.py:851] +W0914 10:05:46.030000 810610 torch/distributed/run.py:851] ***************************************** +W0914 10:05:46.030000 810610 torch/distributed/run.py:851] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. +W0914 10:05:46.030000 810610 torch/distributed/run.py:851] ***************************************** +[env] world=8 distributed=DistributedType.DEEPSPEED mixed_precision=bf16 device=cuda:0 +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +[LtxAropeDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/train: 20983 个 .pt,sidecar 缺失 0,valid=False 剔除 1,转场泄漏剔除 257,rt_ratio<0.8 剔除 2197,可用 18528;文本表 1473 键,scene_dropout=0.1 +[LtxAropeDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/val: 1175 个 .pt,sidecar 缺失 0,valid=False 剔除 0,rt_ratio<0.9 剔除 193,可用 16(limit=16);文本表 1473 键,scene_dropout=0.0 +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +[arope] 装 arope_mask_embed:Linear(1, 4096),零初始化 +[arope] patchify_proj 挂了 forward hook(+ arope_mask_embed(mask)) +[model] DiT 加载 28s,18,987,867,392 参数,4093 个 state_dict 键,mask_channel=True,has arope_mask_embed=True +[env] grad_clip=1.0 +[train] 18528 个 clip,每进程 batch 1,8 进程,到 5000 步 +step 1/5000 loss 0.4861 (w 0.6060 mse 0.5936 t 965 new 0.18) lr 5.00e-08 gnorm 2.401 8.40s mem 79.7GB +step 2/5000 loss 0.5881 (w 0.3528 mse 0.3757 t 737 new 0.24) lr 1.00e-07 gnorm 4.468 3.38s mem 81.1GB +step 3/5000 loss 0.4099 (w 0.4785 mse 0.4715 t 934 new 0.21) lr 1.50e-07 gnorm 3.099 2.82s mem 81.1GB +step 4/5000 loss 0.4003 (w 0.4092 mse 0.4069 t 895 new 0.24) lr 2.00e-07 gnorm 2.373 2.83s mem 81.1GB +step 5/5000 loss 0.4392 (w 0.4070 mse 0.4083 t 803 new 0.24) lr 2.50e-07 gnorm 2.632 2.83s mem 81.1GB +step 6/5000 loss 0.5087 (w 0.3529 mse 0.3591 t 588 new 0.22) lr 3.00e-07 gnorm 2.128 2.83s mem 81.1GB +step 7/5000 loss 0.4050 (w 0.4932 mse 0.4929 t 929 new 0.23) lr 3.50e-07 gnorm 2.207 2.83s mem 81.1GB +step 8/5000 loss 0.3769 (w 0.5039 mse 0.5013 t 935 new 0.22) lr 4.00e-07 gnorm 2.054 3.32s mem 81.1GB +step 9/5000 loss 0.5876 (w 0.4631 mse 0.4474 t 584 new 0.24) lr 4.50e-07 gnorm 3.341 2.84s mem 81.1GB +step 10/5000 loss 0.6910 (w 0.8336 mse 0.8207 t 996 new 0.24) lr 5.00e-07 gnorm 3.137 2.83s mem 81.1GB +step 11/5000 loss 0.3257 (w 0.6445 mse 0.6302 t 984 new 0.18) lr 5.50e-07 gnorm 1.657 2.85s mem 81.1GB +step 12/5000 loss 0.3848 (w 0.4506 mse 0.4536 t 962 new 0.17) lr 6.00e-07 gnorm 3.173 2.83s mem 81.1GB +step 13/5000 loss 0.5699 (w 0.3873 mse 0.3708 t 633 new 0.19) lr 6.50e-07 gnorm 2.631 3.21s mem 81.1GB +step 14/5000 loss 0.8126 (w 0.7637 mse 0.7757 t 274 new 0.16) lr 7.00e-07 gnorm 2.806 3.16s mem 81.1GB +step 15/5000 loss 0.4608 (w 0.4275 mse 0.4142 t 904 new 0.14) lr 7.50e-07 gnorm 2.294 2.84s mem 81.1GB +step 16/5000 loss 0.6755 (w 0.8539 mse 0.8538 t 999 new 0.23) lr 8.00e-07 gnorm 2.916 2.85s mem 81.1GB +step 17/5000 loss 0.4314 (w 0.4839 mse 0.4761 t 939 new 0.18) lr 8.50e-07 gnorm 1.937 2.86s mem 81.1GB +step 18/5000 loss 0.3202 (w 0.5759 mse 0.5932 t 989 new 0.15) lr 9.00e-07 gnorm 0.825 2.84s mem 81.1GB +step 19/5000 loss 0.4228 (w 0.7209 mse 0.7413 t 100 new 0.20) lr 9.50e-07 gnorm 2.087 3.22s mem 81.1GB +step 20/5000 loss 0.2761 (w 0.4019 mse 0.3867 t 955 new 0.25) lr 1.00e-06 gnorm 0.816 2.84s mem 81.1GB +step 21/5000 loss 0.5957 (w 0.8206 mse 0.8112 t 995 new 0.20) lr 1.05e-06 gnorm 1.937 2.85s mem 81.1GB +step 22/5000 loss 0.3408 (w 0.4396 mse 0.4250 t 901 new 0.24) lr 1.10e-06 gnorm 1.915 2.85s mem 81.1GB +step 23/5000 loss 0.4749 (w 0.4166 mse 0.4239 t 740 new 0.17) lr 1.15e-06 gnorm 5.485 2.84s mem 81.1GB +step 24/5000 loss 0.3959 (w 0.4688 mse 0.4968 t 930 new 0.22) lr 1.20e-06 gnorm 0.877 2.84s mem 81.1GB +step 25/5000 loss 0.2243 (w 0.2642 mse 0.2606 t 811 new 0.27) lr 1.25e-06 gnorm 1.307 3.63s mem 81.1GB +step 26/5000 loss 0.3961 (w 0.3668 mse 0.3872 t 274 new 0.19) lr 1.30e-06 gnorm 1.357 2.84s mem 81.1GB +step 27/5000 loss 0.3127 (w 0.3399 mse 0.3322 t 916 new 0.22) lr 1.35e-06 gnorm 0.723 2.84s mem 81.1GB +step 28/5000 loss 0.3123 (w 0.4819 mse 0.4735 t 957 new 0.23) lr 1.40e-06 gnorm 0.816 2.84s mem 81.1GB +step 29/5000 loss 0.2226 (w 0.2019 mse 0.2093 t 786 new 0.16) lr 1.45e-06 gnorm 0.578 2.85s mem 81.1GB +step 30/5000 loss 0.3562 (w 0.4016 mse 0.3837 t 947 new 0.21) lr 1.50e-06 gnorm 0.505 2.86s mem 81.1GB +step 31/5000 loss 0.5557 (w 0.5073 mse 0.5175 t 947 new 0.20) lr 1.55e-06 gnorm 1.888 3.42s mem 81.1GB +step 32/5000 loss 0.2924 (w 0.3567 mse 0.3611 t 906 new 0.23) lr 1.60e-06 gnorm 0.470 2.85s mem 81.1GB +step 33/5000 loss 0.3708 (w 0.3026 mse 0.2842 t 790 new 0.15) lr 1.65e-06 gnorm 0.618 2.85s mem 81.1GB +step 34/5000 loss 0.2077 (w 0.3350 mse 0.3609 t 836 new 0.24) lr 1.70e-06 gnorm 0.393 2.85s mem 81.1GB +step 35/5000 loss 0.4652 (w 0.8127 mse 0.7911 t 999 new 0.23) lr 1.75e-06 gnorm 0.592 2.86s mem 81.1GB +step 36/5000 loss 0.3275 (w 0.3658 mse 0.3562 t 828 new 0.25) lr 1.80e-06 gnorm 0.473 3.12s mem 81.1GB +step 37/5000 loss 0.2994 (w 0.7925 mse 0.7691 t 990 new 0.21) lr 1.85e-06 gnorm 0.421 3.45s mem 81.1GB +step 38/5000 loss 0.4964 (w 0.2765 mse 0.2813 t 889 new 0.24) lr 1.90e-06 gnorm 0.640 2.84s mem 81.1GB +step 39/5000 loss 0.5564 (w 0.4414 mse 0.4386 t 470 new 0.23) lr 1.95e-06 gnorm 0.561 2.85s mem 81.1GB +step 40/5000 loss 0.3925 (w 0.3182 mse 0.3147 t 900 new 0.19) lr 2.00e-06 gnorm 0.424 2.85s mem 81.1GB +step 41/5000 loss 0.6666 (w 0.1715 mse 0.1676 t 889 new 0.10) lr 2.05e-06 gnorm 0.950 2.85s mem 81.1GB +step 42/5000 loss 0.2332 (w 0.3300 mse 0.3229 t 835 new 0.09) lr 2.10e-06 gnorm 0.419 3.39s mem 81.1GB +step 43/5000 loss 0.6629 (w 0.4488 mse 0.4602 t 594 new 0.23) lr 2.15e-06 gnorm 0.372 3.69s mem 81.1GB +step 44/5000 loss 0.2562 (w 0.4241 mse 0.4211 t 966 new 0.22) lr 2.20e-06 gnorm 0.583 2.84s mem 81.1GB +step 45/5000 loss 0.2490 (w 0.6391 mse 0.6324 t 990 new 0.23) lr 2.25e-06 gnorm 0.326 2.85s mem 81.1GB +step 46/5000 loss 0.3099 (w 0.4543 mse 0.4503 t 990 new 0.17) lr 2.30e-06 gnorm 0.400 2.86s mem 81.1GB +step 47/5000 loss 0.4115 (w 0.2441 mse 0.2532 t 603 new 0.10) lr 2.35e-06 gnorm 1.050 2.85s mem 81.1GB +step 48/5000 loss 0.1929 (w 0.3161 mse 0.3139 t 924 new 0.13) lr 2.40e-06 gnorm 0.367 3.23s mem 81.1GB +step 49/5000 loss 0.2946 (w 0.3710 mse 0.3691 t 642 new 0.26) lr 2.45e-06 gnorm 3.645 3.44s mem 81.1GB +step 50/5000 loss 0.2455 (w 0.4103 mse 0.4108 t 970 new 0.06) lr 2.50e-06 gnorm 0.369 2.85s mem 81.1GB +step 51/5000 loss 0.5069 (w 0.4648 mse 0.4535 t 372 new 0.21) lr 2.55e-06 gnorm 0.462 2.85s mem 81.1GB +step 52/5000 loss 0.2179 (w 0.1974 mse 0.1964 t 949 new 0.20) lr 2.60e-06 gnorm 0.368 2.84s mem 81.1GB +step 53/5000 loss 0.3612 (w 0.3209 mse 0.3117 t 747 new 0.09) lr 2.65e-06 gnorm 0.502 2.85s mem 81.1GB +step 54/5000 loss 0.3282 (w 0.3530 mse 0.3564 t 991 new 0.14) lr 2.70e-06 gnorm 0.270 3.15s mem 81.1GB +step 55/5000 loss 0.3807 (w 0.4842 mse 0.4878 t 986 new 0.28) lr 2.75e-06 gnorm 0.395 3.16s mem 81.1GB +step 56/5000 loss 0.3549 (w 0.4480 mse 0.4641 t 989 new 0.10) lr 2.80e-06 gnorm 0.218 2.84s mem 81.1GB +step 57/5000 loss 0.5104 (w 0.4635 mse 0.4593 t 980 new 0.19) lr 2.85e-06 gnorm 0.384 2.84s mem 81.1GB +step 58/5000 loss 0.2663 (w 0.3217 mse 0.3446 t 883 new 0.17) lr 2.90e-06 gnorm 0.428 2.85s mem 81.1GB +step 59/5000 loss 0.3714 (w 0.4444 mse 0.4422 t 961 new 0.21) lr 2.95e-06 gnorm 0.271 2.85s mem 81.1GB +step 60/5000 loss 0.2902 (w 0.3174 mse 0.3262 t 891 new 0.21) lr 3.00e-06 gnorm 0.302 3.50s mem 81.1GB +step 61/5000 loss 0.5143 (w 0.3784 mse 0.3782 t 817 new 0.17) lr 3.05e-06 gnorm 0.395 3.16s mem 81.1GB +step 62/5000 loss 0.4374 (w 0.2743 mse 0.2810 t 979 new 0.11) lr 3.10e-06 gnorm 1.492 2.85s mem 81.1GB +step 63/5000 loss 0.3046 (w 0.5708 mse 0.5461 t 984 new 0.16) lr 3.15e-06 gnorm 0.600 2.85s mem 81.1GB +step 64/5000 loss 0.1400 (w 0.4235 mse 0.4252 t 931 new 0.19) lr 3.20e-06 gnorm 0.235 2.84s mem 81.1GB +step 65/5000 loss 0.3910 (w 0.2603 mse 0.2636 t 847 new 0.22) lr 3.25e-06 gnorm 0.328 2.86s mem 81.1GB +step 66/5000 loss 0.2010 (w 0.2126 mse 0.2385 t 966 new 0.19) lr 3.30e-06 gnorm 0.189 3.42s mem 81.1GB +step 67/5000 loss 0.3015 (w 0.1624 mse 0.1684 t 739 new 0.06) lr 3.35e-06 gnorm 0.220 3.15s mem 81.1GB +step 68/5000 loss 0.3260 (w 0.2212 mse 0.2189 t 853 new 0.10) lr 3.40e-06 gnorm 0.656 2.85s mem 81.1GB +step 69/5000 loss 0.4437 (w 0.5279 mse 0.5097 t 989 new 0.23) lr 3.45e-06 gnorm 0.291 2.85s mem 81.1GB +step 70/5000 loss 0.3574 (w 0.4941 mse 0.5126 t 195 new 0.18) lr 3.50e-06 gnorm 0.718 2.86s mem 81.1GB +step 71/5000 loss 0.3822 (w 0.3914 mse 0.3684 t 967 new 0.24) lr 3.55e-06 gnorm 4.229 3.15s mem 81.1GB +step 72/5000 loss 0.3968 (w 0.6845 mse 0.6870 t 999 new 0.26) lr 3.60e-06 gnorm 0.279 3.41s mem 81.1GB +step 73/5000 loss 0.3655 (w 0.2404 mse 0.2331 t 711 new 0.11) lr 3.65e-06 gnorm 0.884 3.08s mem 81.1GB +step 74/5000 loss 0.3534 (w 0.5438 mse 0.5368 t 991 new 0.24) lr 3.70e-06 gnorm 0.216 2.85s mem 81.1GB +step 75/5000 loss 0.3527 (w 0.3017 mse 0.2958 t 929 new 0.08) lr 3.75e-06 gnorm 1.956 2.83s mem 81.1GB +step 76/5000 loss 0.3276 (w 0.5558 mse 0.5689 t 306 new 0.19) lr 3.80e-06 gnorm 0.248 3.03s mem 81.1GB +step 77/5000 loss 0.4286 (w 0.4759 mse 0.4858 t 264 new 0.24) lr 3.85e-06 gnorm 0.274 3.14s mem 81.1GB +step 78/5000 loss 0.3042 (w 0.3522 mse 0.3383 t 965 new 0.23) lr 3.90e-06 gnorm 0.233 3.61s mem 81.1GB +step 79/5000 loss 0.4343 (w 0.5199 mse 0.5074 t 999 new 0.19) lr 3.95e-06 gnorm 0.831 3.09s mem 81.1GB +step 80/5000 loss 0.3962 (w 0.3452 mse 0.3398 t 958 new 0.16) lr 4.00e-06 gnorm 0.177 2.85s mem 81.1GB +step 81/5000 loss 0.2057 (w 0.3970 mse 0.3972 t 977 new 0.22) lr 4.05e-06 gnorm 0.189 2.86s mem 81.1GB +step 82/5000 loss 0.3371 (w 0.2923 mse 0.2934 t 947 new 0.21) lr 4.10e-06 gnorm 0.220 2.86s mem 81.1GB +step 83/5000 loss 0.4596 (w 0.5083 mse 0.4994 t 264 new 0.22) lr 4.15e-06 gnorm 0.185 3.40s mem 81.1GB +step 84/5000 loss 0.4669 (w 0.3894 mse 0.3964 t 795 new 0.25) lr 4.20e-06 gnorm 0.495 3.40s mem 81.1GB +step 85/5000 loss 0.1128 (w 0.2663 mse 0.2707 t 968 new 0.23) lr 4.25e-06 gnorm 0.229 2.87s mem 81.1GB +step 86/5000 loss 0.1858 (w 0.4567 mse 0.4517 t 995 new 0.19) lr 4.30e-06 gnorm 0.181 2.85s mem 81.1GB +step 87/5000 loss 0.2157 (w 0.3112 mse 0.2989 t 985 new 0.14) lr 4.35e-06 gnorm 0.795 2.85s mem 81.1GB +step 88/5000 loss 0.4460 (w 0.2486 mse 0.2366 t 668 new 0.12) lr 4.40e-06 gnorm 0.189 2.85s mem 81.1GB +step 89/5000 loss 0.1111 (w 0.3293 mse 0.3347 t 925 new 0.20) lr 4.45e-06 gnorm 0.164 3.43s mem 81.1GB +step 90/5000 loss 0.2262 (w 0.5411 mse 0.5296 t 980 new 0.24) lr 4.50e-06 gnorm 0.909 3.43s mem 81.1GB +step 91/5000 loss 0.3623 (w 0.4301 mse 0.4182 t 768 new 0.23) lr 4.55e-06 gnorm 0.189 2.83s mem 81.1GB +step 92/5000 loss 0.6060 (w 0.3032 mse 0.3032 t 804 new 0.19) lr 4.60e-06 gnorm 0.215 2.84s mem 81.1GB +step 93/5000 loss 0.2749 (w 0.2239 mse 0.2363 t 737 new 0.11) lr 4.65e-06 gnorm 0.241 2.85s mem 81.1GB +step 94/5000 loss 0.3862 (w 0.1665 mse 0.1929 t 564 new 0.19) lr 4.70e-06 gnorm 0.382 2.86s mem 81.1GB +step 95/5000 loss 0.3081 (w 0.2650 mse 0.2682 t 929 new 0.18) lr 4.75e-06 gnorm 0.227 3.64s mem 81.1GB +step 96/5000 loss 0.2426 (w 0.4234 mse 0.4359 t 985 new 0.22) lr 4.80e-06 gnorm 0.600 3.17s mem 81.1GB +step 97/5000 loss 0.2893 (w 0.4623 mse 0.4443 t 973 new 0.22) lr 4.85e-06 gnorm 0.255 2.86s mem 81.1GB +step 98/5000 loss 0.4345 (w 0.3897 mse 0.3975 t 551 new 0.23) lr 4.90e-06 gnorm 1.586 2.86s mem 81.1GB +step 99/5000 loss 0.3379 (w 0.1957 mse 0.2119 t 807 new 0.19) lr 4.95e-06 gnorm 0.156 2.86s mem 81.1GB +step 100/5000 loss 0.4540 (w 0.3373 mse 0.3332 t 861 new 0.20) lr 5.00e-06 gnorm 0.172 2.85s mem 81.1GB +step 101/5000 loss 0.2996 (w 0.2863 mse 0.2873 t 923 new 0.22) lr 5.05e-06 gnorm 0.178 3.67s mem 81.1GB +step 102/5000 loss 0.3822 (w 0.3545 mse 0.3649 t 850 new 0.20) lr 5.10e-06 gnorm 0.230 3.07s mem 81.1GB +step 103/5000 loss 0.3137 (w 0.1595 mse 0.1749 t 629 new 0.20) lr 5.15e-06 gnorm 0.177 2.85s mem 81.1GB +step 104/5000 loss 0.1996 (w 0.2940 mse 0.3038 t 992 new 0.14) lr 5.20e-06 gnorm 0.140 2.86s mem 81.1GB +step 105/5000 loss 0.2048 (w 0.1580 mse 0.1623 t 892 new 0.23) lr 5.25e-06 gnorm 0.182 2.85s mem 81.1GB +step 106/5000 loss 0.2622 (w 0.3017 mse 0.3113 t 980 new 0.12) lr 5.30e-06 gnorm 2.489 3.15s mem 81.1GB +step 107/5000 loss 0.4543 (w 0.2351 mse 0.2415 t 864 new 0.22) lr 5.35e-06 gnorm 0.218 3.46s mem 81.1GB +step 108/5000 loss 0.2435 (w 0.6203 mse 0.5894 t 981 new 0.23) lr 5.40e-06 gnorm 0.215 3.09s mem 81.1GB +step 109/5000 loss 0.3149 (w 0.1908 mse 0.2173 t 984 new 0.21) lr 5.45e-06 gnorm 0.180 2.85s mem 81.1GB +step 110/5000 loss 0.5239 (w 0.4164 mse 0.4034 t 915 new 0.21) lr 5.50e-06 gnorm 0.269 2.84s mem 81.1GB +step 111/5000 loss 0.2503 (w 0.3199 mse 0.3133 t 869 new 0.22) lr 5.55e-06 gnorm 0.237 2.84s mem 81.1GB +step 112/5000 loss 0.2550 (w 0.4324 mse 0.4264 t 985 new 0.18) lr 5.60e-06 gnorm 0.146 3.05s mem 81.1GB +step 113/5000 loss 0.3229 (w 0.2215 mse 0.2383 t 927 new 0.27) lr 5.65e-06 gnorm 0.183 3.45s mem 81.1GB +step 114/5000 loss 0.4666 (w 0.2984 mse 0.2909 t 776 new 0.20) lr 5.70e-06 gnorm 0.213 2.85s mem 81.1GB +step 115/5000 loss 0.2823 (w 0.4064 mse 0.3888 t 995 new 0.13) lr 5.75e-06 gnorm 0.136 2.87s mem 81.1GB +step 116/5000 loss 0.4260 (w 0.3397 mse 0.3377 t 750 new 0.21) lr 5.80e-06 gnorm 0.228 2.85s mem 81.1GB +step 117/5000 loss 0.3537 (w 0.3117 mse 0.3282 t 647 new 0.23) lr 5.85e-06 gnorm 0.208 2.85s mem 81.1GB +step 118/5000 loss 0.4365 (w 0.3298 mse 0.3254 t 899 new 0.18) lr 5.90e-06 gnorm 0.251 3.13s mem 81.1GB +step 119/5000 loss 0.2991 (w 0.4657 mse 0.4611 t 989 new 0.21) lr 5.95e-06 gnorm 0.413 3.54s mem 81.1GB +step 120/5000 loss 0.3501 (w 0.3830 mse 0.3727 t 955 new 0.19) lr 6.00e-06 gnorm 0.152 2.85s mem 81.1GB +step 121/5000 loss 0.3811 (w 0.3842 mse 0.3720 t 960 new 0.20) lr 6.05e-06 gnorm 0.319 2.83s mem 81.1GB +step 122/5000 loss 0.2177 (w 0.2863 mse 0.2726 t 925 new 0.19) lr 6.10e-06 gnorm 0.193 2.84s mem 81.1GB +step 123/5000 loss 0.2634 (w 0.3181 mse 0.3223 t 698 new 0.17) lr 6.15e-06 gnorm 0.569 2.84s mem 81.1GB +step 124/5000 loss 0.3855 (w 0.2704 mse 0.2735 t 794 new 0.26) lr 6.20e-06 gnorm 0.265 3.34s mem 81.1GB +step 125/5000 loss 0.3770 (w 0.2242 mse 0.2158 t 884 new 0.15) lr 6.25e-06 gnorm 0.397 3.43s mem 81.1GB +step 126/5000 loss 0.4231 (w 0.2533 mse 0.2344 t 905 new 0.15) lr 6.30e-06 gnorm 0.132 2.85s mem 81.1GB +step 127/5000 loss 0.3607 (w 0.2896 mse 0.2955 t 935 new 0.20) lr 6.35e-06 gnorm 0.158 2.86s mem 81.1GB +step 128/5000 loss 0.3098 (w 0.2124 mse 0.2079 t 788 new 0.22) lr 6.40e-06 gnorm 0.177 2.86s mem 81.1GB +step 129/5000 loss 0.3650 (w 0.3816 mse 0.3928 t 383 new 0.21) lr 6.45e-06 gnorm 0.599 2.85s mem 81.1GB +step 130/5000 loss 0.4048 (w 0.1898 mse 0.1855 t 774 new 0.22) lr 6.50e-06 gnorm 0.199 3.39s mem 81.1GB +step 131/5000 loss 0.3782 (w 0.4312 mse 0.4331 t 375 new 0.25) lr 6.55e-06 gnorm 0.155 3.39s mem 81.1GB +step 132/5000 loss 0.3745 (w 0.2679 mse 0.2715 t 919 new 0.24) lr 6.60e-06 gnorm 0.283 2.85s mem 81.1GB +step 133/5000 loss 0.2460 (w 0.2563 mse 0.2582 t 730 new 0.25) lr 6.65e-06 gnorm 0.195 2.85s mem 81.1GB +step 134/5000 loss 0.5240 (w 0.3537 mse 0.3675 t 662 new 0.27) lr 6.70e-06 gnorm 0.181 2.84s mem 81.1GB +step 135/5000 loss 0.4219 (w 0.3893 mse 0.3795 t 626 new 0.19) lr 6.75e-06 gnorm 0.267 3.16s mem 81.1GB +step 136/5000 loss 0.2848 (w 0.3328 mse 0.3234 t 728 new 0.19) lr 6.80e-06 gnorm 0.164 3.39s mem 81.1GB +step 137/5000 loss 0.3908 (w 0.3502 mse 0.3421 t 807 new 0.26) lr 6.85e-06 gnorm 0.218 3.10s mem 81.1GB +step 138/5000 loss 0.2642 (w 0.2798 mse 0.2836 t 988 new 0.27) lr 6.90e-06 gnorm 1.126 2.85s mem 81.1GB +step 139/5000 loss 0.2751 (w 0.2741 mse 0.2822 t 816 new 0.24) lr 6.95e-06 gnorm 0.252 2.85s mem 81.1GB +step 140/5000 loss 0.3060 (w 0.7059 mse 0.7127 t 183 new 0.26) lr 7.00e-06 gnorm 0.136 2.86s mem 81.1GB +step 141/5000 loss 0.3503 (w 0.2854 mse 0.2893 t 629 new 0.21) lr 7.05e-06 gnorm 0.205 3.09s mem 81.1GB +step 142/5000 loss 0.1897 (w 0.2530 mse 0.2408 t 971 new 0.14) lr 7.10e-06 gnorm 0.156 3.33s mem 81.1GB +step 143/5000 loss 0.3988 (w 0.3798 mse 0.3827 t 968 new 0.22) lr 7.15e-06 gnorm 0.315 3.12s mem 81.1GB +step 144/5000 loss 0.5453 (w 0.2968 mse 0.3016 t 722 new 0.19) lr 7.20e-06 gnorm 0.860 2.85s mem 81.1GB +step 145/5000 loss 0.1846 (w 0.1395 mse 0.1411 t 980 new 0.10) lr 7.25e-06 gnorm 0.227 2.84s mem 81.1GB +step 146/5000 loss 0.1612 (w 0.2596 mse 0.2552 t 959 new 0.23) lr 7.30e-06 gnorm 0.203 2.84s mem 81.1GB +step 147/5000 loss 0.3400 (w 0.3767 mse 0.3916 t 301 new 0.18) lr 7.35e-06 gnorm 0.144 3.61s mem 81.1GB +step 148/5000 loss 0.3231 (w 0.5320 mse 0.5266 t 993 new 0.14) lr 7.40e-06 gnorm 0.233 3.39s mem 81.1GB +step 149/5000 loss 0.2870 (w 0.3157 mse 0.3105 t 624 new 0.24) lr 7.45e-06 gnorm 0.163 2.83s mem 81.1GB +step 150/5000 loss 0.2175 (w 0.2978 mse 0.2980 t 941 new 0.21) lr 7.50e-06 gnorm 0.182 2.85s mem 81.1GB +step 151/5000 loss 0.2659 (w 0.2773 mse 0.2708 t 905 new 0.22) lr 7.55e-06 gnorm 0.192 2.85s mem 81.1GB +step 152/5000 loss 0.2522 (w 0.2609 mse 0.2702 t 946 new 0.15) lr 7.60e-06 gnorm 0.159 2.85s mem 81.1GB +step 153/5000 loss 0.4329 (w 0.3698 mse 0.3596 t 965 new 0.22) lr 7.65e-06 gnorm 0.295 3.60s mem 81.1GB +step 154/5000 loss 0.2310 (w 0.2809 mse 0.2692 t 835 new 0.26) lr 7.70e-06 gnorm 0.163 3.55s mem 81.1GB +step 155/5000 loss 0.3405 (w 0.2739 mse 0.2776 t 828 new 0.22) lr 7.75e-06 gnorm 0.323 2.86s mem 81.1GB +step 156/5000 loss 0.3376 (w 0.2103 mse 0.2234 t 971 new 0.22) lr 7.80e-06 gnorm 0.180 2.85s mem 81.1GB +step 157/5000 loss 0.0803 (w 0.1731 mse 0.1870 t 905 new 0.10) lr 7.85e-06 gnorm 0.136 2.86s mem 81.1GB +step 158/5000 loss 0.5152 (w 0.2462 mse 0.2423 t 814 new 0.22) lr 7.90e-06 gnorm 0.227 2.86s mem 81.1GB +step 159/5000 loss 0.0977 (w 0.3580 mse 0.3512 t 992 new 0.17) lr 7.95e-06 gnorm 0.192 3.45s mem 81.1GB +step 160/5000 loss 0.4523 (w 0.3122 mse 0.3115 t 951 new 0.19) lr 8.00e-06 gnorm 1.709 3.63s mem 81.1GB +step 161/5000 loss 0.3057 (w 0.2789 mse 0.2659 t 865 new 0.20) lr 8.05e-06 gnorm 0.191 2.84s mem 81.1GB +step 162/5000 loss 0.2401 (w 0.5059 mse 0.5162 t 288 new 0.22) lr 8.10e-06 gnorm 0.159 2.85s mem 81.1GB +step 163/5000 loss 0.3599 (w 0.2653 mse 0.2723 t 955 new 0.21) lr 8.15e-06 gnorm 0.256 2.86s mem 81.1GB +step 164/5000 loss 0.4516 (w 0.2749 mse 0.2751 t 698 new 0.25) lr 8.20e-06 gnorm 0.302 3.13s mem 81.1GB +step 165/5000 loss 0.3504 (w 0.2964 mse 0.2853 t 861 new 0.19) lr 8.25e-06 gnorm 0.274 3.36s mem 81.1GB +step 166/5000 loss 0.3640 (w 0.2145 mse 0.2200 t 677 new 0.21) lr 8.30e-06 gnorm 0.154 3.17s mem 81.1GB +step 167/5000 loss 0.1866 (w 0.1894 mse 0.1872 t 768 new 0.23) lr 8.35e-06 gnorm 0.592 2.84s mem 81.1GB +step 168/5000 loss 0.2538 (w 0.2615 mse 0.2543 t 828 new 0.27) lr 8.40e-06 gnorm 0.174 2.86s mem 81.1GB +step 169/5000 loss 0.4088 (w 0.3044 mse 0.3135 t 964 new 0.18) lr 8.45e-06 gnorm 0.243 2.85s mem 81.1GB +step 170/5000 loss 0.2084 (w 0.2997 mse 0.2908 t 955 new 0.25) lr 8.50e-06 gnorm 0.231 3.12s mem 81.1GB +step 171/5000 loss 0.2935 (w 0.2549 mse 0.2700 t 794 new 0.13) lr 8.55e-06 gnorm 0.151 3.59s mem 81.1GB +step 172/5000 loss 0.4331 (w 0.7124 mse 0.7201 t 165 new 0.12) lr 8.60e-06 gnorm 0.173 3.40s mem 81.1GB +step 173/5000 loss 0.4222 (w 0.2808 mse 0.2912 t 648 new 0.15) lr 8.65e-06 gnorm 0.225 2.85s mem 81.1GB +step 174/5000 loss 0.4926 (w 0.3494 mse 0.3449 t 659 new 0.23) lr 8.70e-06 gnorm 0.170 2.86s mem 81.1GB +step 175/5000 loss 0.2882 (w 0.2737 mse 0.2718 t 709 new 0.17) lr 8.75e-06 gnorm 0.481 2.85s mem 81.1GB +step 176/5000 loss 0.3496 (w 0.2748 mse 0.2679 t 959 new 0.24) lr 8.80e-06 gnorm 0.155 3.13s mem 81.1GB +step 177/5000 loss 0.3720 (w 0.3124 mse 0.2981 t 912 new 0.12) lr 8.85e-06 gnorm 0.209 3.61s mem 81.1GB +step 178/5000 loss 0.2066 (w 0.4497 mse 0.4425 t 976 new 0.17) lr 8.90e-06 gnorm 0.189 3.07s mem 81.1GB +step 179/5000 loss 0.2791 (w 0.1785 mse 0.1907 t 902 new 0.26) lr 8.95e-06 gnorm 0.280 2.84s mem 81.1GB +step 180/5000 loss 0.2662 (w 0.2204 mse 0.2291 t 924 new 0.19) lr 9.00e-06 gnorm 0.196 2.84s mem 81.1GB +step 181/5000 loss 0.3470 (w 0.1994 mse 0.1905 t 864 new 0.20) lr 9.05e-06 gnorm 0.149 2.84s mem 81.1GB +step 182/5000 loss 0.3427 (w 0.3115 mse 0.2999 t 742 new 0.23) lr 9.10e-06 gnorm 0.768 3.09s mem 81.1GB +step 183/5000 loss 0.3997 (w 0.3071 mse 0.3059 t 934 new 0.15) lr 9.15e-06 gnorm 0.514 3.57s mem 81.1GB +step 184/5000 loss 0.3915 (w 0.3554 mse 0.3667 t 992 new 0.09) lr 9.20e-06 gnorm 0.196 3.03s mem 81.1GB +step 185/5000 loss 0.4247 (w 0.3115 mse 0.2988 t 629 new 0.24) lr 9.25e-06 gnorm 0.179 2.84s mem 81.1GB +step 186/5000 loss 0.4660 (w 0.5799 mse 0.5827 t 120 new 0.24) lr 9.30e-06 gnorm 0.162 2.85s mem 81.1GB +step 187/5000 loss 0.2322 (w 0.1964 mse 0.2055 t 885 new 0.23) lr 9.35e-06 gnorm 0.243 2.85s mem 81.1GB +step 188/5000 loss 0.2233 (w 0.2200 mse 0.2285 t 902 new 0.21) lr 9.40e-06 gnorm 0.144 3.30s mem 81.1GB +step 189/5000 loss 0.4319 (w 0.4711 mse 0.4549 t 1000 new 0.19) lr 9.45e-06 gnorm 0.256 3.44s mem 81.1GB +step 190/5000 loss 0.1883 (w 0.4845 mse 0.5169 t 982 new 0.18) lr 9.50e-06 gnorm 0.149 3.06s mem 81.1GB +step 191/5000 loss 0.2264 (w 0.3960 mse 0.3939 t 961 new 0.18) lr 9.55e-06 gnorm 0.188 2.83s mem 81.1GB +step 192/5000 loss 0.2489 (w 0.3299 mse 0.3251 t 936 new 0.22) lr 9.60e-06 gnorm 0.141 2.84s mem 81.1GB +step 193/5000 loss 0.1559 (w 0.2782 mse 0.2644 t 933 new 0.16) lr 9.65e-06 gnorm 0.201 2.84s mem 81.1GB +step 194/5000 loss 0.3213 (w 0.2599 mse 0.2485 t 797 new 0.26) lr 9.70e-06 gnorm 0.662 3.41s mem 81.1GB +step 195/5000 loss 0.3077 (w 0.2050 mse 0.2188 t 884 new 0.13) lr 9.75e-06 gnorm 0.183 3.48s mem 81.1GB +step 196/5000 loss 0.4824 (w 0.3265 mse 0.3197 t 648 new 0.20) lr 9.80e-06 gnorm 0.720 3.13s mem 81.1GB +step 197/5000 loss 0.2614 (w 0.5364 mse 0.5289 t 971 new 0.20) lr 9.85e-06 gnorm 0.183 2.86s mem 81.1GB +step 198/5000 loss 0.1360 (w 0.2257 mse 0.2326 t 811 new 0.10) lr 9.90e-06 gnorm 0.143 2.86s mem 81.1GB +step 199/5000 loss 0.4941 (w 0.2442 mse 0.2392 t 508 new 0.21) lr 9.95e-06 gnorm 0.413 2.86s mem 81.1GB +step 200/5000 loss 0.3911 (w 0.7264 mse 0.7169 t 140 new 0.26) lr 1.00e-05 gnorm 0.138 3.43s mem 81.1GB +step 201/5000 loss 0.3964 (w 0.2569 mse 0.2577 t 730 new 0.19) lr 1.00e-05 gnorm 0.152 3.40s mem 81.1GB +step 202/5000 loss 0.3347 (w 0.4034 mse 0.3921 t 447 new 0.19) lr 1.00e-05 gnorm 0.260 3.12s mem 81.1GB +step 203/5000 loss 0.1886 (w 0.2210 mse 0.2195 t 871 new 0.16) lr 1.00e-05 gnorm 0.173 2.85s mem 81.1GB +step 204/5000 loss 0.2721 (w 0.2906 mse 0.2818 t 895 new 0.12) lr 1.00e-05 gnorm 0.270 2.85s mem 81.1GB +step 205/5000 loss 0.2460 (w 0.3507 mse 0.3520 t 931 new 0.20) lr 1.00e-05 gnorm 0.218 3.12s mem 81.1GB +step 206/5000 loss 0.3336 (w 0.5145 mse 0.5058 t 996 new 0.22) lr 1.00e-05 gnorm 0.180 3.33s mem 81.1GB +step 207/5000 loss 0.3080 (w 0.1863 mse 0.1843 t 868 new 0.22) lr 1.00e-05 gnorm 0.216 3.35s mem 81.1GB +step 208/5000 loss 0.3249 (w 0.3141 mse 0.3293 t 967 new 0.23) lr 1.00e-05 gnorm 0.141 2.85s mem 81.1GB +step 209/5000 loss 0.2254 (w 0.2726 mse 0.2651 t 802 new 0.19) lr 1.00e-05 gnorm 0.200 2.86s mem 81.1GB +step 210/5000 loss 0.2824 (w 0.3084 mse 0.3238 t 344 new 0.22) lr 1.00e-05 gnorm 0.218 2.84s mem 81.1GB +step 211/5000 loss 0.1226 (w 0.3272 mse 0.3377 t 992 new 0.10) lr 1.00e-05 gnorm 0.180 3.04s mem 81.1GB +step 212/5000 loss 0.4205 (w 0.3450 mse 0.3376 t 528 new 0.26) lr 1.00e-05 gnorm 0.162 3.38s mem 81.1GB +step 213/5000 loss 0.0962 (w 0.4233 mse 0.4426 t 994 new 0.17) lr 1.00e-05 gnorm 0.171 4.37s mem 81.1GB +step 214/5000 loss 0.3360 (w 0.2978 mse 0.2993 t 968 new 0.05) lr 1.00e-05 gnorm 0.180 2.85s mem 81.1GB +step 215/5000 loss 0.2217 (w 0.2113 mse 0.1973 t 898 new 0.22) lr 1.00e-05 gnorm 0.147 2.86s mem 81.1GB +step 216/5000 loss 0.3162 (w 0.3479 mse 0.3576 t 904 new 0.21) lr 1.00e-05 gnorm 0.355 2.86s mem 81.1GB +step 217/5000 loss 0.3771 (w 0.3106 mse 0.2975 t 791 new 0.28) lr 1.00e-05 gnorm 0.199 3.11s mem 81.1GB +step 218/5000 loss 0.1844 (w 0.1467 mse 0.1486 t 760 new 0.20) lr 1.00e-05 gnorm 0.156 3.47s mem 81.1GB +step 219/5000 loss 0.2923 (w 0.1965 mse 0.1981 t 748 new 0.25) lr 1.00e-05 gnorm 0.144 3.12s mem 81.1GB +step 220/5000 loss 0.3083 (w 0.2697 mse 0.2661 t 866 new 0.23) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +step 221/5000 loss 0.2387 (w 0.2061 mse 0.2062 t 768 new 0.21) lr 1.00e-05 gnorm 0.205 2.84s mem 81.1GB +step 222/5000 loss 0.3572 (w 0.2224 mse 0.2260 t 914 new 0.08) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 223/5000 loss 0.3061 (w 0.2669 mse 0.2631 t 917 new 0.07) lr 1.00e-05 gnorm 0.147 3.03s mem 81.1GB +step 224/5000 loss 0.4151 (w 0.3152 mse 0.2977 t 950 new 0.23) lr 1.00e-05 gnorm 0.161 3.57s mem 81.1GB +step 225/5000 loss 0.0853 (w 0.5918 mse 0.5614 t 997 new 0.25) lr 1.00e-05 gnorm 0.224 3.04s mem 81.1GB +step 226/5000 loss 0.3007 (w 0.3024 mse 0.3004 t 912 new 0.24) lr 1.00e-05 gnorm 0.190 2.84s mem 81.1GB +step 227/5000 loss 0.1985 (w 0.3786 mse 0.3640 t 971 new 0.21) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +step 228/5000 loss 0.3743 (w 0.4051 mse 0.3979 t 998 new 0.22) lr 1.00e-05 gnorm 0.270 2.85s mem 81.1GB +step 229/5000 loss 0.1937 (w 0.2593 mse 0.2701 t 980 new 0.11) lr 1.00e-05 gnorm 0.204 3.26s mem 81.1GB +step 230/5000 loss 0.1284 (w 0.1805 mse 0.1876 t 922 new 0.24) lr 1.00e-05 gnorm 0.177 3.70s mem 81.1GB +step 231/5000 loss 0.1476 (w 0.3310 mse 0.3204 t 859 new 0.15) lr 1.00e-05 gnorm 0.194 3.05s mem 81.1GB +step 232/5000 loss 0.5343 (w 0.3668 mse 0.3608 t 985 new 0.22) lr 1.00e-05 gnorm 0.261 2.85s mem 81.1GB +step 233/5000 loss 0.2443 (w 0.2551 mse 0.2525 t 858 new 0.27) lr 1.00e-05 gnorm 0.133 2.86s mem 81.1GB +step 234/5000 loss 0.3288 (w 0.3885 mse 0.3906 t 964 new 0.18) lr 1.00e-05 gnorm 0.302 2.86s mem 81.1GB +step 235/5000 loss 0.3703 (w 0.2522 mse 0.2911 t 999 new 0.20) lr 1.00e-05 gnorm 0.221 3.38s mem 81.1GB +step 236/5000 loss 0.2469 (w 0.3355 mse 0.3479 t 957 new 0.18) lr 1.00e-05 gnorm 0.314 3.45s mem 81.1GB +step 237/5000 loss 0.2776 (w 0.2903 mse 0.2743 t 846 new 0.18) lr 1.00e-05 gnorm 0.181 3.08s mem 81.1GB +step 238/5000 loss 0.3251 (w 0.1943 mse 0.1932 t 760 new 0.10) lr 1.00e-05 gnorm 0.210 2.83s mem 81.1GB +step 239/5000 loss 0.1921 (w 0.2287 mse 0.2403 t 352 new 0.09) lr 1.00e-05 gnorm 0.230 2.85s mem 81.1GB +step 240/5000 loss 0.3614 (w 0.2528 mse 0.2379 t 654 new 0.14) lr 1.00e-05 gnorm 0.167 3.02s mem 81.1GB +step 241/5000 loss 0.4915 (w 0.3318 mse 0.3249 t 525 new 0.22) lr 1.00e-05 gnorm 0.213 3.32s mem 81.1GB +step 242/5000 loss 0.2324 (w 0.2949 mse 0.3014 t 957 new 0.21) lr 1.00e-05 gnorm 0.180 3.51s mem 81.1GB +step 243/5000 loss 0.3165 (w 0.2958 mse 0.2959 t 848 new 0.20) lr 1.00e-05 gnorm 0.208 3.12s mem 81.1GB +step 244/5000 loss 0.5036 (w 0.2191 mse 0.2217 t 546 new 0.23) lr 1.00e-05 gnorm 0.221 2.83s mem 81.1GB +step 245/5000 loss 0.3186 (w 0.2754 mse 0.2785 t 473 new 0.11) lr 1.00e-05 gnorm 0.787 2.84s mem 81.1GB +step 246/5000 loss 0.3579 (w 0.4378 mse 0.4242 t 368 new 0.23) lr 1.00e-05 gnorm 0.317 3.04s mem 81.1GB +step 247/5000 loss 0.3161 (w 0.6410 mse 0.6050 t 991 new 0.22) lr 1.00e-05 gnorm 0.175 3.29s mem 81.1GB +step 248/5000 loss 0.3831 (w 0.3108 mse 0.2979 t 751 new 0.22) lr 1.00e-05 gnorm 0.171 3.65s mem 81.1GB +step 249/5000 loss 0.3049 (w 0.3090 mse 0.3216 t 323 new 0.25) lr 1.00e-05 gnorm 0.195 2.85s mem 81.1GB +step 250/5000 loss 0.2290 (w 0.2432 mse 0.2527 t 476 new 0.12) lr 1.00e-05 gnorm 0.158 2.85s mem 81.1GB +step 251/5000 loss 0.3895 (w 0.2977 mse 0.2966 t 660 new 0.18) lr 1.00e-05 gnorm 0.139 2.86s mem 81.1GB +step 252/5000 loss 0.2284 (w 0.3163 mse 0.3150 t 899 new 0.23) lr 1.00e-05 gnorm 0.167 3.04s mem 81.1GB +step 253/5000 loss 0.3826 (w 0.2714 mse 0.2601 t 663 new 0.27) lr 1.00e-05 gnorm 0.174 3.44s mem 81.1GB +step 254/5000 loss 0.2572 (w 0.2703 mse 0.2675 t 906 new 0.20) lr 1.00e-05 gnorm 0.167 3.45s mem 81.1GB +step 255/5000 loss 0.4237 (w 0.2561 mse 0.2567 t 735 new 0.21) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +step 256/5000 loss 0.1916 (w 0.1372 mse 0.1437 t 969 new 0.13) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +step 257/5000 loss 0.1500 (w 0.1982 mse 0.1962 t 734 new 0.12) lr 1.00e-05 gnorm 0.197 2.85s mem 81.1GB +step 258/5000 loss 0.3177 (w 0.3399 mse 0.3298 t 936 new 0.25) lr 1.00e-05 gnorm 0.192 3.08s mem 81.1GB +step 259/5000 loss 0.2830 (w 0.2839 mse 0.2806 t 856 new 0.23) lr 1.00e-05 gnorm 0.175 3.08s mem 81.1GB +step 260/5000 loss 0.4098 (w 0.1868 mse 0.2039 t 760 new 0.17) lr 1.00e-05 gnorm 0.135 3.45s mem 81.1GB +step 261/5000 loss 0.3744 (w 0.3024 mse 0.2979 t 744 new 0.20) lr 1.00e-05 gnorm 0.221 2.85s mem 81.1GB +step 262/5000 loss 0.1506 (w 0.2783 mse 0.2663 t 927 new 0.22) lr 1.00e-05 gnorm 0.713 2.86s mem 81.1GB +step 263/5000 loss 0.2526 (w 0.3728 mse 0.3607 t 952 new 0.22) lr 1.00e-05 gnorm 0.168 2.86s mem 81.1GB +step 264/5000 loss 0.1724 (w 0.1891 mse 0.1957 t 693 new 0.23) lr 1.00e-05 gnorm 0.163 3.41s mem 81.1GB +step 265/5000 loss 0.3875 (w 0.2897 mse 0.3083 t 935 new 0.26) lr 1.00e-05 gnorm 2.454 3.08s mem 81.1GB +step 266/5000 loss 0.1413 (w 0.2425 mse 0.2438 t 768 new 0.16) lr 1.00e-05 gnorm 0.195 3.73s mem 81.1GB +step 267/5000 loss 0.2547 (w 0.3805 mse 0.3850 t 988 new 0.15) lr 1.00e-05 gnorm 0.175 2.85s mem 81.1GB +step 268/5000 loss 0.2492 (w 0.2213 mse 0.2268 t 989 new 0.18) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +step 269/5000 loss 0.3160 (w 0.4882 mse 0.4926 t 976 new 0.18) lr 1.00e-05 gnorm 0.178 2.86s mem 81.1GB +step 270/5000 loss 0.2865 (w 0.2796 mse 0.2803 t 916 new 0.15) lr 1.00e-05 gnorm 0.452 3.39s mem 81.1GB +step 271/5000 loss 0.2835 (w 0.3315 mse 0.3166 t 700 new 0.28) lr 1.00e-05 gnorm 0.261 3.09s mem 81.1GB +step 272/5000 loss 0.3366 (w 0.3229 mse 0.3225 t 958 new 0.08) lr 1.00e-05 gnorm 0.220 3.62s mem 81.1GB +step 273/5000 loss 0.3078 (w 0.1884 mse 0.1861 t 989 new 0.22) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +step 274/5000 loss 0.3375 (w 0.2408 mse 0.2395 t 974 new 0.16) lr 1.00e-05 gnorm 0.665 2.85s mem 81.1GB +step 275/5000 loss 0.3727 (w 0.2836 mse 0.2821 t 709 new 0.19) lr 1.00e-05 gnorm 0.199 2.85s mem 81.1GB +step 276/5000 loss 0.2048 (w 0.3794 mse 0.4120 t 153 new 0.16) lr 1.00e-05 gnorm 0.146 3.28s mem 81.1GB +step 277/5000 loss 0.3245 (w 0.1582 mse 0.1573 t 749 new 0.20) lr 1.00e-05 gnorm 0.168 3.37s mem 81.1GB +step 278/5000 loss 0.3657 (w 0.1842 mse 0.1988 t 927 new 0.20) lr 1.00e-05 gnorm 0.160 3.45s mem 81.1GB +step 279/5000 loss 0.2563 (w 0.3233 mse 0.3033 t 983 new 0.23) lr 1.00e-05 gnorm 0.201 2.85s mem 81.1GB +step 280/5000 loss 0.4307 (w 0.4868 mse 0.4997 t 159 new 0.21) lr 1.00e-05 gnorm 0.201 2.84s mem 81.1GB +step 281/5000 loss 0.2929 (w 0.3004 mse 0.3096 t 297 new 0.29) lr 1.00e-05 gnorm 0.176 2.85s mem 81.1GB +step 282/5000 loss 0.1334 (w 0.1836 mse 0.1833 t 905 new 0.20) lr 1.00e-05 gnorm 0.152 3.40s mem 81.1GB +step 283/5000 loss 0.3935 (w 0.4644 mse 0.4575 t 383 new 0.19) lr 1.00e-05 gnorm 0.174 3.09s mem 81.1GB +step 284/5000 loss 0.1067 (w 0.1761 mse 0.1848 t 985 new 0.12) lr 1.00e-05 gnorm 0.145 3.52s mem 81.1GB +step 285/5000 loss 0.2760 (w 0.2215 mse 0.2302 t 951 new 0.08) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +step 286/5000 loss 0.2472 (w 0.2184 mse 0.2340 t 411 new 0.22) lr 1.00e-05 gnorm 0.129 2.85s mem 81.1GB +step 287/5000 loss 0.3801 (w 0.2908 mse 0.2740 t 920 new 0.21) lr 1.00e-05 gnorm 0.185 3.08s mem 81.1GB +step 288/5000 loss 0.2547 (w 0.1448 mse 0.1505 t 683 new 0.23) lr 1.00e-05 gnorm 0.129 3.34s mem 81.1GB +step 289/5000 loss 0.3462 (w 0.3011 mse 0.2884 t 903 new 0.23) lr 1.00e-05 gnorm 0.163 3.38s mem 81.1GB +step 290/5000 loss 0.0863 (w 0.3164 mse 0.3047 t 937 new 0.24) lr 1.00e-05 gnorm 0.162 3.28s mem 81.1GB +step 291/5000 loss 0.3008 (w 0.2336 mse 0.2318 t 948 new 0.20) lr 1.00e-05 gnorm 0.156 2.85s mem 81.1GB +step 292/5000 loss 0.1553 (w 0.2021 mse 0.2089 t 945 new 0.25) lr 1.00e-05 gnorm 0.573 2.86s mem 81.1GB +step 293/5000 loss 0.3642 (w 0.2524 mse 0.2642 t 551 new 0.23) lr 1.00e-05 gnorm 0.226 3.11s mem 81.1GB +step 294/5000 loss 0.2259 (w 0.1922 mse 0.2112 t 955 new 0.14) lr 1.00e-05 gnorm 0.205 3.24s mem 81.1GB +step 295/5000 loss 0.2320 (w 0.2677 mse 0.2604 t 610 new 0.26) lr 1.00e-05 gnorm 0.155 3.36s mem 81.1GB +step 296/5000 loss 0.1102 (w 0.4511 mse 0.4609 t 997 new 0.17) lr 1.00e-05 gnorm 0.314 3.22s mem 81.1GB +step 297/5000 loss 0.2814 (w 0.4093 mse 0.4026 t 970 new 0.19) lr 1.00e-05 gnorm 0.213 2.85s mem 81.1GB +step 298/5000 loss 0.2858 (w 0.2094 mse 0.2238 t 861 new 0.22) lr 1.00e-05 gnorm 0.210 2.86s mem 81.1GB +step 299/5000 loss 0.3502 (w 0.3085 mse 0.2852 t 933 new 0.20) lr 1.00e-05 gnorm 0.175 3.34s mem 81.1GB +step 300/5000 loss 0.3558 (w 0.2942 mse 0.2817 t 732 new 0.18) lr 1.00e-05 gnorm 0.203 3.30s mem 81.1GB +step 301/5000 loss 0.1624 (w 0.3861 mse 0.3898 t 991 new 0.25) lr 1.00e-05 gnorm 0.216 3.40s mem 81.1GB +step 302/5000 loss 0.2519 (w 0.6680 mse 0.6663 t 177 new 0.22) lr 1.00e-05 gnorm 0.228 3.15s mem 81.1GB +step 303/5000 loss 0.3118 (w 0.2203 mse 0.2234 t 712 new 0.14) lr 1.00e-05 gnorm 0.299 2.84s mem 81.1GB +step 304/5000 loss 0.3110 (w 0.2080 mse 0.2060 t 762 new 0.16) lr 1.00e-05 gnorm 0.172 2.85s mem 81.1GB +step 305/5000 loss 0.2827 (w 0.1677 mse 0.1649 t 847 new 0.20) lr 1.00e-05 gnorm 0.206 3.28s mem 81.1GB +step 306/5000 loss 0.2333 (w 0.1993 mse 0.1969 t 962 new 0.25) lr 1.00e-05 gnorm 0.385 3.34s mem 81.1GB +step 307/5000 loss 0.2118 (w 0.2692 mse 0.2704 t 982 new 0.27) lr 1.00e-05 gnorm 0.246 3.39s mem 81.1GB +step 308/5000 loss 0.1777 (w 0.2795 mse 0.2673 t 936 new 0.20) lr 1.00e-05 gnorm 0.159 3.17s mem 81.1GB +step 309/5000 loss 0.1724 (w 0.3693 mse 0.3757 t 476 new 0.23) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +step 310/5000 loss 0.2895 (w 0.2201 mse 0.2075 t 835 new 0.18) lr 1.00e-05 gnorm 0.255 2.85s mem 81.1GB +step 311/5000 loss 0.3946 (w 0.3644 mse 0.3602 t 601 new 0.25) lr 1.00e-05 gnorm 0.231 3.12s mem 81.1GB +step 312/5000 loss 0.3180 (w 0.2251 mse 0.2203 t 665 new 0.22) lr 1.00e-05 gnorm 0.237 3.31s mem 81.1GB +step 313/5000 loss 0.4086 (w 0.2933 mse 0.2896 t 932 new 0.20) lr 1.00e-05 gnorm 2.888 3.39s mem 81.1GB +step 314/5000 loss 0.2523 (w 0.2194 mse 0.2421 t 836 new 0.25) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +step 315/5000 loss 0.3137 (w 0.5135 mse 0.5269 t 195 new 0.09) lr 1.00e-05 gnorm 0.224 2.85s mem 81.1GB +step 316/5000 loss 0.2842 (w 0.2099 mse 0.2112 t 764 new 0.20) lr 1.00e-05 gnorm 0.182 3.04s mem 81.1GB +step 317/5000 loss 0.2433 (w 0.2625 mse 0.2540 t 979 new 0.23) lr 1.00e-05 gnorm 0.155 3.38s mem 81.1GB +step 318/5000 loss 0.1341 (w 0.2260 mse 0.2123 t 897 new 0.26) lr 1.00e-05 gnorm 0.160 3.27s mem 81.1GB +step 319/5000 loss 0.2394 (w 0.2650 mse 0.2607 t 821 new 0.21) lr 1.00e-05 gnorm 0.336 3.43s mem 81.1GB +step 320/5000 loss 0.2227 (w 0.3418 mse 0.3339 t 918 new 0.18) lr 1.00e-05 gnorm 0.378 2.84s mem 81.1GB +step 321/5000 loss 0.1697 (w 0.2735 mse 0.2718 t 983 new 0.22) lr 1.00e-05 gnorm 0.187 2.84s mem 81.1GB +step 322/5000 loss 0.2111 (w 0.1538 mse 0.1655 t 977 new 0.19) lr 1.00e-05 gnorm 0.215 3.12s mem 81.1GB +step 323/5000 loss 0.1891 (w 0.2556 mse 0.2818 t 999 new 0.18) lr 1.00e-05 gnorm 0.208 3.15s mem 81.1GB +step 324/5000 loss 0.2111 (w 0.3634 mse 0.3683 t 997 new 0.16) lr 1.00e-05 gnorm 0.278 3.31s mem 81.1GB +step 325/5000 loss 0.0934 (w 0.4998 mse 0.5006 t 998 new 0.24) lr 1.00e-05 gnorm 0.183 3.13s mem 81.1GB +step 326/5000 loss 0.3606 (w 0.3459 mse 0.3266 t 983 new 0.22) lr 1.00e-05 gnorm 0.202 2.85s mem 81.1GB +step 327/5000 loss 0.2206 (w 0.3288 mse 0.3278 t 943 new 0.13) lr 1.00e-05 gnorm 0.263 2.85s mem 81.1GB +step 328/5000 loss 0.3017 (w 0.2755 mse 0.2656 t 986 new 0.21) lr 1.00e-05 gnorm 0.250 3.37s mem 81.1GB +step 329/5000 loss 0.2500 (w 0.5223 mse 0.4832 t 967 new 0.22) lr 1.00e-05 gnorm 0.206 3.27s mem 81.1GB +step 330/5000 loss 0.1346 (w 0.2626 mse 0.2698 t 974 new 0.26) lr 1.00e-05 gnorm 0.158 3.29s mem 81.1GB +step 331/5000 loss 0.4181 (w 0.2678 mse 0.2565 t 891 new 0.18) lr 1.00e-05 gnorm 0.177 3.18s mem 81.1GB +step 332/5000 loss 0.1579 (w 0.1953 mse 0.1977 t 951 new 0.19) lr 1.00e-05 gnorm 0.142 2.85s mem 81.1GB +step 333/5000 loss 0.3110 (w 0.1410 mse 0.1517 t 843 new 0.23) lr 1.00e-05 gnorm 0.716 2.84s mem 81.1GB +step 334/5000 loss 0.1435 (w 0.4050 mse 0.3793 t 991 new 0.23) lr 1.00e-05 gnorm 0.260 3.36s mem 81.1GB +step 335/5000 loss 0.3355 (w 0.2873 mse 0.2698 t 720 new 0.20) lr 1.00e-05 gnorm 4.637 3.33s mem 81.1GB +step 336/5000 loss 0.2481 (w 0.1824 mse 0.1991 t 973 new 0.24) lr 1.00e-05 gnorm 0.198 3.34s mem 81.1GB +step 337/5000 loss 0.3317 (w 0.4004 mse 0.3923 t 356 new 0.19) lr 1.00e-05 gnorm 0.222 3.25s mem 81.1GB +step 338/5000 loss 0.0789 (w 0.1683 mse 0.1825 t 973 new 0.19) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +step 339/5000 loss 0.2771 (w 0.2718 mse 0.2675 t 931 new 0.23) lr 1.00e-05 gnorm 0.178 2.85s mem 81.1GB +step 340/5000 loss 0.3147 (w 0.3138 mse 0.3131 t 984 new 0.08) lr 1.00e-05 gnorm 0.197 3.31s mem 81.1GB +step 341/5000 loss 0.4048 (w 0.2794 mse 0.2694 t 779 new 0.27) lr 1.00e-05 gnorm 0.192 3.11s mem 81.1GB +step 342/5000 loss 0.1373 (w 0.2647 mse 0.2535 t 996 new 0.25) lr 1.00e-05 gnorm 0.327 3.72s mem 81.1GB +step 343/5000 loss 0.3099 (w 0.2597 mse 0.2672 t 809 new 0.18) lr 1.00e-05 gnorm 0.158 3.18s mem 81.1GB +step 344/5000 loss 0.2485 (w 0.2789 mse 0.2619 t 944 new 0.29) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +step 345/5000 loss 0.2919 (w 0.3222 mse 0.3202 t 495 new 0.23) lr 1.00e-05 gnorm 0.275 2.86s mem 81.1GB +step 346/5000 loss 0.4546 (w 0.2563 mse 0.2565 t 586 new 0.27) lr 1.00e-05 gnorm 0.207 3.60s mem 81.1GB +step 347/5000 loss 0.2573 (w 0.2010 mse 0.2184 t 889 new 0.20) lr 1.00e-05 gnorm 0.200 3.25s mem 81.1GB +step 348/5000 loss 0.2043 (w 0.2804 mse 0.2672 t 964 new 0.21) lr 1.00e-05 gnorm 0.231 3.14s mem 81.1GB +step 349/5000 loss 0.4227 (w 0.2561 mse 0.2590 t 737 new 0.24) lr 1.00e-05 gnorm 0.142 3.20s mem 81.1GB +step 350/5000 loss 0.3548 (w 0.3807 mse 0.3641 t 983 new 0.24) lr 1.00e-05 gnorm 0.319 2.86s mem 81.1GB +step 351/5000 loss 0.4891 (w 0.2315 mse 0.2254 t 843 new 0.26) lr 1.00e-05 gnorm 0.270 3.16s mem 81.1GB +step 352/5000 loss 0.2703 (w 0.1587 mse 0.1662 t 930 new 0.26) lr 1.00e-05 gnorm 0.179 3.32s mem 81.1GB +step 353/5000 loss 0.2142 (w 0.3986 mse 0.3969 t 974 new 0.17) lr 1.00e-05 gnorm 1.550 3.30s mem 81.1GB +step 354/5000 loss 0.3422 (w 0.2161 mse 0.2158 t 568 new 0.23) lr 1.00e-05 gnorm 0.177 3.45s mem 81.1GB +step 355/5000 loss 0.2575 (w 0.2564 mse 0.2480 t 920 new 0.23) lr 1.00e-05 gnorm 0.158 2.85s mem 81.1GB +step 356/5000 loss 0.2743 (w 0.3341 mse 0.3112 t 903 new 0.27) lr 1.00e-05 gnorm 0.212 2.85s mem 81.1GB +step 357/5000 loss 0.1697 (w 0.1482 mse 0.1519 t 779 new 0.12) lr 1.00e-05 gnorm 0.170 3.11s mem 81.1GB +step 358/5000 loss 0.3228 (w 0.2981 mse 0.2793 t 922 new 0.17) lr 1.00e-05 gnorm 0.211 3.04s mem 81.1GB +step 359/5000 loss 0.2533 (w 0.1649 mse 0.1670 t 609 new 0.26) lr 1.00e-05 gnorm 0.233 3.11s mem 81.1GB +step 360/5000 loss 0.1480 (w 0.2086 mse 0.1984 t 784 new 0.25) lr 1.00e-05 gnorm 0.180 3.45s mem 81.1GB +step 361/5000 loss 0.3242 (w 0.2527 mse 0.2469 t 739 new 0.22) lr 1.00e-05 gnorm 0.170 2.85s mem 81.1GB +step 362/5000 loss 0.2274 (w 0.2628 mse 0.2527 t 774 new 0.23) lr 1.00e-05 gnorm 0.199 2.85s mem 81.1GB +step 363/5000 loss 0.2632 (w 0.1808 mse 0.1799 t 925 new 0.24) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +step 364/5000 loss 0.3672 (w 0.2496 mse 0.2407 t 705 new 0.17) lr 1.00e-05 gnorm 0.330 3.27s mem 81.1GB +step 365/5000 loss 0.3776 (w 0.3723 mse 0.3646 t 428 new 0.21) lr 1.00e-05 gnorm 0.479 3.11s mem 81.1GB +step 366/5000 loss 0.2574 (w 0.2321 mse 0.2301 t 951 new 0.24) lr 1.00e-05 gnorm 0.137 3.15s mem 81.1GB +step 367/5000 loss 0.2654 (w 0.1716 mse 0.1722 t 660 new 0.17) lr 1.00e-05 gnorm 0.200 2.86s mem 81.1GB +step 368/5000 loss 0.1046 (w 0.2439 mse 0.2364 t 952 new 0.20) lr 1.00e-05 gnorm 0.132 2.86s mem 81.1GB +step 369/5000 loss 0.2710 (w 0.1517 mse 0.1477 t 687 new 0.22) lr 1.00e-05 gnorm 0.185 3.16s mem 81.1GB +step 370/5000 loss 0.1951 (w 0.3103 mse 0.2923 t 953 new 0.17) lr 1.00e-05 gnorm 0.177 3.06s mem 81.1GB +step 371/5000 loss 0.3059 (w 0.2378 mse 0.2123 t 852 new 0.22) lr 1.00e-05 gnorm 0.151 3.11s mem 81.1GB +step 372/5000 loss 0.3260 (w 0.4072 mse 0.3831 t 954 new 0.17) lr 1.00e-05 gnorm 0.123 3.09s mem 81.1GB +step 373/5000 loss 0.1297 (w 0.2616 mse 0.2596 t 925 new 0.24) lr 1.00e-05 gnorm 0.206 2.85s mem 81.1GB +step 374/5000 loss 0.1932 (w 0.2844 mse 0.2831 t 817 new 0.20) lr 1.00e-05 gnorm 0.536 2.84s mem 81.1GB +step 375/5000 loss 0.1058 (w 0.2866 mse 0.2829 t 976 new 0.10) lr 1.00e-05 gnorm 0.161 3.49s mem 81.1GB +step 376/5000 loss 0.2993 (w 0.3735 mse 0.3566 t 894 new 0.22) lr 1.00e-05 gnorm 0.152 3.08s mem 81.1GB +step 377/5000 loss 0.4193 (w 0.5894 mse 0.5855 t 165 new 0.21) lr 1.00e-05 gnorm 0.195 3.10s mem 81.1GB +step 378/5000 loss 0.2247 (w 0.2877 mse 0.2842 t 854 new 0.14) lr 1.00e-05 gnorm 0.325 3.15s mem 81.1GB +step 379/5000 loss 0.1634 (w 0.3006 mse 0.2949 t 945 new 0.25) lr 1.00e-05 gnorm 0.320 2.84s mem 81.1GB +step 380/5000 loss 0.2772 (w 0.2260 mse 0.2265 t 981 new 0.25) lr 1.00e-05 gnorm 0.161 2.85s mem 81.1GB +step 381/5000 loss 0.3557 (w 0.3907 mse 0.3833 t 955 new 0.18) lr 1.00e-05 gnorm 0.226 3.59s mem 81.1GB +step 382/5000 loss 0.2851 (w 0.1974 mse 0.1852 t 663 new 0.23) lr 1.00e-05 gnorm 0.150 3.35s mem 81.1GB +step 383/5000 loss 0.2218 (w 0.2169 mse 0.2159 t 709 new 0.24) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +step 384/5000 loss 0.2923 (w 0.2357 mse 0.2493 t 470 new 0.24) lr 1.00e-05 gnorm 0.202 3.20s mem 81.1GB +step 385/5000 loss 0.2827 (w 0.1595 mse 0.1687 t 914 new 0.16) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +step 386/5000 loss 0.2968 (w 0.2558 mse 0.2697 t 944 new 0.20) lr 1.00e-05 gnorm 0.191 3.15s mem 81.1GB +step 387/5000 loss 0.3273 (w 0.1644 mse 0.1674 t 673 new 0.29) lr 1.00e-05 gnorm 0.169 3.11s mem 81.1GB +step 388/5000 loss 0.1912 (w 0.1668 mse 0.1651 t 819 new 0.24) lr 1.00e-05 gnorm 0.234 3.32s mem 81.1GB +step 389/5000 loss 0.2280 (w 0.2243 mse 0.2381 t 979 new 0.14) lr 1.00e-05 gnorm 0.185 3.13s mem 81.1GB +step 390/5000 loss 0.1457 (w 0.2085 mse 0.2228 t 838 new 0.11) lr 1.00e-05 gnorm 0.138 3.18s mem 81.1GB +step 391/5000 loss 0.4228 (w 0.2028 mse 0.2047 t 902 new 0.09) lr 1.00e-05 gnorm 0.262 2.85s mem 81.1GB +step 392/5000 loss 0.2409 (w 0.3427 mse 0.3432 t 977 new 0.21) lr 1.00e-05 gnorm 0.183 3.16s mem 81.1GB +step 393/5000 loss 0.3248 (w 0.4800 mse 0.4852 t 274 new 0.25) lr 1.00e-05 gnorm 0.217 3.11s mem 81.1GB +step 394/5000 loss 0.2375 (w 0.3136 mse 0.3100 t 634 new 0.24) lr 1.00e-05 gnorm 0.299 3.10s mem 81.1GB +step 395/5000 loss 0.2507 (w 0.3297 mse 0.3386 t 993 new 0.24) lr 1.00e-05 gnorm 0.131 3.91s mem 81.1GB +step 396/5000 loss 0.4106 (w 0.2976 mse 0.3113 t 997 new 0.21) lr 1.00e-05 gnorm 0.175 2.86s mem 81.1GB +step 397/5000 loss 0.2776 (w 0.3360 mse 0.3339 t 925 new 0.21) lr 1.00e-05 gnorm 0.165 2.85s mem 81.1GB +step 398/5000 loss 0.3557 (w 0.2537 mse 0.2522 t 503 new 0.16) lr 1.00e-05 gnorm 0.163 3.08s mem 81.1GB +step 399/5000 loss 0.2145 (w 0.1652 mse 0.1674 t 629 new 0.29) lr 1.00e-05 gnorm 0.187 3.42s mem 81.1GB +step 400/5000 loss 0.2272 (w 0.1970 mse 0.2056 t 849 new 0.19) lr 1.00e-05 gnorm 0.165 3.11s mem 81.1GB +step 401/5000 loss 0.3335 (w 0.3282 mse 0.3265 t 853 new 0.11) lr 1.00e-05 gnorm 0.354 3.57s mem 81.1GB +step 402/5000 loss 0.3494 (w 0.3827 mse 0.3623 t 991 new 0.26) lr 1.00e-05 gnorm 0.689 2.84s mem 81.1GB +step 403/5000 loss 0.1761 (w 0.1547 mse 0.1581 t 721 new 0.17) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +step 404/5000 loss 0.2868 (w 0.1133 mse 0.1335 t 687 new 0.24) lr 1.00e-05 gnorm 0.227 3.10s mem 81.1GB +step 405/5000 loss 0.2172 (w 0.1660 mse 0.1707 t 910 new 0.18) lr 1.00e-05 gnorm 0.180 3.34s mem 81.1GB +step 406/5000 loss 0.2461 (w 0.2633 mse 0.2595 t 925 new 0.12) lr 1.00e-05 gnorm 0.189 2.85s mem 81.1GB +step 407/5000 loss 0.1615 (w 0.2928 mse 0.2716 t 969 new 0.26) lr 1.00e-05 gnorm 0.200 3.58s mem 81.1GB +step 408/5000 loss 0.1788 (w 0.1800 mse 0.1960 t 887 new 0.16) lr 1.00e-05 gnorm 0.128 2.85s mem 81.1GB +step 409/5000 loss 0.2918 (w 0.2328 mse 0.2277 t 742 new 0.27) lr 1.00e-05 gnorm 0.223 2.86s mem 81.1GB +step 410/5000 loss 0.2893 (w 0.2169 mse 0.2201 t 940 new 0.16) lr 1.00e-05 gnorm 0.160 3.14s mem 81.1GB +step 411/5000 loss 0.3374 (w 0.2883 mse 0.2860 t 725 new 0.24) lr 1.00e-05 gnorm 0.139 3.38s mem 81.1GB +step 412/5000 loss 0.1881 (w 0.1888 mse 0.1869 t 990 new 0.15) lr 1.00e-05 gnorm 0.129 2.86s mem 81.1GB +step 413/5000 loss 0.1918 (w 0.7390 mse 0.7239 t 999 new 0.23) lr 1.00e-05 gnorm 0.197 3.63s mem 81.1GB +step 414/5000 loss 0.3279 (w 0.1672 mse 0.1853 t 932 new 0.20) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +step 415/5000 loss 0.3244 (w 0.2319 mse 0.2417 t 817 new 0.17) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +step 416/5000 loss 0.4481 (w 0.3393 mse 0.3339 t 961 new 0.15) lr 1.00e-05 gnorm 0.220 3.39s mem 81.1GB +step 417/5000 loss 0.3289 (w 0.2955 mse 0.2807 t 594 new 0.23) lr 1.00e-05 gnorm 0.191 3.09s mem 81.1GB +step 418/5000 loss 0.2093 (w 0.3062 mse 0.3089 t 971 new 0.25) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +step 419/5000 loss 0.2628 (w 0.2110 mse 0.2145 t 948 new 0.23) lr 1.00e-05 gnorm 0.149 3.09s mem 81.1GB +step 420/5000 loss 0.1829 (w 0.1574 mse 0.1737 t 692 new 0.17) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +step 421/5000 loss 0.1813 (w 0.1251 mse 0.1372 t 557 new 0.19) lr 1.00e-05 gnorm 0.172 2.85s mem 81.1GB +step 422/5000 loss 0.3510 (w 0.1667 mse 0.1616 t 813 new 0.23) lr 1.00e-05 gnorm 0.171 3.35s mem 81.1GB +step 423/5000 loss 0.2555 (w 0.2233 mse 0.2187 t 931 new 0.18) lr 1.00e-05 gnorm 0.132 3.30s mem 81.1GB +step 424/5000 loss 0.2517 (w 0.3047 mse 0.2975 t 835 new 0.25) lr 1.00e-05 gnorm 0.173 3.16s mem 81.1GB +step 425/5000 loss 0.3649 (w 0.2564 mse 0.2482 t 794 new 0.26) lr 1.00e-05 gnorm 0.222 3.13s mem 81.1GB +step 426/5000 loss 0.1885 (w 0.1407 mse 0.1323 t 672 new 0.24) lr 1.00e-05 gnorm 0.146 2.86s mem 81.1GB +step 427/5000 loss 0.2870 (w 0.2611 mse 0.2651 t 715 new 0.23) lr 1.00e-05 gnorm 0.217 2.84s mem 81.1GB +step 428/5000 loss 0.1629 (w 0.4922 mse 0.4699 t 978 new 0.18) lr 1.00e-05 gnorm 0.238 3.37s mem 81.1GB +step 429/5000 loss 0.4264 (w 0.3352 mse 0.3588 t 995 new 0.13) lr 1.00e-05 gnorm 0.199 3.30s mem 81.1GB +step 430/5000 loss 0.2459 (w 0.1787 mse 0.1829 t 935 new 0.17) lr 1.00e-05 gnorm 0.532 3.17s mem 81.1GB +step 431/5000 loss 0.2925 (w 0.3174 mse 0.3043 t 890 new 0.21) lr 1.00e-05 gnorm 0.148 3.28s mem 81.1GB +step 432/5000 loss 0.2575 (w 0.1531 mse 0.1478 t 822 new 0.16) lr 1.00e-05 gnorm 0.167 2.86s mem 81.1GB +step 433/5000 loss 0.2047 (w 0.2156 mse 0.2014 t 783 new 0.17) lr 1.00e-05 gnorm 0.279 3.14s mem 81.1GB +step 434/5000 loss 0.2009 (w 0.1496 mse 0.1707 t 932 new 0.23) lr 1.00e-05 gnorm 0.152 3.38s mem 81.1GB +step 435/5000 loss 0.2304 (w 0.3202 mse 0.3167 t 586 new 0.22) lr 1.00e-05 gnorm 0.239 3.07s mem 81.1GB +step 436/5000 loss 0.3699 (w 0.1870 mse 0.1945 t 830 new 0.13) lr 1.00e-05 gnorm 0.237 3.13s mem 81.1GB +step 437/5000 loss 0.1949 (w 0.2750 mse 0.2513 t 803 new 0.22) lr 1.00e-05 gnorm 0.194 3.29s mem 81.1GB +step 438/5000 loss 0.1623 (w 0.2403 mse 0.2486 t 450 new 0.21) lr 1.00e-05 gnorm 0.168 2.84s mem 81.1GB +step 439/5000 loss 0.1269 (w 0.2735 mse 0.2772 t 997 new 0.22) lr 1.00e-05 gnorm 0.143 3.10s mem 81.1GB +step 440/5000 loss 0.3503 (w 0.2599 mse 0.2632 t 977 new 0.24) lr 1.00e-05 gnorm 0.424 3.33s mem 81.1GB +step 441/5000 loss 0.2357 (w 0.3108 mse 0.3050 t 614 new 0.25) lr 1.00e-05 gnorm 0.152 3.35s mem 81.1GB +step 442/5000 loss 0.2442 (w 0.1102 mse 0.1118 t 790 new 0.22) lr 1.00e-05 gnorm 0.203 3.14s mem 81.1GB +step 443/5000 loss 0.2185 (w 0.2016 mse 0.1975 t 935 new 0.14) lr 1.00e-05 gnorm 0.137 3.12s mem 81.1GB +step 444/5000 loss 0.2721 (w 0.3059 mse 0.2941 t 601 new 0.21) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +step 445/5000 loss 0.2605 (w 0.2458 mse 0.2423 t 836 new 0.18) lr 1.00e-05 gnorm 0.164 3.14s mem 81.1GB +step 446/5000 loss 0.2533 (w 0.2716 mse 0.2700 t 798 new 0.23) lr 1.00e-05 gnorm 0.201 3.37s mem 81.1GB +step 447/5000 loss 0.1534 (w 0.1372 mse 0.1349 t 929 new 0.20) lr 1.00e-05 gnorm 0.290 3.41s mem 81.1GB +step 448/5000 loss 0.3978 (w 0.3224 mse 0.3088 t 605 new 0.23) lr 1.00e-05 gnorm 0.205 2.84s mem 81.1GB +step 449/5000 loss 0.2956 (w 0.1930 mse 0.1875 t 924 new 0.16) lr 1.00e-05 gnorm 0.187 3.14s mem 81.1GB +step 450/5000 loss 0.3215 (w 0.2580 mse 0.2527 t 728 new 0.28) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +step 451/5000 loss 0.3873 (w 0.1453 mse 0.1679 t 969 new 0.20) lr 1.00e-05 gnorm 0.365 3.40s mem 81.1GB +step 452/5000 loss 0.3313 (w 0.1738 mse 0.1958 t 650 new 0.24) lr 1.00e-05 gnorm 0.145 3.30s mem 81.1GB +step 453/5000 loss 0.2353 (w 0.1971 mse 0.1997 t 741 new 0.16) lr 1.00e-05 gnorm 0.259 3.28s mem 81.1GB +step 454/5000 loss 0.2154 (w 0.0732 mse 0.0886 t 885 new 0.19) lr 1.00e-05 gnorm 0.210 3.28s mem 81.1GB +step 455/5000 loss 0.2358 (w 0.2510 mse 0.2573 t 732 new 0.15) lr 1.00e-05 gnorm 0.168 2.85s mem 81.1GB +step 456/5000 loss 0.3378 (w 0.2553 mse 0.2563 t 528 new 0.26) lr 1.00e-05 gnorm 0.189 2.85s mem 81.1GB +step 457/5000 loss 0.3123 (w 0.2644 mse 0.2882 t 982 new 0.21) lr 1.00e-05 gnorm 0.152 3.29s mem 81.1GB +step 458/5000 loss 0.2971 (w 0.2730 mse 0.2614 t 878 new 0.23) lr 1.00e-05 gnorm 0.311 3.32s mem 81.1GB +step 459/5000 loss 0.2009 (w 0.1386 mse 0.1340 t 754 new 0.12) lr 1.00e-05 gnorm 0.175 3.19s mem 81.1GB +step 460/5000 loss 0.2239 (w 0.2086 mse 0.2154 t 865 new 0.24) lr 1.00e-05 gnorm 0.186 3.12s mem 81.1GB +step 461/5000 loss 0.2518 (w 0.5731 mse 0.5766 t 990 new 0.20) lr 1.00e-05 gnorm 0.177 2.85s mem 81.1GB +step 462/5000 loss 0.4539 (w 0.2956 mse 0.2895 t 964 new 0.24) lr 1.00e-05 gnorm 0.259 2.83s mem 81.1GB +step 463/5000 loss 0.1807 (w 0.4105 mse 0.3973 t 959 new 0.18) lr 1.00e-05 gnorm 0.206 3.57s mem 81.1GB +step 464/5000 loss 0.1984 (w 0.5237 mse 0.5210 t 120 new 0.27) lr 1.00e-05 gnorm 0.180 3.26s mem 81.1GB +step 465/5000 loss 0.4029 (w 0.1432 mse 0.1506 t 774 new 0.23) lr 1.00e-05 gnorm 0.156 3.19s mem 81.1GB +step 466/5000 loss 0.2812 (w 0.1409 mse 0.1531 t 936 new 0.20) lr 1.00e-05 gnorm 0.151 3.17s mem 81.1GB +step 467/5000 loss 0.1770 (w 0.3426 mse 0.3188 t 938 new 0.24) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +step 468/5000 loss 0.3683 (w 0.3721 mse 0.3744 t 332 new 0.24) lr 1.00e-05 gnorm 0.188 2.84s mem 81.1GB +step 469/5000 loss 0.1635 (w 0.1555 mse 0.1645 t 871 new 0.19) lr 1.00e-05 gnorm 0.293 3.11s mem 81.1GB +step 470/5000 loss 0.1512 (w 0.2576 mse 0.2413 t 941 new 0.23) lr 1.00e-05 gnorm 0.177 3.32s mem 81.1GB +step 471/5000 loss 0.3194 (w 0.1499 mse 0.1566 t 914 new 0.12) lr 1.00e-05 gnorm 0.164 3.32s mem 81.1GB +step 472/5000 loss 0.3144 (w 0.6630 mse 0.6609 t 189 new 0.20) lr 1.00e-05 gnorm 0.253 3.38s mem 81.1GB +step 473/5000 loss 0.3070 (w 0.1730 mse 0.1770 t 864 new 0.21) lr 1.00e-05 gnorm 0.170 2.85s mem 81.1GB +step 474/5000 loss 0.2562 (w 0.1482 mse 0.1655 t 386 new 0.17) lr 1.00e-05 gnorm 0.241 3.12s mem 81.1GB +step 475/5000 loss 0.3017 (w 0.2782 mse 0.2833 t 985 new 0.22) lr 1.00e-05 gnorm 0.304 3.10s mem 81.1GB +step 476/5000 loss 0.3706 (w 0.3164 mse 0.2980 t 492 new 0.20) lr 1.00e-05 gnorm 0.184 3.34s mem 81.1GB +step 477/5000 loss 0.2347 (w 0.2900 mse 0.2960 t 310 new 0.07) lr 1.00e-05 gnorm 0.159 3.16s mem 81.1GB +step 478/5000 loss 0.1816 (w 0.2428 mse 0.2513 t 975 new 0.22) lr 1.00e-05 gnorm 0.145 3.19s mem 81.1GB +step 479/5000 loss 0.1831 (w 0.1767 mse 0.1797 t 942 new 0.10) lr 1.00e-05 gnorm 0.183 2.86s mem 81.1GB +step 480/5000 loss 0.2704 (w 0.2437 mse 0.2379 t 871 new 0.17) lr 1.00e-05 gnorm 0.234 3.08s mem 81.1GB +step 481/5000 loss 0.3756 (w 0.2844 mse 0.2666 t 915 new 0.26) lr 1.00e-05 gnorm 0.314 3.22s mem 81.1GB +step 482/5000 loss 0.3561 (w 0.1461 mse 0.1547 t 811 new 0.13) lr 1.00e-05 gnorm 0.197 3.71s mem 81.1GB +step 483/5000 loss 0.2172 (w 0.3420 mse 0.3688 t 997 new 0.19) lr 1.00e-05 gnorm 0.132 3.20s mem 81.1GB +step 484/5000 loss 0.1826 (w 0.1139 mse 0.1330 t 809 new 0.22) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +step 485/5000 loss 0.2952 (w 0.2314 mse 0.2205 t 925 new 0.24) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +step 486/5000 loss 0.1932 (w 0.1992 mse 0.1945 t 930 new 0.14) lr 1.00e-05 gnorm 0.111 3.08s mem 81.1GB +step 487/5000 loss 0.1271 (w 0.2340 mse 0.2330 t 905 new 0.22) lr 1.00e-05 gnorm 0.158 3.37s mem 81.1GB +step 488/5000 loss 0.2538 (w 0.2976 mse 0.2857 t 864 new 0.24) lr 1.00e-05 gnorm 0.161 3.42s mem 81.1GB +step 489/5000 loss 0.1652 (w 0.3126 mse 0.3136 t 909 new 0.14) lr 1.00e-05 gnorm 0.159 3.13s mem 81.1GB +step 490/5000 loss 0.1845 (w 0.3156 mse 0.3134 t 989 new 0.17) lr 1.00e-05 gnorm 0.260 2.84s mem 81.1GB +step 491/5000 loss 0.2256 (w 0.1943 mse 0.2094 t 892 new 0.19) lr 1.00e-05 gnorm 0.276 2.84s mem 81.1GB +step 492/5000 loss 0.3034 (w 0.6543 mse 0.6475 t 153 new 0.20) lr 1.00e-05 gnorm 0.152 3.04s mem 81.1GB +step 493/5000 loss 0.2906 (w 0.2487 mse 0.2509 t 970 new 0.16) lr 1.00e-05 gnorm 0.163 3.37s mem 81.1GB +step 494/5000 loss 0.1855 (w 0.2800 mse 0.2718 t 699 new 0.24) lr 1.00e-05 gnorm 0.166 3.65s mem 81.1GB +step 495/5000 loss 0.2225 (w 0.2096 mse 0.1943 t 857 new 0.23) lr 1.00e-05 gnorm 0.181 3.09s mem 81.1GB +step 496/5000 loss 0.1167 (w 0.2747 mse 0.2733 t 950 new 0.23) lr 1.00e-05 gnorm 0.226 2.84s mem 81.1GB +step 497/5000 loss 0.1225 (w 0.2347 mse 0.2318 t 771 new 0.26) lr 1.00e-05 gnorm 0.163 2.85s mem 81.1GB +step 498/5000 loss 0.1059 (w 0.2824 mse 0.2629 t 953 new 0.17) lr 1.00e-05 gnorm 0.255 3.10s mem 81.1GB +step 499/5000 loss 0.2585 (w 0.2681 mse 0.2575 t 809 new 0.17) lr 1.00e-05 gnorm 0.655 3.27s mem 81.1GB +step 500/5000 loss 0.2654 (w 0.1602 mse 0.1640 t 692 new 0.16) lr 1.00e-05 gnorm 0.300 4.13s mem 81.1GB +[val] step 500 t=200: w=0.4572 mse=0.4694 (n=16) t=500: w=0.2455 mse=0.2505 (n=16) t=800: w=0.1940 mse=0.1950 (n=16) | mean w=0.2989 mse=0.3050 3s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step500.safetensors 4093 个张量 37.98 GB +step 501/5000 loss 0.2683 (w 0.1972 mse 0.2059 t 631 new 0.08) lr 1.00e-05 gnorm 0.257 2.84s mem 81.1GB +step 502/5000 loss 0.1504 (w 0.2724 mse 0.2633 t 979 new 0.23) lr 1.00e-05 gnorm 0.272 2.83s mem 81.1GB +step 503/5000 loss 0.2003 (w 0.2115 mse 0.2094 t 900 new 0.13) lr 1.00e-05 gnorm 0.269 2.82s mem 81.1GB +step 504/5000 loss 0.3174 (w 0.3358 mse 0.3280 t 676 new 0.20) lr 1.00e-05 gnorm 0.209 3.15s mem 81.1GB +step 505/5000 loss 0.3095 (w 0.1412 mse 0.1404 t 980 new 0.22) lr 1.00e-05 gnorm 0.155 3.33s mem 81.1GB +step 506/5000 loss 0.1477 (w 0.1076 mse 0.1127 t 853 new 0.09) lr 1.00e-05 gnorm 0.237 3.52s mem 81.1GB +step 507/5000 loss 0.3563 (w 0.2258 mse 0.2312 t 980 new 0.13) lr 1.00e-05 gnorm 0.198 2.83s mem 81.1GB +step 508/5000 loss 0.4075 (w 0.2323 mse 0.2186 t 301 new 0.23) lr 1.00e-05 gnorm 0.735 2.84s mem 81.1GB +step 509/5000 loss 0.2709 (w 0.2950 mse 0.2809 t 633 new 0.21) lr 1.00e-05 gnorm 0.267 2.85s mem 81.1GB +step 510/5000 loss 0.1767 (w 0.4345 mse 0.4375 t 994 new 0.12) lr 1.00e-05 gnorm 0.309 3.10s mem 81.1GB +step 511/5000 loss 0.2595 (w 0.3581 mse 0.3443 t 984 new 0.21) lr 1.00e-05 gnorm 0.203 3.57s mem 81.1GB +step 512/5000 loss 0.2836 (w 0.1536 mse 0.1521 t 917 new 0.26) lr 1.00e-05 gnorm 0.252 3.36s mem 81.1GB +step 513/5000 loss 0.3000 (w 0.4643 mse 0.4618 t 301 new 0.21) lr 1.00e-05 gnorm 0.377 2.84s mem 81.1GB +step 514/5000 loss 0.2125 (w 0.1388 mse 0.1299 t 840 new 0.16) lr 1.00e-05 gnorm 0.156 2.86s mem 81.1GB +step 515/5000 loss 0.3584 (w 0.2018 mse 0.2137 t 770 new 0.11) lr 1.00e-05 gnorm 0.183 2.85s mem 81.1GB +step 516/5000 loss 0.2312 (w 0.3600 mse 0.3532 t 980 new 0.11) lr 1.00e-05 gnorm 0.164 3.40s mem 81.1GB +step 517/5000 loss 0.1180 (w 0.3189 mse 0.3073 t 971 new 0.21) lr 1.00e-05 gnorm 0.167 3.47s mem 81.1GB +step 518/5000 loss 0.2806 (w 0.3455 mse 0.3269 t 776 new 0.22) lr 1.00e-05 gnorm 0.351 3.32s mem 81.1GB +step 519/5000 loss 0.2348 (w 0.2376 mse 0.2551 t 999 new 0.11) lr 1.00e-05 gnorm 0.178 2.84s mem 81.1GB +step 520/5000 loss 0.2099 (w 0.2906 mse 0.2869 t 992 new 0.19) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 521/5000 loss 0.3509 (w 0.3032 mse 0.3091 t 310 new 0.22) lr 1.00e-05 gnorm 0.499 3.02s mem 81.1GB +step 522/5000 loss 0.3905 (w 0.1700 mse 0.1826 t 956 new 0.14) lr 1.00e-05 gnorm 0.185 3.35s mem 81.1GB +step 523/5000 loss 0.1162 (w 0.4970 mse 0.4692 t 977 new 0.22) lr 1.00e-05 gnorm 0.122 3.53s mem 81.1GB +step 524/5000 loss 0.2000 (w 0.5059 mse 0.4857 t 998 new 0.22) lr 1.00e-05 gnorm 0.174 3.29s mem 81.1GB +step 525/5000 loss 0.1690 (w 0.2686 mse 0.2691 t 856 new 0.21) lr 1.00e-05 gnorm 0.183 2.84s mem 81.1GB +step 526/5000 loss 0.1773 (w 0.2318 mse 0.2232 t 933 new 0.22) lr 1.00e-05 gnorm 0.136 2.85s mem 81.1GB +step 527/5000 loss 0.4838 (w 0.2234 mse 0.2234 t 942 new 0.21) lr 1.00e-05 gnorm 0.235 3.05s mem 81.1GB +step 528/5000 loss 0.2021 (w 0.1893 mse 0.2157 t 340 new 0.20) lr 1.00e-05 gnorm 0.244 3.07s mem 81.1GB +step 529/5000 loss 0.1850 (w 0.3616 mse 0.3814 t 994 new 0.22) lr 1.00e-05 gnorm 0.320 3.30s mem 81.1GB +step 530/5000 loss 0.2262 (w 0.2857 mse 0.3011 t 959 new 0.15) lr 1.00e-05 gnorm 0.163 3.07s mem 81.1GB +step 531/5000 loss 0.3316 (w 0.0934 mse 0.1010 t 933 new 0.17) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +step 532/5000 loss 0.3769 (w 0.1837 mse 0.1787 t 922 new 0.21) lr 1.00e-05 gnorm 0.177 2.85s mem 81.1GB +step 533/5000 loss 0.3395 (w 0.4994 mse 0.5127 t 140 new 0.17) lr 1.00e-05 gnorm 0.170 3.35s mem 81.1GB +step 534/5000 loss 0.1946 (w 0.1983 mse 0.1972 t 836 new 0.08) lr 1.00e-05 gnorm 0.880 3.11s mem 81.1GB +step 535/5000 loss 0.2494 (w 0.3611 mse 0.3436 t 297 new 0.22) lr 1.00e-05 gnorm 0.433 3.55s mem 81.1GB +step 536/5000 loss 0.3468 (w 0.2451 mse 0.2640 t 979 new 0.20) lr 1.00e-05 gnorm 0.191 3.14s mem 81.1GB +step 537/5000 loss 0.3716 (w 0.3204 mse 0.3222 t 482 new 0.24) lr 1.00e-05 gnorm 0.180 2.84s mem 81.1GB +step 538/5000 loss 0.1923 (w 0.2586 mse 0.2493 t 961 new 0.24) lr 1.00e-05 gnorm 0.211 2.84s mem 81.1GB +step 539/5000 loss 0.2364 (w 0.1703 mse 0.1751 t 947 new 0.25) lr 1.00e-05 gnorm 0.297 3.41s mem 81.1GB +step 540/5000 loss 0.2901 (w 0.3060 mse 0.3004 t 492 new 0.25) lr 1.00e-05 gnorm 0.193 3.42s mem 81.1GB +step 541/5000 loss 0.2199 (w 0.1665 mse 0.1732 t 967 new 0.24) lr 1.00e-05 gnorm 0.451 3.45s mem 81.1GB +step 542/5000 loss 0.2433 (w 0.3485 mse 0.3505 t 954 new 0.21) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +step 543/5000 loss 0.1658 (w 0.2127 mse 0.2115 t 869 new 0.27) lr 1.00e-05 gnorm 0.137 2.85s mem 81.1GB +step 544/5000 loss 0.2125 (w 0.2481 mse 0.2266 t 994 new 0.25) lr 1.00e-05 gnorm 0.212 2.85s mem 81.1GB +step 545/5000 loss 0.3060 (w 0.4951 mse 0.5009 t 200 new 0.24) lr 1.00e-05 gnorm 0.221 3.36s mem 81.1GB +step 546/5000 loss 0.2643 (w 0.2806 mse 0.2678 t 870 new 0.23) lr 1.00e-05 gnorm 0.181 3.10s mem 81.1GB +step 547/5000 loss 0.3012 (w 0.3235 mse 0.3080 t 911 new 0.20) lr 1.00e-05 gnorm 0.131 3.43s mem 81.1GB +step 548/5000 loss 0.2177 (w 0.3349 mse 0.3155 t 782 new 0.22) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +step 549/5000 loss 0.1513 (w 0.2872 mse 0.2718 t 886 new 0.19) lr 1.00e-05 gnorm 0.146 2.85s mem 81.1GB +step 550/5000 loss 0.2101 (w 0.3243 mse 0.3203 t 861 new 0.21) lr 1.00e-05 gnorm 0.357 3.10s mem 81.1GB +step 551/5000 loss 0.1991 (w 0.3346 mse 0.3215 t 914 new 0.19) lr 1.00e-05 gnorm 0.231 3.37s mem 81.1GB +step 552/5000 loss 0.2843 (w 0.3582 mse 0.3425 t 987 new 0.25) lr 1.00e-05 gnorm 0.154 3.34s mem 81.1GB +step 553/5000 loss 0.4529 (w 0.5732 mse 0.5717 t 165 new 0.12) lr 1.00e-05 gnorm 0.291 3.36s mem 81.1GB +step 554/5000 loss 0.2877 (w 0.3805 mse 0.3762 t 935 new 0.21) lr 1.00e-05 gnorm 0.201 2.84s mem 81.1GB +step 555/5000 loss 0.2056 (w 0.2257 mse 0.2260 t 932 new 0.02) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +step 556/5000 loss 0.2429 (w 0.2616 mse 0.2644 t 962 new 0.10) lr 1.00e-05 gnorm 0.183 3.02s mem 81.1GB +step 557/5000 loss 0.3969 (w 0.5670 mse 0.5656 t 244 new 0.21) lr 1.00e-05 gnorm 0.682 3.30s mem 81.1GB +step 558/5000 loss 0.2264 (w 0.2354 mse 0.2411 t 976 new 0.16) lr 1.00e-05 gnorm 0.176 3.51s mem 81.1GB +step 559/5000 loss 0.2507 (w 0.2176 mse 0.2217 t 913 new 0.18) lr 1.00e-05 gnorm 0.149 3.42s mem 81.1GB +step 560/5000 loss 0.0954 (w 0.2753 mse 0.2688 t 973 new 0.17) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +step 561/5000 loss 0.4279 (w 0.4603 mse 0.4432 t 217 new 0.21) lr 1.00e-05 gnorm 0.230 2.83s mem 81.1GB +step 562/5000 loss 0.1900 (w 0.1755 mse 0.1864 t 562 new 0.15) lr 1.00e-05 gnorm 0.203 3.14s mem 81.1GB +step 563/5000 loss 0.3813 (w 0.1211 mse 0.1228 t 865 new 0.16) lr 1.00e-05 gnorm 0.823 3.16s mem 81.1GB +step 564/5000 loss 0.2418 (w 0.2240 mse 0.2123 t 821 new 0.23) lr 1.00e-05 gnorm 0.176 3.40s mem 81.1GB +step 565/5000 loss 0.1857 (w 0.3425 mse 0.3427 t 411 new 0.22) lr 1.00e-05 gnorm 0.136 3.06s mem 81.1GB +step 566/5000 loss 0.3012 (w 0.3617 mse 0.3423 t 956 new 0.24) lr 1.00e-05 gnorm 0.193 2.86s mem 81.1GB +step 567/5000 loss 0.3556 (w 0.2705 mse 0.2534 t 790 new 0.25) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +step 568/5000 loss 0.1776 (w 0.2795 mse 0.2839 t 937 new 0.16) lr 1.00e-05 gnorm 0.179 3.45s mem 81.1GB +step 569/5000 loss 0.3308 (w 0.1765 mse 0.1745 t 669 new 0.15) lr 1.00e-05 gnorm 0.171 3.08s mem 81.1GB +step 570/5000 loss 0.1358 (w 0.2916 mse 0.2869 t 961 new 0.22) lr 1.00e-05 gnorm 0.166 3.40s mem 81.1GB +step 571/5000 loss 0.1239 (w 0.1263 mse 0.1203 t 858 new 0.18) lr 1.00e-05 gnorm 0.457 3.11s mem 81.1GB +step 572/5000 loss 0.2265 (w 0.3244 mse 0.3250 t 624 new 0.29) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +step 573/5000 loss 0.3581 (w 0.3438 mse 0.3317 t 960 new 0.15) lr 1.00e-05 gnorm 0.436 2.83s mem 81.1GB +step 574/5000 loss 0.3705 (w 0.2339 mse 0.2219 t 582 new 0.18) lr 1.00e-05 gnorm 0.246 3.27s mem 81.1GB +step 575/5000 loss 0.2133 (w 0.2842 mse 0.2882 t 985 new 0.17) lr 1.00e-05 gnorm 0.138 3.27s mem 81.1GB +step 576/5000 loss 0.2891 (w 0.2831 mse 0.2795 t 704 new 0.23) lr 1.00e-05 gnorm 0.236 3.42s mem 81.1GB +step 577/5000 loss 0.3504 (w 0.2535 mse 0.2623 t 972 new 0.19) lr 1.00e-05 gnorm 0.561 3.13s mem 81.1GB +step 578/5000 loss 0.2824 (w 0.2160 mse 0.2116 t 799 new 0.17) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +step 579/5000 loss 0.2265 (w 0.2453 mse 0.2520 t 982 new 0.13) lr 1.00e-05 gnorm 0.252 2.84s mem 81.1GB +step 580/5000 loss 0.2883 (w 0.2448 mse 0.2515 t 623 new 0.22) lr 1.00e-05 gnorm 0.155 3.33s mem 81.1GB +step 581/5000 loss 0.3708 (w 0.2106 mse 0.2055 t 880 new 0.25) lr 1.00e-05 gnorm 0.196 3.35s mem 81.1GB +step 582/5000 loss 0.2029 (w 0.3731 mse 0.3585 t 990 new 0.19) lr 1.00e-05 gnorm 0.183 3.43s mem 81.1GB +step 583/5000 loss 0.1530 (w 0.3374 mse 0.3372 t 971 new 0.21) lr 1.00e-05 gnorm 0.161 2.84s mem 81.1GB +step 584/5000 loss 0.1784 (w 0.2779 mse 0.2886 t 992 new 0.24) lr 1.00e-05 gnorm 0.135 2.85s mem 81.1GB +step 585/5000 loss 0.4055 (w 0.1339 mse 0.1314 t 929 new 0.20) lr 1.00e-05 gnorm 0.246 2.84s mem 81.1GB +step 586/5000 loss 0.2295 (w 0.3912 mse 0.4078 t 985 new 0.17) lr 1.00e-05 gnorm 0.217 3.14s mem 81.1GB +step 587/5000 loss 0.2337 (w 0.3737 mse 0.3402 t 998 new 0.21) lr 1.00e-05 gnorm 0.230 3.36s mem 81.1GB +step 588/5000 loss 0.1733 (w 0.4617 mse 0.4523 t 994 new 0.12) lr 1.00e-05 gnorm 0.175 3.40s mem 81.1GB +step 589/5000 loss 0.2548 (w 0.2683 mse 0.2676 t 907 new 0.21) lr 1.00e-05 gnorm 0.188 2.84s mem 81.1GB +step 590/5000 loss 0.3570 (w 0.1776 mse 0.1939 t 947 new 0.24) lr 1.00e-05 gnorm 0.195 2.84s mem 81.1GB +step 591/5000 loss 0.4699 (w 0.1473 mse 0.1519 t 773 new 0.24) lr 1.00e-05 gnorm 0.200 3.04s mem 81.1GB +step 592/5000 loss 0.1722 (w 0.2353 mse 0.2348 t 921 new 0.15) lr 1.00e-05 gnorm 0.150 3.32s mem 81.1GB +step 593/5000 loss 0.2241 (w 0.3086 mse 0.3053 t 963 new 0.19) lr 1.00e-05 gnorm 0.176 3.42s mem 81.1GB +step 594/5000 loss 0.2197 (w 0.2991 mse 0.3003 t 940 new 0.26) lr 1.00e-05 gnorm 0.217 3.13s mem 81.1GB +step 595/5000 loss 0.3338 (w 0.1953 mse 0.1871 t 866 new 0.18) lr 1.00e-05 gnorm 0.208 2.85s mem 81.1GB +step 596/5000 loss 0.1425 (w 0.2096 mse 0.2104 t 918 new 0.27) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +step 597/5000 loss 0.2354 (w 0.2137 mse 0.2116 t 863 new 0.21) lr 1.00e-05 gnorm 0.191 3.07s mem 81.1GB +step 598/5000 loss 0.2401 (w 0.3280 mse 0.3233 t 968 new 0.26) lr 1.00e-05 gnorm 0.138 3.37s mem 81.1GB +step 599/5000 loss 0.2512 (w 0.3488 mse 0.3445 t 963 new 0.22) lr 1.00e-05 gnorm 0.241 3.54s mem 81.1GB +step 600/5000 loss 0.3758 (w 0.1802 mse 0.1804 t 467 new 0.19) lr 1.00e-05 gnorm 0.145 3.11s mem 81.1GB +step 601/5000 loss 0.2063 (w 0.2829 mse 0.2726 t 995 new 0.25) lr 1.00e-05 gnorm 0.146 2.84s mem 81.1GB +step 602/5000 loss 0.2752 (w 0.1846 mse 0.1910 t 838 new 0.20) lr 1.00e-05 gnorm 0.252 2.84s mem 81.1GB +step 603/5000 loss 0.1649 (w 0.1484 mse 0.1588 t 969 new 0.13) lr 1.00e-05 gnorm 0.182 3.10s mem 81.1GB +step 604/5000 loss 0.2618 (w 0.2479 mse 0.2423 t 912 new 0.21) lr 1.00e-05 gnorm 0.229 3.27s mem 81.1GB +step 605/5000 loss 0.1353 (w 0.3502 mse 0.3266 t 977 new 0.14) lr 1.00e-05 gnorm 0.187 3.63s mem 81.1GB +step 606/5000 loss 0.3083 (w 0.2816 mse 0.2755 t 956 new 0.16) lr 1.00e-05 gnorm 0.168 2.84s mem 81.1GB +step 607/5000 loss 0.2005 (w 0.2249 mse 0.2139 t 839 new 0.25) lr 1.00e-05 gnorm 0.261 2.84s mem 81.1GB +step 608/5000 loss 0.3116 (w 0.3097 mse 0.2937 t 797 new 0.20) lr 1.00e-05 gnorm 0.384 2.84s mem 81.1GB +step 609/5000 loss 0.4665 (w 0.3789 mse 0.3731 t 979 new 0.21) lr 1.00e-05 gnorm 0.204 3.02s mem 81.1GB +step 610/5000 loss 0.3603 (w 0.5910 mse 0.6206 t 127 new 0.23) lr 1.00e-05 gnorm 0.255 3.37s mem 81.1GB +step 611/5000 loss 0.1355 (w 0.3129 mse 0.3010 t 987 new 0.24) lr 1.00e-05 gnorm 0.104 3.65s mem 81.1GB +step 612/5000 loss 0.3128 (w 0.2610 mse 0.2529 t 982 new 0.20) lr 1.00e-05 gnorm 0.254 2.84s mem 81.1GB +step 613/5000 loss 0.2042 (w 0.2775 mse 0.2727 t 557 new 0.24) lr 1.00e-05 gnorm 0.279 2.84s mem 81.1GB +step 614/5000 loss 0.2780 (w 0.2921 mse 0.3010 t 421 new 0.22) lr 1.00e-05 gnorm 0.147 2.85s mem 81.1GB +step 615/5000 loss 0.2806 (w 0.1837 mse 0.1890 t 913 new 0.12) lr 1.00e-05 gnorm 0.503 3.28s mem 81.1GB +step 616/5000 loss 0.2497 (w 0.2123 mse 0.2121 t 839 new 0.16) lr 1.00e-05 gnorm 0.181 3.56s mem 81.1GB +step 617/5000 loss 0.2046 (w 0.2717 mse 0.2713 t 937 new 0.26) lr 1.00e-05 gnorm 0.146 3.50s mem 81.1GB +step 618/5000 loss 0.2004 (w 0.3493 mse 0.3543 t 994 new 0.13) lr 1.00e-05 gnorm 0.138 2.85s mem 81.1GB +step 619/5000 loss 0.2182 (w 0.2819 mse 0.2786 t 822 new 0.18) lr 1.00e-05 gnorm 0.158 2.85s mem 81.1GB +step 620/5000 loss 0.3209 (w 0.2464 mse 0.2480 t 832 new 0.12) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +step 621/5000 loss 0.4518 (w 0.2490 mse 0.2478 t 692 new 0.22) lr 1.00e-05 gnorm 0.188 3.11s mem 81.1GB +step 622/5000 loss 0.2361 (w 0.2426 mse 0.2350 t 845 new 0.23) lr 1.00e-05 gnorm 0.127 3.58s mem 81.1GB +step 623/5000 loss 0.1763 (w 0.2502 mse 0.2420 t 938 new 0.12) lr 1.00e-05 gnorm 0.185 3.42s mem 81.1GB +step 624/5000 loss 0.2252 (w 0.2185 mse 0.2097 t 939 new 0.21) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +step 625/5000 loss 0.2898 (w 0.2807 mse 0.2880 t 348 new 0.20) lr 1.00e-05 gnorm 0.223 2.84s mem 81.1GB +step 626/5000 loss 0.1636 (w 0.0896 mse 0.0933 t 675 new 0.12) lr 1.00e-05 gnorm 0.221 3.11s mem 81.1GB +step 627/5000 loss 0.1446 (w 0.2706 mse 0.2661 t 952 new 0.12) lr 1.00e-05 gnorm 0.199 3.07s mem 81.1GB +step 628/5000 loss 0.0829 (w 0.3343 mse 0.3162 t 969 new 0.21) lr 1.00e-05 gnorm 0.139 3.56s mem 81.1GB +step 629/5000 loss 0.1529 (w 0.0890 mse 0.0984 t 945 new 0.10) lr 1.00e-05 gnorm 0.152 3.39s mem 81.1GB +step 630/5000 loss 0.1586 (w 0.2970 mse 0.3069 t 980 new 0.20) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 631/5000 loss 0.3582 (w 0.2228 mse 0.2232 t 939 new 0.18) lr 1.00e-05 gnorm 0.186 2.85s mem 81.1GB +step 632/5000 loss 0.3025 (w 0.4020 mse 0.4037 t 992 new 0.23) lr 1.00e-05 gnorm 0.157 3.26s mem 81.1GB +step 633/5000 loss 0.2303 (w 0.1761 mse 0.1856 t 853 new 0.15) lr 1.00e-05 gnorm 0.216 3.29s mem 81.1GB +step 634/5000 loss 0.2284 (w 0.3109 mse 0.3148 t 980 new 0.26) lr 1.00e-05 gnorm 0.445 3.26s mem 81.1GB +step 635/5000 loss 0.1394 (w 0.2608 mse 0.2444 t 935 new 0.15) lr 1.00e-05 gnorm 0.160 3.44s mem 81.1GB +step 636/5000 loss 0.3845 (w 0.7149 mse 0.7044 t 100 new 0.20) lr 1.00e-05 gnorm 0.205 2.84s mem 81.1GB +step 637/5000 loss 0.4053 (w 0.3527 mse 0.3403 t 695 new 0.27) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +step 638/5000 loss 0.3102 (w 0.1797 mse 0.1785 t 516 new 0.18) lr 1.00e-05 gnorm 0.199 3.14s mem 81.1GB +step 639/5000 loss 0.4293 (w 0.2926 mse 0.2876 t 623 new 0.16) lr 1.00e-05 gnorm 0.273 3.12s mem 81.1GB +step 640/5000 loss 0.1637 (w 0.2982 mse 0.2910 t 911 new 0.23) lr 1.00e-05 gnorm 0.210 3.52s mem 81.1GB +step 641/5000 loss 0.2564 (w 0.2138 mse 0.2131 t 636 new 0.17) lr 1.00e-05 gnorm 0.193 3.17s mem 81.1GB +step 642/5000 loss 0.1318 (w 0.1548 mse 0.1695 t 962 new 0.23) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +step 643/5000 loss 0.2882 (w 0.4380 mse 0.4424 t 259 new 0.08) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +step 644/5000 loss 0.3485 (w 0.2660 mse 0.2557 t 800 new 0.14) lr 1.00e-05 gnorm 0.124 3.30s mem 81.1GB +step 645/5000 loss 0.2140 (w 0.1381 mse 0.1320 t 972 new 0.21) lr 1.00e-05 gnorm 0.210 3.07s mem 81.1GB +step 646/5000 loss 0.1630 (w 0.1952 mse 0.1963 t 984 new 0.25) lr 1.00e-05 gnorm 0.447 3.32s mem 81.1GB +step 647/5000 loss 0.3304 (w 0.2902 mse 0.2923 t 444 new 0.21) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +step 648/5000 loss 0.1706 (w 0.4035 mse 0.4033 t 998 new 0.16) lr 1.00e-05 gnorm 1.310 2.84s mem 81.1GB +step 649/5000 loss 0.1418 (w 0.2029 mse 0.1922 t 901 new 0.19) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +step 650/5000 loss 0.1941 (w 0.1191 mse 0.1174 t 785 new 0.11) lr 1.00e-05 gnorm 0.207 3.36s mem 81.1GB +step 651/5000 loss 0.3214 (w 0.2417 mse 0.2387 t 598 new 0.08) lr 1.00e-05 gnorm 0.189 3.35s mem 81.1GB +step 652/5000 loss 0.3327 (w 0.1385 mse 0.1343 t 776 new 0.25) lr 1.00e-05 gnorm 0.158 3.47s mem 81.1GB +step 653/5000 loss 0.3601 (w 0.2660 mse 0.2507 t 921 new 0.14) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +step 654/5000 loss 0.2326 (w 0.1603 mse 0.1650 t 945 new 0.23) lr 1.00e-05 gnorm 0.215 2.83s mem 81.1GB +step 655/5000 loss 0.1711 (w 0.3764 mse 0.3705 t 974 new 0.21) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +step 656/5000 loss 0.2151 (w 0.4393 mse 0.4508 t 978 new 0.19) lr 1.00e-05 gnorm 1.234 3.13s mem 81.1GB +step 657/5000 loss 0.3464 (w 0.1336 mse 0.1435 t 700 new 0.20) lr 1.00e-05 gnorm 0.160 3.31s mem 81.1GB +step 658/5000 loss 0.3440 (w 0.2804 mse 0.2728 t 972 new 0.10) lr 1.00e-05 gnorm 0.165 3.39s mem 81.1GB +step 659/5000 loss 0.1762 (w 0.4419 mse 0.4078 t 990 new 0.20) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +step 660/5000 loss 0.1835 (w 0.3341 mse 0.3294 t 989 new 0.24) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 661/5000 loss 0.2251 (w 0.1870 mse 0.1857 t 881 new 0.22) lr 1.00e-05 gnorm 0.148 2.83s mem 81.1GB +step 662/5000 loss 0.2444 (w 0.2470 mse 0.2375 t 921 new 0.26) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +step 663/5000 loss 0.2695 (w 0.2364 mse 0.2241 t 920 new 0.25) lr 1.00e-05 gnorm 0.192 3.26s mem 81.1GB +step 664/5000 loss 0.2849 (w 0.2581 mse 0.2461 t 911 new 0.23) lr 1.00e-05 gnorm 0.186 3.43s mem 81.1GB +step 665/5000 loss 0.1962 (w 0.3485 mse 0.3448 t 967 new 0.23) lr 1.00e-05 gnorm 0.258 2.84s mem 81.1GB +step 666/5000 loss 0.3272 (w 0.3915 mse 0.4006 t 372 new 0.20) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +step 667/5000 loss 0.2955 (w 0.1641 mse 0.1783 t 767 new 0.26) lr 1.00e-05 gnorm 0.217 2.84s mem 81.1GB +step 668/5000 loss 0.1725 (w 0.2847 mse 0.2655 t 728 new 0.17) lr 1.00e-05 gnorm 0.147 3.12s mem 81.1GB +step 669/5000 loss 0.4032 (w 0.2442 mse 0.2510 t 954 new 0.23) lr 1.00e-05 gnorm 0.255 3.39s mem 81.1GB +step 670/5000 loss 0.2168 (w 0.1911 mse 0.1844 t 954 new 0.25) lr 1.00e-05 gnorm 0.412 3.36s mem 81.1GB +step 671/5000 loss 0.1795 (w 0.3270 mse 0.3088 t 994 new 0.25) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +step 672/5000 loss 0.3112 (w 0.2352 mse 0.2208 t 852 new 0.26) lr 1.00e-05 gnorm 0.163 2.85s mem 81.1GB +step 673/5000 loss 0.1967 (w 0.1991 mse 0.2079 t 815 new 0.24) lr 1.00e-05 gnorm 0.221 3.12s mem 81.1GB +step 674/5000 loss 0.1040 (w 0.3296 mse 0.3200 t 999 new 0.23) lr 1.00e-05 gnorm 0.108 3.08s mem 81.1GB +step 675/5000 loss 0.1917 (w 0.2126 mse 0.2133 t 934 new 0.23) lr 1.00e-05 gnorm 0.301 3.40s mem 81.1GB +step 676/5000 loss 0.2233 (w 0.1471 mse 0.1486 t 875 new 0.13) lr 1.00e-05 gnorm 0.141 3.29s mem 81.1GB +step 677/5000 loss 0.2032 (w 0.2141 mse 0.2196 t 865 new 0.25) lr 1.00e-05 gnorm 0.182 2.85s mem 81.1GB +step 678/5000 loss 0.2203 (w 0.3127 mse 0.3106 t 896 new 0.21) lr 1.00e-05 gnorm 0.220 2.84s mem 81.1GB +step 679/5000 loss 0.2504 (w 0.3802 mse 0.3668 t 980 new 0.22) lr 1.00e-05 gnorm 0.317 3.05s mem 81.1GB +step 680/5000 loss 0.2486 (w 0.2041 mse 0.2009 t 915 new 0.20) lr 1.00e-05 gnorm 0.175 2.84s mem 81.1GB +step 681/5000 loss 0.2840 (w 0.2749 mse 0.2724 t 692 new 0.23) lr 1.00e-05 gnorm 0.151 3.36s mem 81.1GB +step 682/5000 loss 0.2352 (w 0.4546 mse 0.4514 t 228 new 0.16) lr 1.00e-05 gnorm 0.165 3.31s mem 81.1GB +step 683/5000 loss 0.1891 (w 0.1602 mse 0.1696 t 993 new 0.15) lr 1.00e-05 gnorm 0.209 2.84s mem 81.1GB +step 684/5000 loss 0.3120 (w 0.2255 mse 0.2222 t 779 new 0.21) lr 1.00e-05 gnorm 0.182 2.84s mem 81.1GB +step 685/5000 loss 0.1519 (w 0.2563 mse 0.2531 t 555 new 0.22) lr 1.00e-05 gnorm 0.334 3.09s mem 81.1GB +step 686/5000 loss 0.3575 (w 0.2047 mse 0.1852 t 970 new 0.26) lr 1.00e-05 gnorm 0.211 3.11s mem 81.1GB +step 687/5000 loss 0.3266 (w 0.8801 mse 0.8472 t 990 new 0.19) lr 1.00e-05 gnorm 0.472 3.32s mem 81.1GB +step 688/5000 loss 0.2735 (w 0.3047 mse 0.2868 t 878 new 0.22) lr 1.00e-05 gnorm 0.156 3.33s mem 81.1GB +step 689/5000 loss 0.3526 (w 0.4000 mse 0.3908 t 383 new 0.19) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 690/5000 loss 0.3789 (w 0.2486 mse 0.2385 t 854 new 0.16) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +step 691/5000 loss 0.2175 (w 0.4628 mse 0.4956 t 159 new 0.17) lr 1.00e-05 gnorm 0.126 3.34s mem 81.1GB +step 692/5000 loss 0.1299 (w 0.2322 mse 0.2272 t 903 new 0.24) lr 1.00e-05 gnorm 0.154 4.06s mem 81.1GB +step 693/5000 loss 0.2482 (w 0.3146 mse 0.2950 t 969 new 0.23) lr 1.00e-05 gnorm 0.497 3.48s mem 81.1GB +step 694/5000 loss 0.2723 (w 0.1676 mse 0.1629 t 734 new 0.14) lr 1.00e-05 gnorm 0.162 3.42s mem 81.1GB +step 695/5000 loss 0.1948 (w 0.2054 mse 0.2124 t 639 new 0.22) lr 1.00e-05 gnorm 0.140 2.85s mem 81.1GB +step 696/5000 loss 0.1903 (w 0.1486 mse 0.1551 t 768 new 0.17) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +step 697/5000 loss 0.2542 (w 0.2063 mse 0.2041 t 834 new 0.26) lr 1.00e-05 gnorm 0.131 3.31s mem 81.1GB +step 698/5000 loss 0.1966 (w 0.2091 mse 0.2269 t 970 new 0.23) lr 1.00e-05 gnorm 0.165 3.08s mem 81.1GB +step 699/5000 loss 0.2051 (w 0.1277 mse 0.1288 t 748 new 0.20) lr 1.00e-05 gnorm 0.130 3.45s mem 81.1GB +step 700/5000 loss 0.1749 (w 0.2320 mse 0.2380 t 982 new 0.12) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +step 701/5000 loss 0.3804 (w 0.3097 mse 0.3401 t 292 new 0.20) lr 1.00e-05 gnorm 0.197 2.85s mem 81.1GB +step 702/5000 loss 0.1457 (w 0.2370 mse 0.2444 t 934 new 0.10) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +step 703/5000 loss 0.3897 (w 0.1500 mse 0.1544 t 603 new 0.17) lr 1.00e-05 gnorm 0.197 3.29s mem 81.1GB +step 704/5000 loss 0.2943 (w 0.1715 mse 0.1795 t 599 new 0.24) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +step 705/5000 loss 0.3891 (w 0.2383 mse 0.2422 t 467 new 0.24) lr 1.00e-05 gnorm 0.142 3.16s mem 81.1GB +step 706/5000 loss 0.3284 (w 0.2227 mse 0.2082 t 695 new 0.18) lr 1.00e-05 gnorm 0.159 3.16s mem 81.1GB +step 707/5000 loss 0.2480 (w 0.4876 mse 0.4724 t 991 new 0.14) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 708/5000 loss 0.1974 (w 0.2263 mse 0.2354 t 961 new 0.19) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +step 709/5000 loss 0.1515 (w 0.1889 mse 0.1789 t 881 new 0.08) lr 1.00e-05 gnorm 0.164 3.38s mem 81.1GB +step 710/5000 loss 0.2556 (w 0.1994 mse 0.2164 t 980 new 0.18) lr 1.00e-05 gnorm 0.126 3.37s mem 81.1GB +step 711/5000 loss 0.3161 (w 0.3946 mse 0.3926 t 301 new 0.21) lr 1.00e-05 gnorm 0.212 3.39s mem 81.1GB +step 712/5000 loss 0.1743 (w 0.3773 mse 0.3782 t 1000 new 0.13) lr 1.00e-05 gnorm 0.157 2.84s mem 81.1GB +step 713/5000 loss 0.2465 (w 0.1916 mse 0.1914 t 913 new 0.10) lr 1.00e-05 gnorm 0.183 2.84s mem 81.1GB +step 714/5000 loss 0.3012 (w 0.1463 mse 0.1423 t 790 new 0.26) lr 1.00e-05 gnorm 0.167 3.15s mem 81.1GB +step 715/5000 loss 0.1966 (w 0.3246 mse 0.3285 t 1000 new 0.19) lr 1.00e-05 gnorm 0.142 3.05s mem 81.1GB +step 716/5000 loss 0.3138 (w 0.2206 mse 0.2109 t 888 new 0.23) lr 1.00e-05 gnorm 0.181 3.34s mem 81.1GB +step 717/5000 loss 0.2709 (w 0.7888 mse 0.7817 t 120 new 0.23) lr 1.00e-05 gnorm 0.266 3.40s mem 81.1GB +step 718/5000 loss 0.2248 (w 0.2767 mse 0.2812 t 956 new 0.21) lr 1.00e-05 gnorm 0.287 2.85s mem 81.1GB +step 719/5000 loss 0.2135 (w 0.2266 mse 0.2168 t 969 new 0.13) lr 1.00e-05 gnorm 0.140 2.86s mem 81.1GB +step 720/5000 loss 0.2534 (w 0.1052 mse 0.1166 t 932 new 0.18) lr 1.00e-05 gnorm 0.154 3.34s mem 81.1GB +step 721/5000 loss 0.1804 (w 0.6380 mse 0.6258 t 146 new 0.17) lr 1.00e-05 gnorm 0.158 3.37s mem 81.1GB +step 722/5000 loss 0.3020 (w 0.4268 mse 0.4039 t 998 new 0.24) lr 1.00e-05 gnorm 0.166 3.45s mem 81.1GB +step 723/5000 loss 0.2096 (w 0.2094 mse 0.1992 t 770 new 0.23) lr 1.00e-05 gnorm 0.171 3.39s mem 81.1GB +step 724/5000 loss 0.1477 (w 0.2609 mse 0.2592 t 959 new 0.23) lr 1.00e-05 gnorm 0.320 2.84s mem 81.1GB +step 725/5000 loss 0.2917 (w 0.3145 mse 0.3158 t 568 new 0.17) lr 1.00e-05 gnorm 0.125 2.86s mem 81.1GB +step 726/5000 loss 0.2153 (w 0.2605 mse 0.2540 t 924 new 0.20) lr 1.00e-05 gnorm 0.277 3.17s mem 81.1GB +step 727/5000 loss 0.3452 (w 0.1901 mse 0.1863 t 932 new 0.16) lr 1.00e-05 gnorm 0.314 3.05s mem 81.1GB +step 728/5000 loss 0.1883 (w 0.2255 mse 0.2300 t 530 new 0.13) lr 1.00e-05 gnorm 0.129 3.10s mem 81.1GB +step 729/5000 loss 0.1749 (w 0.2152 mse 0.2084 t 909 new 0.15) lr 1.00e-05 gnorm 0.193 3.44s mem 81.1GB +step 730/5000 loss 0.3454 (w 0.1041 mse 0.1066 t 560 new 0.17) lr 1.00e-05 gnorm 0.121 2.86s mem 81.1GB +step 731/5000 loss 0.1641 (w 0.2021 mse 0.2004 t 737 new 0.23) lr 1.00e-05 gnorm 0.299 2.85s mem 81.1GB +step 732/5000 loss 0.2912 (w 0.8468 mse 0.8763 t 994 new 0.21) lr 1.00e-05 gnorm 0.153 3.40s mem 81.1GB +step 733/5000 loss 0.2934 (w 0.3084 mse 0.3080 t 465 new 0.26) lr 1.00e-05 gnorm 0.214 3.04s mem 81.1GB +step 734/5000 loss 0.0957 (w 0.2453 mse 0.2608 t 982 new 0.23) lr 1.00e-05 gnorm 0.186 3.48s mem 81.1GB +step 735/5000 loss 0.2208 (w 0.1677 mse 0.1608 t 786 new 0.23) lr 1.00e-05 gnorm 0.411 3.13s mem 81.1GB +step 736/5000 loss 0.3328 (w 0.3279 mse 0.3170 t 979 new 0.25) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +step 737/5000 loss 0.3651 (w 0.3416 mse 0.3410 t 506 new 0.25) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +step 738/5000 loss 0.4052 (w 0.2808 mse 0.2787 t 683 new 0.19) lr 1.00e-05 gnorm 0.169 3.39s mem 81.1GB +step 739/5000 loss 0.2553 (w 0.2217 mse 0.2227 t 681 new 0.24) lr 1.00e-05 gnorm 0.173 3.07s mem 81.1GB +step 740/5000 loss 0.3429 (w 0.1805 mse 0.1789 t 817 new 0.19) lr 1.00e-05 gnorm 0.133 3.39s mem 81.1GB +step 741/5000 loss 0.2400 (w 0.0999 mse 0.1048 t 852 new 0.08) lr 1.00e-05 gnorm 0.180 3.16s mem 81.1GB +step 742/5000 loss 0.2248 (w 0.2523 mse 0.2467 t 677 new 0.22) lr 1.00e-05 gnorm 0.337 2.84s mem 81.1GB +step 743/5000 loss 0.2058 (w 0.3028 mse 0.3014 t 974 new 0.23) lr 1.00e-05 gnorm 0.142 2.85s mem 81.1GB +step 744/5000 loss 0.3164 (w 0.2751 mse 0.2602 t 974 new 0.21) lr 1.00e-05 gnorm 0.187 3.06s mem 81.1GB +step 745/5000 loss 0.2359 (w 0.2179 mse 0.2097 t 930 new 0.19) lr 1.00e-05 gnorm 0.214 3.36s mem 81.1GB +step 746/5000 loss 0.2694 (w 0.2899 mse 0.2681 t 883 new 0.23) lr 1.00e-05 gnorm 0.168 3.12s mem 81.1GB +step 747/5000 loss 0.3425 (w 0.2793 mse 0.2782 t 684 new 0.28) lr 1.00e-05 gnorm 0.168 2.84s mem 81.1GB +step 748/5000 loss 0.3555 (w 0.2841 mse 0.2841 t 945 new 0.16) lr 1.00e-05 gnorm 0.233 2.84s mem 81.1GB +step 749/5000 loss 0.3394 (w 0.2003 mse 0.1990 t 645 new 0.24) lr 1.00e-05 gnorm 0.214 2.85s mem 81.1GB +step 750/5000 loss 0.2642 (w 0.1795 mse 0.1767 t 904 new 0.25) lr 1.00e-05 gnorm 0.167 3.10s mem 81.1GB +step 751/5000 loss 0.2485 (w 0.3308 mse 0.3155 t 979 new 0.24) lr 1.00e-05 gnorm 0.150 3.35s mem 81.1GB +step 752/5000 loss 0.3831 (w 0.1458 mse 0.1436 t 718 new 0.21) lr 1.00e-05 gnorm 0.340 3.15s mem 81.1GB +step 753/5000 loss 0.2679 (w 0.1813 mse 0.1791 t 528 new 0.15) lr 1.00e-05 gnorm 0.199 2.84s mem 81.1GB +step 754/5000 loss 0.2795 (w 0.2452 mse 0.2366 t 609 new 0.16) lr 1.00e-05 gnorm 0.196 2.84s mem 81.1GB +step 755/5000 loss 0.1588 (w 0.1565 mse 0.1508 t 754 new 0.22) lr 1.00e-05 gnorm 0.242 3.01s mem 81.1GB +step 756/5000 loss 0.1939 (w 0.2847 mse 0.2921 t 977 new 0.10) lr 1.00e-05 gnorm 0.140 3.34s mem 81.1GB +step 757/5000 loss 0.2805 (w 0.2728 mse 0.2726 t 428 new 0.16) lr 1.00e-05 gnorm 0.180 3.40s mem 81.1GB +step 758/5000 loss 0.2997 (w 0.2494 mse 0.2487 t 808 new 0.16) lr 1.00e-05 gnorm 0.166 3.42s mem 81.1GB +step 759/5000 loss 0.1919 (w 0.2240 mse 0.2165 t 779 new 0.25) lr 1.00e-05 gnorm 0.168 2.84s mem 81.1GB +step 760/5000 loss 0.2410 (w 0.1400 mse 0.1454 t 762 new 0.17) lr 1.00e-05 gnorm 0.151 2.84s mem 81.1GB +step 761/5000 loss 0.1337 (w 0.2529 mse 0.2373 t 947 new 0.19) lr 1.00e-05 gnorm 0.152 3.14s mem 81.1GB +step 762/5000 loss 0.2570 (w 0.2569 mse 0.2589 t 951 new 0.20) lr 1.00e-05 gnorm 0.191 3.09s mem 81.1GB +step 763/5000 loss 0.2292 (w 0.2514 mse 0.2565 t 842 new 0.22) lr 1.00e-05 gnorm 0.154 3.34s mem 81.1GB +step 764/5000 loss 0.1802 (w 0.1781 mse 0.1764 t 784 new 0.21) lr 1.00e-05 gnorm 0.172 3.38s mem 81.1GB +step 765/5000 loss 0.1903 (w 0.2590 mse 0.2538 t 974 new 0.24) lr 1.00e-05 gnorm 0.273 2.85s mem 81.1GB +step 766/5000 loss 0.2529 (w 0.2480 mse 0.2447 t 973 new 0.10) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +step 767/5000 loss 0.2315 (w 0.2952 mse 0.2929 t 947 new 0.21) lr 1.00e-05 gnorm 0.138 3.09s mem 81.1GB +step 768/5000 loss 0.2165 (w 0.5363 mse 0.5601 t 200 new 0.21) lr 1.00e-05 gnorm 0.133 3.09s mem 81.1GB +step 769/5000 loss 0.1809 (w 0.2693 mse 0.2587 t 984 new 0.18) lr 1.00e-05 gnorm 0.250 3.41s mem 81.1GB +step 770/5000 loss 0.3765 (w 0.2069 mse 0.2152 t 394 new 0.22) lr 1.00e-05 gnorm 0.149 3.14s mem 81.1GB +step 771/5000 loss 0.1756 (w 0.2552 mse 0.2449 t 948 new 0.17) lr 1.00e-05 gnorm 0.263 2.83s mem 81.1GB +step 772/5000 loss 0.2188 (w 0.2439 mse 0.2325 t 845 new 0.24) lr 1.00e-05 gnorm 0.150 2.83s mem 81.1GB +step 773/5000 loss 0.2659 (w 0.4239 mse 0.4167 t 348 new 0.23) lr 1.00e-05 gnorm 0.185 3.10s mem 81.1GB +step 774/5000 loss 0.3975 (w 0.3006 mse 0.2915 t 987 new 0.25) lr 1.00e-05 gnorm 0.162 3.60s mem 81.1GB +step 775/5000 loss 0.2717 (w 0.2288 mse 0.2308 t 773 new 0.19) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +step 776/5000 loss 0.1804 (w 0.2796 mse 0.2723 t 767 new 0.26) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +step 777/5000 loss 0.2723 (w 0.1462 mse 0.1545 t 832 new 0.24) lr 1.00e-05 gnorm 0.154 2.84s mem 81.1GB +step 778/5000 loss 0.3854 (w 0.1516 mse 0.1496 t 846 new 0.25) lr 1.00e-05 gnorm 0.189 2.84s mem 81.1GB +step 779/5000 loss 0.2325 (w 0.2652 mse 0.2536 t 827 new 0.16) lr 1.00e-05 gnorm 0.133 3.13s mem 81.1GB +step 780/5000 loss 0.2205 (w 0.1990 mse 0.1985 t 518 new 0.22) lr 1.00e-05 gnorm 0.136 3.32s mem 81.1GB +step 781/5000 loss 0.2155 (w 0.1305 mse 0.1445 t 941 new 0.17) lr 1.00e-05 gnorm 0.861 3.32s mem 81.1GB +step 782/5000 loss 0.2566 (w 0.3557 mse 0.3592 t 465 new 0.18) lr 1.00e-05 gnorm 0.184 2.84s mem 81.1GB +step 783/5000 loss 0.1476 (w 0.3247 mse 0.3273 t 979 new 0.08) lr 1.00e-05 gnorm 0.171 2.84s mem 81.1GB +step 784/5000 loss 0.2029 (w 0.4330 mse 0.4192 t 989 new 0.19) lr 1.00e-05 gnorm 0.183 2.83s mem 81.1GB +step 785/5000 loss 0.2991 (w 0.2413 mse 0.2262 t 712 new 0.21) lr 1.00e-05 gnorm 0.277 3.07s mem 81.1GB +step 786/5000 loss 0.1772 (w 0.2907 mse 0.2809 t 954 new 0.21) lr 1.00e-05 gnorm 0.481 3.36s mem 81.1GB +step 787/5000 loss 0.2035 (w 0.2221 mse 0.2262 t 983 new 0.08) lr 1.00e-05 gnorm 0.157 3.39s mem 81.1GB +step 788/5000 loss 0.2948 (w 0.3791 mse 0.3792 t 962 new 0.19) lr 1.00e-05 gnorm 0.164 3.00s mem 81.1GB +step 789/5000 loss 0.2974 (w 0.1627 mse 0.1613 t 928 new 0.18) lr 1.00e-05 gnorm 0.482 2.85s mem 81.1GB +step 790/5000 loss 0.3602 (w 0.3210 mse 0.3129 t 453 new 0.15) lr 1.00e-05 gnorm 0.164 2.85s mem 81.1GB +step 791/5000 loss 0.1204 (w 0.2259 mse 0.2168 t 974 new 0.19) lr 1.00e-05 gnorm 0.126 3.48s mem 81.1GB +step 792/5000 loss 0.2340 (w 0.2644 mse 0.2562 t 828 new 0.19) lr 1.00e-05 gnorm 0.281 3.36s mem 81.1GB +step 793/5000 loss 0.1689 (w 0.3692 mse 0.3618 t 996 new 0.23) lr 1.00e-05 gnorm 0.197 3.45s mem 81.1GB +step 794/5000 loss 0.1576 (w 0.1892 mse 0.1931 t 929 new 0.22) lr 1.00e-05 gnorm 0.294 2.85s mem 81.1GB +step 795/5000 loss 0.0833 (w 0.2456 mse 0.2402 t 991 new 0.25) lr 1.00e-05 gnorm 0.116 2.86s mem 81.1GB +step 796/5000 loss 0.4829 (w 0.3432 mse 0.3381 t 453 new 0.20) lr 1.00e-05 gnorm 0.162 3.15s mem 81.1GB +step 797/5000 loss 0.2773 (w 0.2215 mse 0.2343 t 808 new 0.16) lr 1.00e-05 gnorm 0.384 3.05s mem 81.1GB +step 798/5000 loss 0.2194 (w 0.2257 mse 0.2310 t 938 new 0.20) lr 1.00e-05 gnorm 0.166 3.52s mem 81.1GB +step 799/5000 loss 0.1221 (w 0.2376 mse 0.2422 t 979 new 0.10) lr 1.00e-05 gnorm 0.214 3.09s mem 81.1GB +step 800/5000 loss 0.1046 (w 0.1709 mse 0.1821 t 816 new 0.21) lr 1.00e-05 gnorm 0.188 2.84s mem 81.1GB +step 801/5000 loss 0.2568 (w 0.4527 mse 0.4386 t 976 new 0.24) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +step 802/5000 loss 0.2231 (w 0.2410 mse 0.2237 t 834 new 0.28) lr 1.00e-05 gnorm 0.172 3.30s mem 81.1GB +step 803/5000 loss 0.2238 (w 0.0965 mse 0.1111 t 832 new 0.18) lr 1.00e-05 gnorm 0.300 3.06s mem 81.1GB +step 804/5000 loss 0.1818 (w 0.0973 mse 0.1007 t 845 new 0.09) lr 1.00e-05 gnorm 0.367 3.23s mem 81.1GB +step 805/5000 loss 0.2117 (w 0.2819 mse 0.2732 t 835 new 0.22) lr 1.00e-05 gnorm 0.147 3.19s mem 81.1GB +step 806/5000 loss 0.1579 (w 0.1918 mse 0.2017 t 875 new 0.21) lr 1.00e-05 gnorm 0.151 2.84s mem 81.1GB +step 807/5000 loss 0.2327 (w 0.4675 mse 0.4633 t 998 new 0.19) lr 1.00e-05 gnorm 0.178 2.85s mem 81.1GB +step 808/5000 loss 0.2268 (w 0.3036 mse 0.2881 t 971 new 0.25) lr 1.00e-05 gnorm 0.236 3.09s mem 81.1GB +step 809/5000 loss 0.1829 (w 0.2035 mse 0.1966 t 901 new 0.24) lr 1.00e-05 gnorm 0.175 3.37s mem 81.1GB +step 810/5000 loss 0.1387 (w 0.2102 mse 0.1866 t 835 new 0.20) lr 1.00e-05 gnorm 0.155 3.29s mem 81.1GB +step 811/5000 loss 0.1031 (w 0.5279 mse 0.5104 t 991 new 0.19) lr 1.00e-05 gnorm 0.187 2.84s mem 81.1GB +step 812/5000 loss 0.3983 (w 0.2525 mse 0.2407 t 847 new 0.20) lr 1.00e-05 gnorm 0.207 2.85s mem 81.1GB +step 813/5000 loss 0.1495 (w 0.4102 mse 0.3833 t 982 new 0.23) lr 1.00e-05 gnorm 0.116 2.85s mem 81.1GB +step 814/5000 loss 0.1985 (w 0.1551 mse 0.1460 t 822 new 0.22) lr 1.00e-05 gnorm 0.204 3.12s mem 81.1GB +step 815/5000 loss 0.2988 (w 0.2698 mse 0.2644 t 549 new 0.20) lr 1.00e-05 gnorm 0.144 3.41s mem 81.1GB +step 816/5000 loss 0.3882 (w 0.3287 mse 0.3236 t 383 new 0.19) lr 1.00e-05 gnorm 0.117 3.39s mem 81.1GB +step 817/5000 loss 0.1659 (w 0.2792 mse 0.2657 t 956 new 0.23) lr 1.00e-05 gnorm 0.117 2.85s mem 81.1GB +step 818/5000 loss 0.3125 (w 0.1474 mse 0.1609 t 930 new 0.17) lr 1.00e-05 gnorm 0.136 2.86s mem 81.1GB +step 819/5000 loss 0.1320 (w 0.2990 mse 0.2890 t 998 new 0.23) lr 1.00e-05 gnorm 0.720 2.86s mem 81.1GB +step 820/5000 loss 0.1499 (w 0.3140 mse 0.2988 t 1000 new 0.13) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +step 821/5000 loss 0.1833 (w 0.2044 mse 0.2177 t 757 new 0.19) lr 1.00e-05 gnorm 0.147 3.67s mem 81.1GB +step 822/5000 loss 0.2665 (w 0.4338 mse 0.4236 t 984 new 0.28) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +step 823/5000 loss 0.1831 (w 0.4911 mse 0.4835 t 978 new 0.17) lr 1.00e-05 gnorm 0.189 2.86s mem 81.1GB +step 824/5000 loss 0.1353 (w 0.2224 mse 0.2118 t 872 new 0.21) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +step 825/5000 loss 0.4665 (w 0.3106 mse 0.3087 t 623 new 0.26) lr 1.00e-05 gnorm 0.205 2.86s mem 81.1GB +step 826/5000 loss 0.1582 (w 0.2492 mse 0.2411 t 952 new 0.24) lr 1.00e-05 gnorm 0.185 3.43s mem 81.1GB +step 827/5000 loss 0.3631 (w 0.2610 mse 0.2440 t 845 new 0.27) lr 1.00e-05 gnorm 0.164 3.14s mem 81.1GB +step 828/5000 loss 0.2188 (w 0.2218 mse 0.2185 t 922 new 0.13) lr 1.00e-05 gnorm 0.704 3.07s mem 81.1GB +step 829/5000 loss 0.1447 (w 0.2487 mse 0.2533 t 720 new 0.17) lr 1.00e-05 gnorm 0.245 2.84s mem 81.1GB +step 830/5000 loss 0.3076 (w 0.3071 mse 0.3071 t 923 new 0.15) lr 1.00e-05 gnorm 0.172 2.84s mem 81.1GB +step 831/5000 loss 0.2492 (w 0.3260 mse 0.3113 t 859 new 0.26) lr 1.00e-05 gnorm 3.028 3.04s mem 81.1GB +step 832/5000 loss 0.2483 (w 0.2205 mse 0.2080 t 729 new 0.22) lr 1.00e-05 gnorm 0.150 3.42s mem 81.1GB +step 833/5000 loss 0.4125 (w 0.2759 mse 0.2705 t 582 new 0.20) lr 1.00e-05 gnorm 0.216 3.16s mem 81.1GB +step 834/5000 loss 0.2980 (w 0.2583 mse 0.2499 t 927 new 0.20) lr 1.00e-05 gnorm 0.129 3.11s mem 81.1GB +step 835/5000 loss 0.1910 (w 0.3916 mse 0.3706 t 980 new 0.24) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +step 836/5000 loss 0.1289 (w 0.4028 mse 0.4094 t 975 new 0.19) lr 1.00e-05 gnorm 0.165 2.85s mem 81.1GB +step 837/5000 loss 0.1542 (w 0.2150 mse 0.2070 t 716 new 0.19) lr 1.00e-05 gnorm 0.150 3.28s mem 81.1GB +step 838/5000 loss 0.3050 (w 0.0998 mse 0.1019 t 797 new 0.21) lr 1.00e-05 gnorm 0.170 3.54s mem 81.1GB +step 839/5000 loss 0.1123 (w 0.2301 mse 0.2302 t 943 new 0.03) lr 1.00e-05 gnorm 0.163 3.44s mem 81.1GB +step 840/5000 loss 0.4163 (w 0.1451 mse 0.1584 t 774 new 0.19) lr 1.00e-05 gnorm 0.151 3.09s mem 81.1GB +step 841/5000 loss 0.1575 (w 0.3677 mse 0.3652 t 957 new 0.18) lr 1.00e-05 gnorm 0.155 2.85s mem 81.1GB +step 842/5000 loss 0.2256 (w 0.2522 mse 0.2730 t 974 new 0.19) lr 1.00e-05 gnorm 0.234 2.85s mem 81.1GB +step 843/5000 loss 0.1174 (w 0.2821 mse 0.2699 t 967 new 0.23) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +step 844/5000 loss 0.4286 (w 0.2051 mse 0.2025 t 967 new 0.24) lr 1.00e-05 gnorm 0.175 3.47s mem 81.1GB +step 845/5000 loss 0.1823 (w 0.3126 mse 0.3067 t 999 new 0.23) lr 1.00e-05 gnorm 0.155 3.52s mem 81.1GB +step 846/5000 loss 0.2588 (w 0.2289 mse 0.2229 t 962 new 0.24) lr 1.00e-05 gnorm 0.137 3.10s mem 81.1GB +step 847/5000 loss 0.1434 (w 0.1207 mse 0.1196 t 926 new 0.20) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +step 848/5000 loss 0.1896 (w 0.1986 mse 0.1943 t 735 new 0.19) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +step 849/5000 loss 0.2707 (w 0.1705 mse 0.1859 t 849 new 0.17) lr 1.00e-05 gnorm 0.238 3.11s mem 81.1GB +step 850/5000 loss 0.1431 (w 0.3691 mse 0.3618 t 974 new 0.27) lr 1.00e-05 gnorm 0.129 3.51s mem 81.1GB +step 851/5000 loss 0.2296 (w 0.4117 mse 0.3868 t 984 new 0.19) lr 1.00e-05 gnorm 0.463 3.23s mem 81.1GB +step 852/5000 loss 0.1889 (w 0.2013 mse 0.2066 t 741 new 0.20) lr 1.00e-05 gnorm 0.347 3.10s mem 81.1GB +step 853/5000 loss 0.2577 (w 0.1781 mse 0.1907 t 850 new 0.19) lr 1.00e-05 gnorm 0.290 2.87s mem 81.1GB +step 854/5000 loss 0.3208 (w 0.1689 mse 0.1671 t 837 new 0.23) lr 1.00e-05 gnorm 0.225 2.86s mem 81.1GB +step 855/5000 loss 0.1556 (w 0.2950 mse 0.2813 t 666 new 0.21) lr 1.00e-05 gnorm 0.179 3.02s mem 81.1GB +step 856/5000 loss 0.3081 (w 0.3265 mse 0.3260 t 953 new 0.22) lr 1.00e-05 gnorm 0.602 3.49s mem 81.1GB +step 857/5000 loss 0.4550 (w 0.1012 mse 0.1110 t 893 new 0.27) lr 1.00e-05 gnorm 0.645 3.24s mem 81.1GB +step 858/5000 loss 0.2088 (w 0.3618 mse 0.3512 t 988 new 0.18) lr 1.00e-05 gnorm 0.181 3.10s mem 81.1GB +step 859/5000 loss 0.3886 (w 0.2898 mse 0.2832 t 876 new 0.14) lr 1.00e-05 gnorm 0.183 2.84s mem 81.1GB +step 860/5000 loss 0.2834 (w 0.2937 mse 0.2887 t 944 new 0.22) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +step 861/5000 loss 0.2726 (w 0.1880 mse 0.1920 t 852 new 0.08) lr 1.00e-05 gnorm 0.179 3.08s mem 81.1GB +step 862/5000 loss 0.2635 (w 0.1961 mse 0.1937 t 857 new 0.23) lr 1.00e-05 gnorm 0.172 3.57s mem 81.1GB +step 863/5000 loss 0.2947 (w 0.3736 mse 0.3730 t 979 new 0.10) lr 1.00e-05 gnorm 0.130 3.16s mem 81.1GB +step 864/5000 loss 0.3332 (w 0.3136 mse 0.2905 t 936 new 0.21) lr 1.00e-05 gnorm 0.159 3.08s mem 81.1GB +step 865/5000 loss 0.1624 (w 0.2767 mse 0.2792 t 1000 new 0.22) lr 1.00e-05 gnorm 0.297 2.86s mem 81.1GB +step 866/5000 loss 0.2379 (w 0.2483 mse 0.2444 t 922 new 0.11) lr 1.00e-05 gnorm 0.162 2.85s mem 81.1GB +step 867/5000 loss 0.1560 (w 0.1984 mse 0.1878 t 984 new 0.22) lr 1.00e-05 gnorm 0.645 3.06s mem 81.1GB +step 868/5000 loss 0.2037 (w 0.1181 mse 0.1302 t 857 new 0.21) lr 1.00e-05 gnorm 0.139 3.54s mem 81.1GB +step 869/5000 loss 0.1847 (w 0.2556 mse 0.2507 t 855 new 0.22) lr 1.00e-05 gnorm 0.209 3.31s mem 81.1GB +step 870/5000 loss 0.2676 (w 0.2261 mse 0.2109 t 768 new 0.21) lr 1.00e-05 gnorm 0.164 2.85s mem 81.1GB +step 871/5000 loss 0.2984 (w 0.1021 mse 0.1039 t 886 new 0.10) lr 1.00e-05 gnorm 0.238 2.85s mem 81.1GB +step 872/5000 loss 0.3008 (w 0.2256 mse 0.2181 t 676 new 0.21) lr 1.00e-05 gnorm 0.151 3.03s mem 81.1GB +step 873/5000 loss 0.2384 (w 0.2146 mse 0.2063 t 742 new 0.21) lr 1.00e-05 gnorm 0.210 3.19s mem 81.1GB +step 874/5000 loss 0.2947 (w 0.4618 mse 0.4601 t 989 new 0.15) lr 1.00e-05 gnorm 0.164 3.14s mem 81.1GB +step 875/5000 loss 0.2424 (w 0.3099 mse 0.3007 t 668 new 0.08) lr 1.00e-05 gnorm 0.196 3.34s mem 81.1GB +step 876/5000 loss 0.2894 (w 0.3098 mse 0.3121 t 992 new 0.18) lr 1.00e-05 gnorm 0.148 2.85s mem 81.1GB +step 877/5000 loss 0.1995 (w 0.3046 mse 0.3043 t 964 new 0.21) lr 1.00e-05 gnorm 0.186 2.84s mem 81.1GB +step 878/5000 loss 0.3123 (w 0.3356 mse 0.3311 t 414 new 0.18) lr 1.00e-05 gnorm 0.179 3.26s mem 81.1GB +step 879/5000 loss 0.1092 (w 0.1796 mse 0.1723 t 899 new 0.21) lr 1.00e-05 gnorm 0.217 3.35s mem 81.1GB +step 880/5000 loss 0.2675 (w 0.2976 mse 0.3006 t 690 new 0.15) lr 1.00e-05 gnorm 0.165 3.50s mem 81.1GB +step 881/5000 loss 0.1901 (w 0.1774 mse 0.1801 t 860 new 0.22) lr 1.00e-05 gnorm 0.122 3.11s mem 81.1GB +step 882/5000 loss 0.1539 (w 0.2969 mse 0.2890 t 970 new 0.24) lr 1.00e-05 gnorm 0.333 2.85s mem 81.1GB +step 883/5000 loss 0.2490 (w 0.2033 mse 0.2155 t 991 new 0.14) lr 1.00e-05 gnorm 0.152 2.85s mem 81.1GB +step 884/5000 loss 0.2696 (w 0.2569 mse 0.2538 t 950 new 0.28) lr 1.00e-05 gnorm 0.214 3.10s mem 81.1GB +step 885/5000 loss 0.1363 (w 0.2207 mse 0.2056 t 845 new 0.21) lr 1.00e-05 gnorm 0.132 3.47s mem 81.1GB +step 886/5000 loss 0.1477 (w 0.1788 mse 0.1812 t 568 new 0.21) lr 1.00e-05 gnorm 0.165 3.40s mem 81.1GB +step 887/5000 loss 0.1531 (w 0.8148 mse 0.7547 t 996 new 0.19) lr 1.00e-05 gnorm 0.120 3.11s mem 81.1GB +step 888/5000 loss 0.2479 (w 0.1981 mse 0.2079 t 574 new 0.13) lr 1.00e-05 gnorm 0.137 2.85s mem 81.1GB +step 889/5000 loss 0.2496 (w 0.2663 mse 0.2468 t 881 new 0.27) lr 1.00e-05 gnorm 1.026 2.87s mem 81.1GB +step 890/5000 loss 0.2304 (w 0.2729 mse 0.2621 t 990 new 0.16) lr 1.00e-05 gnorm 0.174 3.13s mem 81.1GB +step 891/5000 loss 0.1342 (w 0.2219 mse 0.2189 t 827 new 0.19) lr 1.00e-05 gnorm 0.165 3.81s mem 81.1GB +step 892/5000 loss 0.1407 (w 0.2836 mse 0.2833 t 981 new 0.22) lr 1.00e-05 gnorm 0.185 3.07s mem 81.1GB +step 893/5000 loss 0.2090 (w 0.1700 mse 0.1662 t 858 new 0.24) lr 1.00e-05 gnorm 0.253 3.35s mem 81.1GB +step 894/5000 loss 0.2463 (w 0.2798 mse 0.2872 t 390 new 0.21) lr 1.00e-05 gnorm 0.140 2.85s mem 81.1GB +step 895/5000 loss 0.2747 (w 0.3397 mse 0.3233 t 259 new 0.21) lr 1.00e-05 gnorm 0.384 2.85s mem 81.1GB +step 896/5000 loss 0.1606 (w 0.1363 mse 0.1371 t 835 new 0.21) lr 1.00e-05 gnorm 0.174 3.44s mem 81.1GB +step 897/5000 loss 0.3470 (w 0.3504 mse 0.3503 t 292 new 0.17) lr 1.00e-05 gnorm 0.379 3.39s mem 81.1GB +step 898/5000 loss 0.2393 (w 0.1807 mse 0.1846 t 758 new 0.19) lr 1.00e-05 gnorm 0.126 3.11s mem 81.1GB +step 899/5000 loss 0.2905 (w 0.2968 mse 0.2807 t 903 new 0.19) lr 1.00e-05 gnorm 0.179 3.12s mem 81.1GB +step 900/5000 loss 0.4070 (w 0.1689 mse 0.1581 t 901 new 0.23) lr 1.00e-05 gnorm 0.188 2.85s mem 81.1GB +step 901/5000 loss 0.2252 (w 0.3368 mse 0.3303 t 958 new 0.08) lr 1.00e-05 gnorm 0.156 2.86s mem 81.1GB +step 902/5000 loss 0.2759 (w 0.2942 mse 0.2751 t 924 new 0.23) lr 1.00e-05 gnorm 0.160 3.45s mem 81.1GB +step 903/5000 loss 0.1134 (w 0.2968 mse 0.2941 t 964 new 0.23) lr 1.00e-05 gnorm 0.122 3.08s mem 81.1GB +step 904/5000 loss 0.1485 (w 0.2807 mse 0.2707 t 969 new 0.30) lr 1.00e-05 gnorm 0.167 3.13s mem 81.1GB +step 905/5000 loss 0.0926 (w 0.1194 mse 0.1372 t 924 new 0.18) lr 1.00e-05 gnorm 0.155 3.15s mem 81.1GB +step 906/5000 loss 0.2795 (w 0.0687 mse 0.0697 t 727 new 0.14) lr 1.00e-05 gnorm 1.045 2.85s mem 81.1GB +step 907/5000 loss 0.2309 (w 0.2161 mse 0.2004 t 852 new 0.18) lr 1.00e-05 gnorm 0.134 3.03s mem 81.1GB +step 908/5000 loss 0.1535 (w 0.3550 mse 0.3581 t 411 new 0.16) lr 1.00e-05 gnorm 0.213 3.23s mem 81.1GB +step 909/5000 loss 0.3592 (w 0.2537 mse 0.2580 t 447 new 0.23) lr 1.00e-05 gnorm 0.191 3.12s mem 81.1GB +step 910/5000 loss 0.1699 (w 0.1766 mse 0.1733 t 943 new 0.21) lr 1.00e-05 gnorm 0.118 3.52s mem 81.1GB +step 911/5000 loss 0.3312 (w 0.2986 mse 0.2884 t 905 new 0.22) lr 1.00e-05 gnorm 0.209 2.85s mem 81.1GB +step 912/5000 loss 0.2297 (w 0.2091 mse 0.2059 t 945 new 0.20) lr 1.00e-05 gnorm 0.139 2.86s mem 81.1GB +step 913/5000 loss 0.3129 (w 0.2783 mse 0.2726 t 670 new 0.20) lr 1.00e-05 gnorm 0.173 3.03s mem 81.1GB +step 914/5000 loss 0.2605 (w 0.1940 mse 0.1882 t 319 new 0.19) lr 1.00e-05 gnorm 0.158 3.49s mem 81.1GB +step 915/5000 loss 0.4023 (w 0.2045 mse 0.2121 t 698 new 0.23) lr 1.00e-05 gnorm 0.315 3.33s mem 81.1GB +step 916/5000 loss 0.4410 (w 0.2642 mse 0.2532 t 883 new 0.19) lr 1.00e-05 gnorm 0.378 3.28s mem 81.1GB +step 917/5000 loss 0.2935 (w 0.2708 mse 0.2503 t 910 new 0.19) lr 1.00e-05 gnorm 0.185 2.86s mem 81.1GB +step 918/5000 loss 0.2057 (w 0.2874 mse 0.2800 t 839 new 0.13) lr 1.00e-05 gnorm 0.174 2.85s mem 81.1GB +step 919/5000 loss 0.2486 (w 0.5927 mse 0.6072 t 120 new 0.23) lr 1.00e-05 gnorm 0.250 3.10s mem 81.1GB +step 920/5000 loss 0.2928 (w 0.3484 mse 0.3362 t 607 new 0.08) lr 1.00e-05 gnorm 0.291 3.44s mem 81.1GB +step 921/5000 loss 0.2612 (w 0.1980 mse 0.2077 t 999 new 0.10) lr 1.00e-05 gnorm 0.159 3.37s mem 81.1GB +step 922/5000 loss 0.3634 (w 0.2677 mse 0.2663 t 953 new 0.17) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +step 923/5000 loss 0.3020 (w 0.1819 mse 0.1823 t 943 new 0.22) lr 1.00e-05 gnorm 0.142 2.85s mem 81.1GB +step 924/5000 loss 0.2687 (w 0.1727 mse 0.1701 t 551 new 0.08) lr 1.00e-05 gnorm 0.286 2.85s mem 81.1GB +step 925/5000 loss 0.3544 (w 0.2179 mse 0.2218 t 935 new 0.28) lr 1.00e-05 gnorm 0.170 3.03s mem 81.1GB +step 926/5000 loss 0.2285 (w 0.2947 mse 0.2890 t 572 new 0.16) lr 1.00e-05 gnorm 0.133 3.50s mem 81.1GB +step 927/5000 loss 0.2602 (w 0.2642 mse 0.2490 t 950 new 0.24) lr 1.00e-05 gnorm 0.274 3.37s mem 81.1GB +step 928/5000 loss 0.2127 (w 0.2866 mse 0.2769 t 973 new 0.16) lr 1.00e-05 gnorm 0.253 3.12s mem 81.1GB +step 929/5000 loss 0.2427 (w 0.3648 mse 0.3440 t 953 new 0.28) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +step 930/5000 loss 0.2302 (w 0.2135 mse 0.1936 t 832 new 0.19) lr 1.00e-05 gnorm 0.148 2.84s mem 81.1GB +step 931/5000 loss 0.1911 (w 0.3156 mse 0.3046 t 994 new 0.22) lr 1.00e-05 gnorm 0.198 3.50s mem 81.1GB +step 932/5000 loss 0.2101 (w 0.1191 mse 0.1204 t 876 new 0.19) lr 1.00e-05 gnorm 0.163 3.34s mem 81.1GB +step 933/5000 loss 0.1854 (w 0.3722 mse 0.3626 t 999 new 0.16) lr 1.00e-05 gnorm 0.163 3.06s mem 81.1GB +step 934/5000 loss 0.1842 (w 0.2986 mse 0.3287 t 183 new 0.20) lr 1.00e-05 gnorm 0.150 3.05s mem 81.1GB +step 935/5000 loss 0.2394 (w 0.2608 mse 0.2642 t 283 new 0.09) lr 1.00e-05 gnorm 0.222 2.84s mem 81.1GB +step 936/5000 loss 0.2784 (w 0.1620 mse 0.1608 t 748 new 0.22) lr 1.00e-05 gnorm 0.247 3.02s mem 81.1GB +step 937/5000 loss 0.3023 (w 0.2444 mse 0.2498 t 562 new 0.10) lr 1.00e-05 gnorm 0.139 3.26s mem 81.1GB +step 938/5000 loss 0.1512 (w 0.2081 mse 0.2075 t 977 new 0.11) lr 1.00e-05 gnorm 0.376 3.40s mem 81.1GB +step 939/5000 loss 0.2093 (w 0.2253 mse 0.2178 t 836 new 0.21) lr 1.00e-05 gnorm 0.216 3.06s mem 81.1GB +step 940/5000 loss 0.1929 (w 0.1292 mse 0.1389 t 853 new 0.18) lr 1.00e-05 gnorm 0.261 3.13s mem 81.1GB +step 941/5000 loss 0.1771 (w 0.3359 mse 0.3137 t 981 new 0.20) lr 1.00e-05 gnorm 0.150 2.86s mem 81.1GB +step 942/5000 loss 0.2696 (w 0.2216 mse 0.2263 t 901 new 0.19) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +step 943/5000 loss 0.1615 (w 0.2197 mse 0.2215 t 933 new 0.20) lr 1.00e-05 gnorm 0.129 3.15s mem 81.1GB +step 944/5000 loss 0.1611 (w 0.4502 mse 0.4427 t 975 new 0.24) lr 1.00e-05 gnorm 0.155 3.39s mem 81.1GB +step 945/5000 loss 0.2658 (w 0.3900 mse 0.3850 t 991 new 0.22) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 946/5000 loss 0.2540 (w 0.3279 mse 0.3141 t 932 new 0.25) lr 1.00e-05 gnorm 0.149 3.13s mem 81.1GB +step 947/5000 loss 0.1950 (w 0.2757 mse 0.2623 t 913 new 0.11) lr 1.00e-05 gnorm 0.161 2.84s mem 81.1GB +step 948/5000 loss 0.2099 (w 0.2243 mse 0.2197 t 663 new 0.14) lr 1.00e-05 gnorm 0.133 3.11s mem 81.1GB +step 949/5000 loss 0.1640 (w 0.2774 mse 0.2796 t 965 new 0.24) lr 1.00e-05 gnorm 0.135 3.15s mem 81.1GB +step 950/5000 loss 0.2450 (w 0.2070 mse 0.2298 t 431 new 0.23) lr 1.00e-05 gnorm 0.204 3.40s mem 81.1GB +step 951/5000 loss 0.1845 (w 0.1182 mse 0.1099 t 909 new 0.12) lr 1.00e-05 gnorm 0.138 3.33s mem 81.1GB +step 952/5000 loss 0.3510 (w 0.2616 mse 0.2565 t 927 new 0.22) lr 1.00e-05 gnorm 0.204 2.84s mem 81.1GB +step 953/5000 loss 0.1119 (w 0.4204 mse 0.4149 t 996 new 0.19) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +step 954/5000 loss 0.1414 (w 0.3624 mse 0.3468 t 983 new 0.23) lr 1.00e-05 gnorm 0.191 3.09s mem 81.1GB +step 955/5000 loss 0.2019 (w 0.1499 mse 0.1357 t 839 new 0.24) lr 1.00e-05 gnorm 0.167 3.15s mem 81.1GB +step 956/5000 loss 0.2253 (w 0.2584 mse 0.2553 t 916 new 0.24) lr 1.00e-05 gnorm 0.167 3.44s mem 81.1GB +step 957/5000 loss 0.2681 (w 0.2322 mse 0.2214 t 833 new 0.24) lr 1.00e-05 gnorm 0.296 3.34s mem 81.1GB +step 958/5000 loss 0.3689 (w 0.3180 mse 0.3211 t 977 new 0.17) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +step 959/5000 loss 0.2414 (w 0.1990 mse 0.2059 t 951 new 0.20) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +step 960/5000 loss 0.2620 (w 0.2424 mse 0.2389 t 601 new 0.16) lr 1.00e-05 gnorm 0.174 3.12s mem 81.1GB +step 961/5000 loss 0.2329 (w 0.1816 mse 0.1824 t 819 new 0.18) lr 1.00e-05 gnorm 0.098 3.38s mem 81.1GB +step 962/5000 loss 0.1381 (w 0.2008 mse 0.2059 t 983 new 0.18) lr 1.00e-05 gnorm 0.258 3.33s mem 81.1GB +step 963/5000 loss 0.3166 (w 0.4331 mse 0.4120 t 986 new 0.23) lr 1.00e-05 gnorm 0.162 3.39s mem 81.1GB +step 964/5000 loss 0.1904 (w 0.1947 mse 0.1861 t 900 new 0.09) lr 1.00e-05 gnorm 0.176 2.86s mem 81.1GB +step 965/5000 loss 0.2764 (w 0.2517 mse 0.2312 t 813 new 0.25) lr 1.00e-05 gnorm 0.167 2.86s mem 81.1GB +step 966/5000 loss 0.1521 (w 0.1639 mse 0.1670 t 941 new 0.28) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +step 967/5000 loss 0.1623 (w 0.2781 mse 0.2710 t 925 new 0.27) lr 1.00e-05 gnorm 0.186 3.45s mem 81.1GB +step 968/5000 loss 0.2677 (w 0.1461 mse 0.1436 t 907 new 0.20) lr 1.00e-05 gnorm 0.144 3.34s mem 81.1GB +step 969/5000 loss 0.1835 (w 0.2730 mse 0.2645 t 936 new 0.21) lr 1.00e-05 gnorm 0.149 3.33s mem 81.1GB +step 970/5000 loss 0.1943 (w 0.1421 mse 0.1461 t 905 new 0.22) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +step 971/5000 loss 0.2529 (w 0.3190 mse 0.3132 t 973 new 0.25) lr 1.00e-05 gnorm 0.197 3.10s mem 81.1GB +step 972/5000 loss 0.2405 (w 0.1988 mse 0.1978 t 781 new 0.23) lr 1.00e-05 gnorm 0.218 2.85s mem 81.1GB +step 973/5000 loss 0.3537 (w 0.3027 mse 0.3003 t 428 new 0.19) lr 1.00e-05 gnorm 0.183 3.73s mem 81.1GB +step 974/5000 loss 0.1970 (w 0.2352 mse 0.2240 t 851 new 0.20) lr 1.00e-05 gnorm 0.272 3.09s mem 81.1GB +step 975/5000 loss 0.3879 (w 0.1749 mse 0.1895 t 811 new 0.12) lr 1.00e-05 gnorm 0.346 3.23s mem 81.1GB +step 976/5000 loss 0.2732 (w 0.1975 mse 0.1933 t 872 new 0.23) lr 1.00e-05 gnorm 0.309 2.85s mem 81.1GB +step 977/5000 loss 0.3384 (w 0.2153 mse 0.2269 t 498 new 0.09) lr 1.00e-05 gnorm 0.132 3.02s mem 81.1GB +step 978/5000 loss 0.2382 (w 0.1447 mse 0.1523 t 861 new 0.20) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +step 979/5000 loss 0.1888 (w 0.3016 mse 0.2910 t 803 new 0.21) lr 1.00e-05 gnorm 0.739 3.41s mem 81.1GB +step 980/5000 loss 0.1672 (w 0.2220 mse 0.2103 t 788 new 0.23) lr 1.00e-05 gnorm 0.173 3.45s mem 81.1GB +step 981/5000 loss 0.1614 (w 0.1947 mse 0.1888 t 884 new 0.21) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +step 982/5000 loss 0.1337 (w 0.2692 mse 0.2550 t 590 new 0.27) lr 1.00e-05 gnorm 0.163 2.84s mem 81.1GB +step 983/5000 loss 0.3180 (w 0.1423 mse 0.1485 t 964 new 0.23) lr 1.00e-05 gnorm 0.169 3.08s mem 81.1GB +step 984/5000 loss 0.3491 (w 0.2930 mse 0.2842 t 621 new 0.20) lr 1.00e-05 gnorm 0.160 3.15s mem 81.1GB +step 985/5000 loss 0.1154 (w 0.2714 mse 0.2615 t 963 new 0.21) lr 1.00e-05 gnorm 0.125 3.45s mem 81.1GB +step 986/5000 loss 0.3579 (w 0.2525 mse 0.2317 t 763 new 0.17) lr 1.00e-05 gnorm 0.287 3.06s mem 81.1GB +step 987/5000 loss 0.2887 (w 0.2126 mse 0.1996 t 934 new 0.20) lr 1.00e-05 gnorm 0.154 3.11s mem 81.1GB +step 988/5000 loss 0.2394 (w 0.2544 mse 0.2486 t 974 new 0.25) lr 1.00e-05 gnorm 0.241 2.86s mem 81.1GB +step 989/5000 loss 0.2924 (w 0.2942 mse 0.2984 t 633 new 0.21) lr 1.00e-05 gnorm 0.169 3.06s mem 81.1GB +step 990/5000 loss 0.4318 (w 0.1443 mse 0.1425 t 889 new 0.11) lr 1.00e-05 gnorm 0.163 3.17s mem 81.1GB +step 991/5000 loss 0.3808 (w 0.1950 mse 0.1914 t 624 new 0.20) lr 1.00e-05 gnorm 0.202 3.30s mem 81.1GB +step 992/5000 loss 0.1724 (w 0.1374 mse 0.1386 t 873 new 0.12) lr 1.00e-05 gnorm 0.116 3.31s mem 81.1GB +step 993/5000 loss 0.3171 (w 0.3874 mse 0.3622 t 998 new 0.19) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +step 994/5000 loss 0.3410 (w 0.1812 mse 0.1827 t 913 new 0.11) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +step 995/5000 loss 0.1719 (w 0.1946 mse 0.1847 t 754 new 0.23) lr 1.00e-05 gnorm 0.207 3.08s mem 81.1GB +step 996/5000 loss 0.2314 (w 0.2160 mse 0.2224 t 946 new 0.25) lr 1.00e-05 gnorm 0.171 3.17s mem 81.1GB +step 997/5000 loss 0.1294 (w 0.2141 mse 0.2075 t 968 new 0.24) lr 1.00e-05 gnorm 0.133 3.40s mem 81.1GB +step 998/5000 loss 0.2147 (w 0.2003 mse 0.2009 t 875 new 0.24) lr 1.00e-05 gnorm 0.176 3.06s mem 81.1GB +step 999/5000 loss 0.2623 (w 0.1470 mse 0.1526 t 870 new 0.25) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +step 1000/5000 loss 0.1574 (w 0.2271 mse 0.2191 t 933 new 0.16) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +[val] step 1000 t=200: w=0.4376 mse=0.4490 (n=16) t=500: w=0.2348 mse=0.2392 (n=16) t=800: w=0.1849 mse=0.1852 (n=16) | mean w=0.2858 mse=0.2911 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step1000.safetensors 4093 个张量 37.98 GB +step 1001/5000 loss 0.3180 (w 0.4326 mse 0.4156 t 985 new 0.19) lr 1.00e-05 gnorm 1.523 3.49s mem 81.1GB +step 1002/5000 loss 0.0728 (w 0.2604 mse 0.2465 t 932 new 0.24) lr 1.00e-05 gnorm 0.225 3.74s mem 81.1GB +step 1003/5000 loss 0.2237 (w 0.6513 mse 0.6404 t 114 new 0.16) lr 1.00e-05 gnorm 0.297 3.05s mem 81.1GB +step 1004/5000 loss 0.2876 (w 0.3067 mse 0.3005 t 923 new 0.22) lr 1.00e-05 gnorm 0.179 3.36s mem 81.1GB +step 1005/5000 loss 0.2015 (w 0.2859 mse 0.2960 t 484 new 0.25) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +step 1006/5000 loss 0.2340 (w 0.2858 mse 0.2842 t 967 new 0.20) lr 1.00e-05 gnorm 0.146 3.09s mem 81.1GB +step 1007/5000 loss 0.2269 (w 0.2755 mse 0.2766 t 976 new 0.25) lr 1.00e-05 gnorm 0.178 3.38s mem 81.1GB +step 1008/5000 loss 0.1932 (w 0.2653 mse 0.2554 t 964 new 0.20) lr 1.00e-05 gnorm 0.126 3.55s mem 81.1GB +step 1009/5000 loss 0.1590 (w 0.2471 mse 0.2408 t 762 new 0.25) lr 1.00e-05 gnorm 0.156 3.06s mem 81.1GB +step 1010/5000 loss 0.1471 (w 0.2314 mse 0.2197 t 924 new 0.29) lr 1.00e-05 gnorm 0.146 3.28s mem 81.1GB +step 1011/5000 loss 0.2963 (w 0.2747 mse 0.2887 t 670 new 0.17) lr 1.00e-05 gnorm 0.253 2.85s mem 81.1GB +step 1012/5000 loss 0.1986 (w 0.2209 mse 0.2137 t 715 new 0.16) lr 1.00e-05 gnorm 0.126 3.44s mem 81.1GB +step 1013/5000 loss 0.1747 (w 0.2698 mse 0.2676 t 885 new 0.25) lr 1.00e-05 gnorm 0.158 3.11s mem 81.1GB +step 1014/5000 loss 0.3790 (w 0.3785 mse 0.3817 t 283 new 0.20) lr 1.00e-05 gnorm 0.188 3.29s mem 81.1GB +step 1015/5000 loss 0.2553 (w 0.2976 mse 0.2895 t 966 new 0.23) lr 1.00e-05 gnorm 0.216 3.06s mem 81.1GB +step 1016/5000 loss 0.2359 (w 0.2480 mse 0.2437 t 973 new 0.22) lr 1.00e-05 gnorm 0.123 3.18s mem 81.1GB +step 1017/5000 loss 0.3398 (w 0.2612 mse 0.2508 t 670 new 0.20) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +step 1018/5000 loss 0.3160 (w 0.1848 mse 0.1920 t 902 new 0.23) lr 1.00e-05 gnorm 0.149 3.24s mem 81.1GB +step 1019/5000 loss 0.0949 (w 0.2772 mse 0.2755 t 975 new 0.22) lr 1.00e-05 gnorm 0.261 3.37s mem 81.1GB +step 1020/5000 loss 0.2090 (w 0.2202 mse 0.2184 t 865 new 0.24) lr 1.00e-05 gnorm 1.011 3.19s mem 81.1GB +step 1021/5000 loss 0.2721 (w 0.2834 mse 0.2872 t 918 new 0.19) lr 1.00e-05 gnorm 0.189 3.12s mem 81.1GB +step 1022/5000 loss 0.3229 (w 0.2198 mse 0.2172 t 871 new 0.18) lr 1.00e-05 gnorm 3.701 3.11s mem 81.1GB +step 1023/5000 loss 0.2714 (w 0.6355 mse 0.6545 t 120 new 0.19) lr 1.00e-05 gnorm 0.131 2.85s mem 81.1GB +step 1024/5000 loss 0.2056 (w 0.3023 mse 0.3032 t 986 new 0.21) lr 1.00e-05 gnorm 0.138 3.31s mem 81.1GB +step 1025/5000 loss 0.1835 (w 0.2236 mse 0.2223 t 895 new 0.22) lr 1.00e-05 gnorm 0.141 3.36s mem 81.1GB +step 1026/5000 loss 0.1447 (w 0.2819 mse 0.2677 t 933 new 0.18) lr 1.00e-05 gnorm 0.207 3.37s mem 81.1GB +step 1027/5000 loss 0.2836 (w 0.3616 mse 0.3586 t 310 new 0.18) lr 1.00e-05 gnorm 0.131 3.49s mem 81.1GB +step 1028/5000 loss 0.1967 (w 0.4482 mse 0.4088 t 997 new 0.25) lr 1.00e-05 gnorm 0.348 2.86s mem 81.1GB +step 1029/5000 loss 0.2868 (w 0.3074 mse 0.2830 t 749 new 0.23) lr 1.00e-05 gnorm 0.130 3.14s mem 81.1GB +step 1030/5000 loss 0.1396 (w 0.1848 mse 0.2003 t 966 new 0.21) lr 1.00e-05 gnorm 0.171 3.09s mem 81.1GB +step 1031/5000 loss 0.2946 (w 0.4764 mse 0.4807 t 297 new 0.14) lr 1.00e-05 gnorm 0.155 3.43s mem 81.1GB +step 1032/5000 loss 0.1903 (w 0.2892 mse 0.2922 t 932 new 0.07) lr 1.00e-05 gnorm 0.128 3.21s mem 81.1GB +step 1033/5000 loss 0.2259 (w 0.2243 mse 0.2156 t 822 new 0.18) lr 1.00e-05 gnorm 0.240 3.43s mem 81.1GB +step 1034/5000 loss 0.2323 (w 0.2596 mse 0.2499 t 978 new 0.21) lr 1.00e-05 gnorm 3.806 2.85s mem 81.1GB +step 1035/5000 loss 0.2631 (w 0.3444 mse 0.3091 t 933 new 0.23) lr 1.00e-05 gnorm 0.149 3.15s mem 81.1GB +step 1036/5000 loss 0.1700 (w 0.1527 mse 0.1513 t 913 new 0.21) lr 1.00e-05 gnorm 0.178 3.31s mem 81.1GB +step 1037/5000 loss 0.2925 (w 0.1278 mse 0.1287 t 923 new 0.17) lr 1.00e-05 gnorm 0.165 3.39s mem 81.1GB +step 1038/5000 loss 0.1821 (w 0.2037 mse 0.1972 t 829 new 0.18) lr 1.00e-05 gnorm 0.124 3.13s mem 81.1GB +step 1039/5000 loss 0.1927 (w 0.1776 mse 0.1771 t 802 new 0.06) lr 1.00e-05 gnorm 0.203 3.37s mem 81.1GB +step 1040/5000 loss 0.3460 (w 0.2904 mse 0.2933 t 644 new 0.27) lr 1.00e-05 gnorm 0.199 2.84s mem 81.1GB +step 1041/5000 loss 0.2961 (w 0.3120 mse 0.2999 t 768 new 0.17) lr 1.00e-05 gnorm 0.671 3.07s mem 81.1GB +step 1042/5000 loss 0.2593 (w 0.1454 mse 0.1436 t 807 new 0.11) lr 1.00e-05 gnorm 0.194 3.31s mem 81.1GB +step 1043/5000 loss 0.2974 (w 0.1603 mse 0.1544 t 668 new 0.21) lr 1.00e-05 gnorm 0.809 3.08s mem 81.1GB +step 1044/5000 loss 0.2088 (w 0.1820 mse 0.1976 t 490 new 0.14) lr 1.00e-05 gnorm 0.143 2.86s mem 81.1GB +step 1045/5000 loss 0.0809 (w 0.1879 mse 0.1881 t 922 new 0.18) lr 1.00e-05 gnorm 0.133 3.38s mem 81.1GB +step 1046/5000 loss 0.4483 (w 0.2137 mse 0.2038 t 683 new 0.24) lr 1.00e-05 gnorm 0.169 2.84s mem 81.1GB +step 1047/5000 loss 0.2475 (w 0.2641 mse 0.2738 t 976 new 0.21) lr 1.00e-05 gnorm 0.169 3.09s mem 81.1GB +step 1048/5000 loss 0.1398 (w 0.1729 mse 0.1821 t 914 new 0.20) lr 1.00e-05 gnorm 0.117 3.35s mem 81.1GB +step 1049/5000 loss 0.2045 (w 0.2825 mse 0.2732 t 915 new 0.27) lr 1.00e-05 gnorm 0.165 3.12s mem 81.1GB +step 1050/5000 loss 0.2353 (w 0.2922 mse 0.2837 t 820 new 0.11) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +step 1051/5000 loss 0.2957 (w 0.2087 mse 0.2107 t 397 new 0.17) lr 1.00e-05 gnorm 0.156 3.18s mem 81.1GB +step 1052/5000 loss 0.2982 (w 0.3452 mse 0.3366 t 336 new 0.24) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +step 1053/5000 loss 0.2131 (w 0.3212 mse 0.3215 t 428 new 0.19) lr 1.00e-05 gnorm 0.168 3.05s mem 81.1GB +step 1054/5000 loss 0.2443 (w 0.3151 mse 0.3139 t 983 new 0.17) lr 1.00e-05 gnorm 0.132 3.43s mem 81.1GB +step 1055/5000 loss 0.2629 (w 0.1463 mse 0.1440 t 741 new 0.13) lr 1.00e-05 gnorm 0.178 3.35s mem 81.1GB +step 1056/5000 loss 0.3403 (w 0.3960 mse 0.3870 t 964 new 0.12) lr 1.00e-05 gnorm 0.162 3.17s mem 81.1GB +step 1057/5000 loss 0.2141 (w 0.2142 mse 0.2003 t 891 new 0.20) lr 1.00e-05 gnorm 0.202 2.85s mem 81.1GB +step 1058/5000 loss 0.1937 (w 0.3351 mse 0.3195 t 971 new 0.23) lr 1.00e-05 gnorm 0.172 2.85s mem 81.1GB +step 1059/5000 loss 0.1208 (w 0.1684 mse 0.1832 t 586 new 0.20) lr 1.00e-05 gnorm 0.112 3.34s mem 81.1GB +step 1060/5000 loss 0.2184 (w 0.1875 mse 0.1812 t 975 new 0.17) lr 1.00e-05 gnorm 0.157 3.43s mem 81.1GB +step 1061/5000 loss 0.3009 (w 0.1841 mse 0.1865 t 946 new 0.25) lr 1.00e-05 gnorm 0.178 3.29s mem 81.1GB +step 1062/5000 loss 0.2193 (w 0.1346 mse 0.1428 t 761 new 0.23) lr 1.00e-05 gnorm 0.158 3.13s mem 81.1GB +step 1063/5000 loss 0.1934 (w 0.1299 mse 0.1129 t 827 new 0.13) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 1064/5000 loss 0.2540 (w 0.3464 mse 0.3254 t 984 new 0.21) lr 1.00e-05 gnorm 0.192 2.84s mem 81.1GB +step 1065/5000 loss 0.1998 (w 0.1278 mse 0.1188 t 790 new 0.15) lr 1.00e-05 gnorm 2.205 3.33s mem 81.1GB +step 1066/5000 loss 0.2731 (w 0.2266 mse 0.2451 t 973 new 0.22) lr 1.00e-05 gnorm 0.155 3.41s mem 81.1GB +step 1067/5000 loss 0.3967 (w 0.2735 mse 0.2696 t 987 new 0.18) lr 1.00e-05 gnorm 0.144 3.36s mem 81.1GB +step 1068/5000 loss 0.2584 (w 0.1924 mse 0.2061 t 989 new 0.28) lr 1.00e-05 gnorm 0.231 3.17s mem 81.1GB +step 1069/5000 loss 0.2387 (w 0.6521 mse 0.6827 t 999 new 0.16) lr 1.00e-05 gnorm 0.186 2.84s mem 81.1GB +step 1070/5000 loss 0.1956 (w 0.2720 mse 0.2678 t 962 new 0.25) lr 1.00e-05 gnorm 0.275 2.84s mem 81.1GB +step 1071/5000 loss 0.2327 (w 0.4380 mse 0.4344 t 986 new 0.29) lr 1.00e-05 gnorm 0.125 3.31s mem 81.1GB +step 1072/5000 loss 0.2486 (w 0.1709 mse 0.1804 t 753 new 0.11) lr 1.00e-05 gnorm 0.138 3.45s mem 81.1GB +step 1073/5000 loss 0.2222 (w 0.3363 mse 0.3570 t 249 new 0.12) lr 1.00e-05 gnorm 0.103 3.08s mem 81.1GB +step 1074/5000 loss 0.1482 (w 0.2649 mse 0.2558 t 960 new 0.25) lr 1.00e-05 gnorm 0.136 3.46s mem 81.1GB +step 1075/5000 loss 0.3167 (w 0.3419 mse 0.3428 t 970 new 0.25) lr 1.00e-05 gnorm 0.260 2.84s mem 81.1GB +step 1076/5000 loss 0.3412 (w 0.2231 mse 0.2063 t 983 new 0.19) lr 1.00e-05 gnorm 0.157 3.12s mem 81.1GB +step 1077/5000 loss 0.3250 (w 0.2580 mse 0.2526 t 915 new 0.24) lr 1.00e-05 gnorm 0.218 3.11s mem 81.1GB +step 1078/5000 loss 0.2176 (w 0.2634 mse 0.2588 t 610 new 0.23) lr 1.00e-05 gnorm 0.206 3.51s mem 81.1GB +step 1079/5000 loss 0.2556 (w 0.2284 mse 0.2390 t 939 new 0.19) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +step 1080/5000 loss 0.2767 (w 0.2073 mse 0.1973 t 798 new 0.14) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +step 1081/5000 loss 0.2927 (w 0.2315 mse 0.2077 t 742 new 0.24) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +step 1082/5000 loss 0.2564 (w 0.2272 mse 0.2264 t 852 new 0.24) lr 1.00e-05 gnorm 0.139 3.05s mem 81.1GB +step 1083/5000 loss 0.0899 (w 0.3155 mse 0.2994 t 993 new 0.26) lr 1.00e-05 gnorm 0.170 3.13s mem 81.1GB +step 1084/5000 loss 0.1935 (w 0.2663 mse 0.2626 t 984 new 0.14) lr 1.00e-05 gnorm 0.150 3.68s mem 81.1GB +step 1085/5000 loss 0.3051 (w 0.2044 mse 0.2059 t 913 new 0.23) lr 1.00e-05 gnorm 0.181 2.85s mem 81.1GB +step 1086/5000 loss 0.1496 (w 0.1519 mse 0.1472 t 690 new 0.25) lr 1.00e-05 gnorm 0.145 3.11s mem 81.1GB +step 1087/5000 loss 0.2339 (w 0.1674 mse 0.1771 t 914 new 0.22) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +step 1088/5000 loss 0.1543 (w 0.0646 mse 0.0737 t 730 new 0.13) lr 1.00e-05 gnorm 0.291 3.05s mem 81.1GB +step 1089/5000 loss 0.1412 (w 0.1936 mse 0.1833 t 801 new 0.22) lr 1.00e-05 gnorm 0.189 3.09s mem 81.1GB +step 1090/5000 loss 0.2676 (w 0.2546 mse 0.2488 t 992 new 0.16) lr 1.00e-05 gnorm 0.202 3.71s mem 81.1GB +step 1091/5000 loss 0.1785 (w 0.2027 mse 0.1956 t 986 new 0.25) lr 1.00e-05 gnorm 0.141 3.07s mem 81.1GB +step 1092/5000 loss 0.2223 (w 0.2100 mse 0.2033 t 850 new 0.21) lr 1.00e-05 gnorm 0.167 3.09s mem 81.1GB +step 1093/5000 loss 0.1972 (w 0.1431 mse 0.1503 t 669 new 0.21) lr 1.00e-05 gnorm 0.181 2.86s mem 81.1GB +step 1094/5000 loss 0.1214 (w 0.2482 mse 0.2551 t 965 new 0.17) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +step 1095/5000 loss 0.3367 (w 0.3827 mse 0.3746 t 418 new 0.16) lr 1.00e-05 gnorm 0.181 3.42s mem 81.1GB +step 1096/5000 loss 0.2741 (w 0.2773 mse 0.3111 t 986 new 0.26) lr 1.00e-05 gnorm 0.232 3.49s mem 81.1GB +step 1097/5000 loss 0.3012 (w 0.3646 mse 0.3402 t 976 new 0.14) lr 1.00e-05 gnorm 0.153 3.15s mem 81.1GB +step 1098/5000 loss 0.1343 (w 0.2775 mse 0.2845 t 939 new 0.14) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +step 1099/5000 loss 0.1547 (w 0.2041 mse 0.2101 t 482 new 0.21) lr 1.00e-05 gnorm 0.211 2.84s mem 81.1GB +step 1100/5000 loss 0.1157 (w 0.2797 mse 0.2503 t 970 new 0.27) lr 1.00e-05 gnorm 0.499 3.35s mem 81.1GB +step 1101/5000 loss 0.1320 (w 0.2749 mse 0.2817 t 999 new 0.24) lr 1.00e-05 gnorm 0.191 3.10s mem 81.1GB +step 1102/5000 loss 0.1749 (w 0.1960 mse 0.2043 t 974 new 0.10) lr 1.00e-05 gnorm 0.183 3.43s mem 81.1GB +step 1103/5000 loss 0.2644 (w 0.2008 mse 0.2001 t 820 new 0.23) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +step 1104/5000 loss 0.2935 (w 0.2183 mse 0.2250 t 959 new 0.20) lr 1.00e-05 gnorm 0.167 2.84s mem 81.1GB +step 1105/5000 loss 0.4809 (w 0.2629 mse 0.2506 t 592 new 0.20) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +step 1106/5000 loss 0.3951 (w 0.2761 mse 0.2824 t 982 new 0.15) lr 1.00e-05 gnorm 0.160 3.38s mem 81.1GB +step 1107/5000 loss 0.2225 (w 0.2798 mse 0.2749 t 680 new 0.20) lr 1.00e-05 gnorm 0.153 3.15s mem 81.1GB +step 1108/5000 loss 0.3938 (w 0.3330 mse 0.3488 t 288 new 0.21) lr 1.00e-05 gnorm 0.129 3.39s mem 81.1GB +step 1109/5000 loss 0.3381 (w 0.2220 mse 0.2097 t 921 new 0.16) lr 1.00e-05 gnorm 0.165 3.37s mem 81.1GB +step 1110/5000 loss 0.1964 (w 0.1670 mse 0.1644 t 954 new 0.10) lr 1.00e-05 gnorm 0.154 2.85s mem 81.1GB +step 1111/5000 loss 0.3603 (w 0.2424 mse 0.2258 t 713 new 0.23) lr 1.00e-05 gnorm 0.344 3.04s mem 81.1GB +step 1112/5000 loss 0.2211 (w 0.4365 mse 0.4114 t 992 new 0.23) lr 1.00e-05 gnorm 0.222 3.07s mem 81.1GB +step 1113/5000 loss 0.3646 (w 0.1863 mse 0.1895 t 656 new 0.12) lr 1.00e-05 gnorm 0.331 3.39s mem 81.1GB +step 1114/5000 loss 0.3468 (w 0.5115 mse 0.5122 t 228 new 0.12) lr 1.00e-05 gnorm 0.282 3.22s mem 81.1GB +step 1115/5000 loss 0.3348 (w 0.2790 mse 0.2653 t 684 new 0.22) lr 1.00e-05 gnorm 0.363 3.37s mem 81.1GB +step 1116/5000 loss 0.2736 (w 0.1649 mse 0.1714 t 855 new 0.16) lr 1.00e-05 gnorm 0.202 2.83s mem 81.1GB +step 1117/5000 loss 0.3933 (w 0.2327 mse 0.2222 t 947 new 0.22) lr 1.00e-05 gnorm 0.135 3.09s mem 81.1GB +step 1118/5000 loss 0.2643 (w 0.3008 mse 0.3021 t 978 new 0.19) lr 1.00e-05 gnorm 0.141 3.09s mem 81.1GB +step 1119/5000 loss 0.2125 (w 0.3108 mse 0.2990 t 982 new 0.23) lr 1.00e-05 gnorm 0.158 3.39s mem 81.1GB +step 1120/5000 loss 0.3243 (w 0.2391 mse 0.2363 t 722 new 0.20) lr 1.00e-05 gnorm 0.167 3.45s mem 81.1GB +step 1121/5000 loss 0.2197 (w 0.2338 mse 0.2119 t 875 new 0.21) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +step 1122/5000 loss 0.2018 (w 0.4352 mse 0.4038 t 998 new 0.17) lr 1.00e-05 gnorm 0.121 2.85s mem 81.1GB +step 1123/5000 loss 0.1890 (w 0.2281 mse 0.2212 t 752 new 0.22) lr 1.00e-05 gnorm 0.190 3.05s mem 81.1GB +step 1124/5000 loss 0.2962 (w 0.1469 mse 0.1478 t 669 new 0.05) lr 1.00e-05 gnorm 0.163 3.08s mem 81.1GB +step 1125/5000 loss 0.1951 (w 0.1108 mse 0.1144 t 962 new 0.11) lr 1.00e-05 gnorm 0.117 3.17s mem 81.1GB +step 1126/5000 loss 0.2127 (w 0.3296 mse 0.3197 t 983 new 0.15) lr 1.00e-05 gnorm 0.350 3.37s mem 81.1GB +step 1127/5000 loss 0.2379 (w 0.3171 mse 0.3081 t 530 new 0.24) lr 1.00e-05 gnorm 0.165 3.03s mem 81.1GB +step 1128/5000 loss 0.2075 (w 0.2771 mse 0.2669 t 897 new 0.21) lr 1.00e-05 gnorm 0.166 2.85s mem 81.1GB +step 1129/5000 loss 0.2123 (w 0.2330 mse 0.2289 t 832 new 0.24) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +step 1130/5000 loss 0.3071 (w 0.2082 mse 0.1941 t 782 new 0.13) lr 1.00e-05 gnorm 0.158 3.17s mem 81.1GB +step 1131/5000 loss 0.1894 (w 0.3932 mse 0.3715 t 999 new 0.19) lr 1.00e-05 gnorm 0.158 3.62s mem 81.1GB +step 1132/5000 loss 0.2624 (w 0.2596 mse 0.2479 t 850 new 0.24) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +step 1133/5000 loss 0.2455 (w 0.3436 mse 0.3333 t 989 new 0.24) lr 1.00e-05 gnorm 0.163 3.09s mem 81.1GB +step 1134/5000 loss 0.1772 (w 0.0642 mse 0.0730 t 745 new 0.13) lr 1.00e-05 gnorm 0.151 3.04s mem 81.1GB +step 1135/5000 loss 0.2024 (w 0.2554 mse 0.2481 t 965 new 0.21) lr 1.00e-05 gnorm 0.126 2.85s mem 81.1GB +step 1136/5000 loss 0.2968 (w 0.1543 mse 0.1658 t 937 new 0.15) lr 1.00e-05 gnorm 0.154 3.39s mem 81.1GB +step 1137/5000 loss 0.1830 (w 0.3503 mse 0.3349 t 914 new 0.24) lr 1.00e-05 gnorm 0.125 3.65s mem 81.1GB +step 1138/5000 loss 0.2293 (w 0.1815 mse 0.1802 t 665 new 0.09) lr 1.00e-05 gnorm 0.159 3.13s mem 81.1GB +step 1139/5000 loss 0.2500 (w 0.2820 mse 0.2958 t 372 new 0.20) lr 1.00e-05 gnorm 0.132 2.85s mem 81.1GB +step 1140/5000 loss 0.1889 (w 0.2515 mse 0.2506 t 947 new 0.19) lr 1.00e-05 gnorm 0.176 3.03s mem 81.1GB +step 1141/5000 loss 0.4118 (w 0.3302 mse 0.3312 t 421 new 0.22) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +step 1142/5000 loss 0.3013 (w 0.2485 mse 0.2451 t 951 new 0.23) lr 1.00e-05 gnorm 0.281 3.62s mem 81.1GB +step 1143/5000 loss 0.2039 (w 0.2868 mse 0.2923 t 274 new 0.23) lr 1.00e-05 gnorm 0.239 3.34s mem 81.1GB +step 1144/5000 loss 0.2507 (w 0.2225 mse 0.2124 t 889 new 0.21) lr 1.00e-05 gnorm 0.211 3.51s mem 81.1GB +step 1145/5000 loss 0.1646 (w 0.0708 mse 0.0724 t 578 new 0.02) lr 1.00e-05 gnorm 0.137 2.85s mem 81.1GB +step 1146/5000 loss 0.3832 (w 0.2966 mse 0.2916 t 961 new 0.20) lr 1.00e-05 gnorm 0.154 3.06s mem 81.1GB +step 1147/5000 loss 0.1665 (w 0.3775 mse 0.3537 t 930 new 0.24) lr 1.00e-05 gnorm 0.135 3.12s mem 81.1GB +step 1148/5000 loss 0.1714 (w 0.2095 mse 0.2159 t 647 new 0.22) lr 1.00e-05 gnorm 0.126 3.53s mem 81.1GB +step 1149/5000 loss 0.2347 (w 0.2972 mse 0.2946 t 852 new 0.21) lr 1.00e-05 gnorm 0.316 3.14s mem 81.1GB +step 1150/5000 loss 0.1609 (w 0.2501 mse 0.2505 t 612 new 0.20) lr 1.00e-05 gnorm 0.156 3.47s mem 81.1GB +step 1151/5000 loss 0.1506 (w 0.2964 mse 0.2942 t 958 new 0.18) lr 1.00e-05 gnorm 0.260 2.85s mem 81.1GB +step 1152/5000 loss 0.1827 (w 0.1314 mse 0.1326 t 725 new 0.22) lr 1.00e-05 gnorm 0.128 3.11s mem 81.1GB +step 1153/5000 loss 0.3417 (w 0.3007 mse 0.2877 t 506 new 0.17) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +step 1154/5000 loss 0.1891 (w 0.4626 mse 0.4476 t 974 new 0.24) lr 1.00e-05 gnorm 0.315 3.45s mem 81.1GB +step 1155/5000 loss 0.1116 (w 0.1042 mse 0.0977 t 672 new 0.20) lr 1.00e-05 gnorm 0.162 3.19s mem 81.1GB +step 1156/5000 loss 0.2342 (w 0.2124 mse 0.2300 t 995 new 0.16) lr 1.00e-05 gnorm 0.156 3.35s mem 81.1GB +step 1157/5000 loss 0.2332 (w 0.3071 mse 0.3029 t 233 new 0.10) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +step 1158/5000 loss 0.2774 (w 0.1545 mse 0.1690 t 940 new 0.23) lr 1.00e-05 gnorm 0.603 3.05s mem 81.1GB +step 1159/5000 loss 0.3168 (w 0.3016 mse 0.3018 t 450 new 0.21) lr 1.00e-05 gnorm 0.111 3.15s mem 81.1GB +step 1160/5000 loss 0.1212 (w 0.3299 mse 0.3236 t 945 new 0.18) lr 1.00e-05 gnorm 0.146 3.20s mem 81.1GB +step 1161/5000 loss 0.1509 (w 0.2779 mse 0.2670 t 934 new 0.17) lr 1.00e-05 gnorm 0.174 3.39s mem 81.1GB +step 1162/5000 loss 0.2245 (w 0.1824 mse 0.1805 t 970 new 0.24) lr 1.00e-05 gnorm 0.143 3.26s mem 81.1GB +step 1163/5000 loss 0.1500 (w 0.3939 mse 0.3814 t 960 new 0.21) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +step 1164/5000 loss 0.2165 (w 0.2048 mse 0.1880 t 977 new 0.24) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +step 1165/5000 loss 0.2501 (w 0.2290 mse 0.2202 t 683 new 0.26) lr 1.00e-05 gnorm 0.181 3.18s mem 81.1GB +step 1166/5000 loss 0.2134 (w 0.3017 mse 0.2856 t 918 new 0.24) lr 1.00e-05 gnorm 0.152 3.23s mem 81.1GB +step 1167/5000 loss 0.1423 (w 0.1241 mse 0.1241 t 911 new 0.25) lr 1.00e-05 gnorm 0.113 3.18s mem 81.1GB +step 1168/5000 loss 0.2395 (w 0.4043 mse 0.3887 t 963 new 0.22) lr 1.00e-05 gnorm 0.162 3.25s mem 81.1GB +step 1169/5000 loss 0.2823 (w 0.3164 mse 0.2904 t 998 new 0.27) lr 1.00e-05 gnorm 0.283 2.84s mem 81.1GB +step 1170/5000 loss 0.1903 (w 0.2992 mse 0.2875 t 922 new 0.19) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +step 1171/5000 loss 0.2546 (w 0.2088 mse 0.1982 t 897 new 0.29) lr 1.00e-05 gnorm 0.268 3.75s mem 81.1GB +step 1172/5000 loss 0.2810 (w 0.3389 mse 0.3394 t 328 new 0.10) lr 1.00e-05 gnorm 0.206 3.26s mem 81.1GB +step 1173/5000 loss 0.2914 (w 0.2967 mse 0.2843 t 948 new 0.24) lr 1.00e-05 gnorm 0.172 3.30s mem 81.1GB +step 1174/5000 loss 0.2590 (w 0.0607 mse 0.0734 t 800 new 0.19) lr 1.00e-05 gnorm 0.143 3.20s mem 81.1GB +step 1175/5000 loss 0.2787 (w 0.3453 mse 0.3352 t 988 new 0.20) lr 1.00e-05 gnorm 0.190 2.86s mem 81.1GB +step 1176/5000 loss 0.1847 (w 0.2208 mse 0.2129 t 874 new 0.10) lr 1.00e-05 gnorm 0.283 3.11s mem 81.1GB +step 1177/5000 loss 0.1211 (w 0.4492 mse 0.4478 t 995 new 0.14) lr 1.00e-05 gnorm 0.220 3.54s mem 81.1GB +step 1178/5000 loss 0.2444 (w 0.2425 mse 0.2391 t 909 new 0.23) lr 1.00e-05 gnorm 0.486 3.37s mem 81.1GB +step 1179/5000 loss 0.1636 (w 0.2342 mse 0.2218 t 892 new 0.22) lr 1.00e-05 gnorm 0.125 3.31s mem 81.1GB +step 1180/5000 loss 0.1607 (w 0.2090 mse 0.2029 t 952 new 0.15) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +step 1181/5000 loss 0.2269 (w 0.2287 mse 0.2214 t 900 new 0.24) lr 1.00e-05 gnorm 0.212 2.84s mem 81.1GB +step 1182/5000 loss 0.2018 (w 0.2368 mse 0.2118 t 879 new 0.19) lr 1.00e-05 gnorm 0.281 3.09s mem 81.1GB +step 1183/5000 loss 0.0993 (w 0.2810 mse 0.2778 t 976 new 0.20) lr 1.00e-05 gnorm 0.123 3.42s mem 81.1GB +step 1184/5000 loss 0.2501 (w 0.3557 mse 0.3599 t 998 new 0.15) lr 1.00e-05 gnorm 0.154 3.12s mem 81.1GB +step 1185/5000 loss 0.1147 (w 0.3340 mse 0.3199 t 995 new 0.22) lr 1.00e-05 gnorm 0.131 3.14s mem 81.1GB +step 1186/5000 loss 0.1741 (w 0.3331 mse 0.3245 t 971 new 0.19) lr 1.00e-05 gnorm 0.159 2.86s mem 81.1GB +step 1187/5000 loss 0.1209 (w 0.1748 mse 0.1871 t 946 new 0.27) lr 1.00e-05 gnorm 0.145 3.06s mem 81.1GB +step 1188/5000 loss 0.2912 (w 0.3450 mse 0.3358 t 984 new 0.20) lr 1.00e-05 gnorm 0.196 3.16s mem 81.1GB +step 1189/5000 loss 0.3603 (w 0.2444 mse 0.2499 t 955 new 0.20) lr 1.00e-05 gnorm 0.203 3.49s mem 81.1GB +step 1190/5000 loss 0.1863 (w 0.3775 mse 0.3653 t 979 new 0.20) lr 1.00e-05 gnorm 0.135 3.12s mem 81.1GB +step 1191/5000 loss 0.2287 (w 0.2258 mse 0.2092 t 849 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +step 1192/5000 loss 0.1678 (w 0.3191 mse 0.2947 t 948 new 0.23) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +step 1193/5000 loss 0.3067 (w 0.2197 mse 0.2120 t 771 new 0.16) lr 1.00e-05 gnorm 0.180 3.08s mem 81.1GB +step 1194/5000 loss 0.1748 (w 0.2806 mse 0.2996 t 980 new 0.13) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +step 1195/5000 loss 0.1817 (w 0.2893 mse 0.2864 t 976 new 0.14) lr 1.00e-05 gnorm 0.140 3.40s mem 81.1GB +step 1196/5000 loss 0.1450 (w 0.2280 mse 0.2337 t 424 new 0.20) lr 1.00e-05 gnorm 0.122 3.21s mem 81.1GB +step 1197/5000 loss 0.2833 (w 0.2490 mse 0.2579 t 660 new 0.22) lr 1.00e-05 gnorm 0.129 3.31s mem 81.1GB +step 1198/5000 loss 0.2244 (w 0.2681 mse 0.2488 t 894 new 0.20) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +step 1199/5000 loss 0.1081 (w 0.2980 mse 0.2822 t 895 new 0.20) lr 1.00e-05 gnorm 0.168 3.05s mem 81.1GB +step 1200/5000 loss 0.3633 (w 0.2907 mse 0.2943 t 264 new 0.17) lr 1.00e-05 gnorm 0.172 3.08s mem 81.1GB +step 1201/5000 loss 0.1767 (w 0.2296 mse 0.2317 t 948 new 0.13) lr 1.00e-05 gnorm 0.175 3.34s mem 81.1GB +step 1202/5000 loss 0.2515 (w 0.2715 mse 0.2595 t 855 new 0.21) lr 1.00e-05 gnorm 0.134 3.15s mem 81.1GB +step 1203/5000 loss 0.3019 (w 0.1496 mse 0.1555 t 890 new 0.17) lr 1.00e-05 gnorm 0.183 3.39s mem 81.1GB +step 1204/5000 loss 0.2732 (w 0.2050 mse 0.2049 t 626 new 0.17) lr 1.00e-05 gnorm 0.173 2.86s mem 81.1GB +step 1205/5000 loss 0.2806 (w 0.1872 mse 0.1906 t 428 new 0.18) lr 1.00e-05 gnorm 0.201 3.05s mem 81.1GB +step 1206/5000 loss 0.2693 (w 0.0842 mse 0.0916 t 731 new 0.11) lr 1.00e-05 gnorm 0.208 3.35s mem 81.1GB +step 1207/5000 loss 0.2665 (w 0.4537 mse 0.4661 t 206 new 0.22) lr 1.00e-05 gnorm 0.142 3.14s mem 81.1GB +step 1208/5000 loss 0.2027 (w 0.1683 mse 0.1643 t 953 new 0.24) lr 1.00e-05 gnorm 0.313 3.33s mem 81.1GB +step 1209/5000 loss 0.1884 (w 0.2288 mse 0.2491 t 998 new 0.22) lr 1.00e-05 gnorm 0.148 3.41s mem 81.1GB +step 1210/5000 loss 0.1718 (w 0.1430 mse 0.1442 t 803 new 0.19) lr 1.00e-05 gnorm 0.199 2.86s mem 81.1GB +step 1211/5000 loss 0.4534 (w 0.2713 mse 0.2669 t 610 new 0.22) lr 1.00e-05 gnorm 0.251 3.05s mem 81.1GB +step 1212/5000 loss 0.2261 (w 0.1618 mse 0.1755 t 892 new 0.17) lr 1.00e-05 gnorm 0.179 3.40s mem 81.1GB +step 1213/5000 loss 0.1613 (w 0.1772 mse 0.1754 t 987 new 0.22) lr 1.00e-05 gnorm 0.197 3.67s mem 81.1GB +step 1214/5000 loss 0.2128 (w 0.1880 mse 0.1809 t 904 new 0.20) lr 1.00e-05 gnorm 0.146 3.35s mem 81.1GB +step 1215/5000 loss 0.1977 (w 0.5631 mse 0.5634 t 134 new 0.20) lr 1.00e-05 gnorm 0.167 2.84s mem 81.1GB +step 1216/5000 loss 0.1075 (w 0.2958 mse 0.2913 t 984 new 0.19) lr 1.00e-05 gnorm 0.216 2.84s mem 81.1GB +step 1217/5000 loss 0.2688 (w 0.2429 mse 0.2347 t 949 new 0.20) lr 1.00e-05 gnorm 0.179 3.07s mem 81.1GB +step 1218/5000 loss 0.1153 (w 0.3152 mse 0.3131 t 968 new 0.20) lr 1.00e-05 gnorm 1.524 3.47s mem 81.1GB +step 1219/5000 loss 0.1082 (w 0.2660 mse 0.2657 t 914 new 0.17) lr 1.00e-05 gnorm 0.485 3.42s mem 81.1GB +step 1220/5000 loss 0.2510 (w 0.1843 mse 0.1739 t 951 new 0.12) lr 1.00e-05 gnorm 0.188 3.33s mem 81.1GB +step 1221/5000 loss 0.2271 (w 0.2631 mse 0.2572 t 919 new 0.22) lr 1.00e-05 gnorm 0.272 2.84s mem 81.1GB +step 1222/5000 loss 0.1824 (w 0.4155 mse 0.3983 t 974 new 0.22) lr 1.00e-05 gnorm 0.141 3.02s mem 81.1GB +step 1223/5000 loss 0.1625 (w 0.1663 mse 0.1817 t 971 new 0.22) lr 1.00e-05 gnorm 0.296 2.84s mem 81.1GB +step 1224/5000 loss 0.2327 (w 0.2828 mse 0.2726 t 804 new 0.19) lr 1.00e-05 gnorm 0.189 3.16s mem 81.1GB +step 1225/5000 loss 0.1793 (w 0.3322 mse 0.3236 t 951 new 0.28) lr 1.00e-05 gnorm 0.168 3.45s mem 81.1GB +step 1226/5000 loss 0.2234 (w 0.3360 mse 0.3314 t 996 new 0.22) lr 1.00e-05 gnorm 0.326 3.31s mem 81.1GB +step 1227/5000 loss 0.2106 (w 0.2381 mse 0.2262 t 844 new 0.24) lr 1.00e-05 gnorm 0.180 2.85s mem 81.1GB +step 1228/5000 loss 0.3055 (w 0.1894 mse 0.1953 t 889 new 0.15) lr 1.00e-05 gnorm 0.650 3.09s mem 81.1GB +step 1229/5000 loss 0.3462 (w 0.1661 mse 0.1777 t 965 new 0.20) lr 1.00e-05 gnorm 0.178 3.19s mem 81.1GB +step 1230/5000 loss 0.2320 (w 0.2871 mse 0.2757 t 665 new 0.21) lr 1.00e-05 gnorm 0.217 3.12s mem 81.1GB +step 1231/5000 loss 0.1808 (w 0.2492 mse 0.2399 t 809 new 0.23) lr 1.00e-05 gnorm 0.253 3.41s mem 81.1GB +step 1232/5000 loss 0.1870 (w 0.2942 mse 0.2885 t 984 new 0.21) lr 1.00e-05 gnorm 0.219 3.36s mem 81.1GB +step 1233/5000 loss 0.1914 (w 0.3045 mse 0.2981 t 437 new 0.16) lr 1.00e-05 gnorm 0.150 2.86s mem 81.1GB +step 1234/5000 loss 0.1327 (w 0.1857 mse 0.1880 t 987 new 0.15) lr 1.00e-05 gnorm 0.182 3.18s mem 81.1GB +step 1235/5000 loss 0.2038 (w 0.2237 mse 0.2186 t 967 new 0.12) lr 1.00e-05 gnorm 0.270 3.10s mem 81.1GB +step 1236/5000 loss 0.2273 (w 0.2191 mse 0.2046 t 809 new 0.26) lr 1.00e-05 gnorm 0.206 3.61s mem 81.1GB +step 1237/5000 loss 0.2870 (w 0.2826 mse 0.2566 t 889 new 0.27) lr 1.00e-05 gnorm 0.165 3.36s mem 81.1GB +step 1238/5000 loss 0.1427 (w 0.2510 mse 0.2372 t 952 new 0.21) lr 1.00e-05 gnorm 0.132 3.34s mem 81.1GB +step 1239/5000 loss 0.3122 (w 0.2261 mse 0.2226 t 809 new 0.24) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +step 1240/5000 loss 0.2200 (w 0.3481 mse 0.3380 t 920 new 0.19) lr 1.00e-05 gnorm 0.165 3.07s mem 81.1GB +step 1241/5000 loss 0.2130 (w 0.2763 mse 0.2694 t 766 new 0.18) lr 1.00e-05 gnorm 0.208 3.12s mem 81.1GB +step 1242/5000 loss 0.2813 (w 0.1625 mse 0.1626 t 794 new 0.22) lr 1.00e-05 gnorm 0.300 3.14s mem 81.1GB +step 1243/5000 loss 0.1571 (w 0.2625 mse 0.2529 t 960 new 0.19) lr 1.00e-05 gnorm 0.201 3.38s mem 81.1GB +step 1244/5000 loss 0.1762 (w 0.2501 mse 0.2418 t 992 new 0.26) lr 1.00e-05 gnorm 0.128 3.16s mem 81.1GB +step 1245/5000 loss 0.1838 (w 0.2255 mse 0.2128 t 901 new 0.20) lr 1.00e-05 gnorm 0.157 2.86s mem 81.1GB +step 1246/5000 loss 0.2511 (w 0.1524 mse 0.1657 t 421 new 0.16) lr 1.00e-05 gnorm 0.150 3.81s mem 81.1GB +step 1247/5000 loss 0.2210 (w 0.6521 mse 0.6106 t 998 new 0.19) lr 1.00e-05 gnorm 0.105 3.32s mem 81.1GB +step 1248/5000 loss 0.1520 (w 0.2189 mse 0.2175 t 663 new 0.15) lr 1.00e-05 gnorm 0.168 3.15s mem 81.1GB +step 1249/5000 loss 0.2586 (w 0.3428 mse 0.3514 t 288 new 0.27) lr 1.00e-05 gnorm 0.225 3.07s mem 81.1GB +step 1250/5000 loss 0.1507 (w 0.1206 mse 0.1153 t 906 new 0.19) lr 1.00e-05 gnorm 0.126 3.17s mem 81.1GB +step 1251/5000 loss 0.0979 (w 0.3903 mse 0.3724 t 983 new 0.21) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +step 1252/5000 loss 0.1753 (w 0.3997 mse 0.4145 t 140 new 0.24) lr 1.00e-05 gnorm 0.155 3.09s mem 81.1GB +step 1253/5000 loss 0.4155 (w 0.3075 mse 0.2921 t 819 new 0.23) lr 1.00e-05 gnorm 10.168 3.35s mem 81.1GB +step 1254/5000 loss 0.1745 (w 0.2376 mse 0.2633 t 973 new 0.15) lr 1.00e-05 gnorm 0.367 3.63s mem 81.1GB +step 1255/5000 loss 0.2249 (w 0.2794 mse 0.2822 t 990 new 0.20) lr 1.00e-05 gnorm 0.156 3.12s mem 81.1GB +step 1256/5000 loss 0.2850 (w 0.1645 mse 0.1585 t 925 new 0.27) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +step 1257/5000 loss 0.2304 (w 0.3031 mse 0.2963 t 929 new 0.22) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +step 1258/5000 loss 0.1574 (w 0.2153 mse 0.2005 t 849 new 0.18) lr 1.00e-05 gnorm 0.200 2.84s mem 81.1GB +step 1259/5000 loss 0.1430 (w 0.1291 mse 0.1244 t 750 new 0.21) lr 1.00e-05 gnorm 0.218 3.31s mem 81.1GB +step 1260/5000 loss 0.1484 (w 0.3922 mse 0.3759 t 975 new 0.22) lr 1.00e-05 gnorm 0.159 3.17s mem 81.1GB +step 1261/5000 loss 0.2381 (w 0.3276 mse 0.3216 t 981 new 0.23) lr 1.00e-05 gnorm 0.141 3.15s mem 81.1GB +step 1262/5000 loss 0.3850 (w 0.1092 mse 0.1092 t 590 new 0.14) lr 1.00e-05 gnorm 0.283 2.84s mem 81.1GB +step 1263/5000 loss 0.2078 (w 0.1159 mse 0.1154 t 862 new 0.14) lr 1.00e-05 gnorm 0.170 3.03s mem 81.1GB +step 1264/5000 loss 0.1673 (w 0.2151 mse 0.2104 t 926 new 0.26) lr 1.00e-05 gnorm 0.120 2.85s mem 81.1GB +step 1265/5000 loss 0.1554 (w 0.2519 mse 0.2436 t 390 new 0.22) lr 1.00e-05 gnorm 0.252 4.11s mem 81.1GB +step 1266/5000 loss 0.2053 (w 0.2097 mse 0.2040 t 904 new 0.22) lr 1.00e-05 gnorm 0.119 3.29s mem 81.1GB +step 1267/5000 loss 0.1835 (w 0.2569 mse 0.2646 t 993 new 0.17) lr 1.00e-05 gnorm 0.426 3.14s mem 81.1GB +step 1268/5000 loss 0.1828 (w 0.3695 mse 0.3672 t 935 new 0.19) lr 1.00e-05 gnorm 0.147 2.85s mem 81.1GB +step 1269/5000 loss 0.1694 (w 0.2650 mse 0.2528 t 839 new 0.19) lr 1.00e-05 gnorm 0.153 3.11s mem 81.1GB +step 1270/5000 loss 0.1923 (w 0.1353 mse 0.1457 t 829 new 0.24) lr 1.00e-05 gnorm 0.355 3.09s mem 81.1GB +step 1271/5000 loss 0.2575 (w 0.2972 mse 0.2784 t 988 new 0.18) lr 1.00e-05 gnorm 0.132 3.14s mem 81.1GB +step 1272/5000 loss 0.1449 (w 0.4138 mse 0.4001 t 970 new 0.19) lr 1.00e-05 gnorm 0.182 3.15s mem 81.1GB +step 1273/5000 loss 0.2099 (w 0.2446 mse 0.2580 t 983 new 0.19) lr 1.00e-05 gnorm 0.183 3.37s mem 81.1GB +step 1274/5000 loss 0.2317 (w 0.1781 mse 0.1847 t 924 new 0.23) lr 1.00e-05 gnorm 0.997 2.85s mem 81.1GB +step 1275/5000 loss 0.2082 (w 0.3479 mse 0.3485 t 977 new 0.23) lr 1.00e-05 gnorm 0.142 3.05s mem 81.1GB +step 1276/5000 loss 0.3786 (w 0.2554 mse 0.2471 t 616 new 0.27) lr 1.00e-05 gnorm 0.157 3.36s mem 81.1GB +step 1277/5000 loss 0.3539 (w 0.2348 mse 0.2233 t 954 new 0.21) lr 1.00e-05 gnorm 0.354 3.31s mem 81.1GB +step 1278/5000 loss 0.3623 (w 0.3103 mse 0.2860 t 862 new 0.22) lr 1.00e-05 gnorm 0.171 2.84s mem 81.1GB +step 1279/5000 loss 0.1377 (w 0.2551 mse 0.2587 t 963 new 0.27) lr 1.00e-05 gnorm 0.135 3.14s mem 81.1GB +step 1280/5000 loss 0.2569 (w 0.2967 mse 0.2815 t 963 new 0.26) lr 1.00e-05 gnorm 0.143 2.85s mem 81.1GB +step 1281/5000 loss 0.2390 (w 0.1916 mse 0.2033 t 984 new 0.12) lr 1.00e-05 gnorm 0.136 3.09s mem 81.1GB +step 1282/5000 loss 0.0824 (w 0.2656 mse 0.2642 t 891 new 0.16) lr 1.00e-05 gnorm 0.155 3.32s mem 81.1GB +step 1283/5000 loss 0.3491 (w 0.2500 mse 0.2397 t 878 new 0.07) lr 1.00e-05 gnorm 0.192 3.11s mem 81.1GB +step 1284/5000 loss 0.2221 (w 0.2359 mse 0.2114 t 927 new 0.19) lr 1.00e-05 gnorm 0.126 2.85s mem 81.1GB +step 1285/5000 loss 0.2352 (w 0.2279 mse 0.2196 t 692 new 0.15) lr 1.00e-05 gnorm 0.147 3.21s mem 81.1GB +step 1286/5000 loss 0.1631 (w 0.2445 mse 0.2368 t 949 new 0.22) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +step 1287/5000 loss 0.2138 (w 0.2958 mse 0.2871 t 953 new 0.18) lr 1.00e-05 gnorm 0.332 2.85s mem 81.1GB +step 1288/5000 loss 0.3504 (w 0.2329 mse 0.2362 t 855 new 0.22) lr 1.00e-05 gnorm 0.249 3.39s mem 81.1GB +step 1289/5000 loss 0.2164 (w 0.1366 mse 0.1372 t 702 new 0.07) lr 1.00e-05 gnorm 0.194 3.13s mem 81.1GB +step 1290/5000 loss 0.2119 (w 0.1395 mse 0.1470 t 866 new 0.24) lr 1.00e-05 gnorm 0.186 3.33s mem 81.1GB +step 1291/5000 loss 0.2948 (w 0.2068 mse 0.2023 t 995 new 0.23) lr 1.00e-05 gnorm 0.185 3.08s mem 81.1GB +step 1292/5000 loss 0.1311 (w 0.2223 mse 0.2171 t 892 new 0.25) lr 1.00e-05 gnorm 0.253 3.09s mem 81.1GB +step 1293/5000 loss 0.3108 (w 0.1377 mse 0.1238 t 940 new 0.18) lr 1.00e-05 gnorm 0.221 2.84s mem 81.1GB +step 1294/5000 loss 0.1915 (w 0.2181 mse 0.2212 t 826 new 0.23) lr 1.00e-05 gnorm 0.192 3.11s mem 81.1GB +step 1295/5000 loss 0.2083 (w 0.2144 mse 0.2012 t 899 new 0.26) lr 1.00e-05 gnorm 0.401 3.65s mem 81.1GB +step 1296/5000 loss 0.4848 (w 0.3246 mse 0.3179 t 553 new 0.09) lr 1.00e-05 gnorm 0.201 3.27s mem 81.1GB +step 1297/5000 loss 0.2052 (w 0.2009 mse 0.1867 t 890 new 0.19) lr 1.00e-05 gnorm 0.197 2.84s mem 81.1GB +step 1298/5000 loss 0.3066 (w 0.1880 mse 0.1860 t 876 new 0.18) lr 1.00e-05 gnorm 0.163 3.04s mem 81.1GB +step 1299/5000 loss 0.2353 (w 0.1788 mse 0.1885 t 619 new 0.15) lr 1.00e-05 gnorm 0.553 3.06s mem 81.1GB +step 1300/5000 loss 0.2417 (w 0.1634 mse 0.1658 t 939 new 0.18) lr 1.00e-05 gnorm 0.152 3.10s mem 81.1GB +step 1301/5000 loss 0.2373 (w 0.1121 mse 0.1083 t 720 new 0.14) lr 1.00e-05 gnorm 0.173 3.14s mem 81.1GB +step 1302/5000 loss 0.2536 (w 0.1633 mse 0.1661 t 820 new 0.09) lr 1.00e-05 gnorm 0.157 3.05s mem 81.1GB +step 1303/5000 loss 0.4531 (w 0.3624 mse 0.3628 t 390 new 0.19) lr 1.00e-05 gnorm 0.164 3.28s mem 81.1GB +step 1304/5000 loss 0.3084 (w 0.3323 mse 0.3415 t 995 new 0.16) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +step 1305/5000 loss 0.2160 (w 0.1859 mse 0.1779 t 717 new 0.14) lr 1.00e-05 gnorm 0.158 3.11s mem 81.1GB +step 1306/5000 loss 0.2018 (w 0.2384 mse 0.2335 t 989 new 0.24) lr 1.00e-05 gnorm 0.198 3.14s mem 81.1GB +step 1307/5000 loss 0.2152 (w 0.2309 mse 0.2230 t 982 new 0.23) lr 1.00e-05 gnorm 0.210 3.10s mem 81.1GB +step 1308/5000 loss 0.2187 (w 0.2870 mse 0.2825 t 912 new 0.23) lr 1.00e-05 gnorm 0.187 3.06s mem 81.1GB +step 1309/5000 loss 0.3303 (w 0.1798 mse 0.1765 t 884 new 0.23) lr 1.00e-05 gnorm 0.271 3.16s mem 81.1GB +step 1310/5000 loss 0.1366 (w 0.3204 mse 0.3119 t 997 new 0.22) lr 1.00e-05 gnorm 0.174 3.04s mem 81.1GB +step 1311/5000 loss 0.1113 (w 0.3636 mse 0.3405 t 988 new 0.22) lr 1.00e-05 gnorm 0.504 3.37s mem 81.1GB +step 1312/5000 loss 0.1451 (w 0.2395 mse 0.2303 t 786 new 0.23) lr 1.00e-05 gnorm 0.244 2.84s mem 81.1GB +step 1313/5000 loss 0.2793 (w 0.2289 mse 0.2328 t 473 new 0.19) lr 1.00e-05 gnorm 0.119 3.13s mem 81.1GB +step 1314/5000 loss 0.2296 (w 0.5369 mse 0.5182 t 986 new 0.18) lr 1.00e-05 gnorm 0.226 3.10s mem 81.1GB +step 1315/5000 loss 0.3569 (w 0.1756 mse 0.1726 t 992 new 0.19) lr 1.00e-05 gnorm 0.181 3.17s mem 81.1GB +step 1316/5000 loss 0.1937 (w 0.3062 mse 0.3039 t 601 new 0.18) lr 1.00e-05 gnorm 0.166 3.08s mem 81.1GB +step 1317/5000 loss 0.2626 (w 0.3336 mse 0.3133 t 776 new 0.23) lr 1.00e-05 gnorm 0.166 3.36s mem 81.1GB +step 1318/5000 loss 0.2092 (w 0.2337 mse 0.2305 t 914 new 0.16) lr 1.00e-05 gnorm 0.164 3.14s mem 81.1GB +step 1319/5000 loss 0.1977 (w 0.2426 mse 0.2368 t 885 new 0.23) lr 1.00e-05 gnorm 0.943 3.16s mem 81.1GB +step 1320/5000 loss 0.2713 (w 0.4091 mse 0.4204 t 983 new 0.19) lr 1.00e-05 gnorm 0.236 3.03s mem 81.1GB +step 1321/5000 loss 0.2510 (w 0.2302 mse 0.2147 t 885 new 0.21) lr 1.00e-05 gnorm 0.156 3.31s mem 81.1GB +step 1322/5000 loss 0.4196 (w 0.1825 mse 0.1816 t 814 new 0.21) lr 1.00e-05 gnorm 0.203 4.10s mem 81.1GB +step 1323/5000 loss 0.3246 (w 0.3750 mse 0.3914 t 228 new 0.17) lr 1.00e-05 gnorm 0.243 3.10s mem 81.1GB +step 1324/5000 loss 0.1820 (w 0.3942 mse 0.3634 t 998 new 0.20) lr 1.00e-05 gnorm 0.134 3.14s mem 81.1GB +step 1325/5000 loss 0.1656 (w 0.4478 mse 0.4231 t 998 new 0.23) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +step 1326/5000 loss 0.3180 (w 0.2888 mse 0.2642 t 974 new 0.18) lr 1.00e-05 gnorm 0.162 3.09s mem 81.1GB +step 1327/5000 loss 0.2858 (w 0.2157 mse 0.2161 t 710 new 0.09) lr 1.00e-05 gnorm 0.175 3.34s mem 81.1GB +step 1328/5000 loss 0.2549 (w 0.4108 mse 0.4149 t 297 new 0.29) lr 1.00e-05 gnorm 0.359 2.85s mem 81.1GB +step 1329/5000 loss 0.2541 (w 0.2330 mse 0.2289 t 959 new 0.20) lr 1.00e-05 gnorm 0.141 3.16s mem 81.1GB +step 1330/5000 loss 0.2508 (w 0.3934 mse 0.4061 t 985 new 0.20) lr 1.00e-05 gnorm 0.158 3.36s mem 81.1GB +step 1331/5000 loss 0.1085 (w 0.3712 mse 0.3622 t 968 new 0.18) lr 1.00e-05 gnorm 0.136 3.12s mem 81.1GB +step 1332/5000 loss 0.3212 (w 0.2111 mse 0.2000 t 866 new 0.20) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +step 1333/5000 loss 0.1476 (w 0.1726 mse 0.1807 t 975 new 0.10) lr 1.00e-05 gnorm 0.191 3.16s mem 81.1GB +step 1334/5000 loss 0.1638 (w 0.2142 mse 0.2179 t 863 new 0.18) lr 1.00e-05 gnorm 0.560 3.10s mem 81.1GB +step 1335/5000 loss 0.1790 (w 0.4408 mse 0.4102 t 992 new 0.20) lr 1.00e-05 gnorm 0.568 3.05s mem 81.1GB +step 1336/5000 loss 0.3134 (w 0.2666 mse 0.2560 t 737 new 0.15) lr 1.00e-05 gnorm 0.151 3.43s mem 81.1GB +step 1337/5000 loss 0.1568 (w 0.2072 mse 0.1894 t 718 new 0.20) lr 1.00e-05 gnorm 0.226 3.12s mem 81.1GB +step 1338/5000 loss 0.1023 (w 0.2330 mse 0.2367 t 956 new 0.11) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +step 1339/5000 loss 0.2583 (w 0.3147 mse 0.2962 t 663 new 0.19) lr 1.00e-05 gnorm 0.158 3.18s mem 81.1GB +step 1340/5000 loss 0.4037 (w 0.2897 mse 0.2862 t 973 new 0.12) lr 1.00e-05 gnorm 0.167 3.42s mem 81.1GB +step 1341/5000 loss 0.2679 (w 0.2702 mse 0.2554 t 881 new 0.21) lr 1.00e-05 gnorm 0.316 3.29s mem 81.1GB +step 1342/5000 loss 0.0828 (w 0.3211 mse 0.3349 t 987 new 0.23) lr 1.00e-05 gnorm 0.220 3.12s mem 81.1GB +step 1343/5000 loss 0.2012 (w 0.3225 mse 0.3188 t 986 new 0.21) lr 1.00e-05 gnorm 0.151 3.03s mem 81.1GB +step 1344/5000 loss 0.3218 (w 0.2202 mse 0.2388 t 578 new 0.18) lr 1.00e-05 gnorm 0.160 3.33s mem 81.1GB +step 1345/5000 loss 0.2564 (w 0.1907 mse 0.1830 t 927 new 0.21) lr 1.00e-05 gnorm 0.194 3.02s mem 81.1GB +step 1346/5000 loss 0.3073 (w 0.4356 mse 0.4413 t 348 new 0.13) lr 1.00e-05 gnorm 0.127 3.17s mem 81.1GB +step 1347/5000 loss 0.3576 (w 0.2005 mse 0.1991 t 817 new 0.22) lr 1.00e-05 gnorm 0.192 3.32s mem 81.1GB +step 1348/5000 loss 0.1752 (w 0.2470 mse 0.2578 t 966 new 0.15) lr 1.00e-05 gnorm 0.138 3.16s mem 81.1GB +step 1349/5000 loss 0.2069 (w 0.2442 mse 0.2238 t 948 new 0.21) lr 1.00e-05 gnorm 0.153 3.03s mem 81.1GB +step 1350/5000 loss 0.2290 (w 0.1397 mse 0.1377 t 850 new 0.15) lr 1.00e-05 gnorm 1.291 2.86s mem 81.1GB +step 1351/5000 loss 0.2086 (w 0.1428 mse 0.1428 t 677 new 0.01) lr 1.00e-05 gnorm 0.134 3.18s mem 81.1GB +step 1352/5000 loss 0.3525 (w 0.2820 mse 0.2722 t 871 new 0.17) lr 1.00e-05 gnorm 0.182 3.09s mem 81.1GB +step 1353/5000 loss 0.3014 (w 0.2893 mse 0.2735 t 540 new 0.27) lr 1.00e-05 gnorm 0.474 3.35s mem 81.1GB +step 1354/5000 loss 0.1201 (w 0.3903 mse 0.3902 t 987 new 0.19) lr 1.00e-05 gnorm 0.270 2.85s mem 81.1GB +step 1355/5000 loss 0.3777 (w 0.2167 mse 0.2170 t 884 new 0.17) lr 1.00e-05 gnorm 0.160 3.07s mem 81.1GB +step 1356/5000 loss 0.3566 (w 0.3024 mse 0.2811 t 978 new 0.22) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +step 1357/5000 loss 0.1995 (w 0.2018 mse 0.1913 t 898 new 0.19) lr 1.00e-05 gnorm 0.223 3.19s mem 81.1GB +step 1358/5000 loss 0.2262 (w 0.3290 mse 0.3242 t 999 new 0.20) lr 1.00e-05 gnorm 0.123 3.11s mem 81.1GB +step 1359/5000 loss 0.1054 (w 0.1916 mse 0.1850 t 875 new 0.10) lr 1.00e-05 gnorm 1.097 3.39s mem 81.1GB +step 1360/5000 loss 0.3166 (w 0.2094 mse 0.1995 t 890 new 0.21) lr 1.00e-05 gnorm 0.208 2.84s mem 81.1GB +step 1361/5000 loss 0.1780 (w 0.0945 mse 0.1091 t 904 new 0.19) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 1362/5000 loss 0.1567 (w 0.1623 mse 0.1564 t 923 new 0.22) lr 1.00e-05 gnorm 0.139 3.03s mem 81.1GB +step 1363/5000 loss 0.2616 (w 0.4180 mse 0.3958 t 972 new 0.19) lr 1.00e-05 gnorm 0.133 3.42s mem 81.1GB +step 1364/5000 loss 0.3338 (w 0.2704 mse 0.2837 t 980 new 0.14) lr 1.00e-05 gnorm 0.168 3.13s mem 81.1GB +step 1365/5000 loss 0.3411 (w 0.2756 mse 0.2649 t 562 new 0.21) lr 1.00e-05 gnorm 0.129 3.17s mem 81.1GB +step 1366/5000 loss 0.2953 (w 0.2307 mse 0.2141 t 841 new 0.21) lr 1.00e-05 gnorm 0.112 2.85s mem 81.1GB +step 1367/5000 loss 0.2499 (w 0.4812 mse 0.4884 t 212 new 0.18) lr 1.00e-05 gnorm 0.835 3.05s mem 81.1GB +step 1368/5000 loss 0.3609 (w 0.1710 mse 0.1716 t 719 new 0.12) lr 1.00e-05 gnorm 0.177 3.03s mem 81.1GB +step 1369/5000 loss 0.0869 (w 0.1829 mse 0.1800 t 969 new 0.22) lr 1.00e-05 gnorm 0.156 3.37s mem 81.1GB +step 1370/5000 loss 0.2762 (w 0.1288 mse 0.1302 t 666 new 0.21) lr 1.00e-05 gnorm 0.143 3.06s mem 81.1GB +step 1371/5000 loss 0.3091 (w 0.2261 mse 0.2196 t 931 new 0.22) lr 1.00e-05 gnorm 0.236 3.14s mem 81.1GB +step 1372/5000 loss 0.2698 (w 0.2379 mse 0.2316 t 815 new 0.24) lr 1.00e-05 gnorm 0.580 2.84s mem 81.1GB +step 1373/5000 loss 0.2946 (w 0.2838 mse 0.2687 t 878 new 0.20) lr 1.00e-05 gnorm 0.146 3.08s mem 81.1GB +step 1374/5000 loss 0.2380 (w 0.2668 mse 0.2489 t 955 new 0.28) lr 1.00e-05 gnorm 0.131 3.09s mem 81.1GB +step 1375/5000 loss 0.3274 (w 0.2272 mse 0.2262 t 999 new 0.10) lr 1.00e-05 gnorm 0.126 3.40s mem 81.1GB +step 1376/5000 loss 0.2360 (w 0.2067 mse 0.2131 t 944 new 0.21) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +step 1377/5000 loss 0.3153 (w 0.2412 mse 0.2404 t 808 new 0.26) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +step 1378/5000 loss 0.2803 (w 0.1834 mse 0.1823 t 950 new 0.19) lr 1.00e-05 gnorm 0.186 3.04s mem 81.1GB +step 1379/5000 loss 0.1912 (w 0.2094 mse 0.2163 t 790 new 0.17) lr 1.00e-05 gnorm 0.151 2.85s mem 81.1GB +step 1380/5000 loss 0.1997 (w 0.2682 mse 0.2711 t 970 new 0.07) lr 1.00e-05 gnorm 0.249 3.10s mem 81.1GB +step 1381/5000 loss 0.2311 (w 0.3160 mse 0.3047 t 892 new 0.21) lr 1.00e-05 gnorm 0.196 3.46s mem 81.1GB +step 1382/5000 loss 0.2232 (w 0.1893 mse 0.1963 t 941 new 0.22) lr 1.00e-05 gnorm 0.124 3.17s mem 81.1GB +step 1383/5000 loss 0.3055 (w 0.2736 mse 0.2724 t 479 new 0.19) lr 1.00e-05 gnorm 1.153 3.72s mem 81.1GB +step 1384/5000 loss 0.3711 (w 0.1558 mse 0.1448 t 815 new 0.23) lr 1.00e-05 gnorm 0.575 3.12s mem 81.1GB +step 1385/5000 loss 0.3477 (w 0.7166 mse 0.7015 t 100 new 0.15) lr 1.00e-05 gnorm 0.179 2.84s mem 81.1GB +step 1386/5000 loss 0.1980 (w 0.2222 mse 0.2135 t 836 new 0.21) lr 1.00e-05 gnorm 0.221 3.07s mem 81.1GB +step 1387/5000 loss 0.1782 (w 0.1944 mse 0.1930 t 906 new 0.23) lr 1.00e-05 gnorm 0.213 3.16s mem 81.1GB +step 1388/5000 loss 0.1140 (w 0.1456 mse 0.1464 t 886 new 0.24) lr 1.00e-05 gnorm 0.144 3.10s mem 81.1GB +step 1389/5000 loss 0.2834 (w 0.2150 mse 0.2254 t 988 new 0.25) lr 1.00e-05 gnorm 0.201 3.12s mem 81.1GB +step 1390/5000 loss 0.2226 (w 0.1560 mse 0.1454 t 897 new 0.21) lr 1.00e-05 gnorm 0.160 3.11s mem 81.1GB +step 1391/5000 loss 0.3018 (w 0.1606 mse 0.1664 t 712 new 0.18) lr 1.00e-05 gnorm 0.138 2.85s mem 81.1GB +step 1392/5000 loss 0.2865 (w 0.1075 mse 0.1176 t 916 new 0.14) lr 1.00e-05 gnorm 0.274 3.26s mem 81.1GB +step 1393/5000 loss 0.2186 (w 0.1830 mse 0.1751 t 858 new 0.20) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +step 1394/5000 loss 0.2718 (w 0.2200 mse 0.2284 t 983 new 0.27) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +step 1395/5000 loss 0.2243 (w 0.1951 mse 0.2022 t 758 new 0.13) lr 1.00e-05 gnorm 0.118 3.16s mem 81.1GB +step 1396/5000 loss 0.1064 (w 0.2572 mse 0.2726 t 974 new 0.22) lr 1.00e-05 gnorm 0.149 3.11s mem 81.1GB +step 1397/5000 loss 0.3164 (w 0.1599 mse 0.1564 t 908 new 0.24) lr 1.00e-05 gnorm 0.148 2.85s mem 81.1GB +step 1398/5000 loss 0.3452 (w 0.3182 mse 0.3293 t 200 new 0.26) lr 1.00e-05 gnorm 0.155 3.38s mem 81.1GB +step 1399/5000 loss 0.2001 (w 0.2435 mse 0.2367 t 773 new 0.22) lr 1.00e-05 gnorm 0.321 3.41s mem 81.1GB +step 1400/5000 loss 0.1615 (w 0.3105 mse 0.3042 t 983 new 0.24) lr 1.00e-05 gnorm 0.136 2.85s mem 81.1GB +step 1401/5000 loss 0.1046 (w 0.2304 mse 0.2307 t 953 new 0.21) lr 1.00e-05 gnorm 0.410 3.13s mem 81.1GB +step 1402/5000 loss 0.1469 (w 0.3622 mse 0.3443 t 715 new 0.20) lr 1.00e-05 gnorm 0.157 3.08s mem 81.1GB +step 1403/5000 loss 0.1373 (w 0.2039 mse 0.2001 t 945 new 0.15) lr 1.00e-05 gnorm 0.198 3.11s mem 81.1GB +step 1404/5000 loss 0.3514 (w 0.1703 mse 0.1858 t 570 new 0.16) lr 1.00e-05 gnorm 0.144 3.15s mem 81.1GB +step 1405/5000 loss 0.2210 (w 0.2590 mse 0.2523 t 959 new 0.20) lr 1.00e-05 gnorm 0.163 3.36s mem 81.1GB +step 1406/5000 loss 0.1573 (w 0.4470 mse 0.4454 t 985 new 0.22) lr 1.00e-05 gnorm 0.203 3.15s mem 81.1GB +step 1407/5000 loss 0.1593 (w 0.1839 mse 0.1779 t 951 new 0.20) lr 1.00e-05 gnorm 0.251 2.85s mem 81.1GB +step 1408/5000 loss 0.1545 (w 0.2075 mse 0.2185 t 981 new 0.22) lr 1.00e-05 gnorm 0.347 3.08s mem 81.1GB +step 1409/5000 loss 0.2970 (w 0.2577 mse 0.2695 t 975 new 0.25) lr 1.00e-05 gnorm 0.147 3.03s mem 81.1GB +step 1410/5000 loss 0.4372 (w 0.3690 mse 0.3754 t 233 new 0.20) lr 1.00e-05 gnorm 0.289 3.14s mem 81.1GB +step 1411/5000 loss 0.1916 (w 0.1689 mse 0.1673 t 731 new 0.27) lr 1.00e-05 gnorm 0.304 3.43s mem 81.1GB +step 1412/5000 loss 0.1727 (w 0.1176 mse 0.1262 t 924 new 0.15) lr 1.00e-05 gnorm 0.127 3.15s mem 81.1GB +step 1413/5000 loss 0.2085 (w 0.1772 mse 0.1623 t 819 new 0.19) lr 1.00e-05 gnorm 0.137 2.86s mem 81.1GB +step 1414/5000 loss 0.2176 (w 0.1392 mse 0.1438 t 899 new 0.13) lr 1.00e-05 gnorm 0.256 3.09s mem 81.1GB +step 1415/5000 loss 0.1508 (w 0.4957 mse 0.5019 t 987 new 0.25) lr 1.00e-05 gnorm 0.170 3.06s mem 81.1GB +step 1416/5000 loss 0.2318 (w 0.5432 mse 0.5284 t 200 new 0.19) lr 1.00e-05 gnorm 0.129 3.38s mem 81.1GB +step 1417/5000 loss 0.2292 (w 0.1435 mse 0.1439 t 890 new 0.23) lr 1.00e-05 gnorm 0.162 3.13s mem 81.1GB +step 1418/5000 loss 0.1432 (w 0.2271 mse 0.2240 t 760 new 0.20) lr 1.00e-05 gnorm 0.165 3.40s mem 81.1GB +step 1419/5000 loss 0.0923 (w 0.2484 mse 0.2366 t 980 new 0.22) lr 1.00e-05 gnorm 0.147 3.05s mem 81.1GB +step 1420/5000 loss 0.2021 (w 0.1777 mse 0.1677 t 727 new 0.09) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 1421/5000 loss 0.1704 (w 0.3609 mse 0.3386 t 953 new 0.16) lr 1.00e-05 gnorm 0.153 3.10s mem 81.1GB +step 1422/5000 loss 0.3816 (w 0.3701 mse 0.3764 t 301 new 0.25) lr 1.00e-05 gnorm 0.246 3.47s mem 81.1GB +step 1423/5000 loss 0.3355 (w 0.3489 mse 0.3651 t 383 new 0.21) lr 1.00e-05 gnorm 0.169 3.13s mem 81.1GB +step 1424/5000 loss 0.2117 (w 0.2391 mse 0.2317 t 799 new 0.10) lr 1.00e-05 gnorm 0.304 3.55s mem 81.1GB +step 1425/5000 loss 0.1143 (w 0.1871 mse 0.1793 t 744 new 0.23) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +step 1426/5000 loss 0.3318 (w 0.2291 mse 0.2177 t 506 new 0.20) lr 1.00e-05 gnorm 0.297 2.84s mem 81.1GB +step 1427/5000 loss 0.2357 (w 0.2639 mse 0.2493 t 841 new 0.18) lr 1.00e-05 gnorm 0.130 3.36s mem 81.1GB +step 1428/5000 loss 0.1746 (w 0.1758 mse 0.1655 t 747 new 0.21) lr 1.00e-05 gnorm 1.484 3.42s mem 81.1GB +step 1429/5000 loss 0.4085 (w 0.4324 mse 0.4429 t 233 new 0.14) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +step 1430/5000 loss 0.2333 (w 0.2195 mse 0.2076 t 949 new 0.21) lr 1.00e-05 gnorm 0.172 3.22s mem 81.1GB +step 1431/5000 loss 0.2464 (w 0.2066 mse 0.2105 t 920 new 0.21) lr 1.00e-05 gnorm 0.216 3.06s mem 81.1GB +step 1432/5000 loss 0.2095 (w 0.1900 mse 0.1812 t 931 new 0.12) lr 1.00e-05 gnorm 0.555 2.85s mem 81.1GB +step 1433/5000 loss 0.1629 (w 0.2608 mse 0.2575 t 942 new 0.22) lr 1.00e-05 gnorm 0.111 3.17s mem 81.1GB +step 1434/5000 loss 0.2863 (w 0.2517 mse 0.2448 t 906 new 0.08) lr 1.00e-05 gnorm 0.164 3.14s mem 81.1GB +step 1435/5000 loss 0.1336 (w 0.3171 mse 0.2984 t 983 new 0.27) lr 1.00e-05 gnorm 0.142 3.40s mem 81.1GB +step 1436/5000 loss 0.2401 (w 0.2873 mse 0.2793 t 672 new 0.21) lr 1.00e-05 gnorm 0.338 2.84s mem 81.1GB +step 1437/5000 loss 0.1478 (w 0.2128 mse 0.2094 t 942 new 0.21) lr 1.00e-05 gnorm 0.157 3.97s mem 81.1GB +step 1438/5000 loss 0.3041 (w 0.3191 mse 0.3209 t 465 new 0.19) lr 1.00e-05 gnorm 0.168 3.02s mem 81.1GB +step 1439/5000 loss 0.2287 (w 0.2254 mse 0.2318 t 795 new 0.17) lr 1.00e-05 gnorm 0.178 3.13s mem 81.1GB +step 1440/5000 loss 0.2638 (w 0.1420 mse 0.1384 t 945 new 0.22) lr 1.00e-05 gnorm 0.220 3.08s mem 81.1GB +step 1441/5000 loss 0.1978 (w 0.2977 mse 0.2799 t 702 new 0.25) lr 1.00e-05 gnorm 0.164 3.47s mem 81.1GB +step 1442/5000 loss 0.2243 (w 0.1245 mse 0.1301 t 740 new 0.22) lr 1.00e-05 gnorm 0.186 3.12s mem 81.1GB +step 1443/5000 loss 0.2666 (w 0.2770 mse 0.2752 t 773 new 0.25) lr 1.00e-05 gnorm 0.738 2.87s mem 81.1GB +step 1444/5000 loss 0.2530 (w 0.2505 mse 0.2434 t 790 new 0.21) lr 1.00e-05 gnorm 0.228 3.07s mem 81.1GB +step 1445/5000 loss 0.2248 (w 0.3799 mse 0.3997 t 254 new 0.17) lr 1.00e-05 gnorm 0.124 3.42s mem 81.1GB +step 1446/5000 loss 0.2520 (w 0.2001 mse 0.2083 t 973 new 0.10) lr 1.00e-05 gnorm 0.156 3.11s mem 81.1GB +step 1447/5000 loss 0.1791 (w 0.1308 mse 0.1298 t 938 new 0.08) lr 1.00e-05 gnorm 0.185 3.42s mem 81.1GB +step 1448/5000 loss 0.2331 (w 0.1691 mse 0.1647 t 537 new 0.16) lr 1.00e-05 gnorm 0.209 3.12s mem 81.1GB +step 1449/5000 loss 0.1246 (w 0.3397 mse 0.3314 t 982 new 0.21) lr 1.00e-05 gnorm 0.163 2.85s mem 81.1GB +step 1450/5000 loss 0.2734 (w 0.2935 mse 0.2845 t 576 new 0.22) lr 1.00e-05 gnorm 0.287 3.11s mem 81.1GB +step 1451/5000 loss 0.2533 (w 0.0960 mse 0.1065 t 720 new 0.22) lr 1.00e-05 gnorm 0.174 3.47s mem 81.1GB +step 1452/5000 loss 0.1688 (w 0.2918 mse 0.2977 t 957 new 0.23) lr 1.00e-05 gnorm 0.134 3.65s mem 81.1GB +step 1453/5000 loss 0.3946 (w 0.2234 mse 0.2164 t 462 new 0.11) lr 1.00e-05 gnorm 0.193 3.18s mem 81.1GB +step 1454/5000 loss 0.2698 (w 0.3219 mse 0.3210 t 368 new 0.10) lr 1.00e-05 gnorm 0.147 3.04s mem 81.1GB +step 1455/5000 loss 0.2038 (w 0.2193 mse 0.2139 t 628 new 0.18) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +step 1456/5000 loss 0.2860 (w 0.2732 mse 0.2761 t 768 new 0.18) lr 1.00e-05 gnorm 0.134 3.07s mem 81.1GB +step 1457/5000 loss 0.2187 (w 0.1938 mse 0.1862 t 818 new 0.20) lr 1.00e-05 gnorm 0.152 3.44s mem 81.1GB +step 1458/5000 loss 0.1939 (w 0.2364 mse 0.2280 t 902 new 0.23) lr 1.00e-05 gnorm 0.175 3.16s mem 81.1GB +step 1459/5000 loss 0.2272 (w 0.3522 mse 0.3584 t 972 new 0.13) lr 1.00e-05 gnorm 0.197 3.19s mem 81.1GB +step 1460/5000 loss 0.2975 (w 0.3700 mse 0.3503 t 982 new 0.26) lr 1.00e-05 gnorm 0.153 3.10s mem 81.1GB +step 1461/5000 loss 0.2409 (w 0.2411 mse 0.2265 t 939 new 0.19) lr 1.00e-05 gnorm 0.395 2.86s mem 81.1GB +step 1462/5000 loss 0.1487 (w 0.2825 mse 0.2682 t 933 new 0.21) lr 1.00e-05 gnorm 0.520 3.09s mem 81.1GB +step 1463/5000 loss 0.2758 (w 0.2937 mse 0.2756 t 942 new 0.23) lr 1.00e-05 gnorm 0.143 3.43s mem 81.1GB +step 1464/5000 loss 0.2574 (w 0.2866 mse 0.3047 t 998 new 0.21) lr 1.00e-05 gnorm 0.148 3.09s mem 81.1GB +step 1465/5000 loss 0.3649 (w 0.2213 mse 0.2251 t 518 new 0.13) lr 1.00e-05 gnorm 0.145 3.16s mem 81.1GB +step 1466/5000 loss 0.2370 (w 0.2357 mse 0.2203 t 779 new 0.17) lr 1.00e-05 gnorm 0.112 3.05s mem 81.1GB +step 1467/5000 loss 0.2785 (w 0.1928 mse 0.1852 t 902 new 0.15) lr 1.00e-05 gnorm 0.118 3.04s mem 81.1GB +step 1468/5000 loss 0.2637 (w 0.3371 mse 0.3215 t 975 new 0.23) lr 1.00e-05 gnorm 0.220 2.84s mem 81.1GB +step 1469/5000 loss 0.2861 (w 0.2671 mse 0.2577 t 833 new 0.21) lr 1.00e-05 gnorm 0.291 3.37s mem 81.1GB +step 1470/5000 loss 0.2854 (w 0.2118 mse 0.2011 t 798 new 0.10) lr 1.00e-05 gnorm 0.135 3.66s mem 81.1GB +step 1471/5000 loss 0.2051 (w 0.1063 mse 0.1168 t 976 new 0.11) lr 1.00e-05 gnorm 0.368 3.14s mem 81.1GB +step 1472/5000 loss 0.2752 (w 0.1618 mse 0.1541 t 695 new 0.22) lr 1.00e-05 gnorm 0.200 3.07s mem 81.1GB +step 1473/5000 loss 0.1926 (w 0.2056 mse 0.2099 t 883 new 0.18) lr 1.00e-05 gnorm 0.208 3.05s mem 81.1GB +step 1474/5000 loss 0.2130 (w 0.1745 mse 0.1773 t 875 new 0.25) lr 1.00e-05 gnorm 0.276 3.68s mem 81.1GB +step 1475/5000 loss 0.1879 (w 0.1792 mse 0.1777 t 952 new 0.19) lr 1.00e-05 gnorm 0.184 3.13s mem 81.1GB +step 1476/5000 loss 0.2018 (w 0.2739 mse 0.2570 t 815 new 0.20) lr 1.00e-05 gnorm 0.286 3.18s mem 81.1GB +step 1477/5000 loss 0.2694 (w 0.3118 mse 0.3160 t 932 new 0.13) lr 1.00e-05 gnorm 0.226 3.15s mem 81.1GB +step 1478/5000 loss 0.3729 (w 0.4769 mse 0.4769 t 306 new 0.17) lr 1.00e-05 gnorm 0.196 3.12s mem 81.1GB +step 1479/5000 loss 0.2106 (w 0.2906 mse 0.2841 t 987 new 0.10) lr 1.00e-05 gnorm 0.787 3.08s mem 81.1GB +step 1480/5000 loss 0.2452 (w 0.3324 mse 0.3378 t 982 new 0.22) lr 1.00e-05 gnorm 0.280 3.12s mem 81.1GB +step 1481/5000 loss 0.3278 (w 0.2611 mse 0.2611 t 336 new 0.28) lr 1.00e-05 gnorm 0.314 3.40s mem 81.1GB +step 1482/5000 loss 0.2201 (w 0.2680 mse 0.2576 t 492 new 0.19) lr 1.00e-05 gnorm 0.150 3.58s mem 81.1GB +step 1483/5000 loss 0.2745 (w 0.2847 mse 0.2772 t 703 new 0.16) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +step 1484/5000 loss 0.3806 (w 0.2814 mse 0.2719 t 669 new 0.25) lr 1.00e-05 gnorm 0.161 2.86s mem 81.1GB +step 1485/5000 loss 0.2176 (w 0.0697 mse 0.0752 t 828 new 0.21) lr 1.00e-05 gnorm 0.127 3.07s mem 81.1GB +step 1486/5000 loss 0.1652 (w 0.2386 mse 0.2278 t 939 new 0.24) lr 1.00e-05 gnorm 0.424 3.09s mem 81.1GB +step 1487/5000 loss 0.3044 (w 0.2402 mse 0.2345 t 892 new 0.21) lr 1.00e-05 gnorm 0.256 3.33s mem 81.1GB +step 1488/5000 loss 0.2079 (w 0.3133 mse 0.3041 t 990 new 0.20) lr 1.00e-05 gnorm 0.202 3.43s mem 81.1GB +step 1489/5000 loss 0.2424 (w 0.0999 mse 0.1044 t 852 new 0.23) lr 1.00e-05 gnorm 0.134 3.37s mem 81.1GB +step 1490/5000 loss 0.1568 (w 0.1771 mse 0.1594 t 906 new 0.25) lr 1.00e-05 gnorm 0.775 2.84s mem 81.1GB +step 1491/5000 loss 0.2420 (w 0.2441 mse 0.2198 t 684 new 0.21) lr 1.00e-05 gnorm 0.234 3.03s mem 81.1GB +step 1492/5000 loss 0.1194 (w 0.3926 mse 0.3877 t 965 new 0.21) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +step 1493/5000 loss 0.3481 (w 0.3067 mse 0.3167 t 968 new 0.19) lr 1.00e-05 gnorm 0.136 3.12s mem 81.1GB +step 1494/5000 loss 0.2859 (w 0.3676 mse 0.3470 t 946 new 0.21) lr 1.00e-05 gnorm 0.228 3.40s mem 81.1GB +step 1495/5000 loss 0.2630 (w 0.3029 mse 0.2887 t 996 new 0.28) lr 1.00e-05 gnorm 0.252 3.40s mem 81.1GB +step 1496/5000 loss 0.4901 (w 0.2761 mse 0.2700 t 981 new 0.23) lr 1.00e-05 gnorm 0.151 2.86s mem 81.1GB +step 1497/5000 loss 0.2146 (w 0.1789 mse 0.1800 t 770 new 0.25) lr 1.00e-05 gnorm 0.133 3.38s mem 81.1GB +step 1498/5000 loss 0.2789 (w 0.1999 mse 0.1906 t 824 new 0.15) lr 1.00e-05 gnorm 0.184 3.13s mem 81.1GB +step 1499/5000 loss 0.1235 (w 0.2982 mse 0.2963 t 947 new 0.13) lr 1.00e-05 gnorm 0.187 3.39s mem 81.1GB +step 1500/5000 loss 0.3610 (w 0.2525 mse 0.2442 t 566 new 0.19) lr 1.00e-05 gnorm 0.119 3.18s mem 81.1GB +[val] step 1500 t=200: w=0.4302 mse=0.4413 (n=16) t=500: w=0.2305 mse=0.2346 (n=16) t=800: w=0.1813 mse=0.1812 (n=16) | mean w=0.2806 mse=0.2857 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step1500.safetensors 4093 个张量 37.98 GB +step 1501/5000 loss 0.2970 (w 0.2422 mse 0.2386 t 973 new 0.20) lr 1.00e-05 gnorm 0.211 3.10s mem 81.1GB +step 1502/5000 loss 0.2339 (w 0.2826 mse 0.2876 t 975 new 0.14) lr 1.00e-05 gnorm 0.135 3.29s mem 81.1GB +step 1503/5000 loss 0.2880 (w 0.2429 mse 0.2349 t 769 new 0.21) lr 1.00e-05 gnorm 0.237 2.82s mem 81.1GB +step 1504/5000 loss 0.2499 (w 0.2001 mse 0.1980 t 883 new 0.17) lr 1.00e-05 gnorm 0.153 3.12s mem 81.1GB +step 1505/5000 loss 0.2409 (w 0.2210 mse 0.2196 t 994 new 0.22) lr 1.00e-05 gnorm 0.214 3.17s mem 81.1GB +step 1506/5000 loss 0.2598 (w 0.1061 mse 0.1204 t 933 new 0.22) lr 1.00e-05 gnorm 0.146 3.40s mem 81.1GB +step 1507/5000 loss 0.2254 (w 0.3139 mse 0.3051 t 328 new 0.19) lr 1.00e-05 gnorm 0.169 2.85s mem 81.1GB +step 1508/5000 loss 0.0898 (w 0.0985 mse 0.1091 t 765 new 0.19) lr 1.00e-05 gnorm 0.121 3.25s mem 81.1GB +step 1509/5000 loss 0.1882 (w 0.3159 mse 0.2871 t 987 new 0.22) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +step 1510/5000 loss 0.2679 (w 0.0947 mse 0.1013 t 802 new 0.15) lr 1.00e-05 gnorm 0.161 3.10s mem 81.1GB +step 1511/5000 loss 0.1844 (w 0.1610 mse 0.1680 t 811 new 0.22) lr 1.00e-05 gnorm 0.132 3.38s mem 81.1GB +step 1512/5000 loss 0.1602 (w 0.3156 mse 0.3006 t 966 new 0.15) lr 1.00e-05 gnorm 0.145 3.43s mem 81.1GB +step 1513/5000 loss 0.3225 (w 0.2015 mse 0.1975 t 783 new 0.19) lr 1.00e-05 gnorm 0.183 2.85s mem 81.1GB +step 1514/5000 loss 0.2305 (w 0.3191 mse 0.3150 t 269 new 0.20) lr 1.00e-05 gnorm 0.153 3.37s mem 81.1GB +step 1515/5000 loss 0.1139 (w 0.2869 mse 0.2840 t 926 new 0.25) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +step 1516/5000 loss 0.2855 (w 0.1630 mse 0.1569 t 826 new 0.22) lr 1.00e-05 gnorm 0.217 3.12s mem 81.1GB +step 1517/5000 loss 0.2439 (w 0.2117 mse 0.2016 t 760 new 0.21) lr 1.00e-05 gnorm 0.166 3.56s mem 81.1GB +step 1518/5000 loss 0.2358 (w 0.2271 mse 0.2268 t 917 new 0.21) lr 1.00e-05 gnorm 0.142 3.12s mem 81.1GB +step 1519/5000 loss 0.2725 (w 0.2274 mse 0.2256 t 659 new 0.29) lr 1.00e-05 gnorm 0.141 3.13s mem 81.1GB +step 1520/5000 loss 0.3058 (w 0.2162 mse 0.2246 t 301 new 0.06) lr 1.00e-05 gnorm 0.199 3.14s mem 81.1GB +step 1521/5000 loss 0.1799 (w 0.1220 mse 0.1258 t 871 new 0.21) lr 1.00e-05 gnorm 0.175 2.85s mem 81.1GB +step 1522/5000 loss 0.2595 (w 0.2867 mse 0.2825 t 958 new 0.17) lr 1.00e-05 gnorm 0.160 3.33s mem 81.1GB +step 1523/5000 loss 0.3105 (w 0.3073 mse 0.3075 t 568 new 0.17) lr 1.00e-05 gnorm 0.384 3.40s mem 81.1GB +step 1524/5000 loss 0.2863 (w 0.2329 mse 0.2280 t 586 new 0.20) lr 1.00e-05 gnorm 0.163 3.41s mem 81.1GB +step 1525/5000 loss 0.2756 (w 0.2272 mse 0.2372 t 959 new 0.19) lr 1.00e-05 gnorm 0.139 3.06s mem 81.1GB +step 1526/5000 loss 0.4556 (w 0.2802 mse 0.2634 t 709 new 0.25) lr 1.00e-05 gnorm 0.525 3.11s mem 81.1GB +step 1527/5000 loss 0.2398 (w 0.1710 mse 0.1723 t 727 new 0.22) lr 1.00e-05 gnorm 0.186 2.85s mem 81.1GB +step 1528/5000 loss 0.2508 (w 0.2652 mse 0.2700 t 710 new 0.14) lr 1.00e-05 gnorm 0.131 3.13s mem 81.1GB +step 1529/5000 loss 0.3090 (w 0.2627 mse 0.2574 t 626 new 0.25) lr 1.00e-05 gnorm 0.156 3.38s mem 81.1GB +step 1530/5000 loss 0.1966 (w 0.2576 mse 0.2505 t 634 new 0.21) lr 1.00e-05 gnorm 0.240 3.16s mem 81.1GB +step 1531/5000 loss 0.1580 (w 0.2922 mse 0.2813 t 939 new 0.19) lr 1.00e-05 gnorm 0.369 3.09s mem 81.1GB +step 1532/5000 loss 0.1977 (w 0.1322 mse 0.1423 t 925 new 0.10) lr 1.00e-05 gnorm 0.189 3.14s mem 81.1GB +step 1533/5000 loss 0.2736 (w 0.2721 mse 0.2665 t 995 new 0.24) lr 1.00e-05 gnorm 0.189 2.85s mem 81.1GB +step 1534/5000 loss 0.3280 (w 0.2032 mse 0.1992 t 728 new 0.16) lr 1.00e-05 gnorm 0.246 3.16s mem 81.1GB +step 1535/5000 loss 0.1933 (w 0.2480 mse 0.2384 t 875 new 0.24) lr 1.00e-05 gnorm 0.180 3.05s mem 81.1GB +step 1536/5000 loss 0.0817 (w 0.2630 mse 0.2483 t 856 new 0.13) lr 1.00e-05 gnorm 0.218 3.17s mem 81.1GB +step 1537/5000 loss 0.2593 (w 0.2048 mse 0.2033 t 890 new 0.22) lr 1.00e-05 gnorm 0.168 3.25s mem 81.1GB +step 1538/5000 loss 0.2098 (w 0.2258 mse 0.2186 t 813 new 0.29) lr 1.00e-05 gnorm 0.309 2.85s mem 81.1GB +step 1539/5000 loss 0.3174 (w 0.1257 mse 0.1272 t 781 new 0.21) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +step 1540/5000 loss 0.2259 (w 0.2399 mse 0.2295 t 961 new 0.20) lr 1.00e-05 gnorm 0.181 3.40s mem 81.1GB +step 1541/5000 loss 0.2529 (w 0.4841 mse 0.4589 t 994 new 0.23) lr 1.00e-05 gnorm 0.162 3.08s mem 81.1GB +step 1542/5000 loss 0.3308 (w 0.1123 mse 0.1159 t 669 new 0.13) lr 1.00e-05 gnorm 0.171 3.09s mem 81.1GB +step 1543/5000 loss 0.1996 (w 0.1417 mse 0.1620 t 996 new 0.22) lr 1.00e-05 gnorm 0.152 3.40s mem 81.1GB +step 1544/5000 loss 0.3658 (w 0.2451 mse 0.2228 t 743 new 0.22) lr 1.00e-05 gnorm 0.177 2.85s mem 81.1GB +step 1545/5000 loss 0.3495 (w 0.2388 mse 0.2494 t 967 new 0.16) lr 1.00e-05 gnorm 2.893 3.05s mem 81.1GB +step 1546/5000 loss 0.2128 (w 0.2146 mse 0.2081 t 506 new 0.21) lr 1.00e-05 gnorm 0.221 3.38s mem 81.1GB +step 1547/5000 loss 0.2074 (w 0.1198 mse 0.1263 t 938 new 0.06) lr 1.00e-05 gnorm 0.190 3.13s mem 81.1GB +step 1548/5000 loss 0.1920 (w 0.2518 mse 0.2721 t 669 new 0.15) lr 1.00e-05 gnorm 0.194 3.12s mem 81.1GB +step 1549/5000 loss 0.2588 (w 0.2605 mse 0.2541 t 932 new 0.28) lr 1.00e-05 gnorm 0.317 3.14s mem 81.1GB +step 1550/5000 loss 0.1170 (w 0.4757 mse 0.4601 t 981 new 0.22) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +step 1551/5000 loss 0.3811 (w 0.1930 mse 0.2115 t 390 new 0.28) lr 1.00e-05 gnorm 0.148 3.09s mem 81.1GB +step 1552/5000 loss 0.2364 (w 0.1767 mse 0.1758 t 826 new 0.13) lr 1.00e-05 gnorm 0.145 3.14s mem 81.1GB +step 1553/5000 loss 0.2834 (w 0.2524 mse 0.2439 t 734 new 0.22) lr 1.00e-05 gnorm 0.154 3.37s mem 81.1GB +step 1554/5000 loss 0.1787 (w 0.0563 mse 0.0668 t 842 new 0.17) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +step 1555/5000 loss 0.2788 (w 0.3937 mse 0.3907 t 955 new 0.20) lr 1.00e-05 gnorm 0.215 3.14s mem 81.1GB +step 1556/5000 loss 0.2972 (w 0.1310 mse 0.1411 t 777 new 0.23) lr 1.00e-05 gnorm 0.208 2.85s mem 81.1GB +step 1557/5000 loss 0.1444 (w 0.2350 mse 0.2303 t 998 new 0.18) lr 1.00e-05 gnorm 0.149 3.13s mem 81.1GB +step 1558/5000 loss 0.2048 (w 0.4469 mse 0.4342 t 994 new 0.23) lr 1.00e-05 gnorm 0.174 3.16s mem 81.1GB +step 1559/5000 loss 0.1780 (w 0.3085 mse 0.2968 t 984 new 0.21) lr 1.00e-05 gnorm 0.157 3.41s mem 81.1GB +step 1560/5000 loss 0.2774 (w 0.2333 mse 0.2255 t 868 new 0.26) lr 1.00e-05 gnorm 0.214 3.20s mem 81.1GB +step 1561/5000 loss 0.1743 (w 0.1528 mse 0.1488 t 866 new 0.19) lr 1.00e-05 gnorm 0.189 3.05s mem 81.1GB +step 1562/5000 loss 0.1922 (w 0.2348 mse 0.2292 t 850 new 0.16) lr 1.00e-05 gnorm 1.148 2.84s mem 81.1GB +step 1563/5000 loss 0.2296 (w 0.2084 mse 0.2149 t 997 new 0.18) lr 1.00e-05 gnorm 0.191 3.43s mem 81.1GB +step 1564/5000 loss 0.1326 (w 0.2337 mse 0.2221 t 808 new 0.23) lr 1.00e-05 gnorm 0.165 3.07s mem 81.1GB +step 1565/5000 loss 0.3005 (w 0.4793 mse 0.4552 t 998 new 0.19) lr 1.00e-05 gnorm 0.183 3.28s mem 81.1GB +step 1566/5000 loss 0.2093 (w 0.2715 mse 0.2857 t 954 new 0.20) lr 1.00e-05 gnorm 0.383 3.07s mem 81.1GB +step 1567/5000 loss 0.0952 (w 0.2065 mse 0.2120 t 981 new 0.24) lr 1.00e-05 gnorm 0.107 3.09s mem 81.1GB +step 1568/5000 loss 0.2719 (w 0.2756 mse 0.2634 t 621 new 0.18) lr 1.00e-05 gnorm 0.147 2.85s mem 81.1GB +step 1569/5000 loss 0.2735 (w 0.1723 mse 0.1613 t 777 new 0.20) lr 1.00e-05 gnorm 0.215 3.41s mem 81.1GB +step 1570/5000 loss 0.3228 (w 0.2784 mse 0.2660 t 969 new 0.12) lr 1.00e-05 gnorm 0.179 3.11s mem 81.1GB +step 1571/5000 loss 0.2813 (w 0.1720 mse 0.1739 t 779 new 0.22) lr 1.00e-05 gnorm 0.147 3.13s mem 81.1GB +step 1572/5000 loss 0.2126 (w 0.1332 mse 0.1351 t 865 new 0.26) lr 1.00e-05 gnorm 0.685 3.02s mem 81.1GB +step 1573/5000 loss 0.2529 (w 0.2047 mse 0.1876 t 851 new 0.21) lr 1.00e-05 gnorm 0.169 3.14s mem 81.1GB +step 1574/5000 loss 0.3051 (w 0.1456 mse 0.1435 t 782 new 0.22) lr 1.00e-05 gnorm 0.275 2.85s mem 81.1GB +step 1575/5000 loss 0.2689 (w 0.3300 mse 0.3239 t 953 new 0.23) lr 1.00e-05 gnorm 0.167 3.38s mem 81.1GB +step 1576/5000 loss 0.1921 (w 0.1730 mse 0.1671 t 883 new 0.22) lr 1.00e-05 gnorm 0.144 3.62s mem 81.1GB +step 1577/5000 loss 0.3139 (w 0.2109 mse 0.2045 t 852 new 0.21) lr 1.00e-05 gnorm 0.164 3.08s mem 81.1GB +step 1578/5000 loss 0.2285 (w 0.1570 mse 0.1643 t 962 new 0.17) lr 1.00e-05 gnorm 0.263 3.02s mem 81.1GB +step 1579/5000 loss 0.1792 (w 0.3523 mse 0.3251 t 959 new 0.24) lr 1.00e-05 gnorm 0.123 3.14s mem 81.1GB +step 1580/5000 loss 0.1477 (w 0.0844 mse 0.0898 t 795 new 0.08) lr 1.00e-05 gnorm 0.188 2.84s mem 81.1GB +step 1581/5000 loss 0.2919 (w 0.3174 mse 0.3088 t 977 new 0.30) lr 1.00e-05 gnorm 0.183 3.12s mem 81.1GB +step 1582/5000 loss 0.1711 (w 0.2892 mse 0.2829 t 964 new 0.20) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +step 1583/5000 loss 0.3149 (w 0.0802 mse 0.0814 t 776 new 0.17) lr 1.00e-05 gnorm 0.156 3.11s mem 81.1GB +step 1584/5000 loss 0.1761 (w 0.1994 mse 0.1855 t 888 new 0.18) lr 1.00e-05 gnorm 0.194 3.07s mem 81.1GB +step 1585/5000 loss 0.2912 (w 0.6916 mse 0.6908 t 127 new 0.07) lr 1.00e-05 gnorm 0.239 3.07s mem 81.1GB +step 1586/5000 loss 0.3749 (w 0.2724 mse 0.2561 t 951 new 0.25) lr 1.00e-05 gnorm 0.248 3.12s mem 81.1GB +step 1587/5000 loss 0.3380 (w 0.2661 mse 0.2658 t 533 new 0.19) lr 1.00e-05 gnorm 0.616 3.10s mem 81.1GB +step 1588/5000 loss 0.1665 (w 0.1123 mse 0.1173 t 695 new 0.12) lr 1.00e-05 gnorm 0.269 3.33s mem 81.1GB +step 1589/5000 loss 0.1835 (w 0.3363 mse 0.3211 t 961 new 0.28) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +step 1590/5000 loss 0.2289 (w 0.1582 mse 0.1687 t 920 new 0.22) lr 1.00e-05 gnorm 0.346 2.85s mem 81.1GB +step 1591/5000 loss 0.2767 (w 0.1745 mse 0.1740 t 849 new 0.21) lr 1.00e-05 gnorm 0.266 3.12s mem 81.1GB +step 1592/5000 loss 0.1784 (w 0.4070 mse 0.3908 t 979 new 0.15) lr 1.00e-05 gnorm 0.128 3.16s mem 81.1GB +step 1593/5000 loss 0.2842 (w 0.2606 mse 0.2533 t 570 new 0.15) lr 1.00e-05 gnorm 0.339 3.11s mem 81.1GB +step 1594/5000 loss 0.1001 (w 0.3033 mse 0.3063 t 990 new 0.11) lr 1.00e-05 gnorm 0.399 3.44s mem 81.1GB +step 1595/5000 loss 0.2677 (w 0.0934 mse 0.0978 t 875 new 0.08) lr 1.00e-05 gnorm 0.528 3.07s mem 81.1GB +step 1596/5000 loss 0.2145 (w 0.2149 mse 0.2169 t 978 new 0.18) lr 1.00e-05 gnorm 0.188 3.16s mem 81.1GB +step 1597/5000 loss 0.2060 (w 0.3412 mse 0.3417 t 984 new 0.21) lr 1.00e-05 gnorm 0.126 2.87s mem 81.1GB +step 1598/5000 loss 0.3345 (w 0.2114 mse 0.2078 t 809 new 0.22) lr 1.00e-05 gnorm 0.171 3.10s mem 81.1GB +step 1599/5000 loss 0.1622 (w 0.1212 mse 0.1333 t 802 new 0.20) lr 1.00e-05 gnorm 0.283 3.14s mem 81.1GB +step 1600/5000 loss 0.2173 (w 0.2854 mse 0.2799 t 916 new 0.17) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +step 1601/5000 loss 0.2119 (w 0.1737 mse 0.1680 t 917 new 0.15) lr 1.00e-05 gnorm 0.276 3.09s mem 81.1GB +step 1602/5000 loss 0.3075 (w 0.4894 mse 0.4854 t 244 new 0.21) lr 1.00e-05 gnorm 0.321 3.07s mem 81.1GB +step 1603/5000 loss 0.2476 (w 0.2165 mse 0.2053 t 824 new 0.19) lr 1.00e-05 gnorm 0.786 2.85s mem 81.1GB +step 1604/5000 loss 0.1601 (w 0.4406 mse 0.4280 t 988 new 0.22) lr 1.00e-05 gnorm 0.178 3.13s mem 81.1GB +step 1605/5000 loss 0.0870 (w 0.2940 mse 0.2829 t 959 new 0.23) lr 1.00e-05 gnorm 0.159 3.14s mem 81.1GB +step 1606/5000 loss 0.0946 (w 0.1550 mse 0.1495 t 808 new 0.27) lr 1.00e-05 gnorm 0.115 3.13s mem 81.1GB +step 1607/5000 loss 0.3731 (w 0.2435 mse 0.2394 t 657 new 0.19) lr 1.00e-05 gnorm 0.249 3.07s mem 81.1GB +step 1608/5000 loss 0.2275 (w 0.2568 mse 0.2577 t 973 new 0.08) lr 1.00e-05 gnorm 0.148 3.08s mem 81.1GB +step 1609/5000 loss 0.3065 (w 0.1116 mse 0.1167 t 788 new 0.27) lr 1.00e-05 gnorm 0.229 3.15s mem 81.1GB +step 1610/5000 loss 0.2140 (w 0.1880 mse 0.2040 t 998 new 0.17) lr 1.00e-05 gnorm 0.167 3.69s mem 81.1GB +step 1611/5000 loss 0.1254 (w 0.2096 mse 0.1973 t 838 new 0.18) lr 1.00e-05 gnorm 0.146 3.33s mem 81.1GB +step 1612/5000 loss 0.1487 (w 0.1862 mse 0.1827 t 785 new 0.21) lr 1.00e-05 gnorm 0.137 3.33s mem 81.1GB +step 1613/5000 loss 0.2950 (w 0.1801 mse 0.1858 t 777 new 0.19) lr 1.00e-05 gnorm 0.187 3.10s mem 81.1GB +step 1614/5000 loss 0.2366 (w 0.1693 mse 0.1701 t 774 new 0.22) lr 1.00e-05 gnorm 0.155 3.07s mem 81.1GB +step 1615/5000 loss 0.1560 (w 0.2735 mse 0.2616 t 975 new 0.25) lr 1.00e-05 gnorm 0.257 3.11s mem 81.1GB +step 1616/5000 loss 0.1263 (w 0.2318 mse 0.2304 t 977 new 0.20) lr 1.00e-05 gnorm 0.122 3.07s mem 81.1GB +step 1617/5000 loss 0.2259 (w 0.2690 mse 0.2649 t 503 new 0.26) lr 1.00e-05 gnorm 0.159 3.33s mem 81.1GB +step 1618/5000 loss 0.2348 (w 0.2558 mse 0.2412 t 918 new 0.18) lr 1.00e-05 gnorm 0.234 3.39s mem 81.1GB +step 1619/5000 loss 0.1728 (w 0.2937 mse 0.2769 t 989 new 0.27) lr 1.00e-05 gnorm 0.111 2.86s mem 81.1GB +step 1620/5000 loss 0.3285 (w 0.2650 mse 0.2740 t 846 new 0.21) lr 1.00e-05 gnorm 0.249 3.07s mem 81.1GB +step 1621/5000 loss 0.2567 (w 0.1081 mse 0.1089 t 943 new 0.13) lr 1.00e-05 gnorm 0.178 3.15s mem 81.1GB +step 1622/5000 loss 0.2796 (w 0.3079 mse 0.2848 t 688 new 0.20) lr 1.00e-05 gnorm 0.392 3.09s mem 81.1GB +step 1623/5000 loss 0.1269 (w 0.2500 mse 0.2438 t 884 new 0.20) lr 1.00e-05 gnorm 0.204 3.28s mem 81.1GB +step 1624/5000 loss 0.3817 (w 0.1500 mse 0.1504 t 553 new 0.17) lr 1.00e-05 gnorm 0.214 3.31s mem 81.1GB +step 1625/5000 loss 0.1976 (w 0.1332 mse 0.1231 t 850 new 0.13) lr 1.00e-05 gnorm 3.843 2.85s mem 81.1GB +step 1626/5000 loss 0.1492 (w 0.2278 mse 0.2192 t 659 new 0.19) lr 1.00e-05 gnorm 0.109 3.11s mem 81.1GB +step 1627/5000 loss 0.2780 (w 0.2031 mse 0.2145 t 557 new 0.19) lr 1.00e-05 gnorm 0.309 3.13s mem 81.1GB +step 1628/5000 loss 0.2513 (w 0.1905 mse 0.1939 t 692 new 0.13) lr 1.00e-05 gnorm 0.275 3.11s mem 81.1GB +step 1629/5000 loss 0.1385 (w 0.3527 mse 0.3451 t 963 new 0.18) lr 1.00e-05 gnorm 0.148 3.52s mem 81.1GB +step 1630/5000 loss 0.2700 (w 0.2033 mse 0.2034 t 728 new 0.13) lr 1.00e-05 gnorm 0.159 3.14s mem 81.1GB +step 1631/5000 loss 0.1560 (w 0.1859 mse 0.1836 t 942 new 0.22) lr 1.00e-05 gnorm 0.269 2.86s mem 81.1GB +step 1632/5000 loss 0.2735 (w 0.1892 mse 0.1802 t 894 new 0.25) lr 1.00e-05 gnorm 0.160 3.09s mem 81.1GB +step 1633/5000 loss 0.2556 (w 0.2776 mse 0.2941 t 973 new 0.22) lr 1.00e-05 gnorm 0.450 3.08s mem 81.1GB +step 1634/5000 loss 0.1612 (w 0.2668 mse 0.2686 t 926 new 0.18) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +step 1635/5000 loss 0.0715 (w 0.2499 mse 0.2407 t 984 new 0.22) lr 1.00e-05 gnorm 0.117 3.53s mem 81.1GB +step 1636/5000 loss 0.2879 (w 0.2805 mse 0.2845 t 998 new 0.24) lr 1.00e-05 gnorm 0.201 3.09s mem 81.1GB +step 1637/5000 loss 0.1608 (w 0.2795 mse 0.2835 t 976 new 0.22) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +step 1638/5000 loss 0.2938 (w 0.2010 mse 0.2021 t 586 new 0.11) lr 1.00e-05 gnorm 0.179 3.11s mem 81.1GB +step 1639/5000 loss 0.3634 (w 0.2762 mse 0.2752 t 592 new 0.22) lr 1.00e-05 gnorm 0.231 3.08s mem 81.1GB +step 1640/5000 loss 0.1270 (w 0.3035 mse 0.3137 t 989 new 0.14) lr 1.00e-05 gnorm 0.213 3.06s mem 81.1GB +step 1641/5000 loss 0.2402 (w 0.4960 mse 0.4433 t 994 new 0.20) lr 1.00e-05 gnorm 0.167 3.40s mem 81.1GB +step 1642/5000 loss 0.2480 (w 0.1389 mse 0.1439 t 863 new 0.11) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +step 1643/5000 loss 0.3712 (w 0.4757 mse 0.4700 t 259 new 0.16) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +step 1644/5000 loss 0.2749 (w 0.3880 mse 0.3804 t 283 new 0.25) lr 1.00e-05 gnorm 0.511 2.85s mem 81.1GB +step 1645/5000 loss 0.2116 (w 0.2276 mse 0.2177 t 804 new 0.27) lr 1.00e-05 gnorm 0.288 3.07s mem 81.1GB +step 1646/5000 loss 0.2207 (w 0.2662 mse 0.2436 t 862 new 0.24) lr 1.00e-05 gnorm 0.152 3.10s mem 81.1GB +step 1647/5000 loss 0.2194 (w 0.2437 mse 0.2430 t 961 new 0.12) lr 1.00e-05 gnorm 0.230 3.42s mem 81.1GB +step 1648/5000 loss 0.2480 (w 0.2149 mse 0.2082 t 917 new 0.27) lr 1.00e-05 gnorm 0.240 2.85s mem 81.1GB +step 1649/5000 loss 0.1961 (w 0.1476 mse 0.1482 t 816 new 0.18) lr 1.00e-05 gnorm 0.221 3.05s mem 81.1GB +step 1650/5000 loss 0.2551 (w 0.2737 mse 0.2584 t 689 new 0.24) lr 1.00e-05 gnorm 0.138 2.85s mem 81.1GB +step 1651/5000 loss 0.1454 (w 0.1382 mse 0.1235 t 941 new 0.17) lr 1.00e-05 gnorm 0.232 3.28s mem 81.1GB +step 1652/5000 loss 0.2177 (w 0.2404 mse 0.2390 t 875 new 0.15) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +step 1653/5000 loss 0.3322 (w 0.3017 mse 0.2931 t 898 new 0.22) lr 1.00e-05 gnorm 0.177 3.54s mem 81.1GB +step 1654/5000 loss 0.3225 (w 0.1625 mse 0.1787 t 939 new 0.16) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +step 1655/5000 loss 0.2893 (w 0.4602 mse 0.4294 t 991 new 0.25) lr 1.00e-05 gnorm 0.174 3.10s mem 81.1GB +step 1656/5000 loss 0.1830 (w 0.3697 mse 0.3792 t 200 new 0.21) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +step 1657/5000 loss 0.1785 (w 0.1426 mse 0.1427 t 669 new 0.17) lr 1.00e-05 gnorm 0.139 3.29s mem 81.1GB +step 1658/5000 loss 0.3891 (w 0.3043 mse 0.2892 t 983 new 0.22) lr 1.00e-05 gnorm 0.201 3.09s mem 81.1GB +step 1659/5000 loss 0.2926 (w 0.1927 mse 0.1867 t 904 new 0.24) lr 1.00e-05 gnorm 0.129 3.52s mem 81.1GB +step 1660/5000 loss 0.1942 (w 0.5836 mse 0.5780 t 990 new 0.27) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +step 1661/5000 loss 0.3664 (w 0.3534 mse 0.3440 t 484 new 0.30) lr 1.00e-05 gnorm 0.172 3.19s mem 81.1GB +step 1662/5000 loss 0.1105 (w 0.1834 mse 0.1728 t 891 new 0.13) lr 1.00e-05 gnorm 0.163 2.86s mem 81.1GB +step 1663/5000 loss 0.2259 (w 0.3838 mse 0.3900 t 319 new 0.26) lr 1.00e-05 gnorm 0.420 3.33s mem 81.1GB +step 1664/5000 loss 0.2198 (w 0.4023 mse 0.3798 t 996 new 0.23) lr 1.00e-05 gnorm 0.205 3.07s mem 81.1GB +step 1665/5000 loss 0.2793 (w 0.3554 mse 0.3495 t 987 new 0.21) lr 1.00e-05 gnorm 0.131 3.51s mem 81.1GB +step 1666/5000 loss 0.2770 (w 0.3538 mse 0.3339 t 976 new 0.24) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +step 1667/5000 loss 0.4526 (w 0.3458 mse 0.3513 t 340 new 0.19) lr 1.00e-05 gnorm 0.494 3.19s mem 81.1GB +step 1668/5000 loss 0.1918 (w 0.3343 mse 0.3027 t 950 new 0.27) lr 1.00e-05 gnorm 0.141 2.85s mem 81.1GB +step 1669/5000 loss 0.2260 (w 0.2830 mse 0.2724 t 1000 new 0.25) lr 1.00e-05 gnorm 0.342 3.16s mem 81.1GB +step 1670/5000 loss 0.2923 (w 0.3190 mse 0.3076 t 722 new 0.22) lr 1.00e-05 gnorm 0.168 3.35s mem 81.1GB +step 1671/5000 loss 0.3773 (w 0.2000 mse 0.2191 t 998 new 0.22) lr 1.00e-05 gnorm 0.940 3.39s mem 81.1GB +step 1672/5000 loss 0.0781 (w 0.3044 mse 0.2978 t 932 new 0.14) lr 1.00e-05 gnorm 0.107 2.86s mem 81.1GB +step 1673/5000 loss 0.2810 (w 0.1842 mse 0.1805 t 904 new 0.13) lr 1.00e-05 gnorm 0.132 3.12s mem 81.1GB +step 1674/5000 loss 0.2892 (w 0.3479 mse 0.3511 t 983 new 0.18) lr 1.00e-05 gnorm 0.182 3.13s mem 81.1GB +step 1675/5000 loss 0.2949 (w 0.2433 mse 0.2399 t 557 new 0.09) lr 1.00e-05 gnorm 0.164 3.09s mem 81.1GB +step 1676/5000 loss 0.2258 (w 0.3506 mse 0.3398 t 946 new 0.16) lr 1.00e-05 gnorm 0.207 3.32s mem 81.1GB +step 1677/5000 loss 0.1566 (w 0.2830 mse 0.2605 t 972 new 0.28) lr 1.00e-05 gnorm 0.135 3.17s mem 81.1GB +step 1678/5000 loss 0.2556 (w 0.2135 mse 0.1949 t 993 new 0.17) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +step 1679/5000 loss 0.1374 (w 0.2457 mse 0.2541 t 752 new 0.20) lr 1.00e-05 gnorm 0.141 3.16s mem 81.1GB +step 1680/5000 loss 0.3026 (w 0.1971 mse 0.1911 t 822 new 0.27) lr 1.00e-05 gnorm 0.113 3.05s mem 81.1GB +step 1681/5000 loss 0.3571 (w 0.2408 mse 0.2360 t 959 new 0.19) lr 1.00e-05 gnorm 10.182 3.40s mem 81.1GB +step 1682/5000 loss 0.1238 (w 0.1743 mse 0.1657 t 920 new 0.24) lr 1.00e-05 gnorm 0.234 3.13s mem 81.1GB +step 1683/5000 loss 0.2552 (w 0.1841 mse 0.1924 t 920 new 0.21) lr 1.00e-05 gnorm 0.800 3.25s mem 81.1GB +step 1684/5000 loss 0.2375 (w 0.1477 mse 0.1449 t 930 new 0.25) lr 1.00e-05 gnorm 0.181 3.10s mem 81.1GB +step 1685/5000 loss 0.1892 (w 0.2368 mse 0.2312 t 977 new 0.23) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +step 1686/5000 loss 0.1627 (w 0.1796 mse 0.1900 t 988 new 0.12) lr 1.00e-05 gnorm 0.156 3.15s mem 81.1GB +step 1687/5000 loss 0.2750 (w 0.2836 mse 0.2691 t 902 new 0.18) lr 1.00e-05 gnorm 0.228 3.13s mem 81.1GB +step 1688/5000 loss 0.2083 (w 0.2374 mse 0.2192 t 966 new 0.10) lr 1.00e-05 gnorm 0.156 3.14s mem 81.1GB +step 1689/5000 loss 0.4114 (w 0.1707 mse 0.1686 t 793 new 0.19) lr 1.00e-05 gnorm 0.165 3.08s mem 81.1GB +step 1690/5000 loss 0.2913 (w 0.2470 mse 0.2450 t 523 new 0.19) lr 1.00e-05 gnorm 0.107 3.15s mem 81.1GB +step 1691/5000 loss 0.3656 (w 0.2774 mse 0.2670 t 872 new 0.19) lr 1.00e-05 gnorm 0.201 2.86s mem 81.1GB +step 1692/5000 loss 0.2856 (w 0.2455 mse 0.2210 t 915 new 0.28) lr 1.00e-05 gnorm 0.132 3.15s mem 81.1GB +step 1693/5000 loss 0.2173 (w 0.2221 mse 0.2256 t 985 new 0.16) lr 1.00e-05 gnorm 0.221 3.12s mem 81.1GB +step 1694/5000 loss 0.3081 (w 0.2688 mse 0.2533 t 542 new 0.26) lr 1.00e-05 gnorm 0.162 3.18s mem 81.1GB +step 1695/5000 loss 0.2814 (w 0.2662 mse 0.2470 t 981 new 0.16) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +step 1696/5000 loss 0.1791 (w 0.1649 mse 0.1735 t 795 new 0.22) lr 1.00e-05 gnorm 0.202 3.07s mem 81.1GB +step 1697/5000 loss 0.3850 (w 0.1543 mse 0.1614 t 404 new 0.21) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +step 1698/5000 loss 0.3690 (w 0.2224 mse 0.2180 t 915 new 0.16) lr 1.00e-05 gnorm 0.154 3.32s mem 81.1GB +step 1699/5000 loss 0.2268 (w 0.1640 mse 0.1636 t 959 new 0.27) lr 1.00e-05 gnorm 0.115 3.13s mem 81.1GB +step 1700/5000 loss 0.2757 (w 0.2744 mse 0.2749 t 981 new 0.21) lr 1.00e-05 gnorm 0.144 3.20s mem 81.1GB +step 1701/5000 loss 0.2554 (w 0.2809 mse 0.2642 t 979 new 0.23) lr 1.00e-05 gnorm 0.255 2.85s mem 81.1GB +step 1702/5000 loss 0.2682 (w 0.2819 mse 0.2774 t 453 new 0.17) lr 1.00e-05 gnorm 0.245 3.09s mem 81.1GB +step 1703/5000 loss 0.3014 (w 0.2286 mse 0.2245 t 749 new 0.24) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +step 1704/5000 loss 0.1811 (w 0.1643 mse 0.1579 t 888 new 0.10) lr 1.00e-05 gnorm 0.124 3.42s mem 81.1GB +step 1705/5000 loss 0.1147 (w 0.3744 mse 0.3797 t 988 new 0.18) lr 1.00e-05 gnorm 1.049 3.03s mem 81.1GB +step 1706/5000 loss 0.2022 (w 0.1311 mse 0.1157 t 684 new 0.13) lr 1.00e-05 gnorm 0.141 4.60s mem 81.1GB +step 1707/5000 loss 0.2796 (w 0.1997 mse 0.1861 t 980 new 0.21) lr 1.00e-05 gnorm 0.163 3.05s mem 81.1GB +step 1708/5000 loss 0.3854 (w 0.2571 mse 0.2470 t 523 new 0.18) lr 1.00e-05 gnorm 0.122 2.85s mem 81.1GB +step 1709/5000 loss 0.2587 (w 0.2374 mse 0.2259 t 954 new 0.25) lr 1.00e-05 gnorm 0.157 3.16s mem 81.1GB +step 1710/5000 loss 0.2331 (w 0.2594 mse 0.2460 t 933 new 0.21) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +step 1711/5000 loss 0.2058 (w 0.2895 mse 0.2747 t 594 new 0.22) lr 1.00e-05 gnorm 0.116 3.05s mem 81.1GB +step 1712/5000 loss 0.1546 (w 0.2921 mse 0.2767 t 948 new 0.28) lr 1.00e-05 gnorm 0.165 3.70s mem 81.1GB +step 1713/5000 loss 0.2846 (w 0.2170 mse 0.2132 t 626 new 0.17) lr 1.00e-05 gnorm 0.133 3.08s mem 81.1GB +step 1714/5000 loss 0.1466 (w 0.0969 mse 0.1006 t 858 new 0.09) lr 1.00e-05 gnorm 0.124 2.86s mem 81.1GB +step 1715/5000 loss 0.2134 (w 0.2659 mse 0.2695 t 895 new 0.21) lr 1.00e-05 gnorm 0.181 3.12s mem 81.1GB +step 1716/5000 loss 0.1695 (w 0.5222 mse 0.5278 t 998 new 0.19) lr 1.00e-05 gnorm 0.212 3.07s mem 81.1GB +step 1717/5000 loss 0.3261 (w 0.2341 mse 0.2302 t 930 new 0.22) lr 1.00e-05 gnorm 0.219 3.32s mem 81.1GB +step 1718/5000 loss 0.2263 (w 0.3310 mse 0.3164 t 983 new 0.13) lr 1.00e-05 gnorm 0.206 3.28s mem 81.1GB +step 1719/5000 loss 0.2222 (w 0.2371 mse 0.2414 t 981 new 0.08) lr 1.00e-05 gnorm 0.120 3.11s mem 81.1GB +step 1720/5000 loss 0.3403 (w 0.2826 mse 0.2833 t 969 new 0.23) lr 1.00e-05 gnorm 0.147 2.85s mem 81.1GB +step 1721/5000 loss 0.2098 (w 0.2689 mse 0.2635 t 999 new 0.19) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +step 1722/5000 loss 0.2747 (w 0.1975 mse 0.1957 t 897 new 0.20) lr 1.00e-05 gnorm 0.245 3.10s mem 81.1GB +step 1723/5000 loss 0.1714 (w 0.1349 mse 0.1315 t 870 new 0.24) lr 1.00e-05 gnorm 0.157 3.30s mem 81.1GB +step 1724/5000 loss 0.2387 (w 0.2758 mse 0.2573 t 726 new 0.24) lr 1.00e-05 gnorm 0.146 3.31s mem 81.1GB +step 1725/5000 loss 0.2228 (w 0.2714 mse 0.2516 t 864 new 0.23) lr 1.00e-05 gnorm 0.453 3.10s mem 81.1GB +step 1726/5000 loss 0.4276 (w 0.3063 mse 0.2990 t 523 new 0.21) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +step 1727/5000 loss 0.2426 (w 0.2030 mse 0.2111 t 881 new 0.28) lr 1.00e-05 gnorm 0.141 3.45s mem 81.1GB +step 1728/5000 loss 0.2044 (w 0.2222 mse 0.2136 t 861 new 0.25) lr 1.00e-05 gnorm 0.193 2.85s mem 81.1GB +step 1729/5000 loss 0.2997 (w 0.3080 mse 0.3135 t 998 new 0.25) lr 1.00e-05 gnorm 0.180 3.24s mem 81.1GB +step 1730/5000 loss 0.1558 (w 0.1866 mse 0.1769 t 835 new 0.10) lr 1.00e-05 gnorm 0.126 3.05s mem 81.1GB +step 1731/5000 loss 0.1798 (w 0.3634 mse 0.3406 t 868 new 0.25) lr 1.00e-05 gnorm 0.146 3.11s mem 81.1GB +step 1732/5000 loss 0.1716 (w 0.1389 mse 0.1418 t 864 new 0.22) lr 1.00e-05 gnorm 0.106 2.85s mem 81.1GB +step 1733/5000 loss 0.2262 (w 0.1502 mse 0.1491 t 703 new 0.25) lr 1.00e-05 gnorm 0.123 3.42s mem 81.1GB +step 1734/5000 loss 0.3860 (w 0.1082 mse 0.1154 t 697 new 0.24) lr 1.00e-05 gnorm 0.152 2.85s mem 81.1GB +step 1735/5000 loss 0.2282 (w 0.2381 mse 0.2309 t 639 new 0.21) lr 1.00e-05 gnorm 0.134 3.54s mem 81.1GB +step 1736/5000 loss 0.4575 (w 0.2934 mse 0.2894 t 375 new 0.23) lr 1.00e-05 gnorm 0.211 3.08s mem 81.1GB +step 1737/5000 loss 0.2238 (w 0.3411 mse 0.3427 t 997 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +step 1738/5000 loss 0.3838 (w 0.2354 mse 0.2297 t 580 new 0.21) lr 1.00e-05 gnorm 0.168 2.85s mem 81.1GB +step 1739/5000 loss 0.4704 (w 0.2295 mse 0.2232 t 779 new 0.23) lr 1.00e-05 gnorm 0.187 3.39s mem 81.1GB +step 1740/5000 loss 0.1860 (w 0.2953 mse 0.2985 t 964 new 0.24) lr 1.00e-05 gnorm 0.447 2.85s mem 81.1GB +step 1741/5000 loss 0.3221 (w 0.2928 mse 0.2946 t 982 new 0.22) lr 1.00e-05 gnorm 0.135 3.69s mem 81.1GB +step 1742/5000 loss 0.1749 (w 0.3095 mse 0.3039 t 988 new 0.14) lr 1.00e-05 gnorm 0.125 3.37s mem 81.1GB +step 1743/5000 loss 0.4909 (w 0.3354 mse 0.3708 t 233 new 0.23) lr 1.00e-05 gnorm 0.145 2.86s mem 81.1GB +step 1744/5000 loss 0.2686 (w 0.2711 mse 0.2539 t 823 new 0.24) lr 1.00e-05 gnorm 0.170 3.07s mem 81.1GB +step 1745/5000 loss 0.1209 (w 0.1784 mse 0.1840 t 697 new 0.15) lr 1.00e-05 gnorm 0.108 3.08s mem 81.1GB +step 1746/5000 loss 0.1759 (w 0.1525 mse 0.1502 t 937 new 0.16) lr 1.00e-05 gnorm 0.139 3.07s mem 81.1GB +step 1747/5000 loss 0.4536 (w 0.2986 mse 0.2939 t 473 new 0.21) lr 1.00e-05 gnorm 0.185 3.35s mem 81.1GB +step 1748/5000 loss 0.2263 (w 0.2417 mse 0.2409 t 980 new 0.22) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +step 1749/5000 loss 0.2993 (w 0.2577 mse 0.2415 t 944 new 0.23) lr 1.00e-05 gnorm 0.174 2.86s mem 81.1GB +step 1750/5000 loss 0.2790 (w 0.3272 mse 0.3141 t 960 new 0.22) lr 1.00e-05 gnorm 0.152 3.11s mem 81.1GB +step 1751/5000 loss 0.2591 (w 0.2743 mse 0.2584 t 694 new 0.23) lr 1.00e-05 gnorm 0.151 3.10s mem 81.1GB +step 1752/5000 loss 0.1396 (w 0.1389 mse 0.1343 t 808 new 0.20) lr 1.00e-05 gnorm 0.160 3.10s mem 81.1GB +step 1753/5000 loss 0.0957 (w 0.2754 mse 0.2642 t 979 new 0.19) lr 1.00e-05 gnorm 0.518 3.31s mem 81.1GB +step 1754/5000 loss 0.0776 (w 0.4533 mse 0.4403 t 993 new 0.27) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +step 1755/5000 loss 0.2765 (w 0.1686 mse 0.1705 t 934 new 0.24) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +step 1756/5000 loss 0.3411 (w 0.1998 mse 0.1882 t 802 new 0.21) lr 1.00e-05 gnorm 0.158 3.12s mem 81.1GB +step 1757/5000 loss 0.1239 (w 0.3242 mse 0.3182 t 942 new 0.25) lr 1.00e-05 gnorm 0.118 3.08s mem 81.1GB +step 1758/5000 loss 0.1972 (w 0.3242 mse 0.3131 t 921 new 0.21) lr 1.00e-05 gnorm 0.234 3.46s mem 81.1GB +step 1759/5000 loss 0.1754 (w 0.4055 mse 0.3896 t 379 new 0.19) lr 1.00e-05 gnorm 0.178 3.12s mem 81.1GB +step 1760/5000 loss 0.2155 (w 0.2014 mse 0.1912 t 844 new 0.24) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +step 1761/5000 loss 0.1721 (w 0.1408 mse 0.1475 t 931 new 0.20) lr 1.00e-05 gnorm 0.131 2.85s mem 81.1GB +step 1762/5000 loss 0.1805 (w 0.2534 mse 0.2408 t 884 new 0.16) lr 1.00e-05 gnorm 0.167 3.12s mem 81.1GB +step 1763/5000 loss 0.2188 (w 0.2829 mse 0.2777 t 893 new 0.18) lr 1.00e-05 gnorm 0.148 3.13s mem 81.1GB +step 1764/5000 loss 0.1796 (w 0.2170 mse 0.2343 t 971 new 0.23) lr 1.00e-05 gnorm 0.154 3.40s mem 81.1GB +step 1765/5000 loss 0.1935 (w 0.3041 mse 0.2979 t 939 new 0.22) lr 1.00e-05 gnorm 0.202 3.38s mem 81.1GB +step 1766/5000 loss 0.2171 (w 0.2455 mse 0.2489 t 584 new 0.20) lr 1.00e-05 gnorm 0.201 2.83s mem 81.1GB +step 1767/5000 loss 0.3646 (w 0.3289 mse 0.3318 t 954 new 0.20) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +step 1768/5000 loss 0.2886 (w 0.3245 mse 0.3283 t 996 new 0.23) lr 1.00e-05 gnorm 0.211 3.10s mem 81.1GB +step 1769/5000 loss 0.2490 (w 0.3219 mse 0.3110 t 500 new 0.22) lr 1.00e-05 gnorm 0.122 3.05s mem 81.1GB +step 1770/5000 loss 0.2730 (w 0.2292 mse 0.2225 t 912 new 0.22) lr 1.00e-05 gnorm 0.111 3.41s mem 81.1GB +step 1771/5000 loss 0.1360 (w 0.2736 mse 0.2784 t 998 new 0.21) lr 1.00e-05 gnorm 0.132 3.26s mem 81.1GB +step 1772/5000 loss 0.2111 (w 1.0134 mse 1.0056 t 999 new 0.23) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +step 1773/5000 loss 0.4299 (w 0.1991 mse 0.1919 t 757 new 0.23) lr 1.00e-05 gnorm 0.168 2.85s mem 81.1GB +step 1774/5000 loss 0.2103 (w 0.2686 mse 0.2486 t 872 new 0.23) lr 1.00e-05 gnorm 0.195 3.10s mem 81.1GB +step 1775/5000 loss 0.2848 (w 0.2507 mse 0.2530 t 642 new 0.21) lr 1.00e-05 gnorm 0.166 3.29s mem 81.1GB +step 1776/5000 loss 0.1699 (w 0.3617 mse 0.3595 t 340 new 0.16) lr 1.00e-05 gnorm 0.221 3.21s mem 81.1GB +step 1777/5000 loss 0.2524 (w 0.2519 mse 0.2375 t 975 new 0.20) lr 1.00e-05 gnorm 0.114 3.31s mem 81.1GB +step 1778/5000 loss 0.2166 (w 0.3040 mse 0.2901 t 942 new 0.24) lr 1.00e-05 gnorm 0.165 2.86s mem 81.1GB +step 1779/5000 loss 0.1405 (w 0.2455 mse 0.2299 t 862 new 0.23) lr 1.00e-05 gnorm 0.154 3.13s mem 81.1GB +step 1780/5000 loss 0.2103 (w 0.2922 mse 0.2841 t 716 new 0.19) lr 1.00e-05 gnorm 1.592 3.05s mem 81.1GB +step 1781/5000 loss 0.2002 (w 0.2430 mse 0.2235 t 878 new 0.19) lr 1.00e-05 gnorm 0.162 3.08s mem 81.1GB +step 1782/5000 loss 0.2633 (w 0.2284 mse 0.2076 t 879 new 0.21) lr 1.00e-05 gnorm 0.164 3.50s mem 81.1GB +step 1783/5000 loss 0.1831 (w 0.3143 mse 0.2908 t 492 new 0.17) lr 1.00e-05 gnorm 0.239 3.04s mem 81.1GB +step 1784/5000 loss 0.2233 (w 0.2966 mse 0.2748 t 867 new 0.20) lr 1.00e-05 gnorm 0.191 2.85s mem 81.1GB +step 1785/5000 loss 0.2205 (w 0.2274 mse 0.2215 t 616 new 0.18) lr 1.00e-05 gnorm 0.173 3.12s mem 81.1GB +step 1786/5000 loss 0.3122 (w 0.2941 mse 0.2769 t 833 new 0.21) lr 1.00e-05 gnorm 0.196 3.08s mem 81.1GB +step 1787/5000 loss 0.2760 (w 0.1778 mse 0.1903 t 965 new 0.23) lr 1.00e-05 gnorm 0.124 3.35s mem 81.1GB +step 1788/5000 loss 0.2361 (w 0.3207 mse 0.2983 t 956 new 0.22) lr 1.00e-05 gnorm 0.210 3.20s mem 81.1GB +step 1789/5000 loss 0.1413 (w 0.1718 mse 0.1599 t 911 new 0.25) lr 1.00e-05 gnorm 0.889 3.10s mem 81.1GB +step 1790/5000 loss 0.1928 (w 0.2711 mse 0.2560 t 911 new 0.27) lr 1.00e-05 gnorm 0.154 2.86s mem 81.1GB +step 1791/5000 loss 0.1693 (w 0.1976 mse 0.1848 t 729 new 0.09) lr 1.00e-05 gnorm 0.155 3.05s mem 81.1GB +step 1792/5000 loss 0.2328 (w 0.2941 mse 0.2922 t 986 new 0.24) lr 1.00e-05 gnorm 0.198 3.08s mem 81.1GB +step 1793/5000 loss 0.1940 (w 0.1640 mse 0.1665 t 759 new 0.22) lr 1.00e-05 gnorm 0.175 3.31s mem 81.1GB +step 1794/5000 loss 0.2730 (w 0.1804 mse 0.1742 t 891 new 0.16) lr 1.00e-05 gnorm 0.225 3.39s mem 81.1GB +step 1795/5000 loss 0.2526 (w 0.2873 mse 0.2829 t 631 new 0.24) lr 1.00e-05 gnorm 0.189 3.15s mem 81.1GB +step 1796/5000 loss 0.3293 (w 0.1257 mse 0.1239 t 818 new 0.23) lr 1.00e-05 gnorm 0.179 2.84s mem 81.1GB +step 1797/5000 loss 0.2771 (w 0.1004 mse 0.1167 t 924 new 0.18) lr 1.00e-05 gnorm 0.175 3.06s mem 81.1GB +step 1798/5000 loss 0.2373 (w 0.2324 mse 0.2213 t 926 new 0.20) lr 1.00e-05 gnorm 0.164 3.08s mem 81.1GB +step 1799/5000 loss 0.2054 (w 0.2234 mse 0.2260 t 970 new 0.18) lr 1.00e-05 gnorm 0.124 3.44s mem 81.1GB +step 1800/5000 loss 0.2657 (w 0.3092 mse 0.2926 t 908 new 0.21) lr 1.00e-05 gnorm 0.109 3.65s mem 81.1GB +step 1801/5000 loss 0.1994 (w 0.1939 mse 0.1877 t 883 new 0.19) lr 1.00e-05 gnorm 0.182 3.14s mem 81.1GB +step 1802/5000 loss 0.1637 (w 0.1760 mse 0.1922 t 949 new 0.14) lr 1.00e-05 gnorm 0.295 2.85s mem 81.1GB +step 1803/5000 loss 0.2795 (w 0.1430 mse 0.1364 t 839 new 0.24) lr 1.00e-05 gnorm 0.122 3.11s mem 81.1GB +step 1804/5000 loss 0.3092 (w 0.1781 mse 0.1731 t 680 new 0.24) lr 1.00e-05 gnorm 0.161 3.08s mem 81.1GB +step 1805/5000 loss 0.3783 (w 0.2594 mse 0.2508 t 639 new 0.19) lr 1.00e-05 gnorm 0.143 3.58s mem 81.1GB +step 1806/5000 loss 0.2228 (w 0.1158 mse 0.1169 t 680 new 0.15) lr 1.00e-05 gnorm 0.129 3.30s mem 81.1GB +step 1807/5000 loss 0.2300 (w 0.1541 mse 0.1438 t 953 new 0.15) lr 1.00e-05 gnorm 0.100 3.06s mem 81.1GB +step 1808/5000 loss 0.1614 (w 0.2531 mse 0.2322 t 918 new 0.19) lr 1.00e-05 gnorm 0.192 2.85s mem 81.1GB +step 1809/5000 loss 0.1294 (w 0.1604 mse 0.1556 t 946 new 0.21) lr 1.00e-05 gnorm 0.164 3.04s mem 81.1GB +step 1810/5000 loss 0.3480 (w 0.1369 mse 0.1333 t 698 new 0.08) lr 1.00e-05 gnorm 0.200 3.08s mem 81.1GB +step 1811/5000 loss 0.2644 (w 0.1724 mse 0.1727 t 896 new 0.20) lr 1.00e-05 gnorm 0.182 3.51s mem 81.1GB +step 1812/5000 loss 0.0818 (w 0.1613 mse 0.1692 t 929 new 0.18) lr 1.00e-05 gnorm 0.121 3.15s mem 81.1GB +step 1813/5000 loss 0.1838 (w 0.2415 mse 0.2526 t 973 new 0.15) lr 1.00e-05 gnorm 0.203 3.10s mem 81.1GB +step 1814/5000 loss 0.2095 (w 0.5973 mse 0.5980 t 183 new 0.23) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 1815/5000 loss 0.0804 (w 0.2957 mse 0.2685 t 956 new 0.21) lr 1.00e-05 gnorm 0.167 3.10s mem 81.1GB +step 1816/5000 loss 0.1667 (w 0.2431 mse 0.2445 t 949 new 0.23) lr 1.00e-05 gnorm 0.170 3.08s mem 81.1GB +step 1817/5000 loss 0.0991 (w 0.2050 mse 0.2008 t 851 new 0.15) lr 1.00e-05 gnorm 0.121 3.49s mem 81.1GB +step 1818/5000 loss 0.2330 (w 0.2015 mse 0.2169 t 685 new 0.18) lr 1.00e-05 gnorm 0.198 3.58s mem 81.1GB +step 1819/5000 loss 0.1584 (w 0.2658 mse 0.2564 t 875 new 0.23) lr 1.00e-05 gnorm 0.148 2.85s mem 81.1GB +step 1820/5000 loss 0.1937 (w 0.1849 mse 0.1940 t 873 new 0.22) lr 1.00e-05 gnorm 0.126 3.16s mem 81.1GB +step 1821/5000 loss 0.3990 (w 0.2395 mse 0.2489 t 476 new 0.18) lr 1.00e-05 gnorm 0.224 2.85s mem 81.1GB +step 1822/5000 loss 0.2539 (w 0.2892 mse 0.2911 t 849 new 0.15) lr 1.00e-05 gnorm 0.117 3.12s mem 81.1GB +step 1823/5000 loss 0.3197 (w 0.1564 mse 0.1612 t 631 new 0.17) lr 1.00e-05 gnorm 0.181 3.54s mem 81.1GB +step 1824/5000 loss 0.2364 (w 0.3613 mse 0.3414 t 954 new 0.24) lr 1.00e-05 gnorm 0.195 3.07s mem 81.1GB +step 1825/5000 loss 0.2004 (w 0.2600 mse 0.2503 t 918 new 0.12) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +step 1826/5000 loss 0.2161 (w 0.2597 mse 0.2499 t 958 new 0.17) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +step 1827/5000 loss 0.2661 (w 0.2588 mse 0.2455 t 925 new 0.22) lr 1.00e-05 gnorm 0.145 2.83s mem 81.1GB +step 1828/5000 loss 0.3892 (w 0.1866 mse 0.1744 t 513 new 0.22) lr 1.00e-05 gnorm 0.200 3.11s mem 81.1GB +step 1829/5000 loss 0.1429 (w 0.3185 mse 0.3233 t 960 new 0.11) lr 1.00e-05 gnorm 0.136 3.49s mem 81.1GB +step 1830/5000 loss 0.2958 (w 0.2598 mse 0.2544 t 444 new 0.24) lr 1.00e-05 gnorm 0.176 3.14s mem 81.1GB +step 1831/5000 loss 0.2921 (w 0.2841 mse 0.2803 t 858 new 0.16) lr 1.00e-05 gnorm 0.596 2.86s mem 81.1GB +step 1832/5000 loss 0.1046 (w 0.2824 mse 0.2804 t 998 new 0.17) lr 1.00e-05 gnorm 0.358 3.14s mem 81.1GB +step 1833/5000 loss 0.2053 (w 0.3049 mse 0.3114 t 988 new 0.21) lr 1.00e-05 gnorm 0.204 2.84s mem 81.1GB +step 1834/5000 loss 0.1486 (w 0.2985 mse 0.2741 t 997 new 0.22) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +step 1835/5000 loss 0.1168 (w 0.2061 mse 0.1916 t 855 new 0.25) lr 1.00e-05 gnorm 0.150 3.55s mem 81.1GB +step 1836/5000 loss 0.3313 (w 0.7002 mse 0.6946 t 992 new 0.21) lr 1.00e-05 gnorm 0.156 3.16s mem 81.1GB +step 1837/5000 loss 0.2244 (w 0.2132 mse 0.2028 t 821 new 0.22) lr 1.00e-05 gnorm 0.157 2.85s mem 81.1GB +step 1838/5000 loss 0.2238 (w 0.1820 mse 0.1661 t 865 new 0.23) lr 1.00e-05 gnorm 0.133 3.07s mem 81.1GB +step 1839/5000 loss 0.2214 (w 0.3374 mse 0.3409 t 976 new 0.21) lr 1.00e-05 gnorm 0.187 2.83s mem 81.1GB +step 1840/5000 loss 0.1401 (w 0.1942 mse 0.2115 t 991 new 0.19) lr 1.00e-05 gnorm 0.150 3.42s mem 81.1GB +step 1841/5000 loss 0.1786 (w 0.1784 mse 0.1899 t 993 new 0.12) lr 1.00e-05 gnorm 0.126 3.59s mem 81.1GB +step 1842/5000 loss 0.3427 (w 0.2879 mse 0.2878 t 988 new 0.20) lr 1.00e-05 gnorm 0.313 3.06s mem 81.1GB +step 1843/5000 loss 0.2424 (w 0.3396 mse 0.3329 t 982 new 0.24) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +step 1844/5000 loss 0.1961 (w 0.3239 mse 0.3168 t 979 new 0.24) lr 1.00e-05 gnorm 0.209 3.05s mem 81.1GB +step 1845/5000 loss 0.0960 (w 0.2270 mse 0.2321 t 994 new 0.12) lr 1.00e-05 gnorm 0.193 3.07s mem 81.1GB +step 1846/5000 loss 0.1737 (w 0.3297 mse 0.3150 t 984 new 0.20) lr 1.00e-05 gnorm 0.157 3.03s mem 81.1GB +step 1847/5000 loss 0.2434 (w 0.2491 mse 0.2381 t 830 new 0.24) lr 1.00e-05 gnorm 0.158 3.24s mem 81.1GB +step 1848/5000 loss 0.3254 (w 0.3387 mse 0.3241 t 476 new 0.22) lr 1.00e-05 gnorm 0.167 3.10s mem 81.1GB +step 1849/5000 loss 0.1840 (w 0.1950 mse 0.1954 t 925 new 0.23) lr 1.00e-05 gnorm 0.185 2.84s mem 81.1GB +step 1850/5000 loss 0.2111 (w 0.2473 mse 0.2400 t 873 new 0.26) lr 1.00e-05 gnorm 0.177 3.06s mem 81.1GB +step 1851/5000 loss 0.1275 (w 0.2744 mse 0.2753 t 903 new 0.20) lr 1.00e-05 gnorm 0.132 3.07s mem 81.1GB +step 1852/5000 loss 0.3123 (w 0.3188 mse 0.3106 t 859 new 0.26) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +step 1853/5000 loss 0.0932 (w 0.1380 mse 0.1378 t 766 new 0.21) lr 1.00e-05 gnorm 0.209 3.45s mem 81.1GB +step 1854/5000 loss 0.2661 (w 0.2813 mse 0.2651 t 859 new 0.17) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +step 1855/5000 loss 0.1731 (w 0.2972 mse 0.2918 t 609 new 0.24) lr 1.00e-05 gnorm 0.177 2.83s mem 81.1GB +step 1856/5000 loss 0.1975 (w 0.1549 mse 0.1520 t 894 new 0.10) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +step 1857/5000 loss 0.2858 (w 0.0980 mse 0.1058 t 706 new 0.15) lr 1.00e-05 gnorm 0.167 3.11s mem 81.1GB +step 1858/5000 loss 0.2474 (w 0.3300 mse 0.3134 t 908 new 0.21) lr 1.00e-05 gnorm 0.185 3.30s mem 81.1GB +step 1859/5000 loss 0.1241 (w 0.3773 mse 0.3551 t 991 new 0.25) lr 1.00e-05 gnorm 0.199 3.32s mem 81.1GB +step 1860/5000 loss 0.1999 (w 0.2122 mse 0.2042 t 881 new 0.23) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +step 1861/5000 loss 0.2338 (w 0.2272 mse 0.2151 t 862 new 0.21) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 1862/5000 loss 0.2929 (w 0.1859 mse 0.1841 t 778 new 0.08) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +step 1863/5000 loss 0.0952 (w 0.1915 mse 0.1784 t 838 new 0.10) lr 1.00e-05 gnorm 0.117 3.35s mem 81.1GB +step 1864/5000 loss 0.2104 (w 0.2411 mse 0.2648 t 428 new 0.19) lr 1.00e-05 gnorm 0.154 3.32s mem 81.1GB +step 1865/5000 loss 0.3517 (w 0.1606 mse 0.1573 t 794 new 0.21) lr 1.00e-05 gnorm 0.194 3.43s mem 81.1GB +step 1866/5000 loss 0.2119 (w 0.2261 mse 0.2132 t 967 new 0.22) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +step 1867/5000 loss 0.2648 (w 0.2783 mse 0.2751 t 444 new 0.18) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +step 1868/5000 loss 0.1332 (w 0.3144 mse 0.3000 t 997 new 0.23) lr 1.00e-05 gnorm 0.131 3.09s mem 81.1GB +step 1869/5000 loss 0.4021 (w 0.4143 mse 0.4163 t 375 new 0.28) lr 1.00e-05 gnorm 0.160 3.08s mem 81.1GB +step 1870/5000 loss 0.1804 (w 0.2882 mse 0.2755 t 917 new 0.25) lr 1.00e-05 gnorm 0.141 3.29s mem 81.1GB +step 1871/5000 loss 0.2974 (w 0.3045 mse 0.2870 t 404 new 0.21) lr 1.00e-05 gnorm 0.144 3.36s mem 81.1GB +step 1872/5000 loss 0.1704 (w 0.2950 mse 0.2747 t 889 new 0.15) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 1873/5000 loss 0.2077 (w 0.2144 mse 0.2173 t 999 new 0.20) lr 1.00e-05 gnorm 0.168 2.85s mem 81.1GB +step 1874/5000 loss 0.1812 (w 0.2434 mse 0.2306 t 937 new 0.27) lr 1.00e-05 gnorm 0.133 3.10s mem 81.1GB +step 1875/5000 loss 0.2744 (w 0.2430 mse 0.2414 t 624 new 0.16) lr 1.00e-05 gnorm 0.216 3.28s mem 81.1GB +step 1876/5000 loss 0.1522 (w 0.3516 mse 0.3354 t 960 new 0.22) lr 1.00e-05 gnorm 0.220 3.43s mem 81.1GB +step 1877/5000 loss 0.1890 (w 0.2028 mse 0.1935 t 949 new 0.08) lr 1.00e-05 gnorm 0.151 3.09s mem 81.1GB +step 1878/5000 loss 0.1820 (w 0.5196 mse 0.5173 t 978 new 0.19) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +step 1879/5000 loss 0.1715 (w 0.1729 mse 0.1787 t 819 new 0.11) lr 1.00e-05 gnorm 0.169 2.84s mem 81.1GB +step 1880/5000 loss 0.2158 (w 0.4005 mse 0.3784 t 989 new 0.24) lr 1.00e-05 gnorm 0.176 3.13s mem 81.1GB +step 1881/5000 loss 0.1402 (w 0.1938 mse 0.1960 t 947 new 0.24) lr 1.00e-05 gnorm 0.169 3.41s mem 81.1GB +step 1882/5000 loss 0.2666 (w 0.3062 mse 0.3024 t 999 new 0.21) lr 1.00e-05 gnorm 0.141 3.40s mem 81.1GB +step 1883/5000 loss 0.3896 (w 0.2277 mse 0.2178 t 710 new 0.21) lr 1.00e-05 gnorm 0.176 3.09s mem 81.1GB +step 1884/5000 loss 0.1890 (w 0.1071 mse 0.1066 t 918 new 0.20) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +step 1885/5000 loss 0.1929 (w 0.2718 mse 0.2633 t 663 new 0.26) lr 1.00e-05 gnorm 0.248 2.84s mem 81.1GB +step 1886/5000 loss 0.3531 (w 0.2429 mse 0.2272 t 977 new 0.21) lr 1.00e-05 gnorm 16.421 3.38s mem 81.1GB +step 1887/5000 loss 0.2965 (w 0.2243 mse 0.2619 t 993 new 0.19) lr 1.00e-05 gnorm 0.248 3.10s mem 81.1GB +step 1888/5000 loss 0.1909 (w 0.2464 mse 0.2514 t 922 new 0.13) lr 1.00e-05 gnorm 0.352 3.43s mem 81.1GB +step 1889/5000 loss 0.1642 (w 0.2117 mse 0.1986 t 987 new 0.25) lr 1.00e-05 gnorm 0.240 3.13s mem 81.1GB +step 1890/5000 loss 0.3139 (w 0.2753 mse 0.2824 t 932 new 0.24) lr 1.00e-05 gnorm 0.204 2.83s mem 81.1GB +step 1891/5000 loss 0.2255 (w 0.6670 mse 0.6558 t 995 new 0.17) lr 1.00e-05 gnorm 0.195 2.84s mem 81.1GB +step 1892/5000 loss 0.2661 (w 0.1618 mse 0.1755 t 804 new 0.21) lr 1.00e-05 gnorm 0.155 3.14s mem 81.1GB +step 1893/5000 loss 0.2980 (w 0.2783 mse 0.2888 t 929 new 0.21) lr 1.00e-05 gnorm 0.167 3.04s mem 81.1GB +step 1894/5000 loss 0.3047 (w 0.1780 mse 0.1769 t 841 new 0.19) lr 1.00e-05 gnorm 0.492 3.35s mem 81.1GB +step 1895/5000 loss 0.3358 (w 0.2143 mse 0.2116 t 891 new 0.19) lr 1.00e-05 gnorm 0.126 2.83s mem 81.1GB +step 1896/5000 loss 0.2841 (w 0.1524 mse 0.1426 t 967 new 0.19) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +step 1897/5000 loss 0.2489 (w 0.2021 mse 0.1974 t 679 new 0.26) lr 1.00e-05 gnorm 0.200 3.12s mem 81.1GB +step 1898/5000 loss 0.2486 (w 0.1377 mse 0.1313 t 713 new 0.17) lr 1.00e-05 gnorm 0.132 3.06s mem 81.1GB +step 1899/5000 loss 0.2427 (w 0.2099 mse 0.1956 t 875 new 0.16) lr 1.00e-05 gnorm 0.233 3.28s mem 81.1GB +step 1900/5000 loss 0.2669 (w 0.1358 mse 0.1573 t 926 new 0.19) lr 1.00e-05 gnorm 0.212 3.40s mem 81.1GB +step 1901/5000 loss 0.2034 (w 0.1525 mse 0.1521 t 935 new 0.27) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +step 1902/5000 loss 0.3227 (w 0.1971 mse 0.1924 t 839 new 0.17) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +step 1903/5000 loss 0.1128 (w 0.2705 mse 0.2513 t 934 new 0.13) lr 1.00e-05 gnorm 0.121 3.03s mem 81.1GB +step 1904/5000 loss 0.1264 (w 0.3373 mse 0.3202 t 979 new 0.23) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 1905/5000 loss 0.2413 (w 0.3989 mse 0.3800 t 274 new 0.18) lr 1.00e-05 gnorm 0.151 3.36s mem 81.1GB +step 1906/5000 loss 0.2360 (w 0.4562 mse 0.4433 t 379 new 0.26) lr 1.00e-05 gnorm 0.143 3.32s mem 81.1GB +step 1907/5000 loss 0.1968 (w 0.1523 mse 0.1632 t 977 new 0.12) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +step 1908/5000 loss 0.1402 (w 0.1925 mse 0.1999 t 930 new 0.16) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 1909/5000 loss 0.2601 (w 0.2331 mse 0.2259 t 870 new 0.22) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +step 1910/5000 loss 0.1635 (w 0.2938 mse 0.2683 t 906 new 0.16) lr 1.00e-05 gnorm 0.680 3.11s mem 81.1GB +step 1911/5000 loss 0.1951 (w 0.1538 mse 0.1570 t 761 new 0.22) lr 1.00e-05 gnorm 0.179 3.37s mem 81.1GB +step 1912/5000 loss 0.2596 (w 0.1893 mse 0.1700 t 838 new 0.21) lr 1.00e-05 gnorm 0.169 3.27s mem 81.1GB +step 1913/5000 loss 0.2513 (w 0.2602 mse 0.2564 t 847 new 0.16) lr 1.00e-05 gnorm 0.227 2.82s mem 81.1GB +step 1914/5000 loss 0.2090 (w 0.2058 mse 0.2008 t 889 new 0.22) lr 1.00e-05 gnorm 0.188 2.83s mem 81.1GB +step 1915/5000 loss 0.2241 (w 0.1905 mse 0.1922 t 847 new 0.18) lr 1.00e-05 gnorm 0.195 3.31s mem 81.1GB +step 1916/5000 loss 0.3410 (w 0.4413 mse 0.4428 t 344 new 0.21) lr 1.00e-05 gnorm 0.217 3.36s mem 81.1GB +step 1917/5000 loss 0.1012 (w 0.1338 mse 0.1371 t 859 new 0.14) lr 1.00e-05 gnorm 0.175 3.48s mem 81.1GB +step 1918/5000 loss 0.2996 (w 0.2382 mse 0.2365 t 948 new 0.18) lr 1.00e-05 gnorm 0.194 3.34s mem 81.1GB +step 1919/5000 loss 0.1690 (w 1.0060 mse 1.0908 t 994 new 0.18) lr 1.00e-05 gnorm 0.612 2.84s mem 81.1GB +step 1920/5000 loss 0.3933 (w 0.3924 mse 0.3903 t 437 new 0.14) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +step 1921/5000 loss 0.1344 (w 0.3917 mse 0.3726 t 962 new 0.13) lr 1.00e-05 gnorm 0.129 3.29s mem 81.1GB +step 1922/5000 loss 0.1196 (w 0.3124 mse 0.3084 t 982 new 0.16) lr 1.00e-05 gnorm 0.198 3.30s mem 81.1GB +step 1923/5000 loss 0.1562 (w 0.2520 mse 0.2446 t 929 new 0.19) lr 1.00e-05 gnorm 0.231 3.41s mem 81.1GB +step 1924/5000 loss 0.3110 (w 0.2561 mse 0.2459 t 965 new 0.15) lr 1.00e-05 gnorm 0.174 3.12s mem 81.1GB +step 1925/5000 loss 0.3131 (w 0.2052 mse 0.2090 t 549 new 0.22) lr 1.00e-05 gnorm 0.123 2.83s mem 81.1GB +step 1926/5000 loss 0.3527 (w 0.2042 mse 0.1984 t 945 new 0.14) lr 1.00e-05 gnorm 0.298 2.83s mem 81.1GB +step 1927/5000 loss 0.3110 (w 0.2982 mse 0.3066 t 315 new 0.24) lr 1.00e-05 gnorm 0.185 3.51s mem 81.1GB +step 1928/5000 loss 0.1788 (w 0.2424 mse 0.2240 t 839 new 0.23) lr 1.00e-05 gnorm 0.215 3.06s mem 81.1GB +step 1929/5000 loss 0.1952 (w 0.1374 mse 0.1423 t 944 new 0.10) lr 1.00e-05 gnorm 0.134 3.36s mem 81.1GB +step 1930/5000 loss 0.1493 (w 0.2909 mse 0.2862 t 916 new 0.23) lr 1.00e-05 gnorm 0.134 3.07s mem 81.1GB +step 1931/5000 loss 0.3123 (w 0.1699 mse 0.1599 t 915 new 0.19) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +step 1932/5000 loss 0.2229 (w 0.2115 mse 0.2085 t 939 new 0.27) lr 1.00e-05 gnorm 0.221 2.84s mem 81.1GB +step 1933/5000 loss 0.1116 (w 0.2405 mse 0.2289 t 908 new 0.21) lr 1.00e-05 gnorm 0.142 3.36s mem 81.1GB +step 1934/5000 loss 0.2576 (w 0.6528 mse 0.6728 t 107 new 0.17) lr 1.00e-05 gnorm 0.154 3.09s mem 81.1GB +step 1935/5000 loss 0.1931 (w 0.3010 mse 0.2893 t 982 new 0.22) lr 1.00e-05 gnorm 0.130 3.32s mem 81.1GB +step 1936/5000 loss 0.4065 (w 0.2566 mse 0.2433 t 909 new 0.19) lr 1.00e-05 gnorm 0.159 3.13s mem 81.1GB +step 1937/5000 loss 0.0937 (w 0.3052 mse 0.2990 t 926 new 0.23) lr 1.00e-05 gnorm 0.157 2.82s mem 81.1GB +step 1938/5000 loss 0.0807 (w 0.2945 mse 0.2815 t 998 new 0.24) lr 1.00e-05 gnorm 0.684 3.09s mem 81.1GB +step 1939/5000 loss 0.2725 (w 0.2408 mse 0.2283 t 689 new 0.18) lr 1.00e-05 gnorm 0.168 3.39s mem 81.1GB +step 1940/5000 loss 0.3219 (w 0.2842 mse 0.2681 t 873 new 0.25) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +step 1941/5000 loss 0.2451 (w 0.3469 mse 0.3297 t 933 new 0.22) lr 1.00e-05 gnorm 0.171 3.35s mem 81.1GB +step 1942/5000 loss 0.2203 (w 0.2639 mse 0.2538 t 794 new 0.25) lr 1.00e-05 gnorm 0.156 2.82s mem 81.1GB +step 1943/5000 loss 0.2784 (w 0.1715 mse 0.1629 t 913 new 0.12) lr 1.00e-05 gnorm 0.227 2.83s mem 81.1GB +step 1944/5000 loss 0.1798 (w 0.1913 mse 0.1918 t 956 new 0.11) lr 1.00e-05 gnorm 0.158 3.13s mem 81.1GB +step 1945/5000 loss 0.2920 (w 0.1537 mse 0.1460 t 660 new 0.22) lr 1.00e-05 gnorm 0.247 3.08s mem 81.1GB +step 1946/5000 loss 0.2375 (w 0.1196 mse 0.1288 t 810 new 0.21) lr 1.00e-05 gnorm 0.144 3.29s mem 81.1GB +step 1947/5000 loss 0.3069 (w 0.1702 mse 0.1670 t 950 new 0.10) lr 1.00e-05 gnorm 0.146 3.29s mem 81.1GB +step 1948/5000 loss 0.1309 (w 0.4081 mse 0.3977 t 990 new 0.12) lr 1.00e-05 gnorm 0.482 2.85s mem 81.1GB +step 1949/5000 loss 0.2492 (w 0.2779 mse 0.2693 t 933 new 0.26) lr 1.00e-05 gnorm 0.158 2.85s mem 81.1GB +step 1950/5000 loss 0.2365 (w 0.3381 mse 0.3212 t 437 new 0.19) lr 1.00e-05 gnorm 0.304 3.61s mem 81.1GB +step 1951/5000 loss 0.1077 (w 0.1869 mse 0.1869 t 968 new 0.18) lr 1.00e-05 gnorm 0.192 3.12s mem 81.1GB +step 1952/5000 loss 0.2110 (w 0.1404 mse 0.1415 t 916 new 0.24) lr 1.00e-05 gnorm 0.149 3.43s mem 81.1GB +step 1953/5000 loss 0.2054 (w 0.2085 mse 0.2018 t 896 new 0.16) lr 1.00e-05 gnorm 0.189 3.36s mem 81.1GB +step 1954/5000 loss 0.2625 (w 0.1152 mse 0.1283 t 754 new 0.20) lr 1.00e-05 gnorm 0.159 2.83s mem 81.1GB +step 1955/5000 loss 0.2570 (w 0.4393 mse 0.4273 t 991 new 0.28) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +step 1956/5000 loss 0.2177 (w 0.2139 mse 0.2193 t 941 new 0.19) lr 1.00e-05 gnorm 0.149 3.44s mem 81.1GB +step 1957/5000 loss 0.5391 (w 0.2479 mse 0.2388 t 717 new 0.22) lr 1.00e-05 gnorm 0.172 2.83s mem 81.1GB +step 1958/5000 loss 0.1668 (w 0.2784 mse 0.2668 t 783 new 0.26) lr 1.00e-05 gnorm 0.158 3.31s mem 81.1GB +step 1959/5000 loss 0.2489 (w 0.2690 mse 0.2782 t 518 new 0.11) lr 1.00e-05 gnorm 0.113 3.11s mem 81.1GB +step 1960/5000 loss 0.2227 (w 0.7223 mse 0.7225 t 120 new 0.22) lr 1.00e-05 gnorm 0.205 2.82s mem 81.1GB +step 1961/5000 loss 0.1410 (w 0.3424 mse 0.3408 t 951 new 0.16) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 1962/5000 loss 0.3116 (w 0.2334 mse 0.2303 t 811 new 0.21) lr 1.00e-05 gnorm 0.210 3.37s mem 81.1GB +step 1963/5000 loss 0.3308 (w 0.2078 mse 0.2159 t 953 new 0.18) lr 1.00e-05 gnorm 0.177 2.83s mem 81.1GB +step 1964/5000 loss 0.2496 (w 0.1973 mse 0.2010 t 677 new 0.24) lr 1.00e-05 gnorm 0.146 3.38s mem 81.1GB +step 1965/5000 loss 0.2286 (w 0.2892 mse 0.2971 t 997 new 0.23) lr 1.00e-05 gnorm 0.157 3.12s mem 81.1GB +step 1966/5000 loss 0.1922 (w 0.2121 mse 0.2028 t 866 new 0.19) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +step 1967/5000 loss 0.0784 (w 0.2450 mse 0.2281 t 870 new 0.22) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +step 1968/5000 loss 0.2539 (w 0.1619 mse 0.1723 t 860 new 0.22) lr 1.00e-05 gnorm 0.136 3.37s mem 81.1GB +step 1969/5000 loss 0.2389 (w 0.1907 mse 0.1882 t 931 new 0.23) lr 1.00e-05 gnorm 0.321 3.08s mem 81.1GB +step 1970/5000 loss 0.1688 (w 0.2970 mse 0.2768 t 975 new 0.27) lr 1.00e-05 gnorm 0.143 3.29s mem 81.1GB +step 1971/5000 loss 0.3202 (w 0.1536 mse 0.1735 t 572 new 0.24) lr 1.00e-05 gnorm 0.150 3.07s mem 81.1GB +step 1972/5000 loss 0.2326 (w 0.2452 mse 0.2398 t 942 new 0.16) lr 1.00e-05 gnorm 0.150 2.83s mem 81.1GB +step 1973/5000 loss 0.1598 (w 0.1804 mse 0.1765 t 871 new 0.22) lr 1.00e-05 gnorm 0.129 3.12s mem 81.1GB +step 1974/5000 loss 0.3133 (w 0.3048 mse 0.3153 t 249 new 0.08) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +step 1975/5000 loss 0.2447 (w 0.2233 mse 0.2160 t 939 new 0.23) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +step 1976/5000 loss 0.1939 (w 0.1403 mse 0.1495 t 800 new 0.26) lr 1.00e-05 gnorm 0.205 3.36s mem 81.1GB +step 1977/5000 loss 0.3905 (w 0.2531 mse 0.2446 t 551 new 0.23) lr 1.00e-05 gnorm 0.173 3.10s mem 81.1GB +step 1978/5000 loss 0.2055 (w 0.2096 mse 0.2168 t 639 new 0.24) lr 1.00e-05 gnorm 0.148 2.83s mem 81.1GB +step 1979/5000 loss 0.2571 (w 0.3075 mse 0.2949 t 968 new 0.14) lr 1.00e-05 gnorm 0.147 3.37s mem 81.1GB +step 1980/5000 loss 0.1658 (w 0.2752 mse 0.2765 t 675 new 0.23) lr 1.00e-05 gnorm 0.247 3.06s mem 81.1GB +step 1981/5000 loss 0.2553 (w 0.2676 mse 0.2588 t 987 new 0.21) lr 1.00e-05 gnorm 0.432 3.10s mem 81.1GB +step 1982/5000 loss 0.1083 (w 0.1542 mse 0.1426 t 909 new 0.16) lr 1.00e-05 gnorm 0.121 3.33s mem 81.1GB +step 1983/5000 loss 0.3799 (w 0.3750 mse 0.3703 t 397 new 0.23) lr 1.00e-05 gnorm 0.182 2.83s mem 81.1GB +step 1984/5000 loss 0.1349 (w 0.2315 mse 0.2126 t 968 new 0.21) lr 1.00e-05 gnorm 0.474 2.84s mem 81.1GB +step 1985/5000 loss 0.2014 (w 0.1575 mse 0.1660 t 853 new 0.22) lr 1.00e-05 gnorm 0.262 3.15s mem 81.1GB +step 1986/5000 loss 0.1824 (w 0.1889 mse 0.1861 t 773 new 0.23) lr 1.00e-05 gnorm 0.170 3.07s mem 81.1GB +step 1987/5000 loss 0.2358 (w 0.2172 mse 0.2152 t 647 new 0.23) lr 1.00e-05 gnorm 0.342 3.35s mem 81.1GB +step 1988/5000 loss 0.2284 (w 0.2835 mse 0.2641 t 835 new 0.22) lr 1.00e-05 gnorm 0.157 3.41s mem 81.1GB +step 1989/5000 loss 0.3102 (w 0.1988 mse 0.2253 t 928 new 0.18) lr 1.00e-05 gnorm 0.247 2.82s mem 81.1GB +step 1990/5000 loss 0.1470 (w 0.2241 mse 0.2257 t 921 new 0.19) lr 1.00e-05 gnorm 0.149 2.83s mem 81.1GB +step 1991/5000 loss 0.1793 (w 0.2525 mse 0.2759 t 278 new 0.14) lr 1.00e-05 gnorm 0.163 3.45s mem 81.1GB +step 1992/5000 loss 0.1909 (w 0.2428 mse 0.2433 t 979 new 0.20) lr 1.00e-05 gnorm 0.484 3.08s mem 81.1GB +step 1993/5000 loss 0.1983 (w 0.1985 mse 0.1845 t 945 new 0.15) lr 1.00e-05 gnorm 0.144 3.33s mem 81.1GB +step 1994/5000 loss 0.2539 (w 0.2490 mse 0.2362 t 940 new 0.24) lr 1.00e-05 gnorm 0.188 3.07s mem 81.1GB +step 1995/5000 loss 0.1409 (w 0.2101 mse 0.1962 t 872 new 0.25) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +step 1996/5000 loss 0.1986 (w 0.1046 mse 0.1096 t 888 new 0.16) lr 1.00e-05 gnorm 0.162 2.83s mem 81.1GB +step 1997/5000 loss 0.1565 (w 0.2046 mse 0.2011 t 927 new 0.16) lr 1.00e-05 gnorm 0.229 3.41s mem 81.1GB +step 1998/5000 loss 0.3394 (w 0.3606 mse 0.3597 t 394 new 0.27) lr 1.00e-05 gnorm 0.156 3.07s mem 81.1GB +step 1999/5000 loss 0.2113 (w 0.2192 mse 0.2073 t 807 new 0.24) lr 1.00e-05 gnorm 0.131 3.14s mem 81.1GB +step 2000/5000 loss 0.2045 (w 0.3156 mse 0.2960 t 976 new 0.24) lr 1.00e-05 gnorm 0.133 3.07s mem 81.1GB +[val] step 2000 t=200: w=0.4239 mse=0.4349 (n=16) t=500: w=0.2260 mse=0.2299 (n=16) t=800: w=0.1769 mse=0.1766 (n=16) | mean w=0.2756 mse=0.2804 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step2000.safetensors 4093 个张量 37.98 GB +step 2001/5000 loss 0.4653 (w 0.1268 mse 0.1154 t 814 new 0.25) lr 1.00e-05 gnorm 0.163 2.85s mem 81.1GB +step 2002/5000 loss 0.2271 (w 0.3132 mse 0.2993 t 968 new 0.24) lr 1.00e-05 gnorm 0.162 3.06s mem 81.1GB +step 2003/5000 loss 0.1605 (w 0.3046 mse 0.3002 t 976 new 0.21) lr 1.00e-05 gnorm 0.199 3.09s mem 81.1GB +step 2004/5000 loss 0.3793 (w 0.3257 mse 0.3302 t 386 new 0.09) lr 1.00e-05 gnorm 0.166 3.30s mem 81.1GB +step 2005/5000 loss 0.2460 (w 0.1918 mse 0.1974 t 987 new 0.26) lr 1.00e-05 gnorm 0.246 3.39s mem 81.1GB +step 2006/5000 loss 0.2916 (w 0.4337 mse 0.4365 t 228 new 0.23) lr 1.00e-05 gnorm 0.180 2.85s mem 81.1GB +step 2007/5000 loss 0.2123 (w 0.1923 mse 0.1858 t 891 new 0.24) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 2008/5000 loss 0.3232 (w 0.2536 mse 0.2455 t 886 new 0.22) lr 1.00e-05 gnorm 0.282 3.11s mem 81.1GB +step 2009/5000 loss 0.1910 (w 0.3960 mse 0.3765 t 980 new 0.27) lr 1.00e-05 gnorm 0.476 3.09s mem 81.1GB +step 2010/5000 loss 0.2551 (w 0.1365 mse 0.1328 t 877 new 0.21) lr 1.00e-05 gnorm 0.172 3.32s mem 81.1GB +step 2011/5000 loss 0.1761 (w 0.3274 mse 0.3137 t 944 new 0.25) lr 1.00e-05 gnorm 0.270 3.13s mem 81.1GB +step 2012/5000 loss 0.0965 (w 0.2834 mse 0.2832 t 929 new 0.18) lr 1.00e-05 gnorm 0.203 2.86s mem 81.1GB +step 2013/5000 loss 0.3560 (w 0.2419 mse 0.2242 t 781 new 0.22) lr 1.00e-05 gnorm 0.161 2.85s mem 81.1GB +step 2014/5000 loss 0.0913 (w 0.2552 mse 0.2422 t 950 new 0.21) lr 1.00e-05 gnorm 0.377 3.29s mem 81.1GB +step 2015/5000 loss 0.3389 (w 0.2272 mse 0.2198 t 928 new 0.21) lr 1.00e-05 gnorm 0.150 3.10s mem 81.1GB +step 2016/5000 loss 0.2426 (w 0.1476 mse 0.1634 t 821 new 0.23) lr 1.00e-05 gnorm 0.183 3.65s mem 81.1GB +step 2017/5000 loss 0.2619 (w 0.4505 mse 0.4478 t 288 new 0.05) lr 1.00e-05 gnorm 0.117 3.12s mem 81.1GB +step 2018/5000 loss 0.2074 (w 0.3196 mse 0.3040 t 665 new 0.19) lr 1.00e-05 gnorm 0.137 2.85s mem 81.1GB +step 2019/5000 loss 0.2077 (w 0.2156 mse 0.2130 t 840 new 0.23) lr 1.00e-05 gnorm 0.653 2.84s mem 81.1GB +step 2020/5000 loss 0.1372 (w 0.1625 mse 0.1544 t 675 new 0.22) lr 1.00e-05 gnorm 0.155 3.39s mem 81.1GB +step 2021/5000 loss 0.1492 (w 0.2449 mse 0.2499 t 846 new 0.14) lr 1.00e-05 gnorm 0.143 3.58s mem 81.1GB +step 2022/5000 loss 0.1734 (w 0.3169 mse 0.3141 t 970 new 0.22) lr 1.00e-05 gnorm 0.268 3.39s mem 81.1GB +step 2023/5000 loss 0.1910 (w 0.3319 mse 0.3230 t 988 new 0.22) lr 1.00e-05 gnorm 0.158 3.15s mem 81.1GB +step 2024/5000 loss 0.4523 (w 0.4297 mse 0.4421 t 223 new 0.21) lr 1.00e-05 gnorm 0.157 3.08s mem 81.1GB +step 2025/5000 loss 0.1887 (w 0.1687 mse 0.1611 t 886 new 0.19) lr 1.00e-05 gnorm 0.133 3.07s mem 81.1GB +step 2026/5000 loss 0.2057 (w 0.1894 mse 0.1832 t 813 new 0.22) lr 1.00e-05 gnorm 0.249 3.51s mem 81.1GB +step 2027/5000 loss 0.3071 (w 0.3074 mse 0.3048 t 992 new 0.09) lr 1.00e-05 gnorm 0.158 3.53s mem 81.1GB +step 2028/5000 loss 0.3970 (w 0.2851 mse 0.2952 t 444 new 0.17) lr 1.00e-05 gnorm 0.196 3.50s mem 81.1GB +step 2029/5000 loss 0.2691 (w 0.2230 mse 0.2172 t 957 new 0.12) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +step 2030/5000 loss 0.3778 (w 0.4706 mse 0.4580 t 306 new 0.20) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +step 2031/5000 loss 0.1463 (w 0.3362 mse 0.3457 t 283 new 0.09) lr 1.00e-05 gnorm 0.123 3.06s mem 81.1GB +step 2032/5000 loss 0.2094 (w 0.1729 mse 0.1719 t 926 new 0.22) lr 1.00e-05 gnorm 0.151 3.08s mem 81.1GB +step 2033/5000 loss 0.2632 (w 0.7882 mse 0.7826 t 100 new 0.23) lr 1.00e-05 gnorm 0.150 3.22s mem 81.1GB +step 2034/5000 loss 0.2741 (w 0.3181 mse 0.3247 t 348 new 0.17) lr 1.00e-05 gnorm 0.125 3.43s mem 81.1GB +step 2035/5000 loss 0.0652 (w 0.1071 mse 0.1224 t 819 new 0.25) lr 1.00e-05 gnorm 0.136 3.14s mem 81.1GB +step 2036/5000 loss 0.2570 (w 0.2155 mse 0.2091 t 542 new 0.21) lr 1.00e-05 gnorm 0.131 2.85s mem 81.1GB +step 2037/5000 loss 0.2620 (w 0.1747 mse 0.1789 t 677 new 0.21) lr 1.00e-05 gnorm 0.321 3.06s mem 81.1GB +step 2038/5000 loss 0.2245 (w 0.3498 mse 0.3519 t 954 new 0.25) lr 1.00e-05 gnorm 0.129 3.25s mem 81.1GB +step 2039/5000 loss 0.2038 (w 0.2038 mse 0.1947 t 800 new 0.15) lr 1.00e-05 gnorm 0.126 3.21s mem 81.1GB +step 2040/5000 loss 0.4393 (w 0.4758 mse 0.4597 t 171 new 0.22) lr 1.00e-05 gnorm 0.169 3.61s mem 81.1GB +step 2041/5000 loss 0.1235 (w 0.2174 mse 0.2043 t 981 new 0.24) lr 1.00e-05 gnorm 0.161 2.84s mem 81.1GB +step 2042/5000 loss 0.1641 (w 0.1888 mse 0.1951 t 965 new 0.22) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +step 2043/5000 loss 0.4183 (w 0.2393 mse 0.2270 t 959 new 0.14) lr 1.00e-05 gnorm 0.221 3.12s mem 81.1GB +step 2044/5000 loss 0.1833 (w 0.2633 mse 0.2678 t 956 new 0.17) lr 1.00e-05 gnorm 0.356 3.23s mem 81.1GB +step 2045/5000 loss 0.2805 (w 0.1534 mse 0.1417 t 946 new 0.17) lr 1.00e-05 gnorm 0.201 3.32s mem 81.1GB +step 2046/5000 loss 0.1171 (w 0.1826 mse 0.1859 t 999 new 0.19) lr 1.00e-05 gnorm 0.162 3.31s mem 81.1GB +step 2047/5000 loss 0.0919 (w 0.1637 mse 0.1622 t 965 new 0.17) lr 1.00e-05 gnorm 0.282 2.84s mem 81.1GB +step 2048/5000 loss 0.1527 (w 0.1485 mse 0.1553 t 939 new 0.22) lr 1.00e-05 gnorm 0.151 2.84s mem 81.1GB +step 2049/5000 loss 0.3214 (w 0.4876 mse 0.4880 t 264 new 0.19) lr 1.00e-05 gnorm 0.134 3.15s mem 81.1GB +step 2050/5000 loss 0.1904 (w 0.1447 mse 0.1445 t 983 new 0.26) lr 1.00e-05 gnorm 0.121 3.30s mem 81.1GB +step 2051/5000 loss 0.3577 (w 0.2015 mse 0.1944 t 826 new 0.18) lr 1.00e-05 gnorm 0.141 3.47s mem 81.1GB +step 2052/5000 loss 0.2859 (w 0.2525 mse 0.2479 t 996 new 0.22) lr 1.00e-05 gnorm 0.151 3.42s mem 81.1GB +step 2053/5000 loss 0.1335 (w 0.1459 mse 0.1427 t 816 new 0.12) lr 1.00e-05 gnorm 0.168 2.84s mem 81.1GB +step 2054/5000 loss 0.3301 (w 0.1965 mse 0.1923 t 624 new 0.19) lr 1.00e-05 gnorm 0.139 2.85s mem 81.1GB +step 2055/5000 loss 0.1097 (w 0.2052 mse 0.1914 t 927 new 0.25) lr 1.00e-05 gnorm 0.139 3.27s mem 81.1GB +step 2056/5000 loss 0.1957 (w 0.4156 mse 0.4176 t 278 new 0.23) lr 1.00e-05 gnorm 0.150 3.09s mem 81.1GB +step 2057/5000 loss 0.3450 (w 0.2308 mse 0.2285 t 869 new 0.19) lr 1.00e-05 gnorm 0.316 3.32s mem 81.1GB +step 2058/5000 loss 0.0781 (w 0.1930 mse 0.1832 t 906 new 0.21) lr 1.00e-05 gnorm 0.136 3.09s mem 81.1GB +step 2059/5000 loss 0.1651 (w 0.2002 mse 0.1969 t 826 new 0.21) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +step 2060/5000 loss 0.3726 (w 0.2403 mse 0.2350 t 822 new 0.21) lr 1.00e-05 gnorm 0.376 2.85s mem 81.1GB +step 2061/5000 loss 0.0796 (w 0.1660 mse 0.1794 t 914 new 0.22) lr 1.00e-05 gnorm 0.180 3.28s mem 81.1GB +step 2062/5000 loss 0.2193 (w 0.3128 mse 0.3100 t 975 new 0.20) lr 1.00e-05 gnorm 0.370 3.06s mem 81.1GB +step 2063/5000 loss 0.1321 (w 0.2123 mse 0.2220 t 991 new 0.18) lr 1.00e-05 gnorm 0.176 3.56s mem 81.1GB +step 2064/5000 loss 0.3188 (w 0.1821 mse 0.1694 t 875 new 0.22) lr 1.00e-05 gnorm 0.535 3.13s mem 81.1GB +step 2065/5000 loss 0.3909 (w 0.2285 mse 0.2089 t 782 new 0.18) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +step 2066/5000 loss 0.1046 (w 0.4248 mse 0.4031 t 982 new 0.22) lr 1.00e-05 gnorm 0.124 2.85s mem 81.1GB +step 2067/5000 loss 0.1462 (w 0.2109 mse 0.2130 t 967 new 0.16) lr 1.00e-05 gnorm 0.335 3.04s mem 81.1GB +step 2068/5000 loss 0.2552 (w 0.2445 mse 0.2497 t 972 new 0.17) lr 1.00e-05 gnorm 0.097 3.05s mem 81.1GB +step 2069/5000 loss 0.2353 (w 0.1827 mse 0.1864 t 878 new 0.12) lr 1.00e-05 gnorm 0.181 3.56s mem 81.1GB +step 2070/5000 loss 0.2063 (w 0.2260 mse 0.2238 t 697 new 0.20) lr 1.00e-05 gnorm 16.329 2.84s mem 81.1GB +step 2071/5000 loss 0.3357 (w 0.2740 mse 0.2697 t 651 new 0.22) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +step 2072/5000 loss 0.1311 (w 0.1973 mse 0.1904 t 948 new 0.13) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +step 2073/5000 loss 0.3555 (w 0.3355 mse 0.3308 t 546 new 0.27) lr 1.00e-05 gnorm 0.261 3.10s mem 81.1GB +step 2074/5000 loss 0.2857 (w 0.2942 mse 0.2818 t 985 new 0.17) lr 1.00e-05 gnorm 1.597 3.43s mem 81.1GB +step 2075/5000 loss 0.1561 (w 0.2459 mse 0.2436 t 904 new 0.25) lr 1.00e-05 gnorm 0.180 3.14s mem 81.1GB +step 2076/5000 loss 0.3190 (w 0.2656 mse 0.2679 t 866 new 0.21) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +step 2077/5000 loss 0.2223 (w 0.1236 mse 0.1254 t 787 new 0.20) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +step 2078/5000 loss 0.1306 (w 0.2148 mse 0.2029 t 878 new 0.21) lr 1.00e-05 gnorm 0.150 3.03s mem 81.1GB +step 2079/5000 loss 0.1479 (w 0.2427 mse 0.2497 t 999 new 0.22) lr 1.00e-05 gnorm 0.233 3.08s mem 81.1GB +step 2080/5000 loss 0.3666 (w 0.1770 mse 0.1802 t 967 new 0.21) lr 1.00e-05 gnorm 0.222 3.51s mem 81.1GB +step 2081/5000 loss 0.2762 (w 0.2174 mse 0.2143 t 352 new 0.14) lr 1.00e-05 gnorm 0.217 3.36s mem 81.1GB +step 2082/5000 loss 0.3430 (w 0.2316 mse 0.2267 t 653 new 0.25) lr 1.00e-05 gnorm 0.137 2.85s mem 81.1GB +step 2083/5000 loss 0.1891 (w 0.1925 mse 0.1893 t 851 new 0.24) lr 1.00e-05 gnorm 0.152 2.85s mem 81.1GB +step 2084/5000 loss 0.1976 (w 0.1708 mse 0.1678 t 759 new 0.28) lr 1.00e-05 gnorm 0.157 3.13s mem 81.1GB +step 2085/5000 loss 0.4392 (w 0.2045 mse 0.2056 t 913 new 0.24) lr 1.00e-05 gnorm 0.171 3.30s mem 81.1GB +step 2086/5000 loss 0.1927 (w 0.2447 mse 0.2402 t 836 new 0.24) lr 1.00e-05 gnorm 3.493 3.26s mem 81.1GB +step 2087/5000 loss 0.2724 (w 0.0617 mse 0.0689 t 925 new 0.11) lr 1.00e-05 gnorm 0.148 3.37s mem 81.1GB +step 2088/5000 loss 0.3427 (w 0.3084 mse 0.2974 t 787 new 0.16) lr 1.00e-05 gnorm 0.415 2.84s mem 81.1GB +step 2089/5000 loss 0.2046 (w 0.1608 mse 0.1778 t 965 new 0.12) lr 1.00e-05 gnorm 0.271 2.85s mem 81.1GB +step 2090/5000 loss 0.2164 (w 0.2040 mse 0.1984 t 935 new 0.17) lr 1.00e-05 gnorm 0.150 3.35s mem 81.1GB +step 2091/5000 loss 0.1834 (w 0.2137 mse 0.2098 t 935 new 0.09) lr 1.00e-05 gnorm 0.191 3.09s mem 81.1GB +step 2092/5000 loss 0.2963 (w 0.2187 mse 0.2183 t 935 new 0.01) lr 1.00e-05 gnorm 0.171 3.32s mem 81.1GB +step 2093/5000 loss 0.3960 (w 0.3632 mse 0.3547 t 348 new 0.20) lr 1.00e-05 gnorm 0.161 3.36s mem 81.1GB +step 2094/5000 loss 0.2551 (w 0.2881 mse 0.2913 t 851 new 0.28) lr 1.00e-05 gnorm 0.155 2.85s mem 81.1GB +step 2095/5000 loss 0.1750 (w 0.1371 mse 0.1445 t 932 new 0.12) lr 1.00e-05 gnorm 0.134 2.86s mem 81.1GB +step 2096/5000 loss 0.1586 (w 0.2617 mse 0.2608 t 962 new 0.13) lr 1.00e-05 gnorm 0.134 3.25s mem 81.1GB +step 2097/5000 loss 0.2708 (w 0.2371 mse 0.2251 t 847 new 0.26) lr 1.00e-05 gnorm 0.114 3.12s mem 81.1GB +step 2098/5000 loss 0.2186 (w 0.1944 mse 0.2042 t 684 new 0.23) lr 1.00e-05 gnorm 0.136 3.27s mem 81.1GB +step 2099/5000 loss 0.2197 (w 0.1554 mse 0.1657 t 874 new 0.23) lr 1.00e-05 gnorm 0.149 3.32s mem 81.1GB +step 2100/5000 loss 0.1571 (w 0.0977 mse 0.1118 t 844 new 0.19) lr 1.00e-05 gnorm 0.154 2.84s mem 81.1GB +step 2101/5000 loss 0.1823 (w 0.2756 mse 0.2726 t 984 new 0.22) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +step 2102/5000 loss 0.3788 (w 0.1352 mse 0.1271 t 819 new 0.17) lr 1.00e-05 gnorm 0.179 3.35s mem 81.1GB +step 2103/5000 loss 0.3176 (w 0.3948 mse 0.4160 t 249 new 0.19) lr 1.00e-05 gnorm 0.169 3.09s mem 81.1GB +step 2104/5000 loss 0.1643 (w 0.1138 mse 0.1166 t 902 new 0.14) lr 1.00e-05 gnorm 0.145 3.41s mem 81.1GB +step 2105/5000 loss 0.2120 (w 0.2747 mse 0.2636 t 944 new 0.17) lr 1.00e-05 gnorm 0.141 3.35s mem 81.1GB +step 2106/5000 loss 0.3494 (w 0.2936 mse 0.2826 t 989 new 0.23) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +step 2107/5000 loss 0.3457 (w 0.1887 mse 0.1798 t 918 new 0.21) lr 1.00e-05 gnorm 0.185 3.06s mem 81.1GB +step 2108/5000 loss 0.2106 (w 0.2402 mse 0.2067 t 858 new 0.21) lr 1.00e-05 gnorm 0.323 3.06s mem 81.1GB +step 2109/5000 loss 0.2355 (w 0.3656 mse 0.3655 t 972 new 0.28) lr 1.00e-05 gnorm 0.174 3.07s mem 81.1GB +step 2110/5000 loss 0.3169 (w 0.2702 mse 0.2608 t 523 new 0.12) lr 1.00e-05 gnorm 0.151 3.44s mem 81.1GB +step 2111/5000 loss 0.4192 (w 0.5842 mse 0.5766 t 217 new 0.23) lr 1.00e-05 gnorm 0.153 3.19s mem 81.1GB +step 2112/5000 loss 0.1850 (w 0.2559 mse 0.2537 t 883 new 0.17) lr 1.00e-05 gnorm 0.156 2.86s mem 81.1GB +step 2113/5000 loss 0.1146 (w 0.1665 mse 0.1698 t 851 new 0.25) lr 1.00e-05 gnorm 0.194 3.05s mem 81.1GB +step 2114/5000 loss 0.1539 (w 0.3353 mse 0.3519 t 971 new 0.19) lr 1.00e-05 gnorm 0.173 3.07s mem 81.1GB +step 2115/5000 loss 0.1698 (w 0.1523 mse 0.1638 t 960 new 0.18) lr 1.00e-05 gnorm 0.132 3.42s mem 81.1GB +step 2116/5000 loss 0.1728 (w 0.3102 mse 0.3155 t 348 new 0.21) lr 1.00e-05 gnorm 0.230 3.28s mem 81.1GB +step 2117/5000 loss 0.1719 (w 0.1502 mse 0.1569 t 916 new 0.14) lr 1.00e-05 gnorm 0.131 3.06s mem 81.1GB +step 2118/5000 loss 0.2379 (w 0.3321 mse 0.3418 t 390 new 0.23) lr 1.00e-05 gnorm 0.204 2.84s mem 81.1GB +step 2119/5000 loss 0.2317 (w 0.2710 mse 0.2635 t 872 new 0.25) lr 1.00e-05 gnorm 0.147 3.58s mem 81.1GB +step 2120/5000 loss 0.2507 (w 0.2059 mse 0.2306 t 968 new 0.26) lr 1.00e-05 gnorm 0.148 3.07s mem 81.1GB +step 2121/5000 loss 0.1387 (w 0.1060 mse 0.1078 t 989 new 0.23) lr 1.00e-05 gnorm 0.326 3.19s mem 81.1GB +step 2122/5000 loss 0.1966 (w 0.3459 mse 0.3460 t 1000 new 0.17) lr 1.00e-05 gnorm 0.250 3.68s mem 81.1GB +step 2123/5000 loss 0.1962 (w 0.2588 mse 0.2435 t 927 new 0.18) lr 1.00e-05 gnorm 0.413 3.20s mem 81.1GB +step 2124/5000 loss 0.2718 (w 0.3630 mse 0.3580 t 394 new 0.18) lr 1.00e-05 gnorm 0.137 2.87s mem 81.1GB +step 2125/5000 loss 0.2119 (w 0.3193 mse 0.2994 t 895 new 0.18) lr 1.00e-05 gnorm 0.146 3.31s mem 81.1GB +step 2126/5000 loss 0.2416 (w 0.1743 mse 0.1718 t 822 new 0.25) lr 1.00e-05 gnorm 0.144 3.45s mem 81.1GB +step 2127/5000 loss 0.3491 (w 0.1739 mse 0.1691 t 681 new 0.19) lr 1.00e-05 gnorm 0.148 3.30s mem 81.1GB +step 2128/5000 loss 0.2949 (w 0.2167 mse 0.2054 t 772 new 0.19) lr 1.00e-05 gnorm 0.169 3.52s mem 81.1GB +step 2129/5000 loss 0.3471 (w 0.4388 mse 0.4136 t 980 new 0.25) lr 1.00e-05 gnorm 0.138 2.86s mem 81.1GB +step 2130/5000 loss 0.3164 (w 0.3100 mse 0.3082 t 998 new 0.26) lr 1.00e-05 gnorm 0.158 2.89s mem 81.1GB +step 2131/5000 loss 0.2716 (w 0.1821 mse 0.1800 t 763 new 0.14) lr 1.00e-05 gnorm 0.204 3.21s mem 81.1GB +step 2132/5000 loss 0.1923 (w 0.1704 mse 0.1607 t 904 new 0.19) lr 1.00e-05 gnorm 0.302 3.13s mem 81.1GB +step 2133/5000 loss 0.2220 (w 0.3181 mse 0.3020 t 750 new 0.19) lr 1.00e-05 gnorm 0.211 3.27s mem 81.1GB +step 2134/5000 loss 0.1476 (w 0.1924 mse 0.1968 t 872 new 0.17) lr 1.00e-05 gnorm 0.153 3.62s mem 81.1GB +step 2135/5000 loss 0.3635 (w 0.1148 mse 0.1237 t 797 new 0.27) lr 1.00e-05 gnorm 0.188 2.96s mem 81.1GB +step 2136/5000 loss 0.1710 (w 0.3393 mse 0.3187 t 974 new 0.22) lr 1.00e-05 gnorm 0.125 2.96s mem 81.1GB +step 2137/5000 loss 0.2603 (w 0.3252 mse 0.3298 t 992 new 0.24) lr 1.00e-05 gnorm 0.209 3.33s mem 81.1GB +step 2138/5000 loss 0.3904 (w 0.1386 mse 0.1340 t 849 new 0.05) lr 1.00e-05 gnorm 0.188 4.44s mem 81.1GB +step 2139/5000 loss 0.1478 (w 0.2165 mse 0.2231 t 428 new 0.25) lr 1.00e-05 gnorm 0.144 5.95s mem 81.1GB +step 2140/5000 loss 0.0949 (w 0.2655 mse 0.2517 t 939 new 0.19) lr 1.00e-05 gnorm 0.126 5.98s mem 81.1GB +step 2141/5000 loss 0.1984 (w 0.5584 mse 0.5535 t 159 new 0.22) lr 1.00e-05 gnorm 0.184 5.97s mem 81.1GB +step 2142/5000 loss 0.2290 (w 0.1739 mse 0.1743 t 951 new 0.20) lr 1.00e-05 gnorm 0.147 5.97s mem 81.1GB +step 2143/5000 loss 0.1828 (w 0.1330 mse 0.1399 t 715 new 0.27) lr 1.00e-05 gnorm 0.150 5.90s mem 81.1GB +step 2144/5000 loss 0.2285 (w 0.1878 mse 0.1848 t 695 new 0.16) lr 1.00e-05 gnorm 0.236 5.05s mem 81.1GB +step 2145/5000 loss 0.2219 (w 0.2753 mse 0.2644 t 846 new 0.23) lr 1.00e-05 gnorm 0.130 6.00s mem 81.1GB +step 2146/5000 loss 0.2465 (w 0.2151 mse 0.2159 t 977 new 0.23) lr 1.00e-05 gnorm 0.123 4.71s mem 81.1GB +step 2147/5000 loss 0.3017 (w 0.3181 mse 0.3118 t 431 new 0.23) lr 1.00e-05 gnorm 0.147 2.86s mem 81.1GB +step 2148/5000 loss 0.2791 (w 0.2832 mse 0.2755 t 431 new 0.27) lr 1.00e-05 gnorm 0.148 3.10s mem 81.1GB +step 2149/5000 loss 0.1774 (w 0.2374 mse 0.2296 t 962 new 0.19) lr 1.00e-05 gnorm 0.123 3.07s mem 81.1GB +step 2150/5000 loss 0.1701 (w 0.2312 mse 0.2247 t 961 new 0.09) lr 1.00e-05 gnorm 0.166 3.41s mem 81.1GB +step 2151/5000 loss 0.0793 (w 0.2597 mse 0.2607 t 972 new 0.09) lr 1.00e-05 gnorm 0.142 3.19s mem 81.1GB +step 2152/5000 loss 0.2143 (w 0.1791 mse 0.1729 t 925 new 0.19) lr 1.00e-05 gnorm 0.137 3.16s mem 81.1GB +step 2153/5000 loss 0.2408 (w 0.1893 mse 0.1742 t 950 new 0.22) lr 1.00e-05 gnorm 0.150 2.94s mem 81.1GB +step 2154/5000 loss 0.4001 (w 0.1899 mse 0.1858 t 703 new 0.18) lr 1.00e-05 gnorm 0.160 3.16s mem 81.1GB +step 2155/5000 loss 0.1934 (w 0.1756 mse 0.1895 t 939 new 0.19) lr 1.00e-05 gnorm 0.242 3.16s mem 81.1GB +step 2156/5000 loss 0.2204 (w 0.2658 mse 0.2658 t 976 new 0.19) lr 1.00e-05 gnorm 0.171 3.18s mem 81.1GB +step 2157/5000 loss 0.3830 (w 0.1970 mse 0.1952 t 975 new 0.24) lr 1.00e-05 gnorm 0.332 3.37s mem 81.1GB +step 2158/5000 loss 0.2793 (w 0.2183 mse 0.2119 t 817 new 0.20) lr 1.00e-05 gnorm 0.257 3.16s mem 81.1GB +step 2159/5000 loss 0.3539 (w 0.2081 mse 0.2001 t 926 new 0.23) lr 1.00e-05 gnorm 0.799 2.91s mem 81.1GB +step 2160/5000 loss 0.3556 (w 0.2639 mse 0.2604 t 599 new 0.18) lr 1.00e-05 gnorm 0.232 3.06s mem 81.1GB +step 2161/5000 loss 0.4610 (w 0.5727 mse 0.5805 t 177 new 0.23) lr 1.00e-05 gnorm 0.118 3.27s mem 81.1GB +step 2162/5000 loss 0.3249 (w 0.2518 mse 0.2412 t 566 new 0.19) lr 1.00e-05 gnorm 0.125 3.87s mem 81.1GB +step 2163/5000 loss 0.1163 (w 0.1288 mse 0.1249 t 832 new 0.10) lr 1.00e-05 gnorm 0.167 3.57s mem 81.1GB +step 2164/5000 loss 0.1878 (w 0.2043 mse 0.1972 t 728 new 0.21) lr 1.00e-05 gnorm 0.108 2.87s mem 81.1GB +step 2165/5000 loss 0.1281 (w 0.1676 mse 0.1744 t 962 new 0.19) lr 1.00e-05 gnorm 0.198 2.93s mem 81.1GB +step 2166/5000 loss 0.1593 (w 0.2599 mse 0.2482 t 909 new 0.19) lr 1.00e-05 gnorm 0.170 3.21s mem 81.1GB +step 2167/5000 loss 0.2872 (w 0.1351 mse 0.1264 t 873 new 0.23) lr 1.00e-05 gnorm 0.125 3.18s mem 81.1GB +step 2168/5000 loss 0.1477 (w 0.1383 mse 0.1510 t 885 new 0.28) lr 1.00e-05 gnorm 0.175 3.79s mem 81.1GB +step 2169/5000 loss 0.3242 (w 0.2357 mse 0.2372 t 807 new 0.20) lr 1.00e-05 gnorm 0.162 4.26s mem 81.1GB +step 2170/5000 loss 0.1846 (w 0.3030 mse 0.2986 t 986 new 0.18) lr 1.00e-05 gnorm 0.127 3.17s mem 81.1GB +step 2171/5000 loss 0.2800 (w 0.2554 mse 0.2473 t 965 new 0.18) lr 1.00e-05 gnorm 1.006 2.87s mem 81.1GB +step 2172/5000 loss 0.2490 (w 0.3320 mse 0.3224 t 983 new 0.16) lr 1.00e-05 gnorm 0.108 3.42s mem 81.1GB +step 2173/5000 loss 0.1701 (w 0.1666 mse 0.1815 t 974 new 0.21) lr 1.00e-05 gnorm 0.181 3.12s mem 81.1GB +step 2174/5000 loss 0.2508 (w 0.3441 mse 0.3458 t 991 new 0.20) lr 1.00e-05 gnorm 0.140 2.86s mem 81.1GB +step 2175/5000 loss 0.2948 (w 0.2260 mse 0.2182 t 952 new 0.19) lr 1.00e-05 gnorm 0.158 3.56s mem 81.1GB +step 2176/5000 loss 0.2082 (w 0.2569 mse 0.2745 t 986 new 0.24) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 2177/5000 loss 0.3441 (w 0.3569 mse 0.3688 t 986 new 0.19) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +step 2178/5000 loss 0.2774 (w 0.2403 mse 0.2274 t 698 new 0.27) lr 1.00e-05 gnorm 0.185 3.34s mem 81.1GB +step 2179/5000 loss 0.2192 (w 0.3851 mse 0.3652 t 978 new 0.19) lr 1.00e-05 gnorm 0.224 3.47s mem 81.1GB +step 2180/5000 loss 0.2537 (w 0.4154 mse 0.4096 t 976 new 0.21) lr 1.00e-05 gnorm 0.838 3.39s mem 81.1GB +step 2181/5000 loss 0.2572 (w 0.2258 mse 0.2243 t 404 new 0.21) lr 1.00e-05 gnorm 0.165 3.74s mem 81.1GB +step 2182/5000 loss 0.2209 (w 0.4747 mse 0.4747 t 177 new 0.00) lr 1.00e-05 gnorm 0.117 2.91s mem 81.1GB +step 2183/5000 loss 0.2621 (w 0.3171 mse 0.3013 t 904 new 0.09) lr 1.00e-05 gnorm 0.177 3.01s mem 81.1GB +step 2184/5000 loss 0.1231 (w 0.4180 mse 0.3939 t 986 new 0.17) lr 1.00e-05 gnorm 0.165 3.60s mem 81.1GB +step 2185/5000 loss 0.1343 (w 0.2073 mse 0.2024 t 880 new 0.24) lr 1.00e-05 gnorm 0.182 3.38s mem 81.1GB +step 2186/5000 loss 0.2640 (w 0.3384 mse 0.3212 t 927 new 0.23) lr 1.00e-05 gnorm 0.212 3.27s mem 81.1GB +step 2187/5000 loss 0.2176 (w 0.2416 mse 0.2304 t 915 new 0.22) lr 1.00e-05 gnorm 0.167 3.54s mem 81.1GB +step 2188/5000 loss 0.2651 (w 0.2495 mse 0.2293 t 972 new 0.15) lr 1.00e-05 gnorm 0.115 2.97s mem 81.1GB +step 2189/5000 loss 0.2771 (w 0.2434 mse 0.2373 t 590 new 0.11) lr 1.00e-05 gnorm 0.154 2.97s mem 81.1GB +step 2190/5000 loss 0.3442 (w 0.3675 mse 0.3632 t 383 new 0.18) lr 1.00e-05 gnorm 0.296 3.41s mem 81.1GB +step 2191/5000 loss 0.1976 (w 0.1520 mse 0.1481 t 897 new 0.14) lr 1.00e-05 gnorm 0.191 3.31s mem 81.1GB +step 2192/5000 loss 0.1535 (w 0.1973 mse 0.1921 t 799 new 0.17) lr 1.00e-05 gnorm 0.151 3.49s mem 81.1GB +step 2193/5000 loss 0.3666 (w 0.3099 mse 0.2944 t 660 new 0.23) lr 1.00e-05 gnorm 0.379 3.44s mem 81.1GB +step 2194/5000 loss 0.1574 (w 0.2083 mse 0.2071 t 966 new 0.24) lr 1.00e-05 gnorm 0.281 2.93s mem 81.1GB +step 2195/5000 loss 0.3390 (w 0.2449 mse 0.2377 t 854 new 0.14) lr 1.00e-05 gnorm 0.308 2.97s mem 81.1GB +step 2196/5000 loss 0.0558 (w 0.2774 mse 0.2734 t 982 new 0.26) lr 1.00e-05 gnorm 0.162 3.62s mem 81.1GB +step 2197/5000 loss 0.3158 (w 0.2829 mse 0.2628 t 876 new 0.16) lr 1.00e-05 gnorm 0.185 4.18s mem 81.1GB +step 2198/5000 loss 0.1448 (w 0.3494 mse 0.3488 t 989 new 0.19) lr 1.00e-05 gnorm 0.146 3.19s mem 81.1GB +step 2199/5000 loss 0.2315 (w 0.1957 mse 0.1972 t 935 new 0.17) lr 1.00e-05 gnorm 0.200 3.15s mem 81.1GB +step 2200/5000 loss 0.2559 (w 0.3543 mse 0.3206 t 950 new 0.20) lr 1.00e-05 gnorm 0.166 2.87s mem 81.1GB +step 2201/5000 loss 0.2521 (w 0.2609 mse 0.2475 t 935 new 0.19) lr 1.00e-05 gnorm 0.143 2.86s mem 81.1GB +step 2202/5000 loss 0.2124 (w 0.2438 mse 0.2336 t 874 new 0.19) lr 1.00e-05 gnorm 0.333 3.44s mem 81.1GB +step 2203/5000 loss 0.1824 (w 0.1889 mse 0.1781 t 852 new 0.22) lr 1.00e-05 gnorm 0.123 3.06s mem 81.1GB +step 2204/5000 loss 0.2346 (w 0.2189 mse 0.2059 t 977 new 0.26) lr 1.00e-05 gnorm 0.559 3.23s mem 81.1GB +step 2205/5000 loss 0.2741 (w 0.2654 mse 0.2574 t 695 new 0.24) lr 1.00e-05 gnorm 0.135 3.36s mem 81.1GB +step 2206/5000 loss 0.2063 (w 0.2270 mse 0.2105 t 958 new 0.16) lr 1.00e-05 gnorm 0.587 3.09s mem 81.1GB +step 2207/5000 loss 0.2434 (w 0.2637 mse 0.2770 t 956 new 0.19) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +step 2208/5000 loss 0.2038 (w 0.2485 mse 0.2388 t 946 new 0.24) lr 1.00e-05 gnorm 0.315 3.64s mem 81.1GB +step 2209/5000 loss 0.1862 (w 0.2519 mse 0.2458 t 903 new 0.20) lr 1.00e-05 gnorm 0.149 6.95s mem 81.1GB +step 2210/5000 loss 0.1805 (w 0.2707 mse 0.2645 t 980 new 0.12) lr 1.00e-05 gnorm 0.133 8.30s mem 81.1GB +step 2211/5000 loss 0.2801 (w 0.1919 mse 0.1859 t 860 new 0.10) lr 1.00e-05 gnorm 0.175 7.61s mem 81.1GB +step 2212/5000 loss 0.2947 (w 0.2145 mse 0.2008 t 952 new 0.14) lr 1.00e-05 gnorm 0.221 7.76s mem 81.1GB +step 2213/5000 loss 0.2344 (w 0.2177 mse 0.2160 t 852 new 0.18) lr 1.00e-05 gnorm 0.149 8.34s mem 81.1GB +step 2214/5000 loss 0.2520 (w 0.2756 mse 0.2690 t 988 new 0.15) lr 1.00e-05 gnorm 0.148 8.14s mem 81.1GB +step 2215/5000 loss 0.2338 (w 0.1779 mse 0.1780 t 706 new 0.21) lr 1.00e-05 gnorm 0.156 5.05s mem 81.1GB +step 2216/5000 loss 0.0984 (w 0.3670 mse 0.3567 t 985 new 0.21) lr 1.00e-05 gnorm 0.359 3.47s mem 81.1GB +step 2217/5000 loss 0.1844 (w 0.2699 mse 0.2525 t 917 new 0.12) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +step 2218/5000 loss 0.3092 (w 0.2247 mse 0.2290 t 988 new 0.19) lr 1.00e-05 gnorm 0.186 2.86s mem 81.1GB +step 2219/5000 loss 0.2929 (w 0.2686 mse 0.2625 t 933 new 0.16) lr 1.00e-05 gnorm 0.333 3.36s mem 81.1GB +step 2220/5000 loss 0.3336 (w 0.1673 mse 0.1688 t 976 new 0.25) lr 1.00e-05 gnorm 0.160 3.19s mem 81.1GB +step 2221/5000 loss 0.2620 (w 0.2574 mse 0.2399 t 957 new 0.27) lr 1.00e-05 gnorm 0.314 3.07s mem 81.1GB +step 2222/5000 loss 0.1824 (w 0.1166 mse 0.1254 t 908 new 0.15) lr 1.00e-05 gnorm 0.204 3.52s mem 81.1GB +step 2223/5000 loss 0.2270 (w 0.0974 mse 0.1086 t 692 new 0.21) lr 1.00e-05 gnorm 0.148 3.32s mem 81.1GB +step 2224/5000 loss 0.2818 (w 0.5583 mse 0.5650 t 159 new 0.16) lr 1.00e-05 gnorm 0.143 3.04s mem 81.1GB +step 2225/5000 loss 0.1543 (w 0.2835 mse 0.2673 t 936 new 0.20) lr 1.00e-05 gnorm 0.136 3.70s mem 81.1GB +step 2226/5000 loss 0.2869 (w 0.3314 mse 0.3208 t 980 new 0.24) lr 1.00e-05 gnorm 0.216 3.42s mem 81.1GB +step 2227/5000 loss 0.3394 (w 0.1209 mse 0.1300 t 845 new 0.24) lr 1.00e-05 gnorm 0.145 3.26s mem 81.1GB +step 2228/5000 loss 0.2349 (w 0.1202 mse 0.1193 t 720 new 0.22) lr 1.00e-05 gnorm 0.174 3.55s mem 81.1GB +step 2229/5000 loss 0.2174 (w 0.3299 mse 0.3393 t 336 new 0.19) lr 1.00e-05 gnorm 0.215 4.18s mem 81.1GB +step 2230/5000 loss 0.2903 (w 0.2416 mse 0.2240 t 809 new 0.23) lr 1.00e-05 gnorm 0.352 4.14s mem 81.1GB +step 2231/5000 loss 0.2109 (w 0.1857 mse 0.1781 t 578 new 0.19) lr 1.00e-05 gnorm 0.255 3.70s mem 81.1GB +step 2232/5000 loss 0.1234 (w 0.5222 mse 0.4923 t 989 new 0.17) lr 1.00e-05 gnorm 0.133 3.37s mem 81.1GB +step 2233/5000 loss 0.2348 (w 0.2712 mse 0.2556 t 838 new 0.23) lr 1.00e-05 gnorm 0.123 3.54s mem 81.1GB +step 2234/5000 loss 0.1314 (w 0.1721 mse 0.1881 t 986 new 0.21) lr 1.00e-05 gnorm 0.145 3.79s mem 81.1GB +step 2235/5000 loss 0.2558 (w 0.3339 mse 0.3186 t 926 new 0.20) lr 1.00e-05 gnorm 0.139 4.34s mem 81.1GB +step 2236/5000 loss 0.2289 (w 0.1348 mse 0.1380 t 841 new 0.21) lr 1.00e-05 gnorm 0.185 4.18s mem 81.1GB +step 2237/5000 loss 0.4080 (w 0.2400 mse 0.2387 t 866 new 0.13) lr 1.00e-05 gnorm 0.156 3.73s mem 81.1GB +step 2238/5000 loss 0.1451 (w 0.2022 mse 0.2207 t 996 new 0.20) lr 1.00e-05 gnorm 0.126 3.19s mem 81.1GB +step 2239/5000 loss 0.3457 (w 0.1260 mse 0.1273 t 819 new 0.05) lr 1.00e-05 gnorm 0.236 3.18s mem 81.1GB +step 2240/5000 loss 0.2035 (w 0.3813 mse 0.3826 t 408 new 0.18) lr 1.00e-05 gnorm 0.097 3.07s mem 81.1GB +step 2241/5000 loss 0.1649 (w 0.1880 mse 0.1902 t 887 new 0.22) lr 1.00e-05 gnorm 0.222 2.85s mem 81.1GB +step 2242/5000 loss 0.2312 (w 0.1390 mse 0.1388 t 928 new 0.01) lr 1.00e-05 gnorm 0.356 3.56s mem 81.1GB +step 2243/5000 loss 0.1864 (w 0.3158 mse 0.3036 t 847 new 0.18) lr 1.00e-05 gnorm 0.170 3.42s mem 81.1GB +step 2244/5000 loss 0.3314 (w 0.3785 mse 0.3681 t 379 new 0.22) lr 1.00e-05 gnorm 0.163 3.19s mem 81.1GB +step 2245/5000 loss 0.2290 (w 0.2579 mse 0.2636 t 897 new 0.17) lr 1.00e-05 gnorm 0.220 3.37s mem 81.1GB +step 2246/5000 loss 0.2229 (w 0.2414 mse 0.2159 t 930 new 0.22) lr 1.00e-05 gnorm 0.190 3.10s mem 81.1GB +step 2247/5000 loss 0.2916 (w 0.2904 mse 0.2834 t 918 new 0.11) lr 1.00e-05 gnorm 0.401 2.84s mem 81.1GB +step 2248/5000 loss 0.1307 (w 0.1989 mse 0.1966 t 948 new 0.14) lr 1.00e-05 gnorm 0.137 3.12s mem 81.1GB +step 2249/5000 loss 0.2625 (w 0.2698 mse 0.2462 t 928 new 0.21) lr 1.00e-05 gnorm 0.199 3.38s mem 81.1GB +step 2250/5000 loss 0.2321 (w 0.2294 mse 0.2054 t 886 new 0.18) lr 1.00e-05 gnorm 0.270 2.85s mem 81.1GB +step 2251/5000 loss 0.2543 (w 0.2453 mse 0.2474 t 982 new 0.23) lr 1.00e-05 gnorm 0.299 3.42s mem 81.1GB +step 2252/5000 loss 0.1024 (w 0.1535 mse 0.1718 t 983 new 0.17) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +step 2253/5000 loss 0.2179 (w 0.1107 mse 0.1135 t 628 new 0.11) lr 1.00e-05 gnorm 0.156 2.86s mem 81.1GB +step 2254/5000 loss 0.3132 (w 0.2976 mse 0.2915 t 609 new 0.22) lr 1.00e-05 gnorm 0.241 3.10s mem 81.1GB +step 2255/5000 loss 0.3434 (w 0.1216 mse 0.1226 t 742 new 0.10) lr 1.00e-05 gnorm 0.191 3.32s mem 81.1GB +step 2256/5000 loss 0.3698 (w 0.2869 mse 0.2796 t 978 new 0.24) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +step 2257/5000 loss 0.1798 (w 0.2676 mse 0.2759 t 961 new 0.15) lr 1.00e-05 gnorm 0.200 3.42s mem 81.1GB +step 2258/5000 loss 0.1603 (w 0.1517 mse 0.1540 t 798 new 0.15) lr 1.00e-05 gnorm 0.856 3.09s mem 81.1GB +step 2259/5000 loss 0.3586 (w 0.1891 mse 0.1855 t 824 new 0.25) lr 1.00e-05 gnorm 0.151 2.86s mem 81.1GB +step 2260/5000 loss 0.1848 (w 0.2811 mse 0.2645 t 675 new 0.23) lr 1.00e-05 gnorm 0.324 3.42s mem 81.1GB +step 2261/5000 loss 0.1789 (w 0.1814 mse 0.1930 t 819 new 0.13) lr 1.00e-05 gnorm 0.131 3.30s mem 81.1GB +step 2262/5000 loss 0.2589 (w 0.2604 mse 0.2434 t 819 new 0.28) lr 1.00e-05 gnorm 0.238 2.85s mem 81.1GB +step 2263/5000 loss 0.1224 (w 0.1389 mse 0.1295 t 895 new 0.24) lr 1.00e-05 gnorm 0.209 3.12s mem 81.1GB +step 2264/5000 loss 0.2842 (w 0.3512 mse 0.3501 t 976 new 0.20) lr 1.00e-05 gnorm 0.182 3.07s mem 81.1GB +step 2265/5000 loss 0.2636 (w 0.4793 mse 0.4740 t 997 new 0.22) lr 1.00e-05 gnorm 0.323 2.84s mem 81.1GB +step 2266/5000 loss 0.3019 (w 0.4180 mse 0.4140 t 323 new 0.25) lr 1.00e-05 gnorm 0.176 3.51s mem 81.1GB +step 2267/5000 loss 0.1875 (w 0.1881 mse 0.1831 t 979 new 0.20) lr 1.00e-05 gnorm 0.200 3.14s mem 81.1GB +step 2268/5000 loss 0.2397 (w 0.1891 mse 0.1834 t 884 new 0.20) lr 1.00e-05 gnorm 0.204 3.04s mem 81.1GB +step 2269/5000 loss 0.2057 (w 0.2932 mse 0.2746 t 911 new 0.27) lr 1.00e-05 gnorm 0.224 3.12s mem 81.1GB +step 2270/5000 loss 0.2929 (w 0.0699 mse 0.0771 t 653 new 0.16) lr 1.00e-05 gnorm 0.173 3.11s mem 81.1GB +step 2271/5000 loss 0.2409 (w 0.2265 mse 0.2181 t 876 new 0.22) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +step 2272/5000 loss 0.1987 (w 0.2840 mse 0.2595 t 943 new 0.25) lr 1.00e-05 gnorm 0.139 3.40s mem 81.1GB +step 2273/5000 loss 0.3291 (w 0.3222 mse 0.3140 t 994 new 0.21) lr 1.00e-05 gnorm 0.247 3.41s mem 81.1GB +step 2274/5000 loss 0.1876 (w 0.2483 mse 0.2316 t 883 new 0.21) lr 1.00e-05 gnorm 0.395 3.06s mem 81.1GB +step 2275/5000 loss 0.2111 (w 0.1087 mse 0.1213 t 970 new 0.13) lr 1.00e-05 gnorm 0.228 3.15s mem 81.1GB +step 2276/5000 loss 0.1826 (w 0.2936 mse 0.2865 t 995 new 0.15) lr 1.00e-05 gnorm 0.173 3.11s mem 81.1GB +step 2277/5000 loss 0.3098 (w 0.3706 mse 0.3871 t 340 new 0.23) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +step 2278/5000 loss 0.2404 (w 0.2550 mse 0.2529 t 956 new 0.13) lr 1.00e-05 gnorm 0.246 3.43s mem 81.1GB +step 2279/5000 loss 0.1858 (w 0.2481 mse 0.2311 t 462 new 0.19) lr 1.00e-05 gnorm 0.195 3.11s mem 81.1GB +step 2280/5000 loss 0.2764 (w 0.2932 mse 0.2759 t 749 new 0.20) lr 1.00e-05 gnorm 0.216 3.29s mem 81.1GB +step 2281/5000 loss 0.1521 (w 0.3718 mse 0.3673 t 989 new 0.21) lr 1.00e-05 gnorm 0.502 3.14s mem 81.1GB +step 2282/5000 loss 0.1422 (w 0.1256 mse 0.1199 t 781 new 0.15) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 2283/5000 loss 0.3347 (w 0.1752 mse 0.1818 t 937 new 0.21) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +step 2284/5000 loss 0.1329 (w 0.3118 mse 0.3025 t 962 new 0.20) lr 1.00e-05 gnorm 0.237 3.51s mem 81.1GB +step 2285/5000 loss 0.1368 (w 0.1769 mse 0.1702 t 873 new 0.24) lr 1.00e-05 gnorm 0.273 3.16s mem 81.1GB +step 2286/5000 loss 0.4252 (w 0.3972 mse 0.3981 t 319 new 0.15) lr 1.00e-05 gnorm 0.205 3.32s mem 81.1GB +step 2287/5000 loss 0.2467 (w 0.3825 mse 0.3747 t 994 new 0.17) lr 1.00e-05 gnorm 0.163 3.37s mem 81.1GB +step 2288/5000 loss 0.2399 (w 0.2367 mse 0.2271 t 880 new 0.13) lr 1.00e-05 gnorm 0.140 2.86s mem 81.1GB +step 2289/5000 loss 0.3977 (w 0.2041 mse 0.2001 t 950 new 0.20) lr 1.00e-05 gnorm 0.165 3.22s mem 81.1GB +step 2290/5000 loss 0.2913 (w 0.2647 mse 0.2746 t 476 new 0.28) lr 1.00e-05 gnorm 0.162 3.40s mem 81.1GB +step 2291/5000 loss 0.3197 (w 0.6406 mse 0.6399 t 992 new 0.21) lr 1.00e-05 gnorm 0.144 3.11s mem 81.1GB +step 2292/5000 loss 0.1947 (w 0.1382 mse 0.1312 t 845 new 0.23) lr 1.00e-05 gnorm 0.167 3.53s mem 81.1GB +step 2293/5000 loss 0.1850 (w 0.2830 mse 0.2766 t 999 new 0.24) lr 1.00e-05 gnorm 0.188 3.34s mem 81.1GB +step 2294/5000 loss 0.2338 (w 0.1042 mse 0.1036 t 586 new 0.20) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +step 2295/5000 loss 0.1968 (w 0.2528 mse 0.2415 t 954 new 0.23) lr 1.00e-05 gnorm 0.248 3.21s mem 81.1GB +step 2296/5000 loss 0.1461 (w 0.4127 mse 0.4034 t 982 new 0.21) lr 1.00e-05 gnorm 0.161 3.10s mem 81.1GB +step 2297/5000 loss 0.1559 (w 0.1924 mse 0.1944 t 746 new 0.23) lr 1.00e-05 gnorm 0.133 2.86s mem 81.1GB +step 2298/5000 loss 0.2357 (w 0.2131 mse 0.2151 t 902 new 0.25) lr 1.00e-05 gnorm 0.224 3.38s mem 81.1GB +step 2299/5000 loss 0.2551 (w 0.1341 mse 0.1450 t 528 new 0.23) lr 1.00e-05 gnorm 0.494 3.12s mem 81.1GB +step 2300/5000 loss 0.1970 (w 0.3988 mse 0.3721 t 996 new 0.24) lr 1.00e-05 gnorm 0.187 2.85s mem 81.1GB +step 2301/5000 loss 0.1627 (w 0.1728 mse 0.1745 t 898 new 0.12) lr 1.00e-05 gnorm 0.129 3.20s mem 81.1GB +step 2302/5000 loss 0.2483 (w 0.2928 mse 0.2765 t 948 new 0.26) lr 1.00e-05 gnorm 0.185 3.11s mem 81.1GB +step 2303/5000 loss 0.3316 (w 0.2450 mse 0.2494 t 490 new 0.14) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +step 2304/5000 loss 0.4296 (w 0.2474 mse 0.2425 t 516 new 0.12) lr 1.00e-05 gnorm 0.176 3.38s mem 81.1GB +step 2305/5000 loss 0.1450 (w 0.2359 mse 0.2178 t 808 new 0.22) lr 1.00e-05 gnorm 0.147 3.05s mem 81.1GB +step 2306/5000 loss 0.2284 (w 0.1497 mse 0.1438 t 897 new 0.18) lr 1.00e-05 gnorm 0.169 2.85s mem 81.1GB +step 2307/5000 loss 0.1669 (w 0.2126 mse 0.2125 t 958 new 0.19) lr 1.00e-05 gnorm 0.430 3.17s mem 81.1GB +step 2308/5000 loss 0.2520 (w 0.2222 mse 0.2038 t 900 new 0.22) lr 1.00e-05 gnorm 0.170 3.10s mem 81.1GB +step 2309/5000 loss 0.1616 (w 0.1885 mse 0.1884 t 904 new 0.20) lr 1.00e-05 gnorm 0.487 2.85s mem 81.1GB +step 2310/5000 loss 0.1898 (w 0.1964 mse 0.1852 t 568 new 0.16) lr 1.00e-05 gnorm 0.249 3.41s mem 81.1GB +step 2311/5000 loss 0.3361 (w 0.2248 mse 0.2262 t 639 new 0.18) lr 1.00e-05 gnorm 0.202 3.08s mem 81.1GB +step 2312/5000 loss 0.2276 (w 0.1485 mse 0.1530 t 907 new 0.13) lr 1.00e-05 gnorm 0.197 2.84s mem 81.1GB +step 2313/5000 loss 0.2838 (w 0.2611 mse 0.2614 t 960 new 0.22) lr 1.00e-05 gnorm 0.237 3.36s mem 81.1GB +step 2314/5000 loss 0.1670 (w 0.3007 mse 0.2843 t 942 new 0.20) lr 1.00e-05 gnorm 0.179 3.30s mem 81.1GB +step 2315/5000 loss 0.2393 (w 0.2139 mse 0.2077 t 503 new 0.11) lr 1.00e-05 gnorm 0.148 3.11s mem 81.1GB +step 2316/5000 loss 0.1457 (w 0.1209 mse 0.1185 t 698 new 0.17) lr 1.00e-05 gnorm 0.150 3.28s mem 81.1GB +step 2317/5000 loss 0.3538 (w 0.2807 mse 0.2774 t 992 new 0.10) lr 1.00e-05 gnorm 0.786 3.14s mem 81.1GB +step 2318/5000 loss 0.2919 (w 0.3854 mse 0.3810 t 980 new 0.14) lr 1.00e-05 gnorm 0.201 2.85s mem 81.1GB +step 2319/5000 loss 0.2091 (w 0.2059 mse 0.1949 t 922 new 0.21) lr 1.00e-05 gnorm 0.136 3.35s mem 81.1GB +step 2320/5000 loss 0.2431 (w 0.2036 mse 0.1970 t 867 new 0.17) lr 1.00e-05 gnorm 0.181 3.40s mem 81.1GB +step 2321/5000 loss 0.3469 (w 0.1706 mse 0.1713 t 865 new 0.22) lr 1.00e-05 gnorm 0.353 3.18s mem 81.1GB +step 2322/5000 loss 0.0711 (w 0.2019 mse 0.2005 t 967 new 0.21) lr 1.00e-05 gnorm 0.132 3.35s mem 81.1GB +step 2323/5000 loss 0.2103 (w 0.2599 mse 0.2573 t 964 new 0.21) lr 1.00e-05 gnorm 0.163 2.84s mem 81.1GB +step 2324/5000 loss 0.2396 (w 0.2112 mse 0.1972 t 636 new 0.21) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +step 2325/5000 loss 0.1438 (w 0.3235 mse 0.3259 t 979 new 0.20) lr 1.00e-05 gnorm 1.318 3.39s mem 81.1GB +step 2326/5000 loss 0.3435 (w 0.1345 mse 0.1259 t 805 new 0.21) lr 1.00e-05 gnorm 0.140 3.11s mem 81.1GB +step 2327/5000 loss 0.5162 (w 0.3639 mse 0.3668 t 297 new 0.20) lr 1.00e-05 gnorm 0.140 3.35s mem 81.1GB +step 2328/5000 loss 0.2670 (w 0.2265 mse 0.2236 t 930 new 0.16) lr 1.00e-05 gnorm 0.161 3.28s mem 81.1GB +step 2329/5000 loss 0.2697 (w 0.1523 mse 0.1594 t 993 new 0.18) lr 1.00e-05 gnorm 0.184 2.84s mem 81.1GB +step 2330/5000 loss 0.2421 (w 0.2698 mse 0.2643 t 866 new 0.28) lr 1.00e-05 gnorm 0.150 3.18s mem 81.1GB +step 2331/5000 loss 0.2082 (w 0.1858 mse 0.1870 t 860 new 0.22) lr 1.00e-05 gnorm 0.138 3.10s mem 81.1GB +step 2332/5000 loss 0.1507 (w 0.1918 mse 0.1779 t 757 new 0.25) lr 1.00e-05 gnorm 0.114 3.13s mem 81.1GB +step 2333/5000 loss 0.2041 (w 0.2328 mse 0.2332 t 889 new 0.19) lr 1.00e-05 gnorm 0.142 3.45s mem 81.1GB +step 2334/5000 loss 0.2637 (w 0.2174 mse 0.2178 t 508 new 0.24) lr 1.00e-05 gnorm 0.604 3.40s mem 81.1GB +step 2335/5000 loss 0.1489 (w 0.2385 mse 0.2297 t 942 new 0.21) lr 1.00e-05 gnorm 0.170 2.85s mem 81.1GB +step 2336/5000 loss 0.2582 (w 0.1436 mse 0.1409 t 855 new 0.11) lr 1.00e-05 gnorm 0.132 3.12s mem 81.1GB +step 2337/5000 loss 0.1931 (w 0.3190 mse 0.3143 t 974 new 0.21) lr 1.00e-05 gnorm 0.197 3.28s mem 81.1GB +step 2338/5000 loss 0.3051 (w 0.0932 mse 0.0951 t 603 new 0.13) lr 1.00e-05 gnorm 0.142 3.11s mem 81.1GB +step 2339/5000 loss 0.1654 (w 0.1399 mse 0.1412 t 705 new 0.16) lr 1.00e-05 gnorm 0.779 3.35s mem 81.1GB +step 2340/5000 loss 0.2210 (w 0.2242 mse 0.2122 t 953 new 0.26) lr 1.00e-05 gnorm 0.186 3.16s mem 81.1GB +step 2341/5000 loss 0.3060 (w 0.2038 mse 0.1950 t 886 new 0.20) lr 1.00e-05 gnorm 0.193 2.84s mem 81.1GB +step 2342/5000 loss 0.1243 (w 0.1879 mse 0.1825 t 979 new 0.26) lr 1.00e-05 gnorm 0.168 3.19s mem 81.1GB +step 2343/5000 loss 0.2195 (w 0.1684 mse 0.1587 t 873 new 0.19) lr 1.00e-05 gnorm 1.659 3.36s mem 81.1GB +step 2344/5000 loss 0.2882 (w 0.2187 mse 0.2195 t 918 new 0.22) lr 1.00e-05 gnorm 0.234 2.85s mem 81.1GB +step 2345/5000 loss 0.2961 (w 0.2285 mse 0.2207 t 901 new 0.20) lr 1.00e-05 gnorm 0.302 3.39s mem 81.1GB +step 2346/5000 loss 0.1465 (w 0.1877 mse 0.1916 t 893 new 0.22) lr 1.00e-05 gnorm 0.130 3.08s mem 81.1GB +step 2347/5000 loss 0.3060 (w 0.3389 mse 0.3299 t 269 new 0.22) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +step 2348/5000 loss 0.2840 (w 0.2161 mse 0.2043 t 662 new 0.19) lr 1.00e-05 gnorm 0.231 3.19s mem 81.1GB +step 2349/5000 loss 0.2123 (w 0.2511 mse 0.2486 t 925 new 0.18) lr 1.00e-05 gnorm 0.294 3.34s mem 81.1GB +step 2350/5000 loss 0.1210 (w 0.2757 mse 0.2693 t 876 new 0.21) lr 1.00e-05 gnorm 0.223 3.13s mem 81.1GB +step 2351/5000 loss 0.3214 (w 0.4166 mse 0.3999 t 992 new 0.21) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +step 2352/5000 loss 0.1982 (w 0.3490 mse 0.3203 t 895 new 0.22) lr 1.00e-05 gnorm 0.183 3.13s mem 81.1GB +step 2353/5000 loss 0.2698 (w 0.1269 mse 0.1181 t 894 new 0.21) lr 1.00e-05 gnorm 0.209 2.84s mem 81.1GB +step 2354/5000 loss 0.1254 (w 0.1429 mse 0.1410 t 610 new 0.25) lr 1.00e-05 gnorm 0.149 3.41s mem 81.1GB +step 2355/5000 loss 0.3495 (w 0.2087 mse 0.2076 t 672 new 0.24) lr 1.00e-05 gnorm 0.146 3.13s mem 81.1GB +step 2356/5000 loss 0.1794 (w 0.2638 mse 0.2441 t 910 new 0.28) lr 1.00e-05 gnorm 0.153 3.17s mem 81.1GB +step 2357/5000 loss 0.3006 (w 0.3411 mse 0.3417 t 264 new 0.01) lr 1.00e-05 gnorm 0.143 3.28s mem 81.1GB +step 2358/5000 loss 0.1678 (w 0.3223 mse 0.3264 t 996 new 0.23) lr 1.00e-05 gnorm 0.221 2.84s mem 81.1GB +step 2359/5000 loss 0.3214 (w 0.3162 mse 0.3203 t 421 new 0.18) lr 1.00e-05 gnorm 0.208 2.83s mem 81.1GB +step 2360/5000 loss 0.2166 (w 0.2509 mse 0.2361 t 854 new 0.29) lr 1.00e-05 gnorm 0.226 3.36s mem 81.1GB +step 2361/5000 loss 0.1950 (w 0.1840 mse 0.1761 t 726 new 0.09) lr 1.00e-05 gnorm 0.366 3.13s mem 81.1GB +step 2362/5000 loss 0.1930 (w 0.3214 mse 0.3202 t 973 new 0.16) lr 1.00e-05 gnorm 0.139 3.15s mem 81.1GB +step 2363/5000 loss 0.2666 (w 0.1719 mse 0.1614 t 770 new 0.21) lr 1.00e-05 gnorm 0.222 3.36s mem 81.1GB +step 2364/5000 loss 0.2490 (w 0.1436 mse 0.1507 t 894 new 0.23) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +step 2365/5000 loss 0.2216 (w 0.3635 mse 0.3590 t 979 new 0.25) lr 1.00e-05 gnorm 0.267 3.16s mem 81.1GB +step 2366/5000 loss 0.3520 (w 0.2941 mse 0.2932 t 970 new 0.18) lr 1.00e-05 gnorm 0.252 3.06s mem 81.1GB +step 2367/5000 loss 0.1653 (w 0.2410 mse 0.2408 t 925 new 0.10) lr 1.00e-05 gnorm 0.154 3.12s mem 81.1GB +step 2368/5000 loss 0.1567 (w 0.3098 mse 0.2908 t 921 new 0.16) lr 1.00e-05 gnorm 0.114 3.42s mem 81.1GB +step 2369/5000 loss 0.3081 (w 0.2140 mse 0.2044 t 911 new 0.11) lr 1.00e-05 gnorm 0.182 3.09s mem 81.1GB +step 2370/5000 loss 0.2493 (w 0.2111 mse 0.1967 t 895 new 0.22) lr 1.00e-05 gnorm 0.146 2.85s mem 81.1GB +step 2371/5000 loss 0.3153 (w 0.1676 mse 0.1641 t 733 new 0.24) lr 1.00e-05 gnorm 0.200 3.17s mem 81.1GB +step 2372/5000 loss 0.2523 (w 0.2693 mse 0.2574 t 960 new 0.14) lr 1.00e-05 gnorm 0.230 3.10s mem 81.1GB +step 2373/5000 loss 0.3377 (w 0.2221 mse 0.2179 t 905 new 0.19) lr 1.00e-05 gnorm 0.365 3.11s mem 81.1GB +step 2374/5000 loss 0.4097 (w 0.4456 mse 0.4418 t 165 new 0.23) lr 1.00e-05 gnorm 0.295 3.44s mem 81.1GB +step 2375/5000 loss 0.1919 (w 0.4981 mse 0.5073 t 134 new 0.09) lr 1.00e-05 gnorm 0.166 3.09s mem 81.1GB +step 2376/5000 loss 0.2341 (w 0.3255 mse 0.3070 t 980 new 0.23) lr 1.00e-05 gnorm 0.170 2.85s mem 81.1GB +step 2377/5000 loss 0.2413 (w 0.2458 mse 0.2474 t 994 new 0.20) lr 1.00e-05 gnorm 0.140 3.13s mem 81.1GB +step 2378/5000 loss 0.0693 (w 0.1660 mse 0.1674 t 955 new 0.13) lr 1.00e-05 gnorm 0.150 3.34s mem 81.1GB +step 2379/5000 loss 0.3907 (w 0.2169 mse 0.2090 t 882 new 0.23) lr 1.00e-05 gnorm 0.208 3.38s mem 81.1GB +step 2380/5000 loss 0.2078 (w 0.2623 mse 0.2654 t 966 new 0.15) lr 1.00e-05 gnorm 0.315 2.84s mem 81.1GB +step 2381/5000 loss 0.2408 (w 0.2846 mse 0.2677 t 566 new 0.20) lr 1.00e-05 gnorm 0.248 3.13s mem 81.1GB +step 2382/5000 loss 0.2869 (w 0.2040 mse 0.1979 t 940 new 0.20) lr 1.00e-05 gnorm 0.141 2.86s mem 81.1GB +step 2383/5000 loss 0.2256 (w 0.2590 mse 0.2390 t 953 new 0.15) lr 1.00e-05 gnorm 0.171 3.17s mem 81.1GB +step 2384/5000 loss 0.2736 (w 0.2767 mse 0.2536 t 936 new 0.24) lr 1.00e-05 gnorm 0.295 3.34s mem 81.1GB +step 2385/5000 loss 0.2631 (w 0.2387 mse 0.2263 t 708 new 0.24) lr 1.00e-05 gnorm 0.460 3.10s mem 81.1GB +step 2386/5000 loss 0.1849 (w 0.2625 mse 0.2494 t 908 new 0.25) lr 1.00e-05 gnorm 0.169 3.12s mem 81.1GB +step 2387/5000 loss 0.3156 (w 0.3394 mse 0.3430 t 976 new 0.15) lr 1.00e-05 gnorm 0.187 3.15s mem 81.1GB +step 2388/5000 loss 0.1531 (w 0.2797 mse 0.2731 t 975 new 0.18) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +step 2389/5000 loss 0.2530 (w 0.1658 mse 0.1721 t 612 new 0.13) lr 1.00e-05 gnorm 0.241 3.09s mem 81.1GB +step 2390/5000 loss 0.2094 (w 0.1247 mse 0.1262 t 884 new 0.06) lr 1.00e-05 gnorm 0.333 3.31s mem 81.1GB +step 2391/5000 loss 0.2243 (w 0.2881 mse 0.2802 t 444 new 0.22) lr 1.00e-05 gnorm 0.200 3.13s mem 81.1GB +step 2392/5000 loss 0.2098 (w 0.3518 mse 0.3319 t 965 new 0.25) lr 1.00e-05 gnorm 0.671 3.15s mem 81.1GB +step 2393/5000 loss 0.2553 (w 0.2369 mse 0.2046 t 885 new 0.22) lr 1.00e-05 gnorm 0.272 3.06s mem 81.1GB +step 2394/5000 loss 0.2441 (w 0.2321 mse 0.2233 t 637 new 0.26) lr 1.00e-05 gnorm 0.163 2.84s mem 81.1GB +step 2395/5000 loss 0.4282 (w 0.1951 mse 0.1930 t 737 new 0.22) lr 1.00e-05 gnorm 0.221 3.11s mem 81.1GB +step 2396/5000 loss 0.1163 (w 0.1049 mse 0.1087 t 869 new 0.09) lr 1.00e-05 gnorm 0.254 3.38s mem 81.1GB +step 2397/5000 loss 0.1488 (w 0.1786 mse 0.1646 t 995 new 0.16) lr 1.00e-05 gnorm 0.202 3.11s mem 81.1GB +step 2398/5000 loss 0.2943 (w 0.2037 mse 0.2057 t 633 new 0.25) lr 1.00e-05 gnorm 0.265 3.06s mem 81.1GB +step 2399/5000 loss 0.1384 (w 0.2833 mse 0.2875 t 919 new 0.23) lr 1.00e-05 gnorm 0.148 3.12s mem 81.1GB +step 2400/5000 loss 0.2552 (w 0.2150 mse 0.2030 t 930 new 0.26) lr 1.00e-05 gnorm 0.637 2.85s mem 81.1GB +step 2401/5000 loss 0.3491 (w 0.2816 mse 0.2760 t 942 new 0.22) lr 1.00e-05 gnorm 0.188 3.38s mem 81.1GB +step 2402/5000 loss 0.1722 (w 0.2144 mse 0.2099 t 996 new 0.20) lr 1.00e-05 gnorm 1.396 3.36s mem 81.1GB +step 2403/5000 loss 0.2381 (w 0.1391 mse 0.1391 t 566 new 0.11) lr 1.00e-05 gnorm 0.273 3.14s mem 81.1GB +step 2404/5000 loss 0.2727 (w 0.2485 mse 0.2466 t 447 new 0.21) lr 1.00e-05 gnorm 0.205 3.37s mem 81.1GB +step 2405/5000 loss 0.2041 (w 0.2155 mse 0.2054 t 826 new 0.21) lr 1.00e-05 gnorm 0.174 2.85s mem 81.1GB +step 2406/5000 loss 0.4668 (w 0.2266 mse 0.2162 t 926 new 0.21) lr 1.00e-05 gnorm 0.304 2.85s mem 81.1GB +step 2407/5000 loss 0.1994 (w 0.1418 mse 0.1549 t 959 new 0.24) lr 1.00e-05 gnorm 0.229 3.42s mem 81.1GB +step 2408/5000 loss 0.1133 (w 0.0921 mse 0.0989 t 650 new 0.08) lr 1.00e-05 gnorm 0.169 3.12s mem 81.1GB +step 2409/5000 loss 0.3212 (w 0.2173 mse 0.2100 t 850 new 0.22) lr 1.00e-05 gnorm 0.210 3.39s mem 81.1GB +step 2410/5000 loss 0.2784 (w 0.2472 mse 0.2329 t 751 new 0.17) lr 1.00e-05 gnorm 0.207 3.06s mem 81.1GB +step 2411/5000 loss 0.3351 (w 0.2849 mse 0.2654 t 813 new 0.25) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +step 2412/5000 loss 0.1961 (w 0.1690 mse 0.1528 t 774 new 0.18) lr 1.00e-05 gnorm 0.159 3.14s mem 81.1GB +step 2413/5000 loss 0.2446 (w 0.2290 mse 0.2224 t 741 new 0.21) lr 1.00e-05 gnorm 0.155 3.05s mem 81.1GB +step 2414/5000 loss 0.1523 (w 0.1512 mse 0.1497 t 932 new 0.18) lr 1.00e-05 gnorm 0.182 3.12s mem 81.1GB +step 2415/5000 loss 0.2054 (w 0.1792 mse 0.2036 t 434 new 0.24) lr 1.00e-05 gnorm 0.162 3.45s mem 81.1GB +step 2416/5000 loss 0.2885 (w 0.2130 mse 0.2102 t 945 new 0.22) lr 1.00e-05 gnorm 0.340 3.07s mem 81.1GB +step 2417/5000 loss 0.3080 (w 0.3374 mse 0.3330 t 989 new 0.22) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +step 2418/5000 loss 0.1456 (w 0.2036 mse 0.2122 t 957 new 0.25) lr 1.00e-05 gnorm 0.369 3.18s mem 81.1GB +step 2419/5000 loss 0.1311 (w 0.1688 mse 0.1653 t 898 new 0.14) lr 1.00e-05 gnorm 0.229 3.05s mem 81.1GB +step 2420/5000 loss 0.1734 (w 0.3334 mse 0.3261 t 981 new 0.23) lr 1.00e-05 gnorm 0.163 3.13s mem 81.1GB +step 2421/5000 loss 0.2621 (w 0.3748 mse 0.3434 t 975 new 0.23) lr 1.00e-05 gnorm 0.163 3.06s mem 81.1GB +step 2422/5000 loss 0.1955 (w 0.3087 mse 0.3287 t 978 new 0.21) lr 1.00e-05 gnorm 0.290 3.11s mem 81.1GB +step 2423/5000 loss 0.1400 (w 0.2256 mse 0.2129 t 650 new 0.16) lr 1.00e-05 gnorm 0.162 2.86s mem 81.1GB +step 2424/5000 loss 0.2489 (w 0.2297 mse 0.2245 t 935 new 0.10) lr 1.00e-05 gnorm 0.913 3.20s mem 81.1GB +step 2425/5000 loss 0.0929 (w 0.2359 mse 0.2375 t 907 new 0.16) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +step 2426/5000 loss 0.1362 (w 0.1963 mse 0.1945 t 798 new 0.21) lr 1.00e-05 gnorm 0.180 3.61s mem 81.1GB +step 2427/5000 loss 0.2171 (w 0.2020 mse 0.2022 t 863 new 0.23) lr 1.00e-05 gnorm 0.775 3.12s mem 81.1GB +step 2428/5000 loss 0.3762 (w 0.1352 mse 0.1369 t 747 new 0.28) lr 1.00e-05 gnorm 0.158 3.33s mem 81.1GB +step 2429/5000 loss 0.3289 (w 0.2951 mse 0.2577 t 939 new 0.23) lr 1.00e-05 gnorm 0.170 2.84s mem 81.1GB +step 2430/5000 loss 0.2665 (w 0.2712 mse 0.2628 t 959 new 0.19) lr 1.00e-05 gnorm 0.150 3.14s mem 81.1GB +step 2431/5000 loss 0.2526 (w 0.2092 mse 0.2140 t 940 new 0.22) lr 1.00e-05 gnorm 0.173 3.30s mem 81.1GB +step 2432/5000 loss 0.2051 (w 0.1537 mse 0.1508 t 886 new 0.21) lr 1.00e-05 gnorm 0.113 3.20s mem 81.1GB +step 2433/5000 loss 0.2437 (w 0.1234 mse 0.1181 t 731 new 0.22) lr 1.00e-05 gnorm 8.180 3.08s mem 81.1GB +step 2434/5000 loss 0.2125 (w 0.1772 mse 0.1796 t 870 new 0.22) lr 1.00e-05 gnorm 0.126 3.41s mem 81.1GB +step 2435/5000 loss 0.2943 (w 0.3657 mse 0.3735 t 306 new 0.23) lr 1.00e-05 gnorm 0.147 2.85s mem 81.1GB +step 2436/5000 loss 0.1470 (w 0.3228 mse 0.3303 t 966 new 0.16) lr 1.00e-05 gnorm 0.123 3.16s mem 81.1GB +step 2437/5000 loss 0.2883 (w 0.2364 mse 0.2424 t 859 new 0.11) lr 1.00e-05 gnorm 0.236 3.41s mem 81.1GB +step 2438/5000 loss 0.2793 (w 0.2508 mse 0.2414 t 892 new 0.21) lr 1.00e-05 gnorm 1.328 3.23s mem 81.1GB +step 2439/5000 loss 0.2728 (w 0.2535 mse 0.2509 t 913 new 0.19) lr 1.00e-05 gnorm 0.126 3.30s mem 81.1GB +step 2440/5000 loss 0.2015 (w 0.1384 mse 0.1418 t 943 new 0.22) lr 1.00e-05 gnorm 0.210 3.06s mem 81.1GB +step 2441/5000 loss 0.3457 (w 0.1182 mse 0.1412 t 969 new 0.21) lr 1.00e-05 gnorm 0.279 3.20s mem 81.1GB +step 2442/5000 loss 0.3583 (w 0.2283 mse 0.2347 t 1000 new 0.21) lr 1.00e-05 gnorm 0.178 3.13s mem 81.1GB +step 2443/5000 loss 0.1759 (w 0.3292 mse 0.3024 t 961 new 0.20) lr 1.00e-05 gnorm 0.143 3.38s mem 81.1GB +step 2444/5000 loss 0.3636 (w 0.2276 mse 0.2204 t 872 new 0.20) lr 1.00e-05 gnorm 0.312 3.31s mem 81.1GB +step 2445/5000 loss 0.2135 (w 0.1786 mse 0.1659 t 802 new 0.18) lr 1.00e-05 gnorm 0.160 3.29s mem 81.1GB +step 2446/5000 loss 0.2923 (w 0.2348 mse 0.2399 t 896 new 0.19) lr 1.00e-05 gnorm 0.945 3.10s mem 81.1GB +step 2447/5000 loss 0.2121 (w 0.3326 mse 0.3102 t 962 new 0.26) lr 1.00e-05 gnorm 0.138 3.20s mem 81.1GB +step 2448/5000 loss 0.2982 (w 0.3835 mse 0.4003 t 183 new 0.22) lr 1.00e-05 gnorm 0.142 3.03s mem 81.1GB +step 2449/5000 loss 0.1875 (w 0.1889 mse 0.1829 t 862 new 0.22) lr 1.00e-05 gnorm 0.130 3.31s mem 81.1GB +step 2450/5000 loss 0.1413 (w 0.2106 mse 0.2089 t 953 new 0.18) lr 1.00e-05 gnorm 0.182 3.26s mem 81.1GB +step 2451/5000 loss 0.2365 (w 0.3098 mse 0.3142 t 428 new 0.26) lr 1.00e-05 gnorm 0.113 3.31s mem 81.1GB +step 2452/5000 loss 0.2436 (w 0.1793 mse 0.1800 t 670 new 0.22) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 2453/5000 loss 0.3100 (w 0.1760 mse 0.1933 t 931 new 0.16) lr 1.00e-05 gnorm 0.340 3.11s mem 81.1GB +step 2454/5000 loss 0.2015 (w 0.1499 mse 0.1526 t 968 new 0.23) lr 1.00e-05 gnorm 0.120 3.07s mem 81.1GB +step 2455/5000 loss 0.3355 (w 0.3418 mse 0.3337 t 390 new 0.21) lr 1.00e-05 gnorm 0.128 3.35s mem 81.1GB +step 2456/5000 loss 0.3279 (w 0.1568 mse 0.1691 t 892 new 0.18) lr 1.00e-05 gnorm 0.152 3.56s mem 81.1GB +step 2457/5000 loss 0.2615 (w 0.3148 mse 0.2938 t 966 new 0.22) lr 1.00e-05 gnorm 0.153 3.10s mem 81.1GB +step 2458/5000 loss 0.2927 (w 0.2473 mse 0.2495 t 562 new 0.19) lr 1.00e-05 gnorm 0.188 2.85s mem 81.1GB +step 2459/5000 loss 0.2268 (w 0.2084 mse 0.2011 t 663 new 0.24) lr 1.00e-05 gnorm 0.259 3.18s mem 81.1GB +step 2460/5000 loss 0.1240 (w 0.2736 mse 0.2759 t 936 new 0.07) lr 1.00e-05 gnorm 0.173 3.11s mem 81.1GB +step 2461/5000 loss 0.1724 (w 0.2768 mse 0.2607 t 980 new 0.18) lr 1.00e-05 gnorm 0.135 3.09s mem 81.1GB +step 2462/5000 loss 0.1712 (w 0.1275 mse 0.1385 t 967 new 0.09) lr 1.00e-05 gnorm 0.220 3.41s mem 81.1GB +step 2463/5000 loss 0.2139 (w 0.1746 mse 0.1734 t 570 new 0.20) lr 1.00e-05 gnorm 0.164 3.08s mem 81.1GB +step 2464/5000 loss 0.1239 (w 0.2684 mse 0.2542 t 979 new 0.21) lr 1.00e-05 gnorm 0.318 2.84s mem 81.1GB +step 2465/5000 loss 0.3403 (w 0.4140 mse 0.4081 t 249 new 0.17) lr 1.00e-05 gnorm 0.137 3.20s mem 81.1GB +step 2466/5000 loss 0.1621 (w 0.2342 mse 0.2183 t 731 new 0.24) lr 1.00e-05 gnorm 0.205 3.28s mem 81.1GB +step 2467/5000 loss 0.1203 (w 0.2225 mse 0.2054 t 927 new 0.23) lr 1.00e-05 gnorm 0.797 3.34s mem 81.1GB +step 2468/5000 loss 0.1484 (w 0.4106 mse 0.3931 t 988 new 0.21) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +step 2469/5000 loss 0.2716 (w 0.1769 mse 0.1738 t 790 new 0.16) lr 1.00e-05 gnorm 0.140 3.28s mem 81.1GB +step 2470/5000 loss 0.3174 (w 0.3975 mse 0.3969 t 323 new 0.22) lr 1.00e-05 gnorm 0.232 2.85s mem 81.1GB +step 2471/5000 loss 0.2053 (w 0.3185 mse 0.3252 t 942 new 0.17) lr 1.00e-05 gnorm 0.157 3.20s mem 81.1GB +step 2472/5000 loss 0.1415 (w 0.1890 mse 0.1922 t 841 new 0.21) lr 1.00e-05 gnorm 0.132 3.43s mem 81.1GB +step 2473/5000 loss 0.3062 (w 0.2181 mse 0.2073 t 730 new 0.23) lr 1.00e-05 gnorm 0.169 3.59s mem 81.1GB +step 2474/5000 loss 0.2470 (w 0.2645 mse 0.2462 t 993 new 0.23) lr 1.00e-05 gnorm 0.165 3.07s mem 81.1GB +step 2475/5000 loss 0.1642 (w 0.2815 mse 0.2561 t 920 new 0.23) lr 1.00e-05 gnorm 0.217 3.32s mem 81.1GB +step 2476/5000 loss 0.4587 (w 0.2655 mse 0.2551 t 959 new 0.19) lr 1.00e-05 gnorm 0.165 2.85s mem 81.1GB +step 2477/5000 loss 0.1819 (w 0.1877 mse 0.1819 t 840 new 0.26) lr 1.00e-05 gnorm 0.106 3.33s mem 81.1GB +step 2478/5000 loss 0.2258 (w 0.2481 mse 0.2431 t 982 new 0.10) lr 1.00e-05 gnorm 0.155 3.16s mem 81.1GB +step 2479/5000 loss 0.0979 (w 0.1917 mse 0.1923 t 912 new 0.19) lr 1.00e-05 gnorm 0.116 3.51s mem 81.1GB +step 2480/5000 loss 0.3065 (w 0.1397 mse 0.1529 t 825 new 0.16) lr 1.00e-05 gnorm 0.165 3.28s mem 81.1GB +step 2481/5000 loss 0.4424 (w 0.1181 mse 0.1175 t 751 new 0.11) lr 1.00e-05 gnorm 0.418 3.12s mem 81.1GB +step 2482/5000 loss 0.4362 (w 0.2235 mse 0.2113 t 776 new 0.24) lr 1.00e-05 gnorm 0.134 2.85s mem 81.1GB +step 2483/5000 loss 0.2504 (w 0.1673 mse 0.1621 t 737 new 0.10) lr 1.00e-05 gnorm 0.180 3.64s mem 81.1GB +step 2484/5000 loss 0.2695 (w 0.2133 mse 0.2098 t 924 new 0.23) lr 1.00e-05 gnorm 0.196 3.63s mem 81.1GB +step 2485/5000 loss 0.1440 (w 0.1789 mse 0.1565 t 901 new 0.22) lr 1.00e-05 gnorm 0.169 3.23s mem 81.1GB +step 2486/5000 loss 0.2427 (w 0.2537 mse 0.2491 t 942 new 0.25) lr 1.00e-05 gnorm 0.684 3.33s mem 81.1GB +step 2487/5000 loss 0.2524 (w 0.1926 mse 0.1841 t 933 new 0.24) lr 1.00e-05 gnorm 0.254 3.13s mem 81.1GB +step 2488/5000 loss 0.1801 (w 0.1486 mse 0.1546 t 881 new 0.23) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +step 2489/5000 loss 0.4207 (w 0.3053 mse 0.3065 t 447 new 0.20) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +step 2490/5000 loss 0.2760 (w 0.1359 mse 0.1432 t 733 new 0.09) lr 1.00e-05 gnorm 0.162 3.44s mem 81.1GB +step 2491/5000 loss 0.2121 (w 0.2552 mse 0.2413 t 931 new 0.20) lr 1.00e-05 gnorm 0.167 3.13s mem 81.1GB +step 2492/5000 loss 0.2228 (w 0.3008 mse 0.2935 t 513 new 0.23) lr 1.00e-05 gnorm 0.189 3.09s mem 81.1GB +step 2493/5000 loss 0.2110 (w 0.2286 mse 0.2159 t 923 new 0.20) lr 1.00e-05 gnorm 0.120 3.06s mem 81.1GB +step 2494/5000 loss 0.1344 (w 0.2472 mse 0.2410 t 931 new 0.26) lr 1.00e-05 gnorm 0.175 3.19s mem 81.1GB +step 2495/5000 loss 0.2718 (w 0.2836 mse 0.2853 t 964 new 0.25) lr 1.00e-05 gnorm 0.129 3.40s mem 81.1GB +step 2496/5000 loss 0.2622 (w 0.2396 mse 0.2314 t 795 new 0.19) lr 1.00e-05 gnorm 0.172 3.13s mem 81.1GB +step 2497/5000 loss 0.2727 (w 0.1535 mse 0.1571 t 946 new 0.17) lr 1.00e-05 gnorm 0.168 3.13s mem 81.1GB +step 2498/5000 loss 0.2493 (w 0.2587 mse 0.2443 t 918 new 0.17) lr 1.00e-05 gnorm 0.184 3.12s mem 81.1GB +step 2499/5000 loss 0.1390 (w 0.1857 mse 0.1873 t 931 new 0.13) lr 1.00e-05 gnorm 0.161 3.09s mem 81.1GB +step 2500/5000 loss 0.1917 (w 0.2619 mse 0.2642 t 904 new 0.13) lr 1.00e-05 gnorm 0.204 3.19s mem 81.1GB +[val] step 2500 t=200: w=0.4208 mse=0.4317 (n=16) t=500: w=0.2241 mse=0.2278 (n=16) t=800: w=0.1753 mse=0.1748 (n=16) | mean w=0.2734 mse=0.2781 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step2500.safetensors 4093 个张量 37.98 GB +step 2501/5000 loss 0.2615 (w 0.2606 mse 0.2587 t 895 new 0.20) lr 1.00e-05 gnorm 1.347 3.43s mem 81.1GB +step 2502/5000 loss 0.1220 (w 0.2658 mse 0.2696 t 969 new 0.21) lr 1.00e-05 gnorm 0.120 3.35s mem 81.1GB +step 2503/5000 loss 0.2007 (w 0.3178 mse 0.3055 t 397 new 0.20) lr 1.00e-05 gnorm 0.131 3.12s mem 81.1GB +step 2504/5000 loss 0.1354 (w 0.2686 mse 0.2506 t 968 new 0.22) lr 1.00e-05 gnorm 0.464 3.35s mem 81.1GB +step 2505/5000 loss 0.1850 (w 0.2489 mse 0.2379 t 939 new 0.22) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +step 2506/5000 loss 0.1356 (w 0.3662 mse 0.3382 t 979 new 0.17) lr 1.00e-05 gnorm 0.153 3.19s mem 81.1GB +step 2507/5000 loss 0.2835 (w 0.1838 mse 0.1803 t 774 new 0.08) lr 1.00e-05 gnorm 0.179 3.16s mem 81.1GB +step 2508/5000 loss 0.2744 (w 0.1590 mse 0.1562 t 513 new 0.14) lr 1.00e-05 gnorm 0.129 3.35s mem 81.1GB +step 2509/5000 loss 0.1708 (w 0.2135 mse 0.2105 t 906 new 0.14) lr 1.00e-05 gnorm 0.607 3.11s mem 81.1GB +step 2510/5000 loss 0.2760 (w 0.2934 mse 0.2752 t 856 new 0.15) lr 1.00e-05 gnorm 0.178 3.37s mem 81.1GB +step 2511/5000 loss 0.2183 (w 0.2104 mse 0.2131 t 996 new 0.22) lr 1.00e-05 gnorm 0.184 2.85s mem 81.1GB +step 2512/5000 loss 0.3299 (w 0.2508 mse 0.2546 t 977 new 0.19) lr 1.00e-05 gnorm 0.182 3.17s mem 81.1GB +step 2513/5000 loss 0.1633 (w 0.2873 mse 0.2837 t 966 new 0.22) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +step 2514/5000 loss 0.3052 (w 0.3832 mse 0.3797 t 254 new 0.12) lr 1.00e-05 gnorm 0.106 3.06s mem 81.1GB +step 2515/5000 loss 0.3078 (w 0.3808 mse 0.3728 t 967 new 0.15) lr 1.00e-05 gnorm 0.155 3.15s mem 81.1GB +step 2516/5000 loss 0.3001 (w 0.2424 mse 0.2473 t 944 new 0.22) lr 1.00e-05 gnorm 0.150 3.14s mem 81.1GB +step 2517/5000 loss 0.3620 (w 0.2368 mse 0.2385 t 557 new 0.23) lr 1.00e-05 gnorm 0.315 2.84s mem 81.1GB +step 2518/5000 loss 0.2787 (w 0.3401 mse 0.3435 t 283 new 0.19) lr 1.00e-05 gnorm 0.142 3.40s mem 81.1GB +step 2519/5000 loss 0.2130 (w 0.1661 mse 0.1787 t 981 new 0.17) lr 1.00e-05 gnorm 0.138 3.35s mem 81.1GB +step 2520/5000 loss 0.1336 (w 0.2222 mse 0.2177 t 849 new 0.15) lr 1.00e-05 gnorm 0.188 3.10s mem 81.1GB +step 2521/5000 loss 0.1888 (w 0.1295 mse 0.1345 t 804 new 0.10) lr 1.00e-05 gnorm 0.161 3.03s mem 81.1GB +step 2522/5000 loss 0.2936 (w 0.2082 mse 0.2140 t 835 new 0.23) lr 1.00e-05 gnorm 0.344 3.09s mem 81.1GB +step 2523/5000 loss 0.1328 (w 0.1823 mse 0.1770 t 849 new 0.21) lr 1.00e-05 gnorm 0.711 3.09s mem 81.1GB +step 2524/5000 loss 0.1656 (w 0.2575 mse 0.2365 t 926 new 0.22) lr 1.00e-05 gnorm 0.143 3.33s mem 81.1GB +step 2525/5000 loss 0.3749 (w 0.0992 mse 0.0964 t 881 new 0.24) lr 1.00e-05 gnorm 0.183 3.10s mem 81.1GB +step 2526/5000 loss 0.1919 (w 0.1463 mse 0.1411 t 917 new 0.21) lr 1.00e-05 gnorm 0.153 3.15s mem 81.1GB +step 2527/5000 loss 0.2571 (w 0.3552 mse 0.3545 t 292 new 0.24) lr 1.00e-05 gnorm 0.137 3.37s mem 81.1GB +step 2528/5000 loss 0.2370 (w 0.0997 mse 0.1012 t 914 new 0.18) lr 1.00e-05 gnorm 0.511 3.13s mem 81.1GB +step 2529/5000 loss 0.2780 (w 0.3526 mse 0.3548 t 1000 new 0.16) lr 1.00e-05 gnorm 0.715 3.12s mem 81.1GB +step 2530/5000 loss 0.0944 (w 0.1840 mse 0.1797 t 977 new 0.20) lr 1.00e-05 gnorm 0.173 3.40s mem 81.1GB +step 2531/5000 loss 0.2709 (w 0.2125 mse 0.2053 t 737 new 0.18) lr 1.00e-05 gnorm 0.200 3.13s mem 81.1GB +step 2532/5000 loss 0.2389 (w 0.2471 mse 0.2383 t 758 new 0.15) lr 1.00e-05 gnorm 0.137 3.35s mem 81.1GB +step 2533/5000 loss 0.2350 (w 0.2591 mse 0.2422 t 759 new 0.24) lr 1.00e-05 gnorm 0.189 3.14s mem 81.1GB +step 2534/5000 loss 0.1418 (w 0.2565 mse 0.2419 t 883 new 0.23) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +step 2535/5000 loss 0.1411 (w 0.1426 mse 0.1473 t 668 new 0.19) lr 1.00e-05 gnorm 0.209 3.24s mem 81.1GB +step 2536/5000 loss 0.1600 (w 0.2259 mse 0.2305 t 950 new 0.08) lr 1.00e-05 gnorm 0.154 3.32s mem 81.1GB +step 2537/5000 loss 0.2911 (w 0.2372 mse 0.2239 t 937 new 0.28) lr 1.00e-05 gnorm 0.197 3.14s mem 81.1GB +step 2538/5000 loss 0.1991 (w 0.1961 mse 0.2043 t 940 new 0.13) lr 1.00e-05 gnorm 0.369 3.13s mem 81.1GB +step 2539/5000 loss 0.0900 (w 0.2444 mse 0.2434 t 944 new 0.15) lr 1.00e-05 gnorm 0.178 3.28s mem 81.1GB +step 2540/5000 loss 0.3116 (w 0.5746 mse 0.5814 t 107 new 0.21) lr 1.00e-05 gnorm 0.320 2.85s mem 81.1GB +step 2541/5000 loss 0.3236 (w 0.3708 mse 0.3641 t 269 new 0.25) lr 1.00e-05 gnorm 0.146 3.20s mem 81.1GB +step 2542/5000 loss 0.1192 (w 0.4098 mse 0.3845 t 990 new 0.20) lr 1.00e-05 gnorm 0.123 3.35s mem 81.1GB +step 2543/5000 loss 0.1923 (w 0.1478 mse 0.1610 t 961 new 0.23) lr 1.00e-05 gnorm 0.118 3.60s mem 81.1GB +step 2544/5000 loss 0.1794 (w 0.1356 mse 0.1226 t 945 new 0.19) lr 1.00e-05 gnorm 0.152 3.08s mem 81.1GB +step 2545/5000 loss 0.1669 (w 0.2641 mse 0.2650 t 965 new 0.08) lr 1.00e-05 gnorm 0.258 3.34s mem 81.1GB +step 2546/5000 loss 0.2481 (w 0.2819 mse 0.2876 t 636 new 0.15) lr 1.00e-05 gnorm 0.251 3.17s mem 81.1GB +step 2547/5000 loss 0.3101 (w 0.1486 mse 0.1383 t 799 new 0.23) lr 1.00e-05 gnorm 0.189 2.85s mem 81.1GB +step 2548/5000 loss 0.1615 (w 0.1877 mse 0.1759 t 914 new 0.24) lr 1.00e-05 gnorm 0.166 3.12s mem 81.1GB +step 2549/5000 loss 0.2308 (w 0.4195 mse 0.4342 t 233 new 0.22) lr 1.00e-05 gnorm 0.185 3.52s mem 81.1GB +step 2550/5000 loss 0.1253 (w 0.2624 mse 0.2516 t 934 new 0.15) lr 1.00e-05 gnorm 0.264 3.14s mem 81.1GB +step 2551/5000 loss 0.2076 (w 0.3009 mse 0.2986 t 621 new 0.06) lr 1.00e-05 gnorm 0.298 3.10s mem 81.1GB +step 2552/5000 loss 0.2928 (w 0.3227 mse 0.3298 t 983 new 0.20) lr 1.00e-05 gnorm 0.362 3.06s mem 81.1GB +step 2553/5000 loss 0.2003 (w 0.1646 mse 0.1737 t 942 new 0.11) lr 1.00e-05 gnorm 0.184 2.85s mem 81.1GB +step 2554/5000 loss 0.1321 (w 0.2064 mse 0.1876 t 962 new 0.25) lr 1.00e-05 gnorm 1.380 3.09s mem 81.1GB +step 2555/5000 loss 0.2720 (w 0.5637 mse 0.5700 t 183 new 0.28) lr 1.00e-05 gnorm 0.132 3.21s mem 81.1GB +step 2556/5000 loss 0.1843 (w 0.2668 mse 0.2579 t 913 new 0.21) lr 1.00e-05 gnorm 0.174 3.21s mem 81.1GB +step 2557/5000 loss 0.2975 (w 0.2134 mse 0.1896 t 860 new 0.23) lr 1.00e-05 gnorm 0.186 3.09s mem 81.1GB +step 2558/5000 loss 0.2255 (w 0.2619 mse 0.2728 t 712 new 0.18) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +step 2559/5000 loss 0.3184 (w 0.2862 mse 0.2740 t 269 new 0.26) lr 1.00e-05 gnorm 0.342 3.02s mem 81.1GB +step 2560/5000 loss 0.1854 (w 0.3157 mse 0.3079 t 996 new 0.22) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 2561/5000 loss 0.1706 (w 0.2669 mse 0.2515 t 922 new 0.19) lr 1.00e-05 gnorm 0.145 3.18s mem 81.1GB +step 2562/5000 loss 0.2698 (w 0.4377 mse 0.4361 t 368 new 0.20) lr 1.00e-05 gnorm 0.118 3.39s mem 81.1GB +step 2563/5000 loss 0.2172 (w 0.2059 mse 0.1868 t 954 new 0.12) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +step 2564/5000 loss 0.1975 (w 0.1855 mse 0.1773 t 862 new 0.10) lr 1.00e-05 gnorm 0.149 3.13s mem 81.1GB +step 2565/5000 loss 0.1770 (w 0.2886 mse 0.2755 t 794 new 0.16) lr 1.00e-05 gnorm 0.178 3.11s mem 81.1GB +step 2566/5000 loss 0.2877 (w 0.2324 mse 0.2317 t 779 new 0.22) lr 1.00e-05 gnorm 0.174 2.85s mem 81.1GB +step 2567/5000 loss 0.1869 (w 0.1852 mse 0.1730 t 938 new 0.24) lr 1.00e-05 gnorm 0.136 3.54s mem 81.1GB +step 2568/5000 loss 0.1579 (w 0.3990 mse 0.3924 t 990 new 0.29) lr 1.00e-05 gnorm 1.741 3.45s mem 81.1GB +step 2569/5000 loss 0.2089 (w 0.1764 mse 0.1672 t 884 new 0.16) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +step 2570/5000 loss 0.2088 (w 0.1308 mse 0.1377 t 487 new 0.15) lr 1.00e-05 gnorm 0.153 3.11s mem 81.1GB +step 2571/5000 loss 0.3113 (w 0.2177 mse 0.2233 t 462 new 0.26) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +step 2572/5000 loss 0.1772 (w 0.1102 mse 0.1236 t 926 new 0.24) lr 1.00e-05 gnorm 0.425 2.83s mem 81.1GB +step 2573/5000 loss 0.2787 (w 0.1927 mse 0.1797 t 905 new 0.24) lr 1.00e-05 gnorm 0.159 3.73s mem 81.1GB +step 2574/5000 loss 0.0520 (w 0.3086 mse 0.2777 t 989 new 0.17) lr 1.00e-05 gnorm 0.122 3.06s mem 81.1GB +step 2575/5000 loss 0.3895 (w 0.2217 mse 0.2165 t 386 new 0.14) lr 1.00e-05 gnorm 0.179 3.08s mem 81.1GB +step 2576/5000 loss 0.2422 (w 0.1999 mse 0.1952 t 484 new 0.10) lr 1.00e-05 gnorm 0.120 2.85s mem 81.1GB +step 2577/5000 loss 0.1307 (w 0.2503 mse 0.2388 t 942 new 0.24) lr 1.00e-05 gnorm 0.167 3.26s mem 81.1GB +step 2578/5000 loss 0.1492 (w 0.2340 mse 0.2236 t 828 new 0.22) lr 1.00e-05 gnorm 0.120 3.23s mem 81.1GB +step 2579/5000 loss 0.0907 (w 0.3750 mse 0.3544 t 989 new 0.21) lr 1.00e-05 gnorm 0.206 3.55s mem 81.1GB +step 2580/5000 loss 0.2710 (w 0.1578 mse 0.1651 t 740 new 0.20) lr 1.00e-05 gnorm 0.174 3.10s mem 81.1GB +step 2581/5000 loss 0.3678 (w 0.1636 mse 0.1604 t 710 new 0.11) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +step 2582/5000 loss 0.2755 (w 0.2065 mse 0.2009 t 882 new 0.23) lr 1.00e-05 gnorm 0.179 2.86s mem 81.1GB +step 2583/5000 loss 0.2952 (w 0.1619 mse 0.1560 t 855 new 0.22) lr 1.00e-05 gnorm 0.349 3.27s mem 81.1GB +step 2584/5000 loss 0.1170 (w 0.2007 mse 0.1956 t 946 new 0.12) lr 1.00e-05 gnorm 0.148 3.21s mem 81.1GB +step 2585/5000 loss 0.3243 (w 0.1441 mse 0.1416 t 868 new 0.22) lr 1.00e-05 gnorm 0.129 3.52s mem 81.1GB +step 2586/5000 loss 0.1305 (w 0.2485 mse 0.2375 t 711 new 0.22) lr 1.00e-05 gnorm 0.122 3.34s mem 81.1GB +step 2587/5000 loss 0.1582 (w 0.0875 mse 0.0887 t 864 new 0.23) lr 1.00e-05 gnorm 0.194 3.06s mem 81.1GB +step 2588/5000 loss 0.2998 (w 0.2785 mse 0.2702 t 557 new 0.15) lr 1.00e-05 gnorm 0.121 2.85s mem 81.1GB +step 2589/5000 loss 0.2411 (w 0.2747 mse 0.2615 t 754 new 0.21) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +step 2590/5000 loss 0.2735 (w 0.2848 mse 0.2810 t 998 new 0.24) lr 1.00e-05 gnorm 0.124 3.22s mem 81.1GB +step 2591/5000 loss 0.0841 (w 0.1996 mse 0.1860 t 976 new 0.21) lr 1.00e-05 gnorm 0.113 3.43s mem 81.1GB +step 2592/5000 loss 0.2433 (w 0.2153 mse 0.2113 t 915 new 0.19) lr 1.00e-05 gnorm 0.158 3.28s mem 81.1GB +step 2593/5000 loss 0.3278 (w 0.2080 mse 0.2061 t 969 new 0.18) lr 1.00e-05 gnorm 0.203 3.09s mem 81.1GB +step 2594/5000 loss 0.1768 (w 0.2090 mse 0.2043 t 562 new 0.24) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +step 2595/5000 loss 0.2167 (w 0.1562 mse 0.1412 t 853 new 0.17) lr 1.00e-05 gnorm 0.162 3.11s mem 81.1GB +step 2596/5000 loss 0.2262 (w 0.3888 mse 0.3894 t 960 new 0.27) lr 1.00e-05 gnorm 0.151 3.51s mem 81.1GB +step 2597/5000 loss 0.3552 (w 0.2230 mse 0.2161 t 943 new 0.17) lr 1.00e-05 gnorm 0.140 3.28s mem 81.1GB +step 2598/5000 loss 0.2753 (w 0.1684 mse 0.1858 t 970 new 0.12) lr 1.00e-05 gnorm 0.153 3.32s mem 81.1GB +step 2599/5000 loss 0.1638 (w 0.2169 mse 0.2215 t 979 new 0.26) lr 1.00e-05 gnorm 0.459 3.15s mem 81.1GB +step 2600/5000 loss 0.2327 (w 0.1531 mse 0.1577 t 578 new 0.09) lr 1.00e-05 gnorm 0.211 3.03s mem 81.1GB +step 2601/5000 loss 0.2349 (w 0.2149 mse 0.2019 t 899 new 0.20) lr 1.00e-05 gnorm 0.155 3.13s mem 81.1GB +step 2602/5000 loss 0.2156 (w 0.2050 mse 0.2326 t 948 new 0.18) lr 1.00e-05 gnorm 0.161 3.27s mem 81.1GB +step 2603/5000 loss 0.2407 (w 0.2563 mse 0.2500 t 864 new 0.19) lr 1.00e-05 gnorm 0.141 3.56s mem 81.1GB +step 2604/5000 loss 0.0805 (w 0.1975 mse 0.1915 t 855 new 0.20) lr 1.00e-05 gnorm 0.882 3.08s mem 81.1GB +step 2605/5000 loss 0.1447 (w 0.2080 mse 0.1961 t 700 new 0.19) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +step 2606/5000 loss 0.2131 (w 0.2008 mse 0.1973 t 730 new 0.24) lr 1.00e-05 gnorm 0.129 3.13s mem 81.1GB +step 2607/5000 loss 0.2289 (w 0.1641 mse 0.1574 t 948 new 0.21) lr 1.00e-05 gnorm 0.184 2.84s mem 81.1GB +step 2608/5000 loss 0.1032 (w 0.2446 mse 0.2383 t 955 new 0.24) lr 1.00e-05 gnorm 0.176 3.49s mem 81.1GB +step 2609/5000 loss 0.1738 (w 0.4995 mse 0.4705 t 988 new 0.26) lr 1.00e-05 gnorm 0.149 3.30s mem 81.1GB +step 2610/5000 loss 0.2412 (w 0.1541 mse 0.1552 t 815 new 0.22) lr 1.00e-05 gnorm 0.177 3.14s mem 81.1GB +step 2611/5000 loss 0.1922 (w 0.2157 mse 0.2068 t 670 new 0.20) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 2612/5000 loss 0.2747 (w 0.1725 mse 0.1727 t 903 new 0.23) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +step 2613/5000 loss 0.1357 (w 0.2956 mse 0.2827 t 991 new 0.26) lr 1.00e-05 gnorm 0.364 2.85s mem 81.1GB +step 2614/5000 loss 0.2394 (w 0.2424 mse 0.2507 t 570 new 0.19) lr 1.00e-05 gnorm 0.168 3.31s mem 81.1GB +step 2615/5000 loss 0.2377 (w 0.2006 mse 0.2076 t 807 new 0.16) lr 1.00e-05 gnorm 0.146 3.38s mem 81.1GB +step 2616/5000 loss 0.3017 (w 0.1296 mse 0.1273 t 979 new 0.25) lr 1.00e-05 gnorm 0.117 3.49s mem 81.1GB +step 2617/5000 loss 0.1520 (w 0.3532 mse 0.3461 t 978 new 0.13) lr 1.00e-05 gnorm 0.161 2.84s mem 81.1GB +step 2618/5000 loss 0.2797 (w 0.3275 mse 0.3193 t 1000 new 0.23) lr 1.00e-05 gnorm 0.156 3.32s mem 81.1GB +step 2619/5000 loss 0.2385 (w 0.1440 mse 0.1432 t 937 new 0.25) lr 1.00e-05 gnorm 0.182 3.33s mem 81.1GB +step 2620/5000 loss 0.2581 (w 0.2662 mse 0.2871 t 973 new 0.19) lr 1.00e-05 gnorm 0.126 3.08s mem 81.1GB +step 2621/5000 loss 0.2144 (w 0.1910 mse 0.1908 t 516 new 0.13) lr 1.00e-05 gnorm 0.123 3.38s mem 81.1GB +step 2622/5000 loss 0.1500 (w 0.2973 mse 0.2858 t 936 new 0.18) lr 1.00e-05 gnorm 0.136 3.28s mem 81.1GB +step 2623/5000 loss 0.2180 (w 0.2239 mse 0.2299 t 523 new 0.23) lr 1.00e-05 gnorm 0.275 2.84s mem 81.1GB +step 2624/5000 loss 0.2561 (w 0.1215 mse 0.1254 t 813 new 0.25) lr 1.00e-05 gnorm 0.126 3.28s mem 81.1GB +step 2625/5000 loss 0.2934 (w 0.1089 mse 0.1119 t 683 new 0.10) lr 1.00e-05 gnorm 0.164 3.25s mem 81.1GB +step 2626/5000 loss 0.2871 (w 0.1556 mse 0.1473 t 840 new 0.13) lr 1.00e-05 gnorm 0.186 3.13s mem 81.1GB +step 2627/5000 loss 0.1985 (w 0.2224 mse 0.2133 t 781 new 0.23) lr 1.00e-05 gnorm 0.162 3.18s mem 81.1GB +step 2628/5000 loss 0.3479 (w 0.1749 mse 0.1758 t 858 new 0.24) lr 1.00e-05 gnorm 0.165 3.43s mem 81.1GB +step 2629/5000 loss 0.2099 (w 0.4317 mse 0.4404 t 973 new 0.14) lr 1.00e-05 gnorm 0.180 2.86s mem 81.1GB +step 2630/5000 loss 0.3762 (w 0.2423 mse 0.2510 t 479 new 0.17) lr 1.00e-05 gnorm 0.127 3.09s mem 81.1GB +step 2631/5000 loss 0.1592 (w 0.3770 mse 0.3701 t 992 new 0.23) lr 1.00e-05 gnorm 0.165 3.35s mem 81.1GB +step 2632/5000 loss 0.2093 (w 0.2517 mse 0.2467 t 702 new 0.22) lr 1.00e-05 gnorm 0.189 3.15s mem 81.1GB +step 2633/5000 loss 0.2348 (w 0.2265 mse 0.2186 t 972 new 0.11) lr 1.00e-05 gnorm 0.152 3.30s mem 81.1GB +step 2634/5000 loss 0.3358 (w 0.2283 mse 0.2338 t 827 new 0.15) lr 1.00e-05 gnorm 0.148 3.12s mem 81.1GB +step 2635/5000 loss 0.2652 (w 0.2023 mse 0.1946 t 883 new 0.23) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +step 2636/5000 loss 0.1604 (w 0.3199 mse 0.3058 t 954 new 0.20) lr 1.00e-05 gnorm 0.150 3.09s mem 81.1GB +step 2637/5000 loss 0.1230 (w 0.2694 mse 0.2566 t 940 new 0.20) lr 1.00e-05 gnorm 0.121 3.36s mem 81.1GB +step 2638/5000 loss 0.3318 (w 0.2403 mse 0.2321 t 735 new 0.25) lr 1.00e-05 gnorm 0.160 3.15s mem 81.1GB +step 2639/5000 loss 0.1001 (w 0.2710 mse 0.2697 t 990 new 0.22) lr 1.00e-05 gnorm 0.143 3.15s mem 81.1GB +step 2640/5000 loss 0.2067 (w 0.2333 mse 0.2257 t 771 new 0.22) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +step 2641/5000 loss 0.1261 (w 0.2964 mse 0.2948 t 993 new 0.24) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +step 2642/5000 loss 0.1784 (w 0.2097 mse 0.2154 t 985 new 0.22) lr 1.00e-05 gnorm 0.280 2.85s mem 81.1GB +step 2643/5000 loss 0.1607 (w 0.3282 mse 0.3085 t 845 new 0.22) lr 1.00e-05 gnorm 0.171 3.28s mem 81.1GB +step 2644/5000 loss 0.2283 (w 0.2624 mse 0.2667 t 927 new 0.20) lr 1.00e-05 gnorm 0.228 3.14s mem 81.1GB +step 2645/5000 loss 0.1393 (w 0.2487 mse 0.2395 t 988 new 0.22) lr 1.00e-05 gnorm 0.127 3.15s mem 81.1GB +step 2646/5000 loss 0.2569 (w 0.1832 mse 0.1792 t 792 new 0.13) lr 1.00e-05 gnorm 0.131 3.12s mem 81.1GB +step 2647/5000 loss 0.2483 (w 0.3122 mse 0.2858 t 950 new 0.21) lr 1.00e-05 gnorm 0.101 3.11s mem 81.1GB +step 2648/5000 loss 0.1604 (w 0.2220 mse 0.2154 t 914 new 0.21) lr 1.00e-05 gnorm 0.241 3.18s mem 81.1GB +step 2649/5000 loss 0.2917 (w 0.2470 mse 0.2331 t 788 new 0.25) lr 1.00e-05 gnorm 0.319 3.06s mem 81.1GB +step 2650/5000 loss 0.1395 (w 0.1647 mse 0.1682 t 641 new 0.16) lr 1.00e-05 gnorm 0.149 3.17s mem 81.1GB +step 2651/5000 loss 0.1761 (w 0.1197 mse 0.1243 t 882 new 0.21) lr 1.00e-05 gnorm 0.107 3.37s mem 81.1GB +step 2652/5000 loss 0.2196 (w 0.3222 mse 0.3043 t 980 new 0.21) lr 1.00e-05 gnorm 0.230 2.85s mem 81.1GB +step 2653/5000 loss 0.3056 (w 0.2657 mse 0.2766 t 503 new 0.25) lr 1.00e-05 gnorm 0.252 3.10s mem 81.1GB +step 2654/5000 loss 0.2472 (w 0.2181 mse 0.2120 t 773 new 0.25) lr 1.00e-05 gnorm 0.188 3.16s mem 81.1GB +step 2655/5000 loss 0.1737 (w 0.4170 mse 0.3988 t 134 new 0.21) lr 1.00e-05 gnorm 0.115 3.11s mem 81.1GB +step 2656/5000 loss 0.2483 (w 0.1717 mse 0.1699 t 776 new 0.13) lr 1.00e-05 gnorm 0.193 3.12s mem 81.1GB +step 2657/5000 loss 0.4080 (w 0.1508 mse 0.1562 t 508 new 0.16) lr 1.00e-05 gnorm 0.178 3.39s mem 81.1GB +step 2658/5000 loss 0.3059 (w 0.2408 mse 0.2263 t 761 new 0.17) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +step 2659/5000 loss 0.1372 (w 0.2745 mse 0.2696 t 983 new 0.23) lr 1.00e-05 gnorm 0.144 3.16s mem 81.1GB +step 2660/5000 loss 0.1621 (w 0.1845 mse 0.1863 t 948 new 0.15) lr 1.00e-05 gnorm 0.201 3.18s mem 81.1GB +step 2661/5000 loss 0.2763 (w 0.1767 mse 0.1901 t 974 new 0.13) lr 1.00e-05 gnorm 0.277 3.11s mem 81.1GB +step 2662/5000 loss 0.4235 (w 0.5571 mse 0.5539 t 189 new 0.18) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +step 2663/5000 loss 0.2067 (w 0.4064 mse 0.3946 t 973 new 0.19) lr 1.00e-05 gnorm 0.152 3.16s mem 81.1GB +step 2664/5000 loss 0.1988 (w 0.1364 mse 0.1380 t 796 new 0.13) lr 1.00e-05 gnorm 0.343 2.85s mem 81.1GB +step 2665/5000 loss 0.1863 (w 0.3440 mse 0.3290 t 981 new 0.24) lr 1.00e-05 gnorm 0.263 3.25s mem 81.1GB +step 2666/5000 loss 0.2189 (w 0.2430 mse 0.2403 t 990 new 0.23) lr 1.00e-05 gnorm 0.171 3.34s mem 81.1GB +step 2667/5000 loss 0.1609 (w 0.2205 mse 0.2080 t 797 new 0.26) lr 1.00e-05 gnorm 0.129 3.18s mem 81.1GB +step 2668/5000 loss 0.1557 (w 0.3079 mse 0.2941 t 951 new 0.19) lr 1.00e-05 gnorm 0.283 3.41s mem 81.1GB +step 2669/5000 loss 0.1489 (w 0.2656 mse 0.2519 t 905 new 0.25) lr 1.00e-05 gnorm 0.220 3.12s mem 81.1GB +step 2670/5000 loss 0.0962 (w 0.3354 mse 0.3262 t 997 new 0.23) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +step 2671/5000 loss 0.3019 (w 0.3040 mse 0.2778 t 956 new 0.22) lr 1.00e-05 gnorm 0.142 3.36s mem 81.1GB +step 2672/5000 loss 0.1573 (w 0.1472 mse 0.1591 t 968 new 0.12) lr 1.00e-05 gnorm 0.142 3.38s mem 81.1GB +step 2673/5000 loss 0.3057 (w 0.1296 mse 0.1213 t 863 new 0.20) lr 1.00e-05 gnorm 0.116 3.15s mem 81.1GB +step 2674/5000 loss 0.1693 (w 0.2447 mse 0.2421 t 966 new 0.22) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 2675/5000 loss 0.4573 (w 0.2333 mse 0.2308 t 537 new 0.14) lr 1.00e-05 gnorm 0.196 3.08s mem 81.1GB +step 2676/5000 loss 0.3295 (w 0.1996 mse 0.1979 t 518 new 0.21) lr 1.00e-05 gnorm 0.178 3.11s mem 81.1GB +step 2677/5000 loss 0.2596 (w 0.2264 mse 0.2134 t 706 new 0.25) lr 1.00e-05 gnorm 0.131 3.09s mem 81.1GB +step 2678/5000 loss 0.3044 (w 0.2909 mse 0.2862 t 973 new 0.07) lr 1.00e-05 gnorm 0.170 3.12s mem 81.1GB +step 2679/5000 loss 0.1747 (w 0.1877 mse 0.1936 t 862 new 0.18) lr 1.00e-05 gnorm 0.170 3.19s mem 81.1GB +step 2680/5000 loss 0.4197 (w 0.2787 mse 0.2681 t 631 new 0.24) lr 1.00e-05 gnorm 0.138 3.11s mem 81.1GB +step 2681/5000 loss 0.3289 (w 0.2997 mse 0.2917 t 315 new 0.26) lr 1.00e-05 gnorm 0.144 3.11s mem 81.1GB +step 2682/5000 loss 0.1499 (w 0.1015 mse 0.1066 t 996 new 0.24) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +step 2683/5000 loss 0.2930 (w 0.2380 mse 0.2278 t 708 new 0.23) lr 1.00e-05 gnorm 0.150 3.30s mem 81.1GB +step 2684/5000 loss 0.2366 (w 0.2462 mse 0.2297 t 781 new 0.23) lr 1.00e-05 gnorm 0.141 3.17s mem 81.1GB +step 2685/5000 loss 0.1086 (w 0.2518 mse 0.2526 t 945 new 0.20) lr 1.00e-05 gnorm 0.200 3.35s mem 81.1GB +step 2686/5000 loss 0.0945 (w 0.3795 mse 0.3809 t 990 new 0.13) lr 1.00e-05 gnorm 0.254 3.44s mem 81.1GB +step 2687/5000 loss 0.3665 (w 0.2630 mse 0.2617 t 470 new 0.21) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +step 2688/5000 loss 0.2399 (w 0.2461 mse 0.2316 t 847 new 0.24) lr 1.00e-05 gnorm 1.115 3.08s mem 81.1GB +step 2689/5000 loss 0.3034 (w 0.2549 mse 0.2517 t 945 new 0.20) lr 1.00e-05 gnorm 0.117 3.41s mem 81.1GB +step 2690/5000 loss 0.2653 (w 0.1891 mse 0.1757 t 836 new 0.20) lr 1.00e-05 gnorm 0.166 3.08s mem 81.1GB +step 2691/5000 loss 0.1514 (w 0.2059 mse 0.2145 t 995 new 0.19) lr 1.00e-05 gnorm 0.119 3.43s mem 81.1GB +step 2692/5000 loss 0.1687 (w 0.2932 mse 0.2665 t 922 new 0.26) lr 1.00e-05 gnorm 0.155 3.39s mem 81.1GB +step 2693/5000 loss 0.1171 (w 0.1464 mse 0.1593 t 724 new 0.18) lr 1.00e-05 gnorm 0.166 2.83s mem 81.1GB +step 2694/5000 loss 0.2236 (w 0.1436 mse 0.1539 t 482 new 0.18) lr 1.00e-05 gnorm 0.169 3.08s mem 81.1GB +step 2695/5000 loss 0.3667 (w 0.2015 mse 0.1949 t 799 new 0.19) lr 1.00e-05 gnorm 0.205 3.07s mem 81.1GB +step 2696/5000 loss 0.2776 (w 0.2279 mse 0.2312 t 440 new 0.07) lr 1.00e-05 gnorm 0.135 3.62s mem 81.1GB +step 2697/5000 loss 0.1867 (w 0.1693 mse 0.1784 t 698 new 0.18) lr 1.00e-05 gnorm 0.151 3.02s mem 81.1GB +step 2698/5000 loss 0.1971 (w 0.1338 mse 0.1499 t 933 new 0.19) lr 1.00e-05 gnorm 0.196 3.34s mem 81.1GB +step 2699/5000 loss 0.2958 (w 0.1208 mse 0.1372 t 730 new 0.21) lr 1.00e-05 gnorm 0.151 2.84s mem 81.1GB +step 2700/5000 loss 0.2871 (w 0.2524 mse 0.2373 t 899 new 0.23) lr 1.00e-05 gnorm 0.169 3.25s mem 81.1GB +step 2701/5000 loss 0.1927 (w 0.2756 mse 0.2695 t 929 new 0.18) lr 1.00e-05 gnorm 0.137 3.46s mem 81.1GB +step 2702/5000 loss 0.2456 (w 0.2911 mse 0.2743 t 988 new 0.15) lr 1.00e-05 gnorm 0.152 3.33s mem 81.1GB +step 2703/5000 loss 0.1401 (w 0.2368 mse 0.2436 t 961 new 0.22) lr 1.00e-05 gnorm 0.122 3.09s mem 81.1GB +step 2704/5000 loss 0.1976 (w 0.2066 mse 0.2001 t 817 new 0.22) lr 1.00e-05 gnorm 0.150 3.36s mem 81.1GB +step 2705/5000 loss 0.4261 (w 0.3307 mse 0.3480 t 553 new 0.18) lr 1.00e-05 gnorm 0.124 2.86s mem 81.1GB +step 2706/5000 loss 0.2178 (w 0.1703 mse 0.1710 t 760 new 0.19) lr 1.00e-05 gnorm 0.185 3.38s mem 81.1GB +step 2707/5000 loss 0.2068 (w 0.1704 mse 0.1687 t 964 new 0.20) lr 1.00e-05 gnorm 0.203 3.06s mem 81.1GB +step 2708/5000 loss 0.3063 (w 0.3879 mse 0.3769 t 344 new 0.22) lr 1.00e-05 gnorm 0.183 3.15s mem 81.1GB +step 2709/5000 loss 0.1473 (w 0.2715 mse 0.2622 t 944 new 0.16) lr 1.00e-05 gnorm 0.168 3.06s mem 81.1GB +step 2710/5000 loss 0.1491 (w 0.1601 mse 0.1496 t 934 new 0.11) lr 1.00e-05 gnorm 0.199 3.09s mem 81.1GB +step 2711/5000 loss 0.2955 (w 0.2927 mse 0.3036 t 195 new 0.09) lr 1.00e-05 gnorm 0.941 3.13s mem 81.1GB +step 2712/5000 loss 0.1556 (w 0.3667 mse 0.3419 t 991 new 0.21) lr 1.00e-05 gnorm 0.178 3.05s mem 81.1GB +step 2713/5000 loss 0.2044 (w 0.1920 mse 0.2086 t 996 new 0.19) lr 1.00e-05 gnorm 0.199 3.10s mem 81.1GB +step 2714/5000 loss 0.2669 (w 0.1347 mse 0.1332 t 948 new 0.22) lr 1.00e-05 gnorm 0.188 3.19s mem 81.1GB +step 2715/5000 loss 0.2598 (w 0.3567 mse 0.3449 t 978 new 0.24) lr 1.00e-05 gnorm 0.204 3.11s mem 81.1GB +step 2716/5000 loss 0.1096 (w 0.1725 mse 0.1603 t 642 new 0.16) lr 1.00e-05 gnorm 0.174 3.05s mem 81.1GB +step 2717/5000 loss 0.2707 (w 0.1728 mse 0.1689 t 830 new 0.13) lr 1.00e-05 gnorm 0.138 3.14s mem 81.1GB +step 2718/5000 loss 0.2876 (w 0.2776 mse 0.2719 t 601 new 0.11) lr 1.00e-05 gnorm 0.241 3.03s mem 81.1GB +step 2719/5000 loss 0.2663 (w 0.2133 mse 0.2050 t 966 new 0.14) lr 1.00e-05 gnorm 0.137 3.05s mem 81.1GB +step 2720/5000 loss 0.2154 (w 0.3633 mse 0.3456 t 673 new 0.20) lr 1.00e-05 gnorm 0.106 3.50s mem 81.1GB +step 2721/5000 loss 0.2048 (w 0.2062 mse 0.1945 t 641 new 0.16) lr 1.00e-05 gnorm 0.187 3.14s mem 81.1GB +step 2722/5000 loss 0.2549 (w 0.1883 mse 0.1935 t 927 new 0.17) lr 1.00e-05 gnorm 0.138 3.16s mem 81.1GB +step 2723/5000 loss 0.1929 (w 0.2866 mse 0.2786 t 922 new 0.22) lr 1.00e-05 gnorm 0.172 3.10s mem 81.1GB +step 2724/5000 loss 0.2213 (w 0.1861 mse 0.1902 t 702 new 0.21) lr 1.00e-05 gnorm 0.343 3.08s mem 81.1GB +step 2725/5000 loss 0.2260 (w 0.1651 mse 0.1620 t 647 new 0.17) lr 1.00e-05 gnorm 0.127 3.07s mem 81.1GB +step 2726/5000 loss 0.1292 (w 0.1569 mse 0.1616 t 899 new 0.24) lr 1.00e-05 gnorm 0.630 3.49s mem 81.1GB +step 2727/5000 loss 0.1945 (w 0.3337 mse 0.3139 t 998 new 0.25) lr 1.00e-05 gnorm 0.115 3.06s mem 81.1GB +step 2728/5000 loss 0.3214 (w 0.2948 mse 0.2921 t 428 new 0.22) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +step 2729/5000 loss 0.2556 (w 0.2141 mse 0.2019 t 899 new 0.14) lr 1.00e-05 gnorm 0.192 3.09s mem 81.1GB +step 2730/5000 loss 0.3077 (w 0.2036 mse 0.1991 t 781 new 0.23) lr 1.00e-05 gnorm 0.195 3.29s mem 81.1GB +step 2731/5000 loss 0.1976 (w 0.1711 mse 0.1702 t 859 new 0.17) lr 1.00e-05 gnorm 0.193 3.12s mem 81.1GB +step 2732/5000 loss 0.1745 (w 0.3489 mse 0.3416 t 983 new 0.20) lr 1.00e-05 gnorm 0.138 3.46s mem 81.1GB +step 2733/5000 loss 0.2606 (w 0.6570 mse 0.6577 t 140 new 0.21) lr 1.00e-05 gnorm 0.141 3.11s mem 81.1GB +step 2734/5000 loss 0.2315 (w 0.1746 mse 0.1680 t 681 new 0.21) lr 1.00e-05 gnorm 0.129 3.12s mem 81.1GB +step 2735/5000 loss 0.2562 (w 0.1094 mse 0.1259 t 967 new 0.19) lr 1.00e-05 gnorm 0.123 3.17s mem 81.1GB +step 2736/5000 loss 0.2386 (w 0.1807 mse 0.1623 t 860 new 0.14) lr 1.00e-05 gnorm 0.137 3.28s mem 81.1GB +step 2737/5000 loss 0.1641 (w 0.3647 mse 0.3402 t 989 new 0.19) lr 1.00e-05 gnorm 0.133 3.34s mem 81.1GB +step 2738/5000 loss 0.2400 (w 0.4268 mse 0.4381 t 992 new 0.18) lr 1.00e-05 gnorm 0.142 3.32s mem 81.1GB +step 2739/5000 loss 0.0830 (w 0.2143 mse 0.2305 t 997 new 0.22) lr 1.00e-05 gnorm 0.225 3.06s mem 81.1GB +step 2740/5000 loss 0.2014 (w 0.2104 mse 0.2266 t 364 new 0.21) lr 1.00e-05 gnorm 0.191 2.84s mem 81.1GB +step 2741/5000 loss 0.1300 (w 0.2154 mse 0.1999 t 776 new 0.25) lr 1.00e-05 gnorm 0.119 3.06s mem 81.1GB +step 2742/5000 loss 0.1759 (w 0.2658 mse 0.2480 t 880 new 0.24) lr 1.00e-05 gnorm 0.132 3.37s mem 81.1GB +step 2743/5000 loss 0.1054 (w 0.0893 mse 0.0858 t 975 new 0.22) lr 1.00e-05 gnorm 0.633 3.27s mem 81.1GB +step 2744/5000 loss 0.1551 (w 0.1493 mse 0.1414 t 849 new 0.14) lr 1.00e-05 gnorm 0.149 3.29s mem 81.1GB +step 2745/5000 loss 0.1040 (w 0.2806 mse 0.2659 t 984 new 0.23) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +step 2746/5000 loss 0.2731 (w 0.2921 mse 0.2843 t 982 new 0.17) lr 1.00e-05 gnorm 0.452 2.84s mem 81.1GB +step 2747/5000 loss 0.2005 (w 0.2132 mse 0.2051 t 800 new 0.18) lr 1.00e-05 gnorm 0.121 3.41s mem 81.1GB +step 2748/5000 loss 0.4219 (w 0.1984 mse 0.1851 t 888 new 0.19) lr 1.00e-05 gnorm 0.165 3.13s mem 81.1GB +step 2749/5000 loss 0.2095 (w 0.1661 mse 0.1728 t 959 new 0.17) lr 1.00e-05 gnorm 0.123 3.17s mem 81.1GB +step 2750/5000 loss 0.1962 (w 0.1738 mse 0.1763 t 945 new 0.21) lr 1.00e-05 gnorm 0.209 3.34s mem 81.1GB +step 2751/5000 loss 0.2271 (w 0.1759 mse 0.1897 t 989 new 0.17) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +step 2752/5000 loss 0.1883 (w 0.1881 mse 0.1792 t 944 new 0.18) lr 1.00e-05 gnorm 0.159 3.19s mem 81.1GB +step 2753/5000 loss 0.1643 (w 0.1793 mse 0.1903 t 986 new 0.22) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +step 2754/5000 loss 0.3170 (w 0.2891 mse 0.2797 t 734 new 0.20) lr 1.00e-05 gnorm 0.125 2.83s mem 81.1GB +step 2755/5000 loss 0.2693 (w 0.2372 mse 0.2338 t 710 new 0.30) lr 1.00e-05 gnorm 0.268 3.34s mem 81.1GB +step 2756/5000 loss 0.3308 (w 0.3447 mse 0.3379 t 348 new 0.22) lr 1.00e-05 gnorm 0.174 3.21s mem 81.1GB +step 2757/5000 loss 0.2818 (w 0.2210 mse 0.2130 t 712 new 0.10) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +step 2758/5000 loss 0.1131 (w 0.2482 mse 0.2535 t 951 new 0.17) lr 1.00e-05 gnorm 0.137 3.17s mem 81.1GB +step 2759/5000 loss 0.1971 (w 0.1358 mse 0.1335 t 755 new 0.20) lr 1.00e-05 gnorm 0.148 3.06s mem 81.1GB +step 2760/5000 loss 0.1714 (w 0.1221 mse 0.1307 t 703 new 0.16) lr 1.00e-05 gnorm 0.206 2.84s mem 81.1GB +step 2761/5000 loss 0.1686 (w 0.1454 mse 0.1440 t 822 new 0.13) lr 1.00e-05 gnorm 0.146 3.44s mem 81.1GB +step 2762/5000 loss 0.2332 (w 0.2548 mse 0.2611 t 977 new 0.19) lr 1.00e-05 gnorm 0.138 3.09s mem 81.1GB +step 2763/5000 loss 0.1378 (w 0.2019 mse 0.2059 t 891 new 0.22) lr 1.00e-05 gnorm 0.191 3.07s mem 81.1GB +step 2764/5000 loss 0.3523 (w 0.2803 mse 0.2596 t 949 new 0.19) lr 1.00e-05 gnorm 0.168 3.07s mem 81.1GB +step 2765/5000 loss 0.2984 (w 0.1756 mse 0.1685 t 553 new 0.23) lr 1.00e-05 gnorm 0.138 3.11s mem 81.1GB +step 2766/5000 loss 0.2513 (w 0.2119 mse 0.2030 t 971 new 0.14) lr 1.00e-05 gnorm 0.171 2.85s mem 81.1GB +step 2767/5000 loss 0.3282 (w 0.1676 mse 0.1695 t 782 new 0.25) lr 1.00e-05 gnorm 0.345 3.44s mem 81.1GB +step 2768/5000 loss 0.2572 (w 0.2525 mse 0.2475 t 444 new 0.21) lr 1.00e-05 gnorm 0.131 3.13s mem 81.1GB +step 2769/5000 loss 0.2062 (w 0.1696 mse 0.1659 t 927 new 0.15) lr 1.00e-05 gnorm 0.152 2.85s mem 81.1GB +step 2770/5000 loss 0.1094 (w 0.1712 mse 0.1677 t 865 new 0.27) lr 1.00e-05 gnorm 0.162 3.16s mem 81.1GB +step 2771/5000 loss 0.1739 (w 0.1302 mse 0.1310 t 904 new 0.12) lr 1.00e-05 gnorm 0.161 3.41s mem 81.1GB +step 2772/5000 loss 0.2280 (w 0.2100 mse 0.2048 t 910 new 0.19) lr 1.00e-05 gnorm 0.278 3.29s mem 81.1GB +step 2773/5000 loss 0.2897 (w 0.4160 mse 0.4064 t 297 new 0.12) lr 1.00e-05 gnorm 0.147 3.06s mem 81.1GB +step 2774/5000 loss 0.1975 (w 0.1393 mse 0.1395 t 954 new 0.22) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +step 2775/5000 loss 0.1843 (w 0.1704 mse 0.1667 t 792 new 0.17) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +step 2776/5000 loss 0.2552 (w 0.2224 mse 0.2157 t 924 new 0.26) lr 1.00e-05 gnorm 0.145 3.17s mem 81.1GB +step 2777/5000 loss 0.1617 (w 0.2057 mse 0.2024 t 911 new 0.19) lr 1.00e-05 gnorm 0.169 3.06s mem 81.1GB +step 2778/5000 loss 0.2359 (w 0.3179 mse 0.3253 t 947 new 0.17) lr 1.00e-05 gnorm 0.151 3.14s mem 81.1GB +step 2779/5000 loss 0.1983 (w 0.3279 mse 0.3382 t 238 new 0.28) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +step 2780/5000 loss 0.1836 (w 0.1864 mse 0.1879 t 898 new 0.17) lr 1.00e-05 gnorm 0.186 3.14s mem 81.1GB +step 2781/5000 loss 0.2188 (w 0.2186 mse 0.2185 t 949 new 0.18) lr 1.00e-05 gnorm 0.864 2.83s mem 81.1GB +step 2782/5000 loss 0.2177 (w 0.1829 mse 0.2013 t 974 new 0.10) lr 1.00e-05 gnorm 0.158 3.14s mem 81.1GB +step 2783/5000 loss 0.3259 (w 0.2698 mse 0.2684 t 440 new 0.14) lr 1.00e-05 gnorm 0.130 3.11s mem 81.1GB +step 2784/5000 loss 0.1002 (w 0.1805 mse 0.1750 t 913 new 0.15) lr 1.00e-05 gnorm 0.245 3.15s mem 81.1GB +step 2785/5000 loss 0.3835 (w 0.3220 mse 0.3188 t 310 new 0.19) lr 1.00e-05 gnorm 0.980 3.12s mem 81.1GB +step 2786/5000 loss 0.2395 (w 0.2267 mse 0.2202 t 827 new 0.24) lr 1.00e-05 gnorm 0.142 3.30s mem 81.1GB +step 2787/5000 loss 0.2907 (w 0.1503 mse 0.1478 t 717 new 0.23) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +step 2788/5000 loss 0.1812 (w 0.2577 mse 0.2679 t 982 new 0.23) lr 1.00e-05 gnorm 0.135 3.39s mem 81.1GB +step 2789/5000 loss 0.2662 (w 0.2053 mse 0.1922 t 910 new 0.21) lr 1.00e-05 gnorm 0.147 3.04s mem 81.1GB +step 2790/5000 loss 0.2030 (w 0.1223 mse 0.1257 t 800 new 0.24) lr 1.00e-05 gnorm 0.197 3.19s mem 81.1GB +step 2791/5000 loss 0.1488 (w 0.1534 mse 0.1500 t 977 new 0.22) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +step 2792/5000 loss 0.2816 (w 0.1094 mse 0.1101 t 886 new 0.20) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +step 2793/5000 loss 0.2236 (w 0.1951 mse 0.1860 t 960 new 0.26) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +step 2794/5000 loss 0.1958 (w 0.2489 mse 0.2467 t 808 new 0.17) lr 1.00e-05 gnorm 0.113 3.34s mem 81.1GB +step 2795/5000 loss 0.2256 (w 0.3153 mse 0.3198 t 972 new 0.13) lr 1.00e-05 gnorm 0.188 3.10s mem 81.1GB +step 2796/5000 loss 0.3715 (w 0.1593 mse 0.1566 t 722 new 0.22) lr 1.00e-05 gnorm 0.268 3.24s mem 81.1GB +step 2797/5000 loss 0.1944 (w 0.2798 mse 0.2750 t 968 new 0.14) lr 1.00e-05 gnorm 0.199 3.06s mem 81.1GB +step 2798/5000 loss 0.2721 (w 0.3684 mse 0.3462 t 978 new 0.22) lr 1.00e-05 gnorm 0.143 3.12s mem 81.1GB +step 2799/5000 loss 0.2493 (w 0.1478 mse 0.1519 t 781 new 0.22) lr 1.00e-05 gnorm 0.154 2.82s mem 81.1GB +step 2800/5000 loss 0.1693 (w 0.0864 mse 0.0903 t 492 new 0.26) lr 1.00e-05 gnorm 0.123 3.31s mem 81.1GB +step 2801/5000 loss 0.2422 (w 0.1754 mse 0.1865 t 809 new 0.22) lr 1.00e-05 gnorm 0.133 3.09s mem 81.1GB +step 2802/5000 loss 0.3281 (w 0.3025 mse 0.2963 t 653 new 0.22) lr 1.00e-05 gnorm 0.172 3.43s mem 81.1GB +step 2803/5000 loss 0.1801 (w 0.3274 mse 0.3417 t 238 new 0.17) lr 1.00e-05 gnorm 0.216 3.07s mem 81.1GB +step 2804/5000 loss 0.2259 (w 0.1509 mse 0.1507 t 725 new 0.25) lr 1.00e-05 gnorm 0.346 3.13s mem 81.1GB +step 2805/5000 loss 0.2447 (w 0.4396 mse 0.4214 t 998 new 0.21) lr 1.00e-05 gnorm 0.278 3.13s mem 81.1GB +step 2806/5000 loss 0.2120 (w 0.4586 mse 0.4396 t 988 new 0.22) lr 1.00e-05 gnorm 0.163 3.42s mem 81.1GB +step 2807/5000 loss 0.2199 (w 0.2341 mse 0.2378 t 623 new 0.21) lr 1.00e-05 gnorm 0.191 2.84s mem 81.1GB +step 2808/5000 loss 0.1000 (w 0.1442 mse 0.1347 t 914 new 0.21) lr 1.00e-05 gnorm 0.133 3.37s mem 81.1GB +step 2809/5000 loss 0.5023 (w 0.3244 mse 0.3165 t 440 new 0.22) lr 1.00e-05 gnorm 0.173 3.05s mem 81.1GB +step 2810/5000 loss 0.3002 (w 0.1834 mse 0.1718 t 677 new 0.22) lr 1.00e-05 gnorm 0.129 3.05s mem 81.1GB +step 2811/5000 loss 0.3191 (w 0.2304 mse 0.2271 t 975 new 0.20) lr 1.00e-05 gnorm 0.126 3.13s mem 81.1GB +step 2812/5000 loss 0.3703 (w 0.2272 mse 0.2162 t 888 new 0.21) lr 1.00e-05 gnorm 0.148 3.37s mem 81.1GB +step 2813/5000 loss 0.3389 (w 0.2227 mse 0.2191 t 865 new 0.16) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +step 2814/5000 loss 0.3413 (w 0.2374 mse 0.2375 t 434 new 0.19) lr 1.00e-05 gnorm 0.169 3.14s mem 81.1GB +step 2815/5000 loss 0.2537 (w 0.2685 mse 0.2650 t 557 new 0.18) lr 1.00e-05 gnorm 0.223 3.08s mem 81.1GB +step 2816/5000 loss 0.0963 (w 0.1260 mse 0.1304 t 936 new 0.15) lr 1.00e-05 gnorm 0.159 3.08s mem 81.1GB +step 2817/5000 loss 0.2074 (w 0.1396 mse 0.1428 t 927 new 0.22) lr 1.00e-05 gnorm 0.144 3.11s mem 81.1GB +step 2818/5000 loss 0.2034 (w 0.2360 mse 0.2369 t 765 new 0.20) lr 1.00e-05 gnorm 0.138 3.42s mem 81.1GB +step 2819/5000 loss 0.1762 (w 0.1625 mse 0.1653 t 932 new 0.18) lr 1.00e-05 gnorm 0.164 2.83s mem 81.1GB +step 2820/5000 loss 0.0984 (w 0.1993 mse 0.1866 t 933 new 0.21) lr 1.00e-05 gnorm 0.192 3.05s mem 81.1GB +step 2821/5000 loss 0.3370 (w 0.2312 mse 0.2208 t 729 new 0.18) lr 1.00e-05 gnorm 0.131 3.14s mem 81.1GB +step 2822/5000 loss 0.2037 (w 0.2656 mse 0.2746 t 401 new 0.19) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +step 2823/5000 loss 0.3154 (w 0.3812 mse 0.3854 t 1000 new 0.23) lr 1.00e-05 gnorm 0.140 3.06s mem 81.1GB +step 2824/5000 loss 0.2770 (w 0.2887 mse 0.2940 t 535 new 0.17) lr 1.00e-05 gnorm 0.223 3.08s mem 81.1GB +step 2825/5000 loss 0.2429 (w 0.2820 mse 0.2721 t 564 new 0.24) lr 1.00e-05 gnorm 0.151 3.31s mem 81.1GB +step 2826/5000 loss 0.3374 (w 0.2700 mse 0.2540 t 557 new 0.21) lr 1.00e-05 gnorm 0.152 3.09s mem 81.1GB +step 2827/5000 loss 0.2469 (w 0.2715 mse 0.2629 t 617 new 0.14) lr 1.00e-05 gnorm 0.145 3.17s mem 81.1GB +step 2828/5000 loss 0.4019 (w 0.3950 mse 0.3948 t 364 new 0.14) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +step 2829/5000 loss 0.2392 (w 0.2230 mse 0.2135 t 703 new 0.20) lr 1.00e-05 gnorm 0.258 3.12s mem 81.1GB +step 2830/5000 loss 0.2880 (w 0.2013 mse 0.1837 t 840 new 0.23) lr 1.00e-05 gnorm 0.219 3.11s mem 81.1GB +step 2831/5000 loss 0.2112 (w 0.3231 mse 0.3318 t 975 new 0.17) lr 1.00e-05 gnorm 0.271 3.24s mem 81.1GB +step 2832/5000 loss 0.1325 (w 0.2081 mse 0.2170 t 985 new 0.27) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +step 2833/5000 loss 0.2254 (w 0.2385 mse 0.2234 t 941 new 0.15) lr 1.00e-05 gnorm 0.143 3.33s mem 81.1GB +step 2834/5000 loss 0.3844 (w 0.2030 mse 0.1958 t 702 new 0.13) lr 1.00e-05 gnorm 0.193 2.83s mem 81.1GB +step 2835/5000 loss 0.3997 (w 0.1887 mse 0.1995 t 702 new 0.22) lr 1.00e-05 gnorm 0.153 3.13s mem 81.1GB +step 2836/5000 loss 0.2609 (w 0.3135 mse 0.2916 t 936 new 0.24) lr 1.00e-05 gnorm 0.176 2.82s mem 81.1GB +step 2837/5000 loss 0.3189 (w 0.1672 mse 0.1548 t 799 new 0.21) lr 1.00e-05 gnorm 0.130 3.17s mem 81.1GB +step 2838/5000 loss 0.1538 (w 0.1675 mse 0.1607 t 933 new 0.23) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 2839/5000 loss 0.3245 (w 0.2064 mse 0.1990 t 865 new 0.20) lr 1.00e-05 gnorm 0.167 3.36s mem 81.1GB +step 2840/5000 loss 0.0934 (w 0.2252 mse 0.2137 t 943 new 0.13) lr 1.00e-05 gnorm 0.215 2.84s mem 81.1GB +step 2841/5000 loss 0.2033 (w 0.1410 mse 0.1500 t 936 new 0.23) lr 1.00e-05 gnorm 0.150 3.43s mem 81.1GB +step 2842/5000 loss 0.2248 (w 0.1466 mse 0.1391 t 870 new 0.24) lr 1.00e-05 gnorm 0.224 2.84s mem 81.1GB +step 2843/5000 loss 0.2269 (w 0.4510 mse 0.4514 t 988 new 0.20) lr 1.00e-05 gnorm 0.201 3.24s mem 81.1GB +step 2844/5000 loss 0.2971 (w 0.1406 mse 0.1388 t 775 new 0.17) lr 1.00e-05 gnorm 0.187 2.84s mem 81.1GB +step 2845/5000 loss 0.3041 (w 0.2049 mse 0.2028 t 726 new 0.22) lr 1.00e-05 gnorm 0.150 3.17s mem 81.1GB +step 2846/5000 loss 0.1686 (w 0.2291 mse 0.2179 t 931 new 0.27) lr 1.00e-05 gnorm 0.272 2.83s mem 81.1GB +step 2847/5000 loss 0.2033 (w 0.4030 mse 0.3895 t 983 new 0.17) lr 1.00e-05 gnorm 0.167 3.41s mem 81.1GB +step 2848/5000 loss 0.1939 (w 0.1838 mse 0.1791 t 889 new 0.20) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +step 2849/5000 loss 0.2147 (w 0.4034 mse 0.3959 t 999 new 0.24) lr 1.00e-05 gnorm 0.220 3.52s mem 81.1GB +step 2850/5000 loss 0.2108 (w 0.2268 mse 0.2225 t 974 new 0.21) lr 1.00e-05 gnorm 0.155 3.05s mem 81.1GB +step 2851/5000 loss 0.1997 (w 0.2441 mse 0.2268 t 872 new 0.22) lr 1.00e-05 gnorm 0.148 3.11s mem 81.1GB +step 2852/5000 loss 0.1614 (w 0.1741 mse 0.1723 t 866 new 0.21) lr 1.00e-05 gnorm 0.169 2.85s mem 81.1GB +step 2853/5000 loss 0.1619 (w 0.1822 mse 0.1800 t 887 new 0.21) lr 1.00e-05 gnorm 0.144 3.41s mem 81.1GB +step 2854/5000 loss 0.3619 (w 0.2917 mse 0.2786 t 462 new 0.15) lr 1.00e-05 gnorm 0.178 2.85s mem 81.1GB +step 2855/5000 loss 0.3788 (w 0.1413 mse 0.1453 t 821 new 0.15) lr 1.00e-05 gnorm 0.143 3.24s mem 81.1GB +step 2856/5000 loss 0.2862 (w 0.3111 mse 0.3149 t 473 new 0.27) lr 1.00e-05 gnorm 0.134 3.23s mem 81.1GB +step 2857/5000 loss 0.3845 (w 0.2269 mse 0.2342 t 440 new 0.24) lr 1.00e-05 gnorm 0.141 3.10s mem 81.1GB +step 2858/5000 loss 0.2491 (w 0.2523 mse 0.2366 t 923 new 0.22) lr 1.00e-05 gnorm 0.204 2.84s mem 81.1GB +step 2859/5000 loss 0.2790 (w 0.2710 mse 0.2577 t 892 new 0.23) lr 1.00e-05 gnorm 0.188 3.11s mem 81.1GB +step 2860/5000 loss 0.2922 (w 0.2501 mse 0.2620 t 973 new 0.21) lr 1.00e-05 gnorm 0.123 2.83s mem 81.1GB +step 2861/5000 loss 0.2549 (w 0.1998 mse 0.1897 t 838 new 0.23) lr 1.00e-05 gnorm 0.130 3.16s mem 81.1GB +step 2862/5000 loss 0.2548 (w 0.2899 mse 0.2821 t 933 new 0.16) lr 1.00e-05 gnorm 0.165 3.16s mem 81.1GB +step 2863/5000 loss 0.2952 (w 0.1612 mse 0.1752 t 967 new 0.21) lr 1.00e-05 gnorm 0.343 3.07s mem 81.1GB +step 2864/5000 loss 0.1991 (w 0.2178 mse 0.2069 t 903 new 0.23) lr 1.00e-05 gnorm 0.137 2.83s mem 81.1GB +step 2865/5000 loss 0.2385 (w 0.1949 mse 0.2032 t 562 new 0.21) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +step 2866/5000 loss 0.3197 (w 0.1700 mse 0.1673 t 834 new 0.16) lr 1.00e-05 gnorm 0.152 3.34s mem 81.1GB +step 2867/5000 loss 0.2118 (w 0.1860 mse 0.2013 t 978 new 0.22) lr 1.00e-05 gnorm 0.124 3.04s mem 81.1GB +step 2868/5000 loss 0.2207 (w 0.1268 mse 0.1222 t 802 new 0.13) lr 1.00e-05 gnorm 0.150 3.14s mem 81.1GB +step 2869/5000 loss 0.2301 (w 0.3631 mse 0.3466 t 940 new 0.17) lr 1.00e-05 gnorm 0.125 3.08s mem 81.1GB +step 2870/5000 loss 0.2176 (w 0.1727 mse 0.1725 t 983 new 0.21) lr 1.00e-05 gnorm 0.129 3.18s mem 81.1GB +step 2871/5000 loss 0.3284 (w 0.2456 mse 0.2332 t 753 new 0.17) lr 1.00e-05 gnorm 0.362 2.84s mem 81.1GB +step 2872/5000 loss 0.2674 (w 0.2431 mse 0.2229 t 923 new 0.21) lr 1.00e-05 gnorm 0.144 3.17s mem 81.1GB +step 2873/5000 loss 0.2781 (w 0.2821 mse 0.2676 t 921 new 0.24) lr 1.00e-05 gnorm 0.310 3.08s mem 81.1GB +step 2874/5000 loss 0.1036 (w 0.2544 mse 0.2441 t 949 new 0.26) lr 1.00e-05 gnorm 0.211 3.07s mem 81.1GB +step 2875/5000 loss 0.3716 (w 0.2333 mse 0.2156 t 694 new 0.21) lr 1.00e-05 gnorm 0.417 3.19s mem 81.1GB +step 2876/5000 loss 0.2033 (w 0.2050 mse 0.2212 t 953 new 0.19) lr 1.00e-05 gnorm 0.133 3.13s mem 81.1GB +step 2877/5000 loss 0.1564 (w 0.1803 mse 0.1881 t 821 new 0.19) lr 1.00e-05 gnorm 0.170 2.84s mem 81.1GB +step 2878/5000 loss 0.1486 (w 0.3205 mse 0.3166 t 954 new 0.23) lr 1.00e-05 gnorm 0.252 3.10s mem 81.1GB +step 2879/5000 loss 0.1993 (w 0.2792 mse 0.2709 t 974 new 0.22) lr 1.00e-05 gnorm 0.159 2.82s mem 81.1GB +step 2880/5000 loss 0.3715 (w 0.1625 mse 0.1786 t 981 new 0.11) lr 1.00e-05 gnorm 0.162 3.39s mem 81.1GB +step 2881/5000 loss 0.1897 (w 0.1125 mse 0.1109 t 972 new 0.25) lr 1.00e-05 gnorm 0.191 2.83s mem 81.1GB +step 2882/5000 loss 0.1451 (w 0.1434 mse 0.1477 t 858 new 0.15) lr 1.00e-05 gnorm 0.170 3.08s mem 81.1GB +step 2883/5000 loss 0.1292 (w 0.1803 mse 0.1731 t 961 new 0.16) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +step 2884/5000 loss 0.1256 (w 0.2441 mse 0.2308 t 991 new 0.24) lr 1.00e-05 gnorm 0.211 3.16s mem 81.1GB +step 2885/5000 loss 0.2635 (w 0.2904 mse 0.2879 t 992 new 0.18) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +step 2886/5000 loss 0.2370 (w 0.1345 mse 0.1345 t 901 new 0.00) lr 1.00e-05 gnorm 0.500 3.34s mem 81.1GB +step 2887/5000 loss 0.2277 (w 0.2024 mse 0.2072 t 979 new 0.24) lr 1.00e-05 gnorm 0.105 2.83s mem 81.1GB +step 2888/5000 loss 0.3695 (w 0.2712 mse 0.2684 t 830 new 0.18) lr 1.00e-05 gnorm 0.151 3.10s mem 81.1GB +step 2889/5000 loss 0.2011 (w 0.2348 mse 0.2223 t 921 new 0.22) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +step 2890/5000 loss 0.1552 (w 0.2101 mse 0.2174 t 748 new 0.14) lr 1.00e-05 gnorm 0.125 3.32s mem 81.1GB +step 2891/5000 loss 0.3929 (w 0.5334 mse 0.5591 t 134 new 0.16) lr 1.00e-05 gnorm 0.177 2.83s mem 81.1GB +step 2892/5000 loss 0.1677 (w 0.2813 mse 0.2742 t 979 new 0.22) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +step 2893/5000 loss 0.1089 (w 0.1422 mse 0.1363 t 926 new 0.18) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +step 2894/5000 loss 0.1582 (w 0.2296 mse 0.2086 t 974 new 0.11) lr 1.00e-05 gnorm 0.163 3.38s mem 81.1GB +step 2895/5000 loss 0.2643 (w 0.1040 mse 0.1155 t 910 new 0.17) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +step 2896/5000 loss 0.1127 (w 0.3022 mse 0.2924 t 993 new 0.24) lr 1.00e-05 gnorm 0.183 3.33s mem 81.1GB +step 2897/5000 loss 0.2103 (w 0.1574 mse 0.1545 t 997 new 0.22) lr 1.00e-05 gnorm 0.227 3.10s mem 81.1GB +step 2898/5000 loss 0.3467 (w 0.2313 mse 0.2257 t 762 new 0.10) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +step 2899/5000 loss 0.2732 (w 0.2555 mse 0.2569 t 709 new 0.18) lr 1.00e-05 gnorm 0.226 3.15s mem 81.1GB +step 2900/5000 loss 0.2920 (w 0.2488 mse 0.2367 t 877 new 0.19) lr 1.00e-05 gnorm 0.131 3.38s mem 81.1GB +step 2901/5000 loss 0.1169 (w 0.2627 mse 0.2584 t 984 new 0.28) lr 1.00e-05 gnorm 0.120 2.84s mem 81.1GB +step 2902/5000 loss 0.2728 (w 0.3515 mse 0.3533 t 244 new 0.01) lr 1.00e-05 gnorm 0.113 3.34s mem 81.1GB +step 2903/5000 loss 0.3003 (w 0.3705 mse 0.3566 t 981 new 0.21) lr 1.00e-05 gnorm 0.215 3.11s mem 81.1GB +step 2904/5000 loss 0.2850 (w 0.1191 mse 0.1185 t 998 new 0.14) lr 1.00e-05 gnorm 0.125 3.08s mem 81.1GB +step 2905/5000 loss 0.1505 (w 0.2242 mse 0.2110 t 993 new 0.24) lr 1.00e-05 gnorm 0.154 3.07s mem 81.1GB +step 2906/5000 loss 0.1257 (w 0.2134 mse 0.2127 t 892 new 0.09) lr 1.00e-05 gnorm 0.153 3.06s mem 81.1GB +step 2907/5000 loss 0.0380 (w 0.2573 mse 0.2787 t 999 new 0.17) lr 1.00e-05 gnorm 0.085 2.84s mem 81.1GB +step 2908/5000 loss 0.1148 (w 0.2078 mse 0.2071 t 1000 new 0.08) lr 1.00e-05 gnorm 0.112 3.37s mem 81.1GB +step 2909/5000 loss 0.2444 (w 0.2357 mse 0.2311 t 875 new 0.20) lr 1.00e-05 gnorm 0.133 3.36s mem 81.1GB +step 2910/5000 loss 0.1714 (w 0.1195 mse 0.1383 t 981 new 0.16) lr 1.00e-05 gnorm 0.207 2.85s mem 81.1GB +step 2911/5000 loss 0.2213 (w 0.1573 mse 0.1723 t 926 new 0.24) lr 1.00e-05 gnorm 0.218 3.15s mem 81.1GB +step 2912/5000 loss 0.3130 (w 0.1233 mse 0.1304 t 557 new 0.09) lr 1.00e-05 gnorm 0.226 3.07s mem 81.1GB +step 2913/5000 loss 0.1329 (w 0.2580 mse 0.2409 t 768 new 0.24) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +step 2914/5000 loss 0.1233 (w 0.3232 mse 0.3301 t 946 new 0.19) lr 1.00e-05 gnorm 0.156 3.17s mem 81.1GB +step 2915/5000 loss 0.3143 (w 0.2685 mse 0.2669 t 748 new 0.23) lr 1.00e-05 gnorm 0.192 3.34s mem 81.1GB +step 2916/5000 loss 0.1954 (w 0.3184 mse 0.2988 t 957 new 0.26) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +step 2917/5000 loss 0.2321 (w 0.2041 mse 0.2002 t 850 new 0.22) lr 1.00e-05 gnorm 0.168 3.34s mem 81.1GB +step 2918/5000 loss 0.2316 (w 0.2634 mse 0.2541 t 944 new 0.16) lr 1.00e-05 gnorm 0.154 3.13s mem 81.1GB +step 2919/5000 loss 0.2117 (w 0.3183 mse 0.2924 t 988 new 0.23) lr 1.00e-05 gnorm 0.183 3.11s mem 81.1GB +step 2920/5000 loss 0.2907 (w 0.3436 mse 0.3423 t 967 new 0.12) lr 1.00e-05 gnorm 0.195 3.10s mem 81.1GB +step 2921/5000 loss 0.1604 (w 0.1217 mse 0.1212 t 923 new 0.11) lr 1.00e-05 gnorm 0.126 3.65s mem 81.1GB +step 2922/5000 loss 0.3294 (w 0.1453 mse 0.1585 t 677 new 0.19) lr 1.00e-05 gnorm 0.231 2.83s mem 81.1GB +step 2923/5000 loss 0.3552 (w 0.1243 mse 0.1296 t 815 new 0.27) lr 1.00e-05 gnorm 0.233 3.41s mem 81.1GB +step 2924/5000 loss 0.4642 (w 0.3135 mse 0.3009 t 390 new 0.22) lr 1.00e-05 gnorm 0.183 3.05s mem 81.1GB +step 2925/5000 loss 0.3128 (w 0.1940 mse 0.1881 t 885 new 0.14) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +step 2926/5000 loss 0.2293 (w 0.1335 mse 0.1300 t 790 new 0.23) lr 1.00e-05 gnorm 0.125 3.14s mem 81.1GB +step 2927/5000 loss 0.2223 (w 0.2210 mse 0.2076 t 910 new 0.21) lr 1.00e-05 gnorm 0.211 3.07s mem 81.1GB +step 2928/5000 loss 0.2344 (w 0.1461 mse 0.1538 t 963 new 0.08) lr 1.00e-05 gnorm 0.164 3.13s mem 81.1GB +step 2929/5000 loss 0.1445 (w 0.2167 mse 0.2221 t 927 new 0.16) lr 1.00e-05 gnorm 0.109 3.39s mem 81.1GB +step 2930/5000 loss 0.3835 (w 0.3796 mse 0.3604 t 995 new 0.25) lr 1.00e-05 gnorm 0.959 3.08s mem 81.1GB +step 2931/5000 loss 0.2840 (w 0.1423 mse 0.1319 t 768 new 0.25) lr 1.00e-05 gnorm 0.227 3.16s mem 81.1GB +step 2932/5000 loss 0.1630 (w 0.3006 mse 0.2942 t 978 new 0.24) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +step 2933/5000 loss 0.1798 (w 0.1355 mse 0.1413 t 873 new 0.24) lr 1.00e-05 gnorm 0.114 3.12s mem 81.1GB +step 2934/5000 loss 0.3306 (w 0.2129 mse 0.1991 t 584 new 0.17) lr 1.00e-05 gnorm 0.115 3.12s mem 81.1GB +step 2935/5000 loss 0.2494 (w 0.1804 mse 0.1846 t 566 new 0.26) lr 1.00e-05 gnorm 0.211 3.38s mem 81.1GB +step 2936/5000 loss 0.1154 (w 0.1714 mse 0.1660 t 817 new 0.19) lr 1.00e-05 gnorm 0.166 2.83s mem 81.1GB +step 2937/5000 loss 0.2547 (w 0.2556 mse 0.2440 t 666 new 0.30) lr 1.00e-05 gnorm 0.248 3.34s mem 81.1GB +step 2938/5000 loss 0.1456 (w 0.1184 mse 0.1329 t 951 new 0.20) lr 1.00e-05 gnorm 0.792 3.12s mem 81.1GB +step 2939/5000 loss 0.2003 (w 0.1844 mse 0.1975 t 955 new 0.23) lr 1.00e-05 gnorm 0.148 3.12s mem 81.1GB +step 2940/5000 loss 0.3789 (w 0.2794 mse 0.2772 t 323 new 0.17) lr 1.00e-05 gnorm 0.419 3.13s mem 81.1GB +step 2941/5000 loss 0.1067 (w 0.2354 mse 0.2395 t 951 new 0.22) lr 1.00e-05 gnorm 0.176 3.07s mem 81.1GB +step 2942/5000 loss 0.2061 (w 0.3072 mse 0.2933 t 971 new 0.20) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 2943/5000 loss 0.1567 (w 0.2879 mse 0.2955 t 988 new 0.20) lr 1.00e-05 gnorm 0.127 3.40s mem 81.1GB +step 2944/5000 loss 0.3966 (w 0.3651 mse 0.3559 t 998 new 0.18) lr 1.00e-05 gnorm 0.179 3.36s mem 81.1GB +step 2945/5000 loss 0.2892 (w 0.1683 mse 0.1783 t 890 new 0.18) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +step 2946/5000 loss 0.2248 (w 0.2969 mse 0.2803 t 961 new 0.21) lr 1.00e-05 gnorm 0.191 3.14s mem 81.1GB +step 2947/5000 loss 0.2153 (w 0.1361 mse 0.1349 t 693 new 0.17) lr 1.00e-05 gnorm 0.112 3.08s mem 81.1GB +step 2948/5000 loss 0.1529 (w 0.3057 mse 0.2924 t 921 new 0.18) lr 1.00e-05 gnorm 0.196 3.10s mem 81.1GB +step 2949/5000 loss 0.2600 (w 0.3051 mse 0.2832 t 934 new 0.15) lr 1.00e-05 gnorm 0.149 3.11s mem 81.1GB +step 2950/5000 loss 0.1917 (w 0.2176 mse 0.2234 t 991 new 0.18) lr 1.00e-05 gnorm 0.133 3.39s mem 81.1GB +step 2951/5000 loss 0.1571 (w 0.1987 mse 0.1860 t 997 new 0.22) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 2952/5000 loss 0.2555 (w 0.1636 mse 0.1742 t 965 new 0.13) lr 1.00e-05 gnorm 0.137 3.34s mem 81.1GB +step 2953/5000 loss 0.2136 (w 0.2665 mse 0.2612 t 916 new 0.17) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +step 2954/5000 loss 0.3420 (w 0.1341 mse 0.1241 t 816 new 0.22) lr 1.00e-05 gnorm 0.152 3.12s mem 81.1GB +step 2955/5000 loss 0.1854 (w 0.3150 mse 0.3045 t 899 new 0.18) lr 1.00e-05 gnorm 0.110 3.43s mem 81.1GB +step 2956/5000 loss 0.1439 (w 0.3320 mse 0.3280 t 964 new 0.21) lr 1.00e-05 gnorm 0.184 3.17s mem 81.1GB +step 2957/5000 loss 0.1612 (w 0.2438 mse 0.2425 t 988 new 0.17) lr 1.00e-05 gnorm 0.117 2.85s mem 81.1GB +step 2958/5000 loss 0.2755 (w 0.3668 mse 0.3524 t 434 new 0.19) lr 1.00e-05 gnorm 0.157 3.37s mem 81.1GB +step 2959/5000 loss 0.2376 (w 0.3317 mse 0.3128 t 962 new 0.24) lr 1.00e-05 gnorm 0.162 3.11s mem 81.1GB +step 2960/5000 loss 0.3703 (w 0.2205 mse 0.2182 t 975 new 0.20) lr 1.00e-05 gnorm 0.260 3.08s mem 81.1GB +step 2961/5000 loss 0.3839 (w 0.1761 mse 0.1770 t 850 new 0.22) lr 1.00e-05 gnorm 0.165 3.37s mem 81.1GB +step 2962/5000 loss 0.2954 (w 0.1651 mse 0.1803 t 521 new 0.20) lr 1.00e-05 gnorm 0.154 3.09s mem 81.1GB +step 2963/5000 loss 0.1297 (w 0.2622 mse 0.2573 t 958 new 0.21) lr 1.00e-05 gnorm 0.175 3.03s mem 81.1GB +step 2964/5000 loss 0.1889 (w 0.2545 mse 0.2265 t 981 new 0.25) lr 1.00e-05 gnorm 0.181 3.12s mem 81.1GB +step 2965/5000 loss 0.2598 (w 0.1421 mse 0.1498 t 887 new 0.10) lr 1.00e-05 gnorm 0.174 3.15s mem 81.1GB +step 2966/5000 loss 0.2956 (w 0.2461 mse 0.2464 t 961 new 0.16) lr 1.00e-05 gnorm 0.155 3.08s mem 81.1GB +step 2967/5000 loss 0.3126 (w 0.1991 mse 0.1868 t 731 new 0.21) lr 1.00e-05 gnorm 0.181 3.01s mem 81.1GB +step 2968/5000 loss 0.2701 (w 0.3073 mse 0.3107 t 328 new 0.18) lr 1.00e-05 gnorm 0.181 3.70s mem 81.1GB +step 2969/5000 loss 0.2651 (w 0.2257 mse 0.2127 t 872 new 0.18) lr 1.00e-05 gnorm 0.145 3.22s mem 81.1GB +step 2970/5000 loss 0.3407 (w 0.1591 mse 0.1669 t 653 new 0.23) lr 1.00e-05 gnorm 0.137 3.12s mem 81.1GB +step 2971/5000 loss 0.2629 (w 0.2011 mse 0.2031 t 988 new 0.19) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +step 2972/5000 loss 0.2565 (w 0.2707 mse 0.2589 t 942 new 0.19) lr 1.00e-05 gnorm 0.875 3.08s mem 81.1GB +step 2973/5000 loss 0.1811 (w 0.2974 mse 0.2871 t 631 new 0.30) lr 1.00e-05 gnorm 0.150 3.42s mem 81.1GB +step 2974/5000 loss 0.3379 (w 0.2551 mse 0.2508 t 459 new 0.19) lr 1.00e-05 gnorm 0.217 2.83s mem 81.1GB +step 2975/5000 loss 0.2081 (w 0.1713 mse 0.1624 t 999 new 0.18) lr 1.00e-05 gnorm 0.135 3.41s mem 81.1GB +step 2976/5000 loss 0.2451 (w 0.2072 mse 0.2159 t 911 new 0.23) lr 1.00e-05 gnorm 0.161 3.13s mem 81.1GB +step 2977/5000 loss 0.1444 (w 0.2185 mse 0.2123 t 976 new 0.12) lr 1.00e-05 gnorm 0.124 3.14s mem 81.1GB +step 2978/5000 loss 0.1821 (w 0.1131 mse 0.1143 t 797 new 0.06) lr 1.00e-05 gnorm 0.293 3.12s mem 81.1GB +step 2979/5000 loss 0.3197 (w 0.2548 mse 0.2439 t 804 new 0.26) lr 1.00e-05 gnorm 0.204 3.35s mem 81.1GB +step 2980/5000 loss 0.4176 (w 0.1845 mse 0.1754 t 757 new 0.23) lr 1.00e-05 gnorm 0.147 2.83s mem 81.1GB +step 2981/5000 loss 0.2781 (w 0.4032 mse 0.3827 t 1000 new 0.23) lr 1.00e-05 gnorm 0.144 3.25s mem 81.1GB +step 2982/5000 loss 0.1158 (w 0.2102 mse 0.2069 t 906 new 0.18) lr 1.00e-05 gnorm 0.164 3.09s mem 81.1GB +step 2983/5000 loss 0.1476 (w 0.5524 mse 0.5828 t 146 new 0.19) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +step 2984/5000 loss 0.2041 (w 0.2310 mse 0.2253 t 842 new 0.21) lr 1.00e-05 gnorm 0.163 3.07s mem 81.1GB +step 2985/5000 loss 0.2210 (w 0.2619 mse 0.2353 t 945 new 0.18) lr 1.00e-05 gnorm 0.301 3.44s mem 81.1GB +step 2986/5000 loss 0.2141 (w 0.2619 mse 0.2591 t 960 new 0.25) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +step 2987/5000 loss 0.2649 (w 0.3060 mse 0.3201 t 956 new 0.18) lr 1.00e-05 gnorm 0.157 3.31s mem 81.1GB +step 2988/5000 loss 0.3713 (w 0.1860 mse 0.1787 t 771 new 0.23) lr 1.00e-05 gnorm 0.233 3.46s mem 81.1GB +step 2989/5000 loss 0.2908 (w 0.3220 mse 0.3392 t 332 new 0.23) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +step 2990/5000 loss 0.2621 (w 0.1510 mse 0.1457 t 915 new 0.23) lr 1.00e-05 gnorm 0.478 3.10s mem 81.1GB +step 2991/5000 loss 0.1436 (w 0.0897 mse 0.1080 t 959 new 0.20) lr 1.00e-05 gnorm 0.192 3.42s mem 81.1GB +step 2992/5000 loss 0.3125 (w 0.1433 mse 0.1376 t 821 new 0.19) lr 1.00e-05 gnorm 0.160 3.04s mem 81.1GB +step 2993/5000 loss 0.1034 (w 0.2749 mse 0.2577 t 987 new 0.24) lr 1.00e-05 gnorm 0.118 3.43s mem 81.1GB +step 2994/5000 loss 0.0983 (w 0.2553 mse 0.2619 t 993 new 0.09) lr 1.00e-05 gnorm 0.175 3.04s mem 81.1GB +step 2995/5000 loss 0.1785 (w 0.1943 mse 0.1757 t 841 new 0.21) lr 1.00e-05 gnorm 0.174 2.85s mem 81.1GB +step 2996/5000 loss 0.2809 (w 0.2468 mse 0.2406 t 730 new 0.14) lr 1.00e-05 gnorm 0.140 3.38s mem 81.1GB +step 2997/5000 loss 0.1987 (w 0.3215 mse 0.2944 t 899 new 0.20) lr 1.00e-05 gnorm 0.132 3.32s mem 81.1GB +step 2998/5000 loss 0.4025 (w 0.1744 mse 0.1809 t 871 new 0.20) lr 1.00e-05 gnorm 0.153 3.06s mem 81.1GB +step 2999/5000 loss 0.2723 (w 0.4774 mse 0.4538 t 978 new 0.24) lr 1.00e-05 gnorm 0.187 3.40s mem 81.1GB +step 3000/5000 loss 0.2170 (w 0.2541 mse 0.2477 t 936 new 0.23) lr 1.00e-05 gnorm 0.193 3.09s mem 81.1GB +[val] step 3000 t=200: w=0.4166 mse=0.4273 (n=16) t=500: w=0.2215 mse=0.2251 (n=16) t=800: w=0.1737 mse=0.1731 (n=16) | mean w=0.2706 mse=0.2752 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step3000.safetensors 4093 个张量 37.98 GB +step 3001/5000 loss 0.2543 (w 0.2654 mse 0.2556 t 942 new 0.26) lr 1.00e-05 gnorm 0.135 3.36s mem 81.1GB +step 3002/5000 loss 0.1915 (w 0.2286 mse 0.2163 t 804 new 0.24) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +step 3003/5000 loss 0.1969 (w 0.1803 mse 0.1781 t 861 new 0.17) lr 1.00e-05 gnorm 0.181 3.21s mem 81.1GB +step 3004/5000 loss 0.0556 (w 0.1978 mse 0.2140 t 969 new 0.16) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +step 3005/5000 loss 0.2434 (w 0.2538 mse 0.2524 t 972 new 0.25) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +step 3006/5000 loss 0.2152 (w 0.1971 mse 0.1941 t 942 new 0.09) lr 1.00e-05 gnorm 0.193 3.08s mem 81.1GB +step 3007/5000 loss 0.2180 (w 0.2182 mse 0.2050 t 821 new 0.21) lr 1.00e-05 gnorm 0.227 3.29s mem 81.1GB +step 3008/5000 loss 0.1864 (w 0.2028 mse 0.1958 t 868 new 0.22) lr 1.00e-05 gnorm 0.164 3.09s mem 81.1GB +step 3009/5000 loss 0.1526 (w 0.2901 mse 0.2921 t 921 new 0.20) lr 1.00e-05 gnorm 0.180 3.14s mem 81.1GB +step 3010/5000 loss 0.2756 (w 0.1794 mse 0.1713 t 706 new 0.09) lr 1.00e-05 gnorm 0.150 3.11s mem 81.1GB +step 3011/5000 loss 0.2525 (w 0.2518 mse 0.2516 t 979 new 0.16) lr 1.00e-05 gnorm 0.165 3.10s mem 81.1GB +step 3012/5000 loss 0.1699 (w 0.1714 mse 0.1740 t 948 new 0.07) lr 1.00e-05 gnorm 0.225 3.10s mem 81.1GB +step 3013/5000 loss 0.1849 (w 0.2351 mse 0.2249 t 960 new 0.23) lr 1.00e-05 gnorm 0.167 3.25s mem 81.1GB +step 3014/5000 loss 0.3642 (w 0.2091 mse 0.2125 t 958 new 0.24) lr 1.00e-05 gnorm 0.143 3.20s mem 81.1GB +step 3015/5000 loss 0.2011 (w 0.1797 mse 0.1872 t 876 new 0.16) lr 1.00e-05 gnorm 0.109 2.83s mem 81.1GB +step 3016/5000 loss 0.2696 (w 0.2081 mse 0.2021 t 875 new 0.16) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 3017/5000 loss 0.2389 (w 0.3339 mse 0.3581 t 254 new 0.26) lr 1.00e-05 gnorm 0.146 3.19s mem 81.1GB +step 3018/5000 loss 0.3003 (w 0.1765 mse 0.1670 t 626 new 0.20) lr 1.00e-05 gnorm 0.137 2.89s mem 81.1GB +step 3019/5000 loss 0.2065 (w 0.2384 mse 0.2241 t 881 new 0.15) lr 1.00e-05 gnorm 0.133 3.15s mem 81.1GB +step 3020/5000 loss 0.2634 (w 0.2337 mse 0.2230 t 659 new 0.25) lr 1.00e-05 gnorm 0.192 3.52s mem 81.1GB +step 3021/5000 loss 0.3311 (w 0.2613 mse 0.2602 t 947 new 0.21) lr 1.00e-05 gnorm 0.353 3.10s mem 81.1GB +step 3022/5000 loss 0.1850 (w 0.1857 mse 0.1798 t 822 new 0.21) lr 1.00e-05 gnorm 0.165 2.88s mem 81.1GB +step 3023/5000 loss 0.1151 (w 0.2378 mse 0.2316 t 970 new 0.18) lr 1.00e-05 gnorm 0.129 3.38s mem 81.1GB +step 3024/5000 loss 0.3169 (w 0.2415 mse 0.2270 t 960 new 0.27) lr 1.00e-05 gnorm 0.312 2.89s mem 81.1GB +step 3025/5000 loss 0.1899 (w 0.3781 mse 0.3625 t 993 new 0.24) lr 1.00e-05 gnorm 0.146 3.40s mem 81.1GB +step 3026/5000 loss 0.1076 (w 0.2258 mse 0.2423 t 993 new 0.11) lr 1.00e-05 gnorm 0.195 3.36s mem 81.1GB +step 3027/5000 loss 0.2489 (w 0.2123 mse 0.2283 t 999 new 0.18) lr 1.00e-05 gnorm 0.155 3.33s mem 81.1GB +step 3028/5000 loss 0.1963 (w 0.2757 mse 0.2790 t 977 new 0.24) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +step 3029/5000 loss 0.1753 (w 0.0952 mse 0.1048 t 629 new 0.10) lr 1.00e-05 gnorm 0.189 3.37s mem 81.1GB +step 3030/5000 loss 0.0809 (w 0.2755 mse 0.2678 t 980 new 0.24) lr 1.00e-05 gnorm 0.107 2.85s mem 81.1GB +step 3031/5000 loss 0.1764 (w 0.2296 mse 0.2254 t 796 new 0.16) lr 1.00e-05 gnorm 0.173 3.33s mem 81.1GB +step 3032/5000 loss 0.2274 (w 0.2039 mse 0.1902 t 943 new 0.16) lr 1.00e-05 gnorm 0.150 3.50s mem 81.1GB +step 3033/5000 loss 0.1617 (w 0.2633 mse 0.2568 t 974 new 0.23) lr 1.00e-05 gnorm 0.180 3.41s mem 81.1GB +step 3034/5000 loss 0.1502 (w 0.1914 mse 0.1842 t 858 new 0.24) lr 1.00e-05 gnorm 0.336 3.25s mem 81.1GB +step 3035/5000 loss 0.1892 (w 0.3501 mse 0.3456 t 278 new 0.23) lr 1.00e-05 gnorm 0.150 3.18s mem 81.1GB +step 3036/5000 loss 0.2292 (w 0.3018 mse 0.2970 t 969 new 0.24) lr 1.00e-05 gnorm 0.178 3.21s mem 81.1GB +step 3037/5000 loss 0.2925 (w 0.1524 mse 0.1444 t 913 new 0.24) lr 1.00e-05 gnorm 0.143 5.95s mem 81.1GB +step 3038/5000 loss 0.2067 (w 0.2825 mse 0.2783 t 936 new 0.21) lr 1.00e-05 gnorm 0.110 5.95s mem 81.1GB +step 3039/5000 loss 0.2059 (w 0.3109 mse 0.3117 t 958 new 0.22) lr 1.00e-05 gnorm 0.173 5.96s mem 81.1GB +step 3040/5000 loss 0.2321 (w 0.0905 mse 0.0911 t 641 new 0.20) lr 1.00e-05 gnorm 0.176 6.07s mem 81.1GB +step 3041/5000 loss 0.1299 (w 0.1800 mse 0.1900 t 977 new 0.23) lr 1.00e-05 gnorm 0.131 5.68s mem 81.1GB +step 3042/5000 loss 0.1938 (w 0.3032 mse 0.3120 t 956 new 0.20) lr 1.00e-05 gnorm 0.190 5.75s mem 81.1GB +step 3043/5000 loss 0.2520 (w 0.2752 mse 0.2599 t 741 new 0.13) lr 1.00e-05 gnorm 0.149 6.00s mem 81.1GB +step 3044/5000 loss 0.2212 (w 0.1732 mse 0.1727 t 901 new 0.02) lr 1.00e-05 gnorm 0.137 5.38s mem 81.1GB +step 3045/5000 loss 0.2213 (w 0.1414 mse 0.1377 t 854 new 0.20) lr 1.00e-05 gnorm 0.170 3.09s mem 81.1GB +step 3046/5000 loss 0.3594 (w 0.2714 mse 0.2664 t 418 new 0.14) lr 1.00e-05 gnorm 0.148 3.15s mem 81.1GB +step 3047/5000 loss 0.1758 (w 0.2063 mse 0.2012 t 983 new 0.12) lr 1.00e-05 gnorm 0.120 2.85s mem 81.1GB +step 3048/5000 loss 0.1995 (w 0.2407 mse 0.2612 t 375 new 0.17) lr 1.00e-05 gnorm 0.173 3.31s mem 81.1GB +step 3049/5000 loss 0.3473 (w 0.3200 mse 0.3157 t 897 new 0.19) lr 1.00e-05 gnorm 0.115 3.17s mem 81.1GB +step 3050/5000 loss 0.1110 (w 0.1771 mse 0.1848 t 994 new 0.23) lr 1.00e-05 gnorm 0.569 3.32s mem 81.1GB +step 3051/5000 loss 0.1915 (w 0.1650 mse 0.1585 t 865 new 0.20) lr 1.00e-05 gnorm 0.184 3.22s mem 81.1GB +step 3052/5000 loss 0.2827 (w 0.1444 mse 0.1450 t 945 new 0.15) lr 1.00e-05 gnorm 0.157 3.43s mem 81.1GB +step 3053/5000 loss 0.1769 (w 0.2812 mse 0.2828 t 987 new 0.22) lr 1.00e-05 gnorm 0.596 2.94s mem 81.1GB +step 3054/5000 loss 0.3110 (w 0.3130 mse 0.3017 t 492 new 0.25) lr 1.00e-05 gnorm 0.634 2.86s mem 81.1GB +step 3055/5000 loss 0.1737 (w 0.2671 mse 0.2638 t 992 new 0.22) lr 1.00e-05 gnorm 0.184 3.44s mem 81.1GB +step 3056/5000 loss 0.2889 (w 0.2189 mse 0.2185 t 869 new 0.18) lr 1.00e-05 gnorm 0.157 3.52s mem 81.1GB +step 3057/5000 loss 0.3375 (w 0.2278 mse 0.2307 t 917 new 0.23) lr 1.00e-05 gnorm 0.152 2.88s mem 81.1GB +step 3058/5000 loss 0.2167 (w 0.2593 mse 0.2562 t 673 new 0.27) lr 1.00e-05 gnorm 0.159 3.37s mem 81.1GB +step 3059/5000 loss 0.3093 (w 0.2966 mse 0.2833 t 881 new 0.15) lr 1.00e-05 gnorm 0.137 3.18s mem 81.1GB +step 3060/5000 loss 0.2183 (w 0.3451 mse 0.3400 t 945 new 0.26) lr 1.00e-05 gnorm 0.127 3.89s mem 81.1GB +step 3061/5000 loss 0.2533 (w 0.1415 mse 0.1398 t 833 new 0.10) lr 1.00e-05 gnorm 0.119 3.48s mem 81.1GB +step 3062/5000 loss 0.1590 (w 0.2464 mse 0.2408 t 898 new 0.22) lr 1.00e-05 gnorm 0.126 3.36s mem 81.1GB +step 3063/5000 loss 0.3147 (w 0.1518 mse 0.1495 t 762 new 0.20) lr 1.00e-05 gnorm 0.141 2.95s mem 81.1GB +step 3064/5000 loss 0.1956 (w 0.1605 mse 0.1702 t 663 new 0.15) lr 1.00e-05 gnorm 0.127 3.43s mem 81.1GB +step 3065/5000 loss 0.1673 (w 0.2413 mse 0.2453 t 957 new 0.23) lr 1.00e-05 gnorm 0.156 2.88s mem 81.1GB +step 3066/5000 loss 0.2753 (w 0.3157 mse 0.2926 t 945 new 0.21) lr 1.00e-05 gnorm 0.149 4.01s mem 81.1GB +step 3067/5000 loss 0.1559 (w 0.2727 mse 0.2791 t 997 new 0.18) lr 1.00e-05 gnorm 0.472 3.78s mem 81.1GB +step 3068/5000 loss 0.1313 (w 0.1617 mse 0.1610 t 893 new 0.14) lr 1.00e-05 gnorm 0.138 3.69s mem 81.1GB +step 3069/5000 loss 0.1902 (w 0.1694 mse 0.1734 t 821 new 0.15) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +step 3070/5000 loss 0.3588 (w 0.2501 mse 0.2437 t 837 new 0.23) lr 1.00e-05 gnorm 0.255 3.36s mem 81.1GB +step 3071/5000 loss 0.1443 (w 0.1642 mse 0.1873 t 971 new 0.20) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +step 3072/5000 loss 0.2703 (w 0.2388 mse 0.2451 t 931 new 0.09) lr 1.00e-05 gnorm 0.144 3.49s mem 81.1GB +step 3073/5000 loss 0.3483 (w 0.4610 mse 0.4700 t 988 new 0.16) lr 1.00e-05 gnorm 0.167 3.13s mem 81.1GB +step 3074/5000 loss 0.2449 (w 0.1956 mse 0.1935 t 994 new 0.19) lr 1.00e-05 gnorm 0.156 3.13s mem 81.1GB +step 3075/5000 loss 0.2931 (w 0.2401 mse 0.2217 t 955 new 0.22) lr 1.00e-05 gnorm 0.116 2.86s mem 81.1GB +step 3076/5000 loss 0.2895 (w 0.1938 mse 0.1900 t 882 new 0.22) lr 1.00e-05 gnorm 0.469 3.55s mem 81.1GB +step 3077/5000 loss 0.2094 (w 0.3116 mse 0.2851 t 988 new 0.22) lr 1.00e-05 gnorm 0.134 2.87s mem 81.1GB +step 3078/5000 loss 0.3009 (w 0.2586 mse 0.2582 t 924 new 0.21) lr 1.00e-05 gnorm 1.644 3.75s mem 81.1GB +step 3079/5000 loss 0.2519 (w 0.1590 mse 0.1612 t 856 new 0.18) lr 1.00e-05 gnorm 0.186 3.18s mem 81.1GB +step 3080/5000 loss 0.2306 (w 0.2129 mse 0.1966 t 875 new 0.21) lr 1.00e-05 gnorm 0.199 3.14s mem 81.1GB +step 3081/5000 loss 0.2909 (w 0.1955 mse 0.1880 t 582 new 0.14) lr 1.00e-05 gnorm 0.181 3.12s mem 81.1GB +step 3082/5000 loss 0.1014 (w 0.1994 mse 0.2065 t 915 new 0.17) lr 1.00e-05 gnorm 0.167 3.33s mem 81.1GB +step 3083/5000 loss 0.1479 (w 0.2388 mse 0.2305 t 919 new 0.20) lr 1.00e-05 gnorm 0.128 2.99s mem 81.1GB +step 3084/5000 loss 0.1704 (w 0.1801 mse 0.1787 t 783 new 0.17) lr 1.00e-05 gnorm 0.424 3.15s mem 81.1GB +step 3085/5000 loss 0.2719 (w 0.3146 mse 0.3148 t 447 new 0.23) lr 1.00e-05 gnorm 0.161 3.14s mem 81.1GB +step 3086/5000 loss 0.3132 (w 0.1880 mse 0.1782 t 743 new 0.22) lr 1.00e-05 gnorm 0.162 3.13s mem 81.1GB +step 3087/5000 loss 0.2077 (w 0.3922 mse 0.3698 t 989 new 0.19) lr 1.00e-05 gnorm 0.109 3.05s mem 81.1GB +step 3088/5000 loss 0.3533 (w 0.1726 mse 0.1677 t 792 new 0.20) lr 1.00e-05 gnorm 0.148 3.06s mem 81.1GB +step 3089/5000 loss 0.1003 (w 0.1995 mse 0.1960 t 885 new 0.22) lr 1.00e-05 gnorm 0.126 2.93s mem 81.1GB +step 3090/5000 loss 0.2705 (w 0.1194 mse 0.1114 t 628 new 0.16) lr 1.00e-05 gnorm 0.144 3.37s mem 81.1GB +step 3091/5000 loss 0.1915 (w 0.1940 mse 0.1924 t 908 new 0.23) lr 1.00e-05 gnorm 0.322 3.33s mem 81.1GB +step 3092/5000 loss 0.2173 (w 0.1922 mse 0.1862 t 717 new 0.22) lr 1.00e-05 gnorm 0.147 3.03s mem 81.1GB +step 3093/5000 loss 0.1803 (w 0.2078 mse 0.1973 t 887 new 0.23) lr 1.00e-05 gnorm 0.155 3.26s mem 81.1GB +step 3094/5000 loss 0.2497 (w 0.2375 mse 0.2474 t 424 new 0.25) lr 1.00e-05 gnorm 0.120 3.28s mem 81.1GB +step 3095/5000 loss 0.1264 (w 0.3880 mse 0.3621 t 994 new 0.25) lr 1.00e-05 gnorm 0.107 6.31s mem 81.1GB +step 3096/5000 loss 0.2976 (w 0.2185 mse 0.2052 t 657 new 0.24) lr 1.00e-05 gnorm 0.263 6.33s mem 81.1GB +step 3097/5000 loss 0.1970 (w 0.2288 mse 0.2238 t 850 new 0.18) lr 1.00e-05 gnorm 0.175 6.35s mem 81.1GB +step 3098/5000 loss 0.1648 (w 0.2364 mse 0.2263 t 976 new 0.26) lr 1.00e-05 gnorm 0.125 6.00s mem 81.1GB +step 3099/5000 loss 0.1496 (w 0.2455 mse 0.2459 t 981 new 0.21) lr 1.00e-05 gnorm 0.130 6.35s mem 81.1GB +step 3100/5000 loss 0.3117 (w 0.2851 mse 0.2753 t 876 new 0.22) lr 1.00e-05 gnorm 0.133 6.24s mem 81.1GB +step 3101/5000 loss 0.1804 (w 0.2467 mse 0.2310 t 916 new 0.18) lr 1.00e-05 gnorm 0.156 6.45s mem 81.1GB +step 3102/5000 loss 0.1281 (w 0.1199 mse 0.1324 t 987 new 0.26) lr 1.00e-05 gnorm 0.151 4.44s mem 81.1GB +step 3103/5000 loss 0.1140 (w 0.2499 mse 0.2404 t 917 new 0.18) lr 1.00e-05 gnorm 0.148 3.47s mem 81.1GB +step 3104/5000 loss 0.2422 (w 0.1733 mse 0.1670 t 816 new 0.22) lr 1.00e-05 gnorm 0.223 2.84s mem 81.1GB +step 3105/5000 loss 0.2828 (w 0.2539 mse 0.2378 t 768 new 0.21) lr 1.00e-05 gnorm 0.188 3.06s mem 81.1GB +step 3106/5000 loss 0.2304 (w 0.1587 mse 0.1623 t 999 new 0.02) lr 1.00e-05 gnorm 0.172 3.09s mem 81.1GB +step 3107/5000 loss 0.1449 (w 0.1895 mse 0.1948 t 873 new 0.15) lr 1.00e-05 gnorm 0.136 3.53s mem 81.1GB +step 3108/5000 loss 0.2575 (w 0.2385 mse 0.2197 t 834 new 0.21) lr 1.00e-05 gnorm 0.134 3.14s mem 81.1GB +step 3109/5000 loss 0.1359 (w 0.1381 mse 0.1364 t 1000 new 0.24) lr 1.00e-05 gnorm 0.124 3.72s mem 81.1GB +step 3110/5000 loss 0.3531 (w 0.2108 mse 0.2087 t 668 new 0.21) lr 1.00e-05 gnorm 0.146 3.01s mem 81.1GB +step 3111/5000 loss 0.1789 (w 0.2715 mse 0.2750 t 938 new 0.25) lr 1.00e-05 gnorm 0.603 3.10s mem 81.1GB +step 3112/5000 loss 0.2248 (w 0.3633 mse 0.3607 t 971 new 0.22) lr 1.00e-05 gnorm 0.124 3.12s mem 81.1GB +step 3113/5000 loss 0.1379 (w 0.2773 mse 0.2581 t 863 new 0.21) lr 1.00e-05 gnorm 0.171 3.40s mem 81.1GB +step 3114/5000 loss 0.3007 (w 0.2543 mse 0.2414 t 901 new 0.18) lr 1.00e-05 gnorm 0.222 3.28s mem 81.1GB +step 3115/5000 loss 0.1715 (w 0.2118 mse 0.2151 t 973 new 0.18) lr 1.00e-05 gnorm 0.156 3.38s mem 81.1GB +step 3116/5000 loss 0.1635 (w 0.3398 mse 0.3314 t 962 new 0.22) lr 1.00e-05 gnorm 0.138 3.26s mem 81.1GB +step 3117/5000 loss 0.1948 (w 0.2334 mse 0.2402 t 996 new 0.12) lr 1.00e-05 gnorm 0.118 4.14s mem 81.1GB +step 3118/5000 loss 0.1396 (w 0.1103 mse 0.1262 t 991 new 0.14) lr 1.00e-05 gnorm 0.091 3.42s mem 81.1GB +step 3119/5000 loss 0.1781 (w 0.2196 mse 0.2084 t 915 new 0.19) lr 1.00e-05 gnorm 0.217 3.22s mem 81.1GB +step 3120/5000 loss 0.3148 (w 0.2669 mse 0.2625 t 506 new 0.23) lr 1.00e-05 gnorm 0.194 3.46s mem 81.1GB +step 3121/5000 loss 0.1745 (w 0.3844 mse 0.3899 t 990 new 0.25) lr 1.00e-05 gnorm 0.166 3.40s mem 81.1GB +step 3122/5000 loss 0.1918 (w 0.2542 mse 0.2357 t 923 new 0.23) lr 1.00e-05 gnorm 0.142 3.23s mem 81.1GB +step 3123/5000 loss 0.3389 (w 0.3186 mse 0.3117 t 386 new 0.22) lr 1.00e-05 gnorm 0.151 4.29s mem 81.1GB +step 3124/5000 loss 0.2897 (w 0.2248 mse 0.2109 t 914 new 0.21) lr 1.00e-05 gnorm 0.168 3.97s mem 81.1GB +step 3125/5000 loss 0.3750 (w 0.2627 mse 0.2457 t 943 new 0.17) lr 1.00e-05 gnorm 0.146 3.58s mem 81.1GB +step 3126/5000 loss 0.2001 (w 0.2379 mse 0.2307 t 656 new 0.25) lr 1.00e-05 gnorm 0.187 3.47s mem 81.1GB +step 3127/5000 loss 0.2242 (w 0.1846 mse 0.1858 t 865 new 0.24) lr 1.00e-05 gnorm 0.152 3.16s mem 81.1GB +step 3128/5000 loss 0.2791 (w 0.1881 mse 0.1821 t 899 new 0.27) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +step 3129/5000 loss 0.2415 (w 0.1530 mse 0.1540 t 607 new 0.21) lr 1.00e-05 gnorm 0.146 3.15s mem 81.1GB +step 3130/5000 loss 0.2985 (w 0.2645 mse 0.2571 t 946 new 0.15) lr 1.00e-05 gnorm 0.175 3.03s mem 81.1GB +step 3131/5000 loss 0.2891 (w 0.2158 mse 0.2010 t 907 new 0.21) lr 1.00e-05 gnorm 0.332 3.14s mem 81.1GB +step 3132/5000 loss 0.2183 (w 0.2847 mse 0.2802 t 607 new 0.23) lr 1.00e-05 gnorm 0.137 3.34s mem 81.1GB +step 3133/5000 loss 0.2874 (w 0.1865 mse 0.2021 t 705 new 0.15) lr 1.00e-05 gnorm 0.135 3.06s mem 81.1GB +step 3134/5000 loss 0.2471 (w 0.1603 mse 0.1714 t 379 new 0.23) lr 1.00e-05 gnorm 0.090 3.04s mem 81.1GB +step 3135/5000 loss 0.2443 (w 0.2011 mse 0.2055 t 839 new 0.18) lr 1.00e-05 gnorm 0.140 3.13s mem 81.1GB +step 3136/5000 loss 0.1643 (w 0.1033 mse 0.1128 t 937 new 0.22) lr 1.00e-05 gnorm 0.118 3.05s mem 81.1GB +step 3137/5000 loss 0.3097 (w 0.3325 mse 0.3317 t 537 new 0.06) lr 1.00e-05 gnorm 0.171 3.15s mem 81.1GB +step 3138/5000 loss 0.2348 (w 0.2143 mse 0.2061 t 948 new 0.19) lr 1.00e-05 gnorm 0.105 3.42s mem 81.1GB +step 3139/5000 loss 0.2201 (w 0.1715 mse 0.1910 t 948 new 0.17) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +step 3140/5000 loss 0.3026 (w 1.0108 mse 1.0206 t 1000 new 0.19) lr 1.00e-05 gnorm 0.124 3.06s mem 81.1GB +step 3141/5000 loss 0.2847 (w 0.6576 mse 0.6578 t 134 new 0.19) lr 1.00e-05 gnorm 0.129 3.14s mem 81.1GB +step 3142/5000 loss 0.3373 (w 0.4185 mse 0.4119 t 991 new 0.19) lr 1.00e-05 gnorm 0.203 3.21s mem 81.1GB +step 3143/5000 loss 0.1457 (w 0.2988 mse 0.3294 t 999 new 0.19) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +step 3144/5000 loss 0.1707 (w 0.2289 mse 0.2362 t 827 new 0.22) lr 1.00e-05 gnorm 0.101 3.44s mem 81.1GB +step 3145/5000 loss 0.2079 (w 0.2347 mse 0.2209 t 828 new 0.23) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +step 3146/5000 loss 0.3196 (w 0.2166 mse 0.2087 t 835 new 0.13) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +step 3147/5000 loss 0.2486 (w 0.2043 mse 0.1990 t 647 new 0.27) lr 1.00e-05 gnorm 0.243 3.09s mem 81.1GB +step 3148/5000 loss 0.3103 (w 0.4109 mse 0.4095 t 292 new 0.20) lr 1.00e-05 gnorm 0.167 3.32s mem 81.1GB +step 3149/5000 loss 0.1098 (w 0.2286 mse 0.2309 t 992 new 0.21) lr 1.00e-05 gnorm 0.177 3.12s mem 81.1GB +step 3150/5000 loss 0.2024 (w 0.2750 mse 0.2808 t 973 new 0.23) lr 1.00e-05 gnorm 0.136 3.41s mem 81.1GB +step 3151/5000 loss 0.4120 (w 0.5135 mse 0.5234 t 159 new 0.25) lr 1.00e-05 gnorm 0.399 2.84s mem 81.1GB +step 3152/5000 loss 0.1844 (w 0.2235 mse 0.2312 t 982 new 0.19) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +step 3153/5000 loss 0.3186 (w 0.2612 mse 0.2431 t 766 new 0.20) lr 1.00e-05 gnorm 0.176 3.14s mem 81.1GB +step 3154/5000 loss 0.2481 (w 0.2593 mse 0.2606 t 948 new 0.20) lr 1.00e-05 gnorm 0.169 3.36s mem 81.1GB +step 3155/5000 loss 0.3367 (w 0.2976 mse 0.2802 t 947 new 0.12) lr 1.00e-05 gnorm 0.141 3.09s mem 81.1GB +step 3156/5000 loss 0.1604 (w 0.2525 mse 0.2393 t 931 new 0.14) lr 1.00e-05 gnorm 0.171 3.36s mem 81.1GB +step 3157/5000 loss 0.2191 (w 0.3899 mse 0.3891 t 984 new 0.19) lr 1.00e-05 gnorm 0.132 3.04s mem 81.1GB +step 3158/5000 loss 0.1724 (w 0.1324 mse 0.1391 t 753 new 0.18) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +step 3159/5000 loss 0.2012 (w 0.1871 mse 0.1968 t 853 new 0.22) lr 1.00e-05 gnorm 0.138 3.15s mem 81.1GB +step 3160/5000 loss 0.1484 (w 0.2179 mse 0.2153 t 868 new 0.23) lr 1.00e-05 gnorm 2.679 3.45s mem 81.1GB +step 3161/5000 loss 0.1642 (w 0.3343 mse 0.3532 t 980 new 0.20) lr 1.00e-05 gnorm 0.154 3.39s mem 81.1GB +step 3162/5000 loss 0.2712 (w 0.2513 mse 0.2718 t 975 new 0.21) lr 1.00e-05 gnorm 0.179 3.37s mem 81.1GB +step 3163/5000 loss 0.2558 (w 0.1726 mse 0.1699 t 875 new 0.23) lr 1.00e-05 gnorm 0.131 3.02s mem 81.1GB +step 3164/5000 loss 0.1397 (w 0.3278 mse 0.3096 t 960 new 0.26) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +step 3165/5000 loss 0.2596 (w 0.2257 mse 0.2166 t 965 new 0.20) lr 1.00e-05 gnorm 0.176 3.43s mem 81.1GB +step 3166/5000 loss 0.2772 (w 0.3037 mse 0.3019 t 450 new 0.25) lr 1.00e-05 gnorm 0.126 3.15s mem 81.1GB +step 3167/5000 loss 0.2048 (w 0.3147 mse 0.2995 t 949 new 0.20) lr 1.00e-05 gnorm 0.207 3.11s mem 81.1GB +step 3168/5000 loss 0.1000 (w 0.1771 mse 0.1726 t 954 new 0.22) lr 1.00e-05 gnorm 0.086 3.14s mem 81.1GB +step 3169/5000 loss 0.3354 (w 0.2100 mse 0.2195 t 968 new 0.20) lr 1.00e-05 gnorm 0.134 3.06s mem 81.1GB +step 3170/5000 loss 0.2394 (w 0.2664 mse 0.2554 t 984 new 0.19) lr 1.00e-05 gnorm 0.133 2.85s mem 81.1GB +step 3171/5000 loss 0.1747 (w 0.3409 mse 0.3397 t 990 new 0.17) lr 1.00e-05 gnorm 0.193 3.39s mem 81.1GB +step 3172/5000 loss 0.2913 (w 0.2031 mse 0.1923 t 902 new 0.27) lr 1.00e-05 gnorm 0.124 3.25s mem 81.1GB +step 3173/5000 loss 0.1790 (w 0.3014 mse 0.2917 t 624 new 0.20) lr 1.00e-05 gnorm 0.167 3.29s mem 81.1GB +step 3174/5000 loss 0.2594 (w 0.1411 mse 0.1399 t 942 new 0.18) lr 1.00e-05 gnorm 0.123 3.07s mem 81.1GB +step 3175/5000 loss 0.2424 (w 0.1731 mse 0.1547 t 675 new 0.24) lr 1.00e-05 gnorm 1.099 3.03s mem 81.1GB +step 3176/5000 loss 0.3841 (w 0.1958 mse 0.2080 t 328 new 0.10) lr 1.00e-05 gnorm 0.172 2.84s mem 81.1GB +step 3177/5000 loss 0.2302 (w 0.2716 mse 0.2454 t 868 new 0.21) lr 1.00e-05 gnorm 0.165 3.32s mem 81.1GB +step 3178/5000 loss 0.2578 (w 0.1693 mse 0.1668 t 921 new 0.21) lr 1.00e-05 gnorm 0.145 3.41s mem 81.1GB +step 3179/5000 loss 0.2334 (w 0.1817 mse 0.1763 t 803 new 0.27) lr 1.00e-05 gnorm 0.139 3.43s mem 81.1GB +step 3180/5000 loss 0.3419 (w 0.3114 mse 0.3192 t 978 new 0.13) lr 1.00e-05 gnorm 0.423 2.83s mem 81.1GB +step 3181/5000 loss 0.2167 (w 0.2283 mse 0.2268 t 977 new 0.21) lr 1.00e-05 gnorm 0.110 3.04s mem 81.1GB +step 3182/5000 loss 0.2515 (w 0.1873 mse 0.1787 t 783 new 0.21) lr 1.00e-05 gnorm 0.187 2.85s mem 81.1GB +step 3183/5000 loss 0.2601 (w 0.2084 mse 0.2025 t 693 new 0.22) lr 1.00e-05 gnorm 0.156 3.63s mem 81.1GB +step 3184/5000 loss 0.3349 (w 0.2263 mse 0.2236 t 976 new 0.26) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +step 3185/5000 loss 0.2575 (w 0.1339 mse 0.1445 t 856 new 0.14) lr 1.00e-05 gnorm 0.146 3.10s mem 81.1GB +step 3186/5000 loss 0.1962 (w 0.1699 mse 0.1696 t 607 new 0.12) lr 1.00e-05 gnorm 0.099 2.85s mem 81.1GB +step 3187/5000 loss 0.1510 (w 0.1573 mse 0.1529 t 898 new 0.20) lr 1.00e-05 gnorm 0.162 3.10s mem 81.1GB +step 3188/5000 loss 0.2022 (w 0.2376 mse 0.2371 t 969 new 0.07) lr 1.00e-05 gnorm 0.193 3.15s mem 81.1GB +step 3189/5000 loss 0.2246 (w 0.2918 mse 0.2758 t 995 new 0.22) lr 1.00e-05 gnorm 0.165 3.44s mem 81.1GB +step 3190/5000 loss 0.2349 (w 0.2958 mse 0.2953 t 310 new 0.20) lr 1.00e-05 gnorm 0.140 3.32s mem 81.1GB +step 3191/5000 loss 0.1940 (w 0.1778 mse 0.1735 t 891 new 0.19) lr 1.00e-05 gnorm 0.167 3.11s mem 81.1GB +step 3192/5000 loss 0.2136 (w 0.2241 mse 0.2172 t 861 new 0.19) lr 1.00e-05 gnorm 0.177 2.85s mem 81.1GB +step 3193/5000 loss 0.2886 (w 0.2334 mse 0.2296 t 944 new 0.20) lr 1.00e-05 gnorm 0.157 3.06s mem 81.1GB +step 3194/5000 loss 0.1500 (w 0.1992 mse 0.1934 t 911 new 0.25) lr 1.00e-05 gnorm 0.141 3.14s mem 81.1GB +step 3195/5000 loss 0.3385 (w 0.6687 mse 0.6650 t 146 new 0.25) lr 1.00e-05 gnorm 0.131 3.16s mem 81.1GB +step 3196/5000 loss 0.4185 (w 0.2395 mse 0.2415 t 973 new 0.20) lr 1.00e-05 gnorm 0.130 3.36s mem 81.1GB +step 3197/5000 loss 0.2027 (w 0.1601 mse 0.1575 t 713 new 0.21) lr 1.00e-05 gnorm 0.131 3.08s mem 81.1GB +step 3198/5000 loss 0.4761 (w 0.3103 mse 0.2997 t 968 new 0.18) lr 1.00e-05 gnorm 0.127 2.85s mem 81.1GB +step 3199/5000 loss 0.3456 (w 0.3108 mse 0.3084 t 465 new 0.15) lr 1.00e-05 gnorm 0.108 3.07s mem 81.1GB +step 3200/5000 loss 0.3799 (w 0.3717 mse 0.3607 t 264 new 0.19) lr 1.00e-05 gnorm 0.155 3.14s mem 81.1GB +step 3201/5000 loss 0.1816 (w 0.3164 mse 0.3163 t 904 new 0.19) lr 1.00e-05 gnorm 0.237 3.28s mem 81.1GB +step 3202/5000 loss 0.3809 (w 0.2793 mse 0.2598 t 857 new 0.24) lr 1.00e-05 gnorm 0.133 3.12s mem 81.1GB +step 3203/5000 loss 0.2770 (w 0.2361 mse 0.2325 t 871 new 0.23) lr 1.00e-05 gnorm 0.140 3.12s mem 81.1GB +step 3204/5000 loss 0.2424 (w 0.2410 mse 0.2322 t 874 new 0.22) lr 1.00e-05 gnorm 0.163 3.04s mem 81.1GB +step 3205/5000 loss 0.1136 (w 0.2588 mse 0.2508 t 949 new 0.23) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +step 3206/5000 loss 0.1764 (w 0.1873 mse 0.1821 t 729 new 0.23) lr 1.00e-05 gnorm 0.133 3.07s mem 81.1GB +step 3207/5000 loss 0.3022 (w 0.1672 mse 0.1704 t 637 new 0.21) lr 1.00e-05 gnorm 0.139 3.46s mem 81.1GB +step 3208/5000 loss 0.4160 (w 0.1819 mse 0.1897 t 773 new 0.13) lr 1.00e-05 gnorm 0.129 3.06s mem 81.1GB +step 3209/5000 loss 0.2355 (w 0.2349 mse 0.2257 t 760 new 0.14) lr 1.00e-05 gnorm 0.234 3.14s mem 81.1GB +step 3210/5000 loss 0.1963 (w 0.4081 mse 0.3904 t 1000 new 0.19) lr 1.00e-05 gnorm 0.171 3.05s mem 81.1GB +step 3211/5000 loss 0.2244 (w 0.1912 mse 0.1857 t 743 new 0.23) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +step 3212/5000 loss 0.2673 (w 0.3381 mse 0.3232 t 968 new 0.15) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +step 3213/5000 loss 0.1832 (w 0.1731 mse 0.1699 t 871 new 0.18) lr 1.00e-05 gnorm 0.142 3.48s mem 81.1GB +step 3214/5000 loss 0.1235 (w 0.2980 mse 0.3023 t 966 new 0.10) lr 1.00e-05 gnorm 0.153 3.37s mem 81.1GB +step 3215/5000 loss 0.2183 (w 0.4213 mse 0.4047 t 990 new 0.24) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +step 3216/5000 loss 0.1806 (w 0.1970 mse 0.1959 t 562 new 0.18) lr 1.00e-05 gnorm 39.826 3.06s mem 81.1GB +step 3217/5000 loss 0.2383 (w 0.3631 mse 0.3651 t 332 new 0.21) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +step 3218/5000 loss 0.2549 (w 0.1672 mse 0.1626 t 927 new 0.11) lr 1.00e-05 gnorm 0.149 3.43s mem 81.1GB +step 3219/5000 loss 0.4211 (w 0.3230 mse 0.3113 t 424 new 0.22) lr 1.00e-05 gnorm 0.196 3.15s mem 81.1GB +step 3220/5000 loss 0.1813 (w 0.1913 mse 0.1875 t 782 new 0.14) lr 1.00e-05 gnorm 0.142 3.40s mem 81.1GB +step 3221/5000 loss 0.1351 (w 0.2277 mse 0.2164 t 936 new 0.21) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +step 3222/5000 loss 0.1862 (w 0.2566 mse 0.2438 t 877 new 0.21) lr 1.00e-05 gnorm 0.168 3.09s mem 81.1GB +step 3223/5000 loss 0.3793 (w 0.1736 mse 0.1725 t 777 new 0.27) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +step 3224/5000 loss 0.3083 (w 0.2205 mse 0.2198 t 859 new 0.19) lr 1.00e-05 gnorm 0.118 3.35s mem 81.1GB +step 3225/5000 loss 0.1129 (w 0.2099 mse 0.2002 t 988 new 0.23) lr 1.00e-05 gnorm 0.184 3.30s mem 81.1GB +step 3226/5000 loss 0.3012 (w 0.3026 mse 0.2901 t 688 new 0.13) lr 1.00e-05 gnorm 0.176 3.12s mem 81.1GB +step 3227/5000 loss 0.1665 (w 0.1920 mse 0.1903 t 987 new 0.18) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +step 3228/5000 loss 0.1811 (w 0.1903 mse 0.1872 t 887 new 0.19) lr 1.00e-05 gnorm 0.341 3.05s mem 81.1GB +step 3229/5000 loss 0.1924 (w 0.2157 mse 0.2117 t 973 new 0.22) lr 1.00e-05 gnorm 0.162 2.83s mem 81.1GB +step 3230/5000 loss 0.2500 (w 0.2018 mse 0.1941 t 852 new 0.23) lr 1.00e-05 gnorm 0.139 3.35s mem 81.1GB +step 3231/5000 loss 0.3531 (w 0.2011 mse 0.1870 t 926 new 0.22) lr 1.00e-05 gnorm 0.138 3.34s mem 81.1GB +step 3232/5000 loss 0.2004 (w 0.2995 mse 0.2919 t 873 new 0.24) lr 1.00e-05 gnorm 0.145 3.31s mem 81.1GB +step 3233/5000 loss 0.2397 (w 0.2757 mse 0.2598 t 605 new 0.25) lr 1.00e-05 gnorm 0.114 2.84s mem 81.1GB +step 3234/5000 loss 0.1894 (w 0.0728 mse 0.0786 t 786 new 0.14) lr 1.00e-05 gnorm 0.121 3.10s mem 81.1GB +step 3235/5000 loss 0.2018 (w 0.2164 mse 0.2103 t 621 new 0.22) lr 1.00e-05 gnorm 0.152 2.85s mem 81.1GB +step 3236/5000 loss 0.2113 (w 0.2856 mse 0.2668 t 958 new 0.27) lr 1.00e-05 gnorm 0.140 3.47s mem 81.1GB +step 3237/5000 loss 0.2535 (w 0.3848 mse 0.4068 t 127 new 0.21) lr 1.00e-05 gnorm 0.146 3.10s mem 81.1GB +step 3238/5000 loss 0.3566 (w 0.2148 mse 0.1883 t 730 new 0.26) lr 1.00e-05 gnorm 0.300 3.43s mem 81.1GB +step 3239/5000 loss 0.2155 (w 0.2171 mse 0.2086 t 927 new 0.19) lr 1.00e-05 gnorm 0.178 3.13s mem 81.1GB +step 3240/5000 loss 0.3407 (w 0.1849 mse 0.1847 t 922 new 0.16) lr 1.00e-05 gnorm 0.181 2.83s mem 81.1GB +step 3241/5000 loss 0.1252 (w 0.3208 mse 0.3233 t 966 new 0.22) lr 1.00e-05 gnorm 0.106 3.15s mem 81.1GB +step 3242/5000 loss 0.2045 (w 0.2229 mse 0.2190 t 886 new 0.23) lr 1.00e-05 gnorm 0.159 3.46s mem 81.1GB +step 3243/5000 loss 0.2477 (w 0.1774 mse 0.1887 t 440 new 0.27) lr 1.00e-05 gnorm 0.173 3.43s mem 81.1GB +step 3244/5000 loss 0.1822 (w 0.2455 mse 0.2283 t 919 new 0.27) lr 1.00e-05 gnorm 0.149 3.15s mem 81.1GB +step 3245/5000 loss 0.2405 (w 0.1231 mse 0.1235 t 669 new 0.11) lr 1.00e-05 gnorm 0.145 3.04s mem 81.1GB +step 3246/5000 loss 0.3543 (w 0.2495 mse 0.2465 t 820 new 0.23) lr 1.00e-05 gnorm 0.340 2.85s mem 81.1GB +step 3247/5000 loss 0.2810 (w 0.4389 mse 0.4458 t 206 new 0.28) lr 1.00e-05 gnorm 0.139 3.05s mem 81.1GB +step 3248/5000 loss 0.1464 (w 0.2137 mse 0.2179 t 945 new 0.15) lr 1.00e-05 gnorm 0.126 3.54s mem 81.1GB +step 3249/5000 loss 0.1992 (w 0.1955 mse 0.1820 t 864 new 0.25) lr 1.00e-05 gnorm 0.243 3.34s mem 81.1GB +step 3250/5000 loss 0.2973 (w 0.2534 mse 0.2385 t 908 new 0.23) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +step 3251/5000 loss 0.1225 (w 0.1468 mse 0.1381 t 945 new 0.17) lr 1.00e-05 gnorm 0.103 3.02s mem 81.1GB +step 3252/5000 loss 0.2286 (w 0.4605 mse 0.4570 t 973 new 0.19) lr 1.00e-05 gnorm 0.167 2.85s mem 81.1GB +step 3253/5000 loss 0.2404 (w 0.1133 mse 0.1325 t 969 new 0.18) lr 1.00e-05 gnorm 0.157 3.11s mem 81.1GB +step 3254/5000 loss 0.0677 (w 0.1373 mse 0.1321 t 913 new 0.08) lr 1.00e-05 gnorm 0.141 3.16s mem 81.1GB +step 3255/5000 loss 0.2802 (w 0.2117 mse 0.2077 t 980 new 0.26) lr 1.00e-05 gnorm 0.135 3.31s mem 81.1GB +step 3256/5000 loss 0.3479 (w 0.2289 mse 0.2209 t 998 new 0.21) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +step 3257/5000 loss 0.2310 (w 0.2042 mse 0.2080 t 992 new 0.25) lr 1.00e-05 gnorm 0.113 3.04s mem 81.1GB +step 3258/5000 loss 0.2229 (w 0.1141 mse 0.1208 t 982 new 0.06) lr 1.00e-05 gnorm 0.172 2.84s mem 81.1GB +step 3259/5000 loss 0.0645 (w 0.3647 mse 0.3313 t 990 new 0.22) lr 1.00e-05 gnorm 0.131 3.32s mem 81.1GB +step 3260/5000 loss 0.1975 (w 0.1525 mse 0.1603 t 963 new 0.16) lr 1.00e-05 gnorm 0.135 3.44s mem 81.1GB +step 3261/5000 loss 0.1200 (w 0.2172 mse 0.2103 t 902 new 0.24) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +step 3262/5000 loss 0.2960 (w 0.5870 mse 0.5807 t 146 new 0.15) lr 1.00e-05 gnorm 0.186 3.10s mem 81.1GB +step 3263/5000 loss 0.2504 (w 0.2055 mse 0.2091 t 980 new 0.25) lr 1.00e-05 gnorm 0.133 2.86s mem 81.1GB +step 3264/5000 loss 0.3060 (w 0.2346 mse 0.2139 t 787 new 0.22) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +step 3265/5000 loss 0.1286 (w 0.3671 mse 0.3452 t 997 new 0.21) lr 1.00e-05 gnorm 0.150 3.31s mem 81.1GB +step 3266/5000 loss 0.1759 (w 0.1797 mse 0.1878 t 944 new 0.23) lr 1.00e-05 gnorm 0.175 3.41s mem 81.1GB +step 3267/5000 loss 0.1534 (w 0.1126 mse 0.1258 t 944 new 0.13) lr 1.00e-05 gnorm 0.166 3.11s mem 81.1GB +step 3268/5000 loss 0.2066 (w 0.2868 mse 0.2695 t 953 new 0.26) lr 1.00e-05 gnorm 0.162 3.14s mem 81.1GB +step 3269/5000 loss 0.1567 (w 0.2071 mse 0.1973 t 851 new 0.21) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +step 3270/5000 loss 0.2622 (w 0.0892 mse 0.0893 t 907 new 0.08) lr 1.00e-05 gnorm 0.238 3.43s mem 81.1GB +step 3271/5000 loss 0.2137 (w 0.2544 mse 0.2544 t 997 new 0.26) lr 1.00e-05 gnorm 0.132 3.37s mem 81.1GB +step 3272/5000 loss 0.0874 (w 0.2449 mse 0.2320 t 990 new 0.19) lr 1.00e-05 gnorm 0.149 3.05s mem 81.1GB +step 3273/5000 loss 0.1575 (w 0.2347 mse 0.2255 t 978 new 0.18) lr 1.00e-05 gnorm 0.133 3.40s mem 81.1GB +step 3274/5000 loss 0.2794 (w 0.2201 mse 0.2205 t 950 new 0.20) lr 1.00e-05 gnorm 1.409 2.83s mem 81.1GB +step 3275/5000 loss 0.1204 (w 0.2118 mse 0.2133 t 938 new 0.19) lr 1.00e-05 gnorm 0.144 3.98s mem 81.1GB +step 3276/5000 loss 0.2021 (w 0.2645 mse 0.2496 t 829 new 0.28) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +step 3277/5000 loss 0.2711 (w 0.2080 mse 0.2141 t 984 new 0.20) lr 1.00e-05 gnorm 0.130 3.36s mem 81.1GB +step 3278/5000 loss 0.2441 (w 0.3244 mse 0.3254 t 348 new 0.26) lr 1.00e-05 gnorm 0.160 3.14s mem 81.1GB +step 3279/5000 loss 0.2192 (w 0.1887 mse 0.1797 t 793 new 0.25) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +step 3280/5000 loss 0.3150 (w 0.3058 mse 0.3039 t 500 new 0.21) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +step 3281/5000 loss 0.2231 (w 0.2228 mse 0.2198 t 974 new 0.22) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +step 3282/5000 loss 0.1082 (w 0.2013 mse 0.1944 t 969 new 0.09) lr 1.00e-05 gnorm 0.202 3.06s mem 81.1GB +step 3283/5000 loss 0.2023 (w 0.1985 mse 0.2014 t 660 new 0.15) lr 1.00e-05 gnorm 0.160 3.39s mem 81.1GB +step 3284/5000 loss 0.4042 (w 0.2190 mse 0.2379 t 968 new 0.19) lr 1.00e-05 gnorm 0.144 3.34s mem 81.1GB +step 3285/5000 loss 0.1403 (w 0.2127 mse 0.2159 t 932 new 0.17) lr 1.00e-05 gnorm 0.229 3.07s mem 81.1GB +step 3286/5000 loss 0.2103 (w 0.1365 mse 0.1336 t 741 new 0.19) lr 1.00e-05 gnorm 1.498 2.83s mem 81.1GB +step 3287/5000 loss 0.2025 (w 0.2028 mse 0.1977 t 706 new 0.28) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +step 3288/5000 loss 0.1456 (w 0.2559 mse 0.2523 t 968 new 0.22) lr 1.00e-05 gnorm 0.163 3.34s mem 81.1GB +step 3289/5000 loss 0.1922 (w 0.2148 mse 0.1923 t 921 new 0.22) lr 1.00e-05 gnorm 0.139 3.40s mem 81.1GB +step 3290/5000 loss 0.2098 (w 0.3002 mse 0.2933 t 999 new 0.23) lr 1.00e-05 gnorm 0.121 3.30s mem 81.1GB +step 3291/5000 loss 0.2375 (w 0.1652 mse 0.1758 t 662 new 0.17) lr 1.00e-05 gnorm 0.114 3.08s mem 81.1GB +step 3292/5000 loss 0.3303 (w 0.2336 mse 0.2182 t 950 new 0.20) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +step 3293/5000 loss 0.2638 (w 0.4244 mse 0.3951 t 969 new 0.23) lr 1.00e-05 gnorm 0.181 3.04s mem 81.1GB +step 3294/5000 loss 0.2015 (w 0.2917 mse 0.3051 t 983 new 0.11) lr 1.00e-05 gnorm 0.141 3.33s mem 81.1GB +step 3295/5000 loss 0.2638 (w 0.2430 mse 0.2428 t 951 new 0.22) lr 1.00e-05 gnorm 0.219 3.42s mem 81.1GB +step 3296/5000 loss 0.3847 (w 0.2453 mse 0.2336 t 973 new 0.21) lr 1.00e-05 gnorm 0.188 3.08s mem 81.1GB +step 3297/5000 loss 0.1663 (w 0.2968 mse 0.2821 t 947 new 0.19) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +step 3298/5000 loss 0.3113 (w 0.5610 mse 0.5537 t 171 new 0.25) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +step 3299/5000 loss 0.3085 (w 0.1877 mse 0.1869 t 918 new 0.22) lr 1.00e-05 gnorm 0.308 3.25s mem 81.1GB +step 3300/5000 loss 0.2131 (w 0.1647 mse 0.1674 t 702 new 0.10) lr 1.00e-05 gnorm 0.112 3.10s mem 81.1GB +step 3301/5000 loss 0.1692 (w 0.2000 mse 0.1903 t 917 new 0.21) lr 1.00e-05 gnorm 0.210 3.35s mem 81.1GB +step 3302/5000 loss 0.3623 (w 0.1560 mse 0.1579 t 743 new 0.25) lr 1.00e-05 gnorm 0.180 3.11s mem 81.1GB +step 3303/5000 loss 0.1475 (w 0.1036 mse 0.1064 t 894 new 0.29) lr 1.00e-05 gnorm 0.133 3.08s mem 81.1GB +step 3304/5000 loss 0.2547 (w 0.2250 mse 0.2235 t 963 new 0.24) lr 1.00e-05 gnorm 0.326 2.84s mem 81.1GB +step 3305/5000 loss 0.1239 (w 0.2589 mse 0.2513 t 736 new 0.26) lr 1.00e-05 gnorm 0.309 3.26s mem 81.1GB +step 3306/5000 loss 0.2828 (w 0.2273 mse 0.2320 t 738 new 0.18) lr 1.00e-05 gnorm 0.307 3.34s mem 81.1GB +step 3307/5000 loss 0.1567 (w 0.2448 mse 0.2374 t 940 new 0.21) lr 1.00e-05 gnorm 0.123 3.08s mem 81.1GB +step 3308/5000 loss 0.2156 (w 0.2693 mse 0.2525 t 987 new 0.20) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +step 3309/5000 loss 0.0885 (w 0.2787 mse 0.2747 t 977 new 0.20) lr 1.00e-05 gnorm 0.132 3.10s mem 81.1GB +step 3310/5000 loss 0.1214 (w 0.1844 mse 0.1886 t 913 new 0.20) lr 1.00e-05 gnorm 0.190 2.83s mem 81.1GB +step 3311/5000 loss 0.1717 (w 0.1250 mse 0.1266 t 947 new 0.25) lr 1.00e-05 gnorm 0.149 3.35s mem 81.1GB +step 3312/5000 loss 0.2115 (w 0.3216 mse 0.3125 t 966 new 0.28) lr 1.00e-05 gnorm 0.230 3.14s mem 81.1GB +step 3313/5000 loss 0.3102 (w 0.2904 mse 0.2750 t 1000 new 0.20) lr 1.00e-05 gnorm 0.110 3.05s mem 81.1GB +step 3314/5000 loss 0.2105 (w 0.2126 mse 0.2070 t 884 new 0.16) lr 1.00e-05 gnorm 0.168 3.30s mem 81.1GB +step 3315/5000 loss 0.2634 (w 0.1951 mse 0.2100 t 984 new 0.20) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +step 3316/5000 loss 0.3717 (w 0.0843 mse 0.0979 t 725 new 0.19) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +step 3317/5000 loss 0.2433 (w 0.1819 mse 0.1958 t 521 new 0.15) lr 1.00e-05 gnorm 0.188 3.09s mem 81.1GB +step 3318/5000 loss 0.2401 (w 0.2021 mse 0.2071 t 584 new 0.23) lr 1.00e-05 gnorm 0.137 3.47s mem 81.1GB +step 3319/5000 loss 0.2893 (w 0.2538 mse 0.2470 t 648 new 0.24) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +step 3320/5000 loss 0.3318 (w 0.1534 mse 0.1493 t 610 new 0.19) lr 1.00e-05 gnorm 0.161 3.10s mem 81.1GB +step 3321/5000 loss 0.2022 (w 0.2752 mse 0.2764 t 878 new 0.13) lr 1.00e-05 gnorm 0.202 2.83s mem 81.1GB +step 3322/5000 loss 0.3427 (w 0.1558 mse 0.1538 t 989 new 0.13) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +step 3323/5000 loss 0.2057 (w 0.1308 mse 0.1422 t 813 new 0.15) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +step 3324/5000 loss 0.1641 (w 0.2250 mse 0.2138 t 961 new 0.20) lr 1.00e-05 gnorm 0.133 3.33s mem 81.1GB +step 3325/5000 loss 0.1110 (w 0.1346 mse 0.1460 t 966 new 0.10) lr 1.00e-05 gnorm 0.132 3.38s mem 81.1GB +step 3326/5000 loss 0.2972 (w 0.3642 mse 0.3645 t 434 new 0.18) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +step 3327/5000 loss 0.1747 (w 0.2427 mse 0.2448 t 796 new 0.21) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +step 3328/5000 loss 0.2337 (w 0.2997 mse 0.3014 t 954 new 0.20) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +step 3329/5000 loss 0.1352 (w 0.2237 mse 0.2149 t 873 new 0.16) lr 1.00e-05 gnorm 0.116 3.30s mem 81.1GB +step 3330/5000 loss 0.3589 (w 0.2114 mse 0.2084 t 728 new 0.11) lr 1.00e-05 gnorm 0.149 3.41s mem 81.1GB +step 3331/5000 loss 0.1872 (w 0.1767 mse 0.1770 t 948 new 0.24) lr 1.00e-05 gnorm 0.141 3.11s mem 81.1GB +step 3332/5000 loss 0.2267 (w 0.2497 mse 0.2467 t 913 new 0.23) lr 1.00e-05 gnorm 0.167 3.08s mem 81.1GB +step 3333/5000 loss 0.2720 (w 0.5116 mse 0.5232 t 998 new 0.19) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +step 3334/5000 loss 0.2992 (w 0.1675 mse 0.1825 t 859 new 0.19) lr 1.00e-05 gnorm 0.167 3.27s mem 81.1GB +step 3335/5000 loss 0.2701 (w 0.5347 mse 0.5372 t 183 new 0.14) lr 1.00e-05 gnorm 0.143 3.07s mem 81.1GB +step 3336/5000 loss 0.2143 (w 0.1496 mse 0.1616 t 746 new 0.16) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +step 3337/5000 loss 0.2683 (w 0.1282 mse 0.1301 t 623 new 0.10) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +step 3338/5000 loss 0.1705 (w 0.2311 mse 0.2273 t 950 new 0.24) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +step 3339/5000 loss 0.1258 (w 0.1373 mse 0.1262 t 787 new 0.24) lr 1.00e-05 gnorm 0.175 2.83s mem 81.1GB +step 3340/5000 loss 0.4041 (w 0.2675 mse 0.2564 t 687 new 0.22) lr 1.00e-05 gnorm 0.212 3.31s mem 81.1GB +step 3341/5000 loss 0.2844 (w 0.3887 mse 0.4128 t 238 new 0.20) lr 1.00e-05 gnorm 0.159 3.10s mem 81.1GB +step 3342/5000 loss 0.1560 (w 0.2292 mse 0.2263 t 966 new 0.24) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +step 3343/5000 loss 0.2307 (w 0.2701 mse 0.2564 t 871 new 0.26) lr 1.00e-05 gnorm 0.199 3.41s mem 81.1GB +step 3344/5000 loss 0.4202 (w 0.1541 mse 0.1596 t 773 new 0.18) lr 1.00e-05 gnorm 0.133 2.82s mem 81.1GB +step 3345/5000 loss 0.1578 (w 0.1753 mse 0.1809 t 553 new 0.21) lr 1.00e-05 gnorm 0.137 3.10s mem 81.1GB +step 3346/5000 loss 0.2945 (w 0.2889 mse 0.2848 t 397 new 0.18) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +step 3347/5000 loss 0.1902 (w 0.1250 mse 0.1372 t 883 new 0.15) lr 1.00e-05 gnorm 0.153 3.27s mem 81.1GB +step 3348/5000 loss 0.4058 (w 0.2342 mse 0.2198 t 729 new 0.17) lr 1.00e-05 gnorm 0.183 3.58s mem 81.1GB +step 3349/5000 loss 0.1599 (w 0.2314 mse 0.2151 t 929 new 0.23) lr 1.00e-05 gnorm 0.174 3.07s mem 81.1GB +step 3350/5000 loss 0.1504 (w 0.2119 mse 0.2221 t 983 new 0.08) lr 1.00e-05 gnorm 0.126 2.83s mem 81.1GB +step 3351/5000 loss 0.2176 (w 0.1927 mse 0.1860 t 804 new 0.12) lr 1.00e-05 gnorm 0.144 3.03s mem 81.1GB +step 3352/5000 loss 0.2555 (w 0.2217 mse 0.2444 t 987 new 0.14) lr 1.00e-05 gnorm 0.131 3.06s mem 81.1GB +step 3353/5000 loss 0.2304 (w 0.1233 mse 0.1250 t 670 new 0.24) lr 1.00e-05 gnorm 0.150 3.41s mem 81.1GB +step 3354/5000 loss 0.2645 (w 0.1257 mse 0.1217 t 660 new 0.13) lr 1.00e-05 gnorm 0.114 3.08s mem 81.1GB +step 3355/5000 loss 0.1543 (w 0.1939 mse 0.2003 t 991 new 0.18) lr 1.00e-05 gnorm 0.148 3.11s mem 81.1GB +step 3356/5000 loss 0.1729 (w 0.1518 mse 0.1501 t 508 new 0.14) lr 1.00e-05 gnorm 0.149 2.82s mem 81.1GB +step 3357/5000 loss 0.1469 (w 0.3498 mse 0.3531 t 998 new 0.20) lr 1.00e-05 gnorm 0.299 3.07s mem 81.1GB +step 3358/5000 loss 0.2290 (w 0.3215 mse 0.3142 t 340 new 0.25) lr 1.00e-05 gnorm 0.118 3.04s mem 81.1GB +step 3359/5000 loss 0.3053 (w 0.2272 mse 0.2348 t 909 new 0.18) lr 1.00e-05 gnorm 0.120 3.32s mem 81.1GB +step 3360/5000 loss 0.3740 (w 0.2346 mse 0.2232 t 861 new 0.23) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +step 3361/5000 loss 0.1303 (w 0.4893 mse 0.5035 t 996 new 0.17) lr 1.00e-05 gnorm 0.118 3.13s mem 81.1GB +step 3362/5000 loss 0.1667 (w 0.2311 mse 0.2191 t 795 new 0.20) lr 1.00e-05 gnorm 0.218 2.83s mem 81.1GB +step 3363/5000 loss 0.1938 (w 0.2303 mse 0.2105 t 893 new 0.21) lr 1.00e-05 gnorm 0.169 3.10s mem 81.1GB +step 3364/5000 loss 0.1758 (w 0.2338 mse 0.2280 t 990 new 0.23) lr 1.00e-05 gnorm 0.188 3.08s mem 81.1GB +step 3365/5000 loss 0.3000 (w 0.5172 mse 0.5428 t 120 new 0.26) lr 1.00e-05 gnorm 0.152 3.40s mem 81.1GB +step 3366/5000 loss 0.1137 (w 0.2387 mse 0.2334 t 938 new 0.23) lr 1.00e-05 gnorm 0.126 3.12s mem 81.1GB +step 3367/5000 loss 0.1891 (w 0.2607 mse 0.2544 t 895 new 0.19) lr 1.00e-05 gnorm 0.193 3.18s mem 81.1GB +step 3368/5000 loss 0.1215 (w 0.2376 mse 0.2335 t 753 new 0.18) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +step 3369/5000 loss 0.4000 (w 0.7053 mse 0.7185 t 107 new 0.21) lr 1.00e-05 gnorm 0.199 3.04s mem 81.1GB +step 3370/5000 loss 0.1897 (w 0.2598 mse 0.2431 t 768 new 0.23) lr 1.00e-05 gnorm 0.136 3.32s mem 81.1GB +step 3371/5000 loss 0.2553 (w 0.1677 mse 0.1610 t 940 new 0.20) lr 1.00e-05 gnorm 0.134 3.45s mem 81.1GB +step 3372/5000 loss 0.3192 (w 0.2720 mse 0.2658 t 836 new 0.29) lr 1.00e-05 gnorm 0.172 2.82s mem 81.1GB +step 3373/5000 loss 0.2101 (w 0.2347 mse 0.2144 t 914 new 0.20) lr 1.00e-05 gnorm 0.121 3.07s mem 81.1GB +step 3374/5000 loss 0.2443 (w 0.1866 mse 0.1819 t 921 new 0.24) lr 1.00e-05 gnorm 0.170 2.82s mem 81.1GB +step 3375/5000 loss 0.1578 (w 0.1352 mse 0.1449 t 855 new 0.26) lr 1.00e-05 gnorm 0.161 3.29s mem 81.1GB +step 3376/5000 loss 0.3561 (w 0.1878 mse 0.1846 t 893 new 0.22) lr 1.00e-05 gnorm 0.161 3.12s mem 81.1GB +step 3377/5000 loss 0.1564 (w 0.2929 mse 0.2908 t 996 new 0.05) lr 1.00e-05 gnorm 0.184 3.38s mem 81.1GB +step 3378/5000 loss 0.2346 (w 0.1229 mse 0.1425 t 811 new 0.19) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +step 3379/5000 loss 0.2217 (w 0.2335 mse 0.2178 t 685 new 0.25) lr 1.00e-05 gnorm 0.181 3.14s mem 81.1GB +step 3380/5000 loss 0.1266 (w 0.2246 mse 0.2200 t 742 new 0.10) lr 1.00e-05 gnorm 0.113 3.02s mem 81.1GB +step 3381/5000 loss 0.2949 (w 0.2208 mse 0.2001 t 826 new 0.21) lr 1.00e-05 gnorm 0.204 3.08s mem 81.1GB +step 3382/5000 loss 0.2818 (w 0.2307 mse 0.2214 t 939 new 0.22) lr 1.00e-05 gnorm 0.142 3.43s mem 81.1GB +step 3383/5000 loss 0.2407 (w 0.3273 mse 0.3122 t 798 new 0.25) lr 1.00e-05 gnorm 0.115 3.14s mem 81.1GB +step 3384/5000 loss 0.1765 (w 0.2340 mse 0.2327 t 745 new 0.03) lr 1.00e-05 gnorm 0.132 3.06s mem 81.1GB +step 3385/5000 loss 0.2886 (w 0.1272 mse 0.1308 t 673 new 0.15) lr 1.00e-05 gnorm 0.176 2.82s mem 81.1GB +step 3386/5000 loss 0.1031 (w 0.2303 mse 0.2228 t 924 new 0.19) lr 1.00e-05 gnorm 0.126 3.05s mem 81.1GB +step 3387/5000 loss 0.1445 (w 0.1758 mse 0.1696 t 897 new 0.22) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +step 3388/5000 loss 0.2298 (w 0.3503 mse 0.3376 t 977 new 0.20) lr 1.00e-05 gnorm 0.535 3.44s mem 81.1GB +step 3389/5000 loss 0.1125 (w 0.2880 mse 0.2870 t 969 new 0.22) lr 1.00e-05 gnorm 0.164 3.16s mem 81.1GB +step 3390/5000 loss 0.1417 (w 0.2162 mse 0.1958 t 830 new 0.21) lr 1.00e-05 gnorm 0.131 3.05s mem 81.1GB +step 3391/5000 loss 0.1557 (w 0.2614 mse 0.2449 t 965 new 0.27) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +step 3392/5000 loss 0.2093 (w 0.1848 mse 0.1854 t 876 new 0.18) lr 1.00e-05 gnorm 0.156 3.02s mem 81.1GB +step 3393/5000 loss 0.2702 (w 0.3741 mse 0.3968 t 206 new 0.11) lr 1.00e-05 gnorm 0.133 3.15s mem 81.1GB +step 3394/5000 loss 0.1241 (w 0.1598 mse 0.1639 t 875 new 0.10) lr 1.00e-05 gnorm 0.175 3.04s mem 81.1GB +step 3395/5000 loss 0.3878 (w 0.4983 mse 0.4833 t 283 new 0.24) lr 1.00e-05 gnorm 0.182 3.09s mem 81.1GB +step 3396/5000 loss 0.1643 (w 0.2705 mse 0.2526 t 733 new 0.17) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +step 3397/5000 loss 0.1398 (w 0.3658 mse 0.3536 t 987 new 0.21) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +step 3398/5000 loss 0.1307 (w 0.2115 mse 0.2072 t 998 new 0.13) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +step 3399/5000 loss 0.2808 (w 0.2619 mse 0.2716 t 599 new 0.16) lr 1.00e-05 gnorm 0.176 3.08s mem 81.1GB +step 3400/5000 loss 0.0950 (w 0.3700 mse 0.3398 t 986 new 0.20) lr 1.00e-05 gnorm 0.188 3.08s mem 81.1GB +step 3401/5000 loss 0.2872 (w 0.1944 mse 0.1881 t 769 new 0.22) lr 1.00e-05 gnorm 0.198 3.07s mem 81.1GB +step 3402/5000 loss 0.2425 (w 0.1930 mse 0.1865 t 985 new 0.14) lr 1.00e-05 gnorm 0.167 3.08s mem 81.1GB +step 3403/5000 loss 0.1025 (w 0.3018 mse 0.3053 t 962 new 0.22) lr 1.00e-05 gnorm 0.137 3.09s mem 81.1GB +step 3404/5000 loss 0.1443 (w 0.2918 mse 0.2802 t 987 new 0.24) lr 1.00e-05 gnorm 0.095 2.83s mem 81.1GB +step 3405/5000 loss 0.1171 (w 0.1559 mse 0.1607 t 924 new 0.20) lr 1.00e-05 gnorm 0.168 3.13s mem 81.1GB +step 3406/5000 loss 0.1408 (w 0.1620 mse 0.1656 t 882 new 0.19) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +step 3407/5000 loss 0.1286 (w 0.2115 mse 0.2121 t 850 new 0.12) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +step 3408/5000 loss 0.1136 (w 0.2261 mse 0.2159 t 903 new 0.26) lr 1.00e-05 gnorm 0.191 3.08s mem 81.1GB +step 3409/5000 loss 0.1558 (w 0.2462 mse 0.2328 t 830 new 0.19) lr 1.00e-05 gnorm 0.158 3.08s mem 81.1GB +step 3410/5000 loss 0.3028 (w 0.3125 mse 0.3066 t 418 new 0.21) lr 1.00e-05 gnorm 0.148 2.82s mem 81.1GB +step 3411/5000 loss 0.1329 (w 0.3136 mse 0.3119 t 972 new 0.24) lr 1.00e-05 gnorm 0.116 3.41s mem 81.1GB +step 3412/5000 loss 0.1595 (w 0.0938 mse 0.1079 t 754 new 0.22) lr 1.00e-05 gnorm 0.108 3.38s mem 81.1GB +step 3413/5000 loss 0.1656 (w 0.2228 mse 0.2029 t 874 new 0.16) lr 1.00e-05 gnorm 0.235 3.07s mem 81.1GB +step 3414/5000 loss 0.3386 (w 0.3484 mse 0.3446 t 952 new 0.27) lr 1.00e-05 gnorm 0.209 3.12s mem 81.1GB +step 3415/5000 loss 0.2897 (w 0.2896 mse 0.2803 t 948 new 0.18) lr 1.00e-05 gnorm 0.206 2.82s mem 81.1GB +step 3416/5000 loss 0.2441 (w 0.3240 mse 0.3173 t 970 new 0.24) lr 1.00e-05 gnorm 0.617 3.06s mem 81.1GB +step 3417/5000 loss 0.2067 (w 0.3732 mse 0.3613 t 956 new 0.24) lr 1.00e-05 gnorm 0.170 3.11s mem 81.1GB +step 3418/5000 loss 0.1587 (w 0.1874 mse 0.1916 t 944 new 0.08) lr 1.00e-05 gnorm 0.164 3.38s mem 81.1GB +step 3419/5000 loss 0.1910 (w 0.3306 mse 0.3216 t 974 new 0.28) lr 1.00e-05 gnorm 0.137 3.30s mem 81.1GB +step 3420/5000 loss 0.1929 (w 0.1805 mse 0.1816 t 963 new 0.20) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +step 3421/5000 loss 0.2961 (w 0.2147 mse 0.2046 t 875 new 0.27) lr 1.00e-05 gnorm 0.172 3.00s mem 81.1GB +step 3422/5000 loss 0.3641 (w 0.2383 mse 0.2383 t 818 new 0.19) lr 1.00e-05 gnorm 0.200 2.83s mem 81.1GB +step 3423/5000 loss 0.2480 (w 0.4369 mse 0.4539 t 238 new 0.08) lr 1.00e-05 gnorm 0.130 3.16s mem 81.1GB +step 3424/5000 loss 0.2385 (w 0.2167 mse 0.2048 t 779 new 0.14) lr 1.00e-05 gnorm 0.207 3.41s mem 81.1GB +step 3425/5000 loss 0.1591 (w 0.2029 mse 0.2150 t 948 new 0.18) lr 1.00e-05 gnorm 0.477 3.33s mem 81.1GB +step 3426/5000 loss 0.3562 (w 0.2492 mse 0.2511 t 278 new 0.19) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +step 3427/5000 loss 0.1746 (w 0.2817 mse 0.2807 t 931 new 0.17) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +step 3428/5000 loss 0.2424 (w 0.2249 mse 0.2137 t 873 new 0.14) lr 1.00e-05 gnorm 0.122 3.17s mem 81.1GB +step 3429/5000 loss 0.2707 (w 0.2125 mse 0.2036 t 846 new 0.13) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +step 3430/5000 loss 0.1163 (w 0.3494 mse 0.3369 t 991 new 0.14) lr 1.00e-05 gnorm 0.219 3.36s mem 81.1GB +step 3431/5000 loss 0.0836 (w 0.0891 mse 0.0874 t 811 new 0.20) lr 1.00e-05 gnorm 0.112 3.32s mem 81.1GB +step 3432/5000 loss 0.1413 (w 0.1873 mse 0.1786 t 794 new 0.21) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +step 3433/5000 loss 0.1565 (w 0.2202 mse 0.2138 t 919 new 0.16) lr 1.00e-05 gnorm 0.360 3.09s mem 81.1GB +step 3434/5000 loss 0.2423 (w 0.3421 mse 0.3173 t 969 new 0.26) lr 1.00e-05 gnorm 0.227 3.12s mem 81.1GB +step 3435/5000 loss 0.1318 (w 0.1733 mse 0.1710 t 862 new 0.28) lr 1.00e-05 gnorm 0.257 3.08s mem 81.1GB +step 3436/5000 loss 0.1817 (w 0.1746 mse 0.1635 t 819 new 0.23) lr 1.00e-05 gnorm 0.165 3.34s mem 81.1GB +step 3437/5000 loss 0.2449 (w 0.2191 mse 0.2277 t 991 new 0.23) lr 1.00e-05 gnorm 0.160 3.16s mem 81.1GB +step 3438/5000 loss 0.2132 (w 0.2204 mse 0.2176 t 654 new 0.20) lr 1.00e-05 gnorm 0.213 2.84s mem 81.1GB +step 3439/5000 loss 0.1017 (w 0.1385 mse 0.1399 t 935 new 0.26) lr 1.00e-05 gnorm 0.194 3.10s mem 81.1GB +step 3440/5000 loss 0.2169 (w 0.4251 mse 0.4268 t 1000 new 0.20) lr 1.00e-05 gnorm 0.267 3.13s mem 81.1GB +step 3441/5000 loss 0.3238 (w 0.1735 mse 0.1862 t 465 new 0.10) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +step 3442/5000 loss 0.2177 (w 0.2419 mse 0.2452 t 418 new 0.15) lr 1.00e-05 gnorm 0.223 3.36s mem 81.1GB +step 3443/5000 loss 0.1176 (w 0.2403 mse 0.2420 t 886 new 0.24) lr 1.00e-05 gnorm 0.313 3.36s mem 81.1GB +step 3444/5000 loss 0.3412 (w 0.1442 mse 0.1439 t 901 new 0.08) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +step 3445/5000 loss 0.2450 (w 0.2555 mse 0.2359 t 763 new 0.23) lr 1.00e-05 gnorm 0.153 3.02s mem 81.1GB +step 3446/5000 loss 0.2002 (w 0.1707 mse 0.1692 t 766 new 0.15) lr 1.00e-05 gnorm 0.347 3.41s mem 81.1GB +step 3447/5000 loss 0.2879 (w 0.2131 mse 0.2098 t 641 new 0.23) lr 1.00e-05 gnorm 0.127 3.11s mem 81.1GB +step 3448/5000 loss 0.1620 (w 0.3031 mse 0.3068 t 967 new 0.21) lr 1.00e-05 gnorm 0.162 3.32s mem 81.1GB +step 3449/5000 loss 0.2435 (w 0.2415 mse 0.2669 t 962 new 0.22) lr 1.00e-05 gnorm 0.179 3.10s mem 81.1GB +step 3450/5000 loss 0.3182 (w 0.3058 mse 0.2966 t 979 new 0.18) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +step 3451/5000 loss 0.1300 (w 0.1378 mse 0.1339 t 941 new 0.17) lr 1.00e-05 gnorm 0.157 2.84s mem 81.1GB +step 3452/5000 loss 0.1976 (w 0.0947 mse 0.0872 t 883 new 0.13) lr 1.00e-05 gnorm 0.388 3.39s mem 81.1GB +step 3453/5000 loss 0.2031 (w 0.2361 mse 0.2448 t 434 new 0.12) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +step 3454/5000 loss 0.1468 (w 0.2268 mse 0.2128 t 879 new 0.24) lr 1.00e-05 gnorm 0.233 3.08s mem 81.1GB +step 3455/5000 loss 0.1519 (w 0.3172 mse 0.2920 t 971 new 0.23) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +step 3456/5000 loss 0.2278 (w 0.2094 mse 0.2010 t 914 new 0.26) lr 1.00e-05 gnorm 0.143 3.03s mem 81.1GB +step 3457/5000 loss 0.2300 (w 0.2060 mse 0.1882 t 997 new 0.26) lr 1.00e-05 gnorm 0.251 2.83s mem 81.1GB +step 3458/5000 loss 0.2923 (w 0.2775 mse 0.2624 t 795 new 0.22) lr 1.00e-05 gnorm 0.111 3.37s mem 81.1GB +step 3459/5000 loss 0.1917 (w 0.1736 mse 0.1700 t 882 new 0.11) lr 1.00e-05 gnorm 0.121 3.26s mem 81.1GB +step 3460/5000 loss 0.2089 (w 0.2540 mse 0.2575 t 988 new 0.23) lr 1.00e-05 gnorm 0.132 3.29s mem 81.1GB +step 3461/5000 loss 0.2662 (w 0.3029 mse 0.2839 t 916 new 0.20) lr 1.00e-05 gnorm 0.149 3.06s mem 81.1GB +step 3462/5000 loss 0.2624 (w 0.2390 mse 0.2440 t 997 new 0.20) lr 1.00e-05 gnorm 0.123 3.04s mem 81.1GB +step 3463/5000 loss 0.0686 (w 0.2462 mse 0.2429 t 967 new 0.24) lr 1.00e-05 gnorm 0.130 2.82s mem 81.1GB +step 3464/5000 loss 0.2859 (w 0.3196 mse 0.3041 t 779 new 0.23) lr 1.00e-05 gnorm 0.124 3.37s mem 81.1GB +step 3465/5000 loss 0.0898 (w 0.2632 mse 0.2620 t 965 new 0.18) lr 1.00e-05 gnorm 0.141 3.25s mem 81.1GB +step 3466/5000 loss 0.1907 (w 0.1941 mse 0.1911 t 968 new 0.21) lr 1.00e-05 gnorm 0.779 3.31s mem 81.1GB +step 3467/5000 loss 0.2435 (w 0.1970 mse 0.1986 t 942 new 0.24) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +step 3468/5000 loss 0.2005 (w 0.2708 mse 0.2540 t 858 new 0.26) lr 1.00e-05 gnorm 0.144 3.10s mem 81.1GB +step 3469/5000 loss 0.2093 (w 0.2038 mse 0.1990 t 768 new 0.24) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +step 3470/5000 loss 0.3372 (w 0.2424 mse 0.2448 t 535 new 0.18) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +step 3471/5000 loss 0.2469 (w 0.5263 mse 0.5381 t 100 new 0.22) lr 1.00e-05 gnorm 0.159 3.27s mem 81.1GB +step 3472/5000 loss 0.1403 (w 0.1946 mse 0.1978 t 958 new 0.24) lr 1.00e-05 gnorm 0.256 3.33s mem 81.1GB +step 3473/5000 loss 0.1941 (w 0.1576 mse 0.1495 t 704 new 0.26) lr 1.00e-05 gnorm 0.391 3.05s mem 81.1GB +step 3474/5000 loss 0.1541 (w 0.2135 mse 0.1975 t 843 new 0.23) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +step 3475/5000 loss 0.1975 (w 0.2368 mse 0.2339 t 970 new 0.11) lr 1.00e-05 gnorm 0.370 3.07s mem 81.1GB +step 3476/5000 loss 0.1308 (w 0.2693 mse 0.2613 t 966 new 0.25) lr 1.00e-05 gnorm 0.143 3.07s mem 81.1GB +step 3477/5000 loss 0.2359 (w 0.2911 mse 0.2890 t 990 new 0.21) lr 1.00e-05 gnorm 0.140 3.33s mem 81.1GB +step 3478/5000 loss 0.3156 (w 0.1973 mse 0.2012 t 586 new 0.10) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +step 3479/5000 loss 0.2267 (w 0.3438 mse 0.3306 t 998 new 0.22) lr 1.00e-05 gnorm 0.172 2.82s mem 81.1GB +step 3480/5000 loss 0.1696 (w 0.1681 mse 0.1621 t 908 new 0.12) lr 1.00e-05 gnorm 0.145 3.03s mem 81.1GB +step 3481/5000 loss 0.2231 (w 0.2753 mse 0.2671 t 844 new 0.26) lr 1.00e-05 gnorm 0.138 3.05s mem 81.1GB +step 3482/5000 loss 0.2988 (w 0.2192 mse 0.2207 t 976 new 0.19) lr 1.00e-05 gnorm 0.261 3.04s mem 81.1GB +step 3483/5000 loss 0.2657 (w 0.1913 mse 0.1881 t 731 new 0.23) lr 1.00e-05 gnorm 0.138 3.39s mem 81.1GB +step 3484/5000 loss 0.1036 (w 0.1995 mse 0.2007 t 920 new 0.22) lr 1.00e-05 gnorm 0.117 3.25s mem 81.1GB +step 3485/5000 loss 0.0951 (w 0.2041 mse 0.2242 t 976 new 0.16) lr 1.00e-05 gnorm 0.117 3.08s mem 81.1GB +step 3486/5000 loss 0.2844 (w 0.3002 mse 0.3043 t 964 new 0.22) lr 1.00e-05 gnorm 0.234 2.84s mem 81.1GB +step 3487/5000 loss 0.3117 (w 0.1528 mse 0.1625 t 940 new 0.17) lr 1.00e-05 gnorm 0.427 3.09s mem 81.1GB +step 3488/5000 loss 0.1970 (w 0.2029 mse 0.1959 t 939 new 0.22) lr 1.00e-05 gnorm 0.114 3.37s mem 81.1GB +step 3489/5000 loss 0.0938 (w 0.2073 mse 0.1986 t 899 new 0.16) lr 1.00e-05 gnorm 0.251 3.07s mem 81.1GB +step 3490/5000 loss 0.2079 (w 0.5365 mse 0.5172 t 989 new 0.18) lr 1.00e-05 gnorm 0.827 3.32s mem 81.1GB +step 3491/5000 loss 0.1112 (w 0.2317 mse 0.2227 t 976 new 0.08) lr 1.00e-05 gnorm 0.185 3.01s mem 81.1GB +step 3492/5000 loss 0.2483 (w 0.2029 mse 0.1973 t 799 new 0.24) lr 1.00e-05 gnorm 0.125 2.81s mem 81.1GB +step 3493/5000 loss 0.1414 (w 0.2751 mse 0.2713 t 996 new 0.06) lr 1.00e-05 gnorm 0.098 3.12s mem 81.1GB +step 3494/5000 loss 0.2380 (w 0.0893 mse 0.0903 t 760 new 0.27) lr 1.00e-05 gnorm 0.162 3.49s mem 81.1GB +step 3495/5000 loss 0.2768 (w 0.5739 mse 0.6001 t 114 new 0.13) lr 1.00e-05 gnorm 0.127 3.33s mem 81.1GB +step 3496/5000 loss 0.2249 (w 0.2007 mse 0.1858 t 815 new 0.28) lr 1.00e-05 gnorm 0.129 3.01s mem 81.1GB +step 3497/5000 loss 0.1291 (w 0.4309 mse 0.4573 t 986 new 0.26) lr 1.00e-05 gnorm 0.157 3.03s mem 81.1GB +step 3498/5000 loss 0.3771 (w 0.2206 mse 0.1982 t 961 new 0.09) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +step 3499/5000 loss 0.2243 (w 0.2148 mse 0.2242 t 631 new 0.19) lr 1.00e-05 gnorm 0.159 3.33s mem 81.1GB +step 3500/5000 loss 0.3143 (w 0.1466 mse 0.1593 t 910 new 0.21) lr 1.00e-05 gnorm 0.311 3.30s mem 81.1GB +[val] step 3500 t=200: w=0.4149 mse=0.4255 (n=16) t=500: w=0.2203 mse=0.2238 (n=16) t=800: w=0.1722 mse=0.1714 (n=16) | mean w=0.2691 mse=0.2736 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step3500.safetensors 4093 个张量 37.98 GB +step 3501/5000 loss 0.2143 (w 0.2090 mse 0.2084 t 933 new 0.23) lr 1.00e-05 gnorm 0.159 3.36s mem 81.1GB +step 3502/5000 loss 0.2510 (w 0.2113 mse 0.2050 t 836 new 0.21) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +step 3503/5000 loss 0.2127 (w 0.3305 mse 0.3336 t 994 new 0.17) lr 1.00e-05 gnorm 0.151 3.45s mem 81.1GB +step 3504/5000 loss 0.1641 (w 0.2897 mse 0.3098 t 995 new 0.13) lr 1.00e-05 gnorm 0.117 2.81s mem 81.1GB +step 3505/5000 loss 0.2224 (w 0.1817 mse 0.1863 t 557 new 0.11) lr 1.00e-05 gnorm 0.120 3.09s mem 81.1GB +step 3506/5000 loss 0.2556 (w 0.2409 mse 0.2485 t 992 new 0.22) lr 1.00e-05 gnorm 0.561 3.46s mem 81.1GB +step 3507/5000 loss 0.1723 (w 0.3821 mse 0.3652 t 997 new 0.25) lr 1.00e-05 gnorm 0.152 3.09s mem 81.1GB +step 3508/5000 loss 0.2464 (w 0.2054 mse 0.1972 t 842 new 0.22) lr 1.00e-05 gnorm 0.126 3.12s mem 81.1GB +step 3509/5000 loss 0.2154 (w 0.3581 mse 0.3581 t 999 new 0.21) lr 1.00e-05 gnorm 0.117 3.35s mem 81.1GB +step 3510/5000 loss 0.1304 (w 0.3212 mse 0.3098 t 975 new 0.23) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +step 3511/5000 loss 0.2094 (w 0.2579 mse 0.2633 t 957 new 0.21) lr 1.00e-05 gnorm 0.180 3.11s mem 81.1GB +step 3512/5000 loss 0.1720 (w 0.1262 mse 0.1353 t 922 new 0.22) lr 1.00e-05 gnorm 0.139 3.38s mem 81.1GB +step 3513/5000 loss 0.2677 (w 0.2855 mse 0.2942 t 238 new 0.15) lr 1.00e-05 gnorm 0.148 3.13s mem 81.1GB +step 3514/5000 loss 0.2142 (w 0.2556 mse 0.2626 t 996 new 0.23) lr 1.00e-05 gnorm 0.113 3.12s mem 81.1GB +step 3515/5000 loss 0.2841 (w 0.1955 mse 0.1980 t 866 new 0.11) lr 1.00e-05 gnorm 0.147 3.52s mem 81.1GB +step 3516/5000 loss 0.1774 (w 0.2024 mse 0.1904 t 609 new 0.21) lr 1.00e-05 gnorm 0.176 2.90s mem 81.1GB +step 3517/5000 loss 0.3200 (w 0.1583 mse 0.1561 t 864 new 0.24) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +step 3518/5000 loss 0.2018 (w 0.4590 mse 0.4416 t 996 new 0.28) lr 1.00e-05 gnorm 0.126 4.27s mem 81.1GB +step 3519/5000 loss 0.3686 (w 0.1695 mse 0.1540 t 845 new 0.21) lr 1.00e-05 gnorm 0.130 3.12s mem 81.1GB +step 3520/5000 loss 0.2084 (w 0.2837 mse 0.2763 t 996 new 0.22) lr 1.00e-05 gnorm 0.141 3.41s mem 81.1GB +step 3521/5000 loss 0.3956 (w 0.3407 mse 0.3234 t 264 new 0.22) lr 1.00e-05 gnorm 0.265 3.08s mem 81.1GB +step 3522/5000 loss 0.2246 (w 0.2187 mse 0.2043 t 804 new 0.16) lr 1.00e-05 gnorm 0.135 3.30s mem 81.1GB +step 3523/5000 loss 0.0637 (w 0.1516 mse 0.1499 t 996 new 0.22) lr 1.00e-05 gnorm 0.251 2.84s mem 81.1GB +step 3524/5000 loss 0.2915 (w 0.2709 mse 0.2629 t 872 new 0.25) lr 1.00e-05 gnorm 0.379 3.13s mem 81.1GB +step 3525/5000 loss 0.1907 (w 0.2122 mse 0.2097 t 798 new 0.22) lr 1.00e-05 gnorm 0.134 3.39s mem 81.1GB +step 3526/5000 loss 0.1738 (w 0.2988 mse 0.3043 t 987 new 0.10) lr 1.00e-05 gnorm 0.235 3.06s mem 81.1GB +step 3527/5000 loss 0.2654 (w 0.1898 mse 0.1797 t 829 new 0.22) lr 1.00e-05 gnorm 0.156 3.08s mem 81.1GB +step 3528/5000 loss 0.3144 (w 0.2059 mse 0.2019 t 948 new 0.22) lr 1.00e-05 gnorm 0.178 3.18s mem 81.1GB +step 3529/5000 loss 0.3166 (w 0.1869 mse 0.1884 t 748 new 0.18) lr 1.00e-05 gnorm 0.287 3.18s mem 81.1GB +step 3530/5000 loss 0.1692 (w 0.3610 mse 0.3650 t 995 new 0.13) lr 1.00e-05 gnorm 0.197 3.43s mem 81.1GB +step 3531/5000 loss 0.2902 (w 0.2914 mse 0.2798 t 570 new 0.21) lr 1.00e-05 gnorm 0.223 3.15s mem 81.1GB +step 3532/5000 loss 0.1604 (w 0.3523 mse 0.3430 t 961 new 0.26) lr 1.00e-05 gnorm 0.130 3.21s mem 81.1GB +step 3533/5000 loss 0.2270 (w 0.2332 mse 0.2286 t 931 new 0.23) lr 1.00e-05 gnorm 0.162 3.72s mem 81.1GB +step 3534/5000 loss 0.3127 (w 0.2487 mse 0.2487 t 470 new 0.23) lr 1.00e-05 gnorm 0.159 5.93s mem 81.1GB +step 3535/5000 loss 0.1593 (w 0.1407 mse 0.1381 t 839 new 0.12) lr 1.00e-05 gnorm 0.257 5.97s mem 81.1GB +step 3536/5000 loss 0.2487 (w 0.3399 mse 0.3278 t 995 new 0.18) lr 1.00e-05 gnorm 0.212 5.97s mem 81.1GB +step 3537/5000 loss 0.2246 (w 0.2182 mse 0.2117 t 732 new 0.19) lr 1.00e-05 gnorm 0.220 5.98s mem 81.1GB +step 3538/5000 loss 0.1930 (w 0.3622 mse 0.3392 t 982 new 0.25) lr 1.00e-05 gnorm 0.116 6.11s mem 81.1GB +step 3539/5000 loss 0.1630 (w 0.3590 mse 0.3544 t 999 new 0.19) lr 1.00e-05 gnorm 0.103 6.00s mem 81.1GB +step 3540/5000 loss 0.0785 (w 0.1559 mse 0.1505 t 894 new 0.23) lr 1.00e-05 gnorm 0.106 5.76s mem 81.1GB +step 3541/5000 loss 0.3472 (w 0.2876 mse 0.2819 t 957 new 0.20) lr 1.00e-05 gnorm 0.121 4.92s mem 81.1GB +step 3542/5000 loss 0.2670 (w 0.1997 mse 0.1922 t 823 new 0.19) lr 1.00e-05 gnorm 0.211 3.13s mem 81.1GB +step 3543/5000 loss 0.2455 (w 0.3115 mse 0.3145 t 998 new 0.26) lr 1.00e-05 gnorm 0.151 3.05s mem 81.1GB +step 3544/5000 loss 0.2437 (w 0.1783 mse 0.1787 t 672 new 0.18) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +step 3545/5000 loss 0.1794 (w 0.1394 mse 0.1496 t 879 new 0.25) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +step 3546/5000 loss 0.2037 (w 0.0986 mse 0.1064 t 955 new 0.15) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 3547/5000 loss 0.1407 (w 0.2805 mse 0.2688 t 927 new 0.24) lr 1.00e-05 gnorm 0.157 3.41s mem 81.1GB +step 3548/5000 loss 0.1862 (w 0.2534 mse 0.2615 t 981 new 0.17) lr 1.00e-05 gnorm 0.122 3.18s mem 81.1GB +step 3549/5000 loss 0.1784 (w 0.1455 mse 0.1519 t 911 new 0.24) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +step 3550/5000 loss 0.3052 (w 0.3372 mse 0.3205 t 934 new 0.24) lr 1.00e-05 gnorm 0.153 3.09s mem 81.1GB +step 3551/5000 loss 0.2650 (w 0.1860 mse 0.1908 t 826 new 0.21) lr 1.00e-05 gnorm 0.329 3.41s mem 81.1GB +step 3552/5000 loss 0.3166 (w 0.2712 mse 0.2907 t 988 new 0.20) lr 1.00e-05 gnorm 0.128 2.91s mem 81.1GB +step 3553/5000 loss 0.2107 (w 0.1534 mse 0.1493 t 851 new 0.19) lr 1.00e-05 gnorm 0.346 3.38s mem 81.1GB +step 3554/5000 loss 0.2093 (w 0.4029 mse 0.4003 t 996 new 0.23) lr 1.00e-05 gnorm 0.180 3.44s mem 81.1GB +step 3555/5000 loss 0.2570 (w 0.2650 mse 0.2641 t 981 new 0.26) lr 1.00e-05 gnorm 0.141 2.87s mem 81.1GB +step 3556/5000 loss 0.1535 (w 0.3033 mse 0.2877 t 923 new 0.21) lr 1.00e-05 gnorm 0.208 3.33s mem 81.1GB +step 3557/5000 loss 0.2394 (w 0.0657 mse 0.0749 t 910 new 0.13) lr 1.00e-05 gnorm 0.416 3.98s mem 81.1GB +step 3558/5000 loss 0.1208 (w 0.4227 mse 0.4087 t 995 new 0.23) lr 1.00e-05 gnorm 0.125 2.90s mem 81.1GB +step 3559/5000 loss 0.3530 (w 0.1842 mse 0.1975 t 588 new 0.19) lr 1.00e-05 gnorm 1.372 3.47s mem 81.1GB +step 3560/5000 loss 0.2385 (w 0.1920 mse 0.1887 t 865 new 0.14) lr 1.00e-05 gnorm 0.168 3.08s mem 81.1GB +step 3561/5000 loss 0.2399 (w 0.2009 mse 0.1914 t 878 new 0.21) lr 1.00e-05 gnorm 0.135 3.20s mem 81.1GB +step 3562/5000 loss 0.2001 (w 0.2614 mse 0.2681 t 978 new 0.21) lr 1.00e-05 gnorm 0.170 2.86s mem 81.1GB +step 3563/5000 loss 0.1534 (w 0.2282 mse 0.2215 t 956 new 0.24) lr 1.00e-05 gnorm 0.180 4.13s mem 81.1GB +step 3564/5000 loss 0.1721 (w 0.1230 mse 0.1358 t 719 new 0.19) lr 1.00e-05 gnorm 0.139 3.61s mem 81.1GB +step 3565/5000 loss 0.0986 (w 0.3127 mse 0.3004 t 984 new 0.22) lr 1.00e-05 gnorm 0.157 3.56s mem 81.1GB +step 3566/5000 loss 0.2014 (w 0.1918 mse 0.1803 t 933 new 0.15) lr 1.00e-05 gnorm 0.164 3.05s mem 81.1GB +step 3567/5000 loss 0.3832 (w 0.2550 mse 0.2566 t 456 new 0.23) lr 1.00e-05 gnorm 0.226 3.07s mem 81.1GB +step 3568/5000 loss 0.1651 (w 0.1856 mse 0.1779 t 830 new 0.25) lr 1.00e-05 gnorm 0.221 3.00s mem 81.1GB +step 3569/5000 loss 0.1935 (w 0.1418 mse 0.1520 t 939 new 0.15) lr 1.00e-05 gnorm 0.168 3.14s mem 81.1GB +step 3570/5000 loss 0.1620 (w 0.2239 mse 0.2172 t 775 new 0.25) lr 1.00e-05 gnorm 0.182 3.13s mem 81.1GB +step 3571/5000 loss 0.1461 (w 0.1479 mse 0.1442 t 916 new 0.23) lr 1.00e-05 gnorm 0.129 3.42s mem 81.1GB +step 3572/5000 loss 0.1376 (w 0.1694 mse 0.1873 t 973 new 0.21) lr 1.00e-05 gnorm 0.109 3.11s mem 81.1GB +step 3573/5000 loss 0.1558 (w 0.2088 mse 0.1913 t 928 new 0.27) lr 1.00e-05 gnorm 0.183 3.17s mem 81.1GB +step 3574/5000 loss 0.2258 (w 0.2499 mse 0.2558 t 999 new 0.14) lr 1.00e-05 gnorm 0.134 3.14s mem 81.1GB +step 3575/5000 loss 0.2422 (w 0.1472 mse 0.1407 t 740 new 0.22) lr 1.00e-05 gnorm 0.120 3.70s mem 81.1GB +step 3576/5000 loss 0.1553 (w 0.1717 mse 0.1790 t 979 new 0.23) lr 1.00e-05 gnorm 0.194 3.10s mem 81.1GB +step 3577/5000 loss 0.2465 (w 0.1440 mse 0.1494 t 854 new 0.10) lr 1.00e-05 gnorm 0.127 3.19s mem 81.1GB +step 3578/5000 loss 0.1530 (w 0.1916 mse 0.1877 t 920 new 0.18) lr 1.00e-05 gnorm 0.133 3.19s mem 81.1GB +step 3579/5000 loss 0.2427 (w 0.1997 mse 0.1828 t 828 new 0.20) lr 1.00e-05 gnorm 0.139 3.21s mem 81.1GB +step 3580/5000 loss 0.2839 (w 0.3077 mse 0.2977 t 700 new 0.24) lr 1.00e-05 gnorm 0.238 3.24s mem 81.1GB +step 3581/5000 loss 0.1233 (w 0.2195 mse 0.2280 t 992 new 0.16) lr 1.00e-05 gnorm 0.204 3.10s mem 81.1GB +step 3582/5000 loss 0.3618 (w 0.0530 mse 0.0563 t 634 new 0.06) lr 1.00e-05 gnorm 0.175 3.14s mem 81.1GB +step 3583/5000 loss 0.1607 (w 0.2309 mse 0.2229 t 768 new 0.21) lr 1.00e-05 gnorm 0.161 3.11s mem 81.1GB +step 3584/5000 loss 0.1864 (w 0.2298 mse 0.2118 t 628 new 0.16) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +step 3585/5000 loss 0.1875 (w 0.2392 mse 0.2235 t 680 new 0.23) lr 1.00e-05 gnorm 0.180 3.06s mem 81.1GB +step 3586/5000 loss 0.1470 (w 0.1931 mse 0.1882 t 705 new 0.14) lr 1.00e-05 gnorm 0.108 3.18s mem 81.1GB +step 3587/5000 loss 0.2234 (w 0.1216 mse 0.1219 t 904 new 0.23) lr 1.00e-05 gnorm 0.147 3.29s mem 81.1GB +step 3588/5000 loss 0.2045 (w 0.3138 mse 0.3078 t 356 new 0.19) lr 1.00e-05 gnorm 0.149 3.54s mem 81.1GB +step 3589/5000 loss 0.1542 (w 0.1672 mse 0.1760 t 923 new 0.24) lr 1.00e-05 gnorm 0.131 3.17s mem 81.1GB +step 3590/5000 loss 0.1682 (w 0.1847 mse 0.1764 t 948 new 0.21) lr 1.00e-05 gnorm 0.139 3.45s mem 81.1GB +step 3591/5000 loss 0.1306 (w 0.1251 mse 0.1261 t 884 new 0.26) lr 1.00e-05 gnorm 0.155 2.99s mem 81.1GB +step 3592/5000 loss 0.1518 (w 0.2519 mse 0.2354 t 950 new 0.22) lr 1.00e-05 gnorm 0.143 4.63s mem 81.1GB +step 3593/5000 loss 0.3350 (w 0.4816 mse 0.4804 t 288 new 0.21) lr 1.00e-05 gnorm 0.114 6.20s mem 81.1GB +step 3594/5000 loss 0.2375 (w 0.4929 mse 0.5378 t 127 new 0.23) lr 1.00e-05 gnorm 0.119 6.33s mem 81.1GB +step 3595/5000 loss 0.2161 (w 0.2501 mse 0.2415 t 758 new 0.19) lr 1.00e-05 gnorm 0.134 6.31s mem 81.1GB +step 3596/5000 loss 0.1675 (w 0.3133 mse 0.3129 t 967 new 0.20) lr 1.00e-05 gnorm 0.137 6.47s mem 81.1GB +step 3597/5000 loss 0.2245 (w 0.1703 mse 0.1731 t 975 new 0.26) lr 1.00e-05 gnorm 0.128 6.12s mem 81.1GB +step 3598/5000 loss 0.2144 (w 0.2092 mse 0.1989 t 728 new 0.23) lr 1.00e-05 gnorm 0.155 6.37s mem 81.1GB +step 3599/5000 loss 0.1077 (w 0.2083 mse 0.2045 t 972 new 0.20) lr 1.00e-05 gnorm 0.186 6.31s mem 81.1GB +step 3600/5000 loss 0.3184 (w 0.4387 mse 0.4340 t 269 new 0.24) lr 1.00e-05 gnorm 0.148 3.44s mem 81.1GB +step 3601/5000 loss 0.2214 (w 0.1315 mse 0.1325 t 657 new 0.24) lr 1.00e-05 gnorm 0.576 3.05s mem 81.1GB +step 3602/5000 loss 0.2658 (w 0.0862 mse 0.0874 t 612 new 0.13) lr 1.00e-05 gnorm 0.185 3.09s mem 81.1GB +step 3603/5000 loss 0.2064 (w 0.2463 mse 0.2386 t 937 new 0.22) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +step 3604/5000 loss 0.3181 (w 0.3912 mse 0.3974 t 310 new 0.14) lr 1.00e-05 gnorm 0.111 3.31s mem 81.1GB +step 3605/5000 loss 0.2419 (w 0.2667 mse 0.2459 t 909 new 0.26) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +step 3606/5000 loss 0.1658 (w 0.1866 mse 0.1744 t 868 new 0.22) lr 1.00e-05 gnorm 0.217 3.22s mem 81.1GB +step 3607/5000 loss 0.3627 (w 0.3440 mse 0.3445 t 973 new 0.17) lr 1.00e-05 gnorm 0.159 3.29s mem 81.1GB +step 3608/5000 loss 0.2930 (w 0.1894 mse 0.1804 t 725 new 0.06) lr 1.00e-05 gnorm 0.118 3.31s mem 81.1GB +step 3609/5000 loss 0.2403 (w 0.5102 mse 0.5172 t 140 new 0.13) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +step 3610/5000 loss 0.1815 (w 0.1440 mse 0.1345 t 822 new 0.21) lr 1.00e-05 gnorm 0.205 3.41s mem 81.1GB +step 3611/5000 loss 0.1770 (w 0.1756 mse 0.1922 t 976 new 0.16) lr 1.00e-05 gnorm 0.137 3.17s mem 81.1GB +step 3612/5000 loss 0.1575 (w 0.1856 mse 0.1991 t 954 new 0.20) lr 1.00e-05 gnorm 0.112 3.18s mem 81.1GB +step 3613/5000 loss 0.1127 (w 0.1776 mse 0.1838 t 729 new 0.21) lr 1.00e-05 gnorm 0.113 3.09s mem 81.1GB +step 3614/5000 loss 0.0618 (w 0.1267 mse 0.1391 t 915 new 0.22) lr 1.00e-05 gnorm 0.145 3.14s mem 81.1GB +step 3615/5000 loss 0.1865 (w 0.2040 mse 0.1904 t 781 new 0.19) lr 1.00e-05 gnorm 0.118 4.11s mem 81.1GB +step 3616/5000 loss 0.1611 (w 0.2610 mse 0.2534 t 676 new 0.24) lr 1.00e-05 gnorm 0.182 3.71s mem 81.1GB +step 3617/5000 loss 0.1190 (w 0.1310 mse 0.1393 t 844 new 0.22) lr 1.00e-05 gnorm 0.158 3.35s mem 81.1GB +step 3618/5000 loss 0.2470 (w 0.1819 mse 0.1865 t 947 new 0.19) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +step 3619/5000 loss 0.2543 (w 0.1173 mse 0.1158 t 772 new 0.07) lr 1.00e-05 gnorm 0.141 3.20s mem 81.1GB +step 3620/5000 loss 0.2300 (w 0.2556 mse 0.2573 t 721 new 0.19) lr 1.00e-05 gnorm 0.257 3.18s mem 81.1GB +step 3621/5000 loss 0.2933 (w 0.2221 mse 0.2080 t 811 new 0.26) lr 1.00e-05 gnorm 0.122 3.64s mem 81.1GB +step 3622/5000 loss 0.2866 (w 0.3169 mse 0.3135 t 479 new 0.19) lr 1.00e-05 gnorm 0.199 4.16s mem 81.1GB +step 3623/5000 loss 0.3005 (w 0.1931 mse 0.1891 t 642 new 0.23) lr 1.00e-05 gnorm 0.204 3.92s mem 81.1GB +step 3624/5000 loss 0.3178 (w 0.2744 mse 0.2654 t 970 new 0.18) lr 1.00e-05 gnorm 0.144 3.00s mem 81.1GB +step 3625/5000 loss 0.2609 (w 0.1842 mse 0.1835 t 760 new 0.20) lr 1.00e-05 gnorm 0.173 3.08s mem 81.1GB +step 3626/5000 loss 0.4169 (w 0.5990 mse 0.5862 t 153 new 0.24) lr 1.00e-05 gnorm 0.121 3.07s mem 81.1GB +step 3627/5000 loss 0.2076 (w 0.2211 mse 0.2127 t 997 new 0.23) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +step 3628/5000 loss 0.2458 (w 0.2782 mse 0.2681 t 945 new 0.23) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +step 3629/5000 loss 0.1771 (w 0.1518 mse 0.1531 t 865 new 0.21) lr 1.00e-05 gnorm 0.136 3.40s mem 81.1GB +step 3630/5000 loss 0.2019 (w 0.3244 mse 0.3196 t 969 new 0.19) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +step 3631/5000 loss 0.3570 (w 0.2890 mse 0.2820 t 787 new 0.18) lr 1.00e-05 gnorm 0.113 3.12s mem 81.1GB +step 3632/5000 loss 0.1505 (w 0.1948 mse 0.1975 t 959 new 0.15) lr 1.00e-05 gnorm 0.661 3.06s mem 81.1GB +step 3633/5000 loss 0.1854 (w 0.2059 mse 0.1933 t 444 new 0.17) lr 1.00e-05 gnorm 0.333 3.09s mem 81.1GB +step 3634/5000 loss 0.2351 (w 0.2270 mse 0.2104 t 890 new 0.22) lr 1.00e-05 gnorm 0.134 3.32s mem 81.1GB +step 3635/5000 loss 0.1493 (w 0.1970 mse 0.1875 t 885 new 0.25) lr 1.00e-05 gnorm 0.236 3.40s mem 81.1GB +step 3636/5000 loss 0.2802 (w 0.1388 mse 0.1465 t 975 new 0.12) lr 1.00e-05 gnorm 0.144 2.82s mem 81.1GB +step 3637/5000 loss 0.0721 (w 0.1906 mse 0.1872 t 972 new 0.24) lr 1.00e-05 gnorm 0.175 3.12s mem 81.1GB +step 3638/5000 loss 0.3276 (w 0.3675 mse 0.3394 t 936 new 0.25) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +step 3639/5000 loss 0.1169 (w 0.1849 mse 0.1810 t 817 new 0.23) lr 1.00e-05 gnorm 0.121 3.16s mem 81.1GB +step 3640/5000 loss 0.1999 (w 0.1654 mse 0.1653 t 947 new 0.21) lr 1.00e-05 gnorm 0.116 3.15s mem 81.1GB +step 3641/5000 loss 0.1922 (w 0.2715 mse 0.2632 t 836 new 0.26) lr 1.00e-05 gnorm 0.118 3.40s mem 81.1GB +step 3642/5000 loss 0.1515 (w 0.1729 mse 0.1666 t 962 new 0.21) lr 1.00e-05 gnorm 0.216 2.83s mem 81.1GB +step 3643/5000 loss 0.3472 (w 0.3076 mse 0.3183 t 955 new 0.25) lr 1.00e-05 gnorm 0.110 3.10s mem 81.1GB +step 3644/5000 loss 0.1261 (w 0.2388 mse 0.2464 t 957 new 0.23) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +step 3645/5000 loss 0.1051 (w 0.1356 mse 0.1296 t 629 new 0.10) lr 1.00e-05 gnorm 0.203 3.36s mem 81.1GB +step 3646/5000 loss 0.2170 (w 0.2164 mse 0.2173 t 704 new 0.19) lr 1.00e-05 gnorm 0.147 3.19s mem 81.1GB +step 3647/5000 loss 0.2160 (w 0.1991 mse 0.1868 t 774 new 0.19) lr 1.00e-05 gnorm 0.264 3.12s mem 81.1GB +step 3648/5000 loss 0.2980 (w 0.2787 mse 0.2588 t 918 new 0.24) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +step 3649/5000 loss 0.1355 (w 0.2090 mse 0.2130 t 926 new 0.26) lr 1.00e-05 gnorm 0.103 3.11s mem 81.1GB +step 3650/5000 loss 0.1702 (w 0.2099 mse 0.2088 t 934 new 0.22) lr 1.00e-05 gnorm 0.121 3.04s mem 81.1GB +step 3651/5000 loss 0.2958 (w 0.1700 mse 0.1692 t 865 new 0.16) lr 1.00e-05 gnorm 0.119 3.35s mem 81.1GB +step 3652/5000 loss 0.2139 (w 0.1047 mse 0.0950 t 817 new 0.17) lr 1.00e-05 gnorm 0.138 3.33s mem 81.1GB +step 3653/5000 loss 0.0997 (w 0.2548 mse 0.2436 t 997 new 0.27) lr 1.00e-05 gnorm 0.128 3.15s mem 81.1GB +step 3654/5000 loss 0.1987 (w 0.2439 mse 0.2533 t 975 new 0.16) lr 1.00e-05 gnorm 0.153 2.82s mem 81.1GB +step 3655/5000 loss 0.1167 (w 0.2635 mse 0.2811 t 962 new 0.21) lr 1.00e-05 gnorm 0.143 3.10s mem 81.1GB +step 3656/5000 loss 0.1540 (w 0.2260 mse 0.2220 t 492 new 0.24) lr 1.00e-05 gnorm 0.120 3.27s mem 81.1GB +step 3657/5000 loss 0.3700 (w 0.2773 mse 0.2748 t 915 new 0.18) lr 1.00e-05 gnorm 0.123 3.11s mem 81.1GB +step 3658/5000 loss 0.1849 (w 0.2513 mse 0.2402 t 966 new 0.16) lr 1.00e-05 gnorm 0.120 3.47s mem 81.1GB +step 3659/5000 loss 0.1571 (w 0.2265 mse 0.2143 t 973 new 0.24) lr 1.00e-05 gnorm 0.108 2.84s mem 81.1GB +step 3660/5000 loss 0.2685 (w 0.2377 mse 0.2225 t 917 new 0.19) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +step 3661/5000 loss 0.2409 (w 0.3967 mse 0.3818 t 941 new 0.18) lr 1.00e-05 gnorm 0.173 3.04s mem 81.1GB +step 3662/5000 loss 0.2320 (w 0.2189 mse 0.2223 t 836 new 0.20) lr 1.00e-05 gnorm 0.112 3.28s mem 81.1GB +step 3663/5000 loss 0.3394 (w 0.2645 mse 0.2564 t 709 new 0.19) lr 1.00e-05 gnorm 0.125 3.32s mem 81.1GB +step 3664/5000 loss 0.2275 (w 0.2841 mse 0.2799 t 348 new 0.23) lr 1.00e-05 gnorm 0.148 3.33s mem 81.1GB +step 3665/5000 loss 0.2465 (w 0.3074 mse 0.3103 t 372 new 0.17) lr 1.00e-05 gnorm 0.117 2.81s mem 81.1GB +step 3666/5000 loss 0.1387 (w 0.1710 mse 0.1784 t 847 new 0.22) lr 1.00e-05 gnorm 0.139 2.82s mem 81.1GB +step 3667/5000 loss 0.2908 (w 0.2394 mse 0.2405 t 848 new 0.15) lr 1.00e-05 gnorm 0.149 3.06s mem 81.1GB +step 3668/5000 loss 0.2230 (w 0.1466 mse 0.1607 t 944 new 0.17) lr 1.00e-05 gnorm 0.140 3.26s mem 81.1GB +step 3669/5000 loss 0.3533 (w 0.1803 mse 0.1778 t 690 new 0.17) lr 1.00e-05 gnorm 0.520 3.37s mem 81.1GB +step 3670/5000 loss 0.2688 (w 0.2301 mse 0.2255 t 574 new 0.21) lr 1.00e-05 gnorm 0.117 3.15s mem 81.1GB +step 3671/5000 loss 0.1552 (w 0.2318 mse 0.2328 t 987 new 0.20) lr 1.00e-05 gnorm 0.208 2.82s mem 81.1GB +step 3672/5000 loss 0.2180 (w 0.1980 mse 0.2072 t 988 new 0.25) lr 1.00e-05 gnorm 0.117 3.04s mem 81.1GB +step 3673/5000 loss 0.1629 (w 0.1493 mse 0.1464 t 887 new 0.09) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +step 3674/5000 loss 0.1529 (w 0.1729 mse 0.1800 t 903 new 0.14) lr 1.00e-05 gnorm 0.121 3.31s mem 81.1GB +step 3675/5000 loss 0.2122 (w 0.2665 mse 0.2486 t 903 new 0.24) lr 1.00e-05 gnorm 0.116 3.35s mem 81.1GB +step 3676/5000 loss 0.1231 (w 0.1262 mse 0.1362 t 936 new 0.25) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +step 3677/5000 loss 0.3313 (w 0.2030 mse 0.1939 t 774 new 0.08) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +step 3678/5000 loss 0.3348 (w 0.2098 mse 0.2145 t 953 new 0.20) lr 1.00e-05 gnorm 0.134 3.03s mem 81.1GB +step 3679/5000 loss 0.3995 (w 0.2794 mse 0.2784 t 672 new 0.22) lr 1.00e-05 gnorm 0.119 3.05s mem 81.1GB +step 3680/5000 loss 0.1502 (w 0.2664 mse 0.2666 t 977 new 0.10) lr 1.00e-05 gnorm 0.126 3.07s mem 81.1GB +step 3681/5000 loss 0.1757 (w 0.1511 mse 0.1648 t 866 new 0.23) lr 1.00e-05 gnorm 0.127 3.31s mem 81.1GB +step 3682/5000 loss 0.2076 (w 0.2151 mse 0.2049 t 947 new 0.18) lr 1.00e-05 gnorm 0.125 3.20s mem 81.1GB +step 3683/5000 loss 0.2095 (w 0.2724 mse 0.2588 t 961 new 0.18) lr 1.00e-05 gnorm 0.156 2.83s mem 81.1GB +step 3684/5000 loss 0.2872 (w 0.3493 mse 0.3420 t 930 new 0.18) lr 1.00e-05 gnorm 0.138 3.04s mem 81.1GB +step 3685/5000 loss 0.1759 (w 0.3013 mse 0.3030 t 999 new 0.19) lr 1.00e-05 gnorm 0.113 3.07s mem 81.1GB +step 3686/5000 loss 0.1909 (w 0.2513 mse 0.2446 t 979 new 0.29) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +step 3687/5000 loss 0.1908 (w 0.1528 mse 0.1661 t 781 new 0.16) lr 1.00e-05 gnorm 0.201 3.12s mem 81.1GB +step 3688/5000 loss 0.2176 (w 0.1996 mse 0.1969 t 840 new 0.12) lr 1.00e-05 gnorm 0.144 3.13s mem 81.1GB +step 3689/5000 loss 0.4442 (w 0.1790 mse 0.1756 t 796 new 0.19) lr 1.00e-05 gnorm 0.145 2.83s mem 81.1GB +step 3690/5000 loss 0.2341 (w 0.1817 mse 0.1831 t 730 new 0.16) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +step 3691/5000 loss 0.1837 (w 0.2879 mse 0.2802 t 607 new 0.15) lr 1.00e-05 gnorm 0.191 3.05s mem 81.1GB +step 3692/5000 loss 0.2161 (w 0.1241 mse 0.1318 t 718 new 0.20) lr 1.00e-05 gnorm 0.121 3.12s mem 81.1GB +step 3693/5000 loss 0.2582 (w 0.2504 mse 0.2474 t 712 new 0.23) lr 1.00e-05 gnorm 0.211 3.38s mem 81.1GB +step 3694/5000 loss 0.1370 (w 0.1561 mse 0.1545 t 921 new 0.25) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +step 3695/5000 loss 0.2404 (w 0.2153 mse 0.1936 t 929 new 0.19) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +step 3696/5000 loss 0.1680 (w 0.3880 mse 0.3806 t 983 new 0.27) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +step 3697/5000 loss 0.3527 (w 0.1206 mse 0.1254 t 820 new 0.15) lr 1.00e-05 gnorm 0.135 3.05s mem 81.1GB +step 3698/5000 loss 0.2536 (w 0.1076 mse 0.1013 t 787 new 0.19) lr 1.00e-05 gnorm 0.108 3.38s mem 81.1GB +step 3699/5000 loss 0.3407 (w 0.3293 mse 0.3260 t 991 new 0.15) lr 1.00e-05 gnorm 0.450 3.32s mem 81.1GB +step 3700/5000 loss 0.1771 (w 0.1443 mse 0.1518 t 672 new 0.07) lr 1.00e-05 gnorm 0.150 3.10s mem 81.1GB +step 3701/5000 loss 0.3977 (w 0.2206 mse 0.2051 t 912 new 0.23) lr 1.00e-05 gnorm 0.116 2.83s mem 81.1GB +step 3702/5000 loss 0.1976 (w 0.2131 mse 0.1981 t 785 new 0.27) lr 1.00e-05 gnorm 0.118 3.27s mem 81.1GB +step 3703/5000 loss 0.2941 (w 0.2545 mse 0.2560 t 866 new 0.16) lr 1.00e-05 gnorm 0.169 2.82s mem 81.1GB +step 3704/5000 loss 0.2354 (w 0.6214 mse 0.6090 t 120 new 0.22) lr 1.00e-05 gnorm 0.119 3.40s mem 81.1GB +step 3705/5000 loss 0.1133 (w 0.3016 mse 0.2841 t 962 new 0.27) lr 1.00e-05 gnorm 0.359 3.41s mem 81.1GB +step 3706/5000 loss 0.2807 (w 0.3461 mse 0.3328 t 977 new 0.18) lr 1.00e-05 gnorm 0.161 3.02s mem 81.1GB +step 3707/5000 loss 0.2527 (w 0.2753 mse 0.2654 t 557 new 0.21) lr 1.00e-05 gnorm 0.112 3.11s mem 81.1GB +step 3708/5000 loss 0.1174 (w 0.1596 mse 0.1451 t 650 new 0.16) lr 1.00e-05 gnorm 0.128 3.01s mem 81.1GB +step 3709/5000 loss 0.2612 (w 0.5896 mse 0.5933 t 159 new 0.21) lr 1.00e-05 gnorm 0.126 3.13s mem 81.1GB +step 3710/5000 loss 0.2726 (w 0.1870 mse 0.1878 t 961 new 0.17) lr 1.00e-05 gnorm 0.157 3.15s mem 81.1GB +step 3711/5000 loss 0.1524 (w 0.1340 mse 0.1261 t 873 new 0.22) lr 1.00e-05 gnorm 0.173 3.15s mem 81.1GB +step 3712/5000 loss 0.2252 (w 0.1135 mse 0.1054 t 909 new 0.17) lr 1.00e-05 gnorm 0.261 3.02s mem 81.1GB +step 3713/5000 loss 0.2138 (w 0.1840 mse 0.1952 t 991 new 0.12) lr 1.00e-05 gnorm 0.214 3.11s mem 81.1GB +step 3714/5000 loss 0.2741 (w 0.1908 mse 0.1801 t 946 new 0.19) lr 1.00e-05 gnorm 0.126 3.01s mem 81.1GB +step 3715/5000 loss 0.1944 (w 0.4935 mse 0.5121 t 140 new 0.08) lr 1.00e-05 gnorm 0.094 3.05s mem 81.1GB +step 3716/5000 loss 0.3070 (w 0.3826 mse 0.3412 t 964 new 0.23) lr 1.00e-05 gnorm 0.127 3.07s mem 81.1GB +step 3717/5000 loss 0.3097 (w 0.1723 mse 0.1765 t 981 new 0.19) lr 1.00e-05 gnorm 0.232 3.09s mem 81.1GB +step 3718/5000 loss 0.2648 (w 0.3758 mse 0.3534 t 977 new 0.18) lr 1.00e-05 gnorm 0.130 3.07s mem 81.1GB +step 3719/5000 loss 0.1942 (w 0.2418 mse 0.2388 t 959 new 0.26) lr 1.00e-05 gnorm 0.150 3.09s mem 81.1GB +step 3720/5000 loss 0.1039 (w 0.1497 mse 0.1591 t 721 new 0.20) lr 1.00e-05 gnorm 0.174 3.03s mem 81.1GB +step 3721/5000 loss 0.2269 (w 0.3147 mse 0.2982 t 960 new 0.26) lr 1.00e-05 gnorm 0.131 3.10s mem 81.1GB +step 3722/5000 loss 0.2693 (w 0.2607 mse 0.2385 t 963 new 0.21) lr 1.00e-05 gnorm 0.451 3.36s mem 81.1GB +step 3723/5000 loss 0.2520 (w 0.3296 mse 0.3370 t 249 new 0.18) lr 1.00e-05 gnorm 0.126 3.10s mem 81.1GB +step 3724/5000 loss 0.3310 (w 0.4351 mse 0.4330 t 992 new 0.21) lr 1.00e-05 gnorm 0.104 3.09s mem 81.1GB +step 3725/5000 loss 0.2090 (w 0.1405 mse 0.1524 t 923 new 0.22) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +step 3726/5000 loss 0.0875 (w 0.2164 mse 0.2124 t 918 new 0.23) lr 1.00e-05 gnorm 0.167 3.06s mem 81.1GB +step 3727/5000 loss 0.1482 (w 0.2561 mse 0.2566 t 980 new 0.20) lr 1.00e-05 gnorm 0.138 3.38s mem 81.1GB +step 3728/5000 loss 0.1760 (w 0.2219 mse 0.1977 t 934 new 0.21) lr 1.00e-05 gnorm 0.139 3.15s mem 81.1GB +step 3729/5000 loss 0.2604 (w 0.4158 mse 0.4111 t 368 new 0.20) lr 1.00e-05 gnorm 0.145 3.05s mem 81.1GB +step 3730/5000 loss 0.2024 (w 0.1586 mse 0.1613 t 878 new 0.19) lr 1.00e-05 gnorm 0.571 2.84s mem 81.1GB +step 3731/5000 loss 0.3460 (w 0.1863 mse 0.1842 t 619 new 0.16) lr 1.00e-05 gnorm 0.123 3.01s mem 81.1GB +step 3732/5000 loss 0.2181 (w 0.2228 mse 0.2171 t 695 new 0.24) lr 1.00e-05 gnorm 0.116 3.10s mem 81.1GB +step 3733/5000 loss 0.1782 (w 0.2752 mse 0.2531 t 872 new 0.23) lr 1.00e-05 gnorm 0.114 3.30s mem 81.1GB +step 3734/5000 loss 0.1689 (w 0.2144 mse 0.1984 t 827 new 0.22) lr 1.00e-05 gnorm 0.176 3.08s mem 81.1GB +step 3735/5000 loss 0.3179 (w 0.2202 mse 0.2172 t 619 new 0.16) lr 1.00e-05 gnorm 0.223 3.12s mem 81.1GB +step 3736/5000 loss 0.0741 (w 0.2849 mse 0.2804 t 954 new 0.24) lr 1.00e-05 gnorm 0.207 2.83s mem 81.1GB +step 3737/5000 loss 0.3300 (w 0.2316 mse 0.2162 t 829 new 0.22) lr 1.00e-05 gnorm 0.156 3.04s mem 81.1GB +step 3738/5000 loss 0.1840 (w 0.2273 mse 0.2190 t 730 new 0.23) lr 1.00e-05 gnorm 0.133 3.06s mem 81.1GB +step 3739/5000 loss 0.2938 (w 0.2236 mse 0.2287 t 948 new 0.17) lr 1.00e-05 gnorm 0.119 3.39s mem 81.1GB +step 3740/5000 loss 0.2241 (w 0.2033 mse 0.1986 t 977 new 0.21) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 3741/5000 loss 0.2297 (w 0.1118 mse 0.1113 t 942 new 0.20) lr 1.00e-05 gnorm 0.154 3.15s mem 81.1GB +step 3742/5000 loss 0.1753 (w 0.2269 mse 0.2198 t 901 new 0.24) lr 1.00e-05 gnorm 0.102 2.84s mem 81.1GB +step 3743/5000 loss 0.2369 (w 0.2906 mse 0.2923 t 348 new 0.19) lr 1.00e-05 gnorm 0.136 3.04s mem 81.1GB +step 3744/5000 loss 0.2810 (w 0.1236 mse 0.1195 t 870 new 0.17) lr 1.00e-05 gnorm 0.309 3.31s mem 81.1GB +step 3745/5000 loss 0.3785 (w 0.2485 mse 0.2389 t 943 new 0.19) lr 1.00e-05 gnorm 0.114 3.13s mem 81.1GB +step 3746/5000 loss 0.2208 (w 0.1286 mse 0.1289 t 659 new 0.21) lr 1.00e-05 gnorm 0.132 3.17s mem 81.1GB +step 3747/5000 loss 0.4673 (w 0.1678 mse 0.1735 t 702 new 0.24) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +step 3748/5000 loss 0.2841 (w 0.2015 mse 0.1979 t 892 new 0.19) lr 1.00e-05 gnorm 0.235 2.82s mem 81.1GB +step 3749/5000 loss 0.2283 (w 0.1372 mse 0.1283 t 802 new 0.20) lr 1.00e-05 gnorm 0.163 3.28s mem 81.1GB +step 3750/5000 loss 0.1807 (w 0.2718 mse 0.2504 t 863 new 0.19) lr 1.00e-05 gnorm 0.172 3.08s mem 81.1GB +step 3751/5000 loss 0.1720 (w 0.3140 mse 0.3027 t 942 new 0.25) lr 1.00e-05 gnorm 0.318 3.08s mem 81.1GB +step 3752/5000 loss 0.2913 (w 0.2612 mse 0.2549 t 692 new 0.09) lr 1.00e-05 gnorm 0.165 3.41s mem 81.1GB +step 3753/5000 loss 0.1219 (w 0.2270 mse 0.2264 t 953 new 0.17) lr 1.00e-05 gnorm 0.253 3.09s mem 81.1GB +step 3754/5000 loss 0.3347 (w 0.1625 mse 0.1601 t 711 new 0.11) lr 1.00e-05 gnorm 0.275 2.83s mem 81.1GB +step 3755/5000 loss 0.2261 (w 0.1954 mse 0.1916 t 264 new 0.10) lr 1.00e-05 gnorm 0.366 3.25s mem 81.1GB +step 3756/5000 loss 0.2977 (w 0.5667 mse 0.5720 t 171 new 0.22) lr 1.00e-05 gnorm 0.159 3.34s mem 81.1GB +step 3757/5000 loss 0.2185 (w 0.1627 mse 0.1697 t 680 new 0.17) lr 1.00e-05 gnorm 0.119 3.09s mem 81.1GB +step 3758/5000 loss 0.2639 (w 0.3632 mse 0.3667 t 288 new 0.19) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +step 3759/5000 loss 0.2707 (w 0.2678 mse 0.2575 t 972 new 0.18) lr 1.00e-05 gnorm 0.131 3.12s mem 81.1GB +step 3760/5000 loss 0.1966 (w 0.3766 mse 0.3658 t 301 new 0.26) lr 1.00e-05 gnorm 0.115 2.83s mem 81.1GB +step 3761/5000 loss 0.2673 (w 0.3677 mse 0.3545 t 969 new 0.24) lr 1.00e-05 gnorm 0.143 3.27s mem 81.1GB +step 3762/5000 loss 0.1771 (w 0.2331 mse 0.2144 t 901 new 0.17) lr 1.00e-05 gnorm 0.110 3.43s mem 81.1GB +step 3763/5000 loss 0.2625 (w 0.1833 mse 0.1722 t 908 new 0.19) lr 1.00e-05 gnorm 0.167 3.07s mem 81.1GB +step 3764/5000 loss 0.1680 (w 0.1790 mse 0.1820 t 943 new 0.24) lr 1.00e-05 gnorm 0.123 3.33s mem 81.1GB +step 3765/5000 loss 0.1716 (w 0.0778 mse 0.0840 t 832 new 0.16) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 3766/5000 loss 0.1338 (w 0.1783 mse 0.1764 t 933 new 0.22) lr 1.00e-05 gnorm 0.146 3.04s mem 81.1GB +step 3767/5000 loss 0.3140 (w 0.1595 mse 0.1471 t 789 new 0.23) lr 1.00e-05 gnorm 0.143 3.01s mem 81.1GB +step 3768/5000 loss 0.1515 (w 0.1790 mse 0.1754 t 882 new 0.22) lr 1.00e-05 gnorm 0.123 3.38s mem 81.1GB +step 3769/5000 loss 0.2253 (w 0.2666 mse 0.2489 t 982 new 0.15) lr 1.00e-05 gnorm 0.138 3.09s mem 81.1GB +step 3770/5000 loss 0.3486 (w 0.1603 mse 0.1799 t 958 new 0.22) lr 1.00e-05 gnorm 0.289 3.10s mem 81.1GB +step 3771/5000 loss 0.1755 (w 0.3099 mse 0.3042 t 988 new 0.17) lr 1.00e-05 gnorm 0.210 2.83s mem 81.1GB +step 3772/5000 loss 0.3376 (w 0.1654 mse 0.1612 t 914 new 0.20) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +step 3773/5000 loss 0.1759 (w 0.1722 mse 0.1652 t 936 new 0.21) lr 1.00e-05 gnorm 0.123 3.07s mem 81.1GB +step 3774/5000 loss 0.3001 (w 0.2466 mse 0.2343 t 969 new 0.23) lr 1.00e-05 gnorm 0.130 3.38s mem 81.1GB +step 3775/5000 loss 0.4076 (w 0.1986 mse 0.2041 t 987 new 0.20) lr 1.00e-05 gnorm 0.230 3.11s mem 81.1GB +step 3776/5000 loss 0.3059 (w 0.1061 mse 0.1009 t 677 new 0.22) lr 1.00e-05 gnorm 0.518 3.06s mem 81.1GB +step 3777/5000 loss 0.4570 (w 0.3261 mse 0.3227 t 379 new 0.28) lr 1.00e-05 gnorm 0.148 2.82s mem 81.1GB +step 3778/5000 loss 0.1380 (w 0.1953 mse 0.1899 t 923 new 0.11) lr 1.00e-05 gnorm 0.203 3.07s mem 81.1GB +step 3779/5000 loss 0.1486 (w 0.1721 mse 0.1595 t 881 new 0.07) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +step 3780/5000 loss 0.1446 (w 0.2092 mse 0.2100 t 875 new 0.16) lr 1.00e-05 gnorm 0.117 3.41s mem 81.1GB +step 3781/5000 loss 0.2757 (w 0.1475 mse 0.1566 t 490 new 0.10) lr 1.00e-05 gnorm 0.213 3.32s mem 81.1GB +step 3782/5000 loss 0.2221 (w 0.1441 mse 0.1423 t 680 new 0.15) lr 1.00e-05 gnorm 1.399 2.83s mem 81.1GB +step 3783/5000 loss 0.2946 (w 0.1876 mse 0.1965 t 915 new 0.20) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 3784/5000 loss 0.2335 (w 0.1695 mse 0.1667 t 328 new 0.13) lr 1.00e-05 gnorm 0.151 3.11s mem 81.1GB +step 3785/5000 loss 0.1243 (w 0.1807 mse 0.1943 t 983 new 0.17) lr 1.00e-05 gnorm 0.173 3.28s mem 81.1GB +step 3786/5000 loss 0.2072 (w 0.1990 mse 0.1929 t 838 new 0.26) lr 1.00e-05 gnorm 0.172 3.12s mem 81.1GB +step 3787/5000 loss 0.0775 (w 0.2313 mse 0.2179 t 941 new 0.09) lr 1.00e-05 gnorm 0.165 3.41s mem 81.1GB +step 3788/5000 loss 0.1379 (w 0.2718 mse 0.2602 t 957 new 0.24) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +step 3789/5000 loss 0.2861 (w 0.2946 mse 0.2990 t 965 new 0.23) lr 1.00e-05 gnorm 0.185 2.82s mem 81.1GB +step 3790/5000 loss 0.2018 (w 0.2954 mse 0.2853 t 495 new 0.24) lr 1.00e-05 gnorm 0.116 3.11s mem 81.1GB +step 3791/5000 loss 0.2444 (w 0.2919 mse 0.2847 t 929 new 0.23) lr 1.00e-05 gnorm 0.132 3.33s mem 81.1GB +step 3792/5000 loss 0.2794 (w 0.2817 mse 0.2725 t 994 new 0.22) lr 1.00e-05 gnorm 0.283 3.47s mem 81.1GB +step 3793/5000 loss 0.2191 (w 0.2464 mse 0.2337 t 970 new 0.18) lr 1.00e-05 gnorm 0.113 3.19s mem 81.1GB +step 3794/5000 loss 0.2505 (w 0.1688 mse 0.1748 t 770 new 0.18) lr 1.00e-05 gnorm 0.180 2.82s mem 81.1GB +step 3795/5000 loss 0.2295 (w 0.2184 mse 0.2172 t 930 new 0.12) lr 1.00e-05 gnorm 0.189 2.84s mem 81.1GB +step 3796/5000 loss 0.1719 (w 0.2049 mse 0.1995 t 961 new 0.16) lr 1.00e-05 gnorm 0.115 3.31s mem 81.1GB +step 3797/5000 loss 0.1041 (w 0.1021 mse 0.0971 t 894 new 0.17) lr 1.00e-05 gnorm 0.128 3.12s mem 81.1GB +step 3798/5000 loss 0.1235 (w 0.1616 mse 0.1710 t 540 new 0.28) lr 1.00e-05 gnorm 0.120 3.38s mem 81.1GB +step 3799/5000 loss 0.1019 (w 0.2004 mse 0.1869 t 855 new 0.20) lr 1.00e-05 gnorm 0.111 3.07s mem 81.1GB +step 3800/5000 loss 0.1081 (w 0.2930 mse 0.2764 t 998 new 0.23) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +step 3801/5000 loss 0.1778 (w 0.1606 mse 0.1514 t 937 new 0.23) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 3802/5000 loss 0.1551 (w 0.2547 mse 0.2384 t 929 new 0.24) lr 1.00e-05 gnorm 0.193 3.30s mem 81.1GB +step 3803/5000 loss 0.2142 (w 0.2202 mse 0.2176 t 735 new 0.23) lr 1.00e-05 gnorm 0.210 3.41s mem 81.1GB +step 3804/5000 loss 0.1379 (w 0.2662 mse 0.2683 t 958 new 0.18) lr 1.00e-05 gnorm 0.144 3.34s mem 81.1GB +step 3805/5000 loss 0.1336 (w 0.1023 mse 0.1127 t 842 new 0.13) lr 1.00e-05 gnorm 0.138 3.09s mem 81.1GB +step 3806/5000 loss 0.1230 (w 0.1980 mse 0.1919 t 887 new 0.17) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +step 3807/5000 loss 0.2364 (w 0.2356 mse 0.2127 t 846 new 0.22) lr 1.00e-05 gnorm 0.156 3.03s mem 81.1GB +step 3808/5000 loss 0.2235 (w 0.2262 mse 0.2221 t 972 new 0.21) lr 1.00e-05 gnorm 0.221 3.04s mem 81.1GB +step 3809/5000 loss 0.2922 (w 0.2847 mse 0.2769 t 964 new 0.24) lr 1.00e-05 gnorm 0.160 3.39s mem 81.1GB +step 3810/5000 loss 0.1942 (w 0.2055 mse 0.2016 t 925 new 0.19) lr 1.00e-05 gnorm 0.224 3.25s mem 81.1GB +step 3811/5000 loss 0.2855 (w 0.1886 mse 0.1905 t 684 new 0.16) lr 1.00e-05 gnorm 0.135 3.07s mem 81.1GB +step 3812/5000 loss 0.3608 (w 0.2234 mse 0.2393 t 379 new 0.23) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +step 3813/5000 loss 0.3824 (w 0.3660 mse 0.3625 t 411 new 0.16) lr 1.00e-05 gnorm 0.162 3.04s mem 81.1GB +step 3814/5000 loss 0.1444 (w 0.2262 mse 0.2129 t 923 new 0.22) lr 1.00e-05 gnorm 0.144 3.10s mem 81.1GB +step 3815/5000 loss 0.3075 (w 0.1518 mse 0.1591 t 867 new 0.22) lr 1.00e-05 gnorm 0.114 3.37s mem 81.1GB +step 3816/5000 loss 0.2034 (w 0.2438 mse 0.2364 t 921 new 0.10) lr 1.00e-05 gnorm 0.121 3.35s mem 81.1GB +step 3817/5000 loss 0.1795 (w 0.2466 mse 0.2294 t 780 new 0.18) lr 1.00e-05 gnorm 0.142 3.08s mem 81.1GB +step 3818/5000 loss 0.4006 (w 0.1751 mse 0.1722 t 834 new 0.07) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +step 3819/5000 loss 0.2090 (w 0.3594 mse 0.3657 t 996 new 0.16) lr 1.00e-05 gnorm 0.128 3.05s mem 81.1GB +step 3820/5000 loss 0.2003 (w 0.1551 mse 0.1558 t 969 new 0.13) lr 1.00e-05 gnorm 0.100 3.23s mem 81.1GB +step 3821/5000 loss 0.1535 (w 0.2354 mse 0.2311 t 621 new 0.21) lr 1.00e-05 gnorm 0.177 3.36s mem 81.1GB +step 3822/5000 loss 0.0902 (w 0.2825 mse 0.2733 t 972 new 0.18) lr 1.00e-05 gnorm 0.179 3.13s mem 81.1GB +step 3823/5000 loss 0.1106 (w 0.1153 mse 0.1334 t 992 new 0.18) lr 1.00e-05 gnorm 0.202 3.08s mem 81.1GB +step 3824/5000 loss 0.1498 (w 0.4913 mse 0.4989 t 120 new 0.21) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +step 3825/5000 loss 0.2493 (w 0.2131 mse 0.2106 t 866 new 0.24) lr 1.00e-05 gnorm 0.125 3.09s mem 81.1GB +step 3826/5000 loss 0.1253 (w 0.0489 mse 0.0522 t 840 new 0.07) lr 1.00e-05 gnorm 0.124 3.54s mem 81.1GB +step 3827/5000 loss 0.2135 (w 0.1879 mse 0.1838 t 992 new 0.12) lr 1.00e-05 gnorm 0.241 3.34s mem 81.1GB +step 3828/5000 loss 0.1435 (w 0.3113 mse 0.3033 t 978 new 0.20) lr 1.00e-05 gnorm 0.115 3.14s mem 81.1GB +step 3829/5000 loss 0.1288 (w 0.1463 mse 0.1357 t 919 new 0.21) lr 1.00e-05 gnorm 0.168 3.12s mem 81.1GB +step 3830/5000 loss 0.3055 (w 0.2059 mse 0.2111 t 910 new 0.23) lr 1.00e-05 gnorm 0.120 2.84s mem 81.1GB +step 3831/5000 loss 0.1955 (w 0.1695 mse 0.1785 t 847 new 0.12) lr 1.00e-05 gnorm 0.118 3.11s mem 81.1GB +step 3832/5000 loss 0.2040 (w 0.3054 mse 0.3006 t 945 new 0.20) lr 1.00e-05 gnorm 0.123 3.55s mem 81.1GB +step 3833/5000 loss 0.2562 (w 0.2407 mse 0.2350 t 530 new 0.25) lr 1.00e-05 gnorm 0.134 3.42s mem 81.1GB +step 3834/5000 loss 0.2652 (w 0.1140 mse 0.1261 t 790 new 0.21) lr 1.00e-05 gnorm 0.138 3.35s mem 81.1GB +step 3835/5000 loss 0.2234 (w 0.2148 mse 0.2079 t 516 new 0.16) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +step 3836/5000 loss 0.2085 (w 0.1733 mse 0.1636 t 759 new 0.20) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +step 3837/5000 loss 0.1020 (w 0.1211 mse 0.1255 t 826 new 0.07) lr 1.00e-05 gnorm 0.107 3.41s mem 81.1GB +step 3838/5000 loss 0.1444 (w 0.2496 mse 0.2410 t 961 new 0.21) lr 1.00e-05 gnorm 0.115 3.57s mem 81.1GB +step 3839/5000 loss 0.1840 (w 0.2131 mse 0.2111 t 930 new 0.13) lr 1.00e-05 gnorm 0.159 3.16s mem 81.1GB +step 3840/5000 loss 0.2838 (w 0.3066 mse 0.2932 t 919 new 0.18) lr 1.00e-05 gnorm 0.133 3.15s mem 81.1GB +step 3841/5000 loss 0.2435 (w 0.2233 mse 0.2259 t 913 new 0.22) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +step 3842/5000 loss 0.1886 (w 0.2820 mse 0.2597 t 977 new 0.16) lr 1.00e-05 gnorm 0.108 2.84s mem 81.1GB +step 3843/5000 loss 0.2431 (w 0.3486 mse 0.3318 t 983 new 0.20) lr 1.00e-05 gnorm 0.138 3.34s mem 81.1GB +step 3844/5000 loss 0.4218 (w 0.2273 mse 0.2251 t 356 new 0.13) lr 1.00e-05 gnorm 0.151 3.42s mem 81.1GB +step 3845/5000 loss 0.2849 (w 0.2310 mse 0.2470 t 992 new 0.15) lr 1.00e-05 gnorm 0.151 3.26s mem 81.1GB +step 3846/5000 loss 0.1338 (w 0.3322 mse 0.3137 t 962 new 0.23) lr 1.00e-05 gnorm 0.122 3.08s mem 81.1GB +step 3847/5000 loss 0.3490 (w 0.2728 mse 0.2601 t 890 new 0.27) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +step 3848/5000 loss 0.3134 (w 0.6534 mse 0.6471 t 107 new 0.22) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 3849/5000 loss 0.1573 (w 0.2422 mse 0.2479 t 942 new 0.19) lr 1.00e-05 gnorm 0.171 3.37s mem 81.1GB +step 3850/5000 loss 0.3342 (w 0.1986 mse 0.1928 t 546 new 0.23) lr 1.00e-05 gnorm 0.126 3.43s mem 81.1GB +step 3851/5000 loss 0.2538 (w 0.2205 mse 0.2234 t 689 new 0.23) lr 1.00e-05 gnorm 0.117 3.39s mem 81.1GB +step 3852/5000 loss 0.1287 (w 0.2273 mse 0.2196 t 871 new 0.18) lr 1.00e-05 gnorm 0.126 3.08s mem 81.1GB +step 3853/5000 loss 0.3697 (w 0.1955 mse 0.1971 t 724 new 0.24) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +step 3854/5000 loss 0.1165 (w 0.0577 mse 0.0574 t 889 new 0.05) lr 1.00e-05 gnorm 0.126 3.11s mem 81.1GB +step 3855/5000 loss 0.2523 (w 0.1605 mse 0.1593 t 928 new 0.18) lr 1.00e-05 gnorm 0.137 3.17s mem 81.1GB +step 3856/5000 loss 0.2515 (w 0.2566 mse 0.2381 t 784 new 0.19) lr 1.00e-05 gnorm 0.136 3.44s mem 81.1GB +step 3857/5000 loss 0.2388 (w 0.2816 mse 0.2737 t 991 new 0.22) lr 1.00e-05 gnorm 0.138 3.40s mem 81.1GB +step 3858/5000 loss 0.3610 (w 0.2460 mse 0.2291 t 930 new 0.20) lr 1.00e-05 gnorm 0.144 2.82s mem 81.1GB +step 3859/5000 loss 0.1919 (w 0.3314 mse 0.3229 t 677 new 0.23) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +step 3860/5000 loss 0.2445 (w 0.2090 mse 0.2093 t 989 new 0.23) lr 1.00e-05 gnorm 0.182 3.03s mem 81.1GB +step 3861/5000 loss 0.2347 (w 0.1746 mse 0.1641 t 866 new 0.18) lr 1.00e-05 gnorm 0.294 3.14s mem 81.1GB +step 3862/5000 loss 0.2190 (w 0.2293 mse 0.2197 t 920 new 0.24) lr 1.00e-05 gnorm 0.134 3.28s mem 81.1GB +step 3863/5000 loss 0.2634 (w 0.2024 mse 0.2007 t 943 new 0.16) lr 1.00e-05 gnorm 0.169 3.34s mem 81.1GB +step 3864/5000 loss 0.2740 (w 0.3604 mse 0.3576 t 987 new 0.11) lr 1.00e-05 gnorm 0.116 2.82s mem 81.1GB +step 3865/5000 loss 0.1478 (w 0.1328 mse 0.1311 t 853 new 0.08) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +step 3866/5000 loss 0.2851 (w 0.1517 mse 0.1699 t 888 new 0.18) lr 1.00e-05 gnorm 0.220 3.08s mem 81.1GB +step 3867/5000 loss 0.3332 (w 0.2211 mse 0.2150 t 853 new 0.22) lr 1.00e-05 gnorm 0.204 3.10s mem 81.1GB +step 3868/5000 loss 0.1816 (w 0.2467 mse 0.2504 t 987 new 0.22) lr 1.00e-05 gnorm 0.116 3.38s mem 81.1GB +step 3869/5000 loss 0.1955 (w 0.1987 mse 0.1808 t 919 new 0.23) lr 1.00e-05 gnorm 0.163 3.38s mem 81.1GB +step 3870/5000 loss 0.2313 (w 0.1560 mse 0.1457 t 826 new 0.16) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +step 3871/5000 loss 0.2648 (w 0.2749 mse 0.2853 t 997 new 0.17) lr 1.00e-05 gnorm 0.172 2.85s mem 81.1GB +step 3872/5000 loss 0.1936 (w 0.2153 mse 0.1956 t 865 new 0.21) lr 1.00e-05 gnorm 0.243 3.05s mem 81.1GB +step 3873/5000 loss 0.1958 (w 0.1674 mse 0.1674 t 892 new 0.23) lr 1.00e-05 gnorm 0.152 3.42s mem 81.1GB +step 3874/5000 loss 0.2632 (w 0.1447 mse 0.1567 t 761 new 0.13) lr 1.00e-05 gnorm 0.147 3.46s mem 81.1GB +step 3875/5000 loss 0.1515 (w 0.2012 mse 0.2063 t 816 new 0.15) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +step 3876/5000 loss 0.2678 (w 0.2354 mse 0.2356 t 580 new 0.23) lr 1.00e-05 gnorm 0.159 2.83s mem 81.1GB +step 3877/5000 loss 0.1857 (w 0.2908 mse 0.2838 t 980 new 0.22) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +step 3878/5000 loss 0.3287 (w 0.1991 mse 0.1991 t 462 new 0.18) lr 1.00e-05 gnorm 0.179 3.09s mem 81.1GB +step 3879/5000 loss 0.2423 (w 0.2968 mse 0.2813 t 964 new 0.27) lr 1.00e-05 gnorm 0.108 3.32s mem 81.1GB +step 3880/5000 loss 0.3219 (w 0.3966 mse 0.3975 t 424 new 0.10) lr 1.00e-05 gnorm 0.138 3.15s mem 81.1GB +step 3881/5000 loss 0.1934 (w 0.2782 mse 0.2696 t 934 new 0.22) lr 1.00e-05 gnorm 0.102 3.08s mem 81.1GB +step 3882/5000 loss 0.1403 (w 0.1332 mse 0.1380 t 926 new 0.21) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +step 3883/5000 loss 0.1525 (w 0.2439 mse 0.2502 t 983 new 0.21) lr 1.00e-05 gnorm 0.107 3.01s mem 81.1GB +step 3884/5000 loss 0.1498 (w 0.2677 mse 0.2782 t 959 new 0.15) lr 1.00e-05 gnorm 0.109 3.03s mem 81.1GB +step 3885/5000 loss 0.1688 (w 0.2539 mse 0.2414 t 811 new 0.26) lr 1.00e-05 gnorm 0.248 3.35s mem 81.1GB +step 3886/5000 loss 0.2232 (w 0.2474 mse 0.2461 t 979 new 0.26) lr 1.00e-05 gnorm 0.136 3.38s mem 81.1GB +step 3887/5000 loss 0.2646 (w 0.2319 mse 0.2284 t 465 new 0.18) lr 1.00e-05 gnorm 0.198 3.08s mem 81.1GB +step 3888/5000 loss 0.2152 (w 0.1384 mse 0.1510 t 544 new 0.23) lr 1.00e-05 gnorm 0.201 2.82s mem 81.1GB +step 3889/5000 loss 0.0935 (w 0.1724 mse 0.1788 t 836 new 0.21) lr 1.00e-05 gnorm 0.217 3.08s mem 81.1GB +step 3890/5000 loss 0.3847 (w 0.2019 mse 0.1873 t 986 new 0.21) lr 1.00e-05 gnorm 0.139 3.04s mem 81.1GB +step 3891/5000 loss 0.1756 (w 0.1868 mse 0.1865 t 949 new 0.15) lr 1.00e-05 gnorm 0.157 3.38s mem 81.1GB +step 3892/5000 loss 0.2290 (w 0.1694 mse 0.1632 t 817 new 0.14) lr 1.00e-05 gnorm 0.190 3.31s mem 81.1GB +step 3893/5000 loss 0.2861 (w 0.1796 mse 0.1731 t 725 new 0.12) lr 1.00e-05 gnorm 0.173 3.05s mem 81.1GB +step 3894/5000 loss 0.2393 (w 0.5147 mse 0.5132 t 223 new 0.03) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +step 3895/5000 loss 0.2741 (w 0.3778 mse 0.3818 t 998 new 0.14) lr 1.00e-05 gnorm 0.143 3.02s mem 81.1GB +step 3896/5000 loss 0.2671 (w 0.2724 mse 0.2702 t 544 new 0.26) lr 1.00e-05 gnorm 0.160 3.06s mem 81.1GB +step 3897/5000 loss 0.2475 (w 0.1972 mse 0.1872 t 940 new 0.22) lr 1.00e-05 gnorm 0.135 3.41s mem 81.1GB +step 3898/5000 loss 0.1979 (w 0.2980 mse 0.2966 t 989 new 0.19) lr 1.00e-05 gnorm 0.115 3.06s mem 81.1GB +step 3899/5000 loss 0.1030 (w 0.1674 mse 0.1554 t 918 new 0.21) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +step 3900/5000 loss 0.1421 (w 0.1399 mse 0.1335 t 772 new 0.27) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +step 3901/5000 loss 0.2552 (w 0.1917 mse 0.1877 t 913 new 0.24) lr 1.00e-05 gnorm 0.154 2.82s mem 81.1GB +step 3902/5000 loss 0.2540 (w 0.3006 mse 0.3210 t 383 new 0.14) lr 1.00e-05 gnorm 0.127 3.03s mem 81.1GB +step 3903/5000 loss 0.2553 (w 0.2032 mse 0.1866 t 811 new 0.19) lr 1.00e-05 gnorm 0.245 3.36s mem 81.1GB +step 3904/5000 loss 0.0966 (w 0.2819 mse 0.2675 t 963 new 0.23) lr 1.00e-05 gnorm 0.094 3.31s mem 81.1GB +step 3905/5000 loss 0.2038 (w 0.2856 mse 0.2683 t 936 new 0.21) lr 1.00e-05 gnorm 0.279 2.82s mem 81.1GB +step 3906/5000 loss 0.2619 (w 0.1395 mse 0.1385 t 824 new 0.24) lr 1.00e-05 gnorm 0.161 3.08s mem 81.1GB +step 3907/5000 loss 0.1723 (w 0.3955 mse 0.3877 t 991 new 0.17) lr 1.00e-05 gnorm 0.119 2.82s mem 81.1GB +step 3908/5000 loss 0.2162 (w 0.1824 mse 0.1691 t 764 new 0.22) lr 1.00e-05 gnorm 0.108 3.07s mem 81.1GB +step 3909/5000 loss 0.2541 (w 0.2091 mse 0.2114 t 956 new 0.22) lr 1.00e-05 gnorm 0.184 3.43s mem 81.1GB +step 3910/5000 loss 0.2037 (w 0.2469 mse 0.2329 t 880 new 0.26) lr 1.00e-05 gnorm 0.143 3.36s mem 81.1GB +step 3911/5000 loss 0.1710 (w 0.1495 mse 0.1363 t 919 new 0.22) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +step 3912/5000 loss 0.2267 (w 0.1082 mse 0.1226 t 823 new 0.20) lr 1.00e-05 gnorm 0.105 3.05s mem 81.1GB +step 3913/5000 loss 0.3532 (w 0.2512 mse 0.2555 t 982 new 0.21) lr 1.00e-05 gnorm 0.308 2.84s mem 81.1GB +step 3914/5000 loss 0.2814 (w 0.2413 mse 0.2379 t 506 new 0.24) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +step 3915/5000 loss 0.2193 (w 0.3466 mse 0.3192 t 892 new 0.13) lr 1.00e-05 gnorm 0.163 3.12s mem 81.1GB +step 3916/5000 loss 0.1842 (w 0.1864 mse 0.1842 t 999 new 0.18) lr 1.00e-05 gnorm 0.104 3.10s mem 81.1GB +step 3917/5000 loss 0.2619 (w 0.2424 mse 0.2422 t 972 new 0.13) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +step 3918/5000 loss 0.1923 (w 0.4734 mse 0.4524 t 1000 new 0.21) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +step 3919/5000 loss 0.2401 (w 0.1278 mse 0.1371 t 677 new 0.20) lr 1.00e-05 gnorm 0.175 2.84s mem 81.1GB +step 3920/5000 loss 0.1736 (w 0.2136 mse 0.2218 t 995 new 0.23) lr 1.00e-05 gnorm 0.114 3.41s mem 81.1GB +step 3921/5000 loss 0.3143 (w 0.1302 mse 0.1402 t 823 new 0.14) lr 1.00e-05 gnorm 0.176 3.12s mem 81.1GB +step 3922/5000 loss 0.2008 (w 0.1652 mse 0.1739 t 942 new 0.09) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +step 3923/5000 loss 0.2334 (w 0.1251 mse 0.1305 t 729 new 0.27) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +step 3924/5000 loss 0.1497 (w 0.3693 mse 0.3529 t 945 new 0.22) lr 1.00e-05 gnorm 0.112 3.04s mem 81.1GB +step 3925/5000 loss 0.2359 (w 0.2077 mse 0.2020 t 889 new 0.17) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +step 3926/5000 loss 0.0904 (w 0.1472 mse 0.1560 t 968 new 0.12) lr 1.00e-05 gnorm 0.163 3.50s mem 81.1GB +step 3927/5000 loss 0.3853 (w 0.1477 mse 0.1504 t 724 new 0.25) lr 1.00e-05 gnorm 0.199 3.40s mem 81.1GB +step 3928/5000 loss 0.2353 (w 0.2996 mse 0.3083 t 993 new 0.24) lr 1.00e-05 gnorm 0.142 3.06s mem 81.1GB +step 3929/5000 loss 0.3293 (w 0.2016 mse 0.2066 t 516 new 0.24) lr 1.00e-05 gnorm 0.201 2.83s mem 81.1GB +step 3930/5000 loss 0.2367 (w 0.1901 mse 0.1925 t 546 new 0.27) lr 1.00e-05 gnorm 0.157 3.06s mem 81.1GB +step 3931/5000 loss 0.1473 (w 0.2121 mse 0.2312 t 961 new 0.20) lr 1.00e-05 gnorm 0.154 2.82s mem 81.1GB +step 3932/5000 loss 0.1387 (w 0.1403 mse 0.1396 t 858 new 0.25) lr 1.00e-05 gnorm 0.108 3.43s mem 81.1GB +step 3933/5000 loss 0.2319 (w 0.2790 mse 0.2640 t 966 new 0.22) lr 1.00e-05 gnorm 0.149 3.14s mem 81.1GB +step 3934/5000 loss 0.1255 (w 0.2384 mse 0.2297 t 944 new 0.25) lr 1.00e-05 gnorm 0.118 3.16s mem 81.1GB +step 3935/5000 loss 0.2383 (w 0.1770 mse 0.1864 t 887 new 0.17) lr 1.00e-05 gnorm 0.182 3.03s mem 81.1GB +step 3936/5000 loss 0.2295 (w 0.2394 mse 0.2330 t 980 new 0.17) lr 1.00e-05 gnorm 0.109 2.81s mem 81.1GB +step 3937/5000 loss 0.1676 (w 0.2521 mse 0.2471 t 878 new 0.21) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +step 3938/5000 loss 0.1768 (w 0.1951 mse 0.2067 t 976 new 0.17) lr 1.00e-05 gnorm 0.192 3.43s mem 81.1GB +step 3939/5000 loss 0.2287 (w 0.1821 mse 0.1772 t 856 new 0.28) lr 1.00e-05 gnorm 0.223 3.12s mem 81.1GB +step 3940/5000 loss 0.4215 (w 0.2680 mse 0.2650 t 767 new 0.23) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +step 3941/5000 loss 0.2497 (w 0.3221 mse 0.3306 t 264 new 0.13) lr 1.00e-05 gnorm 0.111 3.04s mem 81.1GB +step 3942/5000 loss 0.2435 (w 0.5294 mse 0.5262 t 177 new 0.16) lr 1.00e-05 gnorm 0.143 2.82s mem 81.1GB +step 3943/5000 loss 0.2737 (w 0.2558 mse 0.2268 t 958 new 0.25) lr 1.00e-05 gnorm 0.764 3.09s mem 81.1GB +step 3944/5000 loss 0.1630 (w 0.1875 mse 0.1793 t 788 new 0.15) lr 1.00e-05 gnorm 0.136 3.42s mem 81.1GB +step 3945/5000 loss 0.1656 (w 0.0853 mse 0.0872 t 943 new 0.02) lr 1.00e-05 gnorm 0.139 3.05s mem 81.1GB +step 3946/5000 loss 0.1599 (w 0.2331 mse 0.2258 t 990 new 0.21) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +step 3947/5000 loss 0.2149 (w 0.2897 mse 0.2739 t 969 new 0.13) lr 1.00e-05 gnorm 0.160 3.02s mem 81.1GB +step 3948/5000 loss 0.1925 (w 0.2134 mse 0.2078 t 693 new 0.20) lr 1.00e-05 gnorm 0.103 2.84s mem 81.1GB +step 3949/5000 loss 0.1883 (w 0.2956 mse 0.3128 t 997 new 0.21) lr 1.00e-05 gnorm 0.153 3.13s mem 81.1GB +step 3950/5000 loss 0.1082 (w 0.1690 mse 0.1806 t 914 new 0.21) lr 1.00e-05 gnorm 0.267 3.40s mem 81.1GB +step 3951/5000 loss 0.2997 (w 0.3538 mse 0.3558 t 999 new 0.24) lr 1.00e-05 gnorm 0.193 3.07s mem 81.1GB +step 3952/5000 loss 0.2538 (w 0.1328 mse 0.1319 t 828 new 0.10) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +step 3953/5000 loss 0.2013 (w 0.1333 mse 0.1489 t 867 new 0.20) lr 1.00e-05 gnorm 0.159 3.05s mem 81.1GB +step 3954/5000 loss 0.1360 (w 0.2065 mse 0.1943 t 651 new 0.15) lr 1.00e-05 gnorm 0.124 2.85s mem 81.1GB +step 3955/5000 loss 0.2192 (w 0.4047 mse 0.3755 t 978 new 0.19) lr 1.00e-05 gnorm 0.341 3.15s mem 81.1GB +step 3956/5000 loss 0.2107 (w 0.1894 mse 0.1913 t 891 new 0.22) lr 1.00e-05 gnorm 0.122 3.11s mem 81.1GB +step 3957/5000 loss 0.0844 (w 0.1773 mse 0.1629 t 926 new 0.24) lr 1.00e-05 gnorm 0.116 3.40s mem 81.1GB +step 3958/5000 loss 0.3006 (w 0.3100 mse 0.3010 t 980 new 0.19) lr 1.00e-05 gnorm 0.169 2.83s mem 81.1GB +step 3959/5000 loss 0.2572 (w 0.2469 mse 0.2353 t 628 new 0.20) lr 1.00e-05 gnorm 0.113 3.04s mem 81.1GB +step 3960/5000 loss 0.1653 (w 0.2323 mse 0.2444 t 926 new 0.19) lr 1.00e-05 gnorm 0.145 2.82s mem 81.1GB +step 3961/5000 loss 0.3350 (w 0.1840 mse 0.1849 t 780 new 0.18) lr 1.00e-05 gnorm 0.119 3.26s mem 81.1GB +step 3962/5000 loss 0.2096 (w 0.1197 mse 0.1346 t 802 new 0.24) lr 1.00e-05 gnorm 0.131 3.10s mem 81.1GB +step 3963/5000 loss 0.2308 (w 0.4052 mse 0.4157 t 987 new 0.20) lr 1.00e-05 gnorm 0.428 3.12s mem 81.1GB +step 3964/5000 loss 0.1031 (w 0.2844 mse 0.2796 t 980 new 0.18) lr 1.00e-05 gnorm 0.204 2.83s mem 81.1GB +step 3965/5000 loss 0.2927 (w 0.2545 mse 0.2468 t 897 new 0.21) lr 1.00e-05 gnorm 0.205 3.09s mem 81.1GB +step 3966/5000 loss 0.1710 (w 0.1140 mse 0.1193 t 894 new 0.12) lr 1.00e-05 gnorm 0.123 2.82s mem 81.1GB +step 3967/5000 loss 0.2782 (w 0.3276 mse 0.3377 t 992 new 0.20) lr 1.00e-05 gnorm 0.152 3.35s mem 81.1GB +step 3968/5000 loss 0.2056 (w 0.3088 mse 0.3036 t 987 new 0.17) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +step 3969/5000 loss 0.2045 (w 0.2621 mse 0.2600 t 957 new 0.17) lr 1.00e-05 gnorm 0.101 3.12s mem 81.1GB +step 3970/5000 loss 0.2703 (w 0.1305 mse 0.1359 t 679 new 0.27) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +step 3971/5000 loss 0.1627 (w 0.2209 mse 0.2142 t 631 new 0.22) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +step 3972/5000 loss 0.3276 (w 0.3898 mse 0.3736 t 459 new 0.22) lr 1.00e-05 gnorm 0.153 3.14s mem 81.1GB +step 3973/5000 loss 0.1119 (w 0.2772 mse 0.2643 t 971 new 0.20) lr 1.00e-05 gnorm 0.113 3.26s mem 81.1GB +step 3974/5000 loss 0.2465 (w 0.1654 mse 0.1618 t 898 new 0.23) lr 1.00e-05 gnorm 0.185 2.84s mem 81.1GB +step 3975/5000 loss 0.1343 (w 0.1683 mse 0.1630 t 849 new 0.15) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +step 3976/5000 loss 0.2365 (w 0.3012 mse 0.2841 t 981 new 0.27) lr 1.00e-05 gnorm 0.105 2.83s mem 81.1GB +step 3977/5000 loss 0.1501 (w 0.2188 mse 0.2050 t 924 new 0.11) lr 1.00e-05 gnorm 0.112 3.08s mem 81.1GB +step 3978/5000 loss 0.2925 (w 0.5455 mse 0.5448 t 171 new 0.24) lr 1.00e-05 gnorm 0.197 3.13s mem 81.1GB +step 3979/5000 loss 0.3525 (w 0.2834 mse 0.2686 t 815 new 0.20) lr 1.00e-05 gnorm 0.123 3.13s mem 81.1GB +step 3980/5000 loss 0.1864 (w 0.3113 mse 0.3016 t 940 new 0.26) lr 1.00e-05 gnorm 0.300 3.03s mem 81.1GB +step 3981/5000 loss 0.1791 (w 0.3467 mse 0.3436 t 969 new 0.27) lr 1.00e-05 gnorm 0.110 3.10s mem 81.1GB +step 3982/5000 loss 0.2137 (w 0.2000 mse 0.2001 t 887 new 0.21) lr 1.00e-05 gnorm 0.120 3.01s mem 81.1GB +step 3983/5000 loss 0.2155 (w 0.1288 mse 0.1237 t 920 new 0.22) lr 1.00e-05 gnorm 0.145 2.82s mem 81.1GB +step 3984/5000 loss 0.1704 (w 0.2605 mse 0.2576 t 644 new 0.24) lr 1.00e-05 gnorm 0.151 3.05s mem 81.1GB +step 3985/5000 loss 0.2074 (w 0.4211 mse 0.4186 t 288 new 0.24) lr 1.00e-05 gnorm 0.108 3.45s mem 81.1GB +step 3986/5000 loss 0.1748 (w 0.2327 mse 0.2162 t 907 new 0.28) lr 1.00e-05 gnorm 0.160 3.11s mem 81.1GB +step 3987/5000 loss 0.2713 (w 0.9247 mse 0.9202 t 993 new 0.21) lr 1.00e-05 gnorm 0.139 2.82s mem 81.1GB +step 3988/5000 loss 0.2455 (w 0.1378 mse 0.1329 t 826 new 0.23) lr 1.00e-05 gnorm 0.162 3.07s mem 81.1GB +step 3989/5000 loss 0.2422 (w 0.1691 mse 0.1587 t 951 new 0.25) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +step 3990/5000 loss 0.1458 (w 0.2976 mse 0.2804 t 965 new 0.23) lr 1.00e-05 gnorm 0.117 3.15s mem 81.1GB +step 3991/5000 loss 0.3507 (w 0.2478 mse 0.2519 t 957 new 0.16) lr 1.00e-05 gnorm 0.136 3.15s mem 81.1GB +step 3992/5000 loss 0.2017 (w 0.2416 mse 0.2348 t 983 new 0.10) lr 1.00e-05 gnorm 0.120 3.29s mem 81.1GB +step 3993/5000 loss 0.1950 (w 0.2495 mse 0.2529 t 549 new 0.23) lr 1.00e-05 gnorm 0.119 2.82s mem 81.1GB +step 3994/5000 loss 0.3084 (w 0.2808 mse 0.2657 t 909 new 0.21) lr 1.00e-05 gnorm 0.140 3.09s mem 81.1GB +step 3995/5000 loss 0.2651 (w 0.2227 mse 0.2117 t 920 new 0.22) lr 1.00e-05 gnorm 0.139 2.82s mem 81.1GB +step 3996/5000 loss 0.1587 (w 0.2040 mse 0.1915 t 814 new 0.23) lr 1.00e-05 gnorm 0.144 3.12s mem 81.1GB +step 3997/5000 loss 0.2060 (w 0.1712 mse 0.1660 t 984 new 0.16) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +step 3998/5000 loss 0.1135 (w 0.1653 mse 0.1622 t 937 new 0.13) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +step 3999/5000 loss 0.2029 (w 0.3894 mse 0.3965 t 983 new 0.13) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +step 4000/5000 loss 0.0926 (w 0.1699 mse 0.1777 t 1000 new 0.17) lr 1.00e-05 gnorm 0.101 3.03s mem 81.1GB +[val] step 4000 t=200: w=0.4126 mse=0.4231 (n=16) t=500: w=0.2187 mse=0.2221 (n=16) t=800: w=0.1706 mse=0.1698 (n=16) | mean w=0.2673 mse=0.2717 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step4000.safetensors 4093 个张量 37.98 GB +step 4001/5000 loss 0.2695 (w 0.0752 mse 0.0810 t 881 new 0.14) lr 1.00e-05 gnorm 0.200 2.82s mem 81.1GB +step 4002/5000 loss 0.1548 (w 0.2328 mse 0.2210 t 939 new 0.22) lr 1.00e-05 gnorm 0.121 3.37s mem 81.1GB +step 4003/5000 loss 0.2033 (w 0.2643 mse 0.2673 t 940 new 0.11) lr 1.00e-05 gnorm 0.445 3.41s mem 81.1GB +step 4004/5000 loss 0.2300 (w 0.1819 mse 0.1905 t 394 new 0.20) lr 1.00e-05 gnorm 0.154 3.09s mem 81.1GB +step 4005/5000 loss 0.2606 (w 0.2475 mse 0.2329 t 934 new 0.23) lr 1.00e-05 gnorm 0.129 2.82s mem 81.1GB +step 4006/5000 loss 0.1788 (w 0.2874 mse 0.2772 t 698 new 0.13) lr 1.00e-05 gnorm 0.108 3.05s mem 81.1GB +step 4007/5000 loss 0.3954 (w 0.2083 mse 0.1907 t 634 new 0.20) lr 1.00e-05 gnorm 0.201 2.84s mem 81.1GB +step 4008/5000 loss 0.3434 (w 0.2285 mse 0.2324 t 586 new 0.18) lr 1.00e-05 gnorm 0.138 3.41s mem 81.1GB +step 4009/5000 loss 0.1228 (w 0.2627 mse 0.2731 t 978 new 0.17) lr 1.00e-05 gnorm 0.122 3.40s mem 81.1GB +step 4010/5000 loss 0.1200 (w 0.2655 mse 0.2716 t 955 new 0.19) lr 1.00e-05 gnorm 0.176 3.11s mem 81.1GB +step 4011/5000 loss 0.2623 (w 0.0952 mse 0.0977 t 819 new 0.13) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +step 4012/5000 loss 0.1833 (w 0.1134 mse 0.1140 t 689 new 0.18) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +step 4013/5000 loss 0.3004 (w 0.2030 mse 0.1990 t 641 new 0.20) lr 1.00e-05 gnorm 0.145 3.09s mem 81.1GB +step 4014/5000 loss 0.1802 (w 0.2601 mse 0.2546 t 889 new 0.22) lr 1.00e-05 gnorm 0.119 3.41s mem 81.1GB +step 4015/5000 loss 0.3760 (w 0.3206 mse 0.3187 t 375 new 0.12) lr 1.00e-05 gnorm 0.164 3.68s mem 81.1GB +step 4016/5000 loss 0.1493 (w 0.2974 mse 0.2869 t 964 new 0.20) lr 1.00e-05 gnorm 0.125 2.86s mem 81.1GB +step 4017/5000 loss 0.3064 (w 0.2283 mse 0.2168 t 942 new 0.23) lr 1.00e-05 gnorm 0.168 3.02s mem 81.1GB +step 4018/5000 loss 0.2804 (w 1.7631 mse 1.8379 t 996 new 0.27) lr 1.00e-05 gnorm 0.124 3.31s mem 81.1GB +step 4019/5000 loss 0.1284 (w 0.2366 mse 0.2273 t 950 new 0.20) lr 1.00e-05 gnorm 0.152 3.35s mem 81.1GB +step 4020/5000 loss 0.2226 (w 0.2917 mse 0.2835 t 894 new 0.21) lr 1.00e-05 gnorm 0.167 3.19s mem 81.1GB +step 4021/5000 loss 0.1816 (w 0.1392 mse 0.1357 t 873 new 0.24) lr 1.00e-05 gnorm 0.177 3.41s mem 81.1GB +step 4022/5000 loss 0.1194 (w 0.1312 mse 0.1438 t 962 new 0.27) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +step 4023/5000 loss 0.3155 (w 0.1652 mse 0.1614 t 603 new 0.19) lr 1.00e-05 gnorm 0.126 3.02s mem 81.1GB +step 4024/5000 loss 0.2863 (w 0.1815 mse 0.1890 t 500 new 0.08) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +step 4025/5000 loss 0.2332 (w 0.1134 mse 0.1058 t 883 new 0.16) lr 1.00e-05 gnorm 0.134 3.40s mem 81.1GB +step 4026/5000 loss 0.2773 (w 0.3931 mse 0.3892 t 995 new 0.19) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +step 4027/5000 loss 0.1326 (w 0.3376 mse 0.3070 t 961 new 0.24) lr 1.00e-05 gnorm 0.162 3.49s mem 81.1GB +step 4028/5000 loss 0.1620 (w 0.1090 mse 0.1278 t 633 new 0.17) lr 1.00e-05 gnorm 0.497 2.95s mem 81.1GB +step 4029/5000 loss 0.2372 (w 0.2536 mse 0.2435 t 718 new 0.14) lr 1.00e-05 gnorm 0.132 3.19s mem 81.1GB +step 4030/5000 loss 0.1401 (w 0.2645 mse 0.2626 t 980 new 0.19) lr 1.00e-05 gnorm 0.342 2.96s mem 81.1GB +step 4031/5000 loss 0.3733 (w 0.3528 mse 0.3615 t 356 new 0.18) lr 1.00e-05 gnorm 0.148 3.50s mem 81.1GB +step 4032/5000 loss 0.2193 (w 0.2813 mse 0.2639 t 958 new 0.22) lr 1.00e-05 gnorm 0.145 3.50s mem 81.1GB +step 4033/5000 loss 0.1717 (w 0.3029 mse 0.2911 t 941 new 0.17) lr 1.00e-05 gnorm 0.136 4.45s mem 81.1GB +step 4034/5000 loss 0.1552 (w 0.1155 mse 0.1155 t 742 new 0.00) lr 1.00e-05 gnorm 0.100 5.94s mem 81.1GB +step 4035/5000 loss 0.3611 (w 0.2590 mse 0.2507 t 659 new 0.20) lr 1.00e-05 gnorm 0.227 5.97s mem 81.1GB +step 4036/5000 loss 0.1461 (w 0.2761 mse 0.2829 t 974 new 0.17) lr 1.00e-05 gnorm 0.108 5.93s mem 81.1GB +step 4037/5000 loss 0.1844 (w 0.3508 mse 0.3382 t 954 new 0.26) lr 1.00e-05 gnorm 0.246 6.26s mem 81.1GB +step 4038/5000 loss 0.2367 (w 0.1787 mse 0.1717 t 930 new 0.17) lr 1.00e-05 gnorm 0.133 5.97s mem 81.1GB +step 4039/5000 loss 0.3179 (w 0.0951 mse 0.0873 t 424 new 0.16) lr 1.00e-05 gnorm 0.196 5.96s mem 81.1GB +step 4040/5000 loss 0.2579 (w 0.2751 mse 0.2569 t 844 new 0.22) lr 1.00e-05 gnorm 0.368 5.98s mem 81.1GB +step 4041/5000 loss 0.1686 (w 0.1397 mse 0.1401 t 977 new 0.22) lr 1.00e-05 gnorm 0.134 4.10s mem 81.1GB +step 4042/5000 loss 0.1865 (w 0.2670 mse 0.2687 t 979 new 0.21) lr 1.00e-05 gnorm 0.120 3.16s mem 81.1GB +step 4043/5000 loss 0.3796 (w 0.4713 mse 0.4764 t 259 new 0.15) lr 1.00e-05 gnorm 0.120 3.09s mem 81.1GB +step 4044/5000 loss 0.2394 (w 0.1882 mse 0.1948 t 424 new 0.27) lr 1.00e-05 gnorm 0.154 3.29s mem 81.1GB +step 4045/5000 loss 0.3387 (w 0.5203 mse 0.5235 t 212 new 0.22) lr 1.00e-05 gnorm 0.224 3.12s mem 81.1GB +step 4046/5000 loss 0.2651 (w 0.1321 mse 0.1261 t 768 new 0.10) lr 1.00e-05 gnorm 0.120 2.84s mem 81.1GB +step 4047/5000 loss 0.3042 (w 0.2548 mse 0.2521 t 609 new 0.19) lr 1.00e-05 gnorm 0.194 3.08s mem 81.1GB +step 4048/5000 loss 0.1511 (w 0.1688 mse 0.1632 t 979 new 0.15) lr 1.00e-05 gnorm 0.128 3.29s mem 81.1GB +step 4049/5000 loss 0.3066 (w 0.1179 mse 0.1177 t 821 new 0.22) lr 1.00e-05 gnorm 0.148 3.24s mem 81.1GB +step 4050/5000 loss 0.1029 (w 0.1665 mse 0.1748 t 867 new 0.20) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +step 4051/5000 loss 0.1179 (w 0.2417 mse 0.2188 t 965 new 0.21) lr 1.00e-05 gnorm 0.121 3.12s mem 81.1GB +step 4052/5000 loss 0.2105 (w 0.1405 mse 0.1457 t 962 new 0.15) lr 1.00e-05 gnorm 0.136 3.15s mem 81.1GB +step 4053/5000 loss 0.2055 (w 0.3706 mse 0.3542 t 977 new 0.16) lr 1.00e-05 gnorm 0.097 2.85s mem 81.1GB +step 4054/5000 loss 0.2142 (w 0.1128 mse 0.1209 t 969 new 0.09) lr 1.00e-05 gnorm 0.152 3.09s mem 81.1GB +step 4055/5000 loss 0.2523 (w 0.4530 mse 0.4851 t 1000 new 0.19) lr 1.00e-05 gnorm 0.117 3.13s mem 81.1GB +step 4056/5000 loss 0.1819 (w 0.1030 mse 0.1153 t 970 new 0.13) lr 1.00e-05 gnorm 0.158 3.58s mem 81.1GB +step 4057/5000 loss 0.2507 (w 0.2338 mse 0.2325 t 974 new 0.26) lr 1.00e-05 gnorm 0.135 3.67s mem 81.1GB +step 4058/5000 loss 0.2544 (w 0.1729 mse 0.1828 t 956 new 0.22) lr 1.00e-05 gnorm 0.126 3.10s mem 81.1GB +step 4059/5000 loss 0.1024 (w 0.2538 mse 0.2444 t 835 new 0.23) lr 1.00e-05 gnorm 0.149 2.86s mem 81.1GB +step 4060/5000 loss 0.1294 (w 0.2019 mse 0.1989 t 598 new 0.17) lr 1.00e-05 gnorm 0.122 3.17s mem 81.1GB +step 4061/5000 loss 0.2242 (w 0.1979 mse 0.1802 t 993 new 0.13) lr 1.00e-05 gnorm 0.157 3.42s mem 81.1GB +step 4062/5000 loss 0.2599 (w 0.1811 mse 0.1755 t 578 new 0.18) lr 1.00e-05 gnorm 0.169 3.17s mem 81.1GB +step 4063/5000 loss 0.1497 (w 0.1795 mse 0.1706 t 948 new 0.20) lr 1.00e-05 gnorm 0.150 3.61s mem 81.1GB +step 4064/5000 loss 0.3220 (w 0.2884 mse 0.2904 t 375 new 0.24) lr 1.00e-05 gnorm 0.114 3.80s mem 81.1GB +step 4065/5000 loss 0.3109 (w 0.2275 mse 0.2213 t 847 new 0.23) lr 1.00e-05 gnorm 0.286 3.16s mem 81.1GB +step 4066/5000 loss 0.4137 (w 0.0927 mse 0.0951 t 639 new 0.10) lr 1.00e-05 gnorm 0.117 3.16s mem 81.1GB +step 4067/5000 loss 0.2445 (w 0.1782 mse 0.1803 t 971 new 0.22) lr 1.00e-05 gnorm 0.106 3.30s mem 81.1GB +step 4068/5000 loss 0.2809 (w 0.0674 mse 0.0702 t 709 new 0.22) lr 1.00e-05 gnorm 0.137 3.26s mem 81.1GB +step 4069/5000 loss 0.2048 (w 0.2632 mse 0.2496 t 810 new 0.24) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +step 4070/5000 loss 0.2578 (w 0.1846 mse 0.1751 t 965 new 0.25) lr 1.00e-05 gnorm 0.102 3.09s mem 81.1GB +step 4071/5000 loss 0.1922 (w 0.2085 mse 0.2168 t 958 new 0.20) lr 1.00e-05 gnorm 0.122 2.85s mem 81.1GB +step 4072/5000 loss 0.1606 (w 0.2129 mse 0.2008 t 889 new 0.22) lr 1.00e-05 gnorm 0.173 3.31s mem 81.1GB +step 4073/5000 loss 0.1541 (w 0.1086 mse 0.1078 t 768 new 0.23) lr 1.00e-05 gnorm 0.241 3.13s mem 81.1GB +step 4074/5000 loss 0.1100 (w 0.1333 mse 0.1299 t 871 new 0.18) lr 1.00e-05 gnorm 0.111 3.26s mem 81.1GB +step 4075/5000 loss 0.1376 (w 0.1975 mse 0.2029 t 931 new 0.24) lr 1.00e-05 gnorm 0.145 2.82s mem 81.1GB +step 4076/5000 loss 0.2203 (w 0.2867 mse 0.2611 t 987 new 0.18) lr 1.00e-05 gnorm 0.137 3.64s mem 81.1GB +step 4077/5000 loss 0.2610 (w 0.2516 mse 0.2525 t 688 new 0.24) lr 1.00e-05 gnorm 0.159 2.85s mem 81.1GB +step 4078/5000 loss 0.2905 (w 0.3525 mse 0.3363 t 444 new 0.22) lr 1.00e-05 gnorm 0.253 3.45s mem 81.1GB +step 4079/5000 loss 0.2050 (w 0.1707 mse 0.1667 t 839 new 0.27) lr 1.00e-05 gnorm 0.144 3.34s mem 81.1GB +step 4080/5000 loss 0.3178 (w 0.3143 mse 0.3123 t 981 new 0.19) lr 1.00e-05 gnorm 0.127 3.21s mem 81.1GB +step 4081/5000 loss 0.2167 (w 0.1908 mse 0.1921 t 805 new 0.19) lr 1.00e-05 gnorm 0.111 2.95s mem 81.1GB +step 4082/5000 loss 0.2241 (w 0.1436 mse 0.1441 t 631 new 0.27) lr 1.00e-05 gnorm 0.158 3.12s mem 81.1GB +step 4083/5000 loss 0.2340 (w 0.5458 mse 0.5744 t 127 new 0.18) lr 1.00e-05 gnorm 0.108 3.13s mem 81.1GB +step 4084/5000 loss 0.2109 (w 0.1295 mse 0.1297 t 869 new 0.26) lr 1.00e-05 gnorm 0.132 3.36s mem 81.1GB +step 4085/5000 loss 0.3231 (w 0.3272 mse 0.3127 t 979 new 0.19) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +step 4086/5000 loss 0.2382 (w 0.3916 mse 0.3755 t 990 new 0.13) lr 1.00e-05 gnorm 0.158 3.05s mem 81.1GB +step 4087/5000 loss 0.1509 (w 0.1235 mse 0.1306 t 924 new 0.12) lr 1.00e-05 gnorm 0.105 2.96s mem 81.1GB +step 4088/5000 loss 0.2679 (w 0.2344 mse 0.2423 t 401 new 0.11) lr 1.00e-05 gnorm 0.187 3.30s mem 81.1GB +step 4089/5000 loss 0.2300 (w 0.2539 mse 0.2374 t 623 new 0.23) lr 1.00e-05 gnorm 0.124 3.33s mem 81.1GB +step 4090/5000 loss 0.3400 (w 0.2389 mse 0.2448 t 693 new 0.17) lr 1.00e-05 gnorm 0.147 3.28s mem 81.1GB +step 4091/5000 loss 0.1558 (w 0.3195 mse 0.3249 t 980 new 0.16) lr 1.00e-05 gnorm 0.202 3.24s mem 81.1GB +step 4092/5000 loss 0.2035 (w 0.2332 mse 0.2330 t 924 new 0.22) lr 1.00e-05 gnorm 0.146 4.24s mem 81.1GB +step 4093/5000 loss 0.2402 (w 0.1292 mse 0.1457 t 940 new 0.23) lr 1.00e-05 gnorm 0.156 6.05s mem 81.1GB +step 4094/5000 loss 0.0514 (w 0.2313 mse 0.2326 t 962 new 0.27) lr 1.00e-05 gnorm 0.089 6.67s mem 81.1GB +step 4095/5000 loss 0.2742 (w 0.2870 mse 0.2915 t 978 new 0.19) lr 1.00e-05 gnorm 0.140 6.34s mem 81.1GB +step 4096/5000 loss 0.3026 (w 0.3309 mse 0.3196 t 965 new 0.24) lr 1.00e-05 gnorm 0.140 6.21s mem 81.1GB +step 4097/5000 loss 0.3393 (w 0.4638 mse 0.4346 t 992 new 0.24) lr 1.00e-05 gnorm 0.116 6.36s mem 81.1GB +step 4098/5000 loss 0.3677 (w 0.1471 mse 0.1428 t 861 new 0.14) lr 1.00e-05 gnorm 0.135 6.34s mem 81.1GB +step 4099/5000 loss 0.2781 (w 0.1972 mse 0.1975 t 980 new 0.21) lr 1.00e-05 gnorm 0.111 6.38s mem 81.1GB +step 4100/5000 loss 0.2700 (w 0.1415 mse 0.1398 t 783 new 0.22) lr 1.00e-05 gnorm 0.130 3.25s mem 81.1GB +step 4101/5000 loss 0.1269 (w 0.2455 mse 0.2300 t 905 new 0.21) lr 1.00e-05 gnorm 0.103 3.43s mem 81.1GB +step 4102/5000 loss 0.3559 (w 0.3103 mse 0.2835 t 992 new 0.23) lr 1.00e-05 gnorm 0.118 3.16s mem 81.1GB +step 4103/5000 loss 0.3451 (w 0.2229 mse 0.2189 t 986 new 0.27) lr 1.00e-05 gnorm 0.112 3.63s mem 81.1GB +step 4104/5000 loss 0.3256 (w 0.2461 mse 0.2332 t 894 new 0.23) lr 1.00e-05 gnorm 0.112 3.10s mem 81.1GB +step 4105/5000 loss 0.3607 (w 0.1726 mse 0.1865 t 394 new 0.10) lr 1.00e-05 gnorm 0.166 2.85s mem 81.1GB +step 4106/5000 loss 0.1628 (w 0.3608 mse 0.3507 t 994 new 0.19) lr 1.00e-05 gnorm 0.126 3.26s mem 81.1GB +step 4107/5000 loss 0.2305 (w 0.1078 mse 0.1044 t 742 new 0.22) lr 1.00e-05 gnorm 0.320 3.37s mem 81.1GB +step 4108/5000 loss 0.2195 (w 0.2379 mse 0.2266 t 928 new 0.21) lr 1.00e-05 gnorm 0.131 3.47s mem 81.1GB +step 4109/5000 loss 0.2232 (w 0.1798 mse 0.1761 t 893 new 0.23) lr 1.00e-05 gnorm 0.110 3.15s mem 81.1GB +step 4110/5000 loss 0.2531 (w 0.1923 mse 0.1833 t 797 new 0.19) lr 1.00e-05 gnorm 0.153 2.86s mem 81.1GB +step 4111/5000 loss 0.1469 (w 0.2507 mse 0.2439 t 700 new 0.24) lr 1.00e-05 gnorm 0.118 3.03s mem 81.1GB +step 4112/5000 loss 0.2957 (w 0.2218 mse 0.2143 t 708 new 0.19) lr 1.00e-05 gnorm 0.152 2.87s mem 81.1GB +step 4113/5000 loss 0.1488 (w 0.1652 mse 0.1661 t 824 new 0.20) lr 1.00e-05 gnorm 0.117 3.50s mem 81.1GB +step 4114/5000 loss 0.2604 (w 0.1860 mse 0.1992 t 973 new 0.19) lr 1.00e-05 gnorm 0.179 3.36s mem 81.1GB +step 4115/5000 loss 0.1683 (w 0.1376 mse 0.1299 t 922 new 0.19) lr 1.00e-05 gnorm 0.150 4.14s mem 81.1GB +step 4116/5000 loss 0.2021 (w 0.1964 mse 0.2012 t 790 new 0.22) lr 1.00e-05 gnorm 0.447 3.54s mem 81.1GB +step 4117/5000 loss 0.2991 (w 0.1915 mse 0.1807 t 871 new 0.18) lr 1.00e-05 gnorm 0.141 3.07s mem 81.1GB +step 4118/5000 loss 0.2474 (w 0.1743 mse 0.1695 t 760 new 0.27) lr 1.00e-05 gnorm 0.144 2.86s mem 81.1GB +step 4119/5000 loss 0.1695 (w 0.1559 mse 0.1583 t 762 new 0.26) lr 1.00e-05 gnorm 0.234 3.15s mem 81.1GB +step 4120/5000 loss 0.2574 (w 0.1531 mse 0.1558 t 865 new 0.07) lr 1.00e-05 gnorm 0.121 3.43s mem 81.1GB +step 4121/5000 loss 0.0790 (w 0.2934 mse 0.3170 t 983 new 0.17) lr 1.00e-05 gnorm 0.179 3.61s mem 81.1GB +step 4122/5000 loss 0.1823 (w 0.2266 mse 0.2065 t 720 new 0.22) lr 1.00e-05 gnorm 0.227 4.00s mem 81.1GB +step 4123/5000 loss 0.3496 (w 0.2891 mse 0.2804 t 459 new 0.20) lr 1.00e-05 gnorm 0.261 3.65s mem 81.1GB +step 4124/5000 loss 0.2246 (w 0.0972 mse 0.0913 t 790 new 0.21) lr 1.00e-05 gnorm 0.134 3.28s mem 81.1GB +step 4125/5000 loss 0.1628 (w 0.2927 mse 0.2999 t 998 new 0.20) lr 1.00e-05 gnorm 0.153 3.35s mem 81.1GB +step 4126/5000 loss 0.1719 (w 0.0943 mse 0.0910 t 891 new 0.22) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +step 4127/5000 loss 0.0864 (w 0.1056 mse 0.1163 t 995 new 0.11) lr 1.00e-05 gnorm 0.121 3.37s mem 81.1GB +step 4128/5000 loss 0.3879 (w 0.2687 mse 0.2433 t 963 new 0.24) lr 1.00e-05 gnorm 0.175 2.84s mem 81.1GB +step 4129/5000 loss 0.3309 (w 0.3097 mse 0.2972 t 872 new 0.27) lr 1.00e-05 gnorm 0.140 3.06s mem 81.1GB +step 4130/5000 loss 0.2832 (w 0.3529 mse 0.4055 t 159 new 0.19) lr 1.00e-05 gnorm 0.126 3.16s mem 81.1GB +step 4131/5000 loss 0.1874 (w 0.2907 mse 0.2847 t 991 new 0.17) lr 1.00e-05 gnorm 0.958 3.15s mem 81.1GB +step 4132/5000 loss 0.4206 (w 0.2444 mse 0.2384 t 528 new 0.14) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +step 4133/5000 loss 0.2103 (w 0.3694 mse 0.3545 t 973 new 0.20) lr 1.00e-05 gnorm 0.129 3.35s mem 81.1GB +step 4134/5000 loss 0.2201 (w 0.1814 mse 0.1778 t 951 new 0.18) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +step 4135/5000 loss 0.1324 (w 0.4190 mse 0.4255 t 983 new 0.13) lr 1.00e-05 gnorm 0.457 3.06s mem 81.1GB +step 4136/5000 loss 0.1646 (w 0.1993 mse 0.1917 t 840 new 0.26) lr 1.00e-05 gnorm 0.157 3.14s mem 81.1GB +step 4137/5000 loss 0.2167 (w 0.3095 mse 0.3222 t 966 new 0.21) lr 1.00e-05 gnorm 0.163 3.13s mem 81.1GB +step 4138/5000 loss 0.1526 (w 0.3165 mse 0.2944 t 975 new 0.28) lr 1.00e-05 gnorm 0.148 3.10s mem 81.1GB +step 4139/5000 loss 0.3256 (w 0.2977 mse 0.2815 t 642 new 0.24) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +step 4140/5000 loss 0.2249 (w 0.1744 mse 0.1644 t 672 new 0.21) lr 1.00e-05 gnorm 0.174 3.02s mem 81.1GB +step 4141/5000 loss 0.2750 (w 0.1727 mse 0.1734 t 914 new 0.20) lr 1.00e-05 gnorm 0.227 2.84s mem 81.1GB +step 4142/5000 loss 0.2181 (w 0.2228 mse 0.2250 t 495 new 0.13) lr 1.00e-05 gnorm 0.142 3.46s mem 81.1GB +step 4143/5000 loss 0.1667 (w 0.0887 mse 0.0974 t 935 new 0.13) lr 1.00e-05 gnorm 0.245 3.32s mem 81.1GB +step 4144/5000 loss 0.2164 (w 0.1456 mse 0.1492 t 807 new 0.25) lr 1.00e-05 gnorm 0.161 3.31s mem 81.1GB +step 4145/5000 loss 0.2459 (w 0.2153 mse 0.2087 t 688 new 0.25) lr 1.00e-05 gnorm 0.177 3.10s mem 81.1GB +step 4146/5000 loss 0.2760 (w 0.1910 mse 0.1773 t 871 new 0.19) lr 1.00e-05 gnorm 0.124 3.03s mem 81.1GB +step 4147/5000 loss 0.1611 (w 0.2734 mse 0.2662 t 490 new 0.25) lr 1.00e-05 gnorm 0.125 2.83s mem 81.1GB +step 4148/5000 loss 0.1449 (w 0.1985 mse 0.2151 t 788 new 0.21) lr 1.00e-05 gnorm 0.149 3.31s mem 81.1GB +step 4149/5000 loss 0.2203 (w 0.2592 mse 0.2482 t 800 new 0.22) lr 1.00e-05 gnorm 0.125 3.14s mem 81.1GB +step 4150/5000 loss 0.2367 (w 0.2541 mse 0.2610 t 865 new 0.17) lr 1.00e-05 gnorm 0.156 3.08s mem 81.1GB +step 4151/5000 loss 0.2103 (w 0.2121 mse 0.2024 t 645 new 0.22) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +step 4152/5000 loss 0.2443 (w 0.4692 mse 0.4717 t 999 new 0.17) lr 1.00e-05 gnorm 0.120 3.04s mem 81.1GB +step 4153/5000 loss 0.1948 (w 0.3203 mse 0.3022 t 984 new 0.20) lr 1.00e-05 gnorm 0.115 2.83s mem 81.1GB +step 4154/5000 loss 0.2704 (w 0.2542 mse 0.2495 t 937 new 0.22) lr 1.00e-05 gnorm 0.164 3.45s mem 81.1GB +step 4155/5000 loss 0.3343 (w 0.3182 mse 0.3123 t 306 new 0.17) lr 1.00e-05 gnorm 0.144 3.09s mem 81.1GB +step 4156/5000 loss 0.1910 (w 0.2746 mse 0.2547 t 984 new 0.23) lr 1.00e-05 gnorm 0.111 3.07s mem 81.1GB +step 4157/5000 loss 0.2545 (w 0.2239 mse 0.2267 t 946 new 0.18) lr 1.00e-05 gnorm 0.164 3.13s mem 81.1GB +step 4158/5000 loss 0.1883 (w 0.3154 mse 0.2846 t 948 new 0.18) lr 1.00e-05 gnorm 0.771 3.01s mem 81.1GB +step 4159/5000 loss 0.1974 (w 0.0624 mse 0.0732 t 840 new 0.18) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +step 4160/5000 loss 0.2113 (w 0.2112 mse 0.2008 t 729 new 0.20) lr 1.00e-05 gnorm 0.191 3.12s mem 81.1GB +step 4161/5000 loss 0.1892 (w 0.2404 mse 0.2185 t 972 new 0.20) lr 1.00e-05 gnorm 0.163 3.02s mem 81.1GB +step 4162/5000 loss 0.2820 (w 0.3827 mse 0.3677 t 988 new 0.21) lr 1.00e-05 gnorm 0.166 3.09s mem 81.1GB +step 4163/5000 loss 0.3365 (w 0.2651 mse 0.2653 t 966 new 0.20) lr 1.00e-05 gnorm 0.146 3.13s mem 81.1GB +step 4164/5000 loss 0.1485 (w 0.3075 mse 0.3161 t 977 new 0.05) lr 1.00e-05 gnorm 0.173 3.02s mem 81.1GB +step 4165/5000 loss 0.2020 (w 0.2174 mse 0.2199 t 508 new 0.07) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +step 4166/5000 loss 0.2153 (w 0.1894 mse 0.1762 t 599 new 0.20) lr 1.00e-05 gnorm 0.178 3.37s mem 81.1GB +step 4167/5000 loss 0.1335 (w 0.3029 mse 0.3062 t 935 new 0.18) lr 1.00e-05 gnorm 0.150 3.43s mem 81.1GB +step 4168/5000 loss 0.4044 (w 0.3088 mse 0.2976 t 555 new 0.22) lr 1.00e-05 gnorm 0.155 3.14s mem 81.1GB +step 4169/5000 loss 0.2622 (w 0.0643 mse 0.0705 t 837 new 0.14) lr 1.00e-05 gnorm 0.139 3.07s mem 81.1GB +step 4170/5000 loss 0.2815 (w 0.1681 mse 0.1617 t 947 new 0.17) lr 1.00e-05 gnorm 0.130 3.07s mem 81.1GB +step 4171/5000 loss 0.1850 (w 0.1698 mse 0.1697 t 506 new 0.00) lr 1.00e-05 gnorm 0.208 3.13s mem 81.1GB +step 4172/5000 loss 0.1127 (w 0.1106 mse 0.1209 t 774 new 0.17) lr 1.00e-05 gnorm 0.199 3.07s mem 81.1GB +step 4173/5000 loss 0.2981 (w 0.6638 mse 0.6623 t 159 new 0.21) lr 1.00e-05 gnorm 0.170 3.09s mem 81.1GB +step 4174/5000 loss 0.1685 (w 0.2188 mse 0.2057 t 927 new 0.16) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +step 4175/5000 loss 0.3178 (w 0.1840 mse 0.1741 t 802 new 0.22) lr 1.00e-05 gnorm 0.167 3.12s mem 81.1GB +step 4176/5000 loss 0.2810 (w 0.1696 mse 0.1764 t 737 new 0.21) lr 1.00e-05 gnorm 0.123 3.13s mem 81.1GB +step 4177/5000 loss 0.3114 (w 0.2224 mse 0.2144 t 386 new 0.24) lr 1.00e-05 gnorm 0.146 3.28s mem 81.1GB +step 4178/5000 loss 0.2120 (w 0.3797 mse 0.3478 t 1000 new 0.17) lr 1.00e-05 gnorm 0.165 3.38s mem 81.1GB +step 4179/5000 loss 0.1748 (w 0.1505 mse 0.1647 t 920 new 0.25) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +step 4180/5000 loss 0.2008 (w 0.2386 mse 0.2276 t 909 new 0.21) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +step 4181/5000 loss 0.1732 (w 0.1806 mse 0.1749 t 805 new 0.21) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +step 4182/5000 loss 0.2200 (w 0.2747 mse 0.2650 t 930 new 0.17) lr 1.00e-05 gnorm 0.157 3.36s mem 81.1GB +step 4183/5000 loss 0.1940 (w 0.2259 mse 0.2205 t 935 new 0.23) lr 1.00e-05 gnorm 0.213 3.06s mem 81.1GB +step 4184/5000 loss 0.1460 (w 0.3196 mse 0.3190 t 970 new 0.21) lr 1.00e-05 gnorm 0.126 3.38s mem 81.1GB +step 4185/5000 loss 0.1835 (w 0.3164 mse 0.3176 t 411 new 0.13) lr 1.00e-05 gnorm 0.121 3.07s mem 81.1GB +step 4186/5000 loss 0.2217 (w 0.1954 mse 0.1852 t 790 new 0.20) lr 1.00e-05 gnorm 0.124 3.14s mem 81.1GB +step 4187/5000 loss 0.1657 (w 0.2610 mse 0.2407 t 854 new 0.25) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +step 4188/5000 loss 0.1086 (w 0.1580 mse 0.1550 t 990 new 0.14) lr 1.00e-05 gnorm 0.127 3.33s mem 81.1GB +step 4189/5000 loss 0.1322 (w 0.0469 mse 0.0476 t 834 new 0.11) lr 1.00e-05 gnorm 0.109 3.13s mem 81.1GB +step 4190/5000 loss 0.2759 (w 0.1572 mse 0.1606 t 945 new 0.20) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +step 4191/5000 loss 0.2648 (w 0.2483 mse 0.2358 t 594 new 0.22) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +step 4192/5000 loss 0.1946 (w 0.2078 mse 0.1979 t 816 new 0.23) lr 1.00e-05 gnorm 0.188 3.13s mem 81.1GB +step 4193/5000 loss 0.1502 (w 0.2867 mse 0.2700 t 939 new 0.18) lr 1.00e-05 gnorm 0.120 3.02s mem 81.1GB +step 4194/5000 loss 0.2833 (w 0.1263 mse 0.1280 t 957 new 0.18) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 4195/5000 loss 0.1699 (w 0.1836 mse 0.1736 t 836 new 0.22) lr 1.00e-05 gnorm 0.257 3.13s mem 81.1GB +step 4196/5000 loss 0.1934 (w 0.2016 mse 0.1900 t 930 new 0.22) lr 1.00e-05 gnorm 0.128 3.37s mem 81.1GB +step 4197/5000 loss 0.1364 (w 0.3426 mse 0.3511 t 980 new 0.17) lr 1.00e-05 gnorm 0.205 3.05s mem 81.1GB +step 4198/5000 loss 0.2357 (w 0.1943 mse 0.1977 t 465 new 0.20) lr 1.00e-05 gnorm 0.135 2.85s mem 81.1GB +step 4199/5000 loss 0.2076 (w 0.1198 mse 0.1206 t 708 new 0.14) lr 1.00e-05 gnorm 0.173 3.09s mem 81.1GB +step 4200/5000 loss 0.1290 (w 0.2825 mse 0.2798 t 987 new 0.21) lr 1.00e-05 gnorm 0.100 3.13s mem 81.1GB +step 4201/5000 loss 0.2958 (w 0.7337 mse 0.7539 t 107 new 0.21) lr 1.00e-05 gnorm 0.151 3.35s mem 81.1GB +step 4202/5000 loss 0.1076 (w 0.2256 mse 0.2171 t 884 new 0.12) lr 1.00e-05 gnorm 0.139 3.06s mem 81.1GB +step 4203/5000 loss 0.1294 (w 0.1259 mse 0.1272 t 896 new 0.23) lr 1.00e-05 gnorm 0.204 3.09s mem 81.1GB +step 4204/5000 loss 0.2622 (w 0.4391 mse 0.4269 t 993 new 0.21) lr 1.00e-05 gnorm 0.187 3.04s mem 81.1GB +step 4205/5000 loss 0.1740 (w 0.7176 mse 0.7011 t 997 new 0.23) lr 1.00e-05 gnorm 0.111 3.01s mem 81.1GB +step 4206/5000 loss 0.3232 (w 0.1360 mse 0.1371 t 734 new 0.18) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +step 4207/5000 loss 0.1441 (w 0.4750 mse 0.4850 t 993 new 0.20) lr 1.00e-05 gnorm 0.303 3.33s mem 81.1GB +step 4208/5000 loss 0.2693 (w 0.1421 mse 0.1428 t 1000 new 0.18) lr 1.00e-05 gnorm 0.146 3.09s mem 81.1GB +step 4209/5000 loss 0.0956 (w 0.1918 mse 0.1741 t 840 new 0.21) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +step 4210/5000 loss 0.2926 (w 0.2856 mse 0.2679 t 963 new 0.26) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +step 4211/5000 loss 0.1813 (w 0.2206 mse 0.2082 t 920 new 0.16) lr 1.00e-05 gnorm 0.155 3.03s mem 81.1GB +step 4212/5000 loss 0.2771 (w 0.2139 mse 0.2002 t 860 new 0.21) lr 1.00e-05 gnorm 0.288 3.34s mem 81.1GB +step 4213/5000 loss 0.2193 (w 0.4917 mse 0.4917 t 996 new 0.20) lr 1.00e-05 gnorm 0.174 3.37s mem 81.1GB +step 4214/5000 loss 0.2086 (w 0.2630 mse 0.2646 t 979 new 0.13) lr 1.00e-05 gnorm 0.123 3.40s mem 81.1GB +step 4215/5000 loss 0.1027 (w 0.1714 mse 0.1574 t 902 new 0.21) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +step 4216/5000 loss 0.2278 (w 0.1685 mse 0.1620 t 875 new 0.22) lr 1.00e-05 gnorm 0.158 3.06s mem 81.1GB +step 4217/5000 loss 0.3382 (w 0.3587 mse 0.3613 t 259 new 0.22) lr 1.00e-05 gnorm 0.178 3.35s mem 81.1GB +step 4218/5000 loss 0.3968 (w 0.4495 mse 0.4435 t 297 new 0.23) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +step 4219/5000 loss 0.2094 (w 0.2250 mse 0.2267 t 911 new 0.18) lr 1.00e-05 gnorm 0.131 3.10s mem 81.1GB +step 4220/5000 loss 0.2256 (w 0.2855 mse 0.2829 t 490 new 0.19) lr 1.00e-05 gnorm 0.212 3.30s mem 81.1GB +step 4221/5000 loss 0.3206 (w 0.0747 mse 0.0744 t 868 new 0.17) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +step 4222/5000 loss 0.1809 (w 0.3663 mse 0.3512 t 998 new 0.22) lr 1.00e-05 gnorm 0.150 3.08s mem 81.1GB +step 4223/5000 loss 0.3520 (w 0.3310 mse 0.3362 t 997 new 0.20) lr 1.00e-05 gnorm 0.133 3.25s mem 81.1GB +step 4224/5000 loss 0.1635 (w 0.1764 mse 0.1598 t 865 new 0.23) lr 1.00e-05 gnorm 0.153 3.12s mem 81.1GB +step 4225/5000 loss 0.1823 (w 0.1365 mse 0.1284 t 861 new 0.21) lr 1.00e-05 gnorm 0.140 3.12s mem 81.1GB +step 4226/5000 loss 0.1325 (w 0.2402 mse 0.2230 t 278 new 0.27) lr 1.00e-05 gnorm 0.091 3.13s mem 81.1GB +step 4227/5000 loss 0.1020 (w 0.3436 mse 0.3511 t 997 new 0.10) lr 1.00e-05 gnorm 0.122 3.07s mem 81.1GB +step 4228/5000 loss 0.1715 (w 0.1193 mse 0.1329 t 917 new 0.18) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +step 4229/5000 loss 0.2909 (w 0.2150 mse 0.2079 t 937 new 0.17) lr 1.00e-05 gnorm 0.149 3.25s mem 81.1GB +step 4230/5000 loss 0.3897 (w 0.3288 mse 0.3010 t 911 new 0.25) lr 1.00e-05 gnorm 0.149 3.42s mem 81.1GB +step 4231/5000 loss 0.2264 (w 0.1565 mse 0.1658 t 704 new 0.19) lr 1.00e-05 gnorm 0.173 3.31s mem 81.1GB +step 4232/5000 loss 0.3431 (w 0.2823 mse 0.2832 t 421 new 0.21) lr 1.00e-05 gnorm 0.142 3.07s mem 81.1GB +step 4233/5000 loss 0.2802 (w 0.2823 mse 0.2740 t 715 new 0.19) lr 1.00e-05 gnorm 0.125 3.06s mem 81.1GB +step 4234/5000 loss 0.2374 (w 0.2249 mse 0.2267 t 976 new 0.14) lr 1.00e-05 gnorm 0.135 2.82s mem 81.1GB +step 4235/5000 loss 0.1039 (w 0.3217 mse 0.3042 t 990 new 0.23) lr 1.00e-05 gnorm 0.157 3.29s mem 81.1GB +step 4236/5000 loss 0.1788 (w 0.1382 mse 0.1421 t 839 new 0.17) lr 1.00e-05 gnorm 0.709 3.12s mem 81.1GB +step 4237/5000 loss 0.1756 (w 0.1968 mse 0.1948 t 726 new 0.14) lr 1.00e-05 gnorm 0.144 3.29s mem 81.1GB +step 4238/5000 loss 0.1245 (w 0.1801 mse 0.1698 t 906 new 0.23) lr 1.00e-05 gnorm 0.145 3.07s mem 81.1GB +step 4239/5000 loss 0.2372 (w 0.3191 mse 0.3122 t 980 new 0.25) lr 1.00e-05 gnorm 0.134 3.06s mem 81.1GB +step 4240/5000 loss 0.1551 (w 0.2926 mse 0.3156 t 315 new 0.14) lr 1.00e-05 gnorm 0.195 3.02s mem 81.1GB +step 4241/5000 loss 0.1881 (w 0.2652 mse 0.2686 t 508 new 0.18) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +step 4242/5000 loss 0.3351 (w 0.1540 mse 0.1636 t 969 new 0.11) lr 1.00e-05 gnorm 0.139 3.16s mem 81.1GB +step 4243/5000 loss 0.2025 (w 0.2158 mse 0.2157 t 715 new 0.22) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +step 4244/5000 loss 0.1478 (w 0.3188 mse 0.2916 t 930 new 0.22) lr 1.00e-05 gnorm 0.119 3.15s mem 81.1GB +step 4245/5000 loss 0.2804 (w 0.1911 mse 0.1916 t 947 new 0.20) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +step 4246/5000 loss 0.1983 (w 0.3528 mse 0.3515 t 973 new 0.27) lr 1.00e-05 gnorm 0.139 3.03s mem 81.1GB +step 4247/5000 loss 0.2416 (w 0.2687 mse 0.2547 t 953 new 0.16) lr 1.00e-05 gnorm 0.142 3.14s mem 81.1GB +step 4248/5000 loss 0.1998 (w 0.1282 mse 0.1349 t 765 new 0.23) lr 1.00e-05 gnorm 0.111 3.10s mem 81.1GB +step 4249/5000 loss 0.0915 (w 0.2540 mse 0.2369 t 940 new 0.24) lr 1.00e-05 gnorm 0.100 3.11s mem 81.1GB +step 4250/5000 loss 0.2375 (w 0.2347 mse 0.2289 t 954 new 0.23) lr 1.00e-05 gnorm 0.131 3.06s mem 81.1GB +step 4251/5000 loss 0.2495 (w 0.1774 mse 0.1810 t 939 new 0.11) lr 1.00e-05 gnorm 0.207 3.12s mem 81.1GB +step 4252/5000 loss 0.1657 (w 0.2528 mse 0.2471 t 948 new 0.23) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +step 4253/5000 loss 0.2205 (w 0.2136 mse 0.2222 t 348 new 0.17) lr 1.00e-05 gnorm 0.146 3.09s mem 81.1GB +step 4254/5000 loss 0.2701 (w 0.2564 mse 0.2502 t 854 new 0.16) lr 1.00e-05 gnorm 0.136 3.02s mem 81.1GB +step 4255/5000 loss 0.2277 (w 0.1904 mse 0.1979 t 986 new 0.26) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +step 4256/5000 loss 0.1204 (w 0.2764 mse 0.2708 t 839 new 0.22) lr 1.00e-05 gnorm 0.189 3.09s mem 81.1GB +step 4257/5000 loss 0.1823 (w 0.2305 mse 0.2046 t 799 new 0.21) lr 1.00e-05 gnorm 0.159 3.06s mem 81.1GB +step 4258/5000 loss 0.4014 (w 0.2843 mse 0.2665 t 710 new 0.26) lr 1.00e-05 gnorm 0.201 3.02s mem 81.1GB +step 4259/5000 loss 0.1653 (w 0.2617 mse 0.2496 t 670 new 0.19) lr 1.00e-05 gnorm 0.119 3.40s mem 81.1GB +step 4260/5000 loss 0.2172 (w 0.1955 mse 0.1901 t 898 new 0.23) lr 1.00e-05 gnorm 0.199 3.07s mem 81.1GB +step 4261/5000 loss 0.3835 (w 0.1563 mse 0.1537 t 951 new 0.15) lr 1.00e-05 gnorm 0.189 3.08s mem 81.1GB +step 4262/5000 loss 0.1387 (w 0.3004 mse 0.2744 t 951 new 0.25) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +step 4263/5000 loss 0.2758 (w 0.1356 mse 0.1356 t 916 new 0.00) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +step 4264/5000 loss 0.2541 (w 0.2767 mse 0.2681 t 895 new 0.17) lr 1.00e-05 gnorm 0.210 3.08s mem 81.1GB +step 4265/5000 loss 0.3609 (w 0.2185 mse 0.2128 t 763 new 0.13) lr 1.00e-05 gnorm 0.235 3.14s mem 81.1GB +step 4266/5000 loss 0.2135 (w 0.3057 mse 0.2877 t 988 new 0.22) lr 1.00e-05 gnorm 0.163 3.39s mem 81.1GB +step 4267/5000 loss 0.2386 (w 0.2546 mse 0.2448 t 767 new 0.23) lr 1.00e-05 gnorm 0.151 3.14s mem 81.1GB +step 4268/5000 loss 0.2443 (w 0.1720 mse 0.1693 t 942 new 0.09) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 4269/5000 loss 0.1944 (w 0.2134 mse 0.2307 t 963 new 0.19) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +step 4270/5000 loss 0.2479 (w 0.1930 mse 0.1899 t 778 new 0.23) lr 1.00e-05 gnorm 0.311 2.82s mem 81.1GB +step 4271/5000 loss 0.2415 (w 0.2705 mse 0.2549 t 653 new 0.23) lr 1.00e-05 gnorm 0.131 3.09s mem 81.1GB +step 4272/5000 loss 0.1519 (w 0.2529 mse 0.2425 t 973 new 0.24) lr 1.00e-05 gnorm 0.146 3.27s mem 81.1GB +step 4273/5000 loss 0.1555 (w 0.1393 mse 0.1410 t 894 new 0.24) lr 1.00e-05 gnorm 0.112 3.03s mem 81.1GB +step 4274/5000 loss 0.2069 (w 0.1483 mse 0.1431 t 724 new 0.15) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +step 4275/5000 loss 0.2138 (w 0.3820 mse 0.3628 t 978 new 0.24) lr 1.00e-05 gnorm 0.172 3.10s mem 81.1GB +step 4276/5000 loss 0.2776 (w 0.1769 mse 0.1700 t 779 new 0.25) lr 1.00e-05 gnorm 0.229 3.13s mem 81.1GB +step 4277/5000 loss 0.2050 (w 0.2122 mse 0.1983 t 857 new 0.22) lr 1.00e-05 gnorm 0.455 3.12s mem 81.1GB +step 4278/5000 loss 0.3957 (w 0.1043 mse 0.1143 t 804 new 0.16) lr 1.00e-05 gnorm 0.121 3.33s mem 81.1GB +step 4279/5000 loss 0.2412 (w 0.1522 mse 0.1534 t 933 new 0.19) lr 1.00e-05 gnorm 0.147 3.12s mem 81.1GB +step 4280/5000 loss 0.3640 (w 0.1229 mse 0.1253 t 683 new 0.18) lr 1.00e-05 gnorm 0.114 3.11s mem 81.1GB +step 4281/5000 loss 0.1347 (w 0.1743 mse 0.1630 t 965 new 0.26) lr 1.00e-05 gnorm 0.197 3.12s mem 81.1GB +step 4282/5000 loss 0.1265 (w 0.3394 mse 0.3214 t 985 new 0.21) lr 1.00e-05 gnorm 0.439 3.20s mem 81.1GB +step 4283/5000 loss 0.2553 (w 0.2623 mse 0.2551 t 683 new 0.16) lr 1.00e-05 gnorm 0.186 3.06s mem 81.1GB +step 4284/5000 loss 0.1879 (w 0.6383 mse 0.6374 t 989 new 0.19) lr 1.00e-05 gnorm 0.142 3.07s mem 81.1GB +step 4285/5000 loss 0.2595 (w 0.2062 mse 0.1997 t 598 new 0.09) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +step 4286/5000 loss 0.1012 (w 0.2047 mse 0.1964 t 926 new 0.20) lr 1.00e-05 gnorm 0.335 3.13s mem 81.1GB +step 4287/5000 loss 0.1614 (w 0.4171 mse 0.3972 t 994 new 0.19) lr 1.00e-05 gnorm 0.179 3.03s mem 81.1GB +step 4288/5000 loss 0.3647 (w 0.2043 mse 0.2173 t 942 new 0.16) lr 1.00e-05 gnorm 0.154 3.15s mem 81.1GB +step 4289/5000 loss 0.1270 (w 0.4033 mse 0.3645 t 970 new 0.19) lr 1.00e-05 gnorm 0.176 3.04s mem 81.1GB +step 4290/5000 loss 0.2156 (w 0.1914 mse 0.1888 t 940 new 0.25) lr 1.00e-05 gnorm 0.165 3.05s mem 81.1GB +step 4291/5000 loss 0.1532 (w 0.2320 mse 0.2167 t 817 new 0.20) lr 1.00e-05 gnorm 0.122 3.08s mem 81.1GB +step 4292/5000 loss 0.3313 (w 0.1409 mse 0.1355 t 663 new 0.26) lr 1.00e-05 gnorm 0.158 3.11s mem 81.1GB +step 4293/5000 loss 0.1755 (w 0.3600 mse 0.3952 t 177 new 0.23) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +step 4294/5000 loss 0.3072 (w 0.0908 mse 0.1010 t 741 new 0.18) lr 1.00e-05 gnorm 0.139 3.13s mem 81.1GB +step 4295/5000 loss 0.1323 (w 0.2895 mse 0.3010 t 976 new 0.22) lr 1.00e-05 gnorm 0.101 3.03s mem 81.1GB +step 4296/5000 loss 0.1897 (w 0.1297 mse 0.1342 t 861 new 0.26) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +step 4297/5000 loss 0.3216 (w 0.9631 mse 1.0420 t 998 new 0.18) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +step 4298/5000 loss 0.1365 (w 0.1390 mse 0.1484 t 775 new 0.25) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +step 4299/5000 loss 0.2699 (w 0.2465 mse 0.2333 t 904 new 0.22) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +step 4300/5000 loss 0.1489 (w 0.1810 mse 0.1745 t 882 new 0.19) lr 1.00e-05 gnorm 0.414 3.34s mem 81.1GB +step 4301/5000 loss 0.2146 (w 0.1280 mse 0.1375 t 907 new 0.24) lr 1.00e-05 gnorm 0.255 3.08s mem 81.1GB +step 4302/5000 loss 0.1618 (w 0.2277 mse 0.2138 t 873 new 0.23) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +step 4303/5000 loss 0.2694 (w 0.2655 mse 0.2745 t 931 new 0.20) lr 1.00e-05 gnorm 0.140 3.06s mem 81.1GB +step 4304/5000 loss 0.2682 (w 0.3688 mse 0.3629 t 278 new 0.22) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +step 4305/5000 loss 0.1710 (w 0.3152 mse 0.3031 t 962 new 0.20) lr 1.00e-05 gnorm 0.167 3.33s mem 81.1GB +step 4306/5000 loss 0.2442 (w 0.1694 mse 0.1626 t 879 new 0.07) lr 1.00e-05 gnorm 0.141 3.35s mem 81.1GB +step 4307/5000 loss 0.2217 (w 0.2537 mse 0.2584 t 830 new 0.21) lr 1.00e-05 gnorm 0.126 3.22s mem 81.1GB +step 4308/5000 loss 0.3438 (w 0.3706 mse 0.3814 t 238 new 0.18) lr 1.00e-05 gnorm 0.534 3.10s mem 81.1GB +step 4309/5000 loss 0.3205 (w 0.1937 mse 0.1878 t 829 new 0.29) lr 1.00e-05 gnorm 0.192 3.11s mem 81.1GB +step 4310/5000 loss 0.2285 (w 0.5779 mse 0.5815 t 127 new 0.11) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +step 4311/5000 loss 0.3408 (w 0.2380 mse 0.2232 t 653 new 0.19) lr 1.00e-05 gnorm 0.182 3.06s mem 81.1GB +step 4312/5000 loss 0.1788 (w 0.3757 mse 0.3656 t 990 new 0.19) lr 1.00e-05 gnorm 0.191 3.37s mem 81.1GB +step 4313/5000 loss 0.1548 (w 0.1953 mse 0.1927 t 911 new 0.18) lr 1.00e-05 gnorm 0.137 3.26s mem 81.1GB +step 4314/5000 loss 0.2439 (w 0.1220 mse 0.1342 t 540 new 0.16) lr 1.00e-05 gnorm 0.136 3.04s mem 81.1GB +step 4315/5000 loss 0.2730 (w 0.1871 mse 0.1872 t 977 new 0.21) lr 1.00e-05 gnorm 0.129 3.13s mem 81.1GB +step 4316/5000 loss 0.2124 (w 0.2149 mse 0.2072 t 925 new 0.24) lr 1.00e-05 gnorm 0.139 3.03s mem 81.1GB +step 4317/5000 loss 0.2261 (w 0.1174 mse 0.1369 t 383 new 0.18) lr 1.00e-05 gnorm 0.183 3.14s mem 81.1GB +step 4318/5000 loss 0.3206 (w 0.3435 mse 0.3277 t 989 new 0.18) lr 1.00e-05 gnorm 0.142 3.12s mem 81.1GB +step 4319/5000 loss 0.3533 (w 0.3765 mse 0.3601 t 988 new 0.22) lr 1.00e-05 gnorm 0.125 3.03s mem 81.1GB +step 4320/5000 loss 0.1528 (w 0.1231 mse 0.1184 t 890 new 0.26) lr 1.00e-05 gnorm 0.144 3.14s mem 81.1GB +step 4321/5000 loss 0.2641 (w 0.3110 mse 0.2884 t 938 new 0.19) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +step 4322/5000 loss 0.1689 (w 0.2318 mse 0.2224 t 720 new 0.12) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +step 4323/5000 loss 0.3845 (w 0.2605 mse 0.2521 t 586 new 0.21) lr 1.00e-05 gnorm 0.134 3.28s mem 81.1GB +step 4324/5000 loss 0.0685 (w 0.2620 mse 0.2683 t 983 new 0.19) lr 1.00e-05 gnorm 0.139 3.16s mem 81.1GB +step 4325/5000 loss 0.1590 (w 0.1898 mse 0.1998 t 861 new 0.13) lr 1.00e-05 gnorm 0.139 3.28s mem 81.1GB +step 4326/5000 loss 0.2372 (w 0.1420 mse 0.1471 t 977 new 0.20) lr 1.00e-05 gnorm 0.204 3.09s mem 81.1GB +step 4327/5000 loss 0.2033 (w 0.1773 mse 0.1808 t 735 new 0.24) lr 1.00e-05 gnorm 0.129 3.07s mem 81.1GB +step 4328/5000 loss 0.2610 (w 0.3829 mse 0.3784 t 999 new 0.20) lr 1.00e-05 gnorm 0.102 3.11s mem 81.1GB +step 4329/5000 loss 0.2558 (w 0.3544 mse 0.3363 t 971 new 0.19) lr 1.00e-05 gnorm 0.147 3.35s mem 81.1GB +step 4330/5000 loss 0.1892 (w 0.1517 mse 0.1453 t 921 new 0.14) lr 1.00e-05 gnorm 0.121 3.16s mem 81.1GB +step 4331/5000 loss 0.1936 (w 0.3417 mse 0.3266 t 1000 new 0.27) lr 1.00e-05 gnorm 0.136 3.09s mem 81.1GB +step 4332/5000 loss 0.3520 (w 0.5935 mse 0.5914 t 177 new 0.21) lr 1.00e-05 gnorm 0.136 3.08s mem 81.1GB +step 4333/5000 loss 0.0932 (w 0.3695 mse 0.3489 t 991 new 0.25) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +step 4334/5000 loss 0.2105 (w 0.1792 mse 0.1779 t 917 new 0.12) lr 1.00e-05 gnorm 0.141 3.10s mem 81.1GB +step 4335/5000 loss 0.0659 (w 0.2539 mse 0.2368 t 949 new 0.19) lr 1.00e-05 gnorm 0.104 3.12s mem 81.1GB +step 4336/5000 loss 0.1613 (w 0.4339 mse 0.4299 t 996 new 0.16) lr 1.00e-05 gnorm 0.153 3.30s mem 81.1GB +step 4337/5000 loss 0.2019 (w 0.2242 mse 0.2193 t 641 new 0.28) lr 1.00e-05 gnorm 0.137 2.82s mem 81.1GB +step 4338/5000 loss 0.2306 (w 0.1395 mse 0.1466 t 872 new 0.17) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +step 4339/5000 loss 0.2333 (w 0.2174 mse 0.2120 t 969 new 0.13) lr 1.00e-05 gnorm 0.123 2.82s mem 81.1GB +step 4340/5000 loss 0.3062 (w 0.2535 mse 0.2485 t 980 new 0.18) lr 1.00e-05 gnorm 0.135 3.26s mem 81.1GB +step 4341/5000 loss 0.1046 (w 0.1619 mse 0.1547 t 774 new 0.20) lr 1.00e-05 gnorm 0.113 3.08s mem 81.1GB +step 4342/5000 loss 0.2867 (w 0.3684 mse 0.3855 t 233 new 0.22) lr 1.00e-05 gnorm 0.132 3.36s mem 81.1GB +step 4343/5000 loss 0.1731 (w 0.2149 mse 0.2027 t 948 new 0.24) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 4344/5000 loss 0.2409 (w 0.2005 mse 0.1920 t 883 new 0.25) lr 1.00e-05 gnorm 0.134 3.36s mem 81.1GB +step 4345/5000 loss 0.1762 (w 0.3848 mse 0.3644 t 986 new 0.21) lr 1.00e-05 gnorm 0.191 2.84s mem 81.1GB +step 4346/5000 loss 0.2614 (w 0.1659 mse 0.1587 t 936 new 0.17) lr 1.00e-05 gnorm 0.326 3.08s mem 81.1GB +step 4347/5000 loss 0.2054 (w 0.2175 mse 0.2070 t 978 new 0.24) lr 1.00e-05 gnorm 0.127 3.37s mem 81.1GB +step 4348/5000 loss 0.1506 (w 0.2592 mse 0.2592 t 946 new 0.24) lr 1.00e-05 gnorm 0.200 3.26s mem 81.1GB +step 4349/5000 loss 0.1658 (w 0.1909 mse 0.2115 t 997 new 0.13) lr 1.00e-05 gnorm 0.111 3.02s mem 81.1GB +step 4350/5000 loss 0.4235 (w 0.2627 mse 0.2550 t 506 new 0.28) lr 1.00e-05 gnorm 0.188 3.09s mem 81.1GB +step 4351/5000 loss 0.2687 (w 0.1261 mse 0.1236 t 737 new 0.16) lr 1.00e-05 gnorm 0.449 2.82s mem 81.1GB +step 4352/5000 loss 0.1701 (w 0.1517 mse 0.1615 t 840 new 0.19) lr 1.00e-05 gnorm 0.123 3.30s mem 81.1GB +step 4353/5000 loss 0.1643 (w 0.2839 mse 0.2881 t 961 new 0.15) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +step 4354/5000 loss 0.3117 (w 0.1916 mse 0.1900 t 624 new 0.21) lr 1.00e-05 gnorm 0.172 3.03s mem 81.1GB +step 4355/5000 loss 0.1804 (w 0.3523 mse 0.3529 t 979 new 0.15) lr 1.00e-05 gnorm 0.099 3.08s mem 81.1GB +step 4356/5000 loss 0.1228 (w 0.2503 mse 0.2404 t 938 new 0.16) lr 1.00e-05 gnorm 0.638 3.13s mem 81.1GB +step 4357/5000 loss 0.1238 (w 0.1429 mse 0.1356 t 871 new 0.19) lr 1.00e-05 gnorm 0.367 3.02s mem 81.1GB +step 4358/5000 loss 0.4086 (w 0.1928 mse 0.1886 t 578 new 0.23) lr 1.00e-05 gnorm 0.156 3.38s mem 81.1GB +step 4359/5000 loss 0.1746 (w 0.1961 mse 0.1885 t 756 new 0.18) lr 1.00e-05 gnorm 0.128 3.11s mem 81.1GB +step 4360/5000 loss 0.1837 (w 0.2078 mse 0.2012 t 971 new 0.23) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +step 4361/5000 loss 0.1989 (w 0.3146 mse 0.2955 t 997 new 0.20) lr 1.00e-05 gnorm 0.179 3.05s mem 81.1GB +step 4362/5000 loss 0.1832 (w 0.3282 mse 0.3256 t 976 new 0.22) lr 1.00e-05 gnorm 0.141 3.07s mem 81.1GB +step 4363/5000 loss 0.2827 (w 0.2722 mse 0.2665 t 935 new 0.16) lr 1.00e-05 gnorm 0.143 3.04s mem 81.1GB +step 4364/5000 loss 0.1068 (w 0.1715 mse 0.1705 t 950 new 0.23) lr 1.00e-05 gnorm 0.192 3.08s mem 81.1GB +step 4365/5000 loss 0.2267 (w 0.2790 mse 0.2672 t 465 new 0.21) lr 1.00e-05 gnorm 0.190 3.11s mem 81.1GB +step 4366/5000 loss 0.1776 (w 0.1778 mse 0.1808 t 939 new 0.19) lr 1.00e-05 gnorm 0.107 3.07s mem 81.1GB +step 4367/5000 loss 0.1993 (w 0.2631 mse 0.2649 t 958 new 0.25) lr 1.00e-05 gnorm 0.147 3.33s mem 81.1GB +step 4368/5000 loss 0.2741 (w 0.1238 mse 0.1295 t 728 new 0.20) lr 1.00e-05 gnorm 0.169 2.83s mem 81.1GB +step 4369/5000 loss 0.4160 (w 0.2336 mse 0.2324 t 434 new 0.17) lr 1.00e-05 gnorm 0.326 3.27s mem 81.1GB +step 4370/5000 loss 0.2001 (w 0.1484 mse 0.1345 t 698 new 0.18) lr 1.00e-05 gnorm 0.164 3.09s mem 81.1GB +step 4371/5000 loss 0.2558 (w 0.2552 mse 0.2374 t 894 new 0.20) lr 1.00e-05 gnorm 0.211 3.20s mem 81.1GB +step 4372/5000 loss 0.2522 (w 0.2121 mse 0.1951 t 830 new 0.18) lr 1.00e-05 gnorm 0.114 3.04s mem 81.1GB +step 4373/5000 loss 0.3243 (w 0.2067 mse 0.1989 t 884 new 0.20) lr 1.00e-05 gnorm 0.139 3.30s mem 81.1GB +step 4374/5000 loss 0.3282 (w 0.2521 mse 0.2310 t 584 new 0.22) lr 1.00e-05 gnorm 0.125 2.83s mem 81.1GB +step 4375/5000 loss 0.1416 (w 0.2239 mse 0.2382 t 840 new 0.16) lr 1.00e-05 gnorm 0.238 3.35s mem 81.1GB +step 4376/5000 loss 0.2187 (w 0.2969 mse 0.2840 t 913 new 0.27) lr 1.00e-05 gnorm 0.226 3.09s mem 81.1GB +step 4377/5000 loss 0.2041 (w 0.3669 mse 0.3542 t 994 new 0.18) lr 1.00e-05 gnorm 0.120 3.38s mem 81.1GB +step 4378/5000 loss 0.2378 (w 0.2466 mse 0.2371 t 768 new 0.21) lr 1.00e-05 gnorm 0.358 3.31s mem 81.1GB +step 4379/5000 loss 0.2176 (w 0.3221 mse 0.3124 t 958 new 0.21) lr 1.00e-05 gnorm 0.200 3.06s mem 81.1GB +step 4380/5000 loss 0.1197 (w 0.2869 mse 0.2684 t 961 new 0.24) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +step 4381/5000 loss 0.2100 (w 0.1917 mse 0.1928 t 733 new 0.23) lr 1.00e-05 gnorm 0.174 3.13s mem 81.1GB +step 4382/5000 loss 0.1590 (w 0.1296 mse 0.1488 t 914 new 0.18) lr 1.00e-05 gnorm 0.324 3.09s mem 81.1GB +step 4383/5000 loss 0.1580 (w 0.3648 mse 0.3593 t 991 new 0.23) lr 1.00e-05 gnorm 0.134 3.32s mem 81.1GB +step 4384/5000 loss 0.2313 (w 0.2375 mse 0.2356 t 957 new 0.22) lr 1.00e-05 gnorm 0.225 3.02s mem 81.1GB +step 4385/5000 loss 0.2495 (w 0.2972 mse 0.2827 t 844 new 0.17) lr 1.00e-05 gnorm 0.352 3.08s mem 81.1GB +step 4386/5000 loss 0.1383 (w 0.1262 mse 0.1264 t 882 new 0.11) lr 1.00e-05 gnorm 0.235 2.82s mem 81.1GB +step 4387/5000 loss 0.2165 (w 0.2510 mse 0.2469 t 990 new 0.18) lr 1.00e-05 gnorm 0.122 3.09s mem 81.1GB +step 4388/5000 loss 0.2016 (w 0.5441 mse 0.5228 t 994 new 0.23) lr 1.00e-05 gnorm 0.217 3.43s mem 81.1GB +step 4389/5000 loss 0.2415 (w 0.1425 mse 0.1560 t 972 new 0.19) lr 1.00e-05 gnorm 0.179 3.31s mem 81.1GB +step 4390/5000 loss 0.1853 (w 0.2557 mse 0.2385 t 987 new 0.20) lr 1.00e-05 gnorm 0.252 3.00s mem 81.1GB +step 4391/5000 loss 0.3025 (w 0.1780 mse 0.1940 t 992 new 0.10) lr 1.00e-05 gnorm 0.178 3.11s mem 81.1GB +step 4392/5000 loss 0.0553 (w 0.1503 mse 0.1489 t 908 new 0.22) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +step 4393/5000 loss 0.2015 (w 0.1340 mse 0.1405 t 750 new 0.23) lr 1.00e-05 gnorm 0.146 3.36s mem 81.1GB +step 4394/5000 loss 0.3431 (w 0.1956 mse 0.1775 t 929 new 0.20) lr 1.00e-05 gnorm 0.171 3.26s mem 81.1GB +step 4395/5000 loss 0.1141 (w 0.1349 mse 0.1349 t 942 new 0.00) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +step 4396/5000 loss 0.3019 (w 0.2892 mse 0.2820 t 453 new 0.25) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +step 4397/5000 loss 0.1452 (w 0.2504 mse 0.2429 t 926 new 0.09) lr 1.00e-05 gnorm 0.127 3.14s mem 81.1GB +step 4398/5000 loss 0.1513 (w 0.3174 mse 0.3011 t 959 new 0.21) lr 1.00e-05 gnorm 0.133 2.86s mem 81.1GB +step 4399/5000 loss 0.1902 (w 0.1952 mse 0.1955 t 712 new 0.12) lr 1.00e-05 gnorm 0.292 3.34s mem 81.1GB +step 4400/5000 loss 0.3326 (w 0.5424 mse 0.5292 t 177 new 0.26) lr 1.00e-05 gnorm 0.134 3.17s mem 81.1GB +step 4401/5000 loss 0.3690 (w 0.4250 mse 0.4140 t 470 new 0.20) lr 1.00e-05 gnorm 0.177 3.04s mem 81.1GB +step 4402/5000 loss 0.2402 (w 0.2303 mse 0.2139 t 752 new 0.26) lr 1.00e-05 gnorm 0.178 3.09s mem 81.1GB +step 4403/5000 loss 0.1853 (w 0.1064 mse 0.1148 t 851 new 0.22) lr 1.00e-05 gnorm 0.104 3.05s mem 81.1GB +step 4404/5000 loss 0.1677 (w 0.2245 mse 0.2270 t 944 new 0.25) lr 1.00e-05 gnorm 0.100 3.09s mem 81.1GB +step 4405/5000 loss 0.1545 (w 0.3450 mse 0.3395 t 980 new 0.23) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +step 4406/5000 loss 0.2397 (w 0.1790 mse 0.1725 t 775 new 0.19) lr 1.00e-05 gnorm 0.131 3.37s mem 81.1GB +step 4407/5000 loss 0.2468 (w 0.1624 mse 0.1624 t 935 new 0.15) lr 1.00e-05 gnorm 0.201 3.03s mem 81.1GB +step 4408/5000 loss 0.2753 (w 0.1530 mse 0.1457 t 869 new 0.13) lr 1.00e-05 gnorm 0.132 3.01s mem 81.1GB +step 4409/5000 loss 0.2269 (w 0.2586 mse 0.2665 t 959 new 0.20) lr 1.00e-05 gnorm 0.140 3.11s mem 81.1GB +step 4410/5000 loss 0.1611 (w 0.1978 mse 0.1863 t 866 new 0.15) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +step 4411/5000 loss 0.2667 (w 0.2239 mse 0.2110 t 932 new 0.20) lr 1.00e-05 gnorm 0.255 3.37s mem 81.1GB +step 4412/5000 loss 0.2736 (w 0.1818 mse 0.1792 t 662 new 0.24) lr 1.00e-05 gnorm 0.150 3.19s mem 81.1GB +step 4413/5000 loss 0.2574 (w 0.4243 mse 0.4160 t 274 new 0.19) lr 1.00e-05 gnorm 0.188 3.05s mem 81.1GB +step 4414/5000 loss 0.3079 (w 0.2280 mse 0.2341 t 301 new 0.16) lr 1.00e-05 gnorm 0.223 3.32s mem 81.1GB +step 4415/5000 loss 0.1775 (w 0.3454 mse 0.3608 t 964 new 0.15) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +step 4416/5000 loss 0.2582 (w 0.2198 mse 0.2073 t 731 new 0.22) lr 1.00e-05 gnorm 0.116 3.31s mem 81.1GB +step 4417/5000 loss 0.3915 (w 0.1140 mse 0.1075 t 787 new 0.09) lr 1.00e-05 gnorm 0.139 4.52s mem 81.1GB +step 4418/5000 loss 0.2612 (w 0.2255 mse 0.2202 t 991 new 0.14) lr 1.00e-05 gnorm 0.286 3.14s mem 81.1GB +step 4419/5000 loss 0.2448 (w 0.1378 mse 0.1426 t 574 new 0.13) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 4420/5000 loss 0.2361 (w 0.1622 mse 0.1658 t 918 new 0.23) lr 1.00e-05 gnorm 0.144 3.04s mem 81.1GB +step 4421/5000 loss 0.1712 (w 0.0795 mse 0.0897 t 922 new 0.18) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +step 4422/5000 loss 0.2425 (w 0.2438 mse 0.2404 t 747 new 0.19) lr 1.00e-05 gnorm 0.127 3.37s mem 81.1GB +step 4423/5000 loss 0.2606 (w 0.2285 mse 0.2155 t 733 new 0.21) lr 1.00e-05 gnorm 0.203 3.06s mem 81.1GB +step 4424/5000 loss 0.1831 (w 0.2308 mse 0.2380 t 758 new 0.17) lr 1.00e-05 gnorm 0.171 3.29s mem 81.1GB +step 4425/5000 loss 0.1340 (w 0.3609 mse 0.3473 t 980 new 0.21) lr 1.00e-05 gnorm 0.189 3.08s mem 81.1GB +step 4426/5000 loss 0.3410 (w 0.2905 mse 0.3007 t 437 new 0.21) lr 1.00e-05 gnorm 0.189 3.07s mem 81.1GB +step 4427/5000 loss 0.3132 (w 0.2392 mse 0.2222 t 642 new 0.18) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +step 4428/5000 loss 0.1525 (w 0.3012 mse 0.3038 t 996 new 0.20) lr 1.00e-05 gnorm 0.105 3.42s mem 81.1GB +step 4429/5000 loss 0.2019 (w 0.2016 mse 0.1952 t 975 new 0.23) lr 1.00e-05 gnorm 0.257 3.09s mem 81.1GB +step 4430/5000 loss 0.1996 (w 0.1442 mse 0.1568 t 789 new 0.15) lr 1.00e-05 gnorm 0.160 3.29s mem 81.1GB +step 4431/5000 loss 0.2163 (w 0.3295 mse 0.3278 t 989 new 0.24) lr 1.00e-05 gnorm 0.193 3.09s mem 81.1GB +step 4432/5000 loss 0.1335 (w 0.2086 mse 0.1976 t 915 new 0.17) lr 1.00e-05 gnorm 0.175 3.11s mem 81.1GB +step 4433/5000 loss 0.1962 (w 0.2465 mse 0.2502 t 911 new 0.18) lr 1.00e-05 gnorm 0.462 3.06s mem 81.1GB +step 4434/5000 loss 0.1358 (w 0.1935 mse 0.1935 t 864 new 0.15) lr 1.00e-05 gnorm 0.114 3.06s mem 81.1GB +step 4435/5000 loss 0.2981 (w 0.1212 mse 0.1232 t 742 new 0.23) lr 1.00e-05 gnorm 0.218 3.45s mem 81.1GB +step 4436/5000 loss 0.3669 (w 0.1867 mse 0.1854 t 725 new 0.27) lr 1.00e-05 gnorm 0.150 3.02s mem 81.1GB +step 4437/5000 loss 0.2271 (w 0.3261 mse 0.3229 t 997 new 0.20) lr 1.00e-05 gnorm 0.218 3.18s mem 81.1GB +step 4438/5000 loss 0.2324 (w 0.2309 mse 0.2244 t 941 new 0.16) lr 1.00e-05 gnorm 0.134 3.13s mem 81.1GB +step 4439/5000 loss 0.2468 (w 0.1772 mse 0.1696 t 812 new 0.06) lr 1.00e-05 gnorm 0.495 3.04s mem 81.1GB +step 4440/5000 loss 0.4380 (w 0.3278 mse 0.3233 t 319 new 0.25) lr 1.00e-05 gnorm 0.155 3.13s mem 81.1GB +step 4441/5000 loss 0.1378 (w 0.1859 mse 0.1756 t 761 new 0.22) lr 1.00e-05 gnorm 0.112 3.37s mem 81.1GB +step 4442/5000 loss 0.2003 (w 0.2000 mse 0.2013 t 564 new 0.19) lr 1.00e-05 gnorm 0.136 3.02s mem 81.1GB +step 4443/5000 loss 0.1655 (w 0.1508 mse 0.1473 t 787 new 0.17) lr 1.00e-05 gnorm 0.131 3.15s mem 81.1GB +step 4444/5000 loss 0.1232 (w 0.2532 mse 0.2371 t 922 new 0.24) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +step 4445/5000 loss 0.2079 (w 0.3072 mse 0.2967 t 989 new 0.22) lr 1.00e-05 gnorm 0.159 3.04s mem 81.1GB +step 4446/5000 loss 0.2658 (w 0.2527 mse 0.2352 t 975 new 0.19) lr 1.00e-05 gnorm 0.327 3.38s mem 81.1GB +step 4447/5000 loss 0.2273 (w 0.2777 mse 0.2543 t 789 new 0.22) lr 1.00e-05 gnorm 0.181 3.33s mem 81.1GB +step 4448/5000 loss 0.1119 (w 0.1700 mse 0.1695 t 923 new 0.27) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +step 4449/5000 loss 0.3379 (w 0.2911 mse 0.2924 t 979 new 0.22) lr 1.00e-05 gnorm 0.124 3.06s mem 81.1GB +step 4450/5000 loss 0.1346 (w 0.2697 mse 0.2637 t 954 new 0.23) lr 1.00e-05 gnorm 0.101 3.05s mem 81.1GB +step 4451/5000 loss 0.2336 (w 0.1947 mse 0.1885 t 906 new 0.18) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +step 4452/5000 loss 0.2872 (w 0.1966 mse 0.1943 t 940 new 0.23) lr 1.00e-05 gnorm 0.145 3.35s mem 81.1GB +step 4453/5000 loss 0.1960 (w 0.1245 mse 0.1166 t 877 new 0.20) lr 1.00e-05 gnorm 0.183 3.13s mem 81.1GB +step 4454/5000 loss 0.3023 (w 0.4973 mse 0.4913 t 217 new 0.23) lr 1.00e-05 gnorm 0.154 3.06s mem 81.1GB +step 4455/5000 loss 0.2705 (w 0.1247 mse 0.1330 t 656 new 0.23) lr 1.00e-05 gnorm 0.161 3.08s mem 81.1GB +step 4456/5000 loss 0.1831 (w 0.2297 mse 0.2194 t 829 new 0.23) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +step 4457/5000 loss 0.2820 (w 0.1293 mse 0.1385 t 835 new 0.20) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 4458/5000 loss 0.1501 (w 0.2403 mse 0.2253 t 780 new 0.26) lr 1.00e-05 gnorm 0.156 3.41s mem 81.1GB +step 4459/5000 loss 0.1866 (w 0.3619 mse 0.3511 t 984 new 0.17) lr 1.00e-05 gnorm 0.119 3.17s mem 81.1GB +step 4460/5000 loss 0.2491 (w 0.1537 mse 0.1444 t 870 new 0.18) lr 1.00e-05 gnorm 0.122 3.06s mem 81.1GB +step 4461/5000 loss 0.2542 (w 0.2269 mse 0.2502 t 965 new 0.22) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +step 4462/5000 loss 0.1737 (w 0.1337 mse 0.1290 t 897 new 0.10) lr 1.00e-05 gnorm 0.155 2.83s mem 81.1GB +step 4463/5000 loss 0.1442 (w 0.3441 mse 0.3472 t 966 new 0.20) lr 1.00e-05 gnorm 0.167 3.41s mem 81.1GB +step 4464/5000 loss 0.1719 (w 0.1203 mse 0.1391 t 919 new 0.19) lr 1.00e-05 gnorm 0.161 3.30s mem 81.1GB +step 4465/5000 loss 0.2695 (w 0.2852 mse 0.2867 t 934 new 0.26) lr 1.00e-05 gnorm 0.138 3.06s mem 81.1GB +step 4466/5000 loss 0.3953 (w 0.3838 mse 0.3803 t 301 new 0.24) lr 1.00e-05 gnorm 0.140 3.23s mem 81.1GB +step 4467/5000 loss 0.2368 (w 0.1555 mse 0.1665 t 881 new 0.24) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +step 4468/5000 loss 0.2102 (w 0.1292 mse 0.1366 t 854 new 0.21) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +step 4469/5000 loss 0.1132 (w 0.2316 mse 0.2256 t 972 new 0.18) lr 1.00e-05 gnorm 0.164 3.34s mem 81.1GB +step 4470/5000 loss 0.2581 (w 0.3186 mse 0.2990 t 737 new 0.20) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +step 4471/5000 loss 0.1551 (w 0.2664 mse 0.2428 t 628 new 0.17) lr 1.00e-05 gnorm 0.175 3.12s mem 81.1GB +step 4472/5000 loss 0.2098 (w 0.2448 mse 0.2398 t 758 new 0.21) lr 1.00e-05 gnorm 0.170 3.32s mem 81.1GB +step 4473/5000 loss 0.2656 (w 0.0700 mse 0.0724 t 820 new 0.12) lr 1.00e-05 gnorm 0.124 3.08s mem 81.1GB +step 4474/5000 loss 0.1954 (w 0.2403 mse 0.2253 t 868 new 0.21) lr 1.00e-05 gnorm 0.193 3.07s mem 81.1GB +step 4475/5000 loss 0.4883 (w 0.2762 mse 0.2615 t 456 new 0.25) lr 1.00e-05 gnorm 0.388 3.09s mem 81.1GB +step 4476/5000 loss 0.1906 (w 0.1758 mse 0.1771 t 961 new 0.18) lr 1.00e-05 gnorm 0.113 3.36s mem 81.1GB +step 4477/5000 loss 0.2013 (w 0.2125 mse 0.2116 t 973 new 0.18) lr 1.00e-05 gnorm 0.111 3.09s mem 81.1GB +step 4478/5000 loss 0.3352 (w 0.2507 mse 0.2462 t 599 new 0.21) lr 1.00e-05 gnorm 0.126 3.02s mem 81.1GB +step 4479/5000 loss 0.2170 (w 0.2225 mse 0.2033 t 939 new 0.19) lr 1.00e-05 gnorm 0.163 3.06s mem 81.1GB +step 4480/5000 loss 0.2857 (w 0.1352 mse 0.1293 t 782 new 0.10) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +step 4481/5000 loss 0.1771 (w 0.2142 mse 0.2109 t 951 new 0.20) lr 1.00e-05 gnorm 0.842 3.12s mem 81.1GB +step 4482/5000 loss 0.1500 (w 0.1509 mse 0.1394 t 963 new 0.22) lr 1.00e-05 gnorm 0.199 3.07s mem 81.1GB +step 4483/5000 loss 0.1452 (w 0.1321 mse 0.1351 t 912 new 0.19) lr 1.00e-05 gnorm 0.126 2.83s mem 81.1GB +step 4484/5000 loss 0.2615 (w 0.2234 mse 0.2283 t 943 new 0.22) lr 1.00e-05 gnorm 0.162 3.35s mem 81.1GB +step 4485/5000 loss 0.3552 (w 0.1777 mse 0.1787 t 858 new 0.19) lr 1.00e-05 gnorm 0.179 3.09s mem 81.1GB +step 4486/5000 loss 0.2664 (w 0.2227 mse 0.2192 t 712 new 0.21) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +step 4487/5000 loss 0.2562 (w 0.2573 mse 0.2701 t 356 new 0.20) lr 1.00e-05 gnorm 0.249 3.50s mem 81.1GB +step 4488/5000 loss 0.3046 (w 0.2708 mse 0.2526 t 889 new 0.26) lr 1.00e-05 gnorm 0.155 3.09s mem 81.1GB +step 4489/5000 loss 0.3665 (w 0.6443 mse 0.6367 t 114 new 0.17) lr 1.00e-05 gnorm 0.112 2.82s mem 81.1GB +step 4490/5000 loss 0.3322 (w 0.2303 mse 0.2255 t 993 new 0.11) lr 1.00e-05 gnorm 0.174 3.34s mem 81.1GB +step 4491/5000 loss 0.1146 (w 0.2197 mse 0.2237 t 915 new 0.18) lr 1.00e-05 gnorm 0.170 3.12s mem 81.1GB +step 4492/5000 loss 0.2139 (w 0.1957 mse 0.1873 t 603 new 0.23) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +step 4493/5000 loss 0.1352 (w 0.2209 mse 0.2153 t 939 new 0.13) lr 1.00e-05 gnorm 0.168 3.21s mem 81.1GB +step 4494/5000 loss 0.1860 (w 0.2576 mse 0.2586 t 765 new 0.17) lr 1.00e-05 gnorm 0.197 3.14s mem 81.1GB +step 4495/5000 loss 0.3823 (w 0.1074 mse 0.1228 t 981 new 0.16) lr 1.00e-05 gnorm 0.204 2.83s mem 81.1GB +step 4496/5000 loss 0.2403 (w 0.1185 mse 0.1211 t 724 new 0.25) lr 1.00e-05 gnorm 0.215 3.31s mem 81.1GB +step 4497/5000 loss 0.3225 (w 0.3519 mse 0.3333 t 959 new 0.26) lr 1.00e-05 gnorm 0.181 2.82s mem 81.1GB +step 4498/5000 loss 0.2603 (w 0.2170 mse 0.2144 t 964 new 0.19) lr 1.00e-05 gnorm 0.146 3.11s mem 81.1GB +step 4499/5000 loss 0.1477 (w 0.1218 mse 0.1174 t 659 new 0.18) lr 1.00e-05 gnorm 0.330 3.32s mem 81.1GB +step 4500/5000 loss 0.2322 (w 0.2685 mse 0.2666 t 997 new 0.22) lr 1.00e-05 gnorm 0.139 3.06s mem 81.1GB +[val] step 4500 t=200: w=0.4099 mse=0.4204 (n=16) t=500: w=0.2169 mse=0.2202 (n=16) t=800: w=0.1693 mse=0.1684 (n=16) | mean w=0.2654 mse=0.2697 2s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step4500.safetensors 4093 个张量 37.98 GB +step 4501/5000 loss 0.2062 (w 0.1856 mse 0.1933 t 841 new 0.14) lr 1.00e-05 gnorm 0.127 3.12s mem 81.1GB +step 4502/5000 loss 0.1788 (w 0.2521 mse 0.2443 t 879 new 0.17) lr 1.00e-05 gnorm 0.105 3.12s mem 81.1GB +step 4503/5000 loss 0.2576 (w 0.2383 mse 0.2495 t 824 new 0.17) lr 1.00e-05 gnorm 0.119 3.05s mem 81.1GB +step 4504/5000 loss 0.1759 (w 0.2748 mse 0.3071 t 140 new 0.18) lr 1.00e-05 gnorm 0.125 3.28s mem 81.1GB +step 4505/5000 loss 0.3912 (w 0.1686 mse 0.1701 t 727 new 0.08) lr 1.00e-05 gnorm 0.134 3.48s mem 81.1GB +step 4506/5000 loss 0.1740 (w 0.1611 mse 0.1587 t 741 new 0.17) lr 1.00e-05 gnorm 0.123 2.82s mem 81.1GB +step 4507/5000 loss 0.1068 (w 0.2810 mse 0.2711 t 974 new 0.15) lr 1.00e-05 gnorm 0.132 3.11s mem 81.1GB +step 4508/5000 loss 0.2171 (w 0.2180 mse 0.2287 t 379 new 0.21) lr 1.00e-05 gnorm 0.132 3.11s mem 81.1GB +step 4509/5000 loss 0.1372 (w 0.2090 mse 0.2012 t 940 new 0.25) lr 1.00e-05 gnorm 0.151 3.06s mem 81.1GB +step 4510/5000 loss 0.1493 (w 0.2245 mse 0.2136 t 931 new 0.24) lr 1.00e-05 gnorm 0.148 3.31s mem 81.1GB +step 4511/5000 loss 0.1602 (w 0.1954 mse 0.1976 t 942 new 0.16) lr 1.00e-05 gnorm 0.157 3.31s mem 81.1GB +step 4512/5000 loss 0.0848 (w 0.1517 mse 0.1552 t 808 new 0.22) lr 1.00e-05 gnorm 0.104 2.83s mem 81.1GB +step 4513/5000 loss 0.3287 (w 0.1965 mse 0.1964 t 938 new 0.13) lr 1.00e-05 gnorm 0.127 3.06s mem 81.1GB +step 4514/5000 loss 0.1917 (w 0.2262 mse 0.2119 t 928 new 0.22) lr 1.00e-05 gnorm 0.154 3.15s mem 81.1GB +step 4515/5000 loss 0.3197 (w 0.3162 mse 0.3000 t 963 new 0.20) lr 1.00e-05 gnorm 0.177 3.15s mem 81.1GB +step 4516/5000 loss 0.1837 (w 0.1596 mse 0.1752 t 995 new 0.14) lr 1.00e-05 gnorm 0.126 3.13s mem 81.1GB +step 4517/5000 loss 0.2451 (w 0.2518 mse 0.2697 t 986 new 0.19) lr 1.00e-05 gnorm 0.160 3.48s mem 81.1GB +step 4518/5000 loss 0.2224 (w 0.2468 mse 0.2660 t 984 new 0.22) lr 1.00e-05 gnorm 0.243 2.82s mem 81.1GB +step 4519/5000 loss 0.1894 (w 0.3043 mse 0.2814 t 995 new 0.23) lr 1.00e-05 gnorm 0.128 3.06s mem 81.1GB +step 4520/5000 loss 0.1990 (w 0.1570 mse 0.1714 t 952 new 0.13) lr 1.00e-05 gnorm 0.115 3.42s mem 81.1GB +step 4521/5000 loss 0.1961 (w 0.2441 mse 0.2254 t 970 new 0.22) lr 1.00e-05 gnorm 0.165 2.82s mem 81.1GB +step 4522/5000 loss 0.1231 (w 0.2695 mse 0.2581 t 995 new 0.23) lr 1.00e-05 gnorm 0.339 3.11s mem 81.1GB +step 4523/5000 loss 0.2246 (w 0.6039 mse 0.5960 t 153 new 0.15) lr 1.00e-05 gnorm 0.125 3.14s mem 81.1GB +step 4524/5000 loss 0.1182 (w 0.3401 mse 0.3285 t 994 new 0.16) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +step 4525/5000 loss 0.2031 (w 0.2332 mse 0.2459 t 977 new 0.20) lr 1.00e-05 gnorm 0.227 3.36s mem 81.1GB +step 4526/5000 loss 0.1130 (w 0.2225 mse 0.2215 t 980 new 0.24) lr 1.00e-05 gnorm 0.089 3.10s mem 81.1GB +step 4527/5000 loss 0.2035 (w 0.2312 mse 0.2343 t 980 new 0.19) lr 1.00e-05 gnorm 0.167 3.07s mem 81.1GB +step 4528/5000 loss 0.2489 (w 0.2098 mse 0.2017 t 689 new 0.12) lr 1.00e-05 gnorm 2.110 3.33s mem 81.1GB +step 4529/5000 loss 0.2342 (w 0.3553 mse 0.3304 t 954 new 0.25) lr 1.00e-05 gnorm 0.186 3.09s mem 81.1GB +step 4530/5000 loss 0.1840 (w 0.0796 mse 0.0912 t 914 new 0.14) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +step 4531/5000 loss 0.1802 (w 0.1481 mse 0.1516 t 988 new 0.18) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +step 4532/5000 loss 0.3172 (w 0.2062 mse 0.2026 t 936 new 0.19) lr 1.00e-05 gnorm 0.148 3.10s mem 81.1GB +step 4533/5000 loss 0.2465 (w 0.2310 mse 0.2320 t 774 new 0.19) lr 1.00e-05 gnorm 0.256 3.07s mem 81.1GB +step 4534/5000 loss 0.2709 (w 0.1624 mse 0.1642 t 962 new 0.25) lr 1.00e-05 gnorm 0.125 3.34s mem 81.1GB +step 4535/5000 loss 0.2923 (w 0.3254 mse 0.3202 t 943 new 0.21) lr 1.00e-05 gnorm 0.177 3.12s mem 81.1GB +step 4536/5000 loss 0.2202 (w 0.1953 mse 0.2214 t 356 new 0.25) lr 1.00e-05 gnorm 0.105 2.84s mem 81.1GB +step 4537/5000 loss 0.1267 (w 0.2998 mse 0.3050 t 996 new 0.10) lr 1.00e-05 gnorm 0.133 3.28s mem 81.1GB +step 4538/5000 loss 0.1975 (w 0.3742 mse 0.3634 t 310 new 0.25) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +step 4539/5000 loss 0.2295 (w 0.6300 mse 0.5956 t 988 new 0.28) lr 1.00e-05 gnorm 0.343 3.10s mem 81.1GB +step 4540/5000 loss 0.2369 (w 0.2537 mse 0.2352 t 903 new 0.22) lr 1.00e-05 gnorm 0.176 3.33s mem 81.1GB +step 4541/5000 loss 0.3725 (w 0.1163 mse 0.1168 t 839 new 0.19) lr 1.00e-05 gnorm 0.206 2.82s mem 81.1GB +step 4542/5000 loss 0.2058 (w 0.1510 mse 0.1637 t 741 new 0.16) lr 1.00e-05 gnorm 0.157 2.82s mem 81.1GB +step 4543/5000 loss 0.3121 (w 0.1676 mse 0.1611 t 722 new 0.06) lr 1.00e-05 gnorm 0.147 3.45s mem 81.1GB +step 4544/5000 loss 0.1415 (w 0.2096 mse 0.2230 t 948 new 0.19) lr 1.00e-05 gnorm 0.164 2.83s mem 81.1GB +step 4545/5000 loss 0.1249 (w 0.2100 mse 0.2045 t 918 new 0.23) lr 1.00e-05 gnorm 0.127 3.06s mem 81.1GB +step 4546/5000 loss 0.1429 (w 0.2004 mse 0.1968 t 926 new 0.13) lr 1.00e-05 gnorm 0.277 3.35s mem 81.1GB +step 4547/5000 loss 0.2042 (w 0.2864 mse 0.2808 t 916 new 0.19) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +step 4548/5000 loss 0.2100 (w 0.2175 mse 0.2052 t 976 new 0.25) lr 1.00e-05 gnorm 0.130 3.01s mem 81.1GB +step 4549/5000 loss 0.1977 (w 0.1763 mse 0.1767 t 943 new 0.21) lr 1.00e-05 gnorm 0.130 3.17s mem 81.1GB +step 4550/5000 loss 0.0945 (w 0.3061 mse 0.2888 t 937 new 0.19) lr 1.00e-05 gnorm 0.108 2.82s mem 81.1GB +step 4551/5000 loss 0.3068 (w 0.1565 mse 0.1595 t 612 new 0.22) lr 1.00e-05 gnorm 0.153 3.31s mem 81.1GB +step 4552/5000 loss 0.1718 (w 0.1001 mse 0.1015 t 651 new 0.13) lr 1.00e-05 gnorm 0.126 3.29s mem 81.1GB +step 4553/5000 loss 0.2640 (w 0.1678 mse 0.1650 t 905 new 0.11) lr 1.00e-05 gnorm 0.115 2.82s mem 81.1GB +step 4554/5000 loss 0.2715 (w 0.2020 mse 0.1894 t 768 new 0.23) lr 1.00e-05 gnorm 0.129 3.03s mem 81.1GB +step 4555/5000 loss 0.1474 (w 0.3201 mse 0.3148 t 966 new 0.20) lr 1.00e-05 gnorm 0.118 3.40s mem 81.1GB +step 4556/5000 loss 0.3343 (w 0.2530 mse 0.2390 t 969 new 0.24) lr 1.00e-05 gnorm 0.134 2.82s mem 81.1GB +step 4557/5000 loss 0.2171 (w 0.2180 mse 0.2461 t 171 new 0.16) lr 1.00e-05 gnorm 0.127 3.34s mem 81.1GB +step 4558/5000 loss 0.1769 (w 0.2213 mse 0.2325 t 386 new 0.21) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +step 4559/5000 loss 0.3800 (w 0.5298 mse 0.5215 t 189 new 0.17) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +step 4560/5000 loss 0.1593 (w 0.3439 mse 0.3426 t 992 new 0.21) lr 1.00e-05 gnorm 0.177 3.03s mem 81.1GB +step 4561/5000 loss 0.2701 (w 0.1926 mse 0.1848 t 720 new 0.12) lr 1.00e-05 gnorm 0.122 3.13s mem 81.1GB +step 4562/5000 loss 0.2308 (w 0.1587 mse 0.1625 t 860 new 0.19) lr 1.00e-05 gnorm 0.105 2.84s mem 81.1GB +step 4563/5000 loss 0.2287 (w 0.1431 mse 0.1468 t 826 new 0.13) lr 1.00e-05 gnorm 0.136 3.32s mem 81.1GB +step 4564/5000 loss 0.3048 (w 0.2858 mse 0.2774 t 804 new 0.26) lr 1.00e-05 gnorm 0.125 3.15s mem 81.1GB +step 4565/5000 loss 0.1848 (w 0.1582 mse 0.1639 t 836 new 0.22) lr 1.00e-05 gnorm 0.149 2.83s mem 81.1GB +step 4566/5000 loss 0.1735 (w 0.2923 mse 0.2908 t 962 new 0.19) lr 1.00e-05 gnorm 0.467 3.07s mem 81.1GB +step 4567/5000 loss 0.2970 (w 0.2257 mse 0.2292 t 747 new 0.19) lr 1.00e-05 gnorm 0.126 3.12s mem 81.1GB +step 4568/5000 loss 0.2194 (w 0.1817 mse 0.1783 t 977 new 0.18) lr 1.00e-05 gnorm 0.185 2.83s mem 81.1GB +step 4569/5000 loss 0.2073 (w 0.2085 mse 0.1986 t 923 new 0.23) lr 1.00e-05 gnorm 0.248 3.58s mem 81.1GB +step 4570/5000 loss 0.2396 (w 0.2642 mse 0.2561 t 921 new 0.16) lr 1.00e-05 gnorm 0.129 3.07s mem 81.1GB +step 4571/5000 loss 0.0922 (w 0.2937 mse 0.2810 t 995 new 0.23) lr 1.00e-05 gnorm 0.114 2.84s mem 81.1GB +step 4572/5000 loss 0.1809 (w 0.1597 mse 0.1530 t 903 new 0.25) lr 1.00e-05 gnorm 0.139 3.42s mem 81.1GB +step 4573/5000 loss 0.2454 (w 0.2539 mse 0.2510 t 889 new 0.21) lr 1.00e-05 gnorm 0.231 2.85s mem 81.1GB +step 4574/5000 loss 0.2687 (w 0.2286 mse 0.2156 t 875 new 0.19) lr 1.00e-05 gnorm 0.146 2.85s mem 81.1GB +step 4575/5000 loss 0.3793 (w 0.2669 mse 0.2592 t 634 new 0.19) lr 1.00e-05 gnorm 0.124 3.13s mem 81.1GB +step 4576/5000 loss 0.2058 (w 0.1408 mse 0.1499 t 729 new 0.21) lr 1.00e-05 gnorm 0.156 3.13s mem 81.1GB +step 4577/5000 loss 0.3141 (w 0.1986 mse 0.1955 t 750 new 0.23) lr 1.00e-05 gnorm 0.221 2.84s mem 81.1GB +step 4578/5000 loss 0.1905 (w 0.2564 mse 0.2455 t 924 new 0.22) lr 1.00e-05 gnorm 0.136 3.40s mem 81.1GB +step 4579/5000 loss 0.1699 (w 0.1023 mse 0.1072 t 431 new 0.09) lr 1.00e-05 gnorm 0.107 2.84s mem 81.1GB +step 4580/5000 loss 0.1184 (w 0.2349 mse 0.2353 t 911 new 0.13) lr 1.00e-05 gnorm 0.119 3.28s mem 81.1GB +step 4581/5000 loss 0.1745 (w 0.2201 mse 0.2272 t 951 new 0.09) lr 1.00e-05 gnorm 0.149 3.42s mem 81.1GB +step 4582/5000 loss 0.1474 (w 0.1447 mse 0.1546 t 907 new 0.24) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +step 4583/5000 loss 0.3074 (w 0.2161 mse 0.2071 t 825 new 0.23) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +step 4584/5000 loss 0.1815 (w 0.2675 mse 0.2631 t 953 new 0.22) lr 1.00e-05 gnorm 0.133 3.41s mem 81.1GB +step 4585/5000 loss 0.1644 (w 0.1901 mse 0.1852 t 804 new 0.19) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +step 4586/5000 loss 0.2592 (w 0.1783 mse 0.1659 t 726 new 0.20) lr 1.00e-05 gnorm 0.147 3.31s mem 81.1GB +step 4587/5000 loss 0.0753 (w 0.3186 mse 0.3092 t 1000 new 0.17) lr 1.00e-05 gnorm 0.106 3.41s mem 81.1GB +step 4588/5000 loss 0.2094 (w 0.1978 mse 0.2011 t 511 new 0.10) lr 1.00e-05 gnorm 0.108 2.85s mem 81.1GB +step 4589/5000 loss 0.2504 (w 0.2773 mse 0.2792 t 958 new 0.15) lr 1.00e-05 gnorm 0.106 2.84s mem 81.1GB +step 4590/5000 loss 0.1800 (w 0.3247 mse 0.3053 t 683 new 0.24) lr 1.00e-05 gnorm 0.240 3.17s mem 81.1GB +step 4591/5000 loss 0.1729 (w 0.2130 mse 0.1964 t 802 new 0.18) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +step 4592/5000 loss 0.1834 (w 0.2238 mse 0.2053 t 815 new 0.22) lr 1.00e-05 gnorm 0.126 3.30s mem 81.1GB +step 4593/5000 loss 0.3890 (w 0.2072 mse 0.2036 t 917 new 0.23) lr 1.00e-05 gnorm 0.463 3.29s mem 81.1GB +step 4594/5000 loss 0.2537 (w 0.2626 mse 0.2595 t 568 new 0.24) lr 1.00e-05 gnorm 0.276 2.85s mem 81.1GB +step 4595/5000 loss 0.4102 (w 0.2213 mse 0.2273 t 978 new 0.23) lr 1.00e-05 gnorm 0.138 2.85s mem 81.1GB +step 4596/5000 loss 0.3066 (w 0.2646 mse 0.2567 t 927 new 0.20) lr 1.00e-05 gnorm 0.167 3.19s mem 81.1GB +step 4597/5000 loss 0.1500 (w 0.1627 mse 0.1683 t 948 new 0.19) lr 1.00e-05 gnorm 0.193 2.98s mem 81.1GB +step 4598/5000 loss 0.3390 (w 0.3676 mse 0.3584 t 288 new 0.21) lr 1.00e-05 gnorm 0.145 3.59s mem 81.1GB +step 4599/5000 loss 0.2805 (w 0.1989 mse 0.1832 t 937 new 0.24) lr 1.00e-05 gnorm 0.159 3.75s mem 81.1GB +step 4600/5000 loss 0.2299 (w 0.2871 mse 0.2952 t 998 new 0.24) lr 1.00e-05 gnorm 0.157 2.97s mem 81.1GB +step 4601/5000 loss 0.3378 (w 0.2473 mse 0.2377 t 404 new 0.19) lr 1.00e-05 gnorm 0.129 3.25s mem 81.1GB +step 4602/5000 loss 0.3209 (w 0.2813 mse 0.2737 t 492 new 0.20) lr 1.00e-05 gnorm 0.166 3.42s mem 81.1GB +step 4603/5000 loss 0.1230 (w 0.2016 mse 0.1990 t 955 new 0.20) lr 1.00e-05 gnorm 0.134 2.96s mem 81.1GB +step 4604/5000 loss 0.1130 (w 0.1881 mse 0.1729 t 975 new 0.26) lr 1.00e-05 gnorm 0.094 3.69s mem 81.1GB +step 4605/5000 loss 0.2742 (w 0.3019 mse 0.2955 t 315 new 0.19) lr 1.00e-05 gnorm 0.120 3.27s mem 81.1GB +step 4606/5000 loss 0.2144 (w 0.1700 mse 0.1635 t 942 new 0.26) lr 1.00e-05 gnorm 0.165 2.93s mem 81.1GB +step 4607/5000 loss 0.1471 (w 0.1833 mse 0.1866 t 778 new 0.21) lr 1.00e-05 gnorm 0.217 3.31s mem 81.1GB +step 4608/5000 loss 0.1545 (w 0.0924 mse 0.0969 t 715 new 0.07) lr 1.00e-05 gnorm 0.110 3.26s mem 81.1GB +step 4609/5000 loss 0.1190 (w 0.1682 mse 0.1748 t 941 new 0.19) lr 1.00e-05 gnorm 0.164 3.03s mem 81.1GB +step 4610/5000 loss 0.2002 (w 0.2051 mse 0.2106 t 979 new 0.18) lr 1.00e-05 gnorm 0.262 3.66s mem 81.1GB +step 4611/5000 loss 0.2673 (w 0.2495 mse 0.2431 t 537 new 0.15) lr 1.00e-05 gnorm 0.104 3.39s mem 81.1GB +step 4612/5000 loss 0.1706 (w 0.1497 mse 0.1550 t 720 new 0.15) lr 1.00e-05 gnorm 0.131 2.96s mem 81.1GB +step 4613/5000 loss 0.2227 (w 0.2773 mse 0.2673 t 909 new 0.16) lr 1.00e-05 gnorm 0.103 3.78s mem 81.1GB +step 4614/5000 loss 0.1819 (w 0.1609 mse 0.1623 t 599 new 0.23) lr 1.00e-05 gnorm 0.115 2.93s mem 81.1GB +step 4615/5000 loss 0.1952 (w 0.2383 mse 0.2196 t 948 new 0.18) lr 1.00e-05 gnorm 0.182 3.31s mem 81.1GB +step 4616/5000 loss 0.2249 (w 0.3325 mse 0.3453 t 189 new 0.17) lr 1.00e-05 gnorm 0.099 3.41s mem 81.1GB +step 4617/5000 loss 0.1738 (w 0.2605 mse 0.2544 t 544 new 0.22) lr 1.00e-05 gnorm 0.114 3.21s mem 81.1GB +step 4618/5000 loss 0.2697 (w 0.1652 mse 0.1708 t 952 new 0.24) lr 1.00e-05 gnorm 0.127 2.93s mem 81.1GB +step 4619/5000 loss 0.2988 (w 0.2209 mse 0.2211 t 596 new 0.20) lr 1.00e-05 gnorm 0.130 3.73s mem 81.1GB +step 4620/5000 loss 0.2391 (w 0.1591 mse 0.1433 t 839 new 0.25) lr 1.00e-05 gnorm 0.232 3.07s mem 81.1GB +step 4621/5000 loss 0.3140 (w 0.1561 mse 0.1540 t 836 new 0.24) lr 1.00e-05 gnorm 0.170 3.66s mem 81.1GB +step 4622/5000 loss 0.1696 (w 0.2903 mse 0.2828 t 827 new 0.17) lr 1.00e-05 gnorm 0.093 4.39s mem 81.1GB +step 4623/5000 loss 0.3825 (w 0.2440 mse 0.2275 t 809 new 0.13) lr 1.00e-05 gnorm 0.144 3.95s mem 81.1GB +step 4624/5000 loss 0.2485 (w 0.2815 mse 0.2657 t 909 new 0.15) lr 1.00e-05 gnorm 0.122 3.78s mem 81.1GB +step 4625/5000 loss 0.1313 (w 0.2581 mse 0.2391 t 992 new 0.25) lr 1.00e-05 gnorm 0.097 4.12s mem 81.1GB +step 4626/5000 loss 0.3111 (w 0.1223 mse 0.1184 t 838 new 0.20) lr 1.00e-05 gnorm 0.553 3.20s mem 81.1GB +step 4627/5000 loss 0.2782 (w 0.3053 mse 0.2955 t 999 new 0.24) lr 1.00e-05 gnorm 0.148 3.32s mem 81.1GB +step 4628/5000 loss 0.3116 (w 0.2982 mse 0.2730 t 957 new 0.20) lr 1.00e-05 gnorm 0.197 3.55s mem 81.1GB +step 4629/5000 loss 0.3055 (w 0.2335 mse 0.2189 t 769 new 0.25) lr 1.00e-05 gnorm 0.139 2.93s mem 81.1GB +step 4630/5000 loss 0.2082 (w 0.2661 mse 0.2571 t 693 new 0.16) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +step 4631/5000 loss 0.1858 (w 0.2161 mse 0.2223 t 990 new 0.20) lr 1.00e-05 gnorm 0.111 3.58s mem 81.1GB +step 4632/5000 loss 0.1922 (w 0.2889 mse 0.2693 t 920 new 0.22) lr 1.00e-05 gnorm 0.210 3.01s mem 81.1GB +step 4633/5000 loss 0.2365 (w 0.2600 mse 0.2453 t 975 new 0.27) lr 1.00e-05 gnorm 0.145 3.66s mem 81.1GB +step 4634/5000 loss 0.3562 (w 0.1359 mse 0.1406 t 748 new 0.26) lr 1.00e-05 gnorm 0.168 3.26s mem 81.1GB +step 4635/5000 loss 0.1000 (w 0.1682 mse 0.1642 t 940 new 0.24) lr 1.00e-05 gnorm 0.126 6.09s mem 81.1GB +step 4636/5000 loss 0.2080 (w 0.2089 mse 0.1937 t 886 new 0.22) lr 1.00e-05 gnorm 0.129 7.55s mem 81.1GB +step 4637/5000 loss 0.2657 (w 0.2708 mse 0.2673 t 950 new 0.20) lr 1.00e-05 gnorm 0.129 7.35s mem 81.1GB +step 4638/5000 loss 0.1394 (w 0.1073 mse 0.1138 t 614 new 0.09) lr 1.00e-05 gnorm 0.109 7.47s mem 81.1GB +step 4639/5000 loss 0.1929 (w 0.2430 mse 0.2356 t 732 new 0.19) lr 1.00e-05 gnorm 0.113 8.98s mem 81.1GB +step 4640/5000 loss 0.2239 (w 0.3053 mse 0.2965 t 997 new 0.17) lr 1.00e-05 gnorm 0.179 7.92s mem 81.1GB +step 4641/5000 loss 0.2759 (w 0.2986 mse 0.2988 t 989 new 0.01) lr 1.00e-05 gnorm 0.095 8.27s mem 81.1GB +step 4642/5000 loss 0.1499 (w 0.2568 mse 0.2424 t 932 new 0.22) lr 1.00e-05 gnorm 0.150 7.73s mem 81.1GB +step 4643/5000 loss 0.0640 (w 0.1580 mse 0.1584 t 979 new 0.22) lr 1.00e-05 gnorm 0.119 6.99s mem 81.1GB +step 4644/5000 loss 0.1516 (w 0.1739 mse 0.1761 t 657 new 0.22) lr 1.00e-05 gnorm 0.132 6.97s mem 81.1GB +step 4645/5000 loss 0.2314 (w 0.1833 mse 0.1796 t 935 new 0.17) lr 1.00e-05 gnorm 0.190 4.70s mem 81.1GB +step 4646/5000 loss 0.2682 (w 0.2930 mse 0.2830 t 960 new 0.20) lr 1.00e-05 gnorm 0.150 3.70s mem 81.1GB +step 4647/5000 loss 0.2796 (w 0.1552 mse 0.1599 t 775 new 0.18) lr 1.00e-05 gnorm 0.151 2.97s mem 81.1GB +step 4648/5000 loss 0.2231 (w 0.2622 mse 0.2695 t 978 new 0.21) lr 1.00e-05 gnorm 0.134 3.40s mem 81.1GB +step 4649/5000 loss 0.2950 (w 0.3217 mse 0.3114 t 506 new 0.23) lr 1.00e-05 gnorm 0.105 3.20s mem 81.1GB +step 4650/5000 loss 0.2348 (w 0.2516 mse 0.2376 t 810 new 0.19) lr 1.00e-05 gnorm 0.134 3.74s mem 81.1GB +step 4651/5000 loss 0.2242 (w 0.1374 mse 0.1329 t 868 new 0.20) lr 1.00e-05 gnorm 0.143 3.62s mem 81.1GB +step 4652/5000 loss 0.2031 (w 0.1259 mse 0.1292 t 580 new 0.16) lr 1.00e-05 gnorm 0.111 3.98s mem 81.1GB +step 4653/5000 loss 0.4216 (w 0.2666 mse 0.2605 t 712 new 0.12) lr 1.00e-05 gnorm 0.140 4.29s mem 81.1GB +step 4654/5000 loss 0.2115 (w 0.3597 mse 0.3609 t 996 new 0.26) lr 1.00e-05 gnorm 0.122 3.90s mem 81.1GB +step 4655/5000 loss 0.1537 (w 0.3190 mse 0.3160 t 962 new 0.16) lr 1.00e-05 gnorm 0.105 3.45s mem 81.1GB +step 4656/5000 loss 0.2401 (w 0.2637 mse 0.2542 t 623 new 0.25) lr 1.00e-05 gnorm 0.133 4.09s mem 81.1GB +step 4657/5000 loss 0.1841 (w 0.1064 mse 0.1251 t 925 new 0.26) lr 1.00e-05 gnorm 0.119 3.67s mem 81.1GB +step 4658/5000 loss 0.2611 (w 0.2305 mse 0.2218 t 792 new 0.22) lr 1.00e-05 gnorm 0.088 4.26s mem 81.1GB +step 4659/5000 loss 0.1652 (w 0.2104 mse 0.2207 t 328 new 0.23) lr 1.00e-05 gnorm 0.120 4.49s mem 81.1GB +step 4660/5000 loss 0.3452 (w 0.6202 mse 0.6214 t 114 new 0.19) lr 1.00e-05 gnorm 0.175 4.24s mem 81.1GB +step 4661/5000 loss 0.2576 (w 0.1899 mse 0.1859 t 951 new 0.17) lr 1.00e-05 gnorm 0.120 3.01s mem 81.1GB +step 4662/5000 loss 0.1588 (w 0.4359 mse 0.4029 t 978 new 0.19) lr 1.00e-05 gnorm 0.155 3.20s mem 81.1GB +step 4663/5000 loss 0.2686 (w 0.1522 mse 0.1621 t 861 new 0.24) lr 1.00e-05 gnorm 0.243 3.37s mem 81.1GB +step 4664/5000 loss 0.2218 (w 0.2594 mse 0.2594 t 999 new 0.25) lr 1.00e-05 gnorm 0.129 3.22s mem 81.1GB +step 4665/5000 loss 0.1880 (w 0.2487 mse 0.2597 t 990 new 0.15) lr 1.00e-05 gnorm 0.098 3.37s mem 81.1GB +step 4666/5000 loss 0.1029 (w 0.0944 mse 0.1078 t 890 new 0.23) lr 1.00e-05 gnorm 0.124 4.09s mem 81.1GB +step 4667/5000 loss 0.2216 (w 0.2400 mse 0.2353 t 975 new 0.19) lr 1.00e-05 gnorm 0.156 3.24s mem 81.1GB +step 4668/5000 loss 0.2305 (w 0.3251 mse 0.3285 t 323 new 0.20) lr 1.00e-05 gnorm 0.200 3.33s mem 81.1GB +step 4669/5000 loss 0.1721 (w 0.2407 mse 0.2088 t 987 new 0.23) lr 1.00e-05 gnorm 0.104 3.05s mem 81.1GB +step 4670/5000 loss 0.1524 (w 0.1171 mse 0.1171 t 829 new 0.00) lr 1.00e-05 gnorm 0.139 3.15s mem 81.1GB +step 4671/5000 loss 0.3219 (w 0.2233 mse 0.2035 t 626 new 0.21) lr 1.00e-05 gnorm 0.124 2.85s mem 81.1GB +step 4672/5000 loss 0.3077 (w 0.2840 mse 0.2788 t 982 new 0.13) lr 1.00e-05 gnorm 0.125 3.37s mem 81.1GB +step 4673/5000 loss 0.1355 (w 0.2204 mse 0.2182 t 821 new 0.22) lr 1.00e-05 gnorm 0.336 3.09s mem 81.1GB +step 4674/5000 loss 0.3086 (w 0.1638 mse 0.1523 t 624 new 0.19) lr 1.00e-05 gnorm 0.176 3.15s mem 81.1GB +step 4675/5000 loss 0.2746 (w 0.3698 mse 0.3467 t 968 new 0.21) lr 1.00e-05 gnorm 0.130 3.08s mem 81.1GB +step 4676/5000 loss 0.1756 (w 0.3411 mse 0.3112 t 987 new 0.25) lr 1.00e-05 gnorm 0.126 3.06s mem 81.1GB +step 4677/5000 loss 0.1482 (w 0.2989 mse 0.2909 t 989 new 0.22) lr 1.00e-05 gnorm 0.203 2.83s mem 81.1GB +step 4678/5000 loss 0.2348 (w 0.1781 mse 0.1718 t 947 new 0.17) lr 1.00e-05 gnorm 0.109 3.34s mem 81.1GB +step 4679/5000 loss 0.2142 (w 0.1240 mse 0.1234 t 835 new 0.23) lr 1.00e-05 gnorm 0.217 3.12s mem 81.1GB +step 4680/5000 loss 0.1947 (w 0.1732 mse 0.1773 t 528 new 0.24) lr 1.00e-05 gnorm 0.201 3.10s mem 81.1GB +step 4681/5000 loss 0.1902 (w 0.1029 mse 0.1104 t 907 new 0.12) lr 1.00e-05 gnorm 0.158 3.03s mem 81.1GB +step 4682/5000 loss 0.3474 (w 0.2531 mse 0.2562 t 981 new 0.22) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +step 4683/5000 loss 0.3447 (w 0.2068 mse 0.1887 t 786 new 0.25) lr 1.00e-05 gnorm 0.172 3.06s mem 81.1GB +step 4684/5000 loss 0.1554 (w 0.2489 mse 0.2499 t 999 new 0.14) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +step 4685/5000 loss 0.0765 (w 0.1712 mse 0.1879 t 997 new 0.21) lr 1.00e-05 gnorm 0.177 3.10s mem 81.1GB +step 4686/5000 loss 0.2362 (w 0.1103 mse 0.1131 t 797 new 0.25) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +step 4687/5000 loss 0.1861 (w 0.1985 mse 0.1873 t 884 new 0.24) lr 1.00e-05 gnorm 0.212 3.07s mem 81.1GB +step 4688/5000 loss 0.1295 (w 0.1703 mse 0.1697 t 880 new 0.22) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +step 4689/5000 loss 0.1947 (w 0.2406 mse 0.2469 t 984 new 0.23) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +step 4690/5000 loss 0.2511 (w 0.2884 mse 0.2833 t 535 new 0.23) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +step 4691/5000 loss 0.3008 (w 0.2905 mse 0.2681 t 928 new 0.19) lr 1.00e-05 gnorm 0.137 3.18s mem 81.1GB +step 4692/5000 loss 0.1975 (w 0.1905 mse 0.1904 t 973 new 0.09) lr 1.00e-05 gnorm 0.176 3.12s mem 81.1GB +step 4693/5000 loss 0.1530 (w 0.1510 mse 0.1519 t 956 new 0.22) lr 1.00e-05 gnorm 0.112 3.06s mem 81.1GB +step 4694/5000 loss 0.4289 (w 0.1893 mse 0.1838 t 811 new 0.23) lr 1.00e-05 gnorm 0.205 2.83s mem 81.1GB +step 4695/5000 loss 0.2506 (w 0.3072 mse 0.3070 t 813 new 0.25) lr 1.00e-05 gnorm 0.124 3.32s mem 81.1GB +step 4696/5000 loss 0.2964 (w 0.2240 mse 0.2087 t 923 new 0.18) lr 1.00e-05 gnorm 0.139 3.30s mem 81.1GB +step 4697/5000 loss 0.2499 (w 0.1726 mse 0.1740 t 859 new 0.20) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +step 4698/5000 loss 0.0919 (w 0.1406 mse 0.1512 t 973 new 0.16) lr 1.00e-05 gnorm 0.127 3.15s mem 81.1GB +step 4699/5000 loss 0.1777 (w 0.3260 mse 0.3231 t 949 new 0.20) lr 1.00e-05 gnorm 0.286 3.13s mem 81.1GB +step 4700/5000 loss 0.2409 (w 0.1810 mse 0.1972 t 996 new 0.24) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +step 4701/5000 loss 0.2315 (w 0.3166 mse 0.3272 t 244 new 0.15) lr 1.00e-05 gnorm 0.205 3.27s mem 81.1GB +step 4702/5000 loss 0.3158 (w 0.2823 mse 0.2775 t 525 new 0.20) lr 1.00e-05 gnorm 0.127 3.36s mem 81.1GB +step 4703/5000 loss 0.0802 (w 0.1455 mse 0.1430 t 843 new 0.27) lr 1.00e-05 gnorm 0.181 2.83s mem 81.1GB +step 4704/5000 loss 0.3331 (w 0.4177 mse 0.4384 t 171 new 0.24) lr 1.00e-05 gnorm 0.188 3.48s mem 81.1GB +step 4705/5000 loss 0.2956 (w 0.2586 mse 0.2547 t 840 new 0.22) lr 1.00e-05 gnorm 0.151 3.12s mem 81.1GB +step 4706/5000 loss 0.2779 (w 0.1934 mse 0.1919 t 807 new 0.21) lr 1.00e-05 gnorm 0.266 2.83s mem 81.1GB +step 4707/5000 loss 0.2546 (w 0.2763 mse 0.2665 t 470 new 0.23) lr 1.00e-05 gnorm 0.166 3.36s mem 81.1GB +step 4708/5000 loss 0.1495 (w 0.1513 mse 0.1504 t 966 new 0.23) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +step 4709/5000 loss 0.3249 (w 0.3158 mse 0.3110 t 511 new 0.17) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +step 4710/5000 loss 0.2026 (w 0.2688 mse 0.2431 t 875 new 0.19) lr 1.00e-05 gnorm 0.124 3.19s mem 81.1GB +step 4711/5000 loss 0.2680 (w 0.1731 mse 0.1575 t 949 new 0.23) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +step 4712/5000 loss 0.2294 (w 0.2081 mse 0.2070 t 688 new 0.08) lr 1.00e-05 gnorm 0.126 3.00s mem 81.1GB +step 4713/5000 loss 0.1832 (w 0.2196 mse 0.2143 t 873 new 0.20) lr 1.00e-05 gnorm 0.135 3.28s mem 81.1GB +step 4714/5000 loss 0.1480 (w 0.1807 mse 0.1770 t 742 new 0.24) lr 1.00e-05 gnorm 0.096 3.12s mem 81.1GB +step 4715/5000 loss 0.2422 (w 0.1841 mse 0.1784 t 990 new 0.21) lr 1.00e-05 gnorm 0.244 2.82s mem 81.1GB +step 4716/5000 loss 0.1745 (w 0.1459 mse 0.1444 t 868 new 0.27) lr 1.00e-05 gnorm 0.111 3.41s mem 81.1GB +step 4717/5000 loss 0.2025 (w 0.2168 mse 0.2097 t 869 new 0.17) lr 1.00e-05 gnorm 0.177 3.05s mem 81.1GB +step 4718/5000 loss 0.2357 (w 0.3985 mse 0.3640 t 997 new 0.19) lr 1.00e-05 gnorm 0.167 3.12s mem 81.1GB +step 4719/5000 loss 0.2667 (w 0.2324 mse 0.2162 t 673 new 0.22) lr 1.00e-05 gnorm 0.144 3.44s mem 81.1GB +step 4720/5000 loss 0.3052 (w 0.1222 mse 0.1301 t 607 new 0.12) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +step 4721/5000 loss 0.2625 (w 0.3087 mse 0.2828 t 946 new 0.15) lr 1.00e-05 gnorm 0.128 2.82s mem 81.1GB +step 4722/5000 loss 0.2334 (w 0.2822 mse 0.2626 t 972 new 0.25) lr 1.00e-05 gnorm 0.175 3.41s mem 81.1GB +step 4723/5000 loss 0.1844 (w 0.1984 mse 0.1971 t 898 new 0.12) lr 1.00e-05 gnorm 0.170 3.07s mem 81.1GB +step 4724/5000 loss 0.2804 (w 0.0994 mse 0.1065 t 785 new 0.23) lr 1.00e-05 gnorm 0.256 3.13s mem 81.1GB +step 4725/5000 loss 0.2010 (w 0.2125 mse 0.2083 t 940 new 0.21) lr 1.00e-05 gnorm 0.104 3.09s mem 81.1GB +step 4726/5000 loss 0.2191 (w 0.2272 mse 0.2323 t 444 new 0.16) lr 1.00e-05 gnorm 0.116 2.82s mem 81.1GB +step 4727/5000 loss 0.1820 (w 0.1119 mse 0.1361 t 988 new 0.22) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +step 4728/5000 loss 0.2433 (w 0.1753 mse 0.1677 t 609 new 0.23) lr 1.00e-05 gnorm 0.247 3.18s mem 81.1GB +step 4729/5000 loss 0.1975 (w 0.2200 mse 0.2139 t 994 new 0.16) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +step 4730/5000 loss 0.3547 (w 0.2716 mse 0.2716 t 336 new 0.00) lr 1.00e-05 gnorm 0.154 3.13s mem 81.1GB +step 4731/5000 loss 0.2822 (w 0.2350 mse 0.2621 t 328 new 0.17) lr 1.00e-05 gnorm 0.294 3.33s mem 81.1GB +step 4732/5000 loss 0.1249 (w 0.1748 mse 0.1904 t 966 new 0.16) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +step 4733/5000 loss 0.1857 (w 0.3707 mse 0.3372 t 989 new 0.23) lr 1.00e-05 gnorm 0.143 3.13s mem 81.1GB +step 4734/5000 loss 0.1533 (w 0.1623 mse 0.1610 t 946 new 0.08) lr 1.00e-05 gnorm 0.283 3.35s mem 81.1GB +step 4735/5000 loss 0.1898 (w 0.1917 mse 0.1917 t 995 new 0.20) lr 1.00e-05 gnorm 0.230 2.82s mem 81.1GB +step 4736/5000 loss 0.3096 (w 0.2581 mse 0.2750 t 959 new 0.25) lr 1.00e-05 gnorm 0.124 3.12s mem 81.1GB +step 4737/5000 loss 0.1784 (w 0.2540 mse 0.2524 t 921 new 0.24) lr 1.00e-05 gnorm 0.151 3.41s mem 81.1GB +step 4738/5000 loss 0.2238 (w 0.2125 mse 0.2074 t 940 new 0.15) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +step 4739/5000 loss 0.2008 (w 0.3061 mse 0.2938 t 921 new 0.29) lr 1.00e-05 gnorm 0.129 3.17s mem 81.1GB +step 4740/5000 loss 0.1998 (w 0.1488 mse 0.1585 t 834 new 0.19) lr 1.00e-05 gnorm 0.110 3.42s mem 81.1GB +step 4741/5000 loss 0.1198 (w 0.3359 mse 0.3203 t 995 new 0.23) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +step 4742/5000 loss 0.2241 (w 0.2314 mse 0.2304 t 975 new 0.22) lr 1.00e-05 gnorm 0.132 3.14s mem 81.1GB +step 4743/5000 loss 0.1865 (w 0.3672 mse 0.3484 t 974 new 0.23) lr 1.00e-05 gnorm 0.180 3.32s mem 81.1GB +step 4744/5000 loss 0.1945 (w 0.2763 mse 0.2651 t 551 new 0.21) lr 1.00e-05 gnorm 0.229 2.83s mem 81.1GB +step 4745/5000 loss 0.1884 (w 0.2399 mse 0.2292 t 955 new 0.26) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +step 4746/5000 loss 0.1926 (w 0.2435 mse 0.2314 t 599 new 0.23) lr 1.00e-05 gnorm 0.209 3.14s mem 81.1GB +step 4747/5000 loss 0.1922 (w 0.2101 mse 0.2004 t 937 new 0.20) lr 1.00e-05 gnorm 0.127 2.82s mem 81.1GB +step 4748/5000 loss 0.3591 (w 0.4942 mse 0.5124 t 200 new 0.20) lr 1.00e-05 gnorm 0.143 3.43s mem 81.1GB +step 4749/5000 loss 0.2801 (w 0.1713 mse 0.1724 t 962 new 0.22) lr 1.00e-05 gnorm 0.132 3.12s mem 81.1GB +step 4750/5000 loss 0.1925 (w 0.1287 mse 0.1310 t 720 new 0.20) lr 1.00e-05 gnorm 0.207 2.82s mem 81.1GB +step 4751/5000 loss 0.2480 (w 0.1890 mse 0.1800 t 754 new 0.12) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +step 4752/5000 loss 0.2646 (w 0.2216 mse 0.2167 t 582 new 0.13) lr 1.00e-05 gnorm 0.156 3.07s mem 81.1GB +step 4753/5000 loss 0.3723 (w 0.2975 mse 0.2948 t 747 new 0.23) lr 1.00e-05 gnorm 0.155 2.83s mem 81.1GB +step 4754/5000 loss 0.2087 (w 0.1369 mse 0.1379 t 869 new 0.15) lr 1.00e-05 gnorm 0.127 3.38s mem 81.1GB +step 4755/5000 loss 0.1163 (w 0.2739 mse 0.2640 t 956 new 0.16) lr 1.00e-05 gnorm 0.121 3.02s mem 81.1GB +step 4756/5000 loss 0.2678 (w 0.2272 mse 0.2115 t 846 new 0.24) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +step 4757/5000 loss 0.2132 (w 0.2094 mse 0.2077 t 977 new 0.13) lr 1.00e-05 gnorm 0.129 3.09s mem 81.1GB +step 4758/5000 loss 0.2664 (w 0.2208 mse 0.2135 t 962 new 0.18) lr 1.00e-05 gnorm 0.158 3.12s mem 81.1GB +step 4759/5000 loss 0.2511 (w 0.2446 mse 0.2343 t 892 new 0.21) lr 1.00e-05 gnorm 0.156 2.83s mem 81.1GB +step 4760/5000 loss 0.2315 (w 0.2533 mse 0.2389 t 953 new 0.21) lr 1.00e-05 gnorm 0.196 3.44s mem 81.1GB +step 4761/5000 loss 0.2801 (w 0.1043 mse 0.1049 t 885 new 0.11) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +step 4762/5000 loss 0.1052 (w 0.1584 mse 0.1566 t 798 new 0.23) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +step 4763/5000 loss 0.2616 (w 0.2894 mse 0.2733 t 779 new 0.18) lr 1.00e-05 gnorm 0.165 3.43s mem 81.1GB +step 4764/5000 loss 0.1549 (w 0.3230 mse 0.3100 t 980 new 0.18) lr 1.00e-05 gnorm 0.131 3.16s mem 81.1GB +step 4765/5000 loss 0.2545 (w 0.1248 mse 0.1264 t 824 new 0.22) lr 1.00e-05 gnorm 0.112 3.06s mem 81.1GB +step 4766/5000 loss 0.2493 (w 0.1923 mse 0.1932 t 851 new 0.21) lr 1.00e-05 gnorm 0.105 3.34s mem 81.1GB +step 4767/5000 loss 0.2146 (w 0.2389 mse 0.2394 t 998 new 0.20) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +step 4768/5000 loss 0.2206 (w 0.1209 mse 0.1255 t 861 new 0.20) lr 1.00e-05 gnorm 0.235 2.86s mem 81.1GB +step 4769/5000 loss 0.2718 (w 0.1892 mse 0.1895 t 917 new 0.23) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +step 4770/5000 loss 0.0871 (w 0.1921 mse 0.1819 t 918 new 0.24) lr 1.00e-05 gnorm 0.113 3.10s mem 81.1GB +step 4771/5000 loss 0.2029 (w 0.1834 mse 0.1775 t 926 new 0.13) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +step 4772/5000 loss 0.3484 (w 0.2241 mse 0.2253 t 479 new 0.23) lr 1.00e-05 gnorm 0.152 3.37s mem 81.1GB +step 4773/5000 loss 0.3101 (w 0.1563 mse 0.1592 t 918 new 0.17) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +step 4774/5000 loss 0.2242 (w 0.2676 mse 0.2554 t 937 new 0.21) lr 1.00e-05 gnorm 0.135 2.83s mem 81.1GB +step 4775/5000 loss 0.3607 (w 0.1924 mse 0.1863 t 835 new 0.21) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +step 4776/5000 loss 0.3238 (w 0.2160 mse 0.1950 t 601 new 0.22) lr 1.00e-05 gnorm 0.159 3.13s mem 81.1GB +step 4777/5000 loss 0.1255 (w 0.3204 mse 0.3103 t 974 new 0.20) lr 1.00e-05 gnorm 0.182 3.09s mem 81.1GB +step 4778/5000 loss 0.2228 (w 0.1623 mse 0.1641 t 945 new 0.12) lr 1.00e-05 gnorm 0.648 3.48s mem 81.1GB +step 4779/5000 loss 0.1100 (w 0.3097 mse 0.2893 t 971 new 0.20) lr 1.00e-05 gnorm 0.565 2.83s mem 81.1GB +step 4780/5000 loss 0.2851 (w 0.1865 mse 0.1827 t 830 new 0.13) lr 1.00e-05 gnorm 0.190 3.03s mem 81.1GB +step 4781/5000 loss 0.1707 (w 0.1374 mse 0.1259 t 887 new 0.23) lr 1.00e-05 gnorm 0.124 3.41s mem 81.1GB +step 4782/5000 loss 0.2147 (w 0.1904 mse 0.1767 t 808 new 0.11) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +step 4783/5000 loss 0.2304 (w 0.2130 mse 0.2216 t 459 new 0.26) lr 1.00e-05 gnorm 0.173 3.11s mem 81.1GB +step 4784/5000 loss 0.2988 (w 0.3683 mse 0.3658 t 992 new 0.20) lr 1.00e-05 gnorm 0.253 3.44s mem 81.1GB +step 4785/5000 loss 0.3303 (w 0.2191 mse 0.2177 t 637 new 0.14) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +step 4786/5000 loss 0.3204 (w 0.2423 mse 0.2458 t 431 new 0.25) lr 1.00e-05 gnorm 0.136 3.14s mem 81.1GB +step 4787/5000 loss 0.2244 (w 0.2077 mse 0.2009 t 580 new 0.23) lr 1.00e-05 gnorm 0.115 3.15s mem 81.1GB +step 4788/5000 loss 0.1749 (w 0.1730 mse 0.1686 t 578 new 0.18) lr 1.00e-05 gnorm 0.114 2.84s mem 81.1GB +step 4789/5000 loss 0.1544 (w 0.2587 mse 0.2453 t 467 new 0.27) lr 1.00e-05 gnorm 0.151 3.34s mem 81.1GB +step 4790/5000 loss 0.3481 (w 0.1061 mse 0.1114 t 752 new 0.17) lr 1.00e-05 gnorm 0.133 3.46s mem 81.1GB +step 4791/5000 loss 0.2396 (w 0.2385 mse 0.2403 t 651 new 0.17) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +step 4792/5000 loss 0.2461 (w 0.2297 mse 0.2289 t 404 new 0.15) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +step 4793/5000 loss 0.2358 (w 0.0955 mse 0.1066 t 965 new 0.13) lr 1.00e-05 gnorm 0.113 3.14s mem 81.1GB +step 4794/5000 loss 0.1677 (w 0.1942 mse 0.1940 t 836 new 0.25) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +step 4795/5000 loss 0.2027 (w 0.4726 mse 0.4636 t 982 new 0.19) lr 1.00e-05 gnorm 0.111 3.42s mem 81.1GB +step 4796/5000 loss 0.1847 (w 0.1701 mse 0.1656 t 833 new 0.14) lr 1.00e-05 gnorm 0.938 3.13s mem 81.1GB +step 4797/5000 loss 0.1268 (w 0.1632 mse 0.1587 t 895 new 0.20) lr 1.00e-05 gnorm 0.123 2.82s mem 81.1GB +step 4798/5000 loss 0.2240 (w 0.2397 mse 0.2294 t 962 new 0.25) lr 1.00e-05 gnorm 0.188 3.32s mem 81.1GB +step 4799/5000 loss 0.1654 (w 0.2596 mse 0.2511 t 852 new 0.21) lr 1.00e-05 gnorm 0.093 3.06s mem 81.1GB +step 4800/5000 loss 0.1686 (w 0.2735 mse 0.2692 t 973 new 0.23) lr 1.00e-05 gnorm 0.222 3.12s mem 81.1GB +step 4801/5000 loss 0.1561 (w 0.2153 mse 0.2055 t 915 new 0.22) lr 1.00e-05 gnorm 0.124 3.08s mem 81.1GB +step 4802/5000 loss 0.2370 (w 0.2819 mse 0.2745 t 917 new 0.16) lr 1.00e-05 gnorm 0.171 3.38s mem 81.1GB +step 4803/5000 loss 0.2100 (w 0.2765 mse 0.2577 t 651 new 0.23) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +step 4804/5000 loss 0.2041 (w 0.1776 mse 0.1787 t 761 new 0.13) lr 1.00e-05 gnorm 0.107 3.14s mem 81.1GB +step 4805/5000 loss 0.1704 (w 0.2154 mse 0.2130 t 921 new 0.23) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +step 4806/5000 loss 0.1457 (w 0.2716 mse 0.2632 t 966 new 0.28) lr 1.00e-05 gnorm 0.110 3.13s mem 81.1GB +step 4807/5000 loss 0.1283 (w 0.2154 mse 0.2096 t 816 new 0.11) lr 1.00e-05 gnorm 0.144 3.09s mem 81.1GB +step 4808/5000 loss 0.2587 (w 0.4036 mse 0.3761 t 1000 new 0.23) lr 1.00e-05 gnorm 0.133 3.40s mem 81.1GB +step 4809/5000 loss 0.1003 (w 0.2305 mse 0.2073 t 946 new 0.21) lr 1.00e-05 gnorm 0.170 2.85s mem 81.1GB +step 4810/5000 loss 0.1802 (w 0.2791 mse 0.2699 t 997 new 0.16) lr 1.00e-05 gnorm 0.136 3.14s mem 81.1GB +step 4811/5000 loss 0.2717 (w 0.1942 mse 0.1918 t 697 new 0.24) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +step 4812/5000 loss 0.3194 (w 0.3234 mse 0.3194 t 375 new 0.07) lr 1.00e-05 gnorm 65.603 3.12s mem 81.1GB +step 4813/5000 loss 0.2625 (w 0.2083 mse 0.2084 t 774 new 0.24) lr 1.00e-05 gnorm 0.134 3.29s mem 81.1GB +step 4814/5000 loss 0.2786 (w 0.2217 mse 0.2111 t 805 new 0.24) lr 1.00e-05 gnorm 3.319 3.12s mem 81.1GB +step 4815/5000 loss 0.1135 (w 0.3358 mse 0.3293 t 984 new 0.19) lr 1.00e-05 gnorm 0.190 3.03s mem 81.1GB +step 4816/5000 loss 0.2492 (w 0.2541 mse 0.2551 t 858 new 0.19) lr 1.00e-05 gnorm 0.173 3.12s mem 81.1GB +step 4817/5000 loss 0.2090 (w 0.2493 mse 0.2518 t 980 new 0.17) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +step 4818/5000 loss 0.1895 (w 0.2712 mse 0.2489 t 941 new 0.21) lr 1.00e-05 gnorm 0.175 2.83s mem 81.1GB +step 4819/5000 loss 0.2087 (w 0.3241 mse 0.3270 t 988 new 0.18) lr 1.00e-05 gnorm 0.139 3.33s mem 81.1GB +step 4820/5000 loss 0.1287 (w 0.1316 mse 0.1372 t 823 new 0.24) lr 1.00e-05 gnorm 0.164 3.13s mem 81.1GB +step 4821/5000 loss 0.2716 (w 0.2685 mse 0.2844 t 511 new 0.17) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +step 4822/5000 loss 0.1394 (w 0.1339 mse 0.1393 t 938 new 0.28) lr 1.00e-05 gnorm 0.133 2.83s mem 81.1GB +step 4823/5000 loss 0.1307 (w 0.2336 mse 0.2309 t 849 new 0.20) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +step 4824/5000 loss 0.2311 (w 0.2744 mse 0.2554 t 835 new 0.21) lr 1.00e-05 gnorm 0.263 3.06s mem 81.1GB +step 4825/5000 loss 0.2910 (w 0.2560 mse 0.2381 t 621 new 0.16) lr 1.00e-05 gnorm 0.127 3.33s mem 81.1GB +step 4826/5000 loss 0.3332 (w 0.3165 mse 0.3086 t 414 new 0.21) lr 1.00e-05 gnorm 0.117 3.13s mem 81.1GB +step 4827/5000 loss 0.4538 (w 0.6112 mse 0.6201 t 134 new 0.25) lr 1.00e-05 gnorm 0.141 3.34s mem 81.1GB +step 4828/5000 loss 0.2186 (w 0.2953 mse 0.2802 t 909 new 0.16) lr 1.00e-05 gnorm 0.135 2.82s mem 81.1GB +step 4829/5000 loss 0.1326 (w 0.2209 mse 0.2157 t 976 new 0.17) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +step 4830/5000 loss 0.1982 (w 0.1244 mse 0.1356 t 731 new 0.18) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +step 4831/5000 loss 0.1358 (w 0.2106 mse 0.1971 t 890 new 0.20) lr 1.00e-05 gnorm 0.107 3.31s mem 81.1GB +step 4832/5000 loss 0.2372 (w 0.2979 mse 0.2921 t 961 new 0.23) lr 1.00e-05 gnorm 0.175 3.14s mem 81.1GB +step 4833/5000 loss 0.1753 (w 0.3019 mse 0.2802 t 956 new 0.27) lr 1.00e-05 gnorm 0.121 3.39s mem 81.1GB +step 4834/5000 loss 0.1881 (w 0.1776 mse 0.1842 t 424 new 0.24) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +step 4835/5000 loss 0.2812 (w 0.3213 mse 0.3238 t 476 new 0.16) lr 1.00e-05 gnorm 0.156 3.10s mem 81.1GB +step 4836/5000 loss 0.2822 (w 0.2085 mse 0.2086 t 610 new 0.20) lr 1.00e-05 gnorm 5.294 3.29s mem 81.1GB +step 4837/5000 loss 0.2262 (w 0.2418 mse 0.2268 t 874 new 0.25) lr 1.00e-05 gnorm 0.151 3.35s mem 81.1GB +step 4838/5000 loss 0.3083 (w 0.2468 mse 0.2370 t 907 new 0.20) lr 1.00e-05 gnorm 0.122 3.17s mem 81.1GB +step 4839/5000 loss 0.3476 (w 0.2012 mse 0.2062 t 681 new 0.17) lr 1.00e-05 gnorm 0.138 3.03s mem 81.1GB +step 4840/5000 loss 0.2351 (w 0.1776 mse 0.1881 t 942 new 0.11) lr 1.00e-05 gnorm 0.154 3.15s mem 81.1GB +step 4841/5000 loss 0.1424 (w 0.1731 mse 0.1669 t 945 new 0.24) lr 1.00e-05 gnorm 0.259 2.84s mem 81.1GB +step 4842/5000 loss 0.2951 (w 0.3071 mse 0.2945 t 786 new 0.19) lr 1.00e-05 gnorm 0.134 3.37s mem 81.1GB +step 4843/5000 loss 0.3054 (w 0.2946 mse 0.2846 t 610 new 0.21) lr 1.00e-05 gnorm 0.345 3.11s mem 81.1GB +step 4844/5000 loss 0.2638 (w 0.1410 mse 0.1449 t 700 new 0.23) lr 1.00e-05 gnorm 0.110 3.07s mem 81.1GB +step 4845/5000 loss 0.1702 (w 0.1762 mse 0.1779 t 983 new 0.24) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +step 4846/5000 loss 0.1473 (w 0.1988 mse 0.1888 t 712 new 0.17) lr 1.00e-05 gnorm 0.121 3.10s mem 81.1GB +step 4847/5000 loss 0.2769 (w 0.5466 mse 0.5539 t 146 new 0.24) lr 1.00e-05 gnorm 0.107 2.84s mem 81.1GB +step 4848/5000 loss 0.1625 (w 0.2484 mse 0.2355 t 980 new 0.23) lr 1.00e-05 gnorm 0.156 3.39s mem 81.1GB +step 4849/5000 loss 0.2952 (w 0.1545 mse 0.1584 t 845 new 0.23) lr 1.00e-05 gnorm 0.103 3.06s mem 81.1GB +step 4850/5000 loss 0.2829 (w 0.3241 mse 0.3156 t 421 new 0.24) lr 1.00e-05 gnorm 0.156 3.11s mem 81.1GB +step 4851/5000 loss 0.2847 (w 0.2304 mse 0.2181 t 694 new 0.13) lr 1.00e-05 gnorm 0.178 3.03s mem 81.1GB +step 4852/5000 loss 0.1901 (w 0.2661 mse 0.2601 t 955 new 0.20) lr 1.00e-05 gnorm 0.174 3.12s mem 81.1GB +step 4853/5000 loss 0.1641 (w 0.3458 mse 0.3202 t 895 new 0.25) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +step 4854/5000 loss 0.2279 (w 0.5781 mse 0.5772 t 140 new 0.15) lr 1.00e-05 gnorm 0.143 3.13s mem 81.1GB +step 4855/5000 loss 0.1047 (w 0.2519 mse 0.2373 t 851 new 0.24) lr 1.00e-05 gnorm 0.309 3.04s mem 81.1GB +step 4856/5000 loss 0.2248 (w 0.2841 mse 0.2645 t 892 new 0.22) lr 1.00e-05 gnorm 0.207 3.34s mem 81.1GB +step 4857/5000 loss 0.1472 (w 0.3136 mse 0.3097 t 957 new 0.13) lr 1.00e-05 gnorm 0.121 3.03s mem 81.1GB +step 4858/5000 loss 0.1874 (w 0.1860 mse 0.1897 t 988 new 0.11) lr 1.00e-05 gnorm 0.137 3.12s mem 81.1GB +step 4859/5000 loss 0.2508 (w 0.2862 mse 0.3061 t 991 new 0.26) lr 1.00e-05 gnorm 0.148 3.05s mem 81.1GB +step 4860/5000 loss 0.2456 (w 0.2951 mse 0.2842 t 955 new 0.19) lr 1.00e-05 gnorm 0.114 3.14s mem 81.1GB +step 4861/5000 loss 0.3325 (w 0.2596 mse 0.2627 t 695 new 0.14) lr 1.00e-05 gnorm 0.121 3.17s mem 81.1GB +step 4862/5000 loss 0.1340 (w 0.1819 mse 0.1891 t 777 new 0.22) lr 1.00e-05 gnorm 0.087 3.34s mem 81.1GB +step 4863/5000 loss 0.2118 (w 0.1946 mse 0.1992 t 840 new 0.18) lr 1.00e-05 gnorm 0.111 3.03s mem 81.1GB +step 4864/5000 loss 0.2013 (w 0.4648 mse 0.4408 t 994 new 0.24) lr 1.00e-05 gnorm 0.131 3.12s mem 81.1GB +step 4865/5000 loss 0.1586 (w 0.2284 mse 0.2258 t 992 new 0.22) lr 1.00e-05 gnorm 0.111 3.11s mem 81.1GB +step 4866/5000 loss 0.2520 (w 0.3685 mse 0.3797 t 292 new 0.24) lr 1.00e-05 gnorm 0.117 3.33s mem 81.1GB +step 4867/5000 loss 0.1128 (w 0.3426 mse 0.3368 t 989 new 0.30) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +step 4868/5000 loss 0.1934 (w 0.3059 mse 0.3046 t 976 new 0.19) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +step 4869/5000 loss 0.1484 (w 0.4134 mse 0.3775 t 996 new 0.23) lr 1.00e-05 gnorm 0.113 3.07s mem 81.1GB +step 4870/5000 loss 0.2443 (w 0.2763 mse 0.2668 t 871 new 0.20) lr 1.00e-05 gnorm 0.138 3.13s mem 81.1GB +step 4871/5000 loss 0.1752 (w 0.1374 mse 0.1480 t 976 new 0.18) lr 1.00e-05 gnorm 0.098 3.45s mem 81.1GB +step 4872/5000 loss 0.0700 (w 0.1491 mse 0.1370 t 878 new 0.22) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +step 4873/5000 loss 0.1395 (w 0.3212 mse 0.3134 t 965 new 0.21) lr 1.00e-05 gnorm 0.149 3.12s mem 81.1GB +step 4874/5000 loss 0.1295 (w 0.1740 mse 0.1745 t 857 new 0.20) lr 1.00e-05 gnorm 0.119 3.40s mem 81.1GB +step 4875/5000 loss 0.1770 (w 0.1509 mse 0.1472 t 997 new 0.23) lr 1.00e-05 gnorm 0.155 2.82s mem 81.1GB +step 4876/5000 loss 0.2189 (w 0.1793 mse 0.1694 t 907 new 0.25) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +step 4877/5000 loss 0.1225 (w 0.1461 mse 0.1589 t 936 new 0.24) lr 1.00e-05 gnorm 0.112 3.12s mem 81.1GB +step 4878/5000 loss 0.2974 (w 0.2005 mse 0.2056 t 986 new 0.22) lr 1.00e-05 gnorm 0.316 3.11s mem 81.1GB +step 4879/5000 loss 0.1927 (w 0.3270 mse 0.3009 t 843 new 0.26) lr 1.00e-05 gnorm 0.112 3.14s mem 81.1GB +step 4880/5000 loss 0.1709 (w 0.3434 mse 0.3295 t 985 new 0.20) lr 1.00e-05 gnorm 0.162 2.82s mem 81.1GB +step 4881/5000 loss 0.3914 (w 0.2650 mse 0.2564 t 885 new 0.25) lr 1.00e-05 gnorm 0.139 3.28s mem 81.1GB +step 4882/5000 loss 0.2093 (w 0.2439 mse 0.2363 t 876 new 0.24) lr 1.00e-05 gnorm 0.112 2.82s mem 81.1GB +step 4883/5000 loss 0.1829 (w 0.1878 mse 0.1843 t 928 new 0.25) lr 1.00e-05 gnorm 0.105 3.36s mem 81.1GB +step 4884/5000 loss 0.2925 (w 0.3361 mse 0.3263 t 963 new 0.16) lr 1.00e-05 gnorm 0.270 3.12s mem 81.1GB +step 4885/5000 loss 0.3147 (w 0.5927 mse 0.5931 t 146 new 0.22) lr 1.00e-05 gnorm 0.180 3.09s mem 81.1GB +step 4886/5000 loss 0.2137 (w 0.2493 mse 0.2353 t 868 new 0.22) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +step 4887/5000 loss 0.2849 (w 0.1016 mse 0.0982 t 906 new 0.24) lr 1.00e-05 gnorm 0.153 3.29s mem 81.1GB +step 4888/5000 loss 0.1573 (w 0.2218 mse 0.2243 t 817 new 0.17) lr 1.00e-05 gnorm 0.115 2.83s mem 81.1GB +step 4889/5000 loss 0.3243 (w 0.2239 mse 0.2130 t 749 new 0.24) lr 1.00e-05 gnorm 0.344 3.16s mem 81.1GB +step 4890/5000 loss 0.2374 (w 0.1685 mse 0.1760 t 950 new 0.15) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +step 4891/5000 loss 0.1587 (w 0.3693 mse 0.3793 t 979 new 0.19) lr 1.00e-05 gnorm 0.134 3.07s mem 81.1GB +step 4892/5000 loss 0.2983 (w 0.1932 mse 0.1893 t 592 new 0.18) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +step 4893/5000 loss 0.3434 (w 0.1772 mse 0.1781 t 939 new 0.20) lr 1.00e-05 gnorm 0.302 3.40s mem 81.1GB +step 4894/5000 loss 0.2121 (w 0.2668 mse 0.2567 t 990 new 0.26) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +step 4895/5000 loss 0.2106 (w 0.2701 mse 0.2666 t 479 new 0.19) lr 1.00e-05 gnorm 0.183 3.08s mem 81.1GB +step 4896/5000 loss 0.1991 (w 0.3678 mse 0.3880 t 238 new 0.22) lr 1.00e-05 gnorm 0.107 3.08s mem 81.1GB +step 4897/5000 loss 0.3060 (w 0.1815 mse 0.1631 t 740 new 0.25) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +step 4898/5000 loss 0.1808 (w 0.2511 mse 0.2390 t 976 new 0.22) lr 1.00e-05 gnorm 0.197 2.83s mem 81.1GB +step 4899/5000 loss 0.2090 (w 0.2413 mse 0.2293 t 865 new 0.25) lr 1.00e-05 gnorm 0.153 3.42s mem 81.1GB +step 4900/5000 loss 0.3318 (w 0.5288 mse 0.5443 t 165 new 0.18) lr 1.00e-05 gnorm 0.168 3.09s mem 81.1GB +step 4901/5000 loss 0.1660 (w 0.1980 mse 0.1859 t 705 new 0.26) lr 1.00e-05 gnorm 0.106 3.43s mem 81.1GB +step 4902/5000 loss 0.2265 (w 0.2247 mse 0.2146 t 668 new 0.11) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +step 4903/5000 loss 0.2841 (w 0.2454 mse 0.2329 t 787 new 0.21) lr 1.00e-05 gnorm 0.194 3.11s mem 81.1GB +step 4904/5000 loss 0.1801 (w 0.2503 mse 0.2428 t 904 new 0.19) lr 1.00e-05 gnorm 0.117 2.82s mem 81.1GB +step 4905/5000 loss 0.3145 (w 0.1801 mse 0.1865 t 881 new 0.19) lr 1.00e-05 gnorm 0.119 3.45s mem 81.1GB +step 4906/5000 loss 0.3293 (w 0.2711 mse 0.2629 t 500 new 0.24) lr 1.00e-05 gnorm 0.209 3.14s mem 81.1GB +step 4907/5000 loss 0.2602 (w 0.1160 mse 0.1117 t 988 new 0.09) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +step 4908/5000 loss 0.2547 (w 0.2636 mse 0.2357 t 988 new 0.23) lr 1.00e-05 gnorm 0.117 2.83s mem 81.1GB +step 4909/5000 loss 0.4561 (w 0.2199 mse 0.2178 t 621 new 0.12) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +step 4910/5000 loss 0.2077 (w 0.3191 mse 0.3034 t 965 new 0.25) lr 1.00e-05 gnorm 0.089 2.82s mem 81.1GB +step 4911/5000 loss 0.1793 (w 0.3478 mse 0.3240 t 979 new 0.29) lr 1.00e-05 gnorm 0.097 3.08s mem 81.1GB +step 4912/5000 loss 0.2159 (w 0.1510 mse 0.1638 t 999 new 0.20) lr 1.00e-05 gnorm 0.125 3.13s mem 81.1GB +step 4913/5000 loss 0.1488 (w 0.1682 mse 0.1676 t 803 new 0.17) lr 1.00e-05 gnorm 0.162 3.03s mem 81.1GB +step 4914/5000 loss 0.1299 (w 0.2069 mse 0.2176 t 972 new 0.23) lr 1.00e-05 gnorm 0.135 3.13s mem 81.1GB +step 4915/5000 loss 0.2672 (w 0.2322 mse 0.2234 t 605 new 0.18) lr 1.00e-05 gnorm 0.102 3.07s mem 81.1GB +step 4916/5000 loss 0.1678 (w 0.1161 mse 0.1210 t 769 new 0.15) lr 1.00e-05 gnorm 0.186 2.82s mem 81.1GB +step 4917/5000 loss 0.2828 (w 0.2689 mse 0.2762 t 301 new 0.26) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +step 4918/5000 loss 0.3183 (w 0.2753 mse 0.2678 t 450 new 0.16) lr 1.00e-05 gnorm 0.171 3.11s mem 81.1GB +step 4919/5000 loss 0.2427 (w 0.2151 mse 0.2150 t 920 new 0.16) lr 1.00e-05 gnorm 0.174 3.03s mem 81.1GB +step 4920/5000 loss 0.1741 (w 0.3090 mse 0.3007 t 983 new 0.25) lr 1.00e-05 gnorm 0.108 3.10s mem 81.1GB +step 4921/5000 loss 0.2860 (w 0.2504 mse 0.2437 t 987 new 0.25) lr 1.00e-05 gnorm 0.147 2.82s mem 81.1GB +step 4922/5000 loss 0.1878 (w 0.1459 mse 0.1623 t 982 new 0.20) lr 1.00e-05 gnorm 0.190 3.08s mem 81.1GB +step 4923/5000 loss 0.2230 (w 0.2195 mse 0.2132 t 560 new 0.13) lr 1.00e-05 gnorm 0.109 3.08s mem 81.1GB +step 4924/5000 loss 0.1670 (w 0.2130 mse 0.2028 t 976 new 0.21) lr 1.00e-05 gnorm 0.125 3.38s mem 81.1GB +step 4925/5000 loss 0.3199 (w 0.2425 mse 0.2311 t 957 new 0.18) lr 1.00e-05 gnorm 0.164 3.08s mem 81.1GB +step 4926/5000 loss 0.2108 (w 0.1333 mse 0.1390 t 914 new 0.14) lr 1.00e-05 gnorm 0.310 3.13s mem 81.1GB +step 4927/5000 loss 0.1902 (w 0.1647 mse 0.1607 t 969 new 0.17) lr 1.00e-05 gnorm 0.108 2.83s mem 81.1GB +step 4928/5000 loss 0.1985 (w 0.3178 mse 0.3166 t 980 new 0.09) lr 1.00e-05 gnorm 0.152 3.06s mem 81.1GB +step 4929/5000 loss 0.2147 (w 0.2764 mse 0.2832 t 965 new 0.21) lr 1.00e-05 gnorm 0.115 3.08s mem 81.1GB +step 4930/5000 loss 0.2027 (w 0.1500 mse 0.1465 t 818 new 0.18) lr 1.00e-05 gnorm 0.124 3.17s mem 81.1GB +step 4931/5000 loss 0.1448 (w 0.2350 mse 0.2309 t 977 new 0.26) lr 1.00e-05 gnorm 0.087 3.05s mem 81.1GB +step 4932/5000 loss 0.1322 (w 0.4110 mse 0.3825 t 962 new 0.24) lr 1.00e-05 gnorm 0.302 3.28s mem 81.1GB +step 4933/5000 loss 0.2835 (w 0.2826 mse 0.2609 t 929 new 0.22) lr 1.00e-05 gnorm 0.095 2.82s mem 81.1GB +step 4934/5000 loss 0.2168 (w 0.3048 mse 0.2875 t 950 new 0.26) lr 1.00e-05 gnorm 0.246 3.11s mem 81.1GB +step 4935/5000 loss 0.2295 (w 0.5928 mse 0.6070 t 177 new 0.20) lr 1.00e-05 gnorm 0.131 3.35s mem 81.1GB +step 4936/5000 loss 0.1803 (w 0.2193 mse 0.2054 t 831 new 0.20) lr 1.00e-05 gnorm 0.105 3.06s mem 81.1GB +step 4937/5000 loss 0.1833 (w 0.1100 mse 0.1016 t 797 new 0.22) lr 1.00e-05 gnorm 0.107 3.01s mem 81.1GB +step 4938/5000 loss 0.1789 (w 0.2286 mse 0.2239 t 995 new 0.19) lr 1.00e-05 gnorm 0.158 3.33s mem 81.1GB +step 4939/5000 loss 0.1983 (w 0.2245 mse 0.2247 t 624 new 0.22) lr 1.00e-05 gnorm 0.106 2.83s mem 81.1GB +step 4940/5000 loss 0.1478 (w 0.2703 mse 0.2631 t 964 new 0.15) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +step 4941/5000 loss 0.2584 (w 0.2832 mse 0.2686 t 910 new 0.22) lr 1.00e-05 gnorm 0.173 3.35s mem 81.1GB +step 4942/5000 loss 0.1654 (w 0.2166 mse 0.2176 t 961 new 0.22) lr 1.00e-05 gnorm 0.143 3.15s mem 81.1GB +step 4943/5000 loss 0.3245 (w 0.2317 mse 0.2400 t 826 new 0.18) lr 1.00e-05 gnorm 0.138 3.27s mem 81.1GB +step 4944/5000 loss 0.2138 (w 0.2452 mse 0.2474 t 945 new 0.19) lr 1.00e-05 gnorm 0.167 3.07s mem 81.1GB +step 4945/5000 loss 0.1711 (w 0.2170 mse 0.2070 t 800 new 0.17) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +step 4946/5000 loss 0.1452 (w 0.2117 mse 0.1985 t 829 new 0.18) lr 1.00e-05 gnorm 0.134 3.28s mem 81.1GB +step 4947/5000 loss 0.2148 (w 0.2979 mse 0.2863 t 479 new 0.20) lr 1.00e-05 gnorm 0.098 3.44s mem 81.1GB +step 4948/5000 loss 0.2959 (w 0.1771 mse 0.1890 t 992 new 0.10) lr 1.00e-05 gnorm 0.097 2.94s mem 81.1GB +step 4949/5000 loss 0.2745 (w 0.1581 mse 0.1579 t 870 new 0.22) lr 1.00e-05 gnorm 0.115 3.38s mem 81.1GB +step 4950/5000 loss 0.3145 (w 0.1834 mse 0.1730 t 809 new 0.21) lr 1.00e-05 gnorm 0.118 3.26s mem 81.1GB +step 4951/5000 loss 0.0882 (w 0.2589 mse 0.2739 t 994 new 0.19) lr 1.00e-05 gnorm 0.127 3.76s mem 81.1GB +step 4952/5000 loss 0.1310 (w 0.1988 mse 0.2010 t 854 new 0.20) lr 1.00e-05 gnorm 0.155 4.34s mem 81.1GB +step 4953/5000 loss 0.2845 (w 0.3267 mse 0.3119 t 998 new 0.26) lr 1.00e-05 gnorm 0.110 4.51s mem 81.1GB +step 4954/5000 loss 0.2328 (w 0.1927 mse 0.1963 t 932 new 0.20) lr 1.00e-05 gnorm 0.122 4.44s mem 81.1GB +step 4955/5000 loss 0.2722 (w 0.3216 mse 0.3185 t 997 new 0.16) lr 1.00e-05 gnorm 0.157 6.20s mem 81.1GB +step 4956/5000 loss 0.1123 (w 0.2228 mse 0.2213 t 533 new 0.26) lr 1.00e-05 gnorm 0.157 6.36s mem 81.1GB +step 4957/5000 loss 0.2421 (w 0.1909 mse 0.1870 t 832 new 0.23) lr 1.00e-05 gnorm 0.101 6.21s mem 81.1GB +step 4958/5000 loss 0.3254 (w 0.2403 mse 0.2434 t 948 new 0.25) lr 1.00e-05 gnorm 0.172 6.31s mem 81.1GB +step 4959/5000 loss 0.2548 (w 0.2943 mse 0.2878 t 440 new 0.29) lr 1.00e-05 gnorm 0.140 6.41s mem 81.1GB +step 4960/5000 loss 0.2432 (w 0.3401 mse 0.3202 t 947 new 0.13) lr 1.00e-05 gnorm 0.169 6.51s mem 81.1GB +step 4961/5000 loss 0.1600 (w 0.1612 mse 0.1536 t 836 new 0.22) lr 1.00e-05 gnorm 0.110 6.39s mem 81.1GB +step 4962/5000 loss 0.2080 (w 0.1757 mse 0.1741 t 802 new 0.19) lr 1.00e-05 gnorm 0.121 6.29s mem 81.1GB +step 4963/5000 loss 0.1669 (w 0.1273 mse 0.1290 t 938 new 0.11) lr 1.00e-05 gnorm 0.137 6.22s mem 81.1GB +step 4964/5000 loss 0.2960 (w 0.2590 mse 0.2455 t 764 new 0.25) lr 1.00e-05 gnorm 0.127 6.37s mem 81.1GB +step 4965/5000 loss 0.2029 (w 0.0962 mse 0.1071 t 867 new 0.23) lr 1.00e-05 gnorm 0.227 6.46s mem 81.1GB +step 4966/5000 loss 0.2534 (w 0.2020 mse 0.1991 t 644 new 0.21) lr 1.00e-05 gnorm 0.103 6.28s mem 81.1GB +step 4967/5000 loss 0.2682 (w 0.2646 mse 0.2542 t 885 new 0.20) lr 1.00e-05 gnorm 0.127 6.33s mem 81.1GB +step 4968/5000 loss 0.2566 (w 0.2381 mse 0.2229 t 832 new 0.17) lr 1.00e-05 gnorm 0.134 6.31s mem 81.1GB +step 4969/5000 loss 0.1634 (w 0.2087 mse 0.2258 t 984 new 0.12) lr 1.00e-05 gnorm 0.126 6.36s mem 81.1GB +step 4970/5000 loss 0.2932 (w 0.2290 mse 0.2171 t 898 new 0.15) lr 1.00e-05 gnorm 0.128 6.48s mem 81.1GB +step 4971/5000 loss 0.3042 (w 0.1928 mse 0.1893 t 546 new 0.14) lr 1.00e-05 gnorm 0.382 6.51s mem 81.1GB +step 4972/5000 loss 0.2912 (w 0.1375 mse 0.1374 t 794 new 0.25) lr 1.00e-05 gnorm 0.162 6.21s mem 81.1GB +step 4973/5000 loss 0.2231 (w 0.4339 mse 0.4194 t 444 new 0.20) lr 1.00e-05 gnorm 0.135 6.31s mem 81.1GB +step 4974/5000 loss 0.2092 (w 0.2223 mse 0.2131 t 843 new 0.17) lr 1.00e-05 gnorm 0.111 6.21s mem 81.1GB +step 4975/5000 loss 0.1917 (w 0.2947 mse 0.2965 t 375 new 0.09) lr 1.00e-05 gnorm 0.112 6.26s mem 81.1GB +step 4976/5000 loss 0.2280 (w 0.2636 mse 0.2604 t 553 new 0.23) lr 1.00e-05 gnorm 0.224 6.63s mem 81.1GB +step 4977/5000 loss 0.2899 (w 0.1722 mse 0.1723 t 960 new 0.14) lr 1.00e-05 gnorm 0.140 6.52s mem 81.1GB +step 4978/5000 loss 0.3036 (w 0.3302 mse 0.3254 t 586 new 0.21) lr 1.00e-05 gnorm 0.117 6.47s mem 81.1GB +step 4979/5000 loss 0.2714 (w 0.1061 mse 0.1199 t 837 new 0.21) lr 1.00e-05 gnorm 0.112 6.38s mem 81.1GB +step 4980/5000 loss 0.2096 (w 0.1611 mse 0.1646 t 940 new 0.12) lr 1.00e-05 gnorm 0.149 6.18s mem 81.1GB +step 4981/5000 loss 0.1823 (w 0.1708 mse 0.1676 t 890 new 0.20) lr 1.00e-05 gnorm 0.152 6.18s mem 81.1GB +step 4982/5000 loss 0.2667 (w 0.1259 mse 0.1162 t 852 new 0.20) lr 1.00e-05 gnorm 0.140 6.36s mem 81.1GB +step 4983/5000 loss 0.2820 (w 0.2129 mse 0.1916 t 800 new 0.24) lr 1.00e-05 gnorm 0.123 6.46s mem 81.1GB +step 4984/5000 loss 0.1465 (w 0.2931 mse 0.2670 t 914 new 0.19) lr 1.00e-05 gnorm 0.108 6.37s mem 81.1GB +step 4985/5000 loss 0.2321 (w 0.2451 mse 0.2364 t 975 new 0.20) lr 1.00e-05 gnorm 0.168 6.15s mem 81.1GB +step 4986/5000 loss 0.1989 (w 0.2320 mse 0.2282 t 786 new 0.17) lr 1.00e-05 gnorm 1.938 6.35s mem 81.1GB +step 4987/5000 loss 0.1935 (w 0.1986 mse 0.1974 t 954 new 0.20) lr 1.00e-05 gnorm 0.115 6.26s mem 81.1GB +step 4988/5000 loss 0.1378 (w 0.3291 mse 0.3161 t 992 new 0.10) lr 1.00e-05 gnorm 0.083 6.33s mem 81.1GB +step 4989/5000 loss 0.1095 (w 0.2407 mse 0.2291 t 919 new 0.22) lr 1.00e-05 gnorm 0.154 6.26s mem 81.1GB +step 4990/5000 loss 0.2642 (w 0.1665 mse 0.1663 t 609 new 0.21) lr 1.00e-05 gnorm 0.145 6.30s mem 81.1GB +step 4991/5000 loss 0.1709 (w 0.2341 mse 0.2198 t 940 new 0.18) lr 1.00e-05 gnorm 0.337 6.28s mem 81.1GB +step 4992/5000 loss 0.2278 (w 0.2576 mse 0.2474 t 987 new 0.25) lr 1.00e-05 gnorm 0.113 6.27s mem 81.1GB +step 4993/5000 loss 0.1575 (w 0.2860 mse 0.2619 t 891 new 0.27) lr 1.00e-05 gnorm 0.103 6.32s mem 81.1GB +step 4994/5000 loss 0.1995 (w 0.2689 mse 0.2599 t 978 new 0.20) lr 1.00e-05 gnorm 0.124 6.43s mem 81.1GB +step 4995/5000 loss 0.2632 (w 0.1673 mse 0.1570 t 909 new 0.14) lr 1.00e-05 gnorm 0.124 6.54s mem 81.1GB +step 4996/5000 loss 0.1611 (w 0.1882 mse 0.1927 t 993 new 0.22) lr 1.00e-05 gnorm 0.134 6.14s mem 81.1GB +step 4997/5000 loss 0.1629 (w 0.1843 mse 0.1782 t 960 new 0.12) lr 1.00e-05 gnorm 0.093 6.27s mem 81.1GB +step 4998/5000 loss 0.2115 (w 0.3069 mse 0.2769 t 985 new 0.21) lr 1.00e-05 gnorm 0.163 6.25s mem 81.1GB +step 4999/5000 loss 0.1556 (w 0.1681 mse 0.1642 t 920 new 0.21) lr 1.00e-05 gnorm 0.131 6.10s mem 81.1GB +step 5000/5000 loss 0.1345 (w 0.0886 mse 0.0882 t 781 new 0.15) lr 1.00e-05 gnorm 0.118 6.21s mem 81.1GB +[val] step 5000 t=200: w=0.4090 mse=0.4194 (n=16) t=500: w=0.2158 mse=0.2191 (n=16) t=800: w=0.1676 mse=0.1667 (n=16) | mean w=0.2642 mse=0.2684 3s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step5000.safetensors 4093 个张量 37.98 GB +[done] step 5000 diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v2/progress.json b/backup_2026-09-14/runs/ltx__arope_5k_v2/progress.json new file mode 100644 index 0000000000000000000000000000000000000000..7d34aa527f67dec35f2242010b1936ad67d93b89 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v2/progress.json @@ -0,0 +1 @@ +{"step": 5000, "wall": 1789397092.57479, "time": "2026-09-14 14:44:52"} \ No newline at end of file diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v2/train.log b/backup_2026-09-14/runs/ltx__arope_5k_v2/train.log new file mode 100644 index 0000000000000000000000000000000000000000..04a273a4b4c2d56f782dd7e335497ebf0a6b7825 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v2/train.log @@ -0,0 +1,5027 @@ +[2026-09-14 10:06:06] [env] world=8 distributed=DistributedType.DEEPSPEED mixed_precision=bf16 device=cuda:0 +[2026-09-14 10:06:44] [arope] 装 arope_mask_embed:Linear(1, 4096),零初始化 +[2026-09-14 10:06:44] [arope] patchify_proj 挂了 forward hook(+ arope_mask_embed(mask)) +[2026-09-14 10:06:44] [model] DiT 加载 28s,18,987,867,392 参数,4093 个 state_dict 键,mask_channel=True,has arope_mask_embed=True +[2026-09-14 10:07:13] [env] grad_clip=1.0 +[2026-09-14 10:07:13] [train] 18528 个 clip,每进程 batch 1,8 进程,到 5000 步 +[2026-09-14 10:07:24] step 1/5000 loss 0.4861 (w 0.6060 mse 0.5936 t 965 new 0.18) lr 5.00e-08 gnorm 2.401 8.40s mem 79.7GB +[2026-09-14 10:07:27] step 2/5000 loss 0.5881 (w 0.3528 mse 0.3757 t 737 new 0.24) lr 1.00e-07 gnorm 4.468 3.38s mem 81.1GB +[2026-09-14 10:07:30] step 3/5000 loss 0.4099 (w 0.4785 mse 0.4715 t 934 new 0.21) lr 1.50e-07 gnorm 3.099 2.82s mem 81.1GB +[2026-09-14 10:07:33] step 4/5000 loss 0.4003 (w 0.4092 mse 0.4069 t 895 new 0.24) lr 2.00e-07 gnorm 2.373 2.83s mem 81.1GB +[2026-09-14 10:07:35] step 5/5000 loss 0.4392 (w 0.4070 mse 0.4083 t 803 new 0.24) lr 2.50e-07 gnorm 2.632 2.83s mem 81.1GB +[2026-09-14 10:07:38] step 6/5000 loss 0.5087 (w 0.3529 mse 0.3591 t 588 new 0.22) lr 3.00e-07 gnorm 2.128 2.83s mem 81.1GB +[2026-09-14 10:07:42] step 7/5000 loss 0.4050 (w 0.4932 mse 0.4929 t 929 new 0.23) lr 3.50e-07 gnorm 2.207 2.83s mem 81.1GB +[2026-09-14 10:07:45] step 8/5000 loss 0.3769 (w 0.5039 mse 0.5013 t 935 new 0.22) lr 4.00e-07 gnorm 2.054 3.32s mem 81.1GB +[2026-09-14 10:07:48] step 9/5000 loss 0.5876 (w 0.4631 mse 0.4474 t 584 new 0.24) lr 4.50e-07 gnorm 3.341 2.84s mem 81.1GB +[2026-09-14 10:07:51] step 10/5000 loss 0.6910 (w 0.8336 mse 0.8207 t 996 new 0.24) lr 5.00e-07 gnorm 3.137 2.83s mem 81.1GB +[2026-09-14 10:07:53] step 11/5000 loss 0.3257 (w 0.6445 mse 0.6302 t 984 new 0.18) lr 5.50e-07 gnorm 1.657 2.85s mem 81.1GB +[2026-09-14 10:07:56] step 12/5000 loss 0.3848 (w 0.4506 mse 0.4536 t 962 new 0.17) lr 6.00e-07 gnorm 3.173 2.83s mem 81.1GB +[2026-09-14 10:08:00] step 13/5000 loss 0.5699 (w 0.3873 mse 0.3708 t 633 new 0.19) lr 6.50e-07 gnorm 2.631 3.21s mem 81.1GB +[2026-09-14 10:08:03] step 14/5000 loss 0.8126 (w 0.7637 mse 0.7757 t 274 new 0.16) lr 7.00e-07 gnorm 2.806 3.16s mem 81.1GB +[2026-09-14 10:08:06] step 15/5000 loss 0.4608 (w 0.4275 mse 0.4142 t 904 new 0.14) lr 7.50e-07 gnorm 2.294 2.84s mem 81.1GB +[2026-09-14 10:08:08] step 16/5000 loss 0.6755 (w 0.8539 mse 0.8538 t 999 new 0.23) lr 8.00e-07 gnorm 2.916 2.85s mem 81.1GB +[2026-09-14 10:08:11] step 17/5000 loss 0.4314 (w 0.4839 mse 0.4761 t 939 new 0.18) lr 8.50e-07 gnorm 1.937 2.86s mem 81.1GB +[2026-09-14 10:08:14] step 18/5000 loss 0.3202 (w 0.5759 mse 0.5932 t 989 new 0.15) lr 9.00e-07 gnorm 0.825 2.84s mem 81.1GB +[2026-09-14 10:08:18] step 19/5000 loss 0.4228 (w 0.7209 mse 0.7413 t 100 new 0.20) lr 9.50e-07 gnorm 2.087 3.22s mem 81.1GB +[2026-09-14 10:08:20] step 20/5000 loss 0.2761 (w 0.4019 mse 0.3867 t 955 new 0.25) lr 1.00e-06 gnorm 0.816 2.84s mem 81.1GB +[2026-09-14 10:08:23] step 21/5000 loss 0.5957 (w 0.8206 mse 0.8112 t 995 new 0.20) lr 1.05e-06 gnorm 1.937 2.85s mem 81.1GB +[2026-09-14 10:08:26] step 22/5000 loss 0.3408 (w 0.4396 mse 0.4250 t 901 new 0.24) lr 1.10e-06 gnorm 1.915 2.85s mem 81.1GB +[2026-09-14 10:08:29] step 23/5000 loss 0.4749 (w 0.4166 mse 0.4239 t 740 new 0.17) lr 1.15e-06 gnorm 5.485 2.84s mem 81.1GB +[2026-09-14 10:08:32] step 24/5000 loss 0.3959 (w 0.4688 mse 0.4968 t 930 new 0.22) lr 1.20e-06 gnorm 0.877 2.84s mem 81.1GB +[2026-09-14 10:08:35] step 25/5000 loss 0.2243 (w 0.2642 mse 0.2606 t 811 new 0.27) lr 1.25e-06 gnorm 1.307 3.63s mem 81.1GB +[2026-09-14 10:08:38] step 26/5000 loss 0.3961 (w 0.3668 mse 0.3872 t 274 new 0.19) lr 1.30e-06 gnorm 1.357 2.84s mem 81.1GB +[2026-09-14 10:08:41] step 27/5000 loss 0.3127 (w 0.3399 mse 0.3322 t 916 new 0.22) lr 1.35e-06 gnorm 0.723 2.84s mem 81.1GB +[2026-09-14 10:08:44] step 28/5000 loss 0.3123 (w 0.4819 mse 0.4735 t 957 new 0.23) lr 1.40e-06 gnorm 0.816 2.84s mem 81.1GB +[2026-09-14 10:08:47] step 29/5000 loss 0.2226 (w 0.2019 mse 0.2093 t 786 new 0.16) lr 1.45e-06 gnorm 0.578 2.85s mem 81.1GB +[2026-09-14 10:08:50] step 30/5000 loss 0.3562 (w 0.4016 mse 0.3837 t 947 new 0.21) lr 1.50e-06 gnorm 0.505 2.86s mem 81.1GB +[2026-09-14 10:08:53] step 31/5000 loss 0.5557 (w 0.5073 mse 0.5175 t 947 new 0.20) lr 1.55e-06 gnorm 1.888 3.42s mem 81.1GB +[2026-09-14 10:08:56] step 32/5000 loss 0.2924 (w 0.3567 mse 0.3611 t 906 new 0.23) lr 1.60e-06 gnorm 0.470 2.85s mem 81.1GB +[2026-09-14 10:08:59] step 33/5000 loss 0.3708 (w 0.3026 mse 0.2842 t 790 new 0.15) lr 1.65e-06 gnorm 0.618 2.85s mem 81.1GB +[2026-09-14 10:09:02] step 34/5000 loss 0.2077 (w 0.3350 mse 0.3609 t 836 new 0.24) lr 1.70e-06 gnorm 0.393 2.85s mem 81.1GB +[2026-09-14 10:09:05] step 35/5000 loss 0.4652 (w 0.8127 mse 0.7911 t 999 new 0.23) lr 1.75e-06 gnorm 0.592 2.86s mem 81.1GB +[2026-09-14 10:09:08] step 36/5000 loss 0.3275 (w 0.3658 mse 0.3562 t 828 new 0.25) lr 1.80e-06 gnorm 0.473 3.12s mem 81.1GB +[2026-09-14 10:09:11] step 37/5000 loss 0.2994 (w 0.7925 mse 0.7691 t 990 new 0.21) lr 1.85e-06 gnorm 0.421 3.45s mem 81.1GB +[2026-09-14 10:09:14] step 38/5000 loss 0.4964 (w 0.2765 mse 0.2813 t 889 new 0.24) lr 1.90e-06 gnorm 0.640 2.84s mem 81.1GB +[2026-09-14 10:09:17] step 39/5000 loss 0.5564 (w 0.4414 mse 0.4386 t 470 new 0.23) lr 1.95e-06 gnorm 0.561 2.85s mem 81.1GB +[2026-09-14 10:09:20] step 40/5000 loss 0.3925 (w 0.3182 mse 0.3147 t 900 new 0.19) lr 2.00e-06 gnorm 0.424 2.85s mem 81.1GB +[2026-09-14 10:09:23] step 41/5000 loss 0.6666 (w 0.1715 mse 0.1676 t 889 new 0.10) lr 2.05e-06 gnorm 0.950 2.85s mem 81.1GB +[2026-09-14 10:09:26] step 42/5000 loss 0.2332 (w 0.3300 mse 0.3229 t 835 new 0.09) lr 2.10e-06 gnorm 0.419 3.39s mem 81.1GB +[2026-09-14 10:09:30] step 43/5000 loss 0.6629 (w 0.4488 mse 0.4602 t 594 new 0.23) lr 2.15e-06 gnorm 0.372 3.69s mem 81.1GB +[2026-09-14 10:09:33] step 44/5000 loss 0.2562 (w 0.4241 mse 0.4211 t 966 new 0.22) lr 2.20e-06 gnorm 0.583 2.84s mem 81.1GB +[2026-09-14 10:09:36] step 45/5000 loss 0.2490 (w 0.6391 mse 0.6324 t 990 new 0.23) lr 2.25e-06 gnorm 0.326 2.85s mem 81.1GB +[2026-09-14 10:09:38] step 46/5000 loss 0.3099 (w 0.4543 mse 0.4503 t 990 new 0.17) lr 2.30e-06 gnorm 0.400 2.86s mem 81.1GB +[2026-09-14 10:09:41] step 47/5000 loss 0.4115 (w 0.2441 mse 0.2532 t 603 new 0.10) lr 2.35e-06 gnorm 1.050 2.85s mem 81.1GB +[2026-09-14 10:09:45] step 48/5000 loss 0.1929 (w 0.3161 mse 0.3139 t 924 new 0.13) lr 2.40e-06 gnorm 0.367 3.23s mem 81.1GB +[2026-09-14 10:09:48] step 49/5000 loss 0.2946 (w 0.3710 mse 0.3691 t 642 new 0.26) lr 2.45e-06 gnorm 3.645 3.44s mem 81.1GB +[2026-09-14 10:09:51] step 50/5000 loss 0.2455 (w 0.4103 mse 0.4108 t 970 new 0.06) lr 2.50e-06 gnorm 0.369 2.85s mem 81.1GB +[2026-09-14 10:09:54] step 51/5000 loss 0.5069 (w 0.4648 mse 0.4535 t 372 new 0.21) lr 2.55e-06 gnorm 0.462 2.85s mem 81.1GB +[2026-09-14 10:09:57] step 52/5000 loss 0.2179 (w 0.1974 mse 0.1964 t 949 new 0.20) lr 2.60e-06 gnorm 0.368 2.84s mem 81.1GB +[2026-09-14 10:09:59] step 53/5000 loss 0.3612 (w 0.3209 mse 0.3117 t 747 new 0.09) lr 2.65e-06 gnorm 0.502 2.85s mem 81.1GB +[2026-09-14 10:10:03] step 54/5000 loss 0.3282 (w 0.3530 mse 0.3564 t 991 new 0.14) lr 2.70e-06 gnorm 0.270 3.15s mem 81.1GB +[2026-09-14 10:10:06] step 55/5000 loss 0.3807 (w 0.4842 mse 0.4878 t 986 new 0.28) lr 2.75e-06 gnorm 0.395 3.16s mem 81.1GB +[2026-09-14 10:10:09] step 56/5000 loss 0.3549 (w 0.4480 mse 0.4641 t 989 new 0.10) lr 2.80e-06 gnorm 0.218 2.84s mem 81.1GB +[2026-09-14 10:10:11] step 57/5000 loss 0.5104 (w 0.4635 mse 0.4593 t 980 new 0.19) lr 2.85e-06 gnorm 0.384 2.84s mem 81.1GB +[2026-09-14 10:10:14] step 58/5000 loss 0.2663 (w 0.3217 mse 0.3446 t 883 new 0.17) lr 2.90e-06 gnorm 0.428 2.85s mem 81.1GB +[2026-09-14 10:10:17] step 59/5000 loss 0.3714 (w 0.4444 mse 0.4422 t 961 new 0.21) lr 2.95e-06 gnorm 0.271 2.85s mem 81.1GB +[2026-09-14 10:10:21] step 60/5000 loss 0.2902 (w 0.3174 mse 0.3262 t 891 new 0.21) lr 3.00e-06 gnorm 0.302 3.50s mem 81.1GB +[2026-09-14 10:10:24] step 61/5000 loss 0.5143 (w 0.3784 mse 0.3782 t 817 new 0.17) lr 3.05e-06 gnorm 0.395 3.16s mem 81.1GB +[2026-09-14 10:10:27] step 62/5000 loss 0.4374 (w 0.2743 mse 0.2810 t 979 new 0.11) lr 3.10e-06 gnorm 1.492 2.85s mem 81.1GB +[2026-09-14 10:10:29] step 63/5000 loss 0.3046 (w 0.5708 mse 0.5461 t 984 new 0.16) lr 3.15e-06 gnorm 0.600 2.85s mem 81.1GB +[2026-09-14 10:10:32] step 64/5000 loss 0.1400 (w 0.4235 mse 0.4252 t 931 new 0.19) lr 3.20e-06 gnorm 0.235 2.84s mem 81.1GB +[2026-09-14 10:10:35] step 65/5000 loss 0.3910 (w 0.2603 mse 0.2636 t 847 new 0.22) lr 3.25e-06 gnorm 0.328 2.86s mem 81.1GB +[2026-09-14 10:10:39] step 66/5000 loss 0.2010 (w 0.2126 mse 0.2385 t 966 new 0.19) lr 3.30e-06 gnorm 0.189 3.42s mem 81.1GB +[2026-09-14 10:10:42] step 67/5000 loss 0.3015 (w 0.1624 mse 0.1684 t 739 new 0.06) lr 3.35e-06 gnorm 0.220 3.15s mem 81.1GB +[2026-09-14 10:10:45] step 68/5000 loss 0.3260 (w 0.2212 mse 0.2189 t 853 new 0.10) lr 3.40e-06 gnorm 0.656 2.85s mem 81.1GB +[2026-09-14 10:10:47] step 69/5000 loss 0.4437 (w 0.5279 mse 0.5097 t 989 new 0.23) lr 3.45e-06 gnorm 0.291 2.85s mem 81.1GB +[2026-09-14 10:10:50] step 70/5000 loss 0.3574 (w 0.4941 mse 0.5126 t 195 new 0.18) lr 3.50e-06 gnorm 0.718 2.86s mem 81.1GB +[2026-09-14 10:10:54] step 71/5000 loss 0.3822 (w 0.3914 mse 0.3684 t 967 new 0.24) lr 3.55e-06 gnorm 4.229 3.15s mem 81.1GB +[2026-09-14 10:10:57] step 72/5000 loss 0.3968 (w 0.6845 mse 0.6870 t 999 new 0.26) lr 3.60e-06 gnorm 0.279 3.41s mem 81.1GB +[2026-09-14 10:11:00] step 73/5000 loss 0.3655 (w 0.2404 mse 0.2331 t 711 new 0.11) lr 3.65e-06 gnorm 0.884 3.08s mem 81.1GB +[2026-09-14 10:11:03] step 74/5000 loss 0.3534 (w 0.5438 mse 0.5368 t 991 new 0.24) lr 3.70e-06 gnorm 0.216 2.85s mem 81.1GB +[2026-09-14 10:11:06] step 75/5000 loss 0.3527 (w 0.3017 mse 0.2958 t 929 new 0.08) lr 3.75e-06 gnorm 1.956 2.83s mem 81.1GB +[2026-09-14 10:11:09] step 76/5000 loss 0.3276 (w 0.5558 mse 0.5689 t 306 new 0.19) lr 3.80e-06 gnorm 0.248 3.03s mem 81.1GB +[2026-09-14 10:11:12] step 77/5000 loss 0.4286 (w 0.4759 mse 0.4858 t 264 new 0.24) lr 3.85e-06 gnorm 0.274 3.14s mem 81.1GB +[2026-09-14 10:11:15] step 78/5000 loss 0.3042 (w 0.3522 mse 0.3383 t 965 new 0.23) lr 3.90e-06 gnorm 0.233 3.61s mem 81.1GB +[2026-09-14 10:11:19] step 79/5000 loss 0.4343 (w 0.5199 mse 0.5074 t 999 new 0.19) lr 3.95e-06 gnorm 0.831 3.09s mem 81.1GB +[2026-09-14 10:11:21] step 80/5000 loss 0.3962 (w 0.3452 mse 0.3398 t 958 new 0.16) lr 4.00e-06 gnorm 0.177 2.85s mem 81.1GB +[2026-09-14 10:11:24] step 81/5000 loss 0.2057 (w 0.3970 mse 0.3972 t 977 new 0.22) lr 4.05e-06 gnorm 0.189 2.86s mem 81.1GB +[2026-09-14 10:11:27] step 82/5000 loss 0.3371 (w 0.2923 mse 0.2934 t 947 new 0.21) lr 4.10e-06 gnorm 0.220 2.86s mem 81.1GB +[2026-09-14 10:11:31] step 83/5000 loss 0.4596 (w 0.5083 mse 0.4994 t 264 new 0.22) lr 4.15e-06 gnorm 0.185 3.40s mem 81.1GB +[2026-09-14 10:11:34] step 84/5000 loss 0.4669 (w 0.3894 mse 0.3964 t 795 new 0.25) lr 4.20e-06 gnorm 0.495 3.40s mem 81.1GB +[2026-09-14 10:11:37] step 85/5000 loss 0.1128 (w 0.2663 mse 0.2707 t 968 new 0.23) lr 4.25e-06 gnorm 0.229 2.87s mem 81.1GB +[2026-09-14 10:11:40] step 86/5000 loss 0.1858 (w 0.4567 mse 0.4517 t 995 new 0.19) lr 4.30e-06 gnorm 0.181 2.85s mem 81.1GB +[2026-09-14 10:11:43] step 87/5000 loss 0.2157 (w 0.3112 mse 0.2989 t 985 new 0.14) lr 4.35e-06 gnorm 0.795 2.85s mem 81.1GB +[2026-09-14 10:11:45] step 88/5000 loss 0.4460 (w 0.2486 mse 0.2366 t 668 new 0.12) lr 4.40e-06 gnorm 0.189 2.85s mem 81.1GB +[2026-09-14 10:11:49] step 89/5000 loss 0.1111 (w 0.3293 mse 0.3347 t 925 new 0.20) lr 4.45e-06 gnorm 0.164 3.43s mem 81.1GB +[2026-09-14 10:11:52] step 90/5000 loss 0.2262 (w 0.5411 mse 0.5296 t 980 new 0.24) lr 4.50e-06 gnorm 0.909 3.43s mem 81.1GB +[2026-09-14 10:11:55] step 91/5000 loss 0.3623 (w 0.4301 mse 0.4182 t 768 new 0.23) lr 4.55e-06 gnorm 0.189 2.83s mem 81.1GB +[2026-09-14 10:11:58] step 92/5000 loss 0.6060 (w 0.3032 mse 0.3032 t 804 new 0.19) lr 4.60e-06 gnorm 0.215 2.84s mem 81.1GB +[2026-09-14 10:12:01] step 93/5000 loss 0.2749 (w 0.2239 mse 0.2363 t 737 new 0.11) lr 4.65e-06 gnorm 0.241 2.85s mem 81.1GB +[2026-09-14 10:12:04] step 94/5000 loss 0.3862 (w 0.1665 mse 0.1929 t 564 new 0.19) lr 4.70e-06 gnorm 0.382 2.86s mem 81.1GB +[2026-09-14 10:12:07] step 95/5000 loss 0.3081 (w 0.2650 mse 0.2682 t 929 new 0.18) lr 4.75e-06 gnorm 0.227 3.64s mem 81.1GB +[2026-09-14 10:12:10] step 96/5000 loss 0.2426 (w 0.4234 mse 0.4359 t 985 new 0.22) lr 4.80e-06 gnorm 0.600 3.17s mem 81.1GB +[2026-09-14 10:12:13] step 97/5000 loss 0.2893 (w 0.4623 mse 0.4443 t 973 new 0.22) lr 4.85e-06 gnorm 0.255 2.86s mem 81.1GB +[2026-09-14 10:12:16] step 98/5000 loss 0.4345 (w 0.3897 mse 0.3975 t 551 new 0.23) lr 4.90e-06 gnorm 1.586 2.86s mem 81.1GB +[2026-09-14 10:12:19] step 99/5000 loss 0.3379 (w 0.1957 mse 0.2119 t 807 new 0.19) lr 4.95e-06 gnorm 0.156 2.86s mem 81.1GB +[2026-09-14 10:12:22] step 100/5000 loss 0.4540 (w 0.3373 mse 0.3332 t 861 new 0.20) lr 5.00e-06 gnorm 0.172 2.85s mem 81.1GB +[2026-09-14 10:12:26] step 101/5000 loss 0.2996 (w 0.2863 mse 0.2873 t 923 new 0.22) lr 5.05e-06 gnorm 0.178 3.67s mem 81.1GB +[2026-09-14 10:12:29] step 102/5000 loss 0.3822 (w 0.3545 mse 0.3649 t 850 new 0.20) lr 5.10e-06 gnorm 0.230 3.07s mem 81.1GB +[2026-09-14 10:12:32] step 103/5000 loss 0.3137 (w 0.1595 mse 0.1749 t 629 new 0.20) lr 5.15e-06 gnorm 0.177 2.85s mem 81.1GB +[2026-09-14 10:12:35] step 104/5000 loss 0.1996 (w 0.2940 mse 0.3038 t 992 new 0.14) lr 5.20e-06 gnorm 0.140 2.86s mem 81.1GB +[2026-09-14 10:12:37] step 105/5000 loss 0.2048 (w 0.1580 mse 0.1623 t 892 new 0.23) lr 5.25e-06 gnorm 0.182 2.85s mem 81.1GB +[2026-09-14 10:12:41] step 106/5000 loss 0.2622 (w 0.3017 mse 0.3113 t 980 new 0.12) lr 5.30e-06 gnorm 2.489 3.15s mem 81.1GB +[2026-09-14 10:12:44] step 107/5000 loss 0.4543 (w 0.2351 mse 0.2415 t 864 new 0.22) lr 5.35e-06 gnorm 0.218 3.46s mem 81.1GB +[2026-09-14 10:12:47] step 108/5000 loss 0.2435 (w 0.6203 mse 0.5894 t 981 new 0.23) lr 5.40e-06 gnorm 0.215 3.09s mem 81.1GB +[2026-09-14 10:12:50] step 109/5000 loss 0.3149 (w 0.1908 mse 0.2173 t 984 new 0.21) lr 5.45e-06 gnorm 0.180 2.85s mem 81.1GB +[2026-09-14 10:12:53] step 110/5000 loss 0.5239 (w 0.4164 mse 0.4034 t 915 new 0.21) lr 5.50e-06 gnorm 0.269 2.84s mem 81.1GB +[2026-09-14 10:12:56] step 111/5000 loss 0.2503 (w 0.3199 mse 0.3133 t 869 new 0.22) lr 5.55e-06 gnorm 0.237 2.84s mem 81.1GB +[2026-09-14 10:12:59] step 112/5000 loss 0.2550 (w 0.4324 mse 0.4264 t 985 new 0.18) lr 5.60e-06 gnorm 0.146 3.05s mem 81.1GB +[2026-09-14 10:13:02] step 113/5000 loss 0.3229 (w 0.2215 mse 0.2383 t 927 new 0.27) lr 5.65e-06 gnorm 0.183 3.45s mem 81.1GB +[2026-09-14 10:13:05] step 114/5000 loss 0.4666 (w 0.2984 mse 0.2909 t 776 new 0.20) lr 5.70e-06 gnorm 0.213 2.85s mem 81.1GB +[2026-09-14 10:13:08] step 115/5000 loss 0.2823 (w 0.4064 mse 0.3888 t 995 new 0.13) lr 5.75e-06 gnorm 0.136 2.87s mem 81.1GB +[2026-09-14 10:13:11] step 116/5000 loss 0.4260 (w 0.3397 mse 0.3377 t 750 new 0.21) lr 5.80e-06 gnorm 0.228 2.85s mem 81.1GB +[2026-09-14 10:13:14] step 117/5000 loss 0.3537 (w 0.3117 mse 0.3282 t 647 new 0.23) lr 5.85e-06 gnorm 0.208 2.85s mem 81.1GB +[2026-09-14 10:13:17] step 118/5000 loss 0.4365 (w 0.3298 mse 0.3254 t 899 new 0.18) lr 5.90e-06 gnorm 0.251 3.13s mem 81.1GB +[2026-09-14 10:13:20] step 119/5000 loss 0.2991 (w 0.4657 mse 0.4611 t 989 new 0.21) lr 5.95e-06 gnorm 0.413 3.54s mem 81.1GB +[2026-09-14 10:13:23] step 120/5000 loss 0.3501 (w 0.3830 mse 0.3727 t 955 new 0.19) lr 6.00e-06 gnorm 0.152 2.85s mem 81.1GB +[2026-09-14 10:13:26] step 121/5000 loss 0.3811 (w 0.3842 mse 0.3720 t 960 new 0.20) lr 6.05e-06 gnorm 0.319 2.83s mem 81.1GB +[2026-09-14 10:13:29] step 122/5000 loss 0.2177 (w 0.2863 mse 0.2726 t 925 new 0.19) lr 6.10e-06 gnorm 0.193 2.84s mem 81.1GB +[2026-09-14 10:13:32] step 123/5000 loss 0.2634 (w 0.3181 mse 0.3223 t 698 new 0.17) lr 6.15e-06 gnorm 0.569 2.84s mem 81.1GB +[2026-09-14 10:13:35] step 124/5000 loss 0.3855 (w 0.2704 mse 0.2735 t 794 new 0.26) lr 6.20e-06 gnorm 0.265 3.34s mem 81.1GB +[2026-09-14 10:13:38] step 125/5000 loss 0.3770 (w 0.2242 mse 0.2158 t 884 new 0.15) lr 6.25e-06 gnorm 0.397 3.43s mem 81.1GB +[2026-09-14 10:13:41] step 126/5000 loss 0.4231 (w 0.2533 mse 0.2344 t 905 new 0.15) lr 6.30e-06 gnorm 0.132 2.85s mem 81.1GB +[2026-09-14 10:13:44] step 127/5000 loss 0.3607 (w 0.2896 mse 0.2955 t 935 new 0.20) lr 6.35e-06 gnorm 0.158 2.86s mem 81.1GB +[2026-09-14 10:13:47] step 128/5000 loss 0.3098 (w 0.2124 mse 0.2079 t 788 new 0.22) lr 6.40e-06 gnorm 0.177 2.86s mem 81.1GB +[2026-09-14 10:13:50] step 129/5000 loss 0.3650 (w 0.3816 mse 0.3928 t 383 new 0.21) lr 6.45e-06 gnorm 0.599 2.85s mem 81.1GB +[2026-09-14 10:13:53] step 130/5000 loss 0.4048 (w 0.1898 mse 0.1855 t 774 new 0.22) lr 6.50e-06 gnorm 0.199 3.39s mem 81.1GB +[2026-09-14 10:13:57] step 131/5000 loss 0.3782 (w 0.4312 mse 0.4331 t 375 new 0.25) lr 6.55e-06 gnorm 0.155 3.39s mem 81.1GB +[2026-09-14 10:13:59] step 132/5000 loss 0.3745 (w 0.2679 mse 0.2715 t 919 new 0.24) lr 6.60e-06 gnorm 0.283 2.85s mem 81.1GB +[2026-09-14 10:14:02] step 133/5000 loss 0.2460 (w 0.2563 mse 0.2582 t 730 new 0.25) lr 6.65e-06 gnorm 0.195 2.85s mem 81.1GB +[2026-09-14 10:14:05] step 134/5000 loss 0.5240 (w 0.3537 mse 0.3675 t 662 new 0.27) lr 6.70e-06 gnorm 0.181 2.84s mem 81.1GB +[2026-09-14 10:14:08] step 135/5000 loss 0.4219 (w 0.3893 mse 0.3795 t 626 new 0.19) lr 6.75e-06 gnorm 0.267 3.16s mem 81.1GB +[2026-09-14 10:14:12] step 136/5000 loss 0.2848 (w 0.3328 mse 0.3234 t 728 new 0.19) lr 6.80e-06 gnorm 0.164 3.39s mem 81.1GB +[2026-09-14 10:14:15] step 137/5000 loss 0.3908 (w 0.3502 mse 0.3421 t 807 new 0.26) lr 6.85e-06 gnorm 0.218 3.10s mem 81.1GB +[2026-09-14 10:14:18] step 138/5000 loss 0.2642 (w 0.2798 mse 0.2836 t 988 new 0.27) lr 6.90e-06 gnorm 1.126 2.85s mem 81.1GB +[2026-09-14 10:14:21] step 139/5000 loss 0.2751 (w 0.2741 mse 0.2822 t 816 new 0.24) lr 6.95e-06 gnorm 0.252 2.85s mem 81.1GB +[2026-09-14 10:14:23] step 140/5000 loss 0.3060 (w 0.7059 mse 0.7127 t 183 new 0.26) lr 7.00e-06 gnorm 0.136 2.86s mem 81.1GB +[2026-09-14 10:14:27] step 141/5000 loss 0.3503 (w 0.2854 mse 0.2893 t 629 new 0.21) lr 7.05e-06 gnorm 0.205 3.09s mem 81.1GB +[2026-09-14 10:14:30] step 142/5000 loss 0.1897 (w 0.2530 mse 0.2408 t 971 new 0.14) lr 7.10e-06 gnorm 0.156 3.33s mem 81.1GB +[2026-09-14 10:14:33] step 143/5000 loss 0.3988 (w 0.3798 mse 0.3827 t 968 new 0.22) lr 7.15e-06 gnorm 0.315 3.12s mem 81.1GB +[2026-09-14 10:14:36] step 144/5000 loss 0.5453 (w 0.2968 mse 0.3016 t 722 new 0.19) lr 7.20e-06 gnorm 0.860 2.85s mem 81.1GB +[2026-09-14 10:14:39] step 145/5000 loss 0.1846 (w 0.1395 mse 0.1411 t 980 new 0.10) lr 7.25e-06 gnorm 0.227 2.84s mem 81.1GB +[2026-09-14 10:14:42] step 146/5000 loss 0.1612 (w 0.2596 mse 0.2552 t 959 new 0.23) lr 7.30e-06 gnorm 0.203 2.84s mem 81.1GB +[2026-09-14 10:14:45] step 147/5000 loss 0.3400 (w 0.3767 mse 0.3916 t 301 new 0.18) lr 7.35e-06 gnorm 0.144 3.61s mem 81.1GB +[2026-09-14 10:14:49] step 148/5000 loss 0.3231 (w 0.5320 mse 0.5266 t 993 new 0.14) lr 7.40e-06 gnorm 0.233 3.39s mem 81.1GB +[2026-09-14 10:14:51] step 149/5000 loss 0.2870 (w 0.3157 mse 0.3105 t 624 new 0.24) lr 7.45e-06 gnorm 0.163 2.83s mem 81.1GB +[2026-09-14 10:14:54] step 150/5000 loss 0.2175 (w 0.2978 mse 0.2980 t 941 new 0.21) lr 7.50e-06 gnorm 0.182 2.85s mem 81.1GB +[2026-09-14 10:14:57] step 151/5000 loss 0.2659 (w 0.2773 mse 0.2708 t 905 new 0.22) lr 7.55e-06 gnorm 0.192 2.85s mem 81.1GB +[2026-09-14 10:15:00] step 152/5000 loss 0.2522 (w 0.2609 mse 0.2702 t 946 new 0.15) lr 7.60e-06 gnorm 0.159 2.85s mem 81.1GB +[2026-09-14 10:15:04] step 153/5000 loss 0.4329 (w 0.3698 mse 0.3596 t 965 new 0.22) lr 7.65e-06 gnorm 0.295 3.60s mem 81.1GB +[2026-09-14 10:15:07] step 154/5000 loss 0.2310 (w 0.2809 mse 0.2692 t 835 new 0.26) lr 7.70e-06 gnorm 0.163 3.55s mem 81.1GB +[2026-09-14 10:15:10] step 155/5000 loss 0.3405 (w 0.2739 mse 0.2776 t 828 new 0.22) lr 7.75e-06 gnorm 0.323 2.86s mem 81.1GB +[2026-09-14 10:15:13] step 156/5000 loss 0.3376 (w 0.2103 mse 0.2234 t 971 new 0.22) lr 7.80e-06 gnorm 0.180 2.85s mem 81.1GB +[2026-09-14 10:15:16] step 157/5000 loss 0.0803 (w 0.1731 mse 0.1870 t 905 new 0.10) lr 7.85e-06 gnorm 0.136 2.86s mem 81.1GB +[2026-09-14 10:15:19] step 158/5000 loss 0.5152 (w 0.2462 mse 0.2423 t 814 new 0.22) lr 7.90e-06 gnorm 0.227 2.86s mem 81.1GB +[2026-09-14 10:15:22] step 159/5000 loss 0.0977 (w 0.3580 mse 0.3512 t 992 new 0.17) lr 7.95e-06 gnorm 0.192 3.45s mem 81.1GB +[2026-09-14 10:15:26] step 160/5000 loss 0.4523 (w 0.3122 mse 0.3115 t 951 new 0.19) lr 8.00e-06 gnorm 1.709 3.63s mem 81.1GB +[2026-09-14 10:15:29] step 161/5000 loss 0.3057 (w 0.2789 mse 0.2659 t 865 new 0.20) lr 8.05e-06 gnorm 0.191 2.84s mem 81.1GB +[2026-09-14 10:15:31] step 162/5000 loss 0.2401 (w 0.5059 mse 0.5162 t 288 new 0.22) lr 8.10e-06 gnorm 0.159 2.85s mem 81.1GB +[2026-09-14 10:15:34] step 163/5000 loss 0.3599 (w 0.2653 mse 0.2723 t 955 new 0.21) lr 8.15e-06 gnorm 0.256 2.86s mem 81.1GB +[2026-09-14 10:15:37] step 164/5000 loss 0.4516 (w 0.2749 mse 0.2751 t 698 new 0.25) lr 8.20e-06 gnorm 0.302 3.13s mem 81.1GB +[2026-09-14 10:15:41] step 165/5000 loss 0.3504 (w 0.2964 mse 0.2853 t 861 new 0.19) lr 8.25e-06 gnorm 0.274 3.36s mem 81.1GB +[2026-09-14 10:15:44] step 166/5000 loss 0.3640 (w 0.2145 mse 0.2200 t 677 new 0.21) lr 8.30e-06 gnorm 0.154 3.17s mem 81.1GB +[2026-09-14 10:15:47] step 167/5000 loss 0.1866 (w 0.1894 mse 0.1872 t 768 new 0.23) lr 8.35e-06 gnorm 0.592 2.84s mem 81.1GB +[2026-09-14 10:15:50] step 168/5000 loss 0.2538 (w 0.2615 mse 0.2543 t 828 new 0.27) lr 8.40e-06 gnorm 0.174 2.86s mem 81.1GB +[2026-09-14 10:15:53] step 169/5000 loss 0.4088 (w 0.3044 mse 0.3135 t 964 new 0.18) lr 8.45e-06 gnorm 0.243 2.85s mem 81.1GB +[2026-09-14 10:15:56] step 170/5000 loss 0.2084 (w 0.2997 mse 0.2908 t 955 new 0.25) lr 8.50e-06 gnorm 0.231 3.12s mem 81.1GB +[2026-09-14 10:15:59] step 171/5000 loss 0.2935 (w 0.2549 mse 0.2700 t 794 new 0.13) lr 8.55e-06 gnorm 0.151 3.59s mem 81.1GB +[2026-09-14 10:16:03] step 172/5000 loss 0.4331 (w 0.7124 mse 0.7201 t 165 new 0.12) lr 8.60e-06 gnorm 0.173 3.40s mem 81.1GB +[2026-09-14 10:16:05] step 173/5000 loss 0.4222 (w 0.2808 mse 0.2912 t 648 new 0.15) lr 8.65e-06 gnorm 0.225 2.85s mem 81.1GB +[2026-09-14 10:16:08] step 174/5000 loss 0.4926 (w 0.3494 mse 0.3449 t 659 new 0.23) lr 8.70e-06 gnorm 0.170 2.86s mem 81.1GB +[2026-09-14 10:16:11] step 175/5000 loss 0.2882 (w 0.2737 mse 0.2718 t 709 new 0.17) lr 8.75e-06 gnorm 0.481 2.85s mem 81.1GB +[2026-09-14 10:16:14] step 176/5000 loss 0.3496 (w 0.2748 mse 0.2679 t 959 new 0.24) lr 8.80e-06 gnorm 0.155 3.13s mem 81.1GB +[2026-09-14 10:16:18] step 177/5000 loss 0.3720 (w 0.3124 mse 0.2981 t 912 new 0.12) lr 8.85e-06 gnorm 0.209 3.61s mem 81.1GB +[2026-09-14 10:16:21] step 178/5000 loss 0.2066 (w 0.4497 mse 0.4425 t 976 new 0.17) lr 8.90e-06 gnorm 0.189 3.07s mem 81.1GB +[2026-09-14 10:16:24] step 179/5000 loss 0.2791 (w 0.1785 mse 0.1907 t 902 new 0.26) lr 8.95e-06 gnorm 0.280 2.84s mem 81.1GB +[2026-09-14 10:16:27] step 180/5000 loss 0.2662 (w 0.2204 mse 0.2291 t 924 new 0.19) lr 9.00e-06 gnorm 0.196 2.84s mem 81.1GB +[2026-09-14 10:16:30] step 181/5000 loss 0.3470 (w 0.1994 mse 0.1905 t 864 new 0.20) lr 9.05e-06 gnorm 0.149 2.84s mem 81.1GB +[2026-09-14 10:16:33] step 182/5000 loss 0.3427 (w 0.3115 mse 0.2999 t 742 new 0.23) lr 9.10e-06 gnorm 0.768 3.09s mem 81.1GB +[2026-09-14 10:16:36] step 183/5000 loss 0.3997 (w 0.3071 mse 0.3059 t 934 new 0.15) lr 9.15e-06 gnorm 0.514 3.57s mem 81.1GB +[2026-09-14 10:16:39] step 184/5000 loss 0.3915 (w 0.3554 mse 0.3667 t 992 new 0.09) lr 9.20e-06 gnorm 0.196 3.03s mem 81.1GB +[2026-09-14 10:16:42] step 185/5000 loss 0.4247 (w 0.3115 mse 0.2988 t 629 new 0.24) lr 9.25e-06 gnorm 0.179 2.84s mem 81.1GB +[2026-09-14 10:16:45] step 186/5000 loss 0.4660 (w 0.5799 mse 0.5827 t 120 new 0.24) lr 9.30e-06 gnorm 0.162 2.85s mem 81.1GB +[2026-09-14 10:16:48] step 187/5000 loss 0.2322 (w 0.1964 mse 0.2055 t 885 new 0.23) lr 9.35e-06 gnorm 0.243 2.85s mem 81.1GB +[2026-09-14 10:16:51] step 188/5000 loss 0.2233 (w 0.2200 mse 0.2285 t 902 new 0.21) lr 9.40e-06 gnorm 0.144 3.30s mem 81.1GB +[2026-09-14 10:16:55] step 189/5000 loss 0.4319 (w 0.4711 mse 0.4549 t 1000 new 0.19) lr 9.45e-06 gnorm 0.256 3.44s mem 81.1GB +[2026-09-14 10:16:58] step 190/5000 loss 0.1883 (w 0.4845 mse 0.5169 t 982 new 0.18) lr 9.50e-06 gnorm 0.149 3.06s mem 81.1GB +[2026-09-14 10:17:00] step 191/5000 loss 0.2264 (w 0.3960 mse 0.3939 t 961 new 0.18) lr 9.55e-06 gnorm 0.188 2.83s mem 81.1GB +[2026-09-14 10:17:03] step 192/5000 loss 0.2489 (w 0.3299 mse 0.3251 t 936 new 0.22) lr 9.60e-06 gnorm 0.141 2.84s mem 81.1GB +[2026-09-14 10:17:06] step 193/5000 loss 0.1559 (w 0.2782 mse 0.2644 t 933 new 0.16) lr 9.65e-06 gnorm 0.201 2.84s mem 81.1GB +[2026-09-14 10:17:10] step 194/5000 loss 0.3213 (w 0.2599 mse 0.2485 t 797 new 0.26) lr 9.70e-06 gnorm 0.662 3.41s mem 81.1GB +[2026-09-14 10:17:13] step 195/5000 loss 0.3077 (w 0.2050 mse 0.2188 t 884 new 0.13) lr 9.75e-06 gnorm 0.183 3.48s mem 81.1GB +[2026-09-14 10:17:16] step 196/5000 loss 0.4824 (w 0.3265 mse 0.3197 t 648 new 0.20) lr 9.80e-06 gnorm 0.720 3.13s mem 81.1GB +[2026-09-14 10:17:19] step 197/5000 loss 0.2614 (w 0.5364 mse 0.5289 t 971 new 0.20) lr 9.85e-06 gnorm 0.183 2.86s mem 81.1GB +[2026-09-14 10:17:22] step 198/5000 loss 0.1360 (w 0.2257 mse 0.2326 t 811 new 0.10) lr 9.90e-06 gnorm 0.143 2.86s mem 81.1GB +[2026-09-14 10:17:25] step 199/5000 loss 0.4941 (w 0.2442 mse 0.2392 t 508 new 0.21) lr 9.95e-06 gnorm 0.413 2.86s mem 81.1GB +[2026-09-14 10:17:28] step 200/5000 loss 0.3911 (w 0.7264 mse 0.7169 t 140 new 0.26) lr 1.00e-05 gnorm 0.138 3.43s mem 81.1GB +[2026-09-14 10:17:32] step 201/5000 loss 0.3964 (w 0.2569 mse 0.2577 t 730 new 0.19) lr 1.00e-05 gnorm 0.152 3.40s mem 81.1GB +[2026-09-14 10:17:35] step 202/5000 loss 0.3347 (w 0.4034 mse 0.3921 t 447 new 0.19) lr 1.00e-05 gnorm 0.260 3.12s mem 81.1GB +[2026-09-14 10:17:38] step 203/5000 loss 0.1886 (w 0.2210 mse 0.2195 t 871 new 0.16) lr 1.00e-05 gnorm 0.173 2.85s mem 81.1GB +[2026-09-14 10:17:40] step 204/5000 loss 0.2721 (w 0.2906 mse 0.2818 t 895 new 0.12) lr 1.00e-05 gnorm 0.270 2.85s mem 81.1GB +[2026-09-14 10:17:44] step 205/5000 loss 0.2460 (w 0.3507 mse 0.3520 t 931 new 0.20) lr 1.00e-05 gnorm 0.218 3.12s mem 81.1GB +[2026-09-14 10:17:47] step 206/5000 loss 0.3336 (w 0.5145 mse 0.5058 t 996 new 0.22) lr 1.00e-05 gnorm 0.180 3.33s mem 81.1GB +[2026-09-14 10:17:50] step 207/5000 loss 0.3080 (w 0.1863 mse 0.1843 t 868 new 0.22) lr 1.00e-05 gnorm 0.216 3.35s mem 81.1GB +[2026-09-14 10:17:53] step 208/5000 loss 0.3249 (w 0.3141 mse 0.3293 t 967 new 0.23) lr 1.00e-05 gnorm 0.141 2.85s mem 81.1GB +[2026-09-14 10:17:56] step 209/5000 loss 0.2254 (w 0.2726 mse 0.2651 t 802 new 0.19) lr 1.00e-05 gnorm 0.200 2.86s mem 81.1GB +[2026-09-14 10:17:59] step 210/5000 loss 0.2824 (w 0.3084 mse 0.3238 t 344 new 0.22) lr 1.00e-05 gnorm 0.218 2.84s mem 81.1GB +[2026-09-14 10:18:02] step 211/5000 loss 0.1226 (w 0.3272 mse 0.3377 t 992 new 0.10) lr 1.00e-05 gnorm 0.180 3.04s mem 81.1GB +[2026-09-14 10:18:05] step 212/5000 loss 0.4205 (w 0.3450 mse 0.3376 t 528 new 0.26) lr 1.00e-05 gnorm 0.162 3.38s mem 81.1GB +[2026-09-14 10:18:10] step 213/5000 loss 0.0962 (w 0.4233 mse 0.4426 t 994 new 0.17) lr 1.00e-05 gnorm 0.171 4.37s mem 81.1GB +[2026-09-14 10:18:12] step 214/5000 loss 0.3360 (w 0.2978 mse 0.2993 t 968 new 0.05) lr 1.00e-05 gnorm 0.180 2.85s mem 81.1GB +[2026-09-14 10:18:15] step 215/5000 loss 0.2217 (w 0.2113 mse 0.1973 t 898 new 0.22) lr 1.00e-05 gnorm 0.147 2.86s mem 81.1GB +[2026-09-14 10:18:18] step 216/5000 loss 0.3162 (w 0.3479 mse 0.3576 t 904 new 0.21) lr 1.00e-05 gnorm 0.355 2.86s mem 81.1GB +[2026-09-14 10:18:21] step 217/5000 loss 0.3771 (w 0.3106 mse 0.2975 t 791 new 0.28) lr 1.00e-05 gnorm 0.199 3.11s mem 81.1GB +[2026-09-14 10:18:25] step 218/5000 loss 0.1844 (w 0.1467 mse 0.1486 t 760 new 0.20) lr 1.00e-05 gnorm 0.156 3.47s mem 81.1GB +[2026-09-14 10:18:28] step 219/5000 loss 0.2923 (w 0.1965 mse 0.1981 t 748 new 0.25) lr 1.00e-05 gnorm 0.144 3.12s mem 81.1GB +[2026-09-14 10:18:31] step 220/5000 loss 0.3083 (w 0.2697 mse 0.2661 t 866 new 0.23) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +[2026-09-14 10:18:34] step 221/5000 loss 0.2387 (w 0.2061 mse 0.2062 t 768 new 0.21) lr 1.00e-05 gnorm 0.205 2.84s mem 81.1GB +[2026-09-14 10:18:36] step 222/5000 loss 0.3572 (w 0.2224 mse 0.2260 t 914 new 0.08) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-14 10:18:39] step 223/5000 loss 0.3061 (w 0.2669 mse 0.2631 t 917 new 0.07) lr 1.00e-05 gnorm 0.147 3.03s mem 81.1GB +[2026-09-14 10:18:43] step 224/5000 loss 0.4151 (w 0.3152 mse 0.2977 t 950 new 0.23) lr 1.00e-05 gnorm 0.161 3.57s mem 81.1GB +[2026-09-14 10:18:46] step 225/5000 loss 0.0853 (w 0.5918 mse 0.5614 t 997 new 0.25) lr 1.00e-05 gnorm 0.224 3.04s mem 81.1GB +[2026-09-14 10:18:49] step 226/5000 loss 0.3007 (w 0.3024 mse 0.3004 t 912 new 0.24) lr 1.00e-05 gnorm 0.190 2.84s mem 81.1GB +[2026-09-14 10:18:52] step 227/5000 loss 0.1985 (w 0.3786 mse 0.3640 t 971 new 0.21) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +[2026-09-14 10:18:55] step 228/5000 loss 0.3743 (w 0.4051 mse 0.3979 t 998 new 0.22) lr 1.00e-05 gnorm 0.270 2.85s mem 81.1GB +[2026-09-14 10:18:58] step 229/5000 loss 0.1937 (w 0.2593 mse 0.2701 t 980 new 0.11) lr 1.00e-05 gnorm 0.204 3.26s mem 81.1GB +[2026-09-14 10:19:02] step 230/5000 loss 0.1284 (w 0.1805 mse 0.1876 t 922 new 0.24) lr 1.00e-05 gnorm 0.177 3.70s mem 81.1GB +[2026-09-14 10:19:05] step 231/5000 loss 0.1476 (w 0.3310 mse 0.3204 t 859 new 0.15) lr 1.00e-05 gnorm 0.194 3.05s mem 81.1GB +[2026-09-14 10:19:08] step 232/5000 loss 0.5343 (w 0.3668 mse 0.3608 t 985 new 0.22) lr 1.00e-05 gnorm 0.261 2.85s mem 81.1GB +[2026-09-14 10:19:10] step 233/5000 loss 0.2443 (w 0.2551 mse 0.2525 t 858 new 0.27) lr 1.00e-05 gnorm 0.133 2.86s mem 81.1GB +[2026-09-14 10:19:13] step 234/5000 loss 0.3288 (w 0.3885 mse 0.3906 t 964 new 0.18) lr 1.00e-05 gnorm 0.302 2.86s mem 81.1GB +[2026-09-14 10:19:17] step 235/5000 loss 0.3703 (w 0.2522 mse 0.2911 t 999 new 0.20) lr 1.00e-05 gnorm 0.221 3.38s mem 81.1GB +[2026-09-14 10:19:20] step 236/5000 loss 0.2469 (w 0.3355 mse 0.3479 t 957 new 0.18) lr 1.00e-05 gnorm 0.314 3.45s mem 81.1GB +[2026-09-14 10:19:23] step 237/5000 loss 0.2776 (w 0.2903 mse 0.2743 t 846 new 0.18) lr 1.00e-05 gnorm 0.181 3.08s mem 81.1GB +[2026-09-14 10:19:26] step 238/5000 loss 0.3251 (w 0.1943 mse 0.1932 t 760 new 0.10) lr 1.00e-05 gnorm 0.210 2.83s mem 81.1GB +[2026-09-14 10:19:29] step 239/5000 loss 0.1921 (w 0.2287 mse 0.2403 t 352 new 0.09) lr 1.00e-05 gnorm 0.230 2.85s mem 81.1GB +[2026-09-14 10:19:32] step 240/5000 loss 0.3614 (w 0.2528 mse 0.2379 t 654 new 0.14) lr 1.00e-05 gnorm 0.167 3.02s mem 81.1GB +[2026-09-14 10:19:35] step 241/5000 loss 0.4915 (w 0.3318 mse 0.3249 t 525 new 0.22) lr 1.00e-05 gnorm 0.213 3.32s mem 81.1GB +[2026-09-14 10:19:39] step 242/5000 loss 0.2324 (w 0.2949 mse 0.3014 t 957 new 0.21) lr 1.00e-05 gnorm 0.180 3.51s mem 81.1GB +[2026-09-14 10:19:42] step 243/5000 loss 0.3165 (w 0.2958 mse 0.2959 t 848 new 0.20) lr 1.00e-05 gnorm 0.208 3.12s mem 81.1GB +[2026-09-14 10:19:45] step 244/5000 loss 0.5036 (w 0.2191 mse 0.2217 t 546 new 0.23) lr 1.00e-05 gnorm 0.221 2.83s mem 81.1GB +[2026-09-14 10:19:47] step 245/5000 loss 0.3186 (w 0.2754 mse 0.2785 t 473 new 0.11) lr 1.00e-05 gnorm 0.787 2.84s mem 81.1GB +[2026-09-14 10:19:51] step 246/5000 loss 0.3579 (w 0.4378 mse 0.4242 t 368 new 0.23) lr 1.00e-05 gnorm 0.317 3.04s mem 81.1GB +[2026-09-14 10:19:54] step 247/5000 loss 0.3161 (w 0.6410 mse 0.6050 t 991 new 0.22) lr 1.00e-05 gnorm 0.175 3.29s mem 81.1GB +[2026-09-14 10:19:57] step 248/5000 loss 0.3831 (w 0.3108 mse 0.2979 t 751 new 0.22) lr 1.00e-05 gnorm 0.171 3.65s mem 81.1GB +[2026-09-14 10:20:00] step 249/5000 loss 0.3049 (w 0.3090 mse 0.3216 t 323 new 0.25) lr 1.00e-05 gnorm 0.195 2.85s mem 81.1GB +[2026-09-14 10:20:03] step 250/5000 loss 0.2290 (w 0.2432 mse 0.2527 t 476 new 0.12) lr 1.00e-05 gnorm 0.158 2.85s mem 81.1GB +[2026-09-14 10:20:06] step 251/5000 loss 0.3895 (w 0.2977 mse 0.2966 t 660 new 0.18) lr 1.00e-05 gnorm 0.139 2.86s mem 81.1GB +[2026-09-14 10:20:09] step 252/5000 loss 0.2284 (w 0.3163 mse 0.3150 t 899 new 0.23) lr 1.00e-05 gnorm 0.167 3.04s mem 81.1GB +[2026-09-14 10:20:13] step 253/5000 loss 0.3826 (w 0.2714 mse 0.2601 t 663 new 0.27) lr 1.00e-05 gnorm 0.174 3.44s mem 81.1GB +[2026-09-14 10:20:16] step 254/5000 loss 0.2572 (w 0.2703 mse 0.2675 t 906 new 0.20) lr 1.00e-05 gnorm 0.167 3.45s mem 81.1GB +[2026-09-14 10:20:19] step 255/5000 loss 0.4237 (w 0.2561 mse 0.2567 t 735 new 0.21) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +[2026-09-14 10:20:22] step 256/5000 loss 0.1916 (w 0.1372 mse 0.1437 t 969 new 0.13) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +[2026-09-14 10:20:25] step 257/5000 loss 0.1500 (w 0.1982 mse 0.1962 t 734 new 0.12) lr 1.00e-05 gnorm 0.197 2.85s mem 81.1GB +[2026-09-14 10:20:28] step 258/5000 loss 0.3177 (w 0.3399 mse 0.3298 t 936 new 0.25) lr 1.00e-05 gnorm 0.192 3.08s mem 81.1GB +[2026-09-14 10:20:31] step 259/5000 loss 0.2830 (w 0.2839 mse 0.2806 t 856 new 0.23) lr 1.00e-05 gnorm 0.175 3.08s mem 81.1GB +[2026-09-14 10:20:34] step 260/5000 loss 0.4098 (w 0.1868 mse 0.2039 t 760 new 0.17) lr 1.00e-05 gnorm 0.135 3.45s mem 81.1GB +[2026-09-14 10:20:37] step 261/5000 loss 0.3744 (w 0.3024 mse 0.2979 t 744 new 0.20) lr 1.00e-05 gnorm 0.221 2.85s mem 81.1GB +[2026-09-14 10:20:40] step 262/5000 loss 0.1506 (w 0.2783 mse 0.2663 t 927 new 0.22) lr 1.00e-05 gnorm 0.713 2.86s mem 81.1GB +[2026-09-14 10:20:43] step 263/5000 loss 0.2526 (w 0.3728 mse 0.3607 t 952 new 0.22) lr 1.00e-05 gnorm 0.168 2.86s mem 81.1GB +[2026-09-14 10:20:46] step 264/5000 loss 0.1724 (w 0.1891 mse 0.1957 t 693 new 0.23) lr 1.00e-05 gnorm 0.163 3.41s mem 81.1GB +[2026-09-14 10:20:49] step 265/5000 loss 0.3875 (w 0.2897 mse 0.3083 t 935 new 0.26) lr 1.00e-05 gnorm 2.454 3.08s mem 81.1GB +[2026-09-14 10:20:53] step 266/5000 loss 0.1413 (w 0.2425 mse 0.2438 t 768 new 0.16) lr 1.00e-05 gnorm 0.195 3.73s mem 81.1GB +[2026-09-14 10:20:56] step 267/5000 loss 0.2547 (w 0.3805 mse 0.3850 t 988 new 0.15) lr 1.00e-05 gnorm 0.175 2.85s mem 81.1GB +[2026-09-14 10:20:59] step 268/5000 loss 0.2492 (w 0.2213 mse 0.2268 t 989 new 0.18) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +[2026-09-14 10:21:02] step 269/5000 loss 0.3160 (w 0.4882 mse 0.4926 t 976 new 0.18) lr 1.00e-05 gnorm 0.178 2.86s mem 81.1GB +[2026-09-14 10:21:05] step 270/5000 loss 0.2865 (w 0.2796 mse 0.2803 t 916 new 0.15) lr 1.00e-05 gnorm 0.452 3.39s mem 81.1GB +[2026-09-14 10:21:08] step 271/5000 loss 0.2835 (w 0.3315 mse 0.3166 t 700 new 0.28) lr 1.00e-05 gnorm 0.261 3.09s mem 81.1GB +[2026-09-14 10:21:12] step 272/5000 loss 0.3366 (w 0.3229 mse 0.3225 t 958 new 0.08) lr 1.00e-05 gnorm 0.220 3.62s mem 81.1GB +[2026-09-14 10:21:15] step 273/5000 loss 0.3078 (w 0.1884 mse 0.1861 t 989 new 0.22) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +[2026-09-14 10:21:17] step 274/5000 loss 0.3375 (w 0.2408 mse 0.2395 t 974 new 0.16) lr 1.00e-05 gnorm 0.665 2.85s mem 81.1GB +[2026-09-14 10:21:20] step 275/5000 loss 0.3727 (w 0.2836 mse 0.2821 t 709 new 0.19) lr 1.00e-05 gnorm 0.199 2.85s mem 81.1GB +[2026-09-14 10:21:24] step 276/5000 loss 0.2048 (w 0.3794 mse 0.4120 t 153 new 0.16) lr 1.00e-05 gnorm 0.146 3.28s mem 81.1GB +[2026-09-14 10:21:27] step 277/5000 loss 0.3245 (w 0.1582 mse 0.1573 t 749 new 0.20) lr 1.00e-05 gnorm 0.168 3.37s mem 81.1GB +[2026-09-14 10:21:31] step 278/5000 loss 0.3657 (w 0.1842 mse 0.1988 t 927 new 0.20) lr 1.00e-05 gnorm 0.160 3.45s mem 81.1GB +[2026-09-14 10:21:33] step 279/5000 loss 0.2563 (w 0.3233 mse 0.3033 t 983 new 0.23) lr 1.00e-05 gnorm 0.201 2.85s mem 81.1GB +[2026-09-14 10:21:36] step 280/5000 loss 0.4307 (w 0.4868 mse 0.4997 t 159 new 0.21) lr 1.00e-05 gnorm 0.201 2.84s mem 81.1GB +[2026-09-14 10:21:39] step 281/5000 loss 0.2929 (w 0.3004 mse 0.3096 t 297 new 0.29) lr 1.00e-05 gnorm 0.176 2.85s mem 81.1GB +[2026-09-14 10:21:42] step 282/5000 loss 0.1334 (w 0.1836 mse 0.1833 t 905 new 0.20) lr 1.00e-05 gnorm 0.152 3.40s mem 81.1GB +[2026-09-14 10:21:46] step 283/5000 loss 0.3935 (w 0.4644 mse 0.4575 t 383 new 0.19) lr 1.00e-05 gnorm 0.174 3.09s mem 81.1GB +[2026-09-14 10:21:49] step 284/5000 loss 0.1067 (w 0.1761 mse 0.1848 t 985 new 0.12) lr 1.00e-05 gnorm 0.145 3.52s mem 81.1GB +[2026-09-14 10:21:52] step 285/5000 loss 0.2760 (w 0.2215 mse 0.2302 t 951 new 0.08) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +[2026-09-14 10:21:55] step 286/5000 loss 0.2472 (w 0.2184 mse 0.2340 t 411 new 0.22) lr 1.00e-05 gnorm 0.129 2.85s mem 81.1GB +[2026-09-14 10:21:58] step 287/5000 loss 0.3801 (w 0.2908 mse 0.2740 t 920 new 0.21) lr 1.00e-05 gnorm 0.185 3.08s mem 81.1GB +[2026-09-14 10:22:01] step 288/5000 loss 0.2547 (w 0.1448 mse 0.1505 t 683 new 0.23) lr 1.00e-05 gnorm 0.129 3.34s mem 81.1GB +[2026-09-14 10:22:05] step 289/5000 loss 0.3462 (w 0.3011 mse 0.2884 t 903 new 0.23) lr 1.00e-05 gnorm 0.163 3.38s mem 81.1GB +[2026-09-14 10:22:08] step 290/5000 loss 0.0863 (w 0.3164 mse 0.3047 t 937 new 0.24) lr 1.00e-05 gnorm 0.162 3.28s mem 81.1GB +[2026-09-14 10:22:11] step 291/5000 loss 0.3008 (w 0.2336 mse 0.2318 t 948 new 0.20) lr 1.00e-05 gnorm 0.156 2.85s mem 81.1GB +[2026-09-14 10:22:14] step 292/5000 loss 0.1553 (w 0.2021 mse 0.2089 t 945 new 0.25) lr 1.00e-05 gnorm 0.573 2.86s mem 81.1GB +[2026-09-14 10:22:17] step 293/5000 loss 0.3642 (w 0.2524 mse 0.2642 t 551 new 0.23) lr 1.00e-05 gnorm 0.226 3.11s mem 81.1GB +[2026-09-14 10:22:20] step 294/5000 loss 0.2259 (w 0.1922 mse 0.2112 t 955 new 0.14) lr 1.00e-05 gnorm 0.205 3.24s mem 81.1GB +[2026-09-14 10:22:23] step 295/5000 loss 0.2320 (w 0.2677 mse 0.2604 t 610 new 0.26) lr 1.00e-05 gnorm 0.155 3.36s mem 81.1GB +[2026-09-14 10:22:27] step 296/5000 loss 0.1102 (w 0.4511 mse 0.4609 t 997 new 0.17) lr 1.00e-05 gnorm 0.314 3.22s mem 81.1GB +[2026-09-14 10:22:29] step 297/5000 loss 0.2814 (w 0.4093 mse 0.4026 t 970 new 0.19) lr 1.00e-05 gnorm 0.213 2.85s mem 81.1GB +[2026-09-14 10:22:32] step 298/5000 loss 0.2858 (w 0.2094 mse 0.2238 t 861 new 0.22) lr 1.00e-05 gnorm 0.210 2.86s mem 81.1GB +[2026-09-14 10:22:36] step 299/5000 loss 0.3502 (w 0.3085 mse 0.2852 t 933 new 0.20) lr 1.00e-05 gnorm 0.175 3.34s mem 81.1GB +[2026-09-14 10:22:39] step 300/5000 loss 0.3558 (w 0.2942 mse 0.2817 t 732 new 0.18) lr 1.00e-05 gnorm 0.203 3.30s mem 81.1GB +[2026-09-14 10:22:42] step 301/5000 loss 0.1624 (w 0.3861 mse 0.3898 t 991 new 0.25) lr 1.00e-05 gnorm 0.216 3.40s mem 81.1GB +[2026-09-14 10:22:45] step 302/5000 loss 0.2519 (w 0.6680 mse 0.6663 t 177 new 0.22) lr 1.00e-05 gnorm 0.228 3.15s mem 81.1GB +[2026-09-14 10:22:48] step 303/5000 loss 0.3118 (w 0.2203 mse 0.2234 t 712 new 0.14) lr 1.00e-05 gnorm 0.299 2.84s mem 81.1GB +[2026-09-14 10:22:51] step 304/5000 loss 0.3110 (w 0.2080 mse 0.2060 t 762 new 0.16) lr 1.00e-05 gnorm 0.172 2.85s mem 81.1GB +[2026-09-14 10:22:54] step 305/5000 loss 0.2827 (w 0.1677 mse 0.1649 t 847 new 0.20) lr 1.00e-05 gnorm 0.206 3.28s mem 81.1GB +[2026-09-14 10:22:58] step 306/5000 loss 0.2333 (w 0.1993 mse 0.1969 t 962 new 0.25) lr 1.00e-05 gnorm 0.385 3.34s mem 81.1GB +[2026-09-14 10:23:01] step 307/5000 loss 0.2118 (w 0.2692 mse 0.2704 t 982 new 0.27) lr 1.00e-05 gnorm 0.246 3.39s mem 81.1GB +[2026-09-14 10:23:04] step 308/5000 loss 0.1777 (w 0.2795 mse 0.2673 t 936 new 0.20) lr 1.00e-05 gnorm 0.159 3.17s mem 81.1GB +[2026-09-14 10:23:07] step 309/5000 loss 0.1724 (w 0.3693 mse 0.3757 t 476 new 0.23) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +[2026-09-14 10:23:10] step 310/5000 loss 0.2895 (w 0.2201 mse 0.2075 t 835 new 0.18) lr 1.00e-05 gnorm 0.255 2.85s mem 81.1GB +[2026-09-14 10:23:13] step 311/5000 loss 0.3946 (w 0.3644 mse 0.3602 t 601 new 0.25) lr 1.00e-05 gnorm 0.231 3.12s mem 81.1GB +[2026-09-14 10:23:17] step 312/5000 loss 0.3180 (w 0.2251 mse 0.2203 t 665 new 0.22) lr 1.00e-05 gnorm 0.237 3.31s mem 81.1GB +[2026-09-14 10:23:20] step 313/5000 loss 0.4086 (w 0.2933 mse 0.2896 t 932 new 0.20) lr 1.00e-05 gnorm 2.888 3.39s mem 81.1GB +[2026-09-14 10:23:23] step 314/5000 loss 0.2523 (w 0.2194 mse 0.2421 t 836 new 0.25) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +[2026-09-14 10:23:26] step 315/5000 loss 0.3137 (w 0.5135 mse 0.5269 t 195 new 0.09) lr 1.00e-05 gnorm 0.224 2.85s mem 81.1GB +[2026-09-14 10:23:29] step 316/5000 loss 0.2842 (w 0.2099 mse 0.2112 t 764 new 0.20) lr 1.00e-05 gnorm 0.182 3.04s mem 81.1GB +[2026-09-14 10:23:32] step 317/5000 loss 0.2433 (w 0.2625 mse 0.2540 t 979 new 0.23) lr 1.00e-05 gnorm 0.155 3.38s mem 81.1GB +[2026-09-14 10:23:35] step 318/5000 loss 0.1341 (w 0.2260 mse 0.2123 t 897 new 0.26) lr 1.00e-05 gnorm 0.160 3.27s mem 81.1GB +[2026-09-14 10:23:39] step 319/5000 loss 0.2394 (w 0.2650 mse 0.2607 t 821 new 0.21) lr 1.00e-05 gnorm 0.336 3.43s mem 81.1GB +[2026-09-14 10:23:42] step 320/5000 loss 0.2227 (w 0.3418 mse 0.3339 t 918 new 0.18) lr 1.00e-05 gnorm 0.378 2.84s mem 81.1GB +[2026-09-14 10:23:45] step 321/5000 loss 0.1697 (w 0.2735 mse 0.2718 t 983 new 0.22) lr 1.00e-05 gnorm 0.187 2.84s mem 81.1GB +[2026-09-14 10:23:48] step 322/5000 loss 0.2111 (w 0.1538 mse 0.1655 t 977 new 0.19) lr 1.00e-05 gnorm 0.215 3.12s mem 81.1GB +[2026-09-14 10:23:51] step 323/5000 loss 0.1891 (w 0.2556 mse 0.2818 t 999 new 0.18) lr 1.00e-05 gnorm 0.208 3.15s mem 81.1GB +[2026-09-14 10:23:54] step 324/5000 loss 0.2111 (w 0.3634 mse 0.3683 t 997 new 0.16) lr 1.00e-05 gnorm 0.278 3.31s mem 81.1GB +[2026-09-14 10:23:57] step 325/5000 loss 0.0934 (w 0.4998 mse 0.5006 t 998 new 0.24) lr 1.00e-05 gnorm 0.183 3.13s mem 81.1GB +[2026-09-14 10:24:00] step 326/5000 loss 0.3606 (w 0.3459 mse 0.3266 t 983 new 0.22) lr 1.00e-05 gnorm 0.202 2.85s mem 81.1GB +[2026-09-14 10:24:03] step 327/5000 loss 0.2206 (w 0.3288 mse 0.3278 t 943 new 0.13) lr 1.00e-05 gnorm 0.263 2.85s mem 81.1GB +[2026-09-14 10:24:06] step 328/5000 loss 0.3017 (w 0.2755 mse 0.2656 t 986 new 0.21) lr 1.00e-05 gnorm 0.250 3.37s mem 81.1GB +[2026-09-14 10:24:10] step 329/5000 loss 0.2500 (w 0.5223 mse 0.4832 t 967 new 0.22) lr 1.00e-05 gnorm 0.206 3.27s mem 81.1GB +[2026-09-14 10:24:13] step 330/5000 loss 0.1346 (w 0.2626 mse 0.2698 t 974 new 0.26) lr 1.00e-05 gnorm 0.158 3.29s mem 81.1GB +[2026-09-14 10:24:16] step 331/5000 loss 0.4181 (w 0.2678 mse 0.2565 t 891 new 0.18) lr 1.00e-05 gnorm 0.177 3.18s mem 81.1GB +[2026-09-14 10:24:19] step 332/5000 loss 0.1579 (w 0.1953 mse 0.1977 t 951 new 0.19) lr 1.00e-05 gnorm 0.142 2.85s mem 81.1GB +[2026-09-14 10:24:22] step 333/5000 loss 0.3110 (w 0.1410 mse 0.1517 t 843 new 0.23) lr 1.00e-05 gnorm 0.716 2.84s mem 81.1GB +[2026-09-14 10:24:25] step 334/5000 loss 0.1435 (w 0.4050 mse 0.3793 t 991 new 0.23) lr 1.00e-05 gnorm 0.260 3.36s mem 81.1GB +[2026-09-14 10:24:28] step 335/5000 loss 0.3355 (w 0.2873 mse 0.2698 t 720 new 0.20) lr 1.00e-05 gnorm 4.637 3.33s mem 81.1GB +[2026-09-14 10:24:32] step 336/5000 loss 0.2481 (w 0.1824 mse 0.1991 t 973 new 0.24) lr 1.00e-05 gnorm 0.198 3.34s mem 81.1GB +[2026-09-14 10:24:35] step 337/5000 loss 0.3317 (w 0.4004 mse 0.3923 t 356 new 0.19) lr 1.00e-05 gnorm 0.222 3.25s mem 81.1GB +[2026-09-14 10:24:38] step 338/5000 loss 0.0789 (w 0.1683 mse 0.1825 t 973 new 0.19) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +[2026-09-14 10:24:41] step 339/5000 loss 0.2771 (w 0.2718 mse 0.2675 t 931 new 0.23) lr 1.00e-05 gnorm 0.178 2.85s mem 81.1GB +[2026-09-14 10:24:44] step 340/5000 loss 0.3147 (w 0.3138 mse 0.3131 t 984 new 0.08) lr 1.00e-05 gnorm 0.197 3.31s mem 81.1GB +[2026-09-14 10:24:47] step 341/5000 loss 0.4048 (w 0.2794 mse 0.2694 t 779 new 0.27) lr 1.00e-05 gnorm 0.192 3.11s mem 81.1GB +[2026-09-14 10:24:51] step 342/5000 loss 0.1373 (w 0.2647 mse 0.2535 t 996 new 0.25) lr 1.00e-05 gnorm 0.327 3.72s mem 81.1GB +[2026-09-14 10:24:54] step 343/5000 loss 0.3099 (w 0.2597 mse 0.2672 t 809 new 0.18) lr 1.00e-05 gnorm 0.158 3.18s mem 81.1GB +[2026-09-14 10:24:57] step 344/5000 loss 0.2485 (w 0.2789 mse 0.2619 t 944 new 0.29) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +[2026-09-14 10:25:00] step 345/5000 loss 0.2919 (w 0.3222 mse 0.3202 t 495 new 0.23) lr 1.00e-05 gnorm 0.275 2.86s mem 81.1GB +[2026-09-14 10:25:03] step 346/5000 loss 0.4546 (w 0.2563 mse 0.2565 t 586 new 0.27) lr 1.00e-05 gnorm 0.207 3.60s mem 81.1GB +[2026-09-14 10:25:07] step 347/5000 loss 0.2573 (w 0.2010 mse 0.2184 t 889 new 0.20) lr 1.00e-05 gnorm 0.200 3.25s mem 81.1GB +[2026-09-14 10:25:10] step 348/5000 loss 0.2043 (w 0.2804 mse 0.2672 t 964 new 0.21) lr 1.00e-05 gnorm 0.231 3.14s mem 81.1GB +[2026-09-14 10:25:13] step 349/5000 loss 0.4227 (w 0.2561 mse 0.2590 t 737 new 0.24) lr 1.00e-05 gnorm 0.142 3.20s mem 81.1GB +[2026-09-14 10:25:16] step 350/5000 loss 0.3548 (w 0.3807 mse 0.3641 t 983 new 0.24) lr 1.00e-05 gnorm 0.319 2.86s mem 81.1GB +[2026-09-14 10:25:19] step 351/5000 loss 0.4891 (w 0.2315 mse 0.2254 t 843 new 0.26) lr 1.00e-05 gnorm 0.270 3.16s mem 81.1GB +[2026-09-14 10:25:22] step 352/5000 loss 0.2703 (w 0.1587 mse 0.1662 t 930 new 0.26) lr 1.00e-05 gnorm 0.179 3.32s mem 81.1GB +[2026-09-14 10:25:26] step 353/5000 loss 0.2142 (w 0.3986 mse 0.3969 t 974 new 0.17) lr 1.00e-05 gnorm 1.550 3.30s mem 81.1GB +[2026-09-14 10:25:29] step 354/5000 loss 0.3422 (w 0.2161 mse 0.2158 t 568 new 0.23) lr 1.00e-05 gnorm 0.177 3.45s mem 81.1GB +[2026-09-14 10:25:32] step 355/5000 loss 0.2575 (w 0.2564 mse 0.2480 t 920 new 0.23) lr 1.00e-05 gnorm 0.158 2.85s mem 81.1GB +[2026-09-14 10:25:35] step 356/5000 loss 0.2743 (w 0.3341 mse 0.3112 t 903 new 0.27) lr 1.00e-05 gnorm 0.212 2.85s mem 81.1GB +[2026-09-14 10:25:38] step 357/5000 loss 0.1697 (w 0.1482 mse 0.1519 t 779 new 0.12) lr 1.00e-05 gnorm 0.170 3.11s mem 81.1GB +[2026-09-14 10:25:41] step 358/5000 loss 0.3228 (w 0.2981 mse 0.2793 t 922 new 0.17) lr 1.00e-05 gnorm 0.211 3.04s mem 81.1GB +[2026-09-14 10:25:44] step 359/5000 loss 0.2533 (w 0.1649 mse 0.1670 t 609 new 0.26) lr 1.00e-05 gnorm 0.233 3.11s mem 81.1GB +[2026-09-14 10:25:48] step 360/5000 loss 0.1480 (w 0.2086 mse 0.1984 t 784 new 0.25) lr 1.00e-05 gnorm 0.180 3.45s mem 81.1GB +[2026-09-14 10:25:51] step 361/5000 loss 0.3242 (w 0.2527 mse 0.2469 t 739 new 0.22) lr 1.00e-05 gnorm 0.170 2.85s mem 81.1GB +[2026-09-14 10:25:53] step 362/5000 loss 0.2274 (w 0.2628 mse 0.2527 t 774 new 0.23) lr 1.00e-05 gnorm 0.199 2.85s mem 81.1GB +[2026-09-14 10:25:57] step 363/5000 loss 0.2632 (w 0.1808 mse 0.1799 t 925 new 0.24) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +[2026-09-14 10:26:00] step 364/5000 loss 0.3672 (w 0.2496 mse 0.2407 t 705 new 0.17) lr 1.00e-05 gnorm 0.330 3.27s mem 81.1GB +[2026-09-14 10:26:03] step 365/5000 loss 0.3776 (w 0.3723 mse 0.3646 t 428 new 0.21) lr 1.00e-05 gnorm 0.479 3.11s mem 81.1GB +[2026-09-14 10:26:06] step 366/5000 loss 0.2574 (w 0.2321 mse 0.2301 t 951 new 0.24) lr 1.00e-05 gnorm 0.137 3.15s mem 81.1GB +[2026-09-14 10:26:09] step 367/5000 loss 0.2654 (w 0.1716 mse 0.1722 t 660 new 0.17) lr 1.00e-05 gnorm 0.200 2.86s mem 81.1GB +[2026-09-14 10:26:12] step 368/5000 loss 0.1046 (w 0.2439 mse 0.2364 t 952 new 0.20) lr 1.00e-05 gnorm 0.132 2.86s mem 81.1GB +[2026-09-14 10:26:15] step 369/5000 loss 0.2710 (w 0.1517 mse 0.1477 t 687 new 0.22) lr 1.00e-05 gnorm 0.185 3.16s mem 81.1GB +[2026-09-14 10:26:18] step 370/5000 loss 0.1951 (w 0.3103 mse 0.2923 t 953 new 0.17) lr 1.00e-05 gnorm 0.177 3.06s mem 81.1GB +[2026-09-14 10:26:21] step 371/5000 loss 0.3059 (w 0.2378 mse 0.2123 t 852 new 0.22) lr 1.00e-05 gnorm 0.151 3.11s mem 81.1GB +[2026-09-14 10:26:24] step 372/5000 loss 0.3260 (w 0.4072 mse 0.3831 t 954 new 0.17) lr 1.00e-05 gnorm 0.123 3.09s mem 81.1GB +[2026-09-14 10:26:27] step 373/5000 loss 0.1297 (w 0.2616 mse 0.2596 t 925 new 0.24) lr 1.00e-05 gnorm 0.206 2.85s mem 81.1GB +[2026-09-14 10:26:30] step 374/5000 loss 0.1932 (w 0.2844 mse 0.2831 t 817 new 0.20) lr 1.00e-05 gnorm 0.536 2.84s mem 81.1GB +[2026-09-14 10:26:34] step 375/5000 loss 0.1058 (w 0.2866 mse 0.2829 t 976 new 0.10) lr 1.00e-05 gnorm 0.161 3.49s mem 81.1GB +[2026-09-14 10:26:37] step 376/5000 loss 0.2993 (w 0.3735 mse 0.3566 t 894 new 0.22) lr 1.00e-05 gnorm 0.152 3.08s mem 81.1GB +[2026-09-14 10:26:40] step 377/5000 loss 0.4193 (w 0.5894 mse 0.5855 t 165 new 0.21) lr 1.00e-05 gnorm 0.195 3.10s mem 81.1GB +[2026-09-14 10:26:43] step 378/5000 loss 0.2247 (w 0.2877 mse 0.2842 t 854 new 0.14) lr 1.00e-05 gnorm 0.325 3.15s mem 81.1GB +[2026-09-14 10:26:46] step 379/5000 loss 0.1634 (w 0.3006 mse 0.2949 t 945 new 0.25) lr 1.00e-05 gnorm 0.320 2.84s mem 81.1GB +[2026-09-14 10:26:49] step 380/5000 loss 0.2772 (w 0.2260 mse 0.2265 t 981 new 0.25) lr 1.00e-05 gnorm 0.161 2.85s mem 81.1GB +[2026-09-14 10:26:52] step 381/5000 loss 0.3557 (w 0.3907 mse 0.3833 t 955 new 0.18) lr 1.00e-05 gnorm 0.226 3.59s mem 81.1GB +[2026-09-14 10:26:56] step 382/5000 loss 0.2851 (w 0.1974 mse 0.1852 t 663 new 0.23) lr 1.00e-05 gnorm 0.150 3.35s mem 81.1GB +[2026-09-14 10:26:59] step 383/5000 loss 0.2218 (w 0.2169 mse 0.2159 t 709 new 0.24) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +[2026-09-14 10:27:02] step 384/5000 loss 0.2923 (w 0.2357 mse 0.2493 t 470 new 0.24) lr 1.00e-05 gnorm 0.202 3.20s mem 81.1GB +[2026-09-14 10:27:05] step 385/5000 loss 0.2827 (w 0.1595 mse 0.1687 t 914 new 0.16) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +[2026-09-14 10:27:08] step 386/5000 loss 0.2968 (w 0.2558 mse 0.2697 t 944 new 0.20) lr 1.00e-05 gnorm 0.191 3.15s mem 81.1GB +[2026-09-14 10:27:11] step 387/5000 loss 0.3273 (w 0.1644 mse 0.1674 t 673 new 0.29) lr 1.00e-05 gnorm 0.169 3.11s mem 81.1GB +[2026-09-14 10:27:14] step 388/5000 loss 0.1912 (w 0.1668 mse 0.1651 t 819 new 0.24) lr 1.00e-05 gnorm 0.234 3.32s mem 81.1GB +[2026-09-14 10:27:18] step 389/5000 loss 0.2280 (w 0.2243 mse 0.2381 t 979 new 0.14) lr 1.00e-05 gnorm 0.185 3.13s mem 81.1GB +[2026-09-14 10:27:21] step 390/5000 loss 0.1457 (w 0.2085 mse 0.2228 t 838 new 0.11) lr 1.00e-05 gnorm 0.138 3.18s mem 81.1GB +[2026-09-14 10:27:24] step 391/5000 loss 0.4228 (w 0.2028 mse 0.2047 t 902 new 0.09) lr 1.00e-05 gnorm 0.262 2.85s mem 81.1GB +[2026-09-14 10:27:27] step 392/5000 loss 0.2409 (w 0.3427 mse 0.3432 t 977 new 0.21) lr 1.00e-05 gnorm 0.183 3.16s mem 81.1GB +[2026-09-14 10:27:30] step 393/5000 loss 0.3248 (w 0.4800 mse 0.4852 t 274 new 0.25) lr 1.00e-05 gnorm 0.217 3.11s mem 81.1GB +[2026-09-14 10:27:33] step 394/5000 loss 0.2375 (w 0.3136 mse 0.3100 t 634 new 0.24) lr 1.00e-05 gnorm 0.299 3.10s mem 81.1GB +[2026-09-14 10:27:37] step 395/5000 loss 0.2507 (w 0.3297 mse 0.3386 t 993 new 0.24) lr 1.00e-05 gnorm 0.131 3.91s mem 81.1GB +[2026-09-14 10:27:40] step 396/5000 loss 0.4106 (w 0.2976 mse 0.3113 t 997 new 0.21) lr 1.00e-05 gnorm 0.175 2.86s mem 81.1GB +[2026-09-14 10:27:43] step 397/5000 loss 0.2776 (w 0.3360 mse 0.3339 t 925 new 0.21) lr 1.00e-05 gnorm 0.165 2.85s mem 81.1GB +[2026-09-14 10:27:46] step 398/5000 loss 0.3557 (w 0.2537 mse 0.2522 t 503 new 0.16) lr 1.00e-05 gnorm 0.163 3.08s mem 81.1GB +[2026-09-14 10:27:49] step 399/5000 loss 0.2145 (w 0.1652 mse 0.1674 t 629 new 0.29) lr 1.00e-05 gnorm 0.187 3.42s mem 81.1GB +[2026-09-14 10:27:52] step 400/5000 loss 0.2272 (w 0.1970 mse 0.2056 t 849 new 0.19) lr 1.00e-05 gnorm 0.165 3.11s mem 81.1GB +[2026-09-14 10:27:56] step 401/5000 loss 0.3335 (w 0.3282 mse 0.3265 t 853 new 0.11) lr 1.00e-05 gnorm 0.354 3.57s mem 81.1GB +[2026-09-14 10:27:59] step 402/5000 loss 0.3494 (w 0.3827 mse 0.3623 t 991 new 0.26) lr 1.00e-05 gnorm 0.689 2.84s mem 81.1GB +[2026-09-14 10:28:01] step 403/5000 loss 0.1761 (w 0.1547 mse 0.1581 t 721 new 0.17) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +[2026-09-14 10:28:05] step 404/5000 loss 0.2868 (w 0.1133 mse 0.1335 t 687 new 0.24) lr 1.00e-05 gnorm 0.227 3.10s mem 81.1GB +[2026-09-14 10:28:08] step 405/5000 loss 0.2172 (w 0.1660 mse 0.1707 t 910 new 0.18) lr 1.00e-05 gnorm 0.180 3.34s mem 81.1GB +[2026-09-14 10:28:11] step 406/5000 loss 0.2461 (w 0.2633 mse 0.2595 t 925 new 0.12) lr 1.00e-05 gnorm 0.189 2.85s mem 81.1GB +[2026-09-14 10:28:14] step 407/5000 loss 0.1615 (w 0.2928 mse 0.2716 t 969 new 0.26) lr 1.00e-05 gnorm 0.200 3.58s mem 81.1GB +[2026-09-14 10:28:17] step 408/5000 loss 0.1788 (w 0.1800 mse 0.1960 t 887 new 0.16) lr 1.00e-05 gnorm 0.128 2.85s mem 81.1GB +[2026-09-14 10:28:20] step 409/5000 loss 0.2918 (w 0.2328 mse 0.2277 t 742 new 0.27) lr 1.00e-05 gnorm 0.223 2.86s mem 81.1GB +[2026-09-14 10:28:23] step 410/5000 loss 0.2893 (w 0.2169 mse 0.2201 t 940 new 0.16) lr 1.00e-05 gnorm 0.160 3.14s mem 81.1GB +[2026-09-14 10:28:27] step 411/5000 loss 0.3374 (w 0.2883 mse 0.2860 t 725 new 0.24) lr 1.00e-05 gnorm 0.139 3.38s mem 81.1GB +[2026-09-14 10:28:30] step 412/5000 loss 0.1881 (w 0.1888 mse 0.1869 t 990 new 0.15) lr 1.00e-05 gnorm 0.129 2.86s mem 81.1GB +[2026-09-14 10:28:33] step 413/5000 loss 0.1918 (w 0.7390 mse 0.7239 t 999 new 0.23) lr 1.00e-05 gnorm 0.197 3.63s mem 81.1GB +[2026-09-14 10:28:36] step 414/5000 loss 0.3279 (w 0.1672 mse 0.1853 t 932 new 0.20) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +[2026-09-14 10:28:39] step 415/5000 loss 0.3244 (w 0.2319 mse 0.2417 t 817 new 0.17) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +[2026-09-14 10:28:42] step 416/5000 loss 0.4481 (w 0.3393 mse 0.3339 t 961 new 0.15) lr 1.00e-05 gnorm 0.220 3.39s mem 81.1GB +[2026-09-14 10:28:45] step 417/5000 loss 0.3289 (w 0.2955 mse 0.2807 t 594 new 0.23) lr 1.00e-05 gnorm 0.191 3.09s mem 81.1GB +[2026-09-14 10:28:49] step 418/5000 loss 0.2093 (w 0.3062 mse 0.3089 t 971 new 0.25) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +[2026-09-14 10:28:52] step 419/5000 loss 0.2628 (w 0.2110 mse 0.2145 t 948 new 0.23) lr 1.00e-05 gnorm 0.149 3.09s mem 81.1GB +[2026-09-14 10:28:54] step 420/5000 loss 0.1829 (w 0.1574 mse 0.1737 t 692 new 0.17) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +[2026-09-14 10:28:57] step 421/5000 loss 0.1813 (w 0.1251 mse 0.1372 t 557 new 0.19) lr 1.00e-05 gnorm 0.172 2.85s mem 81.1GB +[2026-09-14 10:29:01] step 422/5000 loss 0.3510 (w 0.1667 mse 0.1616 t 813 new 0.23) lr 1.00e-05 gnorm 0.171 3.35s mem 81.1GB +[2026-09-14 10:29:04] step 423/5000 loss 0.2555 (w 0.2233 mse 0.2187 t 931 new 0.18) lr 1.00e-05 gnorm 0.132 3.30s mem 81.1GB +[2026-09-14 10:29:07] step 424/5000 loss 0.2517 (w 0.3047 mse 0.2975 t 835 new 0.25) lr 1.00e-05 gnorm 0.173 3.16s mem 81.1GB +[2026-09-14 10:29:10] step 425/5000 loss 0.3649 (w 0.2564 mse 0.2482 t 794 new 0.26) lr 1.00e-05 gnorm 0.222 3.13s mem 81.1GB +[2026-09-14 10:29:13] step 426/5000 loss 0.1885 (w 0.1407 mse 0.1323 t 672 new 0.24) lr 1.00e-05 gnorm 0.146 2.86s mem 81.1GB +[2026-09-14 10:29:16] step 427/5000 loss 0.2870 (w 0.2611 mse 0.2651 t 715 new 0.23) lr 1.00e-05 gnorm 0.217 2.84s mem 81.1GB +[2026-09-14 10:29:19] step 428/5000 loss 0.1629 (w 0.4922 mse 0.4699 t 978 new 0.18) lr 1.00e-05 gnorm 0.238 3.37s mem 81.1GB +[2026-09-14 10:29:23] step 429/5000 loss 0.4264 (w 0.3352 mse 0.3588 t 995 new 0.13) lr 1.00e-05 gnorm 0.199 3.30s mem 81.1GB +[2026-09-14 10:29:26] step 430/5000 loss 0.2459 (w 0.1787 mse 0.1829 t 935 new 0.17) lr 1.00e-05 gnorm 0.532 3.17s mem 81.1GB +[2026-09-14 10:29:29] step 431/5000 loss 0.2925 (w 0.3174 mse 0.3043 t 890 new 0.21) lr 1.00e-05 gnorm 0.148 3.28s mem 81.1GB +[2026-09-14 10:29:32] step 432/5000 loss 0.2575 (w 0.1531 mse 0.1478 t 822 new 0.16) lr 1.00e-05 gnorm 0.167 2.86s mem 81.1GB +[2026-09-14 10:29:35] step 433/5000 loss 0.2047 (w 0.2156 mse 0.2014 t 783 new 0.17) lr 1.00e-05 gnorm 0.279 3.14s mem 81.1GB +[2026-09-14 10:29:38] step 434/5000 loss 0.2009 (w 0.1496 mse 0.1707 t 932 new 0.23) lr 1.00e-05 gnorm 0.152 3.38s mem 81.1GB +[2026-09-14 10:29:42] step 435/5000 loss 0.2304 (w 0.3202 mse 0.3167 t 586 new 0.22) lr 1.00e-05 gnorm 0.239 3.07s mem 81.1GB +[2026-09-14 10:29:45] step 436/5000 loss 0.3699 (w 0.1870 mse 0.1945 t 830 new 0.13) lr 1.00e-05 gnorm 0.237 3.13s mem 81.1GB +[2026-09-14 10:29:48] step 437/5000 loss 0.1949 (w 0.2750 mse 0.2513 t 803 new 0.22) lr 1.00e-05 gnorm 0.194 3.29s mem 81.1GB +[2026-09-14 10:29:51] step 438/5000 loss 0.1623 (w 0.2403 mse 0.2486 t 450 new 0.21) lr 1.00e-05 gnorm 0.168 2.84s mem 81.1GB +[2026-09-14 10:29:54] step 439/5000 loss 0.1269 (w 0.2735 mse 0.2772 t 997 new 0.22) lr 1.00e-05 gnorm 0.143 3.10s mem 81.1GB +[2026-09-14 10:29:57] step 440/5000 loss 0.3503 (w 0.2599 mse 0.2632 t 977 new 0.24) lr 1.00e-05 gnorm 0.424 3.33s mem 81.1GB +[2026-09-14 10:30:01] step 441/5000 loss 0.2357 (w 0.3108 mse 0.3050 t 614 new 0.25) lr 1.00e-05 gnorm 0.152 3.35s mem 81.1GB +[2026-09-14 10:30:04] step 442/5000 loss 0.2442 (w 0.1102 mse 0.1118 t 790 new 0.22) lr 1.00e-05 gnorm 0.203 3.14s mem 81.1GB +[2026-09-14 10:30:07] step 443/5000 loss 0.2185 (w 0.2016 mse 0.1975 t 935 new 0.14) lr 1.00e-05 gnorm 0.137 3.12s mem 81.1GB +[2026-09-14 10:30:10] step 444/5000 loss 0.2721 (w 0.3059 mse 0.2941 t 601 new 0.21) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +[2026-09-14 10:30:13] step 445/5000 loss 0.2605 (w 0.2458 mse 0.2423 t 836 new 0.18) lr 1.00e-05 gnorm 0.164 3.14s mem 81.1GB +[2026-09-14 10:30:16] step 446/5000 loss 0.2533 (w 0.2716 mse 0.2700 t 798 new 0.23) lr 1.00e-05 gnorm 0.201 3.37s mem 81.1GB +[2026-09-14 10:30:20] step 447/5000 loss 0.1534 (w 0.1372 mse 0.1349 t 929 new 0.20) lr 1.00e-05 gnorm 0.290 3.41s mem 81.1GB +[2026-09-14 10:30:23] step 448/5000 loss 0.3978 (w 0.3224 mse 0.3088 t 605 new 0.23) lr 1.00e-05 gnorm 0.205 2.84s mem 81.1GB +[2026-09-14 10:30:26] step 449/5000 loss 0.2956 (w 0.1930 mse 0.1875 t 924 new 0.16) lr 1.00e-05 gnorm 0.187 3.14s mem 81.1GB +[2026-09-14 10:30:29] step 450/5000 loss 0.3215 (w 0.2580 mse 0.2527 t 728 new 0.28) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +[2026-09-14 10:30:32] step 451/5000 loss 0.3873 (w 0.1453 mse 0.1679 t 969 new 0.20) lr 1.00e-05 gnorm 0.365 3.40s mem 81.1GB +[2026-09-14 10:30:35] step 452/5000 loss 0.3313 (w 0.1738 mse 0.1958 t 650 new 0.24) lr 1.00e-05 gnorm 0.145 3.30s mem 81.1GB +[2026-09-14 10:30:39] step 453/5000 loss 0.2353 (w 0.1971 mse 0.1997 t 741 new 0.16) lr 1.00e-05 gnorm 0.259 3.28s mem 81.1GB +[2026-09-14 10:30:42] step 454/5000 loss 0.2154 (w 0.0732 mse 0.0886 t 885 new 0.19) lr 1.00e-05 gnorm 0.210 3.28s mem 81.1GB +[2026-09-14 10:30:45] step 455/5000 loss 0.2358 (w 0.2510 mse 0.2573 t 732 new 0.15) lr 1.00e-05 gnorm 0.168 2.85s mem 81.1GB +[2026-09-14 10:30:48] step 456/5000 loss 0.3378 (w 0.2553 mse 0.2563 t 528 new 0.26) lr 1.00e-05 gnorm 0.189 2.85s mem 81.1GB +[2026-09-14 10:30:51] step 457/5000 loss 0.3123 (w 0.2644 mse 0.2882 t 982 new 0.21) lr 1.00e-05 gnorm 0.152 3.29s mem 81.1GB +[2026-09-14 10:30:54] step 458/5000 loss 0.2971 (w 0.2730 mse 0.2614 t 878 new 0.23) lr 1.00e-05 gnorm 0.311 3.32s mem 81.1GB +[2026-09-14 10:30:58] step 459/5000 loss 0.2009 (w 0.1386 mse 0.1340 t 754 new 0.12) lr 1.00e-05 gnorm 0.175 3.19s mem 81.1GB +[2026-09-14 10:31:01] step 460/5000 loss 0.2239 (w 0.2086 mse 0.2154 t 865 new 0.24) lr 1.00e-05 gnorm 0.186 3.12s mem 81.1GB +[2026-09-14 10:31:03] step 461/5000 loss 0.2518 (w 0.5731 mse 0.5766 t 990 new 0.20) lr 1.00e-05 gnorm 0.177 2.85s mem 81.1GB +[2026-09-14 10:31:06] step 462/5000 loss 0.4539 (w 0.2956 mse 0.2895 t 964 new 0.24) lr 1.00e-05 gnorm 0.259 2.83s mem 81.1GB +[2026-09-14 10:31:10] step 463/5000 loss 0.1807 (w 0.4105 mse 0.3973 t 959 new 0.18) lr 1.00e-05 gnorm 0.206 3.57s mem 81.1GB +[2026-09-14 10:31:13] step 464/5000 loss 0.1984 (w 0.5237 mse 0.5210 t 120 new 0.27) lr 1.00e-05 gnorm 0.180 3.26s mem 81.1GB +[2026-09-14 10:31:16] step 465/5000 loss 0.4029 (w 0.1432 mse 0.1506 t 774 new 0.23) lr 1.00e-05 gnorm 0.156 3.19s mem 81.1GB +[2026-09-14 10:31:20] step 466/5000 loss 0.2812 (w 0.1409 mse 0.1531 t 936 new 0.20) lr 1.00e-05 gnorm 0.151 3.17s mem 81.1GB +[2026-09-14 10:31:22] step 467/5000 loss 0.1770 (w 0.3426 mse 0.3188 t 938 new 0.24) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +[2026-09-14 10:31:25] step 468/5000 loss 0.3683 (w 0.3721 mse 0.3744 t 332 new 0.24) lr 1.00e-05 gnorm 0.188 2.84s mem 81.1GB +[2026-09-14 10:31:28] step 469/5000 loss 0.1635 (w 0.1555 mse 0.1645 t 871 new 0.19) lr 1.00e-05 gnorm 0.293 3.11s mem 81.1GB +[2026-09-14 10:31:32] step 470/5000 loss 0.1512 (w 0.2576 mse 0.2413 t 941 new 0.23) lr 1.00e-05 gnorm 0.177 3.32s mem 81.1GB +[2026-09-14 10:31:35] step 471/5000 loss 0.3194 (w 0.1499 mse 0.1566 t 914 new 0.12) lr 1.00e-05 gnorm 0.164 3.32s mem 81.1GB +[2026-09-14 10:31:38] step 472/5000 loss 0.3144 (w 0.6630 mse 0.6609 t 189 new 0.20) lr 1.00e-05 gnorm 0.253 3.38s mem 81.1GB +[2026-09-14 10:31:41] step 473/5000 loss 0.3070 (w 0.1730 mse 0.1770 t 864 new 0.21) lr 1.00e-05 gnorm 0.170 2.85s mem 81.1GB +[2026-09-14 10:31:44] step 474/5000 loss 0.2562 (w 0.1482 mse 0.1655 t 386 new 0.17) lr 1.00e-05 gnorm 0.241 3.12s mem 81.1GB +[2026-09-14 10:31:48] step 475/5000 loss 0.3017 (w 0.2782 mse 0.2833 t 985 new 0.22) lr 1.00e-05 gnorm 0.304 3.10s mem 81.1GB +[2026-09-14 10:31:51] step 476/5000 loss 0.3706 (w 0.3164 mse 0.2980 t 492 new 0.20) lr 1.00e-05 gnorm 0.184 3.34s mem 81.1GB +[2026-09-14 10:31:54] step 477/5000 loss 0.2347 (w 0.2900 mse 0.2960 t 310 new 0.07) lr 1.00e-05 gnorm 0.159 3.16s mem 81.1GB +[2026-09-14 10:31:57] step 478/5000 loss 0.1816 (w 0.2428 mse 0.2513 t 975 new 0.22) lr 1.00e-05 gnorm 0.145 3.19s mem 81.1GB +[2026-09-14 10:32:00] step 479/5000 loss 0.1831 (w 0.1767 mse 0.1797 t 942 new 0.10) lr 1.00e-05 gnorm 0.183 2.86s mem 81.1GB +[2026-09-14 10:32:03] step 480/5000 loss 0.2704 (w 0.2437 mse 0.2379 t 871 new 0.17) lr 1.00e-05 gnorm 0.234 3.08s mem 81.1GB +[2026-09-14 10:32:06] step 481/5000 loss 0.3756 (w 0.2844 mse 0.2666 t 915 new 0.26) lr 1.00e-05 gnorm 0.314 3.22s mem 81.1GB +[2026-09-14 10:32:10] step 482/5000 loss 0.3561 (w 0.1461 mse 0.1547 t 811 new 0.13) lr 1.00e-05 gnorm 0.197 3.71s mem 81.1GB +[2026-09-14 10:32:13] step 483/5000 loss 0.2172 (w 0.3420 mse 0.3688 t 997 new 0.19) lr 1.00e-05 gnorm 0.132 3.20s mem 81.1GB +[2026-09-14 10:32:16] step 484/5000 loss 0.1826 (w 0.1139 mse 0.1330 t 809 new 0.22) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +[2026-09-14 10:32:19] step 485/5000 loss 0.2952 (w 0.2314 mse 0.2205 t 925 new 0.24) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +[2026-09-14 10:32:22] step 486/5000 loss 0.1932 (w 0.1992 mse 0.1945 t 930 new 0.14) lr 1.00e-05 gnorm 0.111 3.08s mem 81.1GB +[2026-09-14 10:32:26] step 487/5000 loss 0.1271 (w 0.2340 mse 0.2330 t 905 new 0.22) lr 1.00e-05 gnorm 0.158 3.37s mem 81.1GB +[2026-09-14 10:32:29] step 488/5000 loss 0.2538 (w 0.2976 mse 0.2857 t 864 new 0.24) lr 1.00e-05 gnorm 0.161 3.42s mem 81.1GB +[2026-09-14 10:32:33] step 489/5000 loss 0.1652 (w 0.3126 mse 0.3136 t 909 new 0.14) lr 1.00e-05 gnorm 0.159 3.13s mem 81.1GB +[2026-09-14 10:32:35] step 490/5000 loss 0.1845 (w 0.3156 mse 0.3134 t 989 new 0.17) lr 1.00e-05 gnorm 0.260 2.84s mem 81.1GB +[2026-09-14 10:32:38] step 491/5000 loss 0.2256 (w 0.1943 mse 0.2094 t 892 new 0.19) lr 1.00e-05 gnorm 0.276 2.84s mem 81.1GB +[2026-09-14 10:32:41] step 492/5000 loss 0.3034 (w 0.6543 mse 0.6475 t 153 new 0.20) lr 1.00e-05 gnorm 0.152 3.04s mem 81.1GB +[2026-09-14 10:32:45] step 493/5000 loss 0.2906 (w 0.2487 mse 0.2509 t 970 new 0.16) lr 1.00e-05 gnorm 0.163 3.37s mem 81.1GB +[2026-09-14 10:32:48] step 494/5000 loss 0.1855 (w 0.2800 mse 0.2718 t 699 new 0.24) lr 1.00e-05 gnorm 0.166 3.65s mem 81.1GB +[2026-09-14 10:32:51] step 495/5000 loss 0.2225 (w 0.2096 mse 0.1943 t 857 new 0.23) lr 1.00e-05 gnorm 0.181 3.09s mem 81.1GB +[2026-09-14 10:32:54] step 496/5000 loss 0.1167 (w 0.2747 mse 0.2733 t 950 new 0.23) lr 1.00e-05 gnorm 0.226 2.84s mem 81.1GB +[2026-09-14 10:32:57] step 497/5000 loss 0.1225 (w 0.2347 mse 0.2318 t 771 new 0.26) lr 1.00e-05 gnorm 0.163 2.85s mem 81.1GB +[2026-09-14 10:33:00] step 498/5000 loss 0.1059 (w 0.2824 mse 0.2629 t 953 new 0.17) lr 1.00e-05 gnorm 0.255 3.10s mem 81.1GB +[2026-09-14 10:33:03] step 499/5000 loss 0.2585 (w 0.2681 mse 0.2575 t 809 new 0.17) lr 1.00e-05 gnorm 0.655 3.27s mem 81.1GB +[2026-09-14 10:33:08] step 500/5000 loss 0.2654 (w 0.1602 mse 0.1640 t 692 new 0.16) lr 1.00e-05 gnorm 0.300 4.13s mem 81.1GB +[2026-09-14 10:33:10] [val] step 500 t=200: w=0.4572 mse=0.4694 (n=16) t=500: w=0.2455 mse=0.2505 (n=16) t=800: w=0.1940 mse=0.1950 (n=16) | mean w=0.2989 mse=0.3050 3s +[2026-09-14 10:34:08] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step500.safetensors 4093 个张量 37.98 GB +[2026-09-14 10:34:12] step 501/5000 loss 0.2683 (w 0.1972 mse 0.2059 t 631 new 0.08) lr 1.00e-05 gnorm 0.257 2.84s mem 81.1GB +[2026-09-14 10:34:15] step 502/5000 loss 0.1504 (w 0.2724 mse 0.2633 t 979 new 0.23) lr 1.00e-05 gnorm 0.272 2.83s mem 81.1GB +[2026-09-14 10:34:18] step 503/5000 loss 0.2003 (w 0.2115 mse 0.2094 t 900 new 0.13) lr 1.00e-05 gnorm 0.269 2.82s mem 81.1GB +[2026-09-14 10:34:21] step 504/5000 loss 0.3174 (w 0.3358 mse 0.3280 t 676 new 0.20) lr 1.00e-05 gnorm 0.209 3.15s mem 81.1GB +[2026-09-14 10:34:24] step 505/5000 loss 0.3095 (w 0.1412 mse 0.1404 t 980 new 0.22) lr 1.00e-05 gnorm 0.155 3.33s mem 81.1GB +[2026-09-14 10:34:28] step 506/5000 loss 0.1477 (w 0.1076 mse 0.1127 t 853 new 0.09) lr 1.00e-05 gnorm 0.237 3.52s mem 81.1GB +[2026-09-14 10:34:31] step 507/5000 loss 0.3563 (w 0.2258 mse 0.2312 t 980 new 0.13) lr 1.00e-05 gnorm 0.198 2.83s mem 81.1GB +[2026-09-14 10:34:34] step 508/5000 loss 0.4075 (w 0.2323 mse 0.2186 t 301 new 0.23) lr 1.00e-05 gnorm 0.735 2.84s mem 81.1GB +[2026-09-14 10:34:37] step 509/5000 loss 0.2709 (w 0.2950 mse 0.2809 t 633 new 0.21) lr 1.00e-05 gnorm 0.267 2.85s mem 81.1GB +[2026-09-14 10:34:40] step 510/5000 loss 0.1767 (w 0.4345 mse 0.4375 t 994 new 0.12) lr 1.00e-05 gnorm 0.309 3.10s mem 81.1GB +[2026-09-14 10:34:43] step 511/5000 loss 0.2595 (w 0.3581 mse 0.3443 t 984 new 0.21) lr 1.00e-05 gnorm 0.203 3.57s mem 81.1GB +[2026-09-14 10:34:47] step 512/5000 loss 0.2836 (w 0.1536 mse 0.1521 t 917 new 0.26) lr 1.00e-05 gnorm 0.252 3.36s mem 81.1GB +[2026-09-14 10:34:49] step 513/5000 loss 0.3000 (w 0.4643 mse 0.4618 t 301 new 0.21) lr 1.00e-05 gnorm 0.377 2.84s mem 81.1GB +[2026-09-14 10:34:52] step 514/5000 loss 0.2125 (w 0.1388 mse 0.1299 t 840 new 0.16) lr 1.00e-05 gnorm 0.156 2.86s mem 81.1GB +[2026-09-14 10:34:55] step 515/5000 loss 0.3584 (w 0.2018 mse 0.2137 t 770 new 0.11) lr 1.00e-05 gnorm 0.183 2.85s mem 81.1GB +[2026-09-14 10:34:59] step 516/5000 loss 0.2312 (w 0.3600 mse 0.3532 t 980 new 0.11) lr 1.00e-05 gnorm 0.164 3.40s mem 81.1GB +[2026-09-14 10:35:02] step 517/5000 loss 0.1180 (w 0.3189 mse 0.3073 t 971 new 0.21) lr 1.00e-05 gnorm 0.167 3.47s mem 81.1GB +[2026-09-14 10:35:05] step 518/5000 loss 0.2806 (w 0.3455 mse 0.3269 t 776 new 0.22) lr 1.00e-05 gnorm 0.351 3.32s mem 81.1GB +[2026-09-14 10:35:08] step 519/5000 loss 0.2348 (w 0.2376 mse 0.2551 t 999 new 0.11) lr 1.00e-05 gnorm 0.178 2.84s mem 81.1GB +[2026-09-14 10:35:11] step 520/5000 loss 0.2099 (w 0.2906 mse 0.2869 t 992 new 0.19) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-14 10:35:14] step 521/5000 loss 0.3509 (w 0.3032 mse 0.3091 t 310 new 0.22) lr 1.00e-05 gnorm 0.499 3.02s mem 81.1GB +[2026-09-14 10:35:17] step 522/5000 loss 0.3905 (w 0.1700 mse 0.1826 t 956 new 0.14) lr 1.00e-05 gnorm 0.185 3.35s mem 81.1GB +[2026-09-14 10:35:21] step 523/5000 loss 0.1162 (w 0.4970 mse 0.4692 t 977 new 0.22) lr 1.00e-05 gnorm 0.122 3.53s mem 81.1GB +[2026-09-14 10:35:24] step 524/5000 loss 0.2000 (w 0.5059 mse 0.4857 t 998 new 0.22) lr 1.00e-05 gnorm 0.174 3.29s mem 81.1GB +[2026-09-14 10:35:27] step 525/5000 loss 0.1690 (w 0.2686 mse 0.2691 t 856 new 0.21) lr 1.00e-05 gnorm 0.183 2.84s mem 81.1GB +[2026-09-14 10:35:30] step 526/5000 loss 0.1773 (w 0.2318 mse 0.2232 t 933 new 0.22) lr 1.00e-05 gnorm 0.136 2.85s mem 81.1GB +[2026-09-14 10:35:33] step 527/5000 loss 0.4838 (w 0.2234 mse 0.2234 t 942 new 0.21) lr 1.00e-05 gnorm 0.235 3.05s mem 81.1GB +[2026-09-14 10:35:36] step 528/5000 loss 0.2021 (w 0.1893 mse 0.2157 t 340 new 0.20) lr 1.00e-05 gnorm 0.244 3.07s mem 81.1GB +[2026-09-14 10:35:39] step 529/5000 loss 0.1850 (w 0.3616 mse 0.3814 t 994 new 0.22) lr 1.00e-05 gnorm 0.320 3.30s mem 81.1GB +[2026-09-14 10:35:42] step 530/5000 loss 0.2262 (w 0.2857 mse 0.3011 t 959 new 0.15) lr 1.00e-05 gnorm 0.163 3.07s mem 81.1GB +[2026-09-14 10:35:45] step 531/5000 loss 0.3316 (w 0.0934 mse 0.1010 t 933 new 0.17) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +[2026-09-14 10:35:48] step 532/5000 loss 0.3769 (w 0.1837 mse 0.1787 t 922 new 0.21) lr 1.00e-05 gnorm 0.177 2.85s mem 81.1GB +[2026-09-14 10:35:51] step 533/5000 loss 0.3395 (w 0.4994 mse 0.5127 t 140 new 0.17) lr 1.00e-05 gnorm 0.170 3.35s mem 81.1GB +[2026-09-14 10:35:55] step 534/5000 loss 0.1946 (w 0.1983 mse 0.1972 t 836 new 0.08) lr 1.00e-05 gnorm 0.880 3.11s mem 81.1GB +[2026-09-14 10:35:58] step 535/5000 loss 0.2494 (w 0.3611 mse 0.3436 t 297 new 0.22) lr 1.00e-05 gnorm 0.433 3.55s mem 81.1GB +[2026-09-14 10:36:01] step 536/5000 loss 0.3468 (w 0.2451 mse 0.2640 t 979 new 0.20) lr 1.00e-05 gnorm 0.191 3.14s mem 81.1GB +[2026-09-14 10:36:04] step 537/5000 loss 0.3716 (w 0.3204 mse 0.3222 t 482 new 0.24) lr 1.00e-05 gnorm 0.180 2.84s mem 81.1GB +[2026-09-14 10:36:07] step 538/5000 loss 0.1923 (w 0.2586 mse 0.2493 t 961 new 0.24) lr 1.00e-05 gnorm 0.211 2.84s mem 81.1GB +[2026-09-14 10:36:10] step 539/5000 loss 0.2364 (w 0.1703 mse 0.1751 t 947 new 0.25) lr 1.00e-05 gnorm 0.297 3.41s mem 81.1GB +[2026-09-14 10:36:14] step 540/5000 loss 0.2901 (w 0.3060 mse 0.3004 t 492 new 0.25) lr 1.00e-05 gnorm 0.193 3.42s mem 81.1GB +[2026-09-14 10:36:17] step 541/5000 loss 0.2199 (w 0.1665 mse 0.1732 t 967 new 0.24) lr 1.00e-05 gnorm 0.451 3.45s mem 81.1GB +[2026-09-14 10:36:20] step 542/5000 loss 0.2433 (w 0.3485 mse 0.3505 t 954 new 0.21) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +[2026-09-14 10:36:23] step 543/5000 loss 0.1658 (w 0.2127 mse 0.2115 t 869 new 0.27) lr 1.00e-05 gnorm 0.137 2.85s mem 81.1GB +[2026-09-14 10:36:26] step 544/5000 loss 0.2125 (w 0.2481 mse 0.2266 t 994 new 0.25) lr 1.00e-05 gnorm 0.212 2.85s mem 81.1GB +[2026-09-14 10:36:29] step 545/5000 loss 0.3060 (w 0.4951 mse 0.5009 t 200 new 0.24) lr 1.00e-05 gnorm 0.221 3.36s mem 81.1GB +[2026-09-14 10:36:32] step 546/5000 loss 0.2643 (w 0.2806 mse 0.2678 t 870 new 0.23) lr 1.00e-05 gnorm 0.181 3.10s mem 81.1GB +[2026-09-14 10:36:36] step 547/5000 loss 0.3012 (w 0.3235 mse 0.3080 t 911 new 0.20) lr 1.00e-05 gnorm 0.131 3.43s mem 81.1GB +[2026-09-14 10:36:39] step 548/5000 loss 0.2177 (w 0.3349 mse 0.3155 t 782 new 0.22) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +[2026-09-14 10:36:42] step 549/5000 loss 0.1513 (w 0.2872 mse 0.2718 t 886 new 0.19) lr 1.00e-05 gnorm 0.146 2.85s mem 81.1GB +[2026-09-14 10:36:45] step 550/5000 loss 0.2101 (w 0.3243 mse 0.3203 t 861 new 0.21) lr 1.00e-05 gnorm 0.357 3.10s mem 81.1GB +[2026-09-14 10:36:48] step 551/5000 loss 0.1991 (w 0.3346 mse 0.3215 t 914 new 0.19) lr 1.00e-05 gnorm 0.231 3.37s mem 81.1GB +[2026-09-14 10:36:51] step 552/5000 loss 0.2843 (w 0.3582 mse 0.3425 t 987 new 0.25) lr 1.00e-05 gnorm 0.154 3.34s mem 81.1GB +[2026-09-14 10:36:55] step 553/5000 loss 0.4529 (w 0.5732 mse 0.5717 t 165 new 0.12) lr 1.00e-05 gnorm 0.291 3.36s mem 81.1GB +[2026-09-14 10:36:58] step 554/5000 loss 0.2877 (w 0.3805 mse 0.3762 t 935 new 0.21) lr 1.00e-05 gnorm 0.201 2.84s mem 81.1GB +[2026-09-14 10:37:00] step 555/5000 loss 0.2056 (w 0.2257 mse 0.2260 t 932 new 0.02) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +[2026-09-14 10:37:03] step 556/5000 loss 0.2429 (w 0.2616 mse 0.2644 t 962 new 0.10) lr 1.00e-05 gnorm 0.183 3.02s mem 81.1GB +[2026-09-14 10:37:07] step 557/5000 loss 0.3969 (w 0.5670 mse 0.5656 t 244 new 0.21) lr 1.00e-05 gnorm 0.682 3.30s mem 81.1GB +[2026-09-14 10:37:10] step 558/5000 loss 0.2264 (w 0.2354 mse 0.2411 t 976 new 0.16) lr 1.00e-05 gnorm 0.176 3.51s mem 81.1GB +[2026-09-14 10:37:14] step 559/5000 loss 0.2507 (w 0.2176 mse 0.2217 t 913 new 0.18) lr 1.00e-05 gnorm 0.149 3.42s mem 81.1GB +[2026-09-14 10:37:17] step 560/5000 loss 0.0954 (w 0.2753 mse 0.2688 t 973 new 0.17) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +[2026-09-14 10:37:19] step 561/5000 loss 0.4279 (w 0.4603 mse 0.4432 t 217 new 0.21) lr 1.00e-05 gnorm 0.230 2.83s mem 81.1GB +[2026-09-14 10:37:23] step 562/5000 loss 0.1900 (w 0.1755 mse 0.1864 t 562 new 0.15) lr 1.00e-05 gnorm 0.203 3.14s mem 81.1GB +[2026-09-14 10:37:26] step 563/5000 loss 0.3813 (w 0.1211 mse 0.1228 t 865 new 0.16) lr 1.00e-05 gnorm 0.823 3.16s mem 81.1GB +[2026-09-14 10:37:29] step 564/5000 loss 0.2418 (w 0.2240 mse 0.2123 t 821 new 0.23) lr 1.00e-05 gnorm 0.176 3.40s mem 81.1GB +[2026-09-14 10:37:32] step 565/5000 loss 0.1857 (w 0.3425 mse 0.3427 t 411 new 0.22) lr 1.00e-05 gnorm 0.136 3.06s mem 81.1GB +[2026-09-14 10:37:35] step 566/5000 loss 0.3012 (w 0.3617 mse 0.3423 t 956 new 0.24) lr 1.00e-05 gnorm 0.193 2.86s mem 81.1GB +[2026-09-14 10:37:38] step 567/5000 loss 0.3556 (w 0.2705 mse 0.2534 t 790 new 0.25) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +[2026-09-14 10:37:41] step 568/5000 loss 0.1776 (w 0.2795 mse 0.2839 t 937 new 0.16) lr 1.00e-05 gnorm 0.179 3.45s mem 81.1GB +[2026-09-14 10:37:44] step 569/5000 loss 0.3308 (w 0.1765 mse 0.1745 t 669 new 0.15) lr 1.00e-05 gnorm 0.171 3.08s mem 81.1GB +[2026-09-14 10:37:48] step 570/5000 loss 0.1358 (w 0.2916 mse 0.2869 t 961 new 0.22) lr 1.00e-05 gnorm 0.166 3.40s mem 81.1GB +[2026-09-14 10:37:51] step 571/5000 loss 0.1239 (w 0.1263 mse 0.1203 t 858 new 0.18) lr 1.00e-05 gnorm 0.457 3.11s mem 81.1GB +[2026-09-14 10:37:54] step 572/5000 loss 0.2265 (w 0.3244 mse 0.3250 t 624 new 0.29) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +[2026-09-14 10:37:57] step 573/5000 loss 0.3581 (w 0.3438 mse 0.3317 t 960 new 0.15) lr 1.00e-05 gnorm 0.436 2.83s mem 81.1GB +[2026-09-14 10:38:00] step 574/5000 loss 0.3705 (w 0.2339 mse 0.2219 t 582 new 0.18) lr 1.00e-05 gnorm 0.246 3.27s mem 81.1GB +[2026-09-14 10:38:03] step 575/5000 loss 0.2133 (w 0.2842 mse 0.2882 t 985 new 0.17) lr 1.00e-05 gnorm 0.138 3.27s mem 81.1GB +[2026-09-14 10:38:07] step 576/5000 loss 0.2891 (w 0.2831 mse 0.2795 t 704 new 0.23) lr 1.00e-05 gnorm 0.236 3.42s mem 81.1GB +[2026-09-14 10:38:10] step 577/5000 loss 0.3504 (w 0.2535 mse 0.2623 t 972 new 0.19) lr 1.00e-05 gnorm 0.561 3.13s mem 81.1GB +[2026-09-14 10:38:13] step 578/5000 loss 0.2824 (w 0.2160 mse 0.2116 t 799 new 0.17) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +[2026-09-14 10:38:15] step 579/5000 loss 0.2265 (w 0.2453 mse 0.2520 t 982 new 0.13) lr 1.00e-05 gnorm 0.252 2.84s mem 81.1GB +[2026-09-14 10:38:19] step 580/5000 loss 0.2883 (w 0.2448 mse 0.2515 t 623 new 0.22) lr 1.00e-05 gnorm 0.155 3.33s mem 81.1GB +[2026-09-14 10:38:22] step 581/5000 loss 0.3708 (w 0.2106 mse 0.2055 t 880 new 0.25) lr 1.00e-05 gnorm 0.196 3.35s mem 81.1GB +[2026-09-14 10:38:26] step 582/5000 loss 0.2029 (w 0.3731 mse 0.3585 t 990 new 0.19) lr 1.00e-05 gnorm 0.183 3.43s mem 81.1GB +[2026-09-14 10:38:28] step 583/5000 loss 0.1530 (w 0.3374 mse 0.3372 t 971 new 0.21) lr 1.00e-05 gnorm 0.161 2.84s mem 81.1GB +[2026-09-14 10:38:31] step 584/5000 loss 0.1784 (w 0.2779 mse 0.2886 t 992 new 0.24) lr 1.00e-05 gnorm 0.135 2.85s mem 81.1GB +[2026-09-14 10:38:34] step 585/5000 loss 0.4055 (w 0.1339 mse 0.1314 t 929 new 0.20) lr 1.00e-05 gnorm 0.246 2.84s mem 81.1GB +[2026-09-14 10:38:37] step 586/5000 loss 0.2295 (w 0.3912 mse 0.4078 t 985 new 0.17) lr 1.00e-05 gnorm 0.217 3.14s mem 81.1GB +[2026-09-14 10:38:41] step 587/5000 loss 0.2337 (w 0.3737 mse 0.3402 t 998 new 0.21) lr 1.00e-05 gnorm 0.230 3.36s mem 81.1GB +[2026-09-14 10:38:44] step 588/5000 loss 0.1733 (w 0.4617 mse 0.4523 t 994 new 0.12) lr 1.00e-05 gnorm 0.175 3.40s mem 81.1GB +[2026-09-14 10:38:47] step 589/5000 loss 0.2548 (w 0.2683 mse 0.2676 t 907 new 0.21) lr 1.00e-05 gnorm 0.188 2.84s mem 81.1GB +[2026-09-14 10:38:50] step 590/5000 loss 0.3570 (w 0.1776 mse 0.1939 t 947 new 0.24) lr 1.00e-05 gnorm 0.195 2.84s mem 81.1GB +[2026-09-14 10:38:53] step 591/5000 loss 0.4699 (w 0.1473 mse 0.1519 t 773 new 0.24) lr 1.00e-05 gnorm 0.200 3.04s mem 81.1GB +[2026-09-14 10:38:56] step 592/5000 loss 0.1722 (w 0.2353 mse 0.2348 t 921 new 0.15) lr 1.00e-05 gnorm 0.150 3.32s mem 81.1GB +[2026-09-14 10:39:00] step 593/5000 loss 0.2241 (w 0.3086 mse 0.3053 t 963 new 0.19) lr 1.00e-05 gnorm 0.176 3.42s mem 81.1GB +[2026-09-14 10:39:03] step 594/5000 loss 0.2197 (w 0.2991 mse 0.3003 t 940 new 0.26) lr 1.00e-05 gnorm 0.217 3.13s mem 81.1GB +[2026-09-14 10:39:06] step 595/5000 loss 0.3338 (w 0.1953 mse 0.1871 t 866 new 0.18) lr 1.00e-05 gnorm 0.208 2.85s mem 81.1GB +[2026-09-14 10:39:08] step 596/5000 loss 0.1425 (w 0.2096 mse 0.2104 t 918 new 0.27) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +[2026-09-14 10:39:12] step 597/5000 loss 0.2354 (w 0.2137 mse 0.2116 t 863 new 0.21) lr 1.00e-05 gnorm 0.191 3.07s mem 81.1GB +[2026-09-14 10:39:15] step 598/5000 loss 0.2401 (w 0.3280 mse 0.3233 t 968 new 0.26) lr 1.00e-05 gnorm 0.138 3.37s mem 81.1GB +[2026-09-14 10:39:18] step 599/5000 loss 0.2512 (w 0.3488 mse 0.3445 t 963 new 0.22) lr 1.00e-05 gnorm 0.241 3.54s mem 81.1GB +[2026-09-14 10:39:22] step 600/5000 loss 0.3758 (w 0.1802 mse 0.1804 t 467 new 0.19) lr 1.00e-05 gnorm 0.145 3.11s mem 81.1GB +[2026-09-14 10:39:24] step 601/5000 loss 0.2063 (w 0.2829 mse 0.2726 t 995 new 0.25) lr 1.00e-05 gnorm 0.146 2.84s mem 81.1GB +[2026-09-14 10:39:27] step 602/5000 loss 0.2752 (w 0.1846 mse 0.1910 t 838 new 0.20) lr 1.00e-05 gnorm 0.252 2.84s mem 81.1GB +[2026-09-14 10:39:30] step 603/5000 loss 0.1649 (w 0.1484 mse 0.1588 t 969 new 0.13) lr 1.00e-05 gnorm 0.182 3.10s mem 81.1GB +[2026-09-14 10:39:34] step 604/5000 loss 0.2618 (w 0.2479 mse 0.2423 t 912 new 0.21) lr 1.00e-05 gnorm 0.229 3.27s mem 81.1GB +[2026-09-14 10:39:37] step 605/5000 loss 0.1353 (w 0.3502 mse 0.3266 t 977 new 0.14) lr 1.00e-05 gnorm 0.187 3.63s mem 81.1GB +[2026-09-14 10:39:40] step 606/5000 loss 0.3083 (w 0.2816 mse 0.2755 t 956 new 0.16) lr 1.00e-05 gnorm 0.168 2.84s mem 81.1GB +[2026-09-14 10:39:43] step 607/5000 loss 0.2005 (w 0.2249 mse 0.2139 t 839 new 0.25) lr 1.00e-05 gnorm 0.261 2.84s mem 81.1GB +[2026-09-14 10:39:46] step 608/5000 loss 0.3116 (w 0.3097 mse 0.2937 t 797 new 0.20) lr 1.00e-05 gnorm 0.384 2.84s mem 81.1GB +[2026-09-14 10:39:49] step 609/5000 loss 0.4665 (w 0.3789 mse 0.3731 t 979 new 0.21) lr 1.00e-05 gnorm 0.204 3.02s mem 81.1GB +[2026-09-14 10:39:52] step 610/5000 loss 0.3603 (w 0.5910 mse 0.6206 t 127 new 0.23) lr 1.00e-05 gnorm 0.255 3.37s mem 81.1GB +[2026-09-14 10:39:56] step 611/5000 loss 0.1355 (w 0.3129 mse 0.3010 t 987 new 0.24) lr 1.00e-05 gnorm 0.104 3.65s mem 81.1GB +[2026-09-14 10:39:59] step 612/5000 loss 0.3128 (w 0.2610 mse 0.2529 t 982 new 0.20) lr 1.00e-05 gnorm 0.254 2.84s mem 81.1GB +[2026-09-14 10:40:01] step 613/5000 loss 0.2042 (w 0.2775 mse 0.2727 t 557 new 0.24) lr 1.00e-05 gnorm 0.279 2.84s mem 81.1GB +[2026-09-14 10:40:04] step 614/5000 loss 0.2780 (w 0.2921 mse 0.3010 t 421 new 0.22) lr 1.00e-05 gnorm 0.147 2.85s mem 81.1GB +[2026-09-14 10:40:08] step 615/5000 loss 0.2806 (w 0.1837 mse 0.1890 t 913 new 0.12) lr 1.00e-05 gnorm 0.503 3.28s mem 81.1GB +[2026-09-14 10:40:11] step 616/5000 loss 0.2497 (w 0.2123 mse 0.2121 t 839 new 0.16) lr 1.00e-05 gnorm 0.181 3.56s mem 81.1GB +[2026-09-14 10:40:15] step 617/5000 loss 0.2046 (w 0.2717 mse 0.2713 t 937 new 0.26) lr 1.00e-05 gnorm 0.146 3.50s mem 81.1GB +[2026-09-14 10:40:18] step 618/5000 loss 0.2004 (w 0.3493 mse 0.3543 t 994 new 0.13) lr 1.00e-05 gnorm 0.138 2.85s mem 81.1GB +[2026-09-14 10:40:20] step 619/5000 loss 0.2182 (w 0.2819 mse 0.2786 t 822 new 0.18) lr 1.00e-05 gnorm 0.158 2.85s mem 81.1GB +[2026-09-14 10:40:24] step 620/5000 loss 0.3209 (w 0.2464 mse 0.2480 t 832 new 0.12) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +[2026-09-14 10:40:27] step 621/5000 loss 0.4518 (w 0.2490 mse 0.2478 t 692 new 0.22) lr 1.00e-05 gnorm 0.188 3.11s mem 81.1GB +[2026-09-14 10:40:30] step 622/5000 loss 0.2361 (w 0.2426 mse 0.2350 t 845 new 0.23) lr 1.00e-05 gnorm 0.127 3.58s mem 81.1GB +[2026-09-14 10:40:34] step 623/5000 loss 0.1763 (w 0.2502 mse 0.2420 t 938 new 0.12) lr 1.00e-05 gnorm 0.185 3.42s mem 81.1GB +[2026-09-14 10:40:36] step 624/5000 loss 0.2252 (w 0.2185 mse 0.2097 t 939 new 0.21) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +[2026-09-14 10:40:39] step 625/5000 loss 0.2898 (w 0.2807 mse 0.2880 t 348 new 0.20) lr 1.00e-05 gnorm 0.223 2.84s mem 81.1GB +[2026-09-14 10:40:42] step 626/5000 loss 0.1636 (w 0.0896 mse 0.0933 t 675 new 0.12) lr 1.00e-05 gnorm 0.221 3.11s mem 81.1GB +[2026-09-14 10:40:46] step 627/5000 loss 0.1446 (w 0.2706 mse 0.2661 t 952 new 0.12) lr 1.00e-05 gnorm 0.199 3.07s mem 81.1GB +[2026-09-14 10:40:49] step 628/5000 loss 0.0829 (w 0.3343 mse 0.3162 t 969 new 0.21) lr 1.00e-05 gnorm 0.139 3.56s mem 81.1GB +[2026-09-14 10:40:52] step 629/5000 loss 0.1529 (w 0.0890 mse 0.0984 t 945 new 0.10) lr 1.00e-05 gnorm 0.152 3.39s mem 81.1GB +[2026-09-14 10:40:55] step 630/5000 loss 0.1586 (w 0.2970 mse 0.3069 t 980 new 0.20) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-14 10:40:58] step 631/5000 loss 0.3582 (w 0.2228 mse 0.2232 t 939 new 0.18) lr 1.00e-05 gnorm 0.186 2.85s mem 81.1GB +[2026-09-14 10:41:01] step 632/5000 loss 0.3025 (w 0.4020 mse 0.4037 t 992 new 0.23) lr 1.00e-05 gnorm 0.157 3.26s mem 81.1GB +[2026-09-14 10:41:05] step 633/5000 loss 0.2303 (w 0.1761 mse 0.1856 t 853 new 0.15) lr 1.00e-05 gnorm 0.216 3.29s mem 81.1GB +[2026-09-14 10:41:08] step 634/5000 loss 0.2284 (w 0.3109 mse 0.3148 t 980 new 0.26) lr 1.00e-05 gnorm 0.445 3.26s mem 81.1GB +[2026-09-14 10:41:12] step 635/5000 loss 0.1394 (w 0.2608 mse 0.2444 t 935 new 0.15) lr 1.00e-05 gnorm 0.160 3.44s mem 81.1GB +[2026-09-14 10:41:15] step 636/5000 loss 0.3845 (w 0.7149 mse 0.7044 t 100 new 0.20) lr 1.00e-05 gnorm 0.205 2.84s mem 81.1GB +[2026-09-14 10:41:18] step 637/5000 loss 0.4053 (w 0.3527 mse 0.3403 t 695 new 0.27) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +[2026-09-14 10:41:21] step 638/5000 loss 0.3102 (w 0.1797 mse 0.1785 t 516 new 0.18) lr 1.00e-05 gnorm 0.199 3.14s mem 81.1GB +[2026-09-14 10:41:24] step 639/5000 loss 0.4293 (w 0.2926 mse 0.2876 t 623 new 0.16) lr 1.00e-05 gnorm 0.273 3.12s mem 81.1GB +[2026-09-14 10:41:27] step 640/5000 loss 0.1637 (w 0.2982 mse 0.2910 t 911 new 0.23) lr 1.00e-05 gnorm 0.210 3.52s mem 81.1GB +[2026-09-14 10:41:30] step 641/5000 loss 0.2564 (w 0.2138 mse 0.2131 t 636 new 0.17) lr 1.00e-05 gnorm 0.193 3.17s mem 81.1GB +[2026-09-14 10:41:33] step 642/5000 loss 0.1318 (w 0.1548 mse 0.1695 t 962 new 0.23) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +[2026-09-14 10:41:36] step 643/5000 loss 0.2882 (w 0.4380 mse 0.4424 t 259 new 0.08) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +[2026-09-14 10:41:40] step 644/5000 loss 0.3485 (w 0.2660 mse 0.2557 t 800 new 0.14) lr 1.00e-05 gnorm 0.124 3.30s mem 81.1GB +[2026-09-14 10:41:43] step 645/5000 loss 0.2140 (w 0.1381 mse 0.1320 t 972 new 0.21) lr 1.00e-05 gnorm 0.210 3.07s mem 81.1GB +[2026-09-14 10:41:46] step 646/5000 loss 0.1630 (w 0.1952 mse 0.1963 t 984 new 0.25) lr 1.00e-05 gnorm 0.447 3.32s mem 81.1GB +[2026-09-14 10:41:49] step 647/5000 loss 0.3304 (w 0.2902 mse 0.2923 t 444 new 0.21) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +[2026-09-14 10:41:52] step 648/5000 loss 0.1706 (w 0.4035 mse 0.4033 t 998 new 0.16) lr 1.00e-05 gnorm 1.310 2.84s mem 81.1GB +[2026-09-14 10:41:55] step 649/5000 loss 0.1418 (w 0.2029 mse 0.1922 t 901 new 0.19) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +[2026-09-14 10:41:58] step 650/5000 loss 0.1941 (w 0.1191 mse 0.1174 t 785 new 0.11) lr 1.00e-05 gnorm 0.207 3.36s mem 81.1GB +[2026-09-14 10:42:02] step 651/5000 loss 0.3214 (w 0.2417 mse 0.2387 t 598 new 0.08) lr 1.00e-05 gnorm 0.189 3.35s mem 81.1GB +[2026-09-14 10:42:05] step 652/5000 loss 0.3327 (w 0.1385 mse 0.1343 t 776 new 0.25) lr 1.00e-05 gnorm 0.158 3.47s mem 81.1GB +[2026-09-14 10:42:08] step 653/5000 loss 0.3601 (w 0.2660 mse 0.2507 t 921 new 0.14) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +[2026-09-14 10:42:11] step 654/5000 loss 0.2326 (w 0.1603 mse 0.1650 t 945 new 0.23) lr 1.00e-05 gnorm 0.215 2.83s mem 81.1GB +[2026-09-14 10:42:14] step 655/5000 loss 0.1711 (w 0.3764 mse 0.3705 t 974 new 0.21) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +[2026-09-14 10:42:17] step 656/5000 loss 0.2151 (w 0.4393 mse 0.4508 t 978 new 0.19) lr 1.00e-05 gnorm 1.234 3.13s mem 81.1GB +[2026-09-14 10:42:20] step 657/5000 loss 0.3464 (w 0.1336 mse 0.1435 t 700 new 0.20) lr 1.00e-05 gnorm 0.160 3.31s mem 81.1GB +[2026-09-14 10:42:24] step 658/5000 loss 0.3440 (w 0.2804 mse 0.2728 t 972 new 0.10) lr 1.00e-05 gnorm 0.165 3.39s mem 81.1GB +[2026-09-14 10:42:27] step 659/5000 loss 0.1762 (w 0.4419 mse 0.4078 t 990 new 0.20) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +[2026-09-14 10:42:29] step 660/5000 loss 0.1835 (w 0.3341 mse 0.3294 t 989 new 0.24) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-14 10:42:32] step 661/5000 loss 0.2251 (w 0.1870 mse 0.1857 t 881 new 0.22) lr 1.00e-05 gnorm 0.148 2.83s mem 81.1GB +[2026-09-14 10:42:35] step 662/5000 loss 0.2444 (w 0.2470 mse 0.2375 t 921 new 0.26) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +[2026-09-14 10:42:39] step 663/5000 loss 0.2695 (w 0.2364 mse 0.2241 t 920 new 0.25) lr 1.00e-05 gnorm 0.192 3.26s mem 81.1GB +[2026-09-14 10:42:42] step 664/5000 loss 0.2849 (w 0.2581 mse 0.2461 t 911 new 0.23) lr 1.00e-05 gnorm 0.186 3.43s mem 81.1GB +[2026-09-14 10:42:45] step 665/5000 loss 0.1962 (w 0.3485 mse 0.3448 t 967 new 0.23) lr 1.00e-05 gnorm 0.258 2.84s mem 81.1GB +[2026-09-14 10:42:48] step 666/5000 loss 0.3272 (w 0.3915 mse 0.4006 t 372 new 0.20) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +[2026-09-14 10:42:51] step 667/5000 loss 0.2955 (w 0.1641 mse 0.1783 t 767 new 0.26) lr 1.00e-05 gnorm 0.217 2.84s mem 81.1GB +[2026-09-14 10:42:54] step 668/5000 loss 0.1725 (w 0.2847 mse 0.2655 t 728 new 0.17) lr 1.00e-05 gnorm 0.147 3.12s mem 81.1GB +[2026-09-14 10:42:57] step 669/5000 loss 0.4032 (w 0.2442 mse 0.2510 t 954 new 0.23) lr 1.00e-05 gnorm 0.255 3.39s mem 81.1GB +[2026-09-14 10:43:00] step 670/5000 loss 0.2168 (w 0.1911 mse 0.1844 t 954 new 0.25) lr 1.00e-05 gnorm 0.412 3.36s mem 81.1GB +[2026-09-14 10:43:03] step 671/5000 loss 0.1795 (w 0.3270 mse 0.3088 t 994 new 0.25) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +[2026-09-14 10:43:06] step 672/5000 loss 0.3112 (w 0.2352 mse 0.2208 t 852 new 0.26) lr 1.00e-05 gnorm 0.163 2.85s mem 81.1GB +[2026-09-14 10:43:09] step 673/5000 loss 0.1967 (w 0.1991 mse 0.2079 t 815 new 0.24) lr 1.00e-05 gnorm 0.221 3.12s mem 81.1GB +[2026-09-14 10:43:12] step 674/5000 loss 0.1040 (w 0.3296 mse 0.3200 t 999 new 0.23) lr 1.00e-05 gnorm 0.108 3.08s mem 81.1GB +[2026-09-14 10:43:16] step 675/5000 loss 0.1917 (w 0.2126 mse 0.2133 t 934 new 0.23) lr 1.00e-05 gnorm 0.301 3.40s mem 81.1GB +[2026-09-14 10:43:19] step 676/5000 loss 0.2233 (w 0.1471 mse 0.1486 t 875 new 0.13) lr 1.00e-05 gnorm 0.141 3.29s mem 81.1GB +[2026-09-14 10:43:22] step 677/5000 loss 0.2032 (w 0.2141 mse 0.2196 t 865 new 0.25) lr 1.00e-05 gnorm 0.182 2.85s mem 81.1GB +[2026-09-14 10:43:25] step 678/5000 loss 0.2203 (w 0.3127 mse 0.3106 t 896 new 0.21) lr 1.00e-05 gnorm 0.220 2.84s mem 81.1GB +[2026-09-14 10:43:28] step 679/5000 loss 0.2504 (w 0.3802 mse 0.3668 t 980 new 0.22) lr 1.00e-05 gnorm 0.317 3.05s mem 81.1GB +[2026-09-14 10:43:31] step 680/5000 loss 0.2486 (w 0.2041 mse 0.2009 t 915 new 0.20) lr 1.00e-05 gnorm 0.175 2.84s mem 81.1GB +[2026-09-14 10:43:34] step 681/5000 loss 0.2840 (w 0.2749 mse 0.2724 t 692 new 0.23) lr 1.00e-05 gnorm 0.151 3.36s mem 81.1GB +[2026-09-14 10:43:37] step 682/5000 loss 0.2352 (w 0.4546 mse 0.4514 t 228 new 0.16) lr 1.00e-05 gnorm 0.165 3.31s mem 81.1GB +[2026-09-14 10:43:40] step 683/5000 loss 0.1891 (w 0.1602 mse 0.1696 t 993 new 0.15) lr 1.00e-05 gnorm 0.209 2.84s mem 81.1GB +[2026-09-14 10:43:43] step 684/5000 loss 0.3120 (w 0.2255 mse 0.2222 t 779 new 0.21) lr 1.00e-05 gnorm 0.182 2.84s mem 81.1GB +[2026-09-14 10:43:46] step 685/5000 loss 0.1519 (w 0.2563 mse 0.2531 t 555 new 0.22) lr 1.00e-05 gnorm 0.334 3.09s mem 81.1GB +[2026-09-14 10:43:49] step 686/5000 loss 0.3575 (w 0.2047 mse 0.1852 t 970 new 0.26) lr 1.00e-05 gnorm 0.211 3.11s mem 81.1GB +[2026-09-14 10:43:53] step 687/5000 loss 0.3266 (w 0.8801 mse 0.8472 t 990 new 0.19) lr 1.00e-05 gnorm 0.472 3.32s mem 81.1GB +[2026-09-14 10:43:56] step 688/5000 loss 0.2735 (w 0.3047 mse 0.2868 t 878 new 0.22) lr 1.00e-05 gnorm 0.156 3.33s mem 81.1GB +[2026-09-14 10:43:59] step 689/5000 loss 0.3526 (w 0.4000 mse 0.3908 t 383 new 0.19) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-14 10:44:02] step 690/5000 loss 0.3789 (w 0.2486 mse 0.2385 t 854 new 0.16) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +[2026-09-14 10:44:05] step 691/5000 loss 0.2175 (w 0.4628 mse 0.4956 t 159 new 0.17) lr 1.00e-05 gnorm 0.126 3.34s mem 81.1GB +[2026-09-14 10:44:09] step 692/5000 loss 0.1299 (w 0.2322 mse 0.2272 t 903 new 0.24) lr 1.00e-05 gnorm 0.154 4.06s mem 81.1GB +[2026-09-14 10:44:13] step 693/5000 loss 0.2482 (w 0.3146 mse 0.2950 t 969 new 0.23) lr 1.00e-05 gnorm 0.497 3.48s mem 81.1GB +[2026-09-14 10:44:16] step 694/5000 loss 0.2723 (w 0.1676 mse 0.1629 t 734 new 0.14) lr 1.00e-05 gnorm 0.162 3.42s mem 81.1GB +[2026-09-14 10:44:19] step 695/5000 loss 0.1948 (w 0.2054 mse 0.2124 t 639 new 0.22) lr 1.00e-05 gnorm 0.140 2.85s mem 81.1GB +[2026-09-14 10:44:22] step 696/5000 loss 0.1903 (w 0.1486 mse 0.1551 t 768 new 0.17) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +[2026-09-14 10:44:25] step 697/5000 loss 0.2542 (w 0.2063 mse 0.2041 t 834 new 0.26) lr 1.00e-05 gnorm 0.131 3.31s mem 81.1GB +[2026-09-14 10:44:28] step 698/5000 loss 0.1966 (w 0.2091 mse 0.2269 t 970 new 0.23) lr 1.00e-05 gnorm 0.165 3.08s mem 81.1GB +[2026-09-14 10:44:32] step 699/5000 loss 0.2051 (w 0.1277 mse 0.1288 t 748 new 0.20) lr 1.00e-05 gnorm 0.130 3.45s mem 81.1GB +[2026-09-14 10:44:35] step 700/5000 loss 0.1749 (w 0.2320 mse 0.2380 t 982 new 0.12) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +[2026-09-14 10:44:38] step 701/5000 loss 0.3804 (w 0.3097 mse 0.3401 t 292 new 0.20) lr 1.00e-05 gnorm 0.197 2.85s mem 81.1GB +[2026-09-14 10:44:40] step 702/5000 loss 0.1457 (w 0.2370 mse 0.2444 t 934 new 0.10) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +[2026-09-14 10:44:44] step 703/5000 loss 0.3897 (w 0.1500 mse 0.1544 t 603 new 0.17) lr 1.00e-05 gnorm 0.197 3.29s mem 81.1GB +[2026-09-14 10:44:47] step 704/5000 loss 0.2943 (w 0.1715 mse 0.1795 t 599 new 0.24) lr 1.00e-05 gnorm 0.147 3.08s mem 81.1GB +[2026-09-14 10:44:50] step 705/5000 loss 0.3891 (w 0.2383 mse 0.2422 t 467 new 0.24) lr 1.00e-05 gnorm 0.142 3.16s mem 81.1GB +[2026-09-14 10:44:53] step 706/5000 loss 0.3284 (w 0.2227 mse 0.2082 t 695 new 0.18) lr 1.00e-05 gnorm 0.159 3.16s mem 81.1GB +[2026-09-14 10:44:56] step 707/5000 loss 0.2480 (w 0.4876 mse 0.4724 t 991 new 0.14) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-14 10:44:59] step 708/5000 loss 0.1974 (w 0.2263 mse 0.2354 t 961 new 0.19) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +[2026-09-14 10:45:02] step 709/5000 loss 0.1515 (w 0.1889 mse 0.1789 t 881 new 0.08) lr 1.00e-05 gnorm 0.164 3.38s mem 81.1GB +[2026-09-14 10:45:06] step 710/5000 loss 0.2556 (w 0.1994 mse 0.2164 t 980 new 0.18) lr 1.00e-05 gnorm 0.126 3.37s mem 81.1GB +[2026-09-14 10:45:09] step 711/5000 loss 0.3161 (w 0.3946 mse 0.3926 t 301 new 0.21) lr 1.00e-05 gnorm 0.212 3.39s mem 81.1GB +[2026-09-14 10:45:12] step 712/5000 loss 0.1743 (w 0.3773 mse 0.3782 t 1000 new 0.13) lr 1.00e-05 gnorm 0.157 2.84s mem 81.1GB +[2026-09-14 10:45:15] step 713/5000 loss 0.2465 (w 0.1916 mse 0.1914 t 913 new 0.10) lr 1.00e-05 gnorm 0.183 2.84s mem 81.1GB +[2026-09-14 10:45:18] step 714/5000 loss 0.3012 (w 0.1463 mse 0.1423 t 790 new 0.26) lr 1.00e-05 gnorm 0.167 3.15s mem 81.1GB +[2026-09-14 10:45:21] step 715/5000 loss 0.1966 (w 0.3246 mse 0.3285 t 1000 new 0.19) lr 1.00e-05 gnorm 0.142 3.05s mem 81.1GB +[2026-09-14 10:45:24] step 716/5000 loss 0.3138 (w 0.2206 mse 0.2109 t 888 new 0.23) lr 1.00e-05 gnorm 0.181 3.34s mem 81.1GB +[2026-09-14 10:45:28] step 717/5000 loss 0.2709 (w 0.7888 mse 0.7817 t 120 new 0.23) lr 1.00e-05 gnorm 0.266 3.40s mem 81.1GB +[2026-09-14 10:45:31] step 718/5000 loss 0.2248 (w 0.2767 mse 0.2812 t 956 new 0.21) lr 1.00e-05 gnorm 0.287 2.85s mem 81.1GB +[2026-09-14 10:45:33] step 719/5000 loss 0.2135 (w 0.2266 mse 0.2168 t 969 new 0.13) lr 1.00e-05 gnorm 0.140 2.86s mem 81.1GB +[2026-09-14 10:45:37] step 720/5000 loss 0.2534 (w 0.1052 mse 0.1166 t 932 new 0.18) lr 1.00e-05 gnorm 0.154 3.34s mem 81.1GB +[2026-09-14 10:45:40] step 721/5000 loss 0.1804 (w 0.6380 mse 0.6258 t 146 new 0.17) lr 1.00e-05 gnorm 0.158 3.37s mem 81.1GB +[2026-09-14 10:45:44] step 722/5000 loss 0.3020 (w 0.4268 mse 0.4039 t 998 new 0.24) lr 1.00e-05 gnorm 0.166 3.45s mem 81.1GB +[2026-09-14 10:45:47] step 723/5000 loss 0.2096 (w 0.2094 mse 0.1992 t 770 new 0.23) lr 1.00e-05 gnorm 0.171 3.39s mem 81.1GB +[2026-09-14 10:45:50] step 724/5000 loss 0.1477 (w 0.2609 mse 0.2592 t 959 new 0.23) lr 1.00e-05 gnorm 0.320 2.84s mem 81.1GB +[2026-09-14 10:45:53] step 725/5000 loss 0.2917 (w 0.3145 mse 0.3158 t 568 new 0.17) lr 1.00e-05 gnorm 0.125 2.86s mem 81.1GB +[2026-09-14 10:45:56] step 726/5000 loss 0.2153 (w 0.2605 mse 0.2540 t 924 new 0.20) lr 1.00e-05 gnorm 0.277 3.17s mem 81.1GB +[2026-09-14 10:45:59] step 727/5000 loss 0.3452 (w 0.1901 mse 0.1863 t 932 new 0.16) lr 1.00e-05 gnorm 0.314 3.05s mem 81.1GB +[2026-09-14 10:46:02] step 728/5000 loss 0.1883 (w 0.2255 mse 0.2300 t 530 new 0.13) lr 1.00e-05 gnorm 0.129 3.10s mem 81.1GB +[2026-09-14 10:46:06] step 729/5000 loss 0.1749 (w 0.2152 mse 0.2084 t 909 new 0.15) lr 1.00e-05 gnorm 0.193 3.44s mem 81.1GB +[2026-09-14 10:46:08] step 730/5000 loss 0.3454 (w 0.1041 mse 0.1066 t 560 new 0.17) lr 1.00e-05 gnorm 0.121 2.86s mem 81.1GB +[2026-09-14 10:46:11] step 731/5000 loss 0.1641 (w 0.2021 mse 0.2004 t 737 new 0.23) lr 1.00e-05 gnorm 0.299 2.85s mem 81.1GB +[2026-09-14 10:46:15] step 732/5000 loss 0.2912 (w 0.8468 mse 0.8763 t 994 new 0.21) lr 1.00e-05 gnorm 0.153 3.40s mem 81.1GB +[2026-09-14 10:46:18] step 733/5000 loss 0.2934 (w 0.3084 mse 0.3080 t 465 new 0.26) lr 1.00e-05 gnorm 0.214 3.04s mem 81.1GB +[2026-09-14 10:46:21] step 734/5000 loss 0.0957 (w 0.2453 mse 0.2608 t 982 new 0.23) lr 1.00e-05 gnorm 0.186 3.48s mem 81.1GB +[2026-09-14 10:46:24] step 735/5000 loss 0.2208 (w 0.1677 mse 0.1608 t 786 new 0.23) lr 1.00e-05 gnorm 0.411 3.13s mem 81.1GB +[2026-09-14 10:46:27] step 736/5000 loss 0.3328 (w 0.3279 mse 0.3170 t 979 new 0.25) lr 1.00e-05 gnorm 0.181 2.84s mem 81.1GB +[2026-09-14 10:46:30] step 737/5000 loss 0.3651 (w 0.3416 mse 0.3410 t 506 new 0.25) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +[2026-09-14 10:46:33] step 738/5000 loss 0.4052 (w 0.2808 mse 0.2787 t 683 new 0.19) lr 1.00e-05 gnorm 0.169 3.39s mem 81.1GB +[2026-09-14 10:46:36] step 739/5000 loss 0.2553 (w 0.2217 mse 0.2227 t 681 new 0.24) lr 1.00e-05 gnorm 0.173 3.07s mem 81.1GB +[2026-09-14 10:46:40] step 740/5000 loss 0.3429 (w 0.1805 mse 0.1789 t 817 new 0.19) lr 1.00e-05 gnorm 0.133 3.39s mem 81.1GB +[2026-09-14 10:46:43] step 741/5000 loss 0.2400 (w 0.0999 mse 0.1048 t 852 new 0.08) lr 1.00e-05 gnorm 0.180 3.16s mem 81.1GB +[2026-09-14 10:46:46] step 742/5000 loss 0.2248 (w 0.2523 mse 0.2467 t 677 new 0.22) lr 1.00e-05 gnorm 0.337 2.84s mem 81.1GB +[2026-09-14 10:46:49] step 743/5000 loss 0.2058 (w 0.3028 mse 0.3014 t 974 new 0.23) lr 1.00e-05 gnorm 0.142 2.85s mem 81.1GB +[2026-09-14 10:46:52] step 744/5000 loss 0.3164 (w 0.2751 mse 0.2602 t 974 new 0.21) lr 1.00e-05 gnorm 0.187 3.06s mem 81.1GB +[2026-09-14 10:46:55] step 745/5000 loss 0.2359 (w 0.2179 mse 0.2097 t 930 new 0.19) lr 1.00e-05 gnorm 0.214 3.36s mem 81.1GB +[2026-09-14 10:46:58] step 746/5000 loss 0.2694 (w 0.2899 mse 0.2681 t 883 new 0.23) lr 1.00e-05 gnorm 0.168 3.12s mem 81.1GB +[2026-09-14 10:47:01] step 747/5000 loss 0.3425 (w 0.2793 mse 0.2782 t 684 new 0.28) lr 1.00e-05 gnorm 0.168 2.84s mem 81.1GB +[2026-09-14 10:47:04] step 748/5000 loss 0.3555 (w 0.2841 mse 0.2841 t 945 new 0.16) lr 1.00e-05 gnorm 0.233 2.84s mem 81.1GB +[2026-09-14 10:47:07] step 749/5000 loss 0.3394 (w 0.2003 mse 0.1990 t 645 new 0.24) lr 1.00e-05 gnorm 0.214 2.85s mem 81.1GB +[2026-09-14 10:47:10] step 750/5000 loss 0.2642 (w 0.1795 mse 0.1767 t 904 new 0.25) lr 1.00e-05 gnorm 0.167 3.10s mem 81.1GB +[2026-09-14 10:47:13] step 751/5000 loss 0.2485 (w 0.3308 mse 0.3155 t 979 new 0.24) lr 1.00e-05 gnorm 0.150 3.35s mem 81.1GB +[2026-09-14 10:47:16] step 752/5000 loss 0.3831 (w 0.1458 mse 0.1436 t 718 new 0.21) lr 1.00e-05 gnorm 0.340 3.15s mem 81.1GB +[2026-09-14 10:47:19] step 753/5000 loss 0.2679 (w 0.1813 mse 0.1791 t 528 new 0.15) lr 1.00e-05 gnorm 0.199 2.84s mem 81.1GB +[2026-09-14 10:47:22] step 754/5000 loss 0.2795 (w 0.2452 mse 0.2366 t 609 new 0.16) lr 1.00e-05 gnorm 0.196 2.84s mem 81.1GB +[2026-09-14 10:47:25] step 755/5000 loss 0.1588 (w 0.1565 mse 0.1508 t 754 new 0.22) lr 1.00e-05 gnorm 0.242 3.01s mem 81.1GB +[2026-09-14 10:47:28] step 756/5000 loss 0.1939 (w 0.2847 mse 0.2921 t 977 new 0.10) lr 1.00e-05 gnorm 0.140 3.34s mem 81.1GB +[2026-09-14 10:47:32] step 757/5000 loss 0.2805 (w 0.2728 mse 0.2726 t 428 new 0.16) lr 1.00e-05 gnorm 0.180 3.40s mem 81.1GB +[2026-09-14 10:47:35] step 758/5000 loss 0.2997 (w 0.2494 mse 0.2487 t 808 new 0.16) lr 1.00e-05 gnorm 0.166 3.42s mem 81.1GB +[2026-09-14 10:47:38] step 759/5000 loss 0.1919 (w 0.2240 mse 0.2165 t 779 new 0.25) lr 1.00e-05 gnorm 0.168 2.84s mem 81.1GB +[2026-09-14 10:47:41] step 760/5000 loss 0.2410 (w 0.1400 mse 0.1454 t 762 new 0.17) lr 1.00e-05 gnorm 0.151 2.84s mem 81.1GB +[2026-09-14 10:47:44] step 761/5000 loss 0.1337 (w 0.2529 mse 0.2373 t 947 new 0.19) lr 1.00e-05 gnorm 0.152 3.14s mem 81.1GB +[2026-09-14 10:47:47] step 762/5000 loss 0.2570 (w 0.2569 mse 0.2589 t 951 new 0.20) lr 1.00e-05 gnorm 0.191 3.09s mem 81.1GB +[2026-09-14 10:47:50] step 763/5000 loss 0.2292 (w 0.2514 mse 0.2565 t 842 new 0.22) lr 1.00e-05 gnorm 0.154 3.34s mem 81.1GB +[2026-09-14 10:47:54] step 764/5000 loss 0.1802 (w 0.1781 mse 0.1764 t 784 new 0.21) lr 1.00e-05 gnorm 0.172 3.38s mem 81.1GB +[2026-09-14 10:47:57] step 765/5000 loss 0.1903 (w 0.2590 mse 0.2538 t 974 new 0.24) lr 1.00e-05 gnorm 0.273 2.85s mem 81.1GB +[2026-09-14 10:48:00] step 766/5000 loss 0.2529 (w 0.2480 mse 0.2447 t 973 new 0.10) lr 1.00e-05 gnorm 0.185 2.85s mem 81.1GB +[2026-09-14 10:48:03] step 767/5000 loss 0.2315 (w 0.2952 mse 0.2929 t 947 new 0.21) lr 1.00e-05 gnorm 0.138 3.09s mem 81.1GB +[2026-09-14 10:48:06] step 768/5000 loss 0.2165 (w 0.5363 mse 0.5601 t 200 new 0.21) lr 1.00e-05 gnorm 0.133 3.09s mem 81.1GB +[2026-09-14 10:48:09] step 769/5000 loss 0.1809 (w 0.2693 mse 0.2587 t 984 new 0.18) lr 1.00e-05 gnorm 0.250 3.41s mem 81.1GB +[2026-09-14 10:48:12] step 770/5000 loss 0.3765 (w 0.2069 mse 0.2152 t 394 new 0.22) lr 1.00e-05 gnorm 0.149 3.14s mem 81.1GB +[2026-09-14 10:48:15] step 771/5000 loss 0.1756 (w 0.2552 mse 0.2449 t 948 new 0.17) lr 1.00e-05 gnorm 0.263 2.83s mem 81.1GB +[2026-09-14 10:48:18] step 772/5000 loss 0.2188 (w 0.2439 mse 0.2325 t 845 new 0.24) lr 1.00e-05 gnorm 0.150 2.83s mem 81.1GB +[2026-09-14 10:48:21] step 773/5000 loss 0.2659 (w 0.4239 mse 0.4167 t 348 new 0.23) lr 1.00e-05 gnorm 0.185 3.10s mem 81.1GB +[2026-09-14 10:48:25] step 774/5000 loss 0.3975 (w 0.3006 mse 0.2915 t 987 new 0.25) lr 1.00e-05 gnorm 0.162 3.60s mem 81.1GB +[2026-09-14 10:48:28] step 775/5000 loss 0.2717 (w 0.2288 mse 0.2308 t 773 new 0.19) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +[2026-09-14 10:48:31] step 776/5000 loss 0.1804 (w 0.2796 mse 0.2723 t 767 new 0.26) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +[2026-09-14 10:48:34] step 777/5000 loss 0.2723 (w 0.1462 mse 0.1545 t 832 new 0.24) lr 1.00e-05 gnorm 0.154 2.84s mem 81.1GB +[2026-09-14 10:48:37] step 778/5000 loss 0.3854 (w 0.1516 mse 0.1496 t 846 new 0.25) lr 1.00e-05 gnorm 0.189 2.84s mem 81.1GB +[2026-09-14 10:48:40] step 779/5000 loss 0.2325 (w 0.2652 mse 0.2536 t 827 new 0.16) lr 1.00e-05 gnorm 0.133 3.13s mem 81.1GB +[2026-09-14 10:48:43] step 780/5000 loss 0.2205 (w 0.1990 mse 0.1985 t 518 new 0.22) lr 1.00e-05 gnorm 0.136 3.32s mem 81.1GB +[2026-09-14 10:48:46] step 781/5000 loss 0.2155 (w 0.1305 mse 0.1445 t 941 new 0.17) lr 1.00e-05 gnorm 0.861 3.32s mem 81.1GB +[2026-09-14 10:48:49] step 782/5000 loss 0.2566 (w 0.3557 mse 0.3592 t 465 new 0.18) lr 1.00e-05 gnorm 0.184 2.84s mem 81.1GB +[2026-09-14 10:48:52] step 783/5000 loss 0.1476 (w 0.3247 mse 0.3273 t 979 new 0.08) lr 1.00e-05 gnorm 0.171 2.84s mem 81.1GB +[2026-09-14 10:48:55] step 784/5000 loss 0.2029 (w 0.4330 mse 0.4192 t 989 new 0.19) lr 1.00e-05 gnorm 0.183 2.83s mem 81.1GB +[2026-09-14 10:48:58] step 785/5000 loss 0.2991 (w 0.2413 mse 0.2262 t 712 new 0.21) lr 1.00e-05 gnorm 0.277 3.07s mem 81.1GB +[2026-09-14 10:49:01] step 786/5000 loss 0.1772 (w 0.2907 mse 0.2809 t 954 new 0.21) lr 1.00e-05 gnorm 0.481 3.36s mem 81.1GB +[2026-09-14 10:49:05] step 787/5000 loss 0.2035 (w 0.2221 mse 0.2262 t 983 new 0.08) lr 1.00e-05 gnorm 0.157 3.39s mem 81.1GB +[2026-09-14 10:49:08] step 788/5000 loss 0.2948 (w 0.3791 mse 0.3792 t 962 new 0.19) lr 1.00e-05 gnorm 0.164 3.00s mem 81.1GB +[2026-09-14 10:49:11] step 789/5000 loss 0.2974 (w 0.1627 mse 0.1613 t 928 new 0.18) lr 1.00e-05 gnorm 0.482 2.85s mem 81.1GB +[2026-09-14 10:49:13] step 790/5000 loss 0.3602 (w 0.3210 mse 0.3129 t 453 new 0.15) lr 1.00e-05 gnorm 0.164 2.85s mem 81.1GB +[2026-09-14 10:49:17] step 791/5000 loss 0.1204 (w 0.2259 mse 0.2168 t 974 new 0.19) lr 1.00e-05 gnorm 0.126 3.48s mem 81.1GB +[2026-09-14 10:49:20] step 792/5000 loss 0.2340 (w 0.2644 mse 0.2562 t 828 new 0.19) lr 1.00e-05 gnorm 0.281 3.36s mem 81.1GB +[2026-09-14 10:49:24] step 793/5000 loss 0.1689 (w 0.3692 mse 0.3618 t 996 new 0.23) lr 1.00e-05 gnorm 0.197 3.45s mem 81.1GB +[2026-09-14 10:49:27] step 794/5000 loss 0.1576 (w 0.1892 mse 0.1931 t 929 new 0.22) lr 1.00e-05 gnorm 0.294 2.85s mem 81.1GB +[2026-09-14 10:49:29] step 795/5000 loss 0.0833 (w 0.2456 mse 0.2402 t 991 new 0.25) lr 1.00e-05 gnorm 0.116 2.86s mem 81.1GB +[2026-09-14 10:49:33] step 796/5000 loss 0.4829 (w 0.3432 mse 0.3381 t 453 new 0.20) lr 1.00e-05 gnorm 0.162 3.15s mem 81.1GB +[2026-09-14 10:49:36] step 797/5000 loss 0.2773 (w 0.2215 mse 0.2343 t 808 new 0.16) lr 1.00e-05 gnorm 0.384 3.05s mem 81.1GB +[2026-09-14 10:49:39] step 798/5000 loss 0.2194 (w 0.2257 mse 0.2310 t 938 new 0.20) lr 1.00e-05 gnorm 0.166 3.52s mem 81.1GB +[2026-09-14 10:49:42] step 799/5000 loss 0.1221 (w 0.2376 mse 0.2422 t 979 new 0.10) lr 1.00e-05 gnorm 0.214 3.09s mem 81.1GB +[2026-09-14 10:49:45] step 800/5000 loss 0.1046 (w 0.1709 mse 0.1821 t 816 new 0.21) lr 1.00e-05 gnorm 0.188 2.84s mem 81.1GB +[2026-09-14 10:49:48] step 801/5000 loss 0.2568 (w 0.4527 mse 0.4386 t 976 new 0.24) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +[2026-09-14 10:49:51] step 802/5000 loss 0.2231 (w 0.2410 mse 0.2237 t 834 new 0.28) lr 1.00e-05 gnorm 0.172 3.30s mem 81.1GB +[2026-09-14 10:49:54] step 803/5000 loss 0.2238 (w 0.0965 mse 0.1111 t 832 new 0.18) lr 1.00e-05 gnorm 0.300 3.06s mem 81.1GB +[2026-09-14 10:49:58] step 804/5000 loss 0.1818 (w 0.0973 mse 0.1007 t 845 new 0.09) lr 1.00e-05 gnorm 0.367 3.23s mem 81.1GB +[2026-09-14 10:50:01] step 805/5000 loss 0.2117 (w 0.2819 mse 0.2732 t 835 new 0.22) lr 1.00e-05 gnorm 0.147 3.19s mem 81.1GB +[2026-09-14 10:50:04] step 806/5000 loss 0.1579 (w 0.1918 mse 0.2017 t 875 new 0.21) lr 1.00e-05 gnorm 0.151 2.84s mem 81.1GB +[2026-09-14 10:50:06] step 807/5000 loss 0.2327 (w 0.4675 mse 0.4633 t 998 new 0.19) lr 1.00e-05 gnorm 0.178 2.85s mem 81.1GB +[2026-09-14 10:50:10] step 808/5000 loss 0.2268 (w 0.3036 mse 0.2881 t 971 new 0.25) lr 1.00e-05 gnorm 0.236 3.09s mem 81.1GB +[2026-09-14 10:50:13] step 809/5000 loss 0.1829 (w 0.2035 mse 0.1966 t 901 new 0.24) lr 1.00e-05 gnorm 0.175 3.37s mem 81.1GB +[2026-09-14 10:50:16] step 810/5000 loss 0.1387 (w 0.2102 mse 0.1866 t 835 new 0.20) lr 1.00e-05 gnorm 0.155 3.29s mem 81.1GB +[2026-09-14 10:50:19] step 811/5000 loss 0.1031 (w 0.5279 mse 0.5104 t 991 new 0.19) lr 1.00e-05 gnorm 0.187 2.84s mem 81.1GB +[2026-09-14 10:50:22] step 812/5000 loss 0.3983 (w 0.2525 mse 0.2407 t 847 new 0.20) lr 1.00e-05 gnorm 0.207 2.85s mem 81.1GB +[2026-09-14 10:50:25] step 813/5000 loss 0.1495 (w 0.4102 mse 0.3833 t 982 new 0.23) lr 1.00e-05 gnorm 0.116 2.85s mem 81.1GB +[2026-09-14 10:50:28] step 814/5000 loss 0.1985 (w 0.1551 mse 0.1460 t 822 new 0.22) lr 1.00e-05 gnorm 0.204 3.12s mem 81.1GB +[2026-09-14 10:50:32] step 815/5000 loss 0.2988 (w 0.2698 mse 0.2644 t 549 new 0.20) lr 1.00e-05 gnorm 0.144 3.41s mem 81.1GB +[2026-09-14 10:50:35] step 816/5000 loss 0.3882 (w 0.3287 mse 0.3236 t 383 new 0.19) lr 1.00e-05 gnorm 0.117 3.39s mem 81.1GB +[2026-09-14 10:50:38] step 817/5000 loss 0.1659 (w 0.2792 mse 0.2657 t 956 new 0.23) lr 1.00e-05 gnorm 0.117 2.85s mem 81.1GB +[2026-09-14 10:50:41] step 818/5000 loss 0.3125 (w 0.1474 mse 0.1609 t 930 new 0.17) lr 1.00e-05 gnorm 0.136 2.86s mem 81.1GB +[2026-09-14 10:50:44] step 819/5000 loss 0.1320 (w 0.2990 mse 0.2890 t 998 new 0.23) lr 1.00e-05 gnorm 0.720 2.86s mem 81.1GB +[2026-09-14 10:50:47] step 820/5000 loss 0.1499 (w 0.3140 mse 0.2988 t 1000 new 0.13) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +[2026-09-14 10:50:50] step 821/5000 loss 0.1833 (w 0.2044 mse 0.2177 t 757 new 0.19) lr 1.00e-05 gnorm 0.147 3.67s mem 81.1GB +[2026-09-14 10:50:53] step 822/5000 loss 0.2665 (w 0.4338 mse 0.4236 t 984 new 0.28) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +[2026-09-14 10:50:56] step 823/5000 loss 0.1831 (w 0.4911 mse 0.4835 t 978 new 0.17) lr 1.00e-05 gnorm 0.189 2.86s mem 81.1GB +[2026-09-14 10:50:59] step 824/5000 loss 0.1353 (w 0.2224 mse 0.2118 t 872 new 0.21) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +[2026-09-14 10:51:02] step 825/5000 loss 0.4665 (w 0.3106 mse 0.3087 t 623 new 0.26) lr 1.00e-05 gnorm 0.205 2.86s mem 81.1GB +[2026-09-14 10:51:06] step 826/5000 loss 0.1582 (w 0.2492 mse 0.2411 t 952 new 0.24) lr 1.00e-05 gnorm 0.185 3.43s mem 81.1GB +[2026-09-14 10:51:09] step 827/5000 loss 0.3631 (w 0.2610 mse 0.2440 t 845 new 0.27) lr 1.00e-05 gnorm 0.164 3.14s mem 81.1GB +[2026-09-14 10:51:12] step 828/5000 loss 0.2188 (w 0.2218 mse 0.2185 t 922 new 0.13) lr 1.00e-05 gnorm 0.704 3.07s mem 81.1GB +[2026-09-14 10:51:15] step 829/5000 loss 0.1447 (w 0.2487 mse 0.2533 t 720 new 0.17) lr 1.00e-05 gnorm 0.245 2.84s mem 81.1GB +[2026-09-14 10:51:18] step 830/5000 loss 0.3076 (w 0.3071 mse 0.3071 t 923 new 0.15) lr 1.00e-05 gnorm 0.172 2.84s mem 81.1GB +[2026-09-14 10:51:21] step 831/5000 loss 0.2492 (w 0.3260 mse 0.3113 t 859 new 0.26) lr 1.00e-05 gnorm 3.028 3.04s mem 81.1GB +[2026-09-14 10:51:24] step 832/5000 loss 0.2483 (w 0.2205 mse 0.2080 t 729 new 0.22) lr 1.00e-05 gnorm 0.150 3.42s mem 81.1GB +[2026-09-14 10:51:27] step 833/5000 loss 0.4125 (w 0.2759 mse 0.2705 t 582 new 0.20) lr 1.00e-05 gnorm 0.216 3.16s mem 81.1GB +[2026-09-14 10:51:30] step 834/5000 loss 0.2980 (w 0.2583 mse 0.2499 t 927 new 0.20) lr 1.00e-05 gnorm 0.129 3.11s mem 81.1GB +[2026-09-14 10:51:33] step 835/5000 loss 0.1910 (w 0.3916 mse 0.3706 t 980 new 0.24) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +[2026-09-14 10:51:36] step 836/5000 loss 0.1289 (w 0.4028 mse 0.4094 t 975 new 0.19) lr 1.00e-05 gnorm 0.165 2.85s mem 81.1GB +[2026-09-14 10:51:39] step 837/5000 loss 0.1542 (w 0.2150 mse 0.2070 t 716 new 0.19) lr 1.00e-05 gnorm 0.150 3.28s mem 81.1GB +[2026-09-14 10:51:43] step 838/5000 loss 0.3050 (w 0.0998 mse 0.1019 t 797 new 0.21) lr 1.00e-05 gnorm 0.170 3.54s mem 81.1GB +[2026-09-14 10:51:46] step 839/5000 loss 0.1123 (w 0.2301 mse 0.2302 t 943 new 0.03) lr 1.00e-05 gnorm 0.163 3.44s mem 81.1GB +[2026-09-14 10:51:50] step 840/5000 loss 0.4163 (w 0.1451 mse 0.1584 t 774 new 0.19) lr 1.00e-05 gnorm 0.151 3.09s mem 81.1GB +[2026-09-14 10:51:52] step 841/5000 loss 0.1575 (w 0.3677 mse 0.3652 t 957 new 0.18) lr 1.00e-05 gnorm 0.155 2.85s mem 81.1GB +[2026-09-14 10:51:55] step 842/5000 loss 0.2256 (w 0.2522 mse 0.2730 t 974 new 0.19) lr 1.00e-05 gnorm 0.234 2.85s mem 81.1GB +[2026-09-14 10:51:58] step 843/5000 loss 0.1174 (w 0.2821 mse 0.2699 t 967 new 0.23) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +[2026-09-14 10:52:02] step 844/5000 loss 0.4286 (w 0.2051 mse 0.2025 t 967 new 0.24) lr 1.00e-05 gnorm 0.175 3.47s mem 81.1GB +[2026-09-14 10:52:05] step 845/5000 loss 0.1823 (w 0.3126 mse 0.3067 t 999 new 0.23) lr 1.00e-05 gnorm 0.155 3.52s mem 81.1GB +[2026-09-14 10:52:08] step 846/5000 loss 0.2588 (w 0.2289 mse 0.2229 t 962 new 0.24) lr 1.00e-05 gnorm 0.137 3.10s mem 81.1GB +[2026-09-14 10:52:11] step 847/5000 loss 0.1434 (w 0.1207 mse 0.1196 t 926 new 0.20) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +[2026-09-14 10:52:14] step 848/5000 loss 0.1896 (w 0.1986 mse 0.1943 t 735 new 0.19) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +[2026-09-14 10:52:17] step 849/5000 loss 0.2707 (w 0.1705 mse 0.1859 t 849 new 0.17) lr 1.00e-05 gnorm 0.238 3.11s mem 81.1GB +[2026-09-14 10:52:21] step 850/5000 loss 0.1431 (w 0.3691 mse 0.3618 t 974 new 0.27) lr 1.00e-05 gnorm 0.129 3.51s mem 81.1GB +[2026-09-14 10:52:24] step 851/5000 loss 0.2296 (w 0.4117 mse 0.3868 t 984 new 0.19) lr 1.00e-05 gnorm 0.463 3.23s mem 81.1GB +[2026-09-14 10:52:27] step 852/5000 loss 0.1889 (w 0.2013 mse 0.2066 t 741 new 0.20) lr 1.00e-05 gnorm 0.347 3.10s mem 81.1GB +[2026-09-14 10:52:30] step 853/5000 loss 0.2577 (w 0.1781 mse 0.1907 t 850 new 0.19) lr 1.00e-05 gnorm 0.290 2.87s mem 81.1GB +[2026-09-14 10:52:33] step 854/5000 loss 0.3208 (w 0.1689 mse 0.1671 t 837 new 0.23) lr 1.00e-05 gnorm 0.225 2.86s mem 81.1GB +[2026-09-14 10:52:36] step 855/5000 loss 0.1556 (w 0.2950 mse 0.2813 t 666 new 0.21) lr 1.00e-05 gnorm 0.179 3.02s mem 81.1GB +[2026-09-14 10:52:39] step 856/5000 loss 0.3081 (w 0.3265 mse 0.3260 t 953 new 0.22) lr 1.00e-05 gnorm 0.602 3.49s mem 81.1GB +[2026-09-14 10:52:43] step 857/5000 loss 0.4550 (w 0.1012 mse 0.1110 t 893 new 0.27) lr 1.00e-05 gnorm 0.645 3.24s mem 81.1GB +[2026-09-14 10:52:46] step 858/5000 loss 0.2088 (w 0.3618 mse 0.3512 t 988 new 0.18) lr 1.00e-05 gnorm 0.181 3.10s mem 81.1GB +[2026-09-14 10:52:49] step 859/5000 loss 0.3886 (w 0.2898 mse 0.2832 t 876 new 0.14) lr 1.00e-05 gnorm 0.183 2.84s mem 81.1GB +[2026-09-14 10:52:51] step 860/5000 loss 0.2834 (w 0.2937 mse 0.2887 t 944 new 0.22) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +[2026-09-14 10:52:55] step 861/5000 loss 0.2726 (w 0.1880 mse 0.1920 t 852 new 0.08) lr 1.00e-05 gnorm 0.179 3.08s mem 81.1GB +[2026-09-14 10:52:58] step 862/5000 loss 0.2635 (w 0.1961 mse 0.1937 t 857 new 0.23) lr 1.00e-05 gnorm 0.172 3.57s mem 81.1GB +[2026-09-14 10:53:01] step 863/5000 loss 0.2947 (w 0.3736 mse 0.3730 t 979 new 0.10) lr 1.00e-05 gnorm 0.130 3.16s mem 81.1GB +[2026-09-14 10:53:04] step 864/5000 loss 0.3332 (w 0.3136 mse 0.2905 t 936 new 0.21) lr 1.00e-05 gnorm 0.159 3.08s mem 81.1GB +[2026-09-14 10:53:07] step 865/5000 loss 0.1624 (w 0.2767 mse 0.2792 t 1000 new 0.22) lr 1.00e-05 gnorm 0.297 2.86s mem 81.1GB +[2026-09-14 10:53:10] step 866/5000 loss 0.2379 (w 0.2483 mse 0.2444 t 922 new 0.11) lr 1.00e-05 gnorm 0.162 2.85s mem 81.1GB +[2026-09-14 10:53:13] step 867/5000 loss 0.1560 (w 0.1984 mse 0.1878 t 984 new 0.22) lr 1.00e-05 gnorm 0.645 3.06s mem 81.1GB +[2026-09-14 10:53:17] step 868/5000 loss 0.2037 (w 0.1181 mse 0.1302 t 857 new 0.21) lr 1.00e-05 gnorm 0.139 3.54s mem 81.1GB +[2026-09-14 10:53:20] step 869/5000 loss 0.1847 (w 0.2556 mse 0.2507 t 855 new 0.22) lr 1.00e-05 gnorm 0.209 3.31s mem 81.1GB +[2026-09-14 10:53:23] step 870/5000 loss 0.2676 (w 0.2261 mse 0.2109 t 768 new 0.21) lr 1.00e-05 gnorm 0.164 2.85s mem 81.1GB +[2026-09-14 10:53:26] step 871/5000 loss 0.2984 (w 0.1021 mse 0.1039 t 886 new 0.10) lr 1.00e-05 gnorm 0.238 2.85s mem 81.1GB +[2026-09-14 10:53:29] step 872/5000 loss 0.3008 (w 0.2256 mse 0.2181 t 676 new 0.21) lr 1.00e-05 gnorm 0.151 3.03s mem 81.1GB +[2026-09-14 10:53:32] step 873/5000 loss 0.2384 (w 0.2146 mse 0.2063 t 742 new 0.21) lr 1.00e-05 gnorm 0.210 3.19s mem 81.1GB +[2026-09-14 10:53:36] step 874/5000 loss 0.2947 (w 0.4618 mse 0.4601 t 989 new 0.15) lr 1.00e-05 gnorm 0.164 3.14s mem 81.1GB +[2026-09-14 10:53:39] step 875/5000 loss 0.2424 (w 0.3099 mse 0.3007 t 668 new 0.08) lr 1.00e-05 gnorm 0.196 3.34s mem 81.1GB +[2026-09-14 10:53:42] step 876/5000 loss 0.2894 (w 0.3098 mse 0.3121 t 992 new 0.18) lr 1.00e-05 gnorm 0.148 2.85s mem 81.1GB +[2026-09-14 10:53:45] step 877/5000 loss 0.1995 (w 0.3046 mse 0.3043 t 964 new 0.21) lr 1.00e-05 gnorm 0.186 2.84s mem 81.1GB +[2026-09-14 10:53:48] step 878/5000 loss 0.3123 (w 0.3356 mse 0.3311 t 414 new 0.18) lr 1.00e-05 gnorm 0.179 3.26s mem 81.1GB +[2026-09-14 10:53:51] step 879/5000 loss 0.1092 (w 0.1796 mse 0.1723 t 899 new 0.21) lr 1.00e-05 gnorm 0.217 3.35s mem 81.1GB +[2026-09-14 10:53:55] step 880/5000 loss 0.2675 (w 0.2976 mse 0.3006 t 690 new 0.15) lr 1.00e-05 gnorm 0.165 3.50s mem 81.1GB +[2026-09-14 10:53:58] step 881/5000 loss 0.1901 (w 0.1774 mse 0.1801 t 860 new 0.22) lr 1.00e-05 gnorm 0.122 3.11s mem 81.1GB +[2026-09-14 10:54:01] step 882/5000 loss 0.1539 (w 0.2969 mse 0.2890 t 970 new 0.24) lr 1.00e-05 gnorm 0.333 2.85s mem 81.1GB +[2026-09-14 10:54:03] step 883/5000 loss 0.2490 (w 0.2033 mse 0.2155 t 991 new 0.14) lr 1.00e-05 gnorm 0.152 2.85s mem 81.1GB +[2026-09-14 10:54:07] step 884/5000 loss 0.2696 (w 0.2569 mse 0.2538 t 950 new 0.28) lr 1.00e-05 gnorm 0.214 3.10s mem 81.1GB +[2026-09-14 10:54:10] step 885/5000 loss 0.1363 (w 0.2207 mse 0.2056 t 845 new 0.21) lr 1.00e-05 gnorm 0.132 3.47s mem 81.1GB +[2026-09-14 10:54:14] step 886/5000 loss 0.1477 (w 0.1788 mse 0.1812 t 568 new 0.21) lr 1.00e-05 gnorm 0.165 3.40s mem 81.1GB +[2026-09-14 10:54:17] step 887/5000 loss 0.1531 (w 0.8148 mse 0.7547 t 996 new 0.19) lr 1.00e-05 gnorm 0.120 3.11s mem 81.1GB +[2026-09-14 10:54:20] step 888/5000 loss 0.2479 (w 0.1981 mse 0.2079 t 574 new 0.13) lr 1.00e-05 gnorm 0.137 2.85s mem 81.1GB +[2026-09-14 10:54:23] step 889/5000 loss 0.2496 (w 0.2663 mse 0.2468 t 881 new 0.27) lr 1.00e-05 gnorm 1.026 2.87s mem 81.1GB +[2026-09-14 10:54:26] step 890/5000 loss 0.2304 (w 0.2729 mse 0.2621 t 990 new 0.16) lr 1.00e-05 gnorm 0.174 3.13s mem 81.1GB +[2026-09-14 10:54:29] step 891/5000 loss 0.1342 (w 0.2219 mse 0.2189 t 827 new 0.19) lr 1.00e-05 gnorm 0.165 3.81s mem 81.1GB +[2026-09-14 10:54:33] step 892/5000 loss 0.1407 (w 0.2836 mse 0.2833 t 981 new 0.22) lr 1.00e-05 gnorm 0.185 3.07s mem 81.1GB +[2026-09-14 10:54:36] step 893/5000 loss 0.2090 (w 0.1700 mse 0.1662 t 858 new 0.24) lr 1.00e-05 gnorm 0.253 3.35s mem 81.1GB +[2026-09-14 10:54:39] step 894/5000 loss 0.2463 (w 0.2798 mse 0.2872 t 390 new 0.21) lr 1.00e-05 gnorm 0.140 2.85s mem 81.1GB +[2026-09-14 10:54:42] step 895/5000 loss 0.2747 (w 0.3397 mse 0.3233 t 259 new 0.21) lr 1.00e-05 gnorm 0.384 2.85s mem 81.1GB +[2026-09-14 10:54:45] step 896/5000 loss 0.1606 (w 0.1363 mse 0.1371 t 835 new 0.21) lr 1.00e-05 gnorm 0.174 3.44s mem 81.1GB +[2026-09-14 10:54:49] step 897/5000 loss 0.3470 (w 0.3504 mse 0.3503 t 292 new 0.17) lr 1.00e-05 gnorm 0.379 3.39s mem 81.1GB +[2026-09-14 10:54:52] step 898/5000 loss 0.2393 (w 0.1807 mse 0.1846 t 758 new 0.19) lr 1.00e-05 gnorm 0.126 3.11s mem 81.1GB +[2026-09-14 10:54:55] step 899/5000 loss 0.2905 (w 0.2968 mse 0.2807 t 903 new 0.19) lr 1.00e-05 gnorm 0.179 3.12s mem 81.1GB +[2026-09-14 10:54:58] step 900/5000 loss 0.4070 (w 0.1689 mse 0.1581 t 901 new 0.23) lr 1.00e-05 gnorm 0.188 2.85s mem 81.1GB +[2026-09-14 10:55:01] step 901/5000 loss 0.2252 (w 0.3368 mse 0.3303 t 958 new 0.08) lr 1.00e-05 gnorm 0.156 2.86s mem 81.1GB +[2026-09-14 10:55:04] step 902/5000 loss 0.2759 (w 0.2942 mse 0.2751 t 924 new 0.23) lr 1.00e-05 gnorm 0.160 3.45s mem 81.1GB +[2026-09-14 10:55:07] step 903/5000 loss 0.1134 (w 0.2968 mse 0.2941 t 964 new 0.23) lr 1.00e-05 gnorm 0.122 3.08s mem 81.1GB +[2026-09-14 10:55:10] step 904/5000 loss 0.1485 (w 0.2807 mse 0.2707 t 969 new 0.30) lr 1.00e-05 gnorm 0.167 3.13s mem 81.1GB +[2026-09-14 10:55:14] step 905/5000 loss 0.0926 (w 0.1194 mse 0.1372 t 924 new 0.18) lr 1.00e-05 gnorm 0.155 3.15s mem 81.1GB +[2026-09-14 10:55:16] step 906/5000 loss 0.2795 (w 0.0687 mse 0.0697 t 727 new 0.14) lr 1.00e-05 gnorm 1.045 2.85s mem 81.1GB +[2026-09-14 10:55:19] step 907/5000 loss 0.2309 (w 0.2161 mse 0.2004 t 852 new 0.18) lr 1.00e-05 gnorm 0.134 3.03s mem 81.1GB +[2026-09-14 10:55:23] step 908/5000 loss 0.1535 (w 0.3550 mse 0.3581 t 411 new 0.16) lr 1.00e-05 gnorm 0.213 3.23s mem 81.1GB +[2026-09-14 10:55:26] step 909/5000 loss 0.3592 (w 0.2537 mse 0.2580 t 447 new 0.23) lr 1.00e-05 gnorm 0.191 3.12s mem 81.1GB +[2026-09-14 10:55:29] step 910/5000 loss 0.1699 (w 0.1766 mse 0.1733 t 943 new 0.21) lr 1.00e-05 gnorm 0.118 3.52s mem 81.1GB +[2026-09-14 10:55:32] step 911/5000 loss 0.3312 (w 0.2986 mse 0.2884 t 905 new 0.22) lr 1.00e-05 gnorm 0.209 2.85s mem 81.1GB +[2026-09-14 10:55:35] step 912/5000 loss 0.2297 (w 0.2091 mse 0.2059 t 945 new 0.20) lr 1.00e-05 gnorm 0.139 2.86s mem 81.1GB +[2026-09-14 10:55:38] step 913/5000 loss 0.3129 (w 0.2783 mse 0.2726 t 670 new 0.20) lr 1.00e-05 gnorm 0.173 3.03s mem 81.1GB +[2026-09-14 10:55:42] step 914/5000 loss 0.2605 (w 0.1940 mse 0.1882 t 319 new 0.19) lr 1.00e-05 gnorm 0.158 3.49s mem 81.1GB +[2026-09-14 10:55:45] step 915/5000 loss 0.4023 (w 0.2045 mse 0.2121 t 698 new 0.23) lr 1.00e-05 gnorm 0.315 3.33s mem 81.1GB +[2026-09-14 10:55:48] step 916/5000 loss 0.4410 (w 0.2642 mse 0.2532 t 883 new 0.19) lr 1.00e-05 gnorm 0.378 3.28s mem 81.1GB +[2026-09-14 10:55:51] step 917/5000 loss 0.2935 (w 0.2708 mse 0.2503 t 910 new 0.19) lr 1.00e-05 gnorm 0.185 2.86s mem 81.1GB +[2026-09-14 10:55:54] step 918/5000 loss 0.2057 (w 0.2874 mse 0.2800 t 839 new 0.13) lr 1.00e-05 gnorm 0.174 2.85s mem 81.1GB +[2026-09-14 10:55:57] step 919/5000 loss 0.2486 (w 0.5927 mse 0.6072 t 120 new 0.23) lr 1.00e-05 gnorm 0.250 3.10s mem 81.1GB +[2026-09-14 10:56:00] step 920/5000 loss 0.2928 (w 0.3484 mse 0.3362 t 607 new 0.08) lr 1.00e-05 gnorm 0.291 3.44s mem 81.1GB +[2026-09-14 10:56:04] step 921/5000 loss 0.2612 (w 0.1980 mse 0.2077 t 999 new 0.10) lr 1.00e-05 gnorm 0.159 3.37s mem 81.1GB +[2026-09-14 10:56:07] step 922/5000 loss 0.3634 (w 0.2677 mse 0.2663 t 953 new 0.17) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +[2026-09-14 10:56:10] step 923/5000 loss 0.3020 (w 0.1819 mse 0.1823 t 943 new 0.22) lr 1.00e-05 gnorm 0.142 2.85s mem 81.1GB +[2026-09-14 10:56:13] step 924/5000 loss 0.2687 (w 0.1727 mse 0.1701 t 551 new 0.08) lr 1.00e-05 gnorm 0.286 2.85s mem 81.1GB +[2026-09-14 10:56:16] step 925/5000 loss 0.3544 (w 0.2179 mse 0.2218 t 935 new 0.28) lr 1.00e-05 gnorm 0.170 3.03s mem 81.1GB +[2026-09-14 10:56:19] step 926/5000 loss 0.2285 (w 0.2947 mse 0.2890 t 572 new 0.16) lr 1.00e-05 gnorm 0.133 3.50s mem 81.1GB +[2026-09-14 10:56:22] step 927/5000 loss 0.2602 (w 0.2642 mse 0.2490 t 950 new 0.24) lr 1.00e-05 gnorm 0.274 3.37s mem 81.1GB +[2026-09-14 10:56:26] step 928/5000 loss 0.2127 (w 0.2866 mse 0.2769 t 973 new 0.16) lr 1.00e-05 gnorm 0.253 3.12s mem 81.1GB +[2026-09-14 10:56:28] step 929/5000 loss 0.2427 (w 0.3648 mse 0.3440 t 953 new 0.28) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +[2026-09-14 10:56:31] step 930/5000 loss 0.2302 (w 0.2135 mse 0.1936 t 832 new 0.19) lr 1.00e-05 gnorm 0.148 2.84s mem 81.1GB +[2026-09-14 10:56:35] step 931/5000 loss 0.1911 (w 0.3156 mse 0.3046 t 994 new 0.22) lr 1.00e-05 gnorm 0.198 3.50s mem 81.1GB +[2026-09-14 10:56:38] step 932/5000 loss 0.2101 (w 0.1191 mse 0.1204 t 876 new 0.19) lr 1.00e-05 gnorm 0.163 3.34s mem 81.1GB +[2026-09-14 10:56:41] step 933/5000 loss 0.1854 (w 0.3722 mse 0.3626 t 999 new 0.16) lr 1.00e-05 gnorm 0.163 3.06s mem 81.1GB +[2026-09-14 10:56:44] step 934/5000 loss 0.1842 (w 0.2986 mse 0.3287 t 183 new 0.20) lr 1.00e-05 gnorm 0.150 3.05s mem 81.1GB +[2026-09-14 10:56:47] step 935/5000 loss 0.2394 (w 0.2608 mse 0.2642 t 283 new 0.09) lr 1.00e-05 gnorm 0.222 2.84s mem 81.1GB +[2026-09-14 10:56:50] step 936/5000 loss 0.2784 (w 0.1620 mse 0.1608 t 748 new 0.22) lr 1.00e-05 gnorm 0.247 3.02s mem 81.1GB +[2026-09-14 10:56:53] step 937/5000 loss 0.3023 (w 0.2444 mse 0.2498 t 562 new 0.10) lr 1.00e-05 gnorm 0.139 3.26s mem 81.1GB +[2026-09-14 10:56:57] step 938/5000 loss 0.1512 (w 0.2081 mse 0.2075 t 977 new 0.11) lr 1.00e-05 gnorm 0.376 3.40s mem 81.1GB +[2026-09-14 10:57:00] step 939/5000 loss 0.2093 (w 0.2253 mse 0.2178 t 836 new 0.21) lr 1.00e-05 gnorm 0.216 3.06s mem 81.1GB +[2026-09-14 10:57:03] step 940/5000 loss 0.1929 (w 0.1292 mse 0.1389 t 853 new 0.18) lr 1.00e-05 gnorm 0.261 3.13s mem 81.1GB +[2026-09-14 10:57:06] step 941/5000 loss 0.1771 (w 0.3359 mse 0.3137 t 981 new 0.20) lr 1.00e-05 gnorm 0.150 2.86s mem 81.1GB +[2026-09-14 10:57:09] step 942/5000 loss 0.2696 (w 0.2216 mse 0.2263 t 901 new 0.19) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +[2026-09-14 10:57:12] step 943/5000 loss 0.1615 (w 0.2197 mse 0.2215 t 933 new 0.20) lr 1.00e-05 gnorm 0.129 3.15s mem 81.1GB +[2026-09-14 10:57:15] step 944/5000 loss 0.1611 (w 0.4502 mse 0.4427 t 975 new 0.24) lr 1.00e-05 gnorm 0.155 3.39s mem 81.1GB +[2026-09-14 10:57:19] step 945/5000 loss 0.2658 (w 0.3900 mse 0.3850 t 991 new 0.22) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-14 10:57:22] step 946/5000 loss 0.2540 (w 0.3279 mse 0.3141 t 932 new 0.25) lr 1.00e-05 gnorm 0.149 3.13s mem 81.1GB +[2026-09-14 10:57:25] step 947/5000 loss 0.1950 (w 0.2757 mse 0.2623 t 913 new 0.11) lr 1.00e-05 gnorm 0.161 2.84s mem 81.1GB +[2026-09-14 10:57:28] step 948/5000 loss 0.2099 (w 0.2243 mse 0.2197 t 663 new 0.14) lr 1.00e-05 gnorm 0.133 3.11s mem 81.1GB +[2026-09-14 10:57:31] step 949/5000 loss 0.1640 (w 0.2774 mse 0.2796 t 965 new 0.24) lr 1.00e-05 gnorm 0.135 3.15s mem 81.1GB +[2026-09-14 10:57:34] step 950/5000 loss 0.2450 (w 0.2070 mse 0.2298 t 431 new 0.23) lr 1.00e-05 gnorm 0.204 3.40s mem 81.1GB +[2026-09-14 10:57:38] step 951/5000 loss 0.1845 (w 0.1182 mse 0.1099 t 909 new 0.12) lr 1.00e-05 gnorm 0.138 3.33s mem 81.1GB +[2026-09-14 10:57:40] step 952/5000 loss 0.3510 (w 0.2616 mse 0.2565 t 927 new 0.22) lr 1.00e-05 gnorm 0.204 2.84s mem 81.1GB +[2026-09-14 10:57:43] step 953/5000 loss 0.1119 (w 0.4204 mse 0.4149 t 996 new 0.19) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +[2026-09-14 10:57:46] step 954/5000 loss 0.1414 (w 0.3624 mse 0.3468 t 983 new 0.23) lr 1.00e-05 gnorm 0.191 3.09s mem 81.1GB +[2026-09-14 10:57:49] step 955/5000 loss 0.2019 (w 0.1499 mse 0.1357 t 839 new 0.24) lr 1.00e-05 gnorm 0.167 3.15s mem 81.1GB +[2026-09-14 10:57:53] step 956/5000 loss 0.2253 (w 0.2584 mse 0.2553 t 916 new 0.24) lr 1.00e-05 gnorm 0.167 3.44s mem 81.1GB +[2026-09-14 10:57:56] step 957/5000 loss 0.2681 (w 0.2322 mse 0.2214 t 833 new 0.24) lr 1.00e-05 gnorm 0.296 3.34s mem 81.1GB +[2026-09-14 10:57:59] step 958/5000 loss 0.3689 (w 0.3180 mse 0.3211 t 977 new 0.17) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +[2026-09-14 10:58:02] step 959/5000 loss 0.2414 (w 0.1990 mse 0.2059 t 951 new 0.20) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +[2026-09-14 10:58:05] step 960/5000 loss 0.2620 (w 0.2424 mse 0.2389 t 601 new 0.16) lr 1.00e-05 gnorm 0.174 3.12s mem 81.1GB +[2026-09-14 10:58:08] step 961/5000 loss 0.2329 (w 0.1816 mse 0.1824 t 819 new 0.18) lr 1.00e-05 gnorm 0.098 3.38s mem 81.1GB +[2026-09-14 10:58:12] step 962/5000 loss 0.1381 (w 0.2008 mse 0.2059 t 983 new 0.18) lr 1.00e-05 gnorm 0.258 3.33s mem 81.1GB +[2026-09-14 10:58:15] step 963/5000 loss 0.3166 (w 0.4331 mse 0.4120 t 986 new 0.23) lr 1.00e-05 gnorm 0.162 3.39s mem 81.1GB +[2026-09-14 10:58:18] step 964/5000 loss 0.1904 (w 0.1947 mse 0.1861 t 900 new 0.09) lr 1.00e-05 gnorm 0.176 2.86s mem 81.1GB +[2026-09-14 10:58:21] step 965/5000 loss 0.2764 (w 0.2517 mse 0.2312 t 813 new 0.25) lr 1.00e-05 gnorm 0.167 2.86s mem 81.1GB +[2026-09-14 10:58:24] step 966/5000 loss 0.1521 (w 0.1639 mse 0.1670 t 941 new 0.28) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +[2026-09-14 10:58:27] step 967/5000 loss 0.1623 (w 0.2781 mse 0.2710 t 925 new 0.27) lr 1.00e-05 gnorm 0.186 3.45s mem 81.1GB +[2026-09-14 10:58:31] step 968/5000 loss 0.2677 (w 0.1461 mse 0.1436 t 907 new 0.20) lr 1.00e-05 gnorm 0.144 3.34s mem 81.1GB +[2026-09-14 10:58:34] step 969/5000 loss 0.1835 (w 0.2730 mse 0.2645 t 936 new 0.21) lr 1.00e-05 gnorm 0.149 3.33s mem 81.1GB +[2026-09-14 10:58:37] step 970/5000 loss 0.1943 (w 0.1421 mse 0.1461 t 905 new 0.22) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +[2026-09-14 10:58:40] step 971/5000 loss 0.2529 (w 0.3190 mse 0.3132 t 973 new 0.25) lr 1.00e-05 gnorm 0.197 3.10s mem 81.1GB +[2026-09-14 10:58:43] step 972/5000 loss 0.2405 (w 0.1988 mse 0.1978 t 781 new 0.23) lr 1.00e-05 gnorm 0.218 2.85s mem 81.1GB +[2026-09-14 10:58:47] step 973/5000 loss 0.3537 (w 0.3027 mse 0.3003 t 428 new 0.19) lr 1.00e-05 gnorm 0.183 3.73s mem 81.1GB +[2026-09-14 10:58:50] step 974/5000 loss 0.1970 (w 0.2352 mse 0.2240 t 851 new 0.20) lr 1.00e-05 gnorm 0.272 3.09s mem 81.1GB +[2026-09-14 10:58:53] step 975/5000 loss 0.3879 (w 0.1749 mse 0.1895 t 811 new 0.12) lr 1.00e-05 gnorm 0.346 3.23s mem 81.1GB +[2026-09-14 10:58:56] step 976/5000 loss 0.2732 (w 0.1975 mse 0.1933 t 872 new 0.23) lr 1.00e-05 gnorm 0.309 2.85s mem 81.1GB +[2026-09-14 10:58:59] step 977/5000 loss 0.3384 (w 0.2153 mse 0.2269 t 498 new 0.09) lr 1.00e-05 gnorm 0.132 3.02s mem 81.1GB +[2026-09-14 10:59:02] step 978/5000 loss 0.2382 (w 0.1447 mse 0.1523 t 861 new 0.20) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +[2026-09-14 10:59:05] step 979/5000 loss 0.1888 (w 0.3016 mse 0.2910 t 803 new 0.21) lr 1.00e-05 gnorm 0.739 3.41s mem 81.1GB +[2026-09-14 10:59:09] step 980/5000 loss 0.1672 (w 0.2220 mse 0.2103 t 788 new 0.23) lr 1.00e-05 gnorm 0.173 3.45s mem 81.1GB +[2026-09-14 10:59:12] step 981/5000 loss 0.1614 (w 0.1947 mse 0.1888 t 884 new 0.21) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +[2026-09-14 10:59:15] step 982/5000 loss 0.1337 (w 0.2692 mse 0.2550 t 590 new 0.27) lr 1.00e-05 gnorm 0.163 2.84s mem 81.1GB +[2026-09-14 10:59:18] step 983/5000 loss 0.3180 (w 0.1423 mse 0.1485 t 964 new 0.23) lr 1.00e-05 gnorm 0.169 3.08s mem 81.1GB +[2026-09-14 10:59:21] step 984/5000 loss 0.3491 (w 0.2930 mse 0.2842 t 621 new 0.20) lr 1.00e-05 gnorm 0.160 3.15s mem 81.1GB +[2026-09-14 10:59:25] step 985/5000 loss 0.1154 (w 0.2714 mse 0.2615 t 963 new 0.21) lr 1.00e-05 gnorm 0.125 3.45s mem 81.1GB +[2026-09-14 10:59:28] step 986/5000 loss 0.3579 (w 0.2525 mse 0.2317 t 763 new 0.17) lr 1.00e-05 gnorm 0.287 3.06s mem 81.1GB +[2026-09-14 10:59:31] step 987/5000 loss 0.2887 (w 0.2126 mse 0.1996 t 934 new 0.20) lr 1.00e-05 gnorm 0.154 3.11s mem 81.1GB +[2026-09-14 10:59:34] step 988/5000 loss 0.2394 (w 0.2544 mse 0.2486 t 974 new 0.25) lr 1.00e-05 gnorm 0.241 2.86s mem 81.1GB +[2026-09-14 10:59:37] step 989/5000 loss 0.2924 (w 0.2942 mse 0.2984 t 633 new 0.21) lr 1.00e-05 gnorm 0.169 3.06s mem 81.1GB +[2026-09-14 10:59:40] step 990/5000 loss 0.4318 (w 0.1443 mse 0.1425 t 889 new 0.11) lr 1.00e-05 gnorm 0.163 3.17s mem 81.1GB +[2026-09-14 10:59:43] step 991/5000 loss 0.3808 (w 0.1950 mse 0.1914 t 624 new 0.20) lr 1.00e-05 gnorm 0.202 3.30s mem 81.1GB +[2026-09-14 10:59:47] step 992/5000 loss 0.1724 (w 0.1374 mse 0.1386 t 873 new 0.12) lr 1.00e-05 gnorm 0.116 3.31s mem 81.1GB +[2026-09-14 10:59:49] step 993/5000 loss 0.3171 (w 0.3874 mse 0.3622 t 998 new 0.19) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +[2026-09-14 10:59:52] step 994/5000 loss 0.3410 (w 0.1812 mse 0.1827 t 913 new 0.11) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +[2026-09-14 10:59:55] step 995/5000 loss 0.1719 (w 0.1946 mse 0.1847 t 754 new 0.23) lr 1.00e-05 gnorm 0.207 3.08s mem 81.1GB +[2026-09-14 10:59:58] step 996/5000 loss 0.2314 (w 0.2160 mse 0.2224 t 946 new 0.25) lr 1.00e-05 gnorm 0.171 3.17s mem 81.1GB +[2026-09-14 11:00:02] step 997/5000 loss 0.1294 (w 0.2141 mse 0.2075 t 968 new 0.24) lr 1.00e-05 gnorm 0.133 3.40s mem 81.1GB +[2026-09-14 11:00:05] step 998/5000 loss 0.2147 (w 0.2003 mse 0.2009 t 875 new 0.24) lr 1.00e-05 gnorm 0.176 3.06s mem 81.1GB +[2026-09-14 11:00:08] step 999/5000 loss 0.2623 (w 0.1470 mse 0.1526 t 870 new 0.25) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +[2026-09-14 11:00:11] step 1000/5000 loss 0.1574 (w 0.2271 mse 0.2191 t 933 new 0.16) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +[2026-09-14 11:00:13] [val] step 1000 t=200: w=0.4376 mse=0.4490 (n=16) t=500: w=0.2348 mse=0.2392 (n=16) t=800: w=0.1849 mse=0.1852 (n=16) | mean w=0.2858 mse=0.2911 2s +[2026-09-14 11:01:04] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step1000.safetensors 4093 个张量 37.98 GB +[2026-09-14 11:01:09] step 1001/5000 loss 0.3180 (w 0.4326 mse 0.4156 t 985 new 0.19) lr 1.00e-05 gnorm 1.523 3.49s mem 81.1GB +[2026-09-14 11:01:13] step 1002/5000 loss 0.0728 (w 0.2604 mse 0.2465 t 932 new 0.24) lr 1.00e-05 gnorm 0.225 3.74s mem 81.1GB +[2026-09-14 11:01:16] step 1003/5000 loss 0.2237 (w 0.6513 mse 0.6404 t 114 new 0.16) lr 1.00e-05 gnorm 0.297 3.05s mem 81.1GB +[2026-09-14 11:01:20] step 1004/5000 loss 0.2876 (w 0.3067 mse 0.3005 t 923 new 0.22) lr 1.00e-05 gnorm 0.179 3.36s mem 81.1GB +[2026-09-14 11:01:22] step 1005/5000 loss 0.2015 (w 0.2859 mse 0.2960 t 484 new 0.25) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +[2026-09-14 11:01:25] step 1006/5000 loss 0.2340 (w 0.2858 mse 0.2842 t 967 new 0.20) lr 1.00e-05 gnorm 0.146 3.09s mem 81.1GB +[2026-09-14 11:01:29] step 1007/5000 loss 0.2269 (w 0.2755 mse 0.2766 t 976 new 0.25) lr 1.00e-05 gnorm 0.178 3.38s mem 81.1GB +[2026-09-14 11:01:32] step 1008/5000 loss 0.1932 (w 0.2653 mse 0.2554 t 964 new 0.20) lr 1.00e-05 gnorm 0.126 3.55s mem 81.1GB +[2026-09-14 11:01:35] step 1009/5000 loss 0.1590 (w 0.2471 mse 0.2408 t 762 new 0.25) lr 1.00e-05 gnorm 0.156 3.06s mem 81.1GB +[2026-09-14 11:01:39] step 1010/5000 loss 0.1471 (w 0.2314 mse 0.2197 t 924 new 0.29) lr 1.00e-05 gnorm 0.146 3.28s mem 81.1GB +[2026-09-14 11:01:42] step 1011/5000 loss 0.2963 (w 0.2747 mse 0.2887 t 670 new 0.17) lr 1.00e-05 gnorm 0.253 2.85s mem 81.1GB +[2026-09-14 11:01:45] step 1012/5000 loss 0.1986 (w 0.2209 mse 0.2137 t 715 new 0.16) lr 1.00e-05 gnorm 0.126 3.44s mem 81.1GB +[2026-09-14 11:01:48] step 1013/5000 loss 0.1747 (w 0.2698 mse 0.2676 t 885 new 0.25) lr 1.00e-05 gnorm 0.158 3.11s mem 81.1GB +[2026-09-14 11:01:52] step 1014/5000 loss 0.3790 (w 0.3785 mse 0.3817 t 283 new 0.20) lr 1.00e-05 gnorm 0.188 3.29s mem 81.1GB +[2026-09-14 11:01:55] step 1015/5000 loss 0.2553 (w 0.2976 mse 0.2895 t 966 new 0.23) lr 1.00e-05 gnorm 0.216 3.06s mem 81.1GB +[2026-09-14 11:01:58] step 1016/5000 loss 0.2359 (w 0.2480 mse 0.2437 t 973 new 0.22) lr 1.00e-05 gnorm 0.123 3.18s mem 81.1GB +[2026-09-14 11:02:01] step 1017/5000 loss 0.3398 (w 0.2612 mse 0.2508 t 670 new 0.20) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +[2026-09-14 11:02:04] step 1018/5000 loss 0.3160 (w 0.1848 mse 0.1920 t 902 new 0.23) lr 1.00e-05 gnorm 0.149 3.24s mem 81.1GB +[2026-09-14 11:02:07] step 1019/5000 loss 0.0949 (w 0.2772 mse 0.2755 t 975 new 0.22) lr 1.00e-05 gnorm 0.261 3.37s mem 81.1GB +[2026-09-14 11:02:11] step 1020/5000 loss 0.2090 (w 0.2202 mse 0.2184 t 865 new 0.24) lr 1.00e-05 gnorm 1.011 3.19s mem 81.1GB +[2026-09-14 11:02:14] step 1021/5000 loss 0.2721 (w 0.2834 mse 0.2872 t 918 new 0.19) lr 1.00e-05 gnorm 0.189 3.12s mem 81.1GB +[2026-09-14 11:02:17] step 1022/5000 loss 0.3229 (w 0.2198 mse 0.2172 t 871 new 0.18) lr 1.00e-05 gnorm 3.701 3.11s mem 81.1GB +[2026-09-14 11:02:20] step 1023/5000 loss 0.2714 (w 0.6355 mse 0.6545 t 120 new 0.19) lr 1.00e-05 gnorm 0.131 2.85s mem 81.1GB +[2026-09-14 11:02:23] step 1024/5000 loss 0.2056 (w 0.3023 mse 0.3032 t 986 new 0.21) lr 1.00e-05 gnorm 0.138 3.31s mem 81.1GB +[2026-09-14 11:02:26] step 1025/5000 loss 0.1835 (w 0.2236 mse 0.2223 t 895 new 0.22) lr 1.00e-05 gnorm 0.141 3.36s mem 81.1GB +[2026-09-14 11:02:30] step 1026/5000 loss 0.1447 (w 0.2819 mse 0.2677 t 933 new 0.18) lr 1.00e-05 gnorm 0.207 3.37s mem 81.1GB +[2026-09-14 11:02:33] step 1027/5000 loss 0.2836 (w 0.3616 mse 0.3586 t 310 new 0.18) lr 1.00e-05 gnorm 0.131 3.49s mem 81.1GB +[2026-09-14 11:02:36] step 1028/5000 loss 0.1967 (w 0.4482 mse 0.4088 t 997 new 0.25) lr 1.00e-05 gnorm 0.348 2.86s mem 81.1GB +[2026-09-14 11:02:39] step 1029/5000 loss 0.2868 (w 0.3074 mse 0.2830 t 749 new 0.23) lr 1.00e-05 gnorm 0.130 3.14s mem 81.1GB +[2026-09-14 11:02:42] step 1030/5000 loss 0.1396 (w 0.1848 mse 0.2003 t 966 new 0.21) lr 1.00e-05 gnorm 0.171 3.09s mem 81.1GB +[2026-09-14 11:02:46] step 1031/5000 loss 0.2946 (w 0.4764 mse 0.4807 t 297 new 0.14) lr 1.00e-05 gnorm 0.155 3.43s mem 81.1GB +[2026-09-14 11:02:49] step 1032/5000 loss 0.1903 (w 0.2892 mse 0.2922 t 932 new 0.07) lr 1.00e-05 gnorm 0.128 3.21s mem 81.1GB +[2026-09-14 11:02:52] step 1033/5000 loss 0.2259 (w 0.2243 mse 0.2156 t 822 new 0.18) lr 1.00e-05 gnorm 0.240 3.43s mem 81.1GB +[2026-09-14 11:02:55] step 1034/5000 loss 0.2323 (w 0.2596 mse 0.2499 t 978 new 0.21) lr 1.00e-05 gnorm 3.806 2.85s mem 81.1GB +[2026-09-14 11:02:58] step 1035/5000 loss 0.2631 (w 0.3444 mse 0.3091 t 933 new 0.23) lr 1.00e-05 gnorm 0.149 3.15s mem 81.1GB +[2026-09-14 11:03:02] step 1036/5000 loss 0.1700 (w 0.1527 mse 0.1513 t 913 new 0.21) lr 1.00e-05 gnorm 0.178 3.31s mem 81.1GB +[2026-09-14 11:03:05] step 1037/5000 loss 0.2925 (w 0.1278 mse 0.1287 t 923 new 0.17) lr 1.00e-05 gnorm 0.165 3.39s mem 81.1GB +[2026-09-14 11:03:08] step 1038/5000 loss 0.1821 (w 0.2037 mse 0.1972 t 829 new 0.18) lr 1.00e-05 gnorm 0.124 3.13s mem 81.1GB +[2026-09-14 11:03:12] step 1039/5000 loss 0.1927 (w 0.1776 mse 0.1771 t 802 new 0.06) lr 1.00e-05 gnorm 0.203 3.37s mem 81.1GB +[2026-09-14 11:03:14] step 1040/5000 loss 0.3460 (w 0.2904 mse 0.2933 t 644 new 0.27) lr 1.00e-05 gnorm 0.199 2.84s mem 81.1GB +[2026-09-14 11:03:18] step 1041/5000 loss 0.2961 (w 0.3120 mse 0.2999 t 768 new 0.17) lr 1.00e-05 gnorm 0.671 3.07s mem 81.1GB +[2026-09-14 11:03:21] step 1042/5000 loss 0.2593 (w 0.1454 mse 0.1436 t 807 new 0.11) lr 1.00e-05 gnorm 0.194 3.31s mem 81.1GB +[2026-09-14 11:03:24] step 1043/5000 loss 0.2974 (w 0.1603 mse 0.1544 t 668 new 0.21) lr 1.00e-05 gnorm 0.809 3.08s mem 81.1GB +[2026-09-14 11:03:27] step 1044/5000 loss 0.2088 (w 0.1820 mse 0.1976 t 490 new 0.14) lr 1.00e-05 gnorm 0.143 2.86s mem 81.1GB +[2026-09-14 11:03:30] step 1045/5000 loss 0.0809 (w 0.1879 mse 0.1881 t 922 new 0.18) lr 1.00e-05 gnorm 0.133 3.38s mem 81.1GB +[2026-09-14 11:03:33] step 1046/5000 loss 0.4483 (w 0.2137 mse 0.2038 t 683 new 0.24) lr 1.00e-05 gnorm 0.169 2.84s mem 81.1GB +[2026-09-14 11:03:36] step 1047/5000 loss 0.2475 (w 0.2641 mse 0.2738 t 976 new 0.21) lr 1.00e-05 gnorm 0.169 3.09s mem 81.1GB +[2026-09-14 11:03:39] step 1048/5000 loss 0.1398 (w 0.1729 mse 0.1821 t 914 new 0.20) lr 1.00e-05 gnorm 0.117 3.35s mem 81.1GB +[2026-09-14 11:03:43] step 1049/5000 loss 0.2045 (w 0.2825 mse 0.2732 t 915 new 0.27) lr 1.00e-05 gnorm 0.165 3.12s mem 81.1GB +[2026-09-14 11:03:45] step 1050/5000 loss 0.2353 (w 0.2922 mse 0.2837 t 820 new 0.11) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +[2026-09-14 11:03:49] step 1051/5000 loss 0.2957 (w 0.2087 mse 0.2107 t 397 new 0.17) lr 1.00e-05 gnorm 0.156 3.18s mem 81.1GB +[2026-09-14 11:03:51] step 1052/5000 loss 0.2982 (w 0.3452 mse 0.3366 t 336 new 0.24) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +[2026-09-14 11:03:54] step 1053/5000 loss 0.2131 (w 0.3212 mse 0.3215 t 428 new 0.19) lr 1.00e-05 gnorm 0.168 3.05s mem 81.1GB +[2026-09-14 11:03:58] step 1054/5000 loss 0.2443 (w 0.3151 mse 0.3139 t 983 new 0.17) lr 1.00e-05 gnorm 0.132 3.43s mem 81.1GB +[2026-09-14 11:04:01] step 1055/5000 loss 0.2629 (w 0.1463 mse 0.1440 t 741 new 0.13) lr 1.00e-05 gnorm 0.178 3.35s mem 81.1GB +[2026-09-14 11:04:04] step 1056/5000 loss 0.3403 (w 0.3960 mse 0.3870 t 964 new 0.12) lr 1.00e-05 gnorm 0.162 3.17s mem 81.1GB +[2026-09-14 11:04:07] step 1057/5000 loss 0.2141 (w 0.2142 mse 0.2003 t 891 new 0.20) lr 1.00e-05 gnorm 0.202 2.85s mem 81.1GB +[2026-09-14 11:04:10] step 1058/5000 loss 0.1937 (w 0.3351 mse 0.3195 t 971 new 0.23) lr 1.00e-05 gnorm 0.172 2.85s mem 81.1GB +[2026-09-14 11:04:14] step 1059/5000 loss 0.1208 (w 0.1684 mse 0.1832 t 586 new 0.20) lr 1.00e-05 gnorm 0.112 3.34s mem 81.1GB +[2026-09-14 11:04:17] step 1060/5000 loss 0.2184 (w 0.1875 mse 0.1812 t 975 new 0.17) lr 1.00e-05 gnorm 0.157 3.43s mem 81.1GB +[2026-09-14 11:04:20] step 1061/5000 loss 0.3009 (w 0.1841 mse 0.1865 t 946 new 0.25) lr 1.00e-05 gnorm 0.178 3.29s mem 81.1GB +[2026-09-14 11:04:23] step 1062/5000 loss 0.2193 (w 0.1346 mse 0.1428 t 761 new 0.23) lr 1.00e-05 gnorm 0.158 3.13s mem 81.1GB +[2026-09-14 11:04:26] step 1063/5000 loss 0.1934 (w 0.1299 mse 0.1129 t 827 new 0.13) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-14 11:04:29] step 1064/5000 loss 0.2540 (w 0.3464 mse 0.3254 t 984 new 0.21) lr 1.00e-05 gnorm 0.192 2.84s mem 81.1GB +[2026-09-14 11:04:32] step 1065/5000 loss 0.1998 (w 0.1278 mse 0.1188 t 790 new 0.15) lr 1.00e-05 gnorm 2.205 3.33s mem 81.1GB +[2026-09-14 11:04:36] step 1066/5000 loss 0.2731 (w 0.2266 mse 0.2451 t 973 new 0.22) lr 1.00e-05 gnorm 0.155 3.41s mem 81.1GB +[2026-09-14 11:04:39] step 1067/5000 loss 0.3967 (w 0.2735 mse 0.2696 t 987 new 0.18) lr 1.00e-05 gnorm 0.144 3.36s mem 81.1GB +[2026-09-14 11:04:42] step 1068/5000 loss 0.2584 (w 0.1924 mse 0.2061 t 989 new 0.28) lr 1.00e-05 gnorm 0.231 3.17s mem 81.1GB +[2026-09-14 11:04:45] step 1069/5000 loss 0.2387 (w 0.6521 mse 0.6827 t 999 new 0.16) lr 1.00e-05 gnorm 0.186 2.84s mem 81.1GB +[2026-09-14 11:04:48] step 1070/5000 loss 0.1956 (w 0.2720 mse 0.2678 t 962 new 0.25) lr 1.00e-05 gnorm 0.275 2.84s mem 81.1GB +[2026-09-14 11:04:51] step 1071/5000 loss 0.2327 (w 0.4380 mse 0.4344 t 986 new 0.29) lr 1.00e-05 gnorm 0.125 3.31s mem 81.1GB +[2026-09-14 11:04:55] step 1072/5000 loss 0.2486 (w 0.1709 mse 0.1804 t 753 new 0.11) lr 1.00e-05 gnorm 0.138 3.45s mem 81.1GB +[2026-09-14 11:04:58] step 1073/5000 loss 0.2222 (w 0.3363 mse 0.3570 t 249 new 0.12) lr 1.00e-05 gnorm 0.103 3.08s mem 81.1GB +[2026-09-14 11:05:01] step 1074/5000 loss 0.1482 (w 0.2649 mse 0.2558 t 960 new 0.25) lr 1.00e-05 gnorm 0.136 3.46s mem 81.1GB +[2026-09-14 11:05:04] step 1075/5000 loss 0.3167 (w 0.3419 mse 0.3428 t 970 new 0.25) lr 1.00e-05 gnorm 0.260 2.84s mem 81.1GB +[2026-09-14 11:05:07] step 1076/5000 loss 0.3412 (w 0.2231 mse 0.2063 t 983 new 0.19) lr 1.00e-05 gnorm 0.157 3.12s mem 81.1GB +[2026-09-14 11:05:11] step 1077/5000 loss 0.3250 (w 0.2580 mse 0.2526 t 915 new 0.24) lr 1.00e-05 gnorm 0.218 3.11s mem 81.1GB +[2026-09-14 11:05:14] step 1078/5000 loss 0.2176 (w 0.2634 mse 0.2588 t 610 new 0.23) lr 1.00e-05 gnorm 0.206 3.51s mem 81.1GB +[2026-09-14 11:05:17] step 1079/5000 loss 0.2556 (w 0.2284 mse 0.2390 t 939 new 0.19) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +[2026-09-14 11:05:20] step 1080/5000 loss 0.2767 (w 0.2073 mse 0.1973 t 798 new 0.14) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +[2026-09-14 11:05:23] step 1081/5000 loss 0.2927 (w 0.2315 mse 0.2077 t 742 new 0.24) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +[2026-09-14 11:05:26] step 1082/5000 loss 0.2564 (w 0.2272 mse 0.2264 t 852 new 0.24) lr 1.00e-05 gnorm 0.139 3.05s mem 81.1GB +[2026-09-14 11:05:29] step 1083/5000 loss 0.0899 (w 0.3155 mse 0.2994 t 993 new 0.26) lr 1.00e-05 gnorm 0.170 3.13s mem 81.1GB +[2026-09-14 11:05:33] step 1084/5000 loss 0.1935 (w 0.2663 mse 0.2626 t 984 new 0.14) lr 1.00e-05 gnorm 0.150 3.68s mem 81.1GB +[2026-09-14 11:05:36] step 1085/5000 loss 0.3051 (w 0.2044 mse 0.2059 t 913 new 0.23) lr 1.00e-05 gnorm 0.181 2.85s mem 81.1GB +[2026-09-14 11:05:39] step 1086/5000 loss 0.1496 (w 0.1519 mse 0.1472 t 690 new 0.25) lr 1.00e-05 gnorm 0.145 3.11s mem 81.1GB +[2026-09-14 11:05:42] step 1087/5000 loss 0.2339 (w 0.1674 mse 0.1771 t 914 new 0.22) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +[2026-09-14 11:05:45] step 1088/5000 loss 0.1543 (w 0.0646 mse 0.0737 t 730 new 0.13) lr 1.00e-05 gnorm 0.291 3.05s mem 81.1GB +[2026-09-14 11:05:48] step 1089/5000 loss 0.1412 (w 0.1936 mse 0.1833 t 801 new 0.22) lr 1.00e-05 gnorm 0.189 3.09s mem 81.1GB +[2026-09-14 11:05:52] step 1090/5000 loss 0.2676 (w 0.2546 mse 0.2488 t 992 new 0.16) lr 1.00e-05 gnorm 0.202 3.71s mem 81.1GB +[2026-09-14 11:05:55] step 1091/5000 loss 0.1785 (w 0.2027 mse 0.1956 t 986 new 0.25) lr 1.00e-05 gnorm 0.141 3.07s mem 81.1GB +[2026-09-14 11:05:58] step 1092/5000 loss 0.2223 (w 0.2100 mse 0.2033 t 850 new 0.21) lr 1.00e-05 gnorm 0.167 3.09s mem 81.1GB +[2026-09-14 11:06:01] step 1093/5000 loss 0.1972 (w 0.1431 mse 0.1503 t 669 new 0.21) lr 1.00e-05 gnorm 0.181 2.86s mem 81.1GB +[2026-09-14 11:06:04] step 1094/5000 loss 0.1214 (w 0.2482 mse 0.2551 t 965 new 0.17) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +[2026-09-14 11:06:07] step 1095/5000 loss 0.3367 (w 0.3827 mse 0.3746 t 418 new 0.16) lr 1.00e-05 gnorm 0.181 3.42s mem 81.1GB +[2026-09-14 11:06:11] step 1096/5000 loss 0.2741 (w 0.2773 mse 0.3111 t 986 new 0.26) lr 1.00e-05 gnorm 0.232 3.49s mem 81.1GB +[2026-09-14 11:06:14] step 1097/5000 loss 0.3012 (w 0.3646 mse 0.3402 t 976 new 0.14) lr 1.00e-05 gnorm 0.153 3.15s mem 81.1GB +[2026-09-14 11:06:17] step 1098/5000 loss 0.1343 (w 0.2775 mse 0.2845 t 939 new 0.14) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +[2026-09-14 11:06:20] step 1099/5000 loss 0.1547 (w 0.2041 mse 0.2101 t 482 new 0.21) lr 1.00e-05 gnorm 0.211 2.84s mem 81.1GB +[2026-09-14 11:06:23] step 1100/5000 loss 0.1157 (w 0.2797 mse 0.2503 t 970 new 0.27) lr 1.00e-05 gnorm 0.499 3.35s mem 81.1GB +[2026-09-14 11:06:26] step 1101/5000 loss 0.1320 (w 0.2749 mse 0.2817 t 999 new 0.24) lr 1.00e-05 gnorm 0.191 3.10s mem 81.1GB +[2026-09-14 11:06:30] step 1102/5000 loss 0.1749 (w 0.1960 mse 0.2043 t 974 new 0.10) lr 1.00e-05 gnorm 0.183 3.43s mem 81.1GB +[2026-09-14 11:06:33] step 1103/5000 loss 0.2644 (w 0.2008 mse 0.2001 t 820 new 0.23) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +[2026-09-14 11:06:36] step 1104/5000 loss 0.2935 (w 0.2183 mse 0.2250 t 959 new 0.20) lr 1.00e-05 gnorm 0.167 2.84s mem 81.1GB +[2026-09-14 11:06:39] step 1105/5000 loss 0.4809 (w 0.2629 mse 0.2506 t 592 new 0.20) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +[2026-09-14 11:06:42] step 1106/5000 loss 0.3951 (w 0.2761 mse 0.2824 t 982 new 0.15) lr 1.00e-05 gnorm 0.160 3.38s mem 81.1GB +[2026-09-14 11:06:45] step 1107/5000 loss 0.2225 (w 0.2798 mse 0.2749 t 680 new 0.20) lr 1.00e-05 gnorm 0.153 3.15s mem 81.1GB +[2026-09-14 11:06:49] step 1108/5000 loss 0.3938 (w 0.3330 mse 0.3488 t 288 new 0.21) lr 1.00e-05 gnorm 0.129 3.39s mem 81.1GB +[2026-09-14 11:06:52] step 1109/5000 loss 0.3381 (w 0.2220 mse 0.2097 t 921 new 0.16) lr 1.00e-05 gnorm 0.165 3.37s mem 81.1GB +[2026-09-14 11:06:55] step 1110/5000 loss 0.1964 (w 0.1670 mse 0.1644 t 954 new 0.10) lr 1.00e-05 gnorm 0.154 2.85s mem 81.1GB +[2026-09-14 11:06:58] step 1111/5000 loss 0.3603 (w 0.2424 mse 0.2258 t 713 new 0.23) lr 1.00e-05 gnorm 0.344 3.04s mem 81.1GB +[2026-09-14 11:07:01] step 1112/5000 loss 0.2211 (w 0.4365 mse 0.4114 t 992 new 0.23) lr 1.00e-05 gnorm 0.222 3.07s mem 81.1GB +[2026-09-14 11:07:04] step 1113/5000 loss 0.3646 (w 0.1863 mse 0.1895 t 656 new 0.12) lr 1.00e-05 gnorm 0.331 3.39s mem 81.1GB +[2026-09-14 11:07:08] step 1114/5000 loss 0.3468 (w 0.5115 mse 0.5122 t 228 new 0.12) lr 1.00e-05 gnorm 0.282 3.22s mem 81.1GB +[2026-09-14 11:07:11] step 1115/5000 loss 0.3348 (w 0.2790 mse 0.2653 t 684 new 0.22) lr 1.00e-05 gnorm 0.363 3.37s mem 81.1GB +[2026-09-14 11:07:14] step 1116/5000 loss 0.2736 (w 0.1649 mse 0.1714 t 855 new 0.16) lr 1.00e-05 gnorm 0.202 2.83s mem 81.1GB +[2026-09-14 11:07:17] step 1117/5000 loss 0.3933 (w 0.2327 mse 0.2222 t 947 new 0.22) lr 1.00e-05 gnorm 0.135 3.09s mem 81.1GB +[2026-09-14 11:07:20] step 1118/5000 loss 0.2643 (w 0.3008 mse 0.3021 t 978 new 0.19) lr 1.00e-05 gnorm 0.141 3.09s mem 81.1GB +[2026-09-14 11:07:23] step 1119/5000 loss 0.2125 (w 0.3108 mse 0.2990 t 982 new 0.23) lr 1.00e-05 gnorm 0.158 3.39s mem 81.1GB +[2026-09-14 11:07:27] step 1120/5000 loss 0.3243 (w 0.2391 mse 0.2363 t 722 new 0.20) lr 1.00e-05 gnorm 0.167 3.45s mem 81.1GB +[2026-09-14 11:07:30] step 1121/5000 loss 0.2197 (w 0.2338 mse 0.2119 t 875 new 0.21) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +[2026-09-14 11:07:33] step 1122/5000 loss 0.2018 (w 0.4352 mse 0.4038 t 998 new 0.17) lr 1.00e-05 gnorm 0.121 2.85s mem 81.1GB +[2026-09-14 11:07:36] step 1123/5000 loss 0.1890 (w 0.2281 mse 0.2212 t 752 new 0.22) lr 1.00e-05 gnorm 0.190 3.05s mem 81.1GB +[2026-09-14 11:07:39] step 1124/5000 loss 0.2962 (w 0.1469 mse 0.1478 t 669 new 0.05) lr 1.00e-05 gnorm 0.163 3.08s mem 81.1GB +[2026-09-14 11:07:42] step 1125/5000 loss 0.1951 (w 0.1108 mse 0.1144 t 962 new 0.11) lr 1.00e-05 gnorm 0.117 3.17s mem 81.1GB +[2026-09-14 11:07:45] step 1126/5000 loss 0.2127 (w 0.3296 mse 0.3197 t 983 new 0.15) lr 1.00e-05 gnorm 0.350 3.37s mem 81.1GB +[2026-09-14 11:07:48] step 1127/5000 loss 0.2379 (w 0.3171 mse 0.3081 t 530 new 0.24) lr 1.00e-05 gnorm 0.165 3.03s mem 81.1GB +[2026-09-14 11:07:51] step 1128/5000 loss 0.2075 (w 0.2771 mse 0.2669 t 897 new 0.21) lr 1.00e-05 gnorm 0.166 2.85s mem 81.1GB +[2026-09-14 11:07:54] step 1129/5000 loss 0.2123 (w 0.2330 mse 0.2289 t 832 new 0.24) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +[2026-09-14 11:07:58] step 1130/5000 loss 0.3071 (w 0.2082 mse 0.1941 t 782 new 0.13) lr 1.00e-05 gnorm 0.158 3.17s mem 81.1GB +[2026-09-14 11:08:01] step 1131/5000 loss 0.1894 (w 0.3932 mse 0.3715 t 999 new 0.19) lr 1.00e-05 gnorm 0.158 3.62s mem 81.1GB +[2026-09-14 11:08:04] step 1132/5000 loss 0.2624 (w 0.2596 mse 0.2479 t 850 new 0.24) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +[2026-09-14 11:08:08] step 1133/5000 loss 0.2455 (w 0.3436 mse 0.3333 t 989 new 0.24) lr 1.00e-05 gnorm 0.163 3.09s mem 81.1GB +[2026-09-14 11:08:11] step 1134/5000 loss 0.1772 (w 0.0642 mse 0.0730 t 745 new 0.13) lr 1.00e-05 gnorm 0.151 3.04s mem 81.1GB +[2026-09-14 11:08:13] step 1135/5000 loss 0.2024 (w 0.2554 mse 0.2481 t 965 new 0.21) lr 1.00e-05 gnorm 0.126 2.85s mem 81.1GB +[2026-09-14 11:08:17] step 1136/5000 loss 0.2968 (w 0.1543 mse 0.1658 t 937 new 0.15) lr 1.00e-05 gnorm 0.154 3.39s mem 81.1GB +[2026-09-14 11:08:21] step 1137/5000 loss 0.1830 (w 0.3503 mse 0.3349 t 914 new 0.24) lr 1.00e-05 gnorm 0.125 3.65s mem 81.1GB +[2026-09-14 11:08:24] step 1138/5000 loss 0.2293 (w 0.1815 mse 0.1802 t 665 new 0.09) lr 1.00e-05 gnorm 0.159 3.13s mem 81.1GB +[2026-09-14 11:08:27] step 1139/5000 loss 0.2500 (w 0.2820 mse 0.2958 t 372 new 0.20) lr 1.00e-05 gnorm 0.132 2.85s mem 81.1GB +[2026-09-14 11:08:30] step 1140/5000 loss 0.1889 (w 0.2515 mse 0.2506 t 947 new 0.19) lr 1.00e-05 gnorm 0.176 3.03s mem 81.1GB +[2026-09-14 11:08:33] step 1141/5000 loss 0.4118 (w 0.3302 mse 0.3312 t 421 new 0.22) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +[2026-09-14 11:08:36] step 1142/5000 loss 0.3013 (w 0.2485 mse 0.2451 t 951 new 0.23) lr 1.00e-05 gnorm 0.281 3.62s mem 81.1GB +[2026-09-14 11:08:40] step 1143/5000 loss 0.2039 (w 0.2868 mse 0.2923 t 274 new 0.23) lr 1.00e-05 gnorm 0.239 3.34s mem 81.1GB +[2026-09-14 11:08:43] step 1144/5000 loss 0.2507 (w 0.2225 mse 0.2124 t 889 new 0.21) lr 1.00e-05 gnorm 0.211 3.51s mem 81.1GB +[2026-09-14 11:08:46] step 1145/5000 loss 0.1646 (w 0.0708 mse 0.0724 t 578 new 0.02) lr 1.00e-05 gnorm 0.137 2.85s mem 81.1GB +[2026-09-14 11:08:49] step 1146/5000 loss 0.3832 (w 0.2966 mse 0.2916 t 961 new 0.20) lr 1.00e-05 gnorm 0.154 3.06s mem 81.1GB +[2026-09-14 11:08:52] step 1147/5000 loss 0.1665 (w 0.3775 mse 0.3537 t 930 new 0.24) lr 1.00e-05 gnorm 0.135 3.12s mem 81.1GB +[2026-09-14 11:08:56] step 1148/5000 loss 0.1714 (w 0.2095 mse 0.2159 t 647 new 0.22) lr 1.00e-05 gnorm 0.126 3.53s mem 81.1GB +[2026-09-14 11:08:59] step 1149/5000 loss 0.2347 (w 0.2972 mse 0.2946 t 852 new 0.21) lr 1.00e-05 gnorm 0.316 3.14s mem 81.1GB +[2026-09-14 11:09:02] step 1150/5000 loss 0.1609 (w 0.2501 mse 0.2505 t 612 new 0.20) lr 1.00e-05 gnorm 0.156 3.47s mem 81.1GB +[2026-09-14 11:09:05] step 1151/5000 loss 0.1506 (w 0.2964 mse 0.2942 t 958 new 0.18) lr 1.00e-05 gnorm 0.260 2.85s mem 81.1GB +[2026-09-14 11:09:08] step 1152/5000 loss 0.1827 (w 0.1314 mse 0.1326 t 725 new 0.22) lr 1.00e-05 gnorm 0.128 3.11s mem 81.1GB +[2026-09-14 11:09:11] step 1153/5000 loss 0.3417 (w 0.3007 mse 0.2877 t 506 new 0.17) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +[2026-09-14 11:09:15] step 1154/5000 loss 0.1891 (w 0.4626 mse 0.4476 t 974 new 0.24) lr 1.00e-05 gnorm 0.315 3.45s mem 81.1GB +[2026-09-14 11:09:18] step 1155/5000 loss 0.1116 (w 0.1042 mse 0.0977 t 672 new 0.20) lr 1.00e-05 gnorm 0.162 3.19s mem 81.1GB +[2026-09-14 11:09:21] step 1156/5000 loss 0.2342 (w 0.2124 mse 0.2300 t 995 new 0.16) lr 1.00e-05 gnorm 0.156 3.35s mem 81.1GB +[2026-09-14 11:09:24] step 1157/5000 loss 0.2332 (w 0.3071 mse 0.3029 t 233 new 0.10) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +[2026-09-14 11:09:27] step 1158/5000 loss 0.2774 (w 0.1545 mse 0.1690 t 940 new 0.23) lr 1.00e-05 gnorm 0.603 3.05s mem 81.1GB +[2026-09-14 11:09:31] step 1159/5000 loss 0.3168 (w 0.3016 mse 0.3018 t 450 new 0.21) lr 1.00e-05 gnorm 0.111 3.15s mem 81.1GB +[2026-09-14 11:09:34] step 1160/5000 loss 0.1212 (w 0.3299 mse 0.3236 t 945 new 0.18) lr 1.00e-05 gnorm 0.146 3.20s mem 81.1GB +[2026-09-14 11:09:37] step 1161/5000 loss 0.1509 (w 0.2779 mse 0.2670 t 934 new 0.17) lr 1.00e-05 gnorm 0.174 3.39s mem 81.1GB +[2026-09-14 11:09:40] step 1162/5000 loss 0.2245 (w 0.1824 mse 0.1805 t 970 new 0.24) lr 1.00e-05 gnorm 0.143 3.26s mem 81.1GB +[2026-09-14 11:09:43] step 1163/5000 loss 0.1500 (w 0.3939 mse 0.3814 t 960 new 0.21) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +[2026-09-14 11:09:46] step 1164/5000 loss 0.2165 (w 0.2048 mse 0.1880 t 977 new 0.24) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +[2026-09-14 11:09:50] step 1165/5000 loss 0.2501 (w 0.2290 mse 0.2202 t 683 new 0.26) lr 1.00e-05 gnorm 0.181 3.18s mem 81.1GB +[2026-09-14 11:09:53] step 1166/5000 loss 0.2134 (w 0.3017 mse 0.2856 t 918 new 0.24) lr 1.00e-05 gnorm 0.152 3.23s mem 81.1GB +[2026-09-14 11:09:56] step 1167/5000 loss 0.1423 (w 0.1241 mse 0.1241 t 911 new 0.25) lr 1.00e-05 gnorm 0.113 3.18s mem 81.1GB +[2026-09-14 11:09:59] step 1168/5000 loss 0.2395 (w 0.4043 mse 0.3887 t 963 new 0.22) lr 1.00e-05 gnorm 0.162 3.25s mem 81.1GB +[2026-09-14 11:10:02] step 1169/5000 loss 0.2823 (w 0.3164 mse 0.2904 t 998 new 0.27) lr 1.00e-05 gnorm 0.283 2.84s mem 81.1GB +[2026-09-14 11:10:05] step 1170/5000 loss 0.1903 (w 0.2992 mse 0.2875 t 922 new 0.19) lr 1.00e-05 gnorm 0.114 3.10s mem 81.1GB +[2026-09-14 11:10:09] step 1171/5000 loss 0.2546 (w 0.2088 mse 0.1982 t 897 new 0.29) lr 1.00e-05 gnorm 0.268 3.75s mem 81.1GB +[2026-09-14 11:10:12] step 1172/5000 loss 0.2810 (w 0.3389 mse 0.3394 t 328 new 0.10) lr 1.00e-05 gnorm 0.206 3.26s mem 81.1GB +[2026-09-14 11:10:15] step 1173/5000 loss 0.2914 (w 0.2967 mse 0.2843 t 948 new 0.24) lr 1.00e-05 gnorm 0.172 3.30s mem 81.1GB +[2026-09-14 11:10:19] step 1174/5000 loss 0.2590 (w 0.0607 mse 0.0734 t 800 new 0.19) lr 1.00e-05 gnorm 0.143 3.20s mem 81.1GB +[2026-09-14 11:10:22] step 1175/5000 loss 0.2787 (w 0.3453 mse 0.3352 t 988 new 0.20) lr 1.00e-05 gnorm 0.190 2.86s mem 81.1GB +[2026-09-14 11:10:25] step 1176/5000 loss 0.1847 (w 0.2208 mse 0.2129 t 874 new 0.10) lr 1.00e-05 gnorm 0.283 3.11s mem 81.1GB +[2026-09-14 11:10:28] step 1177/5000 loss 0.1211 (w 0.4492 mse 0.4478 t 995 new 0.14) lr 1.00e-05 gnorm 0.220 3.54s mem 81.1GB +[2026-09-14 11:10:32] step 1178/5000 loss 0.2444 (w 0.2425 mse 0.2391 t 909 new 0.23) lr 1.00e-05 gnorm 0.486 3.37s mem 81.1GB +[2026-09-14 11:10:35] step 1179/5000 loss 0.1636 (w 0.2342 mse 0.2218 t 892 new 0.22) lr 1.00e-05 gnorm 0.125 3.31s mem 81.1GB +[2026-09-14 11:10:38] step 1180/5000 loss 0.1607 (w 0.2090 mse 0.2029 t 952 new 0.15) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +[2026-09-14 11:10:41] step 1181/5000 loss 0.2269 (w 0.2287 mse 0.2214 t 900 new 0.24) lr 1.00e-05 gnorm 0.212 2.84s mem 81.1GB +[2026-09-14 11:10:44] step 1182/5000 loss 0.2018 (w 0.2368 mse 0.2118 t 879 new 0.19) lr 1.00e-05 gnorm 0.281 3.09s mem 81.1GB +[2026-09-14 11:10:47] step 1183/5000 loss 0.0993 (w 0.2810 mse 0.2778 t 976 new 0.20) lr 1.00e-05 gnorm 0.123 3.42s mem 81.1GB +[2026-09-14 11:10:50] step 1184/5000 loss 0.2501 (w 0.3557 mse 0.3599 t 998 new 0.15) lr 1.00e-05 gnorm 0.154 3.12s mem 81.1GB +[2026-09-14 11:10:54] step 1185/5000 loss 0.1147 (w 0.3340 mse 0.3199 t 995 new 0.22) lr 1.00e-05 gnorm 0.131 3.14s mem 81.1GB +[2026-09-14 11:10:57] step 1186/5000 loss 0.1741 (w 0.3331 mse 0.3245 t 971 new 0.19) lr 1.00e-05 gnorm 0.159 2.86s mem 81.1GB +[2026-09-14 11:11:00] step 1187/5000 loss 0.1209 (w 0.1748 mse 0.1871 t 946 new 0.27) lr 1.00e-05 gnorm 0.145 3.06s mem 81.1GB +[2026-09-14 11:11:03] step 1188/5000 loss 0.2912 (w 0.3450 mse 0.3358 t 984 new 0.20) lr 1.00e-05 gnorm 0.196 3.16s mem 81.1GB +[2026-09-14 11:11:06] step 1189/5000 loss 0.3603 (w 0.2444 mse 0.2499 t 955 new 0.20) lr 1.00e-05 gnorm 0.203 3.49s mem 81.1GB +[2026-09-14 11:11:10] step 1190/5000 loss 0.1863 (w 0.3775 mse 0.3653 t 979 new 0.20) lr 1.00e-05 gnorm 0.135 3.12s mem 81.1GB +[2026-09-14 11:11:13] step 1191/5000 loss 0.2287 (w 0.2258 mse 0.2092 t 849 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +[2026-09-14 11:11:15] step 1192/5000 loss 0.1678 (w 0.3191 mse 0.2947 t 948 new 0.23) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +[2026-09-14 11:11:19] step 1193/5000 loss 0.3067 (w 0.2197 mse 0.2120 t 771 new 0.16) lr 1.00e-05 gnorm 0.180 3.08s mem 81.1GB +[2026-09-14 11:11:22] step 1194/5000 loss 0.1748 (w 0.2806 mse 0.2996 t 980 new 0.13) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +[2026-09-14 11:11:25] step 1195/5000 loss 0.1817 (w 0.2893 mse 0.2864 t 976 new 0.14) lr 1.00e-05 gnorm 0.140 3.40s mem 81.1GB +[2026-09-14 11:11:28] step 1196/5000 loss 0.1450 (w 0.2280 mse 0.2337 t 424 new 0.20) lr 1.00e-05 gnorm 0.122 3.21s mem 81.1GB +[2026-09-14 11:11:32] step 1197/5000 loss 0.2833 (w 0.2490 mse 0.2579 t 660 new 0.22) lr 1.00e-05 gnorm 0.129 3.31s mem 81.1GB +[2026-09-14 11:11:34] step 1198/5000 loss 0.2244 (w 0.2681 mse 0.2488 t 894 new 0.20) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +[2026-09-14 11:11:38] step 1199/5000 loss 0.1081 (w 0.2980 mse 0.2822 t 895 new 0.20) lr 1.00e-05 gnorm 0.168 3.05s mem 81.1GB +[2026-09-14 11:11:41] step 1200/5000 loss 0.3633 (w 0.2907 mse 0.2943 t 264 new 0.17) lr 1.00e-05 gnorm 0.172 3.08s mem 81.1GB +[2026-09-14 11:11:44] step 1201/5000 loss 0.1767 (w 0.2296 mse 0.2317 t 948 new 0.13) lr 1.00e-05 gnorm 0.175 3.34s mem 81.1GB +[2026-09-14 11:11:47] step 1202/5000 loss 0.2515 (w 0.2715 mse 0.2595 t 855 new 0.21) lr 1.00e-05 gnorm 0.134 3.15s mem 81.1GB +[2026-09-14 11:11:50] step 1203/5000 loss 0.3019 (w 0.1496 mse 0.1555 t 890 new 0.17) lr 1.00e-05 gnorm 0.183 3.39s mem 81.1GB +[2026-09-14 11:11:53] step 1204/5000 loss 0.2732 (w 0.2050 mse 0.2049 t 626 new 0.17) lr 1.00e-05 gnorm 0.173 2.86s mem 81.1GB +[2026-09-14 11:11:56] step 1205/5000 loss 0.2806 (w 0.1872 mse 0.1906 t 428 new 0.18) lr 1.00e-05 gnorm 0.201 3.05s mem 81.1GB +[2026-09-14 11:12:00] step 1206/5000 loss 0.2693 (w 0.0842 mse 0.0916 t 731 new 0.11) lr 1.00e-05 gnorm 0.208 3.35s mem 81.1GB +[2026-09-14 11:12:03] step 1207/5000 loss 0.2665 (w 0.4537 mse 0.4661 t 206 new 0.22) lr 1.00e-05 gnorm 0.142 3.14s mem 81.1GB +[2026-09-14 11:12:06] step 1208/5000 loss 0.2027 (w 0.1683 mse 0.1643 t 953 new 0.24) lr 1.00e-05 gnorm 0.313 3.33s mem 81.1GB +[2026-09-14 11:12:10] step 1209/5000 loss 0.1884 (w 0.2288 mse 0.2491 t 998 new 0.22) lr 1.00e-05 gnorm 0.148 3.41s mem 81.1GB +[2026-09-14 11:12:13] step 1210/5000 loss 0.1718 (w 0.1430 mse 0.1442 t 803 new 0.19) lr 1.00e-05 gnorm 0.199 2.86s mem 81.1GB +[2026-09-14 11:12:16] step 1211/5000 loss 0.4534 (w 0.2713 mse 0.2669 t 610 new 0.22) lr 1.00e-05 gnorm 0.251 3.05s mem 81.1GB +[2026-09-14 11:12:19] step 1212/5000 loss 0.2261 (w 0.1618 mse 0.1755 t 892 new 0.17) lr 1.00e-05 gnorm 0.179 3.40s mem 81.1GB +[2026-09-14 11:12:23] step 1213/5000 loss 0.1613 (w 0.1772 mse 0.1754 t 987 new 0.22) lr 1.00e-05 gnorm 0.197 3.67s mem 81.1GB +[2026-09-14 11:12:26] step 1214/5000 loss 0.2128 (w 0.1880 mse 0.1809 t 904 new 0.20) lr 1.00e-05 gnorm 0.146 3.35s mem 81.1GB +[2026-09-14 11:12:29] step 1215/5000 loss 0.1977 (w 0.5631 mse 0.5634 t 134 new 0.20) lr 1.00e-05 gnorm 0.167 2.84s mem 81.1GB +[2026-09-14 11:12:32] step 1216/5000 loss 0.1075 (w 0.2958 mse 0.2913 t 984 new 0.19) lr 1.00e-05 gnorm 0.216 2.84s mem 81.1GB +[2026-09-14 11:12:35] step 1217/5000 loss 0.2688 (w 0.2429 mse 0.2347 t 949 new 0.20) lr 1.00e-05 gnorm 0.179 3.07s mem 81.1GB +[2026-09-14 11:12:38] step 1218/5000 loss 0.1153 (w 0.3152 mse 0.3131 t 968 new 0.20) lr 1.00e-05 gnorm 1.524 3.47s mem 81.1GB +[2026-09-14 11:12:42] step 1219/5000 loss 0.1082 (w 0.2660 mse 0.2657 t 914 new 0.17) lr 1.00e-05 gnorm 0.485 3.42s mem 81.1GB +[2026-09-14 11:12:45] step 1220/5000 loss 0.2510 (w 0.1843 mse 0.1739 t 951 new 0.12) lr 1.00e-05 gnorm 0.188 3.33s mem 81.1GB +[2026-09-14 11:12:48] step 1221/5000 loss 0.2271 (w 0.2631 mse 0.2572 t 919 new 0.22) lr 1.00e-05 gnorm 0.272 2.84s mem 81.1GB +[2026-09-14 11:12:51] step 1222/5000 loss 0.1824 (w 0.4155 mse 0.3983 t 974 new 0.22) lr 1.00e-05 gnorm 0.141 3.02s mem 81.1GB +[2026-09-14 11:12:54] step 1223/5000 loss 0.1625 (w 0.1663 mse 0.1817 t 971 new 0.22) lr 1.00e-05 gnorm 0.296 2.84s mem 81.1GB +[2026-09-14 11:12:57] step 1224/5000 loss 0.2327 (w 0.2828 mse 0.2726 t 804 new 0.19) lr 1.00e-05 gnorm 0.189 3.16s mem 81.1GB +[2026-09-14 11:13:00] step 1225/5000 loss 0.1793 (w 0.3322 mse 0.3236 t 951 new 0.28) lr 1.00e-05 gnorm 0.168 3.45s mem 81.1GB +[2026-09-14 11:13:04] step 1226/5000 loss 0.2234 (w 0.3360 mse 0.3314 t 996 new 0.22) lr 1.00e-05 gnorm 0.326 3.31s mem 81.1GB +[2026-09-14 11:13:06] step 1227/5000 loss 0.2106 (w 0.2381 mse 0.2262 t 844 new 0.24) lr 1.00e-05 gnorm 0.180 2.85s mem 81.1GB +[2026-09-14 11:13:10] step 1228/5000 loss 0.3055 (w 0.1894 mse 0.1953 t 889 new 0.15) lr 1.00e-05 gnorm 0.650 3.09s mem 81.1GB +[2026-09-14 11:13:13] step 1229/5000 loss 0.3462 (w 0.1661 mse 0.1777 t 965 new 0.20) lr 1.00e-05 gnorm 0.178 3.19s mem 81.1GB +[2026-09-14 11:13:16] step 1230/5000 loss 0.2320 (w 0.2871 mse 0.2757 t 665 new 0.21) lr 1.00e-05 gnorm 0.217 3.12s mem 81.1GB +[2026-09-14 11:13:19] step 1231/5000 loss 0.1808 (w 0.2492 mse 0.2399 t 809 new 0.23) lr 1.00e-05 gnorm 0.253 3.41s mem 81.1GB +[2026-09-14 11:13:23] step 1232/5000 loss 0.1870 (w 0.2942 mse 0.2885 t 984 new 0.21) lr 1.00e-05 gnorm 0.219 3.36s mem 81.1GB +[2026-09-14 11:13:26] step 1233/5000 loss 0.1914 (w 0.3045 mse 0.2981 t 437 new 0.16) lr 1.00e-05 gnorm 0.150 2.86s mem 81.1GB +[2026-09-14 11:13:29] step 1234/5000 loss 0.1327 (w 0.1857 mse 0.1880 t 987 new 0.15) lr 1.00e-05 gnorm 0.182 3.18s mem 81.1GB +[2026-09-14 11:13:32] step 1235/5000 loss 0.2038 (w 0.2237 mse 0.2186 t 967 new 0.12) lr 1.00e-05 gnorm 0.270 3.10s mem 81.1GB +[2026-09-14 11:13:35] step 1236/5000 loss 0.2273 (w 0.2191 mse 0.2046 t 809 new 0.26) lr 1.00e-05 gnorm 0.206 3.61s mem 81.1GB +[2026-09-14 11:13:39] step 1237/5000 loss 0.2870 (w 0.2826 mse 0.2566 t 889 new 0.27) lr 1.00e-05 gnorm 0.165 3.36s mem 81.1GB +[2026-09-14 11:13:42] step 1238/5000 loss 0.1427 (w 0.2510 mse 0.2372 t 952 new 0.21) lr 1.00e-05 gnorm 0.132 3.34s mem 81.1GB +[2026-09-14 11:13:45] step 1239/5000 loss 0.3122 (w 0.2261 mse 0.2226 t 809 new 0.24) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +[2026-09-14 11:13:48] step 1240/5000 loss 0.2200 (w 0.3481 mse 0.3380 t 920 new 0.19) lr 1.00e-05 gnorm 0.165 3.07s mem 81.1GB +[2026-09-14 11:13:51] step 1241/5000 loss 0.2130 (w 0.2763 mse 0.2694 t 766 new 0.18) lr 1.00e-05 gnorm 0.208 3.12s mem 81.1GB +[2026-09-14 11:13:54] step 1242/5000 loss 0.2813 (w 0.1625 mse 0.1626 t 794 new 0.22) lr 1.00e-05 gnorm 0.300 3.14s mem 81.1GB +[2026-09-14 11:13:58] step 1243/5000 loss 0.1571 (w 0.2625 mse 0.2529 t 960 new 0.19) lr 1.00e-05 gnorm 0.201 3.38s mem 81.1GB +[2026-09-14 11:14:01] step 1244/5000 loss 0.1762 (w 0.2501 mse 0.2418 t 992 new 0.26) lr 1.00e-05 gnorm 0.128 3.16s mem 81.1GB +[2026-09-14 11:14:04] step 1245/5000 loss 0.1838 (w 0.2255 mse 0.2128 t 901 new 0.20) lr 1.00e-05 gnorm 0.157 2.86s mem 81.1GB +[2026-09-14 11:14:08] step 1246/5000 loss 0.2511 (w 0.1524 mse 0.1657 t 421 new 0.16) lr 1.00e-05 gnorm 0.150 3.81s mem 81.1GB +[2026-09-14 11:14:11] step 1247/5000 loss 0.2210 (w 0.6521 mse 0.6106 t 998 new 0.19) lr 1.00e-05 gnorm 0.105 3.32s mem 81.1GB +[2026-09-14 11:14:14] step 1248/5000 loss 0.1520 (w 0.2189 mse 0.2175 t 663 new 0.15) lr 1.00e-05 gnorm 0.168 3.15s mem 81.1GB +[2026-09-14 11:14:17] step 1249/5000 loss 0.2586 (w 0.3428 mse 0.3514 t 288 new 0.27) lr 1.00e-05 gnorm 0.225 3.07s mem 81.1GB +[2026-09-14 11:14:20] step 1250/5000 loss 0.1507 (w 0.1206 mse 0.1153 t 906 new 0.19) lr 1.00e-05 gnorm 0.126 3.17s mem 81.1GB +[2026-09-14 11:14:23] step 1251/5000 loss 0.0979 (w 0.3903 mse 0.3724 t 983 new 0.21) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +[2026-09-14 11:14:26] step 1252/5000 loss 0.1753 (w 0.3997 mse 0.4145 t 140 new 0.24) lr 1.00e-05 gnorm 0.155 3.09s mem 81.1GB +[2026-09-14 11:14:30] step 1253/5000 loss 0.4155 (w 0.3075 mse 0.2921 t 819 new 0.23) lr 1.00e-05 gnorm 10.168 3.35s mem 81.1GB +[2026-09-14 11:14:33] step 1254/5000 loss 0.1745 (w 0.2376 mse 0.2633 t 973 new 0.15) lr 1.00e-05 gnorm 0.367 3.63s mem 81.1GB +[2026-09-14 11:14:36] step 1255/5000 loss 0.2249 (w 0.2794 mse 0.2822 t 990 new 0.20) lr 1.00e-05 gnorm 0.156 3.12s mem 81.1GB +[2026-09-14 11:14:39] step 1256/5000 loss 0.2850 (w 0.1645 mse 0.1585 t 925 new 0.27) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +[2026-09-14 11:14:42] step 1257/5000 loss 0.2304 (w 0.3031 mse 0.2963 t 929 new 0.22) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +[2026-09-14 11:14:45] step 1258/5000 loss 0.1574 (w 0.2153 mse 0.2005 t 849 new 0.18) lr 1.00e-05 gnorm 0.200 2.84s mem 81.1GB +[2026-09-14 11:14:48] step 1259/5000 loss 0.1430 (w 0.1291 mse 0.1244 t 750 new 0.21) lr 1.00e-05 gnorm 0.218 3.31s mem 81.1GB +[2026-09-14 11:14:52] step 1260/5000 loss 0.1484 (w 0.3922 mse 0.3759 t 975 new 0.22) lr 1.00e-05 gnorm 0.159 3.17s mem 81.1GB +[2026-09-14 11:14:55] step 1261/5000 loss 0.2381 (w 0.3276 mse 0.3216 t 981 new 0.23) lr 1.00e-05 gnorm 0.141 3.15s mem 81.1GB +[2026-09-14 11:14:58] step 1262/5000 loss 0.3850 (w 0.1092 mse 0.1092 t 590 new 0.14) lr 1.00e-05 gnorm 0.283 2.84s mem 81.1GB +[2026-09-14 11:15:01] step 1263/5000 loss 0.2078 (w 0.1159 mse 0.1154 t 862 new 0.14) lr 1.00e-05 gnorm 0.170 3.03s mem 81.1GB +[2026-09-14 11:15:03] step 1264/5000 loss 0.1673 (w 0.2151 mse 0.2104 t 926 new 0.26) lr 1.00e-05 gnorm 0.120 2.85s mem 81.1GB +[2026-09-14 11:15:08] step 1265/5000 loss 0.1554 (w 0.2519 mse 0.2436 t 390 new 0.22) lr 1.00e-05 gnorm 0.252 4.11s mem 81.1GB +[2026-09-14 11:15:11] step 1266/5000 loss 0.2053 (w 0.2097 mse 0.2040 t 904 new 0.22) lr 1.00e-05 gnorm 0.119 3.29s mem 81.1GB +[2026-09-14 11:15:14] step 1267/5000 loss 0.1835 (w 0.2569 mse 0.2646 t 993 new 0.17) lr 1.00e-05 gnorm 0.426 3.14s mem 81.1GB +[2026-09-14 11:15:17] step 1268/5000 loss 0.1828 (w 0.3695 mse 0.3672 t 935 new 0.19) lr 1.00e-05 gnorm 0.147 2.85s mem 81.1GB +[2026-09-14 11:15:20] step 1269/5000 loss 0.1694 (w 0.2650 mse 0.2528 t 839 new 0.19) lr 1.00e-05 gnorm 0.153 3.11s mem 81.1GB +[2026-09-14 11:15:23] step 1270/5000 loss 0.1923 (w 0.1353 mse 0.1457 t 829 new 0.24) lr 1.00e-05 gnorm 0.355 3.09s mem 81.1GB +[2026-09-14 11:15:26] step 1271/5000 loss 0.2575 (w 0.2972 mse 0.2784 t 988 new 0.18) lr 1.00e-05 gnorm 0.132 3.14s mem 81.1GB +[2026-09-14 11:15:30] step 1272/5000 loss 0.1449 (w 0.4138 mse 0.4001 t 970 new 0.19) lr 1.00e-05 gnorm 0.182 3.15s mem 81.1GB +[2026-09-14 11:15:33] step 1273/5000 loss 0.2099 (w 0.2446 mse 0.2580 t 983 new 0.19) lr 1.00e-05 gnorm 0.183 3.37s mem 81.1GB +[2026-09-14 11:15:36] step 1274/5000 loss 0.2317 (w 0.1781 mse 0.1847 t 924 new 0.23) lr 1.00e-05 gnorm 0.997 2.85s mem 81.1GB +[2026-09-14 11:15:39] step 1275/5000 loss 0.2082 (w 0.3479 mse 0.3485 t 977 new 0.23) lr 1.00e-05 gnorm 0.142 3.05s mem 81.1GB +[2026-09-14 11:15:42] step 1276/5000 loss 0.3786 (w 0.2554 mse 0.2471 t 616 new 0.27) lr 1.00e-05 gnorm 0.157 3.36s mem 81.1GB +[2026-09-14 11:15:46] step 1277/5000 loss 0.3539 (w 0.2348 mse 0.2233 t 954 new 0.21) lr 1.00e-05 gnorm 0.354 3.31s mem 81.1GB +[2026-09-14 11:15:48] step 1278/5000 loss 0.3623 (w 0.3103 mse 0.2860 t 862 new 0.22) lr 1.00e-05 gnorm 0.171 2.84s mem 81.1GB +[2026-09-14 11:15:52] step 1279/5000 loss 0.1377 (w 0.2551 mse 0.2587 t 963 new 0.27) lr 1.00e-05 gnorm 0.135 3.14s mem 81.1GB +[2026-09-14 11:15:54] step 1280/5000 loss 0.2569 (w 0.2967 mse 0.2815 t 963 new 0.26) lr 1.00e-05 gnorm 0.143 2.85s mem 81.1GB +[2026-09-14 11:15:58] step 1281/5000 loss 0.2390 (w 0.1916 mse 0.2033 t 984 new 0.12) lr 1.00e-05 gnorm 0.136 3.09s mem 81.1GB +[2026-09-14 11:16:01] step 1282/5000 loss 0.0824 (w 0.2656 mse 0.2642 t 891 new 0.16) lr 1.00e-05 gnorm 0.155 3.32s mem 81.1GB +[2026-09-14 11:16:04] step 1283/5000 loss 0.3491 (w 0.2500 mse 0.2397 t 878 new 0.07) lr 1.00e-05 gnorm 0.192 3.11s mem 81.1GB +[2026-09-14 11:16:07] step 1284/5000 loss 0.2221 (w 0.2359 mse 0.2114 t 927 new 0.19) lr 1.00e-05 gnorm 0.126 2.85s mem 81.1GB +[2026-09-14 11:16:10] step 1285/5000 loss 0.2352 (w 0.2279 mse 0.2196 t 692 new 0.15) lr 1.00e-05 gnorm 0.147 3.21s mem 81.1GB +[2026-09-14 11:16:13] step 1286/5000 loss 0.1631 (w 0.2445 mse 0.2368 t 949 new 0.22) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +[2026-09-14 11:16:16] step 1287/5000 loss 0.2138 (w 0.2958 mse 0.2871 t 953 new 0.18) lr 1.00e-05 gnorm 0.332 2.85s mem 81.1GB +[2026-09-14 11:16:20] step 1288/5000 loss 0.3504 (w 0.2329 mse 0.2362 t 855 new 0.22) lr 1.00e-05 gnorm 0.249 3.39s mem 81.1GB +[2026-09-14 11:16:23] step 1289/5000 loss 0.2164 (w 0.1366 mse 0.1372 t 702 new 0.07) lr 1.00e-05 gnorm 0.194 3.13s mem 81.1GB +[2026-09-14 11:16:26] step 1290/5000 loss 0.2119 (w 0.1395 mse 0.1470 t 866 new 0.24) lr 1.00e-05 gnorm 0.186 3.33s mem 81.1GB +[2026-09-14 11:16:29] step 1291/5000 loss 0.2948 (w 0.2068 mse 0.2023 t 995 new 0.23) lr 1.00e-05 gnorm 0.185 3.08s mem 81.1GB +[2026-09-14 11:16:32] step 1292/5000 loss 0.1311 (w 0.2223 mse 0.2171 t 892 new 0.25) lr 1.00e-05 gnorm 0.253 3.09s mem 81.1GB +[2026-09-14 11:16:35] step 1293/5000 loss 0.3108 (w 0.1377 mse 0.1238 t 940 new 0.18) lr 1.00e-05 gnorm 0.221 2.84s mem 81.1GB +[2026-09-14 11:16:38] step 1294/5000 loss 0.1915 (w 0.2181 mse 0.2212 t 826 new 0.23) lr 1.00e-05 gnorm 0.192 3.11s mem 81.1GB +[2026-09-14 11:16:42] step 1295/5000 loss 0.2083 (w 0.2144 mse 0.2012 t 899 new 0.26) lr 1.00e-05 gnorm 0.401 3.65s mem 81.1GB +[2026-09-14 11:16:45] step 1296/5000 loss 0.4848 (w 0.3246 mse 0.3179 t 553 new 0.09) lr 1.00e-05 gnorm 0.201 3.27s mem 81.1GB +[2026-09-14 11:16:48] step 1297/5000 loss 0.2052 (w 0.2009 mse 0.1867 t 890 new 0.19) lr 1.00e-05 gnorm 0.197 2.84s mem 81.1GB +[2026-09-14 11:16:51] step 1298/5000 loss 0.3066 (w 0.1880 mse 0.1860 t 876 new 0.18) lr 1.00e-05 gnorm 0.163 3.04s mem 81.1GB +[2026-09-14 11:16:54] step 1299/5000 loss 0.2353 (w 0.1788 mse 0.1885 t 619 new 0.15) lr 1.00e-05 gnorm 0.553 3.06s mem 81.1GB +[2026-09-14 11:16:57] step 1300/5000 loss 0.2417 (w 0.1634 mse 0.1658 t 939 new 0.18) lr 1.00e-05 gnorm 0.152 3.10s mem 81.1GB +[2026-09-14 11:17:00] step 1301/5000 loss 0.2373 (w 0.1121 mse 0.1083 t 720 new 0.14) lr 1.00e-05 gnorm 0.173 3.14s mem 81.1GB +[2026-09-14 11:17:03] step 1302/5000 loss 0.2536 (w 0.1633 mse 0.1661 t 820 new 0.09) lr 1.00e-05 gnorm 0.157 3.05s mem 81.1GB +[2026-09-14 11:17:07] step 1303/5000 loss 0.4531 (w 0.3624 mse 0.3628 t 390 new 0.19) lr 1.00e-05 gnorm 0.164 3.28s mem 81.1GB +[2026-09-14 11:17:10] step 1304/5000 loss 0.3084 (w 0.3323 mse 0.3415 t 995 new 0.16) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +[2026-09-14 11:17:13] step 1305/5000 loss 0.2160 (w 0.1859 mse 0.1779 t 717 new 0.14) lr 1.00e-05 gnorm 0.158 3.11s mem 81.1GB +[2026-09-14 11:17:16] step 1306/5000 loss 0.2018 (w 0.2384 mse 0.2335 t 989 new 0.24) lr 1.00e-05 gnorm 0.198 3.14s mem 81.1GB +[2026-09-14 11:17:19] step 1307/5000 loss 0.2152 (w 0.2309 mse 0.2230 t 982 new 0.23) lr 1.00e-05 gnorm 0.210 3.10s mem 81.1GB +[2026-09-14 11:17:22] step 1308/5000 loss 0.2187 (w 0.2870 mse 0.2825 t 912 new 0.23) lr 1.00e-05 gnorm 0.187 3.06s mem 81.1GB +[2026-09-14 11:17:25] step 1309/5000 loss 0.3303 (w 0.1798 mse 0.1765 t 884 new 0.23) lr 1.00e-05 gnorm 0.271 3.16s mem 81.1GB +[2026-09-14 11:17:28] step 1310/5000 loss 0.1366 (w 0.3204 mse 0.3119 t 997 new 0.22) lr 1.00e-05 gnorm 0.174 3.04s mem 81.1GB +[2026-09-14 11:17:32] step 1311/5000 loss 0.1113 (w 0.3636 mse 0.3405 t 988 new 0.22) lr 1.00e-05 gnorm 0.504 3.37s mem 81.1GB +[2026-09-14 11:17:35] step 1312/5000 loss 0.1451 (w 0.2395 mse 0.2303 t 786 new 0.23) lr 1.00e-05 gnorm 0.244 2.84s mem 81.1GB +[2026-09-14 11:17:38] step 1313/5000 loss 0.2793 (w 0.2289 mse 0.2328 t 473 new 0.19) lr 1.00e-05 gnorm 0.119 3.13s mem 81.1GB +[2026-09-14 11:17:41] step 1314/5000 loss 0.2296 (w 0.5369 mse 0.5182 t 986 new 0.18) lr 1.00e-05 gnorm 0.226 3.10s mem 81.1GB +[2026-09-14 11:17:44] step 1315/5000 loss 0.3569 (w 0.1756 mse 0.1726 t 992 new 0.19) lr 1.00e-05 gnorm 0.181 3.17s mem 81.1GB +[2026-09-14 11:17:47] step 1316/5000 loss 0.1937 (w 0.3062 mse 0.3039 t 601 new 0.18) lr 1.00e-05 gnorm 0.166 3.08s mem 81.1GB +[2026-09-14 11:17:51] step 1317/5000 loss 0.2626 (w 0.3336 mse 0.3133 t 776 new 0.23) lr 1.00e-05 gnorm 0.166 3.36s mem 81.1GB +[2026-09-14 11:17:54] step 1318/5000 loss 0.2092 (w 0.2337 mse 0.2305 t 914 new 0.16) lr 1.00e-05 gnorm 0.164 3.14s mem 81.1GB +[2026-09-14 11:17:57] step 1319/5000 loss 0.1977 (w 0.2426 mse 0.2368 t 885 new 0.23) lr 1.00e-05 gnorm 0.943 3.16s mem 81.1GB +[2026-09-14 11:18:00] step 1320/5000 loss 0.2713 (w 0.4091 mse 0.4204 t 983 new 0.19) lr 1.00e-05 gnorm 0.236 3.03s mem 81.1GB +[2026-09-14 11:18:03] step 1321/5000 loss 0.2510 (w 0.2302 mse 0.2147 t 885 new 0.21) lr 1.00e-05 gnorm 0.156 3.31s mem 81.1GB +[2026-09-14 11:18:07] step 1322/5000 loss 0.4196 (w 0.1825 mse 0.1816 t 814 new 0.21) lr 1.00e-05 gnorm 0.203 4.10s mem 81.1GB +[2026-09-14 11:18:10] step 1323/5000 loss 0.3246 (w 0.3750 mse 0.3914 t 228 new 0.17) lr 1.00e-05 gnorm 0.243 3.10s mem 81.1GB +[2026-09-14 11:18:14] step 1324/5000 loss 0.1820 (w 0.3942 mse 0.3634 t 998 new 0.20) lr 1.00e-05 gnorm 0.134 3.14s mem 81.1GB +[2026-09-14 11:18:16] step 1325/5000 loss 0.1656 (w 0.4478 mse 0.4231 t 998 new 0.23) lr 1.00e-05 gnorm 0.160 2.85s mem 81.1GB +[2026-09-14 11:18:20] step 1326/5000 loss 0.3180 (w 0.2888 mse 0.2642 t 974 new 0.18) lr 1.00e-05 gnorm 0.162 3.09s mem 81.1GB +[2026-09-14 11:18:23] step 1327/5000 loss 0.2858 (w 0.2157 mse 0.2161 t 710 new 0.09) lr 1.00e-05 gnorm 0.175 3.34s mem 81.1GB +[2026-09-14 11:18:26] step 1328/5000 loss 0.2549 (w 0.4108 mse 0.4149 t 297 new 0.29) lr 1.00e-05 gnorm 0.359 2.85s mem 81.1GB +[2026-09-14 11:18:29] step 1329/5000 loss 0.2541 (w 0.2330 mse 0.2289 t 959 new 0.20) lr 1.00e-05 gnorm 0.141 3.16s mem 81.1GB +[2026-09-14 11:18:32] step 1330/5000 loss 0.2508 (w 0.3934 mse 0.4061 t 985 new 0.20) lr 1.00e-05 gnorm 0.158 3.36s mem 81.1GB +[2026-09-14 11:18:35] step 1331/5000 loss 0.1085 (w 0.3712 mse 0.3622 t 968 new 0.18) lr 1.00e-05 gnorm 0.136 3.12s mem 81.1GB +[2026-09-14 11:18:38] step 1332/5000 loss 0.3212 (w 0.2111 mse 0.2000 t 866 new 0.20) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +[2026-09-14 11:18:41] step 1333/5000 loss 0.1476 (w 0.1726 mse 0.1807 t 975 new 0.10) lr 1.00e-05 gnorm 0.191 3.16s mem 81.1GB +[2026-09-14 11:18:45] step 1334/5000 loss 0.1638 (w 0.2142 mse 0.2179 t 863 new 0.18) lr 1.00e-05 gnorm 0.560 3.10s mem 81.1GB +[2026-09-14 11:18:48] step 1335/5000 loss 0.1790 (w 0.4408 mse 0.4102 t 992 new 0.20) lr 1.00e-05 gnorm 0.568 3.05s mem 81.1GB +[2026-09-14 11:18:51] step 1336/5000 loss 0.3134 (w 0.2666 mse 0.2560 t 737 new 0.15) lr 1.00e-05 gnorm 0.151 3.43s mem 81.1GB +[2026-09-14 11:18:54] step 1337/5000 loss 0.1568 (w 0.2072 mse 0.1894 t 718 new 0.20) lr 1.00e-05 gnorm 0.226 3.12s mem 81.1GB +[2026-09-14 11:18:57] step 1338/5000 loss 0.1023 (w 0.2330 mse 0.2367 t 956 new 0.11) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +[2026-09-14 11:19:00] step 1339/5000 loss 0.2583 (w 0.3147 mse 0.2962 t 663 new 0.19) lr 1.00e-05 gnorm 0.158 3.18s mem 81.1GB +[2026-09-14 11:19:04] step 1340/5000 loss 0.4037 (w 0.2897 mse 0.2862 t 973 new 0.12) lr 1.00e-05 gnorm 0.167 3.42s mem 81.1GB +[2026-09-14 11:19:07] step 1341/5000 loss 0.2679 (w 0.2702 mse 0.2554 t 881 new 0.21) lr 1.00e-05 gnorm 0.316 3.29s mem 81.1GB +[2026-09-14 11:19:10] step 1342/5000 loss 0.0828 (w 0.3211 mse 0.3349 t 987 new 0.23) lr 1.00e-05 gnorm 0.220 3.12s mem 81.1GB +[2026-09-14 11:19:13] step 1343/5000 loss 0.2012 (w 0.3225 mse 0.3188 t 986 new 0.21) lr 1.00e-05 gnorm 0.151 3.03s mem 81.1GB +[2026-09-14 11:19:16] step 1344/5000 loss 0.3218 (w 0.2202 mse 0.2388 t 578 new 0.18) lr 1.00e-05 gnorm 0.160 3.33s mem 81.1GB +[2026-09-14 11:19:19] step 1345/5000 loss 0.2564 (w 0.1907 mse 0.1830 t 927 new 0.21) lr 1.00e-05 gnorm 0.194 3.02s mem 81.1GB +[2026-09-14 11:19:23] step 1346/5000 loss 0.3073 (w 0.4356 mse 0.4413 t 348 new 0.13) lr 1.00e-05 gnorm 0.127 3.17s mem 81.1GB +[2026-09-14 11:19:26] step 1347/5000 loss 0.3576 (w 0.2005 mse 0.1991 t 817 new 0.22) lr 1.00e-05 gnorm 0.192 3.32s mem 81.1GB +[2026-09-14 11:19:29] step 1348/5000 loss 0.1752 (w 0.2470 mse 0.2578 t 966 new 0.15) lr 1.00e-05 gnorm 0.138 3.16s mem 81.1GB +[2026-09-14 11:19:32] step 1349/5000 loss 0.2069 (w 0.2442 mse 0.2238 t 948 new 0.21) lr 1.00e-05 gnorm 0.153 3.03s mem 81.1GB +[2026-09-14 11:19:35] step 1350/5000 loss 0.2290 (w 0.1397 mse 0.1377 t 850 new 0.15) lr 1.00e-05 gnorm 1.291 2.86s mem 81.1GB +[2026-09-14 11:19:38] step 1351/5000 loss 0.2086 (w 0.1428 mse 0.1428 t 677 new 0.01) lr 1.00e-05 gnorm 0.134 3.18s mem 81.1GB +[2026-09-14 11:19:41] step 1352/5000 loss 0.3525 (w 0.2820 mse 0.2722 t 871 new 0.17) lr 1.00e-05 gnorm 0.182 3.09s mem 81.1GB +[2026-09-14 11:19:45] step 1353/5000 loss 0.3014 (w 0.2893 mse 0.2735 t 540 new 0.27) lr 1.00e-05 gnorm 0.474 3.35s mem 81.1GB +[2026-09-14 11:19:47] step 1354/5000 loss 0.1201 (w 0.3903 mse 0.3902 t 987 new 0.19) lr 1.00e-05 gnorm 0.270 2.85s mem 81.1GB +[2026-09-14 11:19:51] step 1355/5000 loss 0.3777 (w 0.2167 mse 0.2170 t 884 new 0.17) lr 1.00e-05 gnorm 0.160 3.07s mem 81.1GB +[2026-09-14 11:19:54] step 1356/5000 loss 0.3566 (w 0.3024 mse 0.2811 t 978 new 0.22) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +[2026-09-14 11:19:57] step 1357/5000 loss 0.1995 (w 0.2018 mse 0.1913 t 898 new 0.19) lr 1.00e-05 gnorm 0.223 3.19s mem 81.1GB +[2026-09-14 11:20:00] step 1358/5000 loss 0.2262 (w 0.3290 mse 0.3242 t 999 new 0.20) lr 1.00e-05 gnorm 0.123 3.11s mem 81.1GB +[2026-09-14 11:20:03] step 1359/5000 loss 0.1054 (w 0.1916 mse 0.1850 t 875 new 0.10) lr 1.00e-05 gnorm 1.097 3.39s mem 81.1GB +[2026-09-14 11:20:06] step 1360/5000 loss 0.3166 (w 0.2094 mse 0.1995 t 890 new 0.21) lr 1.00e-05 gnorm 0.208 2.84s mem 81.1GB +[2026-09-14 11:20:09] step 1361/5000 loss 0.1780 (w 0.0945 mse 0.1091 t 904 new 0.19) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-14 11:20:12] step 1362/5000 loss 0.1567 (w 0.1623 mse 0.1564 t 923 new 0.22) lr 1.00e-05 gnorm 0.139 3.03s mem 81.1GB +[2026-09-14 11:20:16] step 1363/5000 loss 0.2616 (w 0.4180 mse 0.3958 t 972 new 0.19) lr 1.00e-05 gnorm 0.133 3.42s mem 81.1GB +[2026-09-14 11:20:19] step 1364/5000 loss 0.3338 (w 0.2704 mse 0.2837 t 980 new 0.14) lr 1.00e-05 gnorm 0.168 3.13s mem 81.1GB +[2026-09-14 11:20:22] step 1365/5000 loss 0.3411 (w 0.2756 mse 0.2649 t 562 new 0.21) lr 1.00e-05 gnorm 0.129 3.17s mem 81.1GB +[2026-09-14 11:20:25] step 1366/5000 loss 0.2953 (w 0.2307 mse 0.2141 t 841 new 0.21) lr 1.00e-05 gnorm 0.112 2.85s mem 81.1GB +[2026-09-14 11:20:28] step 1367/5000 loss 0.2499 (w 0.4812 mse 0.4884 t 212 new 0.18) lr 1.00e-05 gnorm 0.835 3.05s mem 81.1GB +[2026-09-14 11:20:31] step 1368/5000 loss 0.3609 (w 0.1710 mse 0.1716 t 719 new 0.12) lr 1.00e-05 gnorm 0.177 3.03s mem 81.1GB +[2026-09-14 11:20:34] step 1369/5000 loss 0.0869 (w 0.1829 mse 0.1800 t 969 new 0.22) lr 1.00e-05 gnorm 0.156 3.37s mem 81.1GB +[2026-09-14 11:20:37] step 1370/5000 loss 0.2762 (w 0.1288 mse 0.1302 t 666 new 0.21) lr 1.00e-05 gnorm 0.143 3.06s mem 81.1GB +[2026-09-14 11:20:40] step 1371/5000 loss 0.3091 (w 0.2261 mse 0.2196 t 931 new 0.22) lr 1.00e-05 gnorm 0.236 3.14s mem 81.1GB +[2026-09-14 11:20:43] step 1372/5000 loss 0.2698 (w 0.2379 mse 0.2316 t 815 new 0.24) lr 1.00e-05 gnorm 0.580 2.84s mem 81.1GB +[2026-09-14 11:20:46] step 1373/5000 loss 0.2946 (w 0.2838 mse 0.2687 t 878 new 0.20) lr 1.00e-05 gnorm 0.146 3.08s mem 81.1GB +[2026-09-14 11:20:49] step 1374/5000 loss 0.2380 (w 0.2668 mse 0.2489 t 955 new 0.28) lr 1.00e-05 gnorm 0.131 3.09s mem 81.1GB +[2026-09-14 11:20:53] step 1375/5000 loss 0.3274 (w 0.2272 mse 0.2262 t 999 new 0.10) lr 1.00e-05 gnorm 0.126 3.40s mem 81.1GB +[2026-09-14 11:20:56] step 1376/5000 loss 0.2360 (w 0.2067 mse 0.2131 t 944 new 0.21) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +[2026-09-14 11:20:59] step 1377/5000 loss 0.3153 (w 0.2412 mse 0.2404 t 808 new 0.26) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +[2026-09-14 11:21:02] step 1378/5000 loss 0.2803 (w 0.1834 mse 0.1823 t 950 new 0.19) lr 1.00e-05 gnorm 0.186 3.04s mem 81.1GB +[2026-09-14 11:21:05] step 1379/5000 loss 0.1912 (w 0.2094 mse 0.2163 t 790 new 0.17) lr 1.00e-05 gnorm 0.151 2.85s mem 81.1GB +[2026-09-14 11:21:08] step 1380/5000 loss 0.1997 (w 0.2682 mse 0.2711 t 970 new 0.07) lr 1.00e-05 gnorm 0.249 3.10s mem 81.1GB +[2026-09-14 11:21:12] step 1381/5000 loss 0.2311 (w 0.3160 mse 0.3047 t 892 new 0.21) lr 1.00e-05 gnorm 0.196 3.46s mem 81.1GB +[2026-09-14 11:21:15] step 1382/5000 loss 0.2232 (w 0.1893 mse 0.1963 t 941 new 0.22) lr 1.00e-05 gnorm 0.124 3.17s mem 81.1GB +[2026-09-14 11:21:19] step 1383/5000 loss 0.3055 (w 0.2736 mse 0.2724 t 479 new 0.19) lr 1.00e-05 gnorm 1.153 3.72s mem 81.1GB +[2026-09-14 11:21:22] step 1384/5000 loss 0.3711 (w 0.1558 mse 0.1448 t 815 new 0.23) lr 1.00e-05 gnorm 0.575 3.12s mem 81.1GB +[2026-09-14 11:21:24] step 1385/5000 loss 0.3477 (w 0.7166 mse 0.7015 t 100 new 0.15) lr 1.00e-05 gnorm 0.179 2.84s mem 81.1GB +[2026-09-14 11:21:28] step 1386/5000 loss 0.1980 (w 0.2222 mse 0.2135 t 836 new 0.21) lr 1.00e-05 gnorm 0.221 3.07s mem 81.1GB +[2026-09-14 11:21:31] step 1387/5000 loss 0.1782 (w 0.1944 mse 0.1930 t 906 new 0.23) lr 1.00e-05 gnorm 0.213 3.16s mem 81.1GB +[2026-09-14 11:21:34] step 1388/5000 loss 0.1140 (w 0.1456 mse 0.1464 t 886 new 0.24) lr 1.00e-05 gnorm 0.144 3.10s mem 81.1GB +[2026-09-14 11:21:37] step 1389/5000 loss 0.2834 (w 0.2150 mse 0.2254 t 988 new 0.25) lr 1.00e-05 gnorm 0.201 3.12s mem 81.1GB +[2026-09-14 11:21:40] step 1390/5000 loss 0.2226 (w 0.1560 mse 0.1454 t 897 new 0.21) lr 1.00e-05 gnorm 0.160 3.11s mem 81.1GB +[2026-09-14 11:21:43] step 1391/5000 loss 0.3018 (w 0.1606 mse 0.1664 t 712 new 0.18) lr 1.00e-05 gnorm 0.138 2.85s mem 81.1GB +[2026-09-14 11:21:46] step 1392/5000 loss 0.2865 (w 0.1075 mse 0.1176 t 916 new 0.14) lr 1.00e-05 gnorm 0.274 3.26s mem 81.1GB +[2026-09-14 11:21:49] step 1393/5000 loss 0.2186 (w 0.1830 mse 0.1751 t 858 new 0.20) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +[2026-09-14 11:21:52] step 1394/5000 loss 0.2718 (w 0.2200 mse 0.2284 t 983 new 0.27) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +[2026-09-14 11:21:56] step 1395/5000 loss 0.2243 (w 0.1951 mse 0.2022 t 758 new 0.13) lr 1.00e-05 gnorm 0.118 3.16s mem 81.1GB +[2026-09-14 11:21:59] step 1396/5000 loss 0.1064 (w 0.2572 mse 0.2726 t 974 new 0.22) lr 1.00e-05 gnorm 0.149 3.11s mem 81.1GB +[2026-09-14 11:22:02] step 1397/5000 loss 0.3164 (w 0.1599 mse 0.1564 t 908 new 0.24) lr 1.00e-05 gnorm 0.148 2.85s mem 81.1GB +[2026-09-14 11:22:05] step 1398/5000 loss 0.3452 (w 0.3182 mse 0.3293 t 200 new 0.26) lr 1.00e-05 gnorm 0.155 3.38s mem 81.1GB +[2026-09-14 11:22:08] step 1399/5000 loss 0.2001 (w 0.2435 mse 0.2367 t 773 new 0.22) lr 1.00e-05 gnorm 0.321 3.41s mem 81.1GB +[2026-09-14 11:22:11] step 1400/5000 loss 0.1615 (w 0.3105 mse 0.3042 t 983 new 0.24) lr 1.00e-05 gnorm 0.136 2.85s mem 81.1GB +[2026-09-14 11:22:15] step 1401/5000 loss 0.1046 (w 0.2304 mse 0.2307 t 953 new 0.21) lr 1.00e-05 gnorm 0.410 3.13s mem 81.1GB +[2026-09-14 11:22:18] step 1402/5000 loss 0.1469 (w 0.3622 mse 0.3443 t 715 new 0.20) lr 1.00e-05 gnorm 0.157 3.08s mem 81.1GB +[2026-09-14 11:22:21] step 1403/5000 loss 0.1373 (w 0.2039 mse 0.2001 t 945 new 0.15) lr 1.00e-05 gnorm 0.198 3.11s mem 81.1GB +[2026-09-14 11:22:24] step 1404/5000 loss 0.3514 (w 0.1703 mse 0.1858 t 570 new 0.16) lr 1.00e-05 gnorm 0.144 3.15s mem 81.1GB +[2026-09-14 11:22:27] step 1405/5000 loss 0.2210 (w 0.2590 mse 0.2523 t 959 new 0.20) lr 1.00e-05 gnorm 0.163 3.36s mem 81.1GB +[2026-09-14 11:22:30] step 1406/5000 loss 0.1573 (w 0.4470 mse 0.4454 t 985 new 0.22) lr 1.00e-05 gnorm 0.203 3.15s mem 81.1GB +[2026-09-14 11:22:33] step 1407/5000 loss 0.1593 (w 0.1839 mse 0.1779 t 951 new 0.20) lr 1.00e-05 gnorm 0.251 2.85s mem 81.1GB +[2026-09-14 11:22:36] step 1408/5000 loss 0.1545 (w 0.2075 mse 0.2185 t 981 new 0.22) lr 1.00e-05 gnorm 0.347 3.08s mem 81.1GB +[2026-09-14 11:22:39] step 1409/5000 loss 0.2970 (w 0.2577 mse 0.2695 t 975 new 0.25) lr 1.00e-05 gnorm 0.147 3.03s mem 81.1GB +[2026-09-14 11:22:43] step 1410/5000 loss 0.4372 (w 0.3690 mse 0.3754 t 233 new 0.20) lr 1.00e-05 gnorm 0.289 3.14s mem 81.1GB +[2026-09-14 11:22:46] step 1411/5000 loss 0.1916 (w 0.1689 mse 0.1673 t 731 new 0.27) lr 1.00e-05 gnorm 0.304 3.43s mem 81.1GB +[2026-09-14 11:22:49] step 1412/5000 loss 0.1727 (w 0.1176 mse 0.1262 t 924 new 0.15) lr 1.00e-05 gnorm 0.127 3.15s mem 81.1GB +[2026-09-14 11:22:52] step 1413/5000 loss 0.2085 (w 0.1772 mse 0.1623 t 819 new 0.19) lr 1.00e-05 gnorm 0.137 2.86s mem 81.1GB +[2026-09-14 11:22:55] step 1414/5000 loss 0.2176 (w 0.1392 mse 0.1438 t 899 new 0.13) lr 1.00e-05 gnorm 0.256 3.09s mem 81.1GB +[2026-09-14 11:22:58] step 1415/5000 loss 0.1508 (w 0.4957 mse 0.5019 t 987 new 0.25) lr 1.00e-05 gnorm 0.170 3.06s mem 81.1GB +[2026-09-14 11:23:02] step 1416/5000 loss 0.2318 (w 0.5432 mse 0.5284 t 200 new 0.19) lr 1.00e-05 gnorm 0.129 3.38s mem 81.1GB +[2026-09-14 11:23:05] step 1417/5000 loss 0.2292 (w 0.1435 mse 0.1439 t 890 new 0.23) lr 1.00e-05 gnorm 0.162 3.13s mem 81.1GB +[2026-09-14 11:23:08] step 1418/5000 loss 0.1432 (w 0.2271 mse 0.2240 t 760 new 0.20) lr 1.00e-05 gnorm 0.165 3.40s mem 81.1GB +[2026-09-14 11:23:11] step 1419/5000 loss 0.0923 (w 0.2484 mse 0.2366 t 980 new 0.22) lr 1.00e-05 gnorm 0.147 3.05s mem 81.1GB +[2026-09-14 11:23:14] step 1420/5000 loss 0.2021 (w 0.1777 mse 0.1677 t 727 new 0.09) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-14 11:23:17] step 1421/5000 loss 0.1704 (w 0.3609 mse 0.3386 t 953 new 0.16) lr 1.00e-05 gnorm 0.153 3.10s mem 81.1GB +[2026-09-14 11:23:21] step 1422/5000 loss 0.3816 (w 0.3701 mse 0.3764 t 301 new 0.25) lr 1.00e-05 gnorm 0.246 3.47s mem 81.1GB +[2026-09-14 11:23:24] step 1423/5000 loss 0.3355 (w 0.3489 mse 0.3651 t 383 new 0.21) lr 1.00e-05 gnorm 0.169 3.13s mem 81.1GB +[2026-09-14 11:23:27] step 1424/5000 loss 0.2117 (w 0.2391 mse 0.2317 t 799 new 0.10) lr 1.00e-05 gnorm 0.304 3.55s mem 81.1GB +[2026-09-14 11:23:30] step 1425/5000 loss 0.1143 (w 0.1871 mse 0.1793 t 744 new 0.23) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +[2026-09-14 11:23:33] step 1426/5000 loss 0.3318 (w 0.2291 mse 0.2177 t 506 new 0.20) lr 1.00e-05 gnorm 0.297 2.84s mem 81.1GB +[2026-09-14 11:23:37] step 1427/5000 loss 0.2357 (w 0.2639 mse 0.2493 t 841 new 0.18) lr 1.00e-05 gnorm 0.130 3.36s mem 81.1GB +[2026-09-14 11:23:40] step 1428/5000 loss 0.1746 (w 0.1758 mse 0.1655 t 747 new 0.21) lr 1.00e-05 gnorm 1.484 3.42s mem 81.1GB +[2026-09-14 11:23:43] step 1429/5000 loss 0.4085 (w 0.4324 mse 0.4429 t 233 new 0.14) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +[2026-09-14 11:23:46] step 1430/5000 loss 0.2333 (w 0.2195 mse 0.2076 t 949 new 0.21) lr 1.00e-05 gnorm 0.172 3.22s mem 81.1GB +[2026-09-14 11:23:49] step 1431/5000 loss 0.2464 (w 0.2066 mse 0.2105 t 920 new 0.21) lr 1.00e-05 gnorm 0.216 3.06s mem 81.1GB +[2026-09-14 11:23:52] step 1432/5000 loss 0.2095 (w 0.1900 mse 0.1812 t 931 new 0.12) lr 1.00e-05 gnorm 0.555 2.85s mem 81.1GB +[2026-09-14 11:23:55] step 1433/5000 loss 0.1629 (w 0.2608 mse 0.2575 t 942 new 0.22) lr 1.00e-05 gnorm 0.111 3.17s mem 81.1GB +[2026-09-14 11:23:59] step 1434/5000 loss 0.2863 (w 0.2517 mse 0.2448 t 906 new 0.08) lr 1.00e-05 gnorm 0.164 3.14s mem 81.1GB +[2026-09-14 11:24:02] step 1435/5000 loss 0.1336 (w 0.3171 mse 0.2984 t 983 new 0.27) lr 1.00e-05 gnorm 0.142 3.40s mem 81.1GB +[2026-09-14 11:24:05] step 1436/5000 loss 0.2401 (w 0.2873 mse 0.2793 t 672 new 0.21) lr 1.00e-05 gnorm 0.338 2.84s mem 81.1GB +[2026-09-14 11:24:09] step 1437/5000 loss 0.1478 (w 0.2128 mse 0.2094 t 942 new 0.21) lr 1.00e-05 gnorm 0.157 3.97s mem 81.1GB +[2026-09-14 11:24:12] step 1438/5000 loss 0.3041 (w 0.3191 mse 0.3209 t 465 new 0.19) lr 1.00e-05 gnorm 0.168 3.02s mem 81.1GB +[2026-09-14 11:24:15] step 1439/5000 loss 0.2287 (w 0.2254 mse 0.2318 t 795 new 0.17) lr 1.00e-05 gnorm 0.178 3.13s mem 81.1GB +[2026-09-14 11:24:18] step 1440/5000 loss 0.2638 (w 0.1420 mse 0.1384 t 945 new 0.22) lr 1.00e-05 gnorm 0.220 3.08s mem 81.1GB +[2026-09-14 11:24:22] step 1441/5000 loss 0.1978 (w 0.2977 mse 0.2799 t 702 new 0.25) lr 1.00e-05 gnorm 0.164 3.47s mem 81.1GB +[2026-09-14 11:24:25] step 1442/5000 loss 0.2243 (w 0.1245 mse 0.1301 t 740 new 0.22) lr 1.00e-05 gnorm 0.186 3.12s mem 81.1GB +[2026-09-14 11:24:28] step 1443/5000 loss 0.2666 (w 0.2770 mse 0.2752 t 773 new 0.25) lr 1.00e-05 gnorm 0.738 2.87s mem 81.1GB +[2026-09-14 11:24:31] step 1444/5000 loss 0.2530 (w 0.2505 mse 0.2434 t 790 new 0.21) lr 1.00e-05 gnorm 0.228 3.07s mem 81.1GB +[2026-09-14 11:24:34] step 1445/5000 loss 0.2248 (w 0.3799 mse 0.3997 t 254 new 0.17) lr 1.00e-05 gnorm 0.124 3.42s mem 81.1GB +[2026-09-14 11:24:37] step 1446/5000 loss 0.2520 (w 0.2001 mse 0.2083 t 973 new 0.10) lr 1.00e-05 gnorm 0.156 3.11s mem 81.1GB +[2026-09-14 11:24:41] step 1447/5000 loss 0.1791 (w 0.1308 mse 0.1298 t 938 new 0.08) lr 1.00e-05 gnorm 0.185 3.42s mem 81.1GB +[2026-09-14 11:24:44] step 1448/5000 loss 0.2331 (w 0.1691 mse 0.1647 t 537 new 0.16) lr 1.00e-05 gnorm 0.209 3.12s mem 81.1GB +[2026-09-14 11:24:47] step 1449/5000 loss 0.1246 (w 0.3397 mse 0.3314 t 982 new 0.21) lr 1.00e-05 gnorm 0.163 2.85s mem 81.1GB +[2026-09-14 11:24:50] step 1450/5000 loss 0.2734 (w 0.2935 mse 0.2845 t 576 new 0.22) lr 1.00e-05 gnorm 0.287 3.11s mem 81.1GB +[2026-09-14 11:24:53] step 1451/5000 loss 0.2533 (w 0.0960 mse 0.1065 t 720 new 0.22) lr 1.00e-05 gnorm 0.174 3.47s mem 81.1GB +[2026-09-14 11:24:57] step 1452/5000 loss 0.1688 (w 0.2918 mse 0.2977 t 957 new 0.23) lr 1.00e-05 gnorm 0.134 3.65s mem 81.1GB +[2026-09-14 11:25:00] step 1453/5000 loss 0.3946 (w 0.2234 mse 0.2164 t 462 new 0.11) lr 1.00e-05 gnorm 0.193 3.18s mem 81.1GB +[2026-09-14 11:25:03] step 1454/5000 loss 0.2698 (w 0.3219 mse 0.3210 t 368 new 0.10) lr 1.00e-05 gnorm 0.147 3.04s mem 81.1GB +[2026-09-14 11:25:06] step 1455/5000 loss 0.2038 (w 0.2193 mse 0.2139 t 628 new 0.18) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +[2026-09-14 11:25:09] step 1456/5000 loss 0.2860 (w 0.2732 mse 0.2761 t 768 new 0.18) lr 1.00e-05 gnorm 0.134 3.07s mem 81.1GB +[2026-09-14 11:25:12] step 1457/5000 loss 0.2187 (w 0.1938 mse 0.1862 t 818 new 0.20) lr 1.00e-05 gnorm 0.152 3.44s mem 81.1GB +[2026-09-14 11:25:16] step 1458/5000 loss 0.1939 (w 0.2364 mse 0.2280 t 902 new 0.23) lr 1.00e-05 gnorm 0.175 3.16s mem 81.1GB +[2026-09-14 11:25:19] step 1459/5000 loss 0.2272 (w 0.3522 mse 0.3584 t 972 new 0.13) lr 1.00e-05 gnorm 0.197 3.19s mem 81.1GB +[2026-09-14 11:25:22] step 1460/5000 loss 0.2975 (w 0.3700 mse 0.3503 t 982 new 0.26) lr 1.00e-05 gnorm 0.153 3.10s mem 81.1GB +[2026-09-14 11:25:25] step 1461/5000 loss 0.2409 (w 0.2411 mse 0.2265 t 939 new 0.19) lr 1.00e-05 gnorm 0.395 2.86s mem 81.1GB +[2026-09-14 11:25:28] step 1462/5000 loss 0.1487 (w 0.2825 mse 0.2682 t 933 new 0.21) lr 1.00e-05 gnorm 0.520 3.09s mem 81.1GB +[2026-09-14 11:25:31] step 1463/5000 loss 0.2758 (w 0.2937 mse 0.2756 t 942 new 0.23) lr 1.00e-05 gnorm 0.143 3.43s mem 81.1GB +[2026-09-14 11:25:34] step 1464/5000 loss 0.2574 (w 0.2866 mse 0.3047 t 998 new 0.21) lr 1.00e-05 gnorm 0.148 3.09s mem 81.1GB +[2026-09-14 11:25:38] step 1465/5000 loss 0.3649 (w 0.2213 mse 0.2251 t 518 new 0.13) lr 1.00e-05 gnorm 0.145 3.16s mem 81.1GB +[2026-09-14 11:25:41] step 1466/5000 loss 0.2370 (w 0.2357 mse 0.2203 t 779 new 0.17) lr 1.00e-05 gnorm 0.112 3.05s mem 81.1GB +[2026-09-14 11:25:44] step 1467/5000 loss 0.2785 (w 0.1928 mse 0.1852 t 902 new 0.15) lr 1.00e-05 gnorm 0.118 3.04s mem 81.1GB +[2026-09-14 11:25:46] step 1468/5000 loss 0.2637 (w 0.3371 mse 0.3215 t 975 new 0.23) lr 1.00e-05 gnorm 0.220 2.84s mem 81.1GB +[2026-09-14 11:25:50] step 1469/5000 loss 0.2861 (w 0.2671 mse 0.2577 t 833 new 0.21) lr 1.00e-05 gnorm 0.291 3.37s mem 81.1GB +[2026-09-14 11:25:53] step 1470/5000 loss 0.2854 (w 0.2118 mse 0.2011 t 798 new 0.10) lr 1.00e-05 gnorm 0.135 3.66s mem 81.1GB +[2026-09-14 11:25:57] step 1471/5000 loss 0.2051 (w 0.1063 mse 0.1168 t 976 new 0.11) lr 1.00e-05 gnorm 0.368 3.14s mem 81.1GB +[2026-09-14 11:26:00] step 1472/5000 loss 0.2752 (w 0.1618 mse 0.1541 t 695 new 0.22) lr 1.00e-05 gnorm 0.200 3.07s mem 81.1GB +[2026-09-14 11:26:03] step 1473/5000 loss 0.1926 (w 0.2056 mse 0.2099 t 883 new 0.18) lr 1.00e-05 gnorm 0.208 3.05s mem 81.1GB +[2026-09-14 11:26:06] step 1474/5000 loss 0.2130 (w 0.1745 mse 0.1773 t 875 new 0.25) lr 1.00e-05 gnorm 0.276 3.68s mem 81.1GB +[2026-09-14 11:26:10] step 1475/5000 loss 0.1879 (w 0.1792 mse 0.1777 t 952 new 0.19) lr 1.00e-05 gnorm 0.184 3.13s mem 81.1GB +[2026-09-14 11:26:13] step 1476/5000 loss 0.2018 (w 0.2739 mse 0.2570 t 815 new 0.20) lr 1.00e-05 gnorm 0.286 3.18s mem 81.1GB +[2026-09-14 11:26:16] step 1477/5000 loss 0.2694 (w 0.3118 mse 0.3160 t 932 new 0.13) lr 1.00e-05 gnorm 0.226 3.15s mem 81.1GB +[2026-09-14 11:26:19] step 1478/5000 loss 0.3729 (w 0.4769 mse 0.4769 t 306 new 0.17) lr 1.00e-05 gnorm 0.196 3.12s mem 81.1GB +[2026-09-14 11:26:22] step 1479/5000 loss 0.2106 (w 0.2906 mse 0.2841 t 987 new 0.10) lr 1.00e-05 gnorm 0.787 3.08s mem 81.1GB +[2026-09-14 11:26:25] step 1480/5000 loss 0.2452 (w 0.3324 mse 0.3378 t 982 new 0.22) lr 1.00e-05 gnorm 0.280 3.12s mem 81.1GB +[2026-09-14 11:26:29] step 1481/5000 loss 0.3278 (w 0.2611 mse 0.2611 t 336 new 0.28) lr 1.00e-05 gnorm 0.314 3.40s mem 81.1GB +[2026-09-14 11:26:32] step 1482/5000 loss 0.2201 (w 0.2680 mse 0.2576 t 492 new 0.19) lr 1.00e-05 gnorm 0.150 3.58s mem 81.1GB +[2026-09-14 11:26:36] step 1483/5000 loss 0.2745 (w 0.2847 mse 0.2772 t 703 new 0.16) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +[2026-09-14 11:26:38] step 1484/5000 loss 0.3806 (w 0.2814 mse 0.2719 t 669 new 0.25) lr 1.00e-05 gnorm 0.161 2.86s mem 81.1GB +[2026-09-14 11:26:41] step 1485/5000 loss 0.2176 (w 0.0697 mse 0.0752 t 828 new 0.21) lr 1.00e-05 gnorm 0.127 3.07s mem 81.1GB +[2026-09-14 11:26:45] step 1486/5000 loss 0.1652 (w 0.2386 mse 0.2278 t 939 new 0.24) lr 1.00e-05 gnorm 0.424 3.09s mem 81.1GB +[2026-09-14 11:26:48] step 1487/5000 loss 0.3044 (w 0.2402 mse 0.2345 t 892 new 0.21) lr 1.00e-05 gnorm 0.256 3.33s mem 81.1GB +[2026-09-14 11:26:51] step 1488/5000 loss 0.2079 (w 0.3133 mse 0.3041 t 990 new 0.20) lr 1.00e-05 gnorm 0.202 3.43s mem 81.1GB +[2026-09-14 11:26:55] step 1489/5000 loss 0.2424 (w 0.0999 mse 0.1044 t 852 new 0.23) lr 1.00e-05 gnorm 0.134 3.37s mem 81.1GB +[2026-09-14 11:26:58] step 1490/5000 loss 0.1568 (w 0.1771 mse 0.1594 t 906 new 0.25) lr 1.00e-05 gnorm 0.775 2.84s mem 81.1GB +[2026-09-14 11:27:01] step 1491/5000 loss 0.2420 (w 0.2441 mse 0.2198 t 684 new 0.21) lr 1.00e-05 gnorm 0.234 3.03s mem 81.1GB +[2026-09-14 11:27:04] step 1492/5000 loss 0.1194 (w 0.3926 mse 0.3877 t 965 new 0.21) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +[2026-09-14 11:27:07] step 1493/5000 loss 0.3481 (w 0.3067 mse 0.3167 t 968 new 0.19) lr 1.00e-05 gnorm 0.136 3.12s mem 81.1GB +[2026-09-14 11:27:10] step 1494/5000 loss 0.2859 (w 0.3676 mse 0.3470 t 946 new 0.21) lr 1.00e-05 gnorm 0.228 3.40s mem 81.1GB +[2026-09-14 11:27:14] step 1495/5000 loss 0.2630 (w 0.3029 mse 0.2887 t 996 new 0.28) lr 1.00e-05 gnorm 0.252 3.40s mem 81.1GB +[2026-09-14 11:27:17] step 1496/5000 loss 0.4901 (w 0.2761 mse 0.2700 t 981 new 0.23) lr 1.00e-05 gnorm 0.151 2.86s mem 81.1GB +[2026-09-14 11:27:20] step 1497/5000 loss 0.2146 (w 0.1789 mse 0.1800 t 770 new 0.25) lr 1.00e-05 gnorm 0.133 3.38s mem 81.1GB +[2026-09-14 11:27:23] step 1498/5000 loss 0.2789 (w 0.1999 mse 0.1906 t 824 new 0.15) lr 1.00e-05 gnorm 0.184 3.13s mem 81.1GB +[2026-09-14 11:27:26] step 1499/5000 loss 0.1235 (w 0.2982 mse 0.2963 t 947 new 0.13) lr 1.00e-05 gnorm 0.187 3.39s mem 81.1GB +[2026-09-14 11:27:30] step 1500/5000 loss 0.3610 (w 0.2525 mse 0.2442 t 566 new 0.19) lr 1.00e-05 gnorm 0.119 3.18s mem 81.1GB +[2026-09-14 11:27:31] [val] step 1500 t=200: w=0.4302 mse=0.4413 (n=16) t=500: w=0.2305 mse=0.2346 (n=16) t=800: w=0.1813 mse=0.1812 (n=16) | mean w=0.2806 mse=0.2857 2s +[2026-09-14 11:28:20] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step1500.safetensors 4093 个张量 37.98 GB +[2026-09-14 11:28:25] step 1501/5000 loss 0.2970 (w 0.2422 mse 0.2386 t 973 new 0.20) lr 1.00e-05 gnorm 0.211 3.10s mem 81.1GB +[2026-09-14 11:28:28] step 1502/5000 loss 0.2339 (w 0.2826 mse 0.2876 t 975 new 0.14) lr 1.00e-05 gnorm 0.135 3.29s mem 81.1GB +[2026-09-14 11:28:31] step 1503/5000 loss 0.2880 (w 0.2429 mse 0.2349 t 769 new 0.21) lr 1.00e-05 gnorm 0.237 2.82s mem 81.1GB +[2026-09-14 11:28:34] step 1504/5000 loss 0.2499 (w 0.2001 mse 0.1980 t 883 new 0.17) lr 1.00e-05 gnorm 0.153 3.12s mem 81.1GB +[2026-09-14 11:28:37] step 1505/5000 loss 0.2409 (w 0.2210 mse 0.2196 t 994 new 0.22) lr 1.00e-05 gnorm 0.214 3.17s mem 81.1GB +[2026-09-14 11:28:41] step 1506/5000 loss 0.2598 (w 0.1061 mse 0.1204 t 933 new 0.22) lr 1.00e-05 gnorm 0.146 3.40s mem 81.1GB +[2026-09-14 11:28:44] step 1507/5000 loss 0.2254 (w 0.3139 mse 0.3051 t 328 new 0.19) lr 1.00e-05 gnorm 0.169 2.85s mem 81.1GB +[2026-09-14 11:28:47] step 1508/5000 loss 0.0898 (w 0.0985 mse 0.1091 t 765 new 0.19) lr 1.00e-05 gnorm 0.121 3.25s mem 81.1GB +[2026-09-14 11:28:50] step 1509/5000 loss 0.1882 (w 0.3159 mse 0.2871 t 987 new 0.22) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +[2026-09-14 11:28:53] step 1510/5000 loss 0.2679 (w 0.0947 mse 0.1013 t 802 new 0.15) lr 1.00e-05 gnorm 0.161 3.10s mem 81.1GB +[2026-09-14 11:28:56] step 1511/5000 loss 0.1844 (w 0.1610 mse 0.1680 t 811 new 0.22) lr 1.00e-05 gnorm 0.132 3.38s mem 81.1GB +[2026-09-14 11:29:00] step 1512/5000 loss 0.1602 (w 0.3156 mse 0.3006 t 966 new 0.15) lr 1.00e-05 gnorm 0.145 3.43s mem 81.1GB +[2026-09-14 11:29:03] step 1513/5000 loss 0.3225 (w 0.2015 mse 0.1975 t 783 new 0.19) lr 1.00e-05 gnorm 0.183 2.85s mem 81.1GB +[2026-09-14 11:29:06] step 1514/5000 loss 0.2305 (w 0.3191 mse 0.3150 t 269 new 0.20) lr 1.00e-05 gnorm 0.153 3.37s mem 81.1GB +[2026-09-14 11:29:09] step 1515/5000 loss 0.1139 (w 0.2869 mse 0.2840 t 926 new 0.25) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +[2026-09-14 11:29:12] step 1516/5000 loss 0.2855 (w 0.1630 mse 0.1569 t 826 new 0.22) lr 1.00e-05 gnorm 0.217 3.12s mem 81.1GB +[2026-09-14 11:29:16] step 1517/5000 loss 0.2439 (w 0.2117 mse 0.2016 t 760 new 0.21) lr 1.00e-05 gnorm 0.166 3.56s mem 81.1GB +[2026-09-14 11:29:19] step 1518/5000 loss 0.2358 (w 0.2271 mse 0.2268 t 917 new 0.21) lr 1.00e-05 gnorm 0.142 3.12s mem 81.1GB +[2026-09-14 11:29:22] step 1519/5000 loss 0.2725 (w 0.2274 mse 0.2256 t 659 new 0.29) lr 1.00e-05 gnorm 0.141 3.13s mem 81.1GB +[2026-09-14 11:29:25] step 1520/5000 loss 0.3058 (w 0.2162 mse 0.2246 t 301 new 0.06) lr 1.00e-05 gnorm 0.199 3.14s mem 81.1GB +[2026-09-14 11:29:28] step 1521/5000 loss 0.1799 (w 0.1220 mse 0.1258 t 871 new 0.21) lr 1.00e-05 gnorm 0.175 2.85s mem 81.1GB +[2026-09-14 11:29:31] step 1522/5000 loss 0.2595 (w 0.2867 mse 0.2825 t 958 new 0.17) lr 1.00e-05 gnorm 0.160 3.33s mem 81.1GB +[2026-09-14 11:29:35] step 1523/5000 loss 0.3105 (w 0.3073 mse 0.3075 t 568 new 0.17) lr 1.00e-05 gnorm 0.384 3.40s mem 81.1GB +[2026-09-14 11:29:38] step 1524/5000 loss 0.2863 (w 0.2329 mse 0.2280 t 586 new 0.20) lr 1.00e-05 gnorm 0.163 3.41s mem 81.1GB +[2026-09-14 11:29:41] step 1525/5000 loss 0.2756 (w 0.2272 mse 0.2372 t 959 new 0.19) lr 1.00e-05 gnorm 0.139 3.06s mem 81.1GB +[2026-09-14 11:29:44] step 1526/5000 loss 0.4556 (w 0.2802 mse 0.2634 t 709 new 0.25) lr 1.00e-05 gnorm 0.525 3.11s mem 81.1GB +[2026-09-14 11:29:47] step 1527/5000 loss 0.2398 (w 0.1710 mse 0.1723 t 727 new 0.22) lr 1.00e-05 gnorm 0.186 2.85s mem 81.1GB +[2026-09-14 11:29:50] step 1528/5000 loss 0.2508 (w 0.2652 mse 0.2700 t 710 new 0.14) lr 1.00e-05 gnorm 0.131 3.13s mem 81.1GB +[2026-09-14 11:29:53] step 1529/5000 loss 0.3090 (w 0.2627 mse 0.2574 t 626 new 0.25) lr 1.00e-05 gnorm 0.156 3.38s mem 81.1GB +[2026-09-14 11:29:57] step 1530/5000 loss 0.1966 (w 0.2576 mse 0.2505 t 634 new 0.21) lr 1.00e-05 gnorm 0.240 3.16s mem 81.1GB +[2026-09-14 11:30:00] step 1531/5000 loss 0.1580 (w 0.2922 mse 0.2813 t 939 new 0.19) lr 1.00e-05 gnorm 0.369 3.09s mem 81.1GB +[2026-09-14 11:30:03] step 1532/5000 loss 0.1977 (w 0.1322 mse 0.1423 t 925 new 0.10) lr 1.00e-05 gnorm 0.189 3.14s mem 81.1GB +[2026-09-14 11:30:06] step 1533/5000 loss 0.2736 (w 0.2721 mse 0.2665 t 995 new 0.24) lr 1.00e-05 gnorm 0.189 2.85s mem 81.1GB +[2026-09-14 11:30:09] step 1534/5000 loss 0.3280 (w 0.2032 mse 0.1992 t 728 new 0.16) lr 1.00e-05 gnorm 0.246 3.16s mem 81.1GB +[2026-09-14 11:30:12] step 1535/5000 loss 0.1933 (w 0.2480 mse 0.2384 t 875 new 0.24) lr 1.00e-05 gnorm 0.180 3.05s mem 81.1GB +[2026-09-14 11:30:15] step 1536/5000 loss 0.0817 (w 0.2630 mse 0.2483 t 856 new 0.13) lr 1.00e-05 gnorm 0.218 3.17s mem 81.1GB +[2026-09-14 11:30:19] step 1537/5000 loss 0.2593 (w 0.2048 mse 0.2033 t 890 new 0.22) lr 1.00e-05 gnorm 0.168 3.25s mem 81.1GB +[2026-09-14 11:30:21] step 1538/5000 loss 0.2098 (w 0.2258 mse 0.2186 t 813 new 0.29) lr 1.00e-05 gnorm 0.309 2.85s mem 81.1GB +[2026-09-14 11:30:24] step 1539/5000 loss 0.3174 (w 0.1257 mse 0.1272 t 781 new 0.21) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +[2026-09-14 11:30:28] step 1540/5000 loss 0.2259 (w 0.2399 mse 0.2295 t 961 new 0.20) lr 1.00e-05 gnorm 0.181 3.40s mem 81.1GB +[2026-09-14 11:30:31] step 1541/5000 loss 0.2529 (w 0.4841 mse 0.4589 t 994 new 0.23) lr 1.00e-05 gnorm 0.162 3.08s mem 81.1GB +[2026-09-14 11:30:34] step 1542/5000 loss 0.3308 (w 0.1123 mse 0.1159 t 669 new 0.13) lr 1.00e-05 gnorm 0.171 3.09s mem 81.1GB +[2026-09-14 11:30:37] step 1543/5000 loss 0.1996 (w 0.1417 mse 0.1620 t 996 new 0.22) lr 1.00e-05 gnorm 0.152 3.40s mem 81.1GB +[2026-09-14 11:30:40] step 1544/5000 loss 0.3658 (w 0.2451 mse 0.2228 t 743 new 0.22) lr 1.00e-05 gnorm 0.177 2.85s mem 81.1GB +[2026-09-14 11:30:43] step 1545/5000 loss 0.3495 (w 0.2388 mse 0.2494 t 967 new 0.16) lr 1.00e-05 gnorm 2.893 3.05s mem 81.1GB +[2026-09-14 11:30:47] step 1546/5000 loss 0.2128 (w 0.2146 mse 0.2081 t 506 new 0.21) lr 1.00e-05 gnorm 0.221 3.38s mem 81.1GB +[2026-09-14 11:30:50] step 1547/5000 loss 0.2074 (w 0.1198 mse 0.1263 t 938 new 0.06) lr 1.00e-05 gnorm 0.190 3.13s mem 81.1GB +[2026-09-14 11:30:53] step 1548/5000 loss 0.1920 (w 0.2518 mse 0.2721 t 669 new 0.15) lr 1.00e-05 gnorm 0.194 3.12s mem 81.1GB +[2026-09-14 11:30:56] step 1549/5000 loss 0.2588 (w 0.2605 mse 0.2541 t 932 new 0.28) lr 1.00e-05 gnorm 0.317 3.14s mem 81.1GB +[2026-09-14 11:30:59] step 1550/5000 loss 0.1170 (w 0.4757 mse 0.4601 t 981 new 0.22) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +[2026-09-14 11:31:02] step 1551/5000 loss 0.3811 (w 0.1930 mse 0.2115 t 390 new 0.28) lr 1.00e-05 gnorm 0.148 3.09s mem 81.1GB +[2026-09-14 11:31:05] step 1552/5000 loss 0.2364 (w 0.1767 mse 0.1758 t 826 new 0.13) lr 1.00e-05 gnorm 0.145 3.14s mem 81.1GB +[2026-09-14 11:31:08] step 1553/5000 loss 0.2834 (w 0.2524 mse 0.2439 t 734 new 0.22) lr 1.00e-05 gnorm 0.154 3.37s mem 81.1GB +[2026-09-14 11:31:12] step 1554/5000 loss 0.1787 (w 0.0563 mse 0.0668 t 842 new 0.17) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +[2026-09-14 11:31:15] step 1555/5000 loss 0.2788 (w 0.3937 mse 0.3907 t 955 new 0.20) lr 1.00e-05 gnorm 0.215 3.14s mem 81.1GB +[2026-09-14 11:31:18] step 1556/5000 loss 0.2972 (w 0.1310 mse 0.1411 t 777 new 0.23) lr 1.00e-05 gnorm 0.208 2.85s mem 81.1GB +[2026-09-14 11:31:21] step 1557/5000 loss 0.1444 (w 0.2350 mse 0.2303 t 998 new 0.18) lr 1.00e-05 gnorm 0.149 3.13s mem 81.1GB +[2026-09-14 11:31:24] step 1558/5000 loss 0.2048 (w 0.4469 mse 0.4342 t 994 new 0.23) lr 1.00e-05 gnorm 0.174 3.16s mem 81.1GB +[2026-09-14 11:31:27] step 1559/5000 loss 0.1780 (w 0.3085 mse 0.2968 t 984 new 0.21) lr 1.00e-05 gnorm 0.157 3.41s mem 81.1GB +[2026-09-14 11:31:30] step 1560/5000 loss 0.2774 (w 0.2333 mse 0.2255 t 868 new 0.26) lr 1.00e-05 gnorm 0.214 3.20s mem 81.1GB +[2026-09-14 11:31:34] step 1561/5000 loss 0.1743 (w 0.1528 mse 0.1488 t 866 new 0.19) lr 1.00e-05 gnorm 0.189 3.05s mem 81.1GB +[2026-09-14 11:31:36] step 1562/5000 loss 0.1922 (w 0.2348 mse 0.2292 t 850 new 0.16) lr 1.00e-05 gnorm 1.148 2.84s mem 81.1GB +[2026-09-14 11:31:40] step 1563/5000 loss 0.2296 (w 0.2084 mse 0.2149 t 997 new 0.18) lr 1.00e-05 gnorm 0.191 3.43s mem 81.1GB +[2026-09-14 11:31:43] step 1564/5000 loss 0.1326 (w 0.2337 mse 0.2221 t 808 new 0.23) lr 1.00e-05 gnorm 0.165 3.07s mem 81.1GB +[2026-09-14 11:31:46] step 1565/5000 loss 0.3005 (w 0.4793 mse 0.4552 t 998 new 0.19) lr 1.00e-05 gnorm 0.183 3.28s mem 81.1GB +[2026-09-14 11:31:49] step 1566/5000 loss 0.2093 (w 0.2715 mse 0.2857 t 954 new 0.20) lr 1.00e-05 gnorm 0.383 3.07s mem 81.1GB +[2026-09-14 11:31:52] step 1567/5000 loss 0.0952 (w 0.2065 mse 0.2120 t 981 new 0.24) lr 1.00e-05 gnorm 0.107 3.09s mem 81.1GB +[2026-09-14 11:31:55] step 1568/5000 loss 0.2719 (w 0.2756 mse 0.2634 t 621 new 0.18) lr 1.00e-05 gnorm 0.147 2.85s mem 81.1GB +[2026-09-14 11:31:59] step 1569/5000 loss 0.2735 (w 0.1723 mse 0.1613 t 777 new 0.20) lr 1.00e-05 gnorm 0.215 3.41s mem 81.1GB +[2026-09-14 11:32:02] step 1570/5000 loss 0.3228 (w 0.2784 mse 0.2660 t 969 new 0.12) lr 1.00e-05 gnorm 0.179 3.11s mem 81.1GB +[2026-09-14 11:32:05] step 1571/5000 loss 0.2813 (w 0.1720 mse 0.1739 t 779 new 0.22) lr 1.00e-05 gnorm 0.147 3.13s mem 81.1GB +[2026-09-14 11:32:08] step 1572/5000 loss 0.2126 (w 0.1332 mse 0.1351 t 865 new 0.26) lr 1.00e-05 gnorm 0.685 3.02s mem 81.1GB +[2026-09-14 11:32:11] step 1573/5000 loss 0.2529 (w 0.2047 mse 0.1876 t 851 new 0.21) lr 1.00e-05 gnorm 0.169 3.14s mem 81.1GB +[2026-09-14 11:32:14] step 1574/5000 loss 0.3051 (w 0.1456 mse 0.1435 t 782 new 0.22) lr 1.00e-05 gnorm 0.275 2.85s mem 81.1GB +[2026-09-14 11:32:17] step 1575/5000 loss 0.2689 (w 0.3300 mse 0.3239 t 953 new 0.23) lr 1.00e-05 gnorm 0.167 3.38s mem 81.1GB +[2026-09-14 11:32:21] step 1576/5000 loss 0.1921 (w 0.1730 mse 0.1671 t 883 new 0.22) lr 1.00e-05 gnorm 0.144 3.62s mem 81.1GB +[2026-09-14 11:32:24] step 1577/5000 loss 0.3139 (w 0.2109 mse 0.2045 t 852 new 0.21) lr 1.00e-05 gnorm 0.164 3.08s mem 81.1GB +[2026-09-14 11:32:27] step 1578/5000 loss 0.2285 (w 0.1570 mse 0.1643 t 962 new 0.17) lr 1.00e-05 gnorm 0.263 3.02s mem 81.1GB +[2026-09-14 11:32:30] step 1579/5000 loss 0.1792 (w 0.3523 mse 0.3251 t 959 new 0.24) lr 1.00e-05 gnorm 0.123 3.14s mem 81.1GB +[2026-09-14 11:32:33] step 1580/5000 loss 0.1477 (w 0.0844 mse 0.0898 t 795 new 0.08) lr 1.00e-05 gnorm 0.188 2.84s mem 81.1GB +[2026-09-14 11:32:36] step 1581/5000 loss 0.2919 (w 0.3174 mse 0.3088 t 977 new 0.30) lr 1.00e-05 gnorm 0.183 3.12s mem 81.1GB +[2026-09-14 11:32:40] step 1582/5000 loss 0.1711 (w 0.2892 mse 0.2829 t 964 new 0.20) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +[2026-09-14 11:32:43] step 1583/5000 loss 0.3149 (w 0.0802 mse 0.0814 t 776 new 0.17) lr 1.00e-05 gnorm 0.156 3.11s mem 81.1GB +[2026-09-14 11:32:46] step 1584/5000 loss 0.1761 (w 0.1994 mse 0.1855 t 888 new 0.18) lr 1.00e-05 gnorm 0.194 3.07s mem 81.1GB +[2026-09-14 11:32:49] step 1585/5000 loss 0.2912 (w 0.6916 mse 0.6908 t 127 new 0.07) lr 1.00e-05 gnorm 0.239 3.07s mem 81.1GB +[2026-09-14 11:32:52] step 1586/5000 loss 0.3749 (w 0.2724 mse 0.2561 t 951 new 0.25) lr 1.00e-05 gnorm 0.248 3.12s mem 81.1GB +[2026-09-14 11:32:55] step 1587/5000 loss 0.3380 (w 0.2661 mse 0.2658 t 533 new 0.19) lr 1.00e-05 gnorm 0.616 3.10s mem 81.1GB +[2026-09-14 11:32:58] step 1588/5000 loss 0.1665 (w 0.1123 mse 0.1173 t 695 new 0.12) lr 1.00e-05 gnorm 0.269 3.33s mem 81.1GB +[2026-09-14 11:33:02] step 1589/5000 loss 0.1835 (w 0.3363 mse 0.3211 t 961 new 0.28) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +[2026-09-14 11:33:05] step 1590/5000 loss 0.2289 (w 0.1582 mse 0.1687 t 920 new 0.22) lr 1.00e-05 gnorm 0.346 2.85s mem 81.1GB +[2026-09-14 11:33:08] step 1591/5000 loss 0.2767 (w 0.1745 mse 0.1740 t 849 new 0.21) lr 1.00e-05 gnorm 0.266 3.12s mem 81.1GB +[2026-09-14 11:33:11] step 1592/5000 loss 0.1784 (w 0.4070 mse 0.3908 t 979 new 0.15) lr 1.00e-05 gnorm 0.128 3.16s mem 81.1GB +[2026-09-14 11:33:14] step 1593/5000 loss 0.2842 (w 0.2606 mse 0.2533 t 570 new 0.15) lr 1.00e-05 gnorm 0.339 3.11s mem 81.1GB +[2026-09-14 11:33:17] step 1594/5000 loss 0.1001 (w 0.3033 mse 0.3063 t 990 new 0.11) lr 1.00e-05 gnorm 0.399 3.44s mem 81.1GB +[2026-09-14 11:33:21] step 1595/5000 loss 0.2677 (w 0.0934 mse 0.0978 t 875 new 0.08) lr 1.00e-05 gnorm 0.528 3.07s mem 81.1GB +[2026-09-14 11:33:24] step 1596/5000 loss 0.2145 (w 0.2149 mse 0.2169 t 978 new 0.18) lr 1.00e-05 gnorm 0.188 3.16s mem 81.1GB +[2026-09-14 11:33:27] step 1597/5000 loss 0.2060 (w 0.3412 mse 0.3417 t 984 new 0.21) lr 1.00e-05 gnorm 0.126 2.87s mem 81.1GB +[2026-09-14 11:33:30] step 1598/5000 loss 0.3345 (w 0.2114 mse 0.2078 t 809 new 0.22) lr 1.00e-05 gnorm 0.171 3.10s mem 81.1GB +[2026-09-14 11:33:33] step 1599/5000 loss 0.1622 (w 0.1212 mse 0.1333 t 802 new 0.20) lr 1.00e-05 gnorm 0.283 3.14s mem 81.1GB +[2026-09-14 11:33:36] step 1600/5000 loss 0.2173 (w 0.2854 mse 0.2799 t 916 new 0.17) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +[2026-09-14 11:33:39] step 1601/5000 loss 0.2119 (w 0.1737 mse 0.1680 t 917 new 0.15) lr 1.00e-05 gnorm 0.276 3.09s mem 81.1GB +[2026-09-14 11:33:42] step 1602/5000 loss 0.3075 (w 0.4894 mse 0.4854 t 244 new 0.21) lr 1.00e-05 gnorm 0.321 3.07s mem 81.1GB +[2026-09-14 11:33:45] step 1603/5000 loss 0.2476 (w 0.2165 mse 0.2053 t 824 new 0.19) lr 1.00e-05 gnorm 0.786 2.85s mem 81.1GB +[2026-09-14 11:33:48] step 1604/5000 loss 0.1601 (w 0.4406 mse 0.4280 t 988 new 0.22) lr 1.00e-05 gnorm 0.178 3.13s mem 81.1GB +[2026-09-14 11:33:51] step 1605/5000 loss 0.0870 (w 0.2940 mse 0.2829 t 959 new 0.23) lr 1.00e-05 gnorm 0.159 3.14s mem 81.1GB +[2026-09-14 11:33:55] step 1606/5000 loss 0.0946 (w 0.1550 mse 0.1495 t 808 new 0.27) lr 1.00e-05 gnorm 0.115 3.13s mem 81.1GB +[2026-09-14 11:33:58] step 1607/5000 loss 0.3731 (w 0.2435 mse 0.2394 t 657 new 0.19) lr 1.00e-05 gnorm 0.249 3.07s mem 81.1GB +[2026-09-14 11:34:01] step 1608/5000 loss 0.2275 (w 0.2568 mse 0.2577 t 973 new 0.08) lr 1.00e-05 gnorm 0.148 3.08s mem 81.1GB +[2026-09-14 11:34:04] step 1609/5000 loss 0.3065 (w 0.1116 mse 0.1167 t 788 new 0.27) lr 1.00e-05 gnorm 0.229 3.15s mem 81.1GB +[2026-09-14 11:34:08] step 1610/5000 loss 0.2140 (w 0.1880 mse 0.2040 t 998 new 0.17) lr 1.00e-05 gnorm 0.167 3.69s mem 81.1GB +[2026-09-14 11:34:11] step 1611/5000 loss 0.1254 (w 0.2096 mse 0.1973 t 838 new 0.18) lr 1.00e-05 gnorm 0.146 3.33s mem 81.1GB +[2026-09-14 11:34:14] step 1612/5000 loss 0.1487 (w 0.1862 mse 0.1827 t 785 new 0.21) lr 1.00e-05 gnorm 0.137 3.33s mem 81.1GB +[2026-09-14 11:34:18] step 1613/5000 loss 0.2950 (w 0.1801 mse 0.1858 t 777 new 0.19) lr 1.00e-05 gnorm 0.187 3.10s mem 81.1GB +[2026-09-14 11:34:21] step 1614/5000 loss 0.2366 (w 0.1693 mse 0.1701 t 774 new 0.22) lr 1.00e-05 gnorm 0.155 3.07s mem 81.1GB +[2026-09-14 11:34:24] step 1615/5000 loss 0.1560 (w 0.2735 mse 0.2616 t 975 new 0.25) lr 1.00e-05 gnorm 0.257 3.11s mem 81.1GB +[2026-09-14 11:34:27] step 1616/5000 loss 0.1263 (w 0.2318 mse 0.2304 t 977 new 0.20) lr 1.00e-05 gnorm 0.122 3.07s mem 81.1GB +[2026-09-14 11:34:30] step 1617/5000 loss 0.2259 (w 0.2690 mse 0.2649 t 503 new 0.26) lr 1.00e-05 gnorm 0.159 3.33s mem 81.1GB +[2026-09-14 11:34:34] step 1618/5000 loss 0.2348 (w 0.2558 mse 0.2412 t 918 new 0.18) lr 1.00e-05 gnorm 0.234 3.39s mem 81.1GB +[2026-09-14 11:34:36] step 1619/5000 loss 0.1728 (w 0.2937 mse 0.2769 t 989 new 0.27) lr 1.00e-05 gnorm 0.111 2.86s mem 81.1GB +[2026-09-14 11:34:39] step 1620/5000 loss 0.3285 (w 0.2650 mse 0.2740 t 846 new 0.21) lr 1.00e-05 gnorm 0.249 3.07s mem 81.1GB +[2026-09-14 11:34:43] step 1621/5000 loss 0.2567 (w 0.1081 mse 0.1089 t 943 new 0.13) lr 1.00e-05 gnorm 0.178 3.15s mem 81.1GB +[2026-09-14 11:34:46] step 1622/5000 loss 0.2796 (w 0.3079 mse 0.2848 t 688 new 0.20) lr 1.00e-05 gnorm 0.392 3.09s mem 81.1GB +[2026-09-14 11:34:49] step 1623/5000 loss 0.1269 (w 0.2500 mse 0.2438 t 884 new 0.20) lr 1.00e-05 gnorm 0.204 3.28s mem 81.1GB +[2026-09-14 11:34:52] step 1624/5000 loss 0.3817 (w 0.1500 mse 0.1504 t 553 new 0.17) lr 1.00e-05 gnorm 0.214 3.31s mem 81.1GB +[2026-09-14 11:34:55] step 1625/5000 loss 0.1976 (w 0.1332 mse 0.1231 t 850 new 0.13) lr 1.00e-05 gnorm 3.843 2.85s mem 81.1GB +[2026-09-14 11:34:58] step 1626/5000 loss 0.1492 (w 0.2278 mse 0.2192 t 659 new 0.19) lr 1.00e-05 gnorm 0.109 3.11s mem 81.1GB +[2026-09-14 11:35:01] step 1627/5000 loss 0.2780 (w 0.2031 mse 0.2145 t 557 new 0.19) lr 1.00e-05 gnorm 0.309 3.13s mem 81.1GB +[2026-09-14 11:35:05] step 1628/5000 loss 0.2513 (w 0.1905 mse 0.1939 t 692 new 0.13) lr 1.00e-05 gnorm 0.275 3.11s mem 81.1GB +[2026-09-14 11:35:08] step 1629/5000 loss 0.1385 (w 0.3527 mse 0.3451 t 963 new 0.18) lr 1.00e-05 gnorm 0.148 3.52s mem 81.1GB +[2026-09-14 11:35:11] step 1630/5000 loss 0.2700 (w 0.2033 mse 0.2034 t 728 new 0.13) lr 1.00e-05 gnorm 0.159 3.14s mem 81.1GB +[2026-09-14 11:35:14] step 1631/5000 loss 0.1560 (w 0.1859 mse 0.1836 t 942 new 0.22) lr 1.00e-05 gnorm 0.269 2.86s mem 81.1GB +[2026-09-14 11:35:17] step 1632/5000 loss 0.2735 (w 0.1892 mse 0.1802 t 894 new 0.25) lr 1.00e-05 gnorm 0.160 3.09s mem 81.1GB +[2026-09-14 11:35:20] step 1633/5000 loss 0.2556 (w 0.2776 mse 0.2941 t 973 new 0.22) lr 1.00e-05 gnorm 0.450 3.08s mem 81.1GB +[2026-09-14 11:35:23] step 1634/5000 loss 0.1612 (w 0.2668 mse 0.2686 t 926 new 0.18) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +[2026-09-14 11:35:27] step 1635/5000 loss 0.0715 (w 0.2499 mse 0.2407 t 984 new 0.22) lr 1.00e-05 gnorm 0.117 3.53s mem 81.1GB +[2026-09-14 11:35:30] step 1636/5000 loss 0.2879 (w 0.2805 mse 0.2845 t 998 new 0.24) lr 1.00e-05 gnorm 0.201 3.09s mem 81.1GB +[2026-09-14 11:35:33] step 1637/5000 loss 0.1608 (w 0.2795 mse 0.2835 t 976 new 0.22) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +[2026-09-14 11:35:36] step 1638/5000 loss 0.2938 (w 0.2010 mse 0.2021 t 586 new 0.11) lr 1.00e-05 gnorm 0.179 3.11s mem 81.1GB +[2026-09-14 11:35:39] step 1639/5000 loss 0.3634 (w 0.2762 mse 0.2752 t 592 new 0.22) lr 1.00e-05 gnorm 0.231 3.08s mem 81.1GB +[2026-09-14 11:35:42] step 1640/5000 loss 0.1270 (w 0.3035 mse 0.3137 t 989 new 0.14) lr 1.00e-05 gnorm 0.213 3.06s mem 81.1GB +[2026-09-14 11:35:45] step 1641/5000 loss 0.2402 (w 0.4960 mse 0.4433 t 994 new 0.20) lr 1.00e-05 gnorm 0.167 3.40s mem 81.1GB +[2026-09-14 11:35:48] step 1642/5000 loss 0.2480 (w 0.1389 mse 0.1439 t 863 new 0.11) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +[2026-09-14 11:35:51] step 1643/5000 loss 0.3712 (w 0.4757 mse 0.4700 t 259 new 0.16) lr 1.00e-05 gnorm 0.140 3.05s mem 81.1GB +[2026-09-14 11:35:54] step 1644/5000 loss 0.2749 (w 0.3880 mse 0.3804 t 283 new 0.25) lr 1.00e-05 gnorm 0.511 2.85s mem 81.1GB +[2026-09-14 11:35:57] step 1645/5000 loss 0.2116 (w 0.2276 mse 0.2177 t 804 new 0.27) lr 1.00e-05 gnorm 0.288 3.07s mem 81.1GB +[2026-09-14 11:36:00] step 1646/5000 loss 0.2207 (w 0.2662 mse 0.2436 t 862 new 0.24) lr 1.00e-05 gnorm 0.152 3.10s mem 81.1GB +[2026-09-14 11:36:04] step 1647/5000 loss 0.2194 (w 0.2437 mse 0.2430 t 961 new 0.12) lr 1.00e-05 gnorm 0.230 3.42s mem 81.1GB +[2026-09-14 11:36:07] step 1648/5000 loss 0.2480 (w 0.2149 mse 0.2082 t 917 new 0.27) lr 1.00e-05 gnorm 0.240 2.85s mem 81.1GB +[2026-09-14 11:36:10] step 1649/5000 loss 0.1961 (w 0.1476 mse 0.1482 t 816 new 0.18) lr 1.00e-05 gnorm 0.221 3.05s mem 81.1GB +[2026-09-14 11:36:13] step 1650/5000 loss 0.2551 (w 0.2737 mse 0.2584 t 689 new 0.24) lr 1.00e-05 gnorm 0.138 2.85s mem 81.1GB +[2026-09-14 11:36:16] step 1651/5000 loss 0.1454 (w 0.1382 mse 0.1235 t 941 new 0.17) lr 1.00e-05 gnorm 0.232 3.28s mem 81.1GB +[2026-09-14 11:36:19] step 1652/5000 loss 0.2177 (w 0.2404 mse 0.2390 t 875 new 0.15) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +[2026-09-14 11:36:22] step 1653/5000 loss 0.3322 (w 0.3017 mse 0.2931 t 898 new 0.22) lr 1.00e-05 gnorm 0.177 3.54s mem 81.1GB +[2026-09-14 11:36:25] step 1654/5000 loss 0.3225 (w 0.1625 mse 0.1787 t 939 new 0.16) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +[2026-09-14 11:36:28] step 1655/5000 loss 0.2893 (w 0.4602 mse 0.4294 t 991 new 0.25) lr 1.00e-05 gnorm 0.174 3.10s mem 81.1GB +[2026-09-14 11:36:31] step 1656/5000 loss 0.1830 (w 0.3697 mse 0.3792 t 200 new 0.21) lr 1.00e-05 gnorm 0.113 2.84s mem 81.1GB +[2026-09-14 11:36:35] step 1657/5000 loss 0.1785 (w 0.1426 mse 0.1427 t 669 new 0.17) lr 1.00e-05 gnorm 0.139 3.29s mem 81.1GB +[2026-09-14 11:36:38] step 1658/5000 loss 0.3891 (w 0.3043 mse 0.2892 t 983 new 0.22) lr 1.00e-05 gnorm 0.201 3.09s mem 81.1GB +[2026-09-14 11:36:41] step 1659/5000 loss 0.2926 (w 0.1927 mse 0.1867 t 904 new 0.24) lr 1.00e-05 gnorm 0.129 3.52s mem 81.1GB +[2026-09-14 11:36:44] step 1660/5000 loss 0.1942 (w 0.5836 mse 0.5780 t 990 new 0.27) lr 1.00e-05 gnorm 0.130 2.85s mem 81.1GB +[2026-09-14 11:36:47] step 1661/5000 loss 0.3664 (w 0.3534 mse 0.3440 t 484 new 0.30) lr 1.00e-05 gnorm 0.172 3.19s mem 81.1GB +[2026-09-14 11:36:50] step 1662/5000 loss 0.1105 (w 0.1834 mse 0.1728 t 891 new 0.13) lr 1.00e-05 gnorm 0.163 2.86s mem 81.1GB +[2026-09-14 11:36:53] step 1663/5000 loss 0.2259 (w 0.3838 mse 0.3900 t 319 new 0.26) lr 1.00e-05 gnorm 0.420 3.33s mem 81.1GB +[2026-09-14 11:36:56] step 1664/5000 loss 0.2198 (w 0.4023 mse 0.3798 t 996 new 0.23) lr 1.00e-05 gnorm 0.205 3.07s mem 81.1GB +[2026-09-14 11:37:00] step 1665/5000 loss 0.2793 (w 0.3554 mse 0.3495 t 987 new 0.21) lr 1.00e-05 gnorm 0.131 3.51s mem 81.1GB +[2026-09-14 11:37:03] step 1666/5000 loss 0.2770 (w 0.3538 mse 0.3339 t 976 new 0.24) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +[2026-09-14 11:37:06] step 1667/5000 loss 0.4526 (w 0.3458 mse 0.3513 t 340 new 0.19) lr 1.00e-05 gnorm 0.494 3.19s mem 81.1GB +[2026-09-14 11:37:09] step 1668/5000 loss 0.1918 (w 0.3343 mse 0.3027 t 950 new 0.27) lr 1.00e-05 gnorm 0.141 2.85s mem 81.1GB +[2026-09-14 11:37:12] step 1669/5000 loss 0.2260 (w 0.2830 mse 0.2724 t 1000 new 0.25) lr 1.00e-05 gnorm 0.342 3.16s mem 81.1GB +[2026-09-14 11:37:15] step 1670/5000 loss 0.2923 (w 0.3190 mse 0.3076 t 722 new 0.22) lr 1.00e-05 gnorm 0.168 3.35s mem 81.1GB +[2026-09-14 11:37:19] step 1671/5000 loss 0.3773 (w 0.2000 mse 0.2191 t 998 new 0.22) lr 1.00e-05 gnorm 0.940 3.39s mem 81.1GB +[2026-09-14 11:37:22] step 1672/5000 loss 0.0781 (w 0.3044 mse 0.2978 t 932 new 0.14) lr 1.00e-05 gnorm 0.107 2.86s mem 81.1GB +[2026-09-14 11:37:25] step 1673/5000 loss 0.2810 (w 0.1842 mse 0.1805 t 904 new 0.13) lr 1.00e-05 gnorm 0.132 3.12s mem 81.1GB +[2026-09-14 11:37:28] step 1674/5000 loss 0.2892 (w 0.3479 mse 0.3511 t 983 new 0.18) lr 1.00e-05 gnorm 0.182 3.13s mem 81.1GB +[2026-09-14 11:37:31] step 1675/5000 loss 0.2949 (w 0.2433 mse 0.2399 t 557 new 0.09) lr 1.00e-05 gnorm 0.164 3.09s mem 81.1GB +[2026-09-14 11:37:34] step 1676/5000 loss 0.2258 (w 0.3506 mse 0.3398 t 946 new 0.16) lr 1.00e-05 gnorm 0.207 3.32s mem 81.1GB +[2026-09-14 11:37:38] step 1677/5000 loss 0.1566 (w 0.2830 mse 0.2605 t 972 new 0.28) lr 1.00e-05 gnorm 0.135 3.17s mem 81.1GB +[2026-09-14 11:37:40] step 1678/5000 loss 0.2556 (w 0.2135 mse 0.1949 t 993 new 0.17) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +[2026-09-14 11:37:44] step 1679/5000 loss 0.1374 (w 0.2457 mse 0.2541 t 752 new 0.20) lr 1.00e-05 gnorm 0.141 3.16s mem 81.1GB +[2026-09-14 11:37:47] step 1680/5000 loss 0.3026 (w 0.1971 mse 0.1911 t 822 new 0.27) lr 1.00e-05 gnorm 0.113 3.05s mem 81.1GB +[2026-09-14 11:37:50] step 1681/5000 loss 0.3571 (w 0.2408 mse 0.2360 t 959 new 0.19) lr 1.00e-05 gnorm 10.182 3.40s mem 81.1GB +[2026-09-14 11:37:53] step 1682/5000 loss 0.1238 (w 0.1743 mse 0.1657 t 920 new 0.24) lr 1.00e-05 gnorm 0.234 3.13s mem 81.1GB +[2026-09-14 11:37:57] step 1683/5000 loss 0.2552 (w 0.1841 mse 0.1924 t 920 new 0.21) lr 1.00e-05 gnorm 0.800 3.25s mem 81.1GB +[2026-09-14 11:38:00] step 1684/5000 loss 0.2375 (w 0.1477 mse 0.1449 t 930 new 0.25) lr 1.00e-05 gnorm 0.181 3.10s mem 81.1GB +[2026-09-14 11:38:03] step 1685/5000 loss 0.1892 (w 0.2368 mse 0.2312 t 977 new 0.23) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +[2026-09-14 11:38:06] step 1686/5000 loss 0.1627 (w 0.1796 mse 0.1900 t 988 new 0.12) lr 1.00e-05 gnorm 0.156 3.15s mem 81.1GB +[2026-09-14 11:38:09] step 1687/5000 loss 0.2750 (w 0.2836 mse 0.2691 t 902 new 0.18) lr 1.00e-05 gnorm 0.228 3.13s mem 81.1GB +[2026-09-14 11:38:12] step 1688/5000 loss 0.2083 (w 0.2374 mse 0.2192 t 966 new 0.10) lr 1.00e-05 gnorm 0.156 3.14s mem 81.1GB +[2026-09-14 11:38:15] step 1689/5000 loss 0.4114 (w 0.1707 mse 0.1686 t 793 new 0.19) lr 1.00e-05 gnorm 0.165 3.08s mem 81.1GB +[2026-09-14 11:38:18] step 1690/5000 loss 0.2913 (w 0.2470 mse 0.2450 t 523 new 0.19) lr 1.00e-05 gnorm 0.107 3.15s mem 81.1GB +[2026-09-14 11:38:21] step 1691/5000 loss 0.3656 (w 0.2774 mse 0.2670 t 872 new 0.19) lr 1.00e-05 gnorm 0.201 2.86s mem 81.1GB +[2026-09-14 11:38:24] step 1692/5000 loss 0.2856 (w 0.2455 mse 0.2210 t 915 new 0.28) lr 1.00e-05 gnorm 0.132 3.15s mem 81.1GB +[2026-09-14 11:38:27] step 1693/5000 loss 0.2173 (w 0.2221 mse 0.2256 t 985 new 0.16) lr 1.00e-05 gnorm 0.221 3.12s mem 81.1GB +[2026-09-14 11:38:31] step 1694/5000 loss 0.3081 (w 0.2688 mse 0.2533 t 542 new 0.26) lr 1.00e-05 gnorm 0.162 3.18s mem 81.1GB +[2026-09-14 11:38:34] step 1695/5000 loss 0.2814 (w 0.2662 mse 0.2470 t 981 new 0.16) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +[2026-09-14 11:38:37] step 1696/5000 loss 0.1791 (w 0.1649 mse 0.1735 t 795 new 0.22) lr 1.00e-05 gnorm 0.202 3.07s mem 81.1GB +[2026-09-14 11:38:40] step 1697/5000 loss 0.3850 (w 0.1543 mse 0.1614 t 404 new 0.21) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +[2026-09-14 11:38:43] step 1698/5000 loss 0.3690 (w 0.2224 mse 0.2180 t 915 new 0.16) lr 1.00e-05 gnorm 0.154 3.32s mem 81.1GB +[2026-09-14 11:38:46] step 1699/5000 loss 0.2268 (w 0.1640 mse 0.1636 t 959 new 0.27) lr 1.00e-05 gnorm 0.115 3.13s mem 81.1GB +[2026-09-14 11:38:49] step 1700/5000 loss 0.2757 (w 0.2744 mse 0.2749 t 981 new 0.21) lr 1.00e-05 gnorm 0.144 3.20s mem 81.1GB +[2026-09-14 11:38:52] step 1701/5000 loss 0.2554 (w 0.2809 mse 0.2642 t 979 new 0.23) lr 1.00e-05 gnorm 0.255 2.85s mem 81.1GB +[2026-09-14 11:38:55] step 1702/5000 loss 0.2682 (w 0.2819 mse 0.2774 t 453 new 0.17) lr 1.00e-05 gnorm 0.245 3.09s mem 81.1GB +[2026-09-14 11:38:58] step 1703/5000 loss 0.3014 (w 0.2286 mse 0.2245 t 749 new 0.24) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +[2026-09-14 11:39:02] step 1704/5000 loss 0.1811 (w 0.1643 mse 0.1579 t 888 new 0.10) lr 1.00e-05 gnorm 0.124 3.42s mem 81.1GB +[2026-09-14 11:39:05] step 1705/5000 loss 0.1147 (w 0.3744 mse 0.3797 t 988 new 0.18) lr 1.00e-05 gnorm 1.049 3.03s mem 81.1GB +[2026-09-14 11:39:09] step 1706/5000 loss 0.2022 (w 0.1311 mse 0.1157 t 684 new 0.13) lr 1.00e-05 gnorm 0.141 4.60s mem 81.1GB +[2026-09-14 11:39:12] step 1707/5000 loss 0.2796 (w 0.1997 mse 0.1861 t 980 new 0.21) lr 1.00e-05 gnorm 0.163 3.05s mem 81.1GB +[2026-09-14 11:39:15] step 1708/5000 loss 0.3854 (w 0.2571 mse 0.2470 t 523 new 0.18) lr 1.00e-05 gnorm 0.122 2.85s mem 81.1GB +[2026-09-14 11:39:18] step 1709/5000 loss 0.2587 (w 0.2374 mse 0.2259 t 954 new 0.25) lr 1.00e-05 gnorm 0.157 3.16s mem 81.1GB +[2026-09-14 11:39:21] step 1710/5000 loss 0.2331 (w 0.2594 mse 0.2460 t 933 new 0.21) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +[2026-09-14 11:39:24] step 1711/5000 loss 0.2058 (w 0.2895 mse 0.2747 t 594 new 0.22) lr 1.00e-05 gnorm 0.116 3.05s mem 81.1GB +[2026-09-14 11:39:28] step 1712/5000 loss 0.1546 (w 0.2921 mse 0.2767 t 948 new 0.28) lr 1.00e-05 gnorm 0.165 3.70s mem 81.1GB +[2026-09-14 11:39:31] step 1713/5000 loss 0.2846 (w 0.2170 mse 0.2132 t 626 new 0.17) lr 1.00e-05 gnorm 0.133 3.08s mem 81.1GB +[2026-09-14 11:39:34] step 1714/5000 loss 0.1466 (w 0.0969 mse 0.1006 t 858 new 0.09) lr 1.00e-05 gnorm 0.124 2.86s mem 81.1GB +[2026-09-14 11:39:37] step 1715/5000 loss 0.2134 (w 0.2659 mse 0.2695 t 895 new 0.21) lr 1.00e-05 gnorm 0.181 3.12s mem 81.1GB +[2026-09-14 11:39:40] step 1716/5000 loss 0.1695 (w 0.5222 mse 0.5278 t 998 new 0.19) lr 1.00e-05 gnorm 0.212 3.07s mem 81.1GB +[2026-09-14 11:39:44] step 1717/5000 loss 0.3261 (w 0.2341 mse 0.2302 t 930 new 0.22) lr 1.00e-05 gnorm 0.219 3.32s mem 81.1GB +[2026-09-14 11:39:47] step 1718/5000 loss 0.2263 (w 0.3310 mse 0.3164 t 983 new 0.13) lr 1.00e-05 gnorm 0.206 3.28s mem 81.1GB +[2026-09-14 11:39:50] step 1719/5000 loss 0.2222 (w 0.2371 mse 0.2414 t 981 new 0.08) lr 1.00e-05 gnorm 0.120 3.11s mem 81.1GB +[2026-09-14 11:39:53] step 1720/5000 loss 0.3403 (w 0.2826 mse 0.2833 t 969 new 0.23) lr 1.00e-05 gnorm 0.147 2.85s mem 81.1GB +[2026-09-14 11:39:56] step 1721/5000 loss 0.2098 (w 0.2689 mse 0.2635 t 999 new 0.19) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +[2026-09-14 11:39:59] step 1722/5000 loss 0.2747 (w 0.1975 mse 0.1957 t 897 new 0.20) lr 1.00e-05 gnorm 0.245 3.10s mem 81.1GB +[2026-09-14 11:40:02] step 1723/5000 loss 0.1714 (w 0.1349 mse 0.1315 t 870 new 0.24) lr 1.00e-05 gnorm 0.157 3.30s mem 81.1GB +[2026-09-14 11:40:06] step 1724/5000 loss 0.2387 (w 0.2758 mse 0.2573 t 726 new 0.24) lr 1.00e-05 gnorm 0.146 3.31s mem 81.1GB +[2026-09-14 11:40:09] step 1725/5000 loss 0.2228 (w 0.2714 mse 0.2516 t 864 new 0.23) lr 1.00e-05 gnorm 0.453 3.10s mem 81.1GB +[2026-09-14 11:40:12] step 1726/5000 loss 0.4276 (w 0.3063 mse 0.2990 t 523 new 0.21) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +[2026-09-14 11:40:15] step 1727/5000 loss 0.2426 (w 0.2030 mse 0.2111 t 881 new 0.28) lr 1.00e-05 gnorm 0.141 3.45s mem 81.1GB +[2026-09-14 11:40:18] step 1728/5000 loss 0.2044 (w 0.2222 mse 0.2136 t 861 new 0.25) lr 1.00e-05 gnorm 0.193 2.85s mem 81.1GB +[2026-09-14 11:40:21] step 1729/5000 loss 0.2997 (w 0.3080 mse 0.3135 t 998 new 0.25) lr 1.00e-05 gnorm 0.180 3.24s mem 81.1GB +[2026-09-14 11:40:24] step 1730/5000 loss 0.1558 (w 0.1866 mse 0.1769 t 835 new 0.10) lr 1.00e-05 gnorm 0.126 3.05s mem 81.1GB +[2026-09-14 11:40:27] step 1731/5000 loss 0.1798 (w 0.3634 mse 0.3406 t 868 new 0.25) lr 1.00e-05 gnorm 0.146 3.11s mem 81.1GB +[2026-09-14 11:40:30] step 1732/5000 loss 0.1716 (w 0.1389 mse 0.1418 t 864 new 0.22) lr 1.00e-05 gnorm 0.106 2.85s mem 81.1GB +[2026-09-14 11:40:34] step 1733/5000 loss 0.2262 (w 0.1502 mse 0.1491 t 703 new 0.25) lr 1.00e-05 gnorm 0.123 3.42s mem 81.1GB +[2026-09-14 11:40:36] step 1734/5000 loss 0.3860 (w 0.1082 mse 0.1154 t 697 new 0.24) lr 1.00e-05 gnorm 0.152 2.85s mem 81.1GB +[2026-09-14 11:40:40] step 1735/5000 loss 0.2282 (w 0.2381 mse 0.2309 t 639 new 0.21) lr 1.00e-05 gnorm 0.134 3.54s mem 81.1GB +[2026-09-14 11:40:43] step 1736/5000 loss 0.4575 (w 0.2934 mse 0.2894 t 375 new 0.23) lr 1.00e-05 gnorm 0.211 3.08s mem 81.1GB +[2026-09-14 11:40:46] step 1737/5000 loss 0.2238 (w 0.3411 mse 0.3427 t 997 new 0.22) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +[2026-09-14 11:40:49] step 1738/5000 loss 0.3838 (w 0.2354 mse 0.2297 t 580 new 0.21) lr 1.00e-05 gnorm 0.168 2.85s mem 81.1GB +[2026-09-14 11:40:52] step 1739/5000 loss 0.4704 (w 0.2295 mse 0.2232 t 779 new 0.23) lr 1.00e-05 gnorm 0.187 3.39s mem 81.1GB +[2026-09-14 11:40:55] step 1740/5000 loss 0.1860 (w 0.2953 mse 0.2985 t 964 new 0.24) lr 1.00e-05 gnorm 0.447 2.85s mem 81.1GB +[2026-09-14 11:40:59] step 1741/5000 loss 0.3221 (w 0.2928 mse 0.2946 t 982 new 0.22) lr 1.00e-05 gnorm 0.135 3.69s mem 81.1GB +[2026-09-14 11:41:03] step 1742/5000 loss 0.1749 (w 0.3095 mse 0.3039 t 988 new 0.14) lr 1.00e-05 gnorm 0.125 3.37s mem 81.1GB +[2026-09-14 11:41:05] step 1743/5000 loss 0.4909 (w 0.3354 mse 0.3708 t 233 new 0.23) lr 1.00e-05 gnorm 0.145 2.86s mem 81.1GB +[2026-09-14 11:41:08] step 1744/5000 loss 0.2686 (w 0.2711 mse 0.2539 t 823 new 0.24) lr 1.00e-05 gnorm 0.170 3.07s mem 81.1GB +[2026-09-14 11:41:12] step 1745/5000 loss 0.1209 (w 0.1784 mse 0.1840 t 697 new 0.15) lr 1.00e-05 gnorm 0.108 3.08s mem 81.1GB +[2026-09-14 11:41:15] step 1746/5000 loss 0.1759 (w 0.1525 mse 0.1502 t 937 new 0.16) lr 1.00e-05 gnorm 0.139 3.07s mem 81.1GB +[2026-09-14 11:41:18] step 1747/5000 loss 0.4536 (w 0.2986 mse 0.2939 t 473 new 0.21) lr 1.00e-05 gnorm 0.185 3.35s mem 81.1GB +[2026-09-14 11:41:21] step 1748/5000 loss 0.2263 (w 0.2417 mse 0.2409 t 980 new 0.22) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +[2026-09-14 11:41:24] step 1749/5000 loss 0.2993 (w 0.2577 mse 0.2415 t 944 new 0.23) lr 1.00e-05 gnorm 0.174 2.86s mem 81.1GB +[2026-09-14 11:41:27] step 1750/5000 loss 0.2790 (w 0.3272 mse 0.3141 t 960 new 0.22) lr 1.00e-05 gnorm 0.152 3.11s mem 81.1GB +[2026-09-14 11:41:30] step 1751/5000 loss 0.2591 (w 0.2743 mse 0.2584 t 694 new 0.23) lr 1.00e-05 gnorm 0.151 3.10s mem 81.1GB +[2026-09-14 11:41:33] step 1752/5000 loss 0.1396 (w 0.1389 mse 0.1343 t 808 new 0.20) lr 1.00e-05 gnorm 0.160 3.10s mem 81.1GB +[2026-09-14 11:41:37] step 1753/5000 loss 0.0957 (w 0.2754 mse 0.2642 t 979 new 0.19) lr 1.00e-05 gnorm 0.518 3.31s mem 81.1GB +[2026-09-14 11:41:40] step 1754/5000 loss 0.0776 (w 0.4533 mse 0.4403 t 993 new 0.27) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +[2026-09-14 11:41:42] step 1755/5000 loss 0.2765 (w 0.1686 mse 0.1705 t 934 new 0.24) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +[2026-09-14 11:41:46] step 1756/5000 loss 0.3411 (w 0.1998 mse 0.1882 t 802 new 0.21) lr 1.00e-05 gnorm 0.158 3.12s mem 81.1GB +[2026-09-14 11:41:49] step 1757/5000 loss 0.1239 (w 0.3242 mse 0.3182 t 942 new 0.25) lr 1.00e-05 gnorm 0.118 3.08s mem 81.1GB +[2026-09-14 11:41:52] step 1758/5000 loss 0.1972 (w 0.3242 mse 0.3131 t 921 new 0.21) lr 1.00e-05 gnorm 0.234 3.46s mem 81.1GB +[2026-09-14 11:41:55] step 1759/5000 loss 0.1754 (w 0.4055 mse 0.3896 t 379 new 0.19) lr 1.00e-05 gnorm 0.178 3.12s mem 81.1GB +[2026-09-14 11:41:58] step 1760/5000 loss 0.2155 (w 0.2014 mse 0.1912 t 844 new 0.24) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +[2026-09-14 11:42:01] step 1761/5000 loss 0.1721 (w 0.1408 mse 0.1475 t 931 new 0.20) lr 1.00e-05 gnorm 0.131 2.85s mem 81.1GB +[2026-09-14 11:42:04] step 1762/5000 loss 0.1805 (w 0.2534 mse 0.2408 t 884 new 0.16) lr 1.00e-05 gnorm 0.167 3.12s mem 81.1GB +[2026-09-14 11:42:07] step 1763/5000 loss 0.2188 (w 0.2829 mse 0.2777 t 893 new 0.18) lr 1.00e-05 gnorm 0.148 3.13s mem 81.1GB +[2026-09-14 11:42:11] step 1764/5000 loss 0.1796 (w 0.2170 mse 0.2343 t 971 new 0.23) lr 1.00e-05 gnorm 0.154 3.40s mem 81.1GB +[2026-09-14 11:42:14] step 1765/5000 loss 0.1935 (w 0.3041 mse 0.2979 t 939 new 0.22) lr 1.00e-05 gnorm 0.202 3.38s mem 81.1GB +[2026-09-14 11:42:17] step 1766/5000 loss 0.2171 (w 0.2455 mse 0.2489 t 584 new 0.20) lr 1.00e-05 gnorm 0.201 2.83s mem 81.1GB +[2026-09-14 11:42:20] step 1767/5000 loss 0.3646 (w 0.3289 mse 0.3318 t 954 new 0.20) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +[2026-09-14 11:42:23] step 1768/5000 loss 0.2886 (w 0.3245 mse 0.3283 t 996 new 0.23) lr 1.00e-05 gnorm 0.211 3.10s mem 81.1GB +[2026-09-14 11:42:26] step 1769/5000 loss 0.2490 (w 0.3219 mse 0.3110 t 500 new 0.22) lr 1.00e-05 gnorm 0.122 3.05s mem 81.1GB +[2026-09-14 11:42:30] step 1770/5000 loss 0.2730 (w 0.2292 mse 0.2225 t 912 new 0.22) lr 1.00e-05 gnorm 0.111 3.41s mem 81.1GB +[2026-09-14 11:42:33] step 1771/5000 loss 0.1360 (w 0.2736 mse 0.2784 t 998 new 0.21) lr 1.00e-05 gnorm 0.132 3.26s mem 81.1GB +[2026-09-14 11:42:36] step 1772/5000 loss 0.2111 (w 1.0134 mse 1.0056 t 999 new 0.23) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +[2026-09-14 11:42:38] step 1773/5000 loss 0.4299 (w 0.1991 mse 0.1919 t 757 new 0.23) lr 1.00e-05 gnorm 0.168 2.85s mem 81.1GB +[2026-09-14 11:42:42] step 1774/5000 loss 0.2103 (w 0.2686 mse 0.2486 t 872 new 0.23) lr 1.00e-05 gnorm 0.195 3.10s mem 81.1GB +[2026-09-14 11:42:45] step 1775/5000 loss 0.2848 (w 0.2507 mse 0.2530 t 642 new 0.21) lr 1.00e-05 gnorm 0.166 3.29s mem 81.1GB +[2026-09-14 11:42:48] step 1776/5000 loss 0.1699 (w 0.3617 mse 0.3595 t 340 new 0.16) lr 1.00e-05 gnorm 0.221 3.21s mem 81.1GB +[2026-09-14 11:42:51] step 1777/5000 loss 0.2524 (w 0.2519 mse 0.2375 t 975 new 0.20) lr 1.00e-05 gnorm 0.114 3.31s mem 81.1GB +[2026-09-14 11:42:54] step 1778/5000 loss 0.2166 (w 0.3040 mse 0.2901 t 942 new 0.24) lr 1.00e-05 gnorm 0.165 2.86s mem 81.1GB +[2026-09-14 11:42:57] step 1779/5000 loss 0.1405 (w 0.2455 mse 0.2299 t 862 new 0.23) lr 1.00e-05 gnorm 0.154 3.13s mem 81.1GB +[2026-09-14 11:43:00] step 1780/5000 loss 0.2103 (w 0.2922 mse 0.2841 t 716 new 0.19) lr 1.00e-05 gnorm 1.592 3.05s mem 81.1GB +[2026-09-14 11:43:04] step 1781/5000 loss 0.2002 (w 0.2430 mse 0.2235 t 878 new 0.19) lr 1.00e-05 gnorm 0.162 3.08s mem 81.1GB +[2026-09-14 11:43:07] step 1782/5000 loss 0.2633 (w 0.2284 mse 0.2076 t 879 new 0.21) lr 1.00e-05 gnorm 0.164 3.50s mem 81.1GB +[2026-09-14 11:43:10] step 1783/5000 loss 0.1831 (w 0.3143 mse 0.2908 t 492 new 0.17) lr 1.00e-05 gnorm 0.239 3.04s mem 81.1GB +[2026-09-14 11:43:13] step 1784/5000 loss 0.2233 (w 0.2966 mse 0.2748 t 867 new 0.20) lr 1.00e-05 gnorm 0.191 2.85s mem 81.1GB +[2026-09-14 11:43:16] step 1785/5000 loss 0.2205 (w 0.2274 mse 0.2215 t 616 new 0.18) lr 1.00e-05 gnorm 0.173 3.12s mem 81.1GB +[2026-09-14 11:43:19] step 1786/5000 loss 0.3122 (w 0.2941 mse 0.2769 t 833 new 0.21) lr 1.00e-05 gnorm 0.196 3.08s mem 81.1GB +[2026-09-14 11:43:22] step 1787/5000 loss 0.2760 (w 0.1778 mse 0.1903 t 965 new 0.23) lr 1.00e-05 gnorm 0.124 3.35s mem 81.1GB +[2026-09-14 11:43:26] step 1788/5000 loss 0.2361 (w 0.3207 mse 0.2983 t 956 new 0.22) lr 1.00e-05 gnorm 0.210 3.20s mem 81.1GB +[2026-09-14 11:43:29] step 1789/5000 loss 0.1413 (w 0.1718 mse 0.1599 t 911 new 0.25) lr 1.00e-05 gnorm 0.889 3.10s mem 81.1GB +[2026-09-14 11:43:32] step 1790/5000 loss 0.1928 (w 0.2711 mse 0.2560 t 911 new 0.27) lr 1.00e-05 gnorm 0.154 2.86s mem 81.1GB +[2026-09-14 11:43:35] step 1791/5000 loss 0.1693 (w 0.1976 mse 0.1848 t 729 new 0.09) lr 1.00e-05 gnorm 0.155 3.05s mem 81.1GB +[2026-09-14 11:43:38] step 1792/5000 loss 0.2328 (w 0.2941 mse 0.2922 t 986 new 0.24) lr 1.00e-05 gnorm 0.198 3.08s mem 81.1GB +[2026-09-14 11:43:41] step 1793/5000 loss 0.1940 (w 0.1640 mse 0.1665 t 759 new 0.22) lr 1.00e-05 gnorm 0.175 3.31s mem 81.1GB +[2026-09-14 11:43:44] step 1794/5000 loss 0.2730 (w 0.1804 mse 0.1742 t 891 new 0.16) lr 1.00e-05 gnorm 0.225 3.39s mem 81.1GB +[2026-09-14 11:43:48] step 1795/5000 loss 0.2526 (w 0.2873 mse 0.2829 t 631 new 0.24) lr 1.00e-05 gnorm 0.189 3.15s mem 81.1GB +[2026-09-14 11:43:50] step 1796/5000 loss 0.3293 (w 0.1257 mse 0.1239 t 818 new 0.23) lr 1.00e-05 gnorm 0.179 2.84s mem 81.1GB +[2026-09-14 11:43:54] step 1797/5000 loss 0.2771 (w 0.1004 mse 0.1167 t 924 new 0.18) lr 1.00e-05 gnorm 0.175 3.06s mem 81.1GB +[2026-09-14 11:43:57] step 1798/5000 loss 0.2373 (w 0.2324 mse 0.2213 t 926 new 0.20) lr 1.00e-05 gnorm 0.164 3.08s mem 81.1GB +[2026-09-14 11:44:00] step 1799/5000 loss 0.2054 (w 0.2234 mse 0.2260 t 970 new 0.18) lr 1.00e-05 gnorm 0.124 3.44s mem 81.1GB +[2026-09-14 11:44:04] step 1800/5000 loss 0.2657 (w 0.3092 mse 0.2926 t 908 new 0.21) lr 1.00e-05 gnorm 0.109 3.65s mem 81.1GB +[2026-09-14 11:44:07] step 1801/5000 loss 0.1994 (w 0.1939 mse 0.1877 t 883 new 0.19) lr 1.00e-05 gnorm 0.182 3.14s mem 81.1GB +[2026-09-14 11:44:10] step 1802/5000 loss 0.1637 (w 0.1760 mse 0.1922 t 949 new 0.14) lr 1.00e-05 gnorm 0.295 2.85s mem 81.1GB +[2026-09-14 11:44:13] step 1803/5000 loss 0.2795 (w 0.1430 mse 0.1364 t 839 new 0.24) lr 1.00e-05 gnorm 0.122 3.11s mem 81.1GB +[2026-09-14 11:44:16] step 1804/5000 loss 0.3092 (w 0.1781 mse 0.1731 t 680 new 0.24) lr 1.00e-05 gnorm 0.161 3.08s mem 81.1GB +[2026-09-14 11:44:20] step 1805/5000 loss 0.3783 (w 0.2594 mse 0.2508 t 639 new 0.19) lr 1.00e-05 gnorm 0.143 3.58s mem 81.1GB +[2026-09-14 11:44:23] step 1806/5000 loss 0.2228 (w 0.1158 mse 0.1169 t 680 new 0.15) lr 1.00e-05 gnorm 0.129 3.30s mem 81.1GB +[2026-09-14 11:44:26] step 1807/5000 loss 0.2300 (w 0.1541 mse 0.1438 t 953 new 0.15) lr 1.00e-05 gnorm 0.100 3.06s mem 81.1GB +[2026-09-14 11:44:29] step 1808/5000 loss 0.1614 (w 0.2531 mse 0.2322 t 918 new 0.19) lr 1.00e-05 gnorm 0.192 2.85s mem 81.1GB +[2026-09-14 11:44:32] step 1809/5000 loss 0.1294 (w 0.1604 mse 0.1556 t 946 new 0.21) lr 1.00e-05 gnorm 0.164 3.04s mem 81.1GB +[2026-09-14 11:44:35] step 1810/5000 loss 0.3480 (w 0.1369 mse 0.1333 t 698 new 0.08) lr 1.00e-05 gnorm 0.200 3.08s mem 81.1GB +[2026-09-14 11:44:39] step 1811/5000 loss 0.2644 (w 0.1724 mse 0.1727 t 896 new 0.20) lr 1.00e-05 gnorm 0.182 3.51s mem 81.1GB +[2026-09-14 11:44:42] step 1812/5000 loss 0.0818 (w 0.1613 mse 0.1692 t 929 new 0.18) lr 1.00e-05 gnorm 0.121 3.15s mem 81.1GB +[2026-09-14 11:44:45] step 1813/5000 loss 0.1838 (w 0.2415 mse 0.2526 t 973 new 0.15) lr 1.00e-05 gnorm 0.203 3.10s mem 81.1GB +[2026-09-14 11:44:48] step 1814/5000 loss 0.2095 (w 0.5973 mse 0.5980 t 183 new 0.23) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-14 11:44:51] step 1815/5000 loss 0.0804 (w 0.2957 mse 0.2685 t 956 new 0.21) lr 1.00e-05 gnorm 0.167 3.10s mem 81.1GB +[2026-09-14 11:44:54] step 1816/5000 loss 0.1667 (w 0.2431 mse 0.2445 t 949 new 0.23) lr 1.00e-05 gnorm 0.170 3.08s mem 81.1GB +[2026-09-14 11:44:57] step 1817/5000 loss 0.0991 (w 0.2050 mse 0.2008 t 851 new 0.15) lr 1.00e-05 gnorm 0.121 3.49s mem 81.1GB +[2026-09-14 11:45:01] step 1818/5000 loss 0.2330 (w 0.2015 mse 0.2169 t 685 new 0.18) lr 1.00e-05 gnorm 0.198 3.58s mem 81.1GB +[2026-09-14 11:45:04] step 1819/5000 loss 0.1584 (w 0.2658 mse 0.2564 t 875 new 0.23) lr 1.00e-05 gnorm 0.148 2.85s mem 81.1GB +[2026-09-14 11:45:07] step 1820/5000 loss 0.1937 (w 0.1849 mse 0.1940 t 873 new 0.22) lr 1.00e-05 gnorm 0.126 3.16s mem 81.1GB +[2026-09-14 11:45:10] step 1821/5000 loss 0.3990 (w 0.2395 mse 0.2489 t 476 new 0.18) lr 1.00e-05 gnorm 0.224 2.85s mem 81.1GB +[2026-09-14 11:45:13] step 1822/5000 loss 0.2539 (w 0.2892 mse 0.2911 t 849 new 0.15) lr 1.00e-05 gnorm 0.117 3.12s mem 81.1GB +[2026-09-14 11:45:17] step 1823/5000 loss 0.3197 (w 0.1564 mse 0.1612 t 631 new 0.17) lr 1.00e-05 gnorm 0.181 3.54s mem 81.1GB +[2026-09-14 11:45:20] step 1824/5000 loss 0.2364 (w 0.3613 mse 0.3414 t 954 new 0.24) lr 1.00e-05 gnorm 0.195 3.07s mem 81.1GB +[2026-09-14 11:45:23] step 1825/5000 loss 0.2004 (w 0.2600 mse 0.2503 t 918 new 0.12) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +[2026-09-14 11:45:26] step 1826/5000 loss 0.2161 (w 0.2597 mse 0.2499 t 958 new 0.17) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +[2026-09-14 11:45:28] step 1827/5000 loss 0.2661 (w 0.2588 mse 0.2455 t 925 new 0.22) lr 1.00e-05 gnorm 0.145 2.83s mem 81.1GB +[2026-09-14 11:45:32] step 1828/5000 loss 0.3892 (w 0.1866 mse 0.1744 t 513 new 0.22) lr 1.00e-05 gnorm 0.200 3.11s mem 81.1GB +[2026-09-14 11:45:35] step 1829/5000 loss 0.1429 (w 0.3185 mse 0.3233 t 960 new 0.11) lr 1.00e-05 gnorm 0.136 3.49s mem 81.1GB +[2026-09-14 11:45:38] step 1830/5000 loss 0.2958 (w 0.2598 mse 0.2544 t 444 new 0.24) lr 1.00e-05 gnorm 0.176 3.14s mem 81.1GB +[2026-09-14 11:45:41] step 1831/5000 loss 0.2921 (w 0.2841 mse 0.2803 t 858 new 0.16) lr 1.00e-05 gnorm 0.596 2.86s mem 81.1GB +[2026-09-14 11:45:44] step 1832/5000 loss 0.1046 (w 0.2824 mse 0.2804 t 998 new 0.17) lr 1.00e-05 gnorm 0.358 3.14s mem 81.1GB +[2026-09-14 11:45:47] step 1833/5000 loss 0.2053 (w 0.3049 mse 0.3114 t 988 new 0.21) lr 1.00e-05 gnorm 0.204 2.84s mem 81.1GB +[2026-09-14 11:45:50] step 1834/5000 loss 0.1486 (w 0.2985 mse 0.2741 t 997 new 0.22) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +[2026-09-14 11:45:54] step 1835/5000 loss 0.1168 (w 0.2061 mse 0.1916 t 855 new 0.25) lr 1.00e-05 gnorm 0.150 3.55s mem 81.1GB +[2026-09-14 11:45:57] step 1836/5000 loss 0.3313 (w 0.7002 mse 0.6946 t 992 new 0.21) lr 1.00e-05 gnorm 0.156 3.16s mem 81.1GB +[2026-09-14 11:46:00] step 1837/5000 loss 0.2244 (w 0.2132 mse 0.2028 t 821 new 0.22) lr 1.00e-05 gnorm 0.157 2.85s mem 81.1GB +[2026-09-14 11:46:03] step 1838/5000 loss 0.2238 (w 0.1820 mse 0.1661 t 865 new 0.23) lr 1.00e-05 gnorm 0.133 3.07s mem 81.1GB +[2026-09-14 11:46:06] step 1839/5000 loss 0.2214 (w 0.3374 mse 0.3409 t 976 new 0.21) lr 1.00e-05 gnorm 0.187 2.83s mem 81.1GB +[2026-09-14 11:46:09] step 1840/5000 loss 0.1401 (w 0.1942 mse 0.2115 t 991 new 0.19) lr 1.00e-05 gnorm 0.150 3.42s mem 81.1GB +[2026-09-14 11:46:13] step 1841/5000 loss 0.1786 (w 0.1784 mse 0.1899 t 993 new 0.12) lr 1.00e-05 gnorm 0.126 3.59s mem 81.1GB +[2026-09-14 11:46:16] step 1842/5000 loss 0.3427 (w 0.2879 mse 0.2878 t 988 new 0.20) lr 1.00e-05 gnorm 0.313 3.06s mem 81.1GB +[2026-09-14 11:46:19] step 1843/5000 loss 0.2424 (w 0.3396 mse 0.3329 t 982 new 0.24) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +[2026-09-14 11:46:22] step 1844/5000 loss 0.1961 (w 0.3239 mse 0.3168 t 979 new 0.24) lr 1.00e-05 gnorm 0.209 3.05s mem 81.1GB +[2026-09-14 11:46:25] step 1845/5000 loss 0.0960 (w 0.2270 mse 0.2321 t 994 new 0.12) lr 1.00e-05 gnorm 0.193 3.07s mem 81.1GB +[2026-09-14 11:46:28] step 1846/5000 loss 0.1737 (w 0.3297 mse 0.3150 t 984 new 0.20) lr 1.00e-05 gnorm 0.157 3.03s mem 81.1GB +[2026-09-14 11:46:31] step 1847/5000 loss 0.2434 (w 0.2491 mse 0.2381 t 830 new 0.24) lr 1.00e-05 gnorm 0.158 3.24s mem 81.1GB +[2026-09-14 11:46:34] step 1848/5000 loss 0.3254 (w 0.3387 mse 0.3241 t 476 new 0.22) lr 1.00e-05 gnorm 0.167 3.10s mem 81.1GB +[2026-09-14 11:46:37] step 1849/5000 loss 0.1840 (w 0.1950 mse 0.1954 t 925 new 0.23) lr 1.00e-05 gnorm 0.185 2.84s mem 81.1GB +[2026-09-14 11:46:40] step 1850/5000 loss 0.2111 (w 0.2473 mse 0.2400 t 873 new 0.26) lr 1.00e-05 gnorm 0.177 3.06s mem 81.1GB +[2026-09-14 11:46:43] step 1851/5000 loss 0.1275 (w 0.2744 mse 0.2753 t 903 new 0.20) lr 1.00e-05 gnorm 0.132 3.07s mem 81.1GB +[2026-09-14 11:46:46] step 1852/5000 loss 0.3123 (w 0.3188 mse 0.3106 t 859 new 0.26) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +[2026-09-14 11:46:50] step 1853/5000 loss 0.0932 (w 0.1380 mse 0.1378 t 766 new 0.21) lr 1.00e-05 gnorm 0.209 3.45s mem 81.1GB +[2026-09-14 11:46:52] step 1854/5000 loss 0.2661 (w 0.2813 mse 0.2651 t 859 new 0.17) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +[2026-09-14 11:46:55] step 1855/5000 loss 0.1731 (w 0.2972 mse 0.2918 t 609 new 0.24) lr 1.00e-05 gnorm 0.177 2.83s mem 81.1GB +[2026-09-14 11:46:58] step 1856/5000 loss 0.1975 (w 0.1549 mse 0.1520 t 894 new 0.10) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +[2026-09-14 11:47:01] step 1857/5000 loss 0.2858 (w 0.0980 mse 0.1058 t 706 new 0.15) lr 1.00e-05 gnorm 0.167 3.11s mem 81.1GB +[2026-09-14 11:47:05] step 1858/5000 loss 0.2474 (w 0.3300 mse 0.3134 t 908 new 0.21) lr 1.00e-05 gnorm 0.185 3.30s mem 81.1GB +[2026-09-14 11:47:08] step 1859/5000 loss 0.1241 (w 0.3773 mse 0.3551 t 991 new 0.25) lr 1.00e-05 gnorm 0.199 3.32s mem 81.1GB +[2026-09-14 11:47:11] step 1860/5000 loss 0.1999 (w 0.2122 mse 0.2042 t 881 new 0.23) lr 1.00e-05 gnorm 0.139 2.83s mem 81.1GB +[2026-09-14 11:47:14] step 1861/5000 loss 0.2338 (w 0.2272 mse 0.2151 t 862 new 0.21) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-14 11:47:17] step 1862/5000 loss 0.2929 (w 0.1859 mse 0.1841 t 778 new 0.08) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +[2026-09-14 11:47:20] step 1863/5000 loss 0.0952 (w 0.1915 mse 0.1784 t 838 new 0.10) lr 1.00e-05 gnorm 0.117 3.35s mem 81.1GB +[2026-09-14 11:47:24] step 1864/5000 loss 0.2104 (w 0.2411 mse 0.2648 t 428 new 0.19) lr 1.00e-05 gnorm 0.154 3.32s mem 81.1GB +[2026-09-14 11:47:27] step 1865/5000 loss 0.3517 (w 0.1606 mse 0.1573 t 794 new 0.21) lr 1.00e-05 gnorm 0.194 3.43s mem 81.1GB +[2026-09-14 11:47:30] step 1866/5000 loss 0.2119 (w 0.2261 mse 0.2132 t 967 new 0.22) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +[2026-09-14 11:47:33] step 1867/5000 loss 0.2648 (w 0.2783 mse 0.2751 t 444 new 0.18) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +[2026-09-14 11:47:36] step 1868/5000 loss 0.1332 (w 0.3144 mse 0.3000 t 997 new 0.23) lr 1.00e-05 gnorm 0.131 3.09s mem 81.1GB +[2026-09-14 11:47:39] step 1869/5000 loss 0.4021 (w 0.4143 mse 0.4163 t 375 new 0.28) lr 1.00e-05 gnorm 0.160 3.08s mem 81.1GB +[2026-09-14 11:47:42] step 1870/5000 loss 0.1804 (w 0.2882 mse 0.2755 t 917 new 0.25) lr 1.00e-05 gnorm 0.141 3.29s mem 81.1GB +[2026-09-14 11:47:46] step 1871/5000 loss 0.2974 (w 0.3045 mse 0.2870 t 404 new 0.21) lr 1.00e-05 gnorm 0.144 3.36s mem 81.1GB +[2026-09-14 11:47:48] step 1872/5000 loss 0.1704 (w 0.2950 mse 0.2747 t 889 new 0.15) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-14 11:47:51] step 1873/5000 loss 0.2077 (w 0.2144 mse 0.2173 t 999 new 0.20) lr 1.00e-05 gnorm 0.168 2.85s mem 81.1GB +[2026-09-14 11:47:54] step 1874/5000 loss 0.1812 (w 0.2434 mse 0.2306 t 937 new 0.27) lr 1.00e-05 gnorm 0.133 3.10s mem 81.1GB +[2026-09-14 11:47:58] step 1875/5000 loss 0.2744 (w 0.2430 mse 0.2414 t 624 new 0.16) lr 1.00e-05 gnorm 0.216 3.28s mem 81.1GB +[2026-09-14 11:48:01] step 1876/5000 loss 0.1522 (w 0.3516 mse 0.3354 t 960 new 0.22) lr 1.00e-05 gnorm 0.220 3.43s mem 81.1GB +[2026-09-14 11:48:04] step 1877/5000 loss 0.1890 (w 0.2028 mse 0.1935 t 949 new 0.08) lr 1.00e-05 gnorm 0.151 3.09s mem 81.1GB +[2026-09-14 11:48:07] step 1878/5000 loss 0.1820 (w 0.5196 mse 0.5173 t 978 new 0.19) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +[2026-09-14 11:48:10] step 1879/5000 loss 0.1715 (w 0.1729 mse 0.1787 t 819 new 0.11) lr 1.00e-05 gnorm 0.169 2.84s mem 81.1GB +[2026-09-14 11:48:13] step 1880/5000 loss 0.2158 (w 0.4005 mse 0.3784 t 989 new 0.24) lr 1.00e-05 gnorm 0.176 3.13s mem 81.1GB +[2026-09-14 11:48:17] step 1881/5000 loss 0.1402 (w 0.1938 mse 0.1960 t 947 new 0.24) lr 1.00e-05 gnorm 0.169 3.41s mem 81.1GB +[2026-09-14 11:48:20] step 1882/5000 loss 0.2666 (w 0.3062 mse 0.3024 t 999 new 0.21) lr 1.00e-05 gnorm 0.141 3.40s mem 81.1GB +[2026-09-14 11:48:23] step 1883/5000 loss 0.3896 (w 0.2277 mse 0.2178 t 710 new 0.21) lr 1.00e-05 gnorm 0.176 3.09s mem 81.1GB +[2026-09-14 11:48:26] step 1884/5000 loss 0.1890 (w 0.1071 mse 0.1066 t 918 new 0.20) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +[2026-09-14 11:48:29] step 1885/5000 loss 0.1929 (w 0.2718 mse 0.2633 t 663 new 0.26) lr 1.00e-05 gnorm 0.248 2.84s mem 81.1GB +[2026-09-14 11:48:32] step 1886/5000 loss 0.3531 (w 0.2429 mse 0.2272 t 977 new 0.21) lr 1.00e-05 gnorm 16.421 3.38s mem 81.1GB +[2026-09-14 11:48:35] step 1887/5000 loss 0.2965 (w 0.2243 mse 0.2619 t 993 new 0.19) lr 1.00e-05 gnorm 0.248 3.10s mem 81.1GB +[2026-09-14 11:48:39] step 1888/5000 loss 0.1909 (w 0.2464 mse 0.2514 t 922 new 0.13) lr 1.00e-05 gnorm 0.352 3.43s mem 81.1GB +[2026-09-14 11:48:42] step 1889/5000 loss 0.1642 (w 0.2117 mse 0.1986 t 987 new 0.25) lr 1.00e-05 gnorm 0.240 3.13s mem 81.1GB +[2026-09-14 11:48:45] step 1890/5000 loss 0.3139 (w 0.2753 mse 0.2824 t 932 new 0.24) lr 1.00e-05 gnorm 0.204 2.83s mem 81.1GB +[2026-09-14 11:48:48] step 1891/5000 loss 0.2255 (w 0.6670 mse 0.6558 t 995 new 0.17) lr 1.00e-05 gnorm 0.195 2.84s mem 81.1GB +[2026-09-14 11:48:51] step 1892/5000 loss 0.2661 (w 0.1618 mse 0.1755 t 804 new 0.21) lr 1.00e-05 gnorm 0.155 3.14s mem 81.1GB +[2026-09-14 11:48:54] step 1893/5000 loss 0.2980 (w 0.2783 mse 0.2888 t 929 new 0.21) lr 1.00e-05 gnorm 0.167 3.04s mem 81.1GB +[2026-09-14 11:48:57] step 1894/5000 loss 0.3047 (w 0.1780 mse 0.1769 t 841 new 0.19) lr 1.00e-05 gnorm 0.492 3.35s mem 81.1GB +[2026-09-14 11:49:00] step 1895/5000 loss 0.3358 (w 0.2143 mse 0.2116 t 891 new 0.19) lr 1.00e-05 gnorm 0.126 2.83s mem 81.1GB +[2026-09-14 11:49:03] step 1896/5000 loss 0.2841 (w 0.1524 mse 0.1426 t 967 new 0.19) lr 1.00e-05 gnorm 0.145 2.84s mem 81.1GB +[2026-09-14 11:49:06] step 1897/5000 loss 0.2489 (w 0.2021 mse 0.1974 t 679 new 0.26) lr 1.00e-05 gnorm 0.200 3.12s mem 81.1GB +[2026-09-14 11:49:09] step 1898/5000 loss 0.2486 (w 0.1377 mse 0.1313 t 713 new 0.17) lr 1.00e-05 gnorm 0.132 3.06s mem 81.1GB +[2026-09-14 11:49:12] step 1899/5000 loss 0.2427 (w 0.2099 mse 0.1956 t 875 new 0.16) lr 1.00e-05 gnorm 0.233 3.28s mem 81.1GB +[2026-09-14 11:49:16] step 1900/5000 loss 0.2669 (w 0.1358 mse 0.1573 t 926 new 0.19) lr 1.00e-05 gnorm 0.212 3.40s mem 81.1GB +[2026-09-14 11:49:19] step 1901/5000 loss 0.2034 (w 0.1525 mse 0.1521 t 935 new 0.27) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +[2026-09-14 11:49:21] step 1902/5000 loss 0.3227 (w 0.1971 mse 0.1924 t 839 new 0.17) lr 1.00e-05 gnorm 0.168 2.83s mem 81.1GB +[2026-09-14 11:49:24] step 1903/5000 loss 0.1128 (w 0.2705 mse 0.2513 t 934 new 0.13) lr 1.00e-05 gnorm 0.121 3.03s mem 81.1GB +[2026-09-14 11:49:28] step 1904/5000 loss 0.1264 (w 0.3373 mse 0.3202 t 979 new 0.23) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-14 11:49:31] step 1905/5000 loss 0.2413 (w 0.3989 mse 0.3800 t 274 new 0.18) lr 1.00e-05 gnorm 0.151 3.36s mem 81.1GB +[2026-09-14 11:49:34] step 1906/5000 loss 0.2360 (w 0.4562 mse 0.4433 t 379 new 0.26) lr 1.00e-05 gnorm 0.143 3.32s mem 81.1GB +[2026-09-14 11:49:37] step 1907/5000 loss 0.1968 (w 0.1523 mse 0.1632 t 977 new 0.12) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +[2026-09-14 11:49:40] step 1908/5000 loss 0.1402 (w 0.1925 mse 0.1999 t 930 new 0.16) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-14 11:49:43] step 1909/5000 loss 0.2601 (w 0.2331 mse 0.2259 t 870 new 0.22) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +[2026-09-14 11:49:46] step 1910/5000 loss 0.1635 (w 0.2938 mse 0.2683 t 906 new 0.16) lr 1.00e-05 gnorm 0.680 3.11s mem 81.1GB +[2026-09-14 11:49:50] step 1911/5000 loss 0.1951 (w 0.1538 mse 0.1570 t 761 new 0.22) lr 1.00e-05 gnorm 0.179 3.37s mem 81.1GB +[2026-09-14 11:49:53] step 1912/5000 loss 0.2596 (w 0.1893 mse 0.1700 t 838 new 0.21) lr 1.00e-05 gnorm 0.169 3.27s mem 81.1GB +[2026-09-14 11:49:56] step 1913/5000 loss 0.2513 (w 0.2602 mse 0.2564 t 847 new 0.16) lr 1.00e-05 gnorm 0.227 2.82s mem 81.1GB +[2026-09-14 11:49:59] step 1914/5000 loss 0.2090 (w 0.2058 mse 0.2008 t 889 new 0.22) lr 1.00e-05 gnorm 0.188 2.83s mem 81.1GB +[2026-09-14 11:50:02] step 1915/5000 loss 0.2241 (w 0.1905 mse 0.1922 t 847 new 0.18) lr 1.00e-05 gnorm 0.195 3.31s mem 81.1GB +[2026-09-14 11:50:05] step 1916/5000 loss 0.3410 (w 0.4413 mse 0.4428 t 344 new 0.21) lr 1.00e-05 gnorm 0.217 3.36s mem 81.1GB +[2026-09-14 11:50:09] step 1917/5000 loss 0.1012 (w 0.1338 mse 0.1371 t 859 new 0.14) lr 1.00e-05 gnorm 0.175 3.48s mem 81.1GB +[2026-09-14 11:50:12] step 1918/5000 loss 0.2996 (w 0.2382 mse 0.2365 t 948 new 0.18) lr 1.00e-05 gnorm 0.194 3.34s mem 81.1GB +[2026-09-14 11:50:15] step 1919/5000 loss 0.1690 (w 1.0060 mse 1.0908 t 994 new 0.18) lr 1.00e-05 gnorm 0.612 2.84s mem 81.1GB +[2026-09-14 11:50:18] step 1920/5000 loss 0.3933 (w 0.3924 mse 0.3903 t 437 new 0.14) lr 1.00e-05 gnorm 0.173 2.84s mem 81.1GB +[2026-09-14 11:50:21] step 1921/5000 loss 0.1344 (w 0.3917 mse 0.3726 t 962 new 0.13) lr 1.00e-05 gnorm 0.129 3.29s mem 81.1GB +[2026-09-14 11:50:24] step 1922/5000 loss 0.1196 (w 0.3124 mse 0.3084 t 982 new 0.16) lr 1.00e-05 gnorm 0.198 3.30s mem 81.1GB +[2026-09-14 11:50:28] step 1923/5000 loss 0.1562 (w 0.2520 mse 0.2446 t 929 new 0.19) lr 1.00e-05 gnorm 0.231 3.41s mem 81.1GB +[2026-09-14 11:50:31] step 1924/5000 loss 0.3110 (w 0.2561 mse 0.2459 t 965 new 0.15) lr 1.00e-05 gnorm 0.174 3.12s mem 81.1GB +[2026-09-14 11:50:34] step 1925/5000 loss 0.3131 (w 0.2052 mse 0.2090 t 549 new 0.22) lr 1.00e-05 gnorm 0.123 2.83s mem 81.1GB +[2026-09-14 11:50:37] step 1926/5000 loss 0.3527 (w 0.2042 mse 0.1984 t 945 new 0.14) lr 1.00e-05 gnorm 0.298 2.83s mem 81.1GB +[2026-09-14 11:50:40] step 1927/5000 loss 0.3110 (w 0.2982 mse 0.3066 t 315 new 0.24) lr 1.00e-05 gnorm 0.185 3.51s mem 81.1GB +[2026-09-14 11:50:43] step 1928/5000 loss 0.1788 (w 0.2424 mse 0.2240 t 839 new 0.23) lr 1.00e-05 gnorm 0.215 3.06s mem 81.1GB +[2026-09-14 11:50:47] step 1929/5000 loss 0.1952 (w 0.1374 mse 0.1423 t 944 new 0.10) lr 1.00e-05 gnorm 0.134 3.36s mem 81.1GB +[2026-09-14 11:50:50] step 1930/5000 loss 0.1493 (w 0.2909 mse 0.2862 t 916 new 0.23) lr 1.00e-05 gnorm 0.134 3.07s mem 81.1GB +[2026-09-14 11:50:53] step 1931/5000 loss 0.3123 (w 0.1699 mse 0.1599 t 915 new 0.19) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +[2026-09-14 11:50:56] step 1932/5000 loss 0.2229 (w 0.2115 mse 0.2085 t 939 new 0.27) lr 1.00e-05 gnorm 0.221 2.84s mem 81.1GB +[2026-09-14 11:50:59] step 1933/5000 loss 0.1116 (w 0.2405 mse 0.2289 t 908 new 0.21) lr 1.00e-05 gnorm 0.142 3.36s mem 81.1GB +[2026-09-14 11:51:02] step 1934/5000 loss 0.2576 (w 0.6528 mse 0.6728 t 107 new 0.17) lr 1.00e-05 gnorm 0.154 3.09s mem 81.1GB +[2026-09-14 11:51:05] step 1935/5000 loss 0.1931 (w 0.3010 mse 0.2893 t 982 new 0.22) lr 1.00e-05 gnorm 0.130 3.32s mem 81.1GB +[2026-09-14 11:51:09] step 1936/5000 loss 0.4065 (w 0.2566 mse 0.2433 t 909 new 0.19) lr 1.00e-05 gnorm 0.159 3.13s mem 81.1GB +[2026-09-14 11:51:11] step 1937/5000 loss 0.0937 (w 0.3052 mse 0.2990 t 926 new 0.23) lr 1.00e-05 gnorm 0.157 2.82s mem 81.1GB +[2026-09-14 11:51:15] step 1938/5000 loss 0.0807 (w 0.2945 mse 0.2815 t 998 new 0.24) lr 1.00e-05 gnorm 0.684 3.09s mem 81.1GB +[2026-09-14 11:51:18] step 1939/5000 loss 0.2725 (w 0.2408 mse 0.2283 t 689 new 0.18) lr 1.00e-05 gnorm 0.168 3.39s mem 81.1GB +[2026-09-14 11:51:21] step 1940/5000 loss 0.3219 (w 0.2842 mse 0.2681 t 873 new 0.25) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +[2026-09-14 11:51:24] step 1941/5000 loss 0.2451 (w 0.3469 mse 0.3297 t 933 new 0.22) lr 1.00e-05 gnorm 0.171 3.35s mem 81.1GB +[2026-09-14 11:51:27] step 1942/5000 loss 0.2203 (w 0.2639 mse 0.2538 t 794 new 0.25) lr 1.00e-05 gnorm 0.156 2.82s mem 81.1GB +[2026-09-14 11:51:30] step 1943/5000 loss 0.2784 (w 0.1715 mse 0.1629 t 913 new 0.12) lr 1.00e-05 gnorm 0.227 2.83s mem 81.1GB +[2026-09-14 11:51:33] step 1944/5000 loss 0.1798 (w 0.1913 mse 0.1918 t 956 new 0.11) lr 1.00e-05 gnorm 0.158 3.13s mem 81.1GB +[2026-09-14 11:51:36] step 1945/5000 loss 0.2920 (w 0.1537 mse 0.1460 t 660 new 0.22) lr 1.00e-05 gnorm 0.247 3.08s mem 81.1GB +[2026-09-14 11:51:40] step 1946/5000 loss 0.2375 (w 0.1196 mse 0.1288 t 810 new 0.21) lr 1.00e-05 gnorm 0.144 3.29s mem 81.1GB +[2026-09-14 11:51:43] step 1947/5000 loss 0.3069 (w 0.1702 mse 0.1670 t 950 new 0.10) lr 1.00e-05 gnorm 0.146 3.29s mem 81.1GB +[2026-09-14 11:51:46] step 1948/5000 loss 0.1309 (w 0.4081 mse 0.3977 t 990 new 0.12) lr 1.00e-05 gnorm 0.482 2.85s mem 81.1GB +[2026-09-14 11:51:49] step 1949/5000 loss 0.2492 (w 0.2779 mse 0.2693 t 933 new 0.26) lr 1.00e-05 gnorm 0.158 2.85s mem 81.1GB +[2026-09-14 11:51:52] step 1950/5000 loss 0.2365 (w 0.3381 mse 0.3212 t 437 new 0.19) lr 1.00e-05 gnorm 0.304 3.61s mem 81.1GB +[2026-09-14 11:51:55] step 1951/5000 loss 0.1077 (w 0.1869 mse 0.1869 t 968 new 0.18) lr 1.00e-05 gnorm 0.192 3.12s mem 81.1GB +[2026-09-14 11:51:59] step 1952/5000 loss 0.2110 (w 0.1404 mse 0.1415 t 916 new 0.24) lr 1.00e-05 gnorm 0.149 3.43s mem 81.1GB +[2026-09-14 11:52:02] step 1953/5000 loss 0.2054 (w 0.2085 mse 0.2018 t 896 new 0.16) lr 1.00e-05 gnorm 0.189 3.36s mem 81.1GB +[2026-09-14 11:52:05] step 1954/5000 loss 0.2625 (w 0.1152 mse 0.1283 t 754 new 0.20) lr 1.00e-05 gnorm 0.159 2.83s mem 81.1GB +[2026-09-14 11:52:08] step 1955/5000 loss 0.2570 (w 0.4393 mse 0.4273 t 991 new 0.28) lr 1.00e-05 gnorm 0.179 2.85s mem 81.1GB +[2026-09-14 11:52:11] step 1956/5000 loss 0.2177 (w 0.2139 mse 0.2193 t 941 new 0.19) lr 1.00e-05 gnorm 0.149 3.44s mem 81.1GB +[2026-09-14 11:52:14] step 1957/5000 loss 0.5391 (w 0.2479 mse 0.2388 t 717 new 0.22) lr 1.00e-05 gnorm 0.172 2.83s mem 81.1GB +[2026-09-14 11:52:17] step 1958/5000 loss 0.1668 (w 0.2784 mse 0.2668 t 783 new 0.26) lr 1.00e-05 gnorm 0.158 3.31s mem 81.1GB +[2026-09-14 11:52:20] step 1959/5000 loss 0.2489 (w 0.2690 mse 0.2782 t 518 new 0.11) lr 1.00e-05 gnorm 0.113 3.11s mem 81.1GB +[2026-09-14 11:52:23] step 1960/5000 loss 0.2227 (w 0.7223 mse 0.7225 t 120 new 0.22) lr 1.00e-05 gnorm 0.205 2.82s mem 81.1GB +[2026-09-14 11:52:26] step 1961/5000 loss 0.1410 (w 0.3424 mse 0.3408 t 951 new 0.16) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-14 11:52:30] step 1962/5000 loss 0.3116 (w 0.2334 mse 0.2303 t 811 new 0.21) lr 1.00e-05 gnorm 0.210 3.37s mem 81.1GB +[2026-09-14 11:52:32] step 1963/5000 loss 0.3308 (w 0.2078 mse 0.2159 t 953 new 0.18) lr 1.00e-05 gnorm 0.177 2.83s mem 81.1GB +[2026-09-14 11:52:36] step 1964/5000 loss 0.2496 (w 0.1973 mse 0.2010 t 677 new 0.24) lr 1.00e-05 gnorm 0.146 3.38s mem 81.1GB +[2026-09-14 11:52:39] step 1965/5000 loss 0.2286 (w 0.2892 mse 0.2971 t 997 new 0.23) lr 1.00e-05 gnorm 0.157 3.12s mem 81.1GB +[2026-09-14 11:52:42] step 1966/5000 loss 0.1922 (w 0.2121 mse 0.2028 t 866 new 0.19) lr 1.00e-05 gnorm 0.158 2.82s mem 81.1GB +[2026-09-14 11:52:45] step 1967/5000 loss 0.0784 (w 0.2450 mse 0.2281 t 870 new 0.22) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +[2026-09-14 11:52:48] step 1968/5000 loss 0.2539 (w 0.1619 mse 0.1723 t 860 new 0.22) lr 1.00e-05 gnorm 0.136 3.37s mem 81.1GB +[2026-09-14 11:52:51] step 1969/5000 loss 0.2389 (w 0.1907 mse 0.1882 t 931 new 0.23) lr 1.00e-05 gnorm 0.321 3.08s mem 81.1GB +[2026-09-14 11:52:54] step 1970/5000 loss 0.1688 (w 0.2970 mse 0.2768 t 975 new 0.27) lr 1.00e-05 gnorm 0.143 3.29s mem 81.1GB +[2026-09-14 11:52:58] step 1971/5000 loss 0.3202 (w 0.1536 mse 0.1735 t 572 new 0.24) lr 1.00e-05 gnorm 0.150 3.07s mem 81.1GB +[2026-09-14 11:53:00] step 1972/5000 loss 0.2326 (w 0.2452 mse 0.2398 t 942 new 0.16) lr 1.00e-05 gnorm 0.150 2.83s mem 81.1GB +[2026-09-14 11:53:04] step 1973/5000 loss 0.1598 (w 0.1804 mse 0.1765 t 871 new 0.22) lr 1.00e-05 gnorm 0.129 3.12s mem 81.1GB +[2026-09-14 11:53:07] step 1974/5000 loss 0.3133 (w 0.3048 mse 0.3153 t 249 new 0.08) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +[2026-09-14 11:53:10] step 1975/5000 loss 0.2447 (w 0.2233 mse 0.2160 t 939 new 0.23) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +[2026-09-14 11:53:13] step 1976/5000 loss 0.1939 (w 0.1403 mse 0.1495 t 800 new 0.26) lr 1.00e-05 gnorm 0.205 3.36s mem 81.1GB +[2026-09-14 11:53:16] step 1977/5000 loss 0.3905 (w 0.2531 mse 0.2446 t 551 new 0.23) lr 1.00e-05 gnorm 0.173 3.10s mem 81.1GB +[2026-09-14 11:53:19] step 1978/5000 loss 0.2055 (w 0.2096 mse 0.2168 t 639 new 0.24) lr 1.00e-05 gnorm 0.148 2.83s mem 81.1GB +[2026-09-14 11:53:22] step 1979/5000 loss 0.2571 (w 0.3075 mse 0.2949 t 968 new 0.14) lr 1.00e-05 gnorm 0.147 3.37s mem 81.1GB +[2026-09-14 11:53:25] step 1980/5000 loss 0.1658 (w 0.2752 mse 0.2765 t 675 new 0.23) lr 1.00e-05 gnorm 0.247 3.06s mem 81.1GB +[2026-09-14 11:53:29] step 1981/5000 loss 0.2553 (w 0.2676 mse 0.2588 t 987 new 0.21) lr 1.00e-05 gnorm 0.432 3.10s mem 81.1GB +[2026-09-14 11:53:32] step 1982/5000 loss 0.1083 (w 0.1542 mse 0.1426 t 909 new 0.16) lr 1.00e-05 gnorm 0.121 3.33s mem 81.1GB +[2026-09-14 11:53:35] step 1983/5000 loss 0.3799 (w 0.3750 mse 0.3703 t 397 new 0.23) lr 1.00e-05 gnorm 0.182 2.83s mem 81.1GB +[2026-09-14 11:53:38] step 1984/5000 loss 0.1349 (w 0.2315 mse 0.2126 t 968 new 0.21) lr 1.00e-05 gnorm 0.474 2.84s mem 81.1GB +[2026-09-14 11:53:41] step 1985/5000 loss 0.2014 (w 0.1575 mse 0.1660 t 853 new 0.22) lr 1.00e-05 gnorm 0.262 3.15s mem 81.1GB +[2026-09-14 11:53:44] step 1986/5000 loss 0.1824 (w 0.1889 mse 0.1861 t 773 new 0.23) lr 1.00e-05 gnorm 0.170 3.07s mem 81.1GB +[2026-09-14 11:53:47] step 1987/5000 loss 0.2358 (w 0.2172 mse 0.2152 t 647 new 0.23) lr 1.00e-05 gnorm 0.342 3.35s mem 81.1GB +[2026-09-14 11:53:51] step 1988/5000 loss 0.2284 (w 0.2835 mse 0.2641 t 835 new 0.22) lr 1.00e-05 gnorm 0.157 3.41s mem 81.1GB +[2026-09-14 11:53:54] step 1989/5000 loss 0.3102 (w 0.1988 mse 0.2253 t 928 new 0.18) lr 1.00e-05 gnorm 0.247 2.82s mem 81.1GB +[2026-09-14 11:53:56] step 1990/5000 loss 0.1470 (w 0.2241 mse 0.2257 t 921 new 0.19) lr 1.00e-05 gnorm 0.149 2.83s mem 81.1GB +[2026-09-14 11:54:00] step 1991/5000 loss 0.1793 (w 0.2525 mse 0.2759 t 278 new 0.14) lr 1.00e-05 gnorm 0.163 3.45s mem 81.1GB +[2026-09-14 11:54:03] step 1992/5000 loss 0.1909 (w 0.2428 mse 0.2433 t 979 new 0.20) lr 1.00e-05 gnorm 0.484 3.08s mem 81.1GB +[2026-09-14 11:54:06] step 1993/5000 loss 0.1983 (w 0.1985 mse 0.1845 t 945 new 0.15) lr 1.00e-05 gnorm 0.144 3.33s mem 81.1GB +[2026-09-14 11:54:09] step 1994/5000 loss 0.2539 (w 0.2490 mse 0.2362 t 940 new 0.24) lr 1.00e-05 gnorm 0.188 3.07s mem 81.1GB +[2026-09-14 11:54:12] step 1995/5000 loss 0.1409 (w 0.2101 mse 0.1962 t 872 new 0.25) lr 1.00e-05 gnorm 0.174 2.84s mem 81.1GB +[2026-09-14 11:54:15] step 1996/5000 loss 0.1986 (w 0.1046 mse 0.1096 t 888 new 0.16) lr 1.00e-05 gnorm 0.162 2.83s mem 81.1GB +[2026-09-14 11:54:18] step 1997/5000 loss 0.1565 (w 0.2046 mse 0.2011 t 927 new 0.16) lr 1.00e-05 gnorm 0.229 3.41s mem 81.1GB +[2026-09-14 11:54:22] step 1998/5000 loss 0.3394 (w 0.3606 mse 0.3597 t 394 new 0.27) lr 1.00e-05 gnorm 0.156 3.07s mem 81.1GB +[2026-09-14 11:54:25] step 1999/5000 loss 0.2113 (w 0.2192 mse 0.2073 t 807 new 0.24) lr 1.00e-05 gnorm 0.131 3.14s mem 81.1GB +[2026-09-14 11:54:28] step 2000/5000 loss 0.2045 (w 0.3156 mse 0.2960 t 976 new 0.24) lr 1.00e-05 gnorm 0.133 3.07s mem 81.1GB +[2026-09-14 11:54:29] [val] step 2000 t=200: w=0.4239 mse=0.4349 (n=16) t=500: w=0.2260 mse=0.2299 (n=16) t=800: w=0.1769 mse=0.1766 (n=16) | mean w=0.2756 mse=0.2804 2s +[2026-09-14 11:55:17] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step2000.safetensors 4093 个张量 37.98 GB +[2026-09-14 11:55:22] step 2001/5000 loss 0.4653 (w 0.1268 mse 0.1154 t 814 new 0.25) lr 1.00e-05 gnorm 0.163 2.85s mem 81.1GB +[2026-09-14 11:55:25] step 2002/5000 loss 0.2271 (w 0.3132 mse 0.2993 t 968 new 0.24) lr 1.00e-05 gnorm 0.162 3.06s mem 81.1GB +[2026-09-14 11:55:28] step 2003/5000 loss 0.1605 (w 0.3046 mse 0.3002 t 976 new 0.21) lr 1.00e-05 gnorm 0.199 3.09s mem 81.1GB +[2026-09-14 11:55:31] step 2004/5000 loss 0.3793 (w 0.3257 mse 0.3302 t 386 new 0.09) lr 1.00e-05 gnorm 0.166 3.30s mem 81.1GB +[2026-09-14 11:55:35] step 2005/5000 loss 0.2460 (w 0.1918 mse 0.1974 t 987 new 0.26) lr 1.00e-05 gnorm 0.246 3.39s mem 81.1GB +[2026-09-14 11:55:38] step 2006/5000 loss 0.2916 (w 0.4337 mse 0.4365 t 228 new 0.23) lr 1.00e-05 gnorm 0.180 2.85s mem 81.1GB +[2026-09-14 11:55:40] step 2007/5000 loss 0.2123 (w 0.1923 mse 0.1858 t 891 new 0.24) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-14 11:55:44] step 2008/5000 loss 0.3232 (w 0.2536 mse 0.2455 t 886 new 0.22) lr 1.00e-05 gnorm 0.282 3.11s mem 81.1GB +[2026-09-14 11:55:47] step 2009/5000 loss 0.1910 (w 0.3960 mse 0.3765 t 980 new 0.27) lr 1.00e-05 gnorm 0.476 3.09s mem 81.1GB +[2026-09-14 11:55:50] step 2010/5000 loss 0.2551 (w 0.1365 mse 0.1328 t 877 new 0.21) lr 1.00e-05 gnorm 0.172 3.32s mem 81.1GB +[2026-09-14 11:55:53] step 2011/5000 loss 0.1761 (w 0.3274 mse 0.3137 t 944 new 0.25) lr 1.00e-05 gnorm 0.270 3.13s mem 81.1GB +[2026-09-14 11:55:56] step 2012/5000 loss 0.0965 (w 0.2834 mse 0.2832 t 929 new 0.18) lr 1.00e-05 gnorm 0.203 2.86s mem 81.1GB +[2026-09-14 11:55:59] step 2013/5000 loss 0.3560 (w 0.2419 mse 0.2242 t 781 new 0.22) lr 1.00e-05 gnorm 0.161 2.85s mem 81.1GB +[2026-09-14 11:56:02] step 2014/5000 loss 0.0913 (w 0.2552 mse 0.2422 t 950 new 0.21) lr 1.00e-05 gnorm 0.377 3.29s mem 81.1GB +[2026-09-14 11:56:05] step 2015/5000 loss 0.3389 (w 0.2272 mse 0.2198 t 928 new 0.21) lr 1.00e-05 gnorm 0.150 3.10s mem 81.1GB +[2026-09-14 11:56:09] step 2016/5000 loss 0.2426 (w 0.1476 mse 0.1634 t 821 new 0.23) lr 1.00e-05 gnorm 0.183 3.65s mem 81.1GB +[2026-09-14 11:56:12] step 2017/5000 loss 0.2619 (w 0.4505 mse 0.4478 t 288 new 0.05) lr 1.00e-05 gnorm 0.117 3.12s mem 81.1GB +[2026-09-14 11:56:15] step 2018/5000 loss 0.2074 (w 0.3196 mse 0.3040 t 665 new 0.19) lr 1.00e-05 gnorm 0.137 2.85s mem 81.1GB +[2026-09-14 11:56:18] step 2019/5000 loss 0.2077 (w 0.2156 mse 0.2130 t 840 new 0.23) lr 1.00e-05 gnorm 0.653 2.84s mem 81.1GB +[2026-09-14 11:56:21] step 2020/5000 loss 0.1372 (w 0.1625 mse 0.1544 t 675 new 0.22) lr 1.00e-05 gnorm 0.155 3.39s mem 81.1GB +[2026-09-14 11:56:25] step 2021/5000 loss 0.1492 (w 0.2449 mse 0.2499 t 846 new 0.14) lr 1.00e-05 gnorm 0.143 3.58s mem 81.1GB +[2026-09-14 11:56:28] step 2022/5000 loss 0.1734 (w 0.3169 mse 0.3141 t 970 new 0.22) lr 1.00e-05 gnorm 0.268 3.39s mem 81.1GB +[2026-09-14 11:56:31] step 2023/5000 loss 0.1910 (w 0.3319 mse 0.3230 t 988 new 0.22) lr 1.00e-05 gnorm 0.158 3.15s mem 81.1GB +[2026-09-14 11:56:34] step 2024/5000 loss 0.4523 (w 0.4297 mse 0.4421 t 223 new 0.21) lr 1.00e-05 gnorm 0.157 3.08s mem 81.1GB +[2026-09-14 11:56:37] step 2025/5000 loss 0.1887 (w 0.1687 mse 0.1611 t 886 new 0.19) lr 1.00e-05 gnorm 0.133 3.07s mem 81.1GB +[2026-09-14 11:56:41] step 2026/5000 loss 0.2057 (w 0.1894 mse 0.1832 t 813 new 0.22) lr 1.00e-05 gnorm 0.249 3.51s mem 81.1GB +[2026-09-14 11:56:44] step 2027/5000 loss 0.3071 (w 0.3074 mse 0.3048 t 992 new 0.09) lr 1.00e-05 gnorm 0.158 3.53s mem 81.1GB +[2026-09-14 11:56:48] step 2028/5000 loss 0.3970 (w 0.2851 mse 0.2952 t 444 new 0.17) lr 1.00e-05 gnorm 0.196 3.50s mem 81.1GB +[2026-09-14 11:56:51] step 2029/5000 loss 0.2691 (w 0.2230 mse 0.2172 t 957 new 0.12) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +[2026-09-14 11:56:54] step 2030/5000 loss 0.3778 (w 0.4706 mse 0.4580 t 306 new 0.20) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +[2026-09-14 11:56:57] step 2031/5000 loss 0.1463 (w 0.3362 mse 0.3457 t 283 new 0.09) lr 1.00e-05 gnorm 0.123 3.06s mem 81.1GB +[2026-09-14 11:57:00] step 2032/5000 loss 0.2094 (w 0.1729 mse 0.1719 t 926 new 0.22) lr 1.00e-05 gnorm 0.151 3.08s mem 81.1GB +[2026-09-14 11:57:03] step 2033/5000 loss 0.2632 (w 0.7882 mse 0.7826 t 100 new 0.23) lr 1.00e-05 gnorm 0.150 3.22s mem 81.1GB +[2026-09-14 11:57:07] step 2034/5000 loss 0.2741 (w 0.3181 mse 0.3247 t 348 new 0.17) lr 1.00e-05 gnorm 0.125 3.43s mem 81.1GB +[2026-09-14 11:57:10] step 2035/5000 loss 0.0652 (w 0.1071 mse 0.1224 t 819 new 0.25) lr 1.00e-05 gnorm 0.136 3.14s mem 81.1GB +[2026-09-14 11:57:13] step 2036/5000 loss 0.2570 (w 0.2155 mse 0.2091 t 542 new 0.21) lr 1.00e-05 gnorm 0.131 2.85s mem 81.1GB +[2026-09-14 11:57:16] step 2037/5000 loss 0.2620 (w 0.1747 mse 0.1789 t 677 new 0.21) lr 1.00e-05 gnorm 0.321 3.06s mem 81.1GB +[2026-09-14 11:57:19] step 2038/5000 loss 0.2245 (w 0.3498 mse 0.3519 t 954 new 0.25) lr 1.00e-05 gnorm 0.129 3.25s mem 81.1GB +[2026-09-14 11:57:22] step 2039/5000 loss 0.2038 (w 0.2038 mse 0.1947 t 800 new 0.15) lr 1.00e-05 gnorm 0.126 3.21s mem 81.1GB +[2026-09-14 11:57:26] step 2040/5000 loss 0.4393 (w 0.4758 mse 0.4597 t 171 new 0.22) lr 1.00e-05 gnorm 0.169 3.61s mem 81.1GB +[2026-09-14 11:57:29] step 2041/5000 loss 0.1235 (w 0.2174 mse 0.2043 t 981 new 0.24) lr 1.00e-05 gnorm 0.161 2.84s mem 81.1GB +[2026-09-14 11:57:32] step 2042/5000 loss 0.1641 (w 0.1888 mse 0.1951 t 965 new 0.22) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +[2026-09-14 11:57:35] step 2043/5000 loss 0.4183 (w 0.2393 mse 0.2270 t 959 new 0.14) lr 1.00e-05 gnorm 0.221 3.12s mem 81.1GB +[2026-09-14 11:57:38] step 2044/5000 loss 0.1833 (w 0.2633 mse 0.2678 t 956 new 0.17) lr 1.00e-05 gnorm 0.356 3.23s mem 81.1GB +[2026-09-14 11:57:41] step 2045/5000 loss 0.2805 (w 0.1534 mse 0.1417 t 946 new 0.17) lr 1.00e-05 gnorm 0.201 3.32s mem 81.1GB +[2026-09-14 11:57:45] step 2046/5000 loss 0.1171 (w 0.1826 mse 0.1859 t 999 new 0.19) lr 1.00e-05 gnorm 0.162 3.31s mem 81.1GB +[2026-09-14 11:57:47] step 2047/5000 loss 0.0919 (w 0.1637 mse 0.1622 t 965 new 0.17) lr 1.00e-05 gnorm 0.282 2.84s mem 81.1GB +[2026-09-14 11:57:50] step 2048/5000 loss 0.1527 (w 0.1485 mse 0.1553 t 939 new 0.22) lr 1.00e-05 gnorm 0.151 2.84s mem 81.1GB +[2026-09-14 11:57:53] step 2049/5000 loss 0.3214 (w 0.4876 mse 0.4880 t 264 new 0.19) lr 1.00e-05 gnorm 0.134 3.15s mem 81.1GB +[2026-09-14 11:57:57] step 2050/5000 loss 0.1904 (w 0.1447 mse 0.1445 t 983 new 0.26) lr 1.00e-05 gnorm 0.121 3.30s mem 81.1GB +[2026-09-14 11:58:00] step 2051/5000 loss 0.3577 (w 0.2015 mse 0.1944 t 826 new 0.18) lr 1.00e-05 gnorm 0.141 3.47s mem 81.1GB +[2026-09-14 11:58:04] step 2052/5000 loss 0.2859 (w 0.2525 mse 0.2479 t 996 new 0.22) lr 1.00e-05 gnorm 0.151 3.42s mem 81.1GB +[2026-09-14 11:58:06] step 2053/5000 loss 0.1335 (w 0.1459 mse 0.1427 t 816 new 0.12) lr 1.00e-05 gnorm 0.168 2.84s mem 81.1GB +[2026-09-14 11:58:09] step 2054/5000 loss 0.3301 (w 0.1965 mse 0.1923 t 624 new 0.19) lr 1.00e-05 gnorm 0.139 2.85s mem 81.1GB +[2026-09-14 11:58:13] step 2055/5000 loss 0.1097 (w 0.2052 mse 0.1914 t 927 new 0.25) lr 1.00e-05 gnorm 0.139 3.27s mem 81.1GB +[2026-09-14 11:58:16] step 2056/5000 loss 0.1957 (w 0.4156 mse 0.4176 t 278 new 0.23) lr 1.00e-05 gnorm 0.150 3.09s mem 81.1GB +[2026-09-14 11:58:19] step 2057/5000 loss 0.3450 (w 0.2308 mse 0.2285 t 869 new 0.19) lr 1.00e-05 gnorm 0.316 3.32s mem 81.1GB +[2026-09-14 11:58:22] step 2058/5000 loss 0.0781 (w 0.1930 mse 0.1832 t 906 new 0.21) lr 1.00e-05 gnorm 0.136 3.09s mem 81.1GB +[2026-09-14 11:58:25] step 2059/5000 loss 0.1651 (w 0.2002 mse 0.1969 t 826 new 0.21) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +[2026-09-14 11:58:28] step 2060/5000 loss 0.3726 (w 0.2403 mse 0.2350 t 822 new 0.21) lr 1.00e-05 gnorm 0.376 2.85s mem 81.1GB +[2026-09-14 11:58:31] step 2061/5000 loss 0.0796 (w 0.1660 mse 0.1794 t 914 new 0.22) lr 1.00e-05 gnorm 0.180 3.28s mem 81.1GB +[2026-09-14 11:58:34] step 2062/5000 loss 0.2193 (w 0.3128 mse 0.3100 t 975 new 0.20) lr 1.00e-05 gnorm 0.370 3.06s mem 81.1GB +[2026-09-14 11:58:38] step 2063/5000 loss 0.1321 (w 0.2123 mse 0.2220 t 991 new 0.18) lr 1.00e-05 gnorm 0.176 3.56s mem 81.1GB +[2026-09-14 11:58:41] step 2064/5000 loss 0.3188 (w 0.1821 mse 0.1694 t 875 new 0.22) lr 1.00e-05 gnorm 0.535 3.13s mem 81.1GB +[2026-09-14 11:58:44] step 2065/5000 loss 0.3909 (w 0.2285 mse 0.2089 t 782 new 0.18) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +[2026-09-14 11:58:47] step 2066/5000 loss 0.1046 (w 0.4248 mse 0.4031 t 982 new 0.22) lr 1.00e-05 gnorm 0.124 2.85s mem 81.1GB +[2026-09-14 11:58:50] step 2067/5000 loss 0.1462 (w 0.2109 mse 0.2130 t 967 new 0.16) lr 1.00e-05 gnorm 0.335 3.04s mem 81.1GB +[2026-09-14 11:58:53] step 2068/5000 loss 0.2552 (w 0.2445 mse 0.2497 t 972 new 0.17) lr 1.00e-05 gnorm 0.097 3.05s mem 81.1GB +[2026-09-14 11:58:56] step 2069/5000 loss 0.2353 (w 0.1827 mse 0.1864 t 878 new 0.12) lr 1.00e-05 gnorm 0.181 3.56s mem 81.1GB +[2026-09-14 11:58:59] step 2070/5000 loss 0.2063 (w 0.2260 mse 0.2238 t 697 new 0.20) lr 1.00e-05 gnorm 16.329 2.84s mem 81.1GB +[2026-09-14 11:59:02] step 2071/5000 loss 0.3357 (w 0.2740 mse 0.2697 t 651 new 0.22) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +[2026-09-14 11:59:05] step 2072/5000 loss 0.1311 (w 0.1973 mse 0.1904 t 948 new 0.13) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +[2026-09-14 11:59:08] step 2073/5000 loss 0.3555 (w 0.3355 mse 0.3308 t 546 new 0.27) lr 1.00e-05 gnorm 0.261 3.10s mem 81.1GB +[2026-09-14 11:59:12] step 2074/5000 loss 0.2857 (w 0.2942 mse 0.2818 t 985 new 0.17) lr 1.00e-05 gnorm 1.597 3.43s mem 81.1GB +[2026-09-14 11:59:15] step 2075/5000 loss 0.1561 (w 0.2459 mse 0.2436 t 904 new 0.25) lr 1.00e-05 gnorm 0.180 3.14s mem 81.1GB +[2026-09-14 11:59:18] step 2076/5000 loss 0.3190 (w 0.2656 mse 0.2679 t 866 new 0.21) lr 1.00e-05 gnorm 0.133 2.84s mem 81.1GB +[2026-09-14 11:59:21] step 2077/5000 loss 0.2223 (w 0.1236 mse 0.1254 t 787 new 0.20) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +[2026-09-14 11:59:24] step 2078/5000 loss 0.1306 (w 0.2148 mse 0.2029 t 878 new 0.21) lr 1.00e-05 gnorm 0.150 3.03s mem 81.1GB +[2026-09-14 11:59:27] step 2079/5000 loss 0.1479 (w 0.2427 mse 0.2497 t 999 new 0.22) lr 1.00e-05 gnorm 0.233 3.08s mem 81.1GB +[2026-09-14 11:59:30] step 2080/5000 loss 0.3666 (w 0.1770 mse 0.1802 t 967 new 0.21) lr 1.00e-05 gnorm 0.222 3.51s mem 81.1GB +[2026-09-14 11:59:33] step 2081/5000 loss 0.2762 (w 0.2174 mse 0.2143 t 352 new 0.14) lr 1.00e-05 gnorm 0.217 3.36s mem 81.1GB +[2026-09-14 11:59:36] step 2082/5000 loss 0.3430 (w 0.2316 mse 0.2267 t 653 new 0.25) lr 1.00e-05 gnorm 0.137 2.85s mem 81.1GB +[2026-09-14 11:59:39] step 2083/5000 loss 0.1891 (w 0.1925 mse 0.1893 t 851 new 0.24) lr 1.00e-05 gnorm 0.152 2.85s mem 81.1GB +[2026-09-14 11:59:42] step 2084/5000 loss 0.1976 (w 0.1708 mse 0.1678 t 759 new 0.28) lr 1.00e-05 gnorm 0.157 3.13s mem 81.1GB +[2026-09-14 11:59:46] step 2085/5000 loss 0.4392 (w 0.2045 mse 0.2056 t 913 new 0.24) lr 1.00e-05 gnorm 0.171 3.30s mem 81.1GB +[2026-09-14 11:59:49] step 2086/5000 loss 0.1927 (w 0.2447 mse 0.2402 t 836 new 0.24) lr 1.00e-05 gnorm 3.493 3.26s mem 81.1GB +[2026-09-14 11:59:52] step 2087/5000 loss 0.2724 (w 0.0617 mse 0.0689 t 925 new 0.11) lr 1.00e-05 gnorm 0.148 3.37s mem 81.1GB +[2026-09-14 11:59:55] step 2088/5000 loss 0.3427 (w 0.3084 mse 0.2974 t 787 new 0.16) lr 1.00e-05 gnorm 0.415 2.84s mem 81.1GB +[2026-09-14 11:59:58] step 2089/5000 loss 0.2046 (w 0.1608 mse 0.1778 t 965 new 0.12) lr 1.00e-05 gnorm 0.271 2.85s mem 81.1GB +[2026-09-14 12:00:01] step 2090/5000 loss 0.2164 (w 0.2040 mse 0.1984 t 935 new 0.17) lr 1.00e-05 gnorm 0.150 3.35s mem 81.1GB +[2026-09-14 12:00:04] step 2091/5000 loss 0.1834 (w 0.2137 mse 0.2098 t 935 new 0.09) lr 1.00e-05 gnorm 0.191 3.09s mem 81.1GB +[2026-09-14 12:00:08] step 2092/5000 loss 0.2963 (w 0.2187 mse 0.2183 t 935 new 0.01) lr 1.00e-05 gnorm 0.171 3.32s mem 81.1GB +[2026-09-14 12:00:11] step 2093/5000 loss 0.3960 (w 0.3632 mse 0.3547 t 348 new 0.20) lr 1.00e-05 gnorm 0.161 3.36s mem 81.1GB +[2026-09-14 12:00:14] step 2094/5000 loss 0.2551 (w 0.2881 mse 0.2913 t 851 new 0.28) lr 1.00e-05 gnorm 0.155 2.85s mem 81.1GB +[2026-09-14 12:00:17] step 2095/5000 loss 0.1750 (w 0.1371 mse 0.1445 t 932 new 0.12) lr 1.00e-05 gnorm 0.134 2.86s mem 81.1GB +[2026-09-14 12:00:20] step 2096/5000 loss 0.1586 (w 0.2617 mse 0.2608 t 962 new 0.13) lr 1.00e-05 gnorm 0.134 3.25s mem 81.1GB +[2026-09-14 12:00:23] step 2097/5000 loss 0.2708 (w 0.2371 mse 0.2251 t 847 new 0.26) lr 1.00e-05 gnorm 0.114 3.12s mem 81.1GB +[2026-09-14 12:00:26] step 2098/5000 loss 0.2186 (w 0.1944 mse 0.2042 t 684 new 0.23) lr 1.00e-05 gnorm 0.136 3.27s mem 81.1GB +[2026-09-14 12:00:30] step 2099/5000 loss 0.2197 (w 0.1554 mse 0.1657 t 874 new 0.23) lr 1.00e-05 gnorm 0.149 3.32s mem 81.1GB +[2026-09-14 12:00:33] step 2100/5000 loss 0.1571 (w 0.0977 mse 0.1118 t 844 new 0.19) lr 1.00e-05 gnorm 0.154 2.84s mem 81.1GB +[2026-09-14 12:00:35] step 2101/5000 loss 0.1823 (w 0.2756 mse 0.2726 t 984 new 0.22) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +[2026-09-14 12:00:39] step 2102/5000 loss 0.3788 (w 0.1352 mse 0.1271 t 819 new 0.17) lr 1.00e-05 gnorm 0.179 3.35s mem 81.1GB +[2026-09-14 12:00:42] step 2103/5000 loss 0.3176 (w 0.3948 mse 0.4160 t 249 new 0.19) lr 1.00e-05 gnorm 0.169 3.09s mem 81.1GB +[2026-09-14 12:00:45] step 2104/5000 loss 0.1643 (w 0.1138 mse 0.1166 t 902 new 0.14) lr 1.00e-05 gnorm 0.145 3.41s mem 81.1GB +[2026-09-14 12:00:49] step 2105/5000 loss 0.2120 (w 0.2747 mse 0.2636 t 944 new 0.17) lr 1.00e-05 gnorm 0.141 3.35s mem 81.1GB +[2026-09-14 12:00:52] step 2106/5000 loss 0.3494 (w 0.2936 mse 0.2826 t 989 new 0.23) lr 1.00e-05 gnorm 0.153 2.84s mem 81.1GB +[2026-09-14 12:00:55] step 2107/5000 loss 0.3457 (w 0.1887 mse 0.1798 t 918 new 0.21) lr 1.00e-05 gnorm 0.185 3.06s mem 81.1GB +[2026-09-14 12:00:58] step 2108/5000 loss 0.2106 (w 0.2402 mse 0.2067 t 858 new 0.21) lr 1.00e-05 gnorm 0.323 3.06s mem 81.1GB +[2026-09-14 12:01:01] step 2109/5000 loss 0.2355 (w 0.3656 mse 0.3655 t 972 new 0.28) lr 1.00e-05 gnorm 0.174 3.07s mem 81.1GB +[2026-09-14 12:01:04] step 2110/5000 loss 0.3169 (w 0.2702 mse 0.2608 t 523 new 0.12) lr 1.00e-05 gnorm 0.151 3.44s mem 81.1GB +[2026-09-14 12:01:07] step 2111/5000 loss 0.4192 (w 0.5842 mse 0.5766 t 217 new 0.23) lr 1.00e-05 gnorm 0.153 3.19s mem 81.1GB +[2026-09-14 12:01:10] step 2112/5000 loss 0.1850 (w 0.2559 mse 0.2537 t 883 new 0.17) lr 1.00e-05 gnorm 0.156 2.86s mem 81.1GB +[2026-09-14 12:01:13] step 2113/5000 loss 0.1146 (w 0.1665 mse 0.1698 t 851 new 0.25) lr 1.00e-05 gnorm 0.194 3.05s mem 81.1GB +[2026-09-14 12:01:16] step 2114/5000 loss 0.1539 (w 0.3353 mse 0.3519 t 971 new 0.19) lr 1.00e-05 gnorm 0.173 3.07s mem 81.1GB +[2026-09-14 12:01:20] step 2115/5000 loss 0.1698 (w 0.1523 mse 0.1638 t 960 new 0.18) lr 1.00e-05 gnorm 0.132 3.42s mem 81.1GB +[2026-09-14 12:01:23] step 2116/5000 loss 0.1728 (w 0.3102 mse 0.3155 t 348 new 0.21) lr 1.00e-05 gnorm 0.230 3.28s mem 81.1GB +[2026-09-14 12:01:26] step 2117/5000 loss 0.1719 (w 0.1502 mse 0.1569 t 916 new 0.14) lr 1.00e-05 gnorm 0.131 3.06s mem 81.1GB +[2026-09-14 12:01:29] step 2118/5000 loss 0.2379 (w 0.3321 mse 0.3418 t 390 new 0.23) lr 1.00e-05 gnorm 0.204 2.84s mem 81.1GB +[2026-09-14 12:01:33] step 2119/5000 loss 0.2317 (w 0.2710 mse 0.2635 t 872 new 0.25) lr 1.00e-05 gnorm 0.147 3.58s mem 81.1GB +[2026-09-14 12:01:36] step 2120/5000 loss 0.2507 (w 0.2059 mse 0.2306 t 968 new 0.26) lr 1.00e-05 gnorm 0.148 3.07s mem 81.1GB +[2026-09-14 12:01:39] step 2121/5000 loss 0.1387 (w 0.1060 mse 0.1078 t 989 new 0.23) lr 1.00e-05 gnorm 0.326 3.19s mem 81.1GB +[2026-09-14 12:01:43] step 2122/5000 loss 0.1966 (w 0.3459 mse 0.3460 t 1000 new 0.17) lr 1.00e-05 gnorm 0.250 3.68s mem 81.1GB +[2026-09-14 12:01:46] step 2123/5000 loss 0.1962 (w 0.2588 mse 0.2435 t 927 new 0.18) lr 1.00e-05 gnorm 0.413 3.20s mem 81.1GB +[2026-09-14 12:01:49] step 2124/5000 loss 0.2718 (w 0.3630 mse 0.3580 t 394 new 0.18) lr 1.00e-05 gnorm 0.137 2.87s mem 81.1GB +[2026-09-14 12:01:52] step 2125/5000 loss 0.2119 (w 0.3193 mse 0.2994 t 895 new 0.18) lr 1.00e-05 gnorm 0.146 3.31s mem 81.1GB +[2026-09-14 12:01:56] step 2126/5000 loss 0.2416 (w 0.1743 mse 0.1718 t 822 new 0.25) lr 1.00e-05 gnorm 0.144 3.45s mem 81.1GB +[2026-09-14 12:01:59] step 2127/5000 loss 0.3491 (w 0.1739 mse 0.1691 t 681 new 0.19) lr 1.00e-05 gnorm 0.148 3.30s mem 81.1GB +[2026-09-14 12:02:03] step 2128/5000 loss 0.2949 (w 0.2167 mse 0.2054 t 772 new 0.19) lr 1.00e-05 gnorm 0.169 3.52s mem 81.1GB +[2026-09-14 12:02:05] step 2129/5000 loss 0.3471 (w 0.4388 mse 0.4136 t 980 new 0.25) lr 1.00e-05 gnorm 0.138 2.86s mem 81.1GB +[2026-09-14 12:02:08] step 2130/5000 loss 0.3164 (w 0.3100 mse 0.3082 t 998 new 0.26) lr 1.00e-05 gnorm 0.158 2.89s mem 81.1GB +[2026-09-14 12:02:12] step 2131/5000 loss 0.2716 (w 0.1821 mse 0.1800 t 763 new 0.14) lr 1.00e-05 gnorm 0.204 3.21s mem 81.1GB +[2026-09-14 12:02:15] step 2132/5000 loss 0.1923 (w 0.1704 mse 0.1607 t 904 new 0.19) lr 1.00e-05 gnorm 0.302 3.13s mem 81.1GB +[2026-09-14 12:02:18] step 2133/5000 loss 0.2220 (w 0.3181 mse 0.3020 t 750 new 0.19) lr 1.00e-05 gnorm 0.211 3.27s mem 81.1GB +[2026-09-14 12:02:22] step 2134/5000 loss 0.1476 (w 0.1924 mse 0.1968 t 872 new 0.17) lr 1.00e-05 gnorm 0.153 3.62s mem 81.1GB +[2026-09-14 12:02:25] step 2135/5000 loss 0.3635 (w 0.1148 mse 0.1237 t 797 new 0.27) lr 1.00e-05 gnorm 0.188 2.96s mem 81.1GB +[2026-09-14 12:02:27] step 2136/5000 loss 0.1710 (w 0.3393 mse 0.3187 t 974 new 0.22) lr 1.00e-05 gnorm 0.125 2.96s mem 81.1GB +[2026-09-14 12:02:31] step 2137/5000 loss 0.2603 (w 0.3252 mse 0.3298 t 992 new 0.24) lr 1.00e-05 gnorm 0.209 3.33s mem 81.1GB +[2026-09-14 12:02:35] step 2138/5000 loss 0.3904 (w 0.1386 mse 0.1340 t 849 new 0.05) lr 1.00e-05 gnorm 0.188 4.44s mem 81.1GB +[2026-09-14 12:02:41] step 2139/5000 loss 0.1478 (w 0.2165 mse 0.2231 t 428 new 0.25) lr 1.00e-05 gnorm 0.144 5.95s mem 81.1GB +[2026-09-14 12:02:47] step 2140/5000 loss 0.0949 (w 0.2655 mse 0.2517 t 939 new 0.19) lr 1.00e-05 gnorm 0.126 5.98s mem 81.1GB +[2026-09-14 12:02:53] step 2141/5000 loss 0.1984 (w 0.5584 mse 0.5535 t 159 new 0.22) lr 1.00e-05 gnorm 0.184 5.97s mem 81.1GB +[2026-09-14 12:02:59] step 2142/5000 loss 0.2290 (w 0.1739 mse 0.1743 t 951 new 0.20) lr 1.00e-05 gnorm 0.147 5.97s mem 81.1GB +[2026-09-14 12:03:05] step 2143/5000 loss 0.1828 (w 0.1330 mse 0.1399 t 715 new 0.27) lr 1.00e-05 gnorm 0.150 5.90s mem 81.1GB +[2026-09-14 12:03:10] step 2144/5000 loss 0.2285 (w 0.1878 mse 0.1848 t 695 new 0.16) lr 1.00e-05 gnorm 0.236 5.05s mem 81.1GB +[2026-09-14 12:03:16] step 2145/5000 loss 0.2219 (w 0.2753 mse 0.2644 t 846 new 0.23) lr 1.00e-05 gnorm 0.130 6.00s mem 81.1GB +[2026-09-14 12:03:21] step 2146/5000 loss 0.2465 (w 0.2151 mse 0.2159 t 977 new 0.23) lr 1.00e-05 gnorm 0.123 4.71s mem 81.1GB +[2026-09-14 12:03:24] step 2147/5000 loss 0.3017 (w 0.3181 mse 0.3118 t 431 new 0.23) lr 1.00e-05 gnorm 0.147 2.86s mem 81.1GB +[2026-09-14 12:03:27] step 2148/5000 loss 0.2791 (w 0.2832 mse 0.2755 t 431 new 0.27) lr 1.00e-05 gnorm 0.148 3.10s mem 81.1GB +[2026-09-14 12:03:30] step 2149/5000 loss 0.1774 (w 0.2374 mse 0.2296 t 962 new 0.19) lr 1.00e-05 gnorm 0.123 3.07s mem 81.1GB +[2026-09-14 12:03:33] step 2150/5000 loss 0.1701 (w 0.2312 mse 0.2247 t 961 new 0.09) lr 1.00e-05 gnorm 0.166 3.41s mem 81.1GB +[2026-09-14 12:03:36] step 2151/5000 loss 0.0793 (w 0.2597 mse 0.2607 t 972 new 0.09) lr 1.00e-05 gnorm 0.142 3.19s mem 81.1GB +[2026-09-14 12:03:40] step 2152/5000 loss 0.2143 (w 0.1791 mse 0.1729 t 925 new 0.19) lr 1.00e-05 gnorm 0.137 3.16s mem 81.1GB +[2026-09-14 12:03:43] step 2153/5000 loss 0.2408 (w 0.1893 mse 0.1742 t 950 new 0.22) lr 1.00e-05 gnorm 0.150 2.94s mem 81.1GB +[2026-09-14 12:03:46] step 2154/5000 loss 0.4001 (w 0.1899 mse 0.1858 t 703 new 0.18) lr 1.00e-05 gnorm 0.160 3.16s mem 81.1GB +[2026-09-14 12:03:49] step 2155/5000 loss 0.1934 (w 0.1756 mse 0.1895 t 939 new 0.19) lr 1.00e-05 gnorm 0.242 3.16s mem 81.1GB +[2026-09-14 12:03:52] step 2156/5000 loss 0.2204 (w 0.2658 mse 0.2658 t 976 new 0.19) lr 1.00e-05 gnorm 0.171 3.18s mem 81.1GB +[2026-09-14 12:03:55] step 2157/5000 loss 0.3830 (w 0.1970 mse 0.1952 t 975 new 0.24) lr 1.00e-05 gnorm 0.332 3.37s mem 81.1GB +[2026-09-14 12:03:59] step 2158/5000 loss 0.2793 (w 0.2183 mse 0.2119 t 817 new 0.20) lr 1.00e-05 gnorm 0.257 3.16s mem 81.1GB +[2026-09-14 12:04:02] step 2159/5000 loss 0.3539 (w 0.2081 mse 0.2001 t 926 new 0.23) lr 1.00e-05 gnorm 0.799 2.91s mem 81.1GB +[2026-09-14 12:04:05] step 2160/5000 loss 0.3556 (w 0.2639 mse 0.2604 t 599 new 0.18) lr 1.00e-05 gnorm 0.232 3.06s mem 81.1GB +[2026-09-14 12:04:08] step 2161/5000 loss 0.4610 (w 0.5727 mse 0.5805 t 177 new 0.23) lr 1.00e-05 gnorm 0.118 3.27s mem 81.1GB +[2026-09-14 12:04:12] step 2162/5000 loss 0.3249 (w 0.2518 mse 0.2412 t 566 new 0.19) lr 1.00e-05 gnorm 0.125 3.87s mem 81.1GB +[2026-09-14 12:04:15] step 2163/5000 loss 0.1163 (w 0.1288 mse 0.1249 t 832 new 0.10) lr 1.00e-05 gnorm 0.167 3.57s mem 81.1GB +[2026-09-14 12:04:18] step 2164/5000 loss 0.1878 (w 0.2043 mse 0.1972 t 728 new 0.21) lr 1.00e-05 gnorm 0.108 2.87s mem 81.1GB +[2026-09-14 12:04:21] step 2165/5000 loss 0.1281 (w 0.1676 mse 0.1744 t 962 new 0.19) lr 1.00e-05 gnorm 0.198 2.93s mem 81.1GB +[2026-09-14 12:04:24] step 2166/5000 loss 0.1593 (w 0.2599 mse 0.2482 t 909 new 0.19) lr 1.00e-05 gnorm 0.170 3.21s mem 81.1GB +[2026-09-14 12:04:28] step 2167/5000 loss 0.2872 (w 0.1351 mse 0.1264 t 873 new 0.23) lr 1.00e-05 gnorm 0.125 3.18s mem 81.1GB +[2026-09-14 12:04:32] step 2168/5000 loss 0.1477 (w 0.1383 mse 0.1510 t 885 new 0.28) lr 1.00e-05 gnorm 0.175 3.79s mem 81.1GB +[2026-09-14 12:04:36] step 2169/5000 loss 0.3242 (w 0.2357 mse 0.2372 t 807 new 0.20) lr 1.00e-05 gnorm 0.162 4.26s mem 81.1GB +[2026-09-14 12:04:39] step 2170/5000 loss 0.1846 (w 0.3030 mse 0.2986 t 986 new 0.18) lr 1.00e-05 gnorm 0.127 3.17s mem 81.1GB +[2026-09-14 12:04:42] step 2171/5000 loss 0.2800 (w 0.2554 mse 0.2473 t 965 new 0.18) lr 1.00e-05 gnorm 1.006 2.87s mem 81.1GB +[2026-09-14 12:04:45] step 2172/5000 loss 0.2490 (w 0.3320 mse 0.3224 t 983 new 0.16) lr 1.00e-05 gnorm 0.108 3.42s mem 81.1GB +[2026-09-14 12:04:48] step 2173/5000 loss 0.1701 (w 0.1666 mse 0.1815 t 974 new 0.21) lr 1.00e-05 gnorm 0.181 3.12s mem 81.1GB +[2026-09-14 12:04:51] step 2174/5000 loss 0.2508 (w 0.3441 mse 0.3458 t 991 new 0.20) lr 1.00e-05 gnorm 0.140 2.86s mem 81.1GB +[2026-09-14 12:04:55] step 2175/5000 loss 0.2948 (w 0.2260 mse 0.2182 t 952 new 0.19) lr 1.00e-05 gnorm 0.158 3.56s mem 81.1GB +[2026-09-14 12:04:58] step 2176/5000 loss 0.2082 (w 0.2569 mse 0.2745 t 986 new 0.24) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-14 12:05:00] step 2177/5000 loss 0.3441 (w 0.3569 mse 0.3688 t 986 new 0.19) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +[2026-09-14 12:05:04] step 2178/5000 loss 0.2774 (w 0.2403 mse 0.2274 t 698 new 0.27) lr 1.00e-05 gnorm 0.185 3.34s mem 81.1GB +[2026-09-14 12:05:07] step 2179/5000 loss 0.2192 (w 0.3851 mse 0.3652 t 978 new 0.19) lr 1.00e-05 gnorm 0.224 3.47s mem 81.1GB +[2026-09-14 12:05:11] step 2180/5000 loss 0.2537 (w 0.4154 mse 0.4096 t 976 new 0.21) lr 1.00e-05 gnorm 0.838 3.39s mem 81.1GB +[2026-09-14 12:05:14] step 2181/5000 loss 0.2572 (w 0.2258 mse 0.2243 t 404 new 0.21) lr 1.00e-05 gnorm 0.165 3.74s mem 81.1GB +[2026-09-14 12:05:17] step 2182/5000 loss 0.2209 (w 0.4747 mse 0.4747 t 177 new 0.00) lr 1.00e-05 gnorm 0.117 2.91s mem 81.1GB +[2026-09-14 12:05:20] step 2183/5000 loss 0.2621 (w 0.3171 mse 0.3013 t 904 new 0.09) lr 1.00e-05 gnorm 0.177 3.01s mem 81.1GB +[2026-09-14 12:05:24] step 2184/5000 loss 0.1231 (w 0.4180 mse 0.3939 t 986 new 0.17) lr 1.00e-05 gnorm 0.165 3.60s mem 81.1GB +[2026-09-14 12:05:27] step 2185/5000 loss 0.1343 (w 0.2073 mse 0.2024 t 880 new 0.24) lr 1.00e-05 gnorm 0.182 3.38s mem 81.1GB +[2026-09-14 12:05:31] step 2186/5000 loss 0.2640 (w 0.3384 mse 0.3212 t 927 new 0.23) lr 1.00e-05 gnorm 0.212 3.27s mem 81.1GB +[2026-09-14 12:05:34] step 2187/5000 loss 0.2176 (w 0.2416 mse 0.2304 t 915 new 0.22) lr 1.00e-05 gnorm 0.167 3.54s mem 81.1GB +[2026-09-14 12:05:37] step 2188/5000 loss 0.2651 (w 0.2495 mse 0.2293 t 972 new 0.15) lr 1.00e-05 gnorm 0.115 2.97s mem 81.1GB +[2026-09-14 12:05:40] step 2189/5000 loss 0.2771 (w 0.2434 mse 0.2373 t 590 new 0.11) lr 1.00e-05 gnorm 0.154 2.97s mem 81.1GB +[2026-09-14 12:05:44] step 2190/5000 loss 0.3442 (w 0.3675 mse 0.3632 t 383 new 0.18) lr 1.00e-05 gnorm 0.296 3.41s mem 81.1GB +[2026-09-14 12:05:47] step 2191/5000 loss 0.1976 (w 0.1520 mse 0.1481 t 897 new 0.14) lr 1.00e-05 gnorm 0.191 3.31s mem 81.1GB +[2026-09-14 12:05:51] step 2192/5000 loss 0.1535 (w 0.1973 mse 0.1921 t 799 new 0.17) lr 1.00e-05 gnorm 0.151 3.49s mem 81.1GB +[2026-09-14 12:05:54] step 2193/5000 loss 0.3666 (w 0.3099 mse 0.2944 t 660 new 0.23) lr 1.00e-05 gnorm 0.379 3.44s mem 81.1GB +[2026-09-14 12:05:57] step 2194/5000 loss 0.1574 (w 0.2083 mse 0.2071 t 966 new 0.24) lr 1.00e-05 gnorm 0.281 2.93s mem 81.1GB +[2026-09-14 12:06:00] step 2195/5000 loss 0.3390 (w 0.2449 mse 0.2377 t 854 new 0.14) lr 1.00e-05 gnorm 0.308 2.97s mem 81.1GB +[2026-09-14 12:06:03] step 2196/5000 loss 0.0558 (w 0.2774 mse 0.2734 t 982 new 0.26) lr 1.00e-05 gnorm 0.162 3.62s mem 81.1GB +[2026-09-14 12:06:08] step 2197/5000 loss 0.3158 (w 0.2829 mse 0.2628 t 876 new 0.16) lr 1.00e-05 gnorm 0.185 4.18s mem 81.1GB +[2026-09-14 12:06:11] step 2198/5000 loss 0.1448 (w 0.3494 mse 0.3488 t 989 new 0.19) lr 1.00e-05 gnorm 0.146 3.19s mem 81.1GB +[2026-09-14 12:06:14] step 2199/5000 loss 0.2315 (w 0.1957 mse 0.1972 t 935 new 0.17) lr 1.00e-05 gnorm 0.200 3.15s mem 81.1GB +[2026-09-14 12:06:17] step 2200/5000 loss 0.2559 (w 0.3543 mse 0.3206 t 950 new 0.20) lr 1.00e-05 gnorm 0.166 2.87s mem 81.1GB +[2026-09-14 12:06:20] step 2201/5000 loss 0.2521 (w 0.2609 mse 0.2475 t 935 new 0.19) lr 1.00e-05 gnorm 0.143 2.86s mem 81.1GB +[2026-09-14 12:06:24] step 2202/5000 loss 0.2124 (w 0.2438 mse 0.2336 t 874 new 0.19) lr 1.00e-05 gnorm 0.333 3.44s mem 81.1GB +[2026-09-14 12:06:27] step 2203/5000 loss 0.1824 (w 0.1889 mse 0.1781 t 852 new 0.22) lr 1.00e-05 gnorm 0.123 3.06s mem 81.1GB +[2026-09-14 12:06:30] step 2204/5000 loss 0.2346 (w 0.2189 mse 0.2059 t 977 new 0.26) lr 1.00e-05 gnorm 0.559 3.23s mem 81.1GB +[2026-09-14 12:06:33] step 2205/5000 loss 0.2741 (w 0.2654 mse 0.2574 t 695 new 0.24) lr 1.00e-05 gnorm 0.135 3.36s mem 81.1GB +[2026-09-14 12:06:36] step 2206/5000 loss 0.2063 (w 0.2270 mse 0.2105 t 958 new 0.16) lr 1.00e-05 gnorm 0.587 3.09s mem 81.1GB +[2026-09-14 12:06:40] step 2207/5000 loss 0.2434 (w 0.2637 mse 0.2770 t 956 new 0.19) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +[2026-09-14 12:06:43] step 2208/5000 loss 0.2038 (w 0.2485 mse 0.2388 t 946 new 0.24) lr 1.00e-05 gnorm 0.315 3.64s mem 81.1GB +[2026-09-14 12:06:50] step 2209/5000 loss 0.1862 (w 0.2519 mse 0.2458 t 903 new 0.20) lr 1.00e-05 gnorm 0.149 6.95s mem 81.1GB +[2026-09-14 12:06:59] step 2210/5000 loss 0.1805 (w 0.2707 mse 0.2645 t 980 new 0.12) lr 1.00e-05 gnorm 0.133 8.30s mem 81.1GB +[2026-09-14 12:07:06] step 2211/5000 loss 0.2801 (w 0.1919 mse 0.1859 t 860 new 0.10) lr 1.00e-05 gnorm 0.175 7.61s mem 81.1GB +[2026-09-14 12:07:14] step 2212/5000 loss 0.2947 (w 0.2145 mse 0.2008 t 952 new 0.14) lr 1.00e-05 gnorm 0.221 7.76s mem 81.1GB +[2026-09-14 12:07:22] step 2213/5000 loss 0.2344 (w 0.2177 mse 0.2160 t 852 new 0.18) lr 1.00e-05 gnorm 0.149 8.34s mem 81.1GB +[2026-09-14 12:07:30] step 2214/5000 loss 0.2520 (w 0.2756 mse 0.2690 t 988 new 0.15) lr 1.00e-05 gnorm 0.148 8.14s mem 81.1GB +[2026-09-14 12:07:35] step 2215/5000 loss 0.2338 (w 0.1779 mse 0.1780 t 706 new 0.21) lr 1.00e-05 gnorm 0.156 5.05s mem 81.1GB +[2026-09-14 12:07:39] step 2216/5000 loss 0.0984 (w 0.3670 mse 0.3567 t 985 new 0.21) lr 1.00e-05 gnorm 0.359 3.47s mem 81.1GB +[2026-09-14 12:07:42] step 2217/5000 loss 0.1844 (w 0.2699 mse 0.2525 t 917 new 0.12) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +[2026-09-14 12:07:45] step 2218/5000 loss 0.3092 (w 0.2247 mse 0.2290 t 988 new 0.19) lr 1.00e-05 gnorm 0.186 2.86s mem 81.1GB +[2026-09-14 12:07:48] step 2219/5000 loss 0.2929 (w 0.2686 mse 0.2625 t 933 new 0.16) lr 1.00e-05 gnorm 0.333 3.36s mem 81.1GB +[2026-09-14 12:07:51] step 2220/5000 loss 0.3336 (w 0.1673 mse 0.1688 t 976 new 0.25) lr 1.00e-05 gnorm 0.160 3.19s mem 81.1GB +[2026-09-14 12:07:55] step 2221/5000 loss 0.2620 (w 0.2574 mse 0.2399 t 957 new 0.27) lr 1.00e-05 gnorm 0.314 3.07s mem 81.1GB +[2026-09-14 12:07:58] step 2222/5000 loss 0.1824 (w 0.1166 mse 0.1254 t 908 new 0.15) lr 1.00e-05 gnorm 0.204 3.52s mem 81.1GB +[2026-09-14 12:08:01] step 2223/5000 loss 0.2270 (w 0.0974 mse 0.1086 t 692 new 0.21) lr 1.00e-05 gnorm 0.148 3.32s mem 81.1GB +[2026-09-14 12:08:04] step 2224/5000 loss 0.2818 (w 0.5583 mse 0.5650 t 159 new 0.16) lr 1.00e-05 gnorm 0.143 3.04s mem 81.1GB +[2026-09-14 12:08:08] step 2225/5000 loss 0.1543 (w 0.2835 mse 0.2673 t 936 new 0.20) lr 1.00e-05 gnorm 0.136 3.70s mem 81.1GB +[2026-09-14 12:08:12] step 2226/5000 loss 0.2869 (w 0.3314 mse 0.3208 t 980 new 0.24) lr 1.00e-05 gnorm 0.216 3.42s mem 81.1GB +[2026-09-14 12:08:15] step 2227/5000 loss 0.3394 (w 0.1209 mse 0.1300 t 845 new 0.24) lr 1.00e-05 gnorm 0.145 3.26s mem 81.1GB +[2026-09-14 12:08:18] step 2228/5000 loss 0.2349 (w 0.1202 mse 0.1193 t 720 new 0.22) lr 1.00e-05 gnorm 0.174 3.55s mem 81.1GB +[2026-09-14 12:08:23] step 2229/5000 loss 0.2174 (w 0.3299 mse 0.3393 t 336 new 0.19) lr 1.00e-05 gnorm 0.215 4.18s mem 81.1GB +[2026-09-14 12:08:27] step 2230/5000 loss 0.2903 (w 0.2416 mse 0.2240 t 809 new 0.23) lr 1.00e-05 gnorm 0.352 4.14s mem 81.1GB +[2026-09-14 12:08:30] step 2231/5000 loss 0.2109 (w 0.1857 mse 0.1781 t 578 new 0.19) lr 1.00e-05 gnorm 0.255 3.70s mem 81.1GB +[2026-09-14 12:08:34] step 2232/5000 loss 0.1234 (w 0.5222 mse 0.4923 t 989 new 0.17) lr 1.00e-05 gnorm 0.133 3.37s mem 81.1GB +[2026-09-14 12:08:37] step 2233/5000 loss 0.2348 (w 0.2712 mse 0.2556 t 838 new 0.23) lr 1.00e-05 gnorm 0.123 3.54s mem 81.1GB +[2026-09-14 12:08:41] step 2234/5000 loss 0.1314 (w 0.1721 mse 0.1881 t 986 new 0.21) lr 1.00e-05 gnorm 0.145 3.79s mem 81.1GB +[2026-09-14 12:08:45] step 2235/5000 loss 0.2558 (w 0.3339 mse 0.3186 t 926 new 0.20) lr 1.00e-05 gnorm 0.139 4.34s mem 81.1GB +[2026-09-14 12:08:50] step 2236/5000 loss 0.2289 (w 0.1348 mse 0.1380 t 841 new 0.21) lr 1.00e-05 gnorm 0.185 4.18s mem 81.1GB +[2026-09-14 12:08:53] step 2237/5000 loss 0.4080 (w 0.2400 mse 0.2387 t 866 new 0.13) lr 1.00e-05 gnorm 0.156 3.73s mem 81.1GB +[2026-09-14 12:08:57] step 2238/5000 loss 0.1451 (w 0.2022 mse 0.2207 t 996 new 0.20) lr 1.00e-05 gnorm 0.126 3.19s mem 81.1GB +[2026-09-14 12:09:00] step 2239/5000 loss 0.3457 (w 0.1260 mse 0.1273 t 819 new 0.05) lr 1.00e-05 gnorm 0.236 3.18s mem 81.1GB +[2026-09-14 12:09:03] step 2240/5000 loss 0.2035 (w 0.3813 mse 0.3826 t 408 new 0.18) lr 1.00e-05 gnorm 0.097 3.07s mem 81.1GB +[2026-09-14 12:09:06] step 2241/5000 loss 0.1649 (w 0.1880 mse 0.1902 t 887 new 0.22) lr 1.00e-05 gnorm 0.222 2.85s mem 81.1GB +[2026-09-14 12:09:09] step 2242/5000 loss 0.2312 (w 0.1390 mse 0.1388 t 928 new 0.01) lr 1.00e-05 gnorm 0.356 3.56s mem 81.1GB +[2026-09-14 12:09:13] step 2243/5000 loss 0.1864 (w 0.3158 mse 0.3036 t 847 new 0.18) lr 1.00e-05 gnorm 0.170 3.42s mem 81.1GB +[2026-09-14 12:09:16] step 2244/5000 loss 0.3314 (w 0.3785 mse 0.3681 t 379 new 0.22) lr 1.00e-05 gnorm 0.163 3.19s mem 81.1GB +[2026-09-14 12:09:19] step 2245/5000 loss 0.2290 (w 0.2579 mse 0.2636 t 897 new 0.17) lr 1.00e-05 gnorm 0.220 3.37s mem 81.1GB +[2026-09-14 12:09:22] step 2246/5000 loss 0.2229 (w 0.2414 mse 0.2159 t 930 new 0.22) lr 1.00e-05 gnorm 0.190 3.10s mem 81.1GB +[2026-09-14 12:09:25] step 2247/5000 loss 0.2916 (w 0.2904 mse 0.2834 t 918 new 0.11) lr 1.00e-05 gnorm 0.401 2.84s mem 81.1GB +[2026-09-14 12:09:28] step 2248/5000 loss 0.1307 (w 0.1989 mse 0.1966 t 948 new 0.14) lr 1.00e-05 gnorm 0.137 3.12s mem 81.1GB +[2026-09-14 12:09:32] step 2249/5000 loss 0.2625 (w 0.2698 mse 0.2462 t 928 new 0.21) lr 1.00e-05 gnorm 0.199 3.38s mem 81.1GB +[2026-09-14 12:09:35] step 2250/5000 loss 0.2321 (w 0.2294 mse 0.2054 t 886 new 0.18) lr 1.00e-05 gnorm 0.270 2.85s mem 81.1GB +[2026-09-14 12:09:38] step 2251/5000 loss 0.2543 (w 0.2453 mse 0.2474 t 982 new 0.23) lr 1.00e-05 gnorm 0.299 3.42s mem 81.1GB +[2026-09-14 12:09:41] step 2252/5000 loss 0.1024 (w 0.1535 mse 0.1718 t 983 new 0.17) lr 1.00e-05 gnorm 0.138 3.08s mem 81.1GB +[2026-09-14 12:09:44] step 2253/5000 loss 0.2179 (w 0.1107 mse 0.1135 t 628 new 0.11) lr 1.00e-05 gnorm 0.156 2.86s mem 81.1GB +[2026-09-14 12:09:47] step 2254/5000 loss 0.3132 (w 0.2976 mse 0.2915 t 609 new 0.22) lr 1.00e-05 gnorm 0.241 3.10s mem 81.1GB +[2026-09-14 12:09:51] step 2255/5000 loss 0.3434 (w 0.1216 mse 0.1226 t 742 new 0.10) lr 1.00e-05 gnorm 0.191 3.32s mem 81.1GB +[2026-09-14 12:09:53] step 2256/5000 loss 0.3698 (w 0.2869 mse 0.2796 t 978 new 0.24) lr 1.00e-05 gnorm 0.149 2.85s mem 81.1GB +[2026-09-14 12:09:57] step 2257/5000 loss 0.1798 (w 0.2676 mse 0.2759 t 961 new 0.15) lr 1.00e-05 gnorm 0.200 3.42s mem 81.1GB +[2026-09-14 12:10:00] step 2258/5000 loss 0.1603 (w 0.1517 mse 0.1540 t 798 new 0.15) lr 1.00e-05 gnorm 0.856 3.09s mem 81.1GB +[2026-09-14 12:10:03] step 2259/5000 loss 0.3586 (w 0.1891 mse 0.1855 t 824 new 0.25) lr 1.00e-05 gnorm 0.151 2.86s mem 81.1GB +[2026-09-14 12:10:06] step 2260/5000 loss 0.1848 (w 0.2811 mse 0.2645 t 675 new 0.23) lr 1.00e-05 gnorm 0.324 3.42s mem 81.1GB +[2026-09-14 12:10:09] step 2261/5000 loss 0.1789 (w 0.1814 mse 0.1930 t 819 new 0.13) lr 1.00e-05 gnorm 0.131 3.30s mem 81.1GB +[2026-09-14 12:10:12] step 2262/5000 loss 0.2589 (w 0.2604 mse 0.2434 t 819 new 0.28) lr 1.00e-05 gnorm 0.238 2.85s mem 81.1GB +[2026-09-14 12:10:15] step 2263/5000 loss 0.1224 (w 0.1389 mse 0.1295 t 895 new 0.24) lr 1.00e-05 gnorm 0.209 3.12s mem 81.1GB +[2026-09-14 12:10:19] step 2264/5000 loss 0.2842 (w 0.3512 mse 0.3501 t 976 new 0.20) lr 1.00e-05 gnorm 0.182 3.07s mem 81.1GB +[2026-09-14 12:10:21] step 2265/5000 loss 0.2636 (w 0.4793 mse 0.4740 t 997 new 0.22) lr 1.00e-05 gnorm 0.323 2.84s mem 81.1GB +[2026-09-14 12:10:25] step 2266/5000 loss 0.3019 (w 0.4180 mse 0.4140 t 323 new 0.25) lr 1.00e-05 gnorm 0.176 3.51s mem 81.1GB +[2026-09-14 12:10:28] step 2267/5000 loss 0.1875 (w 0.1881 mse 0.1831 t 979 new 0.20) lr 1.00e-05 gnorm 0.200 3.14s mem 81.1GB +[2026-09-14 12:10:31] step 2268/5000 loss 0.2397 (w 0.1891 mse 0.1834 t 884 new 0.20) lr 1.00e-05 gnorm 0.204 3.04s mem 81.1GB +[2026-09-14 12:10:35] step 2269/5000 loss 0.2057 (w 0.2932 mse 0.2746 t 911 new 0.27) lr 1.00e-05 gnorm 0.224 3.12s mem 81.1GB +[2026-09-14 12:10:38] step 2270/5000 loss 0.2929 (w 0.0699 mse 0.0771 t 653 new 0.16) lr 1.00e-05 gnorm 0.173 3.11s mem 81.1GB +[2026-09-14 12:10:40] step 2271/5000 loss 0.2409 (w 0.2265 mse 0.2181 t 876 new 0.22) lr 1.00e-05 gnorm 0.144 2.85s mem 81.1GB +[2026-09-14 12:10:44] step 2272/5000 loss 0.1987 (w 0.2840 mse 0.2595 t 943 new 0.25) lr 1.00e-05 gnorm 0.139 3.40s mem 81.1GB +[2026-09-14 12:10:47] step 2273/5000 loss 0.3291 (w 0.3222 mse 0.3140 t 994 new 0.21) lr 1.00e-05 gnorm 0.247 3.41s mem 81.1GB +[2026-09-14 12:10:50] step 2274/5000 loss 0.1876 (w 0.2483 mse 0.2316 t 883 new 0.21) lr 1.00e-05 gnorm 0.395 3.06s mem 81.1GB +[2026-09-14 12:10:54] step 2275/5000 loss 0.2111 (w 0.1087 mse 0.1213 t 970 new 0.13) lr 1.00e-05 gnorm 0.228 3.15s mem 81.1GB +[2026-09-14 12:10:57] step 2276/5000 loss 0.1826 (w 0.2936 mse 0.2865 t 995 new 0.15) lr 1.00e-05 gnorm 0.173 3.11s mem 81.1GB +[2026-09-14 12:10:59] step 2277/5000 loss 0.3098 (w 0.3706 mse 0.3871 t 340 new 0.23) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +[2026-09-14 12:11:03] step 2278/5000 loss 0.2404 (w 0.2550 mse 0.2529 t 956 new 0.13) lr 1.00e-05 gnorm 0.246 3.43s mem 81.1GB +[2026-09-14 12:11:06] step 2279/5000 loss 0.1858 (w 0.2481 mse 0.2311 t 462 new 0.19) lr 1.00e-05 gnorm 0.195 3.11s mem 81.1GB +[2026-09-14 12:11:09] step 2280/5000 loss 0.2764 (w 0.2932 mse 0.2759 t 749 new 0.20) lr 1.00e-05 gnorm 0.216 3.29s mem 81.1GB +[2026-09-14 12:11:12] step 2281/5000 loss 0.1521 (w 0.3718 mse 0.3673 t 989 new 0.21) lr 1.00e-05 gnorm 0.502 3.14s mem 81.1GB +[2026-09-14 12:11:15] step 2282/5000 loss 0.1422 (w 0.1256 mse 0.1199 t 781 new 0.15) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-14 12:11:18] step 2283/5000 loss 0.3347 (w 0.1752 mse 0.1818 t 937 new 0.21) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +[2026-09-14 12:11:22] step 2284/5000 loss 0.1329 (w 0.3118 mse 0.3025 t 962 new 0.20) lr 1.00e-05 gnorm 0.237 3.51s mem 81.1GB +[2026-09-14 12:11:25] step 2285/5000 loss 0.1368 (w 0.1769 mse 0.1702 t 873 new 0.24) lr 1.00e-05 gnorm 0.273 3.16s mem 81.1GB +[2026-09-14 12:11:28] step 2286/5000 loss 0.4252 (w 0.3972 mse 0.3981 t 319 new 0.15) lr 1.00e-05 gnorm 0.205 3.32s mem 81.1GB +[2026-09-14 12:11:32] step 2287/5000 loss 0.2467 (w 0.3825 mse 0.3747 t 994 new 0.17) lr 1.00e-05 gnorm 0.163 3.37s mem 81.1GB +[2026-09-14 12:11:34] step 2288/5000 loss 0.2399 (w 0.2367 mse 0.2271 t 880 new 0.13) lr 1.00e-05 gnorm 0.140 2.86s mem 81.1GB +[2026-09-14 12:11:38] step 2289/5000 loss 0.3977 (w 0.2041 mse 0.2001 t 950 new 0.20) lr 1.00e-05 gnorm 0.165 3.22s mem 81.1GB +[2026-09-14 12:11:41] step 2290/5000 loss 0.2913 (w 0.2647 mse 0.2746 t 476 new 0.28) lr 1.00e-05 gnorm 0.162 3.40s mem 81.1GB +[2026-09-14 12:11:44] step 2291/5000 loss 0.3197 (w 0.6406 mse 0.6399 t 992 new 0.21) lr 1.00e-05 gnorm 0.144 3.11s mem 81.1GB +[2026-09-14 12:11:48] step 2292/5000 loss 0.1947 (w 0.1382 mse 0.1312 t 845 new 0.23) lr 1.00e-05 gnorm 0.167 3.53s mem 81.1GB +[2026-09-14 12:11:51] step 2293/5000 loss 0.1850 (w 0.2830 mse 0.2766 t 999 new 0.24) lr 1.00e-05 gnorm 0.188 3.34s mem 81.1GB +[2026-09-14 12:11:54] step 2294/5000 loss 0.2338 (w 0.1042 mse 0.1036 t 586 new 0.20) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +[2026-09-14 12:11:57] step 2295/5000 loss 0.1968 (w 0.2528 mse 0.2415 t 954 new 0.23) lr 1.00e-05 gnorm 0.248 3.21s mem 81.1GB +[2026-09-14 12:12:00] step 2296/5000 loss 0.1461 (w 0.4127 mse 0.4034 t 982 new 0.21) lr 1.00e-05 gnorm 0.161 3.10s mem 81.1GB +[2026-09-14 12:12:03] step 2297/5000 loss 0.1559 (w 0.1924 mse 0.1944 t 746 new 0.23) lr 1.00e-05 gnorm 0.133 2.86s mem 81.1GB +[2026-09-14 12:12:07] step 2298/5000 loss 0.2357 (w 0.2131 mse 0.2151 t 902 new 0.25) lr 1.00e-05 gnorm 0.224 3.38s mem 81.1GB +[2026-09-14 12:12:10] step 2299/5000 loss 0.2551 (w 0.1341 mse 0.1450 t 528 new 0.23) lr 1.00e-05 gnorm 0.494 3.12s mem 81.1GB +[2026-09-14 12:12:13] step 2300/5000 loss 0.1970 (w 0.3988 mse 0.3721 t 996 new 0.24) lr 1.00e-05 gnorm 0.187 2.85s mem 81.1GB +[2026-09-14 12:12:16] step 2301/5000 loss 0.1627 (w 0.1728 mse 0.1745 t 898 new 0.12) lr 1.00e-05 gnorm 0.129 3.20s mem 81.1GB +[2026-09-14 12:12:19] step 2302/5000 loss 0.2483 (w 0.2928 mse 0.2765 t 948 new 0.26) lr 1.00e-05 gnorm 0.185 3.11s mem 81.1GB +[2026-09-14 12:12:22] step 2303/5000 loss 0.3316 (w 0.2450 mse 0.2494 t 490 new 0.14) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +[2026-09-14 12:12:25] step 2304/5000 loss 0.4296 (w 0.2474 mse 0.2425 t 516 new 0.12) lr 1.00e-05 gnorm 0.176 3.38s mem 81.1GB +[2026-09-14 12:12:28] step 2305/5000 loss 0.1450 (w 0.2359 mse 0.2178 t 808 new 0.22) lr 1.00e-05 gnorm 0.147 3.05s mem 81.1GB +[2026-09-14 12:12:31] step 2306/5000 loss 0.2284 (w 0.1497 mse 0.1438 t 897 new 0.18) lr 1.00e-05 gnorm 0.169 2.85s mem 81.1GB +[2026-09-14 12:12:34] step 2307/5000 loss 0.1669 (w 0.2126 mse 0.2125 t 958 new 0.19) lr 1.00e-05 gnorm 0.430 3.17s mem 81.1GB +[2026-09-14 12:12:37] step 2308/5000 loss 0.2520 (w 0.2222 mse 0.2038 t 900 new 0.22) lr 1.00e-05 gnorm 0.170 3.10s mem 81.1GB +[2026-09-14 12:12:40] step 2309/5000 loss 0.1616 (w 0.1885 mse 0.1884 t 904 new 0.20) lr 1.00e-05 gnorm 0.487 2.85s mem 81.1GB +[2026-09-14 12:12:44] step 2310/5000 loss 0.1898 (w 0.1964 mse 0.1852 t 568 new 0.16) lr 1.00e-05 gnorm 0.249 3.41s mem 81.1GB +[2026-09-14 12:12:47] step 2311/5000 loss 0.3361 (w 0.2248 mse 0.2262 t 639 new 0.18) lr 1.00e-05 gnorm 0.202 3.08s mem 81.1GB +[2026-09-14 12:12:50] step 2312/5000 loss 0.2276 (w 0.1485 mse 0.1530 t 907 new 0.13) lr 1.00e-05 gnorm 0.197 2.84s mem 81.1GB +[2026-09-14 12:12:53] step 2313/5000 loss 0.2838 (w 0.2611 mse 0.2614 t 960 new 0.22) lr 1.00e-05 gnorm 0.237 3.36s mem 81.1GB +[2026-09-14 12:12:56] step 2314/5000 loss 0.1670 (w 0.3007 mse 0.2843 t 942 new 0.20) lr 1.00e-05 gnorm 0.179 3.30s mem 81.1GB +[2026-09-14 12:12:59] step 2315/5000 loss 0.2393 (w 0.2139 mse 0.2077 t 503 new 0.11) lr 1.00e-05 gnorm 0.148 3.11s mem 81.1GB +[2026-09-14 12:13:03] step 2316/5000 loss 0.1457 (w 0.1209 mse 0.1185 t 698 new 0.17) lr 1.00e-05 gnorm 0.150 3.28s mem 81.1GB +[2026-09-14 12:13:06] step 2317/5000 loss 0.3538 (w 0.2807 mse 0.2774 t 992 new 0.10) lr 1.00e-05 gnorm 0.786 3.14s mem 81.1GB +[2026-09-14 12:13:09] step 2318/5000 loss 0.2919 (w 0.3854 mse 0.3810 t 980 new 0.14) lr 1.00e-05 gnorm 0.201 2.85s mem 81.1GB +[2026-09-14 12:13:12] step 2319/5000 loss 0.2091 (w 0.2059 mse 0.1949 t 922 new 0.21) lr 1.00e-05 gnorm 0.136 3.35s mem 81.1GB +[2026-09-14 12:13:16] step 2320/5000 loss 0.2431 (w 0.2036 mse 0.1970 t 867 new 0.17) lr 1.00e-05 gnorm 0.181 3.40s mem 81.1GB +[2026-09-14 12:13:19] step 2321/5000 loss 0.3469 (w 0.1706 mse 0.1713 t 865 new 0.22) lr 1.00e-05 gnorm 0.353 3.18s mem 81.1GB +[2026-09-14 12:13:22] step 2322/5000 loss 0.0711 (w 0.2019 mse 0.2005 t 967 new 0.21) lr 1.00e-05 gnorm 0.132 3.35s mem 81.1GB +[2026-09-14 12:13:25] step 2323/5000 loss 0.2103 (w 0.2599 mse 0.2573 t 964 new 0.21) lr 1.00e-05 gnorm 0.163 2.84s mem 81.1GB +[2026-09-14 12:13:28] step 2324/5000 loss 0.2396 (w 0.2112 mse 0.1972 t 636 new 0.21) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +[2026-09-14 12:13:31] step 2325/5000 loss 0.1438 (w 0.3235 mse 0.3259 t 979 new 0.20) lr 1.00e-05 gnorm 1.318 3.39s mem 81.1GB +[2026-09-14 12:13:34] step 2326/5000 loss 0.3435 (w 0.1345 mse 0.1259 t 805 new 0.21) lr 1.00e-05 gnorm 0.140 3.11s mem 81.1GB +[2026-09-14 12:13:38] step 2327/5000 loss 0.5162 (w 0.3639 mse 0.3668 t 297 new 0.20) lr 1.00e-05 gnorm 0.140 3.35s mem 81.1GB +[2026-09-14 12:13:41] step 2328/5000 loss 0.2670 (w 0.2265 mse 0.2236 t 930 new 0.16) lr 1.00e-05 gnorm 0.161 3.28s mem 81.1GB +[2026-09-14 12:13:44] step 2329/5000 loss 0.2697 (w 0.1523 mse 0.1594 t 993 new 0.18) lr 1.00e-05 gnorm 0.184 2.84s mem 81.1GB +[2026-09-14 12:13:47] step 2330/5000 loss 0.2421 (w 0.2698 mse 0.2643 t 866 new 0.28) lr 1.00e-05 gnorm 0.150 3.18s mem 81.1GB +[2026-09-14 12:13:50] step 2331/5000 loss 0.2082 (w 0.1858 mse 0.1870 t 860 new 0.22) lr 1.00e-05 gnorm 0.138 3.10s mem 81.1GB +[2026-09-14 12:13:53] step 2332/5000 loss 0.1507 (w 0.1918 mse 0.1779 t 757 new 0.25) lr 1.00e-05 gnorm 0.114 3.13s mem 81.1GB +[2026-09-14 12:13:57] step 2333/5000 loss 0.2041 (w 0.2328 mse 0.2332 t 889 new 0.19) lr 1.00e-05 gnorm 0.142 3.45s mem 81.1GB +[2026-09-14 12:14:00] step 2334/5000 loss 0.2637 (w 0.2174 mse 0.2178 t 508 new 0.24) lr 1.00e-05 gnorm 0.604 3.40s mem 81.1GB +[2026-09-14 12:14:03] step 2335/5000 loss 0.1489 (w 0.2385 mse 0.2297 t 942 new 0.21) lr 1.00e-05 gnorm 0.170 2.85s mem 81.1GB +[2026-09-14 12:14:06] step 2336/5000 loss 0.2582 (w 0.1436 mse 0.1409 t 855 new 0.11) lr 1.00e-05 gnorm 0.132 3.12s mem 81.1GB +[2026-09-14 12:14:09] step 2337/5000 loss 0.1931 (w 0.3190 mse 0.3143 t 974 new 0.21) lr 1.00e-05 gnorm 0.197 3.28s mem 81.1GB +[2026-09-14 12:14:12] step 2338/5000 loss 0.3051 (w 0.0932 mse 0.0951 t 603 new 0.13) lr 1.00e-05 gnorm 0.142 3.11s mem 81.1GB +[2026-09-14 12:14:16] step 2339/5000 loss 0.1654 (w 0.1399 mse 0.1412 t 705 new 0.16) lr 1.00e-05 gnorm 0.779 3.35s mem 81.1GB +[2026-09-14 12:14:19] step 2340/5000 loss 0.2210 (w 0.2242 mse 0.2122 t 953 new 0.26) lr 1.00e-05 gnorm 0.186 3.16s mem 81.1GB +[2026-09-14 12:14:22] step 2341/5000 loss 0.3060 (w 0.2038 mse 0.1950 t 886 new 0.20) lr 1.00e-05 gnorm 0.193 2.84s mem 81.1GB +[2026-09-14 12:14:25] step 2342/5000 loss 0.1243 (w 0.1879 mse 0.1825 t 979 new 0.26) lr 1.00e-05 gnorm 0.168 3.19s mem 81.1GB +[2026-09-14 12:14:28] step 2343/5000 loss 0.2195 (w 0.1684 mse 0.1587 t 873 new 0.19) lr 1.00e-05 gnorm 1.659 3.36s mem 81.1GB +[2026-09-14 12:14:31] step 2344/5000 loss 0.2882 (w 0.2187 mse 0.2195 t 918 new 0.22) lr 1.00e-05 gnorm 0.234 2.85s mem 81.1GB +[2026-09-14 12:14:35] step 2345/5000 loss 0.2961 (w 0.2285 mse 0.2207 t 901 new 0.20) lr 1.00e-05 gnorm 0.302 3.39s mem 81.1GB +[2026-09-14 12:14:38] step 2346/5000 loss 0.1465 (w 0.1877 mse 0.1916 t 893 new 0.22) lr 1.00e-05 gnorm 0.130 3.08s mem 81.1GB +[2026-09-14 12:14:41] step 2347/5000 loss 0.3060 (w 0.3389 mse 0.3299 t 269 new 0.22) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +[2026-09-14 12:14:44] step 2348/5000 loss 0.2840 (w 0.2161 mse 0.2043 t 662 new 0.19) lr 1.00e-05 gnorm 0.231 3.19s mem 81.1GB +[2026-09-14 12:14:47] step 2349/5000 loss 0.2123 (w 0.2511 mse 0.2486 t 925 new 0.18) lr 1.00e-05 gnorm 0.294 3.34s mem 81.1GB +[2026-09-14 12:14:50] step 2350/5000 loss 0.1210 (w 0.2757 mse 0.2693 t 876 new 0.21) lr 1.00e-05 gnorm 0.223 3.13s mem 81.1GB +[2026-09-14 12:14:53] step 2351/5000 loss 0.3214 (w 0.4166 mse 0.3999 t 992 new 0.21) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +[2026-09-14 12:14:56] step 2352/5000 loss 0.1982 (w 0.3490 mse 0.3203 t 895 new 0.22) lr 1.00e-05 gnorm 0.183 3.13s mem 81.1GB +[2026-09-14 12:14:59] step 2353/5000 loss 0.2698 (w 0.1269 mse 0.1181 t 894 new 0.21) lr 1.00e-05 gnorm 0.209 2.84s mem 81.1GB +[2026-09-14 12:15:03] step 2354/5000 loss 0.1254 (w 0.1429 mse 0.1410 t 610 new 0.25) lr 1.00e-05 gnorm 0.149 3.41s mem 81.1GB +[2026-09-14 12:15:06] step 2355/5000 loss 0.3495 (w 0.2087 mse 0.2076 t 672 new 0.24) lr 1.00e-05 gnorm 0.146 3.13s mem 81.1GB +[2026-09-14 12:15:09] step 2356/5000 loss 0.1794 (w 0.2638 mse 0.2441 t 910 new 0.28) lr 1.00e-05 gnorm 0.153 3.17s mem 81.1GB +[2026-09-14 12:15:12] step 2357/5000 loss 0.3006 (w 0.3411 mse 0.3417 t 264 new 0.01) lr 1.00e-05 gnorm 0.143 3.28s mem 81.1GB +[2026-09-14 12:15:15] step 2358/5000 loss 0.1678 (w 0.3223 mse 0.3264 t 996 new 0.23) lr 1.00e-05 gnorm 0.221 2.84s mem 81.1GB +[2026-09-14 12:15:18] step 2359/5000 loss 0.3214 (w 0.3162 mse 0.3203 t 421 new 0.18) lr 1.00e-05 gnorm 0.208 2.83s mem 81.1GB +[2026-09-14 12:15:21] step 2360/5000 loss 0.2166 (w 0.2509 mse 0.2361 t 854 new 0.29) lr 1.00e-05 gnorm 0.226 3.36s mem 81.1GB +[2026-09-14 12:15:25] step 2361/5000 loss 0.1950 (w 0.1840 mse 0.1761 t 726 new 0.09) lr 1.00e-05 gnorm 0.366 3.13s mem 81.1GB +[2026-09-14 12:15:28] step 2362/5000 loss 0.1930 (w 0.3214 mse 0.3202 t 973 new 0.16) lr 1.00e-05 gnorm 0.139 3.15s mem 81.1GB +[2026-09-14 12:15:31] step 2363/5000 loss 0.2666 (w 0.1719 mse 0.1614 t 770 new 0.21) lr 1.00e-05 gnorm 0.222 3.36s mem 81.1GB +[2026-09-14 12:15:34] step 2364/5000 loss 0.2490 (w 0.1436 mse 0.1507 t 894 new 0.23) lr 1.00e-05 gnorm 0.170 2.83s mem 81.1GB +[2026-09-14 12:15:37] step 2365/5000 loss 0.2216 (w 0.3635 mse 0.3590 t 979 new 0.25) lr 1.00e-05 gnorm 0.267 3.16s mem 81.1GB +[2026-09-14 12:15:40] step 2366/5000 loss 0.3520 (w 0.2941 mse 0.2932 t 970 new 0.18) lr 1.00e-05 gnorm 0.252 3.06s mem 81.1GB +[2026-09-14 12:15:43] step 2367/5000 loss 0.1653 (w 0.2410 mse 0.2408 t 925 new 0.10) lr 1.00e-05 gnorm 0.154 3.12s mem 81.1GB +[2026-09-14 12:15:47] step 2368/5000 loss 0.1567 (w 0.3098 mse 0.2908 t 921 new 0.16) lr 1.00e-05 gnorm 0.114 3.42s mem 81.1GB +[2026-09-14 12:15:50] step 2369/5000 loss 0.3081 (w 0.2140 mse 0.2044 t 911 new 0.11) lr 1.00e-05 gnorm 0.182 3.09s mem 81.1GB +[2026-09-14 12:15:53] step 2370/5000 loss 0.2493 (w 0.2111 mse 0.1967 t 895 new 0.22) lr 1.00e-05 gnorm 0.146 2.85s mem 81.1GB +[2026-09-14 12:15:56] step 2371/5000 loss 0.3153 (w 0.1676 mse 0.1641 t 733 new 0.24) lr 1.00e-05 gnorm 0.200 3.17s mem 81.1GB +[2026-09-14 12:15:59] step 2372/5000 loss 0.2523 (w 0.2693 mse 0.2574 t 960 new 0.14) lr 1.00e-05 gnorm 0.230 3.10s mem 81.1GB +[2026-09-14 12:16:02] step 2373/5000 loss 0.3377 (w 0.2221 mse 0.2179 t 905 new 0.19) lr 1.00e-05 gnorm 0.365 3.11s mem 81.1GB +[2026-09-14 12:16:05] step 2374/5000 loss 0.4097 (w 0.4456 mse 0.4418 t 165 new 0.23) lr 1.00e-05 gnorm 0.295 3.44s mem 81.1GB +[2026-09-14 12:16:09] step 2375/5000 loss 0.1919 (w 0.4981 mse 0.5073 t 134 new 0.09) lr 1.00e-05 gnorm 0.166 3.09s mem 81.1GB +[2026-09-14 12:16:11] step 2376/5000 loss 0.2341 (w 0.3255 mse 0.3070 t 980 new 0.23) lr 1.00e-05 gnorm 0.170 2.85s mem 81.1GB +[2026-09-14 12:16:15] step 2377/5000 loss 0.2413 (w 0.2458 mse 0.2474 t 994 new 0.20) lr 1.00e-05 gnorm 0.140 3.13s mem 81.1GB +[2026-09-14 12:16:18] step 2378/5000 loss 0.0693 (w 0.1660 mse 0.1674 t 955 new 0.13) lr 1.00e-05 gnorm 0.150 3.34s mem 81.1GB +[2026-09-14 12:16:21] step 2379/5000 loss 0.3907 (w 0.2169 mse 0.2090 t 882 new 0.23) lr 1.00e-05 gnorm 0.208 3.38s mem 81.1GB +[2026-09-14 12:16:24] step 2380/5000 loss 0.2078 (w 0.2623 mse 0.2654 t 966 new 0.15) lr 1.00e-05 gnorm 0.315 2.84s mem 81.1GB +[2026-09-14 12:16:27] step 2381/5000 loss 0.2408 (w 0.2846 mse 0.2677 t 566 new 0.20) lr 1.00e-05 gnorm 0.248 3.13s mem 81.1GB +[2026-09-14 12:16:30] step 2382/5000 loss 0.2869 (w 0.2040 mse 0.1979 t 940 new 0.20) lr 1.00e-05 gnorm 0.141 2.86s mem 81.1GB +[2026-09-14 12:16:33] step 2383/5000 loss 0.2256 (w 0.2590 mse 0.2390 t 953 new 0.15) lr 1.00e-05 gnorm 0.171 3.17s mem 81.1GB +[2026-09-14 12:16:37] step 2384/5000 loss 0.2736 (w 0.2767 mse 0.2536 t 936 new 0.24) lr 1.00e-05 gnorm 0.295 3.34s mem 81.1GB +[2026-09-14 12:16:40] step 2385/5000 loss 0.2631 (w 0.2387 mse 0.2263 t 708 new 0.24) lr 1.00e-05 gnorm 0.460 3.10s mem 81.1GB +[2026-09-14 12:16:43] step 2386/5000 loss 0.1849 (w 0.2625 mse 0.2494 t 908 new 0.25) lr 1.00e-05 gnorm 0.169 3.12s mem 81.1GB +[2026-09-14 12:16:46] step 2387/5000 loss 0.3156 (w 0.3394 mse 0.3430 t 976 new 0.15) lr 1.00e-05 gnorm 0.187 3.15s mem 81.1GB +[2026-09-14 12:16:49] step 2388/5000 loss 0.1531 (w 0.2797 mse 0.2731 t 975 new 0.18) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +[2026-09-14 12:16:52] step 2389/5000 loss 0.2530 (w 0.1658 mse 0.1721 t 612 new 0.13) lr 1.00e-05 gnorm 0.241 3.09s mem 81.1GB +[2026-09-14 12:16:55] step 2390/5000 loss 0.2094 (w 0.1247 mse 0.1262 t 884 new 0.06) lr 1.00e-05 gnorm 0.333 3.31s mem 81.1GB +[2026-09-14 12:16:58] step 2391/5000 loss 0.2243 (w 0.2881 mse 0.2802 t 444 new 0.22) lr 1.00e-05 gnorm 0.200 3.13s mem 81.1GB +[2026-09-14 12:17:02] step 2392/5000 loss 0.2098 (w 0.3518 mse 0.3319 t 965 new 0.25) lr 1.00e-05 gnorm 0.671 3.15s mem 81.1GB +[2026-09-14 12:17:05] step 2393/5000 loss 0.2553 (w 0.2369 mse 0.2046 t 885 new 0.22) lr 1.00e-05 gnorm 0.272 3.06s mem 81.1GB +[2026-09-14 12:17:07] step 2394/5000 loss 0.2441 (w 0.2321 mse 0.2233 t 637 new 0.26) lr 1.00e-05 gnorm 0.163 2.84s mem 81.1GB +[2026-09-14 12:17:11] step 2395/5000 loss 0.4282 (w 0.1951 mse 0.1930 t 737 new 0.22) lr 1.00e-05 gnorm 0.221 3.11s mem 81.1GB +[2026-09-14 12:17:14] step 2396/5000 loss 0.1163 (w 0.1049 mse 0.1087 t 869 new 0.09) lr 1.00e-05 gnorm 0.254 3.38s mem 81.1GB +[2026-09-14 12:17:17] step 2397/5000 loss 0.1488 (w 0.1786 mse 0.1646 t 995 new 0.16) lr 1.00e-05 gnorm 0.202 3.11s mem 81.1GB +[2026-09-14 12:17:20] step 2398/5000 loss 0.2943 (w 0.2037 mse 0.2057 t 633 new 0.25) lr 1.00e-05 gnorm 0.265 3.06s mem 81.1GB +[2026-09-14 12:17:23] step 2399/5000 loss 0.1384 (w 0.2833 mse 0.2875 t 919 new 0.23) lr 1.00e-05 gnorm 0.148 3.12s mem 81.1GB +[2026-09-14 12:17:26] step 2400/5000 loss 0.2552 (w 0.2150 mse 0.2030 t 930 new 0.26) lr 1.00e-05 gnorm 0.637 2.85s mem 81.1GB +[2026-09-14 12:17:30] step 2401/5000 loss 0.3491 (w 0.2816 mse 0.2760 t 942 new 0.22) lr 1.00e-05 gnorm 0.188 3.38s mem 81.1GB +[2026-09-14 12:17:33] step 2402/5000 loss 0.1722 (w 0.2144 mse 0.2099 t 996 new 0.20) lr 1.00e-05 gnorm 1.396 3.36s mem 81.1GB +[2026-09-14 12:17:36] step 2403/5000 loss 0.2381 (w 0.1391 mse 0.1391 t 566 new 0.11) lr 1.00e-05 gnorm 0.273 3.14s mem 81.1GB +[2026-09-14 12:17:40] step 2404/5000 loss 0.2727 (w 0.2485 mse 0.2466 t 447 new 0.21) lr 1.00e-05 gnorm 0.205 3.37s mem 81.1GB +[2026-09-14 12:17:42] step 2405/5000 loss 0.2041 (w 0.2155 mse 0.2054 t 826 new 0.21) lr 1.00e-05 gnorm 0.174 2.85s mem 81.1GB +[2026-09-14 12:17:45] step 2406/5000 loss 0.4668 (w 0.2266 mse 0.2162 t 926 new 0.21) lr 1.00e-05 gnorm 0.304 2.85s mem 81.1GB +[2026-09-14 12:17:49] step 2407/5000 loss 0.1994 (w 0.1418 mse 0.1549 t 959 new 0.24) lr 1.00e-05 gnorm 0.229 3.42s mem 81.1GB +[2026-09-14 12:17:52] step 2408/5000 loss 0.1133 (w 0.0921 mse 0.0989 t 650 new 0.08) lr 1.00e-05 gnorm 0.169 3.12s mem 81.1GB +[2026-09-14 12:17:55] step 2409/5000 loss 0.3212 (w 0.2173 mse 0.2100 t 850 new 0.22) lr 1.00e-05 gnorm 0.210 3.39s mem 81.1GB +[2026-09-14 12:17:58] step 2410/5000 loss 0.2784 (w 0.2472 mse 0.2329 t 751 new 0.17) lr 1.00e-05 gnorm 0.207 3.06s mem 81.1GB +[2026-09-14 12:18:01] step 2411/5000 loss 0.3351 (w 0.2849 mse 0.2654 t 813 new 0.25) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +[2026-09-14 12:18:04] step 2412/5000 loss 0.1961 (w 0.1690 mse 0.1528 t 774 new 0.18) lr 1.00e-05 gnorm 0.159 3.14s mem 81.1GB +[2026-09-14 12:18:07] step 2413/5000 loss 0.2446 (w 0.2290 mse 0.2224 t 741 new 0.21) lr 1.00e-05 gnorm 0.155 3.05s mem 81.1GB +[2026-09-14 12:18:10] step 2414/5000 loss 0.1523 (w 0.1512 mse 0.1497 t 932 new 0.18) lr 1.00e-05 gnorm 0.182 3.12s mem 81.1GB +[2026-09-14 12:18:14] step 2415/5000 loss 0.2054 (w 0.1792 mse 0.2036 t 434 new 0.24) lr 1.00e-05 gnorm 0.162 3.45s mem 81.1GB +[2026-09-14 12:18:17] step 2416/5000 loss 0.2885 (w 0.2130 mse 0.2102 t 945 new 0.22) lr 1.00e-05 gnorm 0.340 3.07s mem 81.1GB +[2026-09-14 12:18:20] step 2417/5000 loss 0.3080 (w 0.3374 mse 0.3330 t 989 new 0.22) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +[2026-09-14 12:18:23] step 2418/5000 loss 0.1456 (w 0.2036 mse 0.2122 t 957 new 0.25) lr 1.00e-05 gnorm 0.369 3.18s mem 81.1GB +[2026-09-14 12:18:26] step 2419/5000 loss 0.1311 (w 0.1688 mse 0.1653 t 898 new 0.14) lr 1.00e-05 gnorm 0.229 3.05s mem 81.1GB +[2026-09-14 12:18:29] step 2420/5000 loss 0.1734 (w 0.3334 mse 0.3261 t 981 new 0.23) lr 1.00e-05 gnorm 0.163 3.13s mem 81.1GB +[2026-09-14 12:18:32] step 2421/5000 loss 0.2621 (w 0.3748 mse 0.3434 t 975 new 0.23) lr 1.00e-05 gnorm 0.163 3.06s mem 81.1GB +[2026-09-14 12:18:36] step 2422/5000 loss 0.1955 (w 0.3087 mse 0.3287 t 978 new 0.21) lr 1.00e-05 gnorm 0.290 3.11s mem 81.1GB +[2026-09-14 12:18:38] step 2423/5000 loss 0.1400 (w 0.2256 mse 0.2129 t 650 new 0.16) lr 1.00e-05 gnorm 0.162 2.86s mem 81.1GB +[2026-09-14 12:18:42] step 2424/5000 loss 0.2489 (w 0.2297 mse 0.2245 t 935 new 0.10) lr 1.00e-05 gnorm 0.913 3.20s mem 81.1GB +[2026-09-14 12:18:45] step 2425/5000 loss 0.0929 (w 0.2359 mse 0.2375 t 907 new 0.16) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +[2026-09-14 12:18:48] step 2426/5000 loss 0.1362 (w 0.1963 mse 0.1945 t 798 new 0.21) lr 1.00e-05 gnorm 0.180 3.61s mem 81.1GB +[2026-09-14 12:18:51] step 2427/5000 loss 0.2171 (w 0.2020 mse 0.2022 t 863 new 0.23) lr 1.00e-05 gnorm 0.775 3.12s mem 81.1GB +[2026-09-14 12:18:55] step 2428/5000 loss 0.3762 (w 0.1352 mse 0.1369 t 747 new 0.28) lr 1.00e-05 gnorm 0.158 3.33s mem 81.1GB +[2026-09-14 12:18:58] step 2429/5000 loss 0.3289 (w 0.2951 mse 0.2577 t 939 new 0.23) lr 1.00e-05 gnorm 0.170 2.84s mem 81.1GB +[2026-09-14 12:19:01] step 2430/5000 loss 0.2665 (w 0.2712 mse 0.2628 t 959 new 0.19) lr 1.00e-05 gnorm 0.150 3.14s mem 81.1GB +[2026-09-14 12:19:04] step 2431/5000 loss 0.2526 (w 0.2092 mse 0.2140 t 940 new 0.22) lr 1.00e-05 gnorm 0.173 3.30s mem 81.1GB +[2026-09-14 12:19:07] step 2432/5000 loss 0.2051 (w 0.1537 mse 0.1508 t 886 new 0.21) lr 1.00e-05 gnorm 0.113 3.20s mem 81.1GB +[2026-09-14 12:19:10] step 2433/5000 loss 0.2437 (w 0.1234 mse 0.1181 t 731 new 0.22) lr 1.00e-05 gnorm 8.180 3.08s mem 81.1GB +[2026-09-14 12:19:14] step 2434/5000 loss 0.2125 (w 0.1772 mse 0.1796 t 870 new 0.22) lr 1.00e-05 gnorm 0.126 3.41s mem 81.1GB +[2026-09-14 12:19:17] step 2435/5000 loss 0.2943 (w 0.3657 mse 0.3735 t 306 new 0.23) lr 1.00e-05 gnorm 0.147 2.85s mem 81.1GB +[2026-09-14 12:19:20] step 2436/5000 loss 0.1470 (w 0.3228 mse 0.3303 t 966 new 0.16) lr 1.00e-05 gnorm 0.123 3.16s mem 81.1GB +[2026-09-14 12:19:23] step 2437/5000 loss 0.2883 (w 0.2364 mse 0.2424 t 859 new 0.11) lr 1.00e-05 gnorm 0.236 3.41s mem 81.1GB +[2026-09-14 12:19:26] step 2438/5000 loss 0.2793 (w 0.2508 mse 0.2414 t 892 new 0.21) lr 1.00e-05 gnorm 1.328 3.23s mem 81.1GB +[2026-09-14 12:19:30] step 2439/5000 loss 0.2728 (w 0.2535 mse 0.2509 t 913 new 0.19) lr 1.00e-05 gnorm 0.126 3.30s mem 81.1GB +[2026-09-14 12:19:33] step 2440/5000 loss 0.2015 (w 0.1384 mse 0.1418 t 943 new 0.22) lr 1.00e-05 gnorm 0.210 3.06s mem 81.1GB +[2026-09-14 12:19:36] step 2441/5000 loss 0.3457 (w 0.1182 mse 0.1412 t 969 new 0.21) lr 1.00e-05 gnorm 0.279 3.20s mem 81.1GB +[2026-09-14 12:19:39] step 2442/5000 loss 0.3583 (w 0.2283 mse 0.2347 t 1000 new 0.21) lr 1.00e-05 gnorm 0.178 3.13s mem 81.1GB +[2026-09-14 12:19:42] step 2443/5000 loss 0.1759 (w 0.3292 mse 0.3024 t 961 new 0.20) lr 1.00e-05 gnorm 0.143 3.38s mem 81.1GB +[2026-09-14 12:19:46] step 2444/5000 loss 0.3636 (w 0.2276 mse 0.2204 t 872 new 0.20) lr 1.00e-05 gnorm 0.312 3.31s mem 81.1GB +[2026-09-14 12:19:49] step 2445/5000 loss 0.2135 (w 0.1786 mse 0.1659 t 802 new 0.18) lr 1.00e-05 gnorm 0.160 3.29s mem 81.1GB +[2026-09-14 12:19:52] step 2446/5000 loss 0.2923 (w 0.2348 mse 0.2399 t 896 new 0.19) lr 1.00e-05 gnorm 0.945 3.10s mem 81.1GB +[2026-09-14 12:19:55] step 2447/5000 loss 0.2121 (w 0.3326 mse 0.3102 t 962 new 0.26) lr 1.00e-05 gnorm 0.138 3.20s mem 81.1GB +[2026-09-14 12:19:58] step 2448/5000 loss 0.2982 (w 0.3835 mse 0.4003 t 183 new 0.22) lr 1.00e-05 gnorm 0.142 3.03s mem 81.1GB +[2026-09-14 12:20:02] step 2449/5000 loss 0.1875 (w 0.1889 mse 0.1829 t 862 new 0.22) lr 1.00e-05 gnorm 0.130 3.31s mem 81.1GB +[2026-09-14 12:20:05] step 2450/5000 loss 0.1413 (w 0.2106 mse 0.2089 t 953 new 0.18) lr 1.00e-05 gnorm 0.182 3.26s mem 81.1GB +[2026-09-14 12:20:08] step 2451/5000 loss 0.2365 (w 0.3098 mse 0.3142 t 428 new 0.26) lr 1.00e-05 gnorm 0.113 3.31s mem 81.1GB +[2026-09-14 12:20:11] step 2452/5000 loss 0.2436 (w 0.1793 mse 0.1800 t 670 new 0.22) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-14 12:20:14] step 2453/5000 loss 0.3100 (w 0.1760 mse 0.1933 t 931 new 0.16) lr 1.00e-05 gnorm 0.340 3.11s mem 81.1GB +[2026-09-14 12:20:17] step 2454/5000 loss 0.2015 (w 0.1499 mse 0.1526 t 968 new 0.23) lr 1.00e-05 gnorm 0.120 3.07s mem 81.1GB +[2026-09-14 12:20:21] step 2455/5000 loss 0.3355 (w 0.3418 mse 0.3337 t 390 new 0.21) lr 1.00e-05 gnorm 0.128 3.35s mem 81.1GB +[2026-09-14 12:20:24] step 2456/5000 loss 0.3279 (w 0.1568 mse 0.1691 t 892 new 0.18) lr 1.00e-05 gnorm 0.152 3.56s mem 81.1GB +[2026-09-14 12:20:27] step 2457/5000 loss 0.2615 (w 0.3148 mse 0.2938 t 966 new 0.22) lr 1.00e-05 gnorm 0.153 3.10s mem 81.1GB +[2026-09-14 12:20:30] step 2458/5000 loss 0.2927 (w 0.2473 mse 0.2495 t 562 new 0.19) lr 1.00e-05 gnorm 0.188 2.85s mem 81.1GB +[2026-09-14 12:20:33] step 2459/5000 loss 0.2268 (w 0.2084 mse 0.2011 t 663 new 0.24) lr 1.00e-05 gnorm 0.259 3.18s mem 81.1GB +[2026-09-14 12:20:37] step 2460/5000 loss 0.1240 (w 0.2736 mse 0.2759 t 936 new 0.07) lr 1.00e-05 gnorm 0.173 3.11s mem 81.1GB +[2026-09-14 12:20:40] step 2461/5000 loss 0.1724 (w 0.2768 mse 0.2607 t 980 new 0.18) lr 1.00e-05 gnorm 0.135 3.09s mem 81.1GB +[2026-09-14 12:20:43] step 2462/5000 loss 0.1712 (w 0.1275 mse 0.1385 t 967 new 0.09) lr 1.00e-05 gnorm 0.220 3.41s mem 81.1GB +[2026-09-14 12:20:46] step 2463/5000 loss 0.2139 (w 0.1746 mse 0.1734 t 570 new 0.20) lr 1.00e-05 gnorm 0.164 3.08s mem 81.1GB +[2026-09-14 12:20:49] step 2464/5000 loss 0.1239 (w 0.2684 mse 0.2542 t 979 new 0.21) lr 1.00e-05 gnorm 0.318 2.84s mem 81.1GB +[2026-09-14 12:20:52] step 2465/5000 loss 0.3403 (w 0.4140 mse 0.4081 t 249 new 0.17) lr 1.00e-05 gnorm 0.137 3.20s mem 81.1GB +[2026-09-14 12:20:56] step 2466/5000 loss 0.1621 (w 0.2342 mse 0.2183 t 731 new 0.24) lr 1.00e-05 gnorm 0.205 3.28s mem 81.1GB +[2026-09-14 12:20:59] step 2467/5000 loss 0.1203 (w 0.2225 mse 0.2054 t 927 new 0.23) lr 1.00e-05 gnorm 0.797 3.34s mem 81.1GB +[2026-09-14 12:21:02] step 2468/5000 loss 0.1484 (w 0.4106 mse 0.3931 t 988 new 0.21) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +[2026-09-14 12:21:05] step 2469/5000 loss 0.2716 (w 0.1769 mse 0.1738 t 790 new 0.16) lr 1.00e-05 gnorm 0.140 3.28s mem 81.1GB +[2026-09-14 12:21:08] step 2470/5000 loss 0.3174 (w 0.3975 mse 0.3969 t 323 new 0.22) lr 1.00e-05 gnorm 0.232 2.85s mem 81.1GB +[2026-09-14 12:21:11] step 2471/5000 loss 0.2053 (w 0.3185 mse 0.3252 t 942 new 0.17) lr 1.00e-05 gnorm 0.157 3.20s mem 81.1GB +[2026-09-14 12:21:15] step 2472/5000 loss 0.1415 (w 0.1890 mse 0.1922 t 841 new 0.21) lr 1.00e-05 gnorm 0.132 3.43s mem 81.1GB +[2026-09-14 12:21:18] step 2473/5000 loss 0.3062 (w 0.2181 mse 0.2073 t 730 new 0.23) lr 1.00e-05 gnorm 0.169 3.59s mem 81.1GB +[2026-09-14 12:21:21] step 2474/5000 loss 0.2470 (w 0.2645 mse 0.2462 t 993 new 0.23) lr 1.00e-05 gnorm 0.165 3.07s mem 81.1GB +[2026-09-14 12:21:25] step 2475/5000 loss 0.1642 (w 0.2815 mse 0.2561 t 920 new 0.23) lr 1.00e-05 gnorm 0.217 3.32s mem 81.1GB +[2026-09-14 12:21:28] step 2476/5000 loss 0.4587 (w 0.2655 mse 0.2551 t 959 new 0.19) lr 1.00e-05 gnorm 0.165 2.85s mem 81.1GB +[2026-09-14 12:21:31] step 2477/5000 loss 0.1819 (w 0.1877 mse 0.1819 t 840 new 0.26) lr 1.00e-05 gnorm 0.106 3.33s mem 81.1GB +[2026-09-14 12:21:34] step 2478/5000 loss 0.2258 (w 0.2481 mse 0.2431 t 982 new 0.10) lr 1.00e-05 gnorm 0.155 3.16s mem 81.1GB +[2026-09-14 12:21:38] step 2479/5000 loss 0.0979 (w 0.1917 mse 0.1923 t 912 new 0.19) lr 1.00e-05 gnorm 0.116 3.51s mem 81.1GB +[2026-09-14 12:21:41] step 2480/5000 loss 0.3065 (w 0.1397 mse 0.1529 t 825 new 0.16) lr 1.00e-05 gnorm 0.165 3.28s mem 81.1GB +[2026-09-14 12:21:44] step 2481/5000 loss 0.4424 (w 0.1181 mse 0.1175 t 751 new 0.11) lr 1.00e-05 gnorm 0.418 3.12s mem 81.1GB +[2026-09-14 12:21:47] step 2482/5000 loss 0.4362 (w 0.2235 mse 0.2113 t 776 new 0.24) lr 1.00e-05 gnorm 0.134 2.85s mem 81.1GB +[2026-09-14 12:21:51] step 2483/5000 loss 0.2504 (w 0.1673 mse 0.1621 t 737 new 0.10) lr 1.00e-05 gnorm 0.180 3.64s mem 81.1GB +[2026-09-14 12:21:54] step 2484/5000 loss 0.2695 (w 0.2133 mse 0.2098 t 924 new 0.23) lr 1.00e-05 gnorm 0.196 3.63s mem 81.1GB +[2026-09-14 12:21:57] step 2485/5000 loss 0.1440 (w 0.1789 mse 0.1565 t 901 new 0.22) lr 1.00e-05 gnorm 0.169 3.23s mem 81.1GB +[2026-09-14 12:22:01] step 2486/5000 loss 0.2427 (w 0.2537 mse 0.2491 t 942 new 0.25) lr 1.00e-05 gnorm 0.684 3.33s mem 81.1GB +[2026-09-14 12:22:04] step 2487/5000 loss 0.2524 (w 0.1926 mse 0.1841 t 933 new 0.24) lr 1.00e-05 gnorm 0.254 3.13s mem 81.1GB +[2026-09-14 12:22:07] step 2488/5000 loss 0.1801 (w 0.1486 mse 0.1546 t 881 new 0.23) lr 1.00e-05 gnorm 0.147 2.84s mem 81.1GB +[2026-09-14 12:22:10] step 2489/5000 loss 0.4207 (w 0.3053 mse 0.3065 t 447 new 0.20) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +[2026-09-14 12:22:13] step 2490/5000 loss 0.2760 (w 0.1359 mse 0.1432 t 733 new 0.09) lr 1.00e-05 gnorm 0.162 3.44s mem 81.1GB +[2026-09-14 12:22:17] step 2491/5000 loss 0.2121 (w 0.2552 mse 0.2413 t 931 new 0.20) lr 1.00e-05 gnorm 0.167 3.13s mem 81.1GB +[2026-09-14 12:22:20] step 2492/5000 loss 0.2228 (w 0.3008 mse 0.2935 t 513 new 0.23) lr 1.00e-05 gnorm 0.189 3.09s mem 81.1GB +[2026-09-14 12:22:23] step 2493/5000 loss 0.2110 (w 0.2286 mse 0.2159 t 923 new 0.20) lr 1.00e-05 gnorm 0.120 3.06s mem 81.1GB +[2026-09-14 12:22:26] step 2494/5000 loss 0.1344 (w 0.2472 mse 0.2410 t 931 new 0.26) lr 1.00e-05 gnorm 0.175 3.19s mem 81.1GB +[2026-09-14 12:22:29] step 2495/5000 loss 0.2718 (w 0.2836 mse 0.2853 t 964 new 0.25) lr 1.00e-05 gnorm 0.129 3.40s mem 81.1GB +[2026-09-14 12:22:32] step 2496/5000 loss 0.2622 (w 0.2396 mse 0.2314 t 795 new 0.19) lr 1.00e-05 gnorm 0.172 3.13s mem 81.1GB +[2026-09-14 12:22:36] step 2497/5000 loss 0.2727 (w 0.1535 mse 0.1571 t 946 new 0.17) lr 1.00e-05 gnorm 0.168 3.13s mem 81.1GB +[2026-09-14 12:22:39] step 2498/5000 loss 0.2493 (w 0.2587 mse 0.2443 t 918 new 0.17) lr 1.00e-05 gnorm 0.184 3.12s mem 81.1GB +[2026-09-14 12:22:42] step 2499/5000 loss 0.1390 (w 0.1857 mse 0.1873 t 931 new 0.13) lr 1.00e-05 gnorm 0.161 3.09s mem 81.1GB +[2026-09-14 12:22:45] step 2500/5000 loss 0.1917 (w 0.2619 mse 0.2642 t 904 new 0.13) lr 1.00e-05 gnorm 0.204 3.19s mem 81.1GB +[2026-09-14 12:22:47] [val] step 2500 t=200: w=0.4208 mse=0.4317 (n=16) t=500: w=0.2241 mse=0.2278 (n=16) t=800: w=0.1753 mse=0.1748 (n=16) | mean w=0.2734 mse=0.2781 2s +[2026-09-14 12:23:35] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step2500.safetensors 4093 个张量 37.98 GB +[2026-09-14 12:23:40] step 2501/5000 loss 0.2615 (w 0.2606 mse 0.2587 t 895 new 0.20) lr 1.00e-05 gnorm 1.347 3.43s mem 81.1GB +[2026-09-14 12:23:43] step 2502/5000 loss 0.1220 (w 0.2658 mse 0.2696 t 969 new 0.21) lr 1.00e-05 gnorm 0.120 3.35s mem 81.1GB +[2026-09-14 12:23:46] step 2503/5000 loss 0.2007 (w 0.3178 mse 0.3055 t 397 new 0.20) lr 1.00e-05 gnorm 0.131 3.12s mem 81.1GB +[2026-09-14 12:23:49] step 2504/5000 loss 0.1354 (w 0.2686 mse 0.2506 t 968 new 0.22) lr 1.00e-05 gnorm 0.464 3.35s mem 81.1GB +[2026-09-14 12:23:52] step 2505/5000 loss 0.1850 (w 0.2489 mse 0.2379 t 939 new 0.22) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +[2026-09-14 12:23:55] step 2506/5000 loss 0.1356 (w 0.3662 mse 0.3382 t 979 new 0.17) lr 1.00e-05 gnorm 0.153 3.19s mem 81.1GB +[2026-09-14 12:23:59] step 2507/5000 loss 0.2835 (w 0.1838 mse 0.1803 t 774 new 0.08) lr 1.00e-05 gnorm 0.179 3.16s mem 81.1GB +[2026-09-14 12:24:02] step 2508/5000 loss 0.2744 (w 0.1590 mse 0.1562 t 513 new 0.14) lr 1.00e-05 gnorm 0.129 3.35s mem 81.1GB +[2026-09-14 12:24:05] step 2509/5000 loss 0.1708 (w 0.2135 mse 0.2105 t 906 new 0.14) lr 1.00e-05 gnorm 0.607 3.11s mem 81.1GB +[2026-09-14 12:24:08] step 2510/5000 loss 0.2760 (w 0.2934 mse 0.2752 t 856 new 0.15) lr 1.00e-05 gnorm 0.178 3.37s mem 81.1GB +[2026-09-14 12:24:11] step 2511/5000 loss 0.2183 (w 0.2104 mse 0.2131 t 996 new 0.22) lr 1.00e-05 gnorm 0.184 2.85s mem 81.1GB +[2026-09-14 12:24:14] step 2512/5000 loss 0.3299 (w 0.2508 mse 0.2546 t 977 new 0.19) lr 1.00e-05 gnorm 0.182 3.17s mem 81.1GB +[2026-09-14 12:24:18] step 2513/5000 loss 0.1633 (w 0.2873 mse 0.2837 t 966 new 0.22) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +[2026-09-14 12:24:21] step 2514/5000 loss 0.3052 (w 0.3832 mse 0.3797 t 254 new 0.12) lr 1.00e-05 gnorm 0.106 3.06s mem 81.1GB +[2026-09-14 12:24:24] step 2515/5000 loss 0.3078 (w 0.3808 mse 0.3728 t 967 new 0.15) lr 1.00e-05 gnorm 0.155 3.15s mem 81.1GB +[2026-09-14 12:24:27] step 2516/5000 loss 0.3001 (w 0.2424 mse 0.2473 t 944 new 0.22) lr 1.00e-05 gnorm 0.150 3.14s mem 81.1GB +[2026-09-14 12:24:30] step 2517/5000 loss 0.3620 (w 0.2368 mse 0.2385 t 557 new 0.23) lr 1.00e-05 gnorm 0.315 2.84s mem 81.1GB +[2026-09-14 12:24:33] step 2518/5000 loss 0.2787 (w 0.3401 mse 0.3435 t 283 new 0.19) lr 1.00e-05 gnorm 0.142 3.40s mem 81.1GB +[2026-09-14 12:24:37] step 2519/5000 loss 0.2130 (w 0.1661 mse 0.1787 t 981 new 0.17) lr 1.00e-05 gnorm 0.138 3.35s mem 81.1GB +[2026-09-14 12:24:40] step 2520/5000 loss 0.1336 (w 0.2222 mse 0.2177 t 849 new 0.15) lr 1.00e-05 gnorm 0.188 3.10s mem 81.1GB +[2026-09-14 12:24:43] step 2521/5000 loss 0.1888 (w 0.1295 mse 0.1345 t 804 new 0.10) lr 1.00e-05 gnorm 0.161 3.03s mem 81.1GB +[2026-09-14 12:24:46] step 2522/5000 loss 0.2936 (w 0.2082 mse 0.2140 t 835 new 0.23) lr 1.00e-05 gnorm 0.344 3.09s mem 81.1GB +[2026-09-14 12:24:49] step 2523/5000 loss 0.1328 (w 0.1823 mse 0.1770 t 849 new 0.21) lr 1.00e-05 gnorm 0.711 3.09s mem 81.1GB +[2026-09-14 12:24:52] step 2524/5000 loss 0.1656 (w 0.2575 mse 0.2365 t 926 new 0.22) lr 1.00e-05 gnorm 0.143 3.33s mem 81.1GB +[2026-09-14 12:24:56] step 2525/5000 loss 0.3749 (w 0.0992 mse 0.0964 t 881 new 0.24) lr 1.00e-05 gnorm 0.183 3.10s mem 81.1GB +[2026-09-14 12:24:59] step 2526/5000 loss 0.1919 (w 0.1463 mse 0.1411 t 917 new 0.21) lr 1.00e-05 gnorm 0.153 3.15s mem 81.1GB +[2026-09-14 12:25:02] step 2527/5000 loss 0.2571 (w 0.3552 mse 0.3545 t 292 new 0.24) lr 1.00e-05 gnorm 0.137 3.37s mem 81.1GB +[2026-09-14 12:25:05] step 2528/5000 loss 0.2370 (w 0.0997 mse 0.1012 t 914 new 0.18) lr 1.00e-05 gnorm 0.511 3.13s mem 81.1GB +[2026-09-14 12:25:08] step 2529/5000 loss 0.2780 (w 0.3526 mse 0.3548 t 1000 new 0.16) lr 1.00e-05 gnorm 0.715 3.12s mem 81.1GB +[2026-09-14 12:25:12] step 2530/5000 loss 0.0944 (w 0.1840 mse 0.1797 t 977 new 0.20) lr 1.00e-05 gnorm 0.173 3.40s mem 81.1GB +[2026-09-14 12:25:15] step 2531/5000 loss 0.2709 (w 0.2125 mse 0.2053 t 737 new 0.18) lr 1.00e-05 gnorm 0.200 3.13s mem 81.1GB +[2026-09-14 12:25:18] step 2532/5000 loss 0.2389 (w 0.2471 mse 0.2383 t 758 new 0.15) lr 1.00e-05 gnorm 0.137 3.35s mem 81.1GB +[2026-09-14 12:25:21] step 2533/5000 loss 0.2350 (w 0.2591 mse 0.2422 t 759 new 0.24) lr 1.00e-05 gnorm 0.189 3.14s mem 81.1GB +[2026-09-14 12:25:24] step 2534/5000 loss 0.1418 (w 0.2565 mse 0.2419 t 883 new 0.23) lr 1.00e-05 gnorm 0.166 2.84s mem 81.1GB +[2026-09-14 12:25:27] step 2535/5000 loss 0.1411 (w 0.1426 mse 0.1473 t 668 new 0.19) lr 1.00e-05 gnorm 0.209 3.24s mem 81.1GB +[2026-09-14 12:25:31] step 2536/5000 loss 0.1600 (w 0.2259 mse 0.2305 t 950 new 0.08) lr 1.00e-05 gnorm 0.154 3.32s mem 81.1GB +[2026-09-14 12:25:34] step 2537/5000 loss 0.2911 (w 0.2372 mse 0.2239 t 937 new 0.28) lr 1.00e-05 gnorm 0.197 3.14s mem 81.1GB +[2026-09-14 12:25:37] step 2538/5000 loss 0.1991 (w 0.1961 mse 0.2043 t 940 new 0.13) lr 1.00e-05 gnorm 0.369 3.13s mem 81.1GB +[2026-09-14 12:25:40] step 2539/5000 loss 0.0900 (w 0.2444 mse 0.2434 t 944 new 0.15) lr 1.00e-05 gnorm 0.178 3.28s mem 81.1GB +[2026-09-14 12:25:43] step 2540/5000 loss 0.3116 (w 0.5746 mse 0.5814 t 107 new 0.21) lr 1.00e-05 gnorm 0.320 2.85s mem 81.1GB +[2026-09-14 12:25:46] step 2541/5000 loss 0.3236 (w 0.3708 mse 0.3641 t 269 new 0.25) lr 1.00e-05 gnorm 0.146 3.20s mem 81.1GB +[2026-09-14 12:25:50] step 2542/5000 loss 0.1192 (w 0.4098 mse 0.3845 t 990 new 0.20) lr 1.00e-05 gnorm 0.123 3.35s mem 81.1GB +[2026-09-14 12:25:53] step 2543/5000 loss 0.1923 (w 0.1478 mse 0.1610 t 961 new 0.23) lr 1.00e-05 gnorm 0.118 3.60s mem 81.1GB +[2026-09-14 12:25:56] step 2544/5000 loss 0.1794 (w 0.1356 mse 0.1226 t 945 new 0.19) lr 1.00e-05 gnorm 0.152 3.08s mem 81.1GB +[2026-09-14 12:26:00] step 2545/5000 loss 0.1669 (w 0.2641 mse 0.2650 t 965 new 0.08) lr 1.00e-05 gnorm 0.258 3.34s mem 81.1GB +[2026-09-14 12:26:03] step 2546/5000 loss 0.2481 (w 0.2819 mse 0.2876 t 636 new 0.15) lr 1.00e-05 gnorm 0.251 3.17s mem 81.1GB +[2026-09-14 12:26:06] step 2547/5000 loss 0.3101 (w 0.1486 mse 0.1383 t 799 new 0.23) lr 1.00e-05 gnorm 0.189 2.85s mem 81.1GB +[2026-09-14 12:26:09] step 2548/5000 loss 0.1615 (w 0.1877 mse 0.1759 t 914 new 0.24) lr 1.00e-05 gnorm 0.166 3.12s mem 81.1GB +[2026-09-14 12:26:12] step 2549/5000 loss 0.2308 (w 0.4195 mse 0.4342 t 233 new 0.22) lr 1.00e-05 gnorm 0.185 3.52s mem 81.1GB +[2026-09-14 12:26:16] step 2550/5000 loss 0.1253 (w 0.2624 mse 0.2516 t 934 new 0.15) lr 1.00e-05 gnorm 0.264 3.14s mem 81.1GB +[2026-09-14 12:26:19] step 2551/5000 loss 0.2076 (w 0.3009 mse 0.2986 t 621 new 0.06) lr 1.00e-05 gnorm 0.298 3.10s mem 81.1GB +[2026-09-14 12:26:22] step 2552/5000 loss 0.2928 (w 0.3227 mse 0.3298 t 983 new 0.20) lr 1.00e-05 gnorm 0.362 3.06s mem 81.1GB +[2026-09-14 12:26:25] step 2553/5000 loss 0.2003 (w 0.1646 mse 0.1737 t 942 new 0.11) lr 1.00e-05 gnorm 0.184 2.85s mem 81.1GB +[2026-09-14 12:26:28] step 2554/5000 loss 0.1321 (w 0.2064 mse 0.1876 t 962 new 0.25) lr 1.00e-05 gnorm 1.380 3.09s mem 81.1GB +[2026-09-14 12:26:31] step 2555/5000 loss 0.2720 (w 0.5637 mse 0.5700 t 183 new 0.28) lr 1.00e-05 gnorm 0.132 3.21s mem 81.1GB +[2026-09-14 12:26:34] step 2556/5000 loss 0.1843 (w 0.2668 mse 0.2579 t 913 new 0.21) lr 1.00e-05 gnorm 0.174 3.21s mem 81.1GB +[2026-09-14 12:26:37] step 2557/5000 loss 0.2975 (w 0.2134 mse 0.1896 t 860 new 0.23) lr 1.00e-05 gnorm 0.186 3.09s mem 81.1GB +[2026-09-14 12:26:40] step 2558/5000 loss 0.2255 (w 0.2619 mse 0.2728 t 712 new 0.18) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +[2026-09-14 12:26:44] step 2559/5000 loss 0.3184 (w 0.2862 mse 0.2740 t 269 new 0.26) lr 1.00e-05 gnorm 0.342 3.02s mem 81.1GB +[2026-09-14 12:26:46] step 2560/5000 loss 0.1854 (w 0.3157 mse 0.3079 t 996 new 0.22) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-14 12:26:50] step 2561/5000 loss 0.1706 (w 0.2669 mse 0.2515 t 922 new 0.19) lr 1.00e-05 gnorm 0.145 3.18s mem 81.1GB +[2026-09-14 12:26:53] step 2562/5000 loss 0.2698 (w 0.4377 mse 0.4361 t 368 new 0.20) lr 1.00e-05 gnorm 0.118 3.39s mem 81.1GB +[2026-09-14 12:26:56] step 2563/5000 loss 0.2172 (w 0.2059 mse 0.1868 t 954 new 0.12) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +[2026-09-14 12:26:59] step 2564/5000 loss 0.1975 (w 0.1855 mse 0.1773 t 862 new 0.10) lr 1.00e-05 gnorm 0.149 3.13s mem 81.1GB +[2026-09-14 12:27:02] step 2565/5000 loss 0.1770 (w 0.2886 mse 0.2755 t 794 new 0.16) lr 1.00e-05 gnorm 0.178 3.11s mem 81.1GB +[2026-09-14 12:27:05] step 2566/5000 loss 0.2877 (w 0.2324 mse 0.2317 t 779 new 0.22) lr 1.00e-05 gnorm 0.174 2.85s mem 81.1GB +[2026-09-14 12:27:09] step 2567/5000 loss 0.1869 (w 0.1852 mse 0.1730 t 938 new 0.24) lr 1.00e-05 gnorm 0.136 3.54s mem 81.1GB +[2026-09-14 12:27:12] step 2568/5000 loss 0.1579 (w 0.3990 mse 0.3924 t 990 new 0.29) lr 1.00e-05 gnorm 1.741 3.45s mem 81.1GB +[2026-09-14 12:27:15] step 2569/5000 loss 0.2089 (w 0.1764 mse 0.1672 t 884 new 0.16) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +[2026-09-14 12:27:18] step 2570/5000 loss 0.2088 (w 0.1308 mse 0.1377 t 487 new 0.15) lr 1.00e-05 gnorm 0.153 3.11s mem 81.1GB +[2026-09-14 12:27:21] step 2571/5000 loss 0.3113 (w 0.2177 mse 0.2233 t 462 new 0.26) lr 1.00e-05 gnorm 0.145 3.12s mem 81.1GB +[2026-09-14 12:27:24] step 2572/5000 loss 0.1772 (w 0.1102 mse 0.1236 t 926 new 0.24) lr 1.00e-05 gnorm 0.425 2.83s mem 81.1GB +[2026-09-14 12:27:28] step 2573/5000 loss 0.2787 (w 0.1927 mse 0.1797 t 905 new 0.24) lr 1.00e-05 gnorm 0.159 3.73s mem 81.1GB +[2026-09-14 12:27:31] step 2574/5000 loss 0.0520 (w 0.3086 mse 0.2777 t 989 new 0.17) lr 1.00e-05 gnorm 0.122 3.06s mem 81.1GB +[2026-09-14 12:27:34] step 2575/5000 loss 0.3895 (w 0.2217 mse 0.2165 t 386 new 0.14) lr 1.00e-05 gnorm 0.179 3.08s mem 81.1GB +[2026-09-14 12:27:37] step 2576/5000 loss 0.2422 (w 0.1999 mse 0.1952 t 484 new 0.10) lr 1.00e-05 gnorm 0.120 2.85s mem 81.1GB +[2026-09-14 12:27:40] step 2577/5000 loss 0.1307 (w 0.2503 mse 0.2388 t 942 new 0.24) lr 1.00e-05 gnorm 0.167 3.26s mem 81.1GB +[2026-09-14 12:27:44] step 2578/5000 loss 0.1492 (w 0.2340 mse 0.2236 t 828 new 0.22) lr 1.00e-05 gnorm 0.120 3.23s mem 81.1GB +[2026-09-14 12:27:47] step 2579/5000 loss 0.0907 (w 0.3750 mse 0.3544 t 989 new 0.21) lr 1.00e-05 gnorm 0.206 3.55s mem 81.1GB +[2026-09-14 12:27:50] step 2580/5000 loss 0.2710 (w 0.1578 mse 0.1651 t 740 new 0.20) lr 1.00e-05 gnorm 0.174 3.10s mem 81.1GB +[2026-09-14 12:27:53] step 2581/5000 loss 0.3678 (w 0.1636 mse 0.1604 t 710 new 0.11) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +[2026-09-14 12:27:56] step 2582/5000 loss 0.2755 (w 0.2065 mse 0.2009 t 882 new 0.23) lr 1.00e-05 gnorm 0.179 2.86s mem 81.1GB +[2026-09-14 12:27:59] step 2583/5000 loss 0.2952 (w 0.1619 mse 0.1560 t 855 new 0.22) lr 1.00e-05 gnorm 0.349 3.27s mem 81.1GB +[2026-09-14 12:28:03] step 2584/5000 loss 0.1170 (w 0.2007 mse 0.1956 t 946 new 0.12) lr 1.00e-05 gnorm 0.148 3.21s mem 81.1GB +[2026-09-14 12:28:06] step 2585/5000 loss 0.3243 (w 0.1441 mse 0.1416 t 868 new 0.22) lr 1.00e-05 gnorm 0.129 3.52s mem 81.1GB +[2026-09-14 12:28:10] step 2586/5000 loss 0.1305 (w 0.2485 mse 0.2375 t 711 new 0.22) lr 1.00e-05 gnorm 0.122 3.34s mem 81.1GB +[2026-09-14 12:28:13] step 2587/5000 loss 0.1582 (w 0.0875 mse 0.0887 t 864 new 0.23) lr 1.00e-05 gnorm 0.194 3.06s mem 81.1GB +[2026-09-14 12:28:15] step 2588/5000 loss 0.2998 (w 0.2785 mse 0.2702 t 557 new 0.15) lr 1.00e-05 gnorm 0.121 2.85s mem 81.1GB +[2026-09-14 12:28:19] step 2589/5000 loss 0.2411 (w 0.2747 mse 0.2615 t 754 new 0.21) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +[2026-09-14 12:28:22] step 2590/5000 loss 0.2735 (w 0.2848 mse 0.2810 t 998 new 0.24) lr 1.00e-05 gnorm 0.124 3.22s mem 81.1GB +[2026-09-14 12:28:25] step 2591/5000 loss 0.0841 (w 0.1996 mse 0.1860 t 976 new 0.21) lr 1.00e-05 gnorm 0.113 3.43s mem 81.1GB +[2026-09-14 12:28:28] step 2592/5000 loss 0.2433 (w 0.2153 mse 0.2113 t 915 new 0.19) lr 1.00e-05 gnorm 0.158 3.28s mem 81.1GB +[2026-09-14 12:28:32] step 2593/5000 loss 0.3278 (w 0.2080 mse 0.2061 t 969 new 0.18) lr 1.00e-05 gnorm 0.203 3.09s mem 81.1GB +[2026-09-14 12:28:34] step 2594/5000 loss 0.1768 (w 0.2090 mse 0.2043 t 562 new 0.24) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +[2026-09-14 12:28:38] step 2595/5000 loss 0.2167 (w 0.1562 mse 0.1412 t 853 new 0.17) lr 1.00e-05 gnorm 0.162 3.11s mem 81.1GB +[2026-09-14 12:28:41] step 2596/5000 loss 0.2262 (w 0.3888 mse 0.3894 t 960 new 0.27) lr 1.00e-05 gnorm 0.151 3.51s mem 81.1GB +[2026-09-14 12:28:44] step 2597/5000 loss 0.3552 (w 0.2230 mse 0.2161 t 943 new 0.17) lr 1.00e-05 gnorm 0.140 3.28s mem 81.1GB +[2026-09-14 12:28:48] step 2598/5000 loss 0.2753 (w 0.1684 mse 0.1858 t 970 new 0.12) lr 1.00e-05 gnorm 0.153 3.32s mem 81.1GB +[2026-09-14 12:28:51] step 2599/5000 loss 0.1638 (w 0.2169 mse 0.2215 t 979 new 0.26) lr 1.00e-05 gnorm 0.459 3.15s mem 81.1GB +[2026-09-14 12:28:54] step 2600/5000 loss 0.2327 (w 0.1531 mse 0.1577 t 578 new 0.09) lr 1.00e-05 gnorm 0.211 3.03s mem 81.1GB +[2026-09-14 12:28:57] step 2601/5000 loss 0.2349 (w 0.2149 mse 0.2019 t 899 new 0.20) lr 1.00e-05 gnorm 0.155 3.13s mem 81.1GB +[2026-09-14 12:29:00] step 2602/5000 loss 0.2156 (w 0.2050 mse 0.2326 t 948 new 0.18) lr 1.00e-05 gnorm 0.161 3.27s mem 81.1GB +[2026-09-14 12:29:04] step 2603/5000 loss 0.2407 (w 0.2563 mse 0.2500 t 864 new 0.19) lr 1.00e-05 gnorm 0.141 3.56s mem 81.1GB +[2026-09-14 12:29:07] step 2604/5000 loss 0.0805 (w 0.1975 mse 0.1915 t 855 new 0.20) lr 1.00e-05 gnorm 0.882 3.08s mem 81.1GB +[2026-09-14 12:29:10] step 2605/5000 loss 0.1447 (w 0.2080 mse 0.1961 t 700 new 0.19) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +[2026-09-14 12:29:13] step 2606/5000 loss 0.2131 (w 0.2008 mse 0.1973 t 730 new 0.24) lr 1.00e-05 gnorm 0.129 3.13s mem 81.1GB +[2026-09-14 12:29:16] step 2607/5000 loss 0.2289 (w 0.1641 mse 0.1574 t 948 new 0.21) lr 1.00e-05 gnorm 0.184 2.84s mem 81.1GB +[2026-09-14 12:29:19] step 2608/5000 loss 0.1032 (w 0.2446 mse 0.2383 t 955 new 0.24) lr 1.00e-05 gnorm 0.176 3.49s mem 81.1GB +[2026-09-14 12:29:23] step 2609/5000 loss 0.1738 (w 0.4995 mse 0.4705 t 988 new 0.26) lr 1.00e-05 gnorm 0.149 3.30s mem 81.1GB +[2026-09-14 12:29:26] step 2610/5000 loss 0.2412 (w 0.1541 mse 0.1552 t 815 new 0.22) lr 1.00e-05 gnorm 0.177 3.14s mem 81.1GB +[2026-09-14 12:29:29] step 2611/5000 loss 0.1922 (w 0.2157 mse 0.2068 t 670 new 0.20) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-14 12:29:32] step 2612/5000 loss 0.2747 (w 0.1725 mse 0.1727 t 903 new 0.23) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +[2026-09-14 12:29:35] step 2613/5000 loss 0.1357 (w 0.2956 mse 0.2827 t 991 new 0.26) lr 1.00e-05 gnorm 0.364 2.85s mem 81.1GB +[2026-09-14 12:29:38] step 2614/5000 loss 0.2394 (w 0.2424 mse 0.2507 t 570 new 0.19) lr 1.00e-05 gnorm 0.168 3.31s mem 81.1GB +[2026-09-14 12:29:42] step 2615/5000 loss 0.2377 (w 0.2006 mse 0.2076 t 807 new 0.16) lr 1.00e-05 gnorm 0.146 3.38s mem 81.1GB +[2026-09-14 12:29:45] step 2616/5000 loss 0.3017 (w 0.1296 mse 0.1273 t 979 new 0.25) lr 1.00e-05 gnorm 0.117 3.49s mem 81.1GB +[2026-09-14 12:29:48] step 2617/5000 loss 0.1520 (w 0.3532 mse 0.3461 t 978 new 0.13) lr 1.00e-05 gnorm 0.161 2.84s mem 81.1GB +[2026-09-14 12:29:51] step 2618/5000 loss 0.2797 (w 0.3275 mse 0.3193 t 1000 new 0.23) lr 1.00e-05 gnorm 0.156 3.32s mem 81.1GB +[2026-09-14 12:29:55] step 2619/5000 loss 0.2385 (w 0.1440 mse 0.1432 t 937 new 0.25) lr 1.00e-05 gnorm 0.182 3.33s mem 81.1GB +[2026-09-14 12:29:58] step 2620/5000 loss 0.2581 (w 0.2662 mse 0.2871 t 973 new 0.19) lr 1.00e-05 gnorm 0.126 3.08s mem 81.1GB +[2026-09-14 12:30:01] step 2621/5000 loss 0.2144 (w 0.1910 mse 0.1908 t 516 new 0.13) lr 1.00e-05 gnorm 0.123 3.38s mem 81.1GB +[2026-09-14 12:30:04] step 2622/5000 loss 0.1500 (w 0.2973 mse 0.2858 t 936 new 0.18) lr 1.00e-05 gnorm 0.136 3.28s mem 81.1GB +[2026-09-14 12:30:07] step 2623/5000 loss 0.2180 (w 0.2239 mse 0.2299 t 523 new 0.23) lr 1.00e-05 gnorm 0.275 2.84s mem 81.1GB +[2026-09-14 12:30:10] step 2624/5000 loss 0.2561 (w 0.1215 mse 0.1254 t 813 new 0.25) lr 1.00e-05 gnorm 0.126 3.28s mem 81.1GB +[2026-09-14 12:30:14] step 2625/5000 loss 0.2934 (w 0.1089 mse 0.1119 t 683 new 0.10) lr 1.00e-05 gnorm 0.164 3.25s mem 81.1GB +[2026-09-14 12:30:17] step 2626/5000 loss 0.2871 (w 0.1556 mse 0.1473 t 840 new 0.13) lr 1.00e-05 gnorm 0.186 3.13s mem 81.1GB +[2026-09-14 12:30:20] step 2627/5000 loss 0.1985 (w 0.2224 mse 0.2133 t 781 new 0.23) lr 1.00e-05 gnorm 0.162 3.18s mem 81.1GB +[2026-09-14 12:30:23] step 2628/5000 loss 0.3479 (w 0.1749 mse 0.1758 t 858 new 0.24) lr 1.00e-05 gnorm 0.165 3.43s mem 81.1GB +[2026-09-14 12:30:26] step 2629/5000 loss 0.2099 (w 0.4317 mse 0.4404 t 973 new 0.14) lr 1.00e-05 gnorm 0.180 2.86s mem 81.1GB +[2026-09-14 12:30:29] step 2630/5000 loss 0.3762 (w 0.2423 mse 0.2510 t 479 new 0.17) lr 1.00e-05 gnorm 0.127 3.09s mem 81.1GB +[2026-09-14 12:30:33] step 2631/5000 loss 0.1592 (w 0.3770 mse 0.3701 t 992 new 0.23) lr 1.00e-05 gnorm 0.165 3.35s mem 81.1GB +[2026-09-14 12:30:36] step 2632/5000 loss 0.2093 (w 0.2517 mse 0.2467 t 702 new 0.22) lr 1.00e-05 gnorm 0.189 3.15s mem 81.1GB +[2026-09-14 12:30:39] step 2633/5000 loss 0.2348 (w 0.2265 mse 0.2186 t 972 new 0.11) lr 1.00e-05 gnorm 0.152 3.30s mem 81.1GB +[2026-09-14 12:30:42] step 2634/5000 loss 0.3358 (w 0.2283 mse 0.2338 t 827 new 0.15) lr 1.00e-05 gnorm 0.148 3.12s mem 81.1GB +[2026-09-14 12:30:45] step 2635/5000 loss 0.2652 (w 0.2023 mse 0.1946 t 883 new 0.23) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +[2026-09-14 12:30:48] step 2636/5000 loss 0.1604 (w 0.3199 mse 0.3058 t 954 new 0.20) lr 1.00e-05 gnorm 0.150 3.09s mem 81.1GB +[2026-09-14 12:30:52] step 2637/5000 loss 0.1230 (w 0.2694 mse 0.2566 t 940 new 0.20) lr 1.00e-05 gnorm 0.121 3.36s mem 81.1GB +[2026-09-14 12:30:55] step 2638/5000 loss 0.3318 (w 0.2403 mse 0.2321 t 735 new 0.25) lr 1.00e-05 gnorm 0.160 3.15s mem 81.1GB +[2026-09-14 12:30:58] step 2639/5000 loss 0.1001 (w 0.2710 mse 0.2697 t 990 new 0.22) lr 1.00e-05 gnorm 0.143 3.15s mem 81.1GB +[2026-09-14 12:31:01] step 2640/5000 loss 0.2067 (w 0.2333 mse 0.2257 t 771 new 0.22) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +[2026-09-14 12:31:04] step 2641/5000 loss 0.1261 (w 0.2964 mse 0.2948 t 993 new 0.24) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +[2026-09-14 12:31:07] step 2642/5000 loss 0.1784 (w 0.2097 mse 0.2154 t 985 new 0.22) lr 1.00e-05 gnorm 0.280 2.85s mem 81.1GB +[2026-09-14 12:31:10] step 2643/5000 loss 0.1607 (w 0.3282 mse 0.3085 t 845 new 0.22) lr 1.00e-05 gnorm 0.171 3.28s mem 81.1GB +[2026-09-14 12:31:14] step 2644/5000 loss 0.2283 (w 0.2624 mse 0.2667 t 927 new 0.20) lr 1.00e-05 gnorm 0.228 3.14s mem 81.1GB +[2026-09-14 12:31:17] step 2645/5000 loss 0.1393 (w 0.2487 mse 0.2395 t 988 new 0.22) lr 1.00e-05 gnorm 0.127 3.15s mem 81.1GB +[2026-09-14 12:31:20] step 2646/5000 loss 0.2569 (w 0.1832 mse 0.1792 t 792 new 0.13) lr 1.00e-05 gnorm 0.131 3.12s mem 81.1GB +[2026-09-14 12:31:23] step 2647/5000 loss 0.2483 (w 0.3122 mse 0.2858 t 950 new 0.21) lr 1.00e-05 gnorm 0.101 3.11s mem 81.1GB +[2026-09-14 12:31:26] step 2648/5000 loss 0.1604 (w 0.2220 mse 0.2154 t 914 new 0.21) lr 1.00e-05 gnorm 0.241 3.18s mem 81.1GB +[2026-09-14 12:31:29] step 2649/5000 loss 0.2917 (w 0.2470 mse 0.2331 t 788 new 0.25) lr 1.00e-05 gnorm 0.319 3.06s mem 81.1GB +[2026-09-14 12:31:32] step 2650/5000 loss 0.1395 (w 0.1647 mse 0.1682 t 641 new 0.16) lr 1.00e-05 gnorm 0.149 3.17s mem 81.1GB +[2026-09-14 12:31:36] step 2651/5000 loss 0.1761 (w 0.1197 mse 0.1243 t 882 new 0.21) lr 1.00e-05 gnorm 0.107 3.37s mem 81.1GB +[2026-09-14 12:31:39] step 2652/5000 loss 0.2196 (w 0.3222 mse 0.3043 t 980 new 0.21) lr 1.00e-05 gnorm 0.230 2.85s mem 81.1GB +[2026-09-14 12:31:42] step 2653/5000 loss 0.3056 (w 0.2657 mse 0.2766 t 503 new 0.25) lr 1.00e-05 gnorm 0.252 3.10s mem 81.1GB +[2026-09-14 12:31:45] step 2654/5000 loss 0.2472 (w 0.2181 mse 0.2120 t 773 new 0.25) lr 1.00e-05 gnorm 0.188 3.16s mem 81.1GB +[2026-09-14 12:31:48] step 2655/5000 loss 0.1737 (w 0.4170 mse 0.3988 t 134 new 0.21) lr 1.00e-05 gnorm 0.115 3.11s mem 81.1GB +[2026-09-14 12:31:51] step 2656/5000 loss 0.2483 (w 0.1717 mse 0.1699 t 776 new 0.13) lr 1.00e-05 gnorm 0.193 3.12s mem 81.1GB +[2026-09-14 12:31:54] step 2657/5000 loss 0.4080 (w 0.1508 mse 0.1562 t 508 new 0.16) lr 1.00e-05 gnorm 0.178 3.39s mem 81.1GB +[2026-09-14 12:31:57] step 2658/5000 loss 0.3059 (w 0.2408 mse 0.2263 t 761 new 0.17) lr 1.00e-05 gnorm 0.155 2.86s mem 81.1GB +[2026-09-14 12:32:01] step 2659/5000 loss 0.1372 (w 0.2745 mse 0.2696 t 983 new 0.23) lr 1.00e-05 gnorm 0.144 3.16s mem 81.1GB +[2026-09-14 12:32:04] step 2660/5000 loss 0.1621 (w 0.1845 mse 0.1863 t 948 new 0.15) lr 1.00e-05 gnorm 0.201 3.18s mem 81.1GB +[2026-09-14 12:32:07] step 2661/5000 loss 0.2763 (w 0.1767 mse 0.1901 t 974 new 0.13) lr 1.00e-05 gnorm 0.277 3.11s mem 81.1GB +[2026-09-14 12:32:10] step 2662/5000 loss 0.4235 (w 0.5571 mse 0.5539 t 189 new 0.18) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +[2026-09-14 12:32:13] step 2663/5000 loss 0.2067 (w 0.4064 mse 0.3946 t 973 new 0.19) lr 1.00e-05 gnorm 0.152 3.16s mem 81.1GB +[2026-09-14 12:32:16] step 2664/5000 loss 0.1988 (w 0.1364 mse 0.1380 t 796 new 0.13) lr 1.00e-05 gnorm 0.343 2.85s mem 81.1GB +[2026-09-14 12:32:19] step 2665/5000 loss 0.1863 (w 0.3440 mse 0.3290 t 981 new 0.24) lr 1.00e-05 gnorm 0.263 3.25s mem 81.1GB +[2026-09-14 12:32:23] step 2666/5000 loss 0.2189 (w 0.2430 mse 0.2403 t 990 new 0.23) lr 1.00e-05 gnorm 0.171 3.34s mem 81.1GB +[2026-09-14 12:32:26] step 2667/5000 loss 0.1609 (w 0.2205 mse 0.2080 t 797 new 0.26) lr 1.00e-05 gnorm 0.129 3.18s mem 81.1GB +[2026-09-14 12:32:29] step 2668/5000 loss 0.1557 (w 0.3079 mse 0.2941 t 951 new 0.19) lr 1.00e-05 gnorm 0.283 3.41s mem 81.1GB +[2026-09-14 12:32:32] step 2669/5000 loss 0.1489 (w 0.2656 mse 0.2519 t 905 new 0.25) lr 1.00e-05 gnorm 0.220 3.12s mem 81.1GB +[2026-09-14 12:32:35] step 2670/5000 loss 0.0962 (w 0.3354 mse 0.3262 t 997 new 0.23) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +[2026-09-14 12:32:38] step 2671/5000 loss 0.3019 (w 0.3040 mse 0.2778 t 956 new 0.22) lr 1.00e-05 gnorm 0.142 3.36s mem 81.1GB +[2026-09-14 12:32:42] step 2672/5000 loss 0.1573 (w 0.1472 mse 0.1591 t 968 new 0.12) lr 1.00e-05 gnorm 0.142 3.38s mem 81.1GB +[2026-09-14 12:32:45] step 2673/5000 loss 0.3057 (w 0.1296 mse 0.1213 t 863 new 0.20) lr 1.00e-05 gnorm 0.116 3.15s mem 81.1GB +[2026-09-14 12:32:48] step 2674/5000 loss 0.1693 (w 0.2447 mse 0.2421 t 966 new 0.22) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-14 12:32:51] step 2675/5000 loss 0.4573 (w 0.2333 mse 0.2308 t 537 new 0.14) lr 1.00e-05 gnorm 0.196 3.08s mem 81.1GB +[2026-09-14 12:32:54] step 2676/5000 loss 0.3295 (w 0.1996 mse 0.1979 t 518 new 0.21) lr 1.00e-05 gnorm 0.178 3.11s mem 81.1GB +[2026-09-14 12:32:57] step 2677/5000 loss 0.2596 (w 0.2264 mse 0.2134 t 706 new 0.25) lr 1.00e-05 gnorm 0.131 3.09s mem 81.1GB +[2026-09-14 12:33:01] step 2678/5000 loss 0.3044 (w 0.2909 mse 0.2862 t 973 new 0.07) lr 1.00e-05 gnorm 0.170 3.12s mem 81.1GB +[2026-09-14 12:33:04] step 2679/5000 loss 0.1747 (w 0.1877 mse 0.1936 t 862 new 0.18) lr 1.00e-05 gnorm 0.170 3.19s mem 81.1GB +[2026-09-14 12:33:07] step 2680/5000 loss 0.4197 (w 0.2787 mse 0.2681 t 631 new 0.24) lr 1.00e-05 gnorm 0.138 3.11s mem 81.1GB +[2026-09-14 12:33:10] step 2681/5000 loss 0.3289 (w 0.2997 mse 0.2917 t 315 new 0.26) lr 1.00e-05 gnorm 0.144 3.11s mem 81.1GB +[2026-09-14 12:33:13] step 2682/5000 loss 0.1499 (w 0.1015 mse 0.1066 t 996 new 0.24) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +[2026-09-14 12:33:16] step 2683/5000 loss 0.2930 (w 0.2380 mse 0.2278 t 708 new 0.23) lr 1.00e-05 gnorm 0.150 3.30s mem 81.1GB +[2026-09-14 12:33:20] step 2684/5000 loss 0.2366 (w 0.2462 mse 0.2297 t 781 new 0.23) lr 1.00e-05 gnorm 0.141 3.17s mem 81.1GB +[2026-09-14 12:33:23] step 2685/5000 loss 0.1086 (w 0.2518 mse 0.2526 t 945 new 0.20) lr 1.00e-05 gnorm 0.200 3.35s mem 81.1GB +[2026-09-14 12:33:26] step 2686/5000 loss 0.0945 (w 0.3795 mse 0.3809 t 990 new 0.13) lr 1.00e-05 gnorm 0.254 3.44s mem 81.1GB +[2026-09-14 12:33:29] step 2687/5000 loss 0.3665 (w 0.2630 mse 0.2617 t 470 new 0.21) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +[2026-09-14 12:33:32] step 2688/5000 loss 0.2399 (w 0.2461 mse 0.2316 t 847 new 0.24) lr 1.00e-05 gnorm 1.115 3.08s mem 81.1GB +[2026-09-14 12:33:36] step 2689/5000 loss 0.3034 (w 0.2549 mse 0.2517 t 945 new 0.20) lr 1.00e-05 gnorm 0.117 3.41s mem 81.1GB +[2026-09-14 12:33:39] step 2690/5000 loss 0.2653 (w 0.1891 mse 0.1757 t 836 new 0.20) lr 1.00e-05 gnorm 0.166 3.08s mem 81.1GB +[2026-09-14 12:33:42] step 2691/5000 loss 0.1514 (w 0.2059 mse 0.2145 t 995 new 0.19) lr 1.00e-05 gnorm 0.119 3.43s mem 81.1GB +[2026-09-14 12:33:46] step 2692/5000 loss 0.1687 (w 0.2932 mse 0.2665 t 922 new 0.26) lr 1.00e-05 gnorm 0.155 3.39s mem 81.1GB +[2026-09-14 12:33:48] step 2693/5000 loss 0.1171 (w 0.1464 mse 0.1593 t 724 new 0.18) lr 1.00e-05 gnorm 0.166 2.83s mem 81.1GB +[2026-09-14 12:33:51] step 2694/5000 loss 0.2236 (w 0.1436 mse 0.1539 t 482 new 0.18) lr 1.00e-05 gnorm 0.169 3.08s mem 81.1GB +[2026-09-14 12:33:55] step 2695/5000 loss 0.3667 (w 0.2015 mse 0.1949 t 799 new 0.19) lr 1.00e-05 gnorm 0.205 3.07s mem 81.1GB +[2026-09-14 12:33:58] step 2696/5000 loss 0.2776 (w 0.2279 mse 0.2312 t 440 new 0.07) lr 1.00e-05 gnorm 0.135 3.62s mem 81.1GB +[2026-09-14 12:34:01] step 2697/5000 loss 0.1867 (w 0.1693 mse 0.1784 t 698 new 0.18) lr 1.00e-05 gnorm 0.151 3.02s mem 81.1GB +[2026-09-14 12:34:05] step 2698/5000 loss 0.1971 (w 0.1338 mse 0.1499 t 933 new 0.19) lr 1.00e-05 gnorm 0.196 3.34s mem 81.1GB +[2026-09-14 12:34:07] step 2699/5000 loss 0.2958 (w 0.1208 mse 0.1372 t 730 new 0.21) lr 1.00e-05 gnorm 0.151 2.84s mem 81.1GB +[2026-09-14 12:34:11] step 2700/5000 loss 0.2871 (w 0.2524 mse 0.2373 t 899 new 0.23) lr 1.00e-05 gnorm 0.169 3.25s mem 81.1GB +[2026-09-14 12:34:14] step 2701/5000 loss 0.1927 (w 0.2756 mse 0.2695 t 929 new 0.18) lr 1.00e-05 gnorm 0.137 3.46s mem 81.1GB +[2026-09-14 12:34:17] step 2702/5000 loss 0.2456 (w 0.2911 mse 0.2743 t 988 new 0.15) lr 1.00e-05 gnorm 0.152 3.33s mem 81.1GB +[2026-09-14 12:34:21] step 2703/5000 loss 0.1401 (w 0.2368 mse 0.2436 t 961 new 0.22) lr 1.00e-05 gnorm 0.122 3.09s mem 81.1GB +[2026-09-14 12:34:24] step 2704/5000 loss 0.1976 (w 0.2066 mse 0.2001 t 817 new 0.22) lr 1.00e-05 gnorm 0.150 3.36s mem 81.1GB +[2026-09-14 12:34:27] step 2705/5000 loss 0.4261 (w 0.3307 mse 0.3480 t 553 new 0.18) lr 1.00e-05 gnorm 0.124 2.86s mem 81.1GB +[2026-09-14 12:34:30] step 2706/5000 loss 0.2178 (w 0.1703 mse 0.1710 t 760 new 0.19) lr 1.00e-05 gnorm 0.185 3.38s mem 81.1GB +[2026-09-14 12:34:33] step 2707/5000 loss 0.2068 (w 0.1704 mse 0.1687 t 964 new 0.20) lr 1.00e-05 gnorm 0.203 3.06s mem 81.1GB +[2026-09-14 12:34:36] step 2708/5000 loss 0.3063 (w 0.3879 mse 0.3769 t 344 new 0.22) lr 1.00e-05 gnorm 0.183 3.15s mem 81.1GB +[2026-09-14 12:34:39] step 2709/5000 loss 0.1473 (w 0.2715 mse 0.2622 t 944 new 0.16) lr 1.00e-05 gnorm 0.168 3.06s mem 81.1GB +[2026-09-14 12:34:42] step 2710/5000 loss 0.1491 (w 0.1601 mse 0.1496 t 934 new 0.11) lr 1.00e-05 gnorm 0.199 3.09s mem 81.1GB +[2026-09-14 12:34:46] step 2711/5000 loss 0.2955 (w 0.2927 mse 0.3036 t 195 new 0.09) lr 1.00e-05 gnorm 0.941 3.13s mem 81.1GB +[2026-09-14 12:34:49] step 2712/5000 loss 0.1556 (w 0.3667 mse 0.3419 t 991 new 0.21) lr 1.00e-05 gnorm 0.178 3.05s mem 81.1GB +[2026-09-14 12:34:52] step 2713/5000 loss 0.2044 (w 0.1920 mse 0.2086 t 996 new 0.19) lr 1.00e-05 gnorm 0.199 3.10s mem 81.1GB +[2026-09-14 12:34:55] step 2714/5000 loss 0.2669 (w 0.1347 mse 0.1332 t 948 new 0.22) lr 1.00e-05 gnorm 0.188 3.19s mem 81.1GB +[2026-09-14 12:34:58] step 2715/5000 loss 0.2598 (w 0.3567 mse 0.3449 t 978 new 0.24) lr 1.00e-05 gnorm 0.204 3.11s mem 81.1GB +[2026-09-14 12:35:01] step 2716/5000 loss 0.1096 (w 0.1725 mse 0.1603 t 642 new 0.16) lr 1.00e-05 gnorm 0.174 3.05s mem 81.1GB +[2026-09-14 12:35:04] step 2717/5000 loss 0.2707 (w 0.1728 mse 0.1689 t 830 new 0.13) lr 1.00e-05 gnorm 0.138 3.14s mem 81.1GB +[2026-09-14 12:35:07] step 2718/5000 loss 0.2876 (w 0.2776 mse 0.2719 t 601 new 0.11) lr 1.00e-05 gnorm 0.241 3.03s mem 81.1GB +[2026-09-14 12:35:10] step 2719/5000 loss 0.2663 (w 0.2133 mse 0.2050 t 966 new 0.14) lr 1.00e-05 gnorm 0.137 3.05s mem 81.1GB +[2026-09-14 12:35:14] step 2720/5000 loss 0.2154 (w 0.3633 mse 0.3456 t 673 new 0.20) lr 1.00e-05 gnorm 0.106 3.50s mem 81.1GB +[2026-09-14 12:35:17] step 2721/5000 loss 0.2048 (w 0.2062 mse 0.1945 t 641 new 0.16) lr 1.00e-05 gnorm 0.187 3.14s mem 81.1GB +[2026-09-14 12:35:20] step 2722/5000 loss 0.2549 (w 0.1883 mse 0.1935 t 927 new 0.17) lr 1.00e-05 gnorm 0.138 3.16s mem 81.1GB +[2026-09-14 12:35:23] step 2723/5000 loss 0.1929 (w 0.2866 mse 0.2786 t 922 new 0.22) lr 1.00e-05 gnorm 0.172 3.10s mem 81.1GB +[2026-09-14 12:35:26] step 2724/5000 loss 0.2213 (w 0.1861 mse 0.1902 t 702 new 0.21) lr 1.00e-05 gnorm 0.343 3.08s mem 81.1GB +[2026-09-14 12:35:29] step 2725/5000 loss 0.2260 (w 0.1651 mse 0.1620 t 647 new 0.17) lr 1.00e-05 gnorm 0.127 3.07s mem 81.1GB +[2026-09-14 12:35:33] step 2726/5000 loss 0.1292 (w 0.1569 mse 0.1616 t 899 new 0.24) lr 1.00e-05 gnorm 0.630 3.49s mem 81.1GB +[2026-09-14 12:35:36] step 2727/5000 loss 0.1945 (w 0.3337 mse 0.3139 t 998 new 0.25) lr 1.00e-05 gnorm 0.115 3.06s mem 81.1GB +[2026-09-14 12:35:39] step 2728/5000 loss 0.3214 (w 0.2948 mse 0.2921 t 428 new 0.22) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +[2026-09-14 12:35:42] step 2729/5000 loss 0.2556 (w 0.2141 mse 0.2019 t 899 new 0.14) lr 1.00e-05 gnorm 0.192 3.09s mem 81.1GB +[2026-09-14 12:35:45] step 2730/5000 loss 0.3077 (w 0.2036 mse 0.1991 t 781 new 0.23) lr 1.00e-05 gnorm 0.195 3.29s mem 81.1GB +[2026-09-14 12:35:49] step 2731/5000 loss 0.1976 (w 0.1711 mse 0.1702 t 859 new 0.17) lr 1.00e-05 gnorm 0.193 3.12s mem 81.1GB +[2026-09-14 12:35:52] step 2732/5000 loss 0.1745 (w 0.3489 mse 0.3416 t 983 new 0.20) lr 1.00e-05 gnorm 0.138 3.46s mem 81.1GB +[2026-09-14 12:35:55] step 2733/5000 loss 0.2606 (w 0.6570 mse 0.6577 t 140 new 0.21) lr 1.00e-05 gnorm 0.141 3.11s mem 81.1GB +[2026-09-14 12:35:58] step 2734/5000 loss 0.2315 (w 0.1746 mse 0.1680 t 681 new 0.21) lr 1.00e-05 gnorm 0.129 3.12s mem 81.1GB +[2026-09-14 12:36:01] step 2735/5000 loss 0.2562 (w 0.1094 mse 0.1259 t 967 new 0.19) lr 1.00e-05 gnorm 0.123 3.17s mem 81.1GB +[2026-09-14 12:36:05] step 2736/5000 loss 0.2386 (w 0.1807 mse 0.1623 t 860 new 0.14) lr 1.00e-05 gnorm 0.137 3.28s mem 81.1GB +[2026-09-14 12:36:08] step 2737/5000 loss 0.1641 (w 0.3647 mse 0.3402 t 989 new 0.19) lr 1.00e-05 gnorm 0.133 3.34s mem 81.1GB +[2026-09-14 12:36:11] step 2738/5000 loss 0.2400 (w 0.4268 mse 0.4381 t 992 new 0.18) lr 1.00e-05 gnorm 0.142 3.32s mem 81.1GB +[2026-09-14 12:36:14] step 2739/5000 loss 0.0830 (w 0.2143 mse 0.2305 t 997 new 0.22) lr 1.00e-05 gnorm 0.225 3.06s mem 81.1GB +[2026-09-14 12:36:17] step 2740/5000 loss 0.2014 (w 0.2104 mse 0.2266 t 364 new 0.21) lr 1.00e-05 gnorm 0.191 2.84s mem 81.1GB +[2026-09-14 12:36:20] step 2741/5000 loss 0.1300 (w 0.2154 mse 0.1999 t 776 new 0.25) lr 1.00e-05 gnorm 0.119 3.06s mem 81.1GB +[2026-09-14 12:36:24] step 2742/5000 loss 0.1759 (w 0.2658 mse 0.2480 t 880 new 0.24) lr 1.00e-05 gnorm 0.132 3.37s mem 81.1GB +[2026-09-14 12:36:27] step 2743/5000 loss 0.1054 (w 0.0893 mse 0.0858 t 975 new 0.22) lr 1.00e-05 gnorm 0.633 3.27s mem 81.1GB +[2026-09-14 12:36:30] step 2744/5000 loss 0.1551 (w 0.1493 mse 0.1414 t 849 new 0.14) lr 1.00e-05 gnorm 0.149 3.29s mem 81.1GB +[2026-09-14 12:36:33] step 2745/5000 loss 0.1040 (w 0.2806 mse 0.2659 t 984 new 0.23) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +[2026-09-14 12:36:36] step 2746/5000 loss 0.2731 (w 0.2921 mse 0.2843 t 982 new 0.17) lr 1.00e-05 gnorm 0.452 2.84s mem 81.1GB +[2026-09-14 12:36:40] step 2747/5000 loss 0.2005 (w 0.2132 mse 0.2051 t 800 new 0.18) lr 1.00e-05 gnorm 0.121 3.41s mem 81.1GB +[2026-09-14 12:36:43] step 2748/5000 loss 0.4219 (w 0.1984 mse 0.1851 t 888 new 0.19) lr 1.00e-05 gnorm 0.165 3.13s mem 81.1GB +[2026-09-14 12:36:46] step 2749/5000 loss 0.2095 (w 0.1661 mse 0.1728 t 959 new 0.17) lr 1.00e-05 gnorm 0.123 3.17s mem 81.1GB +[2026-09-14 12:36:49] step 2750/5000 loss 0.1962 (w 0.1738 mse 0.1763 t 945 new 0.21) lr 1.00e-05 gnorm 0.209 3.34s mem 81.1GB +[2026-09-14 12:36:52] step 2751/5000 loss 0.2271 (w 0.1759 mse 0.1897 t 989 new 0.17) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +[2026-09-14 12:36:56] step 2752/5000 loss 0.1883 (w 0.1881 mse 0.1792 t 944 new 0.18) lr 1.00e-05 gnorm 0.159 3.19s mem 81.1GB +[2026-09-14 12:36:59] step 2753/5000 loss 0.1643 (w 0.1793 mse 0.1903 t 986 new 0.22) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +[2026-09-14 12:37:02] step 2754/5000 loss 0.3170 (w 0.2891 mse 0.2797 t 734 new 0.20) lr 1.00e-05 gnorm 0.125 2.83s mem 81.1GB +[2026-09-14 12:37:05] step 2755/5000 loss 0.2693 (w 0.2372 mse 0.2338 t 710 new 0.30) lr 1.00e-05 gnorm 0.268 3.34s mem 81.1GB +[2026-09-14 12:37:09] step 2756/5000 loss 0.3308 (w 0.3447 mse 0.3379 t 348 new 0.22) lr 1.00e-05 gnorm 0.174 3.21s mem 81.1GB +[2026-09-14 12:37:12] step 2757/5000 loss 0.2818 (w 0.2210 mse 0.2130 t 712 new 0.10) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +[2026-09-14 12:37:15] step 2758/5000 loss 0.1131 (w 0.2482 mse 0.2535 t 951 new 0.17) lr 1.00e-05 gnorm 0.137 3.17s mem 81.1GB +[2026-09-14 12:37:18] step 2759/5000 loss 0.1971 (w 0.1358 mse 0.1335 t 755 new 0.20) lr 1.00e-05 gnorm 0.148 3.06s mem 81.1GB +[2026-09-14 12:37:21] step 2760/5000 loss 0.1714 (w 0.1221 mse 0.1307 t 703 new 0.16) lr 1.00e-05 gnorm 0.206 2.84s mem 81.1GB +[2026-09-14 12:37:24] step 2761/5000 loss 0.1686 (w 0.1454 mse 0.1440 t 822 new 0.13) lr 1.00e-05 gnorm 0.146 3.44s mem 81.1GB +[2026-09-14 12:37:27] step 2762/5000 loss 0.2332 (w 0.2548 mse 0.2611 t 977 new 0.19) lr 1.00e-05 gnorm 0.138 3.09s mem 81.1GB +[2026-09-14 12:37:30] step 2763/5000 loss 0.1378 (w 0.2019 mse 0.2059 t 891 new 0.22) lr 1.00e-05 gnorm 0.191 3.07s mem 81.1GB +[2026-09-14 12:37:33] step 2764/5000 loss 0.3523 (w 0.2803 mse 0.2596 t 949 new 0.19) lr 1.00e-05 gnorm 0.168 3.07s mem 81.1GB +[2026-09-14 12:37:37] step 2765/5000 loss 0.2984 (w 0.1756 mse 0.1685 t 553 new 0.23) lr 1.00e-05 gnorm 0.138 3.11s mem 81.1GB +[2026-09-14 12:37:39] step 2766/5000 loss 0.2513 (w 0.2119 mse 0.2030 t 971 new 0.14) lr 1.00e-05 gnorm 0.171 2.85s mem 81.1GB +[2026-09-14 12:37:43] step 2767/5000 loss 0.3282 (w 0.1676 mse 0.1695 t 782 new 0.25) lr 1.00e-05 gnorm 0.345 3.44s mem 81.1GB +[2026-09-14 12:37:46] step 2768/5000 loss 0.2572 (w 0.2525 mse 0.2475 t 444 new 0.21) lr 1.00e-05 gnorm 0.131 3.13s mem 81.1GB +[2026-09-14 12:37:49] step 2769/5000 loss 0.2062 (w 0.1696 mse 0.1659 t 927 new 0.15) lr 1.00e-05 gnorm 0.152 2.85s mem 81.1GB +[2026-09-14 12:37:52] step 2770/5000 loss 0.1094 (w 0.1712 mse 0.1677 t 865 new 0.27) lr 1.00e-05 gnorm 0.162 3.16s mem 81.1GB +[2026-09-14 12:37:55] step 2771/5000 loss 0.1739 (w 0.1302 mse 0.1310 t 904 new 0.12) lr 1.00e-05 gnorm 0.161 3.41s mem 81.1GB +[2026-09-14 12:37:59] step 2772/5000 loss 0.2280 (w 0.2100 mse 0.2048 t 910 new 0.19) lr 1.00e-05 gnorm 0.278 3.29s mem 81.1GB +[2026-09-14 12:38:02] step 2773/5000 loss 0.2897 (w 0.4160 mse 0.4064 t 297 new 0.12) lr 1.00e-05 gnorm 0.147 3.06s mem 81.1GB +[2026-09-14 12:38:05] step 2774/5000 loss 0.1975 (w 0.1393 mse 0.1395 t 954 new 0.22) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +[2026-09-14 12:38:08] step 2775/5000 loss 0.1843 (w 0.1704 mse 0.1667 t 792 new 0.17) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +[2026-09-14 12:38:11] step 2776/5000 loss 0.2552 (w 0.2224 mse 0.2157 t 924 new 0.26) lr 1.00e-05 gnorm 0.145 3.17s mem 81.1GB +[2026-09-14 12:38:14] step 2777/5000 loss 0.1617 (w 0.2057 mse 0.2024 t 911 new 0.19) lr 1.00e-05 gnorm 0.169 3.06s mem 81.1GB +[2026-09-14 12:38:17] step 2778/5000 loss 0.2359 (w 0.3179 mse 0.3253 t 947 new 0.17) lr 1.00e-05 gnorm 0.151 3.14s mem 81.1GB +[2026-09-14 12:38:20] step 2779/5000 loss 0.1983 (w 0.3279 mse 0.3382 t 238 new 0.28) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +[2026-09-14 12:38:23] step 2780/5000 loss 0.1836 (w 0.1864 mse 0.1879 t 898 new 0.17) lr 1.00e-05 gnorm 0.186 3.14s mem 81.1GB +[2026-09-14 12:38:26] step 2781/5000 loss 0.2188 (w 0.2186 mse 0.2185 t 949 new 0.18) lr 1.00e-05 gnorm 0.864 2.83s mem 81.1GB +[2026-09-14 12:38:29] step 2782/5000 loss 0.2177 (w 0.1829 mse 0.2013 t 974 new 0.10) lr 1.00e-05 gnorm 0.158 3.14s mem 81.1GB +[2026-09-14 12:38:32] step 2783/5000 loss 0.3259 (w 0.2698 mse 0.2684 t 440 new 0.14) lr 1.00e-05 gnorm 0.130 3.11s mem 81.1GB +[2026-09-14 12:38:36] step 2784/5000 loss 0.1002 (w 0.1805 mse 0.1750 t 913 new 0.15) lr 1.00e-05 gnorm 0.245 3.15s mem 81.1GB +[2026-09-14 12:38:39] step 2785/5000 loss 0.3835 (w 0.3220 mse 0.3188 t 310 new 0.19) lr 1.00e-05 gnorm 0.980 3.12s mem 81.1GB +[2026-09-14 12:38:42] step 2786/5000 loss 0.2395 (w 0.2267 mse 0.2202 t 827 new 0.24) lr 1.00e-05 gnorm 0.142 3.30s mem 81.1GB +[2026-09-14 12:38:45] step 2787/5000 loss 0.2907 (w 0.1503 mse 0.1478 t 717 new 0.23) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +[2026-09-14 12:38:48] step 2788/5000 loss 0.1812 (w 0.2577 mse 0.2679 t 982 new 0.23) lr 1.00e-05 gnorm 0.135 3.39s mem 81.1GB +[2026-09-14 12:38:51] step 2789/5000 loss 0.2662 (w 0.2053 mse 0.1922 t 910 new 0.21) lr 1.00e-05 gnorm 0.147 3.04s mem 81.1GB +[2026-09-14 12:38:55] step 2790/5000 loss 0.2030 (w 0.1223 mse 0.1257 t 800 new 0.24) lr 1.00e-05 gnorm 0.197 3.19s mem 81.1GB +[2026-09-14 12:38:57] step 2791/5000 loss 0.1488 (w 0.1534 mse 0.1500 t 977 new 0.22) lr 1.00e-05 gnorm 0.152 2.83s mem 81.1GB +[2026-09-14 12:39:01] step 2792/5000 loss 0.2816 (w 0.1094 mse 0.1101 t 886 new 0.20) lr 1.00e-05 gnorm 0.148 3.14s mem 81.1GB +[2026-09-14 12:39:03] step 2793/5000 loss 0.2236 (w 0.1951 mse 0.1860 t 960 new 0.26) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +[2026-09-14 12:39:07] step 2794/5000 loss 0.1958 (w 0.2489 mse 0.2467 t 808 new 0.17) lr 1.00e-05 gnorm 0.113 3.34s mem 81.1GB +[2026-09-14 12:39:10] step 2795/5000 loss 0.2256 (w 0.3153 mse 0.3198 t 972 new 0.13) lr 1.00e-05 gnorm 0.188 3.10s mem 81.1GB +[2026-09-14 12:39:13] step 2796/5000 loss 0.3715 (w 0.1593 mse 0.1566 t 722 new 0.22) lr 1.00e-05 gnorm 0.268 3.24s mem 81.1GB +[2026-09-14 12:39:16] step 2797/5000 loss 0.1944 (w 0.2798 mse 0.2750 t 968 new 0.14) lr 1.00e-05 gnorm 0.199 3.06s mem 81.1GB +[2026-09-14 12:39:19] step 2798/5000 loss 0.2721 (w 0.3684 mse 0.3462 t 978 new 0.22) lr 1.00e-05 gnorm 0.143 3.12s mem 81.1GB +[2026-09-14 12:39:22] step 2799/5000 loss 0.2493 (w 0.1478 mse 0.1519 t 781 new 0.22) lr 1.00e-05 gnorm 0.154 2.82s mem 81.1GB +[2026-09-14 12:39:25] step 2800/5000 loss 0.1693 (w 0.0864 mse 0.0903 t 492 new 0.26) lr 1.00e-05 gnorm 0.123 3.31s mem 81.1GB +[2026-09-14 12:39:29] step 2801/5000 loss 0.2422 (w 0.1754 mse 0.1865 t 809 new 0.22) lr 1.00e-05 gnorm 0.133 3.09s mem 81.1GB +[2026-09-14 12:39:32] step 2802/5000 loss 0.3281 (w 0.3025 mse 0.2963 t 653 new 0.22) lr 1.00e-05 gnorm 0.172 3.43s mem 81.1GB +[2026-09-14 12:39:35] step 2803/5000 loss 0.1801 (w 0.3274 mse 0.3417 t 238 new 0.17) lr 1.00e-05 gnorm 0.216 3.07s mem 81.1GB +[2026-09-14 12:39:38] step 2804/5000 loss 0.2259 (w 0.1509 mse 0.1507 t 725 new 0.25) lr 1.00e-05 gnorm 0.346 3.13s mem 81.1GB +[2026-09-14 12:39:41] step 2805/5000 loss 0.2447 (w 0.4396 mse 0.4214 t 998 new 0.21) lr 1.00e-05 gnorm 0.278 3.13s mem 81.1GB +[2026-09-14 12:39:45] step 2806/5000 loss 0.2120 (w 0.4586 mse 0.4396 t 988 new 0.22) lr 1.00e-05 gnorm 0.163 3.42s mem 81.1GB +[2026-09-14 12:39:48] step 2807/5000 loss 0.2199 (w 0.2341 mse 0.2378 t 623 new 0.21) lr 1.00e-05 gnorm 0.191 2.84s mem 81.1GB +[2026-09-14 12:39:51] step 2808/5000 loss 0.1000 (w 0.1442 mse 0.1347 t 914 new 0.21) lr 1.00e-05 gnorm 0.133 3.37s mem 81.1GB +[2026-09-14 12:39:54] step 2809/5000 loss 0.5023 (w 0.3244 mse 0.3165 t 440 new 0.22) lr 1.00e-05 gnorm 0.173 3.05s mem 81.1GB +[2026-09-14 12:39:57] step 2810/5000 loss 0.3002 (w 0.1834 mse 0.1718 t 677 new 0.22) lr 1.00e-05 gnorm 0.129 3.05s mem 81.1GB +[2026-09-14 12:40:00] step 2811/5000 loss 0.3191 (w 0.2304 mse 0.2271 t 975 new 0.20) lr 1.00e-05 gnorm 0.126 3.13s mem 81.1GB +[2026-09-14 12:40:04] step 2812/5000 loss 0.3703 (w 0.2272 mse 0.2162 t 888 new 0.21) lr 1.00e-05 gnorm 0.148 3.37s mem 81.1GB +[2026-09-14 12:40:06] step 2813/5000 loss 0.3389 (w 0.2227 mse 0.2191 t 865 new 0.16) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +[2026-09-14 12:40:10] step 2814/5000 loss 0.3413 (w 0.2374 mse 0.2375 t 434 new 0.19) lr 1.00e-05 gnorm 0.169 3.14s mem 81.1GB +[2026-09-14 12:40:13] step 2815/5000 loss 0.2537 (w 0.2685 mse 0.2650 t 557 new 0.18) lr 1.00e-05 gnorm 0.223 3.08s mem 81.1GB +[2026-09-14 12:40:16] step 2816/5000 loss 0.0963 (w 0.1260 mse 0.1304 t 936 new 0.15) lr 1.00e-05 gnorm 0.159 3.08s mem 81.1GB +[2026-09-14 12:40:19] step 2817/5000 loss 0.2074 (w 0.1396 mse 0.1428 t 927 new 0.22) lr 1.00e-05 gnorm 0.144 3.11s mem 81.1GB +[2026-09-14 12:40:22] step 2818/5000 loss 0.2034 (w 0.2360 mse 0.2369 t 765 new 0.20) lr 1.00e-05 gnorm 0.138 3.42s mem 81.1GB +[2026-09-14 12:40:25] step 2819/5000 loss 0.1762 (w 0.1625 mse 0.1653 t 932 new 0.18) lr 1.00e-05 gnorm 0.164 2.83s mem 81.1GB +[2026-09-14 12:40:28] step 2820/5000 loss 0.0984 (w 0.1993 mse 0.1866 t 933 new 0.21) lr 1.00e-05 gnorm 0.192 3.05s mem 81.1GB +[2026-09-14 12:40:32] step 2821/5000 loss 0.3370 (w 0.2312 mse 0.2208 t 729 new 0.18) lr 1.00e-05 gnorm 0.131 3.14s mem 81.1GB +[2026-09-14 12:40:35] step 2822/5000 loss 0.2037 (w 0.2656 mse 0.2746 t 401 new 0.19) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +[2026-09-14 12:40:38] step 2823/5000 loss 0.3154 (w 0.3812 mse 0.3854 t 1000 new 0.23) lr 1.00e-05 gnorm 0.140 3.06s mem 81.1GB +[2026-09-14 12:40:41] step 2824/5000 loss 0.2770 (w 0.2887 mse 0.2940 t 535 new 0.17) lr 1.00e-05 gnorm 0.223 3.08s mem 81.1GB +[2026-09-14 12:40:44] step 2825/5000 loss 0.2429 (w 0.2820 mse 0.2721 t 564 new 0.24) lr 1.00e-05 gnorm 0.151 3.31s mem 81.1GB +[2026-09-14 12:40:47] step 2826/5000 loss 0.3374 (w 0.2700 mse 0.2540 t 557 new 0.21) lr 1.00e-05 gnorm 0.152 3.09s mem 81.1GB +[2026-09-14 12:40:50] step 2827/5000 loss 0.2469 (w 0.2715 mse 0.2629 t 617 new 0.14) lr 1.00e-05 gnorm 0.145 3.17s mem 81.1GB +[2026-09-14 12:40:53] step 2828/5000 loss 0.4019 (w 0.3950 mse 0.3948 t 364 new 0.14) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +[2026-09-14 12:40:56] step 2829/5000 loss 0.2392 (w 0.2230 mse 0.2135 t 703 new 0.20) lr 1.00e-05 gnorm 0.258 3.12s mem 81.1GB +[2026-09-14 12:40:59] step 2830/5000 loss 0.2880 (w 0.2013 mse 0.1837 t 840 new 0.23) lr 1.00e-05 gnorm 0.219 3.11s mem 81.1GB +[2026-09-14 12:41:03] step 2831/5000 loss 0.2112 (w 0.3231 mse 0.3318 t 975 new 0.17) lr 1.00e-05 gnorm 0.271 3.24s mem 81.1GB +[2026-09-14 12:41:05] step 2832/5000 loss 0.1325 (w 0.2081 mse 0.2170 t 985 new 0.27) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +[2026-09-14 12:41:09] step 2833/5000 loss 0.2254 (w 0.2385 mse 0.2234 t 941 new 0.15) lr 1.00e-05 gnorm 0.143 3.33s mem 81.1GB +[2026-09-14 12:41:12] step 2834/5000 loss 0.3844 (w 0.2030 mse 0.1958 t 702 new 0.13) lr 1.00e-05 gnorm 0.193 2.83s mem 81.1GB +[2026-09-14 12:41:15] step 2835/5000 loss 0.3997 (w 0.1887 mse 0.1995 t 702 new 0.22) lr 1.00e-05 gnorm 0.153 3.13s mem 81.1GB +[2026-09-14 12:41:18] step 2836/5000 loss 0.2609 (w 0.3135 mse 0.2916 t 936 new 0.24) lr 1.00e-05 gnorm 0.176 2.82s mem 81.1GB +[2026-09-14 12:41:21] step 2837/5000 loss 0.3189 (w 0.1672 mse 0.1548 t 799 new 0.21) lr 1.00e-05 gnorm 0.130 3.17s mem 81.1GB +[2026-09-14 12:41:24] step 2838/5000 loss 0.1538 (w 0.1675 mse 0.1607 t 933 new 0.23) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-14 12:41:27] step 2839/5000 loss 0.3245 (w 0.2064 mse 0.1990 t 865 new 0.20) lr 1.00e-05 gnorm 0.167 3.36s mem 81.1GB +[2026-09-14 12:41:30] step 2840/5000 loss 0.0934 (w 0.2252 mse 0.2137 t 943 new 0.13) lr 1.00e-05 gnorm 0.215 2.84s mem 81.1GB +[2026-09-14 12:41:33] step 2841/5000 loss 0.2033 (w 0.1410 mse 0.1500 t 936 new 0.23) lr 1.00e-05 gnorm 0.150 3.43s mem 81.1GB +[2026-09-14 12:41:36] step 2842/5000 loss 0.2248 (w 0.1466 mse 0.1391 t 870 new 0.24) lr 1.00e-05 gnorm 0.224 2.84s mem 81.1GB +[2026-09-14 12:41:39] step 2843/5000 loss 0.2269 (w 0.4510 mse 0.4514 t 988 new 0.20) lr 1.00e-05 gnorm 0.201 3.24s mem 81.1GB +[2026-09-14 12:41:42] step 2844/5000 loss 0.2971 (w 0.1406 mse 0.1388 t 775 new 0.17) lr 1.00e-05 gnorm 0.187 2.84s mem 81.1GB +[2026-09-14 12:41:46] step 2845/5000 loss 0.3041 (w 0.2049 mse 0.2028 t 726 new 0.22) lr 1.00e-05 gnorm 0.150 3.17s mem 81.1GB +[2026-09-14 12:41:48] step 2846/5000 loss 0.1686 (w 0.2291 mse 0.2179 t 931 new 0.27) lr 1.00e-05 gnorm 0.272 2.83s mem 81.1GB +[2026-09-14 12:41:52] step 2847/5000 loss 0.2033 (w 0.4030 mse 0.3895 t 983 new 0.17) lr 1.00e-05 gnorm 0.167 3.41s mem 81.1GB +[2026-09-14 12:41:55] step 2848/5000 loss 0.1939 (w 0.1838 mse 0.1791 t 889 new 0.20) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +[2026-09-14 12:41:58] step 2849/5000 loss 0.2147 (w 0.4034 mse 0.3959 t 999 new 0.24) lr 1.00e-05 gnorm 0.220 3.52s mem 81.1GB +[2026-09-14 12:42:01] step 2850/5000 loss 0.2108 (w 0.2268 mse 0.2225 t 974 new 0.21) lr 1.00e-05 gnorm 0.155 3.05s mem 81.1GB +[2026-09-14 12:42:04] step 2851/5000 loss 0.1997 (w 0.2441 mse 0.2268 t 872 new 0.22) lr 1.00e-05 gnorm 0.148 3.11s mem 81.1GB +[2026-09-14 12:42:07] step 2852/5000 loss 0.1614 (w 0.1741 mse 0.1723 t 866 new 0.21) lr 1.00e-05 gnorm 0.169 2.85s mem 81.1GB +[2026-09-14 12:42:11] step 2853/5000 loss 0.1619 (w 0.1822 mse 0.1800 t 887 new 0.21) lr 1.00e-05 gnorm 0.144 3.41s mem 81.1GB +[2026-09-14 12:42:13] step 2854/5000 loss 0.3619 (w 0.2917 mse 0.2786 t 462 new 0.15) lr 1.00e-05 gnorm 0.178 2.85s mem 81.1GB +[2026-09-14 12:42:17] step 2855/5000 loss 0.3788 (w 0.1413 mse 0.1453 t 821 new 0.15) lr 1.00e-05 gnorm 0.143 3.24s mem 81.1GB +[2026-09-14 12:42:20] step 2856/5000 loss 0.2862 (w 0.3111 mse 0.3149 t 473 new 0.27) lr 1.00e-05 gnorm 0.134 3.23s mem 81.1GB +[2026-09-14 12:42:23] step 2857/5000 loss 0.3845 (w 0.2269 mse 0.2342 t 440 new 0.24) lr 1.00e-05 gnorm 0.141 3.10s mem 81.1GB +[2026-09-14 12:42:26] step 2858/5000 loss 0.2491 (w 0.2523 mse 0.2366 t 923 new 0.22) lr 1.00e-05 gnorm 0.204 2.84s mem 81.1GB +[2026-09-14 12:42:29] step 2859/5000 loss 0.2790 (w 0.2710 mse 0.2577 t 892 new 0.23) lr 1.00e-05 gnorm 0.188 3.11s mem 81.1GB +[2026-09-14 12:42:32] step 2860/5000 loss 0.2922 (w 0.2501 mse 0.2620 t 973 new 0.21) lr 1.00e-05 gnorm 0.123 2.83s mem 81.1GB +[2026-09-14 12:42:35] step 2861/5000 loss 0.2549 (w 0.1998 mse 0.1897 t 838 new 0.23) lr 1.00e-05 gnorm 0.130 3.16s mem 81.1GB +[2026-09-14 12:42:38] step 2862/5000 loss 0.2548 (w 0.2899 mse 0.2821 t 933 new 0.16) lr 1.00e-05 gnorm 0.165 3.16s mem 81.1GB +[2026-09-14 12:42:41] step 2863/5000 loss 0.2952 (w 0.1612 mse 0.1752 t 967 new 0.21) lr 1.00e-05 gnorm 0.343 3.07s mem 81.1GB +[2026-09-14 12:42:44] step 2864/5000 loss 0.1991 (w 0.2178 mse 0.2069 t 903 new 0.23) lr 1.00e-05 gnorm 0.137 2.83s mem 81.1GB +[2026-09-14 12:42:47] step 2865/5000 loss 0.2385 (w 0.1949 mse 0.2032 t 562 new 0.21) lr 1.00e-05 gnorm 0.138 3.12s mem 81.1GB +[2026-09-14 12:42:51] step 2866/5000 loss 0.3197 (w 0.1700 mse 0.1673 t 834 new 0.16) lr 1.00e-05 gnorm 0.152 3.34s mem 81.1GB +[2026-09-14 12:42:54] step 2867/5000 loss 0.2118 (w 0.1860 mse 0.2013 t 978 new 0.22) lr 1.00e-05 gnorm 0.124 3.04s mem 81.1GB +[2026-09-14 12:42:57] step 2868/5000 loss 0.2207 (w 0.1268 mse 0.1222 t 802 new 0.13) lr 1.00e-05 gnorm 0.150 3.14s mem 81.1GB +[2026-09-14 12:43:00] step 2869/5000 loss 0.2301 (w 0.3631 mse 0.3466 t 940 new 0.17) lr 1.00e-05 gnorm 0.125 3.08s mem 81.1GB +[2026-09-14 12:43:03] step 2870/5000 loss 0.2176 (w 0.1727 mse 0.1725 t 983 new 0.21) lr 1.00e-05 gnorm 0.129 3.18s mem 81.1GB +[2026-09-14 12:43:06] step 2871/5000 loss 0.3284 (w 0.2456 mse 0.2332 t 753 new 0.17) lr 1.00e-05 gnorm 0.362 2.84s mem 81.1GB +[2026-09-14 12:43:09] step 2872/5000 loss 0.2674 (w 0.2431 mse 0.2229 t 923 new 0.21) lr 1.00e-05 gnorm 0.144 3.17s mem 81.1GB +[2026-09-14 12:43:12] step 2873/5000 loss 0.2781 (w 0.2821 mse 0.2676 t 921 new 0.24) lr 1.00e-05 gnorm 0.310 3.08s mem 81.1GB +[2026-09-14 12:43:15] step 2874/5000 loss 0.1036 (w 0.2544 mse 0.2441 t 949 new 0.26) lr 1.00e-05 gnorm 0.211 3.07s mem 81.1GB +[2026-09-14 12:43:18] step 2875/5000 loss 0.3716 (w 0.2333 mse 0.2156 t 694 new 0.21) lr 1.00e-05 gnorm 0.417 3.19s mem 81.1GB +[2026-09-14 12:43:22] step 2876/5000 loss 0.2033 (w 0.2050 mse 0.2212 t 953 new 0.19) lr 1.00e-05 gnorm 0.133 3.13s mem 81.1GB +[2026-09-14 12:43:24] step 2877/5000 loss 0.1564 (w 0.1803 mse 0.1881 t 821 new 0.19) lr 1.00e-05 gnorm 0.170 2.84s mem 81.1GB +[2026-09-14 12:43:28] step 2878/5000 loss 0.1486 (w 0.3205 mse 0.3166 t 954 new 0.23) lr 1.00e-05 gnorm 0.252 3.10s mem 81.1GB +[2026-09-14 12:43:30] step 2879/5000 loss 0.1993 (w 0.2792 mse 0.2709 t 974 new 0.22) lr 1.00e-05 gnorm 0.159 2.82s mem 81.1GB +[2026-09-14 12:43:34] step 2880/5000 loss 0.3715 (w 0.1625 mse 0.1786 t 981 new 0.11) lr 1.00e-05 gnorm 0.162 3.39s mem 81.1GB +[2026-09-14 12:43:37] step 2881/5000 loss 0.1897 (w 0.1125 mse 0.1109 t 972 new 0.25) lr 1.00e-05 gnorm 0.191 2.83s mem 81.1GB +[2026-09-14 12:43:40] step 2882/5000 loss 0.1451 (w 0.1434 mse 0.1477 t 858 new 0.15) lr 1.00e-05 gnorm 0.170 3.08s mem 81.1GB +[2026-09-14 12:43:43] step 2883/5000 loss 0.1292 (w 0.1803 mse 0.1731 t 961 new 0.16) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +[2026-09-14 12:43:46] step 2884/5000 loss 0.1256 (w 0.2441 mse 0.2308 t 991 new 0.24) lr 1.00e-05 gnorm 0.211 3.16s mem 81.1GB +[2026-09-14 12:43:49] step 2885/5000 loss 0.2635 (w 0.2904 mse 0.2879 t 992 new 0.18) lr 1.00e-05 gnorm 0.160 2.84s mem 81.1GB +[2026-09-14 12:43:52] step 2886/5000 loss 0.2370 (w 0.1345 mse 0.1345 t 901 new 0.00) lr 1.00e-05 gnorm 0.500 3.34s mem 81.1GB +[2026-09-14 12:43:55] step 2887/5000 loss 0.2277 (w 0.2024 mse 0.2072 t 979 new 0.24) lr 1.00e-05 gnorm 0.105 2.83s mem 81.1GB +[2026-09-14 12:43:58] step 2888/5000 loss 0.3695 (w 0.2712 mse 0.2684 t 830 new 0.18) lr 1.00e-05 gnorm 0.151 3.10s mem 81.1GB +[2026-09-14 12:44:01] step 2889/5000 loss 0.2011 (w 0.2348 mse 0.2223 t 921 new 0.22) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +[2026-09-14 12:44:04] step 2890/5000 loss 0.1552 (w 0.2101 mse 0.2174 t 748 new 0.14) lr 1.00e-05 gnorm 0.125 3.32s mem 81.1GB +[2026-09-14 12:44:07] step 2891/5000 loss 0.3929 (w 0.5334 mse 0.5591 t 134 new 0.16) lr 1.00e-05 gnorm 0.177 2.83s mem 81.1GB +[2026-09-14 12:44:10] step 2892/5000 loss 0.1677 (w 0.2813 mse 0.2742 t 979 new 0.22) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +[2026-09-14 12:44:13] step 2893/5000 loss 0.1089 (w 0.1422 mse 0.1363 t 926 new 0.18) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +[2026-09-14 12:44:16] step 2894/5000 loss 0.1582 (w 0.2296 mse 0.2086 t 974 new 0.11) lr 1.00e-05 gnorm 0.163 3.38s mem 81.1GB +[2026-09-14 12:44:19] step 2895/5000 loss 0.2643 (w 0.1040 mse 0.1155 t 910 new 0.17) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +[2026-09-14 12:44:22] step 2896/5000 loss 0.1127 (w 0.3022 mse 0.2924 t 993 new 0.24) lr 1.00e-05 gnorm 0.183 3.33s mem 81.1GB +[2026-09-14 12:44:26] step 2897/5000 loss 0.2103 (w 0.1574 mse 0.1545 t 997 new 0.22) lr 1.00e-05 gnorm 0.227 3.10s mem 81.1GB +[2026-09-14 12:44:29] step 2898/5000 loss 0.3467 (w 0.2313 mse 0.2257 t 762 new 0.10) lr 1.00e-05 gnorm 0.155 3.12s mem 81.1GB +[2026-09-14 12:44:32] step 2899/5000 loss 0.2732 (w 0.2555 mse 0.2569 t 709 new 0.18) lr 1.00e-05 gnorm 0.226 3.15s mem 81.1GB +[2026-09-14 12:44:35] step 2900/5000 loss 0.2920 (w 0.2488 mse 0.2367 t 877 new 0.19) lr 1.00e-05 gnorm 0.131 3.38s mem 81.1GB +[2026-09-14 12:44:38] step 2901/5000 loss 0.1169 (w 0.2627 mse 0.2584 t 984 new 0.28) lr 1.00e-05 gnorm 0.120 2.84s mem 81.1GB +[2026-09-14 12:44:41] step 2902/5000 loss 0.2728 (w 0.3515 mse 0.3533 t 244 new 0.01) lr 1.00e-05 gnorm 0.113 3.34s mem 81.1GB +[2026-09-14 12:44:45] step 2903/5000 loss 0.3003 (w 0.3705 mse 0.3566 t 981 new 0.21) lr 1.00e-05 gnorm 0.215 3.11s mem 81.1GB +[2026-09-14 12:44:48] step 2904/5000 loss 0.2850 (w 0.1191 mse 0.1185 t 998 new 0.14) lr 1.00e-05 gnorm 0.125 3.08s mem 81.1GB +[2026-09-14 12:44:51] step 2905/5000 loss 0.1505 (w 0.2242 mse 0.2110 t 993 new 0.24) lr 1.00e-05 gnorm 0.154 3.07s mem 81.1GB +[2026-09-14 12:44:54] step 2906/5000 loss 0.1257 (w 0.2134 mse 0.2127 t 892 new 0.09) lr 1.00e-05 gnorm 0.153 3.06s mem 81.1GB +[2026-09-14 12:44:57] step 2907/5000 loss 0.0380 (w 0.2573 mse 0.2787 t 999 new 0.17) lr 1.00e-05 gnorm 0.085 2.84s mem 81.1GB +[2026-09-14 12:45:00] step 2908/5000 loss 0.1148 (w 0.2078 mse 0.2071 t 1000 new 0.08) lr 1.00e-05 gnorm 0.112 3.37s mem 81.1GB +[2026-09-14 12:45:04] step 2909/5000 loss 0.2444 (w 0.2357 mse 0.2311 t 875 new 0.20) lr 1.00e-05 gnorm 0.133 3.36s mem 81.1GB +[2026-09-14 12:45:06] step 2910/5000 loss 0.1714 (w 0.1195 mse 0.1383 t 981 new 0.16) lr 1.00e-05 gnorm 0.207 2.85s mem 81.1GB +[2026-09-14 12:45:10] step 2911/5000 loss 0.2213 (w 0.1573 mse 0.1723 t 926 new 0.24) lr 1.00e-05 gnorm 0.218 3.15s mem 81.1GB +[2026-09-14 12:45:13] step 2912/5000 loss 0.3130 (w 0.1233 mse 0.1304 t 557 new 0.09) lr 1.00e-05 gnorm 0.226 3.07s mem 81.1GB +[2026-09-14 12:45:15] step 2913/5000 loss 0.1329 (w 0.2580 mse 0.2409 t 768 new 0.24) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +[2026-09-14 12:45:19] step 2914/5000 loss 0.1233 (w 0.3232 mse 0.3301 t 946 new 0.19) lr 1.00e-05 gnorm 0.156 3.17s mem 81.1GB +[2026-09-14 12:45:22] step 2915/5000 loss 0.3143 (w 0.2685 mse 0.2669 t 748 new 0.23) lr 1.00e-05 gnorm 0.192 3.34s mem 81.1GB +[2026-09-14 12:45:25] step 2916/5000 loss 0.1954 (w 0.3184 mse 0.2988 t 957 new 0.26) lr 1.00e-05 gnorm 0.155 2.84s mem 81.1GB +[2026-09-14 12:45:28] step 2917/5000 loss 0.2321 (w 0.2041 mse 0.2002 t 850 new 0.22) lr 1.00e-05 gnorm 0.168 3.34s mem 81.1GB +[2026-09-14 12:45:31] step 2918/5000 loss 0.2316 (w 0.2634 mse 0.2541 t 944 new 0.16) lr 1.00e-05 gnorm 0.154 3.13s mem 81.1GB +[2026-09-14 12:45:34] step 2919/5000 loss 0.2117 (w 0.3183 mse 0.2924 t 988 new 0.23) lr 1.00e-05 gnorm 0.183 3.11s mem 81.1GB +[2026-09-14 12:45:37] step 2920/5000 loss 0.2907 (w 0.3436 mse 0.3423 t 967 new 0.12) lr 1.00e-05 gnorm 0.195 3.10s mem 81.1GB +[2026-09-14 12:45:41] step 2921/5000 loss 0.1604 (w 0.1217 mse 0.1212 t 923 new 0.11) lr 1.00e-05 gnorm 0.126 3.65s mem 81.1GB +[2026-09-14 12:45:44] step 2922/5000 loss 0.3294 (w 0.1453 mse 0.1585 t 677 new 0.19) lr 1.00e-05 gnorm 0.231 2.83s mem 81.1GB +[2026-09-14 12:45:47] step 2923/5000 loss 0.3552 (w 0.1243 mse 0.1296 t 815 new 0.27) lr 1.00e-05 gnorm 0.233 3.41s mem 81.1GB +[2026-09-14 12:45:50] step 2924/5000 loss 0.4642 (w 0.3135 mse 0.3009 t 390 new 0.22) lr 1.00e-05 gnorm 0.183 3.05s mem 81.1GB +[2026-09-14 12:45:54] step 2925/5000 loss 0.3128 (w 0.1940 mse 0.1881 t 885 new 0.14) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +[2026-09-14 12:45:57] step 2926/5000 loss 0.2293 (w 0.1335 mse 0.1300 t 790 new 0.23) lr 1.00e-05 gnorm 0.125 3.14s mem 81.1GB +[2026-09-14 12:46:00] step 2927/5000 loss 0.2223 (w 0.2210 mse 0.2076 t 910 new 0.21) lr 1.00e-05 gnorm 0.211 3.07s mem 81.1GB +[2026-09-14 12:46:03] step 2928/5000 loss 0.2344 (w 0.1461 mse 0.1538 t 963 new 0.08) lr 1.00e-05 gnorm 0.164 3.13s mem 81.1GB +[2026-09-14 12:46:06] step 2929/5000 loss 0.1445 (w 0.2167 mse 0.2221 t 927 new 0.16) lr 1.00e-05 gnorm 0.109 3.39s mem 81.1GB +[2026-09-14 12:46:09] step 2930/5000 loss 0.3835 (w 0.3796 mse 0.3604 t 995 new 0.25) lr 1.00e-05 gnorm 0.959 3.08s mem 81.1GB +[2026-09-14 12:46:13] step 2931/5000 loss 0.2840 (w 0.1423 mse 0.1319 t 768 new 0.25) lr 1.00e-05 gnorm 0.227 3.16s mem 81.1GB +[2026-09-14 12:46:16] step 2932/5000 loss 0.1630 (w 0.3006 mse 0.2942 t 978 new 0.24) lr 1.00e-05 gnorm 0.149 3.08s mem 81.1GB +[2026-09-14 12:46:19] step 2933/5000 loss 0.1798 (w 0.1355 mse 0.1413 t 873 new 0.24) lr 1.00e-05 gnorm 0.114 3.12s mem 81.1GB +[2026-09-14 12:46:22] step 2934/5000 loss 0.3306 (w 0.2129 mse 0.1991 t 584 new 0.17) lr 1.00e-05 gnorm 0.115 3.12s mem 81.1GB +[2026-09-14 12:46:25] step 2935/5000 loss 0.2494 (w 0.1804 mse 0.1846 t 566 new 0.26) lr 1.00e-05 gnorm 0.211 3.38s mem 81.1GB +[2026-09-14 12:46:28] step 2936/5000 loss 0.1154 (w 0.1714 mse 0.1660 t 817 new 0.19) lr 1.00e-05 gnorm 0.166 2.83s mem 81.1GB +[2026-09-14 12:46:31] step 2937/5000 loss 0.2547 (w 0.2556 mse 0.2440 t 666 new 0.30) lr 1.00e-05 gnorm 0.248 3.34s mem 81.1GB +[2026-09-14 12:46:35] step 2938/5000 loss 0.1456 (w 0.1184 mse 0.1329 t 951 new 0.20) lr 1.00e-05 gnorm 0.792 3.12s mem 81.1GB +[2026-09-14 12:46:38] step 2939/5000 loss 0.2003 (w 0.1844 mse 0.1975 t 955 new 0.23) lr 1.00e-05 gnorm 0.148 3.12s mem 81.1GB +[2026-09-14 12:46:41] step 2940/5000 loss 0.3789 (w 0.2794 mse 0.2772 t 323 new 0.17) lr 1.00e-05 gnorm 0.419 3.13s mem 81.1GB +[2026-09-14 12:46:44] step 2941/5000 loss 0.1067 (w 0.2354 mse 0.2395 t 951 new 0.22) lr 1.00e-05 gnorm 0.176 3.07s mem 81.1GB +[2026-09-14 12:46:47] step 2942/5000 loss 0.2061 (w 0.3072 mse 0.2933 t 971 new 0.20) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-14 12:46:50] step 2943/5000 loss 0.1567 (w 0.2879 mse 0.2955 t 988 new 0.20) lr 1.00e-05 gnorm 0.127 3.40s mem 81.1GB +[2026-09-14 12:46:54] step 2944/5000 loss 0.3966 (w 0.3651 mse 0.3559 t 998 new 0.18) lr 1.00e-05 gnorm 0.179 3.36s mem 81.1GB +[2026-09-14 12:46:56] step 2945/5000 loss 0.2892 (w 0.1683 mse 0.1783 t 890 new 0.18) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +[2026-09-14 12:46:59] step 2946/5000 loss 0.2248 (w 0.2969 mse 0.2803 t 961 new 0.21) lr 1.00e-05 gnorm 0.191 3.14s mem 81.1GB +[2026-09-14 12:47:03] step 2947/5000 loss 0.2153 (w 0.1361 mse 0.1349 t 693 new 0.17) lr 1.00e-05 gnorm 0.112 3.08s mem 81.1GB +[2026-09-14 12:47:06] step 2948/5000 loss 0.1529 (w 0.3057 mse 0.2924 t 921 new 0.18) lr 1.00e-05 gnorm 0.196 3.10s mem 81.1GB +[2026-09-14 12:47:09] step 2949/5000 loss 0.2600 (w 0.3051 mse 0.2832 t 934 new 0.15) lr 1.00e-05 gnorm 0.149 3.11s mem 81.1GB +[2026-09-14 12:47:12] step 2950/5000 loss 0.1917 (w 0.2176 mse 0.2234 t 991 new 0.18) lr 1.00e-05 gnorm 0.133 3.39s mem 81.1GB +[2026-09-14 12:47:15] step 2951/5000 loss 0.1571 (w 0.1987 mse 0.1860 t 997 new 0.22) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-14 12:47:18] step 2952/5000 loss 0.2555 (w 0.1636 mse 0.1742 t 965 new 0.13) lr 1.00e-05 gnorm 0.137 3.34s mem 81.1GB +[2026-09-14 12:47:21] step 2953/5000 loss 0.2136 (w 0.2665 mse 0.2612 t 916 new 0.17) lr 1.00e-05 gnorm 0.139 3.10s mem 81.1GB +[2026-09-14 12:47:25] step 2954/5000 loss 0.3420 (w 0.1341 mse 0.1241 t 816 new 0.22) lr 1.00e-05 gnorm 0.152 3.12s mem 81.1GB +[2026-09-14 12:47:28] step 2955/5000 loss 0.1854 (w 0.3150 mse 0.3045 t 899 new 0.18) lr 1.00e-05 gnorm 0.110 3.43s mem 81.1GB +[2026-09-14 12:47:31] step 2956/5000 loss 0.1439 (w 0.3320 mse 0.3280 t 964 new 0.21) lr 1.00e-05 gnorm 0.184 3.17s mem 81.1GB +[2026-09-14 12:47:34] step 2957/5000 loss 0.1612 (w 0.2438 mse 0.2425 t 988 new 0.17) lr 1.00e-05 gnorm 0.117 2.85s mem 81.1GB +[2026-09-14 12:47:37] step 2958/5000 loss 0.2755 (w 0.3668 mse 0.3524 t 434 new 0.19) lr 1.00e-05 gnorm 0.157 3.37s mem 81.1GB +[2026-09-14 12:47:41] step 2959/5000 loss 0.2376 (w 0.3317 mse 0.3128 t 962 new 0.24) lr 1.00e-05 gnorm 0.162 3.11s mem 81.1GB +[2026-09-14 12:47:44] step 2960/5000 loss 0.3703 (w 0.2205 mse 0.2182 t 975 new 0.20) lr 1.00e-05 gnorm 0.260 3.08s mem 81.1GB +[2026-09-14 12:47:47] step 2961/5000 loss 0.3839 (w 0.1761 mse 0.1770 t 850 new 0.22) lr 1.00e-05 gnorm 0.165 3.37s mem 81.1GB +[2026-09-14 12:47:50] step 2962/5000 loss 0.2954 (w 0.1651 mse 0.1803 t 521 new 0.20) lr 1.00e-05 gnorm 0.154 3.09s mem 81.1GB +[2026-09-14 12:47:53] step 2963/5000 loss 0.1297 (w 0.2622 mse 0.2573 t 958 new 0.21) lr 1.00e-05 gnorm 0.175 3.03s mem 81.1GB +[2026-09-14 12:47:56] step 2964/5000 loss 0.1889 (w 0.2545 mse 0.2265 t 981 new 0.25) lr 1.00e-05 gnorm 0.181 3.12s mem 81.1GB +[2026-09-14 12:47:59] step 2965/5000 loss 0.2598 (w 0.1421 mse 0.1498 t 887 new 0.10) lr 1.00e-05 gnorm 0.174 3.15s mem 81.1GB +[2026-09-14 12:48:02] step 2966/5000 loss 0.2956 (w 0.2461 mse 0.2464 t 961 new 0.16) lr 1.00e-05 gnorm 0.155 3.08s mem 81.1GB +[2026-09-14 12:48:06] step 2967/5000 loss 0.3126 (w 0.1991 mse 0.1868 t 731 new 0.21) lr 1.00e-05 gnorm 0.181 3.01s mem 81.1GB +[2026-09-14 12:48:09] step 2968/5000 loss 0.2701 (w 0.3073 mse 0.3107 t 328 new 0.18) lr 1.00e-05 gnorm 0.181 3.70s mem 81.1GB +[2026-09-14 12:48:13] step 2969/5000 loss 0.2651 (w 0.2257 mse 0.2127 t 872 new 0.18) lr 1.00e-05 gnorm 0.145 3.22s mem 81.1GB +[2026-09-14 12:48:16] step 2970/5000 loss 0.3407 (w 0.1591 mse 0.1669 t 653 new 0.23) lr 1.00e-05 gnorm 0.137 3.12s mem 81.1GB +[2026-09-14 12:48:19] step 2971/5000 loss 0.2629 (w 0.2011 mse 0.2031 t 988 new 0.19) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +[2026-09-14 12:48:22] step 2972/5000 loss 0.2565 (w 0.2707 mse 0.2589 t 942 new 0.19) lr 1.00e-05 gnorm 0.875 3.08s mem 81.1GB +[2026-09-14 12:48:26] step 2973/5000 loss 0.1811 (w 0.2974 mse 0.2871 t 631 new 0.30) lr 1.00e-05 gnorm 0.150 3.42s mem 81.1GB +[2026-09-14 12:48:28] step 2974/5000 loss 0.3379 (w 0.2551 mse 0.2508 t 459 new 0.19) lr 1.00e-05 gnorm 0.217 2.83s mem 81.1GB +[2026-09-14 12:48:32] step 2975/5000 loss 0.2081 (w 0.1713 mse 0.1624 t 999 new 0.18) lr 1.00e-05 gnorm 0.135 3.41s mem 81.1GB +[2026-09-14 12:48:35] step 2976/5000 loss 0.2451 (w 0.2072 mse 0.2159 t 911 new 0.23) lr 1.00e-05 gnorm 0.161 3.13s mem 81.1GB +[2026-09-14 12:48:38] step 2977/5000 loss 0.1444 (w 0.2185 mse 0.2123 t 976 new 0.12) lr 1.00e-05 gnorm 0.124 3.14s mem 81.1GB +[2026-09-14 12:48:41] step 2978/5000 loss 0.1821 (w 0.1131 mse 0.1143 t 797 new 0.06) lr 1.00e-05 gnorm 0.293 3.12s mem 81.1GB +[2026-09-14 12:48:45] step 2979/5000 loss 0.3197 (w 0.2548 mse 0.2439 t 804 new 0.26) lr 1.00e-05 gnorm 0.204 3.35s mem 81.1GB +[2026-09-14 12:48:48] step 2980/5000 loss 0.4176 (w 0.1845 mse 0.1754 t 757 new 0.23) lr 1.00e-05 gnorm 0.147 2.83s mem 81.1GB +[2026-09-14 12:48:51] step 2981/5000 loss 0.2781 (w 0.4032 mse 0.3827 t 1000 new 0.23) lr 1.00e-05 gnorm 0.144 3.25s mem 81.1GB +[2026-09-14 12:48:54] step 2982/5000 loss 0.1158 (w 0.2102 mse 0.2069 t 906 new 0.18) lr 1.00e-05 gnorm 0.164 3.09s mem 81.1GB +[2026-09-14 12:48:57] step 2983/5000 loss 0.1476 (w 0.5524 mse 0.5828 t 146 new 0.19) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +[2026-09-14 12:49:00] step 2984/5000 loss 0.2041 (w 0.2310 mse 0.2253 t 842 new 0.21) lr 1.00e-05 gnorm 0.163 3.07s mem 81.1GB +[2026-09-14 12:49:04] step 2985/5000 loss 0.2210 (w 0.2619 mse 0.2353 t 945 new 0.18) lr 1.00e-05 gnorm 0.301 3.44s mem 81.1GB +[2026-09-14 12:49:06] step 2986/5000 loss 0.2141 (w 0.2619 mse 0.2591 t 960 new 0.25) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +[2026-09-14 12:49:10] step 2987/5000 loss 0.2649 (w 0.3060 mse 0.3201 t 956 new 0.18) lr 1.00e-05 gnorm 0.157 3.31s mem 81.1GB +[2026-09-14 12:49:13] step 2988/5000 loss 0.3713 (w 0.1860 mse 0.1787 t 771 new 0.23) lr 1.00e-05 gnorm 0.233 3.46s mem 81.1GB +[2026-09-14 12:49:16] step 2989/5000 loss 0.2908 (w 0.3220 mse 0.3392 t 332 new 0.23) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +[2026-09-14 12:49:19] step 2990/5000 loss 0.2621 (w 0.1510 mse 0.1457 t 915 new 0.23) lr 1.00e-05 gnorm 0.478 3.10s mem 81.1GB +[2026-09-14 12:49:23] step 2991/5000 loss 0.1436 (w 0.0897 mse 0.1080 t 959 new 0.20) lr 1.00e-05 gnorm 0.192 3.42s mem 81.1GB +[2026-09-14 12:49:26] step 2992/5000 loss 0.3125 (w 0.1433 mse 0.1376 t 821 new 0.19) lr 1.00e-05 gnorm 0.160 3.04s mem 81.1GB +[2026-09-14 12:49:29] step 2993/5000 loss 0.1034 (w 0.2749 mse 0.2577 t 987 new 0.24) lr 1.00e-05 gnorm 0.118 3.43s mem 81.1GB +[2026-09-14 12:49:32] step 2994/5000 loss 0.0983 (w 0.2553 mse 0.2619 t 993 new 0.09) lr 1.00e-05 gnorm 0.175 3.04s mem 81.1GB +[2026-09-14 12:49:35] step 2995/5000 loss 0.1785 (w 0.1943 mse 0.1757 t 841 new 0.21) lr 1.00e-05 gnorm 0.174 2.85s mem 81.1GB +[2026-09-14 12:49:38] step 2996/5000 loss 0.2809 (w 0.2468 mse 0.2406 t 730 new 0.14) lr 1.00e-05 gnorm 0.140 3.38s mem 81.1GB +[2026-09-14 12:49:42] step 2997/5000 loss 0.1987 (w 0.3215 mse 0.2944 t 899 new 0.20) lr 1.00e-05 gnorm 0.132 3.32s mem 81.1GB +[2026-09-14 12:49:45] step 2998/5000 loss 0.4025 (w 0.1744 mse 0.1809 t 871 new 0.20) lr 1.00e-05 gnorm 0.153 3.06s mem 81.1GB +[2026-09-14 12:49:48] step 2999/5000 loss 0.2723 (w 0.4774 mse 0.4538 t 978 new 0.24) lr 1.00e-05 gnorm 0.187 3.40s mem 81.1GB +[2026-09-14 12:49:51] step 3000/5000 loss 0.2170 (w 0.2541 mse 0.2477 t 936 new 0.23) lr 1.00e-05 gnorm 0.193 3.09s mem 81.1GB +[2026-09-14 12:49:53] [val] step 3000 t=200: w=0.4166 mse=0.4273 (n=16) t=500: w=0.2215 mse=0.2251 (n=16) t=800: w=0.1737 mse=0.1731 (n=16) | mean w=0.2706 mse=0.2752 2s +[2026-09-14 12:50:43] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step3000.safetensors 4093 个张量 37.98 GB +[2026-09-14 12:50:48] step 3001/5000 loss 0.2543 (w 0.2654 mse 0.2556 t 942 new 0.26) lr 1.00e-05 gnorm 0.135 3.36s mem 81.1GB +[2026-09-14 12:50:51] step 3002/5000 loss 0.1915 (w 0.2286 mse 0.2163 t 804 new 0.24) lr 1.00e-05 gnorm 0.156 3.05s mem 81.1GB +[2026-09-14 12:50:54] step 3003/5000 loss 0.1969 (w 0.1803 mse 0.1781 t 861 new 0.17) lr 1.00e-05 gnorm 0.181 3.21s mem 81.1GB +[2026-09-14 12:50:57] step 3004/5000 loss 0.0556 (w 0.1978 mse 0.2140 t 969 new 0.16) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +[2026-09-14 12:51:00] step 3005/5000 loss 0.2434 (w 0.2538 mse 0.2524 t 972 new 0.25) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +[2026-09-14 12:51:04] step 3006/5000 loss 0.2152 (w 0.1971 mse 0.1941 t 942 new 0.09) lr 1.00e-05 gnorm 0.193 3.08s mem 81.1GB +[2026-09-14 12:51:07] step 3007/5000 loss 0.2180 (w 0.2182 mse 0.2050 t 821 new 0.21) lr 1.00e-05 gnorm 0.227 3.29s mem 81.1GB +[2026-09-14 12:51:10] step 3008/5000 loss 0.1864 (w 0.2028 mse 0.1958 t 868 new 0.22) lr 1.00e-05 gnorm 0.164 3.09s mem 81.1GB +[2026-09-14 12:51:13] step 3009/5000 loss 0.1526 (w 0.2901 mse 0.2921 t 921 new 0.20) lr 1.00e-05 gnorm 0.180 3.14s mem 81.1GB +[2026-09-14 12:51:16] step 3010/5000 loss 0.2756 (w 0.1794 mse 0.1713 t 706 new 0.09) lr 1.00e-05 gnorm 0.150 3.11s mem 81.1GB +[2026-09-14 12:51:19] step 3011/5000 loss 0.2525 (w 0.2518 mse 0.2516 t 979 new 0.16) lr 1.00e-05 gnorm 0.165 3.10s mem 81.1GB +[2026-09-14 12:51:22] step 3012/5000 loss 0.1699 (w 0.1714 mse 0.1740 t 948 new 0.07) lr 1.00e-05 gnorm 0.225 3.10s mem 81.1GB +[2026-09-14 12:51:26] step 3013/5000 loss 0.1849 (w 0.2351 mse 0.2249 t 960 new 0.23) lr 1.00e-05 gnorm 0.167 3.25s mem 81.1GB +[2026-09-14 12:51:29] step 3014/5000 loss 0.3642 (w 0.2091 mse 0.2125 t 958 new 0.24) lr 1.00e-05 gnorm 0.143 3.20s mem 81.1GB +[2026-09-14 12:51:32] step 3015/5000 loss 0.2011 (w 0.1797 mse 0.1872 t 876 new 0.16) lr 1.00e-05 gnorm 0.109 2.83s mem 81.1GB +[2026-09-14 12:51:35] step 3016/5000 loss 0.2696 (w 0.2081 mse 0.2021 t 875 new 0.16) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-14 12:51:38] step 3017/5000 loss 0.2389 (w 0.3339 mse 0.3581 t 254 new 0.26) lr 1.00e-05 gnorm 0.146 3.19s mem 81.1GB +[2026-09-14 12:51:41] step 3018/5000 loss 0.3003 (w 0.1765 mse 0.1670 t 626 new 0.20) lr 1.00e-05 gnorm 0.137 2.89s mem 81.1GB +[2026-09-14 12:51:44] step 3019/5000 loss 0.2065 (w 0.2384 mse 0.2241 t 881 new 0.15) lr 1.00e-05 gnorm 0.133 3.15s mem 81.1GB +[2026-09-14 12:51:48] step 3020/5000 loss 0.2634 (w 0.2337 mse 0.2230 t 659 new 0.25) lr 1.00e-05 gnorm 0.192 3.52s mem 81.1GB +[2026-09-14 12:51:51] step 3021/5000 loss 0.3311 (w 0.2613 mse 0.2602 t 947 new 0.21) lr 1.00e-05 gnorm 0.353 3.10s mem 81.1GB +[2026-09-14 12:51:54] step 3022/5000 loss 0.1850 (w 0.1857 mse 0.1798 t 822 new 0.21) lr 1.00e-05 gnorm 0.165 2.88s mem 81.1GB +[2026-09-14 12:51:57] step 3023/5000 loss 0.1151 (w 0.2378 mse 0.2316 t 970 new 0.18) lr 1.00e-05 gnorm 0.129 3.38s mem 81.1GB +[2026-09-14 12:52:00] step 3024/5000 loss 0.3169 (w 0.2415 mse 0.2270 t 960 new 0.27) lr 1.00e-05 gnorm 0.312 2.89s mem 81.1GB +[2026-09-14 12:52:04] step 3025/5000 loss 0.1899 (w 0.3781 mse 0.3625 t 993 new 0.24) lr 1.00e-05 gnorm 0.146 3.40s mem 81.1GB +[2026-09-14 12:52:07] step 3026/5000 loss 0.1076 (w 0.2258 mse 0.2423 t 993 new 0.11) lr 1.00e-05 gnorm 0.195 3.36s mem 81.1GB +[2026-09-14 12:52:10] step 3027/5000 loss 0.2489 (w 0.2123 mse 0.2283 t 999 new 0.18) lr 1.00e-05 gnorm 0.155 3.33s mem 81.1GB +[2026-09-14 12:52:13] step 3028/5000 loss 0.1963 (w 0.2757 mse 0.2790 t 977 new 0.24) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +[2026-09-14 12:52:16] step 3029/5000 loss 0.1753 (w 0.0952 mse 0.1048 t 629 new 0.10) lr 1.00e-05 gnorm 0.189 3.37s mem 81.1GB +[2026-09-14 12:52:19] step 3030/5000 loss 0.0809 (w 0.2755 mse 0.2678 t 980 new 0.24) lr 1.00e-05 gnorm 0.107 2.85s mem 81.1GB +[2026-09-14 12:52:23] step 3031/5000 loss 0.1764 (w 0.2296 mse 0.2254 t 796 new 0.16) lr 1.00e-05 gnorm 0.173 3.33s mem 81.1GB +[2026-09-14 12:52:26] step 3032/5000 loss 0.2274 (w 0.2039 mse 0.1902 t 943 new 0.16) lr 1.00e-05 gnorm 0.150 3.50s mem 81.1GB +[2026-09-14 12:52:30] step 3033/5000 loss 0.1617 (w 0.2633 mse 0.2568 t 974 new 0.23) lr 1.00e-05 gnorm 0.180 3.41s mem 81.1GB +[2026-09-14 12:52:33] step 3034/5000 loss 0.1502 (w 0.1914 mse 0.1842 t 858 new 0.24) lr 1.00e-05 gnorm 0.336 3.25s mem 81.1GB +[2026-09-14 12:52:36] step 3035/5000 loss 0.1892 (w 0.3501 mse 0.3456 t 278 new 0.23) lr 1.00e-05 gnorm 0.150 3.18s mem 81.1GB +[2026-09-14 12:52:39] step 3036/5000 loss 0.2292 (w 0.3018 mse 0.2970 t 969 new 0.24) lr 1.00e-05 gnorm 0.178 3.21s mem 81.1GB +[2026-09-14 12:52:45] step 3037/5000 loss 0.2925 (w 0.1524 mse 0.1444 t 913 new 0.24) lr 1.00e-05 gnorm 0.143 5.95s mem 81.1GB +[2026-09-14 12:52:51] step 3038/5000 loss 0.2067 (w 0.2825 mse 0.2783 t 936 new 0.21) lr 1.00e-05 gnorm 0.110 5.95s mem 81.1GB +[2026-09-14 12:52:57] step 3039/5000 loss 0.2059 (w 0.3109 mse 0.3117 t 958 new 0.22) lr 1.00e-05 gnorm 0.173 5.96s mem 81.1GB +[2026-09-14 12:53:03] step 3040/5000 loss 0.2321 (w 0.0905 mse 0.0911 t 641 new 0.20) lr 1.00e-05 gnorm 0.176 6.07s mem 81.1GB +[2026-09-14 12:53:09] step 3041/5000 loss 0.1299 (w 0.1800 mse 0.1900 t 977 new 0.23) lr 1.00e-05 gnorm 0.131 5.68s mem 81.1GB +[2026-09-14 12:53:15] step 3042/5000 loss 0.1938 (w 0.3032 mse 0.3120 t 956 new 0.20) lr 1.00e-05 gnorm 0.190 5.75s mem 81.1GB +[2026-09-14 12:53:21] step 3043/5000 loss 0.2520 (w 0.2752 mse 0.2599 t 741 new 0.13) lr 1.00e-05 gnorm 0.149 6.00s mem 81.1GB +[2026-09-14 12:53:26] step 3044/5000 loss 0.2212 (w 0.1732 mse 0.1727 t 901 new 0.02) lr 1.00e-05 gnorm 0.137 5.38s mem 81.1GB +[2026-09-14 12:53:29] step 3045/5000 loss 0.2213 (w 0.1414 mse 0.1377 t 854 new 0.20) lr 1.00e-05 gnorm 0.170 3.09s mem 81.1GB +[2026-09-14 12:53:32] step 3046/5000 loss 0.3594 (w 0.2714 mse 0.2664 t 418 new 0.14) lr 1.00e-05 gnorm 0.148 3.15s mem 81.1GB +[2026-09-14 12:53:35] step 3047/5000 loss 0.1758 (w 0.2063 mse 0.2012 t 983 new 0.12) lr 1.00e-05 gnorm 0.120 2.85s mem 81.1GB +[2026-09-14 12:53:39] step 3048/5000 loss 0.1995 (w 0.2407 mse 0.2612 t 375 new 0.17) lr 1.00e-05 gnorm 0.173 3.31s mem 81.1GB +[2026-09-14 12:53:42] step 3049/5000 loss 0.3473 (w 0.3200 mse 0.3157 t 897 new 0.19) lr 1.00e-05 gnorm 0.115 3.17s mem 81.1GB +[2026-09-14 12:53:45] step 3050/5000 loss 0.1110 (w 0.1771 mse 0.1848 t 994 new 0.23) lr 1.00e-05 gnorm 0.569 3.32s mem 81.1GB +[2026-09-14 12:53:48] step 3051/5000 loss 0.1915 (w 0.1650 mse 0.1585 t 865 new 0.20) lr 1.00e-05 gnorm 0.184 3.22s mem 81.1GB +[2026-09-14 12:53:52] step 3052/5000 loss 0.2827 (w 0.1444 mse 0.1450 t 945 new 0.15) lr 1.00e-05 gnorm 0.157 3.43s mem 81.1GB +[2026-09-14 12:53:55] step 3053/5000 loss 0.1769 (w 0.2812 mse 0.2828 t 987 new 0.22) lr 1.00e-05 gnorm 0.596 2.94s mem 81.1GB +[2026-09-14 12:53:58] step 3054/5000 loss 0.3110 (w 0.3130 mse 0.3017 t 492 new 0.25) lr 1.00e-05 gnorm 0.634 2.86s mem 81.1GB +[2026-09-14 12:54:01] step 3055/5000 loss 0.1737 (w 0.2671 mse 0.2638 t 992 new 0.22) lr 1.00e-05 gnorm 0.184 3.44s mem 81.1GB +[2026-09-14 12:54:05] step 3056/5000 loss 0.2889 (w 0.2189 mse 0.2185 t 869 new 0.18) lr 1.00e-05 gnorm 0.157 3.52s mem 81.1GB +[2026-09-14 12:54:08] step 3057/5000 loss 0.3375 (w 0.2278 mse 0.2307 t 917 new 0.23) lr 1.00e-05 gnorm 0.152 2.88s mem 81.1GB +[2026-09-14 12:54:11] step 3058/5000 loss 0.2167 (w 0.2593 mse 0.2562 t 673 new 0.27) lr 1.00e-05 gnorm 0.159 3.37s mem 81.1GB +[2026-09-14 12:54:14] step 3059/5000 loss 0.3093 (w 0.2966 mse 0.2833 t 881 new 0.15) lr 1.00e-05 gnorm 0.137 3.18s mem 81.1GB +[2026-09-14 12:54:18] step 3060/5000 loss 0.2183 (w 0.3451 mse 0.3400 t 945 new 0.26) lr 1.00e-05 gnorm 0.127 3.89s mem 81.1GB +[2026-09-14 12:54:22] step 3061/5000 loss 0.2533 (w 0.1415 mse 0.1398 t 833 new 0.10) lr 1.00e-05 gnorm 0.119 3.48s mem 81.1GB +[2026-09-14 12:54:25] step 3062/5000 loss 0.1590 (w 0.2464 mse 0.2408 t 898 new 0.22) lr 1.00e-05 gnorm 0.126 3.36s mem 81.1GB +[2026-09-14 12:54:28] step 3063/5000 loss 0.3147 (w 0.1518 mse 0.1495 t 762 new 0.20) lr 1.00e-05 gnorm 0.141 2.95s mem 81.1GB +[2026-09-14 12:54:31] step 3064/5000 loss 0.1956 (w 0.1605 mse 0.1702 t 663 new 0.15) lr 1.00e-05 gnorm 0.127 3.43s mem 81.1GB +[2026-09-14 12:54:34] step 3065/5000 loss 0.1673 (w 0.2413 mse 0.2453 t 957 new 0.23) lr 1.00e-05 gnorm 0.156 2.88s mem 81.1GB +[2026-09-14 12:54:38] step 3066/5000 loss 0.2753 (w 0.3157 mse 0.2926 t 945 new 0.21) lr 1.00e-05 gnorm 0.149 4.01s mem 81.1GB +[2026-09-14 12:54:42] step 3067/5000 loss 0.1559 (w 0.2727 mse 0.2791 t 997 new 0.18) lr 1.00e-05 gnorm 0.472 3.78s mem 81.1GB +[2026-09-14 12:54:46] step 3068/5000 loss 0.1313 (w 0.1617 mse 0.1610 t 893 new 0.14) lr 1.00e-05 gnorm 0.138 3.69s mem 81.1GB +[2026-09-14 12:54:49] step 3069/5000 loss 0.1902 (w 0.1694 mse 0.1734 t 821 new 0.15) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +[2026-09-14 12:54:52] step 3070/5000 loss 0.3588 (w 0.2501 mse 0.2437 t 837 new 0.23) lr 1.00e-05 gnorm 0.255 3.36s mem 81.1GB +[2026-09-14 12:54:55] step 3071/5000 loss 0.1443 (w 0.1642 mse 0.1873 t 971 new 0.20) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +[2026-09-14 12:54:58] step 3072/5000 loss 0.2703 (w 0.2388 mse 0.2451 t 931 new 0.09) lr 1.00e-05 gnorm 0.144 3.49s mem 81.1GB +[2026-09-14 12:55:01] step 3073/5000 loss 0.3483 (w 0.4610 mse 0.4700 t 988 new 0.16) lr 1.00e-05 gnorm 0.167 3.13s mem 81.1GB +[2026-09-14 12:55:05] step 3074/5000 loss 0.2449 (w 0.1956 mse 0.1935 t 994 new 0.19) lr 1.00e-05 gnorm 0.156 3.13s mem 81.1GB +[2026-09-14 12:55:07] step 3075/5000 loss 0.2931 (w 0.2401 mse 0.2217 t 955 new 0.22) lr 1.00e-05 gnorm 0.116 2.86s mem 81.1GB +[2026-09-14 12:55:11] step 3076/5000 loss 0.2895 (w 0.1938 mse 0.1900 t 882 new 0.22) lr 1.00e-05 gnorm 0.469 3.55s mem 81.1GB +[2026-09-14 12:55:14] step 3077/5000 loss 0.2094 (w 0.3116 mse 0.2851 t 988 new 0.22) lr 1.00e-05 gnorm 0.134 2.87s mem 81.1GB +[2026-09-14 12:55:18] step 3078/5000 loss 0.3009 (w 0.2586 mse 0.2582 t 924 new 0.21) lr 1.00e-05 gnorm 1.644 3.75s mem 81.1GB +[2026-09-14 12:55:21] step 3079/5000 loss 0.2519 (w 0.1590 mse 0.1612 t 856 new 0.18) lr 1.00e-05 gnorm 0.186 3.18s mem 81.1GB +[2026-09-14 12:55:24] step 3080/5000 loss 0.2306 (w 0.2129 mse 0.1966 t 875 new 0.21) lr 1.00e-05 gnorm 0.199 3.14s mem 81.1GB +[2026-09-14 12:55:27] step 3081/5000 loss 0.2909 (w 0.1955 mse 0.1880 t 582 new 0.14) lr 1.00e-05 gnorm 0.181 3.12s mem 81.1GB +[2026-09-14 12:55:30] step 3082/5000 loss 0.1014 (w 0.1994 mse 0.2065 t 915 new 0.17) lr 1.00e-05 gnorm 0.167 3.33s mem 81.1GB +[2026-09-14 12:55:33] step 3083/5000 loss 0.1479 (w 0.2388 mse 0.2305 t 919 new 0.20) lr 1.00e-05 gnorm 0.128 2.99s mem 81.1GB +[2026-09-14 12:55:37] step 3084/5000 loss 0.1704 (w 0.1801 mse 0.1787 t 783 new 0.17) lr 1.00e-05 gnorm 0.424 3.15s mem 81.1GB +[2026-09-14 12:55:40] step 3085/5000 loss 0.2719 (w 0.3146 mse 0.3148 t 447 new 0.23) lr 1.00e-05 gnorm 0.161 3.14s mem 81.1GB +[2026-09-14 12:55:43] step 3086/5000 loss 0.3132 (w 0.1880 mse 0.1782 t 743 new 0.22) lr 1.00e-05 gnorm 0.162 3.13s mem 81.1GB +[2026-09-14 12:55:46] step 3087/5000 loss 0.2077 (w 0.3922 mse 0.3698 t 989 new 0.19) lr 1.00e-05 gnorm 0.109 3.05s mem 81.1GB +[2026-09-14 12:55:49] step 3088/5000 loss 0.3533 (w 0.1726 mse 0.1677 t 792 new 0.20) lr 1.00e-05 gnorm 0.148 3.06s mem 81.1GB +[2026-09-14 12:55:52] step 3089/5000 loss 0.1003 (w 0.1995 mse 0.1960 t 885 new 0.22) lr 1.00e-05 gnorm 0.126 2.93s mem 81.1GB +[2026-09-14 12:55:55] step 3090/5000 loss 0.2705 (w 0.1194 mse 0.1114 t 628 new 0.16) lr 1.00e-05 gnorm 0.144 3.37s mem 81.1GB +[2026-09-14 12:55:59] step 3091/5000 loss 0.1915 (w 0.1940 mse 0.1924 t 908 new 0.23) lr 1.00e-05 gnorm 0.322 3.33s mem 81.1GB +[2026-09-14 12:56:02] step 3092/5000 loss 0.2173 (w 0.1922 mse 0.1862 t 717 new 0.22) lr 1.00e-05 gnorm 0.147 3.03s mem 81.1GB +[2026-09-14 12:56:05] step 3093/5000 loss 0.1803 (w 0.2078 mse 0.1973 t 887 new 0.23) lr 1.00e-05 gnorm 0.155 3.26s mem 81.1GB +[2026-09-14 12:56:08] step 3094/5000 loss 0.2497 (w 0.2375 mse 0.2474 t 424 new 0.25) lr 1.00e-05 gnorm 0.120 3.28s mem 81.1GB +[2026-09-14 12:56:14] step 3095/5000 loss 0.1264 (w 0.3880 mse 0.3621 t 994 new 0.25) lr 1.00e-05 gnorm 0.107 6.31s mem 81.1GB +[2026-09-14 12:56:21] step 3096/5000 loss 0.2976 (w 0.2185 mse 0.2052 t 657 new 0.24) lr 1.00e-05 gnorm 0.263 6.33s mem 81.1GB +[2026-09-14 12:56:27] step 3097/5000 loss 0.1970 (w 0.2288 mse 0.2238 t 850 new 0.18) lr 1.00e-05 gnorm 0.175 6.35s mem 81.1GB +[2026-09-14 12:56:33] step 3098/5000 loss 0.1648 (w 0.2364 mse 0.2263 t 976 new 0.26) lr 1.00e-05 gnorm 0.125 6.00s mem 81.1GB +[2026-09-14 12:56:40] step 3099/5000 loss 0.1496 (w 0.2455 mse 0.2459 t 981 new 0.21) lr 1.00e-05 gnorm 0.130 6.35s mem 81.1GB +[2026-09-14 12:56:46] step 3100/5000 loss 0.3117 (w 0.2851 mse 0.2753 t 876 new 0.22) lr 1.00e-05 gnorm 0.133 6.24s mem 81.1GB +[2026-09-14 12:56:52] step 3101/5000 loss 0.1804 (w 0.2467 mse 0.2310 t 916 new 0.18) lr 1.00e-05 gnorm 0.156 6.45s mem 81.1GB +[2026-09-14 12:56:57] step 3102/5000 loss 0.1281 (w 0.1199 mse 0.1324 t 987 new 0.26) lr 1.00e-05 gnorm 0.151 4.44s mem 81.1GB +[2026-09-14 12:57:00] step 3103/5000 loss 0.1140 (w 0.2499 mse 0.2404 t 917 new 0.18) lr 1.00e-05 gnorm 0.148 3.47s mem 81.1GB +[2026-09-14 12:57:03] step 3104/5000 loss 0.2422 (w 0.1733 mse 0.1670 t 816 new 0.22) lr 1.00e-05 gnorm 0.223 2.84s mem 81.1GB +[2026-09-14 12:57:06] step 3105/5000 loss 0.2828 (w 0.2539 mse 0.2378 t 768 new 0.21) lr 1.00e-05 gnorm 0.188 3.06s mem 81.1GB +[2026-09-14 12:57:09] step 3106/5000 loss 0.2304 (w 0.1587 mse 0.1623 t 999 new 0.02) lr 1.00e-05 gnorm 0.172 3.09s mem 81.1GB +[2026-09-14 12:57:13] step 3107/5000 loss 0.1449 (w 0.1895 mse 0.1948 t 873 new 0.15) lr 1.00e-05 gnorm 0.136 3.53s mem 81.1GB +[2026-09-14 12:57:16] step 3108/5000 loss 0.2575 (w 0.2385 mse 0.2197 t 834 new 0.21) lr 1.00e-05 gnorm 0.134 3.14s mem 81.1GB +[2026-09-14 12:57:20] step 3109/5000 loss 0.1359 (w 0.1381 mse 0.1364 t 1000 new 0.24) lr 1.00e-05 gnorm 0.124 3.72s mem 81.1GB +[2026-09-14 12:57:23] step 3110/5000 loss 0.3531 (w 0.2108 mse 0.2087 t 668 new 0.21) lr 1.00e-05 gnorm 0.146 3.01s mem 81.1GB +[2026-09-14 12:57:26] step 3111/5000 loss 0.1789 (w 0.2715 mse 0.2750 t 938 new 0.25) lr 1.00e-05 gnorm 0.603 3.10s mem 81.1GB +[2026-09-14 12:57:29] step 3112/5000 loss 0.2248 (w 0.3633 mse 0.3607 t 971 new 0.22) lr 1.00e-05 gnorm 0.124 3.12s mem 81.1GB +[2026-09-14 12:57:32] step 3113/5000 loss 0.1379 (w 0.2773 mse 0.2581 t 863 new 0.21) lr 1.00e-05 gnorm 0.171 3.40s mem 81.1GB +[2026-09-14 12:57:35] step 3114/5000 loss 0.3007 (w 0.2543 mse 0.2414 t 901 new 0.18) lr 1.00e-05 gnorm 0.222 3.28s mem 81.1GB +[2026-09-14 12:57:39] step 3115/5000 loss 0.1715 (w 0.2118 mse 0.2151 t 973 new 0.18) lr 1.00e-05 gnorm 0.156 3.38s mem 81.1GB +[2026-09-14 12:57:42] step 3116/5000 loss 0.1635 (w 0.3398 mse 0.3314 t 962 new 0.22) lr 1.00e-05 gnorm 0.138 3.26s mem 81.1GB +[2026-09-14 12:57:46] step 3117/5000 loss 0.1948 (w 0.2334 mse 0.2402 t 996 new 0.12) lr 1.00e-05 gnorm 0.118 4.14s mem 81.1GB +[2026-09-14 12:57:50] step 3118/5000 loss 0.1396 (w 0.1103 mse 0.1262 t 991 new 0.14) lr 1.00e-05 gnorm 0.091 3.42s mem 81.1GB +[2026-09-14 12:57:53] step 3119/5000 loss 0.1781 (w 0.2196 mse 0.2084 t 915 new 0.19) lr 1.00e-05 gnorm 0.217 3.22s mem 81.1GB +[2026-09-14 12:57:56] step 3120/5000 loss 0.3148 (w 0.2669 mse 0.2625 t 506 new 0.23) lr 1.00e-05 gnorm 0.194 3.46s mem 81.1GB +[2026-09-14 12:58:00] step 3121/5000 loss 0.1745 (w 0.3844 mse 0.3899 t 990 new 0.25) lr 1.00e-05 gnorm 0.166 3.40s mem 81.1GB +[2026-09-14 12:58:03] step 3122/5000 loss 0.1918 (w 0.2542 mse 0.2357 t 923 new 0.23) lr 1.00e-05 gnorm 0.142 3.23s mem 81.1GB +[2026-09-14 12:58:07] step 3123/5000 loss 0.3389 (w 0.3186 mse 0.3117 t 386 new 0.22) lr 1.00e-05 gnorm 0.151 4.29s mem 81.1GB +[2026-09-14 12:58:11] step 3124/5000 loss 0.2897 (w 0.2248 mse 0.2109 t 914 new 0.21) lr 1.00e-05 gnorm 0.168 3.97s mem 81.1GB +[2026-09-14 12:58:15] step 3125/5000 loss 0.3750 (w 0.2627 mse 0.2457 t 943 new 0.17) lr 1.00e-05 gnorm 0.146 3.58s mem 81.1GB +[2026-09-14 12:58:18] step 3126/5000 loss 0.2001 (w 0.2379 mse 0.2307 t 656 new 0.25) lr 1.00e-05 gnorm 0.187 3.47s mem 81.1GB +[2026-09-14 12:58:21] step 3127/5000 loss 0.2242 (w 0.1846 mse 0.1858 t 865 new 0.24) lr 1.00e-05 gnorm 0.152 3.16s mem 81.1GB +[2026-09-14 12:58:25] step 3128/5000 loss 0.2791 (w 0.1881 mse 0.1821 t 899 new 0.27) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +[2026-09-14 12:58:28] step 3129/5000 loss 0.2415 (w 0.1530 mse 0.1540 t 607 new 0.21) lr 1.00e-05 gnorm 0.146 3.15s mem 81.1GB +[2026-09-14 12:58:31] step 3130/5000 loss 0.2985 (w 0.2645 mse 0.2571 t 946 new 0.15) lr 1.00e-05 gnorm 0.175 3.03s mem 81.1GB +[2026-09-14 12:58:34] step 3131/5000 loss 0.2891 (w 0.2158 mse 0.2010 t 907 new 0.21) lr 1.00e-05 gnorm 0.332 3.14s mem 81.1GB +[2026-09-14 12:58:37] step 3132/5000 loss 0.2183 (w 0.2847 mse 0.2802 t 607 new 0.23) lr 1.00e-05 gnorm 0.137 3.34s mem 81.1GB +[2026-09-14 12:58:40] step 3133/5000 loss 0.2874 (w 0.1865 mse 0.2021 t 705 new 0.15) lr 1.00e-05 gnorm 0.135 3.06s mem 81.1GB +[2026-09-14 12:58:43] step 3134/5000 loss 0.2471 (w 0.1603 mse 0.1714 t 379 new 0.23) lr 1.00e-05 gnorm 0.090 3.04s mem 81.1GB +[2026-09-14 12:58:46] step 3135/5000 loss 0.2443 (w 0.2011 mse 0.2055 t 839 new 0.18) lr 1.00e-05 gnorm 0.140 3.13s mem 81.1GB +[2026-09-14 12:58:50] step 3136/5000 loss 0.1643 (w 0.1033 mse 0.1128 t 937 new 0.22) lr 1.00e-05 gnorm 0.118 3.05s mem 81.1GB +[2026-09-14 12:58:53] step 3137/5000 loss 0.3097 (w 0.3325 mse 0.3317 t 537 new 0.06) lr 1.00e-05 gnorm 0.171 3.15s mem 81.1GB +[2026-09-14 12:58:56] step 3138/5000 loss 0.2348 (w 0.2143 mse 0.2061 t 948 new 0.19) lr 1.00e-05 gnorm 0.105 3.42s mem 81.1GB +[2026-09-14 12:58:59] step 3139/5000 loss 0.2201 (w 0.1715 mse 0.1910 t 948 new 0.17) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +[2026-09-14 12:59:02] step 3140/5000 loss 0.3026 (w 1.0108 mse 1.0206 t 1000 new 0.19) lr 1.00e-05 gnorm 0.124 3.06s mem 81.1GB +[2026-09-14 12:59:05] step 3141/5000 loss 0.2847 (w 0.6576 mse 0.6578 t 134 new 0.19) lr 1.00e-05 gnorm 0.129 3.14s mem 81.1GB +[2026-09-14 12:59:09] step 3142/5000 loss 0.3373 (w 0.4185 mse 0.4119 t 991 new 0.19) lr 1.00e-05 gnorm 0.203 3.21s mem 81.1GB +[2026-09-14 12:59:12] step 3143/5000 loss 0.1457 (w 0.2988 mse 0.3294 t 999 new 0.19) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +[2026-09-14 12:59:15] step 3144/5000 loss 0.1707 (w 0.2289 mse 0.2362 t 827 new 0.22) lr 1.00e-05 gnorm 0.101 3.44s mem 81.1GB +[2026-09-14 12:59:18] step 3145/5000 loss 0.2079 (w 0.2347 mse 0.2209 t 828 new 0.23) lr 1.00e-05 gnorm 0.159 2.84s mem 81.1GB +[2026-09-14 12:59:21] step 3146/5000 loss 0.3196 (w 0.2166 mse 0.2087 t 835 new 0.13) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +[2026-09-14 12:59:24] step 3147/5000 loss 0.2486 (w 0.2043 mse 0.1990 t 647 new 0.27) lr 1.00e-05 gnorm 0.243 3.09s mem 81.1GB +[2026-09-14 12:59:28] step 3148/5000 loss 0.3103 (w 0.4109 mse 0.4095 t 292 new 0.20) lr 1.00e-05 gnorm 0.167 3.32s mem 81.1GB +[2026-09-14 12:59:31] step 3149/5000 loss 0.1098 (w 0.2286 mse 0.2309 t 992 new 0.21) lr 1.00e-05 gnorm 0.177 3.12s mem 81.1GB +[2026-09-14 12:59:34] step 3150/5000 loss 0.2024 (w 0.2750 mse 0.2808 t 973 new 0.23) lr 1.00e-05 gnorm 0.136 3.41s mem 81.1GB +[2026-09-14 12:59:37] step 3151/5000 loss 0.4120 (w 0.5135 mse 0.5234 t 159 new 0.25) lr 1.00e-05 gnorm 0.399 2.84s mem 81.1GB +[2026-09-14 12:59:40] step 3152/5000 loss 0.1844 (w 0.2235 mse 0.2312 t 982 new 0.19) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +[2026-09-14 12:59:43] step 3153/5000 loss 0.3186 (w 0.2612 mse 0.2431 t 766 new 0.20) lr 1.00e-05 gnorm 0.176 3.14s mem 81.1GB +[2026-09-14 12:59:47] step 3154/5000 loss 0.2481 (w 0.2593 mse 0.2606 t 948 new 0.20) lr 1.00e-05 gnorm 0.169 3.36s mem 81.1GB +[2026-09-14 12:59:50] step 3155/5000 loss 0.3367 (w 0.2976 mse 0.2802 t 947 new 0.12) lr 1.00e-05 gnorm 0.141 3.09s mem 81.1GB +[2026-09-14 12:59:53] step 3156/5000 loss 0.1604 (w 0.2525 mse 0.2393 t 931 new 0.14) lr 1.00e-05 gnorm 0.171 3.36s mem 81.1GB +[2026-09-14 12:59:56] step 3157/5000 loss 0.2191 (w 0.3899 mse 0.3891 t 984 new 0.19) lr 1.00e-05 gnorm 0.132 3.04s mem 81.1GB +[2026-09-14 12:59:59] step 3158/5000 loss 0.1724 (w 0.1324 mse 0.1391 t 753 new 0.18) lr 1.00e-05 gnorm 0.126 2.84s mem 81.1GB +[2026-09-14 13:00:02] step 3159/5000 loss 0.2012 (w 0.1871 mse 0.1968 t 853 new 0.22) lr 1.00e-05 gnorm 0.138 3.15s mem 81.1GB +[2026-09-14 13:00:05] step 3160/5000 loss 0.1484 (w 0.2179 mse 0.2153 t 868 new 0.23) lr 1.00e-05 gnorm 2.679 3.45s mem 81.1GB +[2026-09-14 13:00:09] step 3161/5000 loss 0.1642 (w 0.3343 mse 0.3532 t 980 new 0.20) lr 1.00e-05 gnorm 0.154 3.39s mem 81.1GB +[2026-09-14 13:00:12] step 3162/5000 loss 0.2712 (w 0.2513 mse 0.2718 t 975 new 0.21) lr 1.00e-05 gnorm 0.179 3.37s mem 81.1GB +[2026-09-14 13:00:15] step 3163/5000 loss 0.2558 (w 0.1726 mse 0.1699 t 875 new 0.23) lr 1.00e-05 gnorm 0.131 3.02s mem 81.1GB +[2026-09-14 13:00:18] step 3164/5000 loss 0.1397 (w 0.3278 mse 0.3096 t 960 new 0.26) lr 1.00e-05 gnorm 0.109 2.84s mem 81.1GB +[2026-09-14 13:00:22] step 3165/5000 loss 0.2596 (w 0.2257 mse 0.2166 t 965 new 0.20) lr 1.00e-05 gnorm 0.176 3.43s mem 81.1GB +[2026-09-14 13:00:25] step 3166/5000 loss 0.2772 (w 0.3037 mse 0.3019 t 450 new 0.25) lr 1.00e-05 gnorm 0.126 3.15s mem 81.1GB +[2026-09-14 13:00:28] step 3167/5000 loss 0.2048 (w 0.3147 mse 0.2995 t 949 new 0.20) lr 1.00e-05 gnorm 0.207 3.11s mem 81.1GB +[2026-09-14 13:00:31] step 3168/5000 loss 0.1000 (w 0.1771 mse 0.1726 t 954 new 0.22) lr 1.00e-05 gnorm 0.086 3.14s mem 81.1GB +[2026-09-14 13:00:34] step 3169/5000 loss 0.3354 (w 0.2100 mse 0.2195 t 968 new 0.20) lr 1.00e-05 gnorm 0.134 3.06s mem 81.1GB +[2026-09-14 13:00:37] step 3170/5000 loss 0.2394 (w 0.2664 mse 0.2554 t 984 new 0.19) lr 1.00e-05 gnorm 0.133 2.85s mem 81.1GB +[2026-09-14 13:00:40] step 3171/5000 loss 0.1747 (w 0.3409 mse 0.3397 t 990 new 0.17) lr 1.00e-05 gnorm 0.193 3.39s mem 81.1GB +[2026-09-14 13:00:44] step 3172/5000 loss 0.2913 (w 0.2031 mse 0.1923 t 902 new 0.27) lr 1.00e-05 gnorm 0.124 3.25s mem 81.1GB +[2026-09-14 13:00:47] step 3173/5000 loss 0.1790 (w 0.3014 mse 0.2917 t 624 new 0.20) lr 1.00e-05 gnorm 0.167 3.29s mem 81.1GB +[2026-09-14 13:00:50] step 3174/5000 loss 0.2594 (w 0.1411 mse 0.1399 t 942 new 0.18) lr 1.00e-05 gnorm 0.123 3.07s mem 81.1GB +[2026-09-14 13:00:53] step 3175/5000 loss 0.2424 (w 0.1731 mse 0.1547 t 675 new 0.24) lr 1.00e-05 gnorm 1.099 3.03s mem 81.1GB +[2026-09-14 13:00:56] step 3176/5000 loss 0.3841 (w 0.1958 mse 0.2080 t 328 new 0.10) lr 1.00e-05 gnorm 0.172 2.84s mem 81.1GB +[2026-09-14 13:00:59] step 3177/5000 loss 0.2302 (w 0.2716 mse 0.2454 t 868 new 0.21) lr 1.00e-05 gnorm 0.165 3.32s mem 81.1GB +[2026-09-14 13:01:03] step 3178/5000 loss 0.2578 (w 0.1693 mse 0.1668 t 921 new 0.21) lr 1.00e-05 gnorm 0.145 3.41s mem 81.1GB +[2026-09-14 13:01:06] step 3179/5000 loss 0.2334 (w 0.1817 mse 0.1763 t 803 new 0.27) lr 1.00e-05 gnorm 0.139 3.43s mem 81.1GB +[2026-09-14 13:01:09] step 3180/5000 loss 0.3419 (w 0.3114 mse 0.3192 t 978 new 0.13) lr 1.00e-05 gnorm 0.423 2.83s mem 81.1GB +[2026-09-14 13:01:12] step 3181/5000 loss 0.2167 (w 0.2283 mse 0.2268 t 977 new 0.21) lr 1.00e-05 gnorm 0.110 3.04s mem 81.1GB +[2026-09-14 13:01:15] step 3182/5000 loss 0.2515 (w 0.1873 mse 0.1787 t 783 new 0.21) lr 1.00e-05 gnorm 0.187 2.85s mem 81.1GB +[2026-09-14 13:01:18] step 3183/5000 loss 0.2601 (w 0.2084 mse 0.2025 t 693 new 0.22) lr 1.00e-05 gnorm 0.156 3.63s mem 81.1GB +[2026-09-14 13:01:22] step 3184/5000 loss 0.3349 (w 0.2263 mse 0.2236 t 976 new 0.26) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +[2026-09-14 13:01:25] step 3185/5000 loss 0.2575 (w 0.1339 mse 0.1445 t 856 new 0.14) lr 1.00e-05 gnorm 0.146 3.10s mem 81.1GB +[2026-09-14 13:01:28] step 3186/5000 loss 0.1962 (w 0.1699 mse 0.1696 t 607 new 0.12) lr 1.00e-05 gnorm 0.099 2.85s mem 81.1GB +[2026-09-14 13:01:31] step 3187/5000 loss 0.1510 (w 0.1573 mse 0.1529 t 898 new 0.20) lr 1.00e-05 gnorm 0.162 3.10s mem 81.1GB +[2026-09-14 13:01:34] step 3188/5000 loss 0.2022 (w 0.2376 mse 0.2371 t 969 new 0.07) lr 1.00e-05 gnorm 0.193 3.15s mem 81.1GB +[2026-09-14 13:01:37] step 3189/5000 loss 0.2246 (w 0.2918 mse 0.2758 t 995 new 0.22) lr 1.00e-05 gnorm 0.165 3.44s mem 81.1GB +[2026-09-14 13:01:41] step 3190/5000 loss 0.2349 (w 0.2958 mse 0.2953 t 310 new 0.20) lr 1.00e-05 gnorm 0.140 3.32s mem 81.1GB +[2026-09-14 13:01:44] step 3191/5000 loss 0.1940 (w 0.1778 mse 0.1735 t 891 new 0.19) lr 1.00e-05 gnorm 0.167 3.11s mem 81.1GB +[2026-09-14 13:01:47] step 3192/5000 loss 0.2136 (w 0.2241 mse 0.2172 t 861 new 0.19) lr 1.00e-05 gnorm 0.177 2.85s mem 81.1GB +[2026-09-14 13:01:50] step 3193/5000 loss 0.2886 (w 0.2334 mse 0.2296 t 944 new 0.20) lr 1.00e-05 gnorm 0.157 3.06s mem 81.1GB +[2026-09-14 13:01:53] step 3194/5000 loss 0.1500 (w 0.1992 mse 0.1934 t 911 new 0.25) lr 1.00e-05 gnorm 0.141 3.14s mem 81.1GB +[2026-09-14 13:01:56] step 3195/5000 loss 0.3385 (w 0.6687 mse 0.6650 t 146 new 0.25) lr 1.00e-05 gnorm 0.131 3.16s mem 81.1GB +[2026-09-14 13:01:59] step 3196/5000 loss 0.4185 (w 0.2395 mse 0.2415 t 973 new 0.20) lr 1.00e-05 gnorm 0.130 3.36s mem 81.1GB +[2026-09-14 13:02:02] step 3197/5000 loss 0.2027 (w 0.1601 mse 0.1575 t 713 new 0.21) lr 1.00e-05 gnorm 0.131 3.08s mem 81.1GB +[2026-09-14 13:02:05] step 3198/5000 loss 0.4761 (w 0.3103 mse 0.2997 t 968 new 0.18) lr 1.00e-05 gnorm 0.127 2.85s mem 81.1GB +[2026-09-14 13:02:08] step 3199/5000 loss 0.3456 (w 0.3108 mse 0.3084 t 465 new 0.15) lr 1.00e-05 gnorm 0.108 3.07s mem 81.1GB +[2026-09-14 13:02:11] step 3200/5000 loss 0.3799 (w 0.3717 mse 0.3607 t 264 new 0.19) lr 1.00e-05 gnorm 0.155 3.14s mem 81.1GB +[2026-09-14 13:02:15] step 3201/5000 loss 0.1816 (w 0.3164 mse 0.3163 t 904 new 0.19) lr 1.00e-05 gnorm 0.237 3.28s mem 81.1GB +[2026-09-14 13:02:18] step 3202/5000 loss 0.3809 (w 0.2793 mse 0.2598 t 857 new 0.24) lr 1.00e-05 gnorm 0.133 3.12s mem 81.1GB +[2026-09-14 13:02:21] step 3203/5000 loss 0.2770 (w 0.2361 mse 0.2325 t 871 new 0.23) lr 1.00e-05 gnorm 0.140 3.12s mem 81.1GB +[2026-09-14 13:02:24] step 3204/5000 loss 0.2424 (w 0.2410 mse 0.2322 t 874 new 0.22) lr 1.00e-05 gnorm 0.163 3.04s mem 81.1GB +[2026-09-14 13:02:27] step 3205/5000 loss 0.1136 (w 0.2588 mse 0.2508 t 949 new 0.23) lr 1.00e-05 gnorm 0.152 2.84s mem 81.1GB +[2026-09-14 13:02:30] step 3206/5000 loss 0.1764 (w 0.1873 mse 0.1821 t 729 new 0.23) lr 1.00e-05 gnorm 0.133 3.07s mem 81.1GB +[2026-09-14 13:02:33] step 3207/5000 loss 0.3022 (w 0.1672 mse 0.1704 t 637 new 0.21) lr 1.00e-05 gnorm 0.139 3.46s mem 81.1GB +[2026-09-14 13:02:36] step 3208/5000 loss 0.4160 (w 0.1819 mse 0.1897 t 773 new 0.13) lr 1.00e-05 gnorm 0.129 3.06s mem 81.1GB +[2026-09-14 13:02:40] step 3209/5000 loss 0.2355 (w 0.2349 mse 0.2257 t 760 new 0.14) lr 1.00e-05 gnorm 0.234 3.14s mem 81.1GB +[2026-09-14 13:02:43] step 3210/5000 loss 0.1963 (w 0.4081 mse 0.3904 t 1000 new 0.19) lr 1.00e-05 gnorm 0.171 3.05s mem 81.1GB +[2026-09-14 13:02:45] step 3211/5000 loss 0.2244 (w 0.1912 mse 0.1857 t 743 new 0.23) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +[2026-09-14 13:02:49] step 3212/5000 loss 0.2673 (w 0.3381 mse 0.3232 t 968 new 0.15) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +[2026-09-14 13:02:52] step 3213/5000 loss 0.1832 (w 0.1731 mse 0.1699 t 871 new 0.18) lr 1.00e-05 gnorm 0.142 3.48s mem 81.1GB +[2026-09-14 13:02:55] step 3214/5000 loss 0.1235 (w 0.2980 mse 0.3023 t 966 new 0.10) lr 1.00e-05 gnorm 0.153 3.37s mem 81.1GB +[2026-09-14 13:02:58] step 3215/5000 loss 0.2183 (w 0.4213 mse 0.4047 t 990 new 0.24) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +[2026-09-14 13:03:01] step 3216/5000 loss 0.1806 (w 0.1970 mse 0.1959 t 562 new 0.18) lr 1.00e-05 gnorm 39.826 3.06s mem 81.1GB +[2026-09-14 13:03:04] step 3217/5000 loss 0.2383 (w 0.3631 mse 0.3651 t 332 new 0.21) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +[2026-09-14 13:03:08] step 3218/5000 loss 0.2549 (w 0.1672 mse 0.1626 t 927 new 0.11) lr 1.00e-05 gnorm 0.149 3.43s mem 81.1GB +[2026-09-14 13:03:11] step 3219/5000 loss 0.4211 (w 0.3230 mse 0.3113 t 424 new 0.22) lr 1.00e-05 gnorm 0.196 3.15s mem 81.1GB +[2026-09-14 13:03:14] step 3220/5000 loss 0.1813 (w 0.1913 mse 0.1875 t 782 new 0.14) lr 1.00e-05 gnorm 0.142 3.40s mem 81.1GB +[2026-09-14 13:03:17] step 3221/5000 loss 0.1351 (w 0.2277 mse 0.2164 t 936 new 0.21) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +[2026-09-14 13:03:20] step 3222/5000 loss 0.1862 (w 0.2566 mse 0.2438 t 877 new 0.21) lr 1.00e-05 gnorm 0.168 3.09s mem 81.1GB +[2026-09-14 13:03:23] step 3223/5000 loss 0.3793 (w 0.1736 mse 0.1725 t 777 new 0.27) lr 1.00e-05 gnorm 0.158 2.84s mem 81.1GB +[2026-09-14 13:03:26] step 3224/5000 loss 0.3083 (w 0.2205 mse 0.2198 t 859 new 0.19) lr 1.00e-05 gnorm 0.118 3.35s mem 81.1GB +[2026-09-14 13:03:30] step 3225/5000 loss 0.1129 (w 0.2099 mse 0.2002 t 988 new 0.23) lr 1.00e-05 gnorm 0.184 3.30s mem 81.1GB +[2026-09-14 13:03:33] step 3226/5000 loss 0.3012 (w 0.3026 mse 0.2901 t 688 new 0.13) lr 1.00e-05 gnorm 0.176 3.12s mem 81.1GB +[2026-09-14 13:03:35] step 3227/5000 loss 0.1665 (w 0.1920 mse 0.1903 t 987 new 0.18) lr 1.00e-05 gnorm 0.136 2.84s mem 81.1GB +[2026-09-14 13:03:39] step 3228/5000 loss 0.1811 (w 0.1903 mse 0.1872 t 887 new 0.19) lr 1.00e-05 gnorm 0.341 3.05s mem 81.1GB +[2026-09-14 13:03:41] step 3229/5000 loss 0.1924 (w 0.2157 mse 0.2117 t 973 new 0.22) lr 1.00e-05 gnorm 0.162 2.83s mem 81.1GB +[2026-09-14 13:03:45] step 3230/5000 loss 0.2500 (w 0.2018 mse 0.1941 t 852 new 0.23) lr 1.00e-05 gnorm 0.139 3.35s mem 81.1GB +[2026-09-14 13:03:48] step 3231/5000 loss 0.3531 (w 0.2011 mse 0.1870 t 926 new 0.22) lr 1.00e-05 gnorm 0.138 3.34s mem 81.1GB +[2026-09-14 13:03:51] step 3232/5000 loss 0.2004 (w 0.2995 mse 0.2919 t 873 new 0.24) lr 1.00e-05 gnorm 0.145 3.31s mem 81.1GB +[2026-09-14 13:03:54] step 3233/5000 loss 0.2397 (w 0.2757 mse 0.2598 t 605 new 0.25) lr 1.00e-05 gnorm 0.114 2.84s mem 81.1GB +[2026-09-14 13:03:57] step 3234/5000 loss 0.1894 (w 0.0728 mse 0.0786 t 786 new 0.14) lr 1.00e-05 gnorm 0.121 3.10s mem 81.1GB +[2026-09-14 13:04:00] step 3235/5000 loss 0.2018 (w 0.2164 mse 0.2103 t 621 new 0.22) lr 1.00e-05 gnorm 0.152 2.85s mem 81.1GB +[2026-09-14 13:04:04] step 3236/5000 loss 0.2113 (w 0.2856 mse 0.2668 t 958 new 0.27) lr 1.00e-05 gnorm 0.140 3.47s mem 81.1GB +[2026-09-14 13:04:07] step 3237/5000 loss 0.2535 (w 0.3848 mse 0.4068 t 127 new 0.21) lr 1.00e-05 gnorm 0.146 3.10s mem 81.1GB +[2026-09-14 13:04:10] step 3238/5000 loss 0.3566 (w 0.2148 mse 0.1883 t 730 new 0.26) lr 1.00e-05 gnorm 0.300 3.43s mem 81.1GB +[2026-09-14 13:04:13] step 3239/5000 loss 0.2155 (w 0.2171 mse 0.2086 t 927 new 0.19) lr 1.00e-05 gnorm 0.178 3.13s mem 81.1GB +[2026-09-14 13:04:16] step 3240/5000 loss 0.3407 (w 0.1849 mse 0.1847 t 922 new 0.16) lr 1.00e-05 gnorm 0.181 2.83s mem 81.1GB +[2026-09-14 13:04:19] step 3241/5000 loss 0.1252 (w 0.3208 mse 0.3233 t 966 new 0.22) lr 1.00e-05 gnorm 0.106 3.15s mem 81.1GB +[2026-09-14 13:04:23] step 3242/5000 loss 0.2045 (w 0.2229 mse 0.2190 t 886 new 0.23) lr 1.00e-05 gnorm 0.159 3.46s mem 81.1GB +[2026-09-14 13:04:26] step 3243/5000 loss 0.2477 (w 0.1774 mse 0.1887 t 440 new 0.27) lr 1.00e-05 gnorm 0.173 3.43s mem 81.1GB +[2026-09-14 13:04:29] step 3244/5000 loss 0.1822 (w 0.2455 mse 0.2283 t 919 new 0.27) lr 1.00e-05 gnorm 0.149 3.15s mem 81.1GB +[2026-09-14 13:04:32] step 3245/5000 loss 0.2405 (w 0.1231 mse 0.1235 t 669 new 0.11) lr 1.00e-05 gnorm 0.145 3.04s mem 81.1GB +[2026-09-14 13:04:35] step 3246/5000 loss 0.3543 (w 0.2495 mse 0.2465 t 820 new 0.23) lr 1.00e-05 gnorm 0.340 2.85s mem 81.1GB +[2026-09-14 13:04:38] step 3247/5000 loss 0.2810 (w 0.4389 mse 0.4458 t 206 new 0.28) lr 1.00e-05 gnorm 0.139 3.05s mem 81.1GB +[2026-09-14 13:04:42] step 3248/5000 loss 0.1464 (w 0.2137 mse 0.2179 t 945 new 0.15) lr 1.00e-05 gnorm 0.126 3.54s mem 81.1GB +[2026-09-14 13:04:45] step 3249/5000 loss 0.1992 (w 0.1955 mse 0.1820 t 864 new 0.25) lr 1.00e-05 gnorm 0.243 3.34s mem 81.1GB +[2026-09-14 13:04:48] step 3250/5000 loss 0.2973 (w 0.2534 mse 0.2385 t 908 new 0.23) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +[2026-09-14 13:04:51] step 3251/5000 loss 0.1225 (w 0.1468 mse 0.1381 t 945 new 0.17) lr 1.00e-05 gnorm 0.103 3.02s mem 81.1GB +[2026-09-14 13:04:54] step 3252/5000 loss 0.2286 (w 0.4605 mse 0.4570 t 973 new 0.19) lr 1.00e-05 gnorm 0.167 2.85s mem 81.1GB +[2026-09-14 13:04:57] step 3253/5000 loss 0.2404 (w 0.1133 mse 0.1325 t 969 new 0.18) lr 1.00e-05 gnorm 0.157 3.11s mem 81.1GB +[2026-09-14 13:05:00] step 3254/5000 loss 0.0677 (w 0.1373 mse 0.1321 t 913 new 0.08) lr 1.00e-05 gnorm 0.141 3.16s mem 81.1GB +[2026-09-14 13:05:04] step 3255/5000 loss 0.2802 (w 0.2117 mse 0.2077 t 980 new 0.26) lr 1.00e-05 gnorm 0.135 3.31s mem 81.1GB +[2026-09-14 13:05:07] step 3256/5000 loss 0.3479 (w 0.2289 mse 0.2209 t 998 new 0.21) lr 1.00e-05 gnorm 0.118 3.10s mem 81.1GB +[2026-09-14 13:05:10] step 3257/5000 loss 0.2310 (w 0.2042 mse 0.2080 t 992 new 0.25) lr 1.00e-05 gnorm 0.113 3.04s mem 81.1GB +[2026-09-14 13:05:13] step 3258/5000 loss 0.2229 (w 0.1141 mse 0.1208 t 982 new 0.06) lr 1.00e-05 gnorm 0.172 2.84s mem 81.1GB +[2026-09-14 13:05:16] step 3259/5000 loss 0.0645 (w 0.3647 mse 0.3313 t 990 new 0.22) lr 1.00e-05 gnorm 0.131 3.32s mem 81.1GB +[2026-09-14 13:05:20] step 3260/5000 loss 0.1975 (w 0.1525 mse 0.1603 t 963 new 0.16) lr 1.00e-05 gnorm 0.135 3.44s mem 81.1GB +[2026-09-14 13:05:23] step 3261/5000 loss 0.1200 (w 0.2172 mse 0.2103 t 902 new 0.24) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +[2026-09-14 13:05:26] step 3262/5000 loss 0.2960 (w 0.5870 mse 0.5807 t 146 new 0.15) lr 1.00e-05 gnorm 0.186 3.10s mem 81.1GB +[2026-09-14 13:05:29] step 3263/5000 loss 0.2504 (w 0.2055 mse 0.2091 t 980 new 0.25) lr 1.00e-05 gnorm 0.133 2.86s mem 81.1GB +[2026-09-14 13:05:32] step 3264/5000 loss 0.3060 (w 0.2346 mse 0.2139 t 787 new 0.22) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +[2026-09-14 13:05:35] step 3265/5000 loss 0.1286 (w 0.3671 mse 0.3452 t 997 new 0.21) lr 1.00e-05 gnorm 0.150 3.31s mem 81.1GB +[2026-09-14 13:05:38] step 3266/5000 loss 0.1759 (w 0.1797 mse 0.1878 t 944 new 0.23) lr 1.00e-05 gnorm 0.175 3.41s mem 81.1GB +[2026-09-14 13:05:42] step 3267/5000 loss 0.1534 (w 0.1126 mse 0.1258 t 944 new 0.13) lr 1.00e-05 gnorm 0.166 3.11s mem 81.1GB +[2026-09-14 13:05:45] step 3268/5000 loss 0.2066 (w 0.2868 mse 0.2695 t 953 new 0.26) lr 1.00e-05 gnorm 0.162 3.14s mem 81.1GB +[2026-09-14 13:05:48] step 3269/5000 loss 0.1567 (w 0.2071 mse 0.1973 t 851 new 0.21) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +[2026-09-14 13:05:51] step 3270/5000 loss 0.2622 (w 0.0892 mse 0.0893 t 907 new 0.08) lr 1.00e-05 gnorm 0.238 3.43s mem 81.1GB +[2026-09-14 13:05:54] step 3271/5000 loss 0.2137 (w 0.2544 mse 0.2544 t 997 new 0.26) lr 1.00e-05 gnorm 0.132 3.37s mem 81.1GB +[2026-09-14 13:05:57] step 3272/5000 loss 0.0874 (w 0.2449 mse 0.2320 t 990 new 0.19) lr 1.00e-05 gnorm 0.149 3.05s mem 81.1GB +[2026-09-14 13:06:01] step 3273/5000 loss 0.1575 (w 0.2347 mse 0.2255 t 978 new 0.18) lr 1.00e-05 gnorm 0.133 3.40s mem 81.1GB +[2026-09-14 13:06:04] step 3274/5000 loss 0.2794 (w 0.2201 mse 0.2205 t 950 new 0.20) lr 1.00e-05 gnorm 1.409 2.83s mem 81.1GB +[2026-09-14 13:06:08] step 3275/5000 loss 0.1204 (w 0.2118 mse 0.2133 t 938 new 0.19) lr 1.00e-05 gnorm 0.144 3.98s mem 81.1GB +[2026-09-14 13:06:11] step 3276/5000 loss 0.2021 (w 0.2645 mse 0.2496 t 829 new 0.28) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +[2026-09-14 13:06:14] step 3277/5000 loss 0.2711 (w 0.2080 mse 0.2141 t 984 new 0.20) lr 1.00e-05 gnorm 0.130 3.36s mem 81.1GB +[2026-09-14 13:06:17] step 3278/5000 loss 0.2441 (w 0.3244 mse 0.3254 t 348 new 0.26) lr 1.00e-05 gnorm 0.160 3.14s mem 81.1GB +[2026-09-14 13:06:20] step 3279/5000 loss 0.2192 (w 0.1887 mse 0.1797 t 793 new 0.25) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +[2026-09-14 13:06:23] step 3280/5000 loss 0.3150 (w 0.3058 mse 0.3039 t 500 new 0.21) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +[2026-09-14 13:06:26] step 3281/5000 loss 0.2231 (w 0.2228 mse 0.2198 t 974 new 0.22) lr 1.00e-05 gnorm 0.128 3.09s mem 81.1GB +[2026-09-14 13:06:29] step 3282/5000 loss 0.1082 (w 0.2013 mse 0.1944 t 969 new 0.09) lr 1.00e-05 gnorm 0.202 3.06s mem 81.1GB +[2026-09-14 13:06:33] step 3283/5000 loss 0.2023 (w 0.1985 mse 0.2014 t 660 new 0.15) lr 1.00e-05 gnorm 0.160 3.39s mem 81.1GB +[2026-09-14 13:06:36] step 3284/5000 loss 0.4042 (w 0.2190 mse 0.2379 t 968 new 0.19) lr 1.00e-05 gnorm 0.144 3.34s mem 81.1GB +[2026-09-14 13:06:39] step 3285/5000 loss 0.1403 (w 0.2127 mse 0.2159 t 932 new 0.17) lr 1.00e-05 gnorm 0.229 3.07s mem 81.1GB +[2026-09-14 13:06:42] step 3286/5000 loss 0.2103 (w 0.1365 mse 0.1336 t 741 new 0.19) lr 1.00e-05 gnorm 1.498 2.83s mem 81.1GB +[2026-09-14 13:06:45] step 3287/5000 loss 0.2025 (w 0.2028 mse 0.1977 t 706 new 0.28) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +[2026-09-14 13:06:48] step 3288/5000 loss 0.1456 (w 0.2559 mse 0.2523 t 968 new 0.22) lr 1.00e-05 gnorm 0.163 3.34s mem 81.1GB +[2026-09-14 13:06:52] step 3289/5000 loss 0.1922 (w 0.2148 mse 0.1923 t 921 new 0.22) lr 1.00e-05 gnorm 0.139 3.40s mem 81.1GB +[2026-09-14 13:06:55] step 3290/5000 loss 0.2098 (w 0.3002 mse 0.2933 t 999 new 0.23) lr 1.00e-05 gnorm 0.121 3.30s mem 81.1GB +[2026-09-14 13:06:58] step 3291/5000 loss 0.2375 (w 0.1652 mse 0.1758 t 662 new 0.17) lr 1.00e-05 gnorm 0.114 3.08s mem 81.1GB +[2026-09-14 13:07:01] step 3292/5000 loss 0.3303 (w 0.2336 mse 0.2182 t 950 new 0.20) lr 1.00e-05 gnorm 0.123 2.85s mem 81.1GB +[2026-09-14 13:07:04] step 3293/5000 loss 0.2638 (w 0.4244 mse 0.3951 t 969 new 0.23) lr 1.00e-05 gnorm 0.181 3.04s mem 81.1GB +[2026-09-14 13:07:07] step 3294/5000 loss 0.2015 (w 0.2917 mse 0.3051 t 983 new 0.11) lr 1.00e-05 gnorm 0.141 3.33s mem 81.1GB +[2026-09-14 13:07:11] step 3295/5000 loss 0.2638 (w 0.2430 mse 0.2428 t 951 new 0.22) lr 1.00e-05 gnorm 0.219 3.42s mem 81.1GB +[2026-09-14 13:07:14] step 3296/5000 loss 0.3847 (w 0.2453 mse 0.2336 t 973 new 0.21) lr 1.00e-05 gnorm 0.188 3.08s mem 81.1GB +[2026-09-14 13:07:17] step 3297/5000 loss 0.1663 (w 0.2968 mse 0.2821 t 947 new 0.19) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +[2026-09-14 13:07:20] step 3298/5000 loss 0.3113 (w 0.5610 mse 0.5537 t 171 new 0.25) lr 1.00e-05 gnorm 0.144 2.83s mem 81.1GB +[2026-09-14 13:07:23] step 3299/5000 loss 0.3085 (w 0.1877 mse 0.1869 t 918 new 0.22) lr 1.00e-05 gnorm 0.308 3.25s mem 81.1GB +[2026-09-14 13:07:26] step 3300/5000 loss 0.2131 (w 0.1647 mse 0.1674 t 702 new 0.10) lr 1.00e-05 gnorm 0.112 3.10s mem 81.1GB +[2026-09-14 13:07:30] step 3301/5000 loss 0.1692 (w 0.2000 mse 0.1903 t 917 new 0.21) lr 1.00e-05 gnorm 0.210 3.35s mem 81.1GB +[2026-09-14 13:07:33] step 3302/5000 loss 0.3623 (w 0.1560 mse 0.1579 t 743 new 0.25) lr 1.00e-05 gnorm 0.180 3.11s mem 81.1GB +[2026-09-14 13:07:36] step 3303/5000 loss 0.1475 (w 0.1036 mse 0.1064 t 894 new 0.29) lr 1.00e-05 gnorm 0.133 3.08s mem 81.1GB +[2026-09-14 13:07:39] step 3304/5000 loss 0.2547 (w 0.2250 mse 0.2235 t 963 new 0.24) lr 1.00e-05 gnorm 0.326 2.84s mem 81.1GB +[2026-09-14 13:07:42] step 3305/5000 loss 0.1239 (w 0.2589 mse 0.2513 t 736 new 0.26) lr 1.00e-05 gnorm 0.309 3.26s mem 81.1GB +[2026-09-14 13:07:45] step 3306/5000 loss 0.2828 (w 0.2273 mse 0.2320 t 738 new 0.18) lr 1.00e-05 gnorm 0.307 3.34s mem 81.1GB +[2026-09-14 13:07:48] step 3307/5000 loss 0.1567 (w 0.2448 mse 0.2374 t 940 new 0.21) lr 1.00e-05 gnorm 0.123 3.08s mem 81.1GB +[2026-09-14 13:07:51] step 3308/5000 loss 0.2156 (w 0.2693 mse 0.2525 t 987 new 0.20) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +[2026-09-14 13:07:54] step 3309/5000 loss 0.0885 (w 0.2787 mse 0.2747 t 977 new 0.20) lr 1.00e-05 gnorm 0.132 3.10s mem 81.1GB +[2026-09-14 13:07:57] step 3310/5000 loss 0.1214 (w 0.1844 mse 0.1886 t 913 new 0.20) lr 1.00e-05 gnorm 0.190 2.83s mem 81.1GB +[2026-09-14 13:08:01] step 3311/5000 loss 0.1717 (w 0.1250 mse 0.1266 t 947 new 0.25) lr 1.00e-05 gnorm 0.149 3.35s mem 81.1GB +[2026-09-14 13:08:04] step 3312/5000 loss 0.2115 (w 0.3216 mse 0.3125 t 966 new 0.28) lr 1.00e-05 gnorm 0.230 3.14s mem 81.1GB +[2026-09-14 13:08:07] step 3313/5000 loss 0.3102 (w 0.2904 mse 0.2750 t 1000 new 0.20) lr 1.00e-05 gnorm 0.110 3.05s mem 81.1GB +[2026-09-14 13:08:10] step 3314/5000 loss 0.2105 (w 0.2126 mse 0.2070 t 884 new 0.16) lr 1.00e-05 gnorm 0.168 3.30s mem 81.1GB +[2026-09-14 13:08:13] step 3315/5000 loss 0.2634 (w 0.1951 mse 0.2100 t 984 new 0.20) lr 1.00e-05 gnorm 0.161 2.83s mem 81.1GB +[2026-09-14 13:08:16] step 3316/5000 loss 0.3717 (w 0.0843 mse 0.0979 t 725 new 0.19) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +[2026-09-14 13:08:19] step 3317/5000 loss 0.2433 (w 0.1819 mse 0.1958 t 521 new 0.15) lr 1.00e-05 gnorm 0.188 3.09s mem 81.1GB +[2026-09-14 13:08:23] step 3318/5000 loss 0.2401 (w 0.2021 mse 0.2071 t 584 new 0.23) lr 1.00e-05 gnorm 0.137 3.47s mem 81.1GB +[2026-09-14 13:08:26] step 3319/5000 loss 0.2893 (w 0.2538 mse 0.2470 t 648 new 0.24) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +[2026-09-14 13:08:29] step 3320/5000 loss 0.3318 (w 0.1534 mse 0.1493 t 610 new 0.19) lr 1.00e-05 gnorm 0.161 3.10s mem 81.1GB +[2026-09-14 13:08:32] step 3321/5000 loss 0.2022 (w 0.2752 mse 0.2764 t 878 new 0.13) lr 1.00e-05 gnorm 0.202 2.83s mem 81.1GB +[2026-09-14 13:08:35] step 3322/5000 loss 0.3427 (w 0.1558 mse 0.1538 t 989 new 0.13) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +[2026-09-14 13:08:38] step 3323/5000 loss 0.2057 (w 0.1308 mse 0.1422 t 813 new 0.15) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +[2026-09-14 13:08:41] step 3324/5000 loss 0.1641 (w 0.2250 mse 0.2138 t 961 new 0.20) lr 1.00e-05 gnorm 0.133 3.33s mem 81.1GB +[2026-09-14 13:08:45] step 3325/5000 loss 0.1110 (w 0.1346 mse 0.1460 t 966 new 0.10) lr 1.00e-05 gnorm 0.132 3.38s mem 81.1GB +[2026-09-14 13:08:48] step 3326/5000 loss 0.2972 (w 0.3642 mse 0.3645 t 434 new 0.18) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +[2026-09-14 13:08:51] step 3327/5000 loss 0.1747 (w 0.2427 mse 0.2448 t 796 new 0.21) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +[2026-09-14 13:08:54] step 3328/5000 loss 0.2337 (w 0.2997 mse 0.3014 t 954 new 0.20) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +[2026-09-14 13:08:57] step 3329/5000 loss 0.1352 (w 0.2237 mse 0.2149 t 873 new 0.16) lr 1.00e-05 gnorm 0.116 3.30s mem 81.1GB +[2026-09-14 13:09:00] step 3330/5000 loss 0.3589 (w 0.2114 mse 0.2084 t 728 new 0.11) lr 1.00e-05 gnorm 0.149 3.41s mem 81.1GB +[2026-09-14 13:09:04] step 3331/5000 loss 0.1872 (w 0.1767 mse 0.1770 t 948 new 0.24) lr 1.00e-05 gnorm 0.141 3.11s mem 81.1GB +[2026-09-14 13:09:07] step 3332/5000 loss 0.2267 (w 0.2497 mse 0.2467 t 913 new 0.23) lr 1.00e-05 gnorm 0.167 3.08s mem 81.1GB +[2026-09-14 13:09:09] step 3333/5000 loss 0.2720 (w 0.5116 mse 0.5232 t 998 new 0.19) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +[2026-09-14 13:09:13] step 3334/5000 loss 0.2992 (w 0.1675 mse 0.1825 t 859 new 0.19) lr 1.00e-05 gnorm 0.167 3.27s mem 81.1GB +[2026-09-14 13:09:16] step 3335/5000 loss 0.2701 (w 0.5347 mse 0.5372 t 183 new 0.14) lr 1.00e-05 gnorm 0.143 3.07s mem 81.1GB +[2026-09-14 13:09:19] step 3336/5000 loss 0.2143 (w 0.1496 mse 0.1616 t 746 new 0.16) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +[2026-09-14 13:09:22] step 3337/5000 loss 0.2683 (w 0.1282 mse 0.1301 t 623 new 0.10) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +[2026-09-14 13:09:25] step 3338/5000 loss 0.1705 (w 0.2311 mse 0.2273 t 950 new 0.24) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +[2026-09-14 13:09:28] step 3339/5000 loss 0.1258 (w 0.1373 mse 0.1262 t 787 new 0.24) lr 1.00e-05 gnorm 0.175 2.83s mem 81.1GB +[2026-09-14 13:09:31] step 3340/5000 loss 0.4041 (w 0.2675 mse 0.2564 t 687 new 0.22) lr 1.00e-05 gnorm 0.212 3.31s mem 81.1GB +[2026-09-14 13:09:34] step 3341/5000 loss 0.2844 (w 0.3887 mse 0.4128 t 238 new 0.20) lr 1.00e-05 gnorm 0.159 3.10s mem 81.1GB +[2026-09-14 13:09:38] step 3342/5000 loss 0.1560 (w 0.2292 mse 0.2263 t 966 new 0.24) lr 1.00e-05 gnorm 0.149 3.10s mem 81.1GB +[2026-09-14 13:09:41] step 3343/5000 loss 0.2307 (w 0.2701 mse 0.2564 t 871 new 0.26) lr 1.00e-05 gnorm 0.199 3.41s mem 81.1GB +[2026-09-14 13:09:44] step 3344/5000 loss 0.4202 (w 0.1541 mse 0.1596 t 773 new 0.18) lr 1.00e-05 gnorm 0.133 2.82s mem 81.1GB +[2026-09-14 13:09:47] step 3345/5000 loss 0.1578 (w 0.1753 mse 0.1809 t 553 new 0.21) lr 1.00e-05 gnorm 0.137 3.10s mem 81.1GB +[2026-09-14 13:09:50] step 3346/5000 loss 0.2945 (w 0.2889 mse 0.2848 t 397 new 0.18) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +[2026-09-14 13:09:53] step 3347/5000 loss 0.1902 (w 0.1250 mse 0.1372 t 883 new 0.15) lr 1.00e-05 gnorm 0.153 3.27s mem 81.1GB +[2026-09-14 13:09:57] step 3348/5000 loss 0.4058 (w 0.2342 mse 0.2198 t 729 new 0.17) lr 1.00e-05 gnorm 0.183 3.58s mem 81.1GB +[2026-09-14 13:10:00] step 3349/5000 loss 0.1599 (w 0.2314 mse 0.2151 t 929 new 0.23) lr 1.00e-05 gnorm 0.174 3.07s mem 81.1GB +[2026-09-14 13:10:03] step 3350/5000 loss 0.1504 (w 0.2119 mse 0.2221 t 983 new 0.08) lr 1.00e-05 gnorm 0.126 2.83s mem 81.1GB +[2026-09-14 13:10:06] step 3351/5000 loss 0.2176 (w 0.1927 mse 0.1860 t 804 new 0.12) lr 1.00e-05 gnorm 0.144 3.03s mem 81.1GB +[2026-09-14 13:10:09] step 3352/5000 loss 0.2555 (w 0.2217 mse 0.2444 t 987 new 0.14) lr 1.00e-05 gnorm 0.131 3.06s mem 81.1GB +[2026-09-14 13:10:12] step 3353/5000 loss 0.2304 (w 0.1233 mse 0.1250 t 670 new 0.24) lr 1.00e-05 gnorm 0.150 3.41s mem 81.1GB +[2026-09-14 13:10:15] step 3354/5000 loss 0.2645 (w 0.1257 mse 0.1217 t 660 new 0.13) lr 1.00e-05 gnorm 0.114 3.08s mem 81.1GB +[2026-09-14 13:10:18] step 3355/5000 loss 0.1543 (w 0.1939 mse 0.2003 t 991 new 0.18) lr 1.00e-05 gnorm 0.148 3.11s mem 81.1GB +[2026-09-14 13:10:21] step 3356/5000 loss 0.1729 (w 0.1518 mse 0.1501 t 508 new 0.14) lr 1.00e-05 gnorm 0.149 2.82s mem 81.1GB +[2026-09-14 13:10:24] step 3357/5000 loss 0.1469 (w 0.3498 mse 0.3531 t 998 new 0.20) lr 1.00e-05 gnorm 0.299 3.07s mem 81.1GB +[2026-09-14 13:10:27] step 3358/5000 loss 0.2290 (w 0.3215 mse 0.3142 t 340 new 0.25) lr 1.00e-05 gnorm 0.118 3.04s mem 81.1GB +[2026-09-14 13:10:31] step 3359/5000 loss 0.3053 (w 0.2272 mse 0.2348 t 909 new 0.18) lr 1.00e-05 gnorm 0.120 3.32s mem 81.1GB +[2026-09-14 13:10:34] step 3360/5000 loss 0.3740 (w 0.2346 mse 0.2232 t 861 new 0.23) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +[2026-09-14 13:10:37] step 3361/5000 loss 0.1303 (w 0.4893 mse 0.5035 t 996 new 0.17) lr 1.00e-05 gnorm 0.118 3.13s mem 81.1GB +[2026-09-14 13:10:40] step 3362/5000 loss 0.1667 (w 0.2311 mse 0.2191 t 795 new 0.20) lr 1.00e-05 gnorm 0.218 2.83s mem 81.1GB +[2026-09-14 13:10:43] step 3363/5000 loss 0.1938 (w 0.2303 mse 0.2105 t 893 new 0.21) lr 1.00e-05 gnorm 0.169 3.10s mem 81.1GB +[2026-09-14 13:10:46] step 3364/5000 loss 0.1758 (w 0.2338 mse 0.2280 t 990 new 0.23) lr 1.00e-05 gnorm 0.188 3.08s mem 81.1GB +[2026-09-14 13:10:49] step 3365/5000 loss 0.3000 (w 0.5172 mse 0.5428 t 120 new 0.26) lr 1.00e-05 gnorm 0.152 3.40s mem 81.1GB +[2026-09-14 13:10:52] step 3366/5000 loss 0.1137 (w 0.2387 mse 0.2334 t 938 new 0.23) lr 1.00e-05 gnorm 0.126 3.12s mem 81.1GB +[2026-09-14 13:10:56] step 3367/5000 loss 0.1891 (w 0.2607 mse 0.2544 t 895 new 0.19) lr 1.00e-05 gnorm 0.193 3.18s mem 81.1GB +[2026-09-14 13:10:58] step 3368/5000 loss 0.1215 (w 0.2376 mse 0.2335 t 753 new 0.18) lr 1.00e-05 gnorm 0.150 2.84s mem 81.1GB +[2026-09-14 13:11:02] step 3369/5000 loss 0.4000 (w 0.7053 mse 0.7185 t 107 new 0.21) lr 1.00e-05 gnorm 0.199 3.04s mem 81.1GB +[2026-09-14 13:11:05] step 3370/5000 loss 0.1897 (w 0.2598 mse 0.2431 t 768 new 0.23) lr 1.00e-05 gnorm 0.136 3.32s mem 81.1GB +[2026-09-14 13:11:08] step 3371/5000 loss 0.2553 (w 0.1677 mse 0.1610 t 940 new 0.20) lr 1.00e-05 gnorm 0.134 3.45s mem 81.1GB +[2026-09-14 13:11:11] step 3372/5000 loss 0.3192 (w 0.2720 mse 0.2658 t 836 new 0.29) lr 1.00e-05 gnorm 0.172 2.82s mem 81.1GB +[2026-09-14 13:11:14] step 3373/5000 loss 0.2101 (w 0.2347 mse 0.2144 t 914 new 0.20) lr 1.00e-05 gnorm 0.121 3.07s mem 81.1GB +[2026-09-14 13:11:17] step 3374/5000 loss 0.2443 (w 0.1866 mse 0.1819 t 921 new 0.24) lr 1.00e-05 gnorm 0.170 2.82s mem 81.1GB +[2026-09-14 13:11:20] step 3375/5000 loss 0.1578 (w 0.1352 mse 0.1449 t 855 new 0.26) lr 1.00e-05 gnorm 0.161 3.29s mem 81.1GB +[2026-09-14 13:11:23] step 3376/5000 loss 0.3561 (w 0.1878 mse 0.1846 t 893 new 0.22) lr 1.00e-05 gnorm 0.161 3.12s mem 81.1GB +[2026-09-14 13:11:27] step 3377/5000 loss 0.1564 (w 0.2929 mse 0.2908 t 996 new 0.05) lr 1.00e-05 gnorm 0.184 3.38s mem 81.1GB +[2026-09-14 13:11:30] step 3378/5000 loss 0.2346 (w 0.1229 mse 0.1425 t 811 new 0.19) lr 1.00e-05 gnorm 0.117 2.84s mem 81.1GB +[2026-09-14 13:11:33] step 3379/5000 loss 0.2217 (w 0.2335 mse 0.2178 t 685 new 0.25) lr 1.00e-05 gnorm 0.181 3.14s mem 81.1GB +[2026-09-14 13:11:36] step 3380/5000 loss 0.1266 (w 0.2246 mse 0.2200 t 742 new 0.10) lr 1.00e-05 gnorm 0.113 3.02s mem 81.1GB +[2026-09-14 13:11:39] step 3381/5000 loss 0.2949 (w 0.2208 mse 0.2001 t 826 new 0.21) lr 1.00e-05 gnorm 0.204 3.08s mem 81.1GB +[2026-09-14 13:11:42] step 3382/5000 loss 0.2818 (w 0.2307 mse 0.2214 t 939 new 0.22) lr 1.00e-05 gnorm 0.142 3.43s mem 81.1GB +[2026-09-14 13:11:46] step 3383/5000 loss 0.2407 (w 0.3273 mse 0.3122 t 798 new 0.25) lr 1.00e-05 gnorm 0.115 3.14s mem 81.1GB +[2026-09-14 13:11:49] step 3384/5000 loss 0.1765 (w 0.2340 mse 0.2327 t 745 new 0.03) lr 1.00e-05 gnorm 0.132 3.06s mem 81.1GB +[2026-09-14 13:11:51] step 3385/5000 loss 0.2886 (w 0.1272 mse 0.1308 t 673 new 0.15) lr 1.00e-05 gnorm 0.176 2.82s mem 81.1GB +[2026-09-14 13:11:54] step 3386/5000 loss 0.1031 (w 0.2303 mse 0.2228 t 924 new 0.19) lr 1.00e-05 gnorm 0.126 3.05s mem 81.1GB +[2026-09-14 13:11:58] step 3387/5000 loss 0.1445 (w 0.1758 mse 0.1696 t 897 new 0.22) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +[2026-09-14 13:12:01] step 3388/5000 loss 0.2298 (w 0.3503 mse 0.3376 t 977 new 0.20) lr 1.00e-05 gnorm 0.535 3.44s mem 81.1GB +[2026-09-14 13:12:04] step 3389/5000 loss 0.1125 (w 0.2880 mse 0.2870 t 969 new 0.22) lr 1.00e-05 gnorm 0.164 3.16s mem 81.1GB +[2026-09-14 13:12:07] step 3390/5000 loss 0.1417 (w 0.2162 mse 0.1958 t 830 new 0.21) lr 1.00e-05 gnorm 0.131 3.05s mem 81.1GB +[2026-09-14 13:12:10] step 3391/5000 loss 0.1557 (w 0.2614 mse 0.2449 t 965 new 0.27) lr 1.00e-05 gnorm 0.124 2.84s mem 81.1GB +[2026-09-14 13:12:13] step 3392/5000 loss 0.2093 (w 0.1848 mse 0.1854 t 876 new 0.18) lr 1.00e-05 gnorm 0.156 3.02s mem 81.1GB +[2026-09-14 13:12:16] step 3393/5000 loss 0.2702 (w 0.3741 mse 0.3968 t 206 new 0.11) lr 1.00e-05 gnorm 0.133 3.15s mem 81.1GB +[2026-09-14 13:12:19] step 3394/5000 loss 0.1241 (w 0.1598 mse 0.1639 t 875 new 0.10) lr 1.00e-05 gnorm 0.175 3.04s mem 81.1GB +[2026-09-14 13:12:22] step 3395/5000 loss 0.3878 (w 0.4983 mse 0.4833 t 283 new 0.24) lr 1.00e-05 gnorm 0.182 3.09s mem 81.1GB +[2026-09-14 13:12:25] step 3396/5000 loss 0.1643 (w 0.2705 mse 0.2526 t 733 new 0.17) lr 1.00e-05 gnorm 0.130 3.06s mem 81.1GB +[2026-09-14 13:12:28] step 3397/5000 loss 0.1398 (w 0.3658 mse 0.3536 t 987 new 0.21) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +[2026-09-14 13:12:31] step 3398/5000 loss 0.1307 (w 0.2115 mse 0.2072 t 998 new 0.13) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +[2026-09-14 13:12:34] step 3399/5000 loss 0.2808 (w 0.2619 mse 0.2716 t 599 new 0.16) lr 1.00e-05 gnorm 0.176 3.08s mem 81.1GB +[2026-09-14 13:12:37] step 3400/5000 loss 0.0950 (w 0.3700 mse 0.3398 t 986 new 0.20) lr 1.00e-05 gnorm 0.188 3.08s mem 81.1GB +[2026-09-14 13:12:41] step 3401/5000 loss 0.2872 (w 0.1944 mse 0.1881 t 769 new 0.22) lr 1.00e-05 gnorm 0.198 3.07s mem 81.1GB +[2026-09-14 13:12:44] step 3402/5000 loss 0.2425 (w 0.1930 mse 0.1865 t 985 new 0.14) lr 1.00e-05 gnorm 0.167 3.08s mem 81.1GB +[2026-09-14 13:12:47] step 3403/5000 loss 0.1025 (w 0.3018 mse 0.3053 t 962 new 0.22) lr 1.00e-05 gnorm 0.137 3.09s mem 81.1GB +[2026-09-14 13:12:50] step 3404/5000 loss 0.1443 (w 0.2918 mse 0.2802 t 987 new 0.24) lr 1.00e-05 gnorm 0.095 2.83s mem 81.1GB +[2026-09-14 13:12:53] step 3405/5000 loss 0.1171 (w 0.1559 mse 0.1607 t 924 new 0.20) lr 1.00e-05 gnorm 0.168 3.13s mem 81.1GB +[2026-09-14 13:12:56] step 3406/5000 loss 0.1408 (w 0.1620 mse 0.1656 t 882 new 0.19) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +[2026-09-14 13:12:59] step 3407/5000 loss 0.1286 (w 0.2115 mse 0.2121 t 850 new 0.12) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +[2026-09-14 13:13:02] step 3408/5000 loss 0.1136 (w 0.2261 mse 0.2159 t 903 new 0.26) lr 1.00e-05 gnorm 0.191 3.08s mem 81.1GB +[2026-09-14 13:13:05] step 3409/5000 loss 0.1558 (w 0.2462 mse 0.2328 t 830 new 0.19) lr 1.00e-05 gnorm 0.158 3.08s mem 81.1GB +[2026-09-14 13:13:08] step 3410/5000 loss 0.3028 (w 0.3125 mse 0.3066 t 418 new 0.21) lr 1.00e-05 gnorm 0.148 2.82s mem 81.1GB +[2026-09-14 13:13:11] step 3411/5000 loss 0.1329 (w 0.3136 mse 0.3119 t 972 new 0.24) lr 1.00e-05 gnorm 0.116 3.41s mem 81.1GB +[2026-09-14 13:13:15] step 3412/5000 loss 0.1595 (w 0.0938 mse 0.1079 t 754 new 0.22) lr 1.00e-05 gnorm 0.108 3.38s mem 81.1GB +[2026-09-14 13:13:18] step 3413/5000 loss 0.1656 (w 0.2228 mse 0.2029 t 874 new 0.16) lr 1.00e-05 gnorm 0.235 3.07s mem 81.1GB +[2026-09-14 13:13:21] step 3414/5000 loss 0.3386 (w 0.3484 mse 0.3446 t 952 new 0.27) lr 1.00e-05 gnorm 0.209 3.12s mem 81.1GB +[2026-09-14 13:13:24] step 3415/5000 loss 0.2897 (w 0.2896 mse 0.2803 t 948 new 0.18) lr 1.00e-05 gnorm 0.206 2.82s mem 81.1GB +[2026-09-14 13:13:27] step 3416/5000 loss 0.2441 (w 0.3240 mse 0.3173 t 970 new 0.24) lr 1.00e-05 gnorm 0.617 3.06s mem 81.1GB +[2026-09-14 13:13:30] step 3417/5000 loss 0.2067 (w 0.3732 mse 0.3613 t 956 new 0.24) lr 1.00e-05 gnorm 0.170 3.11s mem 81.1GB +[2026-09-14 13:13:33] step 3418/5000 loss 0.1587 (w 0.1874 mse 0.1916 t 944 new 0.08) lr 1.00e-05 gnorm 0.164 3.38s mem 81.1GB +[2026-09-14 13:13:37] step 3419/5000 loss 0.1910 (w 0.3306 mse 0.3216 t 974 new 0.28) lr 1.00e-05 gnorm 0.137 3.30s mem 81.1GB +[2026-09-14 13:13:39] step 3420/5000 loss 0.1929 (w 0.1805 mse 0.1816 t 963 new 0.20) lr 1.00e-05 gnorm 0.119 2.84s mem 81.1GB +[2026-09-14 13:13:42] step 3421/5000 loss 0.2961 (w 0.2147 mse 0.2046 t 875 new 0.27) lr 1.00e-05 gnorm 0.172 3.00s mem 81.1GB +[2026-09-14 13:13:45] step 3422/5000 loss 0.3641 (w 0.2383 mse 0.2383 t 818 new 0.19) lr 1.00e-05 gnorm 0.200 2.83s mem 81.1GB +[2026-09-14 13:13:48] step 3423/5000 loss 0.2480 (w 0.4369 mse 0.4539 t 238 new 0.08) lr 1.00e-05 gnorm 0.130 3.16s mem 81.1GB +[2026-09-14 13:13:52] step 3424/5000 loss 0.2385 (w 0.2167 mse 0.2048 t 779 new 0.14) lr 1.00e-05 gnorm 0.207 3.41s mem 81.1GB +[2026-09-14 13:13:55] step 3425/5000 loss 0.1591 (w 0.2029 mse 0.2150 t 948 new 0.18) lr 1.00e-05 gnorm 0.477 3.33s mem 81.1GB +[2026-09-14 13:13:58] step 3426/5000 loss 0.3562 (w 0.2492 mse 0.2511 t 278 new 0.19) lr 1.00e-05 gnorm 0.143 2.84s mem 81.1GB +[2026-09-14 13:14:01] step 3427/5000 loss 0.1746 (w 0.2817 mse 0.2807 t 931 new 0.17) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +[2026-09-14 13:14:04] step 3428/5000 loss 0.2424 (w 0.2249 mse 0.2137 t 873 new 0.14) lr 1.00e-05 gnorm 0.122 3.17s mem 81.1GB +[2026-09-14 13:14:07] step 3429/5000 loss 0.2707 (w 0.2125 mse 0.2036 t 846 new 0.13) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +[2026-09-14 13:14:11] step 3430/5000 loss 0.1163 (w 0.3494 mse 0.3369 t 991 new 0.14) lr 1.00e-05 gnorm 0.219 3.36s mem 81.1GB +[2026-09-14 13:14:14] step 3431/5000 loss 0.0836 (w 0.0891 mse 0.0874 t 811 new 0.20) lr 1.00e-05 gnorm 0.112 3.32s mem 81.1GB +[2026-09-14 13:14:17] step 3432/5000 loss 0.1413 (w 0.1873 mse 0.1786 t 794 new 0.21) lr 1.00e-05 gnorm 0.129 2.83s mem 81.1GB +[2026-09-14 13:14:20] step 3433/5000 loss 0.1565 (w 0.2202 mse 0.2138 t 919 new 0.16) lr 1.00e-05 gnorm 0.360 3.09s mem 81.1GB +[2026-09-14 13:14:23] step 3434/5000 loss 0.2423 (w 0.3421 mse 0.3173 t 969 new 0.26) lr 1.00e-05 gnorm 0.227 3.12s mem 81.1GB +[2026-09-14 13:14:26] step 3435/5000 loss 0.1318 (w 0.1733 mse 0.1710 t 862 new 0.28) lr 1.00e-05 gnorm 0.257 3.08s mem 81.1GB +[2026-09-14 13:14:29] step 3436/5000 loss 0.1817 (w 0.1746 mse 0.1635 t 819 new 0.23) lr 1.00e-05 gnorm 0.165 3.34s mem 81.1GB +[2026-09-14 13:14:33] step 3437/5000 loss 0.2449 (w 0.2191 mse 0.2277 t 991 new 0.23) lr 1.00e-05 gnorm 0.160 3.16s mem 81.1GB +[2026-09-14 13:14:35] step 3438/5000 loss 0.2132 (w 0.2204 mse 0.2176 t 654 new 0.20) lr 1.00e-05 gnorm 0.213 2.84s mem 81.1GB +[2026-09-14 13:14:39] step 3439/5000 loss 0.1017 (w 0.1385 mse 0.1399 t 935 new 0.26) lr 1.00e-05 gnorm 0.194 3.10s mem 81.1GB +[2026-09-14 13:14:42] step 3440/5000 loss 0.2169 (w 0.4251 mse 0.4268 t 1000 new 0.20) lr 1.00e-05 gnorm 0.267 3.13s mem 81.1GB +[2026-09-14 13:14:45] step 3441/5000 loss 0.3238 (w 0.1735 mse 0.1862 t 465 new 0.10) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +[2026-09-14 13:14:48] step 3442/5000 loss 0.2177 (w 0.2419 mse 0.2452 t 418 new 0.15) lr 1.00e-05 gnorm 0.223 3.36s mem 81.1GB +[2026-09-14 13:14:51] step 3443/5000 loss 0.1176 (w 0.2403 mse 0.2420 t 886 new 0.24) lr 1.00e-05 gnorm 0.313 3.36s mem 81.1GB +[2026-09-14 13:14:54] step 3444/5000 loss 0.3412 (w 0.1442 mse 0.1439 t 901 new 0.08) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +[2026-09-14 13:14:57] step 3445/5000 loss 0.2450 (w 0.2555 mse 0.2359 t 763 new 0.23) lr 1.00e-05 gnorm 0.153 3.02s mem 81.1GB +[2026-09-14 13:15:01] step 3446/5000 loss 0.2002 (w 0.1707 mse 0.1692 t 766 new 0.15) lr 1.00e-05 gnorm 0.347 3.41s mem 81.1GB +[2026-09-14 13:15:04] step 3447/5000 loss 0.2879 (w 0.2131 mse 0.2098 t 641 new 0.23) lr 1.00e-05 gnorm 0.127 3.11s mem 81.1GB +[2026-09-14 13:15:07] step 3448/5000 loss 0.1620 (w 0.3031 mse 0.3068 t 967 new 0.21) lr 1.00e-05 gnorm 0.162 3.32s mem 81.1GB +[2026-09-14 13:15:10] step 3449/5000 loss 0.2435 (w 0.2415 mse 0.2669 t 962 new 0.22) lr 1.00e-05 gnorm 0.179 3.10s mem 81.1GB +[2026-09-14 13:15:13] step 3450/5000 loss 0.3182 (w 0.3058 mse 0.2966 t 979 new 0.18) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +[2026-09-14 13:15:16] step 3451/5000 loss 0.1300 (w 0.1378 mse 0.1339 t 941 new 0.17) lr 1.00e-05 gnorm 0.157 2.84s mem 81.1GB +[2026-09-14 13:15:20] step 3452/5000 loss 0.1976 (w 0.0947 mse 0.0872 t 883 new 0.13) lr 1.00e-05 gnorm 0.388 3.39s mem 81.1GB +[2026-09-14 13:15:23] step 3453/5000 loss 0.2031 (w 0.2361 mse 0.2448 t 434 new 0.12) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +[2026-09-14 13:15:26] step 3454/5000 loss 0.1468 (w 0.2268 mse 0.2128 t 879 new 0.24) lr 1.00e-05 gnorm 0.233 3.08s mem 81.1GB +[2026-09-14 13:15:29] step 3455/5000 loss 0.1519 (w 0.3172 mse 0.2920 t 971 new 0.23) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +[2026-09-14 13:15:32] step 3456/5000 loss 0.2278 (w 0.2094 mse 0.2010 t 914 new 0.26) lr 1.00e-05 gnorm 0.143 3.03s mem 81.1GB +[2026-09-14 13:15:35] step 3457/5000 loss 0.2300 (w 0.2060 mse 0.1882 t 997 new 0.26) lr 1.00e-05 gnorm 0.251 2.83s mem 81.1GB +[2026-09-14 13:15:38] step 3458/5000 loss 0.2923 (w 0.2775 mse 0.2624 t 795 new 0.22) lr 1.00e-05 gnorm 0.111 3.37s mem 81.1GB +[2026-09-14 13:15:41] step 3459/5000 loss 0.1917 (w 0.1736 mse 0.1700 t 882 new 0.11) lr 1.00e-05 gnorm 0.121 3.26s mem 81.1GB +[2026-09-14 13:15:45] step 3460/5000 loss 0.2089 (w 0.2540 mse 0.2575 t 988 new 0.23) lr 1.00e-05 gnorm 0.132 3.29s mem 81.1GB +[2026-09-14 13:15:48] step 3461/5000 loss 0.2662 (w 0.3029 mse 0.2839 t 916 new 0.20) lr 1.00e-05 gnorm 0.149 3.06s mem 81.1GB +[2026-09-14 13:15:51] step 3462/5000 loss 0.2624 (w 0.2390 mse 0.2440 t 997 new 0.20) lr 1.00e-05 gnorm 0.123 3.04s mem 81.1GB +[2026-09-14 13:15:54] step 3463/5000 loss 0.0686 (w 0.2462 mse 0.2429 t 967 new 0.24) lr 1.00e-05 gnorm 0.130 2.82s mem 81.1GB +[2026-09-14 13:15:57] step 3464/5000 loss 0.2859 (w 0.3196 mse 0.3041 t 779 new 0.23) lr 1.00e-05 gnorm 0.124 3.37s mem 81.1GB +[2026-09-14 13:16:00] step 3465/5000 loss 0.0898 (w 0.2632 mse 0.2620 t 965 new 0.18) lr 1.00e-05 gnorm 0.141 3.25s mem 81.1GB +[2026-09-14 13:16:04] step 3466/5000 loss 0.1907 (w 0.1941 mse 0.1911 t 968 new 0.21) lr 1.00e-05 gnorm 0.779 3.31s mem 81.1GB +[2026-09-14 13:16:07] step 3467/5000 loss 0.2435 (w 0.1970 mse 0.1986 t 942 new 0.24) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +[2026-09-14 13:16:10] step 3468/5000 loss 0.2005 (w 0.2708 mse 0.2540 t 858 new 0.26) lr 1.00e-05 gnorm 0.144 3.10s mem 81.1GB +[2026-09-14 13:16:13] step 3469/5000 loss 0.2093 (w 0.2038 mse 0.1990 t 768 new 0.24) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +[2026-09-14 13:16:16] step 3470/5000 loss 0.3372 (w 0.2424 mse 0.2448 t 535 new 0.18) lr 1.00e-05 gnorm 0.139 3.14s mem 81.1GB +[2026-09-14 13:16:19] step 3471/5000 loss 0.2469 (w 0.5263 mse 0.5381 t 100 new 0.22) lr 1.00e-05 gnorm 0.159 3.27s mem 81.1GB +[2026-09-14 13:16:23] step 3472/5000 loss 0.1403 (w 0.1946 mse 0.1978 t 958 new 0.24) lr 1.00e-05 gnorm 0.256 3.33s mem 81.1GB +[2026-09-14 13:16:26] step 3473/5000 loss 0.1941 (w 0.1576 mse 0.1495 t 704 new 0.26) lr 1.00e-05 gnorm 0.391 3.05s mem 81.1GB +[2026-09-14 13:16:29] step 3474/5000 loss 0.1541 (w 0.2135 mse 0.1975 t 843 new 0.23) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +[2026-09-14 13:16:32] step 3475/5000 loss 0.1975 (w 0.2368 mse 0.2339 t 970 new 0.11) lr 1.00e-05 gnorm 0.370 3.07s mem 81.1GB +[2026-09-14 13:16:35] step 3476/5000 loss 0.1308 (w 0.2693 mse 0.2613 t 966 new 0.25) lr 1.00e-05 gnorm 0.143 3.07s mem 81.1GB +[2026-09-14 13:16:38] step 3477/5000 loss 0.2359 (w 0.2911 mse 0.2890 t 990 new 0.21) lr 1.00e-05 gnorm 0.140 3.33s mem 81.1GB +[2026-09-14 13:16:41] step 3478/5000 loss 0.3156 (w 0.1973 mse 0.2012 t 586 new 0.10) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +[2026-09-14 13:16:44] step 3479/5000 loss 0.2267 (w 0.3438 mse 0.3306 t 998 new 0.22) lr 1.00e-05 gnorm 0.172 2.82s mem 81.1GB +[2026-09-14 13:16:47] step 3480/5000 loss 0.1696 (w 0.1681 mse 0.1621 t 908 new 0.12) lr 1.00e-05 gnorm 0.145 3.03s mem 81.1GB +[2026-09-14 13:16:50] step 3481/5000 loss 0.2231 (w 0.2753 mse 0.2671 t 844 new 0.26) lr 1.00e-05 gnorm 0.138 3.05s mem 81.1GB +[2026-09-14 13:16:53] step 3482/5000 loss 0.2988 (w 0.2192 mse 0.2207 t 976 new 0.19) lr 1.00e-05 gnorm 0.261 3.04s mem 81.1GB +[2026-09-14 13:16:57] step 3483/5000 loss 0.2657 (w 0.1913 mse 0.1881 t 731 new 0.23) lr 1.00e-05 gnorm 0.138 3.39s mem 81.1GB +[2026-09-14 13:17:00] step 3484/5000 loss 0.1036 (w 0.1995 mse 0.2007 t 920 new 0.22) lr 1.00e-05 gnorm 0.117 3.25s mem 81.1GB +[2026-09-14 13:17:03] step 3485/5000 loss 0.0951 (w 0.2041 mse 0.2242 t 976 new 0.16) lr 1.00e-05 gnorm 0.117 3.08s mem 81.1GB +[2026-09-14 13:17:06] step 3486/5000 loss 0.2844 (w 0.3002 mse 0.3043 t 964 new 0.22) lr 1.00e-05 gnorm 0.234 2.84s mem 81.1GB +[2026-09-14 13:17:09] step 3487/5000 loss 0.3117 (w 0.1528 mse 0.1625 t 940 new 0.17) lr 1.00e-05 gnorm 0.427 3.09s mem 81.1GB +[2026-09-14 13:17:12] step 3488/5000 loss 0.1970 (w 0.2029 mse 0.1959 t 939 new 0.22) lr 1.00e-05 gnorm 0.114 3.37s mem 81.1GB +[2026-09-14 13:17:15] step 3489/5000 loss 0.0938 (w 0.2073 mse 0.1986 t 899 new 0.16) lr 1.00e-05 gnorm 0.251 3.07s mem 81.1GB +[2026-09-14 13:17:19] step 3490/5000 loss 0.2079 (w 0.5365 mse 0.5172 t 989 new 0.18) lr 1.00e-05 gnorm 0.827 3.32s mem 81.1GB +[2026-09-14 13:17:22] step 3491/5000 loss 0.1112 (w 0.2317 mse 0.2227 t 976 new 0.08) lr 1.00e-05 gnorm 0.185 3.01s mem 81.1GB +[2026-09-14 13:17:25] step 3492/5000 loss 0.2483 (w 0.2029 mse 0.1973 t 799 new 0.24) lr 1.00e-05 gnorm 0.125 2.81s mem 81.1GB +[2026-09-14 13:17:28] step 3493/5000 loss 0.1414 (w 0.2751 mse 0.2713 t 996 new 0.06) lr 1.00e-05 gnorm 0.098 3.12s mem 81.1GB +[2026-09-14 13:17:31] step 3494/5000 loss 0.2380 (w 0.0893 mse 0.0903 t 760 new 0.27) lr 1.00e-05 gnorm 0.162 3.49s mem 81.1GB +[2026-09-14 13:17:34] step 3495/5000 loss 0.2768 (w 0.5739 mse 0.6001 t 114 new 0.13) lr 1.00e-05 gnorm 0.127 3.33s mem 81.1GB +[2026-09-14 13:17:37] step 3496/5000 loss 0.2249 (w 0.2007 mse 0.1858 t 815 new 0.28) lr 1.00e-05 gnorm 0.129 3.01s mem 81.1GB +[2026-09-14 13:17:40] step 3497/5000 loss 0.1291 (w 0.4309 mse 0.4573 t 986 new 0.26) lr 1.00e-05 gnorm 0.157 3.03s mem 81.1GB +[2026-09-14 13:17:43] step 3498/5000 loss 0.3771 (w 0.2206 mse 0.1982 t 961 new 0.09) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +[2026-09-14 13:17:47] step 3499/5000 loss 0.2243 (w 0.2148 mse 0.2242 t 631 new 0.19) lr 1.00e-05 gnorm 0.159 3.33s mem 81.1GB +[2026-09-14 13:17:50] step 3500/5000 loss 0.3143 (w 0.1466 mse 0.1593 t 910 new 0.21) lr 1.00e-05 gnorm 0.311 3.30s mem 81.1GB +[2026-09-14 13:17:52] [val] step 3500 t=200: w=0.4149 mse=0.4255 (n=16) t=500: w=0.2203 mse=0.2238 (n=16) t=800: w=0.1722 mse=0.1714 (n=16) | mean w=0.2691 mse=0.2736 2s +[2026-09-14 13:18:40] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step3500.safetensors 4093 个张量 37.98 GB +[2026-09-14 13:18:45] step 3501/5000 loss 0.2143 (w 0.2090 mse 0.2084 t 933 new 0.23) lr 1.00e-05 gnorm 0.159 3.36s mem 81.1GB +[2026-09-14 13:18:48] step 3502/5000 loss 0.2510 (w 0.2113 mse 0.2050 t 836 new 0.21) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +[2026-09-14 13:18:51] step 3503/5000 loss 0.2127 (w 0.3305 mse 0.3336 t 994 new 0.17) lr 1.00e-05 gnorm 0.151 3.45s mem 81.1GB +[2026-09-14 13:18:54] step 3504/5000 loss 0.1641 (w 0.2897 mse 0.3098 t 995 new 0.13) lr 1.00e-05 gnorm 0.117 2.81s mem 81.1GB +[2026-09-14 13:18:57] step 3505/5000 loss 0.2224 (w 0.1817 mse 0.1863 t 557 new 0.11) lr 1.00e-05 gnorm 0.120 3.09s mem 81.1GB +[2026-09-14 13:19:01] step 3506/5000 loss 0.2556 (w 0.2409 mse 0.2485 t 992 new 0.22) lr 1.00e-05 gnorm 0.561 3.46s mem 81.1GB +[2026-09-14 13:19:04] step 3507/5000 loss 0.1723 (w 0.3821 mse 0.3652 t 997 new 0.25) lr 1.00e-05 gnorm 0.152 3.09s mem 81.1GB +[2026-09-14 13:19:07] step 3508/5000 loss 0.2464 (w 0.2054 mse 0.1972 t 842 new 0.22) lr 1.00e-05 gnorm 0.126 3.12s mem 81.1GB +[2026-09-14 13:19:10] step 3509/5000 loss 0.2154 (w 0.3581 mse 0.3581 t 999 new 0.21) lr 1.00e-05 gnorm 0.117 3.35s mem 81.1GB +[2026-09-14 13:19:13] step 3510/5000 loss 0.1304 (w 0.3212 mse 0.3098 t 975 new 0.23) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +[2026-09-14 13:19:16] step 3511/5000 loss 0.2094 (w 0.2579 mse 0.2633 t 957 new 0.21) lr 1.00e-05 gnorm 0.180 3.11s mem 81.1GB +[2026-09-14 13:19:20] step 3512/5000 loss 0.1720 (w 0.1262 mse 0.1353 t 922 new 0.22) lr 1.00e-05 gnorm 0.139 3.38s mem 81.1GB +[2026-09-14 13:19:23] step 3513/5000 loss 0.2677 (w 0.2855 mse 0.2942 t 238 new 0.15) lr 1.00e-05 gnorm 0.148 3.13s mem 81.1GB +[2026-09-14 13:19:26] step 3514/5000 loss 0.2142 (w 0.2556 mse 0.2626 t 996 new 0.23) lr 1.00e-05 gnorm 0.113 3.12s mem 81.1GB +[2026-09-14 13:19:29] step 3515/5000 loss 0.2841 (w 0.1955 mse 0.1980 t 866 new 0.11) lr 1.00e-05 gnorm 0.147 3.52s mem 81.1GB +[2026-09-14 13:19:33] step 3516/5000 loss 0.1774 (w 0.2024 mse 0.1904 t 609 new 0.21) lr 1.00e-05 gnorm 0.176 2.90s mem 81.1GB +[2026-09-14 13:19:35] step 3517/5000 loss 0.3200 (w 0.1583 mse 0.1561 t 864 new 0.24) lr 1.00e-05 gnorm 0.131 2.83s mem 81.1GB +[2026-09-14 13:19:40] step 3518/5000 loss 0.2018 (w 0.4590 mse 0.4416 t 996 new 0.28) lr 1.00e-05 gnorm 0.126 4.27s mem 81.1GB +[2026-09-14 13:19:43] step 3519/5000 loss 0.3686 (w 0.1695 mse 0.1540 t 845 new 0.21) lr 1.00e-05 gnorm 0.130 3.12s mem 81.1GB +[2026-09-14 13:19:46] step 3520/5000 loss 0.2084 (w 0.2837 mse 0.2763 t 996 new 0.22) lr 1.00e-05 gnorm 0.141 3.41s mem 81.1GB +[2026-09-14 13:19:49] step 3521/5000 loss 0.3956 (w 0.3407 mse 0.3234 t 264 new 0.22) lr 1.00e-05 gnorm 0.265 3.08s mem 81.1GB +[2026-09-14 13:19:53] step 3522/5000 loss 0.2246 (w 0.2187 mse 0.2043 t 804 new 0.16) lr 1.00e-05 gnorm 0.135 3.30s mem 81.1GB +[2026-09-14 13:19:55] step 3523/5000 loss 0.0637 (w 0.1516 mse 0.1499 t 996 new 0.22) lr 1.00e-05 gnorm 0.251 2.84s mem 81.1GB +[2026-09-14 13:19:59] step 3524/5000 loss 0.2915 (w 0.2709 mse 0.2629 t 872 new 0.25) lr 1.00e-05 gnorm 0.379 3.13s mem 81.1GB +[2026-09-14 13:20:02] step 3525/5000 loss 0.1907 (w 0.2122 mse 0.2097 t 798 new 0.22) lr 1.00e-05 gnorm 0.134 3.39s mem 81.1GB +[2026-09-14 13:20:05] step 3526/5000 loss 0.1738 (w 0.2988 mse 0.3043 t 987 new 0.10) lr 1.00e-05 gnorm 0.235 3.06s mem 81.1GB +[2026-09-14 13:20:08] step 3527/5000 loss 0.2654 (w 0.1898 mse 0.1797 t 829 new 0.22) lr 1.00e-05 gnorm 0.156 3.08s mem 81.1GB +[2026-09-14 13:20:11] step 3528/5000 loss 0.3144 (w 0.2059 mse 0.2019 t 948 new 0.22) lr 1.00e-05 gnorm 0.178 3.18s mem 81.1GB +[2026-09-14 13:20:14] step 3529/5000 loss 0.3166 (w 0.1869 mse 0.1884 t 748 new 0.18) lr 1.00e-05 gnorm 0.287 3.18s mem 81.1GB +[2026-09-14 13:20:18] step 3530/5000 loss 0.1692 (w 0.3610 mse 0.3650 t 995 new 0.13) lr 1.00e-05 gnorm 0.197 3.43s mem 81.1GB +[2026-09-14 13:20:21] step 3531/5000 loss 0.2902 (w 0.2914 mse 0.2798 t 570 new 0.21) lr 1.00e-05 gnorm 0.223 3.15s mem 81.1GB +[2026-09-14 13:20:24] step 3532/5000 loss 0.1604 (w 0.3523 mse 0.3430 t 961 new 0.26) lr 1.00e-05 gnorm 0.130 3.21s mem 81.1GB +[2026-09-14 13:20:28] step 3533/5000 loss 0.2270 (w 0.2332 mse 0.2286 t 931 new 0.23) lr 1.00e-05 gnorm 0.162 3.72s mem 81.1GB +[2026-09-14 13:20:34] step 3534/5000 loss 0.3127 (w 0.2487 mse 0.2487 t 470 new 0.23) lr 1.00e-05 gnorm 0.159 5.93s mem 81.1GB +[2026-09-14 13:20:40] step 3535/5000 loss 0.1593 (w 0.1407 mse 0.1381 t 839 new 0.12) lr 1.00e-05 gnorm 0.257 5.97s mem 81.1GB +[2026-09-14 13:20:46] step 3536/5000 loss 0.2487 (w 0.3399 mse 0.3278 t 995 new 0.18) lr 1.00e-05 gnorm 0.212 5.97s mem 81.1GB +[2026-09-14 13:20:52] step 3537/5000 loss 0.2246 (w 0.2182 mse 0.2117 t 732 new 0.19) lr 1.00e-05 gnorm 0.220 5.98s mem 81.1GB +[2026-09-14 13:20:58] step 3538/5000 loss 0.1930 (w 0.3622 mse 0.3392 t 982 new 0.25) lr 1.00e-05 gnorm 0.116 6.11s mem 81.1GB +[2026-09-14 13:21:04] step 3539/5000 loss 0.1630 (w 0.3590 mse 0.3544 t 999 new 0.19) lr 1.00e-05 gnorm 0.103 6.00s mem 81.1GB +[2026-09-14 13:21:10] step 3540/5000 loss 0.0785 (w 0.1559 mse 0.1505 t 894 new 0.23) lr 1.00e-05 gnorm 0.106 5.76s mem 81.1GB +[2026-09-14 13:21:15] step 3541/5000 loss 0.3472 (w 0.2876 mse 0.2819 t 957 new 0.20) lr 1.00e-05 gnorm 0.121 4.92s mem 81.1GB +[2026-09-14 13:21:18] step 3542/5000 loss 0.2670 (w 0.1997 mse 0.1922 t 823 new 0.19) lr 1.00e-05 gnorm 0.211 3.13s mem 81.1GB +[2026-09-14 13:21:21] step 3543/5000 loss 0.2455 (w 0.3115 mse 0.3145 t 998 new 0.26) lr 1.00e-05 gnorm 0.151 3.05s mem 81.1GB +[2026-09-14 13:21:24] step 3544/5000 loss 0.2437 (w 0.1783 mse 0.1787 t 672 new 0.18) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +[2026-09-14 13:21:27] step 3545/5000 loss 0.1794 (w 0.1394 mse 0.1496 t 879 new 0.25) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +[2026-09-14 13:21:30] step 3546/5000 loss 0.2037 (w 0.0986 mse 0.1064 t 955 new 0.15) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-14 13:21:34] step 3547/5000 loss 0.1407 (w 0.2805 mse 0.2688 t 927 new 0.24) lr 1.00e-05 gnorm 0.157 3.41s mem 81.1GB +[2026-09-14 13:21:37] step 3548/5000 loss 0.1862 (w 0.2534 mse 0.2615 t 981 new 0.17) lr 1.00e-05 gnorm 0.122 3.18s mem 81.1GB +[2026-09-14 13:21:40] step 3549/5000 loss 0.1784 (w 0.1455 mse 0.1519 t 911 new 0.24) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +[2026-09-14 13:21:43] step 3550/5000 loss 0.3052 (w 0.3372 mse 0.3205 t 934 new 0.24) lr 1.00e-05 gnorm 0.153 3.09s mem 81.1GB +[2026-09-14 13:21:46] step 3551/5000 loss 0.2650 (w 0.1860 mse 0.1908 t 826 new 0.21) lr 1.00e-05 gnorm 0.329 3.41s mem 81.1GB +[2026-09-14 13:21:49] step 3552/5000 loss 0.3166 (w 0.2712 mse 0.2907 t 988 new 0.20) lr 1.00e-05 gnorm 0.128 2.91s mem 81.1GB +[2026-09-14 13:21:53] step 3553/5000 loss 0.2107 (w 0.1534 mse 0.1493 t 851 new 0.19) lr 1.00e-05 gnorm 0.346 3.38s mem 81.1GB +[2026-09-14 13:21:56] step 3554/5000 loss 0.2093 (w 0.4029 mse 0.4003 t 996 new 0.23) lr 1.00e-05 gnorm 0.180 3.44s mem 81.1GB +[2026-09-14 13:21:59] step 3555/5000 loss 0.2570 (w 0.2650 mse 0.2641 t 981 new 0.26) lr 1.00e-05 gnorm 0.141 2.87s mem 81.1GB +[2026-09-14 13:22:03] step 3556/5000 loss 0.1535 (w 0.3033 mse 0.2877 t 923 new 0.21) lr 1.00e-05 gnorm 0.208 3.33s mem 81.1GB +[2026-09-14 13:22:07] step 3557/5000 loss 0.2394 (w 0.0657 mse 0.0749 t 910 new 0.13) lr 1.00e-05 gnorm 0.416 3.98s mem 81.1GB +[2026-09-14 13:22:10] step 3558/5000 loss 0.1208 (w 0.4227 mse 0.4087 t 995 new 0.23) lr 1.00e-05 gnorm 0.125 2.90s mem 81.1GB +[2026-09-14 13:22:13] step 3559/5000 loss 0.3530 (w 0.1842 mse 0.1975 t 588 new 0.19) lr 1.00e-05 gnorm 1.372 3.47s mem 81.1GB +[2026-09-14 13:22:16] step 3560/5000 loss 0.2385 (w 0.1920 mse 0.1887 t 865 new 0.14) lr 1.00e-05 gnorm 0.168 3.08s mem 81.1GB +[2026-09-14 13:22:19] step 3561/5000 loss 0.2399 (w 0.2009 mse 0.1914 t 878 new 0.21) lr 1.00e-05 gnorm 0.135 3.20s mem 81.1GB +[2026-09-14 13:22:22] step 3562/5000 loss 0.2001 (w 0.2614 mse 0.2681 t 978 new 0.21) lr 1.00e-05 gnorm 0.170 2.86s mem 81.1GB +[2026-09-14 13:22:26] step 3563/5000 loss 0.1534 (w 0.2282 mse 0.2215 t 956 new 0.24) lr 1.00e-05 gnorm 0.180 4.13s mem 81.1GB +[2026-09-14 13:22:30] step 3564/5000 loss 0.1721 (w 0.1230 mse 0.1358 t 719 new 0.19) lr 1.00e-05 gnorm 0.139 3.61s mem 81.1GB +[2026-09-14 13:22:33] step 3565/5000 loss 0.0986 (w 0.3127 mse 0.3004 t 984 new 0.22) lr 1.00e-05 gnorm 0.157 3.56s mem 81.1GB +[2026-09-14 13:22:37] step 3566/5000 loss 0.2014 (w 0.1918 mse 0.1803 t 933 new 0.15) lr 1.00e-05 gnorm 0.164 3.05s mem 81.1GB +[2026-09-14 13:22:40] step 3567/5000 loss 0.3832 (w 0.2550 mse 0.2566 t 456 new 0.23) lr 1.00e-05 gnorm 0.226 3.07s mem 81.1GB +[2026-09-14 13:22:43] step 3568/5000 loss 0.1651 (w 0.1856 mse 0.1779 t 830 new 0.25) lr 1.00e-05 gnorm 0.221 3.00s mem 81.1GB +[2026-09-14 13:22:46] step 3569/5000 loss 0.1935 (w 0.1418 mse 0.1520 t 939 new 0.15) lr 1.00e-05 gnorm 0.168 3.14s mem 81.1GB +[2026-09-14 13:22:49] step 3570/5000 loss 0.1620 (w 0.2239 mse 0.2172 t 775 new 0.25) lr 1.00e-05 gnorm 0.182 3.13s mem 81.1GB +[2026-09-14 13:22:52] step 3571/5000 loss 0.1461 (w 0.1479 mse 0.1442 t 916 new 0.23) lr 1.00e-05 gnorm 0.129 3.42s mem 81.1GB +[2026-09-14 13:22:55] step 3572/5000 loss 0.1376 (w 0.1694 mse 0.1873 t 973 new 0.21) lr 1.00e-05 gnorm 0.109 3.11s mem 81.1GB +[2026-09-14 13:22:59] step 3573/5000 loss 0.1558 (w 0.2088 mse 0.1913 t 928 new 0.27) lr 1.00e-05 gnorm 0.183 3.17s mem 81.1GB +[2026-09-14 13:23:02] step 3574/5000 loss 0.2258 (w 0.2499 mse 0.2558 t 999 new 0.14) lr 1.00e-05 gnorm 0.134 3.14s mem 81.1GB +[2026-09-14 13:23:05] step 3575/5000 loss 0.2422 (w 0.1472 mse 0.1407 t 740 new 0.22) lr 1.00e-05 gnorm 0.120 3.70s mem 81.1GB +[2026-09-14 13:23:09] step 3576/5000 loss 0.1553 (w 0.1717 mse 0.1790 t 979 new 0.23) lr 1.00e-05 gnorm 0.194 3.10s mem 81.1GB +[2026-09-14 13:23:12] step 3577/5000 loss 0.2465 (w 0.1440 mse 0.1494 t 854 new 0.10) lr 1.00e-05 gnorm 0.127 3.19s mem 81.1GB +[2026-09-14 13:23:15] step 3578/5000 loss 0.1530 (w 0.1916 mse 0.1877 t 920 new 0.18) lr 1.00e-05 gnorm 0.133 3.19s mem 81.1GB +[2026-09-14 13:23:18] step 3579/5000 loss 0.2427 (w 0.1997 mse 0.1828 t 828 new 0.20) lr 1.00e-05 gnorm 0.139 3.21s mem 81.1GB +[2026-09-14 13:23:21] step 3580/5000 loss 0.2839 (w 0.3077 mse 0.2977 t 700 new 0.24) lr 1.00e-05 gnorm 0.238 3.24s mem 81.1GB +[2026-09-14 13:23:24] step 3581/5000 loss 0.1233 (w 0.2195 mse 0.2280 t 992 new 0.16) lr 1.00e-05 gnorm 0.204 3.10s mem 81.1GB +[2026-09-14 13:23:28] step 3582/5000 loss 0.3618 (w 0.0530 mse 0.0563 t 634 new 0.06) lr 1.00e-05 gnorm 0.175 3.14s mem 81.1GB +[2026-09-14 13:23:31] step 3583/5000 loss 0.1607 (w 0.2309 mse 0.2229 t 768 new 0.21) lr 1.00e-05 gnorm 0.161 3.11s mem 81.1GB +[2026-09-14 13:23:34] step 3584/5000 loss 0.1864 (w 0.2298 mse 0.2118 t 628 new 0.16) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +[2026-09-14 13:23:37] step 3585/5000 loss 0.1875 (w 0.2392 mse 0.2235 t 680 new 0.23) lr 1.00e-05 gnorm 0.180 3.06s mem 81.1GB +[2026-09-14 13:23:40] step 3586/5000 loss 0.1470 (w 0.1931 mse 0.1882 t 705 new 0.14) lr 1.00e-05 gnorm 0.108 3.18s mem 81.1GB +[2026-09-14 13:23:43] step 3587/5000 loss 0.2234 (w 0.1216 mse 0.1219 t 904 new 0.23) lr 1.00e-05 gnorm 0.147 3.29s mem 81.1GB +[2026-09-14 13:23:47] step 3588/5000 loss 0.2045 (w 0.3138 mse 0.3078 t 356 new 0.19) lr 1.00e-05 gnorm 0.149 3.54s mem 81.1GB +[2026-09-14 13:23:50] step 3589/5000 loss 0.1542 (w 0.1672 mse 0.1760 t 923 new 0.24) lr 1.00e-05 gnorm 0.131 3.17s mem 81.1GB +[2026-09-14 13:23:54] step 3590/5000 loss 0.1682 (w 0.1847 mse 0.1764 t 948 new 0.21) lr 1.00e-05 gnorm 0.139 3.45s mem 81.1GB +[2026-09-14 13:23:57] step 3591/5000 loss 0.1306 (w 0.1251 mse 0.1261 t 884 new 0.26) lr 1.00e-05 gnorm 0.155 2.99s mem 81.1GB +[2026-09-14 13:24:01] step 3592/5000 loss 0.1518 (w 0.2519 mse 0.2354 t 950 new 0.22) lr 1.00e-05 gnorm 0.143 4.63s mem 81.1GB +[2026-09-14 13:24:07] step 3593/5000 loss 0.3350 (w 0.4816 mse 0.4804 t 288 new 0.21) lr 1.00e-05 gnorm 0.114 6.20s mem 81.1GB +[2026-09-14 13:24:14] step 3594/5000 loss 0.2375 (w 0.4929 mse 0.5378 t 127 new 0.23) lr 1.00e-05 gnorm 0.119 6.33s mem 81.1GB +[2026-09-14 13:24:20] step 3595/5000 loss 0.2161 (w 0.2501 mse 0.2415 t 758 new 0.19) lr 1.00e-05 gnorm 0.134 6.31s mem 81.1GB +[2026-09-14 13:24:27] step 3596/5000 loss 0.1675 (w 0.3133 mse 0.3129 t 967 new 0.20) lr 1.00e-05 gnorm 0.137 6.47s mem 81.1GB +[2026-09-14 13:24:33] step 3597/5000 loss 0.2245 (w 0.1703 mse 0.1731 t 975 new 0.26) lr 1.00e-05 gnorm 0.128 6.12s mem 81.1GB +[2026-09-14 13:24:39] step 3598/5000 loss 0.2144 (w 0.2092 mse 0.1989 t 728 new 0.23) lr 1.00e-05 gnorm 0.155 6.37s mem 81.1GB +[2026-09-14 13:24:45] step 3599/5000 loss 0.1077 (w 0.2083 mse 0.2045 t 972 new 0.20) lr 1.00e-05 gnorm 0.186 6.31s mem 81.1GB +[2026-09-14 13:24:49] step 3600/5000 loss 0.3184 (w 0.4387 mse 0.4340 t 269 new 0.24) lr 1.00e-05 gnorm 0.148 3.44s mem 81.1GB +[2026-09-14 13:24:52] step 3601/5000 loss 0.2214 (w 0.1315 mse 0.1325 t 657 new 0.24) lr 1.00e-05 gnorm 0.576 3.05s mem 81.1GB +[2026-09-14 13:24:55] step 3602/5000 loss 0.2658 (w 0.0862 mse 0.0874 t 612 new 0.13) lr 1.00e-05 gnorm 0.185 3.09s mem 81.1GB +[2026-09-14 13:24:58] step 3603/5000 loss 0.2064 (w 0.2463 mse 0.2386 t 937 new 0.22) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +[2026-09-14 13:25:01] step 3604/5000 loss 0.3181 (w 0.3912 mse 0.3974 t 310 new 0.14) lr 1.00e-05 gnorm 0.111 3.31s mem 81.1GB +[2026-09-14 13:25:04] step 3605/5000 loss 0.2419 (w 0.2667 mse 0.2459 t 909 new 0.26) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +[2026-09-14 13:25:07] step 3606/5000 loss 0.1658 (w 0.1866 mse 0.1744 t 868 new 0.22) lr 1.00e-05 gnorm 0.217 3.22s mem 81.1GB +[2026-09-14 13:25:11] step 3607/5000 loss 0.3627 (w 0.3440 mse 0.3445 t 973 new 0.17) lr 1.00e-05 gnorm 0.159 3.29s mem 81.1GB +[2026-09-14 13:25:14] step 3608/5000 loss 0.2930 (w 0.1894 mse 0.1804 t 725 new 0.06) lr 1.00e-05 gnorm 0.118 3.31s mem 81.1GB +[2026-09-14 13:25:17] step 3609/5000 loss 0.2403 (w 0.5102 mse 0.5172 t 140 new 0.13) lr 1.00e-05 gnorm 0.128 2.84s mem 81.1GB +[2026-09-14 13:25:20] step 3610/5000 loss 0.1815 (w 0.1440 mse 0.1345 t 822 new 0.21) lr 1.00e-05 gnorm 0.205 3.41s mem 81.1GB +[2026-09-14 13:25:23] step 3611/5000 loss 0.1770 (w 0.1756 mse 0.1922 t 976 new 0.16) lr 1.00e-05 gnorm 0.137 3.17s mem 81.1GB +[2026-09-14 13:25:27] step 3612/5000 loss 0.1575 (w 0.1856 mse 0.1991 t 954 new 0.20) lr 1.00e-05 gnorm 0.112 3.18s mem 81.1GB +[2026-09-14 13:25:30] step 3613/5000 loss 0.1127 (w 0.1776 mse 0.1838 t 729 new 0.21) lr 1.00e-05 gnorm 0.113 3.09s mem 81.1GB +[2026-09-14 13:25:33] step 3614/5000 loss 0.0618 (w 0.1267 mse 0.1391 t 915 new 0.22) lr 1.00e-05 gnorm 0.145 3.14s mem 81.1GB +[2026-09-14 13:25:37] step 3615/5000 loss 0.1865 (w 0.2040 mse 0.1904 t 781 new 0.19) lr 1.00e-05 gnorm 0.118 4.11s mem 81.1GB +[2026-09-14 13:25:41] step 3616/5000 loss 0.1611 (w 0.2610 mse 0.2534 t 676 new 0.24) lr 1.00e-05 gnorm 0.182 3.71s mem 81.1GB +[2026-09-14 13:25:44] step 3617/5000 loss 0.1190 (w 0.1310 mse 0.1393 t 844 new 0.22) lr 1.00e-05 gnorm 0.158 3.35s mem 81.1GB +[2026-09-14 13:25:47] step 3618/5000 loss 0.2470 (w 0.1819 mse 0.1865 t 947 new 0.19) lr 1.00e-05 gnorm 0.120 3.13s mem 81.1GB +[2026-09-14 13:25:50] step 3619/5000 loss 0.2543 (w 0.1173 mse 0.1158 t 772 new 0.07) lr 1.00e-05 gnorm 0.141 3.20s mem 81.1GB +[2026-09-14 13:25:54] step 3620/5000 loss 0.2300 (w 0.2556 mse 0.2573 t 721 new 0.19) lr 1.00e-05 gnorm 0.257 3.18s mem 81.1GB +[2026-09-14 13:25:57] step 3621/5000 loss 0.2933 (w 0.2221 mse 0.2080 t 811 new 0.26) lr 1.00e-05 gnorm 0.122 3.64s mem 81.1GB +[2026-09-14 13:26:01] step 3622/5000 loss 0.2866 (w 0.3169 mse 0.3135 t 479 new 0.19) lr 1.00e-05 gnorm 0.199 4.16s mem 81.1GB +[2026-09-14 13:26:05] step 3623/5000 loss 0.3005 (w 0.1931 mse 0.1891 t 642 new 0.23) lr 1.00e-05 gnorm 0.204 3.92s mem 81.1GB +[2026-09-14 13:26:08] step 3624/5000 loss 0.3178 (w 0.2744 mse 0.2654 t 970 new 0.18) lr 1.00e-05 gnorm 0.144 3.00s mem 81.1GB +[2026-09-14 13:26:12] step 3625/5000 loss 0.2609 (w 0.1842 mse 0.1835 t 760 new 0.20) lr 1.00e-05 gnorm 0.173 3.08s mem 81.1GB +[2026-09-14 13:26:15] step 3626/5000 loss 0.4169 (w 0.5990 mse 0.5862 t 153 new 0.24) lr 1.00e-05 gnorm 0.121 3.07s mem 81.1GB +[2026-09-14 13:26:18] step 3627/5000 loss 0.2076 (w 0.2211 mse 0.2127 t 997 new 0.23) lr 1.00e-05 gnorm 0.116 3.06s mem 81.1GB +[2026-09-14 13:26:21] step 3628/5000 loss 0.2458 (w 0.2782 mse 0.2681 t 945 new 0.23) lr 1.00e-05 gnorm 0.137 3.07s mem 81.1GB +[2026-09-14 13:26:24] step 3629/5000 loss 0.1771 (w 0.1518 mse 0.1531 t 865 new 0.21) lr 1.00e-05 gnorm 0.136 3.40s mem 81.1GB +[2026-09-14 13:26:27] step 3630/5000 loss 0.2019 (w 0.3244 mse 0.3196 t 969 new 0.19) lr 1.00e-05 gnorm 0.118 2.85s mem 81.1GB +[2026-09-14 13:26:30] step 3631/5000 loss 0.3570 (w 0.2890 mse 0.2820 t 787 new 0.18) lr 1.00e-05 gnorm 0.113 3.12s mem 81.1GB +[2026-09-14 13:26:33] step 3632/5000 loss 0.1505 (w 0.1948 mse 0.1975 t 959 new 0.15) lr 1.00e-05 gnorm 0.661 3.06s mem 81.1GB +[2026-09-14 13:26:36] step 3633/5000 loss 0.1854 (w 0.2059 mse 0.1933 t 444 new 0.17) lr 1.00e-05 gnorm 0.333 3.09s mem 81.1GB +[2026-09-14 13:26:40] step 3634/5000 loss 0.2351 (w 0.2270 mse 0.2104 t 890 new 0.22) lr 1.00e-05 gnorm 0.134 3.32s mem 81.1GB +[2026-09-14 13:26:43] step 3635/5000 loss 0.1493 (w 0.1970 mse 0.1875 t 885 new 0.25) lr 1.00e-05 gnorm 0.236 3.40s mem 81.1GB +[2026-09-14 13:26:46] step 3636/5000 loss 0.2802 (w 0.1388 mse 0.1465 t 975 new 0.12) lr 1.00e-05 gnorm 0.144 2.82s mem 81.1GB +[2026-09-14 13:26:49] step 3637/5000 loss 0.0721 (w 0.1906 mse 0.1872 t 972 new 0.24) lr 1.00e-05 gnorm 0.175 3.12s mem 81.1GB +[2026-09-14 13:26:52] step 3638/5000 loss 0.3276 (w 0.3675 mse 0.3394 t 936 new 0.25) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +[2026-09-14 13:26:55] step 3639/5000 loss 0.1169 (w 0.1849 mse 0.1810 t 817 new 0.23) lr 1.00e-05 gnorm 0.121 3.16s mem 81.1GB +[2026-09-14 13:26:58] step 3640/5000 loss 0.1999 (w 0.1654 mse 0.1653 t 947 new 0.21) lr 1.00e-05 gnorm 0.116 3.15s mem 81.1GB +[2026-09-14 13:27:02] step 3641/5000 loss 0.1922 (w 0.2715 mse 0.2632 t 836 new 0.26) lr 1.00e-05 gnorm 0.118 3.40s mem 81.1GB +[2026-09-14 13:27:05] step 3642/5000 loss 0.1515 (w 0.1729 mse 0.1666 t 962 new 0.21) lr 1.00e-05 gnorm 0.216 2.83s mem 81.1GB +[2026-09-14 13:27:08] step 3643/5000 loss 0.3472 (w 0.3076 mse 0.3183 t 955 new 0.25) lr 1.00e-05 gnorm 0.110 3.10s mem 81.1GB +[2026-09-14 13:27:11] step 3644/5000 loss 0.1261 (w 0.2388 mse 0.2464 t 957 new 0.23) lr 1.00e-05 gnorm 0.139 3.09s mem 81.1GB +[2026-09-14 13:27:14] step 3645/5000 loss 0.1051 (w 0.1356 mse 0.1296 t 629 new 0.10) lr 1.00e-05 gnorm 0.203 3.36s mem 81.1GB +[2026-09-14 13:27:17] step 3646/5000 loss 0.2170 (w 0.2164 mse 0.2173 t 704 new 0.19) lr 1.00e-05 gnorm 0.147 3.19s mem 81.1GB +[2026-09-14 13:27:20] step 3647/5000 loss 0.2160 (w 0.1991 mse 0.1868 t 774 new 0.19) lr 1.00e-05 gnorm 0.264 3.12s mem 81.1GB +[2026-09-14 13:27:23] step 3648/5000 loss 0.2980 (w 0.2787 mse 0.2588 t 918 new 0.24) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +[2026-09-14 13:27:26] step 3649/5000 loss 0.1355 (w 0.2090 mse 0.2130 t 926 new 0.26) lr 1.00e-05 gnorm 0.103 3.11s mem 81.1GB +[2026-09-14 13:27:29] step 3650/5000 loss 0.1702 (w 0.2099 mse 0.2088 t 934 new 0.22) lr 1.00e-05 gnorm 0.121 3.04s mem 81.1GB +[2026-09-14 13:27:33] step 3651/5000 loss 0.2958 (w 0.1700 mse 0.1692 t 865 new 0.16) lr 1.00e-05 gnorm 0.119 3.35s mem 81.1GB +[2026-09-14 13:27:36] step 3652/5000 loss 0.2139 (w 0.1047 mse 0.0950 t 817 new 0.17) lr 1.00e-05 gnorm 0.138 3.33s mem 81.1GB +[2026-09-14 13:27:39] step 3653/5000 loss 0.0997 (w 0.2548 mse 0.2436 t 997 new 0.27) lr 1.00e-05 gnorm 0.128 3.15s mem 81.1GB +[2026-09-14 13:27:42] step 3654/5000 loss 0.1987 (w 0.2439 mse 0.2533 t 975 new 0.16) lr 1.00e-05 gnorm 0.153 2.82s mem 81.1GB +[2026-09-14 13:27:45] step 3655/5000 loss 0.1167 (w 0.2635 mse 0.2811 t 962 new 0.21) lr 1.00e-05 gnorm 0.143 3.10s mem 81.1GB +[2026-09-14 13:27:48] step 3656/5000 loss 0.1540 (w 0.2260 mse 0.2220 t 492 new 0.24) lr 1.00e-05 gnorm 0.120 3.27s mem 81.1GB +[2026-09-14 13:27:52] step 3657/5000 loss 0.3700 (w 0.2773 mse 0.2748 t 915 new 0.18) lr 1.00e-05 gnorm 0.123 3.11s mem 81.1GB +[2026-09-14 13:27:55] step 3658/5000 loss 0.1849 (w 0.2513 mse 0.2402 t 966 new 0.16) lr 1.00e-05 gnorm 0.120 3.47s mem 81.1GB +[2026-09-14 13:27:58] step 3659/5000 loss 0.1571 (w 0.2265 mse 0.2143 t 973 new 0.24) lr 1.00e-05 gnorm 0.108 2.84s mem 81.1GB +[2026-09-14 13:28:01] step 3660/5000 loss 0.2685 (w 0.2377 mse 0.2225 t 917 new 0.19) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +[2026-09-14 13:28:04] step 3661/5000 loss 0.2409 (w 0.3967 mse 0.3818 t 941 new 0.18) lr 1.00e-05 gnorm 0.173 3.04s mem 81.1GB +[2026-09-14 13:28:07] step 3662/5000 loss 0.2320 (w 0.2189 mse 0.2223 t 836 new 0.20) lr 1.00e-05 gnorm 0.112 3.28s mem 81.1GB +[2026-09-14 13:28:10] step 3663/5000 loss 0.3394 (w 0.2645 mse 0.2564 t 709 new 0.19) lr 1.00e-05 gnorm 0.125 3.32s mem 81.1GB +[2026-09-14 13:28:14] step 3664/5000 loss 0.2275 (w 0.2841 mse 0.2799 t 348 new 0.23) lr 1.00e-05 gnorm 0.148 3.33s mem 81.1GB +[2026-09-14 13:28:17] step 3665/5000 loss 0.2465 (w 0.3074 mse 0.3103 t 372 new 0.17) lr 1.00e-05 gnorm 0.117 2.81s mem 81.1GB +[2026-09-14 13:28:19] step 3666/5000 loss 0.1387 (w 0.1710 mse 0.1784 t 847 new 0.22) lr 1.00e-05 gnorm 0.139 2.82s mem 81.1GB +[2026-09-14 13:28:22] step 3667/5000 loss 0.2908 (w 0.2394 mse 0.2405 t 848 new 0.15) lr 1.00e-05 gnorm 0.149 3.06s mem 81.1GB +[2026-09-14 13:28:26] step 3668/5000 loss 0.2230 (w 0.1466 mse 0.1607 t 944 new 0.17) lr 1.00e-05 gnorm 0.140 3.26s mem 81.1GB +[2026-09-14 13:28:29] step 3669/5000 loss 0.3533 (w 0.1803 mse 0.1778 t 690 new 0.17) lr 1.00e-05 gnorm 0.520 3.37s mem 81.1GB +[2026-09-14 13:28:32] step 3670/5000 loss 0.2688 (w 0.2301 mse 0.2255 t 574 new 0.21) lr 1.00e-05 gnorm 0.117 3.15s mem 81.1GB +[2026-09-14 13:28:35] step 3671/5000 loss 0.1552 (w 0.2318 mse 0.2328 t 987 new 0.20) lr 1.00e-05 gnorm 0.208 2.82s mem 81.1GB +[2026-09-14 13:28:38] step 3672/5000 loss 0.2180 (w 0.1980 mse 0.2072 t 988 new 0.25) lr 1.00e-05 gnorm 0.117 3.04s mem 81.1GB +[2026-09-14 13:28:41] step 3673/5000 loss 0.1629 (w 0.1493 mse 0.1464 t 887 new 0.09) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +[2026-09-14 13:28:44] step 3674/5000 loss 0.1529 (w 0.1729 mse 0.1800 t 903 new 0.14) lr 1.00e-05 gnorm 0.121 3.31s mem 81.1GB +[2026-09-14 13:28:48] step 3675/5000 loss 0.2122 (w 0.2665 mse 0.2486 t 903 new 0.24) lr 1.00e-05 gnorm 0.116 3.35s mem 81.1GB +[2026-09-14 13:28:51] step 3676/5000 loss 0.1231 (w 0.1262 mse 0.1362 t 936 new 0.25) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +[2026-09-14 13:28:54] step 3677/5000 loss 0.3313 (w 0.2030 mse 0.1939 t 774 new 0.08) lr 1.00e-05 gnorm 0.158 2.83s mem 81.1GB +[2026-09-14 13:28:57] step 3678/5000 loss 0.3348 (w 0.2098 mse 0.2145 t 953 new 0.20) lr 1.00e-05 gnorm 0.134 3.03s mem 81.1GB +[2026-09-14 13:29:00] step 3679/5000 loss 0.3995 (w 0.2794 mse 0.2784 t 672 new 0.22) lr 1.00e-05 gnorm 0.119 3.05s mem 81.1GB +[2026-09-14 13:29:03] step 3680/5000 loss 0.1502 (w 0.2664 mse 0.2666 t 977 new 0.10) lr 1.00e-05 gnorm 0.126 3.07s mem 81.1GB +[2026-09-14 13:29:06] step 3681/5000 loss 0.1757 (w 0.1511 mse 0.1648 t 866 new 0.23) lr 1.00e-05 gnorm 0.127 3.31s mem 81.1GB +[2026-09-14 13:29:09] step 3682/5000 loss 0.2076 (w 0.2151 mse 0.2049 t 947 new 0.18) lr 1.00e-05 gnorm 0.125 3.20s mem 81.1GB +[2026-09-14 13:29:12] step 3683/5000 loss 0.2095 (w 0.2724 mse 0.2588 t 961 new 0.18) lr 1.00e-05 gnorm 0.156 2.83s mem 81.1GB +[2026-09-14 13:29:15] step 3684/5000 loss 0.2872 (w 0.3493 mse 0.3420 t 930 new 0.18) lr 1.00e-05 gnorm 0.138 3.04s mem 81.1GB +[2026-09-14 13:29:18] step 3685/5000 loss 0.1759 (w 0.3013 mse 0.3030 t 999 new 0.19) lr 1.00e-05 gnorm 0.113 3.07s mem 81.1GB +[2026-09-14 13:29:21] step 3686/5000 loss 0.1909 (w 0.2513 mse 0.2446 t 979 new 0.29) lr 1.00e-05 gnorm 0.106 3.10s mem 81.1GB +[2026-09-14 13:29:24] step 3687/5000 loss 0.1908 (w 0.1528 mse 0.1661 t 781 new 0.16) lr 1.00e-05 gnorm 0.201 3.12s mem 81.1GB +[2026-09-14 13:29:28] step 3688/5000 loss 0.2176 (w 0.1996 mse 0.1969 t 840 new 0.12) lr 1.00e-05 gnorm 0.144 3.13s mem 81.1GB +[2026-09-14 13:29:30] step 3689/5000 loss 0.4442 (w 0.1790 mse 0.1756 t 796 new 0.19) lr 1.00e-05 gnorm 0.145 2.83s mem 81.1GB +[2026-09-14 13:29:33] step 3690/5000 loss 0.2341 (w 0.1817 mse 0.1831 t 730 new 0.16) lr 1.00e-05 gnorm 0.151 3.07s mem 81.1GB +[2026-09-14 13:29:36] step 3691/5000 loss 0.1837 (w 0.2879 mse 0.2802 t 607 new 0.15) lr 1.00e-05 gnorm 0.191 3.05s mem 81.1GB +[2026-09-14 13:29:40] step 3692/5000 loss 0.2161 (w 0.1241 mse 0.1318 t 718 new 0.20) lr 1.00e-05 gnorm 0.121 3.12s mem 81.1GB +[2026-09-14 13:29:43] step 3693/5000 loss 0.2582 (w 0.2504 mse 0.2474 t 712 new 0.23) lr 1.00e-05 gnorm 0.211 3.38s mem 81.1GB +[2026-09-14 13:29:46] step 3694/5000 loss 0.1370 (w 0.1561 mse 0.1545 t 921 new 0.25) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +[2026-09-14 13:29:49] step 3695/5000 loss 0.2404 (w 0.2153 mse 0.1936 t 929 new 0.19) lr 1.00e-05 gnorm 0.131 2.84s mem 81.1GB +[2026-09-14 13:29:52] step 3696/5000 loss 0.1680 (w 0.3880 mse 0.3806 t 983 new 0.27) lr 1.00e-05 gnorm 0.109 3.06s mem 81.1GB +[2026-09-14 13:29:55] step 3697/5000 loss 0.3527 (w 0.1206 mse 0.1254 t 820 new 0.15) lr 1.00e-05 gnorm 0.135 3.05s mem 81.1GB +[2026-09-14 13:29:58] step 3698/5000 loss 0.2536 (w 0.1076 mse 0.1013 t 787 new 0.19) lr 1.00e-05 gnorm 0.108 3.38s mem 81.1GB +[2026-09-14 13:30:02] step 3699/5000 loss 0.3407 (w 0.3293 mse 0.3260 t 991 new 0.15) lr 1.00e-05 gnorm 0.450 3.32s mem 81.1GB +[2026-09-14 13:30:05] step 3700/5000 loss 0.1771 (w 0.1443 mse 0.1518 t 672 new 0.07) lr 1.00e-05 gnorm 0.150 3.10s mem 81.1GB +[2026-09-14 13:30:08] step 3701/5000 loss 0.3977 (w 0.2206 mse 0.2051 t 912 new 0.23) lr 1.00e-05 gnorm 0.116 2.83s mem 81.1GB +[2026-09-14 13:30:11] step 3702/5000 loss 0.1976 (w 0.2131 mse 0.1981 t 785 new 0.27) lr 1.00e-05 gnorm 0.118 3.27s mem 81.1GB +[2026-09-14 13:30:14] step 3703/5000 loss 0.2941 (w 0.2545 mse 0.2560 t 866 new 0.16) lr 1.00e-05 gnorm 0.169 2.82s mem 81.1GB +[2026-09-14 13:30:17] step 3704/5000 loss 0.2354 (w 0.6214 mse 0.6090 t 120 new 0.22) lr 1.00e-05 gnorm 0.119 3.40s mem 81.1GB +[2026-09-14 13:30:21] step 3705/5000 loss 0.1133 (w 0.3016 mse 0.2841 t 962 new 0.27) lr 1.00e-05 gnorm 0.359 3.41s mem 81.1GB +[2026-09-14 13:30:24] step 3706/5000 loss 0.2807 (w 0.3461 mse 0.3328 t 977 new 0.18) lr 1.00e-05 gnorm 0.161 3.02s mem 81.1GB +[2026-09-14 13:30:27] step 3707/5000 loss 0.2527 (w 0.2753 mse 0.2654 t 557 new 0.21) lr 1.00e-05 gnorm 0.112 3.11s mem 81.1GB +[2026-09-14 13:30:30] step 3708/5000 loss 0.1174 (w 0.1596 mse 0.1451 t 650 new 0.16) lr 1.00e-05 gnorm 0.128 3.01s mem 81.1GB +[2026-09-14 13:30:33] step 3709/5000 loss 0.2612 (w 0.5896 mse 0.5933 t 159 new 0.21) lr 1.00e-05 gnorm 0.126 3.13s mem 81.1GB +[2026-09-14 13:30:36] step 3710/5000 loss 0.2726 (w 0.1870 mse 0.1878 t 961 new 0.17) lr 1.00e-05 gnorm 0.157 3.15s mem 81.1GB +[2026-09-14 13:30:39] step 3711/5000 loss 0.1524 (w 0.1340 mse 0.1261 t 873 new 0.22) lr 1.00e-05 gnorm 0.173 3.15s mem 81.1GB +[2026-09-14 13:30:42] step 3712/5000 loss 0.2252 (w 0.1135 mse 0.1054 t 909 new 0.17) lr 1.00e-05 gnorm 0.261 3.02s mem 81.1GB +[2026-09-14 13:30:45] step 3713/5000 loss 0.2138 (w 0.1840 mse 0.1952 t 991 new 0.12) lr 1.00e-05 gnorm 0.214 3.11s mem 81.1GB +[2026-09-14 13:30:48] step 3714/5000 loss 0.2741 (w 0.1908 mse 0.1801 t 946 new 0.19) lr 1.00e-05 gnorm 0.126 3.01s mem 81.1GB +[2026-09-14 13:30:51] step 3715/5000 loss 0.1944 (w 0.4935 mse 0.5121 t 140 new 0.08) lr 1.00e-05 gnorm 0.094 3.05s mem 81.1GB +[2026-09-14 13:30:54] step 3716/5000 loss 0.3070 (w 0.3826 mse 0.3412 t 964 new 0.23) lr 1.00e-05 gnorm 0.127 3.07s mem 81.1GB +[2026-09-14 13:30:58] step 3717/5000 loss 0.3097 (w 0.1723 mse 0.1765 t 981 new 0.19) lr 1.00e-05 gnorm 0.232 3.09s mem 81.1GB +[2026-09-14 13:31:01] step 3718/5000 loss 0.2648 (w 0.3758 mse 0.3534 t 977 new 0.18) lr 1.00e-05 gnorm 0.130 3.07s mem 81.1GB +[2026-09-14 13:31:04] step 3719/5000 loss 0.1942 (w 0.2418 mse 0.2388 t 959 new 0.26) lr 1.00e-05 gnorm 0.150 3.09s mem 81.1GB +[2026-09-14 13:31:07] step 3720/5000 loss 0.1039 (w 0.1497 mse 0.1591 t 721 new 0.20) lr 1.00e-05 gnorm 0.174 3.03s mem 81.1GB +[2026-09-14 13:31:10] step 3721/5000 loss 0.2269 (w 0.3147 mse 0.2982 t 960 new 0.26) lr 1.00e-05 gnorm 0.131 3.10s mem 81.1GB +[2026-09-14 13:31:13] step 3722/5000 loss 0.2693 (w 0.2607 mse 0.2385 t 963 new 0.21) lr 1.00e-05 gnorm 0.451 3.36s mem 81.1GB +[2026-09-14 13:31:16] step 3723/5000 loss 0.2520 (w 0.3296 mse 0.3370 t 249 new 0.18) lr 1.00e-05 gnorm 0.126 3.10s mem 81.1GB +[2026-09-14 13:31:19] step 3724/5000 loss 0.3310 (w 0.4351 mse 0.4330 t 992 new 0.21) lr 1.00e-05 gnorm 0.104 3.09s mem 81.1GB +[2026-09-14 13:31:22] step 3725/5000 loss 0.2090 (w 0.1405 mse 0.1524 t 923 new 0.22) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +[2026-09-14 13:31:26] step 3726/5000 loss 0.0875 (w 0.2164 mse 0.2124 t 918 new 0.23) lr 1.00e-05 gnorm 0.167 3.06s mem 81.1GB +[2026-09-14 13:31:29] step 3727/5000 loss 0.1482 (w 0.2561 mse 0.2566 t 980 new 0.20) lr 1.00e-05 gnorm 0.138 3.38s mem 81.1GB +[2026-09-14 13:31:32] step 3728/5000 loss 0.1760 (w 0.2219 mse 0.1977 t 934 new 0.21) lr 1.00e-05 gnorm 0.139 3.15s mem 81.1GB +[2026-09-14 13:31:35] step 3729/5000 loss 0.2604 (w 0.4158 mse 0.4111 t 368 new 0.20) lr 1.00e-05 gnorm 0.145 3.05s mem 81.1GB +[2026-09-14 13:31:38] step 3730/5000 loss 0.2024 (w 0.1586 mse 0.1613 t 878 new 0.19) lr 1.00e-05 gnorm 0.571 2.84s mem 81.1GB +[2026-09-14 13:31:41] step 3731/5000 loss 0.3460 (w 0.1863 mse 0.1842 t 619 new 0.16) lr 1.00e-05 gnorm 0.123 3.01s mem 81.1GB +[2026-09-14 13:31:44] step 3732/5000 loss 0.2181 (w 0.2228 mse 0.2171 t 695 new 0.24) lr 1.00e-05 gnorm 0.116 3.10s mem 81.1GB +[2026-09-14 13:31:47] step 3733/5000 loss 0.1782 (w 0.2752 mse 0.2531 t 872 new 0.23) lr 1.00e-05 gnorm 0.114 3.30s mem 81.1GB +[2026-09-14 13:31:50] step 3734/5000 loss 0.1689 (w 0.2144 mse 0.1984 t 827 new 0.22) lr 1.00e-05 gnorm 0.176 3.08s mem 81.1GB +[2026-09-14 13:31:54] step 3735/5000 loss 0.3179 (w 0.2202 mse 0.2172 t 619 new 0.16) lr 1.00e-05 gnorm 0.223 3.12s mem 81.1GB +[2026-09-14 13:31:56] step 3736/5000 loss 0.0741 (w 0.2849 mse 0.2804 t 954 new 0.24) lr 1.00e-05 gnorm 0.207 2.83s mem 81.1GB +[2026-09-14 13:31:59] step 3737/5000 loss 0.3300 (w 0.2316 mse 0.2162 t 829 new 0.22) lr 1.00e-05 gnorm 0.156 3.04s mem 81.1GB +[2026-09-14 13:32:03] step 3738/5000 loss 0.1840 (w 0.2273 mse 0.2190 t 730 new 0.23) lr 1.00e-05 gnorm 0.133 3.06s mem 81.1GB +[2026-09-14 13:32:06] step 3739/5000 loss 0.2938 (w 0.2236 mse 0.2287 t 948 new 0.17) lr 1.00e-05 gnorm 0.119 3.39s mem 81.1GB +[2026-09-14 13:32:09] step 3740/5000 loss 0.2241 (w 0.2033 mse 0.1986 t 977 new 0.21) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-14 13:32:12] step 3741/5000 loss 0.2297 (w 0.1118 mse 0.1113 t 942 new 0.20) lr 1.00e-05 gnorm 0.154 3.15s mem 81.1GB +[2026-09-14 13:32:15] step 3742/5000 loss 0.1753 (w 0.2269 mse 0.2198 t 901 new 0.24) lr 1.00e-05 gnorm 0.102 2.84s mem 81.1GB +[2026-09-14 13:32:18] step 3743/5000 loss 0.2369 (w 0.2906 mse 0.2923 t 348 new 0.19) lr 1.00e-05 gnorm 0.136 3.04s mem 81.1GB +[2026-09-14 13:32:21] step 3744/5000 loss 0.2810 (w 0.1236 mse 0.1195 t 870 new 0.17) lr 1.00e-05 gnorm 0.309 3.31s mem 81.1GB +[2026-09-14 13:32:25] step 3745/5000 loss 0.3785 (w 0.2485 mse 0.2389 t 943 new 0.19) lr 1.00e-05 gnorm 0.114 3.13s mem 81.1GB +[2026-09-14 13:32:28] step 3746/5000 loss 0.2208 (w 0.1286 mse 0.1289 t 659 new 0.21) lr 1.00e-05 gnorm 0.132 3.17s mem 81.1GB +[2026-09-14 13:32:31] step 3747/5000 loss 0.4673 (w 0.1678 mse 0.1735 t 702 new 0.24) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +[2026-09-14 13:32:34] step 3748/5000 loss 0.2841 (w 0.2015 mse 0.1979 t 892 new 0.19) lr 1.00e-05 gnorm 0.235 2.82s mem 81.1GB +[2026-09-14 13:32:37] step 3749/5000 loss 0.2283 (w 0.1372 mse 0.1283 t 802 new 0.20) lr 1.00e-05 gnorm 0.163 3.28s mem 81.1GB +[2026-09-14 13:32:40] step 3750/5000 loss 0.1807 (w 0.2718 mse 0.2504 t 863 new 0.19) lr 1.00e-05 gnorm 0.172 3.08s mem 81.1GB +[2026-09-14 13:32:43] step 3751/5000 loss 0.1720 (w 0.3140 mse 0.3027 t 942 new 0.25) lr 1.00e-05 gnorm 0.318 3.08s mem 81.1GB +[2026-09-14 13:32:46] step 3752/5000 loss 0.2913 (w 0.2612 mse 0.2549 t 692 new 0.09) lr 1.00e-05 gnorm 0.165 3.41s mem 81.1GB +[2026-09-14 13:32:50] step 3753/5000 loss 0.1219 (w 0.2270 mse 0.2264 t 953 new 0.17) lr 1.00e-05 gnorm 0.253 3.09s mem 81.1GB +[2026-09-14 13:32:52] step 3754/5000 loss 0.3347 (w 0.1625 mse 0.1601 t 711 new 0.11) lr 1.00e-05 gnorm 0.275 2.83s mem 81.1GB +[2026-09-14 13:32:56] step 3755/5000 loss 0.2261 (w 0.1954 mse 0.1916 t 264 new 0.10) lr 1.00e-05 gnorm 0.366 3.25s mem 81.1GB +[2026-09-14 13:32:59] step 3756/5000 loss 0.2977 (w 0.5667 mse 0.5720 t 171 new 0.22) lr 1.00e-05 gnorm 0.159 3.34s mem 81.1GB +[2026-09-14 13:33:02] step 3757/5000 loss 0.2185 (w 0.1627 mse 0.1697 t 680 new 0.17) lr 1.00e-05 gnorm 0.119 3.09s mem 81.1GB +[2026-09-14 13:33:05] step 3758/5000 loss 0.2639 (w 0.3632 mse 0.3667 t 288 new 0.19) lr 1.00e-05 gnorm 0.147 3.11s mem 81.1GB +[2026-09-14 13:33:08] step 3759/5000 loss 0.2707 (w 0.2678 mse 0.2575 t 972 new 0.18) lr 1.00e-05 gnorm 0.131 3.12s mem 81.1GB +[2026-09-14 13:33:11] step 3760/5000 loss 0.1966 (w 0.3766 mse 0.3658 t 301 new 0.26) lr 1.00e-05 gnorm 0.115 2.83s mem 81.1GB +[2026-09-14 13:33:14] step 3761/5000 loss 0.2673 (w 0.3677 mse 0.3545 t 969 new 0.24) lr 1.00e-05 gnorm 0.143 3.27s mem 81.1GB +[2026-09-14 13:33:18] step 3762/5000 loss 0.1771 (w 0.2331 mse 0.2144 t 901 new 0.17) lr 1.00e-05 gnorm 0.110 3.43s mem 81.1GB +[2026-09-14 13:33:21] step 3763/5000 loss 0.2625 (w 0.1833 mse 0.1722 t 908 new 0.19) lr 1.00e-05 gnorm 0.167 3.07s mem 81.1GB +[2026-09-14 13:33:24] step 3764/5000 loss 0.1680 (w 0.1790 mse 0.1820 t 943 new 0.24) lr 1.00e-05 gnorm 0.123 3.33s mem 81.1GB +[2026-09-14 13:33:27] step 3765/5000 loss 0.1716 (w 0.0778 mse 0.0840 t 832 new 0.16) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-14 13:33:30] step 3766/5000 loss 0.1338 (w 0.1783 mse 0.1764 t 933 new 0.22) lr 1.00e-05 gnorm 0.146 3.04s mem 81.1GB +[2026-09-14 13:33:33] step 3767/5000 loss 0.3140 (w 0.1595 mse 0.1471 t 789 new 0.23) lr 1.00e-05 gnorm 0.143 3.01s mem 81.1GB +[2026-09-14 13:33:37] step 3768/5000 loss 0.1515 (w 0.1790 mse 0.1754 t 882 new 0.22) lr 1.00e-05 gnorm 0.123 3.38s mem 81.1GB +[2026-09-14 13:33:40] step 3769/5000 loss 0.2253 (w 0.2666 mse 0.2489 t 982 new 0.15) lr 1.00e-05 gnorm 0.138 3.09s mem 81.1GB +[2026-09-14 13:33:43] step 3770/5000 loss 0.3486 (w 0.1603 mse 0.1799 t 958 new 0.22) lr 1.00e-05 gnorm 0.289 3.10s mem 81.1GB +[2026-09-14 13:33:46] step 3771/5000 loss 0.1755 (w 0.3099 mse 0.3042 t 988 new 0.17) lr 1.00e-05 gnorm 0.210 2.83s mem 81.1GB +[2026-09-14 13:33:49] step 3772/5000 loss 0.3376 (w 0.1654 mse 0.1612 t 914 new 0.20) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +[2026-09-14 13:33:52] step 3773/5000 loss 0.1759 (w 0.1722 mse 0.1652 t 936 new 0.21) lr 1.00e-05 gnorm 0.123 3.07s mem 81.1GB +[2026-09-14 13:33:55] step 3774/5000 loss 0.3001 (w 0.2466 mse 0.2343 t 969 new 0.23) lr 1.00e-05 gnorm 0.130 3.38s mem 81.1GB +[2026-09-14 13:33:58] step 3775/5000 loss 0.4076 (w 0.1986 mse 0.2041 t 987 new 0.20) lr 1.00e-05 gnorm 0.230 3.11s mem 81.1GB +[2026-09-14 13:34:01] step 3776/5000 loss 0.3059 (w 0.1061 mse 0.1009 t 677 new 0.22) lr 1.00e-05 gnorm 0.518 3.06s mem 81.1GB +[2026-09-14 13:34:04] step 3777/5000 loss 0.4570 (w 0.3261 mse 0.3227 t 379 new 0.28) lr 1.00e-05 gnorm 0.148 2.82s mem 81.1GB +[2026-09-14 13:34:07] step 3778/5000 loss 0.1380 (w 0.1953 mse 0.1899 t 923 new 0.11) lr 1.00e-05 gnorm 0.203 3.07s mem 81.1GB +[2026-09-14 13:34:10] step 3779/5000 loss 0.1486 (w 0.1721 mse 0.1595 t 881 new 0.07) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +[2026-09-14 13:34:14] step 3780/5000 loss 0.1446 (w 0.2092 mse 0.2100 t 875 new 0.16) lr 1.00e-05 gnorm 0.117 3.41s mem 81.1GB +[2026-09-14 13:34:17] step 3781/5000 loss 0.2757 (w 0.1475 mse 0.1566 t 490 new 0.10) lr 1.00e-05 gnorm 0.213 3.32s mem 81.1GB +[2026-09-14 13:34:20] step 3782/5000 loss 0.2221 (w 0.1441 mse 0.1423 t 680 new 0.15) lr 1.00e-05 gnorm 1.399 2.83s mem 81.1GB +[2026-09-14 13:34:23] step 3783/5000 loss 0.2946 (w 0.1876 mse 0.1965 t 915 new 0.20) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-14 13:34:26] step 3784/5000 loss 0.2335 (w 0.1695 mse 0.1667 t 328 new 0.13) lr 1.00e-05 gnorm 0.151 3.11s mem 81.1GB +[2026-09-14 13:34:29] step 3785/5000 loss 0.1243 (w 0.1807 mse 0.1943 t 983 new 0.17) lr 1.00e-05 gnorm 0.173 3.28s mem 81.1GB +[2026-09-14 13:34:32] step 3786/5000 loss 0.2072 (w 0.1990 mse 0.1929 t 838 new 0.26) lr 1.00e-05 gnorm 0.172 3.12s mem 81.1GB +[2026-09-14 13:34:36] step 3787/5000 loss 0.0775 (w 0.2313 mse 0.2179 t 941 new 0.09) lr 1.00e-05 gnorm 0.165 3.41s mem 81.1GB +[2026-09-14 13:34:38] step 3788/5000 loss 0.1379 (w 0.2718 mse 0.2602 t 957 new 0.24) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +[2026-09-14 13:34:41] step 3789/5000 loss 0.2861 (w 0.2946 mse 0.2990 t 965 new 0.23) lr 1.00e-05 gnorm 0.185 2.82s mem 81.1GB +[2026-09-14 13:34:44] step 3790/5000 loss 0.2018 (w 0.2954 mse 0.2853 t 495 new 0.24) lr 1.00e-05 gnorm 0.116 3.11s mem 81.1GB +[2026-09-14 13:34:48] step 3791/5000 loss 0.2444 (w 0.2919 mse 0.2847 t 929 new 0.23) lr 1.00e-05 gnorm 0.132 3.33s mem 81.1GB +[2026-09-14 13:34:51] step 3792/5000 loss 0.2794 (w 0.2817 mse 0.2725 t 994 new 0.22) lr 1.00e-05 gnorm 0.283 3.47s mem 81.1GB +[2026-09-14 13:34:54] step 3793/5000 loss 0.2191 (w 0.2464 mse 0.2337 t 970 new 0.18) lr 1.00e-05 gnorm 0.113 3.19s mem 81.1GB +[2026-09-14 13:34:57] step 3794/5000 loss 0.2505 (w 0.1688 mse 0.1748 t 770 new 0.18) lr 1.00e-05 gnorm 0.180 2.82s mem 81.1GB +[2026-09-14 13:35:00] step 3795/5000 loss 0.2295 (w 0.2184 mse 0.2172 t 930 new 0.12) lr 1.00e-05 gnorm 0.189 2.84s mem 81.1GB +[2026-09-14 13:35:03] step 3796/5000 loss 0.1719 (w 0.2049 mse 0.1995 t 961 new 0.16) lr 1.00e-05 gnorm 0.115 3.31s mem 81.1GB +[2026-09-14 13:35:06] step 3797/5000 loss 0.1041 (w 0.1021 mse 0.0971 t 894 new 0.17) lr 1.00e-05 gnorm 0.128 3.12s mem 81.1GB +[2026-09-14 13:35:10] step 3798/5000 loss 0.1235 (w 0.1616 mse 0.1710 t 540 new 0.28) lr 1.00e-05 gnorm 0.120 3.38s mem 81.1GB +[2026-09-14 13:35:13] step 3799/5000 loss 0.1019 (w 0.2004 mse 0.1869 t 855 new 0.20) lr 1.00e-05 gnorm 0.111 3.07s mem 81.1GB +[2026-09-14 13:35:16] step 3800/5000 loss 0.1081 (w 0.2930 mse 0.2764 t 998 new 0.23) lr 1.00e-05 gnorm 0.138 2.84s mem 81.1GB +[2026-09-14 13:35:19] step 3801/5000 loss 0.1778 (w 0.1606 mse 0.1514 t 937 new 0.23) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-14 13:35:22] step 3802/5000 loss 0.1551 (w 0.2547 mse 0.2384 t 929 new 0.24) lr 1.00e-05 gnorm 0.193 3.30s mem 81.1GB +[2026-09-14 13:35:25] step 3803/5000 loss 0.2142 (w 0.2202 mse 0.2176 t 735 new 0.23) lr 1.00e-05 gnorm 0.210 3.41s mem 81.1GB +[2026-09-14 13:35:29] step 3804/5000 loss 0.1379 (w 0.2662 mse 0.2683 t 958 new 0.18) lr 1.00e-05 gnorm 0.144 3.34s mem 81.1GB +[2026-09-14 13:35:32] step 3805/5000 loss 0.1336 (w 0.1023 mse 0.1127 t 842 new 0.13) lr 1.00e-05 gnorm 0.138 3.09s mem 81.1GB +[2026-09-14 13:35:35] step 3806/5000 loss 0.1230 (w 0.1980 mse 0.1919 t 887 new 0.17) lr 1.00e-05 gnorm 0.131 2.82s mem 81.1GB +[2026-09-14 13:35:38] step 3807/5000 loss 0.2364 (w 0.2356 mse 0.2127 t 846 new 0.22) lr 1.00e-05 gnorm 0.156 3.03s mem 81.1GB +[2026-09-14 13:35:41] step 3808/5000 loss 0.2235 (w 0.2262 mse 0.2221 t 972 new 0.21) lr 1.00e-05 gnorm 0.221 3.04s mem 81.1GB +[2026-09-14 13:35:44] step 3809/5000 loss 0.2922 (w 0.2847 mse 0.2769 t 964 new 0.24) lr 1.00e-05 gnorm 0.160 3.39s mem 81.1GB +[2026-09-14 13:35:47] step 3810/5000 loss 0.1942 (w 0.2055 mse 0.2016 t 925 new 0.19) lr 1.00e-05 gnorm 0.224 3.25s mem 81.1GB +[2026-09-14 13:35:50] step 3811/5000 loss 0.2855 (w 0.1886 mse 0.1905 t 684 new 0.16) lr 1.00e-05 gnorm 0.135 3.07s mem 81.1GB +[2026-09-14 13:35:53] step 3812/5000 loss 0.3608 (w 0.2234 mse 0.2393 t 379 new 0.23) lr 1.00e-05 gnorm 0.151 2.83s mem 81.1GB +[2026-09-14 13:35:56] step 3813/5000 loss 0.3824 (w 0.3660 mse 0.3625 t 411 new 0.16) lr 1.00e-05 gnorm 0.162 3.04s mem 81.1GB +[2026-09-14 13:35:59] step 3814/5000 loss 0.1444 (w 0.2262 mse 0.2129 t 923 new 0.22) lr 1.00e-05 gnorm 0.144 3.10s mem 81.1GB +[2026-09-14 13:36:03] step 3815/5000 loss 0.3075 (w 0.1518 mse 0.1591 t 867 new 0.22) lr 1.00e-05 gnorm 0.114 3.37s mem 81.1GB +[2026-09-14 13:36:06] step 3816/5000 loss 0.2034 (w 0.2438 mse 0.2364 t 921 new 0.10) lr 1.00e-05 gnorm 0.121 3.35s mem 81.1GB +[2026-09-14 13:36:09] step 3817/5000 loss 0.1795 (w 0.2466 mse 0.2294 t 780 new 0.18) lr 1.00e-05 gnorm 0.142 3.08s mem 81.1GB +[2026-09-14 13:36:12] step 3818/5000 loss 0.4006 (w 0.1751 mse 0.1722 t 834 new 0.07) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +[2026-09-14 13:36:15] step 3819/5000 loss 0.2090 (w 0.3594 mse 0.3657 t 996 new 0.16) lr 1.00e-05 gnorm 0.128 3.05s mem 81.1GB +[2026-09-14 13:36:18] step 3820/5000 loss 0.2003 (w 0.1551 mse 0.1558 t 969 new 0.13) lr 1.00e-05 gnorm 0.100 3.23s mem 81.1GB +[2026-09-14 13:36:22] step 3821/5000 loss 0.1535 (w 0.2354 mse 0.2311 t 621 new 0.21) lr 1.00e-05 gnorm 0.177 3.36s mem 81.1GB +[2026-09-14 13:36:25] step 3822/5000 loss 0.0902 (w 0.2825 mse 0.2733 t 972 new 0.18) lr 1.00e-05 gnorm 0.179 3.13s mem 81.1GB +[2026-09-14 13:36:28] step 3823/5000 loss 0.1106 (w 0.1153 mse 0.1334 t 992 new 0.18) lr 1.00e-05 gnorm 0.202 3.08s mem 81.1GB +[2026-09-14 13:36:31] step 3824/5000 loss 0.1498 (w 0.4913 mse 0.4989 t 120 new 0.21) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +[2026-09-14 13:36:34] step 3825/5000 loss 0.2493 (w 0.2131 mse 0.2106 t 866 new 0.24) lr 1.00e-05 gnorm 0.125 3.09s mem 81.1GB +[2026-09-14 13:36:37] step 3826/5000 loss 0.1253 (w 0.0489 mse 0.0522 t 840 new 0.07) lr 1.00e-05 gnorm 0.124 3.54s mem 81.1GB +[2026-09-14 13:36:41] step 3827/5000 loss 0.2135 (w 0.1879 mse 0.1838 t 992 new 0.12) lr 1.00e-05 gnorm 0.241 3.34s mem 81.1GB +[2026-09-14 13:36:44] step 3828/5000 loss 0.1435 (w 0.3113 mse 0.3033 t 978 new 0.20) lr 1.00e-05 gnorm 0.115 3.14s mem 81.1GB +[2026-09-14 13:36:47] step 3829/5000 loss 0.1288 (w 0.1463 mse 0.1357 t 919 new 0.21) lr 1.00e-05 gnorm 0.168 3.12s mem 81.1GB +[2026-09-14 13:36:50] step 3830/5000 loss 0.3055 (w 0.2059 mse 0.2111 t 910 new 0.23) lr 1.00e-05 gnorm 0.120 2.84s mem 81.1GB +[2026-09-14 13:36:53] step 3831/5000 loss 0.1955 (w 0.1695 mse 0.1785 t 847 new 0.12) lr 1.00e-05 gnorm 0.118 3.11s mem 81.1GB +[2026-09-14 13:36:56] step 3832/5000 loss 0.2040 (w 0.3054 mse 0.3006 t 945 new 0.20) lr 1.00e-05 gnorm 0.123 3.55s mem 81.1GB +[2026-09-14 13:37:00] step 3833/5000 loss 0.2562 (w 0.2407 mse 0.2350 t 530 new 0.25) lr 1.00e-05 gnorm 0.134 3.42s mem 81.1GB +[2026-09-14 13:37:03] step 3834/5000 loss 0.2652 (w 0.1140 mse 0.1261 t 790 new 0.21) lr 1.00e-05 gnorm 0.138 3.35s mem 81.1GB +[2026-09-14 13:37:06] step 3835/5000 loss 0.2234 (w 0.2148 mse 0.2079 t 516 new 0.16) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +[2026-09-14 13:37:09] step 3836/5000 loss 0.2085 (w 0.1733 mse 0.1636 t 759 new 0.20) lr 1.00e-05 gnorm 0.132 2.84s mem 81.1GB +[2026-09-14 13:37:12] step 3837/5000 loss 0.1020 (w 0.1211 mse 0.1255 t 826 new 0.07) lr 1.00e-05 gnorm 0.107 3.41s mem 81.1GB +[2026-09-14 13:37:16] step 3838/5000 loss 0.1444 (w 0.2496 mse 0.2410 t 961 new 0.21) lr 1.00e-05 gnorm 0.115 3.57s mem 81.1GB +[2026-09-14 13:37:19] step 3839/5000 loss 0.1840 (w 0.2131 mse 0.2111 t 930 new 0.13) lr 1.00e-05 gnorm 0.159 3.16s mem 81.1GB +[2026-09-14 13:37:22] step 3840/5000 loss 0.2838 (w 0.3066 mse 0.2932 t 919 new 0.18) lr 1.00e-05 gnorm 0.133 3.15s mem 81.1GB +[2026-09-14 13:37:25] step 3841/5000 loss 0.2435 (w 0.2233 mse 0.2259 t 913 new 0.22) lr 1.00e-05 gnorm 0.140 2.84s mem 81.1GB +[2026-09-14 13:37:28] step 3842/5000 loss 0.1886 (w 0.2820 mse 0.2597 t 977 new 0.16) lr 1.00e-05 gnorm 0.108 2.84s mem 81.1GB +[2026-09-14 13:37:31] step 3843/5000 loss 0.2431 (w 0.3486 mse 0.3318 t 983 new 0.20) lr 1.00e-05 gnorm 0.138 3.34s mem 81.1GB +[2026-09-14 13:37:35] step 3844/5000 loss 0.4218 (w 0.2273 mse 0.2251 t 356 new 0.13) lr 1.00e-05 gnorm 0.151 3.42s mem 81.1GB +[2026-09-14 13:37:38] step 3845/5000 loss 0.2849 (w 0.2310 mse 0.2470 t 992 new 0.15) lr 1.00e-05 gnorm 0.151 3.26s mem 81.1GB +[2026-09-14 13:37:41] step 3846/5000 loss 0.1338 (w 0.3322 mse 0.3137 t 962 new 0.23) lr 1.00e-05 gnorm 0.122 3.08s mem 81.1GB +[2026-09-14 13:37:44] step 3847/5000 loss 0.3490 (w 0.2728 mse 0.2601 t 890 new 0.27) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +[2026-09-14 13:37:47] step 3848/5000 loss 0.3134 (w 0.6534 mse 0.6471 t 107 new 0.22) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-14 13:37:50] step 3849/5000 loss 0.1573 (w 0.2422 mse 0.2479 t 942 new 0.19) lr 1.00e-05 gnorm 0.171 3.37s mem 81.1GB +[2026-09-14 13:37:54] step 3850/5000 loss 0.3342 (w 0.1986 mse 0.1928 t 546 new 0.23) lr 1.00e-05 gnorm 0.126 3.43s mem 81.1GB +[2026-09-14 13:37:57] step 3851/5000 loss 0.2538 (w 0.2205 mse 0.2234 t 689 new 0.23) lr 1.00e-05 gnorm 0.117 3.39s mem 81.1GB +[2026-09-14 13:38:00] step 3852/5000 loss 0.1287 (w 0.2273 mse 0.2196 t 871 new 0.18) lr 1.00e-05 gnorm 0.126 3.08s mem 81.1GB +[2026-09-14 13:38:03] step 3853/5000 loss 0.3697 (w 0.1955 mse 0.1971 t 724 new 0.24) lr 1.00e-05 gnorm 0.122 2.84s mem 81.1GB +[2026-09-14 13:38:06] step 3854/5000 loss 0.1165 (w 0.0577 mse 0.0574 t 889 new 0.05) lr 1.00e-05 gnorm 0.126 3.11s mem 81.1GB +[2026-09-14 13:38:09] step 3855/5000 loss 0.2523 (w 0.1605 mse 0.1593 t 928 new 0.18) lr 1.00e-05 gnorm 0.137 3.17s mem 81.1GB +[2026-09-14 13:38:13] step 3856/5000 loss 0.2515 (w 0.2566 mse 0.2381 t 784 new 0.19) lr 1.00e-05 gnorm 0.136 3.44s mem 81.1GB +[2026-09-14 13:38:16] step 3857/5000 loss 0.2388 (w 0.2816 mse 0.2737 t 991 new 0.22) lr 1.00e-05 gnorm 0.138 3.40s mem 81.1GB +[2026-09-14 13:38:19] step 3858/5000 loss 0.3610 (w 0.2460 mse 0.2291 t 930 new 0.20) lr 1.00e-05 gnorm 0.144 2.82s mem 81.1GB +[2026-09-14 13:38:22] step 3859/5000 loss 0.1919 (w 0.3314 mse 0.3229 t 677 new 0.23) lr 1.00e-05 gnorm 0.194 2.84s mem 81.1GB +[2026-09-14 13:38:25] step 3860/5000 loss 0.2445 (w 0.2090 mse 0.2093 t 989 new 0.23) lr 1.00e-05 gnorm 0.182 3.03s mem 81.1GB +[2026-09-14 13:38:28] step 3861/5000 loss 0.2347 (w 0.1746 mse 0.1641 t 866 new 0.18) lr 1.00e-05 gnorm 0.294 3.14s mem 81.1GB +[2026-09-14 13:38:31] step 3862/5000 loss 0.2190 (w 0.2293 mse 0.2197 t 920 new 0.24) lr 1.00e-05 gnorm 0.134 3.28s mem 81.1GB +[2026-09-14 13:38:34] step 3863/5000 loss 0.2634 (w 0.2024 mse 0.2007 t 943 new 0.16) lr 1.00e-05 gnorm 0.169 3.34s mem 81.1GB +[2026-09-14 13:38:37] step 3864/5000 loss 0.2740 (w 0.3604 mse 0.3576 t 987 new 0.11) lr 1.00e-05 gnorm 0.116 2.82s mem 81.1GB +[2026-09-14 13:38:40] step 3865/5000 loss 0.1478 (w 0.1328 mse 0.1311 t 853 new 0.08) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +[2026-09-14 13:38:43] step 3866/5000 loss 0.2851 (w 0.1517 mse 0.1699 t 888 new 0.18) lr 1.00e-05 gnorm 0.220 3.08s mem 81.1GB +[2026-09-14 13:38:46] step 3867/5000 loss 0.3332 (w 0.2211 mse 0.2150 t 853 new 0.22) lr 1.00e-05 gnorm 0.204 3.10s mem 81.1GB +[2026-09-14 13:38:50] step 3868/5000 loss 0.1816 (w 0.2467 mse 0.2504 t 987 new 0.22) lr 1.00e-05 gnorm 0.116 3.38s mem 81.1GB +[2026-09-14 13:38:53] step 3869/5000 loss 0.1955 (w 0.1987 mse 0.1808 t 919 new 0.23) lr 1.00e-05 gnorm 0.163 3.38s mem 81.1GB +[2026-09-14 13:38:56] step 3870/5000 loss 0.2313 (w 0.1560 mse 0.1457 t 826 new 0.16) lr 1.00e-05 gnorm 0.129 2.84s mem 81.1GB +[2026-09-14 13:38:59] step 3871/5000 loss 0.2648 (w 0.2749 mse 0.2853 t 997 new 0.17) lr 1.00e-05 gnorm 0.172 2.85s mem 81.1GB +[2026-09-14 13:39:02] step 3872/5000 loss 0.1936 (w 0.2153 mse 0.1956 t 865 new 0.21) lr 1.00e-05 gnorm 0.243 3.05s mem 81.1GB +[2026-09-14 13:39:05] step 3873/5000 loss 0.1958 (w 0.1674 mse 0.1674 t 892 new 0.23) lr 1.00e-05 gnorm 0.152 3.42s mem 81.1GB +[2026-09-14 13:39:09] step 3874/5000 loss 0.2632 (w 0.1447 mse 0.1567 t 761 new 0.13) lr 1.00e-05 gnorm 0.147 3.46s mem 81.1GB +[2026-09-14 13:39:12] step 3875/5000 loss 0.1515 (w 0.2012 mse 0.2063 t 816 new 0.15) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +[2026-09-14 13:39:15] step 3876/5000 loss 0.2678 (w 0.2354 mse 0.2356 t 580 new 0.23) lr 1.00e-05 gnorm 0.159 2.83s mem 81.1GB +[2026-09-14 13:39:18] step 3877/5000 loss 0.1857 (w 0.2908 mse 0.2838 t 980 new 0.22) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +[2026-09-14 13:39:21] step 3878/5000 loss 0.3287 (w 0.1991 mse 0.1991 t 462 new 0.18) lr 1.00e-05 gnorm 0.179 3.09s mem 81.1GB +[2026-09-14 13:39:24] step 3879/5000 loss 0.2423 (w 0.2968 mse 0.2813 t 964 new 0.27) lr 1.00e-05 gnorm 0.108 3.32s mem 81.1GB +[2026-09-14 13:39:27] step 3880/5000 loss 0.3219 (w 0.3966 mse 0.3975 t 424 new 0.10) lr 1.00e-05 gnorm 0.138 3.15s mem 81.1GB +[2026-09-14 13:39:30] step 3881/5000 loss 0.1934 (w 0.2782 mse 0.2696 t 934 new 0.22) lr 1.00e-05 gnorm 0.102 3.08s mem 81.1GB +[2026-09-14 13:39:33] step 3882/5000 loss 0.1403 (w 0.1332 mse 0.1380 t 926 new 0.21) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +[2026-09-14 13:39:36] step 3883/5000 loss 0.1525 (w 0.2439 mse 0.2502 t 983 new 0.21) lr 1.00e-05 gnorm 0.107 3.01s mem 81.1GB +[2026-09-14 13:39:39] step 3884/5000 loss 0.1498 (w 0.2677 mse 0.2782 t 959 new 0.15) lr 1.00e-05 gnorm 0.109 3.03s mem 81.1GB +[2026-09-14 13:39:43] step 3885/5000 loss 0.1688 (w 0.2539 mse 0.2414 t 811 new 0.26) lr 1.00e-05 gnorm 0.248 3.35s mem 81.1GB +[2026-09-14 13:39:46] step 3886/5000 loss 0.2232 (w 0.2474 mse 0.2461 t 979 new 0.26) lr 1.00e-05 gnorm 0.136 3.38s mem 81.1GB +[2026-09-14 13:39:49] step 3887/5000 loss 0.2646 (w 0.2319 mse 0.2284 t 465 new 0.18) lr 1.00e-05 gnorm 0.198 3.08s mem 81.1GB +[2026-09-14 13:39:52] step 3888/5000 loss 0.2152 (w 0.1384 mse 0.1510 t 544 new 0.23) lr 1.00e-05 gnorm 0.201 2.82s mem 81.1GB +[2026-09-14 13:39:55] step 3889/5000 loss 0.0935 (w 0.1724 mse 0.1788 t 836 new 0.21) lr 1.00e-05 gnorm 0.217 3.08s mem 81.1GB +[2026-09-14 13:39:58] step 3890/5000 loss 0.3847 (w 0.2019 mse 0.1873 t 986 new 0.21) lr 1.00e-05 gnorm 0.139 3.04s mem 81.1GB +[2026-09-14 13:40:01] step 3891/5000 loss 0.1756 (w 0.1868 mse 0.1865 t 949 new 0.15) lr 1.00e-05 gnorm 0.157 3.38s mem 81.1GB +[2026-09-14 13:40:05] step 3892/5000 loss 0.2290 (w 0.1694 mse 0.1632 t 817 new 0.14) lr 1.00e-05 gnorm 0.190 3.31s mem 81.1GB +[2026-09-14 13:40:08] step 3893/5000 loss 0.2861 (w 0.1796 mse 0.1731 t 725 new 0.12) lr 1.00e-05 gnorm 0.173 3.05s mem 81.1GB +[2026-09-14 13:40:11] step 3894/5000 loss 0.2393 (w 0.5147 mse 0.5132 t 223 new 0.03) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +[2026-09-14 13:40:14] step 3895/5000 loss 0.2741 (w 0.3778 mse 0.3818 t 998 new 0.14) lr 1.00e-05 gnorm 0.143 3.02s mem 81.1GB +[2026-09-14 13:40:17] step 3896/5000 loss 0.2671 (w 0.2724 mse 0.2702 t 544 new 0.26) lr 1.00e-05 gnorm 0.160 3.06s mem 81.1GB +[2026-09-14 13:40:20] step 3897/5000 loss 0.2475 (w 0.1972 mse 0.1872 t 940 new 0.22) lr 1.00e-05 gnorm 0.135 3.41s mem 81.1GB +[2026-09-14 13:40:23] step 3898/5000 loss 0.1979 (w 0.2980 mse 0.2966 t 989 new 0.19) lr 1.00e-05 gnorm 0.115 3.06s mem 81.1GB +[2026-09-14 13:40:26] step 3899/5000 loss 0.1030 (w 0.1674 mse 0.1554 t 918 new 0.21) lr 1.00e-05 gnorm 0.174 3.11s mem 81.1GB +[2026-09-14 13:40:29] step 3900/5000 loss 0.1421 (w 0.1399 mse 0.1335 t 772 new 0.27) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +[2026-09-14 13:40:32] step 3901/5000 loss 0.2552 (w 0.1917 mse 0.1877 t 913 new 0.24) lr 1.00e-05 gnorm 0.154 2.82s mem 81.1GB +[2026-09-14 13:40:35] step 3902/5000 loss 0.2540 (w 0.3006 mse 0.3210 t 383 new 0.14) lr 1.00e-05 gnorm 0.127 3.03s mem 81.1GB +[2026-09-14 13:40:39] step 3903/5000 loss 0.2553 (w 0.2032 mse 0.1866 t 811 new 0.19) lr 1.00e-05 gnorm 0.245 3.36s mem 81.1GB +[2026-09-14 13:40:42] step 3904/5000 loss 0.0966 (w 0.2819 mse 0.2675 t 963 new 0.23) lr 1.00e-05 gnorm 0.094 3.31s mem 81.1GB +[2026-09-14 13:40:45] step 3905/5000 loss 0.2038 (w 0.2856 mse 0.2683 t 936 new 0.21) lr 1.00e-05 gnorm 0.279 2.82s mem 81.1GB +[2026-09-14 13:40:48] step 3906/5000 loss 0.2619 (w 0.1395 mse 0.1385 t 824 new 0.24) lr 1.00e-05 gnorm 0.161 3.08s mem 81.1GB +[2026-09-14 13:40:51] step 3907/5000 loss 0.1723 (w 0.3955 mse 0.3877 t 991 new 0.17) lr 1.00e-05 gnorm 0.119 2.82s mem 81.1GB +[2026-09-14 13:40:54] step 3908/5000 loss 0.2162 (w 0.1824 mse 0.1691 t 764 new 0.22) lr 1.00e-05 gnorm 0.108 3.07s mem 81.1GB +[2026-09-14 13:40:57] step 3909/5000 loss 0.2541 (w 0.2091 mse 0.2114 t 956 new 0.22) lr 1.00e-05 gnorm 0.184 3.43s mem 81.1GB +[2026-09-14 13:41:01] step 3910/5000 loss 0.2037 (w 0.2469 mse 0.2329 t 880 new 0.26) lr 1.00e-05 gnorm 0.143 3.36s mem 81.1GB +[2026-09-14 13:41:03] step 3911/5000 loss 0.1710 (w 0.1495 mse 0.1363 t 919 new 0.22) lr 1.00e-05 gnorm 0.118 2.84s mem 81.1GB +[2026-09-14 13:41:06] step 3912/5000 loss 0.2267 (w 0.1082 mse 0.1226 t 823 new 0.20) lr 1.00e-05 gnorm 0.105 3.05s mem 81.1GB +[2026-09-14 13:41:09] step 3913/5000 loss 0.3532 (w 0.2512 mse 0.2555 t 982 new 0.21) lr 1.00e-05 gnorm 0.308 2.84s mem 81.1GB +[2026-09-14 13:41:12] step 3914/5000 loss 0.2814 (w 0.2413 mse 0.2379 t 506 new 0.24) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +[2026-09-14 13:41:16] step 3915/5000 loss 0.2193 (w 0.3466 mse 0.3192 t 892 new 0.13) lr 1.00e-05 gnorm 0.163 3.12s mem 81.1GB +[2026-09-14 13:41:19] step 3916/5000 loss 0.1842 (w 0.1864 mse 0.1842 t 999 new 0.18) lr 1.00e-05 gnorm 0.104 3.10s mem 81.1GB +[2026-09-14 13:41:22] step 3917/5000 loss 0.2619 (w 0.2424 mse 0.2422 t 972 new 0.13) lr 1.00e-05 gnorm 0.176 2.84s mem 81.1GB +[2026-09-14 13:41:25] step 3918/5000 loss 0.1923 (w 0.4734 mse 0.4524 t 1000 new 0.21) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +[2026-09-14 13:41:27] step 3919/5000 loss 0.2401 (w 0.1278 mse 0.1371 t 677 new 0.20) lr 1.00e-05 gnorm 0.175 2.84s mem 81.1GB +[2026-09-14 13:41:31] step 3920/5000 loss 0.1736 (w 0.2136 mse 0.2218 t 995 new 0.23) lr 1.00e-05 gnorm 0.114 3.41s mem 81.1GB +[2026-09-14 13:41:34] step 3921/5000 loss 0.3143 (w 0.1302 mse 0.1402 t 823 new 0.14) lr 1.00e-05 gnorm 0.176 3.12s mem 81.1GB +[2026-09-14 13:41:37] step 3922/5000 loss 0.2008 (w 0.1652 mse 0.1739 t 942 new 0.09) lr 1.00e-05 gnorm 0.143 3.14s mem 81.1GB +[2026-09-14 13:41:40] step 3923/5000 loss 0.2334 (w 0.1251 mse 0.1305 t 729 new 0.27) lr 1.00e-05 gnorm 0.130 2.84s mem 81.1GB +[2026-09-14 13:41:43] step 3924/5000 loss 0.1497 (w 0.3693 mse 0.3529 t 945 new 0.22) lr 1.00e-05 gnorm 0.112 3.04s mem 81.1GB +[2026-09-14 13:41:46] step 3925/5000 loss 0.2359 (w 0.2077 mse 0.2020 t 889 new 0.17) lr 1.00e-05 gnorm 0.136 2.83s mem 81.1GB +[2026-09-14 13:41:49] step 3926/5000 loss 0.0904 (w 0.1472 mse 0.1560 t 968 new 0.12) lr 1.00e-05 gnorm 0.163 3.50s mem 81.1GB +[2026-09-14 13:41:53] step 3927/5000 loss 0.3853 (w 0.1477 mse 0.1504 t 724 new 0.25) lr 1.00e-05 gnorm 0.199 3.40s mem 81.1GB +[2026-09-14 13:41:56] step 3928/5000 loss 0.2353 (w 0.2996 mse 0.3083 t 993 new 0.24) lr 1.00e-05 gnorm 0.142 3.06s mem 81.1GB +[2026-09-14 13:41:59] step 3929/5000 loss 0.3293 (w 0.2016 mse 0.2066 t 516 new 0.24) lr 1.00e-05 gnorm 0.201 2.83s mem 81.1GB +[2026-09-14 13:42:02] step 3930/5000 loss 0.2367 (w 0.1901 mse 0.1925 t 546 new 0.27) lr 1.00e-05 gnorm 0.157 3.06s mem 81.1GB +[2026-09-14 13:42:05] step 3931/5000 loss 0.1473 (w 0.2121 mse 0.2312 t 961 new 0.20) lr 1.00e-05 gnorm 0.154 2.82s mem 81.1GB +[2026-09-14 13:42:08] step 3932/5000 loss 0.1387 (w 0.1403 mse 0.1396 t 858 new 0.25) lr 1.00e-05 gnorm 0.108 3.43s mem 81.1GB +[2026-09-14 13:42:11] step 3933/5000 loss 0.2319 (w 0.2790 mse 0.2640 t 966 new 0.22) lr 1.00e-05 gnorm 0.149 3.14s mem 81.1GB +[2026-09-14 13:42:14] step 3934/5000 loss 0.1255 (w 0.2384 mse 0.2297 t 944 new 0.25) lr 1.00e-05 gnorm 0.118 3.16s mem 81.1GB +[2026-09-14 13:42:17] step 3935/5000 loss 0.2383 (w 0.1770 mse 0.1864 t 887 new 0.17) lr 1.00e-05 gnorm 0.182 3.03s mem 81.1GB +[2026-09-14 13:42:20] step 3936/5000 loss 0.2295 (w 0.2394 mse 0.2330 t 980 new 0.17) lr 1.00e-05 gnorm 0.109 2.81s mem 81.1GB +[2026-09-14 13:42:23] step 3937/5000 loss 0.1676 (w 0.2521 mse 0.2471 t 878 new 0.21) lr 1.00e-05 gnorm 0.146 2.83s mem 81.1GB +[2026-09-14 13:42:26] step 3938/5000 loss 0.1768 (w 0.1951 mse 0.2067 t 976 new 0.17) lr 1.00e-05 gnorm 0.192 3.43s mem 81.1GB +[2026-09-14 13:42:30] step 3939/5000 loss 0.2287 (w 0.1821 mse 0.1772 t 856 new 0.28) lr 1.00e-05 gnorm 0.223 3.12s mem 81.1GB +[2026-09-14 13:42:32] step 3940/5000 loss 0.4215 (w 0.2680 mse 0.2650 t 767 new 0.23) lr 1.00e-05 gnorm 0.165 2.84s mem 81.1GB +[2026-09-14 13:42:35] step 3941/5000 loss 0.2497 (w 0.3221 mse 0.3306 t 264 new 0.13) lr 1.00e-05 gnorm 0.111 3.04s mem 81.1GB +[2026-09-14 13:42:38] step 3942/5000 loss 0.2435 (w 0.5294 mse 0.5262 t 177 new 0.16) lr 1.00e-05 gnorm 0.143 2.82s mem 81.1GB +[2026-09-14 13:42:41] step 3943/5000 loss 0.2737 (w 0.2558 mse 0.2268 t 958 new 0.25) lr 1.00e-05 gnorm 0.764 3.09s mem 81.1GB +[2026-09-14 13:42:45] step 3944/5000 loss 0.1630 (w 0.1875 mse 0.1793 t 788 new 0.15) lr 1.00e-05 gnorm 0.136 3.42s mem 81.1GB +[2026-09-14 13:42:48] step 3945/5000 loss 0.1656 (w 0.0853 mse 0.0872 t 943 new 0.02) lr 1.00e-05 gnorm 0.139 3.05s mem 81.1GB +[2026-09-14 13:42:51] step 3946/5000 loss 0.1599 (w 0.2331 mse 0.2258 t 990 new 0.21) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +[2026-09-14 13:42:54] step 3947/5000 loss 0.2149 (w 0.2897 mse 0.2739 t 969 new 0.13) lr 1.00e-05 gnorm 0.160 3.02s mem 81.1GB +[2026-09-14 13:42:57] step 3948/5000 loss 0.1925 (w 0.2134 mse 0.2078 t 693 new 0.20) lr 1.00e-05 gnorm 0.103 2.84s mem 81.1GB +[2026-09-14 13:43:00] step 3949/5000 loss 0.1883 (w 0.2956 mse 0.3128 t 997 new 0.21) lr 1.00e-05 gnorm 0.153 3.13s mem 81.1GB +[2026-09-14 13:43:03] step 3950/5000 loss 0.1082 (w 0.1690 mse 0.1806 t 914 new 0.21) lr 1.00e-05 gnorm 0.267 3.40s mem 81.1GB +[2026-09-14 13:43:06] step 3951/5000 loss 0.2997 (w 0.3538 mse 0.3558 t 999 new 0.24) lr 1.00e-05 gnorm 0.193 3.07s mem 81.1GB +[2026-09-14 13:43:09] step 3952/5000 loss 0.2538 (w 0.1328 mse 0.1319 t 828 new 0.10) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +[2026-09-14 13:43:12] step 3953/5000 loss 0.2013 (w 0.1333 mse 0.1489 t 867 new 0.20) lr 1.00e-05 gnorm 0.159 3.05s mem 81.1GB +[2026-09-14 13:43:15] step 3954/5000 loss 0.1360 (w 0.2065 mse 0.1943 t 651 new 0.15) lr 1.00e-05 gnorm 0.124 2.85s mem 81.1GB +[2026-09-14 13:43:18] step 3955/5000 loss 0.2192 (w 0.4047 mse 0.3755 t 978 new 0.19) lr 1.00e-05 gnorm 0.341 3.15s mem 81.1GB +[2026-09-14 13:43:21] step 3956/5000 loss 0.2107 (w 0.1894 mse 0.1913 t 891 new 0.22) lr 1.00e-05 gnorm 0.122 3.11s mem 81.1GB +[2026-09-14 13:43:25] step 3957/5000 loss 0.0844 (w 0.1773 mse 0.1629 t 926 new 0.24) lr 1.00e-05 gnorm 0.116 3.40s mem 81.1GB +[2026-09-14 13:43:27] step 3958/5000 loss 0.3006 (w 0.3100 mse 0.3010 t 980 new 0.19) lr 1.00e-05 gnorm 0.169 2.83s mem 81.1GB +[2026-09-14 13:43:30] step 3959/5000 loss 0.2572 (w 0.2469 mse 0.2353 t 628 new 0.20) lr 1.00e-05 gnorm 0.113 3.04s mem 81.1GB +[2026-09-14 13:43:33] step 3960/5000 loss 0.1653 (w 0.2323 mse 0.2444 t 926 new 0.19) lr 1.00e-05 gnorm 0.145 2.82s mem 81.1GB +[2026-09-14 13:43:36] step 3961/5000 loss 0.3350 (w 0.1840 mse 0.1849 t 780 new 0.18) lr 1.00e-05 gnorm 0.119 3.26s mem 81.1GB +[2026-09-14 13:43:40] step 3962/5000 loss 0.2096 (w 0.1197 mse 0.1346 t 802 new 0.24) lr 1.00e-05 gnorm 0.131 3.10s mem 81.1GB +[2026-09-14 13:43:43] step 3963/5000 loss 0.2308 (w 0.4052 mse 0.4157 t 987 new 0.20) lr 1.00e-05 gnorm 0.428 3.12s mem 81.1GB +[2026-09-14 13:43:46] step 3964/5000 loss 0.1031 (w 0.2844 mse 0.2796 t 980 new 0.18) lr 1.00e-05 gnorm 0.204 2.83s mem 81.1GB +[2026-09-14 13:43:49] step 3965/5000 loss 0.2927 (w 0.2545 mse 0.2468 t 897 new 0.21) lr 1.00e-05 gnorm 0.205 3.09s mem 81.1GB +[2026-09-14 13:43:51] step 3966/5000 loss 0.1710 (w 0.1140 mse 0.1193 t 894 new 0.12) lr 1.00e-05 gnorm 0.123 2.82s mem 81.1GB +[2026-09-14 13:43:55] step 3967/5000 loss 0.2782 (w 0.3276 mse 0.3377 t 992 new 0.20) lr 1.00e-05 gnorm 0.152 3.35s mem 81.1GB +[2026-09-14 13:43:58] step 3968/5000 loss 0.2056 (w 0.3088 mse 0.3036 t 987 new 0.17) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +[2026-09-14 13:44:01] step 3969/5000 loss 0.2045 (w 0.2621 mse 0.2600 t 957 new 0.17) lr 1.00e-05 gnorm 0.101 3.12s mem 81.1GB +[2026-09-14 13:44:04] step 3970/5000 loss 0.2703 (w 0.1305 mse 0.1359 t 679 new 0.27) lr 1.00e-05 gnorm 0.141 2.84s mem 81.1GB +[2026-09-14 13:44:07] step 3971/5000 loss 0.1627 (w 0.2209 mse 0.2142 t 631 new 0.22) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +[2026-09-14 13:44:10] step 3972/5000 loss 0.3276 (w 0.3898 mse 0.3736 t 459 new 0.22) lr 1.00e-05 gnorm 0.153 3.14s mem 81.1GB +[2026-09-14 13:44:14] step 3973/5000 loss 0.1119 (w 0.2772 mse 0.2643 t 971 new 0.20) lr 1.00e-05 gnorm 0.113 3.26s mem 81.1GB +[2026-09-14 13:44:16] step 3974/5000 loss 0.2465 (w 0.1654 mse 0.1618 t 898 new 0.23) lr 1.00e-05 gnorm 0.185 2.84s mem 81.1GB +[2026-09-14 13:44:20] step 3975/5000 loss 0.1343 (w 0.1683 mse 0.1630 t 849 new 0.15) lr 1.00e-05 gnorm 0.117 3.11s mem 81.1GB +[2026-09-14 13:44:22] step 3976/5000 loss 0.2365 (w 0.3012 mse 0.2841 t 981 new 0.27) lr 1.00e-05 gnorm 0.105 2.83s mem 81.1GB +[2026-09-14 13:44:25] step 3977/5000 loss 0.1501 (w 0.2188 mse 0.2050 t 924 new 0.11) lr 1.00e-05 gnorm 0.112 3.08s mem 81.1GB +[2026-09-14 13:44:29] step 3978/5000 loss 0.2925 (w 0.5455 mse 0.5448 t 171 new 0.24) lr 1.00e-05 gnorm 0.197 3.13s mem 81.1GB +[2026-09-14 13:44:32] step 3979/5000 loss 0.3525 (w 0.2834 mse 0.2686 t 815 new 0.20) lr 1.00e-05 gnorm 0.123 3.13s mem 81.1GB +[2026-09-14 13:44:35] step 3980/5000 loss 0.1864 (w 0.3113 mse 0.3016 t 940 new 0.26) lr 1.00e-05 gnorm 0.300 3.03s mem 81.1GB +[2026-09-14 13:44:38] step 3981/5000 loss 0.1791 (w 0.3467 mse 0.3436 t 969 new 0.27) lr 1.00e-05 gnorm 0.110 3.10s mem 81.1GB +[2026-09-14 13:44:41] step 3982/5000 loss 0.2137 (w 0.2000 mse 0.2001 t 887 new 0.21) lr 1.00e-05 gnorm 0.120 3.01s mem 81.1GB +[2026-09-14 13:44:44] step 3983/5000 loss 0.2155 (w 0.1288 mse 0.1237 t 920 new 0.22) lr 1.00e-05 gnorm 0.145 2.82s mem 81.1GB +[2026-09-14 13:44:47] step 3984/5000 loss 0.1704 (w 0.2605 mse 0.2576 t 644 new 0.24) lr 1.00e-05 gnorm 0.151 3.05s mem 81.1GB +[2026-09-14 13:44:50] step 3985/5000 loss 0.2074 (w 0.4211 mse 0.4186 t 288 new 0.24) lr 1.00e-05 gnorm 0.108 3.45s mem 81.1GB +[2026-09-14 13:44:53] step 3986/5000 loss 0.1748 (w 0.2327 mse 0.2162 t 907 new 0.28) lr 1.00e-05 gnorm 0.160 3.11s mem 81.1GB +[2026-09-14 13:44:56] step 3987/5000 loss 0.2713 (w 0.9247 mse 0.9202 t 993 new 0.21) lr 1.00e-05 gnorm 0.139 2.82s mem 81.1GB +[2026-09-14 13:44:59] step 3988/5000 loss 0.2455 (w 0.1378 mse 0.1329 t 826 new 0.23) lr 1.00e-05 gnorm 0.162 3.07s mem 81.1GB +[2026-09-14 13:45:02] step 3989/5000 loss 0.2422 (w 0.1691 mse 0.1587 t 951 new 0.25) lr 1.00e-05 gnorm 0.112 2.84s mem 81.1GB +[2026-09-14 13:45:05] step 3990/5000 loss 0.1458 (w 0.2976 mse 0.2804 t 965 new 0.23) lr 1.00e-05 gnorm 0.117 3.15s mem 81.1GB +[2026-09-14 13:45:08] step 3991/5000 loss 0.3507 (w 0.2478 mse 0.2519 t 957 new 0.16) lr 1.00e-05 gnorm 0.136 3.15s mem 81.1GB +[2026-09-14 13:45:12] step 3992/5000 loss 0.2017 (w 0.2416 mse 0.2348 t 983 new 0.10) lr 1.00e-05 gnorm 0.120 3.29s mem 81.1GB +[2026-09-14 13:45:15] step 3993/5000 loss 0.1950 (w 0.2495 mse 0.2529 t 549 new 0.23) lr 1.00e-05 gnorm 0.119 2.82s mem 81.1GB +[2026-09-14 13:45:18] step 3994/5000 loss 0.3084 (w 0.2808 mse 0.2657 t 909 new 0.21) lr 1.00e-05 gnorm 0.140 3.09s mem 81.1GB +[2026-09-14 13:45:20] step 3995/5000 loss 0.2651 (w 0.2227 mse 0.2117 t 920 new 0.22) lr 1.00e-05 gnorm 0.139 2.82s mem 81.1GB +[2026-09-14 13:45:24] step 3996/5000 loss 0.1587 (w 0.2040 mse 0.1915 t 814 new 0.23) lr 1.00e-05 gnorm 0.144 3.12s mem 81.1GB +[2026-09-14 13:45:27] step 3997/5000 loss 0.2060 (w 0.1712 mse 0.1660 t 984 new 0.16) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +[2026-09-14 13:45:30] step 3998/5000 loss 0.1135 (w 0.1653 mse 0.1622 t 937 new 0.13) lr 1.00e-05 gnorm 0.117 3.10s mem 81.1GB +[2026-09-14 13:45:33] step 3999/5000 loss 0.2029 (w 0.3894 mse 0.3965 t 983 new 0.13) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +[2026-09-14 13:45:36] step 4000/5000 loss 0.0926 (w 0.1699 mse 0.1777 t 1000 new 0.17) lr 1.00e-05 gnorm 0.101 3.03s mem 81.1GB +[2026-09-14 13:45:37] [val] step 4000 t=200: w=0.4126 mse=0.4231 (n=16) t=500: w=0.2187 mse=0.2221 (n=16) t=800: w=0.1706 mse=0.1698 (n=16) | mean w=0.2673 mse=0.2717 2s +[2026-09-14 13:46:26] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step4000.safetensors 4093 个张量 37.98 GB +[2026-09-14 13:46:31] step 4001/5000 loss 0.2695 (w 0.0752 mse 0.0810 t 881 new 0.14) lr 1.00e-05 gnorm 0.200 2.82s mem 81.1GB +[2026-09-14 13:46:34] step 4002/5000 loss 0.1548 (w 0.2328 mse 0.2210 t 939 new 0.22) lr 1.00e-05 gnorm 0.121 3.37s mem 81.1GB +[2026-09-14 13:46:38] step 4003/5000 loss 0.2033 (w 0.2643 mse 0.2673 t 940 new 0.11) lr 1.00e-05 gnorm 0.445 3.41s mem 81.1GB +[2026-09-14 13:46:41] step 4004/5000 loss 0.2300 (w 0.1819 mse 0.1905 t 394 new 0.20) lr 1.00e-05 gnorm 0.154 3.09s mem 81.1GB +[2026-09-14 13:46:43] step 4005/5000 loss 0.2606 (w 0.2475 mse 0.2329 t 934 new 0.23) lr 1.00e-05 gnorm 0.129 2.82s mem 81.1GB +[2026-09-14 13:46:47] step 4006/5000 loss 0.1788 (w 0.2874 mse 0.2772 t 698 new 0.13) lr 1.00e-05 gnorm 0.108 3.05s mem 81.1GB +[2026-09-14 13:46:49] step 4007/5000 loss 0.3954 (w 0.2083 mse 0.1907 t 634 new 0.20) lr 1.00e-05 gnorm 0.201 2.84s mem 81.1GB +[2026-09-14 13:46:53] step 4008/5000 loss 0.3434 (w 0.2285 mse 0.2324 t 586 new 0.18) lr 1.00e-05 gnorm 0.138 3.41s mem 81.1GB +[2026-09-14 13:46:56] step 4009/5000 loss 0.1228 (w 0.2627 mse 0.2731 t 978 new 0.17) lr 1.00e-05 gnorm 0.122 3.40s mem 81.1GB +[2026-09-14 13:46:59] step 4010/5000 loss 0.1200 (w 0.2655 mse 0.2716 t 955 new 0.19) lr 1.00e-05 gnorm 0.176 3.11s mem 81.1GB +[2026-09-14 13:47:02] step 4011/5000 loss 0.2623 (w 0.0952 mse 0.0977 t 819 new 0.13) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +[2026-09-14 13:47:05] step 4012/5000 loss 0.1833 (w 0.1134 mse 0.1140 t 689 new 0.18) lr 1.00e-05 gnorm 0.156 2.84s mem 81.1GB +[2026-09-14 13:47:08] step 4013/5000 loss 0.3004 (w 0.2030 mse 0.1990 t 641 new 0.20) lr 1.00e-05 gnorm 0.145 3.09s mem 81.1GB +[2026-09-14 13:47:12] step 4014/5000 loss 0.1802 (w 0.2601 mse 0.2546 t 889 new 0.22) lr 1.00e-05 gnorm 0.119 3.41s mem 81.1GB +[2026-09-14 13:47:15] step 4015/5000 loss 0.3760 (w 0.3206 mse 0.3187 t 375 new 0.12) lr 1.00e-05 gnorm 0.164 3.68s mem 81.1GB +[2026-09-14 13:47:18] step 4016/5000 loss 0.1493 (w 0.2974 mse 0.2869 t 964 new 0.20) lr 1.00e-05 gnorm 0.125 2.86s mem 81.1GB +[2026-09-14 13:47:21] step 4017/5000 loss 0.3064 (w 0.2283 mse 0.2168 t 942 new 0.23) lr 1.00e-05 gnorm 0.168 3.02s mem 81.1GB +[2026-09-14 13:47:25] step 4018/5000 loss 0.2804 (w 1.7631 mse 1.8379 t 996 new 0.27) lr 1.00e-05 gnorm 0.124 3.31s mem 81.1GB +[2026-09-14 13:47:28] step 4019/5000 loss 0.1284 (w 0.2366 mse 0.2273 t 950 new 0.20) lr 1.00e-05 gnorm 0.152 3.35s mem 81.1GB +[2026-09-14 13:47:31] step 4020/5000 loss 0.2226 (w 0.2917 mse 0.2835 t 894 new 0.21) lr 1.00e-05 gnorm 0.167 3.19s mem 81.1GB +[2026-09-14 13:47:35] step 4021/5000 loss 0.1816 (w 0.1392 mse 0.1357 t 873 new 0.24) lr 1.00e-05 gnorm 0.177 3.41s mem 81.1GB +[2026-09-14 13:47:38] step 4022/5000 loss 0.1194 (w 0.1312 mse 0.1438 t 962 new 0.27) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +[2026-09-14 13:47:41] step 4023/5000 loss 0.3155 (w 0.1652 mse 0.1614 t 603 new 0.19) lr 1.00e-05 gnorm 0.126 3.02s mem 81.1GB +[2026-09-14 13:47:44] step 4024/5000 loss 0.2863 (w 0.1815 mse 0.1890 t 500 new 0.08) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +[2026-09-14 13:47:47] step 4025/5000 loss 0.2332 (w 0.1134 mse 0.1058 t 883 new 0.16) lr 1.00e-05 gnorm 0.134 3.40s mem 81.1GB +[2026-09-14 13:47:50] step 4026/5000 loss 0.2773 (w 0.3931 mse 0.3892 t 995 new 0.19) lr 1.00e-05 gnorm 0.121 3.08s mem 81.1GB +[2026-09-14 13:47:53] step 4027/5000 loss 0.1326 (w 0.3376 mse 0.3070 t 961 new 0.24) lr 1.00e-05 gnorm 0.162 3.49s mem 81.1GB +[2026-09-14 13:47:56] step 4028/5000 loss 0.1620 (w 0.1090 mse 0.1278 t 633 new 0.17) lr 1.00e-05 gnorm 0.497 2.95s mem 81.1GB +[2026-09-14 13:48:00] step 4029/5000 loss 0.2372 (w 0.2536 mse 0.2435 t 718 new 0.14) lr 1.00e-05 gnorm 0.132 3.19s mem 81.1GB +[2026-09-14 13:48:03] step 4030/5000 loss 0.1401 (w 0.2645 mse 0.2626 t 980 new 0.19) lr 1.00e-05 gnorm 0.342 2.96s mem 81.1GB +[2026-09-14 13:48:06] step 4031/5000 loss 0.3733 (w 0.3528 mse 0.3615 t 356 new 0.18) lr 1.00e-05 gnorm 0.148 3.50s mem 81.1GB +[2026-09-14 13:48:10] step 4032/5000 loss 0.2193 (w 0.2813 mse 0.2639 t 958 new 0.22) lr 1.00e-05 gnorm 0.145 3.50s mem 81.1GB +[2026-09-14 13:48:14] step 4033/5000 loss 0.1717 (w 0.3029 mse 0.2911 t 941 new 0.17) lr 1.00e-05 gnorm 0.136 4.45s mem 81.1GB +[2026-09-14 13:48:20] step 4034/5000 loss 0.1552 (w 0.1155 mse 0.1155 t 742 new 0.00) lr 1.00e-05 gnorm 0.100 5.94s mem 81.1GB +[2026-09-14 13:48:26] step 4035/5000 loss 0.3611 (w 0.2590 mse 0.2507 t 659 new 0.20) lr 1.00e-05 gnorm 0.227 5.97s mem 81.1GB +[2026-09-14 13:48:32] step 4036/5000 loss 0.1461 (w 0.2761 mse 0.2829 t 974 new 0.17) lr 1.00e-05 gnorm 0.108 5.93s mem 81.1GB +[2026-09-14 13:48:38] step 4037/5000 loss 0.1844 (w 0.3508 mse 0.3382 t 954 new 0.26) lr 1.00e-05 gnorm 0.246 6.26s mem 81.1GB +[2026-09-14 13:48:44] step 4038/5000 loss 0.2367 (w 0.1787 mse 0.1717 t 930 new 0.17) lr 1.00e-05 gnorm 0.133 5.97s mem 81.1GB +[2026-09-14 13:48:50] step 4039/5000 loss 0.3179 (w 0.0951 mse 0.0873 t 424 new 0.16) lr 1.00e-05 gnorm 0.196 5.96s mem 81.1GB +[2026-09-14 13:48:56] step 4040/5000 loss 0.2579 (w 0.2751 mse 0.2569 t 844 new 0.22) lr 1.00e-05 gnorm 0.368 5.98s mem 81.1GB +[2026-09-14 13:49:00] step 4041/5000 loss 0.1686 (w 0.1397 mse 0.1401 t 977 new 0.22) lr 1.00e-05 gnorm 0.134 4.10s mem 81.1GB +[2026-09-14 13:49:03] step 4042/5000 loss 0.1865 (w 0.2670 mse 0.2687 t 979 new 0.21) lr 1.00e-05 gnorm 0.120 3.16s mem 81.1GB +[2026-09-14 13:49:06] step 4043/5000 loss 0.3796 (w 0.4713 mse 0.4764 t 259 new 0.15) lr 1.00e-05 gnorm 0.120 3.09s mem 81.1GB +[2026-09-14 13:49:10] step 4044/5000 loss 0.2394 (w 0.1882 mse 0.1948 t 424 new 0.27) lr 1.00e-05 gnorm 0.154 3.29s mem 81.1GB +[2026-09-14 13:49:13] step 4045/5000 loss 0.3387 (w 0.5203 mse 0.5235 t 212 new 0.22) lr 1.00e-05 gnorm 0.224 3.12s mem 81.1GB +[2026-09-14 13:49:16] step 4046/5000 loss 0.2651 (w 0.1321 mse 0.1261 t 768 new 0.10) lr 1.00e-05 gnorm 0.120 2.84s mem 81.1GB +[2026-09-14 13:49:19] step 4047/5000 loss 0.3042 (w 0.2548 mse 0.2521 t 609 new 0.19) lr 1.00e-05 gnorm 0.194 3.08s mem 81.1GB +[2026-09-14 13:49:22] step 4048/5000 loss 0.1511 (w 0.1688 mse 0.1632 t 979 new 0.15) lr 1.00e-05 gnorm 0.128 3.29s mem 81.1GB +[2026-09-14 13:49:25] step 4049/5000 loss 0.3066 (w 0.1179 mse 0.1177 t 821 new 0.22) lr 1.00e-05 gnorm 0.148 3.24s mem 81.1GB +[2026-09-14 13:49:28] step 4050/5000 loss 0.1029 (w 0.1665 mse 0.1748 t 867 new 0.20) lr 1.00e-05 gnorm 0.139 3.08s mem 81.1GB +[2026-09-14 13:49:32] step 4051/5000 loss 0.1179 (w 0.2417 mse 0.2188 t 965 new 0.21) lr 1.00e-05 gnorm 0.121 3.12s mem 81.1GB +[2026-09-14 13:49:35] step 4052/5000 loss 0.2105 (w 0.1405 mse 0.1457 t 962 new 0.15) lr 1.00e-05 gnorm 0.136 3.15s mem 81.1GB +[2026-09-14 13:49:38] step 4053/5000 loss 0.2055 (w 0.3706 mse 0.3542 t 977 new 0.16) lr 1.00e-05 gnorm 0.097 2.85s mem 81.1GB +[2026-09-14 13:49:41] step 4054/5000 loss 0.2142 (w 0.1128 mse 0.1209 t 969 new 0.09) lr 1.00e-05 gnorm 0.152 3.09s mem 81.1GB +[2026-09-14 13:49:44] step 4055/5000 loss 0.2523 (w 0.4530 mse 0.4851 t 1000 new 0.19) lr 1.00e-05 gnorm 0.117 3.13s mem 81.1GB +[2026-09-14 13:49:47] step 4056/5000 loss 0.1819 (w 0.1030 mse 0.1153 t 970 new 0.13) lr 1.00e-05 gnorm 0.158 3.58s mem 81.1GB +[2026-09-14 13:49:51] step 4057/5000 loss 0.2507 (w 0.2338 mse 0.2325 t 974 new 0.26) lr 1.00e-05 gnorm 0.135 3.67s mem 81.1GB +[2026-09-14 13:49:54] step 4058/5000 loss 0.2544 (w 0.1729 mse 0.1828 t 956 new 0.22) lr 1.00e-05 gnorm 0.126 3.10s mem 81.1GB +[2026-09-14 13:49:57] step 4059/5000 loss 0.1024 (w 0.2538 mse 0.2444 t 835 new 0.23) lr 1.00e-05 gnorm 0.149 2.86s mem 81.1GB +[2026-09-14 13:50:00] step 4060/5000 loss 0.1294 (w 0.2019 mse 0.1989 t 598 new 0.17) lr 1.00e-05 gnorm 0.122 3.17s mem 81.1GB +[2026-09-14 13:50:04] step 4061/5000 loss 0.2242 (w 0.1979 mse 0.1802 t 993 new 0.13) lr 1.00e-05 gnorm 0.157 3.42s mem 81.1GB +[2026-09-14 13:50:07] step 4062/5000 loss 0.2599 (w 0.1811 mse 0.1755 t 578 new 0.18) lr 1.00e-05 gnorm 0.169 3.17s mem 81.1GB +[2026-09-14 13:50:10] step 4063/5000 loss 0.1497 (w 0.1795 mse 0.1706 t 948 new 0.20) lr 1.00e-05 gnorm 0.150 3.61s mem 81.1GB +[2026-09-14 13:50:14] step 4064/5000 loss 0.3220 (w 0.2884 mse 0.2904 t 375 new 0.24) lr 1.00e-05 gnorm 0.114 3.80s mem 81.1GB +[2026-09-14 13:50:17] step 4065/5000 loss 0.3109 (w 0.2275 mse 0.2213 t 847 new 0.23) lr 1.00e-05 gnorm 0.286 3.16s mem 81.1GB +[2026-09-14 13:50:20] step 4066/5000 loss 0.4137 (w 0.0927 mse 0.0951 t 639 new 0.10) lr 1.00e-05 gnorm 0.117 3.16s mem 81.1GB +[2026-09-14 13:50:24] step 4067/5000 loss 0.2445 (w 0.1782 mse 0.1803 t 971 new 0.22) lr 1.00e-05 gnorm 0.106 3.30s mem 81.1GB +[2026-09-14 13:50:27] step 4068/5000 loss 0.2809 (w 0.0674 mse 0.0702 t 709 new 0.22) lr 1.00e-05 gnorm 0.137 3.26s mem 81.1GB +[2026-09-14 13:50:30] step 4069/5000 loss 0.2048 (w 0.2632 mse 0.2496 t 810 new 0.24) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +[2026-09-14 13:50:33] step 4070/5000 loss 0.2578 (w 0.1846 mse 0.1751 t 965 new 0.25) lr 1.00e-05 gnorm 0.102 3.09s mem 81.1GB +[2026-09-14 13:50:36] step 4071/5000 loss 0.1922 (w 0.2085 mse 0.2168 t 958 new 0.20) lr 1.00e-05 gnorm 0.122 2.85s mem 81.1GB +[2026-09-14 13:50:39] step 4072/5000 loss 0.1606 (w 0.2129 mse 0.2008 t 889 new 0.22) lr 1.00e-05 gnorm 0.173 3.31s mem 81.1GB +[2026-09-14 13:50:43] step 4073/5000 loss 0.1541 (w 0.1086 mse 0.1078 t 768 new 0.23) lr 1.00e-05 gnorm 0.241 3.13s mem 81.1GB +[2026-09-14 13:50:46] step 4074/5000 loss 0.1100 (w 0.1333 mse 0.1299 t 871 new 0.18) lr 1.00e-05 gnorm 0.111 3.26s mem 81.1GB +[2026-09-14 13:50:49] step 4075/5000 loss 0.1376 (w 0.1975 mse 0.2029 t 931 new 0.24) lr 1.00e-05 gnorm 0.145 2.82s mem 81.1GB +[2026-09-14 13:50:52] step 4076/5000 loss 0.2203 (w 0.2867 mse 0.2611 t 987 new 0.18) lr 1.00e-05 gnorm 0.137 3.64s mem 81.1GB +[2026-09-14 13:50:55] step 4077/5000 loss 0.2610 (w 0.2516 mse 0.2525 t 688 new 0.24) lr 1.00e-05 gnorm 0.159 2.85s mem 81.1GB +[2026-09-14 13:50:59] step 4078/5000 loss 0.2905 (w 0.3525 mse 0.3363 t 444 new 0.22) lr 1.00e-05 gnorm 0.253 3.45s mem 81.1GB +[2026-09-14 13:51:02] step 4079/5000 loss 0.2050 (w 0.1707 mse 0.1667 t 839 new 0.27) lr 1.00e-05 gnorm 0.144 3.34s mem 81.1GB +[2026-09-14 13:51:05] step 4080/5000 loss 0.3178 (w 0.3143 mse 0.3123 t 981 new 0.19) lr 1.00e-05 gnorm 0.127 3.21s mem 81.1GB +[2026-09-14 13:51:08] step 4081/5000 loss 0.2167 (w 0.1908 mse 0.1921 t 805 new 0.19) lr 1.00e-05 gnorm 0.111 2.95s mem 81.1GB +[2026-09-14 13:51:11] step 4082/5000 loss 0.2241 (w 0.1436 mse 0.1441 t 631 new 0.27) lr 1.00e-05 gnorm 0.158 3.12s mem 81.1GB +[2026-09-14 13:51:15] step 4083/5000 loss 0.2340 (w 0.5458 mse 0.5744 t 127 new 0.18) lr 1.00e-05 gnorm 0.108 3.13s mem 81.1GB +[2026-09-14 13:51:18] step 4084/5000 loss 0.2109 (w 0.1295 mse 0.1297 t 869 new 0.26) lr 1.00e-05 gnorm 0.132 3.36s mem 81.1GB +[2026-09-14 13:51:21] step 4085/5000 loss 0.3231 (w 0.3272 mse 0.3127 t 979 new 0.19) lr 1.00e-05 gnorm 0.135 3.11s mem 81.1GB +[2026-09-14 13:51:24] step 4086/5000 loss 0.2382 (w 0.3916 mse 0.3755 t 990 new 0.13) lr 1.00e-05 gnorm 0.158 3.05s mem 81.1GB +[2026-09-14 13:51:27] step 4087/5000 loss 0.1509 (w 0.1235 mse 0.1306 t 924 new 0.12) lr 1.00e-05 gnorm 0.105 2.96s mem 81.1GB +[2026-09-14 13:51:30] step 4088/5000 loss 0.2679 (w 0.2344 mse 0.2423 t 401 new 0.11) lr 1.00e-05 gnorm 0.187 3.30s mem 81.1GB +[2026-09-14 13:51:34] step 4089/5000 loss 0.2300 (w 0.2539 mse 0.2374 t 623 new 0.23) lr 1.00e-05 gnorm 0.124 3.33s mem 81.1GB +[2026-09-14 13:51:37] step 4090/5000 loss 0.3400 (w 0.2389 mse 0.2448 t 693 new 0.17) lr 1.00e-05 gnorm 0.147 3.28s mem 81.1GB +[2026-09-14 13:51:40] step 4091/5000 loss 0.1558 (w 0.3195 mse 0.3249 t 980 new 0.16) lr 1.00e-05 gnorm 0.202 3.24s mem 81.1GB +[2026-09-14 13:51:44] step 4092/5000 loss 0.2035 (w 0.2332 mse 0.2330 t 924 new 0.22) lr 1.00e-05 gnorm 0.146 4.24s mem 81.1GB +[2026-09-14 13:51:50] step 4093/5000 loss 0.2402 (w 0.1292 mse 0.1457 t 940 new 0.23) lr 1.00e-05 gnorm 0.156 6.05s mem 81.1GB +[2026-09-14 13:51:57] step 4094/5000 loss 0.0514 (w 0.2313 mse 0.2326 t 962 new 0.27) lr 1.00e-05 gnorm 0.089 6.67s mem 81.1GB +[2026-09-14 13:52:04] step 4095/5000 loss 0.2742 (w 0.2870 mse 0.2915 t 978 new 0.19) lr 1.00e-05 gnorm 0.140 6.34s mem 81.1GB +[2026-09-14 13:52:10] step 4096/5000 loss 0.3026 (w 0.3309 mse 0.3196 t 965 new 0.24) lr 1.00e-05 gnorm 0.140 6.21s mem 81.1GB +[2026-09-14 13:52:16] step 4097/5000 loss 0.3393 (w 0.4638 mse 0.4346 t 992 new 0.24) lr 1.00e-05 gnorm 0.116 6.36s mem 81.1GB +[2026-09-14 13:52:22] step 4098/5000 loss 0.3677 (w 0.1471 mse 0.1428 t 861 new 0.14) lr 1.00e-05 gnorm 0.135 6.34s mem 81.1GB +[2026-09-14 13:52:29] step 4099/5000 loss 0.2781 (w 0.1972 mse 0.1975 t 980 new 0.21) lr 1.00e-05 gnorm 0.111 6.38s mem 81.1GB +[2026-09-14 13:52:32] step 4100/5000 loss 0.2700 (w 0.1415 mse 0.1398 t 783 new 0.22) lr 1.00e-05 gnorm 0.130 3.25s mem 81.1GB +[2026-09-14 13:52:36] step 4101/5000 loss 0.1269 (w 0.2455 mse 0.2300 t 905 new 0.21) lr 1.00e-05 gnorm 0.103 3.43s mem 81.1GB +[2026-09-14 13:52:39] step 4102/5000 loss 0.3559 (w 0.3103 mse 0.2835 t 992 new 0.23) lr 1.00e-05 gnorm 0.118 3.16s mem 81.1GB +[2026-09-14 13:52:42] step 4103/5000 loss 0.3451 (w 0.2229 mse 0.2189 t 986 new 0.27) lr 1.00e-05 gnorm 0.112 3.63s mem 81.1GB +[2026-09-14 13:52:45] step 4104/5000 loss 0.3256 (w 0.2461 mse 0.2332 t 894 new 0.23) lr 1.00e-05 gnorm 0.112 3.10s mem 81.1GB +[2026-09-14 13:52:48] step 4105/5000 loss 0.3607 (w 0.1726 mse 0.1865 t 394 new 0.10) lr 1.00e-05 gnorm 0.166 2.85s mem 81.1GB +[2026-09-14 13:52:52] step 4106/5000 loss 0.1628 (w 0.3608 mse 0.3507 t 994 new 0.19) lr 1.00e-05 gnorm 0.126 3.26s mem 81.1GB +[2026-09-14 13:52:55] step 4107/5000 loss 0.2305 (w 0.1078 mse 0.1044 t 742 new 0.22) lr 1.00e-05 gnorm 0.320 3.37s mem 81.1GB +[2026-09-14 13:52:58] step 4108/5000 loss 0.2195 (w 0.2379 mse 0.2266 t 928 new 0.21) lr 1.00e-05 gnorm 0.131 3.47s mem 81.1GB +[2026-09-14 13:53:02] step 4109/5000 loss 0.2232 (w 0.1798 mse 0.1761 t 893 new 0.23) lr 1.00e-05 gnorm 0.110 3.15s mem 81.1GB +[2026-09-14 13:53:04] step 4110/5000 loss 0.2531 (w 0.1923 mse 0.1833 t 797 new 0.19) lr 1.00e-05 gnorm 0.153 2.86s mem 81.1GB +[2026-09-14 13:53:08] step 4111/5000 loss 0.1469 (w 0.2507 mse 0.2439 t 700 new 0.24) lr 1.00e-05 gnorm 0.118 3.03s mem 81.1GB +[2026-09-14 13:53:10] step 4112/5000 loss 0.2957 (w 0.2218 mse 0.2143 t 708 new 0.19) lr 1.00e-05 gnorm 0.152 2.87s mem 81.1GB +[2026-09-14 13:53:14] step 4113/5000 loss 0.1488 (w 0.1652 mse 0.1661 t 824 new 0.20) lr 1.00e-05 gnorm 0.117 3.50s mem 81.1GB +[2026-09-14 13:53:17] step 4114/5000 loss 0.2604 (w 0.1860 mse 0.1992 t 973 new 0.19) lr 1.00e-05 gnorm 0.179 3.36s mem 81.1GB +[2026-09-14 13:53:21] step 4115/5000 loss 0.1683 (w 0.1376 mse 0.1299 t 922 new 0.19) lr 1.00e-05 gnorm 0.150 4.14s mem 81.1GB +[2026-09-14 13:53:25] step 4116/5000 loss 0.2021 (w 0.1964 mse 0.2012 t 790 new 0.22) lr 1.00e-05 gnorm 0.447 3.54s mem 81.1GB +[2026-09-14 13:53:28] step 4117/5000 loss 0.2991 (w 0.1915 mse 0.1807 t 871 new 0.18) lr 1.00e-05 gnorm 0.141 3.07s mem 81.1GB +[2026-09-14 13:53:31] step 4118/5000 loss 0.2474 (w 0.1743 mse 0.1695 t 760 new 0.27) lr 1.00e-05 gnorm 0.144 2.86s mem 81.1GB +[2026-09-14 13:53:34] step 4119/5000 loss 0.1695 (w 0.1559 mse 0.1583 t 762 new 0.26) lr 1.00e-05 gnorm 0.234 3.15s mem 81.1GB +[2026-09-14 13:53:38] step 4120/5000 loss 0.2574 (w 0.1531 mse 0.1558 t 865 new 0.07) lr 1.00e-05 gnorm 0.121 3.43s mem 81.1GB +[2026-09-14 13:53:41] step 4121/5000 loss 0.0790 (w 0.2934 mse 0.3170 t 983 new 0.17) lr 1.00e-05 gnorm 0.179 3.61s mem 81.1GB +[2026-09-14 13:53:45] step 4122/5000 loss 0.1823 (w 0.2266 mse 0.2065 t 720 new 0.22) lr 1.00e-05 gnorm 0.227 4.00s mem 81.1GB +[2026-09-14 13:53:49] step 4123/5000 loss 0.3496 (w 0.2891 mse 0.2804 t 459 new 0.20) lr 1.00e-05 gnorm 0.261 3.65s mem 81.1GB +[2026-09-14 13:53:52] step 4124/5000 loss 0.2246 (w 0.0972 mse 0.0913 t 790 new 0.21) lr 1.00e-05 gnorm 0.134 3.28s mem 81.1GB +[2026-09-14 13:53:55] step 4125/5000 loss 0.1628 (w 0.2927 mse 0.2999 t 998 new 0.20) lr 1.00e-05 gnorm 0.153 3.35s mem 81.1GB +[2026-09-14 13:53:59] step 4126/5000 loss 0.1719 (w 0.0943 mse 0.0910 t 891 new 0.22) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +[2026-09-14 13:54:02] step 4127/5000 loss 0.0864 (w 0.1056 mse 0.1163 t 995 new 0.11) lr 1.00e-05 gnorm 0.121 3.37s mem 81.1GB +[2026-09-14 13:54:05] step 4128/5000 loss 0.3879 (w 0.2687 mse 0.2433 t 963 new 0.24) lr 1.00e-05 gnorm 0.175 2.84s mem 81.1GB +[2026-09-14 13:54:08] step 4129/5000 loss 0.3309 (w 0.3097 mse 0.2972 t 872 new 0.27) lr 1.00e-05 gnorm 0.140 3.06s mem 81.1GB +[2026-09-14 13:54:11] step 4130/5000 loss 0.2832 (w 0.3529 mse 0.4055 t 159 new 0.19) lr 1.00e-05 gnorm 0.126 3.16s mem 81.1GB +[2026-09-14 13:54:14] step 4131/5000 loss 0.1874 (w 0.2907 mse 0.2847 t 991 new 0.17) lr 1.00e-05 gnorm 0.958 3.15s mem 81.1GB +[2026-09-14 13:54:17] step 4132/5000 loss 0.4206 (w 0.2444 mse 0.2384 t 528 new 0.14) lr 1.00e-05 gnorm 0.132 3.08s mem 81.1GB +[2026-09-14 13:54:21] step 4133/5000 loss 0.2103 (w 0.3694 mse 0.3545 t 973 new 0.20) lr 1.00e-05 gnorm 0.129 3.35s mem 81.1GB +[2026-09-14 13:54:23] step 4134/5000 loss 0.2201 (w 0.1814 mse 0.1778 t 951 new 0.18) lr 1.00e-05 gnorm 0.140 2.83s mem 81.1GB +[2026-09-14 13:54:26] step 4135/5000 loss 0.1324 (w 0.4190 mse 0.4255 t 983 new 0.13) lr 1.00e-05 gnorm 0.457 3.06s mem 81.1GB +[2026-09-14 13:54:30] step 4136/5000 loss 0.1646 (w 0.1993 mse 0.1917 t 840 new 0.26) lr 1.00e-05 gnorm 0.157 3.14s mem 81.1GB +[2026-09-14 13:54:33] step 4137/5000 loss 0.2167 (w 0.3095 mse 0.3222 t 966 new 0.21) lr 1.00e-05 gnorm 0.163 3.13s mem 81.1GB +[2026-09-14 13:54:36] step 4138/5000 loss 0.1526 (w 0.3165 mse 0.2944 t 975 new 0.28) lr 1.00e-05 gnorm 0.148 3.10s mem 81.1GB +[2026-09-14 13:54:39] step 4139/5000 loss 0.3256 (w 0.2977 mse 0.2815 t 642 new 0.24) lr 1.00e-05 gnorm 0.145 3.08s mem 81.1GB +[2026-09-14 13:54:42] step 4140/5000 loss 0.2249 (w 0.1744 mse 0.1644 t 672 new 0.21) lr 1.00e-05 gnorm 0.174 3.02s mem 81.1GB +[2026-09-14 13:54:45] step 4141/5000 loss 0.2750 (w 0.1727 mse 0.1734 t 914 new 0.20) lr 1.00e-05 gnorm 0.227 2.84s mem 81.1GB +[2026-09-14 13:54:48] step 4142/5000 loss 0.2181 (w 0.2228 mse 0.2250 t 495 new 0.13) lr 1.00e-05 gnorm 0.142 3.46s mem 81.1GB +[2026-09-14 13:54:52] step 4143/5000 loss 0.1667 (w 0.0887 mse 0.0974 t 935 new 0.13) lr 1.00e-05 gnorm 0.245 3.32s mem 81.1GB +[2026-09-14 13:54:55] step 4144/5000 loss 0.2164 (w 0.1456 mse 0.1492 t 807 new 0.25) lr 1.00e-05 gnorm 0.161 3.31s mem 81.1GB +[2026-09-14 13:54:58] step 4145/5000 loss 0.2459 (w 0.2153 mse 0.2087 t 688 new 0.25) lr 1.00e-05 gnorm 0.177 3.10s mem 81.1GB +[2026-09-14 13:55:01] step 4146/5000 loss 0.2760 (w 0.1910 mse 0.1773 t 871 new 0.19) lr 1.00e-05 gnorm 0.124 3.03s mem 81.1GB +[2026-09-14 13:55:04] step 4147/5000 loss 0.1611 (w 0.2734 mse 0.2662 t 490 new 0.25) lr 1.00e-05 gnorm 0.125 2.83s mem 81.1GB +[2026-09-14 13:55:07] step 4148/5000 loss 0.1449 (w 0.1985 mse 0.2151 t 788 new 0.21) lr 1.00e-05 gnorm 0.149 3.31s mem 81.1GB +[2026-09-14 13:55:10] step 4149/5000 loss 0.2203 (w 0.2592 mse 0.2482 t 800 new 0.22) lr 1.00e-05 gnorm 0.125 3.14s mem 81.1GB +[2026-09-14 13:55:13] step 4150/5000 loss 0.2367 (w 0.2541 mse 0.2610 t 865 new 0.17) lr 1.00e-05 gnorm 0.156 3.08s mem 81.1GB +[2026-09-14 13:55:17] step 4151/5000 loss 0.2103 (w 0.2121 mse 0.2024 t 645 new 0.22) lr 1.00e-05 gnorm 0.160 3.12s mem 81.1GB +[2026-09-14 13:55:20] step 4152/5000 loss 0.2443 (w 0.4692 mse 0.4717 t 999 new 0.17) lr 1.00e-05 gnorm 0.120 3.04s mem 81.1GB +[2026-09-14 13:55:22] step 4153/5000 loss 0.1948 (w 0.3203 mse 0.3022 t 984 new 0.20) lr 1.00e-05 gnorm 0.115 2.83s mem 81.1GB +[2026-09-14 13:55:26] step 4154/5000 loss 0.2704 (w 0.2542 mse 0.2495 t 937 new 0.22) lr 1.00e-05 gnorm 0.164 3.45s mem 81.1GB +[2026-09-14 13:55:29] step 4155/5000 loss 0.3343 (w 0.3182 mse 0.3123 t 306 new 0.17) lr 1.00e-05 gnorm 0.144 3.09s mem 81.1GB +[2026-09-14 13:55:32] step 4156/5000 loss 0.1910 (w 0.2746 mse 0.2547 t 984 new 0.23) lr 1.00e-05 gnorm 0.111 3.07s mem 81.1GB +[2026-09-14 13:55:35] step 4157/5000 loss 0.2545 (w 0.2239 mse 0.2267 t 946 new 0.18) lr 1.00e-05 gnorm 0.164 3.13s mem 81.1GB +[2026-09-14 13:55:38] step 4158/5000 loss 0.1883 (w 0.3154 mse 0.2846 t 948 new 0.18) lr 1.00e-05 gnorm 0.771 3.01s mem 81.1GB +[2026-09-14 13:55:41] step 4159/5000 loss 0.1974 (w 0.0624 mse 0.0732 t 840 new 0.18) lr 1.00e-05 gnorm 0.127 3.05s mem 81.1GB +[2026-09-14 13:55:44] step 4160/5000 loss 0.2113 (w 0.2112 mse 0.2008 t 729 new 0.20) lr 1.00e-05 gnorm 0.191 3.12s mem 81.1GB +[2026-09-14 13:55:47] step 4161/5000 loss 0.1892 (w 0.2404 mse 0.2185 t 972 new 0.20) lr 1.00e-05 gnorm 0.163 3.02s mem 81.1GB +[2026-09-14 13:55:50] step 4162/5000 loss 0.2820 (w 0.3827 mse 0.3677 t 988 new 0.21) lr 1.00e-05 gnorm 0.166 3.09s mem 81.1GB +[2026-09-14 13:55:54] step 4163/5000 loss 0.3365 (w 0.2651 mse 0.2653 t 966 new 0.20) lr 1.00e-05 gnorm 0.146 3.13s mem 81.1GB +[2026-09-14 13:55:57] step 4164/5000 loss 0.1485 (w 0.3075 mse 0.3161 t 977 new 0.05) lr 1.00e-05 gnorm 0.173 3.02s mem 81.1GB +[2026-09-14 13:56:00] step 4165/5000 loss 0.2020 (w 0.2174 mse 0.2199 t 508 new 0.07) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +[2026-09-14 13:56:03] step 4166/5000 loss 0.2153 (w 0.1894 mse 0.1762 t 599 new 0.20) lr 1.00e-05 gnorm 0.178 3.37s mem 81.1GB +[2026-09-14 13:56:06] step 4167/5000 loss 0.1335 (w 0.3029 mse 0.3062 t 935 new 0.18) lr 1.00e-05 gnorm 0.150 3.43s mem 81.1GB +[2026-09-14 13:56:10] step 4168/5000 loss 0.4044 (w 0.3088 mse 0.2976 t 555 new 0.22) lr 1.00e-05 gnorm 0.155 3.14s mem 81.1GB +[2026-09-14 13:56:13] step 4169/5000 loss 0.2622 (w 0.0643 mse 0.0705 t 837 new 0.14) lr 1.00e-05 gnorm 0.139 3.07s mem 81.1GB +[2026-09-14 13:56:16] step 4170/5000 loss 0.2815 (w 0.1681 mse 0.1617 t 947 new 0.17) lr 1.00e-05 gnorm 0.130 3.07s mem 81.1GB +[2026-09-14 13:56:19] step 4171/5000 loss 0.1850 (w 0.1698 mse 0.1697 t 506 new 0.00) lr 1.00e-05 gnorm 0.208 3.13s mem 81.1GB +[2026-09-14 13:56:22] step 4172/5000 loss 0.1127 (w 0.1106 mse 0.1209 t 774 new 0.17) lr 1.00e-05 gnorm 0.199 3.07s mem 81.1GB +[2026-09-14 13:56:25] step 4173/5000 loss 0.2981 (w 0.6638 mse 0.6623 t 159 new 0.21) lr 1.00e-05 gnorm 0.170 3.09s mem 81.1GB +[2026-09-14 13:56:28] step 4174/5000 loss 0.1685 (w 0.2188 mse 0.2057 t 927 new 0.16) lr 1.00e-05 gnorm 0.144 2.84s mem 81.1GB +[2026-09-14 13:56:31] step 4175/5000 loss 0.3178 (w 0.1840 mse 0.1741 t 802 new 0.22) lr 1.00e-05 gnorm 0.167 3.12s mem 81.1GB +[2026-09-14 13:56:34] step 4176/5000 loss 0.2810 (w 0.1696 mse 0.1764 t 737 new 0.21) lr 1.00e-05 gnorm 0.123 3.13s mem 81.1GB +[2026-09-14 13:56:38] step 4177/5000 loss 0.3114 (w 0.2224 mse 0.2144 t 386 new 0.24) lr 1.00e-05 gnorm 0.146 3.28s mem 81.1GB +[2026-09-14 13:56:41] step 4178/5000 loss 0.2120 (w 0.3797 mse 0.3478 t 1000 new 0.17) lr 1.00e-05 gnorm 0.165 3.38s mem 81.1GB +[2026-09-14 13:56:44] step 4179/5000 loss 0.1748 (w 0.1505 mse 0.1647 t 920 new 0.25) lr 1.00e-05 gnorm 0.132 3.13s mem 81.1GB +[2026-09-14 13:56:47] step 4180/5000 loss 0.2008 (w 0.2386 mse 0.2276 t 909 new 0.21) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +[2026-09-14 13:56:50] step 4181/5000 loss 0.1732 (w 0.1806 mse 0.1749 t 805 new 0.21) lr 1.00e-05 gnorm 0.130 2.83s mem 81.1GB +[2026-09-14 13:56:54] step 4182/5000 loss 0.2200 (w 0.2747 mse 0.2650 t 930 new 0.17) lr 1.00e-05 gnorm 0.157 3.36s mem 81.1GB +[2026-09-14 13:56:57] step 4183/5000 loss 0.1940 (w 0.2259 mse 0.2205 t 935 new 0.23) lr 1.00e-05 gnorm 0.213 3.06s mem 81.1GB +[2026-09-14 13:57:00] step 4184/5000 loss 0.1460 (w 0.3196 mse 0.3190 t 970 new 0.21) lr 1.00e-05 gnorm 0.126 3.38s mem 81.1GB +[2026-09-14 13:57:03] step 4185/5000 loss 0.1835 (w 0.3164 mse 0.3176 t 411 new 0.13) lr 1.00e-05 gnorm 0.121 3.07s mem 81.1GB +[2026-09-14 13:57:06] step 4186/5000 loss 0.2217 (w 0.1954 mse 0.1852 t 790 new 0.20) lr 1.00e-05 gnorm 0.124 3.14s mem 81.1GB +[2026-09-14 13:57:09] step 4187/5000 loss 0.1657 (w 0.2610 mse 0.2407 t 854 new 0.25) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +[2026-09-14 13:57:12] step 4188/5000 loss 0.1086 (w 0.1580 mse 0.1550 t 990 new 0.14) lr 1.00e-05 gnorm 0.127 3.33s mem 81.1GB +[2026-09-14 13:57:15] step 4189/5000 loss 0.1322 (w 0.0469 mse 0.0476 t 834 new 0.11) lr 1.00e-05 gnorm 0.109 3.13s mem 81.1GB +[2026-09-14 13:57:19] step 4190/5000 loss 0.2759 (w 0.1572 mse 0.1606 t 945 new 0.20) lr 1.00e-05 gnorm 0.154 3.10s mem 81.1GB +[2026-09-14 13:57:22] step 4191/5000 loss 0.2648 (w 0.2483 mse 0.2358 t 594 new 0.22) lr 1.00e-05 gnorm 0.140 3.10s mem 81.1GB +[2026-09-14 13:57:25] step 4192/5000 loss 0.1946 (w 0.2078 mse 0.1979 t 816 new 0.23) lr 1.00e-05 gnorm 0.188 3.13s mem 81.1GB +[2026-09-14 13:57:28] step 4193/5000 loss 0.1502 (w 0.2867 mse 0.2700 t 939 new 0.18) lr 1.00e-05 gnorm 0.120 3.02s mem 81.1GB +[2026-09-14 13:57:31] step 4194/5000 loss 0.2833 (w 0.1263 mse 0.1280 t 957 new 0.18) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-14 13:57:34] step 4195/5000 loss 0.1699 (w 0.1836 mse 0.1736 t 836 new 0.22) lr 1.00e-05 gnorm 0.257 3.13s mem 81.1GB +[2026-09-14 13:57:37] step 4196/5000 loss 0.1934 (w 0.2016 mse 0.1900 t 930 new 0.22) lr 1.00e-05 gnorm 0.128 3.37s mem 81.1GB +[2026-09-14 13:57:41] step 4197/5000 loss 0.1364 (w 0.3426 mse 0.3511 t 980 new 0.17) lr 1.00e-05 gnorm 0.205 3.05s mem 81.1GB +[2026-09-14 13:57:44] step 4198/5000 loss 0.2357 (w 0.1943 mse 0.1977 t 465 new 0.20) lr 1.00e-05 gnorm 0.135 2.85s mem 81.1GB +[2026-09-14 13:57:47] step 4199/5000 loss 0.2076 (w 0.1198 mse 0.1206 t 708 new 0.14) lr 1.00e-05 gnorm 0.173 3.09s mem 81.1GB +[2026-09-14 13:57:50] step 4200/5000 loss 0.1290 (w 0.2825 mse 0.2798 t 987 new 0.21) lr 1.00e-05 gnorm 0.100 3.13s mem 81.1GB +[2026-09-14 13:57:53] step 4201/5000 loss 0.2958 (w 0.7337 mse 0.7539 t 107 new 0.21) lr 1.00e-05 gnorm 0.151 3.35s mem 81.1GB +[2026-09-14 13:57:56] step 4202/5000 loss 0.1076 (w 0.2256 mse 0.2171 t 884 new 0.12) lr 1.00e-05 gnorm 0.139 3.06s mem 81.1GB +[2026-09-14 13:57:59] step 4203/5000 loss 0.1294 (w 0.1259 mse 0.1272 t 896 new 0.23) lr 1.00e-05 gnorm 0.204 3.09s mem 81.1GB +[2026-09-14 13:58:02] step 4204/5000 loss 0.2622 (w 0.4391 mse 0.4269 t 993 new 0.21) lr 1.00e-05 gnorm 0.187 3.04s mem 81.1GB +[2026-09-14 13:58:05] step 4205/5000 loss 0.1740 (w 0.7176 mse 0.7011 t 997 new 0.23) lr 1.00e-05 gnorm 0.111 3.01s mem 81.1GB +[2026-09-14 13:58:08] step 4206/5000 loss 0.3232 (w 0.1360 mse 0.1371 t 734 new 0.18) lr 1.00e-05 gnorm 0.141 3.06s mem 81.1GB +[2026-09-14 13:58:12] step 4207/5000 loss 0.1441 (w 0.4750 mse 0.4850 t 993 new 0.20) lr 1.00e-05 gnorm 0.303 3.33s mem 81.1GB +[2026-09-14 13:58:15] step 4208/5000 loss 0.2693 (w 0.1421 mse 0.1428 t 1000 new 0.18) lr 1.00e-05 gnorm 0.146 3.09s mem 81.1GB +[2026-09-14 13:58:18] step 4209/5000 loss 0.0956 (w 0.1918 mse 0.1741 t 840 new 0.21) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +[2026-09-14 13:58:21] step 4210/5000 loss 0.2926 (w 0.2856 mse 0.2679 t 963 new 0.26) lr 1.00e-05 gnorm 0.140 3.08s mem 81.1GB +[2026-09-14 13:58:24] step 4211/5000 loss 0.1813 (w 0.2206 mse 0.2082 t 920 new 0.16) lr 1.00e-05 gnorm 0.155 3.03s mem 81.1GB +[2026-09-14 13:58:27] step 4212/5000 loss 0.2771 (w 0.2139 mse 0.2002 t 860 new 0.21) lr 1.00e-05 gnorm 0.288 3.34s mem 81.1GB +[2026-09-14 13:58:30] step 4213/5000 loss 0.2193 (w 0.4917 mse 0.4917 t 996 new 0.20) lr 1.00e-05 gnorm 0.174 3.37s mem 81.1GB +[2026-09-14 13:58:34] step 4214/5000 loss 0.2086 (w 0.2630 mse 0.2646 t 979 new 0.13) lr 1.00e-05 gnorm 0.123 3.40s mem 81.1GB +[2026-09-14 13:58:37] step 4215/5000 loss 0.1027 (w 0.1714 mse 0.1574 t 902 new 0.21) lr 1.00e-05 gnorm 0.164 2.84s mem 81.1GB +[2026-09-14 13:58:40] step 4216/5000 loss 0.2278 (w 0.1685 mse 0.1620 t 875 new 0.22) lr 1.00e-05 gnorm 0.158 3.06s mem 81.1GB +[2026-09-14 13:58:43] step 4217/5000 loss 0.3382 (w 0.3587 mse 0.3613 t 259 new 0.22) lr 1.00e-05 gnorm 0.178 3.35s mem 81.1GB +[2026-09-14 13:58:46] step 4218/5000 loss 0.3968 (w 0.4495 mse 0.4435 t 297 new 0.23) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +[2026-09-14 13:58:49] step 4219/5000 loss 0.2094 (w 0.2250 mse 0.2267 t 911 new 0.18) lr 1.00e-05 gnorm 0.131 3.10s mem 81.1GB +[2026-09-14 13:58:53] step 4220/5000 loss 0.2256 (w 0.2855 mse 0.2829 t 490 new 0.19) lr 1.00e-05 gnorm 0.212 3.30s mem 81.1GB +[2026-09-14 13:58:55] step 4221/5000 loss 0.3206 (w 0.0747 mse 0.0744 t 868 new 0.17) lr 1.00e-05 gnorm 0.160 2.83s mem 81.1GB +[2026-09-14 13:58:59] step 4222/5000 loss 0.1809 (w 0.3663 mse 0.3512 t 998 new 0.22) lr 1.00e-05 gnorm 0.150 3.08s mem 81.1GB +[2026-09-14 13:59:02] step 4223/5000 loss 0.3520 (w 0.3310 mse 0.3362 t 997 new 0.20) lr 1.00e-05 gnorm 0.133 3.25s mem 81.1GB +[2026-09-14 13:59:05] step 4224/5000 loss 0.1635 (w 0.1764 mse 0.1598 t 865 new 0.23) lr 1.00e-05 gnorm 0.153 3.12s mem 81.1GB +[2026-09-14 13:59:08] step 4225/5000 loss 0.1823 (w 0.1365 mse 0.1284 t 861 new 0.21) lr 1.00e-05 gnorm 0.140 3.12s mem 81.1GB +[2026-09-14 13:59:11] step 4226/5000 loss 0.1325 (w 0.2402 mse 0.2230 t 278 new 0.27) lr 1.00e-05 gnorm 0.091 3.13s mem 81.1GB +[2026-09-14 13:59:14] step 4227/5000 loss 0.1020 (w 0.3436 mse 0.3511 t 997 new 0.10) lr 1.00e-05 gnorm 0.122 3.07s mem 81.1GB +[2026-09-14 13:59:17] step 4228/5000 loss 0.1715 (w 0.1193 mse 0.1329 t 917 new 0.18) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +[2026-09-14 13:59:20] step 4229/5000 loss 0.2909 (w 0.2150 mse 0.2079 t 937 new 0.17) lr 1.00e-05 gnorm 0.149 3.25s mem 81.1GB +[2026-09-14 13:59:24] step 4230/5000 loss 0.3897 (w 0.3288 mse 0.3010 t 911 new 0.25) lr 1.00e-05 gnorm 0.149 3.42s mem 81.1GB +[2026-09-14 13:59:27] step 4231/5000 loss 0.2264 (w 0.1565 mse 0.1658 t 704 new 0.19) lr 1.00e-05 gnorm 0.173 3.31s mem 81.1GB +[2026-09-14 13:59:30] step 4232/5000 loss 0.3431 (w 0.2823 mse 0.2832 t 421 new 0.21) lr 1.00e-05 gnorm 0.142 3.07s mem 81.1GB +[2026-09-14 13:59:33] step 4233/5000 loss 0.2802 (w 0.2823 mse 0.2740 t 715 new 0.19) lr 1.00e-05 gnorm 0.125 3.06s mem 81.1GB +[2026-09-14 13:59:36] step 4234/5000 loss 0.2374 (w 0.2249 mse 0.2267 t 976 new 0.14) lr 1.00e-05 gnorm 0.135 2.82s mem 81.1GB +[2026-09-14 13:59:39] step 4235/5000 loss 0.1039 (w 0.3217 mse 0.3042 t 990 new 0.23) lr 1.00e-05 gnorm 0.157 3.29s mem 81.1GB +[2026-09-14 13:59:42] step 4236/5000 loss 0.1788 (w 0.1382 mse 0.1421 t 839 new 0.17) lr 1.00e-05 gnorm 0.709 3.12s mem 81.1GB +[2026-09-14 13:59:46] step 4237/5000 loss 0.1756 (w 0.1968 mse 0.1948 t 726 new 0.14) lr 1.00e-05 gnorm 0.144 3.29s mem 81.1GB +[2026-09-14 13:59:49] step 4238/5000 loss 0.1245 (w 0.1801 mse 0.1698 t 906 new 0.23) lr 1.00e-05 gnorm 0.145 3.07s mem 81.1GB +[2026-09-14 13:59:52] step 4239/5000 loss 0.2372 (w 0.3191 mse 0.3122 t 980 new 0.25) lr 1.00e-05 gnorm 0.134 3.06s mem 81.1GB +[2026-09-14 13:59:55] step 4240/5000 loss 0.1551 (w 0.2926 mse 0.3156 t 315 new 0.14) lr 1.00e-05 gnorm 0.195 3.02s mem 81.1GB +[2026-09-14 13:59:58] step 4241/5000 loss 0.1881 (w 0.2652 mse 0.2686 t 508 new 0.18) lr 1.00e-05 gnorm 0.135 3.08s mem 81.1GB +[2026-09-14 14:00:01] step 4242/5000 loss 0.3351 (w 0.1540 mse 0.1636 t 969 new 0.11) lr 1.00e-05 gnorm 0.139 3.16s mem 81.1GB +[2026-09-14 14:00:04] step 4243/5000 loss 0.2025 (w 0.2158 mse 0.2157 t 715 new 0.22) lr 1.00e-05 gnorm 0.141 3.12s mem 81.1GB +[2026-09-14 14:00:07] step 4244/5000 loss 0.1478 (w 0.3188 mse 0.2916 t 930 new 0.22) lr 1.00e-05 gnorm 0.119 3.15s mem 81.1GB +[2026-09-14 14:00:11] step 4245/5000 loss 0.2804 (w 0.1911 mse 0.1916 t 947 new 0.20) lr 1.00e-05 gnorm 0.159 3.09s mem 81.1GB +[2026-09-14 14:00:14] step 4246/5000 loss 0.1983 (w 0.3528 mse 0.3515 t 973 new 0.27) lr 1.00e-05 gnorm 0.139 3.03s mem 81.1GB +[2026-09-14 14:00:17] step 4247/5000 loss 0.2416 (w 0.2687 mse 0.2547 t 953 new 0.16) lr 1.00e-05 gnorm 0.142 3.14s mem 81.1GB +[2026-09-14 14:00:20] step 4248/5000 loss 0.1998 (w 0.1282 mse 0.1349 t 765 new 0.23) lr 1.00e-05 gnorm 0.111 3.10s mem 81.1GB +[2026-09-14 14:00:23] step 4249/5000 loss 0.0915 (w 0.2540 mse 0.2369 t 940 new 0.24) lr 1.00e-05 gnorm 0.100 3.11s mem 81.1GB +[2026-09-14 14:00:26] step 4250/5000 loss 0.2375 (w 0.2347 mse 0.2289 t 954 new 0.23) lr 1.00e-05 gnorm 0.131 3.06s mem 81.1GB +[2026-09-14 14:00:29] step 4251/5000 loss 0.2495 (w 0.1774 mse 0.1810 t 939 new 0.11) lr 1.00e-05 gnorm 0.207 3.12s mem 81.1GB +[2026-09-14 14:00:32] step 4252/5000 loss 0.1657 (w 0.2528 mse 0.2471 t 948 new 0.23) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +[2026-09-14 14:00:35] step 4253/5000 loss 0.2205 (w 0.2136 mse 0.2222 t 348 new 0.17) lr 1.00e-05 gnorm 0.146 3.09s mem 81.1GB +[2026-09-14 14:00:38] step 4254/5000 loss 0.2701 (w 0.2564 mse 0.2502 t 854 new 0.16) lr 1.00e-05 gnorm 0.136 3.02s mem 81.1GB +[2026-09-14 14:00:41] step 4255/5000 loss 0.2277 (w 0.1904 mse 0.1979 t 986 new 0.26) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +[2026-09-14 14:00:44] step 4256/5000 loss 0.1204 (w 0.2764 mse 0.2708 t 839 new 0.22) lr 1.00e-05 gnorm 0.189 3.09s mem 81.1GB +[2026-09-14 14:00:47] step 4257/5000 loss 0.1823 (w 0.2305 mse 0.2046 t 799 new 0.21) lr 1.00e-05 gnorm 0.159 3.06s mem 81.1GB +[2026-09-14 14:00:51] step 4258/5000 loss 0.4014 (w 0.2843 mse 0.2665 t 710 new 0.26) lr 1.00e-05 gnorm 0.201 3.02s mem 81.1GB +[2026-09-14 14:00:54] step 4259/5000 loss 0.1653 (w 0.2617 mse 0.2496 t 670 new 0.19) lr 1.00e-05 gnorm 0.119 3.40s mem 81.1GB +[2026-09-14 14:00:57] step 4260/5000 loss 0.2172 (w 0.1955 mse 0.1901 t 898 new 0.23) lr 1.00e-05 gnorm 0.199 3.07s mem 81.1GB +[2026-09-14 14:01:00] step 4261/5000 loss 0.3835 (w 0.1563 mse 0.1537 t 951 new 0.15) lr 1.00e-05 gnorm 0.189 3.08s mem 81.1GB +[2026-09-14 14:01:03] step 4262/5000 loss 0.1387 (w 0.3004 mse 0.2744 t 951 new 0.25) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +[2026-09-14 14:01:06] step 4263/5000 loss 0.2758 (w 0.1356 mse 0.1356 t 916 new 0.00) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +[2026-09-14 14:01:09] step 4264/5000 loss 0.2541 (w 0.2767 mse 0.2681 t 895 new 0.17) lr 1.00e-05 gnorm 0.210 3.08s mem 81.1GB +[2026-09-14 14:01:13] step 4265/5000 loss 0.3609 (w 0.2185 mse 0.2128 t 763 new 0.13) lr 1.00e-05 gnorm 0.235 3.14s mem 81.1GB +[2026-09-14 14:01:16] step 4266/5000 loss 0.2135 (w 0.3057 mse 0.2877 t 988 new 0.22) lr 1.00e-05 gnorm 0.163 3.39s mem 81.1GB +[2026-09-14 14:01:19] step 4267/5000 loss 0.2386 (w 0.2546 mse 0.2448 t 767 new 0.23) lr 1.00e-05 gnorm 0.151 3.14s mem 81.1GB +[2026-09-14 14:01:22] step 4268/5000 loss 0.2443 (w 0.1720 mse 0.1693 t 942 new 0.09) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-14 14:01:25] step 4269/5000 loss 0.1944 (w 0.2134 mse 0.2307 t 963 new 0.19) lr 1.00e-05 gnorm 0.127 2.83s mem 81.1GB +[2026-09-14 14:01:28] step 4270/5000 loss 0.2479 (w 0.1930 mse 0.1899 t 778 new 0.23) lr 1.00e-05 gnorm 0.311 2.82s mem 81.1GB +[2026-09-14 14:01:31] step 4271/5000 loss 0.2415 (w 0.2705 mse 0.2549 t 653 new 0.23) lr 1.00e-05 gnorm 0.131 3.09s mem 81.1GB +[2026-09-14 14:01:34] step 4272/5000 loss 0.1519 (w 0.2529 mse 0.2425 t 973 new 0.24) lr 1.00e-05 gnorm 0.146 3.27s mem 81.1GB +[2026-09-14 14:01:37] step 4273/5000 loss 0.1555 (w 0.1393 mse 0.1410 t 894 new 0.24) lr 1.00e-05 gnorm 0.112 3.03s mem 81.1GB +[2026-09-14 14:01:40] step 4274/5000 loss 0.2069 (w 0.1483 mse 0.1431 t 724 new 0.15) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +[2026-09-14 14:01:44] step 4275/5000 loss 0.2138 (w 0.3820 mse 0.3628 t 978 new 0.24) lr 1.00e-05 gnorm 0.172 3.10s mem 81.1GB +[2026-09-14 14:01:47] step 4276/5000 loss 0.2776 (w 0.1769 mse 0.1700 t 779 new 0.25) lr 1.00e-05 gnorm 0.229 3.13s mem 81.1GB +[2026-09-14 14:01:50] step 4277/5000 loss 0.2050 (w 0.2122 mse 0.1983 t 857 new 0.22) lr 1.00e-05 gnorm 0.455 3.12s mem 81.1GB +[2026-09-14 14:01:53] step 4278/5000 loss 0.3957 (w 0.1043 mse 0.1143 t 804 new 0.16) lr 1.00e-05 gnorm 0.121 3.33s mem 81.1GB +[2026-09-14 14:01:56] step 4279/5000 loss 0.2412 (w 0.1522 mse 0.1534 t 933 new 0.19) lr 1.00e-05 gnorm 0.147 3.12s mem 81.1GB +[2026-09-14 14:01:59] step 4280/5000 loss 0.3640 (w 0.1229 mse 0.1253 t 683 new 0.18) lr 1.00e-05 gnorm 0.114 3.11s mem 81.1GB +[2026-09-14 14:02:02] step 4281/5000 loss 0.1347 (w 0.1743 mse 0.1630 t 965 new 0.26) lr 1.00e-05 gnorm 0.197 3.12s mem 81.1GB +[2026-09-14 14:02:06] step 4282/5000 loss 0.1265 (w 0.3394 mse 0.3214 t 985 new 0.21) lr 1.00e-05 gnorm 0.439 3.20s mem 81.1GB +[2026-09-14 14:02:09] step 4283/5000 loss 0.2553 (w 0.2623 mse 0.2551 t 683 new 0.16) lr 1.00e-05 gnorm 0.186 3.06s mem 81.1GB +[2026-09-14 14:02:12] step 4284/5000 loss 0.1879 (w 0.6383 mse 0.6374 t 989 new 0.19) lr 1.00e-05 gnorm 0.142 3.07s mem 81.1GB +[2026-09-14 14:02:15] step 4285/5000 loss 0.2595 (w 0.2062 mse 0.1997 t 598 new 0.09) lr 1.00e-05 gnorm 0.200 3.10s mem 81.1GB +[2026-09-14 14:02:18] step 4286/5000 loss 0.1012 (w 0.2047 mse 0.1964 t 926 new 0.20) lr 1.00e-05 gnorm 0.335 3.13s mem 81.1GB +[2026-09-14 14:02:21] step 4287/5000 loss 0.1614 (w 0.4171 mse 0.3972 t 994 new 0.19) lr 1.00e-05 gnorm 0.179 3.03s mem 81.1GB +[2026-09-14 14:02:24] step 4288/5000 loss 0.3647 (w 0.2043 mse 0.2173 t 942 new 0.16) lr 1.00e-05 gnorm 0.154 3.15s mem 81.1GB +[2026-09-14 14:02:27] step 4289/5000 loss 0.1270 (w 0.4033 mse 0.3645 t 970 new 0.19) lr 1.00e-05 gnorm 0.176 3.04s mem 81.1GB +[2026-09-14 14:02:30] step 4290/5000 loss 0.2156 (w 0.1914 mse 0.1888 t 940 new 0.25) lr 1.00e-05 gnorm 0.165 3.05s mem 81.1GB +[2026-09-14 14:02:33] step 4291/5000 loss 0.1532 (w 0.2320 mse 0.2167 t 817 new 0.20) lr 1.00e-05 gnorm 0.122 3.08s mem 81.1GB +[2026-09-14 14:02:37] step 4292/5000 loss 0.3313 (w 0.1409 mse 0.1355 t 663 new 0.26) lr 1.00e-05 gnorm 0.158 3.11s mem 81.1GB +[2026-09-14 14:02:40] step 4293/5000 loss 0.1755 (w 0.3600 mse 0.3952 t 177 new 0.23) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +[2026-09-14 14:02:43] step 4294/5000 loss 0.3072 (w 0.0908 mse 0.1010 t 741 new 0.18) lr 1.00e-05 gnorm 0.139 3.13s mem 81.1GB +[2026-09-14 14:02:46] step 4295/5000 loss 0.1323 (w 0.2895 mse 0.3010 t 976 new 0.22) lr 1.00e-05 gnorm 0.101 3.03s mem 81.1GB +[2026-09-14 14:02:49] step 4296/5000 loss 0.1897 (w 0.1297 mse 0.1342 t 861 new 0.26) lr 1.00e-05 gnorm 0.164 3.10s mem 81.1GB +[2026-09-14 14:02:52] step 4297/5000 loss 0.3216 (w 0.9631 mse 1.0420 t 998 new 0.18) lr 1.00e-05 gnorm 0.142 3.34s mem 81.1GB +[2026-09-14 14:02:55] step 4298/5000 loss 0.1365 (w 0.1390 mse 0.1484 t 775 new 0.25) lr 1.00e-05 gnorm 0.143 2.83s mem 81.1GB +[2026-09-14 14:02:58] step 4299/5000 loss 0.2699 (w 0.2465 mse 0.2333 t 904 new 0.22) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +[2026-09-14 14:03:02] step 4300/5000 loss 0.1489 (w 0.1810 mse 0.1745 t 882 new 0.19) lr 1.00e-05 gnorm 0.414 3.34s mem 81.1GB +[2026-09-14 14:03:05] step 4301/5000 loss 0.2146 (w 0.1280 mse 0.1375 t 907 new 0.24) lr 1.00e-05 gnorm 0.255 3.08s mem 81.1GB +[2026-09-14 14:03:08] step 4302/5000 loss 0.1618 (w 0.2277 mse 0.2138 t 873 new 0.23) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +[2026-09-14 14:03:11] step 4303/5000 loss 0.2694 (w 0.2655 mse 0.2745 t 931 new 0.20) lr 1.00e-05 gnorm 0.140 3.06s mem 81.1GB +[2026-09-14 14:03:14] step 4304/5000 loss 0.2682 (w 0.3688 mse 0.3629 t 278 new 0.22) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +[2026-09-14 14:03:17] step 4305/5000 loss 0.1710 (w 0.3152 mse 0.3031 t 962 new 0.20) lr 1.00e-05 gnorm 0.167 3.33s mem 81.1GB +[2026-09-14 14:03:20] step 4306/5000 loss 0.2442 (w 0.1694 mse 0.1626 t 879 new 0.07) lr 1.00e-05 gnorm 0.141 3.35s mem 81.1GB +[2026-09-14 14:03:24] step 4307/5000 loss 0.2217 (w 0.2537 mse 0.2584 t 830 new 0.21) lr 1.00e-05 gnorm 0.126 3.22s mem 81.1GB +[2026-09-14 14:03:27] step 4308/5000 loss 0.3438 (w 0.3706 mse 0.3814 t 238 new 0.18) lr 1.00e-05 gnorm 0.534 3.10s mem 81.1GB +[2026-09-14 14:03:30] step 4309/5000 loss 0.3205 (w 0.1937 mse 0.1878 t 829 new 0.29) lr 1.00e-05 gnorm 0.192 3.11s mem 81.1GB +[2026-09-14 14:03:33] step 4310/5000 loss 0.2285 (w 0.5779 mse 0.5815 t 127 new 0.11) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +[2026-09-14 14:03:36] step 4311/5000 loss 0.3408 (w 0.2380 mse 0.2232 t 653 new 0.19) lr 1.00e-05 gnorm 0.182 3.06s mem 81.1GB +[2026-09-14 14:03:39] step 4312/5000 loss 0.1788 (w 0.3757 mse 0.3656 t 990 new 0.19) lr 1.00e-05 gnorm 0.191 3.37s mem 81.1GB +[2026-09-14 14:03:43] step 4313/5000 loss 0.1548 (w 0.1953 mse 0.1927 t 911 new 0.18) lr 1.00e-05 gnorm 0.137 3.26s mem 81.1GB +[2026-09-14 14:03:46] step 4314/5000 loss 0.2439 (w 0.1220 mse 0.1342 t 540 new 0.16) lr 1.00e-05 gnorm 0.136 3.04s mem 81.1GB +[2026-09-14 14:03:49] step 4315/5000 loss 0.2730 (w 0.1871 mse 0.1872 t 977 new 0.21) lr 1.00e-05 gnorm 0.129 3.13s mem 81.1GB +[2026-09-14 14:03:52] step 4316/5000 loss 0.2124 (w 0.2149 mse 0.2072 t 925 new 0.24) lr 1.00e-05 gnorm 0.139 3.03s mem 81.1GB +[2026-09-14 14:03:55] step 4317/5000 loss 0.2261 (w 0.1174 mse 0.1369 t 383 new 0.18) lr 1.00e-05 gnorm 0.183 3.14s mem 81.1GB +[2026-09-14 14:03:58] step 4318/5000 loss 0.3206 (w 0.3435 mse 0.3277 t 989 new 0.18) lr 1.00e-05 gnorm 0.142 3.12s mem 81.1GB +[2026-09-14 14:04:01] step 4319/5000 loss 0.3533 (w 0.3765 mse 0.3601 t 988 new 0.22) lr 1.00e-05 gnorm 0.125 3.03s mem 81.1GB +[2026-09-14 14:04:04] step 4320/5000 loss 0.1528 (w 0.1231 mse 0.1184 t 890 new 0.26) lr 1.00e-05 gnorm 0.144 3.14s mem 81.1GB +[2026-09-14 14:04:07] step 4321/5000 loss 0.2641 (w 0.3110 mse 0.2884 t 938 new 0.19) lr 1.00e-05 gnorm 0.142 3.13s mem 81.1GB +[2026-09-14 14:04:11] step 4322/5000 loss 0.1689 (w 0.2318 mse 0.2224 t 720 new 0.12) lr 1.00e-05 gnorm 0.143 3.08s mem 81.1GB +[2026-09-14 14:04:14] step 4323/5000 loss 0.3845 (w 0.2605 mse 0.2521 t 586 new 0.21) lr 1.00e-05 gnorm 0.134 3.28s mem 81.1GB +[2026-09-14 14:04:17] step 4324/5000 loss 0.0685 (w 0.2620 mse 0.2683 t 983 new 0.19) lr 1.00e-05 gnorm 0.139 3.16s mem 81.1GB +[2026-09-14 14:04:20] step 4325/5000 loss 0.1590 (w 0.1898 mse 0.1998 t 861 new 0.13) lr 1.00e-05 gnorm 0.139 3.28s mem 81.1GB +[2026-09-14 14:04:23] step 4326/5000 loss 0.2372 (w 0.1420 mse 0.1471 t 977 new 0.20) lr 1.00e-05 gnorm 0.204 3.09s mem 81.1GB +[2026-09-14 14:04:26] step 4327/5000 loss 0.2033 (w 0.1773 mse 0.1808 t 735 new 0.24) lr 1.00e-05 gnorm 0.129 3.07s mem 81.1GB +[2026-09-14 14:04:30] step 4328/5000 loss 0.2610 (w 0.3829 mse 0.3784 t 999 new 0.20) lr 1.00e-05 gnorm 0.102 3.11s mem 81.1GB +[2026-09-14 14:04:33] step 4329/5000 loss 0.2558 (w 0.3544 mse 0.3363 t 971 new 0.19) lr 1.00e-05 gnorm 0.147 3.35s mem 81.1GB +[2026-09-14 14:04:36] step 4330/5000 loss 0.1892 (w 0.1517 mse 0.1453 t 921 new 0.14) lr 1.00e-05 gnorm 0.121 3.16s mem 81.1GB +[2026-09-14 14:04:39] step 4331/5000 loss 0.1936 (w 0.3417 mse 0.3266 t 1000 new 0.27) lr 1.00e-05 gnorm 0.136 3.09s mem 81.1GB +[2026-09-14 14:04:42] step 4332/5000 loss 0.3520 (w 0.5935 mse 0.5914 t 177 new 0.21) lr 1.00e-05 gnorm 0.136 3.08s mem 81.1GB +[2026-09-14 14:04:45] step 4333/5000 loss 0.0932 (w 0.3695 mse 0.3489 t 991 new 0.25) lr 1.00e-05 gnorm 0.164 3.11s mem 81.1GB +[2026-09-14 14:04:48] step 4334/5000 loss 0.2105 (w 0.1792 mse 0.1779 t 917 new 0.12) lr 1.00e-05 gnorm 0.141 3.10s mem 81.1GB +[2026-09-14 14:04:52] step 4335/5000 loss 0.0659 (w 0.2539 mse 0.2368 t 949 new 0.19) lr 1.00e-05 gnorm 0.104 3.12s mem 81.1GB +[2026-09-14 14:04:55] step 4336/5000 loss 0.1613 (w 0.4339 mse 0.4299 t 996 new 0.16) lr 1.00e-05 gnorm 0.153 3.30s mem 81.1GB +[2026-09-14 14:04:58] step 4337/5000 loss 0.2019 (w 0.2242 mse 0.2193 t 641 new 0.28) lr 1.00e-05 gnorm 0.137 2.82s mem 81.1GB +[2026-09-14 14:05:01] step 4338/5000 loss 0.2306 (w 0.1395 mse 0.1466 t 872 new 0.17) lr 1.00e-05 gnorm 0.137 3.06s mem 81.1GB +[2026-09-14 14:05:04] step 4339/5000 loss 0.2333 (w 0.2174 mse 0.2120 t 969 new 0.13) lr 1.00e-05 gnorm 0.123 2.82s mem 81.1GB +[2026-09-14 14:05:07] step 4340/5000 loss 0.3062 (w 0.2535 mse 0.2485 t 980 new 0.18) lr 1.00e-05 gnorm 0.135 3.26s mem 81.1GB +[2026-09-14 14:05:10] step 4341/5000 loss 0.1046 (w 0.1619 mse 0.1547 t 774 new 0.20) lr 1.00e-05 gnorm 0.113 3.08s mem 81.1GB +[2026-09-14 14:05:13] step 4342/5000 loss 0.2867 (w 0.3684 mse 0.3855 t 233 new 0.22) lr 1.00e-05 gnorm 0.132 3.36s mem 81.1GB +[2026-09-14 14:05:16] step 4343/5000 loss 0.1731 (w 0.2149 mse 0.2027 t 948 new 0.24) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-14 14:05:20] step 4344/5000 loss 0.2409 (w 0.2005 mse 0.1920 t 883 new 0.25) lr 1.00e-05 gnorm 0.134 3.36s mem 81.1GB +[2026-09-14 14:05:23] step 4345/5000 loss 0.1762 (w 0.3848 mse 0.3644 t 986 new 0.21) lr 1.00e-05 gnorm 0.191 2.84s mem 81.1GB +[2026-09-14 14:05:26] step 4346/5000 loss 0.2614 (w 0.1659 mse 0.1587 t 936 new 0.17) lr 1.00e-05 gnorm 0.326 3.08s mem 81.1GB +[2026-09-14 14:05:29] step 4347/5000 loss 0.2054 (w 0.2175 mse 0.2070 t 978 new 0.24) lr 1.00e-05 gnorm 0.127 3.37s mem 81.1GB +[2026-09-14 14:05:32] step 4348/5000 loss 0.1506 (w 0.2592 mse 0.2592 t 946 new 0.24) lr 1.00e-05 gnorm 0.200 3.26s mem 81.1GB +[2026-09-14 14:05:35] step 4349/5000 loss 0.1658 (w 0.1909 mse 0.2115 t 997 new 0.13) lr 1.00e-05 gnorm 0.111 3.02s mem 81.1GB +[2026-09-14 14:05:38] step 4350/5000 loss 0.4235 (w 0.2627 mse 0.2550 t 506 new 0.28) lr 1.00e-05 gnorm 0.188 3.09s mem 81.1GB +[2026-09-14 14:05:41] step 4351/5000 loss 0.2687 (w 0.1261 mse 0.1236 t 737 new 0.16) lr 1.00e-05 gnorm 0.449 2.82s mem 81.1GB +[2026-09-14 14:05:45] step 4352/5000 loss 0.1701 (w 0.1517 mse 0.1615 t 840 new 0.19) lr 1.00e-05 gnorm 0.123 3.30s mem 81.1GB +[2026-09-14 14:05:48] step 4353/5000 loss 0.1643 (w 0.2839 mse 0.2881 t 961 new 0.15) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +[2026-09-14 14:05:51] step 4354/5000 loss 0.3117 (w 0.1916 mse 0.1900 t 624 new 0.21) lr 1.00e-05 gnorm 0.172 3.03s mem 81.1GB +[2026-09-14 14:05:54] step 4355/5000 loss 0.1804 (w 0.3523 mse 0.3529 t 979 new 0.15) lr 1.00e-05 gnorm 0.099 3.08s mem 81.1GB +[2026-09-14 14:05:57] step 4356/5000 loss 0.1228 (w 0.2503 mse 0.2404 t 938 new 0.16) lr 1.00e-05 gnorm 0.638 3.13s mem 81.1GB +[2026-09-14 14:06:00] step 4357/5000 loss 0.1238 (w 0.1429 mse 0.1356 t 871 new 0.19) lr 1.00e-05 gnorm 0.367 3.02s mem 81.1GB +[2026-09-14 14:06:03] step 4358/5000 loss 0.4086 (w 0.1928 mse 0.1886 t 578 new 0.23) lr 1.00e-05 gnorm 0.156 3.38s mem 81.1GB +[2026-09-14 14:06:06] step 4359/5000 loss 0.1746 (w 0.1961 mse 0.1885 t 756 new 0.18) lr 1.00e-05 gnorm 0.128 3.11s mem 81.1GB +[2026-09-14 14:06:10] step 4360/5000 loss 0.1837 (w 0.2078 mse 0.2012 t 971 new 0.23) lr 1.00e-05 gnorm 0.128 3.07s mem 81.1GB +[2026-09-14 14:06:13] step 4361/5000 loss 0.1989 (w 0.3146 mse 0.2955 t 997 new 0.20) lr 1.00e-05 gnorm 0.179 3.05s mem 81.1GB +[2026-09-14 14:06:16] step 4362/5000 loss 0.1832 (w 0.3282 mse 0.3256 t 976 new 0.22) lr 1.00e-05 gnorm 0.141 3.07s mem 81.1GB +[2026-09-14 14:06:19] step 4363/5000 loss 0.2827 (w 0.2722 mse 0.2665 t 935 new 0.16) lr 1.00e-05 gnorm 0.143 3.04s mem 81.1GB +[2026-09-14 14:06:22] step 4364/5000 loss 0.1068 (w 0.1715 mse 0.1705 t 950 new 0.23) lr 1.00e-05 gnorm 0.192 3.08s mem 81.1GB +[2026-09-14 14:06:25] step 4365/5000 loss 0.2267 (w 0.2790 mse 0.2672 t 465 new 0.21) lr 1.00e-05 gnorm 0.190 3.11s mem 81.1GB +[2026-09-14 14:06:28] step 4366/5000 loss 0.1776 (w 0.1778 mse 0.1808 t 939 new 0.19) lr 1.00e-05 gnorm 0.107 3.07s mem 81.1GB +[2026-09-14 14:06:31] step 4367/5000 loss 0.1993 (w 0.2631 mse 0.2649 t 958 new 0.25) lr 1.00e-05 gnorm 0.147 3.33s mem 81.1GB +[2026-09-14 14:06:34] step 4368/5000 loss 0.2741 (w 0.1238 mse 0.1295 t 728 new 0.20) lr 1.00e-05 gnorm 0.169 2.83s mem 81.1GB +[2026-09-14 14:06:37] step 4369/5000 loss 0.4160 (w 0.2336 mse 0.2324 t 434 new 0.17) lr 1.00e-05 gnorm 0.326 3.27s mem 81.1GB +[2026-09-14 14:06:41] step 4370/5000 loss 0.2001 (w 0.1484 mse 0.1345 t 698 new 0.18) lr 1.00e-05 gnorm 0.164 3.09s mem 81.1GB +[2026-09-14 14:06:44] step 4371/5000 loss 0.2558 (w 0.2552 mse 0.2374 t 894 new 0.20) lr 1.00e-05 gnorm 0.211 3.20s mem 81.1GB +[2026-09-14 14:06:47] step 4372/5000 loss 0.2522 (w 0.2121 mse 0.1951 t 830 new 0.18) lr 1.00e-05 gnorm 0.114 3.04s mem 81.1GB +[2026-09-14 14:06:50] step 4373/5000 loss 0.3243 (w 0.2067 mse 0.1989 t 884 new 0.20) lr 1.00e-05 gnorm 0.139 3.30s mem 81.1GB +[2026-09-14 14:06:53] step 4374/5000 loss 0.3282 (w 0.2521 mse 0.2310 t 584 new 0.22) lr 1.00e-05 gnorm 0.125 2.83s mem 81.1GB +[2026-09-14 14:06:56] step 4375/5000 loss 0.1416 (w 0.2239 mse 0.2382 t 840 new 0.16) lr 1.00e-05 gnorm 0.238 3.35s mem 81.1GB +[2026-09-14 14:06:59] step 4376/5000 loss 0.2187 (w 0.2969 mse 0.2840 t 913 new 0.27) lr 1.00e-05 gnorm 0.226 3.09s mem 81.1GB +[2026-09-14 14:07:03] step 4377/5000 loss 0.2041 (w 0.3669 mse 0.3542 t 994 new 0.18) lr 1.00e-05 gnorm 0.120 3.38s mem 81.1GB +[2026-09-14 14:07:06] step 4378/5000 loss 0.2378 (w 0.2466 mse 0.2371 t 768 new 0.21) lr 1.00e-05 gnorm 0.358 3.31s mem 81.1GB +[2026-09-14 14:07:09] step 4379/5000 loss 0.2176 (w 0.3221 mse 0.3124 t 958 new 0.21) lr 1.00e-05 gnorm 0.200 3.06s mem 81.1GB +[2026-09-14 14:07:12] step 4380/5000 loss 0.1197 (w 0.2869 mse 0.2684 t 961 new 0.24) lr 1.00e-05 gnorm 0.157 2.83s mem 81.1GB +[2026-09-14 14:07:15] step 4381/5000 loss 0.2100 (w 0.1917 mse 0.1928 t 733 new 0.23) lr 1.00e-05 gnorm 0.174 3.13s mem 81.1GB +[2026-09-14 14:07:18] step 4382/5000 loss 0.1590 (w 0.1296 mse 0.1488 t 914 new 0.18) lr 1.00e-05 gnorm 0.324 3.09s mem 81.1GB +[2026-09-14 14:07:21] step 4383/5000 loss 0.1580 (w 0.3648 mse 0.3593 t 991 new 0.23) lr 1.00e-05 gnorm 0.134 3.32s mem 81.1GB +[2026-09-14 14:07:25] step 4384/5000 loss 0.2313 (w 0.2375 mse 0.2356 t 957 new 0.22) lr 1.00e-05 gnorm 0.225 3.02s mem 81.1GB +[2026-09-14 14:07:28] step 4385/5000 loss 0.2495 (w 0.2972 mse 0.2827 t 844 new 0.17) lr 1.00e-05 gnorm 0.352 3.08s mem 81.1GB +[2026-09-14 14:07:30] step 4386/5000 loss 0.1383 (w 0.1262 mse 0.1264 t 882 new 0.11) lr 1.00e-05 gnorm 0.235 2.82s mem 81.1GB +[2026-09-14 14:07:33] step 4387/5000 loss 0.2165 (w 0.2510 mse 0.2469 t 990 new 0.18) lr 1.00e-05 gnorm 0.122 3.09s mem 81.1GB +[2026-09-14 14:07:37] step 4388/5000 loss 0.2016 (w 0.5441 mse 0.5228 t 994 new 0.23) lr 1.00e-05 gnorm 0.217 3.43s mem 81.1GB +[2026-09-14 14:07:40] step 4389/5000 loss 0.2415 (w 0.1425 mse 0.1560 t 972 new 0.19) lr 1.00e-05 gnorm 0.179 3.31s mem 81.1GB +[2026-09-14 14:07:43] step 4390/5000 loss 0.1853 (w 0.2557 mse 0.2385 t 987 new 0.20) lr 1.00e-05 gnorm 0.252 3.00s mem 81.1GB +[2026-09-14 14:07:46] step 4391/5000 loss 0.3025 (w 0.1780 mse 0.1940 t 992 new 0.10) lr 1.00e-05 gnorm 0.178 3.11s mem 81.1GB +[2026-09-14 14:07:49] step 4392/5000 loss 0.0553 (w 0.1503 mse 0.1489 t 908 new 0.22) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +[2026-09-14 14:07:53] step 4393/5000 loss 0.2015 (w 0.1340 mse 0.1405 t 750 new 0.23) lr 1.00e-05 gnorm 0.146 3.36s mem 81.1GB +[2026-09-14 14:07:56] step 4394/5000 loss 0.3431 (w 0.1956 mse 0.1775 t 929 new 0.20) lr 1.00e-05 gnorm 0.171 3.26s mem 81.1GB +[2026-09-14 14:07:59] step 4395/5000 loss 0.1141 (w 0.1349 mse 0.1349 t 942 new 0.00) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +[2026-09-14 14:08:02] step 4396/5000 loss 0.3019 (w 0.2892 mse 0.2820 t 453 new 0.25) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +[2026-09-14 14:08:05] step 4397/5000 loss 0.1452 (w 0.2504 mse 0.2429 t 926 new 0.09) lr 1.00e-05 gnorm 0.127 3.14s mem 81.1GB +[2026-09-14 14:08:08] step 4398/5000 loss 0.1513 (w 0.3174 mse 0.3011 t 959 new 0.21) lr 1.00e-05 gnorm 0.133 2.86s mem 81.1GB +[2026-09-14 14:08:11] step 4399/5000 loss 0.1902 (w 0.1952 mse 0.1955 t 712 new 0.12) lr 1.00e-05 gnorm 0.292 3.34s mem 81.1GB +[2026-09-14 14:08:15] step 4400/5000 loss 0.3326 (w 0.5424 mse 0.5292 t 177 new 0.26) lr 1.00e-05 gnorm 0.134 3.17s mem 81.1GB +[2026-09-14 14:08:18] step 4401/5000 loss 0.3690 (w 0.4250 mse 0.4140 t 470 new 0.20) lr 1.00e-05 gnorm 0.177 3.04s mem 81.1GB +[2026-09-14 14:08:21] step 4402/5000 loss 0.2402 (w 0.2303 mse 0.2139 t 752 new 0.26) lr 1.00e-05 gnorm 0.178 3.09s mem 81.1GB +[2026-09-14 14:08:24] step 4403/5000 loss 0.1853 (w 0.1064 mse 0.1148 t 851 new 0.22) lr 1.00e-05 gnorm 0.104 3.05s mem 81.1GB +[2026-09-14 14:08:27] step 4404/5000 loss 0.1677 (w 0.2245 mse 0.2270 t 944 new 0.25) lr 1.00e-05 gnorm 0.100 3.09s mem 81.1GB +[2026-09-14 14:08:30] step 4405/5000 loss 0.1545 (w 0.3450 mse 0.3395 t 980 new 0.23) lr 1.00e-05 gnorm 0.166 3.10s mem 81.1GB +[2026-09-14 14:08:33] step 4406/5000 loss 0.2397 (w 0.1790 mse 0.1725 t 775 new 0.19) lr 1.00e-05 gnorm 0.131 3.37s mem 81.1GB +[2026-09-14 14:08:36] step 4407/5000 loss 0.2468 (w 0.1624 mse 0.1624 t 935 new 0.15) lr 1.00e-05 gnorm 0.201 3.03s mem 81.1GB +[2026-09-14 14:08:39] step 4408/5000 loss 0.2753 (w 0.1530 mse 0.1457 t 869 new 0.13) lr 1.00e-05 gnorm 0.132 3.01s mem 81.1GB +[2026-09-14 14:08:42] step 4409/5000 loss 0.2269 (w 0.2586 mse 0.2665 t 959 new 0.20) lr 1.00e-05 gnorm 0.140 3.11s mem 81.1GB +[2026-09-14 14:08:46] step 4410/5000 loss 0.1611 (w 0.1978 mse 0.1863 t 866 new 0.15) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +[2026-09-14 14:08:49] step 4411/5000 loss 0.2667 (w 0.2239 mse 0.2110 t 932 new 0.20) lr 1.00e-05 gnorm 0.255 3.37s mem 81.1GB +[2026-09-14 14:08:52] step 4412/5000 loss 0.2736 (w 0.1818 mse 0.1792 t 662 new 0.24) lr 1.00e-05 gnorm 0.150 3.19s mem 81.1GB +[2026-09-14 14:08:55] step 4413/5000 loss 0.2574 (w 0.4243 mse 0.4160 t 274 new 0.19) lr 1.00e-05 gnorm 0.188 3.05s mem 81.1GB +[2026-09-14 14:08:58] step 4414/5000 loss 0.3079 (w 0.2280 mse 0.2341 t 301 new 0.16) lr 1.00e-05 gnorm 0.223 3.32s mem 81.1GB +[2026-09-14 14:09:01] step 4415/5000 loss 0.1775 (w 0.3454 mse 0.3608 t 964 new 0.15) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +[2026-09-14 14:09:05] step 4416/5000 loss 0.2582 (w 0.2198 mse 0.2073 t 731 new 0.22) lr 1.00e-05 gnorm 0.116 3.31s mem 81.1GB +[2026-09-14 14:09:09] step 4417/5000 loss 0.3915 (w 0.1140 mse 0.1075 t 787 new 0.09) lr 1.00e-05 gnorm 0.139 4.52s mem 81.1GB +[2026-09-14 14:09:12] step 4418/5000 loss 0.2612 (w 0.2255 mse 0.2202 t 991 new 0.14) lr 1.00e-05 gnorm 0.286 3.14s mem 81.1GB +[2026-09-14 14:09:15] step 4419/5000 loss 0.2448 (w 0.1378 mse 0.1426 t 574 new 0.13) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-14 14:09:18] step 4420/5000 loss 0.2361 (w 0.1622 mse 0.1658 t 918 new 0.23) lr 1.00e-05 gnorm 0.144 3.04s mem 81.1GB +[2026-09-14 14:09:21] step 4421/5000 loss 0.1712 (w 0.0795 mse 0.0897 t 922 new 0.18) lr 1.00e-05 gnorm 0.137 2.84s mem 81.1GB +[2026-09-14 14:09:25] step 4422/5000 loss 0.2425 (w 0.2438 mse 0.2404 t 747 new 0.19) lr 1.00e-05 gnorm 0.127 3.37s mem 81.1GB +[2026-09-14 14:09:28] step 4423/5000 loss 0.2606 (w 0.2285 mse 0.2155 t 733 new 0.21) lr 1.00e-05 gnorm 0.203 3.06s mem 81.1GB +[2026-09-14 14:09:31] step 4424/5000 loss 0.1831 (w 0.2308 mse 0.2380 t 758 new 0.17) lr 1.00e-05 gnorm 0.171 3.29s mem 81.1GB +[2026-09-14 14:09:34] step 4425/5000 loss 0.1340 (w 0.3609 mse 0.3473 t 980 new 0.21) lr 1.00e-05 gnorm 0.189 3.08s mem 81.1GB +[2026-09-14 14:09:37] step 4426/5000 loss 0.3410 (w 0.2905 mse 0.3007 t 437 new 0.21) lr 1.00e-05 gnorm 0.189 3.07s mem 81.1GB +[2026-09-14 14:09:40] step 4427/5000 loss 0.3132 (w 0.2392 mse 0.2222 t 642 new 0.18) lr 1.00e-05 gnorm 0.127 2.84s mem 81.1GB +[2026-09-14 14:09:43] step 4428/5000 loss 0.1525 (w 0.3012 mse 0.3038 t 996 new 0.20) lr 1.00e-05 gnorm 0.105 3.42s mem 81.1GB +[2026-09-14 14:09:46] step 4429/5000 loss 0.2019 (w 0.2016 mse 0.1952 t 975 new 0.23) lr 1.00e-05 gnorm 0.257 3.09s mem 81.1GB +[2026-09-14 14:09:50] step 4430/5000 loss 0.1996 (w 0.1442 mse 0.1568 t 789 new 0.15) lr 1.00e-05 gnorm 0.160 3.29s mem 81.1GB +[2026-09-14 14:09:53] step 4431/5000 loss 0.2163 (w 0.3295 mse 0.3278 t 989 new 0.24) lr 1.00e-05 gnorm 0.193 3.09s mem 81.1GB +[2026-09-14 14:09:56] step 4432/5000 loss 0.1335 (w 0.2086 mse 0.1976 t 915 new 0.17) lr 1.00e-05 gnorm 0.175 3.11s mem 81.1GB +[2026-09-14 14:09:59] step 4433/5000 loss 0.1962 (w 0.2465 mse 0.2502 t 911 new 0.18) lr 1.00e-05 gnorm 0.462 3.06s mem 81.1GB +[2026-09-14 14:10:02] step 4434/5000 loss 0.1358 (w 0.1935 mse 0.1935 t 864 new 0.15) lr 1.00e-05 gnorm 0.114 3.06s mem 81.1GB +[2026-09-14 14:10:06] step 4435/5000 loss 0.2981 (w 0.1212 mse 0.1232 t 742 new 0.23) lr 1.00e-05 gnorm 0.218 3.45s mem 81.1GB +[2026-09-14 14:10:09] step 4436/5000 loss 0.3669 (w 0.1867 mse 0.1854 t 725 new 0.27) lr 1.00e-05 gnorm 0.150 3.02s mem 81.1GB +[2026-09-14 14:10:12] step 4437/5000 loss 0.2271 (w 0.3261 mse 0.3229 t 997 new 0.20) lr 1.00e-05 gnorm 0.218 3.18s mem 81.1GB +[2026-09-14 14:10:15] step 4438/5000 loss 0.2324 (w 0.2309 mse 0.2244 t 941 new 0.16) lr 1.00e-05 gnorm 0.134 3.13s mem 81.1GB +[2026-09-14 14:10:18] step 4439/5000 loss 0.2468 (w 0.1772 mse 0.1696 t 812 new 0.06) lr 1.00e-05 gnorm 0.495 3.04s mem 81.1GB +[2026-09-14 14:10:21] step 4440/5000 loss 0.4380 (w 0.3278 mse 0.3233 t 319 new 0.25) lr 1.00e-05 gnorm 0.155 3.13s mem 81.1GB +[2026-09-14 14:10:24] step 4441/5000 loss 0.1378 (w 0.1859 mse 0.1756 t 761 new 0.22) lr 1.00e-05 gnorm 0.112 3.37s mem 81.1GB +[2026-09-14 14:10:27] step 4442/5000 loss 0.2003 (w 0.2000 mse 0.2013 t 564 new 0.19) lr 1.00e-05 gnorm 0.136 3.02s mem 81.1GB +[2026-09-14 14:10:31] step 4443/5000 loss 0.1655 (w 0.1508 mse 0.1473 t 787 new 0.17) lr 1.00e-05 gnorm 0.131 3.15s mem 81.1GB +[2026-09-14 14:10:34] step 4444/5000 loss 0.1232 (w 0.2532 mse 0.2371 t 922 new 0.24) lr 1.00e-05 gnorm 0.125 3.12s mem 81.1GB +[2026-09-14 14:10:37] step 4445/5000 loss 0.2079 (w 0.3072 mse 0.2967 t 989 new 0.22) lr 1.00e-05 gnorm 0.159 3.04s mem 81.1GB +[2026-09-14 14:10:40] step 4446/5000 loss 0.2658 (w 0.2527 mse 0.2352 t 975 new 0.19) lr 1.00e-05 gnorm 0.327 3.38s mem 81.1GB +[2026-09-14 14:10:43] step 4447/5000 loss 0.2273 (w 0.2777 mse 0.2543 t 789 new 0.22) lr 1.00e-05 gnorm 0.181 3.33s mem 81.1GB +[2026-09-14 14:10:47] step 4448/5000 loss 0.1119 (w 0.1700 mse 0.1695 t 923 new 0.27) lr 1.00e-05 gnorm 0.128 3.08s mem 81.1GB +[2026-09-14 14:10:50] step 4449/5000 loss 0.3379 (w 0.2911 mse 0.2924 t 979 new 0.22) lr 1.00e-05 gnorm 0.124 3.06s mem 81.1GB +[2026-09-14 14:10:53] step 4450/5000 loss 0.1346 (w 0.2697 mse 0.2637 t 954 new 0.23) lr 1.00e-05 gnorm 0.101 3.05s mem 81.1GB +[2026-09-14 14:10:56] step 4451/5000 loss 0.2336 (w 0.1947 mse 0.1885 t 906 new 0.18) lr 1.00e-05 gnorm 0.143 3.09s mem 81.1GB +[2026-09-14 14:10:59] step 4452/5000 loss 0.2872 (w 0.1966 mse 0.1943 t 940 new 0.23) lr 1.00e-05 gnorm 0.145 3.35s mem 81.1GB +[2026-09-14 14:11:02] step 4453/5000 loss 0.1960 (w 0.1245 mse 0.1166 t 877 new 0.20) lr 1.00e-05 gnorm 0.183 3.13s mem 81.1GB +[2026-09-14 14:11:05] step 4454/5000 loss 0.3023 (w 0.4973 mse 0.4913 t 217 new 0.23) lr 1.00e-05 gnorm 0.154 3.06s mem 81.1GB +[2026-09-14 14:11:08] step 4455/5000 loss 0.2705 (w 0.1247 mse 0.1330 t 656 new 0.23) lr 1.00e-05 gnorm 0.161 3.08s mem 81.1GB +[2026-09-14 14:11:11] step 4456/5000 loss 0.1831 (w 0.2297 mse 0.2194 t 829 new 0.23) lr 1.00e-05 gnorm 0.136 3.10s mem 81.1GB +[2026-09-14 14:11:15] step 4457/5000 loss 0.2820 (w 0.1293 mse 0.1385 t 835 new 0.20) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-14 14:11:18] step 4458/5000 loss 0.1501 (w 0.2403 mse 0.2253 t 780 new 0.26) lr 1.00e-05 gnorm 0.156 3.41s mem 81.1GB +[2026-09-14 14:11:21] step 4459/5000 loss 0.1866 (w 0.3619 mse 0.3511 t 984 new 0.17) lr 1.00e-05 gnorm 0.119 3.17s mem 81.1GB +[2026-09-14 14:11:24] step 4460/5000 loss 0.2491 (w 0.1537 mse 0.1444 t 870 new 0.18) lr 1.00e-05 gnorm 0.122 3.06s mem 81.1GB +[2026-09-14 14:11:27] step 4461/5000 loss 0.2542 (w 0.2269 mse 0.2502 t 965 new 0.22) lr 1.00e-05 gnorm 0.178 2.83s mem 81.1GB +[2026-09-14 14:11:30] step 4462/5000 loss 0.1737 (w 0.1337 mse 0.1290 t 897 new 0.10) lr 1.00e-05 gnorm 0.155 2.83s mem 81.1GB +[2026-09-14 14:11:34] step 4463/5000 loss 0.1442 (w 0.3441 mse 0.3472 t 966 new 0.20) lr 1.00e-05 gnorm 0.167 3.41s mem 81.1GB +[2026-09-14 14:11:37] step 4464/5000 loss 0.1719 (w 0.1203 mse 0.1391 t 919 new 0.19) lr 1.00e-05 gnorm 0.161 3.30s mem 81.1GB +[2026-09-14 14:11:40] step 4465/5000 loss 0.2695 (w 0.2852 mse 0.2867 t 934 new 0.26) lr 1.00e-05 gnorm 0.138 3.06s mem 81.1GB +[2026-09-14 14:11:43] step 4466/5000 loss 0.3953 (w 0.3838 mse 0.3803 t 301 new 0.24) lr 1.00e-05 gnorm 0.140 3.23s mem 81.1GB +[2026-09-14 14:11:46] step 4467/5000 loss 0.2368 (w 0.1555 mse 0.1665 t 881 new 0.24) lr 1.00e-05 gnorm 0.126 3.04s mem 81.1GB +[2026-09-14 14:11:49] step 4468/5000 loss 0.2102 (w 0.1292 mse 0.1366 t 854 new 0.21) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +[2026-09-14 14:11:52] step 4469/5000 loss 0.1132 (w 0.2316 mse 0.2256 t 972 new 0.18) lr 1.00e-05 gnorm 0.164 3.34s mem 81.1GB +[2026-09-14 14:11:56] step 4470/5000 loss 0.2581 (w 0.3186 mse 0.2990 t 737 new 0.20) lr 1.00e-05 gnorm 0.137 3.11s mem 81.1GB +[2026-09-14 14:11:59] step 4471/5000 loss 0.1551 (w 0.2664 mse 0.2428 t 628 new 0.17) lr 1.00e-05 gnorm 0.175 3.12s mem 81.1GB +[2026-09-14 14:12:02] step 4472/5000 loss 0.2098 (w 0.2448 mse 0.2398 t 758 new 0.21) lr 1.00e-05 gnorm 0.170 3.32s mem 81.1GB +[2026-09-14 14:12:05] step 4473/5000 loss 0.2656 (w 0.0700 mse 0.0724 t 820 new 0.12) lr 1.00e-05 gnorm 0.124 3.08s mem 81.1GB +[2026-09-14 14:12:08] step 4474/5000 loss 0.1954 (w 0.2403 mse 0.2253 t 868 new 0.21) lr 1.00e-05 gnorm 0.193 3.07s mem 81.1GB +[2026-09-14 14:12:11] step 4475/5000 loss 0.4883 (w 0.2762 mse 0.2615 t 456 new 0.25) lr 1.00e-05 gnorm 0.388 3.09s mem 81.1GB +[2026-09-14 14:12:15] step 4476/5000 loss 0.1906 (w 0.1758 mse 0.1771 t 961 new 0.18) lr 1.00e-05 gnorm 0.113 3.36s mem 81.1GB +[2026-09-14 14:12:18] step 4477/5000 loss 0.2013 (w 0.2125 mse 0.2116 t 973 new 0.18) lr 1.00e-05 gnorm 0.111 3.09s mem 81.1GB +[2026-09-14 14:12:21] step 4478/5000 loss 0.3352 (w 0.2507 mse 0.2462 t 599 new 0.21) lr 1.00e-05 gnorm 0.126 3.02s mem 81.1GB +[2026-09-14 14:12:24] step 4479/5000 loss 0.2170 (w 0.2225 mse 0.2033 t 939 new 0.19) lr 1.00e-05 gnorm 0.163 3.06s mem 81.1GB +[2026-09-14 14:12:27] step 4480/5000 loss 0.2857 (w 0.1352 mse 0.1293 t 782 new 0.10) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +[2026-09-14 14:12:30] step 4481/5000 loss 0.1771 (w 0.2142 mse 0.2109 t 951 new 0.20) lr 1.00e-05 gnorm 0.842 3.12s mem 81.1GB +[2026-09-14 14:12:33] step 4482/5000 loss 0.1500 (w 0.1509 mse 0.1394 t 963 new 0.22) lr 1.00e-05 gnorm 0.199 3.07s mem 81.1GB +[2026-09-14 14:12:36] step 4483/5000 loss 0.1452 (w 0.1321 mse 0.1351 t 912 new 0.19) lr 1.00e-05 gnorm 0.126 2.83s mem 81.1GB +[2026-09-14 14:12:39] step 4484/5000 loss 0.2615 (w 0.2234 mse 0.2283 t 943 new 0.22) lr 1.00e-05 gnorm 0.162 3.35s mem 81.1GB +[2026-09-14 14:12:42] step 4485/5000 loss 0.3552 (w 0.1777 mse 0.1787 t 858 new 0.19) lr 1.00e-05 gnorm 0.179 3.09s mem 81.1GB +[2026-09-14 14:12:46] step 4486/5000 loss 0.2664 (w 0.2227 mse 0.2192 t 712 new 0.21) lr 1.00e-05 gnorm 0.145 3.10s mem 81.1GB +[2026-09-14 14:12:49] step 4487/5000 loss 0.2562 (w 0.2573 mse 0.2701 t 356 new 0.20) lr 1.00e-05 gnorm 0.249 3.50s mem 81.1GB +[2026-09-14 14:12:52] step 4488/5000 loss 0.3046 (w 0.2708 mse 0.2526 t 889 new 0.26) lr 1.00e-05 gnorm 0.155 3.09s mem 81.1GB +[2026-09-14 14:12:55] step 4489/5000 loss 0.3665 (w 0.6443 mse 0.6367 t 114 new 0.17) lr 1.00e-05 gnorm 0.112 2.82s mem 81.1GB +[2026-09-14 14:12:58] step 4490/5000 loss 0.3322 (w 0.2303 mse 0.2255 t 993 new 0.11) lr 1.00e-05 gnorm 0.174 3.34s mem 81.1GB +[2026-09-14 14:13:01] step 4491/5000 loss 0.1146 (w 0.2197 mse 0.2237 t 915 new 0.18) lr 1.00e-05 gnorm 0.170 3.12s mem 81.1GB +[2026-09-14 14:13:05] step 4492/5000 loss 0.2139 (w 0.1957 mse 0.1873 t 603 new 0.23) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +[2026-09-14 14:13:08] step 4493/5000 loss 0.1352 (w 0.2209 mse 0.2153 t 939 new 0.13) lr 1.00e-05 gnorm 0.168 3.21s mem 81.1GB +[2026-09-14 14:13:11] step 4494/5000 loss 0.1860 (w 0.2576 mse 0.2586 t 765 new 0.17) lr 1.00e-05 gnorm 0.197 3.14s mem 81.1GB +[2026-09-14 14:13:14] step 4495/5000 loss 0.3823 (w 0.1074 mse 0.1228 t 981 new 0.16) lr 1.00e-05 gnorm 0.204 2.83s mem 81.1GB +[2026-09-14 14:13:17] step 4496/5000 loss 0.2403 (w 0.1185 mse 0.1211 t 724 new 0.25) lr 1.00e-05 gnorm 0.215 3.31s mem 81.1GB +[2026-09-14 14:13:20] step 4497/5000 loss 0.3225 (w 0.3519 mse 0.3333 t 959 new 0.26) lr 1.00e-05 gnorm 0.181 2.82s mem 81.1GB +[2026-09-14 14:13:23] step 4498/5000 loss 0.2603 (w 0.2170 mse 0.2144 t 964 new 0.19) lr 1.00e-05 gnorm 0.146 3.11s mem 81.1GB +[2026-09-14 14:13:26] step 4499/5000 loss 0.1477 (w 0.1218 mse 0.1174 t 659 new 0.18) lr 1.00e-05 gnorm 0.330 3.32s mem 81.1GB +[2026-09-14 14:13:29] step 4500/5000 loss 0.2322 (w 0.2685 mse 0.2666 t 997 new 0.22) lr 1.00e-05 gnorm 0.139 3.06s mem 81.1GB +[2026-09-14 14:13:31] [val] step 4500 t=200: w=0.4099 mse=0.4204 (n=16) t=500: w=0.2169 mse=0.2202 (n=16) t=800: w=0.1693 mse=0.1684 (n=16) | mean w=0.2654 mse=0.2697 2s +[2026-09-14 14:14:19] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step4500.safetensors 4093 个张量 37.98 GB +[2026-09-14 14:14:24] step 4501/5000 loss 0.2062 (w 0.1856 mse 0.1933 t 841 new 0.14) lr 1.00e-05 gnorm 0.127 3.12s mem 81.1GB +[2026-09-14 14:14:27] step 4502/5000 loss 0.1788 (w 0.2521 mse 0.2443 t 879 new 0.17) lr 1.00e-05 gnorm 0.105 3.12s mem 81.1GB +[2026-09-14 14:14:30] step 4503/5000 loss 0.2576 (w 0.2383 mse 0.2495 t 824 new 0.17) lr 1.00e-05 gnorm 0.119 3.05s mem 81.1GB +[2026-09-14 14:14:33] step 4504/5000 loss 0.1759 (w 0.2748 mse 0.3071 t 140 new 0.18) lr 1.00e-05 gnorm 0.125 3.28s mem 81.1GB +[2026-09-14 14:14:37] step 4505/5000 loss 0.3912 (w 0.1686 mse 0.1701 t 727 new 0.08) lr 1.00e-05 gnorm 0.134 3.48s mem 81.1GB +[2026-09-14 14:14:39] step 4506/5000 loss 0.1740 (w 0.1611 mse 0.1587 t 741 new 0.17) lr 1.00e-05 gnorm 0.123 2.82s mem 81.1GB +[2026-09-14 14:14:43] step 4507/5000 loss 0.1068 (w 0.2810 mse 0.2711 t 974 new 0.15) lr 1.00e-05 gnorm 0.132 3.11s mem 81.1GB +[2026-09-14 14:14:46] step 4508/5000 loss 0.2171 (w 0.2180 mse 0.2287 t 379 new 0.21) lr 1.00e-05 gnorm 0.132 3.11s mem 81.1GB +[2026-09-14 14:14:49] step 4509/5000 loss 0.1372 (w 0.2090 mse 0.2012 t 940 new 0.25) lr 1.00e-05 gnorm 0.151 3.06s mem 81.1GB +[2026-09-14 14:14:52] step 4510/5000 loss 0.1493 (w 0.2245 mse 0.2136 t 931 new 0.24) lr 1.00e-05 gnorm 0.148 3.31s mem 81.1GB +[2026-09-14 14:14:55] step 4511/5000 loss 0.1602 (w 0.1954 mse 0.1976 t 942 new 0.16) lr 1.00e-05 gnorm 0.157 3.31s mem 81.1GB +[2026-09-14 14:14:58] step 4512/5000 loss 0.0848 (w 0.1517 mse 0.1552 t 808 new 0.22) lr 1.00e-05 gnorm 0.104 2.83s mem 81.1GB +[2026-09-14 14:15:01] step 4513/5000 loss 0.3287 (w 0.1965 mse 0.1964 t 938 new 0.13) lr 1.00e-05 gnorm 0.127 3.06s mem 81.1GB +[2026-09-14 14:15:04] step 4514/5000 loss 0.1917 (w 0.2262 mse 0.2119 t 928 new 0.22) lr 1.00e-05 gnorm 0.154 3.15s mem 81.1GB +[2026-09-14 14:15:08] step 4515/5000 loss 0.3197 (w 0.3162 mse 0.3000 t 963 new 0.20) lr 1.00e-05 gnorm 0.177 3.15s mem 81.1GB +[2026-09-14 14:15:11] step 4516/5000 loss 0.1837 (w 0.1596 mse 0.1752 t 995 new 0.14) lr 1.00e-05 gnorm 0.126 3.13s mem 81.1GB +[2026-09-14 14:15:14] step 4517/5000 loss 0.2451 (w 0.2518 mse 0.2697 t 986 new 0.19) lr 1.00e-05 gnorm 0.160 3.48s mem 81.1GB +[2026-09-14 14:15:17] step 4518/5000 loss 0.2224 (w 0.2468 mse 0.2660 t 984 new 0.22) lr 1.00e-05 gnorm 0.243 2.82s mem 81.1GB +[2026-09-14 14:15:20] step 4519/5000 loss 0.1894 (w 0.3043 mse 0.2814 t 995 new 0.23) lr 1.00e-05 gnorm 0.128 3.06s mem 81.1GB +[2026-09-14 14:15:23] step 4520/5000 loss 0.1990 (w 0.1570 mse 0.1714 t 952 new 0.13) lr 1.00e-05 gnorm 0.115 3.42s mem 81.1GB +[2026-09-14 14:15:26] step 4521/5000 loss 0.1961 (w 0.2441 mse 0.2254 t 970 new 0.22) lr 1.00e-05 gnorm 0.165 2.82s mem 81.1GB +[2026-09-14 14:15:30] step 4522/5000 loss 0.1231 (w 0.2695 mse 0.2581 t 995 new 0.23) lr 1.00e-05 gnorm 0.339 3.11s mem 81.1GB +[2026-09-14 14:15:33] step 4523/5000 loss 0.2246 (w 0.6039 mse 0.5960 t 153 new 0.15) lr 1.00e-05 gnorm 0.125 3.14s mem 81.1GB +[2026-09-14 14:15:36] step 4524/5000 loss 0.1182 (w 0.3401 mse 0.3285 t 994 new 0.16) lr 1.00e-05 gnorm 0.135 2.84s mem 81.1GB +[2026-09-14 14:15:39] step 4525/5000 loss 0.2031 (w 0.2332 mse 0.2459 t 977 new 0.20) lr 1.00e-05 gnorm 0.227 3.36s mem 81.1GB +[2026-09-14 14:15:42] step 4526/5000 loss 0.1130 (w 0.2225 mse 0.2215 t 980 new 0.24) lr 1.00e-05 gnorm 0.089 3.10s mem 81.1GB +[2026-09-14 14:15:45] step 4527/5000 loss 0.2035 (w 0.2312 mse 0.2343 t 980 new 0.19) lr 1.00e-05 gnorm 0.167 3.07s mem 81.1GB +[2026-09-14 14:15:48] step 4528/5000 loss 0.2489 (w 0.2098 mse 0.2017 t 689 new 0.12) lr 1.00e-05 gnorm 2.110 3.33s mem 81.1GB +[2026-09-14 14:15:52] step 4529/5000 loss 0.2342 (w 0.3553 mse 0.3304 t 954 new 0.25) lr 1.00e-05 gnorm 0.186 3.09s mem 81.1GB +[2026-09-14 14:15:54] step 4530/5000 loss 0.1840 (w 0.0796 mse 0.0912 t 914 new 0.14) lr 1.00e-05 gnorm 0.150 2.85s mem 81.1GB +[2026-09-14 14:15:57] step 4531/5000 loss 0.1802 (w 0.1481 mse 0.1516 t 988 new 0.18) lr 1.00e-05 gnorm 0.115 3.09s mem 81.1GB +[2026-09-14 14:16:01] step 4532/5000 loss 0.3172 (w 0.2062 mse 0.2026 t 936 new 0.19) lr 1.00e-05 gnorm 0.148 3.10s mem 81.1GB +[2026-09-14 14:16:04] step 4533/5000 loss 0.2465 (w 0.2310 mse 0.2320 t 774 new 0.19) lr 1.00e-05 gnorm 0.256 3.07s mem 81.1GB +[2026-09-14 14:16:07] step 4534/5000 loss 0.2709 (w 0.1624 mse 0.1642 t 962 new 0.25) lr 1.00e-05 gnorm 0.125 3.34s mem 81.1GB +[2026-09-14 14:16:10] step 4535/5000 loss 0.2923 (w 0.3254 mse 0.3202 t 943 new 0.21) lr 1.00e-05 gnorm 0.177 3.12s mem 81.1GB +[2026-09-14 14:16:13] step 4536/5000 loss 0.2202 (w 0.1953 mse 0.2214 t 356 new 0.25) lr 1.00e-05 gnorm 0.105 2.84s mem 81.1GB +[2026-09-14 14:16:16] step 4537/5000 loss 0.1267 (w 0.2998 mse 0.3050 t 996 new 0.10) lr 1.00e-05 gnorm 0.133 3.28s mem 81.1GB +[2026-09-14 14:16:19] step 4538/5000 loss 0.1975 (w 0.3742 mse 0.3634 t 310 new 0.25) lr 1.00e-05 gnorm 0.109 3.10s mem 81.1GB +[2026-09-14 14:16:22] step 4539/5000 loss 0.2295 (w 0.6300 mse 0.5956 t 988 new 0.28) lr 1.00e-05 gnorm 0.343 3.10s mem 81.1GB +[2026-09-14 14:16:26] step 4540/5000 loss 0.2369 (w 0.2537 mse 0.2352 t 903 new 0.22) lr 1.00e-05 gnorm 0.176 3.33s mem 81.1GB +[2026-09-14 14:16:29] step 4541/5000 loss 0.3725 (w 0.1163 mse 0.1168 t 839 new 0.19) lr 1.00e-05 gnorm 0.206 2.82s mem 81.1GB +[2026-09-14 14:16:31] step 4542/5000 loss 0.2058 (w 0.1510 mse 0.1637 t 741 new 0.16) lr 1.00e-05 gnorm 0.157 2.82s mem 81.1GB +[2026-09-14 14:16:35] step 4543/5000 loss 0.3121 (w 0.1676 mse 0.1611 t 722 new 0.06) lr 1.00e-05 gnorm 0.147 3.45s mem 81.1GB +[2026-09-14 14:16:38] step 4544/5000 loss 0.1415 (w 0.2096 mse 0.2230 t 948 new 0.19) lr 1.00e-05 gnorm 0.164 2.83s mem 81.1GB +[2026-09-14 14:16:41] step 4545/5000 loss 0.1249 (w 0.2100 mse 0.2045 t 918 new 0.23) lr 1.00e-05 gnorm 0.127 3.06s mem 81.1GB +[2026-09-14 14:16:44] step 4546/5000 loss 0.1429 (w 0.2004 mse 0.1968 t 926 new 0.13) lr 1.00e-05 gnorm 0.277 3.35s mem 81.1GB +[2026-09-14 14:16:47] step 4547/5000 loss 0.2042 (w 0.2864 mse 0.2808 t 916 new 0.19) lr 1.00e-05 gnorm 0.128 2.83s mem 81.1GB +[2026-09-14 14:16:50] step 4548/5000 loss 0.2100 (w 0.2175 mse 0.2052 t 976 new 0.25) lr 1.00e-05 gnorm 0.130 3.01s mem 81.1GB +[2026-09-14 14:16:53] step 4549/5000 loss 0.1977 (w 0.1763 mse 0.1767 t 943 new 0.21) lr 1.00e-05 gnorm 0.130 3.17s mem 81.1GB +[2026-09-14 14:16:56] step 4550/5000 loss 0.0945 (w 0.3061 mse 0.2888 t 937 new 0.19) lr 1.00e-05 gnorm 0.108 2.82s mem 81.1GB +[2026-09-14 14:16:59] step 4551/5000 loss 0.3068 (w 0.1565 mse 0.1595 t 612 new 0.22) lr 1.00e-05 gnorm 0.153 3.31s mem 81.1GB +[2026-09-14 14:17:03] step 4552/5000 loss 0.1718 (w 0.1001 mse 0.1015 t 651 new 0.13) lr 1.00e-05 gnorm 0.126 3.29s mem 81.1GB +[2026-09-14 14:17:05] step 4553/5000 loss 0.2640 (w 0.1678 mse 0.1650 t 905 new 0.11) lr 1.00e-05 gnorm 0.115 2.82s mem 81.1GB +[2026-09-14 14:17:08] step 4554/5000 loss 0.2715 (w 0.2020 mse 0.1894 t 768 new 0.23) lr 1.00e-05 gnorm 0.129 3.03s mem 81.1GB +[2026-09-14 14:17:12] step 4555/5000 loss 0.1474 (w 0.3201 mse 0.3148 t 966 new 0.20) lr 1.00e-05 gnorm 0.118 3.40s mem 81.1GB +[2026-09-14 14:17:15] step 4556/5000 loss 0.3343 (w 0.2530 mse 0.2390 t 969 new 0.24) lr 1.00e-05 gnorm 0.134 2.82s mem 81.1GB +[2026-09-14 14:17:18] step 4557/5000 loss 0.2171 (w 0.2180 mse 0.2461 t 171 new 0.16) lr 1.00e-05 gnorm 0.127 3.34s mem 81.1GB +[2026-09-14 14:17:21] step 4558/5000 loss 0.1769 (w 0.2213 mse 0.2325 t 386 new 0.21) lr 1.00e-05 gnorm 0.158 3.10s mem 81.1GB +[2026-09-14 14:17:24] step 4559/5000 loss 0.3800 (w 0.5298 mse 0.5215 t 189 new 0.17) lr 1.00e-05 gnorm 0.123 2.84s mem 81.1GB +[2026-09-14 14:17:27] step 4560/5000 loss 0.1593 (w 0.3439 mse 0.3426 t 992 new 0.21) lr 1.00e-05 gnorm 0.177 3.03s mem 81.1GB +[2026-09-14 14:17:30] step 4561/5000 loss 0.2701 (w 0.1926 mse 0.1848 t 720 new 0.12) lr 1.00e-05 gnorm 0.122 3.13s mem 81.1GB +[2026-09-14 14:17:33] step 4562/5000 loss 0.2308 (w 0.1587 mse 0.1625 t 860 new 0.19) lr 1.00e-05 gnorm 0.105 2.84s mem 81.1GB +[2026-09-14 14:17:36] step 4563/5000 loss 0.2287 (w 0.1431 mse 0.1468 t 826 new 0.13) lr 1.00e-05 gnorm 0.136 3.32s mem 81.1GB +[2026-09-14 14:17:39] step 4564/5000 loss 0.3048 (w 0.2858 mse 0.2774 t 804 new 0.26) lr 1.00e-05 gnorm 0.125 3.15s mem 81.1GB +[2026-09-14 14:17:42] step 4565/5000 loss 0.1848 (w 0.1582 mse 0.1639 t 836 new 0.22) lr 1.00e-05 gnorm 0.149 2.83s mem 81.1GB +[2026-09-14 14:17:45] step 4566/5000 loss 0.1735 (w 0.2923 mse 0.2908 t 962 new 0.19) lr 1.00e-05 gnorm 0.467 3.07s mem 81.1GB +[2026-09-14 14:17:48] step 4567/5000 loss 0.2970 (w 0.2257 mse 0.2292 t 747 new 0.19) lr 1.00e-05 gnorm 0.126 3.12s mem 81.1GB +[2026-09-14 14:17:51] step 4568/5000 loss 0.2194 (w 0.1817 mse 0.1783 t 977 new 0.18) lr 1.00e-05 gnorm 0.185 2.83s mem 81.1GB +[2026-09-14 14:17:55] step 4569/5000 loss 0.2073 (w 0.2085 mse 0.1986 t 923 new 0.23) lr 1.00e-05 gnorm 0.248 3.58s mem 81.1GB +[2026-09-14 14:17:58] step 4570/5000 loss 0.2396 (w 0.2642 mse 0.2561 t 921 new 0.16) lr 1.00e-05 gnorm 0.129 3.07s mem 81.1GB +[2026-09-14 14:18:01] step 4571/5000 loss 0.0922 (w 0.2937 mse 0.2810 t 995 new 0.23) lr 1.00e-05 gnorm 0.114 2.84s mem 81.1GB +[2026-09-14 14:18:04] step 4572/5000 loss 0.1809 (w 0.1597 mse 0.1530 t 903 new 0.25) lr 1.00e-05 gnorm 0.139 3.42s mem 81.1GB +[2026-09-14 14:18:07] step 4573/5000 loss 0.2454 (w 0.2539 mse 0.2510 t 889 new 0.21) lr 1.00e-05 gnorm 0.231 2.85s mem 81.1GB +[2026-09-14 14:18:10] step 4574/5000 loss 0.2687 (w 0.2286 mse 0.2156 t 875 new 0.19) lr 1.00e-05 gnorm 0.146 2.85s mem 81.1GB +[2026-09-14 14:18:13] step 4575/5000 loss 0.3793 (w 0.2669 mse 0.2592 t 634 new 0.19) lr 1.00e-05 gnorm 0.124 3.13s mem 81.1GB +[2026-09-14 14:18:16] step 4576/5000 loss 0.2058 (w 0.1408 mse 0.1499 t 729 new 0.21) lr 1.00e-05 gnorm 0.156 3.13s mem 81.1GB +[2026-09-14 14:18:19] step 4577/5000 loss 0.3141 (w 0.1986 mse 0.1955 t 750 new 0.23) lr 1.00e-05 gnorm 0.221 2.84s mem 81.1GB +[2026-09-14 14:18:23] step 4578/5000 loss 0.1905 (w 0.2564 mse 0.2455 t 924 new 0.22) lr 1.00e-05 gnorm 0.136 3.40s mem 81.1GB +[2026-09-14 14:18:26] step 4579/5000 loss 0.1699 (w 0.1023 mse 0.1072 t 431 new 0.09) lr 1.00e-05 gnorm 0.107 2.84s mem 81.1GB +[2026-09-14 14:18:29] step 4580/5000 loss 0.1184 (w 0.2349 mse 0.2353 t 911 new 0.13) lr 1.00e-05 gnorm 0.119 3.28s mem 81.1GB +[2026-09-14 14:18:32] step 4581/5000 loss 0.1745 (w 0.2201 mse 0.2272 t 951 new 0.09) lr 1.00e-05 gnorm 0.149 3.42s mem 81.1GB +[2026-09-14 14:18:35] step 4582/5000 loss 0.1474 (w 0.1447 mse 0.1546 t 907 new 0.24) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +[2026-09-14 14:18:38] step 4583/5000 loss 0.3074 (w 0.2161 mse 0.2071 t 825 new 0.23) lr 1.00e-05 gnorm 0.111 2.83s mem 81.1GB +[2026-09-14 14:18:41] step 4584/5000 loss 0.1815 (w 0.2675 mse 0.2631 t 953 new 0.22) lr 1.00e-05 gnorm 0.133 3.41s mem 81.1GB +[2026-09-14 14:18:44] step 4585/5000 loss 0.1644 (w 0.1901 mse 0.1852 t 804 new 0.19) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +[2026-09-14 14:18:48] step 4586/5000 loss 0.2592 (w 0.1783 mse 0.1659 t 726 new 0.20) lr 1.00e-05 gnorm 0.147 3.31s mem 81.1GB +[2026-09-14 14:18:51] step 4587/5000 loss 0.0753 (w 0.3186 mse 0.3092 t 1000 new 0.17) lr 1.00e-05 gnorm 0.106 3.41s mem 81.1GB +[2026-09-14 14:18:54] step 4588/5000 loss 0.2094 (w 0.1978 mse 0.2011 t 511 new 0.10) lr 1.00e-05 gnorm 0.108 2.85s mem 81.1GB +[2026-09-14 14:18:57] step 4589/5000 loss 0.2504 (w 0.2773 mse 0.2792 t 958 new 0.15) lr 1.00e-05 gnorm 0.106 2.84s mem 81.1GB +[2026-09-14 14:19:00] step 4590/5000 loss 0.1800 (w 0.3247 mse 0.3053 t 683 new 0.24) lr 1.00e-05 gnorm 0.240 3.17s mem 81.1GB +[2026-09-14 14:19:03] step 4591/5000 loss 0.1729 (w 0.2130 mse 0.1964 t 802 new 0.18) lr 1.00e-05 gnorm 0.149 2.84s mem 81.1GB +[2026-09-14 14:19:06] step 4592/5000 loss 0.1834 (w 0.2238 mse 0.2053 t 815 new 0.22) lr 1.00e-05 gnorm 0.126 3.30s mem 81.1GB +[2026-09-14 14:19:09] step 4593/5000 loss 0.3890 (w 0.2072 mse 0.2036 t 917 new 0.23) lr 1.00e-05 gnorm 0.463 3.29s mem 81.1GB +[2026-09-14 14:19:12] step 4594/5000 loss 0.2537 (w 0.2626 mse 0.2595 t 568 new 0.24) lr 1.00e-05 gnorm 0.276 2.85s mem 81.1GB +[2026-09-14 14:19:15] step 4595/5000 loss 0.4102 (w 0.2213 mse 0.2273 t 978 new 0.23) lr 1.00e-05 gnorm 0.138 2.85s mem 81.1GB +[2026-09-14 14:19:18] step 4596/5000 loss 0.3066 (w 0.2646 mse 0.2567 t 927 new 0.20) lr 1.00e-05 gnorm 0.167 3.19s mem 81.1GB +[2026-09-14 14:19:21] step 4597/5000 loss 0.1500 (w 0.1627 mse 0.1683 t 948 new 0.19) lr 1.00e-05 gnorm 0.193 2.98s mem 81.1GB +[2026-09-14 14:19:25] step 4598/5000 loss 0.3390 (w 0.3676 mse 0.3584 t 288 new 0.21) lr 1.00e-05 gnorm 0.145 3.59s mem 81.1GB +[2026-09-14 14:19:29] step 4599/5000 loss 0.2805 (w 0.1989 mse 0.1832 t 937 new 0.24) lr 1.00e-05 gnorm 0.159 3.75s mem 81.1GB +[2026-09-14 14:19:32] step 4600/5000 loss 0.2299 (w 0.2871 mse 0.2952 t 998 new 0.24) lr 1.00e-05 gnorm 0.157 2.97s mem 81.1GB +[2026-09-14 14:19:35] step 4601/5000 loss 0.3378 (w 0.2473 mse 0.2377 t 404 new 0.19) lr 1.00e-05 gnorm 0.129 3.25s mem 81.1GB +[2026-09-14 14:19:38] step 4602/5000 loss 0.3209 (w 0.2813 mse 0.2737 t 492 new 0.20) lr 1.00e-05 gnorm 0.166 3.42s mem 81.1GB +[2026-09-14 14:19:41] step 4603/5000 loss 0.1230 (w 0.2016 mse 0.1990 t 955 new 0.20) lr 1.00e-05 gnorm 0.134 2.96s mem 81.1GB +[2026-09-14 14:19:45] step 4604/5000 loss 0.1130 (w 0.1881 mse 0.1729 t 975 new 0.26) lr 1.00e-05 gnorm 0.094 3.69s mem 81.1GB +[2026-09-14 14:19:48] step 4605/5000 loss 0.2742 (w 0.3019 mse 0.2955 t 315 new 0.19) lr 1.00e-05 gnorm 0.120 3.27s mem 81.1GB +[2026-09-14 14:19:51] step 4606/5000 loss 0.2144 (w 0.1700 mse 0.1635 t 942 new 0.26) lr 1.00e-05 gnorm 0.165 2.93s mem 81.1GB +[2026-09-14 14:19:55] step 4607/5000 loss 0.1471 (w 0.1833 mse 0.1866 t 778 new 0.21) lr 1.00e-05 gnorm 0.217 3.31s mem 81.1GB +[2026-09-14 14:19:58] step 4608/5000 loss 0.1545 (w 0.0924 mse 0.0969 t 715 new 0.07) lr 1.00e-05 gnorm 0.110 3.26s mem 81.1GB +[2026-09-14 14:20:01] step 4609/5000 loss 0.1190 (w 0.1682 mse 0.1748 t 941 new 0.19) lr 1.00e-05 gnorm 0.164 3.03s mem 81.1GB +[2026-09-14 14:20:05] step 4610/5000 loss 0.2002 (w 0.2051 mse 0.2106 t 979 new 0.18) lr 1.00e-05 gnorm 0.262 3.66s mem 81.1GB +[2026-09-14 14:20:09] step 4611/5000 loss 0.2673 (w 0.2495 mse 0.2431 t 537 new 0.15) lr 1.00e-05 gnorm 0.104 3.39s mem 81.1GB +[2026-09-14 14:20:11] step 4612/5000 loss 0.1706 (w 0.1497 mse 0.1550 t 720 new 0.15) lr 1.00e-05 gnorm 0.131 2.96s mem 81.1GB +[2026-09-14 14:20:15] step 4613/5000 loss 0.2227 (w 0.2773 mse 0.2673 t 909 new 0.16) lr 1.00e-05 gnorm 0.103 3.78s mem 81.1GB +[2026-09-14 14:20:18] step 4614/5000 loss 0.1819 (w 0.1609 mse 0.1623 t 599 new 0.23) lr 1.00e-05 gnorm 0.115 2.93s mem 81.1GB +[2026-09-14 14:20:22] step 4615/5000 loss 0.1952 (w 0.2383 mse 0.2196 t 948 new 0.18) lr 1.00e-05 gnorm 0.182 3.31s mem 81.1GB +[2026-09-14 14:20:25] step 4616/5000 loss 0.2249 (w 0.3325 mse 0.3453 t 189 new 0.17) lr 1.00e-05 gnorm 0.099 3.41s mem 81.1GB +[2026-09-14 14:20:28] step 4617/5000 loss 0.1738 (w 0.2605 mse 0.2544 t 544 new 0.22) lr 1.00e-05 gnorm 0.114 3.21s mem 81.1GB +[2026-09-14 14:20:31] step 4618/5000 loss 0.2697 (w 0.1652 mse 0.1708 t 952 new 0.24) lr 1.00e-05 gnorm 0.127 2.93s mem 81.1GB +[2026-09-14 14:20:35] step 4619/5000 loss 0.2988 (w 0.2209 mse 0.2211 t 596 new 0.20) lr 1.00e-05 gnorm 0.130 3.73s mem 81.1GB +[2026-09-14 14:20:38] step 4620/5000 loss 0.2391 (w 0.1591 mse 0.1433 t 839 new 0.25) lr 1.00e-05 gnorm 0.232 3.07s mem 81.1GB +[2026-09-14 14:20:42] step 4621/5000 loss 0.3140 (w 0.1561 mse 0.1540 t 836 new 0.24) lr 1.00e-05 gnorm 0.170 3.66s mem 81.1GB +[2026-09-14 14:20:46] step 4622/5000 loss 0.1696 (w 0.2903 mse 0.2828 t 827 new 0.17) lr 1.00e-05 gnorm 0.093 4.39s mem 81.1GB +[2026-09-14 14:20:50] step 4623/5000 loss 0.3825 (w 0.2440 mse 0.2275 t 809 new 0.13) lr 1.00e-05 gnorm 0.144 3.95s mem 81.1GB +[2026-09-14 14:20:54] step 4624/5000 loss 0.2485 (w 0.2815 mse 0.2657 t 909 new 0.15) lr 1.00e-05 gnorm 0.122 3.78s mem 81.1GB +[2026-09-14 14:20:58] step 4625/5000 loss 0.1313 (w 0.2581 mse 0.2391 t 992 new 0.25) lr 1.00e-05 gnorm 0.097 4.12s mem 81.1GB +[2026-09-14 14:21:01] step 4626/5000 loss 0.3111 (w 0.1223 mse 0.1184 t 838 new 0.20) lr 1.00e-05 gnorm 0.553 3.20s mem 81.1GB +[2026-09-14 14:21:05] step 4627/5000 loss 0.2782 (w 0.3053 mse 0.2955 t 999 new 0.24) lr 1.00e-05 gnorm 0.148 3.32s mem 81.1GB +[2026-09-14 14:21:08] step 4628/5000 loss 0.3116 (w 0.2982 mse 0.2730 t 957 new 0.20) lr 1.00e-05 gnorm 0.197 3.55s mem 81.1GB +[2026-09-14 14:21:11] step 4629/5000 loss 0.3055 (w 0.2335 mse 0.2189 t 769 new 0.25) lr 1.00e-05 gnorm 0.139 2.93s mem 81.1GB +[2026-09-14 14:21:14] step 4630/5000 loss 0.2082 (w 0.2661 mse 0.2571 t 693 new 0.16) lr 1.00e-05 gnorm 0.155 3.10s mem 81.1GB +[2026-09-14 14:21:18] step 4631/5000 loss 0.1858 (w 0.2161 mse 0.2223 t 990 new 0.20) lr 1.00e-05 gnorm 0.111 3.58s mem 81.1GB +[2026-09-14 14:21:21] step 4632/5000 loss 0.1922 (w 0.2889 mse 0.2693 t 920 new 0.22) lr 1.00e-05 gnorm 0.210 3.01s mem 81.1GB +[2026-09-14 14:21:25] step 4633/5000 loss 0.2365 (w 0.2600 mse 0.2453 t 975 new 0.27) lr 1.00e-05 gnorm 0.145 3.66s mem 81.1GB +[2026-09-14 14:21:28] step 4634/5000 loss 0.3562 (w 0.1359 mse 0.1406 t 748 new 0.26) lr 1.00e-05 gnorm 0.168 3.26s mem 81.1GB +[2026-09-14 14:21:34] step 4635/5000 loss 0.1000 (w 0.1682 mse 0.1642 t 940 new 0.24) lr 1.00e-05 gnorm 0.126 6.09s mem 81.1GB +[2026-09-14 14:21:42] step 4636/5000 loss 0.2080 (w 0.2089 mse 0.1937 t 886 new 0.22) lr 1.00e-05 gnorm 0.129 7.55s mem 81.1GB +[2026-09-14 14:21:49] step 4637/5000 loss 0.2657 (w 0.2708 mse 0.2673 t 950 new 0.20) lr 1.00e-05 gnorm 0.129 7.35s mem 81.1GB +[2026-09-14 14:21:56] step 4638/5000 loss 0.1394 (w 0.1073 mse 0.1138 t 614 new 0.09) lr 1.00e-05 gnorm 0.109 7.47s mem 81.1GB +[2026-09-14 14:22:05] step 4639/5000 loss 0.1929 (w 0.2430 mse 0.2356 t 732 new 0.19) lr 1.00e-05 gnorm 0.113 8.98s mem 81.1GB +[2026-09-14 14:22:13] step 4640/5000 loss 0.2239 (w 0.3053 mse 0.2965 t 997 new 0.17) lr 1.00e-05 gnorm 0.179 7.92s mem 81.1GB +[2026-09-14 14:22:22] step 4641/5000 loss 0.2759 (w 0.2986 mse 0.2988 t 989 new 0.01) lr 1.00e-05 gnorm 0.095 8.27s mem 81.1GB +[2026-09-14 14:22:29] step 4642/5000 loss 0.1499 (w 0.2568 mse 0.2424 t 932 new 0.22) lr 1.00e-05 gnorm 0.150 7.73s mem 81.1GB +[2026-09-14 14:22:36] step 4643/5000 loss 0.0640 (w 0.1580 mse 0.1584 t 979 new 0.22) lr 1.00e-05 gnorm 0.119 6.99s mem 81.1GB +[2026-09-14 14:22:43] step 4644/5000 loss 0.1516 (w 0.1739 mse 0.1761 t 657 new 0.22) lr 1.00e-05 gnorm 0.132 6.97s mem 81.1GB +[2026-09-14 14:22:48] step 4645/5000 loss 0.2314 (w 0.1833 mse 0.1796 t 935 new 0.17) lr 1.00e-05 gnorm 0.190 4.70s mem 81.1GB +[2026-09-14 14:22:52] step 4646/5000 loss 0.2682 (w 0.2930 mse 0.2830 t 960 new 0.20) lr 1.00e-05 gnorm 0.150 3.70s mem 81.1GB +[2026-09-14 14:22:55] step 4647/5000 loss 0.2796 (w 0.1552 mse 0.1599 t 775 new 0.18) lr 1.00e-05 gnorm 0.151 2.97s mem 81.1GB +[2026-09-14 14:22:58] step 4648/5000 loss 0.2231 (w 0.2622 mse 0.2695 t 978 new 0.21) lr 1.00e-05 gnorm 0.134 3.40s mem 81.1GB +[2026-09-14 14:23:01] step 4649/5000 loss 0.2950 (w 0.3217 mse 0.3114 t 506 new 0.23) lr 1.00e-05 gnorm 0.105 3.20s mem 81.1GB +[2026-09-14 14:23:05] step 4650/5000 loss 0.2348 (w 0.2516 mse 0.2376 t 810 new 0.19) lr 1.00e-05 gnorm 0.134 3.74s mem 81.1GB +[2026-09-14 14:23:09] step 4651/5000 loss 0.2242 (w 0.1374 mse 0.1329 t 868 new 0.20) lr 1.00e-05 gnorm 0.143 3.62s mem 81.1GB +[2026-09-14 14:23:13] step 4652/5000 loss 0.2031 (w 0.1259 mse 0.1292 t 580 new 0.16) lr 1.00e-05 gnorm 0.111 3.98s mem 81.1GB +[2026-09-14 14:23:17] step 4653/5000 loss 0.4216 (w 0.2666 mse 0.2605 t 712 new 0.12) lr 1.00e-05 gnorm 0.140 4.29s mem 81.1GB +[2026-09-14 14:23:21] step 4654/5000 loss 0.2115 (w 0.3597 mse 0.3609 t 996 new 0.26) lr 1.00e-05 gnorm 0.122 3.90s mem 81.1GB +[2026-09-14 14:23:24] step 4655/5000 loss 0.1537 (w 0.3190 mse 0.3160 t 962 new 0.16) lr 1.00e-05 gnorm 0.105 3.45s mem 81.1GB +[2026-09-14 14:23:28] step 4656/5000 loss 0.2401 (w 0.2637 mse 0.2542 t 623 new 0.25) lr 1.00e-05 gnorm 0.133 4.09s mem 81.1GB +[2026-09-14 14:23:32] step 4657/5000 loss 0.1841 (w 0.1064 mse 0.1251 t 925 new 0.26) lr 1.00e-05 gnorm 0.119 3.67s mem 81.1GB +[2026-09-14 14:23:36] step 4658/5000 loss 0.2611 (w 0.2305 mse 0.2218 t 792 new 0.22) lr 1.00e-05 gnorm 0.088 4.26s mem 81.1GB +[2026-09-14 14:23:41] step 4659/5000 loss 0.1652 (w 0.2104 mse 0.2207 t 328 new 0.23) lr 1.00e-05 gnorm 0.120 4.49s mem 81.1GB +[2026-09-14 14:23:45] step 4660/5000 loss 0.3452 (w 0.6202 mse 0.6214 t 114 new 0.19) lr 1.00e-05 gnorm 0.175 4.24s mem 81.1GB +[2026-09-14 14:23:48] step 4661/5000 loss 0.2576 (w 0.1899 mse 0.1859 t 951 new 0.17) lr 1.00e-05 gnorm 0.120 3.01s mem 81.1GB +[2026-09-14 14:23:51] step 4662/5000 loss 0.1588 (w 0.4359 mse 0.4029 t 978 new 0.19) lr 1.00e-05 gnorm 0.155 3.20s mem 81.1GB +[2026-09-14 14:23:55] step 4663/5000 loss 0.2686 (w 0.1522 mse 0.1621 t 861 new 0.24) lr 1.00e-05 gnorm 0.243 3.37s mem 81.1GB +[2026-09-14 14:23:58] step 4664/5000 loss 0.2218 (w 0.2594 mse 0.2594 t 999 new 0.25) lr 1.00e-05 gnorm 0.129 3.22s mem 81.1GB +[2026-09-14 14:24:01] step 4665/5000 loss 0.1880 (w 0.2487 mse 0.2597 t 990 new 0.15) lr 1.00e-05 gnorm 0.098 3.37s mem 81.1GB +[2026-09-14 14:24:05] step 4666/5000 loss 0.1029 (w 0.0944 mse 0.1078 t 890 new 0.23) lr 1.00e-05 gnorm 0.124 4.09s mem 81.1GB +[2026-09-14 14:24:09] step 4667/5000 loss 0.2216 (w 0.2400 mse 0.2353 t 975 new 0.19) lr 1.00e-05 gnorm 0.156 3.24s mem 81.1GB +[2026-09-14 14:24:12] step 4668/5000 loss 0.2305 (w 0.3251 mse 0.3285 t 323 new 0.20) lr 1.00e-05 gnorm 0.200 3.33s mem 81.1GB +[2026-09-14 14:24:15] step 4669/5000 loss 0.1721 (w 0.2407 mse 0.2088 t 987 new 0.23) lr 1.00e-05 gnorm 0.104 3.05s mem 81.1GB +[2026-09-14 14:24:18] step 4670/5000 loss 0.1524 (w 0.1171 mse 0.1171 t 829 new 0.00) lr 1.00e-05 gnorm 0.139 3.15s mem 81.1GB +[2026-09-14 14:24:21] step 4671/5000 loss 0.3219 (w 0.2233 mse 0.2035 t 626 new 0.21) lr 1.00e-05 gnorm 0.124 2.85s mem 81.1GB +[2026-09-14 14:24:24] step 4672/5000 loss 0.3077 (w 0.2840 mse 0.2788 t 982 new 0.13) lr 1.00e-05 gnorm 0.125 3.37s mem 81.1GB +[2026-09-14 14:24:27] step 4673/5000 loss 0.1355 (w 0.2204 mse 0.2182 t 821 new 0.22) lr 1.00e-05 gnorm 0.336 3.09s mem 81.1GB +[2026-09-14 14:24:31] step 4674/5000 loss 0.3086 (w 0.1638 mse 0.1523 t 624 new 0.19) lr 1.00e-05 gnorm 0.176 3.15s mem 81.1GB +[2026-09-14 14:24:34] step 4675/5000 loss 0.2746 (w 0.3698 mse 0.3467 t 968 new 0.21) lr 1.00e-05 gnorm 0.130 3.08s mem 81.1GB +[2026-09-14 14:24:37] step 4676/5000 loss 0.1756 (w 0.3411 mse 0.3112 t 987 new 0.25) lr 1.00e-05 gnorm 0.126 3.06s mem 81.1GB +[2026-09-14 14:24:40] step 4677/5000 loss 0.1482 (w 0.2989 mse 0.2909 t 989 new 0.22) lr 1.00e-05 gnorm 0.203 2.83s mem 81.1GB +[2026-09-14 14:24:43] step 4678/5000 loss 0.2348 (w 0.1781 mse 0.1718 t 947 new 0.17) lr 1.00e-05 gnorm 0.109 3.34s mem 81.1GB +[2026-09-14 14:24:46] step 4679/5000 loss 0.2142 (w 0.1240 mse 0.1234 t 835 new 0.23) lr 1.00e-05 gnorm 0.217 3.12s mem 81.1GB +[2026-09-14 14:24:49] step 4680/5000 loss 0.1947 (w 0.1732 mse 0.1773 t 528 new 0.24) lr 1.00e-05 gnorm 0.201 3.10s mem 81.1GB +[2026-09-14 14:24:52] step 4681/5000 loss 0.1902 (w 0.1029 mse 0.1104 t 907 new 0.12) lr 1.00e-05 gnorm 0.158 3.03s mem 81.1GB +[2026-09-14 14:24:55] step 4682/5000 loss 0.3474 (w 0.2531 mse 0.2562 t 981 new 0.22) lr 1.00e-05 gnorm 0.139 3.12s mem 81.1GB +[2026-09-14 14:24:58] step 4683/5000 loss 0.3447 (w 0.2068 mse 0.1887 t 786 new 0.25) lr 1.00e-05 gnorm 0.172 3.06s mem 81.1GB +[2026-09-14 14:25:01] step 4684/5000 loss 0.1554 (w 0.2489 mse 0.2499 t 999 new 0.14) lr 1.00e-05 gnorm 0.122 3.14s mem 81.1GB +[2026-09-14 14:25:05] step 4685/5000 loss 0.0765 (w 0.1712 mse 0.1879 t 997 new 0.21) lr 1.00e-05 gnorm 0.177 3.10s mem 81.1GB +[2026-09-14 14:25:08] step 4686/5000 loss 0.2362 (w 0.1103 mse 0.1131 t 797 new 0.25) lr 1.00e-05 gnorm 0.143 3.11s mem 81.1GB +[2026-09-14 14:25:11] step 4687/5000 loss 0.1861 (w 0.1985 mse 0.1873 t 884 new 0.24) lr 1.00e-05 gnorm 0.212 3.07s mem 81.1GB +[2026-09-14 14:25:14] step 4688/5000 loss 0.1295 (w 0.1703 mse 0.1697 t 880 new 0.22) lr 1.00e-05 gnorm 0.104 2.84s mem 81.1GB +[2026-09-14 14:25:17] step 4689/5000 loss 0.1947 (w 0.2406 mse 0.2469 t 984 new 0.23) lr 1.00e-05 gnorm 0.127 3.10s mem 81.1GB +[2026-09-14 14:25:20] step 4690/5000 loss 0.2511 (w 0.2884 mse 0.2833 t 535 new 0.23) lr 1.00e-05 gnorm 0.123 3.10s mem 81.1GB +[2026-09-14 14:25:23] step 4691/5000 loss 0.3008 (w 0.2905 mse 0.2681 t 928 new 0.19) lr 1.00e-05 gnorm 0.137 3.18s mem 81.1GB +[2026-09-14 14:25:26] step 4692/5000 loss 0.1975 (w 0.1905 mse 0.1904 t 973 new 0.09) lr 1.00e-05 gnorm 0.176 3.12s mem 81.1GB +[2026-09-14 14:25:29] step 4693/5000 loss 0.1530 (w 0.1510 mse 0.1519 t 956 new 0.22) lr 1.00e-05 gnorm 0.112 3.06s mem 81.1GB +[2026-09-14 14:25:32] step 4694/5000 loss 0.4289 (w 0.1893 mse 0.1838 t 811 new 0.23) lr 1.00e-05 gnorm 0.205 2.83s mem 81.1GB +[2026-09-14 14:25:36] step 4695/5000 loss 0.2506 (w 0.3072 mse 0.3070 t 813 new 0.25) lr 1.00e-05 gnorm 0.124 3.32s mem 81.1GB +[2026-09-14 14:25:39] step 4696/5000 loss 0.2964 (w 0.2240 mse 0.2087 t 923 new 0.18) lr 1.00e-05 gnorm 0.139 3.30s mem 81.1GB +[2026-09-14 14:25:42] step 4697/5000 loss 0.2499 (w 0.1726 mse 0.1740 t 859 new 0.20) lr 1.00e-05 gnorm 0.141 2.83s mem 81.1GB +[2026-09-14 14:25:45] step 4698/5000 loss 0.0919 (w 0.1406 mse 0.1512 t 973 new 0.16) lr 1.00e-05 gnorm 0.127 3.15s mem 81.1GB +[2026-09-14 14:25:48] step 4699/5000 loss 0.1777 (w 0.3260 mse 0.3231 t 949 new 0.20) lr 1.00e-05 gnorm 0.286 3.13s mem 81.1GB +[2026-09-14 14:25:51] step 4700/5000 loss 0.2409 (w 0.1810 mse 0.1972 t 996 new 0.24) lr 1.00e-05 gnorm 0.153 2.83s mem 81.1GB +[2026-09-14 14:25:54] step 4701/5000 loss 0.2315 (w 0.3166 mse 0.3272 t 244 new 0.15) lr 1.00e-05 gnorm 0.205 3.27s mem 81.1GB +[2026-09-14 14:25:58] step 4702/5000 loss 0.3158 (w 0.2823 mse 0.2775 t 525 new 0.20) lr 1.00e-05 gnorm 0.127 3.36s mem 81.1GB +[2026-09-14 14:26:00] step 4703/5000 loss 0.0802 (w 0.1455 mse 0.1430 t 843 new 0.27) lr 1.00e-05 gnorm 0.181 2.83s mem 81.1GB +[2026-09-14 14:26:04] step 4704/5000 loss 0.3331 (w 0.4177 mse 0.4384 t 171 new 0.24) lr 1.00e-05 gnorm 0.188 3.48s mem 81.1GB +[2026-09-14 14:26:07] step 4705/5000 loss 0.2956 (w 0.2586 mse 0.2547 t 840 new 0.22) lr 1.00e-05 gnorm 0.151 3.12s mem 81.1GB +[2026-09-14 14:26:10] step 4706/5000 loss 0.2779 (w 0.1934 mse 0.1919 t 807 new 0.21) lr 1.00e-05 gnorm 0.266 2.83s mem 81.1GB +[2026-09-14 14:26:13] step 4707/5000 loss 0.2546 (w 0.2763 mse 0.2665 t 470 new 0.23) lr 1.00e-05 gnorm 0.166 3.36s mem 81.1GB +[2026-09-14 14:26:16] step 4708/5000 loss 0.1495 (w 0.1513 mse 0.1504 t 966 new 0.23) lr 1.00e-05 gnorm 0.130 3.10s mem 81.1GB +[2026-09-14 14:26:19] step 4709/5000 loss 0.3249 (w 0.3158 mse 0.3110 t 511 new 0.17) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +[2026-09-14 14:26:23] step 4710/5000 loss 0.2026 (w 0.2688 mse 0.2431 t 875 new 0.19) lr 1.00e-05 gnorm 0.124 3.19s mem 81.1GB +[2026-09-14 14:26:26] step 4711/5000 loss 0.2680 (w 0.1731 mse 0.1575 t 949 new 0.23) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +[2026-09-14 14:26:29] step 4712/5000 loss 0.2294 (w 0.2081 mse 0.2070 t 688 new 0.08) lr 1.00e-05 gnorm 0.126 3.00s mem 81.1GB +[2026-09-14 14:26:32] step 4713/5000 loss 0.1832 (w 0.2196 mse 0.2143 t 873 new 0.20) lr 1.00e-05 gnorm 0.135 3.28s mem 81.1GB +[2026-09-14 14:26:35] step 4714/5000 loss 0.1480 (w 0.1807 mse 0.1770 t 742 new 0.24) lr 1.00e-05 gnorm 0.096 3.12s mem 81.1GB +[2026-09-14 14:26:38] step 4715/5000 loss 0.2422 (w 0.1841 mse 0.1784 t 990 new 0.21) lr 1.00e-05 gnorm 0.244 2.82s mem 81.1GB +[2026-09-14 14:26:41] step 4716/5000 loss 0.1745 (w 0.1459 mse 0.1444 t 868 new 0.27) lr 1.00e-05 gnorm 0.111 3.41s mem 81.1GB +[2026-09-14 14:26:44] step 4717/5000 loss 0.2025 (w 0.2168 mse 0.2097 t 869 new 0.17) lr 1.00e-05 gnorm 0.177 3.05s mem 81.1GB +[2026-09-14 14:26:47] step 4718/5000 loss 0.2357 (w 0.3985 mse 0.3640 t 997 new 0.19) lr 1.00e-05 gnorm 0.167 3.12s mem 81.1GB +[2026-09-14 14:26:51] step 4719/5000 loss 0.2667 (w 0.2324 mse 0.2162 t 673 new 0.22) lr 1.00e-05 gnorm 0.144 3.44s mem 81.1GB +[2026-09-14 14:26:54] step 4720/5000 loss 0.3052 (w 0.1222 mse 0.1301 t 607 new 0.12) lr 1.00e-05 gnorm 0.142 2.83s mem 81.1GB +[2026-09-14 14:26:57] step 4721/5000 loss 0.2625 (w 0.3087 mse 0.2828 t 946 new 0.15) lr 1.00e-05 gnorm 0.128 2.82s mem 81.1GB +[2026-09-14 14:27:00] step 4722/5000 loss 0.2334 (w 0.2822 mse 0.2626 t 972 new 0.25) lr 1.00e-05 gnorm 0.175 3.41s mem 81.1GB +[2026-09-14 14:27:03] step 4723/5000 loss 0.1844 (w 0.1984 mse 0.1971 t 898 new 0.12) lr 1.00e-05 gnorm 0.170 3.07s mem 81.1GB +[2026-09-14 14:27:06] step 4724/5000 loss 0.2804 (w 0.0994 mse 0.1065 t 785 new 0.23) lr 1.00e-05 gnorm 0.256 3.13s mem 81.1GB +[2026-09-14 14:27:09] step 4725/5000 loss 0.2010 (w 0.2125 mse 0.2083 t 940 new 0.21) lr 1.00e-05 gnorm 0.104 3.09s mem 81.1GB +[2026-09-14 14:27:12] step 4726/5000 loss 0.2191 (w 0.2272 mse 0.2323 t 444 new 0.16) lr 1.00e-05 gnorm 0.116 2.82s mem 81.1GB +[2026-09-14 14:27:15] step 4727/5000 loss 0.1820 (w 0.1119 mse 0.1361 t 988 new 0.22) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +[2026-09-14 14:27:18] step 4728/5000 loss 0.2433 (w 0.1753 mse 0.1677 t 609 new 0.23) lr 1.00e-05 gnorm 0.247 3.18s mem 81.1GB +[2026-09-14 14:27:21] step 4729/5000 loss 0.1975 (w 0.2200 mse 0.2139 t 994 new 0.16) lr 1.00e-05 gnorm 0.125 2.84s mem 81.1GB +[2026-09-14 14:27:24] step 4730/5000 loss 0.3547 (w 0.2716 mse 0.2716 t 336 new 0.00) lr 1.00e-05 gnorm 0.154 3.13s mem 81.1GB +[2026-09-14 14:27:28] step 4731/5000 loss 0.2822 (w 0.2350 mse 0.2621 t 328 new 0.17) lr 1.00e-05 gnorm 0.294 3.33s mem 81.1GB +[2026-09-14 14:27:31] step 4732/5000 loss 0.1249 (w 0.1748 mse 0.1904 t 966 new 0.16) lr 1.00e-05 gnorm 0.132 2.83s mem 81.1GB +[2026-09-14 14:27:34] step 4733/5000 loss 0.1857 (w 0.3707 mse 0.3372 t 989 new 0.23) lr 1.00e-05 gnorm 0.143 3.13s mem 81.1GB +[2026-09-14 14:27:37] step 4734/5000 loss 0.1533 (w 0.1623 mse 0.1610 t 946 new 0.08) lr 1.00e-05 gnorm 0.283 3.35s mem 81.1GB +[2026-09-14 14:27:40] step 4735/5000 loss 0.1898 (w 0.1917 mse 0.1917 t 995 new 0.20) lr 1.00e-05 gnorm 0.230 2.82s mem 81.1GB +[2026-09-14 14:27:43] step 4736/5000 loss 0.3096 (w 0.2581 mse 0.2750 t 959 new 0.25) lr 1.00e-05 gnorm 0.124 3.12s mem 81.1GB +[2026-09-14 14:27:46] step 4737/5000 loss 0.1784 (w 0.2540 mse 0.2524 t 921 new 0.24) lr 1.00e-05 gnorm 0.151 3.41s mem 81.1GB +[2026-09-14 14:27:49] step 4738/5000 loss 0.2238 (w 0.2125 mse 0.2074 t 940 new 0.15) lr 1.00e-05 gnorm 0.121 2.83s mem 81.1GB +[2026-09-14 14:27:52] step 4739/5000 loss 0.2008 (w 0.3061 mse 0.2938 t 921 new 0.29) lr 1.00e-05 gnorm 0.129 3.17s mem 81.1GB +[2026-09-14 14:27:56] step 4740/5000 loss 0.1998 (w 0.1488 mse 0.1585 t 834 new 0.19) lr 1.00e-05 gnorm 0.110 3.42s mem 81.1GB +[2026-09-14 14:27:59] step 4741/5000 loss 0.1198 (w 0.3359 mse 0.3203 t 995 new 0.23) lr 1.00e-05 gnorm 0.134 2.84s mem 81.1GB +[2026-09-14 14:28:02] step 4742/5000 loss 0.2241 (w 0.2314 mse 0.2304 t 975 new 0.22) lr 1.00e-05 gnorm 0.132 3.14s mem 81.1GB +[2026-09-14 14:28:05] step 4743/5000 loss 0.1865 (w 0.3672 mse 0.3484 t 974 new 0.23) lr 1.00e-05 gnorm 0.180 3.32s mem 81.1GB +[2026-09-14 14:28:08] step 4744/5000 loss 0.1945 (w 0.2763 mse 0.2651 t 551 new 0.21) lr 1.00e-05 gnorm 0.229 2.83s mem 81.1GB +[2026-09-14 14:28:11] step 4745/5000 loss 0.1884 (w 0.2399 mse 0.2292 t 955 new 0.26) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +[2026-09-14 14:28:14] step 4746/5000 loss 0.1926 (w 0.2435 mse 0.2314 t 599 new 0.23) lr 1.00e-05 gnorm 0.209 3.14s mem 81.1GB +[2026-09-14 14:28:17] step 4747/5000 loss 0.1922 (w 0.2101 mse 0.2004 t 937 new 0.20) lr 1.00e-05 gnorm 0.127 2.82s mem 81.1GB +[2026-09-14 14:28:21] step 4748/5000 loss 0.3591 (w 0.4942 mse 0.5124 t 200 new 0.20) lr 1.00e-05 gnorm 0.143 3.43s mem 81.1GB +[2026-09-14 14:28:24] step 4749/5000 loss 0.2801 (w 0.1713 mse 0.1724 t 962 new 0.22) lr 1.00e-05 gnorm 0.132 3.12s mem 81.1GB +[2026-09-14 14:28:26] step 4750/5000 loss 0.1925 (w 0.1287 mse 0.1310 t 720 new 0.20) lr 1.00e-05 gnorm 0.207 2.82s mem 81.1GB +[2026-09-14 14:28:30] step 4751/5000 loss 0.2480 (w 0.1890 mse 0.1800 t 754 new 0.12) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +[2026-09-14 14:28:33] step 4752/5000 loss 0.2646 (w 0.2216 mse 0.2167 t 582 new 0.13) lr 1.00e-05 gnorm 0.156 3.07s mem 81.1GB +[2026-09-14 14:28:35] step 4753/5000 loss 0.3723 (w 0.2975 mse 0.2948 t 747 new 0.23) lr 1.00e-05 gnorm 0.155 2.83s mem 81.1GB +[2026-09-14 14:28:39] step 4754/5000 loss 0.2087 (w 0.1369 mse 0.1379 t 869 new 0.15) lr 1.00e-05 gnorm 0.127 3.38s mem 81.1GB +[2026-09-14 14:28:42] step 4755/5000 loss 0.1163 (w 0.2739 mse 0.2640 t 956 new 0.16) lr 1.00e-05 gnorm 0.121 3.02s mem 81.1GB +[2026-09-14 14:28:45] step 4756/5000 loss 0.2678 (w 0.2272 mse 0.2115 t 846 new 0.24) lr 1.00e-05 gnorm 0.154 2.83s mem 81.1GB +[2026-09-14 14:28:48] step 4757/5000 loss 0.2132 (w 0.2094 mse 0.2077 t 977 new 0.13) lr 1.00e-05 gnorm 0.129 3.09s mem 81.1GB +[2026-09-14 14:28:51] step 4758/5000 loss 0.2664 (w 0.2208 mse 0.2135 t 962 new 0.18) lr 1.00e-05 gnorm 0.158 3.12s mem 81.1GB +[2026-09-14 14:28:54] step 4759/5000 loss 0.2511 (w 0.2446 mse 0.2343 t 892 new 0.21) lr 1.00e-05 gnorm 0.156 2.83s mem 81.1GB +[2026-09-14 14:28:57] step 4760/5000 loss 0.2315 (w 0.2533 mse 0.2389 t 953 new 0.21) lr 1.00e-05 gnorm 0.196 3.44s mem 81.1GB +[2026-09-14 14:29:00] step 4761/5000 loss 0.2801 (w 0.1043 mse 0.1049 t 885 new 0.11) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +[2026-09-14 14:29:03] step 4762/5000 loss 0.1052 (w 0.1584 mse 0.1566 t 798 new 0.23) lr 1.00e-05 gnorm 0.112 2.83s mem 81.1GB +[2026-09-14 14:29:07] step 4763/5000 loss 0.2616 (w 0.2894 mse 0.2733 t 779 new 0.18) lr 1.00e-05 gnorm 0.165 3.43s mem 81.1GB +[2026-09-14 14:29:10] step 4764/5000 loss 0.1549 (w 0.3230 mse 0.3100 t 980 new 0.18) lr 1.00e-05 gnorm 0.131 3.16s mem 81.1GB +[2026-09-14 14:29:13] step 4765/5000 loss 0.2545 (w 0.1248 mse 0.1264 t 824 new 0.22) lr 1.00e-05 gnorm 0.112 3.06s mem 81.1GB +[2026-09-14 14:29:16] step 4766/5000 loss 0.2493 (w 0.1923 mse 0.1932 t 851 new 0.21) lr 1.00e-05 gnorm 0.105 3.34s mem 81.1GB +[2026-09-14 14:29:19] step 4767/5000 loss 0.2146 (w 0.2389 mse 0.2394 t 998 new 0.20) lr 1.00e-05 gnorm 0.119 2.83s mem 81.1GB +[2026-09-14 14:29:22] step 4768/5000 loss 0.2206 (w 0.1209 mse 0.1255 t 861 new 0.20) lr 1.00e-05 gnorm 0.235 2.86s mem 81.1GB +[2026-09-14 14:29:25] step 4769/5000 loss 0.2718 (w 0.1892 mse 0.1895 t 917 new 0.23) lr 1.00e-05 gnorm 0.155 3.06s mem 81.1GB +[2026-09-14 14:29:28] step 4770/5000 loss 0.0871 (w 0.1921 mse 0.1819 t 918 new 0.24) lr 1.00e-05 gnorm 0.113 3.10s mem 81.1GB +[2026-09-14 14:29:31] step 4771/5000 loss 0.2029 (w 0.1834 mse 0.1775 t 926 new 0.13) lr 1.00e-05 gnorm 0.134 3.08s mem 81.1GB +[2026-09-14 14:29:35] step 4772/5000 loss 0.3484 (w 0.2241 mse 0.2253 t 479 new 0.23) lr 1.00e-05 gnorm 0.152 3.37s mem 81.1GB +[2026-09-14 14:29:37] step 4773/5000 loss 0.3101 (w 0.1563 mse 0.1592 t 918 new 0.17) lr 1.00e-05 gnorm 0.134 2.83s mem 81.1GB +[2026-09-14 14:29:40] step 4774/5000 loss 0.2242 (w 0.2676 mse 0.2554 t 937 new 0.21) lr 1.00e-05 gnorm 0.135 2.83s mem 81.1GB +[2026-09-14 14:29:43] step 4775/5000 loss 0.3607 (w 0.1924 mse 0.1863 t 835 new 0.21) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +[2026-09-14 14:29:46] step 4776/5000 loss 0.3238 (w 0.2160 mse 0.1950 t 601 new 0.22) lr 1.00e-05 gnorm 0.159 3.13s mem 81.1GB +[2026-09-14 14:29:50] step 4777/5000 loss 0.1255 (w 0.3204 mse 0.3103 t 974 new 0.20) lr 1.00e-05 gnorm 0.182 3.09s mem 81.1GB +[2026-09-14 14:29:53] step 4778/5000 loss 0.2228 (w 0.1623 mse 0.1641 t 945 new 0.12) lr 1.00e-05 gnorm 0.648 3.48s mem 81.1GB +[2026-09-14 14:29:56] step 4779/5000 loss 0.1100 (w 0.3097 mse 0.2893 t 971 new 0.20) lr 1.00e-05 gnorm 0.565 2.83s mem 81.1GB +[2026-09-14 14:29:59] step 4780/5000 loss 0.2851 (w 0.1865 mse 0.1827 t 830 new 0.13) lr 1.00e-05 gnorm 0.190 3.03s mem 81.1GB +[2026-09-14 14:30:02] step 4781/5000 loss 0.1707 (w 0.1374 mse 0.1259 t 887 new 0.23) lr 1.00e-05 gnorm 0.124 3.41s mem 81.1GB +[2026-09-14 14:30:05] step 4782/5000 loss 0.2147 (w 0.1904 mse 0.1767 t 808 new 0.11) lr 1.00e-05 gnorm 0.139 2.84s mem 81.1GB +[2026-09-14 14:30:08] step 4783/5000 loss 0.2304 (w 0.2130 mse 0.2216 t 459 new 0.26) lr 1.00e-05 gnorm 0.173 3.11s mem 81.1GB +[2026-09-14 14:30:12] step 4784/5000 loss 0.2988 (w 0.3683 mse 0.3658 t 992 new 0.20) lr 1.00e-05 gnorm 0.253 3.44s mem 81.1GB +[2026-09-14 14:30:15] step 4785/5000 loss 0.3303 (w 0.2191 mse 0.2177 t 637 new 0.14) lr 1.00e-05 gnorm 0.142 2.84s mem 81.1GB +[2026-09-14 14:30:18] step 4786/5000 loss 0.3204 (w 0.2423 mse 0.2458 t 431 new 0.25) lr 1.00e-05 gnorm 0.136 3.14s mem 81.1GB +[2026-09-14 14:30:21] step 4787/5000 loss 0.2244 (w 0.2077 mse 0.2009 t 580 new 0.23) lr 1.00e-05 gnorm 0.115 3.15s mem 81.1GB +[2026-09-14 14:30:24] step 4788/5000 loss 0.1749 (w 0.1730 mse 0.1686 t 578 new 0.18) lr 1.00e-05 gnorm 0.114 2.84s mem 81.1GB +[2026-09-14 14:30:27] step 4789/5000 loss 0.1544 (w 0.2587 mse 0.2453 t 467 new 0.27) lr 1.00e-05 gnorm 0.151 3.34s mem 81.1GB +[2026-09-14 14:30:31] step 4790/5000 loss 0.3481 (w 0.1061 mse 0.1114 t 752 new 0.17) lr 1.00e-05 gnorm 0.133 3.46s mem 81.1GB +[2026-09-14 14:30:33] step 4791/5000 loss 0.2396 (w 0.2385 mse 0.2403 t 651 new 0.17) lr 1.00e-05 gnorm 0.122 2.83s mem 81.1GB +[2026-09-14 14:30:36] step 4792/5000 loss 0.2461 (w 0.2297 mse 0.2289 t 404 new 0.15) lr 1.00e-05 gnorm 0.124 3.11s mem 81.1GB +[2026-09-14 14:30:40] step 4793/5000 loss 0.2358 (w 0.0955 mse 0.1066 t 965 new 0.13) lr 1.00e-05 gnorm 0.113 3.14s mem 81.1GB +[2026-09-14 14:30:42] step 4794/5000 loss 0.1677 (w 0.1942 mse 0.1940 t 836 new 0.25) lr 1.00e-05 gnorm 0.171 2.83s mem 81.1GB +[2026-09-14 14:30:46] step 4795/5000 loss 0.2027 (w 0.4726 mse 0.4636 t 982 new 0.19) lr 1.00e-05 gnorm 0.111 3.42s mem 81.1GB +[2026-09-14 14:30:49] step 4796/5000 loss 0.1847 (w 0.1701 mse 0.1656 t 833 new 0.14) lr 1.00e-05 gnorm 0.938 3.13s mem 81.1GB +[2026-09-14 14:30:52] step 4797/5000 loss 0.1268 (w 0.1632 mse 0.1587 t 895 new 0.20) lr 1.00e-05 gnorm 0.123 2.82s mem 81.1GB +[2026-09-14 14:30:55] step 4798/5000 loss 0.2240 (w 0.2397 mse 0.2294 t 962 new 0.25) lr 1.00e-05 gnorm 0.188 3.32s mem 81.1GB +[2026-09-14 14:30:58] step 4799/5000 loss 0.1654 (w 0.2596 mse 0.2511 t 852 new 0.21) lr 1.00e-05 gnorm 0.093 3.06s mem 81.1GB +[2026-09-14 14:31:01] step 4800/5000 loss 0.1686 (w 0.2735 mse 0.2692 t 973 new 0.23) lr 1.00e-05 gnorm 0.222 3.12s mem 81.1GB +[2026-09-14 14:31:05] step 4801/5000 loss 0.1561 (w 0.2153 mse 0.2055 t 915 new 0.22) lr 1.00e-05 gnorm 0.124 3.08s mem 81.1GB +[2026-09-14 14:31:08] step 4802/5000 loss 0.2370 (w 0.2819 mse 0.2745 t 917 new 0.16) lr 1.00e-05 gnorm 0.171 3.38s mem 81.1GB +[2026-09-14 14:31:11] step 4803/5000 loss 0.2100 (w 0.2765 mse 0.2577 t 651 new 0.23) lr 1.00e-05 gnorm 0.138 2.83s mem 81.1GB +[2026-09-14 14:31:14] step 4804/5000 loss 0.2041 (w 0.1776 mse 0.1787 t 761 new 0.13) lr 1.00e-05 gnorm 0.107 3.14s mem 81.1GB +[2026-09-14 14:31:17] step 4805/5000 loss 0.1704 (w 0.2154 mse 0.2130 t 921 new 0.23) lr 1.00e-05 gnorm 0.111 3.12s mem 81.1GB +[2026-09-14 14:31:20] step 4806/5000 loss 0.1457 (w 0.2716 mse 0.2632 t 966 new 0.28) lr 1.00e-05 gnorm 0.110 3.13s mem 81.1GB +[2026-09-14 14:31:23] step 4807/5000 loss 0.1283 (w 0.2154 mse 0.2096 t 816 new 0.11) lr 1.00e-05 gnorm 0.144 3.09s mem 81.1GB +[2026-09-14 14:31:27] step 4808/5000 loss 0.2587 (w 0.4036 mse 0.3761 t 1000 new 0.23) lr 1.00e-05 gnorm 0.133 3.40s mem 81.1GB +[2026-09-14 14:31:29] step 4809/5000 loss 0.1003 (w 0.2305 mse 0.2073 t 946 new 0.21) lr 1.00e-05 gnorm 0.170 2.85s mem 81.1GB +[2026-09-14 14:31:33] step 4810/5000 loss 0.1802 (w 0.2791 mse 0.2699 t 997 new 0.16) lr 1.00e-05 gnorm 0.136 3.14s mem 81.1GB +[2026-09-14 14:31:36] step 4811/5000 loss 0.2717 (w 0.1942 mse 0.1918 t 697 new 0.24) lr 1.00e-05 gnorm 0.116 3.14s mem 81.1GB +[2026-09-14 14:31:39] step 4812/5000 loss 0.3194 (w 0.3234 mse 0.3194 t 375 new 0.07) lr 1.00e-05 gnorm 65.603 3.12s mem 81.1GB +[2026-09-14 14:31:42] step 4813/5000 loss 0.2625 (w 0.2083 mse 0.2084 t 774 new 0.24) lr 1.00e-05 gnorm 0.134 3.29s mem 81.1GB +[2026-09-14 14:31:45] step 4814/5000 loss 0.2786 (w 0.2217 mse 0.2111 t 805 new 0.24) lr 1.00e-05 gnorm 3.319 3.12s mem 81.1GB +[2026-09-14 14:31:48] step 4815/5000 loss 0.1135 (w 0.3358 mse 0.3293 t 984 new 0.19) lr 1.00e-05 gnorm 0.190 3.03s mem 81.1GB +[2026-09-14 14:31:52] step 4816/5000 loss 0.2492 (w 0.2541 mse 0.2551 t 858 new 0.19) lr 1.00e-05 gnorm 0.173 3.12s mem 81.1GB +[2026-09-14 14:31:55] step 4817/5000 loss 0.2090 (w 0.2493 mse 0.2518 t 980 new 0.17) lr 1.00e-05 gnorm 0.122 3.10s mem 81.1GB +[2026-09-14 14:31:58] step 4818/5000 loss 0.1895 (w 0.2712 mse 0.2489 t 941 new 0.21) lr 1.00e-05 gnorm 0.175 2.83s mem 81.1GB +[2026-09-14 14:32:01] step 4819/5000 loss 0.2087 (w 0.3241 mse 0.3270 t 988 new 0.18) lr 1.00e-05 gnorm 0.139 3.33s mem 81.1GB +[2026-09-14 14:32:04] step 4820/5000 loss 0.1287 (w 0.1316 mse 0.1372 t 823 new 0.24) lr 1.00e-05 gnorm 0.164 3.13s mem 81.1GB +[2026-09-14 14:32:07] step 4821/5000 loss 0.2716 (w 0.2685 mse 0.2844 t 511 new 0.17) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +[2026-09-14 14:32:10] step 4822/5000 loss 0.1394 (w 0.1339 mse 0.1393 t 938 new 0.28) lr 1.00e-05 gnorm 0.133 2.83s mem 81.1GB +[2026-09-14 14:32:13] step 4823/5000 loss 0.1307 (w 0.2336 mse 0.2309 t 849 new 0.20) lr 1.00e-05 gnorm 0.150 3.12s mem 81.1GB +[2026-09-14 14:32:16] step 4824/5000 loss 0.2311 (w 0.2744 mse 0.2554 t 835 new 0.21) lr 1.00e-05 gnorm 0.263 3.06s mem 81.1GB +[2026-09-14 14:32:20] step 4825/5000 loss 0.2910 (w 0.2560 mse 0.2381 t 621 new 0.16) lr 1.00e-05 gnorm 0.127 3.33s mem 81.1GB +[2026-09-14 14:32:23] step 4826/5000 loss 0.3332 (w 0.3165 mse 0.3086 t 414 new 0.21) lr 1.00e-05 gnorm 0.117 3.13s mem 81.1GB +[2026-09-14 14:32:26] step 4827/5000 loss 0.4538 (w 0.6112 mse 0.6201 t 134 new 0.25) lr 1.00e-05 gnorm 0.141 3.34s mem 81.1GB +[2026-09-14 14:32:29] step 4828/5000 loss 0.2186 (w 0.2953 mse 0.2802 t 909 new 0.16) lr 1.00e-05 gnorm 0.135 2.82s mem 81.1GB +[2026-09-14 14:32:32] step 4829/5000 loss 0.1326 (w 0.2209 mse 0.2157 t 976 new 0.17) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +[2026-09-14 14:32:35] step 4830/5000 loss 0.1982 (w 0.1244 mse 0.1356 t 731 new 0.18) lr 1.00e-05 gnorm 0.114 3.09s mem 81.1GB +[2026-09-14 14:32:39] step 4831/5000 loss 0.1358 (w 0.2106 mse 0.1971 t 890 new 0.20) lr 1.00e-05 gnorm 0.107 3.31s mem 81.1GB +[2026-09-14 14:32:42] step 4832/5000 loss 0.2372 (w 0.2979 mse 0.2921 t 961 new 0.23) lr 1.00e-05 gnorm 0.175 3.14s mem 81.1GB +[2026-09-14 14:32:45] step 4833/5000 loss 0.1753 (w 0.3019 mse 0.2802 t 956 new 0.27) lr 1.00e-05 gnorm 0.121 3.39s mem 81.1GB +[2026-09-14 14:32:48] step 4834/5000 loss 0.1881 (w 0.1776 mse 0.1842 t 424 new 0.24) lr 1.00e-05 gnorm 0.124 2.83s mem 81.1GB +[2026-09-14 14:32:51] step 4835/5000 loss 0.2812 (w 0.3213 mse 0.3238 t 476 new 0.16) lr 1.00e-05 gnorm 0.156 3.10s mem 81.1GB +[2026-09-14 14:32:54] step 4836/5000 loss 0.2822 (w 0.2085 mse 0.2086 t 610 new 0.20) lr 1.00e-05 gnorm 5.294 3.29s mem 81.1GB +[2026-09-14 14:32:58] step 4837/5000 loss 0.2262 (w 0.2418 mse 0.2268 t 874 new 0.25) lr 1.00e-05 gnorm 0.151 3.35s mem 81.1GB +[2026-09-14 14:33:01] step 4838/5000 loss 0.3083 (w 0.2468 mse 0.2370 t 907 new 0.20) lr 1.00e-05 gnorm 0.122 3.17s mem 81.1GB +[2026-09-14 14:33:04] step 4839/5000 loss 0.3476 (w 0.2012 mse 0.2062 t 681 new 0.17) lr 1.00e-05 gnorm 0.138 3.03s mem 81.1GB +[2026-09-14 14:33:07] step 4840/5000 loss 0.2351 (w 0.1776 mse 0.1881 t 942 new 0.11) lr 1.00e-05 gnorm 0.154 3.15s mem 81.1GB +[2026-09-14 14:33:10] step 4841/5000 loss 0.1424 (w 0.1731 mse 0.1669 t 945 new 0.24) lr 1.00e-05 gnorm 0.259 2.84s mem 81.1GB +[2026-09-14 14:33:13] step 4842/5000 loss 0.2951 (w 0.3071 mse 0.2945 t 786 new 0.19) lr 1.00e-05 gnorm 0.134 3.37s mem 81.1GB +[2026-09-14 14:33:16] step 4843/5000 loss 0.3054 (w 0.2946 mse 0.2846 t 610 new 0.21) lr 1.00e-05 gnorm 0.345 3.11s mem 81.1GB +[2026-09-14 14:33:20] step 4844/5000 loss 0.2638 (w 0.1410 mse 0.1449 t 700 new 0.23) lr 1.00e-05 gnorm 0.110 3.07s mem 81.1GB +[2026-09-14 14:33:23] step 4845/5000 loss 0.1702 (w 0.1762 mse 0.1779 t 983 new 0.24) lr 1.00e-05 gnorm 0.142 3.09s mem 81.1GB +[2026-09-14 14:33:26] step 4846/5000 loss 0.1473 (w 0.1988 mse 0.1888 t 712 new 0.17) lr 1.00e-05 gnorm 0.121 3.10s mem 81.1GB +[2026-09-14 14:33:29] step 4847/5000 loss 0.2769 (w 0.5466 mse 0.5539 t 146 new 0.24) lr 1.00e-05 gnorm 0.107 2.84s mem 81.1GB +[2026-09-14 14:33:32] step 4848/5000 loss 0.1625 (w 0.2484 mse 0.2355 t 980 new 0.23) lr 1.00e-05 gnorm 0.156 3.39s mem 81.1GB +[2026-09-14 14:33:35] step 4849/5000 loss 0.2952 (w 0.1545 mse 0.1584 t 845 new 0.23) lr 1.00e-05 gnorm 0.103 3.06s mem 81.1GB +[2026-09-14 14:33:38] step 4850/5000 loss 0.2829 (w 0.3241 mse 0.3156 t 421 new 0.24) lr 1.00e-05 gnorm 0.156 3.11s mem 81.1GB +[2026-09-14 14:33:41] step 4851/5000 loss 0.2847 (w 0.2304 mse 0.2181 t 694 new 0.13) lr 1.00e-05 gnorm 0.178 3.03s mem 81.1GB +[2026-09-14 14:33:44] step 4852/5000 loss 0.1901 (w 0.2661 mse 0.2601 t 955 new 0.20) lr 1.00e-05 gnorm 0.174 3.12s mem 81.1GB +[2026-09-14 14:33:47] step 4853/5000 loss 0.1641 (w 0.3458 mse 0.3202 t 895 new 0.25) lr 1.00e-05 gnorm 0.118 3.06s mem 81.1GB +[2026-09-14 14:33:50] step 4854/5000 loss 0.2279 (w 0.5781 mse 0.5772 t 140 new 0.15) lr 1.00e-05 gnorm 0.143 3.13s mem 81.1GB +[2026-09-14 14:33:53] step 4855/5000 loss 0.1047 (w 0.2519 mse 0.2373 t 851 new 0.24) lr 1.00e-05 gnorm 0.309 3.04s mem 81.1GB +[2026-09-14 14:33:57] step 4856/5000 loss 0.2248 (w 0.2841 mse 0.2645 t 892 new 0.22) lr 1.00e-05 gnorm 0.207 3.34s mem 81.1GB +[2026-09-14 14:34:00] step 4857/5000 loss 0.1472 (w 0.3136 mse 0.3097 t 957 new 0.13) lr 1.00e-05 gnorm 0.121 3.03s mem 81.1GB +[2026-09-14 14:34:03] step 4858/5000 loss 0.1874 (w 0.1860 mse 0.1897 t 988 new 0.11) lr 1.00e-05 gnorm 0.137 3.12s mem 81.1GB +[2026-09-14 14:34:06] step 4859/5000 loss 0.2508 (w 0.2862 mse 0.3061 t 991 new 0.26) lr 1.00e-05 gnorm 0.148 3.05s mem 81.1GB +[2026-09-14 14:34:09] step 4860/5000 loss 0.2456 (w 0.2951 mse 0.2842 t 955 new 0.19) lr 1.00e-05 gnorm 0.114 3.14s mem 81.1GB +[2026-09-14 14:34:12] step 4861/5000 loss 0.3325 (w 0.2596 mse 0.2627 t 695 new 0.14) lr 1.00e-05 gnorm 0.121 3.17s mem 81.1GB +[2026-09-14 14:34:16] step 4862/5000 loss 0.1340 (w 0.1819 mse 0.1891 t 777 new 0.22) lr 1.00e-05 gnorm 0.087 3.34s mem 81.1GB +[2026-09-14 14:34:19] step 4863/5000 loss 0.2118 (w 0.1946 mse 0.1992 t 840 new 0.18) lr 1.00e-05 gnorm 0.111 3.03s mem 81.1GB +[2026-09-14 14:34:22] step 4864/5000 loss 0.2013 (w 0.4648 mse 0.4408 t 994 new 0.24) lr 1.00e-05 gnorm 0.131 3.12s mem 81.1GB +[2026-09-14 14:34:25] step 4865/5000 loss 0.1586 (w 0.2284 mse 0.2258 t 992 new 0.22) lr 1.00e-05 gnorm 0.111 3.11s mem 81.1GB +[2026-09-14 14:34:28] step 4866/5000 loss 0.2520 (w 0.3685 mse 0.3797 t 292 new 0.24) lr 1.00e-05 gnorm 0.117 3.33s mem 81.1GB +[2026-09-14 14:34:31] step 4867/5000 loss 0.1128 (w 0.3426 mse 0.3368 t 989 new 0.30) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +[2026-09-14 14:34:34] step 4868/5000 loss 0.1934 (w 0.3059 mse 0.3046 t 976 new 0.19) lr 1.00e-05 gnorm 0.134 3.12s mem 81.1GB +[2026-09-14 14:34:37] step 4869/5000 loss 0.1484 (w 0.4134 mse 0.3775 t 996 new 0.23) lr 1.00e-05 gnorm 0.113 3.07s mem 81.1GB +[2026-09-14 14:34:40] step 4870/5000 loss 0.2443 (w 0.2763 mse 0.2668 t 871 new 0.20) lr 1.00e-05 gnorm 0.138 3.13s mem 81.1GB +[2026-09-14 14:34:44] step 4871/5000 loss 0.1752 (w 0.1374 mse 0.1480 t 976 new 0.18) lr 1.00e-05 gnorm 0.098 3.45s mem 81.1GB +[2026-09-14 14:34:47] step 4872/5000 loss 0.0700 (w 0.1491 mse 0.1370 t 878 new 0.22) lr 1.00e-05 gnorm 0.141 3.08s mem 81.1GB +[2026-09-14 14:34:50] step 4873/5000 loss 0.1395 (w 0.3212 mse 0.3134 t 965 new 0.21) lr 1.00e-05 gnorm 0.149 3.12s mem 81.1GB +[2026-09-14 14:34:54] step 4874/5000 loss 0.1295 (w 0.1740 mse 0.1745 t 857 new 0.20) lr 1.00e-05 gnorm 0.119 3.40s mem 81.1GB +[2026-09-14 14:34:57] step 4875/5000 loss 0.1770 (w 0.1509 mse 0.1472 t 997 new 0.23) lr 1.00e-05 gnorm 0.155 2.82s mem 81.1GB +[2026-09-14 14:34:59] step 4876/5000 loss 0.2189 (w 0.1793 mse 0.1694 t 907 new 0.25) lr 1.00e-05 gnorm 0.114 2.83s mem 81.1GB +[2026-09-14 14:35:02] step 4877/5000 loss 0.1225 (w 0.1461 mse 0.1589 t 936 new 0.24) lr 1.00e-05 gnorm 0.112 3.12s mem 81.1GB +[2026-09-14 14:35:06] step 4878/5000 loss 0.2974 (w 0.2005 mse 0.2056 t 986 new 0.22) lr 1.00e-05 gnorm 0.316 3.11s mem 81.1GB +[2026-09-14 14:35:09] step 4879/5000 loss 0.1927 (w 0.3270 mse 0.3009 t 843 new 0.26) lr 1.00e-05 gnorm 0.112 3.14s mem 81.1GB +[2026-09-14 14:35:12] step 4880/5000 loss 0.1709 (w 0.3434 mse 0.3295 t 985 new 0.20) lr 1.00e-05 gnorm 0.162 2.82s mem 81.1GB +[2026-09-14 14:35:15] step 4881/5000 loss 0.3914 (w 0.2650 mse 0.2564 t 885 new 0.25) lr 1.00e-05 gnorm 0.139 3.28s mem 81.1GB +[2026-09-14 14:35:18] step 4882/5000 loss 0.2093 (w 0.2439 mse 0.2363 t 876 new 0.24) lr 1.00e-05 gnorm 0.112 2.82s mem 81.1GB +[2026-09-14 14:35:21] step 4883/5000 loss 0.1829 (w 0.1878 mse 0.1843 t 928 new 0.25) lr 1.00e-05 gnorm 0.105 3.36s mem 81.1GB +[2026-09-14 14:35:24] step 4884/5000 loss 0.2925 (w 0.3361 mse 0.3263 t 963 new 0.16) lr 1.00e-05 gnorm 0.270 3.12s mem 81.1GB +[2026-09-14 14:35:27] step 4885/5000 loss 0.3147 (w 0.5927 mse 0.5931 t 146 new 0.22) lr 1.00e-05 gnorm 0.180 3.09s mem 81.1GB +[2026-09-14 14:35:30] step 4886/5000 loss 0.2137 (w 0.2493 mse 0.2353 t 868 new 0.22) lr 1.00e-05 gnorm 0.100 2.83s mem 81.1GB +[2026-09-14 14:35:33] step 4887/5000 loss 0.2849 (w 0.1016 mse 0.0982 t 906 new 0.24) lr 1.00e-05 gnorm 0.153 3.29s mem 81.1GB +[2026-09-14 14:35:36] step 4888/5000 loss 0.1573 (w 0.2218 mse 0.2243 t 817 new 0.17) lr 1.00e-05 gnorm 0.115 2.83s mem 81.1GB +[2026-09-14 14:35:39] step 4889/5000 loss 0.3243 (w 0.2239 mse 0.2130 t 749 new 0.24) lr 1.00e-05 gnorm 0.344 3.16s mem 81.1GB +[2026-09-14 14:35:42] step 4890/5000 loss 0.2374 (w 0.1685 mse 0.1760 t 950 new 0.15) lr 1.00e-05 gnorm 0.129 3.08s mem 81.1GB +[2026-09-14 14:35:46] step 4891/5000 loss 0.1587 (w 0.3693 mse 0.3793 t 979 new 0.19) lr 1.00e-05 gnorm 0.134 3.07s mem 81.1GB +[2026-09-14 14:35:48] step 4892/5000 loss 0.2983 (w 0.1932 mse 0.1893 t 592 new 0.18) lr 1.00e-05 gnorm 0.120 2.83s mem 81.1GB +[2026-09-14 14:35:52] step 4893/5000 loss 0.3434 (w 0.1772 mse 0.1781 t 939 new 0.20) lr 1.00e-05 gnorm 0.302 3.40s mem 81.1GB +[2026-09-14 14:35:55] step 4894/5000 loss 0.2121 (w 0.2668 mse 0.2567 t 990 new 0.26) lr 1.00e-05 gnorm 0.114 3.05s mem 81.1GB +[2026-09-14 14:35:58] step 4895/5000 loss 0.2106 (w 0.2701 mse 0.2666 t 479 new 0.19) lr 1.00e-05 gnorm 0.183 3.08s mem 81.1GB +[2026-09-14 14:36:01] step 4896/5000 loss 0.1991 (w 0.3678 mse 0.3880 t 238 new 0.22) lr 1.00e-05 gnorm 0.107 3.08s mem 81.1GB +[2026-09-14 14:36:04] step 4897/5000 loss 0.3060 (w 0.1815 mse 0.1631 t 740 new 0.25) lr 1.00e-05 gnorm 0.142 3.10s mem 81.1GB +[2026-09-14 14:36:07] step 4898/5000 loss 0.1808 (w 0.2511 mse 0.2390 t 976 new 0.22) lr 1.00e-05 gnorm 0.197 2.83s mem 81.1GB +[2026-09-14 14:36:10] step 4899/5000 loss 0.2090 (w 0.2413 mse 0.2293 t 865 new 0.25) lr 1.00e-05 gnorm 0.153 3.42s mem 81.1GB +[2026-09-14 14:36:13] step 4900/5000 loss 0.3318 (w 0.5288 mse 0.5443 t 165 new 0.18) lr 1.00e-05 gnorm 0.168 3.09s mem 81.1GB +[2026-09-14 14:36:17] step 4901/5000 loss 0.1660 (w 0.1980 mse 0.1859 t 705 new 0.26) lr 1.00e-05 gnorm 0.106 3.43s mem 81.1GB +[2026-09-14 14:36:20] step 4902/5000 loss 0.2265 (w 0.2247 mse 0.2146 t 668 new 0.11) lr 1.00e-05 gnorm 0.132 2.82s mem 81.1GB +[2026-09-14 14:36:23] step 4903/5000 loss 0.2841 (w 0.2454 mse 0.2329 t 787 new 0.21) lr 1.00e-05 gnorm 0.194 3.11s mem 81.1GB +[2026-09-14 14:36:26] step 4904/5000 loss 0.1801 (w 0.2503 mse 0.2428 t 904 new 0.19) lr 1.00e-05 gnorm 0.117 2.82s mem 81.1GB +[2026-09-14 14:36:29] step 4905/5000 loss 0.3145 (w 0.1801 mse 0.1865 t 881 new 0.19) lr 1.00e-05 gnorm 0.119 3.45s mem 81.1GB +[2026-09-14 14:36:32] step 4906/5000 loss 0.3293 (w 0.2711 mse 0.2629 t 500 new 0.24) lr 1.00e-05 gnorm 0.209 3.14s mem 81.1GB +[2026-09-14 14:36:35] step 4907/5000 loss 0.2602 (w 0.1160 mse 0.1117 t 988 new 0.09) lr 1.00e-05 gnorm 0.125 3.10s mem 81.1GB +[2026-09-14 14:36:38] step 4908/5000 loss 0.2547 (w 0.2636 mse 0.2357 t 988 new 0.23) lr 1.00e-05 gnorm 0.117 2.83s mem 81.1GB +[2026-09-14 14:36:41] step 4909/5000 loss 0.4561 (w 0.2199 mse 0.2178 t 621 new 0.12) lr 1.00e-05 gnorm 0.132 3.09s mem 81.1GB +[2026-09-14 14:36:44] step 4910/5000 loss 0.2077 (w 0.3191 mse 0.3034 t 965 new 0.25) lr 1.00e-05 gnorm 0.089 2.82s mem 81.1GB +[2026-09-14 14:36:47] step 4911/5000 loss 0.1793 (w 0.3478 mse 0.3240 t 979 new 0.29) lr 1.00e-05 gnorm 0.097 3.08s mem 81.1GB +[2026-09-14 14:36:50] step 4912/5000 loss 0.2159 (w 0.1510 mse 0.1638 t 999 new 0.20) lr 1.00e-05 gnorm 0.125 3.13s mem 81.1GB +[2026-09-14 14:36:53] step 4913/5000 loss 0.1488 (w 0.1682 mse 0.1676 t 803 new 0.17) lr 1.00e-05 gnorm 0.162 3.03s mem 81.1GB +[2026-09-14 14:36:56] step 4914/5000 loss 0.1299 (w 0.2069 mse 0.2176 t 972 new 0.23) lr 1.00e-05 gnorm 0.135 3.13s mem 81.1GB +[2026-09-14 14:37:00] step 4915/5000 loss 0.2672 (w 0.2322 mse 0.2234 t 605 new 0.18) lr 1.00e-05 gnorm 0.102 3.07s mem 81.1GB +[2026-09-14 14:37:02] step 4916/5000 loss 0.1678 (w 0.1161 mse 0.1210 t 769 new 0.15) lr 1.00e-05 gnorm 0.186 2.82s mem 81.1GB +[2026-09-14 14:37:05] step 4917/5000 loss 0.2828 (w 0.2689 mse 0.2762 t 301 new 0.26) lr 1.00e-05 gnorm 0.124 3.10s mem 81.1GB +[2026-09-14 14:37:09] step 4918/5000 loss 0.3183 (w 0.2753 mse 0.2678 t 450 new 0.16) lr 1.00e-05 gnorm 0.171 3.11s mem 81.1GB +[2026-09-14 14:37:12] step 4919/5000 loss 0.2427 (w 0.2151 mse 0.2150 t 920 new 0.16) lr 1.00e-05 gnorm 0.174 3.03s mem 81.1GB +[2026-09-14 14:37:15] step 4920/5000 loss 0.1741 (w 0.3090 mse 0.3007 t 983 new 0.25) lr 1.00e-05 gnorm 0.108 3.10s mem 81.1GB +[2026-09-14 14:37:18] step 4921/5000 loss 0.2860 (w 0.2504 mse 0.2437 t 987 new 0.25) lr 1.00e-05 gnorm 0.147 2.82s mem 81.1GB +[2026-09-14 14:37:21] step 4922/5000 loss 0.1878 (w 0.1459 mse 0.1623 t 982 new 0.20) lr 1.00e-05 gnorm 0.190 3.08s mem 81.1GB +[2026-09-14 14:37:24] step 4923/5000 loss 0.2230 (w 0.2195 mse 0.2132 t 560 new 0.13) lr 1.00e-05 gnorm 0.109 3.08s mem 81.1GB +[2026-09-14 14:37:27] step 4924/5000 loss 0.1670 (w 0.2130 mse 0.2028 t 976 new 0.21) lr 1.00e-05 gnorm 0.125 3.38s mem 81.1GB +[2026-09-14 14:37:30] step 4925/5000 loss 0.3199 (w 0.2425 mse 0.2311 t 957 new 0.18) lr 1.00e-05 gnorm 0.164 3.08s mem 81.1GB +[2026-09-14 14:37:33] step 4926/5000 loss 0.2108 (w 0.1333 mse 0.1390 t 914 new 0.14) lr 1.00e-05 gnorm 0.310 3.13s mem 81.1GB +[2026-09-14 14:37:36] step 4927/5000 loss 0.1902 (w 0.1647 mse 0.1607 t 969 new 0.17) lr 1.00e-05 gnorm 0.108 2.83s mem 81.1GB +[2026-09-14 14:37:39] step 4928/5000 loss 0.1985 (w 0.3178 mse 0.3166 t 980 new 0.09) lr 1.00e-05 gnorm 0.152 3.06s mem 81.1GB +[2026-09-14 14:37:42] step 4929/5000 loss 0.2147 (w 0.2764 mse 0.2832 t 965 new 0.21) lr 1.00e-05 gnorm 0.115 3.08s mem 81.1GB +[2026-09-14 14:37:45] step 4930/5000 loss 0.2027 (w 0.1500 mse 0.1465 t 818 new 0.18) lr 1.00e-05 gnorm 0.124 3.17s mem 81.1GB +[2026-09-14 14:37:48] step 4931/5000 loss 0.1448 (w 0.2350 mse 0.2309 t 977 new 0.26) lr 1.00e-05 gnorm 0.087 3.05s mem 81.1GB +[2026-09-14 14:37:52] step 4932/5000 loss 0.1322 (w 0.4110 mse 0.3825 t 962 new 0.24) lr 1.00e-05 gnorm 0.302 3.28s mem 81.1GB +[2026-09-14 14:37:55] step 4933/5000 loss 0.2835 (w 0.2826 mse 0.2609 t 929 new 0.22) lr 1.00e-05 gnorm 0.095 2.82s mem 81.1GB +[2026-09-14 14:37:58] step 4934/5000 loss 0.2168 (w 0.3048 mse 0.2875 t 950 new 0.26) lr 1.00e-05 gnorm 0.246 3.11s mem 81.1GB +[2026-09-14 14:38:01] step 4935/5000 loss 0.2295 (w 0.5928 mse 0.6070 t 177 new 0.20) lr 1.00e-05 gnorm 0.131 3.35s mem 81.1GB +[2026-09-14 14:38:04] step 4936/5000 loss 0.1803 (w 0.2193 mse 0.2054 t 831 new 0.20) lr 1.00e-05 gnorm 0.105 3.06s mem 81.1GB +[2026-09-14 14:38:07] step 4937/5000 loss 0.1833 (w 0.1100 mse 0.1016 t 797 new 0.22) lr 1.00e-05 gnorm 0.107 3.01s mem 81.1GB +[2026-09-14 14:38:10] step 4938/5000 loss 0.1789 (w 0.2286 mse 0.2239 t 995 new 0.19) lr 1.00e-05 gnorm 0.158 3.33s mem 81.1GB +[2026-09-14 14:38:13] step 4939/5000 loss 0.1983 (w 0.2245 mse 0.2247 t 624 new 0.22) lr 1.00e-05 gnorm 0.106 2.83s mem 81.1GB +[2026-09-14 14:38:16] step 4940/5000 loss 0.1478 (w 0.2703 mse 0.2631 t 964 new 0.15) lr 1.00e-05 gnorm 0.130 3.13s mem 81.1GB +[2026-09-14 14:38:20] step 4941/5000 loss 0.2584 (w 0.2832 mse 0.2686 t 910 new 0.22) lr 1.00e-05 gnorm 0.173 3.35s mem 81.1GB +[2026-09-14 14:38:23] step 4942/5000 loss 0.1654 (w 0.2166 mse 0.2176 t 961 new 0.22) lr 1.00e-05 gnorm 0.143 3.15s mem 81.1GB +[2026-09-14 14:38:26] step 4943/5000 loss 0.3245 (w 0.2317 mse 0.2400 t 826 new 0.18) lr 1.00e-05 gnorm 0.138 3.27s mem 81.1GB +[2026-09-14 14:38:29] step 4944/5000 loss 0.2138 (w 0.2452 mse 0.2474 t 945 new 0.19) lr 1.00e-05 gnorm 0.167 3.07s mem 81.1GB +[2026-09-14 14:38:32] step 4945/5000 loss 0.1711 (w 0.2170 mse 0.2070 t 800 new 0.17) lr 1.00e-05 gnorm 0.134 3.09s mem 81.1GB +[2026-09-14 14:38:36] step 4946/5000 loss 0.1452 (w 0.2117 mse 0.1985 t 829 new 0.18) lr 1.00e-05 gnorm 0.134 3.28s mem 81.1GB +[2026-09-14 14:38:39] step 4947/5000 loss 0.2148 (w 0.2979 mse 0.2863 t 479 new 0.20) lr 1.00e-05 gnorm 0.098 3.44s mem 81.1GB +[2026-09-14 14:38:42] step 4948/5000 loss 0.2959 (w 0.1771 mse 0.1890 t 992 new 0.10) lr 1.00e-05 gnorm 0.097 2.94s mem 81.1GB +[2026-09-14 14:38:45] step 4949/5000 loss 0.2745 (w 0.1581 mse 0.1579 t 870 new 0.22) lr 1.00e-05 gnorm 0.115 3.38s mem 81.1GB +[2026-09-14 14:38:49] step 4950/5000 loss 0.3145 (w 0.1834 mse 0.1730 t 809 new 0.21) lr 1.00e-05 gnorm 0.118 3.26s mem 81.1GB +[2026-09-14 14:38:52] step 4951/5000 loss 0.0882 (w 0.2589 mse 0.2739 t 994 new 0.19) lr 1.00e-05 gnorm 0.127 3.76s mem 81.1GB +[2026-09-14 14:38:57] step 4952/5000 loss 0.1310 (w 0.1988 mse 0.2010 t 854 new 0.20) lr 1.00e-05 gnorm 0.155 4.34s mem 81.1GB +[2026-09-14 14:39:01] step 4953/5000 loss 0.2845 (w 0.3267 mse 0.3119 t 998 new 0.26) lr 1.00e-05 gnorm 0.110 4.51s mem 81.1GB +[2026-09-14 14:39:06] step 4954/5000 loss 0.2328 (w 0.1927 mse 0.1963 t 932 new 0.20) lr 1.00e-05 gnorm 0.122 4.44s mem 81.1GB +[2026-09-14 14:39:12] step 4955/5000 loss 0.2722 (w 0.3216 mse 0.3185 t 997 new 0.16) lr 1.00e-05 gnorm 0.157 6.20s mem 81.1GB +[2026-09-14 14:39:18] step 4956/5000 loss 0.1123 (w 0.2228 mse 0.2213 t 533 new 0.26) lr 1.00e-05 gnorm 0.157 6.36s mem 81.1GB +[2026-09-14 14:39:25] step 4957/5000 loss 0.2421 (w 0.1909 mse 0.1870 t 832 new 0.23) lr 1.00e-05 gnorm 0.101 6.21s mem 81.1GB +[2026-09-14 14:39:31] step 4958/5000 loss 0.3254 (w 0.2403 mse 0.2434 t 948 new 0.25) lr 1.00e-05 gnorm 0.172 6.31s mem 81.1GB +[2026-09-14 14:39:37] step 4959/5000 loss 0.2548 (w 0.2943 mse 0.2878 t 440 new 0.29) lr 1.00e-05 gnorm 0.140 6.41s mem 81.1GB +[2026-09-14 14:39:44] step 4960/5000 loss 0.2432 (w 0.3401 mse 0.3202 t 947 new 0.13) lr 1.00e-05 gnorm 0.169 6.51s mem 81.1GB +[2026-09-14 14:39:50] step 4961/5000 loss 0.1600 (w 0.1612 mse 0.1536 t 836 new 0.22) lr 1.00e-05 gnorm 0.110 6.39s mem 81.1GB +[2026-09-14 14:39:57] step 4962/5000 loss 0.2080 (w 0.1757 mse 0.1741 t 802 new 0.19) lr 1.00e-05 gnorm 0.121 6.29s mem 81.1GB +[2026-09-14 14:40:03] step 4963/5000 loss 0.1669 (w 0.1273 mse 0.1290 t 938 new 0.11) lr 1.00e-05 gnorm 0.137 6.22s mem 81.1GB +[2026-09-14 14:40:09] step 4964/5000 loss 0.2960 (w 0.2590 mse 0.2455 t 764 new 0.25) lr 1.00e-05 gnorm 0.127 6.37s mem 81.1GB +[2026-09-14 14:40:16] step 4965/5000 loss 0.2029 (w 0.0962 mse 0.1071 t 867 new 0.23) lr 1.00e-05 gnorm 0.227 6.46s mem 81.1GB +[2026-09-14 14:40:22] step 4966/5000 loss 0.2534 (w 0.2020 mse 0.1991 t 644 new 0.21) lr 1.00e-05 gnorm 0.103 6.28s mem 81.1GB +[2026-09-14 14:40:28] step 4967/5000 loss 0.2682 (w 0.2646 mse 0.2542 t 885 new 0.20) lr 1.00e-05 gnorm 0.127 6.33s mem 81.1GB +[2026-09-14 14:40:35] step 4968/5000 loss 0.2566 (w 0.2381 mse 0.2229 t 832 new 0.17) lr 1.00e-05 gnorm 0.134 6.31s mem 81.1GB +[2026-09-14 14:40:41] step 4969/5000 loss 0.1634 (w 0.2087 mse 0.2258 t 984 new 0.12) lr 1.00e-05 gnorm 0.126 6.36s mem 81.1GB +[2026-09-14 14:40:47] step 4970/5000 loss 0.2932 (w 0.2290 mse 0.2171 t 898 new 0.15) lr 1.00e-05 gnorm 0.128 6.48s mem 81.1GB +[2026-09-14 14:40:54] step 4971/5000 loss 0.3042 (w 0.1928 mse 0.1893 t 546 new 0.14) lr 1.00e-05 gnorm 0.382 6.51s mem 81.1GB +[2026-09-14 14:41:00] step 4972/5000 loss 0.2912 (w 0.1375 mse 0.1374 t 794 new 0.25) lr 1.00e-05 gnorm 0.162 6.21s mem 81.1GB +[2026-09-14 14:41:06] step 4973/5000 loss 0.2231 (w 0.4339 mse 0.4194 t 444 new 0.20) lr 1.00e-05 gnorm 0.135 6.31s mem 81.1GB +[2026-09-14 14:41:13] step 4974/5000 loss 0.2092 (w 0.2223 mse 0.2131 t 843 new 0.17) lr 1.00e-05 gnorm 0.111 6.21s mem 81.1GB +[2026-09-14 14:41:19] step 4975/5000 loss 0.1917 (w 0.2947 mse 0.2965 t 375 new 0.09) lr 1.00e-05 gnorm 0.112 6.26s mem 81.1GB +[2026-09-14 14:41:26] step 4976/5000 loss 0.2280 (w 0.2636 mse 0.2604 t 553 new 0.23) lr 1.00e-05 gnorm 0.224 6.63s mem 81.1GB +[2026-09-14 14:41:32] step 4977/5000 loss 0.2899 (w 0.1722 mse 0.1723 t 960 new 0.14) lr 1.00e-05 gnorm 0.140 6.52s mem 81.1GB +[2026-09-14 14:41:39] step 4978/5000 loss 0.3036 (w 0.3302 mse 0.3254 t 586 new 0.21) lr 1.00e-05 gnorm 0.117 6.47s mem 81.1GB +[2026-09-14 14:41:45] step 4979/5000 loss 0.2714 (w 0.1061 mse 0.1199 t 837 new 0.21) lr 1.00e-05 gnorm 0.112 6.38s mem 81.1GB +[2026-09-14 14:41:51] step 4980/5000 loss 0.2096 (w 0.1611 mse 0.1646 t 940 new 0.12) lr 1.00e-05 gnorm 0.149 6.18s mem 81.1GB +[2026-09-14 14:41:57] step 4981/5000 loss 0.1823 (w 0.1708 mse 0.1676 t 890 new 0.20) lr 1.00e-05 gnorm 0.152 6.18s mem 81.1GB +[2026-09-14 14:42:04] step 4982/5000 loss 0.2667 (w 0.1259 mse 0.1162 t 852 new 0.20) lr 1.00e-05 gnorm 0.140 6.36s mem 81.1GB +[2026-09-14 14:42:10] step 4983/5000 loss 0.2820 (w 0.2129 mse 0.1916 t 800 new 0.24) lr 1.00e-05 gnorm 0.123 6.46s mem 81.1GB +[2026-09-14 14:42:17] step 4984/5000 loss 0.1465 (w 0.2931 mse 0.2670 t 914 new 0.19) lr 1.00e-05 gnorm 0.108 6.37s mem 81.1GB +[2026-09-14 14:42:23] step 4985/5000 loss 0.2321 (w 0.2451 mse 0.2364 t 975 new 0.20) lr 1.00e-05 gnorm 0.168 6.15s mem 81.1GB +[2026-09-14 14:42:29] step 4986/5000 loss 0.1989 (w 0.2320 mse 0.2282 t 786 new 0.17) lr 1.00e-05 gnorm 1.938 6.35s mem 81.1GB +[2026-09-14 14:42:35] step 4987/5000 loss 0.1935 (w 0.1986 mse 0.1974 t 954 new 0.20) lr 1.00e-05 gnorm 0.115 6.26s mem 81.1GB +[2026-09-14 14:42:42] step 4988/5000 loss 0.1378 (w 0.3291 mse 0.3161 t 992 new 0.10) lr 1.00e-05 gnorm 0.083 6.33s mem 81.1GB +[2026-09-14 14:42:48] step 4989/5000 loss 0.1095 (w 0.2407 mse 0.2291 t 919 new 0.22) lr 1.00e-05 gnorm 0.154 6.26s mem 81.1GB +[2026-09-14 14:42:54] step 4990/5000 loss 0.2642 (w 0.1665 mse 0.1663 t 609 new 0.21) lr 1.00e-05 gnorm 0.145 6.30s mem 81.1GB +[2026-09-14 14:43:00] step 4991/5000 loss 0.1709 (w 0.2341 mse 0.2198 t 940 new 0.18) lr 1.00e-05 gnorm 0.337 6.28s mem 81.1GB +[2026-09-14 14:43:07] step 4992/5000 loss 0.2278 (w 0.2576 mse 0.2474 t 987 new 0.25) lr 1.00e-05 gnorm 0.113 6.27s mem 81.1GB +[2026-09-14 14:43:13] step 4993/5000 loss 0.1575 (w 0.2860 mse 0.2619 t 891 new 0.27) lr 1.00e-05 gnorm 0.103 6.32s mem 81.1GB +[2026-09-14 14:43:20] step 4994/5000 loss 0.1995 (w 0.2689 mse 0.2599 t 978 new 0.20) lr 1.00e-05 gnorm 0.124 6.43s mem 81.1GB +[2026-09-14 14:43:26] step 4995/5000 loss 0.2632 (w 0.1673 mse 0.1570 t 909 new 0.14) lr 1.00e-05 gnorm 0.124 6.54s mem 81.1GB +[2026-09-14 14:43:32] step 4996/5000 loss 0.1611 (w 0.1882 mse 0.1927 t 993 new 0.22) lr 1.00e-05 gnorm 0.134 6.14s mem 81.1GB +[2026-09-14 14:43:38] step 4997/5000 loss 0.1629 (w 0.1843 mse 0.1782 t 960 new 0.12) lr 1.00e-05 gnorm 0.093 6.27s mem 81.1GB +[2026-09-14 14:43:45] step 4998/5000 loss 0.2115 (w 0.3069 mse 0.2769 t 985 new 0.21) lr 1.00e-05 gnorm 0.163 6.25s mem 81.1GB +[2026-09-14 14:43:51] step 4999/5000 loss 0.1556 (w 0.1681 mse 0.1642 t 920 new 0.21) lr 1.00e-05 gnorm 0.131 6.10s mem 81.1GB +[2026-09-14 14:43:57] step 5000/5000 loss 0.1345 (w 0.0886 mse 0.0882 t 781 new 0.15) lr 1.00e-05 gnorm 0.118 6.21s mem 81.1GB +[2026-09-14 14:44:00] [val] step 5000 t=200: w=0.4090 mse=0.4194 (n=16) t=500: w=0.2158 mse=0.2191 (n=16) t=800: w=0.1676 mse=0.1667 (n=16) | mean w=0.2642 mse=0.2684 3s +[2026-09-14 14:44:50] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v2/dits/dit_step5000.safetensors 4093 个张量 37.98 GB +[2026-09-14 14:44:52] [done] step 5000 diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v2/train_log.csv b/backup_2026-09-14/runs/ltx__arope_5k_v2/train_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..6676cf33b3c8437b2a7f9db4628e65a3e28e8d34 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v2/train_log.csv @@ -0,0 +1,5001 @@ +step,loss,loss_w,mse,new_frac,timestep,lr,grad_norm,step_time,mem_gb,epoch +1,0.4861134886741638,0.6059620976448059,0.5935649871826172,0.1806526780128479,964.7545166015625,5.0000000000000004e-08,2.400681734085083,8.40111780166626,79.65066432952881,0 +2,0.5881109237670898,0.35275718569755554,0.3756859004497528,0.24405594170093536,737.33203125,1.0000000000000001e-07,4.467635631561279,3.382420063018799,81.14050149917603,0 +3,0.40993401408195496,0.478519082069397,0.47149914503097534,0.20652680099010468,933.9302368164062,1.5000000000000002e-07,3.0986392498016357,2.8171963691711426,81.14050149917603,0 +4,0.4002649486064911,0.409179151058197,0.40686315298080444,0.24149183928966522,895.4498291015625,2.0000000000000002e-07,2.372929573059082,2.834177017211914,81.14050149917603,0 +5,0.4392046332359314,0.4070003628730774,0.40826842188835144,0.2426573485136032,803.0537109375,2.5000000000000004e-07,2.6316568851470947,2.828507900238037,81.14050149917603,0 +6,0.5086694359779358,0.3529370427131653,0.3591102957725525,0.2209790199995041,588.0953979492188,3.0000000000000004e-07,2.128448247909546,2.826652765274048,81.14050149917603,0 +7,0.40498191118240356,0.49319809675216675,0.4928985834121704,0.23449882864952087,928.5856323242188,3.5000000000000004e-07,2.2066378593444824,2.827890634536743,81.14050149917603,0 +8,0.37691575288772583,0.5039011836051941,0.5013067722320557,0.2186480164527893,934.7079467773438,4.0000000000000003e-07,2.054107427597046,3.3173515796661377,81.14050149917603,0 +9,0.587638258934021,0.4630526900291443,0.4474356174468994,0.23846153914928436,584.1925659179688,4.5000000000000003e-07,3.340952157974243,2.837419271469116,81.14050149917603,0 +10,0.6910364031791687,0.833565890789032,0.8206987380981445,0.23613053560256958,996.0327758789062,5.000000000000001e-07,3.1372299194335938,2.8341288566589355,81.14050149917603,0 +11,0.32567915320396423,0.6444794535636902,0.6301713585853577,0.18275058269500732,984.4981079101562,5.5e-07,1.657284140586853,2.8462376594543457,81.14050149917603,0 +12,0.3848338723182678,0.45064041018486023,0.4536043703556061,0.17179487645626068,961.9138793945312,6.000000000000001e-07,3.1727349758148193,2.834970235824585,81.14050149917603,0 +13,0.5699366927146912,0.3873383104801178,0.37077146768569946,0.19230769574642181,632.5867309570312,6.5e-07,2.6312382221221924,3.206338882446289,81.14050149917603,0 +14,0.8126156330108643,0.7636768817901611,0.7756913304328918,0.16293705999851227,273.5347900390625,7.000000000000001e-07,2.806438446044922,3.1592509746551514,81.14050149917603,0 +15,0.4608103632926941,0.4275253713130951,0.4142078459262848,0.1414918452501297,903.6668701171875,7.5e-07,2.2943389415740967,2.8441450595855713,81.14050149917603,0 +16,0.6754539608955383,0.8538638353347778,0.853775143623352,0.22867132723331451,998.5840454101562,8.000000000000001e-07,2.916374444961548,2.8503639698028564,81.14050149917603,0 +17,0.43136507272720337,0.48388156294822693,0.47607770562171936,0.1818181872367859,938.756103515625,8.500000000000001e-07,1.9372347593307495,2.8555908203125,81.14050149917603,0 +18,0.3202354609966278,0.5758875012397766,0.5931973457336426,0.1459207385778427,989.2814331054688,9.000000000000001e-07,0.8253378868103027,2.838798761367798,81.14050149917603,0 +19,0.42277881503105164,0.720890462398529,0.7413442730903625,0.19720280170440674,100.0000228881836,9.500000000000001e-07,2.0874857902526855,3.221829414367676,81.14050149917603,0 +20,0.2760561406612396,0.40187913179397583,0.38668301701545715,0.250582754611969,955.10791015625,1.0000000000000002e-06,0.815988302230835,2.841149091720581,81.14050149917603,0 +21,0.595650315284729,0.8206416964530945,0.8111703991889954,0.19930069148540497,994.7838134765625,1.0500000000000001e-06,1.9366874694824219,2.847443103790283,81.14050149917603,0 +22,0.3408476710319519,0.43958020210266113,0.42500177025794983,0.23729602992534637,900.5198364257812,1.1e-06,1.9146980047225952,2.845316171646118,81.14050149917603,0 +23,0.47487491369247437,0.416556179523468,0.423888236284256,0.1678321659564972,740.3775634765625,1.1500000000000002e-06,5.4846954345703125,2.842118263244629,81.14050149917603,0 +24,0.3959193527698517,0.46883663535118103,0.4967562258243561,0.2181818187236786,929.6773681640625,1.2000000000000002e-06,0.8770315647125244,2.8375186920166016,81.14050149917603,0 +25,0.22431200742721558,0.26415613293647766,0.26057952642440796,0.26806527376174927,811.3840942382812,1.25e-06,1.3072121143341064,3.6290595531463623,81.14050149917603,0 +26,0.3961004614830017,0.3668467402458191,0.387182354927063,0.18811188638210297,273.5347900390625,1.3e-06,1.3567899465560913,2.8423709869384766,81.14050149917603,0 +27,0.31267088651657104,0.3399415910243988,0.33215460181236267,0.21771562099456787,916.3778686523438,1.3500000000000002e-06,0.722942590713501,2.8393962383270264,81.14050149917603,0 +28,0.3123369812965393,0.48192790150642395,0.47354021668434143,0.23333333432674408,956.75732421875,1.4000000000000001e-06,0.8162510991096497,2.8424787521362305,81.14050149917603,0 +29,0.22258736193180084,0.20194119215011597,0.20931202173233032,0.1582750529050827,785.822265625,1.45e-06,0.5775518417358398,2.847559690475464,81.14050149917603,0 +30,0.35624170303344727,0.4015997350215912,0.38365739583969116,0.21445220708847046,946.6068115234375,1.5e-06,0.5052744746208191,2.857182502746582,81.14050149917603,0 +31,0.5556626319885254,0.5072981119155884,0.5174970626831055,0.20279720425605774,946.8348388671875,1.5500000000000002e-06,1.8881133794784546,3.424332857131958,81.14050149917603,0 +32,0.2924448847770691,0.3566952645778656,0.3610759675502777,0.2254079282283783,905.7181396484375,1.6000000000000001e-06,0.4698147475719452,2.849687099456787,81.14050149917603,0 +33,0.3707928955554962,0.30255237221717834,0.284235417842865,0.15221445262432098,790.488037109375,1.6500000000000003e-06,0.618135392665863,2.8486168384552,81.14050149917603,0 +34,0.20767183601856232,0.3350096642971039,0.36092114448547363,0.23869463801383972,835.7803955078125,1.7000000000000002e-06,0.3928266167640686,2.852882146835327,81.14050149917603,0 +35,0.46521779894828796,0.8127186894416809,0.791060745716095,0.2254079282283783,998.5840454101562,1.75e-06,0.5923107862472534,2.8551321029663086,81.14050149917603,0 +36,0.32753676176071167,0.36581966280937195,0.35623422265052795,0.2489510476589203,828.0687866210938,1.8000000000000001e-06,0.472595751285553,3.119770050048828,81.14050149917603,0 +37,0.2993980646133423,0.7925071716308594,0.7691173553466797,0.21095570921897888,989.9591064453125,1.85e-06,0.421371728181839,3.4485528469085693,81.14050149917603,0 +38,0.49644148349761963,0.2765030562877655,0.2812591791152954,0.2405594438314438,888.5984497070312,1.9000000000000002e-06,0.6395672559738159,2.842883348464966,81.14050149917603,0 +39,0.5563741326332092,0.4413917064666748,0.43862780928611755,0.23310023546218872,470.316650390625,1.9500000000000004e-06,0.5606410503387451,2.8509466648101807,81.14050149917603,0 +40,0.39251500368118286,0.31818217039108276,0.3146992325782776,0.1878787875175476,900.1648559570312,2.0000000000000003e-06,0.42444148659706116,2.853055953979492,81.14050149917603,0 +41,0.6665723323822021,0.17145401239395142,0.16761533915996552,0.10396270453929901,889.3790893554688,2.05e-06,0.9504879713058472,2.849092960357666,81.14050149917603,0 +42,0.23321649432182312,0.3300241231918335,0.32287997007369995,0.08578088879585266,835.2010498046875,2.1000000000000002e-06,0.4186885952949524,3.389554262161255,81.14050149917603,0 +43,0.6628580093383789,0.4487932324409485,0.4602479934692383,0.22960372269153595,593.8468017578125,2.15e-06,0.37160369753837585,3.691206932067871,81.14050149917603,0 +44,0.2561713457107544,0.4240945279598236,0.4210810363292694,0.2186480164527893,965.8648071289062,2.2e-06,0.5825506448745728,2.8424108028411865,81.14050149917603,0 +45,0.24901661276817322,0.6390856504440308,0.632412850856781,0.22750583291053772,990.228515625,2.25e-06,0.32629790902137756,2.8491787910461426,81.14050149917603,0 +46,0.3099241852760315,0.45429763197898865,0.45027679204940796,0.1738927662372589,989.5532836914062,2.3000000000000004e-06,0.4003613591194153,2.8636391162872314,81.14050149917603,0 +47,0.4114744961261749,0.24414893984794617,0.25324174761772156,0.10303030163049698,603.1679077148438,2.35e-06,1.0496100187301636,2.849268913269043,81.14050149917603,0 +48,0.1929318606853485,0.3161447048187256,0.3139372169971466,0.12820512056350708,923.8132934570312,2.4000000000000003e-06,0.3667057156562805,3.2337486743927,81.14050149917603,0 +49,0.2946462333202362,0.37097442150115967,0.3691287040710449,0.26363635063171387,642.2061767578125,2.4500000000000003e-06,3.644714593887329,3.444431781768799,81.14050149917603,0 +50,0.24546615779399872,0.4103468060493469,0.41079673171043396,0.05524475499987602,969.6383056640625,2.5e-06,0.36899271607398987,2.8481693267822266,81.14050149917603,0 +51,0.5069096088409424,0.46479371190071106,0.45353394746780396,0.21445220708847046,371.6285705566406,2.55e-06,0.4619203805923462,2.8454794883728027,81.14050149917603,0 +52,0.21790452301502228,0.19740495085716248,0.19636903703212738,0.19953380525112152,949.3074340820312,2.6e-06,0.3684476315975189,2.8380286693573,81.14050149917603,0 +53,0.3612423837184906,0.3209039568901062,0.31169700622558594,0.09207459539175034,747.3050537109375,2.6500000000000005e-06,0.5017861723899841,2.846134901046753,81.14050149917603,0 +54,0.32815080881118774,0.3530195653438568,0.3563505709171295,0.1382284313440323,991.1632080078125,2.7000000000000004e-06,0.2700258791446686,3.152059555053711,81.14050149917603,0 +55,0.3807058036327362,0.4842398762702942,0.4877711534500122,0.284149169921875,986.079833984375,2.7500000000000004e-06,0.3948043882846832,3.164055109024048,81.14050149917603,0 +56,0.35491007566452026,0.44795623421669006,0.464082270860672,0.0979020968079567,989.41748046875,2.8000000000000003e-06,0.21778778731822968,2.840693950653076,81.14050149917603,0 +57,0.5104233026504517,0.4635477066040039,0.45932716131210327,0.19277389347553253,980.1610107421875,2.85e-06,0.38445618748664856,2.837614059448242,81.14050149917603,0 +58,0.26629358530044556,0.32170864939689636,0.34461355209350586,0.16806526482105255,883.4002075195312,2.9e-06,0.4281284511089325,2.84590744972229,81.14050149917603,0 +59,0.37144720554351807,0.4443593919277191,0.4421987235546112,0.21235431730747223,960.7506713867188,2.95e-06,0.2710166871547699,2.8486602306365967,81.14050149917603,0 +60,0.29018041491508484,0.31741681694984436,0.32622188329696655,0.21491841971874237,891.30908203125,3e-06,0.302288293838501,3.501391649246216,81.14050149917603,0 +61,0.5142881870269775,0.37839475274086,0.3781970143318176,0.17249417304992676,816.7084350585938,3.05e-06,0.39474010467529297,3.1647839546203613,81.14050149917603,0 +62,0.4374125003814697,0.2743353247642517,0.2810148596763611,0.11491841822862625,978.7633666992188,3.1000000000000004e-06,1.492134928703308,2.8488810062408447,81.14050149917603,0 +63,0.3045777976512909,0.5708451271057129,0.5460719466209412,0.16130536794662476,984.3526000976562,3.1500000000000003e-06,0.5998057126998901,2.8516035079956055,81.14050149917603,0 +64,0.13995416462421417,0.42350679636001587,0.4251740872859955,0.19277389347553253,931.2932739257812,3.2000000000000003e-06,0.23454557359218597,2.8422765731811523,81.14050149917603,0 +65,0.39098039269447327,0.2602636516094208,0.2636195421218872,0.2242424190044403,847.4485473632812,3.2500000000000002e-06,0.32819095253944397,2.85907244682312,81.14050149917603,0 +66,0.2009623795747757,0.21262025833129883,0.23853006958961487,0.18997669219970703,966.2316284179688,3.3000000000000006e-06,0.18861742317676544,3.4194178581237793,81.14050149917603,0 +67,0.3014543652534485,0.16238562762737274,0.16839098930358887,0.0559440553188324,739.3676147460938,3.3500000000000005e-06,0.21985551714897156,3.1527321338653564,81.14050149917603,0 +68,0.32602056860923767,0.22119000554084778,0.21894194185733795,0.10139860212802887,852.6897583007812,3.4000000000000005e-06,0.6557168960571289,2.8541040420532227,81.14050149917603,0 +69,0.4437426030635834,0.5279340147972107,0.5097445249557495,0.23170162737369537,989.41748046875,3.45e-06,0.29107561707496643,2.8532276153564453,81.14050149917603,0 +70,0.3574396073818207,0.4941180646419525,0.512572705745697,0.18298368155956268,194.7152557373047,3.5e-06,0.7179723978042603,2.8608388900756836,81.14050149917603,0 +71,0.382206529378891,0.3913993537425995,0.36839041113853455,0.23519814014434814,966.9605712890625,3.5500000000000003e-06,4.228822708129883,3.1464030742645264,81.14050149917603,0 +72,0.39678388833999634,0.6844773888587952,0.687008798122406,0.2594405710697174,998.8220825195312,3.6000000000000003e-06,0.27855703234672546,3.4092180728912354,81.14050149917603,0 +73,0.365533709526062,0.2404191493988037,0.23306377232074738,0.11002331227064133,711.1596069335938,3.65e-06,0.8840656876564026,3.0821800231933594,81.14050149917603,0 +74,0.3533637821674347,0.5438406467437744,0.5367562770843506,0.2433566451072693,991.4281005859375,3.7e-06,0.21631044149398804,2.846656322479248,81.14050149917603,0 +75,0.35274019837379456,0.3017128109931946,0.2958492934703827,0.07622377574443817,928.5856323242188,3.7500000000000005e-06,1.9557479619979858,2.831681489944458,81.14050149917603,0 +76,0.32764434814453125,0.5558069944381714,0.5689361691474915,0.18881118297576904,305.9609069824219,3.8000000000000005e-06,0.2475919872522354,3.0329906940460205,81.14050149917603,0 +77,0.4285697937011719,0.4759346544742584,0.48583918809890747,0.23636363446712494,263.79840087890625,3.85e-06,0.2741502821445465,3.138646125793457,81.14050149917603,0 +78,0.3042215406894684,0.35216227173805237,0.3383488953113556,0.23170162737369537,964.7545166015625,3.900000000000001e-06,0.23346514999866486,3.6062843799591064,81.14050149917603,0 +79,0.43427717685699463,0.5198656916618347,0.5073810815811157,0.18531468510627747,998.7031860351562,3.95e-06,0.8313566446304321,3.085601806640625,81.14050149917603,0 +80,0.39619767665863037,0.3451954424381256,0.3397703766822815,0.16083915531635284,958.17578125,4.000000000000001e-06,0.17725688219070435,2.8478915691375732,81.14050149917603,0 +81,0.20573319494724274,0.39704135060310364,0.39715254306793213,0.2226107269525528,977.3401489257812,4.05e-06,0.18910910189151764,2.856863498687744,81.14050149917603,0 +82,0.3370996117591858,0.29227715730667114,0.2934059500694275,0.2142191082239151,946.8348388671875,4.1e-06,0.21981318295001984,2.8586301803588867,81.14050149917603,0 +83,0.4596414566040039,0.5083349347114563,0.49939751625061035,0.21771562099456787,263.79840087890625,4.15e-06,0.18528638780117035,3.40474009513855,81.14050149917603,0 +84,0.46692708134651184,0.3893572986125946,0.39642778038978577,0.25244754552841187,795.030517578125,4.2000000000000004e-06,0.49477067589759827,3.396486282348633,81.14050149917603,0 +85,0.11281217634677887,0.2663140892982483,0.27066272497177124,0.22773893177509308,968.2208862304688,4.25e-06,0.22892579436302185,2.8662352561950684,81.14050149917603,0 +86,0.1858471930027008,0.45672938227653503,0.4517216682434082,0.19114218652248383,994.9097900390625,4.3e-06,0.18116264045238495,2.8530831336975098,81.14050149917603,0 +87,0.21569007635116577,0.3111928403377533,0.29894280433654785,0.14219114184379578,984.643310546875,4.350000000000001e-06,0.7954714298248291,2.846001386642456,81.14050149917603,0 +88,0.4460257887840271,0.24863877892494202,0.2366388738155365,0.12004662305116653,667.560546875,4.4e-06,0.18870121240615845,2.845813035964966,81.14050149917603,0 +89,0.11109530925750732,0.3293083906173706,0.33474552631378174,0.20000000298023224,924.9560546875,4.450000000000001e-06,0.1636965125799179,3.4313292503356934,81.14050149917603,0 +90,0.2261885404586792,0.5410953164100647,0.5296300053596497,0.23636363446712494,979.8526000976562,4.5e-06,0.9086935520172119,3.4321887493133545,81.14050149917603,0 +91,0.36225637793540955,0.4301157593727112,0.41818752884864807,0.23030303418636322,767.5730590820312,4.5500000000000005e-06,0.18934595584869385,2.8332631587982178,81.14050149917603,0 +92,0.6059966087341309,0.3032192289829254,0.3032418489456177,0.18997669219970703,803.7642822265625,4.600000000000001e-06,0.21450138092041016,2.8385426998138428,81.14050149917603,0 +93,0.27486246824264526,0.22388982772827148,0.23625722527503967,0.11025641113519669,737.33203125,4.65e-06,0.24119628965854645,2.8471105098724365,81.14050149917603,0 +94,0.3862471282482147,0.16654035449028015,0.19291631877422333,0.19114218652248383,563.8103637695312,4.7e-06,0.3821505308151245,2.8560128211975098,81.14050149917603,0 +95,0.3081252872943878,0.2650344967842102,0.26817435026168823,0.17529137432575226,928.8597412109375,4.75e-06,0.22680208086967468,3.637349843978882,81.14050149917603,0 +96,0.24264183640480042,0.4234023094177246,0.43591925501823425,0.21958041191101074,984.643310546875,4.800000000000001e-06,0.5999400019645691,3.1696231365203857,81.14050149917603,0 +97,0.28933462500572205,0.4623408317565918,0.44425976276397705,0.22494173049926758,972.5713500976562,4.85e-06,0.25539493560791016,2.859508514404297,81.14050149917603,0 +98,0.4344908595085144,0.3897383213043213,0.39752939343452454,0.2298368364572525,550.8392333984375,4.9000000000000005e-06,1.5861737728118896,2.8588814735412598,81.14050149917603,0 +99,0.33788377046585083,0.19570371508598328,0.21189501881599426,0.1890442818403244,807.27197265625,4.95e-06,0.1564408838748932,2.856003522872925,81.14050149917603,0 +100,0.453960120677948,0.33725470304489136,0.33318111300468445,0.2046620100736618,861.1730346679688,5e-06,0.17242205142974854,2.8542838096618652,81.14050149917603,0 +101,0.2996004521846771,0.28630274534225464,0.2872841954231262,0.2226107269525528,923.2371215820312,5.050000000000001e-06,0.1780162751674652,3.669395923614502,81.14050149917603,0 +102,0.38219815492630005,0.35454532504081726,0.3649168610572815,0.1958041936159134,850.0933227539062,5.1e-06,0.22979941964149475,3.06899356842041,81.14050149917603,0 +103,0.3137078881263733,0.1595086306333542,0.17487303912639618,0.19883449375629425,629.2960815429688,5.150000000000001e-06,0.17694909870624542,2.8537139892578125,81.14050149917603,0 +104,0.19960281252861023,0.29395925998687744,0.3037651479244232,0.1403263360261917,992.0859375,5.2e-06,0.13993681967258453,2.85949969291687,81.14050149917603,0 +105,0.2047646939754486,0.15795136988162994,0.1622995287179947,0.23030303418636322,892.0726318359375,5.2500000000000006e-06,0.18152742087841034,2.852977991104126,81.14050149917603,0 +106,0.2621762752532959,0.3016657829284668,0.3112746477127075,0.116317018866539,979.6979370117188,5.300000000000001e-06,2.4887115955352783,3.1482105255126953,81.14050149917603,0 +107,0.45431438088417053,0.23513571918010712,0.24149063229560852,0.21911421418190002,864.0462646484375,5.3500000000000004e-06,0.2183593213558197,3.4614510536193848,81.14050149917603,0 +108,0.24354498088359833,0.6203101277351379,0.5893605947494507,0.2254079282283783,980.7741088867188,5.400000000000001e-06,0.21520569920539856,3.0899107456207275,81.14050149917603,0 +109,0.3148770332336426,0.19084779918193817,0.21727679669857025,0.20536130666732788,983.9144897460938,5.450000000000001e-06,0.18008853495121002,2.8471250534057617,81.14050149917603,0 +110,0.5238687992095947,0.41641661524772644,0.40336036682128906,0.20722611248493195,915.1390991210938,5.500000000000001e-06,0.26912209391593933,2.8366057872772217,81.14050149917603,0 +111,0.25026237964630127,0.3199349641799927,0.3133426010608673,0.2209790199995041,868.7028198242188,5.550000000000001e-06,0.2374003678560257,2.837130308151245,81.14050149917603,0 +112,0.25499454140663147,0.4324086606502533,0.42644965648651123,0.17878787219524384,985.0772094726562,5.600000000000001e-06,0.14576321840286255,3.05306077003479,81.14050149917603,0 +113,0.3229290544986725,0.22150300443172455,0.23832400143146515,0.26596736907958984,927.482421875,5.65e-06,0.18341952562332153,3.4462130069732666,81.14050149917603,0 +114,0.4666389226913452,0.29844343662261963,0.2909461259841919,0.19930069148540497,776.0996704101562,5.7e-06,0.21281829476356506,2.8512563705444336,81.14050149917603,0 +115,0.28225937485694885,0.40639805793762207,0.3887960612773895,0.1263403296470642,995.035400390625,5.75e-06,0.135837584733963,2.874191999435425,81.14050149917603,0 +116,0.42601534724235535,0.33969351649284363,0.3376878499984741,0.21491841971874237,750.1998901367188,5.8e-06,0.22757551074028015,2.849031925201416,81.14050149917603,0 +117,0.35373079776763916,0.3117237389087677,0.32823553681373596,0.23356643319129944,646.8789672851562,5.85e-06,0.20819251239299774,2.8453896045684814,81.14050149917603,0 +118,0.4364674389362335,0.32981204986572266,0.32538729906082153,0.18368297815322876,899.0933837890625,5.9e-06,0.2507576048374176,3.1259357929229736,81.14050149917603,0 +119,0.2991318106651306,0.46568185091018677,0.46113842725753784,0.20792540907859802,989.1450805664062,5.950000000000001e-06,0.413091242313385,3.539501428604126,81.14050149917603,0 +120,0.3500937819480896,0.38300880789756775,0.3726981282234192,0.18578088283538818,955.10791015625,6e-06,0.15212342143058777,2.8489222526550293,81.14050149917603,0 +121,0.381149023771286,0.38421961665153503,0.37196725606918335,0.1958041936159134,959.7694091796875,6.0500000000000005e-06,0.3185708522796631,2.8338160514831543,81.14050149917603,0 +122,0.2176741361618042,0.28631335496902466,0.2726283073425293,0.1878787875175476,924.6715087890625,6.1e-06,0.19301588833332062,2.835984230041504,81.14050149917603,0 +123,0.26343271136283875,0.31809794902801514,0.3223333954811096,0.17482517659664154,697.9737548828125,6.15e-06,0.5692068934440613,2.835047483444214,81.14050149917603,0 +124,0.3855287432670593,0.2703825533390045,0.2734987437725067,0.2622377574443817,793.5297241210938,6.200000000000001e-06,0.2649436593055725,3.3366198539733887,81.14050149917603,0 +125,0.37702786922454834,0.224208801984787,0.2158244252204895,0.15337994694709778,884.2141723632812,6.25e-06,0.39651980996131897,3.4320425987243652,81.14050149917603,0 +126,0.4231131970882416,0.25332608819007874,0.23439210653305054,0.14755244553089142,905.37890625,6.300000000000001e-06,0.131921648979187,2.8471312522888184,81.14050149917603,0 +127,0.3606787323951721,0.289603590965271,0.29549896717071533,0.19976690411567688,935.22314453125,6.35e-06,0.1580847203731537,2.8584346771240234,81.14050149917603,0 +128,0.30975577235221863,0.21235372126102448,0.20794843137264252,0.2186480164527893,788.1709594726562,6.4000000000000006e-06,0.1772342026233673,2.8586816787719727,81.14050149917603,0 +129,0.36495670676231384,0.38160866498947144,0.39280566573143005,0.2097902148962021,382.7987976074219,6.450000000000001e-06,0.5991296768188477,2.8519749641418457,81.14050149917603,0 +130,0.40482139587402344,0.18975774943828583,0.18545712530612946,0.2237762212753296,774.4262084960938,6.5000000000000004e-06,0.1986958235502243,3.387159824371338,81.14050149917603,0 +131,0.37819433212280273,0.43117040395736694,0.433066725730896,0.2501165568828583,375.388671875,6.550000000000001e-06,0.1547754853963852,3.3913915157318115,81.14050149917603,0 +132,0.3744752109050751,0.2678591012954712,0.2714930772781372,0.2354312390089035,919.1144409179688,6.600000000000001e-06,0.28331735730171204,2.8530678749084473,81.14050149917603,0 +133,0.24598458409309387,0.2562757432460785,0.2582065463066101,0.25407925248146057,730.0392456054688,6.650000000000001e-06,0.19525249302387238,2.845261812210083,81.14050149917603,0 +134,0.5240293741226196,0.35365793108940125,0.36754876375198364,0.26713287830352783,661.8328857421875,6.700000000000001e-06,0.18103238940238953,2.8377740383148193,81.14050149917603,0 +135,0.4218931794166565,0.38927558064460754,0.37952834367752075,0.19393938779830933,625.9617919921875,6.750000000000001e-06,0.2665626108646393,3.1556825637817383,81.14050149917603,0 +136,0.28483444452285767,0.332772821187973,0.3233645558357239,0.18997669219970703,727.9061279296875,6.800000000000001e-06,0.16389144957065582,3.390096426010132,81.14050149917603,0 +137,0.3907642066478729,0.35017329454421997,0.34205472469329834,0.2645687758922577,806.5763549804688,6.850000000000001e-06,0.2182716578245163,3.103425979614258,81.14050149917603,0 +138,0.2642431855201721,0.2798078954219818,0.283596932888031,0.26713287830352783,987.7676391601562,6.9e-06,1.1255897283554077,2.8529467582702637,81.14050149917603,0 +139,0.27506139874458313,0.27413100004196167,0.28215694427490234,0.2354312390089035,816.0525512695312,6.95e-06,0.2519471049308777,2.8548243045806885,81.14050149917603,0 +140,0.30601292848587036,0.7059343457221985,0.7126758694648743,0.2599067687988281,183.10153198242188,7e-06,0.1364361196756363,2.8578433990478516,81.14050149917603,0 +141,0.35026147961616516,0.2853955626487732,0.28931450843811035,0.21165500581264496,629.2960815429688,7.05e-06,0.20508868992328644,3.0945634841918945,81.14050149917603,0 +142,0.18974103033542633,0.2530049681663513,0.24075844883918762,0.14172494411468506,971.03173828125,7.100000000000001e-06,0.15627922117710114,3.33213210105896,81.14050149917603,0 +143,0.3988378643989563,0.3797606825828552,0.3827301561832428,0.2181818187236786,968.3995361328125,7.15e-06,0.31525635719299316,3.1227755546569824,81.14050149917603,0 +144,0.5453420877456665,0.2968192398548126,0.3016010522842407,0.18531468510627747,722.4732666015625,7.2000000000000005e-06,0.8602790832519531,2.8486599922180176,81.14050149917603,0 +145,0.184615820646286,0.13948377966880798,0.14106790721416473,0.09930069744586945,980.0068969726562,7.25e-06,0.22667205333709717,2.839995861053467,81.14050149917603,0 +146,0.16120438277721405,0.2595580816268921,0.25516456365585327,0.2282051295042038,959.3736572265625,7.3e-06,0.20349478721618652,2.839008092880249,81.14050149917603,0 +147,0.33997660875320435,0.3767133355140686,0.39160969853401184,0.1750582754611969,301.4790344238281,7.350000000000001e-06,0.144423708319664,3.6132373809814453,81.14050149917603,0 +148,0.32307568192481995,0.5320285558700562,0.5266318917274475,0.13682983815670013,992.6078491210938,7.4e-06,0.2330854833126068,3.38516902923584,81.14050149917603,0 +149,0.2869611382484436,0.3156861662864685,0.3104972839355469,0.24452213943004608,624.2781982421875,7.450000000000001e-06,0.16262182593345642,2.8329479694366455,81.14050149917603,0 +150,0.21751248836517334,0.2977749705314636,0.29803571105003357,0.21072261035442352,941.445068359375,7.500000000000001e-06,0.1823541522026062,2.848700761795044,81.14050149917603,0 +151,0.2659245431423187,0.27729809284210205,0.2707677185535431,0.22074592113494873,905.0384521484375,7.5500000000000006e-06,0.19159437716007233,2.8487393856048584,81.14050149917603,0 +152,0.25216996669769287,0.26092010736465454,0.27023643255233765,0.15058274567127228,946.378173828125,7.600000000000001e-06,0.15903033316135406,2.85312557220459,81.14050149917603,0 +153,0.4329187572002411,0.36984577775001526,0.35963934659957886,0.22214451432228088,965.4962768554688,7.650000000000001e-06,0.29522982239723206,3.59607195854187,81.14050149917603,0 +154,0.23100799322128296,0.2808995544910431,0.26923948526382446,0.25757575035095215,835.2010498046875,7.7e-06,0.1632666140794754,3.545496940612793,81.14050149917603,0 +155,0.34053361415863037,0.27392613887786865,0.2775729298591614,0.2170163094997406,828.0687866210938,7.75e-06,0.3230758309364319,2.85555100440979,81.14050149917603,0 +156,0.337551087141037,0.21030957996845245,0.22344499826431274,0.22331002354621887,970.6856079101562,7.800000000000002e-06,0.17964614927768707,2.852355480194092,81.14050149917603,0 +157,0.08033297210931778,0.1731409877538681,0.18701323866844177,0.09813519567251205,904.6971435546875,7.850000000000001e-06,0.1357143223285675,2.859384059906006,81.14050149917603,0 +158,0.5152199268341064,0.24619746208190918,0.24227343499660492,0.2158508151769638,814.068359375,7.9e-06,0.22650769352912903,2.856611490249634,81.14050149917603,0 +159,0.09766552597284317,0.3579818308353424,0.35117238759994507,0.1650349646806717,992.2167358398438,7.950000000000002e-06,0.19200097024440765,3.4516234397888184,81.14050149917603,0 +160,0.45233577489852905,0.31216657161712646,0.3115273416042328,0.18834498524665833,951.4989624023438,8.000000000000001e-06,1.7085055112838745,3.6336257457733154,81.14050149917603,0 +161,0.3056536614894867,0.2789474427700043,0.2659333646297455,0.20372959971427917,865.4603271484375,8.050000000000001e-06,0.1914437860250473,2.843165159225464,81.14050149917603,0 +162,0.2401050329208374,0.5058504343032837,0.5161822438240051,0.2170163094997406,287.737548828125,8.1e-06,0.15932223200798035,2.851654291152954,81.14050149917603,0 +163,0.35993149876594543,0.2653205692768097,0.2723230719566345,0.21491841971874237,954.6907958984375,8.15e-06,0.2556496262550354,2.858635425567627,81.14050149917603,0 +164,0.45161667466163635,0.2748645544052124,0.27514341473579407,0.2477855533361435,697.9737548828125,8.2e-06,0.3023209273815155,3.1330931186676025,81.14050149917603,0 +165,0.350360244512558,0.2964296042919159,0.2853475511074066,0.19230769574642181,860.688232421875,8.25e-06,0.2740081548690796,3.357740879058838,81.14050149917603,0 +166,0.3640247583389282,0.21447162330150604,0.21995162963867188,0.20606060326099396,677.2564697265625,8.3e-06,0.1538572758436203,3.1731128692626953,81.14050149917603,0 +167,0.18655823171138763,0.18938575685024261,0.1872156411409378,0.22610722482204437,768.4440307617188,8.35e-06,0.5918716788291931,2.843698740005493,81.14050149917603,0 +168,0.2538382112979889,0.26149001717567444,0.25426289439201355,0.269696980714798,828.0687866210938,8.400000000000001e-06,0.1736377775669098,2.855569362640381,81.14050149917603,0 +169,0.4088202714920044,0.3043842613697052,0.31348076462745667,0.17575757205486298,964.3812255859375,8.45e-06,0.24267907440662384,2.852017402648926,81.14050149917603,0 +170,0.20840613543987274,0.2996632158756256,0.29084840416908264,0.2482517510652542,954.6907958984375,8.5e-06,0.2314009666442871,3.1162171363830566,81.14050149917603,0 +171,0.29354989528656006,0.25494295358657837,0.269999235868454,0.13496503233909607,793.5297241210938,8.550000000000001e-06,0.15065647661685944,3.587101697921753,81.14050149917603,0 +172,0.4331488311290741,0.7123865485191345,0.720120906829834,0.12004662305116653,165.13217163085938,8.6e-06,0.17322853207588196,3.396334171295166,81.14050149917603,0 +173,0.4221532344818115,0.28080645203590393,0.2911701798439026,0.15454545617103577,648.4168090820312,8.65e-06,0.22477395832538605,2.8491883277893066,81.14050149917603,0 +174,0.49255281686782837,0.34938085079193115,0.3449349105358124,0.2265734225511551,658.916015625,8.700000000000001e-06,0.17040589451789856,2.8586487770080566,81.14050149917603,0 +175,0.2882257103919983,0.27371272444725037,0.27181100845336914,0.1678321659564972,708.8218383789062,8.750000000000001e-06,0.48103612661361694,2.848525285720825,81.14050149917603,0 +176,0.3495867848396301,0.2748396694660187,0.26793602108955383,0.23613053560256958,958.7767944335938,8.8e-06,0.15468578040599823,3.127613067626953,81.14050149917603,0 +177,0.37196946144104004,0.312438428401947,0.29808080196380615,0.11888112127780914,912.2996826171875,8.85e-06,0.2090364545583725,3.6054975986480713,81.14050149917603,0 +178,0.20657959580421448,0.44967061281204224,0.4425196647644043,0.16899767518043518,976.0529174804688,8.900000000000001e-06,0.1887310892343521,3.0658059120178223,81.14050149917603,0 +179,0.27907848358154297,0.17846840620040894,0.19065262377262115,0.26317015290260315,901.9290771484375,8.95e-06,0.2795352339744568,2.842346668243408,81.14050149917603,0 +180,0.26624736189842224,0.22044990956783295,0.22910985350608826,0.1878787875175476,923.525634765625,9e-06,0.195966899394989,2.8423376083374023,81.14050149917603,0 +181,0.34700262546539307,0.19935904443264008,0.19045932590961456,0.19930069148540497,863.5715942382812,9.050000000000001e-06,0.14915263652801514,2.843855857849121,81.14050149917603,0 +182,0.3426681160926819,0.311473548412323,0.299943208694458,0.22610722482204437,742.382080078125,9.100000000000001e-06,0.7684231400489807,3.093140125274658,81.14050149917603,0 +183,0.3997335135936737,0.3071041703224182,0.30594417452812195,0.14755244553089142,933.6696166992188,9.15e-06,0.5144947171211243,3.56799578666687,81.14050149917603,0 +184,0.39146852493286133,0.3554288148880005,0.36672142148017883,0.09020978957414627,992.0859375,9.200000000000002e-06,0.19575978815555573,3.029688596725464,81.14050149917603,0 +185,0.4246554374694824,0.3115079700946808,0.2987501621246338,0.23706293106079102,629.2960815429688,9.250000000000001e-06,0.1793055385351181,2.8411502838134766,81.14050149917603,0 +186,0.46595659852027893,0.5798623561859131,0.582710325717926,0.2365967333316803,120.44096374511719,9.3e-06,0.1624564528465271,2.8492271900177,81.14050149917603,0 +187,0.23219820857048035,0.19635289907455444,0.2055436074733734,0.23030303418636322,885.0230102539062,9.350000000000002e-06,0.24283906817436218,2.849301338195801,81.14050149917603,0 +188,0.22334758937358856,0.22001703083515167,0.228493794798851,0.2058275043964386,901.9290771484375,9.4e-06,0.14404438436031342,3.3008062839508057,81.14050149917603,0 +189,0.431887149810791,0.47105467319488525,0.4548923075199127,0.18881118297576904,999.8831176757812,9.450000000000001e-06,0.2560749053955078,3.441488265991211,81.14050149917603,0 +190,0.1883057802915573,0.4844546914100647,0.51692134141922,0.17762237787246704,981.8353881835938,9.5e-06,0.14913210272789001,3.0607266426086426,81.14050149917603,0 +191,0.22638066112995148,0.3959954082965851,0.39386817812919617,0.17529137432575226,960.7506713867188,9.55e-06,0.18848417699337006,2.8348333835601807,81.14050149917603,0 +192,0.24893388152122498,0.3298506438732147,0.32506394386291504,0.2174825221300125,936.2454833984375,9.600000000000001e-06,0.14078781008720398,2.8445959091186523,81.14050149917603,0 +193,0.15589112043380737,0.2781781256198883,0.2644166946411133,0.15804195404052734,933.4083862304688,9.65e-06,0.2010917365550995,2.836712598800659,81.14050149917603,0 +194,0.3212790787220001,0.2599354386329651,0.24852228164672852,0.26083916425704956,796.51806640625,9.7e-06,0.6623014211654663,3.414440393447876,81.14050149917603,0 +195,0.3077150881290436,0.20498858392238617,0.21879632771015167,0.13170163333415985,883.8079833984375,9.75e-06,0.1831367164850235,3.4827487468719482,81.14050149917603,0 +196,0.482413113117218,0.3264973759651184,0.3197425901889801,0.19976690411567688,648.4168090820312,9.800000000000001e-06,0.7202340364456177,3.1291091442108154,81.14050149917603,0 +197,0.26144227385520935,0.5364087224006653,0.528903603553772,0.20000000298023224,970.8588256835938,9.85e-06,0.18329858779907227,2.8576717376708984,81.14050149917603,0 +198,0.13602884113788605,0.22567783296108246,0.2325829267501831,0.09533799439668655,811.3840942382812,9.9e-06,0.14312928915023804,2.8635473251342773,81.14050149917603,0 +199,0.4940940737724304,0.24419674277305603,0.23923234641551971,0.20839160680770874,508.12554931640625,9.950000000000001e-06,0.41331350803375244,2.8599085807800293,81.14050149917603,0 +200,0.3911341726779938,0.7263928651809692,0.7168557047843933,0.2610722482204437,140.08938598632812,1e-05,0.13837981224060059,3.428630828857422,81.14050149917603,0 +201,0.3964017331600189,0.2569201588630676,0.2576696276664734,0.1874125897884369,730.0392456054688,1e-05,0.1523279845714569,3.3960764408111572,81.14050149917603,0 +202,0.33465784788131714,0.4033833146095276,0.39206090569496155,0.19230769574642181,446.5873107910156,1e-05,0.2604059875011444,3.121837615966797,81.14050149917603,0 +203,0.18858399987220764,0.22095035016536713,0.21947258710861206,0.1566433608531952,870.971435546875,1e-05,0.17282861471176147,2.8491222858428955,81.14050149917603,0 +204,0.272112637758255,0.29060766100883484,0.2817738950252533,0.11701631546020508,894.70751953125,1e-05,0.26967597007751465,2.851332426071167,81.14050149917603,0 +205,0.24604199826717377,0.35068079829216003,0.3520048260688782,0.19836829602718353,931.025634765625,1e-05,0.2179393768310547,3.122352361679077,81.14050149917603,0 +206,0.3335522413253784,0.5144832730293274,0.5058473348617554,0.22121211886405945,996.0327758789062,1e-05,0.18036586046218872,3.333584785461426,81.14050149917603,0 +207,0.30799734592437744,0.18627798557281494,0.1842520534992218,0.22237762808799744,867.7844848632812,1e-05,0.2161225825548172,3.353498935699463,81.14050149917603,0 +208,0.32493025064468384,0.31408947706222534,0.32933253049850464,0.22960372269153595,966.9605712890625,1e-05,0.14141584932804108,2.8450818061828613,81.14050149917603,0 +209,0.22540035843849182,0.2726239264011383,0.2651205062866211,0.18974359333515167,802.3400268554688,1e-05,0.1998841017484665,2.8577730655670166,81.14050149917603,0 +210,0.2824198007583618,0.30840781331062317,0.3237757086753845,0.2242424190044403,344.2266540527344,1e-05,0.2180250585079193,2.83976411819458,81.14050149917603,0 +211,0.12263219058513641,0.3272179961204529,0.3376581072807312,0.10396270453929901,991.8234252929688,1e-05,0.18010203540325165,3.0379140377044678,81.14050149917603,0 +212,0.42054951190948486,0.3449620008468628,0.3376186490058899,0.26247087121009827,527.8575439453125,1e-05,0.1623252034187317,3.379639148712158,81.14050149917603,0 +213,0.09622960537672043,0.423282653093338,0.44260135293006897,0.17249417304992676,994.1507568359375,1e-05,0.17069870233535767,4.372253894805908,81.14050149917603,0 +214,0.3359641134738922,0.29777634143829346,0.29929617047309875,0.04731934890151024,968.2208862304688,1e-05,0.17996923625469208,2.851172924041748,81.14050149917603,0 +215,0.2217254787683487,0.2113293707370758,0.1973143070936203,0.22191141545772552,898.011962890625,1e-05,0.1471565216779709,2.8559839725494385,81.14050149917603,0 +216,0.31618958711624146,0.34790679812431335,0.3575718402862549,0.20885780453681946,904.0114135742188,1e-05,0.3551400303840637,2.8602044582366943,81.14050149917603,0 +217,0.37711700797080994,0.3105749189853668,0.2975323796272278,0.2836829721927643,791.2536010742188,1e-05,0.19914552569389343,3.1076273918151855,81.14050149917603,0 +218,0.1843731850385666,0.14670397341251373,0.14860504865646362,0.1958041936159134,760.4534912109375,1e-05,0.15596504509449005,3.4704251289367676,81.14050149917603,0 +219,0.29226332902908325,0.19645915925502777,0.19806085526943207,0.24522145092487335,748.2748413085938,1e-05,0.14426319301128387,3.1192057132720947,81.14050149917603,0 +220,0.3083023130893707,0.26966536045074463,0.26607879996299744,0.2293706238269806,865.928466796875,1e-05,0.16557879745960236,2.838237762451172,81.14050149917603,0 +221,0.23874697089195251,0.2061040848493576,0.20619703829288483,0.21095570921897888,767.5730590820312,1e-05,0.20511139929294586,2.8441624641418457,81.14050149917603,0 +222,0.35720881819725037,0.222420796751976,0.22597922384738922,0.08251748234033585,914.2007446289062,1e-05,0.1444823145866394,2.837876319885254,81.14050149917603,0 +223,0.3061491549015045,0.2668863534927368,0.26308298110961914,0.06643356382846832,916.991943359375,1e-05,0.1472085416316986,3.0251243114471436,81.14050149917603,0 +224,0.41506630182266235,0.31523677706718445,0.2977127134799957,0.23426572978496552,949.5288696289062,1e-05,0.1614001840353012,3.5708141326904297,81.14050149917603,0 +225,0.08532625436782837,0.591788113117218,0.5613892078399658,0.24988344311714172,997.1378173828125,1e-05,0.22447220981121063,3.0418286323547363,81.14050149917603,0 +226,0.30071359872817993,0.3024250864982605,0.3003714084625244,0.23636363446712494,911.9796752929688,1e-05,0.19043201208114624,2.841564178466797,81.14050149917603,0 +227,0.19849801063537598,0.3786342442035675,0.3639659881591797,0.21445220708847046,971.2042846679688,1e-05,0.17570284008979797,2.844223976135254,81.14050149917603,0 +228,0.3742690682411194,0.4050899147987366,0.3979340195655823,0.2209790199995041,997.6233520507812,1e-05,0.2704382836818695,2.849769353866577,81.14050149917603,0 +229,0.19368797540664673,0.259278804063797,0.2700578272342682,0.10582750290632248,979.54296875,1e-05,0.20445330440998077,3.262176752090454,81.14050149917603,0 +230,0.12835173308849335,0.1804962009191513,0.1876106560230255,0.24289044737815857,922.0755004882812,1e-05,0.17681032419204712,3.7004923820495605,81.14050149917603,0 +231,0.14761240780353546,0.331032931804657,0.3203701972961426,0.15174825489521027,859.223388671875,1e-05,0.19376182556152344,3.047498941421509,81.14050149917603,0 +232,0.5342885851860046,0.3668467402458191,0.3607815206050873,0.21911421418190002,985.22119140625,1e-05,0.2606681287288666,2.8539915084838867,81.14050149917603,0 +233,0.24432557821273804,0.2551445960998535,0.2524923086166382,0.26853147149086,858.2379760742188,1e-05,0.13325972855091095,2.8591692447662354,81.14050149917603,0 +234,0.32884445786476135,0.38851308822631836,0.39060863852500916,0.18251748383045197,964.1939697265625,1e-05,0.3021862506866455,2.8556506633758545,81.14050149917603,0 +235,0.370309442281723,0.25221988558769226,0.29106828570365906,0.19953380525112152,999.177734375,1e-05,0.221218079328537,3.384967088699341,81.14050149917603,0 +236,0.2469196766614914,0.3355275094509125,0.34792765974998474,0.17832167446613312,957.3680419921875,1e-05,0.31383660435676575,3.4469411373138428,81.14050149917603,0 +237,0.27762505412101746,0.290317177772522,0.27430474758148193,0.17762237787246704,846.3767700195312,1e-05,0.18068864941596985,3.0761210918426514,81.14050149917603,0 +238,0.32511085271835327,0.1942651867866516,0.19316086173057556,0.1023310050368309,760.4534912109375,1e-05,0.20974652469158173,2.830278158187866,81.14050149917603,0 +239,0.19210278987884521,0.22869418561458588,0.24027328193187714,0.09487179666757584,352.25469970703125,1e-05,0.22980201244354248,2.8458244800567627,81.14050149917603,0 +240,0.36135876178741455,0.2528386116027832,0.23791982233524323,0.13939394056797028,654.4724731445312,1e-05,0.16716088354587555,3.0214734077453613,81.14050149917603,0 +241,0.4914736747741699,0.3317537307739258,0.32489871978759766,0.2181818187236786,525.4592895507812,1e-05,0.21261189877986908,3.3198516368865967,81.14050149917603,0 +242,0.2324129045009613,0.2948538064956665,0.3013581931591034,0.214685320854187,957.3680419921875,1e-05,0.17998680472373962,3.510152578353882,81.14050149917603,0 +243,0.3165229260921478,0.2957844138145447,0.29591652750968933,0.19650349020957947,847.9813842773438,1e-05,0.20810174942016602,3.116898775100708,81.14050149917603,0 +244,0.5036374926567078,0.2191431224346161,0.22173646092414856,0.22517482936382294,546.3833618164062,1e-05,0.22063332796096802,2.8335931301116943,81.14050149917603,0 +245,0.3185538053512573,0.27541249990463257,0.27847710251808167,0.11375291645526886,473.1681213378906,1e-05,0.7870954871177673,2.842566728591919,81.14050149917603,0 +246,0.35788679122924805,0.4377686083316803,0.42422160506248474,0.23006993532180786,367.8310546875,1e-05,0.31669852137565613,3.035816192626953,81.14050149917603,0 +247,0.3160891830921173,0.6410493850708008,0.605047345161438,0.2242424190044403,990.76416015625,1e-05,0.175324946641922,3.29388165473938,81.14050149917603,0 +248,0.38314583897590637,0.3107999563217163,0.2979457378387451,0.2181818187236786,751.1552734375,1e-05,0.17125087976455688,3.650603771209717,81.14050149917603,0 +249,0.3048877716064453,0.30895766615867615,0.32158589363098145,0.249417245388031,323.4160461425781,1e-05,0.19519682228565216,2.8470613956451416,81.14050149917603,0 +250,0.22896534204483032,0.24315211176872253,0.2526818811893463,0.12424242496490479,475.9952392578125,1e-05,0.15769627690315247,2.853078842163086,81.14050149917603,0 +251,0.3895184099674225,0.2976842224597931,0.2966439127922058,0.17715618014335632,660.37890625,1e-05,0.13851457834243774,2.857389450073242,81.14050149917603,0 +252,0.22841836512088776,0.3162546455860138,0.3150365352630615,0.22867132723331451,899.4515991210938,1e-05,0.16695673763751984,3.0423710346221924,81.14050149917603,0 +253,0.3826438784599304,0.2714349627494812,0.2600923776626587,0.2666666805744171,663.2779541015625,1e-05,0.17424151301383972,3.4427478313446045,81.14050149917603,0 +254,0.25719910860061646,0.2702902853488922,0.2674690783023834,0.20069929957389832,906.0565185546875,1e-05,0.16749687492847443,3.4538357257843018,81.14050149917603,0 +255,0.4236546754837036,0.25610750913619995,0.2566831707954407,0.21328671276569366,735.275390625,1e-05,0.1847226619720459,2.852771759033203,81.14050149917603,0 +256,0.19163136184215546,0.13722637295722961,0.14372554421424866,0.12657342851161957,968.9326171875,1e-05,0.15973679721355438,2.839656352996826,81.14050149917603,0 +257,0.15000313520431519,0.19823281466960907,0.19619926810264587,0.11724941432476044,734.2389526367188,1e-05,0.1971084177494049,2.8508927822113037,81.14050149917603,0 +258,0.317730575799942,0.33991101384162903,0.32981887459754944,0.2533799409866333,936.2454833984375,1e-05,0.19223488867282867,3.0835020542144775,81.14050149917603,0 +259,0.28296104073524475,0.28386813402175903,0.28055381774902344,0.2270396202802658,855.743408203125,1e-05,0.17530913650989532,3.0832650661468506,81.14050149917603,0 +260,0.4097544550895691,0.1867789924144745,0.20394280552864075,0.1655011624097824,759.5440063476562,1e-05,0.1348974108695984,3.452397584915161,81.14050149917603,0 +261,0.3743806481361389,0.30237865447998047,0.29788315296173096,0.20233100652694702,744.3661499023438,1e-05,0.22107304632663727,2.8546407222747803,81.14050149917603,0 +262,0.15057149529457092,0.27825692296028137,0.2662810981273651,0.2209790199995041,926.9263305664062,1e-05,0.7130034565925598,2.8572731018066406,81.14050149917603,0 +263,0.2525821328163147,0.37284326553344727,0.3606805205345154,0.22121211886405945,952.1465454101562,1e-05,0.16847093403339386,2.8641128540039062,81.14050149917603,0 +264,0.17244553565979004,0.18914104998111725,0.1957012116909027,0.23030303418636322,692.97265625,1e-05,0.163079172372818,3.4060468673706055,81.14050149917603,0 +265,0.38752156496047974,0.2897326648235321,0.30829858779907227,0.26317015290260315,935.4796752929688,1e-05,2.4541079998016357,3.083054542541504,81.14050149917603,0 +266,0.14126445353031158,0.24248437583446503,0.243819922208786,0.1566433608531952,768.4440307617188,1e-05,0.19533567130565643,3.729565382003784,81.14050149917603,0 +267,0.25474393367767334,0.3804801404476166,0.38502785563468933,0.15477855503559113,987.7676391601562,1e-05,0.17545989155769348,2.8502581119537354,81.14050149917603,0 +268,0.24920080602169037,0.22133654356002808,0.22680312395095825,0.18018648028373718,988.8717041015625,1e-05,0.14881585538387299,2.8515498638153076,81.14050149917603,0 +269,0.3159761428833008,0.4881875514984131,0.49257686734199524,0.1818181872367859,975.5648193359375,1e-05,0.17815592885017395,2.855836868286133,81.14050149917603,0 +270,0.286480188369751,0.27955660223960876,0.28031522035598755,0.15034964680671692,915.7601928710938,1e-05,0.45166537165641785,3.3919155597686768,81.14050149917603,0 +271,0.2834511399269104,0.33145278692245483,0.3165530562400818,0.2778554856777191,700.4320068359375,1e-05,0.26140233874320984,3.092698812484741,81.14050149917603,0 +272,0.33656176924705505,0.3229371905326843,0.3225139379501343,0.08135198056697845,957.5706176757812,1e-05,0.2204713076353073,3.6189773082733154,81.14050149917603,0 +273,0.30780357122421265,0.18844863772392273,0.1860841065645218,0.2242424190044403,988.5972900390625,1e-05,0.1850527971982956,2.848043203353882,81.14050149917603,0 +274,0.33752310276031494,0.24080508947372437,0.23951932787895203,0.16037295758724213,974.4140625,1e-05,0.6651198863983154,2.849214792251587,81.14050149917603,0 +275,0.3726862967014313,0.2835853695869446,0.2821419835090637,0.1867132931947708,708.8218383789062,1e-05,0.19929049909114838,2.853316068649292,81.14050149917603,0 +276,0.2047959268093109,0.3793639540672302,0.412024587392807,0.15780885517597198,152.77052307128906,1e-05,0.14647939801216125,3.28165602684021,81.14050149917603,0 +277,0.32447054982185364,0.15822924673557281,0.15732237696647644,0.20046620070934296,749.2398071289062,1e-05,0.16784249246120453,3.3671319484710693,81.14050149917603,0 +278,0.3656936287879944,0.1842156946659088,0.19882667064666748,0.19720280170440674,927.2047729492188,1e-05,0.1595689207315445,3.4462954998016357,81.14050149917603,0 +279,0.25625860691070557,0.3233373761177063,0.30326640605926514,0.23403263092041016,983.3262329101562,1e-05,0.2010296881198883,2.8471341133117676,81.14050149917603,0 +280,0.43074631690979004,0.48676541447639465,0.49972406029701233,0.21351981163024902,158.9905548095703,1e-05,0.2008335441350937,2.8423213958740234,81.14050149917603,0 +281,0.29294830560684204,0.30041763186454773,0.309645414352417,0.2913752794265747,296.9483642578125,1e-05,0.17583510279655457,2.8511769771575928,81.14050149917603,0 +282,0.13341602683067322,0.18360500037670135,0.18332333862781525,0.19813519716262817,904.6971435546875,1e-05,0.152059406042099,3.401401996612549,81.14050149917603,0 +283,0.3935343027114868,0.46442288160324097,0.4574674367904663,0.1867132931947708,382.7987976074219,1e-05,0.1741921603679657,3.0860085487365723,81.14050149917603,0 +284,0.10674415528774261,0.17611025273799896,0.18482883274555206,0.12494172155857086,984.7882080078125,1e-05,0.14468243718147278,3.5212857723236084,81.14050149917603,0 +285,0.2760013937950134,0.22149574756622314,0.2301744967699051,0.08158507943153381,951.0648803710938,1e-05,0.1438455879688263,2.8479020595550537,81.14050149917603,0 +286,0.24719977378845215,0.21839965879917145,0.2339671105146408,0.21888111531734467,411.0456848144531,1e-05,0.12934894859790802,2.850783348083496,81.14050149917603,0 +287,0.3801233172416687,0.29081660509109497,0.2739587128162384,0.21491841971874237,919.7131958007812,1e-05,0.18470218777656555,3.0824086666107178,81.14050149917603,0 +288,0.2546981871128082,0.14475584030151367,0.15049512684345245,0.2321678251028061,682.6182250976562,1e-05,0.1294729858636856,3.344923734664917,81.14050149917603,0 +289,0.34619343280792236,0.3010929822921753,0.28844356536865234,0.2270396202802658,903.3214111328125,1e-05,0.16264668107032776,3.379739284515381,81.14050149917603,0 +290,0.08631463348865509,0.316374808549881,0.30471736192703247,0.24195803701877594,937.2574462890625,1e-05,0.16242879629135132,3.2793705463409424,81.14050149917603,0 +291,0.3008090853691101,0.23357944190502167,0.23180794715881348,0.20442891120910645,947.5157470703125,1e-05,0.15576323866844177,2.852842330932617,81.14050149917603,0 +292,0.15532420575618744,0.20208510756492615,0.20887628197669983,0.25198134779930115,945.4581298828125,1e-05,0.5729302167892456,2.8589518070220947,81.14050149917603,0 +293,0.3641570210456848,0.252403199672699,0.2641582190990448,0.2337995320558548,550.8392333984375,1e-05,0.22638793289661407,3.109539747238159,81.14050149917603,0 +294,0.22588704526424408,0.19221636652946472,0.21119259297847748,0.14475524425506592,955.10791015625,1e-05,0.20521831512451172,3.236851692199707,81.14050149917603,0 +295,0.23198479413986206,0.2677425742149353,0.2604309618473053,0.25874125957489014,610.396240234375,1e-05,0.1550435870885849,3.3587372303009033,81.14050149917603,0 +296,0.11019288003444672,0.45111265778541565,0.460877001285553,0.16923077404499054,997.0159301757812,1e-05,0.313860684633255,3.216236114501953,81.14050149917603,0 +297,0.28135594725608826,0.4093162715435028,0.4026188552379608,0.19114218652248383,969.6383056640625,1e-05,0.21343711018562317,2.8512086868286133,81.14050149917603,0 +298,0.28576844930648804,0.20944330096244812,0.22377334535121918,0.2158508151769638,861.1730346679688,1e-05,0.21002136170864105,2.857351303100586,81.14050149917603,0 +299,0.35015153884887695,0.30853721499443054,0.28517940640449524,0.19696970283985138,932.8836669921875,1e-05,0.17524240911006927,3.343938112258911,81.14050149917603,0 +300,0.3557986617088318,0.2942458391189575,0.28174078464508057,0.18298368155956268,732.1500854492188,1e-05,0.20341047644615173,3.3017234802246094,81.14050149917603,0 +301,0.162448912858963,0.38610348105430603,0.38978850841522217,0.2489510476589203,991.2958374023438,1e-05,0.21613702178001404,3.4019203186035156,81.14050149917603,0 +302,0.25191760063171387,0.6679936647415161,0.6663108468055725,0.2214452177286148,177.18624877929688,1e-05,0.22759659588336945,3.1502859592437744,81.14050149917603,0 +303,0.3117823302745819,0.22027850151062012,0.22337627410888672,0.14335663616657257,712.31884765625,1e-05,0.29908671975135803,2.842061758041382,81.14050149917603,0 +304,0.3109684884548187,0.20803575217723846,0.2059604376554489,0.16456876695156097,762.2591552734375,1e-05,0.1718851923942566,2.8526923656463623,81.14050149917603,0 +305,0.2827194929122925,0.16772140562534332,0.16493947803974152,0.20396269857883453,846.9136352539062,1e-05,0.20647065341472626,3.27941632270813,81.14050149917603,0 +306,0.23334741592407227,0.1992822289466858,0.19692963361740112,0.2545454502105713,961.7210693359375,1e-05,0.3846580684185028,3.3387508392333984,81.14050149917603,0 +307,0.2118426412343979,0.26921042799949646,0.2703661322593689,0.2652680575847626,981.5336303710938,1e-05,0.24568383395671844,3.388423204421997,81.14050149917603,0 +308,0.17766475677490234,0.2794501483440399,0.26733866333961487,0.20442891120910645,936.2454833984375,1e-05,0.1592407375574112,3.1717987060546875,81.14050149917603,0 +309,0.17236225306987762,0.36930492520332336,0.3757212460041046,0.23426572978496552,475.9952392578125,1e-05,0.18532301485538483,2.851079225540161,81.14050149917603,0 +310,0.2894715964794159,0.22012664377689362,0.20748445391654968,0.18484848737716675,835.2010498046875,1e-05,0.25452563166618347,2.8548331260681152,81.14050149917603,0 +311,0.3946012556552887,0.3644130825996399,0.360151469707489,0.24731934070587158,601.3294677734375,1e-05,0.23122458159923553,3.1241796016693115,81.14050149917603,0 +312,0.31797489523887634,0.22514861822128296,0.22033531963825226,0.2209790199995041,664.7142333984375,1e-05,0.2369811236858368,3.3127942085266113,81.14050149917603,0 +313,0.40860632061958313,0.29331174492836,0.2895522713661194,0.19953380525112152,932.3563232421875,1e-05,2.888084888458252,3.3862545490264893,81.14050149917603,0 +314,0.25225624442100525,0.2193707674741745,0.24208596348762512,0.24918414652347565,835.7803955078125,1e-05,0.18094870448112488,2.843722343444824,81.14050149917603,0 +315,0.3137224316596985,0.5134902000427246,0.526893138885498,0.08694638311862946,194.7152557373047,1e-05,0.22406433522701263,2.845064163208008,81.14050149917603,0 +316,0.28416046500205994,0.20985910296440125,0.21115487813949585,0.20349650084972382,764.04736328125,1e-05,0.18170423805713654,3.0392091274261475,81.14050149917603,0 +317,0.24327124655246735,0.262475848197937,0.25400620698928833,0.22517482936382294,978.7633666992188,1e-05,0.15482564270496368,3.3756439685821533,81.14050149917603,0 +318,0.13412338495254517,0.22596272826194763,0.21232277154922485,0.2582750618457794,896.920654296875,1e-05,0.16036604344844818,3.2713241577148438,81.14050149917603,0 +319,0.2394474893808365,0.26497355103492737,0.26065781712532043,0.2142191082239151,820.587890625,1e-05,0.33586764335632324,3.4306225776672363,81.14050149917603,0 +320,0.22266261279582977,0.3417631983757019,0.3338776230812073,0.1818181872367859,917.9066772460938,1e-05,0.37792572379112244,2.8403079509735107,81.14050149917603,0 +321,0.1697099208831787,0.2734830677509308,0.2717932164669037,0.2181818187236786,982.5844116210938,1e-05,0.1865234524011612,2.841377019882202,81.14050149917603,0 +322,0.2111162394285202,0.15383432805538177,0.16546717286109924,0.19207459688186646,976.69921875,1e-05,0.21452206373214722,3.1171669960021973,81.14050149917603,0 +323,0.18907403945922852,0.25558626651763916,0.2817833423614502,0.1762237697839737,999.0592651367188,1e-05,0.20784799754619598,3.1456503868103027,81.14050149917603,0 +324,0.2111346572637558,0.3633682131767273,0.36828961968421936,0.15874126553535461,996.771484375,1e-05,0.27782106399536133,3.306379795074463,81.14050149917603,0 +325,0.09338673204183578,0.49976056814193726,0.5005913376808167,0.24032634496688843,998.4646606445312,1e-05,0.18331338465213776,3.1299402713775635,81.14050149917603,0 +326,0.36064183712005615,0.34591442346572876,0.3265577256679535,0.22167831659317017,983.0303955078125,1e-05,0.2022729068994522,2.849386692047119,81.14050149917603,0 +327,0.22061672806739807,0.32877564430236816,0.32784000039100647,0.12937062978744507,943.3546142578125,1e-05,0.26290038228034973,2.8500964641571045,81.14050149917603,0 +328,0.30167222023010254,0.27546319365501404,0.2655610144138336,0.2097902148962021,985.5084838867188,1e-05,0.24971872568130493,3.366156816482544,81.14050149917603,0 +329,0.2500282824039459,0.5223140120506287,0.4832489490509033,0.220279723405838,966.77880859375,1e-05,0.20568998157978058,3.2685365676879883,81.14050149917603,0 +330,0.13464826345443726,0.26255491375923157,0.26977330446243286,0.2554778456687927,973.9156494140625,1e-05,0.15800043940544128,3.286695718765259,81.14050149917603,0 +331,0.4181462228298187,0.267780065536499,0.25647619366645813,0.17529137432575226,890.9254760742188,1e-05,0.1773337423801422,3.1791882514953613,81.14050149917603,0 +332,0.15789711475372314,0.19526517391204834,0.19766978919506073,0.19417248666286469,951.0648803710938,1e-05,0.14153225719928741,2.8462588787078857,81.14050149917603,0 +333,0.31100669503211975,0.14098194241523743,0.15173126757144928,0.23449882864952087,842.5615844726562,1e-05,0.7155255079269409,2.8445401191711426,81.14050149917603,0 +334,0.1434819996356964,0.40496715903282166,0.37930890917778015,0.225874125957489,990.630615234375,1e-05,0.26033875346183777,3.3609094619750977,81.14050149917603,0 +335,0.33547160029411316,0.28734806180000305,0.26981011033058167,0.20396269857883453,720.25927734375,1e-05,4.637085914611816,3.3295021057128906,81.14050149917603,0 +336,0.24809964001178741,0.18242155015468597,0.1991235315799713,0.2433566451072693,972.5713500976562,1e-05,0.1982981562614441,3.341094970703125,81.14050149917603,0 +337,0.33165696263313293,0.4004182517528534,0.3923255205154419,0.19324009120464325,356.2078552246094,1e-05,0.22206735610961914,3.252852201461792,81.14050149917603,0 +338,0.07889033108949661,0.16825895011425018,0.18254278600215912,0.18554778397083282,972.5713500976562,1e-05,0.1547144055366516,2.8597800731658936,81.14050149917603,0 +339,0.27711769938468933,0.2717830538749695,0.26754897832870483,0.2321678251028061,931.2932739257812,1e-05,0.17752745747566223,2.849081039428711,81.14050149917603,0 +340,0.31472256779670715,0.31383365392684937,0.3130759298801422,0.07738927751779556,983.767822265625,1e-05,0.19712388515472412,3.313400983810425,81.14050149917603,0 +341,0.40478238463401794,0.2793615460395813,0.26938188076019287,0.2657342553138733,778.5809936523438,1e-05,0.19202807545661926,3.1051223278045654,81.14050149917603,0 +342,0.1372978240251541,0.26472440361976624,0.25350502133369446,0.25081583857536316,996.1564331054688,1e-05,0.32680922746658325,3.716189384460449,81.14050149917603,0 +343,0.3099287152290344,0.25974270701408386,0.2671554982662201,0.17832167446613312,808.654296875,1e-05,0.15826721489429474,3.1781973838806152,81.14050149917603,0 +344,0.2485332041978836,0.2789372503757477,0.2618679404258728,0.2885780930519104,944.2952880859375,1e-05,0.14027556777000427,2.8441526889801025,81.14050149917603,0 +345,0.29194456338882446,0.32219183444976807,0.3202219307422638,0.22634032368659973,495.12713623046875,1e-05,0.2754115164279938,2.855071783065796,81.14050149917603,0 +346,0.45457732677459717,0.25629493594169617,0.2564772963523865,0.269696980714798,586.15087890625,1e-05,0.20652168989181519,3.595386505126953,81.14050149917603,0 +347,0.25730931758880615,0.20102998614311218,0.21838700771331787,0.20046620070934296,888.9893188476562,1e-05,0.2004266232252121,3.2497851848602295,81.14050149917603,0 +348,0.20428667962551117,0.28041449189186096,0.26717039942741394,0.2142191082239151,964.1939697265625,1e-05,0.23075535893440247,3.141648054122925,81.14050149917603,0 +349,0.42274928092956543,0.2560873031616211,0.25899019837379456,0.23799534142017365,737.33203125,1e-05,0.1419866383075714,3.2005670070648193,81.14050149917603,0 +350,0.35481134057044983,0.3807256519794464,0.36407169699668884,0.2421911358833313,983.4736938476562,1e-05,0.3190493583679199,2.8580174446105957,81.14050149917603,0 +351,0.4890984296798706,0.23149503767490387,0.22535860538482666,0.255011647939682,842.5615844726562,1e-05,0.2699398398399353,3.160635471343994,81.14050149917603,0 +352,0.27025240659713745,0.15866607427597046,0.16623042523860931,0.25757575035095215,930.2188720703125,1e-05,0.17912279069423676,3.322619676589966,81.14050149917603,0 +353,0.21419325470924377,0.39857783913612366,0.396893709897995,0.16969697177410126,973.5816040039062,1e-05,1.5501163005828857,3.2982192039489746,81.14050149917603,0 +354,0.34217536449432373,0.21608126163482666,0.2157682329416275,0.22517482936382294,568.0068969726562,1e-05,0.1768050640821457,3.4508397579193115,81.14050149917603,0 +355,0.2574521601200104,0.2563512921333313,0.24802148342132568,0.225874125957489,920.0114135742188,1e-05,0.15841197967529297,2.854811429977417,81.14050149917603,0 +356,0.27426719665527344,0.33408522605895996,0.31115463376045227,0.2745920717716217,903.3214111328125,1e-05,0.21243998408317566,2.8494677543640137,81.14050149917603,0 +357,0.16969206929206848,0.14817416667938232,0.15187424421310425,0.12097901850938797,779.4003295898438,1e-05,0.17034777998924255,3.105703115463257,81.14050149917603,0 +358,0.3227631449699402,0.29812753200531006,0.2792901396751404,0.17039626836776733,922.3670654296875,1e-05,0.21145902574062347,3.0438971519470215,81.14050149917603,0 +359,0.2533012628555298,0.16492243111133575,0.16696400940418243,0.264102578163147,608.6077880859375,1e-05,0.23262357711791992,3.109180450439453,81.14050149917603,0 +360,0.14795954525470734,0.20859311521053314,0.19835467636585236,0.2482517510652542,784.2387084960938,1e-05,0.1798439621925354,3.445504665374756,81.14050149917603,0 +361,0.3242082893848419,0.2526501417160034,0.24689722061157227,0.22284382581710815,739.3676147460938,1e-05,0.16998514533042908,2.846174955368042,81.14050149917603,0 +362,0.22742554545402527,0.2627892792224884,0.2527463138103485,0.23146852850914001,773.583740234375,1e-05,0.19899313151836395,2.850886821746826,81.14050149917603,0 +363,0.26315805315971375,0.1808251142501831,0.1799083650112152,0.2377622425556183,924.6715087890625,1e-05,0.16403505206108093,3.107762336730957,81.14050149917603,0 +364,0.3672260046005249,0.24961252510547638,0.24072380363941193,0.16573426127433777,705.2662353515625,1e-05,0.3302235007286072,3.267862558364868,81.14050149917603,0 +365,0.3776167333126068,0.3722960948944092,0.3646232485771179,0.20955711603164673,427.6461486816406,1e-05,0.4785952866077423,3.114591121673584,81.14050149917603,0 +366,0.25739240646362305,0.23206627368927002,0.2301405966281891,0.2354312390089035,951.4989624023438,1e-05,0.13677433133125305,3.1522295475006104,81.14050149917603,0 +367,0.26536825299263,0.17156821489334106,0.17215444147586823,0.16643357276916504,660.37890625,1e-05,0.20000599324703217,2.8604276180267334,81.14050149917603,0 +368,0.10463881492614746,0.2439180165529251,0.2363913208246231,0.19720280170440674,952.1465454101562,1e-05,0.132207989692688,2.857866048812866,81.14050149917603,0 +369,0.2709856331348419,0.1517104059457779,0.14766888320446014,0.21678321063518524,686.5575561523438,1e-05,0.18532794713974,3.1589598655700684,81.14050149917603,0 +370,0.19512011110782623,0.3103398382663727,0.2922567129135132,0.16573426127433777,953.0025024414062,1e-05,0.17709532380104065,3.05546498298645,81.14050149917603,0 +371,0.3059390187263489,0.2377827912569046,0.2122705578804016,0.22004662454128265,851.6567993164062,1e-05,0.1505809873342514,3.105966567993164,81.14050149917603,0 +372,0.32598596811294556,0.4072272479534149,0.3830716907978058,0.16526806354522705,953.8506469726562,1e-05,0.12327277660369873,3.0911879539489746,81.14050149917603,0 +373,0.1296766698360443,0.26158568263053894,0.25955793261528015,0.2405594438314438,924.6715087890625,1e-05,0.20641574263572693,2.8475797176361084,81.14050149917603,0 +374,0.1932336837053299,0.28440821170806885,0.28306740522384644,0.2013985961675644,816.7084350585938,1e-05,0.5363542437553406,2.8384697437286377,81.14050149917603,0 +375,0.1057828962802887,0.2865733206272125,0.28294551372528076,0.09580419212579727,975.7278442382812,1e-05,0.1607634574174881,3.4945948123931885,81.14050149917603,0 +376,0.2993222773075104,0.3734716475009918,0.35657432675361633,0.2209790199995041,894.3345947265625,1e-05,0.15198741853237152,3.080052614212036,81.14050149917603,0 +377,0.41928455233573914,0.5893931984901428,0.5854758024215698,0.2097902148962021,165.13217163085938,1e-05,0.19498278200626373,3.100393533706665,81.14050149917603,0 +378,0.22472484409809113,0.2876613140106201,0.2842022478580475,0.14335663616657257,854.2249145507812,1e-05,0.325361043214798,3.1525750160217285,81.14050149917603,0 +379,0.16336701810359955,0.30059152841567993,0.29486390948295593,0.2501165568828583,945.226806640625,1e-05,0.3196820318698883,2.8376781940460205,81.14050149917603,0 +380,0.2772473692893982,0.22604939341545105,0.2265380471944809,0.250582754611969,981.0787963867188,1e-05,0.16091863811016083,2.851416826248169,81.14050149917603,0 +381,0.35574862360954285,0.39073529839515686,0.3833272159099579,0.18484848737716675,954.8995971679688,1e-05,0.2259385883808136,3.589904308319092,81.14050149917603,0 +382,0.2851219177246094,0.19740131497383118,0.1851731836795807,0.2298368364572525,663.2779541015625,1e-05,0.15017779171466827,3.3500335216522217,81.14050149917603,0 +383,0.22184136509895325,0.21688532829284668,0.21593943238258362,0.24195803701877594,708.8218383789062,1e-05,0.17372183501720428,3.1142005920410156,81.14050149917603,0 +384,0.2923486828804016,0.2357119470834732,0.24925430119037628,0.23799534142017365,470.316650390625,1e-05,0.20186366140842438,3.195704698562622,81.14050149917603,0 +385,0.28274595737457275,0.1595187783241272,0.16873416304588318,0.16083915531635284,913.8861694335938,1e-05,0.1846923828125,2.845137357711792,81.14050149917603,0 +386,0.2968077063560486,0.2557644546031952,0.2697314918041229,0.19766899943351746,944.0609741210938,1e-05,0.19071854650974274,3.1535208225250244,81.14050149917603,0 +387,0.32734689116477966,0.16440565884113312,0.1673610359430313,0.28787878155708313,673.1508178710938,1e-05,0.1686871349811554,3.113715648651123,81.14050149917603,0 +388,0.19116336107254028,0.16676431894302368,0.1650620847940445,0.24009324610233307,819.3053588867188,1e-05,0.23371478915214539,3.316679000854492,81.14050149917603,0 +389,0.22800669074058533,0.22429069876670837,0.23811672627925873,0.13519813120365143,978.9199829101562,1e-05,0.1850314736366272,3.133760690689087,81.14050149917603,0 +390,0.14572742581367493,0.20847827196121216,0.22284111380577087,0.11142191290855408,837.505126953125,1e-05,0.13839323818683624,3.182241201400757,81.14050149917603,0 +391,0.4228322207927704,0.20284898579120636,0.20471607148647308,0.08881118893623352,902.2786865234375,1e-05,0.2619284987449646,2.852510929107666,81.14050149917603,0 +392,0.24090668559074402,0.3427393436431885,0.3431602418422699,0.20722611248493195,977.4996337890625,1e-05,0.1828874796628952,3.157381057739258,81.14050149917603,0 +393,0.32477957010269165,0.47999414801597595,0.48520252108573914,0.25151515007019043,273.5347900390625,1e-05,0.21711820363998413,3.10892391204834,81.14050149917603,0 +394,0.23749393224716187,0.31362512707710266,0.30998796224594116,0.24382284283638,634.2159423828125,1e-05,0.2993374168872833,3.1047816276550293,81.14050149917603,0 +395,0.2506652772426605,0.32968854904174805,0.3385559916496277,0.23636363446712494,993.1259155273438,1e-05,0.1313936710357666,3.9108803272247314,81.14050149917603,0 +396,0.41057270765304565,0.2975541651248932,0.3112643361091614,0.21072261035442352,997.1378173828125,1e-05,0.175124391913414,2.855746269226074,81.14050149917603,0 +397,0.27761057019233704,0.3360094130039215,0.333881676197052,0.20652680099010468,924.6715087890625,1e-05,0.1649997979402542,2.8534770011901855,81.14050149917603,0 +398,0.3557005524635315,0.2536633312702179,0.2522375285625458,0.15920746326446533,502.9901123046875,1e-05,0.16304084658622742,3.0804529190063477,81.14050149917603,0 +399,0.21448083221912384,0.16521145403385162,0.16739165782928467,0.28787878155708313,629.2960815429688,1e-05,0.18722254037857056,3.4174296855926514,81.14050149917603,0 +400,0.2271910011768341,0.19697603583335876,0.20564831793308258,0.1878787875175476,849.041259765625,1e-05,0.16450026631355286,3.1078014373779297,81.14050149917603,0 +401,0.3335317373275757,0.32815054059028625,0.3264692723751068,0.11142191290855408,853.203369140625,1e-05,0.3539230227470398,3.572845935821533,81.14050149917603,0 +402,0.349382221698761,0.38265931606292725,0.362297922372818,0.25920745730400085,991.0303955078125,1e-05,0.6890670657157898,2.8361434936523438,81.14050149917603,0 +403,0.17612610757350922,0.15466994047164917,0.15814755856990814,0.16713286936283112,721.369140625,1e-05,0.13425754010677338,2.840580940246582,81.14050149917603,0 +404,0.28684163093566895,0.11325075477361679,0.13353173434734344,0.2377622425556183,686.5575561523438,1e-05,0.2267265021800995,3.103635787963867,81.14050149917603,0 +405,0.21724002063274384,0.1659945696592331,0.1706564873456955,0.18018648028373718,910.0397338867188,1e-05,0.17968563735485077,3.3388233184814453,81.14050149917603,0 +406,0.24609464406967163,0.2633410692214966,0.25946590304374695,0.12051282078027725,925.2398681640625,1e-05,0.18913498520851135,2.850407838821411,81.14050149917603,0 +407,0.16152700781822205,0.2927575707435608,0.2715784013271332,0.2599067687988281,969.2862548828125,1e-05,0.20044104754924774,3.5830090045928955,81.14050149917603,0 +408,0.17884676158428192,0.18004272878170013,0.19596648216247559,0.1610722541809082,886.6248779296875,1e-05,0.1282697170972824,2.8527581691741943,81.14050149917603,0 +409,0.29178738594055176,0.2327733337879181,0.22767724096775055,0.2713286578655243,742.382080078125,1e-05,0.22304661571979523,2.862178325653076,81.14050149917603,0 +410,0.2893286347389221,0.21692492067813873,0.22009392082691193,0.1627039611339569,940.2321166992188,1e-05,0.160042867064476,3.143874168395996,81.14050149917603,0 +411,0.33739662170410156,0.28829675912857056,0.2859783172607422,0.23589743673801422,724.6637573242188,1e-05,0.13893474638462067,3.376007318496704,81.14050149917603,0 +412,0.18810497224330902,0.1888137012720108,0.18688467144966125,0.14941725134849548,990.36279296875,1e-05,0.1287836879491806,2.8563292026519775,81.14050149917603,0 +413,0.19180434942245483,0.7389985918998718,0.7238548994064331,0.23030303418636322,999.4136352539062,1e-05,0.19705647230148315,3.6257779598236084,81.14050149917603,0 +414,0.3278888761997223,0.1671885997056961,0.18528661131858826,0.19976690411567688,932.3563232421875,1e-05,0.15922418236732483,2.838289737701416,81.14050149917603,0 +415,0.32439541816711426,0.23189899325370789,0.24170081317424774,0.17132866382598877,817.3616943359375,1e-05,0.16389493644237518,2.8420488834381104,81.14050149917603,0 +416,0.44811612367630005,0.3393087089061737,0.33391430974006653,0.1515151560306549,960.5552368164062,1e-05,0.2198936641216278,3.3908698558807373,81.14050149917603,0 +417,0.32894080877304077,0.2955065071582794,0.2806602716445923,0.2337995320558548,593.8468017578125,1e-05,0.19116108119487762,3.0858304500579834,81.14050149917603,0 +418,0.20928440988063812,0.30618810653686523,0.3089215159416199,0.2489510476589203,971.2042846679688,1e-05,0.14281360805034637,3.1059730052948,81.14050149917603,0 +419,0.2627948224544525,0.21095262467861176,0.21449033915996552,0.22960372269153595,947.5157470703125,1e-05,0.14941710233688354,3.0910770893096924,81.14050149917603,0 +420,0.18293513357639313,0.15741361677646637,0.17372511327266693,0.17016316950321198,691.7044067382812,1e-05,0.14383850991725922,2.8464882373809814,81.14050149917603,0 +421,0.18133720755577087,0.12508797645568848,0.1372346580028534,0.18857808411121368,557.397705078125,1e-05,0.17225299775600433,2.853037118911743,81.14050149917603,0 +422,0.3510406017303467,0.16668494045734406,0.16158847510814667,0.23333333432674408,812.7318115234375,1e-05,0.17050904035568237,3.352506160736084,81.14050149917603,0 +423,0.25549113750457764,0.22330933809280396,0.218744695186615,0.18298368155956268,931.025634765625,1e-05,0.13159476220607758,3.3034045696258545,81.14050149917603,0 +424,0.2516981363296509,0.3046591281890869,0.29750749468803406,0.25081583857536316,835.2010498046875,1e-05,0.17328974604606628,3.155025005340576,81.14050149917603,0 +425,0.3648861050605774,0.2564045786857605,0.24815484881401062,0.255011647939682,794.2818603515625,1e-05,0.22208905220031738,3.1283769607543945,81.14050149917603,0 +426,0.1884840726852417,0.14071975648403168,0.13225792348384857,0.24428904056549072,671.7659301757812,1e-05,0.14582759141921997,2.858431339263916,81.14050149917603,0 +427,0.2870289087295532,0.26109421253204346,0.2651432454586029,0.22610722482204437,714.6185302734375,1e-05,0.21680614352226257,2.836310625076294,81.14050149917603,0 +428,0.16287805140018463,0.4921991229057312,0.4699465036392212,0.17762237787246704,977.65869140625,1e-05,0.23803460597991943,3.368798017501831,81.14050149917603,0 +429,0.42644792795181274,0.33517560362815857,0.35882702469825745,0.1258741319179535,994.9097900390625,1e-05,0.19933488965034485,3.3030436038970947,81.14050149917603,0 +430,0.24588702619075775,0.17869263887405396,0.18292643129825592,0.17202797532081604,935.22314453125,1e-05,0.532225489616394,3.1721417903900146,81.14050149917603,0 +431,0.29248806834220886,0.3173966407775879,0.304271936416626,0.20675989985466003,889.7675170898438,1e-05,0.14793112874031067,3.282644510269165,81.14050149917603,0 +432,0.257467120885849,0.15311524271965027,0.14776091277599335,0.1554778516292572,821.8599853515625,1e-05,0.16719673573970795,2.855515956878662,81.14050149917603,0 +433,0.20468972623348236,0.21556302905082703,0.2013738453388214,0.17202797532081604,783.4415283203125,1e-05,0.27935078740119934,3.1421289443969727,81.14050149917603,0 +434,0.20086848735809326,0.1496172696352005,0.17070427536964417,0.225874125957489,931.826171875,1e-05,0.15217845141887665,3.3839566707611084,81.14050149917603,0 +435,0.23044569790363312,0.32020846009254456,0.31666263937950134,0.21888111531734467,586.15087890625,1e-05,0.23939570784568787,3.0698158740997314,81.14050149917603,0 +436,0.36985909938812256,0.18695126473903656,0.1944887787103653,0.1303030252456665,829.883544921875,1e-05,0.23705242574214935,3.133265733718872,81.14050149917603,0 +437,0.19485776126384735,0.27500423789024353,0.2512631118297577,0.21608391404151917,803.0537109375,1e-05,0.1942027509212494,3.2934937477111816,81.14050149917603,0 +438,0.16234397888183594,0.24034371972084045,0.24859407544136047,0.2114219069480896,449.6458740234375,1e-05,0.16767799854278564,2.840919256210327,81.14050149917603,0 +439,0.12694233655929565,0.2734645903110504,0.27718061208724976,0.21678321063518524,997.3809814453125,1e-05,0.14299419522285461,3.100792646408081,81.14050149917603,0 +440,0.35029810667037964,0.25994881987571716,0.26316943764686584,0.2354312390089035,977.4996337890625,1e-05,0.423676460981369,3.33143949508667,81.14050149917603,0 +441,0.23565202951431274,0.3108398914337158,0.3050292134284973,0.24848484992980957,613.9371337890625,1e-05,0.15151289105415344,3.3545939922332764,81.14050149917603,0 +442,0.24423827230930328,0.11022961884737015,0.11182109266519547,0.22447551786899567,789.71923828125,1e-05,0.2030707746744156,3.140444755554199,81.14050149917603,0 +443,0.2184552252292633,0.20155732333660126,0.1974909007549286,0.13776223361492157,935.22314453125,1e-05,0.13669657707214355,3.120722770690918,81.14050149917603,0 +444,0.2721017301082611,0.3058928847312927,0.29411017894744873,0.20606060326099396,601.3294677734375,1e-05,0.1604253351688385,2.8532772064208984,81.14050149917603,0 +445,0.2605462968349457,0.24578027427196503,0.24227696657180786,0.1818181872367859,835.7803955078125,1e-05,0.16365790367126465,3.1398863792419434,81.14050149917603,0 +446,0.25331559777259827,0.2715514302253723,0.270039439201355,0.22610722482204437,797.99267578125,1e-05,0.2007848024368286,3.374678373336792,81.14050149917603,0 +447,0.15338458120822906,0.13719825446605682,0.13486599922180176,0.2030303031206131,928.5856323242188,1e-05,0.2900715172290802,3.413522243499756,81.14050149917603,0 +448,0.397832989692688,0.32238030433654785,0.3087766766548157,0.22867132723331451,604.99365234375,1e-05,0.2052503377199173,2.841052532196045,81.14050149917603,0 +449,0.2955915629863739,0.19303977489471436,0.18745258450508118,0.15734265744686127,923.525634765625,1e-05,0.18739649653434753,3.14298152923584,81.14050149917603,0 +450,0.3214588463306427,0.2580278813838959,0.25269368290901184,0.279720276594162,727.9061279296875,1e-05,0.16373136639595032,2.843735933303833,81.14050149917603,0 +451,0.3872530460357666,0.1452903002500534,0.16794568300247192,0.19883449375629425,969.4624633789062,1e-05,0.3646257519721985,3.395358085632324,81.14050149917603,0 +452,0.33134064078330994,0.1738208830356598,0.19579707086086273,0.238228440284729,649.9450073242188,1e-05,0.14499585330486298,3.3046109676361084,81.14050149917603,0 +453,0.23525530099868774,0.1971360296010971,0.19972679018974304,0.15804195404052734,741.38232421875,1e-05,0.2591790556907654,3.2846896648406982,81.14050149917603,0 +454,0.21536478400230408,0.0732288733124733,0.08859863132238388,0.1946386992931366,885.4254760742188,1e-05,0.21020089089870453,3.2807087898254395,81.14050149917603,0 +455,0.2358277142047882,0.2510201930999756,0.2573423683643341,0.1515151560306549,732.1500854492188,1e-05,0.16764582693576813,2.8547933101654053,81.14050149917603,0 +456,0.3378404974937439,0.2553032636642456,0.2563151717185974,0.2596736550331116,527.8575439453125,1e-05,0.1886492520570755,2.8488917350769043,81.14050149917603,0 +457,0.3122897148132324,0.26435530185699463,0.2881608307361603,0.20909090340137482,982.2857666015625,1e-05,0.15244027972221375,3.290947675704956,81.14050149917603,0 +458,0.2970619797706604,0.27302226424217224,0.26142919063568115,0.22610722482204437,878.402587890625,1e-05,0.31133678555488586,3.322089672088623,81.14050149917603,0 +459,0.2008761763572693,0.13864965736865997,0.1339544802904129,0.11515151709318161,753.992919921875,1e-05,0.17462483048439026,3.1859333515167236,81.14050149917603,0 +460,0.2238551378250122,0.20863212645053864,0.21543928980827332,0.2377622425556183,864.5192260742188,1e-05,0.18552492558956146,3.1190216541290283,81.14050149917603,0 +461,0.2518005967140198,0.5731332898139954,0.576573371887207,0.19510489702224731,989.6887817382812,1e-05,0.1766970008611679,2.847820997238159,81.14050149917603,0 +462,0.45386961102485657,0.29558905959129333,0.28949210047721863,0.24452213943004608,963.818115234375,1e-05,0.25912219285964966,2.8344621658325195,81.14050149917603,0 +463,0.1806657314300537,0.4104559123516083,0.3973096013069153,0.18018648028373718,958.7767944335938,1e-05,0.20574986934661865,3.5713980197906494,81.14050149917603,0 +464,0.19838155806064606,0.5237298607826233,0.521043062210083,0.269696980714798,120.44096374511719,1e-05,0.18049992620944977,3.259162425994873,81.14050149917603,0 +465,0.402874231338501,0.14323961734771729,0.1506105661392212,0.23333333432674408,773.583740234375,1e-05,0.1556478887796402,3.1902666091918945,81.14050149917603,0 +466,0.28117460012435913,0.14089122414588928,0.15306435525417328,0.1990675926208496,935.7356567382812,1e-05,0.15113991498947144,3.1683847904205322,81.14050149917603,0 +467,0.1769508421421051,0.3425593078136444,0.3187507688999176,0.23752914369106293,938.0095825195312,1e-05,0.14967654645442963,2.851961135864258,81.14050149917603,0 +468,0.36831963062286377,0.37213197350502014,0.37442710995674133,0.23892773687839508,331.87054443359375,1e-05,0.1878075748682022,2.836653470993042,81.14050149917603,0 +469,0.16346801817417145,0.1555061787366867,0.16453322768211365,0.18857808411121368,870.5208129882812,1e-05,0.29306790232658386,3.108997344970703,81.14050149917603,0 +470,0.15124818682670593,0.2576342523097992,0.24128605425357819,0.23170162737369537,940.7190551757812,1e-05,0.17676055431365967,3.3240318298339844,81.14050149917603,0 +471,0.31939518451690674,0.1498861461877823,0.15656717121601105,0.12237761914730072,913.5706787109375,1e-05,0.1635282039642334,3.3187005519866943,81.14050149917603,0 +472,0.3144336938858032,0.6630005836486816,0.6608744859695435,0.2030303031206131,188.9440460205078,1e-05,0.25287187099456787,3.381423234939575,81.14050149917603,0 +473,0.3070470094680786,0.17301157116889954,0.17704066634178162,0.20629370212554932,864.0462646484375,1e-05,0.1704760640859604,2.8454625606536865,81.14050149917603,0 +474,0.25617218017578125,0.1482286900281906,0.16553901135921478,0.16923077404499054,386.44976806640625,1e-05,0.2413409799337387,3.120316743850708,81.14050149917603,0 +475,0.3016771972179413,0.2781941592693329,0.28326451778411865,0.22284382581710815,985.0772094726562,1e-05,0.3043934404850006,3.09549880027771,81.14050149917603,0 +476,0.3705899715423584,0.3163856267929077,0.297953724861145,0.19650349020957947,492.46246337890625,1e-05,0.18441958725452423,3.3372976779937744,81.14050149917603,0 +477,0.2347298562526703,0.28998416662216187,0.2960413098335266,0.07342657446861267,310.39483642578125,1e-05,0.15945209562778473,3.1640257835388184,81.14050149917603,0 +478,0.18161046504974365,0.2427540272474289,0.2513226866722107,0.21561771631240845,975.0736083984375,1e-05,0.1445845365524292,3.187664270401001,81.14050149917603,0 +479,0.18306753039360046,0.17673391103744507,0.1796593815088272,0.1023310050368309,942.1655883789062,1e-05,0.18318411707878113,2.8574204444885254,81.14050149917603,0 +480,0.2704412341117859,0.24366652965545654,0.23794354498386383,0.17039626836776733,870.5208129882812,1e-05,0.2336602360010147,3.0750479698181152,81.14050149917603,0 +481,0.3756137788295746,0.2844376862049103,0.2665655016899109,0.26153844594955444,914.5143432617188,1e-05,0.31435516476631165,3.22377610206604,81.14050149917603,0 +482,0.3561100363731384,0.1460653394460678,0.15474292635917664,0.12820512056350708,810.7058715820312,1e-05,0.19691355526447296,3.7088465690612793,81.14050149917603,0 +483,0.21721240878105164,0.3420281708240509,0.36879611015319824,0.1895104944705963,997.3809814453125,1e-05,0.13153302669525146,3.2014942169189453,81.14050149917603,0 +484,0.18258598446846008,0.11394919455051422,0.13299992680549622,0.22331002354621887,809.341064453125,1e-05,0.14695654809474945,3.078775644302368,81.14050149917603,0 +485,0.2952241003513336,0.23141179978847504,0.22048848867416382,0.23636363446712494,924.9560546875,1e-05,0.16413569450378418,2.836637496948242,81.14050149917603,0 +486,0.19324739277362823,0.1991829127073288,0.19445709884166718,0.14195804297924042,930.2188720703125,1e-05,0.11075419187545776,3.0834949016571045,81.14050149917603,0 +487,0.12705472111701965,0.23402856290340424,0.23304302990436554,0.21794871985912323,904.6971435546875,1e-05,0.1578814536333084,3.367879867553711,81.14050149917603,0 +488,0.25383076071739197,0.2975691258907318,0.2856907844543457,0.23613053560256958,864.0462646484375,1e-05,0.1610385626554489,3.417682647705078,81.14050149917603,0 +489,0.16515329480171204,0.31256207823753357,0.31360211968421936,0.13519813120365143,908.7275390625,1e-05,0.159422367811203,3.131258010864258,81.14050149917603,0 +490,0.18452247977256775,0.31563517451286316,0.3133823275566101,0.1662004590034485,989.41748046875,1e-05,0.26033952832221985,2.8419270515441895,81.14050149917603,0 +491,0.22556491196155548,0.19428691267967224,0.20943593978881836,0.19114218652248383,891.6915283203125,1e-05,0.2757228910923004,2.8365609645843506,81.14050149917603,0 +492,0.3033568263053894,0.6543219685554504,0.6474835872650146,0.19976690411567688,152.77052307128906,1e-05,0.1522825062274933,3.037834882736206,81.14050149917603,0 +493,0.29055094718933105,0.24873821437358856,0.25088560581207275,0.15897436439990997,969.9888916015625,1e-05,0.1633089929819107,3.3698792457580566,81.14050149917603,0 +494,0.18553540110588074,0.28002434968948364,0.27179041504859924,0.24242423474788666,699.2063598632812,1e-05,0.16565632820129395,3.654764175415039,81.14050149917603,0 +495,0.22250035405158997,0.20958711206912994,0.194337397813797,0.22610722482204437,856.7466430664062,1e-05,0.18130607903003693,3.085749626159668,81.14050149917603,0 +496,0.1166924461722374,0.2747219502925873,0.27331116795539856,0.2293706238269806,949.9702758789062,1e-05,0.22581881284713745,2.842529535293579,81.14050149917603,0 +497,0.1224507987499237,0.2347002625465393,0.2318395972251892,0.26247087121009827,771.0321044921875,1e-05,0.16291022300720215,2.8533244132995605,81.14050149917603,0 +498,0.10590387135744095,0.2824334502220154,0.2629382610321045,0.16573426127433777,952.5755615234375,1e-05,0.2553059160709381,3.0969953536987305,81.14050149917603,0 +499,0.258452445268631,0.26806673407554626,0.25754672288894653,0.16969697177410126,809.341064453125,1e-05,0.6550172567367554,3.265576124191284,81.14050149917603,0 +500,0.2653726041316986,0.16019921004772186,0.16404183208942413,0.1594405621290207,691.7044067382812,1e-05,0.29989302158355713,4.1266930103302,81.14050149917603,0 +501,0.2682512700557709,0.19722945988178253,0.20594392716884613,0.07925407588481903,630.94677734375,1e-05,0.25652310252189636,2.8396236896514893,81.14050197601318,0 +502,0.1504293531179428,0.2723596692085266,0.2633001208305359,0.22843822836875916,978.9199829101562,1e-05,0.2722867727279663,2.8282268047332764,81.14050197601318,0 +503,0.2003057301044464,0.21148476004600525,0.2094419151544571,0.1291375309228897,900.1648559570312,1e-05,0.268855482339859,2.8227550983428955,81.14050197601318,0 +504,0.3173772096633911,0.3358217477798462,0.32804566621780396,0.20000000298023224,675.8961181640625,1e-05,0.20853585004806519,3.1469123363494873,81.14050197601318,0 +505,0.30945414304733276,0.14119365811347961,0.1403900533914566,0.220279723405838,980.0068969726562,1e-05,0.15493951737880707,3.327976942062378,81.14050197601318,0 +506,0.1476859152317047,0.10763737559318542,0.11274729669094086,0.08857809007167816,853.203369140625,1e-05,0.23737822473049164,3.5208826065063477,81.14050197601318,0 +507,0.3563310503959656,0.2258324921131134,0.23121920228004456,0.12680652737617493,980.3147583007812,1e-05,0.19809462130069733,2.8344531059265137,81.14050197601318,0 +508,0.4074876606464386,0.23232103884220123,0.2185797095298767,0.23356643319129944,301.4790344238281,1e-05,0.7354811429977417,2.8430120944976807,81.14050197601318,0 +509,0.27090200781822205,0.29495206475257874,0.2808850109577179,0.214685320854187,632.5867309570312,1e-05,0.2674258053302765,2.847698211669922,81.14050197601318,0 +510,0.17670981585979462,0.43452581763267517,0.4375261962413788,0.12331002205610275,993.7682495117188,1e-05,0.30898410081863403,3.101330518722534,81.14050197601318,0 +511,0.2594771981239319,0.358064204454422,0.34432241320610046,0.2114219069480896,984.0607299804688,1e-05,0.2029392272233963,3.5712740421295166,81.14050197601318,0 +512,0.28355932235717773,0.153634712100029,0.15211352705955505,0.25920745730400085,917.2977905273438,1e-05,0.25237998366355896,3.356506109237671,81.14050197601318,0 +513,0.3000248670578003,0.4643373489379883,0.46178653836250305,0.20652680099010468,301.4790344238281,1e-05,0.37690919637680054,2.8433034420013428,81.14050197601318,0 +514,0.21253517270088196,0.13876108825206757,0.12992310523986816,0.15594404935836792,840.3358154296875,1e-05,0.15560252964496613,2.8577799797058105,81.14050197601318,0 +515,0.35841989517211914,0.20178668200969696,0.21367010474205017,0.10699300467967987,770.1734008789062,1e-05,0.18307307362556458,2.854120969772339,81.14050197601318,0 +516,0.2311650663614273,0.3600255846977234,0.35321691632270813,0.11235430836677551,980.4682006835938,1e-05,0.16350504755973816,3.402822732925415,81.14050197601318,0 +517,0.11796322464942932,0.3188503384590149,0.30730849504470825,0.20955711603164673,971.03173828125,1e-05,0.16699540615081787,3.469783067703247,81.14050197601318,0 +518,0.28062596917152405,0.3454832434654236,0.326927125453949,0.21794871985912323,776.0996704101562,1e-05,0.3508927822113037,3.3185133934020996,81.14050197601318,0 +519,0.234838604927063,0.23763251304626465,0.2550502419471741,0.10862471163272858,999.177734375,1e-05,0.17820854485034943,2.835726261138916,81.14050197601318,0 +520,0.2099122852087021,0.2905784249305725,0.2868911921977997,0.19254079461097717,992.477783203125,1e-05,0.12879051268100739,2.835867404937744,81.14050197601318,0 +521,0.3508531153202057,0.3031502068042755,0.30910563468933105,0.21888111531734467,310.39483642578125,1e-05,0.4990927577018738,3.0247116088867188,81.14050197601318,0 +522,0.39049232006073,0.17002317309379578,0.18264609575271606,0.1414918452501297,955.523193359375,1e-05,0.18479226529598236,3.35408091545105,81.14050197601318,0 +523,0.11623871326446533,0.4969519376754761,0.46917882561683655,0.22494173049926758,977.3401489257812,1e-05,0.12229824811220169,3.526524782180786,81.14050197601318,0 +524,0.19998840987682343,0.5058793425559998,0.48574891686439514,0.22191141545772552,998.34521484375,1e-05,0.17439347505569458,3.2912096977233887,81.14050197601318,0 +525,0.168965682387352,0.26856324076652527,0.269085556268692,0.20629370212554932,856.2459106445312,1e-05,0.1833326369524002,2.8366611003875732,81.14050197601318,0 +526,0.17733335494995117,0.23177815973758698,0.22315901517868042,0.22331002354621887,933.1463012695312,1e-05,0.13554207980632782,2.8464291095733643,81.14050197601318,0 +527,0.48375990986824036,0.22336556017398834,0.2233840525150299,0.2097902148962021,942.1655883789062,1e-05,0.2351740151643753,3.046513557434082,81.14050197601318,0 +528,0.20209114253520966,0.1893339902162552,0.21573926508426666,0.19650349020957947,340.1504821777344,1e-05,0.2438916116952896,3.072843551635742,81.14050197601318,0 +529,0.18504327535629272,0.3615703582763672,0.3813999891281128,0.21678321063518524,993.5120239257812,1e-05,0.32048675417900085,3.3003594875335693,81.14050197601318,0 +530,0.22620059549808502,0.28574758768081665,0.3010622560977936,0.15454545617103577,959.3736572265625,1e-05,0.1626186966896057,3.073084831237793,81.14050197601318,0 +531,0.33157557249069214,0.09342215955257416,0.1010303944349289,0.17132866382598877,933.4083862304688,1e-05,0.17605748772621155,2.835462808609009,81.14050197601318,0 +532,0.3768787384033203,0.18368884921073914,0.17871305346488953,0.20652680099010468,922.3670654296875,1e-05,0.17718596756458282,2.8537092208862305,81.14050197601318,0 +533,0.33952274918556213,0.4994139075279236,0.5127204060554504,0.1662004590034485,140.08938598632812,1e-05,0.17016033828258514,3.350428342819214,81.14050197601318,0 +534,0.1946028620004654,0.19829821586608887,0.19724728167057037,0.08484848588705063,836.3575439453125,1e-05,0.8795830607414246,3.110386371612549,81.14050197601318,0 +535,0.24936848878860474,0.3611045181751251,0.3435886800289154,0.22074592113494873,296.9483642578125,1e-05,0.432796835899353,3.553339958190918,81.14050197601318,0 +536,0.34677305817604065,0.2450704127550125,0.2640029788017273,0.1958041936159134,978.9199829101562,1e-05,0.19096578657627106,3.1433279514312744,81.14050197601318,0 +537,0.37161508202552795,0.3204072415828705,0.3222452700138092,0.2449883371591568,481.577392578125,1e-05,0.17985934019088745,2.8381576538085938,81.14050197601318,0 +538,0.1922565996646881,0.25859951972961426,0.24933743476867676,0.2393939346075058,961.334228515625,1e-05,0.21130801737308502,2.8406624794006348,81.14050197601318,0 +539,0.23639234900474548,0.17029254138469696,0.1751372069120407,0.25198134779930115,946.8348388671875,1e-05,0.2965584397315979,3.4081900119781494,81.14050197601318,0 +540,0.2900668680667877,0.3060341477394104,0.30036067962646484,0.24801865220069885,492.46246337890625,1e-05,0.19287829101085663,3.4220311641693115,81.14050197601318,0 +541,0.21993456780910492,0.16650710999965668,0.17316949367523193,0.23682983219623566,966.596923828125,1e-05,0.45107924938201904,3.449036121368408,81.14050197601318,0 +542,0.24334992468357086,0.34847989678382874,0.3505309522151947,0.21491841971874237,954.271728515625,1e-05,0.1725742369890213,2.8403046131134033,81.14050197601318,0 +543,0.16580313444137573,0.21272732317447662,0.2115475982427597,0.27365967631340027,868.7028198242188,1e-05,0.13733629882335663,2.8527684211730957,81.14050197601318,0 +544,0.21252675354480743,0.24805781245231628,0.22664546966552734,0.250582754611969,994.4046630859375,1e-05,0.21185798943042755,2.852938652038574,81.14050197601318,0 +545,0.3059713840484619,0.4951479732990265,0.5009388327598572,0.2405594438314438,200.4163818359375,1e-05,0.2209911197423935,3.3555049896240234,81.14050197601318,0 +546,0.2643323838710785,0.2806451916694641,0.267752468585968,0.23356643319129944,870.0686645507812,1e-05,0.1811465620994568,3.103792667388916,81.14050197601318,0 +547,0.3012278974056244,0.323491632938385,0.308010995388031,0.19813519716262817,910.6900634765625,1e-05,0.13079337775707245,3.428217649459839,81.14050197601318,0 +548,0.2176753282546997,0.33486199378967285,0.3154672384262085,0.22470861673355103,781.836181640625,1e-05,0.17865699529647827,2.850799560546875,81.14050197601318,0 +549,0.15134531259536743,0.28723058104515076,0.2718053460121155,0.19393938779830933,885.8264770507812,1e-05,0.1459331512451172,2.847909688949585,81.14050197601318,0 +550,0.2100839912891388,0.3242550492286682,0.32027876377105713,0.21212121844291687,861.1730346679688,1e-05,0.35693874955177307,3.1015334129333496,81.14050197601318,0 +551,0.19909994304180145,0.3345981538295746,0.3214666247367859,0.18881118297576904,913.5706787109375,1e-05,0.2307032346725464,3.366790533065796,81.14050197601318,0 +552,0.2843163311481476,0.3582090139389038,0.34252825379371643,0.2461538463830948,987.069091796875,1e-05,0.15402264893054962,3.339512348175049,81.14050197601318,0 +553,0.4528985619544983,0.57319176197052,0.5716896653175354,0.12074591964483261,165.13217163085938,1e-05,0.2908049523830414,3.355207920074463,81.14050197601318,0 +554,0.28767719864845276,0.38054758310317993,0.37624362111091614,0.20606060326099396,934.9658203125,1e-05,0.20073524117469788,2.840512990951538,81.14050197601318,0 +555,0.20557944476604462,0.22568048536777496,0.22597254812717438,0.017482517287135124,931.826171875,1e-05,0.14464037120342255,2.8405206203460693,81.14050197601318,0 +556,0.24290302395820618,0.261616587638855,0.2644045948982239,0.09650349617004395,962.2981567382812,1e-05,0.18293479084968567,3.0249648094177246,81.14050197601318,0 +557,0.3968697488307953,0.5669571161270142,0.565606415271759,0.21351981163024902,243.64947509765625,1e-05,0.6817564964294434,3.304080009460449,81.14050197601318,0 +558,0.22643336653709412,0.23540882766246796,0.24106043577194214,0.15524475276470184,976.2150268554688,1e-05,0.17583341896533966,3.513110399246216,81.14050197601318,0 +559,0.25070247054100037,0.21762406826019287,0.22174793481826782,0.18135197460651398,912.93701171875,1e-05,0.14876168966293335,3.424600601196289,81.14050197601318,0 +560,0.0954047217965126,0.27527090907096863,0.2688004672527313,0.1666666716337204,972.9094848632812,1e-05,0.1292523741722107,2.8282577991485596,81.14050197601318,0 +561,0.4279339909553528,0.46025893092155457,0.4432431161403656,0.21002331376075745,217.11199951171875,1e-05,0.23007990419864655,2.828339099884033,81.14050197601318,0 +562,0.19004757702350616,0.17554181814193726,0.186374694108963,0.1470862478017807,561.6887817382812,1e-05,0.20279189944267273,3.1424570083618164,81.14050197601318,0 +563,0.3813052177429199,0.12111678719520569,0.12279248237609863,0.15571095049381256,864.9906616210938,1e-05,0.8227514028549194,3.156935214996338,81.14050197601318,0 +564,0.24179595708847046,0.22402790188789368,0.21226198971271515,0.2310023307800293,821.2252807617188,1e-05,0.17585213482379913,3.40081524848938,81.14050197601318,0 +565,0.18568751215934753,0.34247785806655884,0.34268391132354736,0.2174825221300125,411.0456848144531,1e-05,0.13620789349079132,3.0632855892181396,81.14050197601318,0 +566,0.3011782467365265,0.36174309253692627,0.3422642946243286,0.23729602992534637,955.9364624023438,1e-05,0.19302795827388763,2.8615806102752686,81.14050197601318,0 +567,0.3555524945259094,0.2704535722732544,0.25341638922691345,0.2543123662471771,789.71923828125,1e-05,0.130475252866745,2.850182056427002,81.14050197601318,0 +568,0.17764806747436523,0.27953052520751953,0.2839084267616272,0.15920746326446533,936.7528076171875,1e-05,0.1794905662536621,3.452890157699585,81.14050197601318,0 +569,0.33075475692749023,0.17651130259037018,0.1744878739118576,0.14755244553089142,668.9708251953125,1e-05,0.171259343624115,3.0816543102264404,81.14050197601318,0 +570,0.13582083582878113,0.2915927767753601,0.28686922788619995,0.21934731304645538,960.7506713867188,1e-05,0.16611412167549133,3.3957881927490234,81.14050197601318,0 +571,0.12394701689481735,0.12633518874645233,0.12025664001703262,0.1790209710597992,857.74267578125,1e-05,0.4565008580684662,3.114379405975342,81.14050197601318,0 +572,0.22645452618598938,0.32437071204185486,0.3250350058078766,0.28671327233314514,624.2781982421875,1e-05,0.18109045922756195,2.8440499305725098,81.14050197601318,0 +573,0.3580843210220337,0.343753844499588,0.33171936869621277,0.15361304581165314,959.966552734375,1e-05,0.4357208013534546,2.8319272994995117,81.14050197601318,0 +574,0.3704600930213928,0.2338544875383377,0.22191371023654938,0.17575757205486298,582.22021484375,1e-05,0.2462131232023239,3.2734107971191406,81.14050197601318,0 +575,0.2132503092288971,0.2842088043689728,0.28817230463027954,0.16596736013889313,985.364990234375,1e-05,0.13800886273384094,3.268312454223633,81.14050197601318,0 +576,0.28905192017555237,0.28313496708869934,0.27946096658706665,0.22913752496242523,704.0678100585938,1e-05,0.23632732033729553,3.417020797729492,81.14050197601318,0 +577,0.3504198491573334,0.25348907709121704,0.26232805848121643,0.19230769574642181,972.0613403320312,1e-05,0.5608384013175964,3.126617670059204,81.14050197601318,0 +578,0.28242817521095276,0.21604542434215546,0.21157029271125793,0.1722610741853714,798.72509765625,1e-05,0.15567612648010254,2.836138963699341,81.14050197601318,0 +579,0.22649890184402466,0.2453034669160843,0.25199249386787415,0.12564101815223694,981.9857788085938,1e-05,0.25243914127349854,2.838409900665283,81.14050197601318,0 +580,0.2883024513721466,0.24477866291999817,0.2515237331390381,0.2181818187236786,622.5833740234375,1e-05,0.15507838129997253,3.333312749862671,81.14050197601318,0 +581,0.37076160311698914,0.2105759084224701,0.2054784893989563,0.2477855533361435,879.6704711914062,1e-05,0.19587266445159912,3.3470563888549805,81.14050197601318,0 +582,0.20289157330989838,0.37310466170310974,0.3584747314453125,0.18694639205932617,990.228515625,1e-05,0.18319542706012726,3.433225393295288,81.14050197601318,0 +583,0.1529790759086609,0.3373852074146271,0.33718618750572205,0.2074592113494873,970.8588256835938,1e-05,0.16126738488674164,2.843425750732422,81.14050197601318,0 +584,0.1783563792705536,0.27790868282318115,0.28858527541160583,0.24242423474788666,991.8234252929688,1e-05,0.1352999359369278,2.850464105606079,81.14050197601318,0 +585,0.405527263879776,0.13386470079421997,0.13137134909629822,0.2030303031206131,928.8597412109375,1e-05,0.24551376700401306,2.8406364917755127,81.14050197601318,0 +586,0.22950415313243866,0.39120346307754517,0.4078071415424347,0.1722610741853714,985.0772094726562,1e-05,0.21689638495445251,3.143786668777466,81.14050197601318,0 +587,0.23368263244628906,0.3736673593521118,0.3401965796947479,0.21188810467720032,998.2254028320312,1e-05,0.23041053116321564,3.3597679138183594,81.14050197601318,0 +588,0.1732987016439438,0.4616508185863495,0.4522704780101776,0.12121211737394333,993.7682495117188,1e-05,0.1745244860649109,3.404688835144043,81.14050197601318,0 +589,0.25483837723731995,0.2683309316635132,0.2676406800746918,0.2097902148962021,907.0654907226562,1e-05,0.1882762461900711,2.8439109325408936,81.14050197601318,0 +590,0.35696184635162354,0.17759118974208832,0.1939476877450943,0.23729602992534637,946.8348388671875,1e-05,0.19480885565280914,2.8351850509643555,81.14050197601318,0 +591,0.4699014723300934,0.14729399979114532,0.15185248851776123,0.23892773687839508,772.7371215820312,1e-05,0.19961176812648773,3.040678024291992,81.14050197601318,0 +592,0.17220290005207062,0.23526030778884888,0.23478080332279205,0.15291374921798706,921.19580078125,1e-05,0.14975829422473907,3.321105718612671,81.14050197601318,0 +593,0.2240755558013916,0.3086065351963043,0.3053255081176758,0.1890442818403244,963.251220703125,1e-05,0.1759236454963684,3.4163906574249268,81.14050197601318,0 +594,0.21974745392799377,0.2990509569644928,0.30034634470939636,0.25874125957489014,939.9876098632812,1e-05,0.21701651811599731,3.133681297302246,81.14050197601318,0 +595,0.3337613642215729,0.1952703446149826,0.18710735440254211,0.1750582754611969,866.3948974609375,1e-05,0.20789851248264313,2.8486649990081787,81.14050197601318,0 +596,0.14254747331142426,0.20960405468940735,0.21043941378593445,0.2708624601364136,917.6026611328125,1e-05,0.17401567101478577,2.843264579772949,81.14050197601318,0 +597,0.23536942899227142,0.21371473371982574,0.21164540946483612,0.20652680099010468,862.6173095703125,1e-05,0.19136518239974976,3.0659446716308594,81.14050197601318,0 +598,0.2400600165128708,0.32798275351524353,0.3232741057872772,0.25524476170539856,968.3995361328125,1e-05,0.13776227831840515,3.3719851970672607,81.14050197601318,0 +599,0.2512170970439911,0.34882503747940063,0.3444853127002716,0.22214451432228088,963.0614624023438,1e-05,0.24108430743217468,3.5404891967773438,81.14050197601318,0 +600,0.3758155107498169,0.1802217662334442,0.18042495846748352,0.1850815862417221,467.44049072265625,1e-05,0.14456789195537567,3.1110472679138184,81.14050197601318,0 +601,0.20631127059459686,0.28293949365615845,0.2725699543952942,0.2522144615650177,994.6576538085938,1e-05,0.14589549601078033,2.8388705253601074,81.14050197601318,0 +602,0.27520135045051575,0.1846005618572235,0.1909635066986084,0.2046620100736618,837.505126953125,1e-05,0.2515764534473419,2.839520215988159,81.14050197601318,0 +603,0.16485996544361115,0.14842234551906586,0.1587563455104828,0.12727272510528564,969.4624633789062,1e-05,0.18209931254386902,3.0953609943389893,81.14050197601318,0 +604,0.2618141174316406,0.24790972471237183,0.24225600063800812,0.20629370212554932,912.2996826171875,1e-05,0.22916395962238312,3.2748284339904785,81.14050197601318,0 +605,0.13527986407279968,0.3502473533153534,0.3265993893146515,0.1354312300682068,977.0203857421875,1e-05,0.1867830753326416,3.626462697982788,81.14050197601318,0 +606,0.3082939684391022,0.2815741300582886,0.2755271792411804,0.16083915531635284,955.523193359375,1e-05,0.1682862639427185,2.8419666290283203,81.14050197601318,0 +607,0.20051470398902893,0.22490063309669495,0.2139275223016739,0.2466200441122055,838.6439208984375,1e-05,0.26078441739082336,2.8376870155334473,81.14050197601318,0 +608,0.311649352312088,0.3096520006656647,0.2937390208244324,0.2046620100736618,796.51806640625,1e-05,0.3837525546550751,2.838087558746338,81.14050197601318,0 +609,0.46648895740509033,0.3788694143295288,0.37313804030418396,0.2097902148962021,979.2321166992188,1e-05,0.20420677959918976,3.022508144378662,81.14050197601318,0 +610,0.3602568805217743,0.5910237431526184,0.6205745339393616,0.22564102709293365,127.0761489868164,1e-05,0.2545407712459564,3.3722617626190186,81.14050197601318,0 +611,0.13548095524311066,0.3129445016384125,0.3010063171386719,0.2426573485136032,987.2093505859375,1e-05,0.10391075164079666,3.65421462059021,81.14050197601318,0 +612,0.31276264786720276,0.2609908878803253,0.2528739273548126,0.20000000298023224,981.6846923828125,1e-05,0.25382569432258606,2.8403642177581787,81.14050197601318,0 +613,0.20418408513069153,0.27752888202667236,0.2727234661579132,0.24452213943004608,557.397705078125,1e-05,0.2793310582637787,2.8389980792999268,81.14050197601318,0 +614,0.27796071767807007,0.2921251952648163,0.30096492171287537,0.22121211886405945,421.0982971191406,1e-05,0.14720116555690765,2.8549323081970215,81.14050197601318,0 +615,0.2805558741092682,0.18373312056064606,0.18900392949581146,0.12354312092065811,913.2542724609375,1e-05,0.5025897026062012,3.2784576416015625,81.14050197601318,0 +616,0.24970309436321259,0.21232065558433533,0.2121231108903885,0.16247086226940155,838.6439208984375,1e-05,0.18055427074432373,3.559256076812744,81.14050197601318,0 +617,0.20460905134677887,0.2716786563396454,0.2712534964084625,0.25874125957489014,937.2574462890625,1e-05,0.14605580270290375,3.5031392574310303,81.14050197601318,0 +618,0.20036639273166656,0.3492906987667084,0.3543097674846649,0.1263403296470642,994.0235595703125,1e-05,0.13785254955291748,2.8488900661468506,81.14050197601318,0 +619,0.21817275881767273,0.2819174826145172,0.2786352336406708,0.17692308127880096,822.4921875,1e-05,0.15759523212909698,2.8549890518188477,81.14050197601318,0 +620,0.3209252953529358,0.24641653895378113,0.24797265231609344,0.1191142201423645,832.2701416015625,1e-05,0.16612227261066437,3.1027638912200928,81.14050197601318,0 +621,0.4518469274044037,0.2490100860595703,0.24779218435287476,0.21608391404151917,691.7044067382812,1e-05,0.18765045702457428,3.113266944885254,81.14050197601318,0 +622,0.236120343208313,0.2425883561372757,0.23497694730758667,0.23403263092041016,845.2969360351562,1e-05,0.1270851045846939,3.5838584899902344,81.14050197601318,0 +623,0.1762658804655075,0.2502467632293701,0.2419811189174652,0.12121211737394333,937.759521484375,1e-05,0.18480919301509857,3.4249167442321777,81.14050197601318,0 +624,0.22520488500595093,0.21854811906814575,0.20973587036132812,0.21002331376075745,939.0036010742188,1e-05,0.17369715869426727,2.840162992477417,81.14050197601318,0 +625,0.2897722125053406,0.2806541621685028,0.2879808247089386,0.19557109475135803,348.26116943359375,1e-05,0.2228984236717224,2.8371312618255615,81.14050197601318,0 +626,0.1635875701904297,0.08961910754442215,0.09329337626695633,0.11678321659564972,674.5276489257812,1e-05,0.22091296315193176,3.105391502380371,81.14050197601318,0 +627,0.14461912214756012,0.27056050300598145,0.266073077917099,0.1191142201423645,951.93115234375,1e-05,0.1990046501159668,3.067723274230957,81.14050197601318,0 +628,0.0828922763466835,0.33433303236961365,0.3161826431751251,0.21328671276569366,968.7553100585938,1e-05,0.13856126368045807,3.564307689666748,81.14050197601318,0 +629,0.15288524329662323,0.08896836638450623,0.09838511794805527,0.09720280021429062,944.9946899414062,1e-05,0.1523970067501068,3.392151355743408,81.14050197601318,0 +630,0.15858358144760132,0.2970379590988159,0.30692312121391296,0.2018647938966751,979.6979370117188,1e-05,0.14367793500423431,2.8448848724365234,81.14050197601318,0 +631,0.35819193720817566,0.22275885939598083,0.22320634126663208,0.1818181872367859,939.4969482421875,1e-05,0.1855907142162323,2.8482139110565186,81.14050197601318,0 +632,0.30247724056243896,0.40203678607940674,0.40373364090919495,0.22517482936382294,991.954833984375,1e-05,0.1573583334684372,3.2593793869018555,81.14050197601318,0 +633,0.2303224354982376,0.17611350119113922,0.18559607863426208,0.15477855503559113,853.203369140625,1e-05,0.2164999395608902,3.293809175491333,81.14050197601318,0 +634,0.22840501368045807,0.31092292070388794,0.3148188889026642,0.26153844594955444,979.8526000976562,1e-05,0.4450412392616272,3.2636356353759766,81.14050197601318,0 +635,0.13937044143676758,0.26075276732444763,0.24440278112888336,0.15198135375976562,935.22314453125,1e-05,0.16046728193759918,3.441626787185669,81.14050197601318,0 +636,0.3844602108001709,0.7149277925491333,0.7044470906257629,0.19603729248046875,100.0000228881836,1e-05,0.20544306933879852,2.840710401535034,81.14050197601318,0 +637,0.40526023507118225,0.35273605585098267,0.34033674001693726,0.26643356680870056,695.4873657226562,1e-05,0.1940746307373047,2.8385162353515625,81.14050197601318,0 +638,0.3101810812950134,0.17966914176940918,0.1785491555929184,0.18018648028373718,515.6737670898438,1e-05,0.19862835109233856,3.135758638381958,81.14050197601318,0 +639,0.42927858233451843,0.292552649974823,0.2875615358352661,0.16130536794662476,622.5833740234375,1e-05,0.2727092504501343,3.1213619709014893,81.14050197601318,0 +640,0.16368231177330017,0.29815205931663513,0.2910032868385315,0.23449882864952087,911.0138549804688,1e-05,0.20964594185352325,3.5157275199890137,81.14050197601318,0 +641,0.25639310479164124,0.21378475427627563,0.21306295692920685,0.16923077404499054,635.8348388671875,1e-05,0.19329513609409332,3.1722161769866943,81.14050197601318,0 +642,0.13182732462882996,0.15484821796417236,0.1695028692483902,0.2298368364572525,961.9138793945312,1e-05,0.1453983336687088,2.842151165008545,81.14050197601318,0 +643,0.2881925106048584,0.43803688883781433,0.4424248933792114,0.08484848588705063,258.84716796875,1e-05,0.1552148312330246,2.8618454933166504,81.14050197601318,0 +644,0.3485262989997864,0.26601260900497437,0.2556590437889099,0.14452214539051056,800.1805419921875,1e-05,0.12351067364215851,3.30430006980896,81.14050197601318,0 +645,0.21403376758098602,0.1380825787782669,0.13203835487365723,0.20885780453681946,972.0613403320312,1e-05,0.20981241762638092,3.07082462310791,81.14050197601318,0 +646,0.16297036409378052,0.19523465633392334,0.19628889858722687,0.2526806592941284,984.3526000976562,1e-05,0.44683921337127686,3.3176498413085938,81.14050197601318,0 +647,0.3304468095302582,0.2902168035507202,0.29229095578193665,0.20606060326099396,443.50128173828125,1e-05,0.13903014361858368,3.1366820335388184,81.14050197601318,0 +648,0.17064017057418823,0.40346530079841614,0.40328267216682434,0.16083915531635284,998.34521484375,1e-05,1.3104181289672852,2.838597059249878,81.14050197601318,0 +649,0.1418129950761795,0.20294123888015747,0.1922335922718048,0.19277389347553253,900.5198364257812,1e-05,0.13641300797462463,2.8370208740234375,81.14050197601318,0 +650,0.19406189024448395,0.1190759688615799,0.11744247376918793,0.11305361241102219,785.0322875976562,1e-05,0.20708966255187988,3.3615942001342773,81.14050197601318,0 +651,0.32138490676879883,0.24165858328342438,0.23868711292743683,0.0839160829782486,597.6142578125,1e-05,0.1893441379070282,3.3474364280700684,81.14050197601318,0 +652,0.33274176716804504,0.13849857449531555,0.13429206609725952,0.25081583857536316,776.0996704101562,1e-05,0.1582360714673996,3.4734745025634766,81.14050197601318,0 +653,0.3601243197917938,0.2660452425479889,0.2506972551345825,0.139860138297081,921.48974609375,1e-05,0.14446045458316803,2.8335819244384766,81.14050197601318,0 +654,0.23257794976234436,0.16028839349746704,0.16501107811927795,0.22913752496242523,944.7620849609375,1e-05,0.21483874320983887,2.8345348834991455,81.14050197601318,0 +655,0.17105580866336823,0.37636488676071167,0.37051793932914734,0.2058275043964386,974.08203125,1e-05,0.12463714182376862,2.8371009826660156,81.14050197601318,0 +656,0.21505334973335266,0.4392922520637512,0.4507620632648468,0.1878787875175476,978.4493408203125,1e-05,1.233579158782959,3.127885103225708,81.14050197601318,0 +657,0.34642690420150757,0.1335608959197998,0.14351680874824524,0.2041957974433899,700.4320068359375,1e-05,0.1600721925497055,3.3068087100982666,81.14050197601318,0 +658,0.3440101146697998,0.2803986668586731,0.27283167839050293,0.10256410390138626,972.0613403320312,1e-05,0.16458740830421448,3.394343376159668,81.14050197601318,0 +659,0.1761782020330429,0.44192442297935486,0.40775349736213684,0.19930069148540497,989.5532836914062,1e-05,0.1521550565958023,2.8389155864715576,81.14050197601318,0 +660,0.1834900975227356,0.3341284990310669,0.3293868601322174,0.24032634496688843,989.2814331054688,1e-05,0.14376996457576752,2.8385605812072754,81.14050197601318,0 +661,0.22505821287631989,0.1869710385799408,0.18566162884235382,0.2170163094997406,880.5089721679688,1e-05,0.14801916480064392,2.831420660018921,81.14050197601318,0 +662,0.24444139003753662,0.24697981774806976,0.23751454055309296,0.2596736550331116,921.19580078125,1e-05,0.14228372275829315,3.0996644496917725,81.14050197601318,0 +663,0.2694506049156189,0.23640500009059906,0.22409550845623016,0.24918414652347565,919.7131958007812,1e-05,0.1917240023612976,3.2586045265197754,81.14050197601318,0 +664,0.2849329710006714,0.25812914967536926,0.24612651765346527,0.22960372269153595,911.0138549804688,1e-05,0.18631841242313385,3.4255971908569336,81.14050197601318,0 +665,0.19622038304805756,0.34853124618530273,0.3448264002799988,0.23123542964458466,966.77880859375,1e-05,0.25750142335891724,2.843029260635376,81.14050197601318,0 +666,0.32720687985420227,0.391456663608551,0.400564581155777,0.19953380525112152,371.6285705566406,1e-05,0.1407947838306427,2.8394088745117188,81.14050197601318,0 +667,0.29550468921661377,0.16408443450927734,0.17827537655830383,0.25687646865844727,766.697998046875,1e-05,0.21726462244987488,2.8406991958618164,81.14050197601318,0 +668,0.1725042760372162,0.2846871018409729,0.26554253697395325,0.1734265685081482,727.9061279296875,1e-05,0.1470288336277008,3.1155991554260254,81.14050197601318,0 +669,0.40322092175483704,0.24419105052947998,0.2509586811065674,0.23240093886852264,954.0613403320312,1e-05,0.2554578483104706,3.391301155090332,81.14050197601318,0 +670,0.21678340435028076,0.1911146193742752,0.18444359302520752,0.25314685702323914,954.271728515625,1e-05,0.41198301315307617,3.363504409790039,81.14050197601318,0 +671,0.17948001623153687,0.3269501328468323,0.30876290798187256,0.2510489523410797,994.27783203125,1e-05,0.15567313134670258,2.8394007682800293,81.14050197601318,0 +672,0.31115585565567017,0.23515751957893372,0.22075694799423218,0.2599067687988281,851.6567993164062,1e-05,0.16306205093860626,2.852602958679199,81.14050197601318,0 +673,0.19668777287006378,0.19914135336875916,0.20787669718265533,0.23986013233661652,815.3939208984375,1e-05,0.2205514907836914,3.1193244457244873,81.14050197601318,0 +674,0.10396869480609894,0.32960397005081177,0.3199865221977234,0.23193472623825073,998.7031860351562,1e-05,0.10819721221923828,3.0801634788513184,81.14050197601318,0 +675,0.19171632826328278,0.21256214380264282,0.21332672238349915,0.22960372269153595,933.9302368164062,1e-05,0.30134835839271545,3.403879404067993,81.14050197601318,0 +676,0.223288431763649,0.1470882147550583,0.14861199259757996,0.13076922297477722,875.3941650390625,1e-05,0.14067533612251282,3.294127941131592,81.14050197601318,0 +677,0.20316313207149506,0.214081808924675,0.21959622204303741,0.25314685702323914,865.4603271484375,1e-05,0.18225741386413574,2.8458807468414307,81.14050197601318,0 +678,0.2203376293182373,0.31266626715660095,0.3105939030647278,0.21072261035442352,895.8192749023438,1e-05,0.2196556180715561,2.844820261001587,81.14050197601318,0 +679,0.25042062997817993,0.38023239374160767,0.36677098274230957,0.2242424190044403,979.54296875,1e-05,0.31728509068489075,3.0452096462249756,81.14050197601318,0 +680,0.24859032034873962,0.20406034588813782,0.20085026323795319,0.19836829602718353,914.8272094726562,1e-05,0.17458076775074005,2.8405098915100098,81.14050197601318,0 +681,0.28403306007385254,0.27493229508399963,0.27238744497299194,0.23333333432674408,691.7044067382812,1e-05,0.1506434679031372,3.3632330894470215,81.14050197601318,0 +682,0.23522010445594788,0.4546099007129669,0.4513690769672394,0.15804195404052734,227.91456604003906,1e-05,0.16517895460128784,3.3106935024261475,81.14050197601318,0 +683,0.18910494446754456,0.1601770967245102,0.1695561558008194,0.14755244553089142,992.8673706054688,1e-05,0.20874103903770447,2.8351259231567383,81.14050197601318,0 +684,0.3119836151599884,0.2254941314458847,0.22219963371753693,0.2142191082239151,779.4003295898438,1e-05,0.1817110776901245,2.83817720413208,81.14050197601318,0 +685,0.15194812417030334,0.2563101053237915,0.25311344861984253,0.21678321063518524,555.2279663085938,1e-05,0.3340829312801361,3.093980550765991,81.14050197601318,0 +686,0.3574735224246979,0.2046966403722763,0.1851830929517746,0.2589743435382843,970.1636352539062,1e-05,0.21076229214668274,3.1127126216888428,81.14050197601318,0 +687,0.3266313672065735,0.8800580501556396,0.8471700549125671,0.19230769574642181,990.0938720703125,1e-05,0.47245287895202637,3.3191916942596436,81.14050197601318,0 +688,0.2734825313091278,0.30473241209983826,0.28678208589553833,0.2242424190044403,877.97705078125,1e-05,0.1562466323375702,3.3334102630615234,81.14050197601318,0 +689,0.3526056706905365,0.3999515473842621,0.39076897501945496,0.1878787875175476,382.7987976074219,1e-05,0.1342674195766449,2.8284080028533936,81.14050197601318,0 +690,0.3788529932498932,0.24859006702899933,0.23851443827152252,0.16363635659217834,853.715087890625,1e-05,0.13957451283931732,2.8325538635253906,81.14050197601318,0 +691,0.21747246384620667,0.46281054615974426,0.495554119348526,0.1734265685081482,158.9905548095703,1e-05,0.12636125087738037,3.336862564086914,81.14050197601318,0 +692,0.12987828254699707,0.23221544921398163,0.22722026705741882,0.2377622425556183,902.6273193359375,1e-05,0.15442505478858948,4.06234335899353,81.14050197601318,0 +693,0.24822300672531128,0.3146264851093292,0.2949979305267334,0.22517482936382294,969.1096801757812,1e-05,0.49724262952804565,3.4845502376556396,81.14050197601318,0 +694,0.2723223567008972,0.1675703078508377,0.16292504966259003,0.13799533247947693,734.2389526367188,1e-05,0.16233710944652557,3.419780731201172,81.14050197601318,0 +695,0.19483931362628937,0.20543792843818665,0.21242746710777283,0.2242424190044403,639.041015625,1e-05,0.14042013883590698,2.8453867435455322,81.14050197601318,0 +696,0.19025790691375732,0.14859065413475037,0.15509141981601715,0.17296037077903748,768.4440307617188,1e-05,0.11901216953992844,2.844501495361328,81.14050197601318,0 +697,0.2542479932308197,0.20632557570934296,0.20413489639759064,0.26247087121009827,834.0355224609375,1e-05,0.1310661882162094,3.3066866397857666,81.14050197601318,0 +698,0.19664868712425232,0.20912007987499237,0.2269301414489746,0.23193472623825073,970.3380126953125,1e-05,0.16456826031208038,3.0832834243774414,81.14050197601318,0 +699,0.20506012439727783,0.12771598994731903,0.1287638396024704,0.1958041936159134,748.2748413085938,1e-05,0.1295897215604782,3.446657657623291,81.14050197601318,0 +700,0.17492948472499847,0.231991246342659,0.23799799382686615,0.12097901850938797,982.2857666015625,1e-05,0.15957945585250854,3.1228270530700684,81.14050197601318,0 +701,0.3803712725639343,0.30968818068504333,0.34012797474861145,0.19766899943351746,292.3681640625,1e-05,0.19747599959373474,2.8465805053710938,81.14050197601318,0 +702,0.14565202593803406,0.23704396188259125,0.24441221356391907,0.10163170099258423,933.9302368164062,1e-05,0.14352498948574066,2.8503575325012207,81.14050197601318,0 +703,0.389682412147522,0.14998546242713928,0.15435156226158142,0.1722610741853714,603.1679077148438,1e-05,0.19656327366828918,3.290414333343506,81.14050197601318,0 +704,0.2942892909049988,0.17150190472602844,0.17949117720127106,0.24382284283638,599.4783325195312,1e-05,0.14742714166641235,3.0833325386047363,81.14050197601318,0 +705,0.3890839219093323,0.2383202165365219,0.24222852289676666,0.24475523829460144,467.44049072265625,1e-05,0.14200235903263092,3.155953884124756,81.14050197601318,0 +706,0.3284374475479126,0.22271932661533356,0.20818696916103363,0.1818181872367859,695.4873657226562,1e-05,0.15897893905639648,3.156536340713501,81.14050197601318,0 +707,0.24797038733959198,0.4876435697078705,0.47240880131721497,0.14382284879684448,990.630615234375,1e-05,0.1320795863866806,2.8342931270599365,81.14050197601318,0 +708,0.19739337265491486,0.22625386714935303,0.23537158966064453,0.18811188638210297,960.9456176757812,1e-05,0.1469798982143402,2.8419361114501953,81.14050197601318,0 +709,0.15145441889762878,0.18892158567905426,0.17893879115581512,0.08484848588705063,880.926025390625,1e-05,0.16376662254333496,3.3799870014190674,81.14050197601318,0 +710,0.2555794417858124,0.19938971102237701,0.2164195328950882,0.17645686864852905,979.6979370117188,1e-05,0.1264481544494629,3.369506359100342,81.14050197601318,0 +711,0.31609272956848145,0.3946479856967926,0.39264732599258423,0.21165500581264496,301.4790344238281,1e-05,0.21237967908382416,3.389608383178711,81.14050197601318,0 +712,0.17431898415088654,0.3773321807384491,0.37824955582618713,0.13333334028720856,999.7660522460938,1e-05,0.15661853551864624,2.8427698612213135,81.14050197601318,0 +713,0.24647913873195648,0.1916077584028244,0.1913861334323883,0.10419580340385437,912.93701171875,1e-05,0.18260127305984497,2.84033465385437,81.14050197601318,0 +714,0.30118438601493835,0.14632993936538696,0.1423117071390152,0.26083916425704956,789.71923828125,1e-05,0.16691581904888153,3.1471848487854004,81.14050197601318,0 +715,0.19661463797092438,0.32462549209594727,0.32850372791290283,0.18811188638210297,999.8831176757812,1e-05,0.14185763895511627,3.0451531410217285,81.14050197601318,0 +716,0.3137769103050232,0.22059427201747894,0.21091987192630768,0.23146852850914001,888.2062377929688,1e-05,0.18118199706077576,3.3445067405700684,81.14050197601318,0 +717,0.2708989381790161,0.7888193726539612,0.781653106212616,0.23193472623825073,120.44096374511719,1e-05,0.2658572196960449,3.3966877460479736,81.14050197601318,0 +718,0.22480128705501556,0.2766810655593872,0.2812005579471588,0.21235431730747223,956.142333984375,1e-05,0.2866984009742737,2.8520209789276123,81.14050197601318,0 +719,0.2134850174188614,0.22660118341445923,0.2167937457561493,0.1258741319179535,969.1096801757812,1e-05,0.14027512073516846,2.8584282398223877,81.14050197601318,0 +720,0.2533600628376007,0.10523604601621628,0.11657276004552841,0.1822843849658966,931.826171875,1e-05,0.15435178577899933,3.338503837585449,81.14050197601318,0 +721,0.1803787499666214,0.6379644870758057,0.625800609588623,0.16969697177410126,146.47067260742188,1e-05,0.1576109677553177,3.365288019180298,81.14050197601318,0 +722,0.3019895553588867,0.4267615079879761,0.4039211869239807,0.2426573485136032,997.6233520507812,1e-05,0.1658431589603424,3.4510741233825684,81.14050197601318,0 +723,0.2095540165901184,0.20938129723072052,0.19923754036426544,0.232634037733078,770.1734008789062,1e-05,0.17068542540073395,3.392914056777954,81.14050197601318,0 +724,0.14773966372013092,0.2608698904514313,0.25923553109169006,0.22727273404598236,958.576904296875,1e-05,0.32038822770118713,2.8429067134857178,81.14050197601318,0 +725,0.2916869521141052,0.314480185508728,0.3158467710018158,0.16993007063865662,568.0068969726562,1e-05,0.12498953193426132,2.8618743419647217,81.14050197601318,0 +726,0.21534447371959686,0.26052331924438477,0.2540137469768524,0.1962703913450241,923.525634765625,1e-05,0.2774275541305542,3.165836811065674,81.14050197601318,0 +727,0.3452166020870209,0.19005514681339264,0.18633711338043213,0.16083915531635284,931.826171875,1e-05,0.31374508142471313,3.051945209503174,81.14050197601318,0 +728,0.18832707405090332,0.22545020282268524,0.23004285991191864,0.12540791928768158,530.23681640625,1e-05,0.12938068807125092,3.1032586097717285,81.14050197601318,0 +729,0.1749148964881897,0.2151942402124405,0.2084391713142395,0.14568763971328735,908.7275390625,1e-05,0.19335101544857025,3.437248468399048,81.14050197601318,0 +730,0.34535664319992065,0.10409995913505554,0.10657525807619095,0.17365966737270355,559.55126953125,1e-05,0.12100394815206528,2.8557822704315186,81.14050197601318,0 +731,0.16407239437103271,0.20212507247924805,0.200428768992424,0.2321678251028061,737.33203125,1e-05,0.2989887595176697,2.8484115600585938,81.14050197601318,0 +732,0.29124313592910767,0.8467514514923096,0.8762770295143127,0.20629370212554932,994.0235595703125,1e-05,0.15310142934322357,3.4011454582214355,81.14050197601318,0 +733,0.29336264729499817,0.30840107798576355,0.3079557418823242,0.26037296652793884,464.5392150878906,1e-05,0.2140963226556778,3.036207914352417,81.14050197601318,0 +734,0.09572675079107285,0.24532225728034973,0.26082074642181396,0.23496504127979279,981.9857788085938,1e-05,0.18618567287921906,3.482254981994629,81.14050197601318,0 +735,0.22081483900547028,0.1676752120256424,0.1608273684978485,0.23496504127979279,785.822265625,1e-05,0.41141778230667114,3.1257290840148926,81.14050197601318,0 +736,0.33278730511665344,0.327923983335495,0.31696805357933044,0.25477856397628784,979.2321166992188,1e-05,0.18083083629608154,2.8415675163269043,81.14050197601318,0 +737,0.3650754690170288,0.3415897786617279,0.34102800488471985,0.251748263835907,505.5683898925781,1e-05,0.16526980698108673,2.835754156112671,81.14050197601318,0 +738,0.40521201491355896,0.2808437943458557,0.2786603271961212,0.1930069923400879,682.6182250976562,1e-05,0.1687396913766861,3.3892762660980225,81.14050197601318,0 +739,0.2552657723426819,0.2217169553041458,0.22271347045898438,0.2354312390089035,681.2896118164062,1e-05,0.1729402095079422,3.069840669631958,81.14050197601318,0 +740,0.34289246797561646,0.1804526150226593,0.17890514433383942,0.1862470805644989,816.7084350585938,1e-05,0.13255906105041504,3.3911139965057373,81.14050197601318,0 +741,0.23996827006340027,0.09992863237857819,0.10478173941373825,0.08228438347578049,851.6567993164062,1e-05,0.18046991527080536,3.1594903469085693,81.14050197601318,0 +742,0.22477316856384277,0.2523307800292969,0.24667100608348846,0.21888111531734467,677.2564697265625,1e-05,0.3371291756629944,2.8406198024749756,81.14050197601318,0 +743,0.20579677820205688,0.3028388023376465,0.30144280195236206,0.23193472623825073,973.748779296875,1e-05,0.1422763615846634,2.8462307453155518,81.14050197601318,0 +744,0.3164080083370209,0.275084912776947,0.26017066836357117,0.2114219069480896,974.08203125,1e-05,0.18689046800136566,3.064931631088257,81.14050197601318,0 +745,0.23586291074752808,0.21794012188911438,0.2096722275018692,0.1867132931947708,930.2188720703125,1e-05,0.21350738406181335,3.3575704097747803,81.14050197601318,0 +746,0.2694350779056549,0.2899217903614044,0.26811233162879944,0.23123542964458466,883.4002075195312,1e-05,0.16847969591617584,3.1154918670654297,81.14050197601318,0 +747,0.34246334433555603,0.27934807538986206,0.2782302498817444,0.2769230902194977,683.93896484375,1e-05,0.16845384240150452,2.8412139415740967,81.14050197601318,0 +748,0.3555167615413666,0.2840860188007355,0.2841491401195526,0.15897436439990997,944.529052734375,1e-05,0.2334694266319275,2.843925714492798,81.14050197601318,0 +749,0.33939096331596375,0.20033447444438934,0.19898153841495514,0.2449883371591568,645.3312377929688,1e-05,0.21448060870170593,2.8493897914886475,81.14050197601318,0 +750,0.2641712725162506,0.17946870625019073,0.17669692635536194,0.25081583857536316,903.6668701171875,1e-05,0.16717101633548737,3.102593183517456,81.14050197601318,0 +751,0.24849455058574677,0.3308248221874237,0.31547820568084717,0.2393939346075058,979.0761108398438,1e-05,0.15035289525985718,3.3520052433013916,81.14050197601318,0 +752,0.3830950856208801,0.1458364874124527,0.1435685157775879,0.21095570921897888,718.021240234375,1e-05,0.3399243652820587,3.146540880203247,81.14050197601318,0 +753,0.2679023742675781,0.18128933012485504,0.17912396788597107,0.14801864326000214,527.8575439453125,1e-05,0.19928914308547974,2.8396055698394775,81.14050197601318,0 +754,0.2795156240463257,0.24521133303642273,0.23660726845264435,0.16083915531635284,608.6077880859375,1e-05,0.19592143595218658,2.8372364044189453,81.14050197601318,0 +755,0.1588238924741745,0.15645979344844818,0.15075194835662842,0.2242424190044403,753.992919921875,1e-05,0.24204467236995697,3.013751983642578,81.14050197601318,0 +756,0.1938597559928894,0.2847473919391632,0.29210036993026733,0.09883449971675873,977.0203857421875,1e-05,0.14002829790115356,3.3388631343841553,81.14050197601318,0 +757,0.28054243326187134,0.2728443741798401,0.2725607454776764,0.16083915531635284,427.6461486816406,1e-05,0.1797335147857666,3.397596597671509,81.14050197601318,0 +758,0.29965606331825256,0.24938400089740753,0.24871978163719177,0.16037295758724213,807.9645385742188,1e-05,0.1656019538640976,3.4185690879821777,81.14050197601318,0 +759,0.19187584519386292,0.22404970228672028,0.2164609581232071,0.25198134779930115,779.4003295898438,1e-05,0.1680910736322403,2.8403260707855225,81.14050197601318,0 +760,0.24095019698143005,0.1400168091058731,0.14544105529785156,0.17435897886753082,762.2591552734375,1e-05,0.15070034563541412,2.838371753692627,81.14050197601318,0 +761,0.1336994767189026,0.252941757440567,0.23726069927215576,0.18857808411121368,946.6068115234375,1e-05,0.1524869203567505,3.139723777770996,81.14050197601318,0 +762,0.25702863931655884,0.25691649317741394,0.25887417793273926,0.1986013948917389,950.8469848632812,1e-05,0.191258504986763,3.088545083999634,81.14050197601318,0 +763,0.2291809469461441,0.2513956129550934,0.2565360367298126,0.21771562099456787,842.00830078125,1e-05,0.15405651926994324,3.3410894870758057,81.14050197601318,0 +764,0.18024945259094238,0.17807148396968842,0.17642049491405487,0.20932400226593018,784.2387084960938,1e-05,0.17241111397743225,3.381967067718506,81.14050197601318,0 +765,0.19033007323741913,0.2589620053768158,0.2537931799888611,0.2354312390089035,973.5816040039062,1e-05,0.2725011706352234,2.8490052223205566,81.14050197601318,0 +766,0.2529381513595581,0.2479761689901352,0.24465937912464142,0.10419580340385437,972.5713500976562,1e-05,0.1850777268409729,2.8479902744293213,81.14050197601318,0 +767,0.23154674470424652,0.29518434405326843,0.29291847348213196,0.20932400226593018,946.8348388671875,1e-05,0.1376921385526657,3.0870766639709473,81.14050197601318,0 +768,0.21645979583263397,0.5363404154777527,0.560085117816925,0.20885780453681946,200.4163818359375,1e-05,0.13325287401676178,3.087015390396118,81.14050197601318,0 +769,0.18086494505405426,0.2692928612232208,0.25873863697052,0.1818181872367859,984.0607299804688,1e-05,0.2500911056995392,3.4126131534576416,81.14050197601318,0 +770,0.376543790102005,0.2069481611251831,0.21521419286727905,0.22447551786899567,393.64630126953125,1e-05,0.1487509161233902,3.139925718307495,81.14050197601318,0 +771,0.17564097046852112,0.2552383244037628,0.24493606388568878,0.16596736013889313,947.9669189453125,1e-05,0.2627529799938202,2.8298110961914062,81.14050197601318,0 +772,0.2188240885734558,0.24386349320411682,0.23246806859970093,0.23986013233661652,845.2969360351562,1e-05,0.1500692069530487,2.832881450653076,81.14050197601318,0 +773,0.26591840386390686,0.4239040017127991,0.41672956943511963,0.23473192751407623,348.26116943359375,1e-05,0.18519574403762817,3.09661865234375,81.14050197601318,0 +774,0.39754247665405273,0.3006089925765991,0.2915252447128296,0.25081583857536316,987.4890747070312,1e-05,0.16213837265968323,3.59553599357605,81.14050197601318,0 +775,0.27173545956611633,0.22881363332271576,0.2307937890291214,0.19114218652248383,772.7371215820312,1e-05,0.15506646037101746,3.11670184135437,81.14050197601318,0 +776,0.1803705096244812,0.279554545879364,0.2722860276699066,0.257342666387558,766.697998046875,1e-05,0.16021506488323212,3.1235854625701904,81.14050197601318,0 +777,0.27228832244873047,0.14622414112091064,0.1544741988182068,0.23869463801383972,832.2701416015625,1e-05,0.15447188913822174,2.83691668510437,81.14050197601318,0 +778,0.38539981842041016,0.15160587430000305,0.14959490299224854,0.25081583857536316,845.8379516601562,1e-05,0.18855538964271545,2.838594675064087,81.14050197601318,0 +779,0.23254558444023132,0.26516833901405334,0.2536090016365051,0.16363635659217834,827.4590454101562,1e-05,0.13253153860569,3.131592273712158,81.14050197601318,0 +780,0.220490962266922,0.19902510941028595,0.19845537841320038,0.22214451432228088,518.1495361328125,1e-05,0.1356985718011856,3.322782039642334,81.14050197601318,0 +781,0.21549610793590546,0.1304572969675064,0.14448976516723633,0.1734265685081482,940.7190551757812,1e-05,0.8609485030174255,3.317430257797241,81.14050197601318,0 +782,0.2566436529159546,0.3557499945163727,0.3591558337211609,0.17878787219524384,464.5392150878906,1e-05,0.18447238206863403,2.835991859436035,81.14050197601318,0 +783,0.14763173460960388,0.3247233033180237,0.327335387468338,0.07762237638235092,979.2321166992188,1e-05,0.170770525932312,2.8419158458709717,81.14050197601318,0 +784,0.20292913913726807,0.432969331741333,0.4191739857196808,0.18648017942905426,988.8717041015625,1e-05,0.18321193754673004,2.832045555114746,81.14050197601318,0 +785,0.2991013824939728,0.24131788313388824,0.22622378170490265,0.20629370212554932,712.31884765625,1e-05,0.2765245735645294,3.07417893409729,81.14050197601318,0 +786,0.17724384367465973,0.290708065032959,0.2808755338191986,0.21235431730747223,954.4815673828125,1e-05,0.48135703802108765,3.357034921646118,81.14050197601318,0 +787,0.20350493490695953,0.2221386730670929,0.22618068754673004,0.07878787815570831,983.0303955078125,1e-05,0.15749290585517883,3.3940162658691406,81.14050197601318,0 +788,0.29479289054870605,0.3791361451148987,0.37915903329849243,0.18531468510627747,962.4896240234375,1e-05,0.1643989086151123,3.000359296798706,81.14050197601318,0 +789,0.297410786151886,0.16266486048698425,0.16127701103687286,0.17925408482551575,928.31103515625,1e-05,0.4820113182067871,2.84631609916687,81.14050197601318,0 +790,0.36017537117004395,0.32100170850753784,0.3129279315471649,0.14848484098911285,452.67730712890625,1e-05,0.16411316394805908,2.852403402328491,81.14050197601318,0 +791,0.12043879181146622,0.2259315848350525,0.21681927144527435,0.19487179815769196,974.2481079101562,1e-05,0.12589339911937714,3.4753830432891846,81.14050197601318,0 +792,0.23403993248939514,0.26437002420425415,0.25619399547576904,0.1918414980173111,828.0687866210938,1e-05,0.2809070646762848,3.3630456924438477,81.14050197601318,0 +793,0.16885535418987274,0.3691704571247101,0.3618410527706146,0.23240093886852264,996.2799072265625,1e-05,0.1968146115541458,3.4481701850891113,81.14050197601318,0 +794,0.15757302939891815,0.18920840322971344,0.1931498497724533,0.2242424190044403,928.8597412109375,1e-05,0.2939371168613434,2.849388360977173,81.14050197601318,0 +795,0.08326371759176254,0.24561385810375214,0.24022924900054932,0.24731934070587158,991.2958374023438,1e-05,0.11561903357505798,2.8625950813293457,81.14050197601318,0 +796,0.4828502833843231,0.34324049949645996,0.33813586831092834,0.19650349020957947,452.67730712890625,1e-05,0.1622627228498459,3.1519830226898193,81.14050197601318,0 +797,0.2773061990737915,0.22146686911582947,0.2343425303697586,0.16200466454029083,807.9645385742188,1e-05,0.3838072717189789,3.051175832748413,81.14050197601318,0 +798,0.21943175792694092,0.22567477822303772,0.231037899851799,0.19650349020957947,938.0095825195312,1e-05,0.1661408543586731,3.5218722820281982,81.14050197601318,0 +799,0.12210207432508469,0.23759914934635162,0.24221262335777283,0.10303030163049698,979.3876342773438,1e-05,0.21377943456172943,3.0859594345092773,81.14050197601318,0 +800,0.10458739846944809,0.170915886759758,0.18211513757705688,0.21118880808353424,816.0525512695312,1e-05,0.18797564506530762,2.838822841644287,81.14050197601318,0 +801,0.2567729651927948,0.45270809531211853,0.43861281871795654,0.24405594170093536,975.5648193359375,1e-05,0.17642034590244293,2.8397419452667236,81.14050197601318,0 +802,0.2230849266052246,0.2409803420305252,0.2236820012331009,0.284149169921875,834.0355224609375,1e-05,0.172164648771286,3.3045921325683594,81.14050197601318,0 +803,0.2237936109304428,0.09652455151081085,0.11106663197278976,0.18391607701778412,832.2701416015625,1e-05,0.29970818758010864,3.064227819442749,81.14050197601318,0 +804,0.18184641003608704,0.09729663282632828,0.10073444992303848,0.08997669070959091,845.2969360351562,1e-05,0.3671823740005493,3.2294743061065674,81.14050197601318,0 +805,0.21169397234916687,0.2819340229034424,0.27315834164619446,0.2242424190044403,835.2010498046875,1e-05,0.146733820438385,3.187152147293091,81.14050197601318,0 +806,0.15787185728549957,0.1918347328901291,0.20173993706703186,0.20955711603164673,875.3941650390625,1e-05,0.15110500156879425,2.8436713218688965,81.14050197601318,0 +807,0.23271729052066803,0.4674772620201111,0.46333301067352295,0.1867132931947708,998.2254028320312,1e-05,0.17849808931350708,2.8504860401153564,81.14050197601318,0 +808,0.22681745886802673,0.30362996459007263,0.2881220579147339,0.2454545497894287,970.8588256835938,1e-05,0.23637354373931885,3.0925378799438477,81.14050197601318,0 +809,0.18291999399662018,0.20348773896694183,0.1965956836938858,0.2449883371591568,901.2266235351562,1e-05,0.17462311685085297,3.367121458053589,81.14050197601318,0 +810,0.13872112333774567,0.21018865704536438,0.18658393621444702,0.1958041936159134,834.6194458007812,1e-05,0.15497146546840668,3.29206919670105,81.14050197601318,0 +811,0.10308714956045151,0.5279316902160645,0.5104053020477295,0.1890442818403244,991.4281005859375,1e-05,0.18677248060703278,2.8448293209075928,81.14050197601318,0 +812,0.3982558846473694,0.25250688195228577,0.24066223204135895,0.1958041936159134,846.9136352539062,1e-05,0.207109272480011,2.851513385772705,81.14050197601318,0 +813,0.14953655004501343,0.4101751148700714,0.38328516483306885,0.22517482936382294,981.9857788085938,1e-05,0.11563265323638916,2.8519511222839355,81.14050197601318,0 +814,0.19853967428207397,0.15508440136909485,0.14597542583942413,0.2242424190044403,821.8599853515625,1e-05,0.20400935411453247,3.124255657196045,81.14050197601318,0 +815,0.2987522482872009,0.2698296904563904,0.2644314467906952,0.19813519716262817,548.6198120117188,1e-05,0.14352957904338837,3.41442608833313,81.14050197601318,0 +816,0.388187050819397,0.3287440538406372,0.32361066341400146,0.18881118297576904,382.7987976074219,1e-05,0.11737477034330368,3.3905961513519287,81.14050197601318,0 +817,0.16586603224277496,0.2791960537433624,0.26573798060417175,0.232634037733078,956.142333984375,1e-05,0.11680901050567627,2.848759174346924,81.14050197601318,0 +818,0.3124793469905853,0.1474103182554245,0.16090866923332214,0.1678321659564972,929.6773681640625,1e-05,0.13600832223892212,2.856961965560913,81.14050197601318,0 +819,0.13202354311943054,0.29903197288513184,0.2889893054962158,0.23310023546218872,998.2254028320312,1e-05,0.719539225101471,2.8589751720428467,81.14050197601318,0 +820,0.14994552731513977,0.31401777267456055,0.29882389307022095,0.12960372865200043,999.9999389648438,1e-05,0.1320432424545288,3.078028917312622,81.14050197601318,0 +821,0.1833435595035553,0.20437084138393402,0.2176530510187149,0.18531468510627747,756.7888793945312,1e-05,0.14679588377475739,3.6724421977996826,81.14050197601318,0 +822,0.2665199041366577,0.43379759788513184,0.423613578081131,0.28041958808898926,984.0607299804688,1e-05,0.13370688259601593,3.077484607696533,81.14050197601318,0 +823,0.18305177986621857,0.4911019504070282,0.48348268866539,0.17179487645626068,978.4493408203125,1e-05,0.18934151530265808,2.860243320465088,81.14050197601318,0 +824,0.135285884141922,0.22239704430103302,0.21183428168296814,0.21282051503658295,871.8681030273438,1e-05,0.14949509501457214,2.8526721000671387,81.14050197601318,0 +825,0.4664517045021057,0.3105524182319641,0.3087273836135864,0.2601398527622223,622.5833740234375,1e-05,0.20529232919216156,2.861234426498413,81.14050197601318,0 +826,0.1582370102405548,0.24920982122421265,0.2410576194524765,0.23916083574295044,951.7153930664062,1e-05,0.18523870408535004,3.426030397415161,81.14050197601318,0 +827,0.36311131715774536,0.261013925075531,0.2440440058708191,0.2668997645378113,845.2969360351562,1e-05,0.16370700299739838,3.1439425945281982,81.14050197601318,0 +828,0.21880757808685303,0.22178500890731812,0.21851631999015808,0.1303030252456665,921.7830200195312,1e-05,0.7043898701667786,3.070171356201172,81.14050197601318,0 +829,0.14467588067054749,0.24870139360427856,0.2532741129398346,0.16993007063865662,720.25927734375,1e-05,0.24473454058170319,2.8439488410949707,81.14050197601318,0 +830,0.30759111046791077,0.30709800124168396,0.3071289658546448,0.14638695120811462,922.947998046875,1e-05,0.1718667894601822,2.836031675338745,81.14050197601318,0 +831,0.24918612837791443,0.3260372281074524,0.3113388121128082,0.2596736550331116,858.7315673828125,1e-05,3.0283572673797607,3.0362210273742676,81.14050197601318,0 +832,0.24827267229557037,0.22050157189369202,0.20802006125450134,0.21655011177062988,728.9754028320312,1e-05,0.14972509443759918,3.418513059616089,81.14050197601318,0 +833,0.41247043013572693,0.27590253949165344,0.2704814076423645,0.20396269857883453,582.22021484375,1e-05,0.21551045775413513,3.1617085933685303,81.14050197601318,0 +834,0.2980476915836334,0.2583054006099701,0.2498505860567093,0.20209790766239166,926.9263305664062,1e-05,0.1286313831806183,3.107116460800171,81.14050197601318,0 +835,0.19104303419589996,0.39156967401504517,0.37057286500930786,0.23566433787345886,979.6979370117188,1e-05,0.1491900086402893,2.8423728942871094,81.14050197601318,0 +836,0.12888677418231964,0.40283018350601196,0.40941113233566284,0.1862470805644989,974.5794677734375,1e-05,0.16475200653076172,2.848639965057373,81.14050197601318,0 +837,0.15421931445598602,0.215047687292099,0.20696769654750824,0.19044288992881775,715.7589111328125,1e-05,0.15046004951000214,3.2791857719421387,81.14050197601318,0 +838,0.3050483763217926,0.09977544844150543,0.10190322995185852,0.21282051503658295,796.51806640625,1e-05,0.1699131727218628,3.5352349281311035,81.14050197601318,0 +839,0.11232933402061462,0.23012444376945496,0.23020631074905396,0.03146853297948837,942.8807373046875,1e-05,0.16289639472961426,3.4438164234161377,81.14050197601318,0 +840,0.41629987955093384,0.1451387107372284,0.15844343602657318,0.18601398169994354,774.4262084960938,1e-05,0.1507856696844101,3.0873842239379883,81.14050197601318,0 +841,0.157455712556839,0.3677350580692291,0.36524730920791626,0.17878787219524384,956.552734375,1e-05,0.1552690863609314,2.8490989208221436,81.14050197601318,0 +842,0.22560398280620575,0.2522280514240265,0.2729506492614746,0.18764568865299225,974.4140625,1e-05,0.2343388944864273,2.84775447845459,81.14050197601318,0 +843,0.11742740124464035,0.28208276629447937,0.2698749005794525,0.23473192751407623,966.596923828125,1e-05,0.13918322324752808,3.1447603702545166,81.14050197601318,0 +844,0.4286123216152191,0.20513468980789185,0.20248888432979584,0.24172493815422058,966.596923828125,1e-05,0.1745256930589676,3.4651708602905273,81.14050197601318,0 +845,0.18231788277626038,0.3125787079334259,0.3066682815551758,0.22517482936382294,998.7031860351562,1e-05,0.15534228086471558,3.5213756561279297,81.14050197601318,0 +846,0.2587699294090271,0.22888237237930298,0.22291941940784454,0.24475523829460144,961.5278930664062,1e-05,0.13735686242580414,3.1002955436706543,81.14050197601318,0 +847,0.14338797330856323,0.12067219614982605,0.1196209192276001,0.2030303031206131,925.8049926757812,1e-05,0.15543289482593536,2.8371732234954834,81.14050197601318,0 +848,0.18962836265563965,0.19859351217746735,0.19425855576992035,0.18974359333515167,735.275390625,1e-05,0.159807026386261,2.8388004302978516,81.14050197601318,0 +849,0.27068695425987244,0.1705397665500641,0.1858748197555542,0.1738927662372589,849.041259765625,1e-05,0.23768749833106995,3.109313726425171,81.14050197601318,0 +850,0.14310623705387115,0.36908605694770813,0.3618004322052002,0.27435898780822754,973.748779296875,1e-05,0.12937521934509277,3.5064022541046143,81.14050197601318,0 +851,0.22956517338752747,0.41170915961265564,0.3868052065372467,0.1867132931947708,983.767822265625,1e-05,0.46255892515182495,3.2274632453918457,81.14050197601318,0 +852,0.18891911208629608,0.20125621557235718,0.20658913254737854,0.2041957974433899,741.38232421875,1e-05,0.34724679589271545,3.101065158843994,81.14050197601318,0 +853,0.25767406821250916,0.17809538543224335,0.19070586562156677,0.19090908765792847,850.0933227539062,1e-05,0.2897164821624756,2.8701345920562744,81.14050197601318,0 +854,0.32078033685684204,0.16885297000408173,0.16707731783390045,0.23193472623825073,836.9324951171875,1e-05,0.224948912858963,2.858846426010132,81.14050197601318,0 +855,0.15562710165977478,0.295017272233963,0.28127747774124146,0.21398600935935974,666.1416625976562,1e-05,0.17942366003990173,3.0165774822235107,81.14050197601318,0 +856,0.30813777446746826,0.3265048861503601,0.3259739577770233,0.2174825221300125,952.5755615234375,1e-05,0.6017873287200928,3.4912872314453125,81.14050197601318,0 +857,0.4550122022628784,0.10124683380126953,0.11100330203771591,0.26806527376174927,892.831298828125,1e-05,0.6452586650848389,3.237536907196045,81.14050197601318,0 +858,0.20877309143543243,0.36177635192871094,0.35122230648994446,0.17552447319030762,988.4596557617188,1e-05,0.18086013197898865,3.0987942218780518,81.14050197601318,0 +859,0.38863295316696167,0.28980767726898193,0.2831960618495941,0.1382284313440323,875.8281860351562,1e-05,0.1827189177274704,2.8407645225524902,81.14050197601318,0 +860,0.2834469676017761,0.2937155067920685,0.2886667847633362,0.21888111531734467,943.8261108398438,1e-05,0.17433825135231018,2.8393776416778564,81.14050197601318,0 +861,0.27259254455566406,0.1879863440990448,0.19200633466243744,0.0811188817024231,851.6567993164062,1e-05,0.178873673081398,3.0751893520355225,81.14050197601318,0 +862,0.2635067105293274,0.19610226154327393,0.19368506968021393,0.22890442609786987,856.7466430664062,1e-05,0.17239661514759064,3.571216106414795,81.14050197601318,0 +863,0.29473942518234253,0.3735879957675934,0.37300318479537964,0.10489510744810104,979.0761108398438,1e-05,0.130376398563385,3.156346559524536,81.14050197601318,0 +864,0.33315208554267883,0.3135697841644287,0.2904691994190216,0.21048951148986816,935.9909057617188,1e-05,0.1594354659318924,3.0824544429779053,81.14050197601318,0 +865,0.1623898148536682,0.2766875922679901,0.27924779057502747,0.2242424190044403,999.9999389648438,1e-05,0.29726606607437134,2.86344051361084,81.14050197601318,0 +866,0.23786135017871857,0.24827751517295837,0.24439765512943268,0.11095570772886276,921.7830200195312,1e-05,0.1622096747159958,2.8515825271606445,81.14050197601318,0 +867,0.1559504121541977,0.19840268790721893,0.18775179982185364,0.21841491758823395,984.0607299804688,1e-05,0.6446904540061951,3.0561208724975586,81.14050197601318,0 +868,0.20371322333812714,0.11811921000480652,0.1301703304052353,0.21445220708847046,856.7466430664062,1e-05,0.1390228420495987,3.535090208053589,81.14050197601318,0 +869,0.18472641706466675,0.2556053400039673,0.2506891191005707,0.2181818187236786,854.7328491210938,1e-05,0.20923513174057007,3.3071417808532715,81.14050197601318,0 +870,0.267580509185791,0.22614185512065887,0.21092353761196136,0.21491841971874237,767.5730590820312,1e-05,0.16413915157318115,2.848559617996216,81.14050197601318,0 +871,0.29839643836021423,0.10210729390382767,0.10394720733165741,0.0951048955321312,885.8264770507812,1e-05,0.2384248524904251,2.8503425121307373,81.14050197601318,0 +872,0.300761878490448,0.22562722861766815,0.21811513602733612,0.21212121844291687,675.8961181640625,1e-05,0.15119031071662903,3.0318281650543213,81.14050197601318,0 +873,0.23836924135684967,0.21462945640087128,0.2063155621290207,0.20606060326099396,742.382080078125,1e-05,0.2104540467262268,3.189361810684204,81.14050197601318,0 +874,0.2947489619255066,0.46184423565864563,0.46014490723609924,0.1538461595773697,988.734619140625,1e-05,0.1643972396850586,3.1442039012908936,81.14050197601318,0 +875,0.2424088418483734,0.3098837733268738,0.3007386028766632,0.07878787815570831,667.560546875,1e-05,0.19556812942028046,3.342625856399536,81.14050197601318,0 +876,0.2893868386745453,0.30978843569755554,0.3121429681777954,0.1762237697839737,991.69189453125,1e-05,0.14805565774440765,2.8452327251434326,81.14050197601318,0 +877,0.19954366981983185,0.30457431077957153,0.3043399155139923,0.20909090340137482,964.1939697265625,1e-05,0.18644174933433533,2.841923475265503,81.14050197601318,0 +878,0.31231290102005005,0.33562272787094116,0.3311283588409424,0.1778554767370224,414.4279479980469,1e-05,0.1794043630361557,3.261331796646118,81.14050197601318,0 +879,0.10921269655227661,0.17958229780197144,0.17232739925384521,0.20629370212554932,899.0933837890625,1e-05,0.2168264091014862,3.3466532230377197,81.14050197601318,0 +880,0.26749077439308167,0.29763442277908325,0.3006061315536499,0.15058274567127228,690.4288330078125,1e-05,0.16450048983097076,3.500596761703491,81.14050197601318,0 +881,0.19008561968803406,0.17744401097297668,0.18009497225284576,0.2181818187236786,859.7134399414062,1e-05,0.12247443199157715,3.1083128452301025,81.14050197601318,0 +882,0.15387292206287384,0.29689571261405945,0.2890413999557495,0.23589743673801422,970.1636352539062,1e-05,0.33347392082214355,2.8503143787384033,81.14050197601318,0 +883,0.24896486103534698,0.2033393830060959,0.215518057346344,0.13566432893276215,990.8973388671875,1e-05,0.1523369997739792,2.8536975383758545,81.14050197601318,0 +884,0.26957952976226807,0.2568865418434143,0.25375327467918396,0.27715617418289185,949.5288696289062,1e-05,0.2139754742383957,3.1000969409942627,81.14050197601318,0 +885,0.13633054494857788,0.2206537127494812,0.20562343299388885,0.20629370212554932,844.7539672851562,1e-05,0.13211746513843536,3.4696812629699707,81.14050197601318,0 +886,0.14772333204746246,0.17877799272537231,0.18119986355304718,0.2069930136203766,568.0068969726562,1e-05,0.16450311243534088,3.403458833694458,81.14050197601318,0 +887,0.15309783816337585,0.8148291110992432,0.7547073364257812,0.19393938779830933,995.9088745117188,1e-05,0.12021244317293167,3.113377094268799,81.14050197601318,0 +888,0.24789826571941376,0.19811424612998962,0.20786873996257782,0.12797202169895172,574.1869506835938,1e-05,0.13724316656589508,2.8503241539001465,81.14050197601318,0 +889,0.249627485871315,0.2662610113620758,0.24679291248321533,0.27272728085517883,881.341796875,1e-05,1.0263322591781616,2.8674850463867188,81.14050197601318,0 +890,0.23042938113212585,0.2729255259037018,0.26208871603012085,0.16153846681118011,989.8240966796875,1e-05,0.17382799088954926,3.1260693073272705,81.14050197601318,0 +891,0.13416679203510284,0.22193744778633118,0.21891756355762482,0.19230769574642181,826.846923828125,1e-05,0.1647242158651352,3.8065402507781982,81.14050197601318,0 +892,0.14066600799560547,0.2835725247859955,0.28326326608657837,0.2198135256767273,981.0787963867188,1e-05,0.18456164002418518,3.0712742805480957,81.14050197601318,0 +893,0.20896437764167786,0.16998258233070374,0.16623328626155853,0.23589743673801422,857.74267578125,1e-05,0.252966046333313,3.349308490753174,81.14050197601318,0 +894,0.24626481533050537,0.27981510758399963,0.2872423529624939,0.21328671276569366,390.0654296875,1e-05,0.13954685628414154,2.8471968173980713,81.14050197601318,0 +895,0.27466681599617004,0.3397194743156433,0.32327350974082947,0.20606060326099396,258.84716796875,1e-05,0.38374632596969604,2.846930980682373,81.14050197601318,0 +896,0.16057637333869934,0.13633863627910614,0.13711954653263092,0.20512820780277252,834.6194458007812,1e-05,0.17424046993255615,3.435739755630493,81.14050197601318,0 +897,0.3469896912574768,0.35038134455680847,0.3503190279006958,0.17132866382598877,292.3681640625,1e-05,0.37908241152763367,3.386937141418457,81.14050197601318,0 +898,0.2392808496952057,0.18071238696575165,0.18461939692497253,0.1895104944705963,757.7117919921875,1e-05,0.12611526250839233,3.1135544776916504,81.14050197601318,0 +899,0.29052677750587463,0.296815425157547,0.28073427081108093,0.19254079461097717,902.6273193359375,1e-05,0.17892801761627197,3.1214568614959717,81.14050197601318,0 +900,0.40699097514152527,0.16888244450092316,0.15805062651634216,0.2282051295042038,901.2266235351562,1e-05,0.1878209263086319,2.8542635440826416,81.14050197601318,0 +901,0.22516551613807678,0.33675849437713623,0.3303394615650177,0.08298368006944656,957.7728271484375,1e-05,0.15562476217746735,2.855039358139038,81.14050197601318,0 +902,0.27591466903686523,0.29422423243522644,0.2750774323940277,0.23473192751407623,923.8132934570312,1e-05,0.16000138223171234,3.451535940170288,81.14050197601318,0 +903,0.11340267211198807,0.2967527508735657,0.29409727454185486,0.22750583291053772,963.818115234375,1e-05,0.12150592356920242,3.082555055618286,81.14050197601318,0 +904,0.1485278457403183,0.28073781728744507,0.2707078456878662,0.30233100056648254,968.7553100585938,1e-05,0.16705010831356049,3.126230239868164,81.14050197601318,0 +905,0.09255063533782959,0.11935645341873169,0.13721099495887756,0.17692308127880096,924.38623046875,1e-05,0.1552993655204773,3.150829553604126,81.14050197601318,0 +906,0.27945518493652344,0.06870826333761215,0.06971820443868637,0.14289043843746185,726.8310546875,1e-05,1.044968843460083,2.85066294670105,81.14050197601318,0 +907,0.23088808357715607,0.2160966396331787,0.20041298866271973,0.18298368155956268,852.1741943359375,1e-05,0.13436192274093628,3.031154155731201,81.14050197601318,0 +908,0.15349766612052917,0.35496559739112854,0.35813069343566895,0.1638694703578949,411.0456848144531,1e-05,0.21286404132843018,3.2332797050476074,81.14050197601318,0 +909,0.35920655727386475,0.2537018358707428,0.25795915722846985,0.23076923191547394,446.5873107910156,1e-05,0.190987229347229,3.119230270385742,81.14050197601318,0 +910,0.1699008196592331,0.17663295567035675,0.17333365976810455,0.21072261035442352,943.1180419921875,1e-05,0.11768461763858795,3.52042293548584,81.14050197601318,0 +911,0.3311786949634552,0.2985563576221466,0.28842130303382874,0.22004662454128265,905.37890625,1e-05,0.2087121158838272,2.850060224533081,81.14050197601318,0 +912,0.2296968549489975,0.2090698927640915,0.20593169331550598,0.20000000298023224,944.7620849609375,1e-05,0.1388116031885147,2.860036611557007,81.14050197601318,0 +913,0.3129117488861084,0.2782997488975525,0.27256083488464355,0.19557109475135803,670.3726196289062,1e-05,0.1732567697763443,3.0274364948272705,81.14050197601318,0 +914,0.260481595993042,0.19396497309207916,0.18817193806171417,0.19230769574642181,319.1216125488281,1e-05,0.15816639363765717,3.4870285987854004,81.14050197601318,0 +915,0.4022573232650757,0.20446628332138062,0.2120736837387085,0.22610722482204437,697.9737548828125,1e-05,0.31495457887649536,3.3337996006011963,81.14050197601318,0 +916,0.44099903106689453,0.2641911506652832,0.253244549036026,0.19090908765792847,882.9913330078125,1e-05,0.37847983837127686,3.276177167892456,81.14050197601318,0 +917,0.2935398817062378,0.27079954743385315,0.2502816319465637,0.19230769574642181,910.0397338867188,1e-05,0.18515834212303162,2.8571105003356934,81.14050197601318,0 +918,0.2056608647108078,0.28737321496009827,0.2800181806087494,0.13286712765693665,839.2100219726562,1e-05,0.17443369328975677,2.8524701595306396,81.14050197601318,0 +919,0.2486167699098587,0.5926632881164551,0.607234537601471,0.2254079282283783,120.44096374511719,1e-05,0.25010946393013,3.1018998622894287,81.14050197601318,0 +920,0.2928079068660736,0.3483833968639374,0.3361526429653168,0.07599067687988281,606.806884765625,1e-05,0.29072025418281555,3.4439029693603516,81.14050197601318,0 +921,0.2612311542034149,0.1980428546667099,0.20767830312252045,0.10442890226840973,999.177734375,1e-05,0.15926195681095123,3.365922689437866,81.14050197601318,0 +922,0.36342301964759827,0.26771584153175354,0.2662665545940399,0.1710955649614334,953.4276123046875,1e-05,0.13826388120651245,3.0805070400238037,81.14050197601318,0 +923,0.3020065128803253,0.18190011382102966,0.18225322663784027,0.2214452177286148,942.8807373046875,1e-05,0.1418507695198059,2.8453636169433594,81.14050197601318,0 +924,0.26873838901519775,0.172726571559906,0.17011263966560364,0.08484848588705063,550.8392333984375,1e-05,0.2863805890083313,2.846273899078369,81.14050197601318,0 +925,0.354415625333786,0.2178911715745926,0.22176530957221985,0.28484848141670227,934.7079467773438,1e-05,0.17006200551986694,3.0271456241607666,81.14050197601318,0 +926,0.22850771248340607,0.2946874499320984,0.2890336811542511,0.15734265744686127,572.1419677734375,1e-05,0.13276296854019165,3.4952166080474854,81.14050197601318,0 +927,0.2601715922355652,0.2642061114311218,0.24899694323539734,0.2365967333316803,949.9702758789062,1e-05,0.27363643050193787,3.3656809329986572,81.14050197601318,0 +928,0.21268470585346222,0.2865902781486511,0.2768867015838623,0.15687645971775055,973.0780639648438,1e-05,0.25347375869750977,3.117459297180176,81.14050197601318,0 +929,0.24272005259990692,0.364796906709671,0.34402135014533997,0.28205129504203796,952.5755615234375,1e-05,0.1546955406665802,2.835005283355713,81.14050197601318,0 +930,0.23017020523548126,0.2134636491537094,0.19364811480045319,0.1895104944705963,831.677001953125,1e-05,0.14833636581897736,2.8420517444610596,81.14050197601318,0 +931,0.19106335937976837,0.3155835270881653,0.30459535121917725,0.2170163094997406,993.7682495117188,1e-05,0.1975487470626831,3.495328903198242,81.14050197601318,0 +932,0.2101433426141739,0.11914049834012985,0.12038107216358185,0.18834498524665833,876.2608642578125,1e-05,0.16323590278625488,3.3385210037231445,81.14050197601318,0 +933,0.18544812500476837,0.3722124397754669,0.36256590485572815,0.15571095049381256,998.7031860351562,1e-05,0.162794828414917,3.0592052936553955,81.14050197601318,0 +934,0.18419580161571503,0.2986264228820801,0.32872694730758667,0.19533799588680267,183.10153198242188,1e-05,0.1500101536512375,3.0490479469299316,81.14050197601318,0 +935,0.23938259482383728,0.2607901692390442,0.2641693353652954,0.0867132842540741,283.0556640625,1e-05,0.2220708131790161,2.8415164947509766,81.14050197601318,0 +936,0.27836811542510986,0.16195416450500488,0.16079063713550568,0.22400932013988495,748.2748413085938,1e-05,0.24685224890708923,3.0223517417907715,81.14050197601318,0 +937,0.3023377060890198,0.24438826739788055,0.24978496134281158,0.09696969389915466,561.6887817382812,1e-05,0.13913622498512268,3.2580697536468506,81.14050197601318,0 +938,0.1511775255203247,0.20810164511203766,0.20748737454414368,0.11398601531982422,977.4996337890625,1e-05,0.3760431706905365,3.396852731704712,81.14050197601318,0 +939,0.20932073891162872,0.22532586753368378,0.217800572514534,0.20606060326099396,836.3575439453125,1e-05,0.21559900045394897,3.0605545043945312,81.14050197601318,0 +940,0.19291186332702637,0.1292395144701004,0.13893751800060272,0.18251748383045197,852.6897583007812,1e-05,0.26074233651161194,3.132108449935913,81.14050197601318,0 +941,0.17711298167705536,0.33591902256011963,0.3137340843677521,0.19673658907413483,981.38232421875,1e-05,0.14975211024284363,2.856785297393799,81.14050197601318,0 +942,0.2695532441139221,0.22159789502620697,0.22628208994865417,0.18601398169994354,900.5198364257812,1e-05,0.14529798924922943,3.0824804306030273,81.14050197601318,0 +943,0.16150341928005219,0.21966640651226044,0.2214532196521759,0.1990675926208496,933.4083862304688,1e-05,0.1291227787733078,3.148545265197754,81.14050197601318,0 +944,0.1610586941242218,0.4501855671405792,0.4427178204059601,0.23636363446712494,975.0736083984375,1e-05,0.1551223248243332,3.3919014930725098,81.14050197601318,0 +945,0.26580506563186646,0.3899727165699005,0.38495153188705444,0.21631701290607452,990.8973388671875,1e-05,0.12996792793273926,3.103891134262085,81.14050197601318,0 +946,0.2539803683757782,0.32788532972335815,0.314069002866745,0.24965034425258636,931.826171875,1e-05,0.14878666400909424,3.133521795272827,81.14050197601318,0 +947,0.1949843168258667,0.2756860852241516,0.262297660112381,0.11328671127557755,913.2542724609375,1e-05,0.16081081330776215,2.842089891433716,81.14050197601318,0 +948,0.20986440777778625,0.22432389855384827,0.21969759464263916,0.1370629370212555,663.2779541015625,1e-05,0.1334751546382904,3.112464666366577,81.14050197601318,0 +949,0.16397716104984283,0.27743324637413025,0.2795644700527191,0.2405594438314438,965.4962768554688,1e-05,0.1354464590549469,3.1522982120513916,81.14050197601318,0 +950,0.24495825171470642,0.20700585842132568,0.22984440624713898,0.23146852850914001,430.87518310546875,1e-05,0.20422716438770294,3.399902105331421,81.14050197601318,0 +951,0.18450292944908142,0.11816210299730301,0.10994398593902588,0.12074591964483261,909.3855590820312,1e-05,0.1377011090517044,3.330369710922241,81.14050197601318,0 +952,0.35104793310165405,0.26162105798721313,0.25650110840797424,0.2158508151769638,927.2047729492188,1e-05,0.20359273254871368,2.843576669692993,81.14050197601318,0 +953,0.11188003420829773,0.42042872309684753,0.4149393141269684,0.18531468510627747,995.6604614257812,1e-05,0.13218413293361664,2.8427743911743164,81.14050197601318,0 +954,0.1414286196231842,0.36235103011131287,0.34681934118270874,0.22564102709293365,982.7333984375,1e-05,0.19090311229228973,3.090876817703247,81.14050197601318,0 +955,0.20192179083824158,0.14990723133087158,0.13574036955833435,0.238228440284729,838.6439208984375,1e-05,0.1665177047252655,3.154085159301758,81.14050197601318,0 +956,0.22531725466251373,0.2584218978881836,0.2553488314151764,0.24242423474788666,916.0694580078125,1e-05,0.16744861006736755,3.439105272293091,81.14050197601318,0 +957,0.2680802643299103,0.2321588099002838,0.22139544785022736,0.2410256415605545,833.4493408203125,1e-05,0.2963270843029022,3.3412139415740967,81.14050197601318,0 +958,0.3688518702983856,0.31801965832710266,0.32111644744873047,0.1734265685081482,977.0203857421875,1e-05,0.15607772767543793,2.835638999938965,81.14050197601318,0 +959,0.24142110347747803,0.19898076355457306,0.20589877665042877,0.2013985961675644,951.4989624023438,1e-05,0.1307210624217987,2.8444783687591553,81.14050197601318,0 +960,0.2619577646255493,0.24238193035125732,0.23891974985599518,0.16363635659217834,601.3294677734375,1e-05,0.1738794595003128,3.124656915664673,81.14050197601318,0 +961,0.2329023778438568,0.18161100149154663,0.1823611706495285,0.17715618014335632,819.3053588867188,1e-05,0.09837121516466141,3.3849246501922607,81.14050197601318,0 +962,0.1381380259990692,0.20079173147678375,0.2058614045381546,0.1794871836900711,983.178466796875,1e-05,0.2575003206729889,3.3285393714904785,81.14050197601318,0 +963,0.31658685207366943,0.43313923478126526,0.4120224118232727,0.22727273404598236,986.079833984375,1e-05,0.16193273663520813,3.3948745727539062,81.14050197601318,0 +964,0.19038192927837372,0.19471189379692078,0.186051607131958,0.08974359184503555,900.1648559570312,1e-05,0.17558211088180542,2.8557424545288086,81.14050197601318,0 +965,0.276385635137558,0.2517468333244324,0.23121105134487152,0.24965034425258636,812.7318115234375,1e-05,0.16732989251613617,2.8629579544067383,81.14050197601318,0 +966,0.15210331976413727,0.16390009224414825,0.16698220372200012,0.2762237787246704,940.7190551757812,1e-05,0.15486299991607666,3.063420534133911,81.14050197601318,0 +967,0.16227877140045166,0.2781113386154175,0.27104058861732483,0.2701631784439087,924.6715087890625,1e-05,0.18629460036754608,3.449786901473999,81.14050197601318,0 +968,0.2677153944969177,0.14608687162399292,0.14359015226364136,0.2018647938966751,906.7301635742188,1e-05,0.1438310295343399,3.3365426063537598,81.14050197601318,0 +969,0.1834774613380432,0.2730405330657959,0.2645224630832672,0.21375291049480438,935.9909057617188,1e-05,0.14876258373260498,3.333284378051758,81.14050197601318,0 +970,0.19426482915878296,0.14207476377487183,0.1461135894060135,0.2242424190044403,905.0384521484375,1e-05,0.19359765946865082,2.8424572944641113,81.14050197601318,0 +971,0.25291889905929565,0.3190101981163025,0.3132269084453583,0.2529137432575226,973.2462768554688,1e-05,0.1969287395477295,3.1038100719451904,81.14050197601318,0 +972,0.2404620200395584,0.19875843822956085,0.19781796634197235,0.2265734225511551,781.0278930664062,1e-05,0.218343123793602,2.847301721572876,81.14050197601318,0 +973,0.35372328758239746,0.30269935727119446,0.30033251643180847,0.19393938779830933,427.6461486816406,1e-05,0.18277181684970856,3.731194496154785,81.14050197601318,0 +974,0.19695651531219482,0.2352423071861267,0.2239513099193573,0.19836829602718353,850.6163940429688,1e-05,0.2720848023891449,3.0928714275360107,81.14050197601318,0 +975,0.38789185881614685,0.17491281032562256,0.18945594131946564,0.11818181723356247,811.3840942382812,1e-05,0.34578919410705566,3.225705146789551,81.14050197601318,0 +976,0.2732175290584564,0.19747953116893768,0.19332391023635864,0.23146852850914001,871.8681030273438,1e-05,0.309447705745697,2.8511040210723877,81.14050197601318,0 +977,0.3384331166744232,0.21532346308231354,0.22692973911762238,0.09044288843870163,497.7698974609375,1e-05,0.1318977177143097,3.0228469371795654,81.14050197601318,0 +978,0.2382168471813202,0.14467072486877441,0.15228427946567535,0.20069929957389832,861.1730346679688,1e-05,0.14137211441993713,3.1153385639190674,81.14050197601318,0 +979,0.18879081308841705,0.30161166191101074,0.29098981618881226,0.20815850794315338,803.0537109375,1e-05,0.7387012839317322,3.4138400554656982,81.14050197601318,0 +980,0.16724319756031036,0.22196026146411896,0.2102721482515335,0.2310023307800293,788.1709594726562,1e-05,0.1725248098373413,3.4497838020324707,81.14050197601318,0 +981,0.16143012046813965,0.19473907351493835,0.18881607055664062,0.21212121844291687,883.8079833984375,1e-05,0.13948474824428558,3.0928590297698975,81.14050197601318,0 +982,0.13365137577056885,0.26922717690467834,0.2549883723258972,0.26596736907958984,590.026123046875,1e-05,0.1632678359746933,2.8437442779541016,81.14050197601318,0 +983,0.31796762347221375,0.14231358468532562,0.14851722121238708,0.23053613305091858,964.3812255859375,1e-05,0.1686515510082245,3.0830509662628174,81.14050197601318,0 +984,0.3490622043609619,0.2929638922214508,0.28423795104026794,0.20279720425605774,620.8772583007812,1e-05,0.1597496122121811,3.147129774093628,81.14050197601318,0 +985,0.11536112427711487,0.2713663578033447,0.2615043520927429,0.20629370212554932,963.0614624023438,1e-05,0.12523221969604492,3.4522876739501953,81.14050197601318,0 +986,0.35786476731300354,0.25252240896224976,0.23165632784366608,0.16876456141471863,763.1554565429688,1e-05,0.28721922636032104,3.0632758140563965,81.14050197601318,0 +987,0.28869518637657166,0.21262739598751068,0.1995551586151123,0.19696970283985138,934.1901245117188,1e-05,0.15370474755764008,3.109656572341919,81.14050197601318,0 +988,0.23942852020263672,0.25444990396499634,0.24856017529964447,0.2512820363044739,974.08203125,1e-05,0.24105769395828247,2.860820770263672,81.14050197601318,0 +989,0.29241275787353516,0.29424384236335754,0.2983861565589905,0.21491841971874237,632.5867309570312,1e-05,0.1693946272134781,3.0568222999572754,81.14050197601318,0 +990,0.431846559047699,0.14430521428585052,0.14250148832798004,0.11118881404399872,888.9893188476562,1e-05,0.16292859613895416,3.173124313354492,81.14050197601318,0 +991,0.3808363378047943,0.19501924514770508,0.19139866530895233,0.20163169503211975,624.2781982421875,1e-05,0.2020794153213501,3.2984931468963623,81.14050197601318,0 +992,0.17237110435962677,0.1373828649520874,0.1385919600725174,0.12097901850938797,873.2015991210938,1e-05,0.11628124862909317,3.314072608947754,81.14050197601318,0 +993,0.3171396255493164,0.38735148310661316,0.3622475564479828,0.18997669219970703,997.5022583007812,1e-05,0.15023750066757202,2.8372457027435303,81.14050197601318,0 +994,0.340951144695282,0.18118757009506226,0.18268457055091858,0.11328671127557755,912.6188354492188,1e-05,0.1730170100927353,2.83829402923584,81.14050197601318,0 +995,0.17192915081977844,0.19456733763217926,0.1847391277551651,0.2254079282283783,753.992919921875,1e-05,0.2071128487586975,3.075105905532837,81.14050197601318,0 +996,0.2314431071281433,0.21598440408706665,0.22239738702774048,0.2461538463830948,945.68896484375,1e-05,0.17054183781147003,3.1733314990997314,81.14050197601318,0 +997,0.12936246395111084,0.21409446001052856,0.2075154185295105,0.2449883371591568,968.2208862304688,1e-05,0.1333010047674179,3.400700807571411,81.14050197601318,0 +998,0.21466685831546783,0.20032042264938354,0.20089463889598846,0.24475523829460144,875.3941650390625,1e-05,0.17593324184417725,3.0570406913757324,81.14050197601318,0 +999,0.2622767388820648,0.14704225957393646,0.15262261033058167,0.2543123662471771,870.0686645507812,1e-05,0.17373862862586975,2.83951997756958,81.14050197601318,0 +1000,0.15740332007408142,0.22709253430366516,0.2190612256526947,0.16083915531635284,933.4083862304688,1e-05,0.12258674949407578,3.102383852005005,81.14050197601318,0 +1001,0.317960262298584,0.4325724244117737,0.41555121541023254,0.19440560042858124,984.7882080078125,1e-05,1.5229791402816772,3.4871368408203125,81.14050197601318,0 +1002,0.07275503873825073,0.26039549708366394,0.24648655951023102,0.24149183928966522,931.56005859375,1e-05,0.22491441667079926,3.742879867553711,81.14050197601318,0 +1003,0.22368064522743225,0.6512856483459473,0.6404332518577576,0.16153846681118011,113.7176742553711,1e-05,0.29686030745506287,3.0535881519317627,81.14050197601318,0 +1004,0.2876189351081848,0.3067423403263092,0.3004826307296753,0.21561771631240845,922.657958984375,1e-05,0.17932206392288208,3.3586671352386475,81.14050197601318,0 +1005,0.2014828324317932,0.28586652874946594,0.29601743817329407,0.24708624184131622,484.3331604003906,1e-05,0.13585326075553894,2.8335258960723877,81.14050197601318,0 +1006,0.23397304117679596,0.2858183681964874,0.28421860933303833,0.20326340198516846,967.1416625976562,1e-05,0.14619877934455872,3.091418504714966,81.14050197601318,0 +1007,0.22686080634593964,0.2754959464073181,0.27661487460136414,0.24708624184131622,976.2150268554688,1e-05,0.17832866311073303,3.3819000720977783,81.14050197601318,0 +1008,0.19321471452713013,0.26529595255851746,0.2554249167442322,0.19813519716262817,964.0061645507812,1e-05,0.12566442787647247,3.5525739192962646,81.14050197601318,0 +1009,0.1590101718902588,0.24713574349880219,0.24077929556369781,0.2529137432575226,762.2591552734375,1e-05,0.15560786426067352,3.0626208782196045,81.14050197601318,0 +1010,0.14705216884613037,0.23135612905025482,0.21969150006771088,0.2937062978744507,924.38623046875,1e-05,0.14616236090660095,3.283008575439453,81.14050197601318,0 +1011,0.2963372468948364,0.2747498154640198,0.2887009084224701,0.16736596822738647,670.3726196289062,1e-05,0.2531962990760803,2.846714973449707,81.14050197601318,0 +1012,0.19857285916805267,0.22094185650348663,0.2137187123298645,0.15757575631141663,714.6185302734375,1e-05,0.12572205066680908,3.4399311542510986,81.14050197601318,0 +1013,0.17474503815174103,0.2698104977607727,0.2675952911376953,0.2512820363044739,885.4254760742188,1e-05,0.15823101997375488,3.1081149578094482,81.14050197601318,0 +1014,0.37904083728790283,0.37846019864082336,0.3816820979118347,0.19720280170440674,283.0556640625,1e-05,0.18787501752376556,3.286654233932495,81.14050197601318,0 +1015,0.255337655544281,0.29756027460098267,0.2895157039165497,0.23146852850914001,966.2316284179688,1e-05,0.21649043262004852,3.057241439819336,81.14050197601318,0 +1016,0.2358705848455429,0.247954860329628,0.24366116523742676,0.2153846174478531,972.9094848632812,1e-05,0.12280908972024918,3.1784236431121826,81.14050197601318,0 +1017,0.33976539969444275,0.2612455487251282,0.25083160400390625,0.1958041936159134,670.3726196289062,1e-05,0.13698504865169525,2.8354246616363525,81.14050197601318,0 +1018,0.3159600496292114,0.1848379671573639,0.1919575184583664,0.2293706238269806,901.5783081054688,1e-05,0.14875656366348267,3.2396013736724854,81.14050197601318,0 +1019,0.09493148326873779,0.27724188566207886,0.2754599153995514,0.21911421418190002,974.9092407226562,1e-05,0.26096874475479126,3.37064528465271,81.14050197601318,0 +1020,0.20902858674526215,0.22020308673381805,0.21836453676223755,0.23799534142017365,864.5192260742188,1e-05,1.0108036994934082,3.187278985977173,81.14050197601318,0 +1021,0.2721313536167145,0.28341585397720337,0.28716468811035156,0.1946386992931366,917.9066772460938,1e-05,0.1891382485628128,3.115725517272949,81.14050197601318,0 +1022,0.3229178488254547,0.2198084592819214,0.2171763777732849,0.1766899824142456,870.971435546875,1e-05,3.700794219970703,3.1084556579589844,81.14050197601318,0 +1023,0.2714231312274933,0.6355265378952026,0.6544517278671265,0.18764568865299225,120.44096374511719,1e-05,0.13107439875602722,2.8462743759155273,81.14050197601318,0 +1024,0.20556724071502686,0.30229973793029785,0.30322062969207764,0.20932400226593018,986.3638916015625,1e-05,0.1383320540189743,3.312912702560425,81.14050197601318,0 +1025,0.18348637223243713,0.22362367808818817,0.22229385375976562,0.2209790199995041,894.70751953125,1e-05,0.1408700793981552,3.3563716411590576,81.14050197601318,0 +1026,0.14474259316921234,0.2818867862224579,0.26767438650131226,0.18484848737716675,932.6204223632812,1e-05,0.2071840912103653,3.368028163909912,81.14050197601318,0 +1027,0.28363606333732605,0.36162078380584717,0.3585558533668518,0.17692308127880096,310.39483642578125,1e-05,0.1308431327342987,3.4949560165405273,81.14050197601318,0 +1028,0.19667118787765503,0.44821038842201233,0.4088090658187866,0.2466200441122055,997.1378173828125,1e-05,0.3480500876903534,2.863757371902466,81.14050197601318,0 +1029,0.286796510219574,0.30742883682250977,0.2830279767513275,0.23193472623825073,749.2398071289062,1e-05,0.12967173755168915,3.144979238510132,81.14050197601318,0 +1030,0.13962815701961517,0.1848401129245758,0.20027583837509155,0.21282051503658295,966.414306640625,1e-05,0.17054349184036255,3.0857794284820557,81.14050197601318,0 +1031,0.29461169242858887,0.47636786103248596,0.4806808829307556,0.14055943489074707,296.9483642578125,1e-05,0.1553819477558136,3.4326024055480957,81.14050197601318,0 +1032,0.19026565551757812,0.289228618144989,0.2921813130378723,0.06666667014360428,931.826171875,1e-05,0.12835770845413208,3.2123560905456543,81.14050197601318,0 +1033,0.2258869856595993,0.2242768406867981,0.21562381088733673,0.17855477333068848,822.4921875,1e-05,0.239843487739563,3.4324121475219727,81.14050197601318,0 +1034,0.23227448761463165,0.2595840096473694,0.24985003471374512,0.21235431730747223,978.4493408203125,1e-05,3.805513620376587,2.8509321212768555,81.14050197601318,0 +1035,0.263114869594574,0.3443874418735504,0.3090771734714508,0.22960372269153595,932.6204223632812,1e-05,0.14929816126823425,3.146591901779175,81.14050197601318,0 +1036,0.1699967235326767,0.15268512070178986,0.15134978294372559,0.214685320854187,913.2542724609375,1e-05,0.1778167337179184,3.3078150749206543,81.14050197601318,0 +1037,0.2925066351890564,0.1278006136417389,0.12865762412548065,0.16969697177410126,923.2371215820312,1e-05,0.16492629051208496,3.38710355758667,81.14050197601318,0 +1038,0.18210160732269287,0.2036651372909546,0.1972135305404663,0.1822843849658966,828.6761474609375,1e-05,0.12356367707252502,3.134676456451416,81.14050197601318,0 +1039,0.1926862597465515,0.17759796977043152,0.17706982791423798,0.060606058686971664,801.6233520507812,1e-05,0.20325466990470886,3.3693933486938477,81.14050197601318,0 +1040,0.3460087776184082,0.2903825640678406,0.293281614780426,0.274125874042511,643.773681640625,1e-05,0.1986669898033142,2.8394103050231934,81.14050197601318,0 +1041,0.29607275128364563,0.31195932626724243,0.29991042613983154,0.1666666716337204,768.4440307617188,1e-05,0.6713522672653198,3.0742533206939697,81.14050197601318,0 +1042,0.2592833340167999,0.1453903168439865,0.1435646116733551,0.10536130517721176,807.27197265625,1e-05,0.19429822266101837,3.3138506412506104,81.14050197601318,0 +1043,0.2973783016204834,0.1602904200553894,0.15440425276756287,0.2097902148962021,667.560546875,1e-05,0.8094121217727661,3.077117443084717,81.14050197601318,0 +1044,0.20883548259735107,0.18204860389232635,0.1975584328174591,0.13659673929214478,489.7753601074219,1e-05,0.14304786920547485,2.858215808868408,81.14050197601318,0 +1045,0.08092214912176132,0.18789808452129364,0.1880500614643097,0.1778554767370224,922.0755004882812,1e-05,0.13282476365566254,3.383030652999878,81.14050197601318,0 +1046,0.44833216071128845,0.21368706226348877,0.20375406742095947,0.2377622425556183,682.6182250976562,1e-05,0.16897568106651306,2.844642400741577,81.14050197601318,0 +1047,0.24745792150497437,0.26412802934646606,0.27375492453575134,0.2097902148962021,975.5648193359375,1e-05,0.16922278702259064,3.0866904258728027,81.14050197601318,0 +1048,0.1398146152496338,0.1728789508342743,0.18214841187000275,0.19603729248046875,914.2007446289062,1e-05,0.11667264252901077,3.346060276031494,81.14050197601318,0 +1049,0.20448115468025208,0.2825258672237396,0.273190975189209,0.2668997645378113,915.1390991210938,1e-05,0.1647413671016693,3.1180872917175293,81.14050197601318,0 +1050,0.23533964157104492,0.2922360599040985,0.2837326228618622,0.11258741468191147,819.9478759765625,1e-05,0.16464872658252716,2.8412415981292725,81.14050197601318,0 +1051,0.29569941759109497,0.20874793827533722,0.21065674722194672,0.17319346964359283,397.1928405761719,1e-05,0.15644365549087524,3.177926540374756,81.14050197601318,0 +1052,0.2982417941093445,0.3451703190803528,0.3366270363330841,0.24032634496688843,336.031982421875,1e-05,0.16448763012886047,2.8378961086273193,81.14050197601318,0 +1053,0.21309301257133484,0.32119879126548767,0.32150566577911377,0.18927739560604095,427.6461486816406,1e-05,0.16757601499557495,3.04600191116333,81.14050197601318,0 +1054,0.24425122141838074,0.31508246064186096,0.3139205276966095,0.16573426127433777,983.178466796875,1e-05,0.13226130604743958,3.430452585220337,81.14050197601318,0 +1055,0.2629181146621704,0.14633417129516602,0.14402537047863007,0.12937062978744507,741.38232421875,1e-05,0.17789064347743988,3.3480963706970215,81.14050197601318,0 +1056,0.3403317928314209,0.3960111439228058,0.3870415985584259,0.11841491609811783,963.818115234375,1e-05,0.1616402566432953,3.16770076751709,81.14050197601318,0 +1057,0.21410425007343292,0.21419502794742584,0.20033396780490875,0.19883449375629425,890.5407104492188,1e-05,0.20169231295585632,2.8514785766601562,81.14050197601318,0 +1058,0.19366145133972168,0.3350784182548523,0.31947633624076843,0.22680652141571045,971.3762817382812,1e-05,0.17179279029369354,2.8503756523132324,81.14050197601318,0 +1059,0.12078021466732025,0.16838803887367249,0.18318292498588562,0.20372959971427917,586.15087890625,1e-05,0.11248882114887238,3.341559410095215,81.14050197601318,0 +1060,0.2184107005596161,0.18751569092273712,0.18123672902584076,0.17272727191448212,974.5794677734375,1e-05,0.15693941712379456,3.43158221244812,81.14050197601318,0 +1061,0.30092644691467285,0.1840921938419342,0.1864934116601944,0.2477855533361435,945.9192504882812,1e-05,0.17831863462924957,3.2902109622955322,81.14050197601318,0 +1062,0.21930640935897827,0.13457658886909485,0.14278601109981537,0.23473192751407623,761.3585205078125,1e-05,0.15831591188907623,3.127115488052368,81.14050197601318,0 +1063,0.1934170126914978,0.12988147139549255,0.11292745172977448,0.1319347321987152,826.846923828125,1e-05,0.12426640093326569,2.8447790145874023,81.14050197601318,0 +1064,0.25402677059173584,0.3464289605617523,0.32541021704673767,0.20536130666732788,984.4981079101562,1e-05,0.19249700009822845,2.8438665866851807,81.14050197601318,0 +1065,0.19982634484767914,0.12777645885944366,0.11877942085266113,0.15011654794216156,789.71923828125,1e-05,2.205198049545288,3.3253540992736816,81.14050197601318,0 +1066,0.2731434404850006,0.22655446827411652,0.24513676762580872,0.22447551786899567,972.9094848632812,1e-05,0.1551908701658249,3.414872169494629,81.14050197601318,0 +1067,0.3966776132583618,0.27349725365638733,0.26957663893699646,0.1806526780128479,986.6468505859375,1e-05,0.14377228915691376,3.3552114963531494,81.14050197601318,0 +1068,0.25844475626945496,0.19236795604228973,0.20610538125038147,0.2829836905002594,989.0084838867188,1e-05,0.23125828802585602,3.17244815826416,81.14050197601318,0 +1069,0.2386930137872696,0.6520824432373047,0.6826584339141846,0.16037295758724213,999.4136352539062,1e-05,0.18633043766021729,2.8427257537841797,81.14050197601318,0 +1070,0.19563426077365875,0.27203842997550964,0.2677570581436157,0.25034964084625244,961.5278930664062,1e-05,0.27466562390327454,2.8378522396087646,81.14050197601318,0 +1071,0.23273198306560516,0.4380050301551819,0.4343636631965637,0.28601399064064026,986.079833984375,1e-05,0.12455952912569046,3.310990333557129,81.14050197601318,0 +1072,0.24857325851917267,0.17094749212265015,0.1803891509771347,0.10652680695056915,753.0517578125,1e-05,0.13785675168037415,3.4457309246063232,81.14050197601318,0 +1073,0.22216421365737915,0.3363091051578522,0.3570035398006439,0.12237761914730072,248.77369689941406,1e-05,0.10312993079423904,3.0790395736694336,81.14050197601318,0 +1074,0.14821700751781464,0.26487013697624207,0.2558419108390808,0.250582754611969,960.3594970703125,1e-05,0.1359529048204422,3.463505268096924,81.14050197601318,0 +1075,0.31667688488960266,0.34185588359832764,0.3427639603614807,0.250582754611969,969.9888916015625,1e-05,0.26038187742233276,2.8422353267669678,81.14050197601318,0 +1076,0.34123125672340393,0.22309936583042145,0.20631112158298492,0.19277389347553253,983.4736938476562,1e-05,0.15685738623142242,3.119163990020752,81.14050197601318,0 +1077,0.32497408986091614,0.2579622268676758,0.25264352560043335,0.2354312390089035,915.1390991210938,1e-05,0.21802029013633728,3.10976243019104,81.14050197601318,0 +1078,0.21756377816200256,0.2633724510669708,0.2587769627571106,0.22867132723331451,610.396240234375,1e-05,0.2064085155725479,3.5123589038848877,81.14050197601318,0 +1079,0.2556179463863373,0.22843144834041595,0.23902775347232819,0.19160838425159454,939.4969482421875,1e-05,0.1408720761537552,3.1198365688323975,81.14050197601318,0 +1080,0.27670392394065857,0.20727203786373138,0.1972629576921463,0.13613054156303406,797.99267578125,1e-05,0.14520637691020966,3.1003007888793945,81.14050197601318,0 +1081,0.292671799659729,0.23151648044586182,0.20774541795253754,0.23752914369106293,742.382080078125,1e-05,0.11793120950460434,2.8458423614501953,81.14050197601318,0 +1082,0.25640374422073364,0.22716791927814484,0.2263721376657486,0.24032634496688843,851.6567993164062,1e-05,0.13859866559505463,3.046825408935547,81.14050197601318,0 +1083,0.08986515551805496,0.3154848515987396,0.29942846298217773,0.2566433548927307,993.383544921875,1e-05,0.1696205735206604,3.1334781646728516,81.14050197601318,0 +1084,0.19345983862876892,0.26630544662475586,0.2625901401042938,0.14335663616657257,983.767822265625,1e-05,0.15009133517742157,3.680145502090454,81.14050197601318,0 +1085,0.30512678623199463,0.20439697802066803,0.20590822398662567,0.22960372269153595,912.6188354492188,1e-05,0.1812150925397873,2.846141815185547,81.14050197601318,0 +1086,0.1495809257030487,0.15185675024986267,0.14719200134277344,0.2454545497894287,690.4288330078125,1e-05,0.14457446336746216,3.114926338195801,81.14050197601318,0 +1087,0.23390208184719086,0.16737616062164307,0.1770675778388977,0.2158508151769638,914.2007446289062,1e-05,0.1529817432165146,2.8405046463012695,81.14050197601318,0 +1088,0.15427708625793457,0.0646437257528305,0.07370827347040176,0.13496503233909607,730.0392456054688,1e-05,0.2908187210559845,3.049393653869629,81.14050197601318,0 +1089,0.14120689034461975,0.1935899704694748,0.18325701355934143,0.2226107269525528,800.9034423828125,1e-05,0.18862281739711761,3.0906805992126465,81.14050197601318,0 +1090,0.2675692141056061,0.25462445616722107,0.24877864122390747,0.1599067598581314,991.8234252929688,1e-05,0.20200592279434204,3.7111353874206543,81.14050197601318,0 +1091,0.17851103842258453,0.20270679891109467,0.19564010202884674,0.25081583857536316,985.794677734375,1e-05,0.1406082808971405,3.067945718765259,81.14050197601318,0 +1092,0.22228051722049713,0.2099524885416031,0.20332670211791992,0.20909090340137482,850.0933227539062,1e-05,0.16741888225078583,3.0897600650787354,81.14050197601318,0 +1093,0.19717639684677124,0.1431005746126175,0.15027499198913574,0.21165500581264496,668.9708251953125,1e-05,0.18136078119277954,2.8571181297302246,81.14050197601318,0 +1094,0.1214379295706749,0.24822796881198883,0.2550671398639679,0.1650349646806717,965.3115234375,1e-05,0.13733680546283722,3.1089742183685303,81.14050197601318,0 +1095,0.33673855662345886,0.38266682624816895,0.3746289014816284,0.15594404935836792,417.7786560058594,1e-05,0.1814434677362442,3.4198479652404785,81.14050197601318,0 +1096,0.27412959933280945,0.27731558680534363,0.31111830472946167,0.26247087121009827,985.6517944335938,1e-05,0.23215612769126892,3.4920432567596436,81.14050197601318,0 +1097,0.3012329638004303,0.36458244919776917,0.3401596248149872,0.13519813120365143,976.3768310546875,1e-05,0.15298426151275635,3.145514726638794,81.14050197601318,0 +1098,0.1342545598745346,0.27746859192848206,0.284541517496109,0.14335663616657257,938.756103515625,1e-05,0.13231079280376434,2.837947368621826,81.14050197601318,0 +1099,0.15473689138889313,0.2041264921426773,0.21007798612117767,0.2097902148962021,481.577392578125,1e-05,0.21147885918617249,2.8412790298461914,81.14050197601318,0 +1100,0.11566851288080215,0.2796535789966583,0.2502535879611969,0.2708624601364136,970.1636352539062,1e-05,0.49913889169692993,3.347935199737549,81.14050197601318,0 +1101,0.13203540444374084,0.27489110827445984,0.28173089027404785,0.2365967333316803,999.177734375,1e-05,0.1908065229654312,3.1038601398468018,81.14050197601318,0 +1102,0.1748906672000885,0.1959673911333084,0.20433379709720612,0.09696969389915466,973.748779296875,1e-05,0.18330501019954681,3.425009250640869,81.14050197601318,0 +1103,0.26441866159439087,0.2007593959569931,0.20010267198085785,0.23030303418636322,819.9478759765625,1e-05,0.12232795357704163,3.1381115913391113,81.14050197601318,0 +1104,0.293472021818161,0.2183288186788559,0.22497716546058655,0.19696970283985138,959.1751708984375,1e-05,0.1673326939344406,2.8435728549957275,81.14050197601318,0 +1105,0.48090431094169617,0.26287323236465454,0.2505970299243927,0.2002331018447876,591.9431762695312,1e-05,0.12612122297286987,2.842381000518799,81.14050197601318,0 +1106,0.3951343297958374,0.2760653793811798,0.28243476152420044,0.1482517421245575,982.2857666015625,1e-05,0.15958918631076813,3.382606029510498,81.14050197601318,0 +1107,0.22248336672782898,0.2798383831977844,0.2748747766017914,0.20163169503211975,679.9532470703125,1e-05,0.15274815261363983,3.1544885635375977,81.14050197601318,0 +1108,0.39378049969673157,0.33300575613975525,0.3488117754459381,0.20512820780277252,287.737548828125,1e-05,0.12941668927669525,3.3858423233032227,81.14050197601318,0 +1109,0.3381379544734955,0.22197715938091278,0.20971089601516724,0.15874126553535461,920.9009399414062,1e-05,0.16480694711208344,3.368920087814331,81.14050197601318,0 +1110,0.19641104340553284,0.16697195172309875,0.16441507637500763,0.10279720276594162,953.8506469726562,1e-05,0.1543283611536026,2.8506603240966797,81.14050197601318,0 +1111,0.360326886177063,0.24244487285614014,0.2257567048072815,0.23076923191547394,713.4717407226562,1e-05,0.34405186772346497,3.035149335861206,81.14050197601318,0 +1112,0.22105561196804047,0.4364839792251587,0.41141316294670105,0.23473192751407623,991.954833984375,1e-05,0.2219478189945221,3.0728659629821777,81.14050197601318,0 +1113,0.364560067653656,0.1863422393798828,0.18953271210193634,0.11794871836900711,655.9628295898438,1e-05,0.33126023411750793,3.387014627456665,81.14050197601318,0 +1114,0.346758633852005,0.5114710927009583,0.5121966600418091,0.12354312092065811,227.91456604003906,1e-05,0.2818073630332947,3.220639944076538,81.14050197601318,0 +1115,0.3348410725593567,0.2790348529815674,0.26527199149131775,0.2209790199995041,683.93896484375,1e-05,0.3634047210216522,3.3743977546691895,81.14050197601318,0 +1116,0.27356767654418945,0.16492649912834167,0.17143189907073975,0.1599067598581314,854.7328491210938,1e-05,0.20195266604423523,2.832613229751587,81.14050197601318,0 +1117,0.3932952880859375,0.23270046710968018,0.2221796065568924,0.2242424190044403,946.6068115234375,1e-05,0.13521912693977356,3.0925683975219727,81.14050197601318,0 +1118,0.2642563581466675,0.3008106052875519,0.302107036113739,0.19207459688186646,977.9759521484375,1e-05,0.14071841537952423,3.0866715908050537,81.14050197601318,0 +1119,0.21248367428779602,0.31076300144195557,0.2990221083164215,0.23193472623825073,982.2857666015625,1e-05,0.15830326080322266,3.3934836387634277,81.14050197601318,0 +1120,0.32429641485214233,0.2390512228012085,0.23633205890655518,0.20163169503211975,722.4732666015625,1e-05,0.1671159416437149,3.4542043209075928,81.14050197601318,0 +1121,0.21973934769630432,0.23375451564788818,0.21188771724700928,0.21375291049480438,875.3941650390625,1e-05,0.13728994131088257,3.05777907371521,81.14050197601318,0 +1122,0.2018284946680069,0.4351792335510254,0.40377554297447205,0.16969697177410126,998.4646606445312,1e-05,0.12102199345827103,2.8482000827789307,81.14050197601318,0 +1123,0.18898867070674896,0.22809527814388275,0.22118578851222992,0.2198135256767273,752.1058349609375,1e-05,0.1904725283384323,3.0517539978027344,81.14050197601318,0 +1124,0.2961583435535431,0.14685845375061035,0.1478249430656433,0.04895104840397835,668.9708251953125,1e-05,0.16284024715423584,3.076371431350708,81.14050197601318,0 +1125,0.19509968161582947,0.11075655370950699,0.11436370015144348,0.11002331227064133,961.5278930664062,1e-05,0.11662869900465012,3.171842336654663,81.14050197601318,0 +1126,0.21265403926372528,0.3295775055885315,0.319707989692688,0.1526806503534317,982.7333984375,1e-05,0.3495005667209625,3.3656046390533447,81.14050197601318,0 +1127,0.23791170120239258,0.3171466290950775,0.30812326073646545,0.23519814014434814,530.23681640625,1e-05,0.16519595682621002,3.0343356132507324,81.14050197601318,0 +1128,0.20750422775745392,0.2771488428115845,0.26687750220298767,0.20652680099010468,896.5547485351562,1e-05,0.16608025133609772,2.848680019378662,81.14050197601318,0 +1129,0.21225860714912415,0.23300038278102875,0.22887076437473297,0.23636363446712494,832.2701416015625,1e-05,0.12847986817359924,3.065819025039673,81.14050197601318,0 +1130,0.3070536255836487,0.20818564295768738,0.1940637081861496,0.1298368275165558,781.836181640625,1e-05,0.15776307880878448,3.171572685241699,81.14050197601318,0 +1131,0.18941867351531982,0.39318767189979553,0.37145110964775085,0.19137528538703918,998.5840454101562,1e-05,0.15821561217308044,3.616180419921875,81.14050197601318,0 +1132,0.26236069202423096,0.2596290111541748,0.247905895113945,0.23986013233661652,850.0933227539062,1e-05,0.20041638612747192,3.103749990463257,81.14050197601318,0 +1133,0.24548211693763733,0.3436482548713684,0.3332717716693878,0.23799534142017365,988.734619140625,1e-05,0.16323122382164001,3.0938098430633545,81.14050197601318,0 +1134,0.17719155550003052,0.06422195583581924,0.0730157271027565,0.1326340287923813,745.3507080078125,1e-05,0.15106827020645142,3.0400502681732178,81.14050197601318,0 +1135,0.20238175988197327,0.2554347515106201,0.24812372028827667,0.21445220708847046,965.126220703125,1e-05,0.1263469159603119,2.849750518798828,81.14050197601318,0 +1136,0.2968176305294037,0.1543150544166565,0.16583240032196045,0.1515151560306549,937.2574462890625,1e-05,0.15411841869354248,3.390868902206421,81.14050197601318,0 +1137,0.18295663595199585,0.35031992197036743,0.33493903279304504,0.2433566451072693,914.2007446289062,1e-05,0.1245424821972847,3.6502139568328857,81.14050197601318,0 +1138,0.22934800386428833,0.18151745200157166,0.18017257750034332,0.09347319602966309,664.7142333984375,1e-05,0.1593986451625824,3.1320533752441406,81.14050197601318,0 +1139,0.2500121593475342,0.2819577157497406,0.29578059911727905,0.20279720425605774,371.6285705566406,1e-05,0.13249580562114716,2.847860813140869,81.14050197601318,0 +1140,0.1889396607875824,0.2514707148075104,0.2505563795566559,0.1906759887933731,947.2893676757812,1e-05,0.17618173360824585,3.0321340560913086,81.14050197601318,0 +1141,0.4118243455886841,0.3302067816257477,0.3311971426010132,0.2214452177286148,421.0982971191406,1e-05,0.143025204539299,3.1449472904205322,81.14050197601318,0 +1142,0.30128389596939087,0.24846936762332916,0.24506108462810516,0.2310023307800293,951.2822265625,1e-05,0.28092360496520996,3.6230316162109375,81.14050197601318,0 +1143,0.20392248034477234,0.28681641817092896,0.292335569858551,0.23076923191547394,273.5347900390625,1e-05,0.23929427564144135,3.3432416915893555,81.14050197601318,0 +1144,0.25072547793388367,0.22247518599033356,0.21242523193359375,0.20606060326099396,889.3790893554688,1e-05,0.21100462973117828,3.5066921710968018,81.14050197601318,0 +1145,0.1646127849817276,0.07077939063310623,0.07238451391458511,0.02097902074456215,578.2326049804688,1e-05,0.13659711182117462,2.8486831188201904,81.14050197601318,0 +1146,0.38321906328201294,0.29660776257514954,0.29159805178642273,0.1990675926208496,960.5552368164062,1e-05,0.15391525626182556,3.057337760925293,81.14050197601318,0 +1147,0.16648268699645996,0.37751758098602295,0.3537144362926483,0.238228440284729,930.488525390625,1e-05,0.13501136004924774,3.1174709796905518,81.14050197601318,0 +1148,0.17135238647460938,0.20946617424488068,0.21586525440216064,0.2242424190044403,646.8789672851562,1e-05,0.12594002485275269,3.5311787128448486,81.14050197601318,0 +1149,0.2347317934036255,0.29721954464912415,0.2945595979690552,0.2069930136203766,851.6567993164062,1e-05,0.3161066472530365,3.1356003284454346,81.14050197601318,0 +1150,0.1608920842409134,0.2500869929790497,0.25054964423179626,0.19976690411567688,612.1727294921875,1e-05,0.15553419291973114,3.4687347412109375,81.14050197601318,0 +1151,0.15061447024345398,0.2964271605014801,0.29417797923088074,0.17995338141918182,957.5706176757812,1e-05,0.25961142778396606,2.8466153144836426,81.14050197601318,0 +1152,0.18272633850574493,0.13137073814868927,0.13264153897762299,0.2242424190044403,724.6637573242188,1e-05,0.12799227237701416,3.1125333309173584,81.14050197601318,0 +1153,0.34166479110717773,0.3006666302680969,0.28774788975715637,0.17156177759170532,505.5683898925781,1e-05,0.13223257660865784,3.132901668548584,81.14050197601318,0 +1154,0.18914900720119476,0.46257540583610535,0.44764629006385803,0.24312354624271393,974.4140625,1e-05,0.3145997226238251,3.447869300842285,81.14050197601318,0 +1155,0.11158889532089233,0.10415036231279373,0.09765501320362091,0.19930069148540497,671.7659301757812,1e-05,0.16205166280269623,3.189506769180298,81.14050197601318,0 +1156,0.2342095971107483,0.21243304014205933,0.23000752925872803,0.15687645971775055,995.2861328125,1e-05,0.15558019280433655,3.345458984375,81.14050197601318,0 +1157,0.233178049325943,0.30711352825164795,0.3028755784034729,0.1034965068101883,233.2209930419922,1e-05,0.15502752363681793,2.8438093662261963,81.14050197601318,0 +1158,0.27738821506500244,0.15452688932418823,0.1689988672733307,0.23473192751407623,940.4759521484375,1e-05,0.6029267907142639,3.0487184524536133,81.14050197601318,0 +1159,0.3167765140533447,0.3016067445278168,0.301777184009552,0.21375291049480438,449.6458740234375,1e-05,0.11121996492147446,3.149580717086792,81.14050197601318,1 +1160,0.12116178870201111,0.3299493193626404,0.3235614597797394,0.18088577687740326,945.226806640625,1e-05,0.14584554731845856,3.1975977420806885,81.14050197601318,1 +1161,0.15091381967067719,0.27787938714027405,0.26704907417297363,0.16969697177410126,933.9302368164062,1e-05,0.17443814873695374,3.3899450302124023,81.14050197601318,1 +1162,0.22445134818553925,0.18243782222270966,0.18047186732292175,0.24009324610233307,969.8138427734375,1e-05,0.1433430314064026,3.255946159362793,81.14050197601318,1 +1163,0.1500237137079239,0.3939226567745209,0.38140442967414856,0.21212121844291687,960.1631469726562,1e-05,0.14358492195606232,2.8456954956054688,81.14050197601318,1 +1164,0.21648374199867249,0.20481997728347778,0.18801812827587128,0.2405594438314438,976.69921875,1e-05,0.1416211724281311,3.0885655879974365,81.14050197601318,1 +1165,0.25014200806617737,0.22896194458007812,0.22024103999137878,0.2599067687988281,682.6182250976562,1e-05,0.18146802484989166,3.1779675483703613,81.14050197601318,1 +1166,0.21337541937828064,0.3017348349094391,0.28563055396080017,0.2405594438314438,918.2099609375,1e-05,0.15237915515899658,3.2338597774505615,81.14050197601318,1 +1167,0.14230506122112274,0.1241014301776886,0.12412961572408676,0.2489510476589203,911.3367309570312,1e-05,0.11301467567682266,3.177431344985962,81.14050197601318,1 +1168,0.23947004973888397,0.40434345602989197,0.3886832296848297,0.21515151858329773,963.251220703125,1e-05,0.1623777598142624,3.252769947052002,81.14050197601318,1 +1169,0.28230708837509155,0.31638380885124207,0.2903519570827484,0.2734265625476837,997.86474609375,1e-05,0.28335458040237427,2.8404226303100586,81.14050197601318,1 +1170,0.1903035044670105,0.29918617010116577,0.2874686121940613,0.19114218652248383,921.7830200195312,1e-05,0.11433561891317368,3.0999021530151367,81.14050197601318,1 +1171,0.25456947088241577,0.20875336229801178,0.19824063777923584,0.28671327233314514,896.920654296875,1e-05,0.2684917747974396,3.7459206581115723,81.14050197601318,1 +1172,0.280990868806839,0.3388674259185791,0.339378297328949,0.10139860212802887,327.6654357910156,1e-05,0.20571227371692657,3.2622804641723633,81.14050197601318,1 +1173,0.29140204191207886,0.2967127561569214,0.28430086374282837,0.24172493815422058,948.4158325195312,1e-05,0.1722939908504486,3.2985293865203857,81.14050197601318,1 +1174,0.2590142786502838,0.060721319168806076,0.07342024892568588,0.1946386992931366,800.1805419921875,1e-05,0.14288917183876038,3.2032549381256104,81.14050197601318,1 +1175,0.2787339389324188,0.3452928066253662,0.33519673347473145,0.20279720425605774,987.906494140625,1e-05,0.1903890073299408,2.8568997383117676,81.14050197601318,1 +1176,0.18465110659599304,0.22078053653240204,0.21286942064762115,0.0951048955321312,873.64306640625,1e-05,0.28316324949264526,3.105787992477417,81.14050197601318,1 +1177,0.12105301767587662,0.44916990399360657,0.44782403111457825,0.139860138297081,994.7838134765625,1e-05,0.22022563219070435,3.5428555011749268,81.14050197601318,1 +1178,0.244432732462883,0.24248123168945312,0.23910348117351532,0.2270396202802658,909.0570068359375,1e-05,0.4859583079814911,3.370767593383789,81.14050197601318,1 +1179,0.16356709599494934,0.2342296838760376,0.22178973257541656,0.22214451432228088,892.0726318359375,1e-05,0.1252918839454651,3.3098433017730713,81.14050197601318,1 +1180,0.16074234247207642,0.2089914232492447,0.2029026746749878,0.145454540848732,952.3612670898438,1e-05,0.1483466625213623,3.1391944885253906,81.14050197601318,1 +1181,0.22694632411003113,0.22871221601963043,0.22135187685489655,0.24032634496688843,900.1648559570312,1e-05,0.21240481734275818,2.8412816524505615,81.14050197601318,1 +1182,0.2018257975578308,0.23683832585811615,0.21176691353321075,0.18811188638210297,878.82666015625,1e-05,0.28122130036354065,3.0938689708709717,81.14050197601318,1 +1183,0.09927652031183243,0.2809942662715912,0.2777920067310333,0.20000000298023224,976.2150268554688,1e-05,0.12326996773481369,3.41996431350708,81.14050197601318,1 +1184,0.2500803768634796,0.35570409893989563,0.3598557412624359,0.151048943400383,998.1053466796875,1e-05,0.15403205156326294,3.120910406112671,81.14050197601318,1 +1185,0.114734947681427,0.33403995633125305,0.3199172914028168,0.2230769246816635,994.9097900390625,1e-05,0.13112591207027435,3.135643720626831,81.14050197601318,1 +1186,0.17411164939403534,0.33312615752220154,0.3244820237159729,0.19417248666286469,970.5119018554688,1e-05,0.1587962955236435,2.856809139251709,81.14050197601318,1 +1187,0.12093594670295715,0.17475689947605133,0.18705438077449799,0.2717948853969574,946.378173828125,1e-05,0.14485590159893036,3.0581724643707275,81.14050197601318,1 +1188,0.29117658734321594,0.34497594833374023,0.33581072092056274,0.19533799588680267,984.4981079101562,1e-05,0.19594432413578033,3.16151762008667,81.14050197601318,1 +1189,0.36032333970069885,0.2443602830171585,0.249925434589386,0.20000000298023224,955.10791015625,1e-05,0.20323002338409424,3.4895503520965576,81.14050197601318,1 +1190,0.18629375100135803,0.3775216341018677,0.3653019070625305,0.20279720425605774,979.3876342773438,1e-05,0.13537399470806122,3.124279260635376,81.14050197601318,1 +1191,0.22872450947761536,0.22579757869243622,0.20923589169979095,0.22191141545772552,848.5123291015625,1e-05,0.14464813470840454,3.1166656017303467,81.14050197601318,1 +1192,0.16780534386634827,0.31909146904945374,0.29467257857322693,0.2282051295042038,947.7415161132812,1e-05,0.160165473818779,2.8466265201568604,81.14050197601318,1 +1193,0.3067428171634674,0.2196664810180664,0.21199138462543488,0.1594405621290207,771.0321044921875,1e-05,0.18004707992076874,3.0775651931762695,81.14050197601318,1 +1194,0.17481952905654907,0.28056371212005615,0.29961711168289185,0.12937062978744507,980.4682006835938,1e-05,0.14902305603027344,3.096881628036499,81.14050197601318,1 +1195,0.18171750009059906,0.28928980231285095,0.2864094376564026,0.13682983815670013,975.7278442382812,1e-05,0.14035797119140625,3.403712272644043,81.14050197601318,1 +1196,0.14500315487384796,0.22795197367668152,0.23372773826122284,0.20163169503211975,424.38739013671875,1e-05,0.12249027192592621,3.2051055431365967,81.14050197601318,1 +1197,0.28330352902412415,0.24903708696365356,0.2578904330730438,0.2209790199995041,660.37890625,1e-05,0.12857136130332947,3.3145296573638916,81.14050197601318,1 +1198,0.22437165677547455,0.26810330152511597,0.24880218505859375,0.20000000298023224,893.5853271484375,1e-05,0.17944422364234924,2.8519623279571533,81.14050197601318,1 +1199,0.10814739018678665,0.2979823350906372,0.28215643763542175,0.19696970283985138,895.0792846679688,1e-05,0.16764192283153534,3.0458149909973145,81.14050197601318,1 +1200,0.3632848858833313,0.29072996973991394,0.29434993863105774,0.16736596822738647,263.79840087890625,1e-05,0.1724628210067749,3.084505319595337,81.14050197601318,1 +1201,0.1767394244670868,0.22961930930614471,0.23166358470916748,0.13403263688087463,947.9669189453125,1e-05,0.1750440001487732,3.3434510231018066,81.14050197601318,1 +1202,0.2515352666378021,0.27151724696159363,0.25946176052093506,0.21095570921897888,854.7328491210938,1e-05,0.13391222059726715,3.1539485454559326,81.14050197601318,1 +1203,0.3019063174724579,0.14962051808834076,0.15547512471675873,0.17272727191448212,890.15478515625,1e-05,0.18285000324249268,3.3871490955352783,81.14050197601318,1 +1204,0.27318495512008667,0.20502831041812897,0.2049286812543869,0.16969697177410126,625.9617919921875,1e-05,0.17318670451641083,2.8569507598876953,81.14050197601318,1 +1205,0.28062278032302856,0.18715324997901917,0.19059528410434723,0.1790209710597992,427.6461486816406,1e-05,0.2012539505958557,3.0526256561279297,81.14050197601318,1 +1206,0.26929792761802673,0.08423488587141037,0.09157996624708176,0.1107226088643074,731.0974731445312,1e-05,0.20767122507095337,3.34885311126709,81.14050197601318,1 +1207,0.26646357774734497,0.4537275731563568,0.4660918414592743,0.2242424190044403,206.04872131347656,1e-05,0.14175401628017426,3.143442392349243,81.14050197601318,1 +1208,0.20267726480960846,0.16829943656921387,0.1642879843711853,0.2354312390089035,953.0025024414062,1e-05,0.3134118914604187,3.329251527786255,81.14050197601318,1 +1209,0.18837641179561615,0.22883392870426178,0.24910868704319,0.2158508151769638,997.86474609375,1e-05,0.1481596678495407,3.4099526405334473,81.14050197601318,1 +1210,0.17177146673202515,0.14301663637161255,0.14416640996932983,0.19487179815769196,803.0537109375,1e-05,0.19933508336544037,2.862112045288086,81.14050197601318,1 +1211,0.4533783197402954,0.2713225781917572,0.2669353485107422,0.22167831659317017,610.396240234375,1e-05,0.25095266103744507,3.048696517944336,81.14050197601318,1 +1212,0.22612011432647705,0.16183313727378845,0.17547501623630524,0.16759906709194183,891.6915283203125,1e-05,0.17855483293533325,3.4047389030456543,81.14050197601318,1 +1213,0.16128891706466675,0.17724770307540894,0.1753663569688797,0.22191141545772552,986.6468505859375,1e-05,0.1966998130083084,3.668154001235962,81.14050197601318,1 +1214,0.21275043487548828,0.1879996359348297,0.18092390894889832,0.19720280170440674,903.6668701171875,1e-05,0.14560173451900482,3.3490824699401855,81.14050197601318,1 +1215,0.19767272472381592,0.563066840171814,0.5633782744407654,0.2018647938966751,133.62509155273438,1e-05,0.16746501624584198,2.8406505584716797,81.14050197601318,1 +1216,0.10752328485250473,0.29584717750549316,0.2913219928741455,0.19393938779830933,983.9144897460938,1e-05,0.2163429707288742,2.844956874847412,81.14050197601318,1 +1217,0.268831342458725,0.24290744960308075,0.23473751544952393,0.20372959971427917,949.3074340820312,1e-05,0.17907895147800446,3.0731263160705566,81.14050197601318,1 +1218,0.11533710360527039,0.3151530623435974,0.3130635917186737,0.19836829602718353,968.2208862304688,1e-05,1.524166464805603,3.4684977531433105,81.14050197601318,1 +1219,0.10823627561330795,0.2659938633441925,0.26572859287261963,0.16643357276916504,913.8861694335938,1e-05,0.48480817675590515,3.419724464416504,81.14050197601318,1 +1220,0.25103995203971863,0.1843048632144928,0.17386415600776672,0.12144522368907928,951.4989624023438,1e-05,0.1876889169216156,3.3327832221984863,81.14050197601318,1 +1221,0.22714072465896606,0.26306870579719543,0.25723710656166077,0.21515151858329773,918.5123291015625,1e-05,0.27162259817123413,2.8371729850769043,81.14050197601318,1 +1222,0.1823645383119583,0.4154735207557678,0.39828798174858093,0.21561771631240845,974.08203125,1e-05,0.14104124903678894,3.0248003005981445,81.14050197601318,1 +1223,0.16246765851974487,0.16633518040180206,0.18167917430400848,0.22284382581710815,970.8588256835938,1e-05,0.29600992798805237,2.8358442783355713,81.14050197601318,1 +1224,0.23272792994976044,0.28278693556785583,0.27257487177848816,0.1874125897884369,803.7642822265625,1e-05,0.18942122161388397,3.1617166996002197,81.14050197601318,1 +1225,0.1793157309293747,0.33216139674186707,0.32362475991249084,0.27832168340682983,951.4989624023438,1e-05,0.16802512109279633,3.4488723278045654,81.14050197601318,1 +1226,0.22339549660682678,0.3359984755516052,0.33143916726112366,0.2158508151769638,996.1564331054688,1e-05,0.3260531723499298,3.31309175491333,81.14050197601318,1 +1227,0.21060654520988464,0.23809722065925598,0.22619740664958954,0.238228440284729,843.6619262695312,1e-05,0.17978546023368835,2.8527231216430664,81.14050197601318,1 +1228,0.30551955103874207,0.18943551182746887,0.19530238211154938,0.15314684808254242,889.3790893554688,1e-05,0.6499642729759216,3.085644006729126,81.14050197601318,1 +1229,0.3461933732032776,0.16607706248760223,0.17767558991909027,0.20349650084972382,964.940673828125,1e-05,0.1777394860982895,3.1869583129882812,81.14050197601318,1 +1230,0.2320353388786316,0.2870578467845917,0.27567344903945923,0.20629370212554932,664.7142333984375,1e-05,0.21702545881271362,3.121570110321045,81.14050197601318,1 +1231,0.18081916868686676,0.2492215782403946,0.23990489542484283,0.23076923191547394,809.341064453125,1e-05,0.2531500458717346,3.411372423171997,81.14050197601318,1 +1232,0.1870374083518982,0.2941662669181824,0.28846031427383423,0.20815850794315338,983.9144897460938,1e-05,0.2193741649389267,3.364955425262451,81.14050197601318,1 +1233,0.19144406914710999,0.30448076128959656,0.2981174886226654,0.1638694703578949,437.2454833984375,1e-05,0.14979158341884613,2.855726957321167,81.14050197601318,1 +1234,0.13270340859889984,0.1857149302959442,0.18800149857997894,0.14638695120811462,987.069091796875,1e-05,0.1817505955696106,3.1837170124053955,81.14050197601318,1 +1235,0.2037947028875351,0.22369256615638733,0.21856635808944702,0.11515151709318161,966.77880859375,1e-05,0.2703002095222473,3.0961737632751465,81.14050197601318,1 +1236,0.22729060053825378,0.2190963625907898,0.2045629471540451,0.2610722482204437,808.654296875,1e-05,0.20578119158744812,3.6115963459014893,81.14050197601318,1 +1237,0.2869706451892853,0.2826464772224426,0.2566014230251312,0.2668997645378113,888.9893188476562,1e-05,0.16489984095096588,3.3602592945098877,81.14050197601318,1 +1238,0.14265549182891846,0.2509740889072418,0.23718197643756866,0.20629370212554932,951.93115234375,1e-05,0.1318177729845047,3.3440372943878174,81.14050197601318,1 +1239,0.3121844530105591,0.2261391580104828,0.22260119020938873,0.24149183928966522,808.654296875,1e-05,0.17252889275550842,2.8440728187561035,81.14050197601318,1 +1240,0.21996904909610748,0.3481174409389496,0.3380140960216522,0.19114218652248383,920.3087768554688,1e-05,0.165338397026062,3.065037727355957,81.14050197601318,1 +1241,0.21299687027931213,0.27627885341644287,0.2693600356578827,0.18018648028373718,765.8187255859375,1e-05,0.2078901082277298,3.1241724491119385,81.14050197601318,1 +1242,0.2812575399875641,0.16246704757213593,0.16257649660110474,0.22494173049926758,793.5297241210938,1e-05,0.29989302158355713,3.1423938274383545,81.14050197601318,1 +1243,0.15709266066551208,0.262484610080719,0.2528795301914215,0.1890442818403244,960.3594970703125,1e-05,0.20141449570655823,3.3828933238983154,81.14050197601318,1 +1244,0.17621544003486633,0.2501140534877777,0.24178017675876617,0.260606050491333,991.954833984375,1e-05,0.12809941172599792,3.1596202850341797,81.14050197601318,1 +1245,0.18375222384929657,0.22554004192352295,0.21275591850280762,0.20069929957389832,901.2266235351562,1e-05,0.15665367245674133,2.863478422164917,81.14050197601318,1 +1246,0.2511058449745178,0.15238910913467407,0.16567905247211456,0.15687645971775055,421.0982971191406,1e-05,0.149662047624588,3.8054065704345703,81.14050197601318,1 +1247,0.22100254893302917,0.6521433591842651,0.6105518341064453,0.19393938779830933,997.7442626953125,1e-05,0.10504687577486038,3.3180418014526367,81.14050197601318,1 +1248,0.15196633338928223,0.218948632478714,0.21748299896717072,0.14941725134849548,663.2779541015625,1e-05,0.1675507128238678,3.154080629348755,81.14050197601318,1 +1249,0.25857049226760864,0.3427591323852539,0.35136106610298157,0.2710955739021301,287.737548828125,1e-05,0.2246323674917221,3.0697102546691895,81.14050197601318,1 +1250,0.1506626009941101,0.12055880576372147,0.11532894521951675,0.19393938779830933,905.7181396484375,1e-05,0.12597374618053436,3.1665050983428955,81.14050197601318,1 +1251,0.0979219600558281,0.39028674364089966,0.3724172115325928,0.20652680099010468,983.3262329101562,1e-05,0.1466655284166336,2.8447153568267822,81.14050197601318,1 +1252,0.17532199621200562,0.39967426657676697,0.41447678208351135,0.23916083574295044,140.08938598632812,1e-05,0.15549452602863312,3.094675064086914,81.14050197601318,1 +1253,0.4154747724533081,0.30748066306114197,0.29207494854927063,0.23356643319129944,819.3053588867188,1e-05,10.167792320251465,3.346712589263916,81.14050197601318,1 +1254,0.17452578246593475,0.23761621117591858,0.26326650381088257,0.15081584453582764,973.2462768554688,1e-05,0.3673718273639679,3.629957675933838,81.14050197601318,1 +1255,0.22492019832134247,0.27941492199897766,0.28215092420578003,0.1990675926208496,989.8240966796875,1e-05,0.15572528541088104,3.1247246265411377,81.14050197601318,1 +1256,0.2849631905555725,0.1645473837852478,0.1584707647562027,0.26806527376174927,924.6715087890625,1e-05,0.15806423127651215,2.8402602672576904,81.14050197601318,1 +1257,0.23035871982574463,0.3031226098537445,0.2962704598903656,0.22494173049926758,929.1331176757812,1e-05,0.13910895586013794,3.0923805236816406,81.14050197601318,1 +1258,0.15737281739711761,0.21532641351222992,0.20053960382938385,0.17878787219524384,849.041259765625,1e-05,0.20037193596363068,2.8417155742645264,81.14050197601318,1 +1259,0.14301715791225433,0.1290937215089798,0.1243659108877182,0.21212121844291687,750.1998901367188,1e-05,0.2178201675415039,3.3116724491119385,81.14050197601318,1 +1260,0.148419588804245,0.3922373056411743,0.37594589591026306,0.2174825221300125,975.4014282226562,1e-05,0.15944771468639374,3.1733663082122803,81.14050197601318,1 +1261,0.23809270560741425,0.3276456892490387,0.32160788774490356,0.22564102709293365,981.230712890625,1e-05,0.14093221724033356,3.146610975265503,81.14050197601318,1 +1262,0.3850453197956085,0.10919441282749176,0.10917284339666367,0.13659673929214478,590.026123046875,1e-05,0.2830318212509155,2.841233968734741,81.14050197601318,1 +1263,0.2077925205230713,0.11592938005924225,0.11542162299156189,0.13613054156303406,862.1375732421875,1e-05,0.17007984220981598,3.030463218688965,81.14050197601318,1 +1264,0.16727067530155182,0.21513168513774872,0.21044419705867767,0.2622377574443817,926.3671875,1e-05,0.12006596475839615,2.853651523590088,81.14050197601318,1 +1265,0.15542387962341309,0.25187307596206665,0.24361860752105713,0.22004662454128265,390.0654296875,1e-05,0.2518560588359833,4.112981081008911,81.14050197601318,1 +1266,0.20529629290103912,0.2096782922744751,0.20398414134979248,0.21911421418190002,904.354736328125,1e-05,0.11862640082836151,3.294679880142212,81.14050197601318,1 +1267,0.18346455693244934,0.2569206655025482,0.26464784145355225,0.16899767518043518,992.6078491210938,1e-05,0.4263666272163391,3.1445436477661133,81.14050197601318,1 +1268,0.18282829225063324,0.36951297521591187,0.367156058549881,0.1867132931947708,935.22314453125,1e-05,0.14650940895080566,2.8524980545043945,81.14050197601318,1 +1269,0.16940854489803314,0.26497504115104675,0.2528272271156311,0.19440560042858124,839.2100219726562,1e-05,0.15250393748283386,3.1114656925201416,81.14050197601318,1 +1270,0.19231072068214417,0.13532526791095734,0.14571398496627808,0.2405594438314438,828.6761474609375,1e-05,0.35472372174263,3.0893099308013916,81.14050197601318,1 +1271,0.2575462758541107,0.29721325635910034,0.278359055519104,0.1818181872367859,988.18359375,1e-05,0.13201133906841278,3.1363329887390137,81.14050197601318,1 +1272,0.14490321278572083,0.41384294629096985,0.4000610411167145,0.1878787875175476,969.9888916015625,1e-05,0.18152974545955658,3.1476268768310547,81.14050197601318,1 +1273,0.20985351502895355,0.24455256760120392,0.25800207257270813,0.1890442818403244,983.4736938476562,1e-05,0.18298611044883728,3.3705661296844482,81.14050197601318,1 +1274,0.23169192671775818,0.17805159091949463,0.1846519410610199,0.23030303418636322,923.8132934570312,1e-05,0.9974978566169739,2.8480358123779297,81.14050197601318,1 +1275,0.20819097757339478,0.34791627526283264,0.34850046038627625,0.23123542964458466,976.69921875,1e-05,0.14155173301696777,3.0497970581054688,81.14050197601318,1 +1276,0.3785926103591919,0.2553829252719879,0.24713414907455444,0.26806527376174927,615.6897583007812,1e-05,0.15741094946861267,3.3624939918518066,81.14050197601318,1 +1277,0.35391080379486084,0.2348068803548813,0.22329269349575043,0.20885780453681946,953.8506469726562,1e-05,0.3538753390312195,3.3051111698150635,81.14050197601318,1 +1278,0.3622683882713318,0.31034258008003235,0.285968154668808,0.2174825221300125,861.6561889648438,1e-05,0.17091333866119385,2.842259645462036,81.14050197601318,1 +1279,0.13772432506084442,0.2550877332687378,0.2586662769317627,0.27389276027679443,963.251220703125,1e-05,0.1354329138994217,3.1395323276519775,81.14050197601318,1 +1280,0.25691139698028564,0.29671546816825867,0.2815212905406952,0.2596736550331116,962.6806640625,1e-05,0.14294187724590302,2.8466575145721436,81.14050197601318,1 +1281,0.23903656005859375,0.1915539801120758,0.20327773690223694,0.1202797219157219,984.0607299804688,1e-05,0.13596244156360626,3.0932090282440186,81.14050197601318,1 +1282,0.08244296908378601,0.265616238117218,0.2641909420490265,0.16083915531635284,891.30908203125,1e-05,0.1554589569568634,3.316746473312378,81.14050197601318,1 +1283,0.34911802411079407,0.25003254413604736,0.23974202573299408,0.07365967333316803,877.5501708984375,1e-05,0.19214017689228058,3.108912944793701,81.14050197601318,1 +1284,0.2220877707004547,0.2359066754579544,0.21142145991325378,0.18764568865299225,927.2047729492188,1e-05,0.12598790228366852,2.850700616836548,81.14050197601318,1 +1285,0.23521624505519867,0.22789262235164642,0.21963848173618317,0.14568763971328735,691.7044067382812,1e-05,0.1466391384601593,3.2080602645874023,81.14050197601318,1 +1286,0.16309747099876404,0.244484543800354,0.23681621253490448,0.21794871985912323,948.6395874023438,1e-05,0.12257201969623566,3.101923704147339,81.14050197601318,1 +1287,0.2137966752052307,0.29576951265335083,0.28712934255599976,0.17832167446613312,953.4276123046875,1e-05,0.3321378529071808,2.8463656902313232,81.14050197601318,1 +1288,0.35037651658058167,0.23291441798210144,0.2361799031496048,0.2181818187236786,855.2390747070312,1e-05,0.24894371628761292,3.3850414752960205,81.14050197601318,1 +1289,0.21637320518493652,0.13663557171821594,0.13721688091754913,0.06969697028398514,701.6507568359375,1e-05,0.19438369572162628,3.126944065093994,81.14050197601318,1 +1290,0.21186913549900055,0.13949237763881683,0.14702829718589783,0.23869463801383972,866.3948974609375,1e-05,0.18624015152454376,3.32942271232605,81.14050197601318,1 +1291,0.2948005795478821,0.20681706070899963,0.20225296914577484,0.23449882864952087,995.035400390625,1e-05,0.18467369675636292,3.084092140197754,81.14050197601318,1 +1292,0.13106584548950195,0.22225148975849152,0.21706807613372803,0.25477856397628784,892.0726318359375,1e-05,0.2529149055480957,3.094001531600952,81.14050197601318,1 +1293,0.3107721507549286,0.13769082725048065,0.12380041182041168,0.1766899824142456,939.7424926757812,1e-05,0.22126977145671844,2.843149423599243,81.14050197601318,1 +1294,0.19147083163261414,0.21810632944107056,0.22116146981716156,0.23426572978496552,826.2322387695312,1e-05,0.19201728701591492,3.113421678543091,81.14050197601318,1 +1295,0.2083233892917633,0.21443228423595428,0.2011638581752777,0.2610722482204437,899.4515991210938,1e-05,0.4014930725097656,3.6528964042663574,81.14050197601318,1 +1296,0.48484185338020325,0.3246021568775177,0.3179161250591278,0.08601398766040802,553.0419311523438,1e-05,0.2005084604024887,3.274632692337036,81.14050197601318,1 +1297,0.2051834762096405,0.20087380707263947,0.18671974539756775,0.19044288992881775,890.15478515625,1e-05,0.19658493995666504,2.841426134109497,81.14050197601318,1 +1298,0.30662229657173157,0.1880466639995575,0.18603381514549255,0.17529137432575226,876.2608642578125,1e-05,0.16336162388324738,3.043344736099243,81.14050197601318,1 +1299,0.2352638840675354,0.17875061929225922,0.18849000334739685,0.15198135375976562,619.15966796875,1e-05,0.5534442663192749,3.055133819580078,81.14050197601318,1 +1300,0.24170199036598206,0.16342425346374512,0.16576768457889557,0.1822843849658966,939.0036010742188,1e-05,0.15169133245944977,3.1011993885040283,81.14050197601318,1 +1301,0.23725667595863342,0.11207889020442963,0.10825406014919281,0.14498834311962128,720.25927734375,1e-05,0.17268848419189453,3.139953851699829,81.14050197601318,1 +1302,0.2536378502845764,0.16332052648067474,0.16607420146465302,0.08881118893623352,819.9478759765625,1e-05,0.15698276460170746,3.04988169670105,81.14050197601318,1 +1303,0.4531371593475342,0.3623800277709961,0.36279696226119995,0.18927739560604095,390.0654296875,1e-05,0.16351190209388733,3.2784535884857178,81.14050197601318,1 +1304,0.30837807059288025,0.3322584331035614,0.3415148854255676,0.1622377634048462,994.9097900390625,1e-05,0.15076987445354462,3.0746116638183594,81.14050197601318,1 +1305,0.2159598171710968,0.1858757883310318,0.17788676917552948,0.14079253375530243,716.8931274414062,1e-05,0.15800215303897858,3.1116976737976074,81.14050197601318,1 +1306,0.20184928178787231,0.2384481579065323,0.2335490584373474,0.23519814014434814,988.5972900390625,1e-05,0.19808657467365265,3.135080099105835,81.14050197601318,1 +1307,0.2152460515499115,0.23090286552906036,0.22302505373954773,0.22727273404598236,982.1359252929688,1e-05,0.2104058861732483,3.0954415798187256,81.14050197601318,1 +1308,0.21868081390857697,0.28702089190483093,0.28248167037963867,0.22517482936382294,912.2996826171875,1e-05,0.18734672665596008,3.0623056888580322,81.14050197601318,1 +1309,0.33032599091529846,0.17975124716758728,0.176456481218338,0.22773893177509308,884.2141723632812,1e-05,0.27101367712020874,3.1614906787872314,81.14050197601318,1 +1310,0.13656409084796906,0.3204006254673004,0.31189101934432983,0.2242424190044403,996.771484375,1e-05,0.17357760667800903,3.0439958572387695,81.14050197601318,1 +1311,0.1112593561410904,0.3635695278644562,0.3404858708381653,0.2242424190044403,988.0452880859375,1e-05,0.5038558840751648,3.3745195865631104,81.14050197601318,1 +1312,0.14505228400230408,0.23954418301582336,0.23034082353115082,0.22610722482204437,785.822265625,1e-05,0.24441511929035187,2.837245225906372,81.14050197601318,1 +1313,0.2793453335762024,0.22886770963668823,0.23279154300689697,0.1890442818403244,473.1681213378906,1e-05,0.11856946349143982,3.1290807723999023,81.14050197601318,1 +1314,0.22961530089378357,0.5369195342063904,0.5182300806045532,0.17855477333068848,986.221923828125,1e-05,0.22553567588329315,3.0999748706817627,81.14050197601318,1 +1315,0.3569188416004181,0.17560158669948578,0.17262591421604156,0.1930069923400879,992.3473510742188,1e-05,0.1810399442911148,3.1701838970184326,81.14050197601318,1 +1316,0.1937333196401596,0.3061666786670685,0.30386900901794434,0.1818181872367859,601.3294677734375,1e-05,0.16562099754810333,3.082937240600586,81.14050197601318,1 +1317,0.2626161575317383,0.3336087167263031,0.3133162558078766,0.22890442609786987,776.0996704101562,1e-05,0.1655353456735611,3.357084274291992,81.14050197601318,1 +1318,0.20921754837036133,0.2337498664855957,0.23047791421413422,0.15594404935836792,913.8861694335938,1e-05,0.1643596887588501,3.143218517303467,81.14050197601318,1 +1319,0.19770848751068115,0.24258540570735931,0.2368226945400238,0.2293706238269806,885.4254760742188,1e-05,0.9431132674217224,3.161109447479248,81.14050197601318,1 +1320,0.2713264226913452,0.4091107249259949,0.42037639021873474,0.1862470805644989,982.5844116210938,1e-05,0.2363625168800354,3.027057409286499,81.14050197601318,1 +1321,0.25098279118537903,0.23022258281707764,0.21471838653087616,0.21118880808353424,884.6192626953125,1e-05,0.15638844668865204,3.3077468872070312,81.14050197601318,1 +1322,0.41956812143325806,0.1824789196252823,0.18159601092338562,0.21491841971874237,814.068359375,1e-05,0.20263734459877014,4.098409652709961,81.14050197601318,1 +1323,0.324579119682312,0.37502557039260864,0.3914335370063782,0.1662004590034485,227.91456604003906,1e-05,0.24258823692798615,3.1042580604553223,81.14050197601318,1 +1324,0.1819506585597992,0.394174188375473,0.3634110689163208,0.20279720425605774,997.5022583007812,1e-05,0.13428063690662384,3.1390230655670166,81.14050197601318,1 +1325,0.16559842228889465,0.44775959849357605,0.4230611324310303,0.22797203063964844,997.6233520507812,1e-05,0.1604497730731964,2.853876829147339,81.14050197601318,1 +1326,0.31804612278938293,0.2887708246707916,0.2641555070877075,0.17575757205486298,974.08203125,1e-05,0.16200841963291168,3.0890231132507324,81.14050197601318,1 +1327,0.2858012318611145,0.21574616432189941,0.21610140800476074,0.0855477824807167,709.9939575195312,1e-05,0.17537188529968262,3.338491201400757,81.14050197601318,1 +1328,0.2549164295196533,0.41084322333335876,0.41488975286483765,0.2913752794265747,296.9483642578125,1e-05,0.35927683115005493,2.8532514572143555,81.14050197601318,1 +1329,0.2541150152683258,0.23302242159843445,0.22891810536384583,0.1958041936159134,958.576904296875,1e-05,0.14131563901901245,3.161409854888916,81.14050197601318,1 +1330,0.2507835924625397,0.39343374967575073,0.40609443187713623,0.20000000298023224,985.364990234375,1e-05,0.1584392786026001,3.3618075847625732,81.14050197601318,1 +1331,0.10851547867059708,0.3711535930633545,0.3622433841228485,0.18391607701778412,968.0419921875,1e-05,0.136349156498909,3.119446039199829,81.14050197601318,1 +1332,0.32118433713912964,0.211141899228096,0.2000354528427124,0.20209790766239166,865.928466796875,1e-05,0.15039199590682983,2.8475518226623535,81.14050197601318,1 +1333,0.14756031334400177,0.17258384823799133,0.18074296414852142,0.10116550326347351,975.2377319335938,1e-05,0.19144412875175476,3.158855676651001,81.14050197601318,1 +1334,0.16381315886974335,0.21420782804489136,0.21789580583572388,0.1834498792886734,862.6173095703125,1e-05,0.5602561831474304,3.1034560203552246,81.14050197601318,1 +1335,0.17900538444519043,0.4407767653465271,0.41015833616256714,0.19603729248046875,992.2167358398438,1e-05,0.5684869885444641,3.0539770126342773,81.14050197601318,1 +1336,0.3134177327156067,0.26659539341926575,0.25604286789894104,0.1515151560306549,737.33203125,1e-05,0.15148451924324036,3.4274914264678955,81.14050197601318,1 +1337,0.15682794153690338,0.2071722149848938,0.18939459323883057,0.19766899943351746,718.021240234375,1e-05,0.22633828222751617,3.1204023361206055,81.14050197601318,1 +1338,0.1023196280002594,0.23296555876731873,0.23671376705169678,0.10839160531759262,955.523193359375,1e-05,0.1498107761144638,2.8498570919036865,81.14050197601318,1 +1339,0.25825411081314087,0.31472283601760864,0.29619020223617554,0.18927739560604095,663.2779541015625,1e-05,0.15843939781188965,3.1776769161224365,81.14050197601318,1 +1340,0.40371957421302795,0.289734423160553,0.28619205951690674,0.11701631546020508,972.9094848632812,1e-05,0.1665911227464676,3.41739821434021,81.14050197601318,1 +1341,0.26789361238479614,0.27024081349372864,0.25538960099220276,0.2058275043964386,880.5089721679688,1e-05,0.3155447244644165,3.2869627475738525,81.14050197601318,1 +1342,0.08283276110887527,0.32114550471305847,0.3348623216152191,0.22890442609786987,987.3492431640625,1e-05,0.22038951516151428,3.1160054206848145,81.14050197601318,1 +1343,0.20121091604232788,0.3225344717502594,0.31880125403404236,0.21328671276569366,986.221923828125,1e-05,0.1511484682559967,3.0302486419677734,81.14050197601318,1 +1344,0.32183828949928284,0.22022560238838196,0.23880863189697266,0.18041957914829254,578.2326049804688,1e-05,0.1601938158273697,3.3317711353302,81.14050197601318,1 +1345,0.25639575719833374,0.19071675837039948,0.1829608976840973,0.2142191082239151,926.6471557617188,1e-05,0.19382590055465698,3.020001173019409,81.14050197601318,1 +1346,0.30725252628326416,0.43561550974845886,0.441342830657959,0.12937062978744507,348.26116943359375,1e-05,0.1272018849849701,3.1658263206481934,81.14050197601318,1 +1347,0.3576187789440155,0.20050905644893646,0.1991298645734787,0.21678321063518524,816.7084350585938,1e-05,0.19173790514469147,3.3163716793060303,81.14050197601318,1 +1348,0.17521636188030243,0.24699091911315918,0.257779061794281,0.14755244553089142,966.414306640625,1e-05,0.13790492713451385,3.1573517322540283,81.14050197601318,1 +1349,0.2069009691476822,0.24421772360801697,0.22376476228237152,0.21328671276569366,947.5157470703125,1e-05,0.15335196256637573,3.031691074371338,81.14050197601318,1 +1350,0.22904056310653687,0.1396547555923462,0.13771580159664154,0.1538461595773697,849.5682373046875,1e-05,1.2914656400680542,2.8597567081451416,81.14050197601318,1 +1351,0.2085767537355423,0.14282791316509247,0.14279402792453766,0.00699300691485405,677.2564697265625,1e-05,0.13371209800243378,3.1829123497009277,81.14050197601318,1 +1352,0.35252290964126587,0.28200846910476685,0.272207647562027,0.16526806354522705,871.4204711914062,1e-05,0.1818041354417801,3.0867836475372314,81.14050197601318,1 +1353,0.30135250091552734,0.2893177270889282,0.2735286355018616,0.2678321599960327,539.5704345703125,1e-05,0.4737216830253601,3.353156805038452,81.14050197601318,1 +1354,0.1201137900352478,0.39033475518226624,0.39020785689353943,0.19044288992881775,987.069091796875,1e-05,0.2703395485877991,2.8500852584838867,81.14050197601318,1 +1355,0.3777422308921814,0.21672771871089935,0.21701133251190186,0.16736596822738647,884.2141723632812,1e-05,0.15979236364364624,3.069366931915283,81.14050197601318,1 +1356,0.35662713646888733,0.3024376332759857,0.28108447790145874,0.2242424190044403,978.2918701171875,1e-05,0.19354338943958282,2.8443939685821533,81.14050197601318,1 +1357,0.1995423138141632,0.20181900262832642,0.1913481056690216,0.18764568865299225,898.011962890625,1e-05,0.22268347442150116,3.193303346633911,81.14050197601318,1 +1358,0.2262158989906311,0.32902219891548157,0.3242359757423401,0.19813519716262817,998.9408569335938,1e-05,0.12290618568658829,3.1122937202453613,81.14050197601318,1 +1359,0.10537169128656387,0.19162525236606598,0.18496879935264587,0.10489510744810104,874.9585571289062,1e-05,1.0966964960098267,3.39445424079895,81.14050197601318,1 +1360,0.3166084587574005,0.20940564572811127,0.1994774043560028,0.20815850794315338,890.15478515625,1e-05,0.20837770402431488,2.8420557975769043,81.14050197601318,1 +1361,0.1779511570930481,0.09454892575740814,0.10908755660057068,0.1906759887933731,904.354736328125,1e-05,0.12498041242361069,3.115311622619629,81.14050197601318,1 +1362,0.15673582255840302,0.1622961014509201,0.15642400085926056,0.2242424190044403,923.2371215820312,1e-05,0.13860033452510834,3.0326435565948486,81.14050197601318,1 +1363,0.26156550645828247,0.41802623867988586,0.39583301544189453,0.18648017942905426,972.0613403320312,1e-05,0.13306376338005066,3.4195163249969482,81.14050197601318,1 +1364,0.33379533886909485,0.27038976550102234,0.2837100028991699,0.14195804297924042,980.3147583007812,1e-05,0.16811534762382507,3.134068250656128,81.14050197601318,1 +1365,0.3411410450935364,0.27562081813812256,0.2649189829826355,0.21351981163024902,561.6887817382812,1e-05,0.1290007084608078,3.165571928024292,81.14050197601318,1 +1366,0.29528293013572693,0.23071187734603882,0.21408946812152863,0.21002331376075745,841.452880859375,1e-05,0.11237157881259918,2.8521761894226074,81.14050197601318,1 +1367,0.24990814924240112,0.4811626076698303,0.48839271068573,0.17832167446613312,211.61354064941406,1e-05,0.8353641629219055,3.045522689819336,81.14050197601318,1 +1368,0.3609444200992584,0.1710439920425415,0.17159448564052582,0.11724941432476044,719.1432495117188,1e-05,0.1770106852054596,3.0299665927886963,81.14050197601318,1 +1369,0.08692272752523422,0.18288420140743256,0.17998068034648895,0.22331002354621887,969.2862548828125,1e-05,0.1563563495874405,3.3676745891571045,81.14050197601318,1 +1370,0.2762373089790344,0.12880739569664001,0.1301575005054474,0.20606060326099396,666.1416625976562,1e-05,0.14334411919116974,3.059040069580078,81.14050197601318,1 +1371,0.30909934639930725,0.22613665461540222,0.21958795189857483,0.21841491758823395,931.2932739257812,1e-05,0.23604518175125122,3.140385866165161,81.14050197601318,1 +1372,0.26976263523101807,0.23789621889591217,0.23158715665340424,0.24009324610233307,814.732421875,1e-05,0.5804770588874817,2.8376283645629883,81.14050197601318,1 +1373,0.2946053445339203,0.2837591767311096,0.2687143385410309,0.19836829602718353,877.5501708984375,1e-05,0.14637844264507294,3.075709342956543,81.14050197601318,1 +1374,0.23797500133514404,0.2668461799621582,0.24892355501651764,0.2846153974533081,954.8995971679688,1e-05,0.13131970167160034,3.0857152938842773,81.14050197601318,1 +1375,0.32744932174682617,0.22720615565776825,0.22619840502738953,0.09930069744586945,998.9408569335938,1e-05,0.1255132257938385,3.401211738586426,81.14050197601318,1 +1376,0.23597362637519836,0.2066558450460434,0.2130504995584488,0.2058275043964386,944.2952880859375,1e-05,0.1425880491733551,3.1360604763031006,81.14050197601318,1 +1377,0.3153495490550995,0.24119943380355835,0.2403862029314041,0.264102578163147,807.9645385742188,1e-05,0.13440163433551788,3.124300718307495,81.14050197601318,1 +1378,0.2803385257720947,0.1833767145872116,0.18234051764011383,0.19137528538703918,950.1903076171875,1e-05,0.18573245406150818,3.0376296043395996,81.14050197601318,1 +1379,0.1912120282649994,0.20935213565826416,0.21627114713191986,0.17132866382598877,789.71923828125,1e-05,0.1507810652256012,2.8526594638824463,81.14050197601318,1 +1380,0.199676051735878,0.2682066261768341,0.271051287651062,0.07412587106227875,969.9888916015625,1e-05,0.2493097484111786,3.1029269695281982,81.14050197601318,1 +1381,0.23107080161571503,0.31602582335472107,0.304718017578125,0.20955711603164673,892.0726318359375,1e-05,0.19646449387073517,3.456169843673706,81.14050197601318,1 +1382,0.22319096326828003,0.18925614655017853,0.1963130384683609,0.2181818187236786,940.7190551757812,1e-05,0.1242528110742569,3.171414613723755,81.14050197601318,1 +1383,0.30553102493286133,0.2736482322216034,0.27235573530197144,0.18997669219970703,478.7982177734375,1e-05,1.153025507926941,3.7216756343841553,81.14050197601318,1 +1384,0.37113073468208313,0.15579019486904144,0.14477159082889557,0.23006993532180786,815.3939208984375,1e-05,0.5750159621238708,3.1212663650512695,81.14050197601318,1 +1385,0.34769511222839355,0.7166116833686829,0.7014821171760559,0.1515151560306549,100.0000228881836,1e-05,0.17851395905017853,2.843306541442871,81.14050197601318,1 +1386,0.19804349541664124,0.2222365438938141,0.21347777545452118,0.20512820780277252,835.7803955078125,1e-05,0.2213277816772461,3.0702786445617676,81.14050197601318,1 +1387,0.17821645736694336,0.19443970918655396,0.19295306503772736,0.23193472623825073,906.0565185546875,1e-05,0.2128288745880127,3.160858392715454,81.14050197601318,1 +1388,0.11400094628334045,0.14557641744613647,0.14640571177005768,0.23519814014434814,886.226318359375,1e-05,0.14396870136260986,3.101654529571533,81.14050197601318,1 +1389,0.2833925783634186,0.21497389674186707,0.22535865008831024,0.24708624184131622,987.7676391601562,1e-05,0.2010045349597931,3.116122007369995,81.14050197601318,1 +1390,0.22259753942489624,0.15598219633102417,0.1454499363899231,0.2114219069480896,896.5547485351562,1e-05,0.1595264971256256,3.105703353881836,81.14050197601318,1 +1391,0.3017677962779999,0.16064581274986267,0.16636677086353302,0.17529137432575226,712.31884765625,1e-05,0.13847459852695465,2.8480923175811768,81.14050197601318,1 +1392,0.2865288555622101,0.1074945479631424,0.11756661534309387,0.13729603588581085,916.0694580078125,1e-05,0.27396270632743835,3.2645320892333984,81.14050197601318,1 +1393,0.21859179437160492,0.1830012947320938,0.17505784332752228,0.20349650084972382,857.74267578125,1e-05,0.11572177708148956,3.13983416557312,81.14050197601318,1 +1394,0.2717721462249756,0.21997739374637604,0.22842364013195038,0.2652680575847626,982.5844116210938,1e-05,0.15027780830860138,3.1208996772766113,81.14050197601318,1 +1395,0.22434264421463013,0.19506271183490753,0.2021520733833313,0.13333334028720856,757.7117919921875,1e-05,0.11836350709199905,3.162113666534424,81.14050197601318,1 +1396,0.10642628371715546,0.25723162293434143,0.2725747525691986,0.2242424190044403,973.5816040039062,1e-05,0.14894621074199677,3.1132407188415527,81.14050197601318,1 +1397,0.3163590133190155,0.15990519523620605,0.15641260147094727,0.23636363446712494,907.7332763671875,1e-05,0.14752037823200226,2.8518528938293457,81.14050197601318,1 +1398,0.3452327251434326,0.3181653618812561,0.32934197783470154,0.264102578163147,200.4163818359375,1e-05,0.15540623664855957,3.381519079208374,81.14050197601318,1 +1399,0.2000640630722046,0.24351932108402252,0.23673787713050842,0.2242424190044403,772.7371215820312,1e-05,0.32124918699264526,3.4120256900787354,81.14050197601318,1 +1400,0.16148260235786438,0.3105452358722687,0.30421748757362366,0.24149183928966522,983.178466796875,1e-05,0.13553522527217865,2.8514339923858643,81.14050197601318,1 +1401,0.10460802912712097,0.2304203063249588,0.23069651424884796,0.21002331376075745,952.789306640625,1e-05,0.40955811738967896,3.130124568939209,81.14050197601318,1 +1402,0.14689147472381592,0.3622453510761261,0.3442951738834381,0.19603729248046875,714.6185302734375,1e-05,0.15714555978775024,3.076664447784424,81.14050197601318,1 +1403,0.13730277121067047,0.20388923585414886,0.2001294493675232,0.1515151560306549,944.529052734375,1e-05,0.19845201075077057,3.1079514026641846,81.14050197601318,1 +1404,0.3513917326927185,0.1702907532453537,0.18577715754508972,0.15617716312408447,570.0819702148438,1e-05,0.14393197000026703,3.1513452529907227,81.14050197601318,1 +1405,0.22096432745456696,0.25896570086479187,0.25232410430908203,0.20093239843845367,959.1751708984375,1e-05,0.16273079812526703,3.359496831893921,81.14050197601318,1 +1406,0.1573394238948822,0.4470043480396271,0.44542425870895386,0.2226107269525528,984.643310546875,1e-05,0.20317217707633972,3.146989107131958,81.14050197601318,1 +1407,0.15931116044521332,0.18392716348171234,0.17791569232940674,0.2030303031206131,951.4989624023438,1e-05,0.2511436343193054,2.8515193462371826,81.14050197601318,1 +1408,0.154549241065979,0.2075182944536209,0.21852821111679077,0.22237762808799744,981.230712890625,1e-05,0.34727421402931213,3.0822696685791016,81.14050197601318,1 +1409,0.2970424294471741,0.2577306032180786,0.2695014476776123,0.25081583857536316,974.9092407226562,1e-05,0.14658872783184052,3.0339293479919434,81.14050197601318,1 +1410,0.43717265129089355,0.3690151274204254,0.37538883090019226,0.19836829602718353,233.2209930419922,1e-05,0.2886028289794922,3.1402273178100586,81.14050197601318,1 +1411,0.19164970517158508,0.16888107359409332,0.16733644902706146,0.26596736907958984,731.0974731445312,1e-05,0.30367445945739746,3.4254794120788574,81.14050197601318,1 +1412,0.1727302074432373,0.11755068600177765,0.12617971003055573,0.14568763971328735,924.38623046875,1e-05,0.12710371613502502,3.1512060165405273,81.14050197601318,1 +1413,0.20849400758743286,0.1772363930940628,0.16231638193130493,0.18927739560604095,819.3053588867188,1e-05,0.13737860321998596,2.8557915687561035,81.14050197601318,1 +1414,0.21759609878063202,0.13916607201099396,0.14381636679172516,0.12564101815223694,899.0933837890625,1e-05,0.255833238363266,3.093588352203369,81.14050197601318,1 +1415,0.15078409016132355,0.49568745493888855,0.5018563270568848,0.24871794879436493,987.2093505859375,1e-05,0.16973353922367096,3.0582566261291504,81.14050197601318,1 +1416,0.23181171715259552,0.5431864261627197,0.5283698439598083,0.19393938779830933,200.4163818359375,1e-05,0.12925557792186737,3.381068229675293,81.14050197601318,1 +1417,0.22919830679893494,0.1434703916311264,0.14388646185398102,0.22773893177509308,890.15478515625,1e-05,0.16176120936870575,3.134578227996826,81.14050197601318,1 +1418,0.1431678682565689,0.22705160081386566,0.2239728420972824,0.20163169503211975,760.4534912109375,1e-05,0.16504225134849548,3.4020566940307617,81.14050197601318,1 +1419,0.09227818995714188,0.2483539879322052,0.23660241067409515,0.2242424190044403,980.0068969726562,1e-05,0.14681071043014526,3.05049467086792,81.14050197601318,1 +1420,0.20213405787944794,0.1776840090751648,0.1676526963710785,0.09440559148788452,726.8310546875,1e-05,0.12379145622253418,2.8420639038085938,81.14050197601318,1 +1421,0.17042379081249237,0.3608918786048889,0.3386181890964508,0.15734265744686127,952.789306640625,1e-05,0.15255258977413177,3.096696138381958,81.14050197601318,1 +1422,0.38160109519958496,0.37009355425834656,0.37635302543640137,0.2454545497894287,301.4790344238281,1e-05,0.2464333027601242,3.4722518920898438,81.14050197601318,1 +1423,0.33553510904312134,0.34891679883003235,0.3651266098022461,0.20885780453681946,382.7987976074219,1e-05,0.16867737472057343,3.1258814334869385,81.14050197601318,1 +1424,0.21169143915176392,0.23910824954509735,0.23174095153808594,0.1023310050368309,799.454345703125,1e-05,0.3035423755645752,3.5490174293518066,81.14050197601318,1 +1425,0.11430550366640091,0.18711385130882263,0.17926612496376038,0.2310023307800293,744.3661499023438,1e-05,0.13586285710334778,3.0986428260803223,81.14050197601318,1 +1426,0.331750750541687,0.22911198437213898,0.2176932692527771,0.19673658907413483,505.5683898925781,1e-05,0.2967107892036438,2.8427817821502686,81.14050197601318,1 +1427,0.2356841266155243,0.26393556594848633,0.24926510453224182,0.1818181872367859,840.8953247070312,1e-05,0.13009890913963318,3.35768461227417,81.14050197601318,1 +1428,0.17459234595298767,0.1757509708404541,0.16548629105091095,0.20839160680770874,747.3050537109375,1e-05,1.4841198921203613,3.4195587635040283,81.14050197601318,1 +1429,0.4085194170475006,0.43235674500465393,0.44294193387031555,0.13939394056797028,233.2209930419922,1e-05,0.13682058453559875,3.106395959854126,81.14050197601318,1 +1430,0.23326726257801056,0.21948054432868958,0.20756709575653076,0.2114219069480896,948.8626708984375,1e-05,0.17244569957256317,3.2205262184143066,81.14050197601318,1 +1431,0.24639780819416046,0.20658329129219055,0.21049731969833374,0.20536130666732788,920.0114135742188,1e-05,0.21637092530727386,3.0590555667877197,81.14050197601318,1 +1432,0.2094910442829132,0.18998554348945618,0.1812446564435959,0.11515151709318161,930.7574462890625,1e-05,0.5548224449157715,2.8491246700286865,81.14050197601318,1 +1433,0.16285885870456696,0.2608301639556885,0.2575114071369171,0.2209790199995041,941.926025390625,1e-05,0.11140016466379166,3.1683831214904785,81.14050197601318,1 +1434,0.2862720787525177,0.2517422139644623,0.24479597806930542,0.07575757801532745,905.7181396484375,1e-05,0.16415530443191528,3.1418797969818115,81.14050197601318,1 +1435,0.1335773766040802,0.3170859217643738,0.2983746826648712,0.2655011713504791,983.4736938476562,1e-05,0.14184847474098206,3.4020280838012695,81.14050197601318,1 +1436,0.24013453722000122,0.2872623801231384,0.2793199419975281,0.20606060326099396,671.7659301757812,1e-05,0.3379684090614319,2.8445053100585938,81.14050197601318,1 +1437,0.1477883756160736,0.2127559930086136,0.20940381288528442,0.21165500581264496,942.1655883789062,1e-05,0.1569778323173523,3.972541093826294,81.14050197601318,1 +1438,0.30413955450057983,0.31908679008483887,0.32089754939079285,0.19160838425159454,464.5392150878906,1e-05,0.16836117208003998,3.0156490802764893,81.14050197601318,1 +1439,0.22872275114059448,0.22541543841362,0.23177950084209442,0.1662004590034485,795.030517578125,1e-05,0.17755897343158722,3.134122610092163,81.14050197601318,1 +1440,0.2638010084629059,0.14202328026294708,0.13844428956508636,0.2242424190044403,944.529052734375,1e-05,0.21979644894599915,3.0810391902923584,81.14050197601318,1 +1441,0.19781194627285004,0.29771456122398376,0.27988266944885254,0.2477855533361435,701.6507568359375,1e-05,0.1644626259803772,3.474785804748535,81.14050197601318,1 +1442,0.2243475764989853,0.12453597784042358,0.13008129596710205,0.22331002354621887,740.3775634765625,1e-05,0.1864730566740036,3.116645336151123,81.14050197601318,1 +1443,0.26662755012512207,0.2769635021686554,0.27516913414001465,0.2545454502105713,772.7371215820312,1e-05,0.738252580165863,2.867480754852295,81.14050197601318,1 +1444,0.25295549631118774,0.2505427896976471,0.2433745414018631,0.21212121844291687,789.71923828125,1e-05,0.22809132933616638,3.073984146118164,81.14050197601318,1 +1445,0.2248058021068573,0.37991902232170105,0.39971479773521423,0.1678321659564972,253.83924865722656,1e-05,0.12425169348716736,3.421475410461426,81.14050197601318,1 +1446,0.25200510025024414,0.2001079022884369,0.20827864110469818,0.0951048955321312,972.7406005859375,1e-05,0.15559697151184082,3.112088203430176,81.14050197601318,1 +1447,0.17908883094787598,0.13083826005458832,0.12984751164913177,0.07972028106451035,938.0095825195312,1e-05,0.18470697104930878,3.4199883937835693,81.14050197601318,1 +1448,0.23308569192886353,0.16909568011760712,0.1647326946258545,0.1638694703578949,537.2642211914062,1e-05,0.2093304544687271,3.115199089050293,81.14050197601318,1 +1449,0.12456504255533218,0.33965447545051575,0.331376850605011,0.2097902148962021,981.8353881835938,1e-05,0.1626739799976349,2.8458359241485596,81.14050197601318,1 +1450,0.273433119058609,0.29345938563346863,0.28453749418258667,0.22167831659317017,576.2171630859375,1e-05,0.2867276668548584,3.1082236766815186,81.14050197601318,1 +1451,0.2532869577407837,0.09595493972301483,0.10652408748865128,0.2174825221300125,720.25927734375,1e-05,0.17434243857860565,3.471101999282837,81.14050197601318,1 +1452,0.16875068843364716,0.2918184697628021,0.29773545265197754,0.22610722482204437,956.552734375,1e-05,0.13371776044368744,3.653003454208374,81.14050197601318,1 +1453,0.39456650614738464,0.22339370846748352,0.2164488285779953,0.10862471163272858,461.6126403808594,1e-05,0.19291870296001434,3.177189350128174,81.14050197601318,1 +1454,0.269825279712677,0.3218906819820404,0.32100775837898254,0.10372960567474365,367.8310546875,1e-05,0.14743268489837646,3.044574499130249,81.14050197601318,1 +1455,0.20379871129989624,0.2193162590265274,0.21387608349323273,0.17575757205486298,627.6343994140625,1e-05,0.14859607815742493,2.8503692150115967,81.14050197601318,1 +1456,0.2859523892402649,0.2731959819793701,0.2760627865791321,0.1778554767370224,768.4440307617188,1e-05,0.1335555613040924,3.0672597885131836,81.14050197601318,1 +1457,0.21871677041053772,0.19382762908935547,0.18618029356002808,0.1990675926208496,818.01220703125,1e-05,0.15172594785690308,3.436776638031006,81.14050197601318,1 +1458,0.19393745064735413,0.23642949759960175,0.22800546884536743,0.23496504127979279,901.9290771484375,1e-05,0.1748766452074051,3.1606180667877197,81.14050197601318,1 +1459,0.22723837196826935,0.3522224426269531,0.35841864347457886,0.13286712765693665,971.7196655273438,1e-05,0.19666600227355957,3.1924281120300293,81.14050197601318,1 +1460,0.2975424826145172,0.3699977993965149,0.3503100574016571,0.26200467348098755,982.1359252929688,1e-05,0.15345259010791779,3.097709894180298,81.14050197601318,1 +1461,0.2408631443977356,0.24114352464675903,0.2265467494726181,0.18834498524665833,939.4969482421875,1e-05,0.394798219203949,2.8590312004089355,81.14050197601318,1 +1462,0.14866815507411957,0.2824621796607971,0.26816678047180176,0.21445220708847046,932.8836669921875,1e-05,0.5200892090797424,3.090397834777832,81.14050197601318,1 +1463,0.2758054733276367,0.29373398423194885,0.27564477920532227,0.22960372269153595,941.926025390625,1e-05,0.1427277773618698,3.4274652004241943,81.14050197601318,1 +1464,0.2574104368686676,0.28658556938171387,0.3047245740890503,0.2142191082239151,998.4646606445312,1e-05,0.14847001433372498,3.0894734859466553,81.14050197601318,1 +1465,0.3648720979690552,0.2213306725025177,0.2251100391149521,0.12540791928768158,518.1495361328125,1e-05,0.1451113224029541,3.1595306396484375,81.14050197601318,1 +1466,0.23698844015598297,0.23566733300685883,0.22029444575309753,0.1666666716337204,778.5809936523438,1e-05,0.11219652742147446,3.046678304672241,81.14050197601318,1 +1467,0.27847161889076233,0.19283068180084229,0.18518537282943726,0.15337994694709778,901.9290771484375,1e-05,0.1176106259226799,3.0374488830566406,81.14050197601318,1 +1468,0.26368314027786255,0.3371298015117645,0.32147178053855896,0.23123542964458466,974.9092407226562,1e-05,0.22001385688781738,2.8417608737945557,81.14050197601318,1 +1469,0.286114364862442,0.2670602798461914,0.2577122747898102,0.2074592113494873,832.8609008789062,1e-05,0.29147329926490784,3.367746353149414,81.14050197601318,1 +1470,0.28541135787963867,0.21183885633945465,0.2010907381772995,0.10442890226840973,797.99267578125,1e-05,0.13547293841838837,3.659153938293457,81.14050197601318,1 +1471,0.2051173895597458,0.10627277940511703,0.11683391779661179,0.1090909093618393,975.8905029296875,1e-05,0.3676609396934509,3.143188953399658,81.14050197601318,1 +1472,0.275188684463501,0.1618141382932663,0.15410728752613068,0.2242424190044403,695.4873657226562,1e-05,0.20049750804901123,3.065577745437622,81.14050197601318,1 +1473,0.19264402985572815,0.20561672747135162,0.2099398821592331,0.1822843849658966,882.5809936523438,1e-05,0.20790554583072662,3.049039363861084,81.14050197601318,1 +1474,0.2130073755979538,0.17454706132411957,0.17730548977851868,0.24801865220069885,875.3941650390625,1e-05,0.27599361538887024,3.6788270473480225,81.14050197601318,1 +1475,0.18788649141788483,0.17915499210357666,0.1777157187461853,0.18997669219970703,952.1465454101562,1e-05,0.18395507335662842,3.1346096992492676,81.14050197601318,1 +1476,0.20177306234836578,0.27390801906585693,0.25704720616340637,0.20000000298023224,814.732421875,1e-05,0.2855621874332428,3.1756649017333984,81.14050197601318,1 +1477,0.26939597725868225,0.3118329346179962,0.3159773647785187,0.1326340287923813,932.3563232421875,1e-05,0.22578081488609314,3.147831916809082,81.14050197601318,1 +1478,0.3728518784046173,0.47690823674201965,0.4768790006637573,0.16969697177410126,305.9609069824219,1e-05,0.19640548527240753,3.122143030166626,81.14050197601318,1 +1479,0.2105671763420105,0.2905828356742859,0.2841101586818695,0.10023310035467148,986.9286499023438,1e-05,0.7874501347541809,3.076648473739624,81.14050197601318,1 +1480,0.24522876739501953,0.3323810398578644,0.3377777934074402,0.22470861673355103,982.2857666015625,1e-05,0.2802690863609314,3.1158523559570312,81.14050197601318,1 +1481,0.32775217294692993,0.26107466220855713,0.2611291706562042,0.2790209650993347,336.031982421875,1e-05,0.313556045293808,3.401728630065918,81.14050197601318,1 +1482,0.2201281636953354,0.26803791522979736,0.25757893919944763,0.1930069923400879,492.46246337890625,1e-05,0.15049460530281067,3.5825417041778564,81.14050197601318,1 +1483,0.2744562029838562,0.28467464447021484,0.27717679738998413,0.16456876695156097,702.8627319335938,1e-05,0.14174553751945496,3.338904619216919,81.14050197601318,1 +1484,0.38061806559562683,0.2814204692840576,0.2719383239746094,0.24848484992980957,668.9708251953125,1e-05,0.16088669002056122,2.863158702850342,81.14050197601318,1 +1485,0.21763597428798676,0.06973028928041458,0.07521606236696243,0.20629370212554932,828.0687866210938,1e-05,0.12664879858493805,3.073672294616699,81.14050197601318,1 +1486,0.16516231000423431,0.23861068487167358,0.22783935070037842,0.24242423474788666,939.4969482421875,1e-05,0.4242217242717743,3.0850110054016113,81.14050197601318,1 +1487,0.3044310510158539,0.2401924729347229,0.2344648241996765,0.21398600935935974,892.4525146484375,1e-05,0.2561105191707611,3.3326563835144043,81.14050197601318,1 +1488,0.20794281363487244,0.31329548358917236,0.30407387018203735,0.20442891120910645,989.9591064453125,1e-05,0.2024526596069336,3.4341869354248047,81.14050197601318,1 +1489,0.2423814982175827,0.09985525906085968,0.10442579537630081,0.2310023307800293,852.1741943359375,1e-05,0.13361120223999023,3.3677988052368164,81.14050197601318,1 +1490,0.15679804980754852,0.1771278977394104,0.15942272543907166,0.2501165568828583,905.7181396484375,1e-05,0.7750712633132935,2.844475269317627,81.14050197601318,1 +1491,0.24203172326087952,0.24414892494678497,0.21982330083847046,0.20792540907859802,683.93896484375,1e-05,0.23373323678970337,3.028201103210449,81.14050197601318,1 +1492,0.1193883940577507,0.3926304280757904,0.3877202868461609,0.20652680099010468,964.7545166015625,1e-05,0.13391555845737457,3.119903564453125,81.14050197601318,1 +1493,0.3481464087963104,0.30669859051704407,0.3167491555213928,0.18531468510627747,968.3995361328125,1e-05,0.13644467294216156,3.124907970428467,81.14050197601318,1 +1494,0.2859315574169159,0.367647260427475,0.3470297157764435,0.20839160680770874,946.1489868164062,1e-05,0.22796370089054108,3.403557062149048,81.14050197601318,1 +1495,0.2630052864551544,0.30292263627052307,0.28873419761657715,0.2825174927711487,996.2799072265625,1e-05,0.25224947929382324,3.4005513191223145,81.14050197601318,1 +1496,0.49010467529296875,0.2760935425758362,0.2699529826641083,0.23030303418636322,980.9265747070312,1e-05,0.15123224258422852,2.8615472316741943,81.14050197601318,1 +1497,0.21464300155639648,0.1789100617170334,0.18003614246845245,0.253846138715744,770.1734008789062,1e-05,0.1331908106803894,3.380584239959717,81.14050197601318,1 +1498,0.2788526117801666,0.19993524253368378,0.19061081111431122,0.1538461595773697,824.37353515625,1e-05,0.18397396802902222,3.1268436908721924,81.14050197601318,1 +1499,0.12349928170442581,0.2981891930103302,0.2963176667690277,0.13333334028720856,946.8348388671875,1e-05,0.18652348220348358,3.3905532360076904,81.14050197601318,1 +1500,0.3610372841358185,0.2525303065776825,0.24415947496891022,0.18881118297576904,565.9164428710938,1e-05,0.11946440488100052,3.1765334606170654,81.14050197601318,1 +1501,0.29701441526412964,0.24216610193252563,0.23863618075847626,0.19557109475135803,972.9094848632812,1e-05,0.21062295138835907,3.0996274948120117,81.14050197601318,1 +1502,0.23386166989803314,0.28259938955307007,0.2875782251358032,0.13892774283885956,975.0736083984375,1e-05,0.1348802000284195,3.2946979999542236,81.14050197601318,1 +1503,0.28803688287734985,0.24290482699871063,0.2348630130290985,0.20722611248493195,769.3107299804688,1e-05,0.2367725670337677,2.8237099647521973,81.14050197601318,1 +1504,0.2499198615550995,0.20010878145694733,0.19803622364997864,0.16596736013889313,882.5809936523438,1e-05,0.15304066240787506,3.1212332248687744,81.14050197601318,1 +1505,0.24094168841838837,0.2209775745868683,0.219596728682518,0.2242424190044403,994.0235595703125,1e-05,0.2141289860010147,3.1670849323272705,81.14050197601318,1 +1506,0.2597535252571106,0.1061311885714531,0.12043259292840958,0.22447551786899567,933.1463012695312,1e-05,0.14565974473953247,3.399540901184082,81.14050197601318,1 +1507,0.22537943720817566,0.31393033266067505,0.3050540089607239,0.19324009120464325,327.6654357910156,1e-05,0.16939567029476166,2.8457157611846924,81.14050197601318,1 +1508,0.08983830362558365,0.09853983670473099,0.10907966643571854,0.1850815862417221,764.9352416992188,1e-05,0.12132390588521957,3.25454044342041,81.14050197601318,1 +1509,0.18816804885864258,0.3159082531929016,0.28710535168647766,0.22074592113494873,987.4890747070312,1e-05,0.13136622309684753,2.840045928955078,81.14050197601318,1 +1510,0.2679380774497986,0.09465426951646805,0.10134106874465942,0.14965035021305084,802.3400268554688,1e-05,0.1607220321893692,3.1003103256225586,81.14050197601318,1 +1511,0.1844177097082138,0.16095662117004395,0.16803544759750366,0.22494173049926758,810.7058715820312,1e-05,0.1319194734096527,3.3795504570007324,81.14050197601318,1 +1512,0.16024565696716309,0.31561994552612305,0.30061063170433044,0.14685314893722534,966.2316284179688,1e-05,0.14492326974868774,3.430506944656372,81.14050197601318,1 +1513,0.32247304916381836,0.20153716206550598,0.1975177824497223,0.1918414980173111,783.4415283203125,1e-05,0.1830989122390747,2.852849245071411,81.14050197601318,1 +1514,0.2304542064666748,0.3190794587135315,0.31504106521606445,0.19836829602718353,268.69403076171875,1e-05,0.15302634239196777,3.3742761611938477,81.14050197601318,1 +1515,0.11394175887107849,0.28685319423675537,0.28397855162620544,0.24848484992980957,926.3671875,1e-05,0.14924485981464386,2.8467252254486084,81.14050197601318,1 +1516,0.28548312187194824,0.1629810780286789,0.156869038939476,0.2242424190044403,826.2322387695312,1e-05,0.2174735814332962,3.1173198223114014,81.14050197601318,1 +1517,0.24392569065093994,0.211650550365448,0.20162126421928406,0.2097902148962021,759.5440063476562,1e-05,0.1662442833185196,3.5551135540008545,81.14050197601318,1 +1518,0.23579874634742737,0.2271323949098587,0.22679951786994934,0.20512820780277252,917.2977905273438,1e-05,0.1417492777109146,3.1189470291137695,81.14050197601318,1 +1519,0.2725001573562622,0.22742773592472076,0.22564031183719635,0.285314679145813,658.916015625,1e-05,0.1406690776348114,3.129044532775879,81.14050197601318,1 +1520,0.3058362901210785,0.2162354290485382,0.22459988296031952,0.06340326368808746,301.4790344238281,1e-05,0.19931235909461975,3.141395092010498,81.14050197601318,1 +1521,0.1799095720052719,0.12203502655029297,0.12579719722270966,0.21491841971874237,870.5208129882812,1e-05,0.17522592842578888,2.851393938064575,81.14050197601318,1 +1522,0.25951728224754333,0.2867267429828644,0.28251662850379944,0.17039626836776733,958.3765258789062,1e-05,0.16034522652626038,3.3271889686584473,81.14050197601318,1 +1523,0.31051793694496155,0.30728062987327576,0.3075180947780609,0.16713286936283112,568.0068969726562,1e-05,0.38393181562423706,3.395052194595337,81.14050197601318,1 +1524,0.28633490204811096,0.23290424048900604,0.2279660552740097,0.19813519716262817,586.15087890625,1e-05,0.16309833526611328,3.4071760177612305,81.14050197601318,1 +1525,0.27561986446380615,0.22723065316677094,0.23723594844341278,0.19160838425159454,958.9761352539062,1e-05,0.13857285678386688,3.0628464221954346,81.14050197601318,1 +1526,0.4555678963661194,0.2801770567893982,0.2633931040763855,0.24801865220069885,708.8218383789062,1e-05,0.5245640277862549,3.107761859893799,81.14050197601318,1 +1527,0.2398078590631485,0.17101097106933594,0.17227713763713837,0.21561771631240845,726.8310546875,1e-05,0.18550454080104828,2.8470139503479004,81.14050197601318,1 +1528,0.25082600116729736,0.2651927173137665,0.2700469493865967,0.1442890465259552,709.9939575195312,1e-05,0.13129426538944244,3.1348700523376465,81.14050197601318,1 +1529,0.30898168683052063,0.2627003490924835,0.25736862421035767,0.24522145092487335,625.9617919921875,1e-05,0.156187042593956,3.3836400508880615,81.14050197601318,1 +1530,0.19664856791496277,0.25756269693374634,0.2504662275314331,0.2086247056722641,634.2159423828125,1e-05,0.24036291241645813,3.1609244346618652,81.14050197601318,1 +1531,0.1580321341753006,0.29219698905944824,0.2812759280204773,0.18531468510627747,939.4969482421875,1e-05,0.36922621726989746,3.0868992805480957,81.14050197601318,1 +1532,0.19766417145729065,0.13224169611930847,0.14228492975234985,0.09813519567251205,924.6715087890625,1e-05,0.1892675757408142,3.1400833129882812,81.14050197601318,1 +1533,0.27356967329978943,0.2720995843410492,0.26654163002967834,0.24242423474788666,994.7838134765625,1e-05,0.18896253407001495,2.8478317260742188,81.14050197601318,1 +1534,0.32801195979118347,0.20319607853889465,0.19916819036006927,0.1627039611339569,727.9061279296875,1e-05,0.2455989271402359,3.1578257083892822,81.14050197601318,1 +1535,0.19332674145698547,0.24803470075130463,0.23835013806819916,0.23636363446712494,874.9585571289062,1e-05,0.18042723834514618,3.0480031967163086,81.14050197601318,1 +1536,0.08170193433761597,0.26298853754997253,0.24832455813884735,0.12773892283439636,855.743408203125,1e-05,0.21833264827728271,3.1749703884124756,81.14050197601318,1 +1537,0.25926029682159424,0.20483939349651337,0.20325349271297455,0.2242424190044403,890.15478515625,1e-05,0.1676788330078125,3.2490885257720947,81.14050197601318,1 +1538,0.20980989933013916,0.2258433699607849,0.21859033405780792,0.28951048851013184,812.7318115234375,1e-05,0.30938661098480225,2.8462202548980713,81.14050197601318,1 +1539,0.3173682391643524,0.1257134974002838,0.12721729278564453,0.21212121844291687,781.0278930664062,1e-05,0.14937332272529602,2.8533730506896973,81.14050197601318,1 +1540,0.2259267270565033,0.23991051316261292,0.22953474521636963,0.20372959971427917,961.14013671875,1e-05,0.18064504861831665,3.400546073913574,81.14050197601318,1 +1541,0.25289249420166016,0.48410674929618835,0.4589180648326874,0.23356643319129944,994.4046630859375,1e-05,0.16206233203411102,3.0780720710754395,81.14050197601318,1 +1542,0.33076098561286926,0.11232426762580872,0.11587923020124435,0.128671333193779,668.9708251953125,1e-05,0.17059573531150818,3.0939242839813232,81.14050197601318,1 +1543,0.19959525763988495,0.14166390895843506,0.1619899570941925,0.22400932013988495,995.535888671875,1e-05,0.1522606611251831,3.3953745365142822,81.14050197601318,1 +1544,0.36584189534187317,0.24508747458457947,0.2227550894021988,0.21631701290607452,743.3765869140625,1e-05,0.17700232565402985,2.8470253944396973,81.14050197601318,1 +1545,0.34954747557640076,0.2387659102678299,0.24940252304077148,0.15897436439990997,966.77880859375,1e-05,2.8931546211242676,3.048713207244873,81.14050197601318,1 +1546,0.21282488107681274,0.2146081030368805,0.2081015557050705,0.2097902148962021,505.5683898925781,1e-05,0.22110287845134735,3.3788750171661377,81.14050197601318,1 +1547,0.20741254091262817,0.11984837800264359,0.12630364298820496,0.05944056063890457,937.5089111328125,1e-05,0.18965846300125122,3.1312904357910156,81.14050197601318,1 +1548,0.19202816486358643,0.2518395185470581,0.27208423614501953,0.14965035021305084,668.9708251953125,1e-05,0.19393327832221985,3.12127423286438,81.14050197601318,1 +1549,0.2588127851486206,0.26046615839004517,0.2540780007839203,0.279720276594162,932.0916137695312,1e-05,0.31672799587249756,3.141629934310913,81.14050197601318,1 +1550,0.11695892363786697,0.47573617100715637,0.4600571393966675,0.2242424190044403,981.0787963867188,1e-05,0.15519708395004272,2.8605947494506836,81.14050197601318,1 +1551,0.3810780346393585,0.1930006742477417,0.2114744782447815,0.27599066495895386,390.0654296875,1e-05,0.14841045439243317,3.0850658416748047,81.14050197601318,1 +1552,0.23638084530830383,0.17671962082386017,0.17576700448989868,0.13006992638111115,826.2322387695312,1e-05,0.14474362134933472,3.1400537490844727,81.14050197601318,1 +1553,0.28340432047843933,0.2524312436580658,0.2439289093017578,0.22331002354621887,734.2389526367188,1e-05,0.15358009934425354,3.3682706356048584,81.14050197601318,1 +1554,0.1786738634109497,0.05634119361639023,0.06679447740316391,0.1706293672323227,842.00830078125,1e-05,0.13931842148303986,3.123724937438965,81.14050197601318,1 +1555,0.278757780790329,0.39369919896125793,0.39068591594696045,0.20233100652694702,954.8995971679688,1e-05,0.21518248319625854,3.13879132270813,81.14050197601318,1 +1556,0.2971518933773041,0.13099493086338043,0.14111599326133728,0.22843822836875916,776.9306030273438,1e-05,0.20793084800243378,2.8502864837646484,81.14050197601318,1 +1557,0.1444055140018463,0.23497460782527924,0.23032653331756592,0.18205128610134125,998.1053466796875,1e-05,0.14889435470104218,3.1289825439453125,81.14050197601318,1 +1558,0.20482975244522095,0.4468590021133423,0.4342457354068756,0.2254079282283783,994.27783203125,1e-05,0.1736602485179901,3.1602516174316406,81.14050197601318,1 +1559,0.1779623031616211,0.30846723914146423,0.29683104157447815,0.2097902148962021,984.4981079101562,1e-05,0.15712934732437134,3.4122986793518066,81.14050197601318,1 +1560,0.2774074077606201,0.23330242931842804,0.2254604995250702,0.2557109594345093,868.2445068359375,1e-05,0.2143867462873459,3.200392246246338,81.14050197601318,1 +1561,0.17427849769592285,0.15280787646770477,0.1488395631313324,0.1902097910642624,865.928466796875,1e-05,0.18883882462978363,3.0515687465667725,81.14050197601318,1 +1562,0.1922144889831543,0.23483048379421234,0.22917310893535614,0.16433566808700562,849.5682373046875,1e-05,1.1484774351119995,2.838348388671875,81.14050197601318,1 +1563,0.22964811325073242,0.20844325423240662,0.21491870284080505,0.18321678042411804,997.3809814453125,1e-05,0.1911477893590927,3.431124687194824,81.14050197601318,1 +1564,0.13264256715774536,0.2336554378271103,0.22205199301242828,0.22843822836875916,807.9645385742188,1e-05,0.16517627239227295,3.0672569274902344,81.14050197601318,1 +1565,0.30050480365753174,0.4792627990245819,0.45521432161331177,0.19393938779830933,998.4646606445312,1e-05,0.182915598154068,3.280402660369873,81.14050197601318,1 +1566,0.20931831002235413,0.2714839279651642,0.2856646776199341,0.2041957974433899,953.8506469726562,1e-05,0.3826064467430115,3.0749499797821045,81.14050197601318,1 +1567,0.09520423412322998,0.20651650428771973,0.2120129019021988,0.2421911358833313,981.230712890625,1e-05,0.10713601112365723,3.094669818878174,81.14050197601318,1 +1568,0.27192243933677673,0.27557042241096497,0.2634483277797699,0.17855477333068848,620.8772583007812,1e-05,0.14656709134578705,2.845254898071289,81.14050197601318,1 +1569,0.2734895348548889,0.1723046451807022,0.1612965613603592,0.19813519716262817,776.9306030273438,1e-05,0.2145281881093979,3.405285358428955,81.14050197601318,1 +1570,0.32277223467826843,0.2783980071544647,0.26596707105636597,0.11841491609811783,969.2862548828125,1e-05,0.17878958582878113,3.110001802444458,81.14050197601318,1 +1571,0.2813155949115753,0.17203420400619507,0.17387142777442932,0.2242424190044403,778.5809936523438,1e-05,0.14664646983146667,3.128983974456787,81.14050197601318,1 +1572,0.21263495087623596,0.13321556150913239,0.1351422220468521,0.26247087121009827,865.4603271484375,1e-05,0.6847639083862305,3.0240843296051025,81.14050197601318,1 +1573,0.25292307138442993,0.20474094152450562,0.1876220703125,0.2086247056722641,851.1375732421875,1e-05,0.16867327690124512,3.1426615715026855,81.14050197601318,1 +1574,0.3050767779350281,0.14563269913196564,0.14346416294574738,0.2170163094997406,781.836181640625,1e-05,0.27463966608047485,2.848400354385376,81.14050197601318,1 +1575,0.26889947056770325,0.3299749493598938,0.32389962673187256,0.22634032368659973,953.0025024414062,1e-05,0.1673729419708252,3.3787622451782227,81.14050197601318,1 +1576,0.19208888709545135,0.17296408116817474,0.16705399751663208,0.2198135256767273,883.4002075195312,1e-05,0.1438535898923874,3.6198534965515137,81.14050197601318,1 +1577,0.31393736600875854,0.21089373528957367,0.2045319378376007,0.2142191082239151,851.6567993164062,1e-05,0.1635407954454422,3.0764646530151367,81.14050197601318,1 +1578,0.22850368916988373,0.15695594251155853,0.16427400708198547,0.1678321659564972,961.7210693359375,1e-05,0.2630731165409088,3.0184857845306396,81.14050197601318,1 +1579,0.17924541234970093,0.3522659242153168,0.32508599758148193,0.2405594438314438,958.9761352539062,1e-05,0.12278016656637192,3.140361785888672,81.14050197601318,1 +1580,0.14769668877124786,0.08443813771009445,0.08978371322154999,0.0811188817024231,795.030517578125,1e-05,0.1876441240310669,2.840258836746216,81.14050197601318,1 +1581,0.2919093072414398,0.31738927960395813,0.3088339865207672,0.29673659801483154,976.5382080078125,1e-05,0.18316757678985596,3.116022825241089,81.14050197601318,1 +1582,0.17106963694095612,0.2892143726348877,0.2829194664955139,0.20163169503211975,964.0061645507812,1e-05,0.14835518598556519,3.1410398483276367,81.14050197601318,1 +1583,0.3149380385875702,0.08021856844425201,0.0814187079668045,0.17365966737270355,776.0996704101562,1e-05,0.1558515727519989,3.1073861122131348,81.14050197601318,1 +1584,0.1760505586862564,0.1993761956691742,0.18552497029304504,0.17762237787246704,888.2062377929688,1e-05,0.1944049596786499,3.0685195922851562,81.14050197601318,1 +1585,0.29122936725616455,0.6915507912635803,0.690808892250061,0.06969697028398514,127.0761489868164,1e-05,0.238894984126091,3.0730364322662354,81.14050197601318,1 +1586,0.37487661838531494,0.2723775804042816,0.256070613861084,0.25244754552841187,951.2822265625,1e-05,0.24773606657981873,3.12347412109375,81.14050197601318,1 +1587,0.33798620104789734,0.2660558223724365,0.26580941677093506,0.18857808411121368,532.5975952148438,1e-05,0.6162358522415161,3.1038405895233154,81.14050197601318,1 +1588,0.16654744744300842,0.11229623109102249,0.11729562282562256,0.12424242496490479,695.4873657226562,1e-05,0.268795371055603,3.334993600845337,81.14050197601318,1 +1589,0.1834525763988495,0.33631789684295654,0.3211054503917694,0.2773892879486084,961.334228515625,1e-05,0.14183321595191956,3.343278169631958,81.14050197601318,1 +1590,0.22889524698257446,0.1582265943288803,0.16867412626743317,0.22074592113494873,920.3087768554688,1e-05,0.3456364572048187,2.851473808288574,81.14050197601318,1 +1591,0.27670279145240784,0.17453329265117645,0.17398054897785187,0.20675989985466003,848.5123291015625,1e-05,0.26565536856651306,3.1234633922576904,81.14050197601318,1 +1592,0.1783507913351059,0.40704235434532166,0.39079558849334717,0.1526806503534317,979.0761108398438,1e-05,0.12784214317798615,3.159499168395996,81.14050197601318,1 +1593,0.28416234254837036,0.26057836413383484,0.2533262073993683,0.1515151560306549,570.0819702148438,1e-05,0.3385716378688812,3.114583969116211,81.14050197601318,1 +1594,0.10011286288499832,0.3032512664794922,0.30634188652038574,0.11165501177310944,990.228515625,1e-05,0.39858725666999817,3.4403669834136963,81.14050197601318,1 +1595,0.26769861578941345,0.09336084872484207,0.09776280075311661,0.0839160829782486,874.521484375,1e-05,0.5276674032211304,3.071047067642212,81.14050197601318,1 +1596,0.2145281285047531,0.21494261920452118,0.21688678860664368,0.17925408482551575,977.9759521484375,1e-05,0.18828098475933075,3.1607108116149902,81.14050197601318,1 +1597,0.206026092171669,0.34122005105018616,0.34171369671821594,0.2142191082239151,984.2067260742188,1e-05,0.12568165361881256,2.868152618408203,81.14050197601318,1 +1598,0.33446162939071655,0.21140795946121216,0.2077837884426117,0.2214452177286148,809.341064453125,1e-05,0.1708260327577591,3.0983574390411377,81.14050197601318,1 +1599,0.16216778755187988,0.12117572128772736,0.13325299322605133,0.20209790766239166,801.6233520507812,1e-05,0.28256475925445557,3.135739326477051,81.14050197601318,1 +1600,0.2173403650522232,0.2853880524635315,0.2798980176448822,0.1678321659564972,915.7601928710938,1e-05,0.14511573314666748,3.0988943576812744,81.14050197601318,1 +1601,0.2119097262620926,0.1737041175365448,0.1679856777191162,0.14918415248394012,917.2977905273438,1e-05,0.2763068974018097,3.085442543029785,81.14050197601318,1 +1602,0.30747178196907043,0.4894160330295563,0.48543503880500793,0.21212121844291687,243.64947509765625,1e-05,0.3210349977016449,3.070477247238159,81.14050197601318,1 +1603,0.24764284491539001,0.21649758517742157,0.2052711695432663,0.18531468510627747,824.37353515625,1e-05,0.7856420278549194,2.852304220199585,81.14050197601318,1 +1604,0.16012874245643616,0.44060391187667847,0.42803555727005005,0.2158508151769638,987.7676391601562,1e-05,0.17793811857700348,3.1349732875823975,81.14050197601318,1 +1605,0.08696650713682175,0.29399141669273376,0.2829340696334839,0.23170162737369537,958.576904296875,1e-05,0.15888750553131104,3.143911600112915,81.14050197601318,1 +1606,0.09463094174861908,0.15502062439918518,0.14947634935379028,0.274125874042511,807.9645385742188,1e-05,0.11519592255353928,3.128187656402588,81.14050197601318,1 +1607,0.373106986284256,0.24348895251750946,0.2394113689661026,0.1934731900691986,657.4439697265625,1e-05,0.24898479878902435,3.066241502761841,81.14050197601318,1 +1608,0.22745703160762787,0.2567557394504547,0.2577105164527893,0.07855477929115295,973.2462768554688,1e-05,0.1475100964307785,3.077944755554199,81.14050197601318,1 +1609,0.3064865171909332,0.11162939667701721,0.11669256538152695,0.26876455545425415,788.1709594726562,1e-05,0.2285774052143097,3.152628183364868,81.14050197601318,1 +1610,0.21396276354789734,0.1879989504814148,0.2040097713470459,0.1655011624097824,997.86474609375,1e-05,0.1665152609348297,3.6876707077026367,81.14050197601318,1 +1611,0.12544140219688416,0.2096269279718399,0.19728527963161469,0.1846153885126114,838.0756225585938,1e-05,0.14550882577896118,3.332409143447876,81.14050197601318,1 +1612,0.14868296682834625,0.18620741367340088,0.18267592787742615,0.20722611248493195,785.0322875976562,1e-05,0.13730782270431519,3.333038806915283,81.14050197601318,1 +1613,0.29497408866882324,0.18014349043369293,0.18580850958824158,0.1878787875175476,776.9306030273438,1e-05,0.18696515262126923,3.1019484996795654,81.14050197601318,1 +1614,0.23664230108261108,0.16930821537971497,0.17011192440986633,0.2198135256767273,774.4262084960938,1e-05,0.15548419952392578,3.06553053855896,81.14050197601318,1 +1615,0.15598554909229279,0.27347826957702637,0.26157936453819275,0.2526806592941284,974.7445068359375,1e-05,0.25716060400009155,3.1140999794006348,81.14050197601318,1 +1616,0.12626856565475464,0.23180490732192993,0.23043221235275269,0.20046620070934296,976.69921875,1e-05,0.1221180111169815,3.069862127304077,81.14050197601318,1 +1617,0.22585895657539368,0.2690449655056,0.26492008566856384,0.25757575035095215,502.9901123046875,1e-05,0.15920479595661163,3.3290958404541016,81.14050197601318,1 +1618,0.23476460576057434,0.25578734278678894,0.24115599691867828,0.1762237697839737,917.6026611328125,1e-05,0.2340291291475296,3.3907012939453125,81.14050197601318,1 +1619,0.1727650761604309,0.29372236132621765,0.2768879532814026,0.2722610831260681,989.0084838867188,1e-05,0.111353799700737,2.8587894439697266,81.14050197601318,1 +1620,0.3285122215747833,0.26502725481987,0.2740038335323334,0.20512820780277252,846.3767700195312,1e-05,0.24860535562038422,3.0741612911224365,81.14050197601318,1 +1621,0.25669100880622864,0.10807021707296371,0.10885193943977356,0.12890443205833435,943.3546142578125,1e-05,0.1775042712688446,3.1462018489837646,81.14050197601318,1 +1622,0.2795860469341278,0.3079114258289337,0.2848396897315979,0.20372959971427917,687.85546875,1e-05,0.3920036852359772,3.093127727508545,81.14050197601318,1 +1623,0.12685522437095642,0.24999968707561493,0.24375763535499573,0.20326340198516846,884.2141723632812,1e-05,0.2039853185415268,3.278104543685913,81.14050197601318,1 +1624,0.3817031681537628,0.14999791979789734,0.15042652189731598,0.1655011624097824,553.0419311523438,1e-05,0.21359778940677643,3.3088932037353516,81.14050197601318,1 +1625,0.197576105594635,0.13322748243808746,0.12308507412672043,0.1298368275165558,850.0933227539062,1e-05,3.8431198596954346,2.846280097961426,81.14050197601318,1 +1626,0.1492186039686203,0.2277866005897522,0.21919554471969604,0.18974359333515167,658.916015625,1e-05,0.10883035510778427,3.1060595512390137,81.14050197601318,1 +1627,0.2779867649078369,0.2030627280473709,0.21452192962169647,0.19207459688186646,557.397705078125,1e-05,0.30931106209754944,3.1338930130004883,81.14050197601318,1 +1628,0.2512900233268738,0.19050993025302887,0.19387851655483246,0.12773892283439636,691.7044067382812,1e-05,0.274655818939209,3.114499807357788,81.14050197601318,1 +1629,0.13851003348827362,0.35269778966903687,0.345126748085022,0.1750582754611969,963.0614624023438,1e-05,0.1475379765033722,3.524221897125244,81.14050197601318,1 +1630,0.27003997564315796,0.20332367718219757,0.20339664816856384,0.13123543560504913,727.9061279296875,1e-05,0.15886114537715912,3.1405060291290283,81.14050197601318,1 +1631,0.156018927693367,0.18587979674339294,0.18364468216896057,0.22284382581710815,941.685791015625,1e-05,0.26890045404434204,2.856912612915039,81.14050197601318,1 +1632,0.2735476791858673,0.18924441933631897,0.18022826313972473,0.2545454502105713,893.5853271484375,1e-05,0.16029655933380127,3.0921363830566406,81.14050197601318,1 +1633,0.255602091550827,0.27758949995040894,0.29414525628089905,0.22074592113494873,972.7406005859375,1e-05,0.44994837045669556,3.0778520107269287,81.14050197601318,1 +1634,0.16122500598430634,0.2668072283267975,0.26859718561172485,0.18205128610134125,925.8049926757812,1e-05,0.14075453579425812,3.05954909324646,81.14050197601318,1 +1635,0.07151453197002411,0.24990694224834442,0.2407037764787674,0.21678321063518524,984.3526000976562,1e-05,0.11656646430492401,3.5291850566864014,81.14050197601318,1 +1636,0.2878739833831787,0.28051090240478516,0.2845342755317688,0.24195803701877594,997.7442626953125,1e-05,0.20148876309394836,3.0904927253723145,81.14050197601318,1 +1637,0.1607722043991089,0.2795027196407318,0.2835126221179962,0.22284382581710815,976.3768310546875,1e-05,0.17852085828781128,2.8492884635925293,81.14050197601318,1 +1638,0.29378214478492737,0.20101706683635712,0.20206519961357117,0.11491841822862625,586.15087890625,1e-05,0.17873536050319672,3.1139678955078125,81.14050197601318,1 +1639,0.3634347915649414,0.2761921286582947,0.275237500667572,0.21515151858329773,591.9431762695312,1e-05,0.2311723232269287,3.082214832305908,81.14050197601318,1 +1640,0.12698721885681152,0.3035227954387665,0.3137226998806,0.14405594766139984,989.1450805664062,1e-05,0.21303071081638336,3.064199686050415,81.14050197601318,1 +1641,0.24020029604434967,0.49604249000549316,0.4432767927646637,0.19650349020957947,993.5120239257812,1e-05,0.16695864498615265,3.4004149436950684,81.14050197601318,1 +1642,0.2480320930480957,0.13889501988887787,0.14391514658927917,0.11118881404399872,863.0953369140625,1e-05,0.12281984835863113,2.8468143939971924,81.14050197601318,1 +1643,0.37122875452041626,0.4757171869277954,0.4700077772140503,0.1627039611339569,258.84716796875,1e-05,0.13986651599407196,3.047250509262085,81.14050197601318,1 +1644,0.2749151587486267,0.388022243976593,0.3803751468658447,0.25314685702323914,283.0556640625,1e-05,0.5106121897697449,2.854144811630249,81.14050197601318,1 +1645,0.21157780289649963,0.22760532796382904,0.21773073077201843,0.2666666805744171,804.4718627929688,1e-05,0.2876673936843872,3.0749452114105225,81.14050197601318,1 +1646,0.22073903679847717,0.26624301075935364,0.2435631901025772,0.2410256415605545,862.1375732421875,1e-05,0.15164928138256073,3.097264051437378,81.14050197601318,1 +1647,0.2193990796804428,0.2436603158712387,0.24297533929347992,0.1230769231915474,960.7506713867188,1e-05,0.23031803965568542,3.4232325553894043,81.14050197601318,1 +1648,0.2480350136756897,0.2148800641298294,0.20815449953079224,0.26853147149086,916.6853637695312,1e-05,0.23971892893314362,2.8461005687713623,81.14050197601318,1 +1649,0.196069598197937,0.14763931930065155,0.14818289875984192,0.17972028255462646,816.0525512695312,1e-05,0.22059866786003113,3.046257734298706,81.14050197601318,1 +1650,0.25506359338760376,0.27366435527801514,0.2584274411201477,0.23752914369106293,689.1459350585938,1e-05,0.1375589668750763,2.846599817276001,81.14050197601318,1 +1651,0.1453840583562851,0.13818290829658508,0.12346804141998291,0.17272727191448212,940.961669921875,1e-05,0.23172247409820557,3.2750070095062256,81.14050197601318,1 +1652,0.2177325040102005,0.2404320389032364,0.23902294039726257,0.14522144198417664,874.521484375,1e-05,0.15404918789863586,3.1015625,81.14050197601318,1 +1653,0.33215048909187317,0.3016572594642639,0.2931170165538788,0.21561771631240845,898.011962890625,1e-05,0.1766003966331482,3.539804458618164,81.14050197601318,1 +1654,0.3224719166755676,0.1624678671360016,0.17865295708179474,0.15571095049381256,939.2506103515625,1e-05,0.13019756972789764,2.842984914779663,81.14050197601318,1 +1655,0.28929680585861206,0.46018221974372864,0.42942455410957336,0.2461538463830948,991.1632080078125,1e-05,0.17411331832408905,3.104865074157715,81.14050197601318,1 +1656,0.1830165684223175,0.3697268068790436,0.3792150020599365,0.2114219069480896,200.4163818359375,1e-05,0.11279849708080292,2.844026803970337,81.14050197601318,1 +1657,0.1785449981689453,0.14259666204452515,0.1426769644021988,0.16993007063865662,668.9708251953125,1e-05,0.13919295370578766,3.287524461746216,81.14050197601318,1 +1658,0.38913628458976746,0.3043175935745239,0.2891973853111267,0.2186480164527893,982.8820190429688,1e-05,0.20124344527721405,3.090867042541504,81.14050197601318,1 +1659,0.2925891876220703,0.1926553100347519,0.18667367100715637,0.24079254269599915,904.0114135742188,1e-05,0.12918460369110107,3.5249016284942627,81.14050197601318,1 +1660,0.19419436156749725,0.5836217999458313,0.5779764652252197,0.2694638669490814,989.6887817382812,1e-05,0.1297539621591568,2.8500895500183105,81.14050197601318,1 +1661,0.36642321944236755,0.3533511757850647,0.34395354986190796,0.29720279574394226,484.3331604003906,1e-05,0.17197711765766144,3.189459800720215,81.14050197601318,1 +1662,0.11049466580152512,0.18342015147209167,0.1727839708328247,0.13286712765693665,890.9254760742188,1e-05,0.1631660759449005,2.8602216243743896,81.14050197601318,1 +1663,0.22592556476593018,0.383755624294281,0.39001205563545227,0.26247087121009827,319.1216125488281,1e-05,0.4198015332221985,3.3250608444213867,81.14050197601318,1 +1664,0.21975712478160858,0.40231508016586304,0.37979409098625183,0.22750583291053772,996.0327758789062,1e-05,0.20507629215717316,3.070565700531006,81.14050197601318,1 +1665,0.27934104204177856,0.35544267296791077,0.3494674861431122,0.214685320854187,987.2093505859375,1e-05,0.13110752403736115,3.5132815837860107,81.14050197601318,1 +1666,0.27696651220321655,0.3537687659263611,0.3338632881641388,0.23613053560256958,976.0529174804688,1e-05,0.15458671748638153,2.855712890625,81.14050197601318,1 +1667,0.4525874853134155,0.34575873613357544,0.35128942131996155,0.19090908765792847,340.1504821777344,1e-05,0.4940268099308014,3.1890060901641846,81.14050197601318,1 +1668,0.19182482361793518,0.33427679538726807,0.3027225136756897,0.26759907603263855,950.4097290039062,1e-05,0.1407221555709839,2.851229190826416,81.14050197601318,1 +1669,0.22596637904644012,0.28302881121635437,0.27237603068351746,0.25081583857536316,999.9999389648438,1e-05,0.34193530678749084,3.15701961517334,81.14050197601318,1 +1670,0.29228484630584717,0.31902623176574707,0.3075771927833557,0.2242424190044403,722.4732666015625,1e-05,0.16819195449352264,3.345526933670044,81.14050197601318,1 +1671,0.3773053288459778,0.199996680021286,0.21910825371742249,0.22191141545772552,997.6233520507812,1e-05,0.9401118159294128,3.3935184478759766,81.14050197601318,1 +1672,0.0781051367521286,0.30442455410957336,0.2978461682796478,0.139860138297081,931.56005859375,1e-05,0.10679178684949875,2.859165906906128,81.14050197601318,1 +1673,0.28101596236228943,0.18421591818332672,0.18054990470409393,0.13333334028720856,904.354736328125,1e-05,0.13153530657291412,3.123173952102661,81.14050197601318,1 +1674,0.2892009913921356,0.34791210293769836,0.3511344790458679,0.1822843849658966,982.7333984375,1e-05,0.1817883849143982,3.134549617767334,81.14050197601318,1 +1675,0.29493239521980286,0.2433195412158966,0.23985400795936584,0.09440559148788452,557.397705078125,1e-05,0.16404075920581818,3.088697910308838,81.14050197601318,1 +1676,0.2258264720439911,0.35064607858657837,0.33976975083351135,0.1571095585823059,945.9192504882812,1e-05,0.20696623623371124,3.324465751647949,81.14050197601318,1 +1677,0.1566038727760315,0.28296923637390137,0.2605275511741638,0.2846153974533081,971.7196655273438,1e-05,0.13532021641731262,3.1686184406280518,81.14050197601318,1 +1678,0.25556856393814087,0.2134777158498764,0.1949051171541214,0.16969697177410126,992.8673706054688,1e-05,0.12316950410604477,2.8528900146484375,81.14050197601318,1 +1679,0.13742610812187195,0.24568144977092743,0.2541077733039856,0.20326340198516846,752.1058349609375,1e-05,0.1408727616071701,3.1626830101013184,81.14050197601318,1 +1680,0.30259969830513,0.19708986580371857,0.19113455712795258,0.27435898780822754,821.8599853515625,1e-05,0.11335577070713043,3.046231508255005,81.14050197601318,1 +1681,0.3571208119392395,0.24079672992229462,0.23601874709129333,0.18764568865299225,958.7767944335938,1e-05,10.182343482971191,3.4035308361053467,81.14050197601318,1 +1682,0.12379494309425354,0.17429549992084503,0.1656823754310608,0.24358974397182465,920.0114135742188,1e-05,0.2340472787618637,3.125653028488159,81.14050197601318,1 +1683,0.2552441954612732,0.18412847816944122,0.19244064390659332,0.21072261035442352,920.0114135742188,1e-05,0.7998040318489075,3.2518198490142822,81.14050197601318,1 +1684,0.23751486837863922,0.14771950244903564,0.14485976099967957,0.25314685702323914,930.488525390625,1e-05,0.1811424195766449,3.098947763442993,81.14050197601318,1 +1685,0.18923763930797577,0.2368467003107071,0.23124417662620544,0.2265734225511551,976.8599853515625,1e-05,0.15256071090698242,2.844541549682617,81.14050197601318,1 +1686,0.16272450983524323,0.17956803739070892,0.19003117084503174,0.12237761914730072,987.6286010742188,1e-05,0.15615209937095642,3.148855209350586,81.14050197601318,1 +1687,0.27498966455459595,0.28358542919158936,0.26911401748657227,0.17552447319030762,902.2786865234375,1e-05,0.22793427109718323,3.134840965270996,81.14050197601318,1 +1688,0.20831194519996643,0.23740161955356598,0.2191915363073349,0.10489510744810104,966.2316284179688,1e-05,0.15627421438694,3.1423499584198,81.14050197601318,1 +1689,0.4114149212837219,0.17072850465774536,0.16860680282115936,0.1906759887933731,792.7744140625,1e-05,0.16549722850322723,3.079681158065796,81.14050197601318,1 +1690,0.2913106679916382,0.24698340892791748,0.24502545595169067,0.1862470805644989,523.0420532226562,1e-05,0.10729191452264786,3.1513097286224365,81.14050197601318,1 +1691,0.3656153082847595,0.27741625905036926,0.2670004665851593,0.19207459688186646,872.3140258789062,1e-05,0.20050840079784393,2.8615305423736572,81.14050197601318,1 +1692,0.2856154441833496,0.2455253154039383,0.22103413939476013,0.2773892879486084,914.8272094726562,1e-05,0.13219715654850006,3.1520159244537354,81.14050197601318,1 +1693,0.21727851033210754,0.22205811738967896,0.22564035654067993,0.15757575631141663,984.7882080078125,1e-05,0.22144007682800293,3.1160683631896973,81.14050197601318,1 +1694,0.30807018280029297,0.26877710223197937,0.25328755378723145,0.25757575035095215,541.85888671875,1e-05,0.1623719334602356,3.1805996894836426,81.14050197601318,1 +1695,0.28139135241508484,0.266178697347641,0.24702641367912292,0.15804195404052734,981.0787963867188,1e-05,0.14774078130722046,3.144869327545166,81.14050197601318,1 +1696,0.17909462749958038,0.16488903760910034,0.17354194819927216,0.21958041191101074,795.030517578125,1e-05,0.20239782333374023,3.0741069316864014,81.14050197601318,1 +1697,0.3850059509277344,0.15431030094623566,0.16143904626369476,0.2125874161720276,404.18499755859375,1e-05,0.14372719824314117,2.852684497833252,81.14050197601318,1 +1698,0.36903318762779236,0.22243770956993103,0.21802030503749847,0.16363635659217834,914.5143432617188,1e-05,0.1541662961244583,3.32352876663208,81.14050197601318,1 +1699,0.22682148218154907,0.16399714350700378,0.16356617212295532,0.26806527376174927,958.9761352539062,1e-05,0.11480282992124557,3.12786602973938,81.14050197601318,1 +1700,0.27567678689956665,0.27441641688346863,0.2749306261539459,0.20629370212554932,981.0787963867188,1e-05,0.14410057663917542,3.2002482414245605,81.14050197601318,1 +1701,0.25535526871681213,0.28086403012275696,0.26416897773742676,0.2293706238269806,978.6064453125,1e-05,0.25461021065711975,2.8518142700195312,81.14050197601318,1 +1702,0.268213152885437,0.281947523355484,0.2773606777191162,0.16969697177410126,452.67730712890625,1e-05,0.2445431500673294,3.0936667919158936,81.14050197601318,1 +1703,0.301384299993515,0.22859713435173035,0.22452986240386963,0.2449883371591568,749.2398071289062,1e-05,0.13237465918064117,2.8418703079223633,81.14050197601318,1 +1704,0.18113061785697937,0.16427314281463623,0.15787650644779205,0.09557109326124191,888.2062377929688,1e-05,0.12442818284034729,3.41698956489563,81.14050197601318,1 +1705,0.11472886800765991,0.37441590428352356,0.37966489791870117,0.1794871836900711,988.0452880859375,1e-05,1.049489140510559,3.0291106700897217,81.14050197601318,1 +1706,0.20220673084259033,0.13114038109779358,0.11566812545061111,0.1319347321987152,683.93896484375,1e-05,0.14143969118595123,4.599318742752075,81.14050197601318,1 +1707,0.27960753440856934,0.19967637956142426,0.18607960641384125,0.21212121844291687,980.1610107421875,1e-05,0.16251018643379211,3.0541958808898926,81.14050197601318,1 +1708,0.38537460565567017,0.25712719559669495,0.2470412701368332,0.1766899824142456,523.0420532226562,1e-05,0.12178454548120499,2.849487781524658,81.14050197601318,1 +1709,0.2587011456489563,0.23743529617786407,0.22592660784721375,0.2501165568828583,954.271728515625,1e-05,0.15723231434822083,3.1647396087646484,81.14050197601318,1 +1710,0.23309214413166046,0.2594391405582428,0.24600061774253845,0.21002331376075745,933.1463012695312,1e-05,0.1390567421913147,3.1396803855895996,81.14050197601318,1 +1711,0.20583152770996094,0.28950533270835876,0.27474114298820496,0.2181818187236786,593.8468017578125,1e-05,0.11577806621789932,3.0455899238586426,81.14050197601318,1 +1712,0.15458376705646515,0.2920839190483093,0.2766645550727844,0.2769230902194977,947.5157470703125,1e-05,0.1648440957069397,3.6969306468963623,81.14050197601318,1 +1713,0.28461208939552307,0.21696388721466064,0.21324142813682556,0.16853146255016327,625.9617919921875,1e-05,0.13331297039985657,3.0781524181365967,81.14050197601318,1 +1714,0.14658154547214508,0.0969347134232521,0.10057812929153442,0.09487179666757584,857.74267578125,1e-05,0.12436778098344803,2.858844757080078,81.14050197601318,1 +1715,0.21342499554157257,0.2658690810203552,0.2695200443267822,0.21398600935935974,894.70751953125,1e-05,0.18058934807777405,3.115180253982544,81.14050197601318,1 +1716,0.1695156991481781,0.5221766233444214,0.5278030037879944,0.18811188638210297,997.86474609375,1e-05,0.21221917867660522,3.0671536922454834,81.14050197601318,1 +1717,0.326106995344162,0.23410016298294067,0.23016801476478577,0.2181818187236786,929.9484252929688,1e-05,0.21903404593467712,3.3189170360565186,81.14050197601318,1 +1718,0.22629645466804504,0.3310197591781616,0.3163611888885498,0.13216783106327057,983.0303955078125,1e-05,0.20551586151123047,3.2809770107269287,81.14050197601318,1 +1719,0.22224082052707672,0.23710201680660248,0.24137365818023682,0.08181817829608917,981.230712890625,1e-05,0.11967679858207703,3.1113016605377197,81.14050197601318,1 +1720,0.3402596712112427,0.28259527683258057,0.2833433449268341,0.22773893177509308,968.57763671875,1e-05,0.1472271829843521,2.8460566997528076,81.14050197601318,1 +1721,0.2098110020160675,0.2689034640789032,0.26348477602005005,0.1918414980173111,998.7031860351562,1e-05,0.11960726976394653,3.1317267417907715,81.14050197601318,1 +1722,0.2746683359146118,0.19747382402420044,0.19569599628448486,0.19510489702224731,897.28564453125,1e-05,0.24539901316165924,3.1040236949920654,81.14050197601318,1 +1723,0.17136095464229584,0.1348830908536911,0.1315266191959381,0.24428904056549072,870.0686645507812,1e-05,0.15717650949954987,3.2950868606567383,81.14050197601318,1 +1724,0.23869910836219788,0.2757517993450165,0.25730806589126587,0.2421911358833313,725.7503051757812,1e-05,0.14634253084659576,3.3091022968292236,81.14050197601318,1 +1725,0.22279220819473267,0.27136579155921936,0.2516050338745117,0.23356643319129944,863.5715942382812,1e-05,0.4529908001422882,3.096264362335205,81.14050197601318,1 +1726,0.42763751745224,0.30628159642219543,0.29900121688842773,0.20606060326099396,523.0420532226562,1e-05,0.13134202361106873,2.844611644744873,81.14050197601318,1 +1727,0.2426040917634964,0.20296362042427063,0.211095929145813,0.2801864743232727,880.926025390625,1e-05,0.14141516387462616,3.4462525844573975,81.14050197601318,1 +1728,0.2043757438659668,0.22215791046619415,0.21355558931827545,0.25361305475234985,861.1730346679688,1e-05,0.1933218538761139,2.854125499725342,81.14050197601318,1 +1729,0.29965946078300476,0.3080191910266876,0.3134865164756775,0.2533799409866333,997.9851684570312,1e-05,0.17962898313999176,3.241891860961914,81.14050197601318,1 +1730,0.1558401882648468,0.18656866252422333,0.17687247693538666,0.10396270453929901,835.2010498046875,1e-05,0.12597337365150452,3.0535783767700195,81.14050197601318,1 +1731,0.17981097102165222,0.3634469211101532,0.3406311273574829,0.25407925248146057,868.2445068359375,1e-05,0.14556850492954254,3.114788293838501,81.14050197601318,1 +1732,0.17159953713417053,0.13892124593257904,0.14182448387145996,0.21561771631240845,864.0462646484375,1e-05,0.10568727552890778,2.852550983428955,81.14050197601318,1 +1733,0.22622019052505493,0.15022729337215424,0.14912882447242737,0.2543123662471771,702.8627319335938,1e-05,0.12273690104484558,3.4181535243988037,81.14050197601318,1 +1734,0.38603776693344116,0.10817474871873856,0.11537906527519226,0.238228440284729,696.7341918945312,1e-05,0.15189626812934875,2.8468337059020996,81.14050197601318,1 +1735,0.228176087141037,0.2381150871515274,0.23085123300552368,0.21491841971874237,639.041015625,1e-05,0.1341123729944229,3.5424609184265137,81.14050197601318,1 +1736,0.4574567377567291,0.29343846440315247,0.289420485496521,0.23030303418636322,375.388671875,1e-05,0.21116690337657928,3.078974962234497,81.14050197601318,1 +1737,0.22382694482803345,0.3410937190055847,0.3427142798900604,0.21561771631240845,997.259521484375,1e-05,0.1454697549343109,3.1232926845550537,81.14050197601318,1 +1738,0.3837616443634033,0.23540465533733368,0.22973933815956116,0.21095570921897888,580.2335815429688,1e-05,0.1684923619031906,2.850442409515381,81.14050197601318,1 +1739,0.4703983962535858,0.22950409352779388,0.22323478758335114,0.22797203063964844,778.5809936523438,1e-05,0.18726709485054016,3.390470504760742,81.14050197601318,1 +1740,0.1859804391860962,0.2952961027622223,0.2985011637210846,0.24242423474788666,963.818115234375,1e-05,0.44667696952819824,2.8502445220947266,81.14050197601318,1 +1741,0.3221127688884735,0.29281941056251526,0.2946021258831024,0.2230769246816635,981.5336303710938,1e-05,0.13541370630264282,3.6899266242980957,81.14050197601318,1 +1742,0.1748747080564499,0.3095407783985138,0.3038536012172699,0.1375291347503662,988.18359375,1e-05,0.12532643973827362,3.3688926696777344,81.14050197601318,1 +1743,0.4908924698829651,0.3354170024394989,0.37076225876808167,0.2282051295042038,233.2209930419922,1e-05,0.1454077512025833,2.8558690547943115,81.14050197601318,1 +1744,0.26862937211990356,0.2710760831832886,0.2539360225200653,0.2426573485136032,823.121826171875,1e-05,0.17012952268123627,3.065248489379883,81.14050197601318,1 +1745,0.12091538310050964,0.1784428209066391,0.18399162590503693,0.151048943400383,696.7341918945312,1e-05,0.10753291100263596,3.0809617042541504,81.14050197601318,1 +1746,0.17588171362876892,0.15251559019088745,0.15019525587558746,0.15734265744686127,936.7528076171875,1e-05,0.13928838074207306,3.0662412643432617,81.14050197601318,1 +1747,0.4536422789096832,0.29857227206230164,0.29390573501586914,0.21212121844291687,473.1681213378906,1e-05,0.18485145270824432,3.352660655975342,81.14050197601318,1 +1748,0.22628049552440643,0.2417294681072235,0.24087069928646088,0.22167831659317017,980.3147583007812,1e-05,0.15006838738918304,3.1238646507263184,81.14050197601318,1 +1749,0.2992517352104187,0.25770947337150574,0.2414836585521698,0.232634037733078,943.8261108398438,1e-05,0.17370060086250305,2.859592914581299,81.14050197601318,1 +1750,0.27901461720466614,0.32720091938972473,0.31412193179130554,0.2170163094997406,960.1631469726562,1e-05,0.15196271240711212,3.1114931106567383,81.14050197601318,1 +1751,0.2590750753879547,0.2743282914161682,0.2584361732006073,0.23193472623825073,694.233642578125,1e-05,0.15085521340370178,3.0989701747894287,81.14050197601318,1 +1752,0.13956162333488464,0.13887667655944824,0.13434657454490662,0.2046620100736618,807.9645385742188,1e-05,0.16022750735282898,3.100398540496826,81.14050197601318,1 +1753,0.09565016627311707,0.27540844678878784,0.2642267346382141,0.1890442818403244,978.6064453125,1e-05,0.5179336667060852,3.3084795475006104,81.14050197601318,1 +1754,0.07758993655443192,0.4532683193683624,0.44026505947113037,0.274125874042511,993.383544921875,1e-05,0.15065458416938782,3.0705158710479736,81.14050197601318,1 +1755,0.2765357494354248,0.1685512810945511,0.17045444250106812,0.23729602992534637,934.449462890625,1e-05,0.15281668305397034,2.8326101303100586,81.14050197601318,1 +1756,0.3410584628582001,0.1997697353363037,0.18824534118175507,0.21398600935935974,802.3400268554688,1e-05,0.15806512534618378,3.121868848800659,81.14050197601318,1 +1757,0.1239355206489563,0.3241960406303406,0.31816965341567993,0.25081583857536316,941.685791015625,1e-05,0.11825983226299286,3.0782065391540527,81.14050197601318,1 +1758,0.19720101356506348,0.3242010176181793,0.313106894493103,0.21282051503658295,920.9009399414062,1e-05,0.23409578204154968,3.4564735889434814,81.14050197601318,1 +1759,0.17537249624729156,0.4055006504058838,0.3896437883377075,0.19277389347553253,379.11187744140625,1e-05,0.1775728017091751,3.1169304847717285,81.14050197601318,1 +1760,0.21546955406665802,0.20136918127536774,0.19115638732910156,0.23962703347206116,843.6619262695312,1e-05,0.13915890455245972,3.119438409805298,81.14050197601318,1 +1761,0.17205241322517395,0.14078174531459808,0.147530660033226,0.19557109475135803,931.025634765625,1e-05,0.13061995804309845,2.8504295349121094,81.14050197601318,1 +1762,0.18049034476280212,0.25339579582214355,0.2407524734735489,0.1610722541809082,884.2141723632812,1e-05,0.16743023693561554,3.1172235012054443,81.14050197601318,1 +1763,0.2188069075345993,0.2828907370567322,0.2777291238307953,0.17855477333068848,892.831298828125,1e-05,0.1480921357870102,3.132355213165283,81.14050197601318,1 +1764,0.17959968745708466,0.2170240432024002,0.234293594956398,0.23053613305091858,970.8588256835938,1e-05,0.15362298488616943,3.3958287239074707,81.14050197601318,1 +1765,0.19345210492610931,0.30405399203300476,0.297864705324173,0.2170163094997406,939.2506103515625,1e-05,0.20202922821044922,3.384880542755127,81.14050197601318,1 +1766,0.21710968017578125,0.24553415179252625,0.24889196455478668,0.20000000298023224,584.1925659179688,1e-05,0.20137716829776764,2.8339016437530518,81.14050197601318,1 +1767,0.36461007595062256,0.3288944959640503,0.3318060636520386,0.19836829602718353,954.0613403320312,1e-05,0.17619207501411438,2.8395421504974365,81.14050197601318,1 +1768,0.2886044681072235,0.32445526123046875,0.3282814919948578,0.2254079282283783,995.7847900390625,1e-05,0.21099257469177246,3.09908390045166,81.14050197601318,1 +1769,0.2490386813879013,0.3219439685344696,0.3109951317310333,0.22074592113494873,500.3907775878906,1e-05,0.12207096070051193,3.0536646842956543,81.14050197601318,1 +1770,0.2729564905166626,0.22920724749565125,0.22251440584659576,0.2186480164527893,911.6586303710938,1e-05,0.11061032116413116,3.4066507816314697,81.14050197601318,1 +1771,0.13597619533538818,0.2735975682735443,0.2784164249897003,0.21048951148986816,998.1053466796875,1e-05,0.1318281590938568,3.262491226196289,81.14050197601318,1 +1772,0.2111285924911499,1.0133651494979858,1.0055828094482422,0.22634032368659973,999.2957763671875,1e-05,0.1584337055683136,2.8442866802215576,81.14050197601318,1 +1773,0.4298510253429413,0.19906213879585266,0.19185665249824524,0.23076923191547394,756.7888793945312,1e-05,0.1682761311531067,2.848604202270508,81.14050197601318,1 +1774,0.2103101760149002,0.2686222493648529,0.24857139587402344,0.2321678251028061,872.3140258789062,1e-05,0.19492927193641663,3.099919557571411,81.14050197601318,1 +1775,0.2847694158554077,0.2507007122039795,0.25296759605407715,0.20629370212554932,642.2061767578125,1e-05,0.16631442308425903,3.2901434898376465,81.14050197601318,1 +1776,0.16988393664360046,0.36165356636047363,0.3595314025878906,0.15641026198863983,340.1504821777344,1e-05,0.221311554312706,3.2110488414764404,81.14050197601318,1 +1777,0.2524109184741974,0.2518949806690216,0.23747272789478302,0.19813519716262817,975.2377319335938,1e-05,0.11385320872068405,3.3064095973968506,81.14050197601318,1 +1778,0.21663808822631836,0.30400004982948303,0.2901241183280945,0.23519814014434814,942.4046020507812,1e-05,0.164755716919899,2.8571417331695557,81.14050197601318,1 +1779,0.14052966237068176,0.24551451206207275,0.22989106178283691,0.225874125957489,862.1375732421875,1e-05,0.15365585684776306,3.129998207092285,81.14050197601318,1 +1780,0.21028533577919006,0.2922356128692627,0.2840646803379059,0.19487179815769196,715.7589111328125,1e-05,1.5924429893493652,3.0481135845184326,81.14050197601318,1 +1781,0.20019565522670746,0.2429904341697693,0.22353893518447876,0.1902097910642624,877.97705078125,1e-05,0.16188029944896698,3.0806314945220947,81.14050197601318,1 +1782,0.26332888007164,0.22842730581760406,0.20762981474399567,0.21212121844291687,879.2493286132812,1e-05,0.16437791287899017,3.5044515132904053,81.14050197601318,1 +1783,0.18310469388961792,0.3143458962440491,0.29079335927963257,0.17132866382598877,492.46246337890625,1e-05,0.23875965178012848,3.0415947437286377,81.14050197601318,1 +1784,0.22332538664340973,0.2965775430202484,0.274781733751297,0.19696970283985138,867.3228149414062,1e-05,0.1907137930393219,2.846250534057617,81.14050197601318,1 +1785,0.22053992748260498,0.2274252027273178,0.2215394824743271,0.18205128610134125,615.6897583007812,1e-05,0.17349554598331451,3.1153416633605957,81.14050197601318,1 +1786,0.3121550381183624,0.2941237688064575,0.2768552005290985,0.20512820780277252,833.4493408203125,1e-05,0.19574664533138275,3.075660228729248,81.14050197601318,1 +1787,0.27598923444747925,0.17777244746685028,0.19029542803764343,0.23449882864952087,964.940673828125,1e-05,0.12433336675167084,3.3537094593048096,81.14050197601318,1 +1788,0.23612797260284424,0.3207065463066101,0.2983287274837494,0.2230769246816635,955.523193359375,1e-05,0.209807887673378,3.2031760215759277,81.14050197601318,1 +1789,0.14134790003299713,0.17184709012508392,0.15992245078086853,0.24592074751853943,910.6900634765625,1e-05,0.8890732526779175,3.095444917678833,81.14050197601318,1 +1790,0.19276408851146698,0.2710689604282379,0.2560097277164459,0.2710955739021301,911.0138549804688,1e-05,0.15359972417354584,2.8606667518615723,81.14050197601318,1 +1791,0.16934216022491455,0.19759924709796906,0.184830442070961,0.08741258829832077,728.9754028320312,1e-05,0.15545041859149933,3.0491559505462646,81.14050197601318,1 +1792,0.23279881477355957,0.29405874013900757,0.29217997193336487,0.24452213943004608,985.6517944335938,1e-05,0.19775894284248352,3.076380491256714,81.14050197601318,1 +1793,0.19397975504398346,0.16396626830101013,0.1664760261774063,0.21561771631240845,758.630126953125,1e-05,0.17532993853092194,3.305028200149536,81.14050197601318,1 +1794,0.2730482518672943,0.18037737905979156,0.1742393970489502,0.15524475276470184,890.9254760742188,1e-05,0.22532571852207184,3.3900628089904785,81.14050197601318,1 +1795,0.25260910391807556,0.2873019576072693,0.2828589975833893,0.23752914369106293,630.94677734375,1e-05,0.18856662511825562,3.153301954269409,81.14050197601318,1 +1796,0.3293342590332031,0.12574556469917297,0.12392881512641907,0.23030303418636322,818.01220703125,1e-05,0.17946410179138184,2.8410263061523438,81.14050197601318,1 +1797,0.27713286876678467,0.10041783004999161,0.11674022674560547,0.18251748383045197,923.8132934570312,1e-05,0.17456601560115814,3.064258337020874,81.14050197601318,1 +1798,0.23727735877037048,0.23241612315177917,0.22127944231033325,0.19930069148540497,925.8049926757812,1e-05,0.16411709785461426,3.083250045776367,81.14050197601318,1 +1799,0.20536266267299652,0.2233983427286148,0.22595646977424622,0.17995338141918182,969.6383056640625,1e-05,0.1237105131149292,3.437730312347412,81.14050197601318,1 +1800,0.26571494340896606,0.3092196583747864,0.29259029030799866,0.2097902148962021,908.0657348632812,1e-05,0.10927528887987137,3.6510114669799805,81.14050197601318,1 +1801,0.19942428171634674,0.19388695061206818,0.18770849704742432,0.1906759887933731,883.4002075195312,1e-05,0.18203282356262207,3.142181158065796,81.14050197601318,1 +1802,0.1636984795331955,0.17595696449279785,0.1922304332256317,0.13892774283885956,948.6395874023438,1e-05,0.2953757047653198,2.853036642074585,81.14050197601318,1 +1803,0.27945658564567566,0.14296942949295044,0.13643795251846313,0.2354312390089035,839.2100219726562,1e-05,0.1224508211016655,3.114020824432373,81.14050197601318,1 +1804,0.309222936630249,0.17813070118427277,0.17312705516815186,0.2433566451072693,679.9532470703125,1e-05,0.16075390577316284,3.0800814628601074,81.14050197601318,1 +1805,0.37826108932495117,0.2593948543071747,0.25078442692756653,0.19254079461097717,639.041015625,1e-05,0.1432386189699173,3.5793166160583496,81.14050197601318,1 +1806,0.22275365889072418,0.11576772481203079,0.11689150333404541,0.15058274567127228,679.9532470703125,1e-05,0.12941567599773407,3.3009960651397705,81.14050197601318,1 +1807,0.23004089295864105,0.15414783358573914,0.14380885660648346,0.15407925844192505,952.5755615234375,1e-05,0.09973502904176712,3.0639965534210205,81.14050197601318,1 +1808,0.161395862698555,0.25313040614128113,0.232162743806839,0.19230769574642181,918.2099609375,1e-05,0.19174925982952118,2.8474693298339844,81.14050197601318,1 +1809,0.12939128279685974,0.16043852269649506,0.15555506944656372,0.21351981163024902,945.68896484375,1e-05,0.1644926220178604,3.040431261062622,81.14050197601318,1 +1810,0.3479784429073334,0.13690263032913208,0.13327087461948395,0.07738927751779556,697.9737548828125,1e-05,0.19953866302967072,3.078866720199585,81.14050197601318,1 +1811,0.264383465051651,0.17242398858070374,0.17270085215568542,0.2018647938966751,895.8192749023438,1e-05,0.18176306784152985,3.5109734535217285,81.14050197601318,1 +1812,0.08179027587175369,0.1613113433122635,0.16918669641017914,0.18251748383045197,928.8597412109375,1e-05,0.12144544720649719,3.14882230758667,81.14050197601318,1 +1813,0.18378154933452606,0.24149638414382935,0.2525908052921295,0.14778554439544678,973.0780639648438,1e-05,0.20284408330917358,3.1033337116241455,81.14050197601318,1 +1814,0.20952022075653076,0.5973095297813416,0.5979633331298828,0.22867132723331451,183.10153198242188,1e-05,0.12381613999605179,2.8441638946533203,81.14050197601318,1 +1815,0.08035450428724289,0.29571670293807983,0.2685036063194275,0.21002331376075745,955.523193359375,1e-05,0.1673516035079956,3.101897954940796,81.14050197601318,1 +1816,0.16665658354759216,0.24308925867080688,0.24451299011707306,0.23053613305091858,949.3074340820312,1e-05,0.17030656337738037,3.077023506164551,81.14050197601318,1 +1817,0.09909159690141678,0.205003559589386,0.20081427693367004,0.15291374921798706,850.6163940429688,1e-05,0.12123790383338928,3.4929332733154297,81.14050197601318,1 +1818,0.23297861218452454,0.20147715508937836,0.2169070541858673,0.18041957914829254,685.2521362304688,1e-05,0.19794420897960663,3.5830416679382324,81.14050197601318,1 +1819,0.15840062499046326,0.2658251225948334,0.25635606050491333,0.22610722482204437,874.9585571289062,1e-05,0.14837801456451416,2.849459171295166,81.14050197601318,1 +1820,0.19374924898147583,0.18486559391021729,0.193966805934906,0.22004662454128265,873.2015991210938,1e-05,0.12649542093276978,3.1562750339508057,81.14050197601318,1 +1821,0.3989933431148529,0.23952949047088623,0.2488916516304016,0.17692308127880096,475.9952392578125,1e-05,0.22351568937301636,2.850626230239868,81.14050197601318,1 +1822,0.2538904845714569,0.28918370604515076,0.2911074459552765,0.145454540848732,848.5123291015625,1e-05,0.11684577167034149,3.1194889545440674,81.14050197601318,1 +1823,0.3197036385536194,0.15642055869102478,0.16116595268249512,0.17435897886753082,630.94677734375,1e-05,0.18062159419059753,3.5418777465820312,81.14050197601318,1 +1824,0.23636718094348907,0.36134254932403564,0.3414388597011566,0.23682983219623566,953.639404296875,1e-05,0.19539369642734528,3.0682692527770996,81.14050197601318,1 +1825,0.2003551721572876,0.25997769832611084,0.2502613365650177,0.11981351673603058,918.2099609375,1e-05,0.19352920353412628,2.8393917083740234,81.14050197601318,1 +1826,0.21612794697284698,0.2596924602985382,0.24986761808395386,0.17435897886753082,957.7728271484375,1e-05,0.1385757029056549,3.138317823410034,81.14050197601318,1 +1827,0.2661188840866089,0.25879666209220886,0.2454611212015152,0.22074592113494873,925.2398681640625,1e-05,0.14473919570446014,2.8294596672058105,81.14050197601318,1 +1828,0.3892153799533844,0.18659909069538116,0.17437483370304108,0.21771562099456787,513.177978515625,1e-05,0.199706569314003,3.1084065437316895,81.14050197601318,1 +1829,0.14285264909267426,0.3185361921787262,0.32326069474220276,0.11118881404399872,959.7694091796875,1e-05,0.13628464937210083,3.4901020526885986,81.14050197601318,1 +1830,0.2957912087440491,0.25981399416923523,0.2543773353099823,0.2377622425556183,443.50128173828125,1e-05,0.17598018050193787,3.1381940841674805,81.14050197601318,1 +1831,0.2920665740966797,0.28406083583831787,0.28025326132774353,0.16153846681118011,858.2379760742188,1e-05,0.5958589315414429,2.8593006134033203,81.14050197601318,1 +1832,0.10463550686836243,0.2824168801307678,0.28044649958610535,0.16526806354522705,997.86474609375,1e-05,0.35821136832237244,3.1447863578796387,81.14050197601318,1 +1833,0.2052992284297943,0.30493777990341187,0.31138110160827637,0.20512820780277252,988.4596557617188,1e-05,0.20371146500110626,2.8443503379821777,81.14050197601318,1 +1834,0.14856486022472382,0.2985040545463562,0.2740744352340698,0.22074592113494873,996.5260620117188,1e-05,0.14866161346435547,3.082059383392334,81.14050197601318,1 +1835,0.11676321178674698,0.20609983801841736,0.19159799814224243,0.2543123662471771,855.2390747070312,1e-05,0.15012750029563904,3.550529718399048,81.14050197601318,1 +1836,0.33126595616340637,0.7002146244049072,0.6945555806159973,0.20629370212554932,992.3473510742188,1e-05,0.15585851669311523,3.161398410797119,81.14050197601318,1 +1837,0.2243846207857132,0.21316739916801453,0.20284304022789001,0.2181818187236786,821.2252807617188,1e-05,0.1570683866739273,2.848572015762329,81.14050197601318,1 +1838,0.22383788228034973,0.18196900188922882,0.1661362200975418,0.22960372269153595,864.5192260742188,1e-05,0.13288183510303497,3.069852828979492,81.14050197601318,1 +1839,0.2213752120733261,0.33735185861587524,0.3408713638782501,0.21212121844291687,976.0529174804688,1e-05,0.18725775182247162,2.834089994430542,81.14050197601318,1 +1840,0.14013725519180298,0.19420960545539856,0.21149440109729767,0.19160838425159454,991.2958374023438,1e-05,0.14955729246139526,3.4176743030548096,81.14050197601318,1 +1841,0.17861801385879517,0.17840509116649628,0.18994073569774628,0.12214452028274536,992.6078491210938,1e-05,0.12609125673770905,3.5890324115753174,81.14050197601318,1 +1842,0.34269365668296814,0.28785213828086853,0.2877517640590668,0.19813519716262817,987.7676391601562,1e-05,0.313257098197937,3.0610735416412354,81.14050197601318,1 +1843,0.2424277663230896,0.3396294414997101,0.3328966796398163,0.23706293106079102,981.5336303710938,1e-05,0.175834521651268,2.8364789485931396,81.14050197601318,1 +1844,0.19607847929000854,0.3238828480243683,0.3168468773365021,0.23566433787345886,979.3876342773438,1e-05,0.2091704159975052,3.046633243560791,81.14050197601318,1 +1845,0.09595844149589539,0.22700689733028412,0.23213253915309906,0.12284382432699203,993.89599609375,1e-05,0.19321317970752716,3.071535348892212,81.14050197601318,1 +1846,0.1737036406993866,0.3297134041786194,0.31497734785079956,0.1958041936159134,983.6209716796875,1e-05,0.15694406628608704,3.027034044265747,81.14050197601318,1 +1847,0.24337053298950195,0.24913279712200165,0.23813746869564056,0.23986013233661652,830.4837646484375,1e-05,0.15823334455490112,3.2392499446868896,81.14050197601318,1 +1848,0.32540464401245117,0.33869123458862305,0.324147492647171,0.22004662454128265,475.9952392578125,1e-05,0.16677848994731903,3.1027321815490723,81.14050197601318,1 +1849,0.18399374186992645,0.19501391053199768,0.1954164057970047,0.22960372269153595,924.6715087890625,1e-05,0.18454815447330475,2.8377761840820312,81.14050197601318,1 +1850,0.21109944581985474,0.2473221719264984,0.24000245332717896,0.25641024112701416,873.2015991210938,1e-05,0.17650829255580902,3.0607776641845703,81.14050197601318,1 +1851,0.1275021880865097,0.2743890881538391,0.2753129303455353,0.19673658907413483,902.6273193359375,1e-05,0.13202422857284546,3.069359302520752,81.14050197601318,1 +1852,0.3123001456260681,0.3188381791114807,0.31055712699890137,0.26247087121009827,859.223388671875,1e-05,0.13807271420955658,3.0755105018615723,81.14050197601318,1 +1853,0.09318725019693375,0.13796736299991608,0.13777734339237213,0.21328671276569366,765.8187255859375,1e-05,0.20877215266227722,3.453322649002075,81.14050197601318,1 +1854,0.26606041193008423,0.2812909483909607,0.2651277482509613,0.17482517659664154,859.223388671875,1e-05,0.15259262919425964,2.8279716968536377,81.14050197601318,1 +1855,0.17305129766464233,0.2971644997596741,0.2917884588241577,0.23892773687839508,608.6077880859375,1e-05,0.1768961399793625,2.8333749771118164,81.14050197601318,1 +1856,0.19751614332199097,0.1549493968486786,0.15201106667518616,0.10186479985713959,893.5853271484375,1e-05,0.14512906968593597,3.0754315853118896,81.14050197601318,1 +1857,0.28575336933135986,0.0980014055967331,0.1057850643992424,0.14918415248394012,706.4580688476562,1e-05,0.16663706302642822,3.109900951385498,81.14050197601318,1 +1858,0.24736206233501434,0.32997798919677734,0.3134474456310272,0.2114219069480896,908.0657348632812,1e-05,0.18508385121822357,3.303283214569092,81.14050197601318,1 +1859,0.1240648701786995,0.37727099657058716,0.3550962805747986,0.2501165568828583,990.8973388671875,1e-05,0.19903677701950073,3.324418306350708,81.14050197601318,1 +1860,0.19994871318340302,0.21219977736473083,0.20422309637069702,0.2265734225511551,880.5089721679688,1e-05,0.13940797746181488,2.8315722942352295,81.14050197601318,1 +1861,0.23383553326129913,0.22720371186733246,0.21514356136322021,0.21095570921897888,861.6561889648438,1e-05,0.12880587577819824,2.8404431343078613,81.14050197601318,1 +1862,0.2928520739078522,0.1859135776758194,0.18406914174556732,0.08321678638458252,777.7576293945312,1e-05,0.13467702269554138,3.0823142528533936,81.14050197601318,1 +1863,0.09518380463123322,0.19146163761615753,0.17838773131370544,0.10466200113296509,837.505126953125,1e-05,0.1172904223203659,3.3485288619995117,81.14050197601318,1 +1864,0.21036016941070557,0.24114975333213806,0.2647680938243866,0.1895104944705963,427.6461486816406,1e-05,0.15404032170772552,3.317725896835327,81.14050197601318,1 +1865,0.3516784906387329,0.1606253683567047,0.15731428563594818,0.20629370212554932,793.5297241210938,1e-05,0.1938062310218811,3.4317843914031982,81.14050197601318,1 +1866,0.21186017990112305,0.2261098176240921,0.21319341659545898,0.2242424190044403,967.322509765625,1e-05,0.13164424896240234,2.8405957221984863,81.14050197601318,1 +1867,0.26477277278900146,0.2782871723175049,0.2751319706439972,0.17575757205486298,443.50128173828125,1e-05,0.15182052552700043,2.8384768962860107,81.14050197601318,1 +1868,0.13320522010326385,0.3143784701824188,0.3000257909297943,0.23473192751407623,996.8938598632812,1e-05,0.1308208703994751,3.0852861404418945,81.14050197601318,1 +1869,0.402137815952301,0.41427597403526306,0.416310578584671,0.275291383266449,375.388671875,1e-05,0.1604572832584381,3.083681106567383,81.14050197601318,1 +1870,0.18036746978759766,0.28819531202316284,0.2754586338996887,0.24988344311714172,916.6853637695312,1e-05,0.14129091799259186,3.289691686630249,81.14050197601318,1 +1871,0.29737982153892517,0.3044857680797577,0.2870245575904846,0.2102564126253128,404.18499755859375,1e-05,0.14429022371768951,3.358640670776367,81.14050197601318,1 +1872,0.17037302255630493,0.2949696183204651,0.2747252285480499,0.14965035021305084,888.5984497070312,1e-05,0.1294727772474289,2.8382725715637207,81.14050197601318,1 +1873,0.2077152281999588,0.21438026428222656,0.21726642549037933,0.20349650084972382,999.0592651367188,1e-05,0.16797353327274323,2.8452484607696533,81.14050197601318,1 +1874,0.18116538226604462,0.24337875843048096,0.23058336973190308,0.26806527376174927,937.2574462890625,1e-05,0.13328684866428375,3.0975027084350586,81.14050197601318,1 +1875,0.2744331657886505,0.2430071234703064,0.24137315154075623,0.16177156567573547,624.2781982421875,1e-05,0.21641230583190918,3.2848358154296875,81.14050197601318,1 +1876,0.15222372114658356,0.35156893730163574,0.33544018864631653,0.22331002354621887,959.966552734375,1e-05,0.22013886272907257,3.427508592605591,81.14050197601318,1 +1877,0.1889580637216568,0.20284636318683624,0.19353574514389038,0.08484848588705063,949.3074340820312,1e-05,0.1511053740978241,3.0887558460235596,81.14050197601318,1 +1878,0.18204399943351746,0.5195851922035217,0.5172882080078125,0.19393938779830933,978.134033203125,1e-05,0.15056200325489044,2.834279775619507,81.14050197601318,1 +1879,0.1715334802865982,0.1729188859462738,0.17868323624134064,0.11235430836677551,818.6600952148438,1e-05,0.1688276082277298,2.8364198207855225,81.14050197601318,1 +1880,0.21577978134155273,0.40050387382507324,0.3784438669681549,0.2393939346075058,989.2814331054688,1e-05,0.17592541873455048,3.13466215133667,81.14050197601318,1 +1881,0.14023683965206146,0.19377657771110535,0.19603465497493744,0.2365967333316803,946.8348388671875,1e-05,0.1690482795238495,3.409008264541626,81.14050197601318,1 +1882,0.2665810286998749,0.3061535358428955,0.3023742437362671,0.20792540907859802,999.2957763671875,1e-05,0.14092403650283813,3.3999598026275635,81.14050197601318,1 +1883,0.38961172103881836,0.22766725718975067,0.217779278755188,0.21048951148986816,709.9939575195312,1e-05,0.17626455426216125,3.0906522274017334,81.14050197601318,1 +1884,0.1889813393354416,0.10712933540344238,0.10656601935625076,0.2030303031206131,917.9066772460938,1e-05,0.1238018348813057,2.827326774597168,81.14050197601318,1 +1885,0.1929461658000946,0.2718183100223541,0.26334792375564575,0.26247087121009827,663.2779541015625,1e-05,0.2478920966386795,2.8352160453796387,81.14050197601318,1 +1886,0.3531201481819153,0.24293385446071625,0.22716683149337769,0.2142191082239151,976.8599853515625,1e-05,16.421491622924805,3.3833134174346924,81.14050197601318,1 +1887,0.29649195075035095,0.2243340164422989,0.26194530725479126,0.19370628893375397,993.1259155273438,1e-05,0.24750952422618866,3.0964932441711426,81.14050197601318,1 +1888,0.19086198508739471,0.2464323192834854,0.2513723373413086,0.12937062978744507,922.0755004882812,1e-05,0.35188227891921997,3.433957099914551,81.14050197601318,1 +1889,0.16422124207019806,0.2117372453212738,0.198579341173172,0.250582754611969,986.5054321289062,1e-05,0.2400016188621521,3.1276965141296387,81.14050197601318,1 +1890,0.31387874484062195,0.27533960342407227,0.2823682129383087,0.23519814014434814,931.826171875,1e-05,0.204381063580513,2.834165096282959,81.14050197601318,1 +1891,0.22553065419197083,0.6670138239860535,0.6557816863059998,0.17482517659664154,994.9097900390625,1e-05,0.19499465823173523,2.841437816619873,81.14050197601318,1 +1892,0.26613640785217285,0.16180884838104248,0.17548584938049316,0.2114219069480896,803.7642822265625,1e-05,0.15549033880233765,3.1393368244171143,81.14050197601318,1 +1893,0.2980180084705353,0.278304785490036,0.2888113260269165,0.21188810467720032,928.5856323242188,1e-05,0.16698884963989258,3.037139415740967,81.14050197601318,1 +1894,0.3046560287475586,0.17796729505062103,0.17687824368476868,0.19114218652248383,841.452880859375,1e-05,0.4923959970474243,3.350191116333008,81.14050197601318,1 +1895,0.3357645571231842,0.21428316831588745,0.21158847212791443,0.18974359333515167,890.5407104492188,1e-05,0.12646536529064178,2.834770917892456,81.14050197601318,1 +1896,0.28412342071533203,0.15241067111492157,0.14255905151367188,0.19254079461097717,967.1416625976562,1e-05,0.14527106285095215,2.8375062942504883,81.14050197601318,1 +1897,0.24888330698013306,0.2021426558494568,0.19740259647369385,0.26317015290260315,678.60888671875,1e-05,0.2001827508211136,3.123091220855713,81.14050197601318,1 +1898,0.24860556423664093,0.13770943880081177,0.13127672672271729,0.1722610741853714,713.4717407226562,1e-05,0.1324990838766098,3.064732074737549,81.14050197601318,1 +1899,0.24269379675388336,0.2098948061466217,0.19563469290733337,0.1566433608531952,875.3941650390625,1e-05,0.23313437402248383,3.2777206897735596,81.14050197601318,1 +1900,0.2668847143650055,0.1357540488243103,0.15734431147575378,0.19417248666286469,926.3671875,1e-05,0.21224209666252136,3.399413824081421,81.14050197601318,1 +1901,0.20341233909130096,0.152530238032341,0.15208138525485992,0.2666666805744171,934.7079467773438,1e-05,0.15955492854118347,2.831752300262451,81.14050197601318,1 +1902,0.32270219922065735,0.19705943763256073,0.19241595268249512,0.17412588000297546,838.6439208984375,1e-05,0.16825436055660248,2.8312811851501465,81.14050197601318,1 +1903,0.11275172233581543,0.27051854133605957,0.2512611150741577,0.13449883460998535,933.9302368164062,1e-05,0.12106809765100479,3.0341315269470215,81.14050197601318,1 +1904,0.12644915282726288,0.33725160360336304,0.3201945722103119,0.232634037733078,979.2321166992188,1e-05,0.13896195590496063,3.1026577949523926,81.14050197601318,1 +1905,0.24129512906074524,0.398934543132782,0.3799837529659271,0.18041957914829254,273.5347900390625,1e-05,0.1507425457239151,3.3599772453308105,81.14050197601318,1 +1906,0.23604461550712585,0.4562113285064697,0.4432671368122101,0.26083916425704956,379.11187744140625,1e-05,0.1429307907819748,3.319768190383911,81.14050197601318,1 +1907,0.1968468576669693,0.15226009488105774,0.1631973385810852,0.1191142201423645,976.69921875,1e-05,0.15817947685718536,2.836731195449829,81.14050197601318,1 +1908,0.1402411162853241,0.19245214760303497,0.19985385239124298,0.16363635659217834,930.488525390625,1e-05,0.12934039533138275,2.8364057540893555,81.14050197601318,1 +1909,0.2600861191749573,0.2331242710351944,0.22590087354183197,0.2186480164527893,869.614990234375,1e-05,0.1319734901189804,3.0898523330688477,81.14050197601318,1 +1910,0.16354002058506012,0.2938402593135834,0.2682707607746124,0.16363635659217834,906.3938598632812,1e-05,0.679673969745636,3.109772205352783,81.14050197601318,1 +1911,0.19512595236301422,0.15381702780723572,0.15696148574352264,0.21724942326545715,761.3585205078125,1e-05,0.17910906672477722,3.3709330558776855,81.14050197601318,1 +1912,0.2596270442008972,0.18926122784614563,0.16995614767074585,0.20675989985466003,838.0756225585938,1e-05,0.16861936450004578,3.2692325115203857,81.14050197601318,1 +1913,0.25125083327293396,0.26016396284103394,0.25641563534736633,0.16013985872268677,847.4485473632812,1e-05,0.22729603946208954,2.8248565196990967,81.14050197601318,1 +1914,0.20903262495994568,0.20579974353313446,0.2007974535226822,0.2181818187236786,888.9893188476562,1e-05,0.18812774121761322,2.8282456398010254,81.14050197601318,1 +1915,0.22413642704486847,0.19052015244960785,0.19216753542423248,0.17855477333068848,847.4485473632812,1e-05,0.19545935094356537,3.3085343837738037,81.14050197601318,1 +1916,0.3410225212574005,0.4412823021411896,0.44280096888542175,0.21491841971874237,344.2266540527344,1e-05,0.21731841564178467,3.362030506134033,81.14050197601318,1 +1917,0.10116836428642273,0.13380151987075806,0.137095645070076,0.1442890465259552,859.223388671875,1e-05,0.175454244017601,3.479257345199585,81.14050197601318,1 +1918,0.2996457517147064,0.23821677267551422,0.23651790618896484,0.17832167446613312,948.4158325195312,1e-05,0.1938210129737854,3.343557596206665,81.14050197601318,1 +1919,0.16899825632572174,1.0059529542922974,1.0908420085906982,0.17575757205486298,994.27783203125,1e-05,0.6121354699134827,2.8436033725738525,81.14050197601318,1 +1920,0.3932650685310364,0.39240220189094543,0.3903093636035919,0.13729603588581085,437.2454833984375,1e-05,0.1733560413122177,2.8383021354675293,81.14050197601318,1 +1921,0.1343577802181244,0.391659140586853,0.37255024909973145,0.13379953801631927,961.7210693359375,1e-05,0.12854765355587006,3.291431427001953,81.14050197601318,1 +1922,0.11957038193941116,0.31235331296920776,0.30844056606292725,0.16200466454029083,982.4352416992188,1e-05,0.19821713864803314,3.3037047386169434,81.14050197601318,1 +1923,0.15623436868190765,0.25200071930885315,0.244584858417511,0.19230769574642181,928.5856323242188,1e-05,0.23077259957790375,3.410870313644409,81.14050197601318,1 +1924,0.31097716093063354,0.25611910223960876,0.24588754773139954,0.1470862478017807,964.5680541992188,1e-05,0.17394772171974182,3.121525287628174,81.14050197601318,1 +1925,0.3130762279033661,0.20521970093250275,0.20904815196990967,0.2181818187236786,548.6198120117188,1e-05,0.12349500507116318,2.827425956726074,81.14050197601318,1 +1926,0.3526577353477478,0.2041725516319275,0.19839222729206085,0.1442890465259552,944.529052734375,1e-05,0.29771944880485535,2.8256423473358154,81.14050197601318,1 +1927,0.3110020160675049,0.2982098460197449,0.30659887194633484,0.238228440284729,314.781494140625,1e-05,0.18538250029087067,3.510085105895996,81.14050197601318,1 +1928,0.1787920445203781,0.24241656064987183,0.22399622201919556,0.23030303418636322,838.6439208984375,1e-05,0.21523241698741913,3.060825824737549,81.14050197601318,1 +1929,0.195196270942688,0.13738086819648743,0.14227303862571716,0.10396270453929901,943.8261108398438,1e-05,0.1341208666563034,3.362380266189575,81.14050197601318,1 +1930,0.1493457853794098,0.2908676862716675,0.28622058033943176,0.22960372269153595,916.0694580078125,1e-05,0.1340869665145874,3.069596290588379,81.14050197601318,1 +1931,0.3122635781764984,0.16986079514026642,0.15985344350337982,0.18531468510627747,915.4500122070312,1e-05,0.14917072653770447,2.83919358253479,81.14050197601318,1 +1932,0.22285091876983643,0.21146981418132782,0.20845122635364532,0.26713287830352783,939.4969482421875,1e-05,0.22081206738948822,2.8384690284729004,81.14050197601318,1 +1933,0.11162637174129486,0.2404939830303192,0.22894713282585144,0.20955711603164673,908.3971557617188,1e-05,0.14215238392353058,3.3580377101898193,81.14050197601318,1 +1934,0.257588654756546,0.6527581810951233,0.6727784276008606,0.16573426127433777,106.90462493896484,1e-05,0.15362009406089783,3.0945425033569336,81.14050197601318,1 +1935,0.1931331306695938,0.3010348379611969,0.28930988907814026,0.22331002354621887,981.6846923828125,1e-05,0.1302116960287094,3.324002265930176,81.14050197601318,1 +1936,0.406537801027298,0.25664734840393066,0.24325542151927948,0.19393938779830933,909.3855590820312,1e-05,0.15879106521606445,3.126692771911621,81.14050197601318,1 +1937,0.09370465576648712,0.30517107248306274,0.29903656244277954,0.2265734225511551,926.0864868164062,1e-05,0.1573275327682495,2.8216981887817383,81.14050197601318,1 +1938,0.0807364284992218,0.2944675087928772,0.2814667224884033,0.2449883371591568,997.5022583007812,1e-05,0.6841328740119934,3.093273878097534,81.14050197601318,1 +1939,0.2725335359573364,0.24080312252044678,0.22834621369838715,0.18298368155956268,689.1459350585938,1e-05,0.16843406856060028,3.3930678367614746,81.14050197601318,1 +1940,0.32194751501083374,0.28422313928604126,0.26814064383506775,0.2526806592941284,873.2015991210938,1e-05,0.15367862582206726,3.101468086242676,81.14050197601318,1 +1941,0.24511364102363586,0.34687697887420654,0.32968848943710327,0.22470861673355103,932.6204223632812,1e-05,0.17073661088943481,3.3500561714172363,81.14050197601318,1 +1942,0.22028252482414246,0.263905793428421,0.2537641227245331,0.251748263835907,794.2818603515625,1e-05,0.15556134283542633,2.8230130672454834,81.14050197601318,1 +1943,0.27841493487358093,0.17149244248867035,0.16287270188331604,0.11585081368684769,913.2542724609375,1e-05,0.2271154224872589,2.829669952392578,81.14050197601318,1 +1944,0.17976923286914825,0.19130098819732666,0.19177713990211487,0.10885781049728394,955.9364624023438,1e-05,0.1584889441728592,3.1338515281677246,81.14050197601318,1 +1945,0.2920090854167938,0.15374988317489624,0.14599306881427765,0.22051282227039337,660.37890625,1e-05,0.24748298525810242,3.0849483013153076,81.14050197601318,1 +1946,0.2374604195356369,0.11961764842271805,0.12884128093719482,0.20955711603164673,810.0248413085938,1e-05,0.14436393976211548,3.2934682369232178,81.14050197601318,1 +1947,0.30689284205436707,0.1702388972043991,0.16698433458805084,0.09627039730548859,949.5288696289062,1e-05,0.14646020531654358,3.2895705699920654,81.14050197601318,1 +1948,0.13087213039398193,0.4080752432346344,0.39768868684768677,0.12331002205610275,989.8240966796875,1e-05,0.4816538095474243,2.849940776824951,81.14050197601318,1 +1949,0.2491869032382965,0.27793166041374207,0.2692762613296509,0.2554778456687927,932.8836669921875,1e-05,0.15799297392368317,2.851288080215454,81.14050197601318,1 +1950,0.23652705550193787,0.33805352449417114,0.32118290662765503,0.19393938779830933,437.2454833984375,1e-05,0.3041180670261383,3.6072051525115967,81.14050197601318,1 +1951,0.10773861408233643,0.18691083788871765,0.1868620365858078,0.18391607701778412,968.3995361328125,1e-05,0.192488893866539,3.123012065887451,81.14050197601318,1 +1952,0.21096667647361755,0.14035731554031372,0.14150218665599823,0.24382284283638,915.7601928710938,1e-05,0.14896328747272491,3.4299488067626953,81.14050197601318,1 +1953,0.20540809631347656,0.2085118442773819,0.20175716280937195,0.16363635659217834,895.8192749023438,1e-05,0.18884769082069397,3.357353925704956,81.14050197601318,1 +1954,0.2624815106391907,0.11524330079555511,0.12833745777606964,0.2002331018447876,753.992919921875,1e-05,0.1585961878299713,2.8325588703155518,81.14050197601318,1 +1955,0.25696566700935364,0.4392772614955902,0.427341490983963,0.2813519835472107,991.1632080078125,1e-05,0.17876896262168884,2.8488175868988037,81.14050197601318,1 +1956,0.21765254437923431,0.2138770967721939,0.2193402200937271,0.1934731900691986,940.7190551757812,1e-05,0.14877541363239288,3.4351806640625,81.14050197601318,1 +1957,0.5390629768371582,0.2479487806558609,0.23881691694259644,0.22214451432228088,716.8931274414062,1e-05,0.17182151973247528,2.834371566772461,81.14050197601318,1 +1958,0.16675177216529846,0.2783513367176056,0.2667779326438904,0.25687646865844727,782.640625,1e-05,0.1576581597328186,3.310105562210083,81.14050197601318,1 +1959,0.24892696738243103,0.26904258131980896,0.27818459272384644,0.1107226088643074,518.1495361328125,1e-05,0.11266835033893585,3.107332944869995,81.14050197601318,1 +1960,0.222662091255188,0.7223366498947144,0.7224711775779724,0.21631701290607452,120.44096374511719,1e-05,0.20507149398326874,2.823223352432251,81.14050197601318,1 +1961,0.14097082614898682,0.3424489200115204,0.3408048748970032,0.15850815176963806,950.8469848632812,1e-05,0.13129141926765442,2.833407402038574,81.14050197601318,1 +1962,0.31155189871788025,0.23337939381599426,0.23034042119979858,0.2114219069480896,811.3840942382812,1e-05,0.21024732291698456,3.3653581142425537,81.14050197601318,1 +1963,0.3308252990245819,0.20780156552791595,0.21590201556682587,0.17529137432575226,952.789306640625,1e-05,0.1772344708442688,2.8257079124450684,81.14050197601318,1 +1964,0.24962566792964935,0.19725605845451355,0.20100197196006775,0.2365967333316803,677.2564697265625,1e-05,0.14598603546619415,3.377207040786743,81.14050197601318,1 +1965,0.22864362597465515,0.28921759128570557,0.297080397605896,0.2310023307800293,996.5260620117188,1e-05,0.15700958669185638,3.1173300743103027,81.14050197601318,1 +1966,0.19217108190059662,0.2120584398508072,0.20275208353996277,0.1918414980173111,866.3948974609375,1e-05,0.15837091207504272,2.8203680515289307,81.14050197601318,1 +1967,0.07837066054344177,0.2450494021177292,0.22805090248584747,0.2242424190044403,869.614990234375,1e-05,0.12807141244411469,3.0663435459136963,81.14050197601318,1 +1968,0.25387245416641235,0.16186559200286865,0.1722509115934372,0.21958041191101074,859.7134399414062,1e-05,0.13559088110923767,3.3690574169158936,81.14050197601318,1 +1969,0.23887541890144348,0.19071047008037567,0.18815858662128448,0.2293706238269806,931.025634765625,1e-05,0.3213992714881897,3.0771937370300293,81.14050197601318,1 +1970,0.1687762588262558,0.29702693223953247,0.27684733271598816,0.26923078298568726,975.2377319335938,1e-05,0.14343906939029694,3.2938051223754883,81.14050197601318,1 +1971,0.320216566324234,0.15361443161964417,0.1735410988330841,0.238228440284729,572.1419677734375,1e-05,0.1503223478794098,3.0713796615600586,81.14050197601318,1 +1972,0.23259887099266052,0.24517053365707397,0.23979775607585907,0.16363635659217834,941.926025390625,1e-05,0.14957311749458313,2.8315682411193848,81.14050197601318,1 +1973,0.1598099023103714,0.18044395744800568,0.17654262483119965,0.2214452177286148,870.5208129882812,1e-05,0.12931391596794128,3.1235125064849854,81.14050197601318,1 +1974,0.31328585743904114,0.30482393503189087,0.31533247232437134,0.07738927751779556,248.77369689941406,1e-05,0.1410483568906784,3.120248317718506,81.14050197601318,1 +1975,0.24467319250106812,0.22328563034534454,0.21598948538303375,0.23006993532180786,938.5079956054688,1e-05,0.1600360870361328,3.1158101558685303,81.14050197601318,1 +1976,0.19388452172279358,0.14032961428165436,0.14952170848846436,0.25920745730400085,800.1805419921875,1e-05,0.20523057878017426,3.3554527759552,81.14050197601318,1 +1977,0.3905336856842041,0.2530592381954193,0.24462422728538513,0.2282051295042038,550.8392333984375,1e-05,0.17299975454807281,3.102522134780884,81.14050197601318,1 +1978,0.20549319684505463,0.2095915824174881,0.21678702533245087,0.24009324610233307,639.041015625,1e-05,0.14774096012115479,2.834214448928833,81.14050197601318,1 +1979,0.25711172819137573,0.30754920840263367,0.29486608505249023,0.14335663616657257,967.5030517578125,1e-05,0.1471458077430725,3.3653175830841064,81.14050197601318,1 +1980,0.16584540903568268,0.27520060539245605,0.2765127122402191,0.22867132723331451,674.5276489257812,1e-05,0.24706289172172546,3.06494402885437,81.14050197601318,1 +1981,0.25527408719062805,0.26757609844207764,0.25877872109413147,0.20909090340137482,986.6468505859375,1e-05,0.4316931962966919,3.1002249717712402,81.14050197601318,1 +1982,0.1082964837551117,0.15422256290912628,0.14255893230438232,0.15967366099357605,909.0570068359375,1e-05,0.12075354158878326,3.328373432159424,81.14050197601318,1 +1983,0.3798503875732422,0.37499311566352844,0.3703496754169464,0.2310023307800293,397.1928405761719,1e-05,0.18186843395233154,2.830615282058716,81.14050197601318,1 +1984,0.13486945629119873,0.2315453290939331,0.21257461607456207,0.2097902148962021,968.0419921875,1e-05,0.47378605604171753,2.8388540744781494,81.14050197601318,1 +1985,0.20137451589107513,0.15747514367103577,0.16599230468273163,0.21958041191101074,852.6897583007812,1e-05,0.2616359293460846,3.1548709869384766,81.14050197601318,1 +1986,0.1823836714029312,0.1888776272535324,0.1861083060503006,0.2265734225511551,772.7371215820312,1e-05,0.16964784264564514,3.0741240978240967,81.14050197601318,1 +1987,0.23575468361377716,0.2172156274318695,0.2151680737733841,0.23356643319129944,646.8789672851562,1e-05,0.34175750613212585,3.346529960632324,81.14050197601318,1 +1988,0.2284395545721054,0.28349894285202026,0.2641235888004303,0.2226107269525528,835.2010498046875,1e-05,0.1572650671005249,3.4098708629608154,81.14050197601318,1 +1989,0.3101802468299866,0.1987697184085846,0.22528313100337982,0.17855477333068848,928.03564453125,1e-05,0.24726086854934692,2.824688196182251,81.14050197601318,1 +1990,0.1470193862915039,0.2240978330373764,0.225739523768425,0.1918414980173111,920.9009399414062,1e-05,0.14889216423034668,2.8288180828094482,81.14050197601318,1 +1991,0.1793217658996582,0.25252923369407654,0.27594757080078125,0.14498834311962128,278.3217468261719,1e-05,0.1629171222448349,3.4544918537139893,81.14050197601318,1 +1992,0.19086217880249023,0.24283014237880707,0.24332766234874725,0.19766899943351746,978.9199829101562,1e-05,0.4843187928199768,3.0791163444519043,81.14050197601318,1 +1993,0.19834080338478088,0.19849082827568054,0.18448221683502197,0.15407925844192505,945.226806640625,1e-05,0.14369817078113556,3.326389789581299,81.14050197601318,1 +1994,0.2538864016532898,0.24902062118053436,0.2362019121646881,0.24405594170093536,940.2321166992188,1e-05,0.1881968230009079,3.0707263946533203,81.14050197601318,1 +1995,0.14088967442512512,0.21010853350162506,0.19623111188411713,0.2482517510652542,872.3140258789062,1e-05,0.17439456284046173,2.8387584686279297,81.14050197601318,1 +1996,0.1985817402601242,0.10457082837820053,0.10964424163103104,0.16130536794662476,887.812744140625,1e-05,0.161819726228714,2.8342478275299072,81.14050197601318,1 +1997,0.15649142861366272,0.2046225368976593,0.20106127858161926,0.15734265744686127,927.2047729492188,1e-05,0.2286238819360733,3.40537691116333,81.14050197601318,1 +1998,0.339433491230011,0.3605615198612213,0.35968467593193054,0.2745920717716217,393.64630126953125,1e-05,0.1564803570508957,3.0729241371154785,81.14050197601318,1 +1999,0.21127068996429443,0.21922750771045685,0.207315132021904,0.2377622425556183,807.27197265625,1e-05,0.1311740279197693,3.1359260082244873,81.14050197601318,1 +2000,0.20451021194458008,0.31558385491371155,0.29603245854377747,0.24009324610233307,976.3768310546875,1e-05,0.13278019428253174,3.070714235305786,81.14050197601318,1 +2001,0.46529337763786316,0.12682901322841644,0.11543489247560501,0.2510489523410797,814.068359375,1e-05,0.16318586468696594,2.8453829288482666,81.14050197601318,1 +2002,0.22713403403759003,0.3132301867008209,0.29928451776504517,0.24428904056549072,968.3995361328125,1e-05,0.16195756196975708,3.0632741451263428,81.14050197601318,1 +2003,0.16046185791492462,0.30456262826919556,0.30015793442726135,0.214685320854187,976.3768310546875,1e-05,0.19906845688819885,3.0893661975860596,81.14050197601318,1 +2004,0.37932467460632324,0.3256545066833496,0.3301699459552765,0.08741258829832077,386.44976806640625,1e-05,0.16592633724212646,3.300466299057007,81.14050197601318,1 +2005,0.24598072469234467,0.19183337688446045,0.19741632044315338,0.26270395517349243,987.2093505859375,1e-05,0.24576738476753235,3.3850181102752686,81.14050197601318,1 +2006,0.2915777266025543,0.4337085783481598,0.4365140199661255,0.2293706238269806,227.91456604003906,1e-05,0.1799168437719345,2.847342014312744,81.14050197601318,1 +2007,0.21225875616073608,0.19234484434127808,0.185845285654068,0.2354312390089035,890.5407104492188,1e-05,0.12446233630180359,2.8426835536956787,81.14050197601318,1 +2008,0.3231905400753021,0.25361618399620056,0.24552902579307556,0.2214452177286148,886.226318359375,1e-05,0.28151434659957886,3.107896327972412,81.14050197601318,1 +2009,0.19098220765590668,0.39595842361450195,0.37651681900024414,0.2650349736213684,979.6979370117188,1e-05,0.476475328207016,3.090125560760498,81.14050197601318,1 +2010,0.25509241223335266,0.13648071885108948,0.1328219473361969,0.214685320854187,877.1219482421875,1e-05,0.1718098223209381,3.315094232559204,81.14050197601318,1 +2011,0.17613445222377777,0.32741913199424744,0.31368687748908997,0.2512820363044739,944.0609741210938,1e-05,0.26979494094848633,3.126587390899658,81.14050197601318,1 +2012,0.09653370082378387,0.28335335850715637,0.28323185443878174,0.18298368155956268,929.405517578125,1e-05,0.20303721725940704,2.8579232692718506,81.14050197601318,1 +2013,0.3560165762901306,0.2419249713420868,0.22415640950202942,0.21888111531734467,781.0278930664062,1e-05,0.1613388955593109,2.8523571491241455,81.14050197601318,1 +2014,0.09126408398151398,0.2552022635936737,0.2422187626361847,0.20629370212554932,949.9702758789062,1e-05,0.3770590126514435,3.2863779067993164,81.14050197601318,1 +2015,0.338908314704895,0.22721140086650848,0.21979762613773346,0.21048951148986816,927.7593383789062,1e-05,0.14989204704761505,3.103560447692871,81.14050197601318,1 +2016,0.24258828163146973,0.14762498438358307,0.16342473030090332,0.2282051295042038,821.2252807617188,1e-05,0.18311110138893127,3.653681755065918,81.14050197601318,1 +2017,0.26194387674331665,0.45045459270477295,0.44777122139930725,0.04545454680919647,287.737548828125,1e-05,0.11707541346549988,3.1189355850219727,81.14050197601318,1 +2018,0.20743326842784882,0.3196183741092682,0.3040373623371124,0.1878787875175476,664.7142333984375,1e-05,0.1371767818927765,2.8486785888671875,81.14050197601318,1 +2019,0.20769467949867249,0.2156437337398529,0.21303409337997437,0.22750583291053772,839.7739868164062,1e-05,0.6525704264640808,2.840609550476074,81.14050197601318,1 +2020,0.13720352947711945,0.16250599920749664,0.1544066071510315,0.21631701290607452,674.5276489257812,1e-05,0.1552780419588089,3.3907573223114014,81.14050197601318,1 +2021,0.14921064674854279,0.24493858218193054,0.2498909831047058,0.139860138297081,846.3767700195312,1e-05,0.14340688288211823,3.5841193199157715,81.14050197601318,1 +2022,0.173380047082901,0.31688180565834045,0.31410670280456543,0.2181818187236786,969.8138427734375,1e-05,0.26843446493148804,3.394428253173828,81.14050197601318,1 +2023,0.1909978836774826,0.33186209201812744,0.3230484426021576,0.2158508151769638,988.4596557617188,1e-05,0.1578415185213089,3.152139902114868,81.14050197601318,1 +2024,0.45231330394744873,0.42965397238731384,0.4421144425868988,0.21072261035442352,222.54527282714844,1e-05,0.15664559602737427,3.083749771118164,81.14050197601318,1 +2025,0.18873578310012817,0.16874346137046814,0.1610981822013855,0.18997669219970703,886.226318359375,1e-05,0.13348688185214996,3.0709757804870605,81.14050197601318,1 +2026,0.20567238330841064,0.18936753273010254,0.18319071829319,0.2181818187236786,812.7318115234375,1e-05,0.24876952171325684,3.505159378051758,81.14050197601318,1 +2027,0.307108998298645,0.3074021339416504,0.3047598600387573,0.09300699084997177,991.69189453125,1e-05,0.1577785164117813,3.531687021255493,81.14050197601318,1 +2028,0.3970087468624115,0.2850833237171173,0.2952329218387604,0.17132866382598877,443.50128173828125,1e-05,0.1961493045091629,3.500131845474243,81.14050197601318,1 +2029,0.26907089352607727,0.22297747433185577,0.21722640097141266,0.11818181723356247,957.3680419921875,1e-05,0.14187197387218475,3.0899367332458496,81.14050197601318,1 +2030,0.37777552008628845,0.4706031084060669,0.4579823613166809,0.20326340198516846,305.9609069824219,1e-05,0.1359904408454895,2.8435544967651367,81.14050197601318,1 +2031,0.14633148908615112,0.33624738454818726,0.34574025869369507,0.08578088879585266,283.0556640625,1e-05,0.12255013734102249,3.0641098022460938,81.14050197601318,1 +2032,0.20940150320529938,0.17287993431091309,0.17186573147773743,0.2209790199995041,925.8049926757812,1e-05,0.15076105296611786,3.084512948989868,81.14050197601318,1 +2033,0.2632336914539337,0.7882398962974548,0.7825972437858582,0.23333333432674408,100.0000228881836,1e-05,0.14997179806232452,3.2228007316589355,81.14050197601318,1 +2034,0.2740934193134308,0.3180561661720276,0.3247130513191223,0.1678321659564972,348.26116943359375,1e-05,0.12471814453601837,3.4302189350128174,81.14050197601318,1 +2035,0.06521821022033691,0.10712488740682602,0.12236238270998001,0.2466200441122055,818.6600952148438,1e-05,0.13562266528606415,3.138936758041382,81.14050197601318,1 +2036,0.2569658160209656,0.21546386182308197,0.2090684026479721,0.20792540907859802,541.85888671875,1e-05,0.13052135705947876,2.8526864051818848,81.14050197601318,1 +2037,0.26204851269721985,0.17472511529922485,0.1788676381111145,0.2102564126253128,677.2564697265625,1e-05,0.3209071159362793,3.056185483932495,81.14050197601318,1 +2038,0.22453290224075317,0.34982922673225403,0.35190796852111816,0.25244754552841187,954.271728515625,1e-05,0.12948091328144073,3.246737003326416,81.14050197601318,1 +2039,0.2037970870733261,0.2038080394268036,0.19473128020763397,0.15058274567127228,800.1805419921875,1e-05,0.12551523745059967,3.210162878036499,81.14050197601318,1 +2040,0.43934547901153564,0.4758484661579132,0.4596891403198242,0.2242424190044403,171.19692993164062,1e-05,0.16888527572155,3.6130318641662598,81.14050197601318,1 +2041,0.12345752865076065,0.21739067137241364,0.20431190729141235,0.24032634496688843,980.7741088867188,1e-05,0.16057902574539185,2.8396270275115967,81.14050197601318,1 +2042,0.16406193375587463,0.18884481489658356,0.19505983591079712,0.2214452177286148,964.940673828125,1e-05,0.14702419936656952,2.8406450748443604,81.14050197601318,1 +2043,0.41829612851142883,0.23933716118335724,0.22702154517173767,0.14242424070835114,958.576904296875,1e-05,0.22142240405082703,3.12410831451416,81.14050197601318,1 +2044,0.18329809606075287,0.2633129358291626,0.2678331434726715,0.16876456141471863,955.9364624023438,1e-05,0.3559606671333313,3.231241464614868,81.14050197601318,1 +2045,0.28046151995658875,0.15335099399089813,0.1417398899793625,0.16596736013889313,945.9192504882812,1e-05,0.20147237181663513,3.315608501434326,81.14050197601318,1 +2046,0.11705764383077621,0.18256019055843353,0.1859460473060608,0.18717949092388153,999.0592651367188,1e-05,0.16183167695999146,3.306903123855591,81.14050197601318,1 +2047,0.09194041788578033,0.16371218860149384,0.1622260957956314,0.17202797532081604,964.940673828125,1e-05,0.2816213071346283,2.8411736488342285,81.14050197601318,1 +2048,0.15274840593338013,0.14853230118751526,0.15534505248069763,0.22284382581710815,939.2506103515625,1e-05,0.15116022527217865,2.8372933864593506,81.14050197601318,1 +2049,0.3214026093482971,0.4876221716403961,0.48800739645957947,0.18648017942905426,263.79840087890625,1e-05,0.13441066443920135,3.1536965370178223,81.14050197601318,1 +2050,0.1903943568468094,0.14465190470218658,0.14449088275432587,0.2638694643974304,983.3262329101562,1e-05,0.12082207202911377,3.2976436614990234,81.14050197601318,1 +2051,0.3576934039592743,0.20147402584552765,0.19439350068569183,0.17925408482551575,825.6151733398438,1e-05,0.1412152647972107,3.473031997680664,81.14050197601318,1 +2052,0.2859100103378296,0.25248634815216064,0.24791495501995087,0.22214451432228088,996.4030151367188,1e-05,0.1514231413602829,3.4188642501831055,81.14050197601318,1 +2053,0.13353176414966583,0.1459161639213562,0.14272116124629974,0.11864801496267319,816.0525512695312,1e-05,0.16819140315055847,2.8385326862335205,81.14050197601318,1 +2054,0.33010929822921753,0.19650006294250488,0.1922551393508911,0.19230769574642181,624.2781982421875,1e-05,0.1387254297733307,2.8477447032928467,81.14050197601318,1 +2055,0.10970098525285721,0.205156147480011,0.19138970971107483,0.24848484992980957,926.6471557617188,1e-05,0.13921132683753967,3.2744133472442627,81.14050197601318,1 +2056,0.19574177265167236,0.4155914783477783,0.41764846444129944,0.22960372269153595,278.3217468261719,1e-05,0.14979225397109985,3.0897955894470215,81.14050197601318,1 +2057,0.34499555826187134,0.23077517747879028,0.22845251858234406,0.19370628893375397,869.15966796875,1e-05,0.3162466287612915,3.3175837993621826,81.14050197601318,1 +2058,0.07813137024641037,0.19304987788200378,0.18322810530662537,0.2142191082239151,906.0565185546875,1e-05,0.1358398050069809,3.0938496589660645,81.14050197601318,1 +2059,0.16511675715446472,0.20021690428256989,0.19689549505710602,0.21398600935935974,825.6151733398438,1e-05,0.12581342458724976,2.8412725925445557,81.14050197601318,1 +2060,0.37260064482688904,0.24025371670722961,0.2350006103515625,0.21235431730747223,821.8599853515625,1e-05,0.3759697377681732,2.8489389419555664,81.14050197601318,1 +2061,0.07957229018211365,0.16597606241703033,0.1793779730796814,0.22494173049926758,914.2007446289062,1e-05,0.17972052097320557,3.279451608657837,81.14050197601318,1 +2062,0.21931317448616028,0.3128228187561035,0.3100079298019409,0.2041957974433899,975.4014282226562,1e-05,0.37017178535461426,3.057873487472534,81.14050197601318,1 +2063,0.13212116062641144,0.212338387966156,0.22201721370220184,0.18298368155956268,991.1632080078125,1e-05,0.17571629583835602,3.5555074214935303,81.14050197601318,1 +2064,0.31880462169647217,0.18213123083114624,0.16938088834285736,0.2242424190044403,874.9585571289062,1e-05,0.5345960855484009,3.128066062927246,81.14050197601318,1 +2065,0.39085304737091064,0.2285138964653015,0.20885878801345825,0.18205128610134125,781.836181640625,1e-05,0.1532801389694214,2.838240146636963,81.14050197601318,1 +2066,0.10464902222156525,0.4248487651348114,0.40308767557144165,0.2242424190044403,982.4352416992188,1e-05,0.12371574342250824,2.849116086959839,81.14050197601318,1 +2067,0.1461736410856247,0.21093715727329254,0.21295306086540222,0.15874126553535461,966.9605712890625,1e-05,0.3351772129535675,3.036163091659546,81.14050197601318,1 +2068,0.2551942467689514,0.2445453703403473,0.24968262016773224,0.17412588000297546,972.4016723632812,1e-05,0.09719692170619965,3.054527997970581,81.14050197601318,1 +2069,0.23525652289390564,0.1826818883419037,0.186406210064888,0.11538461595773697,878.402587890625,1e-05,0.18072360754013062,3.558574914932251,81.14050197601318,1 +2070,0.20630167424678802,0.22597992420196533,0.22381746768951416,0.19650349020957947,696.7341918945312,1e-05,16.329267501831055,2.841728448867798,81.14050197601318,1 +2071,0.3356858789920807,0.2739781141281128,0.2697288990020752,0.2209790199995041,651.463623046875,1e-05,0.13982994854450226,2.8442718982696533,81.14050197601318,1 +2072,0.13109742105007172,0.19727176427841187,0.19037042558193207,0.1258741319179535,948.4158325195312,1e-05,0.15030677616596222,3.12353777885437,81.14050197601318,1 +2073,0.3555094003677368,0.3354603052139282,0.33083051443099976,0.2710955739021301,546.3833618164062,1e-05,0.26074087619781494,3.102323055267334,81.14050197601318,1 +2074,0.2856863737106323,0.29418042302131653,0.2817613184452057,0.16923077404499054,985.0772094726562,1e-05,1.5974071025848389,3.4303886890411377,81.14050197601318,1 +2075,0.15610475838184357,0.2459065020084381,0.2435828149318695,0.25034964084625244,904.0114135742188,1e-05,0.17991642653942108,3.1408209800720215,81.14050197601318,1 +2076,0.318997859954834,0.26558250188827515,0.2679119110107422,0.20606060326099396,865.928466796875,1e-05,0.13340015709400177,2.8400681018829346,81.14050197601318,1 +2077,0.22232641279697418,0.12363267689943314,0.12540338933467865,0.20233100652694702,786.6087036132812,1e-05,0.12346398830413818,2.84572696685791,81.14050197601318,1 +2078,0.13060477375984192,0.2147904634475708,0.20292821526527405,0.21282051503658295,878.402587890625,1e-05,0.14989086985588074,3.0299859046936035,81.14050197601318,1 +2079,0.1479022353887558,0.24267277121543884,0.24965670704841614,0.22331002354621887,998.5840454101562,1e-05,0.23293738067150116,3.078230619430542,81.14050197601318,1 +2080,0.3665808439254761,0.176998108625412,0.1801617294549942,0.20815850794315338,966.9605712890625,1e-05,0.22212781012058258,3.50653076171875,81.14050197601318,1 +2081,0.2762240469455719,0.21741880476474762,0.21428704261779785,0.13939394056797028,352.25469970703125,1e-05,0.21707911789417267,3.359029769897461,81.14050197601318,1 +2082,0.34295836091041565,0.23164960741996765,0.2266780585050583,0.24638694524765015,652.9728393554688,1e-05,0.13668403029441833,2.8492441177368164,81.14050197601318,1 +2083,0.1890871673822403,0.19249995052814484,0.1892690360546112,0.23706293106079102,850.6163940429688,1e-05,0.15207386016845703,2.854084014892578,81.14050197601318,1 +2084,0.19764283299446106,0.17083698511123657,0.16783644258975983,0.28205129504203796,758.630126953125,1e-05,0.15650443732738495,3.1332204341888428,81.14050197601318,1 +2085,0.43923142552375793,0.204476460814476,0.20558574795722961,0.2405594438314438,913.2542724609375,1e-05,0.17139030992984772,3.2977676391601562,81.14050197601318,1 +2086,0.1927354782819748,0.24465243518352509,0.24015215039253235,0.2421911358833313,836.3575439453125,1e-05,3.4927890300750732,3.256833076477051,81.14050197601318,1 +2087,0.27242612838745117,0.06171286106109619,0.0688701942563057,0.10675990581512451,925.2398681640625,1e-05,0.14808472990989685,3.365125894546509,81.14050197601318,1 +2088,0.3426811695098877,0.3083857297897339,0.2973715364933014,0.16317015886306763,787.3915405273438,1e-05,0.41519489884376526,2.842789888381958,81.14050197601318,1 +2089,0.20461371541023254,0.1608385443687439,0.17778702080249786,0.12377621978521347,964.5680541992188,1e-05,0.27069199085235596,2.849224805831909,81.14050197601318,1 +2090,0.21639899909496307,0.2040068507194519,0.19835034012794495,0.17179487645626068,935.22314453125,1e-05,0.1502312421798706,3.3453564643859863,81.14050197601318,1 +2091,0.1834007203578949,0.21374261379241943,0.20979782938957214,0.08601398766040802,934.7079467773438,1e-05,0.19138246774673462,3.0879318714141846,81.14050197601318,1 +2092,0.2962739169597626,0.21872375905513763,0.21831610798835754,0.0139860138297081,935.22314453125,1e-05,0.17078690230846405,3.316096067428589,81.14050197601318,1 +2093,0.39595091342926025,0.36322537064552307,0.35466131567955017,0.19510489702224731,348.26116943359375,1e-05,0.1612270623445511,3.358228921890259,81.14050197601318,1 +2094,0.2551036477088928,0.28806501626968384,0.291329562664032,0.27762237191200256,851.1375732421875,1e-05,0.15489895641803741,2.8501381874084473,81.14050197601318,1 +2095,0.1749698668718338,0.137083500623703,0.1444663256406784,0.11888112127780914,931.826171875,1e-05,0.13381503522396088,2.8603925704956055,81.14050197601318,1 +2096,0.15858705341815948,0.2617240846157074,0.26080337166786194,0.12773892283439636,961.9138793945312,1e-05,0.13374973833560944,3.2452235221862793,81.14050197601318,1 +2097,0.27084052562713623,0.23709812760353088,0.2251245528459549,0.260606050491333,847.4485473632812,1e-05,0.11446642130613327,3.116804599761963,81.14050197601318,1 +2098,0.21859775483608246,0.19442470371723175,0.20418334007263184,0.23076923191547394,683.93896484375,1e-05,0.13632313907146454,3.271122932434082,81.14050197601318,1 +2099,0.21974869072437286,0.15535558760166168,0.16566413640975952,0.22867132723331451,874.0830688476562,1e-05,0.14850042760372162,3.3218958377838135,81.14050197601318,1 +2100,0.15705610811710358,0.09767939895391464,0.11184930056333542,0.1934731900691986,843.6619262695312,1e-05,0.15415966510772705,2.840738296508789,81.14050197601318,1 +2101,0.18229283392429352,0.2756113111972809,0.2726353704929352,0.21678321063518524,984.4981079101562,1e-05,0.1118328720331192,2.8348143100738525,81.14050197601318,1 +2102,0.3787670135498047,0.13517841696739197,0.1271289736032486,0.16899767518043518,818.6600952148438,1e-05,0.17897261679172516,3.35351824760437,81.14050197601318,1 +2103,0.3175613284111023,0.39476722478866577,0.416000097990036,0.19114218652248383,248.77369689941406,1e-05,0.1686827838420868,3.0906360149383545,81.14050197601318,1 +2104,0.1643284559249878,0.11378931999206543,0.11656566709280014,0.1370629370212555,901.5783081054688,1e-05,0.14545024931430817,3.4116933345794678,81.14050197601318,1 +2105,0.21196016669273376,0.2747424840927124,0.2636190950870514,0.17482517659664154,944.2952880859375,1e-05,0.14100050926208496,3.346318006515503,81.14050197601318,1 +2106,0.34943249821662903,0.29361000657081604,0.28263869881629944,0.22564102709293365,988.734619140625,1e-05,0.15261363983154297,2.8366687297821045,81.14050197601318,1 +2107,0.3457181453704834,0.18874748051166534,0.17979219555854797,0.21212121844291687,917.6026611328125,1e-05,0.18529589474201202,3.0630176067352295,81.14050197601318,1 +2108,0.2105673849582672,0.24015024304389954,0.20674994587898254,0.20559440553188324,857.74267578125,1e-05,0.32319992780685425,3.0610458850860596,81.14050197601318,1 +2109,0.2355383336544037,0.36560532450675964,0.36550912261009216,0.2750582695007324,972.231689453125,1e-05,0.17366908490657806,3.069699764251709,81.14050197601318,1 +2110,0.316879540681839,0.2701960504055023,0.2607520520687103,0.11864801496267319,523.0420532226562,1e-05,0.15116271376609802,3.4388418197631836,81.14050197601318,1 +2111,0.41918283700942993,0.5841879844665527,0.5766371488571167,0.23286713659763336,217.11199951171875,1e-05,0.15261100232601166,3.1918280124664307,81.14050197601318,1 +2112,0.18502382934093475,0.2558539807796478,0.25372883677482605,0.16689977049827576,882.5809936523438,1e-05,0.15624554455280304,2.8573150634765625,81.14050197601318,1 +2113,0.11457443237304688,0.16645176708698273,0.1698443740606308,0.24988344311714172,850.6163940429688,1e-05,0.19448579847812653,3.0502500534057617,81.14050197601318,1 +2114,0.1538928747177124,0.33531516790390015,0.3518606722354889,0.18531468510627747,970.6856079101562,1e-05,0.17319472134113312,3.0654420852661133,81.14050197601318,1 +2115,0.16984526813030243,0.1523282676935196,0.16380615532398224,0.17575757205486298,959.7694091796875,1e-05,0.1318005919456482,3.4246160984039307,81.14050197601318,1 +2116,0.17281629145145416,0.31024324893951416,0.31546398997306824,0.2125874161720276,348.26116943359375,1e-05,0.23034746944904327,3.2829999923706055,81.14050197601318,1 +2117,0.17188005149364471,0.15022461116313934,0.15688523650169373,0.13916084170341492,916.3778686523438,1e-05,0.1308320015668869,3.060204029083252,81.14050197601318,1 +2118,0.2378992736339569,0.3320983946323395,0.341827392578125,0.23473192751407623,390.0654296875,1e-05,0.20396651327610016,2.8441574573516846,81.14050197601318,1 +2119,0.23166131973266602,0.27096298336982727,0.2635252773761749,0.25314685702323914,871.8681030273438,1e-05,0.14720383286476135,3.575681447982788,81.14050197601318,1 +2120,0.25067999958992004,0.20586402714252472,0.23063713312149048,0.26247087121009827,967.6831665039062,1e-05,0.14821286499500275,3.0682172775268555,81.14050197601318,1 +2121,0.13866417109966278,0.10601569712162018,0.10777048766613007,0.2270396202802658,988.5972900390625,1e-05,0.3263286352157593,3.1944847106933594,81.14050197601318,1 +2122,0.1966182440519333,0.34585896134376526,0.3459723889827728,0.17039626836776733,999.53125,1e-05,0.24952302873134613,3.6834819316864014,81.14050197601318,1 +2123,0.19620652496814728,0.2587776482105255,0.2434915155172348,0.17692308127880096,926.6471557617188,1e-05,0.4130932092666626,3.197174310684204,81.14050197601318,1 +2124,0.27176207304000854,0.3630368113517761,0.35796627402305603,0.17599067091941833,393.64630126953125,1e-05,0.13663147389888763,2.8724329471588135,81.14050197601318,1 +2125,0.21193748712539673,0.3193240463733673,0.2993886470794678,0.1818181872367859,894.70751953125,1e-05,0.14574605226516724,3.3085241317749023,81.14050197601318,1 +2126,0.24158146977424622,0.174340158700943,0.17182360589504242,0.25081583857536316,821.8599853515625,1e-05,0.1444588303565979,3.4494993686676025,81.14050197601318,1 +2127,0.3491201102733612,0.1739111989736557,0.16905398666858673,0.1934731900691986,681.2896118164062,1e-05,0.14817191660404205,3.2957346439361572,81.14050197601318,1 +2128,0.2948998808860779,0.2167462557554245,0.20544888079166412,0.19207459688186646,771.8865966796875,1e-05,0.16929829120635986,3.5159239768981934,81.14050197601318,1 +2129,0.3470807671546936,0.43877702951431274,0.4136061370372772,0.24871794879436493,980.0068969726562,1e-05,0.13815195858478546,2.8646352291107178,81.14050197601318,1 +2130,0.3163737654685974,0.3100380599498749,0.30821719765663147,0.26247087121009827,998.2254028320312,1e-05,0.15826000273227692,2.8868637084960938,81.14050197601318,1 +2131,0.27164608240127563,0.1821487545967102,0.18002094328403473,0.1375291347503662,763.1554565429688,1e-05,0.2036607712507248,3.212005376815796,81.14050197601318,1 +2132,0.19228170812129974,0.17038662731647491,0.16069425642490387,0.18881118297576904,903.6668701171875,1e-05,0.3017231822013855,3.1285977363586426,81.14050197601318,1 +2133,0.22201943397521973,0.3181273639202118,0.3019561469554901,0.1934731900691986,750.1998901367188,1e-05,0.21143729984760284,3.2727608680725098,81.14050197601318,1 +2134,0.14764274656772614,0.19236862659454346,0.1967765837907791,0.1734265685081482,872.3140258789062,1e-05,0.15319204330444336,3.620836019515991,81.14050197601318,1 +2135,0.36345434188842773,0.11478948593139648,0.1237194612622261,0.2745920717716217,797.257080078125,1e-05,0.18809331953525543,2.957094192504883,81.14050197601318,1 +2136,0.17102041840553284,0.3392988443374634,0.31867527961730957,0.21608391404151917,973.9156494140625,1e-05,0.12487863004207611,2.9574780464172363,81.14050197601318,1 +2137,0.26029664278030396,0.3252284824848175,0.32977792620658875,0.24172493815422058,991.69189453125,1e-05,0.20905838906764984,3.328615665435791,81.14050197601318,1 +2138,0.3903745710849762,0.1385909765958786,0.13400626182556152,0.053613051772117615,848.5123291015625,1e-05,0.1880214363336563,4.437566518783569,81.14050197601318,1 +2139,0.14784494042396545,0.21645641326904297,0.22308886051177979,0.25244754552841187,427.6461486816406,1e-05,0.14434315264225006,5.9546966552734375,81.14050197601318,1 +2140,0.09485816210508347,0.2654745280742645,0.2516760528087616,0.1878787875175476,939.0036010742188,1e-05,0.1260114461183548,5.976582050323486,81.14050197601318,1 +2141,0.19835755228996277,0.5584073662757874,0.5535336136817932,0.2186480164527893,158.9905548095703,1e-05,0.18440398573875427,5.968650817871094,81.14050197601318,1 +2142,0.22896403074264526,0.17388053238391876,0.1743372529745102,0.20256410539150238,951.0648803710938,1e-05,0.14703024923801422,5.974612474441528,81.14050197601318,1 +2143,0.1828485131263733,0.13302548229694366,0.13991817831993103,0.2652680575847626,714.6185302734375,1e-05,0.14979256689548492,5.903323650360107,81.14050197601318,1 +2144,0.22850140929222107,0.1878374069929123,0.18479403853416443,0.15571095049381256,695.4873657226562,1e-05,0.23634010553359985,5.046164512634277,81.14050197601318,1 +2145,0.22194582223892212,0.2752878665924072,0.26443836092948914,0.23240093886852264,846.3767700195312,1e-05,0.13010777533054352,6.00155782699585,81.14050197601318,1 +2146,0.24654731154441833,0.21512742340564728,0.21589171886444092,0.23123542964458466,976.5382080078125,1e-05,0.12333850562572479,4.711169958114624,81.14050197601318,1 +2147,0.30166900157928467,0.31807929277420044,0.3118055760860443,0.22773893177509308,430.87518310546875,1e-05,0.14679312705993652,2.8617186546325684,81.14050197601318,1 +2148,0.2790922522544861,0.28321975469589233,0.27550992369651794,0.26643356680870056,430.87518310546875,1e-05,0.1476515382528305,3.095160722732544,81.14050197601318,1 +2149,0.17744185030460358,0.23736737668514252,0.2295638620853424,0.1930069923400879,962.1061401367188,1e-05,0.12300192564725876,3.069101333618164,81.14050197601318,1 +2150,0.1701263189315796,0.23116180300712585,0.22466327250003815,0.08974359184503555,961.14013671875,1e-05,0.16617710888385773,3.408501148223877,81.14050197601318,1 +2151,0.07932189106941223,0.2596607506275177,0.2607268989086151,0.08624708652496338,971.5481567382812,1e-05,0.14153999090194702,3.1914589405059814,81.14050197601318,1 +2152,0.21430447697639465,0.1790515035390854,0.17285670340061188,0.19393938779830933,925.2398681640625,1e-05,0.13732847571372986,3.161665201187134,81.14050197601318,1 +2153,0.24081456661224365,0.18927475810050964,0.1742241531610489,0.21841491758823395,949.5288696289062,1e-05,0.15002025663852692,2.94075870513916,81.14050197601318,1 +2154,0.4000506103038788,0.18989604711532593,0.1857869029045105,0.18088577687740326,702.8627319335938,1e-05,0.16031986474990845,3.1642589569091797,81.14050197601318,1 +2155,0.193423792719841,0.17558728158473969,0.18954141438007355,0.18834498524665833,938.756103515625,1e-05,0.2415640652179718,3.1588518619537354,81.14050197601318,1 +2156,0.22041787207126617,0.2658255398273468,0.26579582691192627,0.19114218652248383,976.2150268554688,1e-05,0.1710193157196045,3.177389621734619,81.14050197601318,1 +2157,0.38303136825561523,0.19698072969913483,0.1951913684606552,0.23892773687839508,975.2377319335938,1e-05,0.33249208331108093,3.3680644035339355,81.14050197601318,1 +2158,0.2792702913284302,0.21831342577934265,0.2118920236825943,0.19650349020957947,816.7084350585938,1e-05,0.2565291225910187,3.161792755126953,81.14050197601318,1 +2159,0.3539181649684906,0.2081139087677002,0.2001100480556488,0.23286713659763336,926.0864868164062,1e-05,0.7994207739830017,2.907546281814575,81.14050197601318,1 +2160,0.3555614650249481,0.26392486691474915,0.26044148206710815,0.17715618014335632,599.4783325195312,1e-05,0.23216748237609863,3.062185049057007,81.14050197601318,1 +2161,0.46103280782699585,0.5727320313453674,0.5805352330207825,0.23123542964458466,177.18624877929688,1e-05,0.1179778128862381,3.273159980773926,81.14050197601318,1 +2162,0.3249426484107971,0.25176939368247986,0.24123458564281464,0.1895104944705963,565.9164428710938,1e-05,0.12488877773284912,3.86995267868042,81.14050197601318,1 +2163,0.11631500720977783,0.12876960635185242,0.124918133020401,0.10209789872169495,832.2701416015625,1e-05,0.16744832694530487,3.5673880577087402,81.14050197601318,1 +2164,0.187770813703537,0.20427699387073517,0.19716744124889374,0.2130536139011383,727.9061279296875,1e-05,0.10812114924192429,2.8736979961395264,81.14050197601318,1 +2165,0.12809205055236816,0.16756124794483185,0.1744077056646347,0.1918414980173111,961.7210693359375,1e-05,0.19790400564670563,2.930316686630249,81.14050197601318,1 +2166,0.15927204489707947,0.25986742973327637,0.24817544221878052,0.1850815862417221,909.3855590820312,1e-05,0.17016492784023285,3.212132692337036,81.14050197601318,1 +2167,0.2871673107147217,0.13508282601833344,0.12643320858478546,0.2282051295042038,872.758544921875,1e-05,0.1246589943766594,3.1820850372314453,81.14050197601318,1 +2168,0.1477063000202179,0.13827863335609436,0.15101802349090576,0.27599066495895386,884.6192626953125,1e-05,0.17479276657104492,3.794757127761841,81.14050197601318,1 +2169,0.3242175579071045,0.2356739044189453,0.23720039427280426,0.20000000298023224,807.27197265625,1e-05,0.16177000105381012,4.257937908172607,81.14050197601318,1 +2170,0.18457217514514923,0.302987664937973,0.2985600233078003,0.18158508837223053,986.3638916015625,1e-05,0.12708315253257751,3.1686408519744873,81.14050197601318,1 +2171,0.27995985746383667,0.2553878128528595,0.2473146915435791,0.18321678042411804,964.7545166015625,1e-05,1.0063412189483643,2.8730201721191406,81.14050197601318,1 +2172,0.24904946982860565,0.33202245831489563,0.3223598897457123,0.15734265744686127,983.0303955078125,1e-05,0.10831177979707718,3.4231202602386475,81.14050197601318,1 +2173,0.1700609177350998,0.16658900678157806,0.1815146952867508,0.20606060326099396,974.4140625,1e-05,0.18146546185016632,3.1242403984069824,81.14050197601318,1 +2174,0.25084200501441956,0.34409016370773315,0.34582507610321045,0.1974359005689621,990.630615234375,1e-05,0.1398811936378479,2.8552374839782715,81.14050197601318,1 +2175,0.2947523891925812,0.22598262131214142,0.2181566208600998,0.19370628893375397,952.3612670898438,1e-05,0.15808367729187012,3.561401605606079,81.14050197601318,1 +2176,0.20817215740680695,0.2569263279438019,0.27447572350502014,0.24382284283638,986.079833984375,1e-05,0.1288895457983017,2.8427481651306152,81.14050197601318,1 +2177,0.34407222270965576,0.3568570911884308,0.36876600980758667,0.18834498524665833,986.3638916015625,1e-05,0.16534395515918732,2.8438892364501953,81.14050197601318,1 +2178,0.2773704528808594,0.2402886301279068,0.22744137048721313,0.2668997645378113,697.9737548828125,1e-05,0.185401052236557,3.344403028488159,81.14050197601318,1 +2179,0.2192259132862091,0.38513022661209106,0.3651505410671234,0.1902097910642624,977.9759521484375,1e-05,0.2242744266986847,3.471440553665161,81.14050197601318,1 +2180,0.25369793176651,0.41544216871261597,0.40957143902778625,0.21351981163024902,976.0529174804688,1e-05,0.8375013470649719,3.3879923820495605,81.14050197601318,1 +2181,0.2571873664855957,0.22584685683250427,0.2242521345615387,0.2097902148962021,404.18499755859375,1e-05,0.16521571576595306,3.7357964515686035,81.14050197601318,1 +2182,0.22094660997390747,0.474731981754303,0.4747319519519806,0.0,177.18624877929688,1e-05,0.11694283038377762,2.907355308532715,81.14050197601318,1 +2183,0.2620806097984314,0.31712794303894043,0.30126479268074036,0.09417249262332916,904.0114135742188,1e-05,0.17745599150657654,3.00807523727417,81.14050197601318,1 +2184,0.12313223630189896,0.4179733693599701,0.3938769996166229,0.16596736013889313,986.221923828125,1e-05,0.1650565266609192,3.599745988845825,81.14050197601318,1 +2185,0.13427172601222992,0.2072838991880417,0.20235788822174072,0.2421911358833313,879.6704711914062,1e-05,0.1816278100013733,3.376417398452759,81.14050197601318,1 +2186,0.2639743983745575,0.3383985757827759,0.3211519420146942,0.22843822836875916,927.482421875,1e-05,0.21202467381954193,3.271200656890869,81.14050197601318,1 +2187,0.2176181972026825,0.2416016012430191,0.23044826090335846,0.2186480164527893,915.4500122070312,1e-05,0.16664959490299225,3.5448031425476074,81.14050197601318,1 +2188,0.2650822699069977,0.24949117004871368,0.22928795218467712,0.1487179547548294,972.0613403320312,1e-05,0.11541441828012466,2.971379280090332,81.14050197601318,1 +2189,0.27708375453948975,0.2433936595916748,0.237282857298851,0.1118881106376648,590.026123046875,1e-05,0.15397123992443085,2.9667327404022217,81.14050197601318,1 +2190,0.34423577785491943,0.367504745721817,0.36320823431015015,0.18414919078350067,382.7987976074219,1e-05,0.29551854729652405,3.4131031036376953,81.14050197601318,1 +2191,0.19756895303726196,0.1520022600889206,0.1481034904718399,0.1382284313440323,896.5547485351562,1e-05,0.19089511036872864,3.305917978286743,81.14050197601318,1 +2192,0.15354156494140625,0.19733919203281403,0.1920609176158905,0.1722610741853714,799.454345703125,1e-05,0.15143683552742004,3.4890575408935547,81.14050197601318,1 +2193,0.3665945827960968,0.309867799282074,0.29440590739250183,0.2265734225511551,660.37890625,1e-05,0.37890076637268066,3.442892074584961,81.14050197601318,1 +2194,0.15736466646194458,0.20831851661205292,0.20714513957500458,0.2426573485136032,966.2316284179688,1e-05,0.28061556816101074,2.9338676929473877,81.14050197601318,1 +2195,0.33899733424186707,0.24494005739688873,0.23769092559814453,0.13939394056797028,853.715087890625,1e-05,0.3075404763221741,2.971318006515503,81.14050197601318,1 +2196,0.05582492798566818,0.2774227261543274,0.273406058549881,0.2554778456687927,981.9857788085938,1e-05,0.16216453909873962,3.61790132522583,81.14050197601318,1 +2197,0.31581059098243713,0.28294938802719116,0.26284366846084595,0.16433566808700562,875.8281860351562,1e-05,0.18532538414001465,4.176564455032349,81.14050197601318,1 +2198,0.14481189846992493,0.34940966963768005,0.3487868010997772,0.18554778397083282,989.0084838867188,1e-05,0.14619044959545135,3.1905548572540283,81.14050197601318,1 +2199,0.23147982358932495,0.19571901857852936,0.19719290733337402,0.17179487645626068,935.4796752929688,1e-05,0.19961850345134735,3.148900032043457,81.14050197601318,1 +2200,0.2558808922767639,0.3542911410331726,0.3206067979335785,0.2018647938966751,950.4097290039062,1e-05,0.16632157564163208,2.8672053813934326,81.14050197601318,1 +2201,0.2520809769630432,0.26088765263557434,0.24752262234687805,0.1946386992931366,934.7079467773438,1e-05,0.14333905279636383,2.8635480403900146,81.14050197601318,1 +2202,0.21235500276088715,0.24377350509166718,0.2335614114999771,0.1946386992931366,873.64306640625,1e-05,0.333024263381958,3.4350597858428955,81.14050197601318,1 +2203,0.1824112981557846,0.18891218304634094,0.17812587320804596,0.2209790199995041,851.6567993164062,1e-05,0.12306512147188187,3.060936450958252,81.14050197601318,1 +2204,0.2346028983592987,0.21894095838069916,0.20591089129447937,0.25617715716362,977.4996337890625,1e-05,0.5588826537132263,3.228071689605713,81.14050197601318,1 +2205,0.27405405044555664,0.2654131054878235,0.2574092745780945,0.24125874042510986,695.4873657226562,1e-05,0.1350916475057602,3.363856554031372,81.14050197601318,1 +2206,0.2063473016023636,0.2269713282585144,0.21045070886611938,0.15967366099357605,957.5706176757812,1e-05,0.5870863795280457,3.091247320175171,81.14050197601318,1 +2207,0.2434438019990921,0.26369333267211914,0.27704378962516785,0.18554778397083282,956.142333984375,1e-05,0.19985708594322205,3.0957422256469727,81.14050197601318,1 +2208,0.20378588140010834,0.24852055311203003,0.23879772424697876,0.23519814014434814,945.68896484375,1e-05,0.314618855714798,3.6352763175964355,81.14050197601318,1 +2209,0.18619416654109955,0.2519361972808838,0.2458166629076004,0.19976690411567688,903.3214111328125,1e-05,0.14890249073505402,6.9519569873809814,81.14050197601318,1 +2210,0.1805465966463089,0.27073660492897034,0.2644738554954529,0.12121211737394333,980.3147583007812,1e-05,0.13304220139980316,8.301285743713379,81.14050197601318,1 +2211,0.28013885021209717,0.19185853004455566,0.18589802086353302,0.10256410390138626,859.7134399414062,1e-05,0.17486204206943512,7.6093292236328125,81.14050197601318,1 +2212,0.29467859864234924,0.2145433872938156,0.20084205269813538,0.14102564752101898,952.1465454101562,1e-05,0.22098994255065918,7.757611036300659,81.14050197601318,1 +2213,0.23441556096076965,0.2177073210477829,0.215958833694458,0.18111887574195862,852.1741943359375,1e-05,0.14923664927482605,8.34040093421936,81.14050197601318,1 +2214,0.25203636288642883,0.2755691111087799,0.2689563035964966,0.15198135375976562,988.18359375,1e-05,0.1480550915002823,8.144867181777954,81.14050197601318,1 +2215,0.23384439945220947,0.17792609333992004,0.1779826432466507,0.21002331376075745,706.4580688476562,1e-05,0.15583765506744385,5.049036264419556,81.14050197601318,1 +2216,0.09843835979700089,0.3669756352901459,0.3567318618297577,0.2142191082239151,984.643310546875,1e-05,0.35936808586120605,3.467268943786621,81.14050197601318,1 +2217,0.18443675339221954,0.2699377238750458,0.25253310799598694,0.1230769231915474,916.991943359375,1e-05,0.15823517739772797,3.1043641567230225,81.14050197601318,1 +2218,0.30915364623069763,0.22472701966762543,0.22899432480335236,0.19137528538703918,987.6286010742188,1e-05,0.18561841547489166,2.858297824859619,81.14050197601318,1 +2219,0.2928522229194641,0.2686242163181305,0.2625340521335602,0.16083915531635284,932.6204223632812,1e-05,0.33260899782180786,3.3567748069763184,81.14050197601318,1 +2220,0.33359578251838684,0.16732506453990936,0.16884930431842804,0.25244754552841187,975.7278442382812,1e-05,0.16032123565673828,3.190147638320923,81.14050197601318,1 +2221,0.2619722783565521,0.25735408067703247,0.23987868428230286,0.2708624601364136,956.75732421875,1e-05,0.31417006254196167,3.0664470195770264,81.14050197601318,1 +2222,0.1823844164609909,0.11659124493598938,0.12540997564792633,0.14685314893722534,907.7332763671875,1e-05,0.20440609753131866,3.5228421688079834,81.14050197601318,1 +2223,0.22700552642345428,0.09738989174365997,0.10860283672809601,0.2142191082239151,691.7044067382812,1e-05,0.14843423664569855,3.320465087890625,81.14050197601318,1 +2224,0.28181278705596924,0.5583236217498779,0.5650196075439453,0.16317015886306763,158.9905548095703,1e-05,0.1434313803911209,3.0435574054718018,81.14050197601318,1 +2225,0.15429037809371948,0.28349635004997253,0.2673082649707794,0.20372959971427917,935.9909057617188,1e-05,0.1355937272310257,3.6982078552246094,81.14050197601318,1 +2226,0.2869259715080261,0.3313847482204437,0.32077354192733765,0.24312354624271393,979.6979370117188,1e-05,0.2160845696926117,3.4204020500183105,81.14050197601318,1 +2227,0.33941295742988586,0.12093004584312439,0.13001935184001923,0.23729602992534637,845.2969360351562,1e-05,0.14483846724033356,3.2609519958496094,81.14050197601318,1 +2228,0.23490558564662933,0.12016543745994568,0.11933440715074539,0.2170163094997406,720.25927734375,1e-05,0.1736668050289154,3.5487005710601807,81.14050197601318,1 +2229,0.2174035608768463,0.32988041639328003,0.33933180570602417,0.19114218652248383,336.031982421875,1e-05,0.21533171832561493,4.1807541847229,81.14050197601318,1 +2230,0.2902713716030121,0.24159611761569977,0.22399930655956268,0.22517482936382294,808.654296875,1e-05,0.3515429198741913,4.136538743972778,81.14050197601318,1 +2231,0.2109001874923706,0.1857319474220276,0.178067147731781,0.18974359333515167,578.2326049804688,1e-05,0.2549988627433777,3.697312355041504,81.14050197601318,1 +2232,0.12337829172611237,0.5221573114395142,0.49232128262519836,0.1678321659564972,989.1450805664062,1e-05,0.13294164836406708,3.367063283920288,81.14050197601318,1 +2233,0.23475481569766998,0.2711690664291382,0.2555806040763855,0.23030303418636322,837.505126953125,1e-05,0.12273218482732773,3.535548448562622,81.14050197601318,1 +2234,0.1314244121313095,0.1721106320619583,0.18805637955665588,0.21398600935935974,985.6517944335938,1e-05,0.14538615942001343,3.7918572425842285,81.14050197601318,1 +2235,0.2557946443557739,0.3338853120803833,0.3186142146587372,0.2041957974433899,926.3671875,1e-05,0.13869310915470123,4.335411071777344,81.14050197601318,1 +2236,0.22893770039081573,0.1348308026790619,0.1379823237657547,0.21165500581264496,841.452880859375,1e-05,0.18536068499088287,4.176775217056274,81.14050197601318,1 +2237,0.40795308351516724,0.2399664968252182,0.23869268596172333,0.13356643915176392,865.928466796875,1e-05,0.15579763054847717,3.7270731925964355,81.14050197601318,1 +2238,0.1450769454240799,0.20222611725330353,0.22074536979198456,0.20046620070934296,996.2799072265625,1e-05,0.12579849362373352,3.1929337978363037,81.14050197601318,1 +2239,0.3456517457962036,0.12595893442630768,0.12726086378097534,0.05244755372405052,819.3053588867188,1e-05,0.2358577847480774,3.182316303253174,81.14050197601318,1 +2240,0.2034664750099182,0.38130509853363037,0.3826383650302887,0.18438228964805603,407.6315612792969,1e-05,0.09712820500135422,3.073127508163452,81.14050197601318,1 +2241,0.16491737961769104,0.18799495697021484,0.19016583263874054,0.22354312241077423,887.0220336914062,1e-05,0.22214028239250183,2.8506386280059814,81.14050197601318,1 +2242,0.23120974004268646,0.13896942138671875,0.13875290751457214,0.010489510372281075,928.03564453125,1e-05,0.3557370901107788,3.558002471923828,81.14050197601318,1 +2243,0.1864110231399536,0.31575438380241394,0.3036172389984131,0.1818181872367859,847.4485473632812,1e-05,0.1695471554994583,3.4209017753601074,81.14050197601318,1 +2244,0.33141064643859863,0.37848401069641113,0.3680873513221741,0.2214452177286148,379.11187744140625,1e-05,0.16277721524238586,3.1887919902801514,81.14050197601318,1 +2245,0.22899937629699707,0.25793811678886414,0.26355642080307007,0.17179487645626068,897.28564453125,1e-05,0.22011840343475342,3.3657066822052,81.14050197601318,1 +2246,0.22288697957992554,0.2414109855890274,0.2158951759338379,0.2242424190044403,930.488525390625,1e-05,0.18972298502922058,3.1040570735931396,81.14050197601318,1 +2247,0.2915864586830139,0.29043975472450256,0.28344881534576416,0.11305361241102219,917.6026611328125,1e-05,0.4008876383304596,2.8405702114105225,81.14050197601318,1 +2248,0.13067208230495453,0.19894029200077057,0.196599081158638,0.13939394056797028,947.7415161132812,1e-05,0.13694165647029877,3.11930775642395,81.14050197601318,1 +2249,0.2624673545360565,0.2697661817073822,0.24615277349948883,0.2142191082239151,928.31103515625,1e-05,0.1993737369775772,3.377329111099243,81.14050197601318,1 +2250,0.2321143001317978,0.2294352799654007,0.2053644210100174,0.17832167446613312,886.226318359375,1e-05,0.27039483189582825,2.851548671722412,81.14050197601318,1 +2251,0.254326730966568,0.24529454112052917,0.24736864864826202,0.23146852850914001,982.1359252929688,1e-05,0.2993982434272766,3.419875144958496,81.14050197601318,1 +2252,0.10240954160690308,0.1534680277109146,0.17180319130420685,0.1662004590034485,983.178466796875,1e-05,0.13841111958026886,3.083613395690918,81.14050197601318,1 +2253,0.2179289311170578,0.11066605150699615,0.11354788392782211,0.10979020595550537,627.6343994140625,1e-05,0.15578995645046234,2.8553738594055176,81.14050197601318,1 +2254,0.3131788671016693,0.29761794209480286,0.29153910279273987,0.22004662454128265,608.6077880859375,1e-05,0.24050669372081757,3.0963473320007324,81.14050197601318,1 +2255,0.3434337079524994,0.12155374884605408,0.12264638394117355,0.09906759858131409,742.382080078125,1e-05,0.19101542234420776,3.3192665576934814,81.14050197601318,1 +2256,0.369803786277771,0.28690993785858154,0.27959972620010376,0.24125874042510986,978.2918701171875,1e-05,0.148750439286232,2.8543012142181396,81.14050197601318,1 +2257,0.1798465996980667,0.2675560414791107,0.2759404182434082,0.14895105361938477,961.334228515625,1e-05,0.19995205104351044,3.416947364807129,81.14050197601318,1 +2258,0.1603131890296936,0.1517154723405838,0.15396174788475037,0.1515151560306549,797.99267578125,1e-05,0.8558165431022644,3.088608741760254,81.14050197601318,1 +2259,0.35857704281806946,0.18914102017879486,0.18549978733062744,0.24801865220069885,824.37353515625,1e-05,0.1512223184108734,2.8590734004974365,81.14050197601318,1 +2260,0.18479111790657043,0.281089186668396,0.26451852917671204,0.22867132723331451,674.5276489257812,1e-05,0.32434526085853577,3.4164204597473145,81.14050197601318,1 +2261,0.17893849313259125,0.1813940852880478,0.19303953647613525,0.1258741319179535,818.6600952148438,1e-05,0.130519837141037,3.299041509628296,81.14050197601318,1 +2262,0.25891321897506714,0.2603907883167267,0.24339239299297333,0.28275057673454285,819.3053588867188,1e-05,0.23750895261764526,2.8537914752960205,81.14050197601318,1 +2263,0.12235313653945923,0.1389009952545166,0.129544198513031,0.24428904056549072,895.0792846679688,1e-05,0.20888075232505798,3.115129232406616,81.14050197601318,1 +2264,0.284192830324173,0.35122668743133545,0.35007303953170776,0.19953380525112152,976.2150268554688,1e-05,0.18181906640529633,3.0686910152435303,81.14050197601318,1 +2265,0.263599157333374,0.47928494215011597,0.47396326065063477,0.22494173049926758,997.1378173828125,1e-05,0.3231566250324249,2.8435723781585693,81.14050197601318,1 +2266,0.30193930864334106,0.41798630356788635,0.41397544741630554,0.250582754611969,323.4160461425781,1e-05,0.17559918761253357,3.5109570026397705,81.14050197601318,1 +2267,0.1874891072511673,0.1880733072757721,0.18310576677322388,0.2013985961675644,978.6064453125,1e-05,0.19951125979423523,3.1364150047302246,81.14050197601318,1 +2268,0.23967991769313812,0.18906515836715698,0.18340441584587097,0.20163169503211975,884.2141723632812,1e-05,0.2044806182384491,3.039541482925415,81.14050197601318,1 +2269,0.2056630402803421,0.2932121753692627,0.27460992336273193,0.26923078298568726,911.3367309570312,1e-05,0.22433918714523315,3.1154346466064453,81.14050197601318,1 +2270,0.29293423891067505,0.06991837918758392,0.07713598012924194,0.16293705999851227,652.9728393554688,1e-05,0.17284362018108368,3.114932060241699,81.14050197601318,1 +2271,0.24092909693717957,0.22649265825748444,0.218143492937088,0.22400932013988495,876.2608642578125,1e-05,0.14370408654212952,2.8546040058135986,81.14050197601318,1 +2272,0.19871309399604797,0.2840288281440735,0.259476900100708,0.2543123662471771,943.1180419921875,1e-05,0.13937696814537048,3.3952689170837402,81.14050197601318,1 +2273,0.32911261916160583,0.32223090529441833,0.3140374422073364,0.2058275043964386,993.5120239257812,1e-05,0.24673843383789062,3.414543628692627,81.14050197601318,1 +2274,0.18759196996688843,0.2483416199684143,0.23157979547977448,0.20769231021404266,882.9913330078125,1e-05,0.3950275778770447,3.0641558170318604,81.14050197601318,1 +2275,0.21107009053230286,0.10865617543458939,0.12131679803133011,0.13333334028720856,969.6383056640625,1e-05,0.22818264365196228,3.1464455127716064,81.14050197601318,1 +2276,0.18264418840408325,0.29363977909088135,0.2864574193954468,0.15407925844192505,995.4110107421875,1e-05,0.1734076887369156,3.110502004623413,81.14050197601318,1 +2277,0.309811532497406,0.3706420958042145,0.3871014714241028,0.22960372269153595,340.1504821777344,1e-05,0.15506933629512787,2.8579821586608887,81.14050197601318,1 +2278,0.24036958813667297,0.25502514839172363,0.2528660297393799,0.1298368275165558,955.9364624023438,1e-05,0.24561865627765656,3.4258906841278076,81.14050197601318,1 +2279,0.18577387928962708,0.24809131026268005,0.23113752901554108,0.19370628893375397,461.6126403808594,1e-05,0.19502660632133484,3.113689422607422,81.14050197601318,1 +2280,0.2764398455619812,0.2931687831878662,0.2758776545524597,0.19953380525112152,749.2398071289062,1e-05,0.21563202142715454,3.2875781059265137,81.14050197601318,1 +2281,0.1520681083202362,0.37179988622665405,0.3672865331172943,0.20606060326099396,988.5972900390625,1e-05,0.5016027688980103,3.1397557258605957,81.14050197601318,1 +2282,0.14218036830425262,0.1255815625190735,0.11993812769651413,0.14731934666633606,781.0278930664062,1e-05,0.14201101660728455,2.840919256210327,81.14050197601318,1 +2283,0.3347319960594177,0.17523612082004547,0.18181385099887848,0.21165500581264496,936.7528076171875,1e-05,0.13460280001163483,2.8367156982421875,81.14050197601318,1 +2284,0.13292893767356873,0.3118307888507843,0.3025461733341217,0.19696970283985138,961.5278930664062,1e-05,0.23739978671073914,3.508201837539673,81.14050197601318,1 +2285,0.13681937754154205,0.17693637311458588,0.17024235427379608,0.23636363446712494,873.2015991210938,1e-05,0.27262967824935913,3.15537428855896,81.14050197601318,1 +2286,0.4252088665962219,0.3971632122993469,0.3980571925640106,0.145454540848732,319.1216125488281,1e-05,0.2046179175376892,3.3209803104400635,81.14050197601318,1 +2287,0.24666805565357208,0.3824825584888458,0.37472212314605713,0.16876456141471863,993.5120239257812,1e-05,0.1630481630563736,3.366729974746704,81.14050197601318,1 +2288,0.2399093508720398,0.23667077720165253,0.22706788778305054,0.1319347321987152,879.6704711914062,1e-05,0.1398075520992279,2.8552114963531494,81.14050197601318,1 +2289,0.3976559638977051,0.20412476360797882,0.20014441013336182,0.1958041936159134,949.9702758789062,1e-05,0.16498640179634094,3.21663236618042,81.14050197601318,1 +2290,0.29132673144340515,0.2647235691547394,0.27456793189048767,0.2778554856777191,475.9952392578125,1e-05,0.16224947571754456,3.403111696243286,81.14050197601318,1 +2291,0.3197326064109802,0.6405909061431885,0.6398778557777405,0.20792540907859802,992.3473510742188,1e-05,0.14398129284381866,3.10774302482605,81.14050197601318,1 +2292,0.1947350800037384,0.1381632685661316,0.1312420815229416,0.2298368364572525,844.7539672851562,1e-05,0.1667707860469818,3.5330591201782227,81.14050197601318,1 +2293,0.18501447141170502,0.28295624256134033,0.2766323387622833,0.24242423474788666,999.177734375,1e-05,0.1877879649400711,3.3359692096710205,81.14050197601318,1 +2294,0.23381580412387848,0.10415802150964737,0.10359036922454834,0.20163169503211975,586.15087890625,1e-05,0.13791359961032867,2.8391451835632324,81.14050197601318,1 +2295,0.19678696990013123,0.25275492668151855,0.24152624607086182,0.22867132723331451,953.8506469726562,1e-05,0.24818794429302216,3.2097361087799072,81.14050197601318,1 +2296,0.1460518091917038,0.41265198588371277,0.40335705876350403,0.20722611248493195,982.1359252929688,1e-05,0.16077500581741333,3.1047842502593994,81.14050197601318,1 +2297,0.15593171119689941,0.19242925941944122,0.1943693608045578,0.22564102709293365,746.3303833007812,1e-05,0.1331629455089569,2.8583245277404785,81.14050197601318,1 +2298,0.2357274293899536,0.21308337152004242,0.21511076390743256,0.25407925248146057,901.5783081054688,1e-05,0.22406050562858582,3.376760244369507,81.14050197601318,1 +2299,0.2551414966583252,0.13412858545780182,0.14500829577445984,0.22773893177509308,527.8575439453125,1e-05,0.4937797784805298,3.117548942565918,81.14050197601318,1 +2300,0.1970403492450714,0.3987821042537689,0.37213265895843506,0.24428904056549072,995.6604614257812,1e-05,0.18733027577400208,2.8495230674743652,81.14050197601318,1 +2301,0.16274124383926392,0.17280229926109314,0.17447538673877716,0.1202797219157219,898.011962890625,1e-05,0.1290629804134369,3.2032036781311035,81.14050197601318,1 +2302,0.24826191365718842,0.29278823733329773,0.2764687240123749,0.25874125957489014,947.5157470703125,1e-05,0.18485604226589203,3.114269495010376,81.14050197601318,1 +2303,0.3316320776939392,0.2449910044670105,0.24935242533683777,0.14172494411468506,489.7753601074219,1e-05,0.1431860625743866,2.8440799713134766,81.14050197601318,1 +2304,0.4296146631240845,0.24743449687957764,0.24250411987304688,0.11864801496267319,515.6737670898438,1e-05,0.1763177067041397,3.3772225379943848,81.14050197601318,1 +2305,0.14496855437755585,0.23591065406799316,0.2177908718585968,0.22494173049926758,807.9645385742188,1e-05,0.14705497026443481,3.0528664588928223,81.14050197601318,1 +2306,0.228362038731575,0.14970801770687103,0.14376990497112274,0.1846153885126114,896.5547485351562,1e-05,0.16873519122600555,2.8505351543426514,81.14050197601318,1 +2307,0.1668759137392044,0.2125745564699173,0.21245814859867096,0.18927739560604095,957.9745483398438,1e-05,0.4295598268508911,3.167267322540283,81.14050197601318,1 +2308,0.25201529264450073,0.22216609120368958,0.2038431018590927,0.21655011177062988,900.1648559570312,1e-05,0.17005819082260132,3.101421356201172,81.14050197601318,1 +2309,0.1615847498178482,0.18853913247585297,0.18844377994537354,0.19720280170440674,904.0114135742188,1e-05,0.4873042702674866,2.8500783443450928,81.14050197601318,1 +2310,0.18982233107089996,0.1963934749364853,0.185239776968956,0.15967366099357605,568.0068969726562,1e-05,0.2488309144973755,3.4145584106445312,81.14050197601318,1 +2311,0.33612996339797974,0.2247730940580368,0.22623905539512634,0.1834498792886734,639.041015625,1e-05,0.2017754465341568,3.081495761871338,81.14050197601318,1 +2312,0.22762008011341095,0.14847837388515472,0.1529984027147293,0.13100233674049377,906.7301635742188,1e-05,0.19688531756401062,2.838953733444214,81.14050197601318,1 +2313,0.2838173508644104,0.2611452639102936,0.2613874673843384,0.22494173049926758,959.7694091796875,1e-05,0.23709167540073395,3.3615787029266357,81.14050197601318,1 +2314,0.1669570356607437,0.3007356822490692,0.28430184721946716,0.20209790766239166,941.685791015625,1e-05,0.1788702756166458,3.303999662399292,81.14050197601318,1 +2315,0.23934920132160187,0.21391291916370392,0.207651749253273,0.11305361241102219,502.9901123046875,1e-05,0.1481514275074005,3.1061716079711914,81.14050197601318,1 +2316,0.14569388329982758,0.12092706561088562,0.11846072971820831,0.1694638729095459,697.9737548828125,1e-05,0.14957059919834137,3.2825286388397217,81.14050197601318,1 +2317,0.3538303077220917,0.2806861400604248,0.2773706614971161,0.09627039730548859,991.8234252929688,1e-05,0.7862375974655151,3.137953758239746,81.14050197601318,2 +2318,0.29193174839019775,0.3854360282421112,0.3809574246406555,0.139860138297081,979.54296875,1e-05,0.20130862295627594,2.8537278175354004,81.14050197601318,2 +2319,0.2090974599123001,0.20589402318000793,0.19491715729236603,0.20932400226593018,921.7830200195312,1e-05,0.136170893907547,3.352318048477173,81.14050197601318,2 +2320,0.24305656552314758,0.20359715819358826,0.19696201384067535,0.17319346964359283,866.8596801757812,1e-05,0.18087881803512573,3.398777484893799,81.14050197601318,2 +2321,0.34694889187812805,0.17060987651348114,0.17127153277397156,0.2242424190044403,864.5192260742188,1e-05,0.3529171943664551,3.1810245513916016,81.14050197601318,2 +2322,0.0711258128285408,0.20192134380340576,0.20046405494213104,0.214685320854187,967.322509765625,1e-05,0.13181833922863007,3.3505659103393555,81.14050197601318,2 +2323,0.2102629840373993,0.25989508628845215,0.2572847604751587,0.21328671276569366,964.1939697265625,1e-05,0.16253040730953217,2.8392560482025146,81.14050197601318,2 +2324,0.23957860469818115,0.2111746221780777,0.1972450464963913,0.21235431730747223,635.8348388671875,1e-05,0.12769922614097595,2.8411812782287598,81.14050197601318,2 +2325,0.1438463032245636,0.3234919011592865,0.32588109374046326,0.2041957974433899,978.6064453125,1e-05,1.318299651145935,3.391209840774536,81.14050197601318,2 +2326,0.3434777557849884,0.13453583419322968,0.1259070485830307,0.20955711603164673,805.1764526367188,1e-05,0.14022888243198395,3.1061816215515137,81.14050197601318,2 +2327,0.5161727666854858,0.36393994092941284,0.36683011054992676,0.2030303031206131,296.9483642578125,1e-05,0.13959933817386627,3.3491086959838867,81.14050197601318,2 +2328,0.26696574687957764,0.2264726608991623,0.22357721626758575,0.16083915531635284,929.6773681640625,1e-05,0.16081532835960388,3.2845346927642822,81.14050197601318,2 +2329,0.26966729760169983,0.15228906273841858,0.1594044417142868,0.17692308127880096,993.383544921875,1e-05,0.18414610624313354,2.841643810272217,81.14050197601318,2 +2330,0.24205240607261658,0.2697612941265106,0.26428619027137756,0.28321677446365356,865.928466796875,1e-05,0.149510458111763,3.183753490447998,81.14050197601318,2 +2331,0.20822608470916748,0.18577086925506592,0.1869906485080719,0.21841491758823395,860.2017211914062,1e-05,0.13754434883594513,3.0977673530578613,81.14050197601318,2 +2332,0.15073491632938385,0.19177314639091492,0.17785707116127014,0.24568764865398407,756.7888793945312,1e-05,0.11376674473285675,3.130014657974243,81.14050197601318,2 +2333,0.20409104228019714,0.2327956110239029,0.23322829604148865,0.18694639205932617,888.9893188476562,1e-05,0.1423722505569458,3.4509198665618896,81.14050197601318,2 +2334,0.263700008392334,0.21740594506263733,0.21775230765342712,0.23962703347206116,508.12554931640625,1e-05,0.6044014096260071,3.396475076675415,81.14050197601318,2 +2335,0.14888940751552582,0.23850363492965698,0.22972723841667175,0.21048951148986816,942.1655883789062,1e-05,0.16996777057647705,2.853882074356079,81.14050197601318,2 +2336,0.2581920325756073,0.14360682666301727,0.1409185826778412,0.10862471163272858,855.2390747070312,1e-05,0.13203927874565125,3.115764856338501,81.14050197601318,2 +2337,0.19311532378196716,0.31902238726615906,0.314311146736145,0.21235431730747223,973.5816040039062,1e-05,0.19747889041900635,3.2753937244415283,81.14050197601318,2 +2338,0.3051113188266754,0.09319322556257248,0.09510993957519531,0.1291375309228897,603.1679077148438,1e-05,0.14174595475196838,3.1062700748443604,81.14050197601318,2 +2339,0.16540703177452087,0.1398889124393463,0.14116089046001434,0.15897436439990997,705.2662353515625,1e-05,0.778755247592926,3.348407506942749,81.14050197601318,2 +2340,0.22099965810775757,0.22423982620239258,0.2121511697769165,0.25757575035095215,953.0025024414062,1e-05,0.18634673953056335,3.162899971008301,81.14050197601318,2 +2341,0.3059944212436676,0.2037523090839386,0.19495397806167603,0.20326340198516846,885.8264770507812,1e-05,0.19348646700382233,2.839345693588257,81.14050197601318,2 +2342,0.1243099644780159,0.18793264031410217,0.18248209357261658,0.2554778456687927,979.2321166992188,1e-05,0.16830286383628845,3.190683126449585,81.14050197601318,2 +2343,0.21950535476207733,0.16837863624095917,0.15869565308094025,0.19370628893375397,872.758544921875,1e-05,1.659443736076355,3.3580121994018555,81.14050197601318,2 +2344,0.2882322072982788,0.21874138712882996,0.21950989961624146,0.2209790199995041,917.6026611328125,1e-05,0.23391516506671906,2.84548282623291,81.14050197601318,2 +2345,0.2960681915283203,0.2285437285900116,0.22066104412078857,0.2018647938966751,901.2266235351562,1e-05,0.3021642863750458,3.387637138366699,81.14050197601318,2 +2346,0.14646866917610168,0.18769913911819458,0.1916268765926361,0.220279723405838,893.2089233398438,1e-05,0.12981246411800385,3.079158306121826,81.14050197601318,2 +2347,0.30600863695144653,0.33886709809303284,0.32989832758903503,0.2242424190044403,268.69403076171875,1e-05,0.13050474226474762,2.8415393829345703,81.14050197601318,2 +2348,0.28398609161376953,0.2160932719707489,0.20432507991790771,0.18881118297576904,661.8328857421875,1e-05,0.2306225597858429,3.1866190433502197,81.14050197601318,2 +2349,0.21233302354812622,0.2511119246482849,0.24855057895183563,0.18158508837223053,924.6715087890625,1e-05,0.2935011684894562,3.3353753089904785,81.14050197601318,2 +2350,0.12098660320043564,0.2757464349269867,0.26928257942199707,0.21351981163024902,876.2608642578125,1e-05,0.22336366772651672,3.125584840774536,81.14050197601318,2 +2351,0.3214094340801239,0.41656917333602905,0.3998505473136902,0.20606060326099396,991.69189453125,1e-05,0.14312559366226196,3.0860724449157715,81.14050197601318,2 +2352,0.1981704831123352,0.34902438521385193,0.32030630111694336,0.2214452177286148,895.4498291015625,1e-05,0.1825331151485443,3.12601900100708,81.14050197601318,2 +2353,0.2698496878147125,0.12685441970825195,0.11811158061027527,0.20629370212554932,894.3345947265625,1e-05,0.2087104320526123,2.843366861343384,81.14050197601318,2 +2354,0.1254328191280365,0.14290755987167358,0.14099404215812683,0.24871794879436493,610.396240234375,1e-05,0.14949803054332733,3.410991668701172,81.14050197601318,2 +2355,0.3495495319366455,0.20874294638633728,0.20764081180095673,0.24405594170093536,671.7659301757812,1e-05,0.14644622802734375,3.1309587955474854,81.14050197601318,2 +2356,0.17938220500946045,0.26377445459365845,0.24410557746887207,0.2769230902194977,910.0397338867188,1e-05,0.15331532061100006,3.168854236602783,81.14050197601318,2 +2357,0.30062136054039,0.34114599227905273,0.34174928069114685,0.012820512987673283,263.79840087890625,1e-05,0.1430882066488266,3.281609535217285,81.14050197601318,2 +2358,0.16782304644584656,0.32231444120407104,0.3263712227344513,0.22890442609786987,996.0327758789062,1e-05,0.22130221128463745,2.8427481651306152,81.14050197601318,2 +2359,0.32139620184898376,0.31623604893684387,0.3202701807022095,0.18158508837223053,421.0982971191406,1e-05,0.20794640481472015,2.830200672149658,81.14050197601318,2 +2360,0.21659240126609802,0.25087982416152954,0.23607468605041504,0.29440557956695557,854.2249145507812,1e-05,0.22584809362888336,3.363731861114502,81.14050197601318,2 +2361,0.19498008489608765,0.18400953710079193,0.1760549247264862,0.09254079312086105,725.7503051757812,1e-05,0.36573314666748047,3.1287522315979004,81.14050197601318,2 +2362,0.1929997056722641,0.32144463062286377,0.3202471435070038,0.16317015886306763,973.4141235351562,1e-05,0.13922825455665588,3.149160385131836,81.14050197601318,2 +2363,0.2666025161743164,0.17187069356441498,0.16139717400074005,0.21491841971874237,770.1734008789062,1e-05,0.22158928215503693,3.3565900325775146,81.14050197601318,2 +2364,0.2489788681268692,0.14358505606651306,0.1506911665201187,0.22960372269153595,894.3345947265625,1e-05,0.170395165681839,2.8331942558288574,81.14050197601318,2 +2365,0.2215573936700821,0.36349308490753174,0.3590177297592163,0.24848484992980957,978.7633666992188,1e-05,0.2671164274215698,3.1618571281433105,81.14050197601318,2 +2366,0.3519527018070221,0.2941446900367737,0.29324576258659363,0.18251748383045197,969.9888916015625,1e-05,0.2523135244846344,3.0606610774993896,81.14050197601318,2 +2367,0.16528195142745972,0.24098007380962372,0.24080751836299896,0.09580419212579727,924.9560546875,1e-05,0.15418004989624023,3.1249818801879883,81.14050197601318,2 +2368,0.15665237605571747,0.309752494096756,0.2908424139022827,0.15780885517597198,920.605224609375,1e-05,0.11350762844085693,3.4159374237060547,81.14050197601318,2 +2369,0.308127224445343,0.21402309834957123,0.2043662667274475,0.1090909093618393,911.3367309570312,1e-05,0.18177640438079834,3.086714506149292,81.14050197601318,2 +2370,0.2492980659008026,0.2110983431339264,0.19668371975421906,0.2209790199995041,895.0792846679688,1e-05,0.1455751359462738,2.8530032634735107,81.14050197601318,2 +2371,0.31533950567245483,0.16764427721500397,0.16411933302879333,0.23846153914928436,733.1973266601562,1e-05,0.1998111605644226,3.173085927963257,81.14050197601318,2 +2372,0.2522999346256256,0.26929736137390137,0.257393479347229,0.13916084170341492,959.7694091796875,1e-05,0.2297455221414566,3.102031707763672,81.14050197601318,2 +2373,0.33767959475517273,0.22207200527191162,0.21789534389972687,0.1850815862417221,905.37890625,1e-05,0.365472674369812,3.1145002841949463,81.14050197601318,2 +2374,0.4097009301185608,0.44556760787963867,0.4418450891971588,0.22680652141571045,165.13217163085938,1e-05,0.2953958511352539,3.4418184757232666,81.14050197601318,2 +2375,0.1919112503528595,0.4981393814086914,0.5073488354682922,0.09370629489421844,133.62509155273438,1e-05,0.16601578891277313,3.086333751678467,81.14050197601318,2 +2376,0.23406484723091125,0.3255380392074585,0.3070288598537445,0.23310023546218872,979.54296875,1e-05,0.16991864144802094,2.8547472953796387,81.14050197601318,2 +2377,0.24129897356033325,0.24577467143535614,0.24744005501270294,0.20000000298023224,993.5120239257812,1e-05,0.13950732350349426,3.1292052268981934,81.14050197601318,2 +2378,0.06931022554636002,0.16600576043128967,0.16740255057811737,0.12890443205833435,954.6907958984375,1e-05,0.14989162981510162,3.3410027027130127,81.14050197601318,2 +2379,0.39070895314216614,0.2169058620929718,0.20904555916786194,0.23449882864952087,882.1692504882812,1e-05,0.20830906927585602,3.375434160232544,81.14050197601318,2 +2380,0.20780187845230103,0.26228198409080505,0.26543036103248596,0.14615385234355927,965.6807250976562,1e-05,0.3150908648967743,2.8420047760009766,81.14050197601318,2 +2381,0.24079358577728271,0.28461363911628723,0.26772961020469666,0.19813519716262817,565.9164428710938,1e-05,0.24752962589263916,3.1326639652252197,81.14050197601318,2 +2382,0.2868790328502655,0.20404602587223053,0.19787774980068207,0.19953380525112152,940.2321166992188,1e-05,0.14096198976039886,2.8552863597869873,81.14050197601318,2 +2383,0.22558292746543884,0.2590274512767792,0.2389877736568451,0.1526806503534317,953.0025024414062,1e-05,0.17139387130737305,3.1652185916900635,81.14050197601318,2 +2384,0.27357175946235657,0.27674350142478943,0.2535775601863861,0.2421911358833313,936.49951171875,1e-05,0.29528290033340454,3.3449594974517822,81.14050197601318,2 +2385,0.2631104588508606,0.23867014050483704,0.22626523673534393,0.2365967333316803,707.6432495117188,1e-05,0.4596801698207855,3.099261999130249,81.14050197601318,2 +2386,0.18485505878925323,0.26252204179763794,0.2494281679391861,0.2529137432575226,907.7332763671875,1e-05,0.16923339664936066,3.123553514480591,81.14050197601318,2 +2387,0.3156186044216156,0.33943596482276917,0.34304916858673096,0.15081584453582764,976.3768310546875,1e-05,0.18714945018291473,3.153502941131592,81.14050197601318,2 +2388,0.15312041342258453,0.27970659732818604,0.273142009973526,0.18205128610134125,975.0736083984375,1e-05,0.15572728216648102,2.8437769412994385,81.14050197601318,2 +2389,0.25300469994544983,0.16578558087348938,0.17213159799575806,0.13100233674049377,612.1727294921875,1e-05,0.2407931387424469,3.0858354568481445,81.14050197601318,2 +2390,0.20944367349147797,0.12467028945684433,0.12618571519851685,0.056410256773233414,883.8079833984375,1e-05,0.33325764536857605,3.311307907104492,81.14050197601318,2 +2391,0.22428245842456818,0.2881464958190918,0.2802467942237854,0.21678321063518524,443.50128173828125,1e-05,0.19983090460300446,3.128300666809082,81.14050197601318,2 +2392,0.20980705320835114,0.3517904579639435,0.3318774402141571,0.2526806592941284,964.5680541992188,1e-05,0.6711395382881165,3.1459670066833496,81.14050197601318,2 +2393,0.2553298771381378,0.23689691722393036,0.2045663297176361,0.21631701290607452,885.4254760742188,1e-05,0.27232980728149414,3.0646984577178955,81.14050197601318,2 +2394,0.24407054483890533,0.23213154077529907,0.22328665852546692,0.25524476170539856,637.4429931640625,1e-05,0.16283616423606873,2.844226360321045,81.14050197601318,2 +2395,0.4281752109527588,0.19511649012565613,0.19302873313426971,0.2209790199995041,737.33203125,1e-05,0.22092735767364502,3.105748414993286,81.14050197601318,2 +2396,0.1162712350487709,0.10486763715744019,0.10870014876127243,0.0855477824807167,869.15966796875,1e-05,0.25374138355255127,3.382957696914673,81.14050197601318,2 +2397,0.14883334934711456,0.17855441570281982,0.16455359756946564,0.1638694703578949,995.035400390625,1e-05,0.2016846090555191,3.106768846511841,81.14050197601318,2 +2398,0.29428526759147644,0.20367591083049774,0.20566539466381073,0.24568764865398407,632.5867309570312,1e-05,0.26453179121017456,3.058929443359375,81.14050197601318,2 +2399,0.13843664526939392,0.2832799553871155,0.28748247027397156,0.23473192751407623,918.8137817382812,1e-05,0.14804807305335999,3.118208169937134,81.14050197601318,2 +2400,0.2551591098308563,0.2150203436613083,0.20299679040908813,0.2578088641166687,930.2188720703125,1e-05,0.6371737122535706,2.850071430206299,81.14050197601318,2 +2401,0.34911954402923584,0.28158876299858093,0.27602601051330566,0.22051282227039337,942.4046020507812,1e-05,0.18810449540615082,3.3835628032684326,81.14050197601318,2 +2402,0.17216907441616058,0.21438540518283844,0.2098560333251953,0.2030303031206131,995.9088745117188,1e-05,1.3956667184829712,3.3562848567962646,81.14050197601318,2 +2403,0.23813609778881073,0.13906897604465485,0.13913342356681824,0.10722610354423523,565.9164428710938,1e-05,0.27318769693374634,3.139676332473755,81.14050197601318,2 +2404,0.27267080545425415,0.24854807555675507,0.24664127826690674,0.21398600935935974,446.5873107910156,1e-05,0.205436110496521,3.370156764984131,81.14050197601318,2 +2405,0.20409613847732544,0.21553242206573486,0.20541676878929138,0.2142191082239151,825.6151733398438,1e-05,0.17389482259750366,2.8519845008850098,81.14050197601318,2 +2406,0.46682047843933105,0.22655580937862396,0.21621599793434143,0.2142191082239151,925.8049926757812,1e-05,0.3036883771419525,2.850926399230957,81.14050197601318,2 +2407,0.19940990209579468,0.1418023258447647,0.15494787693023682,0.24405594170093536,959.3736572265625,1e-05,0.2286795973777771,3.4245853424072266,81.14050197601318,2 +2408,0.1132815033197403,0.09213925153017044,0.09894025325775146,0.07948718219995499,649.9450073242188,1e-05,0.16930636763572693,3.124685049057007,81.14050197601318,2 +2409,0.32116204500198364,0.21727178990840912,0.2100316435098648,0.22400932013988495,850.0933227539062,1e-05,0.2104794979095459,3.3900082111358643,81.14050197601318,2 +2410,0.2783997058868408,0.24721571803092957,0.23290219902992249,0.17482517659664154,751.1552734375,1e-05,0.2067161351442337,3.0646133422851562,81.14050197601318,2 +2411,0.33512625098228455,0.2848756015300751,0.26537278294563293,0.2526806592941284,813.4014892578125,1e-05,0.17606602609157562,2.8373939990997314,81.14050197601318,2 +2412,0.19612747430801392,0.16895557940006256,0.15276950597763062,0.1822843849658966,774.4262084960938,1e-05,0.15930287539958954,3.136286973953247,81.14050197601318,2 +2413,0.24463701248168945,0.22899995744228363,0.22241240739822388,0.2097902148962021,741.38232421875,1e-05,0.15450546145439148,3.052788019180298,81.14050197601318,2 +2414,0.1523064374923706,0.15122993290424347,0.1497209221124649,0.1806526780128479,931.56005859375,1e-05,0.18205878138542175,3.117649793624878,81.14050197601318,2 +2415,0.2054160237312317,0.17921419441699982,0.20357759296894073,0.238228440284729,434.07476806640625,1e-05,0.16207601130008698,3.447157382965088,81.14050197601318,2 +2416,0.2885459065437317,0.21299219131469727,0.2101794332265854,0.21608391404151917,944.7620849609375,1e-05,0.3398849666118622,3.065619468688965,81.14050197601318,2 +2417,0.30802762508392334,0.337410032749176,0.33301153779029846,0.21794871985912323,988.8717041015625,1e-05,0.15157592296600342,2.836906671524048,81.14050197601318,2 +2418,0.1455811709165573,0.20357777178287506,0.21221351623535156,0.25314685702323914,957.1648559570312,1e-05,0.3693050146102905,3.1766574382781982,81.14050197601318,2 +2419,0.13105508685112,0.16879762709140778,0.1653064787387848,0.139860138297081,897.6493530273438,1e-05,0.2294401377439499,3.0463428497314453,81.14050197601318,2 +2420,0.17336399853229523,0.3333781957626343,0.3261485695838928,0.2265734225511551,981.38232421875,1e-05,0.1632409393787384,3.132460832595825,81.14050197601318,2 +2421,0.2620712220668793,0.3747926354408264,0.3434433043003082,0.23170162737369537,975.0736083984375,1e-05,0.16255070269107819,3.0636119842529297,81.14050197601318,2 +2422,0.19548457860946655,0.30872076749801636,0.3287290930747986,0.20839160680770874,978.4493408203125,1e-05,0.29034900665283203,3.1050713062286377,81.14050197601318,2 +2423,0.13995522260665894,0.22559423744678497,0.2129214107990265,0.16456876695156097,649.9450073242188,1e-05,0.16243603825569153,2.8575313091278076,81.14050197601318,2 +2424,0.2488964945077896,0.22968417406082153,0.22453437745571136,0.10419580340385437,935.22314453125,1e-05,0.9127740263938904,3.1989998817443848,81.14050197601318,2 +2425,0.09290135651826859,0.23591570556163788,0.23747116327285767,0.16363635659217834,906.7301635742188,1e-05,0.15085762739181519,3.07146954536438,81.14050197601318,2 +2426,0.13623355329036713,0.19626322388648987,0.19452404975891113,0.21398600935935974,797.99267578125,1e-05,0.1800111085176468,3.6084489822387695,81.14050197601318,2 +2427,0.2170654684305191,0.2020273655653,0.20223556458950043,0.23006993532180786,862.6173095703125,1e-05,0.775256872177124,3.1179206371307373,81.14050197601318,2 +2428,0.3761904239654541,0.13516326248645782,0.13687744736671448,0.2780885696411133,747.3050537109375,1e-05,0.15774963796138763,3.327193021774292,81.14050197601318,2 +2429,0.32892322540283203,0.2950715124607086,0.257738322019577,0.22610722482204437,938.756103515625,1e-05,0.170289546251297,2.8397185802459717,81.14050197601318,2 +2430,0.2664887309074402,0.27121031284332275,0.2628483474254608,0.18694639205932617,958.576904296875,1e-05,0.15027105808258057,3.1382317543029785,81.14050197601318,2 +2431,0.25261083245277405,0.20924608409404755,0.21403388679027557,0.2181818187236786,939.7424926757812,1e-05,0.17283950746059418,3.2972402572631836,81.14050197601318,2 +2432,0.20510807633399963,0.15372398495674133,0.1507972925901413,0.21351981163024902,885.8264770507812,1e-05,0.11253820359706879,3.198302984237671,81.14050197601318,2 +2433,0.2436755746603012,0.12336879968643188,0.11809451133012772,0.22331002354621887,731.0974731445312,1e-05,8.180073738098145,3.0784971714019775,81.14050197601318,2 +2434,0.2124590277671814,0.17722506821155548,0.17958129942417145,0.22121211886405945,870.0686645507812,1e-05,0.12617626786231995,3.405191659927368,81.14050197601318,2 +2435,0.29431381821632385,0.36566415429115295,0.3735187351703644,0.23123542964458466,305.9609069824219,1e-05,0.1466653198003769,2.854727268218994,81.14050197601318,2 +2436,0.14701241254806519,0.3228038251399994,0.33031049370765686,0.16433566808700562,966.414306640625,1e-05,0.1233130544424057,3.1572976112365723,81.14050197601318,2 +2437,0.28832000494003296,0.23640954494476318,0.24243316054344177,0.1107226088643074,858.7315673828125,1e-05,0.23604463040828705,3.4063875675201416,81.14050197601318,2 +2438,0.2793002426624298,0.25077444314956665,0.24142175912857056,0.21072261035442352,892.0726318359375,1e-05,1.3275967836380005,3.226243734359741,81.14050197601318,2 +2439,0.27280470728874207,0.2535453140735626,0.25089478492736816,0.19393938779830933,912.6188354492188,1e-05,0.1263103187084198,3.303049325942993,81.14050197601318,2 +2440,0.20149840414524078,0.1383686661720276,0.14176246523857117,0.2242424190044403,943.1180419921875,1e-05,0.2102646678686142,3.0640790462493896,81.14050197601318,2 +2441,0.3457010090351105,0.1181558147072792,0.14116519689559937,0.2074592113494873,969.2862548828125,1e-05,0.2788867950439453,3.2017014026641846,81.14050197601318,2 +2442,0.3582678437232971,0.22827239334583282,0.23471926152706146,0.21351981163024902,999.53125,1e-05,0.17775630950927734,3.1312508583068848,81.14050197601318,2 +2443,0.175858274102211,0.3291797935962677,0.30236729979515076,0.19766899943351746,960.9456176757812,1e-05,0.14336493611335754,3.3755760192871094,81.14050197601318,2 +2444,0.3635988235473633,0.2275514006614685,0.2203686684370041,0.20279720425605774,871.8681030273438,1e-05,0.31189537048339844,3.3117570877075195,81.14050197601318,2 +2445,0.2134629637002945,0.17858433723449707,0.16586308181285858,0.18298368155956268,801.6233520507812,1e-05,0.15963289141654968,3.2936089038848877,81.14050197601318,2 +2446,0.29228904843330383,0.23481535911560059,0.23991701006889343,0.1850815862417221,896.1876220703125,1e-05,0.9445438385009766,3.1027822494506836,81.14050197601318,2 +2447,0.21213968098163605,0.332600474357605,0.3102477192878723,0.2554778456687927,962.1061401367188,1e-05,0.1376636028289795,3.2020151615142822,81.14050197601318,2 +2448,0.2982339859008789,0.3835347890853882,0.40029504895210266,0.2214452177286148,183.10153198242188,1e-05,0.14216186106204987,3.032670736312866,81.14050197601318,2 +2449,0.18749092519283295,0.18888022005558014,0.18286040425300598,0.22237762808799744,861.6561889648438,1e-05,0.13022591173648834,3.3097362518310547,81.14050197601318,2 +2450,0.14126205444335938,0.21060782670974731,0.2088785171508789,0.1818181872367859,952.5755615234375,1e-05,0.18193666636943817,3.261110782623291,81.14050197601318,2 +2451,0.23653706908226013,0.309822142124176,0.3141545057296753,0.25524476170539856,427.6461486816406,1e-05,0.11265306919813156,3.307251214981079,81.14050197601318,2 +2452,0.24357065558433533,0.17934614419937134,0.17995566129684448,0.22400932013988495,670.3726196289062,1e-05,0.1437734216451645,2.8390588760375977,81.14050197601318,2 +2453,0.3099713623523712,0.17603491246700287,0.193344846367836,0.15617716312408447,931.2932739257812,1e-05,0.340066134929657,3.106513500213623,81.14050197601318,2 +2454,0.20147909224033356,0.14988119900226593,0.15264230966567993,0.2282051295042038,968.3995361328125,1e-05,0.12007699906826019,3.0725765228271484,81.14050197601318,2 +2455,0.3354718089103699,0.34176963567733765,0.3337330222129822,0.21212121844291687,390.0654296875,1e-05,0.12814931571483612,3.349844455718994,81.14050197601318,2 +2456,0.32789120078086853,0.15680836141109467,0.16910354793071747,0.18391607701778412,891.6915283203125,1e-05,0.15184162557125092,3.560210704803467,81.14050197601318,2 +2457,0.2614966034889221,0.31484490633010864,0.29378044605255127,0.220279723405838,965.6807250976562,1e-05,0.15316079556941986,3.0971169471740723,81.14050197601318,2 +2458,0.2927483320236206,0.24727223813533783,0.24946214258670807,0.1895104944705963,561.6887817382812,1e-05,0.1876155138015747,2.84859037399292,81.14050197601318,2 +2459,0.22678649425506592,0.20843733847141266,0.20111915469169617,0.2365967333316803,663.2779541015625,1e-05,0.259244441986084,3.180448293685913,81.14050197601318,2 +2460,0.12395942956209183,0.2736046016216278,0.2758512496948242,0.06666667014360428,935.9909057617188,1e-05,0.1725456863641739,3.112959861755371,81.14050197601318,2 +2461,0.1724310964345932,0.27677690982818604,0.2607240676879883,0.1762237697839737,979.54296875,1e-05,0.13525238633155823,3.0949361324310303,81.14050197601318,2 +2462,0.17124326527118683,0.12746016681194305,0.13854441046714783,0.09347319602966309,967.322509765625,1e-05,0.22045506536960602,3.414466381072998,81.14050197601318,2 +2463,0.21394947171211243,0.1746283620595932,0.17335420846939087,0.1986013948917389,570.0819702148438,1e-05,0.16431082785129547,3.0754616260528564,81.14050197601318,2 +2464,0.123918317258358,0.268423855304718,0.2542228102684021,0.21351981163024902,978.6064453125,1e-05,0.3177940845489502,2.840895891189575,81.14050197601318,2 +2465,0.3403375744819641,0.414042204618454,0.40811604261398315,0.16969697177410126,248.77369689941406,1e-05,0.1370178461074829,3.197084426879883,81.14050197601318,2 +2466,0.16214214265346527,0.23424263298511505,0.21831345558166504,0.24009324610233307,731.0974731445312,1e-05,0.2052348256111145,3.27742338180542,81.14050197601318,2 +2467,0.12033672630786896,0.22247755527496338,0.20538179576396942,0.22960372269153595,926.9263305664062,1e-05,0.7972621917724609,3.3397674560546875,81.14050197601318,2 +2468,0.14838498830795288,0.4106185734272003,0.39308640360832214,0.20629370212554932,988.18359375,1e-05,0.1343449056148529,3.1177191734313965,81.14050197601318,2 +2469,0.2715795338153839,0.1768714040517807,0.1738189458847046,0.15571095049381256,790.488037109375,1e-05,0.1397220343351364,3.2758982181549072,81.14050197601318,2 +2470,0.31739288568496704,0.39752447605133057,0.3968563377857208,0.21631701290607452,323.4160461425781,1e-05,0.2317495048046112,2.850919246673584,81.14050197601318,2 +2471,0.20530307292938232,0.31848764419555664,0.3251881003379822,0.17132866382598877,942.1655883789062,1e-05,0.157187819480896,3.1979074478149414,81.14050197601318,2 +2472,0.14152193069458008,0.18896128237247467,0.19220730662345886,0.2114219069480896,841.452880859375,1e-05,0.13202624022960663,3.4303219318389893,81.14050197601318,2 +2473,0.3062325119972229,0.21810205280780792,0.20731592178344727,0.23286713659763336,730.0392456054688,1e-05,0.1686795949935913,3.594968318939209,81.14050197601318,2 +2474,0.2470056265592575,0.2644524872303009,0.24619439244270325,0.22517482936382294,992.7376708984375,1e-05,0.1652911752462387,3.0693981647491455,81.14050197601318,2 +2475,0.16424500942230225,0.28151172399520874,0.2561101019382477,0.22610722482204437,919.7131958007812,1e-05,0.21716424822807312,3.321866750717163,81.14050197601318,2 +2476,0.458705335855484,0.2655099928379059,0.25510138273239136,0.18531468510627747,958.9761352539062,1e-05,0.1652248501777649,2.846087694168091,81.14050197601318,2 +2477,0.18189507722854614,0.18768002092838287,0.18193992972373962,0.260606050491333,840.3358154296875,1e-05,0.10626144707202911,3.3267440795898438,81.14050197601318,2 +2478,0.22582778334617615,0.24808479845523834,0.24313266575336456,0.0979020968079567,982.1359252929688,1e-05,0.1551237851381302,3.1627981662750244,81.14050197601318,2 +2479,0.09790897369384766,0.19172413647174835,0.19233401119709015,0.19393938779830933,911.9796752929688,1e-05,0.11649984866380692,3.511077642440796,81.14050197601318,2 +2480,0.30646806955337524,0.13973695039749146,0.1528639942407608,0.16480186581611633,824.99560546875,1e-05,0.16531048715114594,3.277799606323242,81.14050197601318,2 +2481,0.44241687655448914,0.11814180761575699,0.117464579641819,0.11002331227064133,751.1552734375,1e-05,0.41814783215522766,3.121608018875122,81.14050197601318,2 +2482,0.43615448474884033,0.22346876561641693,0.21126332879066467,0.24475523829460144,776.0996704101562,1e-05,0.13433825969696045,2.8486573696136475,81.14050197601318,2 +2483,0.25042325258255005,0.16728679835796356,0.16206002235412598,0.1034965068101883,737.33203125,1e-05,0.18021167814731598,3.636260509490967,81.14050197601318,2 +2484,0.26952892541885376,0.21328283846378326,0.20976141095161438,0.2282051295042038,923.8132934570312,1e-05,0.19629834592342377,3.630070924758911,81.14050197601318,2 +2485,0.14396217465400696,0.17887717485427856,0.1565074771642685,0.220279723405838,900.8737182617188,1e-05,0.16935183107852936,3.22873854637146,81.14050197601318,2 +2486,0.24267295002937317,0.2537277042865753,0.24906960129737854,0.25361305475234985,941.685791015625,1e-05,0.6840893626213074,3.3325045108795166,81.14050197601318,2 +2487,0.2524140477180481,0.19263307750225067,0.1840655356645584,0.238228440284729,932.6204223632812,1e-05,0.25409945845603943,3.1309597492218018,81.14050197601318,2 +2488,0.18010492622852325,0.14860396087169647,0.15461985766887665,0.22610722482204437,880.5089721679688,1e-05,0.1468447893857956,2.839085817337036,81.14050197601318,2 +2489,0.4206984043121338,0.3052937984466553,0.3064890503883362,0.20093239843845367,446.5873107910156,1e-05,0.1279447078704834,3.0705606937408447,81.14050197601318,2 +2490,0.2759890854358673,0.13589905202388763,0.1431676149368286,0.09417249262332916,733.1973266601562,1e-05,0.1616414189338684,3.436784505844116,81.14050197601318,2 +2491,0.21205070614814758,0.25523972511291504,0.24125435948371887,0.19720280170440674,931.025634765625,1e-05,0.16659048199653625,3.1329615116119385,81.14050197601318,2 +2492,0.2228100448846817,0.3008231520652771,0.2934979498386383,0.2265734225511551,513.177978515625,1e-05,0.1885848492383957,3.085815191268921,81.14050197601318,2 +2493,0.2109641581773758,0.22859424352645874,0.21594315767288208,0.20279720425605774,922.947998046875,1e-05,0.11961610615253448,3.0648629665374756,81.14050197601318,2 +2494,0.1343584656715393,0.24720068275928497,0.24098940193653107,0.2594405710697174,931.025634765625,1e-05,0.17532123625278473,3.1893041133880615,81.14050197601318,2 +2495,0.27177122235298157,0.2835749089717865,0.28532037138938904,0.25151515007019043,963.818115234375,1e-05,0.12931321561336517,3.3972628116607666,81.14050197601318,2 +2496,0.262195348739624,0.23956264555454254,0.23141278326511383,0.1874125897884369,795.030517578125,1e-05,0.1716645509004593,3.1274216175079346,81.14050197601318,2 +2497,0.27272385358810425,0.15351031720638275,0.15708646178245544,0.1694638729095459,946.378173828125,1e-05,0.16784502565860748,3.126563310623169,81.14050197601318,2 +2498,0.2492808997631073,0.25868916511535645,0.24433572590351105,0.16969697177410126,918.2099609375,1e-05,0.18373362720012665,3.1199841499328613,81.14050197601318,2 +2499,0.13895869255065918,0.18565264344215393,0.187279611825943,0.12727272510528564,930.7574462890625,1e-05,0.1610039919614792,3.090790033340454,81.14050197601318,2 +2500,0.1916603296995163,0.26186710596084595,0.26416322588920593,0.13286712765693665,904.0114135742188,1e-05,0.2039007693529129,3.187714099884033,81.14050197601318,2 +2501,0.26151353120803833,0.2606431841850281,0.25870397686958313,0.1958041936159134,895.0792846679688,1e-05,1.3465505838394165,3.4314112663269043,81.14050197601318,2 +2502,0.12198951840400696,0.265763521194458,0.2696395516395569,0.2086247056722641,968.7553100585938,1e-05,0.11999496072530746,3.354678153991699,81.14050197601318,2 +2503,0.20068809390068054,0.31780603528022766,0.30550047755241394,0.19696970283985138,397.1928405761719,1e-05,0.13138869404792786,3.1189491748809814,81.14050197601318,2 +2504,0.1354147344827652,0.26861757040023804,0.2506256103515625,0.2230769246816635,967.5030517578125,1e-05,0.4637199938297272,3.351821184158325,81.14050197601318,2 +2505,0.18496564030647278,0.2489342838525772,0.23789578676223755,0.22331002354621887,938.5079956054688,1e-05,0.16383598744869232,2.8355205059051514,81.14050197601318,2 +2506,0.13558389246463776,0.3661644458770752,0.3381713032722473,0.16899767518043518,978.9199829101562,1e-05,0.15344658493995667,3.193831443786621,81.14050197601318,2 +2507,0.28347906470298767,0.18382957577705383,0.1802653968334198,0.0839160829782486,774.4262084960938,1e-05,0.17926859855651855,3.162627935409546,81.14050197601318,2 +2508,0.2744130790233612,0.15904010832309723,0.1561833769083023,0.1382284313440323,513.177978515625,1e-05,0.12910376489162445,3.35090970993042,81.14050197601318,2 +2509,0.1707880049943924,0.21348246932029724,0.21051788330078125,0.1442890465259552,905.7181396484375,1e-05,0.6071508526802063,3.1106975078582764,81.14050197601318,2 +2510,0.27598732709884644,0.2933942377567291,0.2751556634902954,0.14965035021305084,856.2459106445312,1e-05,0.17848332226276398,3.3729074001312256,81.14050197601318,2 +2511,0.21829241514205933,0.21036016941070557,0.2130553126335144,0.21561771631240845,996.2799072265625,1e-05,0.18382975459098816,2.8486075401306152,81.14050197601318,2 +2512,0.3298906683921814,0.25075557827949524,0.25462061166763306,0.19393938779830933,976.5382080078125,1e-05,0.18233583867549896,3.174762010574341,81.14050197601318,2 +2513,0.16326507925987244,0.28734850883483887,0.28373557329177856,0.21934731304645538,965.6807250976562,1e-05,0.17377841472625732,3.1066157817840576,81.14050197601318,2 +2514,0.3052177131175995,0.38323354721069336,0.37972888350486755,0.12284382432699203,253.83924865722656,1e-05,0.10552919656038284,3.0562236309051514,81.14050197601318,2 +2515,0.30777671933174133,0.38084524869918823,0.37279045581817627,0.14848484098911285,967.1416625976562,1e-05,0.15512557327747345,3.1492180824279785,81.14050197601318,2 +2516,0.300068199634552,0.24241675436496735,0.24725863337516785,0.22074592113494873,943.8261108398438,1e-05,0.14989252388477325,3.138277769088745,81.14050197601318,2 +2517,0.3620304465293884,0.23680992424488068,0.238546222448349,0.2321678251028061,557.397705078125,1e-05,0.31547611951828003,2.8440945148468018,81.14050197601318,2 +2518,0.2787269949913025,0.34014439582824707,0.3435268998146057,0.1862470805644989,283.0556640625,1e-05,0.14204369485378265,3.400934934616089,81.14050197601318,2 +2519,0.21301019191741943,0.1660558581352234,0.1787024736404419,0.17132866382598877,981.38232421875,1e-05,0.13807502388954163,3.35398006439209,81.14050197601318,2 +2520,0.13361266255378723,0.22221142053604126,0.21768760681152344,0.151048943400383,848.5123291015625,1e-05,0.1880033314228058,3.1018970012664795,81.14050197601318,2 +2521,0.1888241171836853,0.1294565349817276,0.1344769299030304,0.10372960567474365,804.4718627929688,1e-05,0.16143707931041718,3.025933027267456,81.14050197601318,2 +2522,0.29355388879776,0.20818206667900085,0.21402783691883087,0.22773893177509308,834.6194458007812,1e-05,0.34353891015052795,3.0927953720092773,81.14050197601318,2 +2523,0.1328059285879135,0.18228641152381897,0.17704597115516663,0.20769231021404266,848.5123291015625,1e-05,0.7105367183685303,3.0902936458587646,81.14050197601318,2 +2524,0.16557903587818146,0.2574906647205353,0.23645268380641937,0.21911421418190002,926.0864868164062,1e-05,0.14290913939476013,3.3319029808044434,81.14050197601318,2 +2525,0.37485429644584656,0.09920100122690201,0.09636136144399643,0.24242423474788666,880.5089721679688,1e-05,0.18304942548274994,3.1022024154663086,81.14050197601318,2 +2526,0.19190524518489838,0.14627759158611298,0.14105075597763062,0.2142191082239151,916.991943359375,1e-05,0.15302284061908722,3.1479265689849854,81.14050197601318,2 +2527,0.25712016224861145,0.35520392656326294,0.3545489013195038,0.2354312390089035,292.3681640625,1e-05,0.13739070296287537,3.3658764362335205,81.14050197601318,2 +2528,0.23699170351028442,0.09965061396360397,0.10118843615055084,0.17878787219524384,913.5706787109375,1e-05,0.5109142065048218,3.1329455375671387,81.14050197601318,2 +2529,0.2780083119869232,0.3525938093662262,0.3548394739627838,0.16037295758724213,999.8831176757812,1e-05,0.7145193219184875,3.119433641433716,81.14050197601318,2 +2530,0.09438253194093704,0.18395869433879852,0.17971551418304443,0.19533799588680267,977.4996337890625,1e-05,0.1733957976102829,3.397442579269409,81.14050197601318,2 +2531,0.2709326446056366,0.21245402097702026,0.20529311895370483,0.18018648028373718,737.33203125,1e-05,0.20048503577709198,3.1318442821502686,81.14050197601318,2 +2532,0.23894375562667847,0.24705184996128082,0.2383434772491455,0.14685314893722534,757.7117919921875,1e-05,0.13690520823001862,3.3523664474487305,81.14050197601318,2 +2533,0.23499906063079834,0.25906670093536377,0.24222667515277863,0.24428904056549072,758.630126953125,1e-05,0.18857136368751526,3.142810344696045,81.14050197601318,2 +2534,0.1418033391237259,0.25646939873695374,0.24186725914478302,0.23170162737369537,882.9913330078125,1e-05,0.16609898209571838,2.8438987731933594,81.14050197601318,2 +2535,0.14112348854541779,0.14259959757328033,0.14726853370666504,0.1946386992931366,667.560546875,1e-05,0.20922784507274628,3.236234188079834,81.14050197601318,2 +2536,0.16004784405231476,0.22591394186019897,0.23051133751869202,0.08041957765817642,949.5288696289062,1e-05,0.15388812124729156,3.3229470252990723,81.14050197601318,2 +2537,0.2911253571510315,0.2372031956911087,0.22385700047016144,0.2846153974533081,936.7528076171875,1e-05,0.19700351357460022,3.1431198120117188,81.14050197601318,2 +2538,0.1990543156862259,0.19607140123844147,0.20425261557102203,0.12657342851161957,939.9876098632812,1e-05,0.36860495805740356,3.13019061088562,81.14050197601318,2 +2539,0.08995237201452255,0.2444278597831726,0.24342283606529236,0.14801864326000214,944.2952880859375,1e-05,0.17827975749969482,3.277254343032837,81.14050197601318,2 +2540,0.3115534782409668,0.5745738744735718,0.5813616514205933,0.2097902148962021,106.90462493896484,1e-05,0.3204476237297058,2.854079008102417,81.14050197601318,2 +2541,0.3235618770122528,0.3708290159702301,0.36411193013191223,0.24638694524765015,268.69403076171875,1e-05,0.14643748104572296,3.2043685913085938,81.14050197601318,2 +2542,0.11918114125728607,0.40976136922836304,0.3845173716545105,0.19696970283985138,989.8240966796875,1e-05,0.12342225760221481,3.350998640060425,81.14050197601318,2 +2543,0.1923157423734665,0.1477801352739334,0.16103039681911469,0.2310023307800293,960.7506713867188,1e-05,0.11769340187311172,3.6044373512268066,81.14050197601318,2 +2544,0.17936241626739502,0.1356022208929062,0.12263250350952148,0.19137528538703918,944.7620849609375,1e-05,0.15198606252670288,3.0828895568847656,81.14050197601318,2 +2545,0.16690008342266083,0.26407870650291443,0.26504525542259216,0.07529137283563614,964.5680541992188,1e-05,0.2581404447555542,3.339682102203369,81.14050197601318,2 +2546,0.248109370470047,0.28194642066955566,0.2875826358795166,0.14965035021305084,635.8348388671875,1e-05,0.2512954771518707,3.1671955585479736,81.14050197601318,2 +2547,0.31011420488357544,0.14861474931240082,0.1382625699043274,0.2282051295042038,798.72509765625,1e-05,0.18901945650577545,2.853893518447876,81.14050197601318,2 +2548,0.16149188578128815,0.18773269653320312,0.17588980495929718,0.23706293106079102,913.5706787109375,1e-05,0.16631343960762024,3.1173462867736816,81.14050197601318,2 +2549,0.23084595799446106,0.41952091455459595,0.43421992659568787,0.21678321063518524,233.2209930419922,1e-05,0.18500597774982452,3.5175609588623047,81.14050197601318,2 +2550,0.12532296776771545,0.26238852739334106,0.25158900022506714,0.15198135375976562,934.1901245117188,1e-05,0.26437491178512573,3.1407384872436523,81.14050197601318,2 +2551,0.20759613811969757,0.300904780626297,0.29862546920776367,0.06480186432600021,620.8772583007812,1e-05,0.2978762984275818,3.095895767211914,81.14050197601318,2 +2552,0.29281654953956604,0.32272982597351074,0.3298023045063019,0.19720280170440674,982.5844116210938,1e-05,0.3619379997253418,3.0575454235076904,81.14050197601318,2 +2553,0.20029233396053314,0.16463904082775116,0.17368993163108826,0.10652680695056915,942.4046020507812,1e-05,0.18395598232746124,2.8452682495117188,81.14050197601318,2 +2554,0.13210447132587433,0.20635442435741425,0.18762192130088806,0.2526806592941284,961.5278930664062,1e-05,1.3795887231826782,3.086728811264038,81.14050197601318,2 +2555,0.2719578444957733,0.5637152194976807,0.5699899792671204,0.2764568626880646,183.10153198242188,1e-05,0.13196483254432678,3.210599422454834,81.14050197601318,2 +2556,0.1842852383852005,0.2668456435203552,0.2578659951686859,0.21072261035442352,913.2542724609375,1e-05,0.17408981919288635,3.205897092819214,81.14050197601318,2 +2557,0.2975251078605652,0.21344821155071259,0.18957197666168213,0.2310023307800293,859.7134399414062,1e-05,0.18551157414913177,3.0906765460968018,81.14050197601318,2 +2558,0.2255435734987259,0.2618546187877655,0.2728232443332672,0.17529137432575226,712.31884765625,1e-05,0.14348800480365753,3.110368013381958,81.14050197601318,2 +2559,0.3184139132499695,0.2861984074115753,0.27404409646987915,0.25874125957489014,268.69403076171875,1e-05,0.3415182828903198,3.0198545455932617,81.14050197601318,2 +2560,0.18540552258491516,0.31573912501335144,0.30792710185050964,0.220279723405838,995.9088745117188,1e-05,0.1220712959766388,2.8384616374969482,81.14050197601318,2 +2561,0.17063835263252258,0.26693078875541687,0.2514650523662567,0.18578088283538818,922.0755004882812,1e-05,0.1445574015378952,3.1831865310668945,81.14050197601318,2 +2562,0.2698071599006653,0.43765541911125183,0.4360697865486145,0.20372959971427917,367.8310546875,1e-05,0.1182040274143219,3.3886637687683105,81.14050197601318,2 +2563,0.21715252101421356,0.2058945894241333,0.18679144978523254,0.11888112127780914,953.639404296875,1e-05,0.17436213791370392,3.1112539768218994,81.14050197601318,2 +2564,0.1975041776895523,0.1854797750711441,0.1772862821817398,0.09696969389915466,861.6561889648438,1e-05,0.14920790493488312,3.126197576522827,81.14050197601318,2 +2565,0.17697376012802124,0.28861215710639954,0.2755381762981415,0.16363635659217834,793.5297241210938,1e-05,0.1775454431772232,3.1116275787353516,81.14050197601318,2 +2566,0.28767162561416626,0.23242607712745667,0.23169739544391632,0.2230769246816635,779.4003295898438,1e-05,0.17376750707626343,2.8467912673950195,81.14050197601318,2 +2567,0.18685942888259888,0.18524333834648132,0.172988623380661,0.23846153914928436,938.0095825195312,1e-05,0.1355391889810562,3.5388851165771484,81.14050197601318,2 +2568,0.15786045789718628,0.39896953105926514,0.3923661410808563,0.2902098000049591,990.36279296875,1e-05,1.741328477859497,3.4500174522399902,81.14050197601318,2 +2569,0.20889267325401306,0.17638209462165833,0.16721266508102417,0.1610722541809082,883.8079833984375,1e-05,0.15067730844020844,2.83402156829834,81.14050197601318,2 +2570,0.20883060991764069,0.1308296173810959,0.1376546025276184,0.14778554439544678,487.06573486328125,1e-05,0.15340256690979004,3.107294797897339,81.14050197601318,2 +2571,0.31127768754959106,0.2177390605211258,0.2232866734266281,0.2599067687988281,461.6126403808594,1e-05,0.14534257352352142,3.1154539585113525,81.14050197601318,2 +2572,0.17716018855571747,0.110192209482193,0.12356192618608475,0.23752914369106293,926.0864868164062,1e-05,0.4254448711872101,2.8347363471984863,81.14050197601318,2 +2573,0.278681218624115,0.19267958402633667,0.1797322779893875,0.238228440284729,905.37890625,1e-05,0.15931066870689392,3.726672649383545,81.14050197601318,2 +2574,0.05199463292956352,0.30860772728919983,0.27771326899528503,0.16923077404499054,989.2814331054688,1e-05,0.12200877815485,3.063364028930664,81.14050197601318,2 +2575,0.38952773809432983,0.22166302800178528,0.2164643555879593,0.14172494411468506,386.44976806640625,1e-05,0.17924746870994568,3.0779364109039307,81.14050197601318,2 +2576,0.24218493700027466,0.1998826265335083,0.19519004225730896,0.0951048955321312,484.3331604003906,1e-05,0.11974594742059708,2.849306344985962,81.14050197601318,2 +2577,0.1307191103696823,0.25027579069137573,0.238798126578331,0.24032634496688843,942.1655883789062,1e-05,0.1674213409423828,3.2601141929626465,81.14050197601318,2 +2578,0.14922308921813965,0.23403415083885193,0.22357633709907532,0.21958041191101074,828.0687866210938,1e-05,0.11954855918884277,3.2297163009643555,81.14050197601318,2 +2579,0.09069884568452835,0.3750096559524536,0.3543581962585449,0.20792540907859802,989.1450805664062,1e-05,0.2060757279396057,3.546063184738159,81.14050197601318,2 +2580,0.2709990441799164,0.15780635178089142,0.16506686806678772,0.20000000298023224,740.3775634765625,1e-05,0.1740494668483734,3.0974020957946777,81.14050197601318,2 +2581,0.3678443431854248,0.1636134386062622,0.16039177775382996,0.11445221304893494,709.9939575195312,1e-05,0.11777437478303909,3.0978996753692627,81.14050197601318,2 +2582,0.27545464038848877,0.20651574432849884,0.20087993144989014,0.22843822836875916,882.1692504882812,1e-05,0.17893871665000916,2.855271577835083,81.14050197601318,2 +2583,0.29523226618766785,0.16192859411239624,0.1560426652431488,0.22237762808799744,854.7328491210938,1e-05,0.3485024869441986,3.272123098373413,81.14050197601318,2 +2584,0.11701089143753052,0.20065027475357056,0.19557391107082367,0.11655011773109436,946.1489868164062,1e-05,0.14806154370307922,3.207611560821533,81.14050197601318,2 +2585,0.32430583238601685,0.14410221576690674,0.141551673412323,0.22284382581710815,868.2445068359375,1e-05,0.12870196998119354,3.518735408782959,81.14050197601318,2 +2586,0.13049674034118652,0.24849924445152283,0.2374560683965683,0.21771562099456787,711.1596069335938,1e-05,0.1224125325679779,3.3384478092193604,81.14050197601318,2 +2587,0.1581624150276184,0.0874936506152153,0.08865586668252945,0.22890442609786987,864.0462646484375,1e-05,0.193698912858963,3.0552732944488525,81.14050197601318,2 +2588,0.29984232783317566,0.2784627079963684,0.2702065110206604,0.14801864326000214,557.397705078125,1e-05,0.12126635015010834,2.851276397705078,81.14050197601318,2 +2589,0.24112699925899506,0.27474290132522583,0.2614506483078003,0.21048951148986816,753.992919921875,1e-05,0.1399374008178711,3.104844331741333,81.14050197601318,2 +2590,0.2734528183937073,0.2847634553909302,0.28097572922706604,0.2433566451072693,998.2254028320312,1e-05,0.1241941750049591,3.2198405265808105,81.14050197601318,2 +2591,0.08411530405282974,0.1995791494846344,0.1859806627035141,0.21282051503658295,975.5648193359375,1e-05,0.11341701447963715,3.4281716346740723,81.14050197601318,2 +2592,0.24334217607975006,0.2152649462223053,0.21126949787139893,0.1878787875175476,914.8272094726562,1e-05,0.15792356431484222,3.280303716659546,81.14050197601318,2 +2593,0.3277899920940399,0.20796990394592285,0.20611830055713654,0.17575757205486298,969.1096801757812,1e-05,0.20287880301475525,3.090304136276245,81.14050197601318,2 +2594,0.17681783437728882,0.20903494954109192,0.20429745316505432,0.23962703347206116,561.6887817382812,1e-05,0.13384924829006195,2.839057207107544,81.14050197601318,2 +2595,0.21673646569252014,0.15623515844345093,0.1412469893693924,0.17412588000297546,853.203369140625,1e-05,0.1619342565536499,3.1051533222198486,81.14050197601318,2 +2596,0.22619400918483734,0.38882142305374146,0.3894190192222595,0.272960364818573,959.7694091796875,1e-05,0.15087859332561493,3.5094804763793945,81.14050197601318,2 +2597,0.35524219274520874,0.22299310564994812,0.2160699963569641,0.16596736013889313,943.1180419921875,1e-05,0.1398131400346756,3.2815001010894775,81.14050197601318,2 +2598,0.27526217699050903,0.16841813921928406,0.1857878714799881,0.11794871836900711,970.3380126953125,1e-05,0.1525987684726715,3.3175652027130127,81.14050197601318,2 +2599,0.16384483873844147,0.21691516041755676,0.2214796394109726,0.26363635063171387,978.6064453125,1e-05,0.45889759063720703,3.1470258235931396,81.14050197601318,2 +2600,0.23265475034713745,0.15313886106014252,0.15771643817424774,0.08531468361616135,578.2326049804688,1e-05,0.21063661575317383,3.0349576473236084,81.14050197601318,2 +2601,0.234913170337677,0.2148800492286682,0.2018699198961258,0.2002331018447876,898.7340087890625,1e-05,0.15543437004089355,3.1335387229919434,81.14050197601318,2 +2602,0.21559473872184753,0.2049553543329239,0.2325867861509323,0.17855477333068848,948.1915893554688,1e-05,0.16053292155265808,3.2700984477996826,81.14050197601318,2 +2603,0.24065856635570526,0.25629207491874695,0.25003552436828613,0.18974359333515167,863.5715942382812,1e-05,0.1413780301809311,3.558788776397705,81.14050197601318,2 +2604,0.08051416277885437,0.19750553369522095,0.19154489040374756,0.2013985961675644,855.2390747070312,1e-05,0.8817422986030579,3.079653263092041,81.14050197601318,2 +2605,0.1447342038154602,0.2079973965883255,0.19612324237823486,0.18694639205932617,700.4320068359375,1e-05,0.13436530530452728,3.0840773582458496,81.14050197601318,2 +2606,0.21305376291275024,0.2008354216814041,0.19727960228919983,0.2365967333316803,730.0392456054688,1e-05,0.12862689793109894,3.128350019454956,81.14050197601318,2 +2607,0.2289494425058365,0.16407570242881775,0.15739470720291138,0.21328671276569366,948.1915893554688,1e-05,0.18418589234352112,2.844550132751465,81.14050197601318,2 +2608,0.10317708551883698,0.24458235502243042,0.23830828070640564,0.23636363446712494,955.3157958984375,1e-05,0.17552459239959717,3.4885003566741943,81.14050197601318,2 +2609,0.1737731546163559,0.4995341897010803,0.47050297260284424,0.2566433548927307,987.906494140625,1e-05,0.1490076631307602,3.2956361770629883,81.14050197601318,2 +2610,0.24119791388511658,0.15406979620456696,0.15519975125789642,0.21678321063518524,814.732421875,1e-05,0.17749124765396118,3.1402103900909424,81.14050197601318,2 +2611,0.19221550226211548,0.21566464006900787,0.2067505419254303,0.20000000298023224,670.3726196289062,1e-05,0.13921798765659332,3.102783441543579,81.14050197601318,2 +2612,0.2747228741645813,0.17246301472187042,0.1727394014596939,0.232634037733078,902.6273193359375,1e-05,0.1392846256494522,3.0823216438293457,81.14050197601318,2 +2613,0.13571015000343323,0.29557865858078003,0.28270113468170166,0.2578088641166687,990.630615234375,1e-05,0.3638765811920166,2.854687452316284,81.14050197601318,2 +2614,0.23941323161125183,0.24241913855075836,0.25066572427749634,0.19207459688186646,570.0819702148438,1e-05,0.1684422343969345,3.306156873703003,81.14050197601318,2 +2615,0.23765385150909424,0.2005700320005417,0.2076020985841751,0.15687645971775055,806.5763549804688,1e-05,0.14594422280788422,3.377723455429077,81.14050197601318,2 +2616,0.30169856548309326,0.1296437829732895,0.1272600293159485,0.2529137432575226,978.9199829101562,1e-05,0.11734475195407867,3.489250898361206,81.14050197601318,2 +2617,0.15201543271541595,0.35322627425193787,0.3460635244846344,0.12657342851161957,978.4493408203125,1e-05,0.16146638989448547,2.8422203063964844,81.14050197601318,2 +2618,0.2797309160232544,0.3274599611759186,0.3193387985229492,0.23170162737369537,999.9999389648438,1e-05,0.15588296949863434,3.316192626953125,81.14050197601318,2 +2619,0.23846329748630524,0.1439640372991562,0.14324243366718292,0.251748263835907,937.2574462890625,1e-05,0.18177103996276855,3.3257226943969727,81.14050197601318,2 +2620,0.2581201493740082,0.26624739170074463,0.28707414865493774,0.19090908765792847,973.2462768554688,1e-05,0.12649759650230408,3.075610399246216,81.14050197601318,2 +2621,0.21437597274780273,0.19096800684928894,0.19075198471546173,0.12797202169895172,515.6737670898438,1e-05,0.12255057692527771,3.3760838508605957,81.14050197601318,2 +2622,0.15004518628120422,0.2972757816314697,0.28579556941986084,0.18368297815322876,936.2454833984375,1e-05,0.13648998737335205,3.276679277420044,81.14050197601318,2 +2623,0.2179602086544037,0.22391411662101746,0.22990192472934723,0.23426572978496552,523.0420532226562,1e-05,0.27482083439826965,2.8372902870178223,81.14050197601318,2 +2624,0.2560594379901886,0.12150688469409943,0.12537401914596558,0.25151515007019043,812.7318115234375,1e-05,0.12559190392494202,3.2846903800964355,81.14050197601318,2 +2625,0.293415367603302,0.10886382311582565,0.11192911118268967,0.0995337963104248,682.6182250976562,1e-05,0.1638578623533249,3.2525789737701416,81.14050197601318,2 +2626,0.287149578332901,0.155593603849411,0.14732562005519867,0.13286712765693665,839.7739868164062,1e-05,0.18607863783836365,3.1273574829101562,81.14050197601318,2 +2627,0.19851826131343842,0.22241421043872833,0.2133142650127411,0.22610722482204437,781.0278930664062,1e-05,0.16227926313877106,3.177823066711426,81.14050197601318,2 +2628,0.3478902578353882,0.17486350238323212,0.1757948100566864,0.24312354624271393,857.74267578125,1e-05,0.16521646082401276,3.4323012828826904,81.14050197601318,2 +2629,0.20992885529994965,0.4316920042037964,0.4403775930404663,0.13636364042758942,972.9094848632812,1e-05,0.1800055354833603,2.8595635890960693,81.14050197601318,2 +2630,0.37622135877609253,0.24228186905384064,0.2509607672691345,0.16736596822738647,478.7982177734375,1e-05,0.12659506499767303,3.09147047996521,81.14050197601318,2 +2631,0.15920378267765045,0.3769620954990387,0.37014445662498474,0.23123542964458466,992.477783203125,1e-05,0.16529054939746857,3.351050853729248,81.14050197601318,2 +2632,0.20928648114204407,0.2516918182373047,0.24668632447719574,0.2242424190044403,701.6507568359375,1e-05,0.18893784284591675,3.1499271392822266,81.14050197601318,2 +2633,0.23482432961463928,0.2264578491449356,0.21862399578094482,0.1146853119134903,971.5481567382812,1e-05,0.15188360214233398,3.2968833446502686,81.14050197601318,2 +2634,0.33581671118736267,0.2283366173505783,0.23381835222244263,0.1515151560306549,827.4590454101562,1e-05,0.14793521165847778,3.1155922412872314,81.14050197601318,2 +2635,0.2651626765727997,0.20228254795074463,0.19463679194450378,0.2298368364572525,882.5809936523438,1e-05,0.1115226075053215,2.844209909439087,81.14050197601318,2 +2636,0.1604202389717102,0.3199378252029419,0.3057839274406433,0.20396269857883453,953.8506469726562,1e-05,0.14966106414794922,3.090963840484619,81.14050197601318,2 +2637,0.12300077080726624,0.2694215476512909,0.2565799653530121,0.19650349020957947,939.7424926757812,1e-05,0.12133178114891052,3.3639636039733887,81.14050197601318,2 +2638,0.33181053400039673,0.2402668595314026,0.23212207853794098,0.2477855533361435,735.275390625,1e-05,0.16038201749324799,3.145488977432251,81.14050197601318,2 +2639,0.10014431923627853,0.2709968388080597,0.2697386145591736,0.2153846174478531,990.0938720703125,1e-05,0.14282438158988953,3.1515674591064453,81.14050197601318,2 +2640,0.2067200392484665,0.23334144055843353,0.22569197416305542,0.21724942326545715,771.0321044921875,1e-05,0.14092741906642914,3.0817015171051025,81.14050197601318,2 +2641,0.1260993778705597,0.29643526673316956,0.29481109976768494,0.23752914369106293,992.996826171875,1e-05,0.1323164403438568,3.076040506362915,81.14050197601318,2 +2642,0.17838820815086365,0.2097453624010086,0.21536169946193695,0.21561771631240845,985.0772094726562,1e-05,0.27980759739875793,2.8537535667419434,81.14050197601318,2 +2643,0.1606532335281372,0.3281898498535156,0.3085125982761383,0.22004662454128265,845.2969360351562,1e-05,0.17100368440151215,3.283220052719116,81.14050197601318,2 +2644,0.22830688953399658,0.2624216675758362,0.26667889952659607,0.20000000298023224,926.6471557617188,1e-05,0.22755862772464752,3.1419460773468018,81.14050197601318,2 +2645,0.13929857313632965,0.24865186214447021,0.23945781588554382,0.2209790199995041,988.32177734375,1e-05,0.12658482789993286,3.153266429901123,81.14050197601318,2 +2646,0.25688159465789795,0.18315847218036652,0.17922158539295197,0.12820512056350708,792.0157470703125,1e-05,0.130527064204216,3.1221678256988525,81.14050197601318,2 +2647,0.24828818440437317,0.3121799826622009,0.2857503294944763,0.20606060326099396,950.1903076171875,1e-05,0.10051175206899643,3.107511281967163,81.14050197601318,2 +2648,0.16043011844158173,0.22204267978668213,0.21544033288955688,0.20652680099010468,913.8861694335938,1e-05,0.2411511242389679,3.176182746887207,81.14050197601318,2 +2649,0.2916664779186249,0.24701692163944244,0.23308977484703064,0.2533799409866333,788.1709594726562,1e-05,0.31938937306404114,3.063861846923828,81.14050197601318,2 +2650,0.1394943743944168,0.16470184922218323,0.16818831861019135,0.15874126553535461,640.6287231445312,1e-05,0.14905670285224915,3.1697163581848145,81.14050197601318,2 +2651,0.17612718045711517,0.11970633268356323,0.1242571473121643,0.2125874161720276,882.1692504882812,1e-05,0.10705249756574631,3.3652961254119873,81.14050197601318,2 +2652,0.21961353719234467,0.32217562198638916,0.30433017015457153,0.21445220708847046,980.1610107421875,1e-05,0.22956381738185883,2.846054792404175,81.14050197601318,2 +2653,0.30561351776123047,0.2657180726528168,0.276557594537735,0.24965034425258636,502.9901123046875,1e-05,0.2517639100551605,3.10064697265625,81.14050197601318,2 +2654,0.24718034267425537,0.21808387339115143,0.21203292906284332,0.2501165568828583,772.7371215820312,1e-05,0.18756988644599915,3.1647775173187256,81.14050197601318,2 +2655,0.17374137043952942,0.4169559180736542,0.39882293343544006,0.21095570921897888,133.62509155273438,1e-05,0.11479374021291733,3.1094613075256348,81.14050197601318,2 +2656,0.24831801652908325,0.17170120775699615,0.16988594830036163,0.1263403296470642,776.0996704101562,1e-05,0.1934857815504074,3.1217689514160156,81.14050197601318,2 +2657,0.40797510743141174,0.15081225335597992,0.156235933303833,0.15571095049381256,508.12554931640625,1e-05,0.17829866707324982,3.391315221786499,81.14050197601318,2 +2658,0.30592501163482666,0.24077598750591278,0.22629284858703613,0.17249417304992676,761.3585205078125,1e-05,0.15450462698936462,2.8611652851104736,81.14050197601318,2 +2659,0.1372179239988327,0.27449050545692444,0.2695904076099396,0.23449882864952087,983.3262329101562,1e-05,0.14445355534553528,3.1559524536132812,81.14050197601318,2 +2660,0.16206343472003937,0.1844610571861267,0.1863105744123459,0.1498834490776062,947.9669189453125,1e-05,0.20116811990737915,3.1778006553649902,81.14050197601318,2 +2661,0.2762920558452606,0.17666447162628174,0.19007033109664917,0.12960372865200043,973.748779296875,1e-05,0.27686595916748047,3.108539342880249,81.14050197601318,2 +2662,0.4235497713088989,0.5571276545524597,0.5538842082023621,0.18275058269500732,188.9440460205078,1e-05,0.14311613142490387,3.141201972961426,81.14050197601318,2 +2663,0.2067432701587677,0.40636077523231506,0.3946404457092285,0.19393938779830933,972.9094848632812,1e-05,0.15204761922359467,3.1588664054870605,81.14050197601318,2 +2664,0.1988271027803421,0.13635659217834473,0.13798263669013977,0.12703962624073029,795.77587890625,1e-05,0.34301498532295227,2.853855848312378,81.14050197601318,2 +2665,0.18626324832439423,0.3440396189689636,0.329046368598938,0.2449883371591568,980.7741088867188,1e-05,0.26271262764930725,3.251439332962036,81.14050197601318,2 +2666,0.21894380450248718,0.24300377070903778,0.24028295278549194,0.2337995320558548,990.4967651367188,1e-05,0.17127713561058044,3.337219715118408,81.14050197601318,2 +2667,0.16094376146793365,0.2205277383327484,0.20795978605747223,0.2596736550331116,797.257080078125,1e-05,0.12905091047286987,3.1787002086639404,81.14050197601318,2 +2668,0.15570411086082458,0.3079443573951721,0.29407939314842224,0.18601398169994354,951.0648803710938,1e-05,0.2834285795688629,3.4124186038970947,81.14050197601318,2 +2669,0.14893734455108643,0.2655733823776245,0.2519368529319763,0.24988344311714172,904.6971435546875,1e-05,0.2196936458349228,3.115574598312378,81.14050197601318,2 +2670,0.09624391049146652,0.33543357253074646,0.3261649012565613,0.23006993532180786,997.3809814453125,1e-05,0.12849830090999603,2.8337581157684326,81.14050197601318,2 +2671,0.3019075095653534,0.303989440202713,0.2777893543243408,0.2214452177286148,956.142333984375,1e-05,0.141937255859375,3.3603384494781494,81.14050197601318,2 +2672,0.15728434920310974,0.14717930555343628,0.15913468599319458,0.12261072546243668,967.5030517578125,1e-05,0.1416396200656891,3.3759610652923584,81.14050197601318,2 +2673,0.3056817054748535,0.12960436940193176,0.1212577223777771,0.19813519716262817,863.0953369140625,1e-05,0.11606490612030029,3.1491754055023193,81.14050197601318,2 +2674,0.16928920149803162,0.2446935772895813,0.242070734500885,0.22004662454128265,965.6807250976562,1e-05,0.1391320824623108,3.098818302154541,81.14050197601318,2 +2675,0.4573342204093933,0.23329894244670868,0.23081806302070618,0.13682983815670013,537.2642211914062,1e-05,0.19597870111465454,3.0830564498901367,81.14050197601318,2 +2676,0.3294961452484131,0.19956256449222565,0.19785575568675995,0.20652680099010468,518.1495361328125,1e-05,0.1784932166337967,3.110189437866211,81.14050197601318,2 +2677,0.25956404209136963,0.2264394909143448,0.21343086659908295,0.2489510476589203,706.4580688476562,1e-05,0.13077370822429657,3.0940728187561035,81.14050197601318,2 +2678,0.3044053912162781,0.2908712327480316,0.28621670603752136,0.0699300691485405,973.4141235351562,1e-05,0.17047511041164398,3.121490478515625,81.14050197601318,2 +2679,0.1746562272310257,0.18771615624427795,0.1935621052980423,0.17645686864852905,861.6561889648438,1e-05,0.1696871817111969,3.186354398727417,81.14050197601318,2 +2680,0.41973039507865906,0.27870967984199524,0.26810023188591003,0.23613053560256958,630.94677734375,1e-05,0.13781984150409698,3.1103861331939697,81.14050197601318,2 +2681,0.328941285610199,0.29974812269210815,0.29174941778182983,0.257342666387558,314.781494140625,1e-05,0.14358824491500854,3.1064157485961914,81.14050197601318,2 +2682,0.14987555146217346,0.10145509243011475,0.10663720965385437,0.23706293106079102,996.1564331054688,1e-05,0.15404218435287476,3.1007676124572754,81.14050197601318,2 +2683,0.2929789423942566,0.23802997171878815,0.227789968252182,0.2265734225511551,707.6432495117188,1e-05,0.1500527709722519,3.300766706466675,81.14050197601318,2 +2684,0.23658612370491028,0.2461717128753662,0.22971691191196442,0.22890442609786987,781.0278930664062,1e-05,0.14145837724208832,3.168086051940918,81.14050197601318,2 +2685,0.10863374918699265,0.2518403232097626,0.25261709094047546,0.20116549730300903,945.4581298828125,1e-05,0.19999602437019348,3.3493762016296387,81.14050197601318,2 +2686,0.09448036551475525,0.37947654724121094,0.38090184330940247,0.13333334028720856,989.6887817382812,1e-05,0.253839910030365,3.437323570251465,81.14050197601318,2 +2687,0.3665030598640442,0.2629745900630951,0.26171037554740906,0.21235431730747223,470.316650390625,1e-05,0.17642103135585785,2.844325304031372,81.14050197601318,2 +2688,0.23987442255020142,0.24612544476985931,0.23160938918590546,0.24452213943004608,846.9136352539062,1e-05,1.1148911714553833,3.0768003463745117,81.14050197601318,2 +2689,0.30335116386413574,0.2549097537994385,0.2517136037349701,0.1974359005689621,944.9946899414062,1e-05,0.11715815216302872,3.4065628051757812,81.14050197601318,2 +2690,0.26532605290412903,0.18913905322551727,0.17568551003932953,0.19883449375629425,836.3575439453125,1e-05,0.1656028777360916,3.079768657684326,81.14050197601318,2 +2691,0.1513649821281433,0.20594651997089386,0.21452157199382782,0.19137528538703918,994.7838134765625,1e-05,0.11936192214488983,3.4310758113861084,81.14050197601318,2 +2692,0.1686781495809555,0.2932001054286957,0.2664796710014343,0.26247087121009827,922.3670654296875,1e-05,0.15459635853767395,3.3889124393463135,81.14050197601318,2 +2693,0.11706434935331345,0.14641867578029633,0.15933865308761597,0.17762237787246704,723.5714111328125,1e-05,0.16613829135894775,2.8298187255859375,81.14050197601318,2 +2694,0.2236427664756775,0.14358730614185333,0.15393836796283722,0.17599067091941833,481.577392578125,1e-05,0.16896331310272217,3.0758159160614014,81.14050197601318,2 +2695,0.36666417121887207,0.20145300030708313,0.19487571716308594,0.1862470805644989,798.72509765625,1e-05,0.20474722981452942,3.073503255844116,81.14050197601318,2 +2696,0.27762648463249207,0.22793960571289062,0.23119384050369263,0.0699300691485405,440.3874816894531,1e-05,0.1345350444316864,3.623918056488037,81.14050197601318,2 +2697,0.18668265640735626,0.16933700442314148,0.1783938854932785,0.18205128610134125,697.9737548828125,1e-05,0.15102505683898926,3.0167391300201416,81.14050197601318,2 +2698,0.19708997011184692,0.1337767243385315,0.1499398648738861,0.19044288992881775,932.6204223632812,1e-05,0.1964150071144104,3.3425028324127197,81.14050197601318,2 +2699,0.295777827501297,0.12084449827671051,0.1372266262769699,0.20792540907859802,730.0392456054688,1e-05,0.15056072175502777,2.8404042720794678,81.14050197601318,2 +2700,0.2870693802833557,0.2524144649505615,0.2373351752758026,0.23170162737369537,899.4515991210938,1e-05,0.16920670866966248,3.2513222694396973,81.14050197601318,2 +2701,0.19267681241035461,0.27556219696998596,0.26954779028892517,0.17529137432575226,928.5856323242188,1e-05,0.13713617622852325,3.456268787384033,81.14050197601318,2 +2702,0.24559591710567474,0.29112839698791504,0.27430662512779236,0.1526806503534317,987.7676391601562,1e-05,0.15237149596214294,3.3276586532592773,81.14050197601318,2 +2703,0.1401311159133911,0.23684944212436676,0.2435780018568039,0.21911421418190002,960.5552368164062,1e-05,0.12207793444395065,3.089592218399048,81.14050197601318,2 +2704,0.1976170837879181,0.2065698653459549,0.20005789399147034,0.21841491758823395,817.3616943359375,1e-05,0.14952129125595093,3.362689733505249,81.14050197601318,2 +2705,0.42612555623054504,0.3307245671749115,0.3480012118816376,0.18438228964805603,553.0419311523438,1e-05,0.1235664114356041,2.85648512840271,81.14050197601318,2 +2706,0.2177661657333374,0.1702866554260254,0.17102573812007904,0.18857808411121368,760.4534912109375,1e-05,0.18493884801864624,3.380948305130005,81.14050197601318,2 +2707,0.20677459239959717,0.17040979862213135,0.16865330934524536,0.20233100652694702,963.6295776367188,1e-05,0.20336177945137024,3.0586307048797607,81.14050197601318,2 +2708,0.30628660321235657,0.3878755569458008,0.37685221433639526,0.2214452177286148,344.2266540527344,1e-05,0.1831732839345932,3.152975082397461,81.14050197601318,2 +2709,0.14734135568141937,0.2715078890323639,0.2621766924858093,0.15874126553535461,943.5906372070312,1e-05,0.16789519786834717,3.0550498962402344,81.14050197601318,2 +2710,0.14905107021331787,0.1600990742444992,0.14964497089385986,0.11002331227064133,933.9302368164062,1e-05,0.19946855306625366,3.0900485515594482,81.14050197601318,2 +2711,0.29547351598739624,0.29268577694892883,0.30361053347587585,0.09370629489421844,194.7152557373047,1e-05,0.9414755702018738,3.1330225467681885,81.14050197601318,2 +2712,0.15558362007141113,0.36670759320259094,0.34185177087783813,0.2130536139011383,991.4281005859375,1e-05,0.17764005064964294,3.0522491931915283,81.14050197601318,2 +2713,0.2044302076101303,0.19197240471839905,0.20860221982002258,0.1918414980173111,995.535888671875,1e-05,0.19896933436393738,3.0963551998138428,81.14050197601318,2 +2714,0.26685118675231934,0.13474048674106598,0.13315077126026154,0.2242424190044403,947.5157470703125,1e-05,0.1883712261915207,3.1944825649261475,81.14050197601318,2 +2715,0.2597656846046448,0.3567088842391968,0.3449307084083557,0.23986013233661652,978.134033203125,1e-05,0.2035854011774063,3.105760097503662,81.14050197601318,2 +2716,0.10958030819892883,0.1725451946258545,0.16025859117507935,0.16060605645179749,642.2061767578125,1e-05,0.17360885441303253,3.0505714416503906,81.14050197601318,2 +2717,0.27065131068229675,0.1728038787841797,0.1689065545797348,0.13449883460998535,830.4837646484375,1e-05,0.1381767988204956,3.1388444900512695,81.14050197601318,2 +2718,0.2875533998012543,0.2776348888874054,0.27193284034729004,0.1090909093618393,601.3294677734375,1e-05,0.24116267263889313,3.027158498764038,81.14050197601318,2 +2719,0.2663156986236572,0.2132531702518463,0.20500458776950836,0.139860138297081,966.414306640625,1e-05,0.13691700994968414,3.0532326698303223,81.14050197601318,2 +2720,0.21543268859386444,0.36334356665611267,0.3456219732761383,0.19603729248046875,673.1508178710938,1e-05,0.10609224438667297,3.5034966468811035,81.14050197601318,2 +2721,0.20481684803962708,0.20616446435451508,0.1944795399904251,0.1554778516292572,640.6287231445312,1e-05,0.18712638318538666,3.136415719985962,81.14050197601318,2 +2722,0.2548861503601074,0.18830016255378723,0.19346782565116882,0.17086246609687805,926.9263305664062,1e-05,0.13786974549293518,3.164201259613037,81.14050197601318,2 +2723,0.19292166829109192,0.2865580916404724,0.2785753011703491,0.2209790199995041,922.3670654296875,1e-05,0.171904057264328,3.0989022254943848,81.14050197601318,2 +2724,0.2213306874036789,0.18606047332286835,0.19020238518714905,0.21398600935935974,701.6507568359375,1e-05,0.342607319355011,3.0792133808135986,81.14050197601318,2 +2725,0.22602739930152893,0.16513219475746155,0.16203588247299194,0.17132866382598877,646.8789672851562,1e-05,0.12691883742809296,3.0693678855895996,81.14050197601318,2 +2726,0.12921130657196045,0.15690985321998596,0.1615970879793167,0.23706293106079102,899.4515991210938,1e-05,0.6303892135620117,3.4902992248535156,81.14050197601318,2 +2727,0.19452765583992004,0.3337383270263672,0.3139210045337677,0.24568764865398407,997.5022583007812,1e-05,0.11541138589382172,3.055647850036621,81.14050197601318,2 +2728,0.3214321732521057,0.2947918176651001,0.292094349861145,0.22121211886405945,427.6461486816406,1e-05,0.14256595075130463,3.0856480598449707,81.14050197601318,2 +2729,0.2555767595767975,0.21405018866062164,0.2019084244966507,0.139860138297081,899.0933837890625,1e-05,0.1917717605829239,3.0901989936828613,81.14050197601318,2 +2730,0.3076626658439636,0.20363390445709229,0.19911642372608185,0.22727273404598236,781.0278930664062,1e-05,0.1947752684354782,3.2922630310058594,81.14050197601318,2 +2731,0.1976465880870819,0.17105722427368164,0.17022749781608582,0.1662004590034485,859.223388671875,1e-05,0.19279834628105164,3.1189632415771484,81.14050197601318,2 +2732,0.17451758682727814,0.34891656041145325,0.3416295051574707,0.19790209829807281,983.3262329101562,1e-05,0.13806696236133575,3.460573673248291,81.14050197601318,2 +2733,0.26056966185569763,0.6570343375205994,0.6576560735702515,0.2125874161720276,140.08938598632812,1e-05,0.1409691721200943,3.113995313644409,81.14050197601318,2 +2734,0.2314658910036087,0.17463445663452148,0.1680106222629547,0.20652680099010468,681.2896118164062,1e-05,0.12917602062225342,3.121504783630371,81.14050197601318,2 +2735,0.2561916708946228,0.10941191017627716,0.12586714327335358,0.1906759887933731,966.9605712890625,1e-05,0.12293815612792969,3.1718993186950684,81.14050197601318,2 +2736,0.2386016547679901,0.18071478605270386,0.16226395964622498,0.1354312300682068,859.7134399414062,1e-05,0.13674914836883545,3.2837259769439697,81.14050197601318,2 +2737,0.16406981647014618,0.36472418904304504,0.3401658833026886,0.18648017942905426,989.41748046875,1e-05,0.13320961594581604,3.3390164375305176,81.14050197601318,2 +2738,0.2400192767381668,0.4267597496509552,0.438052237033844,0.17575757205486298,991.5601806640625,1e-05,0.14199689030647278,3.3228917121887207,81.14050197601318,2 +2739,0.08300692588090897,0.2142801433801651,0.23053139448165894,0.21841491758823395,997.0159301757812,1e-05,0.22529633343219757,3.0575530529022217,81.14050197601318,2 +2740,0.20144151151180267,0.21042850613594055,0.22660939395427704,0.20815850794315338,363.995361328125,1e-05,0.19121228158473969,2.835996150970459,81.14050197601318,2 +2741,0.13000790774822235,0.21535956859588623,0.19985376298427582,0.25244754552841187,776.0996704101562,1e-05,0.11914213001728058,3.063566207885742,81.14050197601318,2 +2742,0.17590098083019257,0.2657848596572876,0.24802561104297638,0.2426573485136032,879.6704711914062,1e-05,0.13215571641921997,3.3709211349487305,81.14050197601318,2 +2743,0.1053895652294159,0.08929348737001419,0.08575502783060074,0.21794871985912323,974.9092407226562,1e-05,0.6333766579627991,3.26942777633667,81.14050197601318,2 +2744,0.15510806441307068,0.14931952953338623,0.14143209159374237,0.1354312300682068,849.041259765625,1e-05,0.14947205781936646,3.2891452312469482,81.14050197601318,2 +2745,0.10398058593273163,0.2805582284927368,0.26592350006103516,0.22634032368659973,984.2067260742188,1e-05,0.1320355385541916,3.1275317668914795,81.14050197601318,2 +2746,0.27311959862709045,0.29213598370552063,0.2842799723148346,0.1694638729095459,981.9857788085938,1e-05,0.45181524753570557,2.840853214263916,81.14050197601318,2 +2747,0.2005349099636078,0.21320092678070068,0.20510536432266235,0.17832167446613312,800.1805419921875,1e-05,0.12061344087123871,3.414569139480591,81.14050197601318,2 +2748,0.42190396785736084,0.19837474822998047,0.18510425090789795,0.18648017942905426,888.2062377929688,1e-05,0.16461604833602905,3.130905866622925,81.14050197601318,2 +2749,0.2094821184873581,0.16606979072093964,0.17275728285312653,0.16969697177410126,958.9761352539062,1e-05,0.12252681702375412,3.1655917167663574,81.14050197601318,2 +2750,0.19619256258010864,0.17377276718616486,0.17631778120994568,0.21235431730747223,945.226806640625,1e-05,0.20904473960399628,3.34479022026062,81.14050197601318,2 +2751,0.2270754873752594,0.17586371302604675,0.18967226147651672,0.16689977049827576,988.734619140625,1e-05,0.13780316710472107,3.1196467876434326,81.14050197601318,2 +2752,0.1882895976305008,0.18808335065841675,0.1791841834783554,0.18298368155956268,944.0609741210938,1e-05,0.158525750041008,3.1853809356689453,81.14050197601318,2 +2753,0.1643073856830597,0.17925454676151276,0.19032616913318634,0.21515151858329773,986.221923828125,1e-05,0.14077617228031158,3.1158676147460938,81.14050197601318,2 +2754,0.31702327728271484,0.2890799939632416,0.2796948254108429,0.19650349020957947,734.2389526367188,1e-05,0.1252216398715973,2.8289475440979004,81.14050197601318,2 +2755,0.26934802532196045,0.23717257380485535,0.23383882641792297,0.29510489106178284,709.9939575195312,1e-05,0.2681833803653717,3.3376786708831787,81.14050197601318,2 +2756,0.33077526092529297,0.34468045830726624,0.3378925323486328,0.2242424190044403,348.26116943359375,1e-05,0.1741301715373993,3.2056195735931396,81.14050197601318,2 +2757,0.28178802132606506,0.22099247574806213,0.2130293995141983,0.10489510744810104,712.31884765625,1e-05,0.14324890077114105,3.112816095352173,81.14050197601318,2 +2758,0.11314278095960617,0.24816277623176575,0.25346559286117554,0.16969697177410126,951.2822265625,1e-05,0.1373170018196106,3.1682188510894775,81.14050197601318,2 +2759,0.19708764553070068,0.1358397901058197,0.13349275290966034,0.19790209829807281,754.9295654296875,1e-05,0.14759138226509094,3.059262275695801,81.14050197601318,2 +2760,0.17135433852672577,0.12212516367435455,0.13065983355045319,0.16060605645179749,702.8627319335938,1e-05,0.20566657185554504,2.843269109725952,81.14050197601318,2 +2761,0.16856738924980164,0.14540192484855652,0.14398685097694397,0.127505823969841,821.8599853515625,1e-05,0.14647755026817322,3.439958095550537,81.14050197601318,2 +2762,0.2332412153482437,0.25480523705482483,0.2611335515975952,0.1918414980173111,976.8599853515625,1e-05,0.13780002295970917,3.0853664875030518,81.14050197601318,2 +2763,0.13781900703907013,0.20193281769752502,0.20589971542358398,0.2181818187236786,890.5407104492188,1e-05,0.19091646373271942,3.069429636001587,81.14050197601318,2 +2764,0.35226571559906006,0.2802563011646271,0.25964415073394775,0.1867132931947708,949.0853271484375,1e-05,0.16831223666667938,3.06532621383667,81.14050197601318,2 +2765,0.2983742356300354,0.17556451261043549,0.1685103327035904,0.22610722482204437,553.0419311523438,1e-05,0.13752642273902893,3.107642650604248,81.14050197601318,2 +2766,0.25130513310432434,0.21189890801906586,0.20298124849796295,0.14195804297924042,970.8588256835938,1e-05,0.17054440081119537,2.8463361263275146,81.14050197601318,2 +2767,0.3282056748867035,0.16764675080776215,0.1694834679365158,0.253846138715744,781.836181640625,1e-05,0.344500333070755,3.44236159324646,81.14050197601318,2 +2768,0.2572324573993683,0.2525317370891571,0.2475353330373764,0.20792540907859802,443.50128173828125,1e-05,0.1314484030008316,3.1321449279785156,81.14050197601318,2 +2769,0.20623840391635895,0.1696019470691681,0.16587549448013306,0.15011654794216156,926.6471557617188,1e-05,0.15156583487987518,2.8472206592559814,81.14050197601318,2 +2770,0.10939359664916992,0.17115382850170135,0.16772811114788055,0.26759907603263855,864.9906616210938,1e-05,0.16222533583641052,3.157058000564575,81.14050197601318,2 +2771,0.17393440008163452,0.13015513122081757,0.13095346093177795,0.12237761914730072,904.354736328125,1e-05,0.16141377389431,3.414790153503418,81.14050197601318,2 +2772,0.22798383235931396,0.2100347876548767,0.2048490196466446,0.19393938779830933,910.0397338867188,1e-05,0.27807220816612244,3.2891154289245605,81.14050197601318,2 +2773,0.28968456387519836,0.41595152020454407,0.4064139723777771,0.11794871836900711,296.9483642578125,1e-05,0.14658047258853912,3.0639569759368896,81.14050197601318,2 +2774,0.19747833907604218,0.13930004835128784,0.13950294256210327,0.22447551786899567,953.8506469726562,1e-05,0.14660701155662537,3.113452672958374,81.14050197601318,2 +2775,0.18430310487747192,0.1703677624464035,0.1667243391275406,0.17296037077903748,792.0157470703125,1e-05,0.15113870799541473,2.8301286697387695,81.14050197601318,2 +2776,0.2552493214607239,0.22240695357322693,0.21567636728286743,0.2557109594345093,924.38623046875,1e-05,0.14526459574699402,3.1700377464294434,81.14050197601318,2 +2777,0.16165345907211304,0.2056886851787567,0.20238837599754333,0.18974359333515167,911.3367309570312,1e-05,0.16855286061763763,3.055981397628784,81.14050197601318,2 +2778,0.23593546450138092,0.317888081073761,0.32533368468284607,0.17156177759170532,947.2893676757812,1e-05,0.15086862444877625,3.1389071941375732,81.14050197601318,2 +2779,0.19828513264656067,0.32787373661994934,0.33824217319488525,0.2780885696411133,238.46560668945312,1e-05,0.1635977029800415,3.1084184646606445,81.14050197601318,2 +2780,0.18356099724769592,0.18639692664146423,0.18785828351974487,0.16923077404499054,898.37353515625,1e-05,0.18569256365299225,3.1384127140045166,81.14050197601318,2 +2781,0.21882764995098114,0.21859405934810638,0.2184630036354065,0.18088577687740326,948.8626708984375,1e-05,0.8636755347251892,2.8341140747070312,81.14050197601318,2 +2782,0.21771995723247528,0.18288353085517883,0.20127654075622559,0.0995337963104248,974.2481079101562,1e-05,0.1576344519853592,3.1403346061706543,81.14050197601318,2 +2783,0.32588842511177063,0.2697618305683136,0.2684023678302765,0.13682983815670013,440.3874816894531,1e-05,0.13014622032642365,3.1125741004943848,81.14050197601318,2 +2784,0.10024446249008179,0.18052884936332703,0.1750272512435913,0.145454540848732,913.2542724609375,1e-05,0.24486127495765686,3.1501259803771973,81.14050197601318,2 +2785,0.3835192918777466,0.3220442533493042,0.3187943994998932,0.18927739560604095,310.39483642578125,1e-05,0.9803564548492432,3.1160757541656494,81.14050197601318,2 +2786,0.2394547015428543,0.2267155647277832,0.22019456326961517,0.2405594438314438,827.4590454101562,1e-05,0.14166966080665588,3.3009393215179443,81.14050197601318,2 +2787,0.2906702756881714,0.15029697120189667,0.14779727160930634,0.22727273404598236,716.8931274414062,1e-05,0.1318097859621048,2.8225862979888916,81.14050197601318,2 +2788,0.1811823695898056,0.25774815678596497,0.2678760290145874,0.2337995320558548,982.2857666015625,1e-05,0.13536009192466736,3.387167453765869,81.14050197601318,2 +2789,0.26622408628463745,0.2052968591451645,0.1921933889389038,0.2102564126253128,910.3654174804688,1e-05,0.14729373157024384,3.0380423069000244,81.14050197601318,2 +2790,0.2030407041311264,0.12233095616102219,0.12568573653697968,0.23916083574295044,800.1805419921875,1e-05,0.1971828192472458,3.189710855484009,81.14050197601318,2 +2791,0.14878898859024048,0.15335886180400848,0.1500488519668579,0.22191141545772552,977.0203857421875,1e-05,0.15202902257442474,2.8284192085266113,81.14050197601318,2 +2792,0.28162139654159546,0.10942583531141281,0.11007345467805862,0.2041957974433899,886.226318359375,1e-05,0.1476968377828598,3.1411654949188232,81.14050197601318,2 +2793,0.22358600795269012,0.19510500133037567,0.18601229786872864,0.26363635063171387,959.966552734375,1e-05,0.1280384361743927,2.832775592803955,81.14050197601318,2 +2794,0.1958421915769577,0.2489372342824936,0.24669574201107025,0.1738927662372589,807.9645385742188,1e-05,0.11341186612844467,3.336266279220581,81.14050197601318,2 +2795,0.22555752098560333,0.31526124477386475,0.3197610676288605,0.12937062978744507,972.0613403320312,1e-05,0.1876886785030365,3.1028318405151367,81.14050197601318,2 +2796,0.37149083614349365,0.15930773317813873,0.1566190868616104,0.2186480164527893,722.4732666015625,1e-05,0.2683565616607666,3.241312026977539,81.14050197601318,2 +2797,0.19437439739704132,0.2797697186470032,0.27501049637794495,0.13729603588581085,967.8626708984375,1e-05,0.1987793743610382,3.059415578842163,81.14050197601318,2 +2798,0.272075355052948,0.3684251308441162,0.34616461396217346,0.21958041191101074,978.4493408203125,1e-05,0.14311110973358154,3.117854356765747,81.14050197601318,2 +2799,0.24933966994285583,0.14775153994560242,0.15191465616226196,0.21724942326545715,781.0278930664062,1e-05,0.15367896854877472,2.822765827178955,81.14050197601318,2 +2800,0.16929344832897186,0.08639027923345566,0.09029357880353928,0.2566433548927307,492.46246337890625,1e-05,0.12299679219722748,3.307749032974243,81.14050197601318,2 +2801,0.24215321242809296,0.17538389563560486,0.18646308779716492,0.2242424190044403,808.654296875,1e-05,0.1328907161951065,3.085151433944702,81.14050197601318,2 +2802,0.32808786630630493,0.302518367767334,0.29628005623817444,0.22331002354621887,652.9728393554688,1e-05,0.17210759222507477,3.433852434158325,81.14050197601318,2 +2803,0.18009847402572632,0.3273589313030243,0.341665118932724,0.16526806354522705,238.46560668945312,1e-05,0.2156788408756256,3.065394639968872,81.14050197601318,2 +2804,0.22588130831718445,0.1508718580007553,0.15066833794116974,0.249417245388031,724.6637573242188,1e-05,0.3462560176849365,3.133497476577759,81.14050197601318,2 +2805,0.24473340809345245,0.4396219551563263,0.4214174151420593,0.21328671276569366,997.6233520507812,1e-05,0.27785244584083557,3.1309802532196045,81.14050197601318,2 +2806,0.2119634449481964,0.45860496163368225,0.43958479166030884,0.21678321063518524,988.0452880859375,1e-05,0.16279204189777374,3.4223878383636475,81.14050197601318,2 +2807,0.2199198603630066,0.2340615689754486,0.23775756359100342,0.21212121844291687,622.5833740234375,1e-05,0.1909523457288742,2.8426687717437744,81.14050197601318,2 +2808,0.09998894482851028,0.14423564076423645,0.13473382592201233,0.21118880808353424,913.5706787109375,1e-05,0.1334662139415741,3.367363214492798,81.14050197601318,2 +2809,0.5023371577262878,0.32435354590415955,0.31646883487701416,0.2214452177286148,440.3874816894531,1e-05,0.17259052395820618,3.054614782333374,81.14050197601318,2 +2810,0.3002244532108307,0.18336573243141174,0.17179030179977417,0.22004662454128265,677.2564697265625,1e-05,0.12896661460399628,3.0526254177093506,81.14050197601318,2 +2811,0.31913143396377563,0.2303706705570221,0.2270537167787552,0.1962703913450241,975.4014282226562,1e-05,0.12644445896148682,3.1330959796905518,81.14050197601318,2 +2812,0.3703330457210541,0.2271597534418106,0.21624699234962463,0.21002331376075745,888.2062377929688,1e-05,0.14773449301719666,3.368640422821045,81.14050197601318,2 +2813,0.33885765075683594,0.2227218747138977,0.21913768351078033,0.15757575631141663,864.5192260742188,1e-05,0.154458686709404,2.827178716659546,81.14050197601318,2 +2814,0.3412635922431946,0.23744776844978333,0.23745481669902802,0.19440560042858124,434.07476806640625,1e-05,0.16932454705238342,3.141543388366699,81.14050197601318,2 +2815,0.25368213653564453,0.26845890283584595,0.2650223970413208,0.17832167446613312,557.397705078125,1e-05,0.22261632978916168,3.082063674926758,81.14050197601318,2 +2816,0.09630011022090912,0.12595398724079132,0.13037952780723572,0.14731934666633606,935.7356567382812,1e-05,0.15880729258060455,3.076817035675049,81.14050197601318,2 +2817,0.2073877602815628,0.13960318267345428,0.14281126856803894,0.22331002354621887,927.482421875,1e-05,0.14428383111953735,3.113722562789917,81.14050197601318,2 +2818,0.20335891842842102,0.23603107035160065,0.23693251609802246,0.19650349020957947,764.9352416992188,1e-05,0.13798005878925323,3.4221866130828857,81.14050197601318,2 +2819,0.17618438601493835,0.16253189742565155,0.1653197556734085,0.17972028255462646,931.56005859375,1e-05,0.1637200117111206,2.8328020572662354,81.14050197601318,2 +2820,0.098432257771492,0.1992752104997635,0.18660353124141693,0.2097902148962021,933.4083862304688,1e-05,0.19197802245616913,3.0547966957092285,81.14050197601318,2 +2821,0.33696433901786804,0.23121020197868347,0.22079239785671234,0.1750582754611969,728.9754028320312,1e-05,0.1309690922498703,3.135342836380005,81.14050197601318,2 +2822,0.2036668360233307,0.26564475893974304,0.27461469173431396,0.18531468510627747,400.70562744140625,1e-05,0.1512710452079773,2.827434539794922,81.14050197601318,2 +2823,0.3154076635837555,0.38122570514678955,0.38539624214172363,0.23053613305091858,999.8831176757812,1e-05,0.1396399885416031,3.061094045639038,81.14050197601318,2 +2824,0.27704647183418274,0.2886659801006317,0.2940373122692108,0.1678321659564972,534.9400024414062,1e-05,0.2229779213666916,3.0757572650909424,81.14050197601318,2 +2825,0.2429378777742386,0.2819901704788208,0.2720918357372284,0.238228440284729,563.8103637695312,1e-05,0.1507110595703125,3.308326005935669,81.14050197601318,2 +2826,0.33743804693222046,0.2700388431549072,0.25400376319885254,0.21328671276569366,557.397705078125,1e-05,0.15168851613998413,3.0874502658843994,81.14050197601318,2 +2827,0.2469043880701065,0.2715025246143341,0.26285409927368164,0.14195804297924042,617.430419921875,1e-05,0.144988551735878,3.1689388751983643,81.14050197601318,2 +2828,0.40187597274780273,0.39503148198127747,0.39476531744003296,0.1403263360261917,363.995361328125,1e-05,0.15771178901195526,2.843597650527954,81.14050197601318,2 +2829,0.23923560976982117,0.22304853796958923,0.21346747875213623,0.1974359005689621,702.8627319335938,1e-05,0.25813958048820496,3.124964714050293,81.14050197601318,2 +2830,0.28798118233680725,0.20128144323825836,0.1836767941713333,0.23170162737369537,839.7739868164062,1e-05,0.21949870884418488,3.106879711151123,81.14050197601318,2 +2831,0.2112129032611847,0.3231428861618042,0.33184564113616943,0.1678321659564972,974.5794677734375,1e-05,0.27094051241874695,3.240166187286377,81.14050197601318,2 +2832,0.13249559700489044,0.20813272893428802,0.2170296162366867,0.26829835772514343,985.364990234375,1e-05,0.13061903417110443,2.8360843658447266,81.14050197601318,2 +2833,0.22536024451255798,0.23850516974925995,0.22344008088111877,0.14918415248394012,941.2037353515625,1e-05,0.14310765266418457,3.3285768032073975,81.14050197601318,2 +2834,0.38438063859939575,0.2030126452445984,0.1958049088716507,0.133100226521492,701.6507568359375,1e-05,0.19319254159927368,2.8309099674224854,81.14050197601318,2 +2835,0.39969009160995483,0.18869924545288086,0.199546217918396,0.21724942326545715,701.6507568359375,1e-05,0.15321488678455353,3.1309938430786133,81.14050197601318,2 +2836,0.260850191116333,0.31352198123931885,0.29158732295036316,0.2410256415605545,936.2454833984375,1e-05,0.1760377436876297,2.8245229721069336,81.14050197601318,2 +2837,0.3189461827278137,0.16722644865512848,0.15484531223773956,0.20606060326099396,798.72509765625,1e-05,0.12999777495861053,3.1659302711486816,81.14050197601318,2 +2838,0.15383362770080566,0.16752389073371887,0.16070020198822021,0.225874125957489,933.1463012695312,1e-05,0.1444157510995865,2.8351516723632812,81.14050197601318,2 +2839,0.3244769275188446,0.2063724249601364,0.1989573836326599,0.2041957974433899,864.9906616210938,1e-05,0.16747193038463593,3.3608837127685547,81.14050197601318,2 +2840,0.0933508425951004,0.22521759569644928,0.21371719241142273,0.12960372865200043,942.6430053710938,1e-05,0.21459388732910156,2.842560052871704,81.14050197601318,2 +2841,0.2033364474773407,0.1410333663225174,0.14998985826969147,0.23449882864952087,935.9909057617188,1e-05,0.14989586174488068,3.428117275238037,81.14050197601318,2 +2842,0.22477257251739502,0.14659662544727325,0.13909417390823364,0.2354312390089035,869.614990234375,1e-05,0.22408010065555573,2.8421506881713867,81.14050197601318,2 +2843,0.2269321084022522,0.4510188102722168,0.45143434405326843,0.19766899943351746,988.18359375,1e-05,0.20123185217380524,3.2416465282440186,81.14050197601318,2 +2844,0.2971112132072449,0.14055666327476501,0.13877065479755402,0.16969697177410126,775.2649536132812,1e-05,0.18722328543663025,2.8415465354919434,81.14050197601318,2 +2845,0.30412396788597107,0.20485088229179382,0.20278353989124298,0.21608391404151917,725.7503051757812,1e-05,0.15011268854141235,3.171823263168335,81.14050197601318,2 +2846,0.1686105728149414,0.22912153601646423,0.21787302196025848,0.27039626240730286,931.2932739257812,1e-05,0.27238431572914124,2.833141565322876,81.14050197601318,2 +2847,0.20330525934696198,0.40303587913513184,0.38946273922920227,0.16969697177410126,982.5844116210938,1e-05,0.16743043065071106,3.409794330596924,81.14050197601318,2 +2848,0.19386103749275208,0.18375635147094727,0.179092139005661,0.20000000298023224,889.3790893554688,1e-05,0.104216068983078,2.839041233062744,81.14050197601318,2 +2849,0.2147471159696579,0.4033765196800232,0.39592841267585754,0.24125874042510986,998.8220825195312,1e-05,0.22038918733596802,3.5213913917541504,81.14050197601318,2 +2850,0.21076872944831848,0.2268393635749817,0.22250227630138397,0.20722611248493195,973.748779296875,1e-05,0.1548071950674057,3.046020030975342,81.14050197601318,2 +2851,0.19973468780517578,0.24407640099525452,0.22683918476104736,0.21934731304645538,871.8681030273438,1e-05,0.14835016429424286,3.1135599613189697,81.14050197601318,2 +2852,0.16144996881484985,0.17405442893505096,0.17230653762817383,0.21398600935935974,866.3948974609375,1e-05,0.16936363279819489,2.8457155227661133,81.14050197601318,2 +2853,0.16185477375984192,0.1821954995393753,0.1799716204404831,0.20815850794315338,886.6248779296875,1e-05,0.14396686851978302,3.405956268310547,81.14050197601318,2 +2854,0.36193716526031494,0.29165172576904297,0.2785792648792267,0.1515151560306549,461.6126403808594,1e-05,0.1780020147562027,2.8489599227905273,81.14050197601318,2 +2855,0.37880489230155945,0.14130966365337372,0.1453457921743393,0.15314684808254242,821.2252807617188,1e-05,0.14324139058589935,3.2373270988464355,81.14050197601318,2 +2856,0.2861853837966919,0.31106722354888916,0.3148815631866455,0.27319347858428955,473.1681213378906,1e-05,0.13445699214935303,3.2337026596069336,81.14050197601318,2 +2857,0.3844809830188751,0.22693519294261932,0.23417054116725922,0.23729602992534637,440.3874816894531,1e-05,0.14091886579990387,3.1028873920440674,81.14050197601318,2 +2858,0.24909508228302002,0.25233420729637146,0.23660944402217865,0.2242424190044403,922.657958984375,1e-05,0.20410658419132233,2.8357906341552734,81.14050197601318,2 +2859,0.2790062725543976,0.27103376388549805,0.25773292779922485,0.2298368364572525,892.4525146484375,1e-05,0.18800458312034607,3.10707950592041,81.14050197601318,2 +2860,0.29218223690986633,0.25006094574928284,0.2619665563106537,0.21165500581264496,973.4141235351562,1e-05,0.12324564158916473,2.8254752159118652,81.14050197601318,2 +2861,0.25494587421417236,0.1997918337583542,0.18973593413829803,0.23449882864952087,838.0756225585938,1e-05,0.12987497448921204,3.163008451461792,81.14050197601318,2 +2862,0.25476863980293274,0.28986796736717224,0.28208282589912415,0.16083915531635284,932.6204223632812,1e-05,0.16468767821788788,3.1613497734069824,81.14050197601318,2 +2863,0.29521575570106506,0.16116848587989807,0.17515699565410614,0.2125874161720276,966.596923828125,1e-05,0.3426630198955536,3.0731656551361084,81.14050197601318,2 +2864,0.19909214973449707,0.21777889132499695,0.20687580108642578,0.22913752496242523,902.6273193359375,1e-05,0.13743442296981812,2.8325655460357666,81.14050197601318,2 +2865,0.238512322306633,0.1949348896741867,0.20324330031871796,0.21188810467720032,561.6887817382812,1e-05,0.13820286095142365,3.1186258792877197,81.14050197601318,2 +2866,0.3197377026081085,0.16998831927776337,0.16734594106674194,0.15804195404052734,834.0355224609375,1e-05,0.15218310058116913,3.342350482940674,81.14050197601318,2 +2867,0.21175040304660797,0.18600980937480927,0.2013280838727951,0.22074592113494873,977.65869140625,1e-05,0.1243281438946724,3.0374906063079834,81.14050197601318,2 +2868,0.22074706852436066,0.1267862319946289,0.12224686145782471,0.13403263688087463,802.3400268554688,1e-05,0.14979392290115356,3.136686325073242,81.14050197601318,2 +2869,0.2301376760005951,0.36308062076568604,0.3465934097766876,0.16853146255016327,939.9876098632812,1e-05,0.12490589171648026,3.0793588161468506,81.14050197601318,2 +2870,0.21760502457618713,0.17274756729602814,0.1725299060344696,0.20675989985466003,982.7333984375,1e-05,0.12931227684020996,3.181445598602295,81.14050197601318,2 +2871,0.3283778429031372,0.2456205189228058,0.23323647677898407,0.17272727191448212,753.0517578125,1e-05,0.36195895075798035,2.843961715698242,81.14050197601318,2 +2872,0.2674194872379303,0.2431439608335495,0.2228737324476242,0.20606060326099396,922.947998046875,1e-05,0.1436728537082672,3.166605234146118,81.14050197601318,2 +2873,0.2780797481536865,0.2821277678012848,0.2675701379776001,0.23636363446712494,921.19580078125,1e-05,0.310457319021225,3.076292037963867,81.14050197601318,2 +2874,0.1035783439874649,0.2544231414794922,0.24413713812828064,0.2582750618457794,949.0853271484375,1e-05,0.21108853816986084,3.0696675777435303,81.14050197601318,2 +2875,0.37155526876449585,0.23334647715091705,0.21564067900180817,0.2069930136203766,694.233642578125,1e-05,0.4174649715423584,3.193633794784546,81.14050197601318,2 +2876,0.20332299172878265,0.20501188933849335,0.22122585773468018,0.19324009120464325,953.4276123046875,1e-05,0.1333318054676056,3.134526491165161,81.14050197601318,2 +2877,0.15640178322792053,0.18033470213413239,0.1880863457918167,0.19393938779830933,821.2252807617188,1e-05,0.16996803879737854,2.837472677230835,81.14050197601318,2 +2878,0.14861777424812317,0.3205309510231018,0.3165706992149353,0.22890442609786987,954.0613403320312,1e-05,0.25209757685661316,3.1024577617645264,81.14050197601318,2 +2879,0.19929660856723785,0.2791917324066162,0.2708984911441803,0.21608391404151917,973.9156494140625,1e-05,0.15881550312042236,2.823509454727173,81.14050197601318,2 +2880,0.3714638948440552,0.16249656677246094,0.1786254644393921,0.11282051354646683,980.7741088867188,1e-05,0.1616153120994568,3.3912978172302246,81.14050197601318,2 +2881,0.18968741595745087,0.11247742921113968,0.11091592907905579,0.24918414652347565,972.0613403320312,1e-05,0.19093811511993408,2.8317532539367676,81.14050197601318,2 +2882,0.1451261341571808,0.14342735707759857,0.14767993986606598,0.15011654794216156,858.2379760742188,1e-05,0.1702984720468521,3.0802855491638184,81.14050197601318,2 +2883,0.12915107607841492,0.18029101192951202,0.17308515310287476,0.15874126553535461,961.14013671875,1e-05,0.13180693984031677,2.836132049560547,81.14050197601318,2 +2884,0.1255716234445572,0.24409841001033783,0.23075683414936066,0.24475523829460144,991.4281005859375,1e-05,0.210767462849617,3.157188892364502,81.14050197601318,2 +2885,0.26352813839912415,0.29042282700538635,0.28785955905914307,0.1846153885126114,992.2167358398438,1e-05,0.15973252058029175,2.839238166809082,81.14050197601318,2 +2886,0.23704573512077332,0.1345115602016449,0.1345115602016449,0.0,900.8737182617188,1e-05,0.4997337758541107,3.3411059379577637,81.14050197601318,2 +2887,0.22773267328739166,0.20242759585380554,0.20718856155872345,0.24312354624271393,979.2321166992188,1e-05,0.1048203632235527,2.829440116882324,81.14050197601318,2 +2888,0.36947768926620483,0.27121877670288086,0.2684122622013092,0.17599067091941833,830.4837646484375,1e-05,0.1512296199798584,3.104954481124878,81.14050197601318,2 +2889,0.20108851790428162,0.23477064073085785,0.22227953374385834,0.2242424190044403,921.48974609375,1e-05,0.16093038022518158,2.825941562652588,81.14050197601318,2 +2890,0.1552063375711441,0.21009521186351776,0.2173500508069992,0.14242424070835114,748.2748413085938,1e-05,0.12489461898803711,3.322305202484131,81.14050197601318,2 +2891,0.3929402530193329,0.5333936214447021,0.5590693950653076,0.1638694703578949,133.62509155273438,1e-05,0.17725728452205658,2.8296778202056885,81.14050197601318,2 +2892,0.16773638129234314,0.2813299298286438,0.274160236120224,0.21794871985912323,978.9199829101562,1e-05,0.16401700675487518,3.10707950592041,81.14050197601318,2 +2893,0.10885223746299744,0.14215779304504395,0.13632526993751526,0.1846153885126114,926.3671875,1e-05,0.13833405077457428,2.833580493927002,81.14050197601318,2 +2894,0.15822844207286835,0.2295803427696228,0.208637997508049,0.1051282063126564,974.4140625,1e-05,0.16298045217990875,3.384100914001465,81.14050197601318,2 +2895,0.2642870545387268,0.10400629043579102,0.11552315950393677,0.1734265685081482,910.0397338867188,1e-05,0.14265836775302887,2.841075897216797,81.14050197601318,2 +2896,0.11267814040184021,0.30224111676216125,0.2923683822154999,0.2449883371591568,992.996826171875,1e-05,0.1828550398349762,3.333728075027466,81.14050197601318,2 +2897,0.2102804332971573,0.15740898251533508,0.15449409186840057,0.22354312241077423,996.64892578125,1e-05,0.22744981944561005,3.0983211994171143,81.14050197601318,2 +2898,0.346733957529068,0.23125918209552765,0.22566445171833038,0.09930069744586945,762.2591552734375,1e-05,0.15474162995815277,3.1183292865753174,81.14050197601318,2 +2899,0.2732073962688446,0.25553059577941895,0.2569487690925598,0.17552447319030762,708.8218383789062,1e-05,0.226316437125206,3.147059440612793,81.14050197601318,2 +2900,0.2919670343399048,0.24884290993213654,0.2367042750120163,0.1930069923400879,876.692138671875,1e-05,0.13064856827259064,3.3807997703552246,81.14050197601318,2 +2901,0.11686883866786957,0.26270151138305664,0.2584468424320221,0.2829836905002594,984.2067260742188,1e-05,0.11985534429550171,2.837862968444824,81.14050197601318,2 +2902,0.272849977016449,0.35146355628967285,0.3532644510269165,0.0139860138297081,243.64947509765625,1e-05,0.11337511241436005,3.34322190284729,81.14050197601318,2 +2903,0.3002624809741974,0.37053823471069336,0.3566092550754547,0.20606060326099396,980.6212768554688,1e-05,0.21536780893802643,3.1059961318969727,81.14050197601318,2 +2904,0.2849830389022827,0.11910120397806168,0.1185406967997551,0.13799533247947693,998.2254028320312,1e-05,0.12497883290052414,3.084167242050171,81.14050197601318,2 +2905,0.15049569308757782,0.22416181862354279,0.21099166572093964,0.23519814014434814,992.8673706054688,1e-05,0.15406517684459686,3.066183090209961,81.14050197601318,2 +2906,0.12566238641738892,0.21337953209877014,0.21269680559635162,0.08578088879585266,892.4525146484375,1e-05,0.15251202881336212,3.0555872917175293,81.14050197601318,2 +2907,0.037977177649736404,0.25734367966651917,0.27869459986686707,0.17086246609687805,999.177734375,1e-05,0.08458267152309418,2.8414392471313477,81.14050197601318,2 +2908,0.11483276635408401,0.20782920718193054,0.20713117718696594,0.07878787815570831,999.7660522460938,1e-05,0.11224435269832611,3.3705718517303467,81.14050197601318,2 +2909,0.2443525344133377,0.23571668565273285,0.23105137050151825,0.1962703913450241,875.3941650390625,1e-05,0.13283060491085052,3.3646183013916016,81.14050197601318,2 +2910,0.17137743532657623,0.11954593658447266,0.13832347095012665,0.1571095585823059,981.230712890625,1e-05,0.20684340596199036,2.8530640602111816,81.14050197601318,2 +2911,0.22134806215763092,0.15734867751598358,0.17233692109584808,0.24009324610233307,926.0864868164062,1e-05,0.21785183250904083,3.1460347175598145,81.14050197601318,2 +2912,0.3129557967185974,0.12331995368003845,0.13039228320121765,0.08508158475160599,557.397705078125,1e-05,0.2262650728225708,3.0701966285705566,81.14050197601318,2 +2913,0.13289140164852142,0.25801947712898254,0.24088972806930542,0.2405594438314438,768.4440307617188,1e-05,0.1595534235239029,2.8334081172943115,81.14050197601318,2 +2914,0.12328982353210449,0.3231830596923828,0.3300676643848419,0.1878787875175476,945.68896484375,1e-05,0.15613442659378052,3.1675405502319336,81.14050197601318,2 +2915,0.3142935037612915,0.2685419023036957,0.2669188678264618,0.2270396202802658,748.2748413085938,1e-05,0.19220444560050964,3.3404464721679688,81.14050197601318,2 +2916,0.19540445506572723,0.318387508392334,0.2988358736038208,0.2554778456687927,956.75732421875,1e-05,0.1553957164287567,2.844733476638794,81.14050197601318,2 +2917,0.23206761479377747,0.2040705531835556,0.20018401741981506,0.21934731304645538,849.5682373046875,1e-05,0.16774402558803558,3.3429956436157227,81.14050197601318,2 +2918,0.23156549036502838,0.26339301466941833,0.2541418969631195,0.15920746326446533,944.2952880859375,1e-05,0.15368129312992096,3.1326889991760254,81.14050197601318,2 +2919,0.21172672510147095,0.31826964020729065,0.292449951171875,0.2282051295042038,988.4596557617188,1e-05,0.18340671062469482,3.1052072048187256,81.14050197601318,2 +2920,0.29067760705947876,0.34364962577819824,0.3423473536968231,0.12097901850938797,967.322509765625,1e-05,0.1948579102754593,3.1007461547851562,81.14050197601318,2 +2921,0.16038304567337036,0.12167370319366455,0.12119936943054199,0.10699300467967987,923.2371215820312,1e-05,0.12572140991687775,3.653679609298706,81.14050197601318,2 +2922,0.32944855093955994,0.14525610208511353,0.15848630666732788,0.19044288992881775,677.2564697265625,1e-05,0.23104286193847656,2.8336474895477295,81.14050197601318,2 +2923,0.355182945728302,0.12431319057941437,0.12960340082645416,0.2652680575847626,814.732421875,1e-05,0.2334551215171814,3.4131338596343994,81.14050197601318,2 +2924,0.4642406105995178,0.31351330876350403,0.3009229302406311,0.2230769246816635,390.0654296875,1e-05,0.1829586625099182,3.0505950450897217,81.14050197601318,2 +2925,0.3127552270889282,0.1940484195947647,0.18813689053058624,0.14195804297924042,885.0230102539062,1e-05,0.14994408190250397,3.124591588973999,81.14050197601318,2 +2926,0.22930827736854553,0.1334998905658722,0.13004042208194733,0.23403263092041016,790.488037109375,1e-05,0.12455091625452042,3.140549898147583,81.14050197601318,2 +2927,0.22228653728961945,0.2210315316915512,0.2076016515493393,0.21398600935935974,909.7130737304688,1e-05,0.21093042194843292,3.073845863342285,81.14050197601318,2 +2928,0.23441344499588013,0.14613603055477142,0.15379682183265686,0.08228438347578049,963.0614624023438,1e-05,0.16444502770900726,3.1341562271118164,81.14050197601318,2 +2929,0.14446836709976196,0.21670803427696228,0.22211328148841858,0.15874126553535461,926.9263305664062,1e-05,0.10911716520786285,3.3886892795562744,81.14050197601318,2 +2930,0.38347572088241577,0.37958773970603943,0.3603938817977905,0.2461538463830948,995.160888671875,1e-05,0.9585828185081482,3.082435369491577,81.14050197601318,2 +2931,0.2840239703655243,0.14227811992168427,0.1318553388118744,0.2501165568828583,767.5730590820312,1e-05,0.22744978964328766,3.163020372390747,81.14050197601318,2 +2932,0.1630164086818695,0.3005555272102356,0.29421108961105347,0.23962703347206116,977.65869140625,1e-05,0.149335578083992,3.0846970081329346,81.14050197601318,2 +2933,0.17984379827976227,0.1355448067188263,0.141335129737854,0.24428904056549072,872.758544921875,1e-05,0.11363551765680313,3.11514949798584,81.14050197601318,2 +2934,0.33057475090026855,0.21286164224147797,0.19914670288562775,0.17482517659664154,584.1925659179688,1e-05,0.11499111354351044,3.1206300258636475,81.14050197601318,2 +2935,0.24944302439689636,0.18038572371006012,0.18455712497234344,0.25804194808006287,565.9164428710938,1e-05,0.21116036176681519,3.376575469970703,81.14050197601318,2 +2936,0.11538100242614746,0.17140816152095795,0.16599829494953156,0.1862470805644989,817.3616943359375,1e-05,0.16559191048145294,2.8287601470947266,81.14050197601318,2 +2937,0.25471508502960205,0.25556880235671997,0.2439882457256317,0.302097886800766,666.1416625976562,1e-05,0.24780839681625366,3.3395397663116455,81.14050197601318,2 +2938,0.14563417434692383,0.11836870014667511,0.1328827291727066,0.19883449375629425,950.628662109375,1e-05,0.7922872304916382,3.115248918533325,81.14050197601318,2 +2939,0.20027855038642883,0.1843820959329605,0.19753780961036682,0.2282051295042038,955.10791015625,1e-05,0.1478727012872696,3.120088577270508,81.14050197601318,2 +2940,0.3789018392562866,0.27937790751457214,0.2771602272987366,0.17296037077903748,323.4160461425781,1e-05,0.41913604736328125,3.133551836013794,81.14050197601318,2 +2941,0.10671411454677582,0.2353707253932953,0.23951506614685059,0.2226107269525528,950.8469848632812,1e-05,0.17601777613162994,3.0725998878479004,81.14050197601318,2 +2942,0.20610231161117554,0.3071952760219574,0.2932710349559784,0.2046620100736618,970.8588256835938,1e-05,0.12206435203552246,2.8391032218933105,81.14050197601318,2 +2943,0.1567043662071228,0.2879369258880615,0.2954903841018677,0.2046620100736618,987.7676391601562,1e-05,0.12675541639328003,3.401935338973999,81.14050197601318,2 +2944,0.3966287672519684,0.36512935161590576,0.3558908998966217,0.1766899824142456,997.5022583007812,1e-05,0.17896214127540588,3.3640756607055664,81.14050197601318,2 +2945,0.2891656160354614,0.16825729608535767,0.17825567722320557,0.17972028255462646,889.7675170898438,1e-05,0.12724235653877258,2.834071636199951,81.14050197601318,2 +2946,0.2247612476348877,0.29692602157592773,0.28033775091171265,0.21491841971874237,960.7506713867188,1e-05,0.19089578092098236,3.1414427757263184,81.14050197601318,2 +2947,0.21527859568595886,0.13610602915287018,0.1349009871482849,0.16923077404499054,692.97265625,1e-05,0.11175447702407837,3.0784997940063477,81.14050197601318,2 +2948,0.15285709500312805,0.30572405457496643,0.29237961769104004,0.17599067091941833,920.605224609375,1e-05,0.1962486356496811,3.1001923084259033,81.14050197601318,2 +2949,0.2599772810935974,0.3051164448261261,0.2831529974937439,0.14941725134849548,933.9302368164062,1e-05,0.14910584688186646,3.1106770038604736,81.14050197601318,2 +2950,0.1916554570198059,0.21764369308948517,0.22340992093086243,0.1818181872367859,990.8973388671875,1e-05,0.13261200487613678,3.389604330062866,81.14050197601318,2 +2951,0.1570916771888733,0.1986583173274994,0.18595939874649048,0.2242424190044403,997.1378173828125,1e-05,0.13129165768623352,2.8274261951446533,81.14050197601318,2 +2952,0.2555318772792816,0.16358225047588348,0.17417964339256287,0.1298368275165558,965.3115234375,1e-05,0.1368546038866043,3.337297201156616,81.14050197601318,2 +2953,0.21355637907981873,0.2664872109889984,0.26122620701789856,0.16969697177410126,916.0694580078125,1e-05,0.13861802220344543,3.104640483856201,81.14050197601318,2 +2954,0.34198838472366333,0.13414952158927917,0.12410902976989746,0.21724942326545715,816.0525512695312,1e-05,0.15187674760818481,3.11773419380188,81.14050197601318,2 +2955,0.18537326157093048,0.3149743676185608,0.30449777841567993,0.17692308127880096,899.4515991210938,1e-05,0.10961689054965973,3.4325597286224365,81.14050197601318,2 +2956,0.14388272166252136,0.33196038007736206,0.3279670476913452,0.20675989985466003,963.6295776367188,1e-05,0.18389631807804108,3.1696078777313232,81.14050197601318,2 +2957,0.16118228435516357,0.24375982582569122,0.24246792495250702,0.1678321659564972,988.0452880859375,1e-05,0.11707765609025955,2.848590850830078,81.14050197601318,2 +2958,0.2754972279071808,0.3667747378349304,0.35241010785102844,0.19393938779830933,434.07476806640625,1e-05,0.15670520067214966,3.371847152709961,81.14050197601318,2 +2959,0.23759309947490692,0.3316982090473175,0.3127940893173218,0.23613053560256958,962.4896240234375,1e-05,0.1624460518360138,3.106771469116211,81.14050197601318,2 +2960,0.37026306986808777,0.22053071856498718,0.21815836429595947,0.2018647938966751,975.2377319335938,1e-05,0.2602241337299347,3.0792040824890137,81.14050197601318,2 +2961,0.3839036226272583,0.17609834671020508,0.1769799143075943,0.22051282227039337,850.0933227539062,1e-05,0.16500717401504517,3.3742382526397705,81.14050197601318,2 +2962,0.2954237163066864,0.1651274561882019,0.18031665682792664,0.20046620070934296,520.6055908203125,1e-05,0.15436886250972748,3.0938825607299805,81.14050197601318,2 +2963,0.12974484264850616,0.26220181584358215,0.2572849988937378,0.214685320854187,958.17578125,1e-05,0.17450137436389923,3.033520460128784,81.14050197601318,2 +2964,0.1888943314552307,0.25450047850608826,0.22652596235275269,0.2543123662471771,980.9265747070312,1e-05,0.1810629814863205,3.1236519813537598,81.14050197601318,2 +2965,0.25976991653442383,0.14205586910247803,0.1497981697320938,0.10326340049505234,887.0220336914062,1e-05,0.17395128309726715,3.150334596633911,81.14050197601318,2 +2966,0.2955516278743744,0.24611762166023254,0.24635086953639984,0.1627039611339569,961.334228515625,1e-05,0.15505392849445343,3.0761237144470215,81.14050197601318,2 +2967,0.31258273124694824,0.1990751028060913,0.18683072924613953,0.20629370212554932,731.0974731445312,1e-05,0.18110878765583038,3.008713960647583,81.14050197601318,2 +2968,0.270087867975235,0.30730029940605164,0.31069114804267883,0.17832167446613312,327.6654357910156,1e-05,0.18078435957431793,3.695328712463379,81.14050197601318,2 +2969,0.2651200592517853,0.22571921348571777,0.2127181589603424,0.17552447319030762,872.3140258789062,1e-05,0.14516958594322205,3.222907543182373,81.14050197601318,2 +2970,0.34070783853530884,0.15912650525569916,0.1668752282857895,0.22680652141571045,652.9728393554688,1e-05,0.13738539814949036,3.124552011489868,81.14050197601318,2 +2971,0.26290035247802734,0.20111186802387238,0.20311352610588074,0.1878787875175476,987.906494140625,1e-05,0.17375606298446655,3.1060562133789062,81.14050197601318,2 +2972,0.25654277205467224,0.2706533372402191,0.25887298583984375,0.19137528538703918,942.4046020507812,1e-05,0.8747375011444092,3.0761632919311523,81.14050197601318,2 +2973,0.18113739788532257,0.2974136769771576,0.28707149624824524,0.29720279574394226,630.94677734375,1e-05,0.14979805052280426,3.420253038406372,81.14050197601318,2 +2974,0.3378883898258209,0.255118191242218,0.2508269250392914,0.19324009120464325,458.6604309082031,1e-05,0.21671514213085175,2.8328888416290283,81.14050197601318,2 +2975,0.20811727643013,0.17133817076683044,0.16238512098789215,0.1818181872367859,998.9408569335938,1e-05,0.13499656319618225,3.4069128036499023,81.14050197601318,2 +2976,0.24513547122478485,0.2071528285741806,0.21589285135269165,0.22517482936382294,910.6900634765625,1e-05,0.16124451160430908,3.1302459239959717,81.14050197601318,2 +2977,0.14437343180179596,0.21845753490924835,0.21227231621742249,0.12051282078027725,975.8905029296875,1e-05,0.12366113811731339,3.1397294998168945,81.14050197601318,2 +2978,0.18205663561820984,0.11311719566583633,0.11428125202655792,0.056410256773233414,796.51806640625,1e-05,0.29263216257095337,3.1228811740875244,81.14050197601318,2 +2979,0.3196669816970825,0.25480228662490845,0.24390767514705658,0.2582750618457794,804.4718627929688,1e-05,0.20362530648708344,3.3503828048706055,81.14050197601318,2 +2980,0.4176493287086487,0.18449026346206665,0.17540809512138367,0.23240093886852264,756.7888793945312,1e-05,0.14743568003177643,2.8321845531463623,81.14050197601318,2 +2981,0.27805912494659424,0.40319380164146423,0.382726788520813,0.23076923191547394,999.53125,1e-05,0.14368048310279846,3.249934673309326,81.14050197601318,2 +2982,0.11583489924669266,0.210164874792099,0.20692789554595947,0.17808857560157776,905.7181396484375,1e-05,0.1637648046016693,3.093224287033081,81.14050197601318,2 +2983,0.1475841999053955,0.5523748993873596,0.582787811756134,0.1930069923400879,146.47067260742188,1e-05,0.15404559671878815,3.104820966720581,81.14050197601318,2 +2984,0.20413458347320557,0.23095713555812836,0.22533103823661804,0.2130536139011383,842.00830078125,1e-05,0.16300654411315918,3.0734424591064453,81.14050197601318,2 +2985,0.22099687159061432,0.2619033753871918,0.23530028760433197,0.17832167446613312,944.529052734375,1e-05,0.3012703061103821,3.4363977909088135,81.14050197601318,2 +2986,0.2140665203332901,0.2618955969810486,0.2591312825679779,0.24848484992980957,960.1631469726562,1e-05,0.16018423438072205,2.829331636428833,81.14050197601318,2 +2987,0.2649095356464386,0.30604368448257446,0.3201456069946289,0.18298368155956268,955.9364624023438,1e-05,0.15732558071613312,3.314608097076416,81.14050197601318,2 +2988,0.3713199198246002,0.18596354126930237,0.17868980765342712,0.23076923191547394,771.0321044921875,1e-05,0.2326255589723587,3.457045316696167,81.14050197601318,2 +2989,0.29081991314888,0.3219718635082245,0.33923742175102234,0.23356643319129944,331.87054443359375,1e-05,0.10039053857326508,2.8277697563171387,81.14050197601318,2 +2990,0.2621380686759949,0.15101131796836853,0.14568109810352325,0.22750583291053772,915.4500122070312,1e-05,0.4784030616283417,3.0992441177368164,81.14050197601318,2 +2991,0.1435890644788742,0.08969971537590027,0.10799692571163177,0.20000000298023224,958.9761352539062,1e-05,0.19201913475990295,3.41957426071167,81.14050197601318,2 +2992,0.3125336468219757,0.14329932630062103,0.1375693529844284,0.18601398169994354,821.2252807617188,1e-05,0.15961624681949615,3.0356526374816895,81.14050197601318,2 +2993,0.10336320102214813,0.27493247389793396,0.25766775012016296,0.23706293106079102,987.2093505859375,1e-05,0.11815206706523895,3.434744358062744,81.14050197601318,2 +2994,0.098301462829113,0.2553301453590393,0.2618522346019745,0.08881118893623352,992.8673706054688,1e-05,0.17485260963439941,3.036663055419922,81.14050197601318,2 +2995,0.17852872610092163,0.19427725672721863,0.1757119745016098,0.2058275043964386,840.8953247070312,1e-05,0.17432036995887756,2.845423698425293,81.14050197601318,2 +2996,0.2808820605278015,0.24679002165794373,0.24062272906303406,0.13636364042758942,730.0392456054688,1e-05,0.13977666199207306,3.3787031173706055,81.14050197601318,2 +2997,0.19871501624584198,0.3215039372444153,0.2944263815879822,0.20116549730300903,899.0933837890625,1e-05,0.13163268566131592,3.31538462638855,81.14050197601318,2 +2998,0.402500182390213,0.1743571162223816,0.18088467419147491,0.2013985961675644,870.5208129882812,1e-05,0.1526428461074829,3.061408519744873,81.14050197601318,2 +2999,0.27229800820350647,0.4773831367492676,0.4538460671901703,0.23986013233661652,978.134033203125,1e-05,0.18735118210315704,3.4013431072235107,81.14050197601318,2 +3000,0.21699590981006622,0.25414013862609863,0.24765872955322266,0.23240093886852264,936.49951171875,1e-05,0.1933734267950058,3.086949586868286,81.14050197601318,2 +3001,0.2543402910232544,0.2653999328613281,0.255578875541687,0.26037296652793884,941.685791015625,1e-05,0.1346341222524643,3.3625948429107666,81.14050197601318,2 +3002,0.19153693318367004,0.22857967019081116,0.2162925899028778,0.24032634496688843,804.4718627929688,1e-05,0.1560998558998108,3.0453202724456787,81.14050197601318,2 +3003,0.19693820178508759,0.18030981719493866,0.1781209409236908,0.1662004590034485,860.688232421875,1e-05,0.18127496540546417,3.206998586654663,81.14050197601318,2 +3004,0.05563146248459816,0.19780567288398743,0.2139551341533661,0.15571095049381256,968.9326171875,1e-05,0.1415873020887375,3.125417947769165,81.14050197601318,2 +3005,0.2433612048625946,0.2537611424922943,0.2523854970932007,0.2526806592941284,971.8906860351562,1e-05,0.13504956662654877,3.0750720500946045,81.14050197601318,2 +3006,0.21519121527671814,0.1970534771680832,0.19407373666763306,0.09090909361839294,942.1655883789062,1e-05,0.19286035001277924,3.0754268169403076,81.14050197601318,2 +3007,0.2179592102766037,0.21817424893379211,0.20502731204032898,0.20536130666732788,820.587890625,1e-05,0.22743336856365204,3.290411949157715,81.14050197601318,2 +3008,0.18642593920230865,0.2028336524963379,0.19582341611385345,0.21678321063518524,867.7844848632812,1e-05,0.16367501020431519,3.0946342945098877,81.14050197601318,2 +3009,0.15257707238197327,0.2901431620121002,0.29209455847740173,0.19533799588680267,921.19580078125,1e-05,0.1799003779888153,3.1431992053985596,81.14050197601318,2 +3010,0.2756287455558777,0.1793656200170517,0.17127355933189392,0.09487179666757584,706.4580688476562,1e-05,0.14951284229755402,3.1072189807891846,81.14050197601318,2 +3011,0.2525177001953125,0.25180116295814514,0.2515825033187866,0.15734265744686127,979.2321166992188,1e-05,0.16497528553009033,3.098830461502075,81.14050197601318,2 +3012,0.16994181275367737,0.17138703167438507,0.17404668033123016,0.06806527078151703,947.9669189453125,1e-05,0.22499123215675354,3.1046202182769775,81.14050197601318,2 +3013,0.1848818063735962,0.23505228757858276,0.2249053716659546,0.22634032368659973,959.7694091796875,1e-05,0.16724459826946259,3.245635986328125,81.14050197601318,2 +3014,0.36416095495224,0.20907561480998993,0.21254540979862213,0.24382284283638,957.5706176757812,1e-05,0.14266538619995117,3.2018535137176514,81.14050197601318,2 +3015,0.20109766721725464,0.17970630526542664,0.18724969029426575,0.1622377634048462,876.2608642578125,1e-05,0.10915493220090866,2.8336021900177,81.14050197601318,2 +3016,0.26964205503463745,0.20807357132434845,0.20214182138442993,0.16153846681118011,875.3941650390625,1e-05,0.12475568801164627,3.119398832321167,81.14050197601318,2 +3017,0.23894160985946655,0.3339240849018097,0.3581470251083374,0.26247087121009827,253.83924865722656,1e-05,0.1457815021276474,3.1865010261535645,81.14050197601318,2 +3018,0.3003108501434326,0.17650508880615234,0.16699784994125366,0.20279720425605774,625.9617919921875,1e-05,0.13708023726940155,2.8852274417877197,81.14050197601318,2 +3019,0.20647451281547546,0.2383590191602707,0.22409701347351074,0.14755244553089142,881.341796875,1e-05,0.13271872699260712,3.1544570922851562,81.14050197601318,2 +3020,0.2633911967277527,0.23371128737926483,0.22304311394691467,0.24708624184131622,658.916015625,1e-05,0.19217468798160553,3.5189833641052246,81.14050197601318,2 +3021,0.3310536742210388,0.26128336787223816,0.26024410128593445,0.21002331376075745,947.0624389648438,1e-05,0.3526650071144104,3.1034631729125977,81.14050197601318,2 +3022,0.1849660575389862,0.18569843471050262,0.17983247339725494,0.21328671276569366,821.8599853515625,1e-05,0.1649186760187149,2.878220796585083,81.14050197601318,2 +3023,0.11513028293848038,0.23777040839195251,0.2315625548362732,0.17832167446613312,970.1636352539062,1e-05,0.12853127717971802,3.375136613845825,81.14050197601318,2 +3024,0.3168819844722748,0.2415301501750946,0.22699810564517975,0.2678321599960327,959.7694091796875,1e-05,0.312241792678833,2.8861985206604004,81.14050197601318,2 +3025,0.18988598883152008,0.3780999183654785,0.3625255227088928,0.24312354624271393,992.996826171875,1e-05,0.14551502466201782,3.3982107639312744,81.14050197601318,2 +3026,0.10764751583337784,0.22579964995384216,0.24234512448310852,0.1118881106376648,993.2548217773438,1e-05,0.1945865899324417,3.360139846801758,81.14050197601318,2 +3027,0.24892014265060425,0.2123294472694397,0.22830556333065033,0.17878787219524384,999.177734375,1e-05,0.15481629967689514,3.3261570930480957,81.14050197601318,2 +3028,0.19625556468963623,0.2757377028465271,0.27904102206230164,0.24172493815422058,976.69921875,1e-05,0.13103017210960388,2.8424322605133057,81.14050197601318,2 +3029,0.17527839541435242,0.09520796686410904,0.10480905324220657,0.10419580340385437,629.2960815429688,1e-05,0.189387708902359,3.3736469745635986,81.14050197601318,2 +3030,0.08089829981327057,0.27551358938217163,0.26782163977622986,0.2410256415605545,980.3147583007812,1e-05,0.10733497887849808,2.8454244136810303,81.14050197601318,2 +3031,0.1764238178730011,0.22956539690494537,0.22537752985954285,0.16293705999851227,795.77587890625,1e-05,0.17298652231693268,3.328748941421509,81.14050197601318,2 +3032,0.2274353802204132,0.20386694371700287,0.19022175669670105,0.15967366099357605,943.1180419921875,1e-05,0.14965283870697021,3.496523380279541,81.14050197601318,2 +3033,0.16166529059410095,0.2632737457752228,0.2567594051361084,0.232634037733078,974.4140625,1e-05,0.17990420758724213,3.405879259109497,81.14050197601318,2 +3034,0.15021033585071564,0.19142185151576996,0.1842271089553833,0.23916083574295044,858.2379760742188,1e-05,0.335793137550354,3.248584032058716,81.14050197601318,2 +3035,0.18921694159507751,0.35008084774017334,0.3456423282623291,0.22610722482204437,278.3217468261719,1e-05,0.1503443717956543,3.176222562789917,81.14050197601318,2 +3036,0.22915849089622498,0.30183660984039307,0.2969847023487091,0.2377622425556183,968.9326171875,1e-05,0.17751915752887726,3.2082085609436035,81.14050197601318,2 +3037,0.29250192642211914,0.15237000584602356,0.14438945055007935,0.2354312390089035,913.2542724609375,1e-05,0.14283551275730133,5.952967166900635,81.14050197601318,2 +3038,0.20674598217010498,0.282504677772522,0.27833861112594604,0.20722611248493195,936.2454833984375,1e-05,0.11012537777423859,5.950230836868286,81.14050197601318,2 +3039,0.20585045218467712,0.31086644530296326,0.3117457926273346,0.21771562099456787,958.17578125,1e-05,0.17326690256595612,5.962344169616699,81.14050197601318,2 +3040,0.23213309049606323,0.090479277074337,0.09111805260181427,0.1986013948917389,640.6287231445312,1e-05,0.1762484908103943,6.070672988891602,81.14050197601318,2 +3041,0.12992465496063232,0.18001878261566162,0.19004547595977783,0.2265734225511551,977.0203857421875,1e-05,0.13135552406311035,5.682722091674805,81.14050197601318,2 +3042,0.19382229447364807,0.3031649589538574,0.31199756264686584,0.20163169503211975,955.523193359375,1e-05,0.18967711925506592,5.752060890197754,81.14050197601318,2 +3043,0.2519634962081909,0.2752434313297272,0.25986021757125854,0.1258741319179535,741.38232421875,1e-05,0.14898145198822021,5.99924111366272,81.14050197601318,2 +3044,0.22121620178222656,0.17316247522830963,0.17271023988723755,0.017482517287135124,901.2266235351562,1e-05,0.13699941337108612,5.383498430252075,81.14050197601318,2 +3045,0.22126904129981995,0.14137756824493408,0.13770978152751923,0.1986013948917389,853.715087890625,1e-05,0.16983266174793243,3.0928549766540527,81.14050197601318,2 +3046,0.35937225818634033,0.2714468538761139,0.26636120676994324,0.1382284313440323,417.7786560058594,1e-05,0.14763939380645752,3.145324468612671,81.14050197601318,2 +3047,0.1757584810256958,0.20634785294532776,0.2011909931898117,0.12237761914730072,982.8820190429688,1e-05,0.11980006098747253,2.8527514934539795,81.14050197601318,2 +3048,0.19945532083511353,0.24068789184093475,0.2611995339393616,0.17482517659664154,375.388671875,1e-05,0.17290334403514862,3.308616876602173,81.14050197601318,2 +3049,0.3473321199417114,0.31995290517807007,0.3156886398792267,0.1906759887933731,896.920654296875,1e-05,0.11464852094650269,3.166670799255371,81.14050197601318,2 +3050,0.11099144071340561,0.1770501583814621,0.18481071293354034,0.2270396202802658,994.4046630859375,1e-05,0.5694674253463745,3.3214335441589355,81.14050197601318,2 +3051,0.1914588212966919,0.1650485098361969,0.15853771567344666,0.1986013948917389,864.5192260742188,1e-05,0.18388406932353973,3.220371961593628,81.14050197601318,2 +3052,0.28269004821777344,0.14439058303833008,0.1450120508670807,0.14568763971328735,944.529052734375,1e-05,0.15683984756469727,3.434918165206909,81.14050197601318,2 +3053,0.176876500248909,0.2812066376209259,0.28281381726264954,0.21841491758823395,987.4890747070312,1e-05,0.5958722829818726,2.9412360191345215,81.14050197601318,2 +3054,0.3109626770019531,0.3130249083042145,0.3016790747642517,0.2543123662471771,492.46246337890625,1e-05,0.6342747211456299,2.8593873977661133,81.14050197601318,2 +3055,0.17373982071876526,0.26709306240081787,0.26382845640182495,0.2181818187236786,991.69189453125,1e-05,0.18420715630054474,3.4375460147857666,81.14050197601318,2 +3056,0.2889421284198761,0.2189384400844574,0.21851183474063873,0.17552447319030762,868.7028198242188,1e-05,0.15662741661071777,3.516984701156616,81.14050197601318,2 +3057,0.33751434087753296,0.22781486809253693,0.23065128922462463,0.22517482936382294,917.2977905273438,1e-05,0.15222547948360443,2.878882646560669,81.14050197601318,2 +3058,0.2166586071252823,0.25933244824409485,0.25617673993110657,0.274125874042511,673.1508178710938,1e-05,0.15892790257930756,3.370741367340088,81.14050197601318,2 +3059,0.3093099594116211,0.2965601682662964,0.2833016514778137,0.14522144198417664,881.341796875,1e-05,0.13654951751232147,3.183520555496216,81.14050197601318,2 +3060,0.21828718483448029,0.3451040983200073,0.34003153443336487,0.260606050491333,945.226806640625,1e-05,0.12733781337738037,3.8861501216888428,81.14050197601318,2 +3061,0.2533312439918518,0.1415228694677353,0.1397991180419922,0.10442890226840973,832.8609008789062,1e-05,0.11927524209022522,3.4795665740966797,81.14050197601318,2 +3062,0.15902924537658691,0.24642620980739594,0.24084427952766418,0.22494173049926758,898.37353515625,1e-05,0.12564608454704285,3.3600845336914062,81.14050197601318,2 +3063,0.3147052824497223,0.15177448093891144,0.1495092362165451,0.19790209829807281,762.2591552734375,1e-05,0.14055472612380981,2.9493565559387207,81.14050197601318,2 +3064,0.19563288986682892,0.16053692996501923,0.17019252479076385,0.14848484098911285,663.2779541015625,1e-05,0.1266825795173645,3.4273879528045654,81.14050197601318,2 +3065,0.167266845703125,0.2412610650062561,0.24528416991233826,0.22610722482204437,957.3680419921875,1e-05,0.15556803345680237,2.8831212520599365,81.14050197601318,2 +3066,0.27532005310058594,0.31573012471199036,0.29263633489608765,0.20885780453681946,944.529052734375,1e-05,0.14946626126766205,4.011794090270996,81.14050197601318,2 +3067,0.15590499341487885,0.27274662256240845,0.2790880501270294,0.18111887574195862,997.0159301757812,1e-05,0.4717728793621063,3.78328275680542,81.14050197601318,2 +3068,0.13129396736621857,0.16168272495269775,0.16097548604011536,0.14125874638557434,893.2089233398438,1e-05,0.13763508200645447,3.685628652572632,81.14050197601318,2 +3069,0.19022060930728912,0.16940639913082123,0.1733972132205963,0.15361304581165314,821.2252807617188,1e-05,0.12309766560792923,2.8416380882263184,81.14050197601318,2 +3070,0.35879892110824585,0.2500816583633423,0.24374766647815704,0.22634032368659973,836.9324951171875,1e-05,0.25499263405799866,3.360593557357788,81.14050197601318,2 +3071,0.14434190094470978,0.1641521006822586,0.18726399540901184,0.19930069148540497,970.6856079101562,1e-05,0.15939225256443024,2.8408164978027344,81.14050197601318,2 +3072,0.2702564001083374,0.23883236944675446,0.2451467216014862,0.0867132842540741,930.7574462890625,1e-05,0.14432695508003235,3.491809606552124,81.14050197601318,2 +3073,0.3483056426048279,0.4610206186771393,0.4700366258621216,0.15617716312408447,987.6286010742188,1e-05,0.1667909473180771,3.1293444633483887,81.14050197601318,2 +3074,0.24489106237888336,0.19555480778217316,0.19345834851264954,0.19487179815769196,994.0235595703125,1e-05,0.1556539088487625,3.127434730529785,81.14050197601318,2 +3075,0.29308879375457764,0.24009709060192108,0.2216942310333252,0.2242424190044403,955.10791015625,1e-05,0.11596747487783432,2.863978624343872,81.14050197601318,2 +3076,0.28953516483306885,0.19381633400917053,0.1899719387292862,0.22167831659317017,882.1692504882812,1e-05,0.46868664026260376,3.5507068634033203,81.14050197601318,2 +3077,0.20936180651187897,0.31157904863357544,0.2850807309150696,0.2242424190044403,987.7676391601562,1e-05,0.1336997151374817,2.868504285812378,81.14050197601318,2 +3078,0.300893098115921,0.2585785686969757,0.2581788897514343,0.21212121844291687,923.8132934570312,1e-05,1.6440904140472412,3.7526819705963135,81.14050197601318,2 +3079,0.25189927220344543,0.1589571088552475,0.16119049489498138,0.18368297815322876,856.2459106445312,1e-05,0.18623721599578857,3.1760165691375732,81.14050197601318,2 +3080,0.2306385189294815,0.21285808086395264,0.19660386443138123,0.21375291049480438,875.3941650390625,1e-05,0.1991439312696457,3.1416540145874023,81.14050197601318,2 +3081,0.2908986210823059,0.19551508128643036,0.18802505731582642,0.1358974426984787,582.22021484375,1e-05,0.18134789168834686,3.120589256286621,81.14050197601318,2 +3082,0.10137265175580978,0.1994101107120514,0.20653468370437622,0.16689977049827576,914.8272094726562,1e-05,0.16743740439414978,3.330918550491333,81.14050197601318,2 +3083,0.14792954921722412,0.23882423341274261,0.23049227893352509,0.20000000298023224,918.8137817382812,1e-05,0.1277497112751007,2.9944379329681396,81.14050197601318,2 +3084,0.1703958809375763,0.18009454011917114,0.17874398827552795,0.17179487645626068,782.640625,1e-05,0.42357879877090454,3.1480729579925537,81.14050197601318,2 +3085,0.27188432216644287,0.3145526945590973,0.3148098587989807,0.2270396202802658,446.5873107910156,1e-05,0.16067126393318176,3.1428637504577637,81.14050197601318,2 +3086,0.31316688656806946,0.187972292304039,0.17820066213607788,0.21771562099456787,743.3765869140625,1e-05,0.16225670278072357,3.1273157596588135,81.14050197601318,2 +3087,0.20767493546009064,0.39218029379844666,0.3698246479034424,0.1862470805644989,989.1450805664062,1e-05,0.10929837077856064,3.049186944961548,81.14050197601318,2 +3088,0.35331133008003235,0.1726262867450714,0.16766825318336487,0.2013985961675644,792.0157470703125,1e-05,0.1481286883354187,3.057849645614624,81.14050197601318,2 +3089,0.10028254240751266,0.19949482381343842,0.19596105813980103,0.2226107269525528,884.6192626953125,1e-05,0.12568728625774384,2.931953191757202,81.14050197601318,2 +3090,0.2705051898956299,0.11935485899448395,0.11139403283596039,0.1594405621290207,627.6343994140625,1e-05,0.14399439096450806,3.371321678161621,81.14050197601318,2 +3091,0.19145071506500244,0.19402751326560974,0.19243693351745605,0.23286713659763336,908.3971557617188,1e-05,0.32172539830207825,3.3342084884643555,81.14050197601318,2 +3092,0.21726210415363312,0.1922391951084137,0.1862492859363556,0.21934731304645538,716.8931274414062,1e-05,0.14655140042304993,3.0348992347717285,81.14050197601318,2 +3093,0.18028710782527924,0.20779889822006226,0.19733290374279022,0.23006993532180786,886.6248779296875,1e-05,0.1548183709383011,3.2619550228118896,81.14050197601318,2 +3094,0.2496553659439087,0.2374802678823471,0.2473824918270111,0.25081583857536316,424.38739013671875,1e-05,0.11983487755060196,3.2813355922698975,81.14050197601318,2 +3095,0.12636582553386688,0.38798773288726807,0.36211657524108887,0.25244754552841187,994.1507568359375,1e-05,0.10706149786710739,6.314610481262207,81.14050197601318,2 +3096,0.29757124185562134,0.21846923232078552,0.2051580846309662,0.24382284283638,657.4439697265625,1e-05,0.2632458806037903,6.3266565799713135,81.14050197601318,2 +3097,0.19697560369968414,0.22875897586345673,0.223832368850708,0.17832167446613312,849.5682373046875,1e-05,0.17508968710899353,6.3535401821136475,81.14050197601318,2 +3098,0.1647658497095108,0.23635618388652802,0.2262660712003708,0.2610722482204437,976.2150268554688,1e-05,0.12481886148452759,6.003815174102783,81.14050197601318,2 +3099,0.14961743354797363,0.24550338089466095,0.2458973079919815,0.20629370212554932,980.7741088867188,1e-05,0.1302562803030014,6.349616765975952,81.14050197601318,2 +3100,0.3116532862186432,0.2851078510284424,0.27527931332588196,0.2242424190044403,875.8281860351562,1e-05,0.13349460065364838,6.238863468170166,81.14050197601318,2 +3101,0.18042713403701782,0.24674555659294128,0.2309703230857849,0.17529137432575226,916.0694580078125,1e-05,0.15625782310962677,6.452800035476685,81.14050197601318,2 +3102,0.12807171046733856,0.11985517293214798,0.13241122663021088,0.26247087121009827,987.3492431640625,1e-05,0.15135790407657623,4.442557334899902,81.14050197601318,2 +3103,0.11399523168802261,0.24985893070697784,0.24036751687526703,0.1750582754611969,916.991943359375,1e-05,0.14845575392246246,3.469623327255249,81.14050197601318,2 +3104,0.24216912686824799,0.1732615977525711,0.1670219898223877,0.2214452177286148,816.0525512695312,1e-05,0.2230936884880066,2.8444008827209473,81.14050197601318,2 +3105,0.28278055787086487,0.25391435623168945,0.23776723444461823,0.20815850794315338,767.5730590820312,1e-05,0.1879936158657074,3.057131290435791,81.14050197601318,2 +3106,0.23041751980781555,0.15873044729232788,0.16229663789272308,0.02097902074456215,999.0592651367188,1e-05,0.17219331860542297,3.0872740745544434,81.14050197601318,2 +3107,0.1448657214641571,0.18950018286705017,0.19478267431259155,0.15221445262432098,873.2015991210938,1e-05,0.13635611534118652,3.5301716327667236,81.14050197601318,2 +3108,0.2575084865093231,0.23853610455989838,0.21974079310894012,0.20629370212554932,834.0355224609375,1e-05,0.1337825506925583,3.1359751224517822,81.14050197601318,2 +3109,0.13586679100990295,0.13813762366771698,0.1364302933216095,0.24358974397182465,999.8831176757812,1e-05,0.12361536920070648,3.7209970951080322,81.14050197601318,2 +3110,0.35305777192115784,0.21077412366867065,0.2087423950433731,0.2142191082239151,667.560546875,1e-05,0.14641007781028748,3.0093157291412354,81.14050197601318,2 +3111,0.17889030277729034,0.2714976370334625,0.2749779522418976,0.2454545497894287,938.0095825195312,1e-05,0.603205680847168,3.0953054428100586,81.14050197601318,2 +3112,0.22477248311042786,0.36334678530693054,0.36065059900283813,0.2158508151769638,970.8588256835938,1e-05,0.12406841665506363,3.1236495971679688,81.14050197601318,2 +3113,0.13793128728866577,0.2773195505142212,0.25813835859298706,0.2058275043964386,863.0953369140625,1e-05,0.17072202265262604,3.403777599334717,81.14050197601318,2 +3114,0.3007282316684723,0.25427567958831787,0.24139150977134705,0.1806526780128479,900.5198364257812,1e-05,0.22234024107456207,3.27586030960083,81.14050197601318,2 +3115,0.17146660387516022,0.21178710460662842,0.21507588028907776,0.17878787219524384,972.7406005859375,1e-05,0.15574564039707184,3.3780455589294434,81.14050197601318,2 +3116,0.16353419423103333,0.339819997549057,0.3314194083213806,0.220279723405838,961.9138793945312,1e-05,0.13751912117004395,3.2571117877960205,81.14050197601318,2 +3117,0.19481965899467468,0.23340149223804474,0.24015313386917114,0.116317018866539,996.4030151367188,1e-05,0.11801964789628983,4.137714624404907,81.14050197601318,2 +3118,0.1396448016166687,0.11027620732784271,0.12616649270057678,0.13729603588581085,991.1632080078125,1e-05,0.09077011048793793,3.4238882064819336,81.14050197601318,2 +3119,0.17808108031749725,0.21960312128067017,0.20837163925170898,0.19230769574642181,915.1390991210938,1e-05,0.21667765080928802,3.220994472503662,81.14050197601318,2 +3120,0.31477582454681396,0.26693806052207947,0.2624763250350952,0.2282051295042038,505.5683898925781,1e-05,0.1942419409751892,3.4618256092071533,81.14050197601318,2 +3121,0.17445392906665802,0.3844253122806549,0.38993775844573975,0.2454545497894287,990.0938720703125,1e-05,0.16624705493450165,3.397359848022461,81.14050197601318,2 +3122,0.19183899462223053,0.25420457124710083,0.23568500578403473,0.22750583291053772,922.657958984375,1e-05,0.14229245483875275,3.2307095527648926,81.14050197601318,2 +3123,0.3389463722705841,0.3185918927192688,0.3117210268974304,0.22331002354621887,386.44976806640625,1e-05,0.15122583508491516,4.292657852172852,81.14050197601318,2 +3124,0.2897169291973114,0.2247958928346634,0.2109459638595581,0.21375291049480438,914.2007446289062,1e-05,0.16810490190982819,3.9680941104888916,81.14050197601318,2 +3125,0.3750128149986267,0.2627020478248596,0.24565021693706512,0.16526806354522705,943.1180419921875,1e-05,0.14586396515369415,3.5847184658050537,81.14050197601318,2 +3126,0.20010656118392944,0.23785321414470673,0.2307048738002777,0.25151515007019043,655.9628295898438,1e-05,0.18683800101280212,3.4697017669677734,81.14050197601318,2 +3127,0.22421646118164062,0.1845940351486206,0.18584425747394562,0.2377622425556183,864.9906616210938,1e-05,0.15245755016803741,3.1638782024383545,81.14050197601318,2 +3128,0.2790825664997101,0.18811102211475372,0.18211647868156433,0.2694638669490814,899.4515991210938,1e-05,0.14723391830921173,3.11026930809021,81.14050197601318,2 +3129,0.24151158332824707,0.1530398279428482,0.15397284924983978,0.214685320854187,606.806884765625,1e-05,0.1456032693386078,3.145277500152588,81.14050197601318,2 +3130,0.2984907031059265,0.26450780034065247,0.2570548951625824,0.1515151560306549,946.378173828125,1e-05,0.17521770298480988,3.032318115234375,81.14050197601318,2 +3131,0.289052277803421,0.21578706800937653,0.2009870707988739,0.21212121844291687,907.39990234375,1e-05,0.33217915892601013,3.138112783432007,81.14050197601318,2 +3132,0.2182663083076477,0.2847389876842499,0.28015926480293274,0.2337995320558548,606.806884765625,1e-05,0.137445867061615,3.3396825790405273,81.14050197601318,2 +3133,0.28739801049232483,0.18646642565727234,0.20212224125862122,0.15011654794216156,705.2662353515625,1e-05,0.13469579815864563,3.0642738342285156,81.14050197601318,2 +3134,0.24712097644805908,0.16029247641563416,0.1714150756597519,0.23240093886852264,379.11187744140625,1e-05,0.0897047370672226,3.037663698196411,81.14050197601318,2 +3135,0.2443457543849945,0.2010660469532013,0.2055143415927887,0.18368297815322876,838.6439208984375,1e-05,0.1399749219417572,3.1316494941711426,81.14050197601318,2 +3136,0.16434673964977264,0.10332740098237991,0.11278252303600311,0.2186480164527893,937.2574462890625,1e-05,0.11827199161052704,3.0457940101623535,81.14050197601318,2 +3137,0.3097028136253357,0.33253875374794006,0.33166900277137756,0.06480186432600021,537.2642211914062,1e-05,0.17055858671665192,3.154369831085205,81.14050197601318,2 +3138,0.23479729890823364,0.21427996456623077,0.20611640810966492,0.1906759887933731,947.7415161132812,1e-05,0.10468181222677231,3.418001413345337,81.14050197601318,2 +3139,0.22010400891304016,0.1714596301317215,0.19101190567016602,0.1722610741853714,947.9669189453125,1e-05,0.12374144047498703,3.1132571697235107,81.14050197601318,2 +3140,0.3026108145713806,1.0107507705688477,1.02057683467865,0.18554778397083282,999.53125,1e-05,0.12449473142623901,3.06286883354187,81.14050197601318,2 +3141,0.2847207188606262,0.6576286554336548,0.6577942967414856,0.19230769574642181,133.62509155273438,1e-05,0.1287996470928192,3.1361467838287354,81.14050197601318,2 +3142,0.33725789189338684,0.4184545576572418,0.41187068819999695,0.18881118297576904,991.0303955078125,1e-05,0.20342043042182922,3.210864305496216,81.14050197601318,2 +3143,0.1456531286239624,0.29879987239837646,0.3293531537055969,0.19417248666286469,999.0592651367188,1e-05,0.12806521356105804,3.092935800552368,81.14050197601318,2 +3144,0.17068195343017578,0.22894378006458282,0.23621487617492676,0.2242424190044403,826.846923828125,1e-05,0.1011337861418724,3.4378256797790527,81.14050197601318,2 +3145,0.20789480209350586,0.23473556339740753,0.22086164355278015,0.22843822836875916,828.0687866210938,1e-05,0.15922382473945618,2.8402109146118164,81.14050197601318,2 +3146,0.31959304213523865,0.21655580401420593,0.2086557298898697,0.12937062978744507,835.2010498046875,1e-05,0.13893114030361176,3.086651086807251,81.14050197601318,2 +3147,0.2485542893409729,0.2042549103498459,0.19901031255722046,0.27435898780822754,646.8789672851562,1e-05,0.2426161915063858,3.0920186042785645,81.14050197601318,2 +3148,0.310306191444397,0.41093677282333374,0.4095277488231659,0.1958041936159134,292.3681640625,1e-05,0.1670163869857788,3.3184406757354736,81.14050197601318,2 +3149,0.10984670370817184,0.22856022417545319,0.23091919720172882,0.20606060326099396,991.69189453125,1e-05,0.17675279080867767,3.1217424869537354,81.14050197601318,2 +3150,0.20238594710826874,0.27499914169311523,0.28079694509506226,0.22750583291053772,973.0780639648438,1e-05,0.13569669425487518,3.4083731174468994,81.14050197601318,2 +3151,0.41202497482299805,0.5134645104408264,0.5234461426734924,0.2477855533361435,158.9905548095703,1e-05,0.3992342948913574,2.8394775390625,81.14050197601318,2 +3152,0.1844109296798706,0.2234717756509781,0.231214240193367,0.19230769574642181,981.9857788085938,1e-05,0.14539137482643127,3.09584641456604,81.14050197601318,2 +3153,0.3185960352420807,0.26117080450057983,0.2430722564458847,0.20000000298023224,765.8187255859375,1e-05,0.1764192432165146,3.138413906097412,81.14050197601318,2 +3154,0.24811962246894836,0.2592642903327942,0.2605714499950409,0.20326340198516846,947.5157470703125,1e-05,0.16930751502513885,3.3573012351989746,81.14050197601318,2 +3155,0.3366886079311371,0.2976120114326477,0.28021878004074097,0.11888112127780914,946.6068115234375,1e-05,0.1412222534418106,3.08565616607666,81.14050197601318,2 +3156,0.16042748093605042,0.25252407789230347,0.23933830857276917,0.13939394056797028,930.7574462890625,1e-05,0.17141073942184448,3.358473300933838,81.14050197601318,2 +3157,0.21910564601421356,0.38990628719329834,0.389108806848526,0.1930069923400879,983.6209716796875,1e-05,0.13211488723754883,3.044614553451538,81.14050197601318,2 +3158,0.1724105179309845,0.1324344128370285,0.13906969130039215,0.17808857560157776,753.0517578125,1e-05,0.12593145668506622,2.8446104526519775,81.14050197601318,2 +3159,0.20116625726222992,0.18705236911773682,0.19684560596942902,0.2242424190044403,852.6897583007812,1e-05,0.13838541507720947,3.150851249694824,81.14050197601318,2 +3160,0.14843042194843292,0.21790702641010284,0.21527840197086334,0.22750583291053772,868.2445068359375,1e-05,2.678581476211548,3.4463443756103516,81.14050197601318,2 +3161,0.16422320902347565,0.3342669904232025,0.35322439670562744,0.20046620070934296,979.8526000976562,1e-05,0.15424346923828125,3.3899037837982178,81.14050197601318,2 +3162,0.2711760699748993,0.2513371407985687,0.27176982164382935,0.2069930136203766,975.4014282226562,1e-05,0.17944589257240295,3.3676371574401855,81.14050197601318,2 +3163,0.25580936670303345,0.17262279987335205,0.16992773115634918,0.2270396202802658,874.9585571289062,1e-05,0.13079474866390228,3.0229644775390625,81.14050197601318,2 +3164,0.13966114819049835,0.32782453298568726,0.30961155891418457,0.260606050491333,960.1631469726562,1e-05,0.10860150307416916,2.838658094406128,81.14050197601318,2 +3165,0.25959816575050354,0.2256922721862793,0.2166110873222351,0.2046620100736618,965.126220703125,1e-05,0.17635300755500793,3.4261934757232666,81.14050197601318,2 +3166,0.2772362530231476,0.3036981225013733,0.3019401431083679,0.250582754611969,449.6458740234375,1e-05,0.1264842301607132,3.146498441696167,81.14050197601318,2 +3167,0.20477987825870514,0.31474509835243225,0.2995232939720154,0.19533799588680267,948.8626708984375,1e-05,0.20678602159023285,3.1097424030303955,81.14050197601318,2 +3168,0.10004886984825134,0.1771470308303833,0.1725713461637497,0.2174825221300125,953.8506469726562,1e-05,0.08645716309547424,3.137349843978882,81.14050197601318,2 +3169,0.33542466163635254,0.21003569662570953,0.21952560544013977,0.20069929957389832,968.3995361328125,1e-05,0.13436053693294525,3.057589292526245,81.14050197601318,2 +3170,0.23937435448169708,0.2663751542568207,0.2553832530975342,0.1890442818403244,984.4981079101562,1e-05,0.13329944014549255,2.845529794692993,81.14050197601318,2 +3171,0.1746523231267929,0.34087303280830383,0.33968791365623474,0.17039626836776733,990.4967651367188,1e-05,0.19273695349693298,3.3898727893829346,81.14050197601318,2 +3172,0.2912745177745819,0.20306047797203064,0.1922844648361206,0.2717948853969574,902.2786865234375,1e-05,0.12394920736551285,3.2509799003601074,81.14050197601318,2 +3173,0.17903384566307068,0.3013964295387268,0.29173406958580017,0.19930069148540497,624.2781982421875,1e-05,0.16655193269252777,3.2930026054382324,81.14050197601318,2 +3174,0.25941866636276245,0.1410524547100067,0.1399424970149994,0.17575757205486298,942.4046020507812,1e-05,0.1229226142168045,3.06878662109375,81.14050197601318,2 +3175,0.24237093329429626,0.17312340438365936,0.15471050143241882,0.23706293106079102,674.5276489257812,1e-05,1.0988609790802002,3.032500743865967,81.14050197601318,2 +3176,0.3841351270675659,0.19577796757221222,0.20801927149295807,0.10396270453929901,327.6654357910156,1e-05,0.17217321693897247,2.837263584136963,81.14050197601318,2 +3177,0.23020333051681519,0.27155888080596924,0.24541573226451874,0.20606060326099396,867.7844848632812,1e-05,0.16497312486171722,3.3234825134277344,81.14050197601318,2 +3178,0.257813423871994,0.16931025683879852,0.16682660579681396,0.20769231021404266,920.9009399414062,1e-05,0.14456073939800262,3.4138376712799072,81.14050197601318,2 +3179,0.23341773450374603,0.18171924352645874,0.1762896180152893,0.2708624601364136,803.0537109375,1e-05,0.1385125368833542,3.4288971424102783,81.14050197601318,2 +3180,0.3419450521469116,0.31142106652259827,0.31919679045677185,0.12727272510528564,977.65869140625,1e-05,0.4230496287345886,2.8324663639068604,81.14050197601318,2 +3181,0.21669429540634155,0.22830447554588318,0.22677242755889893,0.21398600935935974,976.8599853515625,1e-05,0.10991372168064117,3.041649103164673,81.14050197601318,2 +3182,0.2514708340167999,0.18728236854076385,0.17869140207767487,0.2097902148962021,782.640625,1e-05,0.1866147220134735,2.845136880874634,81.14050197601318,2 +3183,0.26012399792671204,0.2084195464849472,0.20253825187683105,0.2242424190044403,692.97265625,1e-05,0.15584467351436615,3.626589298248291,81.14050197601318,2 +3184,0.33493784070014954,0.2263309210538864,0.22356900572776794,0.26247087121009827,975.8905029296875,1e-05,0.13885849714279175,3.1434786319732666,81.14050197601318,2 +3185,0.2575043737888336,0.133901908993721,0.14447730779647827,0.13682983815670013,855.743408203125,1e-05,0.14562492072582245,3.1037657260894775,81.14050197601318,2 +3186,0.19616058468818665,0.16987958550453186,0.1695711761713028,0.12051282078027725,606.806884765625,1e-05,0.09862009435892105,2.8512024879455566,81.14050197601318,2 +3187,0.15097811818122864,0.15725314617156982,0.1529053896665573,0.20093239843845367,898.011962890625,1e-05,0.16213056445121765,3.10081148147583,81.14050197601318,2 +3188,0.20224350690841675,0.23757152259349823,0.23707321286201477,0.07319347560405731,968.9326171875,1e-05,0.1932206153869629,3.1500604152679443,81.14050197601318,2 +3189,0.22464941442012787,0.29179492592811584,0.2758365869522095,0.21724942326545715,994.53125,1e-05,0.16500094532966614,3.4374752044677734,81.14050197601318,2 +3190,0.23490339517593384,0.29577282071113586,0.29527339339256287,0.20279720425605774,310.39483642578125,1e-05,0.13994471728801727,3.3208417892456055,81.14050197601318,2 +3191,0.19403435289859772,0.17784804105758667,0.1734570562839508,0.19440560042858124,890.5407104492188,1e-05,0.16724278032779694,3.107801675796509,81.14050197601318,2 +3192,0.21356098353862762,0.22409391403198242,0.21723110973834991,0.1862470805644989,861.1730346679688,1e-05,0.1773974448442459,2.8511769771575928,81.14050197601318,2 +3193,0.288644939661026,0.2334294468164444,0.22960975766181946,0.19766899943351746,944.0609741210938,1e-05,0.1571122407913208,3.058403253555298,81.14050197601318,2 +3194,0.14996804296970367,0.19922371208667755,0.19337621331214905,0.24708624184131622,910.6900634765625,1e-05,0.1411791741847992,3.135157585144043,81.14050197601318,2 +3195,0.3385148346424103,0.6687325835227966,0.6650078892707825,0.24755243957042694,146.47067260742188,1e-05,0.13086406886577606,3.157010316848755,81.14050197601318,2 +3196,0.41847360134124756,0.23950329422950745,0.24148625135421753,0.19510489702224731,972.5713500976562,1e-05,0.12958475947380066,3.361645460128784,81.14050197601318,2 +3197,0.2026802897453308,0.16009993851184845,0.15754637122154236,0.21048951148986816,713.4717407226562,1e-05,0.13062311708927155,3.0813724994659424,81.14050197601318,2 +3198,0.476060152053833,0.3103008270263672,0.29972079396247864,0.17925408482551575,968.0419921875,1e-05,0.127376988530159,2.8487160205841064,81.14050197601318,2 +3199,0.34564346075057983,0.3108043670654297,0.3083628714084625,0.14685314893722534,464.5392150878906,1e-05,0.10849985480308533,3.0738167762756348,81.14050197601318,2 +3200,0.37987297773361206,0.37168455123901367,0.3607114255428314,0.19230769574642181,263.79840087890625,1e-05,0.15492010116577148,3.135946750640869,81.14050197601318,2 +3201,0.18156956136226654,0.3164483308792114,0.31630274653434753,0.19207459688186646,903.6668701171875,1e-05,0.23666661977767944,3.281573534011841,81.14050197601318,2 +3202,0.38092344999313354,0.27932971715927124,0.259777694940567,0.23752914369106293,857.2454833984375,1e-05,0.1332625448703766,3.1178245544433594,81.14050197601318,2 +3203,0.27698805928230286,0.23605448007583618,0.23245194554328918,0.23286713659763336,870.5208129882812,1e-05,0.1395585983991623,3.1170876026153564,81.14050197601318,2 +3204,0.24236302077770233,0.2410074770450592,0.232198104262352,0.21771562099456787,873.64306640625,1e-05,0.1628948152065277,3.035425901412964,81.14050197601318,2 +3205,0.11363338679075241,0.25879842042922974,0.25079354643821716,0.22564102709293365,948.6395874023438,1e-05,0.1524561494588852,2.8394792079925537,81.14050197601318,2 +3206,0.1764385998249054,0.1872631311416626,0.18211372196674347,0.22890442609786987,728.9754028320312,1e-05,0.13277500867843628,3.0677802562713623,81.14050197601318,2 +3207,0.3021675944328308,0.16720901429653168,0.17035475373268127,0.2058275043964386,637.4429931640625,1e-05,0.13927453756332397,3.4593312740325928,81.14050197601318,2 +3208,0.41600996255874634,0.18187852203845978,0.1896706521511078,0.1258741319179535,772.7371215820312,1e-05,0.12898209691047668,3.0613622665405273,81.14050197601318,2 +3209,0.23550185561180115,0.2349373698234558,0.2257072627544403,0.1375291347503662,760.4534912109375,1e-05,0.23368379473686218,3.140166997909546,81.14050197601318,2 +3210,0.19633784890174866,0.40808480978012085,0.3903695344924927,0.18554778397083282,999.7660522460938,1e-05,0.1706312894821167,3.052182912826538,81.14050197601318,2 +3211,0.2243504673242569,0.19118613004684448,0.18565839529037476,0.22960372269153595,743.3765869140625,1e-05,0.12708888947963715,2.8373515605926514,81.14050197601318,2 +3212,0.2673148512840271,0.3380798101425171,0.32321619987487793,0.15128205716609955,967.5030517578125,1e-05,0.1390276849269867,3.079083204269409,81.14050197601318,2 +3213,0.18323342502117157,0.1730658859014511,0.16985300183296204,0.17575757205486298,871.4204711914062,1e-05,0.14178504049777985,3.4837536811828613,81.14050197601318,2 +3214,0.1235247552394867,0.29798635840415955,0.3022940456867218,0.09696969389915466,966.04833984375,1e-05,0.15254734456539154,3.3716046810150146,81.14050197601318,2 +3215,0.21829481422901154,0.4213266372680664,0.4047498404979706,0.23613053560256958,989.8240966796875,1e-05,0.17128655314445496,2.8266756534576416,81.14050197601318,2 +3216,0.18057411909103394,0.1970372051000595,0.19586725533008575,0.1818181872367859,561.6887817382812,1e-05,39.826107025146484,3.0564794540405273,81.14050197601318,2 +3217,0.23829513788223267,0.36314716935157776,0.36514943838119507,0.21398600935935974,331.87054443359375,1e-05,0.11900005489587784,2.8394742012023926,81.14050197601318,2 +3218,0.25486430525779724,0.16722436249256134,0.1626351773738861,0.11375291645526886,926.9263305664062,1e-05,0.1489219218492508,3.42641019821167,81.14050197601318,2 +3219,0.4211250841617584,0.3229650855064392,0.31131502985954285,0.21515151858329773,424.38739013671875,1e-05,0.19647471606731415,3.1470751762390137,81.14050197601318,2 +3220,0.18133416771888733,0.19129678606987,0.18750856816768646,0.14452214539051056,781.836181640625,1e-05,0.14191976189613342,3.3951730728149414,81.14050197601318,2 +3221,0.1350695937871933,0.2276710420846939,0.21642711758613586,0.21328671276569366,935.7356567382812,1e-05,0.15750549733638763,2.830615282058716,81.14050197601318,2 +3222,0.18624189496040344,0.25655001401901245,0.24378937482833862,0.20932400226593018,877.1219482421875,1e-05,0.1676781177520752,3.0872857570648193,81.14050197601318,2 +3223,0.37930554151535034,0.17363102734088898,0.1725456863641739,0.2708624601364136,776.9306030273438,1e-05,0.15827016532421112,2.836242914199829,81.14050197601318,2 +3224,0.30830833315849304,0.22048185765743256,0.21978317201137543,0.1878787875175476,858.7315673828125,1e-05,0.11773358285427094,3.3536436557769775,81.14050197601318,2 +3225,0.1129271537065506,0.20987653732299805,0.2001948058605194,0.23310023546218872,988.4596557617188,1e-05,0.18355347216129303,3.3034510612487793,81.14050197601318,2 +3226,0.30116432905197144,0.3025524914264679,0.29012200236320496,0.13379953801631927,687.85546875,1e-05,0.175871804356575,3.1244356632232666,81.14050197601318,2 +3227,0.1665353626012802,0.1920388787984848,0.1902594417333603,0.1846153885126114,987.069091796875,1e-05,0.13600490987300873,2.8367419242858887,81.14050197601318,2 +3228,0.18105265498161316,0.1902659684419632,0.18718715012073517,0.1878787875175476,887.0220336914062,1e-05,0.34087055921554565,3.050114870071411,81.14050197601318,2 +3229,0.19238899648189545,0.21572743356227875,0.21173326671123505,0.22191141545772552,972.5713500976562,1e-05,0.1621239185333252,2.8345110416412354,81.14050197601318,2 +3230,0.25004053115844727,0.20179934799671173,0.1940668821334839,0.23123542964458466,851.6567993164062,1e-05,0.13907378911972046,3.348001003265381,81.14050197601318,2 +3231,0.35308974981307983,0.2010701596736908,0.18695512413978577,0.22284382581710815,926.0864868164062,1e-05,0.1380799561738968,3.337970018386841,81.14050197601318,2 +3232,0.20040346682071686,0.2994716763496399,0.29186439514160156,0.23636363446712494,872.758544921875,1e-05,0.14469900727272034,3.309109687805176,81.14050197601318,2 +3233,0.23971587419509888,0.275728315114975,0.25978875160217285,0.24731934070587158,604.99365234375,1e-05,0.11449310928583145,2.842284679412842,81.14050197601318,2 +3234,0.18940015137195587,0.07282812893390656,0.07860234379768372,0.14102564752101898,785.822265625,1e-05,0.12107857316732407,3.103469133377075,81.14050197601318,2 +3235,0.20176130533218384,0.21642298996448517,0.21034786105155945,0.22074592113494873,620.8772583007812,1e-05,0.1523665338754654,2.8475565910339355,81.14050197601318,2 +3236,0.2112729549407959,0.2855929732322693,0.2667963206768036,0.27272728085517883,958.17578125,1e-05,0.13958539068698883,3.474060535430908,81.14050197601318,2 +3237,0.25347450375556946,0.3848395347595215,0.4067569971084595,0.21235431730747223,127.0761489868164,1e-05,0.14557290077209473,3.104182481765747,81.14050197601318,2 +3238,0.3566264808177948,0.21480989456176758,0.18825538456439972,0.25594404339790344,730.0392456054688,1e-05,0.29952168464660645,3.430034875869751,81.14050197601318,2 +3239,0.2154872566461563,0.21714618802070618,0.20861244201660156,0.1906759887933731,926.9263305664062,1e-05,0.17824402451515198,3.1260690689086914,81.14050197601318,2 +3240,0.34074676036834717,0.18487606942653656,0.18471316993236542,0.16200466454029083,922.0755004882812,1e-05,0.18113215267658234,2.8315317630767822,81.14050197601318,2 +3241,0.12523365020751953,0.3208217918872833,0.323263019323349,0.2170163094997406,966.04833984375,1e-05,0.10572566092014313,3.148139476776123,81.14050197601318,2 +3242,0.20445936918258667,0.22285215556621552,0.2189750075340271,0.23426572978496552,885.8264770507812,1e-05,0.15886805951595306,3.461723804473877,81.14050197601318,2 +3243,0.24767491221427917,0.17741309106349945,0.18873925507068634,0.2652680575847626,440.3874816894531,1e-05,0.17304661870002747,3.4262311458587646,81.14050197601318,2 +3244,0.18218830227851868,0.24550274014472961,0.22830621898174286,0.2710955739021301,919.414306640625,1e-05,0.1490093171596527,3.1518898010253906,81.14050197601318,2 +3245,0.24047589302062988,0.12312488257884979,0.12353743612766266,0.10932400822639465,668.9708251953125,1e-05,0.1454799473285675,3.044128656387329,81.14050197601318,2 +3246,0.3543415069580078,0.24952906370162964,0.24649010598659515,0.2298368364572525,819.9478759765625,1e-05,0.3402363359928131,2.848644256591797,81.14050197601318,2 +3247,0.2810012996196747,0.4388711452484131,0.44580715894699097,0.2825174927711487,206.04872131347656,1e-05,0.13932396471500397,3.0544533729553223,81.14050197601318,2 +3248,0.1463862806558609,0.21372798085212708,0.2179364711046219,0.14895105361938477,944.7620849609375,1e-05,0.12564048171043396,3.5380051136016846,81.14050197601318,2 +3249,0.1992405205965042,0.19551143050193787,0.18204189836978912,0.2545454502105713,863.5715942382812,1e-05,0.24343205988407135,3.3352861404418945,81.14050197601318,2 +3250,0.2972552180290222,0.2533765137195587,0.2385435551404953,0.22843822836875916,907.7332763671875,1e-05,0.14175714552402496,3.0873043537139893,81.14050197601318,2 +3251,0.12248443812131882,0.14684876799583435,0.13809844851493835,0.16969697177410126,944.9946899414062,1e-05,0.1029033362865448,3.0249555110931396,81.14050197601318,2 +3252,0.22859303653240204,0.4605428874492645,0.457042396068573,0.19044288992881775,973.2462768554688,1e-05,0.1669468730688095,2.8466711044311523,81.14050197601318,2 +3253,0.2404288351535797,0.11329299211502075,0.1325335055589676,0.17645686864852905,969.1096801757812,1e-05,0.1570543646812439,3.112790822982788,81.14050197601318,2 +3254,0.06770114600658417,0.13726559281349182,0.13213860988616943,0.07878787815570831,912.6188354492188,1e-05,0.14087533950805664,3.1598379611968994,81.14050197601318,2 +3255,0.2802419066429138,0.21170106530189514,0.20771458745002747,0.260606050491333,980.3147583007812,1e-05,0.13480211794376373,3.3095293045043945,81.14050197601318,2 +3256,0.3479037582874298,0.2288854420185089,0.22093535959720612,0.21212121844291687,998.4646606445312,1e-05,0.11831468343734741,3.098860502243042,81.14050197601318,2 +3257,0.23100164532661438,0.20416496694087982,0.2079566866159439,0.25314685702323914,991.5601806640625,1e-05,0.11313661187887192,3.0404391288757324,81.14050197601318,2 +3258,0.222944438457489,0.11414151638746262,0.12076377868652344,0.06386946141719818,982.4352416992188,1e-05,0.17246556282043457,2.8417513370513916,81.14050197601318,2 +3259,0.06451064348220825,0.36467212438583374,0.3312862813472748,0.2242424190044403,990.36279296875,1e-05,0.13091285526752472,3.321584701538086,81.14050197601318,2 +3260,0.19747678935527802,0.152455672621727,0.16034923493862152,0.16177156567573547,963.0614624023438,1e-05,0.1347324699163437,3.4400734901428223,81.14050197601318,2 +3261,0.1199902892112732,0.21716439723968506,0.21030303835868835,0.24289044737815857,902.2786865234375,1e-05,0.13655363023281097,3.1135811805725098,81.14050197601318,2 +3262,0.2960391640663147,0.5869712829589844,0.5807387828826904,0.1515151560306549,146.47067260742188,1e-05,0.18578115105628967,3.0951430797576904,81.14050197601318,2 +3263,0.250436931848526,0.20553019642829895,0.20908907055854797,0.25034964084625244,979.8526000976562,1e-05,0.13293980062007904,2.8558156490325928,81.14050197601318,2 +3264,0.3060459792613983,0.234629824757576,0.2138732522726059,0.21771562099456787,787.3915405273438,1e-05,0.20030570030212402,3.0968520641326904,81.14050197601318,2 +3265,0.12859570980072021,0.36710822582244873,0.3452392518520355,0.2086247056722641,997.1378173828125,1e-05,0.1500026136636734,3.311169147491455,81.14050197601318,2 +3266,0.17588135600090027,0.17967066168785095,0.18780124187469482,0.2282051295042038,943.5906372070312,1e-05,0.1749875396490097,3.4068095684051514,81.14050197601318,2 +3267,0.15338212251663208,0.11263182014226913,0.1258007287979126,0.13426573574543,944.0609741210938,1e-05,0.16583162546157837,3.1128854751586914,81.14050197601318,2 +3268,0.2065689116716385,0.2868265211582184,0.26946645975112915,0.2557109594345093,953.2152709960938,1e-05,0.1624637395143509,3.1359200477600098,81.14050197601318,2 +3269,0.15670035779476166,0.2070656716823578,0.19731269776821136,0.21095570921897888,850.6163940429688,1e-05,0.13434602320194244,2.841783285140991,81.14050197601318,2 +3270,0.262212872505188,0.089246466755867,0.08931580930948257,0.07622377574443817,906.7301635742188,1e-05,0.23793533444404602,3.4277195930480957,81.14050197601318,2 +3271,0.2137087881565094,0.2544316351413727,0.2544046640396118,0.26083916425704956,997.0159301757812,1e-05,0.13190187513828278,3.3708581924438477,81.14050197601318,2 +3272,0.08735212683677673,0.24494510889053345,0.23197317123413086,0.1878787875175476,990.36279296875,1e-05,0.14889216423034668,3.054710865020752,81.14050197601318,2 +3273,0.15747906267642975,0.2346646785736084,0.2254689633846283,0.18321678042411804,978.4493408203125,1e-05,0.13303621113300323,3.3975749015808105,81.14050197601318,2 +3274,0.2794283926486969,0.22007040679454803,0.22046348452568054,0.20163169503211975,950.4097290039062,1e-05,1.4085150957107544,2.8321709632873535,81.14050197601318,2 +3275,0.12039538472890854,0.21183213591575623,0.21332819759845734,0.19230769574642181,938.2591552734375,1e-05,0.14359654486179352,3.9779233932495117,81.14050197601318,2 +3276,0.2020723819732666,0.2645498812198639,0.2496403455734253,0.279720276594162,828.6761474609375,1e-05,0.1342071145772934,3.089745283126831,81.14050197601318,2 +3277,0.27109524607658386,0.20802396535873413,0.21405556797981262,0.20233100652694702,984.2067260742188,1e-05,0.12978868186473846,3.362471580505371,81.14050197601318,2 +3278,0.24411627650260925,0.3243539035320282,0.3254142701625824,0.26083916425704956,348.26116943359375,1e-05,0.15966853499412537,3.1376359462738037,81.14050197601318,2 +3279,0.21917136013507843,0.18865449726581573,0.17967139184474945,0.24871794879436493,792.7744140625,1e-05,0.16408275067806244,3.0967581272125244,81.14050197601318,2 +3280,0.31503596901893616,0.3057684600353241,0.3039320409297943,0.21212121844291687,500.3907775878906,1e-05,0.1245221495628357,2.840383291244507,81.14050197601318,2 +3281,0.22309763729572296,0.22281208634376526,0.2198209911584854,0.22354312241077423,974.4140625,1e-05,0.12766492366790771,3.0881776809692383,81.14050197601318,2 +3282,0.10817430168390274,0.20128534734249115,0.19440801441669464,0.09067598730325699,968.7553100585938,1e-05,0.20201170444488525,3.061634063720703,81.14050197601318,2 +3283,0.20226222276687622,0.19853229820728302,0.20135293900966644,0.15361304581165314,660.37890625,1e-05,0.16049571335315704,3.3923721313476562,81.14050197601318,2 +3284,0.40417003631591797,0.2189968377351761,0.23788906633853912,0.19090908765792847,967.5030517578125,1e-05,0.14355583488941193,3.34238862991333,81.14050197601318,2 +3285,0.14026913046836853,0.2127082347869873,0.2159435898065567,0.17435897886753082,931.826171875,1e-05,0.22867386043071747,3.0737597942352295,81.14050197601318,2 +3286,0.21030138432979584,0.1364573985338211,0.13356344401836395,0.19044288992881775,741.38232421875,1e-05,1.4981305599212646,2.8345799446105957,81.14050197601318,2 +3287,0.20249368250370026,0.20283247530460358,0.1977318674325943,0.2829836905002594,706.4580688476562,1e-05,0.12274452298879623,3.099266767501831,81.14050197601318,2 +3288,0.14555241167545319,0.2558611333370209,0.25234848260879517,0.2242424190044403,968.2208862304688,1e-05,0.16265001893043518,3.3386731147766113,81.14050197601318,2 +3289,0.1922338604927063,0.2147989124059677,0.19232039153575897,0.2242424190044403,920.9009399414062,1e-05,0.1392865777015686,3.396409034729004,81.14050197601318,2 +3290,0.20977084338665009,0.3001648783683777,0.29327473044395447,0.22564102709293365,998.8220825195312,1e-05,0.12137208133935928,3.304633378982544,81.14050197601318,2 +3291,0.237455815076828,0.16520802676677704,0.17582835257053375,0.16969697177410126,661.8328857421875,1e-05,0.1142551451921463,3.081888437271118,81.14050197601318,2 +3292,0.3303450644016266,0.2336420714855194,0.21823449432849884,0.20163169503211975,949.7498168945312,1e-05,0.12289456278085709,2.8459630012512207,81.14050197601318,2 +3293,0.263823539018631,0.4243517816066742,0.39514222741127014,0.23333333432674408,968.57763671875,1e-05,0.18074558675289154,3.0350162982940674,81.14050197601318,2 +3294,0.20150649547576904,0.29171860218048096,0.305120050907135,0.10722610354423523,982.7333984375,1e-05,0.14130635559558868,3.330125570297241,81.14050197601318,2 +3295,0.26382002234458923,0.2429707944393158,0.242817685008049,0.21631701290607452,951.0648803710938,1e-05,0.21921105682849884,3.415982723236084,81.14050197601318,2 +3296,0.38467177748680115,0.24534614384174347,0.23355160653591156,0.2097902148962021,973.4141235351562,1e-05,0.18827389180660248,3.0798046588897705,81.14050197601318,2 +3297,0.1663188636302948,0.2968125641345978,0.2820836007595062,0.1878787875175476,947.2893676757812,1e-05,0.11437639594078064,3.092679023742676,81.14050197601318,2 +3298,0.3113498091697693,0.5610312819480896,0.5537430047988892,0.25244754552841187,171.19692993164062,1e-05,0.144144669175148,2.8272671699523926,81.14050197601318,2 +3299,0.30850255489349365,0.18769623339176178,0.1868804544210434,0.22400932013988495,918.2099609375,1e-05,0.30803564190864563,3.2465755939483643,81.14050197601318,2 +3300,0.2130822092294693,0.16469138860702515,0.16740655899047852,0.10256410390138626,701.6507568359375,1e-05,0.11207006871700287,3.09562087059021,81.14050197601318,2 +3301,0.1691717803478241,0.19998018443584442,0.1902819722890854,0.20722611248493195,916.6853637695312,1e-05,0.20956608653068542,3.3504281044006348,81.14050197601318,2 +3302,0.3622876703739166,0.1559634655714035,0.15789836645126343,0.2522144615650177,743.3765869140625,1e-05,0.18020924925804138,3.1134426593780518,81.14050197601318,2 +3303,0.14753976464271545,0.10361529141664505,0.10643038898706436,0.28601399064064026,893.9605712890625,1e-05,0.1331653594970703,3.0778892040252686,81.14050197601318,2 +3304,0.2547003924846649,0.22495371103286743,0.22348229587078094,0.2354312390089035,962.6806640625,1e-05,0.3264539837837219,2.837524652481079,81.14050197601318,2 +3305,0.12387685477733612,0.2589440941810608,0.25128600001335144,0.25594404339790344,736.306396484375,1e-05,0.309365838766098,3.2646420001983643,81.14050197601318,2 +3306,0.2828431725502014,0.22734791040420532,0.2319851666688919,0.17575757205486298,738.3524169921875,1e-05,0.30665329098701477,3.338287591934204,81.14050197601318,2 +3307,0.1567063331604004,0.24476580321788788,0.23741157352924347,0.2058275043964386,939.9876098632812,1e-05,0.12321723997592926,3.07525634765625,81.14050197601318,2 +3308,0.21562442183494568,0.2692851722240448,0.2524923086166382,0.20069929957389832,986.6468505859375,1e-05,0.12357952445745468,3.1098086833953857,81.14050197601318,2 +3309,0.08851654082536697,0.27872639894485474,0.2747058868408203,0.1986013948917389,977.0203857421875,1e-05,0.1319495290517807,3.1040563583374023,81.14050197601318,2 +3310,0.12142607569694519,0.18440186977386475,0.18856985867023468,0.19720280170440674,912.93701171875,1e-05,0.1896752566099167,2.832875967025757,81.14050197601318,2 +3311,0.17165912687778473,0.12497016042470932,0.1266203075647354,0.2543123662471771,946.8348388671875,1e-05,0.148650124669075,3.3543713092803955,81.14050197601318,2 +3312,0.2114604264497757,0.32157355546951294,0.31248074769973755,0.279720276594162,966.04833984375,1e-05,0.23016062378883362,3.1445744037628174,81.14050197601318,2 +3313,0.31019479036331177,0.2903839945793152,0.2749623656272888,0.2041957974433899,999.7660522460938,1e-05,0.11010198295116425,3.0538296699523926,81.14050197601318,2 +3314,0.21053709089756012,0.212568461894989,0.20695479214191437,0.16083915531635284,883.8079833984375,1e-05,0.16766948997974396,3.2997517585754395,81.14050197601318,2 +3315,0.26340413093566895,0.1950913369655609,0.21000516414642334,0.1958041936159134,983.9144897460938,1e-05,0.16141006350517273,2.831878662109375,81.14050197601318,2 +3316,0.3716943860054016,0.08432156592607498,0.09787644445896149,0.19370628893375397,724.6637573242188,1e-05,0.1302764117717743,2.829341411590576,81.14050197601318,2 +3317,0.24331019818782806,0.18191999197006226,0.19582192599773407,0.15291374921798706,520.6055908203125,1e-05,0.1883714199066162,3.0886917114257812,81.14050197601318,2 +3318,0.2401062399148941,0.20211555063724518,0.2071208506822586,0.23240093886852264,584.1925659179688,1e-05,0.13722272217273712,3.465198516845703,81.14050197601318,2 +3319,0.2892834544181824,0.25378602743148804,0.2469525784254074,0.24452213943004608,648.4168090820312,1e-05,0.13650862872600555,3.074378252029419,81.14050197601318,2 +3320,0.3317771553993225,0.1534425914287567,0.14933417737483978,0.19044288992881775,610.396240234375,1e-05,0.16057179868221283,3.0980708599090576,81.14050197601318,2 +3321,0.20220598578453064,0.2751905620098114,0.27643147110939026,0.1314685344696045,877.97705078125,1e-05,0.20167948305606842,2.8273212909698486,81.14050197601318,2 +3322,0.3427468240261078,0.15577098727226257,0.1538366824388504,0.13286712765693665,989.0084838867188,1e-05,0.11549455672502518,3.0866010189056396,81.14050197601318,2 +3323,0.20574989914894104,0.13084065914154053,0.14221936464309692,0.15337994694709778,812.7318115234375,1e-05,0.14212624728679657,3.1263554096221924,81.14050197601318,2 +3324,0.16411057114601135,0.2249528467655182,0.21375033259391785,0.2030303031206131,960.5552368164062,1e-05,0.1325298547744751,3.3250186443328857,81.14050197601318,2 +3325,0.1110108271241188,0.1346069872379303,0.14595171809196472,0.10303030163049698,965.8648071289062,1e-05,0.13154764473438263,3.375073194503784,81.14050197601318,2 +3326,0.29721108078956604,0.36424338817596436,0.364454984664917,0.17575757205486298,434.07476806640625,1e-05,0.12981358170509338,3.134422540664673,81.14050197601318,2 +3327,0.1746620237827301,0.2426794022321701,0.24483229219913483,0.21282051503658295,795.77587890625,1e-05,0.13835003972053528,2.82627010345459,81.14050197601318,2 +3328,0.23369210958480835,0.29971304535865784,0.301421582698822,0.1974359005689621,954.4815673828125,1e-05,0.1337030529975891,3.0916218757629395,81.14050197601318,2 +3329,0.13524670898914337,0.22371640801429749,0.21486110985279083,0.16480186581611633,873.2015991210938,1e-05,0.11575968563556671,3.2991626262664795,81.14050197601318,2 +3330,0.3589121401309967,0.21143002808094025,0.2084069848060608,0.10559440404176712,727.9061279296875,1e-05,0.14855369925498962,3.4100630283355713,81.14050197601318,2 +3331,0.18721376359462738,0.17671117186546326,0.17695991694927216,0.24125874042510986,948.4158325195312,1e-05,0.14087770879268646,3.1126561164855957,81.14050197601318,2 +3332,0.226732075214386,0.24972863495349884,0.24665877223014832,0.225874125957489,913.2542724609375,1e-05,0.16727307438850403,3.078157424926758,81.14050197601318,2 +3333,0.27200958132743835,0.5115710496902466,0.5232210755348206,0.19114218652248383,997.6233520507812,1e-05,0.12498508393764496,2.83732008934021,81.14050197601318,2 +3334,0.29920047521591187,0.16750530898571014,0.18249855935573578,0.1895104944705963,859.223388671875,1e-05,0.16685523092746735,3.273483991622925,81.14050197601318,2 +3335,0.2700710892677307,0.5346575975418091,0.537181556224823,0.1426573395729065,183.10153198242188,1e-05,0.14314527809619904,3.0743744373321533,81.14050197601318,2 +3336,0.21432819962501526,0.14962773025035858,0.16163678467273712,0.16083915531635284,746.3303833007812,1e-05,0.13218648731708527,3.132936954498291,81.14050197601318,2 +3337,0.2682749927043915,0.12821485102176666,0.13014517724514008,0.10093239694833755,622.5833740234375,1e-05,0.16551242768764496,3.1032772064208984,81.14050197601318,2 +3338,0.17048612236976624,0.2311294823884964,0.22731748223304749,0.23799534142017365,950.1903076171875,1e-05,0.1298803836107254,3.1278481483459473,81.14050197601318,2 +3339,0.12580902874469757,0.1372794806957245,0.12622399628162384,0.24428904056549072,787.3915405273438,1e-05,0.17502711713314056,2.830709218978882,81.14050197601318,2 +3340,0.4041476249694824,0.2675429880619049,0.2564173936843872,0.22004662454128265,686.5575561523438,1e-05,0.21211984753608704,3.310439109802246,81.14050197601318,2 +3341,0.2843608856201172,0.3887159526348114,0.41277098655700684,0.1958041936159134,238.46560668945312,1e-05,0.15867140889167786,3.095914840698242,81.14050197601318,2 +3342,0.15604032576084137,0.22916503250598907,0.22630015015602112,0.2426573485136032,966.2316284179688,1e-05,0.1488020271062851,3.1012208461761475,81.14050197601318,2 +3343,0.2306840717792511,0.2700759470462799,0.2564234733581543,0.2601398527622223,870.5208129882812,1e-05,0.19913050532341003,3.4093830585479736,81.14050197601318,2 +3344,0.42017197608947754,0.15405184030532837,0.15962645411491394,0.1762237697839737,772.7371215820312,1e-05,0.1333674043416977,2.818551540374756,81.14050197601318,2 +3345,0.1577654629945755,0.17531470954418182,0.18089862167835236,0.21235431730747223,553.0419311523438,1e-05,0.13748767971992493,3.1041836738586426,81.14050197601318,2 +3346,0.2944529950618744,0.2889091372489929,0.2847699224948883,0.17972028255462646,397.1928405761719,1e-05,0.1250874400138855,3.1031882762908936,81.14050197601318,2 +3347,0.1902349889278412,0.12498877942562103,0.1371975541114807,0.15337994694709778,882.9913330078125,1e-05,0.1525079309940338,3.2732279300689697,81.14050197601318,2 +3348,0.40579667687416077,0.23416045308113098,0.21977153420448303,0.1734265685081482,728.9754028320312,1e-05,0.18295066058635712,3.5804286003112793,81.14050197601318,2 +3349,0.15993908047676086,0.23140224814414978,0.21514354646205902,0.23286713659763336,929.1331176757812,1e-05,0.1744774729013443,3.0700364112854004,81.14050197601318,2 +3350,0.15037097036838531,0.21193920075893402,0.2221277952194214,0.07668997347354889,983.178466796875,1e-05,0.12592089176177979,2.8348844051361084,81.14050197601318,2 +3351,0.21755394339561462,0.19271080195903778,0.18602731823921204,0.12121211737394333,804.4718627929688,1e-05,0.14411135017871857,3.028437376022339,81.14050197601318,2 +3352,0.255526602268219,0.22169451415538788,0.24443481862545013,0.1354312300682068,986.6468505859375,1e-05,0.1311962604522705,3.062120199203491,81.14050197601318,2 +3353,0.2304464876651764,0.12326744198799133,0.12503182888031006,0.23752914369106293,670.3726196289062,1e-05,0.14974530041217804,3.40995192527771,81.14050197601318,2 +3354,0.2645411193370819,0.12565025687217712,0.12168314307928085,0.1298368275165558,660.37890625,1e-05,0.1144905686378479,3.081301689147949,81.14050197601318,2 +3355,0.15432879328727722,0.19386622309684753,0.20032663643360138,0.18251748383045197,990.630615234375,1e-05,0.14769066870212555,3.1146340370178223,81.14050197601318,2 +3356,0.17288467288017273,0.15176598727703094,0.15013693273067474,0.14172494411468506,508.12554931640625,1e-05,0.14879556000232697,2.8183226585388184,81.14050197601318,2 +3357,0.1468648612499237,0.34979331493377686,0.35314667224884033,0.19720280170440674,997.6233520507812,1e-05,0.29917362332344055,3.0694069862365723,81.14050197601318,2 +3358,0.22903373837471008,0.3214728534221649,0.31415438652038574,0.24522145092487335,340.1504821777344,1e-05,0.11805051565170288,3.040783166885376,81.14050197601318,2 +3359,0.3053181767463684,0.2271801382303238,0.2347506433725357,0.17599067091941833,908.7275390625,1e-05,0.12041105329990387,3.3220582008361816,81.14050197601318,2 +3360,0.37397897243499756,0.23460683226585388,0.22320674359798431,0.225874125957489,860.688232421875,1e-05,0.1509724110364914,3.0723135471343994,81.14050197601318,2 +3361,0.13034671545028687,0.4892590641975403,0.5034624934196472,0.16969697177410126,995.9088745117188,1e-05,0.1176709532737732,3.1265816688537598,81.14050197601318,2 +3362,0.16670812666416168,0.23111571371555328,0.21909497678279877,0.20000000298023224,795.030517578125,1e-05,0.21794508397579193,2.8272743225097656,81.14050197601318,2 +3363,0.19375428557395935,0.23026813566684723,0.21049119532108307,0.20815850794315338,892.831298828125,1e-05,0.16912542283535004,3.0956902503967285,81.14050197601318,2 +3364,0.17582358419895172,0.2338472157716751,0.22804692387580872,0.23240093886852264,989.5532836914062,1e-05,0.18812036514282227,3.078845500946045,81.14050197601318,2 +3365,0.2999539375305176,0.517164409160614,0.5428154468536377,0.26363635063171387,120.44096374511719,1e-05,0.152381032705307,3.3979604244232178,81.14050197601318,2 +3366,0.11374830454587936,0.23865459859371185,0.23340977728366852,0.23496504127979279,938.2591552734375,1e-05,0.1260804533958435,3.1207189559936523,81.14050197601318,2 +3367,0.18914659321308136,0.26065942645072937,0.2544025778770447,0.1878787875175476,895.4498291015625,1e-05,0.19278790056705475,3.1803836822509766,81.14050197601318,2 +3368,0.12153659760951996,0.23760628700256348,0.23347842693328857,0.17552447319030762,753.0517578125,1e-05,0.15043805539608002,2.8385329246520996,81.14050197601318,2 +3369,0.40001368522644043,0.7052749991416931,0.7185447812080383,0.20512820780277252,106.90462493896484,1e-05,0.19919456541538239,3.044257640838623,81.14050197601318,2 +3370,0.18969404697418213,0.25979524850845337,0.2431209832429886,0.23193472623825073,767.5730590820312,1e-05,0.13626930117607117,3.323401689529419,81.14050197601318,2 +3371,0.25534525513648987,0.16765999794006348,0.1609562337398529,0.19510489702224731,940.2321166992188,1e-05,0.13391278684139252,3.454817771911621,81.14050197601318,2 +3372,0.31921419501304626,0.27195578813552856,0.2657957375049591,0.29277390241622925,836.3575439453125,1e-05,0.1720988005399704,2.8233304023742676,81.14050197601318,2 +3373,0.21006223559379578,0.23470951616764069,0.21443024277687073,0.20163169503211975,913.5706787109375,1e-05,0.12069147825241089,3.066011428833008,81.14050197601318,2 +3374,0.2442813515663147,0.18656359612941742,0.181871697306633,0.23892773687839508,920.605224609375,1e-05,0.169852152466774,2.8246538639068604,81.14050197601318,2 +3375,0.1578093022108078,0.1352410763502121,0.14488326013088226,0.264102578163147,855.2390747070312,1e-05,0.1605532169342041,3.2946181297302246,81.14050197601318,2 +3376,0.35612308979034424,0.18779605627059937,0.18463878333568573,0.22447551786899567,892.831298828125,1e-05,0.16092035174369812,3.1158883571624756,81.14050197601318,2 +3377,0.156403586268425,0.29291296005249023,0.2907893657684326,0.04545454680919647,995.535888671875,1e-05,0.1842532455921173,3.382120132446289,81.14050197601318,2 +3378,0.2345687747001648,0.12291283160448074,0.14253714680671692,0.19137528538703918,811.3840942382812,1e-05,0.11675769090652466,2.844878673553467,81.14050197601318,2 +3379,0.22168844938278198,0.23346033692359924,0.21777735650539398,0.25314685702323914,685.2521362304688,1e-05,0.1812170445919037,3.1387529373168945,81.14050197601318,2 +3380,0.1265612542629242,0.2245623618364334,0.22003279626369476,0.10116550326347351,742.382080078125,1e-05,0.1132093295454979,3.0231924057006836,81.14050197601318,2 +3381,0.2949354946613312,0.22082512080669403,0.20014679431915283,0.20629370212554932,825.6151733398438,1e-05,0.20406503975391388,3.0838451385498047,81.14050197601318,2 +3382,0.28180280327796936,0.23072883486747742,0.2213931530714035,0.2226107269525528,938.5079956054688,1e-05,0.1424434632062912,3.425851821899414,81.14050197601318,2 +3383,0.24073591828346252,0.32726094126701355,0.31219395995140076,0.24801865220069885,797.99267578125,1e-05,0.11516379565000534,3.1446053981781006,81.14050197601318,2 +3384,0.1765267550945282,0.2339714914560318,0.23265910148620605,0.02750582806766033,745.3507080078125,1e-05,0.1318919062614441,3.057020664215088,81.14050197601318,2 +3385,0.2886079251766205,0.12719489634037018,0.13075567781925201,0.15011654794216156,673.1508178710938,1e-05,0.17600956559181213,2.8242902755737305,81.14050197601318,2 +3386,0.10310686379671097,0.2303028106689453,0.22279872000217438,0.19044288992881775,923.525634765625,1e-05,0.12633128464221954,3.052870273590088,81.14050197601318,2 +3387,0.1445048749446869,0.17583851516246796,0.1696072369813919,0.2242424190044403,896.920654296875,1e-05,0.13032136857509613,3.062598466873169,81.14050197601318,2 +3388,0.22976046800613403,0.3502826690673828,0.33758345246315,0.19976690411567688,976.5382080078125,1e-05,0.5352135300636292,3.440192461013794,81.14050197601318,2 +3389,0.11245580017566681,0.288040429353714,0.2870458960533142,0.21771562099456787,968.57763671875,1e-05,0.16416405141353607,3.156330108642578,81.14050197601318,2 +3390,0.1416633576154709,0.21623018383979797,0.19577276706695557,0.2130536139011383,830.4837646484375,1e-05,0.13099102675914764,3.0473268032073975,81.14050197601318,2 +3391,0.155660480260849,0.2613900601863861,0.24485592544078827,0.27482518553733826,965.4962768554688,1e-05,0.12373484671115875,2.8425259590148926,81.14050197601318,2 +3392,0.20925557613372803,0.18480445444583893,0.18543080985546112,0.17575757205486298,875.8281860351562,1e-05,0.15631501376628876,3.015872001647949,81.14050197601318,2 +3393,0.27015459537506104,0.3740628659725189,0.3967912197113037,0.10699300467967987,206.04872131347656,1e-05,0.1330881416797638,3.1500871181488037,81.14050197601318,2 +3394,0.12407255172729492,0.1598331332206726,0.16387556493282318,0.09696969389915466,874.9585571289062,1e-05,0.17452329397201538,3.0448358058929443,81.14050197601318,2 +3395,0.38779109716415405,0.49827295541763306,0.48325714468955994,0.24405594170093536,283.0556640625,1e-05,0.18186618387699127,3.086834192276001,81.14050197601318,2 +3396,0.16425776481628418,0.27046340703964233,0.25261980295181274,0.17482517659664154,733.1973266601562,1e-05,0.1297222375869751,3.063814163208008,81.14050197601318,2 +3397,0.1398094743490219,0.365833044052124,0.35357609391212463,0.21002331376075745,987.4890747070312,1e-05,0.14232853055000305,2.8253393173217773,81.14050197601318,2 +3398,0.13072273135185242,0.21148045361042023,0.20721833407878876,0.13426573574543,997.86474609375,1e-05,0.10926409065723419,3.0577495098114014,81.14050197601318,2 +3399,0.2808101773262024,0.2618982195854187,0.2716495990753174,0.16480186581611633,599.4783325195312,1e-05,0.1763491928577423,3.078939199447632,81.14050197601318,2 +3400,0.0950285941362381,0.36998727917671204,0.3398127257823944,0.19930069148540497,985.9375,1e-05,0.18756072223186493,3.0789711475372314,81.14050197601318,2 +3401,0.28721871972084045,0.19437135756015778,0.18813945353031158,0.2186480164527893,769.3107299804688,1e-05,0.19845111668109894,3.070361614227295,81.14050197601318,2 +3402,0.24253253638744354,0.1929914951324463,0.18646153807640076,0.13519813120365143,984.643310546875,1e-05,0.1673881560564041,3.081596851348877,81.14050197601318,2 +3403,0.1025160700082779,0.30182382464408875,0.3052780032157898,0.21958041191101074,962.4896240234375,1e-05,0.13749146461486816,3.085638999938965,81.14050197601318,2 +3404,0.14431437849998474,0.291812926530838,0.2802024483680725,0.23799534142017365,987.069091796875,1e-05,0.09531368315219879,2.8344779014587402,81.14050197601318,2 +3405,0.11714920401573181,0.1559445858001709,0.16067729890346527,0.19813519716262817,924.38623046875,1e-05,0.16847507655620575,3.1286704540252686,81.14050197601318,2 +3406,0.14083051681518555,0.16197825968265533,0.16560527682304382,0.18811188638210297,881.756103515625,1e-05,0.10935518890619278,3.0622565746307373,81.14050197601318,2 +3407,0.12861253321170807,0.211518794298172,0.21209456026554108,0.12377621978521347,850.0933227539062,1e-05,0.19955569505691528,3.099909543991089,81.14050197601318,2 +3408,0.1136498898267746,0.22605030238628387,0.21592840552330017,0.26153844594955444,902.6273193359375,1e-05,0.1908131092786789,3.0809779167175293,81.14050197601318,2 +3409,0.1558128297328949,0.24617306888103485,0.23278310894966125,0.18927739560604095,830.4837646484375,1e-05,0.15775276720523834,3.0836341381073,81.14050197601318,2 +3410,0.302803635597229,0.31247401237487793,0.3065672516822815,0.21212121844291687,417.7786560058594,1e-05,0.14822708070278168,2.8224880695343018,81.14050197601318,2 +3411,0.13288405537605286,0.3135814070701599,0.31185826659202576,0.24195803701877594,971.5481567382812,1e-05,0.11615484952926636,3.4124412536621094,81.14050197601318,2 +3412,0.1594543308019638,0.09376391023397446,0.10790278017520905,0.22400932013988495,753.992919921875,1e-05,0.10787174105644226,3.383681535720825,81.14050197601318,2 +3413,0.16564683616161346,0.222770556807518,0.2028832882642746,0.16153846681118011,874.0830688476562,1e-05,0.23496775329113007,3.0725228786468506,81.14050197601318,2 +3414,0.3386170268058777,0.34836333990097046,0.344643771648407,0.2678321599960327,952.3612670898438,1e-05,0.2092050015926361,3.123155117034912,81.14050197601318,2 +3415,0.28968504071235657,0.289590984582901,0.28025075793266296,0.18251748383045197,947.5157470703125,1e-05,0.20558691024780273,2.8233773708343506,81.14050197601318,2 +3416,0.2440987229347229,0.3239854574203491,0.3172731399536133,0.24428904056549072,969.6383056640625,1e-05,0.6168598532676697,3.063729763031006,81.14050197601318,2 +3417,0.20666386187076569,0.3732457756996155,0.36125555634498596,0.23636363446712494,955.7301025390625,1e-05,0.17027847468852997,3.114175796508789,81.14050197601318,2 +3418,0.15867000818252563,0.1874149739742279,0.19160690903663635,0.08484848588705063,944.0609741210938,1e-05,0.16372302174568176,3.3833651542663574,81.14050197601318,2 +3419,0.1909615844488144,0.3305899202823639,0.32157012820243835,0.27668997645378113,973.9156494140625,1e-05,0.1369805485010147,3.299790143966675,81.14050197601318,2 +3420,0.19289866089820862,0.18054568767547607,0.18157827854156494,0.19650349020957947,962.6806640625,1e-05,0.11853741854429245,2.8371825218200684,81.14050197601318,2 +3421,0.29614824056625366,0.21470960974693298,0.20456521213054657,0.26923078298568726,875.3941650390625,1e-05,0.17226380109786987,3.0048232078552246,81.14050197601318,2 +3422,0.36412933468818665,0.23833036422729492,0.23828162252902985,0.19393938779830933,818.01220703125,1e-05,0.20027466118335724,2.829169988632202,81.14050197601318,2 +3423,0.24799200892448425,0.43685969710350037,0.45394548773765564,0.08484848588705063,238.46560668945312,1e-05,0.1296650916337967,3.156261920928955,81.14050197601318,2 +3424,0.23849979043006897,0.21672563254833221,0.2048376053571701,0.14219114184379578,779.4003295898438,1e-05,0.2073342651128769,3.4088523387908936,81.14050197601318,2 +3425,0.1590854972600937,0.20289333164691925,0.21503564715385437,0.1750582754611969,947.9669189453125,1e-05,0.4771052598953247,3.3347151279449463,81.14050197601318,2 +3426,0.35615354776382446,0.24916169047355652,0.2510506510734558,0.1850815862417221,278.3217468261719,1e-05,0.1431325525045395,2.8388445377349854,81.14050197601318,2 +3427,0.1745731085538864,0.28165605664253235,0.28065142035484314,0.17156177759170532,931.025634765625,1e-05,0.11599795520305634,3.0565664768218994,81.14050197601318,2 +3428,0.24243302643299103,0.22486014664173126,0.21368303894996643,0.1414918452501297,873.2015991210938,1e-05,0.12204501032829285,3.165781021118164,81.14050197601318,2 +3429,0.2707177996635437,0.21254658699035645,0.2035674750804901,0.12890443205833435,845.8379516601562,1e-05,0.14314983785152435,3.0766358375549316,81.14050197601318,2 +3430,0.11632202565670013,0.3494039475917816,0.33689242601394653,0.14195804297924042,991.4281005859375,1e-05,0.21896295249462128,3.3568153381347656,81.14050197601318,2 +3431,0.0835927277803421,0.08910899609327316,0.08737276494503021,0.2030303031206131,810.7058715820312,1e-05,0.11170859634876251,3.324172258377075,81.14050197601318,2 +3432,0.14126762747764587,0.18730466067790985,0.1786060482263565,0.2130536139011383,794.2818603515625,1e-05,0.12900570034980774,2.825519323348999,81.14050197601318,2 +3433,0.15654730796813965,0.2202012985944748,0.21384508907794952,0.16247086226940155,918.8137817382812,1e-05,0.3596585988998413,3.090306520462036,81.14050197601318,2 +3434,0.24233821034431458,0.3420560359954834,0.31732943654060364,0.25594404339790344,968.57763671875,1e-05,0.22715099155902863,3.119131326675415,81.14050197601318,2 +3435,0.13177619874477386,0.17329460382461548,0.17096558213233948,0.278554767370224,861.6561889648438,1e-05,0.2570582926273346,3.0826873779296875,81.14050197601318,2 +3436,0.18169249594211578,0.17459045350551605,0.16345836222171783,0.23146852850914001,819.3053588867188,1e-05,0.16494005918502808,3.3407962322235107,81.14050197601318,2 +3437,0.24493688344955444,0.21914495527744293,0.2277093529701233,0.2282051295042038,991.1632080078125,1e-05,0.16043975949287415,3.1601336002349854,81.14050197601318,2 +3438,0.2131766676902771,0.22044657170772552,0.2175896316766739,0.1958041936159134,654.4724731445312,1e-05,0.2126070261001587,2.8354625701904297,81.14050197601318,2 +3439,0.10165445506572723,0.13845880329608917,0.1399260312318802,0.26247087121009827,935.22314453125,1e-05,0.19399937987327576,3.0979576110839844,81.14050197601318,2 +3440,0.21692653000354767,0.4250892698764801,0.4268210232257843,0.19976690411567688,999.53125,1e-05,0.2671925723552704,3.130903482437134,81.14050197601318,2 +3441,0.3238281309604645,0.17351800203323364,0.18617689609527588,0.10326340049505234,464.5392150878906,1e-05,0.13542796671390533,3.078479528427124,81.14050197601318,2 +3442,0.2176894098520279,0.24188199639320374,0.24521557986736298,0.1515151560306549,417.7786560058594,1e-05,0.2227606624364853,3.360438585281372,81.14050197601318,2 +3443,0.11758787930011749,0.24030402302742004,0.24195286631584167,0.23986013233661652,885.8264770507812,1e-05,0.31309112906455994,3.3625290393829346,81.14050197601318,2 +3444,0.3411782383918762,0.1442164033651352,0.14390568435192108,0.08321678638458252,900.5198364257812,1e-05,0.12770409882068634,2.8266637325286865,81.14050197601318,2 +3445,0.24503391981124878,0.2555343806743622,0.23586219549179077,0.22727273404598236,763.1554565429688,1e-05,0.15286923944950104,3.0214309692382812,81.14050197601318,2 +3446,0.20024634897708893,0.17066965997219086,0.16919709742069244,0.14918415248394012,765.8187255859375,1e-05,0.3467220366001129,3.4050934314727783,81.14050197601318,2 +3447,0.28785768151283264,0.2130521833896637,0.2097558081150055,0.2293706238269806,640.6287231445312,1e-05,0.12706851959228516,3.1139767169952393,81.14050197601318,2 +3448,0.162030890583992,0.30309420824050903,0.30678778886795044,0.20606060326099396,967.1416625976562,1e-05,0.1618325263261795,3.318688154220581,81.14050197601318,2 +3449,0.24347808957099915,0.24154157936573029,0.26689958572387695,0.2158508151769638,961.9138793945312,1e-05,0.1791498214006424,3.097440242767334,81.14050197601318,2 +3450,0.31818708777427673,0.3057604432106018,0.29660576581954956,0.1846153885126114,979.0761108398438,1e-05,0.13531550765037537,3.1106152534484863,81.14050197601318,2 +3451,0.12999628484249115,0.13782598078250885,0.13394464552402496,0.16689977049827576,940.7190551757812,1e-05,0.15696808695793152,2.837766647338867,81.14050197601318,2 +3452,0.19760599732398987,0.09471594542264938,0.08715034276247025,0.13449883460998535,882.9913330078125,1e-05,0.3877066671848297,3.391584634780884,81.14050197601318,2 +3453,0.20308926701545715,0.23610037565231323,0.24478119611740112,0.11818181723356247,434.07476806640625,1e-05,0.15440082550048828,3.1005008220672607,81.14050197601318,2 +3454,0.14676454663276672,0.22676800191402435,0.2128138393163681,0.23892773687839508,879.2493286132812,1e-05,0.23315852880477905,3.0785396099090576,81.14050197601318,2 +3455,0.151864692568779,0.317204087972641,0.2920248806476593,0.23193472623825073,971.2042846679688,1e-05,0.11733532696962357,3.0970230102539062,81.14050197601318,2 +3456,0.22782687842845917,0.20935580134391785,0.2010105848312378,0.2599067687988281,913.5706787109375,1e-05,0.1429593563079834,3.0342555046081543,81.14050197601318,2 +3457,0.23000727593898773,0.2060430347919464,0.1882309466600418,0.2613053619861603,997.3809814453125,1e-05,0.2509680390357971,2.8290438652038574,81.14050197601318,2 +3458,0.2922521233558655,0.27745455503463745,0.2624207139015198,0.21888111531734467,795.030517578125,1e-05,0.11139783263206482,3.366631507873535,81.14050197601318,2 +3459,0.19170498847961426,0.17361682653427124,0.17004668712615967,0.10606060922145844,882.1692504882812,1e-05,0.12070222944021225,3.255575656890869,81.14050197601318,2 +3460,0.20894210040569305,0.25399187207221985,0.2575182616710663,0.23146852850914001,988.18359375,1e-05,0.13232849538326263,3.2876296043395996,81.14050197601318,2 +3461,0.26623088121414185,0.3029264807701111,0.28389015793800354,0.20489510893821716,916.3778686523438,1e-05,0.14859502017498016,3.0595486164093018,81.14050197601318,2 +3462,0.26242882013320923,0.23902103304862976,0.24399501085281372,0.20396269857883453,996.771484375,1e-05,0.12263946235179901,3.043508768081665,81.14050197601318,2 +3463,0.06862610578536987,0.24616026878356934,0.2429039478302002,0.238228440284729,966.596923828125,1e-05,0.13039004802703857,2.815232038497925,81.14050197601318,2 +3464,0.2859194874763489,0.31963491439819336,0.30409330129623413,0.23030303418636322,778.5809936523438,1e-05,0.12446467578411102,3.367295980453491,81.14050197601318,2 +3465,0.0898018479347229,0.26323673129081726,0.26200070977211,0.18111887574195862,964.940673828125,1e-05,0.14109790325164795,3.2488105297088623,81.14050197601318,2 +3466,0.19074960052967072,0.1940978467464447,0.19114939868450165,0.20955711603164673,968.3995361328125,1e-05,0.779278039932251,3.3083243370056152,81.14050197601318,2 +3467,0.24350185692310333,0.19695785641670227,0.1985570639371872,0.2410256415605545,941.926025390625,1e-05,0.13669395446777344,3.068655490875244,81.14050197601318,2 +3468,0.20051921904087067,0.2708393931388855,0.25395718216896057,0.2613053619861603,858.2379760742188,1e-05,0.14446227252483368,3.0957236289978027,81.14050197601318,2 +3469,0.20931625366210938,0.20384803414344788,0.1990036815404892,0.24195803701877594,768.4440307617188,1e-05,0.12699998915195465,3.052023410797119,81.14050197601318,2 +3470,0.3372143507003784,0.24239157140254974,0.24482686817646027,0.18298368155956268,534.9400024414062,1e-05,0.13913775980472565,3.140340805053711,81.14050197601318,2 +3471,0.24688585102558136,0.5262524485588074,0.5381386876106262,0.22447551786899567,100.0000228881836,1e-05,0.15939104557037354,3.271294355392456,81.14050197601318,2 +3472,0.1403350830078125,0.19464203715324402,0.19779710471630096,0.2433566451072693,958.17578125,1e-05,0.2557782232761383,3.3269238471984863,81.14050197601318,2 +3473,0.19411516189575195,0.15757235884666443,0.14946870505809784,0.262937068939209,704.0678100585938,1e-05,0.3908255398273468,3.0477449893951416,81.14050197601318,2 +3474,0.15409906208515167,0.21347171068191528,0.19745248556137085,0.22750583291053772,842.5615844726562,1e-05,0.13222640752792358,3.0900394916534424,81.14050197601318,2 +3475,0.19752579927444458,0.2368178367614746,0.23391622304916382,0.1090909093618393,969.8138427734375,1e-05,0.370291143655777,3.073460817337036,81.14050197601318,3 +3476,0.13075275719165802,0.26927101612091064,0.2612519860267639,0.24685314297676086,966.2316284179688,1e-05,0.14346134662628174,3.0695509910583496,81.14050197601318,3 +3477,0.2359047830104828,0.2911232113838196,0.28895261883735657,0.21328671276569366,990.228515625,1e-05,0.14006711542606354,3.330212116241455,81.14050197601318,3 +3478,0.31559956073760986,0.19732367992401123,0.20124021172523499,0.09696969389915466,586.15087890625,1e-05,0.1661251336336136,3.098278760910034,81.14050197601318,3 +3479,0.2266833335161209,0.3437640070915222,0.3306196630001068,0.2198135256767273,997.86474609375,1e-05,0.17154347896575928,2.815565824508667,81.14050197601318,3 +3480,0.16961242258548737,0.16805250942707062,0.1620929092168808,0.12097901850938797,908.0657348632812,1e-05,0.14513064920902252,3.0272011756896973,81.14050197601318,3 +3481,0.22309589385986328,0.2752518951892853,0.26708343625068665,0.2596736550331116,843.6619262695312,1e-05,0.13789507746696472,3.048074960708618,81.14050197601318,3 +3482,0.29882773756980896,0.2192487120628357,0.22069798409938812,0.18694639205932617,976.0529174804688,1e-05,0.2614437937736511,3.041651487350464,81.14050197601318,3 +3483,0.26566773653030396,0.19132886826992035,0.18813791871070862,0.2293706238269806,731.0974731445312,1e-05,0.13803432881832123,3.391969680786133,81.14050197601318,3 +3484,0.1035725399851799,0.1995110660791397,0.2007003128528595,0.21678321063518524,920.0114135742188,1e-05,0.11728601902723312,3.2493913173675537,81.14050197601318,3 +3485,0.09514155983924866,0.2040952891111374,0.22419427335262299,0.16200466454029083,976.3768310546875,1e-05,0.11718486249446869,3.083031177520752,81.14050197601318,3 +3486,0.2844100296497345,0.30023759603500366,0.3043302297592163,0.22074592113494873,964.0061645507812,1e-05,0.23446278274059296,2.8357481956481934,81.14050197601318,3 +3487,0.31168997287750244,0.15283021330833435,0.1625196486711502,0.17202797532081604,940.4759521484375,1e-05,0.42743948101997375,3.08801007270813,81.14050197601318,3 +3488,0.19697611033916473,0.20285022258758545,0.19587376713752747,0.2242424190044403,939.2506103515625,1e-05,0.11411777883768082,3.374901056289673,81.14050197601318,3 +3489,0.09379251301288605,0.20734301209449768,0.19864298403263092,0.15804195404052734,898.7340087890625,1e-05,0.2506040334701538,3.0701231956481934,81.14050197601318,3 +3490,0.2078896015882492,0.5365490913391113,0.5172248482704163,0.17575757205486298,988.8717041015625,1e-05,0.826804518699646,3.3159310817718506,81.14050197601318,3 +3491,0.11116325110197067,0.23171165585517883,0.22270332276821136,0.07738927751779556,976.2150268554688,1e-05,0.18502122163772583,3.010725736618042,81.14050197601318,3 +3492,0.24826955795288086,0.20286951959133148,0.19725245237350464,0.23729602992534637,799.454345703125,1e-05,0.1245063990354538,2.81242036819458,81.14050197601318,3 +3493,0.14138968288898468,0.27505195140838623,0.27128079533576965,0.06480186432600021,996.4030151367188,1e-05,0.09817846119403839,3.118849515914917,81.14050197601318,3 +3494,0.23799598217010498,0.08928633481264114,0.09029705077409744,0.2717948853969574,759.5440063476562,1e-05,0.16203755140304565,3.486421823501587,81.14050197601318,3 +3495,0.27675676345825195,0.573860228061676,0.6001003384590149,0.127505823969841,113.7176742553711,1e-05,0.12725117802619934,3.3282241821289062,81.14050197601318,3 +3496,0.22493976354599,0.20074103772640228,0.18583297729492188,0.2818181812763214,815.3939208984375,1e-05,0.12860238552093506,3.0091495513916016,81.14050197601318,3 +3497,0.12906044721603394,0.43093982338905334,0.4573498070240021,0.2566433548927307,986.221923828125,1e-05,0.15736478567123413,3.0270438194274902,81.14050197601318,3 +3498,0.37712886929512024,0.22062546014785767,0.19821417331695557,0.09044288843870163,961.334228515625,1e-05,0.13061313331127167,2.824090003967285,81.14050197601318,3 +3499,0.22430379688739777,0.2147679179906845,0.22420522570610046,0.19230769574642181,630.94677734375,1e-05,0.1587660163640976,3.326794147491455,81.14050197601318,3 +3500,0.31425410509109497,0.14657747745513916,0.15929950773715973,0.21351981163024902,910.0397338867188,1e-05,0.31114035844802856,3.3022165298461914,81.14050197601318,3 +3501,0.21433906257152557,0.20899538695812225,0.20842118561267853,0.23030303418636322,933.1463012695312,1e-05,0.1590466946363449,3.3572285175323486,81.14050197601318,3 +3502,0.2510446608066559,0.2113068699836731,0.2050023376941681,0.2142191082239151,835.7803955078125,1e-05,0.13506384193897247,3.1121208667755127,81.14050197601318,3 +3503,0.21265794336795807,0.3304697275161743,0.33355873823165894,0.16573426127433777,993.6402587890625,1e-05,0.15088503062725067,3.454925298690796,81.14050197601318,3 +3504,0.1640768200159073,0.2897167503833771,0.30984610319137573,0.1258741319179535,995.4110107421875,1e-05,0.1169482171535492,2.8083178997039795,81.14050197601318,3 +3505,0.2224014550447464,0.1817227154970169,0.18633489310741425,0.10885781049728394,557.397705078125,1e-05,0.12037137895822525,3.0915982723236084,81.14050197601318,3 +3506,0.2556193172931671,0.24090547859668732,0.24849176406860352,0.2214452177286148,992.3473510742188,1e-05,0.5610865950584412,3.462766170501709,81.14050197601318,3 +3507,0.17226441204547882,0.3821410536766052,0.36519724130630493,0.24708624184131622,996.5260620117188,1e-05,0.1515553742647171,3.08662748336792,81.14050197601318,3 +3508,0.24642519652843475,0.20543473958969116,0.197178453207016,0.2242424190044403,842.00830078125,1e-05,0.12646758556365967,3.1245498657226562,81.14050197601318,3 +3509,0.21542493999004364,0.3581089377403259,0.3580969274044037,0.20536130666732788,998.7031860351562,1e-05,0.11652908474206924,3.3460209369659424,81.14050197601318,3 +3510,0.13039439916610718,0.32121312618255615,0.3098439872264862,0.22797203063964844,974.7445068359375,1e-05,0.11981932818889618,2.83120059967041,81.14050197601318,3 +3511,0.209410160779953,0.2579461634159088,0.26326215267181396,0.21002331376075745,956.9613647460938,1e-05,0.17984476685523987,3.113990306854248,81.14050197601318,3 +3512,0.1720317304134369,0.12624166905879974,0.1352863907814026,0.2158508151769638,922.3670654296875,1e-05,0.13917189836502075,3.3821184635162354,81.14050197601318,3 +3513,0.2677442729473114,0.2854630947113037,0.2941844165325165,0.14848484098911285,238.46560668945312,1e-05,0.14792226254940033,3.1308023929595947,81.14050197601318,3 +3514,0.21418888866901398,0.25556281208992004,0.26261261105537415,0.22727273404598236,996.4030151367188,1e-05,0.11343678832054138,3.1177263259887695,81.14050197601318,3 +3515,0.2841092050075531,0.19548510015010834,0.1980472058057785,0.11142191290855408,866.3948974609375,1e-05,0.1472620815038681,3.5150065422058105,81.14050197601318,3 +3516,0.17740854620933533,0.20236258208751678,0.19038768112659454,0.2102564126253128,608.6077880859375,1e-05,0.17610225081443787,2.9046061038970947,81.14050197601318,3 +3517,0.3200222849845886,0.15830862522125244,0.15607865154743195,0.24195803701877594,864.0462646484375,1e-05,0.13082456588745117,2.832397699356079,81.14050197601318,3 +3518,0.20180653035640717,0.4590322971343994,0.4416148066520691,0.2780885696411133,995.9088745117188,1e-05,0.12594181299209595,4.274332523345947,81.14050197601318,3 +3519,0.3685795068740845,0.1694798469543457,0.1539992094039917,0.20885780453681946,844.7539672851562,1e-05,0.13041043281555176,3.1163864135742188,81.14050197601318,3 +3520,0.20836666226387024,0.2836855351924896,0.2762889266014099,0.21888111531734467,995.6604614257812,1e-05,0.14113907516002655,3.4090404510498047,81.14050197601318,3 +3521,0.3956243097782135,0.3406926095485687,0.3234073221683502,0.22494173049926758,263.79840087890625,1e-05,0.2649270296096802,3.0782575607299805,81.14050197601318,3 +3522,0.22464144229888916,0.21874365210533142,0.20426295697689056,0.16293705999851227,804.4718627929688,1e-05,0.1350477933883667,3.3011112213134766,81.14050197601318,3 +3523,0.0637107864022255,0.15155737102031708,0.14990444481372833,0.2242424190044403,995.9088745117188,1e-05,0.2507963180541992,2.8392910957336426,81.14050197601318,3 +3524,0.2914612293243408,0.27093377709388733,0.26285916566848755,0.24638694524765015,871.8681030273438,1e-05,0.3790723979473114,3.1303796768188477,81.14050197601318,3 +3525,0.19065722823143005,0.2121729999780655,0.20966525375843048,0.22167831659317017,797.99267578125,1e-05,0.13414907455444336,3.3940577507019043,81.14050197601318,3 +3526,0.17381639778614044,0.2988390028476715,0.30432698130607605,0.10163170099258423,986.787841796875,1e-05,0.2349449247121811,3.064119815826416,81.14050197601318,3 +3527,0.2653840482234955,0.18977712094783783,0.1796804517507553,0.2198135256767273,829.2810668945312,1e-05,0.15570765733718872,3.0817642211914062,81.14050197601318,3 +3528,0.31440043449401855,0.2058754563331604,0.20194639265537262,0.2158508151769638,948.4158325195312,1e-05,0.17807844281196594,3.1758975982666016,81.14050197601318,3 +3529,0.31661704182624817,0.18688498437404633,0.18844155967235565,0.17855477333068848,748.2748413085938,1e-05,0.28749725222587585,3.18229341506958,81.14050197601318,3 +3530,0.16915644705295563,0.3610227704048157,0.3649768829345703,0.12937062978744507,995.4110107421875,1e-05,0.19722387194633484,3.427595376968384,81.14050197601318,3 +3531,0.2901533246040344,0.2913696765899658,0.27975064516067505,0.20815850794315338,570.0819702148438,1e-05,0.22261878848075867,3.1515109539031982,81.14050197601318,3 +3532,0.1603531688451767,0.352260947227478,0.3430226445198059,0.2613053619861603,961.14013671875,1e-05,0.12977798283100128,3.2123796939849854,81.14050197601318,3 +3533,0.22704684734344482,0.2331959754228592,0.2285861372947693,0.23496504127979279,930.7574462890625,1e-05,0.1621745228767395,3.72440767288208,81.14050197601318,3 +3534,0.3127347528934479,0.24866235256195068,0.24869303405284882,0.22960372269153595,470.316650390625,1e-05,0.1588987559080124,5.929960250854492,81.14050197601318,3 +3535,0.15925323963165283,0.14065119624137878,0.138092041015625,0.12097901850938797,838.6439208984375,1e-05,0.2565476894378662,5.9653849601745605,81.14050197601318,3 +3536,0.24865373969078064,0.3399208188056946,0.3278346061706543,0.1762237697839737,994.7838134765625,1e-05,0.21210722625255585,5.973349332809448,81.14050197601318,3 +3537,0.22464539110660553,0.21817727386951447,0.21169783174991608,0.1906759887933731,732.1500854492188,1e-05,0.2199007123708725,5.977510690689087,81.14050197601318,3 +3538,0.19303224980831146,0.3621997833251953,0.3391699194908142,0.250582754611969,981.8353881835938,1e-05,0.11601371318101883,6.112500190734863,81.14050197601318,3 +3539,0.16302481293678284,0.35903915762901306,0.35443970561027527,0.1890442818403244,999.0592651367188,1e-05,0.10322354733943939,6.004758834838867,81.14050197601318,3 +3540,0.07845953106880188,0.1559160202741623,0.15047991275787354,0.2337995320558548,893.5853271484375,1e-05,0.10621451586484909,5.756135940551758,81.14050197601318,3 +3541,0.34716832637786865,0.2876095175743103,0.2818768322467804,0.19930069148540497,957.3680419921875,1e-05,0.12118395417928696,4.920395135879517,81.14050197601318,3 +3542,0.2670041620731354,0.19968704879283905,0.19224950671195984,0.1862470805644989,823.121826171875,1e-05,0.21098966896533966,3.130197286605835,81.14050197601318,3 +3543,0.24552787840366364,0.31148871779441833,0.3145361840724945,0.2610722482204437,998.1053466796875,1e-05,0.15142516791820526,3.04876971244812,81.14050197601318,3 +3544,0.24374614655971527,0.17830422520637512,0.1786634773015976,0.1818181872367859,671.7659301757812,1e-05,0.11746460199356079,3.112504482269287,81.14050197601318,3 +3545,0.17944921553134918,0.1393851935863495,0.14962138235569,0.2482517510652542,879.2493286132812,1e-05,0.14156214892864227,3.3442976474761963,81.14050197601318,3 +3546,0.2036934643983841,0.09863797575235367,0.10644903779029846,0.14568763971328735,954.6907958984375,1e-05,0.14173753559589386,2.8417892456054688,81.14050197601318,3 +3547,0.1406598538160324,0.2805005609989166,0.2688184082508087,0.23706293106079102,927.482421875,1e-05,0.15691633522510529,3.4125688076019287,81.14050197601318,3 +3548,0.18615630269050598,0.25340741872787476,0.26145339012145996,0.1738927662372589,980.9265747070312,1e-05,0.122153639793396,3.1804916858673096,81.14050197601318,3 +3549,0.1784108281135559,0.1455003321170807,0.15187296271324158,0.24405594170093536,911.3367309570312,1e-05,0.10949834436178207,3.104099988937378,81.14050197601318,3 +3550,0.30519580841064453,0.3371610939502716,0.3204866945743561,0.23636363446712494,933.9302368164062,1e-05,0.153253972530365,3.093407154083252,81.14050197601318,3 +3551,0.264986127614975,0.18595825135707855,0.19081324338912964,0.2130536139011383,826.2322387695312,1e-05,0.3291192650794983,3.412966251373291,81.14050197601318,3 +3552,0.3165905177593231,0.271157443523407,0.2906847298145294,0.1990675926208496,988.32177734375,1e-05,0.12762047350406647,2.9100306034088135,81.14050197601318,3 +3553,0.21069952845573425,0.15335072576999664,0.1493019461631775,0.19440560042858124,851.1375732421875,1e-05,0.34616586565971375,3.3829185962677,81.14050197601318,3 +3554,0.2092796266078949,0.40293389558792114,0.4002957046031952,0.2265734225511551,996.4030151367188,1e-05,0.18004661798477173,3.4447033405303955,81.14050197601318,3 +3555,0.25703713297843933,0.26501551270484924,0.2641009986400604,0.26037296652793884,981.0787963867188,1e-05,0.1410902440547943,2.87272047996521,81.14050197601318,3 +3556,0.15349799394607544,0.3032766580581665,0.28771471977233887,0.2102564126253128,922.947998046875,1e-05,0.20816169679164886,3.3272616863250732,81.14050197601318,3 +3557,0.23941639065742493,0.06573162972927094,0.0749199390411377,0.13496503233909607,909.7130737304688,1e-05,0.4157581627368927,3.982652425765991,81.14050197601318,3 +3558,0.12079459428787231,0.4227038025856018,0.4086833894252777,0.23333333432674408,994.9097900390625,1e-05,0.12487450242042542,2.900424003601074,81.14050197601318,3 +3559,0.35296082496643066,0.18417978286743164,0.1974538266658783,0.1946386992931366,588.0953979492188,1e-05,1.3721200227737427,3.466202974319458,81.14050197601318,3 +3560,0.2385234385728836,0.19199113547801971,0.1887248307466507,0.14335663616657257,864.9906616210938,1e-05,0.16770507395267487,3.082834482192993,81.14050197601318,3 +3561,0.23994137346744537,0.20091909170150757,0.19139349460601807,0.20792540907859802,877.5501708984375,1e-05,0.13488784432411194,3.1971983909606934,81.14050197601318,3 +3562,0.20014813542366028,0.26144108176231384,0.2681174874305725,0.21445220708847046,978.134033203125,1e-05,0.17018289864063263,2.863513231277466,81.14050197601318,3 +3563,0.1534271389245987,0.22819846868515015,0.22145432233810425,0.24289044737815857,956.3478393554688,1e-05,0.17965607345104218,4.128701448440552,81.14050197601318,3 +3564,0.17212504148483276,0.12300983816385269,0.13577933609485626,0.1934731900691986,719.1432495117188,1e-05,0.13917309045791626,3.6120781898498535,81.14050197601318,3 +3565,0.09858658164739609,0.3126510679721832,0.3003547489643097,0.22004662454128265,983.6209716796875,1e-05,0.15712140500545502,3.5571272373199463,81.14050197601318,3 +3566,0.20140035450458527,0.19179955124855042,0.1803007274866104,0.14755244553089142,933.4083862304688,1e-05,0.1640331894159317,3.0456840991973877,81.14050197601318,3 +3567,0.38316023349761963,0.25501570105552673,0.2565520405769348,0.23240093886852264,455.6820373535156,1e-05,0.22613850235939026,3.073058605194092,81.14050197601318,3 +3568,0.1650540679693222,0.18556122481822968,0.17790035903453827,0.25081583857536316,830.4837646484375,1e-05,0.2208143025636673,2.9968132972717285,81.14050197601318,3 +3569,0.19348877668380737,0.14184382557868958,0.15201158821582794,0.15034964680671692,938.5079956054688,1e-05,0.16799327731132507,3.138150453567505,81.14050197601318,3 +3570,0.16196945309638977,0.2238760143518448,0.217177614569664,0.2461538463830948,775.2649536132812,1e-05,0.18154694139957428,3.125066041946411,81.14050197601318,3 +3571,0.14610184729099274,0.14793534576892853,0.14421361684799194,0.22610722482204437,916.0694580078125,1e-05,0.12852083146572113,3.423078775405884,81.14050197601318,3 +3572,0.13762645423412323,0.16938422620296478,0.18730072677135468,0.20955711603164673,972.5713500976562,1e-05,0.10896514356136322,3.105189085006714,81.14050197601318,3 +3573,0.15577249228954315,0.2087830752134323,0.1912984549999237,0.2666666805744171,928.31103515625,1e-05,0.1827116757631302,3.165642261505127,81.14050197601318,3 +3574,0.22583961486816406,0.24991475045681,0.25578150153160095,0.14102564752101898,998.7031860351562,1e-05,0.1341090053319931,3.1363961696624756,81.14050197601318,3 +3575,0.2422254979610443,0.14717085659503937,0.1407327950000763,0.2242424190044403,740.3775634765625,1e-05,0.12012910842895508,3.6967005729675293,81.14050197601318,3 +3576,0.15529334545135498,0.1717311143875122,0.17904208600521088,0.23356643319129944,978.9199829101562,1e-05,0.1943427473306656,3.0978386402130127,81.14050197601318,3 +3577,0.24651390314102173,0.1440419703722,0.14935031533241272,0.10000000149011612,853.715087890625,1e-05,0.12728744745254517,3.1938774585723877,81.14050197601318,3 +3578,0.15303178131580353,0.19159133732318878,0.18765293061733246,0.1846153885126114,920.3087768554688,1e-05,0.1329633742570877,3.1931827068328857,81.14050197601318,3 +3579,0.24270762503147125,0.19973686337471008,0.18281395733356476,0.1958041936159134,828.0687866210938,1e-05,0.13909022510051727,3.207045555114746,81.14050197601318,3 +3580,0.2839486002922058,0.3077477514743805,0.29772573709487915,0.23729602992534637,700.4320068359375,1e-05,0.23823966085910797,3.2427146434783936,81.14050197601318,3 +3581,0.12332317233085632,0.21948641538619995,0.2280430942773819,0.15897436439990997,992.477783203125,1e-05,0.20394743978977203,3.1014795303344727,81.14050197601318,3 +3582,0.36184749007225037,0.05299665778875351,0.05625974014401436,0.06223776191473007,634.2159423828125,1e-05,0.17460763454437256,3.1420679092407227,81.14050197601318,3 +3583,0.16071461141109467,0.23090218007564545,0.2229340672492981,0.21351981163024902,767.5730590820312,1e-05,0.16129763424396515,3.1112711429595947,81.14050197601318,3 +3584,0.18637815117835999,0.22980473935604095,0.21175377070903778,0.16153846681118011,627.6343994140625,1e-05,0.14068639278411865,3.1174426078796387,81.14050197601318,3 +3585,0.1875154674053192,0.2392003983259201,0.22346098721027374,0.2337995320558548,679.9532470703125,1e-05,0.17993582785129547,3.055577516555786,81.14050197601318,3 +3586,0.14701977372169495,0.19307805597782135,0.18816493451595306,0.13939394056797028,705.2662353515625,1e-05,0.10821811109781265,3.175230026245117,81.14050197601318,3 +3587,0.22335661947727203,0.12159258127212524,0.1219269186258316,0.22913752496242523,904.0114135742188,1e-05,0.14740680158138275,3.286144733428955,81.14050197601318,3 +3588,0.20451533794403076,0.3137873411178589,0.30775895714759827,0.18974359333515167,356.2078552246094,1e-05,0.14855913817882538,3.5437276363372803,81.14050197601318,3 +3589,0.15423235297203064,0.16724713146686554,0.17599965631961823,0.23869463801383972,922.657958984375,1e-05,0.13085928559303284,3.1716806888580322,81.14050197601318,3 +3590,0.16819366812705994,0.1846957951784134,0.17637835443019867,0.20606060326099396,948.4158325195312,1e-05,0.13878919184207916,3.454857349395752,81.14050197601318,3 +3591,0.13055512309074402,0.1250661313533783,0.12614618241786957,0.26317015290260315,883.8079833984375,1e-05,0.15485869348049164,2.9895880222320557,81.14050197601318,3 +3592,0.15184937417507172,0.25185105204582214,0.23538492619991302,0.22004662454128265,949.9702758789062,1e-05,0.14260607957839966,4.629105567932129,81.14050197601318,3 +3593,0.33498477935791016,0.4815703332424164,0.480383038520813,0.21445220708847046,287.737548828125,1e-05,0.11417658627033234,6.200268268585205,81.14050197601318,3 +3594,0.23753438889980316,0.49287378787994385,0.5378063917160034,0.2282051295042038,127.0761489868164,1e-05,0.11889553815126419,6.331695795059204,81.14050197601318,3 +3595,0.21613194048404694,0.2500661313533783,0.24145179986953735,0.1930069923400879,757.7117919921875,1e-05,0.13359804451465607,6.311369180679321,81.14050197601318,3 +3596,0.16748256981372833,0.3133341073989868,0.31289923191070557,0.2041957974433899,967.322509765625,1e-05,0.1372830867767334,6.473106622695923,81.14050197601318,3 +3597,0.22453510761260986,0.17027443647384644,0.17314712703227997,0.2589743435382843,974.9092407226562,1e-05,0.12844879925251007,6.121693134307861,81.14050197601318,3 +3598,0.2143625169992447,0.20920723676681519,0.1989058554172516,0.22727273404598236,727.9061279296875,1e-05,0.15549993515014648,6.367790937423706,81.14050197601318,3 +3599,0.1076526865363121,0.20829692482948303,0.2044697403907776,0.20233100652694702,972.0613403320312,1e-05,0.18564444780349731,6.307113885879517,81.14050197601318,3 +3600,0.3183828592300415,0.43866291642189026,0.43395453691482544,0.2354312390089035,268.69403076171875,1e-05,0.14781568944454193,3.435521125793457,81.14050197601318,3 +3601,0.22137226164340973,0.131504625082016,0.13247047364711761,0.2433566451072693,657.4439697265625,1e-05,0.5755500197410583,3.0516321659088135,81.14050197601318,3 +3602,0.26582634449005127,0.08617418259382248,0.08738312125205994,0.1291375309228897,612.1727294921875,1e-05,0.1845397800207138,3.0909926891326904,81.14050197601318,3 +3603,0.2063709944486618,0.24628204107284546,0.23863404989242554,0.2226107269525528,937.0054321289062,1e-05,0.13900698721408844,2.841804027557373,81.14050197601318,3 +3604,0.3180936574935913,0.3912305533885956,0.3974476158618927,0.13962703943252563,310.39483642578125,1e-05,0.11086208373308182,3.3074216842651367,81.14050197601318,3 +3605,0.24185895919799805,0.2666889727115631,0.24589823186397552,0.25641024112701416,908.7275390625,1e-05,0.1088392585515976,3.095277786254883,81.14050197601318,3 +3606,0.16576215624809265,0.1866379827260971,0.17437012493610382,0.2209790199995041,868.2445068359375,1e-05,0.21716782450675964,3.2205207347869873,81.14050197601318,3 +3607,0.362694650888443,0.3440340757369995,0.3444811999797821,0.1682983636856079,972.9094848632812,1e-05,0.1592635214328766,3.2861685752868652,81.14050197601318,3 +3608,0.29303908348083496,0.1893918812274933,0.1804005354642868,0.0643356665968895,724.6637573242188,1e-05,0.11778698116540909,3.3100273609161377,81.14050197601318,3 +3609,0.2403470277786255,0.5101757645606995,0.5171875357627869,0.12680652737617493,140.08938598632812,1e-05,0.127915158867836,2.8427586555480957,81.14050197601318,3 +3610,0.18150880932807922,0.14404131472110748,0.13453304767608643,0.2114219069480896,822.4921875,1e-05,0.20478665828704834,3.4137604236602783,81.14050197601318,3 +3611,0.17704685032367706,0.17563390731811523,0.19222824275493622,0.16480186581611633,976.2150268554688,1e-05,0.136672705411911,3.16930890083313,81.14050197601318,3 +3612,0.15749035775661469,0.18555037677288055,0.19909445941448212,0.20279720425605774,954.4815673828125,1e-05,0.11225827783346176,3.175774574279785,81.14050197601318,3 +3613,0.11271556466817856,0.1776164025068283,0.18375246226787567,0.20885780453681946,728.9754028320312,1e-05,0.11293292045593262,3.093748092651367,81.14050197601318,3 +3614,0.06179358810186386,0.12667547166347504,0.13905544579029083,0.21724942326545715,915.4500122070312,1e-05,0.14510394632816315,3.1446480751037598,81.14050197601318,3 +3615,0.18647128343582153,0.20404542982578278,0.19042423367500305,0.18694639205932617,781.0278930664062,1e-05,0.11773020774126053,4.108809232711792,81.14050197601318,3 +3616,0.16112753748893738,0.2609950304031372,0.25336283445358276,0.238228440284729,675.8961181640625,1e-05,0.18156802654266357,3.714996099472046,81.14050197601318,3 +3617,0.11899924278259277,0.13096186518669128,0.13927964866161346,0.22331002354621887,843.6619262695312,1e-05,0.1578499972820282,3.3478198051452637,81.14050197601318,3 +3618,0.2469760924577713,0.1819407343864441,0.18647468090057373,0.19044288992881775,947.0624389648438,1e-05,0.12037962675094604,3.12819242477417,81.14050197601318,3 +3619,0.25430619716644287,0.11734018474817276,0.11576216667890549,0.07202797383069992,771.8865966796875,1e-05,0.14080865681171417,3.2025208473205566,81.14050197601318,3 +3620,0.23000888526439667,0.25558707118034363,0.25725728273391724,0.1890442818403244,721.369140625,1e-05,0.25710418820381165,3.1818878650665283,81.14050197601318,3 +3621,0.2932920455932617,0.22207346558570862,0.20800846815109253,0.260606050491333,811.3840942382812,1e-05,0.12246989458799362,3.6405982971191406,81.14050197601318,3 +3622,0.2866188585758209,0.31685730814933777,0.3135180175304413,0.19044288992881775,478.7982177734375,1e-05,0.19928501546382904,4.158481597900391,81.14050197601318,3 +3623,0.30050167441368103,0.1931099146604538,0.1891387701034546,0.23473192751407623,642.2061767578125,1e-05,0.20372022688388824,3.9180243015289307,81.14050197601318,3 +3624,0.317796528339386,0.2744292616844177,0.2653610408306122,0.1806526780128479,970.3380126953125,1e-05,0.1438606083393097,3.0045666694641113,81.14050197601318,3 +3625,0.2609347999095917,0.1842174082994461,0.18346446752548218,0.20046620070934296,759.5440063476562,1e-05,0.17266249656677246,3.077117919921875,81.14050197601318,3 +3626,0.4168889820575714,0.5990207195281982,0.5862036943435669,0.2405594438314438,152.77052307128906,1e-05,0.12117987871170044,3.0709729194641113,81.14050197601318,3 +3627,0.20760266482830048,0.22111065685749054,0.2126988172531128,0.2298368364572525,996.64892578125,1e-05,0.11601514369249344,3.060565710067749,81.14050197601318,3 +3628,0.24584169685840607,0.2782081365585327,0.26811590790748596,0.2337995320558548,944.529052734375,1e-05,0.13725554943084717,3.0712292194366455,81.14050197601318,3 +3629,0.17714866995811462,0.15178751945495605,0.15307438373565674,0.21282051503658295,864.5192260742188,1e-05,0.13614821434020996,3.400212287902832,81.14050197601318,3 +3630,0.20186251401901245,0.3243663012981415,0.3196459412574768,0.19230769574642181,969.4624633789062,1e-05,0.11774582415819168,2.849350690841675,81.14050197601318,3 +3631,0.35704585909843445,0.28903430700302124,0.2819676101207733,0.1794871836900711,787.3915405273438,1e-05,0.11280228942632675,3.122575044631958,81.14050197601318,3 +3632,0.15052975714206696,0.19475476443767548,0.19746330380439758,0.15058274567127228,958.576904296875,1e-05,0.660766065120697,3.0550358295440674,81.14050197601318,3 +3633,0.18536847829818726,0.2058814913034439,0.19331228733062744,0.17412588000297546,443.50128173828125,1e-05,0.33281803131103516,3.0875651836395264,81.14050197601318,3 +3634,0.23513102531433105,0.22703833878040314,0.21038493514060974,0.21888111531734467,890.15478515625,1e-05,0.13380791246891022,3.3244035243988037,81.14050197601318,3 +3635,0.14928436279296875,0.19702643156051636,0.18749816715717316,0.2543123662471771,885.0230102539062,1e-05,0.23630157113075256,3.395054817199707,81.14050197601318,3 +3636,0.2801644802093506,0.13884468376636505,0.14649321138858795,0.11888112127780914,974.9092407226562,1e-05,0.14374162256717682,2.8230738639831543,81.14050197601318,3 +3637,0.07205815613269806,0.19060909748077393,0.18720704317092896,0.23729602992534637,972.231689453125,1e-05,0.1753043532371521,3.120840072631836,81.14050197601318,3 +3638,0.32756954431533813,0.3674907982349396,0.3394297659397125,0.2461538463830948,936.2454833984375,1e-05,0.14494186639785767,3.101090908050537,81.14050197601318,3 +3639,0.11693105101585388,0.18488028645515442,0.18096394836902618,0.22610722482204437,816.7084350585938,1e-05,0.12109901010990143,3.158203363418579,81.14050197601318,3 +3640,0.19992606341838837,0.16541260480880737,0.16533328592777252,0.20606060326099396,947.2893676757812,1e-05,0.11558639258146286,3.149909257888794,81.14050197601318,3 +3641,0.19224992394447327,0.2715493142604828,0.26316767930984497,0.2645687758922577,835.7803955078125,1e-05,0.11763869225978851,3.3960330486297607,81.14050197601318,3 +3642,0.15153127908706665,0.1729278564453125,0.16663126647472382,0.2114219069480896,962.4896240234375,1e-05,0.21593305468559265,2.8255903720855713,81.14050197601318,3 +3643,0.34720340371131897,0.3076205253601074,0.3182898759841919,0.25477856397628784,954.8995971679688,1e-05,0.11021903157234192,3.096522331237793,81.14050197601318,3 +3644,0.12605714797973633,0.23884308338165283,0.24635565280914307,0.23030303418636322,956.75732421875,1e-05,0.13915936648845673,3.09151554107666,81.14050197601318,3 +3645,0.10505704581737518,0.1355976164340973,0.12956707179546356,0.10279720276594162,629.2960815429688,1e-05,0.20309333503246307,3.357386589050293,81.14050197601318,3 +3646,0.21701838076114655,0.2164161652326584,0.21730360388755798,0.19370628893375397,704.0678100585938,1e-05,0.1472802311182022,3.193899154663086,81.14050197601318,3 +3647,0.2159704864025116,0.1991002857685089,0.18675801157951355,0.18694639205932617,773.583740234375,1e-05,0.2638915181159973,3.120802879333496,81.14050197601318,3 +3648,0.2980421483516693,0.27869001030921936,0.2588137984275818,0.2426573485136032,917.9066772460938,1e-05,0.11789526045322418,2.8369574546813965,81.14050197601318,3 +3649,0.13551825284957886,0.20895935595035553,0.21296216547489166,0.26363635063171387,925.8049926757812,1e-05,0.10309416055679321,3.1140434741973877,81.14050197601318,3 +3650,0.1702490746974945,0.20985308289527893,0.20879866182804108,0.2242424190044403,934.1901245117188,1e-05,0.12095391750335693,3.038118600845337,81.14050197601318,3 +3651,0.29584839940071106,0.16999727487564087,0.16923967003822327,0.15734265744686127,864.5192260742188,1e-05,0.11934937536716461,3.3487117290496826,81.14050197601318,3 +3652,0.21392525732517242,0.10467690974473953,0.09504058957099915,0.16689977049827576,816.7084350585938,1e-05,0.1381520926952362,3.3250250816345215,81.14050197601318,3 +3653,0.09968114644289017,0.254806786775589,0.24359022080898285,0.2652680575847626,997.1378173828125,1e-05,0.1284351795911789,3.1524877548217773,81.14050197601318,3 +3654,0.19867944717407227,0.2438896894454956,0.2532553970813751,0.16363635659217834,975.4014282226562,1e-05,0.15300525724887848,2.8225221633911133,81.14050197601318,3 +3655,0.116742804646492,0.2634965479373932,0.28105318546295166,0.2097902148962021,961.9138793945312,1e-05,0.14292804896831512,3.098587989807129,81.14050197601318,3 +3656,0.15401333570480347,0.22601903975009918,0.22201618552207947,0.23869463801383972,492.46246337890625,1e-05,0.12041378766298294,3.268869400024414,81.14050197601318,3 +3657,0.3699615001678467,0.27729544043540955,0.2747764587402344,0.17808857560157776,914.5143432617188,1e-05,0.12262003123760223,3.1141281127929688,81.14050197601318,3 +3658,0.1849176585674286,0.25130361318588257,0.24018236994743347,0.1627039611339569,966.04833984375,1e-05,0.11992600560188293,3.467085361480713,81.14050197601318,3 +3659,0.15706928074359894,0.22648708522319794,0.21432265639305115,0.23752914369106293,972.5713500976562,1e-05,0.10787650942802429,2.8380966186523438,81.14050197601318,3 +3660,0.2684781551361084,0.2377062886953354,0.22251716256141663,0.1930069923400879,917.2977905273438,1e-05,0.14054374396800995,2.825624704360962,81.14050197601318,3 +3661,0.24092049896717072,0.39665770530700684,0.3817954659461975,0.18391607701778412,941.445068359375,1e-05,0.1728883981704712,3.038071632385254,81.14050197601318,3 +3662,0.23200076818466187,0.21894527971744537,0.22229818999767303,0.1958041936159134,836.3575439453125,1e-05,0.11224449425935745,3.275130271911621,81.14050197601318,3 +3663,0.3394322693347931,0.2644903063774109,0.2563531696796417,0.18974359333515167,708.8218383789062,1e-05,0.12534834444522858,3.3245058059692383,81.14050197601318,3 +3664,0.22752535343170166,0.28406596183776855,0.27992749214172363,0.22634032368659973,348.26116943359375,1e-05,0.14811085164546967,3.327219009399414,81.14050197601318,3 +3665,0.24653694033622742,0.3073979318141937,0.31028425693511963,0.16643357276916504,371.6285705566406,1e-05,0.11650654673576355,2.8149642944335938,81.14050197601318,3 +3666,0.1386992633342743,0.17095762491226196,0.17844203114509583,0.2242424190044403,846.9136352539062,1e-05,0.13905228674411774,2.818474531173706,81.14050197601318,3 +3667,0.29081833362579346,0.23943209648132324,0.24048636853694916,0.145454540848732,847.9813842773438,1e-05,0.14913176000118256,3.064237117767334,81.14050197601318,3 +3668,0.22301122546195984,0.14658164978027344,0.16071464121341705,0.17016316950321198,943.5906372070312,1e-05,0.14049094915390015,3.256469249725342,81.14050197601318,3 +3669,0.35334426164627075,0.1802670657634735,0.1778050810098648,0.16923077404499054,690.4288330078125,1e-05,0.5195841789245605,3.371220111846924,81.14050197601318,3 +3670,0.26881152391433716,0.23014238476753235,0.225484237074852,0.2069930136203766,574.1869506835938,1e-05,0.11662542074918747,3.1541028022766113,81.14050197601318,3 +3671,0.15523864328861237,0.2318081110715866,0.23283343017101288,0.20116549730300903,986.6468505859375,1e-05,0.2084151953458786,2.819988965988159,81.14050197601318,3 +3672,0.21795308589935303,0.1980261206626892,0.20716896653175354,0.24708624184131622,988.18359375,1e-05,0.1171528771519661,3.044990062713623,81.14050197601318,3 +3673,0.162942036986351,0.14925429224967957,0.14637067914009094,0.08741258829832077,887.0220336914062,1e-05,0.13578733801841736,2.826721429824829,81.14050197601318,3 +3674,0.1529303789138794,0.17291657626628876,0.18004490435123444,0.13962703943252563,902.6273193359375,1e-05,0.12063945084810257,3.314575433731079,81.14050197601318,3 +3675,0.21222534775733948,0.26653721928596497,0.2486250400543213,0.2365967333316803,902.6273193359375,1e-05,0.1162622720003128,3.3513834476470947,81.14050197601318,3 +3676,0.12312506139278412,0.12615807354450226,0.13622663915157318,0.24708624184131622,935.9909057617188,1e-05,0.1297549307346344,3.132542610168457,81.14050197601318,3 +3677,0.3313193917274475,0.20297017693519592,0.19394326210021973,0.0771561786532402,774.4262084960938,1e-05,0.1584959477186203,2.830380439758301,81.14050197601318,3 +3678,0.3347717523574829,0.20976731181144714,0.21447807550430298,0.2018647938966751,953.0025024414062,1e-05,0.1344565749168396,3.033295154571533,81.14050197601318,3 +3679,0.3994772434234619,0.27943870425224304,0.2783554196357727,0.2230769246816635,671.7659301757812,1e-05,0.11910474300384521,3.0484094619750977,81.14050197601318,3 +3680,0.1502227783203125,0.26642826199531555,0.2665765881538391,0.0979020968079567,976.8599853515625,1e-05,0.1258101761341095,3.0732266902923584,81.14050197601318,3 +3681,0.17574582993984222,0.15109820663928986,0.16476893424987793,0.2282051295042038,866.3948974609375,1e-05,0.1272735297679901,3.306480646133423,81.14050197601318,3 +3682,0.2075752168893814,0.21509410440921783,0.2049347460269928,0.1818181872367859,946.8348388671875,1e-05,0.125230073928833,3.195399045944214,81.14050197601318,3 +3683,0.20948688685894012,0.27236074209213257,0.25878840684890747,0.17832167446613312,961.14013671875,1e-05,0.15616871416568756,2.8267836570739746,81.14050197601318,3 +3684,0.2872098982334137,0.3492714762687683,0.3419819176197052,0.18298368155956268,930.488525390625,1e-05,0.1382100135087967,3.0400683879852295,81.14050197601318,3 +3685,0.17589637637138367,0.3013192415237427,0.30299127101898193,0.18648017942905426,999.0592651367188,1e-05,0.11255000531673431,3.0684120655059814,81.14050197601318,3 +3686,0.19094333052635193,0.25130411982536316,0.2446071058511734,0.28671327233314514,978.7633666992188,1e-05,0.10617152601480484,3.0973310470581055,81.14050197601318,3 +3687,0.19081826508045197,0.15284205973148346,0.16611315310001373,0.15780885517597198,781.0278930664062,1e-05,0.2013753056526184,3.1192626953125,81.14050197601318,3 +3688,0.21758390963077545,0.19962981343269348,0.19686244428157806,0.12121211737394333,840.3358154296875,1e-05,0.1438833773136139,3.1287167072296143,81.14050197601318,3 +3689,0.44416192173957825,0.1790039837360382,0.17559294402599335,0.19230769574642181,795.77587890625,1e-05,0.1447412371635437,2.8275506496429443,81.14050197601318,3 +3690,0.2341272383928299,0.18165038526058197,0.1830710917711258,0.15734265744686127,730.0392456054688,1e-05,0.15129150450229645,3.0741024017333984,81.14050197601318,3 +3691,0.18374471366405487,0.2879188358783722,0.28017258644104004,0.15081584453582764,606.806884765625,1e-05,0.19050171971321106,3.0455145835876465,81.14050197601318,3 +3692,0.21608293056488037,0.1241210326552391,0.13179342448711395,0.20233100652694702,718.021240234375,1e-05,0.1210576519370079,3.1196770668029785,81.14050197601318,3 +3693,0.2581539452075958,0.25035858154296875,0.2473858743906021,0.2321678251028061,712.31884765625,1e-05,0.21094411611557007,3.378817558288574,81.14050197601318,3 +3694,0.13699430227279663,0.15610460937023163,0.15453137457370758,0.2526806592941284,921.48974609375,1e-05,0.12284066528081894,3.1028664112091064,81.14050197601318,3 +3695,0.24040792882442474,0.21533642709255219,0.19356000423431396,0.1895104944705963,928.5856323242188,1e-05,0.131267249584198,2.836735963821411,81.14050197601318,3 +3696,0.16798357665538788,0.38803496956825256,0.38059696555137634,0.26806527376174927,982.8820190429688,1e-05,0.10865362733602524,3.0561540126800537,81.14050197601318,3 +3697,0.3527035713195801,0.12060640752315521,0.1253826916217804,0.1526806503534317,819.9478759765625,1e-05,0.13504979014396667,3.050935745239258,81.14050197601318,3 +3698,0.2535761892795563,0.10759370774030685,0.1013176292181015,0.19254079461097717,787.3915405273438,1e-05,0.10833694040775299,3.3794119358062744,81.14050197601318,3 +3699,0.34074872732162476,0.32934871315956116,0.32597339153289795,0.15034964680671692,991.1632080078125,1e-05,0.4504130780696869,3.317479372024536,81.14050197601318,3 +3700,0.17710290849208832,0.14427973330020905,0.15178820490837097,0.07016316801309586,671.7659301757812,1e-05,0.149752676486969,3.0990147590637207,81.14050197601318,3 +3701,0.3977186977863312,0.2206176072359085,0.20505155622959137,0.23286713659763336,912.2996826171875,1e-05,0.1159241572022438,2.830785036087036,81.14050197601318,3 +3702,0.19756746292114258,0.21308882534503937,0.19808249175548553,0.26643356680870056,785.0322875976562,1e-05,0.11799389868974686,3.266094446182251,81.14050197601318,3 +3703,0.2941020429134369,0.2544502913951874,0.25604861974716187,0.15617716312408447,866.3948974609375,1e-05,0.16878452897071838,2.824334144592285,81.14050197601318,3 +3704,0.23537355661392212,0.6214121580123901,0.6090441942214966,0.22004662454128265,120.44096374511719,1e-05,0.11898628622293472,3.4012110233306885,81.14050197601318,3 +3705,0.11331972479820251,0.301614373922348,0.2841234505176544,0.26993006467819214,962.2981567382812,1e-05,0.3587011694908142,3.4058032035827637,81.14050197601318,3 +3706,0.2807171046733856,0.34605103731155396,0.3328230381011963,0.17529137432575226,977.1804809570312,1e-05,0.16068796813488007,3.020634412765503,81.14050197601318,3 +3707,0.25268715620040894,0.275267094373703,0.2654416263103485,0.21048951148986816,557.397705078125,1e-05,0.11236706376075745,3.1053497791290283,81.14050197601318,3 +3708,0.1174292266368866,0.15956859290599823,0.14505396783351898,0.16083915531635284,649.9450073242188,1e-05,0.12790556252002716,3.00512433052063,81.14050197601318,3 +3709,0.26115506887435913,0.589600682258606,0.5933197736740112,0.21235431730747223,158.9905548095703,1e-05,0.12642334401607513,3.131572723388672,81.14050197601318,3 +3710,0.27255040407180786,0.1870172768831253,0.1878027468919754,0.16736596822738647,960.9456176757812,1e-05,0.15686330199241638,3.145453453063965,81.14050197601318,3 +3711,0.15244919061660767,0.1340498924255371,0.12607455253601074,0.22331002354621887,872.758544921875,1e-05,0.17309921979904175,3.145740270614624,81.14050197601318,3 +3712,0.22524873912334442,0.11347832530736923,0.10543765127658844,0.16969697177410126,908.7275390625,1e-05,0.2606973946094513,3.0155959129333496,81.14050197601318,3 +3713,0.2138228565454483,0.18396659195423126,0.19518016278743744,0.12004662305116653,990.76416015625,1e-05,0.21354258060455322,3.11065411567688,81.14050197601318,3 +3714,0.27412548661231995,0.19080480933189392,0.18012917041778564,0.1874125897884369,946.1489868164062,1e-05,0.12567006051540375,3.0077061653137207,81.14050197601318,3 +3715,0.19442376494407654,0.49347639083862305,0.512069046497345,0.07645687460899353,140.08938598632812,1e-05,0.09363585710525513,3.0517990589141846,81.14050197601318,3 +3716,0.30695393681526184,0.38263487815856934,0.34117409586906433,0.23006993532180786,964.0061645507812,1e-05,0.12732644379138947,3.072383403778076,81.14050197601318,3 +3717,0.30973440408706665,0.17229297757148743,0.17648279666900635,0.1902097910642624,980.7741088867188,1e-05,0.23203562200069427,3.0854077339172363,81.14050197601318,3 +3718,0.264802485704422,0.375825971364975,0.353369802236557,0.18414919078350067,977.4996337890625,1e-05,0.1297461837530136,3.0684351921081543,81.14050197601318,3 +3719,0.19423189759254456,0.24176298081874847,0.23883642256259918,0.2557109594345093,959.3736572265625,1e-05,0.1500796228647232,3.0857861042022705,81.14050197601318,3 +3720,0.10388483107089996,0.14974947273731232,0.15913522243499756,0.19673658907413483,721.369140625,1e-05,0.17393293976783752,3.0329208374023438,81.14050197601318,3 +3721,0.22686728835105896,0.31466221809387207,0.29821258783340454,0.2601398527622223,959.966552734375,1e-05,0.13056842982769012,3.0971767902374268,81.14050197601318,3 +3722,0.26930153369903564,0.2607138752937317,0.2385069727897644,0.2130536139011383,963.0614624023438,1e-05,0.4506327509880066,3.3616280555725098,81.14050197601318,3 +3723,0.252036988735199,0.3296121656894684,0.33702322840690613,0.17972028255462646,248.77369689941406,1e-05,0.12587612867355347,3.10357666015625,81.14050197601318,3 +3724,0.3310256004333496,0.4351460039615631,0.43296775221824646,0.20815850794315338,991.8234252929688,1e-05,0.10362134128808975,3.093733549118042,81.14050197601318,3 +3725,0.20901170372962952,0.14051343500614166,0.1524074673652649,0.22004662454128265,923.2371215820312,1e-05,0.11725922673940659,3.098541498184204,81.14050197601318,3 +3726,0.08754272013902664,0.2164035141468048,0.2124416083097458,0.23356643319129944,917.6026611328125,1e-05,0.16673101484775543,3.0627782344818115,81.14050197601318,3 +3727,0.1482205092906952,0.25605279207229614,0.25656023621559143,0.1974359005689621,980.4682006835938,1e-05,0.13803647458553314,3.3774733543395996,81.14050197601318,3 +3728,0.17596179246902466,0.22190532088279724,0.1976616531610489,0.20675989985466003,934.449462890625,1e-05,0.13874557614326477,3.1536965370178223,81.14050197601318,3 +3729,0.26042866706848145,0.41577163338661194,0.4111194610595703,0.20209790766239166,367.8310546875,1e-05,0.14541447162628174,3.0471668243408203,81.14050197601318,3 +3730,0.2023782581090927,0.15863670408725739,0.1613055318593979,0.19254079461097717,877.5501708984375,1e-05,0.571226954460144,2.838031053543091,81.14050197601318,3 +3731,0.3460218906402588,0.18632113933563232,0.18419592082500458,0.1599067598581314,619.15966796875,1e-05,0.123440682888031,3.0135550498962402,81.14050197601318,3 +3732,0.2180919647216797,0.222808375954628,0.21713753044605255,0.24032634496688843,695.4873657226562,1e-05,0.1159851923584938,3.100961685180664,81.14050197601318,3 +3733,0.17822282016277313,0.27518710494041443,0.25305336713790894,0.23240093886852264,871.8681030273438,1e-05,0.11416291445493698,3.2986598014831543,81.14050197601318,3 +3734,0.16886752843856812,0.2144181728363037,0.19844798743724823,0.21958041191101074,827.4590454101562,1e-05,0.17643187940120697,3.0757076740264893,81.14050197601318,3 +3735,0.31789061427116394,0.2202187478542328,0.2172366976737976,0.1554778516292572,619.15966796875,1e-05,0.2226247638463974,3.1194067001342773,81.14050197601318,3 +3736,0.07405244559049606,0.284912109375,0.28042110800743103,0.23752914369106293,953.639404296875,1e-05,0.20713485777378082,2.8293509483337402,81.14050197601318,3 +3737,0.33002790808677673,0.23158299922943115,0.2161874771118164,0.21911421418190002,829.2810668945312,1e-05,0.15604373812675476,3.044567584991455,81.14050197601318,3 +3738,0.18401992321014404,0.22733935713768005,0.21900492906570435,0.22610722482204437,730.0392456054688,1e-05,0.13289107382297516,3.059597969055176,81.14050197601318,3 +3739,0.2938254177570343,0.22355538606643677,0.22867543995380402,0.1694638729095459,948.1915893554688,1e-05,0.1189318597316742,3.3949129581451416,81.14050197601318,3 +3740,0.22414179146289825,0.2032957375049591,0.19862033426761627,0.20559440553188324,976.69921875,1e-05,0.12531808018684387,3.124722957611084,81.14050197601318,3 +3741,0.22966007888317108,0.11176568269729614,0.11129037290811539,0.2030303031206131,942.4046020507812,1e-05,0.15396519005298615,3.150562286376953,81.14050197601318,3 +3742,0.1753273904323578,0.2269168347120285,0.2198093831539154,0.23566433787345886,900.8737182617188,1e-05,0.10179555416107178,2.841306447982788,81.14050197601318,3 +3743,0.23688845336437225,0.29059019684791565,0.2922545075416565,0.18974359333515167,348.26116943359375,1e-05,0.13632212579250336,3.037020206451416,81.14050197601318,3 +3744,0.28103432059288025,0.1236054077744484,0.11945974081754684,0.1655011624097824,869.614990234375,1e-05,0.3091072738170624,3.305002212524414,81.14050197601318,3 +3745,0.3784783184528351,0.24853022396564484,0.23893918097019196,0.18811188638210297,943.1180419921875,1e-05,0.11397583037614822,3.130474090576172,81.14050197601318,3 +3746,0.2207716703414917,0.12860555946826935,0.12891125679016113,0.21212121844291687,658.916015625,1e-05,0.1323145031929016,3.1735663414001465,81.14050197601318,3 +3747,0.467347115278244,0.16778776049613953,0.17352774739265442,0.2433566451072693,701.6507568359375,1e-05,0.1257406771183014,3.043544292449951,81.14050197601318,3 +3748,0.2841449975967407,0.20146708190441132,0.19786594808101654,0.18927739560604095,892.4525146484375,1e-05,0.2352656126022339,2.8222553730010986,81.14050197601318,3 +3749,0.2282819002866745,0.13717521727085114,0.12829361855983734,0.20372959971427917,802.3400268554688,1e-05,0.163313090801239,3.2763373851776123,81.14050197601318,3 +3750,0.18074332177639008,0.27179867029190063,0.2503822445869446,0.18531468510627747,863.0953369140625,1e-05,0.1720273196697235,3.0837903022766113,81.14050197601318,3 +3751,0.17202487587928772,0.3140280246734619,0.30274543166160583,0.25081583857536316,941.685791015625,1e-05,0.31760352849960327,3.0787785053253174,81.14050197601318,3 +3752,0.2912677228450775,0.26123499870300293,0.2548961043357849,0.08881118893623352,691.7044067382812,1e-05,0.16464537382125854,3.4119861125946045,81.14050197601318,3 +3753,0.12185203284025192,0.22701792418956757,0.22638791799545288,0.17179487645626068,952.789306640625,1e-05,0.25326961278915405,3.09015154838562,81.14050197601318,3 +3754,0.33465561270713806,0.162465900182724,0.1601337045431137,0.11328671127557755,711.1596069335938,1e-05,0.2747572958469391,2.826528787612915,81.14050197601318,3 +3755,0.2261352241039276,0.1954287737607956,0.19164715707302094,0.10326340049505234,263.79840087890625,1e-05,0.36626389622688293,3.2465739250183105,81.14050197601318,3 +3756,0.2977278232574463,0.5666525363922119,0.5719733834266663,0.21841491758823395,171.19692993164062,1e-05,0.15853075683116913,3.343141794204712,81.14050197601318,3 +3757,0.21850793063640594,0.16270460188388824,0.16969920694828033,0.17249417304992676,679.9532470703125,1e-05,0.11901889741420746,3.0889832973480225,81.14050197601318,3 +3758,0.2639325261116028,0.36321204900741577,0.36671507358551025,0.1902097910642624,287.737548828125,1e-05,0.14734122157096863,3.1143035888671875,81.14050197601318,3 +3759,0.27073562145233154,0.26784494519233704,0.25747236609458923,0.17529137432575226,971.5481567382812,1e-05,0.13092069327831268,3.1198904514312744,81.14050197601318,3 +3760,0.19663581252098083,0.3765811324119568,0.3657586872577667,0.26433566212654114,301.4790344238281,1e-05,0.11476960778236389,2.8337433338165283,81.14050197601318,3 +3761,0.26729875802993774,0.3676835000514984,0.3544905483722687,0.23519814014434814,969.1096801757812,1e-05,0.1428941935300827,3.2743709087371826,81.14050197601318,3 +3762,0.1771106719970703,0.23307132720947266,0.21439331769943237,0.1666666716337204,900.5198364257812,1e-05,0.11002154648303986,3.433582067489624,81.14050197601318,3 +3763,0.26248106360435486,0.18332822620868683,0.17218264937400818,0.19393938779830933,908.3971557617188,1e-05,0.1670776903629303,3.067168951034546,81.14050197601318,3 +3764,0.16798345744609833,0.17896176874637604,0.18199926614761353,0.23916083574295044,942.6430053710938,1e-05,0.12349336594343185,3.3328189849853516,81.14050197601318,3 +3765,0.17157891392707825,0.07778581231832504,0.08400344103574753,0.15571095049381256,832.2701416015625,1e-05,0.14380578696727753,2.8359665870666504,81.14050197601318,3 +3766,0.13383609056472778,0.17828811705112457,0.1763521283864975,0.2181818187236786,932.6204223632812,1e-05,0.14560814201831818,3.0442445278167725,81.14050197601318,3 +3767,0.3139672577381134,0.1594797968864441,0.14711055159568787,0.2270396202802658,788.94677734375,1e-05,0.14341434836387634,3.011772632598877,81.14050197601318,3 +3768,0.1515006721019745,0.17901185154914856,0.1754005253314972,0.22074592113494873,882.1692504882812,1e-05,0.12348467856645584,3.3772294521331787,81.14050197601318,3 +3769,0.22529709339141846,0.26661646366119385,0.24885527789592743,0.15034964680671692,982.1359252929688,1e-05,0.13847985863685608,3.093148708343506,81.14050197601318,3 +3770,0.3486384451389313,0.1603381484746933,0.17993907630443573,0.2237762212753296,958.17578125,1e-05,0.28869298100471497,3.1033449172973633,81.14050197601318,3 +3771,0.1755286604166031,0.30988964438438416,0.3042052686214447,0.1662004590034485,988.4596557617188,1e-05,0.2102372795343399,2.833224296569824,81.14050197601318,3 +3772,0.33764979243278503,0.1654178500175476,0.16122792661190033,0.2013985961675644,913.5706787109375,1e-05,0.11834901571273804,3.061143398284912,81.14050197601318,3 +3773,0.1759459525346756,0.172212615609169,0.16523681581020355,0.20815850794315338,936.2454833984375,1e-05,0.12262261658906937,3.0717215538024902,81.14050197601318,3 +3774,0.30013909935951233,0.24658924341201782,0.23429149389266968,0.23449882864952087,968.9326171875,1e-05,0.13026142120361328,3.3771426677703857,81.14050197601318,3 +3775,0.4075991213321686,0.1985812932252884,0.20407763123512268,0.19976690411567688,986.787841796875,1e-05,0.22975066304206848,3.1141722202301025,81.14050197601318,3 +3776,0.3058813214302063,0.10610820353031158,0.10094050318002701,0.2181818187236786,677.2564697265625,1e-05,0.5175487399101257,3.063994884490967,81.14050197601318,3 +3777,0.45704662799835205,0.3261185884475708,0.3226870000362396,0.2825174927711487,379.11187744140625,1e-05,0.1480143666267395,2.815582513809204,81.14050197601318,3 +3778,0.13804057240486145,0.19531205296516418,0.18990787863731384,0.10582750290632248,922.657958984375,1e-05,0.20290476083755493,3.067453384399414,81.14050197601318,3 +3779,0.1486227661371231,0.17214372754096985,0.1595068871974945,0.06643356382846832,881.341796875,1e-05,0.14020811021327972,3.0810000896453857,81.14050197601318,3 +3780,0.14456412196159363,0.20915861427783966,0.2100193053483963,0.15920746326446533,875.3941650390625,1e-05,0.11679121851921082,3.4138283729553223,81.14050197601318,3 +3781,0.27566277980804443,0.1474665254354477,0.15664371848106384,0.10023310035467148,489.7753601074219,1e-05,0.213087797164917,3.316472053527832,81.14050197601318,3 +3782,0.22206516563892365,0.14412979781627655,0.14232566952705383,0.1515151560306549,679.9532470703125,1e-05,1.3994371891021729,2.8285014629364014,81.14050197601318,3 +3783,0.2946288287639618,0.1875765174627304,0.19648528099060059,0.20279720425605774,914.8272094726562,1e-05,0.13189591467380524,2.8326456546783447,81.14050197601318,3 +3784,0.2335379272699356,0.16949307918548584,0.16670796275138855,0.12703962624073029,327.6654357910156,1e-05,0.15075699985027313,3.1051037311553955,81.14050197601318,3 +3785,0.12430626153945923,0.18069754540920258,0.19431275129318237,0.17132866382598877,983.178466796875,1e-05,0.17268481850624084,3.2845191955566406,81.14050197601318,3 +3786,0.20720705389976501,0.19897761940956116,0.19292771816253662,0.26480185985565186,838.0756225585938,1e-05,0.17157045006752014,3.117805242538452,81.14050197601318,3 +3787,0.07748144119977951,0.23134902119636536,0.2178514301776886,0.0883449912071228,941.2037353515625,1e-05,0.16478419303894043,3.4055655002593994,81.14050197601318,3 +3788,0.13791720569133759,0.2718288004398346,0.2602227032184601,0.24149183928966522,956.75732421875,1e-05,0.1543901115655899,2.830994129180908,81.14050197601318,3 +3789,0.2860783636569977,0.2946080267429352,0.29899659752845764,0.2270396202802658,965.126220703125,1e-05,0.18490126729011536,2.8200504779815674,81.14050197601318,3 +3790,0.20180967450141907,0.2953849732875824,0.2853189706802368,0.2405594438314438,495.12713623046875,1e-05,0.11625394225120544,3.1087279319763184,81.14050197601318,3 +3791,0.24438698589801788,0.29187509417533875,0.2846764326095581,0.23496504127979279,928.8597412109375,1e-05,0.13249878585338593,3.3268277645111084,81.14050197601318,3 +3792,0.2794061303138733,0.2817128896713257,0.27250024676322937,0.22400932013988495,993.89599609375,1e-05,0.2826424539089203,3.4725494384765625,81.14050197601318,3 +3793,0.21905429661273956,0.2463865578174591,0.23366306722164154,0.18205128610134125,970.1636352539062,1e-05,0.11310070008039474,3.1949291229248047,81.14050197601318,3 +3794,0.25047603249549866,0.16882750391960144,0.17480480670928955,0.17692308127880096,770.1734008789062,1e-05,0.17979483306407928,2.8245975971221924,81.14050197601318,3 +3795,0.22952622175216675,0.2184295654296875,0.21723072230815887,0.12167832255363464,929.6773681640625,1e-05,0.18907034397125244,2.836022138595581,81.14050197601318,3 +3796,0.17190629243850708,0.20485815405845642,0.19950348138809204,0.15734265744686127,961.334228515625,1e-05,0.11465675383806229,3.311107873916626,81.14050197601318,3 +3797,0.10410913825035095,0.102102130651474,0.09713708609342575,0.16643357276916504,894.3345947265625,1e-05,0.1275419443845749,3.1195456981658936,81.14050197601318,3 +3798,0.12354058772325516,0.16159509122371674,0.17097768187522888,0.2769230902194977,539.5704345703125,1e-05,0.12045196443796158,3.38456654548645,81.14050197601318,3 +3799,0.1019386500120163,0.2003861367702484,0.1869012713432312,0.19930069148540497,854.7328491210938,1e-05,0.11068518459796906,3.0723671913146973,81.14050197601318,3 +3800,0.10810867697000504,0.29297304153442383,0.27635064721107483,0.23473192751407623,997.7442626953125,1e-05,0.13805624842643738,2.8387207984924316,81.14050197601318,3 +3801,0.17777840793132782,0.16063134372234344,0.15135547518730164,0.225874125957489,937.0054321289062,1e-05,0.13399171829223633,2.8341963291168213,81.14050197601318,3 +3802,0.15505819022655487,0.2547430396080017,0.23838011920452118,0.2426573485136032,929.1331176757812,1e-05,0.19295459985733032,3.2987987995147705,81.14050197601318,3 +3803,0.21423086524009705,0.22022970020771027,0.21762600541114807,0.22634032368659973,735.275390625,1e-05,0.20981436967849731,3.4075429439544678,81.14050197601318,3 +3804,0.13786035776138306,0.26618456840515137,0.26833781599998474,0.17972028255462646,958.17578125,1e-05,0.14364489912986755,3.3444344997406006,81.14050197601318,3 +3805,0.13361218571662903,0.10232501477003098,0.11268837749958038,0.12680652737617493,842.00830078125,1e-05,0.13774527609348297,3.093596935272217,81.14050197601318,3 +3806,0.12304811179637909,0.1980133205652237,0.1918889582157135,0.16993007063865662,887.0220336914062,1e-05,0.13125751912593842,2.822681427001953,81.14050197601318,3 +3807,0.2363755702972412,0.23564676940441132,0.21269603073596954,0.2181818187236786,845.8379516601562,1e-05,0.15613920986652374,3.02958345413208,81.14050197601318,3 +3808,0.22345224022865295,0.22622738778591156,0.2220819741487503,0.21445220708847046,971.7196655273438,1e-05,0.22132395207881927,3.036912679672241,81.14050197601318,3 +3809,0.29217857122421265,0.2846866250038147,0.2768717408180237,0.23706293106079102,964.0061645507812,1e-05,0.15966954827308655,3.387718677520752,81.14050197601318,3 +3810,0.19417086243629456,0.20548510551452637,0.2015773355960846,0.19370628893375397,924.6715087890625,1e-05,0.22369304299354553,3.25156569480896,81.14050197601318,3 +3811,0.2854924201965332,0.18861106038093567,0.19046451151371002,0.15757575631141663,683.93896484375,1e-05,0.13501769304275513,3.0737600326538086,81.14050197601318,3 +3812,0.36076852679252625,0.22344954311847687,0.23929795622825623,0.23053613305091858,379.11187744140625,1e-05,0.1505049616098404,2.834498882293701,81.14050197601318,3 +3813,0.38239791989326477,0.36600014567375183,0.3624878525733948,0.15501165390014648,411.0456848144531,1e-05,0.1618373990058899,3.044088125228882,81.14050197601318,3 +3814,0.14438536763191223,0.2262413203716278,0.21286775171756744,0.22331002354621887,922.657958984375,1e-05,0.14429980516433716,3.102818250656128,81.14050197601318,3 +3815,0.30754294991493225,0.15178634226322174,0.15908168256282806,0.21794871985912323,866.8596801757812,1e-05,0.11428984254598618,3.371654748916626,81.14050197601318,3 +3816,0.20344939827919006,0.24381746351718903,0.2363685518503189,0.10303030163049698,920.605224609375,1e-05,0.1205713227391243,3.3547720909118652,81.14050197601318,3 +3817,0.17952829599380493,0.24658052623271942,0.2294139564037323,0.18298368155956268,780.2160034179688,1e-05,0.14181847870349884,3.0755937099456787,81.14050197601318,3 +3818,0.40055209398269653,0.17512059211730957,0.1721651703119278,0.06643356382846832,834.0355224609375,1e-05,0.1565665900707245,2.826845645904541,81.14050197601318,3 +3819,0.20895719528198242,0.35942918062210083,0.3657498061656952,0.15524475276470184,996.1564331054688,1e-05,0.1284138411283493,3.05393648147583,81.14050197601318,3 +3820,0.20026163756847382,0.1551346778869629,0.1557719111442566,0.12727272510528564,969.1096801757812,1e-05,0.1003769040107727,3.233095645904541,81.14050197601318,3 +3821,0.1534614861011505,0.23538431525230408,0.23106685280799866,0.2142191082239151,620.8772583007812,1e-05,0.1771988719701767,3.362133741378784,81.14050197601318,3 +3822,0.09016555547714233,0.2824587821960449,0.27332842350006104,0.17972028255462646,972.4016723632812,1e-05,0.1785724014043808,3.1349382400512695,81.14050197601318,3 +3823,0.110590361058712,0.11528308689594269,0.13340459764003754,0.18205128610134125,991.8234252929688,1e-05,0.20152857899665833,3.0799849033355713,81.14050197601318,3 +3824,0.14975735545158386,0.49127325415611267,0.4989253878593445,0.21165500581264496,120.44096374511719,1e-05,0.13479159772396088,2.840322494506836,81.14050197601318,3 +3825,0.24930794537067413,0.2130783498287201,0.21060733497142792,0.23892773687839508,865.928466796875,1e-05,0.12511460483074188,3.0910115242004395,81.14050197601318,3 +3826,0.12531809508800507,0.04888804629445076,0.05224860459566116,0.0687645673751831,839.7739868164062,1e-05,0.12421755492687225,3.5384647846221924,81.14050197601318,3 +3827,0.21348857879638672,0.18794114887714386,0.1837582290172577,0.12051282078027725,991.8234252929688,1e-05,0.24106156826019287,3.3375425338745117,81.14050197601318,3 +3828,0.14345529675483704,0.3112562894821167,0.30327242612838745,0.1962703913450241,978.134033203125,1e-05,0.11453805863857269,3.1380553245544434,81.14050197601318,3 +3829,0.1288149654865265,0.1462831199169159,0.1356862485408783,0.20955711603164673,919.414306640625,1e-05,0.16834960877895355,3.1198389530181885,81.14050197601318,3 +3830,0.30546560883522034,0.20586687326431274,0.21114158630371094,0.23240093886852264,909.7130737304688,1e-05,0.11988893151283264,2.835700511932373,81.14050197601318,3 +3831,0.19548019766807556,0.16948358714580536,0.17852234840393066,0.12261072546243668,847.4485473632812,1e-05,0.11799212545156479,3.112637996673584,81.14050197601318,3 +3832,0.20398756861686707,0.30537575483322144,0.3006329834461212,0.2030303031206131,945.4581298828125,1e-05,0.12294384092092514,3.5461127758026123,81.14050197601318,3 +3833,0.25621432065963745,0.24070295691490173,0.2349824756383896,0.24801865220069885,530.23681640625,1e-05,0.13389714062213898,3.416565179824829,81.14050197601318,3 +3834,0.2652437090873718,0.11400000751018524,0.12609907984733582,0.2114219069480896,790.488037109375,1e-05,0.1379515528678894,3.3468129634857178,81.14050197601318,3 +3835,0.22339129447937012,0.21478526294231415,0.20792260766029358,0.16083915531635284,515.6737670898438,1e-05,0.12148569524288177,2.8349530696868896,81.14050197601318,3 +3836,0.2085271030664444,0.17330855131149292,0.1635734736919403,0.1986013948917389,758.630126953125,1e-05,0.13170920312404633,2.8394267559051514,81.14050197601318,3 +3837,0.10195231437683105,0.12114126980304718,0.12546657025814056,0.06759906560182571,825.6151733398438,1e-05,0.10682031512260437,3.409555196762085,81.14050197601318,3 +3838,0.1443774402141571,0.24956722557544708,0.24097585678100586,0.20629370212554932,961.334228515625,1e-05,0.11459632962942123,3.5663747787475586,81.14050197601318,3 +3839,0.18400375545024872,0.21314716339111328,0.21108384430408478,0.13123543560504913,930.2188720703125,1e-05,0.15917949378490448,3.164437770843506,81.14050197601318,3 +3840,0.28383079171180725,0.30664125084877014,0.2931784391403198,0.1806526780128479,918.8137817382812,1e-05,0.13342760503292084,3.1490232944488525,81.14050197601318,3 +3841,0.2435079962015152,0.22325754165649414,0.22589047253131866,0.2158508151769638,912.93701171875,1e-05,0.13957791030406952,2.8442869186401367,81.14050197601318,3 +3842,0.1886477917432785,0.28203245997428894,0.2597486078739166,0.15734265744686127,977.0203857421875,1e-05,0.10817190259695053,2.8377459049224854,81.14050197601318,3 +3843,0.2431439310312271,0.3486386239528656,0.33180123567581177,0.19557109475135803,982.7333984375,1e-05,0.13800837099552155,3.3440003395080566,81.14050197601318,3 +3844,0.4218187928199768,0.22727498412132263,0.2250535786151886,0.13286712765693665,356.2078552246094,1e-05,0.15107028186321259,3.4218385219573975,81.14050197601318,3 +3845,0.28488436341285706,0.2309943437576294,0.247040256857872,0.15477855503559113,992.477783203125,1e-05,0.15106000006198883,3.2618958950042725,81.14050197601318,3 +3846,0.13384731113910675,0.332221120595932,0.3136567771434784,0.23286713659763336,962.2981567382812,1e-05,0.1221204325556755,3.075660467147827,81.14050197601318,3 +3847,0.3490128815174103,0.27281972765922546,0.2601022720336914,0.2689976692199707,890.15478515625,1e-05,0.12679602205753326,2.837318181991577,81.14050197601318,3 +3848,0.3133821487426758,0.6534221172332764,0.647063136100769,0.2242424190044403,106.90462493896484,1e-05,0.12936784327030182,2.8442649841308594,81.14050197601318,3 +3849,0.15729303658008575,0.24215386807918549,0.247891366481781,0.18974359333515167,942.1655883789062,1e-05,0.17134606838226318,3.37235164642334,81.14050197601318,3 +3850,0.33423206210136414,0.1986495852470398,0.1927819848060608,0.2293706238269806,546.3833618164062,1e-05,0.1261862814426422,3.4309582710266113,81.14050197601318,3 +3851,0.25379887223243713,0.2204798460006714,0.2234099805355072,0.2310023307800293,689.1459350585938,1e-05,0.11707160621881485,3.394773006439209,81.14050197601318,3 +3852,0.12868624925613403,0.22728048264980316,0.2196165919303894,0.1790209710597992,870.971435546875,1e-05,0.12580609321594238,3.081798791885376,81.14050197601318,3 +3853,0.3697108328342438,0.19551467895507812,0.19707940518856049,0.24079254269599915,723.5714111328125,1e-05,0.12161929905414581,2.8380613327026367,81.14050197601318,3 +3854,0.11652254313230515,0.057684749364852905,0.05744168534874916,0.05128205195069313,888.5984497070312,1e-05,0.1260204017162323,3.113051652908325,81.14050197601318,3 +3855,0.2523111402988434,0.16046614944934845,0.15931154787540436,0.17645686864852905,928.03564453125,1e-05,0.13683123886585236,3.171114206314087,81.14050197601318,3 +3856,0.25152915716171265,0.2566341757774353,0.23814120888710022,0.18531468510627747,784.2387084960938,1e-05,0.13638506829738617,3.442190647125244,81.14050197601318,3 +3857,0.2387951761484146,0.28162145614624023,0.27371925115585327,0.22284382581710815,991.2958374023438,1e-05,0.13806630671024323,3.3951916694641113,81.14050197601318,3 +3858,0.36102476716041565,0.2460457980632782,0.22908513247966766,0.19696970283985138,930.488525390625,1e-05,0.14407464861869812,2.824618101119995,81.14050197601318,3 +3859,0.1919182687997818,0.331376314163208,0.3228757083415985,0.23449882864952087,677.2564697265625,1e-05,0.19364313781261444,2.8387112617492676,81.14050197601318,3 +3860,0.24448378384113312,0.20895743370056152,0.2092740833759308,0.22867132723331451,989.1450805664062,1e-05,0.18208974599838257,3.0298919677734375,81.14050197601318,3 +3861,0.2346736490726471,0.17455482482910156,0.16412506997585297,0.17995338141918182,866.3948974609375,1e-05,0.2936410903930664,3.135511875152588,81.14050197601318,3 +3862,0.21898958086967468,0.2292710244655609,0.21972063183784485,0.2354312390089035,920.0114135742188,1e-05,0.13380445539951324,3.279728651046753,81.14050197601318,3 +3863,0.263445645570755,0.2024436742067337,0.2007095068693161,0.1566433608531952,942.8807373046875,1e-05,0.16942863166332245,3.341714382171631,81.14050197601318,3 +3864,0.27402645349502563,0.3603893518447876,0.3576422333717346,0.10932400822639465,987.069091796875,1e-05,0.11550422757863998,2.8210039138793945,81.14050197601318,3 +3865,0.14783059060573578,0.13280074298381805,0.13112840056419373,0.0839160829782486,852.6897583007812,1e-05,0.14613741636276245,2.830339193344116,81.14050197601318,3 +3866,0.285131573677063,0.1516662836074829,0.16990044713020325,0.18205128610134125,888.2062377929688,1e-05,0.21950748562812805,3.0770182609558105,81.14050197601318,3 +3867,0.3331562876701355,0.2211393117904663,0.21501310169696808,0.2214452177286148,852.6897583007812,1e-05,0.2039923220872879,3.0992965698242188,81.14050197601318,3 +3868,0.18160949647426605,0.24671252071857452,0.2504342496395111,0.2153846174478531,986.5054321289062,1e-05,0.11550294607877731,3.3846333026885986,81.14050197601318,3 +3869,0.1955203413963318,0.19865530729293823,0.1808498501777649,0.22750583291053772,918.5123291015625,1e-05,0.163351908326149,3.3833024501800537,81.14050197601318,3 +3870,0.23128673434257507,0.1560496836900711,0.14566577970981598,0.15524475276470184,826.2322387695312,1e-05,0.1289926916360855,2.8411948680877686,81.14050197601318,3 +3871,0.264838844537735,0.27485591173171997,0.2853294014930725,0.17156177759170532,996.8938598632812,1e-05,0.17191506922245026,2.851767063140869,81.14050197601318,3 +3872,0.19364400207996368,0.21526199579238892,0.19562573730945587,0.2097902148962021,865.4603271484375,1e-05,0.24299250543117523,3.0484161376953125,81.14050197601318,3 +3873,0.1957995742559433,0.16735312342643738,0.16738052666187286,0.23030303418636322,891.6915283203125,1e-05,0.15242673456668854,3.4150166511535645,81.14050197601318,3 +3874,0.26319289207458496,0.14473316073417664,0.15667083859443665,0.13216783106327057,761.3585205078125,1e-05,0.1473199725151062,3.461639642715454,81.14050197601318,3 +3875,0.1514648050069809,0.20119382441043854,0.20632049441337585,0.1538461595773697,816.0525512695312,1e-05,0.16412313282489777,3.111903190612793,81.14050197601318,3 +3876,0.2677869200706482,0.23537364602088928,0.23561584949493408,0.23030303418636322,580.2335815429688,1e-05,0.15926562249660492,2.827416181564331,81.14050197601318,3 +3877,0.18572615087032318,0.29076895117759705,0.2837548851966858,0.22004662454128265,979.8526000976562,1e-05,0.11910305172204971,2.826470136642456,81.14050197601318,3 +3878,0.32869863510131836,0.19913806021213531,0.19910530745983124,0.18298368155956268,461.6126403808594,1e-05,0.1790589839220047,3.090876579284668,81.14050197601318,3 +3879,0.24229800701141357,0.29680588841438293,0.28126129508018494,0.2650349736213684,964.1939697265625,1e-05,0.10811437666416168,3.3215394020080566,81.14050197601318,3 +3880,0.32190966606140137,0.3965827524662018,0.39745864272117615,0.09603729844093323,424.38739013671875,1e-05,0.1381658911705017,3.1532626152038574,81.14050197601318,3 +3881,0.19340750575065613,0.27821624279022217,0.26964977383613586,0.22331002354621887,934.1901245117188,1e-05,0.10239500552415848,3.076636552810669,81.14050197601318,3 +3882,0.14025305211544037,0.1332056224346161,0.13801921904087067,0.21048951148986816,925.8049926757812,1e-05,0.1382683962583542,2.827728748321533,81.14050197601318,3 +3883,0.15247343480587006,0.24389003217220306,0.2502257823944092,0.2102564126253128,983.4736938476562,1e-05,0.1072387769818306,3.0081872940063477,81.14050197601318,3 +3884,0.1497844010591507,0.2677304744720459,0.2782450020313263,0.14965035021305084,959.3736572265625,1e-05,0.10894264280796051,3.030512571334839,81.14050197601318,3 +3885,0.1687833070755005,0.2539331912994385,0.2414313405752182,0.25687646865844727,811.3840942382812,1e-05,0.2483133226633072,3.345759630203247,81.14050197601318,3 +3886,0.2231997847557068,0.2473898082971573,0.2460692971944809,0.2599067687988281,978.7633666992188,1e-05,0.13556234538555145,3.377617597579956,81.14050197601318,3 +3887,0.264640748500824,0.23194892704486847,0.22839492559432983,0.1818181872367859,464.5392150878906,1e-05,0.1977948248386383,3.0839500427246094,81.14050197601318,3 +3888,0.21519383788108826,0.13835281133651733,0.15096209943294525,0.22750583291053772,544.1298217773438,1e-05,0.20109286904335022,2.8181025981903076,81.14050197601318,3 +3889,0.09353990852832794,0.17237640917301178,0.17882342636585236,0.20885780453681946,835.7803955078125,1e-05,0.21675826609134674,3.0837197303771973,81.14050197601318,3 +3890,0.38474810123443604,0.20193922519683838,0.18725156784057617,0.20722611248493195,986.079833984375,1e-05,0.13931603729724884,3.0364186763763428,81.14050197601318,3 +3891,0.17555475234985352,0.1867964118719101,0.18646472692489624,0.1515151560306549,949.0853271484375,1e-05,0.1572585105895996,3.383244514465332,81.14050197601318,3 +3892,0.2290433943271637,0.16940021514892578,0.1631956845521927,0.1382284313440323,817.3616943359375,1e-05,0.19022291898727417,3.3124303817749023,81.14050197601318,3 +3893,0.28605955839157104,0.17957259714603424,0.17312249541282654,0.11818181723356247,724.6637573242188,1e-05,0.17318089306354523,3.0464205741882324,81.14050197601318,3 +3894,0.23929846286773682,0.5147374868392944,0.5132318139076233,0.0279720276594162,222.54527282714844,1e-05,0.14015930891036987,2.828650712966919,81.14050197601318,3 +3895,0.2740592956542969,0.37776893377304077,0.3818456828594208,0.1442890465259552,997.86474609375,1e-05,0.1425102800130844,3.023658037185669,81.14050197601318,3 +3896,0.2670828700065613,0.2724382281303406,0.2701680064201355,0.25874125957489014,544.1298217773438,1e-05,0.159657821059227,3.061671257019043,81.14050197601318,3 +3897,0.247451052069664,0.19719885289669037,0.18717440962791443,0.22494173049926758,939.7424926757812,1e-05,0.13462506234645844,3.4106926918029785,81.14050197601318,3 +3898,0.19790567457675934,0.2979901134967804,0.2965654730796814,0.18648017942905426,988.8717041015625,1e-05,0.11543639749288559,3.064257860183716,81.14050197601318,3 +3899,0.1030239537358284,0.1673966646194458,0.1553788036108017,0.20675989985466003,917.6026611328125,1e-05,0.17380596697330475,3.114187002182007,81.14050197601318,3 +3900,0.1420585811138153,0.13985590636730194,0.1334526687860489,0.274125874042511,771.8865966796875,1e-05,0.1152871623635292,3.0883471965789795,81.14050197601318,3 +3901,0.2551512122154236,0.19172842800617218,0.187676340341568,0.23613053560256958,912.6188354492188,1e-05,0.1537889540195465,2.8247182369232178,81.14050197601318,3 +3902,0.253981351852417,0.3006494641304016,0.3210371136665344,0.14405594766139984,382.7987976074219,1e-05,0.12700973451137543,3.03351092338562,81.14050197601318,3 +3903,0.2552652955055237,0.20321139693260193,0.18659159541130066,0.19254079461097717,810.7058715820312,1e-05,0.2454369068145752,3.3590965270996094,81.14050197601318,3 +3904,0.09657800942659378,0.2819456160068512,0.26753947138786316,0.2254079282283783,963.4406127929688,1e-05,0.0942666083574295,3.309298515319824,81.14050197601318,3 +3905,0.20384198427200317,0.28563356399536133,0.26827090978622437,0.20815850794315338,935.9909057617188,1e-05,0.2790529429912567,2.816387176513672,81.14050197601318,3 +3906,0.2618861496448517,0.13949233293533325,0.1384788453578949,0.23613053560256958,823.7489624023438,1e-05,0.1610330492258072,3.082824468612671,81.14050197601318,3 +3907,0.17229966819286346,0.3955202102661133,0.387663871049881,0.16736596822738647,990.630615234375,1e-05,0.11852946877479553,2.824759006500244,81.14050197601318,3 +3908,0.21616002917289734,0.18235105276107788,0.16914038360118866,0.2242424190044403,764.04736328125,1e-05,0.10806641727685928,3.0721940994262695,81.14050197601318,3 +3909,0.2541031241416931,0.20914573967456818,0.2113741636276245,0.21515151858329773,956.3478393554688,1e-05,0.18425622582435608,3.429837942123413,81.14050197601318,3 +3910,0.2037494033575058,0.24694682657718658,0.23294486105442047,0.25594404339790344,880.0903930664062,1e-05,0.14286307990550995,3.3574821949005127,81.14050197601318,3 +3911,0.17095303535461426,0.14946840703487396,0.1362738311290741,0.2170163094997406,919.414306640625,1e-05,0.118330217897892,2.8364853858947754,81.14050197601318,3 +3912,0.22666631639003754,0.10823564976453781,0.12259945273399353,0.19603729248046875,823.121826171875,1e-05,0.1053125336766243,3.0544514656066895,81.14050197601318,3 +3913,0.35319623351097107,0.25115594267845154,0.2555486261844635,0.2058275043964386,981.5336303710938,1e-05,0.3083483874797821,2.8394110202789307,81.14050197601318,3 +3914,0.28135165572166443,0.2412966638803482,0.23792722821235657,0.2393939346075058,505.5683898925781,1e-05,0.14171558618545532,3.131633996963501,81.14050197601318,3 +3915,0.2192550003528595,0.3466150164604187,0.3192218542098999,0.13379953801631927,892.0726318359375,1e-05,0.1626582145690918,3.121051549911499,81.14050197601318,3 +3916,0.18417690694332123,0.18638749420642853,0.18415503203868866,0.17575757205486298,999.177734375,1e-05,0.10407843440771103,3.1008312702178955,81.14050197601318,3 +3917,0.261942058801651,0.24238364398479462,0.2422395795583725,0.13076922297477722,972.231689453125,1e-05,0.17608991265296936,2.8354294300079346,81.14050197601318,3 +3918,0.19225528836250305,0.47335824370384216,0.45242393016815186,0.20769231021404266,999.6487426757812,1e-05,0.14055831730365753,3.118940830230713,81.14050197601318,3 +3919,0.24011462926864624,0.12776117026805878,0.1370999962091446,0.1990675926208496,677.2564697265625,1e-05,0.1753663420677185,2.8363897800445557,81.14050197601318,3 +3920,0.17363862693309784,0.21355584263801575,0.22181524336338043,0.2282051295042038,995.035400390625,1e-05,0.1140737533569336,3.410477638244629,81.14050197601318,3 +3921,0.3142741024494171,0.1302361786365509,0.1402433216571808,0.13682983815670013,823.121826171875,1e-05,0.17631234228610992,3.120854616165161,81.14050197601318,3 +3922,0.200760617852211,0.1652328372001648,0.17393675446510315,0.09417249262332916,942.1655883789062,1e-05,0.14252237975597382,3.1377673149108887,81.14050197601318,3 +3923,0.23342373967170715,0.12505313754081726,0.13053637742996216,0.2652680575847626,728.9754028320312,1e-05,0.13026557862758636,2.835167407989502,81.14050197601318,3 +3924,0.1496603637933731,0.36929643154144287,0.35290926694869995,0.2230769246816635,945.226806640625,1e-05,0.11163537204265594,3.04049015045166,81.14050197601318,3 +3925,0.23590987920761108,0.2076634168624878,0.20202361047267914,0.17459207773208618,888.5984497070312,1e-05,0.13610190153121948,2.8316385746002197,81.14050197601318,3 +3926,0.09044654667377472,0.14721465110778809,0.15595567226409912,0.1247086226940155,968.0419921875,1e-05,0.1626562923192978,3.4970273971557617,81.14050197601318,3 +3927,0.385256826877594,0.14772021770477295,0.15041682124137878,0.24638694524765015,723.5714111328125,1e-05,0.19940407574176788,3.402719736099243,81.14050197601318,3 +3928,0.23531877994537354,0.299569696187973,0.30829375982284546,0.23846153914928436,993.2548217773438,1e-05,0.14242038130760193,3.0556397438049316,81.14050197601318,3 +3929,0.329337477684021,0.2016209214925766,0.2066405564546585,0.24312354624271393,515.6737670898438,1e-05,0.2013397216796875,2.825380802154541,81.14050197601318,3 +3930,0.23665784299373627,0.19005127251148224,0.19246108829975128,0.2745920717716217,546.3833618164062,1e-05,0.15697449445724487,3.057424306869507,81.14050197601318,3 +3931,0.14725017547607422,0.21208713948726654,0.2312188446521759,0.20046620070934296,960.9456176757812,1e-05,0.15406976640224457,2.8150930404663086,81.14050197601318,3 +3932,0.13869576156139374,0.1402827799320221,0.13963167369365692,0.24848484992980957,857.74267578125,1e-05,0.10811782628297806,3.425172805786133,81.14050197601318,3 +3933,0.23190435767173767,0.2789890766143799,0.26399385929107666,0.2237762212753296,965.6807250976562,1e-05,0.14904463291168213,3.1378438472747803,81.14050197601318,3 +3934,0.12549662590026855,0.2384129911661148,0.22972922027111053,0.2533799409866333,943.8261108398438,1e-05,0.1183362826704979,3.157569646835327,81.14050197601318,3 +3935,0.23827898502349854,0.1770426481962204,0.18640658259391785,0.16689977049827576,887.4180297851562,1e-05,0.18150512874126434,3.0340614318847656,81.14050197601318,3 +3936,0.22948308289051056,0.23937591910362244,0.23295395076274872,0.16899767518043518,979.6979370117188,1e-05,0.10878124833106995,2.8115453720092773,81.14050197601318,3 +3937,0.16761788725852966,0.25211796164512634,0.24714379012584686,0.2097902148962021,877.97705078125,1e-05,0.1464032530784607,2.8264315128326416,81.14050197601318,3 +3938,0.1767653226852417,0.19508446753025055,0.20669953525066376,0.17412588000297546,976.3768310546875,1e-05,0.19212155044078827,3.4335787296295166,81.14050197601318,3 +3939,0.22868189215660095,0.1820659190416336,0.17722436785697937,0.27668997645378113,856.2459106445312,1e-05,0.22275270521640778,3.1219065189361572,81.14050197601318,3 +3940,0.4215273857116699,0.2680288553237915,0.2650298476219177,0.2310023307800293,766.697998046875,1e-05,0.16531765460968018,2.83510684967041,81.14050197601318,3 +3941,0.24973097443580627,0.3220733404159546,0.33062943816185,0.13333334028720856,263.79840087890625,1e-05,0.11114426702260971,3.0367932319641113,81.14050197601318,3 +3942,0.24347303807735443,0.5293707251548767,0.5261843800544739,0.16037295758724213,177.18624877929688,1e-05,0.1427377611398697,2.8229753971099854,81.14050197601318,3 +3943,0.2737016975879669,0.255791038274765,0.22678597271442413,0.2466200441122055,958.3765258789062,1e-05,0.7637993097305298,3.0938496589660645,81.14050197601318,3 +3944,0.16295817494392395,0.1875382959842682,0.17932917177677155,0.15011654794216156,788.1709594726562,1e-05,0.13602159917354584,3.415576457977295,81.14050197601318,3 +3945,0.16555257141590118,0.08526331931352615,0.08717045933008194,0.02097902074456215,942.8807373046875,1e-05,0.13902659714221954,3.0528147220611572,81.14050197601318,3 +3946,0.15994422137737274,0.23310734331607819,0.22577111423015594,0.20606060326099396,989.5532836914062,1e-05,0.13234098255634308,2.819601058959961,81.14050197601318,3 +3947,0.21492470800876617,0.28966274857521057,0.2739339768886566,0.128671333193779,968.57763671875,1e-05,0.15970446169376373,3.0202910900115967,81.14050197601318,3 +3948,0.19248023629188538,0.21344716846942902,0.20776823163032532,0.19813519716262817,692.97265625,1e-05,0.10324441641569138,2.8437881469726562,81.14050197601318,3 +3949,0.18834954500198364,0.2956410050392151,0.3127642273902893,0.21165500581264496,997.1378173828125,1e-05,0.15320709347724915,3.132253885269165,81.14050197601318,3 +3950,0.10823581367731094,0.16900992393493652,0.18058449029922485,0.20815850794315338,913.5706787109375,1e-05,0.2667440176010132,3.3952834606170654,81.14050197601318,3 +3951,0.29965993762016296,0.3538321852684021,0.35582056641578674,0.23962703347206116,998.5840454101562,1e-05,0.19327518343925476,3.073591470718384,81.14050197601318,3 +3952,0.25376495718955994,0.13282431662082672,0.13189280033111572,0.09533799439668655,828.0687866210938,1e-05,0.1105082556605339,2.8272924423217773,81.14050197601318,3 +3953,0.20133039355278015,0.1333223432302475,0.14891301095485687,0.19533799588680267,867.3228149414062,1e-05,0.15931449830532074,3.0538265705108643,81.14050197601318,3 +3954,0.13595625758171082,0.20649662613868713,0.19429230690002441,0.15221445262432098,651.463623046875,1e-05,0.12438245862722397,2.845985174179077,81.14050197601318,3 +3955,0.21919645369052887,0.4046807587146759,0.37551599740982056,0.19440560042858124,977.8174438476562,1e-05,0.34060800075531006,3.149176597595215,81.14050197601318,3 +3956,0.21069024503231049,0.18942870199680328,0.19129954278469086,0.2198135256767273,890.9254760742188,1e-05,0.12160950899124146,3.109851360321045,81.14050197601318,3 +3957,0.08442560583353043,0.1773056983947754,0.16294004023075104,0.24032634496688843,926.3671875,1e-05,0.11568909883499146,3.401365280151367,81.14050197601318,3 +3958,0.3006312847137451,0.3100140690803528,0.301004558801651,0.19370628893375397,980.4682006835938,1e-05,0.16885735094547272,2.8301403522491455,81.14050197601318,3 +3959,0.257199227809906,0.24694596230983734,0.23533038794994354,0.20163169503211975,627.6343994140625,1e-05,0.11253481358289719,3.036304473876953,81.14050197601318,3 +3960,0.1653188318014145,0.23226943612098694,0.24442070722579956,0.18554778397083282,926.0864868164062,1e-05,0.14489445090293884,2.818887710571289,81.14050197601318,3 +3961,0.3350328803062439,0.1840282678604126,0.18489497900009155,0.18041957914829254,780.2160034179688,1e-05,0.11897081136703491,3.2560789585113525,81.14050197601318,3 +3962,0.20959262549877167,0.11968404054641724,0.13457413017749786,0.238228440284729,801.6233520507812,1e-05,0.13081958889961243,3.0977280139923096,81.14050197601318,3 +3963,0.23075774312019348,0.40521442890167236,0.41569027304649353,0.20279720425605774,987.069091796875,1e-05,0.42771080136299133,3.119685411453247,81.14050197601318,3 +3964,0.10310083627700806,0.28441929817199707,0.2795574367046356,0.17645686864852905,979.54296875,1e-05,0.2043624073266983,2.834627151489258,81.14050197601318,3 +3965,0.2926531136035919,0.25448280572891235,0.24678312242031097,0.21188810467720032,896.5547485351562,1e-05,0.20532014966011047,3.092043876647949,81.14050197601318,3 +3966,0.17095156013965607,0.11400490999221802,0.11928050965070724,0.12074591964483261,893.9605712890625,1e-05,0.12262232601642609,2.8247573375701904,81.14050197601318,3 +3967,0.2782467305660248,0.3276415467262268,0.33765047788619995,0.20256410539150238,991.69189453125,1e-05,0.15164251625537872,3.345229148864746,81.14050197601318,3 +3968,0.20564046502113342,0.3087625503540039,0.3036346733570099,0.16899767518043518,987.069091796875,1e-05,0.14114399254322052,3.120185613632202,81.14050197601318,3 +3969,0.20451845228672028,0.2621331214904785,0.26003125309944153,0.17459207773208618,956.75732421875,1e-05,0.1014246791601181,3.1171624660491943,81.14050197601318,3 +3970,0.2703181505203247,0.1304573267698288,0.13593789935112,0.2652680575847626,678.60888671875,1e-05,0.1409388780593872,2.8381576538085938,81.14050197601318,3 +3971,0.16271957755088806,0.220894917845726,0.21422120928764343,0.2214452177286148,630.94677734375,1e-05,0.12641291320323944,3.0400824546813965,81.14050197601318,3 +3972,0.32763710618019104,0.38984739780426025,0.37355437874794006,0.22191141545772552,458.6604309082031,1e-05,0.15325163304805756,3.1376590728759766,81.14050197601318,3 +3973,0.11187747120857239,0.2771930396556854,0.2642625570297241,0.20372959971427917,970.8588256835938,1e-05,0.11299189180135727,3.263310670852661,81.14050197601318,3 +3974,0.24646885693073273,0.16539062559604645,0.16179734468460083,0.22960372269153595,898.011962890625,1e-05,0.18462172150611877,2.84378981590271,81.14050197601318,3 +3975,0.1342734396457672,0.16830173134803772,0.16301612555980682,0.14731934666633606,848.5123291015625,1e-05,0.11714491248130798,3.1134090423583984,81.14050197601318,3 +3976,0.23649300634860992,0.3011663854122162,0.2840992212295532,0.27319347858428955,981.230712890625,1e-05,0.10525283217430115,2.830929756164551,81.14050197601318,3 +3977,0.15008226037025452,0.2187529057264328,0.20502638816833496,0.10839160531759262,924.38623046875,1e-05,0.1123046875,3.0784354209899902,81.14050197601318,3 +3978,0.2925414443016052,0.5455239415168762,0.5448330640792847,0.24172493815422058,171.19692993164062,1e-05,0.19700318574905396,3.128671884536743,81.14050197601318,3 +3979,0.35248681902885437,0.2833769619464874,0.26856729388237,0.19976690411567688,814.732421875,1e-05,0.12293678522109985,3.1271488666534424,81.14050197601318,3 +3980,0.18644846975803375,0.311250776052475,0.30156585574150085,0.26433566212654114,939.9876098632812,1e-05,0.29952502250671387,3.033057928085327,81.14050197601318,3 +3981,0.17913198471069336,0.3466879725456238,0.34356406331062317,0.2678321599960327,968.7553100585938,1e-05,0.10955208539962769,3.1028709411621094,81.14050197601318,3 +3982,0.21366631984710693,0.20001763105392456,0.2000969499349594,0.21328671276569366,887.0220336914062,1e-05,0.11964346468448639,3.0062265396118164,81.14050197601318,3 +3983,0.2154839038848877,0.12875057756900787,0.12368248403072357,0.2242424190044403,919.7131958007812,1e-05,0.14507059752941132,2.81964373588562,81.14050197601318,3 +3984,0.1704493761062622,0.26048487424850464,0.25756198167800903,0.23636363446712494,643.773681640625,1e-05,0.1506623774766922,3.049698829650879,81.14050197601318,3 +3985,0.20741194486618042,0.42110133171081543,0.41858816146850586,0.23869463801383972,287.737548828125,1e-05,0.10822781920433044,3.4463019371032715,81.14050197601318,3 +3986,0.1748477816581726,0.23271764814853668,0.2161628156900406,0.2769230902194977,906.7301635742188,1e-05,0.1604936718940735,3.106433153152466,81.14050197601318,3 +3987,0.27128779888153076,0.9246673583984375,0.9201593995094299,0.21212121844291687,992.996826171875,1e-05,0.138757586479187,2.823429584503174,81.14050197601318,3 +3988,0.24546004831790924,0.13780026137828827,0.13285812735557556,0.22750583291053772,825.6151733398438,1e-05,0.16197451949119568,3.070533037185669,81.14050197601318,3 +3989,0.24224953353405,0.16909880936145782,0.15873833000659943,0.2454545497894287,950.8469848632812,1e-05,0.11229857802391052,2.8377227783203125,81.14050197601318,3 +3990,0.14582684636116028,0.2975860834121704,0.2803800404071808,0.23240093886852264,965.4962768554688,1e-05,0.11662418395280838,3.1510515213012695,81.14050197601318,3 +3991,0.3507174253463745,0.24778497219085693,0.25191575288772583,0.1638694703578949,957.3680419921875,1e-05,0.13576507568359375,3.152010679244995,81.14050197601318,3 +3992,0.20172268152236938,0.24157527089118958,0.23480410873889923,0.10419580340385437,982.7333984375,1e-05,0.11999151855707169,3.287546157836914,81.14050197601318,3 +3993,0.19495615363121033,0.24950210750102997,0.2528909146785736,0.2310023307800293,548.6198120117188,1e-05,0.11936667561531067,2.8176918029785156,81.14050197601318,3 +3994,0.30837467312812805,0.2807839810848236,0.2657250463962555,0.21095570921897888,909.3855590820312,1e-05,0.1401127725839615,3.0888359546661377,81.14050197601318,3 +3995,0.2650841474533081,0.22266831994056702,0.21166838705539703,0.21794871985912323,919.7131958007812,1e-05,0.13919763267040253,2.816244602203369,81.14050197601318,3 +3996,0.15871921181678772,0.2040458768606186,0.19146718084812164,0.22960372269153595,814.068359375,1e-05,0.14416606724262238,3.1240203380584717,81.14050197601318,3 +3997,0.2059715986251831,0.17118620872497559,0.16602720320224762,0.15734265744686127,983.6209716796875,1e-05,0.16383008658885956,3.0986359119415283,81.14050197601318,3 +3998,0.11346952617168427,0.16530512273311615,0.16220404207706451,0.13333334028720856,937.0054321289062,1e-05,0.11690109968185425,3.0977070331573486,81.14050197601318,3 +3999,0.2029094398021698,0.38937827944755554,0.396536260843277,0.13216783106327057,983.0303955078125,1e-05,0.12360940873622894,2.827676296234131,81.14050197601318,3 +4000,0.09262066334486008,0.16994032263755798,0.17765943706035614,0.1738927662372589,999.53125,1e-05,0.10076695680618286,3.0327441692352295,81.14050197601318,3 +4001,0.26950955390930176,0.07524143159389496,0.08103418350219727,0.13729603588581085,880.5089721679688,1e-05,0.20005808770656586,2.8191184997558594,81.14050197601318,3 +4002,0.1547839641571045,0.23278012871742249,0.2210361808538437,0.21794871985912323,939.4969482421875,1e-05,0.1210373118519783,3.370255947113037,81.14050197601318,3 +4003,0.20334449410438538,0.26432812213897705,0.2673224210739136,0.11328671127557755,939.9876098632812,1e-05,0.44492533802986145,3.4098894596099854,81.14050197601318,3 +4004,0.230027437210083,0.18187850713729858,0.19052569568157196,0.20000000298023224,393.64630126953125,1e-05,0.1536812037229538,3.0897231101989746,81.14050197601318,3 +4005,0.2606036365032196,0.24746856093406677,0.23285478353500366,0.22610722482204437,934.449462890625,1e-05,0.12910616397857666,2.8194215297698975,81.14050197601318,3 +4006,0.1788042187690735,0.28742706775665283,0.27718132734298706,0.13403263688087463,697.9737548828125,1e-05,0.10831794142723083,3.045968770980835,81.14050197601318,3 +4007,0.3953544497489929,0.20825527608394623,0.19070382416248322,0.2018647938966751,634.2159423828125,1e-05,0.20050878822803497,2.8390839099884033,81.14050197601318,3 +4008,0.34343692660331726,0.22845067083835602,0.23236672580242157,0.17808857560157776,586.15087890625,1e-05,0.13835565745830536,3.406367063522339,81.14050197601318,3 +4009,0.1228427141904831,0.2627010643482208,0.27309802174568176,0.16736596822738647,977.9759521484375,1e-05,0.12213332951068878,3.3957266807556152,81.14050197601318,3 +4010,0.11997604370117188,0.26551854610443115,0.27157101035118103,0.1878787875175476,955.10791015625,1e-05,0.17631302773952484,3.112306833267212,81.14050197601318,3 +4011,0.26226645708084106,0.09522910416126251,0.09774697571992874,0.12820512056350708,819.3053588867188,1e-05,0.16621747612953186,3.0990638732910156,81.14050197601318,3 +4012,0.1833323985338211,0.1134006679058075,0.11397311836481094,0.1790209710597992,689.1459350585938,1e-05,0.15620142221450806,2.83636736869812,81.14050197601318,3 +4013,0.3003863990306854,0.20300538837909698,0.19903500378131866,0.19766899943351746,640.6287231445312,1e-05,0.14529664814472198,3.0894734859466553,81.14050197601318,3 +4014,0.18016251921653748,0.2600867748260498,0.2546260952949524,0.2214452177286148,888.5984497070312,1e-05,0.11913762241601944,3.4112389087677,81.14050197601318,3 +4015,0.37603119015693665,0.3206345736980438,0.3187074661254883,0.11701631546020508,375.388671875,1e-05,0.16358350217342377,3.6808934211730957,81.14050197601318,3 +4016,0.14932411909103394,0.29739224910736084,0.28685006499290466,0.20233100652694702,964.3812255859375,1e-05,0.12549830973148346,2.856346845626831,81.14050197601318,3 +4017,0.30636146664619446,0.22831037640571594,0.21684274077415466,0.23449882864952087,941.685791015625,1e-05,0.16831280291080475,3.022287130355835,81.14050197601318,3 +4018,0.2804381549358368,1.7631117105484009,1.8378512859344482,0.2668997645378113,995.6604614257812,1e-05,0.12430461496114731,3.309162139892578,81.14050197601318,3 +4019,0.12841899693012238,0.2366178035736084,0.22733750939369202,0.19696970283985138,950.1903076171875,1e-05,0.15205322206020355,3.347757577896118,81.14050197601318,3 +4020,0.22256480157375336,0.29165613651275635,0.2835104167461395,0.21165500581264496,893.5853271484375,1e-05,0.1670643389225006,3.1927027702331543,81.14050197601318,3 +4021,0.18156689405441284,0.13924449682235718,0.1357312947511673,0.23636363446712494,872.758544921875,1e-05,0.17738528549671173,3.4089274406433105,81.14050197601318,3 +4022,0.11942027509212494,0.13120919466018677,0.14384478330612183,0.2745920717716217,961.7210693359375,1e-05,0.11412245780229568,3.0516366958618164,81.14050197601318,3 +4023,0.3155447840690613,0.16516776382923126,0.16139252483844757,0.1946386992931366,603.1679077148438,1e-05,0.12593723833560944,3.0249223709106445,81.14050197601318,3 +4024,0.28627243638038635,0.1814630925655365,0.18900877237319946,0.0839160829782486,500.3907775878906,1e-05,0.1502963900566101,2.8466110229492188,81.14050197601318,3 +4025,0.23320259153842926,0.11342699825763702,0.10578533262014389,0.15687645971775055,883.4002075195312,1e-05,0.1344429850578308,3.3950881958007812,81.14050197601318,3 +4026,0.2773384153842926,0.39308154582977295,0.38921278715133667,0.18857808411121368,994.9097900390625,1e-05,0.12136635184288025,3.0788490772247314,81.14050197601318,3 +4027,0.13259389996528625,0.33760756254196167,0.30700331926345825,0.23752914369106293,961.14013671875,1e-05,0.16193802654743195,3.494394302368164,81.14050197601318,3 +4028,0.16197709739208221,0.10904989391565323,0.12776808440685272,0.1734265685081482,632.5867309570312,1e-05,0.4968855381011963,2.9461746215820312,81.14050197601318,3 +4029,0.23718073964118958,0.25360050797462463,0.24350450932979584,0.13799533247947693,718.021240234375,1e-05,0.13163192570209503,3.189598798751831,81.14050197601318,3 +4030,0.1401320844888687,0.2644619941711426,0.26261118054389954,0.18694639205932617,979.8526000976562,1e-05,0.34211236238479614,2.9570350646972656,81.14050197601318,3 +4031,0.37328240275382996,0.35279759764671326,0.3614653944969177,0.17692308127880096,356.2078552246094,1e-05,0.14777842164039612,3.504256248474121,81.14050197601318,3 +4032,0.21927641332149506,0.281339555978775,0.2638731300830841,0.2153846174478531,957.5706176757812,1e-05,0.14507564902305603,3.500331401824951,81.14050197601318,3 +4033,0.17166881263256073,0.30288729071617126,0.2911068797111511,0.17435897886753082,941.445068359375,1e-05,0.13601696491241455,4.450778245925903,81.14050197601318,3 +4034,0.15523673593997955,0.11546867340803146,0.11546866595745087,0.0,742.382080078125,1e-05,0.1001974418759346,5.939790725708008,81.14050197601318,3 +4035,0.36114251613616943,0.25900959968566895,0.2506532669067383,0.20233100652694702,658.916015625,1e-05,0.2274058759212494,5.974119663238525,81.14050197601318,3 +4036,0.14607101678848267,0.27614936232566833,0.2829078435897827,0.16689977049827576,974.4140625,1e-05,0.10765823721885681,5.931370735168457,81.14050197601318,3 +4037,0.18442770838737488,0.3507707118988037,0.3381602168083191,0.257342666387558,953.639404296875,1e-05,0.24623212218284607,6.257008075714111,81.14050197601318,3 +4038,0.23670291900634766,0.17873381078243256,0.1716960221529007,0.17482517659664154,930.2188720703125,1e-05,0.13348011672496796,5.971414089202881,81.14050197601318,3 +4039,0.3179352581501007,0.09505150467157364,0.08733197301626205,0.16433566808700562,424.38739013671875,1e-05,0.1962592452764511,5.957910060882568,81.14050197601318,3 +4040,0.257874995470047,0.2751378118991852,0.2568570673465729,0.2242424190044403,844.2090454101562,1e-05,0.36818236112594604,5.983356475830078,81.14050197601318,3 +4041,0.16863501071929932,0.13971678912639618,0.1401076465845108,0.2242424190044403,976.69921875,1e-05,0.13409580290317535,4.096710205078125,81.14050197601318,3 +4042,0.18652071058750153,0.26699817180633545,0.2687440514564514,0.20512820780277252,978.6064453125,1e-05,0.11958564817905426,3.1580049991607666,81.14050197601318,3 +4043,0.37963536381721497,0.4713430106639862,0.4763549268245697,0.15058274567127228,258.84716796875,1e-05,0.12049447000026703,3.085181713104248,81.14050197601318,3 +4044,0.23942220211029053,0.18822714686393738,0.19480827450752258,0.2666666805744171,424.38739013671875,1e-05,0.15410830080509186,3.2927048206329346,81.14050197601318,3 +4045,0.3386942744255066,0.5203220844268799,0.5235080122947693,0.2242424190044403,211.61354064941406,1e-05,0.22407084703445435,3.118037223815918,81.14050197601318,3 +4046,0.2651475667953491,0.13205406069755554,0.12608905136585236,0.10419580340385437,767.5730590820312,1e-05,0.12037183344364166,2.8382840156555176,81.14050197601318,3 +4047,0.3042149245738983,0.25476890802383423,0.2521113455295563,0.19114218652248383,608.6077880859375,1e-05,0.194231316447258,3.0761802196502686,81.14050197601318,3 +4048,0.1511460393667221,0.16883133351802826,0.16322316229343414,0.1538461595773697,978.6064453125,1e-05,0.12824031710624695,3.2871317863464355,81.14050197601318,3 +4049,0.30664750933647156,0.11785072833299637,0.11772355437278748,0.2242424190044403,821.2252807617188,1e-05,0.1482369303703308,3.2373414039611816,81.14050197601318,3 +4050,0.10291299223899841,0.16646338999271393,0.1747635155916214,0.19720280170440674,866.8596801757812,1e-05,0.139043390750885,3.0757241249084473,81.14050197601318,3 +4051,0.11791812628507614,0.24165472388267517,0.21884331107139587,0.20629370212554932,965.4962768554688,1e-05,0.12102487683296204,3.119934320449829,81.14050197601318,3 +4052,0.21052059531211853,0.14051921665668488,0.1457444727420807,0.14731934666633606,961.5278930664062,1e-05,0.13577957451343536,3.149951457977295,81.14050197601318,3 +4053,0.2054847627878189,0.3706221282482147,0.3541972041130066,0.16433566808700562,976.69921875,1e-05,0.0970887541770935,2.848076581954956,81.14050197601318,3 +4054,0.21422888338565826,0.11276812851428986,0.1209157407283783,0.09067598730325699,969.4624633789062,1e-05,0.15246905386447906,3.0931971073150635,81.14050197601318,3 +4055,0.25230708718299866,0.45299622416496277,0.48507246375083923,0.19487179815769196,999.7660522460938,1e-05,0.11670279502868652,3.1316139698028564,81.14050197601318,3 +4056,0.18193066120147705,0.10304411500692368,0.11525202542543411,0.13100233674049377,970.1636352539062,1e-05,0.1582714319229126,3.57861328125,81.14050197601318,3 +4057,0.2507043182849884,0.23380669951438904,0.23247811198234558,0.2594405710697174,973.9156494140625,1e-05,0.13456135988235474,3.665571689605713,81.14050197601318,3 +4058,0.2543715834617615,0.1729007214307785,0.1827826350927353,0.21561771631240845,955.523193359375,1e-05,0.12598513066768646,3.098318338394165,81.14050197601318,3 +4059,0.10243716090917587,0.25382861495018005,0.24443958699703217,0.22773893177509308,835.2010498046875,1e-05,0.1492038518190384,2.8603835105895996,81.14050197601318,3 +4060,0.12944959104061127,0.20186078548431396,0.198944091796875,0.1710955649614334,597.6142578125,1e-05,0.12186218798160553,3.171518325805664,81.14050197601318,3 +4061,0.22415876388549805,0.19791997969150543,0.18022266030311584,0.13449883460998535,993.1259155273438,1e-05,0.15733343362808228,3.424245595932007,81.14050197601318,3 +4062,0.2599250376224518,0.18110837042331696,0.1754695177078247,0.17529137432575226,578.2326049804688,1e-05,0.16869834065437317,3.1661746501922607,81.14050197601318,3 +4063,0.14973467588424683,0.17953257262706757,0.17064128816127777,0.19603729248046875,947.7415161132812,1e-05,0.1501697301864624,3.6133790016174316,81.14050197601318,3 +4064,0.32202422618865967,0.28844425082206726,0.29037320613861084,0.24312354624271393,375.388671875,1e-05,0.11447430402040482,3.795360803604126,81.14050197601318,3 +4065,0.31089112162590027,0.22749191522598267,0.2213449478149414,0.22797203063964844,847.4485473632812,1e-05,0.28556501865386963,3.1627445220947266,81.14050197601318,3 +4066,0.413715124130249,0.09274119138717651,0.09513744711875916,0.0951048955321312,639.041015625,1e-05,0.11709526926279068,3.159008264541626,81.14050197601318,3 +4067,0.24448226392269135,0.17820104956626892,0.18028511106967926,0.21655011177062988,971.03173828125,1e-05,0.1064528226852417,3.297788381576538,81.14050197601318,3 +4068,0.2809177339076996,0.06736905872821808,0.07023242115974426,0.220279723405838,708.8218383789062,1e-05,0.13689376413822174,3.2598068714141846,81.14050197601318,3 +4069,0.20478440821170807,0.2632354199886322,0.24960896372795105,0.24195803701877594,810.0248413085938,1e-05,0.15659961104393005,2.8325412273406982,81.14050197601318,3 +4070,0.2578386664390564,0.18464185297489166,0.17509400844573975,0.2510489523410797,964.5680541992188,1e-05,0.1016373336315155,3.0857582092285156,81.14050197601318,3 +4071,0.19222360849380493,0.2084978222846985,0.21681451797485352,0.1974359005689621,958.17578125,1e-05,0.12167882174253464,2.8541152477264404,81.14050197601318,3 +4072,0.16057650744915009,0.21291740238666534,0.2007521092891693,0.22074592113494873,889.3790893554688,1e-05,0.17275911569595337,3.305156946182251,81.14050197601318,3 +4073,0.1541396975517273,0.10863560438156128,0.10780413448810577,0.2298368364572525,767.5730590820312,1e-05,0.24146321415901184,3.133331298828125,81.14050197601318,3 +4074,0.11002232134342194,0.13327975571155548,0.12986187636852264,0.1790209710597992,870.5208129882812,1e-05,0.1112530454993248,3.2562460899353027,81.14050197601318,3 +4075,0.1375577747821808,0.19754643738269806,0.20285071432590485,0.2433566451072693,931.2932739257812,1e-05,0.14479659497737885,2.823702096939087,81.14050197601318,3 +4076,0.22028739750385284,0.2867075502872467,0.26109227538108826,0.17832167446613312,987.2093505859375,1e-05,0.13725492358207703,3.6360278129577637,81.14050197601318,3 +4077,0.26100000739097595,0.25156232714653015,0.252478688955307,0.2405594438314438,687.85546875,1e-05,0.15899835526943207,2.8491575717926025,81.14050197601318,3 +4078,0.29053953289985657,0.3525209426879883,0.33630144596099854,0.2174825221300125,443.50128173828125,1e-05,0.25329047441482544,3.4477217197418213,81.14050197601318,3 +4079,0.20496916770935059,0.17067885398864746,0.1666983962059021,0.26596736907958984,839.2100219726562,1e-05,0.14370036125183105,3.336082696914673,81.14050197601318,3 +4080,0.3177659511566162,0.3143022954463959,0.31228914856910706,0.18857808411121368,980.6212768554688,1e-05,0.1273629516363144,3.214447498321533,81.14050197601318,3 +4081,0.21665386855602264,0.19078466296195984,0.19212965667247772,0.1895104944705963,805.1764526367188,1e-05,0.11101789027452469,2.945173501968384,81.14050197601318,3 +4082,0.22408993542194366,0.14364461600780487,0.14409670233726501,0.2745920717716217,630.94677734375,1e-05,0.15845699608325958,3.1173202991485596,81.14050197601318,3 +4083,0.2340260148048401,0.5457940697669983,0.5744106769561768,0.18018648028373718,127.0761489868164,1e-05,0.10750339180231094,3.1280360221862793,81.14050197601318,3 +4084,0.2108633667230606,0.12947265803813934,0.1296733021736145,0.25920745730400085,868.7028198242188,1e-05,0.1324552446603775,3.3618650436401367,81.14050197601318,3 +4085,0.3231212794780731,0.3271982669830322,0.31274113059043884,0.1895104944705963,979.3876342773438,1e-05,0.13450400531291962,3.110059976577759,81.14050197601318,3 +4086,0.23816564679145813,0.39157867431640625,0.3755447268486023,0.12820512056350708,989.8240966796875,1e-05,0.15840063989162445,3.0471529960632324,81.14050197601318,3 +4087,0.1509094387292862,0.12350387871265411,0.13062380254268646,0.11794871836900711,923.525634765625,1e-05,0.10459258407354355,2.96407151222229,81.14050197601318,3 +4088,0.26789766550064087,0.23441201448440552,0.24226129055023193,0.11328671127557755,400.70562744140625,1e-05,0.18701153993606567,3.3021557331085205,81.14050197601318,3 +4089,0.23004135489463806,0.2538887560367584,0.23743557929992676,0.23193472623825073,622.5833740234375,1e-05,0.12375625967979431,3.3266665935516357,81.14050197601318,3 +4090,0.34004098176956177,0.23890051245689392,0.244771808385849,0.17272727191448212,692.97265625,1e-05,0.14704570174217224,3.281898260116577,81.14050197601318,3 +4091,0.15581977367401123,0.31945112347602844,0.3249222934246063,0.15617716312408447,980.0068969726562,1e-05,0.20178364217281342,3.235964298248291,81.14050197601318,3 +4092,0.20351654291152954,0.2331726998090744,0.2330274134874344,0.21631701290607452,923.8132934570312,1e-05,0.14636163413524628,4.239119052886963,81.14050197601318,3 +4093,0.24022559821605682,0.12922562658786774,0.14574800431728363,0.225874125957489,940.4759521484375,1e-05,0.15570388734340668,6.052273750305176,81.14050197601318,3 +4094,0.05137452855706215,0.23125384747982025,0.23259666562080383,0.27389276027679443,962.2981567382812,1e-05,0.08919110894203186,6.6705803871154785,81.14050197601318,3 +4095,0.27420923113822937,0.2870297431945801,0.29145535826683044,0.1895104944705963,978.2918701171875,1e-05,0.1404131054878235,6.341840505599976,81.14050197601318,3 +4096,0.3026001453399658,0.33085522055625916,0.31961962580680847,0.23799534142017365,964.5680541992188,1e-05,0.14041419327259064,6.211937427520752,81.14050197601318,3 +4097,0.3393235504627228,0.46378400921821594,0.4346473515033722,0.23916083574295044,991.954833984375,1e-05,0.11605142056941986,6.361534833908081,81.14050197601318,3 +4098,0.3677036762237549,0.1470853090286255,0.14275586605072021,0.139860138297081,861.1730346679688,1e-05,0.1348738670349121,6.335361957550049,81.14050197601318,3 +4099,0.2781068980693817,0.19722096621990204,0.19749419391155243,0.2142191082239151,980.1610107421875,1e-05,0.11078330874443054,6.376051902770996,81.14050197601318,3 +4100,0.26997607946395874,0.14151866734027863,0.13978585600852966,0.220279723405838,782.640625,1e-05,0.13039425015449524,3.248411178588867,81.14050197601318,3 +4101,0.12694403529167175,0.24552908539772034,0.22996659576892853,0.21212121844291687,904.6971435546875,1e-05,0.10261167585849762,3.432847023010254,81.14050197601318,3 +4102,0.35590559244155884,0.31031811237335205,0.28351038694381714,0.23123542964458466,991.954833984375,1e-05,0.11760658025741577,3.1574172973632812,81.14050197601318,3 +4103,0.34508228302001953,0.22294388711452484,0.21888810396194458,0.2689976692199707,986.221923828125,1e-05,0.11243846267461777,3.6269187927246094,81.14050197601318,3 +4104,0.32558417320251465,0.24611777067184448,0.23318739235401154,0.23076923191547394,893.9605712890625,1e-05,0.11191972345113754,3.1019887924194336,81.14050197601318,3 +4105,0.3607083559036255,0.17259661853313446,0.18648585677146912,0.10303030163049698,393.64630126953125,1e-05,0.1655070036649704,2.8467230796813965,81.14050197601318,3 +4106,0.1628238558769226,0.36084574460983276,0.3507347106933594,0.19417248666286469,993.7682495117188,1e-05,0.1256314516067505,3.2619986534118652,81.14050197601318,3 +4107,0.23048093914985657,0.10779882967472076,0.10436639934778214,0.2242424190044403,742.382080078125,1e-05,0.3204984962940216,3.3711390495300293,81.14050197601318,3 +4108,0.2195223718881607,0.2378968745470047,0.22663995623588562,0.2142191082239151,928.31103515625,1e-05,0.13062657415866852,3.4675915241241455,81.14050197601318,3 +4109,0.22318020462989807,0.17978113889694214,0.17611052095890045,0.23286713659763336,892.831298828125,1e-05,0.10972966253757477,3.1513171195983887,81.14050197601318,3 +4110,0.25311148166656494,0.192322239279747,0.18329936265945435,0.19393938779830933,797.257080078125,1e-05,0.15322096645832062,2.8611278533935547,81.14050197601318,3 +4111,0.1469481885433197,0.25065550208091736,0.24393975734710693,0.2449883371591568,700.4320068359375,1e-05,0.11845643073320389,3.0302746295928955,81.14050197601318,3 +4112,0.2956717610359192,0.22178561985492706,0.21431435644626617,0.1878787875175476,707.6432495117188,1e-05,0.15163029730319977,2.8681397438049316,81.14050197601318,3 +4113,0.14876531064510345,0.16520662605762482,0.16607239842414856,0.20000000298023224,823.7489624023438,1e-05,0.1173497661948204,3.4987006187438965,81.14050197601318,3 +4114,0.26042836904525757,0.18603797256946564,0.19922444224357605,0.19160838425159454,973.2462768554688,1e-05,0.17933379113674164,3.359062910079956,81.14050197601318,3 +4115,0.16828122735023499,0.13760602474212646,0.1299431174993515,0.18974359333515167,922.0755004882812,1e-05,0.15009991824626923,4.135814428329468,81.14050197601318,3 +4116,0.2021021693944931,0.19636030495166779,0.20116358995437622,0.22470861673355103,790.488037109375,1e-05,0.4470917880535126,3.5358574390411377,81.14050197601318,3 +4117,0.29908233880996704,0.19152601063251495,0.18073341250419617,0.1766899824142456,871.4204711914062,1e-05,0.14083059132099152,3.0674712657928467,81.14050197601318,3 +4118,0.2473859190940857,0.1742699295282364,0.1694653332233429,0.2722610831260681,759.5440063476562,1e-05,0.14442452788352966,2.8606863021850586,81.14050197601318,3 +4119,0.16952598094940186,0.1559053361415863,0.15829157829284668,0.2599067687988281,762.2591552734375,1e-05,0.23409216105937958,3.1516079902648926,81.14050197601318,3 +4120,0.257380872964859,0.15305694937705994,0.15584848821163177,0.07389277219772339,864.9906616210938,1e-05,0.12102432548999786,3.427448034286499,81.14050197601318,3 +4121,0.07897023111581802,0.2934079170227051,0.3169611096382141,0.17039626836776733,982.5844116210938,1e-05,0.1789793223142624,3.60662579536438,81.14050197601318,3 +4122,0.18226458132266998,0.2265845239162445,0.20645199716091156,0.21888111531734467,720.25927734375,1e-05,0.22653116285800934,4.003807067871094,81.14050197601318,3 +4123,0.3496253490447998,0.28908056020736694,0.2804099917411804,0.20093239843845367,458.6604309082031,1e-05,0.26095497608184814,3.6546759605407715,81.14050197601318,3 +4124,0.2245846390724182,0.09723582863807678,0.09133901447057724,0.20629370212554932,790.488037109375,1e-05,0.134277805685997,3.2827706336975098,81.14050197601318,3 +4125,0.162823885679245,0.29268327355384827,0.29985037446022034,0.20233100652694702,998.4646606445312,1e-05,0.15265053510665894,3.3549177646636963,81.14050197601318,3 +4126,0.17192700505256653,0.09426768124103546,0.09103238582611084,0.2242424190044403,890.5407104492188,1e-05,0.14044667780399323,3.079582929611206,81.14050197601318,3 +4127,0.08637645840644836,0.10557325929403305,0.11626551300287247,0.10699300467967987,995.035400390625,1e-05,0.12107222527265549,3.3706612586975098,81.14050197601318,3 +4128,0.3878808319568634,0.2687109410762787,0.24333098530769348,0.2433566451072693,962.6806640625,1e-05,0.17455890774726868,2.8420956134796143,81.14050197601318,3 +4129,0.3308807611465454,0.30974704027175903,0.29722774028778076,0.26806527376174927,872.3140258789062,1e-05,0.1401429921388626,3.056553363800049,81.14050197601318,3 +4130,0.28315433859825134,0.3528982400894165,0.4054946303367615,0.1934731900691986,158.9905548095703,1e-05,0.12609809637069702,3.1628823280334473,81.14050197601318,3 +4131,0.18735748529434204,0.2907324433326721,0.28470689058303833,0.16876456141471863,991.4281005859375,1e-05,0.9584968686103821,3.146940231323242,81.14050197601318,3 +4132,0.420576810836792,0.24436679482460022,0.23839141428470612,0.14219114184379578,527.8575439453125,1e-05,0.1318245679140091,3.075037956237793,81.14050197601318,3 +4133,0.21034452319145203,0.36936479806900024,0.35451483726501465,0.2002331018447876,972.7406005859375,1e-05,0.12929703295230865,3.3526837825775146,81.14050197601318,3 +4134,0.22008278965950012,0.18141289055347443,0.17775635421276093,0.17972028255462646,950.8469848632812,1e-05,0.1404929906129837,2.828850269317627,81.14050197601318,3 +4135,0.13235150277614594,0.41897884011268616,0.4254634380340576,0.13100233674049377,982.5844116210938,1e-05,0.457135409116745,3.0608577728271484,81.14050197601318,3 +4136,0.16459034383296967,0.199294775724411,0.19168807566165924,0.2566433548927307,839.7739868164062,1e-05,0.15747961401939392,3.144451141357422,81.14050197601318,3 +4137,0.21667328476905823,0.30952754616737366,0.3221939504146576,0.2097902148962021,965.8648071289062,1e-05,0.16301096975803375,3.128406524658203,81.14050197601318,3 +4138,0.15260423719882965,0.3165338635444641,0.29443371295928955,0.2769230902194977,975.0736083984375,1e-05,0.14774279296398163,3.10447096824646,81.14050197601318,3 +4139,0.3255649507045746,0.29767170548439026,0.2815372049808502,0.24428904056549072,642.2061767578125,1e-05,0.14483435451984406,3.0766212940216064,81.14050197601318,3 +4140,0.22488924860954285,0.17439371347427368,0.16438035666942596,0.20792540907859802,671.7659301757812,1e-05,0.17354948818683624,3.024268627166748,81.14050197601318,3 +4141,0.2750343382358551,0.17274348437786102,0.1733848750591278,0.20093239843845367,914.2007446289062,1e-05,0.22688481211662292,2.8357114791870117,81.14050197601318,3 +4142,0.21813537180423737,0.22280709445476532,0.22499126195907593,0.13333334028720856,495.12713623046875,1e-05,0.14238588511943817,3.4556477069854736,81.14050197601318,3 +4143,0.16667290031909943,0.0886707454919815,0.09735394269227982,0.13123543560504913,934.9658203125,1e-05,0.24499808251857758,3.32373309135437,81.14050197601318,3 +4144,0.21640285849571228,0.14562293887138367,0.14919829368591309,0.2526806592941284,806.5763549804688,1e-05,0.16095024347305298,3.3128371238708496,81.14050197601318,3 +4145,0.2459208369255066,0.21525858342647552,0.20870262384414673,0.24685314297676086,687.85546875,1e-05,0.17718695104122162,3.095681667327881,81.14050197601318,3 +4146,0.2760196030139923,0.19099357724189758,0.1772565096616745,0.19324009120464325,871.4204711914062,1e-05,0.12444605678319931,3.025033473968506,81.14050197601318,3 +4147,0.16110476851463318,0.2734280228614807,0.2662254571914673,0.2461538463830948,489.7753601074219,1e-05,0.12521451711654663,2.8282418251037598,81.14050197601318,3 +4148,0.1448799967765808,0.19845758378505707,0.2150772660970688,0.20512820780277252,788.1709594726562,1e-05,0.14872990548610687,3.309295415878296,81.14050197601318,3 +4149,0.22032706439495087,0.2592000365257263,0.2482145130634308,0.21888111531734467,800.1805419921875,1e-05,0.12510481476783752,3.1431806087493896,81.14050197601318,3 +4150,0.23668038845062256,0.2540532946586609,0.26103246212005615,0.17132866382598877,864.5192260742188,1e-05,0.15562936663627625,3.081981897354126,81.14050197601318,3 +4151,0.21030080318450928,0.2120749056339264,0.20241804420948029,0.220279723405838,645.3312377929688,1e-05,0.1596517115831375,3.1151280403137207,81.14050197601318,3 +4152,0.24430397152900696,0.46918684244155884,0.4717468023300171,0.16876456141471863,999.2957763671875,1e-05,0.11962062865495682,3.035996675491333,81.14050197601318,3 +4153,0.19482702016830444,0.3202824294567108,0.30216488242149353,0.1958041936159134,983.9144897460938,1e-05,0.11504776775836945,2.829951047897339,81.14050197601318,3 +4154,0.2703939378261566,0.2541842758655548,0.2495470643043518,0.2174825221300125,937.2574462890625,1e-05,0.16373422741889954,3.4460256099700928,81.14050197601318,3 +4155,0.33426862955093384,0.3181745111942291,0.312308669090271,0.17296037077903748,305.9609069824219,1e-05,0.14422902464866638,3.0934040546417236,81.14050197601318,3 +4156,0.19098840653896332,0.2745576798915863,0.25468918681144714,0.22773893177509308,984.4981079101562,1e-05,0.11066082119941711,3.074037551879883,81.14050197601318,3 +4157,0.25453153252601624,0.22389741241931915,0.2267286628484726,0.18275058269500732,945.9192504882812,1e-05,0.16439825296401978,3.130180597305298,81.14050197601318,3 +4158,0.18833106756210327,0.31542056798934937,0.28459733724594116,0.17692308127880096,947.9669189453125,1e-05,0.7712218165397644,3.0083730220794678,81.14050197601318,3 +4159,0.1974027156829834,0.062350112944841385,0.07319236546754837,0.17832167446613312,840.3358154296875,1e-05,0.1265694797039032,3.0499305725097656,81.14050197601318,3 +4160,0.21129873394966125,0.21118490397930145,0.2007923275232315,0.1958041936159134,728.9754028320312,1e-05,0.191498264670372,3.1245055198669434,81.14050197601318,3 +4161,0.18916937708854675,0.24040429294109344,0.21854226291179657,0.20233100652694702,971.5481567382812,1e-05,0.16250601410865784,3.0157768726348877,81.14050197601318,3 +4162,0.2819589674472809,0.3827417492866516,0.36771270632743835,0.21072261035442352,987.906494140625,1e-05,0.16604799032211304,3.0884974002838135,81.14050197601318,3 +4163,0.3365129232406616,0.26507022976875305,0.26533666253089905,0.19510489702224731,965.8648071289062,1e-05,0.14643527567386627,3.130722999572754,81.14050197601318,3 +4164,0.14852552115917206,0.30754682421684265,0.31610482931137085,0.04545454680919647,977.0203857421875,1e-05,0.17284554243087769,3.0182597637176514,81.14050197601318,3 +4165,0.20203471183776855,0.2174167037010193,0.2198825478553772,0.06666667014360428,508.12554931640625,1e-05,0.14022964239120483,3.099951982498169,81.14050197601318,3 +4166,0.21526750922203064,0.1894177496433258,0.17624998092651367,0.19930069148540497,599.4783325195312,1e-05,0.17783531546592712,3.368504524230957,81.14050197601318,3 +4167,0.13354364037513733,0.30285534262657166,0.30615052580833435,0.1790209710597992,935.22314453125,1e-05,0.1498040109872818,3.4288125038146973,81.14050197601318,3 +4168,0.4043728709220886,0.3088253140449524,0.2976049482822418,0.21771562099456787,555.2279663085938,1e-05,0.15518218278884888,3.1443841457366943,81.14050197601318,3 +4169,0.26222220063209534,0.06431478261947632,0.07051365822553635,0.13939394056797028,836.9324951171875,1e-05,0.1389734297990799,3.072270393371582,81.14050197601318,3 +4170,0.2815456986427307,0.16810186207294464,0.1616618037223816,0.16759906709194183,947.2893676757812,1e-05,0.12993498146533966,3.066378355026245,81.14050197601318,3 +4171,0.18499645590782166,0.16976992785930634,0.16972683370113373,0.003496503457427025,505.5683898925781,1e-05,0.2079107016324997,3.1333186626434326,81.14050197601318,3 +4172,0.11274584382772446,0.11059778183698654,0.12092048674821854,0.17296037077903748,774.4262084960938,1e-05,0.19854773581027985,3.0652949810028076,81.14050197601318,3 +4173,0.2981341779232025,0.6637825965881348,0.6622523069381714,0.20675989985466003,158.9905548095703,1e-05,0.16996504366397858,3.09175181388855,81.14050197601318,3 +4174,0.16850410401821136,0.21878203749656677,0.2057172954082489,0.16200466454029083,926.9263305664062,1e-05,0.14406445622444153,2.8385822772979736,81.14050197601318,3 +4175,0.31779563426971436,0.18401789665222168,0.17409707605838776,0.22331002354621887,801.6233520507812,1e-05,0.16745105385780334,3.117757797241211,81.14050197601318,3 +4176,0.2809959650039673,0.16962900757789612,0.17635147273540497,0.2102564126253128,737.33203125,1e-05,0.12308134138584137,3.1254425048828125,81.14050197601318,3 +4177,0.311428040266037,0.22237500548362732,0.21435846388339996,0.24428904056549072,386.44976806640625,1e-05,0.14608687162399292,3.278148651123047,81.14050197601318,3 +4178,0.21197198331356049,0.3796676695346832,0.34783852100372314,0.17412588000297546,999.9999389648438,1e-05,0.1651526689529419,3.3817954063415527,81.14050197601318,3 +4179,0.17482975125312805,0.15045371651649475,0.16470493376255035,0.25407925248146057,920.0114135742188,1e-05,0.13188135623931885,3.134267568588257,81.14050197601318,3 +4180,0.20075000822544098,0.23857751488685608,0.2276225984096527,0.21445220708847046,909.0570068359375,1e-05,0.17121621966362,2.8348186016082764,81.14050197601318,3 +4181,0.173173189163208,0.18060189485549927,0.17491142451763153,0.20792540907859802,805.1764526367188,1e-05,0.12952111661434174,2.830721855163574,81.14050197601318,3 +4182,0.2199966311454773,0.2746541202068329,0.26497337222099304,0.1678321659564972,929.6773681640625,1e-05,0.15711869299411774,3.356401205062866,81.14050197601318,3 +4183,0.1940312385559082,0.22588223218917847,0.220467209815979,0.22890442609786987,934.7079467773438,1e-05,0.2125493437051773,3.0623042583465576,81.14050197601318,3 +4184,0.14601124823093414,0.3195737600326538,0.3189740478992462,0.21002331376075745,970.1636352539062,1e-05,0.12619996070861816,3.380073308944702,81.14050197601318,3 +4185,0.1835445761680603,0.31637245416641235,0.3176034688949585,0.13333334028720856,411.0456848144531,1e-05,0.1211322471499443,3.0713465213775635,81.14050197601318,3 +4186,0.22169972956180573,0.19536921381950378,0.1852368414402008,0.20209790766239166,790.488037109375,1e-05,0.124234139919281,3.1431643962860107,81.14050197601318,3 +4187,0.16568642854690552,0.26102590560913086,0.24066956341266632,0.2466200441122055,854.2249145507812,1e-05,0.12704822421073914,2.837501287460327,81.14050197601318,3 +4188,0.10855337232351303,0.15800514817237854,0.15503889322280884,0.13939394056797028,990.4967651367188,1e-05,0.12714442610740662,3.334127902984619,81.14050197601318,3 +4189,0.1322023570537567,0.04692118242383003,0.04758165776729584,0.10675990581512451,834.0355224609375,1e-05,0.1090773344039917,3.133178472518921,81.14050197601318,3 +4190,0.2759288549423218,0.15722762048244476,0.16063633561134338,0.19533799588680267,944.9946899414062,1e-05,0.1540791541337967,3.0966079235076904,81.14050197601318,3 +4191,0.26477137207984924,0.24830301105976105,0.23577763140201569,0.22214451432228088,593.8468017578125,1e-05,0.14017227292060852,3.0990734100341797,81.14050197601318,3 +4192,0.1945679783821106,0.20777039229869843,0.19791162014007568,0.2265734225511551,816.0525512695312,1e-05,0.18810346722602844,3.1287338733673096,81.14050197601318,3 +4193,0.15023577213287354,0.28669750690460205,0.2700365483760834,0.18041957914829254,939.2506103515625,1e-05,0.12015365064144135,3.019685745239258,81.14050197601318,3 +4194,0.2833399772644043,0.1263098567724228,0.1279519945383072,0.1818181872367859,956.552734375,1e-05,0.1295231133699417,3.1016910076141357,81.14050197601318,3 +4195,0.16989830136299133,0.18358434736728668,0.173631951212883,0.22191141545772552,836.3575439453125,1e-05,0.2565276026725769,3.133272886276245,81.14050197601318,3 +4196,0.19342589378356934,0.20159800350666046,0.18998710811138153,0.22400932013988495,930.2188720703125,1e-05,0.12808765470981598,3.3680460453033447,81.14050197601318,3 +4197,0.13637033104896545,0.3426201641559601,0.3510676920413971,0.16969697177410126,979.8526000976562,1e-05,0.20500987768173218,3.0517520904541016,81.14050197601318,3 +4198,0.2356587052345276,0.19425511360168457,0.1976817399263382,0.2013985961675644,464.5392150878906,1e-05,0.13492636382579803,2.845895528793335,81.14050197601318,3 +4199,0.20758232474327087,0.11981815099716187,0.12059721350669861,0.14242424070835114,707.6432495117188,1e-05,0.17341852188110352,3.0854756832122803,81.14050197601318,3 +4200,0.1290256381034851,0.28248363733291626,0.2797894775867462,0.20512820780277252,986.9286499023438,1e-05,0.09991103410720825,3.1274406909942627,81.14050197601318,3 +4201,0.2957634925842285,0.7337055802345276,0.7538951635360718,0.21048951148986816,106.90462493896484,1e-05,0.15052902698516846,3.346336841583252,81.14050197601318,3 +4202,0.10755477845668793,0.22560220956802368,0.21710437536239624,0.12354312092065811,884.2141723632812,1e-05,0.13921111822128296,3.064068555831909,81.14050197601318,3 +4203,0.129359632730484,0.12593020498752594,0.12722010910511017,0.23076923191547394,895.8192749023438,1e-05,0.20436939597129822,3.086621046066284,81.14050197601318,3 +4204,0.2622092366218567,0.4390600919723511,0.42686450481414795,0.21048951148986816,993.2548217773438,1e-05,0.1874857246875763,3.0445637702941895,81.14050197601318,3 +4205,0.1739943027496338,0.7175518274307251,0.701051652431488,0.225874125957489,996.64892578125,1e-05,0.11121673882007599,3.0064430236816406,81.14050197601318,3 +4206,0.3231755793094635,0.13604919612407684,0.13705722987651825,0.1818181872367859,734.2389526367188,1e-05,0.14076495170593262,3.059068202972412,81.14050197601318,3 +4207,0.14412850141525269,0.4750192165374756,0.48502641916275024,0.20233100652694702,992.6078491210938,1e-05,0.3029157519340515,3.3304851055145264,81.14050197601318,3 +4208,0.26926371455192566,0.14212462306022644,0.14277181029319763,0.17808857560157776,999.8831176757812,1e-05,0.14624150097370148,3.0938761234283447,81.14050197601318,3 +4209,0.09557440876960754,0.1918317973613739,0.17410899698734283,0.21328671276569366,839.7739868164062,1e-05,0.11188075691461563,2.8322818279266357,81.14050197601318,3 +4210,0.29260843992233276,0.28558236360549927,0.2679294943809509,0.260606050491333,963.0614624023438,1e-05,0.13998883962631226,3.0786731243133545,81.14050197601318,3 +4211,0.18126443028450012,0.22059154510498047,0.20816493034362793,0.15734265744686127,920.0114135742188,1e-05,0.15475860238075256,3.0313010215759277,81.14050197601318,3 +4212,0.2770846486091614,0.21389128267765045,0.20020559430122375,0.20536130666732788,859.7134399414062,1e-05,0.28797221183776855,3.340505599975586,81.14050197601318,3 +4213,0.21931535005569458,0.4916987121105194,0.4917456805706024,0.20000000298023224,996.1564331054688,1e-05,0.17405255138874054,3.3730597496032715,81.14050197601318,3 +4214,0.20859476923942566,0.26297226548194885,0.2645775079727173,0.13333334028720856,979.0761108398438,1e-05,0.12336992472410202,3.4032986164093018,81.14050197601318,3 +4215,0.10265405476093292,0.17141835391521454,0.1574469655752182,0.20606060326099396,902.2786865234375,1e-05,0.164048433303833,2.8386363983154297,81.14050197601318,3 +4216,0.22780847549438477,0.16846199333667755,0.1619977056980133,0.22214451432228088,875.3941650390625,1e-05,0.1578516960144043,3.0616984367370605,81.14050197601318,3 +4217,0.3381829261779785,0.3586999475955963,0.3612799644470215,0.2242424190044403,258.84716796875,1e-05,0.17762874066829681,3.346497058868408,81.14050197601318,3 +4218,0.39678648114204407,0.4495057761669159,0.44348886609077454,0.2298368364572525,296.9483642578125,1e-05,0.13449794054031372,3.0774219036102295,81.14050197601318,3 +4219,0.20942161977291107,0.22503706812858582,0.2266772985458374,0.1818181872367859,911.3367309570312,1e-05,0.13086490333080292,3.1027162075042725,81.14050197601318,3 +4220,0.22564460337162018,0.28551435470581055,0.28285205364227295,0.1946386992931366,489.7753601074219,1e-05,0.21191905438899994,3.3017992973327637,81.14050197601318,3 +4221,0.3205930292606354,0.07465646415948868,0.07444578409194946,0.17039626836776733,868.2445068359375,1e-05,0.1604529172182083,2.8286917209625244,81.14050197601318,3 +4222,0.18092702329158783,0.3662695586681366,0.35117486119270325,0.2214452177286148,997.86474609375,1e-05,0.1503530889749527,3.0790274143218994,81.14050197601318,3 +4223,0.35201698541641235,0.33101898431777954,0.3361615240573883,0.20372959971427917,996.8938598632812,1e-05,0.1333199441432953,3.24639630317688,81.14050197601318,3 +4224,0.16351738572120667,0.17639262974262238,0.15984052419662476,0.23496504127979279,864.9906616210938,1e-05,0.15297748148441315,3.116680860519409,81.14050197601318,3 +4225,0.18229615688323975,0.13653390109539032,0.1284080445766449,0.21445220708847046,860.688232421875,1e-05,0.14041177928447723,3.1158201694488525,81.14050197601318,3 +4226,0.1325036734342575,0.240225151181221,0.22302377223968506,0.26993006467819214,278.3217468261719,1e-05,0.0914682000875473,3.1315455436706543,81.14050197601318,3 +4227,0.10203834623098373,0.3435957133769989,0.3510962128639221,0.1023310050368309,997.0159301757812,1e-05,0.12219449132680893,3.069502353668213,81.14050197601318,3 +4228,0.17154622077941895,0.11934913694858551,0.13287127017974854,0.1794871836900711,916.6853637695312,1e-05,0.14191094040870667,2.8325693607330322,81.14050197601318,3 +4229,0.29085204005241394,0.21503233909606934,0.20792338252067566,0.17016316950321198,936.7528076171875,1e-05,0.1492518186569214,3.2519683837890625,81.14050197601318,3 +4230,0.3897274434566498,0.32875317335128784,0.30097517371177673,0.2501165568828583,910.6900634765625,1e-05,0.1490166038274765,3.420583724975586,81.14050197601318,3 +4231,0.22635382413864136,0.15652282536029816,0.16581062972545624,0.18648017942905426,704.0678100585938,1e-05,0.17313486337661743,3.3118081092834473,81.14050197601318,3 +4232,0.343058705329895,0.28233209252357483,0.28322362899780273,0.21235431730747223,421.0982971191406,1e-05,0.14209961891174316,3.07112193107605,81.14050197601318,3 +4233,0.2801668345928192,0.2822701334953308,0.27400270104408264,0.1862470805644989,714.6185302734375,1e-05,0.12497800588607788,3.0552165508270264,81.14050197601318,3 +4234,0.23736269772052765,0.22493022680282593,0.22673164308071136,0.13636364042758942,976.3768310546875,1e-05,0.13540229201316833,2.8240103721618652,81.14050197601318,3 +4235,0.1039385125041008,0.32170650362968445,0.3042350113391876,0.23426572978496552,990.36279296875,1e-05,0.15707221627235413,3.290903091430664,81.14050197601318,3 +4236,0.17881527543067932,0.13819852471351624,0.1421053260564804,0.16526806354522705,839.2100219726562,1e-05,0.7086578011512756,3.1162757873535156,81.14050197601318,3 +4237,0.17555028200149536,0.19676318764686584,0.19484689831733704,0.13682983815670013,725.7503051757812,1e-05,0.14389640092849731,3.287309408187866,81.14050197601318,3 +4238,0.12446513772010803,0.18006689846515656,0.1698371022939682,0.2282051295042038,905.7181396484375,1e-05,0.14461186528205872,3.068117141723633,81.14050197601318,3 +4239,0.23721057176589966,0.3190595507621765,0.3122450113296509,0.24522145092487335,979.6979370117188,1e-05,0.13406141102313995,3.058418035507202,81.14050197601318,3 +4240,0.15510328114032745,0.2926473915576935,0.3156433403491974,0.1382284313440323,314.781494140625,1e-05,0.19488216936588287,3.0172624588012695,81.14050197601318,3 +4241,0.1880859136581421,0.2651683986186981,0.2685791850090027,0.18111887574195862,508.12554931640625,1e-05,0.13542477786540985,3.0787341594696045,81.14050197601318,3 +4242,0.33508536219596863,0.15404023230075836,0.16364780068397522,0.10652680695056915,968.57763671875,1e-05,0.13890203833580017,3.1579761505126953,81.14050197601318,3 +4243,0.202522411942482,0.2157701551914215,0.21569377183914185,0.22167831659317017,714.6185302734375,1e-05,0.14113032817840576,3.123997688293457,81.14050197601318,3 +4244,0.14779207110404968,0.318830668926239,0.2916099429130554,0.2198135256767273,929.6773681640625,1e-05,0.1191759780049324,3.149212598800659,81.14050197601318,3 +4245,0.2803504168987274,0.19105137884616852,0.1915530413389206,0.20000000298023224,947.0624389648438,1e-05,0.15947943925857544,3.0919973850250244,81.14050197601318,3 +4246,0.19828982651233673,0.3528090715408325,0.3514558970928192,0.2722610831260681,972.9094848632812,1e-05,0.13862761855125427,3.0297598838806152,81.14050197601318,3 +4247,0.24160414934158325,0.26872164011001587,0.2547433376312256,0.16153846681118011,953.0025024414062,1e-05,0.1420968472957611,3.1449880599975586,81.14050197601318,3 +4248,0.1997617930173874,0.12819235026836395,0.13492564857006073,0.23170162737369537,764.9352416992188,1e-05,0.11078935861587524,3.0985496044158936,81.14050197601318,3 +4249,0.09152105450630188,0.2540290653705597,0.23690178990364075,0.24475523829460144,939.7424926757812,1e-05,0.09992112964391708,3.106825828552246,81.14050197601318,3 +4250,0.23747491836547852,0.23470748960971832,0.22885704040527344,0.2298368364572525,954.0613403320312,1e-05,0.13074757158756256,3.0598127841949463,81.14050197601318,3 +4251,0.2494921088218689,0.17740009725093842,0.18104299902915955,0.10606060922145844,938.5079956054688,1e-05,0.20677796006202698,3.1212375164031982,81.14050197601318,3 +4252,0.16569191217422485,0.2528461813926697,0.24707402288913727,0.2293706238269806,947.5157470703125,1e-05,0.14327876269817352,3.0792500972747803,81.14050197601318,3 +4253,0.22050581872463226,0.21355289220809937,0.2222314029932022,0.17272727191448212,348.26116943359375,1e-05,0.14592330157756805,3.086155414581299,81.14050197601318,3 +4254,0.27008509635925293,0.2564135193824768,0.25016146898269653,0.16153846681118011,854.2249145507812,1e-05,0.13564465939998627,3.0223050117492676,81.14050197601318,3 +4255,0.2276807576417923,0.1904342770576477,0.19791528582572937,0.264102578163147,986.079833984375,1e-05,0.12596352398395538,3.0355911254882812,81.14050197601318,3 +4256,0.12043134868144989,0.2763723134994507,0.27081918716430664,0.2198135256767273,839.2100219726562,1e-05,0.18893855810165405,3.0860507488250732,81.14050197601318,3 +4257,0.182332843542099,0.23048914968967438,0.2045987844467163,0.20652680099010468,798.72509765625,1e-05,0.15857148170471191,3.059361457824707,81.14050197601318,3 +4258,0.4014139771461487,0.28433606028556824,0.2665456533432007,0.26363635063171387,709.9939575195312,1e-05,0.20084908604621887,3.022815465927124,81.14050197601318,3 +4259,0.16526782512664795,0.2617179751396179,0.24964061379432678,0.18927739560604095,670.3726196289062,1e-05,0.11858571320772171,3.4002747535705566,81.14050197601318,3 +4260,0.21723398566246033,0.195465087890625,0.1900516152381897,0.23473192751407623,898.011962890625,1e-05,0.19902129471302032,3.0690793991088867,81.14050197601318,3 +4261,0.383461594581604,0.15625563263893127,0.15368236601352692,0.1515151560306549,950.8469848632812,1e-05,0.1892135739326477,3.078157663345337,81.14050197601318,3 +4262,0.13865911960601807,0.3004359304904938,0.2743883430957794,0.24918414652347565,951.2822265625,1e-05,0.14995859563350677,3.1158640384674072,81.14050197601318,3 +4263,0.275781512260437,0.1355508416891098,0.13560546934604645,0.003496503457427025,915.7601928710938,1e-05,0.12157018482685089,3.144031286239624,81.14050197601318,3 +4264,0.25411486625671387,0.2767191529273987,0.26814326643943787,0.17296037077903748,894.70751953125,1e-05,0.2098914384841919,3.079763650894165,81.14050197601318,3 +4265,0.36094990372657776,0.2184540033340454,0.21276894211769104,0.12657342851161957,763.1554565429688,1e-05,0.23499330878257751,3.144073486328125,81.14050197601318,3 +4266,0.21354135870933533,0.3057013750076294,0.28765764832496643,0.2242424190044403,988.4596557617188,1e-05,0.16285869479179382,3.3851370811462402,81.14050197601318,3 +4267,0.23855337500572205,0.2546040713787079,0.24482512474060059,0.23030303418636322,766.697998046875,1e-05,0.15147782862186432,3.1367299556732178,81.14050197601318,3 +4268,0.24427032470703125,0.17203395068645477,0.1693219244480133,0.08648018538951874,942.1655883789062,1e-05,0.13230296969413757,2.828352928161621,81.14050197601318,3 +4269,0.19437053799629211,0.21344496309757233,0.23072759807109833,0.1867132931947708,962.871337890625,1e-05,0.12651632726192474,2.828498125076294,81.14050197601318,3 +4270,0.24792955815792084,0.1929684430360794,0.1898682564496994,0.22727273404598236,777.7576293945312,1e-05,0.31080129742622375,2.8178868293762207,81.14050197601318,3 +4271,0.24147409200668335,0.27049243450164795,0.2549472153186798,0.2310023307800293,652.9728393554688,1e-05,0.1306254118680954,3.087278366088867,81.14050197601318,3 +4272,0.15187856554985046,0.25294622778892517,0.24248656630516052,0.2365967333316803,973.2462768554688,1e-05,0.14611634612083435,3.271069049835205,81.14050197601318,3 +4273,0.1554737240076065,0.13932321965694427,0.1410345882177353,0.2377622425556183,894.3345947265625,1e-05,0.11215534806251526,3.031853437423706,81.14050197601318,3 +4274,0.20692512392997742,0.14828912913799286,0.1430913358926773,0.15034964680671692,723.5714111328125,1e-05,0.11356312781572342,3.053504467010498,81.14050197601318,3 +4275,0.21382513642311096,0.3820258677005768,0.3628023564815521,0.2410256415605545,977.8174438476562,1e-05,0.1715441197156906,3.1022353172302246,81.14050197601318,3 +4276,0.27763527631759644,0.17688480019569397,0.16997818648815155,0.2489510476589203,778.5809936523438,1e-05,0.2288256287574768,3.131871223449707,81.14050197601318,3 +4277,0.20502422749996185,0.21215614676475525,0.19831633567810059,0.22191141545772552,857.2454833984375,1e-05,0.45464447140693665,3.1203019618988037,81.14050197601318,3 +4278,0.39569801092147827,0.10430868715047836,0.11430856585502625,0.16293705999851227,803.7642822265625,1e-05,0.12053021788597107,3.3318192958831787,81.14050197601318,3 +4279,0.24117238819599152,0.15219520032405853,0.15337501466274261,0.1946386992931366,933.1463012695312,1e-05,0.1474115401506424,3.119675874710083,81.14050197601318,3 +4280,0.36403781175613403,0.12286204844713211,0.1252506822347641,0.17575757205486298,682.6182250976562,1e-05,0.11415581405162811,3.114367961883545,81.14050197601318,3 +4281,0.13470600545406342,0.17432528734207153,0.16296537220478058,0.26363635063171387,965.4962768554688,1e-05,0.1968659609556198,3.1224093437194824,81.14050197601318,3 +4282,0.1264643371105194,0.33937227725982666,0.32138997316360474,0.20885780453681946,984.7882080078125,1e-05,0.4386956989765167,3.2047362327575684,81.14050197601318,3 +4283,0.2553309202194214,0.2622796595096588,0.25508731603622437,0.16130536794662476,682.6182250976562,1e-05,0.18564005196094513,3.0555965900421143,81.14050197601318,3 +4284,0.18794284760951996,0.638348400592804,0.6373597383499146,0.19230769574642181,989.41748046875,1e-05,0.14234280586242676,3.0687155723571777,81.14050197601318,3 +4285,0.25948336720466614,0.20623089373111725,0.1997307986021042,0.09440559148788452,597.6142578125,1e-05,0.19961588084697723,3.095357656478882,81.14050197601318,3 +4286,0.10119760036468506,0.20468257367610931,0.196397602558136,0.20000000298023224,925.5228271484375,1e-05,0.33458656072616577,3.1265885829925537,81.14050197601318,3 +4287,0.16144095361232758,0.41708794236183167,0.39715519547462463,0.18694639205932617,994.27783203125,1e-05,0.17875216901302338,3.034384250640869,81.14050197601318,3 +4288,0.3647356331348419,0.2042943388223648,0.21730723977088928,0.15967366099357605,942.4046020507812,1e-05,0.1541839838027954,3.145097494125366,81.14050197601318,3 +4289,0.12696340680122375,0.4032706916332245,0.3644615113735199,0.1930069923400879,969.8138427734375,1e-05,0.17630846798419952,3.0436670780181885,81.14050197601318,3 +4290,0.2156205028295517,0.19144703447818756,0.1887560337781906,0.25034964084625244,940.2321166992188,1e-05,0.16483575105667114,3.050114870071411,81.14050197601318,3 +4291,0.15320590138435364,0.23201748728752136,0.2167166769504547,0.20279720425605774,816.7084350585938,1e-05,0.12237779796123505,3.0810914039611816,81.14050197601318,3 +4292,0.3312869966030121,0.1408790647983551,0.13546571135520935,0.2613053619861603,663.2779541015625,1e-05,0.15797297656536102,3.1091980934143066,81.14050197601318,3 +4293,0.1754763126373291,0.3600386381149292,0.3952435553073883,0.22634032368659973,177.18624877929688,1e-05,0.11840510368347168,3.0593764781951904,81.14050197601318,3 +4294,0.3071605861186981,0.09078364074230194,0.10099653899669647,0.1762237697839737,741.38232421875,1e-05,0.13915923237800598,3.133657217025757,81.14050197601318,3 +4295,0.13229581713676453,0.28948941826820374,0.30103471875190735,0.22074592113494873,975.5648193359375,1e-05,0.10062350332736969,3.033453941345215,81.14050197601318,3 +4296,0.18970519304275513,0.12967582046985626,0.13417311012744904,0.2589743435382843,860.688232421875,1e-05,0.16363343596458435,3.0996906757354736,81.14050197601318,3 +4297,0.32163235545158386,0.9630878567695618,1.0420325994491577,0.17575757205486298,997.5022583007812,1e-05,0.14210237562656403,3.342594623565674,81.14050197601318,3 +4298,0.1364971101284027,0.1390208750963211,0.14840419590473175,0.2512820363044739,775.2649536132812,1e-05,0.14296269416809082,2.827155351638794,81.14050197601318,3 +4299,0.26992616057395935,0.24652758240699768,0.23331348598003387,0.22494173049926758,904.354736328125,1e-05,0.14177429676055908,3.099912166595459,81.14050197601318,3 +4300,0.14885498583316803,0.1809915155172348,0.17450088262557983,0.18857808411121368,882.1692504882812,1e-05,0.41361021995544434,3.342144250869751,81.14050197601318,3 +4301,0.21461358666419983,0.12801873683929443,0.1375029981136322,0.24452213943004608,906.7301635742188,1e-05,0.2551465332508087,3.0787858963012695,81.14050197601318,3 +4302,0.1617596596479416,0.22773438692092896,0.21383248269557953,0.22517482936382294,872.758544921875,1e-05,0.1271148920059204,3.104356050491333,81.14050197601318,3 +4303,0.2693754732608795,0.2654914855957031,0.2744936943054199,0.19766899943351746,931.2932739257812,1e-05,0.14048437774181366,3.057598352432251,81.14050197601318,3 +4304,0.2681511342525482,0.3688449561595917,0.3629089593887329,0.2209790199995041,278.3217468261719,1e-05,0.1279464215040207,2.831059694290161,81.14050197601318,3 +4305,0.17096611857414246,0.3152322471141815,0.3031342625617981,0.20000000298023224,962.4896240234375,1e-05,0.16673752665519714,3.3292577266693115,81.14050197601318,3 +4306,0.24424871802330017,0.16938357055187225,0.1626126766204834,0.06643356382846832,878.82666015625,1e-05,0.1414218544960022,3.346414566040039,81.14050197601318,3 +4307,0.22174665331840515,0.2536994218826294,0.25840216875076294,0.20885780453681946,830.4837646484375,1e-05,0.12610282003879547,3.217296838760376,81.14050197601318,3 +4308,0.34383469820022583,0.3706398010253906,0.38141968846321106,0.18298368155956268,238.46560668945312,1e-05,0.5339421033859253,3.0988895893096924,81.14050197601318,3 +4309,0.32051822543144226,0.19369390606880188,0.1877879500389099,0.285314679145813,829.2810668945312,1e-05,0.19160732626914978,3.106494903564453,81.14050197601318,3 +4310,0.22854764759540558,0.5779309272766113,0.5815070271492004,0.10839160531759262,127.0761489868164,1e-05,0.13739320635795593,3.113356351852417,81.14050197601318,3 +4311,0.3407604396343231,0.23797176778316498,0.22316423058509827,0.18648017942905426,652.9728393554688,1e-05,0.1818552017211914,3.058807373046875,81.14050197601318,3 +4312,0.17882566154003143,0.37566351890563965,0.36555930972099304,0.1878787875175476,990.0938720703125,1e-05,0.1906953752040863,3.3734800815582275,81.14050197601318,3 +4313,0.15483906865119934,0.19527363777160645,0.19267405569553375,0.1846153885126114,911.0138549804688,1e-05,0.13694918155670166,3.2620127201080322,81.14050197601318,3 +4314,0.2439182996749878,0.12200254201889038,0.13416220247745514,0.16456876695156097,539.5704345703125,1e-05,0.13578802347183228,3.0401175022125244,81.14050197601318,3 +4315,0.2730104327201843,0.18709446489810944,0.18717248737812042,0.21398600935935974,977.3401489257812,1e-05,0.12883181869983673,3.1298015117645264,81.14050197601318,3 +4316,0.21237193048000336,0.21491315960884094,0.20716321468353271,0.24125874042510986,924.9560546875,1e-05,0.13855351507663727,3.025982618331909,81.14050197601318,3 +4317,0.22607174515724182,0.11742662638425827,0.13693538308143616,0.18088577687740326,382.7987976074219,1e-05,0.18341831862926483,3.1381466388702393,81.14050197601318,3 +4318,0.32061463594436646,0.34353122115135193,0.32773491740226746,0.1822843849658966,988.5972900390625,1e-05,0.14158464968204498,3.1213016510009766,81.14050197601318,3 +4319,0.35331735014915466,0.376473993062973,0.36005106568336487,0.22447551786899567,988.0452880859375,1e-05,0.1253824681043625,3.0319201946258545,81.14050197601318,3 +4320,0.15281124413013458,0.12305562198162079,0.11840967833995819,0.2582750618457794,889.7675170898438,1e-05,0.1439792364835739,3.1357672214508057,81.14050197601318,3 +4321,0.2641058564186096,0.3110196888446808,0.28842616081237793,0.1850815862417221,938.0095825195312,1e-05,0.1419379711151123,3.1289689540863037,81.14050197601318,3 +4322,0.16889268159866333,0.23175691068172455,0.2224072962999344,0.12214452028274536,720.25927734375,1e-05,0.14258791506290436,3.081350326538086,81.14050197601318,3 +4323,0.38445574045181274,0.26051032543182373,0.25212258100509644,0.21212121844291687,586.15087890625,1e-05,0.13384659588336945,3.2759695053100586,81.14050197601318,3 +4324,0.06853482127189636,0.26198944449424744,0.26831692457199097,0.19254079461097717,983.178466796875,1e-05,0.13870511949062347,3.155776262283325,81.14050197601318,3 +4325,0.159001886844635,0.18983647227287292,0.19978700578212738,0.12564101815223694,860.688232421875,1e-05,0.13939504325389862,3.2752888202667236,81.14050197601318,3 +4326,0.23715271055698395,0.14195765554904938,0.14714330434799194,0.2041957974433899,977.3401489257812,1e-05,0.2035633623600006,3.088019609451294,81.14050197601318,3 +4327,0.20334163308143616,0.17732375860214233,0.1807795912027359,0.23869463801383972,735.275390625,1e-05,0.12878020107746124,3.066641330718994,81.14050197601318,3 +4328,0.26097121834754944,0.3829348385334015,0.37843799591064453,0.2013985961675644,998.7031860351562,1e-05,0.10224542766809464,3.1138923168182373,81.14050197601318,3 +4329,0.2558012902736664,0.3543528914451599,0.33632129430770874,0.19160838425159454,970.5119018554688,1e-05,0.14708156883716583,3.354827404022217,81.14050197601318,3 +4330,0.18917934596538544,0.15174730122089386,0.14534008502960205,0.14289043843746185,920.9009399414062,1e-05,0.12079080939292908,3.155790090560913,81.14050197601318,3 +4331,0.1935994029045105,0.34173956513404846,0.3265921473503113,0.2708624601364136,999.7660522460938,1e-05,0.13579712808132172,3.092315673828125,81.14050197601318,3 +4332,0.3520433306694031,0.5934612154960632,0.5913585424423218,0.20675989985466003,177.18624877929688,1e-05,0.13568095862865448,3.0776736736297607,81.14050197601318,3 +4333,0.09322986751794815,0.36946794390678406,0.34888970851898193,0.2533799409866333,990.8973388671875,1e-05,0.16388772428035736,3.1087629795074463,81.14050197601318,3 +4334,0.2105349898338318,0.1791694462299347,0.17794431746006012,0.12354312092065811,917.2977905273438,1e-05,0.14103931188583374,3.097116708755493,81.14050197601318,3 +4335,0.06594821810722351,0.2539215087890625,0.23677383363246918,0.1890442818403244,949.0853271484375,1e-05,0.10431242734193802,3.1171250343322754,81.14050197601318,3 +4336,0.16128119826316833,0.43387195467948914,0.42993852496147156,0.16083915531635284,996.0327758789062,1e-05,0.15286076068878174,3.2960212230682373,81.14050197601318,3 +4337,0.20188799500465393,0.22422926127910614,0.2193271368741989,0.279720276594162,640.6287231445312,1e-05,0.13695834577083588,2.8235180377960205,81.14050197601318,3 +4338,0.23057030141353607,0.1394752413034439,0.14660730957984924,0.17296037077903748,872.3140258789062,1e-05,0.1373385339975357,3.063673496246338,81.14050197601318,3 +4339,0.23327262699604034,0.21738600730895996,0.21200598776340485,0.12727272510528564,968.57763671875,1e-05,0.12328259646892548,2.8218064308166504,81.14050197601318,3 +4340,0.30623549222946167,0.25348731875419617,0.24847470223903656,0.1766899824142456,979.6979370117188,1e-05,0.13543298840522766,3.2623414993286133,81.14050197601318,3 +4341,0.10457916557788849,0.161917045712471,0.15467402338981628,0.19650349020957947,774.4262084960938,1e-05,0.11341322213411331,3.080793619155884,81.14050197601318,3 +4342,0.2866940200328827,0.368437796831131,0.3855013847351074,0.22004662454128265,233.2209930419922,1e-05,0.1320868879556656,3.3558192253112793,81.14050197601318,3 +4343,0.17312805354595184,0.2148573398590088,0.20267602801322937,0.24428904056549072,948.1915893554688,1e-05,0.13379135727882385,2.8286619186401367,81.14050197601318,3 +4344,0.2409375160932541,0.2004619985818863,0.19196945428848267,0.25361305475234985,882.5809936523438,1e-05,0.13381445407867432,3.359055757522583,81.14050197601318,3 +4345,0.1762388050556183,0.38480931520462036,0.36440595984458923,0.21212121844291687,986.221923828125,1e-05,0.19095776975154877,2.841318368911743,81.14050197601318,3 +4346,0.2614474296569824,0.16589245200157166,0.15873059630393982,0.17435897886753082,936.2454833984375,1e-05,0.3258454203605652,3.077099084854126,81.14050197601318,3 +4347,0.20535805821418762,0.21750476956367493,0.2070240080356598,0.23706293106079102,978.4493408203125,1e-05,0.12713146209716797,3.366344451904297,81.14050197601318,3 +4348,0.15060938894748688,0.25920137763023376,0.2592150866985321,0.23706293106079102,946.1489868164062,1e-05,0.20004022121429443,3.258432388305664,81.14050197601318,3 +4349,0.16581116616725922,0.19093814492225647,0.21146975457668304,0.1314685344696045,996.8938598632812,1e-05,0.11133462190628052,3.0229995250701904,81.14050197601318,3 +4350,0.42351192235946655,0.2627352774143219,0.25503429770469666,0.279720276594162,505.5683898925781,1e-05,0.18773820996284485,3.0947766304016113,81.14050197601318,3 +4351,0.2687161862850189,0.12612713873386383,0.12364516407251358,0.16083915531635284,737.33203125,1e-05,0.4485337734222412,2.8208107948303223,81.14050197601318,3 +4352,0.1701231598854065,0.1516829878091812,0.1614609807729721,0.19114218652248383,840.3358154296875,1e-05,0.12338763475418091,3.302870750427246,81.14050197601318,3 +4353,0.16429521143436432,0.2838900089263916,0.2881394922733307,0.15034964680671692,960.7506713867188,1e-05,0.14145202934741974,3.075892686843872,81.14050197601318,3 +4354,0.31172919273376465,0.19163507223129272,0.1899999976158142,0.2058275043964386,624.2781982421875,1e-05,0.17222072184085846,3.0327742099761963,81.14050197601318,3 +4355,0.18040645122528076,0.3522835075855255,0.3528502285480499,0.14731934666633606,979.2321166992188,1e-05,0.09878265857696533,3.0826315879821777,81.14050197601318,3 +4356,0.12280600517988205,0.2503069341182709,0.24042169749736786,0.15804195404052734,937.5089111328125,1e-05,0.6378328800201416,3.125854015350342,81.14050197601318,3 +4357,0.12379395961761475,0.14290373027324677,0.1355891227722168,0.18531468510627747,870.5208129882812,1e-05,0.366965115070343,3.019813299179077,81.14050197601318,3 +4358,0.4085598886013031,0.1928287148475647,0.18855436146259308,0.23240093886852264,578.2326049804688,1e-05,0.1564113348722458,3.3767249584198,81.14050197601318,3 +4359,0.1745622158050537,0.19610656797885895,0.18854482471942902,0.18205128610134125,755.8615112304688,1e-05,0.1276128739118576,3.114583969116211,81.14050197601318,3 +4360,0.1836642622947693,0.20784799754619598,0.20124493539333344,0.2337995320558548,971.2042846679688,1e-05,0.12772715091705322,3.0711185932159424,81.14050197601318,3 +4361,0.1988919973373413,0.31462451815605164,0.295462965965271,0.19976690411567688,997.259521484375,1e-05,0.17875532805919647,3.0521578788757324,81.14050197601318,3 +4362,0.1832214593887329,0.3282224237918854,0.3256293535232544,0.2226107269525528,975.5648193359375,1e-05,0.1414184272289276,3.0658979415893555,81.14050197601318,3 +4363,0.2827286720275879,0.2722495496273041,0.2665271759033203,0.15897436439990997,935.4796752929688,1e-05,0.14256013929843903,3.0372517108917236,81.14050197601318,3 +4364,0.106809601187706,0.1715187430381775,0.1705283522605896,0.22797203063964844,949.5288696289062,1e-05,0.1919557899236679,3.084627866744995,81.14050197601318,3 +4365,0.22671876847743988,0.2789969742298126,0.2671825587749481,0.2097902148962021,464.5392150878906,1e-05,0.1895362138748169,3.109715461730957,81.14050197601318,3 +4366,0.17761138081550598,0.17782002687454224,0.18077623844146729,0.19393938779830933,938.5079956054688,1e-05,0.1065368577837944,3.0734410285949707,81.14050197601318,3 +4367,0.1992630809545517,0.2630961835384369,0.26485371589660645,0.24708624184131622,957.9745483398438,1e-05,0.14743542671203613,3.327768325805664,81.14050197601318,3 +4368,0.2740868926048279,0.12377557903528214,0.12947334349155426,0.19976690411567688,727.9061279296875,1e-05,0.16857029497623444,2.8330841064453125,81.14050197601318,3 +4369,0.41598108410835266,0.23358625173568726,0.23241835832595825,0.16806526482105255,434.07476806640625,1e-05,0.3260882794857025,3.272071361541748,81.14050197601318,3 +4370,0.20010575652122498,0.14835450053215027,0.1344986855983734,0.18484848737716675,697.9737548828125,1e-05,0.16425752639770508,3.093372344970703,81.14050197601318,3 +4371,0.25576239824295044,0.25515395402908325,0.23735830187797546,0.20000000298023224,893.9605712890625,1e-05,0.21069759130477905,3.1950740814208984,81.14050197601318,3 +4372,0.2522153854370117,0.21212780475616455,0.1950937807559967,0.18438228964805603,830.4837646484375,1e-05,0.11446534097194672,3.0426673889160156,81.14050197601318,3 +4373,0.3242771625518799,0.20669595897197723,0.1988966017961502,0.2041957974433899,884.2141723632812,1e-05,0.13902023434638977,3.297870397567749,81.14050197601318,3 +4374,0.3282233774662018,0.2521226108074188,0.23100487887859344,0.21631701290607452,584.1925659179688,1e-05,0.12472586333751678,2.8301825523376465,81.14050197601318,3 +4375,0.14160263538360596,0.2238955944776535,0.23823410272598267,0.1610722541809082,840.3358154296875,1e-05,0.23755349218845367,3.3466532230377197,81.14050197601318,3 +4376,0.21868199110031128,0.29686105251312256,0.28397583961486816,0.274125874042511,912.93701171875,1e-05,0.22606490552425385,3.0906059741973877,81.14050197601318,3 +4377,0.20413005352020264,0.36692824959754944,0.3541804850101471,0.17832167446613312,994.27783203125,1e-05,0.12038012593984604,3.376555919647217,81.14050197601318,3 +4378,0.23776482045650482,0.2466379702091217,0.23707284033298492,0.21212121844291687,767.5730590820312,1e-05,0.35757043957710266,3.3058135509490967,81.14050197601318,3 +4379,0.21761658787727356,0.3220638036727905,0.31243401765823364,0.21212121844291687,957.9745483398438,1e-05,0.19952568411827087,3.056511878967285,81.14050197601318,3 +4380,0.11967639625072479,0.28685396909713745,0.26837801933288574,0.24125874042510986,961.334228515625,1e-05,0.15650102496147156,2.831967353820801,81.14050197601318,3 +4381,0.20998303592205048,0.19166605174541473,0.1927558183670044,0.23333333432674408,733.1973266601562,1e-05,0.1736585646867752,3.1327247619628906,81.14050197601318,3 +4382,0.15900906920433044,0.12960049510002136,0.1487939953804016,0.17832167446613312,913.5706787109375,1e-05,0.3243778944015503,3.091573715209961,81.14050197601318,3 +4383,0.1580321043729782,0.3647943437099457,0.35925745964050293,0.2265734225511551,991.0303955078125,1e-05,0.13428857922554016,3.3193142414093018,81.14050197601318,3 +4384,0.2313334345817566,0.23751109838485718,0.23560868203639984,0.2237762212753296,956.75732421875,1e-05,0.22502446174621582,3.0155694484710693,81.14050197601318,3 +4385,0.24952012300491333,0.29724034667015076,0.28273311257362366,0.17179487645626068,843.6619262695312,1e-05,0.352426141500473,3.0760536193847656,81.14050197601318,3 +4386,0.1382816731929779,0.12620608508586884,0.12639157474040985,0.11095570772886276,881.756103515625,1e-05,0.23544104397296906,2.8181135654449463,81.14050197601318,3 +4387,0.21653293073177338,0.25097909569740295,0.2468518763780594,0.18391607701778412,989.9591064453125,1e-05,0.12155468761920929,3.0889816284179688,81.14050197601318,3 +4388,0.20155426859855652,0.5440765023231506,0.5228148698806763,0.23310023546218872,993.7682495117188,1e-05,0.2169582098722458,3.4287381172180176,81.14050197601318,3 +4389,0.2415478378534317,0.14252851903438568,0.15599583089351654,0.1867132931947708,972.231689453125,1e-05,0.17869159579277039,3.313399076461792,81.14050197601318,3 +4390,0.18529146909713745,0.2557213604450226,0.23849371075630188,0.19603729248046875,986.5054321289062,1e-05,0.25156545639038086,3.001425266265869,81.14050197601318,3 +4391,0.3025026321411133,0.17796504497528076,0.193989560008049,0.10372960567474365,991.954833984375,1e-05,0.1776331067085266,3.1134033203125,81.14050197601318,3 +4392,0.05530685558915138,0.15028893947601318,0.1488838791847229,0.22284382581710815,908.3971557617188,1e-05,0.13808844983577728,2.8280251026153564,81.14050197601318,3 +4393,0.2015342116355896,0.13400870561599731,0.14051136374473572,0.22750583291053772,750.1998901367188,1e-05,0.1464424580335617,3.3599090576171875,81.14050197601318,3 +4394,0.3430895209312439,0.19561298191547394,0.17752023041248322,0.20046620070934296,929.1331176757812,1e-05,0.17142467200756073,3.259610891342163,81.14050197601318,3 +4395,0.11413116008043289,0.13494223356246948,0.13494223356246948,0.0,941.926025390625,1e-05,0.12945644557476044,3.078753709793091,81.14050197601318,3 +4396,0.3018572926521301,0.2892102003097534,0.28195124864578247,0.24708624184131622,452.67730712890625,1e-05,0.1414717435836792,3.079875946044922,81.14050197601318,3 +4397,0.1451944261789322,0.250448614358902,0.2428966909646988,0.09487179666757584,925.8049926757812,1e-05,0.12738867104053497,3.135093927383423,81.14050197601318,3 +4398,0.15134508907794952,0.3173736333847046,0.3011471927165985,0.20652680099010468,959.3736572265625,1e-05,0.13272011280059814,2.857387065887451,81.14050197601318,3 +4399,0.1901800036430359,0.19523438811302185,0.19553449749946594,0.12191142141819,712.31884765625,1e-05,0.29155394434928894,3.339740514755249,81.14050197601318,3 +4400,0.33260971307754517,0.5424274206161499,0.5291593670845032,0.25757575035095215,177.18624877929688,1e-05,0.1336471289396286,3.1661148071289062,81.14050197601318,3 +4401,0.3690067529678345,0.4249532222747803,0.41396427154541016,0.20349650084972382,470.316650390625,1e-05,0.1768716275691986,3.043921709060669,81.14050197601318,3 +4402,0.24015304446220398,0.23032578825950623,0.21387431025505066,0.26247087121009827,752.1058349609375,1e-05,0.17751111090183258,3.093801736831665,81.14050197601318,3 +4403,0.1852954477071762,0.1064176931977272,0.1147998720407486,0.21841491758823395,850.6163940429688,1e-05,0.10387644916772842,3.0480878353118896,81.14050197601318,3 +4404,0.1676713079214096,0.22448495030403137,0.2270418256521225,0.25314685702323914,943.8261108398438,1e-05,0.09951101988554001,3.0923542976379395,81.14050197601318,3 +4405,0.1545092612504959,0.3450288772583008,0.33945199847221375,0.23333333432674408,980.0068969726562,1e-05,0.16615328192710876,3.095412015914917,81.14050197601318,3 +4406,0.23970377445220947,0.17900754511356354,0.172509104013443,0.1874125897884369,775.2649536132812,1e-05,0.13123050332069397,3.37076473236084,81.14050197601318,3 +4407,0.24683091044425964,0.16235794126987457,0.1624491959810257,0.14755244553089142,935.22314453125,1e-05,0.20063985884189606,3.034541606903076,81.14050197601318,3 +4408,0.2752622067928314,0.15295614302158356,0.14568234980106354,0.12680652737617493,869.15966796875,1e-05,0.13158582150936127,3.0141966342926025,81.14050197601318,3 +4409,0.22694280743598938,0.25863897800445557,0.2664724588394165,0.19557109475135803,958.576904296875,1e-05,0.14033198356628418,3.106828212738037,81.14050197601318,3 +4410,0.16109101474285126,0.19778239727020264,0.18631461262702942,0.15058274567127228,866.3948974609375,1e-05,0.1343287229537964,3.093432903289795,81.14050197601318,3 +4411,0.26667317748069763,0.223934605717659,0.21096764504909515,0.2018647938966751,932.0916137695312,1e-05,0.2552582919597626,3.3681437969207764,81.14050197601318,3 +4412,0.2736051380634308,0.1817598044872284,0.17919929325580597,0.2449883371591568,661.8328857421875,1e-05,0.15034103393554688,3.185384750366211,81.14050197601318,3 +4413,0.25742483139038086,0.4243037700653076,0.4159988462924957,0.1902097910642624,273.5347900390625,1e-05,0.18790121376514435,3.0503811836242676,81.14050197601318,3 +4414,0.30793049931526184,0.22798317670822144,0.23409876227378845,0.15897436439990997,301.4790344238281,1e-05,0.22290083765983582,3.3187758922576904,81.14050197601318,3 +4415,0.17748397588729858,0.34544891119003296,0.36081379652023315,0.15034964680671692,964.3812255859375,1e-05,0.13692183792591095,2.838930606842041,81.14050197601318,3 +4416,0.2582021951675415,0.2198062539100647,0.20731380581855774,0.22214451432228088,731.0974731445312,1e-05,0.11570817977190018,3.3132317066192627,81.14050197601318,3 +4417,0.3914974331855774,0.11404749006032944,0.10751952975988388,0.09207459539175034,786.6087036132812,1e-05,0.13917475938796997,4.518766403198242,81.14050197601318,3 +4418,0.2612399458885193,0.2255191206932068,0.22024407982826233,0.13636364042758942,991.0303955078125,1e-05,0.2856486141681671,3.1390552520751953,81.14050197601318,3 +4419,0.2448052167892456,0.13781781494617462,0.1425875574350357,0.1263403296470642,574.1869506835938,1e-05,0.13410405814647675,2.831265687942505,81.14050197601318,3 +4420,0.23609241843223572,0.16219216585159302,0.16578374803066254,0.23030303418636322,917.6026611328125,1e-05,0.1439851075410843,3.042215585708618,81.14050197601318,3 +4421,0.171221524477005,0.07949776947498322,0.08973574638366699,0.18018648028373718,922.0755004882812,1e-05,0.13689714670181274,2.843963861465454,81.14050197601318,3 +4422,0.24251636862754822,0.24384887516498566,0.2404407262802124,0.19230769574642181,747.3050537109375,1e-05,0.12685270607471466,3.3736681938171387,81.14050197601318,3 +4423,0.26060950756073,0.22850273549556732,0.21549983322620392,0.2097902148962021,733.1973266601562,1e-05,0.2029205709695816,3.061281442642212,81.14050197601318,3 +4424,0.1831493228673935,0.23079590499401093,0.23804819583892822,0.17132866382598877,757.7117919921875,1e-05,0.1710326224565506,3.291804075241089,81.14050197601318,3 +4425,0.1340312361717224,0.3609064221382141,0.34733933210372925,0.21491841971874237,979.6979370117188,1e-05,0.189005509018898,3.078983783721924,81.14050197601318,3 +4426,0.34102916717529297,0.290494441986084,0.30073627829551697,0.2125874161720276,437.2454833984375,1e-05,0.18923577666282654,3.0650076866149902,81.14050197601318,3 +4427,0.3131549060344696,0.23923900723457336,0.22218644618988037,0.18041957914829254,642.2061767578125,1e-05,0.12690269947052002,2.8366596698760986,81.14050197601318,3 +4428,0.15247118473052979,0.301154226064682,0.3037988841533661,0.19790209829807281,996.4030151367188,1e-05,0.10459699481725693,3.41512393951416,81.14050197601318,3 +4429,0.20186685025691986,0.20162944495677948,0.19518065452575684,0.22564102709293365,975.0736083984375,1e-05,0.2568872272968292,3.0851430892944336,81.14050197601318,3 +4430,0.19959963858127594,0.14424040913581848,0.15676726400852203,0.15058274567127228,788.94677734375,1e-05,0.16009721159934998,3.289984703063965,81.14050197601318,3 +4431,0.2162739485502243,0.32945486903190613,0.32783186435699463,0.2449883371591568,989.1450805664062,1e-05,0.19254517555236816,3.091787099838257,81.14050197601318,3 +4432,0.1334729939699173,0.2086114138364792,0.19764332473278046,0.16596736013889313,915.4500122070312,1e-05,0.17543567717075348,3.11063551902771,81.14050197601318,3 +4433,0.19620785117149353,0.2465408593416214,0.2502436339855194,0.18414919078350067,910.6900634765625,1e-05,0.46248236298561096,3.0592479705810547,81.14050197601318,3 +4434,0.13576403260231018,0.19346266984939575,0.1934570074081421,0.145454540848732,863.5715942382812,1e-05,0.11378420144319534,3.061502456665039,81.14050197601318,3 +4435,0.2980627417564392,0.12118640542030334,0.12319910526275635,0.22960372269153595,742.382080078125,1e-05,0.21786142885684967,3.4544897079467773,81.14050197601318,3 +4436,0.36688241362571716,0.18667544424533844,0.18535637855529785,0.2678321599960327,724.6637573242188,1e-05,0.15009617805480957,3.0163679122924805,81.14050197601318,3 +4437,0.22705040872097015,0.32609811425209045,0.3229367434978485,0.20116549730300903,996.771484375,1e-05,0.2182331681251526,3.1835477352142334,81.14050197601318,3 +4438,0.23239853978157043,0.23093146085739136,0.22443486750125885,0.1622377634048462,941.2037353515625,1e-05,0.13396680355072021,3.1278741359710693,81.14050197601318,3 +4439,0.2467772364616394,0.17720109224319458,0.16964633762836456,0.0559440553188324,812.0592651367188,1e-05,0.4949658513069153,3.0392088890075684,81.14050197601318,3 +4440,0.4379667639732361,0.32777833938598633,0.3233177959918976,0.2543123662471771,319.1216125488281,1e-05,0.15538378059864044,3.1327404975891113,81.14050197601318,3 +4441,0.1377680003643036,0.18586774170398712,0.1755765825510025,0.21771562099456787,761.3585205078125,1e-05,0.11166223138570786,3.3699865341186523,81.14050197601318,3 +4442,0.20033150911331177,0.2000250220298767,0.20125284790992737,0.19324009120464325,563.8103637695312,1e-05,0.13632966578006744,3.023638963699341,81.14050197601318,3 +4443,0.16547270119190216,0.1508200764656067,0.14725369215011597,0.16526806354522705,787.3915405273438,1e-05,0.13089203834533691,3.1474697589874268,81.14050197601318,3 +4444,0.1232089251279831,0.2531707286834717,0.2371109277009964,0.2449883371591568,922.0755004882812,1e-05,0.12506736814975739,3.1209945678710938,81.14050197601318,3 +4445,0.2078881561756134,0.30719324946403503,0.2966557741165161,0.2181818187236786,988.5972900390625,1e-05,0.15912924706935883,3.03883695602417,81.14050197601318,3 +4446,0.2658172845840454,0.2527197599411011,0.23521214723587036,0.19160838425159454,975.2377319335938,1e-05,0.3274707496166229,3.377180337905884,81.14050197601318,3 +4447,0.22732624411582947,0.27770936489105225,0.25426357984542847,0.22447551786899567,788.94677734375,1e-05,0.18118926882743835,3.33011794090271,81.14050197601318,3 +4448,0.11191145330667496,0.1700126975774765,0.16950723528862,0.27482518553733826,922.947998046875,1e-05,0.12795725464820862,3.0785374641418457,81.14050197601318,3 +4449,0.3378896117210388,0.29110196232795715,0.2923814058303833,0.22074592113494873,978.7633666992188,1e-05,0.12434576451778412,3.0579729080200195,81.14050197601318,3 +4450,0.13464726507663727,0.2697267234325409,0.2637154161930084,0.22890442609786987,953.8506469726562,1e-05,0.10145912319421768,3.0532991886138916,81.14050197601318,3 +4451,0.23356938362121582,0.19471238553524017,0.18851132690906525,0.18275058269500732,906.0565185546875,1e-05,0.14266686141490936,3.0891664028167725,81.14050197601318,3 +4452,0.28723543882369995,0.19664840400218964,0.19427207112312317,0.22960372269153595,939.7424926757812,1e-05,0.1446499526500702,3.350125312805176,81.14050197601318,3 +4453,0.19598522782325745,0.12447089701890945,0.11655455827713013,0.19813519716262817,877.1219482421875,1e-05,0.18344776332378387,3.1328041553497314,81.14050197601318,3 +4454,0.3023412227630615,0.49734291434288025,0.49132928252220154,0.2265734225511551,217.11199951171875,1e-05,0.15355822443962097,3.058913230895996,81.14050197601318,3 +4455,0.27048489451408386,0.12473052740097046,0.1329965442419052,0.23449882864952087,655.9628295898438,1e-05,0.16064363718032837,3.084601879119873,81.14050197601318,3 +4456,0.18307361006736755,0.22965016961097717,0.2194366306066513,0.23426572978496552,828.6761474609375,1e-05,0.1364741027355194,3.100111722946167,81.14050197601318,3 +4457,0.2819726765155792,0.1293068826198578,0.13850216567516327,0.19720280170440674,835.2010498046875,1e-05,0.12961061298847198,3.09826397895813,81.14050197601318,3 +4458,0.15008696913719177,0.2403251975774765,0.22527141869068146,0.2582750618457794,780.2160034179688,1e-05,0.1558389961719513,3.4101450443267822,81.14050197601318,3 +4459,0.1865912526845932,0.36193349957466125,0.35108739137649536,0.16643357276916504,983.767822265625,1e-05,0.11936759203672409,3.165139675140381,81.14050197601318,3 +4460,0.24912488460540771,0.15371406078338623,0.1444149911403656,0.18414919078350067,869.614990234375,1e-05,0.12182434648275375,3.0605714321136475,81.14050197601318,3 +4461,0.2542157769203186,0.2269313484430313,0.2502151429653168,0.2158508151769638,965.126220703125,1e-05,0.1782987415790558,2.833191156387329,81.14050197601318,3 +4462,0.1737402081489563,0.13365647196769714,0.1289515346288681,0.1034965068101883,897.28564453125,1e-05,0.15520694851875305,2.83198618888855,81.14050197601318,3 +4463,0.14421346783638,0.3440536856651306,0.347247838973999,0.19930069148540497,965.6807250976562,1e-05,0.16714029014110565,3.4088456630706787,81.14050197601318,3 +4464,0.1719021499156952,0.12031320482492447,0.13909730315208435,0.19417248666286469,919.414306640625,1e-05,0.16098055243492126,3.2978310585021973,81.14050197601318,3 +4465,0.2694898843765259,0.28524482250213623,0.28667259216308594,0.25524476170539856,933.6696166992188,1e-05,0.1384536176919937,3.0620408058166504,81.14050197601318,3 +4466,0.3953184485435486,0.38379719853401184,0.38027551770210266,0.2433566451072693,301.4790344238281,1e-05,0.1400645226240158,3.2284014225006104,81.14050197601318,3 +4467,0.23676539957523346,0.1555326133966446,0.16652299463748932,0.24195803701877594,880.5089721679688,1e-05,0.12568823993206024,3.0428943634033203,81.14050197601318,3 +4468,0.2102091908454895,0.12922272086143494,0.13659949600696564,0.2086247056722641,854.2249145507812,1e-05,0.14165595173835754,2.8278791904449463,81.14050197601318,3 +4469,0.11316502094268799,0.23155426979064941,0.22558081150054932,0.1846153885126114,972.0613403320312,1e-05,0.16422025859355927,3.3434510231018066,81.14050197601318,3 +4470,0.25814324617385864,0.31859099864959717,0.2990482747554779,0.20349650084972382,737.33203125,1e-05,0.13729900121688843,3.1101160049438477,81.14050197601318,3 +4471,0.15511594712734222,0.26641228795051575,0.24281443655490875,0.17132866382598877,627.6343994140625,1e-05,0.1746513694524765,3.1214635372161865,81.14050197601318,3 +4472,0.20976665616035461,0.24478013813495636,0.23975156247615814,0.2102564126253128,757.7117919921875,1e-05,0.1700226366519928,3.323742628097534,81.14050197601318,3 +4473,0.26564082503318787,0.06995610147714615,0.07239998131990433,0.12004662305116653,819.9478759765625,1e-05,0.12416793406009674,3.084141969680786,81.14050197601318,3 +4474,0.19536465406417847,0.2402949184179306,0.2252688854932785,0.2114219069480896,868.2445068359375,1e-05,0.19310949742794037,3.0674147605895996,81.14050197601318,3 +4475,0.4882761240005493,0.27615097165107727,0.26150909066200256,0.25314685702323914,455.6820373535156,1e-05,0.38814443349838257,3.086986541748047,81.14050197601318,3 +4476,0.19061614573001862,0.17579612135887146,0.17707331478595734,0.1834498792886734,960.9456176757812,1e-05,0.11272495239973068,3.3581953048706055,81.14050197601318,3 +4477,0.20128504931926727,0.21247591078281403,0.21162740886211395,0.1822843849658966,973.2462768554688,1e-05,0.11089647561311722,3.0895605087280273,81.14050197601318,3 +4478,0.33517614006996155,0.25069132447242737,0.2461692988872528,0.2097902148962021,599.4783325195312,1e-05,0.12611186504364014,3.0221145153045654,81.14050197601318,3 +4479,0.21703918278217316,0.222530797123909,0.20332784950733185,0.19230769574642181,939.4969482421875,1e-05,0.16281168162822723,3.064171552658081,81.14050197601318,3 +4480,0.28568488359451294,0.13517433404922485,0.1292593777179718,0.09627039730548859,781.836181640625,1e-05,0.14521193504333496,3.102215528488159,81.14050197601318,3 +4481,0.17706212401390076,0.2142208069562912,0.21088352799415588,0.19557109475135803,950.8469848632812,1e-05,0.8424479365348816,3.119598627090454,81.14050197601318,3 +4482,0.14998576045036316,0.1508617401123047,0.13936400413513184,0.2181818187236786,962.6806640625,1e-05,0.19926710426807404,3.0688369274139404,81.14050197601318,3 +4483,0.14518731832504272,0.13205453753471375,0.13507236540317535,0.1878787875175476,911.9796752929688,1e-05,0.12630410492420197,2.8316190242767334,81.14050197601318,3 +4484,0.2615422010421753,0.22337430715560913,0.228347510099411,0.2198135256767273,943.1180419921875,1e-05,0.16182252764701843,3.3532841205596924,81.14050197601318,3 +4485,0.35515543818473816,0.17769986391067505,0.17871183156967163,0.18648017942905426,858.2379760742188,1e-05,0.17898882925510406,3.0875070095062256,81.14050197601318,3 +4486,0.2663792073726654,0.2226925641298294,0.21918027102947235,0.2058275043964386,712.31884765625,1e-05,0.14535805583000183,3.098400354385376,81.14050197601318,3 +4487,0.25615763664245605,0.2573069930076599,0.2700839340686798,0.20396269857883453,356.2078552246094,1e-05,0.2485482543706894,3.503350257873535,81.14050197601318,3 +4488,0.3045519292354584,0.27079272270202637,0.25256457924842834,0.2645687758922577,889.3790893554688,1e-05,0.1553667038679123,3.0912747383117676,81.14050197601318,3 +4489,0.3664824664592743,0.6443427205085754,0.6367473602294922,0.1650349646806717,113.7176742553711,1e-05,0.111959308385849,2.822971820831299,81.14050197601318,3 +4490,0.33218786120414734,0.23031337559223175,0.22549210488796234,0.10979020595550537,992.8673706054688,1e-05,0.1740378588438034,3.344756603240967,81.14050197601318,3 +4491,0.11463537812232971,0.21967464685440063,0.223673015832901,0.1822843849658966,915.1390991210938,1e-05,0.16954439878463745,3.115306854248047,81.14050197601318,3 +4492,0.2139493077993393,0.1956750452518463,0.1873306930065155,0.2337995320558548,603.1679077148438,1e-05,0.11526355892419815,3.0921895503997803,81.14050197601318,3 +4493,0.13520589470863342,0.2208588570356369,0.21525070071220398,0.133100226521492,938.5079956054688,1e-05,0.16764090955257416,3.2134907245635986,81.14050197601318,3 +4494,0.18596535921096802,0.2576003968715668,0.25856173038482666,0.17202797532081604,764.9352416992188,1e-05,0.19670717418193817,3.1373720169067383,81.14050197601318,3 +4495,0.38233041763305664,0.10735003650188446,0.12283685058355331,0.16363635659217834,980.7741088867188,1e-05,0.2038949579000473,2.8324503898620605,81.14050197601318,3 +4496,0.24033842980861664,0.11847875267267227,0.12107862532138824,0.25314685702323914,723.5714111328125,1e-05,0.21519683301448822,3.3081862926483154,81.14050197601318,3 +4497,0.3224555552005768,0.3519202172756195,0.3333306312561035,0.2613053619861603,958.576904296875,1e-05,0.1813158243894577,2.8234312534332275,81.14050197601318,3 +4498,0.26031631231307983,0.2169611155986786,0.21440735459327698,0.19487179815769196,964.3812255859375,1e-05,0.14610812067985535,3.1140944957733154,81.14050197601318,3 +4499,0.14770551025867462,0.12175972014665604,0.11741587519645691,0.1790209710597992,658.916015625,1e-05,0.33035632967948914,3.316189765930176,81.14050197601318,3 +4500,0.2322298139333725,0.2685273587703705,0.2666098177433014,0.2242424190044403,996.5260620117188,1e-05,0.1387069672346115,3.0617964267730713,81.14050197601318,3 +4501,0.2061997950077057,0.18559344112873077,0.19328396022319794,0.14009323716163635,841.452880859375,1e-05,0.12693847715854645,3.1184589862823486,81.14050197601318,3 +4502,0.17881380021572113,0.25211313366889954,0.24430829286575317,0.16573426127433777,878.82666015625,1e-05,0.10537383705377579,3.1200525760650635,81.14050197601318,3 +4503,0.257562518119812,0.23830950260162354,0.2495296150445938,0.17039626836776733,823.7489624023438,1e-05,0.11912200599908829,3.0452895164489746,81.14050197601318,3 +4504,0.17593710124492645,0.2747938632965088,0.30708885192871094,0.1822843849658966,140.08938598632812,1e-05,0.12527987360954285,3.281449556350708,81.14050197601318,3 +4505,0.39122581481933594,0.16859962046146393,0.17011001706123352,0.08041957765817642,726.8310546875,1e-05,0.13384020328521729,3.478731870651245,81.14050197601318,3 +4506,0.17404857277870178,0.1611471176147461,0.1587129682302475,0.16899767518043518,741.38232421875,1e-05,0.12298716604709625,2.8166894912719727,81.14050197601318,3 +4507,0.10676230490207672,0.28096482157707214,0.2710935175418854,0.14685314893722534,973.748779296875,1e-05,0.1321784108877182,3.110098123550415,81.14050197601318,3 +4508,0.21712258458137512,0.21797844767570496,0.22870735824108124,0.2069930136203766,379.11187744140625,1e-05,0.13242849707603455,3.1118013858795166,81.14050197601318,3 +4509,0.13723155856132507,0.20896930992603302,0.20122326910495758,0.25081583857536316,940.4759521484375,1e-05,0.15143625438213348,3.064263343811035,81.14050197601318,3 +4510,0.1493329107761383,0.22448308765888214,0.2135695219039917,0.238228440284729,930.7574462890625,1e-05,0.14790309965610504,3.3078677654266357,81.14050197601318,3 +4511,0.1601950228214264,0.1954459398984909,0.19758737087249756,0.16363635659217834,941.685791015625,1e-05,0.15736661851406097,3.309964656829834,81.14050197601318,3 +4512,0.0847826823592186,0.15170039236545563,0.1552194058895111,0.21515151858329773,807.9645385742188,1e-05,0.10377618670463562,2.830037832260132,81.14050197601318,3 +4513,0.32874274253845215,0.1965225338935852,0.19642098248004913,0.1263403296470642,937.5089111328125,1e-05,0.12735529243946075,3.0642430782318115,81.14050197601318,3 +4514,0.19166523218154907,0.22618958353996277,0.21192549169063568,0.22447551786899567,928.31103515625,1e-05,0.153769850730896,3.1545772552490234,81.14050197601318,3 +4515,0.3196870982646942,0.31622064113616943,0.29996904730796814,0.20116549730300903,963.251220703125,1e-05,0.17664770781993866,3.1456491947174072,81.14050197601318,3 +4516,0.18365389108657837,0.15964734554290771,0.1751641035079956,0.14382284879684448,994.53125,1e-05,0.12616205215454102,3.133723020553589,81.14050197601318,3 +4517,0.24505920708179474,0.25175896286964417,0.26971572637557983,0.18764568865299225,986.3638916015625,1e-05,0.16035239398479462,3.4807651042938232,81.14050197601318,3 +4518,0.2223905771970749,0.24679513275623322,0.2659749984741211,0.22284382581710815,984.3526000976562,1e-05,0.24335993826389313,2.824312925338745,81.14050197601318,3 +4519,0.18943539261817932,0.30430281162261963,0.28141674399375916,0.23170162737369537,995.160888671875,1e-05,0.12796813249588013,3.0570662021636963,81.14050197601318,3 +4520,0.1989927440881729,0.15698350965976715,0.17141614854335785,0.12773892283439636,952.1465454101562,1e-05,0.11520718783140182,3.4157047271728516,81.14050197601318,3 +4521,0.1960739642381668,0.24407045543193817,0.2254418283700943,0.2242424190044403,970.1636352539062,1e-05,0.1648787260055542,2.815845251083374,81.14050197601318,3 +4522,0.12308369576931,0.269546240568161,0.2580881714820862,0.22680652141571045,995.2861328125,1e-05,0.33853116631507874,3.111328363418579,81.14050197601318,3 +4523,0.22461088001728058,0.6039317846298218,0.5960332751274109,0.15244755148887634,152.77052307128906,1e-05,0.1254594773054123,3.1410224437713623,81.14050197601318,3 +4524,0.118215411901474,0.34012046456336975,0.3285292088985443,0.15757575631141663,993.7682495117188,1e-05,0.13465455174446106,2.8419747352600098,81.14050197601318,3 +4525,0.20311716198921204,0.23319518566131592,0.2459174543619156,0.1958041936159134,976.8599853515625,1e-05,0.22697117924690247,3.362764358520508,81.14050197601318,3 +4526,0.11300705373287201,0.2225361317396164,0.2214972972869873,0.2421911358833313,979.54296875,1e-05,0.08867868036031723,3.101891279220581,81.14050197601318,3 +4527,0.203487828373909,0.23124656081199646,0.23433586955070496,0.18531468510627747,979.6979370117188,1e-05,0.16722340881824493,3.0734782218933105,81.14050197601318,3 +4528,0.24885520339012146,0.20975521206855774,0.2016596794128418,0.12121211737394333,689.1459350585938,1e-05,2.1101715564727783,3.3270986080169678,81.14050197601318,3 +4529,0.23423609137535095,0.35534903407096863,0.330447256565094,0.24755243957042694,954.0613403320312,1e-05,0.1860930621623993,3.0943593978881836,81.14050197601318,3 +4530,0.1839607208967209,0.07959920912981033,0.09121065586805344,0.13776223361492157,914.2007446289062,1e-05,0.14971046149730682,2.845123529434204,81.14050197601318,3 +4531,0.18018078804016113,0.14805184304714203,0.15160822868347168,0.1794871836900711,988.4596557617188,1e-05,0.1147826611995697,3.093754529953003,81.14050197601318,3 +4532,0.3171766400337219,0.20615680515766144,0.2026471644639969,0.18974359333515167,935.7356567382812,1e-05,0.14777213335037231,3.102099895477295,81.14050197601318,3 +4533,0.2465294599533081,0.23096586763858795,0.2319558709859848,0.18531468510627747,774.4262084960938,1e-05,0.25628867745399475,3.07230544090271,81.14050197601318,3 +4534,0.2708735764026642,0.16238340735435486,0.16422200202941895,0.25081583857536316,961.7210693359375,1e-05,0.12545785307884216,3.3369200229644775,81.14050197601318,3 +4535,0.29229116439819336,0.3253706991672516,0.3202361464500427,0.21212121844291687,943.1180419921875,1e-05,0.17660380899906158,3.1203360557556152,81.14050197601318,3 +4536,0.22020664811134338,0.19527703523635864,0.2214333564043045,0.2501165568828583,356.2078552246094,1e-05,0.10466104745864868,2.8397324085235596,81.14050197601318,3 +4537,0.12672847509384155,0.2997649908065796,0.30504000186920166,0.09557109326124191,996.1564331054688,1e-05,0.1334180235862732,3.276902675628662,81.14050197601318,3 +4538,0.1975213885307312,0.3742159307003021,0.36342886090278625,0.24848484992980957,310.39483642578125,1e-05,0.10865519195795059,3.098827362060547,81.14050197601318,3 +4539,0.22954069077968597,0.629971981048584,0.5955801606178284,0.27668997645378113,987.906494140625,1e-05,0.3425303101539612,3.1012277603149414,81.14050197601318,3 +4540,0.23685571551322937,0.25371989607810974,0.23517486453056335,0.21771562099456787,902.9749755859375,1e-05,0.1758906990289688,3.330841064453125,81.14050197601318,3 +4541,0.3725144565105438,0.11630986630916595,0.11675665527582169,0.1878787875175476,838.6439208984375,1e-05,0.20647190511226654,2.8219504356384277,81.14050197601318,3 +4542,0.20581448078155518,0.15095463395118713,0.16372017562389374,0.16340325772762299,741.38232421875,1e-05,0.15664847195148468,2.821894884109497,81.14050197601318,3 +4543,0.31207600235939026,0.16763316094875336,0.16111402213573456,0.06247086077928543,722.4732666015625,1e-05,0.14733190834522247,3.4524295330047607,81.14050197601318,3 +4544,0.14148923754692078,0.20958973467350006,0.22297169268131256,0.18694639205932617,948.4158325195312,1e-05,0.16392429172992706,2.829263687133789,81.14050197601318,3 +4545,0.12489427626132965,0.21001853048801422,0.204531729221344,0.22727273404598236,917.9066772460938,1e-05,0.12746265530586243,3.0626635551452637,81.14050197601318,3 +4546,0.14289593696594238,0.20039592683315277,0.196841761469841,0.13333334028720856,925.8049926757812,1e-05,0.2770596742630005,3.3452906608581543,81.14050197601318,3 +4547,0.204212486743927,0.2863715887069702,0.2808417081832886,0.18811188638210297,915.7601928710938,1e-05,0.12845969200134277,2.830399513244629,81.14050197601318,3 +4548,0.2099829614162445,0.21746622025966644,0.20517300069332123,0.2529137432575226,976.2150268554688,1e-05,0.1295623481273651,3.0056636333465576,81.14050197601318,3 +4549,0.19768714904785156,0.17625536024570465,0.17666596174240112,0.2130536139011383,942.6430053710938,1e-05,0.13039472699165344,3.165334939956665,81.14050197601318,3 +4550,0.09449192881584167,0.30614620447158813,0.2888127863407135,0.19254079461097717,937.0054321289062,1e-05,0.10760462284088135,2.818222761154175,81.14050197601318,3 +4551,0.3068348169326782,0.1565161496400833,0.15948499739170074,0.22121211886405945,612.1727294921875,1e-05,0.15262386202812195,3.3112051486968994,81.14050197601318,3 +4552,0.17183497548103333,0.10012563318014145,0.10151130706071854,0.12890443205833435,651.463623046875,1e-05,0.1259477734565735,3.28592848777771,81.14050197601318,3 +4553,0.26395338773727417,0.1678219437599182,0.16496486961841583,0.1090909093618393,904.6971435546875,1e-05,0.11475571244955063,2.822136163711548,81.14050197601318,3 +4554,0.27150672674179077,0.20199540257453918,0.18937230110168457,0.22517482936382294,767.5730590820312,1e-05,0.12939006090164185,3.027515411376953,81.14050197601318,3 +4555,0.14744748175144196,0.3201185464859009,0.31482774019241333,0.2030303031206131,965.8648071289062,1e-05,0.117756187915802,3.4020884037017822,81.14050197601318,3 +4556,0.3342876732349396,0.2530314326286316,0.23903830349445343,0.2365967333316803,968.9326171875,1e-05,0.1336747258901596,2.8209590911865234,81.14050197601318,3 +4557,0.21708112955093384,0.21796338260173798,0.24610775709152222,0.1582750529050827,171.19692993164062,1e-05,0.12660734355449677,3.3416669368743896,81.14050197601318,3 +4558,0.17690587043762207,0.2212609499692917,0.2325424998998642,0.20629370212554932,386.44976806640625,1e-05,0.15804937481880188,3.1012187004089355,81.14050197601318,3 +4559,0.3800086975097656,0.5298237204551697,0.5214620232582092,0.17179487645626068,188.9440460205078,1e-05,0.12276753038167953,2.838670015335083,81.14050197601318,3 +4560,0.15933245420455933,0.34385964274406433,0.34263402223587036,0.21212121844291687,991.954833984375,1e-05,0.17732378840446472,3.0336432456970215,81.14050197601318,3 +4561,0.2701389491558075,0.19262856245040894,0.1848016232252121,0.11701631546020508,720.25927734375,1e-05,0.1218733936548233,3.127054214477539,81.14050197601318,3 +4562,0.23076899349689484,0.15871931612491608,0.16246657073497772,0.19324009120464325,860.2017211914062,1e-05,0.10453636944293976,2.8360953330993652,81.14050197601318,3 +4563,0.22873790562152863,0.14311227202415466,0.1467559039592743,0.13100233674049377,825.6151733398438,1e-05,0.1364053189754486,3.3155879974365234,81.14050197601318,3 +4564,0.3047854006290436,0.2858142852783203,0.2773941159248352,0.2585081458091736,804.4718627929688,1e-05,0.1252320110797882,3.150541067123413,81.14050197601318,3 +4565,0.18479280173778534,0.15824969112873077,0.1638873666524887,0.21561771631240845,835.7803955078125,1e-05,0.1488347053527832,2.830073595046997,81.14050197601318,3 +4566,0.17347082495689392,0.29229652881622314,0.29075106978416443,0.18834498524665833,962.2981567382812,1e-05,0.46741336584091187,3.066373586654663,81.14050197601318,3 +4567,0.2970494329929352,0.22566835582256317,0.22923877835273743,0.19160838425159454,747.3050537109375,1e-05,0.12589509785175323,3.1189041137695312,81.14050197601318,3 +4568,0.2194250524044037,0.1816820502281189,0.1783030927181244,0.1794871836900711,976.69921875,1e-05,0.1849023699760437,2.834381103515625,81.14050197601318,3 +4569,0.207347571849823,0.20848026871681213,0.19857800006866455,0.22913752496242523,922.947998046875,1e-05,0.24808672070503235,3.582643747329712,81.14050197601318,3 +4570,0.23957525193691254,0.2642391324043274,0.2561167776584625,0.15734265744686127,921.48974609375,1e-05,0.12929517030715942,3.0706734657287598,81.14050197601318,3 +4571,0.09216057509183884,0.2937098443508148,0.28103384375572205,0.23449882864952087,995.2861328125,1e-05,0.114494189620018,2.8380532264709473,81.14050197601318,3 +4572,0.18088415265083313,0.1596565842628479,0.1530248373746872,0.2512820363044739,902.9749755859375,1e-05,0.13936425745487213,3.4151315689086914,81.14050197601318,3 +4573,0.24544788897037506,0.2538793385028839,0.25104713439941406,0.20769231021404266,888.9893188476562,1e-05,0.23100262880325317,2.8464441299438477,81.14050197601318,3 +4574,0.26869967579841614,0.22860029339790344,0.21556223928928375,0.19230769574642181,875.3941650390625,1e-05,0.14574426412582397,2.8461649417877197,81.14050197601318,3 +4575,0.37933117151260376,0.26694434881210327,0.25919315218925476,0.1862470805644989,634.2159423828125,1e-05,0.12374980002641678,3.127549886703491,81.14050197601318,3 +4576,0.20577171444892883,0.1408209353685379,0.1499226689338684,0.2074592113494873,728.9754028320312,1e-05,0.15612606704235077,3.129878044128418,81.14050197601318,3 +4577,0.31406837701797485,0.19858026504516602,0.1954696774482727,0.23170162737369537,750.1998901367188,1e-05,0.2213219404220581,2.8449599742889404,81.14050197601318,3 +4578,0.190481036901474,0.2564241290092468,0.24551193416118622,0.22191141545772552,923.525634765625,1e-05,0.13636961579322815,3.3978445529937744,81.14050197601318,3 +4579,0.16987717151641846,0.10226079076528549,0.10716269910335541,0.09254079312086105,430.87518310546875,1e-05,0.10723215341567993,2.8364827632904053,81.14050197601318,3 +4580,0.11841973662376404,0.2349490523338318,0.23529277741909027,0.12727272510528564,911.0138549804688,1e-05,0.11869823187589645,3.2791757583618164,81.14050197601318,3 +4581,0.17445363104343414,0.2200973480939865,0.22715052962303162,0.09020978957414627,951.2822265625,1e-05,0.14897091686725616,3.4193124771118164,81.14050197601318,3 +4582,0.14735473692417145,0.14470209181308746,0.15462538599967957,0.24242423474788666,907.39990234375,1e-05,0.11430428922176361,2.827162981033325,81.14050197601318,3 +4583,0.3074052929878235,0.21611659228801727,0.20706316828727722,0.23310023546218872,824.99560546875,1e-05,0.11147228628396988,2.834873914718628,81.14050197601318,3 +4584,0.1814984679222107,0.2675161361694336,0.2630961239337921,0.21678321063518524,953.0025024414062,1e-05,0.13261397182941437,3.411114454269409,81.14050197601318,3 +4585,0.16444429755210876,0.1901395469903946,0.1851809024810791,0.18881118297576904,803.7642822265625,1e-05,0.14118692278862,2.8338277339935303,81.14050197601318,3 +4586,0.2592325806617737,0.17827296257019043,0.16585339605808258,0.1986013948917389,725.7503051757812,1e-05,0.14732025563716888,3.314817428588867,81.14050197601318,3 +4587,0.07531046122312546,0.31856656074523926,0.30921047925949097,0.1662004590034485,999.8831176757812,1e-05,0.10559725016355515,3.414768695831299,81.14050197601318,3 +4588,0.20942795276641846,0.19783183932304382,0.20106187462806702,0.09976690262556076,510.6620178222656,1e-05,0.10818562656641006,2.846039295196533,81.14050197601318,3 +4589,0.2504478096961975,0.27727022767066956,0.27918222546577454,0.14965035021305084,958.3765258789062,1e-05,0.10646277666091919,2.8432817459106445,81.14050197601318,3 +4590,0.17998526990413666,0.3246845602989197,0.305341899394989,0.23962703347206116,682.6182250976562,1e-05,0.24016723036766052,3.169109344482422,81.14050197601318,3 +4591,0.17286838591098785,0.21302424371242523,0.1963856816291809,0.17529137432575226,802.3400268554688,1e-05,0.14933057129383087,2.8431010246276855,81.14050197601318,3 +4592,0.18344548344612122,0.2237669825553894,0.20526468753814697,0.22470861673355103,814.732421875,1e-05,0.12606777250766754,3.2974460124969482,81.14050197601318,3 +4593,0.38898327946662903,0.20720325410366058,0.20355762541294098,0.23053613305091858,917.2977905273438,1e-05,0.46308302879333496,3.2887868881225586,81.14050197601318,3 +4594,0.2537309229373932,0.2626146972179413,0.2595027983188629,0.2421911358833313,568.0068969726562,1e-05,0.2762174904346466,2.8533809185028076,81.14050197601318,3 +4595,0.41016536951065063,0.22125551104545593,0.22729331254959106,0.22727273404598236,978.2918701171875,1e-05,0.13822919130325317,2.8517448902130127,81.14050197601318,3 +4596,0.3065515458583832,0.2645602524280548,0.25669530034065247,0.20093239843845367,927.2047729492188,1e-05,0.16697193682193756,3.186694622039795,81.14050197601318,3 +4597,0.15002727508544922,0.16274932026863098,0.16834589838981628,0.18811188638210297,948.1915893554688,1e-05,0.19253957271575928,2.9825007915496826,81.14050197601318,3 +4598,0.33896225690841675,0.3676336109638214,0.35840651392936707,0.2114219069480896,287.737548828125,1e-05,0.1446833461523056,3.5925822257995605,81.14050197601318,3 +4599,0.2804763615131378,0.19893227517604828,0.1832166463136673,0.2405594438314438,936.7528076171875,1e-05,0.1594049483537674,3.748940944671631,81.14050197601318,3 +4600,0.22993232309818268,0.2870945334434509,0.2952122986316681,0.23636363446712494,997.6233520507812,1e-05,0.1568409651517868,2.9747231006622314,81.14050197601318,3 +4601,0.3378337621688843,0.24729187786579132,0.23767085373401642,0.19137528538703918,404.18499755859375,1e-05,0.12903153896331787,3.2541487216949463,81.14050197601318,3 +4602,0.32087767124176025,0.28132084012031555,0.2737447917461395,0.19696970283985138,492.46246337890625,1e-05,0.16582468152046204,3.418335437774658,81.14050197601318,3 +4603,0.1230255663394928,0.20161212980747223,0.19901393353939056,0.20163169503211975,955.10791015625,1e-05,0.1342451125383377,2.957096576690674,81.14050197601318,3 +4604,0.11302286386489868,0.18814845383167267,0.1729225218296051,0.26247087121009827,975.0736083984375,1e-05,0.09355530887842178,3.6862246990203857,81.14050197601318,3 +4605,0.2742031216621399,0.30191853642463684,0.29553771018981934,0.1934731900691986,314.781494140625,1e-05,0.12047728151082993,3.271761178970337,81.14050197601318,3 +4606,0.21444576978683472,0.17003598809242249,0.16351348161697388,0.2566433548927307,941.685791015625,1e-05,0.16452240943908691,2.931582450866699,81.14050197601318,3 +4607,0.14714646339416504,0.18326805531978607,0.18656593561172485,0.21165500581264496,777.7576293945312,1e-05,0.21713285148143768,3.3086092472076416,81.14050197601318,3 +4608,0.15451662242412567,0.09235990047454834,0.09686224162578583,0.07039626687765121,714.6185302734375,1e-05,0.11033301800489426,3.25710391998291,81.14050197601318,3 +4609,0.11900340020656586,0.16824623942375183,0.17479613423347473,0.19324009120464325,940.7190551757812,1e-05,0.16442343592643738,3.026793956756592,81.14050197601318,3 +4610,0.20015345513820648,0.20509645342826843,0.21060900390148163,0.18041957914829254,978.9199829101562,1e-05,0.26248830556869507,3.657486915588379,81.14050197601318,3 +4611,0.2673465609550476,0.24950408935546875,0.24305756390094757,0.15011654794216156,537.2642211914062,1e-05,0.10415523499250412,3.3854868412017822,81.14050197601318,3 +4612,0.1706082820892334,0.1496804803609848,0.15497581660747528,0.15011654794216156,720.25927734375,1e-05,0.1314103752374649,2.9560153484344482,81.14050197601318,3 +4613,0.22267822921276093,0.2772810757160187,0.267328143119812,0.16363635659217834,909.3855590820312,1e-05,0.10286495834589005,3.779254674911499,81.14050197601318,3 +4614,0.18193881213665009,0.16089271008968353,0.16227278113365173,0.23240093886852264,599.4783325195312,1e-05,0.11471985280513763,2.9277918338775635,81.14050197601318,3 +4615,0.19519329071044922,0.2383168488740921,0.2195666879415512,0.17575757205486298,947.7415161132812,1e-05,0.18209539353847504,3.31037974357605,81.14050197601318,3 +4616,0.2248629927635193,0.33249548077583313,0.3453078269958496,0.17272727191448212,188.9440460205078,1e-05,0.09856928884983063,3.4065637588500977,81.14050197601318,3 +4617,0.17379681766033173,0.26048412919044495,0.25440308451652527,0.21655011177062988,544.1298217773438,1e-05,0.11412621289491653,3.213778018951416,81.14050197601318,3 +4618,0.26970550417900085,0.16517728567123413,0.17077232897281647,0.23613053560256958,951.93115234375,1e-05,0.12727585434913635,2.9309253692626953,81.14050197601318,3 +4619,0.2987663447856903,0.22089579701423645,0.22108331322669983,0.20000000298023224,595.7371826171875,1e-05,0.13010922074317932,3.7275381088256836,81.14050197601318,3 +4620,0.23907846212387085,0.1591394543647766,0.14334538578987122,0.24755243957042694,838.6439208984375,1e-05,0.23214615881443024,3.0745208263397217,81.14050197601318,3 +4621,0.31404832005500793,0.15606261789798737,0.15397927165031433,0.24289044737815857,835.7803955078125,1e-05,0.16970957815647125,3.660550832748413,81.14050197601318,3 +4622,0.16960255801677704,0.29027533531188965,0.2828340232372284,0.16969697177410126,826.846923828125,1e-05,0.09280665963888168,4.3895182609558105,81.14050197601318,3 +4623,0.38251662254333496,0.24404160678386688,0.22751636803150177,0.12773892283439636,808.654296875,1e-05,0.1436995267868042,3.954862356185913,81.14050197601318,3 +4624,0.24849486351013184,0.2814575135707855,0.2657485008239746,0.1538461595773697,908.7275390625,1e-05,0.12204939872026443,3.7778027057647705,81.14050197601318,3 +4625,0.13130909204483032,0.25811347365379333,0.2390850931406021,0.25034964084625244,992.0859375,1e-05,0.09705142676830292,4.117386102676392,81.14050197601318,3 +4626,0.31109002232551575,0.1222754493355751,0.11841481924057007,0.20046620070934296,837.505126953125,1e-05,0.5528537034988403,3.19535231590271,81.14050197601318,3 +4627,0.2782220244407654,0.30527034401893616,0.2955121397972107,0.24428904056549072,998.5840454101562,1e-05,0.1482587605714798,3.3197860717773438,81.14050197601318,3 +4628,0.3116125166416168,0.29818740487098694,0.27296122908592224,0.2030303031206131,956.9613647460938,1e-05,0.19690170884132385,3.551649332046509,81.14050197601318,3 +4629,0.3055051267147064,0.23349210619926453,0.21894612908363342,0.2543123662471771,769.3107299804688,1e-05,0.13911332190036774,2.9328887462615967,81.14050197601318,3 +4630,0.20823851227760315,0.2661066949367523,0.2570614516735077,0.16083915531635284,692.97265625,1e-05,0.15453004837036133,3.095188856124878,81.14050197601318,3 +4631,0.18582546710968018,0.21608205139636993,0.22225555777549744,0.20489510893821716,989.5532836914062,1e-05,0.11081403493881226,3.579671859741211,81.14050197601318,3 +4632,0.19217896461486816,0.2888752520084381,0.2693265378475189,0.22004662454128265,919.7131958007812,1e-05,0.21016138792037964,3.0120463371276855,81.14050197601318,3 +4633,0.23651845753192902,0.2600109875202179,0.2453048825263977,0.26759907603263855,974.5794677734375,1e-05,0.1453174650669098,3.6566250324249268,81.14050197601318,4 +4634,0.356220006942749,0.13587692379951477,0.1405700445175171,0.26363635063171387,748.2748413085938,1e-05,0.16814343631267548,3.2632806301116943,81.14050197601318,4 +4635,0.10001186281442642,0.1681978553533554,0.1642448455095291,0.23986013233661652,940.4759521484375,1e-05,0.1263754963874817,6.085552215576172,81.14050197601318,4 +4636,0.20796139538288116,0.2089081108570099,0.19368568062782288,0.22191141545772552,886.226318359375,1e-05,0.1290769875049591,7.546924114227295,81.14050197601318,4 +4637,0.2657032310962677,0.27077165246009827,0.26729562878608704,0.20163169503211975,950.4097290039062,1e-05,0.12878358364105225,7.353938579559326,81.14050197601318,4 +4638,0.13937300443649292,0.10727131366729736,0.11376334726810455,0.09137529134750366,613.9371337890625,1e-05,0.1085621565580368,7.4749836921691895,81.14050197601318,4 +4639,0.19287757575511932,0.24300271272659302,0.23562830686569214,0.18531468510627747,732.1500854492188,1e-05,0.1125517189502716,8.980467081069946,81.14050197601318,4 +4640,0.22387538850307465,0.30527544021606445,0.29650014638900757,0.1694638729095459,996.8938598632812,1e-05,0.1788777858018875,7.915268659591675,81.14050197601318,4 +4641,0.275875449180603,0.29855290055274963,0.29880666732788086,0.0139860138297081,988.5972900390625,1e-05,0.09470447152853012,8.269908428192139,81.14050197601318,4 +4642,0.14986449480056763,0.25677698850631714,0.2423507571220398,0.22447551786899567,932.3563232421875,1e-05,0.14973480999469757,7.726456165313721,81.14050197601318,4 +4643,0.06401123851537704,0.15800921618938446,0.15837250649929047,0.2158508151769638,978.6064453125,1e-05,0.11913881450891495,6.987698554992676,81.14050197601318,4 +4644,0.15164132416248322,0.17389167845249176,0.17609862983226776,0.2181818187236786,657.4439697265625,1e-05,0.13233672082424164,6.967827558517456,81.14050197601318,4 +4645,0.2313837707042694,0.18332430720329285,0.17956432700157166,0.17179487645626068,934.9658203125,1e-05,0.19029463827610016,4.698262929916382,81.14050197601318,4 +4646,0.2682104706764221,0.2929806709289551,0.28303804993629456,0.20396269857883453,960.1631469726562,1e-05,0.14995981752872467,3.696241617202759,81.14050197601318,4 +4647,0.27963533997535706,0.1551508754491806,0.15990741550922394,0.17925408482551575,775.2649536132812,1e-05,0.15119904279708862,2.9695303440093994,81.14050197601318,4 +4648,0.22311502695083618,0.2621794044971466,0.2694845497608185,0.21165500581264496,978.4493408203125,1e-05,0.13446004688739777,3.4026286602020264,81.14050197601318,4 +4649,0.2949780225753784,0.32173851132392883,0.3114209473133087,0.2265734225511551,505.5683898925781,1e-05,0.10513634234666824,3.1964402198791504,81.14050197601318,4 +4650,0.2348354458808899,0.2516191899776459,0.23755060136318207,0.19440560042858124,810.0248413085938,1e-05,0.1342475712299347,3.7414731979370117,81.14050197601318,4 +4651,0.22416019439697266,0.13743659853935242,0.13293173909187317,0.19790209829807281,867.7844848632812,1e-05,0.14270369708538055,3.6185190677642822,81.14050197601318,4 +4652,0.2030791938304901,0.12593884766101837,0.12917646765708923,0.16363635659217834,580.2335815429688,1e-05,0.11143001168966293,3.984279155731201,81.14050197601318,4 +4653,0.4215760827064514,0.2666112780570984,0.26046013832092285,0.12121211737394333,712.31884765625,1e-05,0.13999421894550323,4.28643274307251,81.14050197601318,4 +4654,0.21148675680160522,0.359701931476593,0.36088159680366516,0.2566433548927307,995.7847900390625,1e-05,0.12158824503421783,3.903733968734741,81.14050197601318,4 +4655,0.15370820462703705,0.31896480917930603,0.315969854593277,0.16433566808700562,961.5278930664062,1e-05,0.10530763864517212,3.453049898147583,81.14050197601318,4 +4656,0.24007445573806763,0.2636917233467102,0.25417980551719666,0.24871794879436493,622.5833740234375,1e-05,0.13297314941883087,4.0942511558532715,81.14050197601318,4 +4657,0.18407846987247467,0.10635334253311157,0.12506549060344696,0.25757575035095215,924.6715087890625,1e-05,0.11931927502155304,3.665325880050659,81.14050197601318,4 +4658,0.26107698678970337,0.23049770295619965,0.2218429148197174,0.2242424190044403,792.0157470703125,1e-05,0.08779062330722809,4.2586236000061035,81.14050197601318,4 +4659,0.16519063711166382,0.21041615307331085,0.22074571251869202,0.22960372269153595,327.6654357910156,1e-05,0.12004712969064713,4.494871616363525,81.14050197601318,4 +4660,0.34519702196121216,0.6202216744422913,0.6214081048965454,0.18881118297576904,113.7176742553711,1e-05,0.17502881586551666,4.240664958953857,81.14050197601318,4 +4661,0.2576342523097992,0.18994539976119995,0.1859007477760315,0.16526806354522705,951.4989624023438,1e-05,0.11951220035552979,3.0093841552734375,81.14050197601318,4 +4662,0.1587703973054886,0.43593066930770874,0.40287870168685913,0.18578088283538818,977.9759521484375,1e-05,0.15547700226306915,3.201385259628296,81.14050197601318,4 +4663,0.2685833275318146,0.1521906703710556,0.16213011741638184,0.24195803701877594,861.1730346679688,1e-05,0.24294719099998474,3.369048595428467,81.14050197601318,4 +4664,0.22178740799427032,0.2593899965286255,0.25937870144844055,0.250582754611969,998.5840454101562,1e-05,0.12860754132270813,3.222883939743042,81.14050197601318,4 +4665,0.18800722062587738,0.24867013096809387,0.2596551179885864,0.15198135375976562,990.228515625,1e-05,0.09771222621202469,3.3682870864868164,81.14050197601318,4 +4666,0.10293322801589966,0.09439610689878464,0.10782480984926224,0.22797203063964844,890.15478515625,1e-05,0.12392573803663254,4.0875585079193115,81.14050197601318,4 +4667,0.2215951383113861,0.2400314211845398,0.2353186458349228,0.19440560042858124,974.5794677734375,1e-05,0.1559649109840393,3.2431187629699707,81.14050197601318,4 +4668,0.23053821921348572,0.3251465857028961,0.3285234272480011,0.1958041936159134,323.4160461425781,1e-05,0.20002704858779907,3.330374240875244,81.14050197601318,4 +4669,0.1720672994852066,0.2407403141260147,0.20883546769618988,0.2321678251028061,986.787841796875,1e-05,0.10396556556224823,3.046312093734741,81.14050197601318,4 +4670,0.15239199995994568,0.11714550107717514,0.11714550107717514,0.0,828.6761474609375,1e-05,0.13866016268730164,3.1519229412078857,81.14050197601318,4 +4671,0.32185810804367065,0.22333918511867523,0.2034786194562912,0.2097902148962021,625.9617919921875,1e-05,0.12408488988876343,2.8531973361968994,81.14050197601318,4 +4672,0.307722806930542,0.28404754400253296,0.2787927985191345,0.13449883460998535,981.9857788085938,1e-05,0.12494170665740967,3.3734383583068848,81.14050197601318,4 +4673,0.13546288013458252,0.2203553318977356,0.21816302835941315,0.21911421418190002,821.2252807617188,1e-05,0.3360298275947571,3.0864908695220947,81.14050197601318,4 +4674,0.3086472749710083,0.16375961899757385,0.1522950381040573,0.1890442818403244,624.2781982421875,1e-05,0.175524041056633,3.146209239959717,81.14050197601318,4 +4675,0.27459144592285156,0.3697739243507385,0.34665602445602417,0.21398600935935974,967.5030517578125,1e-05,0.13029742240905762,3.0753445625305176,81.14050197601318,4 +4676,0.17563189566135406,0.34107115864753723,0.31122180819511414,0.2454545497894287,987.2093505859375,1e-05,0.12609615921974182,3.060694694519043,81.14050197601318,4 +4677,0.1482171267271042,0.2989093065261841,0.2908911406993866,0.22004662454128265,988.5972900390625,1e-05,0.20251576602458954,2.8326869010925293,81.14050197601318,4 +4678,0.2348414808511734,0.17813140153884888,0.17184914648532867,0.1678321659564972,947.2893676757812,1e-05,0.10933562368154526,3.340059518814087,81.14050197601318,4 +4679,0.21424275636672974,0.12398843467235565,0.12335365265607834,0.2321678251028061,834.6194458007812,1e-05,0.21683526039123535,3.1200478076934814,81.14050197601318,4 +4680,0.19469407200813293,0.1732240468263626,0.1772979199886322,0.23519814014434814,527.8575439453125,1e-05,0.2011561244726181,3.1042068004608154,81.14050197601318,4 +4681,0.19020357728004456,0.10292806476354599,0.11040499061346054,0.12447552382946014,907.39990234375,1e-05,0.15842124819755554,3.029611587524414,81.14050197601318,4 +4682,0.34740859270095825,0.25305625796318054,0.2561941146850586,0.22494173049926758,980.7741088867188,1e-05,0.13850471377372742,3.1154801845550537,81.14050197601318,4 +4683,0.3447199761867523,0.2067674696445465,0.18870499730110168,0.24731934070587158,785.822265625,1e-05,0.1716977059841156,3.063709259033203,81.14050197601318,4 +4684,0.15539725124835968,0.24886895716190338,0.24985672533512115,0.13939394056797028,999.2957763671875,1e-05,0.1216493546962738,3.140554428100586,81.14050197601318,4 +4685,0.0764949694275856,0.17115814983844757,0.1879471391439438,0.20606060326099396,997.259521484375,1e-05,0.17651446163654327,3.1028058528900146,81.14050197601318,4 +4686,0.23623421788215637,0.11032978445291519,0.11314823478460312,0.25034964084625244,797.257080078125,1e-05,0.14250370860099792,3.1105153560638428,81.14050197601318,4 +4687,0.1860998421907425,0.19851331412792206,0.1872957944869995,0.2393939346075058,883.8079833984375,1e-05,0.21184700727462769,3.069368362426758,81.14050197601318,4 +4688,0.12949678301811218,0.1703033298254013,0.16971200704574585,0.22191141545772552,879.6704711914062,1e-05,0.10433848947286606,2.8432955741882324,81.14050197601318,4 +4689,0.19467619061470032,0.24056775867938995,0.24685043096542358,0.2254079282283783,983.767822265625,1e-05,0.12685102224349976,3.103217124938965,81.14050197601318,4 +4690,0.25111907720565796,0.2884111702442169,0.28334271907806396,0.22913752496242523,534.9400024414062,1e-05,0.1225476786494255,3.100886821746826,81.14050197601318,4 +4691,0.3008470833301544,0.29050424695014954,0.26810434460639954,0.18927739560604095,928.31103515625,1e-05,0.137344628572464,3.1836559772491455,81.14050197601318,4 +4692,0.1975078582763672,0.19053441286087036,0.19035036861896515,0.0923076942563057,972.7406005859375,1e-05,0.17555363476276398,3.124314785003662,81.14050197601318,4 +4693,0.15297755599021912,0.15100683271884918,0.15194085240364075,0.21771562099456787,955.7301025390625,1e-05,0.11162231117486954,3.0615437030792236,81.14050197601318,4 +4694,0.42887067794799805,0.1893073320388794,0.18384048342704773,0.23030303418636322,810.7058715820312,1e-05,0.20450779795646667,2.829988718032837,81.14050197601318,4 +4695,0.2505783140659332,0.30721035599708557,0.3069551885128021,0.2510489523410797,812.7318115234375,1e-05,0.12423563003540039,3.3215558528900146,81.14050197601318,4 +4696,0.2963981330394745,0.2240106761455536,0.20869126915931702,0.1806526780128479,922.657958984375,1e-05,0.13878168165683746,3.3023829460144043,81.14050197601318,4 +4697,0.24986805021762848,0.17260479927062988,0.17399512231349945,0.19510489702224731,858.7315673828125,1e-05,0.14113616943359375,2.8272480964660645,81.14050197601318,4 +4698,0.09190201014280319,0.1406445950269699,0.1512226015329361,0.16247086226940155,972.9094848632812,1e-05,0.12723149359226227,3.148973226547241,81.14050197601318,4 +4699,0.17771196365356445,0.3260275423526764,0.3230903744697571,0.20000000298023224,948.6395874023438,1e-05,0.28593629598617554,3.1346163749694824,81.14050197601318,4 +4700,0.24090629816055298,0.18098749220371246,0.19721250236034393,0.24289044737815857,995.7847900390625,1e-05,0.15270744264125824,2.8262383937835693,81.14050197601318,4 +4701,0.23145869374275208,0.3166317045688629,0.3272435665130615,0.15128205716609955,243.64947509765625,1e-05,0.20489774644374847,3.2666561603546143,81.14050197601318,4 +4702,0.31583255529403687,0.2823168933391571,0.27748018503189087,0.19557109475135803,525.4592895507812,1e-05,0.12738922238349915,3.3571150302886963,81.14050197601318,4 +4703,0.08022082597017288,0.1455404907464981,0.14303618669509888,0.274125874042511,842.5615844726562,1e-05,0.18134702742099762,2.83370041847229,81.14050197601318,4 +4704,0.33306241035461426,0.4176941514015198,0.43844956159591675,0.2421911358833313,171.19692993164062,1e-05,0.18811623752117157,3.475588798522949,81.14050197601318,4 +4705,0.29563039541244507,0.25861862301826477,0.25466108322143555,0.2230769246816635,839.7739868164062,1e-05,0.15089191496372223,3.1176514625549316,81.14050197601318,4 +4706,0.2778645157814026,0.19342483580112457,0.1919301152229309,0.20629370212554932,806.5763549804688,1e-05,0.2659446895122528,2.82786226272583,81.14050197601318,4 +4707,0.25458019971847534,0.2762572765350342,0.26647818088531494,0.2254079282283783,470.316650390625,1e-05,0.16614097356796265,3.364964246749878,81.14050197601318,4 +4708,0.14947713911533356,0.15134990215301514,0.15035143494606018,0.2321678251028061,965.6807250976562,1e-05,0.12990373373031616,3.098923921585083,81.14050197601318,4 +4709,0.3248882293701172,0.3158232569694519,0.310958594083786,0.16643357276916504,510.6620178222656,1e-05,0.17094102501869202,2.826937198638916,81.14050197601318,4 +4710,0.2026103436946869,0.268798291683197,0.24314936995506287,0.18531468510627747,874.521484375,1e-05,0.12368480116128922,3.185598134994507,81.14050197601318,4 +4711,0.26803478598594666,0.17313513159751892,0.15754425525665283,0.2321678251028061,949.0853271484375,1e-05,0.11433098465204239,3.089329242706299,81.14050197601318,4 +4712,0.22940057516098022,0.20806387066841125,0.20704592764377594,0.07855477929115295,687.85546875,1e-05,0.12632770836353302,3.0021636486053467,81.14050197601318,4 +4713,0.18320494890213013,0.21959763765335083,0.21430446207523346,0.20372959971427917,873.2015991210938,1e-05,0.13542933762073517,3.282731056213379,81.14050197601318,4 +4714,0.14797469973564148,0.18074093759059906,0.17697864770889282,0.23752914369106293,742.382080078125,1e-05,0.09614496678113937,3.123056650161743,81.14050197601318,4 +4715,0.2421635091304779,0.1841263324022293,0.17836926877498627,0.21445220708847046,990.0938720703125,1e-05,0.24399487674236298,2.818692207336426,81.14050197601318,4 +4716,0.17454074323177338,0.1459050476551056,0.14441920816898346,0.27202796936035156,867.7844848632812,1e-05,0.11080312728881836,3.4113712310791016,81.14050197601318,4 +4717,0.2025161236524582,0.2167622298002243,0.2097361981868744,0.17482517659664154,869.15966796875,1e-05,0.17676043510437012,3.0522639751434326,81.14050197601318,4 +4718,0.23568478226661682,0.39845383167266846,0.3639964461326599,0.1930069923400879,997.1378173828125,1e-05,0.16720779240131378,3.1191577911376953,81.14050197601318,4 +4719,0.26674020290374756,0.23244164884090424,0.21621106564998627,0.22051282227039337,673.1508178710938,1e-05,0.14363199472427368,3.4387762546539307,81.14050197601318,4 +4720,0.30521684885025024,0.12223570793867111,0.1301327496767044,0.11771561950445175,606.806884765625,1e-05,0.14195279777050018,2.8313677310943604,81.14050197601318,4 +4721,0.2624940872192383,0.30868250131607056,0.282831072807312,0.14965035021305084,945.68896484375,1e-05,0.12788176536560059,2.8243331909179688,81.14050197601318,4 +4722,0.23337221145629883,0.2821735143661499,0.2625744640827179,0.253846138715744,972.4016723632812,1e-05,0.17483577132225037,3.413213014602661,81.14050197601318,4 +4723,0.18436169624328613,0.1984228640794754,0.19713906943798065,0.12191142141819,898.37353515625,1e-05,0.1702527552843094,3.068657875061035,81.14050197601318,4 +4724,0.2803657352924347,0.09935169667005539,0.10645993798971176,0.2270396202802658,785.0322875976562,1e-05,0.2555629312992096,3.1272711753845215,81.14050197601318,4 +4725,0.2009717971086502,0.21250176429748535,0.2083219587802887,0.2114219069480896,940.4759521484375,1e-05,0.10377142578363419,3.0925354957580566,81.14050197601318,4 +4726,0.2191198319196701,0.22716917097568512,0.23233550786972046,0.15757575631141663,443.50128173828125,1e-05,0.11614885926246643,2.822007894515991,81.14050197601318,4 +4727,0.1820456087589264,0.1119065061211586,0.13614404201507568,0.21678321063518524,988.0452880859375,1e-05,0.12058563530445099,2.828035831451416,81.14050197601318,4 +4728,0.24328157305717468,0.17531101405620575,0.1676531732082367,0.23006993532180786,608.6077880859375,1e-05,0.24695070087909698,3.1848528385162354,81.14050197601318,4 +4729,0.19753167033195496,0.22002650797367096,0.2139422595500946,0.15780885517597198,994.27783203125,1e-05,0.1245524063706398,2.844006299972534,81.14050197601318,4 +4730,0.35474494099617004,0.2716285288333893,0.2716285288333893,0.0,336.031982421875,1e-05,0.15441767871379852,3.133519172668457,81.14050197601318,4 +4731,0.2821548581123352,0.23499098420143127,0.26214727759361267,0.16573426127433777,327.6654357910156,1e-05,0.2935173511505127,3.334642171859741,81.14050197601318,4 +4732,0.1248541921377182,0.17481128871440887,0.1904011368751526,0.16433566808700562,966.414306640625,1e-05,0.13164454698562622,2.8285391330718994,81.14050197601318,4 +4733,0.18571344017982483,0.3707359731197357,0.33717525005340576,0.23030303418636322,988.734619140625,1e-05,0.14298173785209656,3.128802537918091,81.14050197601318,4 +4734,0.1532769650220871,0.16227686405181885,0.1609843224287033,0.08205128461122513,946.1489868164062,1e-05,0.28273430466651917,3.3490853309631348,81.14050197601318,4 +4735,0.18975064158439636,0.1917332261800766,0.19167044758796692,0.20396269857883453,995.035400390625,1e-05,0.22950546443462372,2.815972328186035,81.14050197601318,4 +4736,0.3095974326133728,0.25805601477622986,0.2749735116958618,0.2489510476589203,959.3736572265625,1e-05,0.12427106499671936,3.1245176792144775,81.14050197601318,4 +4737,0.17839516699314117,0.25395989418029785,0.2523670792579651,0.2421911358833313,920.9009399414062,1e-05,0.15074439346790314,3.4107234477996826,81.14050197601318,4 +4738,0.2237674444913864,0.21252097189426422,0.20736005902290344,0.14685314893722534,939.9876098632812,1e-05,0.1207391619682312,2.8265304565429688,81.14050197601318,4 +4739,0.2008107304573059,0.3061201572418213,0.2938360273838043,0.28601399064064026,921.48974609375,1e-05,0.12878072261810303,3.1663336753845215,81.14050197601318,4 +4740,0.19980289041996002,0.14883984625339508,0.1584833413362503,0.19114218652248383,834.0355224609375,1e-05,0.1097063273191452,3.422534465789795,81.14050197601318,4 +4741,0.11979338526725769,0.3358609974384308,0.3203139007091522,0.23193472623825073,994.7838134765625,1e-05,0.13402830064296722,2.838472366333008,81.14050197601318,4 +4742,0.22412148118019104,0.2313844859600067,0.23035481572151184,0.22121211886405945,975.4014282226562,1e-05,0.13205358386039734,3.1395375728607178,81.14050197601318,4 +4743,0.1864699423313141,0.3671792149543762,0.3484053611755371,0.225874125957489,973.748779296875,1e-05,0.18025179207324982,3.319365978240967,81.14050197601318,4 +4744,0.19446828961372375,0.27631673216819763,0.2651304006576538,0.20839160680770874,550.8392333984375,1e-05,0.22939042747020721,2.834876775741577,81.14050197601318,4 +4745,0.18844452500343323,0.239918053150177,0.22915863990783691,0.2554778456687927,955.10791015625,1e-05,0.12963932752609253,3.1293270587921143,81.14050197601318,4 +4746,0.19262124598026276,0.2435407191514969,0.2313905954360962,0.23240093886852264,599.4783325195312,1e-05,0.20943309366703033,3.135749101638794,81.14050197601318,4 +4747,0.19221799075603485,0.21010205149650574,0.2003607302904129,0.2030303031206131,936.7528076171875,1e-05,0.12658028304576874,2.819685935974121,81.14050197601318,4 +4748,0.35910776257514954,0.4941958487033844,0.5124024748802185,0.20163169503211975,200.4163818359375,1e-05,0.14274339377880096,3.42531681060791,81.14050197601318,4 +4749,0.28011268377304077,0.17134685814380646,0.1723582148551941,0.21934731304645538,962.2981567382812,1e-05,0.1320699155330658,3.124603509902954,81.14050197601318,4 +4750,0.1925375610589981,0.12874531745910645,0.13100671768188477,0.19813519716262817,720.25927734375,1e-05,0.2070508450269699,2.8203928470611572,81.14050197601318,4 +4751,0.24800825119018555,0.18898437917232513,0.17996062338352203,0.11701631546020508,753.992919921875,1e-05,0.11372153460979462,3.0868098735809326,81.14050197601318,4 +4752,0.26455384492874146,0.2215854674577713,0.21667245030403137,0.12657342851161957,582.22021484375,1e-05,0.15564125776290894,3.074680805206299,81.14050197601318,4 +4753,0.37229472398757935,0.2975383698940277,0.29481592774391174,0.22517482936382294,747.3050537109375,1e-05,0.15452103316783905,2.828132390975952,81.14050197601318,4 +4754,0.20865529775619507,0.13693656027317047,0.13789303600788116,0.151048943400383,869.15966796875,1e-05,0.1271367371082306,3.3772459030151367,81.14050197601318,4 +4755,0.11630341410636902,0.273853063583374,0.26399290561676025,0.1566433608531952,956.3478393554688,1e-05,0.12145276367664337,3.0190823078155518,81.14050197601318,4 +4756,0.26784852147102356,0.22721260786056519,0.21153046190738678,0.23962703347206116,846.3767700195312,1e-05,0.15388458967208862,2.8297863006591797,81.14050197601318,4 +4757,0.213163360953331,0.20942099392414093,0.2076931595802307,0.13076922297477722,977.1804809570312,1e-05,0.1285431832075119,3.091336727142334,81.14050197601318,4 +4758,0.2663883864879608,0.22084464132785797,0.21345879137516022,0.18391607701778412,962.4896240234375,1e-05,0.15769325196743011,3.1185009479522705,81.14050197601318,4 +4759,0.2510532736778259,0.2446262091398239,0.23425811529159546,0.20815850794315338,892.0726318359375,1e-05,0.156106635928154,2.8284647464752197,81.14050197601318,4 +4760,0.23153311014175415,0.2533065378665924,0.23886723816394806,0.20536130666732788,953.4276123046875,1e-05,0.19627885520458221,3.4423866271972656,81.14050197601318,4 +4761,0.2800540328025818,0.10425762087106705,0.10489353537559509,0.10979020595550537,885.4254760742188,1e-05,0.1223025694489479,3.0959153175354004,81.14050197601318,4 +4762,0.10517469048500061,0.1584133505821228,0.15662690997123718,0.22960372269153595,797.99267578125,1e-05,0.1115730032324791,2.830575466156006,81.14050197601318,4 +4763,0.26158076524734497,0.28940269351005554,0.2732868194580078,0.1818181872367859,778.5809936523438,1e-05,0.16476188600063324,3.4319324493408203,81.14050197601318,4 +4764,0.15493296086788177,0.3229510486125946,0.31003376841545105,0.1818181872367859,980.1610107421875,1e-05,0.13095206022262573,3.164607048034668,81.14050197601318,4 +4765,0.2544707655906677,0.12484308332204819,0.12636223435401917,0.2242424190044403,823.7489624023438,1e-05,0.11202655732631683,3.060837507247925,81.14050197601318,4 +4766,0.24931856989860535,0.1922510862350464,0.19317710399627686,0.21282051503658295,851.1375732421875,1e-05,0.10462667793035507,3.335289478302002,81.14050197601318,4 +4767,0.21461713314056396,0.23891884088516235,0.2393742799758911,0.19696970283985138,997.9851684570312,1e-05,0.11915865540504456,2.8343827724456787,81.14050197601318,4 +4768,0.2206002175807953,0.12089527398347855,0.12552326917648315,0.20000000298023224,861.1730346679688,1e-05,0.23531019687652588,2.8581149578094482,81.14050197601318,4 +4769,0.2718399465084076,0.18923218548297882,0.1895037293434143,0.23030303418636322,916.991943359375,1e-05,0.15523488819599152,3.060633659362793,81.14050197601318,4 +4770,0.08709795773029327,0.19214403629302979,0.18187400698661804,0.2433566451072693,917.9066772460938,1e-05,0.11310849338769913,3.09716534614563,81.14050197601318,4 +4771,0.20285606384277344,0.18337541818618774,0.17746831476688385,0.13286712765693665,926.0864868164062,1e-05,0.13371774554252625,3.082613945007324,81.14050197601318,4 +4772,0.34837454557418823,0.22411324083805084,0.22527693212032318,0.22843822836875916,478.7982177734375,1e-05,0.1522887796163559,3.368642807006836,81.14050197601318,4 +4773,0.310092955827713,0.15628618001937866,0.1592336893081665,0.1650349646806717,917.9066772460938,1e-05,0.13369739055633545,2.827317237854004,81.14050197601318,4 +4774,0.22419260442256927,0.26755577325820923,0.2553987205028534,0.20606060326099396,936.7528076171875,1e-05,0.13510288298130035,2.8284149169921875,81.14050197601318,4 +4775,0.36071550846099854,0.19239065051078796,0.18629978597164154,0.20536130666732788,835.2010498046875,1e-05,0.13356748223304749,3.094726324081421,81.14050197601318,4 +4776,0.3237587511539459,0.21595679223537445,0.19500800967216492,0.2242424190044403,601.3294677734375,1e-05,0.15942880511283875,3.1280410289764404,81.14050197601318,4 +4777,0.12551526725292206,0.3203691244125366,0.310289204120636,0.20372959971427917,973.748779296875,1e-05,0.18191593885421753,3.08587908744812,81.14050197601318,4 +4778,0.22277943789958954,0.1622791737318039,0.16405348479747772,0.11748252063989639,945.226806640625,1e-05,0.6475288271903992,3.4835205078125,81.14050197601318,4 +4779,0.11000442504882812,0.3096558749675751,0.28925931453704834,0.20326340198516846,970.6856079101562,1e-05,0.5650726556777954,2.833124876022339,81.14050197601318,4 +4780,0.2850637137889862,0.18651853501796722,0.18268053233623505,0.12727272510528564,830.4837646484375,1e-05,0.1897355318069458,3.025932550430298,81.14050197601318,4 +4781,0.1706743836402893,0.13735048472881317,0.12591542303562164,0.23006993532180786,887.0220336914062,1e-05,0.12356140464544296,3.411159038543701,81.14050197601318,4 +4782,0.21466875076293945,0.19037486612796783,0.17674240469932556,0.10839160531759262,807.9645385742188,1e-05,0.13892856240272522,2.836050510406494,81.14050197601318,4 +4783,0.23043644428253174,0.21298618614673615,0.221604123711586,0.2596736550331116,458.6604309082031,1e-05,0.17329025268554688,3.111919641494751,81.14050197601318,4 +4784,0.29879674315452576,0.36833950877189636,0.3657837212085724,0.19510489702224731,992.0859375,1e-05,0.25312939286231995,3.4406275749206543,81.14050197601318,4 +4785,0.33029112219810486,0.21910063922405243,0.21766720712184906,0.13799533247947693,637.4429931640625,1e-05,0.1418345868587494,2.8393778800964355,81.14050197601318,4 +4786,0.32040935754776,0.242272287607193,0.24582356214523315,0.24568764865398407,430.87518310546875,1e-05,0.136249378323555,3.1362433433532715,81.14050197601318,4 +4787,0.22442395985126495,0.20765560865402222,0.2008708119392395,0.23030303418636322,580.2335815429688,1e-05,0.11525551229715347,3.1529805660247803,81.14050197601318,4 +4788,0.1748916208744049,0.17304126918315887,0.16858680546283722,0.1818181872367859,578.2326049804688,1e-05,0.11449375748634338,2.8388659954071045,81.14050197601318,4 +4789,0.15441611409187317,0.25874316692352295,0.24527834355831146,0.26759907603263855,467.44049072265625,1e-05,0.15112291276454926,3.3399579524993896,81.14050197601318,4 +4790,0.34811535477638245,0.10611987113952637,0.11138200759887695,0.17482517659664154,752.1058349609375,1e-05,0.1333455890417099,3.4588286876678467,81.14050197601318,4 +4791,0.2395535111427307,0.23849913477897644,0.2403332144021988,0.17249417304992676,651.463623046875,1e-05,0.1219417005777359,2.828051805496216,81.14050197601318,4 +4792,0.2461034208536148,0.2296988070011139,0.22892998158931732,0.15244755148887634,404.18499755859375,1e-05,0.12418586760759354,3.112253189086914,81.14050197601318,4 +4793,0.23578514158725739,0.09545694291591644,0.10657213628292084,0.13449883460998535,965.4962768554688,1e-05,0.11337089538574219,3.135561943054199,81.14050197601318,4 +4794,0.167710080742836,0.19423474371433258,0.19397465884685516,0.24918414652347565,836.3575439453125,1e-05,0.17056511342525482,2.8270552158355713,81.14050197601318,4 +4795,0.20271600782871246,0.4726477563381195,0.46358174085617065,0.1902097910642624,981.6846923828125,1e-05,0.11057104170322418,3.4247517585754395,81.14050197601318,4 +4796,0.18474175035953522,0.17012089490890503,0.16564540565013885,0.14079253375530243,832.8609008789062,1e-05,0.9378914833068848,3.127941608428955,81.14050197601318,4 +4797,0.12681768834590912,0.1632087230682373,0.15865425765514374,0.19930069148540497,895.0792846679688,1e-05,0.1229560449719429,2.817150831222534,81.14050197601318,4 +4798,0.22404751181602478,0.23970390856266022,0.22936978936195374,0.2482517510652542,961.9138793945312,1e-05,0.18788841366767883,3.3224880695343018,81.14050197601318,4 +4799,0.16535969078540802,0.2595660090446472,0.2510962188243866,0.2097902148962021,851.6567993164062,1e-05,0.09327776730060577,3.0571086406707764,81.14050197601318,4 +4800,0.16861388087272644,0.27349770069122314,0.2692115604877472,0.2337995320558548,972.5713500976562,1e-05,0.22244709730148315,3.1206307411193848,81.14050197601318,4 +4801,0.1561221182346344,0.21529503166675568,0.2055070400238037,0.22004662454128265,914.8272094726562,1e-05,0.12386704236268997,3.0823147296905518,81.14050197601318,4 +4802,0.2370394915342331,0.28190135955810547,0.2744913101196289,0.16083915531635284,916.991943359375,1e-05,0.17131966352462769,3.3772478103637695,81.14050197601318,4 +4803,0.20997148752212524,0.2765141725540161,0.257682204246521,0.22913752496242523,651.463623046875,1e-05,0.13792982697486877,2.825815439224243,81.14050197601318,4 +4804,0.20413348078727722,0.17762963473796844,0.1786799430847168,0.12727272510528564,761.3585205078125,1e-05,0.10694462060928345,3.1405951976776123,81.14050197601318,4 +4805,0.1704181730747223,0.21542717516422272,0.2130044847726822,0.23123542964458466,920.605224609375,1e-05,0.11084777861833572,3.1156668663024902,81.14050197601318,4 +4806,0.1456930786371231,0.27164044976234436,0.2632022500038147,0.2829836905002594,966.2316284179688,1e-05,0.11042243242263794,3.1297080516815186,81.14050197601318,4 +4807,0.128261536359787,0.2154434323310852,0.20955437421798706,0.10932400822639465,816.0525512695312,1e-05,0.14431922137737274,3.085782766342163,81.14050197601318,4 +4808,0.25868621468544006,0.4036043882369995,0.3760911524295807,0.2270396202802658,999.6487426757812,1e-05,0.13277848064899445,3.401984453201294,81.14050197601318,4 +4809,0.1003287062048912,0.23051263391971588,0.20726878941059113,0.2114219069480896,946.378173828125,1e-05,0.16956861317157745,2.848942995071411,81.14050197601318,4 +4810,0.18018393218517303,0.2790643572807312,0.2698923349380493,0.16083915531635284,996.5260620117188,1e-05,0.13615986704826355,3.1352806091308594,81.14050197601318,4 +4811,0.2717134952545166,0.19420494139194489,0.1917792409658432,0.24428904056549072,696.7341918945312,1e-05,0.11623013019561768,3.1383821964263916,81.14050197601318,4 +4812,0.319446325302124,0.32338953018188477,0.31944677233695984,0.06969697028398514,375.388671875,1e-05,65.60338592529297,3.120502233505249,81.14050197601318,4 +4813,0.26249879598617554,0.20834681391716003,0.20837968587875366,0.2421911358833313,774.4262084960938,1e-05,0.1338629424571991,3.288071393966675,81.14050197601318,4 +4814,0.27855217456817627,0.22168266773223877,0.21108250319957733,0.23799534142017365,805.1764526367188,1e-05,3.318514347076416,3.1186976432800293,81.14050197601318,4 +4815,0.11345449090003967,0.33583375811576843,0.3292538523674011,0.19230769574642181,984.4981079101562,1e-05,0.189894899725914,3.0336029529571533,81.14050197601318,4 +4816,0.24924932420253754,0.2540539801120758,0.2551455497741699,0.19114218652248383,858.2379760742188,1e-05,0.17326481640338898,3.118561267852783,81.14050197601318,4 +4817,0.20901940762996674,0.2492920309305191,0.2517540752887726,0.16853146255016327,980.1610107421875,1e-05,0.12177848070859909,3.0975418090820312,81.14050197601318,4 +4818,0.1895160973072052,0.27121713757514954,0.24893109500408173,0.21002331376075745,940.7190551757812,1e-05,0.17477944493293762,2.831880807876587,81.14050197601318,4 +4819,0.20865431427955627,0.3241042196750641,0.32699963450431824,0.18111887574195862,987.7676391601562,1e-05,0.13924506306648254,3.331122636795044,81.14050197601318,4 +4820,0.12873460352420807,0.13155578076839447,0.13716895878314972,0.23869463801383972,823.121826171875,1e-05,0.16397444903850555,3.1275508403778076,81.14050197601318,4 +4821,0.27156031131744385,0.268453449010849,0.28435203433036804,0.17179487645626068,510.6620178222656,1e-05,0.13429979979991913,3.090597152709961,81.14050197601318,4 +4822,0.13943754136562347,0.1338682770729065,0.13931608200073242,0.2780885696411133,938.2591552734375,1e-05,0.13297362625598907,2.8331174850463867,81.14050197601318,4 +4823,0.1307116448879242,0.2335766851902008,0.23087827861309052,0.2041957974433899,849.041259765625,1e-05,0.15007781982421875,3.11881685256958,81.14050197601318,4 +4824,0.23105916380882263,0.2743593454360962,0.2554416060447693,0.2097902148962021,835.2010498046875,1e-05,0.2625899612903595,3.056138753890991,81.14050197601318,4 +4825,0.2910420894622803,0.2560007870197296,0.23813748359680176,0.16130536794662476,620.8772583007812,1e-05,0.12672466039657593,3.3318214416503906,81.14050197601318,4 +4826,0.3331744372844696,0.3165375292301178,0.3086315393447876,0.2097902148962021,414.4279479980469,1e-05,0.11660777032375336,3.1271183490753174,81.14050197601318,4 +4827,0.4538499116897583,0.6112011671066284,0.6200888752937317,0.2501165568828583,133.62509155273438,1e-05,0.1410345882177353,3.343824863433838,81.14050197601318,4 +4828,0.21864789724349976,0.29528069496154785,0.2801761031150818,0.15734265744686127,909.3855590820312,1e-05,0.13499034941196442,2.820469379425049,81.14050197601318,4 +4829,0.13261139392852783,0.2209196835756302,0.2157406210899353,0.17435897886753082,976.0529174804688,1e-05,0.14172375202178955,3.098710536956787,81.14050197601318,4 +4830,0.19821131229400635,0.12443982064723969,0.1355808824300766,0.1818181872367859,731.0974731445312,1e-05,0.11419574171304703,3.0897276401519775,81.14050197601318,4 +4831,0.1357957422733307,0.21062132716178894,0.19709719717502594,0.2041957974433899,889.7675170898438,1e-05,0.10730067640542984,3.3115596771240234,81.14050197601318,4 +4832,0.23719719052314758,0.29791268706321716,0.29209020733833313,0.23030303418636322,960.7506713867188,1e-05,0.17493779957294464,3.144080877304077,81.14050197601318,4 +4833,0.17525756359100342,0.30191585421562195,0.28016602993011475,0.2708624601364136,956.3478393554688,1e-05,0.12149347364902496,3.386536121368408,81.14050197601318,4 +4834,0.18805181980133057,0.17761622369289398,0.1842324584722519,0.23986013233661652,424.38739013671875,1e-05,0.12358791381120682,2.834911823272705,81.14050197601318,4 +4835,0.2811851501464844,0.3213292956352234,0.3237830400466919,0.16480186581611633,475.9952392578125,1e-05,0.1555100381374359,3.09755277633667,81.14050197601318,4 +4836,0.282213032245636,0.20846542716026306,0.20857402682304382,0.2041957974433899,610.396240234375,1e-05,5.294179916381836,3.2874748706817627,81.14050197601318,4 +4837,0.22624358534812927,0.24178896844387054,0.22683267295360565,0.250582754611969,873.64306640625,1e-05,0.15132875740528107,3.3473429679870605,81.14050197601318,4 +4838,0.3082808256149292,0.2467929720878601,0.23700281977653503,0.20000000298023224,907.39990234375,1e-05,0.12231140583753586,3.166353464126587,81.14050197601318,4 +4839,0.3475690484046936,0.20124812424182892,0.20617209374904633,0.16969697177410126,681.2896118164062,1e-05,0.13766154646873474,3.0325918197631836,81.14050197601318,4 +4840,0.23514708876609802,0.1775812804698944,0.18814104795455933,0.11118881404399872,941.685791015625,1e-05,0.15442495048046112,3.146463632583618,81.14050197601318,4 +4841,0.1424107700586319,0.1730668842792511,0.16689743101596832,0.23613053560256958,944.7620849609375,1e-05,0.25941768288612366,2.840482234954834,81.14050197601318,4 +4842,0.29507899284362793,0.3071436285972595,0.2944977879524231,0.1878787875175476,785.822265625,1e-05,0.13378043472766876,3.371570587158203,81.14050197601318,4 +4843,0.3053629994392395,0.29457804560661316,0.28455376625061035,0.21212121844291687,610.396240234375,1e-05,0.34469908475875854,3.1098873615264893,81.14050197601318,4 +4844,0.2637926936149597,0.14102093875408173,0.14492590725421906,0.2265734225511551,700.4320068359375,1e-05,0.10975125432014465,3.0698018074035645,81.14050197601318,4 +4845,0.17022694647312164,0.17623737454414368,0.1778862178325653,0.23892773687839508,983.178466796875,1e-05,0.14192087948322296,3.093780040740967,81.14050197601318,4 +4846,0.14725856482982635,0.19878330826759338,0.18882468342781067,0.17156177759170532,712.31884765625,1e-05,0.12115541100502014,3.103579521179199,81.14050197601318,4 +4847,0.27691853046417236,0.5465869903564453,0.5539343953132629,0.23682983219623566,146.47067260742188,1e-05,0.10663603246212006,2.8362374305725098,81.14050197601318,4 +4848,0.16248534619808197,0.24839521944522858,0.23550355434417725,0.23076923191547394,979.6979370117188,1e-05,0.15557630360126495,3.3949267864227295,81.14050197601318,4 +4849,0.29520854353904724,0.15448811650276184,0.15840108692646027,0.2337995320558548,844.7539672851562,1e-05,0.10276259481906891,3.058821439743042,81.14050197601318,4 +4850,0.282925009727478,0.32414510846138,0.31560465693473816,0.24032634496688843,421.0982971191406,1e-05,0.15645135939121246,3.105752468109131,81.14050197601318,4 +4851,0.28472283482551575,0.23044072091579437,0.21812310814857483,0.12960372865200043,694.233642578125,1e-05,0.17755164206027985,3.027681827545166,81.14050197601318,4 +4852,0.1901250034570694,0.26611149311065674,0.26007142663002014,0.20000000298023224,955.10791015625,1e-05,0.1744840294122696,3.116231679916382,81.14050197601318,4 +4853,0.16409684717655182,0.34582045674324036,0.3201969265937805,0.25407925248146057,895.0792846679688,1e-05,0.11840683221817017,3.0565834045410156,81.14050197601318,4 +4854,0.22790153324604034,0.5781150460243225,0.5772126317024231,0.15361304581165314,140.08938598632812,1e-05,0.14338012039661407,3.1338703632354736,81.14050197601318,4 +4855,0.10465860366821289,0.25192177295684814,0.23729632794857025,0.23962703347206116,850.6163940429688,1e-05,0.30907610058784485,3.0358219146728516,81.14050197601318,4 +4856,0.22476868331432343,0.28414207696914673,0.2644858956336975,0.2153846174478531,892.0726318359375,1e-05,0.2074805200099945,3.3447020053863525,81.14050197601318,4 +4857,0.1472315639257431,0.3135669231414795,0.3096657395362854,0.1347319334745407,956.552734375,1e-05,0.1213647648692131,3.0284335613250732,81.14050197601318,4 +4858,0.18743088841438293,0.1860419660806656,0.18969422578811646,0.11118881404399872,988.18359375,1e-05,0.13727816939353943,3.1172897815704346,81.14050197601318,4 +4859,0.25080040097236633,0.28616341948509216,0.3060548007488251,0.2622377574443817,991.2958374023438,1e-05,0.14765408635139465,3.0518972873687744,81.14050197601318,4 +4860,0.24560093879699707,0.2950897514820099,0.28422805666923523,0.1946386992931366,955.10791015625,1e-05,0.11368806660175323,3.1386966705322266,81.14050197601318,4 +4861,0.3324505686759949,0.2595639228820801,0.2627185583114624,0.14475524425506592,695.4873657226562,1e-05,0.12054680287837982,3.16528058052063,81.14050197601318,4 +4862,0.13402532041072845,0.18192964792251587,0.189139261841774,0.2181818187236786,776.9306030273438,1e-05,0.08740384876728058,3.344811201095581,81.14050197601318,4 +4863,0.21175606548786163,0.19457051157951355,0.19920974969863892,0.17738927900791168,840.3358154296875,1e-05,0.11139743030071259,3.03117299079895,81.14050197601318,4 +4864,0.20125006139278412,0.4648479223251343,0.4408087730407715,0.23962703347206116,994.27783203125,1e-05,0.13105863332748413,3.118525981903076,81.14050197601318,4 +4865,0.15862490236759186,0.22839443385601044,0.22578682005405426,0.21888111531734467,991.8234252929688,1e-05,0.11069215834140778,3.10835862159729,81.14050197601318,4 +4866,0.2519587576389313,0.368523508310318,0.3797156512737274,0.24079254269599915,292.3681640625,1e-05,0.11654310673475266,3.331054925918579,81.14050197601318,4 +4867,0.11280597746372223,0.3426344096660614,0.33681488037109375,0.302097886800766,989.1450805664062,1e-05,0.11413928866386414,2.828451156616211,81.14050197601318,4 +4868,0.1934220790863037,0.3059024512767792,0.3046412169933319,0.1878787875175476,976.2150268554688,1e-05,0.13364771008491516,3.118598222732544,81.14050197601318,4 +4869,0.1484178751707077,0.4134362041950226,0.3774661123752594,0.23030303418636322,995.6604614257812,1e-05,0.11289607733488083,3.068969964981079,81.14050197601318,4 +4870,0.24432887136936188,0.27627241611480713,0.26680517196655273,0.20489510893821716,870.5208129882812,1e-05,0.13834989070892334,3.1276755332946777,81.14050197601318,4 +4871,0.17518523335456848,0.13739527761936188,0.1480156034231186,0.17715618014335632,976.0529174804688,1e-05,0.09792184829711914,3.4453237056732178,81.14050197601318,4 +4872,0.069964699447155,0.14910966157913208,0.13697762787342072,0.2209790199995041,877.97705078125,1e-05,0.14092880487442017,3.0763442516326904,81.14050197601318,4 +4873,0.1395357847213745,0.3211555480957031,0.31341442465782166,0.21351981163024902,964.940673828125,1e-05,0.14891833066940308,3.118370532989502,81.14050197601318,4 +4874,0.12945806980133057,0.1740063726902008,0.1744748055934906,0.20349650084972382,856.7466430664062,1e-05,0.11892824620008469,3.402573585510254,81.14050197601318,4 +4875,0.17696544528007507,0.1509331613779068,0.14716404676437378,0.22960372269153595,997.0159301757812,1e-05,0.15520687401294708,2.8211240768432617,81.14050197601318,4 +4876,0.218868225812912,0.17928580939769745,0.16942280530929565,0.2482517510652542,906.7301635742188,1e-05,0.11404289305210114,2.827202558517456,81.14050197601318,4 +4877,0.12249693274497986,0.14608314633369446,0.15890558063983917,0.24172493815422058,935.9909057617188,1e-05,0.11216378211975098,3.12395977973938,81.14050197601318,4 +4878,0.29739439487457275,0.20054630935192108,0.20562151074409485,0.21794871985912323,986.079833984375,1e-05,0.31579434871673584,3.108633518218994,81.14050197601318,4 +4879,0.19272500276565552,0.3269767463207245,0.30090469121932983,0.2599067687988281,843.1128540039062,1e-05,0.1121060848236084,3.135672092437744,81.14050197601318,4 +4880,0.1708785593509674,0.34340548515319824,0.3295380175113678,0.19976690411567688,985.364990234375,1e-05,0.16214990615844727,2.822941780090332,81.14050197601318,4 +4881,0.3914201855659485,0.26503482460975647,0.25640806555747986,0.24638694524765015,885.4254760742188,1e-05,0.13907262682914734,3.280592203140259,81.14050197601318,4 +4882,0.20934437215328217,0.24388162791728973,0.23627470433712006,0.2405594438314438,876.2608642578125,1e-05,0.1115771010518074,2.8177735805511475,81.14050197601318,4 +4883,0.18294723331928253,0.1877620667219162,0.18431635200977325,0.2526806592941284,928.03564453125,1e-05,0.10475458949804306,3.3622305393218994,81.14050197601318,4 +4884,0.29252633452415466,0.3361177444458008,0.3262898027896881,0.16317015886306763,962.871337890625,1e-05,0.2703716456890106,3.118178367614746,81.14050197601318,4 +4885,0.3147369623184204,0.5926988124847412,0.5931205749511719,0.22447551786899567,146.47067260742188,1e-05,0.18003837764263153,3.089698553085327,81.14050197601318,4 +4886,0.21365292370319366,0.24934910237789154,0.23530147969722748,0.2242424190044403,867.7844848632812,1e-05,0.10049110651016235,2.8290793895721436,81.14050197601318,4 +4887,0.28494128584861755,0.10163722932338715,0.09819693863391876,0.24405594170093536,906.0565185546875,1e-05,0.15314187109470367,3.288921594619751,81.14050197601318,4 +4888,0.1573457419872284,0.2218255251646042,0.22430892288684845,0.16969697177410126,817.3616943359375,1e-05,0.11507423967123032,2.833146572113037,81.14050197601318,4 +4889,0.3243354856967926,0.22394879162311554,0.2130248248577118,0.24032634496688843,749.2398071289062,1e-05,0.3435674011707306,3.1569855213165283,81.14050197601318,4 +4890,0.2374412566423416,0.16850575804710388,0.17596131563186646,0.15034964680671692,950.4097290039062,1e-05,0.12942424416542053,3.0843827724456787,81.14050197601318,4 +4891,0.15874575078487396,0.3692903518676758,0.3792826235294342,0.1902097910642624,979.3876342773438,1e-05,0.13378238677978516,3.0674996376037598,81.14050197601318,4 +4892,0.29829248785972595,0.19317486882209778,0.18927571177482605,0.18298368155956268,591.9431762695312,1e-05,0.11984269320964813,2.8308191299438477,81.14050197601318,4 +4893,0.34340423345565796,0.17717263102531433,0.17809049785137177,0.20489510893821716,938.5079956054688,1e-05,0.3018999993801117,3.396510362625122,81.14050197601318,4 +4894,0.212144136428833,0.2667778730392456,0.25669723749160767,0.2610722482204437,990.0938720703125,1e-05,0.11392103135585785,3.0468132495880127,81.14050197601318,4 +4895,0.2105952501296997,0.2701120972633362,0.2666115164756775,0.19370628893375397,478.7982177734375,1e-05,0.18295598030090332,3.0847971439361572,81.14050197601318,4 +4896,0.19913116097450256,0.3678145110607147,0.388018935918808,0.220279723405838,238.46560668945312,1e-05,0.10723339021205902,3.084794521331787,81.14050197601318,4 +4897,0.3060205578804016,0.18152515590190887,0.16310659050941467,0.25407925248146057,740.3775634765625,1e-05,0.14212685823440552,3.10011625289917,81.14050197601318,4 +4898,0.18076889216899872,0.2511405646800995,0.23903006315231323,0.22214451432228088,975.7278442382812,1e-05,0.19675284624099731,2.8328685760498047,81.14050197601318,4 +4899,0.20904669165611267,0.24130158126354218,0.22928619384765625,0.250582754611969,864.5192260742188,1e-05,0.15304116904735565,3.415095090866089,81.14050197601318,4 +4900,0.33180856704711914,0.5287798047065735,0.5442734360694885,0.1822843849658966,165.13217163085938,1e-05,0.16844099760055542,3.092109441757202,81.14050197601318,4 +4901,0.1660313755273819,0.1979934573173523,0.1859189122915268,0.2578088641166687,705.2662353515625,1e-05,0.10634100437164307,3.4253361225128174,81.14050197601318,4 +4902,0.22649723291397095,0.22470472753047943,0.21457892656326294,0.10815850645303726,667.560546875,1e-05,0.13210240006446838,2.8229103088378906,81.14050197601318,4 +4903,0.2840692102909088,0.24544277787208557,0.23286648094654083,0.21445220708847046,786.6087036132812,1e-05,0.19359798729419708,3.108081817626953,81.14050197601318,4 +4904,0.1801121085882187,0.25034916400909424,0.24275727570056915,0.19137528538703918,903.6668701171875,1e-05,0.11701791733503342,2.819301128387451,81.14050197601318,4 +4905,0.31450656056404114,0.18012626469135284,0.1864597350358963,0.18694639205932617,880.5089721679688,1e-05,0.1194152981042862,3.445350408554077,81.14050197601318,4 +4906,0.32929515838623047,0.2710894048213959,0.26286581158638,0.24125874042510986,500.3907775878906,1e-05,0.2094719409942627,3.1439995765686035,81.14050197601318,4 +4907,0.2602430284023285,0.115974061191082,0.11167839914560318,0.08927738666534424,988.18359375,1e-05,0.12493669241666794,3.0962953567504883,81.14050197601318,4 +4908,0.2546810507774353,0.2635842263698578,0.2357141524553299,0.22610722482204437,988.18359375,1e-05,0.11651619523763657,2.826197624206543,81.14050197601318,4 +4909,0.4561096131801605,0.21987144649028778,0.21777336299419403,0.12354312092065811,620.8772583007812,1e-05,0.13221868872642517,3.094576358795166,81.14050197601318,4 +4910,0.20765896141529083,0.31911587715148926,0.3034098744392395,0.25314685702323914,964.940673828125,1e-05,0.08878356963396072,2.8211910724639893,81.14050197601318,4 +4911,0.17931602895259857,0.34782758355140686,0.3240125775337219,0.29324010014533997,979.0761108398438,1e-05,0.09686709195375443,3.0788073539733887,81.14050197601318,4 +4912,0.2159091979265213,0.1509539783000946,0.16384902596473694,0.19883449375629425,999.4136352539062,1e-05,0.12546218931674957,3.134206771850586,81.14050197601318,4 +4913,0.1488095074892044,0.16824312508106232,0.16761043667793274,0.16923077404499054,803.0537109375,1e-05,0.16161993145942688,3.029974937438965,81.14050197601318,4 +4914,0.1299387514591217,0.2069281041622162,0.21759341657161713,0.22564102709293365,972.231689453125,1e-05,0.13530346751213074,3.126356601715088,81.14050197601318,4 +4915,0.26718950271606445,0.23216845095157623,0.22340820729732513,0.18484848737716675,604.99365234375,1e-05,0.10233347117900848,3.0710463523864746,81.14050197601318,4 +4916,0.16781513392925262,0.11608653515577316,0.12097255140542984,0.15314684808254242,769.3107299804688,1e-05,0.18617191910743713,2.815950393676758,81.14050197601318,4 +4917,0.28283852338790894,0.26894164085388184,0.2761525809764862,0.26037296652793884,301.4790344238281,1e-05,0.12385137379169464,3.1032862663269043,81.14050197601318,4 +4918,0.3183075487613678,0.27526041865348816,0.2678370475769043,0.1638694703578949,449.6458740234375,1e-05,0.17052051424980164,3.111182689666748,81.14050197601318,4 +4919,0.2427191138267517,0.2150648981332779,0.21501433849334717,0.16363635659217834,920.3087768554688,1e-05,0.17416608333587646,3.026980400085449,81.14050197601318,4 +4920,0.17410355806350708,0.3089987635612488,0.30073079466819763,0.2543123662471771,983.0303955078125,1e-05,0.10814632475376129,3.0973193645477295,81.14050197601318,4 +4921,0.2859618365764618,0.25036704540252686,0.24373790621757507,0.2545454502105713,987.4890747070312,1e-05,0.14748238027095795,2.82432222366333,81.14050197601318,4 +4922,0.1878422051668167,0.1459147185087204,0.1622963845729828,0.19510489702224731,981.6846923828125,1e-05,0.19006703794002533,3.080167770385742,81.14050197601318,4 +4923,0.22298631072044373,0.21951718628406525,0.21319951117038727,0.133100226521492,559.55126953125,1e-05,0.10853462666273117,3.0815324783325195,81.14050197601318,4 +4924,0.16700711846351624,0.2130059450864792,0.20284545421600342,0.21118880808353424,975.5648193359375,1e-05,0.12495437264442444,3.3809499740600586,81.14050197601318,4 +4925,0.3199451267719269,0.2425275295972824,0.23111246526241302,0.17529137432575226,956.552734375,1e-05,0.16425909101963043,3.0777323246002197,81.14050197601318,4 +4926,0.21083873510360718,0.13330078125,0.1389671266078949,0.14125874638557434,913.5706787109375,1e-05,0.3098192512989044,3.132357120513916,81.14050197601318,4 +4927,0.19021311402320862,0.16466403007507324,0.1607058048248291,0.16969697177410126,968.9326171875,1e-05,0.10765601694583893,2.829333782196045,81.14050197601318,4 +4928,0.19852203130722046,0.3177761733531952,0.31663307547569275,0.0923076942563057,980.3147583007812,1e-05,0.15213705599308014,3.0606508255004883,81.14050197601318,4 +4929,0.21472473442554474,0.27643874287605286,0.2831517159938812,0.2125874161720276,965.3115234375,1e-05,0.11478828638792038,3.084909200668335,81.14050197601318,4 +4930,0.20269569754600525,0.150007963180542,0.14648552238941193,0.17878787219524384,818.01220703125,1e-05,0.12387079745531082,3.174391031265259,81.14050197601318,4 +4931,0.144760400056839,0.23499934375286102,0.23090657591819763,0.25617715716362,976.5382080078125,1e-05,0.08691520243883133,3.0461227893829346,81.14050197601318,4 +4932,0.13223543763160706,0.41097065806388855,0.3825010359287262,0.24405594170093536,961.7210693359375,1e-05,0.30164623260498047,3.2774240970611572,81.14050197601318,4 +4933,0.2834808826446533,0.28262192010879517,0.2608506381511688,0.2181818187236786,928.8597412109375,1e-05,0.09456713497638702,2.8192107677459717,81.14050197601318,4 +4934,0.21684923768043518,0.3047519326210022,0.28753697872161865,0.25524476170539856,949.5288696289062,1e-05,0.24566613137722015,3.112173557281494,81.14050197601318,4 +4935,0.22954417765140533,0.5927503705024719,0.6069760918617249,0.19510489702224731,177.18624877929688,1e-05,0.13123276829719543,3.3484761714935303,81.14050197601318,4 +4936,0.1802641749382019,0.21925236284732819,0.20537948608398438,0.20279720425605774,831.0814819335938,1e-05,0.10476536303758621,3.0578718185424805,81.14050197601318,4 +4937,0.18330195546150208,0.11002165079116821,0.10158319771289825,0.2181818187236786,796.51806640625,1e-05,0.1065182238817215,3.0139222145080566,81.14050197601318,4 +4938,0.17893660068511963,0.22860895097255707,0.22394564747810364,0.19440560042858124,995.2861328125,1e-05,0.15773425996303558,3.329637050628662,81.14050197601318,4 +4939,0.1983117163181305,0.22449198365211487,0.22470298409461975,0.22284382581710815,624.2781982421875,1e-05,0.10613226890563965,2.8298656940460205,81.14050197601318,4 +4940,0.14779327809810638,0.270330548286438,0.26308661699295044,0.1543123573064804,964.1939697265625,1e-05,0.13021595776081085,3.134760856628418,81.14050197601318,4 +4941,0.2583591341972351,0.2832403779029846,0.2685767710208893,0.2242424190044403,910.3654174804688,1e-05,0.17275366187095642,3.3545174598693848,81.14050197601318,4 +4942,0.16535918414592743,0.21657338738441467,0.2175721824169159,0.21958041191101074,960.5552368164062,1e-05,0.14326965808868408,3.1463325023651123,81.14050197601318,4 +4943,0.3245447278022766,0.23165197670459747,0.24000190198421478,0.17575757205486298,826.2322387695312,1e-05,0.13787241280078888,3.266341209411621,81.14050197601318,4 +4944,0.21381445229053497,0.24519576132297516,0.2474411129951477,0.19440560042858124,945.226806640625,1e-05,0.16675417125225067,3.0686075687408447,81.14050197601318,4 +4945,0.17111575603485107,0.21700631082057953,0.20704385638237,0.17412588000297546,800.1805419921875,1e-05,0.13446377217769623,3.0925323963165283,81.14050197601318,4 +4946,0.1451936960220337,0.21168527007102966,0.19846855103969574,0.18298368155956268,829.2810668945312,1e-05,0.1339648962020874,3.276944398880005,81.14050197601318,4 +4947,0.21480470895767212,0.29792022705078125,0.2862982153892517,0.19510489702224731,478.7982177734375,1e-05,0.09770538657903671,3.441864252090454,81.14050197601318,4 +4948,0.2958691716194153,0.17714416980743408,0.18902432918548584,0.10023310035467148,992.0859375,1e-05,0.09715127944946289,2.940115451812744,81.14050197601318,4 +4949,0.27446556091308594,0.15810135006904602,0.1579415202140808,0.2181818187236786,870.0686645507812,1e-05,0.11509571969509125,3.3844797611236572,81.14050197601318,4 +4950,0.31454363465309143,0.1834401935338974,0.17304129898548126,0.2114219069480896,809.341064453125,1e-05,0.11838970333337784,3.2571024894714355,81.14050197601318,4 +4951,0.08820241689682007,0.25885114073753357,0.2738878130912781,0.1902097910642624,993.7682495117188,1e-05,0.12717537581920624,3.7553467750549316,81.14050197601318,4 +4952,0.13097313046455383,0.19880391657352448,0.20095646381378174,0.20000000298023224,853.715087890625,1e-05,0.1549510359764099,4.339427709579468,81.14050197601318,4 +4953,0.28449422121047974,0.32669538259506226,0.3118634819984436,0.25617715716362,998.1053466796875,1e-05,0.11026374250650406,4.507970571517944,81.14050197601318,4 +4954,0.23280075192451477,0.19274473190307617,0.19633080065250397,0.20000000298023224,932.0916137695312,1e-05,0.1224002093076706,4.437957048416138,81.14050197601318,4 +4955,0.27215543389320374,0.32156020402908325,0.31845569610595703,0.16293705999851227,996.5260620117188,1e-05,0.1570582389831543,6.201950311660767,81.14050197601318,4 +4956,0.11226099729537964,0.22281302511692047,0.2213164120912552,0.26317015290260315,532.5975952148438,1e-05,0.15717345476150513,6.360240936279297,81.14050197601318,4 +4957,0.24211567640304565,0.19086594879627228,0.18695761263370514,0.23146852850914001,831.677001953125,1e-05,0.1011069044470787,6.211105823516846,81.14050197601318,4 +4958,0.3253742456436157,0.2403310239315033,0.24337157607078552,0.25361305475234985,948.4158325195312,1e-05,0.17232830822467804,6.305967330932617,81.14050197601318,4 +4959,0.25483277440071106,0.29428723454475403,0.287760853767395,0.2885780930519104,440.3874816894531,1e-05,0.14015844464302063,6.410951137542725,81.14050197601318,4 +4960,0.2431609183549881,0.34007662534713745,0.32020851969718933,0.1258741319179535,946.6068115234375,1e-05,0.16919422149658203,6.511963129043579,81.14050197601318,4 +4961,0.15996427834033966,0.16115085780620575,0.15361149609088898,0.2242424190044403,835.7803955078125,1e-05,0.10968220233917236,6.390042543411255,81.14050197601318,4 +4962,0.2080441117286682,0.17572878301143646,0.17413313686847687,0.19324009120464325,801.6233520507812,1e-05,0.12139404565095901,6.285904407501221,81.14050197601318,4 +4963,0.1669452041387558,0.12730304896831512,0.1290169209241867,0.10722610354423523,937.759521484375,1e-05,0.13726381957530975,6.217700958251953,81.14050197601318,4 +4964,0.29598382115364075,0.2590199410915375,0.2454516440629959,0.25081583857536316,764.04736328125,1e-05,0.12731218338012695,6.3667685985565186,81.14050197601318,4 +4965,0.20291709899902344,0.096172034740448,0.10712315142154694,0.23403263092041016,866.8596801757812,1e-05,0.226730614900589,6.46469521522522,81.14050197601318,4 +4966,0.25335752964019775,0.20200467109680176,0.19906820356845856,0.20606060326099396,643.773681640625,1e-05,0.10335473716259003,6.282629728317261,81.14050197601318,4 +4967,0.26824435591697693,0.26460298895835876,0.2541748285293579,0.19930069148540497,885.4254760742188,1e-05,0.12717612087726593,6.3299665451049805,81.14050197601318,4 +4968,0.2566158175468445,0.23814809322357178,0.22287189960479736,0.16573426127433777,831.677001953125,1e-05,0.1342283934354782,6.312727928161621,81.14050197601318,4 +4969,0.1633874922990799,0.2087293118238449,0.22583743929862976,0.12284382432699203,983.9144897460938,1e-05,0.12601792812347412,6.364894866943359,81.14050197601318,4 +4970,0.29322969913482666,0.22895164787769318,0.21708717942237854,0.1515151560306549,898.37353515625,1e-05,0.12811878323554993,6.4805402755737305,81.14050197601318,4 +4971,0.3041521906852722,0.1927596479654312,0.1893194317817688,0.14009323716163635,546.3833618164062,1e-05,0.3820359408855438,6.512629747390747,81.14050197601318,4 +4972,0.2912161946296692,0.137544646859169,0.1373853087425232,0.249417245388031,794.2818603515625,1e-05,0.16200155019760132,6.208297967910767,81.14050197601318,4 +4973,0.22307562828063965,0.43389731645584106,0.4193840026855469,0.1958041936159134,443.50128173828125,1e-05,0.13520711660385132,6.306643009185791,81.14050197601318,4 +4974,0.20915493369102478,0.2223147302865982,0.21311534941196442,0.16969697177410126,842.5615844726562,1e-05,0.11107604950666428,6.214990854263306,81.14050197601318,4 +4975,0.19165131449699402,0.2946820855140686,0.29647448658943176,0.09324008971452713,375.388671875,1e-05,0.11210374534130096,6.259126663208008,81.14050197601318,4 +4976,0.22798427939414978,0.26359349489212036,0.2603660225868225,0.22634032368659973,553.0419311523438,1e-05,0.22359147667884827,6.6321117877960205,81.14050197601318,4 +4977,0.28987473249435425,0.17219464480876923,0.17231205105781555,0.13659673929214478,959.966552734375,1e-05,0.14002922177314758,6.516360282897949,81.14050197601318,4 +4978,0.30363574624061584,0.33021411299705505,0.32539650797843933,0.21118880808353424,586.15087890625,1e-05,0.11689608544111252,6.467282056808472,81.14050197601318,4 +4979,0.2714396119117737,0.10614199936389923,0.11992880702018738,0.2074592113494873,836.9324951171875,1e-05,0.11192863434553146,6.37886643409729,81.14050197601318,4 +4980,0.2096092700958252,0.16112880408763885,0.16459856927394867,0.11864801496267319,939.9876098632812,1e-05,0.14889468252658844,6.183612585067749,81.14050197601318,4 +4981,0.1822531670331955,0.17076502740383148,0.16760294139385223,0.19813519716262817,889.7675170898438,1e-05,0.151936873793602,6.1809961795806885,81.14050197601318,4 +4982,0.26665419340133667,0.12585075199604034,0.11616241186857224,0.2013985961675644,851.6567993164062,1e-05,0.14029137790203094,6.359314918518066,81.14050197601318,4 +4983,0.2820401191711426,0.21291789412498474,0.19161780178546906,0.23846153914928436,800.1805419921875,1e-05,0.12275604158639908,6.462076663970947,81.14050197601318,4 +4984,0.1465449333190918,0.29305022954940796,0.2669501006603241,0.18601398169994354,913.8861694335938,1e-05,0.10808516293764114,6.37433385848999,81.14050197601318,4 +4985,0.2320539802312851,0.24509094655513763,0.23641479015350342,0.20349650084972382,974.7445068359375,1e-05,0.16766886413097382,6.1501243114471436,81.14050197601318,4 +4986,0.19890367984771729,0.23200181126594543,0.22818520665168762,0.1678321659564972,785.822265625,1e-05,1.937774658203125,6.35050630569458,81.14050197601318,4 +4987,0.19349811971187592,0.1986350119113922,0.1973719745874405,0.19836829602718353,953.8506469726562,1e-05,0.11506228893995285,6.2595319747924805,81.14050197601318,4 +4988,0.13776874542236328,0.3290950655937195,0.3160819113254547,0.10139860212802887,992.2167358398438,1e-05,0.08295787125825882,6.329762697219849,81.14050197601318,4 +4989,0.1094864159822464,0.2407323569059372,0.2291119247674942,0.2226107269525528,918.5123291015625,1e-05,0.1543315351009369,6.255290746688843,81.14050197601318,4 +4990,0.2641708254814148,0.16649357974529266,0.16631139814853668,0.20815850794315338,608.6077880859375,1e-05,0.14549270272254944,6.2984089851379395,81.14050197601318,4 +4991,0.17091593146324158,0.23407761752605438,0.21982182562351227,0.17575757205486298,939.9876098632812,1e-05,0.336577832698822,6.276508092880249,81.14050197601318,4 +4992,0.22782181203365326,0.2575594186782837,0.24735771119594574,0.24708624184131622,987.069091796875,1e-05,0.11314024031162262,6.272703409194946,81.14050197601318,4 +4993,0.15750545263290405,0.28598132729530334,0.26190584897994995,0.2689976692199707,890.5407104492188,1e-05,0.102652408182621,6.322172164916992,81.14050197601318,4 +4994,0.1995154321193695,0.26894068717956543,0.2598593533039093,0.2046620100736618,978.2918701171875,1e-05,0.12397050857543945,6.430715560913086,81.14050197601318,4 +4995,0.2631986737251282,0.1673450917005539,0.15699787437915802,0.13846154510974884,909.3855590820312,1e-05,0.12418302893638611,6.536849737167358,81.14050197601318,4 +4996,0.16105546057224274,0.1882491260766983,0.19270019233226776,0.21561771631240845,992.7376708984375,1e-05,0.1335771232843399,6.137789726257324,81.14050197601318,4 +4997,0.16290922462940216,0.18431906402111053,0.17823848128318787,0.12424242496490479,960.3594970703125,1e-05,0.09263381361961365,6.271107196807861,81.14050197601318,4 +4998,0.2114611566066742,0.306932270526886,0.27692776918411255,0.2097902148962021,984.643310546875,1e-05,0.16314250230789185,6.252970933914185,81.14050197601318,4 +4999,0.1556309461593628,0.16812872886657715,0.16423608362674713,0.20955711603164673,919.7131958007812,1e-05,0.13056688010692596,6.098421335220337,81.14050197601318,4 +5000,0.13453444838523865,0.08864524960517883,0.08821451663970947,0.14685314893722534,781.0278930664062,1e-05,0.11812140047550201,6.210877895355225,81.14050197601318,4 diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v2/val_log.csv b/backup_2026-09-14/runs/ltx__arope_5k_v2/val_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..5db3a9ef2d93e5652cb8ec6498dc6bd05b4d7318 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v2/val_log.csv @@ -0,0 +1,31 @@ +step,timestep,loss_w,mse,n +500,200.4163818359375,0.45721864700317383,0.46937171928584576,16 +500,500.3907775878906,0.24550780933350325,0.25054925214499235,16 +500,800.1805419921875,0.1940081212669611,0.19498995412141085,16 +1000,200.4163818359375,0.4376392662525177,0.44904583506286144,16 +1000,500.3907775878906,0.2348350239917636,0.23920097574591637,16 +1000,800.1805419921875,0.18493654765188694,0.1851724749431014,16 +1500,200.4163818359375,0.4301617592573166,0.4413375277072191,16 +1500,500.3907775878906,0.23048890940845013,0.2346090693026781,16 +1500,800.1805419921875,0.18126681447029114,0.18121305108070374,16 +2000,200.4163818359375,0.4239173550158739,0.4348895810544491,16 +2000,500.3907775878906,0.22598917875438929,0.2298521725460887,16 +2000,800.1805419921875,0.17694960022345185,0.1765723368152976,16 +2500,200.4163818359375,0.4208409395068884,0.43168308213353157,16 +2500,500.3907775878906,0.22411341965198517,0.22782743629068136,16 +2500,800.1805419921875,0.17533459747210145,0.17481905780732632,16 +3000,200.4163818359375,0.4166419059038162,0.4273359440267086,16 +3000,500.3907775878906,0.22145191207528114,0.22506106551736593,16 +3000,800.1805419921875,0.17374980403110385,0.1731270868331194,16 +3500,200.4163818359375,0.414933729916811,0.42551691085100174,16 +3500,500.3907775878906,0.22026302386075258,0.22381570748984814,16 +3500,800.1805419921875,0.17216307576745749,0.17143462039530277,16 +4000,200.4163818359375,0.4125910922884941,0.42309046909213066,16 +4000,500.3907775878906,0.21867827139794827,0.22211593855172396,16 +4000,800.1805419921875,0.1705567892640829,0.16979414271190763,16 +4500,200.4163818359375,0.4099069871008396,0.4203749131411314,16 +4500,500.3907775878906,0.2168623311445117,0.22024996299296618,16 +4500,800.1805419921875,0.169289271812886,0.16842198418453336,16 +5000,200.4163818359375,0.40903933346271515,0.41941033117473125,16 +5000,500.3907775878906,0.21581857092678547,0.21913263853639364,16 +5000,800.1805419921875,0.16760628949850798,0.16670406563207507,16 diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v3/accelerate_ga2.yaml b/backup_2026-09-14/runs/ltx__arope_5k_v3/accelerate_ga2.yaml new file mode 100644 index 0000000000000000000000000000000000000000..965e26f1d2ec822dcf168db52ce4ee1732d4b79c --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v3/accelerate_ga2.yaml @@ -0,0 +1,22 @@ +compute_environment: LOCAL_MACHINE +debug: false +deepspeed_config: + gradient_accumulation_steps: 2 + offload_optimizer_device: 'none' + offload_param_device: 'none' + zero3_init_flag: false + zero_stage: 2 +distributed_type: DEEPSPEED +downcast_bf16: 'no' +enable_cpu_affinity: false +machine_rank: 0 +main_training_function: main +mixed_precision: bf16 +num_machines: 1 +num_processes: 8 +rdzv_backend: static +same_network: true +tpu_env: [] +tpu_use_cluster: false +tpu_use_sudo: false +use_cpu: false diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v3/config.json b/backup_2026-09-14/runs/ltx__arope_5k_v3/config.json new file mode 100644 index 0000000000000000000000000000000000000000..3d32fdc1fb4a9e62df7574f0eee66755c3efa366 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v3/config.json @@ -0,0 +1,211 @@ +{ + "args": { + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/train", + "val_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/val", + "text_table": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/text_table_ltx.pt", + "sidecar": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "meta_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/meta", + "model_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5", + "repack_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5-Repackage", + "limit": null, + "min_rt_ratio": 0.8, + "val_min_rt_ratio": 0.9, + "mask_channel": true, + "new_weight": 2.0, + "scene_dropout": 0.1, + "lr": 1e-05, + "weight_decay": 0.01, + "warmup_steps": 200, + "grad_clip": 1.0, + "max_steps": 5000, + "batch_size": 1, + "grad_accum": 2, + "num_workers": 2, + "gradient_checkpointing": true, + "save_every": 500, + "val_every": 500, + "val_n": 16, + "val_timesteps": [ + 200.0, + 500.0, + 800.0 + ], + "log_every": 1, + "output": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v3", + "resume": null, + "seed": 0, + "self_test": false, + "dry_run": false + }, + "sidecar_meta": { + "version": "arope_sidecar_v1", + "gain_correction": [ + -1.1223353683364354, + -1.12 + ], + "walk_speed_px_s": [ + 69.24106392992304, + 46.012630371093756 + ], + "M_px832": [ + [ + -26.562482341426065, + -0.10811496854140469 + ], + [ + -2.730642040963448, + 11.486215518608526 + ], + [ + 0.4151829271053684, + 16.944469913263354 + ] + ], + "n_clips": 22782, + "n_valid": 22781, + "max_sample_dt": 0.5 + }, + "per_frame_context": true, + "latent_cells": [ + 0, + 2, + 4, + 6, + 8, + 10, + 12, + 14, + 16, + 18, + 20 + ], + "dataset": { + "train_total": 20983, + "train_missing": 0, + "train_invalid": 1, + "train_leak_excluded": 257, + "train_low_rt_excluded": 2197, + "train_used": 18528, + "text_table_keys": 1473, + "val_used": 16, + "val_clip_ids": [ + "clip_Eybx_100000255_000042", + "clip_Eybx_100000496_000000", + "clip_Eybx_100000680_000063", + "clip_Eybx_100000737_000063", + "clip_Eybx_100000737_000168", + "clip_Eybx_100000751_000231", + "clip_Eybx_100000751_000546", + "clip_Eybx_100000752_000000", + "clip_Eybx_100000838_000168", + "clip_Eybx_100001216_000000", + "clip_Eybx_100001217_000105", + "clip_Eybx_100002599_000000", + "clip_Eybx_100002875_000147", + "clip_Eybx_200000624_000000", + "clip_Eybx_200001033_000126", + "clip_Eybx_200001197_000063" + ] + }, + "model": { + "dit_safetensors": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors", + "n_params": 18987867392, + "n_state_dict_keys": 4093, + "mask_channel": true, + "resume_info": null + }, + "env": { + "world_size": 8, + "distributed_type": "DistributedType.DEEPSPEED", + "mixed_precision": "bf16", + "torch": "2.11.0+cu128", + "cuda": "12.8", + "gpu": "NVIDIA H200", + "python": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/python3.12", + "platform": "Linux-6.12.94-123.192.amzn2023.x86_64-x86_64-with-glibc2.34", + "hostname": "ip-172-16-244-218.ap-southeast-3.compute.internal", + "argv": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/ltx/train_ltx_arope.py", + "--train_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/train", + "--val_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/val", + "--text_table", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/text_table_ltx.pt", + "--sidecar", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "--meta_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/meta", + "--model_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5", + "--repack_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5-Repackage", + "--new_weight", + "2.0", + "--scene_dropout", + "0.1", + "--lr", + "1e-5", + "--weight_decay", + "0.01", + "--warmup_steps", + "200", + "--grad_clip", + "1.0", + "--max_steps", + "5000", + "--batch_size", + "1", + "--grad_accum", + "2", + "--num_workers", + "2", + "--save_every", + "500", + "--val_every", + "500", + "--val_n", + "16", + "--val_timesteps", + "200,500,800", + "--min_rt_ratio", + "0.8", + "--val_min_rt_ratio", + "0.9", + "--seed", + "0", + "--output", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/ltx/arope_5k_v3" + ], + "started": "2026-09-14 15:28:32", + "cuda_visible_devices": null, + "accelerate": "1.14.0", + "deepspeed": "0.19.6" + }, + "deepspeed_config": { + "train_batch_size": 16, + "train_micro_batch_size_per_gpu": 1, + "gradient_accumulation_steps": 2, + "zero_optimization": { + "stage": 2, + "offload_optimizer": { + "device": "none", + "nvme_path": null + }, + "offload_param": { + "device": "none", + "nvme_path": null + }, + "stage3_gather_16bit_weights_on_model_save": false + }, + "gradient_clipping": 1.0, + "steps_per_print": Infinity, + "bf16": { + "enabled": true + }, + "fp16": { + "enabled": false + }, + "zero_allow_untested_optimizer": true + } +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v3/launch.log b/backup_2026-09-14/runs/ltx__arope_5k_v3/launch.log new file mode 100644 index 0000000000000000000000000000000000000000..4cf4d9bc1dd21afa47674c9c518aaebab242f62b --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v3/launch.log @@ -0,0 +1,249 @@ +W0914 15:27:12.900000 3466367 torch/distributed/run.py:851] +W0914 15:27:12.900000 3466367 torch/distributed/run.py:851] ***************************************** +W0914 15:27:12.900000 3466367 torch/distributed/run.py:851] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. +W0914 15:27:12.900000 3466367 torch/distributed/run.py:851] ***************************************** +[env] world=8 distributed=DistributedType.DEEPSPEED mixed_precision=bf16 device=cuda:0 +[text] 逐 latent 帧文本:11 帧取 cell [0, 2, 4, 6, 8, 10, 12, 14, 16, 18, 20](转场 clip 切换点之后取另一场景的串) +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +[LtxAropeDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/train: 20983 个 .pt,sidecar 缺失 0,valid=False 剔除 1,转场泄漏剔除 257,rt_ratio<0.8 剔除 2197,可用 18528;文本表 1473 键,scene_dropout=0.1 +[LtxAropeDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_ltx/val: 1175 个 .pt,sidecar 缺失 0,valid=False 剔除 0,rt_ratio<0.9 剔除 193,可用 16(limit=16);文本表 1473 键,scene_dropout=0.0 +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +┌──────────────────────────────────────────────────────────────────────┐ +│ DiffSynth-Studio Model Downloader Configuration: │ +│ │ +│ [ ] Download from https://modelscope.cn/ │ +│ (default behavior) │ +│ [ ] Download from https://modelscope.ai/ │ +│ (enabled via `export MODELSCOPE_ENDPOINT=https://modelscope.ai`) │ +│ [ ] Download from https://huggingface.co/ │ +│ (enabled via `export DIFFSYNTH_DOWNLOAD_SOURCE=HuggingFace`) │ +│ [√] Skip download and load only pre-downloaded model files │ +│ (enabled via `export DIFFSYNTH_SKIP_DOWNLOAD=True`) │ +└──────────────────────────────────────────────────────────────────────┘ +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loading models from: "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors" +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +Loaded model: { + "model_name": "ltx2_dit", + "model_class": "diffsynth.models.ltx2_dit.LTXModel", + "extra_kwargs": { + "caption_channels": null, + "apply_gated_attention": true, + "cross_attention_adaln": true, + "ff_bias": false, + "use_keyframes_abs_pos_embedding": true, + "use_tokenwise_av_ca_scale_shift": true + } +} +No ltx2_text_encoder models available. This is not an error. +Using ltx2_dit from "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/LTX-2.5/diffusion_models/ltx-2.5-22b-dev-transformer-bf16.safetensors". +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +No ltx2_text_encoder_post_modules models available. This is not an error. +No ltx2_video_vae_encoder models available. This is not an error. +No ltx2_video_vae_decoder models available. This is not an error. +No ltx25_diffusion_video_vae_decoder models available. This is not an error. +No ltx2_audio_vae_decoder models available. This is not an error. +No ltx2_audio_vocoder models available. This is not an error. +No ltx2_latent_upsampler models available. This is not an error. +No ltx2_audio_vae_encoder models available. This is not an error. +No ltx25_duration_head models available. This is not an error. +[arope] 装 arope_mask_embed:Linear(1, 4096),零初始化 +[arope] patchify_proj 挂了 forward hook(+ arope_mask_embed(mask)) +[arope] BasicAVTransformerBlock._apply_text_cross_attention 打了逐帧文本补丁(开关默认关) +[model] DiT 加载 27s,18,987,867,392 参数,4093 个 state_dict 键,mask_channel=True,has arope_mask_embed=True +[env] grad_clip=1.0 +[train] 18528 个 clip,每进程 batch 1,8 进程,到 5000 步 +step 1/5000 loss 0.4861 (w 0.6059 mse 0.5935 t 965 new 0.18) lr 5.00e-08 gnorm 5.881 8.51s mem 79.7GB +step 2/5000 loss 0.5877 (w 0.3527 mse 0.3757 t 737 new 0.24) lr 1.00e-07 gnorm 2.461 4.09s mem 81.2GB +step 3/5000 loss 0.4102 (w 0.4744 mse 0.4671 t 934 new 0.21) lr 1.50e-07 gnorm 1.576 3.32s mem 81.2GB +step 4/5000 loss 0.4002 (w 0.4086 mse 0.4064 t 895 new 0.24) lr 2.00e-07 gnorm 2.346 3.34s mem 81.2GB +step 5/5000 loss 0.4389 (w 0.4067 mse 0.4079 t 803 new 0.24) lr 2.50e-07 gnorm 2.455 3.33s mem 81.2GB +step 6/5000 loss 0.5074 (w 0.3519 mse 0.3581 t 588 new 0.22) lr 3.00e-07 gnorm 1.787 3.33s mem 81.2GB +step 7/5000 loss 0.4050 (w 0.4941 mse 0.4940 t 929 new 0.23) lr 3.50e-07 gnorm 1.876 3.65s mem 81.2GB +step 8/5000 loss 0.3768 (w 0.5036 mse 0.5012 t 935 new 0.22) lr 4.00e-07 gnorm 1.850 3.70s mem 81.2GB +step 9/5000 loss 0.5873 (w 0.4627 mse 0.4471 t 584 new 0.24) lr 4.50e-07 gnorm 4.530 3.35s mem 81.2GB +step 10/5000 loss 0.6913 (w 0.8336 mse 0.8206 t 996 new 0.24) lr 5.00e-07 gnorm 8.640 3.34s mem 81.2GB +step 11/5000 loss 0.3256 (w 0.6434 mse 0.6292 t 984 new 0.18) lr 5.50e-07 gnorm 2.387 3.35s mem 81.2GB +step 12/5000 loss 0.3851 (w 0.4508 mse 0.4536 t 962 new 0.17) lr 6.00e-07 gnorm 5.958 3.35s mem 81.2GB +step 13/5000 loss 0.5699 (w 0.3875 mse 0.3710 t 633 new 0.19) lr 6.50e-07 gnorm 3.590 3.60s mem 81.2GB +step 14/5000 loss 0.8128 (w 0.7644 mse 0.7765 t 274 new 0.16) lr 7.00e-07 gnorm 2.708 3.60s mem 81.2GB +step 15/5000 loss 0.4606 (w 0.4274 mse 0.4140 t 904 new 0.14) lr 7.50e-07 gnorm 2.186 3.34s mem 81.2GB +step 16/5000 loss 0.6758 (w 0.8538 mse 0.8537 t 999 new 0.23) lr 8.00e-07 gnorm 2.590 3.34s mem 81.2GB +step 17/5000 loss 0.4314 (w 0.4838 mse 0.4761 t 939 new 0.18) lr 8.50e-07 gnorm 1.926 3.32s mem 81.2GB +step 18/5000 loss 0.3207 (w 0.5768 mse 0.5940 t 989 new 0.15) lr 9.00e-07 gnorm 0.837 3.33s mem 81.2GB +step 19/5000 loss 0.4247 (w 0.7223 mse 0.7428 t 100 new 0.20) lr 9.50e-07 gnorm 4.920 3.96s mem 81.2GB +step 20/5000 loss 0.2768 (w 0.4014 mse 0.3861 t 955 new 0.25) lr 1.00e-06 gnorm 1.198 3.35s mem 81.2GB +step 21/5000 loss 0.5968 (w 0.8231 mse 0.8138 t 995 new 0.20) lr 1.05e-06 gnorm 2.142 3.35s mem 81.2GB +step 22/5000 loss 0.3419 (w 0.4395 mse 0.4249 t 901 new 0.24) lr 1.10e-06 gnorm 1.674 3.35s mem 81.2GB +step 23/5000 loss 0.4760 (w 0.4174 mse 0.4246 t 740 new 0.17) lr 1.15e-06 gnorm 1.145 3.34s mem 81.2GB +step 24/5000 loss 0.3962 (w 0.4690 mse 0.4968 t 930 new 0.22) lr 1.20e-06 gnorm 1.052 3.34s mem 81.2GB +step 25/5000 loss 0.2247 (w 0.2647 mse 0.2610 t 811 new 0.27) lr 1.25e-06 gnorm 1.382 4.62s mem 81.2GB +step 26/5000 loss 0.4018 (w 0.3733 mse 0.3936 t 274 new 0.19) lr 1.30e-06 gnorm 0.965 3.36s mem 81.2GB +step 27/5000 loss 0.3144 (w 0.3424 mse 0.3346 t 916 new 0.22) lr 1.35e-06 gnorm 0.796 3.36s mem 81.2GB +step 28/5000 loss 0.3127 (w 0.4852 mse 0.4766 t 957 new 0.23) lr 1.40e-06 gnorm 0.673 3.35s mem 81.2GB +step 29/5000 loss 0.2233 (w 0.2027 mse 0.2100 t 786 new 0.16) lr 1.45e-06 gnorm 0.690 3.34s mem 81.2GB +step 30/5000 loss 0.3564 (w 0.4017 mse 0.3838 t 947 new 0.21) lr 1.50e-06 gnorm 0.533 3.63s mem 81.2GB +step 31/5000 loss 0.5558 (w 0.5065 mse 0.5167 t 947 new 0.20) lr 1.55e-06 gnorm 1.554 3.92s mem 81.2GB diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v3/train.log b/backup_2026-09-14/runs/ltx__arope_5k_v3/train.log new file mode 100644 index 0000000000000000000000000000000000000000..ec730e8f49fc77970e4c31e2536d1be334c74fc1 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v3/train.log @@ -0,0 +1,39 @@ +[2026-09-14 15:27:30] [env] world=8 distributed=DistributedType.DEEPSPEED mixed_precision=bf16 device=cuda:0 +[2026-09-14 15:27:39] [text] 逐 latent 帧文本:11 帧取 cell [0, 2, 4, 6, 8, 10, 12, 14, 16, 18, 20](转场 clip 切换点之后取另一场景的串) +[2026-09-14 15:28:07] [arope] 装 arope_mask_embed:Linear(1, 4096),零初始化 +[2026-09-14 15:28:07] [arope] patchify_proj 挂了 forward hook(+ arope_mask_embed(mask)) +[2026-09-14 15:28:07] [arope] BasicAVTransformerBlock._apply_text_cross_attention 打了逐帧文本补丁(开关默认关) +[2026-09-14 15:28:07] [model] DiT 加载 27s,18,987,867,392 参数,4093 个 state_dict 键,mask_channel=True,has arope_mask_embed=True +[2026-09-14 15:28:32] [env] grad_clip=1.0 +[2026-09-14 15:28:32] [train] 18528 个 clip,每进程 batch 1,8 进程,到 5000 步 +[2026-09-14 15:28:43] step 1/5000 loss 0.4861 (w 0.6059 mse 0.5935 t 965 new 0.18) lr 5.00e-08 gnorm 5.881 8.51s mem 79.7GB +[2026-09-14 15:28:47] step 2/5000 loss 0.5877 (w 0.3527 mse 0.3757 t 737 new 0.24) lr 1.00e-07 gnorm 2.461 4.09s mem 81.2GB +[2026-09-14 15:28:50] step 3/5000 loss 0.4102 (w 0.4744 mse 0.4671 t 934 new 0.21) lr 1.50e-07 gnorm 1.576 3.32s mem 81.2GB +[2026-09-14 15:28:54] step 4/5000 loss 0.4002 (w 0.4086 mse 0.4064 t 895 new 0.24) lr 2.00e-07 gnorm 2.346 3.34s mem 81.2GB +[2026-09-14 15:28:57] step 5/5000 loss 0.4389 (w 0.4067 mse 0.4079 t 803 new 0.24) lr 2.50e-07 gnorm 2.455 3.33s mem 81.2GB +[2026-09-14 15:29:00] step 6/5000 loss 0.5074 (w 0.3519 mse 0.3581 t 588 new 0.22) lr 3.00e-07 gnorm 1.787 3.33s mem 81.2GB +[2026-09-14 15:29:05] step 7/5000 loss 0.4050 (w 0.4941 mse 0.4940 t 929 new 0.23) lr 3.50e-07 gnorm 1.876 3.65s mem 81.2GB +[2026-09-14 15:29:08] step 8/5000 loss 0.3768 (w 0.5036 mse 0.5012 t 935 new 0.22) lr 4.00e-07 gnorm 1.850 3.70s mem 81.2GB +[2026-09-14 15:29:12] step 9/5000 loss 0.5873 (w 0.4627 mse 0.4471 t 584 new 0.24) lr 4.50e-07 gnorm 4.530 3.35s mem 81.2GB +[2026-09-14 15:29:15] step 10/5000 loss 0.6913 (w 0.8336 mse 0.8206 t 996 new 0.24) lr 5.00e-07 gnorm 8.640 3.34s mem 81.2GB +[2026-09-14 15:29:18] step 11/5000 loss 0.3256 (w 0.6434 mse 0.6292 t 984 new 0.18) lr 5.50e-07 gnorm 2.387 3.35s mem 81.2GB +[2026-09-14 15:29:22] step 12/5000 loss 0.3851 (w 0.4508 mse 0.4536 t 962 new 0.17) lr 6.00e-07 gnorm 5.958 3.35s mem 81.2GB +[2026-09-14 15:29:25] step 13/5000 loss 0.5699 (w 0.3875 mse 0.3710 t 633 new 0.19) lr 6.50e-07 gnorm 3.590 3.60s mem 81.2GB +[2026-09-14 15:29:29] step 14/5000 loss 0.8128 (w 0.7644 mse 0.7765 t 274 new 0.16) lr 7.00e-07 gnorm 2.708 3.60s mem 81.2GB +[2026-09-14 15:29:32] step 15/5000 loss 0.4606 (w 0.4274 mse 0.4140 t 904 new 0.14) lr 7.50e-07 gnorm 2.186 3.34s mem 81.2GB +[2026-09-14 15:29:36] step 16/5000 loss 0.6758 (w 0.8538 mse 0.8537 t 999 new 0.23) lr 8.00e-07 gnorm 2.590 3.34s mem 81.2GB +[2026-09-14 15:29:39] step 17/5000 loss 0.4314 (w 0.4838 mse 0.4761 t 939 new 0.18) lr 8.50e-07 gnorm 1.926 3.32s mem 81.2GB +[2026-09-14 15:29:42] step 18/5000 loss 0.3207 (w 0.5768 mse 0.5940 t 989 new 0.15) lr 9.00e-07 gnorm 0.837 3.33s mem 81.2GB +[2026-09-14 15:29:46] step 19/5000 loss 0.4247 (w 0.7223 mse 0.7428 t 100 new 0.20) lr 9.50e-07 gnorm 4.920 3.96s mem 81.2GB +[2026-09-14 15:29:50] step 20/5000 loss 0.2768 (w 0.4014 mse 0.3861 t 955 new 0.25) lr 1.00e-06 gnorm 1.198 3.35s mem 81.2GB +[2026-09-14 15:29:53] step 21/5000 loss 0.5968 (w 0.8231 mse 0.8138 t 995 new 0.20) lr 1.05e-06 gnorm 2.142 3.35s mem 81.2GB +[2026-09-14 15:29:56] step 22/5000 loss 0.3419 (w 0.4395 mse 0.4249 t 901 new 0.24) lr 1.10e-06 gnorm 1.674 3.35s mem 81.2GB +[2026-09-14 15:30:00] step 23/5000 loss 0.4760 (w 0.4174 mse 0.4246 t 740 new 0.17) lr 1.15e-06 gnorm 1.145 3.34s mem 81.2GB +[2026-09-14 15:30:03] step 24/5000 loss 0.3962 (w 0.4690 mse 0.4968 t 930 new 0.22) lr 1.20e-06 gnorm 1.052 3.34s mem 81.2GB +[2026-09-14 15:30:08] step 25/5000 loss 0.2247 (w 0.2647 mse 0.2610 t 811 new 0.27) lr 1.25e-06 gnorm 1.382 4.62s mem 81.2GB +[2026-09-14 15:30:11] step 26/5000 loss 0.4018 (w 0.3733 mse 0.3936 t 274 new 0.19) lr 1.30e-06 gnorm 0.965 3.36s mem 81.2GB +[2026-09-14 15:30:15] step 27/5000 loss 0.3144 (w 0.3424 mse 0.3346 t 916 new 0.22) lr 1.35e-06 gnorm 0.796 3.36s mem 81.2GB +[2026-09-14 15:30:18] step 28/5000 loss 0.3127 (w 0.4852 mse 0.4766 t 957 new 0.23) lr 1.40e-06 gnorm 0.673 3.35s mem 81.2GB +[2026-09-14 15:30:21] step 29/5000 loss 0.2233 (w 0.2027 mse 0.2100 t 786 new 0.16) lr 1.45e-06 gnorm 0.690 3.34s mem 81.2GB +[2026-09-14 15:30:25] step 30/5000 loss 0.3564 (w 0.4017 mse 0.3838 t 947 new 0.21) lr 1.50e-06 gnorm 0.533 3.63s mem 81.2GB +[2026-09-14 15:30:29] step 31/5000 loss 0.5558 (w 0.5065 mse 0.5167 t 947 new 0.20) lr 1.55e-06 gnorm 1.554 3.92s mem 81.2GB diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v3/train_log.csv b/backup_2026-09-14/runs/ltx__arope_5k_v3/train_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..f09f4f402b90f8dea25b989ed592c9e85e4108dd --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v3/train_log.csv @@ -0,0 +1,32 @@ +step,loss,loss_w,mse,new_frac,timestep,lr,grad_norm,step_time,mem_gb,epoch +1,0.48605313897132874,0.6059269905090332,0.5935342907905579,0.1806526780128479,964.7545166015625,5.0000000000000004e-08,5.881167888641357,8.507832527160645,79.72878980636597,0 +2,0.5877400636672974,0.3527403771877289,0.37569963932037354,0.24405594170093536,737.33203125,1.0000000000000001e-07,2.4607973098754883,4.09221339225769,81.21862697601318,0 +3,0.41024714708328247,0.4743597209453583,0.46710461378097534,0.20652680099010468,933.9302368164062,1.5000000000000002e-07,1.57589852809906,3.322610855102539,81.21862697601318,0 +4,0.4002373218536377,0.4086204469203949,0.40639060735702515,0.24149183928966522,895.4498291015625,2.0000000000000002e-07,2.345839738845825,3.337639808654785,81.21862697601318,0 +5,0.43886426091194153,0.40672942996025085,0.4079252779483795,0.2426573485136032,803.0537109375,2.5000000000000004e-07,2.4553396701812744,3.326941728591919,81.21862697601318,0 +6,0.507432758808136,0.3518737256526947,0.35812273621559143,0.2209790199995041,588.0953979492188,3.0000000000000004e-07,1.787217140197754,3.3325603008270264,81.21862697601318,0 +7,0.4049888253211975,0.49408379197120667,0.4940497875213623,0.23449882864952087,928.5856323242188,3.5000000000000004e-07,1.8763407468795776,3.652163505554199,81.21862697601318,0 +8,0.37675467133522034,0.5035624504089355,0.501194179058075,0.2186480164527893,934.7079467773438,4.0000000000000003e-07,1.8502601385116577,3.6982171535491943,81.21862697601318,0 +9,0.5872740745544434,0.46266260743141174,0.44707271456718445,0.23846153914928436,584.1925659179688,4.5000000000000003e-07,4.529577255249023,3.351691722869873,81.21862697601318,0 +10,0.6912951469421387,0.8335699439048767,0.8206446170806885,0.23613053560256958,996.0327758789062,5.000000000000001e-07,8.639554023742676,3.3361501693725586,81.21862697601318,0 +11,0.32561489939689636,0.6434155106544495,0.6291945576667786,0.18275058269500732,984.4981079101562,5.5e-07,2.386720895767212,3.353342056274414,81.21862697601318,0 +12,0.38511914014816284,0.45076456665992737,0.4536336362361908,0.17179487645626068,961.9138793945312,6.000000000000001e-07,5.958014011383057,3.349949598312378,81.21862697601318,0 +13,0.5699214339256287,0.38746869564056396,0.3710295259952545,0.19230769574642181,632.5867309570312,6.5e-07,3.5903213024139404,3.604228973388672,81.21862697601318,0 +14,0.8127984404563904,0.7644270658493042,0.7764986157417297,0.16293705999851227,273.5347900390625,7.000000000000001e-07,2.708012580871582,3.5972788333892822,81.21862697601318,0 +15,0.46061015129089355,0.4274056851863861,0.4140162169933319,0.1414918452501297,903.6668701171875,7.5e-07,2.185619831085205,3.3433303833007812,81.21862697601318,0 +16,0.6757806539535522,0.853763222694397,0.8536979556083679,0.22867132723331451,998.5840454101562,8.000000000000001e-07,2.5901718139648438,3.342155694961548,81.21862697601318,0 +17,0.4314383864402771,0.48377639055252075,0.4761006236076355,0.1818181872367859,938.756103515625,8.500000000000001e-07,1.926060676574707,3.321404457092285,81.21862697601318,0 +18,0.3206782341003418,0.5767877697944641,0.5940275192260742,0.1459207385778427,989.2814331054688,9.000000000000001e-07,0.836552619934082,3.3330254554748535,81.21862697601318,0 +19,0.42466670274734497,0.7222713828086853,0.7428032159805298,0.19720280170440674,100.0000228881836,9.500000000000001e-07,4.92042350769043,3.959139347076416,81.21862697601318,0 +20,0.27678409218788147,0.4014453589916229,0.3860650360584259,0.250582754611969,955.10791015625,1.0000000000000002e-06,1.1975321769714355,3.3454337120056152,81.21862697601318,0 +21,0.596791684627533,0.8231148719787598,0.8138428330421448,0.19930069148540497,994.7838134765625,1.0500000000000001e-06,2.1418354511260986,3.3549365997314453,81.21862697601318,0 +22,0.34186118841171265,0.43946781754493713,0.42487460374832153,0.23729602992534637,900.5198364257812,1.1e-06,1.6743922233581543,3.348691701889038,81.21862697601318,0 +23,0.47600531578063965,0.4174128472805023,0.4246094524860382,0.1678321659564972,740.3775634765625,1.1500000000000002e-06,1.1447415351867676,3.3422977924346924,81.21862697601318,0 +24,0.39623743295669556,0.4690108001232147,0.49680930376052856,0.2181818187236786,929.6773681640625,1.2000000000000002e-06,1.0518487691879272,3.3445091247558594,81.21862697601318,0 +25,0.22467127442359924,0.26466143131256104,0.26099953055381775,0.26806527376174927,811.3840942382812,1.25e-06,1.382239580154419,4.619471311569214,81.21862697601318,0 +26,0.40184199810028076,0.3732575476169586,0.39362215995788574,0.18811188638210297,273.5347900390625,1.3e-06,0.9652767181396484,3.3620715141296387,81.21862697601318,0 +27,0.31440269947052,0.34236669540405273,0.3346227705478668,0.21771562099456787,916.3778686523438,1.3500000000000002e-06,0.7957807183265686,3.3554177284240723,81.21862697601318,0 +28,0.3126636743545532,0.4851629137992859,0.4766300320625305,0.23333333432674408,956.75732421875,1.4000000000000001e-06,0.6727325916290283,3.3470959663391113,81.21862697601318,0 +29,0.22326849400997162,0.2026701718568802,0.21001079678535461,0.1582750529050827,785.822265625,1.45e-06,0.6899201273918152,3.3431007862091064,81.21862697601318,0 +30,0.3563854694366455,0.40167930722236633,0.3837922215461731,0.21445220708847046,946.6068115234375,1.5e-06,0.5334408283233643,3.630997896194458,81.21862697601318,0 +31,0.5558093786239624,0.5064822435379028,0.5166628360748291,0.20279720425605774,946.8348388671875,1.5500000000000002e-06,1.5536047220230103,3.9231016635894775,81.21862697601318,0 diff --git a/backup_2026-09-14/runs/ltx__arope_5k_v3/val_log.csv b/backup_2026-09-14/runs/ltx__arope_5k_v3/val_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..d411589c3c8be6c09fff513cdafdf02c45776650 --- /dev/null +++ b/backup_2026-09-14/runs/ltx__arope_5k_v3/val_log.csv @@ -0,0 +1 @@ +step,timestep,loss_w,mse,n diff --git a/backup_2026-09-14/runs/skyreels__arope_5k/config.json b/backup_2026-09-14/runs/skyreels__arope_5k/config.json new file mode 100644 index 0000000000000000000000000000000000000000..b0755d651981a3899e53a3e3dcb2a69c2c019696 --- /dev/null +++ b/backup_2026-09-14/runs/skyreels__arope_5k/config.json @@ -0,0 +1,221 @@ +{ + "args": { + "train_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_sky/train", + "val_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_sky/val", + "text_table": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "sidecar": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "meta_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/meta", + "model_dir": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/SkyReels-V2-DF-1.3B-540P", + "limit": null, + "min_rt_ratio": 0.8, + "val_min_rt_ratio": 0.9, + "mask_channel": true, + "new_weight": 2.0, + "scene_dropout": 0.1, + "first_frame_cond": true, + "inject_sample_info": 1, + "fps_idx": 0, + "lr": 1e-05, + "weight_decay": 0.01, + "warmup_steps": 200, + "grad_clip": 1.0, + "max_steps": 5000, + "batch_size": 1, + "grad_accum": 2, + "num_workers": 2, + "gradient_checkpointing": true, + "save_every": 500, + "val_every": 500, + "val_n": 16, + "val_timesteps": [ + 200.0, + 500.0, + 800.0 + ], + "log_every": 1, + "output": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k", + "resume": null, + "seed": 0, + "self_test": false, + "dry_run": false + }, + "sidecar_meta": { + "version": "arope_sidecar_v1", + "gain_correction": [ + -1.1223353683364354, + -1.12 + ], + "walk_speed_px_s": [ + 69.24106392992304, + 46.012630371093756 + ], + "M_px832": [ + [ + -26.562482341426065, + -0.10811496854140469 + ], + [ + -2.730642040963448, + 11.486215518608526 + ], + [ + 0.4151829271053684, + 16.944469913263354 + ] + ], + "n_clips": 22782, + "n_valid": 22781, + "max_sample_dt": 0.5 + }, + "dataset": { + "train_total": 20983, + "train_missing": 0, + "train_invalid": 1, + "train_leak_excluded": 257, + "train_low_rt_excluded": 2197, + "train_used": 18528, + "text_table_keys": 361, + "val_used": 16, + "val_clip_ids": [ + "clip_Eybx_100000255_000042", + "clip_Eybx_100000496_000000", + "clip_Eybx_100000680_000063", + "clip_Eybx_100000737_000063", + "clip_Eybx_100000737_000168", + "clip_Eybx_100000751_000231", + "clip_Eybx_100000751_000546", + "clip_Eybx_100000752_000000", + "clip_Eybx_100000838_000168", + "clip_Eybx_100001216_000000", + "clip_Eybx_100001217_000105", + "clip_Eybx_100002599_000000", + "clip_Eybx_100002875_000147", + "clip_Eybx_200000624_000000", + "clip_Eybx_200001033_000126", + "clip_Eybx_200001197_000063" + ] + }, + "model": { + "dit_safetensors": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/SkyReels-V2-DF-1.3B-540P/model.safetensors", + "n_params": 1435533376, + "n_state_dict_keys": 832, + "mask_channel": true, + "inject_sample_info": true, + "fps_idx": 0, + "load_info": { + "missing": [ + "arope_mask_embedding.bias", + "arope_mask_embedding.weight" + ], + "unexpected": [], + "n_tensors": 830 + }, + "resume_info": null + }, + "geometry": { + "lat_h": 60, + "lat_w": 104, + "tok_h": 30, + "tok_w": 52, + "px_per_latent": 8, + "px_per_token": 16, + "rope_offset_scale": 2.0, + "weight_offset_scale": 2.0 + }, + "env": { + "world_size": 8, + "distributed_type": "DistributedType.DEEPSPEED", + "mixed_precision": "bf16", + "torch": "2.11.0+cu128", + "cuda": "12.8", + "gpu": "NVIDIA H200", + "python": "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/.venv/bin/python3.12", + "platform": "Linux-6.12.94-123.192.amzn2023.x86_64-x86_64-with-glibc2.34", + "hostname": "ip-172-16-244-218.ap-southeast-3.compute.internal", + "argv": [ + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/skyreels/train_sky_arope.py", + "--train_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_sky/train", + "--val_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_sky/val", + "--text_table", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/text_table_actionrope.pt", + "--sidecar", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent/arope_sidecar.pt", + "--meta_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/meta", + "--model_dir", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/SkyReels-V2-DF-1.3B-540P", + "--new_weight", + "2.0", + "--scene_dropout", + "0.1", + "--inject_sample_info", + "1", + "--fps_idx", + "0", + "--lr", + "1e-5", + "--weight_decay", + "0.01", + "--warmup_steps", + "200", + "--grad_clip", + "1.0", + "--max_steps", + "5000", + "--batch_size", + "1", + "--grad_accum", + "2", + "--num_workers", + "2", + "--save_every", + "500", + "--val_every", + "500", + "--val_n", + "16", + "--val_timesteps", + "200,500,800", + "--min_rt_ratio", + "0.8", + "--val_min_rt_ratio", + "0.9", + "--seed", + "0", + "--output", + "/opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k" + ], + "started": "2026-09-13 15:54:04", + "cuda_visible_devices": null, + "accelerate": "1.14.0", + "deepspeed": "0.19.6" + }, + "deepspeed_config": { + "train_batch_size": 16, + "train_micro_batch_size_per_gpu": 1, + "gradient_accumulation_steps": 2, + "zero_optimization": { + "stage": 2, + "offload_optimizer": { + "device": "none", + "nvme_path": null + }, + "offload_param": { + "device": "none", + "nvme_path": null + }, + "stage3_gather_16bit_weights_on_model_save": false + }, + "gradient_clipping": 1.0, + "steps_per_print": Infinity, + "bf16": { + "enabled": true + }, + "fp16": { + "enabled": false + }, + "zero_allow_untested_optimizer": true + } +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/skyreels__arope_5k/done.json b/backup_2026-09-14/runs/skyreels__arope_5k/done.json new file mode 100644 index 0000000000000000000000000000000000000000..03fb404039ba446a4bfb63db7ba21fe2e3840aca --- /dev/null +++ b/backup_2026-09-14/runs/skyreels__arope_5k/done.json @@ -0,0 +1,4 @@ +{ + "step": 5000, + "finished": "2026-09-13 23:54:04" +} \ No newline at end of file diff --git a/backup_2026-09-14/runs/skyreels__arope_5k/launch.log b/backup_2026-09-14/runs/skyreels__arope_5k/launch.log new file mode 100644 index 0000000000000000000000000000000000000000..c83be683ccd17971475ffe00428db33a1e618d09 --- /dev/null +++ b/backup_2026-09-14/runs/skyreels__arope_5k/launch.log @@ -0,0 +1,5033 @@ +W0913 15:53:31.614000 3583988 torch/distributed/run.py:851] +W0913 15:53:31.614000 3583988 torch/distributed/run.py:851] ***************************************** +W0913 15:53:31.614000 3583988 torch/distributed/run.py:851] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. +W0913 15:53:31.614000 3583988 torch/distributed/run.py:851] ***************************************** +[env] world=8 distributed=DistributedType.DEEPSPEED mixed_precision=bf16 device=cuda:0 +[SkyAropeDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_sky/train: 20983 个 .pt,sidecar 缺失 0,valid=False 剔除 1,转场泄漏剔除 257,rt_ratio<0.8 剔除 2197,可用 18528;文本表 361 键,scene_dropout=0.1 +[SkyAropeDataset] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/data/latent_sky/val: 1175 个 .pt,sidecar 缺失 0,valid=False 剔除 0,rt_ratio<0.9 剔除 193,可用 16(limit=16);文本表 361 键,scene_dropout=0.0 +[load] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/SkyReels-V2-DF-1.3B-540P/model.safetensors 没有 ['arope_mask_embedding.bias', 'arope_mask_embedding.weight']:arope_mask_embedding 保持零初始化 +[model] 预训练权重 /opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/SkyReels-V2-DF-1.3B-540P/model.safetensors: {'missing': ['arope_mask_embedding.bias', 'arope_mask_embedding.weight'], 'unexpected': [], 'n_tensors': 830} +[model] DiT 加载 9s,1,435,533,376 参数,832 个 state_dict 键,mask_channel=True,inject_sample_info=True,fps_idx=0,has arope_mask_embedding=True +[env] grad_clip=1.0 +[train] 18528 个 clip,每进程 batch 1,8 进程,到 5000 步 +step 1/5000 loss 0.1522 (w 0.1402 mse 0.1433 t 941 new 0.20) lr 5.00e-08 gnorm 0.235 10.89s mem 14.2GB +step 2/5000 loss 0.1281 (w 0.1302 mse 0.1266 t 612 new 0.18) lr 1.00e-07 gnorm 0.307 5.67s mem 15.5GB +step 3/5000 loss 0.1227 (w 0.1573 mse 0.1529 t 891 new 0.28) lr 1.50e-07 gnorm 0.172 5.69s mem 15.6GB +step 4/5000 loss 0.1435 (w 0.1095 mse 0.1043 t 832 new 0.15) lr 2.00e-07 gnorm 0.243 5.70s mem 15.6GB +step 5/5000 loss 0.1455 (w 0.0977 mse 0.0913 t 699 new 0.26) lr 2.50e-07 gnorm 0.245 5.69s mem 15.6GB +step 6/5000 loss 0.1380 (w 0.1321 mse 0.1315 t 436 new 0.18) lr 3.00e-07 gnorm 0.205 5.69s mem 15.6GB +step 7/5000 loss 0.1151 (w 0.0615 mse 0.0677 t 883 new 0.22) lr 3.50e-07 gnorm 0.233 5.69s mem 15.6GB +step 8/5000 loss 0.0761 (w 0.1099 mse 0.1059 t 892 new 0.17) lr 4.00e-07 gnorm 0.225 5.69s mem 15.6GB +step 9/5000 loss 0.1599 (w 0.1709 mse 0.1640 t 432 new 0.18) lr 4.50e-07 gnorm 0.246 5.69s mem 15.6GB +step 10/5000 loss 0.2181 (w 0.2472 mse 0.2517 t 993 new 0.20) lr 5.00e-07 gnorm 0.324 5.69s mem 15.6GB +step 11/5000 loss 0.0758 (w 0.2050 mse 0.1988 t 974 new 0.10) lr 5.50e-07 gnorm 0.144 5.69s mem 15.6GB +step 12/5000 loss 0.0893 (w 0.1379 mse 0.1324 t 936 new 0.23) lr 6.00e-07 gnorm 0.251 5.71s mem 15.6GB +step 13/5000 loss 0.1628 (w 0.1727 mse 0.1729 t 486 new 0.22) lr 6.50e-07 gnorm 0.321 5.69s mem 15.6GB +step 14/5000 loss 0.1638 (w 0.2151 mse 0.2080 t 138 new 0.28) lr 7.00e-07 gnorm 0.259 5.69s mem 15.6GB +step 15/5000 loss 0.0922 (w 0.1069 mse 0.1028 t 844 new 0.20) lr 7.50e-07 gnorm 0.204 5.69s mem 15.6GB +step 16/5000 loss 0.1403 (w 0.1643 mse 0.1625 t 998 new 0.19) lr 8.00e-07 gnorm 0.192 5.69s mem 15.6GB +step 17/5000 loss 0.1185 (w 0.0555 mse 0.0544 t 899 new 0.25) lr 8.50e-07 gnorm 0.208 5.69s mem 15.6GB +step 18/5000 loss 0.0849 (w 0.2398 mse 0.2359 t 982 new 0.24) lr 9.00e-07 gnorm 0.128 5.69s mem 15.6GB +step 19/5000 loss 0.0826 (w 0.9590 mse 0.9550 t 5 new 0.20) lr 9.50e-07 gnorm 0.200 5.69s mem 15.6GB +step 20/5000 loss 0.0948 (w 0.0994 mse 0.0944 t 925 new 0.25) lr 1.00e-06 gnorm 0.143 5.68s mem 15.6GB +step 21/5000 loss 0.1842 (w 0.4055 mse 0.4002 t 991 new 0.25) lr 1.05e-06 gnorm 0.237 5.70s mem 15.6GB +step 22/5000 loss 0.1003 (w 0.1203 mse 0.1119 t 839 new 0.25) lr 1.10e-06 gnorm 0.162 5.70s mem 15.6GB +step 23/5000 loss 0.1549 (w 0.1111 mse 0.1098 t 616 new 0.19) lr 1.15e-06 gnorm 0.196 5.69s mem 15.6GB +step 24/5000 loss 0.1064 (w 0.0669 mse 0.0735 t 885 new 0.27) lr 1.20e-06 gnorm 0.110 5.70s mem 15.6GB +step 25/5000 loss 0.0734 (w 0.0827 mse 0.0791 t 710 new 0.25) lr 1.25e-06 gnorm 0.184 5.69s mem 15.6GB +step 26/5000 loss 0.1268 (w 0.3320 mse 0.3328 t 138 new 0.13) lr 1.30e-06 gnorm 0.196 5.68s mem 15.6GB +step 27/5000 loss 0.0917 (w 0.0878 mse 0.0878 t 864 new 0.18) lr 1.35e-06 gnorm 0.124 5.69s mem 15.6GB +step 28/5000 loss 0.0987 (w 0.1251 mse 0.1250 t 928 new 0.22) lr 1.40e-06 gnorm 0.125 5.69s mem 15.6GB +step 29/5000 loss 0.0975 (w 0.1026 mse 0.0993 t 676 new 0.27) lr 1.45e-06 gnorm 0.160 5.70s mem 15.6GB +step 30/5000 loss 0.0878 (w 0.1070 mse 0.1051 t 911 new 0.23) lr 1.50e-06 gnorm 0.093 5.70s mem 15.6GB +step 31/5000 loss 0.1239 (w 0.0879 mse 0.0862 t 912 new 0.25) lr 1.55e-06 gnorm 0.137 5.69s mem 15.6GB +step 32/5000 loss 0.1064 (w 0.1172 mse 0.1121 t 847 new 0.22) lr 1.60e-06 gnorm 0.122 5.69s mem 15.6GB +step 33/5000 loss 0.1227 (w 0.1085 mse 0.0990 t 682 new 0.28) lr 1.65e-06 gnorm 0.150 5.78s mem 15.6GB +step 34/5000 loss 0.0654 (w 0.0983 mse 0.0937 t 744 new 0.26) lr 1.70e-06 gnorm 0.080 5.69s mem 15.6GB +step 35/5000 loss 0.1493 (w 0.2937 mse 0.2762 t 998 new 0.18) lr 1.75e-06 gnorm 0.115 5.69s mem 15.6GB +step 36/5000 loss 0.1121 (w 0.0903 mse 0.0874 t 733 new 0.25) lr 1.80e-06 gnorm 0.091 5.69s mem 15.6GB +step 37/5000 loss 0.0668 (w 0.1892 mse 0.1843 t 983 new 0.18) lr 1.85e-06 gnorm 0.158 5.69s mem 15.6GB +step 38/5000 loss 0.1496 (w 0.0664 mse 0.0723 t 821 new 0.26) lr 1.90e-06 gnorm 0.142 5.70s mem 15.6GB +step 39/5000 loss 0.1745 (w 0.1565 mse 0.1624 t 314 new 0.20) lr 1.95e-06 gnorm 0.103 5.70s mem 15.6GB +step 40/5000 loss 0.1188 (w 0.1136 mse 0.1105 t 839 new 0.23) lr 2.00e-06 gnorm 0.116 5.70s mem 15.6GB +step 41/5000 loss 0.2082 (w 0.0994 mse 0.0926 t 823 new 0.23) lr 2.05e-06 gnorm 0.217 5.70s mem 15.6GB +step 42/5000 loss 0.0804 (w 0.0845 mse 0.0841 t 744 new 0.30) lr 2.10e-06 gnorm 0.126 5.69s mem 15.6GB +step 43/5000 loss 0.1973 (w 0.1500 mse 0.1442 t 443 new 0.24) lr 2.15e-06 gnorm 0.105 5.92s mem 15.6GB +step 44/5000 loss 0.0817 (w 0.1588 mse 0.1591 t 943 new 0.22) lr 2.20e-06 gnorm 0.100 5.69s mem 15.6GB +step 45/5000 loss 0.0814 (w 0.2355 mse 0.2278 t 983 new 0.26) lr 2.25e-06 gnorm 0.115 5.69s mem 15.6GB +step 46/5000 loss 0.1019 (w 0.1502 mse 0.1566 t 982 new 0.22) lr 2.30e-06 gnorm 0.093 5.68s mem 15.6GB +step 47/5000 loss 0.1456 (w 0.1700 mse 0.1677 t 453 new 0.25) lr 2.35e-06 gnorm 0.095 5.69s mem 15.6GB +step 48/5000 loss 0.0661 (w 0.1343 mse 0.1359 t 875 new 0.19) lr 2.40e-06 gnorm 0.090 5.69s mem 15.6GB +step 49/5000 loss 0.0989 (w 0.1162 mse 0.1095 t 497 new 0.24) lr 2.45e-06 gnorm 0.084 5.69s mem 15.6GB +step 50/5000 loss 0.0789 (w 0.1723 mse 0.1687 t 949 new 0.18) lr 2.50e-06 gnorm 0.100 5.68s mem 15.6GB +step 51/5000 loss 0.1272 (w 0.1558 mse 0.1729 t 222 new 0.21) lr 2.55e-06 gnorm 0.089 5.68s mem 15.6GB +step 52/5000 loss 0.0761 (w 0.0829 mse 0.0803 t 916 new 0.16) lr 2.60e-06 gnorm 0.099 5.67s mem 15.6GB +step 53/5000 loss 0.1015 (w 0.0446 mse 0.0470 t 625 new 0.13) lr 2.65e-06 gnorm 0.097 5.69s mem 15.6GB +step 54/5000 loss 0.1129 (w 0.2622 mse 0.2446 t 985 new 0.23) lr 2.70e-06 gnorm 0.060 5.78s mem 15.6GB +step 55/5000 loss 0.1357 (w 0.1737 mse 0.1681 t 976 new 0.20) lr 2.75e-06 gnorm 0.109 5.69s mem 15.6GB +step 56/5000 loss 0.1022 (w 0.2940 mse 0.2830 t 982 new 0.23) lr 2.80e-06 gnorm 0.074 5.69s mem 15.6GB +step 57/5000 loss 0.1166 (w 0.1606 mse 0.1635 t 966 new 0.20) lr 2.85e-06 gnorm 0.108 5.70s mem 15.6GB +step 58/5000 loss 0.0843 (w 0.0733 mse 0.0737 t 814 new 0.26) lr 2.90e-06 gnorm 0.071 5.69s mem 15.6GB +step 59/5000 loss 0.1491 (w 0.1579 mse 0.1452 t 934 new 0.26) lr 2.95e-06 gnorm 0.077 5.68s mem 15.6GB +step 60/5000 loss 0.1040 (w 0.1343 mse 0.1242 t 825 new 0.30) lr 3.00e-06 gnorm 0.092 5.69s mem 15.6GB +step 61/5000 loss 0.1353 (w 0.0852 mse 0.0831 t 718 new 0.24) lr 3.05e-06 gnorm 0.091 5.69s mem 15.6GB +step 62/5000 loss 0.1734 (w 0.1586 mse 0.1556 t 964 new 0.25) lr 3.10e-06 gnorm 0.101 5.69s mem 15.6GB +step 63/5000 loss 0.1061 (w 0.2409 mse 0.2303 t 973 new 0.27) lr 3.15e-06 gnorm 0.083 5.69s mem 15.6GB +step 64/5000 loss 0.0622 (w 0.1527 mse 0.1440 t 887 new 0.21) lr 3.20e-06 gnorm 0.079 6.13s mem 15.6GB +step 65/5000 loss 0.1102 (w 0.0397 mse 0.0420 t 761 new 0.13) lr 3.25e-06 gnorm 0.088 5.70s mem 15.6GB +step 66/5000 loss 0.0718 (w 0.1185 mse 0.1154 t 943 new 0.25) lr 3.30e-06 gnorm 0.082 5.71s mem 15.6GB +step 67/5000 loss 0.0863 (w 0.0645 mse 0.0666 t 615 new 0.19) lr 3.35e-06 gnorm 0.072 5.70s mem 15.6GB +step 68/5000 loss 0.1077 (w 0.0680 mse 0.0658 t 768 new 0.25) lr 3.40e-06 gnorm 0.083 5.71s mem 15.6GB +step 69/5000 loss 0.1461 (w 0.1811 mse 0.2008 t 982 new 0.18) lr 3.45e-06 gnorm 0.088 5.70s mem 15.6GB +step 70/5000 loss 0.1161 (w 0.5201 mse 0.5309 t 75 new 0.22) lr 3.50e-06 gnorm 0.109 5.70s mem 15.6GB +step 71/5000 loss 0.1110 (w 0.1709 mse 0.1633 t 945 new 0.25) lr 3.55e-06 gnorm 0.097 5.71s mem 15.6GB +step 72/5000 loss 0.1109 (w 0.3022 mse 0.2890 t 998 new 0.27) lr 3.60e-06 gnorm 0.115 5.71s mem 15.6GB +step 73/5000 loss 0.1287 (w 0.0873 mse 0.0907 t 579 new 0.25) lr 3.65e-06 gnorm 0.082 5.69s mem 15.6GB +step 74/5000 loss 0.1051 (w 0.1409 mse 0.1488 t 985 new 0.19) lr 3.70e-06 gnorm 0.097 5.69s mem 15.6GB +step 75/5000 loss 0.1198 (w 0.0971 mse 0.0908 t 883 new 0.16) lr 3.75e-06 gnorm 0.072 5.69s mem 15.6GB +step 76/5000 loss 0.1048 (w 0.2379 mse 0.2451 t 165 new 0.12) lr 3.80e-06 gnorm 0.062 5.69s mem 15.6GB +step 77/5000 loss 0.1245 (w 0.3149 mse 0.3215 t 130 new 0.11) lr 3.85e-06 gnorm 0.069 5.68s mem 15.6GB +step 78/5000 loss 0.0827 (w 0.1479 mse 0.1489 t 941 new 0.24) lr 3.90e-06 gnorm 0.077 5.70s mem 15.6GB +step 79/5000 loss 0.1271 (w 0.2302 mse 0.2423 t 998 new 0.18) lr 3.95e-06 gnorm 0.074 5.70s mem 15.6GB +step 80/5000 loss 0.1353 (w 0.0916 mse 0.0894 t 930 new 0.17) lr 4.00e-06 gnorm 0.071 5.69s mem 15.6GB +step 81/5000 loss 0.0640 (w 0.1053 mse 0.1099 t 962 new 0.18) lr 4.05e-06 gnorm 0.069 5.69s mem 15.6GB +step 82/5000 loss 0.1311 (w 0.0945 mse 0.0952 t 912 new 0.21) lr 4.10e-06 gnorm 0.078 5.69s mem 15.6GB +step 83/5000 loss 0.1149 (w 0.3346 mse 0.3440 t 130 new 0.24) lr 4.15e-06 gnorm 0.100 5.68s mem 15.6GB +step 84/5000 loss 0.1158 (w 0.0971 mse 0.0926 t 688 new 0.26) lr 4.20e-06 gnorm 0.073 5.69s mem 15.6GB +step 85/5000 loss 0.0499 (w 0.1687 mse 0.1616 t 947 new 0.26) lr 4.25e-06 gnorm 0.074 5.92s mem 15.6GB +step 86/5000 loss 0.0606 (w 0.2212 mse 0.2132 t 991 new 0.27) lr 4.30e-06 gnorm 0.063 5.95s mem 15.6GB +step 87/5000 loss 0.0876 (w 0.1585 mse 0.1561 t 974 new 0.22) lr 4.35e-06 gnorm 0.069 5.69s mem 15.6GB +step 88/5000 loss 0.1350 (w 0.0736 mse 0.0738 t 527 new 0.22) lr 4.40e-06 gnorm 0.086 5.68s mem 15.6GB +step 89/5000 loss 0.0473 (w 0.0761 mse 0.0718 t 877 new 0.25) lr 4.45e-06 gnorm 0.062 5.69s mem 15.6GB +step 90/5000 loss 0.0738 (w 0.1957 mse 0.1741 t 966 new 0.24) lr 4.50e-06 gnorm 0.080 5.69s mem 15.6GB +step 91/5000 loss 0.1320 (w 0.0986 mse 0.0994 t 651 new 0.22) lr 4.55e-06 gnorm 0.075 5.69s mem 15.6GB +step 92/5000 loss 0.1366 (w 0.0980 mse 0.0927 t 700 new 0.27) lr 4.60e-06 gnorm 0.076 5.69s mem 15.6GB +step 93/5000 loss 0.0856 (w 0.0780 mse 0.0733 t 612 new 0.24) lr 4.65e-06 gnorm 0.065 5.70s mem 15.6GB +step 94/5000 loss 0.1680 (w 0.1339 mse 0.1275 t 410 new 0.24) lr 4.70e-06 gnorm 0.087 5.69s mem 15.6GB +step 95/5000 loss 0.0636 (w 0.0494 mse 0.0493 t 883 new 0.25) lr 4.75e-06 gnorm 0.070 5.69s mem 15.6GB +step 96/5000 loss 0.0949 (w 0.1884 mse 0.1846 t 974 new 0.25) lr 4.80e-06 gnorm 0.078 5.93s mem 15.6GB +step 97/5000 loss 0.0855 (w 0.1171 mse 0.1171 t 954 new 0.24) lr 4.85e-06 gnorm 0.069 5.68s mem 15.6GB +step 98/5000 loss 0.1436 (w 0.1163 mse 0.1113 t 396 new 0.20) lr 4.90e-06 gnorm 0.075 5.68s mem 15.6GB +step 99/5000 loss 0.0980 (w 0.0834 mse 0.0804 t 705 new 0.25) lr 4.95e-06 gnorm 0.065 5.69s mem 15.6GB +step 100/5000 loss 0.1370 (w 0.0966 mse 0.0889 t 781 new 0.25) lr 5.00e-06 gnorm 0.088 5.69s mem 15.6GB +step 101/5000 loss 0.1132 (w 0.0873 mse 0.0816 t 874 new 0.29) lr 5.05e-06 gnorm 0.072 5.68s mem 15.6GB +step 102/5000 loss 0.0746 (w 0.0733 mse 0.0738 t 765 new 0.23) lr 5.10e-06 gnorm 0.089 5.69s mem 15.6GB +step 103/5000 loss 0.1235 (w 0.0634 mse 0.0630 t 482 new 0.10) lr 5.15e-06 gnorm 0.076 5.68s mem 15.6GB +step 104/5000 loss 0.0827 (w 0.1621 mse 0.1534 t 987 new 0.22) lr 5.20e-06 gnorm 0.066 5.69s mem 15.6GB +step 105/5000 loss 0.0680 (w 0.0599 mse 0.0597 t 827 new 0.17) lr 5.25e-06 gnorm 0.077 5.69s mem 15.6GB +step 106/5000 loss 0.1070 (w 0.1433 mse 0.1361 t 966 new 0.17) lr 5.30e-06 gnorm 0.069 5.68s mem 15.6GB +step 107/5000 loss 0.1029 (w 0.0665 mse 0.0648 t 785 new 0.12) lr 5.35e-06 gnorm 0.089 5.81s mem 15.6GB +step 108/5000 loss 0.0882 (w 0.1503 mse 0.1463 t 967 new 0.23) lr 5.40e-06 gnorm 0.085 5.68s mem 15.6GB +step 109/5000 loss 0.1336 (w 0.1738 mse 0.1631 t 973 new 0.20) lr 5.45e-06 gnorm 0.074 5.69s mem 15.6GB +step 110/5000 loss 0.1470 (w 0.0666 mse 0.0698 t 862 new 0.29) lr 5.50e-06 gnorm 0.111 5.69s mem 15.6GB +step 111/5000 loss 0.0976 (w 0.0799 mse 0.0791 t 792 new 0.23) lr 5.55e-06 gnorm 0.102 5.69s mem 15.6GB +step 112/5000 loss 0.0986 (w 0.1220 mse 0.1208 t 975 new 0.27) lr 5.60e-06 gnorm 0.074 5.69s mem 15.6GB +step 113/5000 loss 0.1254 (w 0.1020 mse 0.0981 t 881 new 0.19) lr 5.65e-06 gnorm 0.069 5.69s mem 15.6GB +step 114/5000 loss 0.1458 (w 0.0837 mse 0.0822 t 663 new 0.25) lr 5.70e-06 gnorm 0.100 5.70s mem 15.6GB +step 115/5000 loss 0.1023 (w 0.2794 mse 0.2662 t 992 new 0.20) lr 5.75e-06 gnorm 0.074 5.69s mem 15.6GB +step 116/5000 loss 0.1517 (w 0.0638 mse 0.0683 t 629 new 0.21) lr 5.80e-06 gnorm 0.090 5.69s mem 15.6GB +step 117/5000 loss 0.1223 (w 0.1073 mse 0.1008 t 502 new 0.23) lr 5.85e-06 gnorm 0.112 5.94s mem 15.6GB +step 118/5000 loss 0.1348 (w 0.0993 mse 0.0972 t 837 new 0.16) lr 5.90e-06 gnorm 0.100 5.85s mem 15.6GB +step 119/5000 loss 0.0874 (w 0.2000 mse 0.2037 t 982 new 0.26) lr 5.95e-06 gnorm 0.076 5.69s mem 15.6GB +step 120/5000 loss 0.1113 (w 0.0949 mse 0.0914 t 925 new 0.20) lr 6.00e-06 gnorm 0.069 5.68s mem 15.6GB +step 121/5000 loss 0.1098 (w 0.0693 mse 0.0671 t 933 new 0.21) lr 6.05e-06 gnorm 0.073 5.69s mem 15.6GB +step 122/5000 loss 0.0867 (w 0.0738 mse 0.0717 t 877 new 0.23) lr 6.10e-06 gnorm 0.067 5.69s mem 15.6GB +step 123/5000 loss 0.0706 (w 0.0820 mse 0.0828 t 563 new 0.25) lr 6.15e-06 gnorm 0.093 5.69s mem 15.6GB +step 124/5000 loss 0.1327 (w 0.1079 mse 0.1046 t 686 new 0.19) lr 6.20e-06 gnorm 0.063 5.70s mem 15.6GB +step 125/5000 loss 0.1237 (w 0.0758 mse 0.0741 t 815 new 0.07) lr 6.25e-06 gnorm 0.091 5.69s mem 15.6GB +step 126/5000 loss 0.0891 (w 0.0947 mse 0.0916 t 847 new 0.29) lr 6.30e-06 gnorm 0.058 5.69s mem 15.6GB +step 127/5000 loss 0.0946 (w 0.1092 mse 0.0990 t 893 new 0.22) lr 6.35e-06 gnorm 0.078 5.68s mem 15.6GB +step 128/5000 loss 0.1222 (w 0.0849 mse 0.0826 t 679 new 0.22) lr 6.40e-06 gnorm 0.072 5.78s mem 15.6GB +step 129/5000 loss 0.1163 (w 0.1975 mse 0.1941 t 232 new 0.28) lr 6.45e-06 gnorm 0.082 5.69s mem 15.6GB +step 130/5000 loss 0.1337 (w 0.0559 mse 0.0540 t 660 new 0.15) lr 6.50e-06 gnorm 0.078 5.69s mem 15.6GB +step 131/5000 loss 0.1369 (w 0.1976 mse 0.1982 t 225 new 0.24) lr 6.55e-06 gnorm 0.075 5.69s mem 15.6GB +step 132/5000 loss 0.1350 (w 0.0961 mse 0.0909 t 868 new 0.23) lr 6.60e-06 gnorm 0.087 5.70s mem 15.6GB +step 133/5000 loss 0.0853 (w 0.0930 mse 0.0937 t 603 new 0.27) lr 6.65e-06 gnorm 0.080 5.69s mem 15.6GB +step 134/5000 loss 0.1301 (w 0.1064 mse 0.1026 t 520 new 0.24) lr 6.70e-06 gnorm 0.072 5.69s mem 15.6GB +step 135/5000 loss 0.1258 (w 0.1197 mse 0.1219 t 478 new 0.17) lr 6.75e-06 gnorm 0.067 5.69s mem 15.6GB +step 136/5000 loss 0.1111 (w 0.0787 mse 0.0747 t 600 new 0.28) lr 6.80e-06 gnorm 0.071 5.69s mem 15.6GB +step 137/5000 loss 0.0963 (w 0.0769 mse 0.0743 t 704 new 0.25) lr 6.85e-06 gnorm 0.082 5.69s mem 15.6GB +step 138/5000 loss 0.0981 (w 0.2210 mse 0.2265 t 979 new 0.22) lr 6.90e-06 gnorm 0.086 5.94s mem 15.6GB +step 139/5000 loss 0.1064 (w 0.1106 mse 0.1058 t 717 new 0.26) lr 6.95e-06 gnorm 0.077 5.69s mem 15.6GB +step 140/5000 loss 0.1099 (w 0.5569 mse 0.5722 t 66 new 0.30) lr 7.00e-06 gnorm 0.066 5.70s mem 15.6GB +step 141/5000 loss 0.1120 (w 0.0791 mse 0.0728 t 482 new 0.26) lr 7.05e-06 gnorm 0.078 5.69s mem 15.6GB +step 142/5000 loss 0.0783 (w 0.1464 mse 0.1346 t 951 new 0.20) lr 7.10e-06 gnorm 0.078 5.70s mem 15.6GB +step 143/5000 loss 0.1318 (w 0.1043 mse 0.1003 t 947 new 0.18) lr 7.15e-06 gnorm 0.081 5.69s mem 15.6GB +step 144/5000 loss 0.1309 (w 0.0774 mse 0.0767 t 593 new 0.16) lr 7.20e-06 gnorm 0.080 5.69s mem 15.6GB +step 145/5000 loss 0.0680 (w 0.1119 mse 0.1031 t 966 new 0.26) lr 7.25e-06 gnorm 0.087 5.69s mem 15.6GB +step 146/5000 loss 0.0858 (w 0.1028 mse 0.0997 t 932 new 0.22) lr 7.30e-06 gnorm 0.065 5.70s mem 15.6GB +step 147/5000 loss 0.1034 (w 0.2388 mse 0.2304 t 161 new 0.23) lr 7.35e-06 gnorm 0.079 5.69s mem 15.6GB +step 148/5000 loss 0.1029 (w 0.2258 mse 0.2065 t 987 new 0.22) lr 7.40e-06 gnorm 0.090 5.69s mem 15.6GB +step 149/5000 loss 0.0900 (w 0.0745 mse 0.0736 t 476 new 0.23) lr 7.45e-06 gnorm 0.069 6.02s mem 15.6GB +step 150/5000 loss 0.0776 (w 0.0973 mse 0.0920 t 903 new 0.25) lr 7.50e-06 gnorm 0.092 5.69s mem 15.6GB +step 151/5000 loss 0.0876 (w 0.0673 mse 0.0654 t 846 new 0.27) lr 7.55e-06 gnorm 0.088 5.68s mem 15.6GB +step 152/5000 loss 0.0864 (w 0.0877 mse 0.0814 t 911 new 0.24) lr 7.60e-06 gnorm 0.075 5.67s mem 15.6GB +step 153/5000 loss 0.1289 (w 0.1345 mse 0.1318 t 942 new 0.25) lr 7.65e-06 gnorm 0.081 5.68s mem 15.6GB +step 154/5000 loss 0.1074 (w 0.0970 mse 0.0964 t 744 new 0.22) lr 7.70e-06 gnorm 0.114 5.68s mem 15.6GB +step 155/5000 loss 0.1035 (w 0.0771 mse 0.0699 t 733 new 0.24) lr 7.75e-06 gnorm 0.083 5.68s mem 15.6GB +step 156/5000 loss 0.1129 (w 0.1699 mse 0.1595 t 951 new 0.21) lr 7.80e-06 gnorm 0.089 5.69s mem 15.6GB +step 157/5000 loss 0.0464 (w 0.0670 mse 0.0609 t 846 new 0.24) lr 7.85e-06 gnorm 0.067 5.69s mem 15.6GB +step 158/5000 loss 0.1461 (w 0.0587 mse 0.0553 t 714 new 0.26) lr 7.90e-06 gnorm 0.094 5.68s mem 15.6GB +step 159/5000 loss 0.0491 (w 0.2287 mse 0.2223 t 987 new 0.17) lr 7.95e-06 gnorm 0.075 5.91s mem 15.6GB +step 160/5000 loss 0.1133 (w 0.1547 mse 0.1443 t 919 new 0.24) lr 8.00e-06 gnorm 0.102 5.69s mem 15.6GB +step 161/5000 loss 0.0911 (w 0.0978 mse 0.0972 t 787 new 0.23) lr 8.05e-06 gnorm 0.096 5.68s mem 15.6GB +step 162/5000 loss 0.0919 (w 0.3283 mse 0.3267 t 150 new 0.25) lr 8.10e-06 gnorm 0.077 5.69s mem 15.6GB +step 163/5000 loss 0.1006 (w 0.1149 mse 0.1087 t 924 new 0.19) lr 8.15e-06 gnorm 0.065 5.69s mem 15.6GB +step 164/5000 loss 0.1366 (w 0.0511 mse 0.0571 t 563 new 0.29) lr 8.20e-06 gnorm 0.102 5.69s mem 15.6GB +step 165/5000 loss 0.1332 (w 0.0963 mse 0.0937 t 780 new 0.27) lr 8.25e-06 gnorm 0.096 5.69s mem 15.6GB +step 166/5000 loss 0.1009 (w 0.0861 mse 0.0837 t 538 new 0.12) lr 8.30e-06 gnorm 0.075 5.69s mem 15.6GB +step 167/5000 loss 0.0838 (w 0.0259 mse 0.0291 t 652 new 0.16) lr 8.35e-06 gnorm 0.100 5.69s mem 15.6GB +step 168/5000 loss 0.0905 (w 0.0635 mse 0.0598 t 733 new 0.22) lr 8.40e-06 gnorm 0.092 5.69s mem 15.6GB +step 169/5000 loss 0.1064 (w 0.0796 mse 0.0801 t 940 new 0.06) lr 8.45e-06 gnorm 0.089 5.69s mem 15.6GB +step 170/5000 loss 0.0795 (w 0.0984 mse 0.1054 t 924 new 0.14) lr 8.50e-06 gnorm 0.099 5.68s mem 15.6GB +step 171/5000 loss 0.0868 (w 0.0656 mse 0.0637 t 686 new 0.20) lr 8.55e-06 gnorm 0.107 5.69s mem 15.6GB +step 172/5000 loss 0.1191 (w 0.6714 mse 0.6707 t 53 new 0.27) lr 8.60e-06 gnorm 0.066 5.68s mem 15.6GB +step 173/5000 loss 0.1464 (w 0.0631 mse 0.0676 t 504 new 0.22) lr 8.65e-06 gnorm 0.086 5.68s mem 15.6GB +step 174/5000 loss 0.1466 (w 0.0664 mse 0.0711 t 516 new 0.26) lr 8.70e-06 gnorm 0.073 5.68s mem 15.6GB +step 175/5000 loss 0.1270 (w 0.0776 mse 0.0744 t 577 new 0.22) lr 8.75e-06 gnorm 0.072 5.68s mem 15.6GB +step 176/5000 loss 0.1060 (w 0.1352 mse 0.1376 t 931 new 0.18) lr 8.80e-06 gnorm 0.061 5.69s mem 15.6GB +step 177/5000 loss 0.1217 (w 0.0934 mse 0.0904 t 857 new 0.17) lr 8.85e-06 gnorm 0.085 5.68s mem 15.6GB +step 178/5000 loss 0.0675 (w 0.1649 mse 0.1627 t 960 new 0.19) lr 8.90e-06 gnorm 0.104 5.69s mem 15.6GB +step 179/5000 loss 0.1234 (w 0.0974 mse 0.0936 t 842 new 0.21) lr 8.95e-06 gnorm 0.068 5.69s mem 15.6GB +step 180/5000 loss 0.1112 (w 0.0850 mse 0.0821 t 875 new 0.26) lr 9.00e-06 gnorm 0.077 5.91s mem 15.6GB +step 181/5000 loss 0.1369 (w 0.0601 mse 0.0609 t 784 new 0.26) lr 9.05e-06 gnorm 0.076 5.90s mem 15.6GB +step 182/5000 loss 0.0955 (w 0.0794 mse 0.0752 t 619 new 0.19) lr 9.10e-06 gnorm 0.088 5.69s mem 15.6GB +step 183/5000 loss 0.1284 (w 0.1352 mse 0.1302 t 891 new 0.19) lr 9.15e-06 gnorm 0.086 5.68s mem 15.6GB +step 184/5000 loss 0.0962 (w 0.1461 mse 0.1424 t 987 new 0.26) lr 9.20e-06 gnorm 0.074 5.68s mem 15.6GB +step 185/5000 loss 0.1240 (w 0.0313 mse 0.0290 t 482 new 0.10) lr 9.25e-06 gnorm 0.091 5.69s mem 15.6GB +step 186/5000 loss 0.1158 (w 0.7591 mse 0.7472 t 20 new 0.23) lr 9.30e-06 gnorm 0.069 5.69s mem 15.6GB +step 187/5000 loss 0.0695 (w 0.0846 mse 0.0817 t 816 new 0.15) lr 9.35e-06 gnorm 0.074 5.69s mem 15.6GB +step 188/5000 loss 0.0955 (w 0.0614 mse 0.0662 t 842 new 0.27) lr 9.40e-06 gnorm 0.085 5.69s mem 15.6GB +step 189/5000 loss 0.1364 (w 0.3109 mse 0.2884 t 1000 new 0.23) lr 9.45e-06 gnorm 0.072 5.68s mem 15.6GB +step 190/5000 loss 0.0766 (w 0.1173 mse 0.1247 t 969 new 0.14) lr 9.50e-06 gnorm 0.086 5.89s mem 15.6GB +step 191/5000 loss 0.0672 (w 0.1563 mse 0.1443 t 934 new 0.25) lr 9.55e-06 gnorm 0.088 5.69s mem 15.6GB +step 192/5000 loss 0.0801 (w 0.1172 mse 0.1096 t 895 new 0.28) lr 9.60e-06 gnorm 0.071 5.75s mem 15.6GB +step 193/5000 loss 0.0536 (w 0.0698 mse 0.0677 t 890 new 0.29) lr 9.65e-06 gnorm 0.084 5.67s mem 15.6GB +step 194/5000 loss 0.1189 (w 0.0435 mse 0.0422 t 690 new 0.21) lr 9.70e-06 gnorm 0.115 5.69s mem 15.6GB +step 195/5000 loss 0.1028 (w 0.0672 mse 0.0668 t 814 new 0.16) lr 9.75e-06 gnorm 0.075 5.70s mem 15.6GB +step 196/5000 loss 0.1993 (w 0.0912 mse 0.0903 t 504 new 0.29) lr 9.80e-06 gnorm 0.118 5.69s mem 15.6GB +step 197/5000 loss 0.1077 (w 0.1289 mse 0.1261 t 951 new 0.22) lr 9.85e-06 gnorm 0.086 5.69s mem 15.6GB +step 198/5000 loss 0.0582 (w 0.0744 mse 0.0724 t 710 new 0.18) lr 9.90e-06 gnorm 0.068 5.68s mem 15.6GB +step 199/5000 loss 0.1660 (w 0.1612 mse 0.1595 t 352 new 0.20) lr 9.95e-06 gnorm 0.098 5.69s mem 15.6GB +step 200/5000 loss 0.1056 (w 0.7649 mse 0.7846 t 34 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 201/5000 loss 0.1279 (w 0.0459 mse 0.0493 t 603 new 0.29) lr 1.00e-05 gnorm 0.108 5.69s mem 15.6GB +step 202/5000 loss 0.1096 (w 0.1616 mse 0.1546 t 291 new 0.23) lr 1.00e-05 gnorm 0.075 6.14s mem 15.6GB +step 203/5000 loss 0.0789 (w 0.0750 mse 0.0684 t 795 new 0.23) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 204/5000 loss 0.0819 (w 0.0984 mse 0.0919 t 831 new 0.22) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 205/5000 loss 0.0958 (w 0.0913 mse 0.0891 t 887 new 0.24) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 206/5000 loss 0.1242 (w 0.3293 mse 0.3236 t 993 new 0.10) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 207/5000 loss 0.1000 (w 0.1033 mse 0.1016 t 790 new 0.26) lr 1.00e-05 gnorm 0.101 5.69s mem 15.6GB +step 208/5000 loss 0.1184 (w 0.1044 mse 0.1033 t 945 new 0.30) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 209/5000 loss 0.0950 (w 0.1131 mse 0.1107 t 698 new 0.18) lr 1.00e-05 gnorm 0.115 5.69s mem 15.6GB +step 210/5000 loss 0.1024 (w 0.2263 mse 0.2219 t 198 new 0.20) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 211/5000 loss 0.0609 (w 0.1670 mse 0.1726 t 986 new 0.27) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 212/5000 loss 0.1097 (w 0.1270 mse 0.1241 t 372 new 0.18) lr 1.00e-05 gnorm 0.073 5.73s mem 15.6GB +step 213/5000 loss 0.0480 (w 0.3857 mse 0.3316 t 990 new 0.29) lr 1.00e-05 gnorm 0.118 5.78s mem 15.6GB +step 214/5000 loss 0.1125 (w 0.1486 mse 0.1473 t 947 new 0.22) lr 1.00e-05 gnorm 0.100 5.68s mem 15.6GB +step 215/5000 loss 0.0819 (w 0.0864 mse 0.0866 t 836 new 0.12) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 216/5000 loss 0.1006 (w 0.0642 mse 0.0641 t 845 new 0.12) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 217/5000 loss 0.1272 (w 0.0643 mse 0.0679 t 683 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 218/5000 loss 0.0741 (w 0.0912 mse 0.0872 t 642 new 0.22) lr 1.00e-05 gnorm 0.110 5.68s mem 15.6GB +step 219/5000 loss 0.1473 (w 0.0847 mse 0.0858 t 626 new 0.21) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +step 220/5000 loss 0.0967 (w 0.0816 mse 0.0785 t 788 new 0.28) lr 1.00e-05 gnorm 0.098 5.69s mem 15.6GB +step 221/5000 loss 0.0827 (w 0.0906 mse 0.0903 t 651 new 0.17) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 222/5000 loss 0.0964 (w 0.0891 mse 0.0862 t 860 new 0.14) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 223/5000 loss 0.0695 (w 0.0921 mse 0.0888 t 865 new 0.24) lr 1.00e-05 gnorm 0.075 6.15s mem 15.6GB +step 224/5000 loss 0.1521 (w 0.1363 mse 0.1307 t 916 new 0.10) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 225/5000 loss 0.0512 (w 0.2355 mse 0.2209 t 995 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 226/5000 loss 0.1013 (w 0.0917 mse 0.0850 t 857 new 0.23) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 227/5000 loss 0.0820 (w 0.0857 mse 0.0849 t 952 new 0.17) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 228/5000 loss 0.1091 (w 0.2070 mse 0.2122 t 996 new 0.13) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +step 229/5000 loss 0.0675 (w 0.0853 mse 0.0900 t 965 new 0.11) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +step 230/5000 loss 0.0522 (w 0.1031 mse 0.1029 t 873 new 0.20) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 231/5000 loss 0.0518 (w 0.0565 mse 0.0562 t 778 new 0.08) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 232/5000 loss 0.1698 (w 0.2136 mse 0.2030 t 975 new 0.25) lr 1.00e-05 gnorm 0.102 5.69s mem 15.6GB +step 233/5000 loss 0.0949 (w 0.0881 mse 0.0857 t 777 new 0.18) lr 1.00e-05 gnorm 0.095 5.68s mem 15.6GB +step 234/5000 loss 0.0983 (w 0.1507 mse 0.1477 t 940 new 0.17) lr 1.00e-05 gnorm 0.094 5.80s mem 15.6GB +step 235/5000 loss 0.1422 (w 0.2207 mse 0.2215 t 999 new 0.16) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +step 236/5000 loss 0.0876 (w 0.1123 mse 0.1019 t 929 new 0.20) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +step 237/5000 loss 0.1002 (w 0.0603 mse 0.0571 t 759 new 0.22) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +step 238/5000 loss 0.1003 (w 0.0554 mse 0.0595 t 642 new 0.22) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +step 239/5000 loss 0.0763 (w 0.0916 mse 0.1110 t 205 new 0.23) lr 1.00e-05 gnorm 0.107 5.69s mem 15.6GB +step 240/5000 loss 0.1006 (w 0.0934 mse 0.0934 t 511 new 0.23) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +step 241/5000 loss 0.1701 (w 0.0918 mse 0.0828 t 370 new 0.19) lr 1.00e-05 gnorm 0.122 5.68s mem 15.6GB +step 242/5000 loss 0.0581 (w 0.1258 mse 0.1174 t 929 new 0.11) lr 1.00e-05 gnorm 0.102 5.69s mem 15.6GB +step 243/5000 loss 0.0811 (w 0.0376 mse 0.0370 t 762 new 0.12) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +step 244/5000 loss 0.1678 (w 0.1123 mse 0.1089 t 391 new 0.30) lr 1.00e-05 gnorm 0.125 5.92s mem 15.6GB +step 245/5000 loss 0.0973 (w 0.0979 mse 0.1041 t 317 new 0.27) lr 1.00e-05 gnorm 0.093 5.70s mem 15.6GB +step 246/5000 loss 0.1376 (w 0.2346 mse 0.2343 t 219 new 0.25) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 247/5000 loss 0.1223 (w 0.0525 mse 0.0629 t 984 new 0.21) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +step 248/5000 loss 0.1110 (w 0.0874 mse 0.0825 t 630 new 0.33) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 249/5000 loss 0.1263 (w 0.2660 mse 0.2640 t 180 new 0.20) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 250/5000 loss 0.0755 (w 0.1307 mse 0.1206 t 320 new 0.21) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +step 251/5000 loss 0.1281 (w 0.0983 mse 0.0984 t 518 new 0.24) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 252/5000 loss 0.0813 (w 0.0811 mse 0.0782 t 838 new 0.25) lr 1.00e-05 gnorm 0.099 5.70s mem 15.6GB +step 253/5000 loss 0.1152 (w 0.0900 mse 0.0857 t 522 new 0.25) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +step 254/5000 loss 0.0939 (w 0.1219 mse 0.1205 t 848 new 0.19) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +step 255/5000 loss 0.1196 (w 0.0673 mse 0.0648 t 610 new 0.26) lr 1.00e-05 gnorm 0.081 5.73s mem 15.6GB +step 256/5000 loss 0.0931 (w 0.0989 mse 0.0931 t 948 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 257/5000 loss 0.0596 (w 0.0638 mse 0.0642 t 608 new 0.26) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +step 258/5000 loss 0.1146 (w 0.0782 mse 0.0787 t 895 new 0.26) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 259/5000 loss 0.1143 (w 0.0984 mse 0.0951 t 773 new 0.26) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 260/5000 loss 0.1060 (w 0.0452 mse 0.0486 t 641 new 0.14) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 261/5000 loss 0.1214 (w 0.0636 mse 0.0627 t 621 new 0.20) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 262/5000 loss 0.0630 (w 0.0685 mse 0.0645 t 880 new 0.22) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 263/5000 loss 0.0759 (w 0.1203 mse 0.1118 t 920 new 0.26) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 264/5000 loss 0.0692 (w 0.0864 mse 0.0852 t 557 new 0.22) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 265/5000 loss 0.1367 (w 0.0833 mse 0.0822 t 894 new 0.25) lr 1.00e-05 gnorm 0.082 5.90s mem 15.6GB +step 266/5000 loss 0.0563 (w 0.0730 mse 0.0691 t 652 new 0.24) lr 1.00e-05 gnorm 0.075 5.96s mem 15.6GB +step 267/5000 loss 0.1038 (w 0.1209 mse 0.1343 t 979 new 0.21) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +step 268/5000 loss 0.0977 (w 0.1458 mse 0.1347 t 981 new 0.23) lr 1.00e-05 gnorm 0.100 5.70s mem 15.6GB +step 269/5000 loss 0.1282 (w 0.0932 mse 0.0842 t 959 new 0.16) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 270/5000 loss 0.1005 (w 0.0825 mse 0.0772 t 863 new 0.23) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 271/5000 loss 0.0810 (w 0.0306 mse 0.0340 t 566 new 0.14) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 272/5000 loss 0.1024 (w 0.0878 mse 0.0852 t 929 new 0.21) lr 1.00e-05 gnorm 0.088 5.70s mem 15.6GB +step 273/5000 loss 0.1170 (w 0.1331 mse 0.1292 t 981 new 0.25) lr 1.00e-05 gnorm 0.108 5.70s mem 15.6GB +step 274/5000 loss 0.1218 (w 0.1934 mse 0.1837 t 957 new 0.29) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +step 275/5000 loss 0.1227 (w 0.1200 mse 0.1189 t 577 new 0.22) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 276/5000 loss 0.0888 (w 0.7261 mse 0.7244 t 43 new 0.20) lr 1.00e-05 gnorm 0.087 5.84s mem 15.6GB +step 277/5000 loss 0.1538 (w 0.0818 mse 0.0846 t 627 new 0.24) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 278/5000 loss 0.1301 (w 0.1157 mse 0.1148 t 881 new 0.21) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 279/5000 loss 0.1218 (w 0.0930 mse 0.0904 t 972 new 0.20) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 280/5000 loss 0.1616 (w 0.6124 mse 0.6191 t 48 new 0.13) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 281/5000 loss 0.1171 (w 0.3092 mse 0.3087 t 157 new 0.24) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 282/5000 loss 0.0799 (w 0.1022 mse 0.0985 t 846 new 0.16) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 283/5000 loss 0.1344 (w 0.2754 mse 0.2712 t 232 new 0.24) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 284/5000 loss 0.0483 (w 0.1166 mse 0.1067 t 974 new 0.24) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 285/5000 loss 0.1065 (w 0.1256 mse 0.1221 t 919 new 0.22) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 286/5000 loss 0.0763 (w 0.1542 mse 0.1504 t 258 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 287/5000 loss 0.1142 (w 0.0462 mse 0.0408 t 869 new 0.16) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 288/5000 loss 0.0891 (w 0.0763 mse 0.0777 t 545 new 0.19) lr 1.00e-05 gnorm 0.072 5.92s mem 15.6GB +step 289/5000 loss 0.0786 (w 0.0945 mse 0.0856 t 844 new 0.24) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 290/5000 loss 0.0354 (w 0.0468 mse 0.0468 t 896 new 0.20) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 291/5000 loss 0.1079 (w 0.0771 mse 0.0782 t 913 new 0.25) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 292/5000 loss 0.0722 (w 0.0833 mse 0.0823 t 910 new 0.19) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 293/5000 loss 0.1288 (w 0.0931 mse 0.0946 t 396 new 0.18) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 294/5000 loss 0.0728 (w 0.0904 mse 0.0897 t 925 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 295/5000 loss 0.0798 (w 0.0687 mse 0.0720 t 461 new 0.28) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 296/5000 loss 0.0596 (w 0.4843 mse 0.4661 t 995 new 0.26) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 297/5000 loss 0.1280 (w 0.0975 mse 0.0920 t 949 new 0.18) lr 1.00e-05 gnorm 0.094 5.70s mem 15.6GB +step 298/5000 loss 0.0893 (w 0.0605 mse 0.0638 t 781 new 0.23) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +step 299/5000 loss 0.1274 (w 0.1002 mse 0.0977 t 890 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 300/5000 loss 0.1109 (w 0.0787 mse 0.0735 t 606 new 0.25) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 301/5000 loss 0.0922 (w 0.1545 mse 0.1597 t 985 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 302/5000 loss 0.0882 (w 0.4745 mse 0.4866 t 62 new 0.12) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 303/5000 loss 0.1393 (w 0.1129 mse 0.1101 t 581 new 0.23) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 304/5000 loss 0.1216 (w 0.0648 mse 0.0626 t 644 new 0.24) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 305/5000 loss 0.1104 (w 0.0669 mse 0.0635 t 760 new 0.24) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 306/5000 loss 0.0868 (w 0.1050 mse 0.0924 t 936 new 0.26) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 307/5000 loss 0.0934 (w 0.1257 mse 0.1148 t 969 new 0.24) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 308/5000 loss 0.0842 (w 0.0646 mse 0.0648 t 895 new 0.13) lr 1.00e-05 gnorm 0.070 5.91s mem 15.6GB +step 309/5000 loss 0.0422 (w 0.0673 mse 0.0669 t 320 new 0.07) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 310/5000 loss 0.0990 (w 0.0627 mse 0.0645 t 744 new 0.18) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 311/5000 loss 0.1147 (w 0.1010 mse 0.1021 t 451 new 0.29) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 312/5000 loss 0.0963 (w 0.0834 mse 0.0837 t 523 new 0.16) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 313/5000 loss 0.1678 (w 0.1157 mse 0.1090 t 889 new 0.27) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 314/5000 loss 0.0935 (w 0.1065 mse 0.1033 t 744 new 0.24) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 315/5000 loss 0.1171 (w 0.4422 mse 0.4367 t 75 new 0.22) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 316/5000 loss 0.1086 (w 0.0891 mse 0.0902 t 647 new 0.21) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 317/5000 loss 0.1131 (w 0.1723 mse 0.1610 t 964 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 318/5000 loss 0.0628 (w 0.1168 mse 0.1164 t 834 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 319/5000 loss 0.0924 (w 0.0648 mse 0.0660 t 723 new 0.25) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 320/5000 loss 0.0747 (w 0.0721 mse 0.0684 t 866 new 0.19) lr 1.00e-05 gnorm 0.106 5.70s mem 15.6GB +step 321/5000 loss 0.0795 (w 0.1379 mse 0.1321 t 970 new 0.26) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 322/5000 loss 0.0627 (w 0.0674 mse 0.0640 t 961 new 0.23) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 323/5000 loss 0.0659 (w 0.2561 mse 0.2461 t 998 new 0.24) lr 1.00e-05 gnorm 0.107 5.69s mem 15.6GB +step 324/5000 loss 0.0881 (w 0.2548 mse 0.2252 t 994 new 0.25) lr 1.00e-05 gnorm 0.085 5.70s mem 15.6GB +step 325/5000 loss 0.0414 (w 0.3114 mse 0.2860 t 997 new 0.26) lr 1.00e-05 gnorm 0.079 5.71s mem 15.6GB +step 326/5000 loss 0.1355 (w 0.0928 mse 0.0967 t 971 new 0.28) lr 1.00e-05 gnorm 0.100 5.69s mem 15.6GB +step 327/5000 loss 0.0702 (w 0.1079 mse 0.0977 t 906 new 0.26) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 328/5000 loss 0.1040 (w 0.1564 mse 0.1596 t 975 new 0.21) lr 1.00e-05 gnorm 0.084 5.86s mem 15.6GB +step 329/5000 loss 0.0887 (w 0.1177 mse 0.1138 t 944 new 0.28) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +step 330/5000 loss 0.0632 (w 0.1380 mse 0.1354 t 956 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 331/5000 loss 0.1225 (w 0.0514 mse 0.0553 t 825 new 0.27) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 332/5000 loss 0.0710 (w 0.1320 mse 0.1264 t 919 new 0.10) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 333/5000 loss 0.1069 (w 0.0798 mse 0.0803 t 754 new 0.21) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +step 334/5000 loss 0.0578 (w 0.1466 mse 0.1380 t 984 new 0.22) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 335/5000 loss 0.0946 (w 0.0761 mse 0.0731 t 591 new 0.21) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 336/5000 loss 0.1161 (w 0.0436 mse 0.0452 t 954 new 0.11) lr 1.00e-05 gnorm 0.125 5.70s mem 15.6GB +step 337/5000 loss 0.0931 (w 0.1650 mse 0.1685 t 208 new 0.18) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 338/5000 loss 0.0436 (w 0.1648 mse 0.1591 t 954 new 0.27) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 339/5000 loss 0.1000 (w 0.0759 mse 0.0775 t 887 new 0.21) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 340/5000 loss 0.0950 (w 0.1608 mse 0.1615 t 972 new 0.26) lr 1.00e-05 gnorm 0.061 5.79s mem 15.6GB +step 341/5000 loss 0.1415 (w 0.0838 mse 0.0816 t 666 new 0.26) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 342/5000 loss 0.0382 (w 0.2579 mse 0.2507 t 993 new 0.20) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 343/5000 loss 0.1142 (w 0.1008 mse 0.0942 t 707 new 0.20) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 344/5000 loss 0.0840 (w 0.0705 mse 0.0693 t 908 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 345/5000 loss 0.0936 (w 0.0784 mse 0.0847 t 339 new 0.15) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 346/5000 loss 0.1180 (w 0.0785 mse 0.0767 t 434 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 347/5000 loss 0.0758 (w 0.0817 mse 0.0792 t 822 new 0.25) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 348/5000 loss 0.0781 (w 0.1378 mse 0.1312 t 940 new 0.24) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 349/5000 loss 0.1441 (w 0.0504 mse 0.0485 t 612 new 0.27) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 350/5000 loss 0.1125 (w 0.1732 mse 0.1692 t 972 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 351/5000 loss 0.1379 (w 0.0917 mse 0.0922 t 754 new 0.14) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 352/5000 loss 0.1110 (w 0.1024 mse 0.0911 t 885 new 0.23) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 353/5000 loss 0.0766 (w 0.1315 mse 0.1323 t 955 new 0.21) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 354/5000 loss 0.1201 (w 0.1626 mse 0.1613 t 414 new 0.21) lr 1.00e-05 gnorm 0.104 5.69s mem 15.6GB +step 355/5000 loss 0.0917 (w 0.1000 mse 0.0992 t 869 new 0.18) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 356/5000 loss 0.1074 (w 0.1119 mse 0.1072 t 844 new 0.26) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 357/5000 loss 0.1096 (w 0.0891 mse 0.0892 t 667 new 0.30) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 358/5000 loss 0.1465 (w 0.0808 mse 0.0748 t 873 new 0.25) lr 1.00e-05 gnorm 0.123 5.69s mem 15.6GB +step 359/5000 loss 0.0852 (w 0.0561 mse 0.0576 t 459 new 0.22) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 360/5000 loss 0.0598 (w 0.0785 mse 0.0708 t 673 new 0.24) lr 1.00e-05 gnorm 0.101 5.97s mem 15.6GB +step 361/5000 loss 0.0986 (w 0.0606 mse 0.0602 t 615 new 0.18) lr 1.00e-05 gnorm 0.115 5.70s mem 15.6GB +step 362/5000 loss 0.0753 (w 0.0499 mse 0.0509 t 659 new 0.07) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 363/5000 loss 0.0849 (w 0.0972 mse 0.0990 t 877 new 0.27) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 364/5000 loss 0.1355 (w 0.0873 mse 0.0858 t 572 new 0.25) lr 1.00e-05 gnorm 0.112 5.70s mem 15.6GB +step 365/5000 loss 0.1060 (w 0.0612 mse 0.0730 t 273 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 366/5000 loss 0.0899 (w 0.0999 mse 0.1003 t 919 new 0.09) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 367/5000 loss 0.1150 (w 0.0850 mse 0.0816 t 518 new 0.26) lr 1.00e-05 gnorm 0.155 5.69s mem 15.6GB +step 368/5000 loss 0.0464 (w 0.0831 mse 0.0753 t 920 new 0.29) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +step 369/5000 loss 0.0897 (w 0.0746 mse 0.0736 t 549 new 0.15) lr 1.00e-05 gnorm 0.095 5.91s mem 15.6GB +step 370/5000 loss 0.0700 (w 0.0863 mse 0.0871 t 922 new 0.15) lr 1.00e-05 gnorm 0.120 5.70s mem 15.6GB +step 371/5000 loss 0.1378 (w 0.1173 mse 0.1132 t 767 new 0.29) lr 1.00e-05 gnorm 0.091 5.80s mem 15.6GB +step 372/5000 loss 0.1133 (w 0.1251 mse 0.1217 t 923 new 0.23) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 373/5000 loss 0.0597 (w 0.0769 mse 0.0733 t 877 new 0.26) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 374/5000 loss 0.0704 (w 0.0648 mse 0.0631 t 718 new 0.26) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 375/5000 loss 0.0626 (w 0.1624 mse 0.1644 t 959 new 0.18) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 376/5000 loss 0.0737 (w 0.0330 mse 0.0321 t 830 new 0.23) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 377/5000 loss 0.1495 (w 0.5802 mse 0.5930 t 53 new 0.29) lr 1.00e-05 gnorm 0.110 5.70s mem 15.6GB +step 378/5000 loss 0.0688 (w 0.0772 mse 0.0709 t 771 new 0.23) lr 1.00e-05 gnorm 0.134 5.69s mem 15.6GB +step 379/5000 loss 0.0600 (w 0.1034 mse 0.0943 t 909 new 0.22) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 380/5000 loss 0.0823 (w 0.0940 mse 0.0952 t 968 new 0.12) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 381/5000 loss 0.1509 (w 0.0855 mse 0.0868 t 925 new 0.22) lr 1.00e-05 gnorm 0.130 5.69s mem 15.6GB +step 382/5000 loss 0.1129 (w 0.0703 mse 0.0660 t 522 new 0.25) lr 1.00e-05 gnorm 0.084 5.91s mem 15.6GB +step 383/5000 loss 0.0933 (w 0.1167 mse 0.1143 t 577 new 0.18) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +step 384/5000 loss 0.1232 (w 0.1375 mse 0.1408 t 314 new 0.20) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +step 385/5000 loss 0.0983 (w 0.0681 mse 0.0642 t 860 new 0.19) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 386/5000 loss 0.0937 (w 0.1060 mse 0.1041 t 907 new 0.20) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 387/5000 loss 0.1119 (w 0.0713 mse 0.0710 t 533 new 0.25) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 388/5000 loss 0.1049 (w 0.1020 mse 0.0951 t 721 new 0.29) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 389/5000 loss 0.0804 (w 0.0905 mse 0.0892 t 964 new 0.22) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 390/5000 loss 0.0654 (w 0.0865 mse 0.0830 t 747 new 0.24) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +step 391/5000 loss 0.1343 (w 0.0746 mse 0.0732 t 842 new 0.13) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 392/5000 loss 0.0997 (w 0.1139 mse 0.1081 t 962 new 0.25) lr 1.00e-05 gnorm 0.065 5.86s mem 15.6GB +step 393/5000 loss 0.1201 (w 0.3632 mse 0.3593 t 138 new 0.21) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +step 394/5000 loss 0.0851 (w 0.0877 mse 0.0854 t 488 new 0.29) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +step 395/5000 loss 0.1249 (w 0.2209 mse 0.2128 t 988 new 0.19) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 396/5000 loss 0.1073 (w 0.3139 mse 0.3101 t 995 new 0.12) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 397/5000 loss 0.0736 (w 0.0738 mse 0.0705 t 877 new 0.13) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 398/5000 loss 0.1159 (w 0.1203 mse 0.1182 t 347 new 0.15) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 399/5000 loss 0.0762 (w 0.0431 mse 0.0459 t 482 new 0.13) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 400/5000 loss 0.1097 (w 0.1268 mse 0.1249 t 763 new 0.23) lr 1.00e-05 gnorm 0.074 5.85s mem 15.6GB +step 401/5000 loss 0.1205 (w 0.0669 mse 0.0654 t 769 new 0.23) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 402/5000 loss 0.1097 (w 0.1923 mse 0.1923 t 985 new 0.23) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 403/5000 loss 0.0939 (w 0.1045 mse 0.1050 t 592 new 0.15) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 404/5000 loss 0.0948 (w 0.0497 mse 0.0493 t 549 new 0.15) lr 1.00e-05 gnorm 0.097 5.70s mem 15.6GB +step 405/5000 loss 0.0845 (w 0.0683 mse 0.0663 t 854 new 0.21) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +step 406/5000 loss 0.1057 (w 0.0661 mse 0.0627 t 878 new 0.25) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 407/5000 loss 0.0581 (w 0.0969 mse 0.0982 t 948 new 0.13) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 408/5000 loss 0.0795 (w 0.0723 mse 0.0673 t 818 new 0.28) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 409/5000 loss 0.1140 (w 0.0676 mse 0.0672 t 619 new 0.17) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 410/5000 loss 0.0899 (w 0.0649 mse 0.0633 t 901 new 0.26) lr 1.00e-05 gnorm 0.081 5.87s mem 15.6GB +step 411/5000 loss 0.0958 (w 0.0695 mse 0.0677 t 596 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 412/5000 loss 0.0630 (w 0.1894 mse 0.1902 t 984 new 0.12) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 413/5000 loss 0.0731 (w 0.2545 mse 0.2309 t 999 new 0.19) lr 1.00e-05 gnorm 0.074 5.95s mem 15.6GB +step 414/5000 loss 0.1120 (w 0.0875 mse 0.0852 t 889 new 0.20) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 415/5000 loss 0.1005 (w 0.0783 mse 0.0704 t 719 new 0.18) lr 1.00e-05 gnorm 0.097 5.68s mem 15.6GB +step 416/5000 loss 0.1035 (w 0.0894 mse 0.0866 t 934 new 0.25) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 417/5000 loss 0.0971 (w 0.1039 mse 0.1003 t 443 new 0.22) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 418/5000 loss 0.0637 (w 0.1054 mse 0.1022 t 952 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 419/5000 loss 0.0779 (w 0.0828 mse 0.0786 t 913 new 0.20) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 420/5000 loss 0.1021 (w 0.0608 mse 0.0602 t 556 new 0.25) lr 1.00e-05 gnorm 0.094 5.68s mem 15.6GB +step 421/5000 loss 0.0676 (w 0.0497 mse 0.0525 t 403 new 0.17) lr 1.00e-05 gnorm 0.072 5.90s mem 15.6GB +step 422/5000 loss 0.1204 (w 0.0861 mse 0.0910 t 712 new 0.28) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +step 423/5000 loss 0.1030 (w 0.1035 mse 0.0996 t 887 new 0.17) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 424/5000 loss 0.0876 (w 0.0354 mse 0.0381 t 744 new 0.12) lr 1.00e-05 gnorm 0.088 5.88s mem 15.6GB +step 425/5000 loss 0.1303 (w 0.0615 mse 0.0593 t 687 new 0.26) lr 1.00e-05 gnorm 0.107 5.69s mem 15.6GB +step 426/5000 loss 0.0813 (w 0.0598 mse 0.0600 t 532 new 0.26) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 427/5000 loss 0.1244 (w 0.0997 mse 0.0906 t 584 new 0.20) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 428/5000 loss 0.0691 (w 0.1347 mse 0.1238 t 962 new 0.26) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 429/5000 loss 0.1066 (w 0.1544 mse 0.1513 t 991 new 0.22) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 430/5000 loss 0.0961 (w 0.0952 mse 0.0862 t 893 new 0.28) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +step 431/5000 loss 0.0917 (w 0.0887 mse 0.0871 t 823 new 0.20) lr 1.00e-05 gnorm 0.095 6.10s mem 15.6GB +step 432/5000 loss 0.1187 (w 0.0678 mse 0.0614 t 725 new 0.22) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 433/5000 loss 0.0888 (w 0.0670 mse 0.0641 t 672 new 0.26) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 434/5000 loss 0.0576 (w 0.0755 mse 0.0770 t 888 new 0.16) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 435/5000 loss 0.0772 (w 0.0921 mse 0.0895 t 434 new 0.19) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 436/5000 loss 0.1256 (w 0.0830 mse 0.0809 t 736 new 0.20) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 437/5000 loss 0.0723 (w 0.0956 mse 0.0937 t 699 new 0.21) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +step 438/5000 loss 0.0759 (w 0.1163 mse 0.1197 t 294 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 439/5000 loss 0.0414 (w 0.2682 mse 0.2682 t 996 new 0.26) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 440/5000 loss 0.1258 (w 0.1777 mse 0.1690 t 962 new 0.24) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 441/5000 loss 0.0857 (w 0.0821 mse 0.0805 t 465 new 0.25) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 442/5000 loss 0.1562 (w 0.1389 mse 0.1321 t 681 new 0.28) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +step 443/5000 loss 0.0739 (w 0.0461 mse 0.0447 t 893 new 0.22) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 444/5000 loss 0.0582 (w 0.0326 mse 0.0369 t 451 new 0.14) lr 1.00e-05 gnorm 0.072 5.83s mem 15.6GB +step 445/5000 loss 0.0932 (w 0.1131 mse 0.1117 t 744 new 0.30) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 446/5000 loss 0.1138 (w 0.0706 mse 0.0700 t 692 new 0.28) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 447/5000 loss 0.0658 (w 0.0475 mse 0.0510 t 883 new 0.26) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 448/5000 loss 0.1172 (w 0.0912 mse 0.0880 t 455 new 0.24) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 449/5000 loss 0.1310 (w 0.1091 mse 0.1033 t 875 new 0.25) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 450/5000 loss 0.0982 (w 0.0625 mse 0.0609 t 600 new 0.25) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 451/5000 loss 0.1126 (w 0.0550 mse 0.0520 t 949 new 0.16) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 452/5000 loss 0.1332 (w 0.0846 mse 0.0795 t 506 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 453/5000 loss 0.0883 (w 0.0683 mse 0.0685 t 617 new 0.20) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 454/5000 loss 0.0836 (w 0.0961 mse 0.0938 t 817 new 0.30) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 455/5000 loss 0.0784 (w 0.0914 mse 0.0886 t 606 new 0.15) lr 1.00e-05 gnorm 0.068 5.94s mem 15.6GB +step 456/5000 loss 0.1331 (w 0.1443 mse 0.1381 t 372 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 457/5000 loss 0.1104 (w 0.1379 mse 0.1300 t 970 new 0.17) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 458/5000 loss 0.0884 (w 0.0577 mse 0.0579 t 806 new 0.10) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 459/5000 loss 0.0792 (w 0.0966 mse 0.0886 t 634 new 0.25) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +step 460/5000 loss 0.0767 (w 0.0745 mse 0.0713 t 786 new 0.24) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 461/5000 loss 0.1035 (w 0.1449 mse 0.1382 t 982 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 462/5000 loss 0.1382 (w 0.1123 mse 0.1015 t 939 new 0.25) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 463/5000 loss 0.0826 (w 0.0976 mse 0.0930 t 931 new 0.28) lr 1.00e-05 gnorm 0.082 5.92s mem 15.6GB +step 464/5000 loss 0.0662 (w 0.8960 mse 0.9018 t 20 new 0.29) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 465/5000 loss 0.1133 (w 0.0552 mse 0.0512 t 659 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 466/5000 loss 0.1106 (w 0.0936 mse 0.0861 t 894 new 0.25) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 467/5000 loss 0.0829 (w 0.1010 mse 0.0956 t 898 new 0.26) lr 1.00e-05 gnorm 0.097 5.70s mem 15.6GB +step 468/5000 loss 0.1272 (w 0.1857 mse 0.1900 t 187 new 0.12) lr 1.00e-05 gnorm 0.073 5.79s mem 15.6GB +step 469/5000 loss 0.0700 (w 0.0444 mse 0.0487 t 794 new 0.13) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 470/5000 loss 0.0684 (w 0.0836 mse 0.0804 t 902 new 0.28) lr 1.00e-05 gnorm 0.110 5.69s mem 15.6GB +step 471/5000 loss 0.1109 (w 0.0665 mse 0.0638 t 859 new 0.18) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 472/5000 loss 0.1243 (w 0.5716 mse 0.5661 t 71 new 0.24) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 473/5000 loss 0.0952 (w 0.0724 mse 0.0727 t 785 new 0.27) lr 1.00e-05 gnorm 0.099 5.70s mem 15.6GB +step 474/5000 loss 0.1011 (w 0.2056 mse 0.1950 t 235 new 0.27) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 475/5000 loss 0.0973 (w 0.1840 mse 0.1818 t 975 new 0.12) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +step 476/5000 loss 0.1035 (w 0.1369 mse 0.1346 t 336 new 0.31) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 477/5000 loss 0.0850 (w 0.2044 mse 0.2066 t 169 new 0.11) lr 1.00e-05 gnorm 0.057 5.92s mem 15.6GB +step 478/5000 loss 0.0946 (w 0.1478 mse 0.1378 t 958 new 0.26) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 479/5000 loss 0.1070 (w 0.0842 mse 0.0854 t 904 new 0.20) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 480/5000 loss 0.1057 (w 0.0926 mse 0.0851 t 794 new 0.17) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 481/5000 loss 0.1124 (w 0.0997 mse 0.0924 t 861 new 0.26) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 482/5000 loss 0.1525 (w 0.0693 mse 0.0698 t 709 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 483/5000 loss 0.0738 (w 0.2045 mse 0.1994 t 996 new 0.23) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 484/5000 loss 0.0895 (w 0.0545 mse 0.0551 t 707 new 0.10) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 485/5000 loss 0.1007 (w 0.0531 mse 0.0543 t 877 new 0.17) lr 1.00e-05 gnorm 0.084 5.91s mem 15.6GB +step 486/5000 loss 0.0740 (w 0.1093 mse 0.1036 t 885 new 0.19) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +step 487/5000 loss 0.0485 (w 0.0464 mse 0.0432 t 846 new 0.11) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 488/5000 loss 0.1172 (w 0.0846 mse 0.0772 t 785 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 489/5000 loss 0.0345 (w 0.0326 mse 0.0353 t 852 new 0.17) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 490/5000 loss 0.0732 (w 0.2370 mse 0.2320 t 982 new 0.20) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 491/5000 loss 0.1021 (w 0.0647 mse 0.0661 t 826 new 0.22) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 492/5000 loss 0.0906 (w 0.6831 mse 0.6881 t 43 new 0.29) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 493/5000 loss 0.1033 (w 0.1221 mse 0.1148 t 950 new 0.32) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 494/5000 loss 0.0580 (w 0.0699 mse 0.0709 t 565 new 0.25) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 495/5000 loss 0.0877 (w 0.0532 mse 0.0525 t 774 new 0.25) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 496/5000 loss 0.0591 (w 0.0657 mse 0.0631 t 917 new 0.11) lr 1.00e-05 gnorm 0.064 5.71s mem 15.6GB +step 497/5000 loss 0.0606 (w 0.0732 mse 0.0724 t 656 new 0.20) lr 1.00e-05 gnorm 0.074 5.92s mem 15.6GB +step 498/5000 loss 0.0447 (w 0.1233 mse 0.1177 t 921 new 0.25) lr 1.00e-05 gnorm 0.074 5.72s mem 15.6GB +step 499/5000 loss 0.0928 (w 0.0643 mse 0.0678 t 707 new 0.25) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +step 500/5000 loss 0.1146 (w 0.0986 mse 0.0977 t 556 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[val] step 500 t=201: w=0.1849 mse=0.1875 (n=16) t=501: w=0.0767 mse=0.0767 (n=16) t=800: w=0.0655 mse=0.0646 (n=16) | mean w=0.1090 mse=0.1096 5s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step500.safetensors 832 个张量 2.87 GB +step 501/5000 loss 0.1118 (w 0.0805 mse 0.0797 t 484 new 0.28) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 502/5000 loss 0.0542 (w 0.1100 mse 0.1188 t 964 new 0.24) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 503/5000 loss 0.0671 (w 0.0375 mse 0.0389 t 839 new 0.10) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +step 504/5000 loss 0.0833 (w 0.0441 mse 0.0462 t 537 new 0.08) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 505/5000 loss 0.1039 (w 0.1398 mse 0.1355 t 966 new 0.28) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 506/5000 loss 0.0773 (w 0.0509 mse 0.0493 t 769 new 0.16) lr 1.00e-05 gnorm 0.072 5.72s mem 15.6GB +step 507/5000 loss 0.1292 (w 0.0755 mse 0.0828 t 967 new 0.22) lr 1.00e-05 gnorm 0.078 5.67s mem 15.6GB +step 508/5000 loss 0.1418 (w 0.1293 mse 0.1411 t 161 new 0.20) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 509/5000 loss 0.0933 (w 0.0858 mse 0.0831 t 486 new 0.24) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 510/5000 loss 0.0638 (w 0.1990 mse 0.1886 t 989 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 511/5000 loss 0.1041 (w 0.1252 mse 0.1216 t 973 new 0.24) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +step 512/5000 loss 0.0984 (w 0.0861 mse 0.0838 t 865 new 0.26) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 513/5000 loss 0.1127 (w 0.2119 mse 0.2275 t 161 new 0.21) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 514/5000 loss 0.0883 (w 0.0631 mse 0.0592 t 751 new 0.23) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 515/5000 loss 0.1440 (w 0.0818 mse 0.0774 t 655 new 0.30) lr 1.00e-05 gnorm 0.096 5.68s mem 15.6GB +step 516/5000 loss 0.0942 (w 0.1304 mse 0.1257 t 967 new 0.26) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 517/5000 loss 0.0652 (w 0.1543 mse 0.1428 t 951 new 0.30) lr 1.00e-05 gnorm 0.096 5.72s mem 15.6GB +step 518/5000 loss 0.0871 (w 0.0861 mse 0.0813 t 663 new 0.25) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 519/5000 loss 0.1040 (w 0.2652 mse 0.2438 t 999 new 0.19) lr 1.00e-05 gnorm 0.101 5.69s mem 15.6GB +step 520/5000 loss 0.0972 (w 0.1694 mse 0.1613 t 987 new 0.25) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 521/5000 loss 0.1209 (w 0.2338 mse 0.2370 t 169 new 0.13) lr 1.00e-05 gnorm 0.104 5.68s mem 15.6GB +step 522/5000 loss 0.1220 (w 0.0629 mse 0.0686 t 926 new 0.19) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +step 523/5000 loss 0.0420 (w 0.1327 mse 0.1308 t 962 new 0.21) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 524/5000 loss 0.0631 (w 0.3458 mse 0.3477 t 997 new 0.13) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 525/5000 loss 0.0755 (w 0.0414 mse 0.0424 t 774 new 0.13) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +step 526/5000 loss 0.0537 (w 0.0884 mse 0.0883 t 890 new 0.26) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 527/5000 loss 0.1633 (w 0.0735 mse 0.0688 t 904 new 0.23) lr 1.00e-05 gnorm 0.094 5.68s mem 15.6GB +step 528/5000 loss 0.0888 (w 0.1496 mse 0.1591 t 194 new 0.29) lr 1.00e-05 gnorm 0.106 5.67s mem 15.6GB +step 529/5000 loss 0.0694 (w 0.2733 mse 0.2853 t 989 new 0.22) lr 1.00e-05 gnorm 0.073 5.83s mem 15.6GB +step 530/5000 loss 0.0839 (w 0.1164 mse 0.1125 t 932 new 0.19) lr 1.00e-05 gnorm 0.105 5.69s mem 15.6GB +step 531/5000 loss 0.1148 (w 0.0638 mse 0.0652 t 890 new 0.20) lr 1.00e-05 gnorm 0.079 5.74s mem 15.6GB +step 532/5000 loss 0.1191 (w 0.0822 mse 0.0747 t 873 new 0.16) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 533/5000 loss 0.0986 (w 0.2901 mse 0.3449 t 34 new 0.22) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 534/5000 loss 0.0889 (w 0.0529 mse 0.0566 t 745 new 0.19) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 535/5000 loss 0.1140 (w 0.2517 mse 0.2596 t 157 new 0.21) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +step 536/5000 loss 0.1200 (w 0.1096 mse 0.1087 t 964 new 0.10) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 537/5000 loss 0.1059 (w 0.1130 mse 0.1100 t 325 new 0.23) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 538/5000 loss 0.0846 (w 0.1101 mse 0.1003 t 935 new 0.27) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 539/5000 loss 0.0957 (w 0.0825 mse 0.0814 t 912 new 0.10) lr 1.00e-05 gnorm 0.073 5.89s mem 15.6GB +step 540/5000 loss 0.1128 (w 0.1150 mse 0.1129 t 336 new 0.26) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 541/5000 loss 0.0975 (w 0.1215 mse 0.1128 t 944 new 0.22) lr 1.00e-05 gnorm 0.085 5.91s mem 15.6GB +step 542/5000 loss 0.0925 (w 0.0683 mse 0.0702 t 924 new 0.16) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 543/5000 loss 0.0527 (w 0.0938 mse 0.0903 t 792 new 0.24) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 544/5000 loss 0.0860 (w 0.2224 mse 0.2000 t 990 new 0.23) lr 1.00e-05 gnorm 0.109 5.69s mem 15.6GB +step 545/5000 loss 0.1062 (w 0.4932 mse 0.5008 t 80 new 0.31) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 546/5000 loss 0.0871 (w 0.0340 mse 0.0338 t 794 new 0.11) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 547/5000 loss 0.1085 (w 0.1020 mse 0.1011 t 855 new 0.21) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 548/5000 loss 0.0922 (w 0.1034 mse 0.1007 t 670 new 0.22) lr 1.00e-05 gnorm 0.080 5.90s mem 15.6GB +step 549/5000 loss 0.0650 (w 0.1234 mse 0.1130 t 817 new 0.23) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 550/5000 loss 0.0729 (w 0.0834 mse 0.0805 t 781 new 0.21) lr 1.00e-05 gnorm 0.101 5.71s mem 15.6GB +step 551/5000 loss 0.0672 (w 0.0607 mse 0.0595 t 859 new 0.22) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 552/5000 loss 0.0951 (w 0.1636 mse 0.1485 t 978 new 0.22) lr 1.00e-05 gnorm 0.100 5.79s mem 15.6GB +step 553/5000 loss 0.1269 (w 0.6209 mse 0.6157 t 53 new 0.31) lr 1.00e-05 gnorm 0.098 5.68s mem 15.6GB +step 554/5000 loss 0.1054 (w 0.0885 mse 0.0856 t 893 new 0.30) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 555/5000 loss 0.0855 (w 0.0705 mse 0.0714 t 888 new 0.21) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 556/5000 loss 0.0829 (w 0.1088 mse 0.0960 t 937 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 557/5000 loss 0.1116 (w 0.2838 mse 0.2995 t 114 new 0.17) lr 1.00e-05 gnorm 0.103 5.68s mem 15.6GB +step 558/5000 loss 0.0991 (w 0.1416 mse 0.1322 t 960 new 0.23) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 559/5000 loss 0.1190 (w 0.0545 mse 0.0497 t 858 new 0.25) lr 1.00e-05 gnorm 0.068 6.09s mem 15.6GB +step 560/5000 loss 0.0569 (w 0.0882 mse 0.0844 t 954 new 0.24) lr 1.00e-05 gnorm 0.076 5.89s mem 15.6GB +step 561/5000 loss 0.1477 (w 0.3822 mse 0.3877 t 93 new 0.28) lr 1.00e-05 gnorm 0.093 5.75s mem 15.6GB +step 562/5000 loss 0.0863 (w 0.1407 mse 0.1411 t 408 new 0.30) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 563/5000 loss 0.1356 (w 0.0673 mse 0.0649 t 786 new 0.25) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 564/5000 loss 0.0881 (w 0.0730 mse 0.0660 t 724 new 0.23) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 565/5000 loss 0.0716 (w 0.1834 mse 0.1781 t 258 new 0.24) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 566/5000 loss 0.0776 (w 0.0642 mse 0.0646 t 927 new 0.17) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 567/5000 loss 0.1326 (w 0.1155 mse 0.1115 t 681 new 0.29) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 568/5000 loss 0.0712 (w 0.0523 mse 0.0526 t 896 new 0.27) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 569/5000 loss 0.1269 (w 0.1029 mse 0.0978 t 528 new 0.27) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 570/5000 loss 0.0557 (w 0.1262 mse 0.1181 t 934 new 0.21) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 571/5000 loss 0.0504 (w 0.0758 mse 0.0746 t 776 new 0.23) lr 1.00e-05 gnorm 0.076 5.92s mem 15.6GB +step 572/5000 loss 0.0767 (w 0.0535 mse 0.0513 t 476 new 0.18) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 573/5000 loss 0.1000 (w 0.0985 mse 0.0922 t 933 new 0.13) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 574/5000 loss 0.1314 (w 0.0979 mse 0.0965 t 430 new 0.27) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 575/5000 loss 0.0750 (w 0.1144 mse 0.1125 t 975 new 0.24) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 576/5000 loss 0.1078 (w 0.1138 mse 0.1086 t 571 new 0.29) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 577/5000 loss 0.1015 (w 0.1151 mse 0.1098 t 953 new 0.28) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 578/5000 loss 0.1160 (w 0.0727 mse 0.0706 t 693 new 0.26) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 579/5000 loss 0.0876 (w 0.1470 mse 0.1498 t 969 new 0.21) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 580/5000 loss 0.1259 (w 0.0733 mse 0.0754 t 475 new 0.26) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 581/5000 loss 0.1108 (w 0.0705 mse 0.0660 t 808 new 0.26) lr 1.00e-05 gnorm 0.081 5.75s mem 15.6GB +step 582/5000 loss 0.0750 (w 0.2453 mse 0.2307 t 983 new 0.28) lr 1.00e-05 gnorm 0.066 5.76s mem 15.6GB +step 583/5000 loss 0.0661 (w 0.0922 mse 0.0899 t 951 new 0.23) lr 1.00e-05 gnorm 0.078 5.94s mem 15.6GB +step 584/5000 loss 0.0782 (w 0.1180 mse 0.1272 t 986 new 0.19) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 585/5000 loss 0.1467 (w 0.0617 mse 0.0598 t 883 new 0.12) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +step 586/5000 loss 0.0724 (w 0.1634 mse 0.1627 t 975 new 0.23) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +step 587/5000 loss 0.0853 (w 0.1883 mse 0.1712 t 997 new 0.26) lr 1.00e-05 gnorm 0.077 5.71s mem 15.6GB +step 588/5000 loss 0.0759 (w 0.3367 mse 0.3427 t 989 new 0.19) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 589/5000 loss 0.0844 (w 0.0897 mse 0.0909 t 849 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 590/5000 loss 0.1527 (w 0.0890 mse 0.0882 t 912 new 0.23) lr 1.00e-05 gnorm 0.072 5.80s mem 15.6GB +step 591/5000 loss 0.1763 (w 0.0733 mse 0.0701 t 658 new 0.26) lr 1.00e-05 gnorm 0.108 5.79s mem 15.6GB +step 592/5000 loss 0.0664 (w 0.0865 mse 0.0855 t 871 new 0.25) lr 1.00e-05 gnorm 0.082 5.67s mem 15.6GB +step 593/5000 loss 0.1018 (w 0.1505 mse 0.1491 t 938 new 0.22) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 594/5000 loss 0.0796 (w 0.0876 mse 0.0831 t 901 new 0.28) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 595/5000 loss 0.0914 (w 0.0475 mse 0.0466 t 788 new 0.28) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 596/5000 loss 0.0664 (w 0.0502 mse 0.0520 t 866 new 0.28) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 597/5000 loss 0.0740 (w 0.0564 mse 0.0560 t 783 new 0.29) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 598/5000 loss 0.0943 (w 0.1086 mse 0.1049 t 947 new 0.25) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 599/5000 loss 0.0821 (w 0.1080 mse 0.0997 t 938 new 0.28) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 600/5000 loss 0.1308 (w 0.1270 mse 0.1217 t 312 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 601/5000 loss 0.0726 (w 0.1558 mse 0.1410 t 991 new 0.28) lr 1.00e-05 gnorm 0.075 5.86s mem 15.6GB +step 602/5000 loss 0.0964 (w 0.0618 mse 0.0627 t 747 new 0.26) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 603/5000 loss 0.0678 (w 0.0684 mse 0.0728 t 949 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 604/5000 loss 0.0981 (w 0.0681 mse 0.0689 t 857 new 0.17) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 605/5000 loss 0.0473 (w 0.0799 mse 0.0717 t 961 new 0.24) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 606/5000 loss 0.1065 (w 0.0745 mse 0.0727 t 926 new 0.17) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 607/5000 loss 0.0558 (w 0.0284 mse 0.0313 t 748 new 0.21) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 608/5000 loss 0.1260 (w 0.0932 mse 0.0944 t 690 new 0.24) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 609/5000 loss 0.1543 (w 0.1337 mse 0.1240 t 965 new 0.26) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 610/5000 loss 0.0933 (w 0.6530 mse 0.6807 t 25 new 0.20) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 611/5000 loss 0.0643 (w 0.1532 mse 0.1451 t 978 new 0.27) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 612/5000 loss 0.1186 (w 0.1304 mse 0.1284 t 969 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 613/5000 loss 0.0915 (w 0.1120 mse 0.1171 t 403 new 0.21) lr 1.00e-05 gnorm 0.052 5.89s mem 15.6GB +step 614/5000 loss 0.0937 (w 0.1180 mse 0.1258 t 267 new 0.15) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 615/5000 loss 0.0984 (w 0.0999 mse 0.0931 t 859 new 0.21) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 616/5000 loss 0.0924 (w 0.0620 mse 0.0601 t 748 new 0.17) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 617/5000 loss 0.0794 (w 0.1241 mse 0.1195 t 896 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 618/5000 loss 0.0757 (w 0.2431 mse 0.2338 t 990 new 0.25) lr 1.00e-05 gnorm 0.099 5.68s mem 15.6GB +step 619/5000 loss 0.0867 (w 0.0559 mse 0.0569 t 726 new 0.23) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +step 620/5000 loss 0.1122 (w 0.1013 mse 0.0969 t 739 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 621/5000 loss 0.1340 (w 0.0618 mse 0.0638 t 556 new 0.23) lr 1.00e-05 gnorm 0.088 5.70s mem 15.6GB +step 622/5000 loss 0.0653 (w 0.0386 mse 0.0408 t 758 new 0.27) lr 1.00e-05 gnorm 0.095 5.85s mem 15.6GB +step 623/5000 loss 0.0571 (w 0.0929 mse 0.0853 t 897 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 624/5000 loss 0.0723 (w 0.0533 mse 0.0528 t 899 new 0.23) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 625/5000 loss 0.0869 (w 0.1263 mse 0.1246 t 201 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 626/5000 loss 0.0681 (w 0.0504 mse 0.0545 t 535 new 0.27) lr 1.00e-05 gnorm 0.129 5.81s mem 15.6GB +step 627/5000 loss 0.0465 (w 0.0538 mse 0.0512 t 920 new 0.19) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 628/5000 loss 0.0523 (w 0.0827 mse 0.0811 t 947 new 0.13) lr 1.00e-05 gnorm 0.118 5.68s mem 15.6GB +step 629/5000 loss 0.0693 (w 0.0342 mse 0.0365 t 909 new 0.11) lr 1.00e-05 gnorm 0.104 5.69s mem 15.6GB +step 630/5000 loss 0.0596 (w 0.1150 mse 0.1174 t 966 new 0.24) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 631/5000 loss 0.1070 (w 0.1093 mse 0.0972 t 900 new 0.26) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 632/5000 loss 0.1195 (w 0.2659 mse 0.2678 t 986 new 0.25) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 633/5000 loss 0.0976 (w 0.0505 mse 0.0522 t 769 new 0.18) lr 1.00e-05 gnorm 0.088 5.88s mem 15.6GB +step 634/5000 loss 0.0824 (w 0.1242 mse 0.1209 t 966 new 0.14) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 635/5000 loss 0.0649 (w 0.0660 mse 0.0619 t 893 new 0.26) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +step 636/5000 loss 0.0918 (w 0.9861 mse 0.9891 t 5 new 0.18) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 637/5000 loss 0.1042 (w 0.0680 mse 0.0662 t 560 new 0.23) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 638/5000 loss 0.1313 (w 0.1386 mse 0.1406 t 360 new 0.10) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 639/5000 loss 0.1292 (w 0.1100 mse 0.1124 t 475 new 0.18) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 640/5000 loss 0.0586 (w 0.0935 mse 0.0897 t 855 new 0.24) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 641/5000 loss 0.0860 (w 0.0506 mse 0.0464 t 490 new 0.12) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +step 642/5000 loss 0.0789 (w 0.1309 mse 0.1222 t 936 new 0.23) lr 1.00e-05 gnorm 0.069 5.80s mem 15.6GB +step 643/5000 loss 0.0949 (w 0.2544 mse 0.2543 t 126 new 0.25) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 644/5000 loss 0.1315 (w 0.0997 mse 0.0953 t 695 new 0.25) lr 1.00e-05 gnorm 0.066 5.78s mem 15.6GB +step 645/5000 loss 0.0728 (w 0.0680 mse 0.0672 t 953 new 0.12) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 646/5000 loss 0.0771 (w 0.1158 mse 0.1105 t 973 new 0.24) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 647/5000 loss 0.1216 (w 0.1133 mse 0.1179 t 288 new 0.22) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +step 648/5000 loss 0.0784 (w 0.3967 mse 0.3859 t 997 new 0.20) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 649/5000 loss 0.0644 (w 0.0287 mse 0.0291 t 839 new 0.13) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 650/5000 loss 0.0683 (w 0.0518 mse 0.0523 t 674 new 0.24) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 651/5000 loss 0.1318 (w 0.1106 mse 0.1093 t 447 new 0.28) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 652/5000 loss 0.1189 (w 0.0788 mse 0.0775 t 663 new 0.22) lr 1.00e-05 gnorm 0.064 5.95s mem 15.6GB +step 653/5000 loss 0.1299 (w 0.1077 mse 0.1016 t 872 new 0.18) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 654/5000 loss 0.0755 (w 0.0713 mse 0.0758 t 908 new 0.26) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 655/5000 loss 0.0772 (w 0.0889 mse 0.0911 t 956 new 0.26) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 656/5000 loss 0.0974 (w 0.0972 mse 0.0959 t 964 new 0.25) lr 1.00e-05 gnorm 0.087 5.74s mem 15.6GB +step 657/5000 loss 0.1030 (w 0.0353 mse 0.0388 t 566 new 0.19) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +step 658/5000 loss 0.1127 (w 0.1478 mse 0.1380 t 953 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 659/5000 loss 0.0705 (w 0.1464 mse 0.1496 t 982 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 660/5000 loss 0.0739 (w 0.1523 mse 0.1457 t 982 new 0.22) lr 1.00e-05 gnorm 0.119 5.69s mem 15.6GB +step 661/5000 loss 0.0702 (w 0.0393 mse 0.0377 t 809 new 0.20) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +step 662/5000 loss 0.0817 (w 0.1220 mse 0.1175 t 871 new 0.26) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 663/5000 loss 0.0863 (w 0.1125 mse 0.1026 t 869 new 0.23) lr 1.00e-05 gnorm 0.086 5.77s mem 15.6GB +step 664/5000 loss 0.0985 (w 0.1008 mse 0.0900 t 855 new 0.20) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 665/5000 loss 0.0695 (w 0.1359 mse 0.1245 t 944 new 0.23) lr 1.00e-05 gnorm 0.114 5.89s mem 15.6GB +step 666/5000 loss 0.1043 (w 0.1199 mse 0.1297 t 222 new 0.26) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 667/5000 loss 0.1169 (w 0.0890 mse 0.0869 t 650 new 0.23) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 668/5000 loss 0.0766 (w 0.0653 mse 0.0680 t 600 new 0.16) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +step 669/5000 loss 0.1172 (w 0.1061 mse 0.0986 t 923 new 0.27) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 670/5000 loss 0.0737 (w 0.0893 mse 0.0805 t 924 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 671/5000 loss 0.0850 (w 0.2230 mse 0.2070 t 990 new 0.22) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +step 672/5000 loss 0.0922 (w 0.0535 mse 0.0504 t 767 new 0.20) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 673/5000 loss 0.0941 (w 0.1188 mse 0.1184 t 716 new 0.23) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 674/5000 loss 0.0471 (w 0.3834 mse 0.3537 t 998 new 0.22) lr 1.00e-05 gnorm 0.061 5.86s mem 15.6GB +step 675/5000 loss 0.0670 (w 0.0436 mse 0.0476 t 891 new 0.15) lr 1.00e-05 gnorm 0.078 5.66s mem 15.6GB +step 676/5000 loss 0.0975 (w 0.0536 mse 0.0536 t 802 new 0.17) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 677/5000 loss 0.0876 (w 0.0533 mse 0.0517 t 787 new 0.14) lr 1.00e-05 gnorm 0.086 5.72s mem 15.6GB +step 678/5000 loss 0.0825 (w 0.0540 mse 0.0489 t 832 new 0.20) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 679/5000 loss 0.0963 (w 0.1533 mse 0.1513 t 965 new 0.28) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 680/5000 loss 0.0868 (w 0.0848 mse 0.0807 t 861 new 0.26) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 681/5000 loss 0.0840 (w 0.0704 mse 0.0683 t 556 new 0.15) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 682/5000 loss 0.0957 (w 0.2704 mse 0.2908 t 101 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 683/5000 loss 0.0857 (w 0.1678 mse 0.1686 t 988 new 0.19) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 684/5000 loss 0.1453 (w 0.0467 mse 0.0449 t 667 new 0.09) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 685/5000 loss 0.0731 (w 0.1457 mse 0.1412 t 401 new 0.27) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 686/5000 loss 0.1242 (w 0.0769 mse 0.0735 t 950 new 0.10) lr 1.00e-05 gnorm 0.065 5.87s mem 15.6GB +step 687/5000 loss 0.0874 (w 0.1834 mse 0.1656 t 983 new 0.16) lr 1.00e-05 gnorm 0.070 5.85s mem 15.6GB +step 688/5000 loss 0.1098 (w 0.0991 mse 0.0954 t 805 new 0.26) lr 1.00e-05 gnorm 0.096 5.94s mem 15.6GB +step 689/5000 loss 0.1226 (w 0.2344 mse 0.2364 t 232 new 0.29) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 690/5000 loss 0.1053 (w 0.0514 mse 0.0536 t 770 new 0.18) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 691/5000 loss 0.0825 (w 0.5287 mse 0.5174 t 48 new 0.26) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 692/5000 loss 0.0518 (w 0.0813 mse 0.0713 t 843 new 0.25) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 693/5000 loss 0.0681 (w 0.1466 mse 0.1390 t 948 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 694/5000 loss 0.0859 (w 0.0526 mse 0.0563 t 608 new 0.24) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 695/5000 loss 0.0702 (w 0.0941 mse 0.0932 t 493 new 0.15) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 696/5000 loss 0.0862 (w 0.0432 mse 0.0450 t 652 new 0.26) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 697/5000 loss 0.1091 (w 0.0597 mse 0.0617 t 742 new 0.23) lr 1.00e-05 gnorm 0.055 5.71s mem 15.6GB +step 698/5000 loss 0.0692 (w 0.0885 mse 0.0874 t 950 new 0.24) lr 1.00e-05 gnorm 0.071 5.71s mem 15.6GB +step 699/5000 loss 0.0725 (w 0.0740 mse 0.0738 t 626 new 0.30) lr 1.00e-05 gnorm 0.077 5.71s mem 15.6GB +step 700/5000 loss 0.0610 (w 0.1475 mse 0.1470 t 970 new 0.27) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 701/5000 loss 0.1147 (w 0.2437 mse 0.2436 t 154 new 0.26) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +step 702/5000 loss 0.0660 (w 0.0728 mse 0.0678 t 891 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 703/5000 loss 0.1079 (w 0.1219 mse 0.1219 t 453 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 704/5000 loss 0.1386 (w 0.0794 mse 0.0846 t 449 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 705/5000 loss 0.1679 (w 0.1355 mse 0.1348 t 312 new 0.27) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 706/5000 loss 0.1154 (w 0.0468 mse 0.0488 t 560 new 0.12) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 707/5000 loss 0.1028 (w 0.1478 mse 0.1370 t 984 new 0.18) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 708/5000 loss 0.0867 (w 0.0839 mse 0.0887 t 935 new 0.20) lr 1.00e-05 gnorm 0.080 5.79s mem 15.6GB +step 709/5000 loss 0.0688 (w 0.0652 mse 0.0611 t 810 new 0.25) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 710/5000 loss 0.1194 (w 0.1608 mse 0.1523 t 966 new 0.22) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 711/5000 loss 0.1103 (w 0.2462 mse 0.2431 t 161 new 0.07) lr 1.00e-05 gnorm 0.066 5.67s mem 15.6GB +step 712/5000 loss 0.0758 (w 0.1957 mse 0.1840 t 1000 new 0.27) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 713/5000 loss 0.0978 (w 0.0736 mse 0.0720 t 858 new 0.16) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 714/5000 loss 0.1133 (w 0.0746 mse 0.0781 t 681 new 0.15) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 715/5000 loss 0.0845 (w 0.2295 mse 0.2214 t 1000 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 716/5000 loss 0.1024 (w 0.0431 mse 0.0423 t 821 new 0.10) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 717/5000 loss 0.0871 (w 0.7149 mse 0.7196 t 20 new 0.24) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 718/5000 loss 0.0786 (w 0.1499 mse 0.1478 t 927 new 0.21) lr 1.00e-05 gnorm 0.069 5.88s mem 15.6GB +step 719/5000 loss 0.0646 (w 0.1404 mse 0.1295 t 948 new 0.19) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 720/5000 loss 0.0947 (w 0.1078 mse 0.0991 t 888 new 0.29) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 721/5000 loss 0.0622 (w 0.5157 mse 0.5762 t 39 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 722/5000 loss 0.1088 (w 0.3256 mse 0.3078 t 996 new 0.31) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 723/5000 loss 0.0753 (w 0.0506 mse 0.0495 t 655 new 0.10) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 724/5000 loss 0.0651 (w 0.0576 mse 0.0591 t 931 new 0.24) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 725/5000 loss 0.0981 (w 0.0804 mse 0.0796 t 414 new 0.30) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 726/5000 loss 0.0859 (w 0.0788 mse 0.0696 t 875 new 0.27) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 727/5000 loss 0.1322 (w 0.0549 mse 0.0551 t 888 new 0.20) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 728/5000 loss 0.0735 (w 0.0325 mse 0.0369 t 375 new 0.22) lr 1.00e-05 gnorm 0.068 5.67s mem 15.6GB +step 729/5000 loss 0.0870 (w 0.0624 mse 0.0629 t 852 new 0.26) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 730/5000 loss 0.1294 (w 0.0865 mse 0.0844 t 405 new 0.20) lr 1.00e-05 gnorm 0.075 5.93s mem 15.6GB +step 731/5000 loss 0.0881 (w 0.0557 mse 0.0595 t 612 new 0.26) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +step 732/5000 loss 0.1080 (w 0.0858 mse 0.0832 t 990 new 0.21) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 733/5000 loss 0.1048 (w 0.0921 mse 0.0988 t 309 new 0.13) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 734/5000 loss 0.0480 (w 0.0996 mse 0.0890 t 969 new 0.18) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 735/5000 loss 0.0841 (w 0.0681 mse 0.0625 t 676 new 0.20) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 736/5000 loss 0.0873 (w 0.1933 mse 0.1899 t 965 new 0.23) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 737/5000 loss 0.0887 (w 0.1016 mse 0.1006 t 349 new 0.27) lr 1.00e-05 gnorm 0.074 5.86s mem 15.6GB +step 738/5000 loss 0.0990 (w 0.0319 mse 0.0326 t 545 new 0.09) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 739/5000 loss 0.0920 (w 0.0710 mse 0.0706 t 543 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 740/5000 loss 0.1393 (w 0.0754 mse 0.0760 t 718 new 0.20) lr 1.00e-05 gnorm 0.083 5.91s mem 15.6GB +step 741/5000 loss 0.0903 (w 0.0730 mse 0.0730 t 767 new 0.25) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 742/5000 loss 0.0869 (w 0.1027 mse 0.1049 t 538 new 0.11) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 743/5000 loss 0.0790 (w 0.0984 mse 0.1011 t 956 new 0.21) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 744/5000 loss 0.1124 (w 0.1657 mse 0.1620 t 956 new 0.15) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 745/5000 loss 0.1231 (w 0.0913 mse 0.0840 t 885 new 0.19) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 746/5000 loss 0.1121 (w 0.0903 mse 0.0853 t 814 new 0.22) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +step 747/5000 loss 0.1079 (w 0.0946 mse 0.0923 t 546 new 0.27) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +step 748/5000 loss 0.1400 (w 0.0563 mse 0.0519 t 908 new 0.24) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 749/5000 loss 0.0928 (w 0.0570 mse 0.0570 t 501 new 0.06) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 750/5000 loss 0.0923 (w 0.0766 mse 0.0716 t 844 new 0.22) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 751/5000 loss 0.0693 (w 0.2068 mse 0.2032 t 965 new 0.23) lr 1.00e-05 gnorm 0.087 5.88s mem 15.6GB +step 752/5000 loss 0.1193 (w 0.0806 mse 0.0805 t 588 new 0.22) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 753/5000 loss 0.1253 (w 0.1304 mse 0.1295 t 372 new 0.14) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 754/5000 loss 0.1149 (w 0.1010 mse 0.1038 t 459 new 0.23) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 755/5000 loss 0.0796 (w 0.1206 mse 0.1166 t 634 new 0.31) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 756/5000 loss 0.0776 (w 0.1492 mse 0.1407 t 961 new 0.19) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 757/5000 loss 0.0817 (w 0.0461 mse 0.0480 t 273 new 0.12) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 758/5000 loss 0.1309 (w 0.0668 mse 0.0668 t 706 new 0.29) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 759/5000 loss 0.0761 (w 0.0633 mse 0.0594 t 667 new 0.18) lr 1.00e-05 gnorm 0.100 5.68s mem 15.6GB +step 760/5000 loss 0.0895 (w 0.0665 mse 0.0646 t 644 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 761/5000 loss 0.0645 (w 0.0868 mse 0.0795 t 911 new 0.23) lr 1.00e-05 gnorm 0.080 5.91s mem 15.6GB +step 762/5000 loss 0.0884 (w 0.0970 mse 0.0935 t 918 new 0.26) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 763/5000 loss 0.1022 (w 0.0782 mse 0.0773 t 753 new 0.25) lr 1.00e-05 gnorm 0.068 5.67s mem 15.6GB +step 764/5000 loss 0.0672 (w 0.0690 mse 0.0626 t 673 new 0.21) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 765/5000 loss 0.0621 (w 0.1247 mse 0.1312 t 955 new 0.26) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 766/5000 loss 0.1188 (w 0.0823 mse 0.0768 t 954 new 0.11) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 767/5000 loss 0.1045 (w 0.0994 mse 0.0899 t 912 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 768/5000 loss 0.0884 (w 0.4140 mse 0.4120 t 80 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 769/5000 loss 0.0828 (w 0.1694 mse 0.1531 t 973 new 0.21) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 770/5000 loss 0.1340 (w 0.2161 mse 0.2185 t 242 new 0.14) lr 1.00e-05 gnorm 0.088 5.98s mem 15.6GB +step 771/5000 loss 0.0644 (w 0.0797 mse 0.0705 t 914 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 772/5000 loss 0.1045 (w 0.0627 mse 0.0622 t 758 new 0.20) lr 1.00e-05 gnorm 0.054 5.81s mem 15.6GB +step 773/5000 loss 0.0935 (w 0.2147 mse 0.2172 t 201 new 0.25) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +step 774/5000 loss 0.1037 (w 0.0498 mse 0.0519 t 979 new 0.13) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 775/5000 loss 0.0846 (w 0.0651 mse 0.0664 t 658 new 0.22) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 776/5000 loss 0.0665 (w 0.0413 mse 0.0402 t 650 new 0.13) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 777/5000 loss 0.1287 (w 0.1015 mse 0.0967 t 739 new 0.22) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 778/5000 loss 0.1126 (w 0.0326 mse 0.0305 t 759 new 0.24) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 779/5000 loss 0.1057 (w 0.0587 mse 0.0604 t 733 new 0.25) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 780/5000 loss 0.0893 (w 0.0732 mse 0.0793 t 362 new 0.26) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 781/5000 loss 0.0803 (w 0.0524 mse 0.0521 t 902 new 0.18) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 782/5000 loss 0.0682 (w 0.1147 mse 0.1104 t 309 new 0.30) lr 1.00e-05 gnorm 0.109 5.94s mem 15.6GB +step 783/5000 loss 0.0488 (w 0.1258 mse 0.1210 t 965 new 0.15) lr 1.00e-05 gnorm 0.073 5.67s mem 15.6GB +step 784/5000 loss 0.0737 (w 0.1879 mse 0.1788 t 981 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 785/5000 loss 0.0965 (w 0.0488 mse 0.0518 t 581 new 0.30) lr 1.00e-05 gnorm 0.111 5.69s mem 15.6GB +step 786/5000 loss 0.0951 (w 0.1237 mse 0.1201 t 924 new 0.21) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 787/5000 loss 0.0825 (w 0.1551 mse 0.1412 t 971 new 0.23) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 788/5000 loss 0.0868 (w 0.0782 mse 0.0721 t 937 new 0.23) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 789/5000 loss 0.1030 (w 0.0826 mse 0.0782 t 882 new 0.26) lr 1.00e-05 gnorm 0.072 5.87s mem 15.6GB +step 790/5000 loss 0.1052 (w 0.1218 mse 0.1233 t 297 new 0.13) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 791/5000 loss 0.0528 (w 0.1629 mse 0.1534 t 957 new 0.27) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 792/5000 loss 0.1037 (w 0.0682 mse 0.0615 t 733 new 0.20) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 793/5000 loss 0.0669 (w 0.2362 mse 0.2197 t 994 new 0.20) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 794/5000 loss 0.0441 (w 0.0688 mse 0.0735 t 883 new 0.19) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 795/5000 loss 0.0433 (w 0.2162 mse 0.1992 t 985 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 796/5000 loss 0.1331 (w 0.0715 mse 0.0755 t 297 new 0.10) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 797/5000 loss 0.1114 (w 0.0344 mse 0.0329 t 706 new 0.21) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 798/5000 loss 0.0861 (w 0.0778 mse 0.0752 t 898 new 0.25) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 799/5000 loss 0.0585 (w 0.0944 mse 0.0914 t 965 new 0.16) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 800/5000 loss 0.0625 (w 0.1111 mse 0.1093 t 717 new 0.23) lr 1.00e-05 gnorm 0.072 5.84s mem 15.6GB +step 801/5000 loss 0.0844 (w 0.1330 mse 0.1266 t 959 new 0.20) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 802/5000 loss 0.0918 (w 0.0643 mse 0.0621 t 742 new 0.23) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +step 803/5000 loss 0.1122 (w 0.0760 mse 0.0698 t 739 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 804/5000 loss 0.0824 (w 0.0583 mse 0.0529 t 758 new 0.25) lr 1.00e-05 gnorm 0.085 5.77s mem 15.6GB +step 805/5000 loss 0.0920 (w 0.0799 mse 0.0746 t 744 new 0.28) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 806/5000 loss 0.0496 (w 0.0676 mse 0.0659 t 802 new 0.21) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 807/5000 loss 0.0642 (w 0.2272 mse 0.2240 t 997 new 0.25) lr 1.00e-05 gnorm 0.111 5.69s mem 15.6GB +step 808/5000 loss 0.0992 (w 0.1688 mse 0.1613 t 951 new 0.17) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 809/5000 loss 0.0814 (w 0.0435 mse 0.0424 t 840 new 0.19) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 810/5000 loss 0.0674 (w 0.0689 mse 0.0637 t 743 new 0.26) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 811/5000 loss 0.0667 (w 0.1316 mse 0.1283 t 985 new 0.27) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 812/5000 loss 0.1253 (w 0.0779 mse 0.0729 t 760 new 0.20) lr 1.00e-05 gnorm 0.083 5.90s mem 15.6GB +step 813/5000 loss 0.0574 (w 0.1325 mse 0.1178 t 969 new 0.22) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 814/5000 loss 0.0740 (w 0.0387 mse 0.0390 t 725 new 0.23) lr 1.00e-05 gnorm 0.059 5.90s mem 15.6GB +step 815/5000 loss 0.1424 (w 0.0675 mse 0.0726 t 394 new 0.25) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 816/5000 loss 0.1366 (w 0.2014 mse 0.2056 t 232 new 0.21) lr 1.00e-05 gnorm 0.071 5.74s mem 15.6GB +step 817/5000 loss 0.0815 (w 0.1502 mse 0.1367 t 927 new 0.24) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 818/5000 loss 0.1169 (w 0.0565 mse 0.0583 t 885 new 0.31) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 819/5000 loss 0.0584 (w 0.1582 mse 0.1516 t 997 new 0.25) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 820/5000 loss 0.0683 (w 0.2310 mse 0.2166 t 1000 new 0.26) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 821/5000 loss 0.0714 (w 0.0786 mse 0.0826 t 637 new 0.18) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 822/5000 loss 0.1114 (w 0.1443 mse 0.1367 t 973 new 0.19) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 823/5000 loss 0.0714 (w 0.1420 mse 0.1316 t 964 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 824/5000 loss 0.0707 (w 0.0771 mse 0.0775 t 796 new 0.08) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 825/5000 loss 0.1545 (w 0.0474 mse 0.0503 t 475 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 826/5000 loss 0.0522 (w 0.0753 mse 0.0727 t 920 new 0.22) lr 1.00e-05 gnorm 0.065 5.88s mem 15.6GB +step 827/5000 loss 0.1069 (w 0.0902 mse 0.0926 t 758 new 0.24) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 828/5000 loss 0.0719 (w 0.0447 mse 0.0450 t 872 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 829/5000 loss 0.0669 (w 0.0682 mse 0.0678 t 591 new 0.17) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 830/5000 loss 0.1154 (w 0.0562 mse 0.0557 t 874 new 0.26) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +step 831/5000 loss 0.0791 (w 0.0292 mse 0.0328 t 777 new 0.16) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 832/5000 loss 0.1050 (w 0.0554 mse 0.0568 t 602 new 0.13) lr 1.00e-05 gnorm 0.069 5.90s mem 15.6GB +step 833/5000 loss 0.1289 (w 0.1058 mse 0.1047 t 430 new 0.26) lr 1.00e-05 gnorm 0.078 5.73s mem 15.6GB +step 834/5000 loss 0.1047 (w 0.0889 mse 0.0828 t 880 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 835/5000 loss 0.0857 (w 0.1323 mse 0.1284 t 966 new 0.18) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 836/5000 loss 0.0514 (w 0.1245 mse 0.1196 t 957 new 0.21) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 837/5000 loss 0.0477 (w 0.0508 mse 0.0517 t 585 new 0.28) lr 1.00e-05 gnorm 0.053 5.74s mem 15.6GB +step 838/5000 loss 0.1242 (w 0.0705 mse 0.0678 t 690 new 0.26) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 839/5000 loss 0.0638 (w 0.0603 mse 0.0605 t 905 new 0.23) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 840/5000 loss 0.1387 (w 0.0829 mse 0.0788 t 660 new 0.26) lr 1.00e-05 gnorm 0.099 5.68s mem 15.6GB +step 841/5000 loss 0.0784 (w 0.1061 mse 0.0982 t 928 new 0.26) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +step 842/5000 loss 0.0812 (w 0.1570 mse 0.1568 t 957 new 0.20) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 843/5000 loss 0.0511 (w 0.0694 mse 0.0711 t 944 new 0.10) lr 1.00e-05 gnorm 0.066 5.96s mem 15.6GB +step 844/5000 loss 0.1588 (w 0.1256 mse 0.1188 t 944 new 0.23) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 845/5000 loss 0.0624 (w 0.2329 mse 0.2221 t 998 new 0.23) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 846/5000 loss 0.1059 (w 0.0867 mse 0.0839 t 936 new 0.19) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 847/5000 loss 0.0733 (w 0.0912 mse 0.0854 t 878 new 0.23) lr 1.00e-05 gnorm 0.063 5.90s mem 15.6GB +step 848/5000 loss 0.1013 (w 0.0976 mse 0.0928 t 610 new 0.26) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 849/5000 loss 0.1126 (w 0.0551 mse 0.0520 t 763 new 0.11) lr 1.00e-05 gnorm 0.089 5.67s mem 15.6GB +step 850/5000 loss 0.0538 (w 0.1795 mse 0.1740 t 956 new 0.20) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 851/5000 loss 0.0960 (w 0.1558 mse 0.1457 t 972 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 852/5000 loss 0.0849 (w 0.0759 mse 0.0736 t 617 new 0.23) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 853/5000 loss 0.0893 (w 0.0590 mse 0.0554 t 765 new 0.17) lr 1.00e-05 gnorm 0.069 5.86s mem 15.6GB +step 854/5000 loss 0.0981 (w 0.0518 mse 0.0506 t 746 new 0.23) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +step 855/5000 loss 0.0595 (w 0.0522 mse 0.0532 t 525 new 0.10) lr 1.00e-05 gnorm 0.065 5.67s mem 15.6GB +step 856/5000 loss 0.0852 (w 0.1035 mse 0.0991 t 921 new 0.19) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 857/5000 loss 0.1596 (w 0.0444 mse 0.0453 t 828 new 0.22) lr 1.00e-05 gnorm 0.100 5.68s mem 15.6GB +step 858/5000 loss 0.0678 (w 0.1673 mse 0.1598 t 980 new 0.27) lr 1.00e-05 gnorm 0.064 5.79s mem 15.6GB +step 859/5000 loss 0.1015 (w 0.0302 mse 0.0352 t 802 new 0.22) lr 1.00e-05 gnorm 0.069 5.67s mem 15.6GB +step 860/5000 loss 0.1198 (w 0.0933 mse 0.0871 t 907 new 0.25) lr 1.00e-05 gnorm 0.119 5.68s mem 15.6GB +step 861/5000 loss 0.0990 (w 0.0679 mse 0.0710 t 767 new 0.14) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 862/5000 loss 0.0925 (w 0.0190 mse 0.0222 t 774 new 0.20) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 863/5000 loss 0.1160 (w 0.1659 mse 0.1569 t 965 new 0.23) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 864/5000 loss 0.0691 (w 0.0721 mse 0.0639 t 894 new 0.16) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 865/5000 loss 0.0710 (w 0.2365 mse 0.2049 t 1000 new 0.28) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 866/5000 loss 0.0923 (w 0.0591 mse 0.0573 t 872 new 0.18) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 867/5000 loss 0.0573 (w 0.0602 mse 0.0678 t 973 new 0.14) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +step 868/5000 loss 0.0701 (w 0.0585 mse 0.0586 t 774 new 0.25) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 869/5000 loss 0.0742 (w 0.0678 mse 0.0619 t 771 new 0.27) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 870/5000 loss 0.0835 (w 0.0687 mse 0.0655 t 651 new 0.20) lr 1.00e-05 gnorm 0.094 5.68s mem 15.6GB +step 871/5000 loss 0.0913 (w 0.0236 mse 0.0267 t 817 new 0.14) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 872/5000 loss 0.1065 (w 0.0805 mse 0.0787 t 537 new 0.15) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 873/5000 loss 0.0874 (w 0.0757 mse 0.0716 t 619 new 0.26) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 874/5000 loss 0.1177 (w 0.2240 mse 0.2095 t 981 new 0.28) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 875/5000 loss 0.0571 (w 0.0765 mse 0.0757 t 527 new 0.23) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 876/5000 loss 0.1091 (w 0.1683 mse 0.1590 t 986 new 0.23) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 877/5000 loss 0.0869 (w 0.0854 mse 0.0807 t 940 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 878/5000 loss 0.0781 (w 0.1300 mse 0.1288 t 261 new 0.09) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 879/5000 loss 0.0489 (w 0.0815 mse 0.0769 t 837 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 880/5000 loss 0.0985 (w 0.1047 mse 0.1061 t 554 new 0.23) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 881/5000 loss 0.0740 (w 0.0596 mse 0.0596 t 779 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 882/5000 loss 0.0591 (w 0.0925 mse 0.0885 t 950 new 0.27) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 883/5000 loss 0.0849 (w 0.1130 mse 0.1075 t 984 new 0.26) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 884/5000 loss 0.0989 (w 0.0654 mse 0.0602 t 916 new 0.18) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 885/5000 loss 0.0558 (w 0.1029 mse 0.0999 t 757 new 0.30) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 886/5000 loss 0.0750 (w 0.1017 mse 0.0980 t 414 new 0.27) lr 1.00e-05 gnorm 0.078 5.85s mem 15.6GB +step 887/5000 loss 0.0783 (w 0.2380 mse 0.2177 t 993 new 0.20) lr 1.00e-05 gnorm 0.108 5.68s mem 15.6GB +step 888/5000 loss 0.1051 (w 0.0954 mse 0.0944 t 421 new 0.20) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 889/5000 loss 0.1054 (w 0.0752 mse 0.0748 t 810 new 0.24) lr 1.00e-05 gnorm 0.091 5.91s mem 15.6GB +step 890/5000 loss 0.0873 (w 0.1696 mse 0.1591 t 983 new 0.25) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 891/5000 loss 0.0600 (w 0.0653 mse 0.0607 t 732 new 0.17) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 892/5000 loss 0.0619 (w 0.1122 mse 0.1104 t 968 new 0.24) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 893/5000 loss 0.0973 (w 0.0961 mse 0.0919 t 776 new 0.12) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 894/5000 loss 0.1013 (w 0.2163 mse 0.2186 t 239 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 895/5000 loss 0.0791 (w 0.2974 mse 0.2954 t 126 new 0.25) lr 1.00e-05 gnorm 0.071 5.79s mem 15.6GB +step 896/5000 loss 0.0764 (w 0.0928 mse 0.0899 t 743 new 0.19) lr 1.00e-05 gnorm 0.084 5.76s mem 15.6GB +step 897/5000 loss 0.1246 (w 0.2727 mse 0.2613 t 154 new 0.25) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 898/5000 loss 0.1136 (w 0.0854 mse 0.0858 t 638 new 0.21) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 899/5000 loss 0.0862 (w 0.0791 mse 0.0788 t 843 new 0.23) lr 1.00e-05 gnorm 0.098 5.69s mem 15.6GB +step 900/5000 loss 0.1120 (w 0.0893 mse 0.0872 t 840 new 0.21) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 901/5000 loss 0.1137 (w 0.0848 mse 0.0791 t 929 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 902/5000 loss 0.0947 (w 0.0689 mse 0.0688 t 875 new 0.26) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 903/5000 loss 0.0561 (w 0.0900 mse 0.0856 t 939 new 0.26) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 904/5000 loss 0.0533 (w 0.1487 mse 0.1454 t 947 new 0.24) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 905/5000 loss 0.0481 (w 0.0636 mse 0.0652 t 876 new 0.16) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 906/5000 loss 0.1067 (w 0.0687 mse 0.0661 t 599 new 0.12) lr 1.00e-05 gnorm 0.087 5.91s mem 15.6GB +step 907/5000 loss 0.0686 (w 0.0679 mse 0.0673 t 768 new 0.26) lr 1.00e-05 gnorm 0.048 5.68s mem 15.6GB +step 908/5000 loss 0.0548 (w 0.1801 mse 0.1770 t 258 new 0.20) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 909/5000 loss 0.1283 (w 0.1886 mse 0.1882 t 291 new 0.28) lr 1.00e-05 gnorm 0.095 5.68s mem 15.6GB +step 910/5000 loss 0.0693 (w 0.1159 mse 0.1053 t 906 new 0.27) lr 1.00e-05 gnorm 0.073 5.89s mem 15.6GB +step 911/5000 loss 0.0960 (w 0.0380 mse 0.0394 t 847 new 0.22) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 912/5000 loss 0.0736 (w 0.0722 mse 0.0732 t 908 new 0.19) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 913/5000 loss 0.1372 (w 0.0883 mse 0.0870 t 530 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 914/5000 loss 0.0938 (w 0.0917 mse 0.1056 t 176 new 0.20) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 915/5000 loss 0.1153 (w 0.0791 mse 0.0753 t 563 new 0.28) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 916/5000 loss 0.1396 (w 0.0568 mse 0.0567 t 813 new 0.15) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 917/5000 loss 0.1043 (w 0.1046 mse 0.0949 t 854 new 0.25) lr 1.00e-05 gnorm 0.062 5.72s mem 15.6GB +step 918/5000 loss 0.0619 (w 0.0686 mse 0.0607 t 749 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 919/5000 loss 0.0840 (w 0.6575 mse 0.7021 t 20 new 0.22) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 920/5000 loss 0.1078 (w 0.1446 mse 0.1524 t 457 new 0.21) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 921/5000 loss 0.0991 (w 0.1208 mse 0.1191 t 999 new 0.26) lr 1.00e-05 gnorm 0.057 5.81s mem 15.6GB +step 922/5000 loss 0.1397 (w 0.1425 mse 0.1369 t 922 new 0.24) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +step 923/5000 loss 0.1005 (w 0.0533 mse 0.0540 t 905 new 0.13) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 924/5000 loss 0.0885 (w 0.0889 mse 0.0881 t 396 new 0.15) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 925/5000 loss 0.1301 (w 0.0809 mse 0.0770 t 892 new 0.24) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 926/5000 loss 0.0950 (w 0.0877 mse 0.0842 t 419 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 927/5000 loss 0.0872 (w 0.1253 mse 0.1184 t 917 new 0.23) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 928/5000 loss 0.0907 (w 0.1036 mse 0.1017 t 955 new 0.18) lr 1.00e-05 gnorm 0.055 5.67s mem 15.6GB +step 929/5000 loss 0.0927 (w 0.1222 mse 0.1107 t 921 new 0.30) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 930/5000 loss 0.0873 (w 0.0594 mse 0.0576 t 739 new 0.22) lr 1.00e-05 gnorm 0.064 5.67s mem 15.6GB +step 931/5000 loss 0.0735 (w 0.1551 mse 0.1491 t 989 new 0.26) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 932/5000 loss 0.0773 (w 0.0841 mse 0.0805 t 803 new 0.23) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 933/5000 loss 0.0771 (w 0.2169 mse 0.2044 t 998 new 0.17) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 934/5000 loss 0.0812 (w 0.5680 mse 0.5647 t 66 new 0.23) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 935/5000 loss 0.0963 (w 0.2729 mse 0.2704 t 146 new 0.25) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 936/5000 loss 0.0917 (w 0.0698 mse 0.0661 t 626 new 0.20) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 937/5000 loss 0.1042 (w 0.0984 mse 0.0975 t 408 new 0.29) lr 1.00e-05 gnorm 0.067 5.67s mem 15.6GB +step 938/5000 loss 0.0558 (w 0.1451 mse 0.1394 t 962 new 0.24) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 939/5000 loss 0.0782 (w 0.0847 mse 0.0782 t 745 new 0.29) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 940/5000 loss 0.1114 (w 0.0821 mse 0.0776 t 768 new 0.20) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 941/5000 loss 0.0909 (w 0.1389 mse 0.1394 t 968 new 0.23) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 942/5000 loss 0.1131 (w 0.0703 mse 0.0666 t 839 new 0.25) lr 1.00e-05 gnorm 0.095 5.93s mem 15.6GB +step 943/5000 loss 0.0699 (w 0.0353 mse 0.0362 t 890 new 0.12) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 944/5000 loss 0.0690 (w 0.1118 mse 0.1094 t 958 new 0.28) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 945/5000 loss 0.1017 (w 0.1721 mse 0.1666 t 984 new 0.17) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 946/5000 loss 0.0915 (w 0.0768 mse 0.0687 t 888 new 0.25) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 947/5000 loss 0.0759 (w 0.0793 mse 0.0726 t 859 new 0.24) lr 1.00e-05 gnorm 0.086 5.74s mem 15.6GB +step 948/5000 loss 0.1053 (w 0.0908 mse 0.0875 t 522 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 949/5000 loss 0.0580 (w 0.1021 mse 0.0926 t 942 new 0.16) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 950/5000 loss 0.1149 (w 0.1598 mse 0.1642 t 276 new 0.17) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 951/5000 loss 0.0707 (w 0.0966 mse 0.0868 t 853 new 0.29) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 952/5000 loss 0.1067 (w 0.1235 mse 0.1169 t 881 new 0.24) lr 1.00e-05 gnorm 0.093 5.93s mem 15.6GB +step 953/5000 loss 0.0506 (w 0.2716 mse 0.2751 t 993 new 0.18) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 954/5000 loss 0.0708 (w 0.1736 mse 0.1688 t 971 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 955/5000 loss 0.0816 (w 0.0521 mse 0.0536 t 748 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 956/5000 loss 0.0771 (w 0.0886 mse 0.0784 t 863 new 0.19) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 957/5000 loss 0.0927 (w 0.0993 mse 0.0955 t 741 new 0.23) lr 1.00e-05 gnorm 0.063 5.91s mem 15.6GB +step 958/5000 loss 0.1569 (w 0.1583 mse 0.1558 t 961 new 0.21) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +step 959/5000 loss 0.0795 (w 0.0971 mse 0.0950 t 919 new 0.23) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 960/5000 loss 0.0929 (w 0.0713 mse 0.0707 t 451 new 0.27) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 961/5000 loss 0.0834 (w 0.0738 mse 0.0737 t 721 new 0.07) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 962/5000 loss 0.0580 (w 0.1196 mse 0.1125 t 971 new 0.11) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 963/5000 loss 0.1058 (w 0.1189 mse 0.1142 t 976 new 0.23) lr 1.00e-05 gnorm 0.085 5.89s mem 15.6GB +step 964/5000 loss 0.0610 (w 0.0912 mse 0.0894 t 839 new 0.21) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 965/5000 loss 0.0950 (w 0.0815 mse 0.0788 t 712 new 0.19) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 966/5000 loss 0.0675 (w 0.0829 mse 0.0830 t 902 new 0.25) lr 1.00e-05 gnorm 0.110 5.69s mem 15.6GB +step 967/5000 loss 0.0684 (w 0.0951 mse 0.0921 t 877 new 0.15) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 968/5000 loss 0.0704 (w 0.1015 mse 0.0985 t 849 new 0.20) lr 1.00e-05 gnorm 0.085 5.73s mem 15.6GB +step 969/5000 loss 0.0862 (w 0.0672 mse 0.0668 t 894 new 0.30) lr 1.00e-05 gnorm 0.095 5.70s mem 15.6GB +step 970/5000 loss 0.0718 (w 0.0221 mse 0.0266 t 846 new 0.22) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 971/5000 loss 0.0826 (w 0.0899 mse 0.0884 t 955 new 0.17) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 972/5000 loss 0.0996 (w 0.0731 mse 0.0726 t 669 new 0.23) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 973/5000 loss 0.1325 (w 0.2157 mse 0.2128 t 273 new 0.24) lr 1.00e-05 gnorm 0.082 5.91s mem 15.6GB +step 974/5000 loss 0.0862 (w 0.0687 mse 0.0625 t 766 new 0.29) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 975/5000 loss 0.1324 (w 0.0175 mse 0.0204 t 710 new 0.18) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 976/5000 loss 0.1126 (w 0.0767 mse 0.0693 t 796 new 0.24) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 977/5000 loss 0.1002 (w 0.1048 mse 0.1029 t 342 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 978/5000 loss 0.0963 (w 0.0587 mse 0.0589 t 781 new 0.24) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 979/5000 loss 0.0816 (w 0.1030 mse 0.0995 t 699 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 980/5000 loss 0.0721 (w 0.0874 mse 0.0854 t 679 new 0.22) lr 1.00e-05 gnorm 0.058 5.82s mem 15.6GB +step 981/5000 loss 0.0660 (w 0.0972 mse 0.0932 t 814 new 0.28) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 982/5000 loss 0.0522 (w 0.0918 mse 0.0902 t 438 new 0.27) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 983/5000 loss 0.1210 (w 0.0955 mse 0.0876 t 940 new 0.13) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +step 984/5000 loss 0.1072 (w 0.0678 mse 0.0701 t 473 new 0.26) lr 1.00e-05 gnorm 0.068 5.87s mem 15.6GB +step 985/5000 loss 0.0606 (w 0.1271 mse 0.1154 t 938 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 986/5000 loss 0.1051 (w 0.0755 mse 0.0722 t 646 new 0.28) lr 1.00e-05 gnorm 0.112 5.69s mem 15.6GB +step 987/5000 loss 0.0856 (w 0.0541 mse 0.0574 t 892 new 0.20) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 988/5000 loss 0.0761 (w 0.1353 mse 0.1373 t 956 new 0.18) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 989/5000 loss 0.1105 (w 0.0917 mse 0.0869 t 486 new 0.21) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 990/5000 loss 0.1326 (w 0.1129 mse 0.1097 t 822 new 0.22) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 991/5000 loss 0.1330 (w 0.0824 mse 0.0800 t 476 new 0.25) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 992/5000 loss 0.0820 (w 0.0881 mse 0.0802 t 798 new 0.23) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 993/5000 loss 0.1111 (w 0.2099 mse 0.2062 t 996 new 0.28) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 994/5000 loss 0.1095 (w 0.0882 mse 0.0826 t 858 new 0.27) lr 1.00e-05 gnorm 0.084 5.80s mem 15.6GB +step 995/5000 loss 0.0752 (w 0.0590 mse 0.0564 t 634 new 0.24) lr 1.00e-05 gnorm 0.093 6.04s mem 15.6GB +step 996/5000 loss 0.0852 (w 0.1134 mse 0.1093 t 910 new 0.20) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 997/5000 loss 0.0567 (w 0.0997 mse 0.0982 t 947 new 0.21) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 998/5000 loss 0.0764 (w 0.1052 mse 0.0958 t 802 new 0.26) lr 1.00e-05 gnorm 0.079 5.67s mem 15.6GB +step 999/5000 loss 0.0856 (w 0.0291 mse 0.0304 t 794 new 0.14) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 1000/5000 loss 0.0858 (w 0.1104 mse 0.1043 t 890 new 0.30) lr 1.00e-05 gnorm 0.055 5.84s mem 15.6GB +[val] step 1000 t=201: w=0.1798 mse=0.1823 (n=16) t=501: w=0.0748 mse=0.0748 (n=16) t=800: w=0.0635 mse=0.0624 (n=16) | mean w=0.1060 mse=0.1065 4s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step1000.safetensors 832 个张量 2.87 GB +step 1001/5000 loss 0.1143 (w 0.1335 mse 0.1288 t 974 new 0.26) lr 1.00e-05 gnorm 0.071 5.66s mem 15.6GB +step 1002/5000 loss 0.0390 (w 0.1113 mse 0.1062 t 887 new 0.31) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 1003/5000 loss 0.0687 (w 0.9330 mse 0.9331 t 15 new 0.20) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 1004/5000 loss 0.1004 (w 0.0802 mse 0.0794 t 873 new 0.24) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +step 1005/5000 loss 0.0883 (w 0.1088 mse 0.1101 t 328 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1006/5000 loss 0.1080 (w 0.0970 mse 0.0889 t 945 new 0.25) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1007/5000 loss 0.0709 (w 0.1111 mse 0.1028 t 960 new 0.22) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1008/5000 loss 0.0870 (w 0.1060 mse 0.0980 t 940 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1009/5000 loss 0.0624 (w 0.0704 mse 0.0690 t 644 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 1010/5000 loss 0.0643 (w 0.0846 mse 0.0792 t 876 new 0.27) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 1011/5000 loss 0.1012 (w 0.0604 mse 0.0585 t 530 new 0.11) lr 1.00e-05 gnorm 0.065 5.79s mem 15.6GB +step 1012/5000 loss 0.0797 (w 0.0905 mse 0.0917 t 584 new 0.28) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1013/5000 loss 0.0727 (w 0.0965 mse 0.0952 t 817 new 0.24) lr 1.00e-05 gnorm 0.059 5.67s mem 15.6GB +step 1014/5000 loss 0.1624 (w 0.3143 mse 0.3284 t 146 new 0.16) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1015/5000 loss 0.1182 (w 0.1123 mse 0.1047 t 943 new 0.27) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1016/5000 loss 0.0804 (w 0.1458 mse 0.1463 t 954 new 0.19) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 1017/5000 loss 0.1232 (w 0.0744 mse 0.0689 t 530 new 0.27) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 1018/5000 loss 0.1309 (w 0.0514 mse 0.0530 t 841 new 0.15) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 1019/5000 loss 0.0497 (w 0.1254 mse 0.1203 t 958 new 0.23) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1020/5000 loss 0.0738 (w 0.0821 mse 0.0816 t 786 new 0.26) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 1021/5000 loss 0.0832 (w 0.0723 mse 0.0694 t 866 new 0.22) lr 1.00e-05 gnorm 0.068 5.71s mem 15.6GB +step 1022/5000 loss 0.0860 (w 0.0782 mse 0.0787 t 795 new 0.20) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1023/5000 loss 0.0992 (w 0.8695 mse 0.8700 t 20 new 0.27) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1024/5000 loss 0.0697 (w 0.0930 mse 0.0903 t 977 new 0.27) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1025/5000 loss 0.0763 (w 0.0521 mse 0.0531 t 831 new 0.24) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1026/5000 loss 0.0611 (w 0.0747 mse 0.0681 t 889 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1027/5000 loss 0.0798 (w 0.2367 mse 0.2318 t 169 new 0.25) lr 1.00e-05 gnorm 0.079 5.90s mem 15.6GB +step 1028/5000 loss 0.0796 (w 0.1927 mse 0.1887 t 995 new 0.25) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 1029/5000 loss 0.1067 (w 0.1398 mse 0.1380 t 627 new 0.24) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 1030/5000 loss 0.0761 (w 0.0950 mse 0.0886 t 944 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1031/5000 loss 0.1107 (w 0.1935 mse 0.2134 t 157 new 0.22) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1032/5000 loss 0.0507 (w 0.0662 mse 0.0576 t 888 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1033/5000 loss 0.1006 (w 0.0464 mse 0.0473 t 726 new 0.21) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 1034/5000 loss 0.0765 (w 0.1124 mse 0.1046 t 964 new 0.13) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 1035/5000 loss 0.0851 (w 0.0607 mse 0.0579 t 889 new 0.23) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1036/5000 loss 0.0816 (w 0.0806 mse 0.0774 t 859 new 0.28) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 1037/5000 loss 0.1011 (w 0.0905 mse 0.0853 t 874 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1038/5000 loss 0.0855 (w 0.0862 mse 0.0811 t 734 new 0.26) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1039/5000 loss 0.0938 (w 0.1045 mse 0.0992 t 697 new 0.22) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1040/5000 loss 0.1262 (w 0.0973 mse 0.0971 t 499 new 0.22) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 1041/5000 loss 0.1157 (w 0.0776 mse 0.0763 t 652 new 0.13) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1042/5000 loss 0.0918 (w 0.0382 mse 0.0406 t 705 new 0.15) lr 1.00e-05 gnorm 0.072 5.91s mem 15.6GB +step 1043/5000 loss 0.1280 (w 0.1238 mse 0.1275 t 527 new 0.12) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1044/5000 loss 0.0799 (w 0.1072 mse 0.1052 t 334 new 0.22) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1045/5000 loss 0.0570 (w 0.1096 mse 0.1052 t 873 new 0.26) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1046/5000 loss 0.1387 (w 0.0913 mse 0.0937 t 545 new 0.21) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 1047/5000 loss 0.1095 (w 0.1047 mse 0.1009 t 959 new 0.23) lr 1.00e-05 gnorm 0.073 5.83s mem 15.6GB +step 1048/5000 loss 0.0636 (w 0.0364 mse 0.0368 t 860 new 0.14) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 1049/5000 loss 0.0765 (w 0.0485 mse 0.0506 t 862 new 0.14) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 1050/5000 loss 0.0930 (w 0.0495 mse 0.0495 t 722 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 1051/5000 loss 0.1258 (w 0.1127 mse 0.1103 t 245 new 0.16) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1052/5000 loss 0.0824 (w 0.1237 mse 0.1245 t 191 new 0.15) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 1053/5000 loss 0.0804 (w 0.1273 mse 0.1305 t 273 new 0.27) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1054/5000 loss 0.1063 (w 0.1753 mse 0.1686 t 971 new 0.17) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1055/5000 loss 0.0870 (w 0.0901 mse 0.0887 t 617 new 0.19) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1056/5000 loss 0.1277 (w 0.1417 mse 0.1395 t 939 new 0.23) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 1057/5000 loss 0.0958 (w 0.0955 mse 0.0900 t 824 new 0.22) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1058/5000 loss 0.0843 (w 0.0869 mse 0.0801 t 952 new 0.22) lr 1.00e-05 gnorm 0.069 5.90s mem 15.6GB +step 1059/5000 loss 0.0449 (w 0.0697 mse 0.0754 t 434 new 0.19) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +step 1060/5000 loss 0.1066 (w 0.0762 mse 0.0787 t 957 new 0.23) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1061/5000 loss 0.0972 (w 0.1109 mse 0.1118 t 910 new 0.19) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1062/5000 loss 0.0914 (w 0.0779 mse 0.0717 t 643 new 0.28) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1063/5000 loss 0.0768 (w 0.0573 mse 0.0542 t 732 new 0.23) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 1064/5000 loss 0.0872 (w 0.1701 mse 0.1552 t 974 new 0.20) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1065/5000 loss 0.0904 (w 0.0843 mse 0.0797 t 681 new 0.22) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1066/5000 loss 0.0991 (w 0.0995 mse 0.0885 t 954 new 0.23) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 1067/5000 loss 0.1134 (w 0.2354 mse 0.2269 t 977 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1068/5000 loss 0.1059 (w 0.1393 mse 0.1285 t 981 new 0.22) lr 1.00e-05 gnorm 0.067 5.90s mem 15.6GB +step 1069/5000 loss 0.0889 (w 0.2719 mse 0.2679 t 999 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1070/5000 loss 0.0801 (w 0.1076 mse 0.1041 t 936 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1071/5000 loss 0.0842 (w 0.1519 mse 0.1481 t 976 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1072/5000 loss 0.0936 (w 0.0518 mse 0.0545 t 632 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1073/5000 loss 0.0870 (w 0.3662 mse 0.3693 t 118 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1074/5000 loss 0.0662 (w 0.0707 mse 0.0696 t 934 new 0.22) lr 1.00e-05 gnorm 0.066 5.72s mem 15.6GB +step 1075/5000 loss 0.0975 (w 0.1436 mse 0.1450 t 950 new 0.21) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 1076/5000 loss 0.1185 (w 0.0949 mse 0.0985 t 972 new 0.21) lr 1.00e-05 gnorm 0.066 5.67s mem 15.6GB +step 1077/5000 loss 0.1098 (w 0.0950 mse 0.0933 t 862 new 0.20) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1078/5000 loss 0.0656 (w 0.0374 mse 0.0435 t 461 new 0.22) lr 1.00e-05 gnorm 0.096 5.68s mem 15.6GB +step 1079/5000 loss 0.0864 (w 0.0874 mse 0.0832 t 900 new 0.20) lr 1.00e-05 gnorm 0.063 5.82s mem 15.6GB +step 1080/5000 loss 0.0819 (w 0.0368 mse 0.0392 t 692 new 0.21) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1081/5000 loss 0.1063 (w 0.0785 mse 0.0851 t 619 new 0.09) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 1082/5000 loss 0.0934 (w 0.0426 mse 0.0429 t 767 new 0.10) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 1083/5000 loss 0.0428 (w 0.1869 mse 0.1804 t 989 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1084/5000 loss 0.0659 (w 0.0991 mse 0.0963 t 972 new 0.10) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 1085/5000 loss 0.1238 (w 0.0634 mse 0.0630 t 858 new 0.26) lr 1.00e-05 gnorm 0.070 5.92s mem 15.6GB +step 1086/5000 loss 0.0659 (w 0.0753 mse 0.0713 t 554 new 0.23) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 1087/5000 loss 0.1004 (w 0.0522 mse 0.0532 t 860 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1088/5000 loss 0.0666 (w 0.0450 mse 0.0462 t 603 new 0.11) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1089/5000 loss 0.0739 (w 0.1038 mse 0.0954 t 696 new 0.22) lr 1.00e-05 gnorm 0.074 5.93s mem 15.6GB +step 1090/5000 loss 0.1081 (w 0.0974 mse 0.0978 t 986 new 0.10) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1091/5000 loss 0.0665 (w 0.1118 mse 0.1138 t 976 new 0.27) lr 1.00e-05 gnorm 0.093 5.70s mem 15.6GB +step 1092/5000 loss 0.0708 (w 0.0711 mse 0.0685 t 765 new 0.28) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1093/5000 loss 0.0708 (w 0.0732 mse 0.0782 t 528 new 0.27) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 1094/5000 loss 0.0561 (w 0.0934 mse 0.0845 t 942 new 0.23) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 1095/5000 loss 0.1059 (w 0.1088 mse 0.1116 t 264 new 0.13) lr 1.00e-05 gnorm 0.102 5.93s mem 15.6GB +step 1096/5000 loss 0.0756 (w 0.0653 mse 0.0715 t 976 new 0.17) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 1097/5000 loss 0.1196 (w 0.0994 mse 0.1027 t 960 new 0.22) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +step 1098/5000 loss 0.0622 (w 0.0508 mse 0.0531 t 899 new 0.24) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 1099/5000 loss 0.0576 (w 0.1275 mse 0.1271 t 325 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1100/5000 loss 0.0581 (w 0.1073 mse 0.0973 t 950 new 0.23) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 1101/5000 loss 0.0368 (w 0.1773 mse 0.1845 t 999 new 0.23) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1102/5000 loss 0.0799 (w 0.1248 mse 0.1235 t 956 new 0.28) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1103/5000 loss 0.0898 (w 0.0918 mse 0.0856 t 722 new 0.27) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1104/5000 loss 0.0956 (w 0.1126 mse 0.1096 t 932 new 0.19) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 1105/5000 loss 0.1534 (w 0.1308 mse 0.1346 t 440 new 0.19) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1106/5000 loss 0.1297 (w 0.1721 mse 0.1504 t 970 new 0.23) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 1107/5000 loss 0.0833 (w 0.0566 mse 0.0548 t 541 new 0.15) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 1108/5000 loss 0.1030 (w 0.2819 mse 0.2907 t 150 new 0.27) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 1109/5000 loss 0.0890 (w 0.0964 mse 0.0967 t 871 new 0.18) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1110/5000 loss 0.0665 (w 0.0917 mse 0.0898 t 923 new 0.22) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1111/5000 loss 0.1256 (w 0.0680 mse 0.0668 t 582 new 0.11) lr 1.00e-05 gnorm 0.075 5.67s mem 15.6GB +step 1112/5000 loss 0.0866 (w 0.1855 mse 0.1867 t 986 new 0.29) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1113/5000 loss 0.1237 (w 0.0799 mse 0.0774 t 513 new 0.26) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 1114/5000 loss 0.1188 (w 0.4383 mse 0.4359 t 101 new 0.23) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 1115/5000 loss 0.1149 (w 0.0689 mse 0.0680 t 546 new 0.16) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1116/5000 loss 0.0965 (w 0.0717 mse 0.0707 t 771 new 0.21) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 1117/5000 loss 0.1264 (w 0.0811 mse 0.0783 t 911 new 0.23) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 1118/5000 loss 0.0938 (w 0.0981 mse 0.0906 t 963 new 0.26) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1119/5000 loss 0.0709 (w 0.1333 mse 0.1224 t 970 new 0.28) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 1120/5000 loss 0.0869 (w 0.0611 mse 0.0616 t 593 new 0.10) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1121/5000 loss 0.0889 (w 0.0615 mse 0.0626 t 802 new 0.14) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1122/5000 loss 0.0779 (w 0.2760 mse 0.2615 t 997 new 0.25) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 1123/5000 loss 0.0808 (w 0.0199 mse 0.0229 t 631 new 0.17) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1124/5000 loss 0.1021 (w 0.0534 mse 0.0521 t 528 new 0.26) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 1125/5000 loss 0.0781 (w 0.1255 mse 0.1277 t 936 new 0.19) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 1126/5000 loss 0.1034 (w 0.0662 mse 0.0728 t 971 new 0.12) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1127/5000 loss 0.0768 (w 0.0947 mse 0.0961 t 375 new 0.24) lr 1.00e-05 gnorm 0.074 5.86s mem 15.6GB +step 1128/5000 loss 0.0755 (w 0.1048 mse 0.1004 t 833 new 0.24) lr 1.00e-05 gnorm 0.064 5.67s mem 15.6GB +step 1129/5000 loss 0.0816 (w 0.0477 mse 0.0460 t 739 new 0.22) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 1130/5000 loss 0.1086 (w 0.0736 mse 0.0690 t 670 new 0.30) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 1131/5000 loss 0.0651 (w 0.1395 mse 0.1294 t 998 new 0.18) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1132/5000 loss 0.1075 (w 0.0935 mse 0.0922 t 765 new 0.11) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1133/5000 loss 0.1097 (w 0.1401 mse 0.1511 t 981 new 0.16) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 1134/5000 loss 0.0941 (w 0.0912 mse 0.0877 t 622 new 0.19) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 1135/5000 loss 0.0867 (w 0.1268 mse 0.1196 t 942 new 0.28) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1136/5000 loss 0.1029 (w 0.0576 mse 0.0592 t 896 new 0.19) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 1137/5000 loss 0.0670 (w 0.0895 mse 0.0798 t 860 new 0.22) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 1138/5000 loss 0.0886 (w 0.0670 mse 0.0678 t 523 new 0.21) lr 1.00e-05 gnorm 0.089 5.79s mem 15.6GB +step 1139/5000 loss 0.1240 (w 0.1880 mse 0.1850 t 222 new 0.25) lr 1.00e-05 gnorm 0.095 5.83s mem 15.6GB +step 1140/5000 loss 0.0819 (w 0.0430 mse 0.0455 t 913 new 0.07) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1141/5000 loss 0.1312 (w 0.1395 mse 0.1401 t 267 new 0.27) lr 1.00e-05 gnorm 0.091 5.89s mem 15.6GB +step 1142/5000 loss 0.0802 (w 0.1004 mse 0.0974 t 919 new 0.15) lr 1.00e-05 gnorm 0.068 5.74s mem 15.6GB +step 1143/5000 loss 0.0832 (w 0.3291 mse 0.3312 t 138 new 0.12) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 1144/5000 loss 0.0974 (w 0.0946 mse 0.0859 t 823 new 0.21) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 1145/5000 loss 0.0812 (w 0.0490 mse 0.0519 t 425 new 0.26) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 1146/5000 loss 0.1041 (w 0.0804 mse 0.0808 t 934 new 0.21) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1147/5000 loss 0.0651 (w 0.1231 mse 0.1162 t 886 new 0.23) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 1148/5000 loss 0.0963 (w 0.1375 mse 0.1333 t 502 new 0.19) lr 1.00e-05 gnorm 0.084 5.93s mem 15.6GB +step 1149/5000 loss 0.0726 (w 0.0406 mse 0.0438 t 767 new 0.14) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 1150/5000 loss 0.0494 (w 0.0638 mse 0.0692 t 463 new 0.16) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1151/5000 loss 0.0726 (w 0.1220 mse 0.1175 t 929 new 0.22) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1152/5000 loss 0.1074 (w 0.1162 mse 0.1071 t 596 new 0.28) lr 1.00e-05 gnorm 0.100 5.91s mem 15.6GB +step 1153/5000 loss 0.1097 (w 0.0602 mse 0.0617 t 349 new 0.16) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 1154/5000 loss 0.0636 (w 0.0622 mse 0.0614 t 957 new 0.13) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1155/5000 loss 0.0611 (w 0.0570 mse 0.0571 t 532 new 0.29) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1156/5000 loss 0.0894 (w 0.1875 mse 0.1798 t 992 new 0.22) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1157/5000 loss 0.1030 (w 0.3186 mse 0.3138 t 105 new 0.23) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1158/5000 loss 0.0971 (w 0.0844 mse 0.0796 t 902 new 0.21) lr 1.00e-05 gnorm 0.070 5.71s mem 15.6GB +step 1159/5000 loss 0.0909 (w 0.1061 mse 0.1116 t 294 new 0.27) lr 1.00e-05 gnorm 0.071 5.71s mem 15.6GB +step 1160/5000 loss 0.0622 (w 0.1038 mse 0.0983 t 909 new 0.16) lr 1.00e-05 gnorm 0.096 5.68s mem 15.6GB +step 1161/5000 loss 0.0645 (w 0.0485 mse 0.0482 t 891 new 0.13) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1162/5000 loss 0.0767 (w 0.0935 mse 0.0942 t 949 new 0.24) lr 1.00e-05 gnorm 0.086 5.89s mem 15.6GB +step 1163/5000 loss 0.0553 (w 0.1405 mse 0.1369 t 933 new 0.22) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 1164/5000 loss 0.0817 (w 0.1134 mse 0.1134 t 961 new 0.13) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 1165/5000 loss 0.0800 (w 0.0479 mse 0.0509 t 545 new 0.27) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 1166/5000 loss 0.0795 (w 0.1124 mse 0.1087 t 867 new 0.23) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 1167/5000 loss 0.0743 (w 0.0525 mse 0.0540 t 856 new 0.19) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 1168/5000 loss 0.1134 (w 0.0795 mse 0.0796 t 938 new 0.19) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 1169/5000 loss 0.1156 (w 0.2333 mse 0.2155 t 996 new 0.23) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +step 1170/5000 loss 0.0685 (w 0.0718 mse 0.0688 t 872 new 0.19) lr 1.00e-05 gnorm 0.100 5.72s mem 15.6GB +step 1171/5000 loss 0.0830 (w 0.0823 mse 0.0784 t 834 new 0.27) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 1172/5000 loss 0.1064 (w 0.1755 mse 0.1784 t 183 new 0.24) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +step 1173/5000 loss 0.1078 (w 0.0873 mse 0.0796 t 914 new 0.29) lr 1.00e-05 gnorm 0.084 5.93s mem 15.6GB +step 1174/5000 loss 0.0762 (w 0.0571 mse 0.0512 t 695 new 0.23) lr 1.00e-05 gnorm 0.063 5.75s mem 15.6GB +step 1175/5000 loss 0.1114 (w 0.1591 mse 0.1480 t 979 new 0.23) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 1176/5000 loss 0.0616 (w 0.0307 mse 0.0313 t 799 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1177/5000 loss 0.0580 (w 0.2259 mse 0.1956 t 991 new 0.30) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1178/5000 loss 0.1081 (w 0.0673 mse 0.0623 t 852 new 0.23) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 1179/5000 loss 0.0615 (w 0.0663 mse 0.0656 t 827 new 0.17) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1180/5000 loss 0.0768 (w 0.0920 mse 0.0924 t 921 new 0.20) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1181/5000 loss 0.0865 (w 0.0491 mse 0.0489 t 839 new 0.17) lr 1.00e-05 gnorm 0.070 5.89s mem 15.6GB +step 1182/5000 loss 0.0878 (w 0.0742 mse 0.0717 t 807 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 1183/5000 loss 0.0638 (w 0.1740 mse 0.1607 t 960 new 0.21) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1184/5000 loss 0.0873 (w 0.0926 mse 0.0914 t 997 new 0.07) lr 1.00e-05 gnorm 0.058 5.73s mem 15.6GB +step 1185/5000 loss 0.0439 (w 0.1746 mse 0.1564 t 991 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1186/5000 loss 0.0586 (w 0.0933 mse 0.0933 t 950 new 0.24) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 1187/5000 loss 0.0447 (w 0.0590 mse 0.0599 t 911 new 0.19) lr 1.00e-05 gnorm 0.049 5.67s mem 15.6GB +step 1188/5000 loss 0.1073 (w 0.1179 mse 0.1119 t 974 new 0.26) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 1189/5000 loss 0.0940 (w 0.0686 mse 0.0642 t 925 new 0.12) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1190/5000 loss 0.0557 (w 0.0513 mse 0.0548 t 965 new 0.11) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 1191/5000 loss 0.1245 (w 0.0770 mse 0.0691 t 762 new 0.27) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 1192/5000 loss 0.0624 (w 0.0897 mse 0.0881 t 913 new 0.25) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 1193/5000 loss 0.1278 (w 0.0945 mse 0.0925 t 656 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1194/5000 loss 0.0847 (w 0.0922 mse 0.0888 t 967 new 0.23) lr 1.00e-05 gnorm 0.071 5.93s mem 15.6GB +step 1195/5000 loss 0.0611 (w 0.1208 mse 0.1141 t 959 new 0.21) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1196/5000 loss 0.0688 (w 0.1391 mse 0.1330 t 270 new 0.27) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1197/5000 loss 0.0814 (w 0.0635 mse 0.0592 t 518 new 0.15) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 1198/5000 loss 0.0986 (w 0.0964 mse 0.0927 t 829 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 1199/5000 loss 0.0588 (w 0.0822 mse 0.0757 t 831 new 0.14) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 1200/5000 loss 0.1275 (w 0.2802 mse 0.2743 t 130 new 0.20) lr 1.00e-05 gnorm 0.098 5.71s mem 15.6GB +step 1201/5000 loss 0.0760 (w 0.1174 mse 0.1111 t 914 new 0.21) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 1202/5000 loss 0.0968 (w 0.0244 mse 0.0289 t 771 new 0.19) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 1203/5000 loss 0.1399 (w 0.0739 mse 0.0734 t 824 new 0.20) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 1204/5000 loss 0.1181 (w 0.1159 mse 0.1122 t 478 new 0.28) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1205/5000 loss 0.0908 (w 0.1485 mse 0.1468 t 273 new 0.24) lr 1.00e-05 gnorm 0.074 5.94s mem 15.6GB +step 1206/5000 loss 0.1034 (w 0.0979 mse 0.0987 t 604 new 0.19) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1207/5000 loss 0.0935 (w 0.4282 mse 0.4214 t 84 new 0.09) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1208/5000 loss 0.0731 (w 0.0401 mse 0.0413 t 922 new 0.09) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1209/5000 loss 0.0837 (w 0.1627 mse 0.1555 t 996 new 0.17) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1210/5000 loss 0.0938 (w 0.0490 mse 0.0490 t 699 new 0.17) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 1211/5000 loss 0.1425 (w 0.0584 mse 0.0617 t 461 new 0.22) lr 1.00e-05 gnorm 0.080 5.92s mem 15.6GB +step 1212/5000 loss 0.0881 (w 0.0751 mse 0.0784 t 826 new 0.30) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 1213/5000 loss 0.0682 (w 0.1074 mse 0.1065 t 977 new 0.15) lr 1.00e-05 gnorm 0.055 5.71s mem 15.6GB +step 1214/5000 loss 0.0772 (w 0.0674 mse 0.0645 t 844 new 0.25) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 1215/5000 loss 0.0688 (w 0.8023 mse 0.8012 t 29 new 0.25) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 1216/5000 loss 0.0559 (w 0.1126 mse 0.1241 t 973 new 0.23) lr 1.00e-05 gnorm 0.080 5.74s mem 15.6GB +step 1217/5000 loss 0.0903 (w 0.1175 mse 0.1150 t 916 new 0.23) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1218/5000 loss 0.0479 (w 0.0768 mse 0.0729 t 947 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1219/5000 loss 0.0577 (w 0.0908 mse 0.0831 t 860 new 0.19) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 1220/5000 loss 0.1085 (w 0.0596 mse 0.0611 t 919 new 0.25) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1221/5000 loss 0.1031 (w 0.0550 mse 0.0516 t 867 new 0.24) lr 1.00e-05 gnorm 0.053 5.74s mem 15.6GB +step 1222/5000 loss 0.0754 (w 0.0688 mse 0.0707 t 956 new 0.11) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 1223/5000 loss 0.0795 (w 0.0882 mse 0.0816 t 951 new 0.20) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 1224/5000 loss 0.0699 (w 0.0672 mse 0.0680 t 700 new 0.19) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 1225/5000 loss 0.0642 (w 0.1113 mse 0.1029 t 919 new 0.28) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 1226/5000 loss 0.0755 (w 0.2137 mse 0.2122 t 993 new 0.24) lr 1.00e-05 gnorm 0.076 5.67s mem 15.6GB +step 1227/5000 loss 0.0890 (w 0.0962 mse 0.0955 t 756 new 0.24) lr 1.00e-05 gnorm 0.087 5.67s mem 15.6GB +step 1228/5000 loss 0.1018 (w 0.1099 mse 0.1050 t 823 new 0.24) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 1229/5000 loss 0.0945 (w 0.1008 mse 0.0942 t 941 new 0.26) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1230/5000 loss 0.0768 (w 0.0918 mse 0.0887 t 523 new 0.26) lr 1.00e-05 gnorm 0.103 5.68s mem 15.6GB +step 1231/5000 loss 0.0610 (w 0.0627 mse 0.0600 t 707 new 0.20) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 1232/5000 loss 0.0832 (w 0.1247 mse 0.1179 t 973 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1233/5000 loss 0.0708 (w 0.1122 mse 0.1127 t 283 new 0.05) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1234/5000 loss 0.0563 (w 0.1938 mse 0.1871 t 978 new 0.24) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1235/5000 loss 0.0852 (w 0.0648 mse 0.0588 t 944 new 0.28) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1236/5000 loss 0.1073 (w 0.0548 mse 0.0557 t 707 new 0.22) lr 1.00e-05 gnorm 0.063 5.71s mem 15.6GB +step 1237/5000 loss 0.1019 (w 0.1002 mse 0.0977 t 822 new 0.32) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1238/5000 loss 0.0683 (w 0.0887 mse 0.0856 t 920 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1239/5000 loss 0.1111 (w 0.0636 mse 0.0634 t 707 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1240/5000 loss 0.0846 (w 0.1113 mse 0.1107 t 870 new 0.05) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 1241/5000 loss 0.0859 (w 0.0684 mse 0.0651 t 649 new 0.23) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 1242/5000 loss 0.1183 (w 0.1114 mse 0.1116 t 686 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1243/5000 loss 0.0582 (w 0.0552 mse 0.0572 t 934 new 0.26) lr 1.00e-05 gnorm 0.078 5.92s mem 15.6GB +step 1244/5000 loss 0.0887 (w 0.1026 mse 0.1006 t 986 new 0.13) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1245/5000 loss 0.0602 (w 0.0395 mse 0.0424 t 840 new 0.13) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 1246/5000 loss 0.1325 (w 0.1845 mse 0.1839 t 267 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1247/5000 loss 0.0858 (w 0.2073 mse 0.1947 t 996 new 0.24) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 1248/5000 loss 0.0676 (w 0.0973 mse 0.0932 t 522 new 0.26) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1249/5000 loss 0.1181 (w 0.3200 mse 0.3166 t 150 new 0.16) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1250/5000 loss 0.0564 (w 0.0629 mse 0.0587 t 847 new 0.23) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 1251/5000 loss 0.0486 (w 0.1540 mse 0.1419 t 972 new 0.27) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1252/5000 loss 0.0726 (w 0.7922 mse 0.7842 t 34 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1253/5000 loss 0.1364 (w 0.0567 mse 0.0524 t 721 new 0.27) lr 1.00e-05 gnorm 0.116 5.68s mem 15.6GB +step 1254/5000 loss 0.0842 (w 0.1152 mse 0.1050 t 955 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1255/5000 loss 0.0873 (w 0.1729 mse 0.1520 t 983 new 0.24) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1256/5000 loss 0.1211 (w 0.1109 mse 0.1062 t 877 new 0.18) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 1257/5000 loss 0.0842 (w 0.0654 mse 0.0640 t 884 new 0.09) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 1258/5000 loss 0.0806 (w 0.0205 mse 0.0234 t 763 new 0.15) lr 1.00e-05 gnorm 0.078 5.83s mem 15.6GB +step 1259/5000 loss 0.0661 (w 0.0914 mse 0.0905 t 629 new 0.20) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1260/5000 loss 0.0889 (w 0.1254 mse 0.1230 t 958 new 0.15) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1261/5000 loss 0.0932 (w 0.1062 mse 0.1052 t 968 new 0.25) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1262/5000 loss 0.1500 (w 0.1213 mse 0.1206 t 438 new 0.28) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1263/5000 loss 0.0871 (w 0.0675 mse 0.0633 t 782 new 0.29) lr 1.00e-05 gnorm 0.068 5.84s mem 15.6GB +step 1264/5000 loss 0.0759 (w 0.0714 mse 0.0661 t 879 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1265/5000 loss 0.0721 (w 0.2038 mse 0.2029 t 239 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 1266/5000 loss 0.0824 (w 0.0548 mse 0.0528 t 845 new 0.16) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1267/5000 loss 0.0619 (w 0.1944 mse 0.1998 t 987 new 0.28) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1268/5000 loss 0.0704 (w 0.0763 mse 0.0730 t 893 new 0.19) lr 1.00e-05 gnorm 0.077 5.92s mem 15.6GB +step 1269/5000 loss 0.0823 (w 0.0687 mse 0.0668 t 749 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1270/5000 loss 0.0771 (w 0.0376 mse 0.0374 t 734 new 0.29) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 1271/5000 loss 0.0944 (w 0.1774 mse 0.1697 t 980 new 0.16) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1272/5000 loss 0.0583 (w 0.0878 mse 0.0854 t 950 new 0.27) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1273/5000 loss 0.0871 (w 0.2017 mse 0.1965 t 972 new 0.28) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1274/5000 loss 0.0817 (w 0.0912 mse 0.0811 t 875 new 0.22) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1275/5000 loss 0.0723 (w 0.1236 mse 0.1162 t 961 new 0.28) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1276/5000 loss 0.1082 (w 0.0801 mse 0.0840 t 467 new 0.16) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1277/5000 loss 0.1341 (w 0.1071 mse 0.0950 t 923 new 0.22) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1278/5000 loss 0.1209 (w 0.0599 mse 0.0558 t 781 new 0.17) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1279/5000 loss 0.0640 (w 0.0806 mse 0.0739 t 938 new 0.19) lr 1.00e-05 gnorm 0.063 5.92s mem 15.6GB +step 1280/5000 loss 0.0809 (w 0.0739 mse 0.0788 t 938 new 0.18) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 1281/5000 loss 0.0991 (w 0.1069 mse 0.0979 t 973 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1282/5000 loss 0.0329 (w 0.0641 mse 0.0592 t 825 new 0.22) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +step 1283/5000 loss 0.1539 (w 0.0861 mse 0.0822 t 805 new 0.23) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1284/5000 loss 0.0845 (w 0.0548 mse 0.0537 t 881 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1285/5000 loss 0.0794 (w 0.0883 mse 0.0905 t 556 new 0.20) lr 1.00e-05 gnorm 0.100 5.69s mem 15.6GB +step 1286/5000 loss 0.0670 (w 0.0686 mse 0.0679 t 915 new 0.13) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 1287/5000 loss 0.0946 (w 0.0669 mse 0.0654 t 922 new 0.27) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 1288/5000 loss 0.1237 (w 0.0884 mse 0.0846 t 772 new 0.27) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1289/5000 loss 0.0797 (w 0.0478 mse 0.0476 t 568 new 0.26) lr 1.00e-05 gnorm 0.106 5.92s mem 15.6GB +step 1290/5000 loss 0.0902 (w 0.0765 mse 0.0684 t 788 new 0.26) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1291/5000 loss 0.0848 (w 0.2140 mse 0.1874 t 992 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 1292/5000 loss 0.0752 (w 0.0767 mse 0.0744 t 827 new 0.24) lr 1.00e-05 gnorm 0.116 5.70s mem 15.6GB +step 1293/5000 loss 0.0864 (w 0.0760 mse 0.0712 t 900 new 0.22) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 1294/5000 loss 0.1000 (w 0.0583 mse 0.0582 t 731 new 0.08) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 1295/5000 loss 0.0718 (w 0.0605 mse 0.0584 t 838 new 0.19) lr 1.00e-05 gnorm 0.103 5.90s mem 15.6GB +step 1296/5000 loss 0.1080 (w 0.0654 mse 0.0638 t 399 new 0.18) lr 1.00e-05 gnorm 0.096 5.76s mem 15.6GB +step 1297/5000 loss 0.0679 (w 0.0706 mse 0.0664 t 824 new 0.24) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1298/5000 loss 0.1377 (w 0.0137 mse 0.0141 t 803 new 0.08) lr 1.00e-05 gnorm 0.176 5.68s mem 15.6GB +step 1299/5000 loss 0.0856 (w 0.0988 mse 0.0957 t 471 new 0.25) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1300/5000 loss 0.0910 (w 0.0837 mse 0.0797 t 899 new 0.23) lr 1.00e-05 gnorm 0.079 5.76s mem 15.6GB +step 1301/5000 loss 0.1053 (w 0.0638 mse 0.0610 t 591 new 0.22) lr 1.00e-05 gnorm 0.135 5.68s mem 15.6GB +step 1302/5000 loss 0.1098 (w 0.1063 mse 0.1001 t 722 new 0.25) lr 1.00e-05 gnorm 0.127 5.68s mem 15.6GB +step 1303/5000 loss 0.1217 (w 0.1787 mse 0.1706 t 239 new 0.18) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1304/5000 loss 0.1105 (w 0.2727 mse 0.2617 t 991 new 0.18) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 1305/5000 loss 0.0902 (w 0.0919 mse 0.0852 t 587 new 0.19) lr 1.00e-05 gnorm 0.137 5.85s mem 15.6GB +step 1306/5000 loss 0.0853 (w 0.0905 mse 0.0878 t 981 new 0.15) lr 1.00e-05 gnorm 0.079 5.91s mem 15.6GB +step 1307/5000 loss 0.0610 (w 0.1639 mse 0.1588 t 970 new 0.24) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 1308/5000 loss 0.1030 (w 0.0707 mse 0.0683 t 857 new 0.12) lr 1.00e-05 gnorm 0.104 5.70s mem 15.6GB +step 1309/5000 loss 0.1321 (w 0.0933 mse 0.0941 t 815 new 0.21) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1310/5000 loss 0.0677 (w 0.1698 mse 0.1465 t 994 new 0.23) lr 1.00e-05 gnorm 0.068 5.88s mem 15.6GB +step 1311/5000 loss 0.0420 (w 0.1753 mse 0.1643 t 980 new 0.23) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 1312/5000 loss 0.0477 (w 0.0957 mse 0.0919 t 676 new 0.30) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 1313/5000 loss 0.0923 (w 0.0902 mse 0.0936 t 317 new 0.20) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1314/5000 loss 0.0991 (w 0.1762 mse 0.1698 t 977 new 0.16) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1315/5000 loss 0.1267 (w 0.1613 mse 0.1495 t 987 new 0.21) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 1316/5000 loss 0.0625 (w 0.0539 mse 0.0516 t 451 new 0.12) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 1317/5000 loss 0.0827 (w 0.0814 mse 0.0726 t 663 new 0.26) lr 1.00e-05 gnorm 0.071 5.77s mem 15.6GB +step 1318/5000 loss 0.0913 (w 0.0424 mse 0.0428 t 860 new 0.13) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 1319/5000 loss 0.0838 (w 0.0559 mse 0.0528 t 817 new 0.22) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 1320/5000 loss 0.0975 (w 0.1285 mse 0.1289 t 970 new 0.22) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1321/5000 loss 0.0954 (w 0.0656 mse 0.0578 t 815 new 0.23) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1322/5000 loss 0.1491 (w 0.0388 mse 0.0388 t 714 new 0.11) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1323/5000 loss 0.1209 (w 0.4278 mse 0.4174 t 101 new 0.23) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 1324/5000 loss 0.0819 (w 0.3487 mse 0.3203 t 996 new 0.25) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 1325/5000 loss 0.0722 (w 0.3005 mse 0.2673 t 996 new 0.29) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 1326/5000 loss 0.1274 (w 0.0864 mse 0.0875 t 956 new 0.12) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 1327/5000 loss 0.0850 (w 0.0598 mse 0.0611 t 578 new 0.24) lr 1.00e-05 gnorm 0.059 5.90s mem 15.6GB +step 1328/5000 loss 0.0918 (w 0.1389 mse 0.1434 t 157 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 1329/5000 loss 0.1096 (w 0.0882 mse 0.0907 t 931 new 0.18) lr 1.00e-05 gnorm 0.067 5.91s mem 15.6GB +step 1330/5000 loss 0.0766 (w 0.1312 mse 0.1147 t 975 new 0.26) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 1331/5000 loss 0.0389 (w 0.0482 mse 0.0515 t 946 new 0.16) lr 1.00e-05 gnorm 0.068 5.98s mem 15.6GB +step 1332/5000 loss 0.0865 (w 0.0398 mse 0.0382 t 788 new 0.21) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1333/5000 loss 0.0636 (w 0.0940 mse 0.0953 t 958 new 0.17) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1334/5000 loss 0.0662 (w 0.1045 mse 0.1018 t 783 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1335/5000 loss 0.1285 (w 0.1583 mse 0.1534 t 987 new 0.14) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +step 1336/5000 loss 0.1172 (w 0.0520 mse 0.0520 t 612 new 0.14) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 1337/5000 loss 0.0790 (w 0.1251 mse 0.1236 t 588 new 0.26) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1338/5000 loss 0.0494 (w 0.1205 mse 0.1084 t 926 new 0.26) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1339/5000 loss 0.1009 (w 0.0778 mse 0.0732 t 522 new 0.23) lr 1.00e-05 gnorm 0.091 5.82s mem 15.6GB +step 1340/5000 loss 0.1008 (w 0.1369 mse 0.1223 t 954 new 0.23) lr 1.00e-05 gnorm 0.089 5.67s mem 15.6GB +step 1341/5000 loss 0.0910 (w 0.0911 mse 0.0900 t 809 new 0.22) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 1342/5000 loss 0.0449 (w 0.0880 mse 0.0870 t 978 new 0.12) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 1343/5000 loss 0.0758 (w 0.0849 mse 0.0831 t 977 new 0.28) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 1344/5000 loss 0.1000 (w 0.0946 mse 0.0895 t 425 new 0.26) lr 1.00e-05 gnorm 0.069 5.93s mem 15.6GB +step 1345/5000 loss 0.1087 (w 0.0503 mse 0.0479 t 880 new 0.20) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1346/5000 loss 0.0964 (w 0.2575 mse 0.2545 t 201 new 0.29) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1347/5000 loss 0.1211 (w 0.0667 mse 0.0668 t 718 new 0.20) lr 1.00e-05 gnorm 0.075 5.67s mem 15.6GB +step 1348/5000 loss 0.0647 (w 0.1204 mse 0.1178 t 944 new 0.25) lr 1.00e-05 gnorm 0.073 5.90s mem 15.6GB +step 1349/5000 loss 0.0787 (w 0.0784 mse 0.0748 t 913 new 0.11) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1350/5000 loss 0.0909 (w 0.0574 mse 0.0608 t 764 new 0.28) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1351/5000 loss 0.0919 (w 0.0975 mse 0.0937 t 538 new 0.31) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1352/5000 loss 0.1191 (w 0.0626 mse 0.0619 t 796 new 0.21) lr 1.00e-05 gnorm 0.063 5.88s mem 15.6GB +step 1353/5000 loss 0.1026 (w 0.0838 mse 0.0856 t 384 new 0.23) lr 1.00e-05 gnorm 0.071 5.95s mem 15.6GB +step 1354/5000 loss 0.0471 (w 0.1990 mse 0.1919 t 978 new 0.24) lr 1.00e-05 gnorm 0.062 5.81s mem 15.6GB +step 1355/5000 loss 0.0967 (w 0.0879 mse 0.0846 t 815 new 0.16) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1356/5000 loss 0.1221 (w 0.0619 mse 0.0595 t 963 new 0.22) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +step 1357/5000 loss 0.0798 (w 0.0395 mse 0.0424 t 836 new 0.26) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 1358/5000 loss 0.0889 (w 0.2030 mse 0.1952 t 998 new 0.19) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 1359/5000 loss 0.0684 (w 0.0805 mse 0.0787 t 801 new 0.20) lr 1.00e-05 gnorm 0.059 5.84s mem 15.6GB +step 1360/5000 loss 0.0978 (w 0.0662 mse 0.0631 t 824 new 0.24) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1361/5000 loss 0.0599 (w 0.0845 mse 0.0826 t 845 new 0.13) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1362/5000 loss 0.0563 (w 0.0347 mse 0.0354 t 874 new 0.09) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1363/5000 loss 0.0834 (w 0.1070 mse 0.0953 t 953 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 1364/5000 loss 0.0883 (w 0.1172 mse 0.1189 t 967 new 0.18) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1365/5000 loss 0.1545 (w 0.1148 mse 0.1115 t 408 new 0.17) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1366/5000 loss 0.0982 (w 0.0635 mse 0.0602 t 752 new 0.17) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1367/5000 loss 0.1215 (w 0.3747 mse 0.3706 t 88 new 0.19) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1368/5000 loss 0.1141 (w 0.0995 mse 0.0964 t 589 new 0.25) lr 1.00e-05 gnorm 0.104 5.68s mem 15.6GB +step 1369/5000 loss 0.0491 (w 0.1389 mse 0.1295 t 948 new 0.15) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 1370/5000 loss 0.1027 (w 0.0859 mse 0.0864 t 525 new 0.21) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +step 1371/5000 loss 0.1357 (w 0.0740 mse 0.0657 t 887 new 0.23) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +step 1372/5000 loss 0.0728 (w 0.0893 mse 0.0849 t 715 new 0.21) lr 1.00e-05 gnorm 0.070 5.67s mem 15.6GB +step 1373/5000 loss 0.0757 (w 0.0332 mse 0.0337 t 805 new 0.16) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 1374/5000 loss 0.0713 (w 0.0946 mse 0.0892 t 925 new 0.19) lr 1.00e-05 gnorm 0.077 5.89s mem 15.6GB +step 1375/5000 loss 0.0908 (w 0.2066 mse 0.1939 t 998 new 0.32) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 1376/5000 loss 0.0831 (w 0.1079 mse 0.0958 t 908 new 0.20) lr 1.00e-05 gnorm 0.094 5.68s mem 15.6GB +step 1377/5000 loss 0.0942 (w 0.0394 mse 0.0368 t 706 new 0.21) lr 1.00e-05 gnorm 0.088 5.67s mem 15.6GB +step 1378/5000 loss 0.1101 (w 0.0596 mse 0.0647 t 917 new 0.13) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1379/5000 loss 0.0673 (w 0.0598 mse 0.0648 t 681 new 0.21) lr 1.00e-05 gnorm 0.086 5.67s mem 15.6GB +step 1380/5000 loss 0.0721 (w 0.0738 mse 0.0758 t 950 new 0.21) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 1381/5000 loss 0.0834 (w 0.0549 mse 0.0528 t 827 new 0.12) lr 1.00e-05 gnorm 0.120 5.68s mem 15.6GB +step 1382/5000 loss 0.0821 (w 0.0410 mse 0.0407 t 902 new 0.11) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 1383/5000 loss 0.1061 (w 0.1272 mse 0.1262 t 323 new 0.26) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +step 1384/5000 loss 0.1283 (w 0.0770 mse 0.0701 t 716 new 0.26) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1385/5000 loss 0.0918 (w 1.0112 mse 1.0112 t 5 new 0.24) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +step 1386/5000 loss 0.0790 (w 0.0681 mse 0.0653 t 744 new 0.25) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 1387/5000 loss 0.0779 (w 0.0958 mse 0.0884 t 848 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1388/5000 loss 0.0474 (w 0.0707 mse 0.0679 t 818 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1389/5000 loss 0.0780 (w 0.0934 mse 0.0997 t 979 new 0.16) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +step 1390/5000 loss 0.0889 (w 0.0282 mse 0.0316 t 833 new 0.15) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1391/5000 loss 0.1252 (w 0.0546 mse 0.0561 t 581 new 0.25) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 1392/5000 loss 0.1259 (w 0.0832 mse 0.0740 t 863 new 0.23) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 1393/5000 loss 0.0895 (w 0.0816 mse 0.0750 t 776 new 0.26) lr 1.00e-05 gnorm 0.058 5.67s mem 15.6GB +step 1394/5000 loss 0.1000 (w 0.1595 mse 0.1503 t 970 new 0.16) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 1395/5000 loss 0.0811 (w 0.0750 mse 0.0645 t 638 new 0.25) lr 1.00e-05 gnorm 0.066 6.13s mem 15.6GB +step 1396/5000 loss 0.0529 (w 0.1472 mse 0.1369 t 955 new 0.22) lr 1.00e-05 gnorm 0.075 5.78s mem 15.6GB +step 1397/5000 loss 0.0901 (w 0.0723 mse 0.0665 t 850 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1398/5000 loss 0.1275 (w 0.5051 mse 0.4962 t 80 new 0.18) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 1399/5000 loss 0.0718 (w 0.0670 mse 0.0650 t 658 new 0.27) lr 1.00e-05 gnorm 0.071 5.85s mem 15.6GB +step 1400/5000 loss 0.0540 (w 0.1499 mse 0.1442 t 971 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 1401/5000 loss 0.0538 (w 0.1020 mse 0.0987 t 921 new 0.18) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 1402/5000 loss 0.0500 (w 0.0340 mse 0.0365 t 584 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1403/5000 loss 0.0470 (w 0.0663 mse 0.0636 t 908 new 0.09) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1404/5000 loss 0.1092 (w 0.0914 mse 0.0926 t 417 new 0.24) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 1405/5000 loss 0.0710 (w 0.0700 mse 0.0727 t 932 new 0.22) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1406/5000 loss 0.0708 (w 0.1697 mse 0.1559 t 974 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1407/5000 loss 0.0658 (w 0.0851 mse 0.0810 t 919 new 0.24) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 1408/5000 loss 0.0871 (w 0.1053 mse 0.0967 t 968 new 0.21) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1409/5000 loss 0.0655 (w 0.0838 mse 0.0871 t 958 new 0.25) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1410/5000 loss 0.1342 (w 0.2750 mse 0.2827 t 105 new 0.20) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1411/5000 loss 0.0871 (w 0.0741 mse 0.0695 t 604 new 0.23) lr 1.00e-05 gnorm 0.078 5.74s mem 15.6GB +step 1412/5000 loss 0.0672 (w 0.0487 mse 0.0470 t 876 new 0.09) lr 1.00e-05 gnorm 0.065 5.81s mem 15.6GB +step 1413/5000 loss 0.0859 (w 0.0904 mse 0.0869 t 721 new 0.25) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 1414/5000 loss 0.0883 (w 0.0775 mse 0.0693 t 837 new 0.19) lr 1.00e-05 gnorm 0.076 5.74s mem 15.6GB +step 1415/5000 loss 0.0664 (w 0.1361 mse 0.1255 t 978 new 0.19) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 1416/5000 loss 0.0699 (w 0.3219 mse 0.3476 t 80 new 0.24) lr 1.00e-05 gnorm 0.059 5.88s mem 15.6GB +step 1417/5000 loss 0.1076 (w 0.0905 mse 0.0811 t 824 new 0.27) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1418/5000 loss 0.0599 (w 0.0642 mse 0.0642 t 642 new 0.21) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +step 1419/5000 loss 0.0387 (w 0.1727 mse 0.1655 t 966 new 0.14) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 1420/5000 loss 0.0884 (w 0.0704 mse 0.0695 t 599 new 0.16) lr 1.00e-05 gnorm 0.076 5.80s mem 15.6GB +step 1421/5000 loss 0.0658 (w 0.0922 mse 0.0904 t 921 new 0.24) lr 1.00e-05 gnorm 0.081 5.90s mem 15.6GB +step 1422/5000 loss 0.1146 (w 0.2694 mse 0.2669 t 161 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1423/5000 loss 0.0975 (w 0.0745 mse 0.0905 t 232 new 0.24) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +step 1424/5000 loss 0.0777 (w 0.0441 mse 0.0462 t 694 new 0.25) lr 1.00e-05 gnorm 0.090 5.90s mem 15.6GB +step 1425/5000 loss 0.0500 (w 0.0753 mse 0.0694 t 621 new 0.20) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1426/5000 loss 0.1206 (w 0.1132 mse 0.1128 t 349 new 0.23) lr 1.00e-05 gnorm 0.077 5.88s mem 15.6GB +step 1427/5000 loss 0.0715 (w 0.0558 mse 0.0596 t 752 new 0.20) lr 1.00e-05 gnorm 0.085 5.67s mem 15.6GB +step 1428/5000 loss 0.0864 (w 0.0757 mse 0.0703 t 625 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1429/5000 loss 0.1246 (w 0.4212 mse 0.4054 t 105 new 0.21) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +step 1430/5000 loss 0.1019 (w 0.0894 mse 0.0887 t 915 new 0.21) lr 1.00e-05 gnorm 0.063 6.45s mem 15.6GB +step 1431/5000 loss 0.0895 (w 0.0460 mse 0.0481 t 869 new 0.09) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 1432/5000 loss 0.0964 (w 0.0715 mse 0.0673 t 886 new 0.23) lr 1.00e-05 gnorm 0.061 5.74s mem 15.6GB +step 1433/5000 loss 0.0814 (w 0.1045 mse 0.0988 t 904 new 0.24) lr 1.00e-05 gnorm 0.077 5.80s mem 15.6GB +step 1434/5000 loss 0.1111 (w 0.0587 mse 0.0569 t 847 new 0.25) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 1435/5000 loss 0.0546 (w 0.1452 mse 0.1354 t 972 new 0.20) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1436/5000 loss 0.0897 (w 0.0624 mse 0.0657 t 532 new 0.17) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1437/5000 loss 0.0670 (w 0.0672 mse 0.0642 t 904 new 0.25) lr 1.00e-05 gnorm 0.068 5.89s mem 15.6GB +step 1438/5000 loss 0.0977 (w 0.1577 mse 0.1466 t 309 new 0.23) lr 1.00e-05 gnorm 0.061 5.89s mem 15.6GB +step 1439/5000 loss 0.1020 (w 0.0723 mse 0.0715 t 688 new 0.20) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1440/5000 loss 0.0947 (w 0.0646 mse 0.0631 t 908 new 0.21) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1441/5000 loss 0.0635 (w 0.0533 mse 0.0557 t 568 new 0.17) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 1442/5000 loss 0.0997 (w 0.1002 mse 0.0950 t 616 new 0.24) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1443/5000 loss 0.1014 (w 0.0597 mse 0.0628 t 658 new 0.24) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 1444/5000 loss 0.0734 (w 0.0878 mse 0.0826 t 681 new 0.21) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1445/5000 loss 0.1079 (w 0.3284 mse 0.3381 t 122 new 0.22) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1446/5000 loss 0.0855 (w 0.1045 mse 0.1039 t 954 new 0.17) lr 1.00e-05 gnorm 0.064 5.86s mem 15.6GB +step 1447/5000 loss 0.0818 (w 0.1104 mse 0.1069 t 898 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1448/5000 loss 0.1092 (w 0.1286 mse 0.1234 t 382 new 0.22) lr 1.00e-05 gnorm 0.064 5.94s mem 15.6GB +step 1449/5000 loss 0.0514 (w 0.1322 mse 0.1225 t 969 new 0.26) lr 1.00e-05 gnorm 0.113 5.68s mem 15.6GB +step 1450/5000 loss 0.1081 (w 0.1045 mse 0.0989 t 423 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1451/5000 loss 0.0700 (w 0.0541 mse 0.0553 t 591 new 0.15) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 1452/5000 loss 0.0763 (w 0.0929 mse 0.0857 t 928 new 0.23) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 1453/5000 loss 0.1110 (w 0.1406 mse 0.1387 t 306 new 0.19) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 1454/5000 loss 0.1158 (w 0.1967 mse 0.2000 t 219 new 0.23) lr 1.00e-05 gnorm 0.070 5.90s mem 15.6GB +step 1455/5000 loss 0.0797 (w 0.0865 mse 0.0833 t 480 new 0.30) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1456/5000 loss 0.0920 (w 0.1048 mse 0.1026 t 652 new 0.18) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 1457/5000 loss 0.0775 (w 0.0855 mse 0.0835 t 719 new 0.22) lr 1.00e-05 gnorm 0.051 5.67s mem 15.6GB +step 1458/5000 loss 0.0733 (w 0.0692 mse 0.0645 t 842 new 0.24) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 1459/5000 loss 0.0848 (w 0.0978 mse 0.0923 t 952 new 0.26) lr 1.00e-05 gnorm 0.057 5.67s mem 15.6GB +step 1460/5000 loss 0.0966 (w 0.1784 mse 0.1713 t 970 new 0.18) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 1461/5000 loss 0.0902 (w 0.1103 mse 0.0997 t 900 new 0.23) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 1462/5000 loss 0.0641 (w 0.0747 mse 0.0705 t 890 new 0.20) lr 1.00e-05 gnorm 0.044 5.87s mem 15.6GB +step 1463/5000 loss 0.0985 (w 0.0758 mse 0.0662 t 904 new 0.25) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 1464/5000 loss 0.1101 (w 0.1985 mse 0.1883 t 997 new 0.18) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 1465/5000 loss 0.0982 (w 0.1348 mse 0.1307 t 362 new 0.23) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 1466/5000 loss 0.0768 (w 0.0768 mse 0.0781 t 666 new 0.17) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1467/5000 loss 0.0986 (w 0.0532 mse 0.0532 t 842 new 0.19) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1468/5000 loss 0.0965 (w 0.1389 mse 0.1382 t 958 new 0.19) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +step 1469/5000 loss 0.1177 (w 0.0664 mse 0.0634 t 740 new 0.15) lr 1.00e-05 gnorm 0.063 5.88s mem 15.6GB +step 1470/5000 loss 0.0940 (w 0.0451 mse 0.0438 t 692 new 0.26) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1471/5000 loss 0.0864 (w 0.1203 mse 0.1294 t 959 new 0.14) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 1472/5000 loss 0.0930 (w 0.0965 mse 0.0970 t 560 new 0.19) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1473/5000 loss 0.0799 (w 0.0734 mse 0.0703 t 812 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1474/5000 loss 0.0804 (w 0.1145 mse 0.1206 t 802 new 0.20) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1475/5000 loss 0.1037 (w 0.0902 mse 0.0899 t 920 new 0.13) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1476/5000 loss 0.1029 (w 0.0600 mse 0.0611 t 715 new 0.15) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1477/5000 loss 0.1056 (w 0.0857 mse 0.0814 t 889 new 0.22) lr 1.00e-05 gnorm 0.072 5.74s mem 15.6GB +step 1478/5000 loss 0.1323 (w 0.2664 mse 0.2644 t 165 new 0.20) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 1479/5000 loss 0.1120 (w 0.1526 mse 0.1423 t 978 new 0.18) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1480/5000 loss 0.0987 (w 0.1670 mse 0.1583 t 970 new 0.25) lr 1.00e-05 gnorm 0.061 5.67s mem 15.6GB +step 1481/5000 loss 0.1101 (w 0.1552 mse 0.1625 t 191 new 0.29) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1482/5000 loss 0.0881 (w 0.1102 mse 0.1102 t 336 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1483/5000 loss 0.0968 (w 0.0732 mse 0.0696 t 569 new 0.29) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1484/5000 loss 0.1581 (w 0.0613 mse 0.0560 t 528 new 0.18) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 1485/5000 loss 0.0744 (w 0.0679 mse 0.0659 t 733 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1486/5000 loss 0.0650 (w 0.0304 mse 0.0370 t 900 new 0.23) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1487/5000 loss 0.0988 (w 0.1008 mse 0.0970 t 827 new 0.18) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 1488/5000 loss 0.0755 (w 0.1212 mse 0.1162 t 983 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1489/5000 loss 0.0820 (w 0.0855 mse 0.0806 t 768 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1490/5000 loss 0.0646 (w 0.0543 mse 0.0531 t 847 new 0.19) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 1491/5000 loss 0.0739 (w 0.0985 mse 0.0960 t 546 new 0.28) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1492/5000 loss 0.0696 (w 0.0851 mse 0.0858 t 941 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 1493/5000 loss 0.1427 (w 0.0414 mse 0.0448 t 947 new 0.15) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 1494/5000 loss 0.1037 (w 0.0965 mse 0.0899 t 911 new 0.27) lr 1.00e-05 gnorm 0.095 5.68s mem 15.6GB +step 1495/5000 loss 0.0864 (w 0.2079 mse 0.2031 t 994 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1496/5000 loss 0.1569 (w 0.0956 mse 0.0964 t 968 new 0.26) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1497/5000 loss 0.1153 (w 0.0948 mse 0.0918 t 655 new 0.24) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 1498/5000 loss 0.1196 (w 0.0584 mse 0.0551 t 728 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1499/5000 loss 0.0574 (w 0.0914 mse 0.0910 t 912 new 0.24) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 1500/5000 loss 0.1408 (w 0.1113 mse 0.1089 t 412 new 0.15) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[val] step 1500 t=201: w=0.1781 mse=0.1806 (n=16) t=501: w=0.0741 mse=0.0741 (n=16) t=800: w=0.0626 mse=0.0615 (n=16) | mean w=0.1050 mse=0.1054 4s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step1500.safetensors 832 个张量 2.87 GB +step 1501/5000 loss 0.1005 (w 0.0925 mse 0.0847 t 954 new 0.22) lr 1.00e-05 gnorm 0.082 5.76s mem 15.6GB +step 1502/5000 loss 0.0957 (w 0.0937 mse 0.0883 t 958 new 0.18) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 1503/5000 loss 0.1097 (w 0.0715 mse 0.0707 t 654 new 0.28) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 1504/5000 loss 0.0792 (w 0.0641 mse 0.0630 t 812 new 0.16) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +step 1505/5000 loss 0.0740 (w 0.1782 mse 0.1626 t 990 new 0.20) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 1506/5000 loss 0.0957 (w 0.0629 mse 0.0562 t 890 new 0.23) lr 1.00e-05 gnorm 0.066 5.96s mem 15.6GB +step 1507/5000 loss 0.0877 (w 0.2109 mse 0.2053 t 183 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 1508/5000 loss 0.0628 (w 0.0799 mse 0.0820 t 648 new 0.24) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 1509/5000 loss 0.0766 (w 0.1782 mse 0.1727 t 979 new 0.19) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 1510/5000 loss 0.0780 (w 0.0910 mse 0.0938 t 698 new 0.18) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1511/5000 loss 0.0753 (w 0.0853 mse 0.0782 t 709 new 0.23) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 1512/5000 loss 0.0802 (w 0.1311 mse 0.1220 t 943 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 1513/5000 loss 0.0998 (w 0.1025 mse 0.0988 t 672 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1514/5000 loss 0.0959 (w 0.3146 mse 0.3119 t 134 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1515/5000 loss 0.0554 (w 0.0563 mse 0.0589 t 879 new 0.23) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1516/5000 loss 0.1055 (w 0.0960 mse 0.0906 t 731 new 0.29) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 1517/5000 loss 0.0832 (w 0.0467 mse 0.0456 t 641 new 0.24) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 1518/5000 loss 0.0922 (w 0.0786 mse 0.0720 t 865 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1519/5000 loss 0.1021 (w 0.0836 mse 0.0817 t 516 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 1520/5000 loss 0.1108 (w 0.1795 mse 0.1770 t 161 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1521/5000 loss 0.0750 (w 0.1180 mse 0.1182 t 794 new 0.21) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1522/5000 loss 0.0833 (w 0.1329 mse 0.1332 t 930 new 0.27) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1523/5000 loss 0.1090 (w 0.0787 mse 0.0786 t 414 new 0.14) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 1524/5000 loss 0.0951 (w 0.0889 mse 0.0891 t 434 new 0.10) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 1525/5000 loss 0.0921 (w 0.0860 mse 0.0817 t 931 new 0.26) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 1526/5000 loss 0.1487 (w 0.0449 mse 0.0436 t 577 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1527/5000 loss 0.0783 (w 0.0698 mse 0.0678 t 599 new 0.24) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1528/5000 loss 0.0821 (w 0.0805 mse 0.0823 t 578 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1529/5000 loss 0.0930 (w 0.0588 mse 0.0599 t 478 new 0.25) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 1530/5000 loss 0.0728 (w 0.0811 mse 0.0786 t 488 new 0.28) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 1531/5000 loss 0.0543 (w 0.0787 mse 0.0757 t 900 new 0.14) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 1532/5000 loss 0.0950 (w 0.1247 mse 0.1160 t 877 new 0.21) lr 1.00e-05 gnorm 0.062 5.96s mem 15.6GB +step 1533/5000 loss 0.0912 (w 0.1592 mse 0.1468 t 991 new 0.24) lr 1.00e-05 gnorm 0.070 5.90s mem 15.6GB +step 1534/5000 loss 0.1124 (w 0.0545 mse 0.0553 t 600 new 0.11) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 1535/5000 loss 0.0791 (w 0.0700 mse 0.0679 t 801 new 0.21) lr 1.00e-05 gnorm 0.084 5.85s mem 15.6GB +step 1536/5000 loss 0.0287 (w 0.0820 mse 0.0709 t 773 new 0.27) lr 1.00e-05 gnorm 0.046 5.68s mem 15.6GB +step 1537/5000 loss 0.1122 (w 0.1077 mse 0.1021 t 824 new 0.28) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 1538/5000 loss 0.0908 (w 0.0605 mse 0.0580 t 712 new 0.21) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 1539/5000 loss 0.1147 (w 0.0447 mse 0.0521 t 669 new 0.19) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1540/5000 loss 0.1055 (w 0.1104 mse 0.1040 t 935 new 0.26) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 1541/5000 loss 0.0738 (w 0.1151 mse 0.1147 t 990 new 0.08) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 1542/5000 loss 0.1318 (w 0.0681 mse 0.0662 t 528 new 0.15) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1543/5000 loss 0.0645 (w 0.2135 mse 0.2181 t 992 new 0.29) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 1544/5000 loss 0.1003 (w 0.0949 mse 0.0943 t 620 new 0.20) lr 1.00e-05 gnorm 0.055 5.71s mem 15.6GB +step 1545/5000 loss 0.1246 (w 0.1181 mse 0.1140 t 944 new 0.20) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 1546/5000 loss 0.0844 (w 0.1138 mse 0.1109 t 349 new 0.25) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 1547/5000 loss 0.0914 (w 0.1144 mse 0.1106 t 897 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1548/5000 loss 0.0607 (w 0.0314 mse 0.0338 t 528 new 0.11) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 1549/5000 loss 0.1118 (w 0.0722 mse 0.0682 t 888 new 0.26) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +step 1550/5000 loss 0.0549 (w 0.0898 mse 0.0853 t 968 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1551/5000 loss 0.1596 (w 0.1205 mse 0.1271 t 239 new 0.28) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1552/5000 loss 0.0662 (w 0.0459 mse 0.0499 t 731 new 0.21) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 1553/5000 loss 0.1084 (w 0.0689 mse 0.0705 t 608 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1554/5000 loss 0.0869 (w 0.0575 mse 0.0561 t 753 new 0.16) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 1555/5000 loss 0.1096 (w 0.0847 mse 0.0780 t 925 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1556/5000 loss 0.0915 (w 0.0644 mse 0.0633 t 664 new 0.13) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1557/5000 loss 0.0591 (w 0.1742 mse 0.1450 t 997 new 0.25) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +step 1558/5000 loss 0.0674 (w 0.1467 mse 0.1417 t 990 new 0.16) lr 1.00e-05 gnorm 0.056 5.76s mem 15.6GB +step 1559/5000 loss 0.0669 (w 0.1179 mse 0.1133 t 974 new 0.25) lr 1.00e-05 gnorm 0.057 5.93s mem 15.6GB +step 1560/5000 loss 0.0860 (w 0.0936 mse 0.0860 t 791 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1561/5000 loss 0.0802 (w 0.0790 mse 0.0765 t 788 new 0.21) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 1562/5000 loss 0.0774 (w 0.0744 mse 0.0681 t 764 new 0.23) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 1563/5000 loss 0.0897 (w 0.1298 mse 0.1238 t 996 new 0.14) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1564/5000 loss 0.0589 (w 0.0664 mse 0.0641 t 706 new 0.15) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 1565/5000 loss 0.0985 (w 0.1606 mse 0.1573 t 997 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 1566/5000 loss 0.0746 (w 0.0731 mse 0.0706 t 923 new 0.20) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1567/5000 loss 0.0366 (w 0.0569 mse 0.0583 t 968 new 0.25) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 1568/5000 loss 0.1069 (w 0.0758 mse 0.0746 t 473 new 0.27) lr 1.00e-05 gnorm 0.061 6.14s mem 15.6GB +step 1569/5000 loss 0.0997 (w 0.0686 mse 0.0650 t 664 new 0.22) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1570/5000 loss 0.0902 (w 0.0825 mse 0.0790 t 948 new 0.16) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 1571/5000 loss 0.1051 (w 0.0539 mse 0.0583 t 666 new 0.20) lr 1.00e-05 gnorm 0.069 5.74s mem 15.6GB +step 1572/5000 loss 0.0959 (w 0.0722 mse 0.0692 t 787 new 0.30) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1573/5000 loss 0.0967 (w 0.0217 mse 0.0252 t 766 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 1574/5000 loss 0.1019 (w 0.0835 mse 0.0765 t 670 new 0.28) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +step 1575/5000 loss 0.0779 (w 0.0955 mse 0.0842 t 922 new 0.16) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1576/5000 loss 0.0689 (w 0.0849 mse 0.0786 t 814 new 0.28) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1577/5000 loss 0.1160 (w 0.0527 mse 0.0497 t 767 new 0.19) lr 1.00e-05 gnorm 0.082 5.67s mem 15.6GB +step 1578/5000 loss 0.0874 (w 0.1080 mse 0.0961 t 936 new 0.23) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 1579/5000 loss 0.0821 (w 0.0854 mse 0.0721 t 931 new 0.22) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 1580/5000 loss 0.0669 (w 0.0466 mse 0.0451 t 688 new 0.20) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1581/5000 loss 0.1143 (w 0.0900 mse 0.0839 t 960 new 0.28) lr 1.00e-05 gnorm 0.075 5.89s mem 15.6GB +step 1582/5000 loss 0.0962 (w 0.1228 mse 0.1116 t 940 new 0.23) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 1583/5000 loss 0.1013 (w 0.1086 mse 0.1043 t 663 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1584/5000 loss 0.0750 (w 0.1103 mse 0.1046 t 821 new 0.25) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 1585/5000 loss 0.1039 (w 0.7547 mse 0.7609 t 25 new 0.09) lr 1.00e-05 gnorm 0.056 5.72s mem 15.6GB +step 1586/5000 loss 0.1022 (w 0.0771 mse 0.0739 t 919 new 0.21) lr 1.00e-05 gnorm 0.131 5.70s mem 15.6GB +step 1587/5000 loss 0.1148 (w 0.1068 mse 0.1074 t 377 new 0.24) lr 1.00e-05 gnorm 0.060 5.67s mem 15.6GB +step 1588/5000 loss 0.0622 (w 0.0693 mse 0.0697 t 560 new 0.23) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 1589/5000 loss 0.0910 (w 0.0756 mse 0.0765 t 935 new 0.22) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 1590/5000 loss 0.0638 (w 0.0415 mse 0.0435 t 870 new 0.13) lr 1.00e-05 gnorm 0.058 5.89s mem 15.6GB +step 1591/5000 loss 0.1214 (w 0.0606 mse 0.0622 t 762 new 0.24) lr 1.00e-05 gnorm 0.054 5.95s mem 15.6GB +step 1592/5000 loss 0.0533 (w 0.1638 mse 0.1583 t 965 new 0.16) lr 1.00e-05 gnorm 0.070 5.93s mem 15.6GB +step 1593/5000 loss 0.1147 (w 0.0833 mse 0.0814 t 417 new 0.18) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 1594/5000 loss 0.0550 (w 0.1254 mse 0.1298 t 983 new 0.24) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 1595/5000 loss 0.0952 (w 0.0863 mse 0.0788 t 800 new 0.27) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1596/5000 loss 0.0773 (w 0.0984 mse 0.0907 t 963 new 0.10) lr 1.00e-05 gnorm 0.057 5.67s mem 15.6GB +step 1597/5000 loss 0.0764 (w 0.0537 mse 0.0573 t 973 new 0.21) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1598/5000 loss 0.0858 (w 0.0628 mse 0.0626 t 707 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 1599/5000 loss 0.0696 (w 0.0793 mse 0.0719 t 697 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 1600/5000 loss 0.0900 (w 0.0656 mse 0.0630 t 863 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1601/5000 loss 0.0929 (w 0.0719 mse 0.0686 t 865 new 0.09) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1602/5000 loss 0.1037 (w 0.1599 mse 0.1861 t 114 new 0.22) lr 1.00e-05 gnorm 0.063 5.78s mem 15.6GB +step 1603/5000 loss 0.0799 (w 0.0546 mse 0.0508 t 728 new 0.24) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 1604/5000 loss 0.0463 (w 0.1958 mse 0.1937 t 979 new 0.24) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1605/5000 loss 0.0480 (w 0.0638 mse 0.0670 t 931 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1606/5000 loss 0.0427 (w 0.0649 mse 0.0639 t 706 new 0.24) lr 1.00e-05 gnorm 0.077 5.73s mem 15.6GB +step 1607/5000 loss 0.1345 (w 0.0987 mse 0.0946 t 515 new 0.26) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 1608/5000 loss 0.0758 (w 0.0837 mse 0.0903 t 955 new 0.20) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 1609/5000 loss 0.1082 (w 0.0842 mse 0.0816 t 679 new 0.20) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1610/5000 loss 0.0873 (w 0.6433 mse 0.6555 t 996 new 0.23) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 1611/5000 loss 0.0694 (w 0.0485 mse 0.0486 t 748 new 0.23) lr 1.00e-05 gnorm 0.061 5.91s mem 15.6GB +step 1612/5000 loss 0.0639 (w 0.0954 mse 0.0912 t 674 new 0.28) lr 1.00e-05 gnorm 0.097 5.68s mem 15.6GB +step 1613/5000 loss 0.0899 (w 0.1021 mse 0.1015 t 664 new 0.29) lr 1.00e-05 gnorm 0.086 5.76s mem 15.6GB +step 1614/5000 loss 0.0837 (w 0.0554 mse 0.0560 t 660 new 0.27) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1615/5000 loss 0.0907 (w 0.1356 mse 0.1373 t 957 new 0.18) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1616/5000 loss 0.0731 (w 0.0969 mse 0.0925 t 961 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 1617/5000 loss 0.0652 (w 0.1142 mse 0.1087 t 347 new 0.25) lr 1.00e-05 gnorm 0.082 5.72s mem 15.6GB +step 1618/5000 loss 0.1150 (w 0.1037 mse 0.1050 t 866 new 0.16) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1619/5000 loss 0.0592 (w 0.1962 mse 0.1932 t 981 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1620/5000 loss 0.1048 (w 0.0617 mse 0.0606 t 759 new 0.24) lr 1.00e-05 gnorm 0.089 5.77s mem 15.6GB +step 1621/5000 loss 0.0925 (w 0.0727 mse 0.0681 t 906 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 1622/5000 loss 0.0836 (w 0.0856 mse 0.0829 t 551 new 0.26) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1623/5000 loss 0.0607 (w 0.0629 mse 0.0635 t 815 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 1624/5000 loss 0.1398 (w 0.0668 mse 0.0656 t 399 new 0.22) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 1625/5000 loss 0.0775 (w 0.0694 mse 0.0611 t 765 new 0.25) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 1626/5000 loss 0.0617 (w 0.1154 mse 0.1133 t 516 new 0.28) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 1627/5000 loss 0.1194 (w 0.0981 mse 0.0987 t 403 new 0.25) lr 1.00e-05 gnorm 0.062 5.89s mem 15.6GB +step 1628/5000 loss 0.0841 (w 0.0441 mse 0.0458 t 556 new 0.23) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 1629/5000 loss 0.0803 (w 0.1327 mse 0.1280 t 938 new 0.19) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1630/5000 loss 0.1025 (w 0.0906 mse 0.0848 t 600 new 0.30) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1631/5000 loss 0.0825 (w 0.0752 mse 0.0750 t 904 new 0.23) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 1632/5000 loss 0.1181 (w 0.1111 mse 0.1095 t 829 new 0.19) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1633/5000 loss 0.0835 (w 0.1013 mse 0.0909 t 954 new 0.26) lr 1.00e-05 gnorm 0.064 5.76s mem 15.6GB +step 1634/5000 loss 0.0743 (w 0.0710 mse 0.0722 t 878 new 0.27) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 1635/5000 loss 0.0254 (w 0.1617 mse 0.1605 t 973 new 0.18) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1636/5000 loss 0.0989 (w 0.1797 mse 0.1758 t 996 new 0.14) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 1637/5000 loss 0.0542 (w 0.1166 mse 0.1121 t 960 new 0.22) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 1638/5000 loss 0.1354 (w 0.1250 mse 0.1186 t 434 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1639/5000 loss 0.1185 (w 0.0346 mse 0.0387 t 440 new 0.21) lr 1.00e-05 gnorm 0.059 5.85s mem 15.6GB +step 1640/5000 loss 0.0552 (w 0.1545 mse 0.1425 t 982 new 0.28) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1641/5000 loss 0.0819 (w 0.1666 mse 0.1718 t 989 new 0.23) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 1642/5000 loss 0.0943 (w 0.0704 mse 0.0711 t 784 new 0.26) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 1643/5000 loss 0.1212 (w 0.3464 mse 0.3484 t 126 new 0.21) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1644/5000 loss 0.0880 (w 0.1889 mse 0.1821 t 146 new 0.20) lr 1.00e-05 gnorm 0.066 5.67s mem 15.6GB +step 1645/5000 loss 0.0890 (w 0.0505 mse 0.0526 t 701 new 0.18) lr 1.00e-05 gnorm 0.071 5.72s mem 15.6GB +step 1646/5000 loss 0.0997 (w 0.0643 mse 0.0595 t 782 new 0.26) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 1647/5000 loss 0.0882 (w 0.1298 mse 0.1200 t 934 new 0.28) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1648/5000 loss 0.1251 (w 0.1191 mse 0.1164 t 864 new 0.23) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 1649/5000 loss 0.0801 (w 0.0816 mse 0.0745 t 717 new 0.25) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 1650/5000 loss 0.1059 (w 0.1101 mse 0.1054 t 552 new 0.21) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 1651/5000 loss 0.0665 (w 0.1094 mse 0.1038 t 902 new 0.29) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1652/5000 loss 0.0950 (w 0.0997 mse 0.0958 t 800 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1653/5000 loss 0.1025 (w 0.0564 mse 0.0601 t 836 new 0.17) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 1654/5000 loss 0.1293 (w 0.0779 mse 0.0713 t 900 new 0.27) lr 1.00e-05 gnorm 0.074 5.76s mem 15.6GB +step 1655/5000 loss 0.0939 (w 0.1738 mse 0.1692 t 985 new 0.25) lr 1.00e-05 gnorm 0.062 5.71s mem 15.6GB +step 1656/5000 loss 0.0726 (w 0.4718 mse 0.4653 t 80 new 0.25) lr 1.00e-05 gnorm 0.066 5.71s mem 15.6GB +step 1657/5000 loss 0.0843 (w 0.0698 mse 0.0671 t 528 new 0.23) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +step 1658/5000 loss 0.1195 (w 0.1431 mse 0.1387 t 971 new 0.26) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 1659/5000 loss 0.0975 (w 0.0670 mse 0.0631 t 845 new 0.24) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 1660/5000 loss 0.0674 (w 0.1804 mse 0.1723 t 982 new 0.23) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 1661/5000 loss 0.1031 (w 0.0337 mse 0.0407 t 328 new 0.23) lr 1.00e-05 gnorm 0.110 5.95s mem 15.6GB +step 1662/5000 loss 0.0441 (w 0.0666 mse 0.0603 t 825 new 0.21) lr 1.00e-05 gnorm 0.063 5.90s mem 15.6GB +step 1663/5000 loss 0.0695 (w 0.2209 mse 0.2193 t 176 new 0.20) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 1664/5000 loss 0.0749 (w 0.1478 mse 0.1320 t 993 new 0.25) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 1665/5000 loss 0.1275 (w 0.2038 mse 0.1914 t 978 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1666/5000 loss 0.1022 (w 0.0417 mse 0.0438 t 960 new 0.11) lr 1.00e-05 gnorm 0.085 5.86s mem 15.6GB +step 1667/5000 loss 0.1525 (w 0.1682 mse 0.1761 t 194 new 0.22) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 1668/5000 loss 0.0825 (w 0.1358 mse 0.1339 t 918 new 0.17) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1669/5000 loss 0.1029 (w 0.1476 mse 0.1487 t 1000 new 0.21) lr 1.00e-05 gnorm 0.075 5.91s mem 15.6GB +step 1670/5000 loss 0.1030 (w 0.0360 mse 0.0412 t 593 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1671/5000 loss 0.1376 (w 0.1498 mse 0.1383 t 996 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 1672/5000 loss 0.0435 (w 0.1094 mse 0.1056 t 887 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1673/5000 loss 0.0950 (w 0.0965 mse 0.0888 t 845 new 0.21) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1674/5000 loss 0.0982 (w 0.1004 mse 0.0956 t 971 new 0.28) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 1675/5000 loss 0.0926 (w 0.0760 mse 0.0818 t 403 new 0.22) lr 1.00e-05 gnorm 0.179 5.74s mem 15.6GB +step 1676/5000 loss 0.0810 (w 0.0648 mse 0.0607 t 910 new 0.24) lr 1.00e-05 gnorm 0.084 5.87s mem 15.6GB +step 1677/5000 loss 0.0504 (w 0.0597 mse 0.0593 t 952 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1678/5000 loss 0.0874 (w 0.1364 mse 0.1290 t 988 new 0.16) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 1679/5000 loss 0.0460 (w 0.0547 mse 0.0531 t 631 new 0.20) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 1680/5000 loss 0.0809 (w 0.0482 mse 0.0501 t 725 new 0.16) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1681/5000 loss 0.1034 (w 0.0687 mse 0.0702 t 931 new 0.29) lr 1.00e-05 gnorm 0.103 5.69s mem 15.6GB +step 1682/5000 loss 0.0617 (w 0.0535 mse 0.0556 t 869 new 0.25) lr 1.00e-05 gnorm 0.074 5.95s mem 15.6GB +step 1683/5000 loss 0.0907 (w 0.0649 mse 0.0634 t 869 new 0.13) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 1684/5000 loss 0.1181 (w 0.0826 mse 0.0748 t 886 new 0.28) lr 1.00e-05 gnorm 0.098 5.69s mem 15.6GB +step 1685/5000 loss 0.0752 (w 0.0881 mse 0.0956 t 961 new 0.18) lr 1.00e-05 gnorm 0.065 5.74s mem 15.6GB +step 1686/5000 loss 0.0818 (w 0.1533 mse 0.1526 t 979 new 0.27) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1687/5000 loss 0.1071 (w 0.0772 mse 0.0693 t 842 new 0.24) lr 1.00e-05 gnorm 0.075 5.75s mem 15.6GB +step 1688/5000 loss 0.0870 (w 0.1006 mse 0.0980 t 943 new 0.25) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1689/5000 loss 0.1673 (w 0.0632 mse 0.0625 t 685 new 0.19) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 1690/5000 loss 0.1351 (w 0.1267 mse 0.1275 t 367 new 0.14) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 1691/5000 loss 0.1125 (w 0.0970 mse 0.0954 t 797 new 0.24) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 1692/5000 loss 0.0952 (w 0.0664 mse 0.0686 t 861 new 0.27) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1693/5000 loss 0.1111 (w 0.1368 mse 0.1292 t 974 new 0.21) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +step 1694/5000 loss 0.1077 (w 0.1095 mse 0.1077 t 387 new 0.21) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1695/5000 loss 0.1282 (w 0.0821 mse 0.0790 t 968 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1696/5000 loss 0.0876 (w 0.0823 mse 0.0750 t 688 new 0.25) lr 1.00e-05 gnorm 0.066 5.74s mem 15.6GB +step 1697/5000 loss 0.1236 (w 0.1514 mse 0.1485 t 252 new 0.24) lr 1.00e-05 gnorm 0.060 5.78s mem 15.6GB +step 1698/5000 loss 0.0995 (w 0.0534 mse 0.0495 t 861 new 0.21) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 1699/5000 loss 0.0891 (w 0.0997 mse 0.0945 t 931 new 0.27) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1700/5000 loss 0.0852 (w 0.1620 mse 0.1536 t 968 new 0.22) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1701/5000 loss 0.0808 (w 0.1491 mse 0.1369 t 964 new 0.24) lr 1.00e-05 gnorm 0.070 5.90s mem 15.6GB +step 1702/5000 loss 0.0893 (w 0.1119 mse 0.1134 t 297 new 0.25) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 1703/5000 loss 0.0966 (w 0.1256 mse 0.1160 t 627 new 0.28) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1704/5000 loss 0.0807 (w 0.0923 mse 0.0813 t 821 new 0.26) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1705/5000 loss 0.0494 (w 0.1033 mse 0.1004 t 980 new 0.25) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 1706/5000 loss 0.1054 (w 0.0889 mse 0.0877 t 546 new 0.13) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 1707/5000 loss 0.1123 (w 0.1611 mse 0.1514 t 966 new 0.25) lr 1.00e-05 gnorm 0.072 5.95s mem 15.6GB +step 1708/5000 loss 0.1173 (w 0.1139 mse 0.1102 t 367 new 0.26) lr 1.00e-05 gnorm 0.065 6.00s mem 15.6GB +step 1709/5000 loss 0.0888 (w 0.1162 mse 0.1145 t 924 new 0.15) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 1710/5000 loss 0.1226 (w 0.0894 mse 0.0832 t 890 new 0.17) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1711/5000 loss 0.0858 (w 0.0916 mse 0.0907 t 443 new 0.23) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 1712/5000 loss 0.0482 (w 0.0210 mse 0.0227 t 913 new 0.13) lr 1.00e-05 gnorm 0.059 5.90s mem 15.6GB +step 1713/5000 loss 0.1018 (w 0.0794 mse 0.0795 t 478 new 0.26) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 1714/5000 loss 0.0742 (w 0.0705 mse 0.0704 t 776 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 1715/5000 loss 0.0791 (w 0.0615 mse 0.0630 t 831 new 0.21) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1716/5000 loss 0.0728 (w 0.2187 mse 0.1987 t 996 new 0.25) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 1717/5000 loss 0.1213 (w 0.0516 mse 0.0511 t 885 new 0.17) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 1718/5000 loss 0.0880 (w 0.1324 mse 0.1242 t 971 new 0.28) lr 1.00e-05 gnorm 0.077 5.79s mem 15.6GB +step 1719/5000 loss 0.0843 (w 0.1322 mse 0.1223 t 968 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 1720/5000 loss 0.1222 (w 0.1002 mse 0.0897 t 947 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1721/5000 loss 0.0783 (w 0.2571 mse 0.2335 t 998 new 0.27) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1722/5000 loss 0.1006 (w 0.0958 mse 0.0933 t 834 new 0.20) lr 1.00e-05 gnorm 0.067 5.89s mem 15.6GB +step 1723/5000 loss 0.0536 (w 0.0622 mse 0.0646 t 794 new 0.13) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1724/5000 loss 0.0924 (w 0.0612 mse 0.0594 t 598 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 1725/5000 loss 0.0752 (w 0.0708 mse 0.0694 t 784 new 0.30) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 1726/5000 loss 0.1393 (w 0.1583 mse 0.1532 t 367 new 0.20) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +step 1727/5000 loss 0.0774 (w 0.0455 mse 0.0429 t 810 new 0.12) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 1728/5000 loss 0.0831 (w 0.0655 mse 0.0606 t 781 new 0.26) lr 1.00e-05 gnorm 0.052 5.72s mem 15.6GB +step 1729/5000 loss 0.0965 (w 0.1661 mse 0.1385 t 997 new 0.18) lr 1.00e-05 gnorm 0.101 5.69s mem 15.6GB +step 1730/5000 loss 0.0765 (w 0.0679 mse 0.0668 t 744 new 0.27) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 1731/5000 loss 0.0605 (w 0.0680 mse 0.0681 t 791 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1732/5000 loss 0.0906 (w 0.1220 mse 0.1170 t 785 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1733/5000 loss 0.0821 (w 0.0445 mse 0.0450 t 569 new 0.20) lr 1.00e-05 gnorm 0.101 5.69s mem 15.6GB +step 1734/5000 loss 0.1391 (w 0.0674 mse 0.0690 t 562 new 0.21) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 1735/5000 loss 0.0825 (w 0.0941 mse 0.0972 t 493 new 0.23) lr 1.00e-05 gnorm 0.088 5.92s mem 15.6GB +step 1736/5000 loss 0.1614 (w 0.1809 mse 0.1856 t 225 new 0.27) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 1737/5000 loss 0.0913 (w 0.1018 mse 0.1025 t 995 new 0.20) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 1738/5000 loss 0.1296 (w 0.0959 mse 0.0957 t 428 new 0.29) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 1739/5000 loss 0.1192 (w 0.0718 mse 0.0748 t 666 new 0.16) lr 1.00e-05 gnorm 0.088 5.79s mem 15.6GB +step 1740/5000 loss 0.0618 (w 0.0696 mse 0.0664 t 939 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1741/5000 loss 0.1032 (w 0.1273 mse 0.1187 t 969 new 0.27) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 1742/5000 loss 0.0540 (w 0.1097 mse 0.1035 t 980 new 0.15) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 1743/5000 loss 0.1499 (w 0.2892 mse 0.2860 t 105 new 0.16) lr 1.00e-05 gnorm 0.078 5.91s mem 15.6GB +step 1744/5000 loss 0.0900 (w 0.1047 mse 0.1004 t 727 new 0.23) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 1745/5000 loss 0.0494 (w 0.0425 mse 0.0427 t 562 new 0.14) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1746/5000 loss 0.0600 (w 0.0873 mse 0.0793 t 896 new 0.18) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 1747/5000 loss 0.1386 (w 0.1251 mse 0.1223 t 317 new 0.14) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 1748/5000 loss 0.0822 (w 0.1381 mse 0.1320 t 967 new 0.25) lr 1.00e-05 gnorm 0.066 5.79s mem 15.6GB +step 1749/5000 loss 0.1199 (w 0.1159 mse 0.1114 t 907 new 0.25) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1750/5000 loss 0.0791 (w 0.0681 mse 0.0685 t 933 new 0.22) lr 1.00e-05 gnorm 0.068 5.71s mem 15.6GB +step 1751/5000 loss 0.0997 (w 0.0943 mse 0.0929 t 559 new 0.23) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1752/5000 loss 0.0857 (w 0.0881 mse 0.0863 t 706 new 0.24) lr 1.00e-05 gnorm 0.089 6.47s mem 15.6GB +step 1753/5000 loss 0.0401 (w 0.1202 mse 0.1114 t 964 new 0.20) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 1754/5000 loss 0.0412 (w 0.1734 mse 0.1657 t 989 new 0.22) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 1755/5000 loss 0.1388 (w 0.0686 mse 0.0640 t 892 new 0.11) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1756/5000 loss 0.1166 (w 0.0879 mse 0.0816 t 698 new 0.27) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1757/5000 loss 0.0545 (w 0.0769 mse 0.0763 t 904 new 0.25) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 1758/5000 loss 0.0631 (w 0.0447 mse 0.0443 t 871 new 0.09) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1759/5000 loss 0.0635 (w 0.1650 mse 0.1622 t 229 new 0.22) lr 1.00e-05 gnorm 0.057 5.93s mem 15.6GB +step 1760/5000 loss 0.1090 (w 0.0895 mse 0.0897 t 756 new 0.14) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1761/5000 loss 0.0797 (w 0.0993 mse 0.0926 t 887 new 0.17) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +step 1762/5000 loss 0.0647 (w 0.0785 mse 0.0725 t 815 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 1763/5000 loss 0.0846 (w 0.1149 mse 0.1183 t 828 new 0.21) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 1764/5000 loss 0.0719 (w 0.1271 mse 0.1151 t 951 new 0.26) lr 1.00e-05 gnorm 0.073 5.96s mem 15.6GB +step 1765/5000 loss 0.0869 (w 0.0499 mse 0.0495 t 900 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 1766/5000 loss 0.0912 (w 0.1404 mse 0.1383 t 432 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1767/5000 loss 0.1339 (w 0.1247 mse 0.1111 t 923 new 0.16) lr 1.00e-05 gnorm 0.061 5.82s mem 15.6GB +step 1768/5000 loss 0.1138 (w 0.1847 mse 0.1679 t 993 new 0.27) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1769/5000 loss 0.1004 (w 0.1213 mse 0.1193 t 344 new 0.26) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 1770/5000 loss 0.1179 (w 0.0831 mse 0.0778 t 856 new 0.25) lr 1.00e-05 gnorm 0.061 5.96s mem 15.6GB +step 1771/5000 loss 0.0465 (w 0.2215 mse 0.2112 t 997 new 0.13) lr 1.00e-05 gnorm 0.059 5.71s mem 15.6GB +step 1772/5000 loss 0.0967 (w 0.3867 mse 0.4022 t 999 new 0.22) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 1773/5000 loss 0.1488 (w 0.0432 mse 0.0440 t 637 new 0.13) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1774/5000 loss 0.0724 (w 0.0745 mse 0.0749 t 797 new 0.24) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 1775/5000 loss 0.0765 (w 0.0649 mse 0.0645 t 497 new 0.25) lr 1.00e-05 gnorm 0.070 5.89s mem 15.6GB +step 1776/5000 loss 0.0849 (w 0.2347 mse 0.2289 t 194 new 0.23) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 1777/5000 loss 0.0809 (w 0.0991 mse 0.0947 t 958 new 0.20) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1778/5000 loss 0.0934 (w 0.0865 mse 0.0799 t 905 new 0.25) lr 1.00e-05 gnorm 0.060 5.81s mem 15.6GB +step 1779/5000 loss 0.0725 (w 0.0799 mse 0.0724 t 782 new 0.26) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 1780/5000 loss 0.0722 (w 0.0766 mse 0.0695 t 585 new 0.29) lr 1.00e-05 gnorm 0.058 5.75s mem 15.6GB +step 1781/5000 loss 0.0701 (w 0.0784 mse 0.0714 t 805 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1782/5000 loss 0.1238 (w 0.1118 mse 0.1153 t 807 new 0.23) lr 1.00e-05 gnorm 0.059 5.95s mem 15.6GB +step 1783/5000 loss 0.0880 (w 0.1760 mse 0.1727 t 336 new 0.29) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1784/5000 loss 0.1031 (w 0.0691 mse 0.0638 t 790 new 0.27) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1785/5000 loss 0.0790 (w 0.0671 mse 0.0661 t 467 new 0.17) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1786/5000 loss 0.1322 (w 0.1021 mse 0.0958 t 741 new 0.25) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 1787/5000 loss 0.1124 (w 0.0621 mse 0.0614 t 941 new 0.07) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 1788/5000 loss 0.0705 (w 0.0872 mse 0.0800 t 926 new 0.25) lr 1.00e-05 gnorm 0.067 5.88s mem 15.6GB +step 1789/5000 loss 0.0503 (w 0.0572 mse 0.0562 t 855 new 0.12) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1790/5000 loss 0.0782 (w 0.0626 mse 0.0593 t 855 new 0.23) lr 1.00e-05 gnorm 0.070 5.90s mem 15.6GB +step 1791/5000 loss 0.0651 (w 0.0352 mse 0.0341 t 602 new 0.21) lr 1.00e-05 gnorm 0.065 5.74s mem 15.6GB +step 1792/5000 loss 0.0882 (w 0.1407 mse 0.1316 t 976 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 1793/5000 loss 0.0984 (w 0.1194 mse 0.1160 t 640 new 0.19) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 1794/5000 loss 0.1036 (w 0.0932 mse 0.0907 t 825 new 0.30) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1795/5000 loss 0.0790 (w 0.0611 mse 0.0673 t 484 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1796/5000 loss 0.1075 (w 0.0398 mse 0.0446 t 719 new 0.23) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 1797/5000 loss 0.1244 (w 0.1029 mse 0.0986 t 875 new 0.17) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +step 1798/5000 loss 0.0824 (w 0.1073 mse 0.1009 t 878 new 0.24) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 1799/5000 loss 0.0727 (w 0.1275 mse 0.1189 t 949 new 0.21) lr 1.00e-05 gnorm 0.080 5.91s mem 15.6GB +step 1800/5000 loss 0.0919 (w 0.0718 mse 0.0678 t 851 new 0.26) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1801/5000 loss 0.0723 (w 0.0556 mse 0.0515 t 814 new 0.31) lr 1.00e-05 gnorm 0.065 5.72s mem 15.6GB +step 1802/5000 loss 0.0549 (w 0.0750 mse 0.0764 t 915 new 0.23) lr 1.00e-05 gnorm 0.118 5.70s mem 15.6GB +step 1803/5000 loss 0.0999 (w 0.0822 mse 0.0787 t 749 new 0.26) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +step 1804/5000 loss 0.1245 (w 0.0891 mse 0.0843 t 541 new 0.20) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1805/5000 loss 0.1497 (w 0.0658 mse 0.0692 t 493 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1806/5000 loss 0.0889 (w 0.0417 mse 0.0403 t 541 new 0.25) lr 1.00e-05 gnorm 0.089 5.89s mem 15.6GB +step 1807/5000 loss 0.0810 (w 0.0830 mse 0.0755 t 921 new 0.22) lr 1.00e-05 gnorm 0.057 5.91s mem 15.6GB +step 1808/5000 loss 0.0661 (w 0.1050 mse 0.1030 t 867 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 1809/5000 loss 0.0465 (w 0.0720 mse 0.0650 t 910 new 0.15) lr 1.00e-05 gnorm 0.057 5.73s mem 15.6GB +step 1810/5000 loss 0.1125 (w 0.0684 mse 0.0712 t 563 new 0.18) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1811/5000 loss 0.0807 (w 0.0822 mse 0.0845 t 832 new 0.27) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1812/5000 loss 0.0405 (w 0.0606 mse 0.0605 t 883 new 0.17) lr 1.00e-05 gnorm 0.071 5.91s mem 15.6GB +step 1813/5000 loss 0.0735 (w 0.1179 mse 0.1117 t 955 new 0.15) lr 1.00e-05 gnorm 0.075 5.84s mem 15.6GB +step 1814/5000 loss 0.1049 (w 0.5544 mse 0.5560 t 66 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1815/5000 loss 0.0489 (w 0.0676 mse 0.0629 t 926 new 0.11) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 1816/5000 loss 0.0715 (w 0.0969 mse 0.0937 t 916 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1817/5000 loss 0.0560 (w 0.0582 mse 0.0563 t 766 new 0.25) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 1818/5000 loss 0.0878 (w 0.1079 mse 0.1058 t 548 new 0.22) lr 1.00e-05 gnorm 0.135 5.69s mem 15.6GB +step 1819/5000 loss 0.0664 (w 0.0836 mse 0.0745 t 801 new 0.24) lr 1.00e-05 gnorm 0.083 5.81s mem 15.6GB +step 1820/5000 loss 0.0677 (w 0.0654 mse 0.0652 t 798 new 0.30) lr 1.00e-05 gnorm 0.067 6.01s mem 15.6GB +step 1821/5000 loss 0.2001 (w 0.1526 mse 0.1532 t 320 new 0.21) lr 1.00e-05 gnorm 0.113 5.69s mem 15.6GB +step 1822/5000 loss 0.0706 (w 0.0549 mse 0.0524 t 762 new 0.19) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +step 1823/5000 loss 0.1373 (w 0.1067 mse 0.1069 t 484 new 0.17) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1824/5000 loss 0.0781 (w 0.0838 mse 0.0781 t 923 new 0.14) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 1825/5000 loss 0.0699 (w 0.0543 mse 0.0544 t 867 new 0.25) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +step 1826/5000 loss 0.0785 (w 0.0874 mse 0.0794 t 929 new 0.15) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1827/5000 loss 0.0985 (w 0.0810 mse 0.0820 t 878 new 0.21) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 1828/5000 loss 0.1063 (w 0.1263 mse 0.1216 t 357 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1829/5000 loss 0.0850 (w 0.1069 mse 0.1005 t 933 new 0.21) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +step 1830/5000 loss 0.1235 (w 0.1239 mse 0.1230 t 288 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1831/5000 loss 0.1005 (w 0.0504 mse 0.0481 t 777 new 0.20) lr 1.00e-05 gnorm 0.064 5.87s mem 15.6GB +step 1832/5000 loss 0.0471 (w 0.1481 mse 0.1352 t 996 new 0.13) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 1833/5000 loss 0.0905 (w 0.1198 mse 0.1169 t 980 new 0.16) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 1834/5000 loss 0.0774 (w 0.0953 mse 0.0923 t 994 new 0.28) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 1835/5000 loss 0.0624 (w 0.0589 mse 0.0591 t 772 new 0.26) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 1836/5000 loss 0.1068 (w 0.0461 mse 0.0441 t 987 new 0.14) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 1837/5000 loss 0.0897 (w 0.0950 mse 0.0961 t 724 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 1838/5000 loss 0.0964 (w 0.0308 mse 0.0322 t 786 new 0.09) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 1839/5000 loss 0.0910 (w 0.1152 mse 0.1083 t 960 new 0.25) lr 1.00e-05 gnorm 0.080 5.84s mem 15.6GB +step 1840/5000 loss 0.0706 (w 0.1994 mse 0.1798 t 985 new 0.14) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1841/5000 loss 0.0754 (w 0.1394 mse 0.1334 t 987 new 0.12) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1842/5000 loss 0.0996 (w 0.1152 mse 0.1094 t 979 new 0.21) lr 1.00e-05 gnorm 0.064 5.92s mem 15.6GB +step 1843/5000 loss 0.1120 (w 0.1048 mse 0.1031 t 969 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1844/5000 loss 0.0920 (w 0.1494 mse 0.1427 t 965 new 0.26) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1845/5000 loss 0.0533 (w 0.0769 mse 0.0794 t 990 new 0.08) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1846/5000 loss 0.0787 (w 0.0963 mse 0.0924 t 972 new 0.24) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +step 1847/5000 loss 0.0979 (w 0.0577 mse 0.0552 t 737 new 0.13) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 1848/5000 loss 0.0944 (w 0.0599 mse 0.0653 t 320 new 0.25) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 1849/5000 loss 0.0681 (w 0.0663 mse 0.0620 t 877 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 1850/5000 loss 0.0834 (w 0.0415 mse 0.0437 t 798 new 0.16) lr 1.00e-05 gnorm 0.073 5.81s mem 15.6GB +step 1851/5000 loss 0.0518 (w 0.1024 mse 0.0994 t 843 new 0.21) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 1852/5000 loss 0.1170 (w 0.0707 mse 0.0658 t 778 new 0.25) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +step 1853/5000 loss 0.0573 (w 0.0907 mse 0.0867 t 649 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1854/5000 loss 0.0914 (w 0.0447 mse 0.0414 t 778 new 0.23) lr 1.00e-05 gnorm 0.070 6.07s mem 15.6GB +step 1855/5000 loss 0.0595 (w 0.0907 mse 0.0890 t 459 new 0.24) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 1856/5000 loss 0.0763 (w 0.0642 mse 0.0650 t 829 new 0.24) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 1857/5000 loss 0.1128 (w 0.0831 mse 0.0797 t 574 new 0.25) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 1858/5000 loss 0.0907 (w 0.0561 mse 0.0569 t 851 new 0.19) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 1859/5000 loss 0.0396 (w 0.1924 mse 0.1767 t 984 new 0.18) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1860/5000 loss 0.0761 (w 0.1041 mse 0.0980 t 809 new 0.24) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 1861/5000 loss 0.0752 (w 0.0504 mse 0.0493 t 781 new 0.17) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 1862/5000 loss 0.0917 (w 0.0344 mse 0.0382 t 665 new 0.26) lr 1.00e-05 gnorm 0.120 5.71s mem 15.6GB +step 1863/5000 loss 0.0558 (w 0.0723 mse 0.0716 t 747 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 1864/5000 loss 0.0699 (w 0.0903 mse 0.0940 t 273 new 0.20) lr 1.00e-05 gnorm 0.069 5.79s mem 15.6GB +step 1865/5000 loss 0.1207 (w 0.0721 mse 0.0694 t 686 new 0.23) lr 1.00e-05 gnorm 0.108 5.69s mem 15.6GB +step 1866/5000 loss 0.0932 (w 0.1007 mse 0.0929 t 945 new 0.26) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1867/5000 loss 0.1083 (w 0.1595 mse 0.1544 t 288 new 0.25) lr 1.00e-05 gnorm 0.077 6.19s mem 15.6GB +step 1868/5000 loss 0.0506 (w 0.2662 mse 0.2459 t 995 new 0.27) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 1869/5000 loss 0.1329 (w 0.2170 mse 0.2112 t 225 new 0.24) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +step 1870/5000 loss 0.0822 (w 0.0617 mse 0.0591 t 864 new 0.13) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 1871/5000 loss 0.0957 (w 0.1038 mse 0.1131 t 252 new 0.18) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 1872/5000 loss 0.0692 (w 0.0860 mse 0.0781 t 821 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 1873/5000 loss 0.0868 (w 0.1083 mse 0.1063 t 998 new 0.21) lr 1.00e-05 gnorm 0.064 5.82s mem 15.6GB +step 1874/5000 loss 0.0916 (w 0.1429 mse 0.1389 t 896 new 0.19) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1875/5000 loss 0.1002 (w 0.0922 mse 0.0861 t 476 new 0.27) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1876/5000 loss 0.0566 (w 0.0754 mse 0.0733 t 933 new 0.13) lr 1.00e-05 gnorm 0.078 5.91s mem 15.6GB +step 1877/5000 loss 0.0967 (w 0.0758 mse 0.0744 t 916 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1878/5000 loss 0.0656 (w 0.1471 mse 0.1364 t 963 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1879/5000 loss 0.0593 (w 0.0731 mse 0.0666 t 720 new 0.30) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 1880/5000 loss 0.0904 (w 0.1781 mse 0.1679 t 982 new 0.33) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1881/5000 loss 0.0687 (w 0.0975 mse 0.0975 t 912 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 1882/5000 loss 0.0828 (w 0.1436 mse 0.1417 t 999 new 0.08) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 1883/5000 loss 0.1426 (w 0.0311 mse 0.0370 t 578 new 0.23) lr 1.00e-05 gnorm 0.086 6.00s mem 15.6GB +step 1884/5000 loss 0.0640 (w 0.0914 mse 0.0902 t 866 new 0.20) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1885/5000 loss 0.0559 (w 0.0470 mse 0.0482 t 522 new 0.24) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1886/5000 loss 0.0914 (w 0.0648 mse 0.0647 t 961 new 0.13) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +step 1887/5000 loss 0.1283 (w 0.2481 mse 0.2340 t 988 new 0.29) lr 1.00e-05 gnorm 0.110 5.90s mem 15.6GB +step 1888/5000 loss 0.0805 (w 0.0667 mse 0.0639 t 873 new 0.24) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 1889/5000 loss 0.0631 (w 0.0991 mse 0.1006 t 977 new 0.18) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 1890/5000 loss 0.1068 (w 0.0837 mse 0.0815 t 888 new 0.21) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 1891/5000 loss 0.0917 (w 0.1317 mse 0.1248 t 991 new 0.20) lr 1.00e-05 gnorm 0.070 5.74s mem 15.6GB +step 1892/5000 loss 0.0888 (w 0.0533 mse 0.0509 t 700 new 0.25) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 1893/5000 loss 0.1161 (w 0.0761 mse 0.0721 t 883 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1894/5000 loss 0.1282 (w 0.0676 mse 0.0619 t 752 new 0.23) lr 1.00e-05 gnorm 0.075 5.82s mem 15.6GB +step 1895/5000 loss 0.1154 (w 0.0452 mse 0.0450 t 824 new 0.27) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1896/5000 loss 0.1047 (w 0.1483 mse 0.1403 t 945 new 0.30) lr 1.00e-05 gnorm 0.076 5.95s mem 15.6GB +step 1897/5000 loss 0.0817 (w 0.0511 mse 0.0506 t 540 new 0.13) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1898/5000 loss 0.1035 (w 0.1170 mse 0.1125 t 582 new 0.21) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1899/5000 loss 0.0921 (w 0.0558 mse 0.0566 t 802 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 1900/5000 loss 0.0876 (w 0.0689 mse 0.0647 t 879 new 0.28) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1901/5000 loss 0.0827 (w 0.0576 mse 0.0525 t 892 new 0.09) lr 1.00e-05 gnorm 0.061 5.89s mem 15.6GB +step 1902/5000 loss 0.1051 (w 0.1039 mse 0.1052 t 748 new 0.19) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 1903/5000 loss 0.0477 (w 0.1212 mse 0.1170 t 891 new 0.17) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 1904/5000 loss 0.0528 (w 0.1662 mse 0.1585 t 965 new 0.22) lr 1.00e-05 gnorm 0.060 5.78s mem 15.6GB +step 1905/5000 loss 0.0815 (w 0.2838 mse 0.2814 t 138 new 0.13) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +step 1906/5000 loss 0.0737 (w 0.1861 mse 0.1831 t 229 new 0.26) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 1907/5000 loss 0.0783 (w 0.1356 mse 0.1292 t 961 new 0.23) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 1908/5000 loss 0.0475 (w 0.0988 mse 0.0949 t 886 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1909/5000 loss 0.1250 (w 0.0592 mse 0.0563 t 793 new 0.29) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 1910/5000 loss 0.0777 (w 0.0774 mse 0.0716 t 848 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 1911/5000 loss 0.0832 (w 0.0961 mse 0.0949 t 643 new 0.19) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 1912/5000 loss 0.0840 (w 0.0640 mse 0.0614 t 748 new 0.15) lr 1.00e-05 gnorm 0.061 5.74s mem 15.6GB +step 1913/5000 loss 0.1091 (w 0.0906 mse 0.0869 t 761 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 1914/5000 loss 0.0768 (w 0.0290 mse 0.0305 t 822 new 0.10) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 1915/5000 loss 0.1077 (w 0.1275 mse 0.1202 t 761 new 0.28) lr 1.00e-05 gnorm 0.089 5.71s mem 15.6GB +step 1916/5000 loss 0.1285 (w 0.1191 mse 0.1251 t 198 new 0.30) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1917/5000 loss 0.0670 (w 0.0446 mse 0.0434 t 778 new 0.23) lr 1.00e-05 gnorm 0.057 6.02s mem 15.6GB +step 1918/5000 loss 0.0804 (w 0.1162 mse 0.1172 t 914 new 0.16) lr 1.00e-05 gnorm 0.067 5.90s mem 15.6GB +step 1919/5000 loss 0.0607 (w 0.2529 mse 0.2246 t 990 new 0.22) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 1920/5000 loss 0.1267 (w 0.1270 mse 0.1257 t 283 new 0.26) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 1921/5000 loss 0.0395 (w 0.1252 mse 0.1115 t 936 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1922/5000 loss 0.0589 (w 0.1442 mse 0.1425 t 970 new 0.22) lr 1.00e-05 gnorm 0.063 5.89s mem 15.6GB +step 1923/5000 loss 0.0651 (w 0.0615 mse 0.0609 t 883 new 0.14) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1924/5000 loss 0.1240 (w 0.1041 mse 0.0962 t 941 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1925/5000 loss 0.0997 (w 0.0926 mse 0.0898 t 394 new 0.21) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 1926/5000 loss 0.1272 (w 0.0769 mse 0.0813 t 908 new 0.23) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 1927/5000 loss 0.1005 (w 0.1883 mse 0.1976 t 172 new 0.27) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 1928/5000 loss 0.0710 (w 0.0764 mse 0.0705 t 748 new 0.22) lr 1.00e-05 gnorm 0.056 5.87s mem 15.6GB +step 1929/5000 loss 0.0897 (w 0.1245 mse 0.1150 t 907 new 0.27) lr 1.00e-05 gnorm 0.071 5.90s mem 15.6GB +step 1930/5000 loss 0.0847 (w 0.0685 mse 0.0641 t 863 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1931/5000 loss 0.1186 (w 0.0796 mse 0.0758 t 862 new 0.26) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 1932/5000 loss 0.0980 (w 0.1163 mse 0.1108 t 900 new 0.27) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1933/5000 loss 0.0715 (w 0.1071 mse 0.0987 t 851 new 0.23) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 1934/5000 loss 0.0688 (w 0.6153 mse 0.6234 t 10 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 1935/5000 loss 0.0893 (w 0.0893 mse 0.0817 t 969 new 0.23) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 1936/5000 loss 0.1359 (w 0.0751 mse 0.0753 t 853 new 0.28) lr 1.00e-05 gnorm 0.058 5.77s mem 15.6GB +step 1937/5000 loss 0.0533 (w 0.0263 mse 0.0296 t 879 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 1938/5000 loss 0.0418 (w 0.0943 mse 0.0878 t 996 new 0.19) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +step 1939/5000 loss 0.0869 (w 0.0627 mse 0.0593 t 552 new 0.15) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1940/5000 loss 0.1133 (w 0.0729 mse 0.0703 t 798 new 0.15) lr 1.00e-05 gnorm 0.058 7.19s mem 15.6GB +step 1941/5000 loss 0.1007 (w 0.0573 mse 0.0535 t 889 new 0.16) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 1942/5000 loss 0.0856 (w 0.0327 mse 0.0356 t 687 new 0.25) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 1943/5000 loss 0.1000 (w 0.0687 mse 0.0655 t 859 new 0.26) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 1944/5000 loss 0.0802 (w 0.1309 mse 0.1248 t 927 new 0.15) lr 1.00e-05 gnorm 0.062 5.90s mem 15.6GB +step 1945/5000 loss 0.1118 (w 0.0654 mse 0.0655 t 518 new 0.14) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 1946/5000 loss 0.0902 (w 0.1148 mse 0.1095 t 708 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 1947/5000 loss 0.1090 (w 0.0905 mse 0.0842 t 916 new 0.25) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +step 1948/5000 loss 0.0509 (w 0.1218 mse 0.1146 t 983 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1949/5000 loss 0.0783 (w 0.0763 mse 0.0740 t 890 new 0.17) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 1950/5000 loss 0.0962 (w 0.1426 mse 0.1403 t 283 new 0.29) lr 1.00e-05 gnorm 0.100 5.70s mem 15.6GB +step 1951/5000 loss 0.0538 (w 0.1038 mse 0.1004 t 947 new 0.25) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 1952/5000 loss 0.0785 (w 0.0703 mse 0.0700 t 863 new 0.22) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 1953/5000 loss 0.0918 (w 0.0647 mse 0.0617 t 832 new 0.25) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 1954/5000 loss 0.0950 (w 0.0854 mse 0.0845 t 634 new 0.10) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 1955/5000 loss 0.0992 (w 0.1990 mse 0.1819 t 985 new 0.23) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 1956/5000 loss 0.0930 (w 0.0767 mse 0.0697 t 902 new 0.26) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 1957/5000 loss 0.1392 (w 0.0447 mse 0.0475 t 587 new 0.16) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +step 1958/5000 loss 0.0705 (w 0.0596 mse 0.0608 t 671 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1959/5000 loss 0.0856 (w 0.1100 mse 0.1057 t 362 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 1960/5000 loss 0.0654 (w 0.9213 mse 0.9158 t 20 new 0.20) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 1961/5000 loss 0.0668 (w 0.0841 mse 0.0834 t 918 new 0.21) lr 1.00e-05 gnorm 0.058 5.76s mem 15.6GB +step 1962/5000 loss 0.1047 (w 0.0644 mse 0.0595 t 710 new 0.22) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1963/5000 loss 0.1095 (w 0.1047 mse 0.0934 t 921 new 0.26) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1964/5000 loss 0.1007 (w 0.1027 mse 0.1020 t 538 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 1965/5000 loss 0.0960 (w 0.1674 mse 0.1623 t 994 new 0.17) lr 1.00e-05 gnorm 0.059 5.89s mem 15.6GB +step 1966/5000 loss 0.0668 (w 0.0862 mse 0.0822 t 788 new 0.26) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 1967/5000 loss 0.0531 (w 0.1102 mse 0.1042 t 793 new 0.21) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 1968/5000 loss 0.0960 (w 0.0627 mse 0.0600 t 779 new 0.14) lr 1.00e-05 gnorm 0.062 5.90s mem 15.6GB +step 1969/5000 loss 0.0842 (w 0.0567 mse 0.0518 t 887 new 0.20) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 1970/5000 loss 0.0673 (w 0.1373 mse 0.1289 t 958 new 0.21) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 1971/5000 loss 0.1060 (w 0.0734 mse 0.0755 t 419 new 0.24) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 1972/5000 loss 0.0802 (w 0.1246 mse 0.1171 t 904 new 0.23) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 1973/5000 loss 0.0703 (w 0.0721 mse 0.0661 t 794 new 0.32) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 1974/5000 loss 0.1214 (w 0.2503 mse 0.2685 t 118 new 0.17) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 1975/5000 loss 0.0898 (w 0.0909 mse 0.0861 t 898 new 0.13) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 1976/5000 loss 0.0843 (w 0.0476 mse 0.0486 t 695 new 0.21) lr 1.00e-05 gnorm 0.066 5.72s mem 15.6GB +step 1977/5000 loss 0.1583 (w 0.1014 mse 0.0970 t 396 new 0.23) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 1978/5000 loss 0.0688 (w 0.0873 mse 0.0844 t 493 new 0.23) lr 1.00e-05 gnorm 0.066 5.71s mem 15.6GB +step 1979/5000 loss 0.1034 (w 0.0854 mse 0.0847 t 945 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 1980/5000 loss 0.0631 (w 0.0948 mse 0.0935 t 535 new 0.25) lr 1.00e-05 gnorm 0.055 5.92s mem 15.6GB +step 1981/5000 loss 0.0707 (w 0.1037 mse 0.0995 t 977 new 0.25) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 1982/5000 loss 0.0611 (w 0.0727 mse 0.0702 t 852 new 0.28) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 1983/5000 loss 0.1337 (w 0.1837 mse 0.1780 t 245 new 0.22) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 1984/5000 loss 0.0551 (w 0.1311 mse 0.1154 t 946 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1985/5000 loss 0.0777 (w 0.0570 mse 0.0576 t 768 new 0.17) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 1986/5000 loss 0.0851 (w 0.0733 mse 0.0725 t 658 new 0.22) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 1987/5000 loss 0.0791 (w 0.0584 mse 0.0576 t 502 new 0.15) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 1988/5000 loss 0.0863 (w 0.0616 mse 0.0549 t 744 new 0.23) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 1989/5000 loss 0.1135 (w 0.0579 mse 0.0575 t 882 new 0.13) lr 1.00e-05 gnorm 0.084 5.71s mem 15.6GB +step 1990/5000 loss 0.0564 (w 0.0545 mse 0.0505 t 871 new 0.17) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 1991/5000 loss 0.0731 (w 0.2554 mse 0.2534 t 142 new 0.23) lr 1.00e-05 gnorm 0.071 5.73s mem 15.6GB +step 1992/5000 loss 0.1016 (w 0.1107 mse 0.1074 t 964 new 0.19) lr 1.00e-05 gnorm 0.069 5.88s mem 15.6GB +step 1993/5000 loss 0.0883 (w 0.0712 mse 0.0656 t 909 new 0.27) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 1994/5000 loss 0.0841 (w 0.0542 mse 0.0557 t 901 new 0.19) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 1995/5000 loss 0.0544 (w 0.0890 mse 0.0879 t 797 new 0.19) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 1996/5000 loss 0.0905 (w 0.0804 mse 0.0731 t 820 new 0.20) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 1997/5000 loss 0.0697 (w 0.0707 mse 0.0660 t 881 new 0.21) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 1998/5000 loss 0.1106 (w 0.1128 mse 0.1120 t 242 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 1999/5000 loss 0.0890 (w 0.0577 mse 0.0564 t 705 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2000/5000 loss 0.0684 (w 0.0849 mse 0.0816 t 960 new 0.25) lr 1.00e-05 gnorm 0.067 5.96s mem 15.6GB +[val] step 2000 t=201: w=0.1763 mse=0.1788 (n=16) t=501: w=0.0732 mse=0.0732 (n=16) t=800: w=0.0618 mse=0.0607 (n=16) | mean w=0.1038 mse=0.1042 4s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step2000.safetensors 832 个张量 2.87 GB +step 2001/5000 loss 0.1310 (w 0.0629 mse 0.0632 t 714 new 0.24) lr 1.00e-05 gnorm 0.061 5.67s mem 15.6GB +step 2002/5000 loss 0.0954 (w 0.0934 mse 0.0879 t 947 new 0.15) lr 1.00e-05 gnorm 0.062 5.78s mem 15.6GB +step 2003/5000 loss 0.0767 (w 0.1401 mse 0.1357 t 960 new 0.22) lr 1.00e-05 gnorm 0.072 5.71s mem 15.6GB +step 2004/5000 loss 0.0924 (w 0.1098 mse 0.1128 t 235 new 0.08) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 2005/5000 loss 0.0872 (w 0.1576 mse 0.1513 t 978 new 0.20) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +step 2006/5000 loss 0.1091 (w 0.2360 mse 0.2410 t 101 new 0.21) lr 1.00e-05 gnorm 0.076 5.93s mem 15.6GB +step 2007/5000 loss 0.0841 (w 0.0592 mse 0.0547 t 824 new 0.26) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 2008/5000 loss 0.0934 (w 0.0456 mse 0.0481 t 818 new 0.18) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2009/5000 loss 0.1042 (w 0.1277 mse 0.1227 t 966 new 0.18) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 2010/5000 loss 0.0872 (w 0.0903 mse 0.0867 t 804 new 0.20) lr 1.00e-05 gnorm 0.056 5.90s mem 15.6GB +step 2011/5000 loss 0.0794 (w 0.0446 mse 0.0395 t 907 new 0.24) lr 1.00e-05 gnorm 0.072 6.78s mem 15.6GB +step 2012/5000 loss 0.0470 (w 0.0947 mse 0.0905 t 884 new 0.19) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 2013/5000 loss 0.1274 (w 0.0662 mse 0.0605 t 669 new 0.17) lr 1.00e-05 gnorm 0.067 5.79s mem 15.6GB +step 2014/5000 loss 0.0495 (w 0.1004 mse 0.0914 t 917 new 0.27) lr 1.00e-05 gnorm 0.061 5.72s mem 15.6GB +step 2015/5000 loss 0.1283 (w 0.1115 mse 0.1037 t 881 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 2016/5000 loss 0.0883 (w 0.0780 mse 0.0747 t 724 new 0.17) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2017/5000 loss 0.0705 (w 0.1780 mse 0.1955 t 150 new 0.24) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 2018/5000 loss 0.0668 (w 0.0673 mse 0.0649 t 523 new 0.18) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +step 2019/5000 loss 0.1000 (w 0.0994 mse 0.0958 t 750 new 0.23) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +step 2020/5000 loss 0.0497 (w 0.0335 mse 0.0377 t 535 new 0.26) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +step 2021/5000 loss 0.0618 (w 0.0394 mse 0.0412 t 759 new 0.13) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +step 2022/5000 loss 0.0698 (w 0.1478 mse 0.1381 t 949 new 0.27) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 2023/5000 loss 0.0561 (w 0.1057 mse 0.1010 t 980 new 0.19) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 2024/5000 loss 0.1077 (w 0.2213 mse 0.2457 t 97 new 0.26) lr 1.00e-05 gnorm 0.078 5.91s mem 15.6GB +step 2025/5000 loss 0.0643 (w 0.0605 mse 0.0567 t 818 new 0.28) lr 1.00e-05 gnorm 0.066 5.91s mem 15.6GB +step 2026/5000 loss 0.0798 (w 0.0598 mse 0.0607 t 712 new 0.22) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 2027/5000 loss 0.1217 (w 0.0961 mse 0.0967 t 986 new 0.19) lr 1.00e-05 gnorm 0.062 5.92s mem 15.6GB +step 2028/5000 loss 0.1273 (w 0.1341 mse 0.1291 t 288 new 0.26) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +step 2029/5000 loss 0.0831 (w 0.1095 mse 0.1022 t 929 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2030/5000 loss 0.1237 (w 0.1707 mse 0.1822 t 165 new 0.27) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 2031/5000 loss 0.0748 (w 0.3237 mse 0.3118 t 146 new 0.22) lr 1.00e-05 gnorm 0.050 5.79s mem 15.6GB +step 2032/5000 loss 0.0745 (w 0.0565 mse 0.0536 t 878 new 0.28) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +step 2033/5000 loss 0.0776 (w 0.9974 mse 0.9966 t 5 new 0.15) lr 1.00e-05 gnorm 0.063 5.82s mem 15.6GB +step 2034/5000 loss 0.1137 (w 0.2416 mse 0.2389 t 201 new 0.25) lr 1.00e-05 gnorm 0.065 6.07s mem 15.6GB +step 2035/5000 loss 0.0460 (w 0.0663 mse 0.0643 t 720 new 0.26) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +step 2036/5000 loss 0.0836 (w 0.0916 mse 0.0884 t 387 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 2037/5000 loss 0.1054 (w 0.0643 mse 0.0651 t 538 new 0.30) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 2038/5000 loss 0.0786 (w 0.1024 mse 0.1028 t 924 new 0.21) lr 1.00e-05 gnorm 0.071 5.76s mem 15.6GB +step 2039/5000 loss 0.1015 (w 0.0385 mse 0.0392 t 695 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2040/5000 loss 0.1246 (w 0.6114 mse 0.6035 t 57 new 0.25) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 2041/5000 loss 0.0482 (w 0.0753 mse 0.0790 t 967 new 0.18) lr 1.00e-05 gnorm 0.074 5.83s mem 15.6GB +step 2042/5000 loss 0.0921 (w 0.1163 mse 0.1162 t 941 new 0.22) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 2043/5000 loss 0.1297 (w 0.0761 mse 0.0747 t 931 new 0.16) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +step 2044/5000 loss 0.0753 (w 0.1063 mse 0.1011 t 927 new 0.23) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 2045/5000 loss 0.0937 (w 0.0899 mse 0.0872 t 910 new 0.29) lr 1.00e-05 gnorm 0.069 5.71s mem 15.6GB +step 2046/5000 loss 0.0457 (w 0.1256 mse 0.1257 t 998 new 0.22) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 2047/5000 loss 0.0616 (w 0.1411 mse 0.1421 t 941 new 0.16) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2048/5000 loss 0.0780 (w 0.1192 mse 0.1172 t 900 new 0.22) lr 1.00e-05 gnorm 0.055 5.93s mem 15.6GB +step 2049/5000 loss 0.1136 (w 0.1940 mse 0.2030 t 130 new 0.25) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 2050/5000 loss 0.0699 (w 0.1136 mse 0.1222 t 972 new 0.20) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2051/5000 loss 0.1224 (w 0.0613 mse 0.0560 t 730 new 0.24) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 2052/5000 loss 0.0936 (w 0.1679 mse 0.1658 t 994 new 0.25) lr 1.00e-05 gnorm 0.079 5.73s mem 15.6GB +step 2053/5000 loss 0.0587 (w 0.0540 mse 0.0532 t 717 new 0.25) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2054/5000 loss 0.1346 (w 0.0511 mse 0.0539 t 476 new 0.22) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 2055/5000 loss 0.0517 (w 0.0650 mse 0.0558 t 880 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2056/5000 loss 0.0830 (w 0.2908 mse 0.2824 t 142 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2057/5000 loss 0.1258 (w 0.0652 mse 0.0644 t 792 new 0.27) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 2058/5000 loss 0.0415 (w 0.0743 mse 0.0698 t 848 new 0.13) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2059/5000 loss 0.0740 (w 0.0855 mse 0.0819 t 730 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2060/5000 loss 0.1162 (w 0.1035 mse 0.0991 t 725 new 0.27) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2061/5000 loss 0.0408 (w 0.0741 mse 0.0728 t 860 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2062/5000 loss 0.0907 (w 0.0871 mse 0.0869 t 958 new 0.22) lr 1.00e-05 gnorm 0.064 5.73s mem 15.6GB +step 2063/5000 loss 0.0465 (w 0.1744 mse 0.1644 t 985 new 0.30) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +step 2064/5000 loss 0.1105 (w 0.0884 mse 0.0841 t 801 new 0.16) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2065/5000 loss 0.1041 (w 0.0383 mse 0.0393 t 670 new 0.21) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 2066/5000 loss 0.0576 (w 0.2061 mse 0.1873 t 970 new 0.25) lr 1.00e-05 gnorm 0.070 5.73s mem 15.6GB +step 2067/5000 loss 0.0757 (w 0.0873 mse 0.0958 t 945 new 0.14) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 2068/5000 loss 0.1162 (w 0.1112 mse 0.0980 t 954 new 0.25) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 2069/5000 loss 0.0977 (w 0.0623 mse 0.0617 t 806 new 0.24) lr 1.00e-05 gnorm 0.073 5.93s mem 15.6GB +step 2070/5000 loss 0.0976 (w 0.0930 mse 0.0872 t 562 new 0.22) lr 1.00e-05 gnorm 0.092 5.74s mem 15.6GB +step 2071/5000 loss 0.1478 (w 0.0716 mse 0.0726 t 508 new 0.24) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 2072/5000 loss 0.0677 (w 0.0657 mse 0.0644 t 914 new 0.21) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 2073/5000 loss 0.0869 (w 0.0943 mse 0.0903 t 391 new 0.24) lr 1.00e-05 gnorm 0.058 5.71s mem 15.6GB +step 2074/5000 loss 0.1112 (w 0.0705 mse 0.0735 t 975 new 0.23) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 2075/5000 loss 0.0484 (w 0.0653 mse 0.0631 t 845 new 0.24) lr 1.00e-05 gnorm 0.067 5.81s mem 15.6GB +step 2076/5000 loss 0.1183 (w 0.0410 mse 0.0440 t 788 new 0.18) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 2077/5000 loss 0.1026 (w 0.0474 mse 0.0477 t 677 new 0.27) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 2078/5000 loss 0.0585 (w 0.0696 mse 0.0676 t 806 new 0.29) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 2079/5000 loss 0.0649 (w 0.2327 mse 0.2128 t 998 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2080/5000 loss 0.1289 (w 0.1113 mse 0.0977 t 945 new 0.20) lr 1.00e-05 gnorm 0.105 5.69s mem 15.6GB +step 2081/5000 loss 0.1038 (w 0.1555 mse 0.1539 t 205 new 0.24) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 2082/5000 loss 0.1216 (w 0.0758 mse 0.0720 t 509 new 0.21) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 2083/5000 loss 0.1022 (w 0.0674 mse 0.0665 t 766 new 0.26) lr 1.00e-05 gnorm 0.064 5.86s mem 15.6GB +step 2084/5000 loss 0.0767 (w 0.0461 mse 0.0469 t 640 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2085/5000 loss 0.1233 (w 0.0570 mse 0.0575 t 859 new 0.20) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 2086/5000 loss 0.0654 (w 0.0408 mse 0.0399 t 745 new 0.30) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 2087/5000 loss 0.1319 (w 0.1127 mse 0.1078 t 878 new 0.19) lr 1.00e-05 gnorm 0.073 6.10s mem 15.6GB +step 2088/5000 loss 0.1377 (w 0.0860 mse 0.0843 t 678 new 0.26) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 2089/5000 loss 0.0911 (w 0.1144 mse 0.1023 t 941 new 0.24) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +step 2090/5000 loss 0.0675 (w 0.0580 mse 0.0572 t 893 new 0.26) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 2091/5000 loss 0.0520 (w 0.1006 mse 0.0969 t 892 new 0.22) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 2092/5000 loss 0.1084 (w 0.0968 mse 0.0921 t 893 new 0.23) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 2093/5000 loss 0.1365 (w 0.1296 mse 0.1323 t 201 new 0.23) lr 1.00e-05 gnorm 0.075 5.99s mem 15.6GB +step 2094/5000 loss 0.1044 (w 0.0602 mse 0.0608 t 766 new 0.24) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 2095/5000 loss 0.0585 (w 0.0445 mse 0.0446 t 888 new 0.08) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2096/5000 loss 0.0848 (w 0.0873 mse 0.0899 t 936 new 0.19) lr 1.00e-05 gnorm 0.078 5.74s mem 15.6GB +step 2097/5000 loss 0.0978 (w 0.0504 mse 0.0527 t 761 new 0.20) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2098/5000 loss 0.0966 (w 0.0879 mse 0.0860 t 546 new 0.23) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 2099/5000 loss 0.0920 (w 0.0979 mse 0.0934 t 800 new 0.15) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 2100/5000 loss 0.0689 (w 0.0127 mse 0.0130 t 756 new 0.10) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2101/5000 loss 0.0698 (w 0.1046 mse 0.1049 t 974 new 0.16) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2102/5000 loss 0.1494 (w 0.0610 mse 0.0584 t 720 new 0.13) lr 1.00e-05 gnorm 0.110 5.71s mem 15.6GB +step 2103/5000 loss 0.1183 (w 0.3653 mse 0.3547 t 118 new 0.25) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 2104/5000 loss 0.0917 (w 0.0644 mse 0.0646 t 841 new 0.09) lr 1.00e-05 gnorm 0.069 5.82s mem 15.6GB +step 2105/5000 loss 0.0830 (w 0.1160 mse 0.1053 t 908 new 0.21) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +step 2106/5000 loss 0.1067 (w 0.2146 mse 0.2030 t 981 new 0.23) lr 1.00e-05 gnorm 0.087 5.72s mem 15.6GB +step 2107/5000 loss 0.0939 (w 0.0920 mse 0.0885 t 866 new 0.21) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +step 2108/5000 loss 0.0730 (w 0.0611 mse 0.0546 t 776 new 0.24) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +step 2109/5000 loss 0.0891 (w 0.1121 mse 0.1085 t 953 new 0.22) lr 1.00e-05 gnorm 0.088 5.91s mem 15.6GB +step 2110/5000 loss 0.1182 (w 0.1057 mse 0.1032 t 367 new 0.12) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 2111/5000 loss 0.1281 (w 0.4129 mse 0.4243 t 93 new 0.27) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 2112/5000 loss 0.0664 (w 0.0558 mse 0.0536 t 812 new 0.12) lr 1.00e-05 gnorm 0.070 5.89s mem 15.6GB +step 2113/5000 loss 0.0530 (w 0.0215 mse 0.0211 t 766 new 0.19) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +step 2114/5000 loss 0.0775 (w 0.1064 mse 0.1048 t 951 new 0.23) lr 1.00e-05 gnorm 0.072 5.71s mem 15.6GB +step 2115/5000 loss 0.0800 (w 0.1167 mse 0.1099 t 933 new 0.21) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 2116/5000 loss 0.0752 (w 0.1195 mse 0.1208 t 201 new 0.13) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +step 2117/5000 loss 0.0782 (w 0.1017 mse 0.0957 t 864 new 0.27) lr 1.00e-05 gnorm 0.102 5.69s mem 15.6GB +step 2118/5000 loss 0.0957 (w 0.2193 mse 0.2099 t 239 new 0.27) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2119/5000 loss 0.0891 (w 0.0657 mse 0.0637 t 796 new 0.24) lr 1.00e-05 gnorm 0.097 5.91s mem 15.6GB +step 2120/5000 loss 0.0736 (w 0.1048 mse 0.1004 t 946 new 0.28) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 2121/5000 loss 0.0527 (w 0.0863 mse 0.0861 t 981 new 0.08) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2122/5000 loss 0.1017 (w 0.2689 mse 0.2362 t 999 new 0.26) lr 1.00e-05 gnorm 0.137 5.70s mem 15.6GB +step 2123/5000 loss 0.0651 (w 0.0520 mse 0.0505 t 880 new 0.19) lr 1.00e-05 gnorm 0.100 5.69s mem 15.6GB +step 2124/5000 loss 0.1140 (w 0.1538 mse 0.1542 t 242 new 0.25) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 2125/5000 loss 0.0754 (w 0.0591 mse 0.0539 t 831 new 0.12) lr 1.00e-05 gnorm 0.118 5.69s mem 15.6GB +step 2126/5000 loss 0.0924 (w 0.0673 mse 0.0659 t 725 new 0.21) lr 1.00e-05 gnorm 0.092 7.00s mem 15.6GB +step 2127/5000 loss 0.1132 (w 0.1044 mse 0.1016 t 543 new 0.30) lr 1.00e-05 gnorm 0.060 5.76s mem 15.6GB +step 2128/5000 loss 0.1197 (w 0.0494 mse 0.0503 t 657 new 0.25) lr 1.00e-05 gnorm 0.096 5.68s mem 15.6GB +step 2129/5000 loss 0.1419 (w 0.1120 mse 0.1047 t 966 new 0.22) lr 1.00e-05 gnorm 0.108 5.70s mem 15.6GB +step 2130/5000 loss 0.0919 (w 0.3333 mse 0.2967 t 997 new 0.27) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2131/5000 loss 0.0790 (w 0.0728 mse 0.0660 t 646 new 0.26) lr 1.00e-05 gnorm 0.113 5.68s mem 15.6GB +step 2132/5000 loss 0.0628 (w 0.0886 mse 0.0869 t 844 new 0.22) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +step 2133/5000 loss 0.0941 (w 0.0560 mse 0.0536 t 629 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 2134/5000 loss 0.0663 (w 0.0740 mse 0.0740 t 797 new 0.22) lr 1.00e-05 gnorm 0.061 5.89s mem 15.6GB +step 2135/5000 loss 0.1177 (w 0.0573 mse 0.0504 t 691 new 0.22) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 2136/5000 loss 0.0579 (w 0.1457 mse 0.1361 t 956 new 0.22) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 2137/5000 loss 0.1093 (w 0.1166 mse 0.1011 t 986 new 0.27) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 2138/5000 loss 0.1717 (w 0.1115 mse 0.1074 t 762 new 0.26) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2139/5000 loss 0.0548 (w 0.1282 mse 0.1247 t 273 new 0.28) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2140/5000 loss 0.0471 (w 0.0686 mse 0.0634 t 899 new 0.29) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 2141/5000 loss 0.0777 (w 0.5930 mse 0.5934 t 48 new 0.28) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 2142/5000 loss 0.0906 (w 0.0997 mse 0.0950 t 919 new 0.17) lr 1.00e-05 gnorm 0.060 5.84s mem 15.6GB +step 2143/5000 loss 0.0844 (w 0.0756 mse 0.0742 t 584 new 0.27) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 2144/5000 loss 0.1016 (w 0.1325 mse 0.1298 t 560 new 0.18) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 2145/5000 loss 0.0818 (w 0.0709 mse 0.0648 t 759 new 0.23) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 2146/5000 loss 0.0865 (w 0.1376 mse 0.1333 t 960 new 0.22) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +step 2147/5000 loss 0.1031 (w 0.1229 mse 0.1173 t 276 new 0.25) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 2148/5000 loss 0.0810 (w 0.2063 mse 0.2164 t 276 new 0.21) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 2149/5000 loss 0.0733 (w 0.1115 mse 0.1046 t 937 new 0.17) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +step 2150/5000 loss 0.0620 (w 0.0714 mse 0.0691 t 935 new 0.24) lr 1.00e-05 gnorm 0.062 5.71s mem 15.6GB +step 2151/5000 loss 0.0432 (w 0.1244 mse 0.1233 t 952 new 0.18) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 2152/5000 loss 0.0803 (w 0.0647 mse 0.0646 t 878 new 0.19) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 2153/5000 loss 0.0828 (w 0.1189 mse 0.1131 t 916 new 0.26) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 2154/5000 loss 0.1371 (w 0.1089 mse 0.1108 t 569 new 0.24) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 2155/5000 loss 0.0796 (w 0.1231 mse 0.1191 t 899 new 0.21) lr 1.00e-05 gnorm 0.081 5.90s mem 15.6GB +step 2156/5000 loss 0.0757 (w 0.1142 mse 0.1062 t 960 new 0.22) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 2157/5000 loss 0.1192 (w 0.1177 mse 0.1132 t 958 new 0.22) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +step 2158/5000 loss 0.0969 (w 0.0928 mse 0.0874 t 718 new 0.24) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 2159/5000 loss 0.1008 (w 0.1025 mse 0.0966 t 879 new 0.25) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 2160/5000 loss 0.0873 (w 0.0843 mse 0.0859 t 449 new 0.26) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 2161/5000 loss 0.1515 (w 0.5372 mse 0.5325 t 62 new 0.16) lr 1.00e-05 gnorm 0.069 5.76s mem 15.6GB +step 2162/5000 loss 0.0898 (w 0.0570 mse 0.0561 t 412 new 0.15) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 2163/5000 loss 0.0504 (w 0.0129 mse 0.0132 t 739 new 0.12) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +step 2164/5000 loss 0.0711 (w 0.0676 mse 0.0675 t 600 new 0.29) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2165/5000 loss 0.0772 (w 0.0955 mse 0.0888 t 936 new 0.20) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +step 2166/5000 loss 0.0614 (w 0.0959 mse 0.0897 t 853 new 0.31) lr 1.00e-05 gnorm 0.094 5.70s mem 15.6GB +step 2167/5000 loss 0.1224 (w 0.0842 mse 0.0822 t 798 new 0.23) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 2168/5000 loss 0.0614 (w 0.0472 mse 0.0499 t 815 new 0.26) lr 1.00e-05 gnorm 0.114 5.69s mem 15.6GB +step 2169/5000 loss 0.1219 (w 0.0791 mse 0.0771 t 705 new 0.19) lr 1.00e-05 gnorm 0.056 5.74s mem 15.6GB +step 2170/5000 loss 0.0429 (w 0.1014 mse 0.0993 t 977 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2171/5000 loss 0.1026 (w 0.0684 mse 0.0637 t 941 new 0.20) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 2172/5000 loss 0.0789 (w 0.0998 mse 0.0997 t 971 new 0.18) lr 1.00e-05 gnorm 0.062 5.67s mem 15.6GB +step 2173/5000 loss 0.0718 (w 0.1036 mse 0.1026 t 957 new 0.21) lr 1.00e-05 gnorm 0.054 5.93s mem 15.6GB +step 2174/5000 loss 0.0963 (w 0.1620 mse 0.1509 t 984 new 0.22) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 2175/5000 loss 0.1021 (w 0.0594 mse 0.0600 t 921 new 0.12) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 2176/5000 loss 0.0717 (w 0.1102 mse 0.1080 t 976 new 0.30) lr 1.00e-05 gnorm 0.059 5.92s mem 15.6GB +step 2177/5000 loss 0.1412 (w 0.1624 mse 0.1486 t 977 new 0.23) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2178/5000 loss 0.0826 (w 0.0639 mse 0.0628 t 563 new 0.25) lr 1.00e-05 gnorm 0.076 5.85s mem 15.6GB +step 2179/5000 loss 0.0749 (w 0.0966 mse 0.0969 t 963 new 0.25) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 2180/5000 loss 0.0959 (w 0.0612 mse 0.0665 t 960 new 0.18) lr 1.00e-05 gnorm 0.061 5.80s mem 15.6GB +step 2181/5000 loss 0.1234 (w 0.2197 mse 0.2138 t 252 new 0.18) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 2182/5000 loss 0.0780 (w 0.5499 mse 0.5558 t 62 new 0.18) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 2183/5000 loss 0.0966 (w 0.0649 mse 0.0614 t 845 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2184/5000 loss 0.0500 (w 0.1644 mse 0.1669 t 977 new 0.17) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 2185/5000 loss 0.0621 (w 0.0484 mse 0.0481 t 808 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2186/5000 loss 0.0990 (w 0.0669 mse 0.0640 t 881 new 0.14) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +step 2187/5000 loss 0.0911 (w 0.0938 mse 0.0903 t 862 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 2188/5000 loss 0.1145 (w 0.0638 mse 0.0659 t 953 new 0.29) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 2189/5000 loss 0.0879 (w 0.0860 mse 0.0825 t 438 new 0.28) lr 1.00e-05 gnorm 0.103 5.70s mem 15.6GB +step 2190/5000 loss 0.1147 (w 0.1657 mse 0.1635 t 232 new 0.22) lr 1.00e-05 gnorm 0.066 5.93s mem 15.6GB +step 2191/5000 loss 0.0804 (w 0.0836 mse 0.0809 t 833 new 0.27) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 2192/5000 loss 0.0634 (w 0.0706 mse 0.0639 t 694 new 0.26) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 2193/5000 loss 0.1271 (w 0.1229 mse 0.1206 t 518 new 0.26) lr 1.00e-05 gnorm 0.105 5.69s mem 15.6GB +step 2194/5000 loss 0.0603 (w 0.0718 mse 0.0737 t 943 new 0.08) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2195/5000 loss 0.1345 (w 0.0564 mse 0.0588 t 770 new 0.24) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 2196/5000 loss 0.0341 (w 0.0936 mse 0.0976 t 969 new 0.28) lr 1.00e-05 gnorm 0.057 5.89s mem 15.6GB +step 2197/5000 loss 0.1067 (w 0.0717 mse 0.0643 t 802 new 0.22) lr 1.00e-05 gnorm 0.083 5.89s mem 15.6GB +step 2198/5000 loss 0.0475 (w 0.1945 mse 0.1718 t 981 new 0.27) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 2199/5000 loss 0.0786 (w 0.0890 mse 0.0903 t 894 new 0.18) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 2200/5000 loss 0.0878 (w 0.0660 mse 0.0692 t 918 new 0.20) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 2201/5000 loss 0.0975 (w 0.0672 mse 0.0619 t 892 new 0.22) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +step 2202/5000 loss 0.0823 (w 0.0532 mse 0.0527 t 799 new 0.25) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +step 2203/5000 loss 0.0833 (w 0.0715 mse 0.0678 t 767 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2204/5000 loss 0.0744 (w 0.0894 mse 0.0897 t 962 new 0.20) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 2205/5000 loss 0.1138 (w 0.0622 mse 0.0671 t 560 new 0.18) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 2206/5000 loss 0.0839 (w 0.0445 mse 0.0446 t 929 new 0.09) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 2207/5000 loss 0.0918 (w 0.0575 mse 0.0610 t 927 new 0.21) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2208/5000 loss 0.0877 (w 0.0871 mse 0.0768 t 910 new 0.28) lr 1.00e-05 gnorm 0.073 5.91s mem 15.6GB +step 2209/5000 loss 0.0654 (w 0.0469 mse 0.0470 t 844 new 0.21) lr 1.00e-05 gnorm 0.082 5.75s mem 15.6GB +step 2210/5000 loss 0.0798 (w 0.1388 mse 0.1267 t 967 new 0.25) lr 1.00e-05 gnorm 0.052 6.13s mem 15.6GB +step 2211/5000 loss 0.1012 (w 0.0438 mse 0.0415 t 779 new 0.21) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2212/5000 loss 0.1110 (w 0.0687 mse 0.0705 t 920 new 0.21) lr 1.00e-05 gnorm 0.087 5.70s mem 15.6GB +step 2213/5000 loss 0.0766 (w 0.0441 mse 0.0461 t 768 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2214/5000 loss 0.1037 (w 0.1763 mse 0.1650 t 980 new 0.15) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 2215/5000 loss 0.1024 (w 0.1034 mse 0.1040 t 574 new 0.25) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 2216/5000 loss 0.0488 (w 0.1710 mse 0.1609 t 974 new 0.28) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2217/5000 loss 0.0647 (w 0.0534 mse 0.0544 t 865 new 0.27) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 2218/5000 loss 0.0898 (w 0.1351 mse 0.1208 t 979 new 0.26) lr 1.00e-05 gnorm 0.048 5.68s mem 15.6GB +step 2219/5000 loss 0.1050 (w 0.0830 mse 0.0731 t 889 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2220/5000 loss 0.1228 (w 0.0809 mse 0.0851 t 959 new 0.29) lr 1.00e-05 gnorm 0.081 5.92s mem 15.6GB +step 2221/5000 loss 0.0800 (w 0.1290 mse 0.1225 t 928 new 0.12) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2222/5000 loss 0.0769 (w 0.0891 mse 0.0886 t 850 new 0.21) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 2223/5000 loss 0.0869 (w 0.0666 mse 0.0652 t 556 new 0.26) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 2224/5000 loss 0.0921 (w 0.5297 mse 0.5327 t 48 new 0.19) lr 1.00e-05 gnorm 0.057 5.75s mem 15.6GB +step 2225/5000 loss 0.0604 (w 0.0419 mse 0.0418 t 894 new 0.13) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2226/5000 loss 0.0916 (w 0.1033 mse 0.0954 t 966 new 0.25) lr 1.00e-05 gnorm 0.104 5.68s mem 15.6GB +step 2227/5000 loss 0.1452 (w 0.0734 mse 0.0683 t 758 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2228/5000 loss 0.1088 (w 0.0663 mse 0.0648 t 591 new 0.17) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 2229/5000 loss 0.0715 (w 0.2339 mse 0.2361 t 191 new 0.30) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 2230/5000 loss 0.0849 (w 0.0782 mse 0.0728 t 707 new 0.30) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 2231/5000 loss 0.1072 (w 0.0794 mse 0.0797 t 425 new 0.29) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2232/5000 loss 0.0550 (w 0.1275 mse 0.1242 t 982 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2233/5000 loss 0.1167 (w 0.1048 mse 0.1007 t 747 new 0.27) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2234/5000 loss 0.0488 (w 0.1342 mse 0.1263 t 976 new 0.19) lr 1.00e-05 gnorm 0.076 5.83s mem 15.6GB +step 2235/5000 loss 0.1110 (w 0.1224 mse 0.1233 t 879 new 0.19) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 2236/5000 loss 0.1165 (w 0.0912 mse 0.0819 t 752 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2237/5000 loss 0.1291 (w 0.0463 mse 0.0475 t 788 new 0.18) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 2238/5000 loss 0.0475 (w 0.2462 mse 0.2448 t 994 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 2239/5000 loss 0.0843 (w 0.0296 mse 0.0325 t 721 new 0.12) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 2240/5000 loss 0.0599 (w 0.1465 mse 0.1465 t 255 new 0.29) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 2241/5000 loss 0.0666 (w 0.0657 mse 0.0614 t 819 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2242/5000 loss 0.0799 (w 0.0581 mse 0.0587 t 882 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2243/5000 loss 0.0730 (w 0.1011 mse 0.0964 t 761 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2244/5000 loss 0.1393 (w 0.1726 mse 0.1706 t 229 new 0.30) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +step 2245/5000 loss 0.0909 (w 0.0752 mse 0.0743 t 834 new 0.21) lr 1.00e-05 gnorm 0.077 5.79s mem 15.6GB +step 2246/5000 loss 0.0737 (w 0.0580 mse 0.0585 t 886 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2247/5000 loss 0.1392 (w 0.0380 mse 0.0374 t 866 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2248/5000 loss 0.0484 (w 0.0624 mse 0.0609 t 913 new 0.27) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 2249/5000 loss 0.1267 (w 0.0896 mse 0.0806 t 882 new 0.19) lr 1.00e-05 gnorm 0.124 5.69s mem 15.6GB +step 2250/5000 loss 0.0774 (w 0.0494 mse 0.0453 t 818 new 0.28) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2251/5000 loss 0.0570 (w 0.1273 mse 0.1199 t 970 new 0.15) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +step 2252/5000 loss 0.0576 (w 0.0633 mse 0.0676 t 971 new 0.11) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +step 2253/5000 loss 0.0920 (w 0.0938 mse 0.0939 t 480 new 0.29) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 2254/5000 loss 0.1165 (w 0.0929 mse 0.0911 t 459 new 0.25) lr 1.00e-05 gnorm 0.100 5.74s mem 15.6GB +step 2255/5000 loss 0.1212 (w 0.0280 mse 0.0269 t 619 new 0.10) lr 1.00e-05 gnorm 0.124 5.95s mem 15.6GB +step 2256/5000 loss 0.1294 (w 0.0438 mse 0.0463 t 963 new 0.16) lr 1.00e-05 gnorm 0.063 5.71s mem 15.6GB +step 2257/5000 loss 0.0415 (w 0.0909 mse 0.0846 t 935 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2258/5000 loss 0.0596 (w 0.0555 mse 0.0522 t 692 new 0.30) lr 1.00e-05 gnorm 0.101 5.89s mem 15.6GB +step 2259/5000 loss 0.1229 (w 0.0477 mse 0.0515 t 728 new 0.24) lr 1.00e-05 gnorm 0.102 5.69s mem 15.6GB +step 2260/5000 loss 0.0890 (w 0.1378 mse 0.1352 t 535 new 0.22) lr 1.00e-05 gnorm 0.057 5.81s mem 15.6GB +step 2261/5000 loss 0.0838 (w 0.0571 mse 0.0573 t 720 new 0.25) lr 1.00e-05 gnorm 0.075 5.89s mem 15.6GB +step 2262/5000 loss 0.0952 (w 0.0838 mse 0.0845 t 721 new 0.19) lr 1.00e-05 gnorm 0.120 5.68s mem 15.6GB +step 2263/5000 loss 0.0740 (w 0.1265 mse 0.1147 t 831 new 0.24) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 2264/5000 loss 0.1019 (w 0.0712 mse 0.0723 t 960 new 0.10) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2265/5000 loss 0.0952 (w 0.2501 mse 0.2283 t 995 new 0.23) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 2266/5000 loss 0.0984 (w 0.2081 mse 0.2030 t 180 new 0.28) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 2267/5000 loss 0.1016 (w 0.0848 mse 0.0835 t 964 new 0.29) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 2268/5000 loss 0.1204 (w 0.0540 mse 0.0529 t 815 new 0.25) lr 1.00e-05 gnorm 0.062 5.73s mem 15.6GB +step 2269/5000 loss 0.0691 (w 0.1128 mse 0.1082 t 856 new 0.25) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2270/5000 loss 0.1131 (w 0.0587 mse 0.0623 t 509 new 0.17) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2271/5000 loss 0.1233 (w 0.0853 mse 0.0803 t 803 new 0.26) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 2272/5000 loss 0.0779 (w 0.1083 mse 0.1034 t 906 new 0.22) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 2273/5000 loss 0.1073 (w 0.1435 mse 0.1543 t 989 new 0.26) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 2274/5000 loss 0.0767 (w 0.0914 mse 0.0885 t 813 new 0.11) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2275/5000 loss 0.0873 (w 0.0978 mse 0.0931 t 949 new 0.22) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 2276/5000 loss 0.0561 (w 0.2436 mse 0.2222 t 992 new 0.30) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 2277/5000 loss 0.1137 (w 0.2108 mse 0.2092 t 194 new 0.12) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 2278/5000 loss 0.0845 (w 0.0667 mse 0.0612 t 927 new 0.27) lr 1.00e-05 gnorm 0.108 5.69s mem 15.6GB +step 2279/5000 loss 0.0894 (w 0.1053 mse 0.1091 t 306 new 0.11) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 2280/5000 loss 0.0865 (w 0.0614 mse 0.0572 t 627 new 0.24) lr 1.00e-05 gnorm 0.069 5.67s mem 15.6GB +step 2281/5000 loss 0.0518 (w 0.2134 mse 0.2019 t 981 new 0.21) lr 1.00e-05 gnorm 0.100 5.69s mem 15.6GB +step 2282/5000 loss 0.0977 (w 0.1212 mse 0.1184 t 669 new 0.20) lr 1.00e-05 gnorm 0.065 6.60s mem 15.6GB +step 2283/5000 loss 0.1084 (w 0.1206 mse 0.1201 t 896 new 0.12) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 2284/5000 loss 0.0665 (w 0.1066 mse 0.1081 t 936 new 0.23) lr 1.00e-05 gnorm 0.114 5.70s mem 15.6GB +step 2285/5000 loss 0.0661 (w 0.0688 mse 0.0636 t 798 new 0.19) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +step 2286/5000 loss 0.1336 (w 0.2760 mse 0.2767 t 176 new 0.10) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +step 2287/5000 loss 0.0804 (w 0.1618 mse 0.1499 t 989 new 0.26) lr 1.00e-05 gnorm 0.098 5.70s mem 15.6GB +step 2288/5000 loss 0.0898 (w 0.0873 mse 0.0802 t 808 new 0.22) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 2289/5000 loss 0.1238 (w 0.0580 mse 0.0575 t 917 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2290/5000 loss 0.1038 (w 0.1080 mse 0.1059 t 320 new 0.22) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2291/5000 loss 0.1044 (w 0.1498 mse 0.1430 t 987 new 0.17) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 2292/5000 loss 0.0861 (w 0.0881 mse 0.0843 t 757 new 0.22) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +step 2293/5000 loss 0.0665 (w 0.3804 mse 0.3498 t 999 new 0.22) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2294/5000 loss 0.1087 (w 0.1039 mse 0.0954 t 434 new 0.21) lr 1.00e-05 gnorm 0.068 5.89s mem 15.6GB +step 2295/5000 loss 0.0680 (w 0.0776 mse 0.0875 t 923 new 0.19) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2296/5000 loss 0.0731 (w 0.1408 mse 0.1408 t 970 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2297/5000 loss 0.0896 (w 0.0902 mse 0.0885 t 624 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2298/5000 loss 0.0857 (w 0.0736 mse 0.0692 t 841 new 0.27) lr 1.00e-05 gnorm 0.073 5.90s mem 15.6GB +step 2299/5000 loss 0.1114 (w 0.0977 mse 0.1054 t 372 new 0.31) lr 1.00e-05 gnorm 0.073 5.84s mem 15.6GB +step 2300/5000 loss 0.0801 (w 0.2063 mse 0.1922 t 993 new 0.22) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 2301/5000 loss 0.0666 (w 0.1035 mse 0.0992 t 836 new 0.31) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2302/5000 loss 0.1096 (w 0.0939 mse 0.0891 t 913 new 0.23) lr 1.00e-05 gnorm 0.064 5.92s mem 15.6GB +step 2303/5000 loss 0.1140 (w 0.1094 mse 0.1077 t 334 new 0.25) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 2304/5000 loss 0.1446 (w 0.1765 mse 0.1719 t 360 new 0.10) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 2305/5000 loss 0.0786 (w 0.0848 mse 0.0831 t 706 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2306/5000 loss 0.0952 (w 0.0427 mse 0.0422 t 833 new 0.13) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 2307/5000 loss 0.0704 (w 0.0841 mse 0.0808 t 930 new 0.25) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 2308/5000 loss 0.0911 (w 0.0933 mse 0.0894 t 839 new 0.12) lr 1.00e-05 gnorm 0.083 5.76s mem 15.6GB +step 2309/5000 loss 0.0670 (w 0.0667 mse 0.0694 t 845 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2310/5000 loss 0.0814 (w 0.1172 mse 0.1239 t 414 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2311/5000 loss 0.1163 (w 0.0936 mse 0.0941 t 493 new 0.24) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 2312/5000 loss 0.0731 (w 0.1050 mse 0.0998 t 849 new 0.24) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 2313/5000 loss 0.0831 (w 0.1370 mse 0.1334 t 933 new 0.15) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 2314/5000 loss 0.0582 (w 0.0802 mse 0.0771 t 904 new 0.17) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2315/5000 loss 0.1265 (w 0.1645 mse 0.1647 t 347 new 0.18) lr 1.00e-05 gnorm 0.094 5.68s mem 15.6GB +step 2316/5000 loss 0.0748 (w 0.0715 mse 0.0714 t 563 new 0.29) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 2317/5000 loss 0.1324 (w 0.2093 mse 0.1929 t 986 new 0.16) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 2318/5000 loss 0.1126 (w 0.1541 mse 0.1552 t 965 new 0.22) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 2319/5000 loss 0.0722 (w 0.0975 mse 0.0928 t 872 new 0.26) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 2320/5000 loss 0.0930 (w 0.0553 mse 0.0580 t 789 new 0.22) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 2321/5000 loss 0.0896 (w 0.0450 mse 0.0472 t 786 new 0.25) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 2322/5000 loss 0.0419 (w 0.1059 mse 0.0933 t 945 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2323/5000 loss 0.0786 (w 0.0835 mse 0.0819 t 940 new 0.20) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 2324/5000 loss 0.1041 (w 0.1000 mse 0.0984 t 490 new 0.20) lr 1.00e-05 gnorm 0.078 5.91s mem 15.6GB +step 2325/5000 loss 0.0747 (w 0.1713 mse 0.1608 t 964 new 0.26) lr 1.00e-05 gnorm 0.069 5.77s mem 15.6GB +step 2326/5000 loss 0.1434 (w 0.0733 mse 0.0702 t 702 new 0.16) lr 1.00e-05 gnorm 0.105 5.70s mem 15.6GB +step 2327/5000 loss 0.1576 (w 0.2457 mse 0.2489 t 157 new 0.17) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2328/5000 loss 0.0836 (w 0.0943 mse 0.0920 t 885 new 0.20) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 2329/5000 loss 0.0849 (w 0.2011 mse 0.1838 t 989 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2330/5000 loss 0.0996 (w 0.1006 mse 0.0953 t 788 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 2331/5000 loss 0.0782 (w 0.0495 mse 0.0476 t 779 new 0.08) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +step 2332/5000 loss 0.0864 (w 0.0955 mse 0.0948 t 637 new 0.25) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +step 2333/5000 loss 0.0852 (w 0.0788 mse 0.0704 t 822 new 0.18) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 2334/5000 loss 0.0952 (w 0.1246 mse 0.1224 t 352 new 0.20) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +step 2335/5000 loss 0.0738 (w 0.0914 mse 0.0903 t 904 new 0.21) lr 1.00e-05 gnorm 0.086 5.71s mem 15.6GB +step 2336/5000 loss 0.0798 (w 0.1008 mse 0.1014 t 772 new 0.13) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 2337/5000 loss 0.0788 (w 0.1328 mse 0.1294 t 955 new 0.16) lr 1.00e-05 gnorm 0.086 5.71s mem 15.6GB +step 2338/5000 loss 0.1093 (w 0.0883 mse 0.0858 t 453 new 0.27) lr 1.00e-05 gnorm 0.104 5.71s mem 15.6GB +step 2339/5000 loss 0.0676 (w 0.1009 mse 0.0935 t 572 new 0.25) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 2340/5000 loss 0.0777 (w 0.0859 mse 0.0779 t 922 new 0.24) lr 1.00e-05 gnorm 0.101 5.70s mem 15.6GB +step 2341/5000 loss 0.1073 (w 0.0446 mse 0.0447 t 817 new 0.17) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 2342/5000 loss 0.0736 (w 0.1557 mse 0.1532 t 965 new 0.23) lr 1.00e-05 gnorm 0.049 5.80s mem 15.6GB +step 2343/5000 loss 0.1079 (w 0.0630 mse 0.0633 t 798 new 0.21) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +step 2344/5000 loss 0.1097 (w 0.0761 mse 0.0727 t 866 new 0.18) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 2345/5000 loss 0.0749 (w 0.0596 mse 0.0585 t 840 new 0.15) lr 1.00e-05 gnorm 0.058 6.03s mem 15.6GB +step 2346/5000 loss 0.0654 (w 0.1001 mse 0.1012 t 828 new 0.27) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2347/5000 loss 0.1022 (w 0.2410 mse 0.2419 t 134 new 0.28) lr 1.00e-05 gnorm 0.142 5.69s mem 15.6GB +step 2348/5000 loss 0.1169 (w 0.1210 mse 0.1307 t 520 new 0.20) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +step 2349/5000 loss 0.0637 (w 0.0425 mse 0.0465 t 877 new 0.27) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 2350/5000 loss 0.0643 (w 0.0594 mse 0.0573 t 803 new 0.22) lr 1.00e-05 gnorm 0.086 5.71s mem 15.6GB +step 2351/5000 loss 0.1089 (w 0.1603 mse 0.1455 t 986 new 0.22) lr 1.00e-05 gnorm 0.122 5.69s mem 15.6GB +step 2352/5000 loss 0.0970 (w 0.0648 mse 0.0634 t 832 new 0.28) lr 1.00e-05 gnorm 0.069 5.94s mem 15.6GB +step 2353/5000 loss 0.0793 (w 0.0748 mse 0.0724 t 830 new 0.23) lr 1.00e-05 gnorm 0.108 5.70s mem 15.6GB +step 2354/5000 loss 0.0755 (w 0.1204 mse 0.1185 t 461 new 0.13) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +step 2355/5000 loss 0.0950 (w 0.0700 mse 0.0668 t 532 new 0.19) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2356/5000 loss 0.0675 (w 0.0721 mse 0.0723 t 854 new 0.26) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 2357/5000 loss 0.1299 (w 0.1929 mse 0.1978 t 130 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 2358/5000 loss 0.0656 (w 0.1743 mse 0.1605 t 993 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2359/5000 loss 0.1170 (w 0.1207 mse 0.1238 t 267 new 0.11) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2360/5000 loss 0.0728 (w 0.0829 mse 0.0775 t 771 new 0.17) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2361/5000 loss 0.0727 (w 0.0571 mse 0.0543 t 598 new 0.11) lr 1.00e-05 gnorm 0.050 5.71s mem 15.6GB +step 2362/5000 loss 0.0779 (w 0.0951 mse 0.0870 t 955 new 0.26) lr 1.00e-05 gnorm 0.069 5.87s mem 15.6GB +step 2363/5000 loss 0.0953 (w 0.0527 mse 0.0519 t 655 new 0.17) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 2364/5000 loss 0.0568 (w 0.0567 mse 0.0538 t 830 new 0.20) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2365/5000 loss 0.0842 (w 0.0708 mse 0.0758 t 964 new 0.18) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2366/5000 loss 0.1307 (w 0.0787 mse 0.0716 t 950 new 0.27) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 2367/5000 loss 0.0737 (w 0.0713 mse 0.0695 t 877 new 0.21) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 2368/5000 loss 0.0573 (w 0.0618 mse 0.0604 t 870 new 0.27) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +step 2369/5000 loss 0.1054 (w 0.0716 mse 0.0653 t 856 new 0.20) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 2370/5000 loss 0.0865 (w 0.0821 mse 0.0797 t 831 new 0.30) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2371/5000 loss 0.1053 (w 0.0652 mse 0.0630 t 607 new 0.15) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2372/5000 loss 0.0846 (w 0.0250 mse 0.0262 t 933 new 0.13) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 2373/5000 loss 0.1243 (w 0.0490 mse 0.0480 t 847 new 0.28) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 2374/5000 loss 0.1504 (w 0.4754 mse 0.4780 t 53 new 0.24) lr 1.00e-05 gnorm 0.053 5.91s mem 15.6GB +step 2375/5000 loss 0.0647 (w 0.6706 mse 0.6776 t 29 new 0.14) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 2376/5000 loss 0.0731 (w 0.0973 mse 0.0987 t 965 new 0.27) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 2377/5000 loss 0.0840 (w 0.1306 mse 0.1269 t 989 new 0.25) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 2378/5000 loss 0.0340 (w 0.1197 mse 0.1095 t 924 new 0.26) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2379/5000 loss 0.1386 (w 0.0474 mse 0.0473 t 812 new 0.29) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 2380/5000 loss 0.0756 (w 0.0606 mse 0.0652 t 942 new 0.30) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2381/5000 loss 0.0655 (w 0.0363 mse 0.0416 t 412 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 2382/5000 loss 0.0859 (w 0.0885 mse 0.0856 t 901 new 0.18) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2383/5000 loss 0.0821 (w 0.0984 mse 0.0956 t 922 new 0.12) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2384/5000 loss 0.0966 (w 0.0857 mse 0.0768 t 895 new 0.21) lr 1.00e-05 gnorm 0.071 5.97s mem 15.6GB +step 2385/5000 loss 0.1069 (w 0.0963 mse 0.0886 t 575 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 2386/5000 loss 0.0552 (w 0.0234 mse 0.0246 t 850 new 0.10) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 2387/5000 loss 0.0926 (w 0.0759 mse 0.0782 t 960 new 0.23) lr 1.00e-05 gnorm 0.075 5.79s mem 15.6GB +step 2388/5000 loss 0.0804 (w 0.0890 mse 0.0831 t 958 new 0.27) lr 1.00e-05 gnorm 0.073 5.79s mem 15.6GB +step 2389/5000 loss 0.1159 (w 0.0963 mse 0.0951 t 463 new 0.24) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2390/5000 loss 0.0826 (w 0.0863 mse 0.0805 t 814 new 0.24) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 2391/5000 loss 0.0860 (w 0.1461 mse 0.1489 t 288 new 0.15) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 2392/5000 loss 0.0955 (w 0.0850 mse 0.0812 t 941 new 0.18) lr 1.00e-05 gnorm 0.075 5.85s mem 15.6GB +step 2393/5000 loss 0.0964 (w 0.1066 mse 0.1006 t 817 new 0.27) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 2394/5000 loss 0.0969 (w 0.0952 mse 0.0986 t 492 new 0.25) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 2395/5000 loss 0.1304 (w 0.0620 mse 0.0631 t 612 new 0.23) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 2396/5000 loss 0.0596 (w 0.1058 mse 0.1030 t 792 new 0.22) lr 1.00e-05 gnorm 0.274 5.69s mem 15.6GB +step 2397/5000 loss 0.0785 (w 0.1247 mse 0.1241 t 992 new 0.12) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 2398/5000 loss 0.0974 (w 0.0900 mse 0.0926 t 486 new 0.15) lr 1.00e-05 gnorm 0.072 5.93s mem 15.6GB +step 2399/5000 loss 0.0633 (w 0.0731 mse 0.0677 t 868 new 0.21) lr 1.00e-05 gnorm 0.120 5.68s mem 15.6GB +step 2400/5000 loss 0.0755 (w 0.0857 mse 0.0830 t 885 new 0.23) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 2401/5000 loss 0.1076 (w 0.0449 mse 0.0452 t 905 new 0.13) lr 1.00e-05 gnorm 0.102 5.70s mem 15.6GB +step 2402/5000 loss 0.0657 (w 0.2198 mse 0.2232 t 993 new 0.10) lr 1.00e-05 gnorm 0.135 5.69s mem 15.6GB +step 2403/5000 loss 0.0884 (w 0.0951 mse 0.0905 t 412 new 0.22) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 2404/5000 loss 0.1020 (w 0.1512 mse 0.1454 t 291 new 0.26) lr 1.00e-05 gnorm 0.097 5.76s mem 15.6GB +step 2405/5000 loss 0.0872 (w 0.0572 mse 0.0554 t 730 new 0.21) lr 1.00e-05 gnorm 0.084 5.75s mem 15.6GB +step 2406/5000 loss 0.1410 (w 0.0818 mse 0.0786 t 878 new 0.21) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 2407/5000 loss 0.0883 (w 0.1294 mse 0.1177 t 932 new 0.25) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 2408/5000 loss 0.0844 (w 0.0796 mse 0.0745 t 506 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 2409/5000 loss 0.1092 (w 0.0810 mse 0.0773 t 765 new 0.12) lr 1.00e-05 gnorm 0.096 5.86s mem 15.6GB +step 2410/5000 loss 0.0881 (w 0.0958 mse 0.0907 t 630 new 0.28) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +step 2411/5000 loss 0.0949 (w 0.0419 mse 0.0457 t 713 new 0.19) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2412/5000 loss 0.1009 (w 0.1230 mse 0.1192 t 660 new 0.25) lr 1.00e-05 gnorm 0.085 5.70s mem 15.6GB +step 2413/5000 loss 0.0941 (w 0.0382 mse 0.0363 t 617 new 0.16) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 2414/5000 loss 0.0668 (w 0.0749 mse 0.0710 t 887 new 0.26) lr 1.00e-05 gnorm 0.056 5.91s mem 15.6GB +step 2415/5000 loss 0.0846 (w 0.0653 mse 0.0707 t 280 new 0.11) lr 1.00e-05 gnorm 0.082 5.92s mem 15.6GB +step 2416/5000 loss 0.0835 (w 0.0674 mse 0.0647 t 908 new 0.27) lr 1.00e-05 gnorm 0.066 5.67s mem 15.6GB +step 2417/5000 loss 0.0926 (w 0.1690 mse 0.1525 t 981 new 0.27) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 2418/5000 loss 0.0673 (w 0.0745 mse 0.0766 t 928 new 0.24) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 2419/5000 loss 0.0707 (w 0.0530 mse 0.0570 t 835 new 0.21) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 2420/5000 loss 0.0627 (w 0.1723 mse 0.1669 t 968 new 0.23) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 2421/5000 loss 0.0735 (w 0.1310 mse 0.1200 t 958 new 0.22) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2422/5000 loss 0.0769 (w 0.1118 mse 0.1115 t 964 new 0.20) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 2423/5000 loss 0.0462 (w 0.0696 mse 0.0670 t 506 new 0.21) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 2424/5000 loss 0.1149 (w 0.1107 mse 0.1062 t 893 new 0.21) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 2425/5000 loss 0.0422 (w 0.0442 mse 0.0415 t 849 new 0.08) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2426/5000 loss 0.0800 (w 0.1049 mse 0.0999 t 692 new 0.24) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 2427/5000 loss 0.0776 (w 0.0698 mse 0.0663 t 783 new 0.14) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 2428/5000 loss 0.1374 (w 0.0757 mse 0.0738 t 625 new 0.24) lr 1.00e-05 gnorm 0.075 5.89s mem 15.6GB +step 2429/5000 loss 0.0993 (w 0.0927 mse 0.0912 t 899 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2430/5000 loss 0.0792 (w 0.1326 mse 0.1202 t 931 new 0.25) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 2431/5000 loss 0.1246 (w 0.0861 mse 0.0829 t 900 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2432/5000 loss 0.0972 (w 0.0591 mse 0.0570 t 817 new 0.21) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 2433/5000 loss 0.1151 (w 0.0458 mse 0.0442 t 604 new 0.21) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 2434/5000 loss 0.0830 (w 0.0668 mse 0.0642 t 794 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2435/5000 loss 0.1153 (w 0.2719 mse 0.2590 t 165 new 0.30) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 2436/5000 loss 0.0559 (w 0.1057 mse 0.1041 t 944 new 0.23) lr 1.00e-05 gnorm 0.056 6.29s mem 15.6GB +step 2437/5000 loss 0.1167 (w 0.0904 mse 0.0872 t 777 new 0.21) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 2438/5000 loss 0.0959 (w 0.0754 mse 0.0700 t 827 new 0.23) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 2439/5000 loss 0.0852 (w 0.0954 mse 0.0861 t 858 new 0.26) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 2440/5000 loss 0.0659 (w 0.0843 mse 0.0777 t 906 new 0.26) lr 1.00e-05 gnorm 0.074 5.89s mem 15.6GB +step 2441/5000 loss 0.0994 (w 0.0864 mse 0.0811 t 948 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2442/5000 loss 0.1011 (w 0.2340 mse 0.2096 t 999 new 0.23) lr 1.00e-05 gnorm 0.064 5.83s mem 15.6GB +step 2443/5000 loss 0.0609 (w 0.0551 mse 0.0552 t 935 new 0.12) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2444/5000 loss 0.1010 (w 0.0710 mse 0.0714 t 796 new 0.27) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 2445/5000 loss 0.0749 (w 0.0621 mse 0.0633 t 697 new 0.29) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2446/5000 loss 0.1153 (w 0.0833 mse 0.0849 t 833 new 0.17) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 2447/5000 loss 0.0730 (w 0.0855 mse 0.0839 t 937 new 0.23) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +step 2448/5000 loss 0.0831 (w 0.4020 mse 0.4259 t 66 new 0.24) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 2449/5000 loss 0.0776 (w 0.0797 mse 0.0735 t 781 new 0.21) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 2450/5000 loss 0.0539 (w 0.0842 mse 0.0816 t 921 new 0.18) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2451/5000 loss 0.0654 (w 0.0886 mse 0.0971 t 273 new 0.22) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2452/5000 loss 0.1182 (w 0.0850 mse 0.0790 t 530 new 0.20) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 2453/5000 loss 0.1038 (w 0.0710 mse 0.0690 t 887 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2454/5000 loss 0.0847 (w 0.1538 mse 0.1449 t 947 new 0.28) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2455/5000 loss 0.1371 (w 0.2079 mse 0.2072 t 239 new 0.10) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 2456/5000 loss 0.1160 (w 0.0983 mse 0.0986 t 826 new 0.17) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2457/5000 loss 0.1107 (w 0.0722 mse 0.0721 t 942 new 0.16) lr 1.00e-05 gnorm 0.062 6.14s mem 15.6GB +step 2458/5000 loss 0.1045 (w 0.1157 mse 0.1138 t 408 new 0.27) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 2459/5000 loss 0.1124 (w 0.0796 mse 0.0775 t 522 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2460/5000 loss 0.0558 (w 0.0806 mse 0.0723 t 894 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2461/5000 loss 0.0816 (w 0.0513 mse 0.0539 t 965 new 0.17) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2462/5000 loss 0.0725 (w 0.0742 mse 0.0670 t 945 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2463/5000 loss 0.0803 (w 0.0457 mse 0.0484 t 417 new 0.07) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 2464/5000 loss 0.0404 (w 0.0441 mse 0.0428 t 964 new 0.23) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 2465/5000 loss 0.1122 (w 0.1686 mse 0.1783 t 118 new 0.28) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2466/5000 loss 0.0741 (w 0.0816 mse 0.0797 t 604 new 0.10) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2467/5000 loss 0.0582 (w 0.0821 mse 0.0787 t 880 new 0.30) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 2468/5000 loss 0.0567 (w 0.1594 mse 0.1638 t 980 new 0.14) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 2469/5000 loss 0.1035 (w 0.0436 mse 0.0463 t 682 new 0.24) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 2470/5000 loss 0.1074 (w 0.1594 mse 0.1623 t 180 new 0.29) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 2471/5000 loss 0.0802 (w 0.0711 mse 0.0699 t 904 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2472/5000 loss 0.0505 (w 0.0846 mse 0.0847 t 752 new 0.19) lr 1.00e-05 gnorm 0.064 5.94s mem 15.6GB +step 2473/5000 loss 0.1224 (w 0.0679 mse 0.0636 t 603 new 0.25) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 2474/5000 loss 0.0922 (w 0.2349 mse 0.2124 t 988 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2475/5000 loss 0.0714 (w 0.1041 mse 0.0970 t 869 new 0.25) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2476/5000 loss 0.1382 (w 0.0685 mse 0.0643 t 931 new 0.29) lr 1.00e-05 gnorm 0.075 5.92s mem 15.6GB +step 2477/5000 loss 0.0796 (w 0.1016 mse 0.0964 t 751 new 0.23) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 2478/5000 loss 0.0781 (w 0.0994 mse 0.0946 t 970 new 0.26) lr 1.00e-05 gnorm 0.085 6.06s mem 15.6GB +step 2479/5000 loss 0.0533 (w 0.1040 mse 0.0953 t 857 new 0.26) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 2480/5000 loss 0.0905 (w 0.0823 mse 0.0780 t 729 new 0.19) lr 1.00e-05 gnorm 0.058 5.80s mem 15.6GB +step 2481/5000 loss 0.1590 (w 0.0769 mse 0.0720 t 630 new 0.28) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 2482/5000 loss 0.1165 (w 0.0347 mse 0.0390 t 663 new 0.21) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 2483/5000 loss 0.1208 (w 0.0508 mse 0.0497 t 612 new 0.17) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 2484/5000 loss 0.0876 (w 0.0631 mse 0.0626 t 875 new 0.26) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2485/5000 loss 0.0425 (w 0.0575 mse 0.0574 t 840 new 0.20) lr 1.00e-05 gnorm 0.086 5.71s mem 15.6GB +step 2486/5000 loss 0.0992 (w 0.0719 mse 0.0782 t 904 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2487/5000 loss 0.1032 (w 0.0744 mse 0.0765 t 889 new 0.19) lr 1.00e-05 gnorm 0.103 5.73s mem 15.6GB +step 2488/5000 loss 0.0799 (w 0.0614 mse 0.0575 t 809 new 0.23) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 2489/5000 loss 0.1375 (w 0.1129 mse 0.1131 t 291 new 0.26) lr 1.00e-05 gnorm 0.073 5.71s mem 15.6GB +step 2490/5000 loss 0.1041 (w 0.0523 mse 0.0503 t 607 new 0.18) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 2491/5000 loss 0.0612 (w 0.0665 mse 0.0643 t 887 new 0.23) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 2492/5000 loss 0.0806 (w 0.1101 mse 0.1098 t 357 new 0.18) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2493/5000 loss 0.0678 (w 0.1020 mse 0.0932 t 874 new 0.25) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 2494/5000 loss 0.0571 (w 0.0653 mse 0.0636 t 887 new 0.29) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2495/5000 loss 0.1036 (w 0.0851 mse 0.0859 t 939 new 0.24) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 2496/5000 loss 0.0870 (w 0.0552 mse 0.0584 t 688 new 0.11) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2497/5000 loss 0.0939 (w 0.0845 mse 0.0812 t 911 new 0.21) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 2498/5000 loss 0.0889 (w 0.0702 mse 0.0675 t 867 new 0.28) lr 1.00e-05 gnorm 0.068 5.82s mem 15.6GB +step 2499/5000 loss 0.0609 (w 0.1020 mse 0.0989 t 886 new 0.21) lr 1.00e-05 gnorm 0.052 5.90s mem 15.6GB +step 2500/5000 loss 0.0765 (w 0.0894 mse 0.0883 t 845 new 0.19) lr 1.00e-05 gnorm 0.061 5.78s mem 15.6GB +[val] step 2500 t=201: w=0.1754 mse=0.1778 (n=16) t=501: w=0.0728 mse=0.0727 (n=16) t=800: w=0.0612 mse=0.0600 (n=16) | mean w=0.1031 mse=0.1035 4s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step2500.safetensors 832 个张量 2.87 GB +step 2501/5000 loss 0.0962 (w 0.0807 mse 0.0794 t 831 new 0.29) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 2502/5000 loss 0.0528 (w 0.0413 mse 0.0434 t 947 new 0.15) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 2503/5000 loss 0.0901 (w 0.1620 mse 0.1593 t 245 new 0.25) lr 1.00e-05 gnorm 0.049 5.89s mem 15.6GB +step 2504/5000 loss 0.0554 (w 0.1047 mse 0.0977 t 945 new 0.26) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 2505/5000 loss 0.0832 (w 0.0737 mse 0.0751 t 898 new 0.16) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +step 2506/5000 loss 0.0698 (w 0.1266 mse 0.1211 t 964 new 0.18) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 2507/5000 loss 0.1090 (w 0.0637 mse 0.0615 t 660 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2508/5000 loss 0.1146 (w 0.1637 mse 0.1570 t 357 new 0.25) lr 1.00e-05 gnorm 0.096 5.88s mem 15.6GB +step 2509/5000 loss 0.0800 (w 0.0988 mse 0.0881 t 847 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2510/5000 loss 0.1027 (w 0.0972 mse 0.1006 t 774 new 0.23) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +step 2511/5000 loss 0.0755 (w 0.0809 mse 0.0843 t 994 new 0.14) lr 1.00e-05 gnorm 0.069 5.76s mem 15.6GB +step 2512/5000 loss 0.0878 (w 0.0462 mse 0.0559 t 960 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2513/5000 loss 0.0545 (w 0.0664 mse 0.0639 t 942 new 0.24) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 2514/5000 loss 0.1166 (w 0.3212 mse 0.3277 t 122 new 0.22) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 2515/5000 loss 0.1043 (w 0.0998 mse 0.0961 t 945 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 2516/5000 loss 0.0873 (w 0.0648 mse 0.0615 t 907 new 0.23) lr 1.00e-05 gnorm 0.049 5.71s mem 15.6GB +step 2517/5000 loss 0.1063 (w 0.0862 mse 0.0865 t 403 new 0.26) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2518/5000 loss 0.0901 (w 0.2923 mse 0.2887 t 146 new 0.27) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 2519/5000 loss 0.1118 (w 0.1195 mse 0.1128 t 968 new 0.19) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 2520/5000 loss 0.0717 (w 0.0609 mse 0.0589 t 762 new 0.19) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2521/5000 loss 0.0597 (w 0.0386 mse 0.0373 t 701 new 0.20) lr 1.00e-05 gnorm 0.060 5.95s mem 15.6GB +step 2522/5000 loss 0.1055 (w 0.0619 mse 0.0647 t 743 new 0.19) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 2523/5000 loss 0.0724 (w 0.0793 mse 0.0790 t 762 new 0.20) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 2524/5000 loss 0.0663 (w 0.0629 mse 0.0605 t 879 new 0.25) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 2525/5000 loss 0.1319 (w 0.0581 mse 0.0512 t 809 new 0.20) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 2526/5000 loss 0.0805 (w 0.0662 mse 0.0655 t 865 new 0.16) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2527/5000 loss 0.0910 (w 0.2868 mse 0.2960 t 154 new 0.24) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 2528/5000 loss 0.1004 (w 0.0646 mse 0.0599 t 859 new 0.27) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 2529/5000 loss 0.0835 (w 0.1965 mse 0.1818 t 1000 new 0.22) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 2530/5000 loss 0.0334 (w 0.1126 mse 0.1062 t 962 new 0.25) lr 1.00e-05 gnorm 0.064 5.92s mem 15.6GB +step 2531/5000 loss 0.1200 (w 0.0599 mse 0.0591 t 612 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 2532/5000 loss 0.0897 (w 0.0639 mse 0.0638 t 638 new 0.24) lr 1.00e-05 gnorm 0.066 5.81s mem 15.6GB +step 2533/5000 loss 0.0893 (w 0.0821 mse 0.0788 t 640 new 0.19) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 2534/5000 loss 0.0719 (w 0.0489 mse 0.0475 t 813 new 0.26) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +step 2535/5000 loss 0.0774 (w 0.0760 mse 0.0756 t 527 new 0.27) lr 1.00e-05 gnorm 0.063 5.83s mem 15.6GB +step 2536/5000 loss 0.0722 (w 0.0776 mse 0.0767 t 916 new 0.17) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 2537/5000 loss 0.0932 (w 0.0745 mse 0.0686 t 896 new 0.22) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2538/5000 loss 0.0796 (w 0.0824 mse 0.0775 t 901 new 0.27) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 2539/5000 loss 0.0508 (w 0.0735 mse 0.0648 t 908 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2540/5000 loss 0.0954 (w 0.9835 mse 0.9826 t 10 new 0.21) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 2541/5000 loss 0.1125 (w 0.2478 mse 0.2478 t 134 new 0.32) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2542/5000 loss 0.0331 (w 0.2084 mse 0.2146 t 983 new 0.24) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 2543/5000 loss 0.0706 (w 0.1191 mse 0.1138 t 934 new 0.27) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 2544/5000 loss 0.0723 (w 0.1111 mse 0.1033 t 908 new 0.26) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 2545/5000 loss 0.0875 (w 0.1145 mse 0.1102 t 941 new 0.15) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 2546/5000 loss 0.0885 (w 0.1553 mse 0.1528 t 490 new 0.30) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2547/5000 loss 0.1179 (w 0.1207 mse 0.1135 t 693 new 0.24) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 2548/5000 loss 0.0755 (w 0.0792 mse 0.0755 t 859 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 2549/5000 loss 0.0977 (w 0.3388 mse 0.3368 t 105 new 0.13) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +step 2550/5000 loss 0.0543 (w 0.0990 mse 0.0899 t 892 new 0.21) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 2551/5000 loss 0.0811 (w 0.0742 mse 0.0698 t 473 new 0.25) lr 1.00e-05 gnorm 0.081 5.91s mem 15.6GB +step 2552/5000 loss 0.0860 (w 0.1229 mse 0.1172 t 970 new 0.19) lr 1.00e-05 gnorm 0.108 5.68s mem 15.6GB +step 2553/5000 loss 0.0942 (w 0.0620 mse 0.0636 t 905 new 0.20) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 2554/5000 loss 0.0652 (w 0.1356 mse 0.1276 t 936 new 0.25) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 2555/5000 loss 0.0962 (w 0.2736 mse 0.2836 t 66 new 0.13) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 2556/5000 loss 0.0648 (w 0.0577 mse 0.0552 t 859 new 0.27) lr 1.00e-05 gnorm 0.087 5.94s mem 15.6GB +step 2557/5000 loss 0.1238 (w 0.0395 mse 0.0386 t 779 new 0.20) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 2558/5000 loss 0.0835 (w 0.0935 mse 0.0979 t 581 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 2559/5000 loss 0.1197 (w 0.2885 mse 0.2857 t 134 new 0.25) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 2560/5000 loss 0.1038 (w 0.1276 mse 0.1363 t 993 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 2561/5000 loss 0.0800 (w 0.1079 mse 0.1077 t 873 new 0.18) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 2562/5000 loss 0.0898 (w 0.1492 mse 0.1527 t 219 new 0.20) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 2563/5000 loss 0.0649 (w 0.0685 mse 0.0651 t 923 new 0.16) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 2564/5000 loss 0.0894 (w 0.0372 mse 0.0387 t 781 new 0.10) lr 1.00e-05 gnorm 0.068 5.90s mem 15.6GB +step 2565/5000 loss 0.0524 (w 0.0615 mse 0.0625 t 686 new 0.10) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2566/5000 loss 0.1210 (w 0.0908 mse 0.0890 t 667 new 0.21) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 2567/5000 loss 0.0869 (w 0.0993 mse 0.0960 t 898 new 0.22) lr 1.00e-05 gnorm 0.070 5.72s mem 15.6GB +step 2568/5000 loss 0.0563 (w 0.1200 mse 0.1176 t 984 new 0.30) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +step 2569/5000 loss 0.0820 (w 0.0692 mse 0.0688 t 814 new 0.15) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2570/5000 loss 0.0827 (w 0.1016 mse 0.0984 t 331 new 0.23) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 2571/5000 loss 0.1208 (w 0.1260 mse 0.1255 t 306 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 2572/5000 loss 0.0701 (w 0.0666 mse 0.0627 t 879 new 0.18) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 2573/5000 loss 0.1134 (w 0.0711 mse 0.0715 t 847 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2574/5000 loss 0.0301 (w 0.1346 mse 0.1276 t 982 new 0.18) lr 1.00e-05 gnorm 0.055 5.91s mem 15.6GB +step 2575/5000 loss 0.1210 (w 0.1226 mse 0.1247 t 235 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2576/5000 loss 0.1247 (w 0.1676 mse 0.1624 t 328 new 0.20) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 2577/5000 loss 0.0453 (w 0.0625 mse 0.0565 t 904 new 0.21) lr 1.00e-05 gnorm 0.054 5.92s mem 15.6GB +step 2578/5000 loss 0.0538 (w 0.0411 mse 0.0414 t 733 new 0.27) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 2579/5000 loss 0.0418 (w 0.1446 mse 0.1329 t 982 new 0.27) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 2580/5000 loss 0.0898 (w 0.0767 mse 0.0708 t 616 new 0.24) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 2581/5000 loss 0.1291 (w 0.0622 mse 0.0613 t 578 new 0.21) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 2582/5000 loss 0.1289 (w 0.0860 mse 0.0773 t 812 new 0.29) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 2583/5000 loss 0.1020 (w 0.1070 mse 0.0999 t 771 new 0.29) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2584/5000 loss 0.0603 (w 0.0897 mse 0.0859 t 911 new 0.18) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 2585/5000 loss 0.0943 (w 0.0498 mse 0.0480 t 791 new 0.21) lr 1.00e-05 gnorm 0.075 6.02s mem 15.6GB +step 2586/5000 loss 0.0649 (w 0.1041 mse 0.1006 t 579 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2587/5000 loss 0.0691 (w 0.0902 mse 0.0867 t 785 new 0.19) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 2588/5000 loss 0.1131 (w 0.1606 mse 0.1692 t 403 new 0.18) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2589/5000 loss 0.0892 (w 0.0885 mse 0.0890 t 634 new 0.14) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2590/5000 loss 0.1109 (w 0.2231 mse 0.1925 t 997 new 0.32) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2591/5000 loss 0.0429 (w 0.1198 mse 0.1176 t 959 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2592/5000 loss 0.0770 (w 0.0930 mse 0.0925 t 861 new 0.27) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2593/5000 loss 0.1463 (w 0.0886 mse 0.0878 t 948 new 0.24) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +step 2594/5000 loss 0.0606 (w 0.0617 mse 0.0640 t 408 new 0.16) lr 1.00e-05 gnorm 0.062 5.85s mem 15.6GB +step 2595/5000 loss 0.0806 (w 0.0813 mse 0.0810 t 769 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2596/5000 loss 0.0825 (w 0.1409 mse 0.1310 t 933 new 0.32) lr 1.00e-05 gnorm 0.064 5.73s mem 15.6GB +step 2597/5000 loss 0.1317 (w 0.0891 mse 0.0809 t 906 new 0.20) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 2598/5000 loss 0.1082 (w 0.0698 mse 0.0713 t 950 new 0.20) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 2599/5000 loss 0.0597 (w 0.1511 mse 0.1448 t 964 new 0.18) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2600/5000 loss 0.0943 (w 0.1232 mse 0.1186 t 425 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2601/5000 loss 0.1159 (w 0.1017 mse 0.1045 t 837 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2602/5000 loss 0.0690 (w 0.0455 mse 0.0481 t 914 new 0.10) lr 1.00e-05 gnorm 0.054 5.72s mem 15.6GB +step 2603/5000 loss 0.0930 (w 0.0648 mse 0.0619 t 784 new 0.17) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2604/5000 loss 0.0528 (w 0.0922 mse 0.0943 t 772 new 0.25) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2605/5000 loss 0.0661 (w 0.0643 mse 0.0646 t 566 new 0.17) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 2606/5000 loss 0.0846 (w 0.0579 mse 0.0551 t 603 new 0.25) lr 1.00e-05 gnorm 0.059 5.91s mem 15.6GB +step 2607/5000 loss 0.0698 (w 0.0627 mse 0.0639 t 914 new 0.22) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 2608/5000 loss 0.0486 (w 0.0589 mse 0.0604 t 925 new 0.21) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 2609/5000 loss 0.0823 (w 0.1765 mse 0.1745 t 979 new 0.11) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 2610/5000 loss 0.0863 (w 0.0682 mse 0.0669 t 715 new 0.25) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2611/5000 loss 0.0949 (w 0.1125 mse 0.1048 t 530 new 0.24) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2612/5000 loss 0.1043 (w 0.1079 mse 0.1014 t 843 new 0.26) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2613/5000 loss 0.0538 (w 0.2407 mse 0.2256 t 984 new 0.20) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 2614/5000 loss 0.0947 (w 0.0859 mse 0.0859 t 417 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2615/5000 loss 0.0890 (w 0.0786 mse 0.0719 t 704 new 0.30) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 2616/5000 loss 0.1090 (w 0.0999 mse 0.1018 t 964 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2617/5000 loss 0.0415 (w 0.1508 mse 0.1474 t 964 new 0.17) lr 1.00e-05 gnorm 0.058 5.72s mem 15.6GB +step 2618/5000 loss 0.0738 (w 0.2085 mse 0.1909 t 1000 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2619/5000 loss 0.0732 (w 0.0373 mse 0.0408 t 896 new 0.25) lr 1.00e-05 gnorm 0.054 5.91s mem 15.6GB +step 2620/5000 loss 0.0942 (w 0.0860 mse 0.0843 t 955 new 0.21) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 2621/5000 loss 0.0768 (w 0.1002 mse 0.1037 t 360 new 0.11) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 2622/5000 loss 0.0632 (w 0.0615 mse 0.0589 t 895 new 0.15) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2623/5000 loss 0.0702 (w 0.0866 mse 0.0860 t 367 new 0.24) lr 1.00e-05 gnorm 0.070 5.93s mem 15.6GB +step 2624/5000 loss 0.0916 (w 0.0719 mse 0.0672 t 712 new 0.23) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 2625/5000 loss 0.1138 (w 0.1070 mse 0.1000 t 545 new 0.27) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 2626/5000 loss 0.0910 (w 0.0791 mse 0.0733 t 750 new 0.21) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 2627/5000 loss 0.1052 (w 0.0822 mse 0.0798 t 669 new 0.22) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 2628/5000 loss 0.1108 (w 0.0688 mse 0.0663 t 776 new 0.22) lr 1.00e-05 gnorm 0.082 5.77s mem 15.6GB +step 2629/5000 loss 0.0836 (w 0.1404 mse 0.1360 t 954 new 0.27) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2630/5000 loss 0.1281 (w 0.1348 mse 0.1346 t 323 new 0.21) lr 1.00e-05 gnorm 0.066 5.84s mem 15.6GB +step 2631/5000 loss 0.0735 (w 0.1794 mse 0.1725 t 987 new 0.24) lr 1.00e-05 gnorm 0.177 5.68s mem 15.6GB +step 2632/5000 loss 0.0736 (w 0.0718 mse 0.0744 t 568 new 0.19) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 2633/5000 loss 0.1083 (w 0.1043 mse 0.0970 t 952 new 0.17) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 2634/5000 loss 0.1268 (w 0.0536 mse 0.0558 t 733 new 0.15) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 2635/5000 loss 0.1028 (w 0.0576 mse 0.0600 t 812 new 0.27) lr 1.00e-05 gnorm 0.057 5.71s mem 15.6GB +step 2636/5000 loss 0.0531 (w 0.0910 mse 0.0849 t 923 new 0.16) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 2637/5000 loss 0.0636 (w 0.0934 mse 0.0926 t 900 new 0.03) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 2638/5000 loss 0.1132 (w 0.0215 mse 0.0246 t 610 new 0.22) lr 1.00e-05 gnorm 0.065 5.89s mem 15.6GB +step 2639/5000 loss 0.0476 (w 0.1472 mse 0.1407 t 983 new 0.20) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2640/5000 loss 0.1020 (w 0.0540 mse 0.0544 t 656 new 0.22) lr 1.00e-05 gnorm 0.056 5.92s mem 15.6GB +step 2641/5000 loss 0.0430 (w 0.1640 mse 0.1616 t 988 new 0.27) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2642/5000 loss 0.0790 (w 0.1177 mse 0.1116 t 975 new 0.23) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 2643/5000 loss 0.0591 (w 0.0589 mse 0.0532 t 758 new 0.17) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 2644/5000 loss 0.0973 (w 0.0815 mse 0.0789 t 880 new 0.24) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 2645/5000 loss 0.0650 (w 0.1020 mse 0.0989 t 980 new 0.16) lr 1.00e-05 gnorm 0.056 5.71s mem 15.6GB +step 2646/5000 loss 0.1070 (w 0.0454 mse 0.0465 t 684 new 0.23) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 2647/5000 loss 0.0900 (w 0.0967 mse 0.0971 t 917 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2648/5000 loss 0.0580 (w 0.0943 mse 0.0859 t 860 new 0.21) lr 1.00e-05 gnorm 0.075 5.83s mem 15.6GB +step 2649/5000 loss 0.1023 (w 0.0611 mse 0.0576 t 679 new 0.29) lr 1.00e-05 gnorm 0.069 5.88s mem 15.6GB +step 2650/5000 loss 0.0703 (w 0.0944 mse 0.0912 t 495 new 0.26) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2651/5000 loss 0.0703 (w 0.0781 mse 0.0808 t 812 new 0.17) lr 1.00e-05 gnorm 0.049 5.90s mem 15.6GB +step 2652/5000 loss 0.1036 (w 0.1171 mse 0.1105 t 966 new 0.27) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +step 2653/5000 loss 0.1164 (w 0.1205 mse 0.1308 t 347 new 0.16) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +step 2654/5000 loss 0.0998 (w 0.0439 mse 0.0432 t 658 new 0.17) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2655/5000 loss 0.0697 (w 0.3087 mse 0.3489 t 29 new 0.15) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2656/5000 loss 0.1077 (w 0.1000 mse 0.0975 t 663 new 0.20) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 2657/5000 loss 0.1725 (w 0.1555 mse 0.1492 t 352 new 0.24) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 2658/5000 loss 0.1021 (w 0.0625 mse 0.0615 t 643 new 0.20) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 2659/5000 loss 0.0701 (w 0.1042 mse 0.1015 t 972 new 0.25) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 2660/5000 loss 0.0642 (w 0.0721 mse 0.0676 t 914 new 0.28) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 2661/5000 loss 0.1074 (w 0.1014 mse 0.0963 t 956 new 0.27) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 2662/5000 loss 0.1160 (w 0.3069 mse 0.3134 t 71 new 0.25) lr 1.00e-05 gnorm 0.060 5.72s mem 15.6GB +step 2663/5000 loss 0.0754 (w 0.0704 mse 0.0650 t 954 new 0.24) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2664/5000 loss 0.0867 (w 0.0719 mse 0.0688 t 689 new 0.27) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 2665/5000 loss 0.0867 (w 0.0568 mse 0.0592 t 967 new 0.10) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2666/5000 loss 0.0793 (w 0.1901 mse 0.1820 t 984 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2667/5000 loss 0.0685 (w 0.0827 mse 0.0832 t 691 new 0.19) lr 1.00e-05 gnorm 0.081 5.83s mem 15.6GB +step 2668/5000 loss 0.0817 (w 0.0975 mse 0.0979 t 919 new 0.24) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 2669/5000 loss 0.0743 (w 0.0789 mse 0.0793 t 846 new 0.24) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 2670/5000 loss 0.0583 (w 0.1302 mse 0.1287 t 996 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 2671/5000 loss 0.0975 (w 0.0446 mse 0.0526 t 927 new 0.22) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 2672/5000 loss 0.0520 (w 0.1083 mse 0.0995 t 945 new 0.25) lr 1.00e-05 gnorm 0.063 5.90s mem 15.6GB +step 2673/5000 loss 0.0887 (w 0.0508 mse 0.0549 t 784 new 0.27) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 2674/5000 loss 0.0871 (w 0.1251 mse 0.1198 t 942 new 0.22) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 2675/5000 loss 0.1547 (w 0.0869 mse 0.0857 t 382 new 0.14) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2676/5000 loss 0.1313 (w 0.1130 mse 0.1084 t 362 new 0.21) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2677/5000 loss 0.1083 (w 0.1073 mse 0.0994 t 574 new 0.22) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 2678/5000 loss 0.1056 (w 0.1186 mse 0.1089 t 955 new 0.18) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2679/5000 loss 0.0849 (w 0.0736 mse 0.0704 t 781 new 0.21) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 2680/5000 loss 0.1436 (w 0.0866 mse 0.0796 t 484 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 2681/5000 loss 0.1322 (w 0.2107 mse 0.2146 t 172 new 0.19) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 2682/5000 loss 0.0716 (w 0.1903 mse 0.1992 t 993 new 0.16) lr 1.00e-05 gnorm 0.072 5.80s mem 15.6GB +step 2683/5000 loss 0.1215 (w 0.0545 mse 0.0562 t 575 new 0.24) lr 1.00e-05 gnorm 0.091 5.83s mem 15.6GB +step 2684/5000 loss 0.0975 (w 0.1147 mse 0.1108 t 669 new 0.25) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 2685/5000 loss 0.0495 (w 0.0639 mse 0.0561 t 910 new 0.22) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 2686/5000 loss 0.0595 (w 0.1257 mse 0.1203 t 982 new 0.26) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 2687/5000 loss 0.1334 (w 0.1847 mse 0.1825 t 314 new 0.20) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 2688/5000 loss 0.0889 (w 0.0940 mse 0.0863 t 760 new 0.25) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 2689/5000 loss 0.0883 (w 0.0992 mse 0.0877 t 909 new 0.23) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 2690/5000 loss 0.1083 (w 0.0520 mse 0.0518 t 745 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 2691/5000 loss 0.0718 (w 0.1371 mse 0.1308 t 991 new 0.20) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 2692/5000 loss 0.0584 (w 0.0698 mse 0.0694 t 873 new 0.27) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2693/5000 loss 0.0585 (w 0.0475 mse 0.0491 t 595 new 0.19) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2694/5000 loss 0.0984 (w 0.1040 mse 0.1021 t 325 new 0.21) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 2695/5000 loss 0.1162 (w 0.0650 mse 0.0636 t 693 new 0.25) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 2696/5000 loss 0.1091 (w 0.1679 mse 0.1703 t 285 new 0.27) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2697/5000 loss 0.0896 (w 0.0647 mse 0.0611 t 563 new 0.26) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 2698/5000 loss 0.0735 (w 0.0700 mse 0.0655 t 889 new 0.24) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 2699/5000 loss 0.0942 (w 0.0559 mse 0.0556 t 603 new 0.23) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +step 2700/5000 loss 0.0963 (w 0.0779 mse 0.0684 t 838 new 0.24) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 2701/5000 loss 0.0729 (w 0.1100 mse 0.1129 t 883 new 0.15) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2702/5000 loss 0.0678 (w 0.1266 mse 0.1245 t 979 new 0.12) lr 1.00e-05 gnorm 0.061 5.67s mem 15.6GB +step 2703/5000 loss 0.0602 (w 0.0955 mse 0.0952 t 934 new 0.23) lr 1.00e-05 gnorm 0.069 5.76s mem 15.6GB +step 2704/5000 loss 0.0756 (w 0.1002 mse 0.0926 t 719 new 0.22) lr 1.00e-05 gnorm 0.078 5.79s mem 15.6GB +step 2705/5000 loss 0.1350 (w 0.0732 mse 0.0793 t 399 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2706/5000 loss 0.0875 (w 0.0814 mse 0.0817 t 642 new 0.22) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2707/5000 loss 0.0921 (w 0.1186 mse 0.1145 t 939 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2708/5000 loss 0.0988 (w 0.1029 mse 0.1133 t 198 new 0.22) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 2709/5000 loss 0.0732 (w 0.0659 mse 0.0613 t 907 new 0.28) lr 1.00e-05 gnorm 0.057 5.76s mem 15.6GB +step 2710/5000 loss 0.0762 (w 0.0903 mse 0.0826 t 891 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2711/5000 loss 0.1029 (w 0.4832 mse 0.4760 t 75 new 0.20) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 2712/5000 loss 0.0761 (w 0.1500 mse 0.1411 t 985 new 0.20) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 2713/5000 loss 0.0973 (w 0.1142 mse 0.1175 t 992 new 0.16) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2714/5000 loss 0.0744 (w 0.0758 mse 0.0736 t 913 new 0.25) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 2715/5000 loss 0.1154 (w 0.1246 mse 0.1092 t 963 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2716/5000 loss 0.0468 (w 0.0737 mse 0.0731 t 497 new 0.27) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 2717/5000 loss 0.1031 (w 0.0491 mse 0.0464 t 737 new 0.20) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2718/5000 loss 0.0995 (w 0.0934 mse 0.0885 t 451 new 0.30) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2719/5000 loss 0.0913 (w 0.0680 mse 0.0724 t 944 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 2720/5000 loss 0.0651 (w 0.0806 mse 0.0849 t 533 new 0.20) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 2721/5000 loss 0.0799 (w 0.0975 mse 0.0973 t 495 new 0.27) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2722/5000 loss 0.1106 (w 0.0921 mse 0.0919 t 880 new 0.21) lr 1.00e-05 gnorm 0.067 5.94s mem 15.6GB +step 2723/5000 loss 0.0656 (w 0.0481 mse 0.0519 t 873 new 0.12) lr 1.00e-05 gnorm 0.069 5.67s mem 15.6GB +step 2724/5000 loss 0.0947 (w 0.0921 mse 0.0861 t 568 new 0.24) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 2725/5000 loss 0.0923 (w 0.0277 mse 0.0335 t 502 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2726/5000 loss 0.0763 (w 0.0845 mse 0.0756 t 838 new 0.18) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 2727/5000 loss 0.0812 (w 0.2184 mse 0.2119 t 996 new 0.20) lr 1.00e-05 gnorm 0.057 5.92s mem 15.6GB +step 2728/5000 loss 0.1142 (w 0.1629 mse 0.1609 t 273 new 0.29) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2729/5000 loss 0.1143 (w 0.0308 mse 0.0368 t 837 new 0.22) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2730/5000 loss 0.0920 (w 0.0433 mse 0.0429 t 669 new 0.14) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2731/5000 loss 0.0686 (w 0.0731 mse 0.0743 t 778 new 0.13) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 2732/5000 loss 0.0653 (w 0.0686 mse 0.0752 t 972 new 0.19) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 2733/5000 loss 0.0831 (w 0.7847 mse 0.7922 t 34 new 0.28) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 2734/5000 loss 0.0948 (w 0.0960 mse 0.0944 t 543 new 0.28) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 2735/5000 loss 0.0897 (w 0.1382 mse 0.1325 t 945 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2736/5000 loss 0.0746 (w 0.0575 mse 0.0619 t 779 new 0.19) lr 1.00e-05 gnorm 0.051 5.91s mem 15.6GB +step 2737/5000 loss 0.0721 (w 0.1565 mse 0.1476 t 982 new 0.11) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +step 2738/5000 loss 0.0886 (w 0.1677 mse 0.1494 t 986 new 0.24) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 2739/5000 loss 0.0429 (w 0.3463 mse 0.3089 t 995 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2740/5000 loss 0.0814 (w 0.1644 mse 0.1671 t 215 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2741/5000 loss 0.0513 (w 0.0381 mse 0.0406 t 663 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2742/5000 loss 0.0773 (w 0.0687 mse 0.0660 t 808 new 0.29) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 2743/5000 loss 0.0615 (w 0.0910 mse 0.0862 t 958 new 0.18) lr 1.00e-05 gnorm 0.055 5.72s mem 15.6GB +step 2744/5000 loss 0.0580 (w 0.0345 mse 0.0339 t 763 new 0.06) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 2745/5000 loss 0.0761 (w 0.2129 mse 0.2106 t 973 new 0.20) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 2746/5000 loss 0.0993 (w 0.1392 mse 0.1277 t 969 new 0.24) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2747/5000 loss 0.0751 (w 0.1075 mse 0.1001 t 695 new 0.24) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 2748/5000 loss 0.1508 (w 0.0324 mse 0.0357 t 821 new 0.13) lr 1.00e-05 gnorm 0.066 5.91s mem 15.6GB +step 2749/5000 loss 0.0787 (w 0.0541 mse 0.0571 t 931 new 0.15) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2750/5000 loss 0.0680 (w 0.0994 mse 0.0989 t 909 new 0.20) lr 1.00e-05 gnorm 0.059 5.71s mem 15.6GB +step 2751/5000 loss 0.1010 (w 0.1223 mse 0.1192 t 981 new 0.26) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +step 2752/5000 loss 0.0743 (w 0.0778 mse 0.0756 t 907 new 0.21) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 2753/5000 loss 0.0718 (w 0.1142 mse 0.1074 t 977 new 0.29) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 2754/5000 loss 0.0893 (w 0.0767 mse 0.0787 t 608 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2755/5000 loss 0.0821 (w 0.0787 mse 0.0737 t 578 new 0.26) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +step 2756/5000 loss 0.0990 (w 0.2032 mse 0.1979 t 201 new 0.19) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2757/5000 loss 0.1112 (w 0.1148 mse 0.1113 t 581 new 0.24) lr 1.00e-05 gnorm 0.069 5.92s mem 15.6GB +step 2758/5000 loss 0.0531 (w 0.0812 mse 0.0828 t 919 new 0.17) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 2759/5000 loss 0.0918 (w 0.0655 mse 0.0635 t 635 new 0.25) lr 1.00e-05 gnorm 0.058 5.73s mem 15.6GB +step 2760/5000 loss 0.0640 (w 0.0412 mse 0.0408 t 569 new 0.12) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 2761/5000 loss 0.0775 (w 0.0811 mse 0.0820 t 725 new 0.21) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2762/5000 loss 0.0667 (w 0.1220 mse 0.1117 t 961 new 0.28) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 2763/5000 loss 0.0518 (w 0.0249 mse 0.0279 t 824 new 0.14) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 2764/5000 loss 0.1125 (w 0.1204 mse 0.1120 t 915 new 0.27) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2765/5000 loss 0.1178 (w 0.1039 mse 0.1005 t 399 new 0.28) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2766/5000 loss 0.1093 (w 0.0880 mse 0.0815 t 951 new 0.23) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 2767/5000 loss 0.1129 (w 0.0429 mse 0.0425 t 670 new 0.13) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2768/5000 loss 0.0931 (w 0.1769 mse 0.1736 t 288 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2769/5000 loss 0.0833 (w 0.0766 mse 0.0706 t 880 new 0.13) lr 1.00e-05 gnorm 0.057 5.93s mem 15.6GB +step 2770/5000 loss 0.0482 (w 0.0609 mse 0.0606 t 786 new 0.28) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 2771/5000 loss 0.0716 (w 0.0512 mse 0.0529 t 845 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 2772/5000 loss 0.1049 (w 0.0613 mse 0.0584 t 854 new 0.19) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 2773/5000 loss 0.1189 (w 0.2187 mse 0.2255 t 157 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2774/5000 loss 0.0832 (w 0.0722 mse 0.0710 t 923 new 0.30) lr 1.00e-05 gnorm 0.098 5.68s mem 15.6GB +step 2775/5000 loss 0.0873 (w 0.0798 mse 0.0784 t 684 new 0.19) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 2776/5000 loss 0.0930 (w 0.0433 mse 0.0429 t 876 new 0.24) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 2777/5000 loss 0.0828 (w 0.0684 mse 0.0664 t 856 new 0.09) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2778/5000 loss 0.0900 (w 0.0894 mse 0.0823 t 913 new 0.18) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 2779/5000 loss 0.0963 (w 0.3660 mse 0.3718 t 109 new 0.22) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2780/5000 loss 0.0688 (w 0.0307 mse 0.0322 t 836 new 0.30) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2781/5000 loss 0.0736 (w 0.0671 mse 0.0684 t 915 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 2782/5000 loss 0.0937 (w 0.0924 mse 0.0891 t 957 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2783/5000 loss 0.1262 (w 0.1278 mse 0.1287 t 285 new 0.28) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2784/5000 loss 0.0599 (w 0.0984 mse 0.0911 t 859 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 2785/5000 loss 0.1488 (w 0.2071 mse 0.2117 t 169 new 0.23) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 2786/5000 loss 0.1066 (w 0.1012 mse 0.0936 t 733 new 0.25) lr 1.00e-05 gnorm 0.052 5.89s mem 15.6GB +step 2787/5000 loss 0.0949 (w 0.0916 mse 0.0874 t 587 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2788/5000 loss 0.0647 (w 0.1152 mse 0.1133 t 970 new 0.27) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2789/5000 loss 0.0935 (w 0.0937 mse 0.0859 t 854 new 0.21) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 2790/5000 loss 0.0803 (w 0.0491 mse 0.0459 t 695 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2791/5000 loss 0.0552 (w 0.1095 mse 0.1059 t 961 new 0.14) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2792/5000 loss 0.0896 (w 0.0444 mse 0.0470 t 818 new 0.18) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 2793/5000 loss 0.0730 (w 0.0917 mse 0.0857 t 933 new 0.30) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2794/5000 loss 0.0782 (w 0.0950 mse 0.1003 t 706 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2795/5000 loss 0.0989 (w 0.1170 mse 0.1042 t 953 new 0.28) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 2796/5000 loss 0.1265 (w 0.0973 mse 0.0928 t 593 new 0.29) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 2797/5000 loss 0.0630 (w 0.1223 mse 0.1134 t 946 new 0.23) lr 1.00e-05 gnorm 0.095 5.68s mem 15.6GB +step 2798/5000 loss 0.0839 (w 0.0989 mse 0.0929 t 964 new 0.24) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 2799/5000 loss 0.0855 (w 0.0318 mse 0.0328 t 669 new 0.14) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 2800/5000 loss 0.0658 (w 0.0677 mse 0.0650 t 336 new 0.17) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2801/5000 loss 0.1050 (w 0.0617 mse 0.0582 t 707 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2802/5000 loss 0.1124 (w 0.1419 mse 0.1392 t 509 new 0.20) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2803/5000 loss 0.0745 (w 0.3773 mse 0.3925 t 109 new 0.23) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 2804/5000 loss 0.0638 (w 0.0652 mse 0.0615 t 596 new 0.21) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 2805/5000 loss 0.1024 (w 0.2671 mse 0.2487 t 996 new 0.27) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 2806/5000 loss 0.0762 (w 0.1244 mse 0.1104 t 980 new 0.22) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 2807/5000 loss 0.0962 (w 0.0677 mse 0.0686 t 475 new 0.13) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 2808/5000 loss 0.0451 (w 0.1059 mse 0.0986 t 859 new 0.22) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 2809/5000 loss 0.1659 (w 0.1408 mse 0.1424 t 285 new 0.24) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 2810/5000 loss 0.1236 (w 0.1038 mse 0.0970 t 538 new 0.25) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 2811/5000 loss 0.1346 (w 0.1654 mse 0.1624 t 958 new 0.23) lr 1.00e-05 gnorm 0.081 5.92s mem 15.6GB +step 2812/5000 loss 0.1345 (w 0.0563 mse 0.0540 t 821 new 0.21) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 2813/5000 loss 0.1260 (w 0.0466 mse 0.0490 t 786 new 0.22) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 2814/5000 loss 0.1235 (w 0.1234 mse 0.1243 t 280 new 0.26) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2815/5000 loss 0.1036 (w 0.1386 mse 0.1388 t 403 new 0.20) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 2816/5000 loss 0.0394 (w 0.0951 mse 0.0924 t 894 new 0.24) lr 1.00e-05 gnorm 0.056 5.81s mem 15.6GB +step 2817/5000 loss 0.0914 (w 0.0944 mse 0.0894 t 881 new 0.25) lr 1.00e-05 gnorm 0.066 5.74s mem 15.6GB +step 2818/5000 loss 0.0931 (w 0.0898 mse 0.0909 t 648 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2819/5000 loss 0.0893 (w 0.0919 mse 0.0786 t 887 new 0.25) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2820/5000 loss 0.0596 (w 0.0758 mse 0.0718 t 890 new 0.21) lr 1.00e-05 gnorm 0.058 5.92s mem 15.6GB +step 2821/5000 loss 0.1169 (w 0.0933 mse 0.0883 t 602 new 0.20) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2822/5000 loss 0.0958 (w 0.2330 mse 0.2298 t 248 new 0.27) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +step 2823/5000 loss 0.1114 (w 0.1969 mse 0.1817 t 1000 new 0.24) lr 1.00e-05 gnorm 0.046 5.68s mem 15.6GB +step 2824/5000 loss 0.1136 (w 0.1404 mse 0.1441 t 380 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 2825/5000 loss 0.0857 (w 0.0759 mse 0.0768 t 410 new 0.19) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 2826/5000 loss 0.1102 (w 0.0899 mse 0.0889 t 403 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 2827/5000 loss 0.0910 (w 0.0931 mse 0.0907 t 469 new 0.17) lr 1.00e-05 gnorm 0.056 5.76s mem 15.6GB +step 2828/5000 loss 0.1322 (w 0.1162 mse 0.1206 t 215 new 0.13) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 2829/5000 loss 0.0928 (w 0.0555 mse 0.0549 t 569 new 0.19) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 2830/5000 loss 0.1212 (w 0.0697 mse 0.0676 t 750 new 0.24) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 2831/5000 loss 0.0915 (w 0.0833 mse 0.0837 t 957 new 0.17) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2832/5000 loss 0.0518 (w 0.1479 mse 0.1428 t 975 new 0.20) lr 1.00e-05 gnorm 0.096 5.68s mem 15.6GB +step 2833/5000 loss 0.1117 (w 0.0887 mse 0.0793 t 903 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2834/5000 loss 0.1255 (w 0.0735 mse 0.0714 t 568 new 0.13) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 2835/5000 loss 0.1528 (w 0.0921 mse 0.0876 t 568 new 0.22) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 2836/5000 loss 0.0902 (w 0.0828 mse 0.0804 t 895 new 0.17) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 2837/5000 loss 0.0982 (w 0.0947 mse 0.0851 t 693 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 2838/5000 loss 0.0602 (w 0.0431 mse 0.0413 t 890 new 0.24) lr 1.00e-05 gnorm 0.067 5.97s mem 15.6GB +step 2839/5000 loss 0.1107 (w 0.0528 mse 0.0515 t 786 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2840/5000 loss 0.0475 (w 0.0703 mse 0.0687 t 905 new 0.28) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 2841/5000 loss 0.0883 (w 0.0318 mse 0.0343 t 894 new 0.17) lr 1.00e-05 gnorm 0.076 5.91s mem 15.6GB +step 2842/5000 loss 0.0898 (w 0.0729 mse 0.0692 t 793 new 0.21) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2843/5000 loss 0.0880 (w 0.0941 mse 0.0943 t 980 new 0.26) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 2844/5000 loss 0.0986 (w 0.0822 mse 0.0772 t 661 new 0.24) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2845/5000 loss 0.1012 (w 0.0654 mse 0.0653 t 598 new 0.24) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 2846/5000 loss 0.0733 (w 0.0868 mse 0.0810 t 887 new 0.22) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 2847/5000 loss 0.0706 (w 0.1706 mse 0.1677 t 970 new 0.21) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 2848/5000 loss 0.0662 (w 0.0884 mse 0.0782 t 823 new 0.29) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2849/5000 loss 0.0722 (w 0.2098 mse 0.1749 t 998 new 0.24) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 2850/5000 loss 0.0826 (w 0.0913 mse 0.0853 t 956 new 0.29) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 2851/5000 loss 0.0643 (w 0.0645 mse 0.0620 t 796 new 0.25) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 2852/5000 loss 0.0671 (w 0.0764 mse 0.0705 t 788 new 0.31) lr 1.00e-05 gnorm 0.066 5.71s mem 15.6GB +step 2853/5000 loss 0.0892 (w 0.0897 mse 0.0877 t 818 new 0.21) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 2854/5000 loss 0.1329 (w 0.1303 mse 0.1311 t 306 new 0.20) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2855/5000 loss 0.1269 (w 0.0662 mse 0.0653 t 724 new 0.17) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2856/5000 loss 0.0992 (w 0.1815 mse 0.1808 t 317 new 0.29) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +step 2857/5000 loss 0.1344 (w 0.0631 mse 0.0707 t 285 new 0.23) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 2858/5000 loss 0.0807 (w 0.1082 mse 0.1031 t 873 new 0.20) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 2859/5000 loss 0.0991 (w 0.0839 mse 0.0835 t 827 new 0.22) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2860/5000 loss 0.1260 (w 0.1837 mse 0.1820 t 955 new 0.20) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2861/5000 loss 0.1052 (w 0.0821 mse 0.0789 t 748 new 0.24) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 2862/5000 loss 0.1116 (w 0.0577 mse 0.0524 t 889 new 0.24) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 2863/5000 loss 0.1410 (w 0.0810 mse 0.0741 t 944 new 0.23) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2864/5000 loss 0.0715 (w 0.0942 mse 0.0883 t 843 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2865/5000 loss 0.0988 (w 0.0921 mse 0.0906 t 408 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2866/5000 loss 0.1152 (w 0.0585 mse 0.0572 t 742 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 2867/5000 loss 0.0991 (w 0.1025 mse 0.1005 t 962 new 0.20) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2868/5000 loss 0.0861 (w 0.0534 mse 0.0517 t 698 new 0.27) lr 1.00e-05 gnorm 0.058 5.79s mem 15.6GB +step 2869/5000 loss 0.0743 (w 0.0651 mse 0.0621 t 901 new 0.20) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 2870/5000 loss 0.0811 (w 0.1006 mse 0.0947 t 971 new 0.18) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 2871/5000 loss 0.1079 (w 0.1174 mse 0.1194 t 632 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 2872/5000 loss 0.1076 (w 0.0899 mse 0.0824 t 874 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2873/5000 loss 0.1079 (w 0.1035 mse 0.1050 t 871 new 0.19) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 2874/5000 loss 0.0511 (w 0.1194 mse 0.1117 t 915 new 0.26) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 2875/5000 loss 0.1348 (w 0.0760 mse 0.0741 t 559 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2876/5000 loss 0.0747 (w 0.0623 mse 0.0597 t 922 new 0.31) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 2877/5000 loss 0.0545 (w 0.0714 mse 0.0712 t 724 new 0.21) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 2878/5000 loss 0.0710 (w 0.1146 mse 0.1112 t 923 new 0.21) lr 1.00e-05 gnorm 0.074 5.93s mem 15.6GB +step 2879/5000 loss 0.0608 (w 0.0832 mse 0.0760 t 956 new 0.26) lr 1.00e-05 gnorm 0.071 5.95s mem 15.6GB +step 2880/5000 loss 0.1284 (w 0.1740 mse 0.1627 t 967 new 0.21) lr 1.00e-05 gnorm 0.070 5.85s mem 15.6GB +step 2881/5000 loss 0.0751 (w 0.0697 mse 0.0656 t 953 new 0.11) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 2882/5000 loss 0.0617 (w 0.0630 mse 0.0595 t 777 new 0.25) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 2883/5000 loss 0.0861 (w 0.1172 mse 0.1155 t 935 new 0.21) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2884/5000 loss 0.0609 (w 0.1364 mse 0.1263 t 985 new 0.19) lr 1.00e-05 gnorm 0.067 5.92s mem 15.6GB +step 2885/5000 loss 0.1079 (w 0.1446 mse 0.1351 t 987 new 0.22) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 2886/5000 loss 0.0867 (w 0.0518 mse 0.0506 t 840 new 0.30) lr 1.00e-05 gnorm 0.060 5.92s mem 15.6GB +step 2887/5000 loss 0.0772 (w 0.1609 mse 0.1567 t 965 new 0.30) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2888/5000 loss 0.1264 (w 0.0636 mse 0.0626 t 737 new 0.18) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 2889/5000 loss 0.0929 (w 0.1075 mse 0.0999 t 872 new 0.27) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 2890/5000 loss 0.0556 (w 0.0460 mse 0.0487 t 626 new 0.25) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 2891/5000 loss 0.1085 (w 0.7614 mse 0.7678 t 29 new 0.25) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 2892/5000 loss 0.0541 (w 0.1473 mse 0.1431 t 964 new 0.28) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2893/5000 loss 0.0789 (w 0.0673 mse 0.0638 t 879 new 0.27) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 2894/5000 loss 0.0616 (w 0.1226 mse 0.1050 t 957 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2895/5000 loss 0.1114 (w 0.0900 mse 0.0840 t 854 new 0.22) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 2896/5000 loss 0.0770 (w 0.0953 mse 0.0943 t 988 new 0.08) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 2897/5000 loss 0.0891 (w 0.1920 mse 0.1884 t 994 new 0.16) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 2898/5000 loss 0.1323 (w 0.0938 mse 0.0897 t 644 new 0.22) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 2899/5000 loss 0.0988 (w 0.0656 mse 0.0653 t 577 new 0.20) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2900/5000 loss 0.0975 (w 0.0221 mse 0.0250 t 804 new 0.20) lr 1.00e-05 gnorm 0.063 5.91s mem 15.6GB +step 2901/5000 loss 0.0612 (w 0.1491 mse 0.1354 t 973 new 0.31) lr 1.00e-05 gnorm 0.103 5.68s mem 15.6GB +step 2902/5000 loss 0.0883 (w 0.3390 mse 0.3342 t 114 new 0.20) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 2903/5000 loss 0.1105 (w 0.1258 mse 0.1297 t 967 new 0.26) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 2904/5000 loss 0.0854 (w 0.1352 mse 0.1317 t 997 new 0.11) lr 1.00e-05 gnorm 0.059 5.67s mem 15.6GB +step 2905/5000 loss 0.0636 (w 0.1679 mse 0.1587 t 988 new 0.25) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 2906/5000 loss 0.0592 (w 0.1104 mse 0.1058 t 827 new 0.22) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +step 2907/5000 loss 0.0221 (w 0.3343 mse 0.3292 t 999 new 0.18) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 2908/5000 loss 0.0503 (w 0.2139 mse 0.1946 t 1000 new 0.20) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 2909/5000 loss 0.0866 (w 0.1015 mse 0.0939 t 802 new 0.24) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 2910/5000 loss 0.0770 (w 0.1307 mse 0.1198 t 968 new 0.24) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 2911/5000 loss 0.0741 (w 0.0343 mse 0.0387 t 879 new 0.26) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 2912/5000 loss 0.1512 (w 0.1032 mse 0.1023 t 403 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 2913/5000 loss 0.0560 (w 0.0817 mse 0.0781 t 652 new 0.15) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2914/5000 loss 0.0568 (w 0.0726 mse 0.0696 t 910 new 0.25) lr 1.00e-05 gnorm 0.067 5.72s mem 15.6GB +step 2915/5000 loss 0.1233 (w 0.0826 mse 0.0796 t 626 new 0.20) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 2916/5000 loss 0.0760 (w 0.1152 mse 0.1206 t 928 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 2917/5000 loss 0.0796 (w 0.0407 mse 0.0408 t 764 new 0.11) lr 1.00e-05 gnorm 0.064 5.79s mem 15.6GB +step 2918/5000 loss 0.0864 (w 0.0579 mse 0.0564 t 908 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2919/5000 loss 0.0793 (w 0.1050 mse 0.0934 t 980 new 0.18) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 2920/5000 loss 0.0990 (w 0.1044 mse 0.1036 t 945 new 0.18) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2921/5000 loss 0.0559 (w 0.0859 mse 0.0806 t 874 new 0.25) lr 1.00e-05 gnorm 0.148 5.96s mem 15.6GB +step 2922/5000 loss 0.1319 (w 0.0823 mse 0.0764 t 538 new 0.25) lr 1.00e-05 gnorm 0.066 5.90s mem 15.6GB +step 2923/5000 loss 0.1424 (w 0.0590 mse 0.0565 t 715 new 0.24) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 2924/5000 loss 0.1706 (w 0.1609 mse 0.1598 t 239 new 0.30) lr 1.00e-05 gnorm 0.064 5.89s mem 15.6GB +step 2925/5000 loss 0.1312 (w 0.0357 mse 0.0372 t 816 new 0.10) lr 1.00e-05 gnorm 0.087 5.90s mem 15.6GB +step 2926/5000 loss 0.1098 (w 0.0823 mse 0.0780 t 682 new 0.26) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 2927/5000 loss 0.0832 (w 0.0736 mse 0.0697 t 853 new 0.15) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 2928/5000 loss 0.0820 (w 0.0997 mse 0.0942 t 938 new 0.23) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 2929/5000 loss 0.0638 (w 0.0748 mse 0.0746 t 880 new 0.19) lr 1.00e-05 gnorm 0.071 5.71s mem 15.6GB +step 2930/5000 loss 0.1356 (w 0.0834 mse 0.0808 t 992 new 0.15) lr 1.00e-05 gnorm 0.068 5.71s mem 15.6GB +step 2931/5000 loss 0.1042 (w 0.0374 mse 0.0388 t 651 new 0.28) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 2932/5000 loss 0.0484 (w 0.0960 mse 0.0945 t 962 new 0.27) lr 1.00e-05 gnorm 0.074 5.78s mem 15.6GB +step 2933/5000 loss 0.0764 (w 0.0502 mse 0.0495 t 798 new 0.26) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 2934/5000 loss 0.1123 (w 0.0840 mse 0.0822 t 432 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 2935/5000 loss 0.0901 (w 0.0780 mse 0.0756 t 412 new 0.27) lr 1.00e-05 gnorm 0.071 5.72s mem 15.6GB +step 2936/5000 loss 0.0606 (w 0.0783 mse 0.0727 t 719 new 0.17) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 2937/5000 loss 0.1195 (w 0.1034 mse 0.0991 t 525 new 0.23) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 2938/5000 loss 0.0775 (w 0.0963 mse 0.0981 t 918 new 0.27) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 2939/5000 loss 0.0977 (w 0.0765 mse 0.0753 t 925 new 0.12) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2940/5000 loss 0.1362 (w 0.2530 mse 0.2503 t 180 new 0.27) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +step 2941/5000 loss 0.0518 (w 0.1137 mse 0.1111 t 918 new 0.22) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 2942/5000 loss 0.0601 (w 0.0539 mse 0.0605 t 951 new 0.19) lr 1.00e-05 gnorm 0.077 6.06s mem 15.6GB +step 2943/5000 loss 0.0705 (w 0.1755 mse 0.1617 t 979 new 0.23) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +step 2944/5000 loss 0.1245 (w 0.1405 mse 0.1397 t 996 new 0.14) lr 1.00e-05 gnorm 0.068 5.82s mem 15.6GB +step 2945/5000 loss 0.1137 (w 0.0302 mse 0.0286 t 823 new 0.10) lr 1.00e-05 gnorm 0.086 5.89s mem 15.6GB +step 2946/5000 loss 0.0736 (w 0.0620 mse 0.0581 t 934 new 0.25) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 2947/5000 loss 0.0768 (w 0.0744 mse 0.0704 t 557 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2948/5000 loss 0.0561 (w 0.0807 mse 0.0808 t 870 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 2949/5000 loss 0.1005 (w 0.1231 mse 0.1190 t 891 new 0.20) lr 1.00e-05 gnorm 0.104 5.68s mem 15.6GB +step 2950/5000 loss 0.0813 (w 0.1515 mse 0.1433 t 984 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2951/5000 loss 0.0932 (w 0.3467 mse 0.3552 t 995 new 0.23) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 2952/5000 loss 0.0902 (w 0.0473 mse 0.0442 t 942 new 0.08) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 2953/5000 loss 0.0943 (w 0.0665 mse 0.0633 t 863 new 0.19) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 2954/5000 loss 0.1287 (w 0.0485 mse 0.0489 t 717 new 0.18) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2955/5000 loss 0.0710 (w 0.0640 mse 0.0592 t 838 new 0.15) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 2956/5000 loss 0.0729 (w 0.0709 mse 0.0721 t 939 new 0.22) lr 1.00e-05 gnorm 0.101 5.68s mem 15.6GB +step 2957/5000 loss 0.0684 (w 0.0703 mse 0.0699 t 980 new 0.12) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 2958/5000 loss 0.0908 (w 0.1256 mse 0.1369 t 280 new 0.20) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +step 2959/5000 loss 0.0856 (w 0.1098 mse 0.0987 t 937 new 0.22) lr 1.00e-05 gnorm 0.121 5.70s mem 15.6GB +step 2960/5000 loss 0.1442 (w 0.0573 mse 0.0565 t 958 new 0.11) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +step 2961/5000 loss 0.1406 (w 0.0557 mse 0.0546 t 765 new 0.13) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 2962/5000 loss 0.1466 (w 0.0766 mse 0.0750 t 365 new 0.24) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 2963/5000 loss 0.0633 (w 0.0937 mse 0.0812 t 930 new 0.27) lr 1.00e-05 gnorm 0.127 5.69s mem 15.6GB +step 2964/5000 loss 0.0786 (w 0.0786 mse 0.0839 t 968 new 0.26) lr 1.00e-05 gnorm 0.079 5.93s mem 15.6GB +step 2965/5000 loss 0.1091 (w 0.0676 mse 0.0631 t 819 new 0.24) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +step 2966/5000 loss 0.1012 (w 0.0765 mse 0.0678 t 935 new 0.23) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +step 2967/5000 loss 0.1157 (w 0.0896 mse 0.0840 t 604 new 0.25) lr 1.00e-05 gnorm 0.109 5.68s mem 15.6GB +step 2968/5000 loss 0.1172 (w 0.2922 mse 0.2889 t 183 new 0.20) lr 1.00e-05 gnorm 0.079 5.82s mem 15.6GB +step 2969/5000 loss 0.0790 (w 0.0701 mse 0.0669 t 797 new 0.30) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 2970/5000 loss 0.1346 (w 0.0834 mse 0.0780 t 509 new 0.26) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 2971/5000 loss 0.0900 (w 0.1271 mse 0.1208 t 979 new 0.23) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 2972/5000 loss 0.0926 (w 0.1349 mse 0.1256 t 905 new 0.20) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2973/5000 loss 0.0526 (w 0.0493 mse 0.0494 t 484 new 0.21) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 2974/5000 loss 0.1116 (w 0.1221 mse 0.1230 t 303 new 0.25) lr 1.00e-05 gnorm 0.069 5.92s mem 15.6GB +step 2975/5000 loss 0.0750 (w 0.0934 mse 0.0900 t 998 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2976/5000 loss 0.1090 (w 0.0715 mse 0.0626 t 855 new 0.21) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +step 2977/5000 loss 0.0625 (w 0.1265 mse 0.1331 t 959 new 0.17) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 2978/5000 loss 0.0739 (w 0.0761 mse 0.0715 t 690 new 0.25) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 2979/5000 loss 0.1099 (w 0.0956 mse 0.0925 t 701 new 0.23) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 2980/5000 loss 0.1552 (w 0.0876 mse 0.0810 t 637 new 0.19) lr 1.00e-05 gnorm 0.091 5.74s mem 15.6GB +step 2981/5000 loss 0.0975 (w 0.2258 mse 0.1917 t 999 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 2982/5000 loss 0.0600 (w 0.1019 mse 0.0944 t 847 new 0.26) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 2983/5000 loss 0.0596 (w 0.7582 mse 0.7624 t 39 new 0.20) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 2984/5000 loss 0.0831 (w 0.0708 mse 0.0684 t 753 new 0.27) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +step 2985/5000 loss 0.0848 (w 0.0632 mse 0.0604 t 908 new 0.23) lr 1.00e-05 gnorm 0.081 6.16s mem 15.6GB +step 2986/5000 loss 0.0989 (w 0.1152 mse 0.1159 t 933 new 0.30) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 2987/5000 loss 0.1108 (w 0.1200 mse 0.1169 t 927 new 0.23) lr 1.00e-05 gnorm 0.099 5.92s mem 15.6GB +step 2988/5000 loss 0.1029 (w 0.0398 mse 0.0403 t 656 new 0.07) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2989/5000 loss 0.1092 (w 0.2463 mse 0.2434 t 187 new 0.29) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 2990/5000 loss 0.0985 (w 0.0753 mse 0.0711 t 862 new 0.26) lr 1.00e-05 gnorm 0.111 5.69s mem 15.6GB +step 2991/5000 loss 0.0839 (w 0.0959 mse 0.0884 t 931 new 0.20) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 2992/5000 loss 0.1126 (w 0.0570 mse 0.0552 t 724 new 0.26) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 2993/5000 loss 0.0396 (w 0.1816 mse 0.1677 t 978 new 0.18) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 2994/5000 loss 0.0595 (w 0.0908 mse 0.0847 t 988 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 2995/5000 loss 0.0839 (w 0.0500 mse 0.0551 t 752 new 0.18) lr 1.00e-05 gnorm 0.054 5.71s mem 15.6GB +step 2996/5000 loss 0.1223 (w 0.0637 mse 0.0559 t 603 new 0.22) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 2997/5000 loss 0.0834 (w 0.0585 mse 0.0582 t 837 new 0.28) lr 1.00e-05 gnorm 0.053 5.90s mem 15.6GB +step 2998/5000 loss 0.1407 (w 0.0333 mse 0.0347 t 794 new 0.08) lr 1.00e-05 gnorm 0.061 5.73s mem 15.6GB +step 2999/5000 loss 0.1091 (w 0.1263 mse 0.1218 t 963 new 0.30) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 3000/5000 loss 0.0871 (w 0.0667 mse 0.0628 t 895 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[val] step 3000 t=201: w=0.1749 mse=0.1773 (n=16) t=501: w=0.0725 mse=0.0724 (n=16) t=800: w=0.0607 mse=0.0595 (n=16) | mean w=0.1027 mse=0.1031 4s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step3000.safetensors 832 个张量 2.87 GB +step 3001/5000 loss 0.0637 (w 0.0788 mse 0.0760 t 904 new 0.21) lr 1.00e-05 gnorm 0.061 5.67s mem 15.6GB +step 3002/5000 loss 0.0673 (w 0.0336 mse 0.0365 t 701 new 0.17) lr 1.00e-05 gnorm 0.069 5.71s mem 15.6GB +step 3003/5000 loss 0.0766 (w 0.0685 mse 0.0670 t 780 new 0.24) lr 1.00e-05 gnorm 0.080 5.71s mem 15.6GB +step 3004/5000 loss 0.0321 (w 0.1181 mse 0.1121 t 948 new 0.28) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 3005/5000 loss 0.0888 (w 0.1345 mse 0.1376 t 953 new 0.21) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 3006/5000 loss 0.0909 (w 0.0838 mse 0.0838 t 904 new 0.19) lr 1.00e-05 gnorm 0.054 5.77s mem 15.6GB +step 3007/5000 loss 0.0781 (w 0.0719 mse 0.0631 t 723 new 0.24) lr 1.00e-05 gnorm 0.062 5.73s mem 15.6GB +step 3008/5000 loss 0.0984 (w 0.0861 mse 0.0880 t 790 new 0.24) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3009/5000 loss 0.0781 (w 0.0548 mse 0.0514 t 871 new 0.26) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 3010/5000 loss 0.0962 (w 0.0550 mse 0.0528 t 574 new 0.13) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 3011/5000 loss 0.0968 (w 0.1861 mse 0.1672 t 965 new 0.27) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 3012/5000 loss 0.0681 (w 0.0650 mse 0.0653 t 914 new 0.24) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +step 3013/5000 loss 0.0871 (w 0.0762 mse 0.0731 t 933 new 0.25) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 3014/5000 loss 0.1426 (w 0.1225 mse 0.1160 t 929 new 0.23) lr 1.00e-05 gnorm 0.109 5.69s mem 15.6GB +step 3015/5000 loss 0.0773 (w 0.0299 mse 0.0302 t 803 new 0.12) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3016/5000 loss 0.0961 (w 0.0764 mse 0.0748 t 802 new 0.23) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3017/5000 loss 0.1061 (w 0.2995 mse 0.2990 t 122 new 0.22) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 3018/5000 loss 0.1284 (w 0.0864 mse 0.0824 t 478 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3019/5000 loss 0.0768 (w 0.0485 mse 0.0451 t 810 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 3020/5000 loss 0.0743 (w 0.0307 mse 0.0351 t 516 new 0.15) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3021/5000 loss 0.0978 (w 0.0700 mse 0.0702 t 912 new 0.26) lr 1.00e-05 gnorm 0.092 5.82s mem 15.6GB +step 3022/5000 loss 0.0837 (w 0.0600 mse 0.0577 t 725 new 0.12) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 3023/5000 loss 0.0474 (w 0.0668 mse 0.0680 t 950 new 0.10) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 3024/5000 loss 0.1388 (w 0.0821 mse 0.0737 t 933 new 0.23) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 3025/5000 loss 0.0541 (w 0.1614 mse 0.1493 t 988 new 0.24) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 3026/5000 loss 0.0546 (w 0.1078 mse 0.1050 t 988 new 0.21) lr 1.00e-05 gnorm 0.052 5.71s mem 15.6GB +step 3027/5000 loss 0.0902 (w 0.1715 mse 0.1576 t 999 new 0.26) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 3028/5000 loss 0.0851 (w 0.0926 mse 0.0884 t 961 new 0.23) lr 1.00e-05 gnorm 0.066 6.13s mem 15.6GB +step 3029/5000 loss 0.0821 (w 0.0767 mse 0.0808 t 482 new 0.17) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 3030/5000 loss 0.0536 (w 0.1221 mse 0.1125 t 967 new 0.27) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 3031/5000 loss 0.0778 (w 0.0699 mse 0.0659 t 689 new 0.30) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3032/5000 loss 0.0944 (w 0.1005 mse 0.0939 t 906 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3033/5000 loss 0.0722 (w 0.1037 mse 0.1017 t 957 new 0.19) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3034/5000 loss 0.0766 (w 0.0723 mse 0.0657 t 777 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3035/5000 loss 0.0788 (w 0.2624 mse 0.2593 t 142 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3036/5000 loss 0.1139 (w 0.0655 mse 0.0611 t 948 new 0.26) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 3037/5000 loss 0.1002 (w 0.0843 mse 0.0808 t 859 new 0.23) lr 1.00e-05 gnorm 0.067 5.93s mem 15.6GB +step 3038/5000 loss 0.0814 (w 0.0861 mse 0.0836 t 895 new 0.24) lr 1.00e-05 gnorm 0.071 5.98s mem 15.6GB +step 3039/5000 loss 0.0841 (w 0.0668 mse 0.0669 t 930 new 0.17) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3040/5000 loss 0.0820 (w 0.0267 mse 0.0297 t 495 new 0.16) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3041/5000 loss 0.0589 (w 0.0617 mse 0.0622 t 961 new 0.20) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +step 3042/5000 loss 0.0660 (w 0.0873 mse 0.0842 t 926 new 0.19) lr 1.00e-05 gnorm 0.058 5.75s mem 15.6GB +step 3043/5000 loss 0.0978 (w 0.0955 mse 0.0932 t 617 new 0.25) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 3044/5000 loss 0.0749 (w 0.0498 mse 0.0479 t 840 new 0.22) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3045/5000 loss 0.0803 (w 0.0843 mse 0.0805 t 770 new 0.24) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 3046/5000 loss 0.1147 (w 0.1085 mse 0.1117 t 264 new 0.30) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 3047/5000 loss 0.0784 (w 0.0791 mse 0.0878 t 971 new 0.25) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3048/5000 loss 0.0919 (w 0.1822 mse 0.1811 t 225 new 0.23) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 3049/5000 loss 0.1165 (w 0.0884 mse 0.0833 t 834 new 0.25) lr 1.00e-05 gnorm 0.067 5.93s mem 15.6GB +step 3050/5000 loss 0.0468 (w 0.2143 mse 0.2119 t 990 new 0.29) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3051/5000 loss 0.0906 (w 0.0568 mse 0.0540 t 786 new 0.20) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 3052/5000 loss 0.1216 (w 0.0998 mse 0.0926 t 908 new 0.26) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3053/5000 loss 0.0600 (w 0.1467 mse 0.1368 t 979 new 0.27) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3054/5000 loss 0.0952 (w 0.0866 mse 0.0963 t 336 new 0.12) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 3055/5000 loss 0.0554 (w 0.1465 mse 0.1413 t 986 new 0.28) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 3056/5000 loss 0.0772 (w 0.0558 mse 0.0531 t 792 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3057/5000 loss 0.1140 (w 0.0937 mse 0.0941 t 865 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3058/5000 loss 0.0659 (w 0.0733 mse 0.0704 t 533 new 0.27) lr 1.00e-05 gnorm 0.065 5.93s mem 15.6GB +step 3059/5000 loss 0.1172 (w 0.1050 mse 0.1017 t 810 new 0.23) lr 1.00e-05 gnorm 0.072 5.93s mem 15.6GB +step 3060/5000 loss 0.0544 (w 0.0676 mse 0.0629 t 909 new 0.12) lr 1.00e-05 gnorm 0.065 5.74s mem 15.6GB +step 3061/5000 loss 0.1225 (w 0.0628 mse 0.0631 t 740 new 0.24) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3062/5000 loss 0.0679 (w 0.0937 mse 0.0927 t 836 new 0.17) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3063/5000 loss 0.0903 (w 0.0141 mse 0.0144 t 644 new 0.12) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3064/5000 loss 0.0806 (w 0.0556 mse 0.0535 t 522 new 0.11) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3065/5000 loss 0.0700 (w 0.0818 mse 0.0780 t 929 new 0.15) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3066/5000 loss 0.0839 (w 0.0578 mse 0.0543 t 908 new 0.25) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 3067/5000 loss 0.0729 (w 0.1508 mse 0.1434 t 995 new 0.28) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3068/5000 loss 0.0613 (w 0.0913 mse 0.0826 t 828 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3069/5000 loss 0.0642 (w 0.0393 mse 0.0422 t 724 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3070/5000 loss 0.1350 (w 0.0752 mse 0.0764 t 746 new 0.20) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3071/5000 loss 0.0504 (w 0.0848 mse 0.0867 t 951 new 0.22) lr 1.00e-05 gnorm 0.063 5.96s mem 15.6GB +step 3072/5000 loss 0.1116 (w 0.0673 mse 0.0641 t 886 new 0.24) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 3073/5000 loss 0.1067 (w 0.1556 mse 0.1454 t 979 new 0.23) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 3074/5000 loss 0.0797 (w 0.1377 mse 0.1394 t 990 new 0.25) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 3075/5000 loss 0.1016 (w 0.0957 mse 0.0882 t 925 new 0.23) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 3076/5000 loss 0.0925 (w 0.0397 mse 0.0396 t 812 new 0.09) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3077/5000 loss 0.0582 (w 0.1296 mse 0.1265 t 979 new 0.13) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3078/5000 loss 0.1100 (w 0.0951 mse 0.0934 t 875 new 0.23) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3079/5000 loss 0.0963 (w 0.0448 mse 0.0451 t 774 new 0.12) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3080/5000 loss 0.0836 (w 0.1124 mse 0.1135 t 802 new 0.30) lr 1.00e-05 gnorm 0.055 5.94s mem 15.6GB +step 3081/5000 loss 0.1102 (w 0.0727 mse 0.0772 t 430 new 0.28) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3082/5000 loss 0.0525 (w 0.0687 mse 0.0639 t 861 new 0.26) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3083/5000 loss 0.0685 (w 0.1090 mse 0.0967 t 868 new 0.26) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 3084/5000 loss 0.0792 (w 0.0735 mse 0.0695 t 671 new 0.20) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 3085/5000 loss 0.1198 (w 0.1612 mse 0.1605 t 291 new 0.17) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 3086/5000 loss 0.1293 (w 0.1248 mse 0.1192 t 620 new 0.21) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3087/5000 loss 0.0610 (w 0.1744 mse 0.1662 t 982 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3088/5000 loss 0.1014 (w 0.0513 mse 0.0515 t 684 new 0.12) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 3089/5000 loss 0.0362 (w 0.0636 mse 0.0629 t 815 new 0.22) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +step 3090/5000 loss 0.0998 (w 0.0518 mse 0.0509 t 480 new 0.27) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3091/5000 loss 0.1135 (w 0.0875 mse 0.0907 t 851 new 0.26) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 3092/5000 loss 0.0863 (w 0.0556 mse 0.0560 t 587 new 0.22) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 3093/5000 loss 0.0783 (w 0.0527 mse 0.0482 t 818 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3094/5000 loss 0.0962 (w 0.1581 mse 0.1546 t 270 new 0.26) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 3095/5000 loss 0.0509 (w 0.1618 mse 0.1582 t 990 new 0.17) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 3096/5000 loss 0.1091 (w 0.0624 mse 0.0602 t 515 new 0.24) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 3097/5000 loss 0.0810 (w 0.0530 mse 0.0542 t 764 new 0.24) lr 1.00e-05 gnorm 0.056 5.84s mem 15.6GB +step 3098/5000 loss 0.0738 (w 0.1203 mse 0.1160 t 960 new 0.21) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 3099/5000 loss 0.0656 (w 0.1053 mse 0.0993 t 967 new 0.22) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 3100/5000 loss 0.1258 (w 0.0934 mse 0.0862 t 802 new 0.24) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 3101/5000 loss 0.0649 (w 0.0602 mse 0.0584 t 863 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3102/5000 loss 0.0508 (w 0.1016 mse 0.0959 t 978 new 0.10) lr 1.00e-05 gnorm 0.082 5.88s mem 15.6GB +step 3103/5000 loss 0.0722 (w 0.0666 mse 0.0640 t 865 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3104/5000 loss 0.0999 (w 0.0646 mse 0.0628 t 717 new 0.26) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 3105/5000 loss 0.1097 (w 0.0672 mse 0.0660 t 651 new 0.27) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +step 3106/5000 loss 0.1082 (w 0.1831 mse 0.1687 t 998 new 0.22) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 3107/5000 loss 0.0721 (w 0.0819 mse 0.0798 t 798 new 0.18) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 3108/5000 loss 0.1111 (w 0.1077 mse 0.1018 t 742 new 0.26) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 3109/5000 loss 0.0703 (w 0.1596 mse 0.1506 t 1000 new 0.18) lr 1.00e-05 gnorm 0.062 5.84s mem 15.6GB +step 3110/5000 loss 0.1361 (w 0.0972 mse 0.0968 t 527 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3111/5000 loss 0.0909 (w 0.0973 mse 0.0896 t 898 new 0.26) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 3112/5000 loss 0.0805 (w 0.1425 mse 0.1412 t 951 new 0.25) lr 1.00e-05 gnorm 0.062 5.71s mem 15.6GB +step 3113/5000 loss 0.0650 (w 0.0565 mse 0.0496 t 784 new 0.23) lr 1.00e-05 gnorm 0.061 5.95s mem 15.6GB +step 3114/5000 loss 0.1299 (w 0.0896 mse 0.0895 t 839 new 0.17) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3115/5000 loss 0.0819 (w 0.0782 mse 0.0742 t 954 new 0.13) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 3116/5000 loss 0.0807 (w 0.1050 mse 0.0969 t 936 new 0.21) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 3117/5000 loss 0.0871 (w 0.1795 mse 0.1593 t 994 new 0.21) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 3118/5000 loss 0.0475 (w 0.0490 mse 0.0563 t 985 new 0.21) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +step 3119/5000 loss 0.0695 (w 0.0678 mse 0.0667 t 862 new 0.24) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +step 3120/5000 loss 0.1169 (w 0.0724 mse 0.0700 t 349 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3121/5000 loss 0.0818 (w 0.1579 mse 0.1475 t 983 new 0.26) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3122/5000 loss 0.0900 (w 0.0726 mse 0.0697 t 873 new 0.25) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 3123/5000 loss 0.1313 (w 0.1388 mse 0.1312 t 235 new 0.24) lr 1.00e-05 gnorm 0.057 5.81s mem 15.6GB +step 3124/5000 loss 0.0916 (w 0.0303 mse 0.0349 t 860 new 0.22) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 3125/5000 loss 0.1329 (w 0.1010 mse 0.0923 t 906 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3126/5000 loss 0.0803 (w 0.0919 mse 0.0873 t 513 new 0.23) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +step 3127/5000 loss 0.0992 (w 0.1009 mse 0.0978 t 786 new 0.25) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 3128/5000 loss 0.1603 (w 0.0699 mse 0.0698 t 838 new 0.20) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3129/5000 loss 0.1002 (w 0.1243 mse 0.1223 t 457 new 0.22) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 3130/5000 loss 0.1044 (w 0.0814 mse 0.0776 t 911 new 0.29) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3131/5000 loss 0.0866 (w 0.0453 mse 0.0463 t 850 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3132/5000 loss 0.0924 (w 0.0515 mse 0.0552 t 457 new 0.24) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 3133/5000 loss 0.0858 (w 0.0614 mse 0.0592 t 572 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3134/5000 loss 0.0928 (w 0.2051 mse 0.1970 t 229 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3135/5000 loss 0.0797 (w 0.0850 mse 0.0769 t 748 new 0.26) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 3136/5000 loss 0.0628 (w 0.0509 mse 0.0481 t 896 new 0.27) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3137/5000 loss 0.1050 (w 0.1412 mse 0.1398 t 382 new 0.23) lr 1.00e-05 gnorm 0.057 5.71s mem 15.6GB +step 3138/5000 loss 0.0640 (w 0.0430 mse 0.0406 t 913 new 0.14) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +step 3139/5000 loss 0.0876 (w 0.1044 mse 0.1039 t 914 new 0.21) lr 1.00e-05 gnorm 0.058 5.85s mem 15.6GB +step 3140/5000 loss 0.1061 (w 0.1107 mse 0.1064 t 999 new 0.23) lr 1.00e-05 gnorm 0.065 5.75s mem 15.6GB +step 3141/5000 loss 0.0940 (w 0.7428 mse 0.7436 t 29 new 0.26) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3142/5000 loss 0.0895 (w 0.1385 mse 0.1354 t 985 new 0.26) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3143/5000 loss 0.0707 (w 0.3408 mse 0.3080 t 998 new 0.25) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3144/5000 loss 0.0646 (w 0.0528 mse 0.0507 t 732 new 0.23) lr 1.00e-05 gnorm 0.058 5.85s mem 15.6GB +step 3145/5000 loss 0.0790 (w 0.0710 mse 0.0695 t 733 new 0.24) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 3146/5000 loss 0.1075 (w 0.0658 mse 0.0620 t 744 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 3147/5000 loss 0.1038 (w 0.0714 mse 0.0695 t 502 new 0.22) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3148/5000 loss 0.1206 (w 0.1560 mse 0.1703 t 154 new 0.31) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 3149/5000 loss 0.0644 (w 0.1750 mse 0.1604 t 986 new 0.25) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3150/5000 loss 0.0771 (w 0.1252 mse 0.1153 t 955 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3151/5000 loss 0.1041 (w 0.6232 mse 0.6480 t 48 new 0.25) lr 1.00e-05 gnorm 0.050 5.68s mem 15.6GB +step 3152/5000 loss 0.0557 (w 0.1132 mse 0.1078 t 969 new 0.22) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3153/5000 loss 0.1221 (w 0.0499 mse 0.0522 t 649 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3154/5000 loss 0.0856 (w 0.1026 mse 0.0942 t 913 new 0.26) lr 1.00e-05 gnorm 0.068 5.73s mem 15.6GB +step 3155/5000 loss 0.1113 (w 0.0774 mse 0.0736 t 911 new 0.26) lr 1.00e-05 gnorm 0.057 5.84s mem 15.6GB +step 3156/5000 loss 0.0701 (w 0.0555 mse 0.0578 t 886 new 0.28) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3157/5000 loss 0.0947 (w 0.1517 mse 0.1397 t 972 new 0.25) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3158/5000 loss 0.0998 (w 0.0757 mse 0.0701 t 632 new 0.17) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3159/5000 loss 0.0731 (w 0.0580 mse 0.0557 t 768 new 0.25) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3160/5000 loss 0.0655 (w 0.0687 mse 0.0646 t 791 new 0.23) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 3161/5000 loss 0.0665 (w 0.1203 mse 0.1168 t 966 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3162/5000 loss 0.0975 (w 0.0833 mse 0.0812 t 958 new 0.14) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 3163/5000 loss 0.0931 (w 0.0501 mse 0.0503 t 801 new 0.12) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3164/5000 loss 0.0536 (w 0.1056 mse 0.1026 t 933 new 0.23) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3165/5000 loss 0.1076 (w 0.0842 mse 0.0826 t 942 new 0.20) lr 1.00e-05 gnorm 0.053 5.86s mem 15.6GB +step 3166/5000 loss 0.1028 (w 0.1089 mse 0.1066 t 294 new 0.17) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 3167/5000 loss 0.0637 (w 0.1046 mse 0.1004 t 915 new 0.19) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3168/5000 loss 0.0529 (w 0.0380 mse 0.0383 t 923 new 0.23) lr 1.00e-05 gnorm 0.057 5.79s mem 15.6GB +step 3169/5000 loss 0.1196 (w 0.0616 mse 0.0616 t 947 new 0.10) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3170/5000 loss 0.0927 (w 0.0888 mse 0.0904 t 974 new 0.17) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3171/5000 loss 0.0534 (w 0.1200 mse 0.1142 t 984 new 0.14) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 3172/5000 loss 0.0971 (w 0.0521 mse 0.0471 t 842 new 0.17) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3173/5000 loss 0.0625 (w 0.0785 mse 0.0719 t 476 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3174/5000 loss 0.0967 (w 0.0626 mse 0.0699 t 905 new 0.23) lr 1.00e-05 gnorm 0.059 5.93s mem 15.6GB +step 3175/5000 loss 0.0795 (w 0.0900 mse 0.0856 t 535 new 0.25) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 3176/5000 loss 0.1256 (w 0.1808 mse 0.1798 t 183 new 0.21) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 3177/5000 loss 0.0889 (w 0.0820 mse 0.0827 t 790 new 0.08) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3178/5000 loss 0.1048 (w 0.0415 mse 0.0389 t 871 new 0.22) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 3179/5000 loss 0.0884 (w 0.0520 mse 0.0471 t 699 new 0.14) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 3180/5000 loss 0.1344 (w 0.1492 mse 0.1344 t 962 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3181/5000 loss 0.0787 (w 0.0757 mse 0.0776 t 961 new 0.24) lr 1.00e-05 gnorm 0.059 5.92s mem 15.6GB +step 3182/5000 loss 0.0829 (w 0.0555 mse 0.0540 t 671 new 0.21) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3183/5000 loss 0.0810 (w 0.0484 mse 0.0507 t 557 new 0.20) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3184/5000 loss 0.1224 (w 0.1007 mse 0.0950 t 959 new 0.26) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3185/5000 loss 0.1061 (w 0.0480 mse 0.0493 t 773 new 0.28) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3186/5000 loss 0.0718 (w 0.0841 mse 0.0826 t 457 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3187/5000 loss 0.0662 (w 0.0646 mse 0.0580 t 836 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3188/5000 loss 0.0811 (w 0.1195 mse 0.1128 t 948 new 0.28) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 3189/5000 loss 0.0935 (w 0.1142 mse 0.1138 t 991 new 0.24) lr 1.00e-05 gnorm 0.056 5.72s mem 15.6GB +step 3190/5000 loss 0.1042 (w 0.2331 mse 0.2312 t 169 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3191/5000 loss 0.0658 (w 0.0432 mse 0.0466 t 824 new 0.26) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3192/5000 loss 0.0877 (w 0.1418 mse 0.1398 t 781 new 0.19) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +step 3193/5000 loss 0.1290 (w 0.0882 mse 0.0801 t 907 new 0.24) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 3194/5000 loss 0.0483 (w 0.0594 mse 0.0565 t 855 new 0.24) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 3195/5000 loss 0.1184 (w 0.6814 mse 0.6809 t 39 new 0.15) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 3196/5000 loss 0.0912 (w 0.0531 mse 0.0493 t 954 new 0.26) lr 1.00e-05 gnorm 0.071 5.93s mem 15.6GB +step 3197/5000 loss 0.1208 (w 0.1019 mse 0.0980 t 582 new 0.24) lr 1.00e-05 gnorm 0.070 5.97s mem 15.6GB +step 3198/5000 loss 0.1595 (w 0.0967 mse 0.0920 t 946 new 0.14) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 3199/5000 loss 0.1348 (w 0.2013 mse 0.1995 t 309 new 0.22) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3200/5000 loss 0.1229 (w 0.2221 mse 0.2213 t 130 new 0.19) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 3201/5000 loss 0.0746 (w 0.0935 mse 0.0866 t 844 new 0.25) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3202/5000 loss 0.1114 (w 0.0621 mse 0.0628 t 775 new 0.22) lr 1.00e-05 gnorm 0.075 5.93s mem 15.6GB +step 3203/5000 loss 0.0986 (w 0.0827 mse 0.0796 t 794 new 0.21) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 3204/5000 loss 0.0834 (w 0.0647 mse 0.0619 t 799 new 0.25) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 3205/5000 loss 0.0524 (w 0.0600 mse 0.0570 t 915 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3206/5000 loss 0.0722 (w 0.0644 mse 0.0635 t 602 new 0.11) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +step 3207/5000 loss 0.1253 (w 0.0621 mse 0.0636 t 492 new 0.16) lr 1.00e-05 gnorm 0.089 5.88s mem 15.6GB +step 3208/5000 loss 0.1275 (w 0.0859 mse 0.0866 t 658 new 0.18) lr 1.00e-05 gnorm 0.062 5.90s mem 15.6GB +step 3209/5000 loss 0.0993 (w 0.0752 mse 0.0742 t 642 new 0.23) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3210/5000 loss 0.0894 (w 0.1947 mse 0.1911 t 1000 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3211/5000 loss 0.0761 (w 0.0515 mse 0.0501 t 620 new 0.23) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3212/5000 loss 0.0720 (w 0.1107 mse 0.1107 t 945 new 0.20) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3213/5000 loss 0.0732 (w 0.0647 mse 0.0622 t 796 new 0.26) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +step 3214/5000 loss 0.0626 (w 0.1101 mse 0.1135 t 943 new 0.12) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3215/5000 loss 0.0594 (w 0.2231 mse 0.2061 t 983 new 0.27) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 3216/5000 loss 0.0800 (w 0.0957 mse 0.0941 t 408 new 0.22) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3217/5000 loss 0.1151 (w 0.2359 mse 0.2318 t 187 new 0.32) lr 1.00e-05 gnorm 0.058 5.93s mem 15.6GB +step 3218/5000 loss 0.1020 (w 0.1094 mse 0.1079 t 880 new 0.14) lr 1.00e-05 gnorm 0.058 5.73s mem 15.6GB +step 3219/5000 loss 0.1641 (w 0.1443 mse 0.1371 t 270 new 0.22) lr 1.00e-05 gnorm 0.059 5.82s mem 15.6GB +step 3220/5000 loss 0.0853 (w 0.0436 mse 0.0428 t 670 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3221/5000 loss 0.0648 (w 0.1125 mse 0.1069 t 894 new 0.29) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3222/5000 loss 0.0816 (w 0.0526 mse 0.0528 t 804 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3223/5000 loss 0.1516 (w 0.0591 mse 0.0568 t 664 new 0.27) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 3224/5000 loss 0.1032 (w 0.0861 mse 0.0787 t 777 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3225/5000 loss 0.0552 (w 0.1752 mse 0.1650 t 980 new 0.29) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3226/5000 loss 0.0925 (w 0.0855 mse 0.0832 t 551 new 0.23) lr 1.00e-05 gnorm 0.102 5.69s mem 15.6GB +step 3227/5000 loss 0.0582 (w 0.1055 mse 0.1082 t 978 new 0.11) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 3228/5000 loss 0.0762 (w 0.0773 mse 0.0740 t 819 new 0.21) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +step 3229/5000 loss 0.0846 (w 0.0989 mse 0.0988 t 954 new 0.30) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 3230/5000 loss 0.0796 (w 0.0531 mse 0.0551 t 767 new 0.28) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 3231/5000 loss 0.1449 (w 0.1159 mse 0.1089 t 879 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3232/5000 loss 0.1044 (w 0.0707 mse 0.0638 t 798 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3233/5000 loss 0.1174 (w 0.1111 mse 0.1083 t 455 new 0.18) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3234/5000 loss 0.0855 (w 0.1123 mse 0.1061 t 676 new 0.26) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3235/5000 loss 0.0770 (w 0.0774 mse 0.0775 t 473 new 0.28) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 3236/5000 loss 0.0829 (w 0.0641 mse 0.0653 t 930 new 0.18) lr 1.00e-05 gnorm 0.047 5.70s mem 15.6GB +step 3237/5000 loss 0.1192 (w 0.8540 mse 0.8455 t 25 new 0.29) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3238/5000 loss 0.1042 (w 0.0296 mse 0.0304 t 603 new 0.14) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 3239/5000 loss 0.0738 (w 0.0697 mse 0.0668 t 880 new 0.30) lr 1.00e-05 gnorm 0.054 5.83s mem 15.6GB +step 3240/5000 loss 0.1179 (w 0.0445 mse 0.0405 t 873 new 0.27) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3241/5000 loss 0.0662 (w 0.1454 mse 0.1357 t 943 new 0.22) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 3242/5000 loss 0.0800 (w 0.1022 mse 0.0978 t 817 new 0.18) lr 1.00e-05 gnorm 0.051 5.84s mem 15.6GB +step 3243/5000 loss 0.0973 (w 0.1110 mse 0.1160 t 285 new 0.22) lr 1.00e-05 gnorm 0.062 5.72s mem 15.6GB +step 3244/5000 loss 0.0734 (w 0.0825 mse 0.0766 t 868 new 0.27) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 3245/5000 loss 0.0925 (w 0.0927 mse 0.0888 t 528 new 0.17) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3246/5000 loss 0.1226 (w 0.0328 mse 0.0329 t 722 new 0.08) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3247/5000 loss 0.1347 (w 0.4496 mse 0.4591 t 84 new 0.21) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3248/5000 loss 0.0649 (w 0.0802 mse 0.0809 t 908 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3249/5000 loss 0.0748 (w 0.0661 mse 0.0650 t 784 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3250/5000 loss 0.1045 (w 0.0336 mse 0.0334 t 850 new 0.23) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3251/5000 loss 0.0506 (w 0.0363 mse 0.0354 t 909 new 0.15) lr 1.00e-05 gnorm 0.055 5.90s mem 15.6GB +step 3252/5000 loss 0.0999 (w 0.0926 mse 0.0920 t 955 new 0.25) lr 1.00e-05 gnorm 0.070 5.96s mem 15.6GB +step 3253/5000 loss 0.0890 (w 0.0930 mse 0.0906 t 948 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 3254/5000 loss 0.0506 (w 0.0645 mse 0.0671 t 858 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3255/5000 loss 0.0713 (w 0.0931 mse 0.0909 t 967 new 0.18) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 3256/5000 loss 0.1108 (w 0.1696 mse 0.1629 t 997 new 0.13) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3257/5000 loss 0.0840 (w 0.2051 mse 0.2025 t 986 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3258/5000 loss 0.0865 (w 0.1650 mse 0.1548 t 970 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3259/5000 loss 0.0344 (w 0.1636 mse 0.1492 t 984 new 0.22) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3260/5000 loss 0.0616 (w 0.0508 mse 0.0518 t 938 new 0.12) lr 1.00e-05 gnorm 0.055 6.05s mem 15.6GB +step 3261/5000 loss 0.0621 (w 0.0942 mse 0.0866 t 842 new 0.30) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3262/5000 loss 0.1206 (w 0.6819 mse 0.6938 t 39 new 0.18) lr 1.00e-05 gnorm 0.081 6.17s mem 15.6GB +step 3263/5000 loss 0.1101 (w 0.1244 mse 0.1121 t 966 new 0.31) lr 1.00e-05 gnorm 0.054 5.92s mem 15.6GB +step 3264/5000 loss 0.1079 (w 0.0592 mse 0.0615 t 678 new 0.09) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +step 3265/5000 loss 0.0522 (w 0.1190 mse 0.1038 t 995 new 0.23) lr 1.00e-05 gnorm 0.047 5.71s mem 15.6GB +step 3266/5000 loss 0.0728 (w 0.0564 mse 0.0562 t 907 new 0.08) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 3267/5000 loss 0.0675 (w 0.0694 mse 0.0664 t 907 new 0.24) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 3268/5000 loss 0.0875 (w 0.0854 mse 0.0800 t 922 new 0.23) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 3269/5000 loss 0.0601 (w 0.0503 mse 0.0510 t 766 new 0.23) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3270/5000 loss 0.0909 (w 0.0771 mse 0.0748 t 849 new 0.18) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 3271/5000 loss 0.0744 (w 0.2357 mse 0.2229 t 995 new 0.29) lr 1.00e-05 gnorm 0.056 5.79s mem 15.6GB +step 3272/5000 loss 0.0384 (w 0.1431 mse 0.1404 t 984 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3273/5000 loss 0.0679 (w 0.0582 mse 0.0622 t 964 new 0.23) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 3274/5000 loss 0.0820 (w 0.0635 mse 0.0562 t 918 new 0.22) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 3275/5000 loss 0.0643 (w 0.0936 mse 0.0852 t 898 new 0.24) lr 1.00e-05 gnorm 0.060 5.83s mem 15.6GB +step 3276/5000 loss 0.0940 (w 0.0613 mse 0.0593 t 734 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3277/5000 loss 0.0897 (w 0.1120 mse 0.1108 t 973 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3278/5000 loss 0.0894 (w 0.1938 mse 0.1904 t 201 new 0.18) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3279/5000 loss 0.0813 (w 0.0663 mse 0.0657 t 685 new 0.29) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 3280/5000 loss 0.0952 (w 0.0918 mse 0.0922 t 344 new 0.21) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 3281/5000 loss 0.0832 (w 0.1258 mse 0.1238 t 957 new 0.22) lr 1.00e-05 gnorm 0.060 5.94s mem 15.6GB +step 3282/5000 loss 0.0558 (w 0.1331 mse 0.1270 t 947 new 0.28) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 3283/5000 loss 0.0683 (w 0.0398 mse 0.0437 t 518 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 3284/5000 loss 0.1343 (w 0.0700 mse 0.0711 t 945 new 0.28) lr 1.00e-05 gnorm 0.054 5.91s mem 15.6GB +step 3285/5000 loss 0.0656 (w 0.0713 mse 0.0704 t 888 new 0.25) lr 1.00e-05 gnorm 0.066 5.72s mem 15.6GB +step 3286/5000 loss 0.1008 (w 0.0770 mse 0.0712 t 617 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3287/5000 loss 0.0699 (w 0.0196 mse 0.0227 t 574 new 0.17) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3288/5000 loss 0.0685 (w 0.1321 mse 0.1275 t 947 new 0.23) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 3289/5000 loss 0.0626 (w 0.0537 mse 0.0592 t 871 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3290/5000 loss 0.0832 (w 0.2176 mse 0.2126 t 998 new 0.21) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3291/5000 loss 0.1257 (w 0.0956 mse 0.0943 t 520 new 0.13) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 3292/5000 loss 0.1229 (w 0.0692 mse 0.0645 t 916 new 0.14) lr 1.00e-05 gnorm 0.074 5.71s mem 15.6GB +step 3293/5000 loss 0.0829 (w 0.0919 mse 0.0865 t 947 new 0.22) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 3294/5000 loss 0.0754 (w 0.1521 mse 0.1458 t 971 new 0.25) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3295/5000 loss 0.1052 (w 0.1078 mse 0.0913 t 919 new 0.24) lr 1.00e-05 gnorm 0.065 5.87s mem 15.6GB +step 3296/5000 loss 0.1380 (w 0.1676 mse 0.1580 t 955 new 0.18) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3297/5000 loss 0.0654 (w 0.0601 mse 0.0555 t 913 new 0.18) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3298/5000 loss 0.1212 (w 0.4795 mse 0.4761 t 57 new 0.11) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3299/5000 loss 0.1226 (w 0.0644 mse 0.0646 t 867 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3300/5000 loss 0.0737 (w 0.0660 mse 0.0661 t 568 new 0.19) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 3301/5000 loss 0.0596 (w 0.0819 mse 0.0843 t 864 new 0.16) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 3302/5000 loss 0.1169 (w 0.0674 mse 0.0650 t 620 new 0.23) lr 1.00e-05 gnorm 0.055 6.09s mem 15.6GB +step 3303/5000 loss 0.0633 (w 0.0199 mse 0.0227 t 829 new 0.15) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3304/5000 loss 0.1019 (w 0.0538 mse 0.0527 t 938 new 0.16) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 3305/5000 loss 0.0445 (w 0.0736 mse 0.0657 t 611 new 0.17) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +step 3306/5000 loss 0.0957 (w 0.0725 mse 0.0709 t 614 new 0.24) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +step 3307/5000 loss 0.0645 (w 0.0733 mse 0.0722 t 901 new 0.20) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 3308/5000 loss 0.0779 (w 0.1250 mse 0.1194 t 977 new 0.30) lr 1.00e-05 gnorm 0.049 5.85s mem 15.6GB +step 3309/5000 loss 0.0463 (w 0.0824 mse 0.0800 t 961 new 0.27) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +step 3310/5000 loss 0.0577 (w 0.0533 mse 0.0491 t 858 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3311/5000 loss 0.0948 (w 0.1258 mse 0.1192 t 912 new 0.31) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 3312/5000 loss 0.0719 (w 0.1325 mse 0.1204 t 943 new 0.31) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 3313/5000 loss 0.1097 (w 0.2782 mse 0.2776 t 1000 new 0.31) lr 1.00e-05 gnorm 0.054 5.88s mem 15.6GB +step 3314/5000 loss 0.0975 (w 0.0693 mse 0.0632 t 814 new 0.25) lr 1.00e-05 gnorm 0.060 5.88s mem 15.6GB +step 3315/5000 loss 0.1026 (w 0.1464 mse 0.1332 t 973 new 0.26) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3316/5000 loss 0.1392 (w 0.0706 mse 0.0697 t 596 new 0.10) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3317/5000 loss 0.0962 (w 0.1040 mse 0.1044 t 365 new 0.30) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 3318/5000 loss 0.0862 (w 0.0672 mse 0.0669 t 432 new 0.14) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3319/5000 loss 0.1123 (w 0.0806 mse 0.0813 t 504 new 0.12) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 3320/5000 loss 0.0986 (w 0.0582 mse 0.0574 t 461 new 0.20) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3321/5000 loss 0.0949 (w 0.0647 mse 0.0640 t 805 new 0.22) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 3322/5000 loss 0.1465 (w 0.0948 mse 0.0915 t 981 new 0.25) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3323/5000 loss 0.0789 (w 0.0976 mse 0.0954 t 712 new 0.26) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +step 3324/5000 loss 0.0586 (w 0.0809 mse 0.0756 t 934 new 0.20) lr 1.00e-05 gnorm 0.049 5.72s mem 15.6GB +step 3325/5000 loss 0.0626 (w 0.1052 mse 0.0955 t 943 new 0.19) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 3326/5000 loss 0.0874 (w 0.1634 mse 0.1575 t 280 new 0.24) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 3327/5000 loss 0.0790 (w 0.0667 mse 0.0662 t 689 new 0.24) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 3328/5000 loss 0.0912 (w 0.0934 mse 0.0936 t 924 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3329/5000 loss 0.0615 (w 0.0679 mse 0.0652 t 798 new 0.21) lr 1.00e-05 gnorm 0.062 5.72s mem 15.6GB +step 3330/5000 loss 0.1060 (w 0.0595 mse 0.0568 t 600 new 0.19) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 3331/5000 loss 0.0796 (w 0.0897 mse 0.0879 t 914 new 0.13) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 3332/5000 loss 0.0921 (w 0.0827 mse 0.0775 t 859 new 0.20) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3333/5000 loss 0.1227 (w 0.1290 mse 0.1265 t 996 new 0.19) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3334/5000 loss 0.0929 (w 0.0617 mse 0.0567 t 778 new 0.24) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +step 3335/5000 loss 0.0989 (w 0.5611 mse 0.5514 t 66 new 0.20) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3336/5000 loss 0.1031 (w 0.0798 mse 0.0757 t 624 new 0.24) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3337/5000 loss 0.0859 (w 0.1020 mse 0.1017 t 475 new 0.24) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 3338/5000 loss 0.0825 (w 0.1558 mse 0.1500 t 917 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3339/5000 loss 0.0543 (w 0.0574 mse 0.0580 t 678 new 0.16) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3340/5000 loss 0.1160 (w 0.0434 mse 0.0411 t 549 new 0.21) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 3341/5000 loss 0.0829 (w 0.2597 mse 0.2631 t 109 new 0.19) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 3342/5000 loss 0.0611 (w 0.1714 mse 0.1717 t 943 new 0.17) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 3343/5000 loss 0.0974 (w 0.0159 mse 0.0172 t 794 new 0.13) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 3344/5000 loss 0.1711 (w 0.0887 mse 0.0841 t 658 new 0.24) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 3345/5000 loss 0.0620 (w 0.0695 mse 0.0694 t 399 new 0.22) lr 1.00e-05 gnorm 0.064 6.26s mem 15.6GB +step 3346/5000 loss 0.1141 (w 0.2266 mse 0.2270 t 245 new 0.27) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 3347/5000 loss 0.0771 (w 0.1107 mse 0.1068 t 813 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3348/5000 loss 0.1404 (w 0.0828 mse 0.0820 t 602 new 0.29) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 3349/5000 loss 0.0665 (w 0.1032 mse 0.0980 t 884 new 0.28) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 3350/5000 loss 0.0753 (w 0.1058 mse 0.1014 t 971 new 0.28) lr 1.00e-05 gnorm 0.072 5.71s mem 15.6GB +step 3351/5000 loss 0.0787 (w 0.0732 mse 0.0658 t 701 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3352/5000 loss 0.1124 (w 0.0941 mse 0.0908 t 977 new 0.25) lr 1.00e-05 gnorm 0.091 5.70s mem 15.6GB +step 3353/5000 loss 0.0982 (w 0.0800 mse 0.0826 t 530 new 0.13) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3354/5000 loss 0.1119 (w 0.0693 mse 0.0697 t 518 new 0.17) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 3355/5000 loss 0.0685 (w 0.1527 mse 0.1253 t 984 new 0.24) lr 1.00e-05 gnorm 0.069 5.76s mem 15.6GB +step 3356/5000 loss 0.0703 (w 0.1008 mse 0.1003 t 352 new 0.16) lr 1.00e-05 gnorm 0.076 5.67s mem 15.6GB +step 3357/5000 loss 0.0511 (w 0.2091 mse 0.1915 t 996 new 0.26) lr 1.00e-05 gnorm 0.068 5.71s mem 15.6GB +step 3358/5000 loss 0.0880 (w 0.2037 mse 0.1993 t 194 new 0.29) lr 1.00e-05 gnorm 0.063 5.71s mem 15.6GB +step 3359/5000 loss 0.1174 (w 0.0883 mse 0.0779 t 852 new 0.26) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 3360/5000 loss 0.1179 (w 0.0661 mse 0.0642 t 780 new 0.29) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3361/5000 loss 0.0452 (w 0.1503 mse 0.1360 t 993 new 0.31) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 3362/5000 loss 0.0718 (w 0.0669 mse 0.0681 t 688 new 0.16) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3363/5000 loss 0.0717 (w 0.0698 mse 0.0647 t 828 new 0.25) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 3364/5000 loss 0.0719 (w 0.1200 mse 0.1101 t 982 new 0.26) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 3365/5000 loss 0.0853 (w 0.8105 mse 0.8032 t 20 new 0.23) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 3366/5000 loss 0.0502 (w 0.0853 mse 0.0780 t 898 new 0.20) lr 1.00e-05 gnorm 0.063 5.76s mem 15.6GB +step 3367/5000 loss 0.0685 (w 0.0903 mse 0.0847 t 832 new 0.27) lr 1.00e-05 gnorm 0.100 5.68s mem 15.6GB +step 3368/5000 loss 0.0580 (w 0.0739 mse 0.0777 t 632 new 0.18) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3369/5000 loss 0.1248 (w 0.9803 mse 0.9797 t 10 new 0.25) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 3370/5000 loss 0.0651 (w 0.0651 mse 0.0639 t 651 new 0.19) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 3371/5000 loss 0.0898 (w 0.0443 mse 0.0452 t 901 new 0.07) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 3372/5000 loss 0.0816 (w 0.0808 mse 0.0781 t 745 new 0.20) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3373/5000 loss 0.0707 (w 0.0560 mse 0.0524 t 859 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3374/5000 loss 0.1103 (w 0.0540 mse 0.0552 t 870 new 0.18) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 3375/5000 loss 0.0820 (w 0.0720 mse 0.0678 t 772 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3376/5000 loss 0.1286 (w 0.0801 mse 0.0789 t 828 new 0.24) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 3377/5000 loss 0.0836 (w 0.2505 mse 0.2425 t 992 new 0.26) lr 1.00e-05 gnorm 0.060 5.67s mem 15.6GB +step 3378/5000 loss 0.0849 (w 0.1194 mse 0.1175 t 710 new 0.22) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 3379/5000 loss 0.0720 (w 0.0818 mse 0.0764 t 548 new 0.19) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 3380/5000 loss 0.0562 (w 0.0584 mse 0.0563 t 619 new 0.26) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3381/5000 loss 0.0932 (w 0.0723 mse 0.0658 t 730 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3382/5000 loss 0.0999 (w 0.0116 mse 0.0118 t 898 new 0.01) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 3383/5000 loss 0.0875 (w 0.0444 mse 0.0442 t 692 new 0.18) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3384/5000 loss 0.0558 (w 0.0445 mse 0.0473 t 622 new 0.30) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 3385/5000 loss 0.0803 (w 0.1015 mse 0.0966 t 533 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3386/5000 loss 0.0503 (w 0.0974 mse 0.0938 t 875 new 0.28) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 3387/5000 loss 0.0536 (w 0.1043 mse 0.0991 t 834 new 0.24) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3388/5000 loss 0.0844 (w 0.1494 mse 0.1469 t 960 new 0.29) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3389/5000 loss 0.0472 (w 0.1197 mse 0.1119 t 947 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3390/5000 loss 0.0622 (w 0.0754 mse 0.0703 t 737 new 0.26) lr 1.00e-05 gnorm 0.055 5.67s mem 15.6GB +step 3391/5000 loss 0.0662 (w 0.0659 mse 0.0646 t 942 new 0.27) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 3392/5000 loss 0.1044 (w 0.1067 mse 0.1038 t 802 new 0.23) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 3393/5000 loss 0.1193 (w 0.4369 mse 0.4401 t 84 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3394/5000 loss 0.0353 (w 0.0155 mse 0.0156 t 801 new 0.16) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3395/5000 loss 0.1323 (w 0.2614 mse 0.2483 t 146 new 0.26) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 3396/5000 loss 0.0528 (w 0.0651 mse 0.0679 t 607 new 0.23) lr 1.00e-05 gnorm 0.049 5.74s mem 15.6GB +step 3397/5000 loss 0.0565 (w 0.1684 mse 0.1680 t 979 new 0.29) lr 1.00e-05 gnorm 0.055 5.90s mem 15.6GB +step 3398/5000 loss 0.0528 (w 0.1436 mse 0.1398 t 996 new 0.24) lr 1.00e-05 gnorm 0.057 5.90s mem 15.6GB +step 3399/5000 loss 0.1125 (w 0.1230 mse 0.1181 t 449 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 3400/5000 loss 0.0519 (w 0.0650 mse 0.0679 t 976 new 0.08) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 3401/5000 loss 0.1034 (w 0.0563 mse 0.0575 t 654 new 0.12) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3402/5000 loss 0.0800 (w 0.1731 mse 0.1598 t 974 new 0.24) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3403/5000 loss 0.0364 (w 0.0858 mse 0.0827 t 937 new 0.26) lr 1.00e-05 gnorm 0.046 5.70s mem 15.6GB +step 3404/5000 loss 0.0546 (w 0.1278 mse 0.1245 t 978 new 0.21) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 3405/5000 loss 0.0558 (w 0.1026 mse 0.0983 t 876 new 0.24) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 3406/5000 loss 0.0570 (w 0.0813 mse 0.0739 t 811 new 0.25) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3407/5000 loss 0.0609 (w 0.0801 mse 0.0755 t 765 new 0.26) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 3408/5000 loss 0.0560 (w 0.0865 mse 0.0839 t 843 new 0.25) lr 1.00e-05 gnorm 0.060 5.93s mem 15.6GB +step 3409/5000 loss 0.0442 (w 0.0214 mse 0.0208 t 737 new 0.11) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 3410/5000 loss 0.0983 (w 0.1378 mse 0.1354 t 264 new 0.24) lr 1.00e-05 gnorm 0.099 5.70s mem 15.6GB +step 3411/5000 loss 0.0229 (w 0.0615 mse 0.0581 t 952 new 0.25) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 3412/5000 loss 0.0815 (w 0.0738 mse 0.0734 t 634 new 0.20) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3413/5000 loss 0.0712 (w 0.0547 mse 0.0550 t 800 new 0.12) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 3414/5000 loss 0.1016 (w 0.0706 mse 0.0677 t 921 new 0.25) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +step 3415/5000 loss 0.1181 (w 0.0798 mse 0.0800 t 913 new 0.23) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 3416/5000 loss 0.0815 (w 0.0848 mse 0.0817 t 949 new 0.25) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 3417/5000 loss 0.0740 (w 0.0939 mse 0.0925 t 926 new 0.28) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 3418/5000 loss 0.0849 (w 0.0691 mse 0.0642 t 907 new 0.20) lr 1.00e-05 gnorm 0.063 5.89s mem 15.6GB +step 3419/5000 loss 0.0629 (w 0.0965 mse 0.0950 t 956 new 0.28) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 3420/5000 loss 0.0774 (w 0.0701 mse 0.0687 t 938 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3421/5000 loss 0.1083 (w 0.0501 mse 0.0506 t 802 new 0.17) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +step 3422/5000 loss 0.1145 (w 0.0678 mse 0.0663 t 719 new 0.24) lr 1.00e-05 gnorm 0.078 5.67s mem 15.6GB +step 3423/5000 loss 0.0929 (w 0.4259 mse 0.4300 t 109 new 0.22) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 3424/5000 loss 0.0888 (w 0.0736 mse 0.0683 t 667 new 0.30) lr 1.00e-05 gnorm 0.107 5.68s mem 15.6GB +step 3425/5000 loss 0.0671 (w 0.1236 mse 0.1177 t 914 new 0.15) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3426/5000 loss 0.1175 (w 0.1863 mse 0.1837 t 142 new 0.19) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3427/5000 loss 0.0881 (w 0.0665 mse 0.0643 t 887 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3428/5000 loss 0.1041 (w 0.0927 mse 0.0875 t 798 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 3429/5000 loss 0.0909 (w 0.0385 mse 0.0408 t 759 new 0.15) lr 1.00e-05 gnorm 0.052 5.97s mem 15.6GB +step 3430/5000 loss 0.0576 (w 0.1248 mse 0.1203 t 985 new 0.20) lr 1.00e-05 gnorm 0.055 5.67s mem 15.6GB +step 3431/5000 loss 0.0660 (w 0.0738 mse 0.0710 t 709 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3432/5000 loss 0.0573 (w 0.0798 mse 0.0747 t 687 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3433/5000 loss 0.0752 (w 0.0908 mse 0.0906 t 868 new 0.15) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3434/5000 loss 0.1036 (w 0.1231 mse 0.1197 t 947 new 0.25) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 3435/5000 loss 0.0621 (w 0.0547 mse 0.0515 t 781 new 0.25) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +step 3436/5000 loss 0.0796 (w 0.0695 mse 0.0652 t 721 new 0.22) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 3437/5000 loss 0.0680 (w 0.2013 mse 0.1990 t 985 new 0.27) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3438/5000 loss 0.0950 (w 0.1082 mse 0.1052 t 511 new 0.17) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 3439/5000 loss 0.0521 (w 0.1197 mse 0.1131 t 893 new 0.23) lr 1.00e-05 gnorm 0.057 5.88s mem 15.6GB +step 3440/5000 loss 0.0939 (w 0.0625 mse 0.0706 t 999 new 0.14) lr 1.00e-05 gnorm 0.072 5.74s mem 15.6GB +step 3441/5000 loss 0.1364 (w 0.1389 mse 0.1345 t 309 new 0.30) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3442/5000 loss 0.0896 (w 0.1101 mse 0.1129 t 264 new 0.21) lr 1.00e-05 gnorm 0.075 6.07s mem 15.6GB +step 3443/5000 loss 0.0522 (w 0.0474 mse 0.0478 t 817 new 0.18) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 3444/5000 loss 0.1459 (w 0.0754 mse 0.0712 t 839 new 0.23) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +step 3445/5000 loss 0.1003 (w 0.0632 mse 0.0623 t 646 new 0.25) lr 1.00e-05 gnorm 0.059 5.89s mem 15.6GB +step 3446/5000 loss 0.0929 (w 0.0584 mse 0.0552 t 649 new 0.14) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 3447/5000 loss 0.1076 (w 0.0849 mse 0.0860 t 495 new 0.22) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 3448/5000 loss 0.0674 (w 0.0765 mse 0.0716 t 945 new 0.26) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3449/5000 loss 0.0849 (w 0.0953 mse 0.0935 t 936 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 3450/5000 loss 0.1519 (w 0.1101 mse 0.1019 t 965 new 0.25) lr 1.00e-05 gnorm 0.094 5.97s mem 15.6GB +step 3451/5000 loss 0.0560 (w 0.1150 mse 0.1022 t 902 new 0.24) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 3452/5000 loss 0.0722 (w 0.0701 mse 0.0667 t 813 new 0.15) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 3453/5000 loss 0.0799 (w 0.1025 mse 0.1127 t 280 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 3454/5000 loss 0.0653 (w 0.1047 mse 0.0970 t 807 new 0.24) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 3455/5000 loss 0.0566 (w 0.1284 mse 0.1181 t 952 new 0.25) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 3456/5000 loss 0.0827 (w 0.0594 mse 0.0619 t 859 new 0.25) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 3457/5000 loss 0.1015 (w 0.1553 mse 0.1411 t 996 new 0.23) lr 1.00e-05 gnorm 0.128 5.69s mem 15.6GB +step 3458/5000 loss 0.1198 (w 0.0636 mse 0.0594 t 688 new 0.18) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 3459/5000 loss 0.0753 (w 0.0937 mse 0.0842 t 812 new 0.22) lr 1.00e-05 gnorm 0.062 5.83s mem 15.6GB +step 3460/5000 loss 0.0998 (w 0.1628 mse 0.1507 t 980 new 0.29) lr 1.00e-05 gnorm 0.093 5.71s mem 15.6GB +step 3461/5000 loss 0.1030 (w 0.0751 mse 0.0730 t 864 new 0.16) lr 1.00e-05 gnorm 0.126 5.75s mem 15.6GB +step 3462/5000 loss 0.0815 (w 0.0436 mse 0.0524 t 994 new 0.21) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 3463/5000 loss 0.0300 (w 0.0886 mse 0.0849 t 944 new 0.22) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 3464/5000 loss 0.0833 (w 0.0687 mse 0.0643 t 666 new 0.29) lr 1.00e-05 gnorm 0.132 5.70s mem 15.6GB +step 3465/5000 loss 0.0493 (w 0.0415 mse 0.0485 t 941 new 0.22) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 3466/5000 loss 0.1126 (w 0.1424 mse 0.1444 t 947 new 0.20) lr 1.00e-05 gnorm 0.062 5.89s mem 15.6GB +step 3467/5000 loss 0.1183 (w 0.0630 mse 0.0582 t 904 new 0.22) lr 1.00e-05 gnorm 0.126 5.69s mem 15.6GB +step 3468/5000 loss 0.0792 (w 0.0680 mse 0.0640 t 777 new 0.24) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 3469/5000 loss 0.0818 (w 0.0661 mse 0.0662 t 652 new 0.23) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3470/5000 loss 0.1022 (w 0.0804 mse 0.0844 t 380 new 0.26) lr 1.00e-05 gnorm 0.117 5.70s mem 15.6GB +step 3471/5000 loss 0.0952 (w 0.8866 mse 0.8850 t 5 new 0.25) lr 1.00e-05 gnorm 0.060 5.88s mem 15.6GB +step 3472/5000 loss 0.0541 (w 0.0893 mse 0.0835 t 930 new 0.23) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 3473/5000 loss 0.0768 (w 0.0821 mse 0.0757 t 571 new 0.13) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3474/5000 loss 0.0582 (w 0.0640 mse 0.0645 t 754 new 0.18) lr 1.00e-05 gnorm 0.058 5.71s mem 15.6GB +step 3475/5000 loss 0.0652 (w 0.1100 mse 0.1040 t 949 new 0.11) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3476/5000 loss 0.0443 (w 0.1071 mse 0.0976 t 943 new 0.25) lr 1.00e-05 gnorm 0.157 5.70s mem 15.6GB +step 3477/5000 loss 0.0981 (w 0.1832 mse 0.1631 t 983 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3478/5000 loss 0.0935 (w 0.0867 mse 0.0810 t 434 new 0.15) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3479/5000 loss 0.0900 (w 0.0918 mse 0.0915 t 996 new 0.13) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 3480/5000 loss 0.0832 (w 0.0749 mse 0.0679 t 851 new 0.27) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 3481/5000 loss 0.0769 (w 0.0517 mse 0.0538 t 756 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3482/5000 loss 0.0894 (w 0.1047 mse 0.1032 t 960 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3483/5000 loss 0.0988 (w 0.0797 mse 0.0789 t 604 new 0.18) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 3484/5000 loss 0.0482 (w 0.0713 mse 0.0683 t 869 new 0.23) lr 1.00e-05 gnorm 0.056 5.94s mem 15.6GB +step 3485/5000 loss 0.0685 (w 0.1030 mse 0.0967 t 960 new 0.09) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3486/5000 loss 0.0937 (w 0.0710 mse 0.0649 t 940 new 0.13) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 3487/5000 loss 0.0978 (w 0.0664 mse 0.0631 t 902 new 0.11) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 3488/5000 loss 0.0833 (w 0.1042 mse 0.0978 t 900 new 0.18) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 3489/5000 loss 0.0464 (w 0.0692 mse 0.0636 t 837 new 0.22) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 3490/5000 loss 0.1053 (w 0.1815 mse 0.1750 t 981 new 0.26) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 3491/5000 loss 0.0618 (w 0.1507 mse 0.1373 t 960 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3492/5000 loss 0.1173 (w 0.0475 mse 0.0413 t 694 new 0.26) lr 1.00e-05 gnorm 0.081 5.76s mem 15.6GB +step 3493/5000 loss 0.0676 (w 0.1212 mse 0.1297 t 994 new 0.30) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3494/5000 loss 0.1335 (w 0.0620 mse 0.0562 t 641 new 0.22) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 3495/5000 loss 0.0878 (w 0.8181 mse 0.8255 t 15 new 0.28) lr 1.00e-05 gnorm 0.085 5.73s mem 15.6GB +step 3496/5000 loss 0.0911 (w 0.0266 mse 0.0293 t 716 new 0.22) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3497/5000 loss 0.0708 (w 0.1027 mse 0.1129 t 977 new 0.21) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 3498/5000 loss 0.1359 (w 0.1327 mse 0.1222 t 935 new 0.22) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 3499/5000 loss 0.0847 (w 0.0174 mse 0.0205 t 484 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3500/5000 loss 0.1172 (w 0.0476 mse 0.0478 t 854 new 0.10) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[val] step 3500 t=201: w=0.1744 mse=0.1768 (n=16) t=501: w=0.0724 mse=0.0723 (n=16) t=800: w=0.0607 mse=0.0595 (n=16) | mean w=0.1025 mse=0.1029 4s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step3500.safetensors 832 个张量 2.87 GB +step 3501/5000 loss 0.0793 (w 0.0655 mse 0.0655 t 890 new 0.09) lr 1.00e-05 gnorm 0.058 5.73s mem 15.6GB +step 3502/5000 loss 0.0932 (w 0.1029 mse 0.0990 t 744 new 0.25) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 3503/5000 loss 0.0837 (w 0.2477 mse 0.2505 t 989 new 0.20) lr 1.00e-05 gnorm 0.051 5.72s mem 15.6GB +step 3504/5000 loss 0.0682 (w 0.1000 mse 0.1009 t 992 new 0.11) lr 1.00e-05 gnorm 0.058 5.74s mem 15.6GB +step 3505/5000 loss 0.0958 (w 0.1228 mse 0.1263 t 403 new 0.29) lr 1.00e-05 gnorm 0.060 5.71s mem 15.6GB +step 3506/5000 loss 0.0983 (w 0.1462 mse 0.1426 t 987 new 0.29) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3507/5000 loss 0.0696 (w 0.1458 mse 0.1426 t 994 new 0.31) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 3508/5000 loss 0.0778 (w 0.0285 mse 0.0275 t 753 new 0.22) lr 1.00e-05 gnorm 0.068 5.89s mem 15.6GB +step 3509/5000 loss 0.0877 (w 0.1585 mse 0.1371 t 998 new 0.16) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +step 3510/5000 loss 0.0521 (w 0.1346 mse 0.1205 t 957 new 0.23) lr 1.00e-05 gnorm 0.051 5.71s mem 15.6GB +step 3511/5000 loss 0.0705 (w 0.0998 mse 0.0887 t 928 new 0.22) lr 1.00e-05 gnorm 0.083 5.94s mem 15.6GB +step 3512/5000 loss 0.0736 (w 0.0688 mse 0.0710 t 873 new 0.21) lr 1.00e-05 gnorm 0.070 5.71s mem 15.6GB +step 3513/5000 loss 0.1199 (w 0.4483 mse 0.4467 t 109 new 0.23) lr 1.00e-05 gnorm 0.062 5.90s mem 15.6GB +step 3514/5000 loss 0.0712 (w 0.2038 mse 0.1911 t 994 new 0.16) lr 1.00e-05 gnorm 0.068 5.90s mem 15.6GB +step 3515/5000 loss 0.0938 (w 0.1091 mse 0.1076 t 788 new 0.25) lr 1.00e-05 gnorm 0.065 5.82s mem 15.6GB +step 3516/5000 loss 0.0833 (w 0.1164 mse 0.1143 t 459 new 0.20) lr 1.00e-05 gnorm 0.056 5.83s mem 15.6GB +step 3517/5000 loss 0.1181 (w 0.0339 mse 0.0353 t 785 new 0.15) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 3518/5000 loss 0.0811 (w 0.2378 mse 0.2427 t 993 new 0.21) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 3519/5000 loss 0.1239 (w 0.0551 mse 0.0528 t 757 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3520/5000 loss 0.0517 (w 0.0914 mse 0.0955 t 993 new 0.15) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 3521/5000 loss 0.1168 (w 0.1835 mse 0.2042 t 130 new 0.17) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3522/5000 loss 0.0686 (w 0.0209 mse 0.0236 t 701 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3523/5000 loss 0.0411 (w 0.1251 mse 0.1203 t 993 new 0.23) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 3524/5000 loss 0.1010 (w 0.0645 mse 0.0623 t 796 new 0.26) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 3525/5000 loss 0.0685 (w 0.0202 mse 0.0221 t 692 new 0.15) lr 1.00e-05 gnorm 0.056 5.72s mem 15.6GB +step 3526/5000 loss 0.0661 (w 0.1200 mse 0.1138 t 978 new 0.21) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 3527/5000 loss 0.1043 (w 0.0638 mse 0.0646 t 735 new 0.27) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 3528/5000 loss 0.0916 (w 0.0687 mse 0.0649 t 914 new 0.15) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 3529/5000 loss 0.1035 (w 0.0467 mse 0.0474 t 626 new 0.29) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3530/5000 loss 0.0843 (w 0.1620 mse 0.1703 t 992 new 0.23) lr 1.00e-05 gnorm 0.068 5.94s mem 15.6GB +step 3531/5000 loss 0.0892 (w 0.0895 mse 0.0870 t 417 new 0.19) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3532/5000 loss 0.0580 (w 0.0864 mse 0.0826 t 935 new 0.20) lr 1.00e-05 gnorm 0.058 5.92s mem 15.6GB +step 3533/5000 loss 0.1006 (w 0.1167 mse 0.1118 t 886 new 0.18) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3534/5000 loss 0.1015 (w 0.0521 mse 0.0582 t 314 new 0.15) lr 1.00e-05 gnorm 0.050 5.89s mem 15.6GB +step 3535/5000 loss 0.0485 (w 0.0719 mse 0.0741 t 748 new 0.14) lr 1.00e-05 gnorm 0.044 5.69s mem 15.6GB +step 3536/5000 loss 0.0684 (w 0.2757 mse 0.2350 t 991 new 0.25) lr 1.00e-05 gnorm 0.072 5.80s mem 15.6GB +step 3537/5000 loss 0.0741 (w 0.0219 mse 0.0202 t 606 new 0.19) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 3538/5000 loss 0.0575 (w 0.1039 mse 0.1051 t 969 new 0.22) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 3539/5000 loss 0.0754 (w 0.2775 mse 0.2943 t 998 new 0.16) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3540/5000 loss 0.0402 (w 0.0531 mse 0.0554 t 829 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3541/5000 loss 0.0998 (w 0.0825 mse 0.0802 t 929 new 0.22) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +step 3542/5000 loss 0.0944 (w 0.0597 mse 0.0547 t 727 new 0.29) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +step 3543/5000 loss 0.0730 (w 0.2256 mse 0.2106 t 997 new 0.31) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 3544/5000 loss 0.1072 (w 0.1080 mse 0.1004 t 532 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3545/5000 loss 0.0721 (w 0.0721 mse 0.0682 t 807 new 0.28) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 3546/5000 loss 0.0722 (w 0.0715 mse 0.0727 t 924 new 0.24) lr 1.00e-05 gnorm 0.066 5.96s mem 15.6GB +step 3547/5000 loss 0.0717 (w 0.0685 mse 0.0667 t 881 new 0.23) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 3548/5000 loss 0.0820 (w 0.1531 mse 0.1429 t 968 new 0.22) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 3549/5000 loss 0.0582 (w 0.0408 mse 0.0402 t 856 new 0.20) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 3550/5000 loss 0.0928 (w 0.0855 mse 0.0837 t 891 new 0.10) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 3551/5000 loss 0.0914 (w 0.0641 mse 0.0637 t 731 new 0.24) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 3552/5000 loss 0.1110 (w 0.1664 mse 0.1578 t 980 new 0.19) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 3553/5000 loss 0.0825 (w 0.0366 mse 0.0370 t 766 new 0.07) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3554/5000 loss 0.0841 (w 0.1301 mse 0.1204 t 994 new 0.26) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3555/5000 loss 0.0985 (w 0.1294 mse 0.1276 t 968 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3556/5000 loss 0.0456 (w 0.0552 mse 0.0524 t 874 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3557/5000 loss 0.1024 (w 0.0561 mse 0.0557 t 853 new 0.22) lr 1.00e-05 gnorm 0.099 5.81s mem 15.6GB +step 3558/5000 loss 0.0444 (w 0.1088 mse 0.1085 t 991 new 0.21) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 3559/5000 loss 0.1175 (w 0.0954 mse 0.0942 t 436 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3560/5000 loss 0.0883 (w 0.0121 mse 0.0142 t 786 new 0.18) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3561/5000 loss 0.0924 (w 0.1402 mse 0.1374 t 805 new 0.19) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3562/5000 loss 0.0723 (w 0.1305 mse 0.1251 t 963 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3563/5000 loss 0.0629 (w 0.0854 mse 0.0877 t 927 new 0.15) lr 1.00e-05 gnorm 0.059 5.67s mem 15.6GB +step 3564/5000 loss 0.0987 (w 0.0542 mse 0.0537 t 589 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 3565/5000 loss 0.0490 (w 0.1455 mse 0.1454 t 972 new 0.24) lr 1.00e-05 gnorm 0.043 5.68s mem 15.6GB +step 3566/5000 loss 0.0586 (w 0.0976 mse 0.0930 t 890 new 0.19) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 3567/5000 loss 0.1094 (w 0.1313 mse 0.1320 t 300 new 0.21) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 3568/5000 loss 0.0800 (w 0.0968 mse 0.0931 t 737 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3569/5000 loss 0.0957 (w 0.1139 mse 0.1066 t 898 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3570/5000 loss 0.0953 (w 0.1004 mse 0.0962 t 661 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3571/5000 loss 0.0479 (w 0.0598 mse 0.0578 t 863 new 0.23) lr 1.00e-05 gnorm 0.050 5.68s mem 15.6GB +step 3572/5000 loss 0.0652 (w 0.1078 mse 0.1035 t 954 new 0.22) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3573/5000 loss 0.0837 (w 0.0712 mse 0.0635 t 882 new 0.20) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 3574/5000 loss 0.0688 (w 0.1432 mse 0.1305 t 998 new 0.15) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3575/5000 loss 0.0932 (w 0.0585 mse 0.0604 t 616 new 0.24) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 3576/5000 loss 0.0705 (w 0.1373 mse 0.1338 t 964 new 0.19) lr 1.00e-05 gnorm 0.065 5.88s mem 15.6GB +step 3577/5000 loss 0.0967 (w 0.0569 mse 0.0527 t 770 new 0.21) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 3578/5000 loss 0.0757 (w 0.0644 mse 0.0557 t 870 new 0.22) lr 1.00e-05 gnorm 0.057 5.82s mem 15.6GB +step 3579/5000 loss 0.1088 (w 0.0563 mse 0.0570 t 733 new 0.26) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 3580/5000 loss 0.1072 (w 0.0784 mse 0.0802 t 566 new 0.27) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 3581/5000 loss 0.0628 (w 0.1684 mse 0.1458 t 987 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3582/5000 loss 0.1082 (w 0.0650 mse 0.0685 t 488 new 0.18) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 3583/5000 loss 0.0593 (w 0.0488 mse 0.0467 t 651 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3584/5000 loss 0.0716 (w 0.0851 mse 0.0805 t 480 new 0.22) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 3585/5000 loss 0.0777 (w 0.0935 mse 0.0925 t 541 new 0.29) lr 1.00e-05 gnorm 0.054 5.73s mem 15.6GB +step 3586/5000 loss 0.0643 (w 0.0529 mse 0.0515 t 572 new 0.21) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +step 3587/5000 loss 0.1097 (w 0.0827 mse 0.0725 t 845 new 0.23) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 3588/5000 loss 0.0781 (w 0.1792 mse 0.1749 t 208 new 0.12) lr 1.00e-05 gnorm 0.060 5.72s mem 15.6GB +step 3589/5000 loss 0.0711 (w 0.0582 mse 0.0554 t 873 new 0.26) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 3590/5000 loss 0.0806 (w 0.1118 mse 0.1075 t 914 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3591/5000 loss 0.0645 (w 0.0436 mse 0.0444 t 814 new 0.22) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 3592/5000 loss 0.0834 (w 0.1095 mse 0.1011 t 917 new 0.24) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 3593/5000 loss 0.0853 (w 0.1263 mse 0.1454 t 150 new 0.24) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 3594/5000 loss 0.0742 (w 0.7543 mse 0.7826 t 25 new 0.24) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 3595/5000 loss 0.0819 (w 0.0405 mse 0.0421 t 638 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3596/5000 loss 0.0646 (w 0.0371 mse 0.0355 t 945 new 0.10) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 3597/5000 loss 0.1058 (w 0.0965 mse 0.1019 t 958 new 0.19) lr 1.00e-05 gnorm 0.065 5.91s mem 15.6GB +step 3598/5000 loss 0.0728 (w 0.0237 mse 0.0258 t 600 new 0.12) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +step 3599/5000 loss 0.0595 (w 0.1120 mse 0.1058 t 953 new 0.21) lr 1.00e-05 gnorm 0.077 5.93s mem 15.6GB +step 3600/5000 loss 0.0848 (w 0.1200 mse 0.1201 t 134 new 0.10) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3601/5000 loss 0.0850 (w 0.0575 mse 0.0606 t 515 new 0.16) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3602/5000 loss 0.1125 (w 0.0838 mse 0.0816 t 463 new 0.21) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 3603/5000 loss 0.0880 (w 0.0603 mse 0.0606 t 896 new 0.10) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3604/5000 loss 0.1073 (w 0.1822 mse 0.1869 t 169 new 0.26) lr 1.00e-05 gnorm 0.061 5.91s mem 15.6GB +step 3605/5000 loss 0.0934 (w 0.0746 mse 0.0717 t 852 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3606/5000 loss 0.0638 (w 0.0856 mse 0.0791 t 791 new 0.27) lr 1.00e-05 gnorm 0.064 5.73s mem 15.6GB +step 3607/5000 loss 0.1270 (w 0.0759 mse 0.0768 t 954 new 0.18) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +step 3608/5000 loss 0.1323 (w 0.0336 mse 0.0367 t 596 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3609/5000 loss 0.0802 (w 0.6397 mse 0.6550 t 34 new 0.16) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 3610/5000 loss 0.0875 (w 0.0618 mse 0.0596 t 726 new 0.23) lr 1.00e-05 gnorm 0.063 5.81s mem 15.6GB +step 3611/5000 loss 0.0589 (w 0.1251 mse 0.1159 t 960 new 0.24) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 3612/5000 loss 0.0501 (w 0.1396 mse 0.1322 t 924 new 0.27) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3613/5000 loss 0.0646 (w 0.0706 mse 0.0669 t 602 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3614/5000 loss 0.0398 (w 0.0628 mse 0.0562 t 862 new 0.17) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 3615/5000 loss 0.0667 (w 0.0828 mse 0.0811 t 669 new 0.21) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 3616/5000 loss 0.0681 (w 0.1179 mse 0.1145 t 537 new 0.22) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 3617/5000 loss 0.0680 (w 0.0661 mse 0.0655 t 756 new 0.21) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3618/5000 loss 0.0959 (w 0.0967 mse 0.0964 t 912 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3619/5000 loss 0.0865 (w 0.0849 mse 0.0767 t 657 new 0.25) lr 1.00e-05 gnorm 0.048 5.68s mem 15.6GB +step 3620/5000 loss 0.0849 (w 0.0917 mse 0.0915 t 592 new 0.17) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3621/5000 loss 0.0958 (w 0.0641 mse 0.0607 t 710 new 0.25) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3622/5000 loss 0.0948 (w 0.1030 mse 0.1033 t 323 new 0.10) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3623/5000 loss 0.1026 (w 0.0665 mse 0.0706 t 497 new 0.13) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 3624/5000 loss 0.1059 (w 0.1168 mse 0.1050 t 950 new 0.26) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3625/5000 loss 0.1190 (w 0.0646 mse 0.0641 t 641 new 0.29) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +step 3626/5000 loss 0.1475 (w 0.5510 mse 0.5810 t 43 new 0.25) lr 1.00e-05 gnorm 0.054 5.93s mem 15.6GB +step 3627/5000 loss 0.0825 (w 0.2140 mse 0.1834 t 994 new 0.27) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 3628/5000 loss 0.0811 (w 0.0352 mse 0.0384 t 908 new 0.14) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 3629/5000 loss 0.0868 (w 0.1005 mse 0.0966 t 786 new 0.19) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 3630/5000 loss 0.0776 (w 0.1115 mse 0.1096 t 949 new 0.21) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3631/5000 loss 0.1375 (w 0.1118 mse 0.1081 t 678 new 0.25) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 3632/5000 loss 0.0740 (w 0.0681 mse 0.0667 t 931 new 0.29) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3633/5000 loss 0.0764 (w 0.0519 mse 0.0573 t 288 new 0.28) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 3634/5000 loss 0.0990 (w 0.0951 mse 0.0981 t 824 new 0.26) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3635/5000 loss 0.0508 (w 0.0506 mse 0.0493 t 816 new 0.14) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3636/5000 loss 0.1185 (w 0.1409 mse 0.1342 t 958 new 0.24) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3637/5000 loss 0.0385 (w 0.1191 mse 0.1163 t 953 new 0.21) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3638/5000 loss 0.1173 (w 0.0575 mse 0.0554 t 895 new 0.15) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 3639/5000 loss 0.0599 (w 0.0610 mse 0.0560 t 718 new 0.22) lr 1.00e-05 gnorm 0.061 5.89s mem 15.6GB +step 3640/5000 loss 0.0733 (w 0.1246 mse 0.1184 t 913 new 0.20) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3641/5000 loss 0.0931 (w 0.0960 mse 0.0906 t 744 new 0.29) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 3642/5000 loss 0.0837 (w 0.0738 mse 0.0652 t 937 new 0.22) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 3643/5000 loss 0.1108 (w 0.0845 mse 0.0751 t 925 new 0.12) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 3644/5000 loss 0.0542 (w 0.0709 mse 0.0758 t 928 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3645/5000 loss 0.0508 (w 0.0712 mse 0.0679 t 482 new 0.21) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +step 3646/5000 loss 0.0819 (w 0.0587 mse 0.0563 t 571 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3647/5000 loss 0.0531 (w 0.0344 mse 0.0373 t 659 new 0.17) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3648/5000 loss 0.1044 (w 0.0879 mse 0.0845 t 866 new 0.21) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3649/5000 loss 0.0687 (w 0.0594 mse 0.0572 t 878 new 0.29) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3650/5000 loss 0.0722 (w 0.0900 mse 0.0857 t 892 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3651/5000 loss 0.1110 (w 0.0756 mse 0.0712 t 786 new 0.21) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +step 3652/5000 loss 0.0812 (w 0.1014 mse 0.0987 t 718 new 0.24) lr 1.00e-05 gnorm 0.058 5.85s mem 15.6GB +step 3653/5000 loss 0.0288 (w 0.1904 mse 0.1824 t 995 new 0.20) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3654/5000 loss 0.0733 (w 0.0463 mse 0.0506 t 958 new 0.24) lr 1.00e-05 gnorm 0.072 5.81s mem 15.6GB +step 3655/5000 loss 0.0515 (w 0.0868 mse 0.0813 t 936 new 0.22) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 3656/5000 loss 0.0772 (w 0.1009 mse 0.1003 t 336 new 0.25) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 3657/5000 loss 0.1339 (w 0.1147 mse 0.1102 t 861 new 0.27) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 3658/5000 loss 0.0614 (w 0.0769 mse 0.0745 t 943 new 0.15) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 3659/5000 loss 0.0733 (w 0.0981 mse 0.1017 t 954 new 0.18) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 3660/5000 loss 0.1098 (w 0.1011 mse 0.0980 t 865 new 0.28) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 3661/5000 loss 0.0805 (w 0.0793 mse 0.0755 t 903 new 0.28) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 3662/5000 loss 0.0729 (w 0.0664 mse 0.0617 t 745 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3663/5000 loss 0.1275 (w 0.0809 mse 0.0777 t 577 new 0.22) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 3664/5000 loss 0.0989 (w 0.1812 mse 0.1814 t 201 new 0.17) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 3665/5000 loss 0.0873 (w 0.1588 mse 0.1544 t 222 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3666/5000 loss 0.0405 (w 0.0521 mse 0.0519 t 760 new 0.10) lr 1.00e-05 gnorm 0.049 5.71s mem 15.6GB +step 3667/5000 loss 0.1011 (w 0.0838 mse 0.0849 t 762 new 0.19) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 3668/5000 loss 0.0882 (w 0.0131 mse 0.0133 t 907 new 0.02) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 3669/5000 loss 0.1223 (w 0.0772 mse 0.0737 t 554 new 0.21) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 3670/5000 loss 0.0783 (w 0.0657 mse 0.0667 t 421 new 0.24) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 3671/5000 loss 0.0611 (w 0.1583 mse 0.1546 t 977 new 0.28) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3672/5000 loss 0.0681 (w 0.1121 mse 0.1127 t 980 new 0.25) lr 1.00e-05 gnorm 0.062 5.71s mem 15.6GB +step 3673/5000 loss 0.0791 (w 0.0673 mse 0.0697 t 819 new 0.25) lr 1.00e-05 gnorm 0.057 5.71s mem 15.6GB +step 3674/5000 loss 0.0740 (w 0.0873 mse 0.0868 t 843 new 0.21) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 3675/5000 loss 0.0700 (w 0.0302 mse 0.0291 t 843 new 0.22) lr 1.00e-05 gnorm 0.058 5.82s mem 15.6GB +step 3676/5000 loss 0.0781 (w 0.0575 mse 0.0607 t 894 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3677/5000 loss 0.1220 (w 0.0824 mse 0.0841 t 660 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3678/5000 loss 0.1230 (w 0.0515 mse 0.0502 t 922 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3679/5000 loss 0.1117 (w 0.0505 mse 0.0467 t 532 new 0.26) lr 1.00e-05 gnorm 0.053 6.09s mem 15.6GB +step 3680/5000 loss 0.0648 (w 0.0985 mse 0.0940 t 961 new 0.26) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +step 3681/5000 loss 0.0704 (w 0.0457 mse 0.0477 t 788 new 0.18) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 3682/5000 loss 0.0599 (w 0.0952 mse 0.0825 t 912 new 0.26) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3683/5000 loss 0.0641 (w 0.0651 mse 0.0624 t 935 new 0.26) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3684/5000 loss 0.0929 (w 0.0671 mse 0.0634 t 886 new 0.27) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3685/5000 loss 0.0552 (w 0.3174 mse 0.2867 t 998 new 0.29) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3686/5000 loss 0.0803 (w 0.0726 mse 0.0771 t 964 new 0.28) lr 1.00e-05 gnorm 0.048 5.68s mem 15.6GB +step 3687/5000 loss 0.1011 (w 0.0716 mse 0.0698 t 669 new 0.27) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 3688/5000 loss 0.1075 (w 0.0765 mse 0.0697 t 751 new 0.30) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3689/5000 loss 0.1570 (w 0.1137 mse 0.1095 t 689 new 0.27) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 3690/5000 loss 0.0834 (w 0.0764 mse 0.0720 t 603 new 0.25) lr 1.00e-05 gnorm 0.056 5.80s mem 15.6GB +step 3691/5000 loss 0.0782 (w 0.1044 mse 0.0994 t 457 new 0.24) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 3692/5000 loss 0.0827 (w 0.0471 mse 0.0501 t 588 new 0.24) lr 1.00e-05 gnorm 0.050 5.68s mem 15.6GB +step 3693/5000 loss 0.0588 (w 0.0485 mse 0.0456 t 581 new 0.07) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 3694/5000 loss 0.0578 (w 0.1151 mse 0.1191 t 872 new 0.20) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3695/5000 loss 0.1058 (w 0.0646 mse 0.0592 t 883 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3696/5000 loss 0.0598 (w 0.1057 mse 0.0979 t 971 new 0.23) lr 1.00e-05 gnorm 0.051 6.02s mem 15.6GB +step 3697/5000 loss 0.1198 (w 0.0524 mse 0.0526 t 722 new 0.27) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 3698/5000 loss 0.0927 (w 0.0444 mse 0.0415 t 678 new 0.29) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 3699/5000 loss 0.1047 (w 0.2008 mse 0.1909 t 985 new 0.18) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 3700/5000 loss 0.0708 (w 0.0742 mse 0.0731 t 532 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3701/5000 loss 0.1269 (w 0.0584 mse 0.0572 t 857 new 0.07) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 3702/5000 loss 0.0897 (w 0.0944 mse 0.0853 t 674 new 0.24) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 3703/5000 loss 0.1134 (w 0.0603 mse 0.0589 t 788 new 0.25) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3704/5000 loss 0.0709 (w 0.7228 mse 0.7360 t 20 new 0.11) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3705/5000 loss 0.0512 (w 0.0848 mse 0.0853 t 937 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3706/5000 loss 0.0990 (w 0.1046 mse 0.1002 t 961 new 0.14) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3707/5000 loss 0.0908 (w 0.0935 mse 0.0963 t 403 new 0.18) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 3708/5000 loss 0.0510 (w 0.0521 mse 0.0533 t 506 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3709/5000 loss 0.1118 (w 0.6707 mse 0.6674 t 48 new 0.18) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3710/5000 loss 0.0900 (w 0.1010 mse 0.0950 t 935 new 0.19) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 3711/5000 loss 0.0667 (w 0.0779 mse 0.0704 t 798 new 0.26) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 3712/5000 loss 0.0685 (w 0.0855 mse 0.0828 t 852 new 0.18) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 3713/5000 loss 0.0734 (w 0.1520 mse 0.1415 t 984 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 3714/5000 loss 0.0997 (w 0.0763 mse 0.0759 t 911 new 0.26) lr 1.00e-05 gnorm 0.069 5.89s mem 15.6GB +step 3715/5000 loss 0.0991 (w 0.5810 mse 0.5966 t 34 new 0.20) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 3716/5000 loss 0.1484 (w 0.1265 mse 0.1205 t 940 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3717/5000 loss 0.0782 (w 0.1172 mse 0.1125 t 967 new 0.21) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 3718/5000 loss 0.0825 (w 0.1203 mse 0.1142 t 962 new 0.24) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 3719/5000 loss 0.0635 (w 0.0859 mse 0.0767 t 932 new 0.23) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 3720/5000 loss 0.0588 (w 0.0936 mse 0.0929 t 592 new 0.23) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 3721/5000 loss 0.0953 (w 0.0882 mse 0.0889 t 933 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3722/5000 loss 0.0957 (w 0.0767 mse 0.0758 t 938 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3723/5000 loss 0.1105 (w 0.2755 mse 0.2863 t 118 new 0.15) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 3724/5000 loss 0.0996 (w 0.2005 mse 0.1953 t 986 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3725/5000 loss 0.0720 (w 0.0460 mse 0.0473 t 874 new 0.19) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3726/5000 loss 0.0432 (w 0.0710 mse 0.0691 t 866 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3727/5000 loss 0.0614 (w 0.1380 mse 0.1363 t 967 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3728/5000 loss 0.0788 (w 0.0681 mse 0.0642 t 892 new 0.22) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 3729/5000 loss 0.0800 (w 0.1069 mse 0.1106 t 219 new 0.30) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 3730/5000 loss 0.0605 (w 0.0471 mse 0.0504 t 805 new 0.21) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3731/5000 loss 0.1057 (w 0.0522 mse 0.0514 t 471 new 0.26) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 3732/5000 loss 0.0973 (w 0.0783 mse 0.0781 t 560 new 0.09) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3733/5000 loss 0.0914 (w 0.0492 mse 0.0529 t 796 new 0.24) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +step 3734/5000 loss 0.0706 (w 0.0567 mse 0.0541 t 733 new 0.23) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 3735/5000 loss 0.1153 (w 0.1107 mse 0.1040 t 471 new 0.26) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 3736/5000 loss 0.0392 (w 0.0445 mse 0.0435 t 923 new 0.05) lr 1.00e-05 gnorm 0.058 5.94s mem 15.6GB +step 3737/5000 loss 0.0917 (w 0.0506 mse 0.0515 t 735 new 0.15) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 3738/5000 loss 0.0808 (w 0.0843 mse 0.0827 t 603 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3739/5000 loss 0.1060 (w 0.1035 mse 0.1015 t 914 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3740/5000 loss 0.0941 (w 0.0492 mse 0.0516 t 961 new 0.22) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3741/5000 loss 0.0965 (w 0.0796 mse 0.0693 t 905 new 0.26) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 3742/5000 loss 0.0726 (w 0.0508 mse 0.0526 t 840 new 0.23) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 3743/5000 loss 0.0791 (w 0.1747 mse 0.1756 t 201 new 0.14) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3744/5000 loss 0.1005 (w 0.0516 mse 0.0481 t 793 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3745/5000 loss 0.1590 (w 0.1135 mse 0.1152 t 906 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3746/5000 loss 0.0883 (w 0.0850 mse 0.0887 t 516 new 0.18) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3747/5000 loss 0.1777 (w 0.1047 mse 0.0993 t 568 new 0.20) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3748/5000 loss 0.0916 (w 0.0913 mse 0.0907 t 827 new 0.22) lr 1.00e-05 gnorm 0.066 5.79s mem 15.6GB +step 3749/5000 loss 0.1009 (w 0.0674 mse 0.0627 t 698 new 0.13) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3750/5000 loss 0.0932 (w 0.1222 mse 0.1137 t 784 new 0.27) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3751/5000 loss 0.0935 (w 0.0635 mse 0.0661 t 904 new 0.25) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 3752/5000 loss 0.1048 (w 0.0661 mse 0.0614 t 556 new 0.27) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 3753/5000 loss 0.0547 (w 0.0974 mse 0.0885 t 921 new 0.27) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3754/5000 loss 0.1086 (w 0.0544 mse 0.0570 t 579 new 0.24) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +step 3755/5000 loss 0.0786 (w 0.2179 mse 0.2090 t 130 new 0.21) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3756/5000 loss 0.1017 (w 0.3729 mse 0.3917 t 57 new 0.29) lr 1.00e-05 gnorm 0.055 5.89s mem 15.6GB +step 3757/5000 loss 0.0777 (w 0.0984 mse 0.0939 t 541 new 0.25) lr 1.00e-05 gnorm 0.059 5.93s mem 15.6GB +step 3758/5000 loss 0.1064 (w 0.3178 mse 0.3196 t 150 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3759/5000 loss 0.0922 (w 0.0882 mse 0.0868 t 952 new 0.14) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 3760/5000 loss 0.0779 (w 0.1985 mse 0.2168 t 161 new 0.23) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 3761/5000 loss 0.1086 (w 0.1344 mse 0.1202 t 948 new 0.24) lr 1.00e-05 gnorm 0.070 5.67s mem 15.6GB +step 3762/5000 loss 0.0627 (w 0.0851 mse 0.0828 t 839 new 0.24) lr 1.00e-05 gnorm 0.045 5.68s mem 15.6GB +step 3763/5000 loss 0.0960 (w 0.0688 mse 0.0637 t 851 new 0.20) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 3764/5000 loss 0.0747 (w 0.0800 mse 0.0736 t 905 new 0.25) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3765/5000 loss 0.0924 (w 0.0157 mse 0.0184 t 739 new 0.17) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3766/5000 loss 0.0682 (w 0.0776 mse 0.0759 t 889 new 0.23) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 3767/5000 loss 0.1084 (w 0.0761 mse 0.0701 t 680 new 0.18) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 3768/5000 loss 0.0787 (w 0.0601 mse 0.0572 t 812 new 0.25) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3769/5000 loss 0.0953 (w 0.1351 mse 0.1256 t 970 new 0.26) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 3770/5000 loss 0.1140 (w 0.1269 mse 0.1256 t 930 new 0.18) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3771/5000 loss 0.0783 (w 0.1261 mse 0.1225 t 980 new 0.20) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3772/5000 loss 0.1214 (w 0.1076 mse 0.0992 t 859 new 0.18) lr 1.00e-05 gnorm 0.073 5.92s mem 15.6GB +step 3773/5000 loss 0.0889 (w 0.0920 mse 0.0889 t 895 new 0.19) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 3774/5000 loss 0.1019 (w 0.1392 mse 0.1322 t 948 new 0.23) lr 1.00e-05 gnorm 0.080 5.71s mem 15.6GB +step 3775/5000 loss 0.1565 (w 0.1586 mse 0.1491 t 978 new 0.25) lr 1.00e-05 gnorm 0.070 6.09s mem 15.6GB +step 3776/5000 loss 0.1002 (w 0.0796 mse 0.0788 t 538 new 0.24) lr 1.00e-05 gnorm 0.067 5.90s mem 15.6GB +step 3777/5000 loss 0.1304 (w 0.2041 mse 0.2108 t 229 new 0.23) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 3778/5000 loss 0.0637 (w 0.0690 mse 0.0682 t 873 new 0.17) lr 1.00e-05 gnorm 0.062 6.08s mem 15.6GB +step 3779/5000 loss 0.0972 (w 0.0792 mse 0.0762 t 810 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3780/5000 loss 0.0577 (w 0.0517 mse 0.0548 t 802 new 0.19) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 3781/5000 loss 0.1103 (w 0.1197 mse 0.1186 t 334 new 0.11) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 3782/5000 loss 0.0906 (w 0.0851 mse 0.0838 t 541 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 3783/5000 loss 0.0921 (w 0.0676 mse 0.0634 t 861 new 0.28) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 3784/5000 loss 0.1004 (w 0.0919 mse 0.0989 t 183 new 0.16) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3785/5000 loss 0.0867 (w 0.1995 mse 0.1967 t 971 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 3786/5000 loss 0.1199 (w 0.0790 mse 0.0761 t 748 new 0.11) lr 1.00e-05 gnorm 0.079 5.79s mem 15.6GB +step 3787/5000 loss 0.0390 (w 0.1253 mse 0.1199 t 903 new 0.18) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3788/5000 loss 0.0751 (w 0.1204 mse 0.1171 t 928 new 0.21) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 3789/5000 loss 0.1420 (w 0.0844 mse 0.0767 t 942 new 0.21) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 3790/5000 loss 0.0982 (w 0.0788 mse 0.0833 t 339 new 0.17) lr 1.00e-05 gnorm 0.058 5.90s mem 15.6GB +step 3791/5000 loss 0.0957 (w 0.1154 mse 0.1074 t 883 new 0.28) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3792/5000 loss 0.1081 (w 0.1137 mse 0.1095 t 990 new 0.19) lr 1.00e-05 gnorm 0.055 5.74s mem 15.6GB +step 3793/5000 loss 0.0905 (w 0.0469 mse 0.0505 t 950 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3794/5000 loss 0.1134 (w 0.1200 mse 0.1162 t 655 new 0.30) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 3795/5000 loss 0.0804 (w 0.0844 mse 0.0759 t 885 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 3796/5000 loss 0.0615 (w 0.0416 mse 0.0414 t 935 new 0.26) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 3797/5000 loss 0.0499 (w 0.0583 mse 0.0561 t 830 new 0.25) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 3798/5000 loss 0.0747 (w 0.1552 mse 0.1552 t 384 new 0.26) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3799/5000 loss 0.0635 (w 0.0675 mse 0.0655 t 771 new 0.27) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3800/5000 loss 0.0317 (w 0.3584 mse 0.3035 t 996 new 0.28) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 3801/5000 loss 0.0653 (w 0.0422 mse 0.0425 t 896 new 0.14) lr 1.00e-05 gnorm 0.065 5.72s mem 15.6GB +step 3802/5000 loss 0.0773 (w 0.0423 mse 0.0374 t 884 new 0.22) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +step 3803/5000 loss 0.1000 (w 0.0608 mse 0.0630 t 610 new 0.25) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 3804/5000 loss 0.0652 (w 0.1173 mse 0.1055 t 930 new 0.29) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3805/5000 loss 0.0654 (w 0.0511 mse 0.0507 t 753 new 0.16) lr 1.00e-05 gnorm 0.046 5.69s mem 15.6GB +step 3806/5000 loss 0.0716 (w 0.0550 mse 0.0568 t 819 new 0.09) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 3807/5000 loss 0.0907 (w 0.0792 mse 0.0774 t 759 new 0.21) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 3808/5000 loss 0.1054 (w 0.0775 mse 0.0779 t 952 new 0.21) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3809/5000 loss 0.1194 (w 0.1199 mse 0.1123 t 940 new 0.23) lr 1.00e-05 gnorm 0.074 5.81s mem 15.6GB +step 3810/5000 loss 0.0841 (w 0.0451 mse 0.0441 t 877 new 0.16) lr 1.00e-05 gnorm 0.062 5.72s mem 15.6GB +step 3811/5000 loss 0.0989 (w 0.0727 mse 0.0660 t 546 new 0.23) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 3812/5000 loss 0.1077 (w 0.1081 mse 0.1108 t 229 new 0.13) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 3813/5000 loss 0.1235 (w 0.1194 mse 0.1178 t 258 new 0.20) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 3814/5000 loss 0.0519 (w 0.0888 mse 0.0809 t 873 new 0.25) lr 1.00e-05 gnorm 0.058 5.71s mem 15.6GB +step 3815/5000 loss 0.1036 (w 0.0864 mse 0.0776 t 789 new 0.25) lr 1.00e-05 gnorm 0.059 5.71s mem 15.6GB +step 3816/5000 loss 0.0659 (w 0.0603 mse 0.0539 t 870 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3817/5000 loss 0.0795 (w 0.0965 mse 0.0967 t 668 new 0.15) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 3818/5000 loss 0.1355 (w 0.0627 mse 0.0634 t 742 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3819/5000 loss 0.0707 (w 0.1034 mse 0.0934 t 993 new 0.25) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3820/5000 loss 0.0658 (w 0.1229 mse 0.1239 t 948 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3821/5000 loss 0.0725 (w 0.0684 mse 0.0691 t 473 new 0.17) lr 1.00e-05 gnorm 0.059 5.97s mem 15.6GB +step 3822/5000 loss 0.0624 (w 0.1120 mse 0.1077 t 954 new 0.13) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 3823/5000 loss 0.0562 (w 0.0804 mse 0.0786 t 986 new 0.23) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 3824/5000 loss 0.0467 (w 0.8000 mse 0.8047 t 20 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3825/5000 loss 0.0892 (w 0.0711 mse 0.0657 t 788 new 0.23) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3826/5000 loss 0.0867 (w 0.1182 mse 0.1108 t 750 new 0.28) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3827/5000 loss 0.0791 (w 0.1432 mse 0.1309 t 986 new 0.24) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3828/5000 loss 0.0532 (w 0.1415 mse 0.1248 t 963 new 0.21) lr 1.00e-05 gnorm 0.053 5.72s mem 15.6GB +step 3829/5000 loss 0.0666 (w 0.0830 mse 0.0829 t 868 new 0.23) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 3830/5000 loss 0.1301 (w 0.0714 mse 0.0697 t 853 new 0.21) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3831/5000 loss 0.0826 (w 0.0720 mse 0.0655 t 761 new 0.20) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3832/5000 loss 0.0803 (w 0.0581 mse 0.0559 t 910 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 3833/5000 loss 0.0935 (w 0.0873 mse 0.0846 t 375 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 3834/5000 loss 0.1054 (w 0.0718 mse 0.0732 t 682 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3835/5000 loss 0.0691 (w 0.0468 mse 0.0521 t 360 new 0.13) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 3836/5000 loss 0.1123 (w 0.0599 mse 0.0579 t 640 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 3837/5000 loss 0.0496 (w 0.0545 mse 0.0541 t 730 new 0.11) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 3838/5000 loss 0.0604 (w 0.1057 mse 0.0929 t 935 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3839/5000 loss 0.0675 (w 0.0567 mse 0.0545 t 885 new 0.22) lr 1.00e-05 gnorm 0.069 5.67s mem 15.6GB +step 3840/5000 loss 0.0985 (w 0.0620 mse 0.0600 t 868 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3841/5000 loss 0.0857 (w 0.0951 mse 0.0881 t 858 new 0.25) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 3842/5000 loss 0.0734 (w 0.0912 mse 0.0839 t 961 new 0.21) lr 1.00e-05 gnorm 0.069 5.67s mem 15.6GB +step 3843/5000 loss 0.0818 (w 0.0773 mse 0.0730 t 971 new 0.30) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3844/5000 loss 0.1669 (w 0.2487 mse 0.2466 t 208 new 0.24) lr 1.00e-05 gnorm 0.098 5.93s mem 15.6GB +step 3845/5000 loss 0.0908 (w 0.1529 mse 0.1622 t 987 new 0.20) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 3846/5000 loss 0.0683 (w 0.1474 mse 0.1412 t 937 new 0.28) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3847/5000 loss 0.1354 (w 0.0781 mse 0.0726 t 824 new 0.18) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 3848/5000 loss 0.0996 (w 0.9808 mse 0.9820 t 10 new 0.18) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3849/5000 loss 0.0566 (w 0.0721 mse 0.0655 t 904 new 0.22) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +step 3850/5000 loss 0.1383 (w 0.1268 mse 0.1194 t 391 new 0.25) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 3851/5000 loss 0.0778 (w 0.0837 mse 0.0812 t 552 new 0.17) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 3852/5000 loss 0.0628 (w 0.0720 mse 0.0707 t 795 new 0.19) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 3853/5000 loss 0.1427 (w 0.0559 mse 0.0547 t 595 new 0.20) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 3854/5000 loss 0.0606 (w 0.0881 mse 0.0883 t 821 new 0.14) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 3855/5000 loss 0.0972 (w 0.0826 mse 0.0810 t 882 new 0.25) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +step 3856/5000 loss 0.0936 (w 0.0657 mse 0.0664 t 673 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 3857/5000 loss 0.1217 (w 0.1592 mse 0.1564 t 985 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3858/5000 loss 0.1085 (w 0.1278 mse 0.1236 t 886 new 0.31) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 3859/5000 loss 0.0777 (w 0.0916 mse 0.0876 t 538 new 0.27) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 3860/5000 loss 0.0937 (w 0.1046 mse 0.0976 t 982 new 0.16) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 3861/5000 loss 0.0921 (w 0.0709 mse 0.0684 t 788 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3862/5000 loss 0.1218 (w 0.0580 mse 0.0534 t 869 new 0.08) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 3863/5000 loss 0.0999 (w 0.0922 mse 0.0895 t 905 new 0.24) lr 1.00e-05 gnorm 0.106 5.69s mem 15.6GB +step 3864/5000 loss 0.0676 (w 0.0881 mse 0.0979 t 978 new 0.23) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 3865/5000 loss 0.0724 (w 0.0717 mse 0.0702 t 768 new 0.24) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3866/5000 loss 0.1064 (w 0.0725 mse 0.0676 t 821 new 0.24) lr 1.00e-05 gnorm 0.080 5.93s mem 15.6GB +step 3867/5000 loss 0.1149 (w 0.1095 mse 0.1030 t 768 new 0.23) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 3868/5000 loss 0.0808 (w 0.0750 mse 0.0759 t 977 new 0.16) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +step 3869/5000 loss 0.0713 (w 0.0779 mse 0.0737 t 867 new 0.11) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 3870/5000 loss 0.0878 (w 0.0939 mse 0.0887 t 731 new 0.21) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 3871/5000 loss 0.1008 (w 0.2063 mse 0.1995 t 995 new 0.25) lr 1.00e-05 gnorm 0.088 5.70s mem 15.6GB +step 3872/5000 loss 0.0821 (w 0.0797 mse 0.0776 t 787 new 0.23) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 3873/5000 loss 0.0712 (w 0.0991 mse 0.0907 t 826 new 0.23) lr 1.00e-05 gnorm 0.070 5.77s mem 15.6GB +step 3874/5000 loss 0.1413 (w 0.0753 mse 0.0709 t 643 new 0.25) lr 1.00e-05 gnorm 0.107 5.69s mem 15.6GB +step 3875/5000 loss 0.0692 (w 0.0986 mse 0.0900 t 717 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3876/5000 loss 0.0882 (w 0.0944 mse 0.0903 t 428 new 0.24) lr 1.00e-05 gnorm 0.054 5.81s mem 15.6GB +step 3877/5000 loss 0.0846 (w 0.1067 mse 0.0987 t 966 new 0.24) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 3878/5000 loss 0.1070 (w 0.1129 mse 0.1132 t 306 new 0.27) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 3879/5000 loss 0.0684 (w 0.1165 mse 0.1066 t 940 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3880/5000 loss 0.1009 (w 0.1690 mse 0.1647 t 270 new 0.24) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 3881/5000 loss 0.0745 (w 0.0760 mse 0.0760 t 892 new 0.25) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +step 3882/5000 loss 0.0789 (w 0.1238 mse 0.1226 t 878 new 0.21) lr 1.00e-05 gnorm 0.081 5.71s mem 15.6GB +step 3883/5000 loss 0.0821 (w 0.1446 mse 0.1406 t 972 new 0.19) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 3884/5000 loss 0.0842 (w 0.1072 mse 0.0944 t 932 new 0.21) lr 1.00e-05 gnorm 0.112 5.88s mem 15.6GB +step 3885/5000 loss 0.0940 (w 0.0921 mse 0.0845 t 710 new 0.19) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 3886/5000 loss 0.0409 (w 0.0921 mse 0.0920 t 964 new 0.24) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 3887/5000 loss 0.1099 (w 0.1385 mse 0.1359 t 309 new 0.19) lr 1.00e-05 gnorm 0.101 5.68s mem 15.6GB +step 3888/5000 loss 0.1382 (w 0.1402 mse 0.1387 t 389 new 0.26) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +step 3889/5000 loss 0.0521 (w 0.0753 mse 0.0670 t 744 new 0.24) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 3890/5000 loss 0.1323 (w 0.0926 mse 0.0941 t 976 new 0.24) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 3891/5000 loss 0.0686 (w 0.0643 mse 0.0580 t 915 new 0.26) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 3892/5000 loss 0.0872 (w 0.0356 mse 0.0378 t 719 new 0.16) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +step 3893/5000 loss 0.0855 (w 0.0448 mse 0.0489 t 596 new 0.27) lr 1.00e-05 gnorm 0.063 5.93s mem 15.6GB +step 3894/5000 loss 0.0653 (w 0.2390 mse 0.2315 t 97 new 0.27) lr 1.00e-05 gnorm 0.065 5.78s mem 15.6GB +step 3895/5000 loss 0.1017 (w 0.2912 mse 0.2637 t 996 new 0.19) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3896/5000 loss 0.0925 (w 0.0814 mse 0.0808 t 389 new 0.22) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 3897/5000 loss 0.0794 (w 0.1335 mse 0.1323 t 900 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3898/5000 loss 0.0735 (w 0.2015 mse 0.1836 t 981 new 0.23) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 3899/5000 loss 0.0542 (w 0.0963 mse 0.0971 t 866 new 0.21) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 3900/5000 loss 0.0758 (w 0.1043 mse 0.0999 t 657 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 3901/5000 loss 0.1285 (w 0.0674 mse 0.0621 t 858 new 0.21) lr 1.00e-05 gnorm 0.070 5.67s mem 15.6GB +step 3902/5000 loss 0.1030 (w 0.1948 mse 0.1898 t 232 new 0.24) lr 1.00e-05 gnorm 0.068 5.92s mem 15.6GB +step 3903/5000 loss 0.1117 (w 0.0633 mse 0.0612 t 709 new 0.26) lr 1.00e-05 gnorm 0.074 5.86s mem 15.6GB +step 3904/5000 loss 0.0654 (w 0.0954 mse 0.0897 t 939 new 0.19) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 3905/5000 loss 0.0834 (w 0.1156 mse 0.1100 t 894 new 0.25) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +step 3906/5000 loss 0.1177 (w 0.1116 mse 0.1077 t 727 new 0.24) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 3907/5000 loss 0.0758 (w 0.0489 mse 0.0516 t 984 new 0.18) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3908/5000 loss 0.0898 (w 0.0572 mse 0.0530 t 647 new 0.13) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 3909/5000 loss 0.1103 (w 0.0884 mse 0.0881 t 927 new 0.21) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 3910/5000 loss 0.0671 (w 0.0797 mse 0.0764 t 809 new 0.23) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 3911/5000 loss 0.0954 (w 0.0721 mse 0.0699 t 868 new 0.28) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 3912/5000 loss 0.1106 (w 0.0548 mse 0.0570 t 727 new 0.16) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 3913/5000 loss 0.1456 (w 0.1401 mse 0.1246 t 969 new 0.26) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 3914/5000 loss 0.1059 (w 0.1289 mse 0.1228 t 349 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3915/5000 loss 0.0987 (w 0.0753 mse 0.0681 t 827 new 0.18) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 3916/5000 loss 0.0646 (w 0.1929 mse 0.1832 t 999 new 0.26) lr 1.00e-05 gnorm 0.082 5.91s mem 15.6GB +step 3917/5000 loss 0.0924 (w 0.1176 mse 0.1126 t 953 new 0.18) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 3918/5000 loss 0.0698 (w 0.5269 mse 0.4404 t 999 new 0.21) lr 1.00e-05 gnorm 0.052 5.93s mem 15.6GB +step 3919/5000 loss 0.1032 (w 0.0751 mse 0.0765 t 538 new 0.13) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 3920/5000 loss 0.0683 (w 0.1301 mse 0.1249 t 992 new 0.26) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 3921/5000 loss 0.1176 (w 0.0997 mse 0.0949 t 727 new 0.30) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 3922/5000 loss 0.0970 (w 0.0730 mse 0.0751 t 904 new 0.19) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3923/5000 loss 0.0812 (w 0.0664 mse 0.0664 t 602 new 0.26) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 3924/5000 loss 0.0603 (w 0.1106 mse 0.1036 t 909 new 0.24) lr 1.00e-05 gnorm 0.055 5.91s mem 15.6GB +step 3925/5000 loss 0.0785 (w 0.0460 mse 0.0483 t 821 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 3926/5000 loss 0.0493 (w 0.1028 mse 0.0997 t 946 new 0.22) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 3927/5000 loss 0.1184 (w 0.0695 mse 0.0641 t 595 new 0.23) lr 1.00e-05 gnorm 0.061 5.72s mem 15.6GB +step 3928/5000 loss 0.0866 (w 0.0611 mse 0.0703 t 988 new 0.18) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 3929/5000 loss 0.1025 (w 0.1008 mse 0.0959 t 360 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3930/5000 loss 0.0954 (w 0.1294 mse 0.1280 t 391 new 0.21) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 3931/5000 loss 0.0625 (w 0.1223 mse 0.1201 t 935 new 0.21) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 3932/5000 loss 0.0558 (w 0.0593 mse 0.0557 t 776 new 0.22) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 3933/5000 loss 0.0787 (w 0.0794 mse 0.0760 t 942 new 0.26) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 3934/5000 loss 0.0355 (w 0.0349 mse 0.0328 t 907 new 0.22) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 3935/5000 loss 0.1061 (w 0.0750 mse 0.0690 t 820 new 0.27) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3936/5000 loss 0.1010 (w 0.1112 mse 0.1085 t 966 new 0.09) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 3937/5000 loss 0.0813 (w 0.0813 mse 0.0729 t 805 new 0.28) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 3938/5000 loss 0.0750 (w 0.1533 mse 0.1470 t 960 new 0.24) lr 1.00e-05 gnorm 0.066 5.83s mem 15.6GB +step 3939/5000 loss 0.0779 (w 0.0208 mse 0.0225 t 774 new 0.11) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3940/5000 loss 0.1404 (w 0.0459 mse 0.0458 t 650 new 0.05) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 3941/5000 loss 0.0909 (w 0.2654 mse 0.2629 t 130 new 0.21) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 3942/5000 loss 0.0832 (w 0.3436 mse 0.3466 t 62 new 0.15) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 3943/5000 loss 0.0850 (w 0.1298 mse 0.1214 t 930 new 0.21) lr 1.00e-05 gnorm 0.088 5.71s mem 15.6GB +step 3944/5000 loss 0.0685 (w 0.0541 mse 0.0520 t 679 new 0.14) lr 1.00e-05 gnorm 0.060 5.89s mem 15.6GB +step 3945/5000 loss 0.0619 (w 0.1246 mse 0.1203 t 905 new 0.22) lr 1.00e-05 gnorm 0.053 5.79s mem 15.6GB +step 3946/5000 loss 0.0835 (w 0.1792 mse 0.1676 t 982 new 0.20) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 3947/5000 loss 0.0811 (w 0.0781 mse 0.0745 t 947 new 0.13) lr 1.00e-05 gnorm 0.064 5.90s mem 15.6GB +step 3948/5000 loss 0.0721 (w 0.0768 mse 0.0746 t 557 new 0.24) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 3949/5000 loss 0.0750 (w 0.0837 mse 0.0860 t 995 new 0.14) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3950/5000 loss 0.0442 (w 0.0712 mse 0.0655 t 859 new 0.29) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 3951/5000 loss 0.1107 (w 0.1486 mse 0.1503 t 998 new 0.18) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 3952/5000 loss 0.0745 (w 0.0582 mse 0.0556 t 733 new 0.23) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3953/5000 loss 0.0840 (w 0.0595 mse 0.0560 t 790 new 0.28) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 3954/5000 loss 0.0546 (w 0.0730 mse 0.0694 t 508 new 0.19) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 3955/5000 loss 0.0934 (w 0.0981 mse 0.1050 t 963 new 0.23) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 3956/5000 loss 0.0708 (w 0.0598 mse 0.0564 t 825 new 0.28) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 3957/5000 loss 0.0366 (w 0.0694 mse 0.0649 t 879 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3958/5000 loss 0.1127 (w 0.1229 mse 0.1115 t 967 new 0.27) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 3959/5000 loss 0.0840 (w 0.0836 mse 0.0821 t 480 new 0.26) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 3960/5000 loss 0.0894 (w 0.0638 mse 0.0640 t 879 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 3961/5000 loss 0.1110 (w 0.0815 mse 0.0756 t 668 new 0.14) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 3962/5000 loss 0.1039 (w 0.0911 mse 0.0840 t 697 new 0.25) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +step 3963/5000 loss 0.0841 (w 0.1618 mse 0.1477 t 978 new 0.19) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3964/5000 loss 0.0488 (w 0.1487 mse 0.1348 t 965 new 0.29) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3965/5000 loss 0.1100 (w 0.0836 mse 0.0802 t 833 new 0.21) lr 1.00e-05 gnorm 0.060 5.89s mem 15.6GB +step 3966/5000 loss 0.0772 (w 0.0828 mse 0.0764 t 829 new 0.21) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 3967/5000 loss 0.1134 (w 0.0879 mse 0.0892 t 986 new 0.20) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 3968/5000 loss 0.0863 (w 0.1207 mse 0.1154 t 978 new 0.29) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 3969/5000 loss 0.0977 (w 0.0830 mse 0.0804 t 928 new 0.27) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 3970/5000 loss 0.0977 (w 0.0812 mse 0.0784 t 540 new 0.25) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 3971/5000 loss 0.0642 (w 0.0831 mse 0.0808 t 484 new 0.20) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3972/5000 loss 0.1070 (w 0.1402 mse 0.1432 t 303 new 0.13) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 3973/5000 loss 0.0567 (w 0.1120 mse 0.1090 t 951 new 0.13) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 3974/5000 loss 0.0873 (w 0.0522 mse 0.0543 t 836 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 3975/5000 loss 0.0817 (w 0.0914 mse 0.0909 t 762 new 0.19) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 3976/5000 loss 0.0741 (w 0.1214 mse 0.1167 t 968 new 0.17) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3977/5000 loss 0.0572 (w 0.0836 mse 0.0758 t 876 new 0.29) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 3978/5000 loss 0.0989 (w 0.4387 mse 0.4739 t 57 new 0.17) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 3979/5000 loss 0.1212 (w 0.0639 mse 0.0595 t 715 new 0.25) lr 1.00e-05 gnorm 0.062 6.09s mem 15.6GB +step 3980/5000 loss 0.0774 (w 0.0753 mse 0.0708 t 901 new 0.19) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 3981/5000 loss 0.1003 (w 0.0784 mse 0.0773 t 947 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 3982/5000 loss 0.0911 (w 0.0475 mse 0.0485 t 819 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3983/5000 loss 0.0795 (w 0.0653 mse 0.0636 t 869 new 0.25) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 3984/5000 loss 0.0522 (w 0.0896 mse 0.0894 t 499 new 0.21) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 3985/5000 loss 0.0650 (w 0.2537 mse 0.2506 t 150 new 0.18) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 3986/5000 loss 0.0777 (w 0.0605 mse 0.0577 t 849 new 0.10) lr 1.00e-05 gnorm 0.067 5.91s mem 15.6GB +step 3987/5000 loss 0.0880 (w 0.1301 mse 0.1219 t 988 new 0.29) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 3988/5000 loss 0.1020 (w 0.0713 mse 0.0688 t 730 new 0.14) lr 1.00e-05 gnorm 0.084 5.67s mem 15.6GB +step 3989/5000 loss 0.0828 (w 0.0821 mse 0.0763 t 918 new 0.32) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 3990/5000 loss 0.0717 (w 0.1244 mse 0.1251 t 942 new 0.19) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 3991/5000 loss 0.1220 (w 0.0519 mse 0.0503 t 929 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 3992/5000 loss 0.0777 (w 0.1384 mse 0.1244 t 971 new 0.25) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 3993/5000 loss 0.0675 (w 0.1085 mse 0.1066 t 394 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 3994/5000 loss 0.0977 (w 0.0718 mse 0.0667 t 853 new 0.22) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 3995/5000 loss 0.0704 (w 0.0549 mse 0.0546 t 869 new 0.22) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 3996/5000 loss 0.0811 (w 0.0758 mse 0.0694 t 714 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 3997/5000 loss 0.1092 (w 0.0861 mse 0.0872 t 972 new 0.18) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 3998/5000 loss 0.0447 (w 0.1089 mse 0.0986 t 896 new 0.27) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 3999/5000 loss 0.0838 (w 0.1380 mse 0.1250 t 971 new 0.22) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4000/5000 loss 0.0659 (w 0.3408 mse 0.3269 t 999 new 0.15) lr 1.00e-05 gnorm 0.054 5.80s mem 15.6GB +[val] step 4000 t=201: w=0.1740 mse=0.1764 (n=16) t=501: w=0.0720 mse=0.0719 (n=16) t=800: w=0.0600 mse=0.0588 (n=16) | mean w=0.1020 mse=0.1024 4s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step4000.safetensors 832 个张量 2.87 GB +step 4001/5000 loss 0.1073 (w 0.0518 mse 0.0498 t 809 new 0.27) lr 1.00e-05 gnorm 0.066 5.67s mem 15.6GB +step 4002/5000 loss 0.0726 (w 0.0972 mse 0.0872 t 900 new 0.30) lr 1.00e-05 gnorm 0.073 5.71s mem 15.6GB +step 4003/5000 loss 0.0660 (w 0.0746 mse 0.0710 t 901 new 0.24) lr 1.00e-05 gnorm 0.050 5.71s mem 15.6GB +step 4004/5000 loss 0.1087 (w 0.1467 mse 0.1429 t 242 new 0.22) lr 1.00e-05 gnorm 0.068 5.71s mem 15.6GB +step 4005/5000 loss 0.0943 (w 0.0529 mse 0.0527 t 892 new 0.13) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 4006/5000 loss 0.0642 (w 0.0697 mse 0.0675 t 563 new 0.20) lr 1.00e-05 gnorm 0.045 5.71s mem 15.6GB +step 4007/5000 loss 0.1355 (w 0.0603 mse 0.0590 t 488 new 0.12) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 4008/5000 loss 0.1168 (w 0.0719 mse 0.0722 t 434 new 0.21) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 4009/5000 loss 0.0664 (w 0.0933 mse 0.0910 t 963 new 0.12) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +step 4010/5000 loss 0.0755 (w 0.1095 mse 0.1003 t 925 new 0.29) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4011/5000 loss 0.1077 (w 0.0520 mse 0.0490 t 721 new 0.23) lr 1.00e-05 gnorm 0.064 5.83s mem 15.6GB +step 4012/5000 loss 0.0939 (w 0.0797 mse 0.0796 t 552 new 0.19) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4013/5000 loss 0.1377 (w 0.0945 mse 0.0895 t 495 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4014/5000 loss 0.0753 (w 0.0651 mse 0.0647 t 821 new 0.13) lr 1.00e-05 gnorm 0.067 5.92s mem 15.6GB +step 4015/5000 loss 0.0831 (w 0.0732 mse 0.0792 t 225 new 0.14) lr 1.00e-05 gnorm 0.052 5.71s mem 15.6GB +step 4016/5000 loss 0.0756 (w 0.0764 mse 0.0731 t 940 new 0.29) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 4017/5000 loss 0.0938 (w 0.0523 mse 0.0525 t 904 new 0.29) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 4018/5000 loss 0.1192 (w 0.1610 mse 0.1487 t 993 new 0.20) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 4019/5000 loss 0.0518 (w 0.0674 mse 0.0615 t 917 new 0.24) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4020/5000 loss 0.0904 (w 0.0776 mse 0.0686 t 829 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4021/5000 loss 0.0776 (w 0.0580 mse 0.0560 t 798 new 0.24) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4022/5000 loss 0.0576 (w 0.1008 mse 0.0983 t 936 new 0.16) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 4023/5000 loss 0.1449 (w 0.1312 mse 0.1301 t 453 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +step 4024/5000 loss 0.1401 (w 0.1474 mse 0.1453 t 344 new 0.22) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4025/5000 loss 0.1113 (w 0.1053 mse 0.0972 t 814 new 0.31) lr 1.00e-05 gnorm 0.057 5.92s mem 15.6GB +step 4026/5000 loss 0.0792 (w 0.2036 mse 0.1871 t 991 new 0.30) lr 1.00e-05 gnorm 0.047 5.71s mem 15.6GB +step 4027/5000 loss 0.0767 (w 0.1010 mse 0.1014 t 935 new 0.23) lr 1.00e-05 gnorm 0.063 5.71s mem 15.6GB +step 4028/5000 loss 0.0983 (w 0.0816 mse 0.0803 t 486 new 0.15) lr 1.00e-05 gnorm 0.076 5.84s mem 15.6GB +step 4029/5000 loss 0.0843 (w 0.0642 mse 0.0640 t 588 new 0.20) lr 1.00e-05 gnorm 0.046 5.91s mem 15.6GB +step 4030/5000 loss 0.0641 (w 0.1093 mse 0.1012 t 966 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4031/5000 loss 0.1589 (w 0.1759 mse 0.1742 t 208 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4032/5000 loss 0.0702 (w 0.1110 mse 0.1062 t 929 new 0.21) lr 1.00e-05 gnorm 0.056 5.84s mem 15.6GB +step 4033/5000 loss 0.0829 (w 0.0633 mse 0.0588 t 903 new 0.22) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +step 4034/5000 loss 0.0676 (w 0.0759 mse 0.0745 t 619 new 0.18) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 4035/5000 loss 0.1278 (w 0.1113 mse 0.1071 t 516 new 0.17) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 4036/5000 loss 0.0641 (w 0.1032 mse 0.0963 t 957 new 0.18) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 4037/5000 loss 0.0788 (w 0.0849 mse 0.0797 t 923 new 0.22) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 4038/5000 loss 0.0854 (w 0.0889 mse 0.0913 t 885 new 0.16) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4039/5000 loss 0.1142 (w 0.1591 mse 0.1545 t 270 new 0.25) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4040/5000 loss 0.0817 (w 0.0566 mse 0.0541 t 756 new 0.22) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 4041/5000 loss 0.0868 (w 0.0833 mse 0.0813 t 961 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 4042/5000 loss 0.0734 (w 0.0780 mse 0.0757 t 964 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4043/5000 loss 0.1322 (w 0.2706 mse 0.2705 t 126 new 0.21) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 4044/5000 loss 0.0810 (w 0.1250 mse 0.1227 t 270 new 0.27) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4045/5000 loss 0.1301 (w 0.5300 mse 0.5195 t 88 new 0.15) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 4046/5000 loss 0.0968 (w 0.0661 mse 0.0604 t 651 new 0.27) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4047/5000 loss 0.1181 (w 0.0618 mse 0.0604 t 459 new 0.20) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 4048/5000 loss 0.0861 (w 0.1401 mse 0.1301 t 964 new 0.29) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4049/5000 loss 0.1097 (w 0.0789 mse 0.0756 t 724 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 4050/5000 loss 0.0437 (w 0.0196 mse 0.0176 t 789 new 0.10) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4051/5000 loss 0.0580 (w 0.1463 mse 0.1411 t 942 new 0.29) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 4052/5000 loss 0.1233 (w 0.1253 mse 0.1197 t 936 new 0.20) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 4053/5000 loss 0.0926 (w 0.0309 mse 0.0322 t 961 new 0.22) lr 1.00e-05 gnorm 0.045 5.85s mem 15.6GB +step 4054/5000 loss 0.0983 (w 0.1452 mse 0.1316 t 949 new 0.30) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 4055/5000 loss 0.0835 (w 0.1787 mse 0.1578 t 1000 new 0.22) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4056/5000 loss 0.0679 (w 0.0414 mse 0.0492 t 950 new 0.22) lr 1.00e-05 gnorm 0.049 5.91s mem 15.6GB +step 4057/5000 loss 0.0900 (w 0.0509 mse 0.0535 t 956 new 0.24) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +step 4058/5000 loss 0.0919 (w 0.0730 mse 0.0712 t 926 new 0.27) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 4059/5000 loss 0.0552 (w 0.0790 mse 0.0752 t 744 new 0.24) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4060/5000 loss 0.0821 (w 0.1673 mse 0.1802 t 447 new 0.17) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 4061/5000 loss 0.0612 (w 0.1553 mse 0.1563 t 988 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4062/5000 loss 0.1084 (w 0.0995 mse 0.0942 t 425 new 0.28) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 4063/5000 loss 0.0662 (w 0.0884 mse 0.0889 t 913 new 0.23) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 4064/5000 loss 0.0982 (w 0.2005 mse 0.1972 t 225 new 0.20) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 4065/5000 loss 0.1277 (w 0.0964 mse 0.0930 t 761 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4066/5000 loss 0.1352 (w 0.0619 mse 0.0642 t 493 new 0.20) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4067/5000 loss 0.1083 (w 0.1175 mse 0.1093 t 951 new 0.23) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4068/5000 loss 0.1046 (w 0.0788 mse 0.0735 t 577 new 0.23) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 4069/5000 loss 0.0769 (w 0.0644 mse 0.0620 t 708 new 0.20) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 4070/5000 loss 0.0852 (w 0.1086 mse 0.1014 t 941 new 0.24) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 4071/5000 loss 0.0960 (w 0.1033 mse 0.0972 t 930 new 0.23) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 4072/5000 loss 0.0643 (w 0.0670 mse 0.0622 t 823 new 0.18) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +step 4073/5000 loss 0.0713 (w 0.0392 mse 0.0387 t 651 new 0.22) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 4074/5000 loss 0.0369 (w 0.0522 mse 0.0539 t 794 new 0.25) lr 1.00e-05 gnorm 0.066 5.82s mem 15.6GB +step 4075/5000 loss 0.0492 (w 0.1254 mse 0.1180 t 887 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 4076/5000 loss 0.0871 (w 0.2022 mse 0.1969 t 978 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4077/5000 loss 0.0877 (w 0.1224 mse 0.1333 t 551 new 0.18) lr 1.00e-05 gnorm 0.069 5.93s mem 15.6GB +step 4078/5000 loss 0.0949 (w 0.1143 mse 0.1116 t 288 new 0.28) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 4079/5000 loss 0.0902 (w 0.0474 mse 0.0452 t 749 new 0.09) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 4080/5000 loss 0.0684 (w 0.0365 mse 0.0381 t 967 new 0.11) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4081/5000 loss 0.0727 (w 0.0746 mse 0.0680 t 702 new 0.30) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4082/5000 loss 0.0894 (w 0.0785 mse 0.0766 t 484 new 0.26) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +step 4083/5000 loss 0.0905 (w 0.5894 mse 0.5808 t 25 new 0.14) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 4084/5000 loss 0.0992 (w 0.0879 mse 0.0822 t 792 new 0.20) lr 1.00e-05 gnorm 0.097 5.72s mem 15.6GB +step 4085/5000 loss 0.1638 (w 0.1510 mse 0.1444 t 965 new 0.14) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +step 4086/5000 loss 0.0770 (w 0.2404 mse 0.2303 t 983 new 0.23) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 4087/5000 loss 0.0674 (w 0.0911 mse 0.0860 t 875 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 4088/5000 loss 0.0904 (w 0.1189 mse 0.1175 t 248 new 0.20) lr 1.00e-05 gnorm 0.080 5.76s mem 15.6GB +step 4089/5000 loss 0.0909 (w 0.0831 mse 0.0837 t 475 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4090/5000 loss 0.1290 (w 0.1109 mse 0.1064 t 557 new 0.24) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 4091/5000 loss 0.0653 (w 0.1717 mse 0.1553 t 966 new 0.15) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 4092/5000 loss 0.0869 (w 0.0464 mse 0.0485 t 875 new 0.24) lr 1.00e-05 gnorm 0.067 5.92s mem 15.6GB +step 4093/5000 loss 0.0780 (w 0.0456 mse 0.0420 t 902 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4094/5000 loss 0.0262 (w 0.0699 mse 0.0733 t 937 new 0.18) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4095/5000 loss 0.0951 (w 0.1691 mse 0.1547 t 963 new 0.25) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +step 4096/5000 loss 0.0774 (w 0.1253 mse 0.1203 t 941 new 0.28) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 4097/5000 loss 0.1379 (w 0.1314 mse 0.1253 t 986 new 0.28) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4098/5000 loss 0.1201 (w 0.0827 mse 0.0840 t 781 new 0.27) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 4099/5000 loss 0.1073 (w 0.0885 mse 0.0868 t 966 new 0.24) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +step 4100/5000 loss 0.0971 (w 0.0517 mse 0.0518 t 671 new 0.22) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 4101/5000 loss 0.0512 (w 0.0688 mse 0.0678 t 846 new 0.23) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 4102/5000 loss 0.1123 (w 0.1309 mse 0.1244 t 986 new 0.24) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 4103/5000 loss 0.1265 (w 0.1363 mse 0.1330 t 977 new 0.24) lr 1.00e-05 gnorm 0.076 5.79s mem 15.6GB +step 4104/5000 loss 0.1602 (w 0.0786 mse 0.0779 t 829 new 0.17) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 4105/5000 loss 0.1419 (w 0.1974 mse 0.1949 t 242 new 0.13) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4106/5000 loss 0.0698 (w 0.1242 mse 0.1116 t 989 new 0.23) lr 1.00e-05 gnorm 0.054 5.73s mem 15.6GB +step 4107/5000 loss 0.0801 (w 0.0516 mse 0.0489 t 619 new 0.20) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4108/5000 loss 0.0894 (w 0.0613 mse 0.0581 t 882 new 0.21) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 4109/5000 loss 0.0805 (w 0.0908 mse 0.0838 t 828 new 0.16) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +step 4110/5000 loss 0.0997 (w 0.0496 mse 0.0472 t 691 new 0.20) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 4111/5000 loss 0.0597 (w 0.0916 mse 0.0896 t 566 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4112/5000 loss 0.0885 (w 0.0386 mse 0.0397 t 575 new 0.14) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 4113/5000 loss 0.0746 (w 0.0695 mse 0.0675 t 727 new 0.26) lr 1.00e-05 gnorm 0.049 5.92s mem 15.6GB +step 4114/5000 loss 0.0854 (w 0.1307 mse 0.1259 t 955 new 0.25) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 4115/5000 loss 0.0903 (w 0.0858 mse 0.0840 t 873 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 4116/5000 loss 0.0702 (w 0.0822 mse 0.0812 t 682 new 0.22) lr 1.00e-05 gnorm 0.056 5.83s mem 15.6GB +step 4117/5000 loss 0.0779 (w 0.0540 mse 0.0487 t 796 new 0.22) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 4118/5000 loss 0.0975 (w 0.0584 mse 0.0594 t 641 new 0.24) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4119/5000 loss 0.0466 (w 0.0394 mse 0.0353 t 644 new 0.25) lr 1.00e-05 gnorm 0.053 5.67s mem 15.6GB +step 4120/5000 loss 0.1006 (w 0.0562 mse 0.0526 t 786 new 0.24) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 4121/5000 loss 0.0557 (w 0.1290 mse 0.1190 t 970 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4122/5000 loss 0.0984 (w 0.1371 mse 0.1306 t 591 new 0.28) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 4123/5000 loss 0.1429 (w 0.1327 mse 0.1277 t 303 new 0.26) lr 1.00e-05 gnorm 0.075 5.92s mem 15.6GB +step 4124/5000 loss 0.0943 (w 0.0625 mse 0.0623 t 682 new 0.30) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4125/5000 loss 0.0706 (w 0.4089 mse 0.4098 t 997 new 0.27) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4126/5000 loss 0.0750 (w 0.0505 mse 0.0456 t 824 new 0.12) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4127/5000 loss 0.0522 (w 0.0674 mse 0.0727 t 992 new 0.15) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4128/5000 loss 0.1255 (w 0.0633 mse 0.0615 t 938 new 0.21) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4129/5000 loss 0.1263 (w 0.0810 mse 0.0734 t 797 new 0.30) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4130/5000 loss 0.1241 (w 0.6589 mse 0.6670 t 48 new 0.19) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4131/5000 loss 0.0777 (w 0.1567 mse 0.1470 t 985 new 0.24) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 4132/5000 loss 0.1241 (w 0.1130 mse 0.1100 t 372 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4133/5000 loss 0.0914 (w 0.0941 mse 0.0882 t 954 new 0.29) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 4134/5000 loss 0.0853 (w 0.0864 mse 0.0832 t 918 new 0.25) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +step 4135/5000 loss 0.0503 (w 0.1839 mse 0.1746 t 970 new 0.25) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 4136/5000 loss 0.0798 (w 0.0486 mse 0.0522 t 750 new 0.16) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4137/5000 loss 0.0767 (w 0.0621 mse 0.0612 t 943 new 0.10) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 4138/5000 loss 0.0510 (w 0.1525 mse 0.1379 t 958 new 0.22) lr 1.00e-05 gnorm 0.075 5.86s mem 15.6GB +step 4139/5000 loss 0.1140 (w 0.0764 mse 0.0729 t 497 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4140/5000 loss 0.0952 (w 0.0669 mse 0.0698 t 532 new 0.23) lr 1.00e-05 gnorm 0.057 5.93s mem 15.6GB +step 4141/5000 loss 0.1067 (w 0.0477 mse 0.0452 t 860 new 0.23) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 4142/5000 loss 0.0797 (w 0.1504 mse 0.1494 t 339 new 0.09) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4143/5000 loss 0.0725 (w 0.0730 mse 0.0697 t 893 new 0.24) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +step 4144/5000 loss 0.0998 (w 0.0742 mse 0.0678 t 704 new 0.26) lr 1.00e-05 gnorm 0.074 5.93s mem 15.6GB +step 4145/5000 loss 0.0957 (w 0.0714 mse 0.0709 t 551 new 0.16) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 4146/5000 loss 0.1086 (w 0.0469 mse 0.0471 t 796 new 0.14) lr 1.00e-05 gnorm 0.056 5.89s mem 15.6GB +step 4147/5000 loss 0.0700 (w 0.1073 mse 0.1089 t 334 new 0.25) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4148/5000 loss 0.0694 (w 0.0636 mse 0.0595 t 679 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4149/5000 loss 0.0906 (w 0.0560 mse 0.0527 t 695 new 0.24) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4150/5000 loss 0.0753 (w 0.0303 mse 0.0350 t 786 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4151/5000 loss 0.0790 (w 0.0492 mse 0.0514 t 501 new 0.10) lr 1.00e-05 gnorm 0.065 5.75s mem 15.6GB +step 4152/5000 loss 0.1117 (w 0.2949 mse 0.2596 t 999 new 0.17) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 4153/5000 loss 0.0675 (w 0.1403 mse 0.1281 t 973 new 0.26) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 4154/5000 loss 0.1118 (w 0.0785 mse 0.0724 t 896 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4155/5000 loss 0.1052 (w 0.1168 mse 0.1228 t 165 new 0.20) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 4156/5000 loss 0.0795 (w 0.1036 mse 0.0934 t 974 new 0.26) lr 1.00e-05 gnorm 0.050 5.81s mem 15.6GB +step 4157/5000 loss 0.0877 (w 0.0629 mse 0.0602 t 910 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4158/5000 loss 0.0645 (w 0.0873 mse 0.0845 t 914 new 0.21) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 4159/5000 loss 0.0721 (w 0.0454 mse 0.0479 t 751 new 0.26) lr 1.00e-05 gnorm 0.243 5.69s mem 15.6GB +step 4160/5000 loss 0.1053 (w 0.1083 mse 0.1056 t 602 new 0.21) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4161/5000 loss 0.0732 (w 0.1321 mse 0.1227 t 952 new 0.21) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4162/5000 loss 0.1062 (w 0.0871 mse 0.0972 t 979 new 0.23) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 4163/5000 loss 0.1164 (w 0.0871 mse 0.0834 t 943 new 0.10) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 4164/5000 loss 0.0842 (w 0.0881 mse 0.0857 t 961 new 0.24) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4165/5000 loss 0.0737 (w 0.0931 mse 0.0916 t 352 new 0.20) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 4166/5000 loss 0.0624 (w 0.0560 mse 0.0577 t 449 new 0.30) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4167/5000 loss 0.0647 (w 0.0491 mse 0.0518 t 893 new 0.22) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 4168/5000 loss 0.1176 (w 0.0878 mse 0.0883 t 401 new 0.28) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 4169/5000 loss 0.1107 (w 0.0780 mse 0.0697 t 746 new 0.20) lr 1.00e-05 gnorm 0.062 5.71s mem 15.6GB +step 4170/5000 loss 0.0850 (w 0.0714 mse 0.0659 t 913 new 0.28) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4171/5000 loss 0.0663 (w 0.1112 mse 0.1087 t 349 new 0.23) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 4172/5000 loss 0.0529 (w 0.0562 mse 0.0565 t 660 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4173/5000 loss 0.1078 (w 0.5030 mse 0.4997 t 48 new 0.26) lr 1.00e-05 gnorm 0.103 5.69s mem 15.6GB +step 4174/5000 loss 0.0760 (w 0.0870 mse 0.0846 t 880 new 0.23) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 4175/5000 loss 0.1082 (w 0.0521 mse 0.0530 t 697 new 0.24) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +step 4176/5000 loss 0.1162 (w 0.0853 mse 0.0809 t 612 new 0.27) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +step 4177/5000 loss 0.1090 (w 0.1478 mse 0.1491 t 235 new 0.27) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4178/5000 loss 0.0688 (w 0.1984 mse 0.1718 t 1000 new 0.21) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 4179/5000 loss 0.0656 (w 0.0660 mse 0.0611 t 869 new 0.21) lr 1.00e-05 gnorm 0.069 5.94s mem 15.6GB +step 4180/5000 loss 0.0974 (w 0.1076 mse 0.1061 t 852 new 0.20) lr 1.00e-05 gnorm 0.088 5.70s mem 15.6GB +step 4181/5000 loss 0.0844 (w 0.0553 mse 0.0578 t 702 new 0.14) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 4182/5000 loss 0.1036 (w 0.0944 mse 0.0968 t 885 new 0.18) lr 1.00e-05 gnorm 0.100 5.69s mem 15.6GB +step 4183/5000 loss 0.0806 (w 0.0904 mse 0.0822 t 892 new 0.30) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 4184/5000 loss 0.0550 (w 0.1339 mse 0.1176 t 950 new 0.26) lr 1.00e-05 gnorm 0.053 5.71s mem 15.6GB +step 4185/5000 loss 0.0564 (w 0.1083 mse 0.1133 t 258 new 0.29) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4186/5000 loss 0.0899 (w 0.0845 mse 0.0830 t 682 new 0.26) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 4187/5000 loss 0.0781 (w 0.0895 mse 0.0896 t 771 new 0.20) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +step 4188/5000 loss 0.0599 (w 0.2333 mse 0.2133 t 984 new 0.26) lr 1.00e-05 gnorm 0.055 5.88s mem 15.6GB +step 4189/5000 loss 0.0631 (w 0.0449 mse 0.0443 t 742 new 0.12) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 4190/5000 loss 0.1032 (w 0.1077 mse 0.1026 t 909 new 0.29) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4191/5000 loss 0.0933 (w 0.0518 mse 0.0536 t 443 new 0.14) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4192/5000 loss 0.0831 (w 0.0797 mse 0.0760 t 717 new 0.23) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 4193/5000 loss 0.0730 (w 0.0904 mse 0.0887 t 900 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 4194/5000 loss 0.1290 (w 0.0949 mse 0.0887 t 928 new 0.18) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4195/5000 loss 0.0788 (w 0.0739 mse 0.0685 t 745 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4196/5000 loss 0.0784 (w 0.0357 mse 0.0365 t 885 new 0.09) lr 1.00e-05 gnorm 0.091 5.70s mem 15.6GB +step 4197/5000 loss 0.0672 (w 0.1188 mse 0.1107 t 966 new 0.30) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4198/5000 loss 0.0923 (w 0.0984 mse 0.1064 t 309 new 0.24) lr 1.00e-05 gnorm 0.070 5.88s mem 15.6GB +step 4199/5000 loss 0.0776 (w 0.0440 mse 0.0495 t 575 new 0.19) lr 1.00e-05 gnorm 0.098 5.71s mem 15.6GB +step 4200/5000 loss 0.0562 (w 0.0480 mse 0.0522 t 978 new 0.13) lr 1.00e-05 gnorm 0.072 6.06s mem 15.6GB +step 4201/5000 loss 0.0866 (w 0.8478 mse 0.8843 t 10 new 0.25) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +step 4202/5000 loss 0.0584 (w 0.0665 mse 0.0658 t 815 new 0.25) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 4203/5000 loss 0.0623 (w 0.0794 mse 0.0773 t 832 new 0.20) lr 1.00e-05 gnorm 0.054 5.91s mem 15.6GB +step 4204/5000 loss 0.0945 (w 0.1556 mse 0.1521 t 988 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 4205/5000 loss 0.0564 (w 0.1213 mse 0.1190 t 994 new 0.17) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 4206/5000 loss 0.1110 (w 0.0608 mse 0.0588 t 608 new 0.13) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 4207/5000 loss 0.0740 (w 0.0817 mse 0.0851 t 987 new 0.15) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4208/5000 loss 0.0935 (w 0.1919 mse 0.1803 t 1000 new 0.26) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 4209/5000 loss 0.0564 (w 0.0769 mse 0.0691 t 750 new 0.30) lr 1.00e-05 gnorm 0.073 5.73s mem 15.6GB +step 4210/5000 loss 0.0838 (w 0.0925 mse 0.0853 t 938 new 0.17) lr 1.00e-05 gnorm 0.071 5.80s mem 15.6GB +step 4211/5000 loss 0.0864 (w 0.0682 mse 0.0646 t 869 new 0.20) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4212/5000 loss 0.1355 (w 0.1066 mse 0.1023 t 779 new 0.18) lr 1.00e-05 gnorm 0.104 5.69s mem 15.6GB +step 4213/5000 loss 0.0825 (w 0.0713 mse 0.0733 t 993 new 0.07) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 4214/5000 loss 0.0803 (w 0.1609 mse 0.1548 t 965 new 0.29) lr 1.00e-05 gnorm 0.075 5.74s mem 15.6GB +step 4215/5000 loss 0.0411 (w 0.0750 mse 0.0719 t 842 new 0.15) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 4216/5000 loss 0.1041 (w 0.0875 mse 0.0851 t 802 new 0.18) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 4217/5000 loss 0.0989 (w 0.2338 mse 0.2313 t 126 new 0.28) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +step 4218/5000 loss 0.1288 (w 0.2374 mse 0.2258 t 157 new 0.24) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 4219/5000 loss 0.0978 (w 0.0673 mse 0.0613 t 856 new 0.19) lr 1.00e-05 gnorm 0.060 5.91s mem 15.6GB +step 4220/5000 loss 0.0804 (w 0.1093 mse 0.1073 t 334 new 0.28) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 4221/5000 loss 0.1181 (w 0.0577 mse 0.0557 t 791 new 0.22) lr 1.00e-05 gnorm 0.095 5.71s mem 15.6GB +step 4222/5000 loss 0.0724 (w 0.2213 mse 0.1890 t 996 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4223/5000 loss 0.1105 (w 0.1207 mse 0.1084 t 995 new 0.26) lr 1.00e-05 gnorm 0.120 5.69s mem 15.6GB +step 4224/5000 loss 0.0770 (w 0.0678 mse 0.0618 t 786 new 0.29) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +step 4225/5000 loss 0.0758 (w 0.0603 mse 0.0598 t 780 new 0.28) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4226/5000 loss 0.0784 (w 0.3111 mse 0.3230 t 142 new 0.19) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 4227/5000 loss 0.0615 (w 0.2160 mse 0.2028 t 995 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 4228/5000 loss 0.0765 (w 0.0862 mse 0.0788 t 864 new 0.29) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +step 4229/5000 loss 0.0907 (w 0.0728 mse 0.0697 t 896 new 0.17) lr 1.00e-05 gnorm 0.057 5.79s mem 15.6GB +step 4230/5000 loss 0.1248 (w 0.0912 mse 0.0856 t 855 new 0.20) lr 1.00e-05 gnorm 0.091 5.73s mem 15.6GB +step 4231/5000 loss 0.1012 (w 0.0718 mse 0.0712 t 571 new 0.24) lr 1.00e-05 gnorm 0.131 5.70s mem 15.6GB +step 4232/5000 loss 0.1184 (w 0.1245 mse 0.1315 t 267 new 0.09) lr 1.00e-05 gnorm 0.060 5.76s mem 15.6GB +step 4233/5000 loss 0.1081 (w 0.0900 mse 0.0896 t 584 new 0.18) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 4234/5000 loss 0.0782 (w 0.0696 mse 0.0656 t 960 new 0.22) lr 1.00e-05 gnorm 0.103 5.71s mem 15.6GB +step 4235/5000 loss 0.0532 (w 0.1180 mse 0.1189 t 984 new 0.07) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +step 4236/5000 loss 0.1034 (w 0.0695 mse 0.0696 t 749 new 0.31) lr 1.00e-05 gnorm 0.070 5.71s mem 15.6GB +step 4237/5000 loss 0.0694 (w 0.0242 mse 0.0245 t 598 new 0.01) lr 1.00e-05 gnorm 0.091 5.70s mem 15.6GB +step 4238/5000 loss 0.0544 (w 0.0837 mse 0.0739 t 847 new 0.23) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +step 4239/5000 loss 0.1081 (w 0.0743 mse 0.0759 t 966 new 0.14) lr 1.00e-05 gnorm 0.067 6.05s mem 15.6GB +step 4240/5000 loss 0.0677 (w 0.1999 mse 0.1996 t 172 new 0.30) lr 1.00e-05 gnorm 0.085 5.91s mem 15.6GB +step 4241/5000 loss 0.0923 (w 0.1486 mse 0.1386 t 352 new 0.28) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4242/5000 loss 0.0973 (w 0.1350 mse 0.1248 t 947 new 0.23) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 4243/5000 loss 0.0838 (w 0.1168 mse 0.1112 t 584 new 0.25) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 4244/5000 loss 0.0490 (w 0.0637 mse 0.0646 t 885 new 0.16) lr 1.00e-05 gnorm 0.045 5.69s mem 15.6GB +step 4245/5000 loss 0.1015 (w 0.0905 mse 0.0850 t 912 new 0.22) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4246/5000 loss 0.0868 (w 0.1459 mse 0.1486 t 954 new 0.19) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4247/5000 loss 0.0662 (w 0.0719 mse 0.0713 t 922 new 0.15) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 4248/5000 loss 0.0619 (w 0.0511 mse 0.0491 t 648 new 0.26) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 4249/5000 loss 0.0496 (w 0.0586 mse 0.0583 t 900 new 0.29) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 4250/5000 loss 0.0983 (w 0.0726 mse 0.0659 t 923 new 0.13) lr 1.00e-05 gnorm 0.068 5.74s mem 15.6GB +step 4251/5000 loss 0.0939 (w 0.0285 mse 0.0308 t 898 new 0.17) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 4252/5000 loss 0.0592 (w 0.1199 mse 0.1129 t 913 new 0.30) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 4253/5000 loss 0.0790 (w 0.2181 mse 0.2176 t 201 new 0.18) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4254/5000 loss 0.0827 (w 0.0591 mse 0.0561 t 771 new 0.20) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +step 4255/5000 loss 0.0837 (w 0.2069 mse 0.1975 t 976 new 0.27) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 4256/5000 loss 0.0597 (w 0.0712 mse 0.0660 t 749 new 0.24) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4257/5000 loss 0.0648 (w 0.0402 mse 0.0407 t 693 new 0.15) lr 1.00e-05 gnorm 0.085 5.70s mem 15.6GB +step 4258/5000 loss 0.1189 (w 0.0889 mse 0.0814 t 578 new 0.24) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 4259/5000 loss 0.0628 (w 0.0806 mse 0.0799 t 530 new 0.22) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 4260/5000 loss 0.0888 (w 0.0833 mse 0.0783 t 836 new 0.28) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 4261/5000 loss 0.1112 (w 0.1233 mse 0.1267 t 918 new 0.21) lr 1.00e-05 gnorm 0.066 6.14s mem 15.6GB +step 4262/5000 loss 0.0763 (w 0.0730 mse 0.0688 t 919 new 0.27) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4263/5000 loss 0.1006 (w 0.0670 mse 0.0658 t 863 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 4264/5000 loss 0.0864 (w 0.0710 mse 0.0657 t 831 new 0.22) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 4265/5000 loss 0.1049 (w 0.0771 mse 0.0732 t 646 new 0.18) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 4266/5000 loss 0.0916 (w 0.0759 mse 0.0724 t 980 new 0.18) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 4267/5000 loss 0.0816 (w 0.0568 mse 0.0542 t 650 new 0.17) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 4268/5000 loss 0.0963 (w 0.0875 mse 0.0791 t 904 new 0.20) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 4269/5000 loss 0.0987 (w 0.0797 mse 0.0779 t 938 new 0.07) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 4270/5000 loss 0.0898 (w 0.0660 mse 0.0634 t 665 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4271/5000 loss 0.0862 (w 0.0945 mse 0.0939 t 509 new 0.25) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 4272/5000 loss 0.0548 (w 0.1385 mse 0.1221 t 955 new 0.24) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 4273/5000 loss 0.0864 (w 0.0809 mse 0.0734 t 830 new 0.27) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 4274/5000 loss 0.1043 (w 0.1287 mse 0.1176 t 595 new 0.28) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4275/5000 loss 0.0769 (w 0.1159 mse 0.1186 t 963 new 0.20) lr 1.00e-05 gnorm 0.072 5.83s mem 15.6GB +step 4276/5000 loss 0.1009 (w 0.0856 mse 0.0796 t 666 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4277/5000 loss 0.0744 (w 0.0897 mse 0.0831 t 775 new 0.26) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 4278/5000 loss 0.1258 (w 0.0814 mse 0.0782 t 700 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4279/5000 loss 0.0813 (w 0.0740 mse 0.0737 t 890 new 0.19) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 4280/5000 loss 0.1791 (w 0.1088 mse 0.1046 t 545 new 0.24) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 4281/5000 loss 0.0601 (w 0.1089 mse 0.1102 t 942 new 0.23) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 4282/5000 loss 0.0584 (w 0.1387 mse 0.1385 t 974 new 0.21) lr 1.00e-05 gnorm 0.045 5.94s mem 15.6GB +step 4283/5000 loss 0.0853 (w 0.0557 mse 0.0533 t 545 new 0.26) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 4284/5000 loss 0.0723 (w 0.1539 mse 0.1404 t 982 new 0.24) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 4285/5000 loss 0.0932 (w 0.1151 mse 0.1107 t 447 new 0.26) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 4286/5000 loss 0.0656 (w 0.0671 mse 0.0640 t 878 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4287/5000 loss 0.0648 (w 0.1945 mse 0.1738 t 990 new 0.14) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 4288/5000 loss 0.1164 (w 0.0935 mse 0.0974 t 905 new 0.18) lr 1.00e-05 gnorm 0.067 5.84s mem 15.6GB +step 4289/5000 loss 0.0730 (w 0.1139 mse 0.1076 t 949 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4290/5000 loss 0.0924 (w 0.0612 mse 0.0584 t 901 new 0.29) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 4291/5000 loss 0.0700 (w 0.0755 mse 0.0751 t 718 new 0.21) lr 1.00e-05 gnorm 0.047 5.70s mem 15.6GB +step 4292/5000 loss 0.1333 (w 0.0885 mse 0.0882 t 522 new 0.24) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +step 4293/5000 loss 0.0786 (w 0.6069 mse 0.6032 t 62 new 0.26) lr 1.00e-05 gnorm 0.060 5.72s mem 15.6GB +step 4294/5000 loss 0.1643 (w 0.0977 mse 0.0940 t 617 new 0.25) lr 1.00e-05 gnorm 0.083 5.75s mem 15.6GB +step 4295/5000 loss 0.0537 (w 0.1446 mse 0.1313 t 959 new 0.26) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4296/5000 loss 0.0945 (w 0.0827 mse 0.0782 t 780 new 0.19) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4297/5000 loss 0.0950 (w 0.1248 mse 0.1204 t 996 new 0.09) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 4298/5000 loss 0.0719 (w 0.0567 mse 0.0568 t 661 new 0.20) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4299/5000 loss 0.0755 (w 0.0439 mse 0.0410 t 845 new 0.24) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 4300/5000 loss 0.0622 (w 0.0818 mse 0.0758 t 812 new 0.20) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +step 4301/5000 loss 0.0768 (w 0.0619 mse 0.0621 t 849 new 0.19) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4302/5000 loss 0.0473 (w 0.0593 mse 0.0593 t 798 new 0.20) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 4303/5000 loss 0.0981 (w 0.0757 mse 0.0720 t 887 new 0.22) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 4304/5000 loss 0.0864 (w 0.2197 mse 0.2314 t 142 new 0.09) lr 1.00e-05 gnorm 0.046 5.69s mem 15.6GB +step 4305/5000 loss 0.0722 (w 0.0770 mse 0.0765 t 937 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4306/5000 loss 0.0906 (w 0.0786 mse 0.0757 t 807 new 0.20) lr 1.00e-05 gnorm 0.054 5.72s mem 15.6GB +step 4307/5000 loss 0.0695 (w 0.0619 mse 0.0608 t 737 new 0.11) lr 1.00e-05 gnorm 0.060 5.71s mem 15.6GB +step 4308/5000 loss 0.1330 (w 0.3572 mse 0.3570 t 109 new 0.23) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 4309/5000 loss 0.1128 (w 0.0321 mse 0.0326 t 735 new 0.21) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 4310/5000 loss 0.0933 (w 0.5878 mse 0.6308 t 25 new 0.30) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +step 4311/5000 loss 0.1260 (w 0.0584 mse 0.0529 t 509 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4312/5000 loss 0.0672 (w 0.0955 mse 0.0904 t 983 new 0.22) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +step 4313/5000 loss 0.0546 (w 0.0552 mse 0.0551 t 855 new 0.27) lr 1.00e-05 gnorm 0.183 5.69s mem 15.6GB +step 4314/5000 loss 0.1068 (w 0.0893 mse 0.0847 t 384 new 0.21) lr 1.00e-05 gnorm 0.066 5.73s mem 15.6GB +step 4315/5000 loss 0.1189 (w 0.1232 mse 0.1210 t 962 new 0.25) lr 1.00e-05 gnorm 0.085 5.71s mem 15.6GB +step 4316/5000 loss 0.0770 (w 0.0462 mse 0.0466 t 877 new 0.10) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4317/5000 loss 0.0808 (w 0.1635 mse 0.1676 t 232 new 0.25) lr 1.00e-05 gnorm 0.060 5.93s mem 15.6GB +step 4318/5000 loss 0.1139 (w 0.1591 mse 0.1573 t 981 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4319/5000 loss 0.1127 (w 0.1252 mse 0.1201 t 980 new 0.28) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 4320/5000 loss 0.0714 (w 0.0373 mse 0.0384 t 823 new 0.20) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +step 4321/5000 loss 0.1006 (w 0.0923 mse 0.0837 t 898 new 0.22) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4322/5000 loss 0.0606 (w 0.0431 mse 0.0413 t 591 new 0.17) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 4323/5000 loss 0.1351 (w 0.0924 mse 0.0920 t 434 new 0.18) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 4324/5000 loss 0.0400 (w 0.0984 mse 0.0949 t 971 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4325/5000 loss 0.0423 (w 0.0476 mse 0.0462 t 780 new 0.21) lr 1.00e-05 gnorm 0.076 6.04s mem 15.6GB +step 4326/5000 loss 0.0870 (w 0.0921 mse 0.0848 t 962 new 0.19) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 4327/5000 loss 0.0930 (w 0.0580 mse 0.0598 t 610 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4328/5000 loss 0.1179 (w 0.3256 mse 0.2967 t 998 new 0.24) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4329/5000 loss 0.0959 (w 0.0881 mse 0.0819 t 950 new 0.16) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 4330/5000 loss 0.0852 (w 0.0709 mse 0.0661 t 871 new 0.23) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +step 4331/5000 loss 0.1054 (w 0.2155 mse 0.1949 t 1000 new 0.23) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4332/5000 loss 0.1008 (w 0.4554 mse 0.4508 t 62 new 0.22) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4333/5000 loss 0.0679 (w 0.2136 mse 0.2138 t 984 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4334/5000 loss 0.1001 (w 0.0448 mse 0.0502 t 865 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4335/5000 loss 0.0489 (w 0.1151 mse 0.1076 t 915 new 0.21) lr 1.00e-05 gnorm 0.072 5.94s mem 15.6GB +step 4336/5000 loss 0.0749 (w 0.1845 mse 0.1887 t 993 new 0.18) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +step 4337/5000 loss 0.0836 (w 0.0996 mse 0.0957 t 495 new 0.27) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4338/5000 loss 0.0805 (w 0.0466 mse 0.0465 t 797 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 4339/5000 loss 0.0853 (w 0.1265 mse 0.1127 t 947 new 0.23) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4340/5000 loss 0.0825 (w 0.0449 mse 0.0503 t 966 new 0.14) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +step 4341/5000 loss 0.0567 (w 0.0634 mse 0.0634 t 660 new 0.18) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4342/5000 loss 0.1000 (w 0.3560 mse 0.3523 t 105 new 0.23) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 4343/5000 loss 0.0678 (w 0.0921 mse 0.0863 t 914 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4344/5000 loss 0.1179 (w 0.0901 mse 0.0824 t 812 new 0.21) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 4345/5000 loss 0.0695 (w 0.1476 mse 0.1407 t 977 new 0.27) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4346/5000 loss 0.1036 (w 0.0901 mse 0.0859 t 895 new 0.20) lr 1.00e-05 gnorm 0.082 5.81s mem 15.6GB +step 4347/5000 loss 0.0848 (w 0.0870 mse 0.0802 t 964 new 0.17) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 4348/5000 loss 0.0760 (w 0.0554 mse 0.0547 t 911 new 0.18) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 4349/5000 loss 0.0723 (w 0.1901 mse 0.1797 t 995 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4350/5000 loss 0.1440 (w 0.0926 mse 0.0955 t 349 new 0.25) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 4351/5000 loss 0.1302 (w 0.1102 mse 0.1073 t 612 new 0.11) lr 1.00e-05 gnorm 0.077 5.91s mem 15.6GB +step 4352/5000 loss 0.0700 (w 0.0807 mse 0.0772 t 751 new 0.17) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 4353/5000 loss 0.0738 (w 0.0936 mse 0.0898 t 934 new 0.18) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4354/5000 loss 0.1201 (w 0.1076 mse 0.1060 t 476 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 4355/5000 loss 0.0745 (w 0.1466 mse 0.1358 t 965 new 0.29) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +step 4356/5000 loss 0.0645 (w 0.0883 mse 0.0816 t 897 new 0.24) lr 1.00e-05 gnorm 0.065 5.82s mem 15.6GB +step 4357/5000 loss 0.0533 (w 0.0386 mse 0.0366 t 794 new 0.17) lr 1.00e-05 gnorm 0.051 5.80s mem 15.6GB +step 4358/5000 loss 0.1489 (w 0.0958 mse 0.0920 t 425 new 0.20) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4359/5000 loss 0.0658 (w 0.0798 mse 0.0752 t 636 new 0.29) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 4360/5000 loss 0.0716 (w 0.0940 mse 0.0857 t 952 new 0.15) lr 1.00e-05 gnorm 0.055 5.73s mem 15.6GB +step 4361/5000 loss 0.0791 (w 0.1203 mse 0.1309 t 995 new 0.12) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4362/5000 loss 0.0823 (w 0.0663 mse 0.0687 t 959 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4363/5000 loss 0.0947 (w 0.0905 mse 0.0887 t 894 new 0.21) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4364/5000 loss 0.0492 (w 0.1167 mse 0.1006 t 916 new 0.21) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 4365/5000 loss 0.0851 (w 0.1722 mse 0.1654 t 309 new 0.21) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4366/5000 loss 0.0609 (w 0.1017 mse 0.0883 t 898 new 0.24) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +step 4367/5000 loss 0.0959 (w 0.1100 mse 0.1011 t 930 new 0.24) lr 1.00e-05 gnorm 0.059 5.87s mem 15.6GB +step 4368/5000 loss 0.1155 (w 0.0643 mse 0.0634 t 600 new 0.24) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 4369/5000 loss 0.1626 (w 0.1310 mse 0.1306 t 280 new 0.21) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4370/5000 loss 0.1097 (w 0.0958 mse 0.0954 t 563 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4371/5000 loss 0.0872 (w 0.0930 mse 0.0886 t 829 new 0.20) lr 1.00e-05 gnorm 0.064 5.95s mem 15.6GB +step 4372/5000 loss 0.0769 (w 0.0532 mse 0.0509 t 737 new 0.29) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +step 4373/5000 loss 0.1190 (w 0.0928 mse 0.0815 t 815 new 0.30) lr 1.00e-05 gnorm 0.062 5.92s mem 15.6GB +step 4374/5000 loss 0.0915 (w 0.0621 mse 0.0618 t 432 new 0.28) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4375/5000 loss 0.0482 (w 0.0726 mse 0.0643 t 751 new 0.26) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 4376/5000 loss 0.0811 (w 0.0671 mse 0.0676 t 858 new 0.18) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 4377/5000 loss 0.0575 (w 0.2490 mse 0.2353 t 990 new 0.29) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4378/5000 loss 0.0615 (w 0.0303 mse 0.0287 t 651 new 0.23) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4379/5000 loss 0.0962 (w 0.1158 mse 0.1109 t 930 new 0.16) lr 1.00e-05 gnorm 0.057 5.85s mem 15.6GB +step 4380/5000 loss 0.0536 (w 0.0590 mse 0.0610 t 935 new 0.11) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 4381/5000 loss 0.0663 (w 0.0589 mse 0.0585 t 607 new 0.22) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4382/5000 loss 0.0931 (w 0.0626 mse 0.0591 t 859 new 0.25) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4383/5000 loss 0.0617 (w 0.1922 mse 0.1849 t 985 new 0.22) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4384/5000 loss 0.0905 (w 0.1058 mse 0.0994 t 928 new 0.18) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4385/5000 loss 0.1131 (w 0.0701 mse 0.0656 t 756 new 0.25) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 4386/5000 loss 0.0623 (w 0.0697 mse 0.0628 t 811 new 0.17) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4387/5000 loss 0.0670 (w 0.0476 mse 0.0516 t 983 new 0.11) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4388/5000 loss 0.0829 (w 0.1952 mse 0.1938 t 989 new 0.24) lr 1.00e-05 gnorm 0.061 5.79s mem 15.6GB +step 4389/5000 loss 0.1012 (w 0.1562 mse 0.1438 t 953 new 0.20) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4390/5000 loss 0.0768 (w 0.1833 mse 0.1597 t 977 new 0.30) lr 1.00e-05 gnorm 0.072 5.74s mem 15.6GB +step 4391/5000 loss 0.0953 (w 0.0668 mse 0.0665 t 986 new 0.12) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 4392/5000 loss 0.0374 (w 0.0939 mse 0.0861 t 851 new 0.24) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 4393/5000 loss 0.0701 (w 0.0353 mse 0.0368 t 629 new 0.08) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4394/5000 loss 0.1247 (w 0.0467 mse 0.0491 t 884 new 0.24) lr 1.00e-05 gnorm 0.078 5.91s mem 15.6GB +step 4395/5000 loss 0.0533 (w 0.0887 mse 0.0797 t 904 new 0.24) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +step 4396/5000 loss 0.1034 (w 0.1481 mse 0.1427 t 297 new 0.23) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +step 4397/5000 loss 0.0556 (w 0.1128 mse 0.1137 t 878 new 0.18) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 4398/5000 loss 0.0884 (w 0.0876 mse 0.0815 t 932 new 0.22) lr 1.00e-05 gnorm 0.056 5.89s mem 15.6GB +step 4399/5000 loss 0.0790 (w 0.0887 mse 0.0870 t 581 new 0.18) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 4400/5000 loss 0.1138 (w 0.6590 mse 0.6667 t 62 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4401/5000 loss 0.0985 (w 0.0907 mse 0.0901 t 314 new 0.12) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 4402/5000 loss 0.0986 (w 0.0791 mse 0.0731 t 631 new 0.26) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 4403/5000 loss 0.0762 (w 0.0479 mse 0.0482 t 766 new 0.14) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 4404/5000 loss 0.0847 (w 0.0554 mse 0.0483 t 907 new 0.18) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4405/5000 loss 0.0668 (w 0.1408 mse 0.1319 t 966 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4406/5000 loss 0.0840 (w 0.0845 mse 0.0819 t 661 new 0.27) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4407/5000 loss 0.1289 (w 0.0884 mse 0.0860 t 893 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 4408/5000 loss 0.1025 (w 0.0463 mse 0.0442 t 792 new 0.18) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4409/5000 loss 0.1086 (w 0.0668 mse 0.0653 t 931 new 0.13) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4410/5000 loss 0.0948 (w 0.0609 mse 0.0568 t 788 new 0.26) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4411/5000 loss 0.0952 (w 0.0354 mse 0.0371 t 888 new 0.13) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 4412/5000 loss 0.1201 (w 0.0989 mse 0.1019 t 520 new 0.20) lr 1.00e-05 gnorm 0.059 5.73s mem 15.6GB +step 4413/5000 loss 0.0774 (w 0.2300 mse 0.2298 t 138 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4414/5000 loss 0.0933 (w 0.2070 mse 0.2123 t 161 new 0.14) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4415/5000 loss 0.0580 (w 0.1293 mse 0.1306 t 940 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 4416/5000 loss 0.0777 (w 0.0689 mse 0.0659 t 604 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4417/5000 loss 0.1419 (w 0.0774 mse 0.0804 t 677 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4418/5000 loss 0.1161 (w 0.1898 mse 0.1722 t 985 new 0.27) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 4419/5000 loss 0.1319 (w 0.0974 mse 0.0966 t 421 new 0.28) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4420/5000 loss 0.1037 (w 0.0790 mse 0.0769 t 866 new 0.15) lr 1.00e-05 gnorm 0.078 5.90s mem 15.6GB +step 4421/5000 loss 0.0602 (w 0.0472 mse 0.0496 t 873 new 0.23) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 4422/5000 loss 0.0841 (w 0.0806 mse 0.0731 t 625 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4423/5000 loss 0.0956 (w 0.0588 mse 0.0599 t 607 new 0.17) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4424/5000 loss 0.0903 (w 0.0785 mse 0.0756 t 638 new 0.21) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 4425/5000 loss 0.0754 (w 0.1166 mse 0.1133 t 966 new 0.17) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +step 4426/5000 loss 0.1146 (w 0.1172 mse 0.1151 t 283 new 0.14) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4427/5000 loss 0.1020 (w 0.0802 mse 0.0763 t 497 new 0.18) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 4428/5000 loss 0.0865 (w 0.0973 mse 0.1107 t 994 new 0.22) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +step 4429/5000 loss 0.0985 (w 0.0803 mse 0.0745 t 958 new 0.24) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 4430/5000 loss 0.0804 (w 0.0816 mse 0.0809 t 680 new 0.18) lr 1.00e-05 gnorm 0.097 5.68s mem 15.6GB +step 4431/5000 loss 0.0683 (w 0.1129 mse 0.1062 t 982 new 0.25) lr 1.00e-05 gnorm 0.065 5.92s mem 15.6GB +step 4432/5000 loss 0.0661 (w 0.0964 mse 0.0912 t 862 new 0.24) lr 1.00e-05 gnorm 0.063 5.87s mem 15.6GB +step 4433/5000 loss 0.0920 (w 0.0598 mse 0.0601 t 855 new 0.13) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 4434/5000 loss 0.0524 (w 0.0695 mse 0.0693 t 784 new 0.24) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 4435/5000 loss 0.1199 (w 0.0985 mse 0.0987 t 619 new 0.15) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 4436/5000 loss 0.1354 (w 0.0723 mse 0.0701 t 596 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 4437/5000 loss 0.0810 (w 0.3850 mse 0.2952 t 994 new 0.24) lr 1.00e-05 gnorm 0.072 5.73s mem 15.6GB +step 4438/5000 loss 0.0933 (w 0.0634 mse 0.0621 t 903 new 0.25) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 4439/5000 loss 0.0835 (w 0.1015 mse 0.0943 t 711 new 0.25) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 4440/5000 loss 0.1269 (w 0.1731 mse 0.1736 t 176 new 0.09) lr 1.00e-05 gnorm 0.052 5.71s mem 15.6GB +step 4441/5000 loss 0.0574 (w 0.0626 mse 0.0572 t 643 new 0.24) lr 1.00e-05 gnorm 0.066 5.89s mem 15.6GB +step 4442/5000 loss 0.0617 (w 0.0842 mse 0.0832 t 410 new 0.10) lr 1.00e-05 gnorm 0.056 5.81s mem 15.6GB +step 4443/5000 loss 0.0575 (w 0.0505 mse 0.0506 t 678 new 0.10) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 4444/5000 loss 0.0858 (w 0.0609 mse 0.0588 t 873 new 0.20) lr 1.00e-05 gnorm 0.053 5.86s mem 15.6GB +step 4445/5000 loss 0.0860 (w 0.1242 mse 0.1225 t 981 new 0.24) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 4446/5000 loss 0.0748 (w 0.1211 mse 0.1111 t 958 new 0.29) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +step 4447/5000 loss 0.0883 (w 0.0618 mse 0.0625 t 680 new 0.20) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 4448/5000 loss 0.0440 (w 0.0804 mse 0.0780 t 874 new 0.16) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 4449/5000 loss 0.1138 (w 0.1483 mse 0.1341 t 964 new 0.25) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 4450/5000 loss 0.0662 (w 0.0907 mse 0.0905 t 923 new 0.16) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4451/5000 loss 0.0947 (w 0.0951 mse 0.0861 t 848 new 0.25) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 4452/5000 loss 0.0942 (w 0.1028 mse 0.0977 t 900 new 0.24) lr 1.00e-05 gnorm 0.054 5.95s mem 15.6GB +step 4453/5000 loss 0.0814 (w 0.0567 mse 0.0547 t 804 new 0.29) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +step 4454/5000 loss 0.1032 (w 0.3286 mse 0.3273 t 93 new 0.25) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 4455/5000 loss 0.1142 (w 0.0606 mse 0.0588 t 513 new 0.11) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4456/5000 loss 0.0692 (w 0.0549 mse 0.0498 t 734 new 0.26) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 4457/5000 loss 0.1103 (w 0.1002 mse 0.0989 t 744 new 0.19) lr 1.00e-05 gnorm 0.076 5.71s mem 15.6GB +step 4458/5000 loss 0.0547 (w 0.0883 mse 0.0818 t 668 new 0.21) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +step 4459/5000 loss 0.0898 (w 0.1646 mse 0.1482 t 972 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4460/5000 loss 0.0786 (w 0.0432 mse 0.0414 t 793 new 0.13) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +step 4461/5000 loss 0.0819 (w 0.1097 mse 0.1056 t 942 new 0.26) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 4462/5000 loss 0.0759 (w 0.0746 mse 0.0673 t 834 new 0.21) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4463/5000 loss 0.0588 (w 0.1074 mse 0.0984 t 942 new 0.25) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 4464/5000 loss 0.0943 (w 0.0949 mse 0.0850 t 868 new 0.26) lr 1.00e-05 gnorm 0.105 5.69s mem 15.6GB +step 4465/5000 loss 0.0887 (w 0.0799 mse 0.0762 t 891 new 0.21) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 4466/5000 loss 0.1146 (w 0.1968 mse 0.2016 t 161 new 0.14) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4467/5000 loss 0.1035 (w 0.0613 mse 0.0602 t 809 new 0.13) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4468/5000 loss 0.0880 (w 0.0673 mse 0.0682 t 771 new 0.12) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4469/5000 loss 0.0419 (w 0.0578 mse 0.0517 t 953 new 0.24) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +step 4470/5000 loss 0.0798 (w 0.0631 mse 0.0611 t 612 new 0.25) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 4471/5000 loss 0.0452 (w 0.0352 mse 0.0339 t 480 new 0.22) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4472/5000 loss 0.0856 (w 0.0665 mse 0.0650 t 638 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4473/5000 loss 0.1061 (w 0.0599 mse 0.0534 t 722 new 0.20) lr 1.00e-05 gnorm 0.064 5.95s mem 15.6GB +step 4474/5000 loss 0.0867 (w 0.0547 mse 0.0550 t 791 new 0.26) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4475/5000 loss 0.1525 (w 0.1691 mse 0.1589 t 300 new 0.23) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 4476/5000 loss 0.0942 (w 0.1417 mse 0.1353 t 935 new 0.17) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4477/5000 loss 0.0658 (w 0.0643 mse 0.0642 t 955 new 0.27) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4478/5000 loss 0.1270 (w 0.0799 mse 0.0804 t 449 new 0.19) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4479/5000 loss 0.0662 (w 0.0758 mse 0.0687 t 900 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4480/5000 loss 0.1149 (w 0.0617 mse 0.0595 t 670 new 0.26) lr 1.00e-05 gnorm 0.047 5.70s mem 15.6GB +step 4481/5000 loss 0.0736 (w 0.0937 mse 0.0847 t 918 new 0.23) lr 1.00e-05 gnorm 0.055 6.87s mem 15.6GB +step 4482/5000 loss 0.0598 (w 0.0740 mse 0.0686 t 938 new 0.09) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4483/5000 loss 0.0728 (w 0.1257 mse 0.1177 t 857 new 0.21) lr 1.00e-05 gnorm 0.054 5.92s mem 15.6GB +step 4484/5000 loss 0.0741 (w 0.0487 mse 0.0535 t 906 new 0.20) lr 1.00e-05 gnorm 0.058 5.80s mem 15.6GB +step 4485/5000 loss 0.1100 (w 0.0489 mse 0.0461 t 777 new 0.14) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4486/5000 loss 0.0706 (w 0.0522 mse 0.0510 t 581 new 0.13) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 4487/5000 loss 0.1111 (w 0.2537 mse 0.2497 t 208 new 0.25) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 4488/5000 loss 0.1077 (w 0.1073 mse 0.1052 t 823 new 0.23) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 4489/5000 loss 0.0939 (w 0.7648 mse 0.8156 t 15 new 0.12) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 4490/5000 loss 0.1173 (w 0.0885 mse 0.0902 t 988 new 0.14) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 4491/5000 loss 0.0466 (w 0.0495 mse 0.0518 t 862 new 0.24) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4492/5000 loss 0.0810 (w 0.1135 mse 0.1131 t 453 new 0.25) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 4493/5000 loss 0.0547 (w 0.0770 mse 0.0724 t 898 new 0.27) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 4494/5000 loss 0.0679 (w 0.0674 mse 0.0674 t 648 new 0.25) lr 1.00e-05 gnorm 0.058 5.89s mem 15.6GB +step 4495/5000 loss 0.1365 (w 0.0747 mse 0.0717 t 967 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 4496/5000 loss 0.0672 (w 0.0610 mse 0.0630 t 595 new 0.26) lr 1.00e-05 gnorm 0.054 5.73s mem 15.6GB +step 4497/5000 loss 0.1232 (w 0.0878 mse 0.0848 t 931 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4498/5000 loss 0.0826 (w 0.0579 mse 0.0557 t 940 new 0.16) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4499/5000 loss 0.0665 (w 0.0694 mse 0.0670 t 516 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 4500/5000 loss 0.1223 (w 0.1572 mse 0.1499 t 994 new 0.19) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[val] step 4500 t=201: w=0.1734 mse=0.1758 (n=16) t=501: w=0.0717 mse=0.0716 (n=16) t=800: w=0.0598 mse=0.0586 (n=16) | mean w=0.1016 mse=0.1020 4s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step4500.safetensors 832 个张量 2.87 GB +step 4501/5000 loss 0.0734 (w 0.0900 mse 0.0879 t 752 new 0.23) lr 1.00e-05 gnorm 0.055 5.81s mem 15.6GB +step 4502/5000 loss 0.0395 (w 0.0461 mse 0.0457 t 807 new 0.25) lr 1.00e-05 gnorm 0.054 5.71s mem 15.6GB +step 4503/5000 loss 0.0794 (w 0.0254 mse 0.0250 t 727 new 0.15) lr 1.00e-05 gnorm 0.045 5.71s mem 15.6GB +step 4504/5000 loss 0.0716 (w 0.5968 mse 0.6065 t 34 new 0.17) lr 1.00e-05 gnorm 0.064 5.91s mem 15.6GB +step 4505/5000 loss 0.1267 (w 0.0879 mse 0.0823 t 599 new 0.16) lr 1.00e-05 gnorm 0.055 5.92s mem 15.6GB +step 4506/5000 loss 0.0884 (w 0.0667 mse 0.0680 t 617 new 0.26) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +step 4507/5000 loss 0.0538 (w 0.0848 mse 0.0861 t 956 new 0.21) lr 1.00e-05 gnorm 0.057 6.07s mem 15.6GB +step 4508/5000 loss 0.0896 (w 0.1247 mse 0.1256 t 229 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 4509/5000 loss 0.0628 (w 0.0731 mse 0.0669 t 902 new 0.22) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4510/5000 loss 0.0694 (w 0.0635 mse 0.0648 t 886 new 0.23) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4511/5000 loss 0.0810 (w 0.0450 mse 0.0456 t 904 new 0.09) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +step 4512/5000 loss 0.0453 (w 0.0912 mse 0.0909 t 706 new 0.18) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4513/5000 loss 0.0799 (w 0.0607 mse 0.0611 t 897 new 0.26) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 4514/5000 loss 0.0932 (w 0.1342 mse 0.1286 t 882 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4515/5000 loss 0.1186 (w 0.1366 mse 0.1218 t 938 new 0.26) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 4516/5000 loss 0.0864 (w 0.2031 mse 0.1842 t 991 new 0.25) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 4517/5000 loss 0.0867 (w 0.1155 mse 0.1106 t 977 new 0.24) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 4518/5000 loss 0.1046 (w 0.1523 mse 0.1410 t 973 new 0.24) lr 1.00e-05 gnorm 0.069 5.90s mem 15.6GB +step 4519/5000 loss 0.0763 (w 0.1200 mse 0.1140 t 992 new 0.23) lr 1.00e-05 gnorm 0.133 5.68s mem 15.6GB +step 4520/5000 loss 0.0726 (w 0.1217 mse 0.1096 t 920 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4521/5000 loss 0.0830 (w 0.0628 mse 0.0637 t 950 new 0.20) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 4522/5000 loss 0.0519 (w 0.1284 mse 0.1310 t 992 new 0.16) lr 1.00e-05 gnorm 0.075 5.82s mem 15.6GB +step 4523/5000 loss 0.0803 (w 0.6399 mse 0.6352 t 43 new 0.22) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 4524/5000 loss 0.0437 (w 0.1504 mse 0.1490 t 989 new 0.27) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4525/5000 loss 0.0701 (w 0.1278 mse 0.1208 t 961 new 0.23) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +step 4526/5000 loss 0.0491 (w 0.0943 mse 0.0947 t 965 new 0.24) lr 1.00e-05 gnorm 0.064 5.89s mem 15.6GB +step 4527/5000 loss 0.0936 (w 0.1457 mse 0.1349 t 966 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4528/5000 loss 0.0992 (w 0.1379 mse 0.1435 t 552 new 0.21) lr 1.00e-05 gnorm 0.057 6.03s mem 15.6GB +step 4529/5000 loss 0.0884 (w 0.0548 mse 0.0494 t 923 new 0.17) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4530/5000 loss 0.0844 (w 0.0809 mse 0.0772 t 860 new 0.18) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 4531/5000 loss 0.0730 (w 0.0762 mse 0.0805 t 980 new 0.25) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 4532/5000 loss 0.1177 (w 0.1068 mse 0.0974 t 894 new 0.30) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 4533/5000 loss 0.1182 (w 0.0674 mse 0.0654 t 660 new 0.25) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4534/5000 loss 0.0877 (w 0.0761 mse 0.0719 t 936 new 0.12) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4535/5000 loss 0.1238 (w 0.0552 mse 0.0560 t 906 new 0.16) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4536/5000 loss 0.0867 (w 0.1814 mse 0.1784 t 208 new 0.27) lr 1.00e-05 gnorm 0.056 5.82s mem 15.6GB +step 4537/5000 loss 0.0545 (w 0.1215 mse 0.1101 t 993 new 0.21) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4538/5000 loss 0.0810 (w 0.2099 mse 0.2133 t 169 new 0.25) lr 1.00e-05 gnorm 0.060 5.74s mem 15.6GB +step 4539/5000 loss 0.0723 (w 0.1532 mse 0.1456 t 979 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 4540/5000 loss 0.0974 (w 0.0844 mse 0.0808 t 843 new 0.09) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4541/5000 loss 0.1303 (w 0.0639 mse 0.0606 t 748 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4542/5000 loss 0.0963 (w 0.1144 mse 0.1107 t 617 new 0.29) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 4543/5000 loss 0.1024 (w 0.0294 mse 0.0287 t 593 new 0.28) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +step 4544/5000 loss 0.0723 (w 0.0807 mse 0.0720 t 914 new 0.24) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +step 4545/5000 loss 0.0380 (w 0.0685 mse 0.0666 t 866 new 0.30) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +step 4546/5000 loss 0.0572 (w 0.0594 mse 0.0594 t 878 new 0.26) lr 1.00e-05 gnorm 0.063 5.89s mem 15.6GB +step 4547/5000 loss 0.0879 (w 0.0567 mse 0.0558 t 863 new 0.24) lr 1.00e-05 gnorm 0.070 5.93s mem 15.6GB +step 4548/5000 loss 0.1197 (w 0.1376 mse 0.1308 t 960 new 0.23) lr 1.00e-05 gnorm 0.060 5.74s mem 15.6GB +step 4549/5000 loss 0.0555 (w 0.0802 mse 0.0840 t 905 new 0.24) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 4550/5000 loss 0.0475 (w 0.1186 mse 0.1244 t 896 new 0.21) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4551/5000 loss 0.1170 (w 0.1480 mse 0.1477 t 463 new 0.19) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 4552/5000 loss 0.0918 (w 0.0853 mse 0.0812 t 508 new 0.26) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 4553/5000 loss 0.1012 (w 0.0676 mse 0.0620 t 846 new 0.22) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 4554/5000 loss 0.1095 (w 0.0836 mse 0.0829 t 651 new 0.29) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 4555/5000 loss 0.0677 (w 0.0877 mse 0.0838 t 943 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4556/5000 loss 0.1181 (w 0.1041 mse 0.0999 t 948 new 0.21) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4557/5000 loss 0.0900 (w 0.5239 mse 0.5254 t 57 new 0.11) lr 1.00e-05 gnorm 0.064 5.71s mem 15.6GB +step 4558/5000 loss 0.0867 (w 0.1824 mse 0.1810 t 235 new 0.24) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4559/5000 loss 0.1152 (w 0.2533 mse 0.2579 t 71 new 0.26) lr 1.00e-05 gnorm 0.051 5.93s mem 15.6GB +step 4560/5000 loss 0.0602 (w 0.1792 mse 0.1755 t 986 new 0.21) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 4561/5000 loss 0.1080 (w 0.0953 mse 0.0873 t 591 new 0.22) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4562/5000 loss 0.0764 (w 0.0490 mse 0.0494 t 779 new 0.24) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +step 4563/5000 loss 0.0869 (w 0.0777 mse 0.0708 t 730 new 0.26) lr 1.00e-05 gnorm 0.055 5.90s mem 15.6GB +step 4564/5000 loss 0.1220 (w 0.0386 mse 0.0377 t 701 new 0.09) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4565/5000 loss 0.0735 (w 0.0719 mse 0.0686 t 744 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 4566/5000 loss 0.0479 (w 0.0580 mse 0.0579 t 937 new 0.15) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 4567/5000 loss 0.1302 (w 0.0727 mse 0.0703 t 625 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 4568/5000 loss 0.0691 (w 0.0975 mse 0.0898 t 961 new 0.13) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 4569/5000 loss 0.0806 (w 0.0669 mse 0.0656 t 874 new 0.25) lr 1.00e-05 gnorm 0.059 5.74s mem 15.6GB +step 4570/5000 loss 0.0732 (w 0.0990 mse 0.0913 t 872 new 0.26) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4571/5000 loss 0.0404 (w 0.1620 mse 0.1567 t 992 new 0.25) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 4572/5000 loss 0.0869 (w 0.0665 mse 0.0602 t 843 new 0.19) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4573/5000 loss 0.0969 (w 0.0696 mse 0.0665 t 822 new 0.18) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 4574/5000 loss 0.0820 (w 0.0590 mse 0.0562 t 802 new 0.15) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 4575/5000 loss 0.1177 (w 0.0810 mse 0.0771 t 488 new 0.20) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 4576/5000 loss 0.0988 (w 0.0954 mse 0.0890 t 602 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 4577/5000 loss 0.1071 (w 0.0349 mse 0.0334 t 629 new 0.15) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4578/5000 loss 0.0886 (w 0.0770 mse 0.0702 t 875 new 0.17) lr 1.00e-05 gnorm 0.055 5.93s mem 15.6GB +step 4579/5000 loss 0.0821 (w 0.0982 mse 0.1107 t 276 new 0.19) lr 1.00e-05 gnorm 0.055 5.71s mem 15.6GB +step 4580/5000 loss 0.0562 (w 0.1059 mse 0.0997 t 855 new 0.18) lr 1.00e-05 gnorm 0.064 5.74s mem 15.6GB +step 4581/5000 loss 0.0583 (w 0.0798 mse 0.0788 t 919 new 0.25) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 4582/5000 loss 0.0584 (w 0.0836 mse 0.0826 t 850 new 0.21) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +step 4583/5000 loss 0.1239 (w 0.0433 mse 0.0440 t 729 new 0.19) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4584/5000 loss 0.0850 (w 0.1004 mse 0.0870 t 922 new 0.22) lr 1.00e-05 gnorm 0.070 5.92s mem 15.6GB +step 4585/5000 loss 0.0597 (w 0.0619 mse 0.0621 t 700 new 0.29) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4586/5000 loss 0.0789 (w 0.0654 mse 0.0619 t 598 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4587/5000 loss 0.0441 (w 0.1344 mse 0.1262 t 1000 new 0.21) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 4588/5000 loss 0.0846 (w 0.0874 mse 0.0877 t 355 new 0.21) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 4589/5000 loss 0.1063 (w 0.0586 mse 0.0586 t 930 new 0.20) lr 1.00e-05 gnorm 0.071 5.91s mem 15.6GB +step 4590/5000 loss 0.0764 (w 0.1001 mse 0.0967 t 545 new 0.26) lr 1.00e-05 gnorm 0.082 5.89s mem 15.6GB +step 4591/5000 loss 0.0707 (w 0.0565 mse 0.0557 t 698 new 0.24) lr 1.00e-05 gnorm 0.064 5.76s mem 15.6GB +step 4592/5000 loss 0.0740 (w 0.0830 mse 0.0832 t 715 new 0.23) lr 1.00e-05 gnorm 0.068 5.91s mem 15.6GB +step 4593/5000 loss 0.1520 (w 0.0693 mse 0.0652 t 865 new 0.25) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 4594/5000 loss 0.0960 (w 0.1061 mse 0.1041 t 414 new 0.25) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 4595/5000 loss 0.1202 (w 0.1433 mse 0.1328 t 963 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4596/5000 loss 0.1084 (w 0.0167 mse 0.0168 t 881 new 0.16) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4597/5000 loss 0.0784 (w 0.0742 mse 0.0750 t 914 new 0.26) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 4598/5000 loss 0.1164 (w 0.2576 mse 0.2534 t 150 new 0.07) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4599/5000 loss 0.0837 (w 0.0525 mse 0.0543 t 896 new 0.23) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 4600/5000 loss 0.0741 (w 0.2148 mse 0.2044 t 996 new 0.25) lr 1.00e-05 gnorm 0.066 5.74s mem 15.6GB +step 4601/5000 loss 0.1130 (w 0.1451 mse 0.1380 t 252 new 0.24) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 4602/5000 loss 0.1125 (w 0.1529 mse 0.1548 t 336 new 0.19) lr 1.00e-05 gnorm 0.071 5.75s mem 15.6GB +step 4603/5000 loss 0.0576 (w 0.0795 mse 0.0793 t 925 new 0.24) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +step 4604/5000 loss 0.0432 (w 0.1499 mse 0.1474 t 958 new 0.16) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4605/5000 loss 0.0921 (w 0.2106 mse 0.2124 t 172 new 0.22) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 4606/5000 loss 0.0636 (w 0.0600 mse 0.0577 t 904 new 0.24) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 4607/5000 loss 0.0649 (w 0.0886 mse 0.0777 t 665 new 0.26) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 4608/5000 loss 0.0923 (w 0.1207 mse 0.1152 t 584 new 0.25) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 4609/5000 loss 0.0404 (w 0.0850 mse 0.0809 t 902 new 0.13) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +step 4610/5000 loss 0.0656 (w 0.1114 mse 0.1042 t 964 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4611/5000 loss 0.0790 (w 0.0307 mse 0.0360 t 382 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4612/5000 loss 0.0735 (w 0.0524 mse 0.0520 t 591 new 0.29) lr 1.00e-05 gnorm 0.078 5.76s mem 15.6GB +step 4613/5000 loss 0.0942 (w 0.0974 mse 0.0893 t 853 new 0.24) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 4614/5000 loss 0.0830 (w 0.0947 mse 0.0916 t 449 new 0.24) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +step 4615/5000 loss 0.0686 (w 0.0976 mse 0.0879 t 913 new 0.27) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 4616/5000 loss 0.0890 (w 0.3555 mse 0.3745 t 71 new 0.13) lr 1.00e-05 gnorm 0.061 5.72s mem 15.6GB +step 4617/5000 loss 0.0630 (w 0.0844 mse 0.0821 t 389 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4618/5000 loss 0.0955 (w 0.0720 mse 0.0696 t 920 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4619/5000 loss 0.0980 (w 0.0917 mse 0.0959 t 445 new 0.24) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +step 4620/5000 loss 0.0943 (w 0.0805 mse 0.0734 t 748 new 0.24) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4621/5000 loss 0.1236 (w 0.0870 mse 0.0864 t 744 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4622/5000 loss 0.0617 (w 0.0889 mse 0.0826 t 732 new 0.19) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 4623/5000 loss 0.1340 (w 0.0458 mse 0.0468 t 707 new 0.19) lr 1.00e-05 gnorm 0.079 5.74s mem 15.6GB +step 4624/5000 loss 0.1006 (w 0.0479 mse 0.0461 t 852 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4625/5000 loss 0.0672 (w 0.0986 mse 0.0951 t 987 new 0.24) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 4626/5000 loss 0.1054 (w 0.0498 mse 0.0465 t 747 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4627/5000 loss 0.1004 (w 0.1015 mse 0.1110 t 998 new 0.23) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 4628/5000 loss 0.0923 (w 0.0580 mse 0.0614 t 928 new 0.20) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4629/5000 loss 0.1212 (w 0.1284 mse 0.1239 t 654 new 0.32) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4630/5000 loss 0.0638 (w 0.0419 mse 0.0423 t 557 new 0.24) lr 1.00e-05 gnorm 0.063 5.81s mem 15.6GB +step 4631/5000 loss 0.0792 (w 0.1051 mse 0.0998 t 982 new 0.19) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 4632/5000 loss 0.0829 (w 0.1156 mse 0.1068 t 869 new 0.18) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4633/5000 loss 0.0681 (w 0.1011 mse 0.0957 t 957 new 0.21) lr 1.00e-05 gnorm 0.065 5.76s mem 15.6GB +step 4634/5000 loss 0.1240 (w 0.0761 mse 0.0758 t 626 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4635/5000 loss 0.0515 (w 0.0520 mse 0.0535 t 902 new 0.17) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 4636/5000 loss 0.0687 (w 0.0571 mse 0.0565 t 818 new 0.25) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 4637/5000 loss 0.0945 (w 0.0301 mse 0.0331 t 918 new 0.12) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4638/5000 loss 0.0688 (w 0.0824 mse 0.0831 t 465 new 0.13) lr 1.00e-05 gnorm 0.040 5.69s mem 15.6GB +step 4639/5000 loss 0.1062 (w 0.0624 mse 0.0625 t 606 new 0.21) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 4640/5000 loss 0.0600 (w 0.1847 mse 0.1786 t 995 new 0.21) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 4641/5000 loss 0.1021 (w 0.1906 mse 0.1810 t 981 new 0.22) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 4642/5000 loss 0.0692 (w 0.0608 mse 0.0593 t 889 new 0.13) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 4643/5000 loss 0.0509 (w 0.1089 mse 0.1014 t 964 new 0.22) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4644/5000 loss 0.0621 (w 0.0582 mse 0.0559 t 515 new 0.22) lr 1.00e-05 gnorm 0.059 5.79s mem 15.6GB +step 4645/5000 loss 0.0858 (w 0.0610 mse 0.0596 t 893 new 0.27) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +step 4646/5000 loss 0.0893 (w 0.1221 mse 0.1078 t 933 new 0.23) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 4647/5000 loss 0.1015 (w 0.0429 mse 0.0433 t 661 new 0.17) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 4648/5000 loss 0.1004 (w 0.0515 mse 0.0519 t 964 new 0.20) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4649/5000 loss 0.1057 (w 0.1365 mse 0.1332 t 349 new 0.28) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4650/5000 loss 0.0921 (w 0.0399 mse 0.0431 t 708 new 0.27) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4651/5000 loss 0.0745 (w 0.0785 mse 0.0803 t 790 new 0.21) lr 1.00e-05 gnorm 0.059 5.82s mem 15.6GB +step 4652/5000 loss 0.0803 (w 0.0887 mse 0.0899 t 428 new 0.21) lr 1.00e-05 gnorm 0.070 6.14s mem 15.6GB +step 4653/5000 loss 0.1366 (w 0.0810 mse 0.0787 t 581 new 0.15) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 4654/5000 loss 0.1001 (w 0.1395 mse 0.1343 t 993 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 4655/5000 loss 0.0751 (w 0.1099 mse 0.1045 t 936 new 0.21) lr 1.00e-05 gnorm 0.075 5.95s mem 15.6GB +step 4656/5000 loss 0.0866 (w 0.0729 mse 0.0716 t 475 new 0.21) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +step 4657/5000 loss 0.0849 (w 0.1104 mse 0.1073 t 877 new 0.17) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4658/5000 loss 0.0992 (w 0.1060 mse 0.0990 t 684 new 0.24) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +step 4659/5000 loss 0.0897 (w 0.2208 mse 0.2178 t 183 new 0.29) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +step 4660/5000 loss 0.1305 (w 0.9093 mse 0.9070 t 15 new 0.25) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +step 4661/5000 loss 0.0953 (w 0.0935 mse 0.0865 t 919 new 0.24) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +step 4662/5000 loss 0.0564 (w 0.0447 mse 0.0500 t 963 new 0.13) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 4663/5000 loss 0.1075 (w 0.0518 mse 0.0512 t 781 new 0.26) lr 1.00e-05 gnorm 0.062 5.75s mem 15.6GB +step 4664/5000 loss 0.0859 (w 0.2276 mse 0.2154 t 998 new 0.18) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 4665/5000 loss 0.0767 (w 0.0914 mse 0.0872 t 983 new 0.16) lr 1.00e-05 gnorm 0.050 5.71s mem 15.6GB +step 4666/5000 loss 0.0682 (w 0.1090 mse 0.1033 t 824 new 0.10) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4667/5000 loss 0.0770 (w 0.1612 mse 0.1584 t 957 new 0.25) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 4668/5000 loss 0.1039 (w 0.2354 mse 0.2333 t 180 new 0.25) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +step 4669/5000 loss 0.0903 (w 0.1086 mse 0.1038 t 978 new 0.22) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 4670/5000 loss 0.0919 (w 0.0940 mse 0.0902 t 734 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 4671/5000 loss 0.1265 (w 0.1170 mse 0.1120 t 478 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4672/5000 loss 0.0994 (w 0.0869 mse 0.0836 t 969 new 0.19) lr 1.00e-05 gnorm 0.073 5.80s mem 15.6GB +step 4673/5000 loss 0.0431 (w 0.0390 mse 0.0402 t 724 new 0.23) lr 1.00e-05 gnorm 0.052 5.93s mem 15.6GB +step 4674/5000 loss 0.1204 (w 0.1472 mse 0.1509 t 476 new 0.21) lr 1.00e-05 gnorm 0.062 5.97s mem 15.6GB +step 4675/5000 loss 0.0670 (w 0.0626 mse 0.0645 t 945 new 0.23) lr 1.00e-05 gnorm 0.059 5.72s mem 15.6GB +step 4676/5000 loss 0.0801 (w 0.1030 mse 0.1094 t 978 new 0.17) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 4677/5000 loss 0.0639 (w 0.1584 mse 0.1472 t 981 new 0.25) lr 1.00e-05 gnorm 0.054 5.71s mem 15.6GB +step 4678/5000 loss 0.0719 (w 0.0541 mse 0.0600 t 913 new 0.18) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 4679/5000 loss 0.1109 (w 0.0465 mse 0.0429 t 743 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4680/5000 loss 0.0852 (w 0.0895 mse 0.0857 t 372 new 0.18) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4681/5000 loss 0.0754 (w 0.0771 mse 0.0730 t 850 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4682/5000 loss 0.0973 (w 0.1220 mse 0.1115 t 967 new 0.25) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4683/5000 loss 0.1090 (w 0.0311 mse 0.0324 t 676 new 0.13) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 4684/5000 loss 0.0324 (w 0.1505 mse 0.1428 t 999 new 0.25) lr 1.00e-05 gnorm 0.071 5.71s mem 15.6GB +step 4685/5000 loss 0.0324 (w 0.2074 mse 0.1967 t 995 new 0.23) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 4686/5000 loss 0.1045 (w 0.0649 mse 0.0608 t 691 new 0.25) lr 1.00e-05 gnorm 0.070 5.91s mem 15.6GB +step 4687/5000 loss 0.0709 (w 0.1038 mse 0.1048 t 814 new 0.15) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 4688/5000 loss 0.0665 (w 0.0651 mse 0.0612 t 808 new 0.21) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 4689/5000 loss 0.0966 (w 0.0858 mse 0.0857 t 972 new 0.25) lr 1.00e-05 gnorm 0.050 5.68s mem 15.6GB +step 4690/5000 loss 0.0866 (w 0.1090 mse 0.1070 t 380 new 0.22) lr 1.00e-05 gnorm 0.117 5.69s mem 15.6GB +step 4691/5000 loss 0.0773 (w 0.0214 mse 0.0231 t 882 new 0.11) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4692/5000 loss 0.0715 (w 0.1052 mse 0.1048 t 954 new 0.12) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 4693/5000 loss 0.0790 (w 0.0919 mse 0.0895 t 926 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4694/5000 loss 0.1373 (w 0.0832 mse 0.0799 t 709 new 0.26) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +step 4695/5000 loss 0.0858 (w 0.0623 mse 0.0610 t 712 new 0.29) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +step 4696/5000 loss 0.1174 (w 0.0834 mse 0.0773 t 873 new 0.28) lr 1.00e-05 gnorm 0.059 5.73s mem 15.6GB +step 4697/5000 loss 0.0739 (w 0.0702 mse 0.0701 t 777 new 0.20) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 4698/5000 loss 0.0480 (w 0.0815 mse 0.0796 t 954 new 0.20) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 4699/5000 loss 0.0747 (w 0.0700 mse 0.0639 t 915 new 0.19) lr 1.00e-05 gnorm 0.103 5.69s mem 15.6GB +step 4700/5000 loss 0.0979 (w 0.1579 mse 0.1476 t 993 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4701/5000 loss 0.0980 (w 0.2906 mse 0.2922 t 114 new 0.13) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4702/5000 loss 0.1236 (w 0.0958 mse 0.0967 t 370 new 0.14) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 4703/5000 loss 0.0458 (w 0.1054 mse 0.1008 t 754 new 0.31) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 4704/5000 loss 0.0994 (w 0.4268 mse 0.4238 t 57 new 0.17) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +step 4705/5000 loss 0.0954 (w 0.1117 mse 0.1024 t 750 new 0.20) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 4706/5000 loss 0.1285 (w 0.0937 mse 0.0883 t 704 new 0.24) lr 1.00e-05 gnorm 0.072 5.71s mem 15.6GB +step 4707/5000 loss 0.0883 (w 0.1159 mse 0.1135 t 314 new 0.13) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +step 4708/5000 loss 0.0509 (w 0.0675 mse 0.0721 t 942 new 0.12) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4709/5000 loss 0.1013 (w 0.0942 mse 0.0923 t 355 new 0.22) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 4710/5000 loss 0.0773 (w 0.0572 mse 0.0540 t 800 new 0.28) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 4711/5000 loss 0.0927 (w 0.0193 mse 0.0221 t 915 new 0.15) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4712/5000 loss 0.0849 (w 0.0440 mse 0.0490 t 551 new 0.27) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4713/5000 loss 0.0662 (w 0.0647 mse 0.0575 t 798 new 0.20) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +step 4714/5000 loss 0.0602 (w 0.0635 mse 0.0610 t 619 new 0.28) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 4715/5000 loss 0.1110 (w 0.1251 mse 0.1167 t 983 new 0.22) lr 1.00e-05 gnorm 0.069 5.92s mem 15.6GB +step 4716/5000 loss 0.0774 (w 0.0900 mse 0.0831 t 790 new 0.27) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 4717/5000 loss 0.0990 (w 0.0708 mse 0.0699 t 792 new 0.13) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +step 4718/5000 loss 0.0791 (w 0.2861 mse 0.2560 t 995 new 0.23) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +step 4719/5000 loss 0.1267 (w 0.0818 mse 0.0770 t 533 new 0.23) lr 1.00e-05 gnorm 0.087 5.70s mem 15.6GB +step 4720/5000 loss 0.0880 (w 0.0767 mse 0.0766 t 457 new 0.25) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4721/5000 loss 0.1006 (w 0.0855 mse 0.0791 t 910 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4722/5000 loss 0.0912 (w 0.0855 mse 0.0833 t 954 new 0.24) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 4723/5000 loss 0.0701 (w 0.0826 mse 0.0837 t 836 new 0.24) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4724/5000 loss 0.1129 (w 0.0595 mse 0.0566 t 674 new 0.14) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4725/5000 loss 0.0900 (w 0.1028 mse 0.0985 t 902 new 0.28) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4726/5000 loss 0.0789 (w 0.1360 mse 0.1346 t 288 new 0.21) lr 1.00e-05 gnorm 0.054 5.79s mem 15.6GB +step 4727/5000 loss 0.0557 (w 0.1236 mse 0.1179 t 980 new 0.19) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +step 4728/5000 loss 0.0755 (w 0.0662 mse 0.0663 t 459 new 0.20) lr 1.00e-05 gnorm 0.063 5.81s mem 15.6GB +step 4729/5000 loss 0.0725 (w 0.2354 mse 0.2060 t 990 new 0.23) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4730/5000 loss 0.1341 (w 0.2151 mse 0.2140 t 191 new 0.20) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +step 4731/5000 loss 0.1333 (w 0.2316 mse 0.2293 t 183 new 0.25) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 4732/5000 loss 0.0555 (w 0.0952 mse 0.0885 t 944 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4733/5000 loss 0.0846 (w 0.1694 mse 0.1550 t 981 new 0.26) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4734/5000 loss 0.0565 (w 0.0322 mse 0.0343 t 911 new 0.09) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 4735/5000 loss 0.0747 (w 0.1494 mse 0.1352 t 992 new 0.25) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4736/5000 loss 0.1480 (w 0.0604 mse 0.0558 t 932 new 0.19) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4737/5000 loss 0.0737 (w 0.0847 mse 0.0835 t 871 new 0.20) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 4738/5000 loss 0.0760 (w 0.1193 mse 0.1156 t 901 new 0.22) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 4739/5000 loss 0.0642 (w 0.0629 mse 0.0648 t 872 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4740/5000 loss 0.0767 (w 0.0491 mse 0.0484 t 742 new 0.14) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 4741/5000 loss 0.0607 (w 0.1160 mse 0.1172 t 991 new 0.20) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4742/5000 loss 0.0746 (w 0.0685 mse 0.0663 t 958 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4743/5000 loss 0.0556 (w 0.0917 mse 0.0860 t 956 new 0.21) lr 1.00e-05 gnorm 0.056 5.67s mem 15.6GB +step 4744/5000 loss 0.0681 (w 0.0841 mse 0.0895 t 396 new 0.26) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 4745/5000 loss 0.0843 (w 0.1108 mse 0.1088 t 925 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 4746/5000 loss 0.0861 (w 0.0990 mse 0.0987 t 449 new 0.29) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4747/5000 loss 0.0787 (w 0.0984 mse 0.0935 t 896 new 0.27) lr 1.00e-05 gnorm 0.070 5.84s mem 15.6GB +step 4748/5000 loss 0.1277 (w 0.4658 mse 0.4638 t 80 new 0.27) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 4749/5000 loss 0.1100 (w 0.1294 mse 0.1243 t 937 new 0.20) lr 1.00e-05 gnorm 0.073 5.91s mem 15.6GB +step 4750/5000 loss 0.0773 (w 0.0345 mse 0.0381 t 591 new 0.13) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4751/5000 loss 0.0779 (w 0.0779 mse 0.0819 t 634 new 0.20) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4752/5000 loss 0.0913 (w 0.0828 mse 0.0789 t 430 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4753/5000 loss 0.1445 (w 0.0558 mse 0.0544 t 625 new 0.17) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4754/5000 loss 0.0968 (w 0.0736 mse 0.0719 t 792 new 0.22) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 4755/5000 loss 0.0529 (w 0.0923 mse 0.0861 t 927 new 0.22) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +step 4756/5000 loss 0.0853 (w 0.0643 mse 0.0661 t 759 new 0.15) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4757/5000 loss 0.0860 (w 0.0831 mse 0.0798 t 961 new 0.26) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 4758/5000 loss 0.0914 (w 0.1006 mse 0.0920 t 937 new 0.31) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 4759/5000 loss 0.0826 (w 0.0461 mse 0.0441 t 827 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +step 4760/5000 loss 0.0914 (w 0.0586 mse 0.0592 t 922 new 0.25) lr 1.00e-05 gnorm 0.061 5.73s mem 15.6GB +step 4761/5000 loss 0.0576 (w 0.0591 mse 0.0630 t 817 new 0.19) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +step 4762/5000 loss 0.0509 (w 0.0882 mse 0.0914 t 692 new 0.14) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4763/5000 loss 0.1029 (w 0.0490 mse 0.0524 t 666 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4764/5000 loss 0.0667 (w 0.1068 mse 0.1086 t 966 new 0.14) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 4765/5000 loss 0.0957 (w 0.0849 mse 0.0785 t 727 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +step 4766/5000 loss 0.1268 (w 0.1121 mse 0.1072 t 766 new 0.17) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +step 4767/5000 loss 0.1070 (w 0.2047 mse 0.1988 t 997 new 0.19) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 4768/5000 loss 0.1067 (w 0.0623 mse 0.0671 t 781 new 0.23) lr 1.00e-05 gnorm 0.080 5.91s mem 15.6GB +step 4769/5000 loss 0.0923 (w 0.0843 mse 0.0854 t 865 new 0.19) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 4770/5000 loss 0.0391 (w 0.0612 mse 0.0565 t 866 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 4771/5000 loss 0.0787 (w 0.0588 mse 0.0627 t 879 new 0.18) lr 1.00e-05 gnorm 0.064 5.90s mem 15.6GB +step 4772/5000 loss 0.1201 (w 0.1055 mse 0.1036 t 323 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 4773/5000 loss 0.1083 (w 0.0999 mse 0.0920 t 866 new 0.23) lr 1.00e-05 gnorm 0.046 5.68s mem 15.6GB +step 4774/5000 loss 0.0892 (w 0.1102 mse 0.0999 t 896 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4775/5000 loss 0.1084 (w 0.0530 mse 0.0561 t 744 new 0.20) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 4776/5000 loss 0.1000 (w 0.0714 mse 0.0757 t 451 new 0.17) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4777/5000 loss 0.0590 (w 0.1058 mse 0.1000 t 956 new 0.10) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +step 4778/5000 loss 0.0743 (w 0.0551 mse 0.0555 t 909 new 0.25) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 4779/5000 loss 0.0517 (w 0.0840 mse 0.0778 t 951 new 0.25) lr 1.00e-05 gnorm 0.071 5.67s mem 15.6GB +step 4780/5000 loss 0.0870 (w 0.0540 mse 0.0532 t 737 new 0.11) lr 1.00e-05 gnorm 0.106 5.76s mem 15.6GB +step 4781/5000 loss 0.0710 (w 0.0697 mse 0.0640 t 819 new 0.25) lr 1.00e-05 gnorm 0.069 5.91s mem 15.6GB +step 4782/5000 loss 0.0977 (w 0.1050 mse 0.0996 t 706 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4783/5000 loss 0.0926 (w 0.1166 mse 0.1187 t 303 new 0.22) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +step 4784/5000 loss 0.1063 (w 0.1824 mse 0.1659 t 987 new 0.27) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 4785/5000 loss 0.1098 (w 0.0356 mse 0.0410 t 492 new 0.21) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 4786/5000 loss 0.1307 (w 0.2129 mse 0.2084 t 276 new 0.23) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 4787/5000 loss 0.1167 (w 0.1109 mse 0.1054 t 428 new 0.21) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4788/5000 loss 0.0978 (w 0.1405 mse 0.1378 t 425 new 0.30) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4789/5000 loss 0.0571 (w 0.1198 mse 0.1169 t 312 new 0.21) lr 1.00e-05 gnorm 0.085 5.93s mem 15.6GB +step 4790/5000 loss 0.1565 (w 0.0774 mse 0.0783 t 631 new 0.27) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +step 4791/5000 loss 0.0921 (w 0.0751 mse 0.0725 t 508 new 0.26) lr 1.00e-05 gnorm 0.070 5.94s mem 15.6GB +step 4792/5000 loss 0.1018 (w 0.1457 mse 0.1436 t 252 new 0.15) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +step 4793/5000 loss 0.1145 (w 0.0842 mse 0.0870 t 942 new 0.24) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 4794/5000 loss 0.0733 (w 0.0445 mse 0.0419 t 745 new 0.20) lr 1.00e-05 gnorm 0.104 5.69s mem 15.6GB +step 4795/5000 loss 0.0793 (w 0.1023 mse 0.0997 t 969 new 0.20) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 4796/5000 loss 0.0733 (w 0.0226 mse 0.0253 t 740 new 0.14) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 4797/5000 loss 0.0447 (w 0.0480 mse 0.0483 t 831 new 0.26) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +step 4798/5000 loss 0.0866 (w 0.0933 mse 0.0884 t 936 new 0.17) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 4799/5000 loss 0.0707 (w 0.0655 mse 0.0633 t 767 new 0.19) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4800/5000 loss 0.0705 (w 0.1047 mse 0.0956 t 954 new 0.26) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +step 4801/5000 loss 0.0684 (w 0.0653 mse 0.0574 t 861 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4802/5000 loss 0.0804 (w 0.0372 mse 0.0372 t 865 new 0.22) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4803/5000 loss 0.0816 (w 0.1250 mse 0.1220 t 508 new 0.23) lr 1.00e-05 gnorm 0.092 5.81s mem 15.6GB +step 4804/5000 loss 0.0788 (w 0.1003 mse 0.0969 t 643 new 0.21) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4805/5000 loss 0.0710 (w 0.0593 mse 0.0548 t 870 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4806/5000 loss 0.0676 (w 0.0568 mse 0.0611 t 943 new 0.10) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4807/5000 loss 0.0715 (w 0.0678 mse 0.0660 t 717 new 0.19) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +step 4808/5000 loss 0.1155 (w 0.1214 mse 0.1199 t 999 new 0.19) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4809/5000 loss 0.0604 (w 0.0818 mse 0.0722 t 911 new 0.21) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4810/5000 loss 0.0742 (w 0.1848 mse 0.1765 t 994 new 0.24) lr 1.00e-05 gnorm 0.063 5.97s mem 15.6GB +step 4811/5000 loss 0.0958 (w 0.1129 mse 0.1065 t 562 new 0.21) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 4812/5000 loss 0.0943 (w 0.1648 mse 0.1641 t 225 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 4813/5000 loss 0.1017 (w 0.0370 mse 0.0369 t 660 new 0.13) lr 1.00e-05 gnorm 0.057 5.71s mem 15.6GB +step 4814/5000 loss 0.0796 (w 0.0516 mse 0.0471 t 702 new 0.25) lr 1.00e-05 gnorm 0.069 5.71s mem 15.6GB +step 4815/5000 loss 0.0586 (w 0.2190 mse 0.2142 t 974 new 0.30) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +step 4816/5000 loss 0.0907 (w 0.0559 mse 0.0555 t 777 new 0.18) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +step 4817/5000 loss 0.0956 (w 0.1216 mse 0.1146 t 966 new 0.20) lr 1.00e-05 gnorm 0.071 5.75s mem 15.6GB +step 4818/5000 loss 0.0874 (w 0.0966 mse 0.0931 t 902 new 0.29) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +step 4819/5000 loss 0.1046 (w 0.1291 mse 0.1129 t 979 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4820/5000 loss 0.0480 (w 0.0750 mse 0.0683 t 727 new 0.16) lr 1.00e-05 gnorm 0.065 5.93s mem 15.6GB +step 4821/5000 loss 0.1012 (w 0.1105 mse 0.1092 t 355 new 0.15) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +step 4822/5000 loss 0.0575 (w 0.0633 mse 0.0610 t 898 new 0.24) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +step 4823/5000 loss 0.0432 (w 0.0616 mse 0.0579 t 763 new 0.21) lr 1.00e-05 gnorm 0.062 5.93s mem 15.6GB +step 4824/5000 loss 0.0711 (w 0.0532 mse 0.0533 t 744 new 0.21) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +step 4825/5000 loss 0.1023 (w 0.0871 mse 0.0835 t 473 new 0.26) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +step 4826/5000 loss 0.1111 (w 0.1772 mse 0.1819 t 261 new 0.14) lr 1.00e-05 gnorm 0.043 5.69s mem 15.6GB +step 4827/5000 loss 0.1184 (w 0.8040 mse 0.7963 t 29 new 0.18) lr 1.00e-05 gnorm 0.058 5.93s mem 15.6GB +step 4828/5000 loss 0.0820 (w 0.0480 mse 0.0453 t 853 new 0.19) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +step 4829/5000 loss 0.0611 (w 0.1207 mse 0.1186 t 960 new 0.21) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4830/5000 loss 0.1021 (w 0.0657 mse 0.0628 t 604 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4831/5000 loss 0.0704 (w 0.0919 mse 0.0900 t 823 new 0.15) lr 1.00e-05 gnorm 0.090 5.89s mem 15.6GB +step 4832/5000 loss 0.0794 (w 0.0595 mse 0.0642 t 934 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 4833/5000 loss 0.0585 (w 0.0870 mse 0.0800 t 927 new 0.16) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4834/5000 loss 0.0856 (w 0.1435 mse 0.1415 t 270 new 0.24) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +step 4835/5000 loss 0.0890 (w 0.0986 mse 0.0973 t 320 new 0.22) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 4836/5000 loss 0.1037 (w 0.0894 mse 0.0846 t 461 new 0.26) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4837/5000 loss 0.0835 (w 0.0721 mse 0.0685 t 799 new 0.20) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 4838/5000 loss 0.1099 (w 0.0792 mse 0.0750 t 850 new 0.12) lr 1.00e-05 gnorm 0.072 5.77s mem 15.6GB +step 4839/5000 loss 0.1256 (w 0.0784 mse 0.0729 t 543 new 0.31) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 4840/5000 loss 0.1102 (w 0.0617 mse 0.0576 t 904 new 0.20) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4841/5000 loss 0.0604 (w 0.0764 mse 0.0735 t 908 new 0.23) lr 1.00e-05 gnorm 0.074 5.95s mem 15.6GB +step 4842/5000 loss 0.1169 (w 0.0597 mse 0.0558 t 676 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4843/5000 loss 0.1203 (w 0.0875 mse 0.0832 t 461 new 0.23) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +step 4844/5000 loss 0.1025 (w 0.0625 mse 0.0589 t 566 new 0.18) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4845/5000 loss 0.0809 (w 0.1553 mse 0.1435 t 971 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4846/5000 loss 0.0582 (w 0.0689 mse 0.0656 t 581 new 0.09) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4847/5000 loss 0.0963 (w 0.6224 mse 0.6220 t 39 new 0.23) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4848/5000 loss 0.0730 (w 0.0808 mse 0.0766 t 966 new 0.24) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4849/5000 loss 0.1127 (w 0.0425 mse 0.0456 t 757 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4850/5000 loss 0.0820 (w 0.1098 mse 0.1082 t 267 new 0.23) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +step 4851/5000 loss 0.0974 (w 0.0378 mse 0.0377 t 559 new 0.20) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 4852/5000 loss 0.1107 (w 0.1235 mse 0.1179 t 925 new 0.23) lr 1.00e-05 gnorm 0.059 5.90s mem 15.6GB +step 4853/5000 loss 0.0592 (w 0.0451 mse 0.0423 t 831 new 0.19) lr 1.00e-05 gnorm 0.064 5.71s mem 15.6GB +step 4854/5000 loss 0.0695 (w 0.6388 mse 0.6559 t 34 new 0.08) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +step 4855/5000 loss 0.0459 (w 0.0656 mse 0.0584 t 766 new 0.20) lr 1.00e-05 gnorm 0.046 5.69s mem 15.6GB +step 4856/5000 loss 0.0694 (w 0.0636 mse 0.0625 t 827 new 0.28) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4857/5000 loss 0.0593 (w 0.0754 mse 0.0725 t 928 new 0.25) lr 1.00e-05 gnorm 0.045 5.69s mem 15.6GB +step 4858/5000 loss 0.0605 (w 0.1023 mse 0.0955 t 980 new 0.09) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4859/5000 loss 0.0712 (w 0.1014 mse 0.0994 t 985 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +step 4860/5000 loss 0.1083 (w 0.0758 mse 0.0677 t 925 new 0.24) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4861/5000 loss 0.1114 (w 0.0487 mse 0.0503 t 560 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4862/5000 loss 0.0579 (w 0.0468 mse 0.0490 t 664 new 0.19) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +step 4863/5000 loss 0.1064 (w 0.0713 mse 0.0678 t 751 new 0.28) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4864/5000 loss 0.0767 (w 0.1912 mse 0.1690 t 990 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4865/5000 loss 0.0600 (w 0.1727 mse 0.1582 t 986 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4866/5000 loss 0.0880 (w 0.2469 mse 0.2448 t 154 new 0.17) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 4867/5000 loss 0.0647 (w 0.1384 mse 0.1237 t 982 new 0.30) lr 1.00e-05 gnorm 0.045 5.69s mem 15.6GB +step 4868/5000 loss 0.0664 (w 0.0870 mse 0.0817 t 960 new 0.18) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4869/5000 loss 0.0579 (w 0.1150 mse 0.1160 t 993 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4870/5000 loss 0.1224 (w 0.0949 mse 0.0850 t 794 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4871/5000 loss 0.0716 (w 0.0712 mse 0.0730 t 960 new 0.30) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +step 4872/5000 loss 0.0382 (w 0.0850 mse 0.0790 t 805 new 0.17) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +step 4873/5000 loss 0.0767 (w 0.0550 mse 0.0575 t 941 new 0.20) lr 1.00e-05 gnorm 0.070 5.94s mem 15.6GB +step 4874/5000 loss 0.0705 (w 0.0512 mse 0.0504 t 774 new 0.23) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +step 4875/5000 loss 0.0817 (w 0.2203 mse 0.2135 t 995 new 0.23) lr 1.00e-05 gnorm 0.046 5.68s mem 15.6GB +step 4876/5000 loss 0.0658 (w 0.0531 mse 0.0494 t 849 new 0.26) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +step 4877/5000 loss 0.0761 (w 0.1209 mse 0.1086 t 894 new 0.25) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 4878/5000 loss 0.0857 (w 0.0913 mse 0.0867 t 976 new 0.22) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +step 4879/5000 loss 0.0622 (w 0.0563 mse 0.0548 t 755 new 0.19) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +step 4880/5000 loss 0.0690 (w 0.0883 mse 0.0840 t 975 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +step 4881/5000 loss 0.1160 (w 0.0331 mse 0.0319 t 817 new 0.18) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 4882/5000 loss 0.0710 (w 0.0669 mse 0.0621 t 803 new 0.23) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4883/5000 loss 0.0652 (w 0.1099 mse 0.1086 t 882 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4884/5000 loss 0.0918 (w 0.1265 mse 0.1142 t 938 new 0.23) lr 1.00e-05 gnorm 0.064 5.80s mem 15.6GB +step 4885/5000 loss 0.0972 (w 0.6401 mse 0.6762 t 39 new 0.17) lr 1.00e-05 gnorm 0.070 5.84s mem 15.6GB +step 4886/5000 loss 0.0733 (w 0.0568 mse 0.0525 t 790 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4887/5000 loss 0.1160 (w 0.0536 mse 0.0524 t 848 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4888/5000 loss 0.0700 (w 0.0793 mse 0.0769 t 719 new 0.20) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 4889/5000 loss 0.1061 (w 0.0723 mse 0.0689 t 627 new 0.25) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +step 4890/5000 loss 0.1085 (w 0.1346 mse 0.1284 t 918 new 0.19) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +step 4891/5000 loss 0.0663 (w 0.1641 mse 0.1575 t 965 new 0.30) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4892/5000 loss 0.1144 (w 0.1309 mse 0.1345 t 440 new 0.14) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4893/5000 loss 0.1473 (w 0.1084 mse 0.1030 t 898 new 0.19) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 4894/5000 loss 0.1110 (w 0.1974 mse 0.1796 t 983 new 0.28) lr 1.00e-05 gnorm 0.052 5.92s mem 15.6GB +step 4895/5000 loss 0.0955 (w 0.1077 mse 0.1109 t 323 new 0.24) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +step 4896/5000 loss 0.0988 (w 0.3191 mse 0.3174 t 109 new 0.17) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4897/5000 loss 0.1185 (w 0.0816 mse 0.0764 t 616 new 0.29) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4898/5000 loss 0.0771 (w 0.0527 mse 0.0536 t 959 new 0.18) lr 1.00e-05 gnorm 0.076 6.00s mem 15.6GB +step 4899/5000 loss 0.0609 (w 0.0552 mse 0.0524 t 786 new 0.23) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +step 4900/5000 loss 0.1023 (w 0.5592 mse 0.6015 t 53 new 0.24) lr 1.00e-05 gnorm 0.113 5.68s mem 15.6GB +step 4901/5000 loss 0.0887 (w 0.0705 mse 0.0686 t 572 new 0.24) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 4902/5000 loss 0.0783 (w 0.0807 mse 0.0801 t 527 new 0.15) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4903/5000 loss 0.0777 (w 0.0446 mse 0.0427 t 677 new 0.11) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 4904/5000 loss 0.0683 (w 0.0806 mse 0.0727 t 844 new 0.28) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 4905/5000 loss 0.1082 (w 0.0775 mse 0.0722 t 809 new 0.21) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 4906/5000 loss 0.1199 (w 0.1364 mse 0.1357 t 344 new 0.19) lr 1.00e-05 gnorm 0.067 5.85s mem 15.6GB +step 4907/5000 loss 0.1169 (w 0.1533 mse 0.1456 t 980 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +step 4908/5000 loss 0.0884 (w 0.1350 mse 0.1194 t 980 new 0.22) lr 1.00e-05 gnorm 0.075 5.88s mem 15.6GB +step 4909/5000 loss 0.1273 (w 0.0582 mse 0.0573 t 473 new 0.27) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +step 4910/5000 loss 0.0724 (w 0.0870 mse 0.0808 t 941 new 0.16) lr 1.00e-05 gnorm 0.040 5.68s mem 15.6GB +step 4911/5000 loss 0.0800 (w 0.1620 mse 0.1526 t 965 new 0.31) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 4912/5000 loss 0.0586 (w 0.0868 mse 0.0827 t 999 new 0.22) lr 1.00e-05 gnorm 0.051 5.79s mem 15.6GB +step 4913/5000 loss 0.0621 (w 0.0601 mse 0.0599 t 699 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +step 4914/5000 loss 0.0665 (w 0.0824 mse 0.0902 t 953 new 0.19) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +step 4915/5000 loss 0.0946 (w 0.0772 mse 0.0762 t 455 new 0.27) lr 1.00e-05 gnorm 0.050 5.68s mem 15.6GB +step 4916/5000 loss 0.0849 (w 0.0772 mse 0.0750 t 654 new 0.16) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4917/5000 loss 0.1208 (w 0.2352 mse 0.2358 t 161 new 0.28) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +step 4918/5000 loss 0.1043 (w 0.1187 mse 0.1189 t 294 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4919/5000 loss 0.0684 (w 0.1138 mse 0.1086 t 870 new 0.22) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +step 4920/5000 loss 0.0789 (w 0.1444 mse 0.1316 t 971 new 0.21) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 4921/5000 loss 0.1139 (w 0.1016 mse 0.0945 t 979 new 0.17) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4922/5000 loss 0.0795 (w 0.0769 mse 0.0775 t 969 new 0.26) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 4923/5000 loss 0.0752 (w 0.0695 mse 0.0681 t 405 new 0.26) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +step 4924/5000 loss 0.0723 (w 0.0828 mse 0.0822 t 959 new 0.23) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +step 4925/5000 loss 0.1285 (w 0.0871 mse 0.0782 t 928 new 0.21) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 4926/5000 loss 0.0695 (w 0.0417 mse 0.0409 t 859 new 0.09) lr 1.00e-05 gnorm 0.059 5.88s mem 15.6GB +step 4927/5000 loss 0.0766 (w 0.0832 mse 0.0797 t 948 new 0.27) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +step 4928/5000 loss 0.0627 (w 0.0971 mse 0.0923 t 967 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +step 4929/5000 loss 0.0900 (w 0.1545 mse 0.1414 t 942 new 0.24) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +step 4930/5000 loss 0.0762 (w 0.0819 mse 0.0756 t 719 new 0.20) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4931/5000 loss 0.0587 (w 0.0924 mse 0.0897 t 960 new 0.23) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4932/5000 loss 0.0549 (w 0.1349 mse 0.1230 t 936 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +step 4933/5000 loss 0.0791 (w 0.0554 mse 0.0511 t 883 new 0.22) lr 1.00e-05 gnorm 0.048 5.80s mem 15.6GB +step 4934/5000 loss 0.0946 (w 0.1128 mse 0.1131 t 916 new 0.27) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +step 4935/5000 loss 0.0875 (w 0.3738 mse 0.3903 t 62 new 0.19) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +step 4936/5000 loss 0.0754 (w 0.1132 mse 0.1086 t 738 new 0.27) lr 1.00e-05 gnorm 0.065 5.90s mem 15.6GB +step 4937/5000 loss 0.0784 (w 0.0763 mse 0.0732 t 690 new 0.30) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +step 4938/5000 loss 0.0838 (w 0.1850 mse 0.1779 t 992 new 0.16) lr 1.00e-05 gnorm 0.071 6.06s mem 15.6GB +step 4939/5000 loss 0.0919 (w 0.0710 mse 0.0698 t 476 new 0.24) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +step 4940/5000 loss 0.0772 (w 0.0646 mse 0.0613 t 940 new 0.21) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 4941/5000 loss 0.0979 (w 0.0812 mse 0.0805 t 854 new 0.24) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +step 4942/5000 loss 0.0683 (w 0.1017 mse 0.0971 t 934 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +step 4943/5000 loss 0.1249 (w 0.0605 mse 0.0591 t 731 new 0.25) lr 1.00e-05 gnorm 0.061 5.92s mem 15.6GB +step 4944/5000 loss 0.0784 (w 0.0583 mse 0.0576 t 909 new 0.22) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +step 4945/5000 loss 0.0546 (w 0.0403 mse 0.0428 t 695 new 0.24) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +step 4946/5000 loss 0.0708 (w 0.0802 mse 0.0771 t 735 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4947/5000 loss 0.0878 (w 0.1280 mse 0.1307 t 323 new 0.25) lr 1.00e-05 gnorm 0.095 5.68s mem 15.6GB +step 4948/5000 loss 0.1216 (w 0.1599 mse 0.1552 t 987 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4949/5000 loss 0.0882 (w 0.0647 mse 0.0652 t 794 new 0.18) lr 1.00e-05 gnorm 0.078 5.80s mem 15.6GB +step 4950/5000 loss 0.1276 (w 0.0734 mse 0.0675 t 707 new 0.22) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +step 4951/5000 loss 0.0650 (w 0.0913 mse 0.0897 t 989 new 0.25) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +step 4952/5000 loss 0.0770 (w 0.0874 mse 0.0789 t 770 new 0.24) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +step 4953/5000 loss 0.0849 (w 0.1585 mse 0.1504 t 997 new 0.17) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4954/5000 loss 0.0873 (w 0.0555 mse 0.0526 t 888 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4955/5000 loss 0.0702 (w 0.2965 mse 0.2498 t 994 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +step 4956/5000 loss 0.0544 (w 0.1097 mse 0.1044 t 377 new 0.22) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +step 4957/5000 loss 0.0722 (w 0.0468 mse 0.0485 t 739 new 0.28) lr 1.00e-05 gnorm 0.063 5.91s mem 15.6GB +step 4958/5000 loss 0.0831 (w 0.0455 mse 0.0470 t 914 new 0.14) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +step 4959/5000 loss 0.1032 (w 0.1421 mse 0.1423 t 285 new 0.26) lr 1.00e-05 gnorm 0.069 5.93s mem 15.6GB +step 4960/5000 loss 0.0938 (w 0.0955 mse 0.0878 t 911 new 0.29) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +step 4961/5000 loss 0.0866 (w 0.0639 mse 0.0575 t 744 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4962/5000 loss 0.0881 (w 0.0540 mse 0.0521 t 697 new 0.16) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +step 4963/5000 loss 0.0620 (w 0.1151 mse 0.1046 t 897 new 0.26) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +step 4964/5000 loss 0.1077 (w 0.0631 mse 0.0611 t 647 new 0.25) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +step 4965/5000 loss 0.0752 (w 0.0566 mse 0.0533 t 789 new 0.07) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +step 4966/5000 loss 0.0923 (w 0.1050 mse 0.1066 t 499 new 0.24) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +step 4967/5000 loss 0.0966 (w 0.0565 mse 0.0551 t 817 new 0.24) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +step 4968/5000 loss 0.1088 (w 0.0780 mse 0.0790 t 739 new 0.24) lr 1.00e-05 gnorm 0.067 5.96s mem 15.6GB +step 4969/5000 loss 0.0484 (w 0.1237 mse 0.1190 t 973 new 0.19) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 4970/5000 loss 0.0995 (w 0.0494 mse 0.0478 t 836 new 0.26) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +step 4971/5000 loss 0.0962 (w 0.0765 mse 0.0801 t 391 new 0.19) lr 1.00e-05 gnorm 0.058 5.87s mem 15.6GB +step 4972/5000 loss 0.0870 (w 0.0509 mse 0.0513 t 687 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +step 4973/5000 loss 0.0660 (w 0.0745 mse 0.0824 t 288 new 0.19) lr 1.00e-05 gnorm 0.070 5.71s mem 15.6GB +step 4974/5000 loss 0.0925 (w 0.0255 mse 0.0279 t 754 new 0.22) lr 1.00e-05 gnorm 0.066 5.71s mem 15.6GB +step 4975/5000 loss 0.0763 (w 0.0750 mse 0.0801 t 225 new 0.26) lr 1.00e-05 gnorm 0.090 5.94s mem 15.6GB +step 4976/5000 loss 0.1291 (w 0.1357 mse 0.1306 t 399 new 0.24) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +step 4977/5000 loss 0.0911 (w 0.0798 mse 0.0735 t 933 new 0.26) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 4978/5000 loss 0.1015 (w 0.0754 mse 0.0725 t 434 new 0.20) lr 1.00e-05 gnorm 0.077 5.89s mem 15.6GB +step 4979/5000 loss 0.1237 (w 0.0307 mse 0.0293 t 746 new 0.25) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +step 4980/5000 loss 0.0792 (w 0.0767 mse 0.0728 t 901 new 0.30) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +step 4981/5000 loss 0.0697 (w 0.1074 mse 0.0992 t 823 new 0.26) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +step 4982/5000 loss 0.1062 (w 0.0514 mse 0.0485 t 767 new 0.24) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 4983/5000 loss 0.0995 (w 0.0660 mse 0.0685 t 695 new 0.19) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +step 4984/5000 loss 0.0541 (w 0.0617 mse 0.0588 t 860 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4985/5000 loss 0.0782 (w 0.1536 mse 0.1493 t 957 new 0.17) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +step 4986/5000 loss 0.0870 (w 0.1000 mse 0.0972 t 676 new 0.19) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +step 4987/5000 loss 0.0798 (w 0.1079 mse 0.1042 t 923 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +step 4988/5000 loss 0.0557 (w 0.1922 mse 0.1828 t 987 new 0.26) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +step 4989/5000 loss 0.0554 (w 0.0657 mse 0.0592 t 867 new 0.26) lr 1.00e-05 gnorm 0.068 5.89s mem 15.6GB +step 4990/5000 loss 0.0772 (w 0.0510 mse 0.0564 t 459 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +step 4991/5000 loss 0.0651 (w 0.0613 mse 0.0582 t 901 new 0.25) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +step 4992/5000 loss 0.0875 (w 0.1414 mse 0.1342 t 978 new 0.25) lr 1.00e-05 gnorm 0.051 5.71s mem 15.6GB +step 4993/5000 loss 0.0844 (w 0.0638 mse 0.0591 t 824 new 0.24) lr 1.00e-05 gnorm 0.105 5.70s mem 15.6GB +step 4994/5000 loss 0.0685 (w 0.1276 mse 0.1216 t 963 new 0.18) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +step 4995/5000 loss 0.1008 (w 0.0774 mse 0.0719 t 853 new 0.18) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +step 4996/5000 loss 0.0544 (w 0.1112 mse 0.1277 t 988 new 0.23) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +step 4997/5000 loss 0.0589 (w 0.0526 mse 0.0507 t 934 new 0.25) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +step 4998/5000 loss 0.0994 (w 0.1551 mse 0.1547 t 974 new 0.23) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +step 4999/5000 loss 0.0540 (w 0.0710 mse 0.0670 t 869 new 0.26) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +step 5000/5000 loss 0.0557 (w 0.0542 mse 0.0533 t 669 new 0.26) lr 1.00e-05 gnorm 0.056 5.71s mem 15.6GB +[val] step 5000 t=201: w=0.1734 mse=0.1758 (n=16) t=501: w=0.0716 mse=0.0715 (n=16) t=800: w=0.0595 mse=0.0583 (n=16) | mean w=0.1015 mse=0.1019 4s +[save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step5000.safetensors 832 个张量 2.87 GB +[done] step 5000 diff --git a/backup_2026-09-14/runs/skyreels__arope_5k/progress.json b/backup_2026-09-14/runs/skyreels__arope_5k/progress.json new file mode 100644 index 0000000000000000000000000000000000000000..41fb1f64efe91bb12c42da42d400eea33dd05f91 --- /dev/null +++ b/backup_2026-09-14/runs/skyreels__arope_5k/progress.json @@ -0,0 +1 @@ +{"step": 5000, "wall": 1789343644.7312973, "time": "2026-09-13 23:54:04"} \ No newline at end of file diff --git a/backup_2026-09-14/runs/skyreels__arope_5k/train.log b/backup_2026-09-14/runs/skyreels__arope_5k/train.log new file mode 100644 index 0000000000000000000000000000000000000000..296014c0848a5d70680307a5a07be3c79a9ec1ec --- /dev/null +++ b/backup_2026-09-14/runs/skyreels__arope_5k/train.log @@ -0,0 +1,5027 @@ +[2026-09-13 15:53:48] [env] world=8 distributed=DistributedType.DEEPSPEED mixed_precision=bf16 device=cuda:0 +[2026-09-13 15:54:00] [load] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/SkyReels-V2-DF-1.3B-540P/model.safetensors 没有 ['arope_mask_embedding.bias', 'arope_mask_embedding.weight']:arope_mask_embedding 保持零初始化 +[2026-09-13 15:54:00] [model] 预训练权重 /opt/dlami/nvme/zhiyangdeng/ActionRoPE/models/SkyReels-V2-DF-1.3B-540P/model.safetensors: {'missing': ['arope_mask_embedding.bias', 'arope_mask_embedding.weight'], 'unexpected': [], 'n_tensors': 830} +[2026-09-13 15:54:00] [model] DiT 加载 9s,1,435,533,376 参数,832 个 state_dict 键,mask_channel=True,inject_sample_info=True,fps_idx=0,has arope_mask_embedding=True +[2026-09-13 15:54:04] [env] grad_clip=1.0 +[2026-09-13 15:54:04] [train] 18528 个 clip,每进程 batch 1,8 进程,到 5000 步 +[2026-09-13 15:54:20] step 1/5000 loss 0.1522 (w 0.1402 mse 0.1433 t 941 new 0.20) lr 5.00e-08 gnorm 0.235 10.89s mem 14.2GB +[2026-09-13 15:54:26] step 2/5000 loss 0.1281 (w 0.1302 mse 0.1266 t 612 new 0.18) lr 1.00e-07 gnorm 0.307 5.67s mem 15.5GB +[2026-09-13 15:54:31] step 3/5000 loss 0.1227 (w 0.1573 mse 0.1529 t 891 new 0.28) lr 1.50e-07 gnorm 0.172 5.69s mem 15.6GB +[2026-09-13 15:54:37] step 4/5000 loss 0.1435 (w 0.1095 mse 0.1043 t 832 new 0.15) lr 2.00e-07 gnorm 0.243 5.70s mem 15.6GB +[2026-09-13 15:54:43] step 5/5000 loss 0.1455 (w 0.0977 mse 0.0913 t 699 new 0.26) lr 2.50e-07 gnorm 0.245 5.69s mem 15.6GB +[2026-09-13 15:54:48] step 6/5000 loss 0.1380 (w 0.1321 mse 0.1315 t 436 new 0.18) lr 3.00e-07 gnorm 0.205 5.69s mem 15.6GB +[2026-09-13 15:54:54] step 7/5000 loss 0.1151 (w 0.0615 mse 0.0677 t 883 new 0.22) lr 3.50e-07 gnorm 0.233 5.69s mem 15.6GB +[2026-09-13 15:55:00] step 8/5000 loss 0.0761 (w 0.1099 mse 0.1059 t 892 new 0.17) lr 4.00e-07 gnorm 0.225 5.69s mem 15.6GB +[2026-09-13 15:55:06] step 9/5000 loss 0.1599 (w 0.1709 mse 0.1640 t 432 new 0.18) lr 4.50e-07 gnorm 0.246 5.69s mem 15.6GB +[2026-09-13 15:55:11] step 10/5000 loss 0.2181 (w 0.2472 mse 0.2517 t 993 new 0.20) lr 5.00e-07 gnorm 0.324 5.69s mem 15.6GB +[2026-09-13 15:55:17] step 11/5000 loss 0.0758 (w 0.2050 mse 0.1988 t 974 new 0.10) lr 5.50e-07 gnorm 0.144 5.69s mem 15.6GB +[2026-09-13 15:55:23] step 12/5000 loss 0.0893 (w 0.1379 mse 0.1324 t 936 new 0.23) lr 6.00e-07 gnorm 0.251 5.71s mem 15.6GB +[2026-09-13 15:55:28] step 13/5000 loss 0.1628 (w 0.1727 mse 0.1729 t 486 new 0.22) lr 6.50e-07 gnorm 0.321 5.69s mem 15.6GB +[2026-09-13 15:55:34] step 14/5000 loss 0.1638 (w 0.2151 mse 0.2080 t 138 new 0.28) lr 7.00e-07 gnorm 0.259 5.69s mem 15.6GB +[2026-09-13 15:55:40] step 15/5000 loss 0.0922 (w 0.1069 mse 0.1028 t 844 new 0.20) lr 7.50e-07 gnorm 0.204 5.69s mem 15.6GB +[2026-09-13 15:55:46] step 16/5000 loss 0.1403 (w 0.1643 mse 0.1625 t 998 new 0.19) lr 8.00e-07 gnorm 0.192 5.69s mem 15.6GB +[2026-09-13 15:55:51] step 17/5000 loss 0.1185 (w 0.0555 mse 0.0544 t 899 new 0.25) lr 8.50e-07 gnorm 0.208 5.69s mem 15.6GB +[2026-09-13 15:55:57] step 18/5000 loss 0.0849 (w 0.2398 mse 0.2359 t 982 new 0.24) lr 9.00e-07 gnorm 0.128 5.69s mem 15.6GB +[2026-09-13 15:56:03] step 19/5000 loss 0.0826 (w 0.9590 mse 0.9550 t 5 new 0.20) lr 9.50e-07 gnorm 0.200 5.69s mem 15.6GB +[2026-09-13 15:56:08] step 20/5000 loss 0.0948 (w 0.0994 mse 0.0944 t 925 new 0.25) lr 1.00e-06 gnorm 0.143 5.68s mem 15.6GB +[2026-09-13 15:56:14] step 21/5000 loss 0.1842 (w 0.4055 mse 0.4002 t 991 new 0.25) lr 1.05e-06 gnorm 0.237 5.70s mem 15.6GB +[2026-09-13 15:56:20] step 22/5000 loss 0.1003 (w 0.1203 mse 0.1119 t 839 new 0.25) lr 1.10e-06 gnorm 0.162 5.70s mem 15.6GB +[2026-09-13 15:56:25] step 23/5000 loss 0.1549 (w 0.1111 mse 0.1098 t 616 new 0.19) lr 1.15e-06 gnorm 0.196 5.69s mem 15.6GB +[2026-09-13 15:56:31] step 24/5000 loss 0.1064 (w 0.0669 mse 0.0735 t 885 new 0.27) lr 1.20e-06 gnorm 0.110 5.70s mem 15.6GB +[2026-09-13 15:56:37] step 25/5000 loss 0.0734 (w 0.0827 mse 0.0791 t 710 new 0.25) lr 1.25e-06 gnorm 0.184 5.69s mem 15.6GB +[2026-09-13 15:56:43] step 26/5000 loss 0.1268 (w 0.3320 mse 0.3328 t 138 new 0.13) lr 1.30e-06 gnorm 0.196 5.68s mem 15.6GB +[2026-09-13 15:56:48] step 27/5000 loss 0.0917 (w 0.0878 mse 0.0878 t 864 new 0.18) lr 1.35e-06 gnorm 0.124 5.69s mem 15.6GB +[2026-09-13 15:56:54] step 28/5000 loss 0.0987 (w 0.1251 mse 0.1250 t 928 new 0.22) lr 1.40e-06 gnorm 0.125 5.69s mem 15.6GB +[2026-09-13 15:57:00] step 29/5000 loss 0.0975 (w 0.1026 mse 0.0993 t 676 new 0.27) lr 1.45e-06 gnorm 0.160 5.70s mem 15.6GB +[2026-09-13 15:57:05] step 30/5000 loss 0.0878 (w 0.1070 mse 0.1051 t 911 new 0.23) lr 1.50e-06 gnorm 0.093 5.70s mem 15.6GB +[2026-09-13 15:57:11] step 31/5000 loss 0.1239 (w 0.0879 mse 0.0862 t 912 new 0.25) lr 1.55e-06 gnorm 0.137 5.69s mem 15.6GB +[2026-09-13 15:57:17] step 32/5000 loss 0.1064 (w 0.1172 mse 0.1121 t 847 new 0.22) lr 1.60e-06 gnorm 0.122 5.69s mem 15.6GB +[2026-09-13 15:57:23] step 33/5000 loss 0.1227 (w 0.1085 mse 0.0990 t 682 new 0.28) lr 1.65e-06 gnorm 0.150 5.78s mem 15.6GB +[2026-09-13 15:57:28] step 34/5000 loss 0.0654 (w 0.0983 mse 0.0937 t 744 new 0.26) lr 1.70e-06 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 15:57:34] step 35/5000 loss 0.1493 (w 0.2937 mse 0.2762 t 998 new 0.18) lr 1.75e-06 gnorm 0.115 5.69s mem 15.6GB +[2026-09-13 15:57:40] step 36/5000 loss 0.1121 (w 0.0903 mse 0.0874 t 733 new 0.25) lr 1.80e-06 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 15:57:45] step 37/5000 loss 0.0668 (w 0.1892 mse 0.1843 t 983 new 0.18) lr 1.85e-06 gnorm 0.158 5.69s mem 15.6GB +[2026-09-13 15:57:51] step 38/5000 loss 0.1496 (w 0.0664 mse 0.0723 t 821 new 0.26) lr 1.90e-06 gnorm 0.142 5.70s mem 15.6GB +[2026-09-13 15:57:57] step 39/5000 loss 0.1745 (w 0.1565 mse 0.1624 t 314 new 0.20) lr 1.95e-06 gnorm 0.103 5.70s mem 15.6GB +[2026-09-13 15:58:03] step 40/5000 loss 0.1188 (w 0.1136 mse 0.1105 t 839 new 0.23) lr 2.00e-06 gnorm 0.116 5.70s mem 15.6GB +[2026-09-13 15:58:08] step 41/5000 loss 0.2082 (w 0.0994 mse 0.0926 t 823 new 0.23) lr 2.05e-06 gnorm 0.217 5.70s mem 15.6GB +[2026-09-13 15:58:14] step 42/5000 loss 0.0804 (w 0.0845 mse 0.0841 t 744 new 0.30) lr 2.10e-06 gnorm 0.126 5.69s mem 15.6GB +[2026-09-13 15:58:20] step 43/5000 loss 0.1973 (w 0.1500 mse 0.1442 t 443 new 0.24) lr 2.15e-06 gnorm 0.105 5.92s mem 15.6GB +[2026-09-13 15:58:26] step 44/5000 loss 0.0817 (w 0.1588 mse 0.1591 t 943 new 0.22) lr 2.20e-06 gnorm 0.100 5.69s mem 15.6GB +[2026-09-13 15:58:31] step 45/5000 loss 0.0814 (w 0.2355 mse 0.2278 t 983 new 0.26) lr 2.25e-06 gnorm 0.115 5.69s mem 15.6GB +[2026-09-13 15:58:37] step 46/5000 loss 0.1019 (w 0.1502 mse 0.1566 t 982 new 0.22) lr 2.30e-06 gnorm 0.093 5.68s mem 15.6GB +[2026-09-13 15:58:43] step 47/5000 loss 0.1456 (w 0.1700 mse 0.1677 t 453 new 0.25) lr 2.35e-06 gnorm 0.095 5.69s mem 15.6GB +[2026-09-13 15:58:48] step 48/5000 loss 0.0661 (w 0.1343 mse 0.1359 t 875 new 0.19) lr 2.40e-06 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 15:58:54] step 49/5000 loss 0.0989 (w 0.1162 mse 0.1095 t 497 new 0.24) lr 2.45e-06 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 15:59:00] step 50/5000 loss 0.0789 (w 0.1723 mse 0.1687 t 949 new 0.18) lr 2.50e-06 gnorm 0.100 5.68s mem 15.6GB +[2026-09-13 15:59:06] step 51/5000 loss 0.1272 (w 0.1558 mse 0.1729 t 222 new 0.21) lr 2.55e-06 gnorm 0.089 5.68s mem 15.6GB +[2026-09-13 15:59:11] step 52/5000 loss 0.0761 (w 0.0829 mse 0.0803 t 916 new 0.16) lr 2.60e-06 gnorm 0.099 5.67s mem 15.6GB +[2026-09-13 15:59:17] step 53/5000 loss 0.1015 (w 0.0446 mse 0.0470 t 625 new 0.13) lr 2.65e-06 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 15:59:23] step 54/5000 loss 0.1129 (w 0.2622 mse 0.2446 t 985 new 0.23) lr 2.70e-06 gnorm 0.060 5.78s mem 15.6GB +[2026-09-13 15:59:28] step 55/5000 loss 0.1357 (w 0.1737 mse 0.1681 t 976 new 0.20) lr 2.75e-06 gnorm 0.109 5.69s mem 15.6GB +[2026-09-13 15:59:34] step 56/5000 loss 0.1022 (w 0.2940 mse 0.2830 t 982 new 0.23) lr 2.80e-06 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 15:59:40] step 57/5000 loss 0.1166 (w 0.1606 mse 0.1635 t 966 new 0.20) lr 2.85e-06 gnorm 0.108 5.70s mem 15.6GB +[2026-09-13 15:59:46] step 58/5000 loss 0.0843 (w 0.0733 mse 0.0737 t 814 new 0.26) lr 2.90e-06 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 15:59:51] step 59/5000 loss 0.1491 (w 0.1579 mse 0.1452 t 934 new 0.26) lr 2.95e-06 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 15:59:57] step 60/5000 loss 0.1040 (w 0.1343 mse 0.1242 t 825 new 0.30) lr 3.00e-06 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 16:00:03] step 61/5000 loss 0.1353 (w 0.0852 mse 0.0831 t 718 new 0.24) lr 3.05e-06 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 16:00:08] step 62/5000 loss 0.1734 (w 0.1586 mse 0.1556 t 964 new 0.25) lr 3.10e-06 gnorm 0.101 5.69s mem 15.6GB +[2026-09-13 16:00:14] step 63/5000 loss 0.1061 (w 0.2409 mse 0.2303 t 973 new 0.27) lr 3.15e-06 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 16:00:20] step 64/5000 loss 0.0622 (w 0.1527 mse 0.1440 t 887 new 0.21) lr 3.20e-06 gnorm 0.079 6.13s mem 15.6GB +[2026-09-13 16:00:26] step 65/5000 loss 0.1102 (w 0.0397 mse 0.0420 t 761 new 0.13) lr 3.25e-06 gnorm 0.088 5.70s mem 15.6GB +[2026-09-13 16:00:32] step 66/5000 loss 0.0718 (w 0.1185 mse 0.1154 t 943 new 0.25) lr 3.30e-06 gnorm 0.082 5.71s mem 15.6GB +[2026-09-13 16:00:37] step 67/5000 loss 0.0863 (w 0.0645 mse 0.0666 t 615 new 0.19) lr 3.35e-06 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 16:00:43] step 68/5000 loss 0.1077 (w 0.0680 mse 0.0658 t 768 new 0.25) lr 3.40e-06 gnorm 0.083 5.71s mem 15.6GB +[2026-09-13 16:00:49] step 69/5000 loss 0.1461 (w 0.1811 mse 0.2008 t 982 new 0.18) lr 3.45e-06 gnorm 0.088 5.70s mem 15.6GB +[2026-09-13 16:00:55] step 70/5000 loss 0.1161 (w 0.5201 mse 0.5309 t 75 new 0.22) lr 3.50e-06 gnorm 0.109 5.70s mem 15.6GB +[2026-09-13 16:01:00] step 71/5000 loss 0.1110 (w 0.1709 mse 0.1633 t 945 new 0.25) lr 3.55e-06 gnorm 0.097 5.71s mem 15.6GB +[2026-09-13 16:01:06] step 72/5000 loss 0.1109 (w 0.3022 mse 0.2890 t 998 new 0.27) lr 3.60e-06 gnorm 0.115 5.71s mem 15.6GB +[2026-09-13 16:01:12] step 73/5000 loss 0.1287 (w 0.0873 mse 0.0907 t 579 new 0.25) lr 3.65e-06 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 16:01:17] step 74/5000 loss 0.1051 (w 0.1409 mse 0.1488 t 985 new 0.19) lr 3.70e-06 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 16:01:23] step 75/5000 loss 0.1198 (w 0.0971 mse 0.0908 t 883 new 0.16) lr 3.75e-06 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:01:29] step 76/5000 loss 0.1048 (w 0.2379 mse 0.2451 t 165 new 0.12) lr 3.80e-06 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 16:01:35] step 77/5000 loss 0.1245 (w 0.3149 mse 0.3215 t 130 new 0.11) lr 3.85e-06 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 16:01:40] step 78/5000 loss 0.0827 (w 0.1479 mse 0.1489 t 941 new 0.24) lr 3.90e-06 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 16:01:46] step 79/5000 loss 0.1271 (w 0.2302 mse 0.2423 t 998 new 0.18) lr 3.95e-06 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 16:01:52] step 80/5000 loss 0.1353 (w 0.0916 mse 0.0894 t 930 new 0.17) lr 4.00e-06 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 16:01:57] step 81/5000 loss 0.0640 (w 0.1053 mse 0.1099 t 962 new 0.18) lr 4.05e-06 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:02:03] step 82/5000 loss 0.1311 (w 0.0945 mse 0.0952 t 912 new 0.21) lr 4.10e-06 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:02:09] step 83/5000 loss 0.1149 (w 0.3346 mse 0.3440 t 130 new 0.24) lr 4.15e-06 gnorm 0.100 5.68s mem 15.6GB +[2026-09-13 16:02:15] step 84/5000 loss 0.1158 (w 0.0971 mse 0.0926 t 688 new 0.26) lr 4.20e-06 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 16:02:20] step 85/5000 loss 0.0499 (w 0.1687 mse 0.1616 t 947 new 0.26) lr 4.25e-06 gnorm 0.074 5.92s mem 15.6GB +[2026-09-13 16:02:26] step 86/5000 loss 0.0606 (w 0.2212 mse 0.2132 t 991 new 0.27) lr 4.30e-06 gnorm 0.063 5.95s mem 15.6GB +[2026-09-13 16:02:32] step 87/5000 loss 0.0876 (w 0.1585 mse 0.1561 t 974 new 0.22) lr 4.35e-06 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:02:38] step 88/5000 loss 0.1350 (w 0.0736 mse 0.0738 t 527 new 0.22) lr 4.40e-06 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 16:02:44] step 89/5000 loss 0.0473 (w 0.0761 mse 0.0718 t 877 new 0.25) lr 4.45e-06 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 16:02:49] step 90/5000 loss 0.0738 (w 0.1957 mse 0.1741 t 966 new 0.24) lr 4.50e-06 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:02:55] step 91/5000 loss 0.1320 (w 0.0986 mse 0.0994 t 651 new 0.22) lr 4.55e-06 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:03:01] step 92/5000 loss 0.1366 (w 0.0980 mse 0.0927 t 700 new 0.27) lr 4.60e-06 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 16:03:06] step 93/5000 loss 0.0856 (w 0.0780 mse 0.0733 t 612 new 0.24) lr 4.65e-06 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 16:03:12] step 94/5000 loss 0.1680 (w 0.1339 mse 0.1275 t 410 new 0.24) lr 4.70e-06 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 16:03:18] step 95/5000 loss 0.0636 (w 0.0494 mse 0.0493 t 883 new 0.25) lr 4.75e-06 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 16:03:24] step 96/5000 loss 0.0949 (w 0.1884 mse 0.1846 t 974 new 0.25) lr 4.80e-06 gnorm 0.078 5.93s mem 15.6GB +[2026-09-13 16:03:29] step 97/5000 loss 0.0855 (w 0.1171 mse 0.1171 t 954 new 0.24) lr 4.85e-06 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 16:03:35] step 98/5000 loss 0.1436 (w 0.1163 mse 0.1113 t 396 new 0.20) lr 4.90e-06 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 16:03:41] step 99/5000 loss 0.0980 (w 0.0834 mse 0.0804 t 705 new 0.25) lr 4.95e-06 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 16:03:47] step 100/5000 loss 0.1370 (w 0.0966 mse 0.0889 t 781 new 0.25) lr 5.00e-06 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 16:03:52] step 101/5000 loss 0.1132 (w 0.0873 mse 0.0816 t 874 new 0.29) lr 5.05e-06 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 16:03:58] step 102/5000 loss 0.0746 (w 0.0733 mse 0.0738 t 765 new 0.23) lr 5.10e-06 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 16:04:04] step 103/5000 loss 0.1235 (w 0.0634 mse 0.0630 t 482 new 0.10) lr 5.15e-06 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 16:04:09] step 104/5000 loss 0.0827 (w 0.1621 mse 0.1534 t 987 new 0.22) lr 5.20e-06 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 16:04:15] step 105/5000 loss 0.0680 (w 0.0599 mse 0.0597 t 827 new 0.17) lr 5.25e-06 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 16:04:21] step 106/5000 loss 0.1070 (w 0.1433 mse 0.1361 t 966 new 0.17) lr 5.30e-06 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 16:04:27] step 107/5000 loss 0.1029 (w 0.0665 mse 0.0648 t 785 new 0.12) lr 5.35e-06 gnorm 0.089 5.81s mem 15.6GB +[2026-09-13 16:04:32] step 108/5000 loss 0.0882 (w 0.1503 mse 0.1463 t 967 new 0.23) lr 5.40e-06 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 16:04:38] step 109/5000 loss 0.1336 (w 0.1738 mse 0.1631 t 973 new 0.20) lr 5.45e-06 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 16:04:44] step 110/5000 loss 0.1470 (w 0.0666 mse 0.0698 t 862 new 0.29) lr 5.50e-06 gnorm 0.111 5.69s mem 15.6GB +[2026-09-13 16:04:49] step 111/5000 loss 0.0976 (w 0.0799 mse 0.0791 t 792 new 0.23) lr 5.55e-06 gnorm 0.102 5.69s mem 15.6GB +[2026-09-13 16:04:55] step 112/5000 loss 0.0986 (w 0.1220 mse 0.1208 t 975 new 0.27) lr 5.60e-06 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 16:05:01] step 113/5000 loss 0.1254 (w 0.1020 mse 0.0981 t 881 new 0.19) lr 5.65e-06 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:05:06] step 114/5000 loss 0.1458 (w 0.0837 mse 0.0822 t 663 new 0.25) lr 5.70e-06 gnorm 0.100 5.70s mem 15.6GB +[2026-09-13 16:05:12] step 115/5000 loss 0.1023 (w 0.2794 mse 0.2662 t 992 new 0.20) lr 5.75e-06 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 16:05:18] step 116/5000 loss 0.1517 (w 0.0638 mse 0.0683 t 629 new 0.21) lr 5.80e-06 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 16:05:24] step 117/5000 loss 0.1223 (w 0.1073 mse 0.1008 t 502 new 0.23) lr 5.85e-06 gnorm 0.112 5.94s mem 15.6GB +[2026-09-13 16:05:30] step 118/5000 loss 0.1348 (w 0.0993 mse 0.0972 t 837 new 0.16) lr 5.90e-06 gnorm 0.100 5.85s mem 15.6GB +[2026-09-13 16:05:35] step 119/5000 loss 0.0874 (w 0.2000 mse 0.2037 t 982 new 0.26) lr 5.95e-06 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 16:05:41] step 120/5000 loss 0.1113 (w 0.0949 mse 0.0914 t 925 new 0.20) lr 6.00e-06 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 16:05:47] step 121/5000 loss 0.1098 (w 0.0693 mse 0.0671 t 933 new 0.21) lr 6.05e-06 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 16:05:52] step 122/5000 loss 0.0867 (w 0.0738 mse 0.0717 t 877 new 0.23) lr 6.10e-06 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:05:58] step 123/5000 loss 0.0706 (w 0.0820 mse 0.0828 t 563 new 0.25) lr 6.15e-06 gnorm 0.093 5.69s mem 15.6GB +[2026-09-13 16:06:04] step 124/5000 loss 0.1327 (w 0.1079 mse 0.1046 t 686 new 0.19) lr 6.20e-06 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 16:06:10] step 125/5000 loss 0.1237 (w 0.0758 mse 0.0741 t 815 new 0.07) lr 6.25e-06 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 16:06:15] step 126/5000 loss 0.0891 (w 0.0947 mse 0.0916 t 847 new 0.29) lr 6.30e-06 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 16:06:21] step 127/5000 loss 0.0946 (w 0.1092 mse 0.0990 t 893 new 0.22) lr 6.35e-06 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 16:06:27] step 128/5000 loss 0.1222 (w 0.0849 mse 0.0826 t 679 new 0.22) lr 6.40e-06 gnorm 0.072 5.78s mem 15.6GB +[2026-09-13 16:06:33] step 129/5000 loss 0.1163 (w 0.1975 mse 0.1941 t 232 new 0.28) lr 6.45e-06 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 16:06:38] step 130/5000 loss 0.1337 (w 0.0559 mse 0.0540 t 660 new 0.15) lr 6.50e-06 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:06:44] step 131/5000 loss 0.1369 (w 0.1976 mse 0.1982 t 225 new 0.24) lr 6.55e-06 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:06:50] step 132/5000 loss 0.1350 (w 0.0961 mse 0.0909 t 868 new 0.23) lr 6.60e-06 gnorm 0.087 5.70s mem 15.6GB +[2026-09-13 16:06:55] step 133/5000 loss 0.0853 (w 0.0930 mse 0.0937 t 603 new 0.27) lr 6.65e-06 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:07:01] step 134/5000 loss 0.1301 (w 0.1064 mse 0.1026 t 520 new 0.24) lr 6.70e-06 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:07:07] step 135/5000 loss 0.1258 (w 0.1197 mse 0.1219 t 478 new 0.17) lr 6.75e-06 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:07:12] step 136/5000 loss 0.1111 (w 0.0787 mse 0.0747 t 600 new 0.28) lr 6.80e-06 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 16:07:18] step 137/5000 loss 0.0963 (w 0.0769 mse 0.0743 t 704 new 0.25) lr 6.85e-06 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 16:07:24] step 138/5000 loss 0.0981 (w 0.2210 mse 0.2265 t 979 new 0.22) lr 6.90e-06 gnorm 0.086 5.94s mem 15.6GB +[2026-09-13 16:07:30] step 139/5000 loss 0.1064 (w 0.1106 mse 0.1058 t 717 new 0.26) lr 6.95e-06 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 16:07:36] step 140/5000 loss 0.1099 (w 0.5569 mse 0.5722 t 66 new 0.30) lr 7.00e-06 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 16:07:41] step 141/5000 loss 0.1120 (w 0.0791 mse 0.0728 t 482 new 0.26) lr 7.05e-06 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:07:47] step 142/5000 loss 0.0783 (w 0.1464 mse 0.1346 t 951 new 0.20) lr 7.10e-06 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 16:07:53] step 143/5000 loss 0.1318 (w 0.1043 mse 0.1003 t 947 new 0.18) lr 7.15e-06 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 16:07:58] step 144/5000 loss 0.1309 (w 0.0774 mse 0.0767 t 593 new 0.16) lr 7.20e-06 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:08:04] step 145/5000 loss 0.0680 (w 0.1119 mse 0.1031 t 966 new 0.26) lr 7.25e-06 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 16:08:10] step 146/5000 loss 0.0858 (w 0.1028 mse 0.0997 t 932 new 0.22) lr 7.30e-06 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 16:08:15] step 147/5000 loss 0.1034 (w 0.2388 mse 0.2304 t 161 new 0.23) lr 7.35e-06 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 16:08:21] step 148/5000 loss 0.1029 (w 0.2258 mse 0.2065 t 987 new 0.22) lr 7.40e-06 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 16:08:27] step 149/5000 loss 0.0900 (w 0.0745 mse 0.0736 t 476 new 0.23) lr 7.45e-06 gnorm 0.069 6.02s mem 15.6GB +[2026-09-13 16:08:33] step 150/5000 loss 0.0776 (w 0.0973 mse 0.0920 t 903 new 0.25) lr 7.50e-06 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 16:08:39] step 151/5000 loss 0.0876 (w 0.0673 mse 0.0654 t 846 new 0.27) lr 7.55e-06 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 16:08:45] step 152/5000 loss 0.0864 (w 0.0877 mse 0.0814 t 911 new 0.24) lr 7.60e-06 gnorm 0.075 5.67s mem 15.6GB +[2026-09-13 16:08:50] step 153/5000 loss 0.1289 (w 0.1345 mse 0.1318 t 942 new 0.25) lr 7.65e-06 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 16:08:56] step 154/5000 loss 0.1074 (w 0.0970 mse 0.0964 t 744 new 0.22) lr 7.70e-06 gnorm 0.114 5.68s mem 15.6GB +[2026-09-13 16:09:02] step 155/5000 loss 0.1035 (w 0.0771 mse 0.0699 t 733 new 0.24) lr 7.75e-06 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 16:09:07] step 156/5000 loss 0.1129 (w 0.1699 mse 0.1595 t 951 new 0.21) lr 7.80e-06 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 16:09:13] step 157/5000 loss 0.0464 (w 0.0670 mse 0.0609 t 846 new 0.24) lr 7.85e-06 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:09:19] step 158/5000 loss 0.1461 (w 0.0587 mse 0.0553 t 714 new 0.26) lr 7.90e-06 gnorm 0.094 5.68s mem 15.6GB +[2026-09-13 16:09:25] step 159/5000 loss 0.0491 (w 0.2287 mse 0.2223 t 987 new 0.17) lr 7.95e-06 gnorm 0.075 5.91s mem 15.6GB +[2026-09-13 16:09:30] step 160/5000 loss 0.1133 (w 0.1547 mse 0.1443 t 919 new 0.24) lr 8.00e-06 gnorm 0.102 5.69s mem 15.6GB +[2026-09-13 16:09:36] step 161/5000 loss 0.0911 (w 0.0978 mse 0.0972 t 787 new 0.23) lr 8.05e-06 gnorm 0.096 5.68s mem 15.6GB +[2026-09-13 16:09:42] step 162/5000 loss 0.0919 (w 0.3283 mse 0.3267 t 150 new 0.25) lr 8.10e-06 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 16:09:47] step 163/5000 loss 0.1006 (w 0.1149 mse 0.1087 t 924 new 0.19) lr 8.15e-06 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 16:09:53] step 164/5000 loss 0.1366 (w 0.0511 mse 0.0571 t 563 new 0.29) lr 8.20e-06 gnorm 0.102 5.69s mem 15.6GB +[2026-09-13 16:09:59] step 165/5000 loss 0.1332 (w 0.0963 mse 0.0937 t 780 new 0.27) lr 8.25e-06 gnorm 0.096 5.69s mem 15.6GB +[2026-09-13 16:10:05] step 166/5000 loss 0.1009 (w 0.0861 mse 0.0837 t 538 new 0.12) lr 8.30e-06 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:10:10] step 167/5000 loss 0.0838 (w 0.0259 mse 0.0291 t 652 new 0.16) lr 8.35e-06 gnorm 0.100 5.69s mem 15.6GB +[2026-09-13 16:10:16] step 168/5000 loss 0.0905 (w 0.0635 mse 0.0598 t 733 new 0.22) lr 8.40e-06 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 16:10:22] step 169/5000 loss 0.1064 (w 0.0796 mse 0.0801 t 940 new 0.06) lr 8.45e-06 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 16:10:28] step 170/5000 loss 0.0795 (w 0.0984 mse 0.1054 t 924 new 0.14) lr 8.50e-06 gnorm 0.099 5.68s mem 15.6GB +[2026-09-13 16:10:33] step 171/5000 loss 0.0868 (w 0.0656 mse 0.0637 t 686 new 0.20) lr 8.55e-06 gnorm 0.107 5.69s mem 15.6GB +[2026-09-13 16:10:39] step 172/5000 loss 0.1191 (w 0.6714 mse 0.6707 t 53 new 0.27) lr 8.60e-06 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 16:10:45] step 173/5000 loss 0.1464 (w 0.0631 mse 0.0676 t 504 new 0.22) lr 8.65e-06 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 16:10:50] step 174/5000 loss 0.1466 (w 0.0664 mse 0.0711 t 516 new 0.26) lr 8.70e-06 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 16:10:56] step 175/5000 loss 0.1270 (w 0.0776 mse 0.0744 t 577 new 0.22) lr 8.75e-06 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 16:11:02] step 176/5000 loss 0.1060 (w 0.1352 mse 0.1376 t 931 new 0.18) lr 8.80e-06 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 16:11:08] step 177/5000 loss 0.1217 (w 0.0934 mse 0.0904 t 857 new 0.17) lr 8.85e-06 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 16:11:13] step 178/5000 loss 0.0675 (w 0.1649 mse 0.1627 t 960 new 0.19) lr 8.90e-06 gnorm 0.104 5.69s mem 15.6GB +[2026-09-13 16:11:19] step 179/5000 loss 0.1234 (w 0.0974 mse 0.0936 t 842 new 0.21) lr 8.95e-06 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 16:11:25] step 180/5000 loss 0.1112 (w 0.0850 mse 0.0821 t 875 new 0.26) lr 9.00e-06 gnorm 0.077 5.91s mem 15.6GB +[2026-09-13 16:11:31] step 181/5000 loss 0.1369 (w 0.0601 mse 0.0609 t 784 new 0.26) lr 9.05e-06 gnorm 0.076 5.90s mem 15.6GB +[2026-09-13 16:11:37] step 182/5000 loss 0.0955 (w 0.0794 mse 0.0752 t 619 new 0.19) lr 9.10e-06 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 16:11:42] step 183/5000 loss 0.1284 (w 0.1352 mse 0.1302 t 891 new 0.19) lr 9.15e-06 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 16:11:48] step 184/5000 loss 0.0962 (w 0.1461 mse 0.1424 t 987 new 0.26) lr 9.20e-06 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 16:11:54] step 185/5000 loss 0.1240 (w 0.0313 mse 0.0290 t 482 new 0.10) lr 9.25e-06 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 16:12:00] step 186/5000 loss 0.1158 (w 0.7591 mse 0.7472 t 20 new 0.23) lr 9.30e-06 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:12:05] step 187/5000 loss 0.0695 (w 0.0846 mse 0.0817 t 816 new 0.15) lr 9.35e-06 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 16:12:11] step 188/5000 loss 0.0955 (w 0.0614 mse 0.0662 t 842 new 0.27) lr 9.40e-06 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 16:12:17] step 189/5000 loss 0.1364 (w 0.3109 mse 0.2884 t 1000 new 0.23) lr 9.45e-06 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 16:12:23] step 190/5000 loss 0.0766 (w 0.1173 mse 0.1247 t 969 new 0.14) lr 9.50e-06 gnorm 0.086 5.89s mem 15.6GB +[2026-09-13 16:12:28] step 191/5000 loss 0.0672 (w 0.1563 mse 0.1443 t 934 new 0.25) lr 9.55e-06 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 16:12:34] step 192/5000 loss 0.0801 (w 0.1172 mse 0.1096 t 895 new 0.28) lr 9.60e-06 gnorm 0.071 5.75s mem 15.6GB +[2026-09-13 16:12:40] step 193/5000 loss 0.0536 (w 0.0698 mse 0.0677 t 890 new 0.29) lr 9.65e-06 gnorm 0.084 5.67s mem 15.6GB +[2026-09-13 16:12:46] step 194/5000 loss 0.1189 (w 0.0435 mse 0.0422 t 690 new 0.21) lr 9.70e-06 gnorm 0.115 5.69s mem 15.6GB +[2026-09-13 16:12:51] step 195/5000 loss 0.1028 (w 0.0672 mse 0.0668 t 814 new 0.16) lr 9.75e-06 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 16:12:57] step 196/5000 loss 0.1993 (w 0.0912 mse 0.0903 t 504 new 0.29) lr 9.80e-06 gnorm 0.118 5.69s mem 15.6GB +[2026-09-13 16:13:03] step 197/5000 loss 0.1077 (w 0.1289 mse 0.1261 t 951 new 0.22) lr 9.85e-06 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 16:13:08] step 198/5000 loss 0.0582 (w 0.0744 mse 0.0724 t 710 new 0.18) lr 9.90e-06 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 16:13:14] step 199/5000 loss 0.1660 (w 0.1612 mse 0.1595 t 352 new 0.20) lr 9.95e-06 gnorm 0.098 5.69s mem 15.6GB +[2026-09-13 16:13:20] step 200/5000 loss 0.1056 (w 0.7649 mse 0.7846 t 34 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:13:26] step 201/5000 loss 0.1279 (w 0.0459 mse 0.0493 t 603 new 0.29) lr 1.00e-05 gnorm 0.108 5.69s mem 15.6GB +[2026-09-13 16:13:32] step 202/5000 loss 0.1096 (w 0.1616 mse 0.1546 t 291 new 0.23) lr 1.00e-05 gnorm 0.075 6.14s mem 15.6GB +[2026-09-13 16:13:38] step 203/5000 loss 0.0789 (w 0.0750 mse 0.0684 t 795 new 0.23) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 16:13:43] step 204/5000 loss 0.0819 (w 0.0984 mse 0.0919 t 831 new 0.22) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 16:13:49] step 205/5000 loss 0.0958 (w 0.0913 mse 0.0891 t 887 new 0.24) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 16:13:55] step 206/5000 loss 0.1242 (w 0.3293 mse 0.3236 t 993 new 0.10) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:14:01] step 207/5000 loss 0.1000 (w 0.1033 mse 0.1016 t 790 new 0.26) lr 1.00e-05 gnorm 0.101 5.69s mem 15.6GB +[2026-09-13 16:14:06] step 208/5000 loss 0.1184 (w 0.1044 mse 0.1033 t 945 new 0.30) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 16:14:12] step 209/5000 loss 0.0950 (w 0.1131 mse 0.1107 t 698 new 0.18) lr 1.00e-05 gnorm 0.115 5.69s mem 15.6GB +[2026-09-13 16:14:18] step 210/5000 loss 0.1024 (w 0.2263 mse 0.2219 t 198 new 0.20) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 16:14:24] step 211/5000 loss 0.0609 (w 0.1670 mse 0.1726 t 986 new 0.27) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 16:14:29] step 212/5000 loss 0.1097 (w 0.1270 mse 0.1241 t 372 new 0.18) lr 1.00e-05 gnorm 0.073 5.73s mem 15.6GB +[2026-09-13 16:14:35] step 213/5000 loss 0.0480 (w 0.3857 mse 0.3316 t 990 new 0.29) lr 1.00e-05 gnorm 0.118 5.78s mem 15.6GB +[2026-09-13 16:14:41] step 214/5000 loss 0.1125 (w 0.1486 mse 0.1473 t 947 new 0.22) lr 1.00e-05 gnorm 0.100 5.68s mem 15.6GB +[2026-09-13 16:14:47] step 215/5000 loss 0.0819 (w 0.0864 mse 0.0866 t 836 new 0.12) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 16:14:52] step 216/5000 loss 0.1006 (w 0.0642 mse 0.0641 t 845 new 0.12) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 16:14:58] step 217/5000 loss 0.1272 (w 0.0643 mse 0.0679 t 683 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 16:15:04] step 218/5000 loss 0.0741 (w 0.0912 mse 0.0872 t 642 new 0.22) lr 1.00e-05 gnorm 0.110 5.68s mem 15.6GB +[2026-09-13 16:15:09] step 219/5000 loss 0.1473 (w 0.0847 mse 0.0858 t 626 new 0.21) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +[2026-09-13 16:15:15] step 220/5000 loss 0.0967 (w 0.0816 mse 0.0785 t 788 new 0.28) lr 1.00e-05 gnorm 0.098 5.69s mem 15.6GB +[2026-09-13 16:15:21] step 221/5000 loss 0.0827 (w 0.0906 mse 0.0903 t 651 new 0.17) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 16:15:26] step 222/5000 loss 0.0964 (w 0.0891 mse 0.0862 t 860 new 0.14) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 16:15:33] step 223/5000 loss 0.0695 (w 0.0921 mse 0.0888 t 865 new 0.24) lr 1.00e-05 gnorm 0.075 6.15s mem 15.6GB +[2026-09-13 16:15:38] step 224/5000 loss 0.1521 (w 0.1363 mse 0.1307 t 916 new 0.10) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:15:44] step 225/5000 loss 0.0512 (w 0.2355 mse 0.2209 t 995 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 16:15:50] step 226/5000 loss 0.1013 (w 0.0917 mse 0.0850 t 857 new 0.23) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 16:15:55] step 227/5000 loss 0.0820 (w 0.0857 mse 0.0849 t 952 new 0.17) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 16:16:01] step 228/5000 loss 0.1091 (w 0.2070 mse 0.2122 t 996 new 0.13) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +[2026-09-13 16:16:07] step 229/5000 loss 0.0675 (w 0.0853 mse 0.0900 t 965 new 0.11) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +[2026-09-13 16:16:13] step 230/5000 loss 0.0522 (w 0.1031 mse 0.1029 t 873 new 0.20) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 16:16:18] step 231/5000 loss 0.0518 (w 0.0565 mse 0.0562 t 778 new 0.08) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:16:24] step 232/5000 loss 0.1698 (w 0.2136 mse 0.2030 t 975 new 0.25) lr 1.00e-05 gnorm 0.102 5.69s mem 15.6GB +[2026-09-13 16:16:30] step 233/5000 loss 0.0949 (w 0.0881 mse 0.0857 t 777 new 0.18) lr 1.00e-05 gnorm 0.095 5.68s mem 15.6GB +[2026-09-13 16:16:36] step 234/5000 loss 0.0983 (w 0.1507 mse 0.1477 t 940 new 0.17) lr 1.00e-05 gnorm 0.094 5.80s mem 15.6GB +[2026-09-13 16:16:41] step 235/5000 loss 0.1422 (w 0.2207 mse 0.2215 t 999 new 0.16) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +[2026-09-13 16:16:47] step 236/5000 loss 0.0876 (w 0.1123 mse 0.1019 t 929 new 0.20) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 16:16:53] step 237/5000 loss 0.1002 (w 0.0603 mse 0.0571 t 759 new 0.22) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +[2026-09-13 16:16:59] step 238/5000 loss 0.1003 (w 0.0554 mse 0.0595 t 642 new 0.22) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +[2026-09-13 16:17:04] step 239/5000 loss 0.0763 (w 0.0916 mse 0.1110 t 205 new 0.23) lr 1.00e-05 gnorm 0.107 5.69s mem 15.6GB +[2026-09-13 16:17:10] step 240/5000 loss 0.1006 (w 0.0934 mse 0.0934 t 511 new 0.23) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +[2026-09-13 16:17:16] step 241/5000 loss 0.1701 (w 0.0918 mse 0.0828 t 370 new 0.19) lr 1.00e-05 gnorm 0.122 5.68s mem 15.6GB +[2026-09-13 16:17:21] step 242/5000 loss 0.0581 (w 0.1258 mse 0.1174 t 929 new 0.11) lr 1.00e-05 gnorm 0.102 5.69s mem 15.6GB +[2026-09-13 16:17:27] step 243/5000 loss 0.0811 (w 0.0376 mse 0.0370 t 762 new 0.12) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +[2026-09-13 16:17:33] step 244/5000 loss 0.1678 (w 0.1123 mse 0.1089 t 391 new 0.30) lr 1.00e-05 gnorm 0.125 5.92s mem 15.6GB +[2026-09-13 16:17:39] step 245/5000 loss 0.0973 (w 0.0979 mse 0.1041 t 317 new 0.27) lr 1.00e-05 gnorm 0.093 5.70s mem 15.6GB +[2026-09-13 16:17:44] step 246/5000 loss 0.1376 (w 0.2346 mse 0.2343 t 219 new 0.25) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 16:17:50] step 247/5000 loss 0.1223 (w 0.0525 mse 0.0629 t 984 new 0.21) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +[2026-09-13 16:17:56] step 248/5000 loss 0.1110 (w 0.0874 mse 0.0825 t 630 new 0.33) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 16:18:02] step 249/5000 loss 0.1263 (w 0.2660 mse 0.2640 t 180 new 0.20) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 16:18:07] step 250/5000 loss 0.0755 (w 0.1307 mse 0.1206 t 320 new 0.21) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +[2026-09-13 16:18:13] step 251/5000 loss 0.1281 (w 0.0983 mse 0.0984 t 518 new 0.24) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 16:18:19] step 252/5000 loss 0.0813 (w 0.0811 mse 0.0782 t 838 new 0.25) lr 1.00e-05 gnorm 0.099 5.70s mem 15.6GB +[2026-09-13 16:18:24] step 253/5000 loss 0.1152 (w 0.0900 mse 0.0857 t 522 new 0.25) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +[2026-09-13 16:18:30] step 254/5000 loss 0.0939 (w 0.1219 mse 0.1205 t 848 new 0.19) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +[2026-09-13 16:18:36] step 255/5000 loss 0.1196 (w 0.0673 mse 0.0648 t 610 new 0.26) lr 1.00e-05 gnorm 0.081 5.73s mem 15.6GB +[2026-09-13 16:18:42] step 256/5000 loss 0.0931 (w 0.0989 mse 0.0931 t 948 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 16:18:47] step 257/5000 loss 0.0596 (w 0.0638 mse 0.0642 t 608 new 0.26) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +[2026-09-13 16:18:53] step 258/5000 loss 0.1146 (w 0.0782 mse 0.0787 t 895 new 0.26) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:18:59] step 259/5000 loss 0.1143 (w 0.0984 mse 0.0951 t 773 new 0.26) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 16:19:04] step 260/5000 loss 0.1060 (w 0.0452 mse 0.0486 t 641 new 0.14) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:19:10] step 261/5000 loss 0.1214 (w 0.0636 mse 0.0627 t 621 new 0.20) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 16:19:16] step 262/5000 loss 0.0630 (w 0.0685 mse 0.0645 t 880 new 0.22) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 16:19:21] step 263/5000 loss 0.0759 (w 0.1203 mse 0.1118 t 920 new 0.26) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 16:19:27] step 264/5000 loss 0.0692 (w 0.0864 mse 0.0852 t 557 new 0.22) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:19:33] step 265/5000 loss 0.1367 (w 0.0833 mse 0.0822 t 894 new 0.25) lr 1.00e-05 gnorm 0.082 5.90s mem 15.6GB +[2026-09-13 16:19:39] step 266/5000 loss 0.0563 (w 0.0730 mse 0.0691 t 652 new 0.24) lr 1.00e-05 gnorm 0.075 5.96s mem 15.6GB +[2026-09-13 16:19:45] step 267/5000 loss 0.1038 (w 0.1209 mse 0.1343 t 979 new 0.21) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +[2026-09-13 16:19:50] step 268/5000 loss 0.0977 (w 0.1458 mse 0.1347 t 981 new 0.23) lr 1.00e-05 gnorm 0.100 5.70s mem 15.6GB +[2026-09-13 16:19:56] step 269/5000 loss 0.1282 (w 0.0932 mse 0.0842 t 959 new 0.16) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 16:20:02] step 270/5000 loss 0.1005 (w 0.0825 mse 0.0772 t 863 new 0.23) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 16:20:08] step 271/5000 loss 0.0810 (w 0.0306 mse 0.0340 t 566 new 0.14) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 16:20:13] step 272/5000 loss 0.1024 (w 0.0878 mse 0.0852 t 929 new 0.21) lr 1.00e-05 gnorm 0.088 5.70s mem 15.6GB +[2026-09-13 16:20:19] step 273/5000 loss 0.1170 (w 0.1331 mse 0.1292 t 981 new 0.25) lr 1.00e-05 gnorm 0.108 5.70s mem 15.6GB +[2026-09-13 16:20:25] step 274/5000 loss 0.1218 (w 0.1934 mse 0.1837 t 957 new 0.29) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +[2026-09-13 16:20:30] step 275/5000 loss 0.1227 (w 0.1200 mse 0.1189 t 577 new 0.22) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:20:36] step 276/5000 loss 0.0888 (w 0.7261 mse 0.7244 t 43 new 0.20) lr 1.00e-05 gnorm 0.087 5.84s mem 15.6GB +[2026-09-13 16:20:42] step 277/5000 loss 0.1538 (w 0.0818 mse 0.0846 t 627 new 0.24) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 16:20:48] step 278/5000 loss 0.1301 (w 0.1157 mse 0.1148 t 881 new 0.21) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 16:20:53] step 279/5000 loss 0.1218 (w 0.0930 mse 0.0904 t 972 new 0.20) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 16:20:59] step 280/5000 loss 0.1616 (w 0.6124 mse 0.6191 t 48 new 0.13) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:21:05] step 281/5000 loss 0.1171 (w 0.3092 mse 0.3087 t 157 new 0.24) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 16:21:11] step 282/5000 loss 0.0799 (w 0.1022 mse 0.0985 t 846 new 0.16) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 16:21:16] step 283/5000 loss 0.1344 (w 0.2754 mse 0.2712 t 232 new 0.24) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 16:21:22] step 284/5000 loss 0.0483 (w 0.1166 mse 0.1067 t 974 new 0.24) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 16:21:28] step 285/5000 loss 0.1065 (w 0.1256 mse 0.1221 t 919 new 0.22) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 16:21:33] step 286/5000 loss 0.0763 (w 0.1542 mse 0.1504 t 258 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 16:21:39] step 287/5000 loss 0.1142 (w 0.0462 mse 0.0408 t 869 new 0.16) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 16:21:45] step 288/5000 loss 0.0891 (w 0.0763 mse 0.0777 t 545 new 0.19) lr 1.00e-05 gnorm 0.072 5.92s mem 15.6GB +[2026-09-13 16:21:51] step 289/5000 loss 0.0786 (w 0.0945 mse 0.0856 t 844 new 0.24) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 16:21:56] step 290/5000 loss 0.0354 (w 0.0468 mse 0.0468 t 896 new 0.20) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 16:22:02] step 291/5000 loss 0.1079 (w 0.0771 mse 0.0782 t 913 new 0.25) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 16:22:08] step 292/5000 loss 0.0722 (w 0.0833 mse 0.0823 t 910 new 0.19) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 16:22:13] step 293/5000 loss 0.1288 (w 0.0931 mse 0.0946 t 396 new 0.18) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 16:22:19] step 294/5000 loss 0.0728 (w 0.0904 mse 0.0897 t 925 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 16:22:25] step 295/5000 loss 0.0798 (w 0.0687 mse 0.0720 t 461 new 0.28) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:22:31] step 296/5000 loss 0.0596 (w 0.4843 mse 0.4661 t 995 new 0.26) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 16:22:36] step 297/5000 loss 0.1280 (w 0.0975 mse 0.0920 t 949 new 0.18) lr 1.00e-05 gnorm 0.094 5.70s mem 15.6GB +[2026-09-13 16:22:42] step 298/5000 loss 0.0893 (w 0.0605 mse 0.0638 t 781 new 0.23) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +[2026-09-13 16:22:48] step 299/5000 loss 0.1274 (w 0.1002 mse 0.0977 t 890 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 16:22:53] step 300/5000 loss 0.1109 (w 0.0787 mse 0.0735 t 606 new 0.25) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 16:22:59] step 301/5000 loss 0.0922 (w 0.1545 mse 0.1597 t 985 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:23:05] step 302/5000 loss 0.0882 (w 0.4745 mse 0.4866 t 62 new 0.12) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 16:23:11] step 303/5000 loss 0.1393 (w 0.1129 mse 0.1101 t 581 new 0.23) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 16:23:16] step 304/5000 loss 0.1216 (w 0.0648 mse 0.0626 t 644 new 0.24) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 16:23:22] step 305/5000 loss 0.1104 (w 0.0669 mse 0.0635 t 760 new 0.24) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 16:23:28] step 306/5000 loss 0.0868 (w 0.1050 mse 0.0924 t 936 new 0.26) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 16:23:34] step 307/5000 loss 0.0934 (w 0.1257 mse 0.1148 t 969 new 0.24) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 16:23:39] step 308/5000 loss 0.0842 (w 0.0646 mse 0.0648 t 895 new 0.13) lr 1.00e-05 gnorm 0.070 5.91s mem 15.6GB +[2026-09-13 16:23:45] step 309/5000 loss 0.0422 (w 0.0673 mse 0.0669 t 320 new 0.07) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 16:23:51] step 310/5000 loss 0.0990 (w 0.0627 mse 0.0645 t 744 new 0.18) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 16:23:57] step 311/5000 loss 0.1147 (w 0.1010 mse 0.1021 t 451 new 0.29) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 16:24:02] step 312/5000 loss 0.0963 (w 0.0834 mse 0.0837 t 523 new 0.16) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 16:24:08] step 313/5000 loss 0.1678 (w 0.1157 mse 0.1090 t 889 new 0.27) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 16:24:14] step 314/5000 loss 0.0935 (w 0.1065 mse 0.1033 t 744 new 0.24) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 16:24:19] step 315/5000 loss 0.1171 (w 0.4422 mse 0.4367 t 75 new 0.22) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 16:24:25] step 316/5000 loss 0.1086 (w 0.0891 mse 0.0902 t 647 new 0.21) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 16:24:31] step 317/5000 loss 0.1131 (w 0.1723 mse 0.1610 t 964 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:24:37] step 318/5000 loss 0.0628 (w 0.1168 mse 0.1164 t 834 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 16:24:42] step 319/5000 loss 0.0924 (w 0.0648 mse 0.0660 t 723 new 0.25) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 16:24:48] step 320/5000 loss 0.0747 (w 0.0721 mse 0.0684 t 866 new 0.19) lr 1.00e-05 gnorm 0.106 5.70s mem 15.6GB +[2026-09-13 16:24:54] step 321/5000 loss 0.0795 (w 0.1379 mse 0.1321 t 970 new 0.26) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:24:59] step 322/5000 loss 0.0627 (w 0.0674 mse 0.0640 t 961 new 0.23) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 16:25:05] step 323/5000 loss 0.0659 (w 0.2561 mse 0.2461 t 998 new 0.24) lr 1.00e-05 gnorm 0.107 5.69s mem 15.6GB +[2026-09-13 16:25:11] step 324/5000 loss 0.0881 (w 0.2548 mse 0.2252 t 994 new 0.25) lr 1.00e-05 gnorm 0.085 5.70s mem 15.6GB +[2026-09-13 16:25:17] step 325/5000 loss 0.0414 (w 0.3114 mse 0.2860 t 997 new 0.26) lr 1.00e-05 gnorm 0.079 5.71s mem 15.6GB +[2026-09-13 16:25:22] step 326/5000 loss 0.1355 (w 0.0928 mse 0.0967 t 971 new 0.28) lr 1.00e-05 gnorm 0.100 5.69s mem 15.6GB +[2026-09-13 16:25:28] step 327/5000 loss 0.0702 (w 0.1079 mse 0.0977 t 906 new 0.26) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 16:25:34] step 328/5000 loss 0.1040 (w 0.1564 mse 0.1596 t 975 new 0.21) lr 1.00e-05 gnorm 0.084 5.86s mem 15.6GB +[2026-09-13 16:25:40] step 329/5000 loss 0.0887 (w 0.1177 mse 0.1138 t 944 new 0.28) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 16:25:46] step 330/5000 loss 0.0632 (w 0.1380 mse 0.1354 t 956 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:25:51] step 331/5000 loss 0.1225 (w 0.0514 mse 0.0553 t 825 new 0.27) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:25:57] step 332/5000 loss 0.0710 (w 0.1320 mse 0.1264 t 919 new 0.10) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 16:26:03] step 333/5000 loss 0.1069 (w 0.0798 mse 0.0803 t 754 new 0.21) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +[2026-09-13 16:26:08] step 334/5000 loss 0.0578 (w 0.1466 mse 0.1380 t 984 new 0.22) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 16:26:14] step 335/5000 loss 0.0946 (w 0.0761 mse 0.0731 t 591 new 0.21) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 16:26:20] step 336/5000 loss 0.1161 (w 0.0436 mse 0.0452 t 954 new 0.11) lr 1.00e-05 gnorm 0.125 5.70s mem 15.6GB +[2026-09-13 16:26:25] step 337/5000 loss 0.0931 (w 0.1650 mse 0.1685 t 208 new 0.18) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 16:26:31] step 338/5000 loss 0.0436 (w 0.1648 mse 0.1591 t 954 new 0.27) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 16:26:37] step 339/5000 loss 0.1000 (w 0.0759 mse 0.0775 t 887 new 0.21) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 16:26:43] step 340/5000 loss 0.0950 (w 0.1608 mse 0.1615 t 972 new 0.26) lr 1.00e-05 gnorm 0.061 5.79s mem 15.6GB +[2026-09-13 16:26:48] step 341/5000 loss 0.1415 (w 0.0838 mse 0.0816 t 666 new 0.26) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 16:26:54] step 342/5000 loss 0.0382 (w 0.2579 mse 0.2507 t 993 new 0.20) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:27:00] step 343/5000 loss 0.1142 (w 0.1008 mse 0.0942 t 707 new 0.20) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:27:06] step 344/5000 loss 0.0840 (w 0.0705 mse 0.0693 t 908 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 16:27:11] step 345/5000 loss 0.0936 (w 0.0784 mse 0.0847 t 339 new 0.15) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 16:27:17] step 346/5000 loss 0.1180 (w 0.0785 mse 0.0767 t 434 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 16:27:23] step 347/5000 loss 0.0758 (w 0.0817 mse 0.0792 t 822 new 0.25) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:27:28] step 348/5000 loss 0.0781 (w 0.1378 mse 0.1312 t 940 new 0.24) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 16:27:34] step 349/5000 loss 0.1441 (w 0.0504 mse 0.0485 t 612 new 0.27) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:27:40] step 350/5000 loss 0.1125 (w 0.1732 mse 0.1692 t 972 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 16:27:45] step 351/5000 loss 0.1379 (w 0.0917 mse 0.0922 t 754 new 0.14) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 16:27:51] step 352/5000 loss 0.1110 (w 0.1024 mse 0.0911 t 885 new 0.23) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:27:57] step 353/5000 loss 0.0766 (w 0.1315 mse 0.1323 t 955 new 0.21) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 16:28:03] step 354/5000 loss 0.1201 (w 0.1626 mse 0.1613 t 414 new 0.21) lr 1.00e-05 gnorm 0.104 5.69s mem 15.6GB +[2026-09-13 16:28:08] step 355/5000 loss 0.0917 (w 0.1000 mse 0.0992 t 869 new 0.18) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:28:14] step 356/5000 loss 0.1074 (w 0.1119 mse 0.1072 t 844 new 0.26) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 16:28:20] step 357/5000 loss 0.1096 (w 0.0891 mse 0.0892 t 667 new 0.30) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 16:28:25] step 358/5000 loss 0.1465 (w 0.0808 mse 0.0748 t 873 new 0.25) lr 1.00e-05 gnorm 0.123 5.69s mem 15.6GB +[2026-09-13 16:28:31] step 359/5000 loss 0.0852 (w 0.0561 mse 0.0576 t 459 new 0.22) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 16:28:37] step 360/5000 loss 0.0598 (w 0.0785 mse 0.0708 t 673 new 0.24) lr 1.00e-05 gnorm 0.101 5.97s mem 15.6GB +[2026-09-13 16:28:43] step 361/5000 loss 0.0986 (w 0.0606 mse 0.0602 t 615 new 0.18) lr 1.00e-05 gnorm 0.115 5.70s mem 15.6GB +[2026-09-13 16:28:48] step 362/5000 loss 0.0753 (w 0.0499 mse 0.0509 t 659 new 0.07) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 16:28:54] step 363/5000 loss 0.0849 (w 0.0972 mse 0.0990 t 877 new 0.27) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 16:29:00] step 364/5000 loss 0.1355 (w 0.0873 mse 0.0858 t 572 new 0.25) lr 1.00e-05 gnorm 0.112 5.70s mem 15.6GB +[2026-09-13 16:29:06] step 365/5000 loss 0.1060 (w 0.0612 mse 0.0730 t 273 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 16:29:11] step 366/5000 loss 0.0899 (w 0.0999 mse 0.1003 t 919 new 0.09) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 16:29:17] step 367/5000 loss 0.1150 (w 0.0850 mse 0.0816 t 518 new 0.26) lr 1.00e-05 gnorm 0.155 5.69s mem 15.6GB +[2026-09-13 16:29:23] step 368/5000 loss 0.0464 (w 0.0831 mse 0.0753 t 920 new 0.29) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +[2026-09-13 16:29:29] step 369/5000 loss 0.0897 (w 0.0746 mse 0.0736 t 549 new 0.15) lr 1.00e-05 gnorm 0.095 5.91s mem 15.6GB +[2026-09-13 16:29:35] step 370/5000 loss 0.0700 (w 0.0863 mse 0.0871 t 922 new 0.15) lr 1.00e-05 gnorm 0.120 5.70s mem 15.6GB +[2026-09-13 16:29:40] step 371/5000 loss 0.1378 (w 0.1173 mse 0.1132 t 767 new 0.29) lr 1.00e-05 gnorm 0.091 5.80s mem 15.6GB +[2026-09-13 16:29:46] step 372/5000 loss 0.1133 (w 0.1251 mse 0.1217 t 923 new 0.23) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 16:29:52] step 373/5000 loss 0.0597 (w 0.0769 mse 0.0733 t 877 new 0.26) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 16:29:58] step 374/5000 loss 0.0704 (w 0.0648 mse 0.0631 t 718 new 0.26) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 16:30:03] step 375/5000 loss 0.0626 (w 0.1624 mse 0.1644 t 959 new 0.18) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 16:30:09] step 376/5000 loss 0.0737 (w 0.0330 mse 0.0321 t 830 new 0.23) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 16:30:15] step 377/5000 loss 0.1495 (w 0.5802 mse 0.5930 t 53 new 0.29) lr 1.00e-05 gnorm 0.110 5.70s mem 15.6GB +[2026-09-13 16:30:20] step 378/5000 loss 0.0688 (w 0.0772 mse 0.0709 t 771 new 0.23) lr 1.00e-05 gnorm 0.134 5.69s mem 15.6GB +[2026-09-13 16:30:26] step 379/5000 loss 0.0600 (w 0.1034 mse 0.0943 t 909 new 0.22) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 16:30:32] step 380/5000 loss 0.0823 (w 0.0940 mse 0.0952 t 968 new 0.12) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 16:30:37] step 381/5000 loss 0.1509 (w 0.0855 mse 0.0868 t 925 new 0.22) lr 1.00e-05 gnorm 0.130 5.69s mem 15.6GB +[2026-09-13 16:30:43] step 382/5000 loss 0.1129 (w 0.0703 mse 0.0660 t 522 new 0.25) lr 1.00e-05 gnorm 0.084 5.91s mem 15.6GB +[2026-09-13 16:30:49] step 383/5000 loss 0.0933 (w 0.1167 mse 0.1143 t 577 new 0.18) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +[2026-09-13 16:30:55] step 384/5000 loss 0.1232 (w 0.1375 mse 0.1408 t 314 new 0.20) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +[2026-09-13 16:31:01] step 385/5000 loss 0.0983 (w 0.0681 mse 0.0642 t 860 new 0.19) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 16:31:06] step 386/5000 loss 0.0937 (w 0.1060 mse 0.1041 t 907 new 0.20) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 16:31:12] step 387/5000 loss 0.1119 (w 0.0713 mse 0.0710 t 533 new 0.25) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 16:31:18] step 388/5000 loss 0.1049 (w 0.1020 mse 0.0951 t 721 new 0.29) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 16:31:23] step 389/5000 loss 0.0804 (w 0.0905 mse 0.0892 t 964 new 0.22) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 16:31:29] step 390/5000 loss 0.0654 (w 0.0865 mse 0.0830 t 747 new 0.24) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +[2026-09-13 16:31:35] step 391/5000 loss 0.1343 (w 0.0746 mse 0.0732 t 842 new 0.13) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 16:31:41] step 392/5000 loss 0.0997 (w 0.1139 mse 0.1081 t 962 new 0.25) lr 1.00e-05 gnorm 0.065 5.86s mem 15.6GB +[2026-09-13 16:31:47] step 393/5000 loss 0.1201 (w 0.3632 mse 0.3593 t 138 new 0.21) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +[2026-09-13 16:31:52] step 394/5000 loss 0.0851 (w 0.0877 mse 0.0854 t 488 new 0.29) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +[2026-09-13 16:31:58] step 395/5000 loss 0.1249 (w 0.2209 mse 0.2128 t 988 new 0.19) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:32:04] step 396/5000 loss 0.1073 (w 0.3139 mse 0.3101 t 995 new 0.12) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 16:32:09] step 397/5000 loss 0.0736 (w 0.0738 mse 0.0705 t 877 new 0.13) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 16:32:15] step 398/5000 loss 0.1159 (w 0.1203 mse 0.1182 t 347 new 0.15) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:32:21] step 399/5000 loss 0.0762 (w 0.0431 mse 0.0459 t 482 new 0.13) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 16:32:27] step 400/5000 loss 0.1097 (w 0.1268 mse 0.1249 t 763 new 0.23) lr 1.00e-05 gnorm 0.074 5.85s mem 15.6GB +[2026-09-13 16:32:32] step 401/5000 loss 0.1205 (w 0.0669 mse 0.0654 t 769 new 0.23) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 16:32:38] step 402/5000 loss 0.1097 (w 0.1923 mse 0.1923 t 985 new 0.23) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 16:32:44] step 403/5000 loss 0.0939 (w 0.1045 mse 0.1050 t 592 new 0.15) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 16:32:50] step 404/5000 loss 0.0948 (w 0.0497 mse 0.0493 t 549 new 0.15) lr 1.00e-05 gnorm 0.097 5.70s mem 15.6GB +[2026-09-13 16:32:55] step 405/5000 loss 0.0845 (w 0.0683 mse 0.0663 t 854 new 0.21) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +[2026-09-13 16:33:01] step 406/5000 loss 0.1057 (w 0.0661 mse 0.0627 t 878 new 0.25) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 16:33:07] step 407/5000 loss 0.0581 (w 0.0969 mse 0.0982 t 948 new 0.13) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 16:33:12] step 408/5000 loss 0.0795 (w 0.0723 mse 0.0673 t 818 new 0.28) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 16:33:18] step 409/5000 loss 0.1140 (w 0.0676 mse 0.0672 t 619 new 0.17) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 16:33:24] step 410/5000 loss 0.0899 (w 0.0649 mse 0.0633 t 901 new 0.26) lr 1.00e-05 gnorm 0.081 5.87s mem 15.6GB +[2026-09-13 16:33:30] step 411/5000 loss 0.0958 (w 0.0695 mse 0.0677 t 596 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:33:35] step 412/5000 loss 0.0630 (w 0.1894 mse 0.1902 t 984 new 0.12) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:33:41] step 413/5000 loss 0.0731 (w 0.2545 mse 0.2309 t 999 new 0.19) lr 1.00e-05 gnorm 0.074 5.95s mem 15.6GB +[2026-09-13 16:33:47] step 414/5000 loss 0.1120 (w 0.0875 mse 0.0852 t 889 new 0.20) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 16:33:53] step 415/5000 loss 0.1005 (w 0.0783 mse 0.0704 t 719 new 0.18) lr 1.00e-05 gnorm 0.097 5.68s mem 15.6GB +[2026-09-13 16:33:58] step 416/5000 loss 0.1035 (w 0.0894 mse 0.0866 t 934 new 0.25) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 16:34:04] step 417/5000 loss 0.0971 (w 0.1039 mse 0.1003 t 443 new 0.22) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 16:34:10] step 418/5000 loss 0.0637 (w 0.1054 mse 0.1022 t 952 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 16:34:16] step 419/5000 loss 0.0779 (w 0.0828 mse 0.0786 t 913 new 0.20) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 16:34:21] step 420/5000 loss 0.1021 (w 0.0608 mse 0.0602 t 556 new 0.25) lr 1.00e-05 gnorm 0.094 5.68s mem 15.6GB +[2026-09-13 16:34:27] step 421/5000 loss 0.0676 (w 0.0497 mse 0.0525 t 403 new 0.17) lr 1.00e-05 gnorm 0.072 5.90s mem 15.6GB +[2026-09-13 16:34:33] step 422/5000 loss 0.1204 (w 0.0861 mse 0.0910 t 712 new 0.28) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +[2026-09-13 16:34:39] step 423/5000 loss 0.1030 (w 0.1035 mse 0.0996 t 887 new 0.17) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:34:44] step 424/5000 loss 0.0876 (w 0.0354 mse 0.0381 t 744 new 0.12) lr 1.00e-05 gnorm 0.088 5.88s mem 15.6GB +[2026-09-13 16:34:50] step 425/5000 loss 0.1303 (w 0.0615 mse 0.0593 t 687 new 0.26) lr 1.00e-05 gnorm 0.107 5.69s mem 15.6GB +[2026-09-13 16:34:56] step 426/5000 loss 0.0813 (w 0.0598 mse 0.0600 t 532 new 0.26) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 16:35:02] step 427/5000 loss 0.1244 (w 0.0997 mse 0.0906 t 584 new 0.20) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:35:07] step 428/5000 loss 0.0691 (w 0.1347 mse 0.1238 t 962 new 0.26) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 16:35:13] step 429/5000 loss 0.1066 (w 0.1544 mse 0.1513 t 991 new 0.22) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 16:35:19] step 430/5000 loss 0.0961 (w 0.0952 mse 0.0862 t 893 new 0.28) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 16:35:25] step 431/5000 loss 0.0917 (w 0.0887 mse 0.0871 t 823 new 0.20) lr 1.00e-05 gnorm 0.095 6.10s mem 15.6GB +[2026-09-13 16:35:31] step 432/5000 loss 0.1187 (w 0.0678 mse 0.0614 t 725 new 0.22) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 16:35:36] step 433/5000 loss 0.0888 (w 0.0670 mse 0.0641 t 672 new 0.26) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:35:42] step 434/5000 loss 0.0576 (w 0.0755 mse 0.0770 t 888 new 0.16) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:35:48] step 435/5000 loss 0.0772 (w 0.0921 mse 0.0895 t 434 new 0.19) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 16:35:53] step 436/5000 loss 0.1256 (w 0.0830 mse 0.0809 t 736 new 0.20) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 16:35:59] step 437/5000 loss 0.0723 (w 0.0956 mse 0.0937 t 699 new 0.21) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +[2026-09-13 16:36:05] step 438/5000 loss 0.0759 (w 0.1163 mse 0.1197 t 294 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:36:10] step 439/5000 loss 0.0414 (w 0.2682 mse 0.2682 t 996 new 0.26) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 16:36:16] step 440/5000 loss 0.1258 (w 0.1777 mse 0.1690 t 962 new 0.24) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 16:36:22] step 441/5000 loss 0.0857 (w 0.0821 mse 0.0805 t 465 new 0.25) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 16:36:28] step 442/5000 loss 0.1562 (w 0.1389 mse 0.1321 t 681 new 0.28) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +[2026-09-13 16:36:33] step 443/5000 loss 0.0739 (w 0.0461 mse 0.0447 t 893 new 0.22) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 16:36:39] step 444/5000 loss 0.0582 (w 0.0326 mse 0.0369 t 451 new 0.14) lr 1.00e-05 gnorm 0.072 5.83s mem 15.6GB +[2026-09-13 16:36:45] step 445/5000 loss 0.0932 (w 0.1131 mse 0.1117 t 744 new 0.30) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 16:36:51] step 446/5000 loss 0.1138 (w 0.0706 mse 0.0700 t 692 new 0.28) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 16:36:56] step 447/5000 loss 0.0658 (w 0.0475 mse 0.0510 t 883 new 0.26) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 16:37:02] step 448/5000 loss 0.1172 (w 0.0912 mse 0.0880 t 455 new 0.24) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 16:37:08] step 449/5000 loss 0.1310 (w 0.1091 mse 0.1033 t 875 new 0.25) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 16:37:13] step 450/5000 loss 0.0982 (w 0.0625 mse 0.0609 t 600 new 0.25) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 16:37:19] step 451/5000 loss 0.1126 (w 0.0550 mse 0.0520 t 949 new 0.16) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 16:37:25] step 452/5000 loss 0.1332 (w 0.0846 mse 0.0795 t 506 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 16:37:31] step 453/5000 loss 0.0883 (w 0.0683 mse 0.0685 t 617 new 0.20) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 16:37:36] step 454/5000 loss 0.0836 (w 0.0961 mse 0.0938 t 817 new 0.30) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 16:37:42] step 455/5000 loss 0.0784 (w 0.0914 mse 0.0886 t 606 new 0.15) lr 1.00e-05 gnorm 0.068 5.94s mem 15.6GB +[2026-09-13 16:37:48] step 456/5000 loss 0.1331 (w 0.1443 mse 0.1381 t 372 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:37:54] step 457/5000 loss 0.1104 (w 0.1379 mse 0.1300 t 970 new 0.17) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:37:59] step 458/5000 loss 0.0884 (w 0.0577 mse 0.0579 t 806 new 0.10) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:38:05] step 459/5000 loss 0.0792 (w 0.0966 mse 0.0886 t 634 new 0.25) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +[2026-09-13 16:38:11] step 460/5000 loss 0.0767 (w 0.0745 mse 0.0713 t 786 new 0.24) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:38:16] step 461/5000 loss 0.1035 (w 0.1449 mse 0.1382 t 982 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:38:22] step 462/5000 loss 0.1382 (w 0.1123 mse 0.1015 t 939 new 0.25) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 16:38:28] step 463/5000 loss 0.0826 (w 0.0976 mse 0.0930 t 931 new 0.28) lr 1.00e-05 gnorm 0.082 5.92s mem 15.6GB +[2026-09-13 16:38:34] step 464/5000 loss 0.0662 (w 0.8960 mse 0.9018 t 20 new 0.29) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 16:38:40] step 465/5000 loss 0.1133 (w 0.0552 mse 0.0512 t 659 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:38:45] step 466/5000 loss 0.1106 (w 0.0936 mse 0.0861 t 894 new 0.25) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 16:38:51] step 467/5000 loss 0.0829 (w 0.1010 mse 0.0956 t 898 new 0.26) lr 1.00e-05 gnorm 0.097 5.70s mem 15.6GB +[2026-09-13 16:38:57] step 468/5000 loss 0.1272 (w 0.1857 mse 0.1900 t 187 new 0.12) lr 1.00e-05 gnorm 0.073 5.79s mem 15.6GB +[2026-09-13 16:39:02] step 469/5000 loss 0.0700 (w 0.0444 mse 0.0487 t 794 new 0.13) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 16:39:08] step 470/5000 loss 0.0684 (w 0.0836 mse 0.0804 t 902 new 0.28) lr 1.00e-05 gnorm 0.110 5.69s mem 15.6GB +[2026-09-13 16:39:14] step 471/5000 loss 0.1109 (w 0.0665 mse 0.0638 t 859 new 0.18) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 16:39:20] step 472/5000 loss 0.1243 (w 0.5716 mse 0.5661 t 71 new 0.24) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:39:25] step 473/5000 loss 0.0952 (w 0.0724 mse 0.0727 t 785 new 0.27) lr 1.00e-05 gnorm 0.099 5.70s mem 15.6GB +[2026-09-13 16:39:31] step 474/5000 loss 0.1011 (w 0.2056 mse 0.1950 t 235 new 0.27) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 16:39:37] step 475/5000 loss 0.0973 (w 0.1840 mse 0.1818 t 975 new 0.12) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +[2026-09-13 16:39:42] step 476/5000 loss 0.1035 (w 0.1369 mse 0.1346 t 336 new 0.31) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 16:39:48] step 477/5000 loss 0.0850 (w 0.2044 mse 0.2066 t 169 new 0.11) lr 1.00e-05 gnorm 0.057 5.92s mem 15.6GB +[2026-09-13 16:39:54] step 478/5000 loss 0.0946 (w 0.1478 mse 0.1378 t 958 new 0.26) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 16:40:00] step 479/5000 loss 0.1070 (w 0.0842 mse 0.0854 t 904 new 0.20) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 16:40:05] step 480/5000 loss 0.1057 (w 0.0926 mse 0.0851 t 794 new 0.17) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:40:11] step 481/5000 loss 0.1124 (w 0.0997 mse 0.0924 t 861 new 0.26) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 16:40:17] step 482/5000 loss 0.1525 (w 0.0693 mse 0.0698 t 709 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:40:23] step 483/5000 loss 0.0738 (w 0.2045 mse 0.1994 t 996 new 0.23) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 16:40:28] step 484/5000 loss 0.0895 (w 0.0545 mse 0.0551 t 707 new 0.10) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:40:34] step 485/5000 loss 0.1007 (w 0.0531 mse 0.0543 t 877 new 0.17) lr 1.00e-05 gnorm 0.084 5.91s mem 15.6GB +[2026-09-13 16:40:40] step 486/5000 loss 0.0740 (w 0.1093 mse 0.1036 t 885 new 0.19) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +[2026-09-13 16:40:46] step 487/5000 loss 0.0485 (w 0.0464 mse 0.0432 t 846 new 0.11) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 16:40:51] step 488/5000 loss 0.1172 (w 0.0846 mse 0.0772 t 785 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 16:40:57] step 489/5000 loss 0.0345 (w 0.0326 mse 0.0353 t 852 new 0.17) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 16:41:03] step 490/5000 loss 0.0732 (w 0.2370 mse 0.2320 t 982 new 0.20) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 16:41:08] step 491/5000 loss 0.1021 (w 0.0647 mse 0.0661 t 826 new 0.22) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:41:14] step 492/5000 loss 0.0906 (w 0.6831 mse 0.6881 t 43 new 0.29) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 16:41:20] step 493/5000 loss 0.1033 (w 0.1221 mse 0.1148 t 950 new 0.32) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 16:41:26] step 494/5000 loss 0.0580 (w 0.0699 mse 0.0709 t 565 new 0.25) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:41:31] step 495/5000 loss 0.0877 (w 0.0532 mse 0.0525 t 774 new 0.25) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 16:41:37] step 496/5000 loss 0.0591 (w 0.0657 mse 0.0631 t 917 new 0.11) lr 1.00e-05 gnorm 0.064 5.71s mem 15.6GB +[2026-09-13 16:41:43] step 497/5000 loss 0.0606 (w 0.0732 mse 0.0724 t 656 new 0.20) lr 1.00e-05 gnorm 0.074 5.92s mem 15.6GB +[2026-09-13 16:41:49] step 498/5000 loss 0.0447 (w 0.1233 mse 0.1177 t 921 new 0.25) lr 1.00e-05 gnorm 0.074 5.72s mem 15.6GB +[2026-09-13 16:41:54] step 499/5000 loss 0.0928 (w 0.0643 mse 0.0678 t 707 new 0.25) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +[2026-09-13 16:42:00] step 500/5000 loss 0.1146 (w 0.0986 mse 0.0977 t 556 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 16:42:05] [val] step 500 t=201: w=0.1849 mse=0.1875 (n=16) t=501: w=0.0767 mse=0.0767 (n=16) t=800: w=0.0655 mse=0.0646 (n=16) | mean w=0.1090 mse=0.1096 5s +[2026-09-13 16:42:09] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step500.safetensors 832 个张量 2.87 GB +[2026-09-13 16:42:15] step 501/5000 loss 0.1118 (w 0.0805 mse 0.0797 t 484 new 0.28) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 16:42:21] step 502/5000 loss 0.0542 (w 0.1100 mse 0.1188 t 964 new 0.24) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 16:42:26] step 503/5000 loss 0.0671 (w 0.0375 mse 0.0389 t 839 new 0.10) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +[2026-09-13 16:42:32] step 504/5000 loss 0.0833 (w 0.0441 mse 0.0462 t 537 new 0.08) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 16:42:38] step 505/5000 loss 0.1039 (w 0.1398 mse 0.1355 t 966 new 0.28) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 16:42:44] step 506/5000 loss 0.0773 (w 0.0509 mse 0.0493 t 769 new 0.16) lr 1.00e-05 gnorm 0.072 5.72s mem 15.6GB +[2026-09-13 16:42:50] step 507/5000 loss 0.1292 (w 0.0755 mse 0.0828 t 967 new 0.22) lr 1.00e-05 gnorm 0.078 5.67s mem 15.6GB +[2026-09-13 16:42:55] step 508/5000 loss 0.1418 (w 0.1293 mse 0.1411 t 161 new 0.20) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:43:01] step 509/5000 loss 0.0933 (w 0.0858 mse 0.0831 t 486 new 0.24) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 16:43:07] step 510/5000 loss 0.0638 (w 0.1990 mse 0.1886 t 989 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 16:43:12] step 511/5000 loss 0.1041 (w 0.1252 mse 0.1216 t 973 new 0.24) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +[2026-09-13 16:43:18] step 512/5000 loss 0.0984 (w 0.0861 mse 0.0838 t 865 new 0.26) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 16:43:24] step 513/5000 loss 0.1127 (w 0.2119 mse 0.2275 t 161 new 0.21) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 16:43:29] step 514/5000 loss 0.0883 (w 0.0631 mse 0.0592 t 751 new 0.23) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 16:43:35] step 515/5000 loss 0.1440 (w 0.0818 mse 0.0774 t 655 new 0.30) lr 1.00e-05 gnorm 0.096 5.68s mem 15.6GB +[2026-09-13 16:43:41] step 516/5000 loss 0.0942 (w 0.1304 mse 0.1257 t 967 new 0.26) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 16:43:47] step 517/5000 loss 0.0652 (w 0.1543 mse 0.1428 t 951 new 0.30) lr 1.00e-05 gnorm 0.096 5.72s mem 15.6GB +[2026-09-13 16:43:52] step 518/5000 loss 0.0871 (w 0.0861 mse 0.0813 t 663 new 0.25) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 16:43:58] step 519/5000 loss 0.1040 (w 0.2652 mse 0.2438 t 999 new 0.19) lr 1.00e-05 gnorm 0.101 5.69s mem 15.6GB +[2026-09-13 16:44:04] step 520/5000 loss 0.0972 (w 0.1694 mse 0.1613 t 987 new 0.25) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 16:44:09] step 521/5000 loss 0.1209 (w 0.2338 mse 0.2370 t 169 new 0.13) lr 1.00e-05 gnorm 0.104 5.68s mem 15.6GB +[2026-09-13 16:44:15] step 522/5000 loss 0.1220 (w 0.0629 mse 0.0686 t 926 new 0.19) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +[2026-09-13 16:44:21] step 523/5000 loss 0.0420 (w 0.1327 mse 0.1308 t 962 new 0.21) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 16:44:26] step 524/5000 loss 0.0631 (w 0.3458 mse 0.3477 t 997 new 0.13) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 16:44:32] step 525/5000 loss 0.0755 (w 0.0414 mse 0.0424 t 774 new 0.13) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +[2026-09-13 16:44:38] step 526/5000 loss 0.0537 (w 0.0884 mse 0.0883 t 890 new 0.26) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 16:44:44] step 527/5000 loss 0.1633 (w 0.0735 mse 0.0688 t 904 new 0.23) lr 1.00e-05 gnorm 0.094 5.68s mem 15.6GB +[2026-09-13 16:44:50] step 528/5000 loss 0.0888 (w 0.1496 mse 0.1591 t 194 new 0.29) lr 1.00e-05 gnorm 0.106 5.67s mem 15.6GB +[2026-09-13 16:44:55] step 529/5000 loss 0.0694 (w 0.2733 mse 0.2853 t 989 new 0.22) lr 1.00e-05 gnorm 0.073 5.83s mem 15.6GB +[2026-09-13 16:45:01] step 530/5000 loss 0.0839 (w 0.1164 mse 0.1125 t 932 new 0.19) lr 1.00e-05 gnorm 0.105 5.69s mem 15.6GB +[2026-09-13 16:45:07] step 531/5000 loss 0.1148 (w 0.0638 mse 0.0652 t 890 new 0.20) lr 1.00e-05 gnorm 0.079 5.74s mem 15.6GB +[2026-09-13 16:45:13] step 532/5000 loss 0.1191 (w 0.0822 mse 0.0747 t 873 new 0.16) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:45:18] step 533/5000 loss 0.0986 (w 0.2901 mse 0.3449 t 34 new 0.22) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 16:45:24] step 534/5000 loss 0.0889 (w 0.0529 mse 0.0566 t 745 new 0.19) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 16:45:30] step 535/5000 loss 0.1140 (w 0.2517 mse 0.2596 t 157 new 0.21) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +[2026-09-13 16:45:35] step 536/5000 loss 0.1200 (w 0.1096 mse 0.1087 t 964 new 0.10) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 16:45:41] step 537/5000 loss 0.1059 (w 0.1130 mse 0.1100 t 325 new 0.23) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 16:45:47] step 538/5000 loss 0.0846 (w 0.1101 mse 0.1003 t 935 new 0.27) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 16:45:53] step 539/5000 loss 0.0957 (w 0.0825 mse 0.0814 t 912 new 0.10) lr 1.00e-05 gnorm 0.073 5.89s mem 15.6GB +[2026-09-13 16:45:58] step 540/5000 loss 0.1128 (w 0.1150 mse 0.1129 t 336 new 0.26) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 16:46:04] step 541/5000 loss 0.0975 (w 0.1215 mse 0.1128 t 944 new 0.22) lr 1.00e-05 gnorm 0.085 5.91s mem 15.6GB +[2026-09-13 16:46:10] step 542/5000 loss 0.0925 (w 0.0683 mse 0.0702 t 924 new 0.16) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 16:46:16] step 543/5000 loss 0.0527 (w 0.0938 mse 0.0903 t 792 new 0.24) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 16:46:21] step 544/5000 loss 0.0860 (w 0.2224 mse 0.2000 t 990 new 0.23) lr 1.00e-05 gnorm 0.109 5.69s mem 15.6GB +[2026-09-13 16:46:27] step 545/5000 loss 0.1062 (w 0.4932 mse 0.5008 t 80 new 0.31) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 16:46:33] step 546/5000 loss 0.0871 (w 0.0340 mse 0.0338 t 794 new 0.11) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 16:46:38] step 547/5000 loss 0.1085 (w 0.1020 mse 0.1011 t 855 new 0.21) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 16:46:45] step 548/5000 loss 0.0922 (w 0.1034 mse 0.1007 t 670 new 0.22) lr 1.00e-05 gnorm 0.080 5.90s mem 15.6GB +[2026-09-13 16:46:50] step 549/5000 loss 0.0650 (w 0.1234 mse 0.1130 t 817 new 0.23) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 16:46:56] step 550/5000 loss 0.0729 (w 0.0834 mse 0.0805 t 781 new 0.21) lr 1.00e-05 gnorm 0.101 5.71s mem 15.6GB +[2026-09-13 16:47:02] step 551/5000 loss 0.0672 (w 0.0607 mse 0.0595 t 859 new 0.22) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 16:47:08] step 552/5000 loss 0.0951 (w 0.1636 mse 0.1485 t 978 new 0.22) lr 1.00e-05 gnorm 0.100 5.79s mem 15.6GB +[2026-09-13 16:47:13] step 553/5000 loss 0.1269 (w 0.6209 mse 0.6157 t 53 new 0.31) lr 1.00e-05 gnorm 0.098 5.68s mem 15.6GB +[2026-09-13 16:47:19] step 554/5000 loss 0.1054 (w 0.0885 mse 0.0856 t 893 new 0.30) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 16:47:25] step 555/5000 loss 0.0855 (w 0.0705 mse 0.0714 t 888 new 0.21) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 16:47:30] step 556/5000 loss 0.0829 (w 0.1088 mse 0.0960 t 937 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 16:47:36] step 557/5000 loss 0.1116 (w 0.2838 mse 0.2995 t 114 new 0.17) lr 1.00e-05 gnorm 0.103 5.68s mem 15.6GB +[2026-09-13 16:47:42] step 558/5000 loss 0.0991 (w 0.1416 mse 0.1322 t 960 new 0.23) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 16:47:48] step 559/5000 loss 0.1190 (w 0.0545 mse 0.0497 t 858 new 0.25) lr 1.00e-05 gnorm 0.068 6.09s mem 15.6GB +[2026-09-13 16:47:54] step 560/5000 loss 0.0569 (w 0.0882 mse 0.0844 t 954 new 0.24) lr 1.00e-05 gnorm 0.076 5.89s mem 15.6GB +[2026-09-13 16:48:00] step 561/5000 loss 0.1477 (w 0.3822 mse 0.3877 t 93 new 0.28) lr 1.00e-05 gnorm 0.093 5.75s mem 15.6GB +[2026-09-13 16:48:05] step 562/5000 loss 0.0863 (w 0.1407 mse 0.1411 t 408 new 0.30) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:48:11] step 563/5000 loss 0.1356 (w 0.0673 mse 0.0649 t 786 new 0.25) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 16:48:17] step 564/5000 loss 0.0881 (w 0.0730 mse 0.0660 t 724 new 0.23) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 16:48:22] step 565/5000 loss 0.0716 (w 0.1834 mse 0.1781 t 258 new 0.24) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 16:48:28] step 566/5000 loss 0.0776 (w 0.0642 mse 0.0646 t 927 new 0.17) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 16:48:34] step 567/5000 loss 0.1326 (w 0.1155 mse 0.1115 t 681 new 0.29) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 16:48:39] step 568/5000 loss 0.0712 (w 0.0523 mse 0.0526 t 896 new 0.27) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 16:48:45] step 569/5000 loss 0.1269 (w 0.1029 mse 0.0978 t 528 new 0.27) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:48:51] step 570/5000 loss 0.0557 (w 0.1262 mse 0.1181 t 934 new 0.21) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 16:48:57] step 571/5000 loss 0.0504 (w 0.0758 mse 0.0746 t 776 new 0.23) lr 1.00e-05 gnorm 0.076 5.92s mem 15.6GB +[2026-09-13 16:49:02] step 572/5000 loss 0.0767 (w 0.0535 mse 0.0513 t 476 new 0.18) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 16:49:08] step 573/5000 loss 0.1000 (w 0.0985 mse 0.0922 t 933 new 0.13) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:49:14] step 574/5000 loss 0.1314 (w 0.0979 mse 0.0965 t 430 new 0.27) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 16:49:20] step 575/5000 loss 0.0750 (w 0.1144 mse 0.1125 t 975 new 0.24) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 16:49:25] step 576/5000 loss 0.1078 (w 0.1138 mse 0.1086 t 571 new 0.29) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 16:49:31] step 577/5000 loss 0.1015 (w 0.1151 mse 0.1098 t 953 new 0.28) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 16:49:37] step 578/5000 loss 0.1160 (w 0.0727 mse 0.0706 t 693 new 0.26) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 16:49:42] step 579/5000 loss 0.0876 (w 0.1470 mse 0.1498 t 969 new 0.21) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 16:49:48] step 580/5000 loss 0.1259 (w 0.0733 mse 0.0754 t 475 new 0.26) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 16:49:54] step 581/5000 loss 0.1108 (w 0.0705 mse 0.0660 t 808 new 0.26) lr 1.00e-05 gnorm 0.081 5.75s mem 15.6GB +[2026-09-13 16:50:00] step 582/5000 loss 0.0750 (w 0.2453 mse 0.2307 t 983 new 0.28) lr 1.00e-05 gnorm 0.066 5.76s mem 15.6GB +[2026-09-13 16:50:06] step 583/5000 loss 0.0661 (w 0.0922 mse 0.0899 t 951 new 0.23) lr 1.00e-05 gnorm 0.078 5.94s mem 15.6GB +[2026-09-13 16:50:11] step 584/5000 loss 0.0782 (w 0.1180 mse 0.1272 t 986 new 0.19) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 16:50:17] step 585/5000 loss 0.1467 (w 0.0617 mse 0.0598 t 883 new 0.12) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +[2026-09-13 16:50:23] step 586/5000 loss 0.0724 (w 0.1634 mse 0.1627 t 975 new 0.23) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +[2026-09-13 16:50:28] step 587/5000 loss 0.0853 (w 0.1883 mse 0.1712 t 997 new 0.26) lr 1.00e-05 gnorm 0.077 5.71s mem 15.6GB +[2026-09-13 16:50:34] step 588/5000 loss 0.0759 (w 0.3367 mse 0.3427 t 989 new 0.19) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 16:50:40] step 589/5000 loss 0.0844 (w 0.0897 mse 0.0909 t 849 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:50:46] step 590/5000 loss 0.1527 (w 0.0890 mse 0.0882 t 912 new 0.23) lr 1.00e-05 gnorm 0.072 5.80s mem 15.6GB +[2026-09-13 16:50:52] step 591/5000 loss 0.1763 (w 0.0733 mse 0.0701 t 658 new 0.26) lr 1.00e-05 gnorm 0.108 5.79s mem 15.6GB +[2026-09-13 16:50:57] step 592/5000 loss 0.0664 (w 0.0865 mse 0.0855 t 871 new 0.25) lr 1.00e-05 gnorm 0.082 5.67s mem 15.6GB +[2026-09-13 16:51:03] step 593/5000 loss 0.1018 (w 0.1505 mse 0.1491 t 938 new 0.22) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 16:51:09] step 594/5000 loss 0.0796 (w 0.0876 mse 0.0831 t 901 new 0.28) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 16:51:15] step 595/5000 loss 0.0914 (w 0.0475 mse 0.0466 t 788 new 0.28) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 16:51:20] step 596/5000 loss 0.0664 (w 0.0502 mse 0.0520 t 866 new 0.28) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 16:51:26] step 597/5000 loss 0.0740 (w 0.0564 mse 0.0560 t 783 new 0.29) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 16:51:32] step 598/5000 loss 0.0943 (w 0.1086 mse 0.1049 t 947 new 0.25) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 16:51:37] step 599/5000 loss 0.0821 (w 0.1080 mse 0.0997 t 938 new 0.28) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 16:51:43] step 600/5000 loss 0.1308 (w 0.1270 mse 0.1217 t 312 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 16:51:49] step 601/5000 loss 0.0726 (w 0.1558 mse 0.1410 t 991 new 0.28) lr 1.00e-05 gnorm 0.075 5.86s mem 15.6GB +[2026-09-13 16:51:55] step 602/5000 loss 0.0964 (w 0.0618 mse 0.0627 t 747 new 0.26) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 16:52:01] step 603/5000 loss 0.0678 (w 0.0684 mse 0.0728 t 949 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 16:52:06] step 604/5000 loss 0.0981 (w 0.0681 mse 0.0689 t 857 new 0.17) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 16:52:12] step 605/5000 loss 0.0473 (w 0.0799 mse 0.0717 t 961 new 0.24) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 16:52:18] step 606/5000 loss 0.1065 (w 0.0745 mse 0.0727 t 926 new 0.17) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 16:52:23] step 607/5000 loss 0.0558 (w 0.0284 mse 0.0313 t 748 new 0.21) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 16:52:29] step 608/5000 loss 0.1260 (w 0.0932 mse 0.0944 t 690 new 0.24) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 16:52:35] step 609/5000 loss 0.1543 (w 0.1337 mse 0.1240 t 965 new 0.26) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 16:52:41] step 610/5000 loss 0.0933 (w 0.6530 mse 0.6807 t 25 new 0.20) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 16:52:46] step 611/5000 loss 0.0643 (w 0.1532 mse 0.1451 t 978 new 0.27) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 16:52:52] step 612/5000 loss 0.1186 (w 0.1304 mse 0.1284 t 969 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:52:58] step 613/5000 loss 0.0915 (w 0.1120 mse 0.1171 t 403 new 0.21) lr 1.00e-05 gnorm 0.052 5.89s mem 15.6GB +[2026-09-13 16:53:04] step 614/5000 loss 0.0937 (w 0.1180 mse 0.1258 t 267 new 0.15) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 16:53:09] step 615/5000 loss 0.0984 (w 0.0999 mse 0.0931 t 859 new 0.21) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 16:53:15] step 616/5000 loss 0.0924 (w 0.0620 mse 0.0601 t 748 new 0.17) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 16:53:21] step 617/5000 loss 0.0794 (w 0.1241 mse 0.1195 t 896 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 16:53:27] step 618/5000 loss 0.0757 (w 0.2431 mse 0.2338 t 990 new 0.25) lr 1.00e-05 gnorm 0.099 5.68s mem 15.6GB +[2026-09-13 16:53:32] step 619/5000 loss 0.0867 (w 0.0559 mse 0.0569 t 726 new 0.23) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +[2026-09-13 16:53:38] step 620/5000 loss 0.1122 (w 0.1013 mse 0.0969 t 739 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 16:53:44] step 621/5000 loss 0.1340 (w 0.0618 mse 0.0638 t 556 new 0.23) lr 1.00e-05 gnorm 0.088 5.70s mem 15.6GB +[2026-09-13 16:53:50] step 622/5000 loss 0.0653 (w 0.0386 mse 0.0408 t 758 new 0.27) lr 1.00e-05 gnorm 0.095 5.85s mem 15.6GB +[2026-09-13 16:53:55] step 623/5000 loss 0.0571 (w 0.0929 mse 0.0853 t 897 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 16:54:01] step 624/5000 loss 0.0723 (w 0.0533 mse 0.0528 t 899 new 0.23) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 16:54:07] step 625/5000 loss 0.0869 (w 0.1263 mse 0.1246 t 201 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 16:54:13] step 626/5000 loss 0.0681 (w 0.0504 mse 0.0545 t 535 new 0.27) lr 1.00e-05 gnorm 0.129 5.81s mem 15.6GB +[2026-09-13 16:54:18] step 627/5000 loss 0.0465 (w 0.0538 mse 0.0512 t 920 new 0.19) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 16:54:24] step 628/5000 loss 0.0523 (w 0.0827 mse 0.0811 t 947 new 0.13) lr 1.00e-05 gnorm 0.118 5.68s mem 15.6GB +[2026-09-13 16:54:30] step 629/5000 loss 0.0693 (w 0.0342 mse 0.0365 t 909 new 0.11) lr 1.00e-05 gnorm 0.104 5.69s mem 15.6GB +[2026-09-13 16:54:35] step 630/5000 loss 0.0596 (w 0.1150 mse 0.1174 t 966 new 0.24) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 16:54:41] step 631/5000 loss 0.1070 (w 0.1093 mse 0.0972 t 900 new 0.26) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 16:54:47] step 632/5000 loss 0.1195 (w 0.2659 mse 0.2678 t 986 new 0.25) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 16:54:53] step 633/5000 loss 0.0976 (w 0.0505 mse 0.0522 t 769 new 0.18) lr 1.00e-05 gnorm 0.088 5.88s mem 15.6GB +[2026-09-13 16:54:58] step 634/5000 loss 0.0824 (w 0.1242 mse 0.1209 t 966 new 0.14) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 16:55:04] step 635/5000 loss 0.0649 (w 0.0660 mse 0.0619 t 893 new 0.26) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +[2026-09-13 16:55:10] step 636/5000 loss 0.0918 (w 0.9861 mse 0.9891 t 5 new 0.18) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 16:55:16] step 637/5000 loss 0.1042 (w 0.0680 mse 0.0662 t 560 new 0.23) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 16:55:21] step 638/5000 loss 0.1313 (w 0.1386 mse 0.1406 t 360 new 0.10) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 16:55:27] step 639/5000 loss 0.1292 (w 0.1100 mse 0.1124 t 475 new 0.18) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 16:55:33] step 640/5000 loss 0.0586 (w 0.0935 mse 0.0897 t 855 new 0.24) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 16:55:38] step 641/5000 loss 0.0860 (w 0.0506 mse 0.0464 t 490 new 0.12) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 16:55:44] step 642/5000 loss 0.0789 (w 0.1309 mse 0.1222 t 936 new 0.23) lr 1.00e-05 gnorm 0.069 5.80s mem 15.6GB +[2026-09-13 16:55:50] step 643/5000 loss 0.0949 (w 0.2544 mse 0.2543 t 126 new 0.25) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 16:55:56] step 644/5000 loss 0.1315 (w 0.0997 mse 0.0953 t 695 new 0.25) lr 1.00e-05 gnorm 0.066 5.78s mem 15.6GB +[2026-09-13 16:56:02] step 645/5000 loss 0.0728 (w 0.0680 mse 0.0672 t 953 new 0.12) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:56:07] step 646/5000 loss 0.0771 (w 0.1158 mse 0.1105 t 973 new 0.24) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 16:56:13] step 647/5000 loss 0.1216 (w 0.1133 mse 0.1179 t 288 new 0.22) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 16:56:19] step 648/5000 loss 0.0784 (w 0.3967 mse 0.3859 t 997 new 0.20) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 16:56:24] step 649/5000 loss 0.0644 (w 0.0287 mse 0.0291 t 839 new 0.13) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 16:56:30] step 650/5000 loss 0.0683 (w 0.0518 mse 0.0523 t 674 new 0.24) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 16:56:36] step 651/5000 loss 0.1318 (w 0.1106 mse 0.1093 t 447 new 0.28) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 16:56:42] step 652/5000 loss 0.1189 (w 0.0788 mse 0.0775 t 663 new 0.22) lr 1.00e-05 gnorm 0.064 5.95s mem 15.6GB +[2026-09-13 16:56:48] step 653/5000 loss 0.1299 (w 0.1077 mse 0.1016 t 872 new 0.18) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 16:56:53] step 654/5000 loss 0.0755 (w 0.0713 mse 0.0758 t 908 new 0.26) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 16:56:59] step 655/5000 loss 0.0772 (w 0.0889 mse 0.0911 t 956 new 0.26) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 16:57:05] step 656/5000 loss 0.0974 (w 0.0972 mse 0.0959 t 964 new 0.25) lr 1.00e-05 gnorm 0.087 5.74s mem 15.6GB +[2026-09-13 16:57:11] step 657/5000 loss 0.1030 (w 0.0353 mse 0.0388 t 566 new 0.19) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +[2026-09-13 16:57:16] step 658/5000 loss 0.1127 (w 0.1478 mse 0.1380 t 953 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 16:57:22] step 659/5000 loss 0.0705 (w 0.1464 mse 0.1496 t 982 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:57:28] step 660/5000 loss 0.0739 (w 0.1523 mse 0.1457 t 982 new 0.22) lr 1.00e-05 gnorm 0.119 5.69s mem 15.6GB +[2026-09-13 16:57:33] step 661/5000 loss 0.0702 (w 0.0393 mse 0.0377 t 809 new 0.20) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +[2026-09-13 16:57:39] step 662/5000 loss 0.0817 (w 0.1220 mse 0.1175 t 871 new 0.26) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 16:57:45] step 663/5000 loss 0.0863 (w 0.1125 mse 0.1026 t 869 new 0.23) lr 1.00e-05 gnorm 0.086 5.77s mem 15.6GB +[2026-09-13 16:57:51] step 664/5000 loss 0.0985 (w 0.1008 mse 0.0900 t 855 new 0.20) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 16:57:57] step 665/5000 loss 0.0695 (w 0.1359 mse 0.1245 t 944 new 0.23) lr 1.00e-05 gnorm 0.114 5.89s mem 15.6GB +[2026-09-13 16:58:02] step 666/5000 loss 0.1043 (w 0.1199 mse 0.1297 t 222 new 0.26) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 16:58:08] step 667/5000 loss 0.1169 (w 0.0890 mse 0.0869 t 650 new 0.23) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 16:58:14] step 668/5000 loss 0.0766 (w 0.0653 mse 0.0680 t 600 new 0.16) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +[2026-09-13 16:58:20] step 669/5000 loss 0.1172 (w 0.1061 mse 0.0986 t 923 new 0.27) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 16:58:25] step 670/5000 loss 0.0737 (w 0.0893 mse 0.0805 t 924 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 16:58:31] step 671/5000 loss 0.0850 (w 0.2230 mse 0.2070 t 990 new 0.22) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +[2026-09-13 16:58:37] step 672/5000 loss 0.0922 (w 0.0535 mse 0.0504 t 767 new 0.20) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 16:58:42] step 673/5000 loss 0.0941 (w 0.1188 mse 0.1184 t 716 new 0.23) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 16:58:48] step 674/5000 loss 0.0471 (w 0.3834 mse 0.3537 t 998 new 0.22) lr 1.00e-05 gnorm 0.061 5.86s mem 15.6GB +[2026-09-13 16:58:54] step 675/5000 loss 0.0670 (w 0.0436 mse 0.0476 t 891 new 0.15) lr 1.00e-05 gnorm 0.078 5.66s mem 15.6GB +[2026-09-13 16:59:00] step 676/5000 loss 0.0975 (w 0.0536 mse 0.0536 t 802 new 0.17) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 16:59:06] step 677/5000 loss 0.0876 (w 0.0533 mse 0.0517 t 787 new 0.14) lr 1.00e-05 gnorm 0.086 5.72s mem 15.6GB +[2026-09-13 16:59:11] step 678/5000 loss 0.0825 (w 0.0540 mse 0.0489 t 832 new 0.20) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 16:59:17] step 679/5000 loss 0.0963 (w 0.1533 mse 0.1513 t 965 new 0.28) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 16:59:23] step 680/5000 loss 0.0868 (w 0.0848 mse 0.0807 t 861 new 0.26) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 16:59:28] step 681/5000 loss 0.0840 (w 0.0704 mse 0.0683 t 556 new 0.15) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 16:59:34] step 682/5000 loss 0.0957 (w 0.2704 mse 0.2908 t 101 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 16:59:40] step 683/5000 loss 0.0857 (w 0.1678 mse 0.1686 t 988 new 0.19) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 16:59:45] step 684/5000 loss 0.1453 (w 0.0467 mse 0.0449 t 667 new 0.09) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 16:59:51] step 685/5000 loss 0.0731 (w 0.1457 mse 0.1412 t 401 new 0.27) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 16:59:57] step 686/5000 loss 0.1242 (w 0.0769 mse 0.0735 t 950 new 0.10) lr 1.00e-05 gnorm 0.065 5.87s mem 15.6GB +[2026-09-13 17:00:03] step 687/5000 loss 0.0874 (w 0.1834 mse 0.1656 t 983 new 0.16) lr 1.00e-05 gnorm 0.070 5.85s mem 15.6GB +[2026-09-13 17:00:09] step 688/5000 loss 0.1098 (w 0.0991 mse 0.0954 t 805 new 0.26) lr 1.00e-05 gnorm 0.096 5.94s mem 15.6GB +[2026-09-13 17:00:15] step 689/5000 loss 0.1226 (w 0.2344 mse 0.2364 t 232 new 0.29) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 17:00:21] step 690/5000 loss 0.1053 (w 0.0514 mse 0.0536 t 770 new 0.18) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 17:00:26] step 691/5000 loss 0.0825 (w 0.5287 mse 0.5174 t 48 new 0.26) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 17:00:32] step 692/5000 loss 0.0518 (w 0.0813 mse 0.0713 t 843 new 0.25) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 17:00:38] step 693/5000 loss 0.0681 (w 0.1466 mse 0.1390 t 948 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 17:00:43] step 694/5000 loss 0.0859 (w 0.0526 mse 0.0563 t 608 new 0.24) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 17:00:49] step 695/5000 loss 0.0702 (w 0.0941 mse 0.0932 t 493 new 0.15) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 17:00:55] step 696/5000 loss 0.0862 (w 0.0432 mse 0.0450 t 652 new 0.26) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:01:01] step 697/5000 loss 0.1091 (w 0.0597 mse 0.0617 t 742 new 0.23) lr 1.00e-05 gnorm 0.055 5.71s mem 15.6GB +[2026-09-13 17:01:06] step 698/5000 loss 0.0692 (w 0.0885 mse 0.0874 t 950 new 0.24) lr 1.00e-05 gnorm 0.071 5.71s mem 15.6GB +[2026-09-13 17:01:12] step 699/5000 loss 0.0725 (w 0.0740 mse 0.0738 t 626 new 0.30) lr 1.00e-05 gnorm 0.077 5.71s mem 15.6GB +[2026-09-13 17:01:18] step 700/5000 loss 0.0610 (w 0.1475 mse 0.1470 t 970 new 0.27) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:01:24] step 701/5000 loss 0.1147 (w 0.2437 mse 0.2436 t 154 new 0.26) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +[2026-09-13 17:01:29] step 702/5000 loss 0.0660 (w 0.0728 mse 0.0678 t 891 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 17:01:35] step 703/5000 loss 0.1079 (w 0.1219 mse 0.1219 t 453 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:01:41] step 704/5000 loss 0.1386 (w 0.0794 mse 0.0846 t 449 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 17:01:46] step 705/5000 loss 0.1679 (w 0.1355 mse 0.1348 t 312 new 0.27) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 17:01:52] step 706/5000 loss 0.1154 (w 0.0468 mse 0.0488 t 560 new 0.12) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 17:01:58] step 707/5000 loss 0.1028 (w 0.1478 mse 0.1370 t 984 new 0.18) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 17:02:04] step 708/5000 loss 0.0867 (w 0.0839 mse 0.0887 t 935 new 0.20) lr 1.00e-05 gnorm 0.080 5.79s mem 15.6GB +[2026-09-13 17:02:09] step 709/5000 loss 0.0688 (w 0.0652 mse 0.0611 t 810 new 0.25) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 17:02:15] step 710/5000 loss 0.1194 (w 0.1608 mse 0.1523 t 966 new 0.22) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 17:02:21] step 711/5000 loss 0.1103 (w 0.2462 mse 0.2431 t 161 new 0.07) lr 1.00e-05 gnorm 0.066 5.67s mem 15.6GB +[2026-09-13 17:02:26] step 712/5000 loss 0.0758 (w 0.1957 mse 0.1840 t 1000 new 0.27) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 17:02:32] step 713/5000 loss 0.0978 (w 0.0736 mse 0.0720 t 858 new 0.16) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 17:02:38] step 714/5000 loss 0.1133 (w 0.0746 mse 0.0781 t 681 new 0.15) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:02:44] step 715/5000 loss 0.0845 (w 0.2295 mse 0.2214 t 1000 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:02:49] step 716/5000 loss 0.1024 (w 0.0431 mse 0.0423 t 821 new 0.10) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 17:02:55] step 717/5000 loss 0.0871 (w 0.7149 mse 0.7196 t 20 new 0.24) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 17:03:01] step 718/5000 loss 0.0786 (w 0.1499 mse 0.1478 t 927 new 0.21) lr 1.00e-05 gnorm 0.069 5.88s mem 15.6GB +[2026-09-13 17:03:07] step 719/5000 loss 0.0646 (w 0.1404 mse 0.1295 t 948 new 0.19) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:03:12] step 720/5000 loss 0.0947 (w 0.1078 mse 0.0991 t 888 new 0.29) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 17:03:18] step 721/5000 loss 0.0622 (w 0.5157 mse 0.5762 t 39 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 17:03:24] step 722/5000 loss 0.1088 (w 0.3256 mse 0.3078 t 996 new 0.31) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 17:03:30] step 723/5000 loss 0.0753 (w 0.0506 mse 0.0495 t 655 new 0.10) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 17:03:35] step 724/5000 loss 0.0651 (w 0.0576 mse 0.0591 t 931 new 0.24) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 17:03:41] step 725/5000 loss 0.0981 (w 0.0804 mse 0.0796 t 414 new 0.30) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 17:03:47] step 726/5000 loss 0.0859 (w 0.0788 mse 0.0696 t 875 new 0.27) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 17:03:53] step 727/5000 loss 0.1322 (w 0.0549 mse 0.0551 t 888 new 0.20) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:03:58] step 728/5000 loss 0.0735 (w 0.0325 mse 0.0369 t 375 new 0.22) lr 1.00e-05 gnorm 0.068 5.67s mem 15.6GB +[2026-09-13 17:04:04] step 729/5000 loss 0.0870 (w 0.0624 mse 0.0629 t 852 new 0.26) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 17:04:10] step 730/5000 loss 0.1294 (w 0.0865 mse 0.0844 t 405 new 0.20) lr 1.00e-05 gnorm 0.075 5.93s mem 15.6GB +[2026-09-13 17:04:16] step 731/5000 loss 0.0881 (w 0.0557 mse 0.0595 t 612 new 0.26) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +[2026-09-13 17:04:21] step 732/5000 loss 0.1080 (w 0.0858 mse 0.0832 t 990 new 0.21) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:04:27] step 733/5000 loss 0.1048 (w 0.0921 mse 0.0988 t 309 new 0.13) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:04:33] step 734/5000 loss 0.0480 (w 0.0996 mse 0.0890 t 969 new 0.18) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 17:04:38] step 735/5000 loss 0.0841 (w 0.0681 mse 0.0625 t 676 new 0.20) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:04:44] step 736/5000 loss 0.0873 (w 0.1933 mse 0.1899 t 965 new 0.23) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 17:04:50] step 737/5000 loss 0.0887 (w 0.1016 mse 0.1006 t 349 new 0.27) lr 1.00e-05 gnorm 0.074 5.86s mem 15.6GB +[2026-09-13 17:04:56] step 738/5000 loss 0.0990 (w 0.0319 mse 0.0326 t 545 new 0.09) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 17:05:01] step 739/5000 loss 0.0920 (w 0.0710 mse 0.0706 t 543 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:05:07] step 740/5000 loss 0.1393 (w 0.0754 mse 0.0760 t 718 new 0.20) lr 1.00e-05 gnorm 0.083 5.91s mem 15.6GB +[2026-09-13 17:05:13] step 741/5000 loss 0.0903 (w 0.0730 mse 0.0730 t 767 new 0.25) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 17:05:19] step 742/5000 loss 0.0869 (w 0.1027 mse 0.1049 t 538 new 0.11) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 17:05:24] step 743/5000 loss 0.0790 (w 0.0984 mse 0.1011 t 956 new 0.21) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 17:05:30] step 744/5000 loss 0.1124 (w 0.1657 mse 0.1620 t 956 new 0.15) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 17:05:36] step 745/5000 loss 0.1231 (w 0.0913 mse 0.0840 t 885 new 0.19) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 17:05:42] step 746/5000 loss 0.1121 (w 0.0903 mse 0.0853 t 814 new 0.22) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +[2026-09-13 17:05:47] step 747/5000 loss 0.1079 (w 0.0946 mse 0.0923 t 546 new 0.27) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +[2026-09-13 17:05:53] step 748/5000 loss 0.1400 (w 0.0563 mse 0.0519 t 908 new 0.24) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 17:05:59] step 749/5000 loss 0.0928 (w 0.0570 mse 0.0570 t 501 new 0.06) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 17:06:04] step 750/5000 loss 0.0923 (w 0.0766 mse 0.0716 t 844 new 0.22) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 17:06:10] step 751/5000 loss 0.0693 (w 0.2068 mse 0.2032 t 965 new 0.23) lr 1.00e-05 gnorm 0.087 5.88s mem 15.6GB +[2026-09-13 17:06:16] step 752/5000 loss 0.1193 (w 0.0806 mse 0.0805 t 588 new 0.22) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 17:06:22] step 753/5000 loss 0.1253 (w 0.1304 mse 0.1295 t 372 new 0.14) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 17:06:27] step 754/5000 loss 0.1149 (w 0.1010 mse 0.1038 t 459 new 0.23) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:06:33] step 755/5000 loss 0.0796 (w 0.1206 mse 0.1166 t 634 new 0.31) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 17:06:39] step 756/5000 loss 0.0776 (w 0.1492 mse 0.1407 t 961 new 0.19) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:06:44] step 757/5000 loss 0.0817 (w 0.0461 mse 0.0480 t 273 new 0.12) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 17:06:50] step 758/5000 loss 0.1309 (w 0.0668 mse 0.0668 t 706 new 0.29) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 17:06:56] step 759/5000 loss 0.0761 (w 0.0633 mse 0.0594 t 667 new 0.18) lr 1.00e-05 gnorm 0.100 5.68s mem 15.6GB +[2026-09-13 17:07:02] step 760/5000 loss 0.0895 (w 0.0665 mse 0.0646 t 644 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:07:07] step 761/5000 loss 0.0645 (w 0.0868 mse 0.0795 t 911 new 0.23) lr 1.00e-05 gnorm 0.080 5.91s mem 15.6GB +[2026-09-13 17:07:13] step 762/5000 loss 0.0884 (w 0.0970 mse 0.0935 t 918 new 0.26) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 17:07:19] step 763/5000 loss 0.1022 (w 0.0782 mse 0.0773 t 753 new 0.25) lr 1.00e-05 gnorm 0.068 5.67s mem 15.6GB +[2026-09-13 17:07:25] step 764/5000 loss 0.0672 (w 0.0690 mse 0.0626 t 673 new 0.21) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:07:30] step 765/5000 loss 0.0621 (w 0.1247 mse 0.1312 t 955 new 0.26) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 17:07:36] step 766/5000 loss 0.1188 (w 0.0823 mse 0.0768 t 954 new 0.11) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 17:07:42] step 767/5000 loss 0.1045 (w 0.0994 mse 0.0899 t 912 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:07:47] step 768/5000 loss 0.0884 (w 0.4140 mse 0.4120 t 80 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 17:07:53] step 769/5000 loss 0.0828 (w 0.1694 mse 0.1531 t 973 new 0.21) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:07:59] step 770/5000 loss 0.1340 (w 0.2161 mse 0.2185 t 242 new 0.14) lr 1.00e-05 gnorm 0.088 5.98s mem 15.6GB +[2026-09-13 17:08:05] step 771/5000 loss 0.0644 (w 0.0797 mse 0.0705 t 914 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 17:08:11] step 772/5000 loss 0.1045 (w 0.0627 mse 0.0622 t 758 new 0.20) lr 1.00e-05 gnorm 0.054 5.81s mem 15.6GB +[2026-09-13 17:08:16] step 773/5000 loss 0.0935 (w 0.2147 mse 0.2172 t 201 new 0.25) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +[2026-09-13 17:08:22] step 774/5000 loss 0.1037 (w 0.0498 mse 0.0519 t 979 new 0.13) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 17:08:28] step 775/5000 loss 0.0846 (w 0.0651 mse 0.0664 t 658 new 0.22) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 17:08:33] step 776/5000 loss 0.0665 (w 0.0413 mse 0.0402 t 650 new 0.13) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 17:08:39] step 777/5000 loss 0.1287 (w 0.1015 mse 0.0967 t 739 new 0.22) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:08:45] step 778/5000 loss 0.1126 (w 0.0326 mse 0.0305 t 759 new 0.24) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:08:50] step 779/5000 loss 0.1057 (w 0.0587 mse 0.0604 t 733 new 0.25) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 17:08:56] step 780/5000 loss 0.0893 (w 0.0732 mse 0.0793 t 362 new 0.26) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 17:09:02] step 781/5000 loss 0.0803 (w 0.0524 mse 0.0521 t 902 new 0.18) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 17:09:08] step 782/5000 loss 0.0682 (w 0.1147 mse 0.1104 t 309 new 0.30) lr 1.00e-05 gnorm 0.109 5.94s mem 15.6GB +[2026-09-13 17:09:14] step 783/5000 loss 0.0488 (w 0.1258 mse 0.1210 t 965 new 0.15) lr 1.00e-05 gnorm 0.073 5.67s mem 15.6GB +[2026-09-13 17:09:19] step 784/5000 loss 0.0737 (w 0.1879 mse 0.1788 t 981 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 17:09:25] step 785/5000 loss 0.0965 (w 0.0488 mse 0.0518 t 581 new 0.30) lr 1.00e-05 gnorm 0.111 5.69s mem 15.6GB +[2026-09-13 17:09:31] step 786/5000 loss 0.0951 (w 0.1237 mse 0.1201 t 924 new 0.21) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 17:09:36] step 787/5000 loss 0.0825 (w 0.1551 mse 0.1412 t 971 new 0.23) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:09:42] step 788/5000 loss 0.0868 (w 0.0782 mse 0.0721 t 937 new 0.23) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 17:09:48] step 789/5000 loss 0.1030 (w 0.0826 mse 0.0782 t 882 new 0.26) lr 1.00e-05 gnorm 0.072 5.87s mem 15.6GB +[2026-09-13 17:09:54] step 790/5000 loss 0.1052 (w 0.1218 mse 0.1233 t 297 new 0.13) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 17:09:59] step 791/5000 loss 0.0528 (w 0.1629 mse 0.1534 t 957 new 0.27) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 17:10:05] step 792/5000 loss 0.1037 (w 0.0682 mse 0.0615 t 733 new 0.20) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:10:11] step 793/5000 loss 0.0669 (w 0.2362 mse 0.2197 t 994 new 0.20) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 17:10:16] step 794/5000 loss 0.0441 (w 0.0688 mse 0.0735 t 883 new 0.19) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 17:10:22] step 795/5000 loss 0.0433 (w 0.2162 mse 0.1992 t 985 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 17:10:28] step 796/5000 loss 0.1331 (w 0.0715 mse 0.0755 t 297 new 0.10) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 17:10:34] step 797/5000 loss 0.1114 (w 0.0344 mse 0.0329 t 706 new 0.21) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 17:10:39] step 798/5000 loss 0.0861 (w 0.0778 mse 0.0752 t 898 new 0.25) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:10:45] step 799/5000 loss 0.0585 (w 0.0944 mse 0.0914 t 965 new 0.16) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:10:51] step 800/5000 loss 0.0625 (w 0.1111 mse 0.1093 t 717 new 0.23) lr 1.00e-05 gnorm 0.072 5.84s mem 15.6GB +[2026-09-13 17:10:56] step 801/5000 loss 0.0844 (w 0.1330 mse 0.1266 t 959 new 0.20) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 17:11:02] step 802/5000 loss 0.0918 (w 0.0643 mse 0.0621 t 742 new 0.23) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +[2026-09-13 17:11:08] step 803/5000 loss 0.1122 (w 0.0760 mse 0.0698 t 739 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:11:14] step 804/5000 loss 0.0824 (w 0.0583 mse 0.0529 t 758 new 0.25) lr 1.00e-05 gnorm 0.085 5.77s mem 15.6GB +[2026-09-13 17:11:19] step 805/5000 loss 0.0920 (w 0.0799 mse 0.0746 t 744 new 0.28) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 17:11:25] step 806/5000 loss 0.0496 (w 0.0676 mse 0.0659 t 802 new 0.21) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:11:31] step 807/5000 loss 0.0642 (w 0.2272 mse 0.2240 t 997 new 0.25) lr 1.00e-05 gnorm 0.111 5.69s mem 15.6GB +[2026-09-13 17:11:36] step 808/5000 loss 0.0992 (w 0.1688 mse 0.1613 t 951 new 0.17) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 17:11:42] step 809/5000 loss 0.0814 (w 0.0435 mse 0.0424 t 840 new 0.19) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:11:48] step 810/5000 loss 0.0674 (w 0.0689 mse 0.0637 t 743 new 0.26) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 17:11:54] step 811/5000 loss 0.0667 (w 0.1316 mse 0.1283 t 985 new 0.27) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:11:59] step 812/5000 loss 0.1253 (w 0.0779 mse 0.0729 t 760 new 0.20) lr 1.00e-05 gnorm 0.083 5.90s mem 15.6GB +[2026-09-13 17:12:05] step 813/5000 loss 0.0574 (w 0.1325 mse 0.1178 t 969 new 0.22) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 17:12:11] step 814/5000 loss 0.0740 (w 0.0387 mse 0.0390 t 725 new 0.23) lr 1.00e-05 gnorm 0.059 5.90s mem 15.6GB +[2026-09-13 17:12:17] step 815/5000 loss 0.1424 (w 0.0675 mse 0.0726 t 394 new 0.25) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 17:12:23] step 816/5000 loss 0.1366 (w 0.2014 mse 0.2056 t 232 new 0.21) lr 1.00e-05 gnorm 0.071 5.74s mem 15.6GB +[2026-09-13 17:12:28] step 817/5000 loss 0.0815 (w 0.1502 mse 0.1367 t 927 new 0.24) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 17:12:34] step 818/5000 loss 0.1169 (w 0.0565 mse 0.0583 t 885 new 0.31) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 17:12:40] step 819/5000 loss 0.0584 (w 0.1582 mse 0.1516 t 997 new 0.25) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 17:12:45] step 820/5000 loss 0.0683 (w 0.2310 mse 0.2166 t 1000 new 0.26) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 17:12:51] step 821/5000 loss 0.0714 (w 0.0786 mse 0.0826 t 637 new 0.18) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 17:12:57] step 822/5000 loss 0.1114 (w 0.1443 mse 0.1367 t 973 new 0.19) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 17:13:03] step 823/5000 loss 0.0714 (w 0.1420 mse 0.1316 t 964 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:13:08] step 824/5000 loss 0.0707 (w 0.0771 mse 0.0775 t 796 new 0.08) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 17:13:14] step 825/5000 loss 0.1545 (w 0.0474 mse 0.0503 t 475 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 17:13:20] step 826/5000 loss 0.0522 (w 0.0753 mse 0.0727 t 920 new 0.22) lr 1.00e-05 gnorm 0.065 5.88s mem 15.6GB +[2026-09-13 17:13:26] step 827/5000 loss 0.1069 (w 0.0902 mse 0.0926 t 758 new 0.24) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:13:31] step 828/5000 loss 0.0719 (w 0.0447 mse 0.0450 t 872 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:13:37] step 829/5000 loss 0.0669 (w 0.0682 mse 0.0678 t 591 new 0.17) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 17:13:43] step 830/5000 loss 0.1154 (w 0.0562 mse 0.0557 t 874 new 0.26) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 17:13:48] step 831/5000 loss 0.0791 (w 0.0292 mse 0.0328 t 777 new 0.16) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 17:13:54] step 832/5000 loss 0.1050 (w 0.0554 mse 0.0568 t 602 new 0.13) lr 1.00e-05 gnorm 0.069 5.90s mem 15.6GB +[2026-09-13 17:14:00] step 833/5000 loss 0.1289 (w 0.1058 mse 0.1047 t 430 new 0.26) lr 1.00e-05 gnorm 0.078 5.73s mem 15.6GB +[2026-09-13 17:14:06] step 834/5000 loss 0.1047 (w 0.0889 mse 0.0828 t 880 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 17:14:11] step 835/5000 loss 0.0857 (w 0.1323 mse 0.1284 t 966 new 0.18) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:14:17] step 836/5000 loss 0.0514 (w 0.1245 mse 0.1196 t 957 new 0.21) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 17:14:23] step 837/5000 loss 0.0477 (w 0.0508 mse 0.0517 t 585 new 0.28) lr 1.00e-05 gnorm 0.053 5.74s mem 15.6GB +[2026-09-13 17:14:29] step 838/5000 loss 0.1242 (w 0.0705 mse 0.0678 t 690 new 0.26) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 17:14:34] step 839/5000 loss 0.0638 (w 0.0603 mse 0.0605 t 905 new 0.23) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:14:40] step 840/5000 loss 0.1387 (w 0.0829 mse 0.0788 t 660 new 0.26) lr 1.00e-05 gnorm 0.099 5.68s mem 15.6GB +[2026-09-13 17:14:46] step 841/5000 loss 0.0784 (w 0.1061 mse 0.0982 t 928 new 0.26) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +[2026-09-13 17:14:51] step 842/5000 loss 0.0812 (w 0.1570 mse 0.1568 t 957 new 0.20) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 17:14:57] step 843/5000 loss 0.0511 (w 0.0694 mse 0.0711 t 944 new 0.10) lr 1.00e-05 gnorm 0.066 5.96s mem 15.6GB +[2026-09-13 17:15:03] step 844/5000 loss 0.1588 (w 0.1256 mse 0.1188 t 944 new 0.23) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 17:15:09] step 845/5000 loss 0.0624 (w 0.2329 mse 0.2221 t 998 new 0.23) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 17:15:14] step 846/5000 loss 0.1059 (w 0.0867 mse 0.0839 t 936 new 0.19) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:15:20] step 847/5000 loss 0.0733 (w 0.0912 mse 0.0854 t 878 new 0.23) lr 1.00e-05 gnorm 0.063 5.90s mem 15.6GB +[2026-09-13 17:15:26] step 848/5000 loss 0.1013 (w 0.0976 mse 0.0928 t 610 new 0.26) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:15:32] step 849/5000 loss 0.1126 (w 0.0551 mse 0.0520 t 763 new 0.11) lr 1.00e-05 gnorm 0.089 5.67s mem 15.6GB +[2026-09-13 17:15:37] step 850/5000 loss 0.0538 (w 0.1795 mse 0.1740 t 956 new 0.20) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 17:15:43] step 851/5000 loss 0.0960 (w 0.1558 mse 0.1457 t 972 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:15:49] step 852/5000 loss 0.0849 (w 0.0759 mse 0.0736 t 617 new 0.23) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:15:55] step 853/5000 loss 0.0893 (w 0.0590 mse 0.0554 t 765 new 0.17) lr 1.00e-05 gnorm 0.069 5.86s mem 15.6GB +[2026-09-13 17:16:00] step 854/5000 loss 0.0981 (w 0.0518 mse 0.0506 t 746 new 0.23) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +[2026-09-13 17:16:06] step 855/5000 loss 0.0595 (w 0.0522 mse 0.0532 t 525 new 0.10) lr 1.00e-05 gnorm 0.065 5.67s mem 15.6GB +[2026-09-13 17:16:12] step 856/5000 loss 0.0852 (w 0.1035 mse 0.0991 t 921 new 0.19) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 17:16:17] step 857/5000 loss 0.1596 (w 0.0444 mse 0.0453 t 828 new 0.22) lr 1.00e-05 gnorm 0.100 5.68s mem 15.6GB +[2026-09-13 17:16:23] step 858/5000 loss 0.0678 (w 0.1673 mse 0.1598 t 980 new 0.27) lr 1.00e-05 gnorm 0.064 5.79s mem 15.6GB +[2026-09-13 17:16:29] step 859/5000 loss 0.1015 (w 0.0302 mse 0.0352 t 802 new 0.22) lr 1.00e-05 gnorm 0.069 5.67s mem 15.6GB +[2026-09-13 17:16:35] step 860/5000 loss 0.1198 (w 0.0933 mse 0.0871 t 907 new 0.25) lr 1.00e-05 gnorm 0.119 5.68s mem 15.6GB +[2026-09-13 17:16:40] step 861/5000 loss 0.0990 (w 0.0679 mse 0.0710 t 767 new 0.14) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 17:16:46] step 862/5000 loss 0.0925 (w 0.0190 mse 0.0222 t 774 new 0.20) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 17:16:52] step 863/5000 loss 0.1160 (w 0.1659 mse 0.1569 t 965 new 0.23) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 17:16:57] step 864/5000 loss 0.0691 (w 0.0721 mse 0.0639 t 894 new 0.16) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 17:17:03] step 865/5000 loss 0.0710 (w 0.2365 mse 0.2049 t 1000 new 0.28) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 17:17:09] step 866/5000 loss 0.0923 (w 0.0591 mse 0.0573 t 872 new 0.18) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 17:17:15] step 867/5000 loss 0.0573 (w 0.0602 mse 0.0678 t 973 new 0.14) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +[2026-09-13 17:17:20] step 868/5000 loss 0.0701 (w 0.0585 mse 0.0586 t 774 new 0.25) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:17:26] step 869/5000 loss 0.0742 (w 0.0678 mse 0.0619 t 771 new 0.27) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:17:32] step 870/5000 loss 0.0835 (w 0.0687 mse 0.0655 t 651 new 0.20) lr 1.00e-05 gnorm 0.094 5.68s mem 15.6GB +[2026-09-13 17:17:37] step 871/5000 loss 0.0913 (w 0.0236 mse 0.0267 t 817 new 0.14) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 17:17:43] step 872/5000 loss 0.1065 (w 0.0805 mse 0.0787 t 537 new 0.15) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:17:49] step 873/5000 loss 0.0874 (w 0.0757 mse 0.0716 t 619 new 0.26) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:17:54] step 874/5000 loss 0.1177 (w 0.2240 mse 0.2095 t 981 new 0.28) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 17:18:00] step 875/5000 loss 0.0571 (w 0.0765 mse 0.0757 t 527 new 0.23) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 17:18:06] step 876/5000 loss 0.1091 (w 0.1683 mse 0.1590 t 986 new 0.23) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 17:18:11] step 877/5000 loss 0.0869 (w 0.0854 mse 0.0807 t 940 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:18:17] step 878/5000 loss 0.0781 (w 0.1300 mse 0.1288 t 261 new 0.09) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:18:23] step 879/5000 loss 0.0489 (w 0.0815 mse 0.0769 t 837 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 17:18:29] step 880/5000 loss 0.0985 (w 0.1047 mse 0.1061 t 554 new 0.23) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 17:18:34] step 881/5000 loss 0.0740 (w 0.0596 mse 0.0596 t 779 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:18:40] step 882/5000 loss 0.0591 (w 0.0925 mse 0.0885 t 950 new 0.27) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 17:18:46] step 883/5000 loss 0.0849 (w 0.1130 mse 0.1075 t 984 new 0.26) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 17:18:51] step 884/5000 loss 0.0989 (w 0.0654 mse 0.0602 t 916 new 0.18) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 17:18:57] step 885/5000 loss 0.0558 (w 0.1029 mse 0.0999 t 757 new 0.30) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 17:19:03] step 886/5000 loss 0.0750 (w 0.1017 mse 0.0980 t 414 new 0.27) lr 1.00e-05 gnorm 0.078 5.85s mem 15.6GB +[2026-09-13 17:19:09] step 887/5000 loss 0.0783 (w 0.2380 mse 0.2177 t 993 new 0.20) lr 1.00e-05 gnorm 0.108 5.68s mem 15.6GB +[2026-09-13 17:19:14] step 888/5000 loss 0.1051 (w 0.0954 mse 0.0944 t 421 new 0.20) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:19:20] step 889/5000 loss 0.1054 (w 0.0752 mse 0.0748 t 810 new 0.24) lr 1.00e-05 gnorm 0.091 5.91s mem 15.6GB +[2026-09-13 17:19:26] step 890/5000 loss 0.0873 (w 0.1696 mse 0.1591 t 983 new 0.25) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 17:19:32] step 891/5000 loss 0.0600 (w 0.0653 mse 0.0607 t 732 new 0.17) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:19:37] step 892/5000 loss 0.0619 (w 0.1122 mse 0.1104 t 968 new 0.24) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 17:19:43] step 893/5000 loss 0.0973 (w 0.0961 mse 0.0919 t 776 new 0.12) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:19:49] step 894/5000 loss 0.1013 (w 0.2163 mse 0.2186 t 239 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 17:19:55] step 895/5000 loss 0.0791 (w 0.2974 mse 0.2954 t 126 new 0.25) lr 1.00e-05 gnorm 0.071 5.79s mem 15.6GB +[2026-09-13 17:20:00] step 896/5000 loss 0.0764 (w 0.0928 mse 0.0899 t 743 new 0.19) lr 1.00e-05 gnorm 0.084 5.76s mem 15.6GB +[2026-09-13 17:20:06] step 897/5000 loss 0.1246 (w 0.2727 mse 0.2613 t 154 new 0.25) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 17:20:12] step 898/5000 loss 0.1136 (w 0.0854 mse 0.0858 t 638 new 0.21) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 17:20:17] step 899/5000 loss 0.0862 (w 0.0791 mse 0.0788 t 843 new 0.23) lr 1.00e-05 gnorm 0.098 5.69s mem 15.6GB +[2026-09-13 17:20:23] step 900/5000 loss 0.1120 (w 0.0893 mse 0.0872 t 840 new 0.21) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:20:29] step 901/5000 loss 0.1137 (w 0.0848 mse 0.0791 t 929 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 17:20:35] step 902/5000 loss 0.0947 (w 0.0689 mse 0.0688 t 875 new 0.26) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 17:20:40] step 903/5000 loss 0.0561 (w 0.0900 mse 0.0856 t 939 new 0.26) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:20:46] step 904/5000 loss 0.0533 (w 0.1487 mse 0.1454 t 947 new 0.24) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 17:20:52] step 905/5000 loss 0.0481 (w 0.0636 mse 0.0652 t 876 new 0.16) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:20:58] step 906/5000 loss 0.1067 (w 0.0687 mse 0.0661 t 599 new 0.12) lr 1.00e-05 gnorm 0.087 5.91s mem 15.6GB +[2026-09-13 17:21:03] step 907/5000 loss 0.0686 (w 0.0679 mse 0.0673 t 768 new 0.26) lr 1.00e-05 gnorm 0.048 5.68s mem 15.6GB +[2026-09-13 17:21:09] step 908/5000 loss 0.0548 (w 0.1801 mse 0.1770 t 258 new 0.20) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:21:15] step 909/5000 loss 0.1283 (w 0.1886 mse 0.1882 t 291 new 0.28) lr 1.00e-05 gnorm 0.095 5.68s mem 15.6GB +[2026-09-13 17:21:21] step 910/5000 loss 0.0693 (w 0.1159 mse 0.1053 t 906 new 0.27) lr 1.00e-05 gnorm 0.073 5.89s mem 15.6GB +[2026-09-13 17:21:26] step 911/5000 loss 0.0960 (w 0.0380 mse 0.0394 t 847 new 0.22) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 17:21:32] step 912/5000 loss 0.0736 (w 0.0722 mse 0.0732 t 908 new 0.19) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 17:21:38] step 913/5000 loss 0.1372 (w 0.0883 mse 0.0870 t 530 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:21:43] step 914/5000 loss 0.0938 (w 0.0917 mse 0.1056 t 176 new 0.20) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:21:49] step 915/5000 loss 0.1153 (w 0.0791 mse 0.0753 t 563 new 0.28) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 17:21:55] step 916/5000 loss 0.1396 (w 0.0568 mse 0.0567 t 813 new 0.15) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 17:22:00] step 917/5000 loss 0.1043 (w 0.1046 mse 0.0949 t 854 new 0.25) lr 1.00e-05 gnorm 0.062 5.72s mem 15.6GB +[2026-09-13 17:22:06] step 918/5000 loss 0.0619 (w 0.0686 mse 0.0607 t 749 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:22:12] step 919/5000 loss 0.0840 (w 0.6575 mse 0.7021 t 20 new 0.22) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 17:22:18] step 920/5000 loss 0.1078 (w 0.1446 mse 0.1524 t 457 new 0.21) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:22:24] step 921/5000 loss 0.0991 (w 0.1208 mse 0.1191 t 999 new 0.26) lr 1.00e-05 gnorm 0.057 5.81s mem 15.6GB +[2026-09-13 17:22:29] step 922/5000 loss 0.1397 (w 0.1425 mse 0.1369 t 922 new 0.24) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +[2026-09-13 17:22:35] step 923/5000 loss 0.1005 (w 0.0533 mse 0.0540 t 905 new 0.13) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:22:41] step 924/5000 loss 0.0885 (w 0.0889 mse 0.0881 t 396 new 0.15) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 17:22:46] step 925/5000 loss 0.1301 (w 0.0809 mse 0.0770 t 892 new 0.24) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 17:22:52] step 926/5000 loss 0.0950 (w 0.0877 mse 0.0842 t 419 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 17:22:58] step 927/5000 loss 0.0872 (w 0.1253 mse 0.1184 t 917 new 0.23) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:23:04] step 928/5000 loss 0.0907 (w 0.1036 mse 0.1017 t 955 new 0.18) lr 1.00e-05 gnorm 0.055 5.67s mem 15.6GB +[2026-09-13 17:23:09] step 929/5000 loss 0.0927 (w 0.1222 mse 0.1107 t 921 new 0.30) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 17:23:15] step 930/5000 loss 0.0873 (w 0.0594 mse 0.0576 t 739 new 0.22) lr 1.00e-05 gnorm 0.064 5.67s mem 15.6GB +[2026-09-13 17:23:21] step 931/5000 loss 0.0735 (w 0.1551 mse 0.1491 t 989 new 0.26) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 17:23:27] step 932/5000 loss 0.0773 (w 0.0841 mse 0.0805 t 803 new 0.23) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 17:23:32] step 933/5000 loss 0.0771 (w 0.2169 mse 0.2044 t 998 new 0.17) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 17:23:38] step 934/5000 loss 0.0812 (w 0.5680 mse 0.5647 t 66 new 0.23) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:23:44] step 935/5000 loss 0.0963 (w 0.2729 mse 0.2704 t 146 new 0.25) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:23:49] step 936/5000 loss 0.0917 (w 0.0698 mse 0.0661 t 626 new 0.20) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 17:23:55] step 937/5000 loss 0.1042 (w 0.0984 mse 0.0975 t 408 new 0.29) lr 1.00e-05 gnorm 0.067 5.67s mem 15.6GB +[2026-09-13 17:24:01] step 938/5000 loss 0.0558 (w 0.1451 mse 0.1394 t 962 new 0.24) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:24:06] step 939/5000 loss 0.0782 (w 0.0847 mse 0.0782 t 745 new 0.29) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 17:24:12] step 940/5000 loss 0.1114 (w 0.0821 mse 0.0776 t 768 new 0.20) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:24:18] step 941/5000 loss 0.0909 (w 0.1389 mse 0.1394 t 968 new 0.23) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 17:24:24] step 942/5000 loss 0.1131 (w 0.0703 mse 0.0666 t 839 new 0.25) lr 1.00e-05 gnorm 0.095 5.93s mem 15.6GB +[2026-09-13 17:24:29] step 943/5000 loss 0.0699 (w 0.0353 mse 0.0362 t 890 new 0.12) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 17:24:35] step 944/5000 loss 0.0690 (w 0.1118 mse 0.1094 t 958 new 0.28) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 17:24:41] step 945/5000 loss 0.1017 (w 0.1721 mse 0.1666 t 984 new 0.17) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 17:24:47] step 946/5000 loss 0.0915 (w 0.0768 mse 0.0687 t 888 new 0.25) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 17:24:52] step 947/5000 loss 0.0759 (w 0.0793 mse 0.0726 t 859 new 0.24) lr 1.00e-05 gnorm 0.086 5.74s mem 15.6GB +[2026-09-13 17:24:58] step 948/5000 loss 0.1053 (w 0.0908 mse 0.0875 t 522 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:25:04] step 949/5000 loss 0.0580 (w 0.1021 mse 0.0926 t 942 new 0.16) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 17:25:09] step 950/5000 loss 0.1149 (w 0.1598 mse 0.1642 t 276 new 0.17) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:25:15] step 951/5000 loss 0.0707 (w 0.0966 mse 0.0868 t 853 new 0.29) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 17:25:21] step 952/5000 loss 0.1067 (w 0.1235 mse 0.1169 t 881 new 0.24) lr 1.00e-05 gnorm 0.093 5.93s mem 15.6GB +[2026-09-13 17:25:27] step 953/5000 loss 0.0506 (w 0.2716 mse 0.2751 t 993 new 0.18) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:25:33] step 954/5000 loss 0.0708 (w 0.1736 mse 0.1688 t 971 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:25:38] step 955/5000 loss 0.0816 (w 0.0521 mse 0.0536 t 748 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 17:25:44] step 956/5000 loss 0.0771 (w 0.0886 mse 0.0784 t 863 new 0.19) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 17:25:50] step 957/5000 loss 0.0927 (w 0.0993 mse 0.0955 t 741 new 0.23) lr 1.00e-05 gnorm 0.063 5.91s mem 15.6GB +[2026-09-13 17:25:56] step 958/5000 loss 0.1569 (w 0.1583 mse 0.1558 t 961 new 0.21) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +[2026-09-13 17:26:01] step 959/5000 loss 0.0795 (w 0.0971 mse 0.0950 t 919 new 0.23) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 17:26:07] step 960/5000 loss 0.0929 (w 0.0713 mse 0.0707 t 451 new 0.27) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 17:26:13] step 961/5000 loss 0.0834 (w 0.0738 mse 0.0737 t 721 new 0.07) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 17:26:18] step 962/5000 loss 0.0580 (w 0.1196 mse 0.1125 t 971 new 0.11) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 17:26:24] step 963/5000 loss 0.1058 (w 0.1189 mse 0.1142 t 976 new 0.23) lr 1.00e-05 gnorm 0.085 5.89s mem 15.6GB +[2026-09-13 17:26:30] step 964/5000 loss 0.0610 (w 0.0912 mse 0.0894 t 839 new 0.21) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 17:26:36] step 965/5000 loss 0.0950 (w 0.0815 mse 0.0788 t 712 new 0.19) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 17:26:41] step 966/5000 loss 0.0675 (w 0.0829 mse 0.0830 t 902 new 0.25) lr 1.00e-05 gnorm 0.110 5.69s mem 15.6GB +[2026-09-13 17:26:47] step 967/5000 loss 0.0684 (w 0.0951 mse 0.0921 t 877 new 0.15) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 17:26:53] step 968/5000 loss 0.0704 (w 0.1015 mse 0.0985 t 849 new 0.20) lr 1.00e-05 gnorm 0.085 5.73s mem 15.6GB +[2026-09-13 17:26:59] step 969/5000 loss 0.0862 (w 0.0672 mse 0.0668 t 894 new 0.30) lr 1.00e-05 gnorm 0.095 5.70s mem 15.6GB +[2026-09-13 17:27:04] step 970/5000 loss 0.0718 (w 0.0221 mse 0.0266 t 846 new 0.22) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 17:27:10] step 971/5000 loss 0.0826 (w 0.0899 mse 0.0884 t 955 new 0.17) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:27:16] step 972/5000 loss 0.0996 (w 0.0731 mse 0.0726 t 669 new 0.23) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 17:27:22] step 973/5000 loss 0.1325 (w 0.2157 mse 0.2128 t 273 new 0.24) lr 1.00e-05 gnorm 0.082 5.91s mem 15.6GB +[2026-09-13 17:27:27] step 974/5000 loss 0.0862 (w 0.0687 mse 0.0625 t 766 new 0.29) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 17:27:33] step 975/5000 loss 0.1324 (w 0.0175 mse 0.0204 t 710 new 0.18) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 17:27:39] step 976/5000 loss 0.1126 (w 0.0767 mse 0.0693 t 796 new 0.24) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 17:27:44] step 977/5000 loss 0.1002 (w 0.1048 mse 0.1029 t 342 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:27:50] step 978/5000 loss 0.0963 (w 0.0587 mse 0.0589 t 781 new 0.24) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 17:27:56] step 979/5000 loss 0.0816 (w 0.1030 mse 0.0995 t 699 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 17:28:02] step 980/5000 loss 0.0721 (w 0.0874 mse 0.0854 t 679 new 0.22) lr 1.00e-05 gnorm 0.058 5.82s mem 15.6GB +[2026-09-13 17:28:07] step 981/5000 loss 0.0660 (w 0.0972 mse 0.0932 t 814 new 0.28) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 17:28:13] step 982/5000 loss 0.0522 (w 0.0918 mse 0.0902 t 438 new 0.27) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 17:28:19] step 983/5000 loss 0.1210 (w 0.0955 mse 0.0876 t 940 new 0.13) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +[2026-09-13 17:28:25] step 984/5000 loss 0.1072 (w 0.0678 mse 0.0701 t 473 new 0.26) lr 1.00e-05 gnorm 0.068 5.87s mem 15.6GB +[2026-09-13 17:28:30] step 985/5000 loss 0.0606 (w 0.1271 mse 0.1154 t 938 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 17:28:36] step 986/5000 loss 0.1051 (w 0.0755 mse 0.0722 t 646 new 0.28) lr 1.00e-05 gnorm 0.112 5.69s mem 15.6GB +[2026-09-13 17:28:42] step 987/5000 loss 0.0856 (w 0.0541 mse 0.0574 t 892 new 0.20) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 17:28:47] step 988/5000 loss 0.0761 (w 0.1353 mse 0.1373 t 956 new 0.18) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 17:28:53] step 989/5000 loss 0.1105 (w 0.0917 mse 0.0869 t 486 new 0.21) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 17:28:59] step 990/5000 loss 0.1326 (w 0.1129 mse 0.1097 t 822 new 0.22) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 17:29:05] step 991/5000 loss 0.1330 (w 0.0824 mse 0.0800 t 476 new 0.25) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 17:29:10] step 992/5000 loss 0.0820 (w 0.0881 mse 0.0802 t 798 new 0.23) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 17:29:16] step 993/5000 loss 0.1111 (w 0.2099 mse 0.2062 t 996 new 0.28) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 17:29:22] step 994/5000 loss 0.1095 (w 0.0882 mse 0.0826 t 858 new 0.27) lr 1.00e-05 gnorm 0.084 5.80s mem 15.6GB +[2026-09-13 17:29:28] step 995/5000 loss 0.0752 (w 0.0590 mse 0.0564 t 634 new 0.24) lr 1.00e-05 gnorm 0.093 6.04s mem 15.6GB +[2026-09-13 17:29:34] step 996/5000 loss 0.0852 (w 0.1134 mse 0.1093 t 910 new 0.20) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 17:29:39] step 997/5000 loss 0.0567 (w 0.0997 mse 0.0982 t 947 new 0.21) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 17:29:45] step 998/5000 loss 0.0764 (w 0.1052 mse 0.0958 t 802 new 0.26) lr 1.00e-05 gnorm 0.079 5.67s mem 15.6GB +[2026-09-13 17:29:51] step 999/5000 loss 0.0856 (w 0.0291 mse 0.0304 t 794 new 0.14) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 17:29:57] step 1000/5000 loss 0.0858 (w 0.1104 mse 0.1043 t 890 new 0.30) lr 1.00e-05 gnorm 0.055 5.84s mem 15.6GB +[2026-09-13 17:30:01] [val] step 1000 t=201: w=0.1798 mse=0.1823 (n=16) t=501: w=0.0748 mse=0.0748 (n=16) t=800: w=0.0635 mse=0.0624 (n=16) | mean w=0.1060 mse=0.1065 4s +[2026-09-13 17:30:04] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step1000.safetensors 832 个张量 2.87 GB +[2026-09-13 17:30:10] step 1001/5000 loss 0.1143 (w 0.1335 mse 0.1288 t 974 new 0.26) lr 1.00e-05 gnorm 0.071 5.66s mem 15.6GB +[2026-09-13 17:30:16] step 1002/5000 loss 0.0390 (w 0.1113 mse 0.1062 t 887 new 0.31) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 17:30:22] step 1003/5000 loss 0.0687 (w 0.9330 mse 0.9331 t 15 new 0.20) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 17:30:27] step 1004/5000 loss 0.1004 (w 0.0802 mse 0.0794 t 873 new 0.24) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +[2026-09-13 17:30:33] step 1005/5000 loss 0.0883 (w 0.1088 mse 0.1101 t 328 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 17:30:39] step 1006/5000 loss 0.1080 (w 0.0970 mse 0.0889 t 945 new 0.25) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:30:44] step 1007/5000 loss 0.0709 (w 0.1111 mse 0.1028 t 960 new 0.22) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 17:30:50] step 1008/5000 loss 0.0870 (w 0.1060 mse 0.0980 t 940 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 17:30:56] step 1009/5000 loss 0.0624 (w 0.0704 mse 0.0690 t 644 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 17:31:01] step 1010/5000 loss 0.0643 (w 0.0846 mse 0.0792 t 876 new 0.27) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 17:31:07] step 1011/5000 loss 0.1012 (w 0.0604 mse 0.0585 t 530 new 0.11) lr 1.00e-05 gnorm 0.065 5.79s mem 15.6GB +[2026-09-13 17:31:13] step 1012/5000 loss 0.0797 (w 0.0905 mse 0.0917 t 584 new 0.28) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 17:31:19] step 1013/5000 loss 0.0727 (w 0.0965 mse 0.0952 t 817 new 0.24) lr 1.00e-05 gnorm 0.059 5.67s mem 15.6GB +[2026-09-13 17:31:24] step 1014/5000 loss 0.1624 (w 0.3143 mse 0.3284 t 146 new 0.16) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:31:30] step 1015/5000 loss 0.1182 (w 0.1123 mse 0.1047 t 943 new 0.27) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:31:36] step 1016/5000 loss 0.0804 (w 0.1458 mse 0.1463 t 954 new 0.19) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:31:41] step 1017/5000 loss 0.1232 (w 0.0744 mse 0.0689 t 530 new 0.27) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 17:31:47] step 1018/5000 loss 0.1309 (w 0.0514 mse 0.0530 t 841 new 0.15) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 17:31:53] step 1019/5000 loss 0.0497 (w 0.1254 mse 0.1203 t 958 new 0.23) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:31:59] step 1020/5000 loss 0.0738 (w 0.0821 mse 0.0816 t 786 new 0.26) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 17:32:04] step 1021/5000 loss 0.0832 (w 0.0723 mse 0.0694 t 866 new 0.22) lr 1.00e-05 gnorm 0.068 5.71s mem 15.6GB +[2026-09-13 17:32:10] step 1022/5000 loss 0.0860 (w 0.0782 mse 0.0787 t 795 new 0.20) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 17:32:16] step 1023/5000 loss 0.0992 (w 0.8695 mse 0.8700 t 20 new 0.27) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:32:21] step 1024/5000 loss 0.0697 (w 0.0930 mse 0.0903 t 977 new 0.27) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:32:27] step 1025/5000 loss 0.0763 (w 0.0521 mse 0.0531 t 831 new 0.24) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:32:33] step 1026/5000 loss 0.0611 (w 0.0747 mse 0.0681 t 889 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:32:39] step 1027/5000 loss 0.0798 (w 0.2367 mse 0.2318 t 169 new 0.25) lr 1.00e-05 gnorm 0.079 5.90s mem 15.6GB +[2026-09-13 17:32:44] step 1028/5000 loss 0.0796 (w 0.1927 mse 0.1887 t 995 new 0.25) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 17:32:50] step 1029/5000 loss 0.1067 (w 0.1398 mse 0.1380 t 627 new 0.24) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 17:32:56] step 1030/5000 loss 0.0761 (w 0.0950 mse 0.0886 t 944 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 17:33:01] step 1031/5000 loss 0.1107 (w 0.1935 mse 0.2134 t 157 new 0.22) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 17:33:07] step 1032/5000 loss 0.0507 (w 0.0662 mse 0.0576 t 888 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:33:13] step 1033/5000 loss 0.1006 (w 0.0464 mse 0.0473 t 726 new 0.21) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 17:33:19] step 1034/5000 loss 0.0765 (w 0.1124 mse 0.1046 t 964 new 0.13) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 17:33:24] step 1035/5000 loss 0.0851 (w 0.0607 mse 0.0579 t 889 new 0.23) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 17:33:30] step 1036/5000 loss 0.0816 (w 0.0806 mse 0.0774 t 859 new 0.28) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 17:33:36] step 1037/5000 loss 0.1011 (w 0.0905 mse 0.0853 t 874 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:33:41] step 1038/5000 loss 0.0855 (w 0.0862 mse 0.0811 t 734 new 0.26) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 17:33:47] step 1039/5000 loss 0.0938 (w 0.1045 mse 0.0992 t 697 new 0.22) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 17:33:53] step 1040/5000 loss 0.1262 (w 0.0973 mse 0.0971 t 499 new 0.22) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 17:33:58] step 1041/5000 loss 0.1157 (w 0.0776 mse 0.0763 t 652 new 0.13) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:34:04] step 1042/5000 loss 0.0918 (w 0.0382 mse 0.0406 t 705 new 0.15) lr 1.00e-05 gnorm 0.072 5.91s mem 15.6GB +[2026-09-13 17:34:10] step 1043/5000 loss 0.1280 (w 0.1238 mse 0.1275 t 527 new 0.12) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:34:16] step 1044/5000 loss 0.0799 (w 0.1072 mse 0.1052 t 334 new 0.22) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:34:22] step 1045/5000 loss 0.0570 (w 0.1096 mse 0.1052 t 873 new 0.26) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:34:27] step 1046/5000 loss 0.1387 (w 0.0913 mse 0.0937 t 545 new 0.21) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 17:34:33] step 1047/5000 loss 0.1095 (w 0.1047 mse 0.1009 t 959 new 0.23) lr 1.00e-05 gnorm 0.073 5.83s mem 15.6GB +[2026-09-13 17:34:39] step 1048/5000 loss 0.0636 (w 0.0364 mse 0.0368 t 860 new 0.14) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:34:45] step 1049/5000 loss 0.0765 (w 0.0485 mse 0.0506 t 862 new 0.14) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 17:34:50] step 1050/5000 loss 0.0930 (w 0.0495 mse 0.0495 t 722 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 17:34:56] step 1051/5000 loss 0.1258 (w 0.1127 mse 0.1103 t 245 new 0.16) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 17:35:02] step 1052/5000 loss 0.0824 (w 0.1237 mse 0.1245 t 191 new 0.15) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:35:08] step 1053/5000 loss 0.0804 (w 0.1273 mse 0.1305 t 273 new 0.27) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 17:35:13] step 1054/5000 loss 0.1063 (w 0.1753 mse 0.1686 t 971 new 0.17) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 17:35:19] step 1055/5000 loss 0.0870 (w 0.0901 mse 0.0887 t 617 new 0.19) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:35:25] step 1056/5000 loss 0.1277 (w 0.1417 mse 0.1395 t 939 new 0.23) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 17:35:30] step 1057/5000 loss 0.0958 (w 0.0955 mse 0.0900 t 824 new 0.22) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 17:35:36] step 1058/5000 loss 0.0843 (w 0.0869 mse 0.0801 t 952 new 0.22) lr 1.00e-05 gnorm 0.069 5.90s mem 15.6GB +[2026-09-13 17:35:42] step 1059/5000 loss 0.0449 (w 0.0697 mse 0.0754 t 434 new 0.19) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +[2026-09-13 17:35:48] step 1060/5000 loss 0.1066 (w 0.0762 mse 0.0787 t 957 new 0.23) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:35:53] step 1061/5000 loss 0.0972 (w 0.1109 mse 0.1118 t 910 new 0.19) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:35:59] step 1062/5000 loss 0.0914 (w 0.0779 mse 0.0717 t 643 new 0.28) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:36:05] step 1063/5000 loss 0.0768 (w 0.0573 mse 0.0542 t 732 new 0.23) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 17:36:10] step 1064/5000 loss 0.0872 (w 0.1701 mse 0.1552 t 974 new 0.20) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 17:36:16] step 1065/5000 loss 0.0904 (w 0.0843 mse 0.0797 t 681 new 0.22) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:36:22] step 1066/5000 loss 0.0991 (w 0.0995 mse 0.0885 t 954 new 0.23) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 17:36:28] step 1067/5000 loss 0.1134 (w 0.2354 mse 0.2269 t 977 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 17:36:33] step 1068/5000 loss 0.1059 (w 0.1393 mse 0.1285 t 981 new 0.22) lr 1.00e-05 gnorm 0.067 5.90s mem 15.6GB +[2026-09-13 17:36:39] step 1069/5000 loss 0.0889 (w 0.2719 mse 0.2679 t 999 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:36:45] step 1070/5000 loss 0.0801 (w 0.1076 mse 0.1041 t 936 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 17:36:51] step 1071/5000 loss 0.0842 (w 0.1519 mse 0.1481 t 976 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 17:36:56] step 1072/5000 loss 0.0936 (w 0.0518 mse 0.0545 t 632 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:37:02] step 1073/5000 loss 0.0870 (w 0.3662 mse 0.3693 t 118 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:37:08] step 1074/5000 loss 0.0662 (w 0.0707 mse 0.0696 t 934 new 0.22) lr 1.00e-05 gnorm 0.066 5.72s mem 15.6GB +[2026-09-13 17:37:14] step 1075/5000 loss 0.0975 (w 0.1436 mse 0.1450 t 950 new 0.21) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 17:37:19] step 1076/5000 loss 0.1185 (w 0.0949 mse 0.0985 t 972 new 0.21) lr 1.00e-05 gnorm 0.066 5.67s mem 15.6GB +[2026-09-13 17:37:25] step 1077/5000 loss 0.1098 (w 0.0950 mse 0.0933 t 862 new 0.20) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 17:37:31] step 1078/5000 loss 0.0656 (w 0.0374 mse 0.0435 t 461 new 0.22) lr 1.00e-05 gnorm 0.096 5.68s mem 15.6GB +[2026-09-13 17:37:37] step 1079/5000 loss 0.0864 (w 0.0874 mse 0.0832 t 900 new 0.20) lr 1.00e-05 gnorm 0.063 5.82s mem 15.6GB +[2026-09-13 17:37:42] step 1080/5000 loss 0.0819 (w 0.0368 mse 0.0392 t 692 new 0.21) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 17:37:48] step 1081/5000 loss 0.1063 (w 0.0785 mse 0.0851 t 619 new 0.09) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 17:37:54] step 1082/5000 loss 0.0934 (w 0.0426 mse 0.0429 t 767 new 0.10) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 17:37:59] step 1083/5000 loss 0.0428 (w 0.1869 mse 0.1804 t 989 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:38:05] step 1084/5000 loss 0.0659 (w 0.0991 mse 0.0963 t 972 new 0.10) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 17:38:11] step 1085/5000 loss 0.1238 (w 0.0634 mse 0.0630 t 858 new 0.26) lr 1.00e-05 gnorm 0.070 5.92s mem 15.6GB +[2026-09-13 17:38:17] step 1086/5000 loss 0.0659 (w 0.0753 mse 0.0713 t 554 new 0.23) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 17:38:22] step 1087/5000 loss 0.1004 (w 0.0522 mse 0.0532 t 860 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 17:38:28] step 1088/5000 loss 0.0666 (w 0.0450 mse 0.0462 t 603 new 0.11) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 17:38:34] step 1089/5000 loss 0.0739 (w 0.1038 mse 0.0954 t 696 new 0.22) lr 1.00e-05 gnorm 0.074 5.93s mem 15.6GB +[2026-09-13 17:38:40] step 1090/5000 loss 0.1081 (w 0.0974 mse 0.0978 t 986 new 0.10) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 17:38:45] step 1091/5000 loss 0.0665 (w 0.1118 mse 0.1138 t 976 new 0.27) lr 1.00e-05 gnorm 0.093 5.70s mem 15.6GB +[2026-09-13 17:38:51] step 1092/5000 loss 0.0708 (w 0.0711 mse 0.0685 t 765 new 0.28) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 17:38:57] step 1093/5000 loss 0.0708 (w 0.0732 mse 0.0782 t 528 new 0.27) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 17:39:03] step 1094/5000 loss 0.0561 (w 0.0934 mse 0.0845 t 942 new 0.23) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 17:39:09] step 1095/5000 loss 0.1059 (w 0.1088 mse 0.1116 t 264 new 0.13) lr 1.00e-05 gnorm 0.102 5.93s mem 15.6GB +[2026-09-13 17:39:14] step 1096/5000 loss 0.0756 (w 0.0653 mse 0.0715 t 976 new 0.17) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 17:39:20] step 1097/5000 loss 0.1196 (w 0.0994 mse 0.1027 t 960 new 0.22) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +[2026-09-13 17:39:26] step 1098/5000 loss 0.0622 (w 0.0508 mse 0.0531 t 899 new 0.24) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 17:39:32] step 1099/5000 loss 0.0576 (w 0.1275 mse 0.1271 t 325 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 17:39:37] step 1100/5000 loss 0.0581 (w 0.1073 mse 0.0973 t 950 new 0.23) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 17:39:43] step 1101/5000 loss 0.0368 (w 0.1773 mse 0.1845 t 999 new 0.23) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 17:39:49] step 1102/5000 loss 0.0799 (w 0.1248 mse 0.1235 t 956 new 0.28) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:39:54] step 1103/5000 loss 0.0898 (w 0.0918 mse 0.0856 t 722 new 0.27) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:40:00] step 1104/5000 loss 0.0956 (w 0.1126 mse 0.1096 t 932 new 0.19) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 17:40:06] step 1105/5000 loss 0.1534 (w 0.1308 mse 0.1346 t 440 new 0.19) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:40:11] step 1106/5000 loss 0.1297 (w 0.1721 mse 0.1504 t 970 new 0.23) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 17:40:17] step 1107/5000 loss 0.0833 (w 0.0566 mse 0.0548 t 541 new 0.15) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 17:40:23] step 1108/5000 loss 0.1030 (w 0.2819 mse 0.2907 t 150 new 0.27) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 17:40:29] step 1109/5000 loss 0.0890 (w 0.0964 mse 0.0967 t 871 new 0.18) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:40:34] step 1110/5000 loss 0.0665 (w 0.0917 mse 0.0898 t 923 new 0.22) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:40:40] step 1111/5000 loss 0.1256 (w 0.0680 mse 0.0668 t 582 new 0.11) lr 1.00e-05 gnorm 0.075 5.67s mem 15.6GB +[2026-09-13 17:40:46] step 1112/5000 loss 0.0866 (w 0.1855 mse 0.1867 t 986 new 0.29) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 17:40:52] step 1113/5000 loss 0.1237 (w 0.0799 mse 0.0774 t 513 new 0.26) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 17:40:57] step 1114/5000 loss 0.1188 (w 0.4383 mse 0.4359 t 101 new 0.23) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 17:41:03] step 1115/5000 loss 0.1149 (w 0.0689 mse 0.0680 t 546 new 0.16) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:41:09] step 1116/5000 loss 0.0965 (w 0.0717 mse 0.0707 t 771 new 0.21) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 17:41:14] step 1117/5000 loss 0.1264 (w 0.0811 mse 0.0783 t 911 new 0.23) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 17:41:20] step 1118/5000 loss 0.0938 (w 0.0981 mse 0.0906 t 963 new 0.26) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:41:26] step 1119/5000 loss 0.0709 (w 0.1333 mse 0.1224 t 970 new 0.28) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 17:41:31] step 1120/5000 loss 0.0869 (w 0.0611 mse 0.0616 t 593 new 0.10) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 17:41:37] step 1121/5000 loss 0.0889 (w 0.0615 mse 0.0626 t 802 new 0.14) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:41:43] step 1122/5000 loss 0.0779 (w 0.2760 mse 0.2615 t 997 new 0.25) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 17:41:49] step 1123/5000 loss 0.0808 (w 0.0199 mse 0.0229 t 631 new 0.17) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 17:41:54] step 1124/5000 loss 0.1021 (w 0.0534 mse 0.0521 t 528 new 0.26) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 17:42:00] step 1125/5000 loss 0.0781 (w 0.1255 mse 0.1277 t 936 new 0.19) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 17:42:06] step 1126/5000 loss 0.1034 (w 0.0662 mse 0.0728 t 971 new 0.12) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 17:42:12] step 1127/5000 loss 0.0768 (w 0.0947 mse 0.0961 t 375 new 0.24) lr 1.00e-05 gnorm 0.074 5.86s mem 15.6GB +[2026-09-13 17:42:17] step 1128/5000 loss 0.0755 (w 0.1048 mse 0.1004 t 833 new 0.24) lr 1.00e-05 gnorm 0.064 5.67s mem 15.6GB +[2026-09-13 17:42:23] step 1129/5000 loss 0.0816 (w 0.0477 mse 0.0460 t 739 new 0.22) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 17:42:29] step 1130/5000 loss 0.1086 (w 0.0736 mse 0.0690 t 670 new 0.30) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 17:42:35] step 1131/5000 loss 0.0651 (w 0.1395 mse 0.1294 t 998 new 0.18) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 17:42:40] step 1132/5000 loss 0.1075 (w 0.0935 mse 0.0922 t 765 new 0.11) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 17:42:46] step 1133/5000 loss 0.1097 (w 0.1401 mse 0.1511 t 981 new 0.16) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 17:42:52] step 1134/5000 loss 0.0941 (w 0.0912 mse 0.0877 t 622 new 0.19) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 17:42:57] step 1135/5000 loss 0.0867 (w 0.1268 mse 0.1196 t 942 new 0.28) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:43:03] step 1136/5000 loss 0.1029 (w 0.0576 mse 0.0592 t 896 new 0.19) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 17:43:09] step 1137/5000 loss 0.0670 (w 0.0895 mse 0.0798 t 860 new 0.22) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 17:43:15] step 1138/5000 loss 0.0886 (w 0.0670 mse 0.0678 t 523 new 0.21) lr 1.00e-05 gnorm 0.089 5.79s mem 15.6GB +[2026-09-13 17:43:20] step 1139/5000 loss 0.1240 (w 0.1880 mse 0.1850 t 222 new 0.25) lr 1.00e-05 gnorm 0.095 5.83s mem 15.6GB +[2026-09-13 17:43:26] step 1140/5000 loss 0.0819 (w 0.0430 mse 0.0455 t 913 new 0.07) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 17:43:32] step 1141/5000 loss 0.1312 (w 0.1395 mse 0.1401 t 267 new 0.27) lr 1.00e-05 gnorm 0.091 5.89s mem 15.6GB +[2026-09-13 17:43:38] step 1142/5000 loss 0.0802 (w 0.1004 mse 0.0974 t 919 new 0.15) lr 1.00e-05 gnorm 0.068 5.74s mem 15.6GB +[2026-09-13 17:43:43] step 1143/5000 loss 0.0832 (w 0.3291 mse 0.3312 t 138 new 0.12) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 17:43:49] step 1144/5000 loss 0.0974 (w 0.0946 mse 0.0859 t 823 new 0.21) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 17:43:55] step 1145/5000 loss 0.0812 (w 0.0490 mse 0.0519 t 425 new 0.26) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 17:44:00] step 1146/5000 loss 0.1041 (w 0.0804 mse 0.0808 t 934 new 0.21) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:44:06] step 1147/5000 loss 0.0651 (w 0.1231 mse 0.1162 t 886 new 0.23) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 17:44:12] step 1148/5000 loss 0.0963 (w 0.1375 mse 0.1333 t 502 new 0.19) lr 1.00e-05 gnorm 0.084 5.93s mem 15.6GB +[2026-09-13 17:44:18] step 1149/5000 loss 0.0726 (w 0.0406 mse 0.0438 t 767 new 0.14) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 17:44:24] step 1150/5000 loss 0.0494 (w 0.0638 mse 0.0692 t 463 new 0.16) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:44:29] step 1151/5000 loss 0.0726 (w 0.1220 mse 0.1175 t 929 new 0.22) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 17:44:35] step 1152/5000 loss 0.1074 (w 0.1162 mse 0.1071 t 596 new 0.28) lr 1.00e-05 gnorm 0.100 5.91s mem 15.6GB +[2026-09-13 17:44:41] step 1153/5000 loss 0.1097 (w 0.0602 mse 0.0617 t 349 new 0.16) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 17:44:47] step 1154/5000 loss 0.0636 (w 0.0622 mse 0.0614 t 957 new 0.13) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:44:53] step 1155/5000 loss 0.0611 (w 0.0570 mse 0.0571 t 532 new 0.29) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:44:58] step 1156/5000 loss 0.0894 (w 0.1875 mse 0.1798 t 992 new 0.22) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:45:04] step 1157/5000 loss 0.1030 (w 0.3186 mse 0.3138 t 105 new 0.23) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:45:10] step 1158/5000 loss 0.0971 (w 0.0844 mse 0.0796 t 902 new 0.21) lr 1.00e-05 gnorm 0.070 5.71s mem 15.6GB +[2026-09-13 17:45:16] step 1159/5000 loss 0.0909 (w 0.1061 mse 0.1116 t 294 new 0.27) lr 1.00e-05 gnorm 0.071 5.71s mem 15.6GB +[2026-09-13 17:45:21] step 1160/5000 loss 0.0622 (w 0.1038 mse 0.0983 t 909 new 0.16) lr 1.00e-05 gnorm 0.096 5.68s mem 15.6GB +[2026-09-13 17:45:27] step 1161/5000 loss 0.0645 (w 0.0485 mse 0.0482 t 891 new 0.13) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:45:33] step 1162/5000 loss 0.0767 (w 0.0935 mse 0.0942 t 949 new 0.24) lr 1.00e-05 gnorm 0.086 5.89s mem 15.6GB +[2026-09-13 17:45:39] step 1163/5000 loss 0.0553 (w 0.1405 mse 0.1369 t 933 new 0.22) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 17:45:44] step 1164/5000 loss 0.0817 (w 0.1134 mse 0.1134 t 961 new 0.13) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 17:45:50] step 1165/5000 loss 0.0800 (w 0.0479 mse 0.0509 t 545 new 0.27) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 17:45:56] step 1166/5000 loss 0.0795 (w 0.1124 mse 0.1087 t 867 new 0.23) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 17:46:01] step 1167/5000 loss 0.0743 (w 0.0525 mse 0.0540 t 856 new 0.19) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 17:46:07] step 1168/5000 loss 0.1134 (w 0.0795 mse 0.0796 t 938 new 0.19) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 17:46:13] step 1169/5000 loss 0.1156 (w 0.2333 mse 0.2155 t 996 new 0.23) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +[2026-09-13 17:46:19] step 1170/5000 loss 0.0685 (w 0.0718 mse 0.0688 t 872 new 0.19) lr 1.00e-05 gnorm 0.100 5.72s mem 15.6GB +[2026-09-13 17:46:25] step 1171/5000 loss 0.0830 (w 0.0823 mse 0.0784 t 834 new 0.27) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 17:46:30] step 1172/5000 loss 0.1064 (w 0.1755 mse 0.1784 t 183 new 0.24) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +[2026-09-13 17:46:36] step 1173/5000 loss 0.1078 (w 0.0873 mse 0.0796 t 914 new 0.29) lr 1.00e-05 gnorm 0.084 5.93s mem 15.6GB +[2026-09-13 17:46:42] step 1174/5000 loss 0.0762 (w 0.0571 mse 0.0512 t 695 new 0.23) lr 1.00e-05 gnorm 0.063 5.75s mem 15.6GB +[2026-09-13 17:46:48] step 1175/5000 loss 0.1114 (w 0.1591 mse 0.1480 t 979 new 0.23) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 17:46:53] step 1176/5000 loss 0.0616 (w 0.0307 mse 0.0313 t 799 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 17:46:59] step 1177/5000 loss 0.0580 (w 0.2259 mse 0.1956 t 991 new 0.30) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 17:47:05] step 1178/5000 loss 0.1081 (w 0.0673 mse 0.0623 t 852 new 0.23) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 17:47:11] step 1179/5000 loss 0.0615 (w 0.0663 mse 0.0656 t 827 new 0.17) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:47:16] step 1180/5000 loss 0.0768 (w 0.0920 mse 0.0924 t 921 new 0.20) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:47:22] step 1181/5000 loss 0.0865 (w 0.0491 mse 0.0489 t 839 new 0.17) lr 1.00e-05 gnorm 0.070 5.89s mem 15.6GB +[2026-09-13 17:47:28] step 1182/5000 loss 0.0878 (w 0.0742 mse 0.0717 t 807 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 17:47:34] step 1183/5000 loss 0.0638 (w 0.1740 mse 0.1607 t 960 new 0.21) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 17:47:40] step 1184/5000 loss 0.0873 (w 0.0926 mse 0.0914 t 997 new 0.07) lr 1.00e-05 gnorm 0.058 5.73s mem 15.6GB +[2026-09-13 17:47:45] step 1185/5000 loss 0.0439 (w 0.1746 mse 0.1564 t 991 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 17:47:51] step 1186/5000 loss 0.0586 (w 0.0933 mse 0.0933 t 950 new 0.24) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 17:47:57] step 1187/5000 loss 0.0447 (w 0.0590 mse 0.0599 t 911 new 0.19) lr 1.00e-05 gnorm 0.049 5.67s mem 15.6GB +[2026-09-13 17:48:02] step 1188/5000 loss 0.1073 (w 0.1179 mse 0.1119 t 974 new 0.26) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 17:48:08] step 1189/5000 loss 0.0940 (w 0.0686 mse 0.0642 t 925 new 0.12) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:48:14] step 1190/5000 loss 0.0557 (w 0.0513 mse 0.0548 t 965 new 0.11) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 17:48:20] step 1191/5000 loss 0.1245 (w 0.0770 mse 0.0691 t 762 new 0.27) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 17:48:26] step 1192/5000 loss 0.0624 (w 0.0897 mse 0.0881 t 913 new 0.25) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 17:48:31] step 1193/5000 loss 0.1278 (w 0.0945 mse 0.0925 t 656 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 17:48:37] step 1194/5000 loss 0.0847 (w 0.0922 mse 0.0888 t 967 new 0.23) lr 1.00e-05 gnorm 0.071 5.93s mem 15.6GB +[2026-09-13 17:48:43] step 1195/5000 loss 0.0611 (w 0.1208 mse 0.1141 t 959 new 0.21) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:48:49] step 1196/5000 loss 0.0688 (w 0.1391 mse 0.1330 t 270 new 0.27) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 17:48:54] step 1197/5000 loss 0.0814 (w 0.0635 mse 0.0592 t 518 new 0.15) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 17:49:00] step 1198/5000 loss 0.0986 (w 0.0964 mse 0.0927 t 829 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 17:49:06] step 1199/5000 loss 0.0588 (w 0.0822 mse 0.0757 t 831 new 0.14) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 17:49:11] step 1200/5000 loss 0.1275 (w 0.2802 mse 0.2743 t 130 new 0.20) lr 1.00e-05 gnorm 0.098 5.71s mem 15.6GB +[2026-09-13 17:49:17] step 1201/5000 loss 0.0760 (w 0.1174 mse 0.1111 t 914 new 0.21) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 17:49:23] step 1202/5000 loss 0.0968 (w 0.0244 mse 0.0289 t 771 new 0.19) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 17:49:29] step 1203/5000 loss 0.1399 (w 0.0739 mse 0.0734 t 824 new 0.20) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 17:49:34] step 1204/5000 loss 0.1181 (w 0.1159 mse 0.1122 t 478 new 0.28) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 17:49:41] step 1205/5000 loss 0.0908 (w 0.1485 mse 0.1468 t 273 new 0.24) lr 1.00e-05 gnorm 0.074 5.94s mem 15.6GB +[2026-09-13 17:49:46] step 1206/5000 loss 0.1034 (w 0.0979 mse 0.0987 t 604 new 0.19) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 17:49:52] step 1207/5000 loss 0.0935 (w 0.4282 mse 0.4214 t 84 new 0.09) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:49:58] step 1208/5000 loss 0.0731 (w 0.0401 mse 0.0413 t 922 new 0.09) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 17:50:03] step 1209/5000 loss 0.0837 (w 0.1627 mse 0.1555 t 996 new 0.17) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:50:09] step 1210/5000 loss 0.0938 (w 0.0490 mse 0.0490 t 699 new 0.17) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 17:50:15] step 1211/5000 loss 0.1425 (w 0.0584 mse 0.0617 t 461 new 0.22) lr 1.00e-05 gnorm 0.080 5.92s mem 15.6GB +[2026-09-13 17:50:21] step 1212/5000 loss 0.0881 (w 0.0751 mse 0.0784 t 826 new 0.30) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 17:50:27] step 1213/5000 loss 0.0682 (w 0.1074 mse 0.1065 t 977 new 0.15) lr 1.00e-05 gnorm 0.055 5.71s mem 15.6GB +[2026-09-13 17:50:32] step 1214/5000 loss 0.0772 (w 0.0674 mse 0.0645 t 844 new 0.25) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 17:50:38] step 1215/5000 loss 0.0688 (w 0.8023 mse 0.8012 t 29 new 0.25) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 17:50:44] step 1216/5000 loss 0.0559 (w 0.1126 mse 0.1241 t 973 new 0.23) lr 1.00e-05 gnorm 0.080 5.74s mem 15.6GB +[2026-09-13 17:50:50] step 1217/5000 loss 0.0903 (w 0.1175 mse 0.1150 t 916 new 0.23) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 17:50:55] step 1218/5000 loss 0.0479 (w 0.0768 mse 0.0729 t 947 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 17:51:01] step 1219/5000 loss 0.0577 (w 0.0908 mse 0.0831 t 860 new 0.19) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 17:51:07] step 1220/5000 loss 0.1085 (w 0.0596 mse 0.0611 t 919 new 0.25) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:51:12] step 1221/5000 loss 0.1031 (w 0.0550 mse 0.0516 t 867 new 0.24) lr 1.00e-05 gnorm 0.053 5.74s mem 15.6GB +[2026-09-13 17:51:18] step 1222/5000 loss 0.0754 (w 0.0688 mse 0.0707 t 956 new 0.11) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 17:51:24] step 1223/5000 loss 0.0795 (w 0.0882 mse 0.0816 t 951 new 0.20) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 17:51:29] step 1224/5000 loss 0.0699 (w 0.0672 mse 0.0680 t 700 new 0.19) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 17:51:35] step 1225/5000 loss 0.0642 (w 0.1113 mse 0.1029 t 919 new 0.28) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 17:51:41] step 1226/5000 loss 0.0755 (w 0.2137 mse 0.2122 t 993 new 0.24) lr 1.00e-05 gnorm 0.076 5.67s mem 15.6GB +[2026-09-13 17:51:47] step 1227/5000 loss 0.0890 (w 0.0962 mse 0.0955 t 756 new 0.24) lr 1.00e-05 gnorm 0.087 5.67s mem 15.6GB +[2026-09-13 17:51:53] step 1228/5000 loss 0.1018 (w 0.1099 mse 0.1050 t 823 new 0.24) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 17:51:58] step 1229/5000 loss 0.0945 (w 0.1008 mse 0.0942 t 941 new 0.26) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:52:04] step 1230/5000 loss 0.0768 (w 0.0918 mse 0.0887 t 523 new 0.26) lr 1.00e-05 gnorm 0.103 5.68s mem 15.6GB +[2026-09-13 17:52:10] step 1231/5000 loss 0.0610 (w 0.0627 mse 0.0600 t 707 new 0.20) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 17:52:16] step 1232/5000 loss 0.0832 (w 0.1247 mse 0.1179 t 973 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 17:52:21] step 1233/5000 loss 0.0708 (w 0.1122 mse 0.1127 t 283 new 0.05) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:52:27] step 1234/5000 loss 0.0563 (w 0.1938 mse 0.1871 t 978 new 0.24) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:52:33] step 1235/5000 loss 0.0852 (w 0.0648 mse 0.0588 t 944 new 0.28) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 17:52:38] step 1236/5000 loss 0.1073 (w 0.0548 mse 0.0557 t 707 new 0.22) lr 1.00e-05 gnorm 0.063 5.71s mem 15.6GB +[2026-09-13 17:52:44] step 1237/5000 loss 0.1019 (w 0.1002 mse 0.0977 t 822 new 0.32) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 17:52:50] step 1238/5000 loss 0.0683 (w 0.0887 mse 0.0856 t 920 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:52:55] step 1239/5000 loss 0.1111 (w 0.0636 mse 0.0634 t 707 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:53:01] step 1240/5000 loss 0.0846 (w 0.1113 mse 0.1107 t 870 new 0.05) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:53:07] step 1241/5000 loss 0.0859 (w 0.0684 mse 0.0651 t 649 new 0.23) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 17:53:13] step 1242/5000 loss 0.1183 (w 0.1114 mse 0.1116 t 686 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 17:53:18] step 1243/5000 loss 0.0582 (w 0.0552 mse 0.0572 t 934 new 0.26) lr 1.00e-05 gnorm 0.078 5.92s mem 15.6GB +[2026-09-13 17:53:24] step 1244/5000 loss 0.0887 (w 0.1026 mse 0.1006 t 986 new 0.13) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 17:53:30] step 1245/5000 loss 0.0602 (w 0.0395 mse 0.0424 t 840 new 0.13) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 17:53:36] step 1246/5000 loss 0.1325 (w 0.1845 mse 0.1839 t 267 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:53:41] step 1247/5000 loss 0.0858 (w 0.2073 mse 0.1947 t 996 new 0.24) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 17:53:47] step 1248/5000 loss 0.0676 (w 0.0973 mse 0.0932 t 522 new 0.26) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 17:53:53] step 1249/5000 loss 0.1181 (w 0.3200 mse 0.3166 t 150 new 0.16) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 17:53:58] step 1250/5000 loss 0.0564 (w 0.0629 mse 0.0587 t 847 new 0.23) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 17:54:04] step 1251/5000 loss 0.0486 (w 0.1540 mse 0.1419 t 972 new 0.27) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:54:10] step 1252/5000 loss 0.0726 (w 0.7922 mse 0.7842 t 34 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 17:54:15] step 1253/5000 loss 0.1364 (w 0.0567 mse 0.0524 t 721 new 0.27) lr 1.00e-05 gnorm 0.116 5.68s mem 15.6GB +[2026-09-13 17:54:21] step 1254/5000 loss 0.0842 (w 0.1152 mse 0.1050 t 955 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 17:54:27] step 1255/5000 loss 0.0873 (w 0.1729 mse 0.1520 t 983 new 0.24) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:54:33] step 1256/5000 loss 0.1211 (w 0.1109 mse 0.1062 t 877 new 0.18) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 17:54:38] step 1257/5000 loss 0.0842 (w 0.0654 mse 0.0640 t 884 new 0.09) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 17:54:44] step 1258/5000 loss 0.0806 (w 0.0205 mse 0.0234 t 763 new 0.15) lr 1.00e-05 gnorm 0.078 5.83s mem 15.6GB +[2026-09-13 17:54:50] step 1259/5000 loss 0.0661 (w 0.0914 mse 0.0905 t 629 new 0.20) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 17:54:55] step 1260/5000 loss 0.0889 (w 0.1254 mse 0.1230 t 958 new 0.15) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 17:55:01] step 1261/5000 loss 0.0932 (w 0.1062 mse 0.1052 t 968 new 0.25) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:55:07] step 1262/5000 loss 0.1500 (w 0.1213 mse 0.1206 t 438 new 0.28) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 17:55:13] step 1263/5000 loss 0.0871 (w 0.0675 mse 0.0633 t 782 new 0.29) lr 1.00e-05 gnorm 0.068 5.84s mem 15.6GB +[2026-09-13 17:55:18] step 1264/5000 loss 0.0759 (w 0.0714 mse 0.0661 t 879 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 17:55:24] step 1265/5000 loss 0.0721 (w 0.2038 mse 0.2029 t 239 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 17:55:30] step 1266/5000 loss 0.0824 (w 0.0548 mse 0.0528 t 845 new 0.16) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 17:55:36] step 1267/5000 loss 0.0619 (w 0.1944 mse 0.1998 t 987 new 0.28) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 17:55:41] step 1268/5000 loss 0.0704 (w 0.0763 mse 0.0730 t 893 new 0.19) lr 1.00e-05 gnorm 0.077 5.92s mem 15.6GB +[2026-09-13 17:55:47] step 1269/5000 loss 0.0823 (w 0.0687 mse 0.0668 t 749 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 17:55:53] step 1270/5000 loss 0.0771 (w 0.0376 mse 0.0374 t 734 new 0.29) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:55:59] step 1271/5000 loss 0.0944 (w 0.1774 mse 0.1697 t 980 new 0.16) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 17:56:04] step 1272/5000 loss 0.0583 (w 0.0878 mse 0.0854 t 950 new 0.27) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 17:56:10] step 1273/5000 loss 0.0871 (w 0.2017 mse 0.1965 t 972 new 0.28) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 17:56:16] step 1274/5000 loss 0.0817 (w 0.0912 mse 0.0811 t 875 new 0.22) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 17:56:21] step 1275/5000 loss 0.0723 (w 0.1236 mse 0.1162 t 961 new 0.28) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:56:27] step 1276/5000 loss 0.1082 (w 0.0801 mse 0.0840 t 467 new 0.16) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:56:33] step 1277/5000 loss 0.1341 (w 0.1071 mse 0.0950 t 923 new 0.22) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:56:38] step 1278/5000 loss 0.1209 (w 0.0599 mse 0.0558 t 781 new 0.17) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 17:56:44] step 1279/5000 loss 0.0640 (w 0.0806 mse 0.0739 t 938 new 0.19) lr 1.00e-05 gnorm 0.063 5.92s mem 15.6GB +[2026-09-13 17:56:50] step 1280/5000 loss 0.0809 (w 0.0739 mse 0.0788 t 938 new 0.18) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 17:56:56] step 1281/5000 loss 0.0991 (w 0.1069 mse 0.0979 t 973 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 17:57:01] step 1282/5000 loss 0.0329 (w 0.0641 mse 0.0592 t 825 new 0.22) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +[2026-09-13 17:57:07] step 1283/5000 loss 0.1539 (w 0.0861 mse 0.0822 t 805 new 0.23) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 17:57:13] step 1284/5000 loss 0.0845 (w 0.0548 mse 0.0537 t 881 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:57:19] step 1285/5000 loss 0.0794 (w 0.0883 mse 0.0905 t 556 new 0.20) lr 1.00e-05 gnorm 0.100 5.69s mem 15.6GB +[2026-09-13 17:57:24] step 1286/5000 loss 0.0670 (w 0.0686 mse 0.0679 t 915 new 0.13) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 17:57:30] step 1287/5000 loss 0.0946 (w 0.0669 mse 0.0654 t 922 new 0.27) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 17:57:36] step 1288/5000 loss 0.1237 (w 0.0884 mse 0.0846 t 772 new 0.27) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 17:57:42] step 1289/5000 loss 0.0797 (w 0.0478 mse 0.0476 t 568 new 0.26) lr 1.00e-05 gnorm 0.106 5.92s mem 15.6GB +[2026-09-13 17:57:47] step 1290/5000 loss 0.0902 (w 0.0765 mse 0.0684 t 788 new 0.26) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 17:57:53] step 1291/5000 loss 0.0848 (w 0.2140 mse 0.1874 t 992 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 17:57:59] step 1292/5000 loss 0.0752 (w 0.0767 mse 0.0744 t 827 new 0.24) lr 1.00e-05 gnorm 0.116 5.70s mem 15.6GB +[2026-09-13 17:58:04] step 1293/5000 loss 0.0864 (w 0.0760 mse 0.0712 t 900 new 0.22) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 17:58:10] step 1294/5000 loss 0.1000 (w 0.0583 mse 0.0582 t 731 new 0.08) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 17:58:16] step 1295/5000 loss 0.0718 (w 0.0605 mse 0.0584 t 838 new 0.19) lr 1.00e-05 gnorm 0.103 5.90s mem 15.6GB +[2026-09-13 17:58:22] step 1296/5000 loss 0.1080 (w 0.0654 mse 0.0638 t 399 new 0.18) lr 1.00e-05 gnorm 0.096 5.76s mem 15.6GB +[2026-09-13 17:58:27] step 1297/5000 loss 0.0679 (w 0.0706 mse 0.0664 t 824 new 0.24) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 17:58:33] step 1298/5000 loss 0.1377 (w 0.0137 mse 0.0141 t 803 new 0.08) lr 1.00e-05 gnorm 0.176 5.68s mem 15.6GB +[2026-09-13 17:58:39] step 1299/5000 loss 0.0856 (w 0.0988 mse 0.0957 t 471 new 0.25) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 17:58:45] step 1300/5000 loss 0.0910 (w 0.0837 mse 0.0797 t 899 new 0.23) lr 1.00e-05 gnorm 0.079 5.76s mem 15.6GB +[2026-09-13 17:58:50] step 1301/5000 loss 0.1053 (w 0.0638 mse 0.0610 t 591 new 0.22) lr 1.00e-05 gnorm 0.135 5.68s mem 15.6GB +[2026-09-13 17:58:56] step 1302/5000 loss 0.1098 (w 0.1063 mse 0.1001 t 722 new 0.25) lr 1.00e-05 gnorm 0.127 5.68s mem 15.6GB +[2026-09-13 17:59:02] step 1303/5000 loss 0.1217 (w 0.1787 mse 0.1706 t 239 new 0.18) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 17:59:07] step 1304/5000 loss 0.1105 (w 0.2727 mse 0.2617 t 991 new 0.18) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 17:59:13] step 1305/5000 loss 0.0902 (w 0.0919 mse 0.0852 t 587 new 0.19) lr 1.00e-05 gnorm 0.137 5.85s mem 15.6GB +[2026-09-13 17:59:19] step 1306/5000 loss 0.0853 (w 0.0905 mse 0.0878 t 981 new 0.15) lr 1.00e-05 gnorm 0.079 5.91s mem 15.6GB +[2026-09-13 17:59:25] step 1307/5000 loss 0.0610 (w 0.1639 mse 0.1588 t 970 new 0.24) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 17:59:31] step 1308/5000 loss 0.1030 (w 0.0707 mse 0.0683 t 857 new 0.12) lr 1.00e-05 gnorm 0.104 5.70s mem 15.6GB +[2026-09-13 17:59:36] step 1309/5000 loss 0.1321 (w 0.0933 mse 0.0941 t 815 new 0.21) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 17:59:42] step 1310/5000 loss 0.0677 (w 0.1698 mse 0.1465 t 994 new 0.23) lr 1.00e-05 gnorm 0.068 5.88s mem 15.6GB +[2026-09-13 17:59:48] step 1311/5000 loss 0.0420 (w 0.1753 mse 0.1643 t 980 new 0.23) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 17:59:54] step 1312/5000 loss 0.0477 (w 0.0957 mse 0.0919 t 676 new 0.30) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 17:59:59] step 1313/5000 loss 0.0923 (w 0.0902 mse 0.0936 t 317 new 0.20) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 18:00:05] step 1314/5000 loss 0.0991 (w 0.1762 mse 0.1698 t 977 new 0.16) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 18:00:11] step 1315/5000 loss 0.1267 (w 0.1613 mse 0.1495 t 987 new 0.21) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 18:00:16] step 1316/5000 loss 0.0625 (w 0.0539 mse 0.0516 t 451 new 0.12) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 18:00:22] step 1317/5000 loss 0.0827 (w 0.0814 mse 0.0726 t 663 new 0.26) lr 1.00e-05 gnorm 0.071 5.77s mem 15.6GB +[2026-09-13 18:00:28] step 1318/5000 loss 0.0913 (w 0.0424 mse 0.0428 t 860 new 0.13) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 18:00:34] step 1319/5000 loss 0.0838 (w 0.0559 mse 0.0528 t 817 new 0.22) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 18:00:39] step 1320/5000 loss 0.0975 (w 0.1285 mse 0.1289 t 970 new 0.22) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 18:00:45] step 1321/5000 loss 0.0954 (w 0.0656 mse 0.0578 t 815 new 0.23) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 18:00:51] step 1322/5000 loss 0.1491 (w 0.0388 mse 0.0388 t 714 new 0.11) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:00:56] step 1323/5000 loss 0.1209 (w 0.4278 mse 0.4174 t 101 new 0.23) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 18:01:02] step 1324/5000 loss 0.0819 (w 0.3487 mse 0.3203 t 996 new 0.25) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 18:01:08] step 1325/5000 loss 0.0722 (w 0.3005 mse 0.2673 t 996 new 0.29) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 18:01:14] step 1326/5000 loss 0.1274 (w 0.0864 mse 0.0875 t 956 new 0.12) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 18:01:19] step 1327/5000 loss 0.0850 (w 0.0598 mse 0.0611 t 578 new 0.24) lr 1.00e-05 gnorm 0.059 5.90s mem 15.6GB +[2026-09-13 18:01:25] step 1328/5000 loss 0.0918 (w 0.1389 mse 0.1434 t 157 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 18:01:31] step 1329/5000 loss 0.1096 (w 0.0882 mse 0.0907 t 931 new 0.18) lr 1.00e-05 gnorm 0.067 5.91s mem 15.6GB +[2026-09-13 18:01:37] step 1330/5000 loss 0.0766 (w 0.1312 mse 0.1147 t 975 new 0.26) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 18:01:43] step 1331/5000 loss 0.0389 (w 0.0482 mse 0.0515 t 946 new 0.16) lr 1.00e-05 gnorm 0.068 5.98s mem 15.6GB +[2026-09-13 18:01:48] step 1332/5000 loss 0.0865 (w 0.0398 mse 0.0382 t 788 new 0.21) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 18:01:54] step 1333/5000 loss 0.0636 (w 0.0940 mse 0.0953 t 958 new 0.17) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:02:00] step 1334/5000 loss 0.0662 (w 0.1045 mse 0.1018 t 783 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 18:02:06] step 1335/5000 loss 0.1285 (w 0.1583 mse 0.1534 t 987 new 0.14) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +[2026-09-13 18:02:11] step 1336/5000 loss 0.1172 (w 0.0520 mse 0.0520 t 612 new 0.14) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 18:02:17] step 1337/5000 loss 0.0790 (w 0.1251 mse 0.1236 t 588 new 0.26) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 18:02:23] step 1338/5000 loss 0.0494 (w 0.1205 mse 0.1084 t 926 new 0.26) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 18:02:28] step 1339/5000 loss 0.1009 (w 0.0778 mse 0.0732 t 522 new 0.23) lr 1.00e-05 gnorm 0.091 5.82s mem 15.6GB +[2026-09-13 18:02:34] step 1340/5000 loss 0.1008 (w 0.1369 mse 0.1223 t 954 new 0.23) lr 1.00e-05 gnorm 0.089 5.67s mem 15.6GB +[2026-09-13 18:02:40] step 1341/5000 loss 0.0910 (w 0.0911 mse 0.0900 t 809 new 0.22) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 18:02:46] step 1342/5000 loss 0.0449 (w 0.0880 mse 0.0870 t 978 new 0.12) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 18:02:51] step 1343/5000 loss 0.0758 (w 0.0849 mse 0.0831 t 977 new 0.28) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 18:02:57] step 1344/5000 loss 0.1000 (w 0.0946 mse 0.0895 t 425 new 0.26) lr 1.00e-05 gnorm 0.069 5.93s mem 15.6GB +[2026-09-13 18:03:03] step 1345/5000 loss 0.1087 (w 0.0503 mse 0.0479 t 880 new 0.20) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 18:03:09] step 1346/5000 loss 0.0964 (w 0.2575 mse 0.2545 t 201 new 0.29) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 18:03:15] step 1347/5000 loss 0.1211 (w 0.0667 mse 0.0668 t 718 new 0.20) lr 1.00e-05 gnorm 0.075 5.67s mem 15.6GB +[2026-09-13 18:03:20] step 1348/5000 loss 0.0647 (w 0.1204 mse 0.1178 t 944 new 0.25) lr 1.00e-05 gnorm 0.073 5.90s mem 15.6GB +[2026-09-13 18:03:26] step 1349/5000 loss 0.0787 (w 0.0784 mse 0.0748 t 913 new 0.11) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 18:03:32] step 1350/5000 loss 0.0909 (w 0.0574 mse 0.0608 t 764 new 0.28) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 18:03:38] step 1351/5000 loss 0.0919 (w 0.0975 mse 0.0937 t 538 new 0.31) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 18:03:43] step 1352/5000 loss 0.1191 (w 0.0626 mse 0.0619 t 796 new 0.21) lr 1.00e-05 gnorm 0.063 5.88s mem 15.6GB +[2026-09-13 18:03:49] step 1353/5000 loss 0.1026 (w 0.0838 mse 0.0856 t 384 new 0.23) lr 1.00e-05 gnorm 0.071 5.95s mem 15.6GB +[2026-09-13 18:03:55] step 1354/5000 loss 0.0471 (w 0.1990 mse 0.1919 t 978 new 0.24) lr 1.00e-05 gnorm 0.062 5.81s mem 15.6GB +[2026-09-13 18:04:01] step 1355/5000 loss 0.0967 (w 0.0879 mse 0.0846 t 815 new 0.16) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 18:04:07] step 1356/5000 loss 0.1221 (w 0.0619 mse 0.0595 t 963 new 0.22) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +[2026-09-13 18:04:12] step 1357/5000 loss 0.0798 (w 0.0395 mse 0.0424 t 836 new 0.26) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 18:04:18] step 1358/5000 loss 0.0889 (w 0.2030 mse 0.1952 t 998 new 0.19) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 18:04:24] step 1359/5000 loss 0.0684 (w 0.0805 mse 0.0787 t 801 new 0.20) lr 1.00e-05 gnorm 0.059 5.84s mem 15.6GB +[2026-09-13 18:04:30] step 1360/5000 loss 0.0978 (w 0.0662 mse 0.0631 t 824 new 0.24) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 18:04:35] step 1361/5000 loss 0.0599 (w 0.0845 mse 0.0826 t 845 new 0.13) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:04:41] step 1362/5000 loss 0.0563 (w 0.0347 mse 0.0354 t 874 new 0.09) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 18:04:47] step 1363/5000 loss 0.0834 (w 0.1070 mse 0.0953 t 953 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 18:04:52] step 1364/5000 loss 0.0883 (w 0.1172 mse 0.1189 t 967 new 0.18) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 18:04:58] step 1365/5000 loss 0.1545 (w 0.1148 mse 0.1115 t 408 new 0.17) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 18:05:04] step 1366/5000 loss 0.0982 (w 0.0635 mse 0.0602 t 752 new 0.17) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 18:05:10] step 1367/5000 loss 0.1215 (w 0.3747 mse 0.3706 t 88 new 0.19) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 18:05:15] step 1368/5000 loss 0.1141 (w 0.0995 mse 0.0964 t 589 new 0.25) lr 1.00e-05 gnorm 0.104 5.68s mem 15.6GB +[2026-09-13 18:05:21] step 1369/5000 loss 0.0491 (w 0.1389 mse 0.1295 t 948 new 0.15) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 18:05:27] step 1370/5000 loss 0.1027 (w 0.0859 mse 0.0864 t 525 new 0.21) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 18:05:32] step 1371/5000 loss 0.1357 (w 0.0740 mse 0.0657 t 887 new 0.23) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +[2026-09-13 18:05:38] step 1372/5000 loss 0.0728 (w 0.0893 mse 0.0849 t 715 new 0.21) lr 1.00e-05 gnorm 0.070 5.67s mem 15.6GB +[2026-09-13 18:05:44] step 1373/5000 loss 0.0757 (w 0.0332 mse 0.0337 t 805 new 0.16) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 18:05:50] step 1374/5000 loss 0.0713 (w 0.0946 mse 0.0892 t 925 new 0.19) lr 1.00e-05 gnorm 0.077 5.89s mem 15.6GB +[2026-09-13 18:05:55] step 1375/5000 loss 0.0908 (w 0.2066 mse 0.1939 t 998 new 0.32) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 18:06:01] step 1376/5000 loss 0.0831 (w 0.1079 mse 0.0958 t 908 new 0.20) lr 1.00e-05 gnorm 0.094 5.68s mem 15.6GB +[2026-09-13 18:06:07] step 1377/5000 loss 0.0942 (w 0.0394 mse 0.0368 t 706 new 0.21) lr 1.00e-05 gnorm 0.088 5.67s mem 15.6GB +[2026-09-13 18:06:12] step 1378/5000 loss 0.1101 (w 0.0596 mse 0.0647 t 917 new 0.13) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 18:06:18] step 1379/5000 loss 0.0673 (w 0.0598 mse 0.0648 t 681 new 0.21) lr 1.00e-05 gnorm 0.086 5.67s mem 15.6GB +[2026-09-13 18:06:24] step 1380/5000 loss 0.0721 (w 0.0738 mse 0.0758 t 950 new 0.21) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 18:06:29] step 1381/5000 loss 0.0834 (w 0.0549 mse 0.0528 t 827 new 0.12) lr 1.00e-05 gnorm 0.120 5.68s mem 15.6GB +[2026-09-13 18:06:35] step 1382/5000 loss 0.0821 (w 0.0410 mse 0.0407 t 902 new 0.11) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 18:06:41] step 1383/5000 loss 0.1061 (w 0.1272 mse 0.1262 t 323 new 0.26) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +[2026-09-13 18:06:47] step 1384/5000 loss 0.1283 (w 0.0770 mse 0.0701 t 716 new 0.26) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 18:06:52] step 1385/5000 loss 0.0918 (w 1.0112 mse 1.0112 t 5 new 0.24) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 18:06:58] step 1386/5000 loss 0.0790 (w 0.0681 mse 0.0653 t 744 new 0.25) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 18:07:04] step 1387/5000 loss 0.0779 (w 0.0958 mse 0.0884 t 848 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 18:07:09] step 1388/5000 loss 0.0474 (w 0.0707 mse 0.0679 t 818 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 18:07:15] step 1389/5000 loss 0.0780 (w 0.0934 mse 0.0997 t 979 new 0.16) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +[2026-09-13 18:07:21] step 1390/5000 loss 0.0889 (w 0.0282 mse 0.0316 t 833 new 0.15) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 18:07:26] step 1391/5000 loss 0.1252 (w 0.0546 mse 0.0561 t 581 new 0.25) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 18:07:32] step 1392/5000 loss 0.1259 (w 0.0832 mse 0.0740 t 863 new 0.23) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 18:07:38] step 1393/5000 loss 0.0895 (w 0.0816 mse 0.0750 t 776 new 0.26) lr 1.00e-05 gnorm 0.058 5.67s mem 15.6GB +[2026-09-13 18:07:44] step 1394/5000 loss 0.1000 (w 0.1595 mse 0.1503 t 970 new 0.16) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 18:07:50] step 1395/5000 loss 0.0811 (w 0.0750 mse 0.0645 t 638 new 0.25) lr 1.00e-05 gnorm 0.066 6.13s mem 15.6GB +[2026-09-13 18:07:55] step 1396/5000 loss 0.0529 (w 0.1472 mse 0.1369 t 955 new 0.22) lr 1.00e-05 gnorm 0.075 5.78s mem 15.6GB +[2026-09-13 18:08:01] step 1397/5000 loss 0.0901 (w 0.0723 mse 0.0665 t 850 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 18:08:07] step 1398/5000 loss 0.1275 (w 0.5051 mse 0.4962 t 80 new 0.18) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 18:08:13] step 1399/5000 loss 0.0718 (w 0.0670 mse 0.0650 t 658 new 0.27) lr 1.00e-05 gnorm 0.071 5.85s mem 15.6GB +[2026-09-13 18:08:18] step 1400/5000 loss 0.0540 (w 0.1499 mse 0.1442 t 971 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 18:08:24] step 1401/5000 loss 0.0538 (w 0.1020 mse 0.0987 t 921 new 0.18) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 18:08:30] step 1402/5000 loss 0.0500 (w 0.0340 mse 0.0365 t 584 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 18:08:36] step 1403/5000 loss 0.0470 (w 0.0663 mse 0.0636 t 908 new 0.09) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 18:08:41] step 1404/5000 loss 0.1092 (w 0.0914 mse 0.0926 t 417 new 0.24) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 18:08:47] step 1405/5000 loss 0.0710 (w 0.0700 mse 0.0727 t 932 new 0.22) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 18:08:53] step 1406/5000 loss 0.0708 (w 0.1697 mse 0.1559 t 974 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:08:58] step 1407/5000 loss 0.0658 (w 0.0851 mse 0.0810 t 919 new 0.24) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 18:09:04] step 1408/5000 loss 0.0871 (w 0.1053 mse 0.0967 t 968 new 0.21) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 18:09:10] step 1409/5000 loss 0.0655 (w 0.0838 mse 0.0871 t 958 new 0.25) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 18:09:15] step 1410/5000 loss 0.1342 (w 0.2750 mse 0.2827 t 105 new 0.20) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 18:09:21] step 1411/5000 loss 0.0871 (w 0.0741 mse 0.0695 t 604 new 0.23) lr 1.00e-05 gnorm 0.078 5.74s mem 15.6GB +[2026-09-13 18:09:27] step 1412/5000 loss 0.0672 (w 0.0487 mse 0.0470 t 876 new 0.09) lr 1.00e-05 gnorm 0.065 5.81s mem 15.6GB +[2026-09-13 18:09:33] step 1413/5000 loss 0.0859 (w 0.0904 mse 0.0869 t 721 new 0.25) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 18:09:38] step 1414/5000 loss 0.0883 (w 0.0775 mse 0.0693 t 837 new 0.19) lr 1.00e-05 gnorm 0.076 5.74s mem 15.6GB +[2026-09-13 18:09:44] step 1415/5000 loss 0.0664 (w 0.1361 mse 0.1255 t 978 new 0.19) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 18:09:50] step 1416/5000 loss 0.0699 (w 0.3219 mse 0.3476 t 80 new 0.24) lr 1.00e-05 gnorm 0.059 5.88s mem 15.6GB +[2026-09-13 18:09:56] step 1417/5000 loss 0.1076 (w 0.0905 mse 0.0811 t 824 new 0.27) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 18:10:01] step 1418/5000 loss 0.0599 (w 0.0642 mse 0.0642 t 642 new 0.21) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +[2026-09-13 18:10:07] step 1419/5000 loss 0.0387 (w 0.1727 mse 0.1655 t 966 new 0.14) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 18:10:13] step 1420/5000 loss 0.0884 (w 0.0704 mse 0.0695 t 599 new 0.16) lr 1.00e-05 gnorm 0.076 5.80s mem 15.6GB +[2026-09-13 18:10:19] step 1421/5000 loss 0.0658 (w 0.0922 mse 0.0904 t 921 new 0.24) lr 1.00e-05 gnorm 0.081 5.90s mem 15.6GB +[2026-09-13 18:10:25] step 1422/5000 loss 0.1146 (w 0.2694 mse 0.2669 t 161 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:10:30] step 1423/5000 loss 0.0975 (w 0.0745 mse 0.0905 t 232 new 0.24) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +[2026-09-13 18:10:36] step 1424/5000 loss 0.0777 (w 0.0441 mse 0.0462 t 694 new 0.25) lr 1.00e-05 gnorm 0.090 5.90s mem 15.6GB +[2026-09-13 18:10:42] step 1425/5000 loss 0.0500 (w 0.0753 mse 0.0694 t 621 new 0.20) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 18:10:48] step 1426/5000 loss 0.1206 (w 0.1132 mse 0.1128 t 349 new 0.23) lr 1.00e-05 gnorm 0.077 5.88s mem 15.6GB +[2026-09-13 18:10:53] step 1427/5000 loss 0.0715 (w 0.0558 mse 0.0596 t 752 new 0.20) lr 1.00e-05 gnorm 0.085 5.67s mem 15.6GB +[2026-09-13 18:10:59] step 1428/5000 loss 0.0864 (w 0.0757 mse 0.0703 t 625 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 18:11:05] step 1429/5000 loss 0.1246 (w 0.4212 mse 0.4054 t 105 new 0.21) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +[2026-09-13 18:11:11] step 1430/5000 loss 0.1019 (w 0.0894 mse 0.0887 t 915 new 0.21) lr 1.00e-05 gnorm 0.063 6.45s mem 15.6GB +[2026-09-13 18:11:17] step 1431/5000 loss 0.0895 (w 0.0460 mse 0.0481 t 869 new 0.09) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 18:11:23] step 1432/5000 loss 0.0964 (w 0.0715 mse 0.0673 t 886 new 0.23) lr 1.00e-05 gnorm 0.061 5.74s mem 15.6GB +[2026-09-13 18:11:29] step 1433/5000 loss 0.0814 (w 0.1045 mse 0.0988 t 904 new 0.24) lr 1.00e-05 gnorm 0.077 5.80s mem 15.6GB +[2026-09-13 18:11:34] step 1434/5000 loss 0.1111 (w 0.0587 mse 0.0569 t 847 new 0.25) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 18:11:40] step 1435/5000 loss 0.0546 (w 0.1452 mse 0.1354 t 972 new 0.20) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 18:11:46] step 1436/5000 loss 0.0897 (w 0.0624 mse 0.0657 t 532 new 0.17) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 18:11:52] step 1437/5000 loss 0.0670 (w 0.0672 mse 0.0642 t 904 new 0.25) lr 1.00e-05 gnorm 0.068 5.89s mem 15.6GB +[2026-09-13 18:11:58] step 1438/5000 loss 0.0977 (w 0.1577 mse 0.1466 t 309 new 0.23) lr 1.00e-05 gnorm 0.061 5.89s mem 15.6GB +[2026-09-13 18:12:03] step 1439/5000 loss 0.1020 (w 0.0723 mse 0.0715 t 688 new 0.20) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:12:09] step 1440/5000 loss 0.0947 (w 0.0646 mse 0.0631 t 908 new 0.21) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 18:12:15] step 1441/5000 loss 0.0635 (w 0.0533 mse 0.0557 t 568 new 0.17) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 18:12:20] step 1442/5000 loss 0.0997 (w 0.1002 mse 0.0950 t 616 new 0.24) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 18:12:26] step 1443/5000 loss 0.1014 (w 0.0597 mse 0.0628 t 658 new 0.24) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 18:12:32] step 1444/5000 loss 0.0734 (w 0.0878 mse 0.0826 t 681 new 0.21) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 18:12:38] step 1445/5000 loss 0.1079 (w 0.3284 mse 0.3381 t 122 new 0.22) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:12:43] step 1446/5000 loss 0.0855 (w 0.1045 mse 0.1039 t 954 new 0.17) lr 1.00e-05 gnorm 0.064 5.86s mem 15.6GB +[2026-09-13 18:12:49] step 1447/5000 loss 0.0818 (w 0.1104 mse 0.1069 t 898 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:12:55] step 1448/5000 loss 0.1092 (w 0.1286 mse 0.1234 t 382 new 0.22) lr 1.00e-05 gnorm 0.064 5.94s mem 15.6GB +[2026-09-13 18:13:01] step 1449/5000 loss 0.0514 (w 0.1322 mse 0.1225 t 969 new 0.26) lr 1.00e-05 gnorm 0.113 5.68s mem 15.6GB +[2026-09-13 18:13:06] step 1450/5000 loss 0.1081 (w 0.1045 mse 0.0989 t 423 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 18:13:12] step 1451/5000 loss 0.0700 (w 0.0541 mse 0.0553 t 591 new 0.15) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 18:13:18] step 1452/5000 loss 0.0763 (w 0.0929 mse 0.0857 t 928 new 0.23) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 18:13:24] step 1453/5000 loss 0.1110 (w 0.1406 mse 0.1387 t 306 new 0.19) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 18:13:29] step 1454/5000 loss 0.1158 (w 0.1967 mse 0.2000 t 219 new 0.23) lr 1.00e-05 gnorm 0.070 5.90s mem 15.6GB +[2026-09-13 18:13:35] step 1455/5000 loss 0.0797 (w 0.0865 mse 0.0833 t 480 new 0.30) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 18:13:41] step 1456/5000 loss 0.0920 (w 0.1048 mse 0.1026 t 652 new 0.18) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 18:13:47] step 1457/5000 loss 0.0775 (w 0.0855 mse 0.0835 t 719 new 0.22) lr 1.00e-05 gnorm 0.051 5.67s mem 15.6GB +[2026-09-13 18:13:52] step 1458/5000 loss 0.0733 (w 0.0692 mse 0.0645 t 842 new 0.24) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 18:13:58] step 1459/5000 loss 0.0848 (w 0.0978 mse 0.0923 t 952 new 0.26) lr 1.00e-05 gnorm 0.057 5.67s mem 15.6GB +[2026-09-13 18:14:04] step 1460/5000 loss 0.0966 (w 0.1784 mse 0.1713 t 970 new 0.18) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 18:14:10] step 1461/5000 loss 0.0902 (w 0.1103 mse 0.0997 t 900 new 0.23) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 18:14:15] step 1462/5000 loss 0.0641 (w 0.0747 mse 0.0705 t 890 new 0.20) lr 1.00e-05 gnorm 0.044 5.87s mem 15.6GB +[2026-09-13 18:14:21] step 1463/5000 loss 0.0985 (w 0.0758 mse 0.0662 t 904 new 0.25) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 18:14:27] step 1464/5000 loss 0.1101 (w 0.1985 mse 0.1883 t 997 new 0.18) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 18:14:33] step 1465/5000 loss 0.0982 (w 0.1348 mse 0.1307 t 362 new 0.23) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 18:14:38] step 1466/5000 loss 0.0768 (w 0.0768 mse 0.0781 t 666 new 0.17) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 18:14:44] step 1467/5000 loss 0.0986 (w 0.0532 mse 0.0532 t 842 new 0.19) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 18:14:50] step 1468/5000 loss 0.0965 (w 0.1389 mse 0.1382 t 958 new 0.19) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +[2026-09-13 18:14:56] step 1469/5000 loss 0.1177 (w 0.0664 mse 0.0634 t 740 new 0.15) lr 1.00e-05 gnorm 0.063 5.88s mem 15.6GB +[2026-09-13 18:15:01] step 1470/5000 loss 0.0940 (w 0.0451 mse 0.0438 t 692 new 0.26) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:15:07] step 1471/5000 loss 0.0864 (w 0.1203 mse 0.1294 t 959 new 0.14) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 18:15:13] step 1472/5000 loss 0.0930 (w 0.0965 mse 0.0970 t 560 new 0.19) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 18:15:19] step 1473/5000 loss 0.0799 (w 0.0734 mse 0.0703 t 812 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:15:24] step 1474/5000 loss 0.0804 (w 0.1145 mse 0.1206 t 802 new 0.20) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 18:15:30] step 1475/5000 loss 0.1037 (w 0.0902 mse 0.0899 t 920 new 0.13) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:15:36] step 1476/5000 loss 0.1029 (w 0.0600 mse 0.0611 t 715 new 0.15) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 18:15:41] step 1477/5000 loss 0.1056 (w 0.0857 mse 0.0814 t 889 new 0.22) lr 1.00e-05 gnorm 0.072 5.74s mem 15.6GB +[2026-09-13 18:15:47] step 1478/5000 loss 0.1323 (w 0.2664 mse 0.2644 t 165 new 0.20) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 18:15:53] step 1479/5000 loss 0.1120 (w 0.1526 mse 0.1423 t 978 new 0.18) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 18:15:59] step 1480/5000 loss 0.0987 (w 0.1670 mse 0.1583 t 970 new 0.25) lr 1.00e-05 gnorm 0.061 5.67s mem 15.6GB +[2026-09-13 18:16:04] step 1481/5000 loss 0.1101 (w 0.1552 mse 0.1625 t 191 new 0.29) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 18:16:10] step 1482/5000 loss 0.0881 (w 0.1102 mse 0.1102 t 336 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 18:16:16] step 1483/5000 loss 0.0968 (w 0.0732 mse 0.0696 t 569 new 0.29) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 18:16:21] step 1484/5000 loss 0.1581 (w 0.0613 mse 0.0560 t 528 new 0.18) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 18:16:27] step 1485/5000 loss 0.0744 (w 0.0679 mse 0.0659 t 733 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 18:16:33] step 1486/5000 loss 0.0650 (w 0.0304 mse 0.0370 t 900 new 0.23) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 18:16:39] step 1487/5000 loss 0.0988 (w 0.1008 mse 0.0970 t 827 new 0.18) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 18:16:44] step 1488/5000 loss 0.0755 (w 0.1212 mse 0.1162 t 983 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 18:16:50] step 1489/5000 loss 0.0820 (w 0.0855 mse 0.0806 t 768 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 18:16:56] step 1490/5000 loss 0.0646 (w 0.0543 mse 0.0531 t 847 new 0.19) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 18:17:02] step 1491/5000 loss 0.0739 (w 0.0985 mse 0.0960 t 546 new 0.28) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 18:17:07] step 1492/5000 loss 0.0696 (w 0.0851 mse 0.0858 t 941 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 18:17:13] step 1493/5000 loss 0.1427 (w 0.0414 mse 0.0448 t 947 new 0.15) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 18:17:19] step 1494/5000 loss 0.1037 (w 0.0965 mse 0.0899 t 911 new 0.27) lr 1.00e-05 gnorm 0.095 5.68s mem 15.6GB +[2026-09-13 18:17:25] step 1495/5000 loss 0.0864 (w 0.2079 mse 0.2031 t 994 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 18:17:30] step 1496/5000 loss 0.1569 (w 0.0956 mse 0.0964 t 968 new 0.26) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 18:17:36] step 1497/5000 loss 0.1153 (w 0.0948 mse 0.0918 t 655 new 0.24) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 18:17:42] step 1498/5000 loss 0.1196 (w 0.0584 mse 0.0551 t 728 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:17:48] step 1499/5000 loss 0.0574 (w 0.0914 mse 0.0910 t 912 new 0.24) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 18:17:53] step 1500/5000 loss 0.1408 (w 0.1113 mse 0.1089 t 412 new 0.15) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 18:17:57] [val] step 1500 t=201: w=0.1781 mse=0.1806 (n=16) t=501: w=0.0741 mse=0.0741 (n=16) t=800: w=0.0626 mse=0.0615 (n=16) | mean w=0.1050 mse=0.1054 4s +[2026-09-13 18:18:01] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step1500.safetensors 832 个张量 2.87 GB +[2026-09-13 18:18:07] step 1501/5000 loss 0.1005 (w 0.0925 mse 0.0847 t 954 new 0.22) lr 1.00e-05 gnorm 0.082 5.76s mem 15.6GB +[2026-09-13 18:18:13] step 1502/5000 loss 0.0957 (w 0.0937 mse 0.0883 t 958 new 0.18) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 18:18:18] step 1503/5000 loss 0.1097 (w 0.0715 mse 0.0707 t 654 new 0.28) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 18:18:24] step 1504/5000 loss 0.0792 (w 0.0641 mse 0.0630 t 812 new 0.16) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +[2026-09-13 18:18:30] step 1505/5000 loss 0.0740 (w 0.1782 mse 0.1626 t 990 new 0.20) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 18:18:36] step 1506/5000 loss 0.0957 (w 0.0629 mse 0.0562 t 890 new 0.23) lr 1.00e-05 gnorm 0.066 5.96s mem 15.6GB +[2026-09-13 18:18:41] step 1507/5000 loss 0.0877 (w 0.2109 mse 0.2053 t 183 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 18:18:47] step 1508/5000 loss 0.0628 (w 0.0799 mse 0.0820 t 648 new 0.24) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 18:18:53] step 1509/5000 loss 0.0766 (w 0.1782 mse 0.1727 t 979 new 0.19) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 18:18:59] step 1510/5000 loss 0.0780 (w 0.0910 mse 0.0938 t 698 new 0.18) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 18:19:04] step 1511/5000 loss 0.0753 (w 0.0853 mse 0.0782 t 709 new 0.23) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 18:19:10] step 1512/5000 loss 0.0802 (w 0.1311 mse 0.1220 t 943 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 18:19:16] step 1513/5000 loss 0.0998 (w 0.1025 mse 0.0988 t 672 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 18:19:21] step 1514/5000 loss 0.0959 (w 0.3146 mse 0.3119 t 134 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:19:27] step 1515/5000 loss 0.0554 (w 0.0563 mse 0.0589 t 879 new 0.23) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:19:33] step 1516/5000 loss 0.1055 (w 0.0960 mse 0.0906 t 731 new 0.29) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 18:19:38] step 1517/5000 loss 0.0832 (w 0.0467 mse 0.0456 t 641 new 0.24) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 18:19:44] step 1518/5000 loss 0.0922 (w 0.0786 mse 0.0720 t 865 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:19:50] step 1519/5000 loss 0.1021 (w 0.0836 mse 0.0817 t 516 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 18:19:56] step 1520/5000 loss 0.1108 (w 0.1795 mse 0.1770 t 161 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 18:20:01] step 1521/5000 loss 0.0750 (w 0.1180 mse 0.1182 t 794 new 0.21) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 18:20:07] step 1522/5000 loss 0.0833 (w 0.1329 mse 0.1332 t 930 new 0.27) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 18:20:13] step 1523/5000 loss 0.1090 (w 0.0787 mse 0.0786 t 414 new 0.14) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 18:20:18] step 1524/5000 loss 0.0951 (w 0.0889 mse 0.0891 t 434 new 0.10) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 18:20:24] step 1525/5000 loss 0.0921 (w 0.0860 mse 0.0817 t 931 new 0.26) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 18:20:30] step 1526/5000 loss 0.1487 (w 0.0449 mse 0.0436 t 577 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:20:36] step 1527/5000 loss 0.0783 (w 0.0698 mse 0.0678 t 599 new 0.24) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:20:41] step 1528/5000 loss 0.0821 (w 0.0805 mse 0.0823 t 578 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 18:20:47] step 1529/5000 loss 0.0930 (w 0.0588 mse 0.0599 t 478 new 0.25) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 18:20:53] step 1530/5000 loss 0.0728 (w 0.0811 mse 0.0786 t 488 new 0.28) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 18:20:58] step 1531/5000 loss 0.0543 (w 0.0787 mse 0.0757 t 900 new 0.14) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 18:21:04] step 1532/5000 loss 0.0950 (w 0.1247 mse 0.1160 t 877 new 0.21) lr 1.00e-05 gnorm 0.062 5.96s mem 15.6GB +[2026-09-13 18:21:10] step 1533/5000 loss 0.0912 (w 0.1592 mse 0.1468 t 991 new 0.24) lr 1.00e-05 gnorm 0.070 5.90s mem 15.6GB +[2026-09-13 18:21:16] step 1534/5000 loss 0.1124 (w 0.0545 mse 0.0553 t 600 new 0.11) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 18:21:22] step 1535/5000 loss 0.0791 (w 0.0700 mse 0.0679 t 801 new 0.21) lr 1.00e-05 gnorm 0.084 5.85s mem 15.6GB +[2026-09-13 18:21:27] step 1536/5000 loss 0.0287 (w 0.0820 mse 0.0709 t 773 new 0.27) lr 1.00e-05 gnorm 0.046 5.68s mem 15.6GB +[2026-09-13 18:21:33] step 1537/5000 loss 0.1122 (w 0.1077 mse 0.1021 t 824 new 0.28) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 18:21:39] step 1538/5000 loss 0.0908 (w 0.0605 mse 0.0580 t 712 new 0.21) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 18:21:45] step 1539/5000 loss 0.1147 (w 0.0447 mse 0.0521 t 669 new 0.19) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:21:50] step 1540/5000 loss 0.1055 (w 0.1104 mse 0.1040 t 935 new 0.26) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 18:21:56] step 1541/5000 loss 0.0738 (w 0.1151 mse 0.1147 t 990 new 0.08) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 18:22:02] step 1542/5000 loss 0.1318 (w 0.0681 mse 0.0662 t 528 new 0.15) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 18:22:07] step 1543/5000 loss 0.0645 (w 0.2135 mse 0.2181 t 992 new 0.29) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 18:22:13] step 1544/5000 loss 0.1003 (w 0.0949 mse 0.0943 t 620 new 0.20) lr 1.00e-05 gnorm 0.055 5.71s mem 15.6GB +[2026-09-13 18:22:19] step 1545/5000 loss 0.1246 (w 0.1181 mse 0.1140 t 944 new 0.20) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 18:22:25] step 1546/5000 loss 0.0844 (w 0.1138 mse 0.1109 t 349 new 0.25) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 18:22:30] step 1547/5000 loss 0.0914 (w 0.1144 mse 0.1106 t 897 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:22:36] step 1548/5000 loss 0.0607 (w 0.0314 mse 0.0338 t 528 new 0.11) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 18:22:42] step 1549/5000 loss 0.1118 (w 0.0722 mse 0.0682 t 888 new 0.26) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +[2026-09-13 18:22:47] step 1550/5000 loss 0.0549 (w 0.0898 mse 0.0853 t 968 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 18:22:53] step 1551/5000 loss 0.1596 (w 0.1205 mse 0.1271 t 239 new 0.28) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:22:59] step 1552/5000 loss 0.0662 (w 0.0459 mse 0.0499 t 731 new 0.21) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 18:23:04] step 1553/5000 loss 0.1084 (w 0.0689 mse 0.0705 t 608 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 18:23:10] step 1554/5000 loss 0.0869 (w 0.0575 mse 0.0561 t 753 new 0.16) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 18:23:16] step 1555/5000 loss 0.1096 (w 0.0847 mse 0.0780 t 925 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:23:22] step 1556/5000 loss 0.0915 (w 0.0644 mse 0.0633 t 664 new 0.13) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 18:23:27] step 1557/5000 loss 0.0591 (w 0.1742 mse 0.1450 t 997 new 0.25) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +[2026-09-13 18:23:33] step 1558/5000 loss 0.0674 (w 0.1467 mse 0.1417 t 990 new 0.16) lr 1.00e-05 gnorm 0.056 5.76s mem 15.6GB +[2026-09-13 18:23:39] step 1559/5000 loss 0.0669 (w 0.1179 mse 0.1133 t 974 new 0.25) lr 1.00e-05 gnorm 0.057 5.93s mem 15.6GB +[2026-09-13 18:23:45] step 1560/5000 loss 0.0860 (w 0.0936 mse 0.0860 t 791 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 18:23:50] step 1561/5000 loss 0.0802 (w 0.0790 mse 0.0765 t 788 new 0.21) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 18:23:56] step 1562/5000 loss 0.0774 (w 0.0744 mse 0.0681 t 764 new 0.23) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 18:24:02] step 1563/5000 loss 0.0897 (w 0.1298 mse 0.1238 t 996 new 0.14) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 18:24:07] step 1564/5000 loss 0.0589 (w 0.0664 mse 0.0641 t 706 new 0.15) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 18:24:13] step 1565/5000 loss 0.0985 (w 0.1606 mse 0.1573 t 997 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 18:24:19] step 1566/5000 loss 0.0746 (w 0.0731 mse 0.0706 t 923 new 0.20) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:24:25] step 1567/5000 loss 0.0366 (w 0.0569 mse 0.0583 t 968 new 0.25) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 18:24:31] step 1568/5000 loss 0.1069 (w 0.0758 mse 0.0746 t 473 new 0.27) lr 1.00e-05 gnorm 0.061 6.14s mem 15.6GB +[2026-09-13 18:24:36] step 1569/5000 loss 0.0997 (w 0.0686 mse 0.0650 t 664 new 0.22) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 18:24:42] step 1570/5000 loss 0.0902 (w 0.0825 mse 0.0790 t 948 new 0.16) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 18:24:48] step 1571/5000 loss 0.1051 (w 0.0539 mse 0.0583 t 666 new 0.20) lr 1.00e-05 gnorm 0.069 5.74s mem 15.6GB +[2026-09-13 18:24:54] step 1572/5000 loss 0.0959 (w 0.0722 mse 0.0692 t 787 new 0.30) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 18:24:59] step 1573/5000 loss 0.0967 (w 0.0217 mse 0.0252 t 766 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 18:25:05] step 1574/5000 loss 0.1019 (w 0.0835 mse 0.0765 t 670 new 0.28) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +[2026-09-13 18:25:11] step 1575/5000 loss 0.0779 (w 0.0955 mse 0.0842 t 922 new 0.16) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:25:17] step 1576/5000 loss 0.0689 (w 0.0849 mse 0.0786 t 814 new 0.28) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 18:25:22] step 1577/5000 loss 0.1160 (w 0.0527 mse 0.0497 t 767 new 0.19) lr 1.00e-05 gnorm 0.082 5.67s mem 15.6GB +[2026-09-13 18:25:28] step 1578/5000 loss 0.0874 (w 0.1080 mse 0.0961 t 936 new 0.23) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 18:25:34] step 1579/5000 loss 0.0821 (w 0.0854 mse 0.0721 t 931 new 0.22) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 18:25:39] step 1580/5000 loss 0.0669 (w 0.0466 mse 0.0451 t 688 new 0.20) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 18:25:45] step 1581/5000 loss 0.1143 (w 0.0900 mse 0.0839 t 960 new 0.28) lr 1.00e-05 gnorm 0.075 5.89s mem 15.6GB +[2026-09-13 18:25:51] step 1582/5000 loss 0.0962 (w 0.1228 mse 0.1116 t 940 new 0.23) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 18:25:57] step 1583/5000 loss 0.1013 (w 0.1086 mse 0.1043 t 663 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:26:02] step 1584/5000 loss 0.0750 (w 0.1103 mse 0.1046 t 821 new 0.25) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 18:26:08] step 1585/5000 loss 0.1039 (w 0.7547 mse 0.7609 t 25 new 0.09) lr 1.00e-05 gnorm 0.056 5.72s mem 15.6GB +[2026-09-13 18:26:14] step 1586/5000 loss 0.1022 (w 0.0771 mse 0.0739 t 919 new 0.21) lr 1.00e-05 gnorm 0.131 5.70s mem 15.6GB +[2026-09-13 18:26:20] step 1587/5000 loss 0.1148 (w 0.1068 mse 0.1074 t 377 new 0.24) lr 1.00e-05 gnorm 0.060 5.67s mem 15.6GB +[2026-09-13 18:26:26] step 1588/5000 loss 0.0622 (w 0.0693 mse 0.0697 t 560 new 0.23) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 18:26:31] step 1589/5000 loss 0.0910 (w 0.0756 mse 0.0765 t 935 new 0.22) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 18:26:37] step 1590/5000 loss 0.0638 (w 0.0415 mse 0.0435 t 870 new 0.13) lr 1.00e-05 gnorm 0.058 5.89s mem 15.6GB +[2026-09-13 18:26:43] step 1591/5000 loss 0.1214 (w 0.0606 mse 0.0622 t 762 new 0.24) lr 1.00e-05 gnorm 0.054 5.95s mem 15.6GB +[2026-09-13 18:26:49] step 1592/5000 loss 0.0533 (w 0.1638 mse 0.1583 t 965 new 0.16) lr 1.00e-05 gnorm 0.070 5.93s mem 15.6GB +[2026-09-13 18:26:55] step 1593/5000 loss 0.1147 (w 0.0833 mse 0.0814 t 417 new 0.18) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 18:27:00] step 1594/5000 loss 0.0550 (w 0.1254 mse 0.1298 t 983 new 0.24) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 18:27:06] step 1595/5000 loss 0.0952 (w 0.0863 mse 0.0788 t 800 new 0.27) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 18:27:12] step 1596/5000 loss 0.0773 (w 0.0984 mse 0.0907 t 963 new 0.10) lr 1.00e-05 gnorm 0.057 5.67s mem 15.6GB +[2026-09-13 18:27:18] step 1597/5000 loss 0.0764 (w 0.0537 mse 0.0573 t 973 new 0.21) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 18:27:23] step 1598/5000 loss 0.0858 (w 0.0628 mse 0.0626 t 707 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 18:27:29] step 1599/5000 loss 0.0696 (w 0.0793 mse 0.0719 t 697 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 18:27:35] step 1600/5000 loss 0.0900 (w 0.0656 mse 0.0630 t 863 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 18:27:41] step 1601/5000 loss 0.0929 (w 0.0719 mse 0.0686 t 865 new 0.09) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 18:27:46] step 1602/5000 loss 0.1037 (w 0.1599 mse 0.1861 t 114 new 0.22) lr 1.00e-05 gnorm 0.063 5.78s mem 15.6GB +[2026-09-13 18:27:52] step 1603/5000 loss 0.0799 (w 0.0546 mse 0.0508 t 728 new 0.24) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 18:27:58] step 1604/5000 loss 0.0463 (w 0.1958 mse 0.1937 t 979 new 0.24) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:28:03] step 1605/5000 loss 0.0480 (w 0.0638 mse 0.0670 t 931 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:28:09] step 1606/5000 loss 0.0427 (w 0.0649 mse 0.0639 t 706 new 0.24) lr 1.00e-05 gnorm 0.077 5.73s mem 15.6GB +[2026-09-13 18:28:15] step 1607/5000 loss 0.1345 (w 0.0987 mse 0.0946 t 515 new 0.26) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 18:28:21] step 1608/5000 loss 0.0758 (w 0.0837 mse 0.0903 t 955 new 0.20) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 18:28:26] step 1609/5000 loss 0.1082 (w 0.0842 mse 0.0816 t 679 new 0.20) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 18:28:32] step 1610/5000 loss 0.0873 (w 0.6433 mse 0.6555 t 996 new 0.23) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 18:28:38] step 1611/5000 loss 0.0694 (w 0.0485 mse 0.0486 t 748 new 0.23) lr 1.00e-05 gnorm 0.061 5.91s mem 15.6GB +[2026-09-13 18:28:44] step 1612/5000 loss 0.0639 (w 0.0954 mse 0.0912 t 674 new 0.28) lr 1.00e-05 gnorm 0.097 5.68s mem 15.6GB +[2026-09-13 18:28:50] step 1613/5000 loss 0.0899 (w 0.1021 mse 0.1015 t 664 new 0.29) lr 1.00e-05 gnorm 0.086 5.76s mem 15.6GB +[2026-09-13 18:28:55] step 1614/5000 loss 0.0837 (w 0.0554 mse 0.0560 t 660 new 0.27) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 18:29:01] step 1615/5000 loss 0.0907 (w 0.1356 mse 0.1373 t 957 new 0.18) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 18:29:07] step 1616/5000 loss 0.0731 (w 0.0969 mse 0.0925 t 961 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 18:29:12] step 1617/5000 loss 0.0652 (w 0.1142 mse 0.1087 t 347 new 0.25) lr 1.00e-05 gnorm 0.082 5.72s mem 15.6GB +[2026-09-13 18:29:18] step 1618/5000 loss 0.1150 (w 0.1037 mse 0.1050 t 866 new 0.16) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 18:29:24] step 1619/5000 loss 0.0592 (w 0.1962 mse 0.1932 t 981 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 18:29:30] step 1620/5000 loss 0.1048 (w 0.0617 mse 0.0606 t 759 new 0.24) lr 1.00e-05 gnorm 0.089 5.77s mem 15.6GB +[2026-09-13 18:29:35] step 1621/5000 loss 0.0925 (w 0.0727 mse 0.0681 t 906 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 18:29:41] step 1622/5000 loss 0.0836 (w 0.0856 mse 0.0829 t 551 new 0.26) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 18:29:47] step 1623/5000 loss 0.0607 (w 0.0629 mse 0.0635 t 815 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 18:29:53] step 1624/5000 loss 0.1398 (w 0.0668 mse 0.0656 t 399 new 0.22) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 18:29:58] step 1625/5000 loss 0.0775 (w 0.0694 mse 0.0611 t 765 new 0.25) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 18:30:04] step 1626/5000 loss 0.0617 (w 0.1154 mse 0.1133 t 516 new 0.28) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 18:30:10] step 1627/5000 loss 0.1194 (w 0.0981 mse 0.0987 t 403 new 0.25) lr 1.00e-05 gnorm 0.062 5.89s mem 15.6GB +[2026-09-13 18:30:16] step 1628/5000 loss 0.0841 (w 0.0441 mse 0.0458 t 556 new 0.23) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 18:30:21] step 1629/5000 loss 0.0803 (w 0.1327 mse 0.1280 t 938 new 0.19) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 18:30:27] step 1630/5000 loss 0.1025 (w 0.0906 mse 0.0848 t 600 new 0.30) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 18:30:33] step 1631/5000 loss 0.0825 (w 0.0752 mse 0.0750 t 904 new 0.23) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 18:30:39] step 1632/5000 loss 0.1181 (w 0.1111 mse 0.1095 t 829 new 0.19) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 18:30:44] step 1633/5000 loss 0.0835 (w 0.1013 mse 0.0909 t 954 new 0.26) lr 1.00e-05 gnorm 0.064 5.76s mem 15.6GB +[2026-09-13 18:30:50] step 1634/5000 loss 0.0743 (w 0.0710 mse 0.0722 t 878 new 0.27) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 18:30:56] step 1635/5000 loss 0.0254 (w 0.1617 mse 0.1605 t 973 new 0.18) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 18:31:01] step 1636/5000 loss 0.0989 (w 0.1797 mse 0.1758 t 996 new 0.14) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 18:31:07] step 1637/5000 loss 0.0542 (w 0.1166 mse 0.1121 t 960 new 0.22) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 18:31:13] step 1638/5000 loss 0.1354 (w 0.1250 mse 0.1186 t 434 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 18:31:19] step 1639/5000 loss 0.1185 (w 0.0346 mse 0.0387 t 440 new 0.21) lr 1.00e-05 gnorm 0.059 5.85s mem 15.6GB +[2026-09-13 18:31:24] step 1640/5000 loss 0.0552 (w 0.1545 mse 0.1425 t 982 new 0.28) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 18:31:30] step 1641/5000 loss 0.0819 (w 0.1666 mse 0.1718 t 989 new 0.23) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 18:31:36] step 1642/5000 loss 0.0943 (w 0.0704 mse 0.0711 t 784 new 0.26) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 18:31:42] step 1643/5000 loss 0.1212 (w 0.3464 mse 0.3484 t 126 new 0.21) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 18:31:47] step 1644/5000 loss 0.0880 (w 0.1889 mse 0.1821 t 146 new 0.20) lr 1.00e-05 gnorm 0.066 5.67s mem 15.6GB +[2026-09-13 18:31:53] step 1645/5000 loss 0.0890 (w 0.0505 mse 0.0526 t 701 new 0.18) lr 1.00e-05 gnorm 0.071 5.72s mem 15.6GB +[2026-09-13 18:31:59] step 1646/5000 loss 0.0997 (w 0.0643 mse 0.0595 t 782 new 0.26) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 18:32:05] step 1647/5000 loss 0.0882 (w 0.1298 mse 0.1200 t 934 new 0.28) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:32:10] step 1648/5000 loss 0.1251 (w 0.1191 mse 0.1164 t 864 new 0.23) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 18:32:16] step 1649/5000 loss 0.0801 (w 0.0816 mse 0.0745 t 717 new 0.25) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 18:32:22] step 1650/5000 loss 0.1059 (w 0.1101 mse 0.1054 t 552 new 0.21) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 18:32:27] step 1651/5000 loss 0.0665 (w 0.1094 mse 0.1038 t 902 new 0.29) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 18:32:33] step 1652/5000 loss 0.0950 (w 0.0997 mse 0.0958 t 800 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:32:39] step 1653/5000 loss 0.1025 (w 0.0564 mse 0.0601 t 836 new 0.17) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 18:32:45] step 1654/5000 loss 0.1293 (w 0.0779 mse 0.0713 t 900 new 0.27) lr 1.00e-05 gnorm 0.074 5.76s mem 15.6GB +[2026-09-13 18:32:51] step 1655/5000 loss 0.0939 (w 0.1738 mse 0.1692 t 985 new 0.25) lr 1.00e-05 gnorm 0.062 5.71s mem 15.6GB +[2026-09-13 18:32:56] step 1656/5000 loss 0.0726 (w 0.4718 mse 0.4653 t 80 new 0.25) lr 1.00e-05 gnorm 0.066 5.71s mem 15.6GB +[2026-09-13 18:33:02] step 1657/5000 loss 0.0843 (w 0.0698 mse 0.0671 t 528 new 0.23) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +[2026-09-13 18:33:08] step 1658/5000 loss 0.1195 (w 0.1431 mse 0.1387 t 971 new 0.26) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 18:33:13] step 1659/5000 loss 0.0975 (w 0.0670 mse 0.0631 t 845 new 0.24) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 18:33:19] step 1660/5000 loss 0.0674 (w 0.1804 mse 0.1723 t 982 new 0.23) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 18:33:25] step 1661/5000 loss 0.1031 (w 0.0337 mse 0.0407 t 328 new 0.23) lr 1.00e-05 gnorm 0.110 5.95s mem 15.6GB +[2026-09-13 18:33:31] step 1662/5000 loss 0.0441 (w 0.0666 mse 0.0603 t 825 new 0.21) lr 1.00e-05 gnorm 0.063 5.90s mem 15.6GB +[2026-09-13 18:33:37] step 1663/5000 loss 0.0695 (w 0.2209 mse 0.2193 t 176 new 0.20) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 18:33:42] step 1664/5000 loss 0.0749 (w 0.1478 mse 0.1320 t 993 new 0.25) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 18:33:48] step 1665/5000 loss 0.1275 (w 0.2038 mse 0.1914 t 978 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 18:33:54] step 1666/5000 loss 0.1022 (w 0.0417 mse 0.0438 t 960 new 0.11) lr 1.00e-05 gnorm 0.085 5.86s mem 15.6GB +[2026-09-13 18:34:00] step 1667/5000 loss 0.1525 (w 0.1682 mse 0.1761 t 194 new 0.22) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 18:34:05] step 1668/5000 loss 0.0825 (w 0.1358 mse 0.1339 t 918 new 0.17) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:34:11] step 1669/5000 loss 0.1029 (w 0.1476 mse 0.1487 t 1000 new 0.21) lr 1.00e-05 gnorm 0.075 5.91s mem 15.6GB +[2026-09-13 18:34:17] step 1670/5000 loss 0.1030 (w 0.0360 mse 0.0412 t 593 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 18:34:23] step 1671/5000 loss 0.1376 (w 0.1498 mse 0.1383 t 996 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 18:34:28] step 1672/5000 loss 0.0435 (w 0.1094 mse 0.1056 t 887 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 18:34:34] step 1673/5000 loss 0.0950 (w 0.0965 mse 0.0888 t 845 new 0.21) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 18:34:40] step 1674/5000 loss 0.0982 (w 0.1004 mse 0.0956 t 971 new 0.28) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 18:34:46] step 1675/5000 loss 0.0926 (w 0.0760 mse 0.0818 t 403 new 0.22) lr 1.00e-05 gnorm 0.179 5.74s mem 15.6GB +[2026-09-13 18:34:52] step 1676/5000 loss 0.0810 (w 0.0648 mse 0.0607 t 910 new 0.24) lr 1.00e-05 gnorm 0.084 5.87s mem 15.6GB +[2026-09-13 18:34:57] step 1677/5000 loss 0.0504 (w 0.0597 mse 0.0593 t 952 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:35:03] step 1678/5000 loss 0.0874 (w 0.1364 mse 0.1290 t 988 new 0.16) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 18:35:09] step 1679/5000 loss 0.0460 (w 0.0547 mse 0.0531 t 631 new 0.20) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 18:35:15] step 1680/5000 loss 0.0809 (w 0.0482 mse 0.0501 t 725 new 0.16) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 18:35:20] step 1681/5000 loss 0.1034 (w 0.0687 mse 0.0702 t 931 new 0.29) lr 1.00e-05 gnorm 0.103 5.69s mem 15.6GB +[2026-09-13 18:35:26] step 1682/5000 loss 0.0617 (w 0.0535 mse 0.0556 t 869 new 0.25) lr 1.00e-05 gnorm 0.074 5.95s mem 15.6GB +[2026-09-13 18:35:32] step 1683/5000 loss 0.0907 (w 0.0649 mse 0.0634 t 869 new 0.13) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 18:35:38] step 1684/5000 loss 0.1181 (w 0.0826 mse 0.0748 t 886 new 0.28) lr 1.00e-05 gnorm 0.098 5.69s mem 15.6GB +[2026-09-13 18:35:43] step 1685/5000 loss 0.0752 (w 0.0881 mse 0.0956 t 961 new 0.18) lr 1.00e-05 gnorm 0.065 5.74s mem 15.6GB +[2026-09-13 18:35:49] step 1686/5000 loss 0.0818 (w 0.1533 mse 0.1526 t 979 new 0.27) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:35:55] step 1687/5000 loss 0.1071 (w 0.0772 mse 0.0693 t 842 new 0.24) lr 1.00e-05 gnorm 0.075 5.75s mem 15.6GB +[2026-09-13 18:36:01] step 1688/5000 loss 0.0870 (w 0.1006 mse 0.0980 t 943 new 0.25) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 18:36:06] step 1689/5000 loss 0.1673 (w 0.0632 mse 0.0625 t 685 new 0.19) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 18:36:12] step 1690/5000 loss 0.1351 (w 0.1267 mse 0.1275 t 367 new 0.14) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 18:36:18] step 1691/5000 loss 0.1125 (w 0.0970 mse 0.0954 t 797 new 0.24) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 18:36:23] step 1692/5000 loss 0.0952 (w 0.0664 mse 0.0686 t 861 new 0.27) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 18:36:29] step 1693/5000 loss 0.1111 (w 0.1368 mse 0.1292 t 974 new 0.21) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +[2026-09-13 18:36:35] step 1694/5000 loss 0.1077 (w 0.1095 mse 0.1077 t 387 new 0.21) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 18:36:40] step 1695/5000 loss 0.1282 (w 0.0821 mse 0.0790 t 968 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:36:46] step 1696/5000 loss 0.0876 (w 0.0823 mse 0.0750 t 688 new 0.25) lr 1.00e-05 gnorm 0.066 5.74s mem 15.6GB +[2026-09-13 18:36:52] step 1697/5000 loss 0.1236 (w 0.1514 mse 0.1485 t 252 new 0.24) lr 1.00e-05 gnorm 0.060 5.78s mem 15.6GB +[2026-09-13 18:36:58] step 1698/5000 loss 0.0995 (w 0.0534 mse 0.0495 t 861 new 0.21) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 18:37:03] step 1699/5000 loss 0.0891 (w 0.0997 mse 0.0945 t 931 new 0.27) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:37:09] step 1700/5000 loss 0.0852 (w 0.1620 mse 0.1536 t 968 new 0.22) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 18:37:15] step 1701/5000 loss 0.0808 (w 0.1491 mse 0.1369 t 964 new 0.24) lr 1.00e-05 gnorm 0.070 5.90s mem 15.6GB +[2026-09-13 18:37:21] step 1702/5000 loss 0.0893 (w 0.1119 mse 0.1134 t 297 new 0.25) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 18:37:26] step 1703/5000 loss 0.0966 (w 0.1256 mse 0.1160 t 627 new 0.28) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:37:32] step 1704/5000 loss 0.0807 (w 0.0923 mse 0.0813 t 821 new 0.26) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 18:37:38] step 1705/5000 loss 0.0494 (w 0.1033 mse 0.1004 t 980 new 0.25) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 18:37:44] step 1706/5000 loss 0.1054 (w 0.0889 mse 0.0877 t 546 new 0.13) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 18:37:49] step 1707/5000 loss 0.1123 (w 0.1611 mse 0.1514 t 966 new 0.25) lr 1.00e-05 gnorm 0.072 5.95s mem 15.6GB +[2026-09-13 18:37:55] step 1708/5000 loss 0.1173 (w 0.1139 mse 0.1102 t 367 new 0.26) lr 1.00e-05 gnorm 0.065 6.00s mem 15.6GB +[2026-09-13 18:38:01] step 1709/5000 loss 0.0888 (w 0.1162 mse 0.1145 t 924 new 0.15) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 18:38:07] step 1710/5000 loss 0.1226 (w 0.0894 mse 0.0832 t 890 new 0.17) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 18:38:13] step 1711/5000 loss 0.0858 (w 0.0916 mse 0.0907 t 443 new 0.23) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 18:38:18] step 1712/5000 loss 0.0482 (w 0.0210 mse 0.0227 t 913 new 0.13) lr 1.00e-05 gnorm 0.059 5.90s mem 15.6GB +[2026-09-13 18:38:24] step 1713/5000 loss 0.1018 (w 0.0794 mse 0.0795 t 478 new 0.26) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 18:38:30] step 1714/5000 loss 0.0742 (w 0.0705 mse 0.0704 t 776 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 18:38:36] step 1715/5000 loss 0.0791 (w 0.0615 mse 0.0630 t 831 new 0.21) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 18:38:41] step 1716/5000 loss 0.0728 (w 0.2187 mse 0.1987 t 996 new 0.25) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 18:38:47] step 1717/5000 loss 0.1213 (w 0.0516 mse 0.0511 t 885 new 0.17) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 18:38:53] step 1718/5000 loss 0.0880 (w 0.1324 mse 0.1242 t 971 new 0.28) lr 1.00e-05 gnorm 0.077 5.79s mem 15.6GB +[2026-09-13 18:38:59] step 1719/5000 loss 0.0843 (w 0.1322 mse 0.1223 t 968 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 18:39:04] step 1720/5000 loss 0.1222 (w 0.1002 mse 0.0897 t 947 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:39:10] step 1721/5000 loss 0.0783 (w 0.2571 mse 0.2335 t 998 new 0.27) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:39:16] step 1722/5000 loss 0.1006 (w 0.0958 mse 0.0933 t 834 new 0.20) lr 1.00e-05 gnorm 0.067 5.89s mem 15.6GB +[2026-09-13 18:39:22] step 1723/5000 loss 0.0536 (w 0.0622 mse 0.0646 t 794 new 0.13) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:39:27] step 1724/5000 loss 0.0924 (w 0.0612 mse 0.0594 t 598 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 18:39:33] step 1725/5000 loss 0.0752 (w 0.0708 mse 0.0694 t 784 new 0.30) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 18:39:39] step 1726/5000 loss 0.1393 (w 0.1583 mse 0.1532 t 367 new 0.20) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +[2026-09-13 18:39:44] step 1727/5000 loss 0.0774 (w 0.0455 mse 0.0429 t 810 new 0.12) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 18:39:50] step 1728/5000 loss 0.0831 (w 0.0655 mse 0.0606 t 781 new 0.26) lr 1.00e-05 gnorm 0.052 5.72s mem 15.6GB +[2026-09-13 18:39:56] step 1729/5000 loss 0.0965 (w 0.1661 mse 0.1385 t 997 new 0.18) lr 1.00e-05 gnorm 0.101 5.69s mem 15.6GB +[2026-09-13 18:40:01] step 1730/5000 loss 0.0765 (w 0.0679 mse 0.0668 t 744 new 0.27) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 18:40:07] step 1731/5000 loss 0.0605 (w 0.0680 mse 0.0681 t 791 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:40:13] step 1732/5000 loss 0.0906 (w 0.1220 mse 0.1170 t 785 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:40:19] step 1733/5000 loss 0.0821 (w 0.0445 mse 0.0450 t 569 new 0.20) lr 1.00e-05 gnorm 0.101 5.69s mem 15.6GB +[2026-09-13 18:40:24] step 1734/5000 loss 0.1391 (w 0.0674 mse 0.0690 t 562 new 0.21) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 18:40:30] step 1735/5000 loss 0.0825 (w 0.0941 mse 0.0972 t 493 new 0.23) lr 1.00e-05 gnorm 0.088 5.92s mem 15.6GB +[2026-09-13 18:40:36] step 1736/5000 loss 0.1614 (w 0.1809 mse 0.1856 t 225 new 0.27) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 18:40:42] step 1737/5000 loss 0.0913 (w 0.1018 mse 0.1025 t 995 new 0.20) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 18:40:47] step 1738/5000 loss 0.1296 (w 0.0959 mse 0.0957 t 428 new 0.29) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 18:40:53] step 1739/5000 loss 0.1192 (w 0.0718 mse 0.0748 t 666 new 0.16) lr 1.00e-05 gnorm 0.088 5.79s mem 15.6GB +[2026-09-13 18:40:59] step 1740/5000 loss 0.0618 (w 0.0696 mse 0.0664 t 939 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 18:41:05] step 1741/5000 loss 0.1032 (w 0.1273 mse 0.1187 t 969 new 0.27) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 18:41:10] step 1742/5000 loss 0.0540 (w 0.1097 mse 0.1035 t 980 new 0.15) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 18:41:16] step 1743/5000 loss 0.1499 (w 0.2892 mse 0.2860 t 105 new 0.16) lr 1.00e-05 gnorm 0.078 5.91s mem 15.6GB +[2026-09-13 18:41:22] step 1744/5000 loss 0.0900 (w 0.1047 mse 0.1004 t 727 new 0.23) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 18:41:28] step 1745/5000 loss 0.0494 (w 0.0425 mse 0.0427 t 562 new 0.14) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:41:33] step 1746/5000 loss 0.0600 (w 0.0873 mse 0.0793 t 896 new 0.18) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 18:41:39] step 1747/5000 loss 0.1386 (w 0.1251 mse 0.1223 t 317 new 0.14) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 18:41:45] step 1748/5000 loss 0.0822 (w 0.1381 mse 0.1320 t 967 new 0.25) lr 1.00e-05 gnorm 0.066 5.79s mem 15.6GB +[2026-09-13 18:41:51] step 1749/5000 loss 0.1199 (w 0.1159 mse 0.1114 t 907 new 0.25) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 18:41:56] step 1750/5000 loss 0.0791 (w 0.0681 mse 0.0685 t 933 new 0.22) lr 1.00e-05 gnorm 0.068 5.71s mem 15.6GB +[2026-09-13 18:42:02] step 1751/5000 loss 0.0997 (w 0.0943 mse 0.0929 t 559 new 0.23) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:42:08] step 1752/5000 loss 0.0857 (w 0.0881 mse 0.0863 t 706 new 0.24) lr 1.00e-05 gnorm 0.089 6.47s mem 15.6GB +[2026-09-13 18:42:14] step 1753/5000 loss 0.0401 (w 0.1202 mse 0.1114 t 964 new 0.20) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 18:42:20] step 1754/5000 loss 0.0412 (w 0.1734 mse 0.1657 t 989 new 0.22) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 18:42:26] step 1755/5000 loss 0.1388 (w 0.0686 mse 0.0640 t 892 new 0.11) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 18:42:31] step 1756/5000 loss 0.1166 (w 0.0879 mse 0.0816 t 698 new 0.27) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 18:42:37] step 1757/5000 loss 0.0545 (w 0.0769 mse 0.0763 t 904 new 0.25) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 18:42:43] step 1758/5000 loss 0.0631 (w 0.0447 mse 0.0443 t 871 new 0.09) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 18:42:49] step 1759/5000 loss 0.0635 (w 0.1650 mse 0.1622 t 229 new 0.22) lr 1.00e-05 gnorm 0.057 5.93s mem 15.6GB +[2026-09-13 18:42:54] step 1760/5000 loss 0.1090 (w 0.0895 mse 0.0897 t 756 new 0.14) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 18:43:00] step 1761/5000 loss 0.0797 (w 0.0993 mse 0.0926 t 887 new 0.17) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +[2026-09-13 18:43:06] step 1762/5000 loss 0.0647 (w 0.0785 mse 0.0725 t 815 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 18:43:11] step 1763/5000 loss 0.0846 (w 0.1149 mse 0.1183 t 828 new 0.21) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 18:43:17] step 1764/5000 loss 0.0719 (w 0.1271 mse 0.1151 t 951 new 0.26) lr 1.00e-05 gnorm 0.073 5.96s mem 15.6GB +[2026-09-13 18:43:23] step 1765/5000 loss 0.0869 (w 0.0499 mse 0.0495 t 900 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 18:43:29] step 1766/5000 loss 0.0912 (w 0.1404 mse 0.1383 t 432 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:43:35] step 1767/5000 loss 0.1339 (w 0.1247 mse 0.1111 t 923 new 0.16) lr 1.00e-05 gnorm 0.061 5.82s mem 15.6GB +[2026-09-13 18:43:40] step 1768/5000 loss 0.1138 (w 0.1847 mse 0.1679 t 993 new 0.27) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:43:46] step 1769/5000 loss 0.1004 (w 0.1213 mse 0.1193 t 344 new 0.26) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 18:43:52] step 1770/5000 loss 0.1179 (w 0.0831 mse 0.0778 t 856 new 0.25) lr 1.00e-05 gnorm 0.061 5.96s mem 15.6GB +[2026-09-13 18:43:58] step 1771/5000 loss 0.0465 (w 0.2215 mse 0.2112 t 997 new 0.13) lr 1.00e-05 gnorm 0.059 5.71s mem 15.6GB +[2026-09-13 18:44:03] step 1772/5000 loss 0.0967 (w 0.3867 mse 0.4022 t 999 new 0.22) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 18:44:09] step 1773/5000 loss 0.1488 (w 0.0432 mse 0.0440 t 637 new 0.13) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 18:44:15] step 1774/5000 loss 0.0724 (w 0.0745 mse 0.0749 t 797 new 0.24) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 18:44:21] step 1775/5000 loss 0.0765 (w 0.0649 mse 0.0645 t 497 new 0.25) lr 1.00e-05 gnorm 0.070 5.89s mem 15.6GB +[2026-09-13 18:44:26] step 1776/5000 loss 0.0849 (w 0.2347 mse 0.2289 t 194 new 0.23) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 18:44:32] step 1777/5000 loss 0.0809 (w 0.0991 mse 0.0947 t 958 new 0.20) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 18:44:38] step 1778/5000 loss 0.0934 (w 0.0865 mse 0.0799 t 905 new 0.25) lr 1.00e-05 gnorm 0.060 5.81s mem 15.6GB +[2026-09-13 18:44:44] step 1779/5000 loss 0.0725 (w 0.0799 mse 0.0724 t 782 new 0.26) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 18:44:49] step 1780/5000 loss 0.0722 (w 0.0766 mse 0.0695 t 585 new 0.29) lr 1.00e-05 gnorm 0.058 5.75s mem 15.6GB +[2026-09-13 18:44:55] step 1781/5000 loss 0.0701 (w 0.0784 mse 0.0714 t 805 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 18:45:01] step 1782/5000 loss 0.1238 (w 0.1118 mse 0.1153 t 807 new 0.23) lr 1.00e-05 gnorm 0.059 5.95s mem 15.6GB +[2026-09-13 18:45:07] step 1783/5000 loss 0.0880 (w 0.1760 mse 0.1727 t 336 new 0.29) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 18:45:13] step 1784/5000 loss 0.1031 (w 0.0691 mse 0.0638 t 790 new 0.27) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 18:45:18] step 1785/5000 loss 0.0790 (w 0.0671 mse 0.0661 t 467 new 0.17) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 18:45:24] step 1786/5000 loss 0.1322 (w 0.1021 mse 0.0958 t 741 new 0.25) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 18:45:30] step 1787/5000 loss 0.1124 (w 0.0621 mse 0.0614 t 941 new 0.07) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 18:45:36] step 1788/5000 loss 0.0705 (w 0.0872 mse 0.0800 t 926 new 0.25) lr 1.00e-05 gnorm 0.067 5.88s mem 15.6GB +[2026-09-13 18:45:41] step 1789/5000 loss 0.0503 (w 0.0572 mse 0.0562 t 855 new 0.12) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 18:45:47] step 1790/5000 loss 0.0782 (w 0.0626 mse 0.0593 t 855 new 0.23) lr 1.00e-05 gnorm 0.070 5.90s mem 15.6GB +[2026-09-13 18:45:53] step 1791/5000 loss 0.0651 (w 0.0352 mse 0.0341 t 602 new 0.21) lr 1.00e-05 gnorm 0.065 5.74s mem 15.6GB +[2026-09-13 18:45:59] step 1792/5000 loss 0.0882 (w 0.1407 mse 0.1316 t 976 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 18:46:04] step 1793/5000 loss 0.0984 (w 0.1194 mse 0.1160 t 640 new 0.19) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 18:46:10] step 1794/5000 loss 0.1036 (w 0.0932 mse 0.0907 t 825 new 0.30) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 18:46:16] step 1795/5000 loss 0.0790 (w 0.0611 mse 0.0673 t 484 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 18:46:22] step 1796/5000 loss 0.1075 (w 0.0398 mse 0.0446 t 719 new 0.23) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 18:46:27] step 1797/5000 loss 0.1244 (w 0.1029 mse 0.0986 t 875 new 0.17) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +[2026-09-13 18:46:33] step 1798/5000 loss 0.0824 (w 0.1073 mse 0.1009 t 878 new 0.24) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 18:46:39] step 1799/5000 loss 0.0727 (w 0.1275 mse 0.1189 t 949 new 0.21) lr 1.00e-05 gnorm 0.080 5.91s mem 15.6GB +[2026-09-13 18:46:45] step 1800/5000 loss 0.0919 (w 0.0718 mse 0.0678 t 851 new 0.26) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 18:46:50] step 1801/5000 loss 0.0723 (w 0.0556 mse 0.0515 t 814 new 0.31) lr 1.00e-05 gnorm 0.065 5.72s mem 15.6GB +[2026-09-13 18:46:56] step 1802/5000 loss 0.0549 (w 0.0750 mse 0.0764 t 915 new 0.23) lr 1.00e-05 gnorm 0.118 5.70s mem 15.6GB +[2026-09-13 18:47:02] step 1803/5000 loss 0.0999 (w 0.0822 mse 0.0787 t 749 new 0.26) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +[2026-09-13 18:47:07] step 1804/5000 loss 0.1245 (w 0.0891 mse 0.0843 t 541 new 0.20) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 18:47:13] step 1805/5000 loss 0.1497 (w 0.0658 mse 0.0692 t 493 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:47:19] step 1806/5000 loss 0.0889 (w 0.0417 mse 0.0403 t 541 new 0.25) lr 1.00e-05 gnorm 0.089 5.89s mem 15.6GB +[2026-09-13 18:47:25] step 1807/5000 loss 0.0810 (w 0.0830 mse 0.0755 t 921 new 0.22) lr 1.00e-05 gnorm 0.057 5.91s mem 15.6GB +[2026-09-13 18:47:31] step 1808/5000 loss 0.0661 (w 0.1050 mse 0.1030 t 867 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 18:47:36] step 1809/5000 loss 0.0465 (w 0.0720 mse 0.0650 t 910 new 0.15) lr 1.00e-05 gnorm 0.057 5.73s mem 15.6GB +[2026-09-13 18:47:42] step 1810/5000 loss 0.1125 (w 0.0684 mse 0.0712 t 563 new 0.18) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:47:48] step 1811/5000 loss 0.0807 (w 0.0822 mse 0.0845 t 832 new 0.27) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:47:54] step 1812/5000 loss 0.0405 (w 0.0606 mse 0.0605 t 883 new 0.17) lr 1.00e-05 gnorm 0.071 5.91s mem 15.6GB +[2026-09-13 18:48:00] step 1813/5000 loss 0.0735 (w 0.1179 mse 0.1117 t 955 new 0.15) lr 1.00e-05 gnorm 0.075 5.84s mem 15.6GB +[2026-09-13 18:48:05] step 1814/5000 loss 0.1049 (w 0.5544 mse 0.5560 t 66 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:48:11] step 1815/5000 loss 0.0489 (w 0.0676 mse 0.0629 t 926 new 0.11) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 18:48:17] step 1816/5000 loss 0.0715 (w 0.0969 mse 0.0937 t 916 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 18:48:22] step 1817/5000 loss 0.0560 (w 0.0582 mse 0.0563 t 766 new 0.25) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 18:48:28] step 1818/5000 loss 0.0878 (w 0.1079 mse 0.1058 t 548 new 0.22) lr 1.00e-05 gnorm 0.135 5.69s mem 15.6GB +[2026-09-13 18:48:34] step 1819/5000 loss 0.0664 (w 0.0836 mse 0.0745 t 801 new 0.24) lr 1.00e-05 gnorm 0.083 5.81s mem 15.6GB +[2026-09-13 18:48:40] step 1820/5000 loss 0.0677 (w 0.0654 mse 0.0652 t 798 new 0.30) lr 1.00e-05 gnorm 0.067 6.01s mem 15.6GB +[2026-09-13 18:48:46] step 1821/5000 loss 0.2001 (w 0.1526 mse 0.1532 t 320 new 0.21) lr 1.00e-05 gnorm 0.113 5.69s mem 15.6GB +[2026-09-13 18:48:51] step 1822/5000 loss 0.0706 (w 0.0549 mse 0.0524 t 762 new 0.19) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +[2026-09-13 18:48:57] step 1823/5000 loss 0.1373 (w 0.1067 mse 0.1069 t 484 new 0.17) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 18:49:03] step 1824/5000 loss 0.0781 (w 0.0838 mse 0.0781 t 923 new 0.14) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 18:49:09] step 1825/5000 loss 0.0699 (w 0.0543 mse 0.0544 t 867 new 0.25) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +[2026-09-13 18:49:15] step 1826/5000 loss 0.0785 (w 0.0874 mse 0.0794 t 929 new 0.15) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 18:49:20] step 1827/5000 loss 0.0985 (w 0.0810 mse 0.0820 t 878 new 0.21) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 18:49:26] step 1828/5000 loss 0.1063 (w 0.1263 mse 0.1216 t 357 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 18:49:32] step 1829/5000 loss 0.0850 (w 0.1069 mse 0.1005 t 933 new 0.21) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +[2026-09-13 18:49:37] step 1830/5000 loss 0.1235 (w 0.1239 mse 0.1230 t 288 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 18:49:43] step 1831/5000 loss 0.1005 (w 0.0504 mse 0.0481 t 777 new 0.20) lr 1.00e-05 gnorm 0.064 5.87s mem 15.6GB +[2026-09-13 18:49:49] step 1832/5000 loss 0.0471 (w 0.1481 mse 0.1352 t 996 new 0.13) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 18:49:55] step 1833/5000 loss 0.0905 (w 0.1198 mse 0.1169 t 980 new 0.16) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 18:50:00] step 1834/5000 loss 0.0774 (w 0.0953 mse 0.0923 t 994 new 0.28) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 18:50:06] step 1835/5000 loss 0.0624 (w 0.0589 mse 0.0591 t 772 new 0.26) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 18:50:12] step 1836/5000 loss 0.1068 (w 0.0461 mse 0.0441 t 987 new 0.14) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 18:50:17] step 1837/5000 loss 0.0897 (w 0.0950 mse 0.0961 t 724 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 18:50:23] step 1838/5000 loss 0.0964 (w 0.0308 mse 0.0322 t 786 new 0.09) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 18:50:29] step 1839/5000 loss 0.0910 (w 0.1152 mse 0.1083 t 960 new 0.25) lr 1.00e-05 gnorm 0.080 5.84s mem 15.6GB +[2026-09-13 18:50:35] step 1840/5000 loss 0.0706 (w 0.1994 mse 0.1798 t 985 new 0.14) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 18:50:40] step 1841/5000 loss 0.0754 (w 0.1394 mse 0.1334 t 987 new 0.12) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 18:50:46] step 1842/5000 loss 0.0996 (w 0.1152 mse 0.1094 t 979 new 0.21) lr 1.00e-05 gnorm 0.064 5.92s mem 15.6GB +[2026-09-13 18:50:52] step 1843/5000 loss 0.1120 (w 0.1048 mse 0.1031 t 969 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:50:58] step 1844/5000 loss 0.0920 (w 0.1494 mse 0.1427 t 965 new 0.26) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 18:51:04] step 1845/5000 loss 0.0533 (w 0.0769 mse 0.0794 t 990 new 0.08) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:51:09] step 1846/5000 loss 0.0787 (w 0.0963 mse 0.0924 t 972 new 0.24) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +[2026-09-13 18:51:15] step 1847/5000 loss 0.0979 (w 0.0577 mse 0.0552 t 737 new 0.13) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 18:51:21] step 1848/5000 loss 0.0944 (w 0.0599 mse 0.0653 t 320 new 0.25) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 18:51:27] step 1849/5000 loss 0.0681 (w 0.0663 mse 0.0620 t 877 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 18:51:32] step 1850/5000 loss 0.0834 (w 0.0415 mse 0.0437 t 798 new 0.16) lr 1.00e-05 gnorm 0.073 5.81s mem 15.6GB +[2026-09-13 18:51:38] step 1851/5000 loss 0.0518 (w 0.1024 mse 0.0994 t 843 new 0.21) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 18:51:44] step 1852/5000 loss 0.1170 (w 0.0707 mse 0.0658 t 778 new 0.25) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +[2026-09-13 18:51:50] step 1853/5000 loss 0.0573 (w 0.0907 mse 0.0867 t 649 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 18:51:56] step 1854/5000 loss 0.0914 (w 0.0447 mse 0.0414 t 778 new 0.23) lr 1.00e-05 gnorm 0.070 6.07s mem 15.6GB +[2026-09-13 18:52:01] step 1855/5000 loss 0.0595 (w 0.0907 mse 0.0890 t 459 new 0.24) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 18:52:07] step 1856/5000 loss 0.0763 (w 0.0642 mse 0.0650 t 829 new 0.24) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 18:52:13] step 1857/5000 loss 0.1128 (w 0.0831 mse 0.0797 t 574 new 0.25) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 18:52:19] step 1858/5000 loss 0.0907 (w 0.0561 mse 0.0569 t 851 new 0.19) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 18:52:24] step 1859/5000 loss 0.0396 (w 0.1924 mse 0.1767 t 984 new 0.18) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 18:52:30] step 1860/5000 loss 0.0761 (w 0.1041 mse 0.0980 t 809 new 0.24) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 18:52:36] step 1861/5000 loss 0.0752 (w 0.0504 mse 0.0493 t 781 new 0.17) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 18:52:41] step 1862/5000 loss 0.0917 (w 0.0344 mse 0.0382 t 665 new 0.26) lr 1.00e-05 gnorm 0.120 5.71s mem 15.6GB +[2026-09-13 18:52:47] step 1863/5000 loss 0.0558 (w 0.0723 mse 0.0716 t 747 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 18:52:53] step 1864/5000 loss 0.0699 (w 0.0903 mse 0.0940 t 273 new 0.20) lr 1.00e-05 gnorm 0.069 5.79s mem 15.6GB +[2026-09-13 18:52:59] step 1865/5000 loss 0.1207 (w 0.0721 mse 0.0694 t 686 new 0.23) lr 1.00e-05 gnorm 0.108 5.69s mem 15.6GB +[2026-09-13 18:53:05] step 1866/5000 loss 0.0932 (w 0.1007 mse 0.0929 t 945 new 0.26) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:53:11] step 1867/5000 loss 0.1083 (w 0.1595 mse 0.1544 t 288 new 0.25) lr 1.00e-05 gnorm 0.077 6.19s mem 15.6GB +[2026-09-13 18:53:16] step 1868/5000 loss 0.0506 (w 0.2662 mse 0.2459 t 995 new 0.27) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 18:53:22] step 1869/5000 loss 0.1329 (w 0.2170 mse 0.2112 t 225 new 0.24) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +[2026-09-13 18:53:28] step 1870/5000 loss 0.0822 (w 0.0617 mse 0.0591 t 864 new 0.13) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 18:53:34] step 1871/5000 loss 0.0957 (w 0.1038 mse 0.1131 t 252 new 0.18) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 18:53:39] step 1872/5000 loss 0.0692 (w 0.0860 mse 0.0781 t 821 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 18:53:45] step 1873/5000 loss 0.0868 (w 0.1083 mse 0.1063 t 998 new 0.21) lr 1.00e-05 gnorm 0.064 5.82s mem 15.6GB +[2026-09-13 18:53:51] step 1874/5000 loss 0.0916 (w 0.1429 mse 0.1389 t 896 new 0.19) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 18:53:57] step 1875/5000 loss 0.1002 (w 0.0922 mse 0.0861 t 476 new 0.27) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 18:54:02] step 1876/5000 loss 0.0566 (w 0.0754 mse 0.0733 t 933 new 0.13) lr 1.00e-05 gnorm 0.078 5.91s mem 15.6GB +[2026-09-13 18:54:08] step 1877/5000 loss 0.0967 (w 0.0758 mse 0.0744 t 916 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:54:14] step 1878/5000 loss 0.0656 (w 0.1471 mse 0.1364 t 963 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:54:20] step 1879/5000 loss 0.0593 (w 0.0731 mse 0.0666 t 720 new 0.30) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 18:54:25] step 1880/5000 loss 0.0904 (w 0.1781 mse 0.1679 t 982 new 0.33) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 18:54:31] step 1881/5000 loss 0.0687 (w 0.0975 mse 0.0975 t 912 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 18:54:37] step 1882/5000 loss 0.0828 (w 0.1436 mse 0.1417 t 999 new 0.08) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 18:54:43] step 1883/5000 loss 0.1426 (w 0.0311 mse 0.0370 t 578 new 0.23) lr 1.00e-05 gnorm 0.086 6.00s mem 15.6GB +[2026-09-13 18:54:48] step 1884/5000 loss 0.0640 (w 0.0914 mse 0.0902 t 866 new 0.20) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 18:54:54] step 1885/5000 loss 0.0559 (w 0.0470 mse 0.0482 t 522 new 0.24) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 18:55:00] step 1886/5000 loss 0.0914 (w 0.0648 mse 0.0647 t 961 new 0.13) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +[2026-09-13 18:55:06] step 1887/5000 loss 0.1283 (w 0.2481 mse 0.2340 t 988 new 0.29) lr 1.00e-05 gnorm 0.110 5.90s mem 15.6GB +[2026-09-13 18:55:11] step 1888/5000 loss 0.0805 (w 0.0667 mse 0.0639 t 873 new 0.24) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 18:55:17] step 1889/5000 loss 0.0631 (w 0.0991 mse 0.1006 t 977 new 0.18) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 18:55:23] step 1890/5000 loss 0.1068 (w 0.0837 mse 0.0815 t 888 new 0.21) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 18:55:29] step 1891/5000 loss 0.0917 (w 0.1317 mse 0.1248 t 991 new 0.20) lr 1.00e-05 gnorm 0.070 5.74s mem 15.6GB +[2026-09-13 18:55:34] step 1892/5000 loss 0.0888 (w 0.0533 mse 0.0509 t 700 new 0.25) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 18:55:40] step 1893/5000 loss 0.1161 (w 0.0761 mse 0.0721 t 883 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:55:46] step 1894/5000 loss 0.1282 (w 0.0676 mse 0.0619 t 752 new 0.23) lr 1.00e-05 gnorm 0.075 5.82s mem 15.6GB +[2026-09-13 18:55:52] step 1895/5000 loss 0.1154 (w 0.0452 mse 0.0450 t 824 new 0.27) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 18:55:58] step 1896/5000 loss 0.1047 (w 0.1483 mse 0.1403 t 945 new 0.30) lr 1.00e-05 gnorm 0.076 5.95s mem 15.6GB +[2026-09-13 18:56:03] step 1897/5000 loss 0.0817 (w 0.0511 mse 0.0506 t 540 new 0.13) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 18:56:09] step 1898/5000 loss 0.1035 (w 0.1170 mse 0.1125 t 582 new 0.21) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:56:15] step 1899/5000 loss 0.0921 (w 0.0558 mse 0.0566 t 802 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 18:56:20] step 1900/5000 loss 0.0876 (w 0.0689 mse 0.0647 t 879 new 0.28) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 18:56:26] step 1901/5000 loss 0.0827 (w 0.0576 mse 0.0525 t 892 new 0.09) lr 1.00e-05 gnorm 0.061 5.89s mem 15.6GB +[2026-09-13 18:56:32] step 1902/5000 loss 0.1051 (w 0.1039 mse 0.1052 t 748 new 0.19) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 18:56:38] step 1903/5000 loss 0.0477 (w 0.1212 mse 0.1170 t 891 new 0.17) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 18:56:43] step 1904/5000 loss 0.0528 (w 0.1662 mse 0.1585 t 965 new 0.22) lr 1.00e-05 gnorm 0.060 5.78s mem 15.6GB +[2026-09-13 18:56:49] step 1905/5000 loss 0.0815 (w 0.2838 mse 0.2814 t 138 new 0.13) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +[2026-09-13 18:56:55] step 1906/5000 loss 0.0737 (w 0.1861 mse 0.1831 t 229 new 0.26) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 18:57:00] step 1907/5000 loss 0.0783 (w 0.1356 mse 0.1292 t 961 new 0.23) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 18:57:06] step 1908/5000 loss 0.0475 (w 0.0988 mse 0.0949 t 886 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 18:57:12] step 1909/5000 loss 0.1250 (w 0.0592 mse 0.0563 t 793 new 0.29) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 18:57:18] step 1910/5000 loss 0.0777 (w 0.0774 mse 0.0716 t 848 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 18:57:24] step 1911/5000 loss 0.0832 (w 0.0961 mse 0.0949 t 643 new 0.19) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 18:57:29] step 1912/5000 loss 0.0840 (w 0.0640 mse 0.0614 t 748 new 0.15) lr 1.00e-05 gnorm 0.061 5.74s mem 15.6GB +[2026-09-13 18:57:35] step 1913/5000 loss 0.1091 (w 0.0906 mse 0.0869 t 761 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 18:57:41] step 1914/5000 loss 0.0768 (w 0.0290 mse 0.0305 t 822 new 0.10) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 18:57:46] step 1915/5000 loss 0.1077 (w 0.1275 mse 0.1202 t 761 new 0.28) lr 1.00e-05 gnorm 0.089 5.71s mem 15.6GB +[2026-09-13 18:57:52] step 1916/5000 loss 0.1285 (w 0.1191 mse 0.1251 t 198 new 0.30) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 18:57:58] step 1917/5000 loss 0.0670 (w 0.0446 mse 0.0434 t 778 new 0.23) lr 1.00e-05 gnorm 0.057 6.02s mem 15.6GB +[2026-09-13 18:58:04] step 1918/5000 loss 0.0804 (w 0.1162 mse 0.1172 t 914 new 0.16) lr 1.00e-05 gnorm 0.067 5.90s mem 15.6GB +[2026-09-13 18:58:10] step 1919/5000 loss 0.0607 (w 0.2529 mse 0.2246 t 990 new 0.22) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 18:58:15] step 1920/5000 loss 0.1267 (w 0.1270 mse 0.1257 t 283 new 0.26) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 18:58:21] step 1921/5000 loss 0.0395 (w 0.1252 mse 0.1115 t 936 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 18:58:27] step 1922/5000 loss 0.0589 (w 0.1442 mse 0.1425 t 970 new 0.22) lr 1.00e-05 gnorm 0.063 5.89s mem 15.6GB +[2026-09-13 18:58:33] step 1923/5000 loss 0.0651 (w 0.0615 mse 0.0609 t 883 new 0.14) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:58:38] step 1924/5000 loss 0.1240 (w 0.1041 mse 0.0962 t 941 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 18:58:44] step 1925/5000 loss 0.0997 (w 0.0926 mse 0.0898 t 394 new 0.21) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 18:58:50] step 1926/5000 loss 0.1272 (w 0.0769 mse 0.0813 t 908 new 0.23) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 18:58:56] step 1927/5000 loss 0.1005 (w 0.1883 mse 0.1976 t 172 new 0.27) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 18:59:02] step 1928/5000 loss 0.0710 (w 0.0764 mse 0.0705 t 748 new 0.22) lr 1.00e-05 gnorm 0.056 5.87s mem 15.6GB +[2026-09-13 18:59:07] step 1929/5000 loss 0.0897 (w 0.1245 mse 0.1150 t 907 new 0.27) lr 1.00e-05 gnorm 0.071 5.90s mem 15.6GB +[2026-09-13 18:59:13] step 1930/5000 loss 0.0847 (w 0.0685 mse 0.0641 t 863 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 18:59:19] step 1931/5000 loss 0.1186 (w 0.0796 mse 0.0758 t 862 new 0.26) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 18:59:25] step 1932/5000 loss 0.0980 (w 0.1163 mse 0.1108 t 900 new 0.27) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 18:59:30] step 1933/5000 loss 0.0715 (w 0.1071 mse 0.0987 t 851 new 0.23) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 18:59:36] step 1934/5000 loss 0.0688 (w 0.6153 mse 0.6234 t 10 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 18:59:42] step 1935/5000 loss 0.0893 (w 0.0893 mse 0.0817 t 969 new 0.23) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 18:59:47] step 1936/5000 loss 0.1359 (w 0.0751 mse 0.0753 t 853 new 0.28) lr 1.00e-05 gnorm 0.058 5.77s mem 15.6GB +[2026-09-13 18:59:53] step 1937/5000 loss 0.0533 (w 0.0263 mse 0.0296 t 879 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 18:59:59] step 1938/5000 loss 0.0418 (w 0.0943 mse 0.0878 t 996 new 0.19) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +[2026-09-13 19:00:05] step 1939/5000 loss 0.0869 (w 0.0627 mse 0.0593 t 552 new 0.15) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 19:00:12] step 1940/5000 loss 0.1133 (w 0.0729 mse 0.0703 t 798 new 0.15) lr 1.00e-05 gnorm 0.058 7.19s mem 15.6GB +[2026-09-13 19:00:17] step 1941/5000 loss 0.1007 (w 0.0573 mse 0.0535 t 889 new 0.16) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 19:00:23] step 1942/5000 loss 0.0856 (w 0.0327 mse 0.0356 t 687 new 0.25) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 19:00:29] step 1943/5000 loss 0.1000 (w 0.0687 mse 0.0655 t 859 new 0.26) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 19:00:35] step 1944/5000 loss 0.0802 (w 0.1309 mse 0.1248 t 927 new 0.15) lr 1.00e-05 gnorm 0.062 5.90s mem 15.6GB +[2026-09-13 19:00:40] step 1945/5000 loss 0.1118 (w 0.0654 mse 0.0655 t 518 new 0.14) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 19:00:46] step 1946/5000 loss 0.0902 (w 0.1148 mse 0.1095 t 708 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 19:00:52] step 1947/5000 loss 0.1090 (w 0.0905 mse 0.0842 t 916 new 0.25) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +[2026-09-13 19:00:58] step 1948/5000 loss 0.0509 (w 0.1218 mse 0.1146 t 983 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 19:01:03] step 1949/5000 loss 0.0783 (w 0.0763 mse 0.0740 t 890 new 0.17) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 19:01:09] step 1950/5000 loss 0.0962 (w 0.1426 mse 0.1403 t 283 new 0.29) lr 1.00e-05 gnorm 0.100 5.70s mem 15.6GB +[2026-09-13 19:01:15] step 1951/5000 loss 0.0538 (w 0.1038 mse 0.1004 t 947 new 0.25) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 19:01:20] step 1952/5000 loss 0.0785 (w 0.0703 mse 0.0700 t 863 new 0.22) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 19:01:26] step 1953/5000 loss 0.0918 (w 0.0647 mse 0.0617 t 832 new 0.25) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 19:01:32] step 1954/5000 loss 0.0950 (w 0.0854 mse 0.0845 t 634 new 0.10) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 19:01:38] step 1955/5000 loss 0.0992 (w 0.1990 mse 0.1819 t 985 new 0.23) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 19:01:43] step 1956/5000 loss 0.0930 (w 0.0767 mse 0.0697 t 902 new 0.26) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 19:01:49] step 1957/5000 loss 0.1392 (w 0.0447 mse 0.0475 t 587 new 0.16) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +[2026-09-13 19:01:55] step 1958/5000 loss 0.0705 (w 0.0596 mse 0.0608 t 671 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 19:02:00] step 1959/5000 loss 0.0856 (w 0.1100 mse 0.1057 t 362 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 19:02:06] step 1960/5000 loss 0.0654 (w 0.9213 mse 0.9158 t 20 new 0.20) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 19:02:12] step 1961/5000 loss 0.0668 (w 0.0841 mse 0.0834 t 918 new 0.21) lr 1.00e-05 gnorm 0.058 5.76s mem 15.6GB +[2026-09-13 19:02:18] step 1962/5000 loss 0.1047 (w 0.0644 mse 0.0595 t 710 new 0.22) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 19:02:23] step 1963/5000 loss 0.1095 (w 0.1047 mse 0.0934 t 921 new 0.26) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:02:29] step 1964/5000 loss 0.1007 (w 0.1027 mse 0.1020 t 538 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 19:02:35] step 1965/5000 loss 0.0960 (w 0.1674 mse 0.1623 t 994 new 0.17) lr 1.00e-05 gnorm 0.059 5.89s mem 15.6GB +[2026-09-13 19:02:41] step 1966/5000 loss 0.0668 (w 0.0862 mse 0.0822 t 788 new 0.26) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 19:02:46] step 1967/5000 loss 0.0531 (w 0.1102 mse 0.1042 t 793 new 0.21) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 19:02:52] step 1968/5000 loss 0.0960 (w 0.0627 mse 0.0600 t 779 new 0.14) lr 1.00e-05 gnorm 0.062 5.90s mem 15.6GB +[2026-09-13 19:02:58] step 1969/5000 loss 0.0842 (w 0.0567 mse 0.0518 t 887 new 0.20) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 19:03:04] step 1970/5000 loss 0.0673 (w 0.1373 mse 0.1289 t 958 new 0.21) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 19:03:10] step 1971/5000 loss 0.1060 (w 0.0734 mse 0.0755 t 419 new 0.24) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 19:03:15] step 1972/5000 loss 0.0802 (w 0.1246 mse 0.1171 t 904 new 0.23) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 19:03:21] step 1973/5000 loss 0.0703 (w 0.0721 mse 0.0661 t 794 new 0.32) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:03:27] step 1974/5000 loss 0.1214 (w 0.2503 mse 0.2685 t 118 new 0.17) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 19:03:32] step 1975/5000 loss 0.0898 (w 0.0909 mse 0.0861 t 898 new 0.13) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 19:03:38] step 1976/5000 loss 0.0843 (w 0.0476 mse 0.0486 t 695 new 0.21) lr 1.00e-05 gnorm 0.066 5.72s mem 15.6GB +[2026-09-13 19:03:44] step 1977/5000 loss 0.1583 (w 0.1014 mse 0.0970 t 396 new 0.23) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 19:03:50] step 1978/5000 loss 0.0688 (w 0.0873 mse 0.0844 t 493 new 0.23) lr 1.00e-05 gnorm 0.066 5.71s mem 15.6GB +[2026-09-13 19:03:55] step 1979/5000 loss 0.1034 (w 0.0854 mse 0.0847 t 945 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 19:04:01] step 1980/5000 loss 0.0631 (w 0.0948 mse 0.0935 t 535 new 0.25) lr 1.00e-05 gnorm 0.055 5.92s mem 15.6GB +[2026-09-13 19:04:07] step 1981/5000 loss 0.0707 (w 0.1037 mse 0.0995 t 977 new 0.25) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 19:04:13] step 1982/5000 loss 0.0611 (w 0.0727 mse 0.0702 t 852 new 0.28) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:04:18] step 1983/5000 loss 0.1337 (w 0.1837 mse 0.1780 t 245 new 0.22) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 19:04:24] step 1984/5000 loss 0.0551 (w 0.1311 mse 0.1154 t 946 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:04:30] step 1985/5000 loss 0.0777 (w 0.0570 mse 0.0576 t 768 new 0.17) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 19:04:36] step 1986/5000 loss 0.0851 (w 0.0733 mse 0.0725 t 658 new 0.22) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 19:04:41] step 1987/5000 loss 0.0791 (w 0.0584 mse 0.0576 t 502 new 0.15) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 19:04:47] step 1988/5000 loss 0.0863 (w 0.0616 mse 0.0549 t 744 new 0.23) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 19:04:53] step 1989/5000 loss 0.1135 (w 0.0579 mse 0.0575 t 882 new 0.13) lr 1.00e-05 gnorm 0.084 5.71s mem 15.6GB +[2026-09-13 19:04:58] step 1990/5000 loss 0.0564 (w 0.0545 mse 0.0505 t 871 new 0.17) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 19:05:04] step 1991/5000 loss 0.0731 (w 0.2554 mse 0.2534 t 142 new 0.23) lr 1.00e-05 gnorm 0.071 5.73s mem 15.6GB +[2026-09-13 19:05:10] step 1992/5000 loss 0.1016 (w 0.1107 mse 0.1074 t 964 new 0.19) lr 1.00e-05 gnorm 0.069 5.88s mem 15.6GB +[2026-09-13 19:05:16] step 1993/5000 loss 0.0883 (w 0.0712 mse 0.0656 t 909 new 0.27) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 19:05:22] step 1994/5000 loss 0.0841 (w 0.0542 mse 0.0557 t 901 new 0.19) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 19:05:27] step 1995/5000 loss 0.0544 (w 0.0890 mse 0.0879 t 797 new 0.19) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 19:05:33] step 1996/5000 loss 0.0905 (w 0.0804 mse 0.0731 t 820 new 0.20) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:05:39] step 1997/5000 loss 0.0697 (w 0.0707 mse 0.0660 t 881 new 0.21) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 19:05:44] step 1998/5000 loss 0.1106 (w 0.1128 mse 0.1120 t 242 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:05:50] step 1999/5000 loss 0.0890 (w 0.0577 mse 0.0564 t 705 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 19:05:56] step 2000/5000 loss 0.0684 (w 0.0849 mse 0.0816 t 960 new 0.25) lr 1.00e-05 gnorm 0.067 5.96s mem 15.6GB +[2026-09-13 19:06:00] [val] step 2000 t=201: w=0.1763 mse=0.1788 (n=16) t=501: w=0.0732 mse=0.0732 (n=16) t=800: w=0.0618 mse=0.0607 (n=16) | mean w=0.1038 mse=0.1042 4s +[2026-09-13 19:06:04] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step2000.safetensors 832 个张量 2.87 GB +[2026-09-13 19:06:09] step 2001/5000 loss 0.1310 (w 0.0629 mse 0.0632 t 714 new 0.24) lr 1.00e-05 gnorm 0.061 5.67s mem 15.6GB +[2026-09-13 19:06:15] step 2002/5000 loss 0.0954 (w 0.0934 mse 0.0879 t 947 new 0.15) lr 1.00e-05 gnorm 0.062 5.78s mem 15.6GB +[2026-09-13 19:06:21] step 2003/5000 loss 0.0767 (w 0.1401 mse 0.1357 t 960 new 0.22) lr 1.00e-05 gnorm 0.072 5.71s mem 15.6GB +[2026-09-13 19:06:27] step 2004/5000 loss 0.0924 (w 0.1098 mse 0.1128 t 235 new 0.08) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 19:06:32] step 2005/5000 loss 0.0872 (w 0.1576 mse 0.1513 t 978 new 0.20) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +[2026-09-13 19:06:38] step 2006/5000 loss 0.1091 (w 0.2360 mse 0.2410 t 101 new 0.21) lr 1.00e-05 gnorm 0.076 5.93s mem 15.6GB +[2026-09-13 19:06:44] step 2007/5000 loss 0.0841 (w 0.0592 mse 0.0547 t 824 new 0.26) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 19:06:50] step 2008/5000 loss 0.0934 (w 0.0456 mse 0.0481 t 818 new 0.18) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 19:06:56] step 2009/5000 loss 0.1042 (w 0.1277 mse 0.1227 t 966 new 0.18) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 19:07:02] step 2010/5000 loss 0.0872 (w 0.0903 mse 0.0867 t 804 new 0.20) lr 1.00e-05 gnorm 0.056 5.90s mem 15.6GB +[2026-09-13 19:07:08] step 2011/5000 loss 0.0794 (w 0.0446 mse 0.0395 t 907 new 0.24) lr 1.00e-05 gnorm 0.072 6.78s mem 15.6GB +[2026-09-13 19:07:14] step 2012/5000 loss 0.0470 (w 0.0947 mse 0.0905 t 884 new 0.19) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 19:07:20] step 2013/5000 loss 0.1274 (w 0.0662 mse 0.0605 t 669 new 0.17) lr 1.00e-05 gnorm 0.067 5.79s mem 15.6GB +[2026-09-13 19:07:26] step 2014/5000 loss 0.0495 (w 0.1004 mse 0.0914 t 917 new 0.27) lr 1.00e-05 gnorm 0.061 5.72s mem 15.6GB +[2026-09-13 19:07:31] step 2015/5000 loss 0.1283 (w 0.1115 mse 0.1037 t 881 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 19:07:37] step 2016/5000 loss 0.0883 (w 0.0780 mse 0.0747 t 724 new 0.17) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 19:07:43] step 2017/5000 loss 0.0705 (w 0.1780 mse 0.1955 t 150 new 0.24) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 19:07:49] step 2018/5000 loss 0.0668 (w 0.0673 mse 0.0649 t 523 new 0.18) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +[2026-09-13 19:07:54] step 2019/5000 loss 0.1000 (w 0.0994 mse 0.0958 t 750 new 0.23) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +[2026-09-13 19:08:00] step 2020/5000 loss 0.0497 (w 0.0335 mse 0.0377 t 535 new 0.26) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +[2026-09-13 19:08:06] step 2021/5000 loss 0.0618 (w 0.0394 mse 0.0412 t 759 new 0.13) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +[2026-09-13 19:08:12] step 2022/5000 loss 0.0698 (w 0.1478 mse 0.1381 t 949 new 0.27) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 19:08:17] step 2023/5000 loss 0.0561 (w 0.1057 mse 0.1010 t 980 new 0.19) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 19:08:23] step 2024/5000 loss 0.1077 (w 0.2213 mse 0.2457 t 97 new 0.26) lr 1.00e-05 gnorm 0.078 5.91s mem 15.6GB +[2026-09-13 19:08:29] step 2025/5000 loss 0.0643 (w 0.0605 mse 0.0567 t 818 new 0.28) lr 1.00e-05 gnorm 0.066 5.91s mem 15.6GB +[2026-09-13 19:08:35] step 2026/5000 loss 0.0798 (w 0.0598 mse 0.0607 t 712 new 0.22) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 19:08:41] step 2027/5000 loss 0.1217 (w 0.0961 mse 0.0967 t 986 new 0.19) lr 1.00e-05 gnorm 0.062 5.92s mem 15.6GB +[2026-09-13 19:08:47] step 2028/5000 loss 0.1273 (w 0.1341 mse 0.1291 t 288 new 0.26) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 19:08:52] step 2029/5000 loss 0.0831 (w 0.1095 mse 0.1022 t 929 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 19:08:58] step 2030/5000 loss 0.1237 (w 0.1707 mse 0.1822 t 165 new 0.27) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 19:09:04] step 2031/5000 loss 0.0748 (w 0.3237 mse 0.3118 t 146 new 0.22) lr 1.00e-05 gnorm 0.050 5.79s mem 15.6GB +[2026-09-13 19:09:09] step 2032/5000 loss 0.0745 (w 0.0565 mse 0.0536 t 878 new 0.28) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +[2026-09-13 19:09:15] step 2033/5000 loss 0.0776 (w 0.9974 mse 0.9966 t 5 new 0.15) lr 1.00e-05 gnorm 0.063 5.82s mem 15.6GB +[2026-09-13 19:09:21] step 2034/5000 loss 0.1137 (w 0.2416 mse 0.2389 t 201 new 0.25) lr 1.00e-05 gnorm 0.065 6.07s mem 15.6GB +[2026-09-13 19:09:27] step 2035/5000 loss 0.0460 (w 0.0663 mse 0.0643 t 720 new 0.26) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +[2026-09-13 19:09:33] step 2036/5000 loss 0.0836 (w 0.0916 mse 0.0884 t 387 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 19:09:39] step 2037/5000 loss 0.1054 (w 0.0643 mse 0.0651 t 538 new 0.30) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 19:09:44] step 2038/5000 loss 0.0786 (w 0.1024 mse 0.1028 t 924 new 0.21) lr 1.00e-05 gnorm 0.071 5.76s mem 15.6GB +[2026-09-13 19:09:50] step 2039/5000 loss 0.1015 (w 0.0385 mse 0.0392 t 695 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 19:09:56] step 2040/5000 loss 0.1246 (w 0.6114 mse 0.6035 t 57 new 0.25) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 19:10:02] step 2041/5000 loss 0.0482 (w 0.0753 mse 0.0790 t 967 new 0.18) lr 1.00e-05 gnorm 0.074 5.83s mem 15.6GB +[2026-09-13 19:10:07] step 2042/5000 loss 0.0921 (w 0.1163 mse 0.1162 t 941 new 0.22) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 19:10:13] step 2043/5000 loss 0.1297 (w 0.0761 mse 0.0747 t 931 new 0.16) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +[2026-09-13 19:10:19] step 2044/5000 loss 0.0753 (w 0.1063 mse 0.1011 t 927 new 0.23) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 19:10:25] step 2045/5000 loss 0.0937 (w 0.0899 mse 0.0872 t 910 new 0.29) lr 1.00e-05 gnorm 0.069 5.71s mem 15.6GB +[2026-09-13 19:10:30] step 2046/5000 loss 0.0457 (w 0.1256 mse 0.1257 t 998 new 0.22) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 19:10:36] step 2047/5000 loss 0.0616 (w 0.1411 mse 0.1421 t 941 new 0.16) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 19:10:42] step 2048/5000 loss 0.0780 (w 0.1192 mse 0.1172 t 900 new 0.22) lr 1.00e-05 gnorm 0.055 5.93s mem 15.6GB +[2026-09-13 19:10:48] step 2049/5000 loss 0.1136 (w 0.1940 mse 0.2030 t 130 new 0.25) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 19:10:53] step 2050/5000 loss 0.0699 (w 0.1136 mse 0.1222 t 972 new 0.20) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 19:10:59] step 2051/5000 loss 0.1224 (w 0.0613 mse 0.0560 t 730 new 0.24) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 19:11:05] step 2052/5000 loss 0.0936 (w 0.1679 mse 0.1658 t 994 new 0.25) lr 1.00e-05 gnorm 0.079 5.73s mem 15.6GB +[2026-09-13 19:11:11] step 2053/5000 loss 0.0587 (w 0.0540 mse 0.0532 t 717 new 0.25) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 19:11:16] step 2054/5000 loss 0.1346 (w 0.0511 mse 0.0539 t 476 new 0.22) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 19:11:22] step 2055/5000 loss 0.0517 (w 0.0650 mse 0.0558 t 880 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 19:11:28] step 2056/5000 loss 0.0830 (w 0.2908 mse 0.2824 t 142 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 19:11:33] step 2057/5000 loss 0.1258 (w 0.0652 mse 0.0644 t 792 new 0.27) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 19:11:39] step 2058/5000 loss 0.0415 (w 0.0743 mse 0.0698 t 848 new 0.13) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:11:45] step 2059/5000 loss 0.0740 (w 0.0855 mse 0.0819 t 730 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 19:11:51] step 2060/5000 loss 0.1162 (w 0.1035 mse 0.0991 t 725 new 0.27) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:11:56] step 2061/5000 loss 0.0408 (w 0.0741 mse 0.0728 t 860 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 19:12:02] step 2062/5000 loss 0.0907 (w 0.0871 mse 0.0869 t 958 new 0.22) lr 1.00e-05 gnorm 0.064 5.73s mem 15.6GB +[2026-09-13 19:12:08] step 2063/5000 loss 0.0465 (w 0.1744 mse 0.1644 t 985 new 0.30) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +[2026-09-13 19:12:13] step 2064/5000 loss 0.1105 (w 0.0884 mse 0.0841 t 801 new 0.16) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:12:19] step 2065/5000 loss 0.1041 (w 0.0383 mse 0.0393 t 670 new 0.21) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 19:12:25] step 2066/5000 loss 0.0576 (w 0.2061 mse 0.1873 t 970 new 0.25) lr 1.00e-05 gnorm 0.070 5.73s mem 15.6GB +[2026-09-13 19:12:31] step 2067/5000 loss 0.0757 (w 0.0873 mse 0.0958 t 945 new 0.14) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 19:12:36] step 2068/5000 loss 0.1162 (w 0.1112 mse 0.0980 t 954 new 0.25) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 19:12:42] step 2069/5000 loss 0.0977 (w 0.0623 mse 0.0617 t 806 new 0.24) lr 1.00e-05 gnorm 0.073 5.93s mem 15.6GB +[2026-09-13 19:12:48] step 2070/5000 loss 0.0976 (w 0.0930 mse 0.0872 t 562 new 0.22) lr 1.00e-05 gnorm 0.092 5.74s mem 15.6GB +[2026-09-13 19:12:54] step 2071/5000 loss 0.1478 (w 0.0716 mse 0.0726 t 508 new 0.24) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 19:12:59] step 2072/5000 loss 0.0677 (w 0.0657 mse 0.0644 t 914 new 0.21) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 19:13:05] step 2073/5000 loss 0.0869 (w 0.0943 mse 0.0903 t 391 new 0.24) lr 1.00e-05 gnorm 0.058 5.71s mem 15.6GB +[2026-09-13 19:13:11] step 2074/5000 loss 0.1112 (w 0.0705 mse 0.0735 t 975 new 0.23) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 19:13:17] step 2075/5000 loss 0.0484 (w 0.0653 mse 0.0631 t 845 new 0.24) lr 1.00e-05 gnorm 0.067 5.81s mem 15.6GB +[2026-09-13 19:13:22] step 2076/5000 loss 0.1183 (w 0.0410 mse 0.0440 t 788 new 0.18) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 19:13:28] step 2077/5000 loss 0.1026 (w 0.0474 mse 0.0477 t 677 new 0.27) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 19:13:34] step 2078/5000 loss 0.0585 (w 0.0696 mse 0.0676 t 806 new 0.29) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 19:13:40] step 2079/5000 loss 0.0649 (w 0.2327 mse 0.2128 t 998 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:13:45] step 2080/5000 loss 0.1289 (w 0.1113 mse 0.0977 t 945 new 0.20) lr 1.00e-05 gnorm 0.105 5.69s mem 15.6GB +[2026-09-13 19:13:51] step 2081/5000 loss 0.1038 (w 0.1555 mse 0.1539 t 205 new 0.24) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 19:13:57] step 2082/5000 loss 0.1216 (w 0.0758 mse 0.0720 t 509 new 0.21) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 19:14:03] step 2083/5000 loss 0.1022 (w 0.0674 mse 0.0665 t 766 new 0.26) lr 1.00e-05 gnorm 0.064 5.86s mem 15.6GB +[2026-09-13 19:14:08] step 2084/5000 loss 0.0767 (w 0.0461 mse 0.0469 t 640 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 19:14:14] step 2085/5000 loss 0.1233 (w 0.0570 mse 0.0575 t 859 new 0.20) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 19:14:20] step 2086/5000 loss 0.0654 (w 0.0408 mse 0.0399 t 745 new 0.30) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 19:14:26] step 2087/5000 loss 0.1319 (w 0.1127 mse 0.1078 t 878 new 0.19) lr 1.00e-05 gnorm 0.073 6.10s mem 15.6GB +[2026-09-13 19:14:32] step 2088/5000 loss 0.1377 (w 0.0860 mse 0.0843 t 678 new 0.26) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 19:14:38] step 2089/5000 loss 0.0911 (w 0.1144 mse 0.1023 t 941 new 0.24) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +[2026-09-13 19:14:43] step 2090/5000 loss 0.0675 (w 0.0580 mse 0.0572 t 893 new 0.26) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 19:14:49] step 2091/5000 loss 0.0520 (w 0.1006 mse 0.0969 t 892 new 0.22) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 19:14:55] step 2092/5000 loss 0.1084 (w 0.0968 mse 0.0921 t 893 new 0.23) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 19:15:01] step 2093/5000 loss 0.1365 (w 0.1296 mse 0.1323 t 201 new 0.23) lr 1.00e-05 gnorm 0.075 5.99s mem 15.6GB +[2026-09-13 19:15:06] step 2094/5000 loss 0.1044 (w 0.0602 mse 0.0608 t 766 new 0.24) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 19:15:12] step 2095/5000 loss 0.0585 (w 0.0445 mse 0.0446 t 888 new 0.08) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 19:15:18] step 2096/5000 loss 0.0848 (w 0.0873 mse 0.0899 t 936 new 0.19) lr 1.00e-05 gnorm 0.078 5.74s mem 15.6GB +[2026-09-13 19:15:24] step 2097/5000 loss 0.0978 (w 0.0504 mse 0.0527 t 761 new 0.20) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:15:29] step 2098/5000 loss 0.0966 (w 0.0879 mse 0.0860 t 546 new 0.23) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 19:15:35] step 2099/5000 loss 0.0920 (w 0.0979 mse 0.0934 t 800 new 0.15) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 19:15:41] step 2100/5000 loss 0.0689 (w 0.0127 mse 0.0130 t 756 new 0.10) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 19:15:47] step 2101/5000 loss 0.0698 (w 0.1046 mse 0.1049 t 974 new 0.16) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:15:52] step 2102/5000 loss 0.1494 (w 0.0610 mse 0.0584 t 720 new 0.13) lr 1.00e-05 gnorm 0.110 5.71s mem 15.6GB +[2026-09-13 19:15:58] step 2103/5000 loss 0.1183 (w 0.3653 mse 0.3547 t 118 new 0.25) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 19:16:04] step 2104/5000 loss 0.0917 (w 0.0644 mse 0.0646 t 841 new 0.09) lr 1.00e-05 gnorm 0.069 5.82s mem 15.6GB +[2026-09-13 19:16:10] step 2105/5000 loss 0.0830 (w 0.1160 mse 0.1053 t 908 new 0.21) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +[2026-09-13 19:16:15] step 2106/5000 loss 0.1067 (w 0.2146 mse 0.2030 t 981 new 0.23) lr 1.00e-05 gnorm 0.087 5.72s mem 15.6GB +[2026-09-13 19:16:21] step 2107/5000 loss 0.0939 (w 0.0920 mse 0.0885 t 866 new 0.21) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +[2026-09-13 19:16:27] step 2108/5000 loss 0.0730 (w 0.0611 mse 0.0546 t 776 new 0.24) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +[2026-09-13 19:16:33] step 2109/5000 loss 0.0891 (w 0.1121 mse 0.1085 t 953 new 0.22) lr 1.00e-05 gnorm 0.088 5.91s mem 15.6GB +[2026-09-13 19:16:38] step 2110/5000 loss 0.1182 (w 0.1057 mse 0.1032 t 367 new 0.12) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 19:16:44] step 2111/5000 loss 0.1281 (w 0.4129 mse 0.4243 t 93 new 0.27) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 19:16:50] step 2112/5000 loss 0.0664 (w 0.0558 mse 0.0536 t 812 new 0.12) lr 1.00e-05 gnorm 0.070 5.89s mem 15.6GB +[2026-09-13 19:16:56] step 2113/5000 loss 0.0530 (w 0.0215 mse 0.0211 t 766 new 0.19) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +[2026-09-13 19:17:02] step 2114/5000 loss 0.0775 (w 0.1064 mse 0.1048 t 951 new 0.23) lr 1.00e-05 gnorm 0.072 5.71s mem 15.6GB +[2026-09-13 19:17:07] step 2115/5000 loss 0.0800 (w 0.1167 mse 0.1099 t 933 new 0.21) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 19:17:13] step 2116/5000 loss 0.0752 (w 0.1195 mse 0.1208 t 201 new 0.13) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +[2026-09-13 19:17:19] step 2117/5000 loss 0.0782 (w 0.1017 mse 0.0957 t 864 new 0.27) lr 1.00e-05 gnorm 0.102 5.69s mem 15.6GB +[2026-09-13 19:17:25] step 2118/5000 loss 0.0957 (w 0.2193 mse 0.2099 t 239 new 0.27) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 19:17:31] step 2119/5000 loss 0.0891 (w 0.0657 mse 0.0637 t 796 new 0.24) lr 1.00e-05 gnorm 0.097 5.91s mem 15.6GB +[2026-09-13 19:17:36] step 2120/5000 loss 0.0736 (w 0.1048 mse 0.1004 t 946 new 0.28) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 19:17:42] step 2121/5000 loss 0.0527 (w 0.0863 mse 0.0861 t 981 new 0.08) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 19:17:48] step 2122/5000 loss 0.1017 (w 0.2689 mse 0.2362 t 999 new 0.26) lr 1.00e-05 gnorm 0.137 5.70s mem 15.6GB +[2026-09-13 19:17:53] step 2123/5000 loss 0.0651 (w 0.0520 mse 0.0505 t 880 new 0.19) lr 1.00e-05 gnorm 0.100 5.69s mem 15.6GB +[2026-09-13 19:17:59] step 2124/5000 loss 0.1140 (w 0.1538 mse 0.1542 t 242 new 0.25) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 19:18:05] step 2125/5000 loss 0.0754 (w 0.0591 mse 0.0539 t 831 new 0.12) lr 1.00e-05 gnorm 0.118 5.69s mem 15.6GB +[2026-09-13 19:18:12] step 2126/5000 loss 0.0924 (w 0.0673 mse 0.0659 t 725 new 0.21) lr 1.00e-05 gnorm 0.092 7.00s mem 15.6GB +[2026-09-13 19:18:18] step 2127/5000 loss 0.1132 (w 0.1044 mse 0.1016 t 543 new 0.30) lr 1.00e-05 gnorm 0.060 5.76s mem 15.6GB +[2026-09-13 19:18:23] step 2128/5000 loss 0.1197 (w 0.0494 mse 0.0503 t 657 new 0.25) lr 1.00e-05 gnorm 0.096 5.68s mem 15.6GB +[2026-09-13 19:18:29] step 2129/5000 loss 0.1419 (w 0.1120 mse 0.1047 t 966 new 0.22) lr 1.00e-05 gnorm 0.108 5.70s mem 15.6GB +[2026-09-13 19:18:35] step 2130/5000 loss 0.0919 (w 0.3333 mse 0.2967 t 997 new 0.27) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 19:18:40] step 2131/5000 loss 0.0790 (w 0.0728 mse 0.0660 t 646 new 0.26) lr 1.00e-05 gnorm 0.113 5.68s mem 15.6GB +[2026-09-13 19:18:46] step 2132/5000 loss 0.0628 (w 0.0886 mse 0.0869 t 844 new 0.22) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +[2026-09-13 19:18:52] step 2133/5000 loss 0.0941 (w 0.0560 mse 0.0536 t 629 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 19:18:58] step 2134/5000 loss 0.0663 (w 0.0740 mse 0.0740 t 797 new 0.22) lr 1.00e-05 gnorm 0.061 5.89s mem 15.6GB +[2026-09-13 19:19:04] step 2135/5000 loss 0.1177 (w 0.0573 mse 0.0504 t 691 new 0.22) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 19:19:09] step 2136/5000 loss 0.0579 (w 0.1457 mse 0.1361 t 956 new 0.22) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 19:19:15] step 2137/5000 loss 0.1093 (w 0.1166 mse 0.1011 t 986 new 0.27) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 19:19:21] step 2138/5000 loss 0.1717 (w 0.1115 mse 0.1074 t 762 new 0.26) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 19:19:26] step 2139/5000 loss 0.0548 (w 0.1282 mse 0.1247 t 273 new 0.28) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 19:19:32] step 2140/5000 loss 0.0471 (w 0.0686 mse 0.0634 t 899 new 0.29) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 19:19:38] step 2141/5000 loss 0.0777 (w 0.5930 mse 0.5934 t 48 new 0.28) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 19:19:44] step 2142/5000 loss 0.0906 (w 0.0997 mse 0.0950 t 919 new 0.17) lr 1.00e-05 gnorm 0.060 5.84s mem 15.6GB +[2026-09-13 19:19:49] step 2143/5000 loss 0.0844 (w 0.0756 mse 0.0742 t 584 new 0.27) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 19:19:55] step 2144/5000 loss 0.1016 (w 0.1325 mse 0.1298 t 560 new 0.18) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 19:20:01] step 2145/5000 loss 0.0818 (w 0.0709 mse 0.0648 t 759 new 0.23) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 19:20:07] step 2146/5000 loss 0.0865 (w 0.1376 mse 0.1333 t 960 new 0.22) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +[2026-09-13 19:20:12] step 2147/5000 loss 0.1031 (w 0.1229 mse 0.1173 t 276 new 0.25) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 19:20:18] step 2148/5000 loss 0.0810 (w 0.2063 mse 0.2164 t 276 new 0.21) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 19:20:24] step 2149/5000 loss 0.0733 (w 0.1115 mse 0.1046 t 937 new 0.17) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +[2026-09-13 19:20:29] step 2150/5000 loss 0.0620 (w 0.0714 mse 0.0691 t 935 new 0.24) lr 1.00e-05 gnorm 0.062 5.71s mem 15.6GB +[2026-09-13 19:20:35] step 2151/5000 loss 0.0432 (w 0.1244 mse 0.1233 t 952 new 0.18) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 19:20:41] step 2152/5000 loss 0.0803 (w 0.0647 mse 0.0646 t 878 new 0.19) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 19:20:46] step 2153/5000 loss 0.0828 (w 0.1189 mse 0.1131 t 916 new 0.26) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 19:20:52] step 2154/5000 loss 0.1371 (w 0.1089 mse 0.1108 t 569 new 0.24) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 19:20:58] step 2155/5000 loss 0.0796 (w 0.1231 mse 0.1191 t 899 new 0.21) lr 1.00e-05 gnorm 0.081 5.90s mem 15.6GB +[2026-09-13 19:21:04] step 2156/5000 loss 0.0757 (w 0.1142 mse 0.1062 t 960 new 0.22) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 19:21:09] step 2157/5000 loss 0.1192 (w 0.1177 mse 0.1132 t 958 new 0.22) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +[2026-09-13 19:21:15] step 2158/5000 loss 0.0969 (w 0.0928 mse 0.0874 t 718 new 0.24) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 19:21:21] step 2159/5000 loss 0.1008 (w 0.1025 mse 0.0966 t 879 new 0.25) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 19:21:27] step 2160/5000 loss 0.0873 (w 0.0843 mse 0.0859 t 449 new 0.26) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 19:21:32] step 2161/5000 loss 0.1515 (w 0.5372 mse 0.5325 t 62 new 0.16) lr 1.00e-05 gnorm 0.069 5.76s mem 15.6GB +[2026-09-13 19:21:38] step 2162/5000 loss 0.0898 (w 0.0570 mse 0.0561 t 412 new 0.15) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 19:21:44] step 2163/5000 loss 0.0504 (w 0.0129 mse 0.0132 t 739 new 0.12) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +[2026-09-13 19:21:49] step 2164/5000 loss 0.0711 (w 0.0676 mse 0.0675 t 600 new 0.29) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 19:21:55] step 2165/5000 loss 0.0772 (w 0.0955 mse 0.0888 t 936 new 0.20) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +[2026-09-13 19:22:01] step 2166/5000 loss 0.0614 (w 0.0959 mse 0.0897 t 853 new 0.31) lr 1.00e-05 gnorm 0.094 5.70s mem 15.6GB +[2026-09-13 19:22:07] step 2167/5000 loss 0.1224 (w 0.0842 mse 0.0822 t 798 new 0.23) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 19:22:12] step 2168/5000 loss 0.0614 (w 0.0472 mse 0.0499 t 815 new 0.26) lr 1.00e-05 gnorm 0.114 5.69s mem 15.6GB +[2026-09-13 19:22:18] step 2169/5000 loss 0.1219 (w 0.0791 mse 0.0771 t 705 new 0.19) lr 1.00e-05 gnorm 0.056 5.74s mem 15.6GB +[2026-09-13 19:22:24] step 2170/5000 loss 0.0429 (w 0.1014 mse 0.0993 t 977 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 19:22:30] step 2171/5000 loss 0.1026 (w 0.0684 mse 0.0637 t 941 new 0.20) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 19:22:35] step 2172/5000 loss 0.0789 (w 0.0998 mse 0.0997 t 971 new 0.18) lr 1.00e-05 gnorm 0.062 5.67s mem 15.6GB +[2026-09-13 19:22:41] step 2173/5000 loss 0.0718 (w 0.1036 mse 0.1026 t 957 new 0.21) lr 1.00e-05 gnorm 0.054 5.93s mem 15.6GB +[2026-09-13 19:22:47] step 2174/5000 loss 0.0963 (w 0.1620 mse 0.1509 t 984 new 0.22) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 19:22:53] step 2175/5000 loss 0.1021 (w 0.0594 mse 0.0600 t 921 new 0.12) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 19:22:59] step 2176/5000 loss 0.0717 (w 0.1102 mse 0.1080 t 976 new 0.30) lr 1.00e-05 gnorm 0.059 5.92s mem 15.6GB +[2026-09-13 19:23:04] step 2177/5000 loss 0.1412 (w 0.1624 mse 0.1486 t 977 new 0.23) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 19:23:10] step 2178/5000 loss 0.0826 (w 0.0639 mse 0.0628 t 563 new 0.25) lr 1.00e-05 gnorm 0.076 5.85s mem 15.6GB +[2026-09-13 19:23:16] step 2179/5000 loss 0.0749 (w 0.0966 mse 0.0969 t 963 new 0.25) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 19:23:22] step 2180/5000 loss 0.0959 (w 0.0612 mse 0.0665 t 960 new 0.18) lr 1.00e-05 gnorm 0.061 5.80s mem 15.6GB +[2026-09-13 19:23:27] step 2181/5000 loss 0.1234 (w 0.2197 mse 0.2138 t 252 new 0.18) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 19:23:33] step 2182/5000 loss 0.0780 (w 0.5499 mse 0.5558 t 62 new 0.18) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 19:23:39] step 2183/5000 loss 0.0966 (w 0.0649 mse 0.0614 t 845 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 19:23:45] step 2184/5000 loss 0.0500 (w 0.1644 mse 0.1669 t 977 new 0.17) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 19:23:50] step 2185/5000 loss 0.0621 (w 0.0484 mse 0.0481 t 808 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:23:56] step 2186/5000 loss 0.0990 (w 0.0669 mse 0.0640 t 881 new 0.14) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +[2026-09-13 19:24:02] step 2187/5000 loss 0.0911 (w 0.0938 mse 0.0903 t 862 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 19:24:07] step 2188/5000 loss 0.1145 (w 0.0638 mse 0.0659 t 953 new 0.29) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 19:24:13] step 2189/5000 loss 0.0879 (w 0.0860 mse 0.0825 t 438 new 0.28) lr 1.00e-05 gnorm 0.103 5.70s mem 15.6GB +[2026-09-13 19:24:19] step 2190/5000 loss 0.1147 (w 0.1657 mse 0.1635 t 232 new 0.22) lr 1.00e-05 gnorm 0.066 5.93s mem 15.6GB +[2026-09-13 19:24:25] step 2191/5000 loss 0.0804 (w 0.0836 mse 0.0809 t 833 new 0.27) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 19:24:31] step 2192/5000 loss 0.0634 (w 0.0706 mse 0.0639 t 694 new 0.26) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 19:24:36] step 2193/5000 loss 0.1271 (w 0.1229 mse 0.1206 t 518 new 0.26) lr 1.00e-05 gnorm 0.105 5.69s mem 15.6GB +[2026-09-13 19:24:42] step 2194/5000 loss 0.0603 (w 0.0718 mse 0.0737 t 943 new 0.08) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 19:24:48] step 2195/5000 loss 0.1345 (w 0.0564 mse 0.0588 t 770 new 0.24) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 19:24:54] step 2196/5000 loss 0.0341 (w 0.0936 mse 0.0976 t 969 new 0.28) lr 1.00e-05 gnorm 0.057 5.89s mem 15.6GB +[2026-09-13 19:24:59] step 2197/5000 loss 0.1067 (w 0.0717 mse 0.0643 t 802 new 0.22) lr 1.00e-05 gnorm 0.083 5.89s mem 15.6GB +[2026-09-13 19:25:05] step 2198/5000 loss 0.0475 (w 0.1945 mse 0.1718 t 981 new 0.27) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 19:25:11] step 2199/5000 loss 0.0786 (w 0.0890 mse 0.0903 t 894 new 0.18) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 19:25:17] step 2200/5000 loss 0.0878 (w 0.0660 mse 0.0692 t 918 new 0.20) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 19:25:22] step 2201/5000 loss 0.0975 (w 0.0672 mse 0.0619 t 892 new 0.22) lr 1.00e-05 gnorm 0.089 5.70s mem 15.6GB +[2026-09-13 19:25:28] step 2202/5000 loss 0.0823 (w 0.0532 mse 0.0527 t 799 new 0.25) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +[2026-09-13 19:25:34] step 2203/5000 loss 0.0833 (w 0.0715 mse 0.0678 t 767 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 19:25:39] step 2204/5000 loss 0.0744 (w 0.0894 mse 0.0897 t 962 new 0.20) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 19:25:45] step 2205/5000 loss 0.1138 (w 0.0622 mse 0.0671 t 560 new 0.18) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 19:25:51] step 2206/5000 loss 0.0839 (w 0.0445 mse 0.0446 t 929 new 0.09) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 19:25:57] step 2207/5000 loss 0.0918 (w 0.0575 mse 0.0610 t 927 new 0.21) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:26:02] step 2208/5000 loss 0.0877 (w 0.0871 mse 0.0768 t 910 new 0.28) lr 1.00e-05 gnorm 0.073 5.91s mem 15.6GB +[2026-09-13 19:26:08] step 2209/5000 loss 0.0654 (w 0.0469 mse 0.0470 t 844 new 0.21) lr 1.00e-05 gnorm 0.082 5.75s mem 15.6GB +[2026-09-13 19:26:14] step 2210/5000 loss 0.0798 (w 0.1388 mse 0.1267 t 967 new 0.25) lr 1.00e-05 gnorm 0.052 6.13s mem 15.6GB +[2026-09-13 19:26:20] step 2211/5000 loss 0.1012 (w 0.0438 mse 0.0415 t 779 new 0.21) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 19:26:26] step 2212/5000 loss 0.1110 (w 0.0687 mse 0.0705 t 920 new 0.21) lr 1.00e-05 gnorm 0.087 5.70s mem 15.6GB +[2026-09-13 19:26:32] step 2213/5000 loss 0.0766 (w 0.0441 mse 0.0461 t 768 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 19:26:37] step 2214/5000 loss 0.1037 (w 0.1763 mse 0.1650 t 980 new 0.15) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 19:26:43] step 2215/5000 loss 0.1024 (w 0.1034 mse 0.1040 t 574 new 0.25) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 19:26:49] step 2216/5000 loss 0.0488 (w 0.1710 mse 0.1609 t 974 new 0.28) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 19:26:55] step 2217/5000 loss 0.0647 (w 0.0534 mse 0.0544 t 865 new 0.27) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 19:27:00] step 2218/5000 loss 0.0898 (w 0.1351 mse 0.1208 t 979 new 0.26) lr 1.00e-05 gnorm 0.048 5.68s mem 15.6GB +[2026-09-13 19:27:06] step 2219/5000 loss 0.1050 (w 0.0830 mse 0.0731 t 889 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 19:27:12] step 2220/5000 loss 0.1228 (w 0.0809 mse 0.0851 t 959 new 0.29) lr 1.00e-05 gnorm 0.081 5.92s mem 15.6GB +[2026-09-13 19:27:18] step 2221/5000 loss 0.0800 (w 0.1290 mse 0.1225 t 928 new 0.12) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 19:27:23] step 2222/5000 loss 0.0769 (w 0.0891 mse 0.0886 t 850 new 0.21) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 19:27:29] step 2223/5000 loss 0.0869 (w 0.0666 mse 0.0652 t 556 new 0.26) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 19:27:35] step 2224/5000 loss 0.0921 (w 0.5297 mse 0.5327 t 48 new 0.19) lr 1.00e-05 gnorm 0.057 5.75s mem 15.6GB +[2026-09-13 19:27:41] step 2225/5000 loss 0.0604 (w 0.0419 mse 0.0418 t 894 new 0.13) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 19:27:46] step 2226/5000 loss 0.0916 (w 0.1033 mse 0.0954 t 966 new 0.25) lr 1.00e-05 gnorm 0.104 5.68s mem 15.6GB +[2026-09-13 19:27:52] step 2227/5000 loss 0.1452 (w 0.0734 mse 0.0683 t 758 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 19:27:58] step 2228/5000 loss 0.1088 (w 0.0663 mse 0.0648 t 591 new 0.17) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 19:28:03] step 2229/5000 loss 0.0715 (w 0.2339 mse 0.2361 t 191 new 0.30) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 19:28:09] step 2230/5000 loss 0.0849 (w 0.0782 mse 0.0728 t 707 new 0.30) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 19:28:15] step 2231/5000 loss 0.1072 (w 0.0794 mse 0.0797 t 425 new 0.29) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:28:20] step 2232/5000 loss 0.0550 (w 0.1275 mse 0.1242 t 982 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:28:26] step 2233/5000 loss 0.1167 (w 0.1048 mse 0.1007 t 747 new 0.27) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 19:28:32] step 2234/5000 loss 0.0488 (w 0.1342 mse 0.1263 t 976 new 0.19) lr 1.00e-05 gnorm 0.076 5.83s mem 15.6GB +[2026-09-13 19:28:38] step 2235/5000 loss 0.1110 (w 0.1224 mse 0.1233 t 879 new 0.19) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 19:28:44] step 2236/5000 loss 0.1165 (w 0.0912 mse 0.0819 t 752 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 19:28:50] step 2237/5000 loss 0.1291 (w 0.0463 mse 0.0475 t 788 new 0.18) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 19:28:55] step 2238/5000 loss 0.0475 (w 0.2462 mse 0.2448 t 994 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 19:29:01] step 2239/5000 loss 0.0843 (w 0.0296 mse 0.0325 t 721 new 0.12) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 19:29:07] step 2240/5000 loss 0.0599 (w 0.1465 mse 0.1465 t 255 new 0.29) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 19:29:12] step 2241/5000 loss 0.0666 (w 0.0657 mse 0.0614 t 819 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 19:29:18] step 2242/5000 loss 0.0799 (w 0.0581 mse 0.0587 t 882 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 19:29:24] step 2243/5000 loss 0.0730 (w 0.1011 mse 0.0964 t 761 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 19:29:30] step 2244/5000 loss 0.1393 (w 0.1726 mse 0.1706 t 229 new 0.30) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +[2026-09-13 19:29:35] step 2245/5000 loss 0.0909 (w 0.0752 mse 0.0743 t 834 new 0.21) lr 1.00e-05 gnorm 0.077 5.79s mem 15.6GB +[2026-09-13 19:29:41] step 2246/5000 loss 0.0737 (w 0.0580 mse 0.0585 t 886 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 19:29:47] step 2247/5000 loss 0.1392 (w 0.0380 mse 0.0374 t 866 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 19:29:52] step 2248/5000 loss 0.0484 (w 0.0624 mse 0.0609 t 913 new 0.27) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 19:29:58] step 2249/5000 loss 0.1267 (w 0.0896 mse 0.0806 t 882 new 0.19) lr 1.00e-05 gnorm 0.124 5.69s mem 15.6GB +[2026-09-13 19:30:04] step 2250/5000 loss 0.0774 (w 0.0494 mse 0.0453 t 818 new 0.28) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:30:10] step 2251/5000 loss 0.0570 (w 0.1273 mse 0.1199 t 970 new 0.15) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +[2026-09-13 19:30:15] step 2252/5000 loss 0.0576 (w 0.0633 mse 0.0676 t 971 new 0.11) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +[2026-09-13 19:30:21] step 2253/5000 loss 0.0920 (w 0.0938 mse 0.0939 t 480 new 0.29) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 19:30:27] step 2254/5000 loss 0.1165 (w 0.0929 mse 0.0911 t 459 new 0.25) lr 1.00e-05 gnorm 0.100 5.74s mem 15.6GB +[2026-09-13 19:30:33] step 2255/5000 loss 0.1212 (w 0.0280 mse 0.0269 t 619 new 0.10) lr 1.00e-05 gnorm 0.124 5.95s mem 15.6GB +[2026-09-13 19:30:38] step 2256/5000 loss 0.1294 (w 0.0438 mse 0.0463 t 963 new 0.16) lr 1.00e-05 gnorm 0.063 5.71s mem 15.6GB +[2026-09-13 19:30:44] step 2257/5000 loss 0.0415 (w 0.0909 mse 0.0846 t 935 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 19:30:50] step 2258/5000 loss 0.0596 (w 0.0555 mse 0.0522 t 692 new 0.30) lr 1.00e-05 gnorm 0.101 5.89s mem 15.6GB +[2026-09-13 19:30:56] step 2259/5000 loss 0.1229 (w 0.0477 mse 0.0515 t 728 new 0.24) lr 1.00e-05 gnorm 0.102 5.69s mem 15.6GB +[2026-09-13 19:31:02] step 2260/5000 loss 0.0890 (w 0.1378 mse 0.1352 t 535 new 0.22) lr 1.00e-05 gnorm 0.057 5.81s mem 15.6GB +[2026-09-13 19:31:08] step 2261/5000 loss 0.0838 (w 0.0571 mse 0.0573 t 720 new 0.25) lr 1.00e-05 gnorm 0.075 5.89s mem 15.6GB +[2026-09-13 19:31:13] step 2262/5000 loss 0.0952 (w 0.0838 mse 0.0845 t 721 new 0.19) lr 1.00e-05 gnorm 0.120 5.68s mem 15.6GB +[2026-09-13 19:31:19] step 2263/5000 loss 0.0740 (w 0.1265 mse 0.1147 t 831 new 0.24) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 19:31:25] step 2264/5000 loss 0.1019 (w 0.0712 mse 0.0723 t 960 new 0.10) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 19:31:31] step 2265/5000 loss 0.0952 (w 0.2501 mse 0.2283 t 995 new 0.23) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 19:31:36] step 2266/5000 loss 0.0984 (w 0.2081 mse 0.2030 t 180 new 0.28) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 19:31:42] step 2267/5000 loss 0.1016 (w 0.0848 mse 0.0835 t 964 new 0.29) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 19:31:48] step 2268/5000 loss 0.1204 (w 0.0540 mse 0.0529 t 815 new 0.25) lr 1.00e-05 gnorm 0.062 5.73s mem 15.6GB +[2026-09-13 19:31:53] step 2269/5000 loss 0.0691 (w 0.1128 mse 0.1082 t 856 new 0.25) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 19:31:59] step 2270/5000 loss 0.1131 (w 0.0587 mse 0.0623 t 509 new 0.17) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 19:32:05] step 2271/5000 loss 0.1233 (w 0.0853 mse 0.0803 t 803 new 0.26) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 19:32:10] step 2272/5000 loss 0.0779 (w 0.1083 mse 0.1034 t 906 new 0.22) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 19:32:16] step 2273/5000 loss 0.1073 (w 0.1435 mse 0.1543 t 989 new 0.26) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 19:32:22] step 2274/5000 loss 0.0767 (w 0.0914 mse 0.0885 t 813 new 0.11) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 19:32:28] step 2275/5000 loss 0.0873 (w 0.0978 mse 0.0931 t 949 new 0.22) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 19:32:33] step 2276/5000 loss 0.0561 (w 0.2436 mse 0.2222 t 992 new 0.30) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 19:32:39] step 2277/5000 loss 0.1137 (w 0.2108 mse 0.2092 t 194 new 0.12) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 19:32:45] step 2278/5000 loss 0.0845 (w 0.0667 mse 0.0612 t 927 new 0.27) lr 1.00e-05 gnorm 0.108 5.69s mem 15.6GB +[2026-09-13 19:32:51] step 2279/5000 loss 0.0894 (w 0.1053 mse 0.1091 t 306 new 0.11) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 19:32:56] step 2280/5000 loss 0.0865 (w 0.0614 mse 0.0572 t 627 new 0.24) lr 1.00e-05 gnorm 0.069 5.67s mem 15.6GB +[2026-09-13 19:33:02] step 2281/5000 loss 0.0518 (w 0.2134 mse 0.2019 t 981 new 0.21) lr 1.00e-05 gnorm 0.100 5.69s mem 15.6GB +[2026-09-13 19:33:09] step 2282/5000 loss 0.0977 (w 0.1212 mse 0.1184 t 669 new 0.20) lr 1.00e-05 gnorm 0.065 6.60s mem 15.6GB +[2026-09-13 19:33:15] step 2283/5000 loss 0.1084 (w 0.1206 mse 0.1201 t 896 new 0.12) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 19:33:20] step 2284/5000 loss 0.0665 (w 0.1066 mse 0.1081 t 936 new 0.23) lr 1.00e-05 gnorm 0.114 5.70s mem 15.6GB +[2026-09-13 19:33:26] step 2285/5000 loss 0.0661 (w 0.0688 mse 0.0636 t 798 new 0.19) lr 1.00e-05 gnorm 0.080 5.70s mem 15.6GB +[2026-09-13 19:33:32] step 2286/5000 loss 0.1336 (w 0.2760 mse 0.2767 t 176 new 0.10) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +[2026-09-13 19:33:37] step 2287/5000 loss 0.0804 (w 0.1618 mse 0.1499 t 989 new 0.26) lr 1.00e-05 gnorm 0.098 5.70s mem 15.6GB +[2026-09-13 19:33:43] step 2288/5000 loss 0.0898 (w 0.0873 mse 0.0802 t 808 new 0.22) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 19:33:49] step 2289/5000 loss 0.1238 (w 0.0580 mse 0.0575 t 917 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 19:33:55] step 2290/5000 loss 0.1038 (w 0.1080 mse 0.1059 t 320 new 0.22) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:34:00] step 2291/5000 loss 0.1044 (w 0.1498 mse 0.1430 t 987 new 0.17) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 19:34:06] step 2292/5000 loss 0.0861 (w 0.0881 mse 0.0843 t 757 new 0.22) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +[2026-09-13 19:34:12] step 2293/5000 loss 0.0665 (w 0.3804 mse 0.3498 t 999 new 0.22) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 19:34:18] step 2294/5000 loss 0.1087 (w 0.1039 mse 0.0954 t 434 new 0.21) lr 1.00e-05 gnorm 0.068 5.89s mem 15.6GB +[2026-09-13 19:34:23] step 2295/5000 loss 0.0680 (w 0.0776 mse 0.0875 t 923 new 0.19) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 19:34:29] step 2296/5000 loss 0.0731 (w 0.1408 mse 0.1408 t 970 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 19:34:35] step 2297/5000 loss 0.0896 (w 0.0902 mse 0.0885 t 624 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 19:34:41] step 2298/5000 loss 0.0857 (w 0.0736 mse 0.0692 t 841 new 0.27) lr 1.00e-05 gnorm 0.073 5.90s mem 15.6GB +[2026-09-13 19:34:47] step 2299/5000 loss 0.1114 (w 0.0977 mse 0.1054 t 372 new 0.31) lr 1.00e-05 gnorm 0.073 5.84s mem 15.6GB +[2026-09-13 19:34:52] step 2300/5000 loss 0.0801 (w 0.2063 mse 0.1922 t 993 new 0.22) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 19:34:58] step 2301/5000 loss 0.0666 (w 0.1035 mse 0.0992 t 836 new 0.31) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:35:04] step 2302/5000 loss 0.1096 (w 0.0939 mse 0.0891 t 913 new 0.23) lr 1.00e-05 gnorm 0.064 5.92s mem 15.6GB +[2026-09-13 19:35:10] step 2303/5000 loss 0.1140 (w 0.1094 mse 0.1077 t 334 new 0.25) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 19:35:15] step 2304/5000 loss 0.1446 (w 0.1765 mse 0.1719 t 360 new 0.10) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 19:35:21] step 2305/5000 loss 0.0786 (w 0.0848 mse 0.0831 t 706 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:35:27] step 2306/5000 loss 0.0952 (w 0.0427 mse 0.0422 t 833 new 0.13) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 19:35:32] step 2307/5000 loss 0.0704 (w 0.0841 mse 0.0808 t 930 new 0.25) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 19:35:38] step 2308/5000 loss 0.0911 (w 0.0933 mse 0.0894 t 839 new 0.12) lr 1.00e-05 gnorm 0.083 5.76s mem 15.6GB +[2026-09-13 19:35:44] step 2309/5000 loss 0.0670 (w 0.0667 mse 0.0694 t 845 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 19:35:50] step 2310/5000 loss 0.0814 (w 0.1172 mse 0.1239 t 414 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 19:35:55] step 2311/5000 loss 0.1163 (w 0.0936 mse 0.0941 t 493 new 0.24) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 19:36:01] step 2312/5000 loss 0.0731 (w 0.1050 mse 0.0998 t 849 new 0.24) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 19:36:07] step 2313/5000 loss 0.0831 (w 0.1370 mse 0.1334 t 933 new 0.15) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 19:36:12] step 2314/5000 loss 0.0582 (w 0.0802 mse 0.0771 t 904 new 0.17) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:36:18] step 2315/5000 loss 0.1265 (w 0.1645 mse 0.1647 t 347 new 0.18) lr 1.00e-05 gnorm 0.094 5.68s mem 15.6GB +[2026-09-13 19:36:24] step 2316/5000 loss 0.0748 (w 0.0715 mse 0.0714 t 563 new 0.29) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 19:36:30] step 2317/5000 loss 0.1324 (w 0.2093 mse 0.1929 t 986 new 0.16) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 19:36:35] step 2318/5000 loss 0.1126 (w 0.1541 mse 0.1552 t 965 new 0.22) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 19:36:41] step 2319/5000 loss 0.0722 (w 0.0975 mse 0.0928 t 872 new 0.26) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 19:36:47] step 2320/5000 loss 0.0930 (w 0.0553 mse 0.0580 t 789 new 0.22) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 19:36:53] step 2321/5000 loss 0.0896 (w 0.0450 mse 0.0472 t 786 new 0.25) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 19:36:58] step 2322/5000 loss 0.0419 (w 0.1059 mse 0.0933 t 945 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 19:37:04] step 2323/5000 loss 0.0786 (w 0.0835 mse 0.0819 t 940 new 0.20) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 19:37:10] step 2324/5000 loss 0.1041 (w 0.1000 mse 0.0984 t 490 new 0.20) lr 1.00e-05 gnorm 0.078 5.91s mem 15.6GB +[2026-09-13 19:37:16] step 2325/5000 loss 0.0747 (w 0.1713 mse 0.1608 t 964 new 0.26) lr 1.00e-05 gnorm 0.069 5.77s mem 15.6GB +[2026-09-13 19:37:21] step 2326/5000 loss 0.1434 (w 0.0733 mse 0.0702 t 702 new 0.16) lr 1.00e-05 gnorm 0.105 5.70s mem 15.6GB +[2026-09-13 19:37:27] step 2327/5000 loss 0.1576 (w 0.2457 mse 0.2489 t 157 new 0.17) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:37:33] step 2328/5000 loss 0.0836 (w 0.0943 mse 0.0920 t 885 new 0.20) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 19:37:39] step 2329/5000 loss 0.0849 (w 0.2011 mse 0.1838 t 989 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 19:37:44] step 2330/5000 loss 0.0996 (w 0.1006 mse 0.0953 t 788 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 19:37:50] step 2331/5000 loss 0.0782 (w 0.0495 mse 0.0476 t 779 new 0.08) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +[2026-09-13 19:37:56] step 2332/5000 loss 0.0864 (w 0.0955 mse 0.0948 t 637 new 0.25) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +[2026-09-13 19:38:01] step 2333/5000 loss 0.0852 (w 0.0788 mse 0.0704 t 822 new 0.18) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 19:38:07] step 2334/5000 loss 0.0952 (w 0.1246 mse 0.1224 t 352 new 0.20) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +[2026-09-13 19:38:13] step 2335/5000 loss 0.0738 (w 0.0914 mse 0.0903 t 904 new 0.21) lr 1.00e-05 gnorm 0.086 5.71s mem 15.6GB +[2026-09-13 19:38:19] step 2336/5000 loss 0.0798 (w 0.1008 mse 0.1014 t 772 new 0.13) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 19:38:24] step 2337/5000 loss 0.0788 (w 0.1328 mse 0.1294 t 955 new 0.16) lr 1.00e-05 gnorm 0.086 5.71s mem 15.6GB +[2026-09-13 19:38:30] step 2338/5000 loss 0.1093 (w 0.0883 mse 0.0858 t 453 new 0.27) lr 1.00e-05 gnorm 0.104 5.71s mem 15.6GB +[2026-09-13 19:38:36] step 2339/5000 loss 0.0676 (w 0.1009 mse 0.0935 t 572 new 0.25) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 19:38:42] step 2340/5000 loss 0.0777 (w 0.0859 mse 0.0779 t 922 new 0.24) lr 1.00e-05 gnorm 0.101 5.70s mem 15.6GB +[2026-09-13 19:38:47] step 2341/5000 loss 0.1073 (w 0.0446 mse 0.0447 t 817 new 0.17) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 19:38:53] step 2342/5000 loss 0.0736 (w 0.1557 mse 0.1532 t 965 new 0.23) lr 1.00e-05 gnorm 0.049 5.80s mem 15.6GB +[2026-09-13 19:38:59] step 2343/5000 loss 0.1079 (w 0.0630 mse 0.0633 t 798 new 0.21) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +[2026-09-13 19:39:05] step 2344/5000 loss 0.1097 (w 0.0761 mse 0.0727 t 866 new 0.18) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 19:39:11] step 2345/5000 loss 0.0749 (w 0.0596 mse 0.0585 t 840 new 0.15) lr 1.00e-05 gnorm 0.058 6.03s mem 15.6GB +[2026-09-13 19:39:16] step 2346/5000 loss 0.0654 (w 0.1001 mse 0.1012 t 828 new 0.27) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 19:39:22] step 2347/5000 loss 0.1022 (w 0.2410 mse 0.2419 t 134 new 0.28) lr 1.00e-05 gnorm 0.142 5.69s mem 15.6GB +[2026-09-13 19:39:28] step 2348/5000 loss 0.1169 (w 0.1210 mse 0.1307 t 520 new 0.20) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +[2026-09-13 19:39:33] step 2349/5000 loss 0.0637 (w 0.0425 mse 0.0465 t 877 new 0.27) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 19:39:39] step 2350/5000 loss 0.0643 (w 0.0594 mse 0.0573 t 803 new 0.22) lr 1.00e-05 gnorm 0.086 5.71s mem 15.6GB +[2026-09-13 19:39:45] step 2351/5000 loss 0.1089 (w 0.1603 mse 0.1455 t 986 new 0.22) lr 1.00e-05 gnorm 0.122 5.69s mem 15.6GB +[2026-09-13 19:39:51] step 2352/5000 loss 0.0970 (w 0.0648 mse 0.0634 t 832 new 0.28) lr 1.00e-05 gnorm 0.069 5.94s mem 15.6GB +[2026-09-13 19:39:57] step 2353/5000 loss 0.0793 (w 0.0748 mse 0.0724 t 830 new 0.23) lr 1.00e-05 gnorm 0.108 5.70s mem 15.6GB +[2026-09-13 19:40:02] step 2354/5000 loss 0.0755 (w 0.1204 mse 0.1185 t 461 new 0.13) lr 1.00e-05 gnorm 0.086 5.70s mem 15.6GB +[2026-09-13 19:40:08] step 2355/5000 loss 0.0950 (w 0.0700 mse 0.0668 t 532 new 0.19) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:40:14] step 2356/5000 loss 0.0675 (w 0.0721 mse 0.0723 t 854 new 0.26) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 19:40:19] step 2357/5000 loss 0.1299 (w 0.1929 mse 0.1978 t 130 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 19:40:25] step 2358/5000 loss 0.0656 (w 0.1743 mse 0.1605 t 993 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 19:40:31] step 2359/5000 loss 0.1170 (w 0.1207 mse 0.1238 t 267 new 0.11) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 19:40:36] step 2360/5000 loss 0.0728 (w 0.0829 mse 0.0775 t 771 new 0.17) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 19:40:42] step 2361/5000 loss 0.0727 (w 0.0571 mse 0.0543 t 598 new 0.11) lr 1.00e-05 gnorm 0.050 5.71s mem 15.6GB +[2026-09-13 19:40:48] step 2362/5000 loss 0.0779 (w 0.0951 mse 0.0870 t 955 new 0.26) lr 1.00e-05 gnorm 0.069 5.87s mem 15.6GB +[2026-09-13 19:40:54] step 2363/5000 loss 0.0953 (w 0.0527 mse 0.0519 t 655 new 0.17) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 19:41:00] step 2364/5000 loss 0.0568 (w 0.0567 mse 0.0538 t 830 new 0.20) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 19:41:05] step 2365/5000 loss 0.0842 (w 0.0708 mse 0.0758 t 964 new 0.18) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 19:41:11] step 2366/5000 loss 0.1307 (w 0.0787 mse 0.0716 t 950 new 0.27) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 19:41:17] step 2367/5000 loss 0.0737 (w 0.0713 mse 0.0695 t 877 new 0.21) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 19:41:22] step 2368/5000 loss 0.0573 (w 0.0618 mse 0.0604 t 870 new 0.27) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +[2026-09-13 19:41:28] step 2369/5000 loss 0.1054 (w 0.0716 mse 0.0653 t 856 new 0.20) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 19:41:34] step 2370/5000 loss 0.0865 (w 0.0821 mse 0.0797 t 831 new 0.30) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 19:41:39] step 2371/5000 loss 0.1053 (w 0.0652 mse 0.0630 t 607 new 0.15) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 19:41:45] step 2372/5000 loss 0.0846 (w 0.0250 mse 0.0262 t 933 new 0.13) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 19:41:51] step 2373/5000 loss 0.1243 (w 0.0490 mse 0.0480 t 847 new 0.28) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 19:41:57] step 2374/5000 loss 0.1504 (w 0.4754 mse 0.4780 t 53 new 0.24) lr 1.00e-05 gnorm 0.053 5.91s mem 15.6GB +[2026-09-13 19:42:02] step 2375/5000 loss 0.0647 (w 0.6706 mse 0.6776 t 29 new 0.14) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 19:42:08] step 2376/5000 loss 0.0731 (w 0.0973 mse 0.0987 t 965 new 0.27) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 19:42:14] step 2377/5000 loss 0.0840 (w 0.1306 mse 0.1269 t 989 new 0.25) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 19:42:20] step 2378/5000 loss 0.0340 (w 0.1197 mse 0.1095 t 924 new 0.26) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:42:25] step 2379/5000 loss 0.1386 (w 0.0474 mse 0.0473 t 812 new 0.29) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 19:42:31] step 2380/5000 loss 0.0756 (w 0.0606 mse 0.0652 t 942 new 0.30) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 19:42:37] step 2381/5000 loss 0.0655 (w 0.0363 mse 0.0416 t 412 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 19:42:42] step 2382/5000 loss 0.0859 (w 0.0885 mse 0.0856 t 901 new 0.18) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:42:48] step 2383/5000 loss 0.0821 (w 0.0984 mse 0.0956 t 922 new 0.12) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 19:42:54] step 2384/5000 loss 0.0966 (w 0.0857 mse 0.0768 t 895 new 0.21) lr 1.00e-05 gnorm 0.071 5.97s mem 15.6GB +[2026-09-13 19:43:00] step 2385/5000 loss 0.1069 (w 0.0963 mse 0.0886 t 575 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 19:43:05] step 2386/5000 loss 0.0552 (w 0.0234 mse 0.0246 t 850 new 0.10) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 19:43:11] step 2387/5000 loss 0.0926 (w 0.0759 mse 0.0782 t 960 new 0.23) lr 1.00e-05 gnorm 0.075 5.79s mem 15.6GB +[2026-09-13 19:43:17] step 2388/5000 loss 0.0804 (w 0.0890 mse 0.0831 t 958 new 0.27) lr 1.00e-05 gnorm 0.073 5.79s mem 15.6GB +[2026-09-13 19:43:23] step 2389/5000 loss 0.1159 (w 0.0963 mse 0.0951 t 463 new 0.24) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 19:43:28] step 2390/5000 loss 0.0826 (w 0.0863 mse 0.0805 t 814 new 0.24) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 19:43:34] step 2391/5000 loss 0.0860 (w 0.1461 mse 0.1489 t 288 new 0.15) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 19:43:40] step 2392/5000 loss 0.0955 (w 0.0850 mse 0.0812 t 941 new 0.18) lr 1.00e-05 gnorm 0.075 5.85s mem 15.6GB +[2026-09-13 19:43:46] step 2393/5000 loss 0.0964 (w 0.1066 mse 0.1006 t 817 new 0.27) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 19:43:51] step 2394/5000 loss 0.0969 (w 0.0952 mse 0.0986 t 492 new 0.25) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 19:43:57] step 2395/5000 loss 0.1304 (w 0.0620 mse 0.0631 t 612 new 0.23) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 19:44:03] step 2396/5000 loss 0.0596 (w 0.1058 mse 0.1030 t 792 new 0.22) lr 1.00e-05 gnorm 0.274 5.69s mem 15.6GB +[2026-09-13 19:44:09] step 2397/5000 loss 0.0785 (w 0.1247 mse 0.1241 t 992 new 0.12) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 19:44:15] step 2398/5000 loss 0.0974 (w 0.0900 mse 0.0926 t 486 new 0.15) lr 1.00e-05 gnorm 0.072 5.93s mem 15.6GB +[2026-09-13 19:44:20] step 2399/5000 loss 0.0633 (w 0.0731 mse 0.0677 t 868 new 0.21) lr 1.00e-05 gnorm 0.120 5.68s mem 15.6GB +[2026-09-13 19:44:26] step 2400/5000 loss 0.0755 (w 0.0857 mse 0.0830 t 885 new 0.23) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 19:44:32] step 2401/5000 loss 0.1076 (w 0.0449 mse 0.0452 t 905 new 0.13) lr 1.00e-05 gnorm 0.102 5.70s mem 15.6GB +[2026-09-13 19:44:37] step 2402/5000 loss 0.0657 (w 0.2198 mse 0.2232 t 993 new 0.10) lr 1.00e-05 gnorm 0.135 5.69s mem 15.6GB +[2026-09-13 19:44:43] step 2403/5000 loss 0.0884 (w 0.0951 mse 0.0905 t 412 new 0.22) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 19:44:49] step 2404/5000 loss 0.1020 (w 0.1512 mse 0.1454 t 291 new 0.26) lr 1.00e-05 gnorm 0.097 5.76s mem 15.6GB +[2026-09-13 19:44:55] step 2405/5000 loss 0.0872 (w 0.0572 mse 0.0554 t 730 new 0.21) lr 1.00e-05 gnorm 0.084 5.75s mem 15.6GB +[2026-09-13 19:45:00] step 2406/5000 loss 0.1410 (w 0.0818 mse 0.0786 t 878 new 0.21) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 19:45:06] step 2407/5000 loss 0.0883 (w 0.1294 mse 0.1177 t 932 new 0.25) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 19:45:12] step 2408/5000 loss 0.0844 (w 0.0796 mse 0.0745 t 506 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 19:45:18] step 2409/5000 loss 0.1092 (w 0.0810 mse 0.0773 t 765 new 0.12) lr 1.00e-05 gnorm 0.096 5.86s mem 15.6GB +[2026-09-13 19:45:23] step 2410/5000 loss 0.0881 (w 0.0958 mse 0.0907 t 630 new 0.28) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +[2026-09-13 19:45:29] step 2411/5000 loss 0.0949 (w 0.0419 mse 0.0457 t 713 new 0.19) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 19:45:35] step 2412/5000 loss 0.1009 (w 0.1230 mse 0.1192 t 660 new 0.25) lr 1.00e-05 gnorm 0.085 5.70s mem 15.6GB +[2026-09-13 19:45:40] step 2413/5000 loss 0.0941 (w 0.0382 mse 0.0363 t 617 new 0.16) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 19:45:46] step 2414/5000 loss 0.0668 (w 0.0749 mse 0.0710 t 887 new 0.26) lr 1.00e-05 gnorm 0.056 5.91s mem 15.6GB +[2026-09-13 19:45:52] step 2415/5000 loss 0.0846 (w 0.0653 mse 0.0707 t 280 new 0.11) lr 1.00e-05 gnorm 0.082 5.92s mem 15.6GB +[2026-09-13 19:45:58] step 2416/5000 loss 0.0835 (w 0.0674 mse 0.0647 t 908 new 0.27) lr 1.00e-05 gnorm 0.066 5.67s mem 15.6GB +[2026-09-13 19:46:04] step 2417/5000 loss 0.0926 (w 0.1690 mse 0.1525 t 981 new 0.27) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 19:46:09] step 2418/5000 loss 0.0673 (w 0.0745 mse 0.0766 t 928 new 0.24) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 19:46:15] step 2419/5000 loss 0.0707 (w 0.0530 mse 0.0570 t 835 new 0.21) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 19:46:21] step 2420/5000 loss 0.0627 (w 0.1723 mse 0.1669 t 968 new 0.23) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 19:46:26] step 2421/5000 loss 0.0735 (w 0.1310 mse 0.1200 t 958 new 0.22) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 19:46:32] step 2422/5000 loss 0.0769 (w 0.1118 mse 0.1115 t 964 new 0.20) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 19:46:38] step 2423/5000 loss 0.0462 (w 0.0696 mse 0.0670 t 506 new 0.21) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 19:46:44] step 2424/5000 loss 0.1149 (w 0.1107 mse 0.1062 t 893 new 0.21) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 19:46:49] step 2425/5000 loss 0.0422 (w 0.0442 mse 0.0415 t 849 new 0.08) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:46:55] step 2426/5000 loss 0.0800 (w 0.1049 mse 0.0999 t 692 new 0.24) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 19:47:01] step 2427/5000 loss 0.0776 (w 0.0698 mse 0.0663 t 783 new 0.14) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 19:47:07] step 2428/5000 loss 0.1374 (w 0.0757 mse 0.0738 t 625 new 0.24) lr 1.00e-05 gnorm 0.075 5.89s mem 15.6GB +[2026-09-13 19:47:12] step 2429/5000 loss 0.0993 (w 0.0927 mse 0.0912 t 899 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 19:47:18] step 2430/5000 loss 0.0792 (w 0.1326 mse 0.1202 t 931 new 0.25) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 19:47:24] step 2431/5000 loss 0.1246 (w 0.0861 mse 0.0829 t 900 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:47:29] step 2432/5000 loss 0.0972 (w 0.0591 mse 0.0570 t 817 new 0.21) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 19:47:35] step 2433/5000 loss 0.1151 (w 0.0458 mse 0.0442 t 604 new 0.21) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 19:47:41] step 2434/5000 loss 0.0830 (w 0.0668 mse 0.0642 t 794 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 19:47:47] step 2435/5000 loss 0.1153 (w 0.2719 mse 0.2590 t 165 new 0.30) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 19:47:53] step 2436/5000 loss 0.0559 (w 0.1057 mse 0.1041 t 944 new 0.23) lr 1.00e-05 gnorm 0.056 6.29s mem 15.6GB +[2026-09-13 19:47:59] step 2437/5000 loss 0.1167 (w 0.0904 mse 0.0872 t 777 new 0.21) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 19:48:04] step 2438/5000 loss 0.0959 (w 0.0754 mse 0.0700 t 827 new 0.23) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 19:48:10] step 2439/5000 loss 0.0852 (w 0.0954 mse 0.0861 t 858 new 0.26) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 19:48:16] step 2440/5000 loss 0.0659 (w 0.0843 mse 0.0777 t 906 new 0.26) lr 1.00e-05 gnorm 0.074 5.89s mem 15.6GB +[2026-09-13 19:48:22] step 2441/5000 loss 0.0994 (w 0.0864 mse 0.0811 t 948 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 19:48:27] step 2442/5000 loss 0.1011 (w 0.2340 mse 0.2096 t 999 new 0.23) lr 1.00e-05 gnorm 0.064 5.83s mem 15.6GB +[2026-09-13 19:48:33] step 2443/5000 loss 0.0609 (w 0.0551 mse 0.0552 t 935 new 0.12) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 19:48:39] step 2444/5000 loss 0.1010 (w 0.0710 mse 0.0714 t 796 new 0.27) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 19:48:44] step 2445/5000 loss 0.0749 (w 0.0621 mse 0.0633 t 697 new 0.29) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 19:48:50] step 2446/5000 loss 0.1153 (w 0.0833 mse 0.0849 t 833 new 0.17) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 19:48:56] step 2447/5000 loss 0.0730 (w 0.0855 mse 0.0839 t 937 new 0.23) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +[2026-09-13 19:49:02] step 2448/5000 loss 0.0831 (w 0.4020 mse 0.4259 t 66 new 0.24) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 19:49:07] step 2449/5000 loss 0.0776 (w 0.0797 mse 0.0735 t 781 new 0.21) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 19:49:13] step 2450/5000 loss 0.0539 (w 0.0842 mse 0.0816 t 921 new 0.18) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 19:49:19] step 2451/5000 loss 0.0654 (w 0.0886 mse 0.0971 t 273 new 0.22) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 19:49:24] step 2452/5000 loss 0.1182 (w 0.0850 mse 0.0790 t 530 new 0.20) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 19:49:30] step 2453/5000 loss 0.1038 (w 0.0710 mse 0.0690 t 887 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:49:36] step 2454/5000 loss 0.0847 (w 0.1538 mse 0.1449 t 947 new 0.28) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 19:49:42] step 2455/5000 loss 0.1371 (w 0.2079 mse 0.2072 t 239 new 0.10) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 19:49:47] step 2456/5000 loss 0.1160 (w 0.0983 mse 0.0986 t 826 new 0.17) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:49:53] step 2457/5000 loss 0.1107 (w 0.0722 mse 0.0721 t 942 new 0.16) lr 1.00e-05 gnorm 0.062 6.14s mem 15.6GB +[2026-09-13 19:49:59] step 2458/5000 loss 0.1045 (w 0.1157 mse 0.1138 t 408 new 0.27) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 19:50:05] step 2459/5000 loss 0.1124 (w 0.0796 mse 0.0775 t 522 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:50:10] step 2460/5000 loss 0.0558 (w 0.0806 mse 0.0723 t 894 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:50:16] step 2461/5000 loss 0.0816 (w 0.0513 mse 0.0539 t 965 new 0.17) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 19:50:22] step 2462/5000 loss 0.0725 (w 0.0742 mse 0.0670 t 945 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 19:50:28] step 2463/5000 loss 0.0803 (w 0.0457 mse 0.0484 t 417 new 0.07) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 19:50:33] step 2464/5000 loss 0.0404 (w 0.0441 mse 0.0428 t 964 new 0.23) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 19:50:39] step 2465/5000 loss 0.1122 (w 0.1686 mse 0.1783 t 118 new 0.28) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 19:50:45] step 2466/5000 loss 0.0741 (w 0.0816 mse 0.0797 t 604 new 0.10) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 19:50:50] step 2467/5000 loss 0.0582 (w 0.0821 mse 0.0787 t 880 new 0.30) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 19:50:56] step 2468/5000 loss 0.0567 (w 0.1594 mse 0.1638 t 980 new 0.14) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 19:51:02] step 2469/5000 loss 0.1035 (w 0.0436 mse 0.0463 t 682 new 0.24) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 19:51:08] step 2470/5000 loss 0.1074 (w 0.1594 mse 0.1623 t 180 new 0.29) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 19:51:13] step 2471/5000 loss 0.0802 (w 0.0711 mse 0.0699 t 904 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:51:19] step 2472/5000 loss 0.0505 (w 0.0846 mse 0.0847 t 752 new 0.19) lr 1.00e-05 gnorm 0.064 5.94s mem 15.6GB +[2026-09-13 19:51:25] step 2473/5000 loss 0.1224 (w 0.0679 mse 0.0636 t 603 new 0.25) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 19:51:31] step 2474/5000 loss 0.0922 (w 0.2349 mse 0.2124 t 988 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:51:36] step 2475/5000 loss 0.0714 (w 0.1041 mse 0.0970 t 869 new 0.25) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 19:51:42] step 2476/5000 loss 0.1382 (w 0.0685 mse 0.0643 t 931 new 0.29) lr 1.00e-05 gnorm 0.075 5.92s mem 15.6GB +[2026-09-13 19:51:48] step 2477/5000 loss 0.0796 (w 0.1016 mse 0.0964 t 751 new 0.23) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 19:51:54] step 2478/5000 loss 0.0781 (w 0.0994 mse 0.0946 t 970 new 0.26) lr 1.00e-05 gnorm 0.085 6.06s mem 15.6GB +[2026-09-13 19:52:00] step 2479/5000 loss 0.0533 (w 0.1040 mse 0.0953 t 857 new 0.26) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 19:52:06] step 2480/5000 loss 0.0905 (w 0.0823 mse 0.0780 t 729 new 0.19) lr 1.00e-05 gnorm 0.058 5.80s mem 15.6GB +[2026-09-13 19:52:11] step 2481/5000 loss 0.1590 (w 0.0769 mse 0.0720 t 630 new 0.28) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 19:52:17] step 2482/5000 loss 0.1165 (w 0.0347 mse 0.0390 t 663 new 0.21) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 19:52:23] step 2483/5000 loss 0.1208 (w 0.0508 mse 0.0497 t 612 new 0.17) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 19:52:28] step 2484/5000 loss 0.0876 (w 0.0631 mse 0.0626 t 875 new 0.26) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 19:52:34] step 2485/5000 loss 0.0425 (w 0.0575 mse 0.0574 t 840 new 0.20) lr 1.00e-05 gnorm 0.086 5.71s mem 15.6GB +[2026-09-13 19:52:40] step 2486/5000 loss 0.0992 (w 0.0719 mse 0.0782 t 904 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 19:52:46] step 2487/5000 loss 0.1032 (w 0.0744 mse 0.0765 t 889 new 0.19) lr 1.00e-05 gnorm 0.103 5.73s mem 15.6GB +[2026-09-13 19:52:51] step 2488/5000 loss 0.0799 (w 0.0614 mse 0.0575 t 809 new 0.23) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 19:52:57] step 2489/5000 loss 0.1375 (w 0.1129 mse 0.1131 t 291 new 0.26) lr 1.00e-05 gnorm 0.073 5.71s mem 15.6GB +[2026-09-13 19:53:03] step 2490/5000 loss 0.1041 (w 0.0523 mse 0.0503 t 607 new 0.18) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 19:53:08] step 2491/5000 loss 0.0612 (w 0.0665 mse 0.0643 t 887 new 0.23) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 19:53:14] step 2492/5000 loss 0.0806 (w 0.1101 mse 0.1098 t 357 new 0.18) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 19:53:20] step 2493/5000 loss 0.0678 (w 0.1020 mse 0.0932 t 874 new 0.25) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 19:53:26] step 2494/5000 loss 0.0571 (w 0.0653 mse 0.0636 t 887 new 0.29) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:53:31] step 2495/5000 loss 0.1036 (w 0.0851 mse 0.0859 t 939 new 0.24) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 19:53:37] step 2496/5000 loss 0.0870 (w 0.0552 mse 0.0584 t 688 new 0.11) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 19:53:43] step 2497/5000 loss 0.0939 (w 0.0845 mse 0.0812 t 911 new 0.21) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 19:53:49] step 2498/5000 loss 0.0889 (w 0.0702 mse 0.0675 t 867 new 0.28) lr 1.00e-05 gnorm 0.068 5.82s mem 15.6GB +[2026-09-13 19:53:55] step 2499/5000 loss 0.0609 (w 0.1020 mse 0.0989 t 886 new 0.21) lr 1.00e-05 gnorm 0.052 5.90s mem 15.6GB +[2026-09-13 19:54:00] step 2500/5000 loss 0.0765 (w 0.0894 mse 0.0883 t 845 new 0.19) lr 1.00e-05 gnorm 0.061 5.78s mem 15.6GB +[2026-09-13 19:54:05] [val] step 2500 t=201: w=0.1754 mse=0.1778 (n=16) t=501: w=0.0728 mse=0.0727 (n=16) t=800: w=0.0612 mse=0.0600 (n=16) | mean w=0.1031 mse=0.1035 4s +[2026-09-13 19:54:08] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step2500.safetensors 832 个张量 2.87 GB +[2026-09-13 19:54:14] step 2501/5000 loss 0.0962 (w 0.0807 mse 0.0794 t 831 new 0.29) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 19:54:20] step 2502/5000 loss 0.0528 (w 0.0413 mse 0.0434 t 947 new 0.15) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 19:54:25] step 2503/5000 loss 0.0901 (w 0.1620 mse 0.1593 t 245 new 0.25) lr 1.00e-05 gnorm 0.049 5.89s mem 15.6GB +[2026-09-13 19:54:31] step 2504/5000 loss 0.0554 (w 0.1047 mse 0.0977 t 945 new 0.26) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 19:54:37] step 2505/5000 loss 0.0832 (w 0.0737 mse 0.0751 t 898 new 0.16) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 19:54:43] step 2506/5000 loss 0.0698 (w 0.1266 mse 0.1211 t 964 new 0.18) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 19:54:48] step 2507/5000 loss 0.1090 (w 0.0637 mse 0.0615 t 660 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 19:54:54] step 2508/5000 loss 0.1146 (w 0.1637 mse 0.1570 t 357 new 0.25) lr 1.00e-05 gnorm 0.096 5.88s mem 15.6GB +[2026-09-13 19:55:00] step 2509/5000 loss 0.0800 (w 0.0988 mse 0.0881 t 847 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 19:55:06] step 2510/5000 loss 0.1027 (w 0.0972 mse 0.1006 t 774 new 0.23) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +[2026-09-13 19:55:11] step 2511/5000 loss 0.0755 (w 0.0809 mse 0.0843 t 994 new 0.14) lr 1.00e-05 gnorm 0.069 5.76s mem 15.6GB +[2026-09-13 19:55:17] step 2512/5000 loss 0.0878 (w 0.0462 mse 0.0559 t 960 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 19:55:23] step 2513/5000 loss 0.0545 (w 0.0664 mse 0.0639 t 942 new 0.24) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 19:55:28] step 2514/5000 loss 0.1166 (w 0.3212 mse 0.3277 t 122 new 0.22) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 19:55:34] step 2515/5000 loss 0.1043 (w 0.0998 mse 0.0961 t 945 new 0.26) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 19:55:40] step 2516/5000 loss 0.0873 (w 0.0648 mse 0.0615 t 907 new 0.23) lr 1.00e-05 gnorm 0.049 5.71s mem 15.6GB +[2026-09-13 19:55:46] step 2517/5000 loss 0.1063 (w 0.0862 mse 0.0865 t 403 new 0.26) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 19:55:51] step 2518/5000 loss 0.0901 (w 0.2923 mse 0.2887 t 146 new 0.27) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 19:55:57] step 2519/5000 loss 0.1118 (w 0.1195 mse 0.1128 t 968 new 0.19) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 19:56:03] step 2520/5000 loss 0.0717 (w 0.0609 mse 0.0589 t 762 new 0.19) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 19:56:09] step 2521/5000 loss 0.0597 (w 0.0386 mse 0.0373 t 701 new 0.20) lr 1.00e-05 gnorm 0.060 5.95s mem 15.6GB +[2026-09-13 19:56:15] step 2522/5000 loss 0.1055 (w 0.0619 mse 0.0647 t 743 new 0.19) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 19:56:20] step 2523/5000 loss 0.0724 (w 0.0793 mse 0.0790 t 762 new 0.20) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 19:56:26] step 2524/5000 loss 0.0663 (w 0.0629 mse 0.0605 t 879 new 0.25) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 19:56:32] step 2525/5000 loss 0.1319 (w 0.0581 mse 0.0512 t 809 new 0.20) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 19:56:38] step 2526/5000 loss 0.0805 (w 0.0662 mse 0.0655 t 865 new 0.16) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 19:56:43] step 2527/5000 loss 0.0910 (w 0.2868 mse 0.2960 t 154 new 0.24) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 19:56:49] step 2528/5000 loss 0.1004 (w 0.0646 mse 0.0599 t 859 new 0.27) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 19:56:55] step 2529/5000 loss 0.0835 (w 0.1965 mse 0.1818 t 1000 new 0.22) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 19:57:01] step 2530/5000 loss 0.0334 (w 0.1126 mse 0.1062 t 962 new 0.25) lr 1.00e-05 gnorm 0.064 5.92s mem 15.6GB +[2026-09-13 19:57:06] step 2531/5000 loss 0.1200 (w 0.0599 mse 0.0591 t 612 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 19:57:12] step 2532/5000 loss 0.0897 (w 0.0639 mse 0.0638 t 638 new 0.24) lr 1.00e-05 gnorm 0.066 5.81s mem 15.6GB +[2026-09-13 19:57:18] step 2533/5000 loss 0.0893 (w 0.0821 mse 0.0788 t 640 new 0.19) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 19:57:24] step 2534/5000 loss 0.0719 (w 0.0489 mse 0.0475 t 813 new 0.26) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +[2026-09-13 19:57:29] step 2535/5000 loss 0.0774 (w 0.0760 mse 0.0756 t 527 new 0.27) lr 1.00e-05 gnorm 0.063 5.83s mem 15.6GB +[2026-09-13 19:57:35] step 2536/5000 loss 0.0722 (w 0.0776 mse 0.0767 t 916 new 0.17) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 19:57:41] step 2537/5000 loss 0.0932 (w 0.0745 mse 0.0686 t 896 new 0.22) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 19:57:47] step 2538/5000 loss 0.0796 (w 0.0824 mse 0.0775 t 901 new 0.27) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 19:57:52] step 2539/5000 loss 0.0508 (w 0.0735 mse 0.0648 t 908 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 19:57:58] step 2540/5000 loss 0.0954 (w 0.9835 mse 0.9826 t 10 new 0.21) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 19:58:04] step 2541/5000 loss 0.1125 (w 0.2478 mse 0.2478 t 134 new 0.32) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 19:58:09] step 2542/5000 loss 0.0331 (w 0.2084 mse 0.2146 t 983 new 0.24) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 19:58:15] step 2543/5000 loss 0.0706 (w 0.1191 mse 0.1138 t 934 new 0.27) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 19:58:21] step 2544/5000 loss 0.0723 (w 0.1111 mse 0.1033 t 908 new 0.26) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 19:58:26] step 2545/5000 loss 0.0875 (w 0.1145 mse 0.1102 t 941 new 0.15) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 19:58:32] step 2546/5000 loss 0.0885 (w 0.1553 mse 0.1528 t 490 new 0.30) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 19:58:38] step 2547/5000 loss 0.1179 (w 0.1207 mse 0.1135 t 693 new 0.24) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 19:58:44] step 2548/5000 loss 0.0755 (w 0.0792 mse 0.0755 t 859 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 19:58:49] step 2549/5000 loss 0.0977 (w 0.3388 mse 0.3368 t 105 new 0.13) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 19:58:55] step 2550/5000 loss 0.0543 (w 0.0990 mse 0.0899 t 892 new 0.21) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 19:59:01] step 2551/5000 loss 0.0811 (w 0.0742 mse 0.0698 t 473 new 0.25) lr 1.00e-05 gnorm 0.081 5.91s mem 15.6GB +[2026-09-13 19:59:07] step 2552/5000 loss 0.0860 (w 0.1229 mse 0.1172 t 970 new 0.19) lr 1.00e-05 gnorm 0.108 5.68s mem 15.6GB +[2026-09-13 19:59:12] step 2553/5000 loss 0.0942 (w 0.0620 mse 0.0636 t 905 new 0.20) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 19:59:18] step 2554/5000 loss 0.0652 (w 0.1356 mse 0.1276 t 936 new 0.25) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 19:59:24] step 2555/5000 loss 0.0962 (w 0.2736 mse 0.2836 t 66 new 0.13) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 19:59:30] step 2556/5000 loss 0.0648 (w 0.0577 mse 0.0552 t 859 new 0.27) lr 1.00e-05 gnorm 0.087 5.94s mem 15.6GB +[2026-09-13 19:59:35] step 2557/5000 loss 0.1238 (w 0.0395 mse 0.0386 t 779 new 0.20) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 19:59:41] step 2558/5000 loss 0.0835 (w 0.0935 mse 0.0979 t 581 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 19:59:47] step 2559/5000 loss 0.1197 (w 0.2885 mse 0.2857 t 134 new 0.25) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 19:59:52] step 2560/5000 loss 0.1038 (w 0.1276 mse 0.1363 t 993 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 19:59:58] step 2561/5000 loss 0.0800 (w 0.1079 mse 0.1077 t 873 new 0.18) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 20:00:04] step 2562/5000 loss 0.0898 (w 0.1492 mse 0.1527 t 219 new 0.20) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 20:00:10] step 2563/5000 loss 0.0649 (w 0.0685 mse 0.0651 t 923 new 0.16) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 20:00:15] step 2564/5000 loss 0.0894 (w 0.0372 mse 0.0387 t 781 new 0.10) lr 1.00e-05 gnorm 0.068 5.90s mem 15.6GB +[2026-09-13 20:00:21] step 2565/5000 loss 0.0524 (w 0.0615 mse 0.0625 t 686 new 0.10) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 20:00:27] step 2566/5000 loss 0.1210 (w 0.0908 mse 0.0890 t 667 new 0.21) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 20:00:33] step 2567/5000 loss 0.0869 (w 0.0993 mse 0.0960 t 898 new 0.22) lr 1.00e-05 gnorm 0.070 5.72s mem 15.6GB +[2026-09-13 20:00:38] step 2568/5000 loss 0.0563 (w 0.1200 mse 0.1176 t 984 new 0.30) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +[2026-09-13 20:00:44] step 2569/5000 loss 0.0820 (w 0.0692 mse 0.0688 t 814 new 0.15) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 20:00:50] step 2570/5000 loss 0.0827 (w 0.1016 mse 0.0984 t 331 new 0.23) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 20:00:55] step 2571/5000 loss 0.1208 (w 0.1260 mse 0.1255 t 306 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 20:01:01] step 2572/5000 loss 0.0701 (w 0.0666 mse 0.0627 t 879 new 0.18) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 20:01:07] step 2573/5000 loss 0.1134 (w 0.0711 mse 0.0715 t 847 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 20:01:13] step 2574/5000 loss 0.0301 (w 0.1346 mse 0.1276 t 982 new 0.18) lr 1.00e-05 gnorm 0.055 5.91s mem 15.6GB +[2026-09-13 20:01:18] step 2575/5000 loss 0.1210 (w 0.1226 mse 0.1247 t 235 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:01:24] step 2576/5000 loss 0.1247 (w 0.1676 mse 0.1624 t 328 new 0.20) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 20:01:30] step 2577/5000 loss 0.0453 (w 0.0625 mse 0.0565 t 904 new 0.21) lr 1.00e-05 gnorm 0.054 5.92s mem 15.6GB +[2026-09-13 20:01:36] step 2578/5000 loss 0.0538 (w 0.0411 mse 0.0414 t 733 new 0.27) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 20:01:42] step 2579/5000 loss 0.0418 (w 0.1446 mse 0.1329 t 982 new 0.27) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 20:01:47] step 2580/5000 loss 0.0898 (w 0.0767 mse 0.0708 t 616 new 0.24) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 20:01:53] step 2581/5000 loss 0.1291 (w 0.0622 mse 0.0613 t 578 new 0.21) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 20:01:59] step 2582/5000 loss 0.1289 (w 0.0860 mse 0.0773 t 812 new 0.29) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 20:02:04] step 2583/5000 loss 0.1020 (w 0.1070 mse 0.0999 t 771 new 0.29) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 20:02:10] step 2584/5000 loss 0.0603 (w 0.0897 mse 0.0859 t 911 new 0.18) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 20:02:16] step 2585/5000 loss 0.0943 (w 0.0498 mse 0.0480 t 791 new 0.21) lr 1.00e-05 gnorm 0.075 6.02s mem 15.6GB +[2026-09-13 20:02:22] step 2586/5000 loss 0.0649 (w 0.1041 mse 0.1006 t 579 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 20:02:27] step 2587/5000 loss 0.0691 (w 0.0902 mse 0.0867 t 785 new 0.19) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 20:02:33] step 2588/5000 loss 0.1131 (w 0.1606 mse 0.1692 t 403 new 0.18) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:02:39] step 2589/5000 loss 0.0892 (w 0.0885 mse 0.0890 t 634 new 0.14) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:02:45] step 2590/5000 loss 0.1109 (w 0.2231 mse 0.1925 t 997 new 0.32) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 20:02:50] step 2591/5000 loss 0.0429 (w 0.1198 mse 0.1176 t 959 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:02:56] step 2592/5000 loss 0.0770 (w 0.0930 mse 0.0925 t 861 new 0.27) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:03:02] step 2593/5000 loss 0.1463 (w 0.0886 mse 0.0878 t 948 new 0.24) lr 1.00e-05 gnorm 0.099 5.69s mem 15.6GB +[2026-09-13 20:03:08] step 2594/5000 loss 0.0606 (w 0.0617 mse 0.0640 t 408 new 0.16) lr 1.00e-05 gnorm 0.062 5.85s mem 15.6GB +[2026-09-13 20:03:13] step 2595/5000 loss 0.0806 (w 0.0813 mse 0.0810 t 769 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 20:03:19] step 2596/5000 loss 0.0825 (w 0.1409 mse 0.1310 t 933 new 0.32) lr 1.00e-05 gnorm 0.064 5.73s mem 15.6GB +[2026-09-13 20:03:25] step 2597/5000 loss 0.1317 (w 0.0891 mse 0.0809 t 906 new 0.20) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 20:03:30] step 2598/5000 loss 0.1082 (w 0.0698 mse 0.0713 t 950 new 0.20) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 20:03:36] step 2599/5000 loss 0.0597 (w 0.1511 mse 0.1448 t 964 new 0.18) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:03:42] step 2600/5000 loss 0.0943 (w 0.1232 mse 0.1186 t 425 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 20:03:48] step 2601/5000 loss 0.1159 (w 0.1017 mse 0.1045 t 837 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:03:53] step 2602/5000 loss 0.0690 (w 0.0455 mse 0.0481 t 914 new 0.10) lr 1.00e-05 gnorm 0.054 5.72s mem 15.6GB +[2026-09-13 20:03:59] step 2603/5000 loss 0.0930 (w 0.0648 mse 0.0619 t 784 new 0.17) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 20:04:05] step 2604/5000 loss 0.0528 (w 0.0922 mse 0.0943 t 772 new 0.25) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:04:10] step 2605/5000 loss 0.0661 (w 0.0643 mse 0.0646 t 566 new 0.17) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 20:04:16] step 2606/5000 loss 0.0846 (w 0.0579 mse 0.0551 t 603 new 0.25) lr 1.00e-05 gnorm 0.059 5.91s mem 15.6GB +[2026-09-13 20:04:22] step 2607/5000 loss 0.0698 (w 0.0627 mse 0.0639 t 914 new 0.22) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 20:04:28] step 2608/5000 loss 0.0486 (w 0.0589 mse 0.0604 t 925 new 0.21) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 20:04:33] step 2609/5000 loss 0.0823 (w 0.1765 mse 0.1745 t 979 new 0.11) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 20:04:39] step 2610/5000 loss 0.0863 (w 0.0682 mse 0.0669 t 715 new 0.25) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:04:45] step 2611/5000 loss 0.0949 (w 0.1125 mse 0.1048 t 530 new 0.24) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 20:04:51] step 2612/5000 loss 0.1043 (w 0.1079 mse 0.1014 t 843 new 0.26) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:04:56] step 2613/5000 loss 0.0538 (w 0.2407 mse 0.2256 t 984 new 0.20) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 20:05:02] step 2614/5000 loss 0.0947 (w 0.0859 mse 0.0859 t 417 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:05:08] step 2615/5000 loss 0.0890 (w 0.0786 mse 0.0719 t 704 new 0.30) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 20:05:13] step 2616/5000 loss 0.1090 (w 0.0999 mse 0.1018 t 964 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:05:19] step 2617/5000 loss 0.0415 (w 0.1508 mse 0.1474 t 964 new 0.17) lr 1.00e-05 gnorm 0.058 5.72s mem 15.6GB +[2026-09-13 20:05:25] step 2618/5000 loss 0.0738 (w 0.2085 mse 0.1909 t 1000 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:05:31] step 2619/5000 loss 0.0732 (w 0.0373 mse 0.0408 t 896 new 0.25) lr 1.00e-05 gnorm 0.054 5.91s mem 15.6GB +[2026-09-13 20:05:36] step 2620/5000 loss 0.0942 (w 0.0860 mse 0.0843 t 955 new 0.21) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 20:05:42] step 2621/5000 loss 0.0768 (w 0.1002 mse 0.1037 t 360 new 0.11) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 20:05:48] step 2622/5000 loss 0.0632 (w 0.0615 mse 0.0589 t 895 new 0.15) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 20:05:54] step 2623/5000 loss 0.0702 (w 0.0866 mse 0.0860 t 367 new 0.24) lr 1.00e-05 gnorm 0.070 5.93s mem 15.6GB +[2026-09-13 20:05:59] step 2624/5000 loss 0.0916 (w 0.0719 mse 0.0672 t 712 new 0.23) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 20:06:05] step 2625/5000 loss 0.1138 (w 0.1070 mse 0.1000 t 545 new 0.27) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 20:06:11] step 2626/5000 loss 0.0910 (w 0.0791 mse 0.0733 t 750 new 0.21) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 20:06:17] step 2627/5000 loss 0.1052 (w 0.0822 mse 0.0798 t 669 new 0.22) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 20:06:22] step 2628/5000 loss 0.1108 (w 0.0688 mse 0.0663 t 776 new 0.22) lr 1.00e-05 gnorm 0.082 5.77s mem 15.6GB +[2026-09-13 20:06:28] step 2629/5000 loss 0.0836 (w 0.1404 mse 0.1360 t 954 new 0.27) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:06:34] step 2630/5000 loss 0.1281 (w 0.1348 mse 0.1346 t 323 new 0.21) lr 1.00e-05 gnorm 0.066 5.84s mem 15.6GB +[2026-09-13 20:06:40] step 2631/5000 loss 0.0735 (w 0.1794 mse 0.1725 t 987 new 0.24) lr 1.00e-05 gnorm 0.177 5.68s mem 15.6GB +[2026-09-13 20:06:45] step 2632/5000 loss 0.0736 (w 0.0718 mse 0.0744 t 568 new 0.19) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 20:06:51] step 2633/5000 loss 0.1083 (w 0.1043 mse 0.0970 t 952 new 0.17) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 20:06:57] step 2634/5000 loss 0.1268 (w 0.0536 mse 0.0558 t 733 new 0.15) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 20:07:03] step 2635/5000 loss 0.1028 (w 0.0576 mse 0.0600 t 812 new 0.27) lr 1.00e-05 gnorm 0.057 5.71s mem 15.6GB +[2026-09-13 20:07:08] step 2636/5000 loss 0.0531 (w 0.0910 mse 0.0849 t 923 new 0.16) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 20:07:14] step 2637/5000 loss 0.0636 (w 0.0934 mse 0.0926 t 900 new 0.03) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 20:07:20] step 2638/5000 loss 0.1132 (w 0.0215 mse 0.0246 t 610 new 0.22) lr 1.00e-05 gnorm 0.065 5.89s mem 15.6GB +[2026-09-13 20:07:26] step 2639/5000 loss 0.0476 (w 0.1472 mse 0.1407 t 983 new 0.20) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 20:07:32] step 2640/5000 loss 0.1020 (w 0.0540 mse 0.0544 t 656 new 0.22) lr 1.00e-05 gnorm 0.056 5.92s mem 15.6GB +[2026-09-13 20:07:37] step 2641/5000 loss 0.0430 (w 0.1640 mse 0.1616 t 988 new 0.27) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:07:43] step 2642/5000 loss 0.0790 (w 0.1177 mse 0.1116 t 975 new 0.23) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 20:07:49] step 2643/5000 loss 0.0591 (w 0.0589 mse 0.0532 t 758 new 0.17) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 20:07:55] step 2644/5000 loss 0.0973 (w 0.0815 mse 0.0789 t 880 new 0.24) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 20:08:00] step 2645/5000 loss 0.0650 (w 0.1020 mse 0.0989 t 980 new 0.16) lr 1.00e-05 gnorm 0.056 5.71s mem 15.6GB +[2026-09-13 20:08:06] step 2646/5000 loss 0.1070 (w 0.0454 mse 0.0465 t 684 new 0.23) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 20:08:12] step 2647/5000 loss 0.0900 (w 0.0967 mse 0.0971 t 917 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:08:18] step 2648/5000 loss 0.0580 (w 0.0943 mse 0.0859 t 860 new 0.21) lr 1.00e-05 gnorm 0.075 5.83s mem 15.6GB +[2026-09-13 20:08:23] step 2649/5000 loss 0.1023 (w 0.0611 mse 0.0576 t 679 new 0.29) lr 1.00e-05 gnorm 0.069 5.88s mem 15.6GB +[2026-09-13 20:08:29] step 2650/5000 loss 0.0703 (w 0.0944 mse 0.0912 t 495 new 0.26) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 20:08:35] step 2651/5000 loss 0.0703 (w 0.0781 mse 0.0808 t 812 new 0.17) lr 1.00e-05 gnorm 0.049 5.90s mem 15.6GB +[2026-09-13 20:08:41] step 2652/5000 loss 0.1036 (w 0.1171 mse 0.1105 t 966 new 0.27) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +[2026-09-13 20:08:46] step 2653/5000 loss 0.1164 (w 0.1205 mse 0.1308 t 347 new 0.16) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 20:08:52] step 2654/5000 loss 0.0998 (w 0.0439 mse 0.0432 t 658 new 0.17) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:08:58] step 2655/5000 loss 0.0697 (w 0.3087 mse 0.3489 t 29 new 0.15) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:09:04] step 2656/5000 loss 0.1077 (w 0.1000 mse 0.0975 t 663 new 0.20) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 20:09:09] step 2657/5000 loss 0.1725 (w 0.1555 mse 0.1492 t 352 new 0.24) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 20:09:15] step 2658/5000 loss 0.1021 (w 0.0625 mse 0.0615 t 643 new 0.20) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 20:09:21] step 2659/5000 loss 0.0701 (w 0.1042 mse 0.1015 t 972 new 0.25) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 20:09:26] step 2660/5000 loss 0.0642 (w 0.0721 mse 0.0676 t 914 new 0.28) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 20:09:32] step 2661/5000 loss 0.1074 (w 0.1014 mse 0.0963 t 956 new 0.27) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 20:09:38] step 2662/5000 loss 0.1160 (w 0.3069 mse 0.3134 t 71 new 0.25) lr 1.00e-05 gnorm 0.060 5.72s mem 15.6GB +[2026-09-13 20:09:44] step 2663/5000 loss 0.0754 (w 0.0704 mse 0.0650 t 954 new 0.24) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:09:49] step 2664/5000 loss 0.0867 (w 0.0719 mse 0.0688 t 689 new 0.27) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 20:09:55] step 2665/5000 loss 0.0867 (w 0.0568 mse 0.0592 t 967 new 0.10) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:10:01] step 2666/5000 loss 0.0793 (w 0.1901 mse 0.1820 t 984 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:10:07] step 2667/5000 loss 0.0685 (w 0.0827 mse 0.0832 t 691 new 0.19) lr 1.00e-05 gnorm 0.081 5.83s mem 15.6GB +[2026-09-13 20:10:12] step 2668/5000 loss 0.0817 (w 0.0975 mse 0.0979 t 919 new 0.24) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 20:10:18] step 2669/5000 loss 0.0743 (w 0.0789 mse 0.0793 t 846 new 0.24) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 20:10:24] step 2670/5000 loss 0.0583 (w 0.1302 mse 0.1287 t 996 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 20:10:30] step 2671/5000 loss 0.0975 (w 0.0446 mse 0.0526 t 927 new 0.22) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 20:10:35] step 2672/5000 loss 0.0520 (w 0.1083 mse 0.0995 t 945 new 0.25) lr 1.00e-05 gnorm 0.063 5.90s mem 15.6GB +[2026-09-13 20:10:41] step 2673/5000 loss 0.0887 (w 0.0508 mse 0.0549 t 784 new 0.27) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 20:10:47] step 2674/5000 loss 0.0871 (w 0.1251 mse 0.1198 t 942 new 0.22) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 20:10:53] step 2675/5000 loss 0.1547 (w 0.0869 mse 0.0857 t 382 new 0.14) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 20:10:58] step 2676/5000 loss 0.1313 (w 0.1130 mse 0.1084 t 362 new 0.21) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 20:11:04] step 2677/5000 loss 0.1083 (w 0.1073 mse 0.0994 t 574 new 0.22) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 20:11:10] step 2678/5000 loss 0.1056 (w 0.1186 mse 0.1089 t 955 new 0.18) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 20:11:15] step 2679/5000 loss 0.0849 (w 0.0736 mse 0.0704 t 781 new 0.21) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 20:11:21] step 2680/5000 loss 0.1436 (w 0.0866 mse 0.0796 t 484 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 20:11:27] step 2681/5000 loss 0.1322 (w 0.2107 mse 0.2146 t 172 new 0.19) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 20:11:33] step 2682/5000 loss 0.0716 (w 0.1903 mse 0.1992 t 993 new 0.16) lr 1.00e-05 gnorm 0.072 5.80s mem 15.6GB +[2026-09-13 20:11:38] step 2683/5000 loss 0.1215 (w 0.0545 mse 0.0562 t 575 new 0.24) lr 1.00e-05 gnorm 0.091 5.83s mem 15.6GB +[2026-09-13 20:11:44] step 2684/5000 loss 0.0975 (w 0.1147 mse 0.1108 t 669 new 0.25) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 20:11:50] step 2685/5000 loss 0.0495 (w 0.0639 mse 0.0561 t 910 new 0.22) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 20:11:56] step 2686/5000 loss 0.0595 (w 0.1257 mse 0.1203 t 982 new 0.26) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 20:12:01] step 2687/5000 loss 0.1334 (w 0.1847 mse 0.1825 t 314 new 0.20) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 20:12:07] step 2688/5000 loss 0.0889 (w 0.0940 mse 0.0863 t 760 new 0.25) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 20:12:13] step 2689/5000 loss 0.0883 (w 0.0992 mse 0.0877 t 909 new 0.23) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 20:12:18] step 2690/5000 loss 0.1083 (w 0.0520 mse 0.0518 t 745 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 20:12:24] step 2691/5000 loss 0.0718 (w 0.1371 mse 0.1308 t 991 new 0.20) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 20:12:30] step 2692/5000 loss 0.0584 (w 0.0698 mse 0.0694 t 873 new 0.27) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:12:35] step 2693/5000 loss 0.0585 (w 0.0475 mse 0.0491 t 595 new 0.19) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:12:41] step 2694/5000 loss 0.0984 (w 0.1040 mse 0.1021 t 325 new 0.21) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 20:12:47] step 2695/5000 loss 0.1162 (w 0.0650 mse 0.0636 t 693 new 0.25) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 20:12:53] step 2696/5000 loss 0.1091 (w 0.1679 mse 0.1703 t 285 new 0.27) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:12:58] step 2697/5000 loss 0.0896 (w 0.0647 mse 0.0611 t 563 new 0.26) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 20:13:04] step 2698/5000 loss 0.0735 (w 0.0700 mse 0.0655 t 889 new 0.24) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 20:13:10] step 2699/5000 loss 0.0942 (w 0.0559 mse 0.0556 t 603 new 0.23) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +[2026-09-13 20:13:16] step 2700/5000 loss 0.0963 (w 0.0779 mse 0.0684 t 838 new 0.24) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 20:13:22] step 2701/5000 loss 0.0729 (w 0.1100 mse 0.1129 t 883 new 0.15) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 20:13:27] step 2702/5000 loss 0.0678 (w 0.1266 mse 0.1245 t 979 new 0.12) lr 1.00e-05 gnorm 0.061 5.67s mem 15.6GB +[2026-09-13 20:13:33] step 2703/5000 loss 0.0602 (w 0.0955 mse 0.0952 t 934 new 0.23) lr 1.00e-05 gnorm 0.069 5.76s mem 15.6GB +[2026-09-13 20:13:39] step 2704/5000 loss 0.0756 (w 0.1002 mse 0.0926 t 719 new 0.22) lr 1.00e-05 gnorm 0.078 5.79s mem 15.6GB +[2026-09-13 20:13:45] step 2705/5000 loss 0.1350 (w 0.0732 mse 0.0793 t 399 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 20:13:50] step 2706/5000 loss 0.0875 (w 0.0814 mse 0.0817 t 642 new 0.22) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 20:13:56] step 2707/5000 loss 0.0921 (w 0.1186 mse 0.1145 t 939 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:14:02] step 2708/5000 loss 0.0988 (w 0.1029 mse 0.1133 t 198 new 0.22) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 20:14:07] step 2709/5000 loss 0.0732 (w 0.0659 mse 0.0613 t 907 new 0.28) lr 1.00e-05 gnorm 0.057 5.76s mem 15.6GB +[2026-09-13 20:14:13] step 2710/5000 loss 0.0762 (w 0.0903 mse 0.0826 t 891 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:14:19] step 2711/5000 loss 0.1029 (w 0.4832 mse 0.4760 t 75 new 0.20) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 20:14:25] step 2712/5000 loss 0.0761 (w 0.1500 mse 0.1411 t 985 new 0.20) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 20:14:30] step 2713/5000 loss 0.0973 (w 0.1142 mse 0.1175 t 992 new 0.16) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:14:36] step 2714/5000 loss 0.0744 (w 0.0758 mse 0.0736 t 913 new 0.25) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 20:14:42] step 2715/5000 loss 0.1154 (w 0.1246 mse 0.1092 t 963 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:14:47] step 2716/5000 loss 0.0468 (w 0.0737 mse 0.0731 t 497 new 0.27) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 20:14:53] step 2717/5000 loss 0.1031 (w 0.0491 mse 0.0464 t 737 new 0.20) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 20:14:59] step 2718/5000 loss 0.0995 (w 0.0934 mse 0.0885 t 451 new 0.30) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 20:15:05] step 2719/5000 loss 0.0913 (w 0.0680 mse 0.0724 t 944 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 20:15:10] step 2720/5000 loss 0.0651 (w 0.0806 mse 0.0849 t 533 new 0.20) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 20:15:16] step 2721/5000 loss 0.0799 (w 0.0975 mse 0.0973 t 495 new 0.27) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 20:15:22] step 2722/5000 loss 0.1106 (w 0.0921 mse 0.0919 t 880 new 0.21) lr 1.00e-05 gnorm 0.067 5.94s mem 15.6GB +[2026-09-13 20:15:28] step 2723/5000 loss 0.0656 (w 0.0481 mse 0.0519 t 873 new 0.12) lr 1.00e-05 gnorm 0.069 5.67s mem 15.6GB +[2026-09-13 20:15:34] step 2724/5000 loss 0.0947 (w 0.0921 mse 0.0861 t 568 new 0.24) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 20:15:39] step 2725/5000 loss 0.0923 (w 0.0277 mse 0.0335 t 502 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:15:45] step 2726/5000 loss 0.0763 (w 0.0845 mse 0.0756 t 838 new 0.18) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 20:15:51] step 2727/5000 loss 0.0812 (w 0.2184 mse 0.2119 t 996 new 0.20) lr 1.00e-05 gnorm 0.057 5.92s mem 15.6GB +[2026-09-13 20:15:57] step 2728/5000 loss 0.1142 (w 0.1629 mse 0.1609 t 273 new 0.29) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:16:02] step 2729/5000 loss 0.1143 (w 0.0308 mse 0.0368 t 837 new 0.22) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:16:08] step 2730/5000 loss 0.0920 (w 0.0433 mse 0.0429 t 669 new 0.14) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 20:16:14] step 2731/5000 loss 0.0686 (w 0.0731 mse 0.0743 t 778 new 0.13) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 20:16:20] step 2732/5000 loss 0.0653 (w 0.0686 mse 0.0752 t 972 new 0.19) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 20:16:25] step 2733/5000 loss 0.0831 (w 0.7847 mse 0.7922 t 34 new 0.28) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 20:16:31] step 2734/5000 loss 0.0948 (w 0.0960 mse 0.0944 t 543 new 0.28) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 20:16:37] step 2735/5000 loss 0.0897 (w 0.1382 mse 0.1325 t 945 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:16:43] step 2736/5000 loss 0.0746 (w 0.0575 mse 0.0619 t 779 new 0.19) lr 1.00e-05 gnorm 0.051 5.91s mem 15.6GB +[2026-09-13 20:16:48] step 2737/5000 loss 0.0721 (w 0.1565 mse 0.1476 t 982 new 0.11) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +[2026-09-13 20:16:54] step 2738/5000 loss 0.0886 (w 0.1677 mse 0.1494 t 986 new 0.24) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 20:17:00] step 2739/5000 loss 0.0429 (w 0.3463 mse 0.3089 t 995 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 20:17:05] step 2740/5000 loss 0.0814 (w 0.1644 mse 0.1671 t 215 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:17:11] step 2741/5000 loss 0.0513 (w 0.0381 mse 0.0406 t 663 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:17:17] step 2742/5000 loss 0.0773 (w 0.0687 mse 0.0660 t 808 new 0.29) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 20:17:23] step 2743/5000 loss 0.0615 (w 0.0910 mse 0.0862 t 958 new 0.18) lr 1.00e-05 gnorm 0.055 5.72s mem 15.6GB +[2026-09-13 20:17:28] step 2744/5000 loss 0.0580 (w 0.0345 mse 0.0339 t 763 new 0.06) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 20:17:34] step 2745/5000 loss 0.0761 (w 0.2129 mse 0.2106 t 973 new 0.20) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 20:17:40] step 2746/5000 loss 0.0993 (w 0.1392 mse 0.1277 t 969 new 0.24) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 20:17:45] step 2747/5000 loss 0.0751 (w 0.1075 mse 0.1001 t 695 new 0.24) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 20:17:51] step 2748/5000 loss 0.1508 (w 0.0324 mse 0.0357 t 821 new 0.13) lr 1.00e-05 gnorm 0.066 5.91s mem 15.6GB +[2026-09-13 20:17:57] step 2749/5000 loss 0.0787 (w 0.0541 mse 0.0571 t 931 new 0.15) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:18:03] step 2750/5000 loss 0.0680 (w 0.0994 mse 0.0989 t 909 new 0.20) lr 1.00e-05 gnorm 0.059 5.71s mem 15.6GB +[2026-09-13 20:18:08] step 2751/5000 loss 0.1010 (w 0.1223 mse 0.1192 t 981 new 0.26) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +[2026-09-13 20:18:14] step 2752/5000 loss 0.0743 (w 0.0778 mse 0.0756 t 907 new 0.21) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 20:18:20] step 2753/5000 loss 0.0718 (w 0.1142 mse 0.1074 t 977 new 0.29) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 20:18:26] step 2754/5000 loss 0.0893 (w 0.0767 mse 0.0787 t 608 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:18:31] step 2755/5000 loss 0.0821 (w 0.0787 mse 0.0737 t 578 new 0.26) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +[2026-09-13 20:18:37] step 2756/5000 loss 0.0990 (w 0.2032 mse 0.1979 t 201 new 0.19) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 20:18:43] step 2757/5000 loss 0.1112 (w 0.1148 mse 0.1113 t 581 new 0.24) lr 1.00e-05 gnorm 0.069 5.92s mem 15.6GB +[2026-09-13 20:18:49] step 2758/5000 loss 0.0531 (w 0.0812 mse 0.0828 t 919 new 0.17) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 20:18:54] step 2759/5000 loss 0.0918 (w 0.0655 mse 0.0635 t 635 new 0.25) lr 1.00e-05 gnorm 0.058 5.73s mem 15.6GB +[2026-09-13 20:19:00] step 2760/5000 loss 0.0640 (w 0.0412 mse 0.0408 t 569 new 0.12) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 20:19:06] step 2761/5000 loss 0.0775 (w 0.0811 mse 0.0820 t 725 new 0.21) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:19:12] step 2762/5000 loss 0.0667 (w 0.1220 mse 0.1117 t 961 new 0.28) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 20:19:17] step 2763/5000 loss 0.0518 (w 0.0249 mse 0.0279 t 824 new 0.14) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 20:19:23] step 2764/5000 loss 0.1125 (w 0.1204 mse 0.1120 t 915 new 0.27) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 20:19:29] step 2765/5000 loss 0.1178 (w 0.1039 mse 0.1005 t 399 new 0.28) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 20:19:34] step 2766/5000 loss 0.1093 (w 0.0880 mse 0.0815 t 951 new 0.23) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 20:19:40] step 2767/5000 loss 0.1129 (w 0.0429 mse 0.0425 t 670 new 0.13) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 20:19:46] step 2768/5000 loss 0.0931 (w 0.1769 mse 0.1736 t 288 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 20:19:52] step 2769/5000 loss 0.0833 (w 0.0766 mse 0.0706 t 880 new 0.13) lr 1.00e-05 gnorm 0.057 5.93s mem 15.6GB +[2026-09-13 20:19:58] step 2770/5000 loss 0.0482 (w 0.0609 mse 0.0606 t 786 new 0.28) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 20:20:03] step 2771/5000 loss 0.0716 (w 0.0512 mse 0.0529 t 845 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 20:20:09] step 2772/5000 loss 0.1049 (w 0.0613 mse 0.0584 t 854 new 0.19) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 20:20:15] step 2773/5000 loss 0.1189 (w 0.2187 mse 0.2255 t 157 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:20:20] step 2774/5000 loss 0.0832 (w 0.0722 mse 0.0710 t 923 new 0.30) lr 1.00e-05 gnorm 0.098 5.68s mem 15.6GB +[2026-09-13 20:20:26] step 2775/5000 loss 0.0873 (w 0.0798 mse 0.0784 t 684 new 0.19) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 20:20:32] step 2776/5000 loss 0.0930 (w 0.0433 mse 0.0429 t 876 new 0.24) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 20:20:38] step 2777/5000 loss 0.0828 (w 0.0684 mse 0.0664 t 856 new 0.09) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:20:43] step 2778/5000 loss 0.0900 (w 0.0894 mse 0.0823 t 913 new 0.18) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 20:20:49] step 2779/5000 loss 0.0963 (w 0.3660 mse 0.3718 t 109 new 0.22) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 20:20:55] step 2780/5000 loss 0.0688 (w 0.0307 mse 0.0322 t 836 new 0.30) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:21:00] step 2781/5000 loss 0.0736 (w 0.0671 mse 0.0684 t 915 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 20:21:06] step 2782/5000 loss 0.0937 (w 0.0924 mse 0.0891 t 957 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:21:12] step 2783/5000 loss 0.1262 (w 0.1278 mse 0.1287 t 285 new 0.28) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:21:17] step 2784/5000 loss 0.0599 (w 0.0984 mse 0.0911 t 859 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:21:23] step 2785/5000 loss 0.1488 (w 0.2071 mse 0.2117 t 169 new 0.23) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 20:21:29] step 2786/5000 loss 0.1066 (w 0.1012 mse 0.0936 t 733 new 0.25) lr 1.00e-05 gnorm 0.052 5.89s mem 15.6GB +[2026-09-13 20:21:35] step 2787/5000 loss 0.0949 (w 0.0916 mse 0.0874 t 587 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:21:40] step 2788/5000 loss 0.0647 (w 0.1152 mse 0.1133 t 970 new 0.27) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 20:21:46] step 2789/5000 loss 0.0935 (w 0.0937 mse 0.0859 t 854 new 0.21) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 20:21:52] step 2790/5000 loss 0.0803 (w 0.0491 mse 0.0459 t 695 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:21:58] step 2791/5000 loss 0.0552 (w 0.1095 mse 0.1059 t 961 new 0.14) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:22:03] step 2792/5000 loss 0.0896 (w 0.0444 mse 0.0470 t 818 new 0.18) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 20:22:09] step 2793/5000 loss 0.0730 (w 0.0917 mse 0.0857 t 933 new 0.30) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:22:15] step 2794/5000 loss 0.0782 (w 0.0950 mse 0.1003 t 706 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:22:20] step 2795/5000 loss 0.0989 (w 0.1170 mse 0.1042 t 953 new 0.28) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 20:22:26] step 2796/5000 loss 0.1265 (w 0.0973 mse 0.0928 t 593 new 0.29) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 20:22:32] step 2797/5000 loss 0.0630 (w 0.1223 mse 0.1134 t 946 new 0.23) lr 1.00e-05 gnorm 0.095 5.68s mem 15.6GB +[2026-09-13 20:22:38] step 2798/5000 loss 0.0839 (w 0.0989 mse 0.0929 t 964 new 0.24) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 20:22:43] step 2799/5000 loss 0.0855 (w 0.0318 mse 0.0328 t 669 new 0.14) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 20:22:49] step 2800/5000 loss 0.0658 (w 0.0677 mse 0.0650 t 336 new 0.17) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:22:55] step 2801/5000 loss 0.1050 (w 0.0617 mse 0.0582 t 707 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:23:00] step 2802/5000 loss 0.1124 (w 0.1419 mse 0.1392 t 509 new 0.20) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:23:06] step 2803/5000 loss 0.0745 (w 0.3773 mse 0.3925 t 109 new 0.23) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 20:23:12] step 2804/5000 loss 0.0638 (w 0.0652 mse 0.0615 t 596 new 0.21) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 20:23:17] step 2805/5000 loss 0.1024 (w 0.2671 mse 0.2487 t 996 new 0.27) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 20:23:23] step 2806/5000 loss 0.0762 (w 0.1244 mse 0.1104 t 980 new 0.22) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 20:23:29] step 2807/5000 loss 0.0962 (w 0.0677 mse 0.0686 t 475 new 0.13) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 20:23:35] step 2808/5000 loss 0.0451 (w 0.1059 mse 0.0986 t 859 new 0.22) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 20:23:40] step 2809/5000 loss 0.1659 (w 0.1408 mse 0.1424 t 285 new 0.24) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 20:23:46] step 2810/5000 loss 0.1236 (w 0.1038 mse 0.0970 t 538 new 0.25) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 20:23:52] step 2811/5000 loss 0.1346 (w 0.1654 mse 0.1624 t 958 new 0.23) lr 1.00e-05 gnorm 0.081 5.92s mem 15.6GB +[2026-09-13 20:23:58] step 2812/5000 loss 0.1345 (w 0.0563 mse 0.0540 t 821 new 0.21) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 20:24:03] step 2813/5000 loss 0.1260 (w 0.0466 mse 0.0490 t 786 new 0.22) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 20:24:09] step 2814/5000 loss 0.1235 (w 0.1234 mse 0.1243 t 280 new 0.26) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 20:24:15] step 2815/5000 loss 0.1036 (w 0.1386 mse 0.1388 t 403 new 0.20) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 20:24:21] step 2816/5000 loss 0.0394 (w 0.0951 mse 0.0924 t 894 new 0.24) lr 1.00e-05 gnorm 0.056 5.81s mem 15.6GB +[2026-09-13 20:24:26] step 2817/5000 loss 0.0914 (w 0.0944 mse 0.0894 t 881 new 0.25) lr 1.00e-05 gnorm 0.066 5.74s mem 15.6GB +[2026-09-13 20:24:32] step 2818/5000 loss 0.0931 (w 0.0898 mse 0.0909 t 648 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 20:24:38] step 2819/5000 loss 0.0893 (w 0.0919 mse 0.0786 t 887 new 0.25) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:24:44] step 2820/5000 loss 0.0596 (w 0.0758 mse 0.0718 t 890 new 0.21) lr 1.00e-05 gnorm 0.058 5.92s mem 15.6GB +[2026-09-13 20:24:50] step 2821/5000 loss 0.1169 (w 0.0933 mse 0.0883 t 602 new 0.20) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 20:24:55] step 2822/5000 loss 0.0958 (w 0.2330 mse 0.2298 t 248 new 0.27) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +[2026-09-13 20:25:01] step 2823/5000 loss 0.1114 (w 0.1969 mse 0.1817 t 1000 new 0.24) lr 1.00e-05 gnorm 0.046 5.68s mem 15.6GB +[2026-09-13 20:25:07] step 2824/5000 loss 0.1136 (w 0.1404 mse 0.1441 t 380 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 20:25:12] step 2825/5000 loss 0.0857 (w 0.0759 mse 0.0768 t 410 new 0.19) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 20:25:18] step 2826/5000 loss 0.1102 (w 0.0899 mse 0.0889 t 403 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 20:25:24] step 2827/5000 loss 0.0910 (w 0.0931 mse 0.0907 t 469 new 0.17) lr 1.00e-05 gnorm 0.056 5.76s mem 15.6GB +[2026-09-13 20:25:30] step 2828/5000 loss 0.1322 (w 0.1162 mse 0.1206 t 215 new 0.13) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 20:25:35] step 2829/5000 loss 0.0928 (w 0.0555 mse 0.0549 t 569 new 0.19) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 20:25:41] step 2830/5000 loss 0.1212 (w 0.0697 mse 0.0676 t 750 new 0.24) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 20:25:47] step 2831/5000 loss 0.0915 (w 0.0833 mse 0.0837 t 957 new 0.17) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 20:25:53] step 2832/5000 loss 0.0518 (w 0.1479 mse 0.1428 t 975 new 0.20) lr 1.00e-05 gnorm 0.096 5.68s mem 15.6GB +[2026-09-13 20:25:58] step 2833/5000 loss 0.1117 (w 0.0887 mse 0.0793 t 903 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 20:26:04] step 2834/5000 loss 0.1255 (w 0.0735 mse 0.0714 t 568 new 0.13) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 20:26:10] step 2835/5000 loss 0.1528 (w 0.0921 mse 0.0876 t 568 new 0.22) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 20:26:15] step 2836/5000 loss 0.0902 (w 0.0828 mse 0.0804 t 895 new 0.17) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 20:26:21] step 2837/5000 loss 0.0982 (w 0.0947 mse 0.0851 t 693 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:26:27] step 2838/5000 loss 0.0602 (w 0.0431 mse 0.0413 t 890 new 0.24) lr 1.00e-05 gnorm 0.067 5.97s mem 15.6GB +[2026-09-13 20:26:33] step 2839/5000 loss 0.1107 (w 0.0528 mse 0.0515 t 786 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:26:38] step 2840/5000 loss 0.0475 (w 0.0703 mse 0.0687 t 905 new 0.28) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 20:26:44] step 2841/5000 loss 0.0883 (w 0.0318 mse 0.0343 t 894 new 0.17) lr 1.00e-05 gnorm 0.076 5.91s mem 15.6GB +[2026-09-13 20:26:50] step 2842/5000 loss 0.0898 (w 0.0729 mse 0.0692 t 793 new 0.21) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:26:56] step 2843/5000 loss 0.0880 (w 0.0941 mse 0.0943 t 980 new 0.26) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 20:27:01] step 2844/5000 loss 0.0986 (w 0.0822 mse 0.0772 t 661 new 0.24) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:27:07] step 2845/5000 loss 0.1012 (w 0.0654 mse 0.0653 t 598 new 0.24) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 20:27:13] step 2846/5000 loss 0.0733 (w 0.0868 mse 0.0810 t 887 new 0.22) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 20:27:19] step 2847/5000 loss 0.0706 (w 0.1706 mse 0.1677 t 970 new 0.21) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 20:27:24] step 2848/5000 loss 0.0662 (w 0.0884 mse 0.0782 t 823 new 0.29) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 20:27:30] step 2849/5000 loss 0.0722 (w 0.2098 mse 0.1749 t 998 new 0.24) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 20:27:36] step 2850/5000 loss 0.0826 (w 0.0913 mse 0.0853 t 956 new 0.29) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 20:27:42] step 2851/5000 loss 0.0643 (w 0.0645 mse 0.0620 t 796 new 0.25) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 20:27:47] step 2852/5000 loss 0.0671 (w 0.0764 mse 0.0705 t 788 new 0.31) lr 1.00e-05 gnorm 0.066 5.71s mem 15.6GB +[2026-09-13 20:27:53] step 2853/5000 loss 0.0892 (w 0.0897 mse 0.0877 t 818 new 0.21) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 20:27:59] step 2854/5000 loss 0.1329 (w 0.1303 mse 0.1311 t 306 new 0.20) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:28:04] step 2855/5000 loss 0.1269 (w 0.0662 mse 0.0653 t 724 new 0.17) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:28:10] step 2856/5000 loss 0.0992 (w 0.1815 mse 0.1808 t 317 new 0.29) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +[2026-09-13 20:28:16] step 2857/5000 loss 0.1344 (w 0.0631 mse 0.0707 t 285 new 0.23) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 20:28:22] step 2858/5000 loss 0.0807 (w 0.1082 mse 0.1031 t 873 new 0.20) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 20:28:27] step 2859/5000 loss 0.0991 (w 0.0839 mse 0.0835 t 827 new 0.22) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:28:33] step 2860/5000 loss 0.1260 (w 0.1837 mse 0.1820 t 955 new 0.20) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:28:39] step 2861/5000 loss 0.1052 (w 0.0821 mse 0.0789 t 748 new 0.24) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 20:28:44] step 2862/5000 loss 0.1116 (w 0.0577 mse 0.0524 t 889 new 0.24) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 20:28:50] step 2863/5000 loss 0.1410 (w 0.0810 mse 0.0741 t 944 new 0.23) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:28:56] step 2864/5000 loss 0.0715 (w 0.0942 mse 0.0883 t 843 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:29:02] step 2865/5000 loss 0.0988 (w 0.0921 mse 0.0906 t 408 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:29:07] step 2866/5000 loss 0.1152 (w 0.0585 mse 0.0572 t 742 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:29:13] step 2867/5000 loss 0.0991 (w 0.1025 mse 0.1005 t 962 new 0.20) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 20:29:19] step 2868/5000 loss 0.0861 (w 0.0534 mse 0.0517 t 698 new 0.27) lr 1.00e-05 gnorm 0.058 5.79s mem 15.6GB +[2026-09-13 20:29:24] step 2869/5000 loss 0.0743 (w 0.0651 mse 0.0621 t 901 new 0.20) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 20:29:30] step 2870/5000 loss 0.0811 (w 0.1006 mse 0.0947 t 971 new 0.18) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 20:29:36] step 2871/5000 loss 0.1079 (w 0.1174 mse 0.1194 t 632 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 20:29:42] step 2872/5000 loss 0.1076 (w 0.0899 mse 0.0824 t 874 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:29:47] step 2873/5000 loss 0.1079 (w 0.1035 mse 0.1050 t 871 new 0.19) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 20:29:53] step 2874/5000 loss 0.0511 (w 0.1194 mse 0.1117 t 915 new 0.26) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:29:59] step 2875/5000 loss 0.1348 (w 0.0760 mse 0.0741 t 559 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 20:30:05] step 2876/5000 loss 0.0747 (w 0.0623 mse 0.0597 t 922 new 0.31) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 20:30:10] step 2877/5000 loss 0.0545 (w 0.0714 mse 0.0712 t 724 new 0.21) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 20:30:16] step 2878/5000 loss 0.0710 (w 0.1146 mse 0.1112 t 923 new 0.21) lr 1.00e-05 gnorm 0.074 5.93s mem 15.6GB +[2026-09-13 20:30:22] step 2879/5000 loss 0.0608 (w 0.0832 mse 0.0760 t 956 new 0.26) lr 1.00e-05 gnorm 0.071 5.95s mem 15.6GB +[2026-09-13 20:30:28] step 2880/5000 loss 0.1284 (w 0.1740 mse 0.1627 t 967 new 0.21) lr 1.00e-05 gnorm 0.070 5.85s mem 15.6GB +[2026-09-13 20:30:34] step 2881/5000 loss 0.0751 (w 0.0697 mse 0.0656 t 953 new 0.11) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 20:30:40] step 2882/5000 loss 0.0617 (w 0.0630 mse 0.0595 t 777 new 0.25) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 20:30:45] step 2883/5000 loss 0.0861 (w 0.1172 mse 0.1155 t 935 new 0.21) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 20:30:51] step 2884/5000 loss 0.0609 (w 0.1364 mse 0.1263 t 985 new 0.19) lr 1.00e-05 gnorm 0.067 5.92s mem 15.6GB +[2026-09-13 20:30:57] step 2885/5000 loss 0.1079 (w 0.1446 mse 0.1351 t 987 new 0.22) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 20:31:03] step 2886/5000 loss 0.0867 (w 0.0518 mse 0.0506 t 840 new 0.30) lr 1.00e-05 gnorm 0.060 5.92s mem 15.6GB +[2026-09-13 20:31:09] step 2887/5000 loss 0.0772 (w 0.1609 mse 0.1567 t 965 new 0.30) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:31:14] step 2888/5000 loss 0.1264 (w 0.0636 mse 0.0626 t 737 new 0.18) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 20:31:20] step 2889/5000 loss 0.0929 (w 0.1075 mse 0.0999 t 872 new 0.27) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 20:31:26] step 2890/5000 loss 0.0556 (w 0.0460 mse 0.0487 t 626 new 0.25) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 20:31:32] step 2891/5000 loss 0.1085 (w 0.7614 mse 0.7678 t 29 new 0.25) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 20:31:37] step 2892/5000 loss 0.0541 (w 0.1473 mse 0.1431 t 964 new 0.28) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 20:31:43] step 2893/5000 loss 0.0789 (w 0.0673 mse 0.0638 t 879 new 0.27) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 20:31:49] step 2894/5000 loss 0.0616 (w 0.1226 mse 0.1050 t 957 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 20:31:54] step 2895/5000 loss 0.1114 (w 0.0900 mse 0.0840 t 854 new 0.22) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 20:32:00] step 2896/5000 loss 0.0770 (w 0.0953 mse 0.0943 t 988 new 0.08) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 20:32:06] step 2897/5000 loss 0.0891 (w 0.1920 mse 0.1884 t 994 new 0.16) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 20:32:11] step 2898/5000 loss 0.1323 (w 0.0938 mse 0.0897 t 644 new 0.22) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 20:32:17] step 2899/5000 loss 0.0988 (w 0.0656 mse 0.0653 t 577 new 0.20) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 20:32:23] step 2900/5000 loss 0.0975 (w 0.0221 mse 0.0250 t 804 new 0.20) lr 1.00e-05 gnorm 0.063 5.91s mem 15.6GB +[2026-09-13 20:32:29] step 2901/5000 loss 0.0612 (w 0.1491 mse 0.1354 t 973 new 0.31) lr 1.00e-05 gnorm 0.103 5.68s mem 15.6GB +[2026-09-13 20:32:34] step 2902/5000 loss 0.0883 (w 0.3390 mse 0.3342 t 114 new 0.20) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 20:32:40] step 2903/5000 loss 0.1105 (w 0.1258 mse 0.1297 t 967 new 0.26) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 20:32:46] step 2904/5000 loss 0.0854 (w 0.1352 mse 0.1317 t 997 new 0.11) lr 1.00e-05 gnorm 0.059 5.67s mem 15.6GB +[2026-09-13 20:32:52] step 2905/5000 loss 0.0636 (w 0.1679 mse 0.1587 t 988 new 0.25) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 20:32:57] step 2906/5000 loss 0.0592 (w 0.1104 mse 0.1058 t 827 new 0.22) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +[2026-09-13 20:33:03] step 2907/5000 loss 0.0221 (w 0.3343 mse 0.3292 t 999 new 0.18) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 20:33:09] step 2908/5000 loss 0.0503 (w 0.2139 mse 0.1946 t 1000 new 0.20) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 20:33:14] step 2909/5000 loss 0.0866 (w 0.1015 mse 0.0939 t 802 new 0.24) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 20:33:20] step 2910/5000 loss 0.0770 (w 0.1307 mse 0.1198 t 968 new 0.24) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 20:33:26] step 2911/5000 loss 0.0741 (w 0.0343 mse 0.0387 t 879 new 0.26) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 20:33:31] step 2912/5000 loss 0.1512 (w 0.1032 mse 0.1023 t 403 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 20:33:37] step 2913/5000 loss 0.0560 (w 0.0817 mse 0.0781 t 652 new 0.15) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:33:43] step 2914/5000 loss 0.0568 (w 0.0726 mse 0.0696 t 910 new 0.25) lr 1.00e-05 gnorm 0.067 5.72s mem 15.6GB +[2026-09-13 20:33:49] step 2915/5000 loss 0.1233 (w 0.0826 mse 0.0796 t 626 new 0.20) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 20:33:54] step 2916/5000 loss 0.0760 (w 0.1152 mse 0.1206 t 928 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:34:00] step 2917/5000 loss 0.0796 (w 0.0407 mse 0.0408 t 764 new 0.11) lr 1.00e-05 gnorm 0.064 5.79s mem 15.6GB +[2026-09-13 20:34:06] step 2918/5000 loss 0.0864 (w 0.0579 mse 0.0564 t 908 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:34:12] step 2919/5000 loss 0.0793 (w 0.1050 mse 0.0934 t 980 new 0.18) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 20:34:17] step 2920/5000 loss 0.0990 (w 0.1044 mse 0.1036 t 945 new 0.18) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 20:34:23] step 2921/5000 loss 0.0559 (w 0.0859 mse 0.0806 t 874 new 0.25) lr 1.00e-05 gnorm 0.148 5.96s mem 15.6GB +[2026-09-13 20:34:29] step 2922/5000 loss 0.1319 (w 0.0823 mse 0.0764 t 538 new 0.25) lr 1.00e-05 gnorm 0.066 5.90s mem 15.6GB +[2026-09-13 20:34:35] step 2923/5000 loss 0.1424 (w 0.0590 mse 0.0565 t 715 new 0.24) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 20:34:41] step 2924/5000 loss 0.1706 (w 0.1609 mse 0.1598 t 239 new 0.30) lr 1.00e-05 gnorm 0.064 5.89s mem 15.6GB +[2026-09-13 20:34:47] step 2925/5000 loss 0.1312 (w 0.0357 mse 0.0372 t 816 new 0.10) lr 1.00e-05 gnorm 0.087 5.90s mem 15.6GB +[2026-09-13 20:34:52] step 2926/5000 loss 0.1098 (w 0.0823 mse 0.0780 t 682 new 0.26) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 20:34:58] step 2927/5000 loss 0.0832 (w 0.0736 mse 0.0697 t 853 new 0.15) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 20:35:04] step 2928/5000 loss 0.0820 (w 0.0997 mse 0.0942 t 938 new 0.23) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 20:35:10] step 2929/5000 loss 0.0638 (w 0.0748 mse 0.0746 t 880 new 0.19) lr 1.00e-05 gnorm 0.071 5.71s mem 15.6GB +[2026-09-13 20:35:15] step 2930/5000 loss 0.1356 (w 0.0834 mse 0.0808 t 992 new 0.15) lr 1.00e-05 gnorm 0.068 5.71s mem 15.6GB +[2026-09-13 20:35:21] step 2931/5000 loss 0.1042 (w 0.0374 mse 0.0388 t 651 new 0.28) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 20:35:27] step 2932/5000 loss 0.0484 (w 0.0960 mse 0.0945 t 962 new 0.27) lr 1.00e-05 gnorm 0.074 5.78s mem 15.6GB +[2026-09-13 20:35:33] step 2933/5000 loss 0.0764 (w 0.0502 mse 0.0495 t 798 new 0.26) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 20:35:38] step 2934/5000 loss 0.1123 (w 0.0840 mse 0.0822 t 432 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 20:35:44] step 2935/5000 loss 0.0901 (w 0.0780 mse 0.0756 t 412 new 0.27) lr 1.00e-05 gnorm 0.071 5.72s mem 15.6GB +[2026-09-13 20:35:50] step 2936/5000 loss 0.0606 (w 0.0783 mse 0.0727 t 719 new 0.17) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 20:35:56] step 2937/5000 loss 0.1195 (w 0.1034 mse 0.0991 t 525 new 0.23) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 20:36:01] step 2938/5000 loss 0.0775 (w 0.0963 mse 0.0981 t 918 new 0.27) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 20:36:07] step 2939/5000 loss 0.0977 (w 0.0765 mse 0.0753 t 925 new 0.12) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:36:13] step 2940/5000 loss 0.1362 (w 0.2530 mse 0.2503 t 180 new 0.27) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 20:36:18] step 2941/5000 loss 0.0518 (w 0.1137 mse 0.1111 t 918 new 0.22) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 20:36:24] step 2942/5000 loss 0.0601 (w 0.0539 mse 0.0605 t 951 new 0.19) lr 1.00e-05 gnorm 0.077 6.06s mem 15.6GB +[2026-09-13 20:36:30] step 2943/5000 loss 0.0705 (w 0.1755 mse 0.1617 t 979 new 0.23) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +[2026-09-13 20:36:36] step 2944/5000 loss 0.1245 (w 0.1405 mse 0.1397 t 996 new 0.14) lr 1.00e-05 gnorm 0.068 5.82s mem 15.6GB +[2026-09-13 20:36:42] step 2945/5000 loss 0.1137 (w 0.0302 mse 0.0286 t 823 new 0.10) lr 1.00e-05 gnorm 0.086 5.89s mem 15.6GB +[2026-09-13 20:36:48] step 2946/5000 loss 0.0736 (w 0.0620 mse 0.0581 t 934 new 0.25) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 20:36:53] step 2947/5000 loss 0.0768 (w 0.0744 mse 0.0704 t 557 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:36:59] step 2948/5000 loss 0.0561 (w 0.0807 mse 0.0808 t 870 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 20:37:05] step 2949/5000 loss 0.1005 (w 0.1231 mse 0.1190 t 891 new 0.20) lr 1.00e-05 gnorm 0.104 5.68s mem 15.6GB +[2026-09-13 20:37:11] step 2950/5000 loss 0.0813 (w 0.1515 mse 0.1433 t 984 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 20:37:17] step 2951/5000 loss 0.0932 (w 0.3467 mse 0.3552 t 995 new 0.23) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 20:37:22] step 2952/5000 loss 0.0902 (w 0.0473 mse 0.0442 t 942 new 0.08) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 20:37:28] step 2953/5000 loss 0.0943 (w 0.0665 mse 0.0633 t 863 new 0.19) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 20:37:34] step 2954/5000 loss 0.1287 (w 0.0485 mse 0.0489 t 717 new 0.18) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 20:37:39] step 2955/5000 loss 0.0710 (w 0.0640 mse 0.0592 t 838 new 0.15) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 20:37:45] step 2956/5000 loss 0.0729 (w 0.0709 mse 0.0721 t 939 new 0.22) lr 1.00e-05 gnorm 0.101 5.68s mem 15.6GB +[2026-09-13 20:37:51] step 2957/5000 loss 0.0684 (w 0.0703 mse 0.0699 t 980 new 0.12) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 20:37:57] step 2958/5000 loss 0.0908 (w 0.1256 mse 0.1369 t 280 new 0.20) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +[2026-09-13 20:38:02] step 2959/5000 loss 0.0856 (w 0.1098 mse 0.0987 t 937 new 0.22) lr 1.00e-05 gnorm 0.121 5.70s mem 15.6GB +[2026-09-13 20:38:08] step 2960/5000 loss 0.1442 (w 0.0573 mse 0.0565 t 958 new 0.11) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +[2026-09-13 20:38:14] step 2961/5000 loss 0.1406 (w 0.0557 mse 0.0546 t 765 new 0.13) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 20:38:19] step 2962/5000 loss 0.1466 (w 0.0766 mse 0.0750 t 365 new 0.24) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 20:38:25] step 2963/5000 loss 0.0633 (w 0.0937 mse 0.0812 t 930 new 0.27) lr 1.00e-05 gnorm 0.127 5.69s mem 15.6GB +[2026-09-13 20:38:31] step 2964/5000 loss 0.0786 (w 0.0786 mse 0.0839 t 968 new 0.26) lr 1.00e-05 gnorm 0.079 5.93s mem 15.6GB +[2026-09-13 20:38:37] step 2965/5000 loss 0.1091 (w 0.0676 mse 0.0631 t 819 new 0.24) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +[2026-09-13 20:38:42] step 2966/5000 loss 0.1012 (w 0.0765 mse 0.0678 t 935 new 0.23) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +[2026-09-13 20:38:48] step 2967/5000 loss 0.1157 (w 0.0896 mse 0.0840 t 604 new 0.25) lr 1.00e-05 gnorm 0.109 5.68s mem 15.6GB +[2026-09-13 20:38:54] step 2968/5000 loss 0.1172 (w 0.2922 mse 0.2889 t 183 new 0.20) lr 1.00e-05 gnorm 0.079 5.82s mem 15.6GB +[2026-09-13 20:39:00] step 2969/5000 loss 0.0790 (w 0.0701 mse 0.0669 t 797 new 0.30) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 20:39:06] step 2970/5000 loss 0.1346 (w 0.0834 mse 0.0780 t 509 new 0.26) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 20:39:11] step 2971/5000 loss 0.0900 (w 0.1271 mse 0.1208 t 979 new 0.23) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 20:39:17] step 2972/5000 loss 0.0926 (w 0.1349 mse 0.1256 t 905 new 0.20) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:39:23] step 2973/5000 loss 0.0526 (w 0.0493 mse 0.0494 t 484 new 0.21) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 20:39:29] step 2974/5000 loss 0.1116 (w 0.1221 mse 0.1230 t 303 new 0.25) lr 1.00e-05 gnorm 0.069 5.92s mem 15.6GB +[2026-09-13 20:39:34] step 2975/5000 loss 0.0750 (w 0.0934 mse 0.0900 t 998 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:39:40] step 2976/5000 loss 0.1090 (w 0.0715 mse 0.0626 t 855 new 0.21) lr 1.00e-05 gnorm 0.102 5.68s mem 15.6GB +[2026-09-13 20:39:46] step 2977/5000 loss 0.0625 (w 0.1265 mse 0.1331 t 959 new 0.17) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 20:39:51] step 2978/5000 loss 0.0739 (w 0.0761 mse 0.0715 t 690 new 0.25) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 20:39:57] step 2979/5000 loss 0.1099 (w 0.0956 mse 0.0925 t 701 new 0.23) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 20:40:03] step 2980/5000 loss 0.1552 (w 0.0876 mse 0.0810 t 637 new 0.19) lr 1.00e-05 gnorm 0.091 5.74s mem 15.6GB +[2026-09-13 20:40:09] step 2981/5000 loss 0.0975 (w 0.2258 mse 0.1917 t 999 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:40:14] step 2982/5000 loss 0.0600 (w 0.1019 mse 0.0944 t 847 new 0.26) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 20:40:20] step 2983/5000 loss 0.0596 (w 0.7582 mse 0.7624 t 39 new 0.20) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 20:40:26] step 2984/5000 loss 0.0831 (w 0.0708 mse 0.0684 t 753 new 0.27) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +[2026-09-13 20:40:32] step 2985/5000 loss 0.0848 (w 0.0632 mse 0.0604 t 908 new 0.23) lr 1.00e-05 gnorm 0.081 6.16s mem 15.6GB +[2026-09-13 20:40:38] step 2986/5000 loss 0.0989 (w 0.1152 mse 0.1159 t 933 new 0.30) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 20:40:44] step 2987/5000 loss 0.1108 (w 0.1200 mse 0.1169 t 927 new 0.23) lr 1.00e-05 gnorm 0.099 5.92s mem 15.6GB +[2026-09-13 20:40:49] step 2988/5000 loss 0.1029 (w 0.0398 mse 0.0403 t 656 new 0.07) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:40:55] step 2989/5000 loss 0.1092 (w 0.2463 mse 0.2434 t 187 new 0.29) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 20:41:01] step 2990/5000 loss 0.0985 (w 0.0753 mse 0.0711 t 862 new 0.26) lr 1.00e-05 gnorm 0.111 5.69s mem 15.6GB +[2026-09-13 20:41:07] step 2991/5000 loss 0.0839 (w 0.0959 mse 0.0884 t 931 new 0.20) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:41:12] step 2992/5000 loss 0.1126 (w 0.0570 mse 0.0552 t 724 new 0.26) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 20:41:18] step 2993/5000 loss 0.0396 (w 0.1816 mse 0.1677 t 978 new 0.18) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 20:41:24] step 2994/5000 loss 0.0595 (w 0.0908 mse 0.0847 t 988 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:41:29] step 2995/5000 loss 0.0839 (w 0.0500 mse 0.0551 t 752 new 0.18) lr 1.00e-05 gnorm 0.054 5.71s mem 15.6GB +[2026-09-13 20:41:35] step 2996/5000 loss 0.1223 (w 0.0637 mse 0.0559 t 603 new 0.22) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 20:41:41] step 2997/5000 loss 0.0834 (w 0.0585 mse 0.0582 t 837 new 0.28) lr 1.00e-05 gnorm 0.053 5.90s mem 15.6GB +[2026-09-13 20:41:47] step 2998/5000 loss 0.1407 (w 0.0333 mse 0.0347 t 794 new 0.08) lr 1.00e-05 gnorm 0.061 5.73s mem 15.6GB +[2026-09-13 20:41:52] step 2999/5000 loss 0.1091 (w 0.1263 mse 0.1218 t 963 new 0.30) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 20:41:58] step 3000/5000 loss 0.0871 (w 0.0667 mse 0.0628 t 895 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 20:42:02] [val] step 3000 t=201: w=0.1749 mse=0.1773 (n=16) t=501: w=0.0725 mse=0.0724 (n=16) t=800: w=0.0607 mse=0.0595 (n=16) | mean w=0.1027 mse=0.1031 4s +[2026-09-13 20:42:06] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step3000.safetensors 832 个张量 2.87 GB +[2026-09-13 20:42:12] step 3001/5000 loss 0.0637 (w 0.0788 mse 0.0760 t 904 new 0.21) lr 1.00e-05 gnorm 0.061 5.67s mem 15.6GB +[2026-09-13 20:42:17] step 3002/5000 loss 0.0673 (w 0.0336 mse 0.0365 t 701 new 0.17) lr 1.00e-05 gnorm 0.069 5.71s mem 15.6GB +[2026-09-13 20:42:23] step 3003/5000 loss 0.0766 (w 0.0685 mse 0.0670 t 780 new 0.24) lr 1.00e-05 gnorm 0.080 5.71s mem 15.6GB +[2026-09-13 20:42:29] step 3004/5000 loss 0.0321 (w 0.1181 mse 0.1121 t 948 new 0.28) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 20:42:35] step 3005/5000 loss 0.0888 (w 0.1345 mse 0.1376 t 953 new 0.21) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 20:42:40] step 3006/5000 loss 0.0909 (w 0.0838 mse 0.0838 t 904 new 0.19) lr 1.00e-05 gnorm 0.054 5.77s mem 15.6GB +[2026-09-13 20:42:46] step 3007/5000 loss 0.0781 (w 0.0719 mse 0.0631 t 723 new 0.24) lr 1.00e-05 gnorm 0.062 5.73s mem 15.6GB +[2026-09-13 20:42:52] step 3008/5000 loss 0.0984 (w 0.0861 mse 0.0880 t 790 new 0.24) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 20:42:58] step 3009/5000 loss 0.0781 (w 0.0548 mse 0.0514 t 871 new 0.26) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 20:43:03] step 3010/5000 loss 0.0962 (w 0.0550 mse 0.0528 t 574 new 0.13) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 20:43:09] step 3011/5000 loss 0.0968 (w 0.1861 mse 0.1672 t 965 new 0.27) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 20:43:15] step 3012/5000 loss 0.0681 (w 0.0650 mse 0.0653 t 914 new 0.24) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +[2026-09-13 20:43:20] step 3013/5000 loss 0.0871 (w 0.0762 mse 0.0731 t 933 new 0.25) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 20:43:26] step 3014/5000 loss 0.1426 (w 0.1225 mse 0.1160 t 929 new 0.23) lr 1.00e-05 gnorm 0.109 5.69s mem 15.6GB +[2026-09-13 20:43:32] step 3015/5000 loss 0.0773 (w 0.0299 mse 0.0302 t 803 new 0.12) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:43:37] step 3016/5000 loss 0.0961 (w 0.0764 mse 0.0748 t 802 new 0.23) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 20:43:43] step 3017/5000 loss 0.1061 (w 0.2995 mse 0.2990 t 122 new 0.22) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 20:43:49] step 3018/5000 loss 0.1284 (w 0.0864 mse 0.0824 t 478 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 20:43:55] step 3019/5000 loss 0.0768 (w 0.0485 mse 0.0451 t 810 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 20:44:00] step 3020/5000 loss 0.0743 (w 0.0307 mse 0.0351 t 516 new 0.15) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 20:44:06] step 3021/5000 loss 0.0978 (w 0.0700 mse 0.0702 t 912 new 0.26) lr 1.00e-05 gnorm 0.092 5.82s mem 15.6GB +[2026-09-13 20:44:12] step 3022/5000 loss 0.0837 (w 0.0600 mse 0.0577 t 725 new 0.12) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 20:44:18] step 3023/5000 loss 0.0474 (w 0.0668 mse 0.0680 t 950 new 0.10) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 20:44:23] step 3024/5000 loss 0.1388 (w 0.0821 mse 0.0737 t 933 new 0.23) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 20:44:29] step 3025/5000 loss 0.0541 (w 0.1614 mse 0.1493 t 988 new 0.24) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 20:44:35] step 3026/5000 loss 0.0546 (w 0.1078 mse 0.1050 t 988 new 0.21) lr 1.00e-05 gnorm 0.052 5.71s mem 15.6GB +[2026-09-13 20:44:40] step 3027/5000 loss 0.0902 (w 0.1715 mse 0.1576 t 999 new 0.26) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 20:44:47] step 3028/5000 loss 0.0851 (w 0.0926 mse 0.0884 t 961 new 0.23) lr 1.00e-05 gnorm 0.066 6.13s mem 15.6GB +[2026-09-13 20:44:52] step 3029/5000 loss 0.0821 (w 0.0767 mse 0.0808 t 482 new 0.17) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 20:44:58] step 3030/5000 loss 0.0536 (w 0.1221 mse 0.1125 t 967 new 0.27) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 20:45:04] step 3031/5000 loss 0.0778 (w 0.0699 mse 0.0659 t 689 new 0.30) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 20:45:09] step 3032/5000 loss 0.0944 (w 0.1005 mse 0.0939 t 906 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 20:45:15] step 3033/5000 loss 0.0722 (w 0.1037 mse 0.1017 t 957 new 0.19) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:45:21] step 3034/5000 loss 0.0766 (w 0.0723 mse 0.0657 t 777 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:45:26] step 3035/5000 loss 0.0788 (w 0.2624 mse 0.2593 t 142 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:45:32] step 3036/5000 loss 0.1139 (w 0.0655 mse 0.0611 t 948 new 0.26) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 20:45:38] step 3037/5000 loss 0.1002 (w 0.0843 mse 0.0808 t 859 new 0.23) lr 1.00e-05 gnorm 0.067 5.93s mem 15.6GB +[2026-09-13 20:45:44] step 3038/5000 loss 0.0814 (w 0.0861 mse 0.0836 t 895 new 0.24) lr 1.00e-05 gnorm 0.071 5.98s mem 15.6GB +[2026-09-13 20:45:50] step 3039/5000 loss 0.0841 (w 0.0668 mse 0.0669 t 930 new 0.17) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:45:56] step 3040/5000 loss 0.0820 (w 0.0267 mse 0.0297 t 495 new 0.16) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:46:02] step 3041/5000 loss 0.0589 (w 0.0617 mse 0.0622 t 961 new 0.20) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +[2026-09-13 20:46:07] step 3042/5000 loss 0.0660 (w 0.0873 mse 0.0842 t 926 new 0.19) lr 1.00e-05 gnorm 0.058 5.75s mem 15.6GB +[2026-09-13 20:46:13] step 3043/5000 loss 0.0978 (w 0.0955 mse 0.0932 t 617 new 0.25) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 20:46:19] step 3044/5000 loss 0.0749 (w 0.0498 mse 0.0479 t 840 new 0.22) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 20:46:24] step 3045/5000 loss 0.0803 (w 0.0843 mse 0.0805 t 770 new 0.24) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 20:46:30] step 3046/5000 loss 0.1147 (w 0.1085 mse 0.1117 t 264 new 0.30) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 20:46:36] step 3047/5000 loss 0.0784 (w 0.0791 mse 0.0878 t 971 new 0.25) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 20:46:42] step 3048/5000 loss 0.0919 (w 0.1822 mse 0.1811 t 225 new 0.23) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 20:46:48] step 3049/5000 loss 0.1165 (w 0.0884 mse 0.0833 t 834 new 0.25) lr 1.00e-05 gnorm 0.067 5.93s mem 15.6GB +[2026-09-13 20:46:53] step 3050/5000 loss 0.0468 (w 0.2143 mse 0.2119 t 990 new 0.29) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 20:46:59] step 3051/5000 loss 0.0906 (w 0.0568 mse 0.0540 t 786 new 0.20) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 20:47:05] step 3052/5000 loss 0.1216 (w 0.0998 mse 0.0926 t 908 new 0.26) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 20:47:11] step 3053/5000 loss 0.0600 (w 0.1467 mse 0.1368 t 979 new 0.27) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 20:47:16] step 3054/5000 loss 0.0952 (w 0.0866 mse 0.0963 t 336 new 0.12) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 20:47:22] step 3055/5000 loss 0.0554 (w 0.1465 mse 0.1413 t 986 new 0.28) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 20:47:28] step 3056/5000 loss 0.0772 (w 0.0558 mse 0.0531 t 792 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 20:47:33] step 3057/5000 loss 0.1140 (w 0.0937 mse 0.0941 t 865 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:47:39] step 3058/5000 loss 0.0659 (w 0.0733 mse 0.0704 t 533 new 0.27) lr 1.00e-05 gnorm 0.065 5.93s mem 15.6GB +[2026-09-13 20:47:45] step 3059/5000 loss 0.1172 (w 0.1050 mse 0.1017 t 810 new 0.23) lr 1.00e-05 gnorm 0.072 5.93s mem 15.6GB +[2026-09-13 20:47:51] step 3060/5000 loss 0.0544 (w 0.0676 mse 0.0629 t 909 new 0.12) lr 1.00e-05 gnorm 0.065 5.74s mem 15.6GB +[2026-09-13 20:47:57] step 3061/5000 loss 0.1225 (w 0.0628 mse 0.0631 t 740 new 0.24) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 20:48:02] step 3062/5000 loss 0.0679 (w 0.0937 mse 0.0927 t 836 new 0.17) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 20:48:08] step 3063/5000 loss 0.0903 (w 0.0141 mse 0.0144 t 644 new 0.12) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:48:14] step 3064/5000 loss 0.0806 (w 0.0556 mse 0.0535 t 522 new 0.11) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:48:19] step 3065/5000 loss 0.0700 (w 0.0818 mse 0.0780 t 929 new 0.15) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 20:48:25] step 3066/5000 loss 0.0839 (w 0.0578 mse 0.0543 t 908 new 0.25) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 20:48:31] step 3067/5000 loss 0.0729 (w 0.1508 mse 0.1434 t 995 new 0.28) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 20:48:37] step 3068/5000 loss 0.0613 (w 0.0913 mse 0.0826 t 828 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 20:48:43] step 3069/5000 loss 0.0642 (w 0.0393 mse 0.0422 t 724 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:48:48] step 3070/5000 loss 0.1350 (w 0.0752 mse 0.0764 t 746 new 0.20) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 20:48:54] step 3071/5000 loss 0.0504 (w 0.0848 mse 0.0867 t 951 new 0.22) lr 1.00e-05 gnorm 0.063 5.96s mem 15.6GB +[2026-09-13 20:49:00] step 3072/5000 loss 0.1116 (w 0.0673 mse 0.0641 t 886 new 0.24) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 20:49:06] step 3073/5000 loss 0.1067 (w 0.1556 mse 0.1454 t 979 new 0.23) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 20:49:11] step 3074/5000 loss 0.0797 (w 0.1377 mse 0.1394 t 990 new 0.25) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 20:49:17] step 3075/5000 loss 0.1016 (w 0.0957 mse 0.0882 t 925 new 0.23) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 20:49:23] step 3076/5000 loss 0.0925 (w 0.0397 mse 0.0396 t 812 new 0.09) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:49:29] step 3077/5000 loss 0.0582 (w 0.1296 mse 0.1265 t 979 new 0.13) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 20:49:34] step 3078/5000 loss 0.1100 (w 0.0951 mse 0.0934 t 875 new 0.23) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:49:40] step 3079/5000 loss 0.0963 (w 0.0448 mse 0.0451 t 774 new 0.12) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 20:49:46] step 3080/5000 loss 0.0836 (w 0.1124 mse 0.1135 t 802 new 0.30) lr 1.00e-05 gnorm 0.055 5.94s mem 15.6GB +[2026-09-13 20:49:52] step 3081/5000 loss 0.1102 (w 0.0727 mse 0.0772 t 430 new 0.28) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:49:57] step 3082/5000 loss 0.0525 (w 0.0687 mse 0.0639 t 861 new 0.26) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 20:50:03] step 3083/5000 loss 0.0685 (w 0.1090 mse 0.0967 t 868 new 0.26) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 20:50:09] step 3084/5000 loss 0.0792 (w 0.0735 mse 0.0695 t 671 new 0.20) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 20:50:14] step 3085/5000 loss 0.1198 (w 0.1612 mse 0.1605 t 291 new 0.17) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 20:50:20] step 3086/5000 loss 0.1293 (w 0.1248 mse 0.1192 t 620 new 0.21) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 20:50:26] step 3087/5000 loss 0.0610 (w 0.1744 mse 0.1662 t 982 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:50:32] step 3088/5000 loss 0.1014 (w 0.0513 mse 0.0515 t 684 new 0.12) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 20:50:37] step 3089/5000 loss 0.0362 (w 0.0636 mse 0.0629 t 815 new 0.22) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +[2026-09-13 20:50:43] step 3090/5000 loss 0.0998 (w 0.0518 mse 0.0509 t 480 new 0.27) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:50:49] step 3091/5000 loss 0.1135 (w 0.0875 mse 0.0907 t 851 new 0.26) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 20:50:55] step 3092/5000 loss 0.0863 (w 0.0556 mse 0.0560 t 587 new 0.22) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 20:51:01] step 3093/5000 loss 0.0783 (w 0.0527 mse 0.0482 t 818 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:51:07] step 3094/5000 loss 0.0962 (w 0.1581 mse 0.1546 t 270 new 0.26) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 20:51:12] step 3095/5000 loss 0.0509 (w 0.1618 mse 0.1582 t 990 new 0.17) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 20:51:18] step 3096/5000 loss 0.1091 (w 0.0624 mse 0.0602 t 515 new 0.24) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 20:51:24] step 3097/5000 loss 0.0810 (w 0.0530 mse 0.0542 t 764 new 0.24) lr 1.00e-05 gnorm 0.056 5.84s mem 15.6GB +[2026-09-13 20:51:30] step 3098/5000 loss 0.0738 (w 0.1203 mse 0.1160 t 960 new 0.21) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 20:51:35] step 3099/5000 loss 0.0656 (w 0.1053 mse 0.0993 t 967 new 0.22) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 20:51:41] step 3100/5000 loss 0.1258 (w 0.0934 mse 0.0862 t 802 new 0.24) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 20:51:47] step 3101/5000 loss 0.0649 (w 0.0602 mse 0.0584 t 863 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 20:51:53] step 3102/5000 loss 0.0508 (w 0.1016 mse 0.0959 t 978 new 0.10) lr 1.00e-05 gnorm 0.082 5.88s mem 15.6GB +[2026-09-13 20:51:58] step 3103/5000 loss 0.0722 (w 0.0666 mse 0.0640 t 865 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 20:52:04] step 3104/5000 loss 0.0999 (w 0.0646 mse 0.0628 t 717 new 0.26) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 20:52:10] step 3105/5000 loss 0.1097 (w 0.0672 mse 0.0660 t 651 new 0.27) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 20:52:15] step 3106/5000 loss 0.1082 (w 0.1831 mse 0.1687 t 998 new 0.22) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 20:52:21] step 3107/5000 loss 0.0721 (w 0.0819 mse 0.0798 t 798 new 0.18) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 20:52:27] step 3108/5000 loss 0.1111 (w 0.1077 mse 0.1018 t 742 new 0.26) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 20:52:33] step 3109/5000 loss 0.0703 (w 0.1596 mse 0.1506 t 1000 new 0.18) lr 1.00e-05 gnorm 0.062 5.84s mem 15.6GB +[2026-09-13 20:52:38] step 3110/5000 loss 0.1361 (w 0.0972 mse 0.0968 t 527 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 20:52:44] step 3111/5000 loss 0.0909 (w 0.0973 mse 0.0896 t 898 new 0.26) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 20:52:50] step 3112/5000 loss 0.0805 (w 0.1425 mse 0.1412 t 951 new 0.25) lr 1.00e-05 gnorm 0.062 5.71s mem 15.6GB +[2026-09-13 20:52:56] step 3113/5000 loss 0.0650 (w 0.0565 mse 0.0496 t 784 new 0.23) lr 1.00e-05 gnorm 0.061 5.95s mem 15.6GB +[2026-09-13 20:53:01] step 3114/5000 loss 0.1299 (w 0.0896 mse 0.0895 t 839 new 0.17) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:53:07] step 3115/5000 loss 0.0819 (w 0.0782 mse 0.0742 t 954 new 0.13) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 20:53:13] step 3116/5000 loss 0.0807 (w 0.1050 mse 0.0969 t 936 new 0.21) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 20:53:19] step 3117/5000 loss 0.0871 (w 0.1795 mse 0.1593 t 994 new 0.21) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 20:53:24] step 3118/5000 loss 0.0475 (w 0.0490 mse 0.0563 t 985 new 0.21) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +[2026-09-13 20:53:30] step 3119/5000 loss 0.0695 (w 0.0678 mse 0.0667 t 862 new 0.24) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +[2026-09-13 20:53:36] step 3120/5000 loss 0.1169 (w 0.0724 mse 0.0700 t 349 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:53:41] step 3121/5000 loss 0.0818 (w 0.1579 mse 0.1475 t 983 new 0.26) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:53:47] step 3122/5000 loss 0.0900 (w 0.0726 mse 0.0697 t 873 new 0.25) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 20:53:53] step 3123/5000 loss 0.1313 (w 0.1388 mse 0.1312 t 235 new 0.24) lr 1.00e-05 gnorm 0.057 5.81s mem 15.6GB +[2026-09-13 20:53:59] step 3124/5000 loss 0.0916 (w 0.0303 mse 0.0349 t 860 new 0.22) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 20:54:04] step 3125/5000 loss 0.1329 (w 0.1010 mse 0.0923 t 906 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:54:10] step 3126/5000 loss 0.0803 (w 0.0919 mse 0.0873 t 513 new 0.23) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +[2026-09-13 20:54:16] step 3127/5000 loss 0.0992 (w 0.1009 mse 0.0978 t 786 new 0.25) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 20:54:21] step 3128/5000 loss 0.1603 (w 0.0699 mse 0.0698 t 838 new 0.20) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 20:54:27] step 3129/5000 loss 0.1002 (w 0.1243 mse 0.1223 t 457 new 0.22) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 20:54:33] step 3130/5000 loss 0.1044 (w 0.0814 mse 0.0776 t 911 new 0.29) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:54:39] step 3131/5000 loss 0.0866 (w 0.0453 mse 0.0463 t 850 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 20:54:44] step 3132/5000 loss 0.0924 (w 0.0515 mse 0.0552 t 457 new 0.24) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 20:54:50] step 3133/5000 loss 0.0858 (w 0.0614 mse 0.0592 t 572 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 20:54:56] step 3134/5000 loss 0.0928 (w 0.2051 mse 0.1970 t 229 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 20:55:01] step 3135/5000 loss 0.0797 (w 0.0850 mse 0.0769 t 748 new 0.26) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 20:55:07] step 3136/5000 loss 0.0628 (w 0.0509 mse 0.0481 t 896 new 0.27) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 20:55:13] step 3137/5000 loss 0.1050 (w 0.1412 mse 0.1398 t 382 new 0.23) lr 1.00e-05 gnorm 0.057 5.71s mem 15.6GB +[2026-09-13 20:55:18] step 3138/5000 loss 0.0640 (w 0.0430 mse 0.0406 t 913 new 0.14) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +[2026-09-13 20:55:24] step 3139/5000 loss 0.0876 (w 0.1044 mse 0.1039 t 914 new 0.21) lr 1.00e-05 gnorm 0.058 5.85s mem 15.6GB +[2026-09-13 20:55:30] step 3140/5000 loss 0.1061 (w 0.1107 mse 0.1064 t 999 new 0.23) lr 1.00e-05 gnorm 0.065 5.75s mem 15.6GB +[2026-09-13 20:55:36] step 3141/5000 loss 0.0940 (w 0.7428 mse 0.7436 t 29 new 0.26) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:55:42] step 3142/5000 loss 0.0895 (w 0.1385 mse 0.1354 t 985 new 0.26) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 20:55:47] step 3143/5000 loss 0.0707 (w 0.3408 mse 0.3080 t 998 new 0.25) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 20:55:53] step 3144/5000 loss 0.0646 (w 0.0528 mse 0.0507 t 732 new 0.23) lr 1.00e-05 gnorm 0.058 5.85s mem 15.6GB +[2026-09-13 20:55:59] step 3145/5000 loss 0.0790 (w 0.0710 mse 0.0695 t 733 new 0.24) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 20:56:04] step 3146/5000 loss 0.1075 (w 0.0658 mse 0.0620 t 744 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 20:56:10] step 3147/5000 loss 0.1038 (w 0.0714 mse 0.0695 t 502 new 0.22) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 20:56:16] step 3148/5000 loss 0.1206 (w 0.1560 mse 0.1703 t 154 new 0.31) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 20:56:22] step 3149/5000 loss 0.0644 (w 0.1750 mse 0.1604 t 986 new 0.25) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 20:56:28] step 3150/5000 loss 0.0771 (w 0.1252 mse 0.1153 t 955 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 20:56:33] step 3151/5000 loss 0.1041 (w 0.6232 mse 0.6480 t 48 new 0.25) lr 1.00e-05 gnorm 0.050 5.68s mem 15.6GB +[2026-09-13 20:56:39] step 3152/5000 loss 0.0557 (w 0.1132 mse 0.1078 t 969 new 0.22) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 20:56:45] step 3153/5000 loss 0.1221 (w 0.0499 mse 0.0522 t 649 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 20:56:50] step 3154/5000 loss 0.0856 (w 0.1026 mse 0.0942 t 913 new 0.26) lr 1.00e-05 gnorm 0.068 5.73s mem 15.6GB +[2026-09-13 20:56:56] step 3155/5000 loss 0.1113 (w 0.0774 mse 0.0736 t 911 new 0.26) lr 1.00e-05 gnorm 0.057 5.84s mem 15.6GB +[2026-09-13 20:57:02] step 3156/5000 loss 0.0701 (w 0.0555 mse 0.0578 t 886 new 0.28) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 20:57:08] step 3157/5000 loss 0.0947 (w 0.1517 mse 0.1397 t 972 new 0.25) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 20:57:13] step 3158/5000 loss 0.0998 (w 0.0757 mse 0.0701 t 632 new 0.17) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 20:57:19] step 3159/5000 loss 0.0731 (w 0.0580 mse 0.0557 t 768 new 0.25) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:57:25] step 3160/5000 loss 0.0655 (w 0.0687 mse 0.0646 t 791 new 0.23) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 20:57:30] step 3161/5000 loss 0.0665 (w 0.1203 mse 0.1168 t 966 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:57:36] step 3162/5000 loss 0.0975 (w 0.0833 mse 0.0812 t 958 new 0.14) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 20:57:42] step 3163/5000 loss 0.0931 (w 0.0501 mse 0.0503 t 801 new 0.12) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 20:57:48] step 3164/5000 loss 0.0536 (w 0.1056 mse 0.1026 t 933 new 0.23) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 20:57:54] step 3165/5000 loss 0.1076 (w 0.0842 mse 0.0826 t 942 new 0.20) lr 1.00e-05 gnorm 0.053 5.86s mem 15.6GB +[2026-09-13 20:57:59] step 3166/5000 loss 0.1028 (w 0.1089 mse 0.1066 t 294 new 0.17) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 20:58:05] step 3167/5000 loss 0.0637 (w 0.1046 mse 0.1004 t 915 new 0.19) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 20:58:11] step 3168/5000 loss 0.0529 (w 0.0380 mse 0.0383 t 923 new 0.23) lr 1.00e-05 gnorm 0.057 5.79s mem 15.6GB +[2026-09-13 20:58:17] step 3169/5000 loss 0.1196 (w 0.0616 mse 0.0616 t 947 new 0.10) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 20:58:22] step 3170/5000 loss 0.0927 (w 0.0888 mse 0.0904 t 974 new 0.17) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 20:58:28] step 3171/5000 loss 0.0534 (w 0.1200 mse 0.1142 t 984 new 0.14) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 20:58:34] step 3172/5000 loss 0.0971 (w 0.0521 mse 0.0471 t 842 new 0.17) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 20:58:39] step 3173/5000 loss 0.0625 (w 0.0785 mse 0.0719 t 476 new 0.20) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 20:58:45] step 3174/5000 loss 0.0967 (w 0.0626 mse 0.0699 t 905 new 0.23) lr 1.00e-05 gnorm 0.059 5.93s mem 15.6GB +[2026-09-13 20:58:51] step 3175/5000 loss 0.0795 (w 0.0900 mse 0.0856 t 535 new 0.25) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 20:58:57] step 3176/5000 loss 0.1256 (w 0.1808 mse 0.1798 t 183 new 0.21) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 20:59:03] step 3177/5000 loss 0.0889 (w 0.0820 mse 0.0827 t 790 new 0.08) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 20:59:08] step 3178/5000 loss 0.1048 (w 0.0415 mse 0.0389 t 871 new 0.22) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 20:59:14] step 3179/5000 loss 0.0884 (w 0.0520 mse 0.0471 t 699 new 0.14) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 20:59:20] step 3180/5000 loss 0.1344 (w 0.1492 mse 0.1344 t 962 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:59:26] step 3181/5000 loss 0.0787 (w 0.0757 mse 0.0776 t 961 new 0.24) lr 1.00e-05 gnorm 0.059 5.92s mem 15.6GB +[2026-09-13 20:59:32] step 3182/5000 loss 0.0829 (w 0.0555 mse 0.0540 t 671 new 0.21) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 20:59:37] step 3183/5000 loss 0.0810 (w 0.0484 mse 0.0507 t 557 new 0.20) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 20:59:43] step 3184/5000 loss 0.1224 (w 0.1007 mse 0.0950 t 959 new 0.26) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 20:59:49] step 3185/5000 loss 0.1061 (w 0.0480 mse 0.0493 t 773 new 0.28) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 20:59:54] step 3186/5000 loss 0.0718 (w 0.0841 mse 0.0826 t 457 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 21:00:00] step 3187/5000 loss 0.0662 (w 0.0646 mse 0.0580 t 836 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:00:06] step 3188/5000 loss 0.0811 (w 0.1195 mse 0.1128 t 948 new 0.28) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 21:00:12] step 3189/5000 loss 0.0935 (w 0.1142 mse 0.1138 t 991 new 0.24) lr 1.00e-05 gnorm 0.056 5.72s mem 15.6GB +[2026-09-13 21:00:17] step 3190/5000 loss 0.1042 (w 0.2331 mse 0.2312 t 169 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:00:23] step 3191/5000 loss 0.0658 (w 0.0432 mse 0.0466 t 824 new 0.26) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 21:00:29] step 3192/5000 loss 0.0877 (w 0.1418 mse 0.1398 t 781 new 0.19) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +[2026-09-13 21:00:34] step 3193/5000 loss 0.1290 (w 0.0882 mse 0.0801 t 907 new 0.24) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 21:00:40] step 3194/5000 loss 0.0483 (w 0.0594 mse 0.0565 t 855 new 0.24) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 21:00:46] step 3195/5000 loss 0.1184 (w 0.6814 mse 0.6809 t 39 new 0.15) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 21:00:52] step 3196/5000 loss 0.0912 (w 0.0531 mse 0.0493 t 954 new 0.26) lr 1.00e-05 gnorm 0.071 5.93s mem 15.6GB +[2026-09-13 21:00:58] step 3197/5000 loss 0.1208 (w 0.1019 mse 0.0980 t 582 new 0.24) lr 1.00e-05 gnorm 0.070 5.97s mem 15.6GB +[2026-09-13 21:01:03] step 3198/5000 loss 0.1595 (w 0.0967 mse 0.0920 t 946 new 0.14) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 21:01:09] step 3199/5000 loss 0.1348 (w 0.2013 mse 0.1995 t 309 new 0.22) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 21:01:15] step 3200/5000 loss 0.1229 (w 0.2221 mse 0.2213 t 130 new 0.19) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 21:01:21] step 3201/5000 loss 0.0746 (w 0.0935 mse 0.0866 t 844 new 0.25) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:01:26] step 3202/5000 loss 0.1114 (w 0.0621 mse 0.0628 t 775 new 0.22) lr 1.00e-05 gnorm 0.075 5.93s mem 15.6GB +[2026-09-13 21:01:32] step 3203/5000 loss 0.0986 (w 0.0827 mse 0.0796 t 794 new 0.21) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 21:01:38] step 3204/5000 loss 0.0834 (w 0.0647 mse 0.0619 t 799 new 0.25) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 21:01:44] step 3205/5000 loss 0.0524 (w 0.0600 mse 0.0570 t 915 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 21:01:49] step 3206/5000 loss 0.0722 (w 0.0644 mse 0.0635 t 602 new 0.11) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +[2026-09-13 21:01:55] step 3207/5000 loss 0.1253 (w 0.0621 mse 0.0636 t 492 new 0.16) lr 1.00e-05 gnorm 0.089 5.88s mem 15.6GB +[2026-09-13 21:02:01] step 3208/5000 loss 0.1275 (w 0.0859 mse 0.0866 t 658 new 0.18) lr 1.00e-05 gnorm 0.062 5.90s mem 15.6GB +[2026-09-13 21:02:07] step 3209/5000 loss 0.0993 (w 0.0752 mse 0.0742 t 642 new 0.23) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 21:02:12] step 3210/5000 loss 0.0894 (w 0.1947 mse 0.1911 t 1000 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 21:02:18] step 3211/5000 loss 0.0761 (w 0.0515 mse 0.0501 t 620 new 0.23) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 21:02:24] step 3212/5000 loss 0.0720 (w 0.1107 mse 0.1107 t 945 new 0.20) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 21:02:30] step 3213/5000 loss 0.0732 (w 0.0647 mse 0.0622 t 796 new 0.26) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +[2026-09-13 21:02:35] step 3214/5000 loss 0.0626 (w 0.1101 mse 0.1135 t 943 new 0.12) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:02:41] step 3215/5000 loss 0.0594 (w 0.2231 mse 0.2061 t 983 new 0.27) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 21:02:47] step 3216/5000 loss 0.0800 (w 0.0957 mse 0.0941 t 408 new 0.22) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 21:02:53] step 3217/5000 loss 0.1151 (w 0.2359 mse 0.2318 t 187 new 0.32) lr 1.00e-05 gnorm 0.058 5.93s mem 15.6GB +[2026-09-13 21:02:58] step 3218/5000 loss 0.1020 (w 0.1094 mse 0.1079 t 880 new 0.14) lr 1.00e-05 gnorm 0.058 5.73s mem 15.6GB +[2026-09-13 21:03:04] step 3219/5000 loss 0.1641 (w 0.1443 mse 0.1371 t 270 new 0.22) lr 1.00e-05 gnorm 0.059 5.82s mem 15.6GB +[2026-09-13 21:03:10] step 3220/5000 loss 0.0853 (w 0.0436 mse 0.0428 t 670 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:03:16] step 3221/5000 loss 0.0648 (w 0.1125 mse 0.1069 t 894 new 0.29) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 21:03:21] step 3222/5000 loss 0.0816 (w 0.0526 mse 0.0528 t 804 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 21:03:27] step 3223/5000 loss 0.1516 (w 0.0591 mse 0.0568 t 664 new 0.27) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 21:03:33] step 3224/5000 loss 0.1032 (w 0.0861 mse 0.0787 t 777 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:03:39] step 3225/5000 loss 0.0552 (w 0.1752 mse 0.1650 t 980 new 0.29) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 21:03:44] step 3226/5000 loss 0.0925 (w 0.0855 mse 0.0832 t 551 new 0.23) lr 1.00e-05 gnorm 0.102 5.69s mem 15.6GB +[2026-09-13 21:03:50] step 3227/5000 loss 0.0582 (w 0.1055 mse 0.1082 t 978 new 0.11) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 21:03:56] step 3228/5000 loss 0.0762 (w 0.0773 mse 0.0740 t 819 new 0.21) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +[2026-09-13 21:04:01] step 3229/5000 loss 0.0846 (w 0.0989 mse 0.0988 t 954 new 0.30) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 21:04:07] step 3230/5000 loss 0.0796 (w 0.0531 mse 0.0551 t 767 new 0.28) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 21:04:13] step 3231/5000 loss 0.1449 (w 0.1159 mse 0.1089 t 879 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:04:18] step 3232/5000 loss 0.1044 (w 0.0707 mse 0.0638 t 798 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:04:24] step 3233/5000 loss 0.1174 (w 0.1111 mse 0.1083 t 455 new 0.18) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:04:30] step 3234/5000 loss 0.0855 (w 0.1123 mse 0.1061 t 676 new 0.26) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 21:04:36] step 3235/5000 loss 0.0770 (w 0.0774 mse 0.0775 t 473 new 0.28) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 21:04:41] step 3236/5000 loss 0.0829 (w 0.0641 mse 0.0653 t 930 new 0.18) lr 1.00e-05 gnorm 0.047 5.70s mem 15.6GB +[2026-09-13 21:04:47] step 3237/5000 loss 0.1192 (w 0.8540 mse 0.8455 t 25 new 0.29) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:04:53] step 3238/5000 loss 0.1042 (w 0.0296 mse 0.0304 t 603 new 0.14) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 21:04:59] step 3239/5000 loss 0.0738 (w 0.0697 mse 0.0668 t 880 new 0.30) lr 1.00e-05 gnorm 0.054 5.83s mem 15.6GB +[2026-09-13 21:05:04] step 3240/5000 loss 0.1179 (w 0.0445 mse 0.0405 t 873 new 0.27) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 21:05:10] step 3241/5000 loss 0.0662 (w 0.1454 mse 0.1357 t 943 new 0.22) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 21:05:16] step 3242/5000 loss 0.0800 (w 0.1022 mse 0.0978 t 817 new 0.18) lr 1.00e-05 gnorm 0.051 5.84s mem 15.6GB +[2026-09-13 21:05:22] step 3243/5000 loss 0.0973 (w 0.1110 mse 0.1160 t 285 new 0.22) lr 1.00e-05 gnorm 0.062 5.72s mem 15.6GB +[2026-09-13 21:05:27] step 3244/5000 loss 0.0734 (w 0.0825 mse 0.0766 t 868 new 0.27) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 21:05:33] step 3245/5000 loss 0.0925 (w 0.0927 mse 0.0888 t 528 new 0.17) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:05:39] step 3246/5000 loss 0.1226 (w 0.0328 mse 0.0329 t 722 new 0.08) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:05:44] step 3247/5000 loss 0.1347 (w 0.4496 mse 0.4591 t 84 new 0.21) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 21:05:50] step 3248/5000 loss 0.0649 (w 0.0802 mse 0.0809 t 908 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 21:05:56] step 3249/5000 loss 0.0748 (w 0.0661 mse 0.0650 t 784 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 21:06:02] step 3250/5000 loss 0.1045 (w 0.0336 mse 0.0334 t 850 new 0.23) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 21:06:07] step 3251/5000 loss 0.0506 (w 0.0363 mse 0.0354 t 909 new 0.15) lr 1.00e-05 gnorm 0.055 5.90s mem 15.6GB +[2026-09-13 21:06:13] step 3252/5000 loss 0.0999 (w 0.0926 mse 0.0920 t 955 new 0.25) lr 1.00e-05 gnorm 0.070 5.96s mem 15.6GB +[2026-09-13 21:06:19] step 3253/5000 loss 0.0890 (w 0.0930 mse 0.0906 t 948 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 21:06:25] step 3254/5000 loss 0.0506 (w 0.0645 mse 0.0671 t 858 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 21:06:31] step 3255/5000 loss 0.0713 (w 0.0931 mse 0.0909 t 967 new 0.18) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 21:06:36] step 3256/5000 loss 0.1108 (w 0.1696 mse 0.1629 t 997 new 0.13) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:06:42] step 3257/5000 loss 0.0840 (w 0.2051 mse 0.2025 t 986 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 21:06:48] step 3258/5000 loss 0.0865 (w 0.1650 mse 0.1548 t 970 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:06:53] step 3259/5000 loss 0.0344 (w 0.1636 mse 0.1492 t 984 new 0.22) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 21:06:59] step 3260/5000 loss 0.0616 (w 0.0508 mse 0.0518 t 938 new 0.12) lr 1.00e-05 gnorm 0.055 6.05s mem 15.6GB +[2026-09-13 21:07:05] step 3261/5000 loss 0.0621 (w 0.0942 mse 0.0866 t 842 new 0.30) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 21:07:11] step 3262/5000 loss 0.1206 (w 0.6819 mse 0.6938 t 39 new 0.18) lr 1.00e-05 gnorm 0.081 6.17s mem 15.6GB +[2026-09-13 21:07:17] step 3263/5000 loss 0.1101 (w 0.1244 mse 0.1121 t 966 new 0.31) lr 1.00e-05 gnorm 0.054 5.92s mem 15.6GB +[2026-09-13 21:07:23] step 3264/5000 loss 0.1079 (w 0.0592 mse 0.0615 t 678 new 0.09) lr 1.00e-05 gnorm 0.079 5.70s mem 15.6GB +[2026-09-13 21:07:29] step 3265/5000 loss 0.0522 (w 0.1190 mse 0.1038 t 995 new 0.23) lr 1.00e-05 gnorm 0.047 5.71s mem 15.6GB +[2026-09-13 21:07:34] step 3266/5000 loss 0.0728 (w 0.0564 mse 0.0562 t 907 new 0.08) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 21:07:40] step 3267/5000 loss 0.0675 (w 0.0694 mse 0.0664 t 907 new 0.24) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 21:07:46] step 3268/5000 loss 0.0875 (w 0.0854 mse 0.0800 t 922 new 0.23) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 21:07:51] step 3269/5000 loss 0.0601 (w 0.0503 mse 0.0510 t 766 new 0.23) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 21:07:57] step 3270/5000 loss 0.0909 (w 0.0771 mse 0.0748 t 849 new 0.18) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 21:08:03] step 3271/5000 loss 0.0744 (w 0.2357 mse 0.2229 t 995 new 0.29) lr 1.00e-05 gnorm 0.056 5.79s mem 15.6GB +[2026-09-13 21:08:09] step 3272/5000 loss 0.0384 (w 0.1431 mse 0.1404 t 984 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:08:14] step 3273/5000 loss 0.0679 (w 0.0582 mse 0.0622 t 964 new 0.23) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 21:08:20] step 3274/5000 loss 0.0820 (w 0.0635 mse 0.0562 t 918 new 0.22) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 21:08:26] step 3275/5000 loss 0.0643 (w 0.0936 mse 0.0852 t 898 new 0.24) lr 1.00e-05 gnorm 0.060 5.83s mem 15.6GB +[2026-09-13 21:08:32] step 3276/5000 loss 0.0940 (w 0.0613 mse 0.0593 t 734 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 21:08:37] step 3277/5000 loss 0.0897 (w 0.1120 mse 0.1108 t 973 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 21:08:43] step 3278/5000 loss 0.0894 (w 0.1938 mse 0.1904 t 201 new 0.18) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:08:49] step 3279/5000 loss 0.0813 (w 0.0663 mse 0.0657 t 685 new 0.29) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 21:08:54] step 3280/5000 loss 0.0952 (w 0.0918 mse 0.0922 t 344 new 0.21) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 21:09:00] step 3281/5000 loss 0.0832 (w 0.1258 mse 0.1238 t 957 new 0.22) lr 1.00e-05 gnorm 0.060 5.94s mem 15.6GB +[2026-09-13 21:09:06] step 3282/5000 loss 0.0558 (w 0.1331 mse 0.1270 t 947 new 0.28) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 21:09:12] step 3283/5000 loss 0.0683 (w 0.0398 mse 0.0437 t 518 new 0.23) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 21:09:18] step 3284/5000 loss 0.1343 (w 0.0700 mse 0.0711 t 945 new 0.28) lr 1.00e-05 gnorm 0.054 5.91s mem 15.6GB +[2026-09-13 21:09:24] step 3285/5000 loss 0.0656 (w 0.0713 mse 0.0704 t 888 new 0.25) lr 1.00e-05 gnorm 0.066 5.72s mem 15.6GB +[2026-09-13 21:09:29] step 3286/5000 loss 0.1008 (w 0.0770 mse 0.0712 t 617 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 21:09:35] step 3287/5000 loss 0.0699 (w 0.0196 mse 0.0227 t 574 new 0.17) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:09:41] step 3288/5000 loss 0.0685 (w 0.1321 mse 0.1275 t 947 new 0.23) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 21:09:46] step 3289/5000 loss 0.0626 (w 0.0537 mse 0.0592 t 871 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 21:09:52] step 3290/5000 loss 0.0832 (w 0.2176 mse 0.2126 t 998 new 0.21) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:09:58] step 3291/5000 loss 0.1257 (w 0.0956 mse 0.0943 t 520 new 0.13) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 21:10:04] step 3292/5000 loss 0.1229 (w 0.0692 mse 0.0645 t 916 new 0.14) lr 1.00e-05 gnorm 0.074 5.71s mem 15.6GB +[2026-09-13 21:10:09] step 3293/5000 loss 0.0829 (w 0.0919 mse 0.0865 t 947 new 0.22) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 21:10:15] step 3294/5000 loss 0.0754 (w 0.1521 mse 0.1458 t 971 new 0.25) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:10:21] step 3295/5000 loss 0.1052 (w 0.1078 mse 0.0913 t 919 new 0.24) lr 1.00e-05 gnorm 0.065 5.87s mem 15.6GB +[2026-09-13 21:10:27] step 3296/5000 loss 0.1380 (w 0.1676 mse 0.1580 t 955 new 0.18) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 21:10:32] step 3297/5000 loss 0.0654 (w 0.0601 mse 0.0555 t 913 new 0.18) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 21:10:38] step 3298/5000 loss 0.1212 (w 0.4795 mse 0.4761 t 57 new 0.11) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:10:44] step 3299/5000 loss 0.1226 (w 0.0644 mse 0.0646 t 867 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 21:10:50] step 3300/5000 loss 0.0737 (w 0.0660 mse 0.0661 t 568 new 0.19) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 21:10:55] step 3301/5000 loss 0.0596 (w 0.0819 mse 0.0843 t 864 new 0.16) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 21:11:01] step 3302/5000 loss 0.1169 (w 0.0674 mse 0.0650 t 620 new 0.23) lr 1.00e-05 gnorm 0.055 6.09s mem 15.6GB +[2026-09-13 21:11:07] step 3303/5000 loss 0.0633 (w 0.0199 mse 0.0227 t 829 new 0.15) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:11:13] step 3304/5000 loss 0.1019 (w 0.0538 mse 0.0527 t 938 new 0.16) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 21:11:19] step 3305/5000 loss 0.0445 (w 0.0736 mse 0.0657 t 611 new 0.17) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +[2026-09-13 21:11:24] step 3306/5000 loss 0.0957 (w 0.0725 mse 0.0709 t 614 new 0.24) lr 1.00e-05 gnorm 0.089 5.69s mem 15.6GB +[2026-09-13 21:11:30] step 3307/5000 loss 0.0645 (w 0.0733 mse 0.0722 t 901 new 0.20) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 21:11:36] step 3308/5000 loss 0.0779 (w 0.1250 mse 0.1194 t 977 new 0.30) lr 1.00e-05 gnorm 0.049 5.85s mem 15.6GB +[2026-09-13 21:11:42] step 3309/5000 loss 0.0463 (w 0.0824 mse 0.0800 t 961 new 0.27) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +[2026-09-13 21:11:47] step 3310/5000 loss 0.0577 (w 0.0533 mse 0.0491 t 858 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 21:11:53] step 3311/5000 loss 0.0948 (w 0.1258 mse 0.1192 t 912 new 0.31) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 21:11:59] step 3312/5000 loss 0.0719 (w 0.1325 mse 0.1204 t 943 new 0.31) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 21:12:05] step 3313/5000 loss 0.1097 (w 0.2782 mse 0.2776 t 1000 new 0.31) lr 1.00e-05 gnorm 0.054 5.88s mem 15.6GB +[2026-09-13 21:12:11] step 3314/5000 loss 0.0975 (w 0.0693 mse 0.0632 t 814 new 0.25) lr 1.00e-05 gnorm 0.060 5.88s mem 15.6GB +[2026-09-13 21:12:16] step 3315/5000 loss 0.1026 (w 0.1464 mse 0.1332 t 973 new 0.26) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:12:22] step 3316/5000 loss 0.1392 (w 0.0706 mse 0.0697 t 596 new 0.10) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:12:28] step 3317/5000 loss 0.0962 (w 0.1040 mse 0.1044 t 365 new 0.30) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 21:12:33] step 3318/5000 loss 0.0862 (w 0.0672 mse 0.0669 t 432 new 0.14) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 21:12:39] step 3319/5000 loss 0.1123 (w 0.0806 mse 0.0813 t 504 new 0.12) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 21:12:45] step 3320/5000 loss 0.0986 (w 0.0582 mse 0.0574 t 461 new 0.20) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:12:51] step 3321/5000 loss 0.0949 (w 0.0647 mse 0.0640 t 805 new 0.22) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 21:12:56] step 3322/5000 loss 0.1465 (w 0.0948 mse 0.0915 t 981 new 0.25) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:13:02] step 3323/5000 loss 0.0789 (w 0.0976 mse 0.0954 t 712 new 0.26) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +[2026-09-13 21:13:08] step 3324/5000 loss 0.0586 (w 0.0809 mse 0.0756 t 934 new 0.20) lr 1.00e-05 gnorm 0.049 5.72s mem 15.6GB +[2026-09-13 21:13:13] step 3325/5000 loss 0.0626 (w 0.1052 mse 0.0955 t 943 new 0.19) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 21:13:19] step 3326/5000 loss 0.0874 (w 0.1634 mse 0.1575 t 280 new 0.24) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 21:13:25] step 3327/5000 loss 0.0790 (w 0.0667 mse 0.0662 t 689 new 0.24) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 21:13:31] step 3328/5000 loss 0.0912 (w 0.0934 mse 0.0936 t 924 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:13:36] step 3329/5000 loss 0.0615 (w 0.0679 mse 0.0652 t 798 new 0.21) lr 1.00e-05 gnorm 0.062 5.72s mem 15.6GB +[2026-09-13 21:13:42] step 3330/5000 loss 0.1060 (w 0.0595 mse 0.0568 t 600 new 0.19) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 21:13:48] step 3331/5000 loss 0.0796 (w 0.0897 mse 0.0879 t 914 new 0.13) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 21:13:53] step 3332/5000 loss 0.0921 (w 0.0827 mse 0.0775 t 859 new 0.20) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:13:59] step 3333/5000 loss 0.1227 (w 0.1290 mse 0.1265 t 996 new 0.19) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:14:05] step 3334/5000 loss 0.0929 (w 0.0617 mse 0.0567 t 778 new 0.24) lr 1.00e-05 gnorm 0.090 5.70s mem 15.6GB +[2026-09-13 21:14:11] step 3335/5000 loss 0.0989 (w 0.5611 mse 0.5514 t 66 new 0.20) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 21:14:16] step 3336/5000 loss 0.1031 (w 0.0798 mse 0.0757 t 624 new 0.24) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 21:14:22] step 3337/5000 loss 0.0859 (w 0.1020 mse 0.1017 t 475 new 0.24) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 21:14:28] step 3338/5000 loss 0.0825 (w 0.1558 mse 0.1500 t 917 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:14:34] step 3339/5000 loss 0.0543 (w 0.0574 mse 0.0580 t 678 new 0.16) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 21:14:39] step 3340/5000 loss 0.1160 (w 0.0434 mse 0.0411 t 549 new 0.21) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 21:14:45] step 3341/5000 loss 0.0829 (w 0.2597 mse 0.2631 t 109 new 0.19) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 21:14:51] step 3342/5000 loss 0.0611 (w 0.1714 mse 0.1717 t 943 new 0.17) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 21:14:56] step 3343/5000 loss 0.0974 (w 0.0159 mse 0.0172 t 794 new 0.13) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 21:15:02] step 3344/5000 loss 0.1711 (w 0.0887 mse 0.0841 t 658 new 0.24) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 21:15:08] step 3345/5000 loss 0.0620 (w 0.0695 mse 0.0694 t 399 new 0.22) lr 1.00e-05 gnorm 0.064 6.26s mem 15.6GB +[2026-09-13 21:15:14] step 3346/5000 loss 0.1141 (w 0.2266 mse 0.2270 t 245 new 0.27) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 21:15:20] step 3347/5000 loss 0.0771 (w 0.1107 mse 0.1068 t 813 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:15:25] step 3348/5000 loss 0.1404 (w 0.0828 mse 0.0820 t 602 new 0.29) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 21:15:31] step 3349/5000 loss 0.0665 (w 0.1032 mse 0.0980 t 884 new 0.28) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 21:15:37] step 3350/5000 loss 0.0753 (w 0.1058 mse 0.1014 t 971 new 0.28) lr 1.00e-05 gnorm 0.072 5.71s mem 15.6GB +[2026-09-13 21:15:43] step 3351/5000 loss 0.0787 (w 0.0732 mse 0.0658 t 701 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 21:15:48] step 3352/5000 loss 0.1124 (w 0.0941 mse 0.0908 t 977 new 0.25) lr 1.00e-05 gnorm 0.091 5.70s mem 15.6GB +[2026-09-13 21:15:54] step 3353/5000 loss 0.0982 (w 0.0800 mse 0.0826 t 530 new 0.13) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 21:16:00] step 3354/5000 loss 0.1119 (w 0.0693 mse 0.0697 t 518 new 0.17) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 21:16:06] step 3355/5000 loss 0.0685 (w 0.1527 mse 0.1253 t 984 new 0.24) lr 1.00e-05 gnorm 0.069 5.76s mem 15.6GB +[2026-09-13 21:16:11] step 3356/5000 loss 0.0703 (w 0.1008 mse 0.1003 t 352 new 0.16) lr 1.00e-05 gnorm 0.076 5.67s mem 15.6GB +[2026-09-13 21:16:17] step 3357/5000 loss 0.0511 (w 0.2091 mse 0.1915 t 996 new 0.26) lr 1.00e-05 gnorm 0.068 5.71s mem 15.6GB +[2026-09-13 21:16:23] step 3358/5000 loss 0.0880 (w 0.2037 mse 0.1993 t 194 new 0.29) lr 1.00e-05 gnorm 0.063 5.71s mem 15.6GB +[2026-09-13 21:16:29] step 3359/5000 loss 0.1174 (w 0.0883 mse 0.0779 t 852 new 0.26) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 21:16:34] step 3360/5000 loss 0.1179 (w 0.0661 mse 0.0642 t 780 new 0.29) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 21:16:40] step 3361/5000 loss 0.0452 (w 0.1503 mse 0.1360 t 993 new 0.31) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 21:16:46] step 3362/5000 loss 0.0718 (w 0.0669 mse 0.0681 t 688 new 0.16) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:16:51] step 3363/5000 loss 0.0717 (w 0.0698 mse 0.0647 t 828 new 0.25) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 21:16:57] step 3364/5000 loss 0.0719 (w 0.1200 mse 0.1101 t 982 new 0.26) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 21:17:03] step 3365/5000 loss 0.0853 (w 0.8105 mse 0.8032 t 20 new 0.23) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 21:17:09] step 3366/5000 loss 0.0502 (w 0.0853 mse 0.0780 t 898 new 0.20) lr 1.00e-05 gnorm 0.063 5.76s mem 15.6GB +[2026-09-13 21:17:15] step 3367/5000 loss 0.0685 (w 0.0903 mse 0.0847 t 832 new 0.27) lr 1.00e-05 gnorm 0.100 5.68s mem 15.6GB +[2026-09-13 21:17:20] step 3368/5000 loss 0.0580 (w 0.0739 mse 0.0777 t 632 new 0.18) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:17:26] step 3369/5000 loss 0.1248 (w 0.9803 mse 0.9797 t 10 new 0.25) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 21:17:32] step 3370/5000 loss 0.0651 (w 0.0651 mse 0.0639 t 651 new 0.19) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 21:17:37] step 3371/5000 loss 0.0898 (w 0.0443 mse 0.0452 t 901 new 0.07) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 21:17:43] step 3372/5000 loss 0.0816 (w 0.0808 mse 0.0781 t 745 new 0.20) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:17:49] step 3373/5000 loss 0.0707 (w 0.0560 mse 0.0524 t 859 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 21:17:55] step 3374/5000 loss 0.1103 (w 0.0540 mse 0.0552 t 870 new 0.18) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 21:18:00] step 3375/5000 loss 0.0820 (w 0.0720 mse 0.0678 t 772 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:18:06] step 3376/5000 loss 0.1286 (w 0.0801 mse 0.0789 t 828 new 0.24) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 21:18:12] step 3377/5000 loss 0.0836 (w 0.2505 mse 0.2425 t 992 new 0.26) lr 1.00e-05 gnorm 0.060 5.67s mem 15.6GB +[2026-09-13 21:18:18] step 3378/5000 loss 0.0849 (w 0.1194 mse 0.1175 t 710 new 0.22) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 21:18:24] step 3379/5000 loss 0.0720 (w 0.0818 mse 0.0764 t 548 new 0.19) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 21:18:29] step 3380/5000 loss 0.0562 (w 0.0584 mse 0.0563 t 619 new 0.26) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:18:35] step 3381/5000 loss 0.0932 (w 0.0723 mse 0.0658 t 730 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 21:18:41] step 3382/5000 loss 0.0999 (w 0.0116 mse 0.0118 t 898 new 0.01) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 21:18:46] step 3383/5000 loss 0.0875 (w 0.0444 mse 0.0442 t 692 new 0.18) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:18:52] step 3384/5000 loss 0.0558 (w 0.0445 mse 0.0473 t 622 new 0.30) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 21:18:58] step 3385/5000 loss 0.0803 (w 0.1015 mse 0.0966 t 533 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:19:04] step 3386/5000 loss 0.0503 (w 0.0974 mse 0.0938 t 875 new 0.28) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 21:19:09] step 3387/5000 loss 0.0536 (w 0.1043 mse 0.0991 t 834 new 0.24) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 21:19:15] step 3388/5000 loss 0.0844 (w 0.1494 mse 0.1469 t 960 new 0.29) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:19:21] step 3389/5000 loss 0.0472 (w 0.1197 mse 0.1119 t 947 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:19:27] step 3390/5000 loss 0.0622 (w 0.0754 mse 0.0703 t 737 new 0.26) lr 1.00e-05 gnorm 0.055 5.67s mem 15.6GB +[2026-09-13 21:19:32] step 3391/5000 loss 0.0662 (w 0.0659 mse 0.0646 t 942 new 0.27) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 21:19:38] step 3392/5000 loss 0.1044 (w 0.1067 mse 0.1038 t 802 new 0.23) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 21:19:44] step 3393/5000 loss 0.1193 (w 0.4369 mse 0.4401 t 84 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 21:19:49] step 3394/5000 loss 0.0353 (w 0.0155 mse 0.0156 t 801 new 0.16) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:19:55] step 3395/5000 loss 0.1323 (w 0.2614 mse 0.2483 t 146 new 0.26) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 21:20:01] step 3396/5000 loss 0.0528 (w 0.0651 mse 0.0679 t 607 new 0.23) lr 1.00e-05 gnorm 0.049 5.74s mem 15.6GB +[2026-09-13 21:20:07] step 3397/5000 loss 0.0565 (w 0.1684 mse 0.1680 t 979 new 0.29) lr 1.00e-05 gnorm 0.055 5.90s mem 15.6GB +[2026-09-13 21:20:13] step 3398/5000 loss 0.0528 (w 0.1436 mse 0.1398 t 996 new 0.24) lr 1.00e-05 gnorm 0.057 5.90s mem 15.6GB +[2026-09-13 21:20:19] step 3399/5000 loss 0.1125 (w 0.1230 mse 0.1181 t 449 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 21:20:24] step 3400/5000 loss 0.0519 (w 0.0650 mse 0.0679 t 976 new 0.08) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 21:20:30] step 3401/5000 loss 0.1034 (w 0.0563 mse 0.0575 t 654 new 0.12) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:20:36] step 3402/5000 loss 0.0800 (w 0.1731 mse 0.1598 t 974 new 0.24) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 21:20:42] step 3403/5000 loss 0.0364 (w 0.0858 mse 0.0827 t 937 new 0.26) lr 1.00e-05 gnorm 0.046 5.70s mem 15.6GB +[2026-09-13 21:20:47] step 3404/5000 loss 0.0546 (w 0.1278 mse 0.1245 t 978 new 0.21) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 21:20:53] step 3405/5000 loss 0.0558 (w 0.1026 mse 0.0983 t 876 new 0.24) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 21:20:59] step 3406/5000 loss 0.0570 (w 0.0813 mse 0.0739 t 811 new 0.25) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:21:05] step 3407/5000 loss 0.0609 (w 0.0801 mse 0.0755 t 765 new 0.26) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 21:21:11] step 3408/5000 loss 0.0560 (w 0.0865 mse 0.0839 t 843 new 0.25) lr 1.00e-05 gnorm 0.060 5.93s mem 15.6GB +[2026-09-13 21:21:16] step 3409/5000 loss 0.0442 (w 0.0214 mse 0.0208 t 737 new 0.11) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 21:21:22] step 3410/5000 loss 0.0983 (w 0.1378 mse 0.1354 t 264 new 0.24) lr 1.00e-05 gnorm 0.099 5.70s mem 15.6GB +[2026-09-13 21:21:28] step 3411/5000 loss 0.0229 (w 0.0615 mse 0.0581 t 952 new 0.25) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 21:21:33] step 3412/5000 loss 0.0815 (w 0.0738 mse 0.0734 t 634 new 0.20) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:21:39] step 3413/5000 loss 0.0712 (w 0.0547 mse 0.0550 t 800 new 0.12) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 21:21:45] step 3414/5000 loss 0.1016 (w 0.0706 mse 0.0677 t 921 new 0.25) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +[2026-09-13 21:21:51] step 3415/5000 loss 0.1181 (w 0.0798 mse 0.0800 t 913 new 0.23) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 21:21:56] step 3416/5000 loss 0.0815 (w 0.0848 mse 0.0817 t 949 new 0.25) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 21:22:02] step 3417/5000 loss 0.0740 (w 0.0939 mse 0.0925 t 926 new 0.28) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 21:22:08] step 3418/5000 loss 0.0849 (w 0.0691 mse 0.0642 t 907 new 0.20) lr 1.00e-05 gnorm 0.063 5.89s mem 15.6GB +[2026-09-13 21:22:14] step 3419/5000 loss 0.0629 (w 0.0965 mse 0.0950 t 956 new 0.28) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 21:22:19] step 3420/5000 loss 0.0774 (w 0.0701 mse 0.0687 t 938 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:22:25] step 3421/5000 loss 0.1083 (w 0.0501 mse 0.0506 t 802 new 0.17) lr 1.00e-05 gnorm 0.087 5.68s mem 15.6GB +[2026-09-13 21:22:31] step 3422/5000 loss 0.1145 (w 0.0678 mse 0.0663 t 719 new 0.24) lr 1.00e-05 gnorm 0.078 5.67s mem 15.6GB +[2026-09-13 21:22:36] step 3423/5000 loss 0.0929 (w 0.4259 mse 0.4300 t 109 new 0.22) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 21:22:42] step 3424/5000 loss 0.0888 (w 0.0736 mse 0.0683 t 667 new 0.30) lr 1.00e-05 gnorm 0.107 5.68s mem 15.6GB +[2026-09-13 21:22:48] step 3425/5000 loss 0.0671 (w 0.1236 mse 0.1177 t 914 new 0.15) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:22:54] step 3426/5000 loss 0.1175 (w 0.1863 mse 0.1837 t 142 new 0.19) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:22:59] step 3427/5000 loss 0.0881 (w 0.0665 mse 0.0643 t 887 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 21:23:05] step 3428/5000 loss 0.1041 (w 0.0927 mse 0.0875 t 798 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 21:23:11] step 3429/5000 loss 0.0909 (w 0.0385 mse 0.0408 t 759 new 0.15) lr 1.00e-05 gnorm 0.052 5.97s mem 15.6GB +[2026-09-13 21:23:17] step 3430/5000 loss 0.0576 (w 0.1248 mse 0.1203 t 985 new 0.20) lr 1.00e-05 gnorm 0.055 5.67s mem 15.6GB +[2026-09-13 21:23:22] step 3431/5000 loss 0.0660 (w 0.0738 mse 0.0710 t 709 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:23:28] step 3432/5000 loss 0.0573 (w 0.0798 mse 0.0747 t 687 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 21:23:34] step 3433/5000 loss 0.0752 (w 0.0908 mse 0.0906 t 868 new 0.15) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 21:23:39] step 3434/5000 loss 0.1036 (w 0.1231 mse 0.1197 t 947 new 0.25) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 21:23:45] step 3435/5000 loss 0.0621 (w 0.0547 mse 0.0515 t 781 new 0.25) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +[2026-09-13 21:23:51] step 3436/5000 loss 0.0796 (w 0.0695 mse 0.0652 t 721 new 0.22) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 21:23:57] step 3437/5000 loss 0.0680 (w 0.2013 mse 0.1990 t 985 new 0.27) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:24:02] step 3438/5000 loss 0.0950 (w 0.1082 mse 0.1052 t 511 new 0.17) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 21:24:08] step 3439/5000 loss 0.0521 (w 0.1197 mse 0.1131 t 893 new 0.23) lr 1.00e-05 gnorm 0.057 5.88s mem 15.6GB +[2026-09-13 21:24:14] step 3440/5000 loss 0.0939 (w 0.0625 mse 0.0706 t 999 new 0.14) lr 1.00e-05 gnorm 0.072 5.74s mem 15.6GB +[2026-09-13 21:24:20] step 3441/5000 loss 0.1364 (w 0.1389 mse 0.1345 t 309 new 0.30) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 21:24:26] step 3442/5000 loss 0.0896 (w 0.1101 mse 0.1129 t 264 new 0.21) lr 1.00e-05 gnorm 0.075 6.07s mem 15.6GB +[2026-09-13 21:24:31] step 3443/5000 loss 0.0522 (w 0.0474 mse 0.0478 t 817 new 0.18) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 21:24:37] step 3444/5000 loss 0.1459 (w 0.0754 mse 0.0712 t 839 new 0.23) lr 1.00e-05 gnorm 0.090 5.68s mem 15.6GB +[2026-09-13 21:24:43] step 3445/5000 loss 0.1003 (w 0.0632 mse 0.0623 t 646 new 0.25) lr 1.00e-05 gnorm 0.059 5.89s mem 15.6GB +[2026-09-13 21:24:49] step 3446/5000 loss 0.0929 (w 0.0584 mse 0.0552 t 649 new 0.14) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 21:24:54] step 3447/5000 loss 0.1076 (w 0.0849 mse 0.0860 t 495 new 0.22) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 21:25:00] step 3448/5000 loss 0.0674 (w 0.0765 mse 0.0716 t 945 new 0.26) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 21:25:06] step 3449/5000 loss 0.0849 (w 0.0953 mse 0.0935 t 936 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 21:25:12] step 3450/5000 loss 0.1519 (w 0.1101 mse 0.1019 t 965 new 0.25) lr 1.00e-05 gnorm 0.094 5.97s mem 15.6GB +[2026-09-13 21:25:17] step 3451/5000 loss 0.0560 (w 0.1150 mse 0.1022 t 902 new 0.24) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 21:25:23] step 3452/5000 loss 0.0722 (w 0.0701 mse 0.0667 t 813 new 0.15) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 21:25:29] step 3453/5000 loss 0.0799 (w 0.1025 mse 0.1127 t 280 new 0.24) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 21:25:35] step 3454/5000 loss 0.0653 (w 0.1047 mse 0.0970 t 807 new 0.24) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 21:25:40] step 3455/5000 loss 0.0566 (w 0.1284 mse 0.1181 t 952 new 0.25) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 21:25:46] step 3456/5000 loss 0.0827 (w 0.0594 mse 0.0619 t 859 new 0.25) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 21:25:52] step 3457/5000 loss 0.1015 (w 0.1553 mse 0.1411 t 996 new 0.23) lr 1.00e-05 gnorm 0.128 5.69s mem 15.6GB +[2026-09-13 21:25:57] step 3458/5000 loss 0.1198 (w 0.0636 mse 0.0594 t 688 new 0.18) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 21:26:03] step 3459/5000 loss 0.0753 (w 0.0937 mse 0.0842 t 812 new 0.22) lr 1.00e-05 gnorm 0.062 5.83s mem 15.6GB +[2026-09-13 21:26:09] step 3460/5000 loss 0.0998 (w 0.1628 mse 0.1507 t 980 new 0.29) lr 1.00e-05 gnorm 0.093 5.71s mem 15.6GB +[2026-09-13 21:26:15] step 3461/5000 loss 0.1030 (w 0.0751 mse 0.0730 t 864 new 0.16) lr 1.00e-05 gnorm 0.126 5.75s mem 15.6GB +[2026-09-13 21:26:20] step 3462/5000 loss 0.0815 (w 0.0436 mse 0.0524 t 994 new 0.21) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 21:26:26] step 3463/5000 loss 0.0300 (w 0.0886 mse 0.0849 t 944 new 0.22) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 21:26:32] step 3464/5000 loss 0.0833 (w 0.0687 mse 0.0643 t 666 new 0.29) lr 1.00e-05 gnorm 0.132 5.70s mem 15.6GB +[2026-09-13 21:26:38] step 3465/5000 loss 0.0493 (w 0.0415 mse 0.0485 t 941 new 0.22) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 21:26:44] step 3466/5000 loss 0.1126 (w 0.1424 mse 0.1444 t 947 new 0.20) lr 1.00e-05 gnorm 0.062 5.89s mem 15.6GB +[2026-09-13 21:26:49] step 3467/5000 loss 0.1183 (w 0.0630 mse 0.0582 t 904 new 0.22) lr 1.00e-05 gnorm 0.126 5.69s mem 15.6GB +[2026-09-13 21:26:55] step 3468/5000 loss 0.0792 (w 0.0680 mse 0.0640 t 777 new 0.24) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 21:27:01] step 3469/5000 loss 0.0818 (w 0.0661 mse 0.0662 t 652 new 0.23) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 21:27:06] step 3470/5000 loss 0.1022 (w 0.0804 mse 0.0844 t 380 new 0.26) lr 1.00e-05 gnorm 0.117 5.70s mem 15.6GB +[2026-09-13 21:27:12] step 3471/5000 loss 0.0952 (w 0.8866 mse 0.8850 t 5 new 0.25) lr 1.00e-05 gnorm 0.060 5.88s mem 15.6GB +[2026-09-13 21:27:18] step 3472/5000 loss 0.0541 (w 0.0893 mse 0.0835 t 930 new 0.23) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 21:27:24] step 3473/5000 loss 0.0768 (w 0.0821 mse 0.0757 t 571 new 0.13) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:27:30] step 3474/5000 loss 0.0582 (w 0.0640 mse 0.0645 t 754 new 0.18) lr 1.00e-05 gnorm 0.058 5.71s mem 15.6GB +[2026-09-13 21:27:36] step 3475/5000 loss 0.0652 (w 0.1100 mse 0.1040 t 949 new 0.11) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 21:27:41] step 3476/5000 loss 0.0443 (w 0.1071 mse 0.0976 t 943 new 0.25) lr 1.00e-05 gnorm 0.157 5.70s mem 15.6GB +[2026-09-13 21:27:47] step 3477/5000 loss 0.0981 (w 0.1832 mse 0.1631 t 983 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 21:27:53] step 3478/5000 loss 0.0935 (w 0.0867 mse 0.0810 t 434 new 0.15) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 21:27:59] step 3479/5000 loss 0.0900 (w 0.0918 mse 0.0915 t 996 new 0.13) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 21:28:04] step 3480/5000 loss 0.0832 (w 0.0749 mse 0.0679 t 851 new 0.27) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 21:28:10] step 3481/5000 loss 0.0769 (w 0.0517 mse 0.0538 t 756 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:28:16] step 3482/5000 loss 0.0894 (w 0.1047 mse 0.1032 t 960 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 21:28:21] step 3483/5000 loss 0.0988 (w 0.0797 mse 0.0789 t 604 new 0.18) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 21:28:27] step 3484/5000 loss 0.0482 (w 0.0713 mse 0.0683 t 869 new 0.23) lr 1.00e-05 gnorm 0.056 5.94s mem 15.6GB +[2026-09-13 21:28:33] step 3485/5000 loss 0.0685 (w 0.1030 mse 0.0967 t 960 new 0.09) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:28:39] step 3486/5000 loss 0.0937 (w 0.0710 mse 0.0649 t 940 new 0.13) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 21:28:44] step 3487/5000 loss 0.0978 (w 0.0664 mse 0.0631 t 902 new 0.11) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 21:28:50] step 3488/5000 loss 0.0833 (w 0.1042 mse 0.0978 t 900 new 0.18) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 21:28:56] step 3489/5000 loss 0.0464 (w 0.0692 mse 0.0636 t 837 new 0.22) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 21:29:02] step 3490/5000 loss 0.1053 (w 0.1815 mse 0.1750 t 981 new 0.26) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 21:29:07] step 3491/5000 loss 0.0618 (w 0.1507 mse 0.1373 t 960 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:29:13] step 3492/5000 loss 0.1173 (w 0.0475 mse 0.0413 t 694 new 0.26) lr 1.00e-05 gnorm 0.081 5.76s mem 15.6GB +[2026-09-13 21:29:19] step 3493/5000 loss 0.0676 (w 0.1212 mse 0.1297 t 994 new 0.30) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:29:25] step 3494/5000 loss 0.1335 (w 0.0620 mse 0.0562 t 641 new 0.22) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 21:29:30] step 3495/5000 loss 0.0878 (w 0.8181 mse 0.8255 t 15 new 0.28) lr 1.00e-05 gnorm 0.085 5.73s mem 15.6GB +[2026-09-13 21:29:36] step 3496/5000 loss 0.0911 (w 0.0266 mse 0.0293 t 716 new 0.22) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 21:29:42] step 3497/5000 loss 0.0708 (w 0.1027 mse 0.1129 t 977 new 0.21) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 21:29:48] step 3498/5000 loss 0.1359 (w 0.1327 mse 0.1222 t 935 new 0.22) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 21:29:53] step 3499/5000 loss 0.0847 (w 0.0174 mse 0.0205 t 484 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:29:59] step 3500/5000 loss 0.1172 (w 0.0476 mse 0.0478 t 854 new 0.10) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 21:30:03] [val] step 3500 t=201: w=0.1744 mse=0.1768 (n=16) t=501: w=0.0724 mse=0.0723 (n=16) t=800: w=0.0607 mse=0.0595 (n=16) | mean w=0.1025 mse=0.1029 4s +[2026-09-13 21:30:07] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step3500.safetensors 832 个张量 2.87 GB +[2026-09-13 21:30:13] step 3501/5000 loss 0.0793 (w 0.0655 mse 0.0655 t 890 new 0.09) lr 1.00e-05 gnorm 0.058 5.73s mem 15.6GB +[2026-09-13 21:30:18] step 3502/5000 loss 0.0932 (w 0.1029 mse 0.0990 t 744 new 0.25) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 21:30:24] step 3503/5000 loss 0.0837 (w 0.2477 mse 0.2505 t 989 new 0.20) lr 1.00e-05 gnorm 0.051 5.72s mem 15.6GB +[2026-09-13 21:30:30] step 3504/5000 loss 0.0682 (w 0.1000 mse 0.1009 t 992 new 0.11) lr 1.00e-05 gnorm 0.058 5.74s mem 15.6GB +[2026-09-13 21:30:36] step 3505/5000 loss 0.0958 (w 0.1228 mse 0.1263 t 403 new 0.29) lr 1.00e-05 gnorm 0.060 5.71s mem 15.6GB +[2026-09-13 21:30:41] step 3506/5000 loss 0.0983 (w 0.1462 mse 0.1426 t 987 new 0.29) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 21:30:47] step 3507/5000 loss 0.0696 (w 0.1458 mse 0.1426 t 994 new 0.31) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 21:30:53] step 3508/5000 loss 0.0778 (w 0.0285 mse 0.0275 t 753 new 0.22) lr 1.00e-05 gnorm 0.068 5.89s mem 15.6GB +[2026-09-13 21:30:59] step 3509/5000 loss 0.0877 (w 0.1585 mse 0.1371 t 998 new 0.16) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +[2026-09-13 21:31:04] step 3510/5000 loss 0.0521 (w 0.1346 mse 0.1205 t 957 new 0.23) lr 1.00e-05 gnorm 0.051 5.71s mem 15.6GB +[2026-09-13 21:31:10] step 3511/5000 loss 0.0705 (w 0.0998 mse 0.0887 t 928 new 0.22) lr 1.00e-05 gnorm 0.083 5.94s mem 15.6GB +[2026-09-13 21:31:16] step 3512/5000 loss 0.0736 (w 0.0688 mse 0.0710 t 873 new 0.21) lr 1.00e-05 gnorm 0.070 5.71s mem 15.6GB +[2026-09-13 21:31:22] step 3513/5000 loss 0.1199 (w 0.4483 mse 0.4467 t 109 new 0.23) lr 1.00e-05 gnorm 0.062 5.90s mem 15.6GB +[2026-09-13 21:31:28] step 3514/5000 loss 0.0712 (w 0.2038 mse 0.1911 t 994 new 0.16) lr 1.00e-05 gnorm 0.068 5.90s mem 15.6GB +[2026-09-13 21:31:34] step 3515/5000 loss 0.0938 (w 0.1091 mse 0.1076 t 788 new 0.25) lr 1.00e-05 gnorm 0.065 5.82s mem 15.6GB +[2026-09-13 21:31:40] step 3516/5000 loss 0.0833 (w 0.1164 mse 0.1143 t 459 new 0.20) lr 1.00e-05 gnorm 0.056 5.83s mem 15.6GB +[2026-09-13 21:31:45] step 3517/5000 loss 0.1181 (w 0.0339 mse 0.0353 t 785 new 0.15) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 21:31:51] step 3518/5000 loss 0.0811 (w 0.2378 mse 0.2427 t 993 new 0.21) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 21:31:57] step 3519/5000 loss 0.1239 (w 0.0551 mse 0.0528 t 757 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 21:32:03] step 3520/5000 loss 0.0517 (w 0.0914 mse 0.0955 t 993 new 0.15) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 21:32:08] step 3521/5000 loss 0.1168 (w 0.1835 mse 0.2042 t 130 new 0.17) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 21:32:14] step 3522/5000 loss 0.0686 (w 0.0209 mse 0.0236 t 701 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:32:20] step 3523/5000 loss 0.0411 (w 0.1251 mse 0.1203 t 993 new 0.23) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 21:32:25] step 3524/5000 loss 0.1010 (w 0.0645 mse 0.0623 t 796 new 0.26) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 21:32:31] step 3525/5000 loss 0.0685 (w 0.0202 mse 0.0221 t 692 new 0.15) lr 1.00e-05 gnorm 0.056 5.72s mem 15.6GB +[2026-09-13 21:32:37] step 3526/5000 loss 0.0661 (w 0.1200 mse 0.1138 t 978 new 0.21) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 21:32:43] step 3527/5000 loss 0.1043 (w 0.0638 mse 0.0646 t 735 new 0.27) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 21:32:48] step 3528/5000 loss 0.0916 (w 0.0687 mse 0.0649 t 914 new 0.15) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 21:32:54] step 3529/5000 loss 0.1035 (w 0.0467 mse 0.0474 t 626 new 0.29) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 21:33:00] step 3530/5000 loss 0.0843 (w 0.1620 mse 0.1703 t 992 new 0.23) lr 1.00e-05 gnorm 0.068 5.94s mem 15.6GB +[2026-09-13 21:33:06] step 3531/5000 loss 0.0892 (w 0.0895 mse 0.0870 t 417 new 0.19) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:33:12] step 3532/5000 loss 0.0580 (w 0.0864 mse 0.0826 t 935 new 0.20) lr 1.00e-05 gnorm 0.058 5.92s mem 15.6GB +[2026-09-13 21:33:17] step 3533/5000 loss 0.1006 (w 0.1167 mse 0.1118 t 886 new 0.18) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 21:33:23] step 3534/5000 loss 0.1015 (w 0.0521 mse 0.0582 t 314 new 0.15) lr 1.00e-05 gnorm 0.050 5.89s mem 15.6GB +[2026-09-13 21:33:29] step 3535/5000 loss 0.0485 (w 0.0719 mse 0.0741 t 748 new 0.14) lr 1.00e-05 gnorm 0.044 5.69s mem 15.6GB +[2026-09-13 21:33:35] step 3536/5000 loss 0.0684 (w 0.2757 mse 0.2350 t 991 new 0.25) lr 1.00e-05 gnorm 0.072 5.80s mem 15.6GB +[2026-09-13 21:33:41] step 3537/5000 loss 0.0741 (w 0.0219 mse 0.0202 t 606 new 0.19) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 21:33:46] step 3538/5000 loss 0.0575 (w 0.1039 mse 0.1051 t 969 new 0.22) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 21:33:52] step 3539/5000 loss 0.0754 (w 0.2775 mse 0.2943 t 998 new 0.16) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:33:58] step 3540/5000 loss 0.0402 (w 0.0531 mse 0.0554 t 829 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:34:03] step 3541/5000 loss 0.0998 (w 0.0825 mse 0.0802 t 929 new 0.22) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +[2026-09-13 21:34:09] step 3542/5000 loss 0.0944 (w 0.0597 mse 0.0547 t 727 new 0.29) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +[2026-09-13 21:34:15] step 3543/5000 loss 0.0730 (w 0.2256 mse 0.2106 t 997 new 0.31) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 21:34:21] step 3544/5000 loss 0.1072 (w 0.1080 mse 0.1004 t 532 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:34:26] step 3545/5000 loss 0.0721 (w 0.0721 mse 0.0682 t 807 new 0.28) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 21:34:32] step 3546/5000 loss 0.0722 (w 0.0715 mse 0.0727 t 924 new 0.24) lr 1.00e-05 gnorm 0.066 5.96s mem 15.6GB +[2026-09-13 21:34:38] step 3547/5000 loss 0.0717 (w 0.0685 mse 0.0667 t 881 new 0.23) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 21:34:44] step 3548/5000 loss 0.0820 (w 0.1531 mse 0.1429 t 968 new 0.22) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 21:34:49] step 3549/5000 loss 0.0582 (w 0.0408 mse 0.0402 t 856 new 0.20) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 21:34:55] step 3550/5000 loss 0.0928 (w 0.0855 mse 0.0837 t 891 new 0.10) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 21:35:01] step 3551/5000 loss 0.0914 (w 0.0641 mse 0.0637 t 731 new 0.24) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 21:35:07] step 3552/5000 loss 0.1110 (w 0.1664 mse 0.1578 t 980 new 0.19) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 21:35:12] step 3553/5000 loss 0.0825 (w 0.0366 mse 0.0370 t 766 new 0.07) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 21:35:18] step 3554/5000 loss 0.0841 (w 0.1301 mse 0.1204 t 994 new 0.26) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 21:35:24] step 3555/5000 loss 0.0985 (w 0.1294 mse 0.1276 t 968 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:35:30] step 3556/5000 loss 0.0456 (w 0.0552 mse 0.0524 t 874 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 21:35:35] step 3557/5000 loss 0.1024 (w 0.0561 mse 0.0557 t 853 new 0.22) lr 1.00e-05 gnorm 0.099 5.81s mem 15.6GB +[2026-09-13 21:35:41] step 3558/5000 loss 0.0444 (w 0.1088 mse 0.1085 t 991 new 0.21) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 21:35:47] step 3559/5000 loss 0.1175 (w 0.0954 mse 0.0942 t 436 new 0.24) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 21:35:53] step 3560/5000 loss 0.0883 (w 0.0121 mse 0.0142 t 786 new 0.18) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:35:58] step 3561/5000 loss 0.0924 (w 0.1402 mse 0.1374 t 805 new 0.19) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 21:36:04] step 3562/5000 loss 0.0723 (w 0.1305 mse 0.1251 t 963 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 21:36:10] step 3563/5000 loss 0.0629 (w 0.0854 mse 0.0877 t 927 new 0.15) lr 1.00e-05 gnorm 0.059 5.67s mem 15.6GB +[2026-09-13 21:36:16] step 3564/5000 loss 0.0987 (w 0.0542 mse 0.0537 t 589 new 0.21) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 21:36:21] step 3565/5000 loss 0.0490 (w 0.1455 mse 0.1454 t 972 new 0.24) lr 1.00e-05 gnorm 0.043 5.68s mem 15.6GB +[2026-09-13 21:36:27] step 3566/5000 loss 0.0586 (w 0.0976 mse 0.0930 t 890 new 0.19) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 21:36:33] step 3567/5000 loss 0.1094 (w 0.1313 mse 0.1320 t 300 new 0.21) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 21:36:38] step 3568/5000 loss 0.0800 (w 0.0968 mse 0.0931 t 737 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 21:36:44] step 3569/5000 loss 0.0957 (w 0.1139 mse 0.1066 t 898 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:36:50] step 3570/5000 loss 0.0953 (w 0.1004 mse 0.0962 t 661 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:36:55] step 3571/5000 loss 0.0479 (w 0.0598 mse 0.0578 t 863 new 0.23) lr 1.00e-05 gnorm 0.050 5.68s mem 15.6GB +[2026-09-13 21:37:01] step 3572/5000 loss 0.0652 (w 0.1078 mse 0.1035 t 954 new 0.22) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:37:07] step 3573/5000 loss 0.0837 (w 0.0712 mse 0.0635 t 882 new 0.20) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 21:37:13] step 3574/5000 loss 0.0688 (w 0.1432 mse 0.1305 t 998 new 0.15) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:37:19] step 3575/5000 loss 0.0932 (w 0.0585 mse 0.0604 t 616 new 0.24) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 21:37:24] step 3576/5000 loss 0.0705 (w 0.1373 mse 0.1338 t 964 new 0.19) lr 1.00e-05 gnorm 0.065 5.88s mem 15.6GB +[2026-09-13 21:37:30] step 3577/5000 loss 0.0967 (w 0.0569 mse 0.0527 t 770 new 0.21) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 21:37:36] step 3578/5000 loss 0.0757 (w 0.0644 mse 0.0557 t 870 new 0.22) lr 1.00e-05 gnorm 0.057 5.82s mem 15.6GB +[2026-09-13 21:37:42] step 3579/5000 loss 0.1088 (w 0.0563 mse 0.0570 t 733 new 0.26) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 21:37:48] step 3580/5000 loss 0.1072 (w 0.0784 mse 0.0802 t 566 new 0.27) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 21:37:53] step 3581/5000 loss 0.0628 (w 0.1684 mse 0.1458 t 987 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:37:59] step 3582/5000 loss 0.1082 (w 0.0650 mse 0.0685 t 488 new 0.18) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 21:38:05] step 3583/5000 loss 0.0593 (w 0.0488 mse 0.0467 t 651 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:38:10] step 3584/5000 loss 0.0716 (w 0.0851 mse 0.0805 t 480 new 0.22) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 21:38:16] step 3585/5000 loss 0.0777 (w 0.0935 mse 0.0925 t 541 new 0.29) lr 1.00e-05 gnorm 0.054 5.73s mem 15.6GB +[2026-09-13 21:38:22] step 3586/5000 loss 0.0643 (w 0.0529 mse 0.0515 t 572 new 0.21) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +[2026-09-13 21:38:28] step 3587/5000 loss 0.1097 (w 0.0827 mse 0.0725 t 845 new 0.23) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 21:38:33] step 3588/5000 loss 0.0781 (w 0.1792 mse 0.1749 t 208 new 0.12) lr 1.00e-05 gnorm 0.060 5.72s mem 15.6GB +[2026-09-13 21:38:39] step 3589/5000 loss 0.0711 (w 0.0582 mse 0.0554 t 873 new 0.26) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 21:38:45] step 3590/5000 loss 0.0806 (w 0.1118 mse 0.1075 t 914 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:38:51] step 3591/5000 loss 0.0645 (w 0.0436 mse 0.0444 t 814 new 0.22) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 21:38:56] step 3592/5000 loss 0.0834 (w 0.1095 mse 0.1011 t 917 new 0.24) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 21:39:02] step 3593/5000 loss 0.0853 (w 0.1263 mse 0.1454 t 150 new 0.24) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 21:39:08] step 3594/5000 loss 0.0742 (w 0.7543 mse 0.7826 t 25 new 0.24) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 21:39:14] step 3595/5000 loss 0.0819 (w 0.0405 mse 0.0421 t 638 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:39:19] step 3596/5000 loss 0.0646 (w 0.0371 mse 0.0355 t 945 new 0.10) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 21:39:25] step 3597/5000 loss 0.1058 (w 0.0965 mse 0.1019 t 958 new 0.19) lr 1.00e-05 gnorm 0.065 5.91s mem 15.6GB +[2026-09-13 21:39:31] step 3598/5000 loss 0.0728 (w 0.0237 mse 0.0258 t 600 new 0.12) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +[2026-09-13 21:39:37] step 3599/5000 loss 0.0595 (w 0.1120 mse 0.1058 t 953 new 0.21) lr 1.00e-05 gnorm 0.077 5.93s mem 15.6GB +[2026-09-13 21:39:43] step 3600/5000 loss 0.0848 (w 0.1200 mse 0.1201 t 134 new 0.10) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 21:39:49] step 3601/5000 loss 0.0850 (w 0.0575 mse 0.0606 t 515 new 0.16) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 21:39:54] step 3602/5000 loss 0.1125 (w 0.0838 mse 0.0816 t 463 new 0.21) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 21:40:00] step 3603/5000 loss 0.0880 (w 0.0603 mse 0.0606 t 896 new 0.10) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:40:06] step 3604/5000 loss 0.1073 (w 0.1822 mse 0.1869 t 169 new 0.26) lr 1.00e-05 gnorm 0.061 5.91s mem 15.6GB +[2026-09-13 21:40:12] step 3605/5000 loss 0.0934 (w 0.0746 mse 0.0717 t 852 new 0.22) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:40:18] step 3606/5000 loss 0.0638 (w 0.0856 mse 0.0791 t 791 new 0.27) lr 1.00e-05 gnorm 0.064 5.73s mem 15.6GB +[2026-09-13 21:40:23] step 3607/5000 loss 0.1270 (w 0.0759 mse 0.0768 t 954 new 0.18) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +[2026-09-13 21:40:29] step 3608/5000 loss 0.1323 (w 0.0336 mse 0.0367 t 596 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:40:35] step 3609/5000 loss 0.0802 (w 0.6397 mse 0.6550 t 34 new 0.16) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 21:40:40] step 3610/5000 loss 0.0875 (w 0.0618 mse 0.0596 t 726 new 0.23) lr 1.00e-05 gnorm 0.063 5.81s mem 15.6GB +[2026-09-13 21:40:46] step 3611/5000 loss 0.0589 (w 0.1251 mse 0.1159 t 960 new 0.24) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 21:40:52] step 3612/5000 loss 0.0501 (w 0.1396 mse 0.1322 t 924 new 0.27) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:40:58] step 3613/5000 loss 0.0646 (w 0.0706 mse 0.0669 t 602 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:41:03] step 3614/5000 loss 0.0398 (w 0.0628 mse 0.0562 t 862 new 0.17) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 21:41:09] step 3615/5000 loss 0.0667 (w 0.0828 mse 0.0811 t 669 new 0.21) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 21:41:15] step 3616/5000 loss 0.0681 (w 0.1179 mse 0.1145 t 537 new 0.22) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 21:41:21] step 3617/5000 loss 0.0680 (w 0.0661 mse 0.0655 t 756 new 0.21) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 21:41:26] step 3618/5000 loss 0.0959 (w 0.0967 mse 0.0964 t 912 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:41:32] step 3619/5000 loss 0.0865 (w 0.0849 mse 0.0767 t 657 new 0.25) lr 1.00e-05 gnorm 0.048 5.68s mem 15.6GB +[2026-09-13 21:41:38] step 3620/5000 loss 0.0849 (w 0.0917 mse 0.0915 t 592 new 0.17) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:41:44] step 3621/5000 loss 0.0958 (w 0.0641 mse 0.0607 t 710 new 0.25) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 21:41:49] step 3622/5000 loss 0.0948 (w 0.1030 mse 0.1033 t 323 new 0.10) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:41:55] step 3623/5000 loss 0.1026 (w 0.0665 mse 0.0706 t 497 new 0.13) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 21:42:01] step 3624/5000 loss 0.1059 (w 0.1168 mse 0.1050 t 950 new 0.26) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:42:07] step 3625/5000 loss 0.1190 (w 0.0646 mse 0.0641 t 641 new 0.29) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +[2026-09-13 21:42:12] step 3626/5000 loss 0.1475 (w 0.5510 mse 0.5810 t 43 new 0.25) lr 1.00e-05 gnorm 0.054 5.93s mem 15.6GB +[2026-09-13 21:42:18] step 3627/5000 loss 0.0825 (w 0.2140 mse 0.1834 t 994 new 0.27) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 21:42:24] step 3628/5000 loss 0.0811 (w 0.0352 mse 0.0384 t 908 new 0.14) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 21:42:30] step 3629/5000 loss 0.0868 (w 0.1005 mse 0.0966 t 786 new 0.19) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 21:42:35] step 3630/5000 loss 0.0776 (w 0.1115 mse 0.1096 t 949 new 0.21) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:42:41] step 3631/5000 loss 0.1375 (w 0.1118 mse 0.1081 t 678 new 0.25) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 21:42:47] step 3632/5000 loss 0.0740 (w 0.0681 mse 0.0667 t 931 new 0.29) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:42:52] step 3633/5000 loss 0.0764 (w 0.0519 mse 0.0573 t 288 new 0.28) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 21:42:58] step 3634/5000 loss 0.0990 (w 0.0951 mse 0.0981 t 824 new 0.26) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:43:04] step 3635/5000 loss 0.0508 (w 0.0506 mse 0.0493 t 816 new 0.14) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:43:10] step 3636/5000 loss 0.1185 (w 0.1409 mse 0.1342 t 958 new 0.24) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 21:43:15] step 3637/5000 loss 0.0385 (w 0.1191 mse 0.1163 t 953 new 0.21) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:43:21] step 3638/5000 loss 0.1173 (w 0.0575 mse 0.0554 t 895 new 0.15) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 21:43:27] step 3639/5000 loss 0.0599 (w 0.0610 mse 0.0560 t 718 new 0.22) lr 1.00e-05 gnorm 0.061 5.89s mem 15.6GB +[2026-09-13 21:43:33] step 3640/5000 loss 0.0733 (w 0.1246 mse 0.1184 t 913 new 0.20) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 21:43:38] step 3641/5000 loss 0.0931 (w 0.0960 mse 0.0906 t 744 new 0.29) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 21:43:44] step 3642/5000 loss 0.0837 (w 0.0738 mse 0.0652 t 937 new 0.22) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 21:43:50] step 3643/5000 loss 0.1108 (w 0.0845 mse 0.0751 t 925 new 0.12) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 21:43:56] step 3644/5000 loss 0.0542 (w 0.0709 mse 0.0758 t 928 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 21:44:01] step 3645/5000 loss 0.0508 (w 0.0712 mse 0.0679 t 482 new 0.21) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +[2026-09-13 21:44:07] step 3646/5000 loss 0.0819 (w 0.0587 mse 0.0563 t 571 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 21:44:13] step 3647/5000 loss 0.0531 (w 0.0344 mse 0.0373 t 659 new 0.17) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:44:18] step 3648/5000 loss 0.1044 (w 0.0879 mse 0.0845 t 866 new 0.21) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:44:24] step 3649/5000 loss 0.0687 (w 0.0594 mse 0.0572 t 878 new 0.29) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 21:44:30] step 3650/5000 loss 0.0722 (w 0.0900 mse 0.0857 t 892 new 0.24) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:44:36] step 3651/5000 loss 0.1110 (w 0.0756 mse 0.0712 t 786 new 0.21) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 21:44:41] step 3652/5000 loss 0.0812 (w 0.1014 mse 0.0987 t 718 new 0.24) lr 1.00e-05 gnorm 0.058 5.85s mem 15.6GB +[2026-09-13 21:44:47] step 3653/5000 loss 0.0288 (w 0.1904 mse 0.1824 t 995 new 0.20) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:44:53] step 3654/5000 loss 0.0733 (w 0.0463 mse 0.0506 t 958 new 0.24) lr 1.00e-05 gnorm 0.072 5.81s mem 15.6GB +[2026-09-13 21:44:59] step 3655/5000 loss 0.0515 (w 0.0868 mse 0.0813 t 936 new 0.22) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 21:45:04] step 3656/5000 loss 0.0772 (w 0.1009 mse 0.1003 t 336 new 0.25) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 21:45:10] step 3657/5000 loss 0.1339 (w 0.1147 mse 0.1102 t 861 new 0.27) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 21:45:16] step 3658/5000 loss 0.0614 (w 0.0769 mse 0.0745 t 943 new 0.15) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 21:45:22] step 3659/5000 loss 0.0733 (w 0.0981 mse 0.1017 t 954 new 0.18) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 21:45:27] step 3660/5000 loss 0.1098 (w 0.1011 mse 0.0980 t 865 new 0.28) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 21:45:33] step 3661/5000 loss 0.0805 (w 0.0793 mse 0.0755 t 903 new 0.28) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 21:45:39] step 3662/5000 loss 0.0729 (w 0.0664 mse 0.0617 t 745 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:45:45] step 3663/5000 loss 0.1275 (w 0.0809 mse 0.0777 t 577 new 0.22) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 21:45:50] step 3664/5000 loss 0.0989 (w 0.1812 mse 0.1814 t 201 new 0.17) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 21:45:56] step 3665/5000 loss 0.0873 (w 0.1588 mse 0.1544 t 222 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 21:46:02] step 3666/5000 loss 0.0405 (w 0.0521 mse 0.0519 t 760 new 0.10) lr 1.00e-05 gnorm 0.049 5.71s mem 15.6GB +[2026-09-13 21:46:07] step 3667/5000 loss 0.1011 (w 0.0838 mse 0.0849 t 762 new 0.19) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 21:46:13] step 3668/5000 loss 0.0882 (w 0.0131 mse 0.0133 t 907 new 0.02) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 21:46:19] step 3669/5000 loss 0.1223 (w 0.0772 mse 0.0737 t 554 new 0.21) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 21:46:25] step 3670/5000 loss 0.0783 (w 0.0657 mse 0.0667 t 421 new 0.24) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 21:46:30] step 3671/5000 loss 0.0611 (w 0.1583 mse 0.1546 t 977 new 0.28) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:46:36] step 3672/5000 loss 0.0681 (w 0.1121 mse 0.1127 t 980 new 0.25) lr 1.00e-05 gnorm 0.062 5.71s mem 15.6GB +[2026-09-13 21:46:42] step 3673/5000 loss 0.0791 (w 0.0673 mse 0.0697 t 819 new 0.25) lr 1.00e-05 gnorm 0.057 5.71s mem 15.6GB +[2026-09-13 21:46:47] step 3674/5000 loss 0.0740 (w 0.0873 mse 0.0868 t 843 new 0.21) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 21:46:53] step 3675/5000 loss 0.0700 (w 0.0302 mse 0.0291 t 843 new 0.22) lr 1.00e-05 gnorm 0.058 5.82s mem 15.6GB +[2026-09-13 21:46:59] step 3676/5000 loss 0.0781 (w 0.0575 mse 0.0607 t 894 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 21:47:05] step 3677/5000 loss 0.1220 (w 0.0824 mse 0.0841 t 660 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 21:47:10] step 3678/5000 loss 0.1230 (w 0.0515 mse 0.0502 t 922 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:47:16] step 3679/5000 loss 0.1117 (w 0.0505 mse 0.0467 t 532 new 0.26) lr 1.00e-05 gnorm 0.053 6.09s mem 15.6GB +[2026-09-13 21:47:22] step 3680/5000 loss 0.0648 (w 0.0985 mse 0.0940 t 961 new 0.26) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +[2026-09-13 21:47:28] step 3681/5000 loss 0.0704 (w 0.0457 mse 0.0477 t 788 new 0.18) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 21:47:34] step 3682/5000 loss 0.0599 (w 0.0952 mse 0.0825 t 912 new 0.26) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 21:47:39] step 3683/5000 loss 0.0641 (w 0.0651 mse 0.0624 t 935 new 0.26) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:47:45] step 3684/5000 loss 0.0929 (w 0.0671 mse 0.0634 t 886 new 0.27) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:47:51] step 3685/5000 loss 0.0552 (w 0.3174 mse 0.2867 t 998 new 0.29) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 21:47:56] step 3686/5000 loss 0.0803 (w 0.0726 mse 0.0771 t 964 new 0.28) lr 1.00e-05 gnorm 0.048 5.68s mem 15.6GB +[2026-09-13 21:48:02] step 3687/5000 loss 0.1011 (w 0.0716 mse 0.0698 t 669 new 0.27) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 21:48:08] step 3688/5000 loss 0.1075 (w 0.0765 mse 0.0697 t 751 new 0.30) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:48:14] step 3689/5000 loss 0.1570 (w 0.1137 mse 0.1095 t 689 new 0.27) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 21:48:19] step 3690/5000 loss 0.0834 (w 0.0764 mse 0.0720 t 603 new 0.25) lr 1.00e-05 gnorm 0.056 5.80s mem 15.6GB +[2026-09-13 21:48:25] step 3691/5000 loss 0.0782 (w 0.1044 mse 0.0994 t 457 new 0.24) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 21:48:31] step 3692/5000 loss 0.0827 (w 0.0471 mse 0.0501 t 588 new 0.24) lr 1.00e-05 gnorm 0.050 5.68s mem 15.6GB +[2026-09-13 21:48:36] step 3693/5000 loss 0.0588 (w 0.0485 mse 0.0456 t 581 new 0.07) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 21:48:42] step 3694/5000 loss 0.0578 (w 0.1151 mse 0.1191 t 872 new 0.20) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 21:48:48] step 3695/5000 loss 0.1058 (w 0.0646 mse 0.0592 t 883 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:48:54] step 3696/5000 loss 0.0598 (w 0.1057 mse 0.0979 t 971 new 0.23) lr 1.00e-05 gnorm 0.051 6.02s mem 15.6GB +[2026-09-13 21:49:00] step 3697/5000 loss 0.1198 (w 0.0524 mse 0.0526 t 722 new 0.27) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 21:49:05] step 3698/5000 loss 0.0927 (w 0.0444 mse 0.0415 t 678 new 0.29) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 21:49:11] step 3699/5000 loss 0.1047 (w 0.2008 mse 0.1909 t 985 new 0.18) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 21:49:17] step 3700/5000 loss 0.0708 (w 0.0742 mse 0.0731 t 532 new 0.23) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 21:49:22] step 3701/5000 loss 0.1269 (w 0.0584 mse 0.0572 t 857 new 0.07) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 21:49:28] step 3702/5000 loss 0.0897 (w 0.0944 mse 0.0853 t 674 new 0.24) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 21:49:34] step 3703/5000 loss 0.1134 (w 0.0603 mse 0.0589 t 788 new 0.25) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:49:39] step 3704/5000 loss 0.0709 (w 0.7228 mse 0.7360 t 20 new 0.11) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:49:45] step 3705/5000 loss 0.0512 (w 0.0848 mse 0.0853 t 937 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:49:51] step 3706/5000 loss 0.0990 (w 0.1046 mse 0.1002 t 961 new 0.14) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 21:49:57] step 3707/5000 loss 0.0908 (w 0.0935 mse 0.0963 t 403 new 0.18) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 21:50:02] step 3708/5000 loss 0.0510 (w 0.0521 mse 0.0533 t 506 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:50:08] step 3709/5000 loss 0.1118 (w 0.6707 mse 0.6674 t 48 new 0.18) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 21:50:14] step 3710/5000 loss 0.0900 (w 0.1010 mse 0.0950 t 935 new 0.19) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 21:50:19] step 3711/5000 loss 0.0667 (w 0.0779 mse 0.0704 t 798 new 0.26) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 21:50:25] step 3712/5000 loss 0.0685 (w 0.0855 mse 0.0828 t 852 new 0.18) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 21:50:31] step 3713/5000 loss 0.0734 (w 0.1520 mse 0.1415 t 984 new 0.25) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 21:50:37] step 3714/5000 loss 0.0997 (w 0.0763 mse 0.0759 t 911 new 0.26) lr 1.00e-05 gnorm 0.069 5.89s mem 15.6GB +[2026-09-13 21:50:42] step 3715/5000 loss 0.0991 (w 0.5810 mse 0.5966 t 34 new 0.20) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 21:50:48] step 3716/5000 loss 0.1484 (w 0.1265 mse 0.1205 t 940 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:50:54] step 3717/5000 loss 0.0782 (w 0.1172 mse 0.1125 t 967 new 0.21) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 21:51:00] step 3718/5000 loss 0.0825 (w 0.1203 mse 0.1142 t 962 new 0.24) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 21:51:05] step 3719/5000 loss 0.0635 (w 0.0859 mse 0.0767 t 932 new 0.23) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 21:51:11] step 3720/5000 loss 0.0588 (w 0.0936 mse 0.0929 t 592 new 0.23) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 21:51:17] step 3721/5000 loss 0.0953 (w 0.0882 mse 0.0889 t 933 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 21:51:22] step 3722/5000 loss 0.0957 (w 0.0767 mse 0.0758 t 938 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:51:28] step 3723/5000 loss 0.1105 (w 0.2755 mse 0.2863 t 118 new 0.15) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 21:51:34] step 3724/5000 loss 0.0996 (w 0.2005 mse 0.1953 t 986 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:51:39] step 3725/5000 loss 0.0720 (w 0.0460 mse 0.0473 t 874 new 0.19) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:51:45] step 3726/5000 loss 0.0432 (w 0.0710 mse 0.0691 t 866 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:51:51] step 3727/5000 loss 0.0614 (w 0.1380 mse 0.1363 t 967 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:51:57] step 3728/5000 loss 0.0788 (w 0.0681 mse 0.0642 t 892 new 0.22) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 21:52:02] step 3729/5000 loss 0.0800 (w 0.1069 mse 0.1106 t 219 new 0.30) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 21:52:08] step 3730/5000 loss 0.0605 (w 0.0471 mse 0.0504 t 805 new 0.21) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 21:52:14] step 3731/5000 loss 0.1057 (w 0.0522 mse 0.0514 t 471 new 0.26) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 21:52:19] step 3732/5000 loss 0.0973 (w 0.0783 mse 0.0781 t 560 new 0.09) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:52:25] step 3733/5000 loss 0.0914 (w 0.0492 mse 0.0529 t 796 new 0.24) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +[2026-09-13 21:52:31] step 3734/5000 loss 0.0706 (w 0.0567 mse 0.0541 t 733 new 0.23) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 21:52:37] step 3735/5000 loss 0.1153 (w 0.1107 mse 0.1040 t 471 new 0.26) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 21:52:42] step 3736/5000 loss 0.0392 (w 0.0445 mse 0.0435 t 923 new 0.05) lr 1.00e-05 gnorm 0.058 5.94s mem 15.6GB +[2026-09-13 21:52:48] step 3737/5000 loss 0.0917 (w 0.0506 mse 0.0515 t 735 new 0.15) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 21:52:54] step 3738/5000 loss 0.0808 (w 0.0843 mse 0.0827 t 603 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:53:00] step 3739/5000 loss 0.1060 (w 0.1035 mse 0.1015 t 914 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 21:53:05] step 3740/5000 loss 0.0941 (w 0.0492 mse 0.0516 t 961 new 0.22) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 21:53:11] step 3741/5000 loss 0.0965 (w 0.0796 mse 0.0693 t 905 new 0.26) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 21:53:17] step 3742/5000 loss 0.0726 (w 0.0508 mse 0.0526 t 840 new 0.23) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 21:53:22] step 3743/5000 loss 0.0791 (w 0.1747 mse 0.1756 t 201 new 0.14) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:53:28] step 3744/5000 loss 0.1005 (w 0.0516 mse 0.0481 t 793 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 21:53:34] step 3745/5000 loss 0.1590 (w 0.1135 mse 0.1152 t 906 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:53:40] step 3746/5000 loss 0.0883 (w 0.0850 mse 0.0887 t 516 new 0.18) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 21:53:45] step 3747/5000 loss 0.1777 (w 0.1047 mse 0.0993 t 568 new 0.20) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:53:51] step 3748/5000 loss 0.0916 (w 0.0913 mse 0.0907 t 827 new 0.22) lr 1.00e-05 gnorm 0.066 5.79s mem 15.6GB +[2026-09-13 21:53:57] step 3749/5000 loss 0.1009 (w 0.0674 mse 0.0627 t 698 new 0.13) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 21:54:02] step 3750/5000 loss 0.0932 (w 0.1222 mse 0.1137 t 784 new 0.27) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 21:54:08] step 3751/5000 loss 0.0935 (w 0.0635 mse 0.0661 t 904 new 0.25) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 21:54:14] step 3752/5000 loss 0.1048 (w 0.0661 mse 0.0614 t 556 new 0.27) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 21:54:20] step 3753/5000 loss 0.0547 (w 0.0974 mse 0.0885 t 921 new 0.27) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 21:54:25] step 3754/5000 loss 0.1086 (w 0.0544 mse 0.0570 t 579 new 0.24) lr 1.00e-05 gnorm 0.065 5.71s mem 15.6GB +[2026-09-13 21:54:31] step 3755/5000 loss 0.0786 (w 0.2179 mse 0.2090 t 130 new 0.21) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 21:54:37] step 3756/5000 loss 0.1017 (w 0.3729 mse 0.3917 t 57 new 0.29) lr 1.00e-05 gnorm 0.055 5.89s mem 15.6GB +[2026-09-13 21:54:43] step 3757/5000 loss 0.0777 (w 0.0984 mse 0.0939 t 541 new 0.25) lr 1.00e-05 gnorm 0.059 5.93s mem 15.6GB +[2026-09-13 21:54:49] step 3758/5000 loss 0.1064 (w 0.3178 mse 0.3196 t 150 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 21:54:54] step 3759/5000 loss 0.0922 (w 0.0882 mse 0.0868 t 952 new 0.14) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 21:55:00] step 3760/5000 loss 0.0779 (w 0.1985 mse 0.2168 t 161 new 0.23) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 21:55:06] step 3761/5000 loss 0.1086 (w 0.1344 mse 0.1202 t 948 new 0.24) lr 1.00e-05 gnorm 0.070 5.67s mem 15.6GB +[2026-09-13 21:55:12] step 3762/5000 loss 0.0627 (w 0.0851 mse 0.0828 t 839 new 0.24) lr 1.00e-05 gnorm 0.045 5.68s mem 15.6GB +[2026-09-13 21:55:17] step 3763/5000 loss 0.0960 (w 0.0688 mse 0.0637 t 851 new 0.20) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 21:55:23] step 3764/5000 loss 0.0747 (w 0.0800 mse 0.0736 t 905 new 0.25) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 21:55:29] step 3765/5000 loss 0.0924 (w 0.0157 mse 0.0184 t 739 new 0.17) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 21:55:34] step 3766/5000 loss 0.0682 (w 0.0776 mse 0.0759 t 889 new 0.23) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 21:55:40] step 3767/5000 loss 0.1084 (w 0.0761 mse 0.0701 t 680 new 0.18) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 21:55:46] step 3768/5000 loss 0.0787 (w 0.0601 mse 0.0572 t 812 new 0.25) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:55:52] step 3769/5000 loss 0.0953 (w 0.1351 mse 0.1256 t 970 new 0.26) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 21:55:57] step 3770/5000 loss 0.1140 (w 0.1269 mse 0.1256 t 930 new 0.18) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:56:03] step 3771/5000 loss 0.0783 (w 0.1261 mse 0.1225 t 980 new 0.20) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 21:56:09] step 3772/5000 loss 0.1214 (w 0.1076 mse 0.0992 t 859 new 0.18) lr 1.00e-05 gnorm 0.073 5.92s mem 15.6GB +[2026-09-13 21:56:15] step 3773/5000 loss 0.0889 (w 0.0920 mse 0.0889 t 895 new 0.19) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 21:56:20] step 3774/5000 loss 0.1019 (w 0.1392 mse 0.1322 t 948 new 0.23) lr 1.00e-05 gnorm 0.080 5.71s mem 15.6GB +[2026-09-13 21:56:26] step 3775/5000 loss 0.1565 (w 0.1586 mse 0.1491 t 978 new 0.25) lr 1.00e-05 gnorm 0.070 6.09s mem 15.6GB +[2026-09-13 21:56:32] step 3776/5000 loss 0.1002 (w 0.0796 mse 0.0788 t 538 new 0.24) lr 1.00e-05 gnorm 0.067 5.90s mem 15.6GB +[2026-09-13 21:56:38] step 3777/5000 loss 0.1304 (w 0.2041 mse 0.2108 t 229 new 0.23) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 21:56:44] step 3778/5000 loss 0.0637 (w 0.0690 mse 0.0682 t 873 new 0.17) lr 1.00e-05 gnorm 0.062 6.08s mem 15.6GB +[2026-09-13 21:56:50] step 3779/5000 loss 0.0972 (w 0.0792 mse 0.0762 t 810 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 21:56:56] step 3780/5000 loss 0.0577 (w 0.0517 mse 0.0548 t 802 new 0.19) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 21:57:02] step 3781/5000 loss 0.1103 (w 0.1197 mse 0.1186 t 334 new 0.11) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 21:57:07] step 3782/5000 loss 0.0906 (w 0.0851 mse 0.0838 t 541 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 21:57:13] step 3783/5000 loss 0.0921 (w 0.0676 mse 0.0634 t 861 new 0.28) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 21:57:19] step 3784/5000 loss 0.1004 (w 0.0919 mse 0.0989 t 183 new 0.16) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 21:57:24] step 3785/5000 loss 0.0867 (w 0.1995 mse 0.1967 t 971 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 21:57:30] step 3786/5000 loss 0.1199 (w 0.0790 mse 0.0761 t 748 new 0.11) lr 1.00e-05 gnorm 0.079 5.79s mem 15.6GB +[2026-09-13 21:57:36] step 3787/5000 loss 0.0390 (w 0.1253 mse 0.1199 t 903 new 0.18) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 21:57:42] step 3788/5000 loss 0.0751 (w 0.1204 mse 0.1171 t 928 new 0.21) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 21:57:47] step 3789/5000 loss 0.1420 (w 0.0844 mse 0.0767 t 942 new 0.21) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 21:57:53] step 3790/5000 loss 0.0982 (w 0.0788 mse 0.0833 t 339 new 0.17) lr 1.00e-05 gnorm 0.058 5.90s mem 15.6GB +[2026-09-13 21:57:59] step 3791/5000 loss 0.0957 (w 0.1154 mse 0.1074 t 883 new 0.28) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 21:58:05] step 3792/5000 loss 0.1081 (w 0.1137 mse 0.1095 t 990 new 0.19) lr 1.00e-05 gnorm 0.055 5.74s mem 15.6GB +[2026-09-13 21:58:11] step 3793/5000 loss 0.0905 (w 0.0469 mse 0.0505 t 950 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 21:58:16] step 3794/5000 loss 0.1134 (w 0.1200 mse 0.1162 t 655 new 0.30) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 21:58:22] step 3795/5000 loss 0.0804 (w 0.0844 mse 0.0759 t 885 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 21:58:28] step 3796/5000 loss 0.0615 (w 0.0416 mse 0.0414 t 935 new 0.26) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 21:58:34] step 3797/5000 loss 0.0499 (w 0.0583 mse 0.0561 t 830 new 0.25) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 21:58:39] step 3798/5000 loss 0.0747 (w 0.1552 mse 0.1552 t 384 new 0.26) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 21:58:45] step 3799/5000 loss 0.0635 (w 0.0675 mse 0.0655 t 771 new 0.27) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 21:58:51] step 3800/5000 loss 0.0317 (w 0.3584 mse 0.3035 t 996 new 0.28) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 21:58:57] step 3801/5000 loss 0.0653 (w 0.0422 mse 0.0425 t 896 new 0.14) lr 1.00e-05 gnorm 0.065 5.72s mem 15.6GB +[2026-09-13 21:59:03] step 3802/5000 loss 0.0773 (w 0.0423 mse 0.0374 t 884 new 0.22) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +[2026-09-13 21:59:08] step 3803/5000 loss 0.1000 (w 0.0608 mse 0.0630 t 610 new 0.25) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 21:59:14] step 3804/5000 loss 0.0652 (w 0.1173 mse 0.1055 t 930 new 0.29) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 21:59:20] step 3805/5000 loss 0.0654 (w 0.0511 mse 0.0507 t 753 new 0.16) lr 1.00e-05 gnorm 0.046 5.69s mem 15.6GB +[2026-09-13 21:59:25] step 3806/5000 loss 0.0716 (w 0.0550 mse 0.0568 t 819 new 0.09) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 21:59:31] step 3807/5000 loss 0.0907 (w 0.0792 mse 0.0774 t 759 new 0.21) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 21:59:37] step 3808/5000 loss 0.1054 (w 0.0775 mse 0.0779 t 952 new 0.21) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 21:59:43] step 3809/5000 loss 0.1194 (w 0.1199 mse 0.1123 t 940 new 0.23) lr 1.00e-05 gnorm 0.074 5.81s mem 15.6GB +[2026-09-13 21:59:48] step 3810/5000 loss 0.0841 (w 0.0451 mse 0.0441 t 877 new 0.16) lr 1.00e-05 gnorm 0.062 5.72s mem 15.6GB +[2026-09-13 21:59:54] step 3811/5000 loss 0.0989 (w 0.0727 mse 0.0660 t 546 new 0.23) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 22:00:00] step 3812/5000 loss 0.1077 (w 0.1081 mse 0.1108 t 229 new 0.13) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 22:00:06] step 3813/5000 loss 0.1235 (w 0.1194 mse 0.1178 t 258 new 0.20) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 22:00:11] step 3814/5000 loss 0.0519 (w 0.0888 mse 0.0809 t 873 new 0.25) lr 1.00e-05 gnorm 0.058 5.71s mem 15.6GB +[2026-09-13 22:00:17] step 3815/5000 loss 0.1036 (w 0.0864 mse 0.0776 t 789 new 0.25) lr 1.00e-05 gnorm 0.059 5.71s mem 15.6GB +[2026-09-13 22:00:23] step 3816/5000 loss 0.0659 (w 0.0603 mse 0.0539 t 870 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:00:29] step 3817/5000 loss 0.0795 (w 0.0965 mse 0.0967 t 668 new 0.15) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 22:00:34] step 3818/5000 loss 0.1355 (w 0.0627 mse 0.0634 t 742 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 22:00:40] step 3819/5000 loss 0.0707 (w 0.1034 mse 0.0934 t 993 new 0.25) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 22:00:46] step 3820/5000 loss 0.0658 (w 0.1229 mse 0.1239 t 948 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:00:52] step 3821/5000 loss 0.0725 (w 0.0684 mse 0.0691 t 473 new 0.17) lr 1.00e-05 gnorm 0.059 5.97s mem 15.6GB +[2026-09-13 22:00:58] step 3822/5000 loss 0.0624 (w 0.1120 mse 0.1077 t 954 new 0.13) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 22:01:03] step 3823/5000 loss 0.0562 (w 0.0804 mse 0.0786 t 986 new 0.23) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 22:01:09] step 3824/5000 loss 0.0467 (w 0.8000 mse 0.8047 t 20 new 0.19) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 22:01:15] step 3825/5000 loss 0.0892 (w 0.0711 mse 0.0657 t 788 new 0.23) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:01:20] step 3826/5000 loss 0.0867 (w 0.1182 mse 0.1108 t 750 new 0.28) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 22:01:26] step 3827/5000 loss 0.0791 (w 0.1432 mse 0.1309 t 986 new 0.24) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 22:01:32] step 3828/5000 loss 0.0532 (w 0.1415 mse 0.1248 t 963 new 0.21) lr 1.00e-05 gnorm 0.053 5.72s mem 15.6GB +[2026-09-13 22:01:38] step 3829/5000 loss 0.0666 (w 0.0830 mse 0.0829 t 868 new 0.23) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 22:01:43] step 3830/5000 loss 0.1301 (w 0.0714 mse 0.0697 t 853 new 0.21) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 22:01:49] step 3831/5000 loss 0.0826 (w 0.0720 mse 0.0655 t 761 new 0.20) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 22:01:55] step 3832/5000 loss 0.0803 (w 0.0581 mse 0.0559 t 910 new 0.23) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 22:02:01] step 3833/5000 loss 0.0935 (w 0.0873 mse 0.0846 t 375 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 22:02:06] step 3834/5000 loss 0.1054 (w 0.0718 mse 0.0732 t 682 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:02:12] step 3835/5000 loss 0.0691 (w 0.0468 mse 0.0521 t 360 new 0.13) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 22:02:18] step 3836/5000 loss 0.1123 (w 0.0599 mse 0.0579 t 640 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 22:02:23] step 3837/5000 loss 0.0496 (w 0.0545 mse 0.0541 t 730 new 0.11) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 22:02:29] step 3838/5000 loss 0.0604 (w 0.1057 mse 0.0929 t 935 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:02:35] step 3839/5000 loss 0.0675 (w 0.0567 mse 0.0545 t 885 new 0.22) lr 1.00e-05 gnorm 0.069 5.67s mem 15.6GB +[2026-09-13 22:02:41] step 3840/5000 loss 0.0985 (w 0.0620 mse 0.0600 t 868 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:02:47] step 3841/5000 loss 0.0857 (w 0.0951 mse 0.0881 t 858 new 0.25) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 22:02:52] step 3842/5000 loss 0.0734 (w 0.0912 mse 0.0839 t 961 new 0.21) lr 1.00e-05 gnorm 0.069 5.67s mem 15.6GB +[2026-09-13 22:02:58] step 3843/5000 loss 0.0818 (w 0.0773 mse 0.0730 t 971 new 0.30) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:03:04] step 3844/5000 loss 0.1669 (w 0.2487 mse 0.2466 t 208 new 0.24) lr 1.00e-05 gnorm 0.098 5.93s mem 15.6GB +[2026-09-13 22:03:10] step 3845/5000 loss 0.0908 (w 0.1529 mse 0.1622 t 987 new 0.20) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 22:03:15] step 3846/5000 loss 0.0683 (w 0.1474 mse 0.1412 t 937 new 0.28) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:03:21] step 3847/5000 loss 0.1354 (w 0.0781 mse 0.0726 t 824 new 0.18) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 22:03:27] step 3848/5000 loss 0.0996 (w 0.9808 mse 0.9820 t 10 new 0.18) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:03:33] step 3849/5000 loss 0.0566 (w 0.0721 mse 0.0655 t 904 new 0.22) lr 1.00e-05 gnorm 0.089 5.68s mem 15.6GB +[2026-09-13 22:03:38] step 3850/5000 loss 0.1383 (w 0.1268 mse 0.1194 t 391 new 0.25) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 22:03:44] step 3851/5000 loss 0.0778 (w 0.0837 mse 0.0812 t 552 new 0.17) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 22:03:50] step 3852/5000 loss 0.0628 (w 0.0720 mse 0.0707 t 795 new 0.19) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 22:03:55] step 3853/5000 loss 0.1427 (w 0.0559 mse 0.0547 t 595 new 0.20) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 22:04:01] step 3854/5000 loss 0.0606 (w 0.0881 mse 0.0883 t 821 new 0.14) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 22:04:07] step 3855/5000 loss 0.0972 (w 0.0826 mse 0.0810 t 882 new 0.25) lr 1.00e-05 gnorm 0.081 5.69s mem 15.6GB +[2026-09-13 22:04:12] step 3856/5000 loss 0.0936 (w 0.0657 mse 0.0664 t 673 new 0.22) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 22:04:18] step 3857/5000 loss 0.1217 (w 0.1592 mse 0.1564 t 985 new 0.24) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:04:24] step 3858/5000 loss 0.1085 (w 0.1278 mse 0.1236 t 886 new 0.31) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 22:04:30] step 3859/5000 loss 0.0777 (w 0.0916 mse 0.0876 t 538 new 0.27) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 22:04:35] step 3860/5000 loss 0.0937 (w 0.1046 mse 0.0976 t 982 new 0.16) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 22:04:41] step 3861/5000 loss 0.0921 (w 0.0709 mse 0.0684 t 788 new 0.21) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:04:47] step 3862/5000 loss 0.1218 (w 0.0580 mse 0.0534 t 869 new 0.08) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 22:04:53] step 3863/5000 loss 0.0999 (w 0.0922 mse 0.0895 t 905 new 0.24) lr 1.00e-05 gnorm 0.106 5.69s mem 15.6GB +[2026-09-13 22:04:58] step 3864/5000 loss 0.0676 (w 0.0881 mse 0.0979 t 978 new 0.23) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 22:05:04] step 3865/5000 loss 0.0724 (w 0.0717 mse 0.0702 t 768 new 0.24) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 22:05:10] step 3866/5000 loss 0.1064 (w 0.0725 mse 0.0676 t 821 new 0.24) lr 1.00e-05 gnorm 0.080 5.93s mem 15.6GB +[2026-09-13 22:05:16] step 3867/5000 loss 0.1149 (w 0.1095 mse 0.1030 t 768 new 0.23) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 22:05:21] step 3868/5000 loss 0.0808 (w 0.0750 mse 0.0759 t 977 new 0.16) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +[2026-09-13 22:05:27] step 3869/5000 loss 0.0713 (w 0.0779 mse 0.0737 t 867 new 0.11) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 22:05:33] step 3870/5000 loss 0.0878 (w 0.0939 mse 0.0887 t 731 new 0.21) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 22:05:39] step 3871/5000 loss 0.1008 (w 0.2063 mse 0.1995 t 995 new 0.25) lr 1.00e-05 gnorm 0.088 5.70s mem 15.6GB +[2026-09-13 22:05:44] step 3872/5000 loss 0.0821 (w 0.0797 mse 0.0776 t 787 new 0.23) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 22:05:50] step 3873/5000 loss 0.0712 (w 0.0991 mse 0.0907 t 826 new 0.23) lr 1.00e-05 gnorm 0.070 5.77s mem 15.6GB +[2026-09-13 22:05:56] step 3874/5000 loss 0.1413 (w 0.0753 mse 0.0709 t 643 new 0.25) lr 1.00e-05 gnorm 0.107 5.69s mem 15.6GB +[2026-09-13 22:06:01] step 3875/5000 loss 0.0692 (w 0.0986 mse 0.0900 t 717 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 22:06:07] step 3876/5000 loss 0.0882 (w 0.0944 mse 0.0903 t 428 new 0.24) lr 1.00e-05 gnorm 0.054 5.81s mem 15.6GB +[2026-09-13 22:06:13] step 3877/5000 loss 0.0846 (w 0.1067 mse 0.0987 t 966 new 0.24) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 22:06:19] step 3878/5000 loss 0.1070 (w 0.1129 mse 0.1132 t 306 new 0.27) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 22:06:24] step 3879/5000 loss 0.0684 (w 0.1165 mse 0.1066 t 940 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:06:30] step 3880/5000 loss 0.1009 (w 0.1690 mse 0.1647 t 270 new 0.24) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:06:36] step 3881/5000 loss 0.0745 (w 0.0760 mse 0.0760 t 892 new 0.25) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +[2026-09-13 22:06:42] step 3882/5000 loss 0.0789 (w 0.1238 mse 0.1226 t 878 new 0.21) lr 1.00e-05 gnorm 0.081 5.71s mem 15.6GB +[2026-09-13 22:06:48] step 3883/5000 loss 0.0821 (w 0.1446 mse 0.1406 t 972 new 0.19) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 22:06:53] step 3884/5000 loss 0.0842 (w 0.1072 mse 0.0944 t 932 new 0.21) lr 1.00e-05 gnorm 0.112 5.88s mem 15.6GB +[2026-09-13 22:06:59] step 3885/5000 loss 0.0940 (w 0.0921 mse 0.0845 t 710 new 0.19) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 22:07:05] step 3886/5000 loss 0.0409 (w 0.0921 mse 0.0920 t 964 new 0.24) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 22:07:11] step 3887/5000 loss 0.1099 (w 0.1385 mse 0.1359 t 309 new 0.19) lr 1.00e-05 gnorm 0.101 5.68s mem 15.6GB +[2026-09-13 22:07:16] step 3888/5000 loss 0.1382 (w 0.1402 mse 0.1387 t 389 new 0.26) lr 1.00e-05 gnorm 0.093 5.68s mem 15.6GB +[2026-09-13 22:07:22] step 3889/5000 loss 0.0521 (w 0.0753 mse 0.0670 t 744 new 0.24) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 22:07:28] step 3890/5000 loss 0.1323 (w 0.0926 mse 0.0941 t 976 new 0.24) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 22:07:33] step 3891/5000 loss 0.0686 (w 0.0643 mse 0.0580 t 915 new 0.26) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 22:07:39] step 3892/5000 loss 0.0872 (w 0.0356 mse 0.0378 t 719 new 0.16) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +[2026-09-13 22:07:45] step 3893/5000 loss 0.0855 (w 0.0448 mse 0.0489 t 596 new 0.27) lr 1.00e-05 gnorm 0.063 5.93s mem 15.6GB +[2026-09-13 22:07:51] step 3894/5000 loss 0.0653 (w 0.2390 mse 0.2315 t 97 new 0.27) lr 1.00e-05 gnorm 0.065 5.78s mem 15.6GB +[2026-09-13 22:07:56] step 3895/5000 loss 0.1017 (w 0.2912 mse 0.2637 t 996 new 0.19) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:08:02] step 3896/5000 loss 0.0925 (w 0.0814 mse 0.0808 t 389 new 0.22) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 22:08:08] step 3897/5000 loss 0.0794 (w 0.1335 mse 0.1323 t 900 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:08:14] step 3898/5000 loss 0.0735 (w 0.2015 mse 0.1836 t 981 new 0.23) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 22:08:19] step 3899/5000 loss 0.0542 (w 0.0963 mse 0.0971 t 866 new 0.21) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 22:08:25] step 3900/5000 loss 0.0758 (w 0.1043 mse 0.0999 t 657 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:08:31] step 3901/5000 loss 0.1285 (w 0.0674 mse 0.0621 t 858 new 0.21) lr 1.00e-05 gnorm 0.070 5.67s mem 15.6GB +[2026-09-13 22:08:37] step 3902/5000 loss 0.1030 (w 0.1948 mse 0.1898 t 232 new 0.24) lr 1.00e-05 gnorm 0.068 5.92s mem 15.6GB +[2026-09-13 22:08:43] step 3903/5000 loss 0.1117 (w 0.0633 mse 0.0612 t 709 new 0.26) lr 1.00e-05 gnorm 0.074 5.86s mem 15.6GB +[2026-09-13 22:08:48] step 3904/5000 loss 0.0654 (w 0.0954 mse 0.0897 t 939 new 0.19) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 22:08:54] step 3905/5000 loss 0.0834 (w 0.1156 mse 0.1100 t 894 new 0.25) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 22:09:00] step 3906/5000 loss 0.1177 (w 0.1116 mse 0.1077 t 727 new 0.24) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 22:09:06] step 3907/5000 loss 0.0758 (w 0.0489 mse 0.0516 t 984 new 0.18) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 22:09:11] step 3908/5000 loss 0.0898 (w 0.0572 mse 0.0530 t 647 new 0.13) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 22:09:17] step 3909/5000 loss 0.1103 (w 0.0884 mse 0.0881 t 927 new 0.21) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 22:09:23] step 3910/5000 loss 0.0671 (w 0.0797 mse 0.0764 t 809 new 0.23) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 22:09:28] step 3911/5000 loss 0.0954 (w 0.0721 mse 0.0699 t 868 new 0.28) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 22:09:34] step 3912/5000 loss 0.1106 (w 0.0548 mse 0.0570 t 727 new 0.16) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 22:09:40] step 3913/5000 loss 0.1456 (w 0.1401 mse 0.1246 t 969 new 0.26) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 22:09:45] step 3914/5000 loss 0.1059 (w 0.1289 mse 0.1228 t 349 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:09:51] step 3915/5000 loss 0.0987 (w 0.0753 mse 0.0681 t 827 new 0.18) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 22:09:57] step 3916/5000 loss 0.0646 (w 0.1929 mse 0.1832 t 999 new 0.26) lr 1.00e-05 gnorm 0.082 5.91s mem 15.6GB +[2026-09-13 22:10:03] step 3917/5000 loss 0.0924 (w 0.1176 mse 0.1126 t 953 new 0.18) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 22:10:09] step 3918/5000 loss 0.0698 (w 0.5269 mse 0.4404 t 999 new 0.21) lr 1.00e-05 gnorm 0.052 5.93s mem 15.6GB +[2026-09-13 22:10:14] step 3919/5000 loss 0.1032 (w 0.0751 mse 0.0765 t 538 new 0.13) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 22:10:20] step 3920/5000 loss 0.0683 (w 0.1301 mse 0.1249 t 992 new 0.26) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 22:10:26] step 3921/5000 loss 0.1176 (w 0.0997 mse 0.0949 t 727 new 0.30) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 22:10:32] step 3922/5000 loss 0.0970 (w 0.0730 mse 0.0751 t 904 new 0.19) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 22:10:37] step 3923/5000 loss 0.0812 (w 0.0664 mse 0.0664 t 602 new 0.26) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 22:10:43] step 3924/5000 loss 0.0603 (w 0.1106 mse 0.1036 t 909 new 0.24) lr 1.00e-05 gnorm 0.055 5.91s mem 15.6GB +[2026-09-13 22:10:49] step 3925/5000 loss 0.0785 (w 0.0460 mse 0.0483 t 821 new 0.26) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 22:10:55] step 3926/5000 loss 0.0493 (w 0.1028 mse 0.0997 t 946 new 0.22) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 22:11:00] step 3927/5000 loss 0.1184 (w 0.0695 mse 0.0641 t 595 new 0.23) lr 1.00e-05 gnorm 0.061 5.72s mem 15.6GB +[2026-09-13 22:11:06] step 3928/5000 loss 0.0866 (w 0.0611 mse 0.0703 t 988 new 0.18) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 22:11:12] step 3929/5000 loss 0.1025 (w 0.1008 mse 0.0959 t 360 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:11:17] step 3930/5000 loss 0.0954 (w 0.1294 mse 0.1280 t 391 new 0.21) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 22:11:23] step 3931/5000 loss 0.0625 (w 0.1223 mse 0.1201 t 935 new 0.21) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 22:11:29] step 3932/5000 loss 0.0558 (w 0.0593 mse 0.0557 t 776 new 0.22) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 22:11:34] step 3933/5000 loss 0.0787 (w 0.0794 mse 0.0760 t 942 new 0.26) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 22:11:40] step 3934/5000 loss 0.0355 (w 0.0349 mse 0.0328 t 907 new 0.22) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 22:11:46] step 3935/5000 loss 0.1061 (w 0.0750 mse 0.0690 t 820 new 0.27) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 22:11:52] step 3936/5000 loss 0.1010 (w 0.1112 mse 0.1085 t 966 new 0.09) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 22:11:57] step 3937/5000 loss 0.0813 (w 0.0813 mse 0.0729 t 805 new 0.28) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 22:12:03] step 3938/5000 loss 0.0750 (w 0.1533 mse 0.1470 t 960 new 0.24) lr 1.00e-05 gnorm 0.066 5.83s mem 15.6GB +[2026-09-13 22:12:09] step 3939/5000 loss 0.0779 (w 0.0208 mse 0.0225 t 774 new 0.11) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:12:15] step 3940/5000 loss 0.1404 (w 0.0459 mse 0.0458 t 650 new 0.05) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 22:12:20] step 3941/5000 loss 0.0909 (w 0.2654 mse 0.2629 t 130 new 0.21) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 22:12:26] step 3942/5000 loss 0.0832 (w 0.3436 mse 0.3466 t 62 new 0.15) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 22:12:32] step 3943/5000 loss 0.0850 (w 0.1298 mse 0.1214 t 930 new 0.21) lr 1.00e-05 gnorm 0.088 5.71s mem 15.6GB +[2026-09-13 22:12:38] step 3944/5000 loss 0.0685 (w 0.0541 mse 0.0520 t 679 new 0.14) lr 1.00e-05 gnorm 0.060 5.89s mem 15.6GB +[2026-09-13 22:12:44] step 3945/5000 loss 0.0619 (w 0.1246 mse 0.1203 t 905 new 0.22) lr 1.00e-05 gnorm 0.053 5.79s mem 15.6GB +[2026-09-13 22:12:50] step 3946/5000 loss 0.0835 (w 0.1792 mse 0.1676 t 982 new 0.20) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 22:12:55] step 3947/5000 loss 0.0811 (w 0.0781 mse 0.0745 t 947 new 0.13) lr 1.00e-05 gnorm 0.064 5.90s mem 15.6GB +[2026-09-13 22:13:01] step 3948/5000 loss 0.0721 (w 0.0768 mse 0.0746 t 557 new 0.24) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:13:07] step 3949/5000 loss 0.0750 (w 0.0837 mse 0.0860 t 995 new 0.14) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:13:13] step 3950/5000 loss 0.0442 (w 0.0712 mse 0.0655 t 859 new 0.29) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 22:13:18] step 3951/5000 loss 0.1107 (w 0.1486 mse 0.1503 t 998 new 0.18) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 22:13:24] step 3952/5000 loss 0.0745 (w 0.0582 mse 0.0556 t 733 new 0.23) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:13:30] step 3953/5000 loss 0.0840 (w 0.0595 mse 0.0560 t 790 new 0.28) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 22:13:35] step 3954/5000 loss 0.0546 (w 0.0730 mse 0.0694 t 508 new 0.19) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 22:13:41] step 3955/5000 loss 0.0934 (w 0.0981 mse 0.1050 t 963 new 0.23) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 22:13:47] step 3956/5000 loss 0.0708 (w 0.0598 mse 0.0564 t 825 new 0.28) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 22:13:52] step 3957/5000 loss 0.0366 (w 0.0694 mse 0.0649 t 879 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:13:58] step 3958/5000 loss 0.1127 (w 0.1229 mse 0.1115 t 967 new 0.27) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 22:14:04] step 3959/5000 loss 0.0840 (w 0.0836 mse 0.0821 t 480 new 0.26) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 22:14:10] step 3960/5000 loss 0.0894 (w 0.0638 mse 0.0640 t 879 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 22:14:16] step 3961/5000 loss 0.1110 (w 0.0815 mse 0.0756 t 668 new 0.14) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 22:14:21] step 3962/5000 loss 0.1039 (w 0.0911 mse 0.0840 t 697 new 0.25) lr 1.00e-05 gnorm 0.077 5.68s mem 15.6GB +[2026-09-13 22:14:27] step 3963/5000 loss 0.0841 (w 0.1618 mse 0.1477 t 978 new 0.19) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:14:33] step 3964/5000 loss 0.0488 (w 0.1487 mse 0.1348 t 965 new 0.29) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:14:39] step 3965/5000 loss 0.1100 (w 0.0836 mse 0.0802 t 833 new 0.21) lr 1.00e-05 gnorm 0.060 5.89s mem 15.6GB +[2026-09-13 22:14:44] step 3966/5000 loss 0.0772 (w 0.0828 mse 0.0764 t 829 new 0.21) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 22:14:50] step 3967/5000 loss 0.1134 (w 0.0879 mse 0.0892 t 986 new 0.20) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 22:14:56] step 3968/5000 loss 0.0863 (w 0.1207 mse 0.1154 t 978 new 0.29) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 22:15:02] step 3969/5000 loss 0.0977 (w 0.0830 mse 0.0804 t 928 new 0.27) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 22:15:07] step 3970/5000 loss 0.0977 (w 0.0812 mse 0.0784 t 540 new 0.25) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 22:15:13] step 3971/5000 loss 0.0642 (w 0.0831 mse 0.0808 t 484 new 0.20) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 22:15:19] step 3972/5000 loss 0.1070 (w 0.1402 mse 0.1432 t 303 new 0.13) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 22:15:24] step 3973/5000 loss 0.0567 (w 0.1120 mse 0.1090 t 951 new 0.13) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 22:15:30] step 3974/5000 loss 0.0873 (w 0.0522 mse 0.0543 t 836 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:15:36] step 3975/5000 loss 0.0817 (w 0.0914 mse 0.0909 t 762 new 0.19) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 22:15:41] step 3976/5000 loss 0.0741 (w 0.1214 mse 0.1167 t 968 new 0.17) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:15:47] step 3977/5000 loss 0.0572 (w 0.0836 mse 0.0758 t 876 new 0.29) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 22:15:53] step 3978/5000 loss 0.0989 (w 0.4387 mse 0.4739 t 57 new 0.17) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 22:15:59] step 3979/5000 loss 0.1212 (w 0.0639 mse 0.0595 t 715 new 0.25) lr 1.00e-05 gnorm 0.062 6.09s mem 15.6GB +[2026-09-13 22:16:05] step 3980/5000 loss 0.0774 (w 0.0753 mse 0.0708 t 901 new 0.19) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 22:16:10] step 3981/5000 loss 0.1003 (w 0.0784 mse 0.0773 t 947 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 22:16:16] step 3982/5000 loss 0.0911 (w 0.0475 mse 0.0485 t 819 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:16:22] step 3983/5000 loss 0.0795 (w 0.0653 mse 0.0636 t 869 new 0.25) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 22:16:27] step 3984/5000 loss 0.0522 (w 0.0896 mse 0.0894 t 499 new 0.21) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:16:33] step 3985/5000 loss 0.0650 (w 0.2537 mse 0.2506 t 150 new 0.18) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 22:16:39] step 3986/5000 loss 0.0777 (w 0.0605 mse 0.0577 t 849 new 0.10) lr 1.00e-05 gnorm 0.067 5.91s mem 15.6GB +[2026-09-13 22:16:45] step 3987/5000 loss 0.0880 (w 0.1301 mse 0.1219 t 988 new 0.29) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:16:50] step 3988/5000 loss 0.1020 (w 0.0713 mse 0.0688 t 730 new 0.14) lr 1.00e-05 gnorm 0.084 5.67s mem 15.6GB +[2026-09-13 22:16:56] step 3989/5000 loss 0.0828 (w 0.0821 mse 0.0763 t 918 new 0.32) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 22:17:02] step 3990/5000 loss 0.0717 (w 0.1244 mse 0.1251 t 942 new 0.19) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 22:17:08] step 3991/5000 loss 0.1220 (w 0.0519 mse 0.0503 t 929 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 22:17:13] step 3992/5000 loss 0.0777 (w 0.1384 mse 0.1244 t 971 new 0.25) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 22:17:19] step 3993/5000 loss 0.0675 (w 0.1085 mse 0.1066 t 394 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:17:25] step 3994/5000 loss 0.0977 (w 0.0718 mse 0.0667 t 853 new 0.22) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 22:17:30] step 3995/5000 loss 0.0704 (w 0.0549 mse 0.0546 t 869 new 0.22) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 22:17:36] step 3996/5000 loss 0.0811 (w 0.0758 mse 0.0694 t 714 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:17:42] step 3997/5000 loss 0.1092 (w 0.0861 mse 0.0872 t 972 new 0.18) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:17:48] step 3998/5000 loss 0.0447 (w 0.1089 mse 0.0986 t 896 new 0.27) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 22:17:53] step 3999/5000 loss 0.0838 (w 0.1380 mse 0.1250 t 971 new 0.22) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 22:17:59] step 4000/5000 loss 0.0659 (w 0.3408 mse 0.3269 t 999 new 0.15) lr 1.00e-05 gnorm 0.054 5.80s mem 15.6GB +[2026-09-13 22:18:03] [val] step 4000 t=201: w=0.1740 mse=0.1764 (n=16) t=501: w=0.0720 mse=0.0719 (n=16) t=800: w=0.0600 mse=0.0588 (n=16) | mean w=0.1020 mse=0.1024 4s +[2026-09-13 22:18:07] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step4000.safetensors 832 个张量 2.87 GB +[2026-09-13 22:18:13] step 4001/5000 loss 0.1073 (w 0.0518 mse 0.0498 t 809 new 0.27) lr 1.00e-05 gnorm 0.066 5.67s mem 15.6GB +[2026-09-13 22:18:18] step 4002/5000 loss 0.0726 (w 0.0972 mse 0.0872 t 900 new 0.30) lr 1.00e-05 gnorm 0.073 5.71s mem 15.6GB +[2026-09-13 22:18:24] step 4003/5000 loss 0.0660 (w 0.0746 mse 0.0710 t 901 new 0.24) lr 1.00e-05 gnorm 0.050 5.71s mem 15.6GB +[2026-09-13 22:18:30] step 4004/5000 loss 0.1087 (w 0.1467 mse 0.1429 t 242 new 0.22) lr 1.00e-05 gnorm 0.068 5.71s mem 15.6GB +[2026-09-13 22:18:36] step 4005/5000 loss 0.0943 (w 0.0529 mse 0.0527 t 892 new 0.13) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 22:18:41] step 4006/5000 loss 0.0642 (w 0.0697 mse 0.0675 t 563 new 0.20) lr 1.00e-05 gnorm 0.045 5.71s mem 15.6GB +[2026-09-13 22:18:47] step 4007/5000 loss 0.1355 (w 0.0603 mse 0.0590 t 488 new 0.12) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 22:18:53] step 4008/5000 loss 0.1168 (w 0.0719 mse 0.0722 t 434 new 0.21) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 22:18:59] step 4009/5000 loss 0.0664 (w 0.0933 mse 0.0910 t 963 new 0.12) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +[2026-09-13 22:19:04] step 4010/5000 loss 0.0755 (w 0.1095 mse 0.1003 t 925 new 0.29) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:19:10] step 4011/5000 loss 0.1077 (w 0.0520 mse 0.0490 t 721 new 0.23) lr 1.00e-05 gnorm 0.064 5.83s mem 15.6GB +[2026-09-13 22:19:16] step 4012/5000 loss 0.0939 (w 0.0797 mse 0.0796 t 552 new 0.19) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:19:21] step 4013/5000 loss 0.1377 (w 0.0945 mse 0.0895 t 495 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 22:19:27] step 4014/5000 loss 0.0753 (w 0.0651 mse 0.0647 t 821 new 0.13) lr 1.00e-05 gnorm 0.067 5.92s mem 15.6GB +[2026-09-13 22:19:33] step 4015/5000 loss 0.0831 (w 0.0732 mse 0.0792 t 225 new 0.14) lr 1.00e-05 gnorm 0.052 5.71s mem 15.6GB +[2026-09-13 22:19:39] step 4016/5000 loss 0.0756 (w 0.0764 mse 0.0731 t 940 new 0.29) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 22:19:45] step 4017/5000 loss 0.0938 (w 0.0523 mse 0.0525 t 904 new 0.29) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 22:19:50] step 4018/5000 loss 0.1192 (w 0.1610 mse 0.1487 t 993 new 0.20) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 22:19:56] step 4019/5000 loss 0.0518 (w 0.0674 mse 0.0615 t 917 new 0.24) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 22:20:02] step 4020/5000 loss 0.0904 (w 0.0776 mse 0.0686 t 829 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:20:07] step 4021/5000 loss 0.0776 (w 0.0580 mse 0.0560 t 798 new 0.24) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:20:13] step 4022/5000 loss 0.0576 (w 0.1008 mse 0.0983 t 936 new 0.16) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 22:20:19] step 4023/5000 loss 0.1449 (w 0.1312 mse 0.1301 t 453 new 0.25) lr 1.00e-05 gnorm 0.082 5.69s mem 15.6GB +[2026-09-13 22:20:25] step 4024/5000 loss 0.1401 (w 0.1474 mse 0.1453 t 344 new 0.22) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 22:20:30] step 4025/5000 loss 0.1113 (w 0.1053 mse 0.0972 t 814 new 0.31) lr 1.00e-05 gnorm 0.057 5.92s mem 15.6GB +[2026-09-13 22:20:36] step 4026/5000 loss 0.0792 (w 0.2036 mse 0.1871 t 991 new 0.30) lr 1.00e-05 gnorm 0.047 5.71s mem 15.6GB +[2026-09-13 22:20:42] step 4027/5000 loss 0.0767 (w 0.1010 mse 0.1014 t 935 new 0.23) lr 1.00e-05 gnorm 0.063 5.71s mem 15.6GB +[2026-09-13 22:20:48] step 4028/5000 loss 0.0983 (w 0.0816 mse 0.0803 t 486 new 0.15) lr 1.00e-05 gnorm 0.076 5.84s mem 15.6GB +[2026-09-13 22:20:54] step 4029/5000 loss 0.0843 (w 0.0642 mse 0.0640 t 588 new 0.20) lr 1.00e-05 gnorm 0.046 5.91s mem 15.6GB +[2026-09-13 22:20:59] step 4030/5000 loss 0.0641 (w 0.1093 mse 0.1012 t 966 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:21:05] step 4031/5000 loss 0.1589 (w 0.1759 mse 0.1742 t 208 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:21:11] step 4032/5000 loss 0.0702 (w 0.1110 mse 0.1062 t 929 new 0.21) lr 1.00e-05 gnorm 0.056 5.84s mem 15.6GB +[2026-09-13 22:21:17] step 4033/5000 loss 0.0829 (w 0.0633 mse 0.0588 t 903 new 0.22) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +[2026-09-13 22:21:22] step 4034/5000 loss 0.0676 (w 0.0759 mse 0.0745 t 619 new 0.18) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 22:21:28] step 4035/5000 loss 0.1278 (w 0.1113 mse 0.1071 t 516 new 0.17) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 22:21:34] step 4036/5000 loss 0.0641 (w 0.1032 mse 0.0963 t 957 new 0.18) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 22:21:39] step 4037/5000 loss 0.0788 (w 0.0849 mse 0.0797 t 923 new 0.22) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 22:21:45] step 4038/5000 loss 0.0854 (w 0.0889 mse 0.0913 t 885 new 0.16) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:21:51] step 4039/5000 loss 0.1142 (w 0.1591 mse 0.1545 t 270 new 0.25) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 22:21:57] step 4040/5000 loss 0.0817 (w 0.0566 mse 0.0541 t 756 new 0.22) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 22:22:02] step 4041/5000 loss 0.0868 (w 0.0833 mse 0.0813 t 961 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 22:22:08] step 4042/5000 loss 0.0734 (w 0.0780 mse 0.0757 t 964 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:22:14] step 4043/5000 loss 0.1322 (w 0.2706 mse 0.2705 t 126 new 0.21) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 22:22:19] step 4044/5000 loss 0.0810 (w 0.1250 mse 0.1227 t 270 new 0.27) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:22:25] step 4045/5000 loss 0.1301 (w 0.5300 mse 0.5195 t 88 new 0.15) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 22:22:31] step 4046/5000 loss 0.0968 (w 0.0661 mse 0.0604 t 651 new 0.27) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:22:37] step 4047/5000 loss 0.1181 (w 0.0618 mse 0.0604 t 459 new 0.20) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 22:22:42] step 4048/5000 loss 0.0861 (w 0.1401 mse 0.1301 t 964 new 0.29) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 22:22:48] step 4049/5000 loss 0.1097 (w 0.0789 mse 0.0756 t 724 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 22:22:54] step 4050/5000 loss 0.0437 (w 0.0196 mse 0.0176 t 789 new 0.10) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:22:59] step 4051/5000 loss 0.0580 (w 0.1463 mse 0.1411 t 942 new 0.29) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 22:23:05] step 4052/5000 loss 0.1233 (w 0.1253 mse 0.1197 t 936 new 0.20) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 22:23:11] step 4053/5000 loss 0.0926 (w 0.0309 mse 0.0322 t 961 new 0.22) lr 1.00e-05 gnorm 0.045 5.85s mem 15.6GB +[2026-09-13 22:23:17] step 4054/5000 loss 0.0983 (w 0.1452 mse 0.1316 t 949 new 0.30) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 22:23:22] step 4055/5000 loss 0.0835 (w 0.1787 mse 0.1578 t 1000 new 0.22) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:23:28] step 4056/5000 loss 0.0679 (w 0.0414 mse 0.0492 t 950 new 0.22) lr 1.00e-05 gnorm 0.049 5.91s mem 15.6GB +[2026-09-13 22:23:34] step 4057/5000 loss 0.0900 (w 0.0509 mse 0.0535 t 956 new 0.24) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +[2026-09-13 22:23:40] step 4058/5000 loss 0.0919 (w 0.0730 mse 0.0712 t 926 new 0.27) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 22:23:45] step 4059/5000 loss 0.0552 (w 0.0790 mse 0.0752 t 744 new 0.24) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:23:51] step 4060/5000 loss 0.0821 (w 0.1673 mse 0.1802 t 447 new 0.17) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 22:23:57] step 4061/5000 loss 0.0612 (w 0.1553 mse 0.1563 t 988 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 22:24:03] step 4062/5000 loss 0.1084 (w 0.0995 mse 0.0942 t 425 new 0.28) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 22:24:08] step 4063/5000 loss 0.0662 (w 0.0884 mse 0.0889 t 913 new 0.23) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 22:24:14] step 4064/5000 loss 0.0982 (w 0.2005 mse 0.1972 t 225 new 0.20) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 22:24:20] step 4065/5000 loss 0.1277 (w 0.0964 mse 0.0930 t 761 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 22:24:26] step 4066/5000 loss 0.1352 (w 0.0619 mse 0.0642 t 493 new 0.20) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:24:31] step 4067/5000 loss 0.1083 (w 0.1175 mse 0.1093 t 951 new 0.23) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:24:37] step 4068/5000 loss 0.1046 (w 0.0788 mse 0.0735 t 577 new 0.23) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 22:24:43] step 4069/5000 loss 0.0769 (w 0.0644 mse 0.0620 t 708 new 0.20) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 22:24:48] step 4070/5000 loss 0.0852 (w 0.1086 mse 0.1014 t 941 new 0.24) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 22:24:54] step 4071/5000 loss 0.0960 (w 0.1033 mse 0.0972 t 930 new 0.23) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 22:25:00] step 4072/5000 loss 0.0643 (w 0.0670 mse 0.0622 t 823 new 0.18) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +[2026-09-13 22:25:06] step 4073/5000 loss 0.0713 (w 0.0392 mse 0.0387 t 651 new 0.22) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 22:25:11] step 4074/5000 loss 0.0369 (w 0.0522 mse 0.0539 t 794 new 0.25) lr 1.00e-05 gnorm 0.066 5.82s mem 15.6GB +[2026-09-13 22:25:17] step 4075/5000 loss 0.0492 (w 0.1254 mse 0.1180 t 887 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 22:25:23] step 4076/5000 loss 0.0871 (w 0.2022 mse 0.1969 t 978 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 22:25:29] step 4077/5000 loss 0.0877 (w 0.1224 mse 0.1333 t 551 new 0.18) lr 1.00e-05 gnorm 0.069 5.93s mem 15.6GB +[2026-09-13 22:25:34] step 4078/5000 loss 0.0949 (w 0.1143 mse 0.1116 t 288 new 0.28) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 22:25:40] step 4079/5000 loss 0.0902 (w 0.0474 mse 0.0452 t 749 new 0.09) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 22:25:46] step 4080/5000 loss 0.0684 (w 0.0365 mse 0.0381 t 967 new 0.11) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:25:52] step 4081/5000 loss 0.0727 (w 0.0746 mse 0.0680 t 702 new 0.30) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:25:57] step 4082/5000 loss 0.0894 (w 0.0785 mse 0.0766 t 484 new 0.26) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +[2026-09-13 22:26:03] step 4083/5000 loss 0.0905 (w 0.5894 mse 0.5808 t 25 new 0.14) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 22:26:09] step 4084/5000 loss 0.0992 (w 0.0879 mse 0.0822 t 792 new 0.20) lr 1.00e-05 gnorm 0.097 5.72s mem 15.6GB +[2026-09-13 22:26:15] step 4085/5000 loss 0.1638 (w 0.1510 mse 0.1444 t 965 new 0.14) lr 1.00e-05 gnorm 0.067 5.71s mem 15.6GB +[2026-09-13 22:26:20] step 4086/5000 loss 0.0770 (w 0.2404 mse 0.2303 t 983 new 0.23) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 22:26:26] step 4087/5000 loss 0.0674 (w 0.0911 mse 0.0860 t 875 new 0.22) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 22:26:32] step 4088/5000 loss 0.0904 (w 0.1189 mse 0.1175 t 248 new 0.20) lr 1.00e-05 gnorm 0.080 5.76s mem 15.6GB +[2026-09-13 22:26:38] step 4089/5000 loss 0.0909 (w 0.0831 mse 0.0837 t 475 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:26:43] step 4090/5000 loss 0.1290 (w 0.1109 mse 0.1064 t 557 new 0.24) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 22:26:49] step 4091/5000 loss 0.0653 (w 0.1717 mse 0.1553 t 966 new 0.15) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 22:26:55] step 4092/5000 loss 0.0869 (w 0.0464 mse 0.0485 t 875 new 0.24) lr 1.00e-05 gnorm 0.067 5.92s mem 15.6GB +[2026-09-13 22:27:01] step 4093/5000 loss 0.0780 (w 0.0456 mse 0.0420 t 902 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:27:06] step 4094/5000 loss 0.0262 (w 0.0699 mse 0.0733 t 937 new 0.18) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:27:12] step 4095/5000 loss 0.0951 (w 0.1691 mse 0.1547 t 963 new 0.25) lr 1.00e-05 gnorm 0.092 5.68s mem 15.6GB +[2026-09-13 22:27:18] step 4096/5000 loss 0.0774 (w 0.1253 mse 0.1203 t 941 new 0.28) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 22:27:23] step 4097/5000 loss 0.1379 (w 0.1314 mse 0.1253 t 986 new 0.28) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:27:29] step 4098/5000 loss 0.1201 (w 0.0827 mse 0.0840 t 781 new 0.27) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 22:27:35] step 4099/5000 loss 0.1073 (w 0.0885 mse 0.0868 t 966 new 0.24) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +[2026-09-13 22:27:41] step 4100/5000 loss 0.0971 (w 0.0517 mse 0.0518 t 671 new 0.22) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 22:27:46] step 4101/5000 loss 0.0512 (w 0.0688 mse 0.0678 t 846 new 0.23) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 22:27:52] step 4102/5000 loss 0.1123 (w 0.1309 mse 0.1244 t 986 new 0.24) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 22:27:58] step 4103/5000 loss 0.1265 (w 0.1363 mse 0.1330 t 977 new 0.24) lr 1.00e-05 gnorm 0.076 5.79s mem 15.6GB +[2026-09-13 22:28:03] step 4104/5000 loss 0.1602 (w 0.0786 mse 0.0779 t 829 new 0.17) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 22:28:09] step 4105/5000 loss 0.1419 (w 0.1974 mse 0.1949 t 242 new 0.13) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 22:28:15] step 4106/5000 loss 0.0698 (w 0.1242 mse 0.1116 t 989 new 0.23) lr 1.00e-05 gnorm 0.054 5.73s mem 15.6GB +[2026-09-13 22:28:21] step 4107/5000 loss 0.0801 (w 0.0516 mse 0.0489 t 619 new 0.20) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 22:28:26] step 4108/5000 loss 0.0894 (w 0.0613 mse 0.0581 t 882 new 0.21) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 22:28:32] step 4109/5000 loss 0.0805 (w 0.0908 mse 0.0838 t 828 new 0.16) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +[2026-09-13 22:28:38] step 4110/5000 loss 0.0997 (w 0.0496 mse 0.0472 t 691 new 0.20) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 22:28:43] step 4111/5000 loss 0.0597 (w 0.0916 mse 0.0896 t 566 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 22:28:49] step 4112/5000 loss 0.0885 (w 0.0386 mse 0.0397 t 575 new 0.14) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 22:28:55] step 4113/5000 loss 0.0746 (w 0.0695 mse 0.0675 t 727 new 0.26) lr 1.00e-05 gnorm 0.049 5.92s mem 15.6GB +[2026-09-13 22:29:01] step 4114/5000 loss 0.0854 (w 0.1307 mse 0.1259 t 955 new 0.25) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 22:29:07] step 4115/5000 loss 0.0903 (w 0.0858 mse 0.0840 t 873 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 22:29:12] step 4116/5000 loss 0.0702 (w 0.0822 mse 0.0812 t 682 new 0.22) lr 1.00e-05 gnorm 0.056 5.83s mem 15.6GB +[2026-09-13 22:29:18] step 4117/5000 loss 0.0779 (w 0.0540 mse 0.0487 t 796 new 0.22) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 22:29:24] step 4118/5000 loss 0.0975 (w 0.0584 mse 0.0594 t 641 new 0.24) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 22:29:29] step 4119/5000 loss 0.0466 (w 0.0394 mse 0.0353 t 644 new 0.25) lr 1.00e-05 gnorm 0.053 5.67s mem 15.6GB +[2026-09-13 22:29:35] step 4120/5000 loss 0.1006 (w 0.0562 mse 0.0526 t 786 new 0.24) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 22:29:41] step 4121/5000 loss 0.0557 (w 0.1290 mse 0.1190 t 970 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:29:47] step 4122/5000 loss 0.0984 (w 0.1371 mse 0.1306 t 591 new 0.28) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 22:29:53] step 4123/5000 loss 0.1429 (w 0.1327 mse 0.1277 t 303 new 0.26) lr 1.00e-05 gnorm 0.075 5.92s mem 15.6GB +[2026-09-13 22:29:58] step 4124/5000 loss 0.0943 (w 0.0625 mse 0.0623 t 682 new 0.30) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:30:04] step 4125/5000 loss 0.0706 (w 0.4089 mse 0.4098 t 997 new 0.27) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:30:10] step 4126/5000 loss 0.0750 (w 0.0505 mse 0.0456 t 824 new 0.12) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 22:30:15] step 4127/5000 loss 0.0522 (w 0.0674 mse 0.0727 t 992 new 0.15) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 22:30:21] step 4128/5000 loss 0.1255 (w 0.0633 mse 0.0615 t 938 new 0.21) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:30:27] step 4129/5000 loss 0.1263 (w 0.0810 mse 0.0734 t 797 new 0.30) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 22:30:32] step 4130/5000 loss 0.1241 (w 0.6589 mse 0.6670 t 48 new 0.19) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 22:30:38] step 4131/5000 loss 0.0777 (w 0.1567 mse 0.1470 t 985 new 0.24) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 22:30:44] step 4132/5000 loss 0.1241 (w 0.1130 mse 0.1100 t 372 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:30:50] step 4133/5000 loss 0.0914 (w 0.0941 mse 0.0882 t 954 new 0.29) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 22:30:55] step 4134/5000 loss 0.0853 (w 0.0864 mse 0.0832 t 918 new 0.25) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +[2026-09-13 22:31:01] step 4135/5000 loss 0.0503 (w 0.1839 mse 0.1746 t 970 new 0.25) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 22:31:07] step 4136/5000 loss 0.0798 (w 0.0486 mse 0.0522 t 750 new 0.16) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 22:31:12] step 4137/5000 loss 0.0767 (w 0.0621 mse 0.0612 t 943 new 0.10) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 22:31:18] step 4138/5000 loss 0.0510 (w 0.1525 mse 0.1379 t 958 new 0.22) lr 1.00e-05 gnorm 0.075 5.86s mem 15.6GB +[2026-09-13 22:31:24] step 4139/5000 loss 0.1140 (w 0.0764 mse 0.0729 t 497 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 22:31:30] step 4140/5000 loss 0.0952 (w 0.0669 mse 0.0698 t 532 new 0.23) lr 1.00e-05 gnorm 0.057 5.93s mem 15.6GB +[2026-09-13 22:31:36] step 4141/5000 loss 0.1067 (w 0.0477 mse 0.0452 t 860 new 0.23) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 22:31:41] step 4142/5000 loss 0.0797 (w 0.1504 mse 0.1494 t 339 new 0.09) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:31:47] step 4143/5000 loss 0.0725 (w 0.0730 mse 0.0697 t 893 new 0.24) lr 1.00e-05 gnorm 0.051 5.68s mem 15.6GB +[2026-09-13 22:31:53] step 4144/5000 loss 0.0998 (w 0.0742 mse 0.0678 t 704 new 0.26) lr 1.00e-05 gnorm 0.074 5.93s mem 15.6GB +[2026-09-13 22:31:59] step 4145/5000 loss 0.0957 (w 0.0714 mse 0.0709 t 551 new 0.16) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 22:32:05] step 4146/5000 loss 0.1086 (w 0.0469 mse 0.0471 t 796 new 0.14) lr 1.00e-05 gnorm 0.056 5.89s mem 15.6GB +[2026-09-13 22:32:10] step 4147/5000 loss 0.0700 (w 0.1073 mse 0.1089 t 334 new 0.25) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:32:16] step 4148/5000 loss 0.0694 (w 0.0636 mse 0.0595 t 679 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:32:22] step 4149/5000 loss 0.0906 (w 0.0560 mse 0.0527 t 695 new 0.24) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 22:32:27] step 4150/5000 loss 0.0753 (w 0.0303 mse 0.0350 t 786 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:32:33] step 4151/5000 loss 0.0790 (w 0.0492 mse 0.0514 t 501 new 0.10) lr 1.00e-05 gnorm 0.065 5.75s mem 15.6GB +[2026-09-13 22:32:39] step 4152/5000 loss 0.1117 (w 0.2949 mse 0.2596 t 999 new 0.17) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 22:32:45] step 4153/5000 loss 0.0675 (w 0.1403 mse 0.1281 t 973 new 0.26) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 22:32:50] step 4154/5000 loss 0.1118 (w 0.0785 mse 0.0724 t 896 new 0.23) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 22:32:56] step 4155/5000 loss 0.1052 (w 0.1168 mse 0.1228 t 165 new 0.20) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 22:33:02] step 4156/5000 loss 0.0795 (w 0.1036 mse 0.0934 t 974 new 0.26) lr 1.00e-05 gnorm 0.050 5.81s mem 15.6GB +[2026-09-13 22:33:07] step 4157/5000 loss 0.0877 (w 0.0629 mse 0.0602 t 910 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 22:33:13] step 4158/5000 loss 0.0645 (w 0.0873 mse 0.0845 t 914 new 0.21) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 22:33:19] step 4159/5000 loss 0.0721 (w 0.0454 mse 0.0479 t 751 new 0.26) lr 1.00e-05 gnorm 0.243 5.69s mem 15.6GB +[2026-09-13 22:33:25] step 4160/5000 loss 0.1053 (w 0.1083 mse 0.1056 t 602 new 0.21) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:33:30] step 4161/5000 loss 0.0732 (w 0.1321 mse 0.1227 t 952 new 0.21) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 22:33:36] step 4162/5000 loss 0.1062 (w 0.0871 mse 0.0972 t 979 new 0.23) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 22:33:42] step 4163/5000 loss 0.1164 (w 0.0871 mse 0.0834 t 943 new 0.10) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 22:33:47] step 4164/5000 loss 0.0842 (w 0.0881 mse 0.0857 t 961 new 0.24) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:33:53] step 4165/5000 loss 0.0737 (w 0.0931 mse 0.0916 t 352 new 0.20) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 22:33:59] step 4166/5000 loss 0.0624 (w 0.0560 mse 0.0577 t 449 new 0.30) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:34:04] step 4167/5000 loss 0.0647 (w 0.0491 mse 0.0518 t 893 new 0.22) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 22:34:10] step 4168/5000 loss 0.1176 (w 0.0878 mse 0.0883 t 401 new 0.28) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 22:34:16] step 4169/5000 loss 0.1107 (w 0.0780 mse 0.0697 t 746 new 0.20) lr 1.00e-05 gnorm 0.062 5.71s mem 15.6GB +[2026-09-13 22:34:22] step 4170/5000 loss 0.0850 (w 0.0714 mse 0.0659 t 913 new 0.28) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:34:27] step 4171/5000 loss 0.0663 (w 0.1112 mse 0.1087 t 349 new 0.23) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 22:34:33] step 4172/5000 loss 0.0529 (w 0.0562 mse 0.0565 t 660 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 22:34:39] step 4173/5000 loss 0.1078 (w 0.5030 mse 0.4997 t 48 new 0.26) lr 1.00e-05 gnorm 0.103 5.69s mem 15.6GB +[2026-09-13 22:34:44] step 4174/5000 loss 0.0760 (w 0.0870 mse 0.0846 t 880 new 0.23) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 22:34:50] step 4175/5000 loss 0.1082 (w 0.0521 mse 0.0530 t 697 new 0.24) lr 1.00e-05 gnorm 0.081 5.68s mem 15.6GB +[2026-09-13 22:34:56] step 4176/5000 loss 0.1162 (w 0.0853 mse 0.0809 t 612 new 0.27) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +[2026-09-13 22:35:01] step 4177/5000 loss 0.1090 (w 0.1478 mse 0.1491 t 235 new 0.27) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:35:07] step 4178/5000 loss 0.0688 (w 0.1984 mse 0.1718 t 1000 new 0.21) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 22:35:13] step 4179/5000 loss 0.0656 (w 0.0660 mse 0.0611 t 869 new 0.21) lr 1.00e-05 gnorm 0.069 5.94s mem 15.6GB +[2026-09-13 22:35:19] step 4180/5000 loss 0.0974 (w 0.1076 mse 0.1061 t 852 new 0.20) lr 1.00e-05 gnorm 0.088 5.70s mem 15.6GB +[2026-09-13 22:35:25] step 4181/5000 loss 0.0844 (w 0.0553 mse 0.0578 t 702 new 0.14) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 22:35:30] step 4182/5000 loss 0.1036 (w 0.0944 mse 0.0968 t 885 new 0.18) lr 1.00e-05 gnorm 0.100 5.69s mem 15.6GB +[2026-09-13 22:35:36] step 4183/5000 loss 0.0806 (w 0.0904 mse 0.0822 t 892 new 0.30) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 22:35:42] step 4184/5000 loss 0.0550 (w 0.1339 mse 0.1176 t 950 new 0.26) lr 1.00e-05 gnorm 0.053 5.71s mem 15.6GB +[2026-09-13 22:35:47] step 4185/5000 loss 0.0564 (w 0.1083 mse 0.1133 t 258 new 0.29) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:35:53] step 4186/5000 loss 0.0899 (w 0.0845 mse 0.0830 t 682 new 0.26) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 22:35:59] step 4187/5000 loss 0.0781 (w 0.0895 mse 0.0896 t 771 new 0.20) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +[2026-09-13 22:36:05] step 4188/5000 loss 0.0599 (w 0.2333 mse 0.2133 t 984 new 0.26) lr 1.00e-05 gnorm 0.055 5.88s mem 15.6GB +[2026-09-13 22:36:10] step 4189/5000 loss 0.0631 (w 0.0449 mse 0.0443 t 742 new 0.12) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 22:36:16] step 4190/5000 loss 0.1032 (w 0.1077 mse 0.1026 t 909 new 0.29) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:36:22] step 4191/5000 loss 0.0933 (w 0.0518 mse 0.0536 t 443 new 0.14) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:36:28] step 4192/5000 loss 0.0831 (w 0.0797 mse 0.0760 t 717 new 0.23) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 22:36:33] step 4193/5000 loss 0.0730 (w 0.0904 mse 0.0887 t 900 new 0.26) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 22:36:39] step 4194/5000 loss 0.1290 (w 0.0949 mse 0.0887 t 928 new 0.18) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 22:36:45] step 4195/5000 loss 0.0788 (w 0.0739 mse 0.0685 t 745 new 0.27) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 22:36:50] step 4196/5000 loss 0.0784 (w 0.0357 mse 0.0365 t 885 new 0.09) lr 1.00e-05 gnorm 0.091 5.70s mem 15.6GB +[2026-09-13 22:36:56] step 4197/5000 loss 0.0672 (w 0.1188 mse 0.1107 t 966 new 0.30) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:37:02] step 4198/5000 loss 0.0923 (w 0.0984 mse 0.1064 t 309 new 0.24) lr 1.00e-05 gnorm 0.070 5.88s mem 15.6GB +[2026-09-13 22:37:08] step 4199/5000 loss 0.0776 (w 0.0440 mse 0.0495 t 575 new 0.19) lr 1.00e-05 gnorm 0.098 5.71s mem 15.6GB +[2026-09-13 22:37:14] step 4200/5000 loss 0.0562 (w 0.0480 mse 0.0522 t 978 new 0.13) lr 1.00e-05 gnorm 0.072 6.06s mem 15.6GB +[2026-09-13 22:37:20] step 4201/5000 loss 0.0866 (w 0.8478 mse 0.8843 t 10 new 0.25) lr 1.00e-05 gnorm 0.083 5.70s mem 15.6GB +[2026-09-13 22:37:25] step 4202/5000 loss 0.0584 (w 0.0665 mse 0.0658 t 815 new 0.25) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 22:37:31] step 4203/5000 loss 0.0623 (w 0.0794 mse 0.0773 t 832 new 0.20) lr 1.00e-05 gnorm 0.054 5.91s mem 15.6GB +[2026-09-13 22:37:37] step 4204/5000 loss 0.0945 (w 0.1556 mse 0.1521 t 988 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 22:37:43] step 4205/5000 loss 0.0564 (w 0.1213 mse 0.1190 t 994 new 0.17) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 22:37:48] step 4206/5000 loss 0.1110 (w 0.0608 mse 0.0588 t 608 new 0.13) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 22:37:54] step 4207/5000 loss 0.0740 (w 0.0817 mse 0.0851 t 987 new 0.15) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 22:38:00] step 4208/5000 loss 0.0935 (w 0.1919 mse 0.1803 t 1000 new 0.26) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 22:38:05] step 4209/5000 loss 0.0564 (w 0.0769 mse 0.0691 t 750 new 0.30) lr 1.00e-05 gnorm 0.073 5.73s mem 15.6GB +[2026-09-13 22:38:11] step 4210/5000 loss 0.0838 (w 0.0925 mse 0.0853 t 938 new 0.17) lr 1.00e-05 gnorm 0.071 5.80s mem 15.6GB +[2026-09-13 22:38:17] step 4211/5000 loss 0.0864 (w 0.0682 mse 0.0646 t 869 new 0.20) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 22:38:23] step 4212/5000 loss 0.1355 (w 0.1066 mse 0.1023 t 779 new 0.18) lr 1.00e-05 gnorm 0.104 5.69s mem 15.6GB +[2026-09-13 22:38:28] step 4213/5000 loss 0.0825 (w 0.0713 mse 0.0733 t 993 new 0.07) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 22:38:34] step 4214/5000 loss 0.0803 (w 0.1609 mse 0.1548 t 965 new 0.29) lr 1.00e-05 gnorm 0.075 5.74s mem 15.6GB +[2026-09-13 22:38:40] step 4215/5000 loss 0.0411 (w 0.0750 mse 0.0719 t 842 new 0.15) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 22:38:45] step 4216/5000 loss 0.1041 (w 0.0875 mse 0.0851 t 802 new 0.18) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 22:38:51] step 4217/5000 loss 0.0989 (w 0.2338 mse 0.2313 t 126 new 0.28) lr 1.00e-05 gnorm 0.093 5.69s mem 15.6GB +[2026-09-13 22:38:57] step 4218/5000 loss 0.1288 (w 0.2374 mse 0.2258 t 157 new 0.24) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 22:39:03] step 4219/5000 loss 0.0978 (w 0.0673 mse 0.0613 t 856 new 0.19) lr 1.00e-05 gnorm 0.060 5.91s mem 15.6GB +[2026-09-13 22:39:09] step 4220/5000 loss 0.0804 (w 0.1093 mse 0.1073 t 334 new 0.28) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 22:39:14] step 4221/5000 loss 0.1181 (w 0.0577 mse 0.0557 t 791 new 0.22) lr 1.00e-05 gnorm 0.095 5.71s mem 15.6GB +[2026-09-13 22:39:20] step 4222/5000 loss 0.0724 (w 0.2213 mse 0.1890 t 996 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:39:26] step 4223/5000 loss 0.1105 (w 0.1207 mse 0.1084 t 995 new 0.26) lr 1.00e-05 gnorm 0.120 5.69s mem 15.6GB +[2026-09-13 22:39:31] step 4224/5000 loss 0.0770 (w 0.0678 mse 0.0618 t 786 new 0.29) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +[2026-09-13 22:39:37] step 4225/5000 loss 0.0758 (w 0.0603 mse 0.0598 t 780 new 0.28) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 22:39:43] step 4226/5000 loss 0.0784 (w 0.3111 mse 0.3230 t 142 new 0.19) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 22:39:48] step 4227/5000 loss 0.0615 (w 0.2160 mse 0.2028 t 995 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 22:39:54] step 4228/5000 loss 0.0765 (w 0.0862 mse 0.0788 t 864 new 0.29) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +[2026-09-13 22:40:00] step 4229/5000 loss 0.0907 (w 0.0728 mse 0.0697 t 896 new 0.17) lr 1.00e-05 gnorm 0.057 5.79s mem 15.6GB +[2026-09-13 22:40:06] step 4230/5000 loss 0.1248 (w 0.0912 mse 0.0856 t 855 new 0.20) lr 1.00e-05 gnorm 0.091 5.73s mem 15.6GB +[2026-09-13 22:40:11] step 4231/5000 loss 0.1012 (w 0.0718 mse 0.0712 t 571 new 0.24) lr 1.00e-05 gnorm 0.131 5.70s mem 15.6GB +[2026-09-13 22:40:17] step 4232/5000 loss 0.1184 (w 0.1245 mse 0.1315 t 267 new 0.09) lr 1.00e-05 gnorm 0.060 5.76s mem 15.6GB +[2026-09-13 22:40:23] step 4233/5000 loss 0.1081 (w 0.0900 mse 0.0896 t 584 new 0.18) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 22:40:29] step 4234/5000 loss 0.0782 (w 0.0696 mse 0.0656 t 960 new 0.22) lr 1.00e-05 gnorm 0.103 5.71s mem 15.6GB +[2026-09-13 22:40:35] step 4235/5000 loss 0.0532 (w 0.1180 mse 0.1189 t 984 new 0.07) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +[2026-09-13 22:40:40] step 4236/5000 loss 0.1034 (w 0.0695 mse 0.0696 t 749 new 0.31) lr 1.00e-05 gnorm 0.070 5.71s mem 15.6GB +[2026-09-13 22:40:46] step 4237/5000 loss 0.0694 (w 0.0242 mse 0.0245 t 598 new 0.01) lr 1.00e-05 gnorm 0.091 5.70s mem 15.6GB +[2026-09-13 22:40:52] step 4238/5000 loss 0.0544 (w 0.0837 mse 0.0739 t 847 new 0.23) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +[2026-09-13 22:40:58] step 4239/5000 loss 0.1081 (w 0.0743 mse 0.0759 t 966 new 0.14) lr 1.00e-05 gnorm 0.067 6.05s mem 15.6GB +[2026-09-13 22:41:04] step 4240/5000 loss 0.0677 (w 0.1999 mse 0.1996 t 172 new 0.30) lr 1.00e-05 gnorm 0.085 5.91s mem 15.6GB +[2026-09-13 22:41:10] step 4241/5000 loss 0.0923 (w 0.1486 mse 0.1386 t 352 new 0.28) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:41:15] step 4242/5000 loss 0.0973 (w 0.1350 mse 0.1248 t 947 new 0.23) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 22:41:21] step 4243/5000 loss 0.0838 (w 0.1168 mse 0.1112 t 584 new 0.25) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 22:41:27] step 4244/5000 loss 0.0490 (w 0.0637 mse 0.0646 t 885 new 0.16) lr 1.00e-05 gnorm 0.045 5.69s mem 15.6GB +[2026-09-13 22:41:32] step 4245/5000 loss 0.1015 (w 0.0905 mse 0.0850 t 912 new 0.22) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 22:41:38] step 4246/5000 loss 0.0868 (w 0.1459 mse 0.1486 t 954 new 0.19) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 22:41:44] step 4247/5000 loss 0.0662 (w 0.0719 mse 0.0713 t 922 new 0.15) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 22:41:50] step 4248/5000 loss 0.0619 (w 0.0511 mse 0.0491 t 648 new 0.26) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 22:41:55] step 4249/5000 loss 0.0496 (w 0.0586 mse 0.0583 t 900 new 0.29) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 22:42:01] step 4250/5000 loss 0.0983 (w 0.0726 mse 0.0659 t 923 new 0.13) lr 1.00e-05 gnorm 0.068 5.74s mem 15.6GB +[2026-09-13 22:42:07] step 4251/5000 loss 0.0939 (w 0.0285 mse 0.0308 t 898 new 0.17) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 22:42:13] step 4252/5000 loss 0.0592 (w 0.1199 mse 0.1129 t 913 new 0.30) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 22:42:18] step 4253/5000 loss 0.0790 (w 0.2181 mse 0.2176 t 201 new 0.18) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:42:24] step 4254/5000 loss 0.0827 (w 0.0591 mse 0.0561 t 771 new 0.20) lr 1.00e-05 gnorm 0.094 5.69s mem 15.6GB +[2026-09-13 22:42:30] step 4255/5000 loss 0.0837 (w 0.2069 mse 0.1975 t 976 new 0.27) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 22:42:35] step 4256/5000 loss 0.0597 (w 0.0712 mse 0.0660 t 749 new 0.24) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:42:41] step 4257/5000 loss 0.0648 (w 0.0402 mse 0.0407 t 693 new 0.15) lr 1.00e-05 gnorm 0.085 5.70s mem 15.6GB +[2026-09-13 22:42:47] step 4258/5000 loss 0.1189 (w 0.0889 mse 0.0814 t 578 new 0.24) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 22:42:52] step 4259/5000 loss 0.0628 (w 0.0806 mse 0.0799 t 530 new 0.22) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 22:42:58] step 4260/5000 loss 0.0888 (w 0.0833 mse 0.0783 t 836 new 0.28) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 22:43:04] step 4261/5000 loss 0.1112 (w 0.1233 mse 0.1267 t 918 new 0.21) lr 1.00e-05 gnorm 0.066 6.14s mem 15.6GB +[2026-09-13 22:43:10] step 4262/5000 loss 0.0763 (w 0.0730 mse 0.0688 t 919 new 0.27) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:43:16] step 4263/5000 loss 0.1006 (w 0.0670 mse 0.0658 t 863 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 22:43:22] step 4264/5000 loss 0.0864 (w 0.0710 mse 0.0657 t 831 new 0.22) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 22:43:27] step 4265/5000 loss 0.1049 (w 0.0771 mse 0.0732 t 646 new 0.18) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 22:43:33] step 4266/5000 loss 0.0916 (w 0.0759 mse 0.0724 t 980 new 0.18) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 22:43:39] step 4267/5000 loss 0.0816 (w 0.0568 mse 0.0542 t 650 new 0.17) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 22:43:45] step 4268/5000 loss 0.0963 (w 0.0875 mse 0.0791 t 904 new 0.20) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 22:43:50] step 4269/5000 loss 0.0987 (w 0.0797 mse 0.0779 t 938 new 0.07) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 22:43:56] step 4270/5000 loss 0.0898 (w 0.0660 mse 0.0634 t 665 new 0.21) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:44:02] step 4271/5000 loss 0.0862 (w 0.0945 mse 0.0939 t 509 new 0.25) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 22:44:08] step 4272/5000 loss 0.0548 (w 0.1385 mse 0.1221 t 955 new 0.24) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 22:44:13] step 4273/5000 loss 0.0864 (w 0.0809 mse 0.0734 t 830 new 0.27) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 22:44:19] step 4274/5000 loss 0.1043 (w 0.1287 mse 0.1176 t 595 new 0.28) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:44:25] step 4275/5000 loss 0.0769 (w 0.1159 mse 0.1186 t 963 new 0.20) lr 1.00e-05 gnorm 0.072 5.83s mem 15.6GB +[2026-09-13 22:44:31] step 4276/5000 loss 0.1009 (w 0.0856 mse 0.0796 t 666 new 0.26) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:44:36] step 4277/5000 loss 0.0744 (w 0.0897 mse 0.0831 t 775 new 0.26) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 22:44:42] step 4278/5000 loss 0.1258 (w 0.0814 mse 0.0782 t 700 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:44:48] step 4279/5000 loss 0.0813 (w 0.0740 mse 0.0737 t 890 new 0.19) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 22:44:53] step 4280/5000 loss 0.1791 (w 0.1088 mse 0.1046 t 545 new 0.24) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 22:44:59] step 4281/5000 loss 0.0601 (w 0.1089 mse 0.1102 t 942 new 0.23) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 22:45:05] step 4282/5000 loss 0.0584 (w 0.1387 mse 0.1385 t 974 new 0.21) lr 1.00e-05 gnorm 0.045 5.94s mem 15.6GB +[2026-09-13 22:45:11] step 4283/5000 loss 0.0853 (w 0.0557 mse 0.0533 t 545 new 0.26) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 22:45:17] step 4284/5000 loss 0.0723 (w 0.1539 mse 0.1404 t 982 new 0.24) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 22:45:22] step 4285/5000 loss 0.0932 (w 0.1151 mse 0.1107 t 447 new 0.26) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 22:45:28] step 4286/5000 loss 0.0656 (w 0.0671 mse 0.0640 t 878 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:45:34] step 4287/5000 loss 0.0648 (w 0.1945 mse 0.1738 t 990 new 0.14) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 22:45:40] step 4288/5000 loss 0.1164 (w 0.0935 mse 0.0974 t 905 new 0.18) lr 1.00e-05 gnorm 0.067 5.84s mem 15.6GB +[2026-09-13 22:45:45] step 4289/5000 loss 0.0730 (w 0.1139 mse 0.1076 t 949 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:45:51] step 4290/5000 loss 0.0924 (w 0.0612 mse 0.0584 t 901 new 0.29) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 22:45:57] step 4291/5000 loss 0.0700 (w 0.0755 mse 0.0751 t 718 new 0.21) lr 1.00e-05 gnorm 0.047 5.70s mem 15.6GB +[2026-09-13 22:46:03] step 4292/5000 loss 0.1333 (w 0.0885 mse 0.0882 t 522 new 0.24) lr 1.00e-05 gnorm 0.092 5.70s mem 15.6GB +[2026-09-13 22:46:08] step 4293/5000 loss 0.0786 (w 0.6069 mse 0.6032 t 62 new 0.26) lr 1.00e-05 gnorm 0.060 5.72s mem 15.6GB +[2026-09-13 22:46:14] step 4294/5000 loss 0.1643 (w 0.0977 mse 0.0940 t 617 new 0.25) lr 1.00e-05 gnorm 0.083 5.75s mem 15.6GB +[2026-09-13 22:46:20] step 4295/5000 loss 0.0537 (w 0.1446 mse 0.1313 t 959 new 0.26) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:46:25] step 4296/5000 loss 0.0945 (w 0.0827 mse 0.0782 t 780 new 0.19) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 22:46:31] step 4297/5000 loss 0.0950 (w 0.1248 mse 0.1204 t 996 new 0.09) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 22:46:37] step 4298/5000 loss 0.0719 (w 0.0567 mse 0.0568 t 661 new 0.20) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 22:46:43] step 4299/5000 loss 0.0755 (w 0.0439 mse 0.0410 t 845 new 0.24) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 22:46:48] step 4300/5000 loss 0.0622 (w 0.0818 mse 0.0758 t 812 new 0.20) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +[2026-09-13 22:46:54] step 4301/5000 loss 0.0768 (w 0.0619 mse 0.0621 t 849 new 0.19) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 22:47:00] step 4302/5000 loss 0.0473 (w 0.0593 mse 0.0593 t 798 new 0.20) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 22:47:05] step 4303/5000 loss 0.0981 (w 0.0757 mse 0.0720 t 887 new 0.22) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 22:47:11] step 4304/5000 loss 0.0864 (w 0.2197 mse 0.2314 t 142 new 0.09) lr 1.00e-05 gnorm 0.046 5.69s mem 15.6GB +[2026-09-13 22:47:17] step 4305/5000 loss 0.0722 (w 0.0770 mse 0.0765 t 937 new 0.19) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:47:23] step 4306/5000 loss 0.0906 (w 0.0786 mse 0.0757 t 807 new 0.20) lr 1.00e-05 gnorm 0.054 5.72s mem 15.6GB +[2026-09-13 22:47:28] step 4307/5000 loss 0.0695 (w 0.0619 mse 0.0608 t 737 new 0.11) lr 1.00e-05 gnorm 0.060 5.71s mem 15.6GB +[2026-09-13 22:47:34] step 4308/5000 loss 0.1330 (w 0.3572 mse 0.3570 t 109 new 0.23) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 22:47:40] step 4309/5000 loss 0.1128 (w 0.0321 mse 0.0326 t 735 new 0.21) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 22:47:46] step 4310/5000 loss 0.0933 (w 0.5878 mse 0.6308 t 25 new 0.30) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +[2026-09-13 22:47:51] step 4311/5000 loss 0.1260 (w 0.0584 mse 0.0529 t 509 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:47:57] step 4312/5000 loss 0.0672 (w 0.0955 mse 0.0904 t 983 new 0.22) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +[2026-09-13 22:48:03] step 4313/5000 loss 0.0546 (w 0.0552 mse 0.0551 t 855 new 0.27) lr 1.00e-05 gnorm 0.183 5.69s mem 15.6GB +[2026-09-13 22:48:08] step 4314/5000 loss 0.1068 (w 0.0893 mse 0.0847 t 384 new 0.21) lr 1.00e-05 gnorm 0.066 5.73s mem 15.6GB +[2026-09-13 22:48:14] step 4315/5000 loss 0.1189 (w 0.1232 mse 0.1210 t 962 new 0.25) lr 1.00e-05 gnorm 0.085 5.71s mem 15.6GB +[2026-09-13 22:48:20] step 4316/5000 loss 0.0770 (w 0.0462 mse 0.0466 t 877 new 0.10) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 22:48:26] step 4317/5000 loss 0.0808 (w 0.1635 mse 0.1676 t 232 new 0.25) lr 1.00e-05 gnorm 0.060 5.93s mem 15.6GB +[2026-09-13 22:48:32] step 4318/5000 loss 0.1139 (w 0.1591 mse 0.1573 t 981 new 0.22) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:48:37] step 4319/5000 loss 0.1127 (w 0.1252 mse 0.1201 t 980 new 0.28) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 22:48:43] step 4320/5000 loss 0.0714 (w 0.0373 mse 0.0384 t 823 new 0.20) lr 1.00e-05 gnorm 0.106 5.68s mem 15.6GB +[2026-09-13 22:48:49] step 4321/5000 loss 0.1006 (w 0.0923 mse 0.0837 t 898 new 0.22) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:48:54] step 4322/5000 loss 0.0606 (w 0.0431 mse 0.0413 t 591 new 0.17) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 22:49:00] step 4323/5000 loss 0.1351 (w 0.0924 mse 0.0920 t 434 new 0.18) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 22:49:06] step 4324/5000 loss 0.0400 (w 0.0984 mse 0.0949 t 971 new 0.23) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 22:49:12] step 4325/5000 loss 0.0423 (w 0.0476 mse 0.0462 t 780 new 0.21) lr 1.00e-05 gnorm 0.076 6.04s mem 15.6GB +[2026-09-13 22:49:18] step 4326/5000 loss 0.0870 (w 0.0921 mse 0.0848 t 962 new 0.19) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 22:49:23] step 4327/5000 loss 0.0930 (w 0.0580 mse 0.0598 t 610 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:49:29] step 4328/5000 loss 0.1179 (w 0.3256 mse 0.2967 t 998 new 0.24) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 22:49:35] step 4329/5000 loss 0.0959 (w 0.0881 mse 0.0819 t 950 new 0.16) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 22:49:40] step 4330/5000 loss 0.0852 (w 0.0709 mse 0.0661 t 871 new 0.23) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +[2026-09-13 22:49:46] step 4331/5000 loss 0.1054 (w 0.2155 mse 0.1949 t 1000 new 0.23) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:49:52] step 4332/5000 loss 0.1008 (w 0.4554 mse 0.4508 t 62 new 0.22) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 22:49:57] step 4333/5000 loss 0.0679 (w 0.2136 mse 0.2138 t 984 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:50:03] step 4334/5000 loss 0.1001 (w 0.0448 mse 0.0502 t 865 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 22:50:09] step 4335/5000 loss 0.0489 (w 0.1151 mse 0.1076 t 915 new 0.21) lr 1.00e-05 gnorm 0.072 5.94s mem 15.6GB +[2026-09-13 22:50:15] step 4336/5000 loss 0.0749 (w 0.1845 mse 0.1887 t 993 new 0.18) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +[2026-09-13 22:50:21] step 4337/5000 loss 0.0836 (w 0.0996 mse 0.0957 t 495 new 0.27) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:50:26] step 4338/5000 loss 0.0805 (w 0.0466 mse 0.0465 t 797 new 0.25) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 22:50:32] step 4339/5000 loss 0.0853 (w 0.1265 mse 0.1127 t 947 new 0.23) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 22:50:38] step 4340/5000 loss 0.0825 (w 0.0449 mse 0.0503 t 966 new 0.14) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +[2026-09-13 22:50:43] step 4341/5000 loss 0.0567 (w 0.0634 mse 0.0634 t 660 new 0.18) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 22:50:49] step 4342/5000 loss 0.1000 (w 0.3560 mse 0.3523 t 105 new 0.23) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 22:50:55] step 4343/5000 loss 0.0678 (w 0.0921 mse 0.0863 t 914 new 0.21) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:51:01] step 4344/5000 loss 0.1179 (w 0.0901 mse 0.0824 t 812 new 0.21) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 22:51:06] step 4345/5000 loss 0.0695 (w 0.1476 mse 0.1407 t 977 new 0.27) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 22:51:12] step 4346/5000 loss 0.1036 (w 0.0901 mse 0.0859 t 895 new 0.20) lr 1.00e-05 gnorm 0.082 5.81s mem 15.6GB +[2026-09-13 22:51:18] step 4347/5000 loss 0.0848 (w 0.0870 mse 0.0802 t 964 new 0.17) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 22:51:23] step 4348/5000 loss 0.0760 (w 0.0554 mse 0.0547 t 911 new 0.18) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 22:51:29] step 4349/5000 loss 0.0723 (w 0.1901 mse 0.1797 t 995 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:51:35] step 4350/5000 loss 0.1440 (w 0.0926 mse 0.0955 t 349 new 0.25) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 22:51:41] step 4351/5000 loss 0.1302 (w 0.1102 mse 0.1073 t 612 new 0.11) lr 1.00e-05 gnorm 0.077 5.91s mem 15.6GB +[2026-09-13 22:51:47] step 4352/5000 loss 0.0700 (w 0.0807 mse 0.0772 t 751 new 0.17) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 22:51:52] step 4353/5000 loss 0.0738 (w 0.0936 mse 0.0898 t 934 new 0.18) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:51:58] step 4354/5000 loss 0.1201 (w 0.1076 mse 0.1060 t 476 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 22:52:04] step 4355/5000 loss 0.0745 (w 0.1466 mse 0.1358 t 965 new 0.29) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +[2026-09-13 22:52:09] step 4356/5000 loss 0.0645 (w 0.0883 mse 0.0816 t 897 new 0.24) lr 1.00e-05 gnorm 0.065 5.82s mem 15.6GB +[2026-09-13 22:52:15] step 4357/5000 loss 0.0533 (w 0.0386 mse 0.0366 t 794 new 0.17) lr 1.00e-05 gnorm 0.051 5.80s mem 15.6GB +[2026-09-13 22:52:21] step 4358/5000 loss 0.1489 (w 0.0958 mse 0.0920 t 425 new 0.20) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 22:52:27] step 4359/5000 loss 0.0658 (w 0.0798 mse 0.0752 t 636 new 0.29) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 22:52:32] step 4360/5000 loss 0.0716 (w 0.0940 mse 0.0857 t 952 new 0.15) lr 1.00e-05 gnorm 0.055 5.73s mem 15.6GB +[2026-09-13 22:52:38] step 4361/5000 loss 0.0791 (w 0.1203 mse 0.1309 t 995 new 0.12) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 22:52:44] step 4362/5000 loss 0.0823 (w 0.0663 mse 0.0687 t 959 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:52:50] step 4363/5000 loss 0.0947 (w 0.0905 mse 0.0887 t 894 new 0.21) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:52:55] step 4364/5000 loss 0.0492 (w 0.1167 mse 0.1006 t 916 new 0.21) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 22:53:01] step 4365/5000 loss 0.0851 (w 0.1722 mse 0.1654 t 309 new 0.21) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:53:07] step 4366/5000 loss 0.0609 (w 0.1017 mse 0.0883 t 898 new 0.24) lr 1.00e-05 gnorm 0.047 5.68s mem 15.6GB +[2026-09-13 22:53:13] step 4367/5000 loss 0.0959 (w 0.1100 mse 0.1011 t 930 new 0.24) lr 1.00e-05 gnorm 0.059 5.87s mem 15.6GB +[2026-09-13 22:53:18] step 4368/5000 loss 0.1155 (w 0.0643 mse 0.0634 t 600 new 0.24) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 22:53:24] step 4369/5000 loss 0.1626 (w 0.1310 mse 0.1306 t 280 new 0.21) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:53:30] step 4370/5000 loss 0.1097 (w 0.0958 mse 0.0954 t 563 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:53:36] step 4371/5000 loss 0.0872 (w 0.0930 mse 0.0886 t 829 new 0.20) lr 1.00e-05 gnorm 0.064 5.95s mem 15.6GB +[2026-09-13 22:53:41] step 4372/5000 loss 0.0769 (w 0.0532 mse 0.0509 t 737 new 0.29) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +[2026-09-13 22:53:47] step 4373/5000 loss 0.1190 (w 0.0928 mse 0.0815 t 815 new 0.30) lr 1.00e-05 gnorm 0.062 5.92s mem 15.6GB +[2026-09-13 22:53:53] step 4374/5000 loss 0.0915 (w 0.0621 mse 0.0618 t 432 new 0.28) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 22:53:59] step 4375/5000 loss 0.0482 (w 0.0726 mse 0.0643 t 751 new 0.26) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 22:54:04] step 4376/5000 loss 0.0811 (w 0.0671 mse 0.0676 t 858 new 0.18) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 22:54:10] step 4377/5000 loss 0.0575 (w 0.2490 mse 0.2353 t 990 new 0.29) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:54:16] step 4378/5000 loss 0.0615 (w 0.0303 mse 0.0287 t 651 new 0.23) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 22:54:22] step 4379/5000 loss 0.0962 (w 0.1158 mse 0.1109 t 930 new 0.16) lr 1.00e-05 gnorm 0.057 5.85s mem 15.6GB +[2026-09-13 22:54:28] step 4380/5000 loss 0.0536 (w 0.0590 mse 0.0610 t 935 new 0.11) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 22:54:33] step 4381/5000 loss 0.0663 (w 0.0589 mse 0.0585 t 607 new 0.22) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 22:54:39] step 4382/5000 loss 0.0931 (w 0.0626 mse 0.0591 t 859 new 0.25) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:54:45] step 4383/5000 loss 0.0617 (w 0.1922 mse 0.1849 t 985 new 0.22) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 22:54:50] step 4384/5000 loss 0.0905 (w 0.1058 mse 0.0994 t 928 new 0.18) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:54:56] step 4385/5000 loss 0.1131 (w 0.0701 mse 0.0656 t 756 new 0.25) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 22:55:02] step 4386/5000 loss 0.0623 (w 0.0697 mse 0.0628 t 811 new 0.17) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 22:55:08] step 4387/5000 loss 0.0670 (w 0.0476 mse 0.0516 t 983 new 0.11) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 22:55:13] step 4388/5000 loss 0.0829 (w 0.1952 mse 0.1938 t 989 new 0.24) lr 1.00e-05 gnorm 0.061 5.79s mem 15.6GB +[2026-09-13 22:55:19] step 4389/5000 loss 0.1012 (w 0.1562 mse 0.1438 t 953 new 0.20) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 22:55:25] step 4390/5000 loss 0.0768 (w 0.1833 mse 0.1597 t 977 new 0.30) lr 1.00e-05 gnorm 0.072 5.74s mem 15.6GB +[2026-09-13 22:55:30] step 4391/5000 loss 0.0953 (w 0.0668 mse 0.0665 t 986 new 0.12) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 22:55:36] step 4392/5000 loss 0.0374 (w 0.0939 mse 0.0861 t 851 new 0.24) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 22:55:42] step 4393/5000 loss 0.0701 (w 0.0353 mse 0.0368 t 629 new 0.08) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 22:55:48] step 4394/5000 loss 0.1247 (w 0.0467 mse 0.0491 t 884 new 0.24) lr 1.00e-05 gnorm 0.078 5.91s mem 15.6GB +[2026-09-13 22:55:54] step 4395/5000 loss 0.0533 (w 0.0887 mse 0.0797 t 904 new 0.24) lr 1.00e-05 gnorm 0.055 5.70s mem 15.6GB +[2026-09-13 22:55:59] step 4396/5000 loss 0.1034 (w 0.1481 mse 0.1427 t 297 new 0.23) lr 1.00e-05 gnorm 0.091 5.68s mem 15.6GB +[2026-09-13 22:56:05] step 4397/5000 loss 0.0556 (w 0.1128 mse 0.1137 t 878 new 0.18) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 22:56:11] step 4398/5000 loss 0.0884 (w 0.0876 mse 0.0815 t 932 new 0.22) lr 1.00e-05 gnorm 0.056 5.89s mem 15.6GB +[2026-09-13 22:56:17] step 4399/5000 loss 0.0790 (w 0.0887 mse 0.0870 t 581 new 0.18) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 22:56:22] step 4400/5000 loss 0.1138 (w 0.6590 mse 0.6667 t 62 new 0.20) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 22:56:28] step 4401/5000 loss 0.0985 (w 0.0907 mse 0.0901 t 314 new 0.12) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 22:56:34] step 4402/5000 loss 0.0986 (w 0.0791 mse 0.0731 t 631 new 0.26) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 22:56:40] step 4403/5000 loss 0.0762 (w 0.0479 mse 0.0482 t 766 new 0.14) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 22:56:45] step 4404/5000 loss 0.0847 (w 0.0554 mse 0.0483 t 907 new 0.18) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:56:51] step 4405/5000 loss 0.0668 (w 0.1408 mse 0.1319 t 966 new 0.25) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 22:56:57] step 4406/5000 loss 0.0840 (w 0.0845 mse 0.0819 t 661 new 0.27) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:57:02] step 4407/5000 loss 0.1289 (w 0.0884 mse 0.0860 t 893 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 22:57:08] step 4408/5000 loss 0.1025 (w 0.0463 mse 0.0442 t 792 new 0.18) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 22:57:14] step 4409/5000 loss 0.1086 (w 0.0668 mse 0.0653 t 931 new 0.13) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 22:57:20] step 4410/5000 loss 0.0948 (w 0.0609 mse 0.0568 t 788 new 0.26) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:57:25] step 4411/5000 loss 0.0952 (w 0.0354 mse 0.0371 t 888 new 0.13) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 22:57:31] step 4412/5000 loss 0.1201 (w 0.0989 mse 0.1019 t 520 new 0.20) lr 1.00e-05 gnorm 0.059 5.73s mem 15.6GB +[2026-09-13 22:57:37] step 4413/5000 loss 0.0774 (w 0.2300 mse 0.2298 t 138 new 0.23) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 22:57:42] step 4414/5000 loss 0.0933 (w 0.2070 mse 0.2123 t 161 new 0.14) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 22:57:48] step 4415/5000 loss 0.0580 (w 0.1293 mse 0.1306 t 940 new 0.23) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 22:57:54] step 4416/5000 loss 0.0777 (w 0.0689 mse 0.0659 t 604 new 0.25) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 22:57:59] step 4417/5000 loss 0.1419 (w 0.0774 mse 0.0804 t 677 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 22:58:05] step 4418/5000 loss 0.1161 (w 0.1898 mse 0.1722 t 985 new 0.27) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 22:58:11] step 4419/5000 loss 0.1319 (w 0.0974 mse 0.0966 t 421 new 0.28) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:58:17] step 4420/5000 loss 0.1037 (w 0.0790 mse 0.0769 t 866 new 0.15) lr 1.00e-05 gnorm 0.078 5.90s mem 15.6GB +[2026-09-13 22:58:23] step 4421/5000 loss 0.0602 (w 0.0472 mse 0.0496 t 873 new 0.23) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 22:58:28] step 4422/5000 loss 0.0841 (w 0.0806 mse 0.0731 t 625 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 22:58:34] step 4423/5000 loss 0.0956 (w 0.0588 mse 0.0599 t 607 new 0.17) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 22:58:40] step 4424/5000 loss 0.0903 (w 0.0785 mse 0.0756 t 638 new 0.21) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 22:58:45] step 4425/5000 loss 0.0754 (w 0.1166 mse 0.1133 t 966 new 0.17) lr 1.00e-05 gnorm 0.051 5.70s mem 15.6GB +[2026-09-13 22:58:51] step 4426/5000 loss 0.1146 (w 0.1172 mse 0.1151 t 283 new 0.14) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 22:58:57] step 4427/5000 loss 0.1020 (w 0.0802 mse 0.0763 t 497 new 0.18) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 22:59:03] step 4428/5000 loss 0.0865 (w 0.0973 mse 0.1107 t 994 new 0.22) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +[2026-09-13 22:59:09] step 4429/5000 loss 0.0985 (w 0.0803 mse 0.0745 t 958 new 0.24) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 22:59:14] step 4430/5000 loss 0.0804 (w 0.0816 mse 0.0809 t 680 new 0.18) lr 1.00e-05 gnorm 0.097 5.68s mem 15.6GB +[2026-09-13 22:59:20] step 4431/5000 loss 0.0683 (w 0.1129 mse 0.1062 t 982 new 0.25) lr 1.00e-05 gnorm 0.065 5.92s mem 15.6GB +[2026-09-13 22:59:26] step 4432/5000 loss 0.0661 (w 0.0964 mse 0.0912 t 862 new 0.24) lr 1.00e-05 gnorm 0.063 5.87s mem 15.6GB +[2026-09-13 22:59:32] step 4433/5000 loss 0.0920 (w 0.0598 mse 0.0601 t 855 new 0.13) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 22:59:38] step 4434/5000 loss 0.0524 (w 0.0695 mse 0.0693 t 784 new 0.24) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 22:59:43] step 4435/5000 loss 0.1199 (w 0.0985 mse 0.0987 t 619 new 0.15) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 22:59:49] step 4436/5000 loss 0.1354 (w 0.0723 mse 0.0701 t 596 new 0.25) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 22:59:55] step 4437/5000 loss 0.0810 (w 0.3850 mse 0.2952 t 994 new 0.24) lr 1.00e-05 gnorm 0.072 5.73s mem 15.6GB +[2026-09-13 23:00:01] step 4438/5000 loss 0.0933 (w 0.0634 mse 0.0621 t 903 new 0.25) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 23:00:06] step 4439/5000 loss 0.0835 (w 0.1015 mse 0.0943 t 711 new 0.25) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 23:00:12] step 4440/5000 loss 0.1269 (w 0.1731 mse 0.1736 t 176 new 0.09) lr 1.00e-05 gnorm 0.052 5.71s mem 15.6GB +[2026-09-13 23:00:18] step 4441/5000 loss 0.0574 (w 0.0626 mse 0.0572 t 643 new 0.24) lr 1.00e-05 gnorm 0.066 5.89s mem 15.6GB +[2026-09-13 23:00:24] step 4442/5000 loss 0.0617 (w 0.0842 mse 0.0832 t 410 new 0.10) lr 1.00e-05 gnorm 0.056 5.81s mem 15.6GB +[2026-09-13 23:00:29] step 4443/5000 loss 0.0575 (w 0.0505 mse 0.0506 t 678 new 0.10) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 23:00:35] step 4444/5000 loss 0.0858 (w 0.0609 mse 0.0588 t 873 new 0.20) lr 1.00e-05 gnorm 0.053 5.86s mem 15.6GB +[2026-09-13 23:00:41] step 4445/5000 loss 0.0860 (w 0.1242 mse 0.1225 t 981 new 0.24) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 23:00:47] step 4446/5000 loss 0.0748 (w 0.1211 mse 0.1111 t 958 new 0.29) lr 1.00e-05 gnorm 0.071 5.70s mem 15.6GB +[2026-09-13 23:00:52] step 4447/5000 loss 0.0883 (w 0.0618 mse 0.0625 t 680 new 0.20) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 23:00:58] step 4448/5000 loss 0.0440 (w 0.0804 mse 0.0780 t 874 new 0.16) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 23:01:04] step 4449/5000 loss 0.1138 (w 0.1483 mse 0.1341 t 964 new 0.25) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 23:01:10] step 4450/5000 loss 0.0662 (w 0.0907 mse 0.0905 t 923 new 0.16) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 23:01:15] step 4451/5000 loss 0.0947 (w 0.0951 mse 0.0861 t 848 new 0.25) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 23:01:21] step 4452/5000 loss 0.0942 (w 0.1028 mse 0.0977 t 900 new 0.24) lr 1.00e-05 gnorm 0.054 5.95s mem 15.6GB +[2026-09-13 23:01:27] step 4453/5000 loss 0.0814 (w 0.0567 mse 0.0547 t 804 new 0.29) lr 1.00e-05 gnorm 0.048 5.70s mem 15.6GB +[2026-09-13 23:01:33] step 4454/5000 loss 0.1032 (w 0.3286 mse 0.3273 t 93 new 0.25) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 23:01:39] step 4455/5000 loss 0.1142 (w 0.0606 mse 0.0588 t 513 new 0.11) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:01:44] step 4456/5000 loss 0.0692 (w 0.0549 mse 0.0498 t 734 new 0.26) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 23:01:50] step 4457/5000 loss 0.1103 (w 0.1002 mse 0.0989 t 744 new 0.19) lr 1.00e-05 gnorm 0.076 5.71s mem 15.6GB +[2026-09-13 23:01:56] step 4458/5000 loss 0.0547 (w 0.0883 mse 0.0818 t 668 new 0.21) lr 1.00e-05 gnorm 0.076 5.70s mem 15.6GB +[2026-09-13 23:02:01] step 4459/5000 loss 0.0898 (w 0.1646 mse 0.1482 t 972 new 0.26) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:02:07] step 4460/5000 loss 0.0786 (w 0.0432 mse 0.0414 t 793 new 0.13) lr 1.00e-05 gnorm 0.097 5.69s mem 15.6GB +[2026-09-13 23:02:13] step 4461/5000 loss 0.0819 (w 0.1097 mse 0.1056 t 942 new 0.26) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 23:02:19] step 4462/5000 loss 0.0759 (w 0.0746 mse 0.0673 t 834 new 0.21) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 23:02:24] step 4463/5000 loss 0.0588 (w 0.1074 mse 0.0984 t 942 new 0.25) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 23:02:30] step 4464/5000 loss 0.0943 (w 0.0949 mse 0.0850 t 868 new 0.26) lr 1.00e-05 gnorm 0.105 5.69s mem 15.6GB +[2026-09-13 23:02:36] step 4465/5000 loss 0.0887 (w 0.0799 mse 0.0762 t 891 new 0.21) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 23:02:41] step 4466/5000 loss 0.1146 (w 0.1968 mse 0.2016 t 161 new 0.14) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 23:02:47] step 4467/5000 loss 0.1035 (w 0.0613 mse 0.0602 t 809 new 0.13) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:02:53] step 4468/5000 loss 0.0880 (w 0.0673 mse 0.0682 t 771 new 0.12) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 23:02:59] step 4469/5000 loss 0.0419 (w 0.0578 mse 0.0517 t 953 new 0.24) lr 1.00e-05 gnorm 0.058 5.70s mem 15.6GB +[2026-09-13 23:03:04] step 4470/5000 loss 0.0798 (w 0.0631 mse 0.0611 t 612 new 0.25) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 23:03:10] step 4471/5000 loss 0.0452 (w 0.0352 mse 0.0339 t 480 new 0.22) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 23:03:16] step 4472/5000 loss 0.0856 (w 0.0665 mse 0.0650 t 638 new 0.21) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 23:03:22] step 4473/5000 loss 0.1061 (w 0.0599 mse 0.0534 t 722 new 0.20) lr 1.00e-05 gnorm 0.064 5.95s mem 15.6GB +[2026-09-13 23:03:27] step 4474/5000 loss 0.0867 (w 0.0547 mse 0.0550 t 791 new 0.26) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:03:33] step 4475/5000 loss 0.1525 (w 0.1691 mse 0.1589 t 300 new 0.23) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 23:03:39] step 4476/5000 loss 0.0942 (w 0.1417 mse 0.1353 t 935 new 0.17) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:03:44] step 4477/5000 loss 0.0658 (w 0.0643 mse 0.0642 t 955 new 0.27) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:03:50] step 4478/5000 loss 0.1270 (w 0.0799 mse 0.0804 t 449 new 0.19) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:03:56] step 4479/5000 loss 0.0662 (w 0.0758 mse 0.0687 t 900 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:04:02] step 4480/5000 loss 0.1149 (w 0.0617 mse 0.0595 t 670 new 0.26) lr 1.00e-05 gnorm 0.047 5.70s mem 15.6GB +[2026-09-13 23:04:08] step 4481/5000 loss 0.0736 (w 0.0937 mse 0.0847 t 918 new 0.23) lr 1.00e-05 gnorm 0.055 6.87s mem 15.6GB +[2026-09-13 23:04:14] step 4482/5000 loss 0.0598 (w 0.0740 mse 0.0686 t 938 new 0.09) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 23:04:20] step 4483/5000 loss 0.0728 (w 0.1257 mse 0.1177 t 857 new 0.21) lr 1.00e-05 gnorm 0.054 5.92s mem 15.6GB +[2026-09-13 23:04:26] step 4484/5000 loss 0.0741 (w 0.0487 mse 0.0535 t 906 new 0.20) lr 1.00e-05 gnorm 0.058 5.80s mem 15.6GB +[2026-09-13 23:04:32] step 4485/5000 loss 0.1100 (w 0.0489 mse 0.0461 t 777 new 0.14) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 23:04:38] step 4486/5000 loss 0.0706 (w 0.0522 mse 0.0510 t 581 new 0.13) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 23:04:43] step 4487/5000 loss 0.1111 (w 0.2537 mse 0.2497 t 208 new 0.25) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 23:04:49] step 4488/5000 loss 0.1077 (w 0.1073 mse 0.1052 t 823 new 0.23) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 23:04:55] step 4489/5000 loss 0.0939 (w 0.7648 mse 0.8156 t 15 new 0.12) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 23:05:00] step 4490/5000 loss 0.1173 (w 0.0885 mse 0.0902 t 988 new 0.14) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 23:05:06] step 4491/5000 loss 0.0466 (w 0.0495 mse 0.0518 t 862 new 0.24) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:05:12] step 4492/5000 loss 0.0810 (w 0.1135 mse 0.1131 t 453 new 0.25) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 23:05:18] step 4493/5000 loss 0.0547 (w 0.0770 mse 0.0724 t 898 new 0.27) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 23:05:23] step 4494/5000 loss 0.0679 (w 0.0674 mse 0.0674 t 648 new 0.25) lr 1.00e-05 gnorm 0.058 5.89s mem 15.6GB +[2026-09-13 23:05:29] step 4495/5000 loss 0.1365 (w 0.0747 mse 0.0717 t 967 new 0.25) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 23:05:35] step 4496/5000 loss 0.0672 (w 0.0610 mse 0.0630 t 595 new 0.26) lr 1.00e-05 gnorm 0.054 5.73s mem 15.6GB +[2026-09-13 23:05:41] step 4497/5000 loss 0.1232 (w 0.0878 mse 0.0848 t 931 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 23:05:46] step 4498/5000 loss 0.0826 (w 0.0579 mse 0.0557 t 940 new 0.16) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 23:05:52] step 4499/5000 loss 0.0665 (w 0.0694 mse 0.0670 t 516 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 23:05:58] step 4500/5000 loss 0.1223 (w 0.1572 mse 0.1499 t 994 new 0.19) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:06:02] [val] step 4500 t=201: w=0.1734 mse=0.1758 (n=16) t=501: w=0.0717 mse=0.0716 (n=16) t=800: w=0.0598 mse=0.0586 (n=16) | mean w=0.1016 mse=0.1020 4s +[2026-09-13 23:06:05] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step4500.safetensors 832 个张量 2.87 GB +[2026-09-13 23:06:11] step 4501/5000 loss 0.0734 (w 0.0900 mse 0.0879 t 752 new 0.23) lr 1.00e-05 gnorm 0.055 5.81s mem 15.6GB +[2026-09-13 23:06:17] step 4502/5000 loss 0.0395 (w 0.0461 mse 0.0457 t 807 new 0.25) lr 1.00e-05 gnorm 0.054 5.71s mem 15.6GB +[2026-09-13 23:06:23] step 4503/5000 loss 0.0794 (w 0.0254 mse 0.0250 t 727 new 0.15) lr 1.00e-05 gnorm 0.045 5.71s mem 15.6GB +[2026-09-13 23:06:29] step 4504/5000 loss 0.0716 (w 0.5968 mse 0.6065 t 34 new 0.17) lr 1.00e-05 gnorm 0.064 5.91s mem 15.6GB +[2026-09-13 23:06:35] step 4505/5000 loss 0.1267 (w 0.0879 mse 0.0823 t 599 new 0.16) lr 1.00e-05 gnorm 0.055 5.92s mem 15.6GB +[2026-09-13 23:06:41] step 4506/5000 loss 0.0884 (w 0.0667 mse 0.0680 t 617 new 0.26) lr 1.00e-05 gnorm 0.080 5.69s mem 15.6GB +[2026-09-13 23:06:47] step 4507/5000 loss 0.0538 (w 0.0848 mse 0.0861 t 956 new 0.21) lr 1.00e-05 gnorm 0.057 6.07s mem 15.6GB +[2026-09-13 23:06:52] step 4508/5000 loss 0.0896 (w 0.1247 mse 0.1256 t 229 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 23:06:58] step 4509/5000 loss 0.0628 (w 0.0731 mse 0.0669 t 902 new 0.22) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:07:04] step 4510/5000 loss 0.0694 (w 0.0635 mse 0.0648 t 886 new 0.23) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 23:07:09] step 4511/5000 loss 0.0810 (w 0.0450 mse 0.0456 t 904 new 0.09) lr 1.00e-05 gnorm 0.086 5.68s mem 15.6GB +[2026-09-13 23:07:15] step 4512/5000 loss 0.0453 (w 0.0912 mse 0.0909 t 706 new 0.18) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:07:21] step 4513/5000 loss 0.0799 (w 0.0607 mse 0.0611 t 897 new 0.26) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 23:07:27] step 4514/5000 loss 0.0932 (w 0.1342 mse 0.1286 t 882 new 0.21) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 23:07:32] step 4515/5000 loss 0.1186 (w 0.1366 mse 0.1218 t 938 new 0.26) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 23:07:38] step 4516/5000 loss 0.0864 (w 0.2031 mse 0.1842 t 991 new 0.25) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 23:07:44] step 4517/5000 loss 0.0867 (w 0.1155 mse 0.1106 t 977 new 0.24) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 23:07:50] step 4518/5000 loss 0.1046 (w 0.1523 mse 0.1410 t 973 new 0.24) lr 1.00e-05 gnorm 0.069 5.90s mem 15.6GB +[2026-09-13 23:07:55] step 4519/5000 loss 0.0763 (w 0.1200 mse 0.1140 t 992 new 0.23) lr 1.00e-05 gnorm 0.133 5.68s mem 15.6GB +[2026-09-13 23:08:01] step 4520/5000 loss 0.0726 (w 0.1217 mse 0.1096 t 920 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:08:07] step 4521/5000 loss 0.0830 (w 0.0628 mse 0.0637 t 950 new 0.20) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 23:08:13] step 4522/5000 loss 0.0519 (w 0.1284 mse 0.1310 t 992 new 0.16) lr 1.00e-05 gnorm 0.075 5.82s mem 15.6GB +[2026-09-13 23:08:18] step 4523/5000 loss 0.0803 (w 0.6399 mse 0.6352 t 43 new 0.22) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 23:08:24] step 4524/5000 loss 0.0437 (w 0.1504 mse 0.1490 t 989 new 0.27) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:08:30] step 4525/5000 loss 0.0701 (w 0.1278 mse 0.1208 t 961 new 0.23) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +[2026-09-13 23:08:36] step 4526/5000 loss 0.0491 (w 0.0943 mse 0.0947 t 965 new 0.24) lr 1.00e-05 gnorm 0.064 5.89s mem 15.6GB +[2026-09-13 23:08:41] step 4527/5000 loss 0.0936 (w 0.1457 mse 0.1349 t 966 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:08:47] step 4528/5000 loss 0.0992 (w 0.1379 mse 0.1435 t 552 new 0.21) lr 1.00e-05 gnorm 0.057 6.03s mem 15.6GB +[2026-09-13 23:08:53] step 4529/5000 loss 0.0884 (w 0.0548 mse 0.0494 t 923 new 0.17) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:08:59] step 4530/5000 loss 0.0844 (w 0.0809 mse 0.0772 t 860 new 0.18) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 23:09:04] step 4531/5000 loss 0.0730 (w 0.0762 mse 0.0805 t 980 new 0.25) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 23:09:10] step 4532/5000 loss 0.1177 (w 0.1068 mse 0.0974 t 894 new 0.30) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 23:09:16] step 4533/5000 loss 0.1182 (w 0.0674 mse 0.0654 t 660 new 0.25) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 23:09:22] step 4534/5000 loss 0.0877 (w 0.0761 mse 0.0719 t 936 new 0.12) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 23:09:27] step 4535/5000 loss 0.1238 (w 0.0552 mse 0.0560 t 906 new 0.16) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:09:33] step 4536/5000 loss 0.0867 (w 0.1814 mse 0.1784 t 208 new 0.27) lr 1.00e-05 gnorm 0.056 5.82s mem 15.6GB +[2026-09-13 23:09:39] step 4537/5000 loss 0.0545 (w 0.1215 mse 0.1101 t 993 new 0.21) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:09:45] step 4538/5000 loss 0.0810 (w 0.2099 mse 0.2133 t 169 new 0.25) lr 1.00e-05 gnorm 0.060 5.74s mem 15.6GB +[2026-09-13 23:09:50] step 4539/5000 loss 0.0723 (w 0.1532 mse 0.1456 t 979 new 0.24) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 23:09:56] step 4540/5000 loss 0.0974 (w 0.0844 mse 0.0808 t 843 new 0.09) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 23:10:02] step 4541/5000 loss 0.1303 (w 0.0639 mse 0.0606 t 748 new 0.22) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:10:07] step 4542/5000 loss 0.0963 (w 0.1144 mse 0.1107 t 617 new 0.29) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 23:10:13] step 4543/5000 loss 0.1024 (w 0.0294 mse 0.0287 t 593 new 0.28) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +[2026-09-13 23:10:19] step 4544/5000 loss 0.0723 (w 0.0807 mse 0.0720 t 914 new 0.24) lr 1.00e-05 gnorm 0.082 5.70s mem 15.6GB +[2026-09-13 23:10:24] step 4545/5000 loss 0.0380 (w 0.0685 mse 0.0666 t 866 new 0.30) lr 1.00e-05 gnorm 0.054 5.68s mem 15.6GB +[2026-09-13 23:10:30] step 4546/5000 loss 0.0572 (w 0.0594 mse 0.0594 t 878 new 0.26) lr 1.00e-05 gnorm 0.063 5.89s mem 15.6GB +[2026-09-13 23:10:36] step 4547/5000 loss 0.0879 (w 0.0567 mse 0.0558 t 863 new 0.24) lr 1.00e-05 gnorm 0.070 5.93s mem 15.6GB +[2026-09-13 23:10:42] step 4548/5000 loss 0.1197 (w 0.1376 mse 0.1308 t 960 new 0.23) lr 1.00e-05 gnorm 0.060 5.74s mem 15.6GB +[2026-09-13 23:10:48] step 4549/5000 loss 0.0555 (w 0.0802 mse 0.0840 t 905 new 0.24) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 23:10:54] step 4550/5000 loss 0.0475 (w 0.1186 mse 0.1244 t 896 new 0.21) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 23:10:59] step 4551/5000 loss 0.1170 (w 0.1480 mse 0.1477 t 463 new 0.19) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 23:11:05] step 4552/5000 loss 0.0918 (w 0.0853 mse 0.0812 t 508 new 0.26) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 23:11:11] step 4553/5000 loss 0.1012 (w 0.0676 mse 0.0620 t 846 new 0.22) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 23:11:16] step 4554/5000 loss 0.1095 (w 0.0836 mse 0.0829 t 651 new 0.29) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 23:11:22] step 4555/5000 loss 0.0677 (w 0.0877 mse 0.0838 t 943 new 0.21) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:11:28] step 4556/5000 loss 0.1181 (w 0.1041 mse 0.0999 t 948 new 0.21) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 23:11:34] step 4557/5000 loss 0.0900 (w 0.5239 mse 0.5254 t 57 new 0.11) lr 1.00e-05 gnorm 0.064 5.71s mem 15.6GB +[2026-09-13 23:11:39] step 4558/5000 loss 0.0867 (w 0.1824 mse 0.1810 t 235 new 0.24) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:11:45] step 4559/5000 loss 0.1152 (w 0.2533 mse 0.2579 t 71 new 0.26) lr 1.00e-05 gnorm 0.051 5.93s mem 15.6GB +[2026-09-13 23:11:51] step 4560/5000 loss 0.0602 (w 0.1792 mse 0.1755 t 986 new 0.21) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 23:11:57] step 4561/5000 loss 0.1080 (w 0.0953 mse 0.0873 t 591 new 0.22) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 23:12:02] step 4562/5000 loss 0.0764 (w 0.0490 mse 0.0494 t 779 new 0.24) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +[2026-09-13 23:12:08] step 4563/5000 loss 0.0869 (w 0.0777 mse 0.0708 t 730 new 0.26) lr 1.00e-05 gnorm 0.055 5.90s mem 15.6GB +[2026-09-13 23:12:14] step 4564/5000 loss 0.1220 (w 0.0386 mse 0.0377 t 701 new 0.09) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:12:20] step 4565/5000 loss 0.0735 (w 0.0719 mse 0.0686 t 744 new 0.20) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 23:12:25] step 4566/5000 loss 0.0479 (w 0.0580 mse 0.0579 t 937 new 0.15) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 23:12:31] step 4567/5000 loss 0.1302 (w 0.0727 mse 0.0703 t 625 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 23:12:37] step 4568/5000 loss 0.0691 (w 0.0975 mse 0.0898 t 961 new 0.13) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 23:12:42] step 4569/5000 loss 0.0806 (w 0.0669 mse 0.0656 t 874 new 0.25) lr 1.00e-05 gnorm 0.059 5.74s mem 15.6GB +[2026-09-13 23:12:48] step 4570/5000 loss 0.0732 (w 0.0990 mse 0.0913 t 872 new 0.26) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 23:12:54] step 4571/5000 loss 0.0404 (w 0.1620 mse 0.1567 t 992 new 0.25) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 23:13:00] step 4572/5000 loss 0.0869 (w 0.0665 mse 0.0602 t 843 new 0.19) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 23:13:05] step 4573/5000 loss 0.0969 (w 0.0696 mse 0.0665 t 822 new 0.18) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 23:13:11] step 4574/5000 loss 0.0820 (w 0.0590 mse 0.0562 t 802 new 0.15) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 23:13:17] step 4575/5000 loss 0.1177 (w 0.0810 mse 0.0771 t 488 new 0.20) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 23:13:22] step 4576/5000 loss 0.0988 (w 0.0954 mse 0.0890 t 602 new 0.23) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 23:13:28] step 4577/5000 loss 0.1071 (w 0.0349 mse 0.0334 t 629 new 0.15) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 23:13:34] step 4578/5000 loss 0.0886 (w 0.0770 mse 0.0702 t 875 new 0.17) lr 1.00e-05 gnorm 0.055 5.93s mem 15.6GB +[2026-09-13 23:13:40] step 4579/5000 loss 0.0821 (w 0.0982 mse 0.1107 t 276 new 0.19) lr 1.00e-05 gnorm 0.055 5.71s mem 15.6GB +[2026-09-13 23:13:46] step 4580/5000 loss 0.0562 (w 0.1059 mse 0.0997 t 855 new 0.18) lr 1.00e-05 gnorm 0.064 5.74s mem 15.6GB +[2026-09-13 23:13:51] step 4581/5000 loss 0.0583 (w 0.0798 mse 0.0788 t 919 new 0.25) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 23:13:57] step 4582/5000 loss 0.0584 (w 0.0836 mse 0.0826 t 850 new 0.21) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +[2026-09-13 23:14:03] step 4583/5000 loss 0.1239 (w 0.0433 mse 0.0440 t 729 new 0.19) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 23:14:09] step 4584/5000 loss 0.0850 (w 0.1004 mse 0.0870 t 922 new 0.22) lr 1.00e-05 gnorm 0.070 5.92s mem 15.6GB +[2026-09-13 23:14:14] step 4585/5000 loss 0.0597 (w 0.0619 mse 0.0621 t 700 new 0.29) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:14:20] step 4586/5000 loss 0.0789 (w 0.0654 mse 0.0619 t 598 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:14:26] step 4587/5000 loss 0.0441 (w 0.1344 mse 0.1262 t 1000 new 0.21) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 23:14:31] step 4588/5000 loss 0.0846 (w 0.0874 mse 0.0877 t 355 new 0.21) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 23:14:37] step 4589/5000 loss 0.1063 (w 0.0586 mse 0.0586 t 930 new 0.20) lr 1.00e-05 gnorm 0.071 5.91s mem 15.6GB +[2026-09-13 23:14:43] step 4590/5000 loss 0.0764 (w 0.1001 mse 0.0967 t 545 new 0.26) lr 1.00e-05 gnorm 0.082 5.89s mem 15.6GB +[2026-09-13 23:14:49] step 4591/5000 loss 0.0707 (w 0.0565 mse 0.0557 t 698 new 0.24) lr 1.00e-05 gnorm 0.064 5.76s mem 15.6GB +[2026-09-13 23:14:55] step 4592/5000 loss 0.0740 (w 0.0830 mse 0.0832 t 715 new 0.23) lr 1.00e-05 gnorm 0.068 5.91s mem 15.6GB +[2026-09-13 23:15:01] step 4593/5000 loss 0.1520 (w 0.0693 mse 0.0652 t 865 new 0.25) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 23:15:06] step 4594/5000 loss 0.0960 (w 0.1061 mse 0.1041 t 414 new 0.25) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 23:15:12] step 4595/5000 loss 0.1202 (w 0.1433 mse 0.1328 t 963 new 0.24) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 23:15:18] step 4596/5000 loss 0.1084 (w 0.0167 mse 0.0168 t 881 new 0.16) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 23:15:23] step 4597/5000 loss 0.0784 (w 0.0742 mse 0.0750 t 914 new 0.26) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 23:15:29] step 4598/5000 loss 0.1164 (w 0.2576 mse 0.2534 t 150 new 0.07) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:15:35] step 4599/5000 loss 0.0837 (w 0.0525 mse 0.0543 t 896 new 0.23) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 23:15:41] step 4600/5000 loss 0.0741 (w 0.2148 mse 0.2044 t 996 new 0.25) lr 1.00e-05 gnorm 0.066 5.74s mem 15.6GB +[2026-09-13 23:15:46] step 4601/5000 loss 0.1130 (w 0.1451 mse 0.1380 t 252 new 0.24) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 23:15:52] step 4602/5000 loss 0.1125 (w 0.1529 mse 0.1548 t 336 new 0.19) lr 1.00e-05 gnorm 0.071 5.75s mem 15.6GB +[2026-09-13 23:15:58] step 4603/5000 loss 0.0576 (w 0.0795 mse 0.0793 t 925 new 0.24) lr 1.00e-05 gnorm 0.064 5.70s mem 15.6GB +[2026-09-13 23:16:03] step 4604/5000 loss 0.0432 (w 0.1499 mse 0.1474 t 958 new 0.16) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 23:16:09] step 4605/5000 loss 0.0921 (w 0.2106 mse 0.2124 t 172 new 0.22) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 23:16:15] step 4606/5000 loss 0.0636 (w 0.0600 mse 0.0577 t 904 new 0.24) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 23:16:21] step 4607/5000 loss 0.0649 (w 0.0886 mse 0.0777 t 665 new 0.26) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 23:16:26] step 4608/5000 loss 0.0923 (w 0.1207 mse 0.1152 t 584 new 0.25) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 23:16:32] step 4609/5000 loss 0.0404 (w 0.0850 mse 0.0809 t 902 new 0.13) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +[2026-09-13 23:16:38] step 4610/5000 loss 0.0656 (w 0.1114 mse 0.1042 t 964 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 23:16:43] step 4611/5000 loss 0.0790 (w 0.0307 mse 0.0360 t 382 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:16:49] step 4612/5000 loss 0.0735 (w 0.0524 mse 0.0520 t 591 new 0.29) lr 1.00e-05 gnorm 0.078 5.76s mem 15.6GB +[2026-09-13 23:16:55] step 4613/5000 loss 0.0942 (w 0.0974 mse 0.0893 t 853 new 0.24) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 23:17:01] step 4614/5000 loss 0.0830 (w 0.0947 mse 0.0916 t 449 new 0.24) lr 1.00e-05 gnorm 0.078 5.70s mem 15.6GB +[2026-09-13 23:17:07] step 4615/5000 loss 0.0686 (w 0.0976 mse 0.0879 t 913 new 0.27) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 23:17:12] step 4616/5000 loss 0.0890 (w 0.3555 mse 0.3745 t 71 new 0.13) lr 1.00e-05 gnorm 0.061 5.72s mem 15.6GB +[2026-09-13 23:17:18] step 4617/5000 loss 0.0630 (w 0.0844 mse 0.0821 t 389 new 0.25) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 23:17:24] step 4618/5000 loss 0.0955 (w 0.0720 mse 0.0696 t 920 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:17:29] step 4619/5000 loss 0.0980 (w 0.0917 mse 0.0959 t 445 new 0.24) lr 1.00e-05 gnorm 0.084 5.70s mem 15.6GB +[2026-09-13 23:17:35] step 4620/5000 loss 0.0943 (w 0.0805 mse 0.0734 t 748 new 0.24) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:17:41] step 4621/5000 loss 0.1236 (w 0.0870 mse 0.0864 t 744 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 23:17:47] step 4622/5000 loss 0.0617 (w 0.0889 mse 0.0826 t 732 new 0.19) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 23:17:52] step 4623/5000 loss 0.1340 (w 0.0458 mse 0.0468 t 707 new 0.19) lr 1.00e-05 gnorm 0.079 5.74s mem 15.6GB +[2026-09-13 23:17:58] step 4624/5000 loss 0.1006 (w 0.0479 mse 0.0461 t 852 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 23:18:04] step 4625/5000 loss 0.0672 (w 0.0986 mse 0.0951 t 987 new 0.24) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 23:18:09] step 4626/5000 loss 0.1054 (w 0.0498 mse 0.0465 t 747 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:18:15] step 4627/5000 loss 0.1004 (w 0.1015 mse 0.1110 t 998 new 0.23) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 23:18:21] step 4628/5000 loss 0.0923 (w 0.0580 mse 0.0614 t 928 new 0.20) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 23:18:27] step 4629/5000 loss 0.1212 (w 0.1284 mse 0.1239 t 654 new 0.32) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 23:18:32] step 4630/5000 loss 0.0638 (w 0.0419 mse 0.0423 t 557 new 0.24) lr 1.00e-05 gnorm 0.063 5.81s mem 15.6GB +[2026-09-13 23:18:38] step 4631/5000 loss 0.0792 (w 0.1051 mse 0.0998 t 982 new 0.19) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 23:18:44] step 4632/5000 loss 0.0829 (w 0.1156 mse 0.1068 t 869 new 0.18) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:18:50] step 4633/5000 loss 0.0681 (w 0.1011 mse 0.0957 t 957 new 0.21) lr 1.00e-05 gnorm 0.065 5.76s mem 15.6GB +[2026-09-13 23:18:56] step 4634/5000 loss 0.1240 (w 0.0761 mse 0.0758 t 626 new 0.23) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 23:19:01] step 4635/5000 loss 0.0515 (w 0.0520 mse 0.0535 t 902 new 0.17) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 23:19:07] step 4636/5000 loss 0.0687 (w 0.0571 mse 0.0565 t 818 new 0.25) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 23:19:13] step 4637/5000 loss 0.0945 (w 0.0301 mse 0.0331 t 918 new 0.12) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:19:18] step 4638/5000 loss 0.0688 (w 0.0824 mse 0.0831 t 465 new 0.13) lr 1.00e-05 gnorm 0.040 5.69s mem 15.6GB +[2026-09-13 23:19:24] step 4639/5000 loss 0.1062 (w 0.0624 mse 0.0625 t 606 new 0.21) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 23:19:30] step 4640/5000 loss 0.0600 (w 0.1847 mse 0.1786 t 995 new 0.21) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 23:19:35] step 4641/5000 loss 0.1021 (w 0.1906 mse 0.1810 t 981 new 0.22) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 23:19:41] step 4642/5000 loss 0.0692 (w 0.0608 mse 0.0593 t 889 new 0.13) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 23:19:47] step 4643/5000 loss 0.0509 (w 0.1089 mse 0.1014 t 964 new 0.22) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 23:19:53] step 4644/5000 loss 0.0621 (w 0.0582 mse 0.0559 t 515 new 0.22) lr 1.00e-05 gnorm 0.059 5.79s mem 15.6GB +[2026-09-13 23:19:58] step 4645/5000 loss 0.0858 (w 0.0610 mse 0.0596 t 893 new 0.27) lr 1.00e-05 gnorm 0.096 5.69s mem 15.6GB +[2026-09-13 23:20:04] step 4646/5000 loss 0.0893 (w 0.1221 mse 0.1078 t 933 new 0.23) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 23:20:10] step 4647/5000 loss 0.1015 (w 0.0429 mse 0.0433 t 661 new 0.17) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 23:20:16] step 4648/5000 loss 0.1004 (w 0.0515 mse 0.0519 t 964 new 0.20) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:20:21] step 4649/5000 loss 0.1057 (w 0.1365 mse 0.1332 t 349 new 0.28) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 23:20:27] step 4650/5000 loss 0.0921 (w 0.0399 mse 0.0431 t 708 new 0.27) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:20:33] step 4651/5000 loss 0.0745 (w 0.0785 mse 0.0803 t 790 new 0.21) lr 1.00e-05 gnorm 0.059 5.82s mem 15.6GB +[2026-09-13 23:20:39] step 4652/5000 loss 0.0803 (w 0.0887 mse 0.0899 t 428 new 0.21) lr 1.00e-05 gnorm 0.070 6.14s mem 15.6GB +[2026-09-13 23:20:45] step 4653/5000 loss 0.1366 (w 0.0810 mse 0.0787 t 581 new 0.15) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 23:20:50] step 4654/5000 loss 0.1001 (w 0.1395 mse 0.1343 t 993 new 0.23) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 23:20:56] step 4655/5000 loss 0.0751 (w 0.1099 mse 0.1045 t 936 new 0.21) lr 1.00e-05 gnorm 0.075 5.95s mem 15.6GB +[2026-09-13 23:21:02] step 4656/5000 loss 0.0866 (w 0.0729 mse 0.0716 t 475 new 0.21) lr 1.00e-05 gnorm 0.090 5.69s mem 15.6GB +[2026-09-13 23:21:08] step 4657/5000 loss 0.0849 (w 0.1104 mse 0.1073 t 877 new 0.17) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 23:21:13] step 4658/5000 loss 0.0992 (w 0.1060 mse 0.0990 t 684 new 0.24) lr 1.00e-05 gnorm 0.063 5.70s mem 15.6GB +[2026-09-13 23:21:19] step 4659/5000 loss 0.0897 (w 0.2208 mse 0.2178 t 183 new 0.29) lr 1.00e-05 gnorm 0.092 5.69s mem 15.6GB +[2026-09-13 23:21:25] step 4660/5000 loss 0.1305 (w 0.9093 mse 0.9070 t 15 new 0.25) lr 1.00e-05 gnorm 0.077 5.70s mem 15.6GB +[2026-09-13 23:21:31] step 4661/5000 loss 0.0953 (w 0.0935 mse 0.0865 t 919 new 0.24) lr 1.00e-05 gnorm 0.088 5.69s mem 15.6GB +[2026-09-13 23:21:36] step 4662/5000 loss 0.0564 (w 0.0447 mse 0.0500 t 963 new 0.13) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 23:21:42] step 4663/5000 loss 0.1075 (w 0.0518 mse 0.0512 t 781 new 0.26) lr 1.00e-05 gnorm 0.062 5.75s mem 15.6GB +[2026-09-13 23:21:48] step 4664/5000 loss 0.0859 (w 0.2276 mse 0.2154 t 998 new 0.18) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 23:21:53] step 4665/5000 loss 0.0767 (w 0.0914 mse 0.0872 t 983 new 0.16) lr 1.00e-05 gnorm 0.050 5.71s mem 15.6GB +[2026-09-13 23:21:59] step 4666/5000 loss 0.0682 (w 0.1090 mse 0.1033 t 824 new 0.10) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:22:05] step 4667/5000 loss 0.0770 (w 0.1612 mse 0.1584 t 957 new 0.25) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 23:22:11] step 4668/5000 loss 0.1039 (w 0.2354 mse 0.2333 t 180 new 0.25) lr 1.00e-05 gnorm 0.073 5.70s mem 15.6GB +[2026-09-13 23:22:16] step 4669/5000 loss 0.0903 (w 0.1086 mse 0.1038 t 978 new 0.22) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 23:22:22] step 4670/5000 loss 0.0919 (w 0.0940 mse 0.0902 t 734 new 0.21) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 23:22:28] step 4671/5000 loss 0.1265 (w 0.1170 mse 0.1120 t 478 new 0.23) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:22:34] step 4672/5000 loss 0.0994 (w 0.0869 mse 0.0836 t 969 new 0.19) lr 1.00e-05 gnorm 0.073 5.80s mem 15.6GB +[2026-09-13 23:22:39] step 4673/5000 loss 0.0431 (w 0.0390 mse 0.0402 t 724 new 0.23) lr 1.00e-05 gnorm 0.052 5.93s mem 15.6GB +[2026-09-13 23:22:45] step 4674/5000 loss 0.1204 (w 0.1472 mse 0.1509 t 476 new 0.21) lr 1.00e-05 gnorm 0.062 5.97s mem 15.6GB +[2026-09-13 23:22:51] step 4675/5000 loss 0.0670 (w 0.0626 mse 0.0645 t 945 new 0.23) lr 1.00e-05 gnorm 0.059 5.72s mem 15.6GB +[2026-09-13 23:22:57] step 4676/5000 loss 0.0801 (w 0.1030 mse 0.1094 t 978 new 0.17) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 23:23:03] step 4677/5000 loss 0.0639 (w 0.1584 mse 0.1472 t 981 new 0.25) lr 1.00e-05 gnorm 0.054 5.71s mem 15.6GB +[2026-09-13 23:23:09] step 4678/5000 loss 0.0719 (w 0.0541 mse 0.0600 t 913 new 0.18) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 23:23:14] step 4679/5000 loss 0.1109 (w 0.0465 mse 0.0429 t 743 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 23:23:20] step 4680/5000 loss 0.0852 (w 0.0895 mse 0.0857 t 372 new 0.18) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:23:26] step 4681/5000 loss 0.0754 (w 0.0771 mse 0.0730 t 850 new 0.25) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 23:23:31] step 4682/5000 loss 0.0973 (w 0.1220 mse 0.1115 t 967 new 0.25) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 23:23:37] step 4683/5000 loss 0.1090 (w 0.0311 mse 0.0324 t 676 new 0.13) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 23:23:43] step 4684/5000 loss 0.0324 (w 0.1505 mse 0.1428 t 999 new 0.25) lr 1.00e-05 gnorm 0.071 5.71s mem 15.6GB +[2026-09-13 23:23:49] step 4685/5000 loss 0.0324 (w 0.2074 mse 0.1967 t 995 new 0.23) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 23:23:55] step 4686/5000 loss 0.1045 (w 0.0649 mse 0.0608 t 691 new 0.25) lr 1.00e-05 gnorm 0.070 5.91s mem 15.6GB +[2026-09-13 23:24:00] step 4687/5000 loss 0.0709 (w 0.1038 mse 0.1048 t 814 new 0.15) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 23:24:06] step 4688/5000 loss 0.0665 (w 0.0651 mse 0.0612 t 808 new 0.21) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 23:24:12] step 4689/5000 loss 0.0966 (w 0.0858 mse 0.0857 t 972 new 0.25) lr 1.00e-05 gnorm 0.050 5.68s mem 15.6GB +[2026-09-13 23:24:17] step 4690/5000 loss 0.0866 (w 0.1090 mse 0.1070 t 380 new 0.22) lr 1.00e-05 gnorm 0.117 5.69s mem 15.6GB +[2026-09-13 23:24:23] step 4691/5000 loss 0.0773 (w 0.0214 mse 0.0231 t 882 new 0.11) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 23:24:29] step 4692/5000 loss 0.0715 (w 0.1052 mse 0.1048 t 954 new 0.12) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 23:24:34] step 4693/5000 loss 0.0790 (w 0.0919 mse 0.0895 t 926 new 0.23) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:24:40] step 4694/5000 loss 0.1373 (w 0.0832 mse 0.0799 t 709 new 0.26) lr 1.00e-05 gnorm 0.080 5.68s mem 15.6GB +[2026-09-13 23:24:46] step 4695/5000 loss 0.0858 (w 0.0623 mse 0.0610 t 712 new 0.29) lr 1.00e-05 gnorm 0.047 5.69s mem 15.6GB +[2026-09-13 23:24:52] step 4696/5000 loss 0.1174 (w 0.0834 mse 0.0773 t 873 new 0.28) lr 1.00e-05 gnorm 0.059 5.73s mem 15.6GB +[2026-09-13 23:24:57] step 4697/5000 loss 0.0739 (w 0.0702 mse 0.0701 t 777 new 0.20) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 23:25:03] step 4698/5000 loss 0.0480 (w 0.0815 mse 0.0796 t 954 new 0.20) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 23:25:09] step 4699/5000 loss 0.0747 (w 0.0700 mse 0.0639 t 915 new 0.19) lr 1.00e-05 gnorm 0.103 5.69s mem 15.6GB +[2026-09-13 23:25:14] step 4700/5000 loss 0.0979 (w 0.1579 mse 0.1476 t 993 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:25:20] step 4701/5000 loss 0.0980 (w 0.2906 mse 0.2922 t 114 new 0.13) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 23:25:26] step 4702/5000 loss 0.1236 (w 0.0958 mse 0.0967 t 370 new 0.14) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 23:25:32] step 4703/5000 loss 0.0458 (w 0.1054 mse 0.1008 t 754 new 0.31) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 23:25:37] step 4704/5000 loss 0.0994 (w 0.4268 mse 0.4238 t 57 new 0.17) lr 1.00e-05 gnorm 0.054 5.70s mem 15.6GB +[2026-09-13 23:25:43] step 4705/5000 loss 0.0954 (w 0.1117 mse 0.1024 t 750 new 0.20) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 23:25:49] step 4706/5000 loss 0.1285 (w 0.0937 mse 0.0883 t 704 new 0.24) lr 1.00e-05 gnorm 0.072 5.71s mem 15.6GB +[2026-09-13 23:25:54] step 4707/5000 loss 0.0883 (w 0.1159 mse 0.1135 t 314 new 0.13) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +[2026-09-13 23:26:00] step 4708/5000 loss 0.0509 (w 0.0675 mse 0.0721 t 942 new 0.12) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:26:06] step 4709/5000 loss 0.1013 (w 0.0942 mse 0.0923 t 355 new 0.22) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 23:26:12] step 4710/5000 loss 0.0773 (w 0.0572 mse 0.0540 t 800 new 0.28) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 23:26:17] step 4711/5000 loss 0.0927 (w 0.0193 mse 0.0221 t 915 new 0.15) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:26:23] step 4712/5000 loss 0.0849 (w 0.0440 mse 0.0490 t 551 new 0.27) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:26:29] step 4713/5000 loss 0.0662 (w 0.0647 mse 0.0575 t 798 new 0.20) lr 1.00e-05 gnorm 0.068 5.70s mem 15.6GB +[2026-09-13 23:26:34] step 4714/5000 loss 0.0602 (w 0.0635 mse 0.0610 t 619 new 0.28) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 23:26:41] step 4715/5000 loss 0.1110 (w 0.1251 mse 0.1167 t 983 new 0.22) lr 1.00e-05 gnorm 0.069 5.92s mem 15.6GB +[2026-09-13 23:26:46] step 4716/5000 loss 0.0774 (w 0.0900 mse 0.0831 t 790 new 0.27) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 23:26:52] step 4717/5000 loss 0.0990 (w 0.0708 mse 0.0699 t 792 new 0.13) lr 1.00e-05 gnorm 0.075 5.70s mem 15.6GB +[2026-09-13 23:26:58] step 4718/5000 loss 0.0791 (w 0.2861 mse 0.2560 t 995 new 0.23) lr 1.00e-05 gnorm 0.073 5.69s mem 15.6GB +[2026-09-13 23:27:03] step 4719/5000 loss 0.1267 (w 0.0818 mse 0.0770 t 533 new 0.23) lr 1.00e-05 gnorm 0.087 5.70s mem 15.6GB +[2026-09-13 23:27:09] step 4720/5000 loss 0.0880 (w 0.0767 mse 0.0766 t 457 new 0.25) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 23:27:15] step 4721/5000 loss 0.1006 (w 0.0855 mse 0.0791 t 910 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 23:27:20] step 4722/5000 loss 0.0912 (w 0.0855 mse 0.0833 t 954 new 0.24) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 23:27:26] step 4723/5000 loss 0.0701 (w 0.0826 mse 0.0837 t 836 new 0.24) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 23:27:32] step 4724/5000 loss 0.1129 (w 0.0595 mse 0.0566 t 674 new 0.14) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:27:38] step 4725/5000 loss 0.0900 (w 0.1028 mse 0.0985 t 902 new 0.28) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:27:43] step 4726/5000 loss 0.0789 (w 0.1360 mse 0.1346 t 288 new 0.21) lr 1.00e-05 gnorm 0.054 5.79s mem 15.6GB +[2026-09-13 23:27:49] step 4727/5000 loss 0.0557 (w 0.1236 mse 0.1179 t 980 new 0.19) lr 1.00e-05 gnorm 0.086 5.69s mem 15.6GB +[2026-09-13 23:27:55] step 4728/5000 loss 0.0755 (w 0.0662 mse 0.0663 t 459 new 0.20) lr 1.00e-05 gnorm 0.063 5.81s mem 15.6GB +[2026-09-13 23:28:01] step 4729/5000 loss 0.0725 (w 0.2354 mse 0.2060 t 990 new 0.23) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:28:06] step 4730/5000 loss 0.1341 (w 0.2151 mse 0.2140 t 191 new 0.20) lr 1.00e-05 gnorm 0.091 5.69s mem 15.6GB +[2026-09-13 23:28:12] step 4731/5000 loss 0.1333 (w 0.2316 mse 0.2293 t 183 new 0.25) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 23:28:18] step 4732/5000 loss 0.0555 (w 0.0952 mse 0.0885 t 944 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:28:23] step 4733/5000 loss 0.0846 (w 0.1694 mse 0.1550 t 981 new 0.26) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:28:29] step 4734/5000 loss 0.0565 (w 0.0322 mse 0.0343 t 911 new 0.09) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 23:28:35] step 4735/5000 loss 0.0747 (w 0.1494 mse 0.1352 t 992 new 0.25) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 23:28:41] step 4736/5000 loss 0.1480 (w 0.0604 mse 0.0558 t 932 new 0.19) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 23:28:46] step 4737/5000 loss 0.0737 (w 0.0847 mse 0.0835 t 871 new 0.20) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 23:28:52] step 4738/5000 loss 0.0760 (w 0.1193 mse 0.1156 t 901 new 0.22) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 23:28:58] step 4739/5000 loss 0.0642 (w 0.0629 mse 0.0648 t 872 new 0.19) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:29:03] step 4740/5000 loss 0.0767 (w 0.0491 mse 0.0484 t 742 new 0.14) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 23:29:09] step 4741/5000 loss 0.0607 (w 0.1160 mse 0.1172 t 991 new 0.20) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:29:15] step 4742/5000 loss 0.0746 (w 0.0685 mse 0.0663 t 958 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 23:29:20] step 4743/5000 loss 0.0556 (w 0.0917 mse 0.0860 t 956 new 0.21) lr 1.00e-05 gnorm 0.056 5.67s mem 15.6GB +[2026-09-13 23:29:26] step 4744/5000 loss 0.0681 (w 0.0841 mse 0.0895 t 396 new 0.26) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 23:29:32] step 4745/5000 loss 0.0843 (w 0.1108 mse 0.1088 t 925 new 0.19) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 23:29:38] step 4746/5000 loss 0.0861 (w 0.0990 mse 0.0987 t 449 new 0.29) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 23:29:43] step 4747/5000 loss 0.0787 (w 0.0984 mse 0.0935 t 896 new 0.27) lr 1.00e-05 gnorm 0.070 5.84s mem 15.6GB +[2026-09-13 23:29:49] step 4748/5000 loss 0.1277 (w 0.4658 mse 0.4638 t 80 new 0.27) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 23:29:55] step 4749/5000 loss 0.1100 (w 0.1294 mse 0.1243 t 937 new 0.20) lr 1.00e-05 gnorm 0.073 5.91s mem 15.6GB +[2026-09-13 23:30:01] step 4750/5000 loss 0.0773 (w 0.0345 mse 0.0381 t 591 new 0.13) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:30:06] step 4751/5000 loss 0.0779 (w 0.0779 mse 0.0819 t 634 new 0.20) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:30:12] step 4752/5000 loss 0.0913 (w 0.0828 mse 0.0789 t 430 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:30:18] step 4753/5000 loss 0.1445 (w 0.0558 mse 0.0544 t 625 new 0.17) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:30:24] step 4754/5000 loss 0.0968 (w 0.0736 mse 0.0719 t 792 new 0.22) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 23:30:29] step 4755/5000 loss 0.0529 (w 0.0923 mse 0.0861 t 927 new 0.22) lr 1.00e-05 gnorm 0.058 5.68s mem 15.6GB +[2026-09-13 23:30:35] step 4756/5000 loss 0.0853 (w 0.0643 mse 0.0661 t 759 new 0.15) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 23:30:41] step 4757/5000 loss 0.0860 (w 0.0831 mse 0.0798 t 961 new 0.26) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 23:30:47] step 4758/5000 loss 0.0914 (w 0.1006 mse 0.0920 t 937 new 0.31) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 23:30:52] step 4759/5000 loss 0.0826 (w 0.0461 mse 0.0441 t 827 new 0.23) lr 1.00e-05 gnorm 0.060 5.70s mem 15.6GB +[2026-09-13 23:30:58] step 4760/5000 loss 0.0914 (w 0.0586 mse 0.0592 t 922 new 0.25) lr 1.00e-05 gnorm 0.061 5.73s mem 15.6GB +[2026-09-13 23:31:04] step 4761/5000 loss 0.0576 (w 0.0591 mse 0.0630 t 817 new 0.19) lr 1.00e-05 gnorm 0.065 5.70s mem 15.6GB +[2026-09-13 23:31:10] step 4762/5000 loss 0.0509 (w 0.0882 mse 0.0914 t 692 new 0.14) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 23:31:15] step 4763/5000 loss 0.1029 (w 0.0490 mse 0.0524 t 666 new 0.20) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 23:31:21] step 4764/5000 loss 0.0667 (w 0.1068 mse 0.1086 t 966 new 0.14) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 23:31:27] step 4765/5000 loss 0.0957 (w 0.0849 mse 0.0785 t 727 new 0.23) lr 1.00e-05 gnorm 0.060 5.68s mem 15.6GB +[2026-09-13 23:31:32] step 4766/5000 loss 0.1268 (w 0.1121 mse 0.1072 t 766 new 0.17) lr 1.00e-05 gnorm 0.048 5.69s mem 15.6GB +[2026-09-13 23:31:38] step 4767/5000 loss 0.1070 (w 0.2047 mse 0.1988 t 997 new 0.19) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 23:31:44] step 4768/5000 loss 0.1067 (w 0.0623 mse 0.0671 t 781 new 0.23) lr 1.00e-05 gnorm 0.080 5.91s mem 15.6GB +[2026-09-13 23:31:50] step 4769/5000 loss 0.0923 (w 0.0843 mse 0.0854 t 865 new 0.19) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 23:31:55] step 4770/5000 loss 0.0391 (w 0.0612 mse 0.0565 t 866 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 23:32:01] step 4771/5000 loss 0.0787 (w 0.0588 mse 0.0627 t 879 new 0.18) lr 1.00e-05 gnorm 0.064 5.90s mem 15.6GB +[2026-09-13 23:32:07] step 4772/5000 loss 0.1201 (w 0.1055 mse 0.1036 t 323 new 0.23) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 23:32:13] step 4773/5000 loss 0.1083 (w 0.0999 mse 0.0920 t 866 new 0.23) lr 1.00e-05 gnorm 0.046 5.68s mem 15.6GB +[2026-09-13 23:32:18] step 4774/5000 loss 0.0892 (w 0.1102 mse 0.0999 t 896 new 0.20) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:32:24] step 4775/5000 loss 0.1084 (w 0.0530 mse 0.0561 t 744 new 0.20) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 23:32:30] step 4776/5000 loss 0.1000 (w 0.0714 mse 0.0757 t 451 new 0.17) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:32:35] step 4777/5000 loss 0.0590 (w 0.1058 mse 0.1000 t 956 new 0.10) lr 1.00e-05 gnorm 0.078 5.68s mem 15.6GB +[2026-09-13 23:32:41] step 4778/5000 loss 0.0743 (w 0.0551 mse 0.0555 t 909 new 0.25) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 23:32:47] step 4779/5000 loss 0.0517 (w 0.0840 mse 0.0778 t 951 new 0.25) lr 1.00e-05 gnorm 0.071 5.67s mem 15.6GB +[2026-09-13 23:32:53] step 4780/5000 loss 0.0870 (w 0.0540 mse 0.0532 t 737 new 0.11) lr 1.00e-05 gnorm 0.106 5.76s mem 15.6GB +[2026-09-13 23:32:59] step 4781/5000 loss 0.0710 (w 0.0697 mse 0.0640 t 819 new 0.25) lr 1.00e-05 gnorm 0.069 5.91s mem 15.6GB +[2026-09-13 23:33:05] step 4782/5000 loss 0.0977 (w 0.1050 mse 0.0996 t 706 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 23:33:10] step 4783/5000 loss 0.0926 (w 0.1166 mse 0.1187 t 303 new 0.22) lr 1.00e-05 gnorm 0.084 5.69s mem 15.6GB +[2026-09-13 23:33:16] step 4784/5000 loss 0.1063 (w 0.1824 mse 0.1659 t 987 new 0.27) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 23:33:22] step 4785/5000 loss 0.1098 (w 0.0356 mse 0.0410 t 492 new 0.21) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 23:33:27] step 4786/5000 loss 0.1307 (w 0.2129 mse 0.2084 t 276 new 0.23) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 23:33:33] step 4787/5000 loss 0.1167 (w 0.1109 mse 0.1054 t 428 new 0.21) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:33:39] step 4788/5000 loss 0.0978 (w 0.1405 mse 0.1378 t 425 new 0.30) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:33:45] step 4789/5000 loss 0.0571 (w 0.1198 mse 0.1169 t 312 new 0.21) lr 1.00e-05 gnorm 0.085 5.93s mem 15.6GB +[2026-09-13 23:33:50] step 4790/5000 loss 0.1565 (w 0.0774 mse 0.0783 t 631 new 0.27) lr 1.00e-05 gnorm 0.088 5.68s mem 15.6GB +[2026-09-13 23:33:56] step 4791/5000 loss 0.0921 (w 0.0751 mse 0.0725 t 508 new 0.26) lr 1.00e-05 gnorm 0.070 5.94s mem 15.6GB +[2026-09-13 23:34:02] step 4792/5000 loss 0.1018 (w 0.1457 mse 0.1436 t 252 new 0.15) lr 1.00e-05 gnorm 0.075 5.71s mem 15.6GB +[2026-09-13 23:34:08] step 4793/5000 loss 0.1145 (w 0.0842 mse 0.0870 t 942 new 0.24) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 23:34:13] step 4794/5000 loss 0.0733 (w 0.0445 mse 0.0419 t 745 new 0.20) lr 1.00e-05 gnorm 0.104 5.69s mem 15.6GB +[2026-09-13 23:34:19] step 4795/5000 loss 0.0793 (w 0.1023 mse 0.0997 t 969 new 0.20) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 23:34:25] step 4796/5000 loss 0.0733 (w 0.0226 mse 0.0253 t 740 new 0.14) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 23:34:31] step 4797/5000 loss 0.0447 (w 0.0480 mse 0.0483 t 831 new 0.26) lr 1.00e-05 gnorm 0.074 5.68s mem 15.6GB +[2026-09-13 23:34:36] step 4798/5000 loss 0.0866 (w 0.0933 mse 0.0884 t 936 new 0.17) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 23:34:42] step 4799/5000 loss 0.0707 (w 0.0655 mse 0.0633 t 767 new 0.19) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:34:48] step 4800/5000 loss 0.0705 (w 0.1047 mse 0.0956 t 954 new 0.26) lr 1.00e-05 gnorm 0.079 5.68s mem 15.6GB +[2026-09-13 23:34:54] step 4801/5000 loss 0.0684 (w 0.0653 mse 0.0574 t 861 new 0.23) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:34:59] step 4802/5000 loss 0.0804 (w 0.0372 mse 0.0372 t 865 new 0.22) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 23:35:05] step 4803/5000 loss 0.0816 (w 0.1250 mse 0.1220 t 508 new 0.23) lr 1.00e-05 gnorm 0.092 5.81s mem 15.6GB +[2026-09-13 23:35:11] step 4804/5000 loss 0.0788 (w 0.1003 mse 0.0969 t 643 new 0.21) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:35:17] step 4805/5000 loss 0.0710 (w 0.0593 mse 0.0548 t 870 new 0.26) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 23:35:22] step 4806/5000 loss 0.0676 (w 0.0568 mse 0.0611 t 943 new 0.10) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:35:28] step 4807/5000 loss 0.0715 (w 0.0678 mse 0.0660 t 717 new 0.19) lr 1.00e-05 gnorm 0.069 5.69s mem 15.6GB +[2026-09-13 23:35:34] step 4808/5000 loss 0.1155 (w 0.1214 mse 0.1199 t 999 new 0.19) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 23:35:39] step 4809/5000 loss 0.0604 (w 0.0818 mse 0.0722 t 911 new 0.21) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 23:35:45] step 4810/5000 loss 0.0742 (w 0.1848 mse 0.1765 t 994 new 0.24) lr 1.00e-05 gnorm 0.063 5.97s mem 15.6GB +[2026-09-13 23:35:51] step 4811/5000 loss 0.0958 (w 0.1129 mse 0.1065 t 562 new 0.21) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 23:35:57] step 4812/5000 loss 0.0943 (w 0.1648 mse 0.1641 t 225 new 0.23) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 23:36:03] step 4813/5000 loss 0.1017 (w 0.0370 mse 0.0369 t 660 new 0.13) lr 1.00e-05 gnorm 0.057 5.71s mem 15.6GB +[2026-09-13 23:36:08] step 4814/5000 loss 0.0796 (w 0.0516 mse 0.0471 t 702 new 0.25) lr 1.00e-05 gnorm 0.069 5.71s mem 15.6GB +[2026-09-13 23:36:14] step 4815/5000 loss 0.0586 (w 0.2190 mse 0.2142 t 974 new 0.30) lr 1.00e-05 gnorm 0.070 5.70s mem 15.6GB +[2026-09-13 23:36:20] step 4816/5000 loss 0.0907 (w 0.0559 mse 0.0555 t 777 new 0.18) lr 1.00e-05 gnorm 0.069 5.70s mem 15.6GB +[2026-09-13 23:36:26] step 4817/5000 loss 0.0956 (w 0.1216 mse 0.1146 t 966 new 0.20) lr 1.00e-05 gnorm 0.071 5.75s mem 15.6GB +[2026-09-13 23:36:31] step 4818/5000 loss 0.0874 (w 0.0966 mse 0.0931 t 902 new 0.29) lr 1.00e-05 gnorm 0.062 5.68s mem 15.6GB +[2026-09-13 23:36:37] step 4819/5000 loss 0.1046 (w 0.1291 mse 0.1129 t 979 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:36:43] step 4820/5000 loss 0.0480 (w 0.0750 mse 0.0683 t 727 new 0.16) lr 1.00e-05 gnorm 0.065 5.93s mem 15.6GB +[2026-09-13 23:36:49] step 4821/5000 loss 0.1012 (w 0.1105 mse 0.1092 t 355 new 0.15) lr 1.00e-05 gnorm 0.057 5.70s mem 15.6GB +[2026-09-13 23:36:54] step 4822/5000 loss 0.0575 (w 0.0633 mse 0.0610 t 898 new 0.24) lr 1.00e-05 gnorm 0.056 5.70s mem 15.6GB +[2026-09-13 23:37:00] step 4823/5000 loss 0.0432 (w 0.0616 mse 0.0579 t 763 new 0.21) lr 1.00e-05 gnorm 0.062 5.93s mem 15.6GB +[2026-09-13 23:37:06] step 4824/5000 loss 0.0711 (w 0.0532 mse 0.0533 t 744 new 0.21) lr 1.00e-05 gnorm 0.073 5.68s mem 15.6GB +[2026-09-13 23:37:12] step 4825/5000 loss 0.1023 (w 0.0871 mse 0.0835 t 473 new 0.26) lr 1.00e-05 gnorm 0.079 5.69s mem 15.6GB +[2026-09-13 23:37:18] step 4826/5000 loss 0.1111 (w 0.1772 mse 0.1819 t 261 new 0.14) lr 1.00e-05 gnorm 0.043 5.69s mem 15.6GB +[2026-09-13 23:37:23] step 4827/5000 loss 0.1184 (w 0.8040 mse 0.7963 t 29 new 0.18) lr 1.00e-05 gnorm 0.058 5.93s mem 15.6GB +[2026-09-13 23:37:29] step 4828/5000 loss 0.0820 (w 0.0480 mse 0.0453 t 853 new 0.19) lr 1.00e-05 gnorm 0.066 5.70s mem 15.6GB +[2026-09-13 23:37:35] step 4829/5000 loss 0.0611 (w 0.1207 mse 0.1186 t 960 new 0.21) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:37:41] step 4830/5000 loss 0.1021 (w 0.0657 mse 0.0628 t 604 new 0.26) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:37:47] step 4831/5000 loss 0.0704 (w 0.0919 mse 0.0900 t 823 new 0.15) lr 1.00e-05 gnorm 0.090 5.89s mem 15.6GB +[2026-09-13 23:37:52] step 4832/5000 loss 0.0794 (w 0.0595 mse 0.0642 t 934 new 0.23) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 23:37:58] step 4833/5000 loss 0.0585 (w 0.0870 mse 0.0800 t 927 new 0.16) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:38:04] step 4834/5000 loss 0.0856 (w 0.1435 mse 0.1415 t 270 new 0.24) lr 1.00e-05 gnorm 0.053 5.70s mem 15.6GB +[2026-09-13 23:38:10] step 4835/5000 loss 0.0890 (w 0.0986 mse 0.0973 t 320 new 0.22) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 23:38:15] step 4836/5000 loss 0.1037 (w 0.0894 mse 0.0846 t 461 new 0.26) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:38:21] step 4837/5000 loss 0.0835 (w 0.0721 mse 0.0685 t 799 new 0.20) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 23:38:27] step 4838/5000 loss 0.1099 (w 0.0792 mse 0.0750 t 850 new 0.12) lr 1.00e-05 gnorm 0.072 5.77s mem 15.6GB +[2026-09-13 23:38:32] step 4839/5000 loss 0.1256 (w 0.0784 mse 0.0729 t 543 new 0.31) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 23:38:38] step 4840/5000 loss 0.1102 (w 0.0617 mse 0.0576 t 904 new 0.20) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 23:38:44] step 4841/5000 loss 0.0604 (w 0.0764 mse 0.0735 t 908 new 0.23) lr 1.00e-05 gnorm 0.074 5.95s mem 15.6GB +[2026-09-13 23:38:50] step 4842/5000 loss 0.1169 (w 0.0597 mse 0.0558 t 676 new 0.22) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:38:56] step 4843/5000 loss 0.1203 (w 0.0875 mse 0.0832 t 461 new 0.23) lr 1.00e-05 gnorm 0.049 5.70s mem 15.6GB +[2026-09-13 23:39:01] step 4844/5000 loss 0.1025 (w 0.0625 mse 0.0589 t 566 new 0.18) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 23:39:07] step 4845/5000 loss 0.0809 (w 0.1553 mse 0.1435 t 971 new 0.24) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 23:39:13] step 4846/5000 loss 0.0582 (w 0.0689 mse 0.0656 t 581 new 0.09) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 23:39:18] step 4847/5000 loss 0.0963 (w 0.6224 mse 0.6220 t 39 new 0.23) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 23:39:24] step 4848/5000 loss 0.0730 (w 0.0808 mse 0.0766 t 966 new 0.24) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:39:30] step 4849/5000 loss 0.1127 (w 0.0425 mse 0.0456 t 757 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 23:39:35] step 4850/5000 loss 0.0820 (w 0.1098 mse 0.1082 t 267 new 0.23) lr 1.00e-05 gnorm 0.068 5.68s mem 15.6GB +[2026-09-13 23:39:41] step 4851/5000 loss 0.0974 (w 0.0378 mse 0.0377 t 559 new 0.20) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 23:39:47] step 4852/5000 loss 0.1107 (w 0.1235 mse 0.1179 t 925 new 0.23) lr 1.00e-05 gnorm 0.059 5.90s mem 15.6GB +[2026-09-13 23:39:53] step 4853/5000 loss 0.0592 (w 0.0451 mse 0.0423 t 831 new 0.19) lr 1.00e-05 gnorm 0.064 5.71s mem 15.6GB +[2026-09-13 23:39:59] step 4854/5000 loss 0.0695 (w 0.6388 mse 0.6559 t 34 new 0.08) lr 1.00e-05 gnorm 0.062 5.70s mem 15.6GB +[2026-09-13 23:40:04] step 4855/5000 loss 0.0459 (w 0.0656 mse 0.0584 t 766 new 0.20) lr 1.00e-05 gnorm 0.046 5.69s mem 15.6GB +[2026-09-13 23:40:10] step 4856/5000 loss 0.0694 (w 0.0636 mse 0.0625 t 827 new 0.28) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:40:16] step 4857/5000 loss 0.0593 (w 0.0754 mse 0.0725 t 928 new 0.25) lr 1.00e-05 gnorm 0.045 5.69s mem 15.6GB +[2026-09-13 23:40:21] step 4858/5000 loss 0.0605 (w 0.1023 mse 0.0955 t 980 new 0.09) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 23:40:27] step 4859/5000 loss 0.0712 (w 0.1014 mse 0.0994 t 985 new 0.25) lr 1.00e-05 gnorm 0.063 5.68s mem 15.6GB +[2026-09-13 23:40:33] step 4860/5000 loss 0.1083 (w 0.0758 mse 0.0677 t 925 new 0.24) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:40:38] step 4861/5000 loss 0.1114 (w 0.0487 mse 0.0503 t 560 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:40:44] step 4862/5000 loss 0.0579 (w 0.0468 mse 0.0490 t 664 new 0.19) lr 1.00e-05 gnorm 0.050 5.70s mem 15.6GB +[2026-09-13 23:40:50] step 4863/5000 loss 0.1064 (w 0.0713 mse 0.0678 t 751 new 0.28) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 23:40:56] step 4864/5000 loss 0.0767 (w 0.1912 mse 0.1690 t 990 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 23:41:01] step 4865/5000 loss 0.0600 (w 0.1727 mse 0.1582 t 986 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 23:41:07] step 4866/5000 loss 0.0880 (w 0.2469 mse 0.2448 t 154 new 0.17) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 23:41:13] step 4867/5000 loss 0.0647 (w 0.1384 mse 0.1237 t 982 new 0.30) lr 1.00e-05 gnorm 0.045 5.69s mem 15.6GB +[2026-09-13 23:41:18] step 4868/5000 loss 0.0664 (w 0.0870 mse 0.0817 t 960 new 0.18) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 23:41:24] step 4869/5000 loss 0.0579 (w 0.1150 mse 0.1160 t 993 new 0.25) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:41:30] step 4870/5000 loss 0.1224 (w 0.0949 mse 0.0850 t 794 new 0.24) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 23:41:36] step 4871/5000 loss 0.0716 (w 0.0712 mse 0.0730 t 960 new 0.30) lr 1.00e-05 gnorm 0.074 5.70s mem 15.6GB +[2026-09-13 23:41:41] step 4872/5000 loss 0.0382 (w 0.0850 mse 0.0790 t 805 new 0.17) lr 1.00e-05 gnorm 0.071 5.69s mem 15.6GB +[2026-09-13 23:41:47] step 4873/5000 loss 0.0767 (w 0.0550 mse 0.0575 t 941 new 0.20) lr 1.00e-05 gnorm 0.070 5.94s mem 15.6GB +[2026-09-13 23:41:53] step 4874/5000 loss 0.0705 (w 0.0512 mse 0.0504 t 774 new 0.23) lr 1.00e-05 gnorm 0.056 5.68s mem 15.6GB +[2026-09-13 23:41:59] step 4875/5000 loss 0.0817 (w 0.2203 mse 0.2135 t 995 new 0.23) lr 1.00e-05 gnorm 0.046 5.68s mem 15.6GB +[2026-09-13 23:42:05] step 4876/5000 loss 0.0658 (w 0.0531 mse 0.0494 t 849 new 0.26) lr 1.00e-05 gnorm 0.074 5.69s mem 15.6GB +[2026-09-13 23:42:10] step 4877/5000 loss 0.0761 (w 0.1209 mse 0.1086 t 894 new 0.25) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 23:42:16] step 4878/5000 loss 0.0857 (w 0.0913 mse 0.0867 t 976 new 0.22) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +[2026-09-13 23:42:22] step 4879/5000 loss 0.0622 (w 0.0563 mse 0.0548 t 755 new 0.19) lr 1.00e-05 gnorm 0.052 5.70s mem 15.6GB +[2026-09-13 23:42:27] step 4880/5000 loss 0.0690 (w 0.0883 mse 0.0840 t 975 new 0.25) lr 1.00e-05 gnorm 0.062 5.69s mem 15.6GB +[2026-09-13 23:42:33] step 4881/5000 loss 0.1160 (w 0.0331 mse 0.0319 t 817 new 0.18) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 23:42:39] step 4882/5000 loss 0.0710 (w 0.0669 mse 0.0621 t 803 new 0.23) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 23:42:44] step 4883/5000 loss 0.0652 (w 0.1099 mse 0.1086 t 882 new 0.21) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:42:50] step 4884/5000 loss 0.0918 (w 0.1265 mse 0.1142 t 938 new 0.23) lr 1.00e-05 gnorm 0.064 5.80s mem 15.6GB +[2026-09-13 23:42:56] step 4885/5000 loss 0.0972 (w 0.6401 mse 0.6762 t 39 new 0.17) lr 1.00e-05 gnorm 0.070 5.84s mem 15.6GB +[2026-09-13 23:43:02] step 4886/5000 loss 0.0733 (w 0.0568 mse 0.0525 t 790 new 0.23) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:43:08] step 4887/5000 loss 0.1160 (w 0.0536 mse 0.0524 t 848 new 0.22) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 23:43:13] step 4888/5000 loss 0.0700 (w 0.0793 mse 0.0769 t 719 new 0.20) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 23:43:19] step 4889/5000 loss 0.1061 (w 0.0723 mse 0.0689 t 627 new 0.25) lr 1.00e-05 gnorm 0.049 5.69s mem 15.6GB +[2026-09-13 23:43:25] step 4890/5000 loss 0.1085 (w 0.1346 mse 0.1284 t 918 new 0.19) lr 1.00e-05 gnorm 0.050 5.69s mem 15.6GB +[2026-09-13 23:43:30] step 4891/5000 loss 0.0663 (w 0.1641 mse 0.1575 t 965 new 0.30) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 23:43:36] step 4892/5000 loss 0.1144 (w 0.1309 mse 0.1345 t 440 new 0.14) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 23:43:42] step 4893/5000 loss 0.1473 (w 0.1084 mse 0.1030 t 898 new 0.19) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 23:43:48] step 4894/5000 loss 0.1110 (w 0.1974 mse 0.1796 t 983 new 0.28) lr 1.00e-05 gnorm 0.052 5.92s mem 15.6GB +[2026-09-13 23:43:54] step 4895/5000 loss 0.0955 (w 0.1077 mse 0.1109 t 323 new 0.24) lr 1.00e-05 gnorm 0.072 5.68s mem 15.6GB +[2026-09-13 23:43:59] step 4896/5000 loss 0.0988 (w 0.3191 mse 0.3174 t 109 new 0.17) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:44:05] step 4897/5000 loss 0.1185 (w 0.0816 mse 0.0764 t 616 new 0.29) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 23:44:11] step 4898/5000 loss 0.0771 (w 0.0527 mse 0.0536 t 959 new 0.18) lr 1.00e-05 gnorm 0.076 6.00s mem 15.6GB +[2026-09-13 23:44:17] step 4899/5000 loss 0.0609 (w 0.0552 mse 0.0524 t 786 new 0.23) lr 1.00e-05 gnorm 0.053 5.68s mem 15.6GB +[2026-09-13 23:44:22] step 4900/5000 loss 0.1023 (w 0.5592 mse 0.6015 t 53 new 0.24) lr 1.00e-05 gnorm 0.113 5.68s mem 15.6GB +[2026-09-13 23:44:28] step 4901/5000 loss 0.0887 (w 0.0705 mse 0.0686 t 572 new 0.24) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 23:44:34] step 4902/5000 loss 0.0783 (w 0.0807 mse 0.0801 t 527 new 0.15) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:44:40] step 4903/5000 loss 0.0777 (w 0.0446 mse 0.0427 t 677 new 0.11) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 23:44:45] step 4904/5000 loss 0.0683 (w 0.0806 mse 0.0727 t 844 new 0.28) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 23:44:51] step 4905/5000 loss 0.1082 (w 0.0775 mse 0.0722 t 809 new 0.21) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 23:44:57] step 4906/5000 loss 0.1199 (w 0.1364 mse 0.1357 t 344 new 0.19) lr 1.00e-05 gnorm 0.067 5.85s mem 15.6GB +[2026-09-13 23:45:03] step 4907/5000 loss 0.1169 (w 0.1533 mse 0.1456 t 980 new 0.24) lr 1.00e-05 gnorm 0.072 5.69s mem 15.6GB +[2026-09-13 23:45:08] step 4908/5000 loss 0.0884 (w 0.1350 mse 0.1194 t 980 new 0.22) lr 1.00e-05 gnorm 0.075 5.88s mem 15.6GB +[2026-09-13 23:45:14] step 4909/5000 loss 0.1273 (w 0.0582 mse 0.0573 t 473 new 0.27) lr 1.00e-05 gnorm 0.067 5.68s mem 15.6GB +[2026-09-13 23:45:20] step 4910/5000 loss 0.0724 (w 0.0870 mse 0.0808 t 941 new 0.16) lr 1.00e-05 gnorm 0.040 5.68s mem 15.6GB +[2026-09-13 23:45:26] step 4911/5000 loss 0.0800 (w 0.1620 mse 0.1526 t 965 new 0.31) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 23:45:31] step 4912/5000 loss 0.0586 (w 0.0868 mse 0.0827 t 999 new 0.22) lr 1.00e-05 gnorm 0.051 5.79s mem 15.6GB +[2026-09-13 23:45:37] step 4913/5000 loss 0.0621 (w 0.0601 mse 0.0599 t 699 new 0.25) lr 1.00e-05 gnorm 0.056 5.69s mem 15.6GB +[2026-09-13 23:45:43] step 4914/5000 loss 0.0665 (w 0.0824 mse 0.0902 t 953 new 0.19) lr 1.00e-05 gnorm 0.076 5.68s mem 15.6GB +[2026-09-13 23:45:49] step 4915/5000 loss 0.0946 (w 0.0772 mse 0.0762 t 455 new 0.27) lr 1.00e-05 gnorm 0.050 5.68s mem 15.6GB +[2026-09-13 23:45:54] step 4916/5000 loss 0.0849 (w 0.0772 mse 0.0750 t 654 new 0.16) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 23:46:00] step 4917/5000 loss 0.1208 (w 0.2352 mse 0.2358 t 161 new 0.28) lr 1.00e-05 gnorm 0.059 5.68s mem 15.6GB +[2026-09-13 23:46:06] step 4918/5000 loss 0.1043 (w 0.1187 mse 0.1189 t 294 new 0.24) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 23:46:11] step 4919/5000 loss 0.0684 (w 0.1138 mse 0.1086 t 870 new 0.22) lr 1.00e-05 gnorm 0.054 5.69s mem 15.6GB +[2026-09-13 23:46:17] step 4920/5000 loss 0.0789 (w 0.1444 mse 0.1316 t 971 new 0.21) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 23:46:23] step 4921/5000 loss 0.1139 (w 0.1016 mse 0.0945 t 979 new 0.17) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:46:29] step 4922/5000 loss 0.0795 (w 0.0769 mse 0.0775 t 969 new 0.26) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 23:46:34] step 4923/5000 loss 0.0752 (w 0.0695 mse 0.0681 t 405 new 0.26) lr 1.00e-05 gnorm 0.082 5.68s mem 15.6GB +[2026-09-13 23:46:40] step 4924/5000 loss 0.0723 (w 0.0828 mse 0.0822 t 959 new 0.23) lr 1.00e-05 gnorm 0.049 5.68s mem 15.6GB +[2026-09-13 23:46:46] step 4925/5000 loss 0.1285 (w 0.0871 mse 0.0782 t 928 new 0.21) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 23:46:52] step 4926/5000 loss 0.0695 (w 0.0417 mse 0.0409 t 859 new 0.09) lr 1.00e-05 gnorm 0.059 5.88s mem 15.6GB +[2026-09-13 23:46:57] step 4927/5000 loss 0.0766 (w 0.0832 mse 0.0797 t 948 new 0.27) lr 1.00e-05 gnorm 0.055 5.69s mem 15.6GB +[2026-09-13 23:47:03] step 4928/5000 loss 0.0627 (w 0.0971 mse 0.0923 t 967 new 0.19) lr 1.00e-05 gnorm 0.057 5.69s mem 15.6GB +[2026-09-13 23:47:09] step 4929/5000 loss 0.0900 (w 0.1545 mse 0.1414 t 942 new 0.24) lr 1.00e-05 gnorm 0.063 5.69s mem 15.6GB +[2026-09-13 23:47:14] step 4930/5000 loss 0.0762 (w 0.0819 mse 0.0756 t 719 new 0.20) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 23:47:20] step 4931/5000 loss 0.0587 (w 0.0924 mse 0.0897 t 960 new 0.23) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:47:26] step 4932/5000 loss 0.0549 (w 0.1349 mse 0.1230 t 936 new 0.25) lr 1.00e-05 gnorm 0.070 5.69s mem 15.6GB +[2026-09-13 23:47:32] step 4933/5000 loss 0.0791 (w 0.0554 mse 0.0511 t 883 new 0.22) lr 1.00e-05 gnorm 0.048 5.80s mem 15.6GB +[2026-09-13 23:47:37] step 4934/5000 loss 0.0946 (w 0.1128 mse 0.1131 t 916 new 0.27) lr 1.00e-05 gnorm 0.095 5.69s mem 15.6GB +[2026-09-13 23:47:43] step 4935/5000 loss 0.0875 (w 0.3738 mse 0.3903 t 62 new 0.19) lr 1.00e-05 gnorm 0.061 5.71s mem 15.6GB +[2026-09-13 23:47:49] step 4936/5000 loss 0.0754 (w 0.1132 mse 0.1086 t 738 new 0.27) lr 1.00e-05 gnorm 0.065 5.90s mem 15.6GB +[2026-09-13 23:47:55] step 4937/5000 loss 0.0784 (w 0.0763 mse 0.0732 t 690 new 0.30) lr 1.00e-05 gnorm 0.072 5.70s mem 15.6GB +[2026-09-13 23:48:01] step 4938/5000 loss 0.0838 (w 0.1850 mse 0.1779 t 992 new 0.16) lr 1.00e-05 gnorm 0.071 6.06s mem 15.6GB +[2026-09-13 23:48:06] step 4939/5000 loss 0.0919 (w 0.0710 mse 0.0698 t 476 new 0.24) lr 1.00e-05 gnorm 0.055 5.68s mem 15.6GB +[2026-09-13 23:48:12] step 4940/5000 loss 0.0772 (w 0.0646 mse 0.0613 t 940 new 0.21) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 23:48:18] step 4941/5000 loss 0.0979 (w 0.0812 mse 0.0805 t 854 new 0.24) lr 1.00e-05 gnorm 0.078 5.69s mem 15.6GB +[2026-09-13 23:48:24] step 4942/5000 loss 0.0683 (w 0.1017 mse 0.0971 t 934 new 0.25) lr 1.00e-05 gnorm 0.052 5.69s mem 15.6GB +[2026-09-13 23:48:29] step 4943/5000 loss 0.1249 (w 0.0605 mse 0.0591 t 731 new 0.25) lr 1.00e-05 gnorm 0.061 5.92s mem 15.6GB +[2026-09-13 23:48:35] step 4944/5000 loss 0.0784 (w 0.0583 mse 0.0576 t 909 new 0.22) lr 1.00e-05 gnorm 0.084 5.68s mem 15.6GB +[2026-09-13 23:48:41] step 4945/5000 loss 0.0546 (w 0.0403 mse 0.0428 t 695 new 0.24) lr 1.00e-05 gnorm 0.052 5.68s mem 15.6GB +[2026-09-13 23:48:47] step 4946/5000 loss 0.0708 (w 0.0802 mse 0.0771 t 735 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:48:52] step 4947/5000 loss 0.0878 (w 0.1280 mse 0.1307 t 323 new 0.25) lr 1.00e-05 gnorm 0.095 5.68s mem 15.6GB +[2026-09-13 23:48:58] step 4948/5000 loss 0.1216 (w 0.1599 mse 0.1552 t 987 new 0.20) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:49:04] step 4949/5000 loss 0.0882 (w 0.0647 mse 0.0652 t 794 new 0.18) lr 1.00e-05 gnorm 0.078 5.80s mem 15.6GB +[2026-09-13 23:49:10] step 4950/5000 loss 0.1276 (w 0.0734 mse 0.0675 t 707 new 0.22) lr 1.00e-05 gnorm 0.076 5.69s mem 15.6GB +[2026-09-13 23:49:15] step 4951/5000 loss 0.0650 (w 0.0913 mse 0.0897 t 989 new 0.25) lr 1.00e-05 gnorm 0.077 5.69s mem 15.6GB +[2026-09-13 23:49:21] step 4952/5000 loss 0.0770 (w 0.0874 mse 0.0789 t 770 new 0.24) lr 1.00e-05 gnorm 0.075 5.69s mem 15.6GB +[2026-09-13 23:49:27] step 4953/5000 loss 0.0849 (w 0.1585 mse 0.1504 t 997 new 0.17) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:49:32] step 4954/5000 loss 0.0873 (w 0.0555 mse 0.0526 t 888 new 0.23) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 23:49:38] step 4955/5000 loss 0.0702 (w 0.2965 mse 0.2498 t 994 new 0.23) lr 1.00e-05 gnorm 0.059 5.69s mem 15.6GB +[2026-09-13 23:49:44] step 4956/5000 loss 0.0544 (w 0.1097 mse 0.1044 t 377 new 0.22) lr 1.00e-05 gnorm 0.053 5.69s mem 15.6GB +[2026-09-13 23:49:50] step 4957/5000 loss 0.0722 (w 0.0468 mse 0.0485 t 739 new 0.28) lr 1.00e-05 gnorm 0.063 5.91s mem 15.6GB +[2026-09-13 23:49:55] step 4958/5000 loss 0.0831 (w 0.0455 mse 0.0470 t 914 new 0.14) lr 1.00e-05 gnorm 0.061 5.70s mem 15.6GB +[2026-09-13 23:50:01] step 4959/5000 loss 0.1032 (w 0.1421 mse 0.1423 t 285 new 0.26) lr 1.00e-05 gnorm 0.069 5.93s mem 15.6GB +[2026-09-13 23:50:07] step 4960/5000 loss 0.0938 (w 0.0955 mse 0.0878 t 911 new 0.29) lr 1.00e-05 gnorm 0.065 5.69s mem 15.6GB +[2026-09-13 23:50:13] step 4961/5000 loss 0.0866 (w 0.0639 mse 0.0575 t 744 new 0.25) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:50:18] step 4962/5000 loss 0.0881 (w 0.0540 mse 0.0521 t 697 new 0.16) lr 1.00e-05 gnorm 0.060 5.69s mem 15.6GB +[2026-09-13 23:50:24] step 4963/5000 loss 0.0620 (w 0.1151 mse 0.1046 t 897 new 0.26) lr 1.00e-05 gnorm 0.067 5.69s mem 15.6GB +[2026-09-13 23:50:30] step 4964/5000 loss 0.1077 (w 0.0631 mse 0.0611 t 647 new 0.25) lr 1.00e-05 gnorm 0.087 5.69s mem 15.6GB +[2026-09-13 23:50:36] step 4965/5000 loss 0.0752 (w 0.0566 mse 0.0533 t 789 new 0.07) lr 1.00e-05 gnorm 0.064 5.69s mem 15.6GB +[2026-09-13 23:50:41] step 4966/5000 loss 0.0923 (w 0.1050 mse 0.1066 t 499 new 0.24) lr 1.00e-05 gnorm 0.065 5.68s mem 15.6GB +[2026-09-13 23:50:47] step 4967/5000 loss 0.0966 (w 0.0565 mse 0.0551 t 817 new 0.24) lr 1.00e-05 gnorm 0.070 5.68s mem 15.6GB +[2026-09-13 23:50:53] step 4968/5000 loss 0.1088 (w 0.0780 mse 0.0790 t 739 new 0.24) lr 1.00e-05 gnorm 0.067 5.96s mem 15.6GB +[2026-09-13 23:50:59] step 4969/5000 loss 0.0484 (w 0.1237 mse 0.1190 t 973 new 0.19) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 23:51:04] step 4970/5000 loss 0.0995 (w 0.0494 mse 0.0478 t 836 new 0.26) lr 1.00e-05 gnorm 0.083 5.68s mem 15.6GB +[2026-09-13 23:51:10] step 4971/5000 loss 0.0962 (w 0.0765 mse 0.0801 t 391 new 0.19) lr 1.00e-05 gnorm 0.058 5.87s mem 15.6GB +[2026-09-13 23:51:16] step 4972/5000 loss 0.0870 (w 0.0509 mse 0.0513 t 687 new 0.24) lr 1.00e-05 gnorm 0.061 5.69s mem 15.6GB +[2026-09-13 23:51:22] step 4973/5000 loss 0.0660 (w 0.0745 mse 0.0824 t 288 new 0.19) lr 1.00e-05 gnorm 0.070 5.71s mem 15.6GB +[2026-09-13 23:51:27] step 4974/5000 loss 0.0925 (w 0.0255 mse 0.0279 t 754 new 0.22) lr 1.00e-05 gnorm 0.066 5.71s mem 15.6GB +[2026-09-13 23:51:33] step 4975/5000 loss 0.0763 (w 0.0750 mse 0.0801 t 225 new 0.26) lr 1.00e-05 gnorm 0.090 5.94s mem 15.6GB +[2026-09-13 23:51:39] step 4976/5000 loss 0.1291 (w 0.1357 mse 0.1306 t 399 new 0.24) lr 1.00e-05 gnorm 0.059 5.70s mem 15.6GB +[2026-09-13 23:51:45] step 4977/5000 loss 0.0911 (w 0.0798 mse 0.0735 t 933 new 0.26) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 23:51:51] step 4978/5000 loss 0.1015 (w 0.0754 mse 0.0725 t 434 new 0.20) lr 1.00e-05 gnorm 0.077 5.89s mem 15.6GB +[2026-09-13 23:51:56] step 4979/5000 loss 0.1237 (w 0.0307 mse 0.0293 t 746 new 0.25) lr 1.00e-05 gnorm 0.069 5.68s mem 15.6GB +[2026-09-13 23:52:02] step 4980/5000 loss 0.0792 (w 0.0767 mse 0.0728 t 901 new 0.30) lr 1.00e-05 gnorm 0.081 5.70s mem 15.6GB +[2026-09-13 23:52:08] step 4981/5000 loss 0.0697 (w 0.1074 mse 0.0992 t 823 new 0.26) lr 1.00e-05 gnorm 0.066 5.68s mem 15.6GB +[2026-09-13 23:52:13] step 4982/5000 loss 0.1062 (w 0.0514 mse 0.0485 t 767 new 0.24) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 23:52:19] step 4983/5000 loss 0.0995 (w 0.0660 mse 0.0685 t 695 new 0.19) lr 1.00e-05 gnorm 0.085 5.69s mem 15.6GB +[2026-09-13 23:52:25] step 4984/5000 loss 0.0541 (w 0.0617 mse 0.0588 t 860 new 0.22) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:52:31] step 4985/5000 loss 0.0782 (w 0.1536 mse 0.1493 t 957 new 0.17) lr 1.00e-05 gnorm 0.061 5.68s mem 15.6GB +[2026-09-13 23:52:36] step 4986/5000 loss 0.0870 (w 0.1000 mse 0.0972 t 676 new 0.19) lr 1.00e-05 gnorm 0.083 5.69s mem 15.6GB +[2026-09-13 23:52:42] step 4987/5000 loss 0.0798 (w 0.1079 mse 0.1042 t 923 new 0.25) lr 1.00e-05 gnorm 0.058 5.69s mem 15.6GB +[2026-09-13 23:52:48] step 4988/5000 loss 0.0557 (w 0.1922 mse 0.1828 t 987 new 0.26) lr 1.00e-05 gnorm 0.057 5.68s mem 15.6GB +[2026-09-13 23:52:54] step 4989/5000 loss 0.0554 (w 0.0657 mse 0.0592 t 867 new 0.26) lr 1.00e-05 gnorm 0.068 5.89s mem 15.6GB +[2026-09-13 23:52:59] step 4990/5000 loss 0.0772 (w 0.0510 mse 0.0564 t 459 new 0.25) lr 1.00e-05 gnorm 0.068 5.69s mem 15.6GB +[2026-09-13 23:53:05] step 4991/5000 loss 0.0651 (w 0.0613 mse 0.0582 t 901 new 0.25) lr 1.00e-05 gnorm 0.067 5.70s mem 15.6GB +[2026-09-13 23:53:11] step 4992/5000 loss 0.0875 (w 0.1414 mse 0.1342 t 978 new 0.25) lr 1.00e-05 gnorm 0.051 5.71s mem 15.6GB +[2026-09-13 23:53:16] step 4993/5000 loss 0.0844 (w 0.0638 mse 0.0591 t 824 new 0.24) lr 1.00e-05 gnorm 0.105 5.70s mem 15.6GB +[2026-09-13 23:53:22] step 4994/5000 loss 0.0685 (w 0.1276 mse 0.1216 t 963 new 0.18) lr 1.00e-05 gnorm 0.066 5.69s mem 15.6GB +[2026-09-13 23:53:28] step 4995/5000 loss 0.1008 (w 0.0774 mse 0.0719 t 853 new 0.18) lr 1.00e-05 gnorm 0.071 5.68s mem 15.6GB +[2026-09-13 23:53:34] step 4996/5000 loss 0.0544 (w 0.1112 mse 0.1277 t 988 new 0.23) lr 1.00e-05 gnorm 0.075 5.68s mem 15.6GB +[2026-09-13 23:53:39] step 4997/5000 loss 0.0589 (w 0.0526 mse 0.0507 t 934 new 0.25) lr 1.00e-05 gnorm 0.051 5.69s mem 15.6GB +[2026-09-13 23:53:45] step 4998/5000 loss 0.0994 (w 0.1551 mse 0.1547 t 974 new 0.23) lr 1.00e-05 gnorm 0.064 5.68s mem 15.6GB +[2026-09-13 23:53:51] step 4999/5000 loss 0.0540 (w 0.0710 mse 0.0670 t 869 new 0.26) lr 1.00e-05 gnorm 0.085 5.68s mem 15.6GB +[2026-09-13 23:53:56] step 5000/5000 loss 0.0557 (w 0.0542 mse 0.0533 t 669 new 0.26) lr 1.00e-05 gnorm 0.056 5.71s mem 15.6GB +[2026-09-13 23:54:01] [val] step 5000 t=201: w=0.1734 mse=0.1758 (n=16) t=501: w=0.0716 mse=0.0715 (n=16) t=800: w=0.0595 mse=0.0583 (n=16) | mean w=0.1015 mse=0.1019 4s +[2026-09-13 23:54:04] [save] /opt/dlami/nvme/zhiyangdeng/ActionRoPE/outputs/skyreels/arope_5k/dits/dit_step5000.safetensors 832 个张量 2.87 GB +[2026-09-13 23:54:04] [done] step 5000 diff --git a/backup_2026-09-14/runs/skyreels__arope_5k/train_log.csv b/backup_2026-09-14/runs/skyreels__arope_5k/train_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..c603d12547969874348b6bb388063c58365c55a0 --- /dev/null +++ b/backup_2026-09-14/runs/skyreels__arope_5k/train_log.csv @@ -0,0 +1,5001 @@ +step,loss,loss_w,mse,new_frac,timestep,lr,grad_norm,step_time,mem_gb,epoch +1,0.15223553776741028,0.14016258716583252,0.1432708501815796,0.19911858439445496,940.900146484375,5.0000000000000004e-08,0.23522496223449707,10.889323949813843,14.20447587966919,0 +2,0.12805905938148499,0.1302352249622345,0.1266462504863739,0.17845351994037628,612.2449340820312,1.0000000000000001e-07,0.30673062801361084,5.667623043060303,15.541421890258789,0 +3,0.12271548062562943,0.1572549194097519,0.15292517840862274,0.2791426181793213,891.2169799804688,1.5000000000000002e-07,0.17216672003269196,5.690636157989502,15.555093765258789,0 +4,0.14347171783447266,0.10950450599193573,0.10433997958898544,0.14829325675964355,831.6600341796875,2.0000000000000002e-07,0.2426987886428833,5.698444604873657,15.555093765258789,0 +5,0.14548978209495544,0.0976877436041832,0.09134858101606369,0.26122593879699707,698.8536376953125,2.5000000000000004e-07,0.24543195962905884,5.685017108917236,15.555093765258789,0 +6,0.13800905644893646,0.13212931156158447,0.13154932856559753,0.17684294283390045,436.19793701171875,3.0000000000000004e-07,0.20469222962856293,5.694804906845093,15.555093765258789,0 +7,0.11505530029535294,0.06145735830068588,0.06767117977142334,0.2160496711730957,882.784912109375,3.5000000000000004e-07,0.23266646265983582,5.6909472942352295,15.555093765258789,0 +8,0.07608727365732193,0.109938845038414,0.10589788109064102,0.17010416090488434,892.4485473632812,4.0000000000000003e-07,0.2253805547952652,5.688847780227661,15.555093765258789,0 +9,0.15994319319725037,0.17087194323539734,0.16402064263820648,0.18298877775669098,431.9371643066406,4.5000000000000003e-07,0.24563957750797272,5.693518161773682,15.555093765258789,0 +10,0.2181163728237152,0.24716190993785858,0.25168904662132263,0.2012099325656891,993.2210693359375,5.000000000000001e-07,0.3238072693347931,5.686565160751343,15.555093765258789,0 +11,0.07577140629291534,0.20497916638851166,0.19877628982067108,0.09825319796800613,973.6957397460938,5.5e-07,0.14422355592250824,5.685594797134399,15.555093765258789,0 +12,0.08929458260536194,0.13791467249393463,0.1323508620262146,0.23411056399345398,936.2449951171875,6.000000000000001e-07,0.25135940313339233,5.70991587638855,15.555093765258789,0 +13,0.1628064215183258,0.172735333442688,0.17294584214687347,0.2152884602546692,485.94134521484375,6.5e-07,0.3213292062282562,5.6858015060424805,15.555093765258789,0 +14,0.16376103460788727,0.21505257487297058,0.2080075740814209,0.284519225358963,137.90036010742188,7.000000000000001e-07,0.2591521441936493,5.6876466274261475,15.555093765258789,0 +15,0.0921647772192955,0.10689814388751984,0.10280413925647736,0.1956971138715744,844.1558227539062,7.5e-07,0.20429189503192902,5.689188003540039,15.555093765258789,0 +16,0.14025841653347015,0.16431894898414612,0.16252490878105164,0.18636217713356018,997.5768432617188,8.000000000000001e-07,0.191990926861763,5.692641258239746,15.555093765258789,0 +17,0.11845695227384567,0.055499687790870667,0.05439271405339241,0.251850962638855,898.8763427734375,8.500000000000001e-07,0.2079753428697586,5.689668416976929,15.555093765258789,0 +18,0.08487913757562637,0.2397882342338562,0.23586280643939972,0.23644229769706726,981.7597045898438,9.000000000000001e-07,0.12753917276859283,5.6937501430511475,15.555093765258789,0 +19,0.08256206661462784,0.9590155482292175,0.9549846649169922,0.20204326510429382,4.9800801277160645,9.500000000000001e-07,0.20014894008636475,5.686096429824829,15.555093765258789,0 +20,0.09478211402893066,0.09939347952604294,0.09437928348779678,0.24658653140068054,925.1558837890625,1.0000000000000002e-06,0.14263096451759338,5.684364318847656,15.555093765258789,0 +21,0.18424881994724274,0.4055025577545166,0.40017369389533997,0.2517547905445099,991.0935668945312,1.0500000000000001e-06,0.2371051162481308,5.696604251861572,15.555093765258789,0 +22,0.10026047378778458,0.1202884241938591,0.11189455538988113,0.24713940918445587,839.3560791015625,1.1e-06,0.16204006969928741,5.695929527282715,15.555093765258789,0 +23,0.15494287014007568,0.11106374114751816,0.10978898406028748,0.19171473383903503,616.125732421875,1.1500000000000002e-06,0.19577361643314362,5.689801216125488,15.555093765258789,0 +24,0.10635779052972794,0.06686612963676453,0.07352926582098007,0.27096953988075256,884.5029296875,1.2000000000000002e-06,0.10989294201135635,5.6954545974731445,15.555093765258789,0 +25,0.0733625665307045,0.08274554461240768,0.0790780708193779,0.24626602232456207,710.2763671875,1.25e-06,0.183507040143013,5.688014030456543,15.555093765258789,0 +26,0.12684643268585205,0.3320471942424774,0.33283039927482605,0.13235576450824738,137.90036010742188,1.3e-06,0.19645589590072632,5.6833813190460205,15.555093765258789,0 +27,0.09170979261398315,0.08784524351358414,0.08779892325401306,0.17588941752910614,863.7206420898438,1.3500000000000002e-06,0.12350336462259293,5.6926188468933105,15.555093765258789,0 +28,0.09870939701795578,0.12511004507541656,0.12495774775743484,0.21989582479000092,927.8350219726562,1.4000000000000001e-06,0.12504562735557556,5.691068649291992,15.555093765258789,0 +29,0.09749479591846466,0.10255680233240128,0.09927121549844742,0.2674839496612549,675.5514526367188,1.45e-06,0.15954822301864624,5.696234226226807,15.555093765258789,0 +30,0.08778439462184906,0.1069808155298233,0.10507332533597946,0.2251121699810028,911.4300537109375,1.5e-06,0.0927560105919838,5.70493221282959,15.555093765258789,0 +31,0.12388782203197479,0.08787517994642258,0.08617392182350159,0.24568909406661987,911.7965698242188,1.5500000000000002e-06,0.13664107024669647,5.6852638721466064,15.555093765258789,0 +32,0.1063954308629036,0.11723636835813522,0.11205168813467026,0.22229966521263123,847.2938232421875,1.6000000000000001e-06,0.121892049908638,5.694932222366333,15.555093765258789,0 +33,0.12267336249351501,0.10852739959955215,0.09899511933326721,0.2821153700351715,681.8181762695312,1.6500000000000003e-06,0.14984633028507233,5.783778429031372,15.555093765258789,0 +34,0.06540738046169281,0.0983085185289383,0.09369854629039764,0.26453524827957153,744.3366088867188,1.7000000000000002e-06,0.08031124621629715,5.6912360191345215,15.555093765258789,0 +35,0.14928153157234192,0.2936580777168274,0.276170939207077,0.18213140964508057,997.5768432617188,1.75e-06,0.11465013772249222,5.690775632858276,15.555093765258789,0 +36,0.11212602257728577,0.0902838185429573,0.08744838088750839,0.2519230544567108,733.4710693359375,1.8000000000000001e-06,0.0911007896065712,5.69381046295166,15.555093765258789,0 +37,0.0667639821767807,0.18915705382823944,0.1842922419309616,0.17891825735569,982.9059448242188,1.85e-06,0.15771985054016113,5.694414377212524,15.555093765258789,0 +38,0.1496187001466751,0.06635037064552307,0.07232984155416489,0.2623717784881592,821.3306274414062,1.9000000000000002e-06,0.1421205997467041,5.700139045715332,15.555093765258789,0 +39,0.17446359992027283,0.15652251243591309,0.16236309707164764,0.19562499225139618,314.37127685546875,1.9500000000000004e-06,0.10311467200517654,5.696171045303345,15.555093765258789,0 +40,0.11878618597984314,0.11362309008836746,0.11050108075141907,0.2274439036846161,838.8157958984375,2.0000000000000003e-06,0.11623041331768036,5.698985576629639,15.555093765258789,0 +41,0.2082187980413437,0.09942058473825455,0.09262707829475403,0.22710736095905304,822.50341796875,2.05e-06,0.21703608334064484,5.69685959815979,15.555093765258789,0 +42,0.0804138034582138,0.08450206369161606,0.08409437537193298,0.2987339496612549,743.5170288085938,2.1000000000000002e-06,0.12632104754447937,5.691892147064209,15.555093765258789,0 +43,0.1973111927509308,0.15004751086235046,0.14424434304237366,0.24062499403953552,442.5064697265625,2.15e-06,0.10524015128612518,5.923060417175293,15.555093765258789,0 +44,0.0816945806145668,0.15875014662742615,0.15910394489765167,0.21761217713356018,942.7236938476562,2.2e-06,0.10013176500797272,5.686992406845093,15.555093765258789,0 +45,0.08137147128582001,0.2354901283979416,0.22778095304965973,0.2637099325656891,983.36181640625,2.25e-06,0.11535685509443283,5.686878681182861,15.555093765258789,0 +46,0.10192645341157913,0.15021516382694244,0.15658554434776306,0.22138620913028717,982.2193603515625,2.3000000000000004e-06,0.0930221751332283,5.678308963775635,15.555093765258789,0 +47,0.14564330875873566,0.16999532282352448,0.16768203675746918,0.2520432472229004,452.8061218261719,2.35e-06,0.0953688845038414,5.687962293624878,15.555093765258789,0 +48,0.06609342992305756,0.13428056240081787,0.1359492689371109,0.18637017905712128,875.2998046875,2.4000000000000003e-06,0.0899929404258728,5.69031834602356,15.555093765258789,0 +49,0.09886437654495239,0.1161729171872139,0.10954920947551727,0.239094540476799,496.98797607421875,2.4500000000000003e-06,0.08407551050186157,5.690133810043335,15.555093765258789,0 +50,0.07888132333755493,0.17234207689762115,0.16867074370384216,0.1843108832836151,948.9403076171875,2.5e-06,0.09969013929367065,5.68215799331665,15.555093765258789,0 +51,0.12722356617450714,0.15580736100673676,0.17288203537464142,0.21308492124080658,222.03948974609375,2.55e-06,0.0888364315032959,5.683478593826294,15.555093765258789,0 +52,0.07612954080104828,0.08291910588741302,0.08032340556383133,0.16076922416687012,915.7753295898438,2.6e-06,0.09922447055578232,5.669732332229614,15.555093765258789,0 +53,0.10146953910589218,0.0445730946958065,0.046964507550001144,0.1338782012462616,625.0,2.6500000000000005e-06,0.09717659652233124,5.6861631870269775,15.555093765258789,0 +54,0.11289522051811218,0.2622240483760834,0.2446078360080719,0.23285254836082458,984.94482421875,2.7000000000000004e-06,0.05960043519735336,5.775522947311401,15.555093765258789,0 +55,0.13573849201202393,0.17374975979328156,0.16814881563186646,0.20372594892978668,976.3572998046875,2.7500000000000004e-06,0.10855375975370407,5.692124843597412,15.555093765258789,0 +56,0.10224604606628418,0.29398444294929504,0.28296124935150146,0.22583332657814026,981.9896850585938,2.8000000000000003e-06,0.07353585213422775,5.68898868560791,15.555093765258789,0 +57,0.11661946028470993,0.16062991321086884,0.16349129378795624,0.19971153140068054,966.4247436523438,2.85e-06,0.10754825919866562,5.698056936264038,15.555093765258789,0 +58,0.08425652980804443,0.07325581461191177,0.07371168583631516,0.25661858916282654,813.5474853515625,2.9e-06,0.07098671048879623,5.6882164478302,15.555093765258789,0 +59,0.14906811714172363,0.15790796279907227,0.14517010748386383,0.2641666531562805,934.3434448242188,2.95e-06,0.07688599824905396,5.684826850891113,15.555093765258789,0 +60,0.10403262078762054,0.13425807654857635,0.12424525618553162,0.302099347114563,825.4075927734375,3e-06,0.09215457737445831,5.6906538009643555,15.555093765258789,0 +61,0.13533152639865875,0.08522024750709534,0.08305022120475769,0.23677082359790802,717.632080078125,3.05e-06,0.09062763303518295,5.69477105140686,15.555093765258789,0 +62,0.17335845530033112,0.15858815610408783,0.1556147038936615,0.2489503175020218,964.0897216796875,3.1000000000000004e-06,0.1013944000005722,5.687307357788086,15.555093765258789,0 +63,0.10612671822309494,0.24094614386558533,0.23029305040836334,0.26994389295578003,973.4513549804688,3.1500000000000003e-06,0.0825854018330574,5.69046425819397,15.555093765258789,0 +64,0.06216348707675934,0.15266942977905273,0.1440275013446808,0.2082291543483734,887.0499877929688,3.2000000000000003e-06,0.07905378192663193,6.133248329162598,15.555093765258789,0 +65,0.11021821200847626,0.03965705633163452,0.041963208466768265,0.12608973681926727,760.95458984375,3.2500000000000002e-06,0.08825143426656723,5.704499959945679,15.555093765258789,0 +66,0.07179438322782516,0.1184641420841217,0.11536578088998795,0.2546554505825043,943.3267822265625,3.3000000000000006e-06,0.08191504329442978,5.710389614105225,15.555093765258789,0 +67,0.08632419258356094,0.06452156603336334,0.06656286120414734,0.19109775125980377,614.83740234375,3.3500000000000005e-06,0.07208877056837082,5.702220678329468,15.555093765258789,0 +68,0.10774203389883041,0.06804779171943665,0.06575465947389603,0.253269225358963,768.4899291992188,3.4000000000000005e-06,0.0829678326845169,5.7059485912323,15.555093765258789,0 +69,0.14613215625286102,0.1810940057039261,0.20076453685760498,0.18205928802490234,981.9896850585938,3.45e-06,0.08754641562700272,5.698452472686768,15.555093765258789,0 +70,0.11610369384288788,0.5200972557067871,0.5308976769447327,0.2156650573015213,75.18797302246094,3.5e-06,0.1090165227651596,5.703794240951538,15.555093765258789,0 +71,0.11096872389316559,0.17093275487422943,0.16333319246768951,0.2506009638309479,944.52587890625,3.5500000000000003e-06,0.09659291058778763,5.705328941345215,15.555093765258789,0 +72,0.11093854904174805,0.3021746277809143,0.2890301048755646,0.26932692527770996,997.9838256835938,3.6000000000000003e-06,0.11492787301540375,5.708246469497681,15.555093765258789,0 +73,0.1286715865135193,0.08730793744325638,0.09067405760288239,0.25035256147384644,579.399169921875,3.65e-06,0.08234722167253494,5.6942267417907715,15.555093765258789,0 +74,0.10505222529172897,0.14087393879890442,0.14883838593959808,0.18796473741531372,985.3936767578125,3.7e-06,0.09740784764289856,5.68994402885437,15.555093765258789,0 +75,0.1197735071182251,0.09708362072706223,0.0908089280128479,0.16278845071792603,882.784912109375,3.7500000000000005e-06,0.07239512354135513,5.6942548751831055,15.555093765258789,0 +76,0.10483845323324203,0.2379351109266281,0.24513539671897888,0.11959134042263031,164.93057250976562,3.8000000000000005e-06,0.062226541340351105,5.685670375823975,15.555093765258789,0 +77,0.12446200102567673,0.31490084528923035,0.32153940200805664,0.11467146873474121,129.92831420898438,3.85e-06,0.06931518018245697,5.6846466064453125,15.555093765258789,0 +78,0.08274287730455399,0.14788277447223663,0.1489163488149643,0.24408653378486633,940.900146484375,3.900000000000001e-06,0.07675393670797348,5.695206642150879,15.555093765258789,0 +79,0.12705282866954803,0.23023457825183868,0.24225446581840515,0.17690704762935638,997.7804565429688,3.95e-06,0.07358686625957489,5.696322202682495,15.555093765258789,0 +80,0.13527797162532806,0.09155769646167755,0.08938193321228027,0.16914261877536774,930.143310546875,4.000000000000001e-06,0.07051881402730942,5.690042495727539,15.555093765258789,0 +81,0.06400694698095322,0.10532716661691666,0.10989002138376236,0.18430288136005402,961.7158813476562,4.05e-06,0.06924416124820709,5.689762830734253,15.555093765258789,0 +82,0.13107022643089294,0.0945124626159668,0.09519088268280029,0.21378204226493835,911.7965698242188,4.1e-06,0.07754995673894882,5.692011117935181,15.555093765258789,0 +83,0.11486071348190308,0.33461833000183105,0.34400659799575806,0.2430528700351715,129.92831420898438,4.15e-06,0.10024002939462662,5.681730031967163,15.555093765258789,0 +84,0.11579880863428116,0.09713207185268402,0.09257356822490692,0.26258814334869385,687.94970703125,4.2000000000000004e-06,0.07305993884801865,5.686986684799194,15.555093765258789,0 +85,0.0498790517449379,0.16869628429412842,0.16156217455863953,0.2593749761581421,946.6019287109375,4.25e-06,0.07387812435626984,5.920071125030518,15.555093765258789,0 +86,0.06060919538140297,0.22116772830486298,0.21323250234127045,0.2689182460308075,991.3079833984375,4.3e-06,0.06295538693666458,5.95030665397644,15.555093765258789,0 +87,0.08756208419799805,0.1585017442703247,0.156138077378273,0.22149838507175446,973.9398803710938,4.350000000000001e-06,0.06921626627445221,5.690608263015747,15.555093765258789,0 +88,0.13502319157123566,0.07362229377031326,0.07379503548145294,0.22055287659168243,526.620361328125,4.4e-06,0.08643266558647156,5.682644367218018,15.555093765258789,0 +89,0.04731317609548569,0.0760800763964653,0.07175420224666595,0.2506089508533478,877.0883178710938,4.450000000000001e-06,0.06227157264947891,5.691287517547607,15.555093765258789,0 +90,0.0738251730799675,0.19568918645381927,0.17405171692371368,0.23561698198318481,965.9091796875,4.5e-06,0.08002075552940369,5.690733909606934,15.555093765258789,0 +91,0.13198351860046387,0.09861299395561218,0.09935283660888672,0.2241586446762085,651.3410034179688,4.5500000000000005e-06,0.07526985555887222,5.6915881633758545,15.555093765258789,0 +92,0.1366078406572342,0.09802690148353577,0.09269656240940094,0.26537659764289856,699.823974609375,4.600000000000001e-06,0.0756237655878067,5.687117099761963,15.555093765258789,0 +93,0.08559700846672058,0.07796090841293335,0.07333121448755264,0.2379567176103592,612.2449340820312,4.65e-06,0.06496678292751312,5.695064306259155,15.555093765258789,0 +94,0.1680411696434021,0.13388775289058685,0.12754961848258972,0.2350640892982483,409.94622802734375,4.7e-06,0.0866730734705925,5.690326929092407,15.555093765258789,0 +95,0.06360789388418198,0.0494195818901062,0.04928984493017197,0.2472035139799118,883.2159423828125,4.75e-06,0.07049451768398285,5.685518980026245,15.555093765258789,0 +96,0.09490488469600677,0.18844503164291382,0.18461042642593384,0.2542227506637573,973.9398803710938,4.800000000000001e-06,0.07775775343179703,5.93142557144165,15.555093765258789,0 +97,0.08546608686447144,0.11712072789669037,0.11714792996644974,0.23897434771060944,953.7914428710938,4.85e-06,0.06865981221199036,5.679535388946533,15.555093765258789,0 +98,0.14357516169548035,0.11630283296108246,0.11131787300109863,0.19804486632347107,396.1748962402344,4.9000000000000005e-06,0.07478461414575577,5.684760570526123,15.555093765258789,0 +99,0.09796900302171707,0.08338520675897598,0.08035100996494293,0.25324517488479614,704.624755859375,4.95e-06,0.06463010609149933,5.685016870498657,15.555093765258789,0 +100,0.13698604702949524,0.0965992733836174,0.08885936439037323,0.24810095131397247,780.78076171875,5e-06,0.0877709612250328,5.686316967010498,15.555093765258789,0 +101,0.11321327090263367,0.0872906818985939,0.08162937313318253,0.29112178087234497,874.3990478515625,5.050000000000001e-06,0.07243018597364426,5.68405556678772,15.555093765258789,0 +102,0.0746213048696518,0.07325799763202667,0.07380057871341705,0.22989583015441895,764.7515258789062,5.1e-06,0.08931710571050644,5.690491676330566,15.555093765258789,0 +103,0.12347526103258133,0.06344258040189743,0.06302204728126526,0.10400640964508057,482.1867370605469,5.150000000000001e-06,0.07562749087810516,5.683650016784668,15.555093765258789,0 +104,0.08271937817335129,0.16205184161663055,0.1533704698085785,0.2165384590625763,986.50927734375,5.2e-06,0.0660165324807167,5.6851279735565186,15.555093765258789,0 +105,0.06797447800636292,0.05985574051737785,0.05965615063905716,0.17054486274719238,826.5582275390625,5.2500000000000006e-06,0.07685510814189911,5.6862404346466064,15.555093765258789,0 +106,0.1069657951593399,0.143264040350914,0.13610397279262543,0.17093749344348907,965.6505737304688,5.300000000000001e-06,0.06858305633068085,5.679773807525635,15.555093765258789,0 +107,0.10293719172477722,0.0664619654417038,0.06479969620704651,0.12308493256568909,784.97021484375,5.3500000000000004e-06,0.08899125456809998,5.805348634719849,15.555093765258789,0 +108,0.08822503685951233,0.15027154982089996,0.14625109732151031,0.2304326891899109,967.4503784179688,5.400000000000001e-06,0.08467226475477219,5.682822942733765,15.555093765258789,0 +109,0.1336323469877243,0.17383883893489838,0.1631079763174057,0.20247595012187958,972.7151489257812,5.450000000000001e-06,0.07432202994823456,5.687234878540039,15.555093765258789,0 +110,0.14704173803329468,0.06655585765838623,0.06978138536214828,0.2925160229206085,861.80126953125,5.500000000000001e-06,0.11099100112915039,5.68582558631897,15.555093765258789,0 +111,0.09762443602085114,0.07988878339529037,0.07911655306816101,0.23257210850715637,791.788818359375,5.550000000000001e-06,0.10193993151187897,5.686238527297974,15.555093765258789,0 +112,0.09864246100187302,0.12197975069284439,0.12076505273580551,0.2676362097263336,974.6696166992188,5.600000000000001e-06,0.0735374316573143,5.690436124801636,15.555093765258789,0 +113,0.12541459500789642,0.10196449607610703,0.09805456548929214,0.18793268501758575,881.0508422851562,5.65e-06,0.06860777735710144,5.68747091293335,15.555093765258789,0 +114,0.1458185315132141,0.0837249904870987,0.08218961209058762,0.25025638937950134,662.593994140625,5.7e-06,0.09961580485105515,5.695556640625,15.555093765258789,0 +115,0.10227411985397339,0.2794323265552521,0.26623934507369995,0.19824518263339996,991.52197265625,5.75e-06,0.07378878444433212,5.68576455116272,15.555093765258789,0 +116,0.1517493724822998,0.06384751945734024,0.06832463294267654,0.2144230753183365,628.7276611328125,5.8e-06,0.09000463038682938,5.686782360076904,15.555093765258789,0 +117,0.12230902910232544,0.10726658999919891,0.10078196972608566,0.2275240272283554,502.3923645019531,5.85e-06,0.11198921501636505,5.935308218002319,15.555093765258789,0 +118,0.13479988276958466,0.0993492379784584,0.09721588343381882,0.16245992481708527,837.1862182617188,5.9e-06,0.09990166127681732,5.85025691986084,15.555093765258789,0 +119,0.08735529333353043,0.20001353323459625,0.20368951559066772,0.26154646277427673,981.5291137695312,5.950000000000001e-06,0.0759589821100235,5.68586277961731,15.555093765258789,0 +120,0.11131590604782104,0.09494945406913757,0.09135133028030396,0.20372594892978668,925.1558837890625,6e-06,0.068790964782238,5.684812545776367,15.555093765258789,0 +121,0.10978542268276215,0.06932469457387924,0.06712504476308823,0.21387819945812225,932.7411499023438,6.0500000000000005e-06,0.07284461706876755,5.688924551010132,15.555093765258789,0 +122,0.08669345080852509,0.07378134876489639,0.07173597812652588,0.23493589460849762,876.6427001953125,6.1e-06,0.06702245026826859,5.691896915435791,15.555093765258789,0 +123,0.07059871405363083,0.08200502395629883,0.08283385634422302,0.2496073693037033,563.1868286132812,6.15e-06,0.09290625154972076,5.687343597412109,15.555093765258789,0 +124,0.13273587822914124,0.10785914212465286,0.10462333261966705,0.1872996687889099,685.9205932617188,6.200000000000001e-06,0.06348046660423279,5.696349859237671,15.555093765258789,0 +125,0.12371121346950531,0.07580843567848206,0.07413899153470993,0.07287660241127014,814.7632446289062,6.25e-06,0.09116432815790176,5.694121837615967,15.555093765258789,0 +126,0.08906339108943939,0.09474693983793259,0.09160667657852173,0.28822916746139526,846.7742309570312,6.300000000000001e-06,0.05830485001206398,5.686091661453247,15.555093765258789,0 +127,0.09462840855121613,0.10916657745838165,0.09896128624677658,0.22153043746948242,893.2648315429688,6.35e-06,0.07792866975069046,5.684718132019043,15.555093765258789,0 +128,0.12222954630851746,0.08487486094236374,0.08260439336299896,0.2181890904903412,678.7020263671875,6.4000000000000006e-06,0.07216391712427139,5.775688409805298,15.555093765258789,0 +129,0.11629690229892731,0.19752930104732513,0.19413915276527405,0.28488782048225403,232.08470153808594,6.450000000000001e-06,0.08168378472328186,5.694515705108643,15.555093765258789,0 +130,0.13365504145622253,0.05586837977170944,0.05396188795566559,0.1488301157951355,660.3773803710938,6.5000000000000004e-06,0.07783300429582596,5.690905809402466,15.555093765258789,0 +131,0.13693121075630188,0.19760075211524963,0.19824890792369843,0.2400640994310379,225.4098358154297,6.550000000000001e-06,0.07501019537448883,5.68729829788208,15.555093765258789,0 +132,0.1350259780883789,0.09611617028713226,0.09094090759754181,0.22571313381195068,867.9705810546875,6.600000000000001e-06,0.08715813606977463,5.697724103927612,15.555093765258789,0 +133,0.08531452715396881,0.09295911341905594,0.09372607618570328,0.27222755551338196,603.0020751953125,6.650000000000001e-06,0.08005519956350327,5.68824315071106,15.555093765258789,0 +134,0.13007570803165436,0.10636810213327408,0.10260573029518127,0.2416265904903412,519.8598022460938,6.700000000000001e-06,0.07214090973138809,5.6863014698028564,15.555093765258789,0 +135,0.12575973570346832,0.11965139955282211,0.12186127156019211,0.17378205060958862,478.3950500488281,6.750000000000001e-06,0.06736109405755997,5.685950517654419,15.555093765258789,0 +136,0.1111258789896965,0.07867947965860367,0.07471200823783875,0.2848076820373535,600.3118286132812,6.800000000000001e-06,0.07136861234903336,5.691122531890869,15.555093765258789,0 +137,0.09628204256296158,0.07686272263526917,0.07434172183275223,0.25149038434028625,703.6713256835938,6.850000000000001e-06,0.08159205317497253,5.694737195968628,15.555093765258789,0 +138,0.09813199192285538,0.2210109978914261,0.22645814716815948,0.2240544855594635,979.2027587890625,6.9e-06,0.08645445108413696,5.94436240196228,15.555093765258789,0 +139,0.10638044029474258,0.11059834808111191,0.10581030696630478,0.25681889057159424,716.7235717773438,6.95e-06,0.07735734432935715,5.686941146850586,15.555093765258789,0 +140,0.10994072258472443,0.5569069981575012,0.5721730589866638,0.2960897386074066,66.28787994384766,7e-06,0.06567152589559555,5.699328422546387,15.555093765258789,0 +141,0.1119937151670456,0.07908042520284653,0.07280001044273376,0.2597515881061554,482.1867370605469,7.05e-06,0.07825252413749695,5.693457126617432,15.555093765258789,0 +142,0.07833678275346756,0.14635710418224335,0.13462094962596893,0.20249198377132416,951.2427978515625,7.100000000000001e-06,0.07750285416841507,5.696312189102173,15.555093765258789,0 +143,0.13182593882083893,0.10425291955471039,0.10034231096506119,0.1757451891899109,946.896240234375,7.15e-06,0.0810679942369461,5.686470985412598,15.555093765258789,0 +144,0.13088147342205048,0.07743104547262192,0.07668868452310562,0.15820512175559998,593.4874267578125,7.2000000000000005e-06,0.08025359362363815,5.687333583831787,15.555093765258789,0 +145,0.06800876557826996,0.11188846826553345,0.10305281728506088,0.2556810677051544,966.1671142578125,7.25e-06,0.08665191382169724,5.6869056224823,15.555093765258789,0 +146,0.08579807728528976,0.1028178408741951,0.09970999509096146,0.21715544164180756,932.0956420898438,7.3e-06,0.06453342735767365,5.695231676101685,15.555093765258789,0 +147,0.10338928550481796,0.23875011503696442,0.2303866147994995,0.23025640845298767,161.1498260498047,7.350000000000001e-06,0.07936833798885345,5.691150188446045,15.555093765258789,0 +148,0.10290174931287766,0.22581052780151367,0.20651361346244812,0.2239583283662796,987.3948974609375,7.4e-06,0.0899486169219017,5.6906023025512695,15.555093765258789,0 +149,0.09001211822032928,0.07453849166631699,0.07355771213769913,0.2263782024383545,476.4851989746094,7.450000000000001e-06,0.06889164447784424,6.0214903354644775,15.555093765258789,0 +150,0.07757171243429184,0.09725776314735413,0.09204831719398499,0.2458493560552597,903.1631469726562,7.500000000000001e-06,0.09218430519104004,5.688965797424316,15.555093765258789,0 +151,0.08762086927890778,0.0672711431980133,0.06538516283035278,0.2743990421295166,846.2532348632812,7.5500000000000006e-06,0.08782872557640076,5.679716110229492,15.555093765258789,0 +152,0.08643245697021484,0.08769732713699341,0.08137903362512589,0.24041666090488434,911.0628662109375,7.600000000000001e-06,0.07469411194324493,5.6733152866363525,15.555093765258789,0 +153,0.12887278199195862,0.13454784452915192,0.1317681223154068,0.24564102292060852,942.1181640625,7.650000000000001e-06,0.08117467910051346,5.6789703369140625,15.555093765258789,0 +154,0.1074441522359848,0.0969642773270607,0.0964352935552597,0.2194230705499649,743.5170288085938,7.7e-06,0.11417485028505325,5.682448625564575,15.555093765258789,0 +155,0.1035471111536026,0.07708246260881424,0.0698694959282875,0.23983171582221985,733.4710693359375,7.75e-06,0.08286835998296738,5.6847898960113525,15.555093765258789,0 +156,0.11285120993852615,0.16985604166984558,0.159542515873909,0.21189101040363312,950.6705322265625,7.800000000000002e-06,0.08852560818195343,5.687982082366943,15.555093765258789,0 +157,0.04637962579727173,0.06699668616056442,0.060899678617715836,0.23710736632347107,845.7308959960938,7.850000000000001e-06,0.06668566912412643,5.688109397888184,15.555093765258789,0 +158,0.14609725773334503,0.05867189168930054,0.05530766770243645,0.25775641202926636,713.9794311523438,7.9e-06,0.09425798803567886,5.682528495788574,15.555093765258789,0 +159,0.04913460463285446,0.22868113219738007,0.22229444980621338,0.17459934949874878,986.731201171875,7.950000000000002e-06,0.0746438205242157,5.907787084579468,15.555093765258789,0 +160,0.11326480656862259,0.15470008552074432,0.14429724216461182,0.24465544521808624,919.3121948242188,8.000000000000001e-06,0.10235264152288437,5.68842887878418,15.555093765258789,0 +161,0.09109481424093246,0.09781866520643234,0.09723969548940659,0.2338942289352417,787.0369873046875,8.050000000000001e-06,0.09625040739774704,5.678890705108643,15.555093765258789,0 +162,0.09188109636306763,0.3283454477787018,0.3267212510108948,0.2513381242752075,149.64788818359375,8.1e-06,0.07731932401657104,5.694079875946045,15.555093765258789,0 +163,0.10060945153236389,0.11491533368825912,0.10874901711940765,0.18698717653751373,924.4791870117188,8.15e-06,0.06489330530166626,5.685964107513428,15.555093765258789,0 +164,0.1366497129201889,0.05105309933423996,0.057053353637456894,0.2862580120563507,563.1868286132812,8.2e-06,0.10184816271066666,5.68505334854126,15.555093765258789,0 +165,0.1332460194826126,0.09627186506986618,0.0936659574508667,0.2692147195339203,780.0751953125,8.25e-06,0.09577985852956772,5.688991546630859,15.555093765258789,0 +166,0.10090763866901398,0.08610287308692932,0.08373498916625977,0.11987178772687912,538.1549072265625,8.3e-06,0.0749756321310997,5.694681644439697,15.555093765258789,0 +167,0.08380177617073059,0.025910820811986923,0.029059983789920807,0.161370187997818,652.4856567382812,8.35e-06,0.10024649649858475,5.691580772399902,15.555093765258789,0 +168,0.09045030921697617,0.06346647441387177,0.05984463542699814,0.2183653712272644,733.4710693359375,8.400000000000001e-06,0.09197226166725159,5.691094875335693,15.555093765258789,0 +169,0.1064143031835556,0.07963277399539948,0.08011499792337418,0.06059294566512108,940.287353515625,8.45e-06,0.08883853256702423,5.694532632827759,15.555093765258789,0 +170,0.07945830374956131,0.09839458763599396,0.10537809878587723,0.1422676295042038,924.4791870117188,8.5e-06,0.09879998117685318,5.684436321258545,15.555093765258789,0 +171,0.08678440749645233,0.06562070548534393,0.0636894553899765,0.20181889832019806,685.9205932617188,8.550000000000001e-06,0.10723715275526047,5.694905519485474,15.555093765258789,0 +172,0.11912541091442108,0.6714255809783936,0.6707291603088379,0.2700721025466919,52.6819953918457,8.6e-06,0.06618384271860123,5.681142330169678,15.555093765258789,0 +173,0.14640295505523682,0.06306468695402145,0.06755559891462326,0.2233814001083374,504.1766052246094,8.65e-06,0.08634167164564133,5.6840434074401855,15.555093765258789,0 +174,0.14662949740886688,0.066434845328331,0.07112891227006912,0.25759613513946533,516.4320068359375,8.700000000000001e-06,0.07303972542285919,5.6813201904296875,15.555093765258789,0 +175,0.12701261043548584,0.0776028260588646,0.07438834756612778,0.2152724266052246,576.5086669921875,8.750000000000001e-06,0.07226736098527908,5.683218479156494,15.555093765258789,0 +176,0.10599949955940247,0.13520166277885437,0.13761305809020996,0.18310095369815826,931.1224365234375,8.8e-06,0.06124518811702728,5.685687780380249,15.555093765258789,0 +177,0.12169253826141357,0.09344182163476944,0.09040573239326477,0.17440705001354218,857.4120483398438,8.85e-06,0.08533128350973129,5.681594133377075,15.555093765258789,0 +178,0.06747352331876755,0.1648748219013214,0.16268803179264069,0.19349358975887299,959.5725708007812,8.900000000000001e-06,0.10387588292360306,5.686213493347168,15.555093765258789,0 +179,0.12339697033166885,0.09738202393054962,0.0935860127210617,0.21032050251960754,841.503173828125,8.95e-06,0.06803196668624878,5.69032883644104,15.555093765258789,0 +180,0.11124708503484726,0.08496865630149841,0.08210059255361557,0.2587019205093384,874.8499145507812,9e-06,0.07668853551149368,5.912088632583618,15.555093765258789,0 +181,0.1369316130876541,0.060134049504995346,0.06094112992286682,0.2554166615009308,784.2772827148438,9.050000000000001e-06,0.07632394134998322,5.9010090827941895,15.555093765258789,0 +182,0.09550391137599945,0.07944387942552567,0.07523582875728607,0.19148236513137817,618.6868286132812,9.100000000000001e-06,0.08791469037532806,5.691572904586792,15.555093765258789,0 +183,0.12841053307056427,0.13517554104328156,0.13015028834342957,0.18737179040908813,890.8045654296875,9.15e-06,0.08589912950992584,5.6821722984313965,15.555093765258789,0 +184,0.09624576568603516,0.14605841040611267,0.14239643514156342,0.2594711482524872,986.50927734375,9.200000000000002e-06,0.07374265789985657,5.683969736099243,15.555093765258789,0 +185,0.12404481321573257,0.031260520219802856,0.029022058472037315,0.09564102441072464,482.1867370605469,9.250000000000001e-06,0.09121418744325638,5.686460494995117,15.555093765258789,0 +186,0.11581641435623169,0.7591473460197449,0.7471775412559509,0.23096153140068054,19.685039520263672,9.3e-06,0.0694003775715828,5.690420866012573,15.555093765258789,0 +187,0.06946920603513718,0.08457495272159576,0.08166681975126266,0.1547195464372635,815.9722900390625,9.350000000000002e-06,0.07361432909965515,5.692395210266113,15.555093765258789,0 +188,0.09546666592359543,0.0613597072660923,0.0662311390042305,0.2739022374153137,841.503173828125,9.4e-06,0.08451423794031143,5.686721086502075,15.555093765258789,0 +189,0.13639084994792938,0.31088581681251526,0.28842416405677795,0.23146633803844452,999.7998046875,9.450000000000001e-06,0.0715515986084938,5.678623914718628,15.555093765258789,0 +190,0.07655228674411774,0.11726358532905579,0.12470303475856781,0.13689102232456207,969.2273559570312,9.5e-06,0.08637465536594391,5.885529518127441,15.555093765258789,0 +191,0.06723149120807648,0.15633247792720795,0.1442999392747879,0.24625800549983978,934.3434448242188,9.55e-06,0.08804161101579666,5.687682390213013,15.555093765258789,0 +192,0.08005321025848389,0.11716838926076889,0.10955913364887238,0.2834775447845459,894.8863525390625,9.600000000000001e-06,0.0712089017033577,5.745836496353149,15.555093765258789,0 +193,0.05360536649823189,0.0698452889919281,0.06770754605531693,0.29153844714164734,890.3912353515625,9.65e-06,0.08407162874937057,5.670666217803955,15.555093765258789,0 +194,0.11889182776212692,0.04353373497724533,0.04217134788632393,0.21487179398536682,689.9642333984375,9.7e-06,0.11454132199287415,5.692312717437744,15.555093765258789,0 +195,0.1028154194355011,0.06719791889190674,0.06677964329719543,0.16224358975887299,814.15625,9.75e-06,0.074635811150074,5.699694871902466,15.555093765258789,0 +196,0.19931921362876892,0.09118813276290894,0.09027250111103058,0.29403042793273926,504.1766052246094,9.800000000000001e-06,0.11817685514688492,5.689967632293701,15.555093765258789,0 +197,0.10772710293531418,0.1288946568965912,0.12611423432826996,0.21535255014896393,950.9569091796875,9.85e-06,0.08607928454875946,5.68562650680542,15.555093765258789,0 +198,0.05818784236907959,0.07436978816986084,0.07237205654382706,0.17560896277427673,710.2763671875,9.9e-06,0.06755300611257553,5.684939861297607,15.555093765258789,0 +199,0.16599871218204498,0.1611805111169815,0.15951399505138397,0.20151442289352417,352.0115051269531,9.950000000000001e-06,0.09811238944530487,5.688120603561401,15.555093765258789,0 +200,0.10555166006088257,0.764853835105896,0.784565269947052,0.2361217886209488,34.046695709228516,1e-05,0.06656312942504883,5.692572355270386,15.555093765258789,0 +201,0.1278572380542755,0.04592885076999664,0.049332406371831894,0.2889503240585327,603.0020751953125,1e-05,0.10752881318330765,5.691860914230347,15.555093765258789,0 +202,0.10959823429584503,0.1615511029958725,0.15460139513015747,0.23384614288806915,291.41107177734375,1e-05,0.07468064874410629,6.140586614608765,15.555093765258789,0 +203,0.07891266793012619,0.07497324049472809,0.06839844584465027,0.23304486274719238,795.1236572265625,1e-05,0.08429812639951706,5.702707529067993,15.555093765258789,0 +204,0.08186116069555283,0.09840862452983856,0.09194441139698029,0.22225961089134216,830.5369873046875,1e-05,0.08684643357992172,5.693079948425293,15.555093765258789,0 +205,0.09581007808446884,0.09130563586950302,0.08908692747354507,0.24481569230556488,886.6278686523438,1e-05,0.06791431456804276,5.701767683029175,15.555093765258789,0 +206,0.12421847879886627,0.3293185532093048,0.3235650360584259,0.09644230455160141,993.2210693359375,1e-05,0.07538864016532898,5.686494827270508,15.555093765258789,0 +207,0.10002229362726212,0.10327084362506866,0.10156828910112381,0.26087337732315063,790.4412231445312,1e-05,0.1014188677072525,5.690784215927124,15.555093765258789,0 +208,0.1183934211730957,0.10440807789564133,0.1033303290605545,0.2986137568950653,944.52587890625,1e-05,0.09214825183153152,5.687950372695923,15.555093765258789,0 +209,0.09504294395446777,0.11309009045362473,0.11072669923305511,0.18366184830665588,697.8798828125,1e-05,0.11525505036115646,5.692779302597046,15.555093765258789,0 +210,0.10238181799650192,0.22629310190677643,0.22190088033676147,0.19693107903003693,197.81146240234375,1e-05,0.07793679088354111,5.684507369995117,15.555093765258789,0 +211,0.06090717390179634,0.16699761152267456,0.17258885502815247,0.2678445279598236,986.064208984375,1e-05,0.09356436878442764,5.691669225692749,15.555093765258789,0 +212,0.10971306264400482,0.1269674152135849,0.12413889169692993,0.18112178146839142,372.1910095214844,1e-05,0.07330538332462311,5.731809854507446,15.555093765258789,0 +213,0.04796073958277702,0.38566917181015015,0.33163243532180786,0.2893669903278351,990.0166625976562,1e-05,0.11846255511045456,5.778920888900757,15.555093765258789,0 +214,0.11249654740095139,0.14858144521713257,0.14728125929832458,0.2242548018693924,946.6019287109375,1e-05,0.0995372086763382,5.684839487075806,15.555093765258789,0 +215,0.0818699449300766,0.0863829255104065,0.0865941271185875,0.11684294790029526,835.5437622070312,1e-05,0.085093192756176,5.683104753494263,15.555093765258789,0 +216,0.1005505695939064,0.06422265619039536,0.06409396231174469,0.12498396635055542,844.6821899414062,1e-05,0.0973593220114708,5.6860692501068115,15.555093765258789,0 +217,0.1272359937429428,0.064253069460392,0.06785299628973007,0.2618829905986786,682.8494262695312,1e-05,0.08191754668951035,5.685811281204224,15.555093765258789,0 +218,0.07413067668676376,0.09120899438858032,0.08721861988306046,0.2221153825521469,642.0233154296875,1e-05,0.10952356457710266,5.68211555480957,15.555093765258789,0 +219,0.14727014303207397,0.08466901630163193,0.08584010601043701,0.21291665732860565,626.2474975585938,1e-05,0.09923601895570755,5.688587188720703,15.555093765258789,0 +220,0.09669724106788635,0.08161969482898712,0.07854974269866943,0.2790144085884094,787.721923828125,1e-05,0.09828124940395355,5.688031196594238,15.555093765258789,0 +221,0.08271314203739166,0.09057829529047012,0.09032318741083145,0.17103365063667297,651.3410034179688,1e-05,0.07790733873844147,5.700197696685791,15.555093765258789,0 +222,0.0964178591966629,0.08914449065923691,0.08616561442613602,0.13689102232456207,860.34912109375,1e-05,0.08299646526575089,5.691192626953125,15.555093765258789,0 +223,0.06950058788061142,0.09206721186637878,0.0887828916311264,0.23943910002708435,864.6732177734375,1e-05,0.07479273527860641,6.145991325378418,15.555093765258789,0 +224,0.15208761394023895,0.13634124398231506,0.1306530088186264,0.09959935396909714,916.1324462890625,1e-05,0.07838977128267288,5.686952114105225,15.555093765258789,0 +225,0.05121028795838356,0.23549167811870575,0.22092384099960327,0.23414261639118195,995.10595703125,1e-05,0.07117262482643127,5.689849853515625,15.555093765258789,0 +226,0.101275734603405,0.09169291704893112,0.08496642112731934,0.23201921582221985,856.9182739257812,1e-05,0.07481396943330765,5.684791803359985,15.555093765258789,0 +227,0.08202264457941055,0.0857001543045044,0.08490781486034393,0.17493589222431183,951.5281982421875,1e-05,0.07605373859405518,5.693021774291992,15.555093765258789,0 +228,0.10909278690814972,0.20703214406967163,0.2121550291776657,0.12565705180168152,995.9349365234375,1e-05,0.08913758397102356,5.696819305419922,15.555093765258789,0 +229,0.06754323095083237,0.0853205993771553,0.0899823009967804,0.10787659883499146,965.3915405273438,1e-05,0.08913469314575195,5.6837077140808105,15.555093765258789,0 +230,0.05219224467873573,0.10310813039541245,0.10286660492420197,0.19970351457595825,872.5845947265625,1e-05,0.06527013331651688,5.683384418487549,15.555093765258789,0 +231,0.05177278444170952,0.056481748819351196,0.056184832006692886,0.08094550669193268,777.9456176757812,1e-05,0.07784059643745422,5.686133861541748,15.555093765258789,0 +232,0.16975559294223785,0.21362702548503876,0.20302873849868774,0.2503044903278351,974.9119873046875,1e-05,0.10198874026536942,5.688725233078003,15.555093765258789,0 +233,0.09491358697414398,0.08810711652040482,0.08570318669080734,0.1756249964237213,776.5151977539062,1e-05,0.09537869691848755,5.681294679641724,15.555093765258789,0 +234,0.09827366471290588,0.15067018568515778,0.1476696878671646,0.17121794819831848,939.9801635742188,1e-05,0.09377340972423553,5.796651363372803,15.555093765258789,0 +235,0.14216876029968262,0.22074967622756958,0.2215310037136078,0.16284453868865967,998.592041015625,1e-05,0.10560420155525208,5.680871248245239,15.555093765258789,0 +236,0.08761557191610336,0.11228770762681961,0.10187055170536041,0.20484775304794312,928.828369140625,1e-05,0.08265168219804764,5.67650294303894,15.555093765258789,0 +237,0.10024791955947876,0.06029621511697769,0.057089004665613174,0.2198076844215393,759.419189453125,1e-05,0.09930721670389175,5.691421985626221,15.555093765258789,0 +238,0.10025696456432343,0.05540747195482254,0.05947403237223625,0.22432690858840942,642.0233154296875,1e-05,0.09495127201080322,5.68665623664856,15.555093765258789,0 +239,0.07630162686109543,0.09159822016954422,0.11098494380712509,0.2276282012462616,204.84951782226562,1e-05,0.107027567923069,5.685934782028198,15.555093765258789,0 +240,0.10063263773918152,0.09341998398303986,0.09341408312320709,0.22669069468975067,511.2293395996094,1e-05,0.08987431228160858,5.682801008224487,15.555093765258789,0 +241,0.17005214095115662,0.0917961373925209,0.08282172679901123,0.19315704703330994,369.71832275390625,1e-05,0.12235361337661743,5.682209730148315,15.555093765258789,0 +242,0.05812106654047966,0.1257515400648117,0.11735495179891586,0.11121794581413269,928.828369140625,1e-05,0.10180305689573288,5.686501979827881,15.555093765258789,0 +243,0.08107639849185944,0.03758462518453598,0.03702078387141228,0.1205689087510109,761.7188110351562,1e-05,0.10222019255161285,5.684554576873779,15.555093765258789,0 +244,0.1677694469690323,0.11230751127004623,0.10893183201551437,0.2954086363315582,391.4835205078125,1e-05,0.12499997764825821,5.919459342956543,15.555093765258789,0 +245,0.09730831533670425,0.09789372235536575,0.10413286089897156,0.265360563993454,317.1641845703125,1e-05,0.09306419640779495,5.6957807540893555,15.555093765258789,0 +246,0.13764528930187225,0.2345946878194809,0.23430544137954712,0.24520832300186157,218.64686584472656,1e-05,0.09651245921850204,5.688629865646362,15.555093765258789,0 +247,0.12233474850654602,0.052522167563438416,0.06292504817247391,0.20770832896232605,984.2687377929688,1e-05,0.08961505442857742,5.701649904251099,15.555093765258789,0 +248,0.11095381528139114,0.08736720681190491,0.08248085528612137,0.3261057436466217,629.9603271484375,1e-05,0.09224005788564682,5.694390773773193,15.555093765258789,0 +249,0.12631691992282867,0.26600372791290283,0.2639710307121277,0.19612979888916016,179.79454040527344,1e-05,0.08986009657382965,5.685725927352905,15.555093765258789,0 +250,0.07554128021001816,0.13070611655712128,0.12064748257398605,0.21107371151447296,319.94049072265625,1e-05,0.0860435888171196,5.698082208633423,15.555093765258789,0 +251,0.1280667781829834,0.09830872714519501,0.09835579246282578,0.23999999463558197,518.14990234375,1e-05,0.0826290175318718,5.686372756958008,15.555093765258789,0 +252,0.0812867134809494,0.08106312155723572,0.07824911922216415,0.251153826713562,837.7308349609375,1e-05,0.09895074367523193,5.697124719619751,15.555093765258789,0 +253,0.115183986723423,0.08997752517461777,0.08568492531776428,0.25185897946357727,521.561767578125,1e-05,0.093059241771698,5.693695783615112,15.555093765258789,0 +254,0.09385094046592712,0.12188738584518433,0.12048624455928802,0.18931891024112701,847.8120727539062,1e-05,0.08223796635866165,5.6960132122039795,15.555093765258789,0 +255,0.11963583528995514,0.06733030825853348,0.06477191299200058,0.2591346204280853,609.6311645507812,1e-05,0.0812406986951828,5.727506399154663,15.555093765258789,0 +256,0.09312286972999573,0.09892173856496811,0.09309642761945724,0.24902242422103882,947.775634765625,1e-05,0.06497553735971451,5.694210529327393,15.555093765258789,0 +257,0.05962361395359039,0.06383790820837021,0.06420429050922394,0.25631409883499146,608.3162231445312,1e-05,0.0961034968495369,5.692168951034546,15.555093765258789,0 +258,0.11462289839982986,0.07820982486009598,0.07872867584228516,0.26444709300994873,894.8863525390625,1e-05,0.07224884629249573,5.694179534912109,15.555093765258789,0 +259,0.11430764943361282,0.09838447719812393,0.09514618664979935,0.26374998688697815,772.9007568359375,1e-05,0.08430847525596619,5.692676067352295,15.555093765258789,0 +260,0.10598926991224289,0.04522212594747543,0.04855286329984665,0.14282050728797913,640.8381958007812,1e-05,0.06686054170131683,5.692238092422485,15.555093765258789,0 +261,0.12135419994592667,0.06359082460403442,0.0627405196428299,0.1951362043619156,621.2273559570312,1e-05,0.07923492044210434,5.68925142288208,15.555093765258789,0 +262,0.06295859813690186,0.06851576268672943,0.06454651057720184,0.2247435748577118,880.177490234375,1e-05,0.07748778164386749,5.691979646682739,15.555093765258789,0 +263,0.07591918855905533,0.12025762349367142,0.11179271340370178,0.2591506242752075,920.358642578125,1e-05,0.0864042341709137,5.6931312084198,15.555093765258789,0 +264,0.06917741149663925,0.08639290183782578,0.08515618741512299,0.22141826152801514,557.0953369140625,1e-05,0.07462433725595474,5.689857244491577,15.555093765258789,0 +265,0.1366593837738037,0.08333238214254379,0.08220645785331726,0.24712339043617249,893.6715698242188,1e-05,0.08206220716238022,5.903167963027954,15.555093765258789,0 +266,0.056319594383239746,0.07297241687774658,0.06912348419427872,0.23692306876182556,652.4856567382812,1e-05,0.0751834511756897,5.95521879196167,15.555093765258789,0 +267,0.10379607230424881,0.12089142203330994,0.13430826365947723,0.20896634459495544,979.2027587890625,1e-05,0.08256059885025024,5.702844619750977,15.555093765258789,0 +268,0.09770423173904419,0.14582876861095428,0.13466200232505798,0.22967948019504547,981.0671997070312,1e-05,0.10043098777532578,5.699801206588745,15.555093765258789,0 +269,0.12818531692028046,0.0932176485657692,0.08418343961238861,0.1632051169872284,958.7605590820312,1e-05,0.07742806524038315,5.696314811706543,15.555093765258789,0 +270,0.1005200520157814,0.08248018473386765,0.07721426337957382,0.2306249886751175,862.7633056640625,1e-05,0.06232117861509323,5.697310209274292,15.555093765258789,0 +271,0.08100059628486633,0.030638251453638077,0.03404202684760094,0.13952723145484924,566.1925659179688,1e-05,0.07470254600048065,5.698354005813599,15.555093765258789,0 +272,0.10238755494356155,0.08783455193042755,0.0852208286523819,0.20665864646434784,929.1580810546875,1e-05,0.08750198781490326,5.701638460159302,15.555093765258789,0 +273,0.11697568744421005,0.13310226798057556,0.12916594743728638,0.2519070506095886,980.6033935546875,1e-05,0.10804584622383118,5.695563316345215,15.555093765258789,0 +274,0.12175025790929794,0.19341178238391876,0.1837272047996521,0.290689080953598,956.8480224609375,1e-05,0.08036542683839798,5.696179628372192,15.555093765258789,0 +275,0.12269476801156998,0.120017871260643,0.11892911046743393,0.21618588268756866,576.5086669921875,1e-05,0.07953694462776184,5.693607807159424,15.555093765258789,0 +276,0.08883990347385406,0.7261133193969727,0.7244369387626648,0.199559286236763,43.43629455566406,1e-05,0.08689191192388535,5.835970878601074,15.555093765258789,0 +277,0.1538124829530716,0.0818370059132576,0.08455131202936172,0.23641826212406158,627.4900512695312,1e-05,0.06771675497293472,5.687970161437988,15.555093765258789,0 +278,0.13009582459926605,0.11573116481304169,0.11481316387653351,0.21098557114601135,880.6146240234375,1e-05,0.09225411713123322,5.686690807342529,15.555093765258789,0 +279,0.1217702105641365,0.09299339354038239,0.09044622629880905,0.19780448079109192,971.7275390625,1e-05,0.08568737655878067,5.687224388122559,15.555093765258789,0 +280,0.16161976754665375,0.6124302744865417,0.6191450953483582,0.1266506314277649,48.076927185058594,1e-05,0.06694649904966354,5.685661554336548,15.555093765258789,0 +281,0.1171385645866394,0.30916938185691833,0.3087070882320404,0.23647435009479523,157.3426513671875,1e-05,0.07433193922042847,5.687660455703735,15.555093765258789,0 +282,0.07990007102489471,0.10223846137523651,0.09851482510566711,0.15842948853969574,845.7308959960938,1e-05,0.08504313975572586,5.694547891616821,15.555093765258789,0 +283,0.1344066560268402,0.275424987077713,0.27124154567718506,0.24330928921699524,232.08470153808594,1e-05,0.08775702118873596,5.68865180015564,15.555093765258789,0 +284,0.04832268878817558,0.11661379039287567,0.10672015696763992,0.2429487109184265,974.1835327148438,1e-05,0.06743449717760086,5.683480262756348,15.555093765258789,0 +285,0.10654155910015106,0.12556885182857513,0.12205750495195389,0.21699517965316772,918.6107788085938,1e-05,0.07268770784139633,5.68672513961792,15.555093765258789,0 +286,0.0762595385313034,0.15415045619010925,0.1503780037164688,0.21955128014087677,257.9365234375,1e-05,0.07023480534553528,5.691704511642456,15.555093765258789,0 +287,0.11423074454069138,0.046175990253686905,0.040795568376779556,0.16411057114601135,868.9024658203125,1e-05,0.07509098947048187,5.696293830871582,15.555093765258789,0 +288,0.08910004049539566,0.07632414996623993,0.07774300873279572,0.1878765970468521,544.5823974609375,1e-05,0.07180675119161606,5.916043281555176,15.555093765258789,0 +289,0.07861503213644028,0.09445157647132874,0.08562159538269043,0.24205127358436584,843.6281127929688,1e-05,0.08009115606546402,5.68194580078125,15.555093765258789,0 +290,0.03535230830311775,0.046762753278017044,0.046789128333330154,0.20316505432128906,896.4932861328125,1e-05,0.057183705270290375,5.680526971817017,15.555093765258789,0 +291,0.10794349759817123,0.07714845985174179,0.07823767513036728,0.25447115302085876,912.8910522460938,1e-05,0.07210094481706619,5.681735038757324,15.555093765258789,0 +292,0.07216205447912216,0.0832803025841713,0.08227236568927765,0.19210736453533173,909.5860595703125,1e-05,0.0756843239068985,5.683753728866577,15.555093765258789,0 +293,0.12882018089294434,0.09313604235649109,0.09459618479013443,0.1782371699810028,396.1748962402344,1e-05,0.08069548010826111,5.677542448043823,15.555093765258789,0 +294,0.07278735935688019,0.09040796011686325,0.08974167704582214,0.18752403557300568,925.1558837890625,1e-05,0.06376650929450989,5.685914754867554,15.555093765258789,0 +295,0.07984661310911179,0.068662129342556,0.07200736552476883,0.2770031988620758,460.8586120605469,1e-05,0.07461696118116379,5.6853978633880615,15.555093765258789,0 +296,0.059583865106105804,0.4842517673969269,0.4660536050796509,0.263982355594635,994.89794921875,1e-05,0.08093294501304626,5.6841723918914795,15.555093765258789,0 +297,0.12804891169071198,0.09751581400632858,0.09200768917798996,0.1826842874288559,948.9403076171875,1e-05,0.0944979339838028,5.70457911491394,15.555093765258789,0 +298,0.08932331204414368,0.060482207685709,0.06378976255655289,0.22990383207798004,780.78076171875,1e-05,0.08859357982873917,5.683902740478516,15.555093765258789,0 +299,0.1273988038301468,0.10022097080945969,0.09770164638757706,0.22709134221076965,889.5617065429688,1e-05,0.05650124326348305,5.686521053314209,15.555093765258789,0 +300,0.11088819801807404,0.07869266718626022,0.07345125079154968,0.25111377239227295,605.6701049804688,1e-05,0.07253384590148926,5.680007696151733,15.555093765258789,0 +301,0.09215456247329712,0.1545426994562149,0.15966765582561493,0.22918269038200378,985.1694946289062,1e-05,0.06660258769989014,5.686192274093628,15.555093765258789,0 +302,0.08815920352935791,0.47449296712875366,0.486631840467453,0.11761217564344406,61.78706741333008,1e-05,0.07127518206834793,5.683127164840698,15.555093765258789,0 +303,0.13927710056304932,0.11285866796970367,0.1101490780711174,0.2273477464914322,580.8350830078125,1e-05,0.09143329411745071,5.686899900436401,15.555093765258789,0 +304,0.12158285081386566,0.06480574607849121,0.06258382648229599,0.24202723801136017,644.3798828125,1e-05,0.08438652753829956,5.6891560554504395,15.555093765258789,0 +305,0.1103578507900238,0.06691138446331024,0.06346505135297775,0.23993588984012604,760.1881103515625,1e-05,0.08095850795507431,5.683228492736816,15.555093765258789,0 +306,0.08679364621639252,0.10503313690423965,0.09241874516010284,0.2555208206176758,935.9296264648438,1e-05,0.05098328739404678,5.689266681671143,15.555093765258789,0 +307,0.09342481940984726,0.12565132975578308,0.11477027833461761,0.23867787420749664,968.7218017578125,1e-05,0.07921066880226135,5.685598850250244,15.555093765258789,0 +308,0.08416683971881866,0.06455791741609573,0.06475343555212021,0.13277243077754974,894.8863525390625,1e-05,0.0698995515704155,5.908145427703857,15.555093765258789,0 +309,0.04216224327683449,0.06733343750238419,0.06685585528612137,0.06818109005689621,319.94049072265625,1e-05,0.07023859769105911,5.697810649871826,15.555093765258789,0 +310,0.09895750135183334,0.06273984163999557,0.06445327401161194,0.1767868548631668,743.5170288085938,1e-05,0.08142450451850891,5.693206071853638,15.555093765258789,0 +311,0.11474970728158951,0.10103388130664825,0.10205322504043579,0.2948317229747772,450.76727294921875,1e-05,0.08833036571741104,5.6926844120025635,15.555093765258789,0 +312,0.09629352390766144,0.08337348699569702,0.0836707130074501,0.16019229590892792,523.2557983398438,1e-05,0.07425373047590256,5.693840026855469,15.555093765258789,0 +313,0.1678180694580078,0.11565598100423813,0.10902633517980576,0.26713138818740845,888.7283325195312,1e-05,0.0922345519065857,5.6918580532073975,15.555093765258789,0 +314,0.09345309436321259,0.10652712732553482,0.10331317782402039,0.2395833283662796,744.3366088867188,1e-05,0.06429225951433182,5.699506759643555,15.555093765258789,0 +315,0.11708438396453857,0.44218865036964417,0.4366668462753296,0.2243509590625763,75.18797302246094,1e-05,0.07662001997232437,5.697297096252441,15.555093765258789,0 +316,0.10860449075698853,0.08907525986433029,0.09024466574192047,0.20770031213760376,646.7181396484375,1e-05,0.08251546323299408,5.689200162887573,15.555093765258789,0 +317,0.11313649266958237,0.1722647100687027,0.1609835922718048,0.2146073579788208,964.0897216796875,1e-05,0.0686926543712616,5.690893650054932,15.555093765258789,0 +318,0.0627920925617218,0.11683211475610733,0.11640200763940811,0.2217467874288559,833.8881225585938,1e-05,0.054500579833984375,5.694066286087036,15.555093765258789,0 +319,0.09243085235357285,0.06479734182357788,0.06600029766559601,0.24975959956645966,723.0185546875,1e-05,0.06500959396362305,5.704279184341431,15.555093765258789,0 +320,0.07473006099462509,0.07211177051067352,0.06839007139205933,0.1914663463830948,866.0933227539062,1e-05,0.10551779717206955,5.695939540863037,15.555093765258789,0 +321,0.07954203337430954,0.1378595232963562,0.13211074471473694,0.2576282024383545,970.48291015625,1e-05,0.07502252608537674,5.693434715270996,15.555093765258789,0 +322,0.0627305805683136,0.06738150864839554,0.06397270411252975,0.22770030796527863,960.6482543945312,1e-05,0.08136605471372604,5.690612316131592,15.555093765258789,0 +323,0.06591605395078659,0.25609084963798523,0.2460784614086151,0.24328525364398956,998.3897094726562,1e-05,0.1065070703625679,5.6946868896484375,15.555093765258789,0 +324,0.08812511712312698,0.25477778911590576,0.22515413165092468,0.24831730127334595,994.4806518554688,1e-05,0.08460379391908646,5.701021909713745,15.555093765258789,0 +325,0.04141289368271828,0.31144553422927856,0.28597429394721985,0.26479166746139526,997.3726806640625,1e-05,0.079130157828331,5.705459833145142,15.555093765258789,0 +326,0.1355246603488922,0.0927690640091896,0.09672226756811142,0.2773076891899109,971.23095703125,1e-05,0.1001214012503624,5.694183349609375,15.555093765258789,0 +327,0.07022596150636673,0.10789969563484192,0.09770458936691284,0.2587660253047943,906.2156372070312,1e-05,0.08506917953491211,5.691212892532349,15.555093765258789,0 +328,0.10399631410837173,0.1564314216375351,0.15956582129001617,0.2087259590625763,975.3954467773438,1e-05,0.08433793485164642,5.859362602233887,15.555093765258789,0 +329,0.08871221542358398,0.11766642332077026,0.11380545794963837,0.2787419855594635,944.2269897460938,1e-05,0.0826869010925293,5.6797990798950195,15.555093765258789,0 +330,0.06316985189914703,0.13798898458480835,0.135390967130661,0.23432691395282745,956.0206298828125,1e-05,0.06749621033668518,5.693169832229614,15.555093765258789,0 +331,0.12248556315898895,0.051373980939388275,0.05526271462440491,0.26865383982658386,824.8300170898438,1e-05,0.06883393228054047,5.692737817764282,15.555093765258789,0 +332,0.07100656628608704,0.13203862309455872,0.12643271684646606,0.10449519008398056,918.6107788085938,1e-05,0.05976865813136101,5.695255517959595,15.555093765258789,0 +333,0.10685721039772034,0.07984880357980728,0.08029752224683762,0.20521633327007294,753.9683227539062,1e-05,0.08866972476243973,5.699820518493652,15.555093765258789,0 +334,0.057827021926641464,0.1465889811515808,0.13803240656852722,0.21911056339740753,984.0426025390625,1e-05,0.06892215460538864,5.68447470664978,15.555093765258789,0 +335,0.09462134540081024,0.07613576203584671,0.07311265170574188,0.2131570428609848,590.71728515625,1e-05,0.0683295726776123,5.68534779548645,15.555093765258789,0 +336,0.11614219844341278,0.043597422540187836,0.045152448117733,0.11195512115955353,953.7914428710938,1e-05,0.12477829307317734,5.70404577255249,15.555093765258789,0 +337,0.09314452111721039,0.1649732142686844,0.16853289306163788,0.1780528724193573,208.3333282470703,1e-05,0.06863021850585938,5.699409484863281,15.555093765258789,0 +338,0.04356907308101654,0.16482099890708923,0.159149169921875,0.27068910002708435,953.7914428710938,1e-05,0.0742092877626419,5.692826986312866,15.555093765258789,0 +339,0.09999914467334747,0.07591240108013153,0.07753870636224747,0.20749197900295258,887.0499877929688,1e-05,0.08510547131299973,5.690286874771118,15.555093765258789,0 +340,0.09498750418424606,0.16080696880817413,0.161456897854805,0.2636938989162445,972.4690551757812,1e-05,0.06127545237541199,5.794324636459351,15.555093765258789,0 +341,0.1414763480424881,0.08382518589496613,0.08155704289674759,0.2560977339744568,665.8878784179688,1e-05,0.06578206270933151,5.681337356567383,15.555093765258789,0 +342,0.038179781287908554,0.2578699290752411,0.25068792700767517,0.20250800251960754,993.4319458007812,1e-05,0.07485383749008179,5.686900615692139,15.555093765258789,0 +343,0.11421841382980347,0.10080473870038986,0.09423866868019104,0.19634614884853363,706.521728515625,1e-05,0.07153142243623734,5.6897358894348145,15.555093765258789,0 +344,0.08403412252664566,0.07054247707128525,0.06926406919956207,0.25026440620422363,907.7218017578125,1e-05,0.059039972722530365,5.692614555358887,15.555093765258789,0 +345,0.09355520457029343,0.07837504893541336,0.08466031402349472,0.14887820184230804,338.9212646484375,1e-05,0.08489164710044861,5.689143896102905,15.555093765258789,0 +346,0.11796844005584717,0.07845444977283478,0.07665841281414032,0.25823718309402466,434.0730895996094,1e-05,0.08174256235361099,5.685964584350586,15.555093765258789,0 +347,0.07581846415996552,0.081688791513443,0.07923812419176102,0.2516586482524872,821.9178466796875,1e-05,0.0779745876789093,5.686193466186523,15.555093765258789,0 +348,0.07810424268245697,0.13779056072235107,0.1312081217765808,0.23609775304794312,939.9801635742188,1e-05,0.06717342883348465,5.68425178527832,15.555093765258789,0 +349,0.14411821961402893,0.05037861317396164,0.048504333943128586,0.26895031332969666,612.2449340820312,1e-05,0.0776253268122673,5.693426609039307,15.555093765258789,0 +350,0.11245404183864594,0.1731594353914261,0.16922804713249207,0.2536458373069763,971.9750366210938,1e-05,0.07051243633031845,5.69062066078186,15.555093765258789,0 +351,0.13785621523857117,0.09174730628728867,0.09215748310089111,0.14075319468975067,753.9683227539062,1e-05,0.06822603940963745,5.6867804527282715,15.555093765258789,0 +352,0.11104215681552887,0.10242003202438354,0.09114561975002289,0.23334133625030518,885.3558349609375,1e-05,0.07177983224391937,5.68658447265625,15.555093765258789,0 +353,0.0765770971775055,0.13146138191223145,0.13230180740356445,0.21462339162826538,955.4664916992188,1e-05,0.06635552644729614,5.683288097381592,15.555093765258789,0 +354,0.1200551837682724,0.16261890530586243,0.1613054871559143,0.2108333259820938,414.4384765625,1e-05,0.10446867346763611,5.6859047412872314,15.555093765258789,0 +355,0.09168101847171783,0.0999680832028389,0.09917934238910675,0.18019230663776398,869.3666381835938,1e-05,0.06853684782981873,5.686970949172974,15.555093765258789,0 +356,0.10740971565246582,0.11186673492193222,0.107246994972229,0.25922274589538574,843.6281127929688,1e-05,0.06710578501224518,5.6845409870147705,15.555093765258789,0 +357,0.10956056416034698,0.08908847719430923,0.0891939103603363,0.2974839508533478,666.9776611328125,1e-05,0.072552889585495,5.68241024017334,15.555093765258789,0 +358,0.1464644968509674,0.08079852908849716,0.07476582378149033,0.25475960969924927,873.039794921875,1e-05,0.12336064130067825,5.691890478134155,15.555093765258789,0 +359,0.08519894629716873,0.05609895661473274,0.05762006342411041,0.2153846025466919,458.8607482910156,1e-05,0.06491788476705551,5.685626745223999,15.555093765258789,0 +360,0.05982312560081482,0.07845707982778549,0.07075776159763336,0.2353445440530777,673.4317626953125,1e-05,0.10146305710077286,5.968682050704956,15.555093765258789,0 +361,0.09860225021839142,0.060621194541454315,0.060213539749383926,0.1825801283121109,614.83740234375,1e-05,0.11479170620441437,5.699021339416504,15.555093765258789,0 +362,0.0752958431839943,0.0498872734606266,0.050948046147823334,0.07287660241127014,659.2627563476562,1e-05,0.05943465977907181,5.701451539993286,15.555093765258789,0 +363,0.08488873392343521,0.09722550213336945,0.09899550676345825,0.26722756028175354,876.6427001953125,1e-05,0.08725709468126297,5.69121527671814,15.555093765258789,0 +364,0.13553518056869507,0.08734259754419327,0.08577447384595871,0.2462499886751175,572.1257934570312,1e-05,0.11205199360847473,5.7016496658325195,15.555093765258789,0 +365,0.10598140954971313,0.06118309497833252,0.07298928499221802,0.22874197363853455,273.4375,1e-05,0.07643505185842514,5.687311410903931,15.555093765258789,0 +366,0.0898699164390564,0.0999048724770546,0.10027264803647995,0.09252403676509857,919.3121948242188,1e-05,0.0728730782866478,5.695215940475464,15.555093765258789,0 +367,0.1149538904428482,0.0849820226430893,0.08157414197921753,0.2627163231372833,518.14990234375,1e-05,0.15455970168113708,5.69309139251709,15.555093765258789,0 +368,0.046413641422986984,0.08308284729719162,0.07532621920108795,0.2861458361148834,920.358642578125,1e-05,0.09152834862470627,5.695098400115967,15.555093765258789,0 +369,0.08973732590675354,0.0746118351817131,0.07355280965566635,0.1466025561094284,549.327392578125,1e-05,0.09518655389547348,5.907168626785278,15.555093765258789,0 +370,0.06998778134584427,0.08634334802627563,0.08705948293209076,0.1509535163640976,921.7437133789062,1e-05,0.11963196098804474,5.701295852661133,15.555093765258789,0 +371,0.13782992959022522,0.11729461699724197,0.113175168633461,0.2851282060146332,767.0015869140625,1e-05,0.09088140726089478,5.800755977630615,15.555093765258789,0 +372,0.11327991634607315,0.1250769942998886,0.12174190580844879,0.23391024768352509,923.1171264648438,1e-05,0.06243716552853584,5.693373680114746,15.555093765258789,0 +373,0.05972420424222946,0.07689090818166733,0.07331180572509766,0.26354166865348816,876.6427001953125,1e-05,0.08494497835636139,5.691801309585571,15.555093765258789,0 +374,0.07044359296560287,0.06478173285722733,0.06311361491680145,0.25893428921699524,717.632080078125,1e-05,0.08320660144090652,5.694350719451904,15.555093765258789,0 +375,0.06263334304094315,0.1623973250389099,0.16437172889709473,0.18483172357082367,959.0316162109375,1e-05,0.06518488377332687,5.688967943191528,15.555093765258789,0 +376,0.07366546243429184,0.033020615577697754,0.032124217599630356,0.2332131266593933,829.9730834960938,1e-05,0.0837010070681572,5.7022552490234375,15.555093765258789,0 +377,0.14950357377529144,0.5801728963851929,0.5929960012435913,0.2945833206176758,52.6819953918457,1e-05,0.11031270027160645,5.697995185852051,15.555093765258789,0 +378,0.06881437450647354,0.07722387462854385,0.07094095647335052,0.230705127120018,770.7055053710938,1e-05,0.13357828557491302,5.686278820037842,15.555093765258789,0 +379,0.06001173332333565,0.1034327894449234,0.09428630769252777,0.22196313738822937,909.21484375,1e-05,0.06513519585132599,5.694877624511719,15.555093765258789,0 +380,0.08233020454645157,0.09404376894235611,0.09523634612560272,0.12002403289079666,967.9602661132812,1e-05,0.09434028714895248,5.6892311573028564,15.555093765258789,0 +381,0.15091663599014282,0.08550814539194107,0.08678693324327469,0.22393429279327393,924.81787109375,1e-05,0.13041245937347412,5.693272590637207,15.555093765258789,0 +382,0.1129116415977478,0.07032445818185806,0.06599961966276169,0.24533653259277344,521.561767578125,1e-05,0.08404143899679184,5.913228511810303,15.555093765258789,0 +383,0.09332990646362305,0.11665808409452438,0.11426068842411041,0.17724359035491943,576.5086669921875,1e-05,0.08052722364664078,5.697122097015381,15.555093765258789,0 +384,0.12319393455982208,0.13749586045742035,0.14076362550258636,0.2005208283662796,314.37127685546875,1e-05,0.09869188815355301,5.685601234436035,15.555093765258789,0 +385,0.09834308177232742,0.0680602416396141,0.06420180201530457,0.19247595965862274,859.8626708984375,1e-05,0.08679667860269547,5.693321943283081,15.555093765258789,0 +386,0.09372099488973618,0.10596733540296555,0.10408536344766617,0.19504006206989288,907.3464965820312,1e-05,0.07863208651542664,5.691296100616455,15.555093765258789,0 +387,0.11189896613359451,0.0712602362036705,0.07099992036819458,0.25100159645080566,533.2568969726562,1e-05,0.07799369096755981,5.696612596511841,15.555093765258789,0 +388,0.10485280305147171,0.10203873366117477,0.09513789415359497,0.28825318813323975,721.2352294921875,1e-05,0.0813727080821991,5.68922758102417,15.555093765258789,0 +389,0.0803845003247261,0.0904955342411995,0.08924663811922073,0.22455929219722748,964.3510131835938,1e-05,0.08120539039373398,5.68833589553833,15.555093765258789,0 +390,0.0653790757060051,0.0864609107375145,0.08298628777265549,0.236298069357872,746.7793579101562,1e-05,0.07619189471006393,5.696474313735962,15.555093765258789,0 +391,0.1342819333076477,0.07461503893136978,0.07322707027196884,0.1250160187482834,842.0365600585938,1e-05,0.08696404844522476,5.694045543670654,15.555093765258789,0 +392,0.09974021464586258,0.11391353607177734,0.10813988000154495,0.25149038434028625,961.9814453125,1e-05,0.06474018841981888,5.858210802078247,15.555093765258789,0 +393,0.12008467316627502,0.3632220923900604,0.3592769503593445,0.21062499284744263,137.90036010742188,1e-05,0.08152911067008972,5.700034856796265,15.555093765258789,0 +394,0.08505313098430634,0.08770426362752914,0.08538050949573517,0.28556087613105774,487.8049011230469,1e-05,0.08946795016527176,5.703584909439087,15.555093765258789,0 +395,0.12486504763364792,0.22094762325286865,0.21278341114521027,0.19228364527225494,988.2747802734375,1e-05,0.08024869859218597,5.694461107254028,15.555093765258789,0 +396,0.10726181417703629,0.3138660192489624,0.3100925087928772,0.12004807591438293,995.10595703125,1e-05,0.07892947643995285,5.6876256465911865,15.555093765258789,0 +397,0.07357501238584518,0.07379850000143051,0.07047700881958008,0.12842147052288055,876.6427001953125,1e-05,0.08170606195926666,5.694925308227539,15.555093765258789,0 +398,0.11591269820928574,0.12027440220117569,0.11817900091409683,0.15169070661067963,346.82080078125,1e-05,0.0799255222082138,5.693789482116699,15.555093765258789,0 +399,0.07624874264001846,0.04312619939446449,0.045922089368104935,0.13287660479545593,482.1867370605469,1e-05,0.07719031721353531,5.70427393913269,15.555093765258789,0 +400,0.10974445194005966,0.12681876122951508,0.12489456683397293,0.23481570184230804,763.2398681640625,1e-05,0.07412153482437134,5.848447799682617,15.555093765258789,0 +401,0.12045204639434814,0.06688900291919708,0.06544673442840576,0.2277163416147232,769.2307739257812,1e-05,0.08714663237333298,5.691313982009888,15.555093765258789,0 +402,0.10971154272556305,0.19228316843509674,0.19225528836250305,0.23387017846107483,984.7198486328125,1e-05,0.08448296785354614,5.698545455932617,15.555093765258789,0 +403,0.09391215443611145,0.1044662818312645,0.10496078431606293,0.15356570482254028,592.105224609375,1e-05,0.09408986568450928,5.690126419067383,15.555093765258789,0 +404,0.09481409192085266,0.04972738400101662,0.04932186007499695,0.14706730842590332,549.327392578125,1e-05,0.09666791558265686,5.696945905685425,15.555093765258789,0 +405,0.08450926095247269,0.0683046281337738,0.0662933811545372,0.20526441931724548,853.9290161132812,1e-05,0.09617654979228973,5.688858985900879,15.555093765258789,0 +406,0.10567565262317657,0.06614314019680023,0.06274136900901794,0.25401440262794495,877.5327758789062,1e-05,0.08251893520355225,5.686464309692383,15.555093765258789,0 +407,0.05806470289826393,0.09691738337278366,0.09816975891590118,0.1335897445678711,948.3590698242188,1e-05,0.0714450404047966,5.6909568309783936,15.555093765258789,0 +408,0.07952695339918137,0.07226306945085526,0.06732460856437683,0.28131410479545593,818.3701782226562,1e-05,0.08986710011959076,5.688631534576416,15.555093765258789,0 +409,0.11398640275001526,0.06762950867414474,0.06720065325498581,0.17123396694660187,618.6868286132812,1e-05,0.09136290848255157,5.690008163452148,15.555093765258789,0 +410,0.08985629677772522,0.064900703728199,0.06333771347999573,0.2562499940395355,901.2276611328125,1e-05,0.0809614434838295,5.873101234436035,15.555093765258789,0 +411,0.09583070874214172,0.06949413567781448,0.06766916066408157,0.23324517905712128,596.2343139648438,1e-05,0.07971794903278351,5.6909568309783936,15.555093765258789,0 +412,0.06297580897808075,0.1893957257270813,0.19020575284957886,0.12403044104576111,983.5890502929688,1e-05,0.07480799406766891,5.689172029495239,15.555093765258789,0 +413,0.07312393188476562,0.2544768452644348,0.23094716668128967,0.19254806637763977,998.9959716796875,1e-05,0.07377327978610992,5.951745510101318,15.555093765258789,0 +414,0.11197491735219955,0.08754023909568787,0.08515036851167679,0.20491985976696014,888.7283325195312,1e-05,0.07311277836561203,5.6898353099823,15.555093765258789,0 +415,0.10051225870847702,0.07834548503160477,0.07042993605136871,0.18040063977241516,718.5374145507812,1e-05,0.09693793207406998,5.6820104122161865,15.555093765258789,0 +416,0.10347798466682434,0.0893707424402237,0.08662322908639908,0.2526842951774597,934.0242309570312,1e-05,0.08800774812698364,5.687379837036133,15.555093765258789,0 +417,0.09712105244398117,0.10394664853811264,0.10033559799194336,0.22423876821994781,442.5064697265625,1e-05,0.09112218767404556,5.681772708892822,15.555093765258789,0 +418,0.06368400156497955,0.10536741465330124,0.10222166031599045,0.24553684890270233,951.5281982421875,1e-05,0.08165449649095535,5.686649799346924,15.555093765258789,0 +419,0.07788685709238052,0.08281158655881882,0.07855518907308578,0.20180287957191467,912.8910522460938,1e-05,0.07062613219022751,5.68141770362854,15.555093765258789,0 +420,0.10210629552602768,0.06083735078573227,0.0601789616048336,0.25130608677864075,555.5556030273438,1e-05,0.09420659393072128,5.684479236602783,15.555093765258789,0 +421,0.06762227416038513,0.049651820212602615,0.052508823573589325,0.17317306995391846,403.11651611328125,1e-05,0.07171567529439926,5.8977625370025635,15.555093765258789,0 +422,0.12043949961662292,0.08608110249042511,0.09097903966903687,0.2819471061229706,712.13427734375,1e-05,0.0931888297200203,5.682976245880127,15.555093765258789,0 +423,0.1029863953590393,0.10348935425281525,0.09958253055810928,0.17258813977241516,886.6278686523438,1e-05,0.07454614341259003,5.69244384765625,15.555093765258789,0 +424,0.08759782463312149,0.0354357473552227,0.03812719136476517,0.12419070303440094,743.5170288085938,1e-05,0.08840946108102798,5.8849241733551025,15.555093765258789,0 +425,0.13032881915569305,0.061508528888225555,0.059293024241924286,0.258653849363327,686.9369506835938,1e-05,0.10707075893878937,5.686669588088989,15.555093765258789,0 +426,0.0812644362449646,0.059773001819849014,0.06003429368138313,0.26094549894332886,531.6091918945312,1e-05,0.07893908768892288,5.685826539993286,15.555093765258789,0 +427,0.12444259971380234,0.0997248962521553,0.09064116328954697,0.19895032048225403,583.6886596679688,1e-05,0.07547365128993988,5.69194769859314,15.555093765258789,0 +428,0.06914011389017105,0.13473211228847504,0.12379362434148788,0.2609134614467621,962.2467651367188,1e-05,0.07741563767194748,5.689263343811035,15.555093765258789,0 +429,0.10659250617027283,0.15440967679023743,0.15128375589847565,0.21771633625030518,991.3079833984375,1e-05,0.09365740418434143,5.689516544342041,15.555093765258789,0 +430,0.09606806188821793,0.09524539113044739,0.08617497235536575,0.2764182686805725,893.2648315429688,1e-05,0.08934897184371948,5.688133001327515,15.555093765258789,0 +431,0.09167236089706421,0.08866243064403534,0.0871005579829216,0.20480768382549286,823.0874633789062,1e-05,0.09537309408187866,6.100081443786621,15.555093765258789,0 +432,0.11868498474359512,0.06779652833938599,0.06137292459607124,0.22007210552692413,724.7899169921875,1e-05,0.09147508442401886,5.6865057945251465,15.555093765258789,0 +433,0.08878748118877411,0.06695954501628876,0.0641108900308609,0.2564503252506256,672.3660278320312,1e-05,0.08049046993255615,5.686446189880371,15.555093765258789,0 +434,0.05760978162288666,0.07547388970851898,0.07696753740310669,0.15806089341640472,887.8910522460938,1e-05,0.07837706059217453,5.687912225723267,15.555093765258789,0 +435,0.0771624818444252,0.09212265908718109,0.08946546167135239,0.19370992481708527,434.0730895996094,1e-05,0.09669423848390579,5.694500923156738,15.555093765258789,0 +436,0.1255740374326706,0.08295680582523346,0.08087549358606339,0.20093749463558197,736.0197143554688,1e-05,0.07295329123735428,5.696266412734985,15.555093765258789,0 +437,0.07233686000108719,0.09563948214054108,0.09372347593307495,0.21329325437545776,698.8536376953125,1e-05,0.08221612870693207,5.699784517288208,15.555093765258789,0 +438,0.07591693848371506,0.1163373813033104,0.11970622837543488,0.19732370972633362,294.342529296875,1e-05,0.06702396273612976,5.694645881652832,15.555093765258789,0 +439,0.041370783001184464,0.26822134852409363,0.26821044087409973,0.2562499940395355,995.5211791992188,1e-05,0.06279987841844559,5.697651386260986,15.555093765258789,0 +440,0.1257825791835785,0.17767997086048126,0.16897262632846832,0.24254006147384644,961.9814453125,1e-05,0.07767803966999054,5.695218801498413,15.555093765258789,0 +441,0.08566384762525558,0.08205678313970566,0.08050821721553802,0.25025638937950134,464.8240966796875,1e-05,0.07079233229160309,5.6958723068237305,15.555093765258789,0 +442,0.1562405526638031,0.13893356919288635,0.13209791481494904,0.2829967737197876,680.7832641601562,1e-05,0.08973682671785355,5.700959920883179,15.555093765258789,0 +443,0.07390950620174408,0.04607154428958893,0.044707041233778,0.22064101696014404,893.2648315429688,1e-05,0.07299376279115677,5.696129322052002,15.555093765258789,0 +444,0.058223046362400055,0.032640840858221054,0.03686393424868584,0.13758012652397156,450.76727294921875,1e-05,0.07158467173576355,5.825656414031982,15.555093765258789,0 +445,0.09322692453861237,0.11308727413415909,0.11168176680803299,0.30086538195610046,744.3366088867188,1e-05,0.07683096826076508,5.691413164138794,15.555093765258789,0 +446,0.11380931735038757,0.07055247575044632,0.07002298533916473,0.284727543592453,691.9642944335938,1e-05,0.06964170932769775,5.6900954246521,15.555093765258789,0 +447,0.06577618420124054,0.04746424779295921,0.050960738211870193,0.26492786407470703,882.784912109375,1e-05,0.06555675715208054,5.690853595733643,15.555093765258789,0 +448,0.11722971498966217,0.09122133255004883,0.08798261731863022,0.24426281452178955,454.8346252441406,1e-05,0.08627098053693771,5.694173812866211,15.555093765258789,0 +449,0.1309848129749298,0.10909523814916611,0.10331682115793228,0.25333333015441895,874.8499145507812,1e-05,0.09439431130886078,5.689144611358643,15.555093765258789,0 +450,0.09822042286396027,0.06246567144989967,0.06089212745428085,0.24851761758327484,600.3118286132812,1e-05,0.0773586630821228,5.698462963104248,15.555093765258789,0 +451,0.11255248636007309,0.05500409007072449,0.05199790745973587,0.15815705060958862,948.6500244140625,1e-05,0.0582558698952198,5.690965890884399,15.555093765258789,0 +452,0.13315774500370026,0.0846400260925293,0.07947345077991486,0.24791665375232697,505.9523620605469,1e-05,0.0823817253112793,5.690069913864136,15.555093765258789,0 +453,0.08833876997232437,0.06827306002378464,0.0685393288731575,0.20491985976696014,617.4088745117188,1e-05,0.07666362822055817,5.69747519493103,15.555093765258789,0 +454,0.0836009681224823,0.0960530936717987,0.09378314018249512,0.3030368387699127,816.57421875,1e-05,0.07046959549188614,5.692072153091431,15.555093765258789,0 +455,0.07839351147413254,0.09142094105482101,0.08864334225654602,0.14659453928470612,605.6701049804688,1e-05,0.0680215060710907,5.939604043960571,15.555093765258789,0 +456,0.13305729627609253,0.14425380527973175,0.13806341588497162,0.2541666626930237,372.1910095214844,1e-05,0.06908891350030899,5.692205429077148,15.555093765258789,0 +457,0.1103690043091774,0.13791382312774658,0.13003630936145782,0.17122595012187958,969.9821166992188,1e-05,0.0724543109536171,5.690011739730835,15.555093765258789,0 +458,0.08844948559999466,0.057668205350637436,0.057887885719537735,0.10499999672174454,806.1080322265625,1e-05,0.07181335240602493,5.6921608448028564,15.555093765258789,0 +459,0.07923716306686401,0.09657067060470581,0.08860918879508972,0.25342145562171936,633.6292114257812,1e-05,0.07957680523395538,5.696546316146851,15.555093765258789,0 +460,0.0766569972038269,0.07446128129959106,0.07134681195020676,0.2440224289894104,785.6611938476562,1e-05,0.07953797280788422,5.693816900253296,15.555093765258789,0 +461,0.10349280387163162,0.14489448070526123,0.13822494447231293,0.21081730723381042,982.4486694335938,1e-05,0.07151494175195694,5.692959785461426,15.555093765258789,0 +462,0.13824966549873352,0.11226660013198853,0.10154441744089127,0.2516185939311981,939.36376953125,1e-05,0.08138235658407211,5.693152189254761,15.555093765258789,0 +463,0.08263451606035233,0.0976308211684227,0.09299787133932114,0.2813621759414673,931.1224365234375,1e-05,0.0821915790438652,5.9158971309661865,15.555093765258789,0 +464,0.06621497124433517,0.8959553241729736,0.9018362760543823,0.2881169617176056,19.685039520263672,1e-05,0.06972502917051315,5.697598934173584,15.555093765258789,0 +465,0.11330332607030869,0.05517488345503807,0.05117357149720192,0.23145832121372223,659.2627563476562,1e-05,0.06895589828491211,5.687463283538818,15.555093765258789,0 +466,0.11055974662303925,0.0935584157705307,0.08613935112953186,0.2516586482524872,894.0774536132812,1e-05,0.07811762392520905,5.698168754577637,15.555093765258789,0 +467,0.08288462460041046,0.1009579673409462,0.09560620784759521,0.260504812002182,897.6888427734375,1e-05,0.09688278287649155,5.696659803390503,15.555093765258789,0 +468,0.1271502673625946,0.1857157200574875,0.19004866480827332,0.1161217913031578,187.07484436035156,1e-05,0.0728256106376648,5.785277843475342,15.555093765258789,0 +469,0.07000633329153061,0.044382479041814804,0.04869205132126808,0.12950320541858673,794.4606323242188,1e-05,0.0633683130145073,5.688572883605957,15.555093765258789,0 +470,0.06842081993818283,0.08363603800535202,0.08042217046022415,0.28302884101867676,902.0044555664062,1e-05,0.10966470837593079,5.685714960098267,15.555093765258789,0 +471,0.11087162792682648,0.06654507666826248,0.06378518044948578,0.18319711089134216,859.375,1e-05,0.08485592901706696,5.690336465835571,15.555093765258789,0 +472,0.12433820217847824,0.5715914368629456,0.5660784840583801,0.2360096126794815,70.75472259521484,1e-05,0.07805188745260239,5.689809560775757,15.555093765258789,0 +473,0.09516292810440063,0.07241954654455185,0.07273823767900467,0.2689262628555298,784.97021484375,1e-05,0.09909181296825409,5.700284481048584,15.555093765258789,0 +474,0.10113736987113953,0.20559903979301453,0.19498787820339203,0.2657932639122009,235.38963317871094,1e-05,0.06679046154022217,5.697344064712524,15.555093765258789,0 +475,0.09734028577804565,0.18403175473213196,0.18182094395160675,0.12383012473583221,974.6696166992188,1e-05,0.07493098825216293,5.707370042800903,15.555093765258789,0 +476,0.10345117747783661,0.13692550361156464,0.13463157415390015,0.30512017011642456,336.25732421875,1e-05,0.06997691094875336,5.691189765930176,15.555093765258789,0 +477,0.08503764867782593,0.2043527066707611,0.20663250982761383,0.10927082598209381,168.68511962890625,1e-05,0.05721618980169296,5.922166109085083,15.555093765258789,0 +478,0.09456169605255127,0.1478201299905777,0.13780809938907623,0.2575240433216095,957.9439697265625,1e-05,0.07557851076126099,5.6850385665893555,15.555093765258789,0 +479,0.10696692764759064,0.084206223487854,0.08543016761541367,0.20403043925762177,904.3141479492188,1e-05,0.0966443419456482,5.6852195262908936,15.555093765258789,0 +480,0.10566244274377823,0.09260465204715729,0.08506643027067184,0.17020031809806824,794.4606323242188,1e-05,0.07975351810455322,5.694464921951294,15.555093765258789,0 +481,0.11235358566045761,0.09973171353340149,0.09242535382509232,0.2604086399078369,860.8343505859375,1e-05,0.07411635667085648,5.694602727890015,15.555093765258789,0 +482,0.1524873673915863,0.069272480905056,0.06977329403162003,0.22715544700622559,709.3425903320312,1e-05,0.07994461059570312,5.686477899551392,15.555093765258789,0 +483,0.07378733158111572,0.20454245805740356,0.19939474761486053,0.22650639712810516,995.5211791992188,1e-05,0.06483329832553864,5.699283838272095,15.555093765258789,0 +484,0.08953583240509033,0.05448498576879501,0.055092617869377136,0.10084134340286255,707.4652709960938,1e-05,0.07539702206850052,5.689992427825928,15.555093765258789,0 +485,0.1006818488240242,0.053067564964294434,0.05430683493614197,0.16887018084526062,877.0883178710938,1e-05,0.08420593291521072,5.912211179733276,15.555093765258789,0 +486,0.07397544384002686,0.10927245020866394,0.1036340519785881,0.1925080120563507,885.3558349609375,1e-05,0.08872745931148529,5.698312044143677,15.555093765258789,0 +487,0.04847057908773422,0.04637647047638893,0.0431947335600853,0.10950320214033127,845.7308959960938,1e-05,0.06511114537715912,5.686605930328369,15.555093765258789,0 +488,0.11722233891487122,0.08464448899030685,0.07719089090824127,0.19737979769706726,784.97021484375,1e-05,0.06963223963975906,5.684810400009155,15.555093765258789,0 +489,0.0344865620136261,0.03258417174220085,0.03526606410741806,0.1712099313735962,851.9107666015625,1e-05,0.061624374240636826,5.700785875320435,15.555093765258789,0 +490,0.07324374467134476,0.2370140701532364,0.23204270005226135,0.20296473801136017,981.9896850585938,1e-05,0.0811726450920105,5.682831525802612,15.555093765258789,0 +491,0.10208410024642944,0.06471151113510132,0.06612836569547653,0.2201041579246521,825.9837646484375,1e-05,0.06696183979511261,5.6944420337677,15.555093765258789,0 +492,0.09062661230564117,0.6830963492393494,0.6881398558616638,0.29246795177459717,43.43629455566406,1e-05,0.06285360455513,5.695231199264526,15.555093765258789,0 +493,0.10328038036823273,0.12212279438972473,0.11477449536323547,0.32160255312919617,949.5192260742188,1e-05,0.08709345757961273,5.684521913528442,15.555093765258789,0 +494,0.05799707770347595,0.06985000520944595,0.07085679471492767,0.24707530438899994,564.6929931640625,1e-05,0.07236366719007492,5.694841623306274,15.555093765258789,0 +495,0.08769724518060684,0.05319127440452576,0.05252169817686081,0.24957531690597534,774.3531494140625,1e-05,0.08631402999162674,5.692702054977417,15.555093765258789,0 +496,0.05913672223687172,0.06573060899972916,0.0630827248096466,0.10834134370088577,916.8442993164062,1e-05,0.06376457214355469,5.706897497177124,15.555093765258789,0 +497,0.06063215807080269,0.07321836054325104,0.07238449901342392,0.19754807651042938,655.8935546875,1e-05,0.07355795800685883,5.91510534286499,15.555093765258789,0 +498,0.04470343887805939,0.1233224868774414,0.11767569929361343,0.2519551217556,921.0526123046875,1e-05,0.07415612041950226,5.720296382904053,15.555093765258789,0 +499,0.09282927960157394,0.0642617791891098,0.0678008571267128,0.24511216580867767,707.4652709960938,1e-05,0.07895941287279129,5.697171211242676,15.555093765258789,0 +500,0.11455293744802475,0.09856721758842468,0.0977112278342247,0.24819710850715637,555.5556030273438,1e-05,0.06385880708694458,5.690738201141357,15.555093765258789,0 +501,0.1118442565202713,0.08050145953893661,0.07971062511205673,0.27502402663230896,484.06866455078125,1e-05,0.07191679626703262,5.6783294677734375,15.555093765258789,0 +502,0.05421116203069687,0.11002981662750244,0.11879201233386993,0.24260415136814117,964.3510131835938,1e-05,0.07120582461357117,5.700054883956909,15.555093765258789,0 +503,0.0670824721455574,0.037478987127542496,0.03893381357192993,0.10018429160118103,838.8157958984375,1e-05,0.07958406209945679,5.704919815063477,15.555093765258789,0 +504,0.08326162397861481,0.044088203459978104,0.04617410525679588,0.08094550669193268,536.5296630859375,1e-05,0.07511509954929352,5.699259042739868,15.555093765258789,0 +505,0.103908970952034,0.1397538036108017,0.1355426162481308,0.2759455144405365,966.1671142578125,1e-05,0.08135182410478592,5.6912736892700195,15.555093765258789,0 +506,0.07729026675224304,0.05088910087943077,0.04933474585413933,0.16196313500404358,769.2307739257812,1e-05,0.0716109573841095,5.7242395877838135,15.555093765258789,0 +507,0.12923794984817505,0.07549137622117996,0.08280769735574722,0.21774037182331085,966.6818237304688,1e-05,0.0779564157128334,5.667770147323608,15.555093765258789,0 +508,0.14182010293006897,0.12929639220237732,0.14109309017658234,0.19818107783794403,161.1498260498047,1e-05,0.07766552269458771,5.6865234375,15.555093765258789,0 +509,0.0933031439781189,0.08575555682182312,0.08307092636823654,0.24252402782440186,485.94134521484375,1e-05,0.08169182389974594,5.6838219165802,15.555093765258789,0 +510,0.06377377361059189,0.19903820753097534,0.18864598870277405,0.2397916615009308,989.3660888671875,1e-05,0.05886770784854889,5.688502311706543,15.555093765258789,0 +511,0.10410113632678986,0.12515000998973846,0.12161020934581757,0.23816505074501038,972.9610595703125,1e-05,0.08863276988267899,5.684983491897583,15.555093765258789,0 +512,0.09843222796916962,0.08614388853311539,0.08375145494937897,0.2623397409915924,865.1477661132812,1e-05,0.0910797044634819,5.691214084625244,15.555093765258789,0 +513,0.11270640790462494,0.21193130314350128,0.22749029099941254,0.20686697959899902,161.1498260498047,1e-05,0.075529545545578,5.684382200241089,15.555093765258789,0 +514,0.08833841979503632,0.06308264285326004,0.05920859053730965,0.22943909466266632,750.7987060546875,1e-05,0.0805484801530838,5.68618106842041,15.555093765258789,0 +515,0.14402662217617035,0.08179961144924164,0.07740768045186996,0.29961538314819336,654.7619018554688,1e-05,0.09624572843313217,5.6780290603637695,15.555093765258789,0 +516,0.09417316317558289,0.13043886423110962,0.1256893426179886,0.25919869542121887,966.9384155273438,1e-05,0.09053443372249603,5.677451848983765,15.555093765258789,0 +517,0.0652303621172905,0.15430444478988647,0.14278674125671387,0.29530447721481323,951.2427978515625,1e-05,0.09557285904884338,5.721389055252075,15.555093765258789,0 +518,0.08707410097122192,0.0861331894993782,0.08125248551368713,0.2510416507720947,662.593994140625,1e-05,0.0917668342590332,5.687324523925781,15.555093765258789,0 +519,0.10395386815071106,0.2651517987251282,0.2437533140182495,0.18705928325653076,998.592041015625,1e-05,0.10051377862691879,5.685814619064331,15.555093765258789,0 +520,0.09723547101020813,0.16942226886749268,0.1613336056470871,0.25248396396636963,987.174072265625,1e-05,0.08730120211839676,5.692989110946655,15.555093765258789,0 +521,0.12086320668458939,0.23383930325508118,0.23699422180652618,0.13055287301540375,168.68511962890625,1e-05,0.10423675179481506,5.683302879333496,15.555093765258789,0 +522,0.12204882502555847,0.0628664493560791,0.06856303662061691,0.19239582121372223,925.8298950195312,1e-05,0.09034498780965805,5.6840057373046875,15.555093765258789,0 +523,0.04196463152766228,0.13274526596069336,0.13082832098007202,0.21118588745594025,961.7158813476562,1e-05,0.05959152430295944,5.6791675090789795,15.555094242095947,0 +524,0.06314616650342941,0.34581372141838074,0.34765303134918213,0.1307772397994995,997.168212890625,1e-05,0.076392762362957,5.685218334197998,15.555094242095947,0 +525,0.07550342381000519,0.04142090678215027,0.04241472855210304,0.12796473503112793,773.6281127929688,1e-05,0.0931638851761818,5.691748857498169,15.555094242095947,0 +526,0.05366021767258644,0.08842876553535461,0.08832959830760956,0.2625560760498047,889.9769897460938,1e-05,0.07919205725193024,5.684171438217163,15.555094242095947,0 +527,0.16330446302890778,0.0735284686088562,0.0687781497836113,0.23150640726089478,904.3141479492188,1e-05,0.09415329247713089,5.682533025741577,15.555094242095947,0 +528,0.08877502381801605,0.14959664642810822,0.15910036861896515,0.2913782000541687,194.25677490234375,1e-05,0.10636061429977417,5.667588472366333,15.555094242095947,0 +529,0.06936025619506836,0.2733127176761627,0.2852801978588104,0.2245432585477829,988.9306640625,1e-05,0.07340656965970993,5.833898544311523,15.555094242095947,0 +530,0.0838947519659996,0.11636705696582794,0.11246845871210098,0.1923317164182663,932.0956420898438,1e-05,0.10487660765647888,5.689272403717041,15.555094242095947,0 +531,0.1147645115852356,0.0638066902756691,0.0652274638414383,0.20443908870220184,890.3912353515625,1e-05,0.07945358753204346,5.738771915435791,15.555094242095947,0 +532,0.11905114352703094,0.08223626017570496,0.07474779337644577,0.16420672833919525,873.039794921875,1e-05,0.07994241267442703,5.687869310379028,15.555094242095947,0 +533,0.09857287257909775,0.2900537848472595,0.34489014744758606,0.2245432585477829,34.046695709228516,1e-05,0.07282576709985733,5.681135416030884,15.555094242095947,0 +534,0.08886361867189407,0.05285155400633812,0.05656839907169342,0.18512018024921417,745.1535034179688,1e-05,0.0814920961856842,5.688796043395996,15.555094242095947,0 +535,0.11398967355489731,0.25171375274658203,0.25955861806869507,0.21192306280136108,157.3426513671875,1e-05,0.08951916545629501,5.677133560180664,15.555094242095947,0 +536,0.11996575444936752,0.1096089705824852,0.10874038189649582,0.09549678862094879,964.3510131835938,1e-05,0.090984046459198,5.683742046356201,15.555094242095947,0 +537,0.10588366538286209,0.11296600848436356,0.11002649366855621,0.23358172178268433,325.4438171386719,1e-05,0.08042282611131668,5.684099435806274,15.555094242095947,0 +538,0.08455203473567963,0.11009655147790909,0.10032142698764801,0.26770833134651184,935.2970581054688,1e-05,0.08547583967447281,5.679731369018555,15.555094242095947,0 +539,0.09573865681886673,0.08250851184129715,0.08137344568967819,0.10236378014087677,911.7965698242188,1e-05,0.07302938401699066,5.885570287704468,15.555094242095947,0 +540,0.11280378699302673,0.11496074497699738,0.11293163895606995,0.2554166615009308,336.25732421875,1e-05,0.06992360949516296,5.683666229248047,15.555094242095947,0 +541,0.09748093038797379,0.12149439752101898,0.1127895712852478,0.22419871389865875,943.9275512695312,1e-05,0.08516329526901245,5.9096128940582275,15.555094242095947,0 +542,0.09248263388872147,0.0682663545012474,0.07020746916532516,0.1587499976158142,923.799560546875,1e-05,0.07707531750202179,5.6910340785980225,15.555094242095947,0 +543,0.05268295854330063,0.09384144842624664,0.09028331190347672,0.23612980544567108,791.788818359375,1e-05,0.06334004551172256,5.680697917938232,15.555094242095947,0 +544,0.0860343724489212,0.2224465161561966,0.19999153912067413,0.23018428683280945,990.448486328125,1e-05,0.10942068696022034,5.686589002609253,15.555094242095947,0 +545,0.10619969666004181,0.4932493567466736,0.5007584691047668,0.3085416555404663,79.58802795410156,1e-05,0.06081000342965126,5.6872522830963135,15.555094242095947,0 +546,0.08705940842628479,0.034043602645397186,0.0338466614484787,0.11045672744512558,793.795654296875,1e-05,0.07735546678304672,5.680078029632568,15.555094242095947,0 +547,0.10854019224643707,0.10202319175004959,0.10109948366880417,0.2051442265510559,854.930419921875,1e-05,0.07898242771625519,5.684211730957031,15.555094242095947,0 +548,0.09218378365039825,0.10338981449604034,0.10074387490749359,0.21927884221076965,670.22265625,1e-05,0.07967786490917206,5.9049131870269775,15.555094242095947,0 +549,0.06495226919651031,0.12343098968267441,0.11304082721471786,0.23288460075855255,817.174560546875,1e-05,0.07364791631698608,5.677823066711426,15.555094242095947,0 +550,0.0728713870048523,0.08335258066654205,0.0804508700966835,0.20975960791110992,780.78076171875,1e-05,0.10124973952770233,5.713508367538452,15.555094242095947,0 +551,0.06717091798782349,0.06071530655026436,0.059499528259038925,0.21665063500404358,859.375,1e-05,0.06967952102422714,5.69773530960083,15.555094242095947,0 +552,0.09508530050516129,0.1636112630367279,0.14846353232860565,0.22428685426712036,978.0244140625,1e-05,0.10025681555271149,5.792386531829834,15.555094242095947,0 +553,0.12686583399772644,0.6208763718605042,0.6156647801399231,0.3134695291519165,52.6819953918457,1e-05,0.09775656461715698,5.682084560394287,15.555094242095947,0 +554,0.10543761402368546,0.08850845694541931,0.08562967926263809,0.30020031332969666,892.8571166992188,1e-05,0.07820291072130203,5.677996873855591,15.555094242095947,0 +555,0.08550524711608887,0.07052483409643173,0.07142850756645203,0.2092868536710739,887.8910522460938,1e-05,0.06811652332544327,5.683548927307129,15.555094242095947,0 +556,0.08289308845996857,0.10879993438720703,0.09603048861026764,0.2140304446220398,936.8737182617188,1e-05,0.063845194876194,5.687196969985962,15.555094242095947,0 +557,0.11160804331302643,0.28380292654037476,0.2995103895664215,0.17026442289352417,113.63636016845703,1e-05,0.10318093746900558,5.682412385940552,15.555094242095947,0 +558,0.0990988090634346,0.14159545302391052,0.13215406239032745,0.2309935837984085,959.8422241210938,1e-05,0.07846236974000931,5.6844258308410645,15.555094242095947,0 +559,0.11901616305112839,0.0545007698237896,0.04971418157219887,0.2525240182876587,858.3959350585938,1e-05,0.06751243025064468,6.091943025588989,15.555094242095947,0 +560,0.056946445256471634,0.0882483720779419,0.08440187573432922,0.24270832538604736,954.3519897460938,1e-05,0.07566603273153305,5.8917317390441895,15.555094242095947,0 +561,0.1477106511592865,0.382232666015625,0.38769418001174927,0.28137820959091187,92.59259796142578,1e-05,0.09306304156780243,5.749058723449707,15.555094242095947,0 +562,0.08625589311122894,0.1407376080751419,0.14106237888336182,0.30086538195610046,407.6819763183594,1e-05,0.07954327762126923,5.692413806915283,15.555094242095947,0 +563,0.13563193380832672,0.06725370138883591,0.06487488746643066,0.25100159645080566,786.3502197265625,1e-05,0.08554313331842422,5.690719366073608,15.555094242095947,0 +564,0.088087297976017,0.07300820201635361,0.06602175533771515,0.23404645919799805,723.90576171875,1e-05,0.0941544622182846,5.687395095825195,15.555094242095947,0 +565,0.07160775363445282,0.18335281312465668,0.17806392908096313,0.24270030856132507,257.9365234375,1e-05,0.08664896339178085,5.689620733261108,15.555094242095947,0 +566,0.07758665084838867,0.06423129141330719,0.0646471157670021,0.16971954703330994,926.5010375976562,1e-05,0.06059885025024414,5.68761134147644,15.555094242095947,0 +567,0.13262039422988892,0.11551963537931442,0.11153560876846313,0.2928365170955658,680.7832641601562,1e-05,0.06524451076984406,5.6960649490356445,15.555094242095947,0 +568,0.07118941098451614,0.05234256759285927,0.05263020098209381,0.2743028700351715,895.6915893554688,1e-05,0.0876227393746376,5.682662725448608,15.555094242095947,0 +569,0.1269400268793106,0.10286654531955719,0.09782086312770844,0.2743028700351715,528.291015625,1e-05,0.0797109305858612,5.688075304031372,15.555094242095947,0 +570,0.055713996291160583,0.12624724209308624,0.11806361377239227,0.20812499523162842,934.3434448242188,1e-05,0.07963172346353531,5.689169883728027,15.555094242095947,0 +571,0.05041046068072319,0.07577918469905853,0.07462923973798752,0.23394230008125305,775.796630859375,1e-05,0.07566005736589432,5.918132305145264,15.555094242095947,0 +572,0.07669045031070709,0.05353850871324539,0.05131951719522476,0.18108172714710236,476.4851989746094,1e-05,0.07069529592990875,5.687450408935547,15.555094242095947,0 +573,0.09995782375335693,0.09848149865865707,0.09222868829965591,0.12810896337032318,933.0629272460938,1e-05,0.06720304489135742,5.694915056228638,15.555094242095947,0 +574,0.1313599944114685,0.09787510335445404,0.09646537154912949,0.26536858081817627,429.7900695800781,1e-05,0.07475067675113678,5.678310871124268,15.555094242095947,0 +575,0.07499399781227112,0.11435094475746155,0.11249486356973648,0.242660254240036,975.15380859375,1e-05,0.06408273428678513,5.689890623092651,15.555094242095947,0 +576,0.1077987551689148,0.11382418125867844,0.10860269516706467,0.29037660360336304,570.6521606445312,1e-05,0.07905639708042145,5.684547185897827,15.555094242095947,0 +577,0.10149221122264862,0.11506053060293198,0.10975632071495056,0.2806650400161743,952.9466552734375,1e-05,0.0790775865316391,5.692556858062744,15.555094242095947,0 +578,0.11595427244901657,0.072715163230896,0.07057194411754608,0.26144230365753174,692.9590454101562,1e-05,0.07858835160732269,5.67891788482666,15.555094242095947,0 +579,0.08764101564884186,0.14700989425182343,0.14980365335941315,0.21042467653751373,969.4793090820312,1e-05,0.06793846935033798,5.69060492515564,15.555094242095947,0 +580,0.12587806582450867,0.07333157956600189,0.07540480047464371,0.2601442337036133,474.5657653808594,1e-05,0.07983134686946869,5.6824634075164795,15.555094242095947,0 +581,0.11080583184957504,0.07054932415485382,0.06599486619234085,0.25711536407470703,807.9915161132812,1e-05,0.08123796433210373,5.754470348358154,15.555094242095947,0 +582,0.07498394697904587,0.24533124268054962,0.23073545098304749,0.28389421105384827,983.36181640625,1e-05,0.06557712703943253,5.757760763168335,15.555094242095947,0 +583,0.066105417907238,0.09215709567070007,0.08988033980131149,0.2330208271741867,950.9569091796875,1e-05,0.07778232544660568,5.936418533325195,15.555094242095947,0 +584,0.07823339104652405,0.11797255277633667,0.1272338330745697,0.1903846114873886,986.064208984375,1e-05,0.0681212767958641,5.678468465805054,15.555094242095947,0 +585,0.14668814837932587,0.06171242520213127,0.05984983593225479,0.12067307531833649,883.2159423828125,1e-05,0.0920625776052475,5.6991565227508545,15.555094242095947,0 +586,0.07241209596395493,0.16336533427238464,0.16274435818195343,0.22924678027629852,974.6696166992188,1e-05,0.08223865181207657,5.704549551010132,15.555094242095947,0 +587,0.08530957251787186,0.18827390670776367,0.17124630510807037,0.2553926110267639,996.9635620117188,1e-05,0.07651665061712265,5.706899881362915,15.555094242095947,0 +588,0.07585597783327103,0.33665257692337036,0.3426671028137207,0.1871073693037033,989.3660888671875,1e-05,0.0765606015920639,5.702392578125,15.555094242095947,0 +589,0.08442983031272888,0.08968250453472137,0.09094984084367752,0.20783652365207672,849.3589477539062,1e-05,0.07182162255048752,5.690506219863892,15.555094242095947,0 +590,0.15265831351280212,0.08901619911193848,0.08819975703954697,0.2330208271741867,911.7965698242188,1e-05,0.07164078205823898,5.797720193862915,15.555094242095947,0 +591,0.1763293445110321,0.07332007586956024,0.07013117522001266,0.25988781452178955,658.1439819335938,1e-05,0.10812878608703613,5.789243221282959,15.555094242095947,0 +592,0.06642423570156097,0.08654238283634186,0.08551297336816788,0.2476842850446701,871.2120971679688,1e-05,0.0815938264131546,5.671013593673706,15.555094242095947,0 +593,0.1018320620059967,0.15048432350158691,0.14908891916275024,0.22470352053642273,938.4346313476562,1e-05,0.0673624575138092,5.689891576766968,15.555094242095947,0 +594,0.07955396175384521,0.08756863325834274,0.08314962685108185,0.27987179160118103,900.8379516601562,1e-05,0.0777994692325592,5.681283235549927,15.555094242095947,0 +595,0.09136539697647095,0.047474008053541183,0.046599261462688446,0.278189092874527,788.4046630859375,1e-05,0.06803569197654724,5.680255651473999,15.555094242095947,0 +596,0.06637623906135559,0.05018165707588196,0.052021574229002,0.27568909525871277,865.6211547851562,1e-05,0.06721880286931992,5.684835195541382,15.555094242095947,0 +597,0.0739959329366684,0.056362710893154144,0.05597864091396332,0.2922596037387848,782.8849487304688,1e-05,0.06093478575348854,5.700294256210327,15.555094242095947,0 +598,0.09431774914264679,0.10863811522722244,0.10494974255561829,0.2483733892440796,946.896240234375,1e-05,0.07475840300321579,5.684587001800537,15.555094242095947,0 +599,0.08209335803985596,0.10802619159221649,0.09973225742578506,0.275969535112381,938.1237182617188,1e-05,0.0663292184472084,5.688990831375122,15.555094242095947,0 +600,0.13079069554805756,0.12696503102779388,0.12172636389732361,0.24820512533187866,311.56158447265625,1e-05,0.06767097115516663,5.690435886383057,15.555094242095947,0 +601,0.07262269407510757,0.15584364533424377,0.14100655913352966,0.2805047929286957,990.87890625,1e-05,0.07504051178693771,5.862862825393677,15.555094242095947,0 +602,0.09638497233390808,0.061831772327423096,0.06266658753156662,0.25633013248443604,746.7793579101562,1e-05,0.07144548743963242,5.699014663696289,15.555094242095947,0 +603,0.0677574872970581,0.06844811141490936,0.07284297049045563,0.2388221025466919,948.6500244140625,1e-05,0.07327479124069214,5.686933755874634,15.555094242095947,0 +604,0.09812668710947037,0.0680507943034172,0.06894616782665253,0.17378205060958862,857.4120483398438,1e-05,0.0722527876496315,5.693824768066406,15.555094242095947,0 +605,0.04732377454638481,0.07993512600660324,0.07174272835254669,0.23604966700077057,961.1829223632812,1e-05,0.07297897338867188,5.6817357540130615,15.555094242095947,0 +606,0.10652356594800949,0.0744844302535057,0.07271255552768707,0.16880609095096588,925.8298950195312,1e-05,0.0768657922744751,5.688206911087036,15.555094242095947,0 +607,0.05576252192258835,0.028411870822310448,0.031289972364902496,0.20743589103221893,748.3948974609375,1e-05,0.06415396928787231,5.696840524673462,15.555094242095947,0 +608,0.12595443427562714,0.09322306513786316,0.09435257315635681,0.24249999225139618,689.9642333984375,1e-05,0.06482894718647003,5.676898956298828,15.555094242095947,0 +609,0.1542760133743286,0.13370710611343384,0.12404105812311172,0.2578365206718445,964.872314453125,1e-05,0.07627762109041214,5.684574127197266,15.555094242095947,0 +610,0.09328939765691757,0.6529591083526611,0.6806603074073792,0.20426280796527863,24.50980567932129,1e-05,0.059045515954494476,5.691888809204102,15.555094242095947,0 +611,0.06433980911970139,0.1532033383846283,0.14505739510059357,0.2731410264968872,978.2608642578125,1e-05,0.06284523010253906,5.69034743309021,15.555094242095947,0 +612,0.11857552081346512,0.13038522005081177,0.12844674289226532,0.2029246687889099,968.974853515625,1e-05,0.06946609169244766,5.691129446029663,15.555094242095947,0 +613,0.09148882329463959,0.11200574040412903,0.11707830429077148,0.21245191991329193,403.11651611328125,1e-05,0.05247075483202934,5.891714572906494,15.555094242095947,0 +614,0.09369725733995438,0.1180378645658493,0.1257839947938919,0.15328525006771088,267.29559326171875,1e-05,0.08382924646139145,5.680070877075195,15.555094242095947,0 +615,0.09843665361404419,0.09988176077604294,0.09313153475522995,0.21053685247898102,858.8861083984375,1e-05,0.0670132264494896,5.680326700210571,15.555094242095947,0 +616,0.0923888310790062,0.06202327832579613,0.06010834127664566,0.17040063440799713,748.3948974609375,1e-05,0.07648252695798874,5.6896398067474365,15.555094242095947,0 +617,0.07939532399177551,0.1241164579987526,0.11948340386152267,0.23203524947166443,896.4932861328125,1e-05,0.060124240815639496,5.681408405303955,15.555094242095947,0 +618,0.07571344822645187,0.24310491979122162,0.2338392585515976,0.24918268620967865,989.8002319335938,1e-05,0.09928681701421738,5.678295373916626,15.555094242095947,0 +619,0.08671241253614426,0.055916424840688705,0.056898750364780426,0.22949518263339996,725.671142578125,1e-05,0.10622269660234451,5.67785906791687,15.555094242095947,0 +620,0.11215948313474655,0.10127616673707962,0.0968698114156723,0.23481570184230804,739.3790893554688,1e-05,0.07607189565896988,5.681951284408569,15.555094242095947,0 +621,0.13396553695201874,0.06175233796238899,0.06376583129167557,0.2344711422920227,555.5556030273438,1e-05,0.08756615221500397,5.6952879428863525,15.555094242095947,0 +622,0.06525792926549911,0.03857945650815964,0.04080219194293022,0.2691746652126312,757.8740844726562,1e-05,0.09519853442907333,5.848864793777466,15.555094242095947,0 +623,0.05713062360882759,0.09291279315948486,0.08525816351175308,0.23199518024921417,897.2911987304688,1e-05,0.07641147077083588,5.685667514801025,15.555094242095947,0 +624,0.07229181379079819,0.053300414234399796,0.052782416343688965,0.23275640606880188,899.2704467773438,1e-05,0.0722719207406044,5.682498455047607,15.555094242095947,0 +625,0.08685782551765442,0.12625917792320251,0.12455165386199951,0.26150640845298767,201.34228515625,1e-05,0.05831426382064819,5.677090406417847,15.555094242095947,0 +626,0.0681123360991478,0.050411686301231384,0.05453812703490257,0.26722756028175354,534.8970336914062,1e-05,0.12851457297801971,5.813720941543579,15.555094242095947,0 +627,0.046501901000738144,0.05380074307322502,0.05121240019798279,0.18564102053642273,920.0105590820312,1e-05,0.08225028216838837,5.689875602722168,15.555094242095947,0 +628,0.05232194811105728,0.08265804499387741,0.08108027279376984,0.13373397290706635,947.4830322265625,1e-05,0.11779967695474625,5.683947324752808,15.555094242095947,0 +629,0.06934749335050583,0.03417573869228363,0.03651750460267067,0.1100560873746872,908.8427124023438,1e-05,0.1044771745800972,5.685783386230469,15.555094242095947,0 +630,0.05959876999258995,0.1149560734629631,0.11738693714141846,0.24193108081817627,965.6505737304688,1e-05,0.05825096368789673,5.687139987945557,15.555094242095947,0 +631,0.1070491150021553,0.10928914695978165,0.09723992645740509,0.2610977590084076,900.0560302734375,1e-05,0.06401991844177246,5.697360038757324,15.555094242095947,0 +632,0.11952028423547745,0.2659156620502472,0.26776885986328125,0.25083333253860474,986.2869873046875,1e-05,0.09032334387302399,5.691965818405151,15.555094242095947,0 +633,0.09764664620161057,0.050515495240688324,0.05221405625343323,0.183461531996727,769.2307739257812,1e-05,0.0882328450679779,5.878673076629639,15.555094242095947,0 +634,0.08235801011323929,0.12422355264425278,0.12091381847858429,0.13596954941749573,965.9091796875,1e-05,0.05908776447176933,5.687166213989258,15.555094242095947,0 +635,0.06494040042161942,0.06604231148958206,0.06190149486064911,0.25921472907066345,893.2648315429688,1e-05,0.10204776376485825,5.679492473602295,15.555094242095947,0 +636,0.09184757620096207,0.9860921502113342,0.989130437374115,0.1800640970468521,4.9800801277160645,1e-05,0.07529710233211517,5.6893579959869385,15.555094242095947,0 +637,0.10423173010349274,0.06800354272127151,0.06615354865789413,0.23002402484416962,560.154541015625,1e-05,0.08234924077987671,5.68027663230896,15.555094242095947,0 +638,0.13129112124443054,0.1385694295167923,0.14058330655097961,0.09518428891897202,359.68658447265625,1e-05,0.06634862720966339,5.6797778606414795,15.555094242095947,0 +639,0.12917445600032806,0.11003924906253815,0.11240328103303909,0.1776762753725052,474.5657653808594,1e-05,0.07978205382823944,5.67530083656311,15.555094242095947,0 +640,0.058562569320201874,0.09354124218225479,0.08972834050655365,0.2424919754266739,855.4293212890625,1e-05,0.08683105558156967,5.682773113250732,15.555094242095947,0 +641,0.0860067680478096,0.0505862720310688,0.046411413699388504,0.11528044193983078,489.6593933105469,1e-05,0.08933643251657486,5.685039520263672,15.555094242095947,0 +642,0.07890057563781738,0.13090482354164124,0.12219694256782532,0.2326442152261734,936.2449951171875,1e-05,0.06871511042118073,5.797084331512451,15.555094242095947,0 +643,0.0948653444647789,0.2543734014034271,0.25434911251068115,0.2470112144947052,125.89928436279297,1e-05,0.059150099754333496,5.684628248214722,15.555094242095947,0 +644,0.13150432705879211,0.09973366558551788,0.0953403040766716,0.24919070303440094,694.9378051757812,1e-05,0.06578684598207474,5.7815258502960205,15.555094242095947,0 +645,0.07280515134334564,0.06797872483730316,0.06715737283229828,0.11724358797073364,952.9466552734375,1e-05,0.06903809309005737,5.6890504360198975,15.555094242095947,0 +646,0.07713311910629272,0.11579461395740509,0.11052801460027695,0.24071313440799713,973.4513549804688,1e-05,0.07833275198936462,5.675307750701904,15.555094242095947,0 +647,0.12162414938211441,0.11328351497650146,0.1178738921880722,0.2173076868057251,288.4615478515625,1e-05,0.08946976065635681,5.6898181438446045,15.555094242095947,0 +648,0.07836361229419708,0.39674660563468933,0.3858906626701355,0.19507211446762085,997.168212890625,1e-05,0.06424734741449356,5.685686826705933,15.555094242095947,0 +649,0.06437962502241135,0.0286849457770586,0.029144713655114174,0.12544871866703033,839.3560791015625,1e-05,0.07925097644329071,5.684373378753662,15.555094242095947,0 +650,0.06827432662248611,0.05182869732379913,0.05229772999882698,0.2357371747493744,674.4935913085938,1e-05,0.07187316566705704,5.6845667362213135,15.555094242095947,0 +651,0.13183002173900604,0.11060074716806412,0.1093265563249588,0.2777724266052246,446.65814208984375,1e-05,0.07326915115118027,5.6889708042144775,15.555094242095947,0 +652,0.11886640638113022,0.07884817570447922,0.07747846096754074,0.22257210314273834,662.593994140625,1e-05,0.06417262554168701,5.9543256759643555,15.555094242095947,0 +653,0.12991666793823242,0.10772237181663513,0.10163085907697678,0.1757211536169052,871.670654296875,1e-05,0.07250940799713135,5.681011199951172,15.555094242095947,0 +654,0.07552961260080338,0.07132638990879059,0.07578905671834946,0.26472756266593933,908.4699096679688,1e-05,0.05607801303267479,5.677648305892944,15.555094242095947,0 +655,0.07719273865222931,0.08891384303569794,0.09110332280397415,0.25612980127334595,956.2970581054688,1e-05,0.06206871196627617,5.6970250606536865,15.555094242095947,0 +656,0.09744647890329361,0.09716383367776871,0.09589940309524536,0.25342947244644165,963.5654907226562,1e-05,0.08680334687232971,5.7368483543396,15.555094242095947,0 +657,0.10301780700683594,0.035302288830280304,0.03880370035767555,0.18608172237873077,566.1925659179688,1e-05,0.0857774019241333,5.700960636138916,15.555094242095947,0 +658,0.1126544252038002,0.14782504737377167,0.13798785209655762,0.22148236632347107,952.9466552734375,1e-05,0.07016351819038391,5.692563056945801,15.555094242095947,0 +659,0.07053820788860321,0.14644360542297363,0.14955110847949982,0.20836538076400757,982.2193603515625,1e-05,0.06927800923585892,5.691721677780151,15.555094242095947,0 +660,0.07388091832399368,0.15229330956935883,0.14568328857421875,0.22121794521808624,981.7597045898438,1e-05,0.1191372275352478,5.693739891052246,15.555094242095947,0 +661,0.07019326090812683,0.039320725947618484,0.037730373442173004,0.2049759477376938,809.2384033203125,1e-05,0.09879361838102341,5.6852288246154785,15.555094242095947,0 +662,0.08169052749872208,0.12201542407274246,0.11750432848930359,0.26318109035491943,871.2120971679688,1e-05,0.0690801814198494,5.683429718017578,15.555094242095947,0 +663,0.08631759881973267,0.11250635981559753,0.10261719673871994,0.22794871032238007,868.9024658203125,1e-05,0.08553872257471085,5.771966218948364,15.555094242095947,0 +664,0.09848257899284363,0.10080114752054214,0.08997192233800888,0.20191505551338196,855.4293212890625,1e-05,0.0756949931383133,5.684544563293457,15.555094242095947,0 +665,0.06946222484111786,0.13590677082538605,0.12449433654546738,0.2320592850446701,944.2269897460938,1e-05,0.11415482312440872,5.885215520858765,15.555094242095947,0 +666,0.10430272668600082,0.1198875680565834,0.12974506616592407,0.26230767369270325,222.03948974609375,1e-05,0.08523182570934296,5.683515787124634,15.555094242095947,0 +667,0.11686427891254425,0.08904048055410385,0.08685864508152008,0.23392626643180847,650.1919555664062,1e-05,0.07236428558826447,5.6786816120147705,15.555094242095947,0 +668,0.07657068967819214,0.0652589350938797,0.06796011328697205,0.16074518859386444,600.3118286132812,1e-05,0.09279737621545792,5.675414085388184,15.555094242095947,0 +669,0.11717251688241959,0.10614228993654251,0.09862223267555237,0.272163450717926,923.458740234375,1e-05,0.08575455099344254,5.686319351196289,15.555094242095947,0 +670,0.07373535633087158,0.08930110186338425,0.08050879836082458,0.21321313083171844,923.799560546875,1e-05,0.06581585109233856,5.691462516784668,15.555094242095947,0 +671,0.08499082177877426,0.2230066955089569,0.20699891448020935,0.21858973801136017,990.232666015625,1e-05,0.09888477623462677,5.688518524169922,15.555094242095947,0 +672,0.09217468649148941,0.053536199033260345,0.050354283303022385,0.2023637741804123,767.0015869140625,1e-05,0.07213778793811798,5.682773590087891,15.555094242095947,0 +673,0.09412378817796707,0.11876863241195679,0.11835422366857529,0.22854165732860565,715.8119506835938,1e-05,0.07379954308271408,5.683602333068848,15.555094242095947,0 +674,0.04706950858235359,0.38340961933135986,0.3536820113658905,0.2181810885667801,997.7804565429688,1e-05,0.060932062566280365,5.8629467487335205,15.555094242095947,0 +675,0.06703551113605499,0.04364215210080147,0.047614749521017075,0.14783653616905212,891.2169799804688,1e-05,0.07824557274580002,5.664689302444458,15.555094242095947,0 +676,0.09750372171401978,0.05360829457640648,0.05362626910209656,0.16923075914382935,801.64990234375,1e-05,0.07707815617322922,5.682564973831177,15.555094242095947,0 +677,0.08757998794317245,0.05331828072667122,0.05169399082660675,0.14379006624221802,787.0369873046875,1e-05,0.08631788939237595,5.722803115844727,15.555094242095947,0 +678,0.0824686661362648,0.05404971167445183,0.048913486301898956,0.2044871747493744,832.2192993164062,1e-05,0.07826844602823257,5.68607234954834,15.555094242095947,0 +679,0.09627293050289154,0.15332961082458496,0.1513158231973648,0.27725961804389954,965.3915405273438,1e-05,0.07308236509561539,5.68647313117981,15.555094242095947,0 +680,0.0867970883846283,0.08477730304002762,0.0806613340973854,0.2563942074775696,861.318359375,1e-05,0.07291898131370544,5.677826166152954,15.555094242095947,0 +681,0.08399926126003265,0.0703638568520546,0.06829711049795151,0.14820511639118195,555.5556030273438,1e-05,0.07906721532344818,5.679048299789429,15.555094242095947,0 +682,0.0957193449139595,0.2703603208065033,0.290841668844223,0.24584133923053741,101.10294342041016,1e-05,0.06918798387050629,5.69012451171875,15.555094242095947,0 +683,0.0856749638915062,0.16777077317237854,0.16863299906253815,0.19061698019504547,987.8356323242188,1e-05,0.07742492109537125,5.68297815322876,15.555094242095947,0 +684,0.14526326954364777,0.04672384634613991,0.044884659349918365,0.09247595816850662,666.9776611328125,1e-05,0.08090466260910034,5.684261083602905,15.555094242095947,0 +685,0.07310879975557327,0.14574739336967468,0.14116954803466797,0.27137818932533264,400.81524658203125,1e-05,0.0720822885632515,5.684674978256226,15.555094242095947,0 +686,0.12422167509794235,0.07690239697694778,0.07345818728208542,0.09866185486316681,949.8078002929688,1e-05,0.06456473469734192,5.873530149459839,15.555094242095947,0 +687,0.08735811710357666,0.1833810806274414,0.16561244428157806,0.16472755372524261,983.1340942382812,1e-05,0.07022809237241745,5.8481528759002686,15.555094242095947,0 +688,0.10977820307016373,0.09905669838190079,0.095423124730587,0.25662660598754883,805.4765625,1e-05,0.09623182564973831,5.938847064971924,15.555094242095947,0 +689,0.12262199819087982,0.23440243303775787,0.23640526831150055,0.29269230365753174,232.08470153808594,1e-05,0.05953044071793556,5.691319227218628,15.555094242095947,0 +690,0.10531041026115417,0.05135016515851021,0.05360834673047066,0.183934286236763,769.9692993164062,1e-05,0.07023081928491592,5.689964771270752,15.555094242095947,0 +691,0.08247815817594528,0.5287450551986694,0.5173670649528503,0.263774037361145,48.076927185058594,1e-05,0.08018115907907486,5.691080570220947,15.555094242095947,0 +692,0.051845502108335495,0.08134955912828445,0.07126453518867493,0.254855751991272,842.5684204101562,1e-05,0.05685488134622574,5.6939616203308105,15.555094242095947,0 +693,0.0681292936205864,0.14655451476573944,0.13896241784095764,0.20955929160118103,948.067626953125,1e-05,0.06361012905836105,5.6913323402404785,15.555094242095947,0 +694,0.08585763722658157,0.05261201411485672,0.05632123723626137,0.23712338507175446,608.3162231445312,1e-05,0.06577366590499878,5.6968770027160645,15.555094242095947,0 +695,0.07019342482089996,0.0940643846988678,0.09322720766067505,0.14985576272010803,493.3414306640625,1e-05,0.056374356150627136,5.6920037269592285,15.555094242095947,0 +696,0.08623760938644409,0.04315880686044693,0.045038167387247086,0.2613781988620758,652.4856567382812,1e-05,0.0766015350818634,5.6812262535095215,15.555094242095947,0 +697,0.10907041281461716,0.05971727520227432,0.06167479604482651,0.23012018203735352,741.8699340820312,1e-05,0.05502705276012421,5.706504583358765,15.555094242095947,0 +698,0.06921524554491043,0.08845105767250061,0.08737057447433472,0.2418028712272644,950.095947265625,1e-05,0.07053294777870178,5.709326267242432,15.555094242095947,0 +699,0.0724867731332779,0.07396841794252396,0.07382135838270187,0.29556089639663696,626.2474975585938,1e-05,0.07728670537471771,5.711681127548218,15.555094242095947,0 +700,0.060973577201366425,0.1475246548652649,0.14703431725502014,0.2692948579788208,969.9821166992188,1e-05,0.06867655366659164,5.692407131195068,15.555094242095947,0 +701,0.1147150993347168,0.2436661720275879,0.24359698593616486,0.2568589746952057,153.50877380371094,1e-05,0.07890575379133224,5.7017176151275635,15.555094242095947,0 +702,0.06596780568361282,0.07279209047555923,0.06783192604780197,0.22883813083171844,891.2169799804688,1e-05,0.05986928194761276,5.695527791976929,15.555094242095947,0 +703,0.1078936755657196,0.12192999571561813,0.12194795906543732,0.24193909764289856,452.8061218261719,1e-05,0.06129399314522743,5.687594890594482,15.555094242095947,0 +704,0.138630211353302,0.07936734706163406,0.08462126553058624,0.2559695541858673,448.71795654296875,1e-05,0.06786052882671356,5.692643404006958,15.555094242095947,0 +705,0.16790008544921875,0.13547568023204803,0.13481611013412476,0.2700640857219696,311.56158447265625,1e-05,0.06014420464634895,5.685760974884033,15.555094242095947,0 +706,0.11538077890872955,0.04679395630955696,0.04883081465959549,0.11785256117582321,560.154541015625,1e-05,0.059172287583351135,5.691744327545166,15.555094242095947,0 +707,0.10284825414419174,0.14780302345752716,0.13695856928825378,0.18416665494441986,984.0426025390625,1e-05,0.05972043797373772,5.687373399734497,15.555094242095947,0 +708,0.08669040352106094,0.08389820903539658,0.08869870007038116,0.20114582777023315,934.6619262695312,1e-05,0.08019217103719711,5.789478302001953,15.555094242095947,0 +709,0.06875831633806229,0.06524673104286194,0.06110410392284393,0.2537660300731659,809.8590698242188,1e-05,0.07392967492341995,5.688398361206055,15.555094242095947,0 +710,0.11943229287862778,0.16077780723571777,0.1523096263408661,0.2197115272283554,965.6505737304688,1e-05,0.06758236140012741,5.685980796813965,15.555094242095947,0 +711,0.11027638614177704,0.24620367586612701,0.24312931299209595,0.06749198585748672,161.1498260498047,1e-05,0.06574609875679016,5.674898624420166,15.555094242095947,0 +712,0.07576459646224976,0.19565077126026154,0.1839631348848343,0.26568910479545593,999.5994262695312,1e-05,0.08596477657556534,5.676469802856445,15.555094242095947,0 +713,0.09778555482625961,0.07357405871152878,0.07199326157569885,0.15602563321590424,858.3959350585938,1e-05,0.0634692907333374,5.686746597290039,15.555094242095947,0 +714,0.11328323930501938,0.07456302642822266,0.07807474583387375,0.15048076212406158,680.7832641601562,1e-05,0.08001375943422318,5.683846473693848,15.555094242095947,0 +715,0.08449866622686386,0.22948068380355835,0.22142910957336426,0.2009134590625763,999.7998046875,1e-05,0.06617849320173264,5.687048435211182,15.555094242095947,0 +716,0.10236288607120514,0.043128080666065216,0.04232887551188469,0.10385416448116302,820.7417602539062,1e-05,0.07594384998083115,5.690875053405762,15.555094242095947,0 +717,0.08713807910680771,0.7149477005004883,0.7195815443992615,0.23599357903003693,19.685039520263672,1e-05,0.08781570196151733,5.684189319610596,15.555094242095947,0 +718,0.07856985926628113,0.14990727603435516,0.14780184626579285,0.211410254240036,926.8355712890625,1e-05,0.0694771409034729,5.884520053863525,15.555094242095947,0 +719,0.06455732882022858,0.1404058188199997,0.12948466837406158,0.18550479412078857,948.067626953125,1e-05,0.06126658618450165,5.68869161605835,15.555094242095947,0 +720,0.09473682194948196,0.10779881477355957,0.09914623945951462,0.2946714758872986,887.8910522460938,1e-05,0.0871785432100296,5.681486368179321,15.555094242095947,0 +721,0.06216057389974594,0.5157371163368225,0.5761698484420776,0.26421472430229187,38.75969314575195,1e-05,0.08187557011842728,5.69449257850647,15.555094242095947,0 +722,0.10877267271280289,0.325567364692688,0.30776309967041016,0.3145272433757782,995.9349365234375,1e-05,0.07687389105558395,5.685437917709351,15.555094242095947,0 +723,0.07529616355895996,0.050611309707164764,0.04947400838136673,0.09733974188566208,654.7619018554688,1e-05,0.0830998495221138,5.686153888702393,15.555094242095947,0 +724,0.06509745121002197,0.05764298886060715,0.059126850217580795,0.24072915315628052,930.7967529296875,1e-05,0.08600585907697678,5.689996004104614,15.555094242095947,0 +725,0.09805859625339508,0.08043017238378525,0.07958724349737167,0.3017948567867279,414.4384765625,1e-05,0.08216164261102676,5.679464340209961,15.555094242095947,0 +726,0.08591241389513016,0.0787767693400383,0.06956982612609863,0.2650480568408966,874.8499145507812,1e-05,0.07454104721546173,5.680401802062988,15.555094242095947,0 +727,0.13215728104114532,0.05494679883122444,0.05514067783951759,0.20354166626930237,887.8910522460938,1e-05,0.06565956771373749,5.684453248977661,15.555094242095947,0 +728,0.07353095710277557,0.032474011182785034,0.03694834187626839,0.2179727554321289,374.6498718261719,1e-05,0.06767501682043076,5.669191598892212,15.555094242095947,0 +729,0.08704612404108047,0.06242155656218529,0.06293841451406479,0.2585737109184265,851.9107666015625,1e-05,0.07302507758140564,5.680548429489136,15.555094242095947,0 +730,0.12938827276229858,0.08653348684310913,0.08443120867013931,0.19726762175559998,405.4053955078125,1e-05,0.07469204068183899,5.9284398555755615,15.555094242095947,0 +731,0.088107630610466,0.05567626655101776,0.05952051654458046,0.26306089758872986,612.2449340820312,1e-05,0.07591918110847473,5.698426246643066,15.555094242095947,0 +732,0.10799305140972137,0.08583816140890121,0.0832233726978302,0.2148076891899109,989.8002319335938,1e-05,0.07146496325731277,5.683116436004639,15.555094242095947,0 +733,0.10482501983642578,0.0920594111084938,0.09881976246833801,0.13016025722026825,308.7349548339844,1e-05,0.08035488426685333,5.683748722076416,15.555094242095947,0 +734,0.04795268550515175,0.09956454485654831,0.08897769451141357,0.17908653616905212,969.4793090820312,1e-05,0.08264488726854324,5.6896936893463135,15.555094242095947,0 +735,0.0840575248003006,0.0681312158703804,0.0625004842877388,0.20434294641017914,675.5514526367188,1e-05,0.07213125377893448,5.677448511123657,15.555094242095947,0 +736,0.08729520440101624,0.19326436519622803,0.18994837999343872,0.23259614408016205,964.872314453125,1e-05,0.08626651018857956,5.680983304977417,15.555094242095947,0 +737,0.08867137879133224,0.10164742171764374,0.10060498118400574,0.26710736751556396,349.42364501953125,1e-05,0.07421275973320007,5.858489274978638,15.555094242095947,0 +738,0.09902654588222504,0.0319339744746685,0.032649893313646317,0.09308493137359619,544.5823974609375,1e-05,0.06471627950668335,5.676073312759399,15.555094242095947,0 +739,0.09197790175676346,0.07101043313741684,0.07058883458375931,0.22571313381195068,542.9864501953125,1e-05,0.069471575319767,5.686180353164673,15.555094242095947,0 +740,0.13930648565292358,0.07539321482181549,0.0760139524936676,0.20214742422103882,717.632080078125,1e-05,0.08326806873083115,5.912320137023926,15.555094242095947,0 +741,0.09032325446605682,0.07304644584655762,0.0729915052652359,0.24887819588184357,767.0015869140625,1e-05,0.07423621416091919,5.691371202468872,15.555094242095947,0 +742,0.08689325302839279,0.10268590599298477,0.10493902862071991,0.11354967206716537,538.1549072265625,1e-05,0.06959646195173264,5.700535774230957,15.555094242095947,0 +743,0.0789506658911705,0.09840276092290878,0.10110094398260117,0.2081330120563507,955.7438354492188,1e-05,0.05994667112827301,5.686543941497803,15.555094242095947,0 +744,0.11238224804401398,0.16565491259098053,0.16199956834316254,0.14749999344348907,956.2970581054688,1e-05,0.07033516466617584,5.688694953918457,15.555094242095947,0 +745,0.12308769673109055,0.09128402173519135,0.08395972102880478,0.1935817301273346,885.3558349609375,1e-05,0.07035840302705765,5.68599009513855,15.555094242095947,0 +746,0.11210250854492188,0.09029698371887207,0.08527214080095291,0.21638621389865875,813.5474853515625,1e-05,0.09486596286296844,5.6865949630737305,15.555094242095947,0 +747,0.10793663561344147,0.09455764293670654,0.09229336678981781,0.274487167596817,546.1712036132812,1e-05,0.09195854514837265,5.682522535324097,15.555094242095947,0 +748,0.1399926096200943,0.05628035217523575,0.05186513066291809,0.24193108081817627,908.0963134765625,1e-05,0.07694613188505173,5.68647837638855,15.555094242095947,0 +749,0.09280208498239517,0.056961704045534134,0.057029448449611664,0.06040865182876587,500.59954833984375,1e-05,0.07994876056909561,5.685974597930908,15.555094242095947,0 +750,0.0922938883304596,0.07664444297552109,0.0716237798333168,0.21685896813869476,844.1558227539062,1e-05,0.08615510910749435,5.682942628860474,15.555094242095947,0 +751,0.06927459686994553,0.20675083994865417,0.20317798852920532,0.2281971126794815,964.61181640625,1e-05,0.08699402213096619,5.882169008255005,15.555094242095947,0 +752,0.11931560933589935,0.08064086735248566,0.08050967752933502,0.2230929434299469,587.923828125,1e-05,0.08681618422269821,5.677608013153076,15.555094242095947,0 +753,0.12525328993797302,0.1304023712873459,0.1295318752527237,0.14488781988620758,372.1910095214844,1e-05,0.08082009106874466,5.685048818588257,15.555094242095947,0 +754,0.11488357931375504,0.10104160010814667,0.1037641167640686,0.2335176169872284,458.8607482910156,1e-05,0.07723673433065414,5.6804890632629395,15.555094242095947,0 +755,0.07963870465755463,0.12064112722873688,0.11661598086357117,0.3118990361690521,633.6292114257812,1e-05,0.07514902949333191,5.6792120933532715,15.555094242095947,0 +756,0.07764796167612076,0.14924025535583496,0.14065298438072205,0.19211538136005402,961.1829223632812,1e-05,0.06579940021038055,5.6895928382873535,15.555094242095947,0 +757,0.08171743154525757,0.04614019766449928,0.04804287478327751,0.11685896664857864,273.4375,1e-05,0.0880185216665268,5.686310768127441,15.555094242095947,0 +758,0.13089196383953094,0.06675058603286743,0.06682392954826355,0.2924519181251526,705.574951171875,1e-05,0.07824642211198807,5.679722785949707,15.555094242095947,0 +759,0.07608433812856674,0.06328590214252472,0.059445299208164215,0.18241986632347107,666.9776611328125,1e-05,0.10046142339706421,5.682709693908691,15.555094242095947,0 +760,0.08949344605207443,0.0665057897567749,0.06464170664548874,0.21255607903003693,644.3798828125,1e-05,0.06928849965333939,5.685161590576172,15.555094242095947,0 +761,0.06453759968280792,0.0867702066898346,0.07948437333106995,0.23354165256023407,911.4300537109375,1e-05,0.08031418919563293,5.908910512924194,15.555094242095947,0 +762,0.08842212706804276,0.09698643535375595,0.09345898777246475,0.2589583098888397,918.259033203125,1e-05,0.08409592509269714,5.687889099121094,15.555094242095947,0 +763,0.10222825407981873,0.07820773869752884,0.07732238620519638,0.2538782060146332,753.1796264648438,1e-05,0.06849709153175354,5.673999071121216,15.555094242095947,0 +764,0.06720203161239624,0.06899121403694153,0.06257995963096619,0.21177883446216583,673.4317626953125,1e-05,0.07654739171266556,5.683696269989014,15.555094242095947,0 +765,0.062108490616083145,0.12473608553409576,0.13119280338287354,0.25524839758872986,955.4664916992188,1e-05,0.08114854246377945,5.684328317642212,15.555094242095947,0 +766,0.11877588927745819,0.08233743160963058,0.07678120583295822,0.1068749949336052,953.7914428710938,1e-05,0.0752548798918724,5.686141729354858,15.555094242095947,0 +767,0.1044849157333374,0.0993710607290268,0.08988302946090698,0.18838942050933838,911.7965698242188,1e-05,0.06410723924636841,5.676469802856445,15.555094242095947,0 +768,0.08839917927980423,0.4140126705169678,0.4119715690612793,0.2251121699810028,79.58802795410156,1e-05,0.061323244124650955,5.682466745376587,15.555094242095947,0 +769,0.08275143802165985,0.16942691802978516,0.15310201048851013,0.2144230753183365,972.9610595703125,1e-05,0.0762547105550766,5.6786298751831055,15.555094242095947,0 +770,0.1339978128671646,0.21605801582336426,0.21846544742584229,0.1415945440530777,241.93548583984375,1e-05,0.0883159190416336,5.984118223190308,15.555094242095947,0 +771,0.06441053748130798,0.07967408746480942,0.07051962614059448,0.22941505908966064,913.6167602539062,1e-05,0.0755973607301712,5.690671920776367,15.555094242095947,0 +772,0.10452409088611603,0.06267476081848145,0.0621824748814106,0.20396633446216583,757.8740844726562,1e-05,0.05392186716198921,5.809719085693359,15.555094242095947,0 +773,0.09354902803897858,0.214736670255661,0.21718300879001617,0.2518669664859772,201.34228515625,1e-05,0.09038671851158142,5.683080673217773,15.555094242095947,0 +774,0.10366129130125046,0.04975271597504616,0.051851432770490646,0.12988781929016113,978.7327270507812,1e-05,0.06179261952638626,5.679561138153076,15.555094242095947,0 +775,0.08455657958984375,0.06507425010204315,0.06639926880598068,0.22083333134651184,658.1439819335938,1e-05,0.0847494974732399,5.680662631988525,15.555094242095947,0 +776,0.06647084653377533,0.04129771515727043,0.04021923616528511,0.13043268024921417,650.1919555664062,1e-05,0.06469958275556564,5.683615446090698,15.555094242095947,0 +777,0.12871910631656647,0.1015397161245346,0.09672477841377258,0.21709133684635162,739.3790893554688,1e-05,0.0663750022649765,5.675612688064575,15.555094242095947,0 +778,0.11260302364826202,0.03258775174617767,0.03054868057370186,0.23763620853424072,758.6478271484375,1e-05,0.07601296156644821,5.6839399337768555,15.555094242095947,0 +779,0.10573714226484299,0.05865003913640976,0.06042828410863876,0.2500160038471222,732.615966796875,1e-05,0.08111443370580673,5.6873767375946045,15.555094242095947,0 +780,0.08928550779819489,0.07323252409696579,0.07926943153142929,0.2576121687889099,362.2159423828125,1e-05,0.06815074384212494,5.684890031814575,15.555094242095947,0 +781,0.08029662817716599,0.05239341780543327,0.0520588681101799,0.17596153914928436,902.0044555664062,1e-05,0.06739895045757294,5.681523561477661,15.555094242095947,0 +782,0.06819505989551544,0.11470445990562439,0.11037100851535797,0.30086538195610046,308.7349548339844,1e-05,0.10887827724218369,5.941211700439453,15.555094242095947,0 +783,0.04883584752678871,0.12578606605529785,0.1210273951292038,0.1471875011920929,964.872314453125,1e-05,0.07310227304697037,5.6748433113098145,15.555094242095947,0 +784,0.07373151183128357,0.18787138164043427,0.17877332866191864,0.23170672357082367,981.0671997070312,1e-05,0.05772416666150093,5.689841270446777,15.555094242095947,0 +785,0.09648603945970535,0.048776011914014816,0.051839832216501236,0.3046794831752777,580.8350830078125,1e-05,0.11116649955511093,5.686126708984375,15.555094242095947,0 +786,0.09509464353322983,0.12366469949483871,0.12007667869329453,0.2113221138715744,924.1397094726562,1e-05,0.0755566880106926,5.687850475311279,15.555094242095947,0 +787,0.08245980739593506,0.15508082509040833,0.141231968998909,0.23240384459495544,971.23095703125,1e-05,0.06552959233522415,5.683768272399902,15.555094242095947,0 +788,0.08683418482542038,0.07816552370786667,0.07211260497570038,0.2341907024383545,937.1871948242188,1e-05,0.08582033216953278,5.686963319778442,15.555094242095947,0 +789,0.10297902673482895,0.0825790986418724,0.078184112906456,0.2554967999458313,882.3529052734375,1e-05,0.0719490796327591,5.869536876678467,15.555094242095947,0 +790,0.10522918403148651,0.12177477031946182,0.12328094989061356,0.13326922059059143,297.256103515625,1e-05,0.07598709315061569,5.686866521835327,15.555094242095947,0 +791,0.05275236815214157,0.16289015114307404,0.15338362753391266,0.270480751991272,956.5726318359375,1e-05,0.07520859688520432,5.689711570739746,15.555094242095947,0 +792,0.10370179265737534,0.06817539781332016,0.061490170657634735,0.19968749582767487,733.4710693359375,1e-05,0.07971001416444778,5.684309005737305,15.555094242095947,0 +793,0.06690443307161331,0.23621083796024323,0.2196587324142456,0.2006249874830246,993.642333984375,1e-05,0.09218796342611313,5.688358306884766,15.555094242095947,0 +794,0.04412428289651871,0.06877751648426056,0.07349975407123566,0.19401441514492035,883.2159423828125,1e-05,0.05807353928685188,5.686532497406006,15.555094242095947,0 +795,0.04332711547613144,0.2161809504032135,0.19917984306812286,0.253004789352417,985.1694946289062,1e-05,0.06513011455535889,5.687324523925781,15.555094242095947,0 +796,0.13308699429035187,0.0714794397354126,0.07546974718570709,0.10116185247898102,297.256103515625,1e-05,0.07828325033187866,5.678479909896851,15.555094242095947,0 +797,0.11141609400510788,0.03440653905272484,0.03285922110080719,0.21473556756973267,705.574951171875,1e-05,0.08576545119285583,5.683428525924683,15.555094242095947,0 +798,0.08605898916721344,0.07781416177749634,0.07521142065525055,0.25042468309402466,897.6888427734375,1e-05,0.07424832880496979,5.6803271770477295,15.555094242095947,0 +799,0.0585455521941185,0.09440579265356064,0.09140889346599579,0.16399037837982178,965.1322021484375,1e-05,0.07639767974615097,5.68384861946106,15.555094242095947,0 +800,0.06253325939178467,0.11105793714523315,0.10929495096206665,0.2342708259820938,716.7235717773438,1e-05,0.0724308043718338,5.8369505405426025,15.555094242095947,0 +801,0.08443574607372284,0.13302487134933472,0.12661905586719513,0.19899839162826538,958.7605590820312,1e-05,0.07649525254964828,5.6929614543914795,15.555094242095947,0 +802,0.0917762815952301,0.0642850250005722,0.062078919261693954,0.2250080108642578,741.8699340820312,1e-05,0.09224666655063629,5.683440685272217,15.555094242095947,0 +803,0.11216375976800919,0.07596828788518906,0.06982163339853287,0.24685896933078766,739.3790893554688,1e-05,0.06869661062955856,5.6878440380096436,15.555094242095947,0 +804,0.08238813281059265,0.058270424604415894,0.052922673523426056,0.2474038302898407,757.8740844726562,1e-05,0.08466865867376328,5.769575119018555,15.555094242095947,0 +805,0.09197261929512024,0.07989386469125748,0.07456929236650467,0.27591344714164734,743.5170288085938,1e-05,0.08555179834365845,5.692049264907837,15.555094242095947,0 +806,0.049590907990932465,0.06755315512418747,0.06586743146181107,0.21262018382549286,801.64990234375,1e-05,0.0770980641245842,5.683741569519043,15.555094242095947,0 +807,0.06416692584753036,0.2271931916475296,0.22397466003894806,0.25121793150901794,996.9635620117188,1e-05,0.11076636612415314,5.685841798782349,15.555094242095947,0 +808,0.0991794764995575,0.16881197690963745,0.161259725689888,0.16884614527225494,950.9569091796875,1e-05,0.07207632064819336,5.688422203063965,15.555094242095947,0 +809,0.08142667263746262,0.043549396097660065,0.04238153621554375,0.18671473860740662,840.4324951171875,1e-05,0.06643810123205185,5.688715219497681,15.555094242095947,0 +810,0.06742103397846222,0.06887568533420563,0.06371726840734482,0.26337337493896484,742.69482421875,1e-05,0.07132947444915771,5.6874470710754395,15.555094242095947,0 +811,0.06668289750814438,0.13161994516849518,0.12832890450954437,0.2693910300731659,985.3936767578125,1e-05,0.08040931075811386,5.683647632598877,15.555094242095947,0 +812,0.12530021369457245,0.07786597311496735,0.07290012389421463,0.19896633923053741,760.1881103515625,1e-05,0.0827927514910698,5.901232719421387,15.555094242095947,0 +813,0.05742879584431648,0.1324678659439087,0.11782403290271759,0.2245432585477829,969.4793090820312,1e-05,0.05784435197710991,5.683522939682007,15.555094242095947,0 +814,0.0739544928073883,0.038726672530174255,0.03901923447847366,0.23440703749656677,724.7899169921875,1e-05,0.05875746160745621,5.899188041687012,15.555094242095947,0 +815,0.1423802673816681,0.0674532875418663,0.0725926086306572,0.24687498807907104,393.8356018066406,1e-05,0.09709049016237259,5.694561958312988,15.555094242095947,0 +816,0.1366274505853653,0.20137950778007507,0.205646812915802,0.20986376702785492,232.08470153808594,1e-05,0.07133521884679794,5.741051435470581,15.555094242095947,0 +817,0.08147220313549042,0.15016202628612518,0.13669221103191376,0.23536056280136108,926.8355712890625,1e-05,0.08209872245788574,5.687249660491943,15.555094242095947,0 +818,0.11689306795597076,0.05652078613638878,0.05831165611743927,0.306314080953598,884.5029296875,1e-05,0.08414579182863235,5.691410303115845,15.555094242095947,0 +819,0.05843270942568779,0.15821556746959686,0.15163393318653107,0.2524999976158142,996.9635620117188,1e-05,0.07152285426855087,5.692981958389282,15.555094242095947,0 +820,0.06832019239664078,0.23097971081733704,0.21659991145133972,0.25736376643180847,1000.0,1e-05,0.07185828685760498,5.698610305786133,15.555094242095947,0 +821,0.07137572020292282,0.07858906686306,0.08258286863565445,0.175649031996727,637.2549438476562,1e-05,0.08157890290021896,5.684662580490112,15.555094242095947,0 +822,0.11140234023332596,0.14428558945655823,0.13673719763755798,0.18737179040908813,972.9610595703125,1e-05,0.060498081147670746,5.6957619190216064,15.555094242095947,0 +823,0.07143988460302353,0.141981303691864,0.13161757588386536,0.22200319170951843,963.5654907226562,1e-05,0.06861285865306854,5.690704822540283,15.555094242095947,0 +824,0.07067953795194626,0.07713323086500168,0.07749021798372269,0.08267627656459808,796.4441528320312,1e-05,0.06410367786884308,5.6876304149627686,15.555094242095947,0 +825,0.15450087189674377,0.04741985350847244,0.05030004307627678,0.2348637729883194,474.5657653808594,1e-05,0.07588929682970047,5.691093444824219,15.555094242095947,0 +826,0.05215355381369591,0.0752946138381958,0.072683185338974,0.21786056458950043,919.6617431640625,1e-05,0.06499109417200089,5.884131193161011,15.555094242095947,0 +827,0.10686518251895905,0.0901859775185585,0.09259474277496338,0.24398235976696014,757.8740844726562,1e-05,0.0796491950750351,5.681447744369507,15.555094242095947,0 +828,0.07188358902931213,0.04469529911875725,0.04502896964550018,0.24848556518554688,872.1281127929688,1e-05,0.06577984243631363,5.683717727661133,15.555094242095947,0 +829,0.06688890606164932,0.06824807822704315,0.06784965097904205,0.17493589222431183,590.71728515625,1e-05,0.0706721842288971,5.68645977973938,15.555094242095947,0 +830,0.11544501036405563,0.05624791979789734,0.0557248480618,0.2634214758872986,873.947021484375,1e-05,0.08283621072769165,5.680956840515137,15.555094242095947,0 +831,0.07905000448226929,0.029168404638767242,0.03281893581151962,0.1611778736114502,777.2314453125,1e-05,0.0545726902782917,5.680159091949463,15.555094242095947,0 +832,0.10499641299247742,0.055354420095682144,0.056824762374162674,0.1334855705499649,601.6597900390625,1e-05,0.06906256824731827,5.904782295227051,15.555094242095947,0 +833,0.12886905670166016,0.10580828040838242,0.1047128438949585,0.2578926086425781,429.7900695800781,1e-05,0.07772500067949295,5.730502605438232,15.555094242095947,0 +834,0.10465968400239944,0.08891606330871582,0.08282075822353363,0.22099357843399048,880.177490234375,1e-05,0.06211893633008003,5.687837839126587,15.555094242095947,0 +835,0.08565855026245117,0.13234421610832214,0.12837573885917664,0.1796794831752777,965.6505737304688,1e-05,0.0661524161696434,5.677238702774048,15.555094242095947,0 +836,0.05136902257800102,0.12446147203445435,0.11963555961847305,0.21060895919799805,957.1228637695312,1e-05,0.07037314772605896,5.698377370834351,15.555094242095947,0 +837,0.047716908156871796,0.050792668014764786,0.0517236553132534,0.2751922905445099,585.1063842773438,1e-05,0.05280196666717529,5.744634389877319,15.555094242095947,0 +838,0.12421073764562607,0.07047958672046661,0.06781663000583649,0.2627083361148834,689.9642333984375,1e-05,0.08776260167360306,5.683941841125488,15.555094242095947,0 +839,0.0637684166431427,0.060257308185100555,0.060494549572467804,0.23262819647789001,905.4575805664062,1e-05,0.08015508204698563,5.677991151809692,15.555094242095947,0 +840,0.1387341022491455,0.08290344476699829,0.0787973552942276,0.25680288672447205,660.3773803710938,1e-05,0.09936017543077469,5.684252500534058,15.555094242095947,0 +841,0.07841150462627411,0.1061176285147667,0.09823202341794968,0.26027241349220276,927.5025634765625,1e-05,0.0922841876745224,5.68112850189209,15.555094242095947,0 +842,0.08122134208679199,0.15696612000465393,0.15682445466518402,0.19990384578704834,956.8480224609375,1e-05,0.07285700738430023,5.675994396209717,15.555094242095947,0 +843,0.051055364310741425,0.06941981613636017,0.07109708338975906,0.09557691961526871,943.9275512695312,1e-05,0.06606695055961609,5.960739850997925,15.555094242095947,0 +844,0.15876208245754242,0.1256350576877594,0.1188482791185379,0.22706730663776398,943.9275512695312,1e-05,0.09062779694795609,5.688819646835327,15.555094242095947,0 +845,0.06238635256886482,0.23288221657276154,0.22205623984336853,0.22596953809261322,997.7804565429688,1e-05,0.06489736586809158,5.6777567863464355,15.555094242095947,0 +846,0.1058783307671547,0.08665354549884796,0.08387463539838791,0.19312499463558197,935.6137084960938,1e-05,0.07562964409589767,5.682841062545776,15.555094242095947,0 +847,0.0733342245221138,0.09124977141618729,0.085381418466568,0.23266826570034027,878.4185791015625,1e-05,0.06296751648187637,5.899984836578369,15.555094242095947,0 +848,0.10130470991134644,0.097588449716568,0.09280265122652054,0.25872594118118286,609.6311645507812,1e-05,0.07012419402599335,5.679581165313721,15.555094242095947,0 +849,0.11255938559770584,0.055059611797332764,0.05197148770093918,0.11385416239500046,763.2398681640625,1e-05,0.0893988087773323,5.6741790771484375,15.555094242095947,0 +850,0.05378374829888344,0.17945878207683563,0.1740007996559143,0.19508813321590424,955.7438354492188,1e-05,0.06028461828827858,5.679179430007935,15.555094242095947,0 +851,0.09597218781709671,0.15579690039157867,0.14565391838550568,0.25062498450279236,972.4690551757812,1e-05,0.0663520023226738,5.6846818923950195,15.555094242095947,0 +852,0.0849151685833931,0.07588169723749161,0.0736476480960846,0.23383812606334686,617.4088745117188,1e-05,0.07237012684345245,5.684597730636597,15.555094242095947,0 +853,0.0893157571554184,0.05900860205292702,0.05543435364961624,0.16576121747493744,764.7515258789062,1e-05,0.06931864470243454,5.862759590148926,15.555094242095947,0 +854,0.09811118245124817,0.051820266991853714,0.05057041719555855,0.2290704995393753,745.9677734375,1e-05,0.08981069922447205,5.684834003448486,15.555094242095947,0 +855,0.05953793227672577,0.052152443677186966,0.05324319005012512,0.10006409883499146,524.9420166015625,1e-05,0.0650133267045021,5.672719478607178,15.555094242095947,0 +856,0.08520668745040894,0.10349638760089874,0.09909767657518387,0.19023236632347107,921.0526123046875,1e-05,0.091455839574337,5.675837278366089,15.555094242095947,0 +857,0.15959466993808746,0.04439375922083855,0.04526447504758835,0.22169069945812225,827.7026977539062,1e-05,0.10002726316452026,5.683624029159546,15.555094242095947,0 +858,0.06776253879070282,0.16732697188854218,0.1597762256860733,0.27253204584121704,980.37109375,1e-05,0.06364022195339203,5.794072151184082,15.555094242095947,0 +859,0.10153905302286148,0.03020518459379673,0.03517384082078934,0.21697916090488434,802.292236328125,1e-05,0.06909491866827011,5.672380685806274,15.555094242095947,0 +860,0.1198374405503273,0.09331955760717392,0.08707595616579056,0.24524839222431183,906.9703979492188,1e-05,0.11865232139825821,5.680881023406982,15.555094242095947,0 +861,0.09899717569351196,0.06786184757947922,0.07096271216869354,0.14142628014087677,767.0015869140625,1e-05,0.0846804529428482,5.6853907108306885,15.555094242095947,0 +862,0.09251802414655685,0.018994802609086037,0.022193295881152153,0.198685884475708,774.3531494140625,1e-05,0.06022375822067261,5.684572458267212,15.555094242095947,0 +863,0.11598963290452957,0.16586802899837494,0.15686863660812378,0.23171474039554596,964.61181640625,1e-05,0.07453619688749313,5.682945489883423,15.555094242095947,0 +864,0.06908673793077469,0.07213367521762848,0.06392611563205719,0.1566346138715744,894.4823608398438,1e-05,0.0842682272195816,5.6768152713775635,15.555094242095947,0 +865,0.07098246365785599,0.23647160828113556,0.20494408905506134,0.2791105806827545,1000.0,1e-05,0.08596988022327423,5.679136514663696,15.555094242095947,0 +866,0.09234229475259781,0.05905008316040039,0.05731235444545746,0.18012820184230804,872.1281127929688,1e-05,0.08444972336292267,5.678800344467163,15.555094242095947,0 +867,0.05725255608558655,0.0602446086704731,0.06784835457801819,0.14278845489025116,972.9610595703125,1e-05,0.08857536315917969,5.676034450531006,15.555094242095947,0 +868,0.07009607553482056,0.058485664427280426,0.05859207361936569,0.24621793627738953,774.3531494140625,1e-05,0.07650283724069595,5.679438829421997,15.555094242095947,0 +869,0.07419189810752869,0.06776735186576843,0.061853740364313126,0.26934292912483215,771.4395751953125,1e-05,0.07175364345312119,5.681580305099487,15.555094242095947,0 +870,0.08349800109863281,0.06865908205509186,0.06545066088438034,0.19500800967216492,651.3410034179688,1e-05,0.09391262382268906,5.683287620544434,15.555094242095947,0 +871,0.09128817170858383,0.023585006594657898,0.02674676850438118,0.14056089520454407,817.174560546875,1e-05,0.08491574972867966,5.684310436248779,15.555094242095947,0 +872,0.10650049149990082,0.08053629100322723,0.07870977371931076,0.14704325795173645,536.5296630859375,1e-05,0.06371885538101196,5.684263467788696,15.555094242095947,0 +873,0.08741167187690735,0.07568936794996262,0.07162869721651077,0.2587660253047943,618.6868286132812,1e-05,0.0740463063120842,5.6798484325408936,15.555094242095947,0 +874,0.11773651093244553,0.22401881217956543,0.20946626365184784,0.2847195267677307,980.8355712890625,1e-05,0.08502727746963501,5.677893161773682,15.555094242095947,0 +875,0.05711375176906586,0.07648561894893646,0.07571419328451157,0.22574518620967865,526.620361328125,1e-05,0.07807007431983948,5.682217597961426,15.555094242095947,0 +876,0.10907953232526779,0.16827204823493958,0.15900667011737823,0.2332291603088379,985.8411254882812,1e-05,0.06791292876005173,5.679341077804565,15.555094242095947,0 +877,0.08694927394390106,0.08539173752069473,0.08066319674253464,0.2301442176103592,939.9801635742188,1e-05,0.07632993161678314,5.684356927871704,15.555094242095947,0 +878,0.07810742408037186,0.13000860810279846,0.1287647932767868,0.09372595697641373,261.0759582519531,1e-05,0.06429868191480637,5.684101104736328,15.555094242095947,0 +879,0.048912592232227325,0.08153433352708817,0.07687239348888397,0.2506009638309479,837.1862182617188,1e-05,0.06206890940666199,5.69303822517395,15.555094242095947,0 +880,0.09849674999713898,0.10471583157777786,0.10611359030008316,0.22713139653205872,554.0089721679688,1e-05,0.07860997319221497,5.684005260467529,15.555094242095947,0 +881,0.07398214191198349,0.05956460162997246,0.05957474187016487,0.24269229173660278,778.6576538085938,1e-05,0.06608936190605164,5.685049057006836,15.555094242095947,0 +882,0.0591365285217762,0.09248404204845428,0.08845744282007217,0.2660176157951355,949.8078002929688,1e-05,0.07131527364253998,5.688704490661621,15.555094242095947,0 +883,0.08485431224107742,0.11303046345710754,0.10752435773611069,0.2562499940395355,984.494384765625,1e-05,0.07264556735754013,5.682333946228027,15.555094242095947,0 +884,0.09885943681001663,0.06542862206697464,0.06022783741354942,0.17858973145484924,916.1324462890625,1e-05,0.08734133094549179,5.678616523742676,15.555094242095947,0 +885,0.055788490921258926,0.10290425270795822,0.09992560744285583,0.304791659116745,757.0978393554688,1e-05,0.06974217295646667,5.697590351104736,15.555094242095947,0 +886,0.07504130154848099,0.1016547903418541,0.09799667447805405,0.2690865397453308,414.4384765625,1e-05,0.0784747526049614,5.853036642074585,15.555094242095947,0 +887,0.07830501347780228,0.2379598170518875,0.21774214506149292,0.19831730425357819,993.0098266601562,1e-05,0.10763854533433914,5.68345046043396,15.555094242095947,0 +888,0.1051148846745491,0.09539162367582321,0.09441090375185013,0.19612979888916016,421.0875244140625,1e-05,0.08024409413337708,5.68042778968811,15.555094242095947,0 +889,0.10543429851531982,0.07521673291921616,0.07475974410772324,0.23566505312919617,810.4782104492188,1e-05,0.09116742759943008,5.910624980926514,15.555094242095947,0 +890,0.0872512087225914,0.1696281135082245,0.15910759568214417,0.2542227506637573,982.677490234375,1e-05,0.076820969581604,5.685081243515015,15.555094242095947,0 +891,0.0599544420838356,0.06532357633113861,0.06071506440639496,0.17031249403953552,731.7578735351562,1e-05,0.07396701723337173,5.683756589889526,15.555094242095947,0 +892,0.06188751757144928,0.11221212148666382,0.11038072407245636,0.24387820065021515,967.9602661132812,1e-05,0.06977275013923645,5.68971061706543,15.555094242095947,0 +893,0.0972655639052391,0.09614961594343185,0.0918968990445137,0.12004807591438293,775.796630859375,1e-05,0.0717102661728859,5.6758551597595215,15.555094242095947,0 +894,0.10133757442235947,0.2163274586200714,0.2186017632484436,0.2346714586019516,238.6731414794922,1e-05,0.06830745190382004,5.68885064125061,15.555094242095947,0 +895,0.07909931242465973,0.2974422872066498,0.2954159677028656,0.25265222787857056,125.89928436279297,1e-05,0.0705183669924736,5.789707899093628,15.555094242095947,0 +896,0.07642479240894318,0.09277401119470596,0.08987238258123398,0.18525640666484833,742.69482421875,1e-05,0.0836024358868599,5.755132436752319,15.555094242095947,0 +897,0.12457939982414246,0.2726779580116272,0.2612639367580414,0.24963140487670898,153.50877380371094,1e-05,0.09012193977832794,5.691003322601318,15.555094242095947,0 +898,0.1135544627904892,0.08542934060096741,0.08575893938541412,0.20782852172851562,638.4540405273438,1e-05,0.08064425736665726,5.6884448528289795,15.555094242095947,0 +899,0.08615997433662415,0.07911575585603714,0.07882658392190933,0.23105768859386444,842.5684204101562,1e-05,0.09835249930620193,5.694138765335083,15.555094242095947,0 +900,0.11197790503501892,0.08925604075193405,0.08720662444829941,0.21453525125980377,840.4324951171875,1e-05,0.06358177214860916,5.681259870529175,15.555094242095947,0 +901,0.11366744339466095,0.08483566343784332,0.07907751947641373,0.21886217594146729,929.4871826171875,1e-05,0.06708473712205887,5.6844987869262695,15.555094242095947,0 +902,0.09467717260122299,0.06891351193189621,0.06883462518453598,0.25711536407470703,875.2998046875,1e-05,0.07351110130548477,5.687848806381226,15.555094242095947,0 +903,0.056059643626213074,0.08997110277414322,0.08557583391666412,0.26434293389320374,939.36376953125,1e-05,0.06554567068815231,5.686332702636719,15.555094242095947,0 +904,0.05326693505048752,0.1486528515815735,0.14538265764713287,0.24243588745594025,947.4830322265625,1e-05,0.06241864338517189,5.683557748794556,15.555094242095947,0 +905,0.04807313159108162,0.06359562277793884,0.06524185091257095,0.15909454226493835,876.1961669921875,1e-05,0.076657235622406,5.677138328552246,15.555094242095947,0 +906,0.10674166679382324,0.06871236115694046,0.06614500284194946,0.11576922982931137,598.9583129882812,1e-05,0.08669859915971756,5.9118359088897705,15.555094242095947,0 +907,0.06863754242658615,0.06791061908006668,0.06731729954481125,0.2571554481983185,767.7470092773438,1e-05,0.0480603352189064,5.6792311668396,15.555094242095947,0 +908,0.054836664348840714,0.18010786175727844,0.17697611451148987,0.20141024887561798,257.9365234375,1e-05,0.06373601406812668,5.680187702178955,15.555094242095947,0 +909,0.1282731592655182,0.18864117562770844,0.18819303810596466,0.282091349363327,291.41107177734375,1e-05,0.09540092200040817,5.676049470901489,15.555094242095947,0 +910,0.06930889189243317,0.11590506881475449,0.10533107072114944,0.27077722549438477,905.8369750976562,1e-05,0.07266125082969666,5.892413139343262,15.555094242095947,0 +911,0.09602423757314682,0.037957366555929184,0.039424531161785126,0.2154807597398758,846.7742309570312,1e-05,0.07804862409830093,5.679048538208008,15.555094242095947,0 +912,0.07359445840120316,0.07220539450645447,0.07315989583730698,0.19057691097259521,908.4699096679688,1e-05,0.06729584187269211,5.682607650756836,15.555094242095947,0 +913,0.13720232248306274,0.0883336067199707,0.08696763962507248,0.24516025185585022,529.9539794921875,1e-05,0.0705929547548294,5.675718784332275,15.555094242095947,0 +914,0.09378328919410706,0.09169454127550125,0.10557664185762405,0.19576120376586914,176.11683654785156,1e-05,0.07664970308542252,5.6839399337768555,15.555094242095947,0 +915,0.11530514061450958,0.0791008323431015,0.07528956979513168,0.2830929458141327,563.1868286132812,1e-05,0.08794394135475159,5.681656122207642,15.555094242095947,0 +916,0.13957884907722473,0.05680711567401886,0.05665506795048714,0.1520112156867981,812.9371337890625,1e-05,0.07836074382066727,5.679309844970703,15.555094242095947,0 +917,0.10433495789766312,0.10456681996583939,0.09487245976924896,0.25323715806007385,853.9290161132812,1e-05,0.062347620725631714,5.721864461898804,15.555094242095947,0 +918,0.06191585958003998,0.06863565742969513,0.06066501885652542,0.24466344714164734,749.19873046875,1e-05,0.06945742666721344,5.6850905418396,15.555094242095947,0 +919,0.0839545726776123,0.6575415730476379,0.7020737528800964,0.22460736334323883,19.685039520263672,1e-05,0.06873065233230591,5.6782145500183105,15.555094242095947,0 +920,0.10776585340499878,0.14460907876491547,0.15243279933929443,0.2117067277431488,456.8528137207031,1e-05,0.0658598467707634,5.677947044372559,15.555094242095947,0 +921,0.09912341088056564,0.12077700346708298,0.11907884478569031,0.2574999928474426,998.592041015625,1e-05,0.057329051196575165,5.809020042419434,15.555094242095947,0 +922,0.13967964053153992,0.14248353242874146,0.13692857325077057,0.23613780736923218,922.431884765625,1e-05,0.07585137337446213,5.696308374404907,15.555094242095947,0 +923,0.1005207970738411,0.05334169790148735,0.05398096516728401,0.1328125,905.4575805664062,1e-05,0.07627417147159576,5.678189039230347,15.555094242095947,0 +924,0.08851934224367142,0.08890567719936371,0.08809468150138855,0.14903844892978668,396.1748962402344,1e-05,0.06757150590419769,5.677988052368164,15.555094242095947,0 +925,0.13006381690502167,0.08086628466844559,0.076972596347332,0.2396794855594635,892.4485473632812,1e-05,0.09363333880901337,5.6936938762664795,15.555094242095947,0 +926,0.09501621127128601,0.08767317980527878,0.0842251181602478,0.25427883863449097,418.88299560546875,1e-05,0.06671347469091415,5.692991733551025,15.555094242095947,0 +927,0.08718030899763107,0.12525629997253418,0.11843512952327728,0.23039261996746063,916.8442993164062,1e-05,0.07150789350271225,5.682502269744873,15.555094242095947,0 +928,0.09072509407997131,0.10363242775201797,0.1017267107963562,0.1828766018152237,954.6314086914062,1e-05,0.05522322282195091,5.671433210372925,15.555094242095947,0 +929,0.09266427159309387,0.1221533864736557,0.11072254180908203,0.2983333170413971,921.0526123046875,1e-05,0.060961104929447174,5.681661367416382,15.555094242095947,0 +930,0.08725366741418839,0.0594233013689518,0.05758806690573692,0.21543268859386444,738.5433959960938,1e-05,0.06410009413957596,5.673226833343506,15.555094242095947,0 +931,0.0734751746058464,0.1550816297531128,0.1491299271583557,0.2590785026550293,989.3660888671875,1e-05,0.0627768486738205,5.687473773956299,15.555094242095947,0 +932,0.07733343541622162,0.0840793251991272,0.08046616613864899,0.23161056637763977,802.9328002929688,1e-05,0.05993432179093361,5.688623905181885,15.555094242095947,0 +933,0.07713951170444489,0.21690165996551514,0.2043953388929367,0.16654646396636963,997.7804565429688,1e-05,0.05522957071661949,5.676499128341675,15.555094242095947,0 +934,0.08123362809419632,0.5680339932441711,0.5646519064903259,0.2313862144947052,66.28787994384766,1e-05,0.06646983325481415,5.69223427772522,15.555094242095947,0 +935,0.09631926566362381,0.272938072681427,0.27041491866111755,0.25487980246543884,145.7597198486328,1e-05,0.07388254255056381,5.678869009017944,15.555094242095947,0 +936,0.09174051880836487,0.06982501596212387,0.0661010816693306,0.2014903724193573,626.2474975585938,1e-05,0.08423814922571182,5.6920671463012695,15.555094242095947,0 +937,0.10422798246145248,0.09838748723268509,0.09751733392477036,0.29275640845298767,407.6819763183594,1e-05,0.0671229213476181,5.674458026885986,15.555094242095947,0 +938,0.05583422631025314,0.1450851857662201,0.1393694281578064,0.23903043568134308,961.9814453125,1e-05,0.07130760699510574,5.680768251419067,15.555094242095947,0 +939,0.07824727147817612,0.08471223711967468,0.07822144776582718,0.2919791638851166,745.1535034179688,1e-05,0.08147598057985306,5.689218044281006,15.555094242095947,0 +940,0.1113738864660263,0.08205413073301315,0.07761406898498535,0.2033172994852066,768.4899291992188,1e-05,0.07961920648813248,5.681989669799805,15.555094242095947,0 +941,0.09089161455631256,0.13888119161128998,0.1393781304359436,0.22780448198318481,968.468505859375,1e-05,0.06897712498903275,5.675658464431763,15.555094242095947,0 +942,0.11308328807353973,0.07027255743741989,0.0666467696428299,0.24512018263339996,839.3560791015625,1e-05,0.094785675406456,5.927018642425537,15.555094242095947,0 +943,0.06988510489463806,0.035304956138134,0.036219559609889984,0.11697115004062653,890.3912353515625,1e-05,0.07363598048686981,5.688230752944946,15.555094242095947,0 +944,0.06904715299606323,0.11181983351707458,0.10941756516695023,0.2790384590625763,957.9439697265625,1e-05,0.07811489701271057,5.688077926635742,15.555094242095947,0 +945,0.10172462463378906,0.17214061319828033,0.1665797084569931,0.17404647171497345,984.494384765625,1e-05,0.064934641122818,5.682626247406006,15.555094242095947,0 +946,0.09152568876743317,0.07678484171628952,0.06868109107017517,0.24673877656459808,887.8910522460938,1e-05,0.0734267607331276,5.688075304031372,15.555094242095947,0 +947,0.07589870691299438,0.0793139785528183,0.07263129949569702,0.24076120555400848,858.8861083984375,1e-05,0.08602939546108246,5.743030071258545,15.555094242095947,0 +948,0.10530093312263489,0.09083089977502823,0.0875261053442955,0.21415863931179047,521.561767578125,1e-05,0.06925426423549652,5.693549394607544,15.555094242095947,0 +949,0.0580437071621418,0.10206486284732819,0.09260226786136627,0.16231569647789001,942.1181640625,1e-05,0.06353873014450073,5.690848350524902,15.555094242095947,0 +950,0.1148815006017685,0.15979152917861938,0.16419710218906403,0.17465543746948242,276.479736328125,1e-05,0.06903529912233353,5.686015605926514,15.555094242095947,0 +951,0.07067364454269409,0.0966169461607933,0.08680260181427002,0.2932131290435791,852.9224853515625,1e-05,0.07306806743144989,5.695251226425171,15.555094242095947,0 +952,0.1066599115729332,0.12349661439657211,0.11686747521162033,0.23895832896232605,880.6146240234375,1e-05,0.09311230480670929,5.930372476577759,15.555094242095947,0 +953,0.05063195526599884,0.27163946628570557,0.27511242032051086,0.17985576391220093,992.58642578125,1e-05,0.06999584287405014,5.681262493133545,15.555094242095947,0 +954,0.07079976797103882,0.17356662452220917,0.16883453726768494,0.21134614944458008,970.7328491210938,1e-05,0.06873513758182526,5.6856606006622314,15.555094242095947,0 +955,0.08156520128250122,0.05211970582604408,0.05356825515627861,0.23126602172851562,748.3948974609375,1e-05,0.06711409240961075,5.678035020828247,15.555094242095947,0 +956,0.07706501334905624,0.08858908712863922,0.07838261127471924,0.18629005551338196,863.2425537109375,1e-05,0.06309457123279572,5.679925203323364,15.555094242095947,0 +957,0.09271997213363647,0.09928248077630997,0.09548869729042053,0.22564902901649475,741.0423583984375,1e-05,0.06271462887525558,5.9087207317352295,15.555094242095947,0 +958,0.15693901479244232,0.1583346277475357,0.1558101922273636,0.20616985857486725,961.1829223632812,1e-05,0.07903645932674408,5.700469017028809,15.555094242095947,0 +959,0.07949256151914597,0.09708976000547409,0.09495954215526581,0.23185095191001892,919.3121948242188,1e-05,0.08518765866756439,5.69255518913269,15.555094242095947,0 +960,0.0929187759757042,0.07130659371614456,0.07066671550273895,0.27193909883499146,450.76727294921875,1e-05,0.07941703498363495,5.687272787094116,15.555094242095947,0 +961,0.0834195539355278,0.07377802580595016,0.07365892827510834,0.07363782078027725,721.2352294921875,1e-05,0.07013479620218277,5.685291767120361,15.555094242095947,0 +962,0.05801336467266083,0.11962612718343735,0.11253134906291962,0.11087339371442795,971.4794311523438,1e-05,0.06177910417318344,5.689965009689331,15.555094242095947,0 +963,0.10581354796886444,0.11889886856079102,0.11421824246644974,0.2289823591709137,976.3572998046875,1e-05,0.08509031683206558,5.892562627792358,15.555094242095947,0 +964,0.061027660965919495,0.09117364138364792,0.08938553184270859,0.20857371389865875,838.8157958984375,1e-05,0.05380477383732796,5.685667991638184,15.555094242095947,0 +965,0.09502903372049332,0.08148868381977081,0.07877327501773834,0.18830128014087677,712.13427734375,1e-05,0.05830669775605202,5.6902549266815186,15.555094242095947,0 +966,0.06753087043762207,0.08288189768791199,0.08302018791437149,0.25412657856941223,902.0044555664062,1e-05,0.10980585962533951,5.68550968170166,15.555094242095947,0 +967,0.06843249499797821,0.09514159709215164,0.09214466065168381,0.15135416388511658,876.6427001953125,1e-05,0.05998558923602104,5.689745187759399,15.555094242095947,0 +968,0.07043015956878662,0.10145030170679092,0.09846829622983932,0.1985016018152237,848.8447265625,1e-05,0.0850842073559761,5.7349395751953125,15.555094242095947,0 +969,0.08619996905326843,0.06723272055387497,0.06679446250200272,0.30223557353019714,894.4823608398438,1e-05,0.09474340081214905,5.703683614730835,15.555094242095947,0 +970,0.07180444151163101,0.02214025892317295,0.02660822868347168,0.22075319290161133,846.2532348632812,1e-05,0.06146017462015152,5.678306818008423,15.555094242095947,0 +971,0.0825781524181366,0.08987247943878174,0.0884338915348053,0.17175480723381042,954.9102783203125,1e-05,0.07226593047380447,5.6828696727752686,15.555094242095947,0 +972,0.09958090633153915,0.07313604652881622,0.07259838283061981,0.2335176169872284,669.14501953125,1e-05,0.055451396852731705,5.6804492473602295,15.555094242095947,0 +973,0.1324809491634369,0.21570540964603424,0.21283681690692902,0.23855768144130707,273.4375,1e-05,0.08185606449842453,5.911192893981934,15.555094242095947,0 +974,0.08623634278774261,0.06869558244943619,0.06250505894422531,0.2944871783256531,765.50390625,1e-05,0.05232931300997734,5.685797929763794,15.555094242095947,0 +975,0.1324041336774826,0.017490703612565994,0.02037900872528553,0.17720352113246918,710.2763671875,1e-05,0.06316960602998734,5.681628942489624,15.555094242095947,0 +976,0.11264269053936005,0.07669796049594879,0.06927017867565155,0.2414102405309677,796.4441528320312,1e-05,0.08759194612503052,5.688989877700806,15.555094242095947,0 +977,0.10017465054988861,0.10476613789796829,0.10291052609682083,0.2507852613925934,341.5697937011719,1e-05,0.06932905316352844,5.687946557998657,15.555094242095947,0 +978,0.09632199257612228,0.05870337411761284,0.05891339108347893,0.2420112043619156,780.78076171875,1e-05,0.06895549595355988,5.680245637893677,15.555094242095947,0 +979,0.0816112831234932,0.10298007726669312,0.09952928125858307,0.21159453690052032,698.8536376953125,1e-05,0.07226338982582092,5.686197996139526,15.555094242095947,0 +980,0.07211422175168991,0.08740608394145966,0.08541256934404373,0.21540865302085876,678.7020263671875,1e-05,0.05767055228352547,5.817634582519531,15.555094242095947,0 +981,0.06601627171039581,0.09723508358001709,0.0932164415717125,0.28092947602272034,814.15625,1e-05,0.07825078070163727,5.6793742179870605,15.555094242095947,0 +982,0.05216149985790253,0.0917574092745781,0.09018176048994064,0.26884615421295166,438.31170654296875,1e-05,0.08074253052473068,5.679872751235962,15.555094242095947,0 +983,0.12104550749063492,0.09546850621700287,0.08755659312009811,0.12757210433483124,940.287353515625,1e-05,0.10161392390727997,5.676968574523926,15.555094242095947,0 +984,0.10722104460000992,0.06781531125307083,0.070078544318676,0.2609134614467621,472.6368408203125,1e-05,0.06751637160778046,5.8699140548706055,15.555094242095947,0 +985,0.060584623366594315,0.12711001932621002,0.11540541797876358,0.23349358141422272,938.1237182617188,1e-05,0.0802689865231514,5.692631721496582,15.555094242095947,0 +986,0.10511737316846848,0.0754888504743576,0.07216602563858032,0.2808894217014313,645.55126953125,1e-05,0.11239761114120483,5.690963268280029,15.555094242095947,0 +987,0.08562279492616653,0.05410384759306908,0.057352084666490555,0.20296473801136017,891.62841796875,1e-05,0.07599037885665894,5.691627740859985,15.555094242095947,0 +988,0.07612483948469162,0.1352595090866089,0.13728292286396027,0.1829807609319687,956.2970581054688,1e-05,0.07843221724033356,5.692323923110962,15.555094242095947,0 +989,0.11052174121141434,0.09171642363071442,0.08693452924489975,0.21309293806552887,485.94134521484375,1e-05,0.07138552516698837,5.688523769378662,15.555094242095947,0 +990,0.1326155662536621,0.11288263648748398,0.10965994745492935,0.2182692289352417,821.9178466796875,1e-05,0.08738265186548233,5.688926458358765,15.555094242095947,0 +991,0.13299891352653503,0.08242399245500565,0.08000488579273224,0.25052082538604736,476.4851989746094,1e-05,0.08136027306318283,5.686351537704468,15.555094242095947,0 +992,0.08199219405651093,0.08811099827289581,0.08022689074277878,0.234847754240036,798.4103393554688,1e-05,0.07539980113506317,5.686938762664795,15.555094242095947,0 +993,0.1110934168100357,0.20994041860103607,0.20615160465240479,0.27842947840690613,995.728271484375,1e-05,0.0765690803527832,5.6904027462005615,15.555094242095947,0 +994,0.10949303954839706,0.08824468404054642,0.08257649093866348,0.27273234724998474,857.9046020507812,1e-05,0.08355972915887833,5.80449652671814,15.555094242095947,0 +995,0.07524140179157257,0.05898498743772507,0.05642663314938545,0.24340544641017914,633.6292114257812,1e-05,0.09280607849359512,6.038330554962158,15.555094242095947,0 +996,0.08520687371492386,0.11337357759475708,0.10932691395282745,0.2035096138715744,909.9564819335938,1e-05,0.06125923991203308,5.679392099380493,15.555094242095947,0 +997,0.056696392595767975,0.09972880035638809,0.09821563959121704,0.21332530677318573,946.6019287109375,1e-05,0.06132689118385315,5.681203842163086,15.555094242095947,0 +998,0.0763833075761795,0.10523862391710281,0.0958137959241867,0.26328524947166443,801.64990234375,1e-05,0.07899938523769379,5.672573804855347,15.555094242095947,0 +999,0.0855962485074997,0.029143767431378365,0.03035600483417511,0.13623397052288055,793.795654296875,1e-05,0.08076928555965424,5.683905839920044,15.555094242095947,0 +1000,0.08579761534929276,0.11041569709777832,0.10434602946043015,0.29733172059059143,890.3912353515625,1e-05,0.055235523730516434,5.841092109680176,15.555094242095947,0 +1001,0.11428223550319672,0.13352245092391968,0.12878817319869995,0.2621394097805023,974.1835327148438,1e-05,0.07076861709356308,5.658653020858765,15.555094242095947,0 +1002,0.03901371359825134,0.1112629771232605,0.10619177669286728,0.3085496723651886,887.4710083007812,1e-05,0.07324695587158203,5.698561191558838,15.555094242095947,0 +1003,0.06874271482229233,0.9329552054405212,0.9330672025680542,0.20473556220531464,14.822135925292969,1e-05,0.07300261408090591,5.700526475906372,15.555094242095947,0 +1004,0.100370854139328,0.08019396662712097,0.07941141724586487,0.23760415613651276,873.4939575195312,1e-05,0.07934577018022537,5.697544097900391,15.555094242095947,0 +1005,0.08825576305389404,0.10880695283412933,0.11008841544389725,0.2148958295583725,328.1711120605469,1e-05,0.05918413773179054,5.685723066329956,15.555094242095947,0 +1006,0.10803086310625076,0.09704875946044922,0.08888242393732071,0.25254005193710327,944.8242797851562,1e-05,0.06400208920240402,5.684199810028076,15.555094242095947,0 +1007,0.07086575031280518,0.11113958060741425,0.10279906541109085,0.22354966402053833,959.8422241210938,1e-05,0.07449469715356827,5.693910360336304,15.555094242095947,0 +1008,0.08698605746030807,0.10595035552978516,0.09803014248609543,0.2569310665130615,939.6723022460938,1e-05,0.06781405955553055,5.68738055229187,15.555094242095947,0 +1009,0.06237940490245819,0.0703846886754036,0.06897244602441788,0.2618910074234009,644.3798828125,1e-05,0.0824929028749466,5.686126947402954,15.555094242095947,0 +1010,0.06427424401044846,0.08458621799945831,0.07923676073551178,0.26712340116500854,876.1961669921875,1e-05,0.08845192193984985,5.685062646865845,15.555094242095947,0 +1011,0.10116959363222122,0.06044146046042442,0.05852879583835602,0.11257211118936539,529.9539794921875,1e-05,0.06477530300617218,5.791773796081543,15.555094242095947,0 +1012,0.07969212532043457,0.09052512794733047,0.09166329354047775,0.2807932496070862,583.6886596679688,1e-05,0.06107879802584648,5.682883024215698,15.555094242095947,0 +1013,0.07274670898914337,0.09646854549646378,0.09518453478813171,0.24181890487670898,816.57421875,1e-05,0.058578621596097946,5.666112422943115,15.555094242095947,0 +1014,0.16243420541286469,0.3143326938152313,0.3284060060977936,0.1598156988620758,145.7597198486328,1e-05,0.07122433930635452,5.680278539657593,15.555094242095947,0 +1015,0.11824657022953033,0.11233469098806381,0.10466232150793076,0.27426281571388245,943.3267822265625,1e-05,0.07372745871543884,5.683299779891968,15.555094242095947,0 +1016,0.08044710755348206,0.14579756557941437,0.14629259705543518,0.189823716878891,954.3519897460938,1e-05,0.07680591195821762,5.678771257400513,15.555094242095947,0 +1017,0.123238205909729,0.07442470639944077,0.06893854588270187,0.2673717737197876,529.9539794921875,1e-05,0.08754225075244904,5.68370795249939,15.555094242095947,0 +1018,0.13091890513896942,0.05140227451920509,0.053014837205410004,0.15164262056350708,840.9685668945312,1e-05,0.05768604949116707,5.6779468059539795,15.555094242095947,0 +1019,0.04965350776910782,0.12537315487861633,0.1203000620007515,0.22641825675964355,957.6707763671875,1e-05,0.06415701657533646,5.68008279800415,15.555094242095947,0 +1020,0.07376629114151001,0.08206344395875931,0.08155715465545654,0.25797274708747864,785.6611938476562,1e-05,0.08474520593881607,5.678589344024658,15.555094242095947,0 +1021,0.08315667510032654,0.07228071987628937,0.06935886293649673,0.21630607545375824,866.0933227539062,1e-05,0.06829734891653061,5.705034017562866,15.555094242095947,0 +1022,0.08596968650817871,0.07818026840686798,0.07869824022054672,0.2046714723110199,795.1236572265625,1e-05,0.07058445364236832,5.686606168746948,15.555094242095947,0 +1023,0.09916386753320694,0.8695133328437805,0.8699942231178284,0.26604166626930237,19.685039520263672,1e-05,0.07627272605895996,5.682113170623779,15.555094242095947,0 +1024,0.06967388838529587,0.09299139678478241,0.09032754600048065,0.26839742064476013,976.8355712890625,1e-05,0.06364277750253677,5.684457063674927,15.555094242095947,0 +1025,0.07633031904697418,0.052117638289928436,0.05309895798563957,0.2386137694120407,830.5369873046875,1e-05,0.07165773212909698,5.683250665664673,15.555094242095947,0 +1026,0.06109562888741493,0.07470703125,0.06810466945171356,0.22961537539958954,889.1455078125,1e-05,0.0607977956533432,5.689910888671875,15.555094242095947,0 +1027,0.07980028539896011,0.2366500198841095,0.23184113204479218,0.2519390881061554,168.68511962890625,1e-05,0.07929078489542007,5.899142742156982,15.555094242095947,0 +1028,0.07957839965820312,0.19271788001060486,0.18865332007408142,0.2503845989704132,995.10595703125,1e-05,0.07462314516305923,5.679956436157227,15.555094242095947,0 +1029,0.10669998824596405,0.1397954821586609,0.13796652853488922,0.23634614050388336,627.4900512695312,1e-05,0.057904843240976334,5.687973260879517,15.555094242095947,0 +1030,0.07613275945186615,0.0950303003191948,0.08859024196863174,0.2041987031698227,943.62744140625,1e-05,0.06681978702545166,5.688457727432251,15.555094242095947,0 +1031,0.1106572300195694,0.1934613585472107,0.21340137720108032,0.2155689001083374,157.3426513671875,1e-05,0.06492843478918076,5.675842523574829,15.555094242095947,0 +1032,0.050664301961660385,0.06620604544878006,0.057554688304662704,0.200536847114563,887.8910522460938,1e-05,0.06637091189622879,5.6883814334869385,15.555094242095947,0 +1033,0.10064735263586044,0.046382348984479904,0.04733188822865486,0.2119150608778,725.671142578125,1e-05,0.08246294409036636,5.6903040409088135,15.555094242095947,0 +1034,0.07649162411689758,0.11238819360733032,0.10457459837198257,0.13112980127334595,963.5654907226562,1e-05,0.07312262058258057,5.684945821762085,15.555094242095947,0 +1035,0.08512237668037415,0.06070965528488159,0.05786307528614998,0.23072916269302368,889.1455078125,1e-05,0.0735158920288086,5.690019607543945,15.555094242095947,0 +1036,0.08164163678884506,0.08064153045415878,0.07736866176128387,0.27599358558654785,858.8861083984375,1e-05,0.08060643076896667,5.68050742149353,15.555094242095947,0 +1037,0.10110732167959213,0.09053323417901993,0.08526766300201416,0.2513461410999298,874.3990478515625,1e-05,0.06562545895576477,5.678191423416138,15.555094242095947,0 +1038,0.0855034813284874,0.08622820675373077,0.08105870336294174,0.2581089735031128,734.3234252929688,1e-05,0.06513963639736176,5.675527811050415,15.555094242095947,0 +1039,0.09382277727127075,0.10449311882257462,0.09917955100536346,0.21946313977241516,696.9026489257812,1e-05,0.07143527269363403,5.685939311981201,15.555094242095947,0 +1040,0.12623418867588043,0.0972810834646225,0.0971403494477272,0.22071313858032227,498.798095703125,1e-05,0.08785005658864975,5.691862344741821,15.555094242095947,0 +1041,0.11571869999170303,0.07760006934404373,0.0762542113661766,0.1341666579246521,652.4856567382812,1e-05,0.07350204139947891,5.683000802993774,15.555094242095947,0 +1042,0.091812364757061,0.03823840245604515,0.040573060512542725,0.15308493375778198,704.624755859375,1e-05,0.07183915376663208,5.908707141876221,15.555094242095947,0 +1043,0.12797322869300842,0.1237511858344078,0.12754856050014496,0.11581730097532272,526.620361328125,1e-05,0.07010786235332489,5.679692029953003,15.555094242095947,0 +1044,0.07988765090703964,0.1072162389755249,0.10523401945829391,0.22015222907066345,333.5777282714844,1e-05,0.061308603733778,5.689116716384888,15.555094242095947,0 +1045,0.05702975392341614,0.1096162274479866,0.10522416234016418,0.2557692229747772,872.5845947265625,1e-05,0.07114681601524353,5.6835949420928955,15.555094242095947,0 +1046,0.13869965076446533,0.0912565141916275,0.09374707192182541,0.20658652484416962,544.5823974609375,1e-05,0.072752945125103,5.683248043060303,15.555094242095947,0 +1047,0.1094558984041214,0.10470163077116013,0.1009121686220169,0.2261698693037033,958.7605590820312,1e-05,0.07311877608299255,5.830135822296143,15.555094242095947,0 +1048,0.06360812485218048,0.03640618920326233,0.03681204468011856,0.136955127120018,860.34912109375,1e-05,0.07970796525478363,5.6752769947052,15.555094242095947,0 +1049,0.07650060951709747,0.04850276559591293,0.05060030519962311,0.14318108558654785,861.80126953125,1e-05,0.07490913569927216,5.677396059036255,15.555094242095947,0 +1050,0.09295830875635147,0.04951319098472595,0.04951906576752663,0.2519150674343109,722.12841796875,1e-05,0.05831163004040718,5.68878436088562,15.555094242095947,0 +1051,0.1258450299501419,0.11270307004451752,0.11032900959253311,0.16012820601463318,245.17686462402344,1e-05,0.06274817138910294,5.683198690414429,15.555094242095947,0 +1052,0.0823582261800766,0.12373358011245728,0.1245344877243042,0.14711537957191467,190.67796325683594,1e-05,0.08019795268774033,5.682410717010498,15.555094242095947,0 +1053,0.08037305623292923,0.12729880213737488,0.13053478300571442,0.27282851934432983,273.4375,1e-05,0.06526228040456772,5.685938119888306,15.555094242095947,0 +1054,0.10630811750888824,0.17530719935894012,0.16859763860702515,0.1737099289894104,971.4794311523438,1e-05,0.07416719198226929,5.686732053756714,15.555094242095947,0 +1055,0.0869613066315651,0.09013828635215759,0.08873620629310608,0.18565703928470612,617.4088745117188,1e-05,0.07013208419084549,5.684728384017944,15.555094242095947,0 +1056,0.12770028412342072,0.14174441993236542,0.13945627212524414,0.23173877596855164,939.36376953125,1e-05,0.08108910173177719,5.68201208114624,15.555094242095947,0 +1057,0.09582313895225525,0.09553686529397964,0.09003709256649017,0.22014422714710236,824.2506713867188,1e-05,0.07398821413516998,5.685626745223999,15.555094242095947,0 +1058,0.08433057367801666,0.08694396913051605,0.08008556067943573,0.2172195464372635,951.8129272460938,1e-05,0.06943085789680481,5.898208856582642,15.555094242095947,0 +1059,0.044940389692783356,0.06973174959421158,0.0753931999206543,0.18946313858032227,434.0730895996094,1e-05,0.047034624963998795,5.679832696914673,15.555094242095947,0 +1060,0.10657946020364761,0.07618023455142975,0.07868481427431107,0.23367787897586823,957.1228637695312,1e-05,0.07003702223300934,5.680931329727173,15.555094242095947,0 +1061,0.09718257933855057,0.11093034595251083,0.11175303161144257,0.18975961208343506,910.3261108398438,1e-05,0.06959477066993713,5.675167083740234,15.555094242095947,0 +1062,0.09143766760826111,0.0779014378786087,0.07174499332904816,0.2783733904361725,643.2039184570312,1e-05,0.07114566117525101,5.6785924434661865,15.555094242095947,0 +1063,0.07678592205047607,0.05725959688425064,0.054187141358852386,0.23411056399345398,731.7578735351562,1e-05,0.06104965880513191,5.6984405517578125,15.555094242095947,0 +1064,0.08718031644821167,0.1701083928346634,0.15517814457416534,0.20230768620967865,973.6957397460938,1e-05,0.06507977098226547,5.679927825927734,15.555094242095947,0 +1065,0.09041190147399902,0.0843234732747078,0.07966359704732895,0.21738781034946442,680.7832641601562,1e-05,0.07050985842943192,5.683127403259277,15.555094242095947,0 +1066,0.09910216927528381,0.09954409301280975,0.08854171633720398,0.23112979531288147,954.3519897460938,1e-05,0.06751450151205063,5.683531284332275,15.555094242095947,0 +1067,0.11340324580669403,0.2353827953338623,0.22687968611717224,0.1930048018693924,977.3124389648438,1e-05,0.07070342451334,5.687974214553833,15.555094242095947,0 +1068,0.1058824211359024,0.1393209546804428,0.12849974632263184,0.22315704822540283,981.2984008789062,1e-05,0.06691482663154602,5.90449595451355,15.555094242095947,0 +1069,0.08889632672071457,0.2719106376171112,0.2679201066493988,0.20009614527225494,998.9959716796875,1e-05,0.06626330316066742,5.6877405643463135,15.555094242095947,0 +1070,0.08012821525335312,0.1076197475194931,0.10405241698026657,0.23028044402599335,935.6137084960938,1e-05,0.06079554557800293,5.677380323410034,15.555094242095947,0 +1071,0.0841599777340889,0.15193095803260803,0.14806653559207916,0.2122996747493744,976.3572998046875,1e-05,0.07212735712528229,5.685875654220581,15.555094242095947,0 +1072,0.09360561519861221,0.05183768272399902,0.054478999227285385,0.23638620972633362,632.4110717773438,1e-05,0.06924344599246979,5.687164068222046,15.555094242095947,0 +1073,0.08703921735286713,0.3662063479423523,0.36928874254226685,0.19644230604171753,117.75362396240234,1e-05,0.0611938051879406,5.6851983070373535,15.555094242095947,0 +1074,0.06616532057523727,0.0706978440284729,0.06957674026489258,0.21505607664585114,933.7044067382812,1e-05,0.06626277416944504,5.720024585723877,15.555094242095947,0 +1075,0.09749826788902283,0.14357084035873413,0.1450163573026657,0.21453525125980377,949.5192260742188,1e-05,0.08828415721654892,5.677196025848389,15.555094242095947,0 +1076,0.11850089579820633,0.09492021799087524,0.0984562337398529,0.21361377835273743,971.9750366210938,1e-05,0.06637145578861237,5.667914390563965,15.555094242095947,0 +1077,0.10980165004730225,0.09496398270130157,0.09329163283109665,0.20382210612297058,861.80126953125,1e-05,0.06859614700078964,5.684811592102051,15.555094242095947,0 +1078,0.06560904532670975,0.03738277778029442,0.04345546290278435,0.21629005670547485,460.8586120605469,1e-05,0.09585970640182495,5.675569534301758,15.555094242095947,0 +1079,0.0864279642701149,0.08737430721521378,0.0831783190369606,0.20416666567325592,900.0560302734375,1e-05,0.06260507553815842,5.8227455615997314,15.555094242095947,0 +1080,0.08188126236200333,0.03684619441628456,0.03923502191901207,0.20767627656459808,691.9642944335938,1e-05,0.06831225007772446,5.6906418800354,15.555094242095947,0 +1081,0.10626713931560516,0.07853879034519196,0.08514353632926941,0.09109774976968765,618.6868286132812,1e-05,0.07021237909793854,5.686439275741577,15.555094242095947,0 +1082,0.0934062972664833,0.04263359680771828,0.04294361174106598,0.1027243584394455,767.0015869140625,1e-05,0.057446565479040146,5.682872295379639,15.555094242095947,0 +1083,0.04281814023852348,0.1868904083967209,0.1803612858057022,0.22738781571388245,988.7123413085938,1e-05,0.06141480430960655,5.689270973205566,15.555094242095947,0 +1084,0.06590051203966141,0.09905397146940231,0.09632182866334915,0.09704326838254929,972.4690551757812,1e-05,0.06912712752819061,5.695468425750732,15.555094242095947,0 +1085,0.12383326143026352,0.06336314231157303,0.06297657638788223,0.2565625011920929,857.9046020507812,1e-05,0.07026325166225433,5.922009706497192,15.555094242095947,0 +1086,0.0658646821975708,0.07533085346221924,0.07134775817394257,0.2322676181793213,554.0089721679688,1e-05,0.07810758054256439,5.68821907043457,15.555094242095947,0 +1087,0.10040738433599472,0.05222256854176521,0.053150475025177,0.18861377239227295,860.34912109375,1e-05,0.07147352397441864,5.694117546081543,15.555094242095947,0 +1088,0.06657329201698303,0.0449865497648716,0.046157531440258026,0.1070673018693924,603.0020751953125,1e-05,0.058786846697330475,5.688424348831177,15.555094242095947,0 +1089,0.073882095515728,0.10383162647485733,0.09535898268222809,0.2180688977241516,695.9219970703125,1e-05,0.07429856806993484,5.930697679519653,15.555094242095947,0 +1090,0.10813173651695251,0.09740037471055984,0.09781821817159653,0.09657050669193268,986.064208984375,1e-05,0.0666385143995285,5.693062782287598,15.555094242095947,0 +1091,0.06654392927885056,0.11175838112831116,0.11378034204244614,0.2726842761039734,975.8771362304688,1e-05,0.09344754368066788,5.70199179649353,15.555094242095947,0 +1092,0.07082317024469376,0.07109300047159195,0.06851903349161148,0.27513620257377625,764.7515258789062,1e-05,0.06805182993412018,5.693548202514648,15.555094242095947,0 +1093,0.0708451122045517,0.07317773997783661,0.07815591990947723,0.2733333110809326,528.291015625,1e-05,0.07549690455198288,5.6926960945129395,15.555094242095947,0 +1094,0.05609259754419327,0.09342150390148163,0.08453460037708282,0.22680287063121796,941.8146362304688,1e-05,0.08105719089508057,5.6868579387664795,15.555094242095947,0 +1095,0.10593081265687943,0.10884600132703781,0.11161325126886368,0.13153044879436493,264.1955871582031,1e-05,0.10172678530216217,5.926694631576538,15.555094242095947,0 +1096,0.07562649995088577,0.06534839421510696,0.07147493213415146,0.16707532107830048,975.6365966796875,1e-05,0.0752757117152214,5.687361717224121,15.555094242095947,0 +1097,0.11955173313617706,0.09940192103385925,0.10270047932863235,0.22316505014896393,960.1112060546875,1e-05,0.1059199646115303,5.6762919425964355,15.555094242095947,0 +1098,0.06221161037683487,0.05082796886563301,0.053089287132024765,0.23565703630447388,898.8763427734375,1e-05,0.05641559511423111,5.678076982498169,15.555094242095947,0 +1099,0.057640425860881805,0.12753337621688843,0.12705743312835693,0.1906730681657791,325.4438171386719,1e-05,0.06383468955755234,5.688771963119507,15.555094242095947,0 +1100,0.058090098202228546,0.10729335248470306,0.09725125133991241,0.2301442176103592,949.8078002929688,1e-05,0.07888473570346832,5.683292627334595,15.555094242095947,0 +1101,0.03677143156528473,0.17726032435894012,0.18446701765060425,0.23335736989974976,998.592041015625,1e-05,0.06853727251291275,5.684702396392822,15.555094242095947,0 +1102,0.07989808917045593,0.12479359656572342,0.12349583953619003,0.2777003049850464,955.7438354492188,1e-05,0.06874336302280426,5.688094615936279,15.555094242095947,0 +1103,0.08983314782381058,0.09183881431818008,0.08558021485805511,0.2741265892982483,722.12841796875,1e-05,0.07178632915019989,5.679094076156616,15.555094242095947,0 +1104,0.09564807265996933,0.11263278871774673,0.10957234352827072,0.1936698704957962,931.7718505859375,1e-05,0.07495743781328201,5.682148456573486,15.555094242095947,0 +1105,0.15340730547904968,0.13083112239837646,0.1346251517534256,0.1917548030614853,440.41455078125,1e-05,0.06576154381036758,5.686018705368042,15.555094242095947,0 +1106,0.12973999977111816,0.17209284007549286,0.15041643381118774,0.23394230008125305,969.9821166992188,1e-05,0.07499833405017853,5.68727970123291,15.555094242095947,0 +1107,0.0833057388663292,0.05660451203584671,0.05484222248196602,0.14973556995391846,541.3831787109375,1e-05,0.07891742140054703,5.685877323150635,15.555094242095947,0 +1108,0.10296835005283356,0.2818942368030548,0.2906998097896576,0.26560094952583313,149.64788818359375,1e-05,0.05479619279503822,5.6825525760650635,15.555094242095947,0 +1109,0.08896715939044952,0.09640198200941086,0.09671927988529205,0.17643429338932037,870.7523803710938,1e-05,0.0642303079366684,5.682142496109009,15.555094242095947,0 +1110,0.06645721197128296,0.09169972687959671,0.08977615833282471,0.21901442110538483,923.1171264648438,1e-05,0.07438501715660095,5.6836607456207275,15.555094242095947,0 +1111,0.12562982738018036,0.06799618899822235,0.06680400669574738,0.10664262622594833,582.2649536132812,1e-05,0.0745428130030632,5.666972875595093,15.555094242095947,0 +1112,0.08658281713724136,0.18545037508010864,0.1867058426141739,0.29132211208343506,986.2869873046875,1e-05,0.058642417192459106,5.686757326126099,15.555094242095947,0 +1113,0.12372975051403046,0.07985282689332962,0.07740102708339691,0.261081725358963,512.9716796875,1e-05,0.08179240673780441,5.679124593734741,15.555094242095947,0 +1114,0.11878769099712372,0.438260018825531,0.43593186140060425,0.22609774768352509,101.10294342041016,1e-05,0.08225811272859573,5.68466329574585,15.555094242095947,0 +1115,0.11490871757268906,0.06891379505395889,0.06795509159564972,0.1587499976158142,546.1712036132812,1e-05,0.070409394800663,5.682085990905762,15.555094242095947,0 +1116,0.09649975597858429,0.07166452705860138,0.07073553651571274,0.20857371389865875,771.4395751953125,1e-05,0.07919207960367203,5.680788516998291,15.555094242095947,0 +1117,0.1263647824525833,0.08109813928604126,0.07828222960233688,0.2254006266593933,911.4300537109375,1e-05,0.0491521991789341,5.684516429901123,15.555094242095947,0 +1118,0.09376608580350876,0.0980607122182846,0.09055532515048981,0.26414263248443604,962.7756958007812,1e-05,0.07025149464607239,5.682321786880493,15.555094242095947,0 +1119,0.0708797499537468,0.13329146802425385,0.12238429486751556,0.28496792912483215,969.9821166992188,1e-05,0.058096662163734436,5.694659233093262,15.555094242095947,0 +1120,0.08689548820257187,0.06112002581357956,0.06162569299340248,0.09651441872119904,593.4874267578125,1e-05,0.06269064545631409,5.685521125793457,15.555094242095947,0 +1121,0.0888679251074791,0.06150970607995987,0.06259722262620926,0.14328524470329285,801.64990234375,1e-05,0.06642688065767288,5.687838792800903,15.555094242095947,0 +1122,0.07791594415903091,0.27601778507232666,0.261473149061203,0.2522195279598236,997.3726806640625,1e-05,0.06677522510290146,5.6821489334106445,15.555094242095947,0 +1123,0.08078483492136002,0.01987488940358162,0.02293906733393669,0.17497596144676208,631.1881713867188,1e-05,0.06462806463241577,5.684748649597168,15.555094242095947,0 +1124,0.10214275121688843,0.05341869965195656,0.052078377455472946,0.2592547833919525,528.291015625,1e-05,0.07548163086175919,5.679046392440796,15.555094242095947,0 +1125,0.07809600979089737,0.12545277178287506,0.12766270339488983,0.18638621270656586,935.6137084960938,1e-05,0.05612063780426979,5.677725315093994,15.555094242095947,0 +1126,0.10341387987136841,0.06617020815610886,0.07282019406557083,0.12489582598209381,970.7328491210938,1e-05,0.07203474640846252,5.685728073120117,15.555094242095947,0 +1127,0.07676549255847931,0.09473799169063568,0.09612617641687393,0.23786857724189758,374.6498718261719,1e-05,0.07366812974214554,5.857511043548584,15.555094242095947,0 +1128,0.07545288652181625,0.10479112714529037,0.10038620978593826,0.2435256391763687,833.3333129882812,1e-05,0.06369160115718842,5.673916816711426,15.555094242095947,0 +1129,0.08158502727746964,0.047719359397888184,0.04599699378013611,0.21782051026821136,739.3790893554688,1e-05,0.05285806208848953,5.685692310333252,15.555094242095947,0 +1130,0.10863041877746582,0.07361996173858643,0.06902825832366943,0.29739582538604736,670.22265625,1e-05,0.08028889447450638,5.677177906036377,15.555094242095947,0 +1131,0.06509403884410858,0.13947415351867676,0.12940099835395813,0.1816185861825943,997.5768432617188,1e-05,0.061058349907398224,5.6795806884765625,15.555094242095947,0 +1132,0.10749321430921555,0.09351063519716263,0.09217287600040436,0.11091345548629761,764.7515258789062,1e-05,0.06378375738859177,5.686227083206177,15.555094242095947,0 +1133,0.109684057533741,0.14012405276298523,0.151123046875,0.16201922297477722,980.8355712890625,1e-05,0.08782527595758438,5.675450563430786,15.555094242095947,0 +1134,0.0940907895565033,0.09121980518102646,0.08774951845407486,0.1943509578704834,622.4899291992188,1e-05,0.07273504883050919,5.682790279388428,15.555094242095947,0 +1135,0.08672156929969788,0.1268094778060913,0.11957340687513351,0.28447115421295166,941.5103759765625,1e-05,0.07109304517507553,5.677022933959961,15.555094242095947,0 +1136,0.1029312014579773,0.05755149573087692,0.059234827756881714,0.18589742481708527,896.4932861328125,1e-05,0.08625141531229019,5.681705951690674,15.555094242095947,0 +1137,0.06697703152894974,0.08947504311800003,0.07980953902006149,0.21523235738277435,860.34912109375,1e-05,0.07116673141717911,5.698445081710815,15.555094242095947,0 +1138,0.08856232464313507,0.06703300774097443,0.06783179193735123,0.20664262771606445,523.2557983398438,1e-05,0.08931363373994827,5.787841081619263,15.555094242095947,0 +1139,0.12401670217514038,0.18797655403614044,0.18496479094028473,0.25389420986175537,222.03948974609375,1e-05,0.09546701610088348,5.833527088165283,15.555094242095947,0 +1140,0.08192791789770126,0.04296381026506424,0.04547537490725517,0.06943108886480331,912.5270385742188,1e-05,0.06917174160480499,5.684677600860596,15.555094242095947,0 +1141,0.1311967372894287,0.13950560986995697,0.14006704092025757,0.27213940024375916,267.29559326171875,1e-05,0.09127124398946762,5.885075330734253,15.555094242095947,0 +1142,0.08024328202009201,0.10044848173856735,0.09740065783262253,0.14711537957191467,918.9618530273438,1e-05,0.06784026324748993,5.736334800720215,15.555094242095947,0 +1143,0.08322498202323914,0.3290528357028961,0.3312200605869293,0.11999999731779099,137.90036010742188,1e-05,0.05828598514199257,5.675723552703857,15.555094242095947,0 +1144,0.09744025766849518,0.09455408155918121,0.08589721471071243,0.21298877894878387,822.50341796875,1e-05,0.07339727878570557,5.681368589401245,15.555094242095947,0 +1145,0.0812344178557396,0.04896342381834984,0.05188760906457901,0.2561778724193573,425.4617614746094,1e-05,0.08375757187604904,5.684439659118652,15.555094242095947,0 +1146,0.10406020283699036,0.08035340905189514,0.08083813637495041,0.21246793866157532,934.0242309570312,1e-05,0.07160159945487976,5.680374622344971,15.555094242095947,0 +1147,0.06507830321788788,0.12311483174562454,0.11618953943252563,0.23490384221076965,885.7808837890625,1e-05,0.07822313159704208,5.686987638473511,15.555094242095947,0 +1148,0.09625112265348434,0.13748563826084137,0.13333012163639069,0.19359774887561798,502.3923645019531,1e-05,0.08392760902643204,5.928394794464111,15.555094242095947,0 +1149,0.07257497310638428,0.040611859411001205,0.043799158185720444,0.1429567188024521,767.0015869140625,1e-05,0.08338307589292526,5.687652826309204,15.555094242095947,0 +1150,0.04941538721323013,0.06381385773420334,0.06917504966259003,0.16487178206443787,462.8463439941406,1e-05,0.07626347243785858,5.680879592895508,15.555094242095947,0 +1151,0.07261234521865845,0.12195201218128204,0.1175118163228035,0.21705126762390137,929.1580810546875,1e-05,0.062161099165678024,5.680915832519531,15.555094242095947,0 +1152,0.10744556039571762,0.11616408079862595,0.10707293450832367,0.27524036169052124,596.2343139648438,1e-05,0.10003510117530823,5.91305685043335,15.555094242095947,0 +1153,0.10969281196594238,0.06024668738245964,0.06173689290881157,0.1647355705499649,349.42364501953125,1e-05,0.07707306742668152,5.686821699142456,15.555094242095947,0 +1154,0.06360779702663422,0.06223847344517708,0.06144851818680763,0.13333332538604736,956.8480224609375,1e-05,0.06084084138274193,5.68502140045166,15.555094242095947,0 +1155,0.061100587248802185,0.056976091116666794,0.057055551558732986,0.2947435677051544,531.6091918945312,1e-05,0.0655892863869667,5.6856231689453125,15.555094242095947,0 +1156,0.08940189331769943,0.18751618266105652,0.17980894446372986,0.21582531929016113,991.9489135742188,1e-05,0.07130303233861923,5.679553747177124,15.555094242095947,0 +1157,0.10296215116977692,0.31860920786857605,0.31375154852867126,0.22635415196418762,105.31136322021484,1e-05,0.07354766130447388,5.680768013000488,15.555094242095947,0 +1158,0.0970713198184967,0.08436238020658493,0.0795704796910286,0.21349358558654785,901.616455078125,1e-05,0.06986109912395477,5.70512318611145,15.555094242095947,0 +1159,0.09085909277200699,0.10607565194368362,0.11157424002885818,0.2689743638038635,294.342529296875,1e-05,0.07071254402399063,5.711646795272827,15.555094242095947,1 +1160,0.06217426434159279,0.1037992388010025,0.0982908383011818,0.1584695428609848,909.21484375,1e-05,0.09608617424964905,5.684458255767822,15.555094242095947,1 +1161,0.06454015523195267,0.048544347286224365,0.04824568331241608,0.1274038404226303,891.2169799804688,1e-05,0.060861531645059586,5.687835216522217,15.555094242095947,1 +1162,0.07665552943944931,0.09348975121974945,0.09424993395805359,0.23656249046325684,949.22998046875,1e-05,0.0859094187617302,5.890443563461304,15.555094242095947,1 +1163,0.05530090630054474,0.14052487909793854,0.13685797154903412,0.21891024708747864,933.3839721679688,1e-05,0.08374542742967606,5.686221122741699,15.555094242095947,1 +1164,0.08166919648647308,0.11338068544864655,0.11336074769496918,0.1346554458141327,960.6482543945312,1e-05,0.07257286459207535,5.689986228942871,15.555094242095947,1 +1165,0.08000467717647552,0.047865092754364014,0.050944823771715164,0.27230769395828247,544.5823974609375,1e-05,0.08742053806781769,5.680185556411743,15.555094242095947,1 +1166,0.07952902466058731,0.11235886067152023,0.10872355103492737,0.22804486751556396,866.564453125,1e-05,0.08587563037872314,5.693300008773804,15.555094242095947,1 +1167,0.07428128272294998,0.05245975777506828,0.05397726222872734,0.18753203749656677,855.9268798828125,1e-05,0.08102500438690186,5.68984842300415,15.555094242095947,1 +1168,0.11340649425983429,0.0794776901602745,0.07964685559272766,0.19237980246543884,938.4346313476562,1e-05,0.09738834202289581,5.692519664764404,15.555094242095947,1 +1169,0.11555563658475876,0.23329338431358337,0.2154533565044403,0.22784453630447388,996.3473510742188,1e-05,0.061181794852018356,5.70568060874939,15.555094242095947,1 +1170,0.06848115473985672,0.07175280153751373,0.06877860426902771,0.19487980008125305,872.1281127929688,1e-05,0.10035848617553711,5.717063903808594,15.555094242095947,1 +1171,0.08295366913080215,0.08228743821382523,0.07843898236751556,0.2662900686264038,833.8881225585938,1e-05,0.07067444175481796,5.698233604431152,15.555094242095947,1 +1172,0.10644170641899109,0.17552021145820618,0.17843352258205414,0.24320511519908905,183.4470977783203,1e-05,0.0833309069275856,5.699193477630615,15.555094242095947,1 +1173,0.10778654366731644,0.08731672912836075,0.079574815928936,0.2885817289352417,914.3394165039062,1e-05,0.08440704643726349,5.928116321563721,15.555094242095947,1 +1174,0.07617123425006866,0.057085391134023666,0.05116628110408783,0.22967948019504547,694.9378051757812,1e-05,0.06303228437900543,5.747687101364136,15.555094242095947,1 +1175,0.11138994991779327,0.15906034409999847,0.14801424741744995,0.2318830043077469,979.4371948242188,1e-05,0.08435944467782974,5.689120769500732,15.555094242095947,1 +1176,0.06157081946730614,0.030679132789373398,0.031267985701560974,0.25699517130851746,799.0620727539062,1e-05,0.0675731897354126,5.689438819885254,15.555094242095947,1 +1177,0.05802299082279205,0.22585232555866241,0.19559596478939056,0.29604166746139526,991.0935668945312,1e-05,0.06923291087150574,5.693087816238403,15.555094242095947,1 +1178,0.10813426971435547,0.06731164455413818,0.06232805922627449,0.2318830043077469,852.4172973632812,1e-05,0.07704596221446991,5.688271522521973,15.555094242095947,1 +1179,0.06145273149013519,0.06629219651222229,0.06563521921634674,0.17132210731506348,826.5582275390625,1e-05,0.07011940330266953,5.683899402618408,15.555094242095947,1 +1180,0.07677652686834335,0.09200364351272583,0.0924239382147789,0.19862179458141327,920.7059936523438,1e-05,0.06555125117301941,5.6754820346832275,15.555094242095947,1 +1181,0.08645129948854446,0.04906311631202698,0.0488828606903553,0.1690785139799118,838.8157958984375,1e-05,0.07032511383295059,5.8938164710998535,15.555094242095947,1 +1182,0.0877700001001358,0.07424749433994293,0.07167363166809082,0.2261698693037033,806.7376098632812,1e-05,0.07638678699731827,5.69079065322876,15.555094242095947,1 +1183,0.06384818255901337,0.17402847111225128,0.16070300340652466,0.21081730723381042,959.8422241210938,1e-05,0.0674307569861412,5.692653179168701,15.555094242095947,1 +1184,0.08731946349143982,0.09259290248155594,0.09141846746206284,0.07413461059331894,996.7586059570312,1e-05,0.05849046632647514,5.7268712520599365,15.555094242095947,1 +1185,0.043943341821432114,0.17455421388149261,0.15637172758579254,0.22692306339740753,991.3079833984375,1e-05,0.062048524618148804,5.682125568389893,15.555094242095947,1 +1186,0.05861039459705353,0.09329710900783539,0.09330753982067108,0.23614582419395447,950.3834838867188,1e-05,0.058084484189748764,5.681195020675659,15.555094242095947,1 +1187,0.04465450718998909,0.05897514894604683,0.05988205224275589,0.19399037957191467,911.0628662109375,1e-05,0.048855096101760864,5.67302393913269,15.555094242095947,1 +1188,0.1073225885629654,0.11791874468326569,0.11190244555473328,0.26451119780540466,973.6957397460938,1e-05,0.07287909835577011,5.685080528259277,15.555094242095947,1 +1189,0.09400264918804169,0.06861453503370285,0.0641704797744751,0.12185095995664597,925.1558837890625,1e-05,0.06109737232327461,5.687825679779053,15.555094242095947,1 +1190,0.055716801434755325,0.0513472817838192,0.05483366176486015,0.1070673018693924,965.1322021484375,1e-05,0.06023476645350456,5.702315330505371,15.555094242095947,1 +1191,0.12452215701341629,0.07698795199394226,0.06906775385141373,0.2722756266593933,762.48046875,1e-05,0.060693804174661636,5.700005531311035,15.555094242095947,1 +1192,0.06237997114658356,0.08970952033996582,0.0880778506398201,0.25370991230010986,913.2543334960938,1e-05,0.06409221887588501,5.704830884933472,15.555094242095947,1 +1193,0.12775056064128876,0.09450092911720276,0.09249100089073181,0.23392626643180847,655.8935546875,1e-05,0.05909491702914238,5.692693471908569,15.555094242095947,1 +1194,0.08472808450460434,0.09219317138195038,0.08877147734165192,0.2276201844215393,966.9384155273438,1e-05,0.07107490301132202,5.933623552322388,15.555094242095947,1 +1195,0.06105895712971687,0.12082741409540176,0.11406844854354858,0.21329325437545776,959.0316162109375,1e-05,0.07620902359485626,5.676713705062866,15.555094242095947,1 +1196,0.06882663071155548,0.13911600410938263,0.1329919695854187,0.2721714675426483,270.376220703125,1e-05,0.07157989591360092,5.692021369934082,15.555094242095947,1 +1197,0.08137787133455276,0.06351463496685028,0.05922389030456543,0.14636217057704926,518.14990234375,1e-05,0.07497105747461319,5.683420419692993,15.555094242095947,1 +1198,0.09863196313381195,0.09636294841766357,0.09270204603672028,0.2335096001625061,828.8410034179688,1e-05,0.07983649522066116,5.6930553913116455,15.555094242095947,1 +1199,0.05879666656255722,0.08217566460371017,0.07567702233791351,0.1405208259820938,831.0991821289062,1e-05,0.062037937343120575,5.6899635791778564,15.555094242095947,1 +1200,0.1274735927581787,0.2801821231842041,0.27428334951400757,0.198581725358963,129.92831420898438,1e-05,0.09814038127660751,5.7124199867248535,15.555094242095947,1 +1201,0.07597692310810089,0.1173642948269844,0.11110001802444458,0.2090063989162445,913.6167602539062,1e-05,0.05692830681800842,5.691513299942017,15.555094242095947,1 +1202,0.09678319841623306,0.02440084144473076,0.028916750103235245,0.1927003115415573,771.4395751953125,1e-05,0.07470786571502686,5.68589186668396,15.555094242095947,1 +1203,0.13993492722511292,0.07386920601129532,0.07342638820409775,0.1978285163640976,823.6697998046875,1e-05,0.07258216291666031,5.686685562133789,15.555094242095947,1 +1204,0.11814704537391663,0.11587449908256531,0.11224094778299332,0.277179479598999,478.3950500488281,1e-05,0.06424327194690704,5.68745493888855,15.555094242095947,1 +1205,0.09084445238113403,0.148509219288826,0.14684313535690308,0.24196313321590424,273.4375,1e-05,0.07357512414455414,5.941741228103638,15.555094242095947,1 +1206,0.10343374311923981,0.09789197891950607,0.09871938824653625,0.19342146813869476,604.3388061523438,1e-05,0.06911563873291016,5.682063817977905,15.555094242095947,1 +1207,0.09352389723062515,0.42816823720932007,0.42138636112213135,0.08692307025194168,83.95523071289062,1e-05,0.061330072581768036,5.690645694732666,15.555094242095947,1 +1208,0.07307160645723343,0.04006454348564148,0.041316378861665726,0.09395833313465118,921.7437133789062,1e-05,0.06816386431455612,5.686275243759155,15.555094242095947,1 +1209,0.08367622643709183,0.16273799538612366,0.15547694265842438,0.16624999046325684,996.3473510742188,1e-05,0.06367421895265579,5.683792591094971,15.555094242095947,1 +1210,0.09377581626176834,0.04900503531098366,0.04898123815655708,0.1650240272283554,698.8536376953125,1e-05,0.05739002302289009,5.685816287994385,15.555094242095947,1 +1211,0.14249689877033234,0.058431364595890045,0.06174442172050476,0.22150640189647675,460.8586120605469,1e-05,0.0799831673502922,5.919161081314087,15.555094242095947,1 +1212,0.08805515617132187,0.07506813108921051,0.07843450456857681,0.29529646039009094,825.9837646484375,1e-05,0.06591328978538513,5.701236009597778,15.555094242095947,1 +1213,0.06824839115142822,0.10740770399570465,0.10654662549495697,0.14637820422649384,977.3124389648438,1e-05,0.054762858897447586,5.7073142528533936,15.555094242095947,1 +1214,0.07715139538049698,0.06739436089992523,0.06449197232723236,0.24944710731506348,844.1558227539062,1e-05,0.07378040254116058,5.697232246398926,15.555094242095947,1 +1215,0.06877680122852325,0.8023037910461426,0.8012054562568665,0.2454727441072464,29.296875,1e-05,0.0662766695022583,5.697363615036011,15.555094242095947,1 +1216,0.05587588623166084,0.11264566332101822,0.1240798830986023,0.22620192170143127,972.7151489257812,1e-05,0.08022935688495636,5.740711450576782,15.555094242095947,1 +1217,0.09026528149843216,0.11747252941131592,0.11504156142473221,0.22710736095905304,915.7753295898438,1e-05,0.06571979820728302,5.694482803344727,15.555094242095947,1 +1218,0.047857534140348434,0.07678341120481491,0.07292290031909943,0.2086217850446701,946.6019287109375,1e-05,0.05915205553174019,5.68593168258667,15.555094242095947,1 +1219,0.05773036926984787,0.09077268838882446,0.08309740573167801,0.1890464723110199,859.8626708984375,1e-05,0.08766525238752365,5.686950922012329,15.555094242095947,1 +1220,0.10848155617713928,0.05963895097374916,0.06111210957169533,0.2549198567867279,919.3121948242188,1e-05,0.07033971697092056,5.680093050003052,15.555094242095947,1 +1221,0.1031249463558197,0.055042561143636703,0.05164910480380058,0.23816505074501038,867.0343017578125,1e-05,0.05326000228524208,5.736133337020874,15.555094242095947,1 +1222,0.07544849067926407,0.06884187459945679,0.0707368478178978,0.10632210969924927,956.2970581054688,1e-05,0.0900888442993164,5.6925599575042725,15.555094242095947,1 +1223,0.07948017120361328,0.0881979912519455,0.08160368353128433,0.20287659764289856,950.9569091796875,1e-05,0.08807024359703064,5.686800718307495,15.555094242095947,1 +1224,0.06985212117433548,0.06723028421401978,0.06803982704877853,0.1924198716878891,699.823974609375,1e-05,0.07505301386117935,5.685395240783691,15.555094242095947,1 +1225,0.06423844397068024,0.11132567375898361,0.10286100953817368,0.2824919819831848,919.3121948242188,1e-05,0.08837910741567612,5.682715654373169,15.555094242095947,1 +1226,0.07553618401288986,0.2137201875448227,0.21215064823627472,0.23848557472229004,993.4319458007812,1e-05,0.07632454484701157,5.674673557281494,15.555094242095947,1 +1227,0.08903495967388153,0.09622582793235779,0.09549827873706818,0.23608973622322083,755.5379638671875,1e-05,0.08664660900831223,5.674349784851074,15.555094242095947,1 +1228,0.1017582044005394,0.10986831784248352,0.10495404899120331,0.24002403020858765,822.50341796875,1e-05,0.09101413935422897,5.67576265335083,15.555094242095947,1 +1229,0.09452386945486069,0.10076814144849777,0.09419630467891693,0.2590785026550293,941.20556640625,1e-05,0.07607948035001755,5.682823419570923,15.555094242095947,1 +1230,0.0767938569188118,0.09175502508878708,0.08868587017059326,0.2581730782985687,523.2557983398438,1e-05,0.10347717255353928,5.680618762969971,15.555094242095947,1 +1231,0.060969289392232895,0.06266845762729645,0.060002438724040985,0.2021714597940445,707.4652709960938,1e-05,0.06757654249668121,5.678750276565552,15.555094242095947,1 +1232,0.08318959176540375,0.12467606365680695,0.1178840771317482,0.2489503175020218,972.7151489257812,1e-05,0.06492745876312256,5.691235065460205,15.555094242095947,1 +1233,0.07083787024021149,0.11216198652982712,0.11265271157026291,0.05188301205635071,282.50775146484375,1e-05,0.0761648640036583,5.678908109664917,15.555094242095947,1 +1234,0.05626934394240379,0.19379408657550812,0.1871284693479538,0.24444711208343506,978.0244140625,1e-05,0.07048608362674713,5.67595911026001,15.555094242095947,1 +1235,0.08524098247289658,0.06480268388986588,0.05879230797290802,0.27723556756973267,944.2269897460938,1e-05,0.07090125977993011,5.685741662979126,15.555094242095947,1 +1236,0.10729965567588806,0.05481061711907387,0.05569891259074211,0.21655447781085968,706.521728515625,1e-05,0.0626581683754921,5.710941314697266,15.555094242095947,1 +1237,0.10192866623401642,0.10021626949310303,0.09765741974115372,0.31968748569488525,821.9178466796875,1e-05,0.06397322565317154,5.680369853973389,15.555094242095947,1 +1238,0.06826446205377579,0.0887487530708313,0.08562805503606796,0.25350961089134216,920.0105590820312,1e-05,0.07121587544679642,5.6793811321258545,15.555094242095947,1 +1239,0.11108668893575668,0.06355337798595428,0.06344825774431229,0.22989583015441895,706.521728515625,1e-05,0.0760982483625412,5.6787285804748535,15.555094242095947,1 +1240,0.08458775281906128,0.11125164479017258,0.110742948949337,0.04915865138173103,869.8297119140625,1e-05,0.0772145688533783,5.679995059967041,15.555094242095947,1 +1241,0.08593898266553879,0.06841997057199478,0.06505416333675385,0.23434293270111084,649.0385131835938,1e-05,0.0805986300110817,5.687838554382324,15.555094242095947,1 +1242,0.11833253502845764,0.11137255281209946,0.11156027019023895,0.25430288910865784,685.9205932617188,1e-05,0.06777063012123108,5.686554193496704,15.555094242095947,1 +1243,0.05821604281663895,0.055221863090991974,0.057165518403053284,0.25630608201026917,933.7044067382812,1e-05,0.07826419919729233,5.91753625869751,15.555094242095947,1 +1244,0.08866231143474579,0.10255160927772522,0.10064921528100967,0.1297355741262436,986.2869873046875,1e-05,0.07173966616392136,5.68655800819397,15.555094242095947,1 +1245,0.060187362134456635,0.03951738029718399,0.04242574796080589,0.13153845071792603,840.4324951171875,1e-05,0.07313026487827301,5.675623893737793,15.555094242095947,1 +1246,0.13246668875217438,0.18446041643619537,0.18387748301029205,0.20229165256023407,267.29559326171875,1e-05,0.06984656304121017,5.678418874740601,15.555094242095947,1 +1247,0.08582429587841034,0.20726312696933746,0.1946614533662796,0.2444150596857071,996.1414184570312,1e-05,0.07957828044891357,5.688801050186157,15.555094242095947,1 +1248,0.06762875616550446,0.09731835871934891,0.0931820273399353,0.2572596073150635,521.561767578125,1e-05,0.06903837621212006,5.681331634521484,15.555094242095947,1 +1249,0.11813265830278397,0.31998398900032043,0.31658777594566345,0.16298076510429382,149.64788818359375,1e-05,0.07797881960868835,5.681997776031494,15.555094242095947,1 +1250,0.05641331523656845,0.06288745999336243,0.05871620774269104,0.22958332300186157,847.2938232421875,1e-05,0.08547955751419067,5.68715763092041,15.555094242095947,1 +1251,0.04855981841683388,0.15400251746177673,0.14194704592227936,0.2702403664588928,971.7275390625,1e-05,0.07619526982307434,5.6845619678497314,15.555094242095947,1 +1252,0.0725574865937233,0.792212724685669,0.7842179536819458,0.24830928444862366,34.046695709228516,1e-05,0.06672647595405579,5.688370227813721,15.555094242095947,1 +1253,0.13635459542274475,0.056737177073955536,0.05237011983990669,0.26508814096450806,721.2352294921875,1e-05,0.11569639295339584,5.680604934692383,15.555094242095947,1 +1254,0.0841987282037735,0.11519454419612885,0.10500281304121017,0.254543274641037,954.9102783203125,1e-05,0.06376495212316513,5.68791937828064,15.555094242095947,1 +1255,0.08727406710386276,0.1729472577571869,0.1520308554172516,0.23898236453533173,982.677490234375,1e-05,0.06616144627332687,5.680173873901367,15.555094242095947,1 +1256,0.12105748057365417,0.11094151437282562,0.10619381070137024,0.17821313440799713,876.6427001953125,1e-05,0.09073638916015625,5.688043832778931,15.555094242095947,1 +1257,0.0842030867934227,0.06535196304321289,0.06403322517871857,0.08906249701976776,883.6459350585938,1e-05,0.056205395609140396,5.682126045227051,15.555094242095947,1 +1258,0.08058018982410431,0.020501965656876564,0.023382147774100304,0.1489262729883194,763.2398681640625,1e-05,0.07750491797924042,5.825285911560059,15.555094242095947,1 +1259,0.06612548232078552,0.09142512083053589,0.09046417474746704,0.20420671999454498,628.7276611328125,1e-05,0.07789763808250427,5.6801698207855225,15.555094242095947,1 +1260,0.08885065466165543,0.12538228929042816,0.12297075986862183,0.15145832300186157,958.4887084960938,1e-05,0.06404361128807068,5.687659740447998,15.555094242095947,1 +1261,0.093196339905262,0.1061708852648735,0.10522875934839249,0.2546153664588928,968.2146606445312,1e-05,0.07371809333562851,5.683287858963013,15.555094242095947,1 +1262,0.14997941255569458,0.12127744406461716,0.1205674335360527,0.28043267130851746,438.31170654296875,1e-05,0.07809821516275406,5.683096408843994,15.555094242095947,1 +1263,0.08712318539619446,0.06751899421215057,0.06329426169395447,0.2901522219181061,782.1857299804688,1e-05,0.06771552562713623,5.835986375808716,15.555094242095947,1 +1264,0.07593314349651337,0.07138676196336746,0.06608109921216965,0.2416987121105194,879.3001098632812,1e-05,0.07208839803934097,5.69269323348999,15.555094242095947,1 +1265,0.07207702100276947,0.20383700728416443,0.20290859043598175,0.20612980425357819,238.6731414794922,1e-05,0.05848973989486694,5.686749219894409,15.555094242095947,1 +1266,0.08241795003414154,0.054764825850725174,0.05278976261615753,0.15880608558654785,845.2072143554688,1e-05,0.06678909063339233,5.686795949935913,15.555094242095947,1 +1267,0.06191707402467728,0.19435442984104156,0.1997634917497635,0.2849038243293762,987.3948974609375,1e-05,0.06808234006166458,5.69206976890564,15.555094242095947,1 +1268,0.07039396464824677,0.07627023011445999,0.07299737632274628,0.18690703809261322,893.2648315429688,1e-05,0.0772094801068306,5.916277170181274,15.555094242095947,1 +1269,0.08232041448354721,0.06866821646690369,0.06683290004730225,0.22602562606334686,749.19873046875,1e-05,0.06210603192448616,5.684047698974609,15.555094242095947,1 +1270,0.07713136076927185,0.03760584816336632,0.03735002502799034,0.28720352053642273,734.3234252929688,1e-05,0.07706981897354126,5.681988477706909,15.555094242095947,1 +1271,0.094393290579319,0.17737135291099548,0.16967572271823883,0.15550480782985687,979.9048461914062,1e-05,0.06068698689341545,5.6817169189453125,15.555094242095947,1 +1272,0.058311473578214645,0.08783731609582901,0.0853654146194458,0.2669791579246521,949.5192260742188,1e-05,0.06222066283226013,5.68246865272522,15.555094242095947,1 +1273,0.08714522421360016,0.20174942910671234,0.19646881520748138,0.27560093998908997,971.9750366210938,1e-05,0.06280975788831711,5.67589807510376,15.555094242095947,1 +1274,0.08165795356035233,0.09116238355636597,0.08105825632810593,0.22153043746948242,875.2998046875,1e-05,0.06089499220252037,5.6858367919921875,15.555094242095947,1 +1275,0.07234558463096619,0.12357188761234283,0.11624548584222794,0.2774038314819336,960.6482543945312,1e-05,0.07438240200281143,5.678446054458618,15.555094242095947,1 +1276,0.10824930667877197,0.08009128272533417,0.08397991210222244,0.16074518859386444,466.7919921875,1e-05,0.07121995091438293,5.678693056106567,15.555094242095947,1 +1277,0.13413245975971222,0.10710914433002472,0.09502451866865158,0.2172115296125412,923.1171264648438,1e-05,0.07164934277534485,5.679966688156128,15.555094242095947,1 +1278,0.12092937529087067,0.059942055493593216,0.05582740157842636,0.17340543866157532,781.4841918945312,1e-05,0.06971122324466705,5.67887020111084,15.555094242095947,1 +1279,0.06396955251693726,0.0805656835436821,0.07386619597673416,0.19144229590892792,938.4346313476562,1e-05,0.06322840601205826,5.919844627380371,15.555094242095947,1 +1280,0.0809239000082016,0.07390634715557098,0.07882101833820343,0.17961537837982178,937.5,1e-05,0.054139457643032074,5.688976526260376,15.555094242095947,1 +1281,0.0990619882941246,0.10692198574542999,0.09786074608564377,0.2473878115415573,972.9610595703125,1e-05,0.06268488615751266,5.678348779678345,15.555094242095947,1 +1282,0.032892122864723206,0.06409019231796265,0.05923708528280258,0.21995191276073456,825.4075927734375,1e-05,0.050696566700935364,5.678323745727539,15.555094242095947,1 +1283,0.15388908982276917,0.08613314479589462,0.08220278471708298,0.2266586422920227,804.8433837890625,1e-05,0.07135428488254547,5.681697607040405,15.555094242095947,1 +1284,0.08451835811138153,0.05483926087617874,0.05366196110844612,0.2497115284204483,880.6146240234375,1e-05,0.06643573194742203,5.684839963912964,15.555094242095947,1 +1285,0.07937105000019073,0.08829857409000397,0.0905030220746994,0.20402242243289948,555.5556030273438,1e-05,0.10038605332374573,5.691464900970459,15.555094242095947,1 +1286,0.06696746498346329,0.06860506534576416,0.06785392016172409,0.13172274827957153,914.6995849609375,1e-05,0.054887864738702774,5.685935020446777,15.555094242095947,1 +1287,0.09456589072942734,0.06693030148744583,0.06540904194116592,0.26588940620422363,922.431884765625,1e-05,0.05562494695186615,5.68591046333313,15.555094242095947,1 +1288,0.12365700304508209,0.0883687287569046,0.08458603918552399,0.26548075675964355,772.1712036132812,1e-05,0.07353514432907104,5.6838061809539795,15.555094242095947,1 +1289,0.07967232167720795,0.04778803884983063,0.0476187989115715,0.2600160241127014,567.685546875,1e-05,0.10586875677108765,5.919208288192749,15.555094242095947,1 +1290,0.09015816450119019,0.076512910425663,0.06844400614500046,0.25899839401245117,788.4046630859375,1e-05,0.06333592534065247,5.675074815750122,15.555094242095947,1 +1291,0.08481987565755844,0.21398556232452393,0.1873520463705063,0.22885416448116302,991.52197265625,1e-05,0.05990979075431824,5.68235969543457,15.555094242095947,1 +1292,0.07519609481096268,0.07671362906694412,0.0743996798992157,0.2357371747493744,826.5582275390625,1e-05,0.11589384824037552,5.695873022079468,15.555094242095947,1 +1293,0.08637051284313202,0.07603352516889572,0.0712001845240593,0.21532851457595825,900.4474487304688,1e-05,0.08445637673139572,5.684921741485596,15.555094242095947,1 +1294,0.0999898761510849,0.05826271325349808,0.05815155431628227,0.07758012413978577,730.8970947265625,1e-05,0.07699305564165115,5.681454181671143,15.555094242095947,1 +1295,0.07177001982927322,0.060535501688718796,0.05842025205492973,0.1855769157409668,837.7308349609375,1e-05,0.10259143263101578,5.899264574050903,15.555094242095947,1 +1296,0.10795706510543823,0.06538468599319458,0.06378508359193802,0.17779646813869476,398.5013732910156,1e-05,0.09596648067235947,5.764951944351196,15.555094242095947,1 +1297,0.06785229593515396,0.07056624442338943,0.06640821695327759,0.2385336458683014,823.6697998046875,1e-05,0.07223408669233322,5.681888818740845,15.555094242095947,1 +1298,0.13771532475948334,0.013711076229810715,0.014102847315371037,0.08354967832565308,802.9328002929688,1e-05,0.1758483648300171,5.684873342514038,15.555094242095947,1 +1299,0.08561906963586807,0.09879539906978607,0.09572741389274597,0.25248396396636963,470.6982727050781,1e-05,0.07613510638475418,5.6849753856658936,15.555094242095947,1 +1300,0.09095088392496109,0.08371280878782272,0.07971660047769547,0.22853364050388336,899.2704467773438,1e-05,0.07886596024036407,5.764744520187378,15.555094242095947,1 +1301,0.10526973009109497,0.0637713149189949,0.06095097213983536,0.2201121747493744,590.71728515625,1e-05,0.13521219789981842,5.683489561080933,15.555094242095947,1 +1302,0.10984677076339722,0.10629711300134659,0.1001228392124176,0.24500800669193268,722.12841796875,1e-05,0.12749412655830383,5.684771776199341,15.555094242095947,1 +1303,0.121719591319561,0.17870712280273438,0.17064169049263,0.18333332240581512,238.6731414794922,1e-05,0.06571570783853531,5.6844565868377686,15.555094242095947,1 +1304,0.11052665114402771,0.27272722125053406,0.2617015540599823,0.17797274887561798,991.3079833984375,1e-05,0.07477417588233948,5.682129144668579,15.555094242095947,1 +1305,0.0902010053396225,0.09193023294210434,0.08524779975414276,0.18903043866157532,586.51806640625,1e-05,0.1370914727449417,5.8485212326049805,15.555094242095947,1 +1306,0.08533235639333725,0.09049516916275024,0.0878044068813324,0.15466345846652985,980.6033935546875,1e-05,0.07937350124120712,5.907437086105347,15.555094242095947,1 +1307,0.061009060591459274,0.16385255753993988,0.1588369607925415,0.23749999701976776,969.7308959960938,1e-05,0.08393661677837372,5.6801817417144775,15.555094242095947,1 +1308,0.1029660776257515,0.07070434838533401,0.06830967217683792,0.11519230157136917,857.4120483398438,1e-05,0.10408978164196014,5.700670003890991,15.555094242095947,1 +1309,0.13205118477344513,0.09332628548145294,0.09411323070526123,0.20749999582767487,814.7632446289062,1e-05,0.06485452502965927,5.68084979057312,15.555094242095947,1 +1310,0.06769547611474991,0.16977106034755707,0.14652852714061737,0.22941505908966064,994.4806518554688,1e-05,0.06805764883756638,5.881669282913208,15.555094242095947,1 +1311,0.04202951118350029,0.17531315982341766,0.16429665684700012,0.22741185128688812,979.6713256835938,1e-05,0.08827054500579834,5.685683965682983,15.555094242095947,1 +1312,0.04772590100765228,0.09568195044994354,0.09194523096084595,0.297820508480072,675.5514526367188,1e-05,0.07872416824102402,5.68243670463562,15.555094242095947,1 +1313,0.09234027564525604,0.09022597223520279,0.09360693395137787,0.2019791603088379,317.1641845703125,1e-05,0.06920754909515381,5.678813457489014,15.555094242095947,1 +1314,0.09909436106681824,0.17624686658382416,0.16980840265750885,0.16490383446216583,976.5967407226562,1e-05,0.0742017924785614,5.687972545623779,15.555094242095947,1 +1315,0.12674184143543243,0.16125306487083435,0.14949174225330353,0.21163460612297058,986.952880859375,1e-05,0.07694053649902344,5.68304181098938,15.555094242095947,1 +1316,0.06254702806472778,0.05388721078634262,0.051636952906847,0.12491986900568008,450.76727294921875,1e-05,0.07042066752910614,5.6861371994018555,15.555094242095947,1 +1317,0.08265305310487747,0.08144725114107132,0.07259971648454666,0.26219549775123596,662.593994140625,1e-05,0.07050353288650513,5.765930652618408,15.555094242095947,1 +1318,0.09129752218723297,0.04237084835767746,0.0428096279501915,0.12796473503112793,859.8626708984375,1e-05,0.07664452493190765,5.675258159637451,15.555094242095947,1 +1319,0.08380689471960068,0.0558946467936039,0.052779581397771835,0.22073717415332794,816.57421875,1e-05,0.08671823143959045,5.684457063674927,15.555094242095947,1 +1320,0.09745602309703827,0.12849870324134827,0.1288885474205017,0.21551281213760376,970.48291015625,1e-05,0.07045997679233551,5.682406187057495,15.555094242095947,1 +1321,0.09537742286920547,0.0656004473567009,0.057788655161857605,0.23423075675964355,815.3685913085938,1e-05,0.06621930748224258,5.683220148086548,15.555094242095947,1 +1322,0.14907610416412354,0.03884139657020569,0.03881893679499626,0.11290864646434784,713.9794311523438,1e-05,0.06258343905210495,5.6754069328308105,15.555094242095947,1 +1323,0.12090636789798737,0.42777642607688904,0.4173670709133148,0.22577723860740662,101.10294342041016,1e-05,0.0726979449391365,5.676327466964722,15.555094242095947,1 +1324,0.08189459145069122,0.3486521244049072,0.3202974498271942,0.2531810700893402,995.728271484375,1e-05,0.054005399346351624,5.683664798736572,15.555094242095947,1 +1325,0.07222042232751846,0.30053192377090454,0.2673328220844269,0.28746792674064636,995.9349365234375,1e-05,0.0699843168258667,5.68550705909729,15.555094242095947,1 +1326,0.12736421823501587,0.08638288825750351,0.08752012252807617,0.11653845757246017,956.2970581054688,1e-05,0.0734591856598854,5.69287109375,15.555094242095947,1 +1327,0.08498883247375488,0.059806957840919495,0.06108848378062248,0.24048876762390137,577.95703125,1e-05,0.05913456901907921,5.900005340576172,15.555094242095947,1 +1328,0.09179781377315521,0.13892804086208344,0.14340290427207947,0.2346794754266739,157.3426513671875,1e-05,0.07979481667280197,5.689047336578369,15.555094242095947,1 +1329,0.10959146171808243,0.0881902277469635,0.0907372385263443,0.18285255134105682,930.7967529296875,1e-05,0.06721906363964081,5.905571937561035,15.555094242095947,1 +1330,0.07661927491426468,0.13115184009075165,0.11468805372714996,0.261290043592453,975.15380859375,1e-05,0.05719049647450447,5.700077295303345,15.555094242095947,1 +1331,0.038943324238061905,0.04820820689201355,0.051541317254304886,0.15599358081817627,946.3070678710938,1e-05,0.06835503876209259,5.984081268310547,15.555094242095947,1 +1332,0.08653533458709717,0.03977857530117035,0.038166385143995285,0.2094070464372635,787.721923828125,1e-05,0.06064566969871521,5.681687116622925,15.555094242095947,1 +1333,0.06359700113534927,0.09400729835033417,0.0952623039484024,0.1727403849363327,958.2166748046875,1e-05,0.07130618393421173,5.686776399612427,15.555094242095947,1 +1334,0.06618601828813553,0.10454203933477402,0.10182498395442963,0.23887819051742554,782.8849487304688,1e-05,0.07220723479986191,5.690569162368774,15.555094242095947,1 +1335,0.12854577600955963,0.15832680463790894,0.1534481942653656,0.14397434890270233,986.731201171875,1e-05,0.09610171616077423,5.691833257675171,15.555094242095947,1 +1336,0.11722913384437561,0.05204920470714569,0.05197567865252495,0.14134614169597626,612.2449340820312,1e-05,0.08198130130767822,5.678570985794067,15.555094242095947,1 +1337,0.0789942741394043,0.1250980645418167,0.12356913089752197,0.26318109035491943,587.923828125,1e-05,0.07425906509160995,5.678631067276001,15.555094242095947,1 +1338,0.049448005855083466,0.12053725123405457,0.10836037248373032,0.256169855594635,925.8298950195312,1e-05,0.07374807447195053,5.682055711746216,15.555094242095947,1 +1339,0.10089278966188431,0.07778038829565048,0.07318475842475891,0.2318669855594635,521.561767578125,1e-05,0.09116943180561066,5.820790529251099,15.555094242095947,1 +1340,0.1007668599486351,0.13689368963241577,0.12232412397861481,0.23221954703330994,954.3519897460938,1e-05,0.08880086243152618,5.673269748687744,15.555094242095947,1 +1341,0.09100744873285294,0.09105245023965836,0.08998991549015045,0.21651440858840942,809.2384033203125,1e-05,0.08118785917758942,5.6889588832855225,15.555094242095947,1 +1342,0.04487340524792671,0.08797881007194519,0.08697769045829773,0.11725159734487534,978.4969482421875,1e-05,0.07484938204288483,5.678710699081421,15.555094242095947,1 +1343,0.07581907510757446,0.0848788470029831,0.08306808024644852,0.2835817337036133,976.5967407226562,1e-05,0.0768950954079628,5.691460371017456,15.555094242095947,1 +1344,0.10003655403852463,0.09462007135152817,0.0895468071103096,0.264783650636673,425.4617614746094,1e-05,0.06934849172830582,5.93027663230896,15.555094242095947,1 +1345,0.10866515338420868,0.050348807126283646,0.0479179248213768,0.19989582896232605,879.7392578125,1e-05,0.06928296387195587,5.679910659790039,15.555094242095947,1 +1346,0.09643575549125671,0.25747761130332947,0.25450602173805237,0.2870272397994995,201.34228515625,1e-05,0.060548730194568634,5.684661865234375,15.555094242095947,1 +1347,0.1211007609963417,0.0667281523346901,0.06678078323602676,0.2001522332429886,717.632080078125,1e-05,0.07456547766923904,5.6743690967559814,15.555094242095947,1 +1348,0.06467483192682266,0.1204238161444664,0.11780840158462524,0.24638621509075165,943.62744140625,1e-05,0.07326804101467133,5.901133060455322,15.555094242095947,1 +1349,0.07872572541236877,0.0783652737736702,0.07479330897331238,0.10575319826602936,912.8910522460938,1e-05,0.0615055225789547,5.679895639419556,15.555094242095947,1 +1350,0.09086339175701141,0.05737301707267761,0.060786373913288116,0.27842947840690613,763.9968872070312,1e-05,0.06232594698667526,5.6818249225616455,15.555094242095947,1 +1351,0.09192805737257004,0.09747688472270966,0.09366428107023239,0.3056810796260834,538.1549072265625,1e-05,0.07249650359153748,5.680063009262085,15.555094242095947,1 +1352,0.1191149577498436,0.06257323920726776,0.06188935041427612,0.21478363871574402,795.784912109375,1e-05,0.06314759701490402,5.877849578857422,15.555094242095947,1 +1353,0.10261324793100357,0.08378230780363083,0.08557046949863434,0.23203524947166443,384.3490905761719,1e-05,0.07064471393823624,5.954329490661621,15.555094242095947,1 +1354,0.047128211706876755,0.19901470839977264,0.19185097515583038,0.23625800013542175,978.0244140625,1e-05,0.061746738851070404,5.806121349334717,15.555094242095947,1 +1355,0.09666063636541367,0.08794540911912918,0.0846208781003952,0.15787659585475922,814.7632446289062,1e-05,0.0717763602733612,5.691847801208496,15.555094242095947,1 +1356,0.12208481878042221,0.06190173700451851,0.059494949877262115,0.22016826272010803,963.3027954101562,1e-05,0.0751093178987503,5.710529565811157,15.555094242095947,1 +1357,0.07984516024589539,0.03951345384120941,0.04241020232439041,0.2556730806827545,835.5437622070312,1e-05,0.060873571783304214,5.702368259429932,15.555094242095947,1 +1358,0.08890092372894287,0.20298345386981964,0.19517754018306732,0.1933813989162445,998.18701171875,1e-05,0.07754646241664886,5.68963098526001,15.555094242095947,1 +1359,0.06836115568876266,0.08052947372198105,0.07868605107069016,0.19597755372524261,801.0057983398438,1e-05,0.05856805294752121,5.842972040176392,15.555094242095947,1 +1360,0.0978107899427414,0.06621606647968292,0.06305471062660217,0.24487178027629852,823.6697998046875,1e-05,0.0637839287519455,5.68206262588501,15.555094242095947,1 +1361,0.05992377549409866,0.08449219167232513,0.08255936950445175,0.13499999046325684,845.2072143554688,1e-05,0.06514375656843185,5.685823917388916,15.555094242095947,1 +1362,0.05632646754384041,0.034734759479761124,0.035403139889240265,0.08781249821186066,874.3990478515625,1e-05,0.07245884835720062,5.684998035430908,15.555094242095947,1 +1363,0.08342284709215164,0.1070152074098587,0.0952577069401741,0.23420672118663788,952.9466552734375,1e-05,0.05824171006679535,5.685913324356079,15.555094242095947,1 +1364,0.08833374083042145,0.11721580475568771,0.11885742098093033,0.18337339162826538,966.6818237304688,1e-05,0.07106463611125946,5.6778388023376465,15.555094242095947,1 +1365,0.1545322984457016,0.11484788358211517,0.11150377988815308,0.16603364050388336,407.6819763183594,1e-05,0.06143693998456001,5.678828477859497,15.555094242095947,1 +1366,0.09817077964544296,0.06349076330661774,0.060214411467313766,0.1725640892982483,752.3885498046875,1e-05,0.07781944423913956,5.680464744567871,15.555094242095947,1 +1367,0.12145662307739258,0.374673992395401,0.3706047832965851,0.19176281988620758,88.28997039794922,1e-05,0.06865526735782623,5.681844234466553,15.555094242095947,1 +1368,0.11409571766853333,0.09954000264406204,0.09643752127885818,0.25181087851524353,589.323486328125,1e-05,0.10425986349582672,5.676254034042358,15.555094242095947,1 +1369,0.04908435791730881,0.13894374668598175,0.12954556941986084,0.15083332359790802,948.3590698242188,1e-05,0.05747261643409729,5.681603193283081,15.555094242095947,1 +1370,0.10271836817264557,0.08588633686304092,0.08636079728603363,0.2116105705499649,524.9420166015625,1e-05,0.08912794291973114,5.686132192611694,15.555094242095947,1 +1371,0.13567934930324554,0.07401353865861893,0.0657394602894783,0.22873397171497345,887.0499877929688,1e-05,0.08887086808681488,5.683753728866577,15.555094242095947,1 +1372,0.07276396453380585,0.08927666395902634,0.08486367762088776,0.21195511519908905,714.8972778320312,1e-05,0.06969811767339706,5.674141883850098,15.555094242095947,1 +1373,0.0756794661283493,0.03323005139827728,0.03372374176979065,0.1647355705499649,804.8433837890625,1e-05,0.08807319402694702,5.684269428253174,15.555094242095947,1 +1374,0.07125586271286011,0.09458856284618378,0.08919799327850342,0.19276441633701324,924.81787109375,1e-05,0.07748629152774811,5.891107082366943,15.555094242095947,1 +1375,0.09077105671167374,0.20664162933826447,0.19392576813697815,0.3225400447845459,998.18701171875,1e-05,0.08104847371578217,5.680096387863159,15.555094242095947,1 +1376,0.08308322727680206,0.10793944448232651,0.09581632912158966,0.19949518144130707,907.7218017578125,1e-05,0.09377853572368622,5.681561708450317,15.555094242095947,1 +1377,0.09421943873167038,0.03936227783560753,0.03676239773631096,0.2131730616092682,705.574951171875,1e-05,0.08842486143112183,5.674885034561157,15.555094242095947,1 +1378,0.11010569334030151,0.059555575251579285,0.06470327079296112,0.12604966759681702,917.19921875,1e-05,0.07801378518342972,5.680565357208252,15.555094242095947,1 +1379,0.0673200935125351,0.05979536473751068,0.0647999569773674,0.20777243375778198,680.7832641601562,1e-05,0.08577888458967209,5.674861669540405,15.555094242095947,1 +1380,0.07206615805625916,0.07379928976297379,0.07583434879779816,0.21357370913028717,949.5192260742188,1e-05,0.08735165745019913,5.676174640655518,15.555094242095947,1 +1381,0.08343585580587387,0.05489818751811981,0.05276264250278473,0.1212339699268341,826.5582275390625,1e-05,0.11969804763793945,5.684963703155518,15.555094242095947,1 +1382,0.08212505280971527,0.04096849635243416,0.04069683700799942,0.11045672744512558,902.0044555664062,1e-05,0.07995716482400894,5.678684234619141,15.555094242095947,1 +1383,0.10613289475440979,0.12715090811252594,0.1262265145778656,0.25988781452178955,322.7003173828125,1e-05,0.09187444299459457,5.676641225814819,15.555094242095947,1 +1384,0.12832030653953552,0.0770205706357956,0.07010073214769363,0.2553365230560303,715.8119506835938,1e-05,0.07838320732116699,5.683487892150879,15.555094242095947,1 +1385,0.09175269305706024,1.0112416744232178,1.0112452507019043,0.23634614050388336,4.9800801277160645,1e-05,0.08337175846099854,5.675724029541016,15.555094242095947,1 +1386,0.07896273583173752,0.06813006848096848,0.06529027968645096,0.25459936261177063,744.3366088867188,1e-05,0.09129159897565842,5.675417423248291,15.555094242095947,1 +1387,0.07792429625988007,0.09575454145669937,0.08836420625448227,0.2202964723110199,847.8120727539062,1e-05,0.06634330749511719,5.685378313064575,15.555094242095947,1 +1388,0.047445859760046005,0.07066074758768082,0.06787391006946564,0.24800479412078857,817.7731323242188,1e-05,0.07069394737482071,5.681910753250122,15.555094242095947,1 +1389,0.07801486551761627,0.09340322762727737,0.09974757581949234,0.16197915375232697,979.2027587890625,1e-05,0.09277155250310898,5.679002046585083,15.555094242095947,1 +1390,0.0889461562037468,0.02817648835480213,0.03157076612114906,0.14624999463558197,833.3333129882812,1e-05,0.06859932094812393,5.67957067489624,15.555094242095947,1 +1391,0.12518605589866638,0.05463341623544693,0.056135471910238266,0.25064101815223694,580.8350830078125,1e-05,0.05599675700068474,5.683292627334595,15.555094242095947,1 +1392,0.12594208121299744,0.08318673074245453,0.07403183728456497,0.2251121699810028,863.2425537109375,1e-05,0.08167922496795654,5.6783223152160645,15.555094242095947,1 +1393,0.08949338644742966,0.0816391110420227,0.07502049207687378,0.2609294652938843,775.796630859375,1e-05,0.05778194218873978,5.67360782623291,15.555094242095947,1 +1394,0.09997239708900452,0.15952666103839874,0.1503334641456604,0.16128204762935638,970.48291015625,1e-05,0.056983958929777145,5.6879518032073975,15.555094242095947,1 +1395,0.08106442540884018,0.07497458159923553,0.06445217877626419,0.25420671701431274,638.4540405273438,1e-05,0.06639961153268814,6.127861022949219,15.555094242095947,1 +1396,0.052850980311632156,0.14723476767539978,0.13694201409816742,0.2167387753725052,955.4664916992188,1e-05,0.07491070032119751,5.776433706283569,15.555094242095947,1 +1397,0.09012457728385925,0.07230069488286972,0.06647458672523499,0.2112419754266739,850.3836669921875,1e-05,0.07212656736373901,5.686632871627808,15.555094242095947,1 +1398,0.1275051087141037,0.5051468014717102,0.49615922570228577,0.17965544760227203,79.58802795410156,1e-05,0.08544525504112244,5.675410270690918,15.555094242095947,1 +1399,0.07176585495471954,0.06700950115919113,0.06497638672590256,0.2651281952857971,658.1439819335938,1e-05,0.07130429893732071,5.848602294921875,15.555094242095947,1 +1400,0.054049279540777206,0.14993208646774292,0.14415229856967926,0.2396955043077469,971.4794311523438,1e-05,0.054184943437576294,5.692172288894653,15.555094242095947,1 +1401,0.05383693054318428,0.10195474326610565,0.09867777675390244,0.1787339746952057,921.3984985351562,1e-05,0.07519832998514175,5.67920708656311,15.555094242095947,1 +1402,0.050035327672958374,0.034011244773864746,0.03648613020777702,0.23083332180976868,583.6886596679688,1e-05,0.07625052332878113,5.682067155838013,15.555094242095947,1 +1403,0.04698403924703598,0.06633894145488739,0.06364498287439346,0.0885416641831398,908.0963134765625,1e-05,0.062427062541246414,5.680521249771118,15.555094242095947,1 +1404,0.10915875434875488,0.09138695150613785,0.09261354058980942,0.23574517667293549,416.6666564941406,1e-05,0.07339844107627869,5.682003498077393,15.555094242095947,1 +1405,0.07096530497074127,0.07001785933971405,0.07268498092889786,0.2180849313735962,931.7718505859375,1e-05,0.06467244029045105,5.677018165588379,15.555094242095947,1 +1406,0.0707579180598259,0.16967841982841492,0.1559029519557953,0.26662659645080566,973.9398803710938,1e-05,0.06653162837028503,5.691141128540039,15.555094242095947,1 +1407,0.06576387584209442,0.08513490855693817,0.08097674697637558,0.2445112019777298,919.3121948242188,1e-05,0.07974063605070114,5.6795454025268555,15.555094242095947,1 +1408,0.08709016442298889,0.10526047646999359,0.09670092165470123,0.2125801146030426,968.2146606445312,1e-05,0.06581872701644897,5.681314706802368,15.555094242095947,1 +1409,0.06547634303569794,0.08382321894168854,0.0870790109038353,0.24851761758327484,957.6707763671875,1e-05,0.06933031976222992,5.678636074066162,15.555094242095947,1 +1410,0.134161114692688,0.27496519684791565,0.2827155888080597,0.20036858320236206,105.31136322021484,1e-05,0.06353363394737244,5.68280553817749,15.555094242095947,1 +1411,0.08706097304821014,0.07406208664178848,0.06945135444402695,0.22709934413433075,604.3388061523438,1e-05,0.07786392420530319,5.741684436798096,15.555094242095947,1 +1412,0.06716414541006088,0.04867052659392357,0.04703560844063759,0.09247595816850662,876.1961669921875,1e-05,0.06535729765892029,5.810170888900757,15.555094242095947,1 +1413,0.08592772483825684,0.09043019264936447,0.08690952509641647,0.2498237043619156,721.2352294921875,1e-05,0.052915606647729874,5.681901216506958,15.555094242095947,1 +1414,0.08827283978462219,0.07751356810331345,0.06929027289152145,0.19294069707393646,837.1862182617188,1e-05,0.0757356807589531,5.739729642868042,15.555094242095947,1 +1415,0.06643183529376984,0.13605362176895142,0.12547920644283295,0.18822915852069855,978.2608642578125,1e-05,0.08152425289154053,5.683470964431763,15.555094242095947,1 +1416,0.06993857026100159,0.3218863010406494,0.3475748598575592,0.2416265904903412,79.58802795410156,1e-05,0.058656543493270874,5.882253408432007,15.555094242095947,1 +1417,0.10761850327253342,0.09045646339654922,0.08107566833496094,0.2657932639122009,823.6697998046875,1e-05,0.06897299736738205,5.676928520202637,15.555094242095947,1 +1418,0.05985317379236221,0.06417444348335266,0.06423909962177277,0.20754806697368622,642.0233154296875,1e-05,0.10614452511072159,5.6811676025390625,15.555094242095947,1 +1419,0.038702547550201416,0.17267046868801117,0.1655280590057373,0.143052875995636,966.1671142578125,1e-05,0.0863574892282486,5.680237054824829,15.555094242095947,1 +1420,0.08843092620372772,0.07044975459575653,0.06953942030668259,0.16105768084526062,598.9583129882812,1e-05,0.07553195208311081,5.797743320465088,15.555094242095947,1 +1421,0.06581871956586838,0.09219149500131607,0.09038157016038895,0.23548877239227295,921.3984985351562,1e-05,0.08120495080947876,5.896872043609619,15.555094242095947,1 +1422,0.11456108838319778,0.2694026231765747,0.2668835520744324,0.23494389653205872,161.1498260498047,1e-05,0.06273679435253143,5.6796488761901855,15.555094242095947,1 +1423,0.09748727083206177,0.07453516125679016,0.09047304838895798,0.23850961029529572,232.08470153808594,1e-05,0.08983331173658371,5.680985450744629,15.555094242095947,1 +1424,0.0777449905872345,0.04411483556032181,0.04616910219192505,0.24766826629638672,693.9501953125,1e-05,0.09010015428066254,5.897908449172974,15.555094242095947,1 +1425,0.05003039538860321,0.07532180100679398,0.06937484443187714,0.20141024887561798,621.2273559570312,1e-05,0.061644718050956726,5.680983066558838,15.555094242095947,1 +1426,0.12057658284902573,0.11316180974245071,0.11276861280202866,0.22890223562717438,349.42364501953125,1e-05,0.07722421735525131,5.8785223960876465,15.555094242095947,1 +1427,0.07145240157842636,0.055764779448509216,0.05956704542040825,0.1997596025466919,751.5949096679688,1e-05,0.08522475510835648,5.673281908035278,15.555094242095947,1 +1428,0.08636002987623215,0.07574485242366791,0.07029030472040176,0.199559286236763,625.0,1e-05,0.07003463059663773,5.678345441818237,15.555094242095947,1 +1429,0.12464074790477753,0.42116498947143555,0.40541940927505493,0.20584934949874878,105.31136322021484,1e-05,0.08999205380678177,5.680973768234253,15.555094242095947,1 +1430,0.1019243374466896,0.08939657360315323,0.0887361690402031,0.21111378073692322,915.0589599609375,1e-05,0.06345751136541367,6.447836637496948,15.555094242095947,1 +1431,0.08952107280492783,0.046014636754989624,0.04814143106341362,0.0948076918721199,869.3666381835938,1e-05,0.09043857455253601,5.685663461685181,15.555094242095947,1 +1432,0.09644953906536102,0.07150454819202423,0.067270427942276,0.22596153616905212,886.2048950195312,1e-05,0.0609540231525898,5.736258268356323,15.555094242095947,1 +1433,0.0813835933804512,0.10447501391172409,0.09879527240991592,0.2434535175561905,903.9313354492188,1e-05,0.07689231634140015,5.801818132400513,15.555094242095947,1 +1434,0.1111048236489296,0.058723606169223785,0.056923896074295044,0.2514583170413971,847.2938232421875,1e-05,0.07810837030410767,5.686537742614746,15.555094242095947,1 +1435,0.05461609736084938,0.14523759484291077,0.13536448776721954,0.19989582896232605,971.9750366210938,1e-05,0.06308852881193161,5.686566114425659,15.555094242095947,1 +1436,0.0897478312253952,0.062374938279390335,0.06573190540075302,0.16828525066375732,531.6091918945312,1e-05,0.06620404869318008,5.688195705413818,15.555094242095947,1 +1437,0.06700573116540909,0.06716235727071762,0.06421173363924026,0.24911056458950043,904.3141479492188,1e-05,0.0681554526090622,5.889416456222534,15.555094242095947,1 +1438,0.09771725535392761,0.15770015120506287,0.146591916680336,0.22892627120018005,308.7349548339844,1e-05,0.06055412068963051,5.8855204582214355,15.555094242095947,1 +1439,0.10195011645555496,0.07227987051010132,0.07148387283086777,0.20306889712810516,687.94970703125,1e-05,0.06324657052755356,5.68478536605835,15.555094242095947,1 +1440,0.09472683817148209,0.0645928680896759,0.06314972043037415,0.20693910121917725,908.0963134765625,1e-05,0.06440604478120804,5.6793036460876465,15.555094242095947,1 +1441,0.0634746178984642,0.053250525146722794,0.055703241378068924,0.16534455120563507,567.685546875,1e-05,0.079522505402565,5.683541297912598,15.555094242095947,1 +1442,0.09972036629915237,0.10017751902341843,0.09496429562568665,0.23529647290706635,616.125732421875,1e-05,0.07048944383859634,5.678659200668335,15.555094242095947,1 +1443,0.10136982053518295,0.05973580479621887,0.06282021850347519,0.24010415375232697,658.1439819335938,1e-05,0.0589827299118042,5.6804115772247314,15.555094242095947,1 +1444,0.07339872419834137,0.08776561915874481,0.08256503194570541,0.21047274768352509,680.7832641601562,1e-05,0.061227280646562576,5.679047107696533,15.555094242095947,1 +1445,0.10789927840232849,0.32839706540107727,0.3381323218345642,0.21678684651851654,121.84115600585938,1e-05,0.06297371536493301,5.6805641651153564,15.555094242095947,1 +1446,0.08551371842622757,0.10445985198020935,0.10393523424863815,0.17142628133296967,954.0719604492188,1e-05,0.06435322016477585,5.8586745262146,15.555094242095947,1 +1447,0.08182254433631897,0.11044692248106003,0.1069207713007927,0.2289823591709137,897.6888427734375,1e-05,0.07089003920555115,5.685152292251587,15.555094242095947,1 +1448,0.10921996831893921,0.1285584419965744,0.12336384505033493,0.2185496687889099,381.9444580078125,1e-05,0.06424234062433243,5.936093091964722,15.555094242095947,1 +1449,0.051431089639663696,0.13223551213741302,0.12247937172651291,0.25730767846107483,969.2273559570312,1e-05,0.11300481110811234,5.680436372756958,15.555094242095947,1 +1450,0.10810625553131104,0.10447163134813309,0.09886126965284348,0.1945512741804123,423.2804260253906,1e-05,0.06402399390935898,5.689192056655884,15.555094242095947,1 +1451,0.07002043724060059,0.05405678600072861,0.05532291904091835,0.1505608856678009,590.71728515625,1e-05,0.08491247147321701,5.686449289321899,15.555094242095947,1 +1452,0.07627652585506439,0.0928623154759407,0.08569498360157013,0.22996793687343597,927.5025634765625,1e-05,0.09182481467723846,5.689813852310181,15.555094242095947,1 +1453,0.11097913980484009,0.1405887007713318,0.13865476846694946,0.19336538016796112,305.8912353515625,1e-05,0.06669154763221741,5.680582046508789,15.555094242095947,1 +1454,0.1157645434141159,0.19673195481300354,0.2000039666891098,0.2287820428609848,218.64686584472656,1e-05,0.06997288763523102,5.904225587844849,15.555094242095947,1 +1455,0.07974643260240555,0.08645711839199066,0.08326365053653717,0.2974679470062256,480.2955627441406,1e-05,0.07638836652040482,5.681084394454956,15.555094242095947,1 +1456,0.09197509288787842,0.1047944724559784,0.10264801979064941,0.18457531929016113,652.4856567382812,1e-05,0.06048072502017021,5.677940130233765,15.555094242095947,1 +1457,0.0775008425116539,0.0855192095041275,0.08345898240804672,0.2185657024383545,719.4397583007812,1e-05,0.05106188356876373,5.673393726348877,15.555094242095947,1 +1458,0.07332096248865128,0.06921033561229706,0.06453683972358704,0.24172274768352509,841.503173828125,1e-05,0.07998340576887131,5.67667555809021,15.555094242095947,1 +1459,0.08477585762739182,0.09783787280321121,0.09232885390520096,0.26307690143585205,952.3810424804688,1e-05,0.05697498098015785,5.665994644165039,15.555094242095947,1 +1460,0.09658824652433395,0.1783851981163025,0.17130927741527557,0.17742787301540375,969.7308959960938,1e-05,0.059702660888433456,5.681403398513794,15.555094242095947,1 +1461,0.09020489454269409,0.11029563844203949,0.09972929954528809,0.22873397171497345,900.0560302734375,1e-05,0.08696960657835007,5.679646015167236,15.555094242095947,1 +1462,0.06409119069576263,0.07468921691179276,0.07047679275274277,0.1962660253047943,889.5617065429688,1e-05,0.04408053308725357,5.86764121055603,15.555094242095947,1 +1463,0.09845627844333649,0.07576275616884232,0.06615866720676422,0.24907051026821136,903.9313354492188,1e-05,0.05936586484313011,5.697644948959351,15.555094242095947,1 +1464,0.11008135229349136,0.1985211968421936,0.1882607787847519,0.18169069290161133,997.3726806640625,1e-05,0.06007937341928482,5.68073296546936,15.555094242095947,1 +1465,0.09820793569087982,0.13483478128910065,0.1306673139333725,0.22756409645080566,362.2159423828125,1e-05,0.06804253906011581,5.6838483810424805,15.555094242095947,1 +1466,0.07675105333328247,0.07677674293518066,0.07814161479473114,0.17278043925762177,665.8878784179688,1e-05,0.07360244542360306,5.678428649902344,15.555094242095947,1 +1467,0.09857282042503357,0.05318346247076988,0.05318047106266022,0.19402243196964264,841.503173828125,1e-05,0.06858097016811371,5.680874586105347,15.555094242095947,1 +1468,0.09654679149389267,0.13888849318027496,0.13816648721694946,0.19189903140068054,957.6707763671875,1e-05,0.09177746623754501,5.676538467407227,15.555094242095947,1 +1469,0.11765335500240326,0.06636092811822891,0.06344323605298996,0.15358974039554596,740.2120361328125,1e-05,0.0628155916929245,5.882343769073486,15.555094242095947,1 +1470,0.09403875470161438,0.0450739823281765,0.043834954500198364,0.2551282048225403,691.9642944335938,1e-05,0.06687158346176147,5.68766188621521,15.555094242095947,1 +1471,0.08644421398639679,0.12026110291481018,0.12944866716861725,0.13960736989974976,959.3023071289062,1e-05,0.05449738726019859,5.689368009567261,15.555094242095947,1 +1472,0.09298247843980789,0.09652739763259888,0.09697065502405167,0.19163461029529572,560.154541015625,1e-05,0.0763542503118515,5.680594444274902,15.555094242095947,1 +1473,0.07994483411312103,0.0734095424413681,0.07027416676282883,0.2533012628555298,812.3250122070312,1e-05,0.07125493884086609,5.688387155532837,15.555094242095947,1 +1474,0.08035828173160553,0.11451135575771332,0.12055525183677673,0.20242787897586823,801.64990234375,1e-05,0.07432872802019119,5.685495376586914,15.555094242095947,1 +1475,0.10368667542934418,0.09018643945455551,0.08988665789365768,0.13333332538604736,920.358642578125,1e-05,0.06540679931640625,5.689781188964844,15.555094242095947,1 +1476,0.10291683673858643,0.059983331710100174,0.061109960079193115,0.15448717772960663,714.8972778320312,1e-05,0.06394946575164795,5.688449382781982,15.555094242095947,1 +1477,0.10555244982242584,0.08565804362297058,0.08143432438373566,0.22205927968025208,888.7283325195312,1e-05,0.07202215492725372,5.737351417541504,15.555094242095947,1 +1478,0.13234561681747437,0.26638326048851013,0.26441270112991333,0.19979967176914215,164.93057250976562,1e-05,0.059168849140405655,5.680777072906494,15.555094242095947,1 +1479,0.11197465658187866,0.15259115397930145,0.14233370125293732,0.1843189001083374,977.787353515625,1e-05,0.061205364763736725,5.68191385269165,15.555094242095947,1 +1480,0.09872381389141083,0.1669764667749405,0.1583060622215271,0.2538701891899109,969.9821166992188,1e-05,0.06097686290740967,5.674661159515381,15.555094242095947,1 +1481,0.1100543662905693,0.15524087846279144,0.16249752044677734,0.2884775400161743,190.67796325683594,1e-05,0.06535837799310684,5.6847779750823975,15.555094242095947,1 +1482,0.08809192478656769,0.11018731445074081,0.11019865423440933,0.2036057561635971,336.25732421875,1e-05,0.06882143765687943,5.688457489013672,15.555094242095947,1 +1483,0.09683932363986969,0.07317550480365753,0.06960826367139816,0.2910096049308777,569.172119140625,1e-05,0.07364257425069809,5.684108018875122,15.555094242095947,1 +1484,0.15806831419467926,0.06125621870160103,0.056036341935396194,0.17788460850715637,528.291015625,1e-05,0.079200878739357,5.6792151927948,15.555094242095947,1 +1485,0.07437174022197723,0.0678887888789177,0.06588217616081238,0.24972756206989288,733.4710693359375,1e-05,0.06893526762723923,5.688183069229126,15.555094242095947,1 +1486,0.06499592959880829,0.030367273837327957,0.036974165588617325,0.2276282012462616,900.0560302734375,1e-05,0.07791135460138321,5.68209981918335,15.555094242095947,1 +1487,0.09875979274511337,0.10080435127019882,0.09704624116420746,0.17876601219177246,827.1312866210938,1e-05,0.07634191960096359,5.686150074005127,15.555094242095947,1 +1488,0.07554478943347931,0.12122426927089691,0.11622403562068939,0.25207531452178955,982.9059448242188,1e-05,0.07096816599369049,5.679193735122681,15.555094242095947,1 +1489,0.08195313811302185,0.08553290367126465,0.08056654781103134,0.19593749940395355,767.7470092773438,1e-05,0.06610088795423508,5.685454607009888,15.555094242095947,1 +1490,0.06462221592664719,0.05430062487721443,0.05311312898993492,0.19480767846107483,847.2938232421875,1e-05,0.06846465170383453,5.682037830352783,15.555094242095947,1 +1491,0.07388215512037277,0.0985085591673851,0.09598324447870255,0.2767227590084076,546.1712036132812,1e-05,0.07190808653831482,5.678295612335205,15.555094242095947,1 +1492,0.06955000013113022,0.08506613224744797,0.08582344651222229,0.2571554481983185,940.900146484375,1e-05,0.08223587274551392,5.686359405517578,15.555094242095947,1 +1493,0.14268508553504944,0.041438959538936615,0.044761788100004196,0.14857371151447296,946.896240234375,1e-05,0.07990176230669022,5.688351631164551,15.555094242095947,1 +1494,0.10372550040483475,0.09645270556211472,0.08985742181539536,0.2667147219181061,910.6948852539062,1e-05,0.09529048204421997,5.684201717376709,15.555094242095947,1 +1495,0.08638956397771835,0.20785339176654816,0.20308662950992584,0.23258812725543976,993.642333984375,1e-05,0.060728345066308975,5.6849305629730225,15.555094242095947,1 +1496,0.15689632296562195,0.09564551711082458,0.09637708961963654,0.25633013248443604,967.7055053710938,1e-05,0.0776827484369278,5.679263353347778,15.555094242095947,1 +1497,0.11526283621788025,0.09483596682548523,0.09177891910076141,0.2429727464914322,654.7619018554688,1e-05,0.09699459373950958,5.685284376144409,15.555094242095947,1 +1498,0.11955200135707855,0.05843985825777054,0.05514807254076004,0.2129727452993393,728.2971801757812,1e-05,0.06503713876008987,5.6870574951171875,15.555094242095947,1 +1499,0.057367511093616486,0.09144596010446548,0.09102796763181686,0.23790864646434784,911.7965698242188,1e-05,0.07313139736652374,5.678318500518799,15.555094242095947,1 +1500,0.14076508581638336,0.11130829900503159,0.10885933041572571,0.15494389832019806,412.1983947753906,1e-05,0.07261547446250916,5.686382055282593,15.555094242095947,1 +1501,0.1005111113190651,0.09251151233911514,0.08469127118587494,0.22304485738277435,954.3519897460938,1e-05,0.08187136054039001,5.764727354049683,15.555094242095947,1 +1502,0.09572423994541168,0.09374498575925827,0.0882590115070343,0.17897434532642365,957.9439697265625,1e-05,0.06786253303289413,5.701497554779053,15.555094242095947,1 +1503,0.10967305302619934,0.07149948179721832,0.07066241651773453,0.27736377716064453,653.6259765625,1e-05,0.0764043852686882,5.693905353546143,15.555094242095947,1 +1504,0.07916070520877838,0.06405939906835556,0.06298330426216125,0.15756410360336304,812.3250122070312,1e-05,0.08047660440206528,5.703095436096191,15.555094242095947,1 +1505,0.07404215633869171,0.1782054305076599,0.16261693835258484,0.20451922714710236,989.8002319335938,1e-05,0.07009173184633255,5.69570255279541,15.555094242095947,1 +1506,0.09566634148359299,0.06292292475700378,0.056243423372507095,0.23145832121372223,889.9769897460938,1e-05,0.06645897030830383,5.959930419921875,15.555094242095947,1 +1507,0.08771634846925735,0.21087539196014404,0.2052716761827469,0.24125801026821136,183.4470977783203,1e-05,0.07325281202793121,5.686163902282715,15.555094242095947,1 +1508,0.06276778131723404,0.07989881187677383,0.0820450633764267,0.23613780736923218,647.8805541992188,1e-05,0.0600162073969841,5.695558071136475,15.555094242095947,1 +1509,0.07655297964811325,0.1781706064939499,0.17269736528396606,0.18825319409370422,978.7327270507812,1e-05,0.07784932106733322,5.699233531951904,15.555094242095947,1 +1510,0.07802324742078781,0.09099151939153671,0.09382369369268417,0.18291665613651276,697.8798828125,1e-05,0.07162921130657196,5.68766713142395,15.555094242095947,1 +1511,0.07531684637069702,0.08533531427383423,0.07823529839515686,0.23277242481708527,709.3425903320312,1e-05,0.06861288845539093,5.696372985839844,15.555094242095947,1 +1512,0.0801755040884018,0.1310659795999527,0.12199476361274719,0.2290624976158142,943.3267822265625,1e-05,0.05623163655400276,5.6877665519714355,15.555094242095947,1 +1513,0.09982148557901382,0.1024630218744278,0.09884366393089294,0.25458332896232605,672.3660278320312,1e-05,0.06084487959742546,5.68809962272644,15.555094242095947,1 +1514,0.09588432312011719,0.3146428167819977,0.3118692636489868,0.24608974158763885,133.9285888671875,1e-05,0.0629374161362648,5.684699535369873,15.555094242095947,1 +1515,0.055351875722408295,0.056319307535886765,0.05889735370874405,0.22765223681926727,879.3001098632812,1e-05,0.06454572081565857,5.687021970748901,15.555094242095947,1 +1516,0.10554355382919312,0.09603777527809143,0.09058211743831635,0.29296472668647766,730.8970947265625,1e-05,0.07772999256849289,5.693094730377197,15.555094242095947,1 +1517,0.0831885114312172,0.046707943081855774,0.04558665677905083,0.24299678206443787,640.8381958007812,1e-05,0.07291743904352188,5.702865123748779,15.555094242095947,1 +1518,0.09224843978881836,0.07860609143972397,0.0720210000872612,0.23162660002708435,865.1477661132812,1e-05,0.06735213845968246,5.687934398651123,15.555094242095947,1 +1519,0.10207271575927734,0.0836285650730133,0.08174244314432144,0.23578524589538574,516.4320068359375,1e-05,0.05378243699669838,5.685421705245972,15.555094242095947,1 +1520,0.110756516456604,0.17945197224617004,0.1770254671573639,0.22524037957191467,161.1498260498047,1e-05,0.06255288422107697,5.689819574356079,15.555094242095947,1 +1521,0.07495487481355667,0.11796420067548752,0.11821044981479645,0.20992787182331085,794.4606323242188,1e-05,0.06968860328197479,5.68198037147522,15.555094242095947,1 +1522,0.08329739421606064,0.13288000226020813,0.13317923247814178,0.2686378061771393,930.4703369140625,1e-05,0.06635379791259766,5.688168048858643,15.555094242095947,1 +1523,0.10901026427745819,0.07868985086679459,0.07862551510334015,0.13576923310756683,414.4384765625,1e-05,0.05463700741529465,5.688914775848389,15.555094242095947,1 +1524,0.09510587900876999,0.08889787644147873,0.08908523619174957,0.10120993107557297,434.0730895996094,1e-05,0.05483129993081093,5.694438219070435,15.555094242095947,1 +1525,0.09211970120668411,0.08601146191358566,0.08165831118822098,0.26073718070983887,931.447509765625,1e-05,0.06609325855970383,5.70112419128418,15.555094242095947,1 +1526,0.14871913194656372,0.044949885457754135,0.04357099160552025,0.26356568932533264,576.5086669921875,1e-05,0.0647888258099556,5.68700385093689,15.555094242095947,1 +1527,0.07828518003225327,0.069764144718647,0.0677977204322815,0.24137820303440094,598.9583129882812,1e-05,0.06452430039644241,5.685209512710571,15.555094242095947,1 +1528,0.08213686943054199,0.0804712250828743,0.0822862982749939,0.23683492839336395,577.95703125,1e-05,0.06587466597557068,5.692817449569702,15.555094242095947,1 +1529,0.09298685193061829,0.058837585151195526,0.059861619025468826,0.25265222787857056,478.3950500488281,1e-05,0.05874162167310715,5.678239583969116,15.555094242095947,1 +1530,0.07283894717693329,0.08106417953968048,0.0786043256521225,0.27678683400154114,487.8049011230469,1e-05,0.05770206078886986,5.692152976989746,15.555094242095947,1 +1531,0.05431138724088669,0.0786985531449318,0.07570619136095047,0.14202724397182465,900.0560302734375,1e-05,0.06205093115568161,5.687932014465332,15.555094242095947,1 +1532,0.09503219276666641,0.12467345595359802,0.11597970873117447,0.21225960552692413,876.6427001953125,1e-05,0.06180166080594063,5.9554688930511475,15.555094242095947,1 +1533,0.0912020355463028,0.15919511020183563,0.14676450192928314,0.23895832896232605,991.0935668945312,1e-05,0.06978791952133179,5.900165557861328,15.555094242095947,1 +1534,0.11242805421352386,0.05450136587023735,0.05526844412088394,0.11363781988620758,600.3118286132812,1e-05,0.06755183637142181,5.683783292770386,15.555094242095947,1 +1535,0.07911533117294312,0.06995319575071335,0.06786459684371948,0.2055448591709137,801.0057983398438,1e-05,0.08350810408592224,5.851329326629639,15.555094242095947,1 +1536,0.0287006888538599,0.08196384459733963,0.07091677933931351,0.26627403497695923,772.9007568359375,1e-05,0.04553571715950966,5.684805870056152,15.555094242095947,1 +1537,0.11215923726558685,0.10772924870252609,0.10214465856552124,0.2760256230831146,823.6697998046875,1e-05,0.07455256581306458,5.687081575393677,15.555094242095947,1 +1538,0.09077626466751099,0.0604948028922081,0.057972878217697144,0.20536857843399048,712.13427734375,1e-05,0.08498610556125641,5.691650629043579,15.555094242095947,1 +1539,0.11471462994813919,0.04473850131034851,0.05205861106514931,0.1904086470603943,669.14501953125,1e-05,0.06471412628889084,5.690008640289307,15.555094242095947,1 +1540,0.10545434802770615,0.11040754616260529,0.10395682603120804,0.26122593879699707,934.9798583984375,1e-05,0.05295106768608093,5.686398029327393,15.555094242095947,1 +1541,0.07379426807165146,0.11508945375680923,0.11473114043474197,0.08166666328907013,990.448486328125,1e-05,0.07533972710371017,5.6903603076934814,15.555094242095947,1 +1542,0.13182051479816437,0.06811907887458801,0.06622160971164703,0.15360575914382935,528.291015625,1e-05,0.07174689322710037,5.680166959762573,15.555094242095947,1 +1543,0.06453252583742142,0.21347486972808838,0.21811534464359283,0.29326921701431274,992.374267578125,1e-05,0.055974796414375305,5.683679819107056,15.555094242095947,1 +1544,0.10025012493133545,0.09491941332817078,0.09425806999206543,0.2041025608778,619.959716796875,1e-05,0.055266670882701874,5.708353519439697,15.555094242095947,1 +1545,0.12460191547870636,0.11812551319599152,0.113958440721035,0.20470352470874786,944.2269897460938,1e-05,0.07888052612543106,5.684229850769043,15.555094242095947,1 +1546,0.08443564176559448,0.113762766122818,0.11086229234933853,0.24766826629638672,349.42364501953125,1e-05,0.08318077027797699,5.685427665710449,15.555094242095947,1 +1547,0.09143909811973572,0.11444628238677979,0.1106216162443161,0.23076921701431274,896.8926391601562,1e-05,0.07120326161384583,5.68904709815979,15.555094242095947,1 +1548,0.06065982207655907,0.031441591680049896,0.0337555930018425,0.11121794581413269,528.291015625,1e-05,0.06467512249946594,5.699833154678345,15.555094242095947,1 +1549,0.11175230145454407,0.07215118408203125,0.06815092265605927,0.2602243423461914,888.3101196289062,1e-05,0.09462477266788483,5.689775228500366,15.555094242095947,1 +1550,0.054877638816833496,0.08976060897111893,0.08527905493974686,0.20597755908966064,967.9602661132812,1e-05,0.05912051349878311,5.689117431640625,15.555094242095947,1 +1551,0.1595977544784546,0.12046412378549576,0.12714916467666626,0.2763140797615051,238.6731414794922,1e-05,0.07079461961984634,5.691196918487549,15.555094242095947,1 +1552,0.06616426259279251,0.045918431133031845,0.04994230344891548,0.20596152544021606,730.8970947265625,1e-05,0.05206312611699104,5.689343214035034,15.555094242095947,1 +1553,0.10837481915950775,0.06888057291507721,0.07054854929447174,0.23297274112701416,608.3162231445312,1e-05,0.06313537061214447,5.685128211975098,15.555094242095947,1 +1554,0.08694372326135635,0.057478759437799454,0.05607236176729202,0.16383813321590424,753.1796264648438,1e-05,0.0581139512360096,5.685615301132202,15.555094242095947,1 +1555,0.10963837802410126,0.08471342921257019,0.07800834625959396,0.25070512294769287,924.81787109375,1e-05,0.06533490866422653,5.685650110244751,15.555094242095947,1 +1556,0.09146271646022797,0.0644301176071167,0.0633067786693573,0.13308493793010712,663.6961059570312,1e-05,0.07037871330976486,5.681537389755249,15.555094242095947,1 +1557,0.059078820049762726,0.17418994009494781,0.14496521651744843,0.252532035112381,996.7586059570312,1e-05,0.047483161091804504,5.684385061264038,15.555094242095947,1 +1558,0.067428819835186,0.14672604203224182,0.1416829377412796,0.1640544831752777,990.232666015625,1e-05,0.05589098855853081,5.763781547546387,15.555094242095947,1 +1559,0.06692548096179962,0.11785890907049179,0.11334534734487534,0.25208333134651184,973.6957397460938,1e-05,0.05704084783792496,5.92643928527832,15.555094242095947,1 +1560,0.08603204786777496,0.09359802305698395,0.08597265928983688,0.2532852590084076,791.1160888671875,1e-05,0.0685068815946579,5.685606479644775,15.555094242095947,1 +1561,0.0802268236875534,0.07899545878171921,0.07649938017129898,0.2114262729883194,787.721923828125,1e-05,0.05215595290064812,5.684715509414673,15.555094242095947,1 +1562,0.07737559825181961,0.07436122000217438,0.06813604384660721,0.2345753163099289,763.9968872070312,1e-05,0.053358882665634155,5.6894659996032715,15.555094242095947,1 +1563,0.08973342180252075,0.1297835260629654,0.12383206933736801,0.13826121389865875,995.5211791992188,1e-05,0.06446150690317154,5.686131238937378,15.555094242095947,1 +1564,0.05887599661946297,0.0663636103272438,0.06414233148097992,0.1476762741804123,705.574951171875,1e-05,0.052512381225824356,5.680835723876953,15.555094242095947,1 +1565,0.0985250324010849,0.1606132686138153,0.15725798904895782,0.21092146635055542,997.3726806640625,1e-05,0.05491829663515091,5.6923463344573975,15.555094242095947,1 +1566,0.074630007147789,0.07306763529777527,0.07063549757003784,0.19655448198318481,923.1171264648438,1e-05,0.06319715827703476,5.680164575576782,15.555094242095947,1 +1567,0.036597080528736115,0.05688392370939255,0.05834507569670677,0.24522435665130615,968.2146606445312,1e-05,0.052432581782341,5.683004140853882,15.555094242095947,1 +1568,0.10685538500547409,0.07582640647888184,0.07463626563549042,0.2696634531021118,472.6368408203125,1e-05,0.060500867664813995,6.139292478561401,15.555094242095947,1 +1569,0.09971228986978531,0.06861861050128937,0.06500090658664703,0.2170112133026123,663.6961059570312,1e-05,0.06447228044271469,5.689862966537476,15.555094242095947,1 +1570,0.09022653847932816,0.08245955407619476,0.07904709875583649,0.16119390726089478,948.3590698242188,1e-05,0.06657286733388901,5.698658466339111,15.555094242095947,1 +1571,0.10510091483592987,0.05393899232149124,0.05833365023136139,0.20112179219722748,665.8878784179688,1e-05,0.06937085837125778,5.7414679527282715,15.555094242095947,1 +1572,0.09587238729000092,0.07216031849384308,0.0692274197936058,0.2997836470603943,787.0369873046875,1e-05,0.07394582033157349,5.691111087799072,15.555094242095947,1 +1573,0.09672936797142029,0.02173461765050888,0.025247791782021523,0.22131408751010895,766.25390625,1e-05,0.06740151345729828,5.684309720993042,15.555094242095947,1 +1574,0.10190320014953613,0.08345315605401993,0.07647503167390823,0.27842146158218384,670.22265625,1e-05,0.09226219356060028,5.6834046840667725,15.555094242095947,1 +1575,0.07790536433458328,0.09554459899663925,0.08422747999429703,0.15613780915737152,921.7437133789062,1e-05,0.06302419304847717,5.67789101600647,15.555094242095947,1 +1576,0.0689067617058754,0.08488695323467255,0.07861322909593582,0.2774038314819336,813.5474853515625,1e-05,0.06256239861249924,5.6876091957092285,15.555094242095947,1 +1577,0.11595433205366135,0.052736423909664154,0.04968356341123581,0.19064101576805115,767.0015869140625,1e-05,0.08199042826890945,5.674395561218262,15.555094242095947,1 +1578,0.0874451994895935,0.10803906619548798,0.09610411524772644,0.23145031929016113,935.9296264648438,1e-05,0.053255558013916016,5.682751417160034,15.555094242095947,1 +1579,0.08208868652582169,0.08536937832832336,0.07206808775663376,0.21889422833919525,931.447509765625,1e-05,0.06040788069367409,5.683605670928955,15.555094242095947,1 +1580,0.06693844497203827,0.04657316952943802,0.045063432306051254,0.19759614765644073,687.94970703125,1e-05,0.06619293242692947,5.684159278869629,15.555094242095947,1 +1581,0.11428418755531311,0.08998793363571167,0.08394529670476913,0.2771233916282654,960.3799438476562,1e-05,0.07457807660102844,5.888331413269043,15.555094242095947,1 +1582,0.0962207093834877,0.12284235656261444,0.11162671446800232,0.23030447959899902,939.6723022460938,1e-05,0.05507383495569229,5.686057806015015,15.555094242095947,1 +1583,0.10133146494626999,0.10857408493757248,0.1042797788977623,0.2704487144947052,662.593994140625,1e-05,0.06708614528179169,5.687687397003174,15.555094242095947,1 +1584,0.07500749081373215,0.11025340855121613,0.10460077971220016,0.24728363752365112,820.7417602539062,1e-05,0.08828312158584595,5.681886434555054,15.555094242095947,1 +1585,0.10390187799930573,0.7547397017478943,0.7609295845031738,0.09231570363044739,24.50980567932129,1e-05,0.056065771728754044,5.723673582077026,15.555094242095947,1 +1586,0.10221242904663086,0.07705554366111755,0.07385699450969696,0.20829325914382935,918.9618530273438,1e-05,0.1307128667831421,5.702453851699829,15.555094242095947,1 +1587,0.11479195952415466,0.10682973265647888,0.10741855204105377,0.24446313083171844,377.094970703125,1e-05,0.06007932871580124,5.6726601123809814,15.555094242095947,1 +1588,0.06222541630268097,0.06927520781755447,0.0696544200181961,0.2278285175561905,560.154541015625,1e-05,0.0882907509803772,5.685170412063599,15.555094242095947,1 +1589,0.09099245816469193,0.07555336505174637,0.07646816223859787,0.21767626702785492,935.2970581054688,1e-05,0.08110389858484268,5.681405782699585,15.555094242095947,1 +1590,0.06376238912343979,0.04152023047208786,0.0434589609503746,0.1300160139799118,869.8297119140625,1e-05,0.05767273157835007,5.8892600536346436,15.555094242095947,1 +1591,0.12136638909578323,0.06064475700259209,0.06215221434831619,0.24374999105930328,762.48046875,1e-05,0.05398557335138321,5.949555397033691,15.555094242095947,1 +1592,0.053341060876846313,0.16383488476276398,0.15827049314975739,0.15955929458141327,964.61181640625,1e-05,0.07030142843723297,5.933096647262573,15.555094242095947,1 +1593,0.11470244079828262,0.08334387838840485,0.08137472718954086,0.1794871687889099,416.6666564941406,1e-05,0.06673312932252884,5.683144569396973,15.555094242095947,1 +1594,0.054950594902038574,0.12537074089050293,0.1298311948776245,0.24020832777023315,983.36181640625,1e-05,0.05518246814608574,5.678337097167969,15.555094242095947,1 +1595,0.09515616297721863,0.08630330860614777,0.07875918596982956,0.2678445279598236,800.3597412109375,1e-05,0.06167544424533844,5.677596092224121,15.555094242095947,1 +1596,0.0772940069437027,0.09841561317443848,0.09074386209249496,0.10345352441072464,962.7756958007812,1e-05,0.05707436054944992,5.670894622802734,15.555094242095947,1 +1597,0.0764232724905014,0.05374203249812126,0.05733694136142731,0.20761217176914215,973.2064208984375,1e-05,0.061480361968278885,5.68068265914917,15.555094242095947,1 +1598,0.08580812811851501,0.06275373697280884,0.06259433180093765,0.2219391018152237,707.4652709960938,1e-05,0.06710682064294815,5.6795127391815186,15.555094242095947,1 +1599,0.06962079554796219,0.07932499051094055,0.07194307446479797,0.26047274470329285,696.9026489257812,1e-05,0.058120135217905045,5.679285049438477,15.555094242095947,1 +1600,0.09003378450870514,0.0656333863735199,0.06304661929607391,0.23285254836082458,862.7633056640625,1e-05,0.06271891295909882,5.6853721141815186,15.555094242095947,1 +1601,0.09287134557962418,0.07193762809038162,0.0686044692993164,0.09207531809806824,865.1477661132812,1e-05,0.07151971012353897,5.682892084121704,15.555094242095947,1 +1602,0.10370978713035583,0.15990254282951355,0.18613697588443756,0.21669070422649384,113.63636016845703,1e-05,0.06324362009763718,5.776228666305542,15.555094242095947,1 +1603,0.07989726960659027,0.054620418697595596,0.0507952943444252,0.23858171701431274,728.2971801757812,1e-05,0.07955707609653473,5.687011480331421,15.555094242095947,1 +1604,0.046258263289928436,0.19575534760951996,0.19370275735855103,0.24136216938495636,979.2027587890625,1e-05,0.0625385046005249,5.679279327392578,15.555094242095947,1 +1605,0.04799667000770569,0.06382735818624496,0.06698187440633774,0.25447115302085876,930.7967529296875,1e-05,0.06712248176336288,5.685295343399048,15.555094242095947,1 +1606,0.0426965095102787,0.06492442637681961,0.06393200159072876,0.24148236215114594,705.574951171875,1e-05,0.07668077945709229,5.726467609405518,15.555094242095947,1 +1607,0.1345067024230957,0.09867747873067856,0.09464970231056213,0.2560817301273346,514.7058715820312,1e-05,0.08114642649888992,5.686209440231323,15.555094242095947,1 +1608,0.07577300071716309,0.08369754254817963,0.09032973647117615,0.20040865242481232,954.9102783203125,1e-05,0.06030397489666939,5.6789233684539795,15.555094242095947,1 +1609,0.10824259370565414,0.08417575061321259,0.08162795752286911,0.20010416209697723,678.7020263671875,1e-05,0.07239607721567154,5.6888933181762695,15.555094242095947,1 +1610,0.08730091899633408,0.6433133482933044,0.6555434465408325,0.23157049715518951,996.3473510742188,1e-05,0.09067725390195847,5.681704759597778,15.555094242095947,1 +1611,0.06937004625797272,0.048528000712394714,0.048565324395895004,0.23401442170143127,747.5884399414062,1e-05,0.06147858500480652,5.910484313964844,15.555094242095947,1 +1612,0.06386934220790863,0.09542223066091537,0.0911538228392601,0.2818509638309479,674.4935913085938,1e-05,0.09663687646389008,5.679577350616455,15.555094242095947,1 +1613,0.08994224667549133,0.10209283232688904,0.1015484482049942,0.2892547845840454,663.6961059570312,1e-05,0.08562083542346954,5.7605140209198,15.555094242095947,1 +1614,0.08371129631996155,0.055369362235069275,0.05602102354168892,0.2730528712272644,660.3773803710938,1e-05,0.0654071718454361,5.676804780960083,15.555094242095947,1 +1615,0.09072091430425644,0.13563483953475952,0.13726229965686798,0.1782451868057251,957.39697265625,1e-05,0.06894610077142715,5.684232234954834,15.555094242095947,1 +1616,0.07310386002063751,0.09688367694616318,0.09249290823936462,0.23318909108638763,960.6482543945312,1e-05,0.056531213223934174,5.694503307342529,15.555094242095947,1 +1617,0.0651736781001091,0.1141950860619545,0.10869976133108139,0.25141024589538574,346.82080078125,1e-05,0.08229324221611023,5.716508865356445,15.555094242095947,1 +1618,0.11503127962350845,0.10368607938289642,0.10503800958395004,0.16499999165534973,865.6211547851562,1e-05,0.0615403987467289,5.684294939041138,15.555094242095947,1 +1619,0.0592469722032547,0.196246936917305,0.19321560859680176,0.1947435885667801,981.2984008789062,1e-05,0.06392110139131546,5.686821460723877,15.555094242095947,1 +1620,0.10480398684740067,0.061682671308517456,0.06061440333724022,0.24283653497695923,759.419189453125,1e-05,0.08889750391244888,5.769108533859253,15.555094242095947,1 +1621,0.0924549475312233,0.07265577465295792,0.06814289093017578,0.22644229233264923,906.2156372070312,1e-05,0.06049017235636711,5.6807732582092285,15.555094242095947,1 +1622,0.08362201601266861,0.08563530445098877,0.08288760483264923,0.2599519193172455,550.8948364257812,1e-05,0.0722646415233612,5.689216136932373,15.555094242095947,1 +1623,0.06066852807998657,0.06289106607437134,0.06353568285703659,0.23644229769706726,814.7632446289062,1e-05,0.05257313326001167,5.6875996589660645,15.555094242095947,1 +1624,0.13980068266391754,0.06675852090120316,0.06555062532424927,0.2222195416688919,398.5013732910156,1e-05,0.06803649663925171,5.680486679077148,15.555094242095947,1 +1625,0.07745333015918732,0.06941789388656616,0.06114478036761284,0.2541666626930237,764.7515258789062,1e-05,0.05819101259112358,5.699894666671753,15.555094242095947,1 +1626,0.06168292462825775,0.11541163921356201,0.11331101506948471,0.2804967761039734,516.4320068359375,1e-05,0.08581797778606415,5.689987897872925,15.555094242095947,1 +1627,0.1193750873208046,0.09809044003486633,0.09867414832115173,0.2518669664859772,403.11651611328125,1e-05,0.062098387628793716,5.886768817901611,15.555094242095947,1 +1628,0.08413010090589523,0.0441378578543663,0.04580501466989517,0.2343669831752777,555.5556030273438,1e-05,0.054283421486616135,5.676457166671753,15.555094242095947,1 +1629,0.08025096356868744,0.13270768523216248,0.1280117779970169,0.19032852351665497,938.1237182617188,1e-05,0.06988819688558578,5.682607412338257,15.555094242095947,1 +1630,0.10253071784973145,0.09057606756687164,0.08475247025489807,0.3021954894065857,600.3118286132812,1e-05,0.06196151301264763,5.684513807296753,15.555094242095947,1 +1631,0.0825444683432579,0.07516167312860489,0.07498320192098618,0.2319711446762085,903.5476684570312,1e-05,0.06495581567287445,5.696294069290161,15.555094242095947,1 +1632,0.11814519017934799,0.11108207702636719,0.10951857268810272,0.19369390606880188,828.8410034179688,1e-05,0.06329875439405441,5.685049533843994,15.555094242095947,1 +1633,0.08346479386091232,0.10132835805416107,0.09088058769702911,0.25627401471138,954.0719604492188,1e-05,0.06353261321783066,5.755985260009766,15.555094242095947,1 +1634,0.07428224384784698,0.07097232341766357,0.07217772305011749,0.26731568574905396,878.4185791015625,1e-05,0.07739966362714767,5.700292110443115,15.555094242095947,1 +1635,0.025405844673514366,0.1616739183664322,0.16053512692451477,0.17854967713356018,973.4513549804688,1e-05,0.059256333857774734,5.685832262039185,15.555094242095947,1 +1636,0.09893010556697845,0.1797041893005371,0.17582963407039642,0.14281249046325684,996.1414184570312,1e-05,0.08397497981786728,5.684328079223633,15.555094242095947,1 +1637,0.05424358695745468,0.11661353707313538,0.1120644062757492,0.22045671939849854,960.1112060546875,1e-05,0.07503608614206314,5.697065114974976,15.555094242095947,1 +1638,0.13541346788406372,0.12502184510231018,0.11856004595756531,0.23133012652397156,434.0730895996094,1e-05,0.06862548738718033,5.6878416538238525,15.555094242095947,1 +1639,0.11845313757658005,0.03457237407565117,0.038716547191143036,0.21185897290706635,440.41455078125,1e-05,0.05900888890028,5.847938060760498,15.555094242095947,1 +1640,0.055172909051179886,0.15447667241096497,0.14245904982089996,0.2819230556488037,981.5291137695312,1e-05,0.06311540305614471,5.690889596939087,15.555094242095947,1 +1641,0.0819484069943428,0.16663368046283722,0.1717737764120102,0.2301281988620758,988.9306640625,1e-05,0.08375182002782822,5.696464538574219,15.555094242095947,1 +1642,0.09432103484869003,0.07039178162813187,0.07110945880413055,0.26016825437545776,783.5821533203125,1e-05,0.08259198069572449,5.689138412475586,15.555094242095947,1 +1643,0.12115898728370667,0.34641528129577637,0.34842631220817566,0.2106490284204483,125.89928436279297,1e-05,0.06454373896121979,5.684729814529419,15.555094242095947,1 +1644,0.0879906564950943,0.1889093965291977,0.1821010261774063,0.19650639593601227,145.7597198486328,1e-05,0.06617744266986847,5.674937009811401,15.555094242095947,1 +1645,0.08896990865468979,0.05047006532549858,0.05260336771607399,0.18140223622322083,700.7908935546875,1e-05,0.07088998705148697,5.717792987823486,15.555094242095947,1 +1646,0.0997157171368599,0.06431131064891815,0.059473033994436264,0.2641907036304474,782.1857299804688,1e-05,0.08156552910804749,5.678142786026001,15.555094242095947,1 +1647,0.08818784356117249,0.12981471419334412,0.11999911814928055,0.2801121771335602,934.3434448242188,1e-05,0.06301168352365494,5.681671380996704,15.555094242095947,1 +1648,0.1251254379749298,0.11910352110862732,0.1164257600903511,0.23115383088588715,864.197509765625,1e-05,0.08362878113985062,5.690242052078247,15.555094242095947,1 +1649,0.08012785017490387,0.08163760602474213,0.07451675087213516,0.24955126643180847,716.7235717773438,1e-05,0.0805436223745346,5.68658447265625,15.555094242095947,1 +1650,0.10587693750858307,0.11014393717050552,0.105421282351017,0.21301281452178955,552.4553833007812,1e-05,0.057625703513622284,5.684392690658569,15.555094242095947,1 +1651,0.06647181510925293,0.10937683284282684,0.1038305014371872,0.2893829941749573,902.3915405273438,1e-05,0.06454538553953171,5.682783365249634,15.555094242095947,1 +1652,0.09499123692512512,0.09967121481895447,0.09575561434030533,0.2263862043619156,800.3597412109375,1e-05,0.06337307393550873,5.682227373123169,15.555094242095947,1 +1653,0.10254950821399689,0.05635553598403931,0.060102444142103195,0.17157050967216492,835.5437622070312,1e-05,0.07961130142211914,5.6819891929626465,15.555094242095947,1 +1654,0.1292816549539566,0.07793483883142471,0.07126803696155548,0.26806890964508057,899.6636962890625,1e-05,0.07382257282733917,5.756518125534058,15.555094242095947,1 +1655,0.09386099129915237,0.17379480600357056,0.1692448854446411,0.24977563321590424,984.94482421875,1e-05,0.061896298080682755,5.706905841827393,15.555094242095947,1 +1656,0.0726279616355896,0.47179168462753296,0.4653424620628357,0.2516586482524872,79.58802795410156,1e-05,0.06573233008384705,5.7124598026275635,15.555094242095947,1 +1657,0.08431536704301834,0.06975097954273224,0.0671258196234703,0.23161056637763977,528.291015625,1e-05,0.07495563477277756,5.711892127990723,15.555094242095947,1 +1658,0.11948632448911667,0.14312727749347687,0.1387084722518921,0.26105767488479614,970.9821166992188,1e-05,0.07728684693574905,5.694059371948242,15.555094242095947,1 +1659,0.09746591746807098,0.06695487350225449,0.06308117508888245,0.23993588984012604,844.6821899414062,1e-05,0.07843836396932602,5.7002012729644775,15.555094242095947,1 +1660,0.06742332875728607,0.18035931885242462,0.1723160743713379,0.22956730425357819,982.4486694335938,1e-05,0.05338495597243309,5.696046829223633,15.555094242095947,1 +1661,0.10311272740364075,0.033709362149238586,0.04066736251115799,0.2346634566783905,328.1711120605469,1e-05,0.1102871224284172,5.949553966522217,15.555094242095947,1 +1662,0.0441325418651104,0.06658773869276047,0.06030521169304848,0.21149037778377533,824.8300170898438,1e-05,0.06340562552213669,5.8963117599487305,15.555094242095947,1 +1663,0.06946038454771042,0.2209474891424179,0.21925440430641174,0.2001362144947052,176.11683654785156,1e-05,0.08502965420484543,5.682626008987427,15.555094242095947,1 +1664,0.07492067664861679,0.1477716863155365,0.13201002776622772,0.24858973920345306,993.2210693359375,1e-05,0.06962895393371582,5.701808929443359,15.555094242095947,1 +1665,0.12753231823444366,0.2038075178861618,0.19136779010295868,0.2360096126794815,978.2608642578125,1e-05,0.07192210108041763,5.686391115188599,15.555094242095947,1 +1666,0.10222888737916946,0.041718143969774246,0.04379336163401604,0.10671474039554596,959.5725708007812,1e-05,0.08509393781423569,5.860799074172974,15.555094242095947,1 +1667,0.15246979892253876,0.16815102100372314,0.1760944426059723,0.2235817164182663,194.25677490234375,1e-05,0.07667525857686996,5.680899381637573,15.555094242095947,1 +1668,0.08253595978021622,0.13584743440151215,0.13391344249248505,0.1700400561094284,917.5531616210938,1e-05,0.06654632091522217,5.688236236572266,15.555094242095947,1 +1669,0.10293757170438766,0.14756269752979279,0.14873696863651276,0.20954325795173645,1000.0,1e-05,0.07503508031368256,5.906847238540649,15.555094242095947,1 +1670,0.10303865373134613,0.03598657250404358,0.04115860164165497,0.24399839341640472,593.4874267578125,1e-05,0.06562863290309906,5.687287092208862,15.555094242095947,1 +1671,0.13760744035243988,0.1497882604598999,0.13829044997692108,0.19864583015441895,995.9349365234375,1e-05,0.06199832633137703,5.692627668380737,15.555094242095947,1 +1672,0.04351869598031044,0.10938388854265213,0.10563521832227707,0.2461458295583725,887.4710083007812,1e-05,0.06069410219788551,5.689980745315552,15.555094242095947,1 +1673,0.09501039236783981,0.09650599956512451,0.0888112485408783,0.20847755670547485,845.2072143554688,1e-05,0.07753180712461472,5.682708501815796,15.555094242095947,1 +1674,0.0982452854514122,0.1003580093383789,0.09557167440652847,0.2843188941478729,970.7328491210938,1e-05,0.09079965204000473,5.6799280643463135,15.555094242095947,1 +1675,0.09259065240621567,0.07600876688957214,0.0817546397447586,0.21921473741531372,403.11651611328125,1e-05,0.1785963475704193,5.7436909675598145,15.555094242095947,1 +1676,0.08095528930425644,0.064817875623703,0.060669999569654465,0.2377644181251526,910.3261108398438,1e-05,0.08424559980630875,5.86924147605896,15.555094242095947,1 +1677,0.05036931112408638,0.059671152383089066,0.05928477644920349,0.24661056697368622,952.3810424804688,1e-05,0.06699695438146591,5.687215805053711,15.555094242095947,1 +1678,0.08738251030445099,0.13639779388904572,0.12903964519500732,0.16181890666484833,987.8356323242188,1e-05,0.06689619272947311,5.683522701263428,15.555094242095947,1 +1679,0.04595937207341194,0.054660096764564514,0.053121864795684814,0.20280447602272034,631.1881713867188,1e-05,0.0697164386510849,5.689141750335693,15.555094242095947,1 +1680,0.08092716336250305,0.048209939152002335,0.05009346827864647,0.15877403318881989,724.7899169921875,1e-05,0.0717284306883812,5.680998802185059,15.555094242095947,1 +1681,0.10340484231710434,0.06868157535791397,0.07019917666912079,0.2896554470062256,931.1224365234375,1e-05,0.1033991202712059,5.6878955364227295,15.555094242095947,1 +1682,0.06174193322658539,0.05352826416492462,0.05558585748076439,0.25016024708747864,869.3666381835938,1e-05,0.07440237700939178,5.945084095001221,15.555094242095947,1 +1683,0.0907077044248581,0.0649225190281868,0.06338714063167572,0.1266506314277649,869.3666381835938,1e-05,0.07450303435325623,5.677024602890015,15.555094242095947,1 +1684,0.11812057346105576,0.08261669427156448,0.07481808215379715,0.275761216878891,885.7808837890625,1e-05,0.09836526960134506,5.688048839569092,15.555094242095947,1 +1685,0.07523835450410843,0.08811873942613602,0.09555777907371521,0.1794951856136322,960.9158325195312,1e-05,0.0648578554391861,5.739554405212402,15.555094242095947,1 +1686,0.08176933228969574,0.1532893180847168,0.15260034799575806,0.2743028700351715,978.9678955078125,1e-05,0.0707077831029892,5.686450719833374,15.555094242095947,1 +1687,0.10712774097919464,0.07716166973114014,0.06932561844587326,0.24458332359790802,842.0365600585938,1e-05,0.0745912566781044,5.753998279571533,15.555094242095947,1 +1688,0.08695358783006668,0.1005922183394432,0.09802297502756119,0.2517227530479431,943.3267822265625,1e-05,0.0781274288892746,5.68401312828064,15.555094242095947,1 +1689,0.1672542691230774,0.06315529346466064,0.06246773898601532,0.18748396635055542,684.9005737304688,1e-05,0.06786013394594193,5.682529926300049,15.555094242095947,1 +1690,0.1350928544998169,0.12665554881095886,0.12747539579868317,0.13535255193710327,367.23162841796875,1e-05,0.08694985508918762,5.6847264766693115,15.555094242095947,1 +1691,0.1125493273139,0.09702019393444061,0.09535489976406097,0.2384374886751175,797.1013793945312,1e-05,0.07653795182704926,5.68365740776062,15.555094242095947,1 +1692,0.09523386508226395,0.06637447327375412,0.06858676671981812,0.26808491349220276,861.318359375,1e-05,0.06576825678348541,5.682145118713379,15.555094242095947,1 +1693,0.11112471669912338,0.13676093518733978,0.12915711104869843,0.2073798030614853,974.1835327148438,1e-05,0.09319040924310684,5.6842041015625,15.555094242095947,1 +1694,0.10768197476863861,0.10952253639698029,0.10767096281051636,0.20778845250606537,386.7403564453125,1e-05,0.06605858355760574,5.684085845947266,15.555094242095947,1 +1695,0.12821726500988007,0.0820937305688858,0.07904040068387985,0.237748384475708,967.9602661132812,1e-05,0.0669294074177742,5.687621831893921,15.555094242095947,1 +1696,0.08756573498249054,0.08232883363962173,0.07503911107778549,0.2546554505825043,687.94970703125,1e-05,0.06612060219049454,5.738377809524536,15.555094242095947,1 +1697,0.12364709377288818,0.15139009058475494,0.1484721451997757,0.24370992183685303,251.59742736816406,1e-05,0.059909578412771225,5.782124280929565,15.555094242095947,1 +1698,0.0995032861828804,0.053377777338027954,0.049450796097517014,0.20551280677318573,860.8343505859375,1e-05,0.0862686038017273,5.6891796588897705,15.555094242095947,1 +1699,0.08910039812326431,0.09972277283668518,0.09447714686393738,0.26683491468429565,931.447509765625,1e-05,0.06488537788391113,5.687692403793335,15.555094242095947,1 +1700,0.08520596474409103,0.16199974715709686,0.15359511971473694,0.21853365004062653,967.9602661132812,1e-05,0.06615199893712997,5.68304967880249,15.555094242095947,1 +1701,0.0808412954211235,0.14912225306034088,0.13686466217041016,0.2420913428068161,963.8278198242188,1e-05,0.06966175138950348,5.899151802062988,15.555094242095947,1 +1702,0.08931167423725128,0.11193870007991791,0.11336436867713928,0.2517467737197876,297.256103515625,1e-05,0.07304344326257706,5.693249702453613,15.555094242095947,1 +1703,0.09658998250961304,0.12558424472808838,0.11602722108364105,0.280985563993454,627.4900512695312,1e-05,0.06318850070238113,5.68204402923584,15.555094242095947,1 +1704,0.08074008673429489,0.09234427660703659,0.08125331252813339,0.2606810927391052,820.7417602539062,1e-05,0.0650186538696289,5.679202318191528,15.555094242095947,1 +1705,0.04941306263208389,0.10331540554761887,0.1004239022731781,0.25383812189102173,979.6713256835938,1e-05,0.05700827017426491,5.688703775405884,15.555094242095947,1 +1706,0.10543660074472427,0.08890214562416077,0.0876525267958641,0.12571313977241516,546.1712036132812,1e-05,0.060495682060718536,5.681891441345215,15.555094242095947,1 +1707,0.1123260036110878,0.16105639934539795,0.15143661201000214,0.25217947363853455,966.4247436523438,1e-05,0.07165711373090744,5.951741456985474,15.555094242095947,1 +1708,0.11731255054473877,0.1139153465628624,0.11019051820039749,0.2576362192630768,367.23162841796875,1e-05,0.06544993817806244,5.995989561080933,15.555094242095947,1 +1709,0.08879081904888153,0.11618991941213608,0.114482082426548,0.1499759554862976,923.799560546875,1e-05,0.07009273767471313,5.685520887374878,15.555094242095947,1 +1710,0.12262603640556335,0.08937385678291321,0.08318675309419632,0.1703205108642578,889.9769897460938,1e-05,0.06391184777021408,5.679646968841553,15.555094242095947,1 +1711,0.08584652096033096,0.0915631502866745,0.09065662324428558,0.22981569170951843,442.5064697265625,1e-05,0.05863502249121666,5.680790901184082,15.555094242095947,1 +1712,0.048163242638111115,0.020996319130063057,0.022707847878336906,0.1253846138715744,912.8910522460938,1e-05,0.05883526802062988,5.895882844924927,15.555094242095947,1 +1713,0.10178685933351517,0.07939496636390686,0.07948818057775497,0.2609855532646179,478.3950500488281,1e-05,0.060254644602537155,5.67777943611145,15.555094242095947,1 +1714,0.07422148436307907,0.07054337859153748,0.07035301625728607,0.23739582300186157,775.796630859375,1e-05,0.0533863790333271,5.6873557567596436,15.555094242095947,1 +1715,0.07905317842960358,0.06154652312397957,0.06298863887786865,0.21423877775669098,830.5369873046875,1e-05,0.06485675275325775,5.684810161590576,15.555094242095947,1 +1716,0.07280349731445312,0.2186751812696457,0.19870977103710175,0.2500320374965668,996.3473510742188,1e-05,0.05766136199235916,5.68419337272644,15.555094242095947,1 +1717,0.1212996169924736,0.05159231275320053,0.051143061369657516,0.17105768620967865,884.9298706054688,1e-05,0.07345196604728699,5.687382936477661,15.555094242095947,1 +1718,0.08801966905593872,0.1323871910572052,0.12415458261966705,0.275064080953598,971.23095703125,1e-05,0.07733649015426636,5.785529136657715,15.555094242095947,1 +1719,0.08425547182559967,0.13223308324813843,0.12231408804655075,0.22571313381195068,968.2146606445312,1e-05,0.05556242913007736,5.6899025440216064,15.555094242095947,1 +1720,0.12223952263593674,0.10019837319850922,0.08966679871082306,0.2503044903278351,947.1898803710938,1e-05,0.06667623668909073,5.68966817855835,15.555094242095947,1 +1721,0.07826032489538193,0.25709837675094604,0.2335478514432907,0.27022436261177063,997.7804565429688,1e-05,0.06299270689487457,5.68437123298645,15.555094242095947,1 +1722,0.10063734650611877,0.09576781094074249,0.0932607352733612,0.20394229888916016,834.44140625,1e-05,0.06685605645179749,5.890644311904907,15.555094242095947,1 +1723,0.05361669510602951,0.0622260682284832,0.06456457078456879,0.13331730663776398,793.795654296875,1e-05,0.07091382145881653,5.690582036972046,15.555094242095947,1 +1724,0.09242931753396988,0.06123104318976402,0.059369806200265884,0.20677082240581512,597.59912109375,1e-05,0.05753430724143982,5.693244457244873,15.555094242095947,1 +1725,0.07520026713609695,0.07080655544996262,0.06937521696090698,0.3015865385532379,784.2772827148438,1e-05,0.05634098872542381,5.684534549713135,15.555094242095947,1 +1726,0.13931217789649963,0.15829944610595703,0.15317682921886444,0.20280447602272034,367.23162841796875,1e-05,0.09009500592947006,5.6833274364471436,15.555094242095947,1 +1727,0.07740338146686554,0.045544493943452835,0.04286518320441246,0.1173878163099289,809.8590698242188,1e-05,0.06312472373247147,5.6955249309539795,15.555094242095947,1 +1728,0.08305493742227554,0.06553381681442261,0.06057141721248627,0.26028043031692505,780.78076171875,1e-05,0.05193578451871872,5.718440771102905,15.555094242095947,1 +1729,0.09647392481565475,0.16611482203006744,0.13845644891262054,0.17590543627738953,996.5530395507812,1e-05,0.10136750340461731,5.693441152572632,15.555094242095947,1 +1730,0.07653972506523132,0.06793332099914551,0.06679384410381317,0.27491986751556396,743.5170288085938,1e-05,0.07861169427633286,5.6860010623931885,15.555094242095947,1 +1731,0.060549475252628326,0.06803298741579056,0.06814645230770111,0.24862179160118103,791.1160888671875,1e-05,0.06528223305940628,5.694788455963135,15.555094242095947,1 +1732,0.09059331566095352,0.12201143056154251,0.117037333548069,0.25322115421295166,784.97021484375,1e-05,0.0654168352484703,5.692078113555908,15.555094242095947,1 +1733,0.08209124952554703,0.04449661076068878,0.04498682916164398,0.2009214609861374,569.172119140625,1e-05,0.10084101557731628,5.686540603637695,15.555094242095947,1 +1734,0.13907955586910248,0.06737780570983887,0.06895415484905243,0.21032851934432983,561.674072265625,1e-05,0.05717609077692032,5.684653282165527,15.555094242095947,1 +1735,0.08246853202581406,0.09405461698770523,0.09720739722251892,0.2250240296125412,493.3414306640625,1e-05,0.08753734081983566,5.9157116413116455,15.555094242095947,1 +1736,0.1613878458738327,0.1809445172548294,0.1856074333190918,0.26665061712265015,225.4098358154297,1e-05,0.0813133642077446,5.691120624542236,15.555094242095947,1 +1737,0.0912855714559555,0.10184920579195023,0.10251209139823914,0.20354166626930237,995.3138427734375,1e-05,0.06718166172504425,5.681442022323608,15.555094242095947,1 +1738,0.12959986925125122,0.09589400887489319,0.09570439904928207,0.2861939072608948,427.6316223144531,1e-05,0.06989245116710663,5.699520111083984,15.555094242095947,1 +1739,0.11922574043273926,0.07178053259849548,0.07476291805505753,0.16130608320236206,665.8878784179688,1e-05,0.08776732534170151,5.790157318115234,15.555094242095947,1 +1740,0.06184135377407074,0.06962001323699951,0.06644434481859207,0.23788461089134216,939.36376953125,1e-05,0.058912716805934906,5.691360950469971,15.555094242095947,1 +1741,0.10317520797252655,0.12734143435955048,0.11872965097427368,0.26569709181785583,968.7218017578125,1e-05,0.06838646531105042,5.683120965957642,15.555094242095947,1 +1742,0.05398789048194885,0.10966642946004868,0.10346987843513489,0.14953525364398956,979.9048461914062,1e-05,0.05146029219031334,5.6919004917144775,15.555094242095947,1 +1743,0.14986494183540344,0.28922969102859497,0.28596389293670654,0.16264422237873077,105.31136322021484,1e-05,0.07845025509595871,5.907337427139282,15.555094242095947,1 +1744,0.08999663591384888,0.10467265546321869,0.10041121393442154,0.2265705019235611,726.5493774414062,1e-05,0.060148224234580994,5.689689636230469,15.555094242095947,1 +1745,0.04941677302122116,0.04250193387269974,0.042691171169281006,0.14185096323490143,561.674072265625,1e-05,0.06458470970392227,5.68636679649353,15.555094242095947,1 +1746,0.05997805669903755,0.08726394176483154,0.07927047461271286,0.18156249821186066,895.6915893554688,1e-05,0.059150513261556625,5.698939800262451,15.555094242095947,1 +1747,0.1385904848575592,0.12510815262794495,0.12231443077325821,0.14404647052288055,317.1641845703125,1e-05,0.07400969415903091,5.679543972015381,15.555094242095947,1 +1748,0.08221839368343353,0.1380617320537567,0.13196371495723724,0.25064101815223694,966.6818237304688,1e-05,0.06605678796768188,5.7900238037109375,15.555094242095947,1 +1749,0.1198621466755867,0.11586295813322067,0.11144701391458511,0.24997594952583313,906.9703979492188,1e-05,0.06930675357580185,5.684582233428955,15.555094242095947,1 +1750,0.07910335808992386,0.06807686388492584,0.06853725016117096,0.21906249225139618,933.3839721679688,1e-05,0.06810051947832108,5.706875801086426,15.555094242095947,1 +1751,0.09965962916612625,0.09433192014694214,0.09289957582950592,0.23189102113246918,558.6282348632812,1e-05,0.06524238735437393,5.694061756134033,15.555094242095947,1 +1752,0.08565004169940948,0.08807585388422012,0.08627711981534958,0.24288460612297058,705.574951171875,1e-05,0.08875725418329239,6.4694600105285645,15.555094242095947,1 +1753,0.04012293741106987,0.12021642923355103,0.11143273860216141,0.20473556220531464,963.8278198242188,1e-05,0.060836080461740494,5.69903039932251,15.555094242095947,1 +1754,0.041206810623407364,0.17337679862976074,0.1656847447156906,0.21697114408016205,988.7123413085938,1e-05,0.05882680416107178,5.700006008148193,15.555094242095947,1 +1755,0.13876409828662872,0.0686025619506836,0.06399919092655182,0.1117948666214943,892.0389404296875,1e-05,0.0690622553229332,5.686090469360352,15.555094242095947,1 +1756,0.11657553166151047,0.0878738984465599,0.08156666159629822,0.2708252966403961,697.8798828125,1e-05,0.06576687097549438,5.685234308242798,15.555094242095947,1 +1757,0.054513320326805115,0.07693120837211609,0.07627956569194794,0.2543589770793915,903.5476684570312,1e-05,0.08998145163059235,5.689677000045776,15.555094242095947,1 +1758,0.06305248290300369,0.04473225399851799,0.04429211840033531,0.0885416641831398,870.7523803710938,1e-05,0.06094630807638168,5.682394742965698,15.555094242095947,1 +1759,0.06354920566082001,0.1650099754333496,0.1621544361114502,0.21794870495796204,228.7581787109375,1e-05,0.05656030401587486,5.929051399230957,15.555094242095947,1 +1760,0.10898244380950928,0.08948086202144623,0.08973250538110733,0.14075319468975067,755.5379638671875,1e-05,0.06175040453672409,5.68242335319519,15.555094242095947,1 +1761,0.07966571301221848,0.09927575290203094,0.09259891510009766,0.17141826450824738,886.6278686523438,1e-05,0.06075628474354744,5.709380865097046,15.555094242095947,1 +1762,0.06474652886390686,0.07846708595752716,0.07250524312257767,0.24968749284744263,814.7632446289062,1e-05,0.062318459153175354,5.688244342803955,15.555094242095947,1 +1763,0.08461754024028778,0.11485443264245987,0.11826793104410172,0.20745190978050232,827.7026977539062,1e-05,0.059516116976737976,5.68874192237854,15.555094242095947,1 +1764,0.07186003774404526,0.12709593772888184,0.11513902992010117,0.2614903748035431,950.9569091796875,1e-05,0.07281041890382767,5.960846662521362,15.555094242095947,1 +1765,0.08685177564620972,0.04989295080304146,0.049543771892786026,0.25218749046325684,899.6636962890625,1e-05,0.05559233948588371,5.68836236000061,15.555094242095947,1 +1766,0.091180220246315,0.14037172496318817,0.1382727175951004,0.2520432472229004,431.9371643066406,1e-05,0.0648554190993309,5.688937187194824,15.555094242095947,1 +1767,0.13392357528209686,0.12470695376396179,0.11107147485017776,0.15561698377132416,923.458740234375,1e-05,0.06068917736411095,5.820065975189209,15.555094242095947,1 +1768,0.1137915700674057,0.1847350299358368,0.16788709163665771,0.27443909645080566,992.7984008789062,1e-05,0.06525170803070068,5.6906938552856445,15.555094242095947,1 +1769,0.10044529289007187,0.12125104665756226,0.1193164512515068,0.2639743387699127,344.2029113769531,1e-05,0.07607755810022354,5.691066265106201,15.555094242095947,1 +1770,0.11787940561771393,0.0831269770860672,0.07775487005710602,0.2513461410999298,856.4231567382812,1e-05,0.06120064854621887,5.958315372467041,15.555094242095947,1 +1771,0.04648979753255844,0.2214677929878235,0.21116413176059723,0.1331890970468521,996.7586059570312,1e-05,0.0585268959403038,5.706486940383911,15.555094242095947,1 +1772,0.09673509001731873,0.38674548268318176,0.4022311270236969,0.2185496687889099,998.7943115234375,1e-05,0.07320927083492279,5.683171510696411,15.555094242095947,1 +1773,0.1488116830587387,0.04324498772621155,0.04403458535671234,0.1300240308046341,637.2549438476562,1e-05,0.07382143288850784,5.690756320953369,15.555094242095947,1 +1774,0.07238733768463135,0.07454662770032883,0.07493442296981812,0.23557691276073456,797.1013793945312,1e-05,0.06288696825504303,5.699718236923218,15.555094242095947,1 +1775,0.07648425549268723,0.06492401659488678,0.06453856080770493,0.25275638699531555,496.98797607421875,1e-05,0.07045851647853851,5.892579793930054,15.555094242095947,1 +1776,0.0848882794380188,0.23472896218299866,0.22887644171714783,0.23358973860740662,194.25677490234375,1e-05,0.09071425348520279,5.686367034912109,15.555094242095947,1 +1777,0.0809425562620163,0.09908197820186615,0.09468507021665573,0.20217947661876678,958.2166748046875,1e-05,0.07124799489974976,5.684139966964722,15.555094242095947,1 +1778,0.0933774933218956,0.08649931848049164,0.07988916337490082,0.24664261937141418,904.6961059570312,1e-05,0.059894051402807236,5.813952445983887,15.555094242095947,1 +1779,0.07250459492206573,0.0799160823225975,0.07235262542963028,0.25842946767807007,782.1857299804688,1e-05,0.07619374990463257,5.685854434967041,15.555094242095947,1 +1780,0.0721864402294159,0.07660799473524094,0.06948640197515488,0.2883172929286957,585.1063842773438,1e-05,0.058038126677274704,5.74537205696106,15.555094242095947,1 +1781,0.0700707957148552,0.07839849591255188,0.07140321284532547,0.22471153736114502,805.4765625,1e-05,0.0689791813492775,5.693745374679565,15.555094242095947,1 +1782,0.1238061934709549,0.11175117641687393,0.11527892202138901,0.23413459956645966,807.365478515625,1e-05,0.05911414325237274,5.952489137649536,15.555094242095947,1 +1783,0.08804832398891449,0.1759968101978302,0.17274300754070282,0.2884695529937744,336.25732421875,1e-05,0.07358995825052261,5.693991661071777,15.555094242095947,1 +1784,0.1030532717704773,0.06910285353660583,0.06375544518232346,0.2714422941207886,789.7643432617188,1e-05,0.0650709941983223,5.690151929855347,15.555094242095947,1 +1785,0.07899394631385803,0.06710895895957947,0.06608487665653229,0.16978365182876587,466.7919921875,1e-05,0.0642322301864624,5.687597751617432,15.555094242095947,1 +1786,0.1322273463010788,0.10208704322576523,0.09575644880533218,0.2530849277973175,741.0423583984375,1e-05,0.08752238005399704,5.687180519104004,15.555094242095947,1 +1787,0.11243113875389099,0.062079235911369324,0.0614115409553051,0.0659695491194725,941.20556640625,1e-05,0.08258478343486786,5.690187692642212,15.555094242095947,1 +1788,0.07053005695343018,0.08718226850032806,0.08002406358718872,0.2548237144947052,925.8298950195312,1e-05,0.06710325181484222,5.87671422958374,15.555094242095947,1 +1789,0.05033723637461662,0.05718768388032913,0.056204792112112045,0.11836537718772888,854.930419921875,1e-05,0.06310804188251495,5.691343307495117,15.555094242095947,1 +1790,0.07821224629878998,0.06255967170000076,0.059326909482479095,0.2269390970468521,855.4293212890625,1e-05,0.07030212134122849,5.902937889099121,15.555094242095947,1 +1791,0.06507495045661926,0.03519007936120033,0.03407133370637894,0.213365375995636,601.6597900390625,1e-05,0.06453662365674973,5.739012956619263,15.555094242095947,1 +1792,0.08819170296192169,0.14065982401371002,0.13161692023277283,0.23561698198318481,975.6365966796875,1e-05,0.07297544181346893,5.690711975097656,15.555094242095947,1 +1793,0.0984090268611908,0.11943242698907852,0.11600689589977264,0.1888621747493744,639.6484985351562,1e-05,0.0777360200881958,5.690888404846191,15.555094242095947,1 +1794,0.1035696342587471,0.09320838004350662,0.09074018150568008,0.3030368387699127,824.8300170898438,1e-05,0.0684402734041214,5.689201831817627,15.555094242095947,1 +1795,0.07903529703617096,0.06105764955282211,0.0673377513885498,0.20434294641017914,484.06866455078125,1e-05,0.06943495571613312,5.689458847045898,15.555094242095947,1 +1796,0.10747869312763214,0.039765365421772,0.044556181877851486,0.23112179338932037,719.4397583007812,1e-05,0.06236240640282631,5.704205513000488,15.555094242095947,1 +1797,0.1244354099035263,0.10294830799102783,0.09864818304777145,0.1677243560552597,875.2998046875,1e-05,0.09883419424295425,5.687065601348877,15.555094242095947,1 +1798,0.08239065110683441,0.10726163536310196,0.10085151344537735,0.2416265904903412,878.4185791015625,1e-05,0.07764515280723572,5.689785718917847,15.555094242095947,1 +1799,0.07267188280820847,0.12746776640415192,0.1189313754439354,0.2079567164182663,948.9403076171875,1e-05,0.07998371869325638,5.911458730697632,15.555094242095947,1 +1800,0.09190455824136734,0.07182770222425461,0.06775673478841782,0.25746792554855347,850.8939819335938,1e-05,0.06074605509638786,5.686792612075806,15.555094242095947,1 +1801,0.07233240455389023,0.055558063089847565,0.05153439939022064,0.3050720989704132,813.5474853515625,1e-05,0.0654006227850914,5.722043514251709,15.555094242095947,1 +1802,0.05486805737018585,0.0749649778008461,0.07636597752571106,0.2278285175561905,914.6995849609375,1e-05,0.11848575621843338,5.696037292480469,15.555094242095947,1 +1803,0.09992463886737823,0.08220914751291275,0.07873859256505966,0.25824517011642456,749.19873046875,1e-05,0.04955611750483513,5.69807505607605,15.555094242095947,1 +1804,0.1245412528514862,0.08907121419906616,0.08432219177484512,0.1981249898672104,541.3831787109375,1e-05,0.06647523492574692,5.684376001358032,15.555094242095947,1 +1805,0.14970706403255463,0.06578274071216583,0.06920023262500763,0.19892627000808716,493.3414306640625,1e-05,0.0674385279417038,5.686699867248535,15.555094242095947,1 +1806,0.08886241912841797,0.04173848032951355,0.040259990841150284,0.24574518203735352,541.3831787109375,1e-05,0.08935811370611191,5.887354373931885,15.555094242095947,1 +1807,0.0809512585401535,0.08301588892936707,0.07547738403081894,0.22322915494441986,921.0526123046875,1e-05,0.0567576065659523,5.912811279296875,15.555094242095947,1 +1808,0.06609638780355453,0.10496111959218979,0.10299301892518997,0.23502403497695923,866.564453125,1e-05,0.07264316082000732,5.686186075210571,15.555094242095947,1 +1809,0.04650924354791641,0.0720384418964386,0.06502493470907211,0.14628204703330994,909.9564819335938,1e-05,0.05672125890851021,5.729027509689331,15.555094242095947,1 +1810,0.11246203631162643,0.06843524426221848,0.07122384011745453,0.17768429219722748,563.1868286132812,1e-05,0.07127910107374191,5.692080497741699,15.555094242095947,1 +1811,0.08066534250974655,0.08224498480558395,0.08451051265001297,0.27318108081817627,832.2192993164062,1e-05,0.07069046050310135,5.69493293762207,15.555094242095947,1 +1812,0.0404861643910408,0.06064020097255707,0.06052730232477188,0.1720672994852066,883.2159423828125,1e-05,0.07118358463048935,5.914988040924072,15.555094242095947,1 +1813,0.07351109385490417,0.11793738603591919,0.1116555854678154,0.14793269336223602,954.6314086914062,1e-05,0.07519326359033585,5.8387157917022705,15.555094242095947,1 +1814,0.10487235337495804,0.554421603679657,0.5560401678085327,0.24042467772960663,66.28787994384766,1e-05,0.06650203466415405,5.689194917678833,15.555094242095947,1 +1815,0.0488571897149086,0.06758496165275574,0.06286158412694931,0.10854166001081467,925.8298950195312,1e-05,0.09719313681125641,5.685703992843628,15.555094242095947,1 +1816,0.07148542255163193,0.09692735970020294,0.09366273134946823,0.21929486095905304,915.7753295898438,1e-05,0.06853990256786346,5.68516993522644,15.555094242095947,1 +1817,0.05597047135233879,0.058188941329717636,0.0562794990837574,0.24907851219177246,765.50390625,1e-05,0.05811532586812973,5.682058095932007,15.555094242095947,1 +1818,0.08779102563858032,0.10794953256845474,0.10577279329299927,0.21927884221076965,547.7528686523438,1e-05,0.13538125157356262,5.689143896102905,15.555094242095947,1 +1819,0.06638458371162415,0.0836191177368164,0.07452155649662018,0.2373637706041336,801.0057983398438,1e-05,0.08253787457942963,5.805662155151367,15.555094242095947,1 +1820,0.06773453950881958,0.06544866412878036,0.06524734944105148,0.3043028712272644,798.4103393554688,1e-05,0.0671282708644867,6.0103724002838135,15.555094242095947,1 +1821,0.20014220476150513,0.1525912582874298,0.1531926691532135,0.21290063858032227,319.94049072265625,1e-05,0.11310920119285583,5.691143274307251,15.555094242095947,1 +1822,0.07056458294391632,0.054917123168706894,0.052399735897779465,0.18573717772960663,762.48046875,1e-05,0.08873502910137177,5.702281951904297,15.555094242095947,1 +1823,0.13727763295173645,0.10668934881687164,0.10689648240804672,0.17117787897586823,484.06866455078125,1e-05,0.07640117406845093,5.683638334274292,15.555094242095947,1 +1824,0.07811478525400162,0.08376956731081009,0.07809320092201233,0.14259615540504456,922.7748413085938,1e-05,0.075510174036026,5.679637432098389,15.555094242095947,1 +1825,0.06989794969558716,0.054283179342746735,0.054385386407375336,0.24957531690597534,866.564453125,1e-05,0.08854994922876358,5.7023539543151855,15.555094242095947,1 +1826,0.0785146951675415,0.08740603923797607,0.07937833666801453,0.14858974516391754,929.4871826171875,1e-05,0.06393549591302872,5.693859338760376,15.555094242095947,1 +1827,0.09845548123121262,0.08104008436203003,0.0819968581199646,0.20614582300186157,877.5327758789062,1e-05,0.07254574447870255,5.696255922317505,15.555094242095947,1 +1828,0.10634157061576843,0.1262526512145996,0.12155762314796448,0.25612178444862366,357.1428527832031,1e-05,0.06777317076921463,5.689653158187866,15.555094242095947,1 +1829,0.08504071831703186,0.10692914575338364,0.1005023792386055,0.21350960433483124,932.7411499023438,1e-05,0.06480281054973602,5.709495306015015,15.555094242095947,1 +1830,0.12353676557540894,0.1238899752497673,0.12303514778614044,0.21255607903003693,288.4615478515625,1e-05,0.06648917496204376,5.686664342880249,15.555094242095947,1 +1831,0.1005496010184288,0.050429437309503555,0.04805152863264084,0.20262017846107483,776.5151977539062,1e-05,0.06410335004329681,5.865050554275513,15.555094242095947,1 +1832,0.0470673143863678,0.1481245756149292,0.13523775339126587,0.1297275573015213,996.3473510742188,1e-05,0.05353536456823349,5.676040887832642,15.555094242095947,1 +1833,0.09053091704845428,0.11976461857557297,0.11694588512182236,0.16361378133296967,980.37109375,1e-05,0.057636093348264694,5.697053909301758,15.555094242095947,1 +1834,0.07742922008037567,0.09528648853302002,0.09234216809272766,0.2849999964237213,994.0623168945312,1e-05,0.07392222434282303,5.702007532119751,15.555094242095947,1 +1835,0.062390636652708054,0.05885515362024307,0.05905444920063019,0.2577403783798218,772.1712036132812,1e-05,0.06165732070803642,5.696316957473755,15.555094242095947,1 +1836,0.10680228471755981,0.04613003507256508,0.044058896601200104,0.1356971114873886,986.952880859375,1e-05,0.07987331598997116,5.6824212074279785,15.555094242095947,1 +1837,0.08965519070625305,0.09497223049402237,0.09614750742912292,0.19394229352474213,723.90576171875,1e-05,0.05710789933800697,5.686911106109619,15.555094242095947,1 +1838,0.0963866114616394,0.030841894447803497,0.03224363923072815,0.09320512413978577,785.6611938476562,1e-05,0.06207306683063507,5.687089204788208,15.555094242095947,1 +1839,0.09096456319093704,0.1152162104845047,0.10827429592609406,0.24602563679218292,959.5725708007812,1e-05,0.08014915138483047,5.844867467880249,15.555094242095947,1 +1840,0.07064097374677658,0.19937764108181,0.17976026237010956,0.14436697959899902,985.1694946289062,1e-05,0.059020183980464935,5.692447185516357,15.555094242095947,1 +1841,0.07543610781431198,0.13940003514289856,0.13342612981796265,0.11556089669466019,987.3948974609375,1e-05,0.07238583266735077,5.692984104156494,15.555094242095947,1 +1842,0.09963341057300568,0.115229532122612,0.10936906933784485,0.20815704762935638,979.2027587890625,1e-05,0.06444890052080154,5.919823169708252,15.555094242095947,1 +1843,0.11203711479902267,0.10481513291597366,0.10311763733625412,0.18834133446216583,968.7218017578125,1e-05,0.07059217989444733,5.692272663116455,15.555094242095947,1 +1844,0.09198883175849915,0.14942921698093414,0.14265945553779602,0.2637019157409668,965.1322021484375,1e-05,0.06278962641954422,5.689476490020752,15.555094242095947,1 +1845,0.05332694202661514,0.07686004787683487,0.07943902164697647,0.08183493465185165,989.5833129882812,1e-05,0.06261996924877167,5.683680295944214,15.555094242095947,1 +1846,0.07873781025409698,0.09628359973430634,0.09235109388828278,0.23703524470329285,972.2222290039062,1e-05,0.0827128067612648,5.696792125701904,15.555094242095947,1 +1847,0.09786408394575119,0.05770733579993248,0.05521639063954353,0.1342467963695526,736.8637084960938,1e-05,0.0692765936255455,5.698192834854126,15.555094242095947,1 +1848,0.09441708773374557,0.05990056321024895,0.06529653817415237,0.2530688941478729,319.94049072265625,1e-05,0.057567987591028214,5.697740793228149,15.555094242095947,1 +1849,0.06813046336174011,0.0663294568657875,0.06203258037567139,0.22895030677318573,876.6427001953125,1e-05,0.07955937087535858,5.6949403285980225,15.555094242095947,1 +1850,0.0834348127245903,0.04147471860051155,0.04374519735574722,0.15874198079109192,798.4103393554688,1e-05,0.07314810156822205,5.806977272033691,15.555094242095947,1 +1851,0.051758699119091034,0.10243774205446243,0.09944723546504974,0.21462339162826538,842.5684204101562,1e-05,0.06930554658174515,5.7027764320373535,15.555094242095947,1 +1852,0.11695671081542969,0.07070056349039078,0.0658385381102562,0.24805288016796112,777.9456176757812,1e-05,0.0792212039232254,5.701326370239258,15.555094242095947,1 +1853,0.0572558268904686,0.09070219844579697,0.08672285079956055,0.26326921582221985,649.0385131835938,1e-05,0.0682206079363823,5.693670749664307,15.555094242095947,1 +1854,0.09137377142906189,0.04466874897480011,0.041400983929634094,0.22582530975341797,777.9456176757812,1e-05,0.07034963369369507,6.074708938598633,15.555094242095947,1 +1855,0.05953759700059891,0.09072166681289673,0.08903588354587555,0.24394230544567108,458.8607482910156,1e-05,0.054243601858615875,5.696389198303223,15.555094242095947,1 +1856,0.07633011788129807,0.06417261064052582,0.06503075361251831,0.23892627656459808,828.8410034179688,1e-05,0.07754970341920853,5.691305160522461,15.555094242095947,1 +1857,0.11284908652305603,0.08307063579559326,0.07972393184900284,0.25399839878082275,573.5930786132812,1e-05,0.06995450705289841,5.682590007781982,15.555094242095947,1 +1858,0.09070128947496414,0.056089382618665695,0.05689685419201851,0.19316506385803223,850.8939819335938,1e-05,0.07891660928726196,5.686692476272583,15.555094242095947,1 +1859,0.03962923213839531,0.1924000084400177,0.17667850852012634,0.17791666090488434,984.494384765625,1e-05,0.06929992884397507,5.68692684173584,15.555094242095947,1 +1860,0.07611292600631714,0.10414634644985199,0.09803508967161179,0.23874197900295258,809.2384033203125,1e-05,0.0623258501291275,5.681459665298462,15.555094242095947,1 +1861,0.07519280910491943,0.05044429749250412,0.049256887286901474,0.17449519038200378,781.4841918945312,1e-05,0.05569254979491234,5.684759616851807,15.555094242095947,1 +1862,0.091741643846035,0.03443039581179619,0.038186557590961456,0.25883013010025024,664.7939453125,1e-05,0.12016305327415466,5.711735725402832,15.555094242095947,1 +1863,0.05584573745727539,0.07232159376144409,0.07164524495601654,0.24088941514492035,746.7793579101562,1e-05,0.07244380563497543,5.691997528076172,15.555094242095947,1 +1864,0.06992925703525543,0.09031815826892853,0.09396746754646301,0.20036858320236206,273.4375,1e-05,0.06903790682554245,5.793407917022705,15.555094242095947,1 +1865,0.12073919922113419,0.07209665328264236,0.06943973898887634,0.23423075675964355,685.9205932617188,1e-05,0.10792014002799988,5.686838626861572,15.555094242095947,1 +1866,0.09319613873958588,0.10067301243543625,0.09291990846395493,0.25902241468429565,945.1219482421875,1e-05,0.06690841168165207,5.685070753097534,15.555094242095947,1 +1867,0.10833020508289337,0.15949851274490356,0.15435516834259033,0.25342145562171936,288.4615478515625,1e-05,0.07721274346113205,6.186699151992798,15.555094242095947,1 +1868,0.05057014152407646,0.26621749997138977,0.24587078392505646,0.2686137855052948,994.6895141601562,1e-05,0.07067594677209854,5.698564052581787,15.555094242095947,1 +1869,0.1329095959663391,0.2170383483171463,0.21117274463176727,0.23739582300186157,225.4098358154297,1e-05,0.09001686424016953,5.696333646774292,15.555094242095947,1 +1870,0.08220077306032181,0.0617128349840641,0.059098053723573685,0.13326922059059143,864.197509765625,1e-05,0.07071851193904877,5.7022528648376465,15.555094242095947,1 +1871,0.09573885798454285,0.103767991065979,0.11313149333000183,0.17849358916282654,251.59742736816406,1e-05,0.06847961246967316,5.698265552520752,15.555094242095947,1 +1872,0.06918203830718994,0.08602307736873627,0.07814040035009384,0.2121955007314682,821.3306274414062,1e-05,0.05835331231355667,5.694817304611206,15.555094242095947,1 +1873,0.08680061250925064,0.10832463949918747,0.10634907335042953,0.21417467296123505,998.3897094726562,1e-05,0.06449129432439804,5.823606491088867,15.555094242095947,1 +1874,0.09156100451946259,0.1428794115781784,0.13885177671909332,0.1889422982931137,896.4932861328125,1e-05,0.07750647515058517,5.681057929992676,15.555094242095947,1 +1875,0.10020085424184799,0.09223973751068115,0.08612021058797836,0.2744791507720947,476.4851989746094,1e-05,0.07370874285697937,5.690199136734009,15.555094242095947,1 +1876,0.056596092879772186,0.07538551837205887,0.07333816587924957,0.12599357962608337,933.0629272460938,1e-05,0.07787822932004929,5.908219814300537,15.555094242095947,1 +1877,0.09665574878454208,0.07584110647439957,0.07440405339002609,0.18814903497695923,915.7753295898438,1e-05,0.07063736766576767,5.692941665649414,15.555094242095947,1 +1878,0.0655767172574997,0.14709027111530304,0.13639481365680695,0.23955929279327393,963.0394287109375,1e-05,0.0669579729437828,5.691895961761475,15.555094242095947,1 +1879,0.05932677909731865,0.07307558506727219,0.06658223271369934,0.2954086363315582,720.3389282226562,1e-05,0.07100655883550644,5.691469192504883,15.555094242095947,1 +1880,0.09044760465621948,0.1781109869480133,0.16788840293884277,0.3306169807910919,981.7597045898438,1e-05,0.07412475347518921,5.688107490539551,15.555094242095947,1 +1881,0.0686960220336914,0.09745100885629654,0.09745116531848907,0.25970351696014404,911.7965698242188,1e-05,0.061519984155893326,5.692334413528442,15.555094242095947,1 +1882,0.08276974409818649,0.14362679421901703,0.14169083535671234,0.07521634548902512,998.7943115234375,1e-05,0.061038512736558914,5.698660135269165,15.555094242095947,1 +1883,0.14257755875587463,0.031140560284256935,0.03699527308344841,0.23310896754264832,577.95703125,1e-05,0.08616183698177338,6.0016772747039795,15.555094242095947,1 +1884,0.06397363543510437,0.09137320518493652,0.09015855938196182,0.20499999821186066,866.0933227539062,1e-05,0.07396461069583893,5.686580181121826,15.555094242095947,1 +1885,0.05589405819773674,0.04695754498243332,0.04823978990316391,0.24072915315628052,521.561767578125,1e-05,0.06449627876281738,5.679644346237183,15.555094242095947,1 +1886,0.09136680513620377,0.06479846686124802,0.0646560937166214,0.13333332538604736,960.9158325195312,1e-05,0.10161449760198593,5.681955337524414,15.555094242095947,1 +1887,0.1282922625541687,0.2481226623058319,0.23396621644496918,0.29258814454078674,988.2747802734375,1e-05,0.10963090509176254,5.895750045776367,15.555094242095947,1 +1888,0.08048094063997269,0.06670896708965302,0.06391943246126175,0.23692306876182556,872.5845947265625,1e-05,0.07660280168056488,5.688201665878296,15.555094242095947,1 +1889,0.06311512738466263,0.09914267063140869,0.10055863857269287,0.17638620734214783,977.07421875,1e-05,0.08519653975963593,5.682724714279175,15.555094242095947,1 +1890,0.10682033747434616,0.08371425420045853,0.08152931183576584,0.20666666328907013,887.8910522460938,1e-05,0.08499891310930252,5.683187961578369,15.555094242095947,1 +1891,0.09165291488170624,0.131694495677948,0.1247616782784462,0.19729967415332794,991.3079833984375,1e-05,0.06958605349063873,5.740494012832642,15.555094242095947,1 +1892,0.08877602219581604,0.05331968888640404,0.05093402415513992,0.2451842874288559,699.823974609375,1e-05,0.07805240899324417,5.678323030471802,15.555094242095947,1 +1893,0.11605507135391235,0.0760502889752388,0.07206130772829056,0.251522421836853,882.784912109375,1e-05,0.06725528091192245,5.685891151428223,15.555094242095947,1 +1894,0.1281868815422058,0.06759640574455261,0.06186902895569801,0.23120993375778198,752.3885498046875,1e-05,0.07546290010213852,5.822211265563965,15.555094242095947,1 +1895,0.1154482364654541,0.045192066580057144,0.044961117208004,0.26626601815223694,824.2506713867188,1e-05,0.05873668193817139,5.6859450340271,15.555094242095947,1 +1896,0.10465314984321594,0.14834031462669373,0.14026084542274475,0.3029807507991791,944.8242797851562,1e-05,0.07609269767999649,5.949954271316528,15.555094242095947,1 +1897,0.08172015100717545,0.05105167627334595,0.05058613792061806,0.1337660253047943,539.7727661132812,1e-05,0.06356655806303024,5.685973882675171,15.555094242095947,1 +1898,0.10348498076200485,0.11704669147729874,0.11245762556791306,0.20677883923053741,582.2649536132812,1e-05,0.06324523687362671,5.678860664367676,15.555094242095947,1 +1899,0.09212099760770798,0.055791184306144714,0.05658012256026268,0.2561057507991791,801.64990234375,1e-05,0.057536087930202484,5.683810234069824,15.555094242095947,1 +1900,0.08757270127534866,0.06891137361526489,0.06471218913793564,0.27678683400154114,879.3001098632812,1e-05,0.06278052181005478,5.68304443359375,15.555094242095947,1 +1901,0.08273691684007645,0.05758121237158775,0.05249972268939018,0.08947916328907013,892.4485473632812,1e-05,0.06149473041296005,5.89123797416687,15.555094242095947,1 +1902,0.10509009659290314,0.10394562780857086,0.10524556040763855,0.1917548030614853,748.3948974609375,1e-05,0.06225975975394249,5.685951232910156,15.555094242095947,1 +1903,0.047678761184215546,0.12119084596633911,0.11696689575910568,0.1691666543483734,891.2169799804688,1e-05,0.0565662756562233,5.683512210845947,15.555094242095947,1 +1904,0.05275082588195801,0.16623564064502716,0.15851040184497833,0.21660254895687103,964.872314453125,1e-05,0.05966728925704956,5.7796807289123535,15.555094242095947,1 +1905,0.08145265281200409,0.2838161289691925,0.2814110219478607,0.1327323615550995,137.90036010742188,1e-05,0.08932888507843018,5.683377742767334,15.555094242095947,1 +1906,0.07365914434194565,0.18605950474739075,0.18305763602256775,0.2577083110809326,228.7581787109375,1e-05,0.06604041904211044,5.680025815963745,15.555094242095947,1 +1907,0.07831482589244843,0.1356222927570343,0.12922947108745575,0.2323397397994995,960.6482543945312,1e-05,0.05946870893239975,5.6845972537994385,15.555094242095947,1 +1908,0.04751456156373024,0.0987987294793129,0.09491652250289917,0.233501598238945,885.7808837890625,1e-05,0.060987796634435654,5.684586048126221,15.555094242095947,1 +1909,0.12501384317874908,0.05917275324463844,0.0562637634575367,0.29151442646980286,793.128662109375,1e-05,0.07501771301031113,5.683349847793579,15.555094242095947,1 +1910,0.07770878076553345,0.07737349718809128,0.07160567492246628,0.24400639533996582,848.3289794921875,1e-05,0.05960291251540184,5.685928106307983,15.555094242095947,1 +1911,0.08321809768676758,0.0960746631026268,0.09492810815572739,0.19114582240581512,643.2039184570312,1e-05,0.07422587275505066,5.692041635513306,15.555094242095947,1 +1912,0.08400930464267731,0.06395117193460464,0.06142557039856911,0.15328525006771088,747.5884399414062,1e-05,0.06100204586982727,5.737893342971802,15.555094242095947,1 +1913,0.10911688208580017,0.09060700237751007,0.08693406730890274,0.24098557233810425,760.95458984375,1e-05,0.06138724088668823,5.6924779415130615,15.555094242095947,1 +1914,0.07682176679372787,0.029018690809607506,0.0304988045245409,0.09968749433755875,821.9178466796875,1e-05,0.05509163811802864,5.684567928314209,15.555094242095947,1 +1915,0.10773180425167084,0.12748417258262634,0.12018940597772598,0.28111377358436584,760.95458984375,1e-05,0.08865630626678467,5.710970640182495,15.555094242095947,1 +1916,0.1285136342048645,0.11906864494085312,0.12512987852096558,0.30099359154701233,197.81146240234375,1e-05,0.06340258568525314,5.691298723220825,15.555094242095947,1 +1917,0.06704642623662949,0.044635482132434845,0.04340362548828125,0.22602562606334686,777.9456176757812,1e-05,0.05736821889877319,6.017819404602051,15.555094242095947,1 +1918,0.08037693798542023,0.11615800112485886,0.11720159649848938,0.16094550490379333,914.3394165039062,1e-05,0.06724806874990463,5.895192623138428,15.555094242095947,1 +1919,0.060712337493896484,0.25294047594070435,0.22461123764514923,0.22076120972633362,990.232666015625,1e-05,0.0678725466132164,5.68750524520874,15.555094242095947,1 +1920,0.1267283707857132,0.1269613653421402,0.12569358944892883,0.2564503252506256,282.50775146484375,1e-05,0.07532435655593872,5.689518213272095,15.555094242095947,1 +1921,0.0394786074757576,0.12521284818649292,0.11147505789995193,0.21396633982658386,935.9296264648438,1e-05,0.064348004758358,5.686956405639648,15.555094242095947,1 +1922,0.05886160209774971,0.14424742758274078,0.1424643099308014,0.21630607545375824,970.2327880859375,1e-05,0.06318347901105881,5.888683557510376,15.555094242095947,1 +1923,0.06506050378084183,0.06154387444257736,0.060875304043293,0.14328524470329285,882.784912109375,1e-05,0.06651022285223007,5.687585830688477,15.555094242095947,1 +1924,0.12396010756492615,0.10410241782665253,0.09619899839162827,0.20971153676509857,940.5940551757812,1e-05,0.0661606639623642,5.687749862670898,15.555094242095947,1 +1925,0.09974510967731476,0.09256116300821304,0.08979155123233795,0.20633012056350708,393.8356018066406,1e-05,0.0557185634970665,5.687224388122559,15.555094242095947,1 +1926,0.12721174955368042,0.07694430649280548,0.0813107043504715,0.23471152782440186,908.0963134765625,1e-05,0.056848641484975815,5.704663515090942,15.555094242095947,1 +1927,0.10052623599767685,0.18834318220615387,0.19757355749607086,0.26762017607688904,172.413818359375,1e-05,0.0769008994102478,5.692533493041992,15.555094242095947,1 +1928,0.070955291390419,0.07636678218841553,0.07050435245037079,0.22150640189647675,748.3948974609375,1e-05,0.05609564110636711,5.872636079788208,15.555094242095947,1 +1929,0.08966260403394699,0.12452653795480728,0.11503314226865768,0.271113783121109,906.9703979492188,1e-05,0.07057696580886841,5.895849704742432,15.555094242095947,1 +1930,0.08468376100063324,0.06853792071342468,0.06409309059381485,0.23841345310211182,863.2425537109375,1e-05,0.06706853955984116,5.685859680175781,15.555094242095947,1 +1931,0.11863182485103607,0.07958581298589706,0.07576828449964523,0.2578926086425781,862.2828979492188,1e-05,0.07199689745903015,5.684138536453247,15.555094242095947,1 +1932,0.0979686751961708,0.11629734188318253,0.11078724265098572,0.27318108081817627,900.0560302734375,1e-05,0.05906732752919197,5.689960241317749,15.555094242095947,1 +1933,0.07153387367725372,0.10710491240024567,0.0987149253487587,0.22658653557300568,851.403076171875,1e-05,0.059773415327072144,5.687816143035889,15.555094242095947,1 +1934,0.0687645971775055,0.6153168678283691,0.6234249472618103,0.24948717653751373,9.920635223388672,1e-05,0.06160168722271919,5.690961122512817,15.555094242095947,1 +1935,0.08930228650569916,0.08925538510084152,0.0817079171538353,0.23386217653751373,968.974853515625,1e-05,0.0638699159026146,5.6932525634765625,15.555094242095947,1 +1936,0.13593851029872894,0.07507126778364182,0.0752677321434021,0.2792547941207886,852.9224853515625,1e-05,0.05833721160888672,5.767269849777222,15.555094242095947,1 +1937,0.05327557399868965,0.026343150064349174,0.029617413878440857,0.20761217176914215,878.85986328125,1e-05,0.07007105648517609,5.6870763301849365,15.555094242095947,1 +1938,0.04182848334312439,0.09430807083845139,0.08777348697185516,0.18636217713356018,995.728271484375,1e-05,0.06143835559487343,5.709043502807617,15.555094242095947,1 +1939,0.08686354756355286,0.06270937621593475,0.05928836762905121,0.1526762694120407,552.4553833007812,1e-05,0.0714363306760788,5.682003498077393,15.555094242095947,1 +1940,0.11328549683094025,0.07291234284639359,0.07034116238355637,0.1547195464372635,798.4103393554688,1e-05,0.0576164573431015,7.193312883377075,15.555094242095947,1 +1941,0.1007075235247612,0.057261306792497635,0.05352546274662018,0.15783652663230896,889.1455078125,1e-05,0.06005271151661873,5.688790321350098,15.555094242095947,1 +1942,0.0855913758277893,0.032731637358665466,0.035603538155555725,0.24732370674610138,686.9369506835938,1e-05,0.06117242947220802,5.68228816986084,15.555094242095947,1 +1943,0.09998010843992233,0.06865350157022476,0.06545989960432053,0.25775641202926636,858.8861083984375,1e-05,0.06013471260666847,5.690519094467163,15.555094242095947,1 +1944,0.08022956550121307,0.13085812330245972,0.1248055100440979,0.1525961458683014,926.5010375976562,1e-05,0.06214951351284981,5.900186061859131,15.555094242095947,1 +1945,0.11178175359964371,0.06537149846553802,0.06552047282457352,0.13854166865348816,518.14990234375,1e-05,0.0603591650724411,5.694106340408325,15.555094242095947,1 +1946,0.09017358720302582,0.11478599905967712,0.10946505516767502,0.23416665196418762,708.4055786132812,1e-05,0.0667436346411705,5.678797483444214,15.555094242095947,1 +1947,0.10898043215274811,0.09047641605138779,0.08424945920705795,0.25043267011642456,916.1324462890625,1e-05,0.06732869148254395,5.70738410949707,15.555094242095947,1 +1948,0.050861068069934845,0.12175887078046799,0.11464996635913849,0.22205927968025208,982.677490234375,1e-05,0.06311330199241638,5.687292575836182,15.555094242095947,1 +1949,0.07830724865198135,0.07627668231725693,0.07404888421297073,0.1699358969926834,889.5617065429688,1e-05,0.08077102154493332,5.6853742599487305,15.555094242095947,1 +1950,0.09616211801767349,0.14258010685443878,0.14034676551818848,0.29308491945266724,282.50775146484375,1e-05,0.10043235123157501,5.704684257507324,15.555094242095947,1 +1951,0.0538119301199913,0.10382316261529922,0.1003521978855133,0.2524919807910919,946.896240234375,1e-05,0.0540669709444046,5.694075107574463,15.555094242095947,1 +1952,0.07851974666118622,0.07031407952308655,0.07002339512109756,0.21853365004062653,862.7633056640625,1e-05,0.07883567363023758,5.686347723007202,15.555094242095947,1 +1953,0.09178262948989868,0.06470044702291489,0.061705198138952255,0.25061696767807007,832.2192993164062,1e-05,0.08479278534650803,5.688284397125244,15.555094242095947,1 +1954,0.09495618939399719,0.08543949574232101,0.08453899621963501,0.10375800728797913,633.6292114257812,1e-05,0.06315889954566956,5.680469036102295,15.555094242095947,1 +1955,0.09918591380119324,0.19900526106357574,0.18187017738819122,0.23494389653205872,984.94482421875,1e-05,0.08733764290809631,5.683324098587036,15.555094242095947,1 +1956,0.09300678968429565,0.07669235020875931,0.06968677788972855,0.26401442289352417,902.0044555664062,1e-05,0.08534980565309525,5.688287734985352,15.555094242095947,1 +1957,0.1392277181148529,0.04467061907052994,0.047514867037534714,0.16048076748847961,586.51806640625,1e-05,0.07511022686958313,5.712957382202148,15.555094242095947,1 +1958,0.07048185914754868,0.059564173221588135,0.06077321246266365,0.2366987019777298,671.2963256835938,1e-05,0.06566915661096573,5.68901515007019,15.555094242095947,1 +1959,0.08558346331119537,0.11000429093837738,0.10565090924501419,0.22996793687343597,362.2159423828125,1e-05,0.07966804504394531,5.686228513717651,15.555094242095947,1 +1960,0.06543790549039841,0.9212645292282104,0.9157691597938538,0.20035254955291748,19.685039520263672,1e-05,0.0757087916135788,5.688180685043335,15.555094242095947,1 +1961,0.06676988303661346,0.08408509194850922,0.08337567746639252,0.207267627120018,918.259033203125,1e-05,0.05774582177400589,5.758377552032471,15.555094242095947,1 +1962,0.10470956563949585,0.06442426890134811,0.059462130069732666,0.22134613990783691,710.2763671875,1e-05,0.059273432940244675,5.690631151199341,15.555094242095947,1 +1963,0.10946405678987503,0.10470245778560638,0.0934259444475174,0.2551442086696625,921.3984985351562,1e-05,0.06734257191419601,5.687285661697388,15.555094242095947,1 +1964,0.10066184401512146,0.10274814814329147,0.10197730362415314,0.25294870138168335,538.1549072265625,1e-05,0.07128060609102249,5.681775331497192,15.555094242095947,1 +1965,0.0960381031036377,0.16735553741455078,0.16229090094566345,0.17307691276073456,994.0623168945312,1e-05,0.05902132764458656,5.8875181674957275,15.555094242095947,1 +1966,0.0667930394411087,0.08615712821483612,0.08218448609113693,0.2589823603630066,788.4046630859375,1e-05,0.0586593896150589,5.699019908905029,15.555094242095947,1 +1967,0.053085580468177795,0.1102483719587326,0.10424106568098068,0.21174678206443787,793.128662109375,1e-05,0.06274213641881943,5.701381206512451,15.555094242095947,1 +1968,0.09602217376232147,0.06272687017917633,0.05995974689722061,0.14443910121917725,778.6576538085938,1e-05,0.06173824518918991,5.899103403091431,15.555094242095947,1 +1969,0.08421239256858826,0.05666041001677513,0.051821451634168625,0.2007131278514862,886.6278686523438,1e-05,0.07658952474594116,5.684402942657471,15.555094242095947,1 +1970,0.06729213148355484,0.13733623921871185,0.1289430856704712,0.20549678802490234,958.2166748046875,1e-05,0.06892368197441101,5.682933568954468,15.555094242095947,1 +1971,0.10596076399087906,0.07335711270570755,0.07553776353597641,0.2353365272283554,418.88299560546875,1e-05,0.06227341666817665,5.6873252391815186,15.555094242095947,1 +1972,0.08017683774232864,0.12464117258787155,0.11706968396902084,0.22739581763744354,903.9313354492188,1e-05,0.06525630503892899,5.6775288581848145,15.555094242095947,1 +1973,0.07034941017627716,0.07208891212940216,0.06611725687980652,0.3222676217556,794.4606323242188,1e-05,0.0669010728597641,5.6856749057769775,15.555094242095947,1 +1974,0.12139170616865158,0.2503224313259125,0.26852768659591675,0.17435896396636963,117.75362396240234,1e-05,0.061635926365852356,5.692463159561157,15.555094242095947,1 +1975,0.08977046608924866,0.09092649817466736,0.08610429614782333,0.13032852113246918,898.4814453125,1e-05,0.05946875736117363,5.691619157791138,15.555094242095947,1 +1976,0.08432234823703766,0.04763171449303627,0.048578497022390366,0.20677883923053741,694.9378051757812,1e-05,0.06567003577947617,5.715360403060913,15.555094242095947,1 +1977,0.15832635760307312,0.10136992484331131,0.09702059626579285,0.2251282036304474,396.1748962402344,1e-05,0.06446734070777893,5.682257652282715,15.555094242095947,1 +1978,0.0688028410077095,0.0873209610581398,0.08442161977291107,0.22697915136814117,493.3414306640625,1e-05,0.06600124388933182,5.709487438201904,15.555094242095947,1 +1979,0.1034431979060173,0.08544792234897614,0.08468733727931976,0.2254967838525772,945.4190673828125,1e-05,0.07001291215419769,5.694457769393921,15.555094242095947,1 +1980,0.0630553588271141,0.09475672990083694,0.09351465106010437,0.24520832300186157,534.8970336914062,1e-05,0.054609399288892746,5.9187047481536865,15.555094242095947,1 +1981,0.07069816440343857,0.10366743057966232,0.09948103874921799,0.2457531988620758,977.3124389648438,1e-05,0.06521768867969513,5.700099468231201,15.555094242095947,1 +1982,0.06105108931660652,0.07271379232406616,0.0701896920800209,0.27959132194519043,852.4172973632812,1e-05,0.056134480983018875,5.693782329559326,15.555094242095947,1 +1983,0.13373082876205444,0.1836833655834198,0.17795154452323914,0.2246313989162445,245.17686462402344,1e-05,0.07794231921434402,5.700982570648193,15.555094242095947,1 +1984,0.055060647428035736,0.13105535507202148,0.11535273492336273,0.2070833295583725,946.3070678710938,1e-05,0.06503046303987503,5.690725803375244,15.555094242095947,1 +1985,0.07767213881015778,0.05702568218111992,0.05756513401865959,0.17471954226493835,768.4899291992188,1e-05,0.06615555286407471,5.689807176589966,15.555094242095947,1 +1986,0.08508163690567017,0.07332222163677216,0.07247781753540039,0.22409453988075256,658.1439819335938,1e-05,0.0880967453122139,5.691438436508179,15.555094242095947,1 +1987,0.07911929488182068,0.05835891515016556,0.05755474045872688,0.15445512533187866,502.3923645019531,1e-05,0.06755980104207993,5.6764817237854,15.555094242095947,1 +1988,0.08625572919845581,0.06164338067173958,0.05488988384604454,0.22928684949874878,743.5170288085938,1e-05,0.06056345999240875,5.696974754333496,15.555094242095947,1 +1989,0.11354116350412369,0.05787799507379532,0.05749545991420746,0.12600961327552795,881.919921875,1e-05,0.08377166837453842,5.706677198410034,15.555094242095947,1 +1990,0.05644609034061432,0.05452846735715866,0.05047465115785599,0.1714823693037033,870.7523803710938,1e-05,0.0634302943944931,5.693559408187866,15.555094242095947,1 +1991,0.0730886161327362,0.25540944933891296,0.25338223576545715,0.233028843998909,141.84397888183594,1e-05,0.07146695256233215,5.733265399932861,15.555094242095947,1 +1992,0.10162366181612015,0.1106785386800766,0.1073594018816948,0.19276441633701324,964.3510131835938,1e-05,0.06854911893606186,5.88279390335083,15.555094242095947,1 +1993,0.08827634155750275,0.07121562957763672,0.06559309363365173,0.2736137807369232,909.21484375,1e-05,0.06705639511346817,5.69573974609375,15.555094242095947,1 +1994,0.08413855731487274,0.0542050339281559,0.055666714906692505,0.19167467951774597,901.2276611328125,1e-05,0.06901722401380539,5.692574739456177,15.555094242095947,1 +1995,0.05444369092583656,0.08898366987705231,0.08786327391862869,0.19283653795719147,797.1013793945312,1e-05,0.050053197890520096,5.688582420349121,15.555094242095947,1 +1996,0.09045637398958206,0.08038046956062317,0.07314129918813705,0.19756409525871277,820.1513671875,1e-05,0.06473691016435623,5.694375038146973,15.555094242095947,1 +1997,0.06970112025737762,0.0707496702671051,0.06598950177431107,0.20702724158763885,880.6146240234375,1e-05,0.07757008820772171,5.691421031951904,15.555094242095947,1 +1998,0.1105780303478241,0.11283403635025024,0.11195249855518341,0.2461538314819336,241.93548583984375,1e-05,0.055818017572164536,5.689816474914551,15.555094242095947,1 +1999,0.08895081281661987,0.05767400562763214,0.056377485394477844,0.2623477578163147,704.624755859375,1e-05,0.062483854591846466,5.687316179275513,15.555094242095947,1 +2000,0.068415567278862,0.08486537635326385,0.08156545460224152,0.25073716044425964,960.1112060546875,1e-05,0.06744401901960373,5.958724737167358,15.555094242095947,1 +2001,0.13101093471050262,0.06289655715227127,0.06322091072797775,0.23955127596855164,713.9794311523438,1e-05,0.06104346364736557,5.6739420890808105,15.555094242095947,1 +2002,0.09544461220502853,0.09339550882577896,0.0878504291176796,0.151810884475708,946.896240234375,1e-05,0.062046896666288376,5.781586647033691,15.555094242095947,1 +2003,0.07671962678432465,0.14007849991321564,0.13573260605335236,0.22056889533996582,960.1112060546875,1e-05,0.07183670252561569,5.710088014602661,15.555094242095947,1 +2004,0.09237024188041687,0.10975145548582077,0.11276467889547348,0.07995191961526871,235.38963317871094,1e-05,0.05812882259488106,5.703639268875122,15.555094242095947,1 +2005,0.087191142141819,0.1576196849346161,0.15129131078720093,0.19838941097259521,978.2608642578125,1e-05,0.06703977286815643,5.707589626312256,15.555094242095947,1 +2006,0.10905974358320236,0.2360381782054901,0.24101407825946808,0.21487179398536682,101.10294342041016,1e-05,0.07609254121780396,5.931596040725708,15.555094242095947,1 +2007,0.08405981212854385,0.05915616452693939,0.05467042326927185,0.2618750035762787,824.2506713867188,1e-05,0.052841100841760635,5.692969799041748,15.555094242095947,1 +2008,0.09338580816984177,0.045561593025922775,0.048108626157045364,0.18082530796527863,817.7731323242188,1e-05,0.06294790655374527,5.687522888183594,15.555094242095947,1 +2009,0.1042351946234703,0.12769460678100586,0.12267477810382843,0.1830769181251526,965.6505737304688,1e-05,0.07552418857812881,5.68505597114563,15.555094242095947,1 +2010,0.08721768856048584,0.09027533233165741,0.08672013878822327,0.2007131278514862,804.208251953125,1e-05,0.05550132319331169,5.904507398605347,15.555094242095947,1 +2011,0.07940814644098282,0.044565487653017044,0.039497923105955124,0.23763620853424072,907.3464965820312,1e-05,0.07177513092756271,6.779846906661987,15.555094242095947,1 +2012,0.04703362286090851,0.0946594625711441,0.09052620083093643,0.19191505014896393,884.0750122070312,1e-05,0.05614469200372696,5.698412895202637,15.555094242095947,1 +2013,0.12738166749477386,0.06624039262533188,0.060532741248607635,0.169182687997818,669.14501953125,1e-05,0.06697151809930801,5.792191028594971,15.555094242095947,1 +2014,0.0494823083281517,0.10037387162446976,0.09142101556062698,0.2710336446762085,916.8442993164062,1e-05,0.06093216687440872,5.718513488769531,15.555094242095947,1 +2015,0.12833485007286072,0.1115424707531929,0.10372813791036606,0.22609774768352509,881.4859008789062,1e-05,0.06033894047141075,5.704010725021362,15.555094242095947,1 +2016,0.08834247291088104,0.07802522927522659,0.0747118666768074,0.17218749225139618,723.90576171875,1e-05,0.054943811148405075,5.6919472217559814,15.555094242095947,1 +2017,0.07052367925643921,0.17799493670463562,0.19550147652626038,0.2363060861825943,149.64788818359375,1e-05,0.05964585766196251,5.700171947479248,15.555094242095947,1 +2018,0.06683475524187088,0.06734807789325714,0.06486013531684875,0.1758253127336502,523.2557983398438,1e-05,0.06072226166725159,5.70728063583374,15.555094242095947,1 +2019,0.09998320788145065,0.09935055673122406,0.09584319591522217,0.23362179100513458,750.0000610351562,1e-05,0.07957107573747635,5.70310115814209,15.555094242095947,1 +2020,0.049673061817884445,0.0335349515080452,0.03767002746462822,0.2579807639122009,534.8970336914062,1e-05,0.05185607448220253,5.701763153076172,15.555094242095947,1 +2021,0.0618261955678463,0.03935544192790985,0.04116968810558319,0.13067306578159332,759.419189453125,1e-05,0.048391226679086685,5.697946548461914,15.555094242095947,1 +2022,0.06978610903024673,0.14775905013084412,0.13811016082763672,0.2738381326198578,949.22998046875,1e-05,0.08361338824033737,5.696652173995972,15.555094242095947,1 +2023,0.05607948824763298,0.10573571920394897,0.10096762329339981,0.18767628073692322,980.37109375,1e-05,0.07373303174972534,5.678486585617065,15.555094242095947,1 +2024,0.10765363276004791,0.2213372141122818,0.24565602838993073,0.25804486870765686,96.86347198486328,1e-05,0.07789083570241928,5.90679669380188,15.555094242095947,1 +2025,0.06434847414493561,0.0605463981628418,0.056720487773418427,0.2800079882144928,817.7731323242188,1e-05,0.06613187491893768,5.9130589962005615,15.555094242095947,1 +2026,0.07977736741304398,0.059779535979032516,0.06067395955324173,0.2186538428068161,712.13427734375,1e-05,0.07696221023797989,5.686206579208374,15.555094242095947,1 +2027,0.12170447409152985,0.09613364189863205,0.0966765359044075,0.19238781929016113,985.8411254882812,1e-05,0.061987146735191345,5.924085378646851,15.555094242095947,1 +2028,0.12733641266822815,0.13406720757484436,0.12913021445274353,0.26276442408561707,288.4615478515625,1e-05,0.08281226456165314,5.683643102645874,15.555094242095947,1 +2029,0.08313792198896408,0.10948517173528671,0.10221801698207855,0.21299678087234497,928.828369140625,1e-05,0.07037743926048279,5.689598083496094,15.555094242095947,1 +2030,0.12370269000530243,0.1706775426864624,0.18216489255428314,0.2675400674343109,164.93057250976562,1e-05,0.07849157601594925,5.686310529708862,15.555094242095947,1 +2031,0.07484523206949234,0.3236982822418213,0.31176772713661194,0.22291666269302368,145.7597198486328,1e-05,0.04976511746644974,5.793826580047607,15.555094242095947,1 +2032,0.0744827389717102,0.056456878781318665,0.05362372472882271,0.2834935784339905,878.4185791015625,1e-05,0.09487096220254898,5.689603805541992,15.555094242095947,1 +2033,0.0776090994477272,0.9973791241645813,0.9965853095054626,0.14629006385803223,4.9800801277160645,1e-05,0.06285476684570312,5.81710147857666,15.555094242095947,1 +2034,0.1137017011642456,0.2416285127401352,0.23887676000595093,0.24799679219722748,201.34228515625,1e-05,0.06491938978433609,6.07217264175415,15.555094242095947,1 +2035,0.045967042446136475,0.06628226488828659,0.06434555351734161,0.25659453868865967,720.3389282226562,1e-05,0.09188540279865265,5.682262182235718,15.555094242095947,1 +2036,0.08358664065599442,0.09156498312950134,0.0884178876876831,0.23294870555400848,386.7403564453125,1e-05,0.07606109231710434,5.685145854949951,15.555094242095947,1 +2037,0.10537709295749664,0.06425938755273819,0.0650579035282135,0.29877403378486633,538.1549072265625,1e-05,0.08297549933195114,5.685173034667969,15.555094242095947,1 +2038,0.0785917416214943,0.10235073417425156,0.10282205790281296,0.20818108320236206,923.799560546875,1e-05,0.07117852568626404,5.760251760482788,15.555094242095947,1 +2039,0.10145576298236847,0.03850088268518448,0.039172589778900146,0.231682687997818,694.9378051757812,1e-05,0.06774566322565079,5.6933276653289795,15.555094242095947,1 +2040,0.12458740174770355,0.611404538154602,0.6035321354866028,0.24841345846652985,57.25191116333008,1e-05,0.09002561122179031,5.68751072883606,15.555094242095947,1 +2041,0.04821233078837395,0.07531417906284332,0.07898377627134323,0.17697115242481232,967.4503784179688,1e-05,0.07429958134889603,5.827363967895508,15.555094242095947,1 +2042,0.09205988049507141,0.11629174649715424,0.116178959608078,0.2167387753725052,941.20556640625,1e-05,0.08792077004909515,5.693578720092773,15.555094242095947,1 +2043,0.1296994984149933,0.07610265165567398,0.07468581944704056,0.1594471037387848,930.7967529296875,1e-05,0.09506765753030777,5.688987493515015,15.555094242095947,1 +2044,0.07525663077831268,0.1062563881278038,0.1011333242058754,0.23180288076400757,926.5010375976562,1e-05,0.05652138218283653,5.678553819656372,15.555094242095947,1 +2045,0.09371613711118698,0.08986449241638184,0.08724822103977203,0.2850080132484436,910.3261108398438,1e-05,0.06891947239637375,5.708549737930298,15.555094242095947,1 +2046,0.04568492993712425,0.1256314367055893,0.1256994605064392,0.21871794760227203,998.3897094726562,1e-05,0.07008406519889832,5.697354316711426,15.555094242095947,1 +2047,0.061649829149246216,0.1410769373178482,0.14207562804222107,0.161370187997818,941.20556640625,1e-05,0.0661543607711792,5.688422918319702,15.555094242095947,1 +2048,0.0780302882194519,0.11924801766872406,0.11719363927841187,0.21870993077754974,899.6636962890625,1e-05,0.055253032594919205,5.930659770965576,15.555094242095947,1 +2049,0.11356083303689957,0.19399729371070862,0.20301590859889984,0.24683493375778198,129.92831420898438,1e-05,0.08381235599517822,5.698524236679077,15.555094242095947,1 +2050,0.06985495984554291,0.11360059678554535,0.12215939164161682,0.20379005372524261,971.7275390625,1e-05,0.07098472118377686,5.687228202819824,15.555094242095947,1 +2051,0.12235353887081146,0.06133466958999634,0.05602236092090607,0.23788461089134216,730.0333251953125,1e-05,0.06508989632129669,5.7029807567596436,15.555094242095947,1 +2052,0.09359899908304214,0.16791631281375885,0.16578373312950134,0.2524919807910919,993.8524169921875,1e-05,0.07938646525144577,5.731094598770142,15.555094242095947,1 +2053,0.05870645493268967,0.053967610001564026,0.05318976566195488,0.253846138715744,716.7235717773438,1e-05,0.05532274767756462,5.692320346832275,15.555094242095947,1 +2054,0.13455773890018463,0.05113769322633743,0.05393099784851074,0.2151923030614853,476.4851989746094,1e-05,0.07930539548397064,5.683236360549927,15.555094242095947,1 +2055,0.05170365795493126,0.06495404243469238,0.055808547884225845,0.23112979531288147,879.7392578125,1e-05,0.07020974904298782,5.6889564990997314,15.555094242095947,1 +2056,0.08296911418437958,0.29080820083618164,0.28240856528282166,0.23498396575450897,141.84397888183594,1e-05,0.06979954242706299,5.6919567584991455,15.555094242095947,1 +2057,0.12581755220890045,0.06523886322975159,0.0643969178199768,0.26855766773223877,792.4597778320312,1e-05,0.06371151655912399,5.692156553268433,15.555094242095947,1 +2058,0.04151163995265961,0.07433578372001648,0.06977386772632599,0.13036057353019714,847.8120727539062,1e-05,0.05613056570291519,5.690404415130615,15.555094242095947,1 +2059,0.07398933172225952,0.08548683673143387,0.08193263411521912,0.23423877358436584,730.0333251953125,1e-05,0.06868816912174225,5.688147783279419,15.555094242095947,1 +2060,0.1162472665309906,0.10352972149848938,0.09909512847661972,0.2667147219181061,724.7899169921875,1e-05,0.06531381607055664,5.69482946395874,15.555094242095947,1 +2061,0.04077020660042763,0.07410528510808945,0.07283351570367813,0.2474038302898407,860.34912109375,1e-05,0.05796695500612259,5.686792373657227,15.555094242095947,1 +2062,0.09071927517652512,0.08707518875598907,0.08688865602016449,0.2159615308046341,958.4887084960938,1e-05,0.06351181864738464,5.728827953338623,15.555094242095947,1 +2063,0.04646102711558342,0.1744081974029541,0.164395272731781,0.29701921343803406,984.94482421875,1e-05,0.08647595345973969,5.696551084518433,15.555094242095947,1 +2064,0.11049463599920273,0.08836992084980011,0.08407250046730042,0.16180287301540375,801.0057983398438,1e-05,0.064871646463871,5.690627574920654,15.555094242095947,1 +2065,0.10414119064807892,0.038276586681604385,0.0392831489443779,0.21362178027629852,670.22265625,1e-05,0.06195041909813881,5.695803642272949,15.555094242095947,1 +2066,0.057565413415431976,0.20612554252147675,0.1873241811990738,0.2456730604171753,970.2327880859375,1e-05,0.07026723772287369,5.7276105880737305,15.555094242095947,1 +2067,0.07569366693496704,0.08731818944215775,0.0958276018500328,0.14244391024112701,944.52587890625,1e-05,0.07076432555913925,5.695486783981323,15.555094242095947,1 +2068,0.11615696549415588,0.11116923391819,0.09803938865661621,0.25254005193710327,953.5103759765625,1e-05,0.06953179836273193,5.703006982803345,15.555094242095947,1 +2069,0.09773952513933182,0.06229456141591072,0.06173304468393326,0.2424759566783905,806.1080322265625,1e-05,0.0728401243686676,5.927042245864868,15.555094242095947,1 +2070,0.09755607694387436,0.09297586232423782,0.08715614676475525,0.2198237031698227,561.674072265625,1e-05,0.09231747686862946,5.741200923919678,15.555094242095947,1 +2071,0.14784544706344604,0.07155843079090118,0.07257366180419922,0.23528845608234406,507.7196960449219,1e-05,0.06202986463904381,5.696943044662476,15.555094242095947,1 +2072,0.06766688823699951,0.065726637840271,0.06441283226013184,0.21044069528579712,914.3394165039062,1e-05,0.08036861568689346,5.684112548828125,15.555094242095947,1 +2073,0.0868997648358345,0.09430603682994843,0.0903177335858345,0.23857371509075165,391.4835205078125,1e-05,0.058333296328783035,5.714502334594727,15.555094242095947,1 +2074,0.11121652275323868,0.07048826664686203,0.07353382557630539,0.2294551134109497,974.6696166992188,1e-05,0.08211251348257065,5.688664197921753,15.555094242095947,1 +2075,0.048386283218860626,0.06533312052488327,0.06310784071683884,0.23502403497695923,844.6821899414062,1e-05,0.06670068204402924,5.808457374572754,15.555094242095947,1 +2076,0.11825832724571228,0.041030336171388626,0.04404635354876518,0.17936697602272034,787.721923828125,1e-05,0.07833999395370483,5.682652711868286,15.555094242095947,1 +2077,0.10262512415647507,0.047382891178131104,0.04771937429904938,0.27387017011642456,676.6055297851562,1e-05,0.058703940361738205,5.701943874359131,15.555094242095947,1 +2078,0.05853961035609245,0.06956741958856583,0.06762672960758209,0.2944470942020416,806.1080322265625,1e-05,0.04988373443484306,5.688299655914307,15.555094242095947,1 +2079,0.06489501148462296,0.2326665222644806,0.21280153095722198,0.26277244091033936,997.5768432617188,1e-05,0.06507425010204315,5.694264888763428,15.555094242095947,1 +2080,0.12890231609344482,0.11132127791643143,0.09771595895290375,0.2048637717962265,944.52587890625,1e-05,0.10490411520004272,5.690235614776611,15.555094242095947,1 +2081,0.10376692563295364,0.15550491213798523,0.15394258499145508,0.24289262294769287,204.84951782226562,1e-05,0.07866909354925156,5.685532808303833,15.555094242095947,1 +2082,0.12156900018453598,0.07578667998313904,0.07203218340873718,0.21086537837982178,509.47869873046875,1e-05,0.07362248748540878,5.6949543952941895,15.555094242095947,1 +2083,0.10217901319265366,0.06738591939210892,0.06652744114398956,0.2569631338119507,765.50390625,1e-05,0.06388270109891891,5.8568994998931885,15.555094242095947,1 +2084,0.07669772207736969,0.046061981469392776,0.046936772763729095,0.218854159116745,639.6484985351562,1e-05,0.06607919931411743,5.69074273109436,15.555094242095947,1 +2085,0.12325923144817352,0.05696483328938484,0.057476114481687546,0.1971554458141327,858.8861083984375,1e-05,0.07984913885593414,5.68132209777832,15.555094242095947,1 +2086,0.06537026911973953,0.04083949699997902,0.03990936651825905,0.3017948567867279,745.1535034179688,1e-05,0.07295303046703339,5.684171676635742,15.555094242095947,1 +2087,0.13194046914577484,0.1127019003033638,0.10779678821563721,0.18939101696014404,877.5327758789062,1e-05,0.07337691634893417,6.09698486328125,15.555094242095947,1 +2088,0.13774073123931885,0.08603602647781372,0.08432336151599884,0.25785255432128906,677.6557006835938,1e-05,0.08550505340099335,5.681708812713623,15.555094242095947,1 +2089,0.09111747145652771,0.1144249215722084,0.10234493762254715,0.23937499523162842,940.5940551757812,1e-05,0.08204098790884018,5.695162534713745,15.555094242095947,1 +2090,0.06746628135442734,0.05796636641025543,0.057232074439525604,0.2618910074234009,893.2648315429688,1e-05,0.07140195369720459,5.6780736446380615,15.555094242095947,1 +2091,0.052025895565748215,0.10060925036668777,0.09689223766326904,0.22499197721481323,892.4485473632812,1e-05,0.057640548795461655,5.6848835945129395,15.555094242095947,1 +2092,0.10838311910629272,0.0967913269996643,0.0920569971203804,0.23029646277427673,893.2648315429688,1e-05,0.08136015385389328,5.687041997909546,15.555094242095947,1 +2093,0.13654965162277222,0.12958019971847534,0.1323072910308838,0.22701120376586914,201.34228515625,1e-05,0.07459930330514908,5.99138069152832,15.555094242095947,1 +2094,0.10443706065416336,0.06020816043019295,0.060819998383522034,0.2376682609319687,766.25390625,1e-05,0.057416751980781555,5.704564571380615,15.555094242095947,1 +2095,0.05849335715174675,0.04453696310520172,0.044568222016096115,0.07558493316173553,887.8910522460938,1e-05,0.05805709585547447,5.686973810195923,15.555094242095947,1 +2096,0.08479362726211548,0.08725094795227051,0.08990335464477539,0.18568108975887299,936.2449951171875,1e-05,0.07831724733114243,5.739035129547119,15.555094242095947,1 +2097,0.09779132902622223,0.05037442594766617,0.052706602960824966,0.19543267786502838,760.95458984375,1e-05,0.06544473767280579,5.688149929046631,15.555094242095947,1 +2098,0.09657476842403412,0.08794687688350677,0.08599293231964111,0.22746793925762177,546.1712036132812,1e-05,0.06589875370264053,5.704711437225342,15.555094242095947,1 +2099,0.09200631082057953,0.09790366142988205,0.09338785707950592,0.14725960791110992,799.7118530273438,1e-05,0.08730565756559372,5.692850589752197,15.555094242095947,1 +2100,0.06891653686761856,0.0127415144816041,0.012976672500371933,0.09502403438091278,755.5379638671875,1e-05,0.07180903106927872,5.68930721282959,15.555094242095947,1 +2101,0.06982447952032089,0.10464268922805786,0.10486168414354324,0.16046473383903503,973.6957397460938,1e-05,0.06727185845375061,5.687932014465332,15.555094242095947,1 +2102,0.1494024246931076,0.060966335237026215,0.05839795619249344,0.12907852232456207,720.3389282226562,1e-05,0.1100463718175888,5.7106242179870605,15.555094242095947,1 +2103,0.11834953725337982,0.36527732014656067,0.3547188639640808,0.24696312844753265,117.75362396240234,1e-05,0.08327591419219971,5.685698747634888,15.555094242095947,1 +2104,0.0917239561676979,0.06442274153232574,0.06458581984043121,0.09252403676509857,840.9685668945312,1e-05,0.06864514201879501,5.823700666427612,15.555094242095947,1 +2105,0.08295486122369766,0.1159619688987732,0.10527975112199783,0.2129727452993393,907.7218017578125,1e-05,0.09546282887458801,5.6898040771484375,15.555094242095947,1 +2106,0.10674824565649033,0.2146487832069397,0.20300351083278656,0.22600960731506348,980.8355712890625,1e-05,0.08725350350141525,5.721736431121826,15.555094242095947,1 +2107,0.0938943475484848,0.09202504903078079,0.08849772065877914,0.20837338268756866,865.6211547851562,1e-05,0.09270601719617844,5.6922218799591064,15.555094242095947,1 +2108,0.07295739650726318,0.06110698729753494,0.05462811514735222,0.23806089162826538,775.796630859375,1e-05,0.08620786666870117,5.703771591186523,15.555094242095947,1 +2109,0.08908139914274216,0.11211411654949188,0.10849225521087646,0.22391825914382935,953.2288818359375,1e-05,0.08799432218074799,5.911602735519409,15.555094242095947,1 +2110,0.11817951500415802,0.10569102317094803,0.10317707806825638,0.11909455060958862,367.23162841796875,1e-05,0.08156339824199677,5.680211544036865,15.555094242095947,1 +2111,0.12809045612812042,0.41286781430244446,0.42433643341064453,0.26826921105384827,92.59259796142578,1e-05,0.08473936468362808,5.683420181274414,15.555094242095947,1 +2112,0.06639029830694199,0.05584399402141571,0.053605109453201294,0.12005608528852463,812.3250122070312,1e-05,0.07024449110031128,5.887071847915649,15.555094242095947,1 +2113,0.05298805609345436,0.021493535488843918,0.021129736676812172,0.19240383803844452,765.50390625,1e-05,0.09000568091869354,5.698903799057007,15.555094242095947,1 +2114,0.07746157050132751,0.10643691569566727,0.10481241345405579,0.22922274470329285,950.6705322265625,1e-05,0.07185173034667969,5.705165386199951,15.555094242095947,1 +2115,0.08002887666225433,0.11671701818704605,0.10993116348981857,0.2109294831752777,932.7411499023438,1e-05,0.06295374780893326,5.699596881866455,15.555094242095947,1 +2116,0.07520316541194916,0.11949397623538971,0.12075567245483398,0.12556089460849762,201.34228515625,1e-05,0.08897428214550018,5.696802139282227,15.555094242095947,1 +2117,0.07821401953697205,0.10166412591934204,0.0957404151558876,0.27127403020858765,863.7206420898438,1e-05,0.10209444165229797,5.690342903137207,15.555094242095947,1 +2118,0.09567691385746002,0.21926207840442657,0.20994159579277039,0.26868587732315063,238.6731414794922,1e-05,0.07167035341262817,5.694509506225586,15.555094242095947,1 +2119,0.08913183212280273,0.06573960930109024,0.06369419395923615,0.2391025573015213,796.4441528320312,1e-05,0.09690728783607483,5.90753436088562,15.555094242095947,1 +2120,0.07358169555664062,0.10476032644510269,0.10036157816648483,0.280304491519928,945.7156982421875,1e-05,0.07944656163454056,5.686407804489136,15.555094242095947,1 +2121,0.052682988345623016,0.08626507967710495,0.08607247471809387,0.08094550669193268,980.6033935546875,1e-05,0.06840904802083969,5.689399480819702,15.555094242095947,1 +2122,0.10173331946134567,0.26894572377204895,0.2362232804298401,0.2551842927932739,999.1974487304688,1e-05,0.13664177060127258,5.700801134109497,15.555094242095947,1 +2123,0.06511811912059784,0.051968734711408615,0.05050332844257355,0.19182690978050232,879.7392578125,1e-05,0.09956900030374527,5.6880409717559814,15.555094242095947,1 +2124,0.11395785212516785,0.15384924411773682,0.15417742729187012,0.25265222787857056,241.93548583984375,1e-05,0.07356418669223785,5.693624019622803,15.555094242095947,1 +2125,0.07535091042518616,0.05906331166625023,0.05385918170213699,0.12332531809806824,830.5369873046875,1e-05,0.1178107038140297,5.68827223777771,15.555094242095947,1 +2126,0.0924016609787941,0.06726042181253433,0.0658729076385498,0.2075641006231308,724.7899169921875,1e-05,0.09159096330404282,7.00368595123291,15.555094242095947,1 +2127,0.11320167779922485,0.10438334196805954,0.10159461200237274,0.3017948567867279,542.9864501953125,1e-05,0.06045467033982277,5.760768413543701,15.555094242095947,1 +2128,0.11972428113222122,0.049410805106163025,0.0502849705517292,0.2547195553779602,657.0208740234375,1e-05,0.09617724269628525,5.684818983078003,15.555094242095947,1 +2129,0.14189249277114868,0.11195366829633713,0.10472233593463898,0.22259613871574402,966.1671142578125,1e-05,0.10809249430894852,5.701732397079468,15.555094242095947,1 +2130,0.09186611324548721,0.33329907059669495,0.29669392108917236,0.273749977350235,996.9635620117188,1e-05,0.07221852242946625,5.686170816421509,15.555094242095947,1 +2131,0.0789855569601059,0.0728440061211586,0.06602233648300171,0.25997593998908997,645.55126953125,1e-05,0.11329798400402069,5.681859970092773,15.555094242095947,1 +2132,0.06282805651426315,0.08858366310596466,0.08694835007190704,0.22127403318881989,844.1558227539062,1e-05,0.09944473206996918,5.688615322113037,15.555094242095947,1 +2133,0.09409122914075851,0.05604374408721924,0.053577568382024765,0.2510576844215393,628.7276611328125,1e-05,0.0642382875084877,5.688714265823364,15.555094242095947,1 +2134,0.06632526218891144,0.074045330286026,0.07404085248708725,0.2171233892440796,797.1013793945312,1e-05,0.06136474013328552,5.885917901992798,15.555094242095947,1 +2135,0.11765794456005096,0.057347942143678665,0.05042413994669914,0.22051280736923218,690.9660034179688,1e-05,0.09051238000392914,5.687499284744263,15.555094242095947,1 +2136,0.05791705101728439,0.14570511877536774,0.13610579073429108,0.2199038416147232,956.0206298828125,1e-05,0.06513787060976028,5.676430702209473,15.555094242095947,1 +2137,0.10934468358755112,0.11657825112342834,0.10108204185962677,0.2650560736656189,985.8411254882812,1e-05,0.07658716291189194,5.697633266448975,15.555094242095947,1 +2138,0.17168045043945312,0.11145889014005661,0.10735487192869186,0.25902241468429565,762.48046875,1e-05,0.06620634347200394,5.689955711364746,15.555094242095947,1 +2139,0.05477697402238846,0.12817630171775818,0.12465237081050873,0.276129812002182,273.4375,1e-05,0.05963395535945892,5.691628694534302,15.555094242095947,1 +2140,0.04710381478071213,0.0685620978474617,0.06339555233716965,0.288221150636673,899.2704467773438,1e-05,0.061458855867385864,5.68341588973999,15.555094242095947,1 +2141,0.07766389846801758,0.5929710268974304,0.5933730006217957,0.27948716282844543,48.076927185058594,1e-05,0.08697086572647095,5.686776161193848,15.555094242095947,1 +2142,0.09060848504304886,0.0997006967663765,0.09502244740724564,0.17441505193710327,918.6107788085938,1e-05,0.05974240601062775,5.843527793884277,15.555094242095947,1 +2143,0.08441993594169617,0.07561784982681274,0.07421378791332245,0.26798075437545776,583.6886596679688,1e-05,0.061229679733514786,5.675726652145386,15.555094242095947,1 +2144,0.10155187547206879,0.1324646919965744,0.12981043756008148,0.17957530915737152,560.154541015625,1e-05,0.0568096749484539,5.6837499141693115,15.555094242095947,1 +2145,0.08180301636457443,0.07090350985527039,0.06476806104183197,0.2303285151720047,759.419189453125,1e-05,0.06576641649007797,5.682815074920654,15.555094242095947,1 +2146,0.0865338146686554,0.13758760690689087,0.13326700031757355,0.21564902365207672,960.3799438476562,1e-05,0.08161111921072006,5.697587966918945,15.555094242095947,1 +2147,0.10309043526649475,0.12288721650838852,0.11731795966625214,0.25488781929016113,276.479736328125,1e-05,0.07372597604990005,5.685997724533081,15.555094242095947,1 +2148,0.08100074529647827,0.20625822246074677,0.21639512479305267,0.2107371687889099,276.479736328125,1e-05,0.0876934826374054,5.693125009536743,15.555094242095947,1 +2149,0.07328933477401733,0.11145413666963577,0.10458330065011978,0.17011217772960663,936.5596923828125,1e-05,0.0931900218129158,5.682956218719482,15.555094242095947,1 +2150,0.06195468828082085,0.07138429582118988,0.06913892924785614,0.2357291579246521,934.9798583984375,1e-05,0.06217023730278015,5.706379175186157,15.555094242095947,1 +2151,0.04318138584494591,0.12442770600318909,0.12334597110748291,0.18195512890815735,952.09716796875,1e-05,0.09033868461847305,5.68533730506897,15.555094242095947,1 +2152,0.08025699108839035,0.06473991274833679,0.06464008241891861,0.19163461029529572,877.5327758789062,1e-05,0.09219668805599213,5.6864845752716064,15.555094242095947,1 +2153,0.08276336640119553,0.11886841058731079,0.11310278624296188,0.25726762413978577,916.1324462890625,1e-05,0.06131959706544876,5.682361841201782,15.555094242095947,1 +2154,0.1370709389448166,0.10893727093935013,0.1107897013425827,0.237644225358963,569.172119140625,1e-05,0.08067429065704346,5.683807611465454,15.555094242095947,1 +2155,0.07964296638965607,0.12313754856586456,0.11907509714365005,0.20971953868865967,898.8763427734375,1e-05,0.08133148401975632,5.89518928527832,15.555094242095947,1 +2156,0.07567311823368073,0.11416232585906982,0.10621989518404007,0.22304485738277435,959.8422241210938,1e-05,0.08215777575969696,5.683748006820679,15.555094242095947,1 +2157,0.11921627819538116,0.1176861822605133,0.1132109984755516,0.22101761400699615,958.2166748046875,1e-05,0.1059977188706398,5.683520078659058,15.555094242095947,1 +2158,0.09688273072242737,0.09278477728366852,0.0873594731092453,0.2419951856136322,717.632080078125,1e-05,0.054558612406253815,5.6841771602630615,15.555094242095947,1 +2159,0.10078886151313782,0.10248324275016785,0.0966470018029213,0.2530849277973175,878.85986328125,1e-05,0.06207918003201485,5.68364691734314,15.555094242095947,1 +2160,0.08733947575092316,0.08430284261703491,0.0858500599861145,0.2555849254131317,448.71795654296875,1e-05,0.06526505202054977,5.684379577636719,15.555094242095947,1 +2161,0.15154187381267548,0.5371914505958557,0.5324917435646057,0.1649198681116104,61.78706741333008,1e-05,0.06931303441524506,5.762851715087891,15.555094242095947,1 +2162,0.08977401256561279,0.05697094276547432,0.05613325536251068,0.14711537957191467,412.1983947753906,1e-05,0.06506781280040741,5.684471845626831,15.555094242095947,1 +2163,0.05037194862961769,0.012938679195940495,0.013161265291273594,0.12421473860740662,739.3790893554688,1e-05,0.09228512644767761,5.6803882122039795,15.555094242095947,1 +2164,0.07107138633728027,0.06763554364442825,0.06747790426015854,0.2882131338119507,600.3118286132812,1e-05,0.06030426546931267,5.685463905334473,15.555094242095947,1 +2165,0.07718639075756073,0.09548703581094742,0.08884603530168533,0.19874197244644165,935.9296264648438,1e-05,0.09325771033763885,5.682838678359985,15.555094242095947,1 +2166,0.06136689707636833,0.095909483730793,0.08968671411275864,0.3073717951774597,852.9224853515625,1e-05,0.09407064318656921,5.698916912078857,15.555094242095947,1 +2167,0.12235334515571594,0.08424665778875351,0.08217490464448929,0.23329326510429382,797.7569580078125,1e-05,0.07110001146793365,5.683797121047974,15.555094242095947,1 +2168,0.06137567758560181,0.047179605811834335,0.049860574305057526,0.2552964687347412,815.3685913085938,1e-05,0.11361247301101685,5.693723440170288,15.555094242095947,1 +2169,0.12189468741416931,0.07911818474531174,0.07710899412631989,0.19315704703330994,704.624755859375,1e-05,0.05648518353700638,5.742505311965942,15.555094242095947,1 +2170,0.042916350066661835,0.10138846933841705,0.09931734949350357,0.20250800251960754,976.8355712890625,1e-05,0.06154288351535797,5.690383672714233,15.555094242095947,1 +2171,0.10260297358036041,0.06838531047105789,0.06370604038238525,0.20288461446762085,940.900146484375,1e-05,0.07933589816093445,5.686814069747925,15.555094242095947,1 +2172,0.0789281353354454,0.0998486801981926,0.09973493963479996,0.18221153318881989,971.23095703125,1e-05,0.06239296495914459,5.671969890594482,15.555094242095947,1 +2173,0.07176906615495682,0.10360532253980637,0.10255896300077438,0.20548877120018005,956.8480224609375,1e-05,0.05409327149391174,5.929265260696411,15.555094242095947,1 +2174,0.09630654752254486,0.1619815230369568,0.1509150266647339,0.2196153700351715,984.0426025390625,1e-05,0.05659891664981842,5.6781885623931885,15.555094242095947,1 +2175,0.10208984464406967,0.059442274272441864,0.06004152446985245,0.11761217564344406,920.7059936523438,1e-05,0.07798971235752106,5.695348501205444,15.555094242095947,1 +2176,0.07170475274324417,0.11020620167255402,0.1079983115196228,0.2973797917366028,976.3572998046875,1e-05,0.05937696620821953,5.921609878540039,15.555094242095947,1 +2177,0.14124509692192078,0.16235144436359406,0.14863760769367218,0.22596953809261322,976.8355712890625,1e-05,0.07275176793336868,5.69357967376709,15.555094242095947,1 +2178,0.08260977268218994,0.06393453478813171,0.0627526342868805,0.25427883863449097,563.1868286132812,1e-05,0.07636198401451111,5.854491472244263,15.555094242095947,1 +2179,0.07490253448486328,0.0965937003493309,0.09689792990684509,0.24853365123271942,962.7756958007812,1e-05,0.06540088355541229,5.703351974487305,15.555094242095947,1 +2180,0.0959428995847702,0.061232611536979675,0.06653697043657303,0.17580127716064453,959.5725708007812,1e-05,0.06052309647202492,5.803393602371216,15.555094242095947,1 +2181,0.12336504459381104,0.21968141198158264,0.21377979218959808,0.18283653259277344,251.59742736816406,1e-05,0.06528161466121674,5.704931974411011,15.555094242095947,1 +2182,0.07799774408340454,0.5499345660209656,0.5557957291603088,0.1831570416688919,61.78706741333008,1e-05,0.05539707839488983,5.698379755020142,15.555094242095947,1 +2183,0.09663594514131546,0.06490562111139297,0.061410825699567795,0.23735575377941132,844.6821899414062,1e-05,0.06930730491876602,5.693564176559448,15.555094242095947,1 +2184,0.04996965080499649,0.16441483795642853,0.16687260568141937,0.17334935069084167,976.5967407226562,1e-05,0.07611750066280365,5.6909050941467285,15.555094242095947,1 +2185,0.06208905950188637,0.0483817420899868,0.04805300012230873,0.21254006028175354,807.9915161132812,1e-05,0.06480462104082108,5.688864469528198,15.555094242095947,1 +2186,0.0989706739783287,0.06691017746925354,0.06403049826622009,0.14278043806552887,881.0508422851562,1e-05,0.08900152891874313,5.698635816574097,15.555094242095947,1 +2187,0.09105537831783295,0.0938199907541275,0.09027907252311707,0.20383012294769287,862.2828979492188,1e-05,0.0704486295580864,5.68289852142334,15.555094242095947,1 +2188,0.1144847571849823,0.06377733498811722,0.06585267931222916,0.28506410121917725,952.9466552734375,1e-05,0.06407316774129868,5.693789720535278,15.555094242095947,1 +2189,0.08787234127521515,0.08602878451347351,0.08251902461051941,0.2847435772418976,438.31170654296875,1e-05,0.10297944396734238,5.697010040283203,15.555094242095947,1 +2190,0.11474230885505676,0.16570889949798584,0.1634799987077713,0.21686698496341705,232.08470153808594,1e-05,0.06615696847438812,5.931734800338745,15.555094242095947,1 +2191,0.08043111860752106,0.0835571214556694,0.08091054111719131,0.2655048072338104,833.3333129882812,1e-05,0.057403236627578735,5.69661545753479,15.555094242095947,1 +2192,0.06339626014232635,0.07060552388429642,0.06385170668363571,0.26257210969924927,693.9501953125,1e-05,0.06874383985996246,5.678377628326416,15.555094242095947,1 +2193,0.12714573740959167,0.1228511855006218,0.12063920497894287,0.26423075795173645,518.14990234375,1e-05,0.10465163737535477,5.685542345046997,15.555094242095947,1 +2194,0.06025071069598198,0.07179155945777893,0.07372168451547623,0.07516826689243317,943.3267822265625,1e-05,0.062326621264219284,5.691025257110596,15.555094242095947,1 +2195,0.1345016062259674,0.05641023442149162,0.05877931788563728,0.24029646813869476,769.9692993164062,1e-05,0.07954228669404984,5.685440540313721,15.555094242095947,1 +2196,0.03412245213985443,0.09359420835971832,0.09763624519109726,0.2752724289894104,969.4793090820312,1e-05,0.056751806288957596,5.893227815628052,15.555094242095947,1 +2197,0.10668715089559555,0.07171694189310074,0.06428323686122894,0.21868589520454407,802.292236328125,1e-05,0.08334692567586899,5.890774965286255,15.555094242095947,1 +2198,0.04754171520471573,0.19446438550949097,0.1718101054430008,0.26895031332969666,981.2984008789062,1e-05,0.07434079051017761,5.687496900558472,15.555094242095947,1 +2199,0.07855749130249023,0.08901220560073853,0.09034320712089539,0.17951922118663788,893.6715698242188,1e-05,0.07376124709844589,5.689509868621826,15.555094242095947,1 +2200,0.0877721980214119,0.06595143675804138,0.069237120449543,0.19915063679218292,917.5531616210938,1e-05,0.07258715480566025,5.703415870666504,15.555094242095947,1 +2201,0.09746845066547394,0.06720061600208282,0.06194932758808136,0.2245352417230606,892.4485473632812,1e-05,0.08871041983366013,5.702363967895508,15.555094242095947,1 +2202,0.08233680576086044,0.053193170577287674,0.052668776363134384,0.2541506290435791,799.0620727539062,1e-05,0.08144675940275192,5.696341037750244,15.555094242095947,1 +2203,0.08332208544015884,0.07150920480489731,0.06776764243841171,0.25043267011642456,767.0015869140625,1e-05,0.0691632553935051,5.689985990524292,15.555094242095947,1 +2204,0.07440678775310516,0.0893654152750969,0.08969061821699142,0.20443908870220184,961.9814453125,1e-05,0.05655200779438019,5.697621822357178,15.555094242095947,1 +2205,0.11381864547729492,0.062160760164260864,0.06712891161441803,0.18224358558654785,560.154541015625,1e-05,0.07469143718481064,5.692899942398071,15.555094242095947,1 +2206,0.08389735221862793,0.04445810243487358,0.04455627128481865,0.08697916567325592,929.1580810546875,1e-05,0.05894230678677559,5.698493003845215,15.555094242095947,1 +2207,0.09181471168994904,0.05747898295521736,0.061036378145217896,0.20944710075855255,926.8355712890625,1e-05,0.05610329657793045,5.687543869018555,15.555094242095947,1 +2208,0.08771516382694244,0.08711258322000504,0.07676592469215393,0.2848397195339203,909.9564819335938,1e-05,0.07282897084951401,5.911896228790283,15.555094242095947,1 +2209,0.06541862338781357,0.046934932470321655,0.04695402458310127,0.2085336446762085,843.6281127929688,1e-05,0.08178026229143143,5.74707555770874,15.555094242095947,1 +2210,0.07975061982870102,0.13882751762866974,0.12673893570899963,0.25344550609588623,966.6818237304688,1e-05,0.05209711566567421,6.132033586502075,15.555094242095947,1 +2211,0.10122040659189224,0.043838560581207275,0.041461456567049026,0.21395832300186157,778.6576538085938,1e-05,0.07263481616973877,5.692573308944702,15.555094242095947,1 +2212,0.11100322753190994,0.06873426586389542,0.07046971470117569,0.21321313083171844,920.358642578125,1e-05,0.08729253709316254,5.704578876495361,15.555094242095947,1 +2213,0.07655651867389679,0.04413263499736786,0.04612082242965698,0.2325560748577118,767.7470092773438,1e-05,0.06052570044994354,5.691901922225952,15.555094242095947,1 +2214,0.10374174267053604,0.17627118527889252,0.16502362489700317,0.15167467296123505,979.9048461914062,1e-05,0.062462907284498215,5.6826088428497314,15.555094242095947,1 +2215,0.10235854238271713,0.10336614400148392,0.10402581095695496,0.2519551217556,573.5930786132812,1e-05,0.07989902794361115,5.688554048538208,15.555094242095947,1 +2216,0.04881318286061287,0.17100556194782257,0.16088758409023285,0.27754807472229004,973.9398803710938,1e-05,0.06186176463961601,5.690908432006836,15.555094242095947,1 +2217,0.06474964320659637,0.05336630716919899,0.054395318031311035,0.2686057686805725,864.6732177734375,1e-05,0.04985622689127922,5.694074630737305,15.555094242095947,1 +2218,0.08979092538356781,0.13510650396347046,0.12084260582923889,0.2601602375507355,978.9678955078125,1e-05,0.048042237758636475,5.679666042327881,15.555094242095947,1 +2219,0.10495180636644363,0.08300021290779114,0.07305953651666641,0.21236377954483032,889.1455078125,1e-05,0.07175164669752121,5.685696363449097,15.555094242095947,1 +2220,0.12277188897132874,0.08085472881793976,0.08512011170387268,0.28824517130851746,959.0316162109375,1e-05,0.08058629184961319,5.921221733093262,15.555094242095947,1 +2221,0.07995429635047913,0.1290152370929718,0.12251847982406616,0.11663461476564407,927.8350219726562,1e-05,0.05785416066646576,5.687827825546265,15.555094242095947,1 +2222,0.07686640322208405,0.08906161040067673,0.08864257484674454,0.20953525602817535,850.3836669921875,1e-05,0.08044356852769852,5.694795608520508,15.555094242095947,1 +2223,0.08694350719451904,0.06659448891878128,0.06516142189502716,0.26286858320236206,555.5556030273438,1e-05,0.08472367376089096,5.688943147659302,15.555094242095947,1 +2224,0.09205269813537598,0.5297168493270874,0.532689094543457,0.18719550967216492,48.076927185058594,1e-05,0.05739708989858627,5.752834796905518,15.555094242095947,1 +2225,0.060442663729190826,0.04188055917620659,0.041778672486543655,0.13081730902194977,894.4823608398438,1e-05,0.06830324977636337,5.691492795944214,15.555094242095947,1 +2226,0.09161461144685745,0.10333593189716339,0.09543408453464508,0.2530849277973175,965.6505737304688,1e-05,0.10379460453987122,5.684986591339111,15.555094242095947,1 +2227,0.14518438279628754,0.07344304025173187,0.06834787130355835,0.2334214597940445,757.8740844726562,1e-05,0.06277687847614288,5.689999341964722,15.555094242095947,1 +2228,0.10879793763160706,0.06625136733055115,0.0647653341293335,0.17040063440799713,590.71728515625,1e-05,0.0756387710571289,5.689754247665405,15.555094242095947,1 +2229,0.07153823226690292,0.2339286357164383,0.2361360639333725,0.29528042674064636,190.67796325683594,1e-05,0.06362031400203705,5.698460340499878,15.555094242095947,1 +2230,0.08491744846105576,0.0782141163945198,0.0728420689702034,0.2955528795719147,706.521728515625,1e-05,0.07391075789928436,5.6891701221466064,15.555094242095947,1 +2231,0.10723575204610825,0.07940119504928589,0.07971762865781784,0.2850080132484436,425.4617614746094,1e-05,0.05608634278178215,5.689197778701782,15.555094242095947,1 +2232,0.0549655482172966,0.1275457888841629,0.12420377135276794,0.22874197363853455,981.5291137695312,1e-05,0.06699857860803604,5.686256170272827,15.555094242095947,1 +2233,0.11672703921794891,0.10481864959001541,0.10070137679576874,0.26730766892433167,746.7793579101562,1e-05,0.06308897584676743,5.692172050476074,15.555094242095947,1 +2234,0.04884422570466995,0.13421466946601868,0.12628789246082306,0.19395031034946442,975.6365966796875,1e-05,0.07565366476774216,5.832720041275024,15.555094242095947,1 +2235,0.11101824045181274,0.12235052138566971,0.12329436838626862,0.18637017905712128,879.3001098632812,1e-05,0.07121742516756058,5.679443597793579,15.555094242095947,1 +2236,0.1164814904332161,0.09115533530712128,0.08189776539802551,0.2585656940937042,752.3885498046875,1e-05,0.06939247995615005,5.6858811378479,15.555094242095947,1 +2237,0.12906885147094727,0.046289242804050446,0.04752115160226822,0.17964743077754974,787.721923828125,1e-05,0.07588231563568115,5.680113315582275,15.555094242095947,1 +2238,0.04751868173480034,0.2461516559123993,0.24478983879089355,0.22056089341640472,993.642333984375,1e-05,0.06745736300945282,5.684922933578491,15.555094242095947,1 +2239,0.08426214009523392,0.02960703708231449,0.03246409818530083,0.11851762235164642,721.2352294921875,1e-05,0.06398572772741318,5.693678855895996,15.555094242095947,1 +2240,0.05990570783615112,0.14651097357273102,0.14653019607067108,0.28931888937950134,254.77706909179688,1e-05,0.05203819274902344,5.687343597412109,15.555094242095947,1 +2241,0.06658878922462463,0.06567519158124924,0.06139470636844635,0.25640222430229187,818.9655151367188,1e-05,0.0677807480096817,5.686868190765381,15.555094242095947,1 +2242,0.07989591360092163,0.05811231955885887,0.058711834251880646,0.2415063977241516,881.919921875,1e-05,0.07307049632072449,5.687033653259277,15.555094242095947,1 +2243,0.07302452623844147,0.10106811672449112,0.09640859067440033,0.23564903438091278,760.95458984375,1e-05,0.0547037348151207,5.686935186386108,15.555094242095947,1 +2244,0.1393028199672699,0.17258381843566895,0.1705574095249176,0.2987339496612549,228.7581787109375,1e-05,0.0672198012471199,5.710372686386108,15.555094242095947,1 +2245,0.09085771441459656,0.07516034692525864,0.07431799918413162,0.21256409585475922,834.44140625,1e-05,0.0771249309182167,5.785466194152832,15.555094242095947,1 +2246,0.07370291650295258,0.057989124208688736,0.058529410511255264,0.2474999874830246,885.7808837890625,1e-05,0.06108798086643219,5.68716025352478,15.555094242095947,1 +2247,0.13923168182373047,0.03800942748785019,0.037392325699329376,0.22413460910320282,865.6211547851562,1e-05,0.06553042680025101,5.686780214309692,15.555094242095947,1 +2248,0.048419490456581116,0.062359459698200226,0.0609036348760128,0.268894225358963,913.2543334960938,1e-05,0.057789821177721024,5.684850454330444,15.555094242095947,1 +2249,0.12666356563568115,0.08961532264947891,0.08058540523052216,0.18822915852069855,882.3529052734375,1e-05,0.123593270778656,5.685023069381714,15.555094242095947,1 +2250,0.0774325281381607,0.049381617456674576,0.045284371823072433,0.28196313977241516,817.7731323242188,1e-05,0.056263234466314316,5.685924291610718,15.555094242095947,1 +2251,0.056955352425575256,0.1273053139448166,0.11988870799541473,0.14536859095096588,969.7308959960938,1e-05,0.07483813911676407,5.705158948898315,15.555094242095947,1 +2252,0.057610005140304565,0.063270702958107,0.06758540868759155,0.10934294760227203,971.4794311523438,1e-05,0.1024884358048439,5.684448480606079,15.555094242095947,1 +2253,0.09197907149791718,0.09375051409006119,0.09390777349472046,0.28736376762390137,480.2955627441406,1e-05,0.07592098414897919,5.683442831039429,15.555094242095947,1 +2254,0.11646771430969238,0.09288428723812103,0.0910865068435669,0.2534855604171753,458.8607482910156,1e-05,0.0997319370508194,5.7406628131866455,15.555094242095947,1 +2255,0.12121609598398209,0.027969909831881523,0.026870617642998695,0.09612178802490234,618.6868286132812,1e-05,0.12429893016815186,5.945181131362915,15.555094242095947,1 +2256,0.1294051557779312,0.04382014274597168,0.0463159941136837,0.15868589282035828,963.3027954101562,1e-05,0.06304104626178741,5.711588621139526,15.555094242095947,1 +2257,0.04146324843168259,0.09094466269016266,0.08461824804544449,0.24549677968025208,935.2970581054688,1e-05,0.06171295791864395,5.691499471664429,15.555094242095947,1 +2258,0.05964430794119835,0.055522456765174866,0.052204430103302,0.30366986989974976,691.9642944335938,1e-05,0.10110728442668915,5.886048316955566,15.555094242095947,1 +2259,0.12294378131628036,0.047670770436525345,0.0515003502368927,0.23834934830665588,728.2971801757812,1e-05,0.10203558206558228,5.68712854385376,15.555094242095947,1 +2260,0.08904016017913818,0.13776983320713043,0.13519519567489624,0.22131408751010895,534.8970336914062,1e-05,0.05711432918906212,5.809571027755737,15.555094242095947,1 +2261,0.08378076553344727,0.057100676000118256,0.05726567655801773,0.24621793627738953,720.3389282226562,1e-05,0.07487615942955017,5.889649391174316,15.555094242095947,1 +2262,0.09518679976463318,0.08380204439163208,0.08451079577207565,0.1938782036304474,721.2352294921875,1e-05,0.12049178034067154,5.684455633163452,15.555094242095947,1 +2263,0.07399578392505646,0.12646566331386566,0.11471934616565704,0.24482370913028717,831.0991821289062,1e-05,0.06556974351406097,5.682187557220459,15.555094242095947,1 +2264,0.10189313441514969,0.07124187052249908,0.07226016372442245,0.09749198704957962,959.8422241210938,1e-05,0.06975942850112915,5.685409784317017,15.555094242095947,1 +2265,0.0951584205031395,0.25005555152893066,0.22832819819450378,0.22957530617713928,995.10595703125,1e-05,0.0769176185131073,5.68375563621521,15.555094242095947,1 +2266,0.09840147197246552,0.20806032419204712,0.20295237004756927,0.2821153700351715,179.79454040527344,1e-05,0.05315907299518585,5.679805040359497,15.555094242095947,1 +2267,0.10164887458086014,0.084832102060318,0.08349581807851791,0.2852884531021118,963.8278198242188,1e-05,0.04753720015287399,5.689538955688477,15.555094242095947,1 +2268,0.12039551883935928,0.053998518735170364,0.05289790406823158,0.25205928087234497,814.7632446289062,1e-05,0.06237372010946274,5.730148792266846,15.555094242095947,1 +2269,0.06906550377607346,0.11277035623788834,0.10815208405256271,0.25217947363853455,855.9268798828125,1e-05,0.05541669577360153,5.694733619689941,15.555094242095947,1 +2270,0.11306555569171906,0.05869613587856293,0.06231095269322395,0.17153845727443695,509.47869873046875,1e-05,0.0677214190363884,5.685738563537598,15.555094242095947,1 +2271,0.12329018115997314,0.0852559357881546,0.08034206926822662,0.2600240409374237,802.9328002929688,1e-05,0.06398864090442657,5.682451248168945,15.555094242095947,1 +2272,0.07791079580783844,0.10832300782203674,0.10336384922266006,0.2241666615009308,905.8369750976562,1e-05,0.08677563071250916,5.689088344573975,15.555094242095947,1 +2273,0.10730461031198502,0.14352910220623016,0.15427455306053162,0.26124998927116394,988.9306640625,1e-05,0.07660854607820511,5.681999921798706,15.555094242095947,1 +2274,0.07672026008367538,0.09139715135097504,0.08849187195301056,0.11102563887834549,812.9371337890625,1e-05,0.062151096761226654,5.68612813949585,15.555094242095947,1 +2275,0.08727458119392395,0.09775567054748535,0.09307806938886642,0.21869389712810516,948.9403076171875,1e-05,0.08113221079111099,5.6841888427734375,15.555094242095947,1 +2276,0.05607961118221283,0.2436027079820633,0.22223863005638123,0.2997435927391052,992.1616821289062,1e-05,0.08489232510328293,5.689834356307983,15.555094242095947,1 +2277,0.11370117217302322,0.21076853573322296,0.20915213227272034,0.12087339162826538,194.25677490234375,1e-05,0.0864265114068985,5.683069944381714,15.555094242095947,1 +2278,0.08446439355611801,0.06673719733953476,0.06123526394367218,0.2714983820915222,926.5010375976562,1e-05,0.1078474372625351,5.68879771232605,15.555094242095947,1 +2279,0.08944375813007355,0.10526085644960403,0.10912375152111053,0.10605768859386444,305.8912353515625,1e-05,0.07240299880504608,5.683668613433838,15.555094242095947,1 +2280,0.08648707717657089,0.061362020671367645,0.05716071277856827,0.23509614169597626,627.4900512695312,1e-05,0.06942390650510788,5.674740314483643,15.555094242095947,1 +2281,0.05180656164884567,0.2133859395980835,0.20192773640155792,0.20986376702785492,980.6033935546875,1e-05,0.10031799972057343,5.690542459487915,15.555094242095947,1 +2282,0.09769748151302338,0.12118824571371078,0.11839813739061356,0.20008012652397156,669.14501953125,1e-05,0.06548220664262772,6.600155353546143,15.555094242095947,1 +2283,0.10836133360862732,0.12062991410493851,0.12005092203617096,0.12004807591438293,895.6915893554688,1e-05,0.0698668360710144,5.702387571334839,15.555094242095947,1 +2284,0.06650596112012863,0.10661028325557709,0.10807148367166519,0.23227563500404358,935.6137084960938,1e-05,0.11403615027666092,5.700860023498535,15.555094242095947,1 +2285,0.06608156859874725,0.06882653385400772,0.06363605707883835,0.18542467057704926,798.4103393554688,1e-05,0.08040497452020645,5.6971235275268555,15.555094242095947,1 +2286,0.1335950493812561,0.276039183139801,0.2766587734222412,0.1046554446220398,176.11683654785156,1e-05,0.08582310378551483,5.698158502578735,15.555094242095947,1 +2287,0.08038875460624695,0.16178710758686066,0.1498943567276001,0.2606250047683716,988.9306640625,1e-05,0.09788602590560913,5.7041614055633545,15.555094242095947,1 +2288,0.08977772295475006,0.08732427656650543,0.08021687716245651,0.22403845191001892,807.9915161132812,1e-05,0.07072138041257858,5.697255611419678,15.555094242095947,1 +2289,0.12383805960416794,0.05804610624909401,0.05747124180197716,0.2641025483608246,916.8442993164062,1e-05,0.0692530944943428,5.693504333496094,15.555094242095947,1 +2290,0.10382163524627686,0.10804090648889542,0.10591689497232437,0.22451120615005493,319.94049072265625,1e-05,0.06655091047286987,5.68970799446106,15.555094242095947,1 +2291,0.10443937033414841,0.14977313578128815,0.142987459897995,0.17465543746948242,986.952880859375,1e-05,0.06263143569231033,5.699390172958374,15.555094242095947,1 +2292,0.0861196368932724,0.08810615539550781,0.0842604860663414,0.2177884578704834,757.0978393554688,1e-05,0.06533387303352356,5.709418058395386,15.555094242095947,1 +2293,0.06646851450204849,0.3804056644439697,0.34979313611984253,0.21548877656459808,998.592041015625,1e-05,0.06058120355010033,5.688695907592773,15.555094242095947,1 +2294,0.10866788029670715,0.10390636324882507,0.09535472095012665,0.20594550669193268,434.0730895996094,1e-05,0.06760749965906143,5.889163017272949,15.555094242095947,1 +2295,0.06800000369548798,0.07755985110998154,0.08750902861356735,0.18941505253314972,923.1171264648438,1e-05,0.06041156128048897,5.687882900238037,15.555094242095947,1 +2296,0.07309085130691528,0.14079338312149048,0.14083676040172577,0.21843749284744263,969.7308959960938,1e-05,0.0629885196685791,5.693009376525879,15.555094242095947,1 +2297,0.08957688510417938,0.09017009288072586,0.08850113302469254,0.21404646337032318,623.7474975585938,1e-05,0.0720951184630394,5.686433792114258,15.555094242095947,1 +2298,0.08565329760313034,0.07360638678073883,0.069186270236969,0.27109774947166443,840.9685668945312,1e-05,0.07334620505571365,5.904027223587036,15.555094242095947,1 +2299,0.11140270531177521,0.09773121774196625,0.10543995350599289,0.30937498807907104,372.1910095214844,1e-05,0.07275474071502686,5.843589544296265,15.555094242095947,1 +2300,0.08008264750242233,0.20628014206886292,0.19217920303344727,0.21543268859386444,992.58642578125,1e-05,0.06961724162101746,5.679015636444092,15.555094242095947,1 +2301,0.06663258373737335,0.10346727818250656,0.09920626878738403,0.3071955144405365,835.5437622070312,1e-05,0.0667261853814125,5.691665887832642,15.555094242095947,1 +2302,0.10960520803928375,0.09388698637485504,0.08905518054962158,0.22641825675964355,912.8910522460938,1e-05,0.06386589258909225,5.9245781898498535,15.555094242095947,1 +2303,0.11395812034606934,0.10935135930776596,0.1076919287443161,0.24587339162826538,333.5777282714844,1e-05,0.08539045602083206,5.680176734924316,15.555094242095947,1 +2304,0.1446210741996765,0.17647838592529297,0.17185480892658234,0.10408653318881989,359.68658447265625,1e-05,0.08126012235879898,5.6849305629730225,15.555094242095947,1 +2305,0.07862430810928345,0.08478062599897385,0.08313535898923874,0.2593509554862976,705.574951171875,1e-05,0.06509990990161896,5.6882007122039795,15.555094242095947,1 +2306,0.0952000692486763,0.04265926033258438,0.042242929339408875,0.12969550490379333,833.3333129882812,1e-05,0.07722387462854385,5.698005437850952,15.555094242095947,1 +2307,0.07035376876592636,0.08409948647022247,0.08079231530427933,0.24735575914382935,929.8156127929688,1e-05,0.07893244177103043,5.681951522827148,15.555094242095947,1 +2308,0.09114536643028259,0.09325462579727173,0.08942495286464691,0.12004807591438293,838.8157958984375,1e-05,0.08332754671573639,5.760307550430298,15.555094242095947,1 +2309,0.06696119904518127,0.06667034327983856,0.06941951811313629,0.24774838984012604,844.6821899414062,1e-05,0.05797608196735382,5.688175916671753,15.555094242095947,1 +2310,0.08135346323251724,0.11716656386852264,0.12391048669815063,0.22911056876182556,414.4384765625,1e-05,0.07055012136697769,5.6869401931762695,15.555094242095947,1 +2311,0.11632159352302551,0.09359463304281235,0.09410665929317474,0.24128204584121704,493.3414306640625,1e-05,0.09373728930950165,5.687369346618652,15.555094242095947,1 +2312,0.07310578227043152,0.10502699762582779,0.0997764840722084,0.23684294521808624,848.8447265625,1e-05,0.06366702914237976,5.683682918548584,15.555094242095947,1 +2313,0.0830521509051323,0.1369885951280594,0.1334385871887207,0.14659453928470612,932.7411499023438,1e-05,0.06435566395521164,5.684070348739624,15.555094242095947,1 +2314,0.05824027210474014,0.08015849441289902,0.0770551860332489,0.17327724397182465,903.5476684570312,1e-05,0.056302618235349655,5.689011812210083,15.555094242095947,1 +2315,0.1265321522951126,0.16450704634189606,0.16469456255435944,0.18185897171497345,346.82080078125,1e-05,0.09390591084957123,5.680030107498169,15.555094242095947,1 +2316,0.07475346326828003,0.0715222954750061,0.0714111179113388,0.2857612073421478,563.1868286132812,1e-05,0.06855206936597824,5.682511329650879,15.555094242095947,1 +2317,0.13238957524299622,0.20931054651737213,0.1929156631231308,0.15555287897586823,986.064208984375,1e-05,0.08658728003501892,5.693222522735596,15.555094242095947,2 +2318,0.11264778673648834,0.15413443744182587,0.15522468090057373,0.22159454226493835,965.3915405273438,1e-05,0.06844820082187653,5.684123992919922,15.555094242095947,2 +2319,0.07223758101463318,0.09746700525283813,0.09284205734729767,0.2586778700351715,872.1281127929688,1e-05,0.06925716251134872,5.678767919540405,15.555094242095947,2 +2320,0.09297492355108261,0.055339083075523376,0.058003537356853485,0.22138620913028717,789.0855712890625,1e-05,0.07450933754444122,5.678662300109863,15.555094242095947,2 +2321,0.08962243795394897,0.045046787708997726,0.047244369983673096,0.24584133923053741,785.6611938476562,1e-05,0.06817381829023361,5.684401273727417,15.555094242095947,2 +2322,0.04193522408604622,0.10586418956518173,0.09330135583877563,0.2223237156867981,945.1219482421875,1e-05,0.0699549987912178,5.6859681606292725,15.555094242095947,2 +2323,0.0785970464348793,0.08352037519216537,0.08193087577819824,0.19980768859386444,939.9801635742188,1e-05,0.07507283240556717,5.688470840454102,15.555094242095947,2 +2324,0.1040864810347557,0.09998678416013718,0.09841539710760117,0.20092947781085968,489.6593933105469,1e-05,0.07819154858589172,5.912717819213867,15.555094242095947,2 +2325,0.07474783807992935,0.17128317058086395,0.1608448177576065,0.26056888699531555,963.8278198242188,1e-05,0.06858498603105545,5.766351222991943,15.555094242095947,2 +2326,0.14339014887809753,0.0733383372426033,0.07020264863967896,0.1616426259279251,701.75439453125,1e-05,0.10463323444128036,5.700076580047607,15.555094242095947,2 +2327,0.1576482504606247,0.24571599066257477,0.24889929592609406,0.16613781452178955,157.3426513671875,1e-05,0.06716451793909073,5.692944765090942,15.555094242095947,2 +2328,0.0835670754313469,0.0943073108792305,0.09197736531496048,0.20499999821186066,884.5029296875,1e-05,0.058602746576070786,5.700559377670288,15.555094242095947,2 +2329,0.08493397384881973,0.20109954476356506,0.1838442087173462,0.23018428683280945,988.7123413085938,1e-05,0.06307462602853775,5.694232702255249,15.555094242095947,2 +2330,0.09959864616394043,0.10055430233478546,0.09525030851364136,0.23494389653205872,787.721923828125,1e-05,0.0798930749297142,5.6944899559021,15.555094242095947,2 +2331,0.07819315791130066,0.04946628212928772,0.047602396458387375,0.0792868584394455,779.3674926757812,1e-05,0.08998654037714005,5.696495532989502,15.555094242095947,2 +2332,0.08641673624515533,0.09554269909858704,0.09479463845491409,0.24918268620967865,637.2549438476562,1e-05,0.04985535517334938,5.697407484054565,15.555094242095947,2 +2333,0.08517510443925858,0.0788135752081871,0.07037551701068878,0.18360576033592224,821.9178466796875,1e-05,0.06880056858062744,5.698787212371826,15.555094242095947,2 +2334,0.09523764252662659,0.12460009008646011,0.12243378162384033,0.20117788016796112,352.0115051269531,1e-05,0.08054986596107483,5.697519302368164,15.555094242095947,2 +2335,0.07375501841306686,0.09136843681335449,0.09027407318353653,0.20758011937141418,904.3141479492188,1e-05,0.08585356175899506,5.705371141433716,15.555094242095947,2 +2336,0.07976255565881729,0.10077349096536636,0.10142840445041656,0.13489583134651184,772.1712036132812,1e-05,0.06582603603601456,5.68245792388916,15.555094242095947,2 +2337,0.07879810780286789,0.13277274370193481,0.1293800175189972,0.15661858022212982,955.4664916992188,1e-05,0.08645841479301453,5.708556413650513,15.555094242095947,2 +2338,0.10933437198400497,0.08833373337984085,0.08581098914146423,0.2702884376049042,452.8061218261719,1e-05,0.10353317111730576,5.706491470336914,15.555094242095947,2 +2339,0.06763681769371033,0.10088557749986649,0.0935126394033432,0.24665063619613647,572.1257934570312,1e-05,0.054461851716041565,5.6969499588012695,15.555094242095947,2 +2340,0.07769802212715149,0.08587442338466644,0.07785385847091675,0.2408493459224701,921.7437133789062,1e-05,0.10101640969514847,5.701911449432373,15.555094242095947,2 +2341,0.10729265958070755,0.044552210718393326,0.04474160447716713,0.16661858558654785,817.174560546875,1e-05,0.09425392746925354,5.694250583648682,15.555094242095947,2 +2342,0.07360369712114334,0.15568840503692627,0.15323063731193542,0.22777242958545685,964.872314453125,1e-05,0.04851231724023819,5.798665761947632,15.555094242095947,2 +2343,0.10785175859928131,0.06300988048315048,0.06329720467329025,0.20836538076400757,797.7569580078125,1e-05,0.09647519886493683,5.688797950744629,15.555094242095947,2 +2344,0.10968852788209915,0.07612910121679306,0.07265692949295044,0.17560096085071564,865.6211547851562,1e-05,0.09075695276260376,5.692023992538452,15.555094242095947,2 +2345,0.07486917078495026,0.059594832360744476,0.05849972367286682,0.14600159227848053,840.4324951171875,1e-05,0.057778529822826385,6.030162811279297,15.555094242095947,2 +2346,0.06535634398460388,0.1001250296831131,0.10116714239120483,0.2748797833919525,828.2725830078125,1e-05,0.056611187756061554,5.687119007110596,15.555094242095947,2 +2347,0.10222239047288895,0.24095959961414337,0.24185895919799805,0.2776922881603241,133.9285888671875,1e-05,0.1424509435892105,5.688035249710083,15.555094242095947,2 +2348,0.11694163829088211,0.12102092802524567,0.13069257140159607,0.20242787897586823,519.8598022460938,1e-05,0.08347954601049423,5.699260950088501,15.555094242095947,2 +2349,0.06367850303649902,0.04246998578310013,0.04654973745346069,0.2742307484149933,876.6427001953125,1e-05,0.07644107192754745,5.687438249588013,15.555094242095947,2 +2350,0.06433131545782089,0.05943712219595909,0.05729285627603531,0.22254806756973267,802.9328002929688,1e-05,0.08632791042327881,5.706367015838623,15.555094242095947,2 +2351,0.10888401418924332,0.16034278273582458,0.14552418887615204,0.2177884578704834,985.8411254882812,1e-05,0.12211862206459045,5.69368839263916,15.555094242095947,2 +2352,0.09699203073978424,0.06484821438789368,0.06335917115211487,0.27522435784339905,831.6600341796875,1e-05,0.06852735579013824,5.943500757217407,15.555094242095947,2 +2353,0.079266756772995,0.07478047907352448,0.07241827249526978,0.22544069588184357,829.9730834960938,1e-05,0.10790807008743286,5.700875282287598,15.555094242095947,2 +2354,0.07546272873878479,0.12039412558078766,0.11845297366380692,0.1316586434841156,460.8586120605469,1e-05,0.08605941385030746,5.696695327758789,15.555094242095947,2 +2355,0.09503361582756042,0.07003019750118256,0.06681443750858307,0.1861458271741867,531.6091918945312,1e-05,0.0561857707798481,5.693809509277344,15.555094242095947,2 +2356,0.06748248636722565,0.07209528982639313,0.07234819233417511,0.26018428802490234,853.9290161132812,1e-05,0.05934148281812668,5.6976799964904785,15.555094242095947,2 +2357,0.12988094985485077,0.19291891157627106,0.1977786272764206,0.22623395919799805,129.92831420898438,1e-05,0.08020675182342529,5.6878392696380615,15.555094242095947,2 +2358,0.06564618647098541,0.17427104711532593,0.1605236977338791,0.2272515892982483,993.2210693359375,1e-05,0.057585880160331726,5.6926515102386475,15.555094242095947,2 +2359,0.11698749661445618,0.12066624313592911,0.12384854257106781,0.10563300549983978,267.29559326171875,1e-05,0.06244570389389992,5.691773891448975,15.555094242095947,2 +2360,0.07276124507188797,0.08293934911489487,0.07750827819108963,0.16585735976696014,770.7055053710938,1e-05,0.06946072727441788,5.693057537078857,15.555094242095947,2 +2361,0.07271108031272888,0.05707466974854469,0.05425311625003815,0.10745993256568909,597.59912109375,1e-05,0.04999389499425888,5.712579965591431,15.555094242095947,2 +2362,0.07790766656398773,0.09508690983057022,0.0869734063744545,0.25547274947166443,955.188720703125,1e-05,0.06900729984045029,5.867201805114746,15.555094242095947,2 +2363,0.09527587890625,0.05268978327512741,0.05189541354775429,0.17493589222431183,654.7619018554688,1e-05,0.06835003197193146,5.682910919189453,15.555094242095947,2 +2364,0.05681582912802696,0.056651562452316284,0.05377989262342453,0.20180287957191467,829.9730834960938,1e-05,0.07292913645505905,5.685883283615112,15.555094242095947,2 +2365,0.08415406197309494,0.07081659883260727,0.07583501935005188,0.17936697602272034,964.0897216796875,1e-05,0.05983048677444458,5.688462734222412,15.555094242095947,2 +2366,0.13068030774593353,0.07873958349227905,0.07159034162759781,0.274959921836853,949.5192260742188,1e-05,0.07423289120197296,5.683229446411133,15.555094242095947,2 +2367,0.0736595094203949,0.0712646022439003,0.06948171555995941,0.20924678444862366,877.0883178710938,1e-05,0.055559948086738586,5.683840274810791,15.555094242095947,2 +2368,0.057268936187028885,0.06179877743124962,0.06037776917219162,0.26838940382003784,870.2915649414062,1e-05,0.04746489226818085,5.684518575668335,15.555094242095947,2 +2369,0.10541416704654694,0.07162073254585266,0.06528324633836746,0.2014903724193573,855.9268798828125,1e-05,0.06434520334005356,5.681424617767334,15.555094242095947,2 +2370,0.08654877543449402,0.08206090331077576,0.07972478121519089,0.30405446887016296,831.0991821289062,1e-05,0.05662073940038681,5.689549684524536,15.555094242095947,2 +2371,0.10532693564891815,0.0651567354798317,0.06302664428949356,0.15358974039554596,606.9959106445312,1e-05,0.05944821983575821,5.686708688735962,15.555094242095947,2 +2372,0.08456171303987503,0.024971360340714455,0.026162246242165565,0.12988781929016113,932.7411499023438,1e-05,0.054181139916181564,5.680883884429932,15.555094242095947,2 +2373,0.1242707297205925,0.04904639348387718,0.048030704259872437,0.2754567265510559,846.7742309570312,1e-05,0.06815924495458603,5.6978349685668945,15.555094242095947,2 +2374,0.15043625235557556,0.47535309195518494,0.4779653251171112,0.23589742183685303,52.6819953918457,1e-05,0.05301004648208618,5.9073097705841064,15.555094242095947,2 +2375,0.0646834447979927,0.6706029176712036,0.6775887608528137,0.13766025006771088,29.296875,1e-05,0.053884830325841904,5.69539213180542,15.555094242095947,2 +2376,0.07308401167392731,0.09726358205080032,0.09873717278242111,0.27398237586021423,965.3915405273438,1e-05,0.051967769861221313,5.6824119091033936,15.555094242095947,2 +2377,0.08403896540403366,0.1305902898311615,0.12688705325126648,0.2476842850446701,988.9306640625,1e-05,0.08266903460025787,5.6933205127716064,15.555094242095947,2 +2378,0.03398461639881134,0.11967267841100693,0.10950490087270737,0.2581089735031128,924.4791870117188,1e-05,0.05617887154221535,5.688148021697998,15.555094242095947,2 +2379,0.13861581683158875,0.047358378767967224,0.04730398207902908,0.28621792793273926,811.7109985351562,1e-05,0.068817138671875,5.6800453662872314,15.555094242095947,2 +2380,0.07562405616044998,0.06056508794426918,0.06516876816749573,0.2984134554862976,942.4212036132812,1e-05,0.0683387890458107,5.69088339805603,15.555094242095947,2 +2381,0.06546652317047119,0.036284640431404114,0.041637953370809555,0.19102562963962555,412.1983947753906,1e-05,0.06399166584014893,5.6849119663238525,15.555094242095947,2 +2382,0.08591928333044052,0.08845127373933792,0.08557914197444916,0.18455928564071655,901.2276611328125,1e-05,0.06544727832078934,5.6850950717926025,15.555094242095947,2 +2383,0.08213627338409424,0.09843885898590088,0.09561393409967422,0.11648236960172653,921.7437133789062,1e-05,0.06983783841133118,5.688961029052734,15.555094242095947,2 +2384,0.09658176451921463,0.08573488891124725,0.07675933837890625,0.2098717838525772,895.2894897460938,1e-05,0.07122056186199188,5.974608421325684,15.555094242095947,2 +2385,0.10690683871507645,0.09628523141145706,0.08858641982078552,0.2348637729883194,575.0540771484375,1e-05,0.06725861132144928,5.6844751834869385,15.555094242095947,2 +2386,0.05524776130914688,0.023361878469586372,0.02457991987466812,0.09696313738822937,850.3836669921875,1e-05,0.0635443702340126,5.6841654777526855,15.555094242095947,2 +2387,0.09255315363407135,0.075902558863163,0.07822991162538528,0.23241184651851654,960.1112060546875,1e-05,0.07489021122455597,5.791852951049805,15.555094242095947,2 +2388,0.08044548332691193,0.08898145705461502,0.0830674022436142,0.2733413279056549,957.9439697265625,1e-05,0.07320618629455566,5.7889509201049805,15.555094242095947,2 +2389,0.11589720845222473,0.09634000062942505,0.09513852745294571,0.23828524351119995,462.8463439941406,1e-05,0.0702081248164177,5.687530994415283,15.555094242095947,2 +2390,0.08257200568914413,0.0862608551979065,0.08046167343854904,0.23876601457595825,814.15625,1e-05,0.054120514541864395,5.696608781814575,15.555094242095947,2 +2391,0.08599313348531723,0.146051287651062,0.14885833859443665,0.1483333259820938,288.4615478515625,1e-05,0.05367416515946388,5.685665130615234,15.555094242095947,2 +2392,0.09552257508039474,0.08495840430259705,0.08122813701629639,0.18289262056350708,940.5940551757812,1e-05,0.07539168000221252,5.853219985961914,15.555094242095947,2 +2393,0.09640686213970184,0.10658281296491623,0.100613534450531,0.2667147219181061,816.57421875,1e-05,0.051518287509679794,5.685459852218628,15.555094242095947,2 +2394,0.09687449038028717,0.0951562225818634,0.09860542416572571,0.24928684532642365,491.5048522949219,1e-05,0.05922044441103935,5.700660467147827,15.555094242095947,2 +2395,0.13037201762199402,0.062008295208215714,0.06314422190189362,0.22846953570842743,612.2449340820312,1e-05,0.07831927388906479,5.6906633377075195,15.555094242095947,2 +2396,0.05963728576898575,0.10581956058740616,0.10301019996404648,0.21548877656459808,792.4597778320312,1e-05,0.2744710147380829,5.692285537719727,15.555094242095947,2 +2397,0.07851728051900864,0.1247299313545227,0.12407554686069489,0.12467146664857864,991.52197265625,1e-05,0.0535166971385479,5.681573152542114,15.555094242095947,2 +2398,0.0974348932504654,0.09003877639770508,0.0926087498664856,0.14608973264694214,485.94134521484375,1e-05,0.07227765768766403,5.925040245056152,15.555094242095947,2 +2399,0.06332128494977951,0.07309618592262268,0.06766395270824432,0.2084214687347412,867.5030517578125,1e-05,0.11986670643091202,5.684866905212402,15.555094242095947,2 +2400,0.07549149543046951,0.0857468694448471,0.08301018923521042,0.2274439036846161,885.3558349609375,1e-05,0.08359067887067795,5.686594247817993,15.555094242095947,2 +2401,0.1075812429189682,0.044885072857141495,0.045181889086961746,0.13412660360336304,904.6961059570312,1e-05,0.10231782495975494,5.70122766494751,15.555094242095947,2 +2402,0.06568644195795059,0.21980667114257812,0.2232237458229065,0.09874198585748672,993.0098266601562,1e-05,0.13457758724689484,5.694900751113892,15.555094242095947,2 +2403,0.08840221166610718,0.09505434334278107,0.09052226692438126,0.22273236513137817,412.1983947753906,1e-05,0.07863599807024002,5.686288356781006,15.555094242095947,2 +2404,0.10196925699710846,0.15117967128753662,0.14541466534137726,0.26095351576805115,291.41107177734375,1e-05,0.09743156284093857,5.764874696731567,15.555094242095947,2 +2405,0.08723006397485733,0.057212017476558685,0.05544733256101608,0.21259614825248718,730.0333251953125,1e-05,0.08430888503789902,5.751454591751099,15.555094242095947,2 +2406,0.14095495641231537,0.08176711946725845,0.07864542305469513,0.2136297971010208,878.4185791015625,1e-05,0.08591707050800323,5.693526983261108,15.555094242095947,2 +2407,0.08834540843963623,0.1294393092393875,0.1176929920911789,0.25391826033592224,932.0956420898438,1e-05,0.06989981234073639,5.695946455001831,15.555094242095947,2 +2408,0.08436235785484314,0.0795656219124794,0.07452511787414551,0.22158652544021606,505.9523620605469,1e-05,0.06704773753881454,5.679028749465942,15.555094242095947,2 +2409,0.10917965322732925,0.0810263529419899,0.07729240506887436,0.12149038165807724,764.7515258789062,1e-05,0.0963473692536354,5.85893177986145,15.555094242095947,2 +2410,0.0880618542432785,0.0958225429058075,0.09066316485404968,0.2811618447303772,629.9603271484375,1e-05,0.09308219701051712,5.685495376586914,15.555094242095947,2 +2411,0.09485732018947601,0.041898518800735474,0.04574674740433693,0.1943589597940445,713.0584106445312,1e-05,0.0725005492568016,5.6859729290008545,15.555094242095947,2 +2412,0.1008833721280098,0.12301383167505264,0.1191757544875145,0.2503044903278351,660.3773803710938,1e-05,0.08500741422176361,5.698673486709595,15.555094242095947,2 +2413,0.09406302124261856,0.03815101087093353,0.03633926436305046,0.1643429398536682,617.4088745117188,1e-05,0.07684526592493057,5.6878132820129395,15.555094242095947,2 +2414,0.06681866943836212,0.07490482926368713,0.07103990763425827,0.2568429410457611,887.4710083007812,1e-05,0.05630763992667198,5.909294128417969,15.555094242095947,2 +2415,0.084607794880867,0.06534037739038467,0.07071376591920853,0.1088942289352417,279.50311279296875,1e-05,0.08192284405231476,5.923495292663574,15.555094242095947,2 +2416,0.08347072452306747,0.06735580414533615,0.06474222987890244,0.26839742064476013,908.4699096679688,1e-05,0.06607729196548462,5.672722578048706,15.555094242095947,2 +2417,0.09259413182735443,0.16898342967033386,0.15245755016803741,0.27359774708747864,981.0671997070312,1e-05,0.06530483812093735,5.680976867675781,15.555094242095947,2 +2418,0.06732027977705002,0.0744573250412941,0.07659333199262619,0.2440144121646881,928.4979858398438,1e-05,0.05825645849108696,5.684410572052002,15.555094242095947,2 +2419,0.07070343941450119,0.05299359932541847,0.05698186159133911,0.2062179446220398,834.9933471679688,1e-05,0.05675716698169708,5.681177616119385,15.555094242095947,2 +2420,0.0626988336443901,0.1722801774740219,0.16687500476837158,0.22552081942558289,968.468505859375,1e-05,0.05383797362446785,5.685769319534302,15.555094242095947,2 +2421,0.07353928685188293,0.13103842735290527,0.12000611424446106,0.21666665375232697,957.9439697265625,1e-05,0.0715252235531807,5.693039417266846,15.555094242095947,2 +2422,0.07685988396406174,0.11177510768175125,0.1114957183599472,0.20271633565425873,963.5654907226562,1e-05,0.0599483884871006,5.684142589569092,15.555094242095947,2 +2423,0.04620204493403435,0.0696415975689888,0.06696697324514389,0.21040062606334686,505.9523620605469,1e-05,0.05096431076526642,5.687029123306274,15.555094242095947,2 +2424,0.11486351490020752,0.11066402494907379,0.10617411881685257,0.21302883327007294,893.2648315429688,1e-05,0.07497560977935791,5.6886420249938965,15.555094242095947,2 +2425,0.04220926761627197,0.04421553015708923,0.04149404540657997,0.07663461565971375,848.8447265625,1e-05,0.06654462963342667,5.688885450363159,15.555094242095947,2 +2426,0.08001053333282471,0.10491641610860825,0.09991282224655151,0.24436697363853455,691.9642944335938,1e-05,0.07839343696832657,5.6882545948028564,15.555094242095947,2 +2427,0.07759948074817657,0.06976459920406342,0.06630752235651016,0.1371554434299469,782.8849487304688,1e-05,0.061286911368370056,5.6984803676605225,15.555094242095947,2 +2428,0.13741566240787506,0.0757097527384758,0.073837511241436,0.2357371747493744,625.0,1e-05,0.07497430592775345,5.890471696853638,15.555094242095947,2 +2429,0.09933798760175705,0.09266726672649384,0.09123256802558899,0.2249358892440796,898.8763427734375,1e-05,0.0658232718706131,5.689893007278442,15.555094242095947,2 +2430,0.07915385067462921,0.13261276483535767,0.12018284201622009,0.2549038231372833,930.7967529296875,1e-05,0.0749911442399025,5.682051181793213,15.555094242095947,2 +2431,0.12463431060314178,0.08612880110740662,0.08293042331933975,0.24562498927116394,900.4474487304688,1e-05,0.06539864093065262,5.686868190765381,15.555094242095947,2 +2432,0.0972236916422844,0.059097930788993835,0.05704318359494209,0.20840543508529663,817.174560546875,1e-05,0.06849736720323563,5.682743072509766,15.555094242095947,2 +2433,0.11507575213909149,0.04584585875272751,0.04417474940419197,0.20829325914382935,604.3388061523438,1e-05,0.08691032975912094,5.691150665283203,15.555094242095947,2 +2434,0.08300495147705078,0.0667969286441803,0.06422673910856247,0.25207531452178955,793.795654296875,1e-05,0.06632760167121887,5.6886773109436035,15.555094242095947,2 +2435,0.11529698967933655,0.27193909883499146,0.25898370146751404,0.298028826713562,164.93057250976562,1e-05,0.07600825279951096,5.685739517211914,15.555094242095947,2 +2436,0.05586197227239609,0.10568030178546906,0.10405328869819641,0.2301442176103592,943.62744140625,1e-05,0.05632151663303375,6.290001153945923,15.555094242095947,2 +2437,0.11671589314937592,0.09043683111667633,0.08715378493070602,0.213365375995636,777.2314453125,1e-05,0.0853869840502739,5.676204681396484,15.555094242095947,2 +2438,0.09594929963350296,0.07538029551506042,0.07002852857112885,0.22833332419395447,826.5582275390625,1e-05,0.05880644544959068,5.68480372428894,15.555094242095947,2 +2439,0.08515758067369461,0.09541521221399307,0.08613504469394684,0.2641666531562805,857.9046020507812,1e-05,0.07137183845043182,5.681807279586792,15.555094242095947,2 +2440,0.06592503935098648,0.0842694565653801,0.07767708599567413,0.26479166746139526,905.8369750976562,1e-05,0.0742335319519043,5.8853654861450195,15.555094242095947,2 +2441,0.09944520890712738,0.08644445240497589,0.08110623806715012,0.22644229233264923,948.3590698242188,1e-05,0.05887210741639137,5.689818620681763,15.555094242095947,2 +2442,0.10110664367675781,0.23396365344524384,0.2096288949251175,0.22584934532642365,999.1974487304688,1e-05,0.0643855556845665,5.830054998397827,15.555094242095947,2 +2443,0.0609469935297966,0.05513253062963486,0.055236369371414185,0.12368589639663696,934.6619262695312,1e-05,0.06888696551322937,5.688404083251953,15.555094242095947,2 +2444,0.10102851688861847,0.0709882453083992,0.07140439748764038,0.2704727351665497,796.4441528320312,1e-05,0.07374919205904007,5.682127952575684,15.555094242095947,2 +2445,0.07492745667695999,0.06205025315284729,0.06331007927656174,0.29260414838790894,696.9026489257812,1e-05,0.05485719442367554,5.689526557922363,15.555094242095947,2 +2446,0.11525070667266846,0.08327384293079376,0.08487778902053833,0.16971153020858765,832.777099609375,1e-05,0.08275454491376877,5.689478635787964,15.555094242095947,2 +2447,0.0730317011475563,0.08548703044652939,0.08392256498336792,0.227035254240036,936.5596923828125,1e-05,0.09611339867115021,5.687997579574585,15.555094242095947,2 +2448,0.08312923461198807,0.4019888639450073,0.42588725686073303,0.23944710195064545,66.28787994384766,1e-05,0.056370556354522705,5.681493043899536,15.555094242095947,2 +2449,0.07763023674488068,0.07969234138727188,0.07350245863199234,0.2125801146030426,781.4841918945312,1e-05,0.09353838115930557,5.6883134841918945,15.555094242095947,2 +2450,0.053914476186037064,0.08419620990753174,0.08157683163881302,0.1756249964237213,921.0526123046875,1e-05,0.057714637368917465,5.691770553588867,15.555094242095947,2 +2451,0.06537748873233795,0.08859579265117645,0.0971197783946991,0.2184615284204483,273.4375,1e-05,0.06835901737213135,5.6862852573394775,15.555094242095947,2 +2452,0.11818014085292816,0.08498955518007278,0.0789601132273674,0.20463140308856964,529.9539794921875,1e-05,0.07186877727508545,5.704872131347656,15.555094242095947,2 +2453,0.10384955257177353,0.07103531807661057,0.06899535655975342,0.22924678027629852,887.0499877929688,1e-05,0.06679879128932953,5.6898980140686035,15.555094242095947,2 +2454,0.08471397310495377,0.15384584665298462,0.14493797719478607,0.28324517607688904,946.896240234375,1e-05,0.05806322395801544,5.6891093254089355,15.555094242095947,2 +2455,0.1370854377746582,0.20786769688129425,0.20717084407806396,0.10420672595500946,238.6731414794922,1e-05,0.056558914482593536,5.684000253677368,15.555094242095947,2 +2456,0.11601419746875763,0.09828931093215942,0.09862187504768372,0.17249999940395355,825.9837646484375,1e-05,0.06526871770620346,5.685586929321289,15.555094242095947,2 +2457,0.11066098511219025,0.07218915224075317,0.0721048042178154,0.1634935885667801,942.4212036132812,1e-05,0.06233381852507591,6.140057325363159,15.555094242095947,2 +2458,0.10453036427497864,0.11566155403852463,0.11378000676631927,0.26548075675964355,407.6819763183594,1e-05,0.07074379920959473,5.6833882331848145,15.555094242095947,2 +2459,0.11237075179815292,0.07958149909973145,0.07752086222171783,0.2504086494445801,521.561767578125,1e-05,0.05588393285870552,5.6903111934661865,15.555094242095947,2 +2460,0.055780913680791855,0.0806046798825264,0.07229021936655045,0.2516586482524872,894.4823608398438,1e-05,0.05577199533581734,5.690508127212524,15.555094242095947,2 +2461,0.08159857988357544,0.05125756561756134,0.053926046937704086,0.17173075675964355,965.3915405273438,1e-05,0.05964056774973869,5.694788217544556,15.555094242095947,2 +2462,0.07253129035234451,0.07423478364944458,0.06699952483177185,0.21206730604171753,945.1219482421875,1e-05,0.054913412779569626,5.686990022659302,15.555094242095947,2 +2463,0.08028899878263474,0.04566500708460808,0.04840152710676193,0.06532852351665497,416.6666564941406,1e-05,0.06786906719207764,5.678904294967651,15.555094242095947,2 +2464,0.04042688012123108,0.04409867525100708,0.042766273021698,0.22883813083171844,963.8278198242188,1e-05,0.08343339711427689,5.693375587463379,15.555094242095947,2 +2465,0.1121884137392044,0.1685991883277893,0.17833903431892395,0.27512818574905396,117.75362396240234,1e-05,0.0711737647652626,5.690066337585449,15.555094242095947,2 +2466,0.0741114392876625,0.08160902559757233,0.07968573272228241,0.09574519097805023,604.3388061523438,1e-05,0.07043445110321045,5.687894821166992,15.555094242095947,2 +2467,0.058201927691698074,0.08210798352956772,0.07872503995895386,0.2956490218639374,880.177490234375,1e-05,0.08326209336519241,5.693577289581299,15.555094242095947,2 +2468,0.05673949420452118,0.159368634223938,0.16375732421875,0.14456729590892792,979.9048461914062,1e-05,0.06138306483626366,5.704240798950195,15.555094242095947,2 +2469,0.10347598046064377,0.04359683766961098,0.046284500509500504,0.2423797994852066,681.8181762695312,1e-05,0.06889425963163376,5.683549165725708,15.555094242095947,2 +2470,0.10738837718963623,0.15944840013980865,0.16225773096084595,0.28834134340286255,179.79454040527344,1e-05,0.07274949550628662,5.684534311294556,15.555094242095947,2 +2471,0.08024628460407257,0.07110375165939331,0.06985709071159363,0.22766825556755066,904.3141479492188,1e-05,0.06734124571084976,5.6888298988342285,15.555094242095947,2 +2472,0.05052705481648445,0.08456023782491684,0.08472951501607895,0.18873396515846252,752.3885498046875,1e-05,0.06409687548875809,5.936246633529663,15.555094242095947,2 +2473,0.1224261000752449,0.06786365061998367,0.0636124461889267,0.24795672297477722,603.0020751953125,1e-05,0.0908064916729927,5.69295334815979,15.555094242095947,2 +2474,0.09215452522039413,0.2349107712507248,0.21239595115184784,0.25159454345703125,987.615478515625,1e-05,0.06520900130271912,5.692110300064087,15.555094242095947,2 +2475,0.07138927280902863,0.1041388139128685,0.09704899042844772,0.2472115308046341,868.9024658203125,1e-05,0.07282164692878723,5.694579124450684,15.555094242095947,2 +2476,0.13820448517799377,0.06854292750358582,0.06425541639328003,0.28611376881599426,931.447509765625,1e-05,0.07499098032712936,5.918407917022705,15.555094242095947,2 +2477,0.07958655804395676,0.10164456069469452,0.0964207872748375,0.2294711470603943,750.7987060546875,1e-05,0.050645533949136734,5.689726114273071,15.555094242095947,2 +2478,0.07808518409729004,0.09940704703330994,0.09458032995462418,0.2617467939853668,969.7308959960938,1e-05,0.08482669293880463,6.05985426902771,15.555094242095947,2 +2479,0.05333956331014633,0.10396813601255417,0.09532514214515686,0.2604166567325592,856.9182739257812,1e-05,0.06011096388101578,5.684836149215698,15.555094242095947,2 +2480,0.09050297737121582,0.0822957307100296,0.07803410291671753,0.19026441872119904,729.1666870117188,1e-05,0.05849133059382439,5.802528381347656,15.555094242095947,2 +2481,0.1589779108762741,0.07687202095985413,0.07196760177612305,0.28496792912483215,629.9603271484375,1e-05,0.07429482787847519,5.684568166732788,15.555094242095947,2 +2482,0.11649607867002487,0.03465961292386055,0.03900165110826492,0.20566505193710327,662.593994140625,1e-05,0.07561637461185455,5.69107460975647,15.555094242095947,2 +2483,0.12080783396959305,0.05080665647983551,0.04966389760375023,0.16544069349765778,612.2449340820312,1e-05,0.08169812709093094,5.690452337265015,15.555094242095947,2 +2484,0.08762666583061218,0.06308811157941818,0.06259309500455856,0.2565625011920929,875.2998046875,1e-05,0.05698183551430702,5.693394899368286,15.555094242095947,2 +2485,0.04249448701739311,0.05747610703110695,0.057447295635938644,0.2003285139799118,839.89501953125,1e-05,0.08637647330760956,5.706019163131714,15.555094242095947,2 +2486,0.09915763139724731,0.07191666960716248,0.07816346734762192,0.2563621699810028,903.5476684570312,1e-05,0.06931570172309875,5.688657999038696,15.555094242095947,2 +2487,0.1031668484210968,0.0743553563952446,0.07653345167636871,0.18560896813869476,889.1455078125,1e-05,0.10269258916378021,5.727137565612793,15.555094242095947,2 +2488,0.07988634705543518,0.06135037913918495,0.05747354030609131,0.22991184890270233,809.2384033203125,1e-05,0.0847453624010086,5.694913387298584,15.555094242095947,2 +2489,0.13751693069934845,0.1128634512424469,0.11305122077465057,0.260817289352417,291.41107177734375,1e-05,0.07289353013038635,5.714056015014648,15.555094242095947,2 +2490,0.10413156449794769,0.05228789895772934,0.05034201964735985,0.18189102411270142,606.9959106445312,1e-05,0.07393793016672134,5.695363283157349,15.555094242095947,2 +2491,0.06123364716768265,0.06648890674114227,0.06428219377994537,0.23377403616905212,886.6278686523438,1e-05,0.07164052873849869,5.6955671310424805,15.555094242095947,2 +2492,0.08057144284248352,0.11006022244691849,0.10976714640855789,0.17985576391220093,357.1428527832031,1e-05,0.07223077118396759,5.692937850952148,15.555094242095947,2 +2493,0.06784549355506897,0.10204687714576721,0.09319906681776047,0.25283652544021606,873.947021484375,1e-05,0.05816615745425224,5.700327396392822,15.555094242095947,2 +2494,0.05713241547346115,0.06533326953649521,0.0635945126414299,0.2910096049308777,886.6278686523438,1e-05,0.0666317269206047,5.689368724822998,15.555094242095947,2 +2495,0.10360223799943924,0.08508013933897018,0.08590523898601532,0.2358333319425583,939.36376953125,1e-05,0.07358826696872711,5.679062843322754,15.555094242095947,2 +2496,0.08701056241989136,0.05521416291594505,0.05842847377061844,0.10902243107557297,687.94970703125,1e-05,0.05939779803156853,5.686448097229004,15.555094242095947,2 +2497,0.09391436725854874,0.08449901640415192,0.08120641857385635,0.20877403020858765,911.0628662109375,1e-05,0.08201250433921814,5.680893182754517,15.555094242095947,2 +2498,0.08891500532627106,0.07023362070322037,0.06746432930231094,0.27935895323753357,866.564453125,1e-05,0.06819986552000046,5.821624040603638,15.555094242095947,2 +2499,0.06093881279230118,0.10201067477464676,0.0989375039935112,0.20986376702785492,886.2048950195312,1e-05,0.05196012184023857,5.896768093109131,15.555094242095947,2 +2500,0.07646801322698593,0.08940660953521729,0.08828385919332504,0.19349358975887299,844.6821899414062,1e-05,0.061326008290052414,5.781021595001221,15.555094242095947,2 +2501,0.09622255712747574,0.08071620762348175,0.0793805941939354,0.29480767250061035,831.0991821289062,1e-05,0.06809122115373611,5.681390047073364,15.555094242095947,2 +2502,0.05277225375175476,0.0412820465862751,0.04335033521056175,0.1493990272283554,947.4830322265625,1e-05,0.0725405216217041,5.701132297515869,15.555094242095947,2 +2503,0.09012004733085632,0.1619531512260437,0.15926918387413025,0.2528685927391052,245.17686462402344,1e-05,0.0486019067466259,5.8872528076171875,15.555094242095947,2 +2504,0.05540144443511963,0.10474823415279388,0.09765638411045074,0.2606250047683716,945.4190673828125,1e-05,0.06682924926280975,5.695058584213257,15.555094242095947,2 +2505,0.08315026015043259,0.07372336834669113,0.07512116432189941,0.16102562844753265,898.4814453125,1e-05,0.0894358828663826,5.694806337356567,15.555094242095947,2 +2506,0.0697992742061615,0.1266421228647232,0.12109361588954926,0.17547275125980377,964.3510131835938,1e-05,0.055554844439029694,5.6953465938568115,15.555094242095947,2 +2507,0.10903946310281754,0.06368386745452881,0.06153007969260216,0.23027242720127106,660.3773803710938,1e-05,0.05603397265076637,5.693196773529053,15.555094242095947,2 +2508,0.11455805599689484,0.1637098789215088,0.15699897706508636,0.24607370793819427,357.1428527832031,1e-05,0.09556233137845993,5.881893634796143,15.555094242095947,2 +2509,0.07995576411485672,0.098823182284832,0.08805105090141296,0.2278285175561905,847.2938232421875,1e-05,0.07082021981477737,5.6913368701934814,15.555094242095947,2 +2510,0.10273982584476471,0.09720069169998169,0.10058638453483582,0.23020030558109283,773.6281127929688,1e-05,0.05052699148654938,5.683483600616455,15.555094242095947,2 +2511,0.07551604509353638,0.08090371638536453,0.0843280777335167,0.1433253139257431,993.642333984375,1e-05,0.06868735700845718,5.755603075027466,15.555094242095947,2 +2512,0.08783469349145889,0.04615769907832146,0.05591438338160515,0.22716344892978668,960.3799438476562,1e-05,0.07126326113939285,5.685179710388184,15.555094242095947,2 +2513,0.05454142764210701,0.0664246678352356,0.06394018232822418,0.24299678206443787,942.4212036132812,1e-05,0.051880061626434326,5.68419623374939,15.555094242095947,2 +2514,0.11655794829130173,0.32122597098350525,0.32772257924079895,0.21978364884853363,121.84115600585938,1e-05,0.05458192154765129,5.684065341949463,15.555094242095947,2 +2515,0.1043434888124466,0.09980084747076035,0.09608478099107742,0.26008012890815735,944.8242797851562,1e-05,0.08212592452764511,5.6862571239471436,15.555094242095947,2 +2516,0.08727595210075378,0.06480977684259415,0.06146185100078583,0.22996793687343597,906.9703979492188,1e-05,0.04873399809002876,5.709643363952637,15.555094242095947,2 +2517,0.10627306252717972,0.08617343008518219,0.0865064412355423,0.2637980580329895,403.11651611328125,1e-05,0.06279587745666504,5.693820953369141,15.555094242095947,2 +2518,0.09010164439678192,0.2922613024711609,0.2887459099292755,0.26752403378486633,145.7597198486328,1e-05,0.07761704921722412,5.686040163040161,15.555094242095947,2 +2519,0.11178874969482422,0.11947331577539444,0.11283332109451294,0.19153845310211182,968.468505859375,1e-05,0.048555515706539154,5.688164472579956,15.555094242095947,2 +2520,0.07171684503555298,0.06091035157442093,0.05890035629272461,0.18794870376586914,762.48046875,1e-05,0.061539117246866226,5.68965220451355,15.555094242095947,2 +2521,0.059711672365665436,0.038579151034355164,0.0373043492436409,0.20269230008125305,700.7908935546875,1e-05,0.0599476657807827,5.954523801803589,15.555094242095947,2 +2522,0.10554027557373047,0.061874840408563614,0.06470479816198349,0.18806089460849762,742.69482421875,1e-05,0.06199976056814194,5.6808998584747314,15.555094242095947,2 +2523,0.07244621217250824,0.07925393432378769,0.07896462827920914,0.19911056756973267,762.48046875,1e-05,0.05395134910941124,5.700171947479248,15.555094242095947,2 +2524,0.06628228724002838,0.0628984197974205,0.06054413318634033,0.2539823651313782,878.85986328125,1e-05,0.053597498685121536,5.698448657989502,15.555094242095947,2 +2525,0.13193175196647644,0.05812537297606468,0.05124010890722275,0.20224358141422272,809.2384033203125,1e-05,0.06932458281517029,5.703144550323486,15.555094242095947,2 +2526,0.08047417551279068,0.06616050004959106,0.06553702801465988,0.16335736215114594,864.6732177734375,1e-05,0.06461631506681442,5.694772958755493,15.555094242095947,2 +2527,0.09101982414722443,0.2868354320526123,0.29597434401512146,0.24309293925762177,153.50877380371094,1e-05,0.0595996156334877,5.695942401885986,15.555094242095947,2 +2528,0.10044481605291367,0.06463722139596939,0.05988909304141998,0.27338141202926636,859.375,1e-05,0.05258999019861221,5.693451166152954,15.555094242095947,2 +2529,0.08352667093276978,0.1964891403913498,0.18176253139972687,0.2198237031698227,999.7998046875,1e-05,0.08341314643621445,5.6902947425842285,15.555094242095947,2 +2530,0.033411260694265366,0.11257599294185638,0.10623503476381302,0.2456650584936142,961.9814453125,1e-05,0.06395596265792847,5.923404693603516,15.555094242095947,2 +2531,0.12003298103809357,0.059851497411727905,0.059080056846141815,0.22515223920345306,612.2449340820312,1e-05,0.06227630004286766,5.675843238830566,15.555094242095947,2 +2532,0.08966661989688873,0.06387419253587723,0.06380992382764816,0.23798075318336487,638.4540405273438,1e-05,0.0656655952334404,5.808807611465454,15.555094242095947,2 +2533,0.08926314860582352,0.0820741131901741,0.07880760729312897,0.1909775584936142,639.6484985351562,1e-05,0.06607335805892944,5.702347993850708,15.555094242095947,2 +2534,0.07192744314670563,0.048882536590099335,0.0474625900387764,0.2649438977241516,812.9371337890625,1e-05,0.048561856150627136,5.696178913116455,15.555094242095947,2 +2535,0.07736552506685257,0.0759773775935173,0.0755995362997055,0.2651281952857971,526.620361328125,1e-05,0.06257178634405136,5.82897162437439,15.555094242095947,2 +2536,0.07218655198812485,0.07763594388961792,0.07666902989149094,0.16835737228393555,916.1324462890625,1e-05,0.07218462973833084,5.684385538101196,15.555094242095947,2 +2537,0.09322571009397507,0.07454080879688263,0.06855596601963043,0.21555288136005402,895.6915893554688,1e-05,0.06655986607074738,5.686849594116211,15.555094242095947,2 +2538,0.07960696518421173,0.08242043852806091,0.07751258462667465,0.2696634531021118,900.8379516601562,1e-05,0.05636686831712723,5.697863817214966,15.555094242095947,2 +2539,0.05081245303153992,0.07347538322210312,0.06482935696840286,0.208349347114563,907.7218017578125,1e-05,0.06645245105028152,5.685329914093018,15.555094242095947,2 +2540,0.09538821130990982,0.9835224151611328,0.9826270937919617,0.20530447363853455,9.920635223388672,1e-05,0.07599391788244247,5.688239812850952,15.555094242095947,2 +2541,0.11253611743450165,0.2478349804878235,0.24782498180866241,0.3225400447845459,133.9285888671875,1e-05,0.0698084607720375,5.689997911453247,15.555094242095947,2 +2542,0.03307412937283516,0.20842397212982178,0.2145759016275406,0.2403685748577118,982.677490234375,1e-05,0.049030277878046036,5.691760301589966,15.555094242095947,2 +2543,0.07060480117797852,0.11910117417573929,0.11377356946468353,0.2679567337036133,934.3434448242188,1e-05,0.08013394474983215,5.694186210632324,15.555094242095947,2 +2544,0.07234318554401398,0.11109385639429092,0.10334507375955582,0.25845351815223694,908.4699096679688,1e-05,0.09209321439266205,5.687014818191528,15.555094242095947,2 +2545,0.0874931812286377,0.11448164284229279,0.11020293086767197,0.15167467296123505,940.5940551757812,1e-05,0.08309448510408401,5.688917636871338,15.555094242095947,2 +2546,0.08846624195575714,0.1552639901638031,0.1528196632862091,0.2966907024383545,489.6593933105469,1e-05,0.07200909405946732,5.690725803375244,15.555094242095947,2 +2547,0.11792609095573425,0.12069648504257202,0.1135135143995285,0.24080127477645874,692.9590454101562,1e-05,0.07319093495607376,5.683724880218506,15.555094242095947,2 +2548,0.0754607692360878,0.07915621250867844,0.07547571510076523,0.2537900507450104,859.375,1e-05,0.08247634768486023,5.68783974647522,15.555094242095947,2 +2549,0.0976809710264206,0.33882227540016174,0.3367716372013092,0.13467146456241608,105.31136322021484,1e-05,0.08349985629320145,5.683714151382446,15.555094242095947,2 +2550,0.05425206571817398,0.09897328913211823,0.08989157527685165,0.20568108558654785,891.62841796875,1e-05,0.06958191841840744,5.68125319480896,15.555094242095947,2 +2551,0.08114712685346603,0.0741952508687973,0.06978268176317215,0.24965544044971466,472.6368408203125,1e-05,0.08117713779211044,5.908874750137329,15.555094242095947,2 +2552,0.08602254092693329,0.12292845547199249,0.11720866709947586,0.18704326450824738,970.48291015625,1e-05,0.10830575972795486,5.676528215408325,15.555094242095947,2 +2553,0.09424431622028351,0.06201104819774628,0.06362544745206833,0.19718749821186066,904.6961059570312,1e-05,0.0694001093506813,5.699841260910034,15.555094242095947,2 +2554,0.06523192673921585,0.1356320083141327,0.12759342789649963,0.24829326570034027,935.6137084960938,1e-05,0.08433131128549576,5.695535898208618,15.555094242095947,2 +2555,0.09623247385025024,0.2735704481601715,0.2836402654647827,0.13480769097805023,66.28787994384766,1e-05,0.08644020557403564,5.6929402351379395,15.555094242095947,2 +2556,0.06475252658128738,0.05774709954857826,0.05519364774227142,0.2662339508533478,858.8861083984375,1e-05,0.08687976002693176,5.935020446777344,15.555094242095947,2 +2557,0.12375650554895401,0.03947053104639053,0.038611408323049545,0.20121793448925018,778.6576538085938,1e-05,0.07672256976366043,5.688914060592651,15.555094242095947,2 +2558,0.083543561398983,0.0935220941901207,0.0978999137878418,0.22911056876182556,580.8350830078125,1e-05,0.060984011739492416,5.6832146644592285,15.555094242095947,2 +2559,0.11970797181129456,0.28846248984336853,0.2857220768928528,0.24677883088588715,133.9285888671875,1e-05,0.08607365936040878,5.684286117553711,15.555094242095947,2 +2560,0.10384726524353027,0.12757278978824615,0.1363499015569687,0.24568107724189758,993.0098266601562,1e-05,0.08223912119865417,5.685979843139648,15.555094242095947,2 +2561,0.07997960597276688,0.10790067166090012,0.107718326151371,0.1773717850446701,872.5845947265625,1e-05,0.06481240689754486,5.683600664138794,15.555094242095947,2 +2562,0.08980515599250793,0.14918887615203857,0.15267148613929749,0.19941505789756775,218.64686584472656,1e-05,0.05818169564008713,5.684786796569824,15.555094242095947,2 +2563,0.06486636400222778,0.06853462755680084,0.0651298463344574,0.16008011996746063,922.7748413085938,1e-05,0.08056093007326126,5.686123609542847,15.555094242095947,2 +2564,0.08944319933652878,0.03718436136841774,0.03867989405989647,0.10303685814142227,781.4841918945312,1e-05,0.06793924421072006,5.904571056365967,15.555094242095947,2 +2565,0.05242379009723663,0.06151081249117851,0.06254442036151886,0.10448717325925827,685.9205932617188,1e-05,0.0715322270989418,5.691475868225098,15.555094242095947,2 +2566,0.12096212804317474,0.09078524261713028,0.08899907022714615,0.21366986632347107,666.9776611328125,1e-05,0.07571635395288467,5.683785676956177,15.555094242095947,2 +2567,0.08692747354507446,0.0993400514125824,0.09598882496356964,0.22219550609588623,897.6888427734375,1e-05,0.06992930918931961,5.724017858505249,15.555094242095947,2 +2568,0.056267619132995605,0.11998306959867477,0.11760837584733963,0.3034375011920929,983.5890502929688,1e-05,0.051893796771764755,5.695173025131226,15.555094242095947,2 +2569,0.08200101554393768,0.06917889416217804,0.06880655884742737,0.14822115004062653,814.15625,1e-05,0.056777529418468475,5.685821533203125,15.555094242095947,2 +2570,0.08268357068300247,0.1016266718506813,0.09835348278284073,0.22680287063121796,330.88238525390625,1e-05,0.08821574598550797,5.690004348754883,15.555094242095947,2 +2571,0.12075549364089966,0.12599357962608337,0.12546436488628387,0.23318909108638763,305.8912353515625,1e-05,0.06280875205993652,5.68385910987854,15.555094242095947,2 +2572,0.0700986310839653,0.06660430878400803,0.06271519511938095,0.18174678087234497,878.85986328125,1e-05,0.06097104027867317,5.682283639907837,15.555094242095947,2 +2573,0.11342316120862961,0.07114403694868088,0.07149893045425415,0.18590544164180756,846.7742309570312,1e-05,0.05698710307478905,5.691032886505127,15.555094242095947,2 +2574,0.030066555365920067,0.1346471756696701,0.12763787806034088,0.17964743077754974,981.7597045898438,1e-05,0.055349260568618774,5.914562225341797,15.555094242095947,2 +2575,0.12097042798995972,0.1226172223687172,0.12474963068962097,0.24284453690052032,235.38963317871094,1e-05,0.06061152368783951,5.689965009689331,15.555094242095947,2 +2576,0.12473945319652557,0.1676379144191742,0.16242991387844086,0.1958012729883194,328.1711120605469,1e-05,0.059207502752542496,5.682394027709961,15.555094242095947,2 +2577,0.045346714556217194,0.06252286583185196,0.05645350366830826,0.20577724277973175,904.3141479492188,1e-05,0.05387603119015694,5.920770168304443,15.555094242095947,2 +2578,0.0537881925702095,0.04107513278722763,0.04141884297132492,0.2710095942020416,733.4710693359375,1e-05,0.06052203103899956,5.682754278182983,15.555094242095947,2 +2579,0.04177108034491539,0.1445959210395813,0.13288180530071259,0.2704567313194275,981.5291137695312,1e-05,0.05928613990545273,5.678858518600464,15.555094242095947,2 +2580,0.08981633931398392,0.0767006203532219,0.07084998488426208,0.2420032024383545,616.125732421875,1e-05,0.06901022791862488,5.681564807891846,15.555094242095947,2 +2581,0.1290820986032486,0.06221992149949074,0.06134917959570885,0.205048069357872,577.95703125,1e-05,0.058088283985853195,5.682433366775513,15.555094242095947,2 +2582,0.12893937528133392,0.08600299805402756,0.07734357565641403,0.2861538231372833,811.7109985351562,1e-05,0.07198264449834824,5.677747488021851,15.555094242095947,2 +2583,0.10204419493675232,0.10702525079250336,0.09993097186088562,0.293485552072525,771.4395751953125,1e-05,0.07151342928409576,5.6854517459869385,15.555094242095947,2 +2584,0.0603160597383976,0.0897231325507164,0.0859241932630539,0.18127402663230896,910.6948852539062,1e-05,0.05213608220219612,5.6861982345581055,15.555094242095947,2 +2585,0.09432762116193771,0.04978489875793457,0.047965411096811295,0.20768429338932037,791.1160888671875,1e-05,0.07492145895957947,6.0192484855651855,15.555094242095947,2 +2586,0.06490452587604523,0.10405401140451431,0.10058120638132095,0.21639421582221985,579.399169921875,1e-05,0.07046030461788177,5.688540458679199,15.555094242095947,2 +2587,0.06912892311811447,0.09022723138332367,0.08670152723789215,0.18973557651042938,784.97021484375,1e-05,0.07832866162061691,5.6893088817596436,15.555094242095947,2 +2588,0.11312353610992432,0.16062262654304504,0.1691981852054596,0.18280448019504547,403.11651611328125,1e-05,0.0656992644071579,5.691302299499512,15.555094242095947,2 +2589,0.08916202187538147,0.08849792927503586,0.08899698406457901,0.13871794939041138,633.6292114257812,1e-05,0.05842685326933861,5.691006660461426,15.555094242095947,2 +2590,0.11091067641973495,0.22311127185821533,0.19245748221874237,0.31717145442962646,996.9635620117188,1e-05,0.07261747866868973,5.689183235168457,15.555094242095947,2 +2591,0.042859144508838654,0.1197819858789444,0.11756829172372818,0.22321313619613647,958.7605590820312,1e-05,0.058106668293476105,5.694364786148071,15.555094242095947,2 +2592,0.07704917341470718,0.09298113733530045,0.09249553829431534,0.27003204822540283,861.318359375,1e-05,0.061048850417137146,5.693508625030518,15.555094242095947,2 +2593,0.14633162319660187,0.08855891227722168,0.08776089549064636,0.23770031332969666,948.067626953125,1e-05,0.09894539415836334,5.6928911209106445,15.555094242095947,2 +2594,0.06056899204850197,0.061667900532484055,0.06404294818639755,0.15705928206443787,407.6819763183594,1e-05,0.061622850596904755,5.845816135406494,15.555094242095947,2 +2595,0.08061452955007553,0.08130094408988953,0.08097913861274719,0.20095351338386536,769.2307739257812,1e-05,0.06946299225091934,5.694843530654907,15.555094242095947,2 +2596,0.08247783035039902,0.14087897539138794,0.13100305199623108,0.3171233832836151,932.7411499023438,1e-05,0.06426884233951569,5.7268102169036865,15.555094242095947,2 +2597,0.13167689740657806,0.0891382172703743,0.08085814863443375,0.20286056399345398,905.8369750976562,1e-05,0.07619132101535797,5.684194564819336,15.555094242095947,2 +2598,0.10822796076536179,0.06983153522014618,0.07132363319396973,0.20441505312919617,950.095947265625,1e-05,0.07812563329935074,5.69209623336792,15.555094242095947,2 +2599,0.05968067795038223,0.15110591053962708,0.14478230476379395,0.17566505074501038,963.8278198242188,1e-05,0.05890800431370735,5.693740606307983,15.555094242095947,2 +2600,0.09429240226745605,0.12315723299980164,0.11860264837741852,0.2493269145488739,425.4617614746094,1e-05,0.07117690145969391,5.685699462890625,15.555094242095947,2 +2601,0.11590307950973511,0.10171875357627869,0.10454250127077103,0.25409454107284546,836.6402587890625,1e-05,0.0589146688580513,5.68538761138916,15.555094242095947,2 +2602,0.06896132975816727,0.04550988972187042,0.04810214042663574,0.1028205081820488,913.978515625,1e-05,0.054379962384700775,5.72254490852356,15.555094242095947,2 +2603,0.09301306307315826,0.06476356834173203,0.06185959652066231,0.17455929517745972,784.2772827148438,1e-05,0.07037370651960373,5.6859049797058105,15.555094242095947,2 +2604,0.052845630794763565,0.09224826842546463,0.09430617094039917,0.24766826629638672,772.1712036132812,1e-05,0.06328952312469482,5.688294172286987,15.555094242095947,2 +2605,0.06614245474338531,0.0642533153295517,0.0646466538310051,0.17125000059604645,566.1925659179688,1e-05,0.06896470487117767,5.701075315475464,15.555094242095947,2 +2606,0.08459148555994034,0.05790647491812706,0.05510111153125763,0.25341343879699707,603.0020751953125,1e-05,0.0587003268301487,5.910434246063232,15.555094242095947,2 +2607,0.06981274485588074,0.06274491548538208,0.06385667622089386,0.21925480663776398,913.978515625,1e-05,0.07526760548353195,5.681055545806885,15.555094242095947,2 +2608,0.04860909283161163,0.05891529843211174,0.06043442711234093,0.21385416388511658,925.4932250976562,1e-05,0.06241045892238617,5.6814186573028564,15.555094242095947,2 +2609,0.0823187530040741,0.1765085607767105,0.1745191216468811,0.1137179434299469,979.4371948242188,1e-05,0.05584722384810448,5.683686971664429,15.555094242095947,2 +2610,0.08632680028676987,0.06819647550582886,0.06693704426288605,0.24866986274719238,714.8972778320312,1e-05,0.06047598272562027,5.691332578659058,15.555094242095947,2 +2611,0.0948934406042099,0.1125136986374855,0.10481201857328415,0.23682691156864166,529.9539794921875,1e-05,0.06998501718044281,5.691154956817627,15.555094242095947,2 +2612,0.10434094816446304,0.10792424529790878,0.10143260657787323,0.2557932734489441,842.5684204101562,1e-05,0.05924861878156662,5.689740419387817,15.555094242095947,2 +2613,0.053784701973199844,0.24066521227359772,0.22562558948993683,0.19826121628284454,984.0426025390625,1e-05,0.050416480749845505,5.687711954116821,15.555094242095947,2 +2614,0.09465256333351135,0.08586466312408447,0.08588434755802155,0.2263862043619156,416.6666564941406,1e-05,0.05934113264083862,5.691800594329834,15.555094242095947,2 +2615,0.0890321433544159,0.07857859879732132,0.07187003642320633,0.3049038350582123,703.6713256835938,1e-05,0.0695950984954834,5.6849164962768555,15.555094242095947,2 +2616,0.10896527022123337,0.09987520426511765,0.10179106146097183,0.2385176122188568,964.3510131835938,1e-05,0.05519009754061699,5.688888788223267,15.555094242095947,2 +2617,0.04148400202393532,0.1507575362920761,0.1474127322435379,0.17440705001354218,963.5654907226562,1e-05,0.057659853249788284,5.724679708480835,15.555094242095947,2 +2618,0.07384875416755676,0.20845095813274384,0.1908760815858841,0.2461378127336502,1000.0,1e-05,0.06191649287939072,5.685883283615112,15.555094242095947,2 +2619,0.0731554701924324,0.037307966500520706,0.04076322913169861,0.2517387866973877,896.4932861328125,1e-05,0.05415121838450432,5.912753343582153,15.555094242095947,2 +2620,0.09424549341201782,0.08600156754255295,0.08427036553621292,0.21111378073692322,954.9102783203125,1e-05,0.05827060341835022,5.699541091918945,15.555094242095947,2 +2621,0.07679085433483124,0.10020072013139725,0.10374534875154495,0.10923076421022415,359.68658447265625,1e-05,0.05572302266955376,5.698432683944702,15.555094242095947,2 +2622,0.06316391378641129,0.061514150351285934,0.058930903673172,0.14571313560009003,894.8863525390625,1e-05,0.05738724395632744,5.693805456161499,15.555094242095947,2 +2623,0.07020710408687592,0.08655879646539688,0.08604506403207779,0.23665063083171844,367.23162841796875,1e-05,0.0704953670501709,5.928519248962402,15.555094242095947,2 +2624,0.0916018933057785,0.07192865014076233,0.06721758842468262,0.2309935837984085,712.13427734375,1e-05,0.07401008158922195,5.685741662979126,15.555094242095947,2 +2625,0.11381429433822632,0.10696851462125778,0.09998419135808945,0.26868587732315063,544.5823974609375,1e-05,0.0687260776758194,5.702523946762085,15.555094242095947,2 +2626,0.09104831516742706,0.07911888509988785,0.073295459151268,0.20503205060958862,750.0000610351562,1e-05,0.07747398316860199,5.690915107727051,15.555094242095947,2 +2627,0.10517437011003494,0.08223697543144226,0.07978811115026474,0.22079326212406158,669.14501953125,1e-05,0.08511597663164139,5.693151473999023,15.555094242095947,2 +2628,0.1107727587223053,0.06878091394901276,0.06632716953754425,0.22147434949874878,775.796630859375,1e-05,0.08227663487195969,5.765089988708496,15.555094242095947,2 +2629,0.08358875662088394,0.14040438830852509,0.13601358234882355,0.26665863394737244,954.3519897460938,1e-05,0.05879363417625427,5.685366153717041,15.555094242095947,2 +2630,0.12810032069683075,0.13479971885681152,0.13455018401145935,0.20713140070438385,322.7003173828125,1e-05,0.06630685925483704,5.842220783233643,15.555094242095947,2 +2631,0.07351810485124588,0.1793968379497528,0.1725120097398758,0.24148236215114594,987.174072265625,1e-05,0.1773785948753357,5.682898044586182,15.555094242095947,2 +2632,0.07356083393096924,0.07175999134778976,0.07444603741168976,0.19209134578704834,567.685546875,1e-05,0.0612700954079628,5.704843282699585,15.555094242095947,2 +2633,0.10828626900911331,0.10430318862199783,0.09696652740240097,0.17239582538604736,952.09716796875,1e-05,0.05900958925485611,5.704862117767334,15.555094242095947,2 +2634,0.12676751613616943,0.053589340299367905,0.055810004472732544,0.1472756415605545,732.615966796875,1e-05,0.06695499271154404,5.704935073852539,15.555094242095947,2 +2635,0.1028061956167221,0.05763082206249237,0.06001349166035652,0.2688301205635071,812.3250122070312,1e-05,0.05694245174527168,5.706511735916138,15.555094242095947,2 +2636,0.05313489958643913,0.09102397412061691,0.08491252362728119,0.16459134221076965,923.1171264648438,1e-05,0.0624784417450428,5.698623418807983,15.555094242095947,2 +2637,0.06356091797351837,0.09342530369758606,0.0925929844379425,0.03393429517745972,900.4474487304688,1e-05,0.06061110273003578,5.701152086257935,15.555094242095947,2 +2638,0.11324764043092728,0.021485449746251106,0.024577010422945023,0.21860575675964355,609.6311645507812,1e-05,0.06529639661312103,5.887000799179077,15.555094242095947,2 +2639,0.04758191108703613,0.14724141359329224,0.14067889750003815,0.20310896635055542,983.1340942382812,1e-05,0.05599575117230415,5.6932737827301025,15.555094242095947,2 +2640,0.10199403762817383,0.05397733673453331,0.05443139374256134,0.22275640070438385,655.8935546875,1e-05,0.055627427995204926,5.921499729156494,15.555094242095947,2 +2641,0.043012384325265884,0.16395024955272675,0.1616344302892685,0.27009615302085876,988.0552978515625,1e-05,0.0658080130815506,5.686304807662964,15.555094242095947,2 +2642,0.0789731964468956,0.11768912523984909,0.11158055812120438,0.23246793448925018,974.6696166992188,1e-05,0.07102601230144501,5.684990406036377,15.555094242095947,2 +2643,0.059121690690517426,0.05893438309431076,0.053246691823005676,0.1730448603630066,757.8740844726562,1e-05,0.0523335300385952,5.679960250854492,15.555094242095947,2 +2644,0.09731531143188477,0.08152129501104355,0.07885722815990448,0.2355448603630066,879.7392578125,1e-05,0.07706939429044724,5.698645353317261,15.555094242095947,2 +2645,0.0649738684296608,0.10204946249723434,0.09889806807041168,0.16362980008125305,980.13818359375,1e-05,0.055776506662368774,5.711475372314453,15.555094242095947,2 +2646,0.10702935606241226,0.04541826620697975,0.04650837182998657,0.22963140904903412,683.8768310546875,1e-05,0.06745973229408264,5.698972463607788,15.555094242095947,2 +2647,0.08998610824346542,0.09666363149881363,0.09705804288387299,0.21554486453533173,917.19921875,1e-05,0.06153972074389458,5.688422918319702,15.555094242095947,2 +2648,0.05801882594823837,0.09434854984283447,0.08592771738767624,0.2108413428068161,859.8626708984375,1e-05,0.0748262032866478,5.826223611831665,15.555094242095947,2 +2649,0.1023440957069397,0.061129771173000336,0.057570938020944595,0.29035255312919617,678.7020263671875,1e-05,0.06935644894838333,5.884628772735596,15.555094242095947,2 +2650,0.07029643654823303,0.09443565458059311,0.09122193604707718,0.2568349242210388,495.1690979003906,1e-05,0.0701870247721672,5.688901662826538,15.555094242095947,2 +2651,0.07031773775815964,0.07812362909317017,0.08079443126916885,0.1747676283121109,811.7109985351562,1e-05,0.04859529435634613,5.899946928024292,15.555094242095947,2 +2652,0.10362526029348373,0.11710222065448761,0.11047568172216415,0.2698878049850464,966.4247436523438,1e-05,0.0932527706027031,5.688493013381958,15.555094242095947,2 +2653,0.11640522629022598,0.1204855665564537,0.13081304728984833,0.16150639951229095,346.82080078125,1e-05,0.08915897458791733,5.688886642456055,15.555094242095947,2 +2654,0.09982343018054962,0.04394989833235741,0.04319838061928749,0.16645832359790802,658.1439819335938,1e-05,0.06038312241435051,5.687178134918213,15.555094242095947,2 +2655,0.06970705091953278,0.30865734815597534,0.34894153475761414,0.1500881314277649,29.296875,1e-05,0.05861835926771164,5.6860809326171875,15.555094242095947,2 +2656,0.10770271718502045,0.10002359002828598,0.09745781123638153,0.19962339103221893,662.593994140625,1e-05,0.07367263734340668,5.697326183319092,15.555094242095947,2 +2657,0.17247450351715088,0.15554851293563843,0.14919574558734894,0.23632210493087769,352.0115051269531,1e-05,0.08844413608312607,5.687513113021851,15.555094242095947,2 +2658,0.10207384079694748,0.06251200288534164,0.06149185821413994,0.2033172994852066,643.2039184570312,1e-05,0.06437331438064575,5.696999549865723,15.555094242095947,2 +2659,0.070118747651577,0.10423052310943604,0.10154331475496292,0.2537740170955658,971.7275390625,1e-05,0.06822063773870468,5.677032709121704,15.555094242095947,2 +2660,0.06419592350721359,0.07212509959936142,0.06759148836135864,0.2784775495529175,913.6167602539062,1e-05,0.07997795194387436,5.690885305404663,15.555094242095947,2 +2661,0.10744622349739075,0.10137477517127991,0.09631572663784027,0.2745272219181061,955.7438354492188,1e-05,0.07905160635709763,5.689156770706177,15.555094242095947,2 +2662,0.1160324364900589,0.3069421947002411,0.31344425678253174,0.24719549715518951,70.75472259521484,1e-05,0.05998830497264862,5.716270685195923,15.555094242095947,2 +2663,0.07536348700523376,0.07035550475120544,0.06501635164022446,0.2441265881061554,954.3519897460938,1e-05,0.06217435747385025,5.691774368286133,15.555094242095947,2 +2664,0.0866793617606163,0.0719328448176384,0.06876392662525177,0.26894229650497437,688.9586791992188,1e-05,0.08198301494121552,5.679033994674683,15.555094242095947,2 +2665,0.08671800047159195,0.05679488182067871,0.05920446664094925,0.10203525424003601,967.4503784179688,1e-05,0.06632596254348755,5.69102144241333,15.555094242095947,2 +2666,0.07929810136556625,0.1901480257511139,0.18197663128376007,0.24969550967216492,983.8159790039062,1e-05,0.06645602732896805,5.685698747634888,15.555094242095947,2 +2667,0.06847138702869415,0.08272630721330643,0.08315148204565048,0.1936698704957962,690.9660034179688,1e-05,0.08121669292449951,5.829403877258301,15.555094242095947,2 +2668,0.08172924816608429,0.09752095490694046,0.0979180708527565,0.2424679398536682,918.6107788085938,1e-05,0.0678127110004425,5.684640884399414,15.555094242095947,2 +2669,0.074254609644413,0.0789184719324112,0.0792762041091919,0.24394230544567108,845.7308959960938,1e-05,0.06348150968551636,5.682362079620361,15.555094242095947,2 +2670,0.058313481509685516,0.130185067653656,0.12867657840251923,0.252796471118927,995.5211791992188,1e-05,0.06620300561189651,5.67981743812561,15.555094242095947,2 +2671,0.09745338559150696,0.04464907944202423,0.05261339992284775,0.21761217713356018,926.8355712890625,1e-05,0.0771455392241478,5.68103289604187,15.555094242095947,2 +2672,0.051961492747068405,0.10829488188028336,0.09951914101839066,0.25421473383903503,945.4190673828125,1e-05,0.06326548010110855,5.895262241363525,15.555094242095947,2 +2673,0.08871906995773315,0.05079621821641922,0.054937802255153656,0.2739022374153137,783.5821533203125,1e-05,0.06288131326436996,5.684015989303589,15.555094242095947,2 +2674,0.08713176846504211,0.12514223158359528,0.11983354389667511,0.2224999964237213,942.4212036132812,1e-05,0.0737086683511734,5.679605484008789,15.555094242095947,2 +2675,0.15471866726875305,0.08690706640481949,0.08571317046880722,0.14259615540504456,381.9444580078125,1e-05,0.070122629404068,5.685057640075684,15.555094242095947,2 +2676,0.1313377022743225,0.11298848688602448,0.10835681855678558,0.21163460612297058,362.2159423828125,1e-05,0.06816289573907852,5.690615653991699,15.555094242095947,2 +2677,0.10827585309743881,0.10729844123125076,0.09935007989406586,0.2180688977241516,573.5930786132812,1e-05,0.08011052012443542,5.685554504394531,15.555094242095947,2 +2678,0.10562586039304733,0.11861148476600647,0.10889993607997894,0.17533652484416962,955.188720703125,1e-05,0.07308463752269745,5.687242746353149,15.555094242095947,2 +2679,0.08490724861621857,0.0736289769411087,0.07042864710092545,0.20713941752910614,781.4841918945312,1e-05,0.07699532806873322,5.688101768493652,15.555094242095947,2 +2680,0.1435869038105011,0.08664247393608093,0.07963936775922775,0.22697915136814117,484.06866455078125,1e-05,0.06656862795352936,5.68410587310791,15.555094242095947,2 +2681,0.1321709305047989,0.21070823073387146,0.21456897258758545,0.19210736453533173,172.413818359375,1e-05,0.0558147057890892,5.682902812957764,15.555094242095947,2 +2682,0.07155855745077133,0.19028183817863464,0.19922791421413422,0.16224358975887299,993.4319458007812,1e-05,0.07203080505132675,5.797721862792969,15.555094242095947,2 +2683,0.12149165570735931,0.054508864879608154,0.056204285472631454,0.24456730484962463,575.0540771484375,1e-05,0.09055259078741074,5.825041770935059,15.555094242095947,2 +2684,0.09751743078231812,0.11473426222801208,0.11081443727016449,0.24977563321590424,669.14501953125,1e-05,0.06335963308811188,5.70448637008667,15.555094242095947,2 +2685,0.04951288923621178,0.06387866288423538,0.05612023174762726,0.22023236751556396,909.5860595703125,1e-05,0.07380267232656479,5.6940295696258545,15.555094242095947,2 +2686,0.059474386274814606,0.1257166713476181,0.12029794603586197,0.2566906809806824,982.4486694335938,1e-05,0.05213669687509537,5.683624505996704,15.555094242095947,2 +2687,0.13339467346668243,0.18468062579631805,0.18245169520378113,0.20048075914382935,314.37127685546875,1e-05,0.07126633077859879,5.683034658432007,15.555094242095947,2 +2688,0.08888991177082062,0.0939500629901886,0.0863436907529831,0.2472996711730957,760.1881103515625,1e-05,0.0597933754324913,5.684391498565674,15.555094242095947,2 +2689,0.08828842639923096,0.09915617108345032,0.08772867172956467,0.22824518382549286,908.8427124023438,1e-05,0.053155235946178436,5.6918745040893555,15.555094242095947,2 +2690,0.10831887274980545,0.05200459063053131,0.051790252327919006,0.25225961208343506,745.1535034179688,1e-05,0.08202558755874634,5.694171905517578,15.555094242095947,2 +2691,0.07177524268627167,0.13714583218097687,0.13080665469169617,0.1987900584936142,991.0935668945312,1e-05,0.06394530087709427,5.686579942703247,15.555094242095947,2 +2692,0.05843495577573776,0.06980306655168533,0.0694204792380333,0.26586538553237915,873.039794921875,1e-05,0.055134911090135574,5.69433331489563,15.555094242095947,2 +2693,0.0584772452712059,0.047547806054353714,0.04905739799141884,0.19487980008125305,594.86376953125,1e-05,0.06197541952133179,5.689815998077393,15.555094242095947,2 +2694,0.09838411211967468,0.10397415608167648,0.10210638493299484,0.2053445428609848,325.4438171386719,1e-05,0.08531219512224197,5.689884424209595,15.555094242095947,2 +2695,0.1162041425704956,0.064973846077919,0.06361289322376251,0.2528926134109497,692.9590454101562,1e-05,0.075494185090065,5.682871580123901,15.555094242095947,2 +2696,0.10911813378334045,0.167903333902359,0.17030532658100128,0.2749679386615753,285.49383544921875,1e-05,0.06240783631801605,5.686728477478027,15.555094242095947,2 +2697,0.08959397673606873,0.06466247141361237,0.061064742505550385,0.2618750035762787,563.1868286132812,1e-05,0.08457083255052567,5.688398838043213,15.555094242095947,2 +2698,0.07353881001472473,0.06999893486499786,0.0655098631978035,0.2416987121105194,889.1455078125,1e-05,0.06466716527938843,5.6814048290252686,15.555094242095947,2 +2699,0.09415397047996521,0.05589546635746956,0.05558061972260475,0.22999998927116394,603.0020751953125,1e-05,0.050662919878959656,5.678609609603882,15.555094242095947,2 +2700,0.0962647870182991,0.0779241994023323,0.06844181567430496,0.2377644181251526,837.7308349609375,1e-05,0.09031924605369568,5.6930015087127686,15.555094242095947,2 +2701,0.07289811968803406,0.1100069135427475,0.11292929947376251,0.1451522409915924,882.784912109375,1e-05,0.056782305240631104,5.685443878173828,15.555094242095947,2 +2702,0.0677715465426445,0.12658825516700745,0.12446805834770203,0.11871794611215591,979.2027587890625,1e-05,0.06060763821005821,5.673783779144287,15.555094242095947,2 +2703,0.06018558144569397,0.09545620530843735,0.09520505368709564,0.23240384459495544,934.0242309570312,1e-05,0.06942342966794968,5.756219863891602,15.555094242095947,2 +2704,0.07564711570739746,0.10024262219667435,0.09264245629310608,0.2162499874830246,718.5374145507812,1e-05,0.07782378792762756,5.788255453109741,15.555094242095947,2 +2705,0.13501589000225067,0.07315196096897125,0.07934647053480148,0.23397435247898102,398.5013732910156,1e-05,0.06847182661294937,5.68747353553772,15.555094242095947,2 +2706,0.08745512366294861,0.08137895911931992,0.0817275419831276,0.22282852232456207,642.0233154296875,1e-05,0.06459227204322815,5.6859824657440186,15.555094242095947,2 +2707,0.09210469573736191,0.11860951036214828,0.11449772864580154,0.21723556518554688,939.0547485351562,1e-05,0.06341684609651566,5.686919927597046,15.555094242095947,2 +2708,0.09878391772508621,0.10288966447114944,0.11334638297557831,0.22459934651851654,197.81146240234375,1e-05,0.07448199391365051,5.684420824050903,15.555094242095947,2 +2709,0.0731651559472084,0.06586644798517227,0.06131269037723541,0.2770993411540985,906.5933837890625,1e-05,0.05686110630631447,5.759056568145752,15.555094242095947,2 +2710,0.07615256309509277,0.09033891558647156,0.08260135352611542,0.22427082061767578,891.2169799804688,1e-05,0.062380339950323105,5.688457727432251,15.555094242095947,2 +2711,0.10290805995464325,0.48316770792007446,0.4759809672832489,0.2029487043619156,75.18797302246094,1e-05,0.05854756385087967,5.680477619171143,15.555094242095947,2 +2712,0.07613619416952133,0.14995241165161133,0.14109621942043304,0.20098556578159332,985.3936767578125,1e-05,0.04902417212724686,5.688241958618164,15.555094242095947,2 +2713,0.09731949120759964,0.11424947530031204,0.11752194911241531,0.1606009602546692,992.374267578125,1e-05,0.05804893746972084,5.686568975448608,15.555094242095947,2 +2714,0.07439357787370682,0.07577964663505554,0.0735875815153122,0.2453685849905014,912.8910522460938,1e-05,0.06416147947311401,5.684946298599243,15.555094242095947,2 +2715,0.11544401943683624,0.12464270740747452,0.10921663045883179,0.24619390070438385,963.0394287109375,1e-05,0.06131092458963394,5.686581373214722,15.555094242095947,2 +2716,0.0468439981341362,0.07372269779443741,0.07306376099586487,0.2688060700893402,496.98797607421875,1e-05,0.058043308556079865,5.681559085845947,15.555094242095947,2 +2717,0.10308101773262024,0.049149490892887115,0.04639080911874771,0.20105768740177155,736.8637084960938,1e-05,0.056623149663209915,5.68604850769043,15.555094242095947,2 +2718,0.09948419034481049,0.0933929979801178,0.08852814137935638,0.3037179410457611,450.76727294921875,1e-05,0.07078824937343597,5.686748504638672,15.555094242095947,2 +2719,0.09132544696331024,0.06803929060697556,0.07240455597639084,0.2319711446762085,943.62744140625,1e-05,0.0673123225569725,5.682682037353516,15.555094242095947,2 +2720,0.06511355191469193,0.08056827634572983,0.08494368195533752,0.20048075914382935,533.2568969726562,1e-05,0.05511746555566788,5.6772637367248535,15.555094242095947,2 +2721,0.07991106063127518,0.09748328477144241,0.09727100282907486,0.2668910026550293,495.1690979003906,1e-05,0.07161667943000793,5.687293529510498,15.555094242095947,2 +2722,0.11060386896133423,0.09211769700050354,0.0918770581483841,0.2108333259820938,880.177490234375,1e-05,0.0666048526763916,5.938625812530518,15.555094242095947,2 +2723,0.06559452414512634,0.048117708414793015,0.051928501576185226,0.11790063977241516,873.039794921875,1e-05,0.06877809017896652,5.674241542816162,15.555094242095947,2 +2724,0.09467881172895432,0.09206805378198624,0.08608392626047134,0.2428765892982483,567.685546875,1e-05,0.0501018650829792,5.687690496444702,15.555094242095947,2 +2725,0.09225155413150787,0.02771833725273609,0.03353310003876686,0.2276282012462616,502.3923645019531,1e-05,0.06075870990753174,5.6850340366363525,15.555094242095947,2 +2726,0.0762997716665268,0.08447717130184174,0.0755503848195076,0.1849839687347412,837.7308349609375,1e-05,0.054890964180231094,5.681920766830444,15.555094242095947,2 +2727,0.08123502135276794,0.2184254676103592,0.21191029250621796,0.20094551146030426,995.728271484375,1e-05,0.056993160396814346,5.915407419204712,15.555094242095947,2 +2728,0.11418627202510834,0.16292910277843475,0.16092757880687714,0.2866666615009308,273.4375,1e-05,0.05828794091939926,5.6859047412872314,15.555094242095947,2 +2729,0.11427053064107895,0.030844297260046005,0.03684920445084572,0.22295671701431274,837.1862182617188,1e-05,0.06082972511649132,5.685771226882935,15.555094242095947,2 +2730,0.0919640064239502,0.04332728311419487,0.04285270348191261,0.1368749886751175,669.14501953125,1e-05,0.055794257670640945,5.6889731884002686,15.555094242095947,2 +2731,0.068602055311203,0.07309646904468536,0.07428161054849625,0.13083332777023315,777.9456176757812,1e-05,0.061284225434064865,5.680142164230347,15.555094242095947,2 +2732,0.06534133106470108,0.06858737021684647,0.07520876824855804,0.19332531094551086,971.7275390625,1e-05,0.0728907361626625,5.680255174636841,15.555094242095947,2 +2733,0.08311507105827332,0.784660816192627,0.792150616645813,0.27608171105384827,34.046695709228516,1e-05,0.06396818906068802,5.683881759643555,15.555094242095947,2 +2734,0.09483011066913605,0.09602617472410202,0.09437007457017899,0.2823878228664398,542.9864501953125,1e-05,0.06465498358011246,5.688992023468018,15.555094242095947,2 +2735,0.08967231959104538,0.13816428184509277,0.1325390785932541,0.24290062487125397,944.52587890625,1e-05,0.0604429766535759,5.687830209732056,15.555094242095947,2 +2736,0.07457132637500763,0.05747339874505997,0.061891619116067886,0.18632210791110992,778.6576538085938,1e-05,0.05062852427363396,5.910595655441284,15.555094242095947,2 +2737,0.07210545241832733,0.1564531922340393,0.14757730066776276,0.10830127447843552,981.9896850585938,1e-05,0.08279694616794586,5.702985048294067,15.555094242095947,2 +2738,0.08861413598060608,0.16769389808177948,0.1494302898645401,0.24455928802490234,985.6176147460938,1e-05,0.07507568597793579,5.699605703353882,15.555094242095947,2 +2739,0.04290444403886795,0.34625664353370667,0.30894938111305237,0.1945512741804123,994.89794921875,1e-05,0.05741509795188904,5.685866832733154,15.555094242095947,2 +2740,0.08139060437679291,0.1643844097852707,0.16705043613910675,0.24886217713356018,215.23179626464844,1e-05,0.06610563397407532,5.694153070449829,15.555094242095947,2 +2741,0.051304444670677185,0.03806314989924431,0.040637511759996414,0.2375721037387848,662.593994140625,1e-05,0.060023073107004166,5.68674111366272,15.555094242095947,2 +2742,0.07732078433036804,0.06870761513710022,0.06599845737218857,0.2899358868598938,807.9915161132812,1e-05,0.08358212560415268,5.696043014526367,15.555094242095947,2 +2743,0.06150871887803078,0.09099461883306503,0.0861515998840332,0.18333332240581512,957.6707763671875,1e-05,0.05500086396932602,5.720885276794434,15.555094242095947,2 +2744,0.05803648754954338,0.034458063542842865,0.03393666446208954,0.05548878014087677,763.2398681640625,1e-05,0.06289534270763397,5.699999809265137,15.555094242095947,2 +2745,0.07607971876859665,0.21288533508777618,0.21064655482769012,0.20243589580059052,973.2064208984375,1e-05,0.06930337846279144,5.684832811355591,15.555094242095947,2 +2746,0.09927187114953995,0.1392139196395874,0.12766380608081818,0.24111376702785492,969.4793090820312,1e-05,0.0710499957203865,5.6892805099487305,15.555094242095947,2 +2747,0.07511886954307556,0.10746901482343674,0.10006611049175262,0.23933492600917816,694.9378051757812,1e-05,0.06875237822532654,5.68385910987854,15.555094242095947,2 +2748,0.1507762223482132,0.032405778765678406,0.03565910831093788,0.12919871509075165,820.7417602539062,1e-05,0.0662471204996109,5.906290531158447,15.555094242095947,2 +2749,0.07869449257850647,0.05407947301864624,0.05705348774790764,0.148541659116745,931.447509765625,1e-05,0.06095710024237633,5.685956716537476,15.555094242095947,2 +2750,0.06795604526996613,0.09935088455677032,0.09888330101966858,0.20499198138713837,909.21484375,1e-05,0.05913029611110687,5.710349798202515,15.555094242095947,2 +2751,0.10095100849866867,0.12226308882236481,0.11919126659631729,0.25871792435646057,980.8355712890625,1e-05,0.0915926918387413,5.698355674743652,15.555094242095947,2 +2752,0.07432097941637039,0.0777948722243309,0.07555866986513138,0.20999197661876678,907.3464965820312,1e-05,0.06199180334806442,5.697495698928833,15.555094242095947,2 +2753,0.07176686078310013,0.11421598494052887,0.10741027444601059,0.2888701856136322,976.5967407226562,1e-05,0.07928896695375443,5.6906585693359375,15.555094242095947,2 +2754,0.08931173384189606,0.07672638446092606,0.07865451276302338,0.23344551026821136,608.3162231445312,1e-05,0.05770521238446236,5.687175989151001,15.555094242095947,2 +2755,0.08207903802394867,0.0787343978881836,0.07369430363178253,0.2592628002166748,577.95703125,1e-05,0.0501241460442543,5.697742938995361,15.555094242095947,2 +2756,0.09904681146144867,0.2031773030757904,0.19791856408119202,0.18834133446216583,201.34228515625,1e-05,0.06990028917789459,5.693304061889648,15.555094242095947,2 +2757,0.1112174317240715,0.11481828987598419,0.11133073270320892,0.2406490296125412,580.8350830078125,1e-05,0.06906738132238388,5.918467998504639,15.555094242095947,2 +2758,0.053075797855854034,0.08117502182722092,0.0828026533126831,0.171979159116745,918.9618530273438,1e-05,0.06595168262720108,5.684103727340698,15.555094242095947,2 +2759,0.09183169901371002,0.06550085544586182,0.0634651705622673,0.24762018024921417,634.842529296875,1e-05,0.0582297146320343,5.725589036941528,15.555094242095947,2 +2760,0.0639580488204956,0.04117359593510628,0.040773238986730576,0.12003204971551895,569.172119140625,1e-05,0.07864093780517578,5.691774606704712,15.555094242095947,2 +2761,0.07746671885251999,0.081137515604496,0.08202804625034332,0.20770031213760376,724.7899169921875,1e-05,0.06271828711032867,5.69286036491394,15.555094242095947,2 +2762,0.06668997555971146,0.12198037654161453,0.11172740161418915,0.2785496711730957,960.9158325195312,1e-05,0.07234129309654236,5.703121662139893,15.555094242095947,2 +2763,0.05176955834031105,0.0249437615275383,0.02791491709649563,0.14278845489025116,824.2506713867188,1e-05,0.05803421139717102,5.697312831878662,15.555094242095947,2 +2764,0.11246030777692795,0.1203717440366745,0.11200948804616928,0.2743028700351715,915.4175415039062,1e-05,0.06999039649963379,5.69055438041687,15.555094242095947,2 +2765,0.11780159175395966,0.10394810885190964,0.10046201944351196,0.2830929458141327,398.5013732910156,1e-05,0.0711725577712059,5.693481922149658,15.555094242095947,2 +2766,0.10930578410625458,0.08797584474086761,0.08151081949472427,0.2263782024383545,950.9569091796875,1e-05,0.08520260453224182,5.687374591827393,15.555094242095947,2 +2767,0.11291554570198059,0.04287276789546013,0.0424773208796978,0.12861377000808716,670.22265625,1e-05,0.06948598474264145,5.685819149017334,15.555094242095947,2 +2768,0.0930650383234024,0.17685118317604065,0.173612579703331,0.20104967057704926,288.4615478515625,1e-05,0.06898980587720871,5.685857057571411,15.555094242095947,2 +2769,0.08328129351139069,0.0766269639134407,0.07055500894784927,0.1332131326198578,879.7392578125,1e-05,0.056617699563503265,5.9344987869262695,15.555094242095947,2 +2770,0.04815787822008133,0.060918767005205154,0.06057491898536682,0.2824999988079071,786.3502197265625,1e-05,0.05762988328933716,5.682840585708618,15.555094242095947,2 +2771,0.07159782201051712,0.05116237699985504,0.05293658748269081,0.24781249463558197,845.2072143554688,1e-05,0.06444264948368073,5.685368299484253,15.555094242095947,2 +2772,0.1048833504319191,0.061277180910110474,0.058434583246707916,0.19374999403953552,853.9290161132812,1e-05,0.0786278247833252,5.680197477340698,15.555094242095947,2 +2773,0.11888998001813889,0.21867835521697998,0.22546282410621643,0.22838139533996582,157.3426513671875,1e-05,0.06312963366508484,5.6868674755096436,15.555094242095947,2 +2774,0.08315028995275497,0.07221058756113052,0.070963554084301,0.3011378049850464,923.1171264648438,1e-05,0.09800989925861359,5.684075593948364,15.555094242095947,2 +2775,0.08732353895902634,0.07981425523757935,0.07843824476003647,0.18703524768352509,683.8768310546875,1e-05,0.07477353513240814,5.685338497161865,15.555094242095947,2 +2776,0.09302310645580292,0.04329736530780792,0.042928293347358704,0.24040062725543976,876.1961669921875,1e-05,0.05651283636689186,5.684048652648926,15.555094242095947,2 +2777,0.08276773244142532,0.06837373226881027,0.06635551154613495,0.08509615063667297,855.9268798828125,1e-05,0.061526715755462646,5.686192274093628,15.555094242095947,2 +2778,0.08999927341938019,0.08940692245960236,0.08229534327983856,0.17793267965316772,912.5270385742188,1e-05,0.07489002496004105,5.686343669891357,15.555094242095947,2 +2779,0.0962992012500763,0.36598071455955505,0.3717808723449707,0.21767626702785492,109.48905944824219,1e-05,0.05616239085793495,5.6923911571502686,15.555094242095947,2 +2780,0.06877201795578003,0.03068358264863491,0.032179053872823715,0.3032371699810028,836.0927734375,1e-05,0.06297342479228973,5.689468860626221,15.555094242095947,2 +2781,0.07361914217472076,0.06712707877159119,0.0684485137462616,0.2266586422920227,915.0589599609375,1e-05,0.06053013727068901,5.682371616363525,15.555094242095947,2 +2782,0.09372080862522125,0.09235487878322601,0.08907471597194672,0.24453525245189667,956.5726318359375,1e-05,0.0655159279704094,5.685082674026489,15.555094242095947,2 +2783,0.12623052299022675,0.12781135737895966,0.12866246700286865,0.2777964770793915,285.49383544921875,1e-05,0.06599938124418259,5.6917173862457275,15.555094242095947,2 +2784,0.05993600934743881,0.09836103767156601,0.09105201810598373,0.21746793389320374,858.8861083984375,1e-05,0.0659574568271637,5.693912982940674,15.555094242095947,2 +2785,0.14877580106258392,0.20714665949344635,0.21173858642578125,0.22601762413978577,168.68511962890625,1e-05,0.07145342975854874,5.7025227546691895,15.555094242095947,2 +2786,0.10663862526416779,0.10117918252944946,0.09359997510910034,0.24993589520454407,732.615966796875,1e-05,0.052073270082473755,5.887871265411377,15.555094242095947,2 +2787,0.09488150477409363,0.09156202524900436,0.08736772835254669,0.20044070482254028,586.51806640625,1e-05,0.06072456017136574,5.687079429626465,15.555094242095947,2 +2788,0.06466880440711975,0.11520928889513016,0.1133037880063057,0.268998384475708,969.9821166992188,1e-05,0.06764458864927292,5.685980558395386,15.555094242095947,2 +2789,0.09346359968185425,0.09374258667230606,0.08593563735485077,0.20772434771060944,854.4303588867188,1e-05,0.07089132070541382,5.681509494781494,15.555094242095947,2 +2790,0.08033429831266403,0.04909905791282654,0.04587889835238457,0.21978364884853363,694.9378051757812,1e-05,0.0632542073726654,5.685421705245972,15.555094242095947,2 +2791,0.05520043522119522,0.10948876291513443,0.10590756684541702,0.13876602053642273,961.1829223632812,1e-05,0.06329629570245743,5.688483238220215,15.555094242095947,2 +2792,0.08960899710655212,0.04436176270246506,0.04701246693730354,0.17697115242481232,817.7731323242188,1e-05,0.06858033686876297,5.680564641952515,15.555094242095947,2 +2793,0.07303840667009354,0.09165119379758835,0.08566603064537048,0.29653042554855347,933.0629272460938,1e-05,0.06251730769872665,5.691831350326538,15.555094242095947,2 +2794,0.07815609872341156,0.09504863619804382,0.10025865584611893,0.21639421582221985,705.574951171875,1e-05,0.06316976249217987,5.689659357070923,15.555094242095947,2 +2795,0.09887484461069107,0.11697829514741898,0.10419528931379318,0.28131410479545593,952.9466552734375,1e-05,0.08147656917572021,5.6827638149261475,15.555094242095947,2 +2796,0.12653467059135437,0.09732215106487274,0.09277890622615814,0.2912660241127014,593.4874267578125,1e-05,0.06530751287937164,5.68224024772644,15.555094242095947,2 +2797,0.06297944486141205,0.12226853519678116,0.11337830871343613,0.22582530975341797,946.0116577148438,1e-05,0.09480203688144684,5.681776523590088,15.555094242095947,2 +2798,0.08392459899187088,0.09888637810945511,0.09291768074035645,0.23735575377941132,963.5654907226562,1e-05,0.05209684371948242,5.686781406402588,15.555094242095947,2 +2799,0.08549845963716507,0.03179242089390755,0.03278319910168648,0.136955127120018,669.14501953125,1e-05,0.06333248317241669,5.678812026977539,15.555094242095947,2 +2800,0.06581854075193405,0.0676736831665039,0.06501372158527374,0.16826121509075165,336.25732421875,1e-05,0.058941785246133804,5.693726062774658,15.555094242095947,2 +2801,0.10500480979681015,0.06174791604280472,0.05818453058600426,0.2009134590625763,706.521728515625,1e-05,0.06225511059165001,5.687314510345459,15.555094242095947,2 +2802,0.11236225068569183,0.1419312208890915,0.13922077417373657,0.195785254240036,509.47869873046875,1e-05,0.057860687375068665,5.689627408981323,15.555094242095947,2 +2803,0.07451450824737549,0.37728485465049744,0.3924882113933563,0.22602562606334686,109.48905944824219,1e-05,0.05399642512202263,5.687458276748657,15.555094242095947,2 +2804,0.06378010660409927,0.06522811949253082,0.06150753051042557,0.2072836458683014,596.2343139648438,1e-05,0.08439460396766663,5.685553312301636,15.555094242095947,2 +2805,0.10238233208656311,0.26713675260543823,0.24873900413513184,0.2707291543483734,995.9349365234375,1e-05,0.07009159028530121,5.684889554977417,15.555094242095947,2 +2806,0.07619175314903259,0.12435872107744217,0.11037572473287582,0.22499999403953552,979.6713256835938,1e-05,0.056500393897295,5.684124231338501,15.555094242095947,2 +2807,0.09619100391864777,0.06767871975898743,0.06858740746974945,0.1274999976158142,474.5657653808594,1e-05,0.066689632833004,5.680023908615112,15.555094242095947,2 +2808,0.04509635642170906,0.10587222129106522,0.09864587336778641,0.2218429446220398,859.375,1e-05,0.053917501121759415,5.689225196838379,15.555094242095947,2 +2809,0.16594235599040985,0.14083953201770782,0.1424476057291031,0.2413221001625061,285.49383544921875,1e-05,0.07669207453727722,5.6877336502075195,15.555094242095947,2 +2810,0.12360873073339462,0.10379497706890106,0.09696737676858902,0.2541345953941345,538.1549072265625,1e-05,0.06619597226381302,5.69636869430542,15.555094242095947,2 +2811,0.13461638987064362,0.16543379426002502,0.16242380440235138,0.22716344892978668,958.4887084960938,1e-05,0.08072133362293243,5.921794414520264,15.555094242095947,2 +2812,0.13452935218811035,0.05628204718232155,0.05400408059358597,0.21236377954483032,820.7417602539062,1e-05,0.05949384719133377,5.680346250534058,15.555094242095947,2 +2813,0.12603600323200226,0.04663161560893059,0.049006618559360504,0.21732370555400848,785.6611938476562,1e-05,0.06927461177110672,5.680436134338379,15.555094242095947,2 +2814,0.12350484728813171,0.12341323494911194,0.12432432174682617,0.25845351815223694,279.50311279296875,1e-05,0.07279903441667557,5.685082912445068,15.555094242095947,2 +2815,0.10360070317983627,0.1385672688484192,0.1388469785451889,0.20002402365207672,403.11651611328125,1e-05,0.058128222823143005,5.678861141204834,15.555094242095947,2 +2816,0.039449386298656464,0.09510469436645508,0.09238546341657639,0.23600159585475922,894.0774536132812,1e-05,0.05616765096783638,5.808818101882935,15.555094242095947,2 +2817,0.091447614133358,0.09444977343082428,0.08944983780384064,0.25217145681381226,881.0508422851562,1e-05,0.06633807718753815,5.741283655166626,15.555094242095947,2 +2818,0.09307358413934708,0.08977729827165604,0.09088641405105591,0.23212338984012604,647.8805541992188,1e-05,0.06695430725812912,5.689340829849243,15.555094242095947,2 +2819,0.08928178995847702,0.09191648662090302,0.0785684734582901,0.24648235738277435,887.4710083007812,1e-05,0.06309673935174942,5.685091495513916,15.555094242095947,2 +2820,0.059617750346660614,0.07582826912403107,0.07181774824857712,0.20588140189647675,890.3912353515625,1e-05,0.057788025587797165,5.922781944274902,15.555094242095947,2 +2821,0.11691010743379593,0.09334754943847656,0.08833485096693039,0.19923877716064453,601.6597900390625,1e-05,0.05562351644039154,5.6869001388549805,15.555094242095947,2 +2822,0.09581516683101654,0.2329920530319214,0.22979521751403809,0.26713138818740845,248.39744567871094,1e-05,0.05074998363852501,5.682927370071411,15.555094242095947,2 +2823,0.11138736456632614,0.19691726565361023,0.18166962265968323,0.24260415136814117,999.7998046875,1e-05,0.0456354022026062,5.680238485336304,15.555094242095947,2 +2824,0.11364255845546722,0.14039088785648346,0.14409871399402618,0.237644225358963,379.5264587402344,1e-05,0.054020956158638,5.686846733093262,15.555094242095947,2 +2825,0.0856948047876358,0.075925812125206,0.07680616527795792,0.18902242183685303,409.94622802734375,1e-05,0.056402139365673065,5.6829235553741455,15.555094242095947,2 +2826,0.11016157269477844,0.08994563668966293,0.08886302262544632,0.2468108832836151,403.11651611328125,1e-05,0.06385030597448349,5.691509008407593,15.555094242095947,2 +2827,0.09101131558418274,0.09308508038520813,0.09066036343574524,0.16760416328907013,468.75,1e-05,0.05601333826780319,5.762739658355713,15.555094242095947,2 +2828,0.13219678401947021,0.116182841360569,0.12061323970556259,0.1274038404226303,215.23179626464844,1e-05,0.049161966890096664,5.680670261383057,15.555094242095947,2 +2829,0.09283746778964996,0.05546879395842552,0.05489814653992653,0.19305287301540375,569.172119140625,1e-05,0.060459647327661514,5.6838905811309814,15.555094242095947,2 +2830,0.1211511641740799,0.06973349303007126,0.0676330104470253,0.23644229769706726,750.0000610351562,1e-05,0.06583712249994278,5.67968487739563,15.555094242095947,2 +2831,0.09145808219909668,0.08333632349967957,0.08369149267673492,0.16534455120563507,957.1228637695312,1e-05,0.07074198126792908,5.685882329940796,15.555094242095947,2 +2832,0.05177103355526924,0.1478610634803772,0.14284703135490417,0.20213942229747772,975.15380859375,1e-05,0.09596137702465057,5.683916091918945,15.555094242095947,2 +2833,0.11171995848417282,0.08869851380586624,0.0792691707611084,0.2108573615550995,902.7777709960938,1e-05,0.07249905914068222,5.685147523880005,15.555094242095947,2 +2834,0.12550249695777893,0.07353504002094269,0.07140202075242996,0.12666666507720947,567.685546875,1e-05,0.05191193148493767,5.684808969497681,15.555094242095947,2 +2835,0.15279939770698547,0.0921398252248764,0.08761608600616455,0.22291666269302368,567.685546875,1e-05,0.06283950805664062,5.6799962520599365,15.555094242095947,2 +2836,0.09023427963256836,0.0827837735414505,0.0803808718919754,0.1661778837442398,894.8863525390625,1e-05,0.08073051273822784,5.683785915374756,15.555094242095947,2 +2837,0.09820638597011566,0.09465402364730835,0.08509694784879684,0.23012018203735352,692.9590454101562,1e-05,0.06122831627726555,5.6868064403533936,15.555094242095947,2 +2838,0.060248274356126785,0.043136317282915115,0.041329942643642426,0.24255608022212982,889.9769897460938,1e-05,0.0665891095995903,5.967720031738281,15.555094242095947,2 +2839,0.11069448292255402,0.05276528745889664,0.05149602144956589,0.22361376881599426,786.3502197265625,1e-05,0.061835404485464096,5.685914754867554,15.555094242095947,2 +2840,0.047501176595687866,0.0703459158539772,0.06870917975902557,0.28370991349220276,905.0772094726562,1e-05,0.07047983258962631,5.680637359619141,15.555094242095947,2 +2841,0.08833163976669312,0.03179840371012688,0.03431379050016403,0.1708012819290161,894.4823608398438,1e-05,0.0763310045003891,5.914731979370117,15.555094242095947,2 +2842,0.08983740955591202,0.07289178669452667,0.06924156844615936,0.20564903318881989,793.128662109375,1e-05,0.06318926811218262,5.686220407485962,15.555094242095947,2 +2843,0.08803630620241165,0.09413731843233109,0.09430649131536484,0.25883013010025024,979.9048461914062,1e-05,0.06792258471250534,5.6962409019470215,15.555094242095947,2 +2844,0.09864889085292816,0.0821722000837326,0.07721837610006332,0.24376600980758667,661.4877319335938,1e-05,0.05819175764918327,5.6852641105651855,15.555094242095947,2 +2845,0.1011940985918045,0.06542304903268814,0.06534907221794128,0.24391025304794312,597.59912109375,1e-05,0.061126090586185455,5.675065517425537,15.555094242095947,2 +2846,0.07334020733833313,0.08681212365627289,0.08104290068149567,0.22170671820640564,887.0499877929688,1e-05,0.060883574187755585,5.682980060577393,15.555094242095947,2 +2847,0.0705934688448906,0.17058643698692322,0.1676514893770218,0.21137018501758575,970.48291015625,1e-05,0.07064616680145264,5.685168504714966,15.555094242095947,2 +2848,0.06624491512775421,0.08836004883050919,0.07818619906902313,0.28697916865348816,822.50341796875,1e-05,0.056669220328330994,5.685122013092041,15.555094242095947,2 +2849,0.07215730845928192,0.20983220636844635,0.17491967976093292,0.23704326152801514,997.9838256835938,1e-05,0.054712433367967606,5.680304765701294,15.555094242095947,2 +2850,0.0826224833726883,0.09130414575338364,0.08527219295501709,0.2862820327281952,955.7438354492188,1e-05,0.055902957916259766,5.70060133934021,15.555094242095947,2 +2851,0.06425905227661133,0.06454218178987503,0.06196840479969978,0.2545512616634369,796.4441528320312,1e-05,0.0709921196103096,5.696252346038818,15.555094242095947,2 +2852,0.06714307516813278,0.07640177011489868,0.07050144672393799,0.30656248331069946,788.4046630859375,1e-05,0.06605317443609238,5.70533299446106,15.555094242095947,2 +2853,0.08916936814785004,0.08973393589258194,0.08766385912895203,0.20963941514492035,818.3701782226562,1e-05,0.059804610908031464,5.701272487640381,15.555094242095947,2 +2854,0.13289611041545868,0.13027644157409668,0.13105805218219757,0.2007051259279251,305.8912353515625,1e-05,0.06029878184199333,5.69079327583313,15.555094242095947,2 +2855,0.1268719732761383,0.06618883460760117,0.0653080940246582,0.17251601815223694,723.90576171875,1e-05,0.06037065014243126,5.689074516296387,15.555094242095947,2 +2856,0.09916216880083084,0.18146614730358124,0.18082086741924286,0.2893829941749573,317.1641845703125,1e-05,0.04959958419203758,5.6954779624938965,15.555094242095947,2 +2857,0.13444991409778595,0.06307924538850784,0.07070557773113251,0.23241986334323883,285.49383544921875,1e-05,0.07373148202896118,5.701066017150879,15.555094242095947,2 +2858,0.08065865933895111,0.1081710234284401,0.10305994749069214,0.203701913356781,873.4939575195312,1e-05,0.057461582124233246,5.695018768310547,15.555094242095947,2 +2859,0.09909333288669586,0.08390727639198303,0.08354349434375763,0.22225961089134216,827.1312866210938,1e-05,0.059076517820358276,5.693493127822876,15.555094242095947,2 +2860,0.1260003000497818,0.18371744453907013,0.18197692930698395,0.20134614408016205,955.188720703125,1e-05,0.06292826682329178,5.6898133754730225,15.555094242095947,2 +2861,0.10524406284093857,0.08213798701763153,0.07885723561048508,0.2368749976158142,747.5884399414062,1e-05,0.07808589190244675,5.681643486022949,15.555094242095947,2 +2862,0.111607626080513,0.05770759657025337,0.05236689746379852,0.24108171463012695,889.1455078125,1e-05,0.05360177904367447,5.684582471847534,15.555094242095947,2 +2863,0.14104938507080078,0.08104193210601807,0.0740598812699318,0.23106569051742554,943.9275512695312,1e-05,0.06015894189476967,5.689649820327759,15.555094242095947,2 +2864,0.0714849904179573,0.09423721581697464,0.08825662732124329,0.22476762533187866,842.5684204101562,1e-05,0.05478028208017349,5.687873363494873,15.555094242095947,2 +2865,0.09882166981697083,0.09212487190961838,0.09060719609260559,0.1913621723651886,407.6819763183594,1e-05,0.058680105954408646,5.69363260269165,15.555094242095947,2 +2866,0.1152309849858284,0.058470193296670914,0.057238299399614334,0.2416105717420578,741.8699340820312,1e-05,0.0597284659743309,5.685704708099365,15.555094242095947,2 +2867,0.09908316284418106,0.10250861942768097,0.1004706621170044,0.19508011639118195,962.2467651367188,1e-05,0.055840808898210526,5.690210819244385,15.555094242095947,2 +2868,0.08605092018842697,0.053406111896038055,0.05171151086688042,0.268894225358963,697.8798828125,1e-05,0.057715609669685364,5.791576862335205,15.555094242095947,2 +2869,0.07431283593177795,0.06513898819684982,0.06211687624454498,0.19865383207798004,900.8379516601562,1e-05,0.07747022807598114,5.691839933395386,15.555094242095947,2 +2870,0.08109252899885178,0.10064590722322464,0.09474057704210281,0.18445512652397156,970.7328491210938,1e-05,0.06037534028291702,5.681303262710571,15.555094242095947,2 +2871,0.10786551982164383,0.11743824183940887,0.11940430849790573,0.2534695565700531,632.4110717773438,1e-05,0.06561891734600067,5.6829071044921875,15.555094242095947,2 +2872,0.10763510316610336,0.08994093537330627,0.08244536072015762,0.18887819349765778,873.947021484375,1e-05,0.059199489653110504,5.69022798538208,15.555094242095947,2 +2873,0.10792279243469238,0.10346046090126038,0.104978047311306,0.19394229352474213,871.2120971679688,1e-05,0.07846426218748093,5.684815406799316,15.555094242095947,2 +2874,0.051141127943992615,0.11941102147102356,0.11171696335077286,0.2597596049308777,915.4175415039062,1e-05,0.06261781603097916,5.68550968170166,15.555094242095947,2 +2875,0.13479124009609222,0.07597941160202026,0.07407143712043762,0.23818108439445496,558.6282348632812,1e-05,0.06900042295455933,5.68932318687439,15.555094242095947,2 +2876,0.07468094676733017,0.062329716980457306,0.059688717126846313,0.3127884566783905,922.431884765625,1e-05,0.07976050674915314,5.685028791427612,15.555094242095947,2 +2877,0.05446312204003334,0.07141653448343277,0.0711689367890358,0.2131650596857071,723.90576171875,1e-05,0.06800227612257004,5.68087363243103,15.555094242095947,2 +2878,0.07104502618312836,0.11462479829788208,0.11122271418571472,0.20869390666484833,923.458740234375,1e-05,0.07391040772199631,5.930172681808472,15.555094242095947,2 +2879,0.0608491376042366,0.08320147544145584,0.07599717378616333,0.25959935784339905,956.0206298828125,1e-05,0.07053165137767792,5.953500509262085,15.555094242095947,2 +2880,0.12840881943702698,0.17402806878089905,0.1626635044813156,0.21114581823349,967.4503784179688,1e-05,0.07014717906713486,5.846762418746948,15.555094242095947,2 +2881,0.07510726153850555,0.06973517686128616,0.06564615666866302,0.10717146843671799,952.9466552734375,1e-05,0.06637176126241684,5.6807780265808105,15.555094242095947,2 +2882,0.0617407001554966,0.06302216649055481,0.05945532023906708,0.2497195452451706,776.5151977539062,1e-05,0.06974177062511444,5.683623313903809,15.555094242095947,2 +2883,0.08609822392463684,0.11724865436553955,0.11549807339906693,0.21250800788402557,934.9798583984375,1e-05,0.06743598729372025,5.688921689987183,15.555094242095947,2 +2884,0.06092791631817818,0.1363583356142044,0.1262979805469513,0.19014422595500946,985.3936767578125,1e-05,0.0666501373052597,5.9181904792785645,15.555094242095947,2 +2885,0.10788396000862122,0.14462332427501678,0.13514620065689087,0.2188461422920227,986.731201171875,1e-05,0.06431274116039276,5.693854093551636,15.555094242095947,2 +2886,0.08667156845331192,0.05183633789420128,0.050566256046295166,0.29616984724998474,839.89501953125,1e-05,0.059809863567352295,5.919001817703247,15.555094242095947,2 +2887,0.07716529071331024,0.1609046757221222,0.15669602155685425,0.2974839508533478,964.872314453125,1e-05,0.06184103339910507,5.686477899551392,15.555094242095947,2 +2888,0.12635652720928192,0.06363960355520248,0.06258732080459595,0.1789262741804123,736.8637084960938,1e-05,0.07513292133808136,5.6763715744018555,15.555094242095947,2 +2889,0.09293220937252045,0.10748882591724396,0.09994257986545563,0.2739262580871582,871.670654296875,1e-05,0.07167242467403412,5.6913042068481445,15.555094242095947,2 +2890,0.05560990422964096,0.04598033055663109,0.04873574152588844,0.2497115284204483,626.2474975585938,1e-05,0.05828003212809563,5.6797966957092285,15.555094242095947,2 +2891,0.1085304394364357,0.7613826394081116,0.7678172588348389,0.24686697125434875,29.296875,1e-05,0.07882114499807358,5.689117431640625,15.555094242095947,2 +2892,0.05405258387327194,0.1472894698381424,0.14305227994918823,0.2768189013004303,964.3510131835938,1e-05,0.0667751282453537,5.685724973678589,15.555094242095947,2 +2893,0.07890130579471588,0.06733569502830505,0.06376952677965164,0.27407851815223694,879.3001098632812,1e-05,0.07045405358076096,5.678228139877319,15.555094242095947,2 +2894,0.06157783046364784,0.12257842719554901,0.10503320395946503,0.2500801086425781,956.8480224609375,1e-05,0.05604275315999985,5.692104339599609,15.555094242095947,2 +2895,0.11140222102403641,0.09004949778318405,0.08400222659111023,0.2246313989162445,853.9290161132812,1e-05,0.09368501603603363,5.691816568374634,15.555094242095947,2 +2896,0.07697655260562897,0.09529326111078262,0.09430469572544098,0.08094550669193268,988.0552978515625,1e-05,0.06161130219697952,5.683267593383789,15.555094242095947,2 +2897,0.08907689154148102,0.1920495182275772,0.18836206197738647,0.15763621032238007,994.2716674804688,1e-05,0.06894238293170929,5.685143232345581,15.555094242095947,2 +2898,0.1323034167289734,0.09379616379737854,0.08968847990036011,0.2231971025466919,644.3798828125,1e-05,0.0913984477519989,5.682173252105713,15.555094242095947,2 +2899,0.09878166019916534,0.06559442728757858,0.06531928479671478,0.20491985976696014,576.5086669921875,1e-05,0.06812828034162521,5.685234785079956,15.555094242095947,2 +2900,0.097474105656147,0.02212749421596527,0.025047939270734787,0.20261217653751373,803.5714111328125,1e-05,0.06270138174295425,5.907730340957642,15.555094242095947,2 +2901,0.06119486689567566,0.14909008145332336,0.13542510569095612,0.3103765845298767,973.2064208984375,1e-05,0.10307583957910538,5.684592962265015,15.555094242095947,2 +2902,0.08831857144832611,0.3390394151210785,0.33418962359428406,0.20416666567325592,113.63636016845703,1e-05,0.055465586483478546,5.677799701690674,15.555094242095947,2 +2903,0.11050565540790558,0.1257813721895218,0.12969641387462616,0.2634294629096985,967.194580078125,1e-05,0.08402621001005173,5.685473442077637,15.555094242095947,2 +2904,0.08539213240146637,0.1351570338010788,0.13165169954299927,0.10927082598209381,996.9635620117188,1e-05,0.05880880355834961,5.674113750457764,15.555094242095947,2 +2905,0.06362312287092209,0.16789986193180084,0.15872135758399963,0.24940703809261322,987.8356323242188,1e-05,0.05231799930334091,5.6847984790802,15.555094242095947,2 +2906,0.05915176123380661,0.11043694615364075,0.10584429651498795,0.2195112109184265,827.1312866210938,1e-05,0.0512809157371521,5.680597305297852,15.555094242095947,2 +2907,0.02209237590432167,0.3342509865760803,0.3292439579963684,0.18019230663776398,998.592041015625,1e-05,0.04856719821691513,5.685806751251221,15.555094242095947,2 +2908,0.050268497318029404,0.21392083168029785,0.19462090730667114,0.1991666555404663,999.5994262695312,1e-05,0.06836317479610443,5.686885595321655,15.555094242095947,2 +2909,0.08664290606975555,0.10145770013332367,0.09394724667072296,0.24453525245189667,801.64990234375,1e-05,0.06674365699291229,5.6848649978637695,15.555094242095947,2 +2910,0.0770057737827301,0.13068287074565887,0.11982780694961548,0.23655447363853455,968.2146606445312,1e-05,0.051913101226091385,5.6885716915130615,15.555094242095947,2 +2911,0.07410486042499542,0.03432537987828255,0.038724739104509354,0.2579807639122009,878.85986328125,1e-05,0.07215104252099991,5.7029993534088135,15.555094242095947,2 +2912,0.15117964148521423,0.10315808653831482,0.10230688750743866,0.24516025185585022,403.11651611328125,1e-05,0.06982295960187912,5.685941696166992,15.555094242095947,2 +2913,0.05597551912069321,0.08173855394124985,0.07811271399259567,0.15165063738822937,652.4856567382812,1e-05,0.05484917014837265,5.686485528945923,15.555094242095947,2 +2914,0.056794241070747375,0.07258681952953339,0.06964213401079178,0.2475801259279251,909.9564819335938,1e-05,0.06733398139476776,5.718683242797852,15.555094242095947,2 +2915,0.12325392663478851,0.08256714791059494,0.0795670673251152,0.20164261758327484,626.2474975585938,1e-05,0.05228668451309204,5.68764591217041,15.555094242095947,2 +2916,0.07600622624158859,0.11519724130630493,0.12061993777751923,0.21369390189647675,927.8350219726562,1e-05,0.054515913128852844,5.685413837432861,15.555094242095947,2 +2917,0.07957148551940918,0.04072962701320648,0.040830496698617935,0.10916665941476822,763.9968872070312,1e-05,0.0642467588186264,5.792409420013428,15.555094242095947,2 +2918,0.08640435338020325,0.057904068380594254,0.05640673264861107,0.18602563440799713,907.7218017578125,1e-05,0.05930029973387718,5.6920084953308105,15.555094242095947,2 +2919,0.07927443832159042,0.10500437021255493,0.0934029370546341,0.179791659116745,980.37109375,1e-05,0.052620723843574524,5.6881797313690186,15.555094242095947,2 +2920,0.09901707619428635,0.10437104105949402,0.1035895049571991,0.17753204703330994,945.1219482421875,1e-05,0.05689166113734245,5.687001943588257,15.555094242095947,2 +2921,0.05585243180394173,0.08592087775468826,0.08058347553014755,0.25102561712265015,874.3990478515625,1e-05,0.14830268919467926,5.961050748825073,15.555094242095947,2 +2922,0.13190510869026184,0.08225349336862564,0.07636334002017975,0.2455689013004303,538.1549072265625,1e-05,0.0655326098203659,5.89538836479187,15.555094242095947,2 +2923,0.1424407809972763,0.05897475779056549,0.05645088106393814,0.24409453570842743,714.8972778320312,1e-05,0.08124314993619919,5.689770698547363,15.555094242095947,2 +2924,0.170552060008049,0.16091692447662354,0.1598019003868103,0.29741185903549194,238.6731414794922,1e-05,0.06428094208240509,5.894845247268677,15.555094242095947,2 +2925,0.131196990609169,0.03565075621008873,0.03723124787211418,0.100216343998909,815.9722900390625,1e-05,0.08734972774982452,5.898989677429199,15.555094242095947,2 +2926,0.10983128100633621,0.08234012871980667,0.07799513638019562,0.2581730782985687,681.8181762695312,1e-05,0.08401638269424438,5.687938690185547,15.555094242095947,2 +2927,0.08317079395055771,0.0735568255186081,0.06973029673099518,0.14536859095096588,853.4264526367188,1e-05,0.07938623428344727,5.681218385696411,15.555094242095947,2 +2928,0.08195076137781143,0.09965847432613373,0.09423131495714188,0.229463130235672,938.1237182617188,1e-05,0.08501068502664566,5.677527666091919,15.555094242095947,2 +2929,0.06381620466709137,0.07481921464204788,0.07456778734922409,0.1905929446220398,880.177490234375,1e-05,0.07055458426475525,5.707329273223877,15.555094242095947,2 +2930,0.13555973768234253,0.08338742703199387,0.08084278553724289,0.146217942237854,991.7354736328125,1e-05,0.06800782680511475,5.709019660949707,15.555094242095947,2 +2931,0.10420120507478714,0.037384722381830215,0.038766007870435715,0.2773076891899109,651.3410034179688,1e-05,0.06539836525917053,5.701826810836792,15.555094242095947,2 +2932,0.048428088426589966,0.0959768295288086,0.09446732699871063,0.27428683638572693,962.2467651367188,1e-05,0.07354619354009628,5.7812488079071045,15.555094242095947,2 +2933,0.07640185207128525,0.05021798983216286,0.04950523376464844,0.2609134614467621,797.7569580078125,1e-05,0.05674333497881889,5.6877171993255615,15.555094242095947,2 +2934,0.11230452358722687,0.08399532735347748,0.08216703683137894,0.249126598238945,431.9371643066406,1e-05,0.05562639236450195,5.691214084625244,15.555094242095947,2 +2935,0.09010741114616394,0.07795299589633942,0.07560887187719345,0.27408653497695923,412.1983947753906,1e-05,0.07088306546211243,5.723369598388672,15.555094242095947,2 +2936,0.06059444323182106,0.07825891673564911,0.07272458076477051,0.16931089758872986,718.5374145507812,1e-05,0.057376936078071594,5.701925277709961,15.555094242095947,2 +2937,0.11948585510253906,0.1033739373087883,0.09910497814416885,0.2304246723651886,524.9420166015625,1e-05,0.07863250374794006,5.682101011276245,15.555094242095947,2 +2938,0.07746511697769165,0.09630469232797623,0.09812485426664352,0.2749839723110199,917.9064331054688,1e-05,0.06386274099349976,5.688709735870361,15.555094242095947,2 +2939,0.09770843386650085,0.07652679830789566,0.07525232434272766,0.12327723950147629,925.1558837890625,1e-05,0.059381503611803055,5.68970799446106,15.555094242095947,2 +2940,0.13623738288879395,0.25296416878700256,0.25025245547294617,0.27068910002708435,179.79454040527344,1e-05,0.0827750563621521,5.6787779331207275,15.555094242095947,2 +2941,0.051766376942396164,0.11374588310718536,0.11114201694726944,0.22476762533187866,918.259033203125,1e-05,0.053952403366565704,5.694092750549316,15.555094242095947,2 +2942,0.0600915253162384,0.05386430025100708,0.0604524165391922,0.1908653825521469,950.9569091796875,1e-05,0.07729257643222809,6.062146902084351,15.555094242095947,2 +2943,0.07054763287305832,0.175477534532547,0.1616567075252533,0.23093749582767487,979.2027587890625,1e-05,0.08114556223154068,5.695469379425049,15.555094242095947,2 +2944,0.12452910840511322,0.1405010223388672,0.13971325755119324,0.14058493077754974,995.728271484375,1e-05,0.06845561414957047,5.818673610687256,15.555094242095947,2 +2945,0.11372257769107819,0.030180802568793297,0.028640950098633766,0.09805288165807724,823.0874633789062,1e-05,0.08581379801034927,5.8878819942474365,15.555094242095947,2 +2946,0.07364382594823837,0.062013786286115646,0.058093659579753876,0.24568909406661987,934.3434448242188,1e-05,0.07013316452503204,5.679967403411865,15.555094242095947,2 +2947,0.07675658166408539,0.07440730184316635,0.07038351148366928,0.2095993459224701,557.0953369140625,1e-05,0.05762292817234993,5.693962812423706,15.555094242095947,2 +2948,0.05605919286608696,0.08070440590381622,0.08083458244800568,0.24905447661876678,870.2915649414062,1e-05,0.06597843021154404,5.684729814529419,15.555094242095947,2 +2949,0.100486621260643,0.12307371199131012,0.11901986598968506,0.19592146575450897,891.2169799804688,1e-05,0.10416361689567566,5.678679943084717,15.555094242095947,2 +2950,0.08131875097751617,0.151484414935112,0.14326103031635284,0.20479166507720947,984.494384765625,1e-05,0.06701380014419556,5.689123630523682,15.555094242095947,2 +2951,0.09317746758460999,0.34665343165397644,0.35516706109046936,0.22911858558654785,995.10595703125,1e-05,0.07404736429452896,5.690816164016724,15.555094242095947,2 +2952,0.09022605419158936,0.047296829521656036,0.04415203258395195,0.07516025006771088,941.8146362304688,1e-05,0.09083353728055954,5.693976640701294,15.555094242095947,2 +2953,0.09434886276721954,0.06653054803609848,0.06332985311746597,0.18920671939849854,863.2425537109375,1e-05,0.08772402256727219,5.689821243286133,15.555094242095947,2 +2954,0.1286943256855011,0.048466768115758896,0.04887046292424202,0.1846073716878891,716.7235717773438,1e-05,0.07313208281993866,5.687729835510254,15.555094242095947,2 +2955,0.07104448229074478,0.06396937370300293,0.05922257527709007,0.15371794998645782,837.7308349609375,1e-05,0.09230298548936844,5.68753981590271,15.555094242095947,2 +2956,0.07292617857456207,0.0709378719329834,0.07211409509181976,0.2247355729341507,939.0547485351562,1e-05,0.10086646676063538,5.684251308441162,15.555094242095947,2 +2957,0.06843488663434982,0.07030833512544632,0.06992480158805847,0.12042467296123505,979.6713256835938,1e-05,0.06092157959938049,5.697524309158325,15.555094242095947,2 +2958,0.09076466411352158,0.12557847797870636,0.1369001716375351,0.20328524708747864,279.50311279296875,1e-05,0.0785849541425705,5.699341773986816,15.555094242095947,2 +2959,0.0855727344751358,0.10978882759809494,0.09868698567152023,0.2194390892982483,937.1871948242188,1e-05,0.12053094059228897,5.695137977600098,15.555094242095947,2 +2960,0.14419087767601013,0.057323724031448364,0.05648353323340416,0.10737179219722748,958.2166748046875,1e-05,0.09334923326969147,5.687356472015381,15.555094242095947,2 +2961,0.14062124490737915,0.05567082762718201,0.054587095975875854,0.1266506314277649,764.7515258789062,1e-05,0.06722431629896164,5.691059827804565,15.555094242095947,2 +2962,0.14656056463718414,0.07655126601457596,0.0750059187412262,0.2403605729341507,364.73089599609375,1e-05,0.08699017763137817,5.691071271896362,15.555094242095947,2 +2963,0.06326904892921448,0.0937294214963913,0.08118012547492981,0.2661858797073364,930.143310546875,1e-05,0.12690944969654083,5.68787693977356,15.555094242095947,2 +2964,0.07862099260091782,0.07859884202480316,0.08390983194112778,0.26383012533187866,967.7055053710938,1e-05,0.07904140651226044,5.931061506271362,15.555094242095947,2 +2965,0.10914722830057144,0.06761123985052109,0.06305033713579178,0.24223557114601135,818.9655151367188,1e-05,0.09225666522979736,5.700039386749268,15.555094242095947,2 +2966,0.10116640478372574,0.07646247744560242,0.06780966371297836,0.22692306339740753,935.2970581054688,1e-05,0.092838354408741,5.6835949420928955,15.555094242095947,2 +2967,0.11569955945014954,0.08955967426300049,0.08395591378211975,0.2522355616092682,604.3388061523438,1e-05,0.10901010036468506,5.679605960845947,15.555094242095947,2 +2968,0.11720529198646545,0.2921702265739441,0.2888825237751007,0.20459133386611938,183.4470977783203,1e-05,0.07901440560817719,5.824234485626221,15.555094242095947,2 +2969,0.07895314693450928,0.07006897032260895,0.066898874938488,0.29586538672447205,797.1013793945312,1e-05,0.0755901113152504,5.692209005355835,15.555094242095947,2 +2970,0.13462594151496887,0.08342982828617096,0.07804660499095917,0.26392626762390137,509.47869873046875,1e-05,0.07362344861030579,5.677016496658325,15.555094242095947,2 +2971,0.0899541899561882,0.12708644568920135,0.12084697932004929,0.23213940858840942,979.4371948242188,1e-05,0.06396140158176422,5.690887689590454,15.555094242095947,2 +2972,0.09256056696176529,0.13488474488258362,0.12560142576694489,0.19706730544567108,904.6961059570312,1e-05,0.05882568657398224,5.68524956703186,15.555094242095947,2 +2973,0.05256552994251251,0.04926956817507744,0.04940396547317505,0.20956729352474213,484.06866455078125,1e-05,0.09674184769392014,5.690969228744507,15.555094242095947,2 +2974,0.11164288222789764,0.12208657711744308,0.12302311509847641,0.24972756206989288,303.0303039550781,1e-05,0.06906947493553162,5.918549537658691,15.555094242095947,2 +2975,0.07499592751264572,0.09335257858037949,0.08995821326971054,0.2295592874288559,998.18701171875,1e-05,0.05926781892776489,5.688347816467285,15.555094242095947,2 +2976,0.10898998379707336,0.07153517007827759,0.06258523464202881,0.2076602429151535,854.930419921875,1e-05,0.10235253721475601,5.6832499504089355,15.555094242095947,2 +2977,0.06247430667281151,0.1264803260564804,0.1331188976764679,0.16979967057704926,959.3023071289062,1e-05,0.07707414031028748,5.687917709350586,15.555094242095947,2 +2978,0.07393097877502441,0.0760936513543129,0.07150629162788391,0.24838140606880188,689.9642333984375,1e-05,0.07346617430448532,5.686275482177734,15.555094242095947,2 +2979,0.10990986227989197,0.09559337049722672,0.09249740093946457,0.22565704584121704,700.7908935546875,1e-05,0.09135337173938751,5.682108640670776,15.555094242095947,2 +2980,0.1551682949066162,0.08759273588657379,0.08100054413080215,0.18575319647789001,637.2549438476562,1e-05,0.09139856696128845,5.740849733352661,15.555094242095947,2 +2981,0.09751210361719131,0.22576862573623657,0.19170400500297546,0.24810095131397247,999.1974487304688,1e-05,0.0615387037396431,5.685335159301758,15.555094242095947,2 +2982,0.05997039005160332,0.10189982503652573,0.0944288969039917,0.25575318932533264,847.2938232421875,1e-05,0.07972133904695511,5.684808731079102,15.555094242095947,2 +2983,0.059583451598882675,0.7581917643547058,0.7624498009681702,0.20024839043617249,38.75969314575195,1e-05,0.07951028645038605,5.676639795303345,15.555094242095947,2 +2984,0.08310960978269577,0.07084055244922638,0.06844586879014969,0.2669631242752075,753.1796264648438,1e-05,0.09025348722934723,5.680618524551392,15.555094242095947,2 +2985,0.08478018641471863,0.06317850202322006,0.060423191636800766,0.23499998450279236,908.0963134765625,1e-05,0.08095074445009232,6.160040378570557,15.555094242095947,2 +2986,0.0988815501332283,0.11521703749895096,0.115871861577034,0.3026522397994995,933.3839721679688,1e-05,0.06468494236469269,5.702148199081421,15.555094242095947,2 +2987,0.11076241731643677,0.12002600729465485,0.11691085994243622,0.2295592874288559,926.5010375976562,1e-05,0.09885246306657791,5.924693584442139,15.555094242095947,2 +2988,0.10290148109197617,0.03983688727021217,0.04028788208961487,0.06749198585748672,655.8935546875,1e-05,0.058468256145715714,5.693706274032593,15.555094242095947,2 +2989,0.10923469066619873,0.24626415967941284,0.24342584609985352,0.29366186261177063,187.07484436035156,1e-05,0.08292815089225769,5.69040060043335,15.555094242095947,2 +2990,0.09851745516061783,0.07530465722084045,0.07110777497291565,0.26018428802490234,862.2828979492188,1e-05,0.11146200448274612,5.6936821937561035,15.555094242095947,2 +2991,0.08385706692934036,0.09585409611463547,0.08839517831802368,0.20432691276073456,931.447509765625,1e-05,0.0576268807053566,5.691669940948486,15.555094242095947,2 +2992,0.11256016790866852,0.05703195929527283,0.05522073432803154,0.2594470977783203,723.90576171875,1e-05,0.09231220185756683,5.689411401748657,15.555094242095947,2 +2993,0.03955797478556633,0.18155984580516815,0.16774366796016693,0.18087339401245117,978.2608642578125,1e-05,0.06790249794721603,5.699138641357422,15.555094242095947,2 +2994,0.05946888402104378,0.09075738489627838,0.08465101569890976,0.22750800848007202,987.8356323242188,1e-05,0.058963775634765625,5.694572448730469,15.555094242095947,2 +2995,0.08394718170166016,0.049981262534856796,0.05509428307414055,0.18294870853424072,751.5949096679688,1e-05,0.05432356148958206,5.713989496231079,15.555094242095947,2 +2996,0.12232845276594162,0.06367915868759155,0.05589273199439049,0.22037659585475922,603.0020751953125,1e-05,0.06574693322181702,5.682076930999756,15.555094242095947,2 +2997,0.08336994051933289,0.05846928432583809,0.058156825602054596,0.28360575437545776,837.1862182617188,1e-05,0.05263825133442879,5.900346517562866,15.555094242095947,2 +2998,0.14065542817115784,0.03333480283617973,0.034703437238931656,0.08094550669193268,794.4606323242188,1e-05,0.06120580807328224,5.73119044303894,15.555094242095947,2 +2999,0.10907946527004242,0.12625890970230103,0.12176208198070526,0.297660231590271,963.0394287109375,1e-05,0.07038374990224838,5.680905342102051,15.555094242095947,2 +3000,0.08713852614164352,0.06672682613134384,0.06276755034923553,0.20125800371170044,895.2894897460938,1e-05,0.06725994497537613,5.691830396652222,15.555094242095947,2 +3001,0.06372452527284622,0.07884901762008667,0.0760047659277916,0.21352563798427582,903.5476684570312,1e-05,0.06055948883295059,5.669024705886841,15.555094242095947,2 +3002,0.06734599173069,0.03364143893122673,0.03650984540581703,0.17412659525871277,700.7908935546875,1e-05,0.06948123872280121,5.708834886550903,15.555094242095947,2 +3003,0.07663213461637497,0.06853556632995605,0.06697557866573334,0.2401522397994995,780.0751953125,1e-05,0.08020012825727463,5.7117509841918945,15.555094242095947,2 +3004,0.03213992342352867,0.11810297518968582,0.11213941872119904,0.2849999964237213,947.775634765625,1e-05,0.06853111833333969,5.704378604888916,15.555094242095947,2 +3005,0.08883698284626007,0.13452942669391632,0.1375998705625534,0.20740383863449097,952.6641235351562,1e-05,0.0595005638897419,5.695204973220825,15.555094242095947,2 +3006,0.09085551649332047,0.08376319706439972,0.08384142816066742,0.18825319409370422,904.3141479492188,1e-05,0.05415533483028412,5.7653350830078125,15.555094242095947,2 +3007,0.07812412083148956,0.07188398391008377,0.06312531232833862,0.24205929040908813,723.0185546875,1e-05,0.06229905039072037,5.726147890090942,15.555094242095947,2 +3008,0.09842222929000854,0.08613978326320648,0.08802981674671173,0.24128204584121704,790.4412231445312,1e-05,0.07023175060749054,5.687599182128906,15.555094242095947,2 +3009,0.0781073272228241,0.0547633059322834,0.05139528959989548,0.2616025507450104,871.2120971679688,1e-05,0.0745556652545929,5.689685344696045,15.555094242095947,2 +3010,0.09624979645013809,0.055014509707689285,0.05284610763192177,0.1254006326198578,573.5930786132812,1e-05,0.07355543971061707,5.6944756507873535,15.555094242095947,2 +3011,0.09678792208433151,0.18610389530658722,0.1672196239233017,0.2697836458683014,964.872314453125,1e-05,0.07523299753665924,5.682738542556763,15.555094242095947,2 +3012,0.06810203194618225,0.06501112133264542,0.06533782184123993,0.2387099266052246,913.6167602539062,1e-05,0.07553640753030777,5.7035911083221436,15.555094242095947,2 +3013,0.08706846833229065,0.07622634619474411,0.07305071502923965,0.24712339043617249,932.7411499023438,1e-05,0.055771566927433014,5.682656764984131,15.555094242095947,2 +3014,0.14258722960948944,0.12252815812826157,0.11595716327428818,0.2275320440530777,929.1580810546875,1e-05,0.10907983779907227,5.687462091445923,15.555094242095947,2 +3015,0.0772569552063942,0.029867593199014664,0.03021438606083393,0.12439903616905212,802.9328002929688,1e-05,0.06550537794828415,5.687789440155029,15.555094242095947,2 +3016,0.09605618566274643,0.07635778933763504,0.07478565722703934,0.23366184532642365,801.64990234375,1e-05,0.06366793066263199,5.685894727706909,15.555094242095947,2 +3017,0.10606133937835693,0.2995060682296753,0.2989513874053955,0.217403843998909,121.84115600585938,1e-05,0.07829847186803818,5.690867900848389,15.555094242095947,2 +3018,0.12843354046344757,0.08642201870679855,0.08240970224142075,0.24516025185585022,478.3950500488281,1e-05,0.07051919400691986,5.693303823471069,15.555094242095947,2 +3019,0.07683838158845901,0.048511259257793427,0.04513801634311676,0.21452723443508148,810.4782104492188,1e-05,0.07190842926502228,5.687139272689819,15.555094242095947,2 +3020,0.07431139051914215,0.030657706782221794,0.03512114658951759,0.152211531996727,516.4320068359375,1e-05,0.06892766803503036,5.694967269897461,15.555094242095947,2 +3021,0.09782607853412628,0.07002001255750656,0.0702095702290535,0.2561618387699127,912.162109375,1e-05,0.09218558669090271,5.815314292907715,15.555094242095947,2 +3022,0.08367554843425751,0.060006026178598404,0.057713840156793594,0.12439903616905212,724.7899169921875,1e-05,0.07404254376888275,5.685501575469971,15.555094242095947,2 +3023,0.04736948013305664,0.06679529696702957,0.0680241584777832,0.09749198704957962,949.8078002929688,1e-05,0.0587616041302681,5.683385610580444,15.555094242095947,2 +3024,0.13876986503601074,0.08214671909809113,0.07371813803911209,0.23294870555400848,932.7411499023438,1e-05,0.0799817368388176,5.684735536575317,15.555094242095947,2 +3025,0.054082781076431274,0.16143156588077545,0.1492970585823059,0.24418267607688904,988.0552978515625,1e-05,0.05801801756024361,5.681614398956299,15.555094242095947,2 +3026,0.054635051637887955,0.10784339159727097,0.10497181117534637,0.21357370913028717,988.4937133789062,1e-05,0.052487604320049286,5.710528612136841,15.555094242095947,2 +3027,0.09023988991975784,0.17148280143737793,0.15760251879692078,0.25711536407470703,998.592041015625,1e-05,0.07024778425693512,5.6845481395721436,15.555094242095947,2 +3028,0.08507729321718216,0.09264709800481796,0.08839788287878036,0.22954325377941132,960.6482543945312,1e-05,0.06610812991857529,6.133340120315552,15.555094242095947,2 +3029,0.08210860192775726,0.07669876515865326,0.0807976946234703,0.17286057770252228,482.1867370605469,1e-05,0.07392129302024841,5.68480920791626,15.555094242095947,2 +3030,0.053598251193761826,0.12214890867471695,0.11249469965696335,0.26529645919799805,966.6818237304688,1e-05,0.06580782681703568,5.698679447174072,15.555094242095947,2 +3031,0.07776890695095062,0.06986924260854721,0.06591824442148209,0.2995592951774597,688.9586791992188,1e-05,0.06767278164625168,5.694941759109497,15.555094242095947,2 +3032,0.09442650526762009,0.100466288626194,0.09385745227336884,0.261658638715744,905.8369750976562,1e-05,0.06542409211397171,5.691251516342163,15.555094242095947,2 +3033,0.07217966020107269,0.10371039062738419,0.10170429944992065,0.19306890666484833,956.8480224609375,1e-05,0.06345291435718536,5.689883708953857,15.555094242095947,2 +3034,0.0765678882598877,0.07228323817253113,0.06570946425199509,0.21298076212406158,776.5151977539062,1e-05,0.05512213334441185,5.6928510665893555,15.555094242095947,2 +3035,0.07882709801197052,0.2624327540397644,0.25930365920066833,0.25033652782440186,141.84397888183594,1e-05,0.05915047600865364,5.693870544433594,15.555094242095947,2 +3036,0.11391862481832504,0.06550902873277664,0.061113953590393066,0.2550400495529175,947.775634765625,1e-05,0.07749006152153015,5.695133924484253,15.555094242095947,2 +3037,0.1001645177602768,0.08428370952606201,0.08082235604524612,0.2333173006772995,858.8861083984375,1e-05,0.06674706190824509,5.931082725524902,15.555094242095947,2 +3038,0.08139263093471527,0.08611433953046799,0.0835888609290123,0.2430528700351715,894.8863525390625,1e-05,0.07082954049110413,5.983916521072388,15.555094242095947,2 +3039,0.08408796787261963,0.06680215150117874,0.06692859530448914,0.168782040476799,930.143310546875,1e-05,0.061161790043115616,5.692644357681274,15.555094242095947,2 +3040,0.08197744190692902,0.02674134448170662,0.029672911390662193,0.15533652901649475,495.1690979003906,1e-05,0.058768607676029205,5.693754196166992,15.555094242095947,2 +3041,0.05888838320970535,0.06166322901844978,0.06222286820411682,0.20249998569488525,961.1829223632812,1e-05,0.06700693070888519,5.712958812713623,15.555094242095947,2 +3042,0.0659642443060875,0.08732625097036362,0.08424532413482666,0.19458332657814026,925.8298950195312,1e-05,0.05848051235079765,5.754930019378662,15.555094242095947,2 +3043,0.0977700725197792,0.09552035480737686,0.09320232272148132,0.2470112144947052,617.4088745117188,1e-05,0.07101644575595856,5.701453685760498,15.555094242095947,2 +3044,0.07488161325454712,0.04977039992809296,0.047913119196891785,0.2167387753725052,840.4324951171875,1e-05,0.06433075666427612,5.693234920501709,15.555094242095947,2 +3045,0.08025123178958893,0.08431048691272736,0.08046410232782364,0.2425640970468521,769.9692993164062,1e-05,0.07288993895053864,5.695168733596802,15.555094242095947,2 +3046,0.11469856649637222,0.10851870477199554,0.11171405762434006,0.29825320839881897,264.1955871582031,1e-05,0.07482223212718964,5.699723482131958,15.555094242095947,2 +3047,0.07837487757205963,0.07908636331558228,0.08777720481157303,0.24794068932533264,970.9821166992188,1e-05,0.05867651477456093,5.698095083236694,15.555094242095947,2 +3048,0.09193293005228043,0.18218548595905304,0.18108688294887543,0.22960735857486725,225.4098358154297,1e-05,0.07819456607103348,5.693303823471069,15.555094242095947,2 +3049,0.11650147289037704,0.08837739378213882,0.08325576782226562,0.25177082419395447,833.8881225585938,1e-05,0.06679478287696838,5.931356191635132,15.555094242095947,2 +3050,0.046757787466049194,0.21426700055599213,0.2118670791387558,0.28903043270111084,990.448486328125,1e-05,0.061701517552137375,5.683022499084473,15.555094242095947,2 +3051,0.09058655053377151,0.05683106929063797,0.05402980372309685,0.1990785151720047,785.6611938476562,1e-05,0.08022918552160263,5.685395240783691,15.555094242095947,2 +3052,0.12156395614147186,0.09975380450487137,0.09257086366415024,0.2578205168247223,908.0963134765625,1e-05,0.07094227522611618,5.686507225036621,15.555094242095947,2 +3053,0.05996870994567871,0.1467273235321045,0.13676562905311584,0.2749118506908417,978.7327270507812,1e-05,0.06172936037182808,5.678445816040039,15.555094242095947,2 +3054,0.09523210674524307,0.08662872761487961,0.09631596505641937,0.11929486691951752,336.25732421875,1e-05,0.06464932858943939,5.684253454208374,15.555094242095947,2 +3055,0.055351629853248596,0.14647211134433746,0.14131562411785126,0.28496792912483215,985.8411254882812,1e-05,0.0541071780025959,5.683255910873413,15.555094242095947,2 +3056,0.0771510899066925,0.05582059547305107,0.053119637072086334,0.22565704584121704,791.788818359375,1e-05,0.06165318191051483,5.6796629428863525,15.555094242095947,2 +3057,0.1139698177576065,0.09370172023773193,0.0941040962934494,0.21590544283390045,865.1477661132812,1e-05,0.06298177689313889,5.686829328536987,15.555094242095947,2 +3058,0.06591694056987762,0.07333576679229736,0.07041678577661514,0.2709134519100189,533.2568969726562,1e-05,0.06483183801174164,5.927206039428711,15.555094242095947,2 +3059,0.11722041666507721,0.10500328987836838,0.101677805185318,0.22748397290706635,810.4782104492188,1e-05,0.07169898599386215,5.92941689491272,15.555094242095947,2 +3060,0.05444389954209328,0.06760001927614212,0.0629219338297844,0.12274038046598434,909.21484375,1e-05,0.06466629356145859,5.735174655914307,15.555094242095947,2 +3061,0.1224985271692276,0.06275658309459686,0.06311701983213425,0.2437339723110199,740.2120361328125,1e-05,0.06787505745887756,5.6939733028411865,15.555094242095947,2 +3062,0.067864790558815,0.09367622435092926,0.09266352653503418,0.17162659764289856,836.0927734375,1e-05,0.0531005896627903,5.692309379577637,15.555094242095947,2 +3063,0.09026973694562912,0.014118542894721031,0.014385177753865719,0.12421473860740662,644.3798828125,1e-05,0.06595981121063232,5.692281007766724,15.555094242095947,2 +3064,0.08055251836776733,0.055568307638168335,0.05353226512670517,0.10714743286371231,521.561767578125,1e-05,0.05908037722110748,5.687624454498291,15.555094242095947,2 +3065,0.0699838399887085,0.0817839503288269,0.07804173976182938,0.15492787957191467,928.828369140625,1e-05,0.05306068807840347,5.689822435379028,15.555094242095947,2 +3066,0.08393487334251404,0.057783342897892,0.05431581288576126,0.2496153712272644,908.0963134765625,1e-05,0.05793460085988045,5.696497440338135,15.555094242095947,2 +3067,0.07292944937944412,0.15078185498714447,0.14339599013328552,0.2769310772418976,994.89794921875,1e-05,0.06448512524366379,5.687938451766968,15.555094242095947,2 +3068,0.06131597235798836,0.09131027013063431,0.08259610086679459,0.2552964687347412,828.2725830078125,1e-05,0.06917649507522583,5.69194483757019,15.555094242095947,2 +3069,0.06423021852970123,0.039318621158599854,0.042192719876766205,0.2388221025466919,723.90576171875,1e-05,0.06094314530491829,5.692669868469238,15.555094242095947,2 +3070,0.1350412368774414,0.07518523186445236,0.0764409676194191,0.19590544700622559,745.9677734375,1e-05,0.0621330700814724,5.67918848991394,15.555094242095947,2 +3071,0.05039730295538902,0.08482756465673447,0.08667636662721634,0.21984775364398956,950.6705322265625,1e-05,0.06258855015039444,5.961836576461792,15.555094242095947,2 +3072,0.11164901405572891,0.0672503262758255,0.06407348811626434,0.24443107843399048,886.2048950195312,1e-05,0.05426355451345444,5.6983723640441895,15.555094242095947,2 +3073,0.10672584921121597,0.15564019978046417,0.14537940919399261,0.2291666567325592,978.9678955078125,1e-05,0.06629390269517899,5.700388431549072,15.555094242095947,2 +3074,0.07966919988393784,0.13767991960048676,0.1393599659204483,0.25064101815223694,989.8002319335938,1e-05,0.0532686673104763,5.702524900436401,15.555094242095947,2 +3075,0.10159924626350403,0.09565082937479019,0.08818549662828445,0.2292788326740265,925.1558837890625,1e-05,0.05525224283337593,5.702450275421143,15.555094242095947,2 +3076,0.09254289418458939,0.039716433733701706,0.039646584540605545,0.08564101904630661,811.7109985351562,1e-05,0.06131204962730408,5.693192005157471,15.555094242095947,2 +3077,0.05823510140180588,0.12955060601234436,0.1265197992324829,0.13249999284744263,979.2027587890625,1e-05,0.05313165858387947,5.69209623336792,15.555094242095947,2 +3078,0.11004716157913208,0.09514550119638443,0.09338893741369247,0.2264743447303772,875.2998046875,1e-05,0.06186213716864586,5.693615198135376,15.555094242095947,2 +3079,0.09626747667789459,0.04482390731573105,0.04511546716094017,0.12183493375778198,773.6281127929688,1e-05,0.06914477795362473,5.694173812866211,15.555094242095947,2 +3080,0.08357354253530502,0.1124257892370224,0.11346554756164551,0.3047836422920227,801.64990234375,1e-05,0.055267296731472015,5.9396891593933105,15.555094242095947,2 +3081,0.11021813750267029,0.07270005345344543,0.07723391801118851,0.2840544879436493,429.7900695800781,1e-05,0.05543608218431473,5.688832998275757,15.555094242095947,2 +3082,0.05247768759727478,0.06874585151672363,0.0639151856303215,0.26346153020858765,861.318359375,1e-05,0.054276250302791595,5.6876060962677,15.555094242095947,2 +3083,0.06846131384372711,0.10901451855897903,0.09674616158008575,0.26143428683280945,867.5030517578125,1e-05,0.049107663333415985,5.688695430755615,15.555094242095947,2 +3084,0.079190194606781,0.07346349954605103,0.06946379691362381,0.20413461327552795,671.2963256835938,1e-05,0.06845443695783615,5.70082426071167,15.555094242095947,2 +3085,0.11984317749738693,0.16117119789123535,0.16049882769584656,0.1656089723110199,291.41107177734375,1e-05,0.07259169220924377,5.69188117980957,15.555094242095947,2 +3086,0.12929174304008484,0.12484395503997803,0.1191808357834816,0.2133493572473526,619.959716796875,1e-05,0.0644633024930954,5.6997246742248535,15.555094242095947,2 +3087,0.061018843203783035,0.17437100410461426,0.166221484541893,0.2105528712272644,981.5291137695312,1e-05,0.05487915128469467,5.690965175628662,15.555094242095947,2 +3088,0.10136217623949051,0.05131559446454048,0.051501356065273285,0.11566506326198578,683.8768310546875,1e-05,0.07676836103200912,5.692285537719727,15.555094242095947,2 +3089,0.03624316677451134,0.06357051432132721,0.06293248385190964,0.2199038416147232,815.3685913085938,1e-05,0.05091428756713867,5.698864221572876,15.555094242095947,2 +3090,0.09981125593185425,0.05179920792579651,0.05088049918413162,0.27368587255477905,480.2955627441406,1e-05,0.05484221503138542,5.6948606967926025,15.555094242095947,2 +3091,0.11345894634723663,0.0875047892332077,0.09073078632354736,0.25516825914382935,851.403076171875,1e-05,0.07072804868221283,5.681142807006836,15.555094242095947,2 +3092,0.0862841084599495,0.055584728717803955,0.05595601722598076,0.21763621270656586,586.51806640625,1e-05,0.07397299259901047,5.680282354354858,15.555094242095947,2 +3093,0.07828835397958755,0.05270399525761604,0.048202451318502426,0.2259855717420578,818.3701782226562,1e-05,0.06320340931415558,5.690618276596069,15.555094242095947,2 +3094,0.09624175727367401,0.1581229269504547,0.15463179349899292,0.25621792674064636,270.376220703125,1e-05,0.058663398027420044,5.679857492446899,15.555094242095947,2 +3095,0.05092158168554306,0.16180311143398285,0.15819953382015228,0.16623397171497345,990.0166625976562,1e-05,0.05689512938261032,5.682287693023682,15.555094242095947,2 +3096,0.10905075073242188,0.0623914860188961,0.06016550213098526,0.23532050848007202,514.7058715820312,1e-05,0.07883995771408081,5.694035291671753,15.555094242095947,2 +3097,0.08104988187551498,0.0530027411878109,0.054216962307691574,0.2367868572473526,763.9968872070312,1e-05,0.055908314883708954,5.838699817657471,15.555094242095947,2 +3098,0.07382616400718689,0.12034714221954346,0.11603909730911255,0.2133413404226303,959.8422241210938,1e-05,0.07086201757192612,5.696397066116333,15.555094242095947,2 +3099,0.06557312607765198,0.10530785471200943,0.0992896631360054,0.22294871509075165,967.4503784179688,1e-05,0.0842236801981926,5.690087080001831,15.555094242095947,2 +3100,0.1257811188697815,0.09335417300462723,0.0861789733171463,0.23559294641017914,802.292236328125,1e-05,0.08157254010438919,5.693233251571655,15.555094242095947,2 +3101,0.06489508599042892,0.06018294766545296,0.05840914696455002,0.2347676157951355,863.2425537109375,1e-05,0.068819560110569,5.68950891494751,15.555094242095947,2 +3102,0.050845950841903687,0.10163569450378418,0.09594020247459412,0.10476762801408768,978.4969482421875,1e-05,0.08158440887928009,5.88184380531311,15.555094242095947,2 +3103,0.07222308963537216,0.06664300709962845,0.06404738128185272,0.25362980365753174,864.6732177734375,1e-05,0.06640872359275818,5.686113595962524,15.555094242095947,2 +3104,0.09992218762636185,0.06461768597364426,0.06282380223274231,0.2562580108642578,716.7235717773438,1e-05,0.07241275906562805,5.6785337924957275,15.555094242095947,2 +3105,0.10969288647174835,0.0672493577003479,0.0659579187631607,0.2659454941749573,651.3410034179688,1e-05,0.08930358290672302,5.688324689865112,15.555094242095947,2 +3106,0.10823677480220795,0.18312841653823853,0.16865770518779755,0.21877403557300568,998.3897094726562,1e-05,0.06597225368022919,5.677195072174072,15.555094242095947,2 +3107,0.07212495058774948,0.08185886591672897,0.07975760102272034,0.17992787063121796,798.4103393554688,1e-05,0.06623038649559021,5.696831941604614,15.555094242095947,2 +3108,0.11110411584377289,0.10769667476415634,0.10179802030324936,0.25929486751556396,741.8699340820312,1e-05,0.09059543907642365,5.683281660079956,15.555094242095947,2 +3109,0.07030834257602692,0.15956588089466095,0.1506417691707611,0.18427082896232605,999.7998046875,1e-05,0.061501916497945786,5.840083837509155,15.555094242095947,2 +3110,0.13610246777534485,0.09718767553567886,0.09678228199481964,0.24597755074501038,526.620361328125,1e-05,0.0714002251625061,5.688793182373047,15.555094242095947,2 +3111,0.09091725200414658,0.097296342253685,0.08961918205022812,0.2597676217556,897.6888427734375,1e-05,0.08703193813562393,5.6861348152160645,15.555094242095947,2 +3112,0.08051272481679916,0.1425139307975769,0.1411518007516861,0.24606569111347198,950.9569091796875,1e-05,0.06240363046526909,5.710965156555176,15.555094242095947,2 +3113,0.06495814025402069,0.05646321177482605,0.04961296170949936,0.22941505908966064,783.5821533203125,1e-05,0.06061086058616638,5.9500837326049805,15.555094242095947,2 +3114,0.12988503277301788,0.08962469547986984,0.08945030719041824,0.16616986691951752,839.3560791015625,1e-05,0.060780979692935944,5.6856043338775635,15.555094242095947,2 +3115,0.08190321922302246,0.07823001593351364,0.0741884857416153,0.13392627239227295,954.0719604492188,1e-05,0.07190436869859695,5.697130441665649,15.555094242095947,2 +3116,0.08065791428089142,0.10500040650367737,0.09691938012838364,0.2147996723651886,936.2449951171875,1e-05,0.061295319348573685,5.697412967681885,15.555094242095947,2 +3117,0.08707007765769958,0.17953218519687653,0.15929880738258362,0.20951120555400848,993.8524169921875,1e-05,0.07434090226888657,5.69101095199585,15.555094242095947,2 +3118,0.047522056847810745,0.04900767654180527,0.056292276829481125,0.20575319230556488,984.94482421875,1e-05,0.048133280128240585,5.695163249969482,15.555094242095947,2 +3119,0.06954309344291687,0.06780549883842468,0.06673004478216171,0.23970352113246918,861.80126953125,1e-05,0.047401055693626404,5.694846153259277,15.555094242095947,2 +3120,0.11686529219150543,0.07239405065774918,0.06995367258787155,0.2366105616092682,349.42364501953125,1e-05,0.05975354090332985,5.691333293914795,15.555094242095947,2 +3121,0.08179710805416107,0.15789945423603058,0.14753836393356323,0.2606009542942047,983.1340942382812,1e-05,0.05549102649092674,5.69270920753479,15.555094242095947,2 +3122,0.09001797437667847,0.07255126535892487,0.0696958526968956,0.24504005908966064,873.4939575195312,1e-05,0.048469092696905136,5.687220811843872,15.555094242095947,2 +3123,0.13131529092788696,0.13877247273921967,0.13117127120494843,0.23858171701431274,235.38963317871094,1e-05,0.057158518582582474,5.812757730484009,15.555094242095947,2 +3124,0.0916130542755127,0.03032347932457924,0.03490658476948738,0.21646633744239807,860.34912109375,1e-05,0.04863927885890007,5.685381889343262,15.555094242095947,2 +3125,0.13293348252773285,0.10099652409553528,0.09228113293647766,0.24664261937141418,905.8369750976562,1e-05,0.06220871955156326,5.689107656478882,15.555094242095947,2 +3126,0.08034132421016693,0.09190547466278076,0.08730997145175934,0.22915063798427582,512.9716796875,1e-05,0.04824337735772133,5.6964874267578125,15.555094242095947,2 +3127,0.0991724357008934,0.10088427364826202,0.09775379300117493,0.25178685784339905,786.3502197265625,1e-05,0.06651053577661514,5.683464527130127,15.555094242095947,2 +3128,0.16034449636936188,0.06990102678537369,0.06984717398881912,0.19814902544021606,837.7308349609375,1e-05,0.06374491751194,5.69512939453125,15.555094242095947,2 +3129,0.1002240926027298,0.12427878379821777,0.12232017517089844,0.2236618548631668,456.8528137207031,1e-05,0.06586789339780807,5.683507919311523,15.555094242095947,2 +3130,0.1044100821018219,0.08143828064203262,0.07761435210704803,0.2899278700351715,911.0628662109375,1e-05,0.06237800046801567,5.687779903411865,15.555094242095947,2 +3131,0.08656767755746841,0.045263901352882385,0.046289972960948944,0.22864583134651184,849.8719482421875,1e-05,0.05665183067321777,5.685925722122192,15.555094242095947,2 +3132,0.09244932979345322,0.051545463502407074,0.05523299053311348,0.23560896515846252,456.8528137207031,1e-05,0.05277591943740845,5.683175563812256,15.555094242095947,2 +3133,0.08575320243835449,0.061437636613845825,0.05916798859834671,0.23053684830665588,572.1257934570312,1e-05,0.051688116043806076,5.687372446060181,15.555094242095947,2 +3134,0.09281924366950989,0.2050676792860031,0.19696786999702454,0.24776440858840942,228.7581787109375,1e-05,0.05199073255062103,5.688661575317383,15.555094242095947,2 +3135,0.07972323149442673,0.08500176668167114,0.07685723155736923,0.26383814215660095,748.3948974609375,1e-05,0.05780990794301033,5.699101448059082,15.555094242095947,2 +3136,0.06278881430625916,0.0509362518787384,0.048053305596113205,0.26643428206443787,896.4932861328125,1e-05,0.05449383705854416,5.690015077590942,15.555094242095947,2 +3137,0.10495689511299133,0.14117431640625,0.13975533843040466,0.23306088149547577,381.9444580078125,1e-05,0.056815940886735916,5.705735445022583,15.555094242095947,2 +3138,0.06395668536424637,0.04304361715912819,0.040643684566020966,0.13728365302085876,913.2543334960938,1e-05,0.04760008305311203,5.702420473098755,15.555094242095947,2 +3139,0.08755165338516235,0.10441405326128006,0.10387948155403137,0.21203525364398956,913.6167602539062,1e-05,0.05846891924738884,5.845022916793823,15.555094242095947,2 +3140,0.10606174170970917,0.11067061871290207,0.10636431723833084,0.2250240296125412,999.1974487304688,1e-05,0.06485650688409805,5.751120567321777,15.555094242095947,2 +3141,0.09402814507484436,0.7427933812141418,0.7435933351516724,0.2639743387699127,29.296875,1e-05,0.054652512073516846,5.693929433822632,15.555094242095947,2 +3142,0.08953516185283661,0.1384623795747757,0.13543327152729034,0.2590785026550293,984.7198486328125,1e-05,0.05435322970151901,5.693799734115601,15.555094242095947,2 +3143,0.07070153951644897,0.3407815992832184,0.3079893887042999,0.24657851457595825,998.3897094726562,1e-05,0.05947905033826828,5.699196815490723,15.555094242095947,2 +3144,0.06460124999284744,0.052844662219285965,0.050748858600854874,0.23270832002162933,731.7578735351562,1e-05,0.05779510363936424,5.849221467971802,15.555094242095947,2 +3145,0.0790313109755516,0.07104518264532089,0.06948120146989822,0.23738780617713928,733.4710693359375,1e-05,0.07369541376829147,5.683200120925903,15.555094242095947,2 +3146,0.10745388269424438,0.0657719075679779,0.06204056367278099,0.22862979769706726,743.5170288085938,1e-05,0.0627686083316803,5.683712959289551,15.555094242095947,2 +3147,0.10378903895616531,0.07142715156078339,0.06952329725027084,0.21954326331615448,502.3923645019531,1e-05,0.05228494107723236,5.6899614334106445,15.555094242095947,2 +3148,0.12062406539916992,0.15596507489681244,0.17030031979084015,0.30568909645080566,153.50877380371094,1e-05,0.07574260979890823,5.690521955490112,15.555094242095947,2 +3149,0.06438198685646057,0.17501042783260345,0.16036999225616455,0.24534454941749573,985.8411254882812,1e-05,0.054214369505643845,5.693182706832886,15.555094242095947,2 +3150,0.07712122797966003,0.12524700164794922,0.11534319818019867,0.24953524768352509,954.6314086914062,1e-05,0.06538370996713638,5.685550928115845,15.555094242095947,2 +3151,0.10409659147262573,0.6231902837753296,0.6479793787002563,0.2513621747493744,48.076927185058594,1e-05,0.050079137086868286,5.675103425979614,15.555094242095947,2 +3152,0.05574619024991989,0.11320193856954575,0.10779936611652374,0.2247435748577118,969.4793090820312,1e-05,0.05176897719502449,5.693857431411743,15.555094242095947,2 +3153,0.12212993204593658,0.049928147345781326,0.052172888070344925,0.2599439024925232,649.0385131835938,1e-05,0.06160809099674225,5.6927807331085205,15.555094242095947,2 +3154,0.08558019250631332,0.10264953970909119,0.09421955794095993,0.2603205144405365,912.8910522460938,1e-05,0.06774560362100601,5.727171421051025,15.555094242095947,2 +3155,0.11133603006601334,0.07740811258554459,0.07355686277151108,0.2648557722568512,911.4300537109375,1e-05,0.05661208927631378,5.8424973487854,15.555094242095947,2 +3156,0.0700867623090744,0.055458780378103256,0.05776932090520859,0.2792467772960663,886.2048950195312,1e-05,0.054428741335868835,5.688159942626953,15.555094242095947,2 +3157,0.09470273554325104,0.1516505628824234,0.13970720767974854,0.2533493638038635,972.2222290039062,1e-05,0.05315636470913887,5.686251878738403,15.555094242095947,2 +3158,0.09984060376882553,0.07566466182470322,0.07008014619350433,0.17340543866157532,632.4110717773438,1e-05,0.05546346306800842,5.685161113739014,15.555094242095947,2 +3159,0.07309317588806152,0.05795552581548691,0.0557093545794487,0.25215545296669006,768.4899291992188,1e-05,0.059645794332027435,5.688857793807983,15.555094242095947,2 +3160,0.06548008322715759,0.06870526820421219,0.06464342027902603,0.23383812606334686,791.1160888671875,1e-05,0.048842594027519226,5.683692455291748,15.555094242095947,2 +3161,0.06650149077177048,0.12025266885757446,0.11677954345941544,0.2106490284204483,965.9091796875,1e-05,0.058696940541267395,5.689993381500244,15.555094242095947,2 +3162,0.09749550372362137,0.08328437805175781,0.08121857047080994,0.14395031332969666,958.4887084960938,1e-05,0.05647435039281845,5.681278467178345,15.555094242095947,2 +3163,0.09311919659376144,0.05006333813071251,0.050262466073036194,0.11794871091842651,801.0057983398438,1e-05,0.05191171541810036,5.69295334815979,15.555094242095947,2 +3164,0.05355572700500488,0.10557243227958679,0.10260239988565445,0.23270031809806824,933.3839721679688,1e-05,0.05281352624297142,5.69465970993042,15.555094242095947,2 +3165,0.10760331153869629,0.08418485522270203,0.08255942910909653,0.19911858439445496,941.5103759765625,1e-05,0.05308575555682182,5.8589794635772705,15.555094242095947,2 +3166,0.10276799649000168,0.1088775023818016,0.1065746322274208,0.17161056399345398,294.342529296875,1e-05,0.055620551109313965,5.682274341583252,15.555094242095947,2 +3167,0.06373225897550583,0.10460611432790756,0.10038261115550995,0.19266825914382935,915.0589599609375,1e-05,0.06439843028783798,5.698481798171997,15.555094242095947,2 +3168,0.05289562791585922,0.03803396597504616,0.03833280876278877,0.22574518620967865,923.1171264648438,1e-05,0.0565224252641201,5.7855751514434814,15.555094242095947,2 +3169,0.11961516737937927,0.06163995340466499,0.06163008138537407,0.09825319796800613,946.896240234375,1e-05,0.0580504946410656,5.694639444351196,15.555094242095947,2 +3170,0.09273447096347809,0.08876216411590576,0.09036035090684891,0.17317306995391846,973.6957397460938,1e-05,0.06013628467917442,5.690271854400635,15.555094242095947,2 +3171,0.053438637405633926,0.11997146159410477,0.11416684091091156,0.13942307233810425,983.8159790039062,1e-05,0.06755331158638,5.699818134307861,15.555094242095947,2 +3172,0.09714143723249435,0.052141234278678894,0.047133252024650574,0.17025640606880188,842.0365600585938,1e-05,0.06424582004547119,5.698188543319702,15.555094242095947,2 +3173,0.0625327080488205,0.07849347591400146,0.07194307446479797,0.20066505670547485,476.4851989746094,1e-05,0.06866166740655899,5.691076040267944,15.555094242095947,2 +3174,0.09670323133468628,0.06264134496450424,0.06987937539815903,0.22959935665130615,904.6961059570312,1e-05,0.0585605651140213,5.929402112960815,15.555094242095947,2 +3175,0.0795435681939125,0.089968241751194,0.08560653030872345,0.2513461410999298,534.8970336914062,1e-05,0.0574733167886734,5.6950743198394775,15.555094242095947,2 +3176,0.12559933960437775,0.18079979717731476,0.17977359890937805,0.20972755551338196,183.4470977783203,1e-05,0.05643143504858017,5.695981979370117,15.555094242095947,2 +3177,0.08886586129665375,0.08201989531517029,0.0826582983136177,0.0808333307504654,790.4412231445312,1e-05,0.06318618357181549,5.69109582901001,15.555094242095947,2 +3178,0.10477202385663986,0.04150073975324631,0.03891053423285484,0.22344550490379333,870.7523803710938,1e-05,0.07755492627620697,5.685592174530029,15.555094242095947,2 +3179,0.08839654922485352,0.05197310075163841,0.047080013900995255,0.1410096138715744,698.8536376953125,1e-05,0.05651453137397766,5.681183099746704,15.555094242095947,2 +3180,0.13442952930927277,0.1492454558610916,0.1343720257282257,0.20298877358436584,962.2467651367188,1e-05,0.06136823073029518,5.6926352977752686,15.555094242095947,2 +3181,0.07867184281349182,0.07571256905794144,0.07762203365564346,0.24231569468975067,960.9158325195312,1e-05,0.05872119963169098,5.9152140617370605,15.555094242095947,2 +3182,0.08289593458175659,0.055536553263664246,0.053955476731061935,0.21225960552692413,671.2963256835938,1e-05,0.06376069784164429,5.69525671005249,15.555094242095947,2 +3183,0.0809875950217247,0.04838504642248154,0.05067948251962662,0.19816505908966064,557.0953369140625,1e-05,0.06470126658678055,5.687836170196533,15.555094242095947,2 +3184,0.12241974472999573,0.10071020573377609,0.095014788210392,0.2564743459224701,959.3023071289062,1e-05,0.0585283599793911,5.687915802001953,15.555094242095947,2 +3185,0.10609932243824005,0.047976303845644,0.04929909110069275,0.2780608832836151,772.9007568359375,1e-05,0.06149114668369293,5.691457271575928,15.555094242095947,2 +3186,0.07182882726192474,0.08413437008857727,0.08262628316879272,0.24944710731506348,456.8528137207031,1e-05,0.056088320910930634,5.689769268035889,15.555094242095947,2 +3187,0.06622432172298431,0.06458911299705505,0.058049093931913376,0.23405447602272034,835.5437622070312,1e-05,0.06102121248841286,5.694039821624756,15.555094242095947,2 +3188,0.08105897158384323,0.11952037364244461,0.11275424063205719,0.2840704917907715,947.775634765625,1e-05,0.07375621050596237,5.684659481048584,15.555094242095947,2 +3189,0.09347356855869293,0.1142224445939064,0.11383506655693054,0.23846152424812317,990.6640014648438,1e-05,0.05602561682462692,5.722254991531372,15.555094242095947,2 +3190,0.10424648225307465,0.23306331038475037,0.231209859251976,0.25392627716064453,168.68511962890625,1e-05,0.060849569737911224,5.692414283752441,15.555094242095947,2 +3191,0.06578235328197479,0.04324495792388916,0.04656083136796951,0.25823718309402466,824.2506713867188,1e-05,0.06378434598445892,5.702462911605835,15.555094242095947,2 +3192,0.08772352337837219,0.14176584780216217,0.13975857198238373,0.19076120853424072,780.78076171875,1e-05,0.06493597477674484,5.705097913742065,15.555094242095947,2 +3193,0.12900188565254211,0.08818874508142471,0.08011477440595627,0.23985576629638672,907.3464965820312,1e-05,0.07490705698728561,5.689022541046143,15.555094242095947,2 +3194,0.048313118517398834,0.05939440429210663,0.05650448426604271,0.2397916615009308,854.930419921875,1e-05,0.06677907705307007,5.6969828605651855,15.555094242095947,2 +3195,0.11841735988855362,0.681394636631012,0.6808695793151855,0.15048076212406158,38.75969314575195,1e-05,0.0621025376021862,5.6964240074157715,15.555094242095947,2 +3196,0.09124656021595001,0.05307895690202713,0.049279436469078064,0.26383814215660095,953.7914428710938,1e-05,0.0714370533823967,5.927672624588013,15.555094242095947,2 +3197,0.12083494663238525,0.10185305029153824,0.09796716272830963,0.2372836470603943,582.2649536132812,1e-05,0.06989917904138565,5.967238664627075,15.555094242095947,2 +3198,0.1594592183828354,0.09670444577932358,0.0919620543718338,0.14403043687343597,946.3070678710938,1e-05,0.06389259546995163,5.682973861694336,15.555094242095947,2 +3199,0.13482904434204102,0.2012515366077423,0.19952188432216644,0.22360576689243317,308.7349548339844,1e-05,0.06823400408029556,5.690387010574341,15.555094242095947,2 +3200,0.12287119030952454,0.2221352607011795,0.22131986916065216,0.190400630235672,129.92831420898438,1e-05,0.07175959646701813,5.6853883266448975,15.555094242095947,2 +3201,0.07464110851287842,0.09353886544704437,0.08663906902074814,0.25447916984558105,844.1558227539062,1e-05,0.056792404502630234,5.6860833168029785,15.555094242095947,2 +3202,0.1114082932472229,0.062092289328575134,0.06282752752304077,0.21979966759681702,775.0761108398438,1e-05,0.07507921010255814,5.9266955852508545,15.555094242095947,2 +3203,0.09862770885229111,0.08273046463727951,0.0796496570110321,0.20839743316173553,794.4606323242188,1e-05,0.07128624618053436,5.682478189468384,15.555094242095947,2 +3204,0.08336339890956879,0.06474145501852036,0.06194824352860451,0.2504887580871582,799.0620727539062,1e-05,0.06777208298444748,5.681593894958496,15.555094242095947,2 +3205,0.05239817127585411,0.05997591093182564,0.057046256959438324,0.2005208283662796,914.6995849609375,1e-05,0.06594612449407578,5.690122604370117,15.555094242095947,2 +3206,0.07220980525016785,0.0644051730632782,0.06354037672281265,0.10670672357082367,601.6597900390625,1e-05,0.06491237878799438,5.7073938846588135,15.555094242095947,2 +3207,0.12531211972236633,0.06209072098135948,0.06362307816743851,0.15909454226493835,491.5048522949219,1e-05,0.08867449313402176,5.883509397506714,15.555094242095947,2 +3208,0.12745828926563263,0.08586733788251877,0.08659394085407257,0.17854967713356018,658.1439819335938,1e-05,0.06183917820453644,5.895921945571899,15.555094242095947,2 +3209,0.09927612543106079,0.07524658739566803,0.0742228776216507,0.22604165971279144,642.0233154296875,1e-05,0.06539788097143173,5.689651727676392,15.555094242095947,2 +3210,0.08944979310035706,0.19468212127685547,0.1911272406578064,0.21096953749656677,999.5994262695312,1e-05,0.06384815275669098,5.689187049865723,15.555094242095947,2 +3211,0.07613904774188995,0.05147990211844444,0.050054844468832016,0.22780448198318481,619.959716796875,1e-05,0.058803264051675797,5.7022545337677,15.555094242095947,2 +3212,0.07195211201906204,0.11069679260253906,0.11073720455169678,0.1991826891899109,945.4190673828125,1e-05,0.0557173453271389,5.693818092346191,15.555094242095947,2 +3213,0.07322246581315994,0.06469358503818512,0.06222143769264221,0.2618910074234009,795.784912109375,1e-05,0.07937507331371307,5.696377515792847,15.555094242095947,2 +3214,0.06260029226541519,0.1100524291396141,0.11348787695169449,0.11731570214033127,943.0255737304688,1e-05,0.060742586851119995,5.691591501235962,15.555094242095947,2 +3215,0.05940214917063713,0.22306568920612335,0.20613804459571838,0.2695592939853668,982.677490234375,1e-05,0.060685306787490845,5.6970789432525635,15.555094242095947,2 +3216,0.08002794533967972,0.09569341689348221,0.09408784657716751,0.22419871389865875,407.6819763183594,1e-05,0.06416986882686615,5.68676233291626,15.555094242095947,2 +3217,0.11506754159927368,0.23592598736286163,0.23176707327365875,0.3173156976699829,187.07484436035156,1e-05,0.05829206481575966,5.933713674545288,15.555094242095947,2 +3218,0.10196733474731445,0.10935171693563461,0.10792418569326401,0.14089743793010712,880.177490234375,1e-05,0.05769573897123337,5.72665548324585,15.555094242095947,2 +3219,0.16413050889968872,0.14434735476970673,0.13705353438854218,0.21979966759681702,270.376220703125,1e-05,0.059007756412029266,5.815786123275757,15.555094242095947,2 +3220,0.08526302874088287,0.04358281195163727,0.04280375689268112,0.2534535229206085,670.22265625,1e-05,0.06965535134077072,5.688702821731567,15.555094242095947,2 +3221,0.06482991576194763,0.11254686862230301,0.10688772052526474,0.28806889057159424,894.0774536132812,1e-05,0.05325336381793022,5.692095041275024,15.555094242095947,2 +3222,0.08161034435033798,0.052572812885046005,0.05284475162625313,0.2571474313735962,804.208251953125,1e-05,0.06468996405601501,5.6917054653167725,15.555094242095947,2 +3223,0.1516200751066208,0.05914018675684929,0.05677404999732971,0.2732532024383545,663.6961059570312,1e-05,0.07491255551576614,5.687903642654419,15.555094242095947,2 +3224,0.1031680554151535,0.08614862710237503,0.07870502024888992,0.2279006391763687,777.2314453125,1e-05,0.056973546743392944,5.692450761795044,15.555094242095947,2 +3225,0.055196527391672134,0.17520026862621307,0.16498421132564545,0.28543269634246826,980.37109375,1e-05,0.053155310451984406,5.688949346542358,15.555094242095947,2 +3226,0.09251970052719116,0.085536427795887,0.08322321623563766,0.2285817265510559,550.8948364257812,1e-05,0.10192981362342834,5.690873384475708,15.555094242095947,2 +3227,0.058166470378637314,0.10553790628910065,0.10822372138500214,0.11391826719045639,978.0244140625,1e-05,0.07276880741119385,5.6985764503479,15.555094242095947,2 +3228,0.0762433260679245,0.07726296037435532,0.0739506408572197,0.2076682597398758,818.9655151367188,1e-05,0.05178603157401085,5.702420711517334,15.555094242095947,2 +3229,0.08457734435796738,0.09890448302030563,0.09879548102617264,0.29567307233810425,953.7914428710938,1e-05,0.08756949007511139,5.690957307815552,15.555094242095947,2 +3230,0.07960239797830582,0.053082793951034546,0.05509461835026741,0.2849038243293762,767.0015869140625,1e-05,0.05629727989435196,5.695750951766968,15.555094242095947,2 +3231,0.14494994282722473,0.11589068919420242,0.10889153927564621,0.2091025561094284,878.85986328125,1e-05,0.06954650580883026,5.692724227905273,15.555094242095947,2 +3232,0.10440601408481598,0.07074157893657684,0.0637684315443039,0.2635897397994995,797.7569580078125,1e-05,0.05832735449075699,5.687834978103638,15.555094242095947,2 +3233,0.11736056208610535,0.11114393174648285,0.10826748609542847,0.18271633982658386,454.8346252441406,1e-05,0.05401429906487465,5.6924521923065186,15.555094242095947,2 +3234,0.08546007424592972,0.11226311326026917,0.10606402903795242,0.26296472549438477,675.5514526367188,1e-05,0.05643361434340477,5.689851760864258,15.555094242095947,2 +3235,0.07699255645275116,0.0773857980966568,0.07751823216676712,0.27764421701431274,472.6368408203125,1e-05,0.047629453241825104,5.6899871826171875,15.555094242095947,2 +3236,0.08292020112276077,0.06409173458814621,0.06529448181390762,0.17604967951774597,930.143310546875,1e-05,0.04735516384243965,5.695124387741089,15.555094242095947,2 +3237,0.119167760014534,0.8539718985557556,0.845476508140564,0.29037660360336304,24.50980567932129,1e-05,0.05680633336305618,5.689030170440674,15.555094242095947,2 +3238,0.10418838262557983,0.02955114282667637,0.030378585681319237,0.13832531869411469,603.0020751953125,1e-05,0.05086235702037811,5.692243337631226,15.555094242095947,2 +3239,0.07384676486253738,0.06969956308603287,0.06678397953510284,0.29855766892433167,880.177490234375,1e-05,0.053598545491695404,5.834393501281738,15.555094242095947,2 +3240,0.11794716864824295,0.04453308507800102,0.04053087905049324,0.2661858797073364,872.5845947265625,1e-05,0.05567095801234245,5.688660144805908,15.555094242095947,2 +3241,0.06621231883764267,0.14543688297271729,0.135677769780159,0.21728365123271942,943.0255737304688,1e-05,0.04884963855147362,5.6881256103515625,15.555094242095947,2 +3242,0.08001541346311569,0.10219352692365646,0.09777209907770157,0.17821313440799713,817.174560546875,1e-05,0.05128180980682373,5.841296911239624,15.555094242095947,2 +3243,0.09727603197097778,0.11095064133405685,0.11598289757966995,0.21645031869411469,285.49383544921875,1e-05,0.061681415885686874,5.7235212326049805,15.555094242095947,2 +3244,0.07340943813323975,0.0825103148818016,0.07658518105745316,0.26848557591438293,868.4371337890625,1e-05,0.06377509981393814,5.679360389709473,15.555094242095947,2 +3245,0.09245943278074265,0.09271220117807388,0.08882706612348557,0.16962338984012604,528.291015625,1e-05,0.052216216921806335,5.694735765457153,15.555094242095947,2 +3246,0.12262339890003204,0.03279463201761246,0.03294273838400841,0.08008813858032227,722.12841796875,1e-05,0.07026780396699905,5.685190439224243,15.555094242095947,2 +3247,0.13469624519348145,0.44962531328201294,0.45907318592071533,0.21176281571388245,83.95523071289062,1e-05,0.06235474720597267,5.685283422470093,15.555094242095947,2 +3248,0.06487566977739334,0.08022261410951614,0.08093871176242828,0.23837338387966156,908.4699096679688,1e-05,0.054965801537036896,5.687427520751953,15.555094242095947,2 +3249,0.07480251789093018,0.06610360741615295,0.06497219204902649,0.2447996735572815,784.2772827148438,1e-05,0.06905556470155716,5.6923816204071045,15.555094242095947,2 +3250,0.10453163832426071,0.03359963372349739,0.03343338891863823,0.2268589586019516,850.3836669921875,1e-05,0.06619559228420258,5.692776441574097,15.555094242095947,2 +3251,0.050612159073352814,0.036340244114398956,0.03535284474492073,0.1516105681657791,908.8427124023438,1e-05,0.05520203337073326,5.898653507232666,15.555094242095947,2 +3252,0.0998649075627327,0.0925777480006218,0.09195137023925781,0.25370991230010986,954.9102783203125,1e-05,0.06959886103868484,5.95740270614624,15.555094242095947,2 +3253,0.08897071331739426,0.09301479905843735,0.09060478955507278,0.23146633803844452,948.067626953125,1e-05,0.06025703251361847,5.695338487625122,15.555094242095947,2 +3254,0.05062189698219299,0.06448455899953842,0.06706539541482925,0.25122594833374023,857.9046020507812,1e-05,0.06548064202070236,5.6897947788238525,15.555094242095947,2 +3255,0.0712832510471344,0.09306804090738297,0.09085629880428314,0.18416665494441986,966.6818237304688,1e-05,0.059822797775268555,5.696465492248535,15.555094242095947,2 +3256,0.1108069121837616,0.16958612203598022,0.16292451322078705,0.13333332538604736,997.3726806640625,1e-05,0.0579226016998291,5.69206690788269,15.555094242095947,2 +3257,0.08400069177150726,0.20505453646183014,0.20247507095336914,0.22749999165534973,985.6176147460938,1e-05,0.06880685687065125,5.687533855438232,15.555094242095947,2 +3258,0.08647102862596512,0.16499343514442444,0.15478499233722687,0.2149999886751175,970.2327880859375,1e-05,0.05886828899383545,5.686550855636597,15.555094242095947,2 +3259,0.03444540873169899,0.16358670592308044,0.1491728574037552,0.22134613990783691,983.5890502929688,1e-05,0.056217923760414124,5.690599679946899,15.555094242095947,2 +3260,0.06156289577484131,0.05077620595693588,0.05179804936051369,0.11706729978322983,938.1237182617188,1e-05,0.055256981402635574,6.051023960113525,15.555094242095947,2 +3261,0.062088437378406525,0.09421231597661972,0.0866084173321724,0.2958413362503052,842.0365600585938,1e-05,0.05292219668626785,5.688349008560181,15.555094242095947,2 +3262,0.12056363373994827,0.6818856596946716,0.6938090324401855,0.18437498807907104,38.75969314575195,1e-05,0.08094142377376556,6.167855739593506,15.555094242095947,2 +3263,0.11008793860673904,0.12436715513467789,0.1120997965335846,0.3114663362503052,965.9091796875,1e-05,0.053706809878349304,5.919482231140137,15.555094242095947,2 +3264,0.10786064714193344,0.059168148785829544,0.06154868006706238,0.09434294700622559,677.6557006835938,1e-05,0.07912181317806244,5.6994948387146,15.555094242095947,2 +3265,0.0521533340215683,0.11902216076850891,0.10378648340702057,0.22609774768352509,995.10595703125,1e-05,0.04692542925477028,5.706646919250488,15.555094242095947,2 +3266,0.07284733653068542,0.056435734033584595,0.05624120682477951,0.07827723771333694,906.5933837890625,1e-05,0.07102201879024506,5.695208787918091,15.555094242095947,2 +3267,0.06753818690776825,0.06936409324407578,0.0664450004696846,0.23715543746948242,907.3464965820312,1e-05,0.060805078595876694,5.679450273513794,15.555094242095947,2 +3268,0.08746261894702911,0.08537177741527557,0.07995764166116714,0.2292628139257431,922.088134765625,1e-05,0.06551269441843033,5.703004598617554,15.555094242095947,2 +3269,0.060138069093227386,0.05033178627490997,0.051024243235588074,0.2339983880519867,765.50390625,1e-05,0.05886403098702431,5.69759202003479,15.555094242095947,2 +3270,0.09094132483005524,0.07713989168405533,0.07479020953178406,0.17575320601463318,848.8447265625,1e-05,0.07702412456274033,5.6984827518463135,15.555094242095947,2 +3271,0.07436959445476532,0.23568670451641083,0.22291168570518494,0.2946714758872986,994.89794921875,1e-05,0.056266747415065765,5.7887725830078125,15.555094242095947,2 +3272,0.038388691842556,0.1431358903646469,0.1403968781232834,0.22999197244644165,983.5890502929688,1e-05,0.0695691853761673,5.689292669296265,15.555094242095947,2 +3273,0.06790680438280106,0.05823064595460892,0.062245387583971024,0.23199518024921417,963.5654907226562,1e-05,0.07288995385169983,5.704599618911743,15.555094242095947,2 +3274,0.08198032528162003,0.06350836902856827,0.0562397837638855,0.21893428266048431,917.5531616210938,1e-05,0.08173064887523651,5.6895058155059814,15.555094242095947,2 +3275,0.06430412083864212,0.09364494681358337,0.08523096144199371,0.23878204822540283,898.0855712890625,1e-05,0.05951550230383873,5.828103542327881,15.555094242095947,2 +3276,0.09401033073663712,0.06128630414605141,0.05933964252471924,0.22403845191001892,734.3234252929688,1e-05,0.06916721165180206,5.690413951873779,15.555094242095947,2 +3277,0.08972129225730896,0.11204052716493607,0.1108260229229927,0.25265222787857056,973.2064208984375,1e-05,0.06798625737428665,5.6879565715789795,15.555094242095947,2 +3278,0.08938756585121155,0.19376417994499207,0.19042690098285675,0.17953525483608246,201.34228515625,1e-05,0.06303723901510239,5.686370849609375,15.555094242095947,2 +3279,0.08134375512599945,0.06630174815654755,0.06570187211036682,0.2888782024383545,684.9005737304688,1e-05,0.060322508215904236,5.68417501449585,15.555094242095947,2 +3280,0.0951933041214943,0.09175021946430206,0.0922185555100441,0.20665864646434784,344.2029113769531,1e-05,0.052680134773254395,5.6841723918914795,15.555094242095947,2 +3281,0.08322293311357498,0.12576428055763245,0.12381716072559357,0.22295671701431274,956.8480224609375,1e-05,0.060244567692279816,5.9382758140563965,15.555094242095947,2 +3282,0.05577347055077553,0.13311345875263214,0.1270258128643036,0.2778846025466919,947.4830322265625,1e-05,0.05904514715075493,5.679122447967529,15.555094242095947,2 +3283,0.06827756762504578,0.03976165130734444,0.04373817518353462,0.2309935837984085,518.14990234375,1e-05,0.07996108382940292,5.690617322921753,15.555094242095947,2 +3284,0.13426217436790466,0.06999590992927551,0.07108505070209503,0.27985575795173645,945.4190673828125,1e-05,0.05369555577635765,5.913830518722534,15.555094242095947,2 +3285,0.06558840721845627,0.07126893848180771,0.07037670910358429,0.24842146039009094,887.8910522460938,1e-05,0.06577875465154648,5.717830181121826,15.555094242095947,2 +3286,0.10079266130924225,0.07699411362409592,0.07117881625890732,0.2590464651584625,617.4088745117188,1e-05,0.06201624497771263,5.690430164337158,15.555094242095947,2 +3287,0.06985633075237274,0.01957216113805771,0.022671343758702278,0.1674519181251526,573.5930786132812,1e-05,0.05799758806824684,5.688120603561401,15.555094242095947,2 +3288,0.06850257515907288,0.13208472728729248,0.12745870649814606,0.22977563738822937,946.6019287109375,1e-05,0.047781605273485184,5.6896514892578125,15.555094242095947,2 +3289,0.0625600665807724,0.053681328892707825,0.05920940637588501,0.196866974234581,870.7523803710938,1e-05,0.0666060671210289,5.687291860580444,15.555094242095947,2 +3290,0.08317877352237701,0.21758176386356354,0.21258190274238586,0.2098798006772995,997.9838256835938,1e-05,0.06275554746389389,5.685744285583496,15.555094242095947,2 +3291,0.1256549209356308,0.09561832249164581,0.09429973363876343,0.13084936141967773,519.8598022460938,1e-05,0.05526909604668617,5.704169750213623,15.555094242095947,2 +3292,0.1229124441742897,0.06920664012432098,0.06449603289365768,0.14425480365753174,916.4888305664062,1e-05,0.07373302429914474,5.705157995223999,15.555094242095947,2 +3293,0.08286851644515991,0.0918888971209526,0.0864911675453186,0.21747595071792603,947.1898803710938,1e-05,0.05795729160308838,5.695982933044434,15.555094242095947,2 +3294,0.07543934136629105,0.15209713578224182,0.14582929015159607,0.24841345846652985,970.7328491210938,1e-05,0.05382988601922989,5.686514616012573,15.555094242095947,2 +3295,0.1052216961979866,0.10783586651086807,0.09127359837293625,0.24056890606880188,918.6107788085938,1e-05,0.06534530222415924,5.866375207901001,15.555094242095947,2 +3296,0.13802190124988556,0.16758807003498077,0.15796448290348053,0.17623396217823029,955.188720703125,1e-05,0.05930725112557411,5.699465751647949,15.555094242095947,2 +3297,0.06536288559436798,0.06014087796211243,0.05546792596578598,0.18283653259277344,912.5270385742188,1e-05,0.054658208042383194,5.694163799285889,15.555094242095947,2 +3298,0.12116296589374542,0.47946131229400635,0.4760570824146271,0.10916665941476822,57.25191116333008,1e-05,0.05216417461633682,5.69480562210083,15.555094242095947,2 +3299,0.12261424213647842,0.064447782933712,0.06463507562875748,0.19176281988620758,866.564453125,1e-05,0.07128951698541641,5.692932367324829,15.555094242095947,2 +3300,0.07374225556850433,0.06604506820440292,0.06612265110015869,0.18685095012187958,567.685546875,1e-05,0.05408934876322746,5.700310945510864,15.555094242095947,2 +3301,0.05960969999432564,0.08191986382007599,0.08427172899246216,0.15704326331615448,864.197509765625,1e-05,0.08636392652988434,5.693321943283081,15.555094242095947,2 +3302,0.11691675335168839,0.06738848239183426,0.06500696390867233,0.23269230127334595,619.959716796875,1e-05,0.05450902879238129,6.093150854110718,15.555094242095947,2 +3303,0.0632815733551979,0.019900856539607048,0.022733589634299278,0.1489262729883194,829.4078369140625,1e-05,0.05388513579964638,5.685438632965088,15.555094242095947,2 +3304,0.10188613086938858,0.05382871627807617,0.05269132927060127,0.16197115182876587,937.5,1e-05,0.08268927037715912,5.686632871627808,15.555094242095947,2 +3305,0.04453371465206146,0.07364503294229507,0.06572822481393814,0.1687900573015213,610.940673828125,1e-05,0.05106315761804581,5.6817710399627686,15.555094242095947,2 +3306,0.09574469178915024,0.07251127064228058,0.07087819278240204,0.23559294641017914,613.5438232421875,1e-05,0.08877762407064438,5.69479513168335,15.555094242095947,2 +3307,0.0645156130194664,0.07330706715583801,0.07219471037387848,0.1971554458141327,900.8379516601562,1e-05,0.05374746769666672,5.70189642906189,15.555094242095947,2 +3308,0.07794041931629181,0.12499073147773743,0.11943812668323517,0.297187477350235,977.3124389648438,1e-05,0.04885579273104668,5.852920770645142,15.555094242095947,2 +3309,0.04633759334683418,0.08243515342473984,0.08003829419612885,0.27263620495796204,961.1829223632812,1e-05,0.04651141166687012,5.688650846481323,15.555094242095947,2 +3310,0.05772414803504944,0.05329132825136185,0.04910609498620033,0.25014421343803406,858.3959350585938,1e-05,0.06842773407697678,5.688857316970825,15.555094242095947,2 +3311,0.09481101483106613,0.12577690184116364,0.11915693432092667,0.30609774589538574,911.7965698242188,1e-05,0.05488579720258713,5.684404373168945,15.555094242095947,2 +3312,0.0718812495470047,0.1324729025363922,0.120408795773983,0.3147996664047241,943.0255737304688,1e-05,0.06920209527015686,5.682878017425537,15.555094242095947,2 +3313,0.10974755883216858,0.27815839648246765,0.27755799889564514,0.30637016892433167,999.5994262695312,1e-05,0.054004453122615814,5.881115436553955,15.555094242095947,2 +3314,0.09750902652740479,0.06926817446947098,0.06322646886110306,0.2516586482524872,814.15625,1e-05,0.059563104063272476,5.883537530899048,15.555094242095947,2 +3315,0.10259173810482025,0.14641454815864563,0.13315442204475403,0.25767627358436584,972.7151489257812,1e-05,0.06121549755334854,5.687459707260132,15.555094242095947,2 +3316,0.13916124403476715,0.07059939950704575,0.0696704164147377,0.09547275304794312,596.2343139648438,1e-05,0.05821087583899498,5.690837860107422,15.555094242095947,2 +3317,0.09620548039674759,0.1039666011929512,0.10438239574432373,0.29961538314819336,364.73089599609375,1e-05,0.049800749868154526,5.69108247756958,15.555094242095947,2 +3318,0.08624434471130371,0.0671532079577446,0.06689905375242233,0.14075319468975067,431.9371643066406,1e-05,0.059082530438899994,5.695363521575928,15.555094242095947,2 +3319,0.11232717335224152,0.08057181537151337,0.08134906738996506,0.12475159764289856,504.1766052246094,1e-05,0.05004211887717247,5.689254522323608,15.555094242095947,2 +3320,0.09860042482614517,0.05824507027864456,0.05744027718901634,0.19843749701976776,460.8586120605469,1e-05,0.05193933844566345,5.69296932220459,15.555094242095947,2 +3321,0.09492210298776627,0.0647154301404953,0.06396156549453735,0.21660254895687103,805.4765625,1e-05,0.053059156984090805,5.696332216262817,15.555094242095947,2 +3322,0.14645890891551971,0.09482425451278687,0.09146246314048767,0.25033652782440186,981.2984008789062,1e-05,0.05427279323339462,5.694156169891357,15.555094242095947,2 +3323,0.07891836017370224,0.09755854308605194,0.0954257920384407,0.2557692229747772,712.13427734375,1e-05,0.06741411983966827,5.709012269973755,15.555094242095947,2 +3324,0.058648910373449326,0.08089876174926758,0.07561711966991425,0.2049519121646881,934.0242309570312,1e-05,0.04891766607761383,5.7167298793792725,15.555094242095947,2 +3325,0.06258632242679596,0.1051659807562828,0.09553228318691254,0.18903043866157532,942.7236938476562,1e-05,0.06743833422660828,5.697861909866333,15.555094242095947,2 +3326,0.08743863552808762,0.16341575980186462,0.15750868618488312,0.23529647290706635,279.50311279296875,1e-05,0.07975506037473679,5.691712379455566,15.555094242095947,2 +3327,0.07896336168050766,0.06672605872154236,0.06615903228521347,0.24086537957191467,688.9586791992188,1e-05,0.0633721575140953,5.6960999965667725,15.555094242095947,2 +3328,0.09117179363965988,0.09338731318712234,0.09357862174510956,0.20721152424812317,924.1397094726562,1e-05,0.05845722183585167,5.690823316574097,15.555094242095947,2 +3329,0.06147974357008934,0.06790769845247269,0.06519152224063873,0.2054407000541687,798.4103393554688,1e-05,0.06191311404109001,5.722118139266968,15.555094242095947,2 +3330,0.10595438629388809,0.059531375765800476,0.05683163180947304,0.1937660127878189,600.3118286132812,1e-05,0.07322759181261063,5.6937150955200195,15.555094242095947,2 +3331,0.07956008613109589,0.08967635780572891,0.08785756677389145,0.12718749046325684,914.3394165039062,1e-05,0.05392208695411682,5.680835723876953,15.555094242095947,2 +3332,0.09206333011388779,0.08269866555929184,0.0774853304028511,0.2040865272283554,858.8861083984375,1e-05,0.06323091685771942,5.689203500747681,15.555094242095947,2 +3333,0.12274571508169174,0.12903445959091187,0.12654070556163788,0.19205127656459808,995.9349365234375,1e-05,0.05188669636845589,5.692294120788574,15.555094242095947,2 +3334,0.09294608235359192,0.06168745830655098,0.05665671452879906,0.2438381314277649,777.9456176757812,1e-05,0.0903138667345047,5.700842380523682,15.555094242095947,2 +3335,0.09892746806144714,0.5611460208892822,0.5513651371002197,0.2025400549173355,66.28787994384766,1e-05,0.06439673900604248,5.690613508224487,15.555094242095947,2 +3336,0.10308732092380524,0.07980488240718842,0.07566139847040176,0.23886217176914215,623.7474975585938,1e-05,0.062208183109760284,5.685992002487183,15.555094242095947,2 +3337,0.08585742115974426,0.10196381062269211,0.10170725733041763,0.24188300967216492,474.5657653808594,1e-05,0.08378306776285172,5.677867889404297,15.555094242095947,2 +3338,0.08245790749788284,0.15580950677394867,0.1500038057565689,0.25459936261177063,917.19921875,1e-05,0.061132464557886124,5.688345432281494,15.555094242095947,2 +3339,0.054308950901031494,0.0573616661131382,0.05796884000301361,0.15980768203735352,677.6557006835938,1e-05,0.0706871971487999,5.690131664276123,15.555094242095947,2 +3340,0.11600974947214127,0.04337077960371971,0.04105940833687782,0.2131730616092682,549.327392578125,1e-05,0.08840136229991913,5.682207822799683,15.555094242095947,2 +3341,0.08287593722343445,0.2596580386161804,0.2631363272666931,0.18628203868865967,109.48905944824219,1e-05,0.05034104362130165,5.689998149871826,15.555094242095947,2 +3342,0.0611259788274765,0.17143449187278748,0.17168033123016357,0.16826923191547394,943.3267822265625,1e-05,0.08102914690971375,5.6872007846832275,15.555094242095947,2 +3343,0.09735560417175293,0.015928441658616066,0.01715843752026558,0.1253846138715744,794.4606323242188,1e-05,0.058300286531448364,5.677879810333252,15.555094242095947,2 +3344,0.1711186319589615,0.08872129023075104,0.08407334983348846,0.23733171820640564,658.1439819335938,1e-05,0.06883205473423004,5.701910972595215,15.555094242095947,2 +3345,0.06197238713502884,0.0695357546210289,0.0694049820303917,0.22478364408016205,398.5013732910156,1e-05,0.06448333710432053,6.257333278656006,15.555094242095947,2 +3346,0.11413072049617767,0.22661229968070984,0.22695866227149963,0.26693910360336304,245.17686462402344,1e-05,0.0863446295261383,5.691707372665405,15.555094242095947,2 +3347,0.07711271196603775,0.11068226397037506,0.10677209496498108,0.23279646039009094,812.9371337890625,1e-05,0.061475757509469986,5.689465284347534,15.555094242095947,2 +3348,0.14038453996181488,0.08275319635868073,0.0819852277636528,0.2920512855052948,601.6597900390625,1e-05,0.07861234247684479,5.686784029006958,15.555094242095947,2 +3349,0.06652146577835083,0.10321788489818573,0.09796758741140366,0.27727562189102173,883.6459350585938,1e-05,0.08359018713235855,5.683846950531006,15.555094242095947,2 +3350,0.07532384991645813,0.10583112388849258,0.10139940679073334,0.2786538302898407,971.4794311523438,1e-05,0.07150959223508835,5.7109215259552,15.555094242095947,2 +3351,0.07869970798492432,0.07323803752660751,0.06583673506975174,0.23027242720127106,700.7908935546875,1e-05,0.06697861105203629,5.687608480453491,15.555094242095947,2 +3352,0.11239369958639145,0.0940510705113411,0.09080760180950165,0.24639421701431274,977.3124389648438,1e-05,0.09114821255207062,5.6960625648498535,15.555094242095947,2 +3353,0.09815462678670883,0.07997224479913712,0.0826205164194107,0.12873396277427673,529.9539794921875,1e-05,0.07112079858779907,5.691401720046997,15.555094242095947,2 +3354,0.1118851751089096,0.06931833922863007,0.06965483725070953,0.17345352470874786,518.14990234375,1e-05,0.06467575579881668,5.696304798126221,15.555094242095947,2 +3355,0.06846200674772263,0.15271756052970886,0.12533098459243774,0.23946313560009003,984.0426025390625,1e-05,0.06935902684926987,5.7626049518585205,15.555094242095947,2 +3356,0.07029296457767487,0.10084661096334457,0.10032714903354645,0.1620512753725052,352.0115051269531,1e-05,0.07614048570394516,5.673676490783691,15.555094242095947,2 +3357,0.05108587071299553,0.2090834677219391,0.19153176248073578,0.2617708146572113,995.9349365234375,1e-05,0.06757548451423645,5.707044363021851,15.555094242095947,2 +3358,0.08801601827144623,0.20369945466518402,0.1993345469236374,0.2930368483066559,194.25677490234375,1e-05,0.06302095949649811,5.709501028060913,15.555094242095947,2 +3359,0.11740650236606598,0.08832310885190964,0.07790666073560715,0.2590865194797516,851.9107666015625,1e-05,0.07509167492389679,5.698892116546631,15.555094242095947,2 +3360,0.11792004108428955,0.06611927598714828,0.06420663744211197,0.28629806637763977,780.0751953125,1e-05,0.059387799352407455,5.699007511138916,15.555094242095947,2 +3361,0.04517519474029541,0.15034063160419464,0.13603897392749786,0.31302082538604736,993.0098266601562,1e-05,0.04940878972411156,5.694601058959961,15.555094242095947,2 +3362,0.07181071490049362,0.06685216724872589,0.06809886544942856,0.15718749165534973,687.94970703125,1e-05,0.06336908042430878,5.690983772277832,15.555094242095947,2 +3363,0.07172728329896927,0.06975430250167847,0.06473100185394287,0.24728363752365112,827.7026977539062,1e-05,0.05658498778939247,5.701549053192139,15.555094242095947,2 +3364,0.07191047072410583,0.12004365772008896,0.11011617630720139,0.2612980604171753,982.2193603515625,1e-05,0.08087436109781265,5.688904523849487,15.555094242095947,2 +3365,0.08533693850040436,0.8105095624923706,0.8031506538391113,0.22552883625030518,19.685039520263672,1e-05,0.04931655898690224,5.677242279052734,15.555094242095947,2 +3366,0.050227489322423935,0.0853104442358017,0.07795834541320801,0.20434294641017914,898.0855712890625,1e-05,0.06308509409427643,5.755148410797119,15.555094242095947,2 +3367,0.06854890286922455,0.09029130637645721,0.0847354456782341,0.26720350980758667,831.6600341796875,1e-05,0.09960266947746277,5.682455539703369,15.555094242095947,2 +3368,0.057986676692962646,0.07393337041139603,0.07771598547697067,0.17608171701431274,632.4110717773438,1e-05,0.06059136241674423,5.685758113861084,15.555094242095947,2 +3369,0.12476594001054764,0.9803343415260315,0.9797343015670776,0.2522035241127014,9.920635223388672,1e-05,0.07405684143304825,5.6856162548065186,15.555094242095947,2 +3370,0.06510277092456818,0.06505008786916733,0.06390302628278732,0.19361376762390137,651.3410034179688,1e-05,0.07331056892871857,5.6908111572265625,15.555094242095947,2 +3371,0.08978743106126785,0.04433731362223625,0.04517334699630737,0.07383012771606445,901.2276611328125,1e-05,0.08498428016901016,5.679276466369629,15.555094242095947,2 +3372,0.08163786679506302,0.08083904534578323,0.07809377461671829,0.19876602292060852,745.1535034179688,1e-05,0.05778191611170769,5.689560890197754,15.555094242095947,2 +3373,0.07069883495569229,0.056039340794086456,0.052382778376340866,0.24905447661876678,859.375,1e-05,0.0620606429874897,5.689194917678833,15.555094242095947,2 +3374,0.11032694578170776,0.05398750677704811,0.05516183376312256,0.1791185885667801,870.2915649414062,1e-05,0.0726962462067604,5.682231664657593,15.555094242095947,2 +3375,0.08202468603849411,0.07198131829500198,0.06779220700263977,0.21931089460849762,772.1712036132812,1e-05,0.06270620226860046,5.688292026519775,15.555094242095947,2 +3376,0.1285511702299118,0.08010047674179077,0.07892660796642303,0.24068909883499146,827.7026977539062,1e-05,0.05968470498919487,5.684584856033325,15.555094242095947,2 +3377,0.08359374105930328,0.25045517086982727,0.24251779913902283,0.2593749761581421,992.374267578125,1e-05,0.060483772307634354,5.67383337020874,15.555094242095947,2 +3378,0.08494362235069275,0.11936569213867188,0.11753780394792557,0.2185496687889099,710.2763671875,1e-05,0.07857116311788559,5.682282209396362,15.555094242095947,2 +3379,0.0719858855009079,0.08184638619422913,0.07642815262079239,0.19322115182876587,547.7528686523438,1e-05,0.05993356928229332,5.6831653118133545,15.555094242095947,2 +3380,0.056185945868492126,0.05838747322559357,0.05633784458041191,0.2625480592250824,618.6868286132812,1e-05,0.06337018311023712,5.688920974731445,15.555094242095947,2 +3381,0.09323558956384659,0.07234229892492294,0.0657956525683403,0.2205849289894104,730.0333251953125,1e-05,0.06912626326084137,5.689125061035156,15.555094242095947,2 +3382,0.09985826909542084,0.011641123332083225,0.011755337007343769,0.013020833022892475,898.4814453125,1e-05,0.0756341964006424,5.679935455322266,15.555094242095947,2 +3383,0.08753608167171478,0.044429704546928406,0.04422891139984131,0.18415865302085876,691.9642944335938,1e-05,0.06345424056053162,5.68523907661438,15.555094242095947,2 +3384,0.055832307785749435,0.04445960372686386,0.047300901263952255,0.30233973264694214,622.4899291992188,1e-05,0.05455118045210838,5.683650016784668,15.555094242095947,2 +3385,0.08028092980384827,0.10149339586496353,0.09660553187131882,0.21165063977241516,533.2568969726562,1e-05,0.07048695534467697,5.686498641967773,15.555094242095947,2 +3386,0.050287652760744095,0.09740179032087326,0.0938107818365097,0.275064080953598,874.8499145507812,1e-05,0.05702836066484451,5.678136587142944,15.555094242095947,2 +3387,0.05364743620157242,0.10425609350204468,0.09908975660800934,0.24331730604171753,833.8881225585938,1e-05,0.06418875604867935,5.695552349090576,15.555094242095947,2 +3388,0.08441274613142014,0.14943353831768036,0.14689308404922485,0.28736376762390137,960.3799438476562,1e-05,0.05748388171195984,5.685394287109375,15.555094242095947,2 +3389,0.04717332869768143,0.11973248422145844,0.11188025772571564,0.2185657024383545,947.1898803710938,1e-05,0.07024876773357391,5.685036897659302,15.555094242095947,2 +3390,0.06220449134707451,0.07543675601482391,0.07031020522117615,0.2576282024383545,736.8637084960938,1e-05,0.05488967522978783,5.673428773880005,15.555094242095947,2 +3391,0.06622545421123505,0.06591426581144333,0.06461435556411743,0.27446311712265015,942.1181640625,1e-05,0.06685368716716766,5.681596994400024,15.555094242095947,2 +3392,0.10439015179872513,0.10666242986917496,0.10383526235818863,0.23364582657814026,802.292236328125,1e-05,0.08177237957715988,5.690654277801514,15.555094242095947,2 +3393,0.11925514787435532,0.43694934248924255,0.4400790333747864,0.20743589103221893,83.95523071289062,1e-05,0.06412927806377411,5.686133623123169,15.555094242095947,2 +3394,0.03532565385103226,0.015549866482615471,0.015646308660507202,0.16336537897586823,801.0057983398438,1e-05,0.05993155762553215,5.69460129737854,15.555094242095947,2 +3395,0.13230851292610168,0.26136359572410583,0.24827930331230164,0.26287660002708435,145.7597198486328,1e-05,0.06928812712430954,5.698680877685547,15.555094242095947,2 +3396,0.05278707295656204,0.065081387758255,0.06794505566358566,0.22718748450279236,606.9959106445312,1e-05,0.049228426069021225,5.744241952896118,15.555094242095947,2 +3397,0.05650879442691803,0.16843944787979126,0.16798967123031616,0.2943990230560303,978.7327270507812,1e-05,0.05477163940668106,5.900141954421997,15.555094242095947,2 +3398,0.05277048796415329,0.14358171820640564,0.1398123800754547,0.24410255253314972,996.3473510742188,1e-05,0.05733701214194298,5.8990373611450195,15.555094242095947,2 +3399,0.11253924667835236,0.12302771210670471,0.11811608821153641,0.23092146217823029,448.71795654296875,1e-05,0.06273113191127777,5.684345006942749,15.555094242095947,2 +3400,0.051937129348516464,0.06501469016075134,0.06785304844379425,0.077740378677845,976.1173706054688,1e-05,0.06349363923072815,5.6791300773620605,15.555094242095947,2 +3401,0.10337621718645096,0.056330397725105286,0.057461537420749664,0.12115383893251419,653.6259765625,1e-05,0.061432961374521255,5.692360877990723,15.555094242095947,2 +3402,0.08003383874893188,0.17305445671081543,0.15975701808929443,0.2365064024925232,973.9398803710938,1e-05,0.06799504905939102,5.689068078994751,15.555094242095947,2 +3403,0.0364098884165287,0.08583937585353851,0.08265596628189087,0.2563862204551697,937.1871948242188,1e-05,0.04608691856265068,5.695964574813843,15.555094242095947,2 +3404,0.05457714572548866,0.12779487669467926,0.12446784973144531,0.20523236691951752,978.0244140625,1e-05,0.05536504462361336,5.6967387199401855,15.555094242095947,2 +3405,0.05578761175274849,0.10255212336778641,0.09827770292758942,0.23550480604171753,876.1961669921875,1e-05,0.05317406728863716,5.702638387680054,15.555094242095947,2 +3406,0.05700576305389404,0.08129159361124039,0.07387421280145645,0.2475080043077469,811.095458984375,1e-05,0.05952288955450058,5.687257766723633,15.555094242095947,2 +3407,0.06085466220974922,0.08014199882745743,0.07552854716777802,0.25612980127334595,764.7515258789062,1e-05,0.054764505475759506,5.682582378387451,15.555094242095947,2 +3408,0.05599263682961464,0.08648418635129929,0.08388372510671616,0.2541506290435791,842.5684204101562,1e-05,0.060213908553123474,5.931974649429321,15.555094242095947,2 +3409,0.04422872141003609,0.021400567144155502,0.02079787105321884,0.11491987109184265,736.8637084960938,1e-05,0.05668231099843979,5.680120944976807,15.555094242095947,2 +3410,0.0982634425163269,0.13782484829425812,0.13544602692127228,0.23903845250606537,264.1955871582031,1e-05,0.09944374859333038,5.704303741455078,15.555094242095947,2 +3411,0.022928152233362198,0.06148379296064377,0.05807686597108841,0.2510416507720947,952.09716796875,1e-05,0.066732257604599,5.698646783828735,15.555094242095947,2 +3412,0.08154058456420898,0.07380213588476181,0.0733533501625061,0.20261217653751373,633.6292114257812,1e-05,0.05982446298003197,5.6914238929748535,15.555094242095947,2 +3413,0.07117249816656113,0.05471305549144745,0.054968513548374176,0.11637018620967865,799.7118530273438,1e-05,0.061135925352573395,5.696021795272827,15.555094242095947,2 +3414,0.10156220942735672,0.0705784410238266,0.06766975671052933,0.24825319647789001,920.7059936523438,1e-05,0.08308045566082001,5.696269512176514,15.555094242095947,2 +3415,0.11812954396009445,0.07977656275033951,0.07999520003795624,0.23190703988075256,912.8910522460938,1e-05,0.05446280911564827,5.698513507843018,15.555094242095947,2 +3416,0.0814821794629097,0.08476494252681732,0.08174388110637665,0.2461378127336502,948.9403076171875,1e-05,0.061618588864803314,5.704576253890991,15.555094242095947,2 +3417,0.07404220849275589,0.0939486101269722,0.09247396886348724,0.27579325437545776,926.165771484375,1e-05,0.057517074048519135,5.69818377494812,15.555094242095947,2 +3418,0.08490168303251266,0.06914680451154709,0.06422846019268036,0.20336537063121796,907.3464965820312,1e-05,0.06251585483551025,5.894672393798828,15.555094242095947,2 +3419,0.0628601461648941,0.09646367281675339,0.0950004830956459,0.2802003026008606,956.0206298828125,1e-05,0.05778469517827034,5.682920932769775,15.555094242095947,2 +3420,0.0773678570985794,0.07005758583545685,0.06865643709897995,0.2518269121646881,937.5,1e-05,0.05939880385994911,5.69294285774231,15.555094242095947,2 +3421,0.10827000439167023,0.050065916031599045,0.05056314915418625,0.16903845965862274,801.64990234375,1e-05,0.08740859478712082,5.6848883628845215,15.555094242095947,2 +3422,0.11447987705469131,0.06779960542917252,0.06625135987997055,0.24127402901649475,719.4397583007812,1e-05,0.07793020457029343,5.6746790409088135,15.555094242095947,2 +3423,0.09294462203979492,0.4259156286716461,0.43000563979148865,0.21777242422103882,109.48905944824219,1e-05,0.054217975586652756,5.684972763061523,15.555094242095947,2 +3424,0.08884171396493912,0.07355093210935593,0.0683065876364708,0.2975480556488037,666.9776611328125,1e-05,0.10668326169252396,5.684100151062012,15.555094242095947,2 +3425,0.06710582226514816,0.12363391369581223,0.11774095147848129,0.15010416507720947,913.6167602539062,1e-05,0.05197610706090927,5.692543029785156,15.555094242095947,2 +3426,0.1174645945429802,0.18626311421394348,0.18369559943675995,0.19144229590892792,141.84397888183594,1e-05,0.05996452271938324,5.686990737915039,15.555094242095947,2 +3427,0.08814418315887451,0.06651212275028229,0.06430147588253021,0.2043830007314682,886.6278686523438,1e-05,0.06692150980234146,5.690777778625488,15.555094242095947,2 +3428,0.1041315346956253,0.0926968976855278,0.08751408010721207,0.23249998688697815,798.4103393554688,1e-05,0.05989553779363632,5.679004907608032,15.555094242095947,2 +3429,0.0908501073718071,0.03845047578215599,0.04080936312675476,0.14874999225139618,758.6478271484375,1e-05,0.05216675251722336,5.966223955154419,15.555094242095947,2 +3430,0.05757245793938637,0.12478314340114594,0.12029408663511276,0.2016826868057251,985.3936767578125,1e-05,0.0548192597925663,5.672802925109863,15.555094242095947,2 +3431,0.06597249954938889,0.07375704497098923,0.07102999091148376,0.19103364646434784,709.3425903320312,1e-05,0.05890258774161339,5.689138174057007,15.555094242095947,2 +3432,0.057267215102910995,0.07981764525175095,0.0747159942984581,0.2391105741262436,686.9369506835938,1e-05,0.06554513424634933,5.692240476608276,15.555094242095947,2 +3433,0.07516328245401382,0.09083914011716843,0.09055022150278091,0.1499759554862976,867.5030517578125,1e-05,0.06233809143304825,5.684507846832275,15.555094242095947,2 +3434,0.10361786186695099,0.12313895672559738,0.11972469836473465,0.2521233856678009,947.1898803710938,1e-05,0.0733303502202034,5.677435874938965,15.555094242095947,2 +3435,0.062113046646118164,0.05474086478352547,0.05150217562913895,0.25265222787857056,781.4841918945312,1e-05,0.09631840884685516,5.685375928878784,15.555094242095947,2 +3436,0.07964339107275009,0.06947532296180725,0.06521225720643997,0.21993589401245117,721.2352294921875,1e-05,0.05699742212891579,5.6793200969696045,15.555094242095947,2 +3437,0.06795071810483932,0.2013251781463623,0.19900020956993103,0.2712419629096985,984.94482421875,1e-05,0.06129935383796692,5.686698913574219,15.555094242095947,2 +3438,0.09502807259559631,0.10818617045879364,0.10517748445272446,0.1691666543483734,511.2293395996094,1e-05,0.08966535329818726,5.688836097717285,15.555094242095947,2 +3439,0.052107423543930054,0.11972930282354355,0.11314325779676437,0.23423075675964355,893.2648315429688,1e-05,0.05713561549782753,5.882380723953247,15.555094242095947,2 +3440,0.09392531961202621,0.06251760572195053,0.07059451192617416,0.1411939114332199,999.1974487304688,1e-05,0.07201141119003296,5.743139743804932,15.555094242095947,2 +3441,0.13639505207538605,0.13886292278766632,0.13450439274311066,0.29653844237327576,308.7349548339844,1e-05,0.06426585465669632,5.696059465408325,15.555094242095947,2 +3442,0.08960361033678055,0.11011534184217453,0.11294738203287125,0.20884615182876587,264.1955871582031,1e-05,0.07475149631500244,6.065711498260498,15.555094242095947,2 +3443,0.05216071009635925,0.04737934470176697,0.04781109839677811,0.1812339723110199,817.174560546875,1e-05,0.07665132731199265,5.6874167919158936,15.555094242095947,2 +3444,0.1459333449602127,0.07543294131755829,0.0711674913764,0.2292788326740265,839.3560791015625,1e-05,0.08970416337251663,5.683658838272095,15.555094242095947,2 +3445,0.1003340482711792,0.06322073191404343,0.062293414026498795,0.24516025185585022,645.55126953125,1e-05,0.05867108702659607,5.890660047531128,15.555094242095947,2 +3446,0.09294344484806061,0.058448392897844315,0.05517188832163811,0.1417948603630066,649.0385131835938,1e-05,0.07744462043046951,5.685717582702637,15.555094242095947,2 +3447,0.10755857080221176,0.08487670123577118,0.08601909875869751,0.2205929458141327,495.1690979003906,1e-05,0.07469773292541504,5.687141418457031,15.555094242095947,2 +3448,0.06739749014377594,0.07650823146104813,0.07156969606876373,0.25556889176368713,944.8242797851562,1e-05,0.054623402655124664,5.686141729354858,15.555094242095947,2 +3449,0.08491820096969604,0.09532330185174942,0.09345714002847672,0.19986377656459808,936.2449951171875,1e-05,0.07048561424016953,5.684380292892456,15.555094242095947,2 +3450,0.15188907086849213,0.11010847240686417,0.10193706303834915,0.2513701915740967,964.61181640625,1e-05,0.093618243932724,5.965487241744995,15.555094242095947,2 +3451,0.05604008585214615,0.11495573073625565,0.10218476504087448,0.2444951832294464,902.0044555664062,1e-05,0.08775881677865982,5.681746959686279,15.555094242095947,2 +3452,0.07215438038110733,0.0701151117682457,0.0667375847697258,0.14569711685180664,812.9371337890625,1e-05,0.06143485754728317,5.695891857147217,15.555094242095947,2 +3453,0.0799393579363823,0.10246090590953827,0.11266952008008957,0.23856569826602936,279.50311279296875,1e-05,0.07275589555501938,5.685976982116699,15.555094242095947,2 +3454,0.0652880072593689,0.10465287417173386,0.09703101217746735,0.23970352113246918,807.365478515625,1e-05,0.09045170992612839,5.694942474365234,15.555094242095947,2 +3455,0.05661284178495407,0.1284320205450058,0.11808525770902634,0.2542628049850464,951.5281982421875,1e-05,0.07868292182683945,5.6866960525512695,15.555094242095947,2 +3456,0.08265523612499237,0.05943458899855614,0.06194491311907768,0.2494150549173355,859.375,1e-05,0.07565992325544357,5.684069633483887,15.555094242095947,2 +3457,0.10147847980260849,0.1553182601928711,0.14112870395183563,0.2311939001083374,995.5211791992188,1e-05,0.12771525979042053,5.68879771232605,15.555094242095947,2 +3458,0.11979880183935165,0.06355250626802444,0.059382472187280655,0.183461531996727,687.94970703125,1e-05,0.08469969779253006,5.692614316940308,15.555094242095947,2 +3459,0.07528242468833923,0.09374634176492691,0.08416695147752762,0.22161857783794403,811.7109985351562,1e-05,0.06244218349456787,5.825139045715332,15.555094242095947,2 +3460,0.09977440536022186,0.16284140944480896,0.15066158771514893,0.2946714758872986,979.9048461914062,1e-05,0.09262625873088837,5.711655616760254,15.555094242095947,2 +3461,0.10297325998544693,0.07505667954683304,0.0729508101940155,0.15709935128688812,863.7206420898438,1e-05,0.12594623863697052,5.752098321914673,15.555094242095947,2 +3462,0.08148650825023651,0.04361435025930405,0.052441779524087906,0.21419870853424072,994.4806518554688,1e-05,0.0871664360165596,5.6919167041778564,15.555094242095947,2 +3463,0.029969803988933563,0.08861593902111053,0.08489453792572021,0.2234855741262436,943.9275512695312,1e-05,0.05990788713097572,5.700380563735962,15.555094242095947,2 +3464,0.08334684371948242,0.06874854117631912,0.06428473442792892,0.2910096049308777,665.8878784179688,1e-05,0.13185371458530426,5.697006464004517,15.555094242095947,2 +3465,0.0492611899971962,0.04149916395545006,0.04850863665342331,0.21977563202381134,941.20556640625,1e-05,0.07525509595870972,5.693663120269775,15.555094242095947,2 +3466,0.11260874569416046,0.14238950610160828,0.1443909853696823,0.20266826450824738,946.896240234375,1e-05,0.06183643266558647,5.893473386764526,15.555094242095947,2 +3467,0.11830595880746841,0.06304210424423218,0.05819595232605934,0.2158493548631668,903.9313354492188,1e-05,0.12608946859836578,5.6946117877960205,15.555094242095947,2 +3468,0.07917873561382294,0.06799382716417313,0.0640384703874588,0.23516826331615448,776.5151977539062,1e-05,0.08638336509466171,5.689519643783569,15.555094242095947,2 +3469,0.08178232610225677,0.06609456241130829,0.06621028482913971,0.22577723860740662,652.4856567382812,1e-05,0.059104640036821365,5.696831941604614,15.555094242095947,2 +3470,0.1022329032421112,0.08039893209934235,0.08437059819698334,0.25977563858032227,379.5264587402344,1e-05,0.11668312549591064,5.699328660964966,15.555094242095947,2 +3471,0.09521935880184174,0.8865748643875122,0.8849966526031494,0.2488381266593933,4.9800801277160645,1e-05,0.059522662311792374,5.880217552185059,15.555094242095947,2 +3472,0.054138798266649246,0.08927037566900253,0.08352667093276978,0.22862979769706726,930.143310546875,1e-05,0.06513705104589462,5.684957981109619,15.555094242095947,2 +3473,0.07677528262138367,0.08205343782901764,0.07573303580284119,0.1293269246816635,570.6521606445312,1e-05,0.06286153197288513,5.689631700515747,15.555094242095947,2 +3474,0.058217912912368774,0.06404560059309006,0.06451654434204102,0.18349358439445496,753.9683227539062,1e-05,0.058486271649599075,5.710635423660278,15.555094242095947,2 +3475,0.06521762907505035,0.10999097675085068,0.10399820655584335,0.11205928772687912,949.22998046875,1e-05,0.06180763617157936,5.687068939208984,15.555094242095947,3 +3476,0.044253814965486526,0.10713933408260345,0.09756222367286682,0.2531971037387848,943.3267822265625,1e-05,0.15661603212356567,5.696017503738403,15.555094242095947,3 +3477,0.09805044531822205,0.18321754038333893,0.1631031185388565,0.2533974349498749,983.36181640625,1e-05,0.06539873033761978,5.693585395812988,15.555094242095947,3 +3478,0.09352102875709534,0.08671770244836807,0.08103638142347336,0.14847755432128906,434.0730895996094,1e-05,0.06811753660440445,5.692307472229004,15.555094242095947,3 +3479,0.08995302766561508,0.0918482169508934,0.09148922562599182,0.12727563083171844,996.3473510742188,1e-05,0.06984230875968933,5.701792001724243,15.555094242095947,3 +3480,0.08323776721954346,0.0749296024441719,0.06785987317562103,0.2660015821456909,850.8939819335938,1e-05,0.05827703699469566,5.699543237686157,15.555094242095947,3 +3481,0.07688570022583008,0.05171153321862221,0.05380725860595703,0.2458493560552597,755.5379638671875,1e-05,0.05806884542107582,5.692090034484863,15.555094242095947,3 +3482,0.08938108384609222,0.10470809042453766,0.10324645787477493,0.26894229650497437,959.5725708007812,1e-05,0.06674765050411224,5.686483860015869,15.555094242095947,3 +3483,0.09878361225128174,0.07972981780767441,0.07885830104351044,0.18088141083717346,604.3388061523438,1e-05,0.07084167003631592,5.701487064361572,15.555094242095947,3 +3484,0.048245906829833984,0.07127539068460464,0.06831838190555573,0.22853364050388336,869.3666381835938,1e-05,0.05604013428092003,5.942671060562134,15.555094242095947,3 +3485,0.06849095970392227,0.1029905304312706,0.09667975455522537,0.0883573666214943,960.1112060546875,1e-05,0.058205027133226395,5.687739849090576,15.555094242095947,3 +3486,0.0936531350016594,0.07098855078220367,0.06489216536283493,0.1341666579246521,939.6723022460938,1e-05,0.07816459983587265,5.685943603515625,15.555094242095947,3 +3487,0.09781752526760101,0.06643046438694,0.06309477239847183,0.10970351845026016,901.616455078125,1e-05,0.08155837655067444,5.68384861946106,15.555094242095947,3 +3488,0.08328995108604431,0.10422879457473755,0.09777213633060455,0.1767868548631668,899.6636962890625,1e-05,0.05359199270606041,5.6824870109558105,15.555094242095947,3 +3489,0.04639821872115135,0.06916286051273346,0.06355109810829163,0.2230849266052246,836.6402587890625,1e-05,0.05634326487779617,5.698822259902954,15.555094242095947,3 +3490,0.105274997651577,0.18147803843021393,0.17500868439674377,0.2646874785423279,981.0671997070312,1e-05,0.06276074051856995,5.683851718902588,15.555094242095947,3 +3491,0.06183925271034241,0.15070337057113647,0.13731153309345245,0.21811698377132416,959.8422241210938,1e-05,0.06250942498445511,5.691382646560669,15.555094242095947,3 +3492,0.11726327240467072,0.047508593648672104,0.04129412770271301,0.261290043592453,693.9501953125,1e-05,0.08067962527275085,5.761941432952881,15.555094242095947,3 +3493,0.06760135293006897,0.12121853232383728,0.12971103191375732,0.30475160479545593,993.8524169921875,1e-05,0.05423979461193085,5.69171929359436,15.555094242095947,3 +3494,0.1334579885005951,0.06202598288655281,0.05618275701999664,0.22056089341640472,640.8381958007812,1e-05,0.06042172387242317,5.676089286804199,15.555094242095947,3 +3495,0.0878070816397667,0.8181170225143433,0.8254534602165222,0.28071314096450806,14.822135925292969,1e-05,0.08468743413686752,5.729506492614746,15.555094242095947,3 +3496,0.0910511463880539,0.026625951752066612,0.02931251935660839,0.22132210433483124,715.8119506835938,1e-05,0.06246030330657959,5.683605194091797,15.555094242095947,3 +3497,0.07082663476467133,0.10267557948827744,0.1128595694899559,0.20896634459495544,976.5967407226562,1e-05,0.06969939917325974,5.683498382568359,15.555094242095947,3 +3498,0.1359078288078308,0.13268353044986725,0.12223176658153534,0.2162499874830246,935.2970581054688,1e-05,0.06767215579748154,5.683292388916016,15.555094242095947,3 +3499,0.0847131684422493,0.017369326204061508,0.020525097846984863,0.18819710612297058,484.06866455078125,1e-05,0.05706687644124031,5.687903642654419,15.555094242095947,3 +3500,0.11719710379838943,0.04756984859704971,0.04775075241923332,0.09933493286371231,853.9290161132812,1e-05,0.0781179890036583,5.683164119720459,15.555094242095947,3 +3501,0.07931356132030487,0.06547269970178604,0.06545261293649673,0.09214743226766586,889.9769897460938,1e-05,0.057751018553972244,5.727832317352295,15.555094242095947,3 +3502,0.09318384528160095,0.10285962373018265,0.09897711127996445,0.25149840116500854,744.3366088867188,1e-05,0.0656299889087677,5.699043035507202,15.555094242095947,3 +3503,0.08365197479724884,0.2476823776960373,0.2504805624485016,0.19506409764289856,989.148681640625,1e-05,0.050620824098587036,5.720066785812378,15.555094242095947,3 +3504,0.06818654388189316,0.09999920427799225,0.10086207836866379,0.10875800997018814,992.1616821289062,1e-05,0.058163195848464966,5.740490913391113,15.555094242095947,3 +3505,0.09581585228443146,0.122764453291893,0.12633833289146423,0.2922596037387848,403.11651611328125,1e-05,0.05987406522035599,5.70674204826355,15.555094242095947,3 +3506,0.09834906458854675,0.14620785415172577,0.14256791770458221,0.29144230484962463,986.952880859375,1e-05,0.06247527524828911,5.689842700958252,15.555094242095947,3 +3507,0.0695837140083313,0.14578525722026825,0.14259909093379974,0.3079807460308075,994.0623168945312,1e-05,0.08359663933515549,5.689958095550537,15.555094242095947,3 +3508,0.07784043997526169,0.028504345566034317,0.027480855584144592,0.2191426157951355,753.1796264648438,1e-05,0.06775223463773727,5.893032073974609,15.555094242095947,3 +3509,0.08770895004272461,0.15852907299995422,0.13713489472866058,0.1629967838525772,997.7804565429688,1e-05,0.04990168660879135,5.695024490356445,15.555094242095947,3 +3510,0.05205922946333885,0.13462390005588531,0.12053331732749939,0.22631409764289856,957.39697265625,1e-05,0.05123402550816536,5.709479331970215,15.555094242095947,3 +3511,0.07047881931066513,0.09976920485496521,0.08868582546710968,0.2172115296125412,928.1668090820312,1e-05,0.08302024751901627,5.9416258335113525,15.555094242095947,3 +3512,0.07357993721961975,0.06884153932332993,0.07097169011831284,0.21445512771606445,873.039794921875,1e-05,0.06981851905584335,5.710748672485352,15.555094242095947,3 +3513,0.11994606256484985,0.4483160376548767,0.4467436373233795,0.23416665196418762,109.48905944824219,1e-05,0.062247809022665024,5.898514986038208,15.555094242095947,3 +3514,0.07121530920267105,0.20378252863883972,0.19110246002674103,0.16249999403953552,993.8524169921875,1e-05,0.06848552823066711,5.9023683071136475,15.555094242095947,3 +3515,0.09380193799734116,0.10909444093704224,0.1075633317232132,0.24583332240581512,788.4046630859375,1e-05,0.06501401960849762,5.81689453125,15.555094242095947,3 +3516,0.08333956450223923,0.11635857075452805,0.11426892876625061,0.19930288195610046,458.8607482910156,1e-05,0.05609537661075592,5.829050540924072,15.555094242095947,3 +3517,0.11814694851636887,0.03388671576976776,0.03534172847867012,0.1546153724193573,784.97021484375,1e-05,0.0603463351726532,5.6994781494140625,15.555094242095947,3 +3518,0.08112319558858871,0.23776841163635254,0.24267764389514923,0.21340544521808624,993.0098266601562,1e-05,0.08588851988315582,5.694263219833374,15.555094242095947,3 +3519,0.12392082810401917,0.055085405707359314,0.052810341119766235,0.26288461685180664,757.0978393554688,1e-05,0.06934570521116257,5.692626953125,15.555094242095947,3 +3520,0.05165828764438629,0.09140550345182419,0.09545332938432693,0.1546233892440796,992.58642578125,1e-05,0.07419250905513763,5.697519540786743,15.555094242095947,3 +3521,0.11679485440254211,0.18350353837013245,0.20415140688419342,0.17439903318881989,129.92831420898438,1e-05,0.06403908133506775,5.698723793029785,15.555094242095947,3 +3522,0.06861750036478043,0.020924033597111702,0.023635687306523323,0.21022434532642365,700.7908935546875,1e-05,0.07001574337482452,5.694927453994751,15.555094242095947,3 +3523,0.041050396859645844,0.12505610287189484,0.12031485885381699,0.23241184651851654,993.0098266601562,1e-05,0.07003747671842575,5.698099374771118,15.555094242095947,3 +3524,0.10102705657482147,0.06447724997997284,0.06226121634244919,0.2580047845840454,796.4441528320312,1e-05,0.07632395625114441,5.687129497528076,15.555094242095947,3 +3525,0.06845283508300781,0.020211437717080116,0.022060228511691093,0.15116986632347107,691.9642944335938,1e-05,0.05641023814678192,5.72378396987915,15.555094242095947,3 +3526,0.06612161546945572,0.11996971070766449,0.11376603692770004,0.21208332479000092,977.5501098632812,1e-05,0.07111120223999023,5.699958324432373,15.555094242095947,3 +3527,0.1042967140674591,0.06382134556770325,0.06462500989437103,0.2718189060688019,735.1730346679688,1e-05,0.08295200020074844,5.689681529998779,15.555094242095947,3 +3528,0.09155405312776566,0.06874505430459976,0.0648825392127037,0.1535416543483734,914.3394165039062,1e-05,0.06527966260910034,5.702328681945801,15.555094242095947,3 +3529,0.10350418090820312,0.046700675040483475,0.04736773669719696,0.2938862144947052,626.2474975585938,1e-05,0.05893085524439812,5.700118064880371,15.555094242095947,3 +3530,0.08430006355047226,0.16203784942626953,0.17031872272491455,0.22715544700622559,992.1616821289062,1e-05,0.0679970309138298,5.937019109725952,15.555094242095947,3 +3531,0.08918377757072449,0.08949513733386993,0.08701963722705841,0.18568909168243408,416.6666564941406,1e-05,0.054384928196668625,5.689263820648193,15.555094242095947,3 +3532,0.05800287798047066,0.08638380467891693,0.08257783949375153,0.19556890428066254,934.9798583984375,1e-05,0.057595789432525635,5.924276113510132,15.555094242095947,3 +3533,0.10056793689727783,0.11672414094209671,0.11179109662771225,0.17692306637763977,886.2048950195312,1e-05,0.06702624261379242,5.68590235710144,15.555094242095947,3 +3534,0.10145659744739532,0.05208861455321312,0.05822959914803505,0.14898236095905304,314.37127685546875,1e-05,0.0504826083779335,5.89234185218811,15.555094242095947,3 +3535,0.048497896641492844,0.07190777361392975,0.07412555068731308,0.13644230365753174,748.3948974609375,1e-05,0.0435054786503315,5.68739128112793,15.555094242095947,3 +3536,0.06836245208978653,0.2756829261779785,0.23499943315982819,0.24841345846652985,991.0935668945312,1e-05,0.07154221087694168,5.798670053482056,15.555094242095947,3 +3537,0.07413586229085922,0.02190980687737465,0.020207298919558525,0.1940624862909317,605.6701049804688,1e-05,0.06723695248365402,5.695805788040161,15.555094242095947,3 +3538,0.057468559592962265,0.10392309725284576,0.10508894175291061,0.22083333134651184,969.2273559570312,1e-05,0.05108145251870155,5.692930221557617,15.555094242095947,3 +3539,0.07539282739162445,0.2774519622325897,0.29425203800201416,0.16113781929016113,998.3897094726562,1e-05,0.05437904968857765,5.694195747375488,15.555094242095947,3 +3540,0.04023740440607071,0.053121116012334824,0.05536472052335739,0.22620192170143127,828.8410034179688,1e-05,0.051749538630247116,5.69400429725647,15.555094242095947,3 +3541,0.09979501366615295,0.08248050510883331,0.08020694553852081,0.2220272421836853,928.828369140625,1e-05,0.08161787688732147,5.6955859661102295,15.555094242095947,3 +3542,0.09435994923114777,0.05970039218664169,0.054675135761499405,0.2869230806827545,726.5493774414062,1e-05,0.04917813837528229,5.695749521255493,15.555094242095947,3 +3543,0.07299671322107315,0.22561316192150116,0.21056519448757172,0.3147996664047241,996.7586059570312,1e-05,0.0801076591014862,5.691360712051392,15.555094242095947,3 +3544,0.1071832925081253,0.10801046341657639,0.10035356134176254,0.24601761996746063,531.6091918945312,1e-05,0.05818038061261177,5.691298961639404,15.555094242095947,3 +3545,0.07207565754652023,0.07207067310810089,0.06821697950363159,0.2773236930370331,807.365478515625,1e-05,0.05628904700279236,5.70156455039978,15.555094242095947,3 +3546,0.07216984033584595,0.07148377597332001,0.07269487529993057,0.2446954995393753,924.4791870117188,1e-05,0.06612267345190048,5.9643824100494385,15.555094242095947,3 +3547,0.07173634320497513,0.06849270313978195,0.0667228177189827,0.23213940858840942,881.0508422851562,1e-05,0.064425028860569,5.678600549697876,15.555094242095947,3 +3548,0.08204437047243118,0.15309302508831024,0.14288125932216644,0.21693909168243408,967.7055053710938,1e-05,0.051409997045993805,5.694543123245239,15.555094242095947,3 +3549,0.05818874388933182,0.04076278209686279,0.04018399119377136,0.20316505432128906,855.9268798828125,1e-05,0.06555985659360886,5.697905778884888,15.555094242095947,3 +3550,0.09281831979751587,0.08547281473875046,0.08368164300918579,0.09547275304794312,891.2169799804688,1e-05,0.06491155922412872,5.701357126235962,15.555094242095947,3 +3551,0.091407909989357,0.0640939474105835,0.06374774128198624,0.23970352113246918,730.8970947265625,1e-05,0.07306206971406937,5.699523448944092,15.555094242095947,3 +3552,0.11098059266805649,0.16643767058849335,0.15776652097702026,0.19207531213760376,980.13818359375,1e-05,0.05511126667261124,5.695924758911133,15.555094242095947,3 +3553,0.08252166956663132,0.03663206845521927,0.037044450640678406,0.06782852113246918,766.25390625,1e-05,0.06536483019590378,5.694974184036255,15.555094242095947,3 +3554,0.08413630723953247,0.13005314767360687,0.12038678675889969,0.2616746723651886,993.8524169921875,1e-05,0.06591764092445374,5.693941116333008,15.555094242095947,3 +3555,0.0984996110200882,0.12938478589057922,0.1276216357946396,0.24193108081817627,967.9602661132812,1e-05,0.060353390872478485,5.692298650741577,15.555094242095947,3 +3556,0.0455625094473362,0.05521952360868454,0.052395518869161606,0.24580127000808716,873.947021484375,1e-05,0.055641718208789825,5.687205791473389,15.555094242095947,3 +3557,0.10243600606918335,0.056114088743925095,0.055702511221170425,0.22243589162826538,853.4264526367188,1e-05,0.09914831072092056,5.808459997177124,15.555094242095947,3 +3558,0.04438867047429085,0.10884777456521988,0.10846799612045288,0.21213139593601227,991.3079833984375,1e-05,0.060233499854803085,5.696783781051636,15.555094242095947,3 +3559,0.1175117939710617,0.09538005292415619,0.09418531507253647,0.23545671999454498,436.19793701171875,1e-05,0.06919330358505249,5.694642782211304,15.555094242095947,3 +3560,0.0883297249674797,0.01207386702299118,0.014215163886547089,0.18454326689243317,786.3502197265625,1e-05,0.0630551353096962,5.686925888061523,15.555094242095947,3 +3561,0.09244436770677567,0.14022864401340485,0.1374380886554718,0.18955928087234497,804.8433837890625,1e-05,0.062313586473464966,5.679640769958496,15.555094242095947,3 +3562,0.0722992792725563,0.13049130141735077,0.12511052191257477,0.23550480604171753,963.0394287109375,1e-05,0.052551448345184326,5.68790340423584,15.555094242095947,3 +3563,0.06292517483234406,0.08540137857198715,0.08768535405397415,0.14695511758327484,927.1693725585938,1e-05,0.058801162987947464,5.670820236206055,15.555094242095947,3 +3564,0.09865552186965942,0.05420847237110138,0.053716860711574554,0.20526441931724548,589.323486328125,1e-05,0.07185467332601547,5.685760736465454,15.555094242095947,3 +3565,0.04901247099041939,0.14553719758987427,0.14538335800170898,0.24090543389320374,972.2222290039062,1e-05,0.043337006121873856,5.680275917053223,15.555094242095947,3 +3566,0.05856388062238693,0.09761620312929153,0.09296365827322006,0.1917548030614853,890.3912353515625,1e-05,0.05448750779032707,5.684189558029175,15.555094242095947,3 +3567,0.10943999886512756,0.13129226863384247,0.13197293877601624,0.21350158751010895,300.1519775390625,1e-05,0.06964094191789627,5.68455171585083,15.555094242095947,3 +3568,0.08003869652748108,0.09682929515838623,0.09313219785690308,0.25254005193710327,736.8637084960938,1e-05,0.056463632732629776,5.687455415725708,15.555094242095947,3 +3569,0.09573952108621597,0.11388660222291946,0.10655002295970917,0.23385415971279144,898.4814453125,1e-05,0.059267859905958176,5.68944239616394,15.555094242095947,3 +3570,0.09525896608829498,0.10041762888431549,0.09616921097040176,0.22564902901649475,661.4877319335938,1e-05,0.06952075660228729,5.68634557723999,15.555094242095947,3 +3571,0.04788755998015404,0.05984143912792206,0.05775982141494751,0.2347676157951355,863.2425537109375,1e-05,0.04967552796006203,5.683284044265747,15.555094242095947,3 +3572,0.06516063958406448,0.10777011513710022,0.1035015657544136,0.22175480425357819,953.7914428710938,1e-05,0.06100841984152794,5.691180229187012,15.555094242095947,3 +3573,0.08369375765323639,0.07124719768762589,0.06354972720146179,0.19649839401245117,882.3529052734375,1e-05,0.060537755489349365,5.678598880767822,15.555094242095947,3 +3574,0.06875322014093399,0.1431562900543213,0.1304658204317093,0.14617787301540375,997.7804565429688,1e-05,0.0584123358130455,5.685709476470947,15.555094242095947,3 +3575,0.09324686229228973,0.0584825836122036,0.06044389680027962,0.24166665971279144,616.125732421875,1e-05,0.06419320404529572,5.679677248001099,15.555094242095947,3 +3576,0.07053856551647186,0.13734909892082214,0.1337897777557373,0.18889422714710236,964.3510131835938,1e-05,0.06533808261156082,5.878076791763306,15.555094242095947,3 +3577,0.09671124815940857,0.056925948709249496,0.0527154840528965,0.2104647308588028,769.9692993164062,1e-05,0.05078655481338501,5.693343639373779,15.555094242095947,3 +3578,0.0757366344332695,0.06443628668785095,0.05571212247014046,0.21810095012187958,869.8297119140625,1e-05,0.056726694107055664,5.8221166133880615,15.555094242095947,3 +3579,0.10883350670337677,0.05633500590920448,0.056953418999910355,0.25633013248443604,733.4710693359375,1e-05,0.05639733001589775,5.700706481933594,15.555094242095947,3 +3580,0.10717946290969849,0.07837298512458801,0.0801897719502449,0.2703285217285156,566.1925659179688,1e-05,0.055648934096097946,5.70445990562439,15.555094242095947,3 +3581,0.06281857192516327,0.16838474571704865,0.14581389725208282,0.24435095489025116,987.174072265625,1e-05,0.054409757256507874,5.692262172698975,15.555094242095947,3 +3582,0.10822504758834839,0.06502123922109604,0.0684918686747551,0.1833653748035431,487.8049011230469,1e-05,0.05752978101372719,5.698694705963135,15.555094242095947,3 +3583,0.05934377759695053,0.048792045563459396,0.046746689826250076,0.262668251991272,651.3410034179688,1e-05,0.05842209234833717,5.693624973297119,15.555094242095947,3 +3584,0.07155381143093109,0.0851268470287323,0.08048641681671143,0.22384615242481232,480.2955627441406,1e-05,0.0600765235722065,5.6970648765563965,15.555094242095947,3 +3585,0.07773179560899734,0.09347444027662277,0.09248968958854675,0.2898557484149933,541.3831787109375,1e-05,0.05424465984106064,5.732342004776001,15.555094242095947,3 +3586,0.06431787461042404,0.05288499593734741,0.051460735499858856,0.20829325914382935,572.1257934570312,1e-05,0.04946838691830635,5.701582908630371,15.555094242095947,3 +3587,0.10969237238168716,0.08270318806171417,0.07252813130617142,0.22827723622322083,844.6821899414062,1e-05,0.055410102009773254,5.697361707687378,15.555094242095947,3 +3588,0.07811446487903595,0.179195836186409,0.1748693734407425,0.12132211029529572,208.3333282470703,1e-05,0.059897057712078094,5.720599889755249,15.555094242095947,3 +3589,0.0711236298084259,0.05820589140057564,0.05538544803857803,0.25663459300994873,873.4939575195312,1e-05,0.05543842166662216,5.695558547973633,15.555094242095947,3 +3590,0.08061471581459045,0.11177592724561691,0.1075294017791748,0.2497996687889099,914.3394165039062,1e-05,0.06957417726516724,5.694291114807129,15.555094242095947,3 +3591,0.06453216075897217,0.04362550750374794,0.04443742707371712,0.2163301259279251,814.15625,1e-05,0.04978746548295021,5.6854472160339355,15.555094242095947,3 +3592,0.08342519402503967,0.10954924672842026,0.1010851263999939,0.2379487156867981,916.8442993164062,1e-05,0.06524699181318283,5.6953654289245605,15.555094242095947,3 +3593,0.08528569340705872,0.1262960284948349,0.14544729888439178,0.24359774589538574,149.64788818359375,1e-05,0.0686655193567276,5.696780204772949,15.555094242095947,3 +3594,0.07418429851531982,0.7543159127235413,0.7826359272003174,0.24106569588184357,24.50980567932129,1e-05,0.05400660261511803,5.696979284286499,15.555094242095947,3 +3595,0.08192073553800583,0.040536750108003616,0.04206696152687073,0.19827723503112793,638.4540405273438,1e-05,0.06125427037477493,5.69137978553772,15.555094242095947,3 +3596,0.06460855901241302,0.03706517443060875,0.03551127389073372,0.10370992869138718,945.1219482421875,1e-05,0.06697975099086761,5.6799561977386475,15.555094242095947,3 +3597,0.10578643530607224,0.09653421491384506,0.10191473364830017,0.19401441514492035,957.6707763671875,1e-05,0.06499719619750977,5.909566402435303,15.555094242095947,3 +3598,0.07276394218206406,0.02366241253912449,0.025830809026956558,0.11584935337305069,600.3118286132812,1e-05,0.05089934170246124,5.699136972427368,15.555094242095947,3 +3599,0.059491366147994995,0.11199673265218735,0.10577616840600967,0.21353363990783691,952.9466552734375,1e-05,0.07679364830255508,5.9320526123046875,15.555094242095947,3 +3600,0.08475487679243088,0.12004735320806503,0.12012026458978653,0.09612178802490234,133.9285888671875,1e-05,0.06483078747987747,5.6897478103637695,15.555094242095947,3 +3601,0.0849907174706459,0.057465750724077225,0.060621656477451324,0.1561698615550995,514.7058715820312,1e-05,0.06830897927284241,5.686514854431152,15.555094242095947,3 +3602,0.11249246448278427,0.08383887261152267,0.08162955194711685,0.21409454941749573,462.8463439941406,1e-05,0.06757287681102753,5.68175745010376,15.555094242095947,3 +3603,0.08802151679992676,0.06032552197575569,0.06062290072441101,0.10499999672174454,896.0928344726562,1e-05,0.06273023039102554,5.691125154495239,15.555094242095947,3 +3604,0.10732625424861908,0.18221254646778107,0.18688789010047913,0.26451119780540466,168.68511962890625,1e-05,0.06071249768137932,5.906386375427246,15.555094242095947,3 +3605,0.09341198205947876,0.07459632307291031,0.07166896760463715,0.21869389712810516,851.9107666015625,1e-05,0.06295006722211838,5.693371772766113,15.555094242095947,3 +3606,0.06384829431772232,0.08556614071130753,0.07907146960496902,0.27427083253860474,791.1160888671875,1e-05,0.06424631178379059,5.732465982437134,15.555094242095947,3 +3607,0.12704603374004364,0.07587366551160812,0.07682594656944275,0.18243588507175446,954.3519897460938,1e-05,0.050576113164424896,5.70072078704834,15.555094242095947,3 +3608,0.1322956532239914,0.03358523175120354,0.03668485954403877,0.2518429458141327,596.2343139648438,1e-05,0.05229160562157631,5.6866302490234375,15.555094242095947,3 +3609,0.08018641173839569,0.6396891474723816,0.6550230979919434,0.16361378133296967,34.046695709228516,1e-05,0.061102282255887985,5.698643445968628,15.555094242095947,3 +3610,0.08751194179058075,0.0618014931678772,0.05963113531470299,0.22547274827957153,725.671142578125,1e-05,0.06275998800992966,5.807775497436523,15.555094242095947,3 +3611,0.05893684923648834,0.12507115304470062,0.11586083471775055,0.2444150596857071,959.8422241210938,1e-05,0.04802597686648369,5.685492753982544,15.555094242095947,3 +3612,0.0501427948474884,0.13962869346141815,0.1322280615568161,0.2721714675426483,924.1397094726562,1e-05,0.05423370748758316,5.688551187515259,15.555094242095947,3 +3613,0.06461121141910553,0.07064315676689148,0.06688035279512405,0.22166666388511658,601.6597900390625,1e-05,0.058358676731586456,5.686197280883789,15.555094242095947,3 +3614,0.03979433700442314,0.06278186291456223,0.056216031312942505,0.17267628014087677,862.2828979492188,1e-05,0.06269583106040955,5.698939085006714,15.555094242095947,3 +3615,0.06672757863998413,0.08283833414316177,0.08114589005708694,0.20874999463558197,669.14501953125,1e-05,0.09665582329034805,5.688570022583008,15.555094242095947,3 +3616,0.06813844293355942,0.11791892349720001,0.11446463316679001,0.21723556518554688,536.5296630859375,1e-05,0.05700172483921051,5.6963982582092285,15.555094242095947,3 +3617,0.06798284500837326,0.06611094623804092,0.06550095230340958,0.2093830108642578,755.5379638671875,1e-05,0.06696303188800812,5.68716287612915,15.555094242095947,3 +3618,0.09594367444515228,0.09674247354269028,0.0964164063334465,0.24105767905712128,912.162109375,1e-05,0.05868232250213623,5.6872031688690186,15.555094242095947,3 +3619,0.08654186129570007,0.08490274101495743,0.07671699672937393,0.2532772421836853,657.0208740234375,1e-05,0.048345908522605896,5.682509660720825,15.555094242095947,3 +3620,0.08494067192077637,0.09168730676174164,0.09147569537162781,0.16922275722026825,592.105224609375,1e-05,0.05797531083226204,5.692184925079346,15.555094242095947,3 +3621,0.0958162397146225,0.06409291177988052,0.06072799861431122,0.24612979590892792,710.2763671875,1e-05,0.054644085466861725,5.6915082931518555,15.555094242095947,3 +3622,0.0947590321302414,0.10298259556293488,0.10331912338733673,0.09863781929016113,322.7003173828125,1e-05,0.056791894137859344,5.687627553939819,15.555094242095947,3 +3623,0.10259309411048889,0.06650343537330627,0.07059215009212494,0.1257612109184265,496.98797607421875,1e-05,0.053995855152606964,5.6817240715026855,15.555094242095947,3 +3624,0.10585415363311768,0.11677876859903336,0.10504329204559326,0.2623237073421478,950.095947265625,1e-05,0.05446546897292137,5.688742399215698,15.555094242095947,3 +3625,0.11899375915527344,0.06457390636205673,0.06412536650896072,0.2852243483066559,640.8381958007812,1e-05,0.09342461824417114,5.6936585903167725,15.555094242095947,3 +3626,0.14752863347530365,0.5510362982749939,0.580956220626831,0.2531089782714844,43.43629455566406,1e-05,0.05445526912808418,5.929330587387085,15.555094242095947,3 +3627,0.08252031356096268,0.21404369175434113,0.18342535197734833,0.2740945518016815,994.2716674804688,1e-05,0.05121149495244026,5.68830132484436,15.555094242095947,3 +3628,0.08109714090824127,0.0352182537317276,0.03843216225504875,0.14306890964508057,908.0963134765625,1e-05,0.08644596487283707,5.6856324672698975,15.555094242095947,3 +3629,0.08680947124958038,0.10054762661457062,0.09661467373371124,0.1930048018693924,785.6611938476562,1e-05,0.0494210310280323,5.691014289855957,15.555094242095947,3 +3630,0.07756297290325165,0.11150377988815308,0.10955538600683212,0.21462339162826538,948.6500244140625,1e-05,0.06312678009271622,5.687132358551025,15.555094242095947,3 +3631,0.13748709857463837,0.1118040382862091,0.10810865461826324,0.25074517726898193,677.6557006835938,1e-05,0.06025895103812218,5.683770179748535,15.555094242095947,3 +3632,0.07398336380720139,0.06805524230003357,0.0666893869638443,0.29162660241127014,930.7967529296875,1e-05,0.06050422787666321,5.686172723770142,15.555094242095947,3 +3633,0.07637237012386322,0.0518609844148159,0.05730890855193138,0.2758413255214691,288.4615478515625,1e-05,0.06136815994977951,5.680885076522827,15.555094242095947,3 +3634,0.09896303713321686,0.09509995579719543,0.09814395755529404,0.264679491519928,823.6697998046875,1e-05,0.05423317477107048,5.686330795288086,15.555094242095947,3 +3635,0.050834305584430695,0.05059797689318657,0.04925202950835228,0.13770832121372223,815.9722900390625,1e-05,0.057307057082653046,5.689602613449097,15.555094242095947,3 +3636,0.11852364987134933,0.14089469611644745,0.1342184692621231,0.24165864288806915,957.6707763671875,1e-05,0.05560687929391861,5.688292503356934,15.555094242095947,3 +3637,0.0385139025747776,0.11912962049245834,0.11634164303541183,0.21291665732860565,953.2288818359375,1e-05,0.06051856651902199,5.6900856494903564,15.555094242095947,3 +3638,0.1172834187746048,0.05754135176539421,0.05541788414120674,0.15370993316173553,894.8863525390625,1e-05,0.07936430722475052,5.6773083209991455,15.555094242095947,3 +3639,0.05993011221289635,0.06096191704273224,0.055969174951314926,0.21899838745594025,717.632080078125,1e-05,0.06109984591603279,5.888253450393677,15.555094242095947,3 +3640,0.07328911870718002,0.12463589012622833,0.11842022836208344,0.20253203809261322,912.5270385742188,1e-05,0.05367347598075867,5.691368579864502,15.555094242095947,3 +3641,0.09311683475971222,0.0960351824760437,0.09063176065683365,0.2862499952316284,744.3366088867188,1e-05,0.0781855434179306,5.697478294372559,15.555094242095947,3 +3642,0.08369283378124237,0.07378880679607391,0.06515728682279587,0.21862979233264923,937.1871948242188,1e-05,0.08357803523540497,5.691707372665405,15.555094242095947,3 +3643,0.11084137111902237,0.08449383080005646,0.07513177394866943,0.11909455060958862,924.81787109375,1e-05,0.07370568811893463,5.699077367782593,15.555094242095947,3 +3644,0.05423085764050484,0.07086756080389023,0.07584488391876221,0.1855608969926834,927.8350219726562,1e-05,0.07148131728172302,5.691697597503662,15.555094242095947,3 +3645,0.05075133591890335,0.07116041332483292,0.06788664311170578,0.20654647052288055,482.1867370605469,1e-05,0.09342202544212341,5.691140174865723,15.555094242095947,3 +3646,0.08189348876476288,0.058701664209365845,0.056253157556056976,0.20702724158763885,570.6521606445312,1e-05,0.06633869558572769,5.689261436462402,15.555094242095947,3 +3647,0.053106825798749924,0.03437316045165062,0.03726809099316597,0.17412659525871277,659.2627563476562,1e-05,0.07019543647766113,5.686221361160278,15.555094242095947,3 +3648,0.10435859858989716,0.08789760619401932,0.0844813734292984,0.21062499284744263,866.0933227539062,1e-05,0.05674322694540024,5.6881186962127686,15.555094242095947,3 +3649,0.0686774030327797,0.059367287904024124,0.05718067288398743,0.2864583134651184,878.4185791015625,1e-05,0.058712463825941086,5.698984384536743,15.555094242095947,3 +3650,0.07216931134462357,0.08997772634029388,0.08571217209100723,0.23971953988075256,891.62841796875,1e-05,0.05973963811993599,5.691964149475098,15.555094242095947,3 +3651,0.11095641553401947,0.07561459392309189,0.07122821360826492,0.2133413404226303,785.6611938476562,1e-05,0.08344808965921402,5.683611869812012,15.555094242095947,3 +3652,0.08118769526481628,0.1014019027352333,0.09866344183683395,0.2420913428068161,717.632080078125,1e-05,0.057979267090559006,5.852583169937134,15.555094242095947,3 +3653,0.0287521593272686,0.19041681289672852,0.1824129819869995,0.20096153020858765,995.10595703125,1e-05,0.05956441909074783,5.688816547393799,15.555094242095947,3 +3654,0.07333476096391678,0.04626009985804558,0.05056808516383171,0.2379567176103592,958.4887084960938,1e-05,0.07169663161039352,5.81080174446106,15.555094242095947,3 +3655,0.051526717841625214,0.08677499741315842,0.08130966871976852,0.21532851457595825,936.2449951171875,1e-05,0.06585622578859329,5.695435523986816,15.555094242095947,3 +3656,0.07716499269008636,0.10094579309225082,0.10033613443374634,0.24590544402599335,336.25732421875,1e-05,0.053464531898498535,5.695678234100342,15.555094242095947,3 +3657,0.13387413322925568,0.11467938870191574,0.1101895421743393,0.2744230628013611,860.8343505859375,1e-05,0.0750260055065155,5.691125154495239,15.555094242095947,3 +3658,0.06142028793692589,0.07688820362091064,0.07445918023586273,0.1505608856678009,943.0255737304688,1e-05,0.07161814719438553,5.69610071182251,15.555094242095947,3 +3659,0.07329913228750229,0.09810636937618256,0.10172834247350693,0.18174678087234497,953.7914428710938,1e-05,0.06078168749809265,5.6811583042144775,15.555094242095947,3 +3660,0.10977616161108017,0.10109847038984299,0.09798203408718109,0.2753044664859772,865.1477661132812,1e-05,0.07349850237369537,5.699422597885132,15.555094242095947,3 +3661,0.08045167475938797,0.07934160530567169,0.07549566775560379,0.2787259519100189,903.1631469726562,1e-05,0.06430169939994812,5.683709144592285,15.555094242095947,3 +3662,0.07294603437185287,0.0663955956697464,0.061738647520542145,0.2540544867515564,745.1535034179688,1e-05,0.058580201119184494,5.6938254833221436,15.555094242095947,3 +3663,0.1275433450937271,0.0808715969324112,0.0777047798037529,0.22428685426712036,576.5086669921875,1e-05,0.06027058884501457,5.698100328445435,15.555094242095947,3 +3664,0.09887821972370148,0.18119627237319946,0.18143418431282043,0.16510416567325592,201.34228515625,1e-05,0.07105167955160141,5.702804327011108,15.555094242095947,3 +3665,0.08727309107780457,0.15876074135303497,0.15444520115852356,0.25796473026275635,222.03948974609375,1e-05,0.06848490238189697,5.690974950790405,15.555094242095947,3 +3666,0.04045231267809868,0.052091922610998154,0.051936157047748566,0.09822916239500046,760.1881103515625,1e-05,0.049450863152742386,5.706082582473755,15.555094242095947,3 +3667,0.10113219916820526,0.08379833400249481,0.08487287908792496,0.19181890785694122,761.7188110351562,1e-05,0.06333959102630615,5.698410511016846,15.555094242095947,3 +3668,0.08824710547924042,0.013062103651463985,0.013262097723782063,0.015737179666757584,906.5933837890625,1e-05,0.04963896423578262,5.691852807998657,15.555094242095947,3 +3669,0.12225650250911713,0.07721153646707535,0.07371465116739273,0.20716345310211182,554.0089721679688,1e-05,0.06138665974140167,5.697538614273071,15.555094242095947,3 +3670,0.07828840613365173,0.06567450612783432,0.06667999923229218,0.2362099289894104,421.0875244140625,1e-05,0.04840315878391266,5.692612171173096,15.555094242095947,3 +3671,0.0610765740275383,0.15832898020744324,0.15462541580200195,0.2843269109725952,977.3124389648438,1e-05,0.05926034227013588,5.694216012954712,15.555094242095947,3 +3672,0.06809812039136887,0.11207683384418488,0.1126578077673912,0.25265222787857056,979.9048461914062,1e-05,0.06155460700392723,5.705579519271851,15.555094242095947,3 +3673,0.07914428412914276,0.06729669123888016,0.06973473727703094,0.24955928325653076,818.9655151367188,1e-05,0.05725020542740822,5.709654331207275,15.555094242095947,3 +3674,0.07399618625640869,0.08729595690965652,0.08676004409790039,0.21250800788402557,842.5684204101562,1e-05,0.06046636775135994,5.703029632568359,15.555094242095947,3 +3675,0.07000908255577087,0.030209003016352654,0.02914310432970524,0.2168349325656891,842.5684204101562,1e-05,0.05760924890637398,5.824286460876465,15.555094242095947,3 +3676,0.07806684821844101,0.05749610811471939,0.06072692573070526,0.24762819707393646,894.4823608398438,1e-05,0.06690998375415802,5.689139127731323,15.555094242095947,3 +3677,0.1219753548502922,0.08239566534757614,0.08405759185552597,0.2524999976158142,660.3773803710938,1e-05,0.055631812661886215,5.686709880828857,15.555094242095947,3 +3678,0.12303920835256577,0.05148088559508324,0.050168488174676895,0.22747595608234406,921.7437133789062,1e-05,0.05929308012127876,5.691398620605469,15.555094242095947,3 +3679,0.11172869056463242,0.05047939345240593,0.04668182507157326,0.26037660241127014,531.6091918945312,1e-05,0.05319484323263168,6.0890212059021,15.555094242095947,3 +3680,0.06480958312749863,0.09845578670501709,0.09398090094327927,0.25836536288261414,960.9158325195312,1e-05,0.0651087686419487,5.706863164901733,15.555094242095947,3 +3681,0.07037383317947388,0.045735009014606476,0.04774308577179909,0.18395031988620758,788.4046630859375,1e-05,0.05257614329457283,5.697768926620483,15.555094242095947,3 +3682,0.05985965207219124,0.09519824385643005,0.0824555978178978,0.26047274470329285,911.7965698242188,1e-05,0.054642025381326675,5.6854188442230225,15.555094242095947,3 +3683,0.06414677947759628,0.06510498374700546,0.062394216656684875,0.2562499940395355,934.9798583984375,1e-05,0.05734815075993538,5.694378137588501,15.555094242095947,3 +3684,0.09293113648891449,0.06709640473127365,0.0634351447224617,0.2654487192630768,885.7808837890625,1e-05,0.06952786445617676,5.694471120834351,15.555094242095947,3 +3685,0.055210188031196594,0.31736665964126587,0.28667280077934265,0.28979164361953735,998.3897094726562,1e-05,0.06357301026582718,5.688131332397461,15.555094242095947,3 +3686,0.080327108502388,0.07262901961803436,0.07706113904714584,0.27819710969924927,964.0897216796875,1e-05,0.047916658222675323,5.682873010635376,15.555094242095947,3 +3687,0.10111922770738602,0.07155002653598785,0.0697588250041008,0.26808491349220276,669.14501953125,1e-05,0.055775560438632965,5.68468165397644,15.555094242095947,3 +3688,0.10750432312488556,0.07651922106742859,0.06974230706691742,0.30320510268211365,750.7987060546875,1e-05,0.07008308172225952,5.686181306838989,15.555094242095947,3 +3689,0.15704260766506195,0.11365868151187897,0.10953306406736374,0.26509615778923035,688.9586791992188,1e-05,0.06758876144886017,5.681353569030762,15.555094242095947,3 +3690,0.08339865505695343,0.07639892399311066,0.07198647409677505,0.2542628049850464,603.0020751953125,1e-05,0.056150518357753754,5.7993433475494385,15.555094242095947,3 +3691,0.0782298594713211,0.10435067117214203,0.09939485043287277,0.24270030856132507,456.8528137207031,1e-05,0.05628563091158867,5.697325229644775,15.555094242095947,3 +3692,0.08268223702907562,0.04707162454724312,0.05006507784128189,0.2423797994852066,587.923828125,1e-05,0.05021948739886284,5.683030605316162,15.555094242095947,3 +3693,0.05884332209825516,0.048460911959409714,0.04562985152006149,0.06880608946084976,580.8350830078125,1e-05,0.05262073501944542,5.6833038330078125,15.555094242095947,3 +3694,0.05782429873943329,0.11505637317895889,0.11911378055810928,0.19651441276073456,871.670654296875,1e-05,0.06823360919952393,5.690835237503052,15.555094242095947,3 +3695,0.10581620037555695,0.06457747519016266,0.05920209735631943,0.22451922297477722,882.784912109375,1e-05,0.05755261704325676,5.688127040863037,15.555094242095947,3 +3696,0.05982257425785065,0.10565613955259323,0.09785841405391693,0.22842948138713837,970.9821166992188,1e-05,0.05121839791536331,6.01526141166687,15.555094242095947,3 +3697,0.11981059610843658,0.05241909623146057,0.052618492394685745,0.27244389057159424,722.12841796875,1e-05,0.05335978791117668,5.682905197143555,15.555094242095947,3 +3698,0.09268245846033096,0.04442894831299782,0.041469600051641464,0.2934935688972473,677.6557006835938,1e-05,0.06070299446582794,5.683182954788208,15.555094242095947,3 +3699,0.1047232449054718,0.20077134668827057,0.19092050194740295,0.18405447900295258,984.94482421875,1e-05,0.07437767088413239,5.6798059940338135,15.555094242095947,3 +3700,0.07084725797176361,0.07420646399259567,0.07309601455926895,0.22956730425357819,531.6091918945312,1e-05,0.06932694464921951,5.688657760620117,15.555094242095947,3 +3701,0.12690167129039764,0.058406442403793335,0.05722413584589958,0.06693108379840851,857.4120483398438,1e-05,0.06993049383163452,5.684657335281372,15.555094242095947,3 +3702,0.08968198299407959,0.09442176669836044,0.08529582619667053,0.24349358677864075,674.4935913085938,1e-05,0.052551839500665665,5.678828239440918,15.555094242095947,3 +3703,0.11335504800081253,0.06027758866548538,0.0589214526116848,0.25004005432128906,788.4046630859375,1e-05,0.056965652853250504,5.686490774154663,15.555094242095947,3 +3704,0.07089979946613312,0.7228220105171204,0.7359791994094849,0.10655448585748672,19.685039520263672,1e-05,0.05926326662302017,5.68541955947876,15.555094242095947,3 +3705,0.05122669041156769,0.08479263633489609,0.08526197075843811,0.2313781976699829,936.8737182617188,1e-05,0.05829952284693718,5.6889564990997314,15.555094242095947,3 +3706,0.09902103990316391,0.10462453216314316,0.1002122089266777,0.14271634817123413,961.4497680664062,1e-05,0.05453731119632721,5.688250303268433,15.555094242095947,3 +3707,0.09076668322086334,0.09352037310600281,0.09629479050636292,0.18166665732860565,403.11651611328125,1e-05,0.0667336955666542,5.680220603942871,15.555094242095947,3 +3708,0.0509747713804245,0.05211930349469185,0.05328831449151039,0.19490383565425873,505.9523620605469,1e-05,0.05919403210282326,5.68735671043396,15.555094242095947,3 +3709,0.11182849109172821,0.6707162857055664,0.6673765778541565,0.18433493375778198,48.076927185058594,1e-05,0.06854064762592316,5.685035943984985,15.555094242095947,3 +3710,0.08999490737915039,0.10096604377031326,0.09503790736198425,0.19180287420749664,934.6619262695312,1e-05,0.06681639701128006,5.680236577987671,15.555094242095947,3 +3711,0.06668426096439362,0.07789233326911926,0.07036355137825012,0.2555769085884094,797.7569580078125,1e-05,0.05245816335082054,5.675231456756592,15.555094242095947,3 +3712,0.06845303624868393,0.08552109450101852,0.08280772715806961,0.17599357664585114,851.9107666015625,1e-05,0.0749649778008461,5.6911609172821045,15.555094242095947,3 +3713,0.07338897138834,0.1520327478647232,0.1415417641401291,0.24987979233264923,984.2687377929688,1e-05,0.06884387135505676,5.68886661529541,15.555094242095947,3 +3714,0.09969854354858398,0.07628130167722702,0.07588779926300049,0.255120187997818,910.6948852539062,1e-05,0.06888791173696518,5.893974542617798,15.555094242095947,3 +3715,0.09913384914398193,0.580976665019989,0.5966470837593079,0.1956089735031128,34.046695709228516,1e-05,0.04777251556515694,5.694463014602661,15.555094242095947,3 +3716,0.14841844141483307,0.1265168935060501,0.12047474831342697,0.22989583015441895,939.6723022460938,1e-05,0.061269938945770264,5.692824363708496,15.555094242095947,3 +3717,0.0781598836183548,0.11722792685031891,0.11246950924396515,0.2123958319425583,967.4503784179688,1e-05,0.0556982085108757,5.696270227432251,15.555094242095947,3 +3718,0.08249955624341965,0.12026789039373398,0.11423611640930176,0.23970352113246918,961.9814453125,1e-05,0.0564505010843277,5.684069395065308,15.555094242095947,3 +3719,0.0635109543800354,0.08592613786458969,0.0767182931303978,0.23040063679218292,932.0956420898438,1e-05,0.0751645639538765,5.689080238342285,15.555094242095947,3 +3720,0.058815911412239075,0.09359452873468399,0.09293460100889206,0.22956730425357819,592.105224609375,1e-05,0.04991265386343002,5.693380355834961,15.555094242095947,3 +3721,0.09526383876800537,0.08824162930250168,0.08891157805919647,0.22786858677864075,933.0629272460938,1e-05,0.06055464223027229,5.693117618560791,15.555094242095947,3 +3722,0.09573522210121155,0.0766642689704895,0.07576581090688705,0.23184293508529663,938.1237182617188,1e-05,0.05193198472261429,5.692467927932739,15.555094242095947,3 +3723,0.11052112281322479,0.27546659111976624,0.2863157093524933,0.15116184949874878,117.75362396240234,1e-05,0.05724120885133743,5.684497833251953,15.555094242095947,3 +3724,0.09964358806610107,0.20050379633903503,0.19532491266727448,0.23203524947166443,986.064208984375,1e-05,0.05193241685628891,5.689916610717773,15.555094242095947,3 +3725,0.07198028266429901,0.046041425317525864,0.04734872654080391,0.1889583319425583,874.3990478515625,1e-05,0.0522250235080719,5.686345815658569,15.555094242095947,3 +3726,0.04320742189884186,0.0709867924451828,0.06914649158716202,0.25341343879699707,865.6211547851562,1e-05,0.05937788262963295,5.693224668502808,15.555094242095947,3 +3727,0.061434030532836914,0.13799409568309784,0.13627029955387115,0.25092145800590515,966.9384155273438,1e-05,0.05188610404729843,5.69427752494812,15.555094242095947,3 +3728,0.07883169502019882,0.06811821460723877,0.0642111524939537,0.22032852470874786,892.0389404296875,1e-05,0.06862714886665344,5.684776544570923,15.555094242095947,3 +3729,0.08002212643623352,0.10686243325471878,0.11064169555902481,0.3000320494174957,218.64686584472656,1e-05,0.05061853304505348,5.689281225204468,15.555094242095947,3 +3730,0.06053191423416138,0.04710085690021515,0.05035391449928284,0.2130528837442398,804.8433837890625,1e-05,0.05579090490937233,5.688334226608276,15.555094242095947,3 +3731,0.10574071109294891,0.052172522991895676,0.051424045115709305,0.2605208158493042,470.6982727050781,1e-05,0.05538162961602211,5.683023452758789,15.555094242095947,3 +3732,0.09728345274925232,0.0783131942152977,0.07810631394386292,0.0907692238688469,560.154541015625,1e-05,0.060219574719667435,5.688498020172119,15.555094242095947,3 +3733,0.0913664773106575,0.049212969839572906,0.052884988486766815,0.23962338268756866,796.4441528320312,1e-05,0.052490025758743286,5.695473670959473,15.555094242095947,3 +3734,0.07064587622880936,0.05665639415383339,0.054143138229846954,0.23469550907611847,732.615966796875,1e-05,0.05658720061182976,5.700194358825684,15.555094242095947,3 +3735,0.11534435302019119,0.11069554090499878,0.10399042069911957,0.261658638715744,470.6982727050781,1e-05,0.06799940019845963,5.69681453704834,15.555094242095947,3 +3736,0.039188895374536514,0.044498104602098465,0.04354891926050186,0.05158653482794762,922.7748413085938,1e-05,0.05787207558751106,5.940430641174316,15.555094242095947,3 +3737,0.0916982963681221,0.05055692046880722,0.0514712929725647,0.14822115004062653,735.1730346679688,1e-05,0.07046107202768326,5.6951916217803955,15.555094242095947,3 +3738,0.08078309893608093,0.08427249640226364,0.08271296322345734,0.2500240206718445,603.0020751953125,1e-05,0.05790209397673607,5.690717697143555,15.555094242095947,3 +3739,0.10601001977920532,0.10353062301874161,0.10145601630210876,0.19831730425357819,913.978515625,1e-05,0.06675703823566437,5.688954830169678,15.555094242095947,3 +3740,0.09410760551691055,0.04919397085905075,0.051573220640420914,0.2154807597398758,960.6482543945312,1e-05,0.0638590157032013,5.697928190231323,15.555094242095947,3 +3741,0.09646256268024445,0.07960250228643417,0.06926235556602478,0.2555208206176758,904.6961059570312,1e-05,0.07379627972841263,5.691688776016235,15.555094242095947,3 +3742,0.07258213311433792,0.05079944059252739,0.05262098088860512,0.22844550013542175,839.89501953125,1e-05,0.0624428391456604,5.697041034698486,15.555094242095947,3 +3743,0.07912735641002655,0.17466594278812408,0.1756090521812439,0.14240384101867676,201.34228515625,1e-05,0.059079740196466446,5.688827753067017,15.555094242095947,3 +3744,0.10054001957178116,0.051629457622766495,0.04807808995246887,0.2583733797073364,793.128662109375,1e-05,0.06847897171974182,5.687583923339844,15.555094242095947,3 +3745,0.15895141661167145,0.11348601430654526,0.11521728336811066,0.21475160121917725,905.8369750976562,1e-05,0.05897810682654381,5.690178871154785,15.555094242095947,3 +3746,0.08831483125686646,0.08500005304813385,0.08865963667631149,0.1824038326740265,516.4320068359375,1e-05,0.05508474260568619,5.6877360343933105,15.555094242095947,3 +3747,0.17767968773841858,0.104749895632267,0.09932826459407806,0.20064102113246918,567.685546875,1e-05,0.05813498795032501,5.693578243255615,15.555094242095947,3 +3748,0.0916329175233841,0.09128787368535995,0.0907335951924324,0.2194230705499649,827.1312866210938,1e-05,0.06562956422567368,5.792970657348633,15.555094242095947,3 +3749,0.10087788105010986,0.0673665851354599,0.06271395087242126,0.1293429434299469,697.8798828125,1e-05,0.06828154623508453,5.692573547363281,15.555094242095947,3 +3750,0.09316384792327881,0.12216663360595703,0.11371849477291107,0.2695592939853668,783.5821533203125,1e-05,0.06417062133550644,5.693723440170288,15.555094242095947,3 +3751,0.09348855167627335,0.06353747099637985,0.0661311075091362,0.2520352602005005,903.5476684570312,1e-05,0.07236377149820328,5.693310499191284,15.555094242095947,3 +3752,0.10483632236719131,0.06611855328083038,0.061416856944561005,0.27233973145484924,555.5556030273438,1e-05,0.06728401780128479,5.696590185165405,15.555094242095947,3 +3753,0.054651301354169846,0.09741245955228806,0.08848773688077927,0.265937477350235,921.3984985351562,1e-05,0.057197585701942444,5.687873363494873,15.555094242095947,3 +3754,0.10857674479484558,0.054445866495370865,0.05702439323067665,0.2438381314277649,579.399169921875,1e-05,0.06502926349639893,5.713436603546143,15.555094242095947,3 +3755,0.07859041541814804,0.21790212392807007,0.208989217877388,0.20577724277973175,129.92831420898438,1e-05,0.06708458065986633,5.6915106773376465,15.555094242095947,3 +3756,0.10174296051263809,0.37291818857192993,0.3917429447174072,0.2936217784881592,57.25191116333008,1e-05,0.055307596921920776,5.889345407485962,15.555094242095947,3 +3757,0.07770823687314987,0.09840807318687439,0.09388720989227295,0.24724358320236206,541.3831787109375,1e-05,0.05855988338589668,5.934509754180908,15.555094242095947,3 +3758,0.10639363527297974,0.3178194761276245,0.31955578923225403,0.23184293508529663,149.64788818359375,1e-05,0.07090932130813599,5.686656475067139,15.555094242095947,3 +3759,0.09224550426006317,0.08817416429519653,0.08683931827545166,0.14287659525871277,952.09716796875,1e-05,0.05172676965594292,5.684764623641968,15.555094242095947,3 +3760,0.07791949063539505,0.19852615892887115,0.21679896116256714,0.22765223681926727,161.1498260498047,1e-05,0.05439739301800728,5.683677911758423,15.555094242095947,3 +3761,0.10856320708990097,0.1344047337770462,0.12022678554058075,0.24419069290161133,948.067626953125,1e-05,0.06991079449653625,5.670056104660034,15.555094242095947,3 +3762,0.06266605854034424,0.08513996005058289,0.08278561383485794,0.23616184294223785,839.3560791015625,1e-05,0.04492123797535896,5.683190822601318,15.555094242095947,3 +3763,0.09604141861200333,0.06876663863658905,0.06372692435979843,0.2049519121646881,851.403076171875,1e-05,0.05609888210892677,5.6806862354278564,15.555094242095947,3 +3764,0.07465942949056625,0.08003460615873337,0.0735720843076706,0.2516426146030426,905.0772094726562,1e-05,0.06264191120862961,5.689011096954346,15.555094242095947,3 +3765,0.09235665202140808,0.01569933444261551,0.0183608029037714,0.17326121032238007,739.3790893554688,1e-05,0.061611853539943695,5.683338403701782,15.555094242095947,3 +3766,0.06817381083965302,0.07761920988559723,0.07587433606386185,0.2288942188024521,889.1455078125,1e-05,0.0664946436882019,5.6814985275268555,15.555094242095947,3 +3767,0.1084364503622055,0.07612130045890808,0.07006541639566422,0.18417467176914215,679.7445678710938,1e-05,0.07294479757547379,5.683674097061157,15.555094242095947,3 +3768,0.07873706519603729,0.06007986515760422,0.05720505118370056,0.25322115421295166,811.7109985351562,1e-05,0.05971662700176239,5.691626787185669,15.555094242095947,3 +3769,0.09533409774303436,0.13510966300964355,0.12563353776931763,0.2581009566783905,969.7308959960938,1e-05,0.0629189983010292,5.697714567184448,15.555094242095947,3 +3770,0.11402234435081482,0.1268986165523529,0.12561637163162231,0.1776762753725052,930.143310546875,1e-05,0.0598553791642189,5.693968296051025,15.555094242095947,3 +3771,0.07826356589794159,0.12614381313323975,0.12247207760810852,0.19605769217014313,980.37109375,1e-05,0.05929771810770035,5.700007200241089,15.555094242095947,3 +3772,0.12137576192617416,0.10757355391979218,0.099230095744133,0.17635415494441986,859.375,1e-05,0.07256628572940826,5.91978120803833,15.555094242095947,3 +3773,0.08888871222734451,0.09197442978620529,0.08894187211990356,0.1938701868057251,894.8863525390625,1e-05,0.07352329045534134,5.697580814361572,15.555094242095947,3 +3774,0.10192786157131195,0.13924354314804077,0.13221238553524017,0.2324438989162445,947.775634765625,1e-05,0.08033701032400131,5.705559253692627,15.555094242095947,3 +3775,0.15645210444927216,0.15860216319561005,0.14906273782253265,0.2515464723110199,977.5501098632812,1e-05,0.06956837326288223,6.087380886077881,15.555094242095947,3 +3776,0.10020967572927475,0.07961814105510712,0.07876511663198471,0.2418990284204483,538.1549072265625,1e-05,0.06720071285963058,5.8958587646484375,15.555094242095947,3 +3777,0.130445197224617,0.20413677394390106,0.2108326256275177,0.2347596138715744,228.7581787109375,1e-05,0.08613904565572739,5.689269304275513,15.555094242095947,3 +3778,0.06374003738164902,0.06903225928544998,0.06815174221992493,0.16891025006771088,873.4939575195312,1e-05,0.061863046139478683,6.077287912368774,15.555094242095947,3 +3779,0.097246915102005,0.07919566333293915,0.07621011883020401,0.23423877358436584,810.4782104492188,1e-05,0.06957027316093445,5.690476417541504,15.555094242095947,3 +3780,0.05771716684103012,0.051741376519203186,0.05476316437125206,0.1907772421836853,801.64990234375,1e-05,0.06307052820920944,5.697136640548706,15.555094242095947,3 +3781,0.11026713252067566,0.11974001675844193,0.11855757236480713,0.11157852411270142,333.5777282714844,1e-05,0.08249160647392273,5.688831567764282,15.555094242095947,3 +3782,0.09055210649967194,0.08505003899335861,0.0837850496172905,0.1882692277431488,541.3831787109375,1e-05,0.0635194331407547,5.679086208343506,15.555094242095947,3 +3783,0.09206725656986237,0.06762600690126419,0.06341346353292465,0.2774839699268341,861.318359375,1e-05,0.07704512774944305,5.682758331298828,15.555094242095947,3 +3784,0.10043146461248398,0.09186004102230072,0.09893668442964554,0.1563381403684616,183.4470977783203,1e-05,0.06420205533504486,5.689347982406616,15.555094242095947,3 +3785,0.08666734397411346,0.19954268634319305,0.1966620236635208,0.24762018024921417,971.4794311523438,1e-05,0.06646561622619629,5.68313193321228,15.555094242095947,3 +3786,0.11994948238134384,0.07900983095169067,0.07612697780132294,0.10830127447843552,747.5884399414062,1e-05,0.0786350816488266,5.791027307510376,15.555094242095947,3 +3787,0.03895144537091255,0.1253315657377243,0.11985248327255249,0.17943909764289856,902.7777709960938,1e-05,0.05808674916625023,5.687225341796875,15.555094242095947,3 +3788,0.07510687410831451,0.12038532644510269,0.11707694828510284,0.2074679434299469,927.8350219726562,1e-05,0.0773358941078186,5.679856061935425,15.555094242095947,3 +3789,0.14199011027812958,0.08435792475938797,0.07667697966098785,0.21211537718772888,941.5103759765625,1e-05,0.07373915612697601,5.682020664215088,15.555094242095947,3 +3790,0.09819509088993073,0.07876302301883698,0.08328931033611298,0.17311698198318481,338.9212646484375,1e-05,0.05799790471792221,5.904701471328735,15.555094242095947,3 +3791,0.09568419307470322,0.11536095291376114,0.10737961530685425,0.2843669652938843,883.2159423828125,1e-05,0.05875145643949509,5.687670707702637,15.555094242095947,3 +3792,0.10811009258031845,0.11369644105434418,0.10946398228406906,0.18628203868865967,989.5833129882812,1e-05,0.05467398464679718,5.735921621322632,15.555094242095947,3 +3793,0.0904962420463562,0.04686075076460838,0.0504942387342453,0.21899838745594025,949.8078002929688,1e-05,0.06193339079618454,5.6908862590789795,15.555094242095947,3 +3794,0.11336378008127213,0.11999361962080002,0.1162402406334877,0.29604166746139526,654.7619018554688,1e-05,0.05993659421801567,5.680219411849976,15.555094242095947,3 +3795,0.08039561659097672,0.08443871885538101,0.07594684511423111,0.2301442176103592,884.5029296875,1e-05,0.0515265166759491,5.687930107116699,15.555094242095947,3 +3796,0.061457857489585876,0.04161633923649788,0.04144106060266495,0.2565464675426483,935.2970581054688,1e-05,0.049508415162563324,5.687768936157227,15.555094242095947,3 +3797,0.04994238168001175,0.058272793889045715,0.0561298131942749,0.2518349289894104,829.9730834960938,1e-05,0.061487630009651184,5.698247671127319,15.555094242095947,3 +3798,0.07474944740533829,0.15522564947605133,0.1551508605480194,0.2646554410457611,384.3490905761719,1e-05,0.052898455411195755,5.693499326705933,15.555094242095947,3 +3799,0.06345520913600922,0.06745374202728271,0.0655384510755539,0.2698477506637573,771.4395751953125,1e-05,0.05961071327328682,5.69154691696167,15.555094242095947,3 +3800,0.03170575946569443,0.3583708703517914,0.30353596806526184,0.27657851576805115,996.1414184570312,1e-05,0.05308541655540466,5.680741310119629,15.555094242095947,3 +3801,0.06527546048164368,0.04221254587173462,0.04249061644077301,0.13682691752910614,896.0928344726562,1e-05,0.06545322388410568,5.716428995132446,15.555094242095947,3 +3802,0.07730766385793686,0.042267270386219025,0.03736933693289757,0.22451922297477722,883.6459350585938,1e-05,0.06107458472251892,5.714358806610107,15.555094242095947,3 +3803,0.09998835623264313,0.06082979962229729,0.0630301758646965,0.2500160038471222,609.6311645507812,1e-05,0.06855086237192154,5.695576906204224,15.555094242095947,3 +3804,0.06517504900693893,0.11730185896158218,0.10552047193050385,0.29172274470329285,930.143310546875,1e-05,0.07068925350904465,5.6929075717926025,15.555094242095947,3 +3805,0.06535468995571136,0.05106493458151817,0.05066545307636261,0.1555849313735962,753.1796264648438,1e-05,0.04646402969956398,5.68513298034668,15.555094242095947,3 +3806,0.07158900797367096,0.055041588842868805,0.05675981193780899,0.09434294700622559,818.9655151367188,1e-05,0.06313186883926392,5.698505640029907,15.555094242095947,3 +3807,0.09071145951747894,0.07923228293657303,0.07738913595676422,0.21134614944458008,758.6478271484375,1e-05,0.06354586035013199,5.695698499679565,15.555094242095947,3 +3808,0.10536322742700577,0.07750871777534485,0.07787323743104935,0.21246793866157532,952.3810424804688,1e-05,0.05941272899508476,5.700182676315308,15.555094242095947,3 +3809,0.11943382024765015,0.11989922821521759,0.11231864243745804,0.22825320065021515,939.6723022460938,1e-05,0.07397464662790298,5.8121678829193115,15.555094242095947,3 +3810,0.08414460718631744,0.04509548470377922,0.044117752462625504,0.1575961410999298,876.6427001953125,1e-05,0.06150608882308006,5.718173980712891,15.555094242095947,3 +3811,0.09893213212490082,0.07268978655338287,0.0659705176949501,0.2282131314277649,546.1712036132812,1e-05,0.06736849993467331,5.695852041244507,15.555094242095947,3 +3812,0.10766313225030899,0.10809051245450974,0.11082247644662857,0.1303125023841858,228.7581787109375,1e-05,0.06338105350732803,5.693532466888428,15.555094242095947,3 +3813,0.12345625460147858,0.1193912997841835,0.11783983558416367,0.1969551146030426,257.9365234375,1e-05,0.0659426599740982,5.7030322551727295,15.555094242095947,3 +3814,0.051927968859672546,0.0888419821858406,0.08085790276527405,0.2473878115415573,873.4939575195312,1e-05,0.057524845004081726,5.70551872253418,15.555094242095947,3 +3815,0.10355512797832489,0.08642156422138214,0.07758552581071854,0.24776440858840942,789.0855712890625,1e-05,0.05945441499352455,5.706212759017944,15.555094242095947,3 +3816,0.06586641073226929,0.06025323271751404,0.05390855297446251,0.19373396039009094,870.2915649414062,1e-05,0.06369545310735703,5.691418886184692,15.555094242095947,3 +3817,0.07951157540082932,0.09650062024593353,0.09674669802188873,0.15406249463558197,668.0632934570312,1e-05,0.06757167726755142,5.700183391571045,15.555094242095947,3 +3818,0.13551297783851624,0.06274809688329697,0.06342940777540207,0.23084935545921326,741.8699340820312,1e-05,0.062150873243808746,5.678112268447876,15.555094242095947,3 +3819,0.07068302482366562,0.10336750745773315,0.0933956503868103,0.253846138715744,993.4319458007812,1e-05,0.05251837894320488,5.692148447036743,15.555094242095947,3 +3820,0.06581894308328629,0.12292654067277908,0.12390843033790588,0.2108333259820938,948.067626953125,1e-05,0.05871673300862312,5.690002679824829,15.555094242095947,3 +3821,0.07247494161128998,0.0683790072798729,0.06908731907606125,0.1681169867515564,472.6368408203125,1e-05,0.0586409866809845,5.971317768096924,15.555094242095947,3 +3822,0.062371667474508286,0.11196702718734741,0.10766485333442688,0.13430288434028625,953.5103759765625,1e-05,0.07205439358949661,5.6929237842559814,15.555094242095947,3 +3823,0.05622437968850136,0.08037550747394562,0.07859243452548981,0.22665062546730042,986.064208984375,1e-05,0.05564345791935921,5.697558641433716,15.555094242095947,3 +3824,0.04673197120428085,0.7999585270881653,0.8046568036079407,0.1870192289352417,19.685039520263672,1e-05,0.07140221446752548,5.68906569480896,15.555094242095947,3 +3825,0.0891847237944603,0.0710706040263176,0.06570995599031448,0.23424679040908813,787.721923828125,1e-05,0.06217509135603905,5.693596363067627,15.555094242095947,3 +3826,0.08671975135803223,0.11822724342346191,0.11079428344964981,0.2805769145488739,750.0000610351562,1e-05,0.057283952832221985,5.691742897033691,15.555094242095947,3 +3827,0.0790707916021347,0.143175408244133,0.13093364238739014,0.2373717874288559,986.064208984375,1e-05,0.06515403091907501,5.692601203918457,15.555094242095947,3 +3828,0.05319271981716156,0.14153039455413818,0.12479253858327866,0.20705929398536682,963.0394287109375,1e-05,0.05251253768801689,5.721065282821655,15.555094242095947,3 +3829,0.0666198879480362,0.08301086723804474,0.08290582150220871,0.22862979769706726,868.4371337890625,1e-05,0.06279002130031586,5.699057579040527,15.555094242095947,3 +3830,0.13010837137699127,0.07140594720840454,0.0697161853313446,0.20540864765644073,853.4264526367188,1e-05,0.06087512895464897,5.693429231643677,15.555094242095947,3 +3831,0.08260969817638397,0.07196038961410522,0.06551742553710938,0.20141024887561798,760.95458984375,1e-05,0.056597236543893814,5.692933559417725,15.555094242095947,3 +3832,0.08034452050924301,0.05810817703604698,0.055877573788166046,0.22780448198318481,909.5860595703125,1e-05,0.061405714601278305,5.675284147262573,15.555094242095947,3 +3833,0.09347597509622574,0.08730752766132355,0.08462119102478027,0.25525641441345215,374.6498718261719,1e-05,0.05802882835268974,5.675099849700928,15.555094242095947,3 +3834,0.10535052418708801,0.07176632434129715,0.07315666973590851,0.21911858022212982,681.8181762695312,1e-05,0.05801885947585106,5.689595699310303,15.555094242095947,3 +3835,0.06908459216356277,0.046780310571193695,0.05211350694298744,0.1334935873746872,359.68658447265625,1e-05,0.06290401518344879,5.684414386749268,15.555094242095947,3 +3836,0.11226748675107956,0.05989663675427437,0.05785498395562172,0.25893428921699524,639.6484985351562,1e-05,0.057901255786418915,5.681344032287598,15.555094242095947,3 +3837,0.04962178319692612,0.05452540144324303,0.0541498139500618,0.11229967325925827,730.0333251953125,1e-05,0.07047054916620255,5.682008266448975,15.555094242095947,3 +3838,0.06043088063597679,0.1056925356388092,0.09287677705287933,0.2480849325656891,935.2970581054688,1e-05,0.065714530646801,5.685815095901489,15.555094242095947,3 +3839,0.06752194464206696,0.05670012906193733,0.05450068786740303,0.2248397320508957,885.3558349609375,1e-05,0.06910910457372665,5.670442581176758,15.555094242095947,3 +3840,0.09850902855396271,0.062030334025621414,0.059958361089229584,0.25892627239227295,867.5030517578125,1e-05,0.061752405017614365,5.693083763122559,15.555094242095947,3 +3841,0.08569911867380142,0.09510822594165802,0.08812828361988068,0.24535255134105682,858.3959350585938,1e-05,0.08294708281755447,5.690523147583008,15.555094242095947,3 +3842,0.07337504625320435,0.09116554260253906,0.08394569903612137,0.21032050251960754,961.1829223632812,1e-05,0.069142647087574,5.673431158065796,15.555094242095947,3 +3843,0.08183817565441132,0.07733876258134842,0.07296264171600342,0.29778844118118286,970.7328491210938,1e-05,0.058211490511894226,5.685652732849121,15.555094242095947,3 +3844,0.1669011116027832,0.24865052103996277,0.2466374635696411,0.23683492839336395,208.3333282470703,1e-05,0.09773426502943039,5.92742395401001,15.555094242095947,3 +3845,0.09075254946947098,0.1529233306646347,0.16215482354164124,0.195416659116745,987.174072265625,1e-05,0.057308096438646317,5.684266567230225,15.555094242095947,3 +3846,0.06830817461013794,0.14740866422653198,0.1412305235862732,0.2762660086154938,936.8737182617188,1e-05,0.0621488131582737,5.685760021209717,15.555094242095947,3 +3847,0.13540653884410858,0.07811743021011353,0.07261601090431213,0.17595352232456207,823.6697998046875,1e-05,0.09130579978227615,5.683290243148804,15.555094242095947,3 +3848,0.09956693649291992,0.9808447957038879,0.9820494651794434,0.178341343998909,9.920635223388672,1e-05,0.0623110793530941,5.685170412063599,15.555094242095947,3 +3849,0.05663372948765755,0.07210755348205566,0.06547417491674423,0.21611377596855164,904.3141479492188,1e-05,0.08946112543344498,5.682868480682373,15.555094242095947,3 +3850,0.1383104920387268,0.12680326402187347,0.1194109097123146,0.25419870018959045,391.4835205078125,1e-05,0.07924369722604752,5.688292980194092,15.555094242095947,3 +3851,0.0778026357293129,0.08373700827360153,0.08115141838788986,0.17218749225139618,552.4553833007812,1e-05,0.05878075212240219,5.680563688278198,15.555094242095947,3 +3852,0.06278106570243835,0.0719929113984108,0.07071270048618317,0.1899999976158142,795.1236572265625,1e-05,0.07734227180480957,5.6846702098846436,15.555094242095947,3 +3853,0.14266927540302277,0.05588138848543167,0.05465150251984596,0.20280447602272034,594.86376953125,1e-05,0.081146739423275,5.681436538696289,15.555094242095947,3 +3854,0.06061641126871109,0.08806095272302628,0.0883362889289856,0.144294872879982,821.3306274414062,1e-05,0.08641497045755386,5.68597936630249,15.555094242095947,3 +3855,0.09716026484966278,0.08260101079940796,0.08100569993257523,0.2534855604171753,881.919921875,1e-05,0.08127431571483612,5.686329364776611,15.555094242095947,3 +3856,0.0935773029923439,0.06570225208997726,0.06639130413532257,0.223469540476799,673.4317626953125,1e-05,0.06745433062314987,5.684805154800415,15.555094242095947,3 +3857,0.12171681225299835,0.15915851294994354,0.1564035266637802,0.24148236215114594,985.1694946289062,1e-05,0.06615916639566422,5.6868577003479,15.555094242095947,3 +3858,0.1085050106048584,0.12777289748191833,0.12358905375003815,0.3065224289894104,885.7808837890625,1e-05,0.06251103430986404,5.683843374252319,15.555094242095947,3 +3859,0.07769764959812164,0.09159497916698456,0.08762113004922867,0.26991987228393555,538.1549072265625,1e-05,0.06697510182857513,5.676636695861816,15.555094242095947,3 +3860,0.09372921288013458,0.10461485385894775,0.09764841943979263,0.15920671820640564,981.5291137695312,1e-05,0.08815968781709671,5.683522701263428,15.555094242095947,3 +3861,0.0920887365937233,0.07092130184173584,0.06844394654035568,0.20549678802490234,788.4046630859375,1e-05,0.07032421231269836,5.689088344573975,15.555094242095947,3 +3862,0.12179665267467499,0.058012284338474274,0.053403887897729874,0.08239582926034927,869.3666381835938,1e-05,0.06373421847820282,5.6780877113342285,15.555094242095947,3 +3863,0.09992358833551407,0.09223424643278122,0.08954738080501556,0.23691505193710327,905.4575805664062,1e-05,0.10579090565443039,5.687276363372803,15.555094242095947,3 +3864,0.06761416792869568,0.08810719102621078,0.09793273359537125,0.23000800609588623,978.0244140625,1e-05,0.055790066719055176,5.702433109283447,15.555094242095947,3 +3865,0.0723569318652153,0.07169955223798752,0.07022169232368469,0.2383253127336502,768.4899291992188,1e-05,0.07101324945688248,5.692620038986206,15.555094242095947,3 +3866,0.1064189225435257,0.07250392436981201,0.06759680062532425,0.2444951832294464,820.7417602539062,1e-05,0.08038347959518433,5.929412603378296,15.555094242095947,3 +3867,0.11488135159015656,0.10954994708299637,0.10302315652370453,0.2273317277431488,768.4899291992188,1e-05,0.07423358410596848,5.69936203956604,15.555094242095947,3 +3868,0.08077481389045715,0.07497500628232956,0.07594555616378784,0.1647355705499649,977.07421875,1e-05,0.0760691687464714,5.69679856300354,15.555094242095947,3 +3869,0.07128395140171051,0.07793447375297546,0.07373974472284317,0.11232371628284454,867.0343017578125,1e-05,0.09161815792322159,5.690468072891235,15.555094242095947,3 +3870,0.08777976036071777,0.09394939243793488,0.08866909891366959,0.2104647308588028,730.8970947265625,1e-05,0.07611822336912155,5.68877100944519,15.555094242095947,3 +3871,0.10081234574317932,0.20631147921085358,0.19951258599758148,0.25074517726898193,994.6895141601562,1e-05,0.08793781697750092,5.69777512550354,15.555094242095947,3 +3872,0.08207482844591141,0.0796685591340065,0.0775715559720993,0.23055288195610046,787.0369873046875,1e-05,0.052853912115097046,5.695085525512695,15.555094242095947,3 +3873,0.07121416181325912,0.09911314398050308,0.09071796387434006,0.22774839401245117,825.9837646484375,1e-05,0.07031349092721939,5.767441272735596,15.555094242095947,3 +3874,0.14134933054447174,0.0753418356180191,0.0709027573466301,0.24516025185585022,643.2039184570312,1e-05,0.10738378763198853,5.692782640457153,15.555094242095947,3 +3875,0.06916232407093048,0.0986061841249466,0.09002765268087387,0.2282051146030426,716.7235717773438,1e-05,0.06089473143219948,5.69361424446106,15.555094242095947,3 +3876,0.08821624517440796,0.09439890086650848,0.09033378213644028,0.23838140070438385,427.6316223144531,1e-05,0.05384741723537445,5.812556743621826,15.555094242095947,3 +3877,0.08461283892393112,0.10668515413999557,0.09873190522193909,0.239599347114563,965.9091796875,1e-05,0.08361421525478363,5.702482461929321,15.555094242095947,3 +3878,0.10701114684343338,0.11291108280420303,0.11322719603776932,0.2719791531562805,305.8912353515625,1e-05,0.0689217671751976,5.698364019393921,15.555094242095947,3 +3879,0.06839066743850708,0.1165231317281723,0.10662711411714554,0.2375480681657791,939.9801635742188,1e-05,0.05473753809928894,5.69154691696167,15.555094242095947,3 +3880,0.10085228830575943,0.1689554899930954,0.16468361020088196,0.24080929160118103,270.376220703125,1e-05,0.07027070969343185,5.689876556396484,15.555094242095947,3 +3881,0.0745307132601738,0.07602281123399734,0.07597921788692474,0.24601761996746063,891.62841796875,1e-05,0.048955485224723816,5.699071407318115,15.555094242095947,3 +3882,0.07885716110467911,0.12375316023826599,0.12255514413118362,0.20665062963962555,878.4185791015625,1e-05,0.08075825124979019,5.70897102355957,15.555094242095947,3 +3883,0.08206264674663544,0.14462019503116608,0.14055682718753815,0.1915464699268341,971.9750366210938,1e-05,0.06187562271952629,5.695264577865601,15.555094242095947,3 +3884,0.0841987207531929,0.10716911405324936,0.09440479427576065,0.20780448615550995,932.0956420898438,1e-05,0.11218849569559097,5.884247541427612,15.555094242095947,3 +3885,0.09395866841077805,0.09209005534648895,0.08451071381568909,0.18704326450824738,710.2763671875,1e-05,0.07153540849685669,5.682700872421265,15.555094242095947,3 +3886,0.04085420072078705,0.09208716452121735,0.09200017154216766,0.242291659116745,964.0897216796875,1e-05,0.0799257904291153,5.684004306793213,15.555094242095947,3 +3887,0.10990174859762192,0.13849353790283203,0.13592925667762756,0.19123396277427673,308.7349548339844,1e-05,0.10101138800382614,5.682973146438599,15.555094242095947,3 +3888,0.1381610929965973,0.14024262130260468,0.13872654736042023,0.26490384340286255,389.1184997558594,1e-05,0.09332101792097092,5.683309555053711,15.555094242095947,3 +3889,0.05208078771829605,0.07532598078250885,0.06698352843523026,0.2353445440530777,744.3366088867188,1e-05,0.06662383675575256,5.684494733810425,15.555094242095947,3 +3890,0.1322745829820633,0.09263911843299866,0.09413301199674606,0.23675480484962463,976.3572998046875,1e-05,0.07143552601337433,5.684123754501343,15.555094242095947,3 +3891,0.06858370453119278,0.06430858373641968,0.057994745671749115,0.25863781571388245,915.4175415039062,1e-05,0.06454209238290787,5.682825565338135,15.555094242095947,3 +3892,0.08721725642681122,0.03560490533709526,0.037775032222270966,0.1564422994852066,718.5374145507812,1e-05,0.047408297657966614,5.683305025100708,15.555094242095947,3 +3893,0.08546600490808487,0.04477782920002937,0.04894751310348511,0.2667067348957062,596.2343139648438,1e-05,0.06303463131189346,5.930697441101074,15.555094242095947,3 +3894,0.06534311175346375,0.23899240791797638,0.2314697951078415,0.27492788434028625,96.86347198486328,1e-05,0.06454108655452728,5.776339769363403,15.555094242095947,3 +3895,0.10167266428470612,0.29116058349609375,0.26373639702796936,0.19311697781085968,996.3473510742188,1e-05,0.06624860316514969,5.686012029647827,15.555094242095947,3 +3896,0.09249766170978546,0.08138393610715866,0.08078017085790634,0.22475960850715637,389.1184997558594,1e-05,0.06356966495513916,5.6810736656188965,15.555094242095947,3 +3897,0.07936007529497147,0.13348965346813202,0.13228540122509003,0.18637017905712128,900.4474487304688,1e-05,0.0636383444070816,5.694955348968506,15.555094242095947,3 +3898,0.07354901731014252,0.2014867663383484,0.1836206018924713,0.2273477464914322,981.0671997070312,1e-05,0.06338845193386078,5.695341110229492,15.555094242095947,3 +3899,0.054197926074266434,0.09627065062522888,0.09714262932538986,0.2077644169330597,865.6211547851562,1e-05,0.07038678228855133,5.676019906997681,15.555094242095947,3 +3900,0.07583186030387878,0.10427650064229965,0.09994889795780182,0.22023236751556396,657.0208740234375,1e-05,0.05461420863866806,5.68547797203064,15.555094242095947,3 +3901,0.12848156690597534,0.06739494949579239,0.062097035348415375,0.2129567265510559,857.9046020507812,1e-05,0.07016696780920029,5.6725921630859375,15.555094242095947,3 +3902,0.10295894742012024,0.19476628303527832,0.1898101270198822,0.24410255253314972,232.08470153808594,1e-05,0.06778822094202042,5.915550231933594,15.555094242095947,3 +3903,0.11167456209659576,0.06334549188613892,0.06117716804146767,0.25950318574905396,709.3425903320312,1e-05,0.07426274567842484,5.86434531211853,15.555094242095947,3 +3904,0.06544598937034607,0.09536594897508621,0.08971967548131943,0.19101762771606445,938.7450561523438,1e-05,0.06499787420034409,5.6831254959106445,15.555094242095947,3 +3905,0.08341072499752045,0.11561217159032822,0.11003725975751877,0.2524198591709137,894.4823608398438,1e-05,0.08259075880050659,5.683017253875732,15.555094242095947,3 +3906,0.1177382543683052,0.11162485182285309,0.1076795756816864,0.23955929279327393,727.4247436523438,1e-05,0.08409655094146729,5.68349027633667,15.555094242095947,3 +3907,0.07582177966833115,0.04893559217453003,0.05155356228351593,0.17768429219722748,984.0426025390625,1e-05,0.056055158376693726,5.691659450531006,15.555094242095947,3 +3908,0.08984991908073425,0.05719802528619766,0.053027037531137466,0.13362979888916016,646.7181396484375,1e-05,0.06816309690475464,5.678865432739258,15.555094242095947,3 +3909,0.11026588827371597,0.08842889964580536,0.08812865614891052,0.21368588507175446,927.1693725585938,1e-05,0.08776630461215973,5.691558361053467,15.555094242095947,3 +3910,0.06707264482975006,0.0797310397028923,0.07644407451152802,0.22601762413978577,808.6157836914062,1e-05,0.07658331096172333,5.688793897628784,15.555094242095947,3 +3911,0.09539156407117844,0.07212122529745102,0.06985758244991302,0.28448715806007385,868.4371337890625,1e-05,0.0802929624915123,5.683488130569458,15.555094242095947,3 +3912,0.11057094484567642,0.054812267422676086,0.05696598067879677,0.16408653557300568,726.5493774414062,1e-05,0.06926633417606354,5.701594352722168,15.555094242095947,3 +3913,0.1456393599510193,0.14010390639305115,0.12460581958293915,0.26431891322135925,968.7218017578125,1e-05,0.07468151301145554,5.701072931289673,15.555094242095947,3 +3914,0.10585516691207886,0.12888863682746887,0.12282783538103104,0.2512820363044739,349.42364501953125,1e-05,0.05778287351131439,5.6866936683654785,15.555094242095947,3 +3915,0.09874150156974792,0.07528294622898102,0.06811857223510742,0.1781410127878189,826.5582275390625,1e-05,0.04892440512776375,5.687235116958618,15.555094242095947,3 +3916,0.06462232768535614,0.19287702441215515,0.18320854008197784,0.2556249797344208,998.592041015625,1e-05,0.08163845539093018,5.912939786911011,15.555094242095947,3 +3917,0.09239289164543152,0.11760133504867554,0.1125631108880043,0.18038460612297058,953.2288818359375,1e-05,0.07507124543190002,5.6870033740997314,15.555094242095947,3 +3918,0.06980206072330475,0.5269014239311218,0.44037264585494995,0.21015223860740662,999.3985595703125,1e-05,0.05154829099774361,5.932732582092285,15.555094242095947,3 +3919,0.10322404652833939,0.07513770461082458,0.07647711783647537,0.1335897445678711,538.1549072265625,1e-05,0.06347732245922089,5.680739164352417,15.555094242095947,3 +3920,0.06830098479986191,0.13013218343257904,0.12489867955446243,0.25536859035491943,991.52197265625,1e-05,0.054633207619190216,5.681404113769531,15.555094242095947,3 +3921,0.11762451380491257,0.09967080503702164,0.09490399807691574,0.2997435927391052,726.5493774414062,1e-05,0.05712684988975525,5.680079460144043,15.555094242095947,3 +3922,0.09701784700155258,0.07297475636005402,0.07512523233890533,0.19282852113246918,904.3141479492188,1e-05,0.06692516058683395,5.6881937980651855,15.555094242095947,3 +3923,0.08123587816953659,0.06642790138721466,0.0664217621088028,0.2592788338661194,601.6597900390625,1e-05,0.059764325618743896,5.68009090423584,15.555094242095947,3 +3924,0.060267023742198944,0.11059825867414474,0.10356239974498749,0.2398798018693924,909.21484375,1e-05,0.054749321192502975,5.9105544090271,15.555094242095947,3 +3925,0.07849761843681335,0.046016398817300797,0.04825843125581741,0.25958332419395447,821.3306274414062,1e-05,0.05802924931049347,5.684833765029907,15.555094242095947,3 +3926,0.04929238557815552,0.10282161086797714,0.09973417967557907,0.2199999988079071,946.3070678710938,1e-05,0.07923553138971329,5.681433916091919,15.555094242095947,3 +3927,0.11835063248872757,0.06952950358390808,0.06412811577320099,0.23213940858840942,594.86376953125,1e-05,0.06069524213671684,5.723867654800415,15.555094242095947,3 +3928,0.08658160269260406,0.061066579073667526,0.07028309255838394,0.184407040476799,988.4937133789062,1e-05,0.049322161823511124,5.676830053329468,15.555094242095947,3 +3929,0.10253296792507172,0.10082314163446426,0.09587134420871735,0.26122593879699707,359.68658447265625,1e-05,0.06781693547964096,5.68818998336792,15.555094242095947,3 +3930,0.09544502943754196,0.12937122583389282,0.12798500061035156,0.21380607783794403,391.4835205078125,1e-05,0.04876196011900902,5.680972337722778,15.555094242095947,3 +3931,0.062451981008052826,0.1222527027130127,0.1201360896229744,0.21478363871574402,934.6619262695312,1e-05,0.07697279006242752,5.681398391723633,15.555094242095947,3 +3932,0.055846523493528366,0.059272706508636475,0.055680520832538605,0.2245272397994995,775.796630859375,1e-05,0.05185981094837189,5.68432092666626,15.555094242095947,3 +3933,0.07874354720115662,0.07935045659542084,0.0759519711136818,0.26026442646980286,942.4212036132812,1e-05,0.054046474397182465,5.684070825576782,15.555094242095947,3 +3934,0.03547712787985802,0.034917786717414856,0.032812539488077164,0.22016826272010803,906.9703979492188,1e-05,0.08453840762376785,5.690533399581909,15.555094242095947,3 +3935,0.10608626902103424,0.07497631758451462,0.06895499676465988,0.26924678683280945,819.5592651367188,1e-05,0.06167100742459297,5.680219650268555,15.555094242095947,3 +3936,0.10099378973245621,0.11120986938476562,0.10849803686141968,0.09231570363044739,965.6505737304688,1e-05,0.05763796716928482,5.680076599121094,15.555094242095947,3 +3937,0.08132006973028183,0.08126165717840195,0.07286922633647919,0.283573716878891,805.4765625,1e-05,0.048624806106090546,5.686798095703125,15.555094242095947,3 +3938,0.07495158165693283,0.15327034890651703,0.14696714282035828,0.237644225358963,960.1112060546875,1e-05,0.06607317179441452,5.830623149871826,15.555094242095947,3 +3939,0.07793804258108139,0.02084837667644024,0.022495323792099953,0.11361377686262131,773.6281127929688,1e-05,0.06391005963087082,5.6940929889678955,15.555094242095947,3 +3940,0.1404096931219101,0.04586692526936531,0.045757271349430084,0.04946313798427582,650.1919555664062,1e-05,0.08180227875709534,5.693332672119141,15.555094242095947,3 +3941,0.09089163690805435,0.26540160179138184,0.26288291811943054,0.20894229412078857,129.92831420898438,1e-05,0.06040317937731743,5.675074100494385,15.555094242095947,3 +3942,0.08316724002361298,0.3435865044593811,0.3465757369995117,0.14822115004062653,61.78706741333008,1e-05,0.05878987908363342,5.704944372177124,15.555094242095947,3 +3943,0.08496507257223129,0.12978942692279816,0.12137971818447113,0.21265223622322083,930.4703369140625,1e-05,0.0875810980796814,5.707711219787598,15.555094242095947,3 +3944,0.06850720196962357,0.05410471558570862,0.052037157118320465,0.13751602172851562,678.7020263671875,1e-05,0.060205910354852676,5.894115447998047,15.555094242095947,3 +3945,0.06191764026880264,0.12457789480686188,0.12026376277208328,0.2210657000541687,905.4575805664062,1e-05,0.053073909133672714,5.7931249141693115,15.555094242095947,3 +3946,0.08345792442560196,0.17918579280376434,0.16764670610427856,0.2029326856136322,982.2193603515625,1e-05,0.0607093870639801,5.682798385620117,15.555094242095947,3 +3947,0.08106223493814468,0.07811080664396286,0.07448764890432358,0.12599357962608337,947.1898803710938,1e-05,0.06370894610881805,5.8954758644104,15.555094242095947,3 +3948,0.0720948874950409,0.07675405591726303,0.07458672672510147,0.24037659168243408,557.0953369140625,1e-05,0.06409325450658798,5.68504524230957,15.555094242095947,3 +3949,0.07500152289867401,0.08366366475820541,0.08600987493991852,0.13959935307502747,995.10595703125,1e-05,0.05384425073862076,5.691019296646118,15.555094242095947,3 +3950,0.04420580342411995,0.07115699350833893,0.06547844409942627,0.29308491945266724,859.375,1e-05,0.0650598406791687,5.685796022415161,15.555094242095947,3 +3951,0.11073540896177292,0.1485956758260727,0.15026643872261047,0.17983172833919525,997.5768432617188,1e-05,0.061992812901735306,5.680182456970215,15.555094242095947,3 +3952,0.07451412081718445,0.058187779039144516,0.0555686391890049,0.22596153616905212,733.4710693359375,1e-05,0.06190633773803711,5.690554618835449,15.555094242095947,3 +3953,0.08402261883020401,0.05954999476671219,0.05598251894116402,0.27775639295578003,789.7643432617188,1e-05,0.07039854675531387,5.682171583175659,15.555094242095947,3 +3954,0.054627031087875366,0.07302868366241455,0.0693756565451622,0.1914663463830948,507.7196960449219,1e-05,0.07278098165988922,5.685171127319336,15.555094242095947,3 +3955,0.09336484968662262,0.09813383221626282,0.10501652210950851,0.2250160127878189,962.511474609375,1e-05,0.07885803282260895,5.682917356491089,15.555094242095947,3 +3956,0.07083255052566528,0.05978536978363991,0.05637499690055847,0.28168267011642456,824.8300170898438,1e-05,0.0745861753821373,5.680234432220459,15.555094242095947,3 +3957,0.03659027814865112,0.069404736161232,0.0649350956082344,0.23442307114601135,879.3001098632812,1e-05,0.06794346868991852,5.685387372970581,15.555094242095947,3 +3958,0.11273862421512604,0.12286631762981415,0.1115489974617958,0.2739422917366028,966.9384155273438,1e-05,0.08338931202888489,5.686419248580933,15.555094242095947,3 +3959,0.08403389900922775,0.08356974273920059,0.08213381469249725,0.2627083361148834,480.2955627441406,1e-05,0.048997871577739716,5.684061765670776,15.555094242095947,3 +3960,0.08935635536909103,0.06381326913833618,0.06400785595178604,0.2367948591709137,878.85986328125,1e-05,0.053307391703128815,5.685821294784546,15.555094242095947,3 +3961,0.11098608374595642,0.08149155229330063,0.07561193406581879,0.14251601696014404,668.0632934570312,1e-05,0.07715453952550888,5.685044527053833,15.555094242095947,3 +3962,0.10392498970031738,0.09112612158060074,0.08403187245130539,0.25296473503112793,696.9026489257812,1e-05,0.07671640813350677,5.679598093032837,15.555094242095947,3 +3963,0.08405977487564087,0.1617768257856369,0.1476699560880661,0.18521633744239807,978.0244140625,1e-05,0.06165720522403717,5.687209606170654,15.555094242095947,3 +3964,0.04877270758152008,0.14872154593467712,0.13477541506290436,0.2878204882144928,965.3915405273438,1e-05,0.06195779889822006,5.687122344970703,15.555094242095947,3 +3965,0.10998908430337906,0.08361775428056717,0.08017726242542267,0.20810095965862274,833.3333129882812,1e-05,0.059518273919820786,5.893308877944946,15.555094242095947,3 +3966,0.0771980732679367,0.08283313363790512,0.07637158781290054,0.20501601696014404,829.4078369140625,1e-05,0.049379199743270874,5.693357467651367,15.555094242095947,3 +3967,0.11344888061285019,0.08788788318634033,0.0892040804028511,0.19995993375778198,985.8411254882812,1e-05,0.07114873081445694,5.688726186752319,15.555094242095947,3 +3968,0.08625797182321548,0.12065814435482025,0.11535701900720596,0.2944470942020416,978.0244140625,1e-05,0.07906331866979599,5.687525749206543,15.555094242095947,3 +3969,0.09769196808338165,0.08304926007986069,0.08043273538351059,0.26799678802490234,927.8350219726562,1e-05,0.056130893528461456,5.691420078277588,15.555094242095947,3 +3970,0.09766862541437149,0.08123147487640381,0.07842462509870529,0.24867787957191467,539.7727661132812,1e-05,0.06902888417243958,5.677210807800293,15.555094242095947,3 +3971,0.06421040743589401,0.08306664973497391,0.08075844496488571,0.20387019217014313,484.06866455078125,1e-05,0.05730276182293892,5.6869471073150635,15.555094242095947,3 +3972,0.10696260631084442,0.1402025818824768,0.1432146579027176,0.12666666507720947,303.0303039550781,1e-05,0.06645748764276505,5.684370994567871,15.555094242095947,3 +3973,0.056748613715171814,0.11200626194477081,0.10896170884370804,0.1316586434841156,950.9569091796875,1e-05,0.05323360115289688,5.683006525039673,15.555094242095947,3 +3974,0.08732824772596359,0.05222444236278534,0.05425208806991577,0.20964743196964264,835.5437622070312,1e-05,0.05789307504892349,5.6853346824646,15.555094242095947,3 +3975,0.08165758103132248,0.09139075875282288,0.0909108892083168,0.18524037301540375,762.48046875,1e-05,0.05899800360202789,5.684694290161133,15.555094242095947,3 +3976,0.07406234741210938,0.12139049917459488,0.11670145392417908,0.1721554398536682,968.2146606445312,1e-05,0.061766598373651505,5.690242290496826,15.555094242095947,3 +3977,0.05721014738082886,0.08355774730443954,0.07580512762069702,0.29131409525871277,876.1961669921875,1e-05,0.059664901345968246,5.686101675033569,15.555094242095947,3 +3978,0.09891799837350845,0.43871521949768066,0.4739343225955963,0.17150640487670898,57.25191116333008,1e-05,0.06465420126914978,5.678773880004883,15.555094242095947,3 +3979,0.1212272047996521,0.0639411211013794,0.05954746529459953,0.2512820363044739,714.8972778320312,1e-05,0.06234066188335419,6.085227727890015,15.555094242095947,3 +3980,0.0773538202047348,0.07527817785739899,0.07076806575059891,0.1919471025466919,900.8379516601562,1e-05,0.05523962527513504,5.6784827709198,15.555094242095947,3 +3981,0.10028538852930069,0.07843522727489471,0.07729056477546692,0.2747996747493744,947.4830322265625,1e-05,0.06680026650428772,5.686554431915283,15.555094242095947,3 +3982,0.09106609970331192,0.04750605300068855,0.0485299751162529,0.20953525602817535,818.9655151367188,1e-05,0.06623880565166473,5.692675352096558,15.555094242095947,3 +3983,0.07954995334148407,0.06533143669366837,0.06356418132781982,0.2464503049850464,868.9024658203125,1e-05,0.0768866091966629,5.688992738723755,15.555094242095947,3 +3984,0.0521908700466156,0.0895628109574318,0.08938128501176834,0.21211537718772888,498.798095703125,1e-05,0.05399530753493309,5.68680739402771,15.555094242095947,3 +3985,0.065013088285923,0.25369176268577576,0.25061267614364624,0.1766185760498047,149.64788818359375,1e-05,0.059860870242118835,5.699755430221558,15.555094242095947,3 +3986,0.07766058295965195,0.06054015830159187,0.05770784616470337,0.09971153736114502,848.8447265625,1e-05,0.06694312393665314,5.905617952346802,15.555094242095947,3 +3987,0.08799171447753906,0.13010452687740326,0.12185715138912201,0.2914102375507355,988.0552978515625,1e-05,0.05880744755268097,5.6872406005859375,15.555094242095947,3 +3988,0.10196253657341003,0.07125385105609894,0.06882763653993607,0.14281249046325684,730.0333251953125,1e-05,0.08409091830253601,5.674592018127441,15.555094242095947,3 +3989,0.08283670991659164,0.08208628743886948,0.07625332474708557,0.32160255312919617,918.259033203125,1e-05,0.06139098107814789,5.693079471588135,15.555094242095947,3 +3990,0.0716838389635086,0.12437049299478531,0.1251075118780136,0.18575319647789001,942.1181640625,1e-05,0.05210413411259651,5.682998180389404,15.555094242095947,3 +3991,0.12200688570737839,0.051903240382671356,0.05028877034783363,0.18504807353019714,928.828369140625,1e-05,0.06427202373743057,5.681957006454468,15.555094242095947,3 +3992,0.0777025818824768,0.13839583098888397,0.12441709637641907,0.25421473383903503,970.7328491210938,1e-05,0.0641700029373169,5.681698560714722,15.555094242095947,3 +3993,0.06750885397195816,0.10848361253738403,0.10656546801328659,0.25286057591438293,393.8356018066406,1e-05,0.06832215189933777,5.6852099895477295,15.555094242095947,3 +3994,0.0976937860250473,0.07175272703170776,0.0666738823056221,0.22066505253314972,852.9224853515625,1e-05,0.057105496525764465,5.688744783401489,15.555094242095947,3 +3995,0.07038869708776474,0.05490567907691002,0.054625507444143295,0.22171473503112793,868.9024658203125,1e-05,0.07899108529090881,5.685675382614136,15.555094242095947,3 +3996,0.08114199340343475,0.075777567923069,0.06943128257989883,0.22066505253314972,713.9794311523438,1e-05,0.06151839345693588,5.686279535293579,15.555094242095947,3 +3997,0.10924337804317474,0.08607978373765945,0.08716592937707901,0.1751602441072464,972.2222290039062,1e-05,0.06611888855695724,5.685671806335449,15.555094242095947,3 +3998,0.04467106610536575,0.10893675684928894,0.09858579188585281,0.27194711565971375,896.0928344726562,1e-05,0.056861020624637604,5.675889015197754,15.555094242095947,3 +3999,0.0838170051574707,0.13796652853488922,0.12497121840715408,0.22205927968025208,971.23095703125,1e-05,0.06086528301239014,5.698249578475952,15.555094242095947,3 +4000,0.06585215032100677,0.34075912833213806,0.32693246006965637,0.15295672416687012,999.1974487304688,1e-05,0.0536186508834362,5.800900220870972,15.555094242095947,3 +4001,0.107280433177948,0.05182662233710289,0.04978370666503906,0.27136215567588806,809.2384033203125,1e-05,0.06611836701631546,5.666079759597778,15.555094242095947,3 +4002,0.07256189733743668,0.09721971303224564,0.08715979754924774,0.3037179410457611,900.0560302734375,1e-05,0.0729772299528122,5.7147581577301025,15.555094242095947,3 +4003,0.06597907841205597,0.07460884749889374,0.0710456594824791,0.24483972787857056,900.8379516601562,1e-05,0.049517326056957245,5.707994222640991,15.555094242095947,3 +4004,0.10874789953231812,0.14669813215732574,0.14285431802272797,0.21959935128688812,241.93548583984375,1e-05,0.06755080819129944,5.7086591720581055,15.555094242095947,3 +4005,0.09433654695749283,0.052910417318344116,0.05269847810268402,0.13380607962608337,892.0389404296875,1e-05,0.05824245885014534,5.701784610748291,15.555094242095947,3 +4006,0.06421474367380142,0.06969571858644485,0.06754757463932037,0.1976442188024521,563.1868286132812,1e-05,0.04538504779338837,5.705439329147339,15.555094242095947,3 +4007,0.13554713129997253,0.06026571989059448,0.059044115245342255,0.12223557382822037,487.8049011230469,1e-05,0.07953453809022903,5.693124055862427,15.555094242095947,3 +4008,0.11677847802639008,0.0718655064702034,0.07218200713396072,0.20665864646434784,434.0730895996094,1e-05,0.05580610781908035,5.697738885879517,15.555094242095947,3 +4009,0.06638523936271667,0.09331531077623367,0.09103432297706604,0.1212339699268341,962.7756958007812,1e-05,0.048369765281677246,5.702158212661743,15.555094242095947,3 +4010,0.07547594606876373,0.10953221470117569,0.10025811195373535,0.2873958349227905,925.1558837890625,1e-05,0.06642555445432663,5.689004421234131,15.555094242095947,3 +4011,0.10765378922224045,0.051951292902231216,0.04896262660622597,0.22940704226493835,721.2352294921875,1e-05,0.06361523270606995,5.83282208442688,15.555094242095947,3 +4012,0.09391820430755615,0.0796736404299736,0.07958896458148956,0.18516826629638672,552.4553833007812,1e-05,0.06761297583580017,5.6900341510772705,15.555094242095947,3 +4013,0.1376727670431137,0.09452200680971146,0.08948589116334915,0.252323716878891,495.1690979003906,1e-05,0.052076634019613266,5.686260461807251,15.555094242095947,3 +4014,0.07530791312456131,0.06509280949831009,0.0647457018494606,0.13032852113246918,821.3306274414062,1e-05,0.0674605593085289,5.9207000732421875,15.555094242095947,3 +4015,0.08307354152202606,0.07323230803012848,0.07920848578214645,0.13751602172851562,225.4098358154297,1e-05,0.05249498412013054,5.707650423049927,15.555094242095947,3 +4016,0.07561927288770676,0.07637294381856918,0.07305452972650528,0.2943750023841858,940.287353515625,1e-05,0.056889768689870834,5.698046922683716,15.555094242095947,3 +4017,0.09382537007331848,0.05232352763414383,0.05249950289726257,0.28621792793273926,903.5476684570312,1e-05,0.07677043229341507,5.699719190597534,15.555094242095947,3 +4018,0.11918603628873825,0.16095246374607086,0.1487099677324295,0.20489582419395447,992.58642578125,1e-05,0.05636764317750931,5.697443723678589,15.555094242095947,3 +4019,0.05177535116672516,0.06743749231100082,0.06149628758430481,0.23866185545921326,917.19921875,1e-05,0.06519503891468048,5.6946094036102295,15.555094242095947,3 +4020,0.0904226303100586,0.07755792140960693,0.06861621886491776,0.21844550967216492,828.8410034179688,1e-05,0.06962154060602188,5.6918721199035645,15.555094242095947,3 +4021,0.07755511999130249,0.058048561215400696,0.055953532457351685,0.23675480484962463,797.7569580078125,1e-05,0.06794293224811554,5.692207098007202,15.555094242095947,3 +4022,0.05759195610880852,0.10078967362642288,0.09826859831809998,0.16296473145484924,935.9296264648438,1e-05,0.06667196750640869,5.700517654418945,15.555094242095947,3 +4023,0.14492130279541016,0.1311773806810379,0.13007164001464844,0.25277242064476013,452.8061218261719,1e-05,0.08238105475902557,5.687653064727783,15.555094242095947,3 +4024,0.14008885622024536,0.14738960564136505,0.145347461104393,0.2172035127878189,344.2029113769531,1e-05,0.06511487811803818,5.689105033874512,15.555094242095947,3 +4025,0.11131659150123596,0.10526999831199646,0.09723253548145294,0.30697113275527954,813.5474853515625,1e-05,0.056978896260261536,5.921503305435181,15.555094242095947,3 +4026,0.0791827142238617,0.2036101371049881,0.1870616227388382,0.30280447006225586,991.3079833984375,1e-05,0.04703889042139053,5.707565069198608,15.555094242095947,3 +4027,0.07668785750865936,0.10096263885498047,0.10141647607088089,0.23002402484416962,934.9798583984375,1e-05,0.0629359781742096,5.709835767745972,15.555094242095947,3 +4028,0.09828586876392365,0.08164041489362717,0.08029830455780029,0.14634615182876587,485.94134521484375,1e-05,0.07588265091180801,5.84375786781311,15.555094242095947,3 +4029,0.08425567299127579,0.06419240683317184,0.06397050619125366,0.20491985976696014,587.923828125,1e-05,0.045683953911066055,5.911098480224609,15.555094242095947,3 +4030,0.06405596435070038,0.1093057170510292,0.10120916366577148,0.22335736453533173,965.9091796875,1e-05,0.062166448682546616,5.69247031211853,15.555094242095947,3 +4031,0.1588745415210724,0.17589980363845825,0.17419520020484924,0.2104567289352417,208.3333282470703,1e-05,0.05466747656464577,5.686555624008179,15.555094242095947,3 +4032,0.07021710276603699,0.11096680164337158,0.10621695965528488,0.21159453690052032,929.1580810546875,1e-05,0.056008800864219666,5.836782693862915,15.555094242095947,3 +4033,0.08290796726942062,0.06332038342952728,0.058801665902137756,0.22141024470329285,903.1631469726562,1e-05,0.04705994203686714,5.69192910194397,15.555094242095947,3 +4034,0.06759114563465118,0.07588222622871399,0.0744975358247757,0.17734774947166443,618.6868286132812,1e-05,0.047704920172691345,5.687260389328003,15.555094242095947,3 +4035,0.12781576812267303,0.1113339364528656,0.10709214210510254,0.1685977429151535,516.4320068359375,1e-05,0.06859579682350159,5.689966201782227,15.555094242095947,3 +4036,0.06412366777658463,0.10324756801128387,0.09629768133163452,0.1795833259820938,956.8480224609375,1e-05,0.048469722270965576,5.687499284744263,15.555094242095947,3 +4037,0.07876357436180115,0.08491116762161255,0.0796697810292244,0.21699517965316772,922.7748413085938,1e-05,0.06354515999555588,5.679257869720459,15.555094242095947,3 +4038,0.08535091578960419,0.08891419321298599,0.09130550920963287,0.15704326331615448,885.3558349609375,1e-05,0.054230645298957825,5.689865350723267,15.555094242095947,3 +4039,0.11424285173416138,0.15907546877861023,0.15446701645851135,0.24677082896232605,270.376220703125,1e-05,0.056765563786029816,5.689666509628296,15.555094242095947,3 +4040,0.08173098415136337,0.05655211955308914,0.05405475199222565,0.21831730008125305,756.319091796875,1e-05,0.0539659783244133,5.682648658752441,15.555094242095947,3 +4041,0.08676076680421829,0.08326328545808792,0.08133591711521149,0.2521474361419678,960.6482543945312,1e-05,0.0634537935256958,5.680535554885864,15.555094242095947,3 +4042,0.07344024628400803,0.0779646635055542,0.07570019364356995,0.20956729352474213,963.8278198242188,1e-05,0.05517352744936943,5.687290668487549,15.555094242095947,3 +4043,0.13222770392894745,0.2705593407154083,0.270453542470932,0.2052564024925232,125.89928436279297,1e-05,0.06152789667248726,5.683775186538696,15.555094242095947,3 +4044,0.08102618902921677,0.12503644824028015,0.12268450111150742,0.26712340116500854,270.376220703125,1e-05,0.06362840533256531,5.686300992965698,15.555094242095947,3 +4045,0.13007889688014984,0.5299762487411499,0.5194979310035706,0.15083332359790802,88.28997039794922,1e-05,0.08617038279771805,5.691463470458984,15.555094242095947,3 +4046,0.0968322679400444,0.06612946093082428,0.06035958230495453,0.2673717737197876,651.3410034179688,1e-05,0.06205663084983826,5.693176031112671,15.555094242095947,3 +4047,0.11811771988868713,0.061767950654029846,0.06043672561645508,0.1983974277973175,458.8607482910156,1e-05,0.08405079692602158,5.697016954421997,15.555094242095947,3 +4048,0.08610926568508148,0.14006271958351135,0.13008524477481842,0.29374998807907104,963.8278198242188,1e-05,0.06655917316675186,5.689463376998901,15.555094242095947,3 +4049,0.10966136306524277,0.07888687402009964,0.07564917951822281,0.23782852292060852,723.90576171875,1e-05,0.05325819179415703,5.686137676239014,15.555094242095947,3 +4050,0.04369306564331055,0.019627327099442482,0.017558764666318893,0.09564102441072464,789.0855712890625,1e-05,0.0696755051612854,5.689185380935669,15.555094242095947,3 +4051,0.05801539868116379,0.1462661772966385,0.14111487567424774,0.29354166984558105,942.1181640625,1e-05,0.051193688064813614,5.6860315799713135,15.555094242095947,3 +4052,0.12333870679140091,0.12526139616966248,0.11970137804746628,0.20349358022212982,935.6137084960938,1e-05,0.0712694302201271,5.686033010482788,15.555094242095947,3 +4053,0.09260130673646927,0.030897201970219612,0.032235752791166306,0.22403845191001892,960.6482543945312,1e-05,0.04518403857946396,5.847057580947876,15.555094242095947,3 +4054,0.09827768802642822,0.14524193108081818,0.13156162202358246,0.29779645800590515,948.6500244140625,1e-05,0.05453004315495491,5.699048280715942,15.555094242095947,3 +4055,0.08347219228744507,0.17869159579277039,0.15780815482139587,0.21890223026275635,999.5994262695312,1e-05,0.06835057586431503,5.690070152282715,15.555094242095947,3 +4056,0.06790954619646072,0.04138251021504402,0.049185410141944885,0.2244310826063156,949.8078002929688,1e-05,0.049341101199388504,5.911971092224121,15.555094242095947,3 +4057,0.09002062678337097,0.05094509944319725,0.05348186567425728,0.24034453928470612,956.0206298828125,1e-05,0.051835041493177414,5.697003364562988,15.555094242095947,3 +4058,0.09192436188459396,0.072970449924469,0.07116346061229706,0.27089741826057434,925.8298950195312,1e-05,0.058021560311317444,5.680078506469727,15.555094242095947,3 +4059,0.055232323706150055,0.07896358519792557,0.07521673291921616,0.2444150596857071,743.5170288085938,1e-05,0.05815717205405235,5.691873550415039,15.555094242095947,3 +4060,0.0821223258972168,0.16734211146831512,0.18019641935825348,0.17171473801136017,446.65814208984375,1e-05,0.05040280893445015,5.69148325920105,15.555094242095947,3 +4061,0.06119554117321968,0.15525487065315247,0.1563398241996765,0.2279086410999298,988.2747802734375,1e-05,0.057483892887830734,5.6922218799591064,15.555094242095947,3 +4062,0.10838212072849274,0.09950356930494308,0.09420158714056015,0.2832772433757782,425.4617614746094,1e-05,0.06900361180305481,5.6853132247924805,15.555094242095947,3 +4063,0.0661880373954773,0.0884319618344307,0.08891570568084717,0.22673878073692322,913.2543334960938,1e-05,0.06368646025657654,5.683131456375122,15.555094242095947,3 +4064,0.09823228418827057,0.20046842098236084,0.19719049334526062,0.19912660121917725,225.4098358154297,1e-05,0.05498339608311653,5.697953701019287,15.555094242095947,3 +4065,0.1276593655347824,0.09641855955123901,0.092967189848423,0.2311858832836151,760.95458984375,1e-05,0.056374844163656235,5.6865012645721436,15.555094242095947,3 +4066,0.13520099222660065,0.06189388036727905,0.06423740833997726,0.20029646158218384,493.3414306640625,1e-05,0.059498269110918045,5.690391302108765,15.555094242095947,3 +4067,0.10827895998954773,0.11747501790523529,0.10934474319219589,0.22529646754264832,951.2427978515625,1e-05,0.05452775955200195,5.694554090499878,15.555094242095947,3 +4068,0.1045910120010376,0.07881297171115875,0.07348314672708511,0.2330208271741867,576.5086669921875,1e-05,0.0569114089012146,5.696265935897827,15.555094242095947,3 +4069,0.07687617838382721,0.06441235542297363,0.06199723854660988,0.2038862109184265,708.4055786132812,1e-05,0.0594189278781414,5.696682691574097,15.555094242095947,3 +4070,0.08516640961170197,0.10857971757650375,0.1014183908700943,0.24272434413433075,940.5940551757812,1e-05,0.057605769485235214,5.70139479637146,15.555094242095947,3 +4071,0.09601657092571259,0.10325182229280472,0.0971926897764206,0.22909455001354218,930.143310546875,1e-05,0.0895589217543602,5.69161057472229,15.555094242095947,3 +4072,0.06425562500953674,0.06703785806894302,0.0621626190841198,0.1835416555404663,822.50341796875,1e-05,0.08106504380702972,5.696922302246094,15.555094242095947,3 +4073,0.07133588939905167,0.03917144611477852,0.03871561586856842,0.2166265994310379,651.3410034179688,1e-05,0.0781591460108757,5.702030420303345,15.555094242095947,3 +4074,0.03687756881117821,0.052186548709869385,0.05391941964626312,0.24898236989974976,794.4606323242188,1e-05,0.06570127606391907,5.818973541259766,15.555094242095947,3 +4075,0.04917794466018677,0.12535521388053894,0.11796101182699203,0.22881409525871277,887.0499877929688,1e-05,0.06018027663230896,5.70177149772644,15.555094242095947,3 +4076,0.08707507699728012,0.20222948491573334,0.1968708336353302,0.2682532072067261,978.2608642578125,1e-05,0.0668967068195343,5.685666561126709,15.555094242095947,3 +4077,0.08770804107189178,0.12235304713249207,0.1333092600107193,0.18263621628284454,550.8948364257812,1e-05,0.06860360503196716,5.927626132965088,15.555094242095947,3 +4078,0.09491709619760513,0.11425384134054184,0.11159947514533997,0.28131410479545593,288.4615478515625,1e-05,0.05452637001872063,5.6955406665802,15.555094242095947,3 +4079,0.09016206860542297,0.04737187176942825,0.045196983963251114,0.09371794760227203,749.19873046875,1e-05,0.06227518990635872,5.6973772048950195,15.555094242095947,3 +4080,0.06842532753944397,0.03647833690047264,0.038106728345155716,0.10671474039554596,967.194580078125,1e-05,0.06409190595149994,5.693341016769409,15.555094242095947,3 +4081,0.07273874431848526,0.07460810244083405,0.06800548732280731,0.302572101354599,701.75439453125,1e-05,0.0553809255361557,5.69359564781189,15.555094242095947,3 +4082,0.08943068236112595,0.07851018756628036,0.07660580426454544,0.25640222430229187,484.06866455078125,1e-05,0.09168680012226105,5.697054624557495,15.555094242095947,3 +4083,0.09049589186906815,0.5894323587417603,0.5807674527168274,0.1439102441072464,24.50980567932129,1e-05,0.06946492195129395,5.6953284740448,15.555094242095947,3 +4084,0.0992012768983841,0.0879470705986023,0.08217965066432953,0.1995673030614853,791.788818359375,1e-05,0.09749794751405716,5.7154381275177,15.555094242095947,3 +4085,0.16381463408470154,0.15103812515735626,0.1443624496459961,0.13931889832019806,965.1322021484375,1e-05,0.06681439280509949,5.712918519973755,15.555094242095947,3 +4086,0.07701168954372406,0.24036695063114166,0.2302604466676712,0.2274198681116104,982.677490234375,1e-05,0.07989686727523804,5.683245658874512,15.555094242095947,3 +4087,0.06736752390861511,0.09114514291286469,0.0859789252281189,0.21649838984012604,874.8499145507812,1e-05,0.06872082501649857,5.688025951385498,15.555094242095947,3 +4088,0.09041208028793335,0.11894745379686356,0.11746782809495926,0.19864583015441895,248.39744567871094,1e-05,0.07995098829269409,5.759005069732666,15.555094242095947,3 +4089,0.0909210667014122,0.08307954668998718,0.0837278887629509,0.2404647320508957,474.5657653808594,1e-05,0.05433407053351402,5.6886537075042725,15.555094242095947,3 +4090,0.12898005545139313,0.11089692264795303,0.10641102492809296,0.24356569349765778,557.0953369140625,1e-05,0.07658186554908752,5.687065362930298,15.555094242095947,3 +4091,0.06532618403434753,0.1716948300600052,0.155337393283844,0.1451602578163147,966.1671142578125,1e-05,0.06289005279541016,5.696280241012573,15.555094242095947,3 +4092,0.0868929848074913,0.0463942289352417,0.04846186563372612,0.23560896515846252,875.2998046875,1e-05,0.0671442300081253,5.9244043827056885,15.555094242095947,3 +4093,0.07797858864068985,0.04561249166727066,0.0420106016099453,0.22534453868865967,901.616455078125,1e-05,0.06799563765525818,5.688799619674683,15.555094242095947,3 +4094,0.026242494583129883,0.06986349821090698,0.07328426837921143,0.1796794831752777,936.8737182617188,1e-05,0.06998200714588165,5.691807746887207,15.555094242095947,3 +4095,0.0951085016131401,0.16907306015491486,0.15471965074539185,0.2486458271741867,963.3027954101562,1e-05,0.09229643642902374,5.683570623397827,15.555094242095947,3 +4096,0.0773654505610466,0.12534348666667938,0.12025316804647446,0.27522435784339905,940.5940551757812,1e-05,0.06894733011722565,5.694738388061523,15.555094242095947,3 +4097,0.13785244524478912,0.13138599693775177,0.1252576857805252,0.28467145562171936,986.2869873046875,1e-05,0.06159302219748497,5.690241575241089,15.555094242095947,3 +4098,0.1201101690530777,0.08270303159952164,0.08402750641107559,0.26722756028175354,780.78076171875,1e-05,0.0832916647195816,5.691352367401123,15.555094242095947,3 +4099,0.10728654265403748,0.08850143104791641,0.08683571219444275,0.23904646933078766,966.4247436523438,1e-05,0.0808059424161911,5.697319984436035,15.555094242095947,3 +4100,0.09709975868463516,0.05171976611018181,0.051823534071445465,0.22055287659168243,671.2963256835938,1e-05,0.07395985722541809,5.691891431808472,15.555094242095947,3 +4101,0.05117093771696091,0.0687558576464653,0.06781352311372757,0.22697114944458008,845.7308959960938,1e-05,0.05257048085331917,5.698922157287598,15.555094242095947,3 +4102,0.11233439296483994,0.1309197098016739,0.12441443651914597,0.24432691931724548,986.2869873046875,1e-05,0.07209310680627823,5.696879863739014,15.555094242095947,3 +4103,0.1264893263578415,0.13625085353851318,0.13299831748008728,0.23623396456241608,976.5967407226562,1e-05,0.07613305747509003,5.793549537658691,15.555094242095947,3 +4104,0.1602354198694229,0.07864219695329666,0.07788707315921783,0.17465543746948242,829.4078369140625,1e-05,0.05989481881260872,5.684189081192017,15.555094242095947,3 +4105,0.1419312208890915,0.19741082191467285,0.194936603307724,0.1341666579246521,241.93548583984375,1e-05,0.05953628197312355,5.687847375869751,15.555094242095947,3 +4106,0.06976555287837982,0.12424399703741074,0.11156895756721497,0.22928684949874878,989.3660888671875,1e-05,0.05429106578230858,5.73098349571228,15.555094242095947,3 +4107,0.08010417222976685,0.05161688104271889,0.04889544099569321,0.2049599289894104,618.6868286132812,1e-05,0.05964088439941406,5.691725015640259,15.555094242095947,3 +4108,0.08936324715614319,0.061269767582416534,0.058118727058172226,0.2093910127878189,882.3529052734375,1e-05,0.061194658279418945,5.682629346847534,15.555094242095947,3 +4109,0.0804717168211937,0.0907687321305275,0.08381251990795135,0.16189903020858765,827.7026977539062,1e-05,0.04733002558350563,5.6844446659088135,15.555094242095947,3 +4110,0.0996612086892128,0.04959995299577713,0.04715587943792343,0.2006330043077469,690.9660034179688,1e-05,0.05643114075064659,5.695000171661377,15.555094242095947,3 +4111,0.059730164706707,0.09160055220127106,0.08959979563951492,0.2274439036846161,566.1925659179688,1e-05,0.06137719377875328,5.694659948348999,15.555094242095947,3 +4112,0.08852367848157883,0.03862551599740982,0.03965987637639046,0.13644230365753174,575.0540771484375,1e-05,0.04888083413243294,5.690455675125122,15.555094242095947,3 +4113,0.07458262890577316,0.06947190314531326,0.06751061975955963,0.2571233808994293,727.4247436523438,1e-05,0.049048881977796555,5.919905662536621,15.555094242095947,3 +4114,0.08536632359027863,0.13070158660411835,0.1259295642375946,0.2515624761581421,954.9102783203125,1e-05,0.05583159625530243,5.683501958847046,15.555094242095947,3 +4115,0.0903061255812645,0.08584761619567871,0.08398041129112244,0.22938300669193268,872.5845947265625,1e-05,0.059853553771972656,5.681337833404541,15.555094242095947,3 +4116,0.07019859552383423,0.08223270624876022,0.0811772271990776,0.21862979233264923,681.8181762695312,1e-05,0.05554225295782089,5.830077409744263,15.555094242095947,3 +4117,0.07785779237747192,0.05403447523713112,0.04869552329182625,0.21588940918445587,795.784912109375,1e-05,0.052603188902139664,5.70475697517395,15.555094242095947,3 +4118,0.09746073186397552,0.05841532349586487,0.05935617536306381,0.24374999105930328,640.8381958007812,1e-05,0.057133834809064865,5.685805320739746,15.555094242095947,3 +4119,0.04658201336860657,0.039384759962558746,0.03533870354294777,0.2499999850988388,644.3798828125,1e-05,0.05300584435462952,5.674925804138184,15.555094242095947,3 +4120,0.10060238093137741,0.05617799609899521,0.05264586955308914,0.23741185665130615,786.3502197265625,1e-05,0.060903917998075485,5.683944940567017,15.555094242095947,3 +4121,0.0556890070438385,0.12902610003948212,0.11901881545782089,0.2564903795719147,970.48291015625,1e-05,0.057966653257608414,5.692789077758789,15.555094242095947,3 +4122,0.09842435270547867,0.1371191143989563,0.13056343793869019,0.28111377358436584,590.71728515625,1e-05,0.06160885468125343,5.6843461990356445,15.555094242095947,3 +4123,0.14292649924755096,0.13265706598758698,0.12770535051822662,0.2645753026008606,303.0303039550781,1e-05,0.07458574324846268,5.922980308532715,15.555094242095947,3 +4124,0.09428615868091583,0.062497176229953766,0.06227155402302742,0.29961538314819336,681.8181762695312,1e-05,0.05523575842380524,5.691009521484375,15.555094242095947,3 +4125,0.07058140635490417,0.4088785946369171,0.4098142683506012,0.2749679386615753,997.3726806640625,1e-05,0.061679158359766006,5.686325550079346,15.555094242095947,3 +4126,0.0750359296798706,0.05049719661474228,0.04556182026863098,0.11877403408288956,824.2506713867188,1e-05,0.05727259814739227,5.686141729354858,15.555094242095947,3 +4127,0.05216497182846069,0.06740816682577133,0.07273522764444351,0.1526762694120407,991.52197265625,1e-05,0.060820359736680984,5.686487674713135,15.555094242095947,3 +4128,0.12552504241466522,0.063323974609375,0.0614725761115551,0.20586538314819336,937.5,1e-05,0.0679721087217331,5.685182094573975,15.555094242095947,3 +4129,0.12627361714839935,0.0809972807765007,0.07339201122522354,0.2978685796260834,797.1013793945312,1e-05,0.05954480543732643,5.688570261001587,15.555094242095947,3 +4130,0.12410351634025574,0.6589402556419373,0.6670215725898743,0.19379006326198578,48.076927185058594,1e-05,0.0625787079334259,5.685939788818359,15.555094242095947,3 +4131,0.07774149626493454,0.15666450560092926,0.14699652791023254,0.24292467534542084,985.3936767578125,1e-05,0.06054474040865898,5.683189392089844,15.555094242095947,3 +4132,0.12413118779659271,0.11302462220191956,0.10998446494340897,0.2416265904903412,372.1910095214844,1e-05,0.059190478175878525,5.689833879470825,15.555094242095947,3 +4133,0.09142625331878662,0.09407462924718857,0.0881553441286087,0.28572115302085876,954.0719604492188,1e-05,0.05423039197921753,5.6838459968566895,15.555094242095947,3 +4134,0.08533648401498795,0.08641538769006729,0.08324993401765823,0.2470272332429886,918.259033203125,1e-05,0.04794249311089516,5.697138547897339,15.555094242095947,3 +4135,0.05032839626073837,0.183932825922966,0.17460040748119354,0.2544230818748474,970.48291015625,1e-05,0.04923592135310173,5.691273212432861,15.555094242095947,3 +4136,0.07977451384067535,0.04858322814106941,0.05224033445119858,0.16256409883499146,750.0000610351562,1e-05,0.05605233833193779,5.68955397605896,15.555094242095947,3 +4137,0.07667385041713715,0.062051255255937576,0.06116851046681404,0.09644230455160141,942.7236938476562,1e-05,0.05872802436351776,5.683899879455566,15.555094242095947,3 +4138,0.051033809781074524,0.1524750143289566,0.1378706842660904,0.21630607545375824,957.9439697265625,1e-05,0.07452504336833954,5.860086441040039,15.555094242095947,3 +4139,0.11396336555480957,0.07643871009349823,0.07294537872076035,0.2718028724193573,496.98797607421875,1e-05,0.06717229634523392,5.686635732650757,15.555094242095947,3 +4140,0.0952061265707016,0.06692507863044739,0.06980583071708679,0.2250320464372635,531.6091918945312,1e-05,0.05685309320688248,5.9253175258636475,15.555094242095947,3 +4141,0.10669247061014175,0.047650616616010666,0.04517117142677307,0.22543267905712128,860.34912109375,1e-05,0.05827399343252182,5.679060459136963,15.555094242095947,3 +4142,0.07972164452075958,0.1504141390323639,0.14939717948436737,0.09063301235437393,338.9212646484375,1e-05,0.0581650584936142,5.69356894493103,15.555094242095947,3 +4143,0.07248767465353012,0.07299480587244034,0.06973665207624435,0.2366025596857071,892.8571166992188,1e-05,0.05050547793507576,5.683939456939697,15.555094242095947,3 +4144,0.09976085275411606,0.07417353987693787,0.06779524683952332,0.262668251991272,703.6713256835938,1e-05,0.07441318035125732,5.933058977127075,15.555094242095947,3 +4145,0.09574678540229797,0.07144144177436829,0.07090535759925842,0.15661858022212982,550.8948364257812,1e-05,0.051003001630306244,5.6893651485443115,15.555094242095947,3 +4146,0.10864706337451935,0.04692230001091957,0.047138020396232605,0.14080928266048431,795.784912109375,1e-05,0.05643623694777489,5.888795375823975,15.555094242095947,3 +4147,0.06996555626392365,0.10728242993354797,0.10891401022672653,0.25025638937950134,333.5777282714844,1e-05,0.054638929665088654,5.686159610748291,15.555094242095947,3 +4148,0.06938239187002182,0.06362548470497131,0.059536464512348175,0.23377403616905212,678.7020263671875,1e-05,0.06981930881738663,5.685819864273071,15.555094242095947,3 +4149,0.09062005579471588,0.055963918566703796,0.0526607409119606,0.24125801026821136,694.9378051757812,1e-05,0.05610273778438568,5.688792943954468,15.555094242095947,3 +4150,0.07526831328868866,0.030280334874987602,0.035013142973184586,0.23643428087234497,785.6611938476562,1e-05,0.05513807758688927,5.6907782554626465,15.555094242095947,3 +4151,0.07900502532720566,0.049233682453632355,0.051449332386255264,0.100216343998909,500.59954833984375,1e-05,0.06450659781694412,5.75450873374939,15.555094242095947,3 +4152,0.11171112209558487,0.29491811990737915,0.2596149444580078,0.16996794939041138,998.7943115234375,1e-05,0.061515357345342636,5.6841700077056885,15.555094242095947,3 +4153,0.06750935316085815,0.14033041894435883,0.12809345126152039,0.2590705156326294,972.7151489257812,1e-05,0.056845422834157944,5.684708118438721,15.555094242095947,3 +4154,0.11180999130010605,0.07851111143827438,0.07239098101854324,0.229463130235672,896.4932861328125,1e-05,0.06326258182525635,5.687432527542114,15.555094242095947,3 +4155,0.10520932823419571,0.11683974415063858,0.12277387827634811,0.20121793448925018,164.93057250976562,1e-05,0.05548013746738434,5.682330131530762,15.555094242095947,3 +4156,0.07949884235858917,0.10355088114738464,0.09338868409395218,0.25547274947166443,973.6957397460938,1e-05,0.050416067242622375,5.810434818267822,15.555094242095947,3 +4157,0.08770070225000381,0.06287204474210739,0.06023082882165909,0.21475160121917725,910.3261108398438,1e-05,0.0649033859372139,5.689507007598877,15.555094242095947,3 +4158,0.06447404623031616,0.08732867240905762,0.08449197560548782,0.2093990296125412,913.6167602539062,1e-05,0.05691278353333473,5.679439544677734,15.555094242095947,3 +4159,0.07207289338111877,0.045414481312036514,0.04786087945103645,0.26007211208343506,750.7987060546875,1e-05,0.24272550642490387,5.689409017562866,15.555094242095947,3 +4160,0.10527000576257706,0.10826856642961502,0.10558047145605087,0.21076922118663788,601.6597900390625,1e-05,0.05403736233711243,5.6850950717926025,15.555094242095947,3 +4161,0.0731988325715065,0.13209250569343567,0.12267091870307922,0.21298877894878387,952.09716796875,1e-05,0.05972103029489517,5.686497926712036,15.555094242095947,3 +4162,0.10616527497768402,0.08713176846504211,0.09718632698059082,0.22881409525871277,979.4371948242188,1e-05,0.07304448634386063,5.687041997909546,15.555094242095947,3 +4163,0.11635411530733109,0.0870961919426918,0.08336369693279266,0.09865384548902512,942.7236938476562,1e-05,0.06374337524175644,5.683290243148804,15.555094242095947,3 +4164,0.08421022444963455,0.08806681632995605,0.08568582683801651,0.2400640994310379,961.1829223632812,1e-05,0.06419187784194946,5.68665623664856,15.555094242095947,3 +4165,0.07374408841133118,0.09313783794641495,0.0915888175368309,0.19880607724189758,352.0115051269531,1e-05,0.053472548723220825,5.682935953140259,15.555094242095947,3 +4166,0.06241677701473236,0.05603049695491791,0.05769187584519386,0.29973557591438293,448.71795654296875,1e-05,0.05767040327191353,5.685197591781616,15.555094242095947,3 +4167,0.06466639041900635,0.04906409978866577,0.051767852157354355,0.22340543568134308,893.2648315429688,1e-05,0.07799477130174637,5.683818578720093,15.555094242095947,3 +4168,0.1176328957080841,0.08778315037488937,0.08832821249961853,0.2777964770793915,400.81524658203125,1e-05,0.05750974640250206,5.6785197257995605,15.555094242095947,3 +4169,0.11068130284547806,0.07798700034618378,0.06967367976903915,0.2029487043619156,745.9677734375,1e-05,0.06160379573702812,5.71031379699707,15.555094242095947,3 +4170,0.08497469872236252,0.07138951867818832,0.06594615429639816,0.28007209300994873,912.5270385742188,1e-05,0.06977199018001556,5.689758539199829,15.555094242095947,3 +4171,0.06630074977874756,0.11122453957796097,0.10874943435192108,0.22863781452178955,349.42364501953125,1e-05,0.08988916128873825,5.694271564483643,15.555094242095947,3 +4172,0.05294157937169075,0.05622393265366554,0.056502941995859146,0.24853365123271942,660.3773803710938,1e-05,0.06714353710412979,5.688793659210205,15.555094242095947,3 +4173,0.1078178733587265,0.5029798150062561,0.49974319338798523,0.2611137628555298,48.076927185058594,1e-05,0.10283312201499939,5.685189247131348,15.555094242095947,3 +4174,0.07602201402187347,0.08704529702663422,0.08461087942123413,0.2301442176103592,880.177490234375,1e-05,0.07918602973222733,5.675817012786865,15.555094242095947,3 +4175,0.10821946710348129,0.05208992585539818,0.05296861752867699,0.24165062606334686,696.9026489257812,1e-05,0.08063379675149918,5.683808326721191,15.555094242095947,3 +4176,0.11615534871816635,0.08527345210313797,0.08091340959072113,0.26710736751556396,612.2449340820312,1e-05,0.10613398998975754,5.684959888458252,15.555094242095947,3 +4177,0.10899701714515686,0.14779974520206451,0.14914990961551666,0.2669070363044739,235.38963317871094,1e-05,0.054142534732818604,5.691295862197876,15.555094242095947,3 +4178,0.06879135966300964,0.19837290048599243,0.17180000245571136,0.20673877000808716,1000.0,1e-05,0.05045274645090103,5.685141086578369,15.555094242095947,3 +4179,0.0656132698059082,0.06600530445575714,0.0610676109790802,0.20716345310211182,869.3666381835938,1e-05,0.06907923519611359,5.93945574760437,15.555094242095947,3 +4180,0.09740445017814636,0.10761833935976028,0.10613252967596054,0.1966666579246521,852.4172973632812,1e-05,0.08764852583408356,5.700405597686768,15.555094242095947,3 +4181,0.0843520537018776,0.05526652932167053,0.057796865701675415,0.14222756028175354,701.75439453125,1e-05,0.05470460280776024,5.701761960983276,15.555094242095947,3 +4182,0.10361504554748535,0.0944366529583931,0.09677106142044067,0.17903845012187958,884.5029296875,1e-05,0.09956608712673187,5.69266152381897,15.555094242095947,3 +4183,0.08059608936309814,0.09042355418205261,0.08216883987188339,0.3009454905986786,892.4485473632812,1e-05,0.07474034279584885,5.694936752319336,15.555094242095947,3 +4184,0.05498103052377701,0.1339445263147354,0.11757823079824448,0.2590865194797516,949.8078002929688,1e-05,0.052993614226579666,5.711878061294556,15.555094242095947,3 +4185,0.05637136846780777,0.1083478033542633,0.11329653859138489,0.2884775400161743,257.9365234375,1e-05,0.058867454528808594,5.691492319107056,15.555094242095947,3 +4186,0.08989974856376648,0.08451265841722488,0.08297789096832275,0.2593509554862976,681.8181762695312,1e-05,0.08573439717292786,5.694273233413696,15.555094242095947,3 +4187,0.07811479270458221,0.08945950865745544,0.08956561237573624,0.19528044760227203,770.7055053710938,1e-05,0.0509219765663147,5.701998949050903,15.555094242095947,3 +4188,0.059878185391426086,0.23326070606708527,0.21331633627414703,0.260608971118927,983.8159790039062,1e-05,0.0549602210521698,5.879875183105469,15.555094242095947,3 +4189,0.06310334801673889,0.0448966845870018,0.044255129992961884,0.1176682636141777,741.8699340820312,1e-05,0.08565893769264221,5.692792177200317,15.555094242095947,3 +4190,0.10320757329463959,0.1077236533164978,0.10263452678918839,0.2893829941749573,908.8427124023438,1e-05,0.06151506304740906,5.688085079193115,15.555094242095947,3 +4191,0.09329989552497864,0.05181065574288368,0.05364157631993294,0.13681089878082275,442.5064697265625,1e-05,0.0656525045633316,5.6925270557403564,15.555094242095947,3 +4192,0.08306209743022919,0.07967250049114227,0.07603325694799423,0.2272435873746872,716.7235717773438,1e-05,0.07252147793769836,5.694604158401489,15.555094242095947,3 +4193,0.07297217100858688,0.09040230512619019,0.08869556337594986,0.258124977350235,899.6636962890625,1e-05,0.06910340487957001,5.6866796016693115,15.555094242095947,3 +4194,0.12897582352161407,0.09488533437252045,0.08868230134248734,0.1771714687347412,927.5025634765625,1e-05,0.060932911932468414,5.693735122680664,15.555094242095947,3 +4195,0.07878153026103973,0.07393801212310791,0.06852605938911438,0.26771634817123413,745.1535034179688,1e-05,0.06721634417772293,5.694073438644409,15.555094242095947,3 +4196,0.07836246490478516,0.03573083505034447,0.03654332458972931,0.08655448257923126,885.3558349609375,1e-05,0.09108792990446091,5.6968982219696045,15.555094242095947,3 +4197,0.06720450520515442,0.1187506914138794,0.11066267639398575,0.3027483820915222,965.9091796875,1e-05,0.054053645581007004,5.692380428314209,15.555094242095947,3 +4198,0.09231732785701752,0.09837466478347778,0.10642952471971512,0.24415864050388336,308.7349548339844,1e-05,0.07010447978973389,5.884215354919434,15.555094242095947,3 +4199,0.07758398354053497,0.04403369873762131,0.04954881593585014,0.18667466938495636,575.0540771484375,1e-05,0.09762436151504517,5.705206394195557,15.555094242095947,3 +4200,0.05621003359556198,0.04797843098640442,0.05221031606197357,0.1313782036304474,977.787353515625,1e-05,0.07249224931001663,6.055161476135254,15.555094242095947,3 +4201,0.0865568220615387,0.8477975726127625,0.8843241333961487,0.2474999874830246,9.920635223388672,1e-05,0.08348686248064041,5.695594787597656,15.555094242095947,3 +4202,0.05844338610768318,0.06649064272642136,0.06577198952436447,0.2519390881061554,814.7632446289062,1e-05,0.07103520631790161,5.696624040603638,15.555094242095947,3 +4203,0.06227418780326843,0.0793679878115654,0.07731962203979492,0.19641825556755066,832.2192993164062,1e-05,0.05432967469096184,5.914448976516724,15.555094242095947,3 +4204,0.094504714012146,0.15558424592018127,0.1521446257829666,0.23092947900295258,988.4937133789062,1e-05,0.07567525655031204,5.68420672416687,15.555094242095947,3 +4205,0.056422747671604156,0.12127172201871872,0.11900965869426727,0.1673557609319687,994.2716674804688,1e-05,0.07391253858804703,5.685885667800903,15.555094242095947,3 +4206,0.11102748662233353,0.06083434820175171,0.05881384387612343,0.13385416567325592,608.3162231445312,1e-05,0.07793902605772018,5.681908130645752,15.555094242095947,3 +4207,0.07399188727140427,0.08174615353345871,0.08510340750217438,0.148541659116745,987.3948974609375,1e-05,0.052307892590761185,5.69343638420105,15.555094242095947,3 +4208,0.0935354083776474,0.19189468026161194,0.18029135465621948,0.2580128014087677,999.7998046875,1e-05,0.08792992681264877,5.682202577590942,15.555094242095947,3 +4209,0.05637524276971817,0.07686550915241241,0.06906361132860184,0.30233171582221985,750.0000610351562,1e-05,0.07297306507825851,5.733354091644287,15.555094242095947,3 +4210,0.0837840586900711,0.09250672161579132,0.08533686399459839,0.16979967057704926,938.1237182617188,1e-05,0.07069525122642517,5.804142475128174,15.555094242095947,3 +4211,0.08639894425868988,0.0681966245174408,0.06456174701452255,0.2033172994852066,869.3666381835938,1e-05,0.06015510484576225,5.6867992877960205,15.555094242095947,3 +4212,0.13550838828086853,0.10659222304821014,0.10228181630373001,0.17696313560009003,778.6576538085938,1e-05,0.10365980118513107,5.692854881286621,15.555094242095947,3 +4213,0.08254622668027878,0.07129599153995514,0.07326213270425797,0.07383012771606445,993.4319458007812,1e-05,0.08521682024002075,5.685204029083252,15.555094242095947,3 +4214,0.08031708747148514,0.16094258427619934,0.15479253232479095,0.28688299655914307,964.61181640625,1e-05,0.07504529505968094,5.735339641571045,15.555094242095947,3 +4215,0.041052091866731644,0.07497943937778473,0.07190804183483124,0.1479567289352417,842.0365600585938,1e-05,0.06904344260692596,5.68550705909729,15.555094242095947,3 +4216,0.10412507504224777,0.08746371418237686,0.08505816012620926,0.18299679458141327,801.64990234375,1e-05,0.09098520129919052,5.685296297073364,15.555094242095947,3 +4217,0.09891917556524277,0.2338152825832367,0.23126310110092163,0.27948716282844543,125.89928436279297,1e-05,0.09263701736927032,5.692160367965698,15.555094242095947,3 +4218,0.1287829875946045,0.23738516867160797,0.22580528259277344,0.23986376821994781,157.3426513671875,1e-05,0.06567026674747467,5.67714262008667,15.555094242095947,3 +4219,0.09777748584747314,0.06725732982158661,0.06125031039118767,0.19254806637763977,855.9268798828125,1e-05,0.059757597744464874,5.9101197719573975,15.555094242095947,3 +4220,0.08040162175893784,0.10931091755628586,0.10729146003723145,0.2808894217014313,333.5777282714844,1e-05,0.07473140209913254,5.6942737102508545,15.555094242095947,3 +4221,0.11809374392032623,0.05769283324480057,0.05571905896067619,0.2225160151720047,791.1160888671875,1e-05,0.09505078941583633,5.71208643913269,15.555094242095947,3 +4222,0.0724426880478859,0.22133062779903412,0.18895764648914337,0.2045672982931137,996.3473510742188,1e-05,0.06212516129016876,5.689837217330933,15.555094242095947,3 +4223,0.11049378663301468,0.12066555768251419,0.10843676328659058,0.2554967999458313,994.6895141601562,1e-05,0.12006710469722748,5.689055681228638,15.555094242095947,3 +4224,0.07704953849315643,0.06776823848485947,0.06183581054210663,0.2946794629096985,786.3502197265625,1e-05,0.09473918378353119,5.686370849609375,15.555094242095947,3 +4225,0.07576466351747513,0.0602802149951458,0.05978313460946083,0.28418266773223877,780.0751953125,1e-05,0.06123867630958557,5.686909198760986,15.555094242095947,3 +4226,0.07836160063743591,0.31111207604408264,0.32302507758140564,0.19374999403953552,141.84397888183594,1e-05,0.05491986125707626,5.680238246917725,15.555094242095947,3 +4227,0.06150328740477562,0.21604499220848083,0.2027776837348938,0.24098557233810425,994.89794921875,1e-05,0.0723627507686615,5.693827390670776,15.555094242095947,3 +4228,0.07646878808736801,0.08616120368242264,0.07883300632238388,0.294286847114563,864.197509765625,1e-05,0.09638414531946182,5.6870667934417725,15.555094242095947,3 +4229,0.0906631126999855,0.07275431603193283,0.0696512758731842,0.17453524470329285,895.6915893554688,1e-05,0.05746598169207573,5.786240339279175,15.555094242095947,3 +4230,0.12481149286031723,0.09124528616666794,0.08559530973434448,0.20333333313465118,854.930419921875,1e-05,0.09115200489759445,5.727001905441284,15.555094242095947,3 +4231,0.10123224556446075,0.07181812077760696,0.0712345689535141,0.24322114884853363,570.6521606445312,1e-05,0.13072583079338074,5.69574761390686,15.555094242095947,3 +4232,0.118422731757164,0.1244816929101944,0.13154882192611694,0.08893429487943649,267.29559326171875,1e-05,0.06024366244673729,5.761073112487793,15.555094242095947,3 +4233,0.1081109419465065,0.09002870321273804,0.08957482129335403,0.1785416603088379,583.6886596679688,1e-05,0.07754641771316528,5.676580429077148,15.555094242095947,3 +4234,0.07817794382572174,0.06964506953954697,0.06564614921808243,0.2218509465456009,960.1112060546875,1e-05,0.10275299847126007,5.712179183959961,15.555094242095947,3 +4235,0.05318005010485649,0.11800293624401093,0.11890304088592529,0.07463140785694122,983.5890502929688,1e-05,0.0752231776714325,5.708975315093994,15.555094242095947,3 +4236,0.10337931662797928,0.06948087364435196,0.0695599913597107,0.3074919879436493,749.19873046875,1e-05,0.06962279975414276,5.705179214477539,15.555094242095947,3 +4237,0.06935620307922363,0.024203414097428322,0.024450596421957016,0.010576922446489334,597.59912109375,1e-05,0.09101651608943939,5.70381236076355,15.555094242095947,3 +4238,0.054386310279369354,0.08367376774549484,0.07391895353794098,0.22758813202381134,847.2938232421875,1e-05,0.07509502023458481,5.708294868469238,15.555094242095947,3 +4239,0.10814060270786285,0.07427705079317093,0.07592847943305969,0.14220352470874786,965.6505737304688,1e-05,0.06742335855960846,6.045058488845825,15.555094242095947,3 +4240,0.06771697103977203,0.19985657930374146,0.1995578110218048,0.2955528795719147,172.413818359375,1e-05,0.08466588705778122,5.914158344268799,15.555094242095947,3 +4241,0.09228865802288055,0.14859887957572937,0.13858994841575623,0.28044870495796204,352.0115051269531,1e-05,0.05791888386011124,5.686068534851074,15.555094242095947,3 +4242,0.09729335457086563,0.1349828839302063,0.12481684982776642,0.23127402365207672,947.1898803710938,1e-05,0.07009274512529373,5.683477878570557,15.555094242095947,3 +4243,0.08380776643753052,0.11675252765417099,0.11116963624954224,0.24696312844753265,583.6886596679688,1e-05,0.07908782362937927,5.693309545516968,15.555094242095947,3 +4244,0.049042943865060806,0.06369300931692123,0.06456699222326279,0.16274839639663696,884.5029296875,1e-05,0.04523368924856186,5.688263177871704,15.555094242095947,3 +4245,0.10149288922548294,0.09050236642360687,0.08495762944221497,0.22321313619613647,912.162109375,1e-05,0.060327231884002686,5.686133623123169,15.555094242095947,3 +4246,0.08681806176900864,0.145875483751297,0.14856992661952972,0.19084934890270233,954.3519897460938,1e-05,0.06309957057237625,5.690324783325195,15.555094242095947,3 +4247,0.06623945385217667,0.07191881537437439,0.07125682383775711,0.1520112156867981,921.7437133789062,1e-05,0.07210599631071091,5.69509220123291,15.555094242095947,3 +4248,0.06188581883907318,0.05105651915073395,0.0490620918571949,0.25746792554855347,647.8805541992188,1e-05,0.0536012165248394,5.682523727416992,15.555094242095947,3 +4249,0.04961160570383072,0.05864884331822395,0.0583309642970562,0.2906089723110199,900.4474487304688,1e-05,0.07184518873691559,5.691024541854858,15.555094242095947,3 +4250,0.09829077124595642,0.07264988869428635,0.06585601717233658,0.13067306578159332,923.458740234375,1e-05,0.0684221088886261,5.743483066558838,15.555094242095947,3 +4251,0.09385544806718826,0.028526300564408302,0.030780106782913208,0.16905447840690613,898.4814453125,1e-05,0.07521171867847443,5.695874929428101,15.555094242095947,3 +4252,0.05915587767958641,0.11988994479179382,0.11291158944368362,0.3010095953941345,912.8910522460938,1e-05,0.07155290991067886,5.695460796356201,15.555094242095947,3 +4253,0.07895444333553314,0.21811474859714508,0.217567577958107,0.1758333295583725,201.34228515625,1e-05,0.05766341835260391,5.693000078201294,15.555094242095947,3 +4254,0.0826524943113327,0.059118181467056274,0.05609195679426193,0.20104967057704926,770.7055053710938,1e-05,0.09430316835641861,5.690519571304321,15.555094242095947,3 +4255,0.08373323827981949,0.20688776671886444,0.1974710375070572,0.2673797905445099,976.3572998046875,1e-05,0.06642204523086548,5.696118116378784,15.555094242095947,3 +4256,0.05967196449637413,0.07123717665672302,0.06596972048282623,0.24111376702785492,749.19873046875,1e-05,0.05779673904180527,5.692923307418823,15.555094242095947,3 +4257,0.06482978910207748,0.0401921421289444,0.04074063524603844,0.14542467892169952,692.9590454101562,1e-05,0.08498725295066833,5.702177286148071,15.555094242095947,3 +4258,0.11885960400104523,0.0888974517583847,0.0813671350479126,0.23753204941749573,577.95703125,1e-05,0.07784945517778397,5.702508926391602,15.555094242095947,3 +4259,0.06282884627580643,0.08061930537223816,0.07988407462835312,0.21524037420749664,529.9539794921875,1e-05,0.06331390887498856,5.701962471008301,15.555094242095947,3 +4260,0.08880405873060226,0.08325240015983582,0.07832615077495575,0.2796955108642578,835.5437622070312,1e-05,0.07830732315778732,5.688869953155518,15.555094242095947,3 +4261,0.1111745834350586,0.12333057075738907,0.12674087285995483,0.20745190978050232,918.259033203125,1e-05,0.06562423706054688,6.136077642440796,15.555094242095947,3 +4262,0.07627452164888382,0.07295610010623932,0.06878383457660675,0.26520833373069763,918.9618530273438,1e-05,0.05828256532549858,5.692492246627808,15.555094242095947,3 +4263,0.10057827085256577,0.06696393340826035,0.06579294800758362,0.2516586482524872,862.7633056640625,1e-05,0.06297291815280914,5.678115367889404,15.555094242095947,3 +4264,0.08642701059579849,0.07103487104177475,0.06565533578395844,0.21543268859386444,830.5369873046875,1e-05,0.05327434465289116,5.699634313583374,15.555094242095947,3 +4265,0.10490591824054718,0.0771355852484703,0.0732356533408165,0.18228363990783691,645.55126953125,1e-05,0.05281859636306763,5.6893393993377686,15.555094242095947,3 +4266,0.09158224612474442,0.07585605978965759,0.07236349582672119,0.17905448377132416,980.37109375,1e-05,0.053186312317848206,5.700803756713867,15.555094242095947,3 +4267,0.08161462098360062,0.05681218206882477,0.05416983366012573,0.16884614527225494,650.1919555664062,1e-05,0.07144449651241302,5.688820123672485,15.555094242095947,3 +4268,0.0963272899389267,0.08746175467967987,0.07911781966686249,0.19872595369815826,904.3141479492188,1e-05,0.05282144248485565,5.694288015365601,15.555094242095947,3 +4269,0.09873701632022858,0.07967907935380936,0.07785218209028244,0.07084935903549194,937.8121948242188,1e-05,0.051149189472198486,5.685196161270142,15.555094242095947,3 +4270,0.08980308473110199,0.06598662585020065,0.06343047320842743,0.20638620853424072,664.7939453125,1e-05,0.05874290317296982,5.688478231430054,15.555094242095947,3 +4271,0.08621340990066528,0.09446955472230911,0.09389422833919525,0.2521233856678009,509.47869873046875,1e-05,0.05804026126861572,5.6840856075286865,15.555094242095947,3 +4272,0.05480251833796501,0.1385137140750885,0.12208004295825958,0.23955929279327393,954.9102783203125,1e-05,0.06785041093826294,5.695364952087402,15.555094242095947,3 +4273,0.08642279356718063,0.08090236037969589,0.07335851341485977,0.2726842761039734,829.9730834960938,1e-05,0.07901997864246368,5.68999719619751,15.555094242095947,3 +4274,0.10425280779600143,0.1287006288766861,0.11760831624269485,0.2847195267677307,594.86376953125,1e-05,0.06176832318305969,5.688106536865234,15.555094242095947,3 +4275,0.07686891406774521,0.11590851098299026,0.11864317208528519,0.20142626762390137,962.511474609375,1e-05,0.07200772315263748,5.828052759170532,15.555094242095947,3 +4276,0.10089634358882904,0.08557184040546417,0.07959863543510437,0.2573156952857971,665.8878784179688,1e-05,0.06758590787649155,5.690042972564697,15.555094242095947,3 +4277,0.07439327239990234,0.08972257375717163,0.08308786153793335,0.2576362192630768,775.0761108398438,1e-05,0.07710642367601395,5.6885340213775635,15.555094242095947,3 +4278,0.12578000128269196,0.08136642724275589,0.07821546494960785,0.25824517011642456,699.823974609375,1e-05,0.06232307851314545,5.692188739776611,15.555094242095947,3 +4279,0.08131235092878342,0.07397917658090591,0.07373534142971039,0.19383813440799713,889.9769897460938,1e-05,0.05981259420514107,5.69633674621582,15.555094242095947,3 +4280,0.17914870381355286,0.10883951187133789,0.10462161153554916,0.2374679446220398,544.5823974609375,1e-05,0.06835471838712692,5.699229717254639,15.555094242095947,3 +4281,0.06012814864516258,0.10886881500482559,0.11020252853631973,0.23335736989974976,942.1181640625,1e-05,0.07171861827373505,5.691057920455933,15.555094242095947,3 +4282,0.0583944208920002,0.13866087794303894,0.13847830891609192,0.21320511400699615,974.1835327148438,1e-05,0.04536205902695656,5.943841934204102,15.555094242095947,3 +4283,0.08525097370147705,0.05570482090115547,0.05334028601646423,0.25602564215660095,544.5823974609375,1e-05,0.06874532252550125,5.696743011474609,15.555094242095947,3 +4284,0.07225949317216873,0.1538839042186737,0.14039631187915802,0.2359214723110199,981.9896850585938,1e-05,0.06920699775218964,5.683254241943359,15.555094242095947,3 +4285,0.09324731677770615,0.11509335041046143,0.11071527749300003,0.26202723383903503,446.65814208984375,1e-05,0.054437872022390366,5.683324337005615,15.555094242095947,3 +4286,0.06564239412546158,0.06707543879747391,0.06396235525608063,0.25871792435646057,877.9761962890625,1e-05,0.05750251188874245,5.691399097442627,15.555094242095947,3 +4287,0.06475009024143219,0.19454917311668396,0.1737545281648636,0.14436697959899902,990.232666015625,1e-05,0.07063968479633331,5.683907508850098,15.555094242095947,3 +4288,0.11635009199380875,0.09351647645235062,0.09738615900278091,0.17608171701431274,904.6961059570312,1e-05,0.06727774441242218,5.841254472732544,15.555094242095947,3 +4289,0.07297960668802261,0.1138736680150032,0.10764887183904648,0.2361217886209488,949.22998046875,1e-05,0.05918264016509056,5.69331169128418,15.555094242095947,3 +4290,0.092444509267807,0.061177682131528854,0.05844254791736603,0.29151442646980286,901.2276611328125,1e-05,0.05492535978555679,5.697209358215332,15.555094242095947,3 +4291,0.06995206326246262,0.07551103830337524,0.0750606507062912,0.21024839580059052,717.632080078125,1e-05,0.047068215906620026,5.6966564655303955,15.555094242095947,3 +4292,0.13330420851707458,0.08850573748350143,0.08821986615657806,0.236402228474617,521.561767578125,1e-05,0.09216036647558212,5.699693441390991,15.555094242095947,3 +4293,0.07864794135093689,0.606886088848114,0.603158175945282,0.26093748211860657,61.78706741333008,1e-05,0.05987559258937836,5.7173011302948,15.555094242095947,3 +4294,0.16434678435325623,0.09768608212471008,0.09396955370903015,0.25495994091033936,617.4088745117188,1e-05,0.08326513320207596,5.752185821533203,15.555094242095947,3 +4295,0.053700149059295654,0.1446329653263092,0.1312563121318817,0.25862979888916016,958.7605590820312,1e-05,0.06357191503047943,5.687572240829468,15.555094242095947,3 +4296,0.09454754739999771,0.08273938298225403,0.07819733023643494,0.1902083307504654,780.0751953125,1e-05,0.05159488320350647,5.687329053878784,15.555094242095947,3 +4297,0.09503676742315292,0.12481636554002762,0.12039345502853394,0.08695512264966965,995.728271484375,1e-05,0.0694112628698349,5.701562166213989,15.555094242095947,3 +4298,0.071876659989357,0.05672423541545868,0.05684713274240494,0.20354966819286346,661.4877319335938,1e-05,0.0627928376197815,5.694053888320923,15.555094242095947,3 +4299,0.07545485347509384,0.04389975965023041,0.04101886972784996,0.24282851815223694,845.2072143554688,1e-05,0.04978679493069649,5.692426919937134,15.555094242095947,3 +4300,0.062229305505752563,0.08184204250574112,0.0758136734366417,0.1981249898672104,811.7109985351562,1e-05,0.046720512211322784,5.691022872924805,15.555094242095947,3 +4301,0.0768495723605156,0.06188839301466942,0.062136292457580566,0.19028043746948242,848.8447265625,1e-05,0.056169912219047546,5.685934782028198,15.555094242095947,3 +4302,0.04733355715870857,0.0592617392539978,0.05926836282014847,0.1953125,797.7569580078125,1e-05,0.056217536330223083,5.6971752643585205,15.555094242095947,3 +4303,0.09813001751899719,0.07571783661842346,0.07198002934455872,0.21814903616905212,887.0499877929688,1e-05,0.053259290754795074,5.684904098510742,15.555094242095947,3 +4304,0.08642520755529404,0.21967510879039764,0.23137935996055603,0.09122595936059952,141.84397888183594,1e-05,0.04579127952456474,5.686581134796143,15.555094242095947,3 +4305,0.07218408584594727,0.07701332122087479,0.07649808377027512,0.1854807585477829,937.1871948242188,1e-05,0.059049248695373535,5.685099363327026,15.555094242095947,3 +4306,0.09063988924026489,0.07856044173240662,0.07566249370574951,0.2008974254131317,806.7376098632812,1e-05,0.05396713316440582,5.719113826751709,15.555094242095947,3 +4307,0.06945937871932983,0.061889179050922394,0.06078347563743591,0.11138621717691422,736.8637084960938,1e-05,0.06004471704363823,5.711045980453491,15.555094242095947,3 +4308,0.1330472081899643,0.3572334349155426,0.3570268750190735,0.2322676181793213,109.48905944824219,1e-05,0.05568230524659157,5.703331470489502,15.555094242095947,3 +4309,0.11276809871196747,0.03210694342851639,0.03255010396242142,0.20656248927116394,735.1730346679688,1e-05,0.054441701620817184,5.704870223999023,15.555094242095947,3 +4310,0.09334509074687958,0.5877748727798462,0.630772054195404,0.2952083349227905,24.50980567932129,1e-05,0.050314903259277344,5.695990324020386,15.555094242095947,3 +4311,0.12595562636852264,0.05842209607362747,0.05288970097899437,0.21385416388511658,509.47869873046875,1e-05,0.06612162292003632,5.69305682182312,15.555094242095947,3 +4312,0.06717558950185776,0.09547189623117447,0.0904095470905304,0.2246474325656891,983.1340942382812,1e-05,0.05212470144033432,5.697168588638306,15.555094242095947,3 +4313,0.0545860193669796,0.05518148094415665,0.055124394595623016,0.2675400674343109,855.4293212890625,1e-05,0.18268489837646484,5.69035792350769,15.555094242095947,3 +4314,0.10681231319904327,0.08933273702859879,0.08467316627502441,0.20597755908966064,384.3490905761719,1e-05,0.06569412350654602,5.725647449493408,15.555094242095947,3 +4315,0.11890164017677307,0.12320344895124435,0.12104543298482895,0.2525961399078369,961.7158813476562,1e-05,0.08521144092082977,5.705777645111084,15.555094242095947,3 +4316,0.077020063996315,0.04619786888360977,0.04657075181603432,0.09633012115955353,877.0883178710938,1e-05,0.06136839836835861,5.695530891418457,15.555094242095947,3 +4317,0.08079372346401215,0.16351304948329926,0.16756698489189148,0.24862979352474213,232.08470153808594,1e-05,0.060084763914346695,5.925570726394653,15.555094242095947,3 +4318,0.11386162042617798,0.15911558270454407,0.15725278854370117,0.22274838387966156,980.6033935546875,1e-05,0.06999056786298752,5.685572147369385,15.555094242095947,3 +4319,0.1126684844493866,0.1251961886882782,0.12010429054498672,0.27842146158218384,979.6713256835938,1e-05,0.06679896265268326,5.684324741363525,15.555094242095947,3 +4320,0.07143919914960861,0.03725627064704895,0.0384117066860199,0.20450319349765778,823.0874633789062,1e-05,0.10606539249420166,5.683879613876343,15.555094242095947,3 +4321,0.10060399770736694,0.09234167635440826,0.08374246209859848,0.2222195416688919,897.6888427734375,1e-05,0.05916597321629524,5.688067436218262,15.555094242095947,3 +4322,0.0606180876493454,0.04309767484664917,0.04128921777009964,0.17006409168243408,590.71728515625,1e-05,0.05299832299351692,5.69359564781189,15.555094242095947,3 +4323,0.1350693702697754,0.0924006924033165,0.09204570949077606,0.18376602232456207,434.0730895996094,1e-05,0.06400685757398605,5.684746742248535,15.555094242095947,3 +4324,0.03998931124806404,0.09842877089977264,0.09494542330503464,0.22622595727443695,971.4794311523438,1e-05,0.06703177839517593,5.6925132274627686,15.555094242095947,3 +4325,0.04232904314994812,0.047644324600696564,0.04618541896343231,0.20857371389865875,780.0751953125,1e-05,0.07634513080120087,6.040636301040649,15.555094242095947,3 +4326,0.0869860053062439,0.09207755327224731,0.08476776629686356,0.19335736334323883,961.7158813476562,1e-05,0.06881001591682434,5.690668821334839,15.555094242095947,3 +4327,0.09303540736436844,0.05799934267997742,0.05983800068497658,0.2311858832836151,609.6311645507812,1e-05,0.07012307643890381,5.6862006187438965,15.555094242095947,3 +4328,0.11785781383514404,0.32559600472450256,0.29668575525283813,0.24096953868865967,997.7804565429688,1e-05,0.06477847695350647,5.685651063919067,15.555094242095947,3 +4329,0.09592650085687637,0.08812529593706131,0.0819222554564476,0.16124999523162842,950.3834838867188,1e-05,0.06973439455032349,5.6823484897613525,15.555094242095947,3 +4330,0.08522394299507141,0.07090900093317032,0.06609054654836655,0.22953525185585022,870.7523803710938,1e-05,0.05225130170583725,5.69862174987793,15.555094242095947,3 +4331,0.10543173551559448,0.21548059582710266,0.19490043818950653,0.23391826450824738,999.5994262695312,1e-05,0.06594204902648926,5.688098669052124,15.555094242095947,3 +4332,0.10079609602689743,0.45544153451919556,0.45076513290405273,0.21568909287452698,61.78706741333008,1e-05,0.060825854539871216,5.6963114738464355,15.555094242095947,3 +4333,0.06791076809167862,0.21359771490097046,0.21381080150604248,0.19774839282035828,984.494384765625,1e-05,0.06241180747747421,5.686159372329712,15.555094242095947,3 +4334,0.10005912184715271,0.044790200889110565,0.05018067732453346,0.20666666328907013,865.1477661132812,1e-05,0.06496832519769669,5.692634344100952,15.555094242095947,3 +4335,0.04886065796017647,0.11509279906749725,0.10758686810731888,0.20742787420749664,915.4175415039062,1e-05,0.07179048657417297,5.941471815109253,15.555094242095947,3 +4336,0.07492630183696747,0.1845182627439499,0.18866240978240967,0.1824038326740265,993.2210693359375,1e-05,0.051979951560497284,5.698309421539307,15.555094242095947,3 +4337,0.08359318226575851,0.09958089143037796,0.09573417156934738,0.2653205096721649,495.1690979003906,1e-05,0.05376795679330826,5.686877250671387,15.555094242095947,3 +4338,0.08053869754076004,0.04661592096090317,0.04647841304540634,0.2472035139799118,797.1013793945312,1e-05,0.06603790074586868,5.683436393737793,15.555094242095947,3 +4339,0.08530179411172867,0.12654735147953033,0.11271117627620697,0.2293509542942047,947.1898803710938,1e-05,0.06101136654615402,5.697713613510132,15.555094242095947,3 +4340,0.08248424530029297,0.04489506781101227,0.05032860115170479,0.14242787659168243,965.6505737304688,1e-05,0.05024956166744232,5.695456027984619,15.555094242095947,3 +4341,0.05674111470580101,0.06337190419435501,0.06342066079378128,0.17985576391220093,660.3773803710938,1e-05,0.060197725892066956,5.6946330070495605,15.555094242095947,3 +4342,0.09995640069246292,0.35597163438796997,0.3522651791572571,0.23444710671901703,105.31136322021484,1e-05,0.07045109570026398,5.69558048248291,15.555094242095947,3 +4343,0.0678139254450798,0.09211836755275726,0.08628913760185242,0.20627403259277344,913.978515625,1e-05,0.06626003235578537,5.688711166381836,15.555094242095947,3 +4344,0.1179051324725151,0.09012728184461594,0.08243180811405182,0.20539261400699615,812.3250122070312,1e-05,0.07402021437883377,5.697907209396362,15.555094242095947,3 +4345,0.06948274374008179,0.14758792519569397,0.14067167043685913,0.26932692527770996,976.5967407226562,1e-05,0.061015691608190536,5.697643280029297,15.555094242095947,3 +4346,0.10361127555370331,0.09008009731769562,0.08594960719347,0.2007291615009308,894.8863525390625,1e-05,0.08236122876405716,5.811982154846191,15.555094242095947,3 +4347,0.08482202887535095,0.08697880804538727,0.08020336180925369,0.1723717898130417,963.5654907226562,1e-05,0.07923440635204315,5.691315650939941,15.555094242095947,3 +4348,0.07598286867141724,0.05541794374585152,0.054689034819602966,0.1847035139799118,910.6948852539062,1e-05,0.05583696439862251,5.699554204940796,15.555094242095947,3 +4349,0.07226663827896118,0.19005858898162842,0.17971213161945343,0.25447916984558105,994.6895141601562,1e-05,0.05794177204370499,5.691342353820801,15.555094242095947,3 +4350,0.14398987591266632,0.09261409193277359,0.09546550363302231,0.25399038195610046,349.42364501953125,1e-05,0.07250484824180603,5.6866536140441895,15.555094242095947,3 +4351,0.13024605810642242,0.11019478738307953,0.107286736369133,0.10971954464912415,612.2449340820312,1e-05,0.07742953300476074,5.908109188079834,15.555094242095947,3 +4352,0.06996667385101318,0.08074575662612915,0.07715500891208649,0.17092947661876678,750.7987060546875,1e-05,0.053181033581495285,5.698016405105591,15.555094242095947,3 +4353,0.07375077158212662,0.0936112329363823,0.08981429785490036,0.17887820303440094,934.3434448242188,1e-05,0.06610330194234848,5.68990421295166,15.555094242095947,3 +4354,0.12008412182331085,0.1076313704252243,0.1060316264629364,0.2335096001625061,476.4851989746094,1e-05,0.060373689979314804,5.69584846496582,15.555094242095947,3 +4355,0.07449514418840408,0.1466350257396698,0.13575498759746552,0.28600960969924927,964.872314453125,1e-05,0.05075293406844139,5.695226192474365,15.555094242095947,3 +4356,0.06445033103227615,0.08834229409694672,0.08161184191703796,0.24120190739631653,896.8926391601562,1e-05,0.06496786326169968,5.817079067230225,15.555094242095947,3 +4357,0.05334357172250748,0.03856867924332619,0.036556925624608994,0.1749679446220398,794.4606323242188,1e-05,0.05132046714425087,5.804616689682007,15.555094242095947,3 +4358,0.14889293909072876,0.095794677734375,0.09197273850440979,0.19687499105930328,425.4617614746094,1e-05,0.052213773131370544,5.685076475143433,15.555094242095947,3 +4359,0.06583432853221893,0.07981248199939728,0.07515273988246918,0.28565704822540283,636.0511474609375,1e-05,0.06027219817042351,5.683027744293213,15.555094242095947,3 +4360,0.0715886726975441,0.09396085143089294,0.08572147786617279,0.15371794998645782,951.5281982421875,1e-05,0.05545980855822563,5.728189706802368,15.555094242095947,3 +4361,0.07907005399465561,0.1202821359038353,0.13090334832668304,0.12001602351665497,995.3138427734375,1e-05,0.0515422523021698,5.690795183181763,15.555094242095947,3 +4362,0.08225826919078827,0.06628517806529999,0.06869085878133774,0.258493572473526,958.7605590820312,1e-05,0.058490026742219925,5.69329309463501,15.555094242095947,3 +4363,0.09467624127864838,0.09048810601234436,0.08872342854738235,0.20798876881599426,893.6715698242188,1e-05,0.05425231531262398,5.685739994049072,15.555094242095947,3 +4364,0.04922546073794365,0.11671650409698486,0.10058168321847916,0.21088139712810516,916.1324462890625,1e-05,0.06797865778207779,5.684115648269653,15.555094242095947,3 +4365,0.08506854623556137,0.17224426567554474,0.16544264554977417,0.20788460969924927,308.7349548339844,1e-05,0.05438854172825813,5.687902927398682,15.555094242095947,3 +4366,0.060922421514987946,0.10165906697511673,0.08827199786901474,0.23641826212406158,898.4814453125,1e-05,0.04716240242123604,5.682086229324341,15.555094242095947,3 +4367,0.09588446468114853,0.10995832830667496,0.10113891214132309,0.23975960910320282,929.8156127929688,1e-05,0.058545541018247604,5.870545387268066,15.555094242095947,3 +4368,0.11551690101623535,0.0642504170536995,0.06339635699987411,0.23626601696014404,600.3118286132812,1e-05,0.05688534304499626,5.684101581573486,15.555094242095947,3 +4369,0.1626230627298355,0.13100282847881317,0.13056589663028717,0.20759615302085876,279.50311279296875,1e-05,0.06166858971118927,5.687270402908325,15.555094242095947,3 +4370,0.10972912609577179,0.0958433449268341,0.0953521728515625,0.21767626702785492,563.1868286132812,1e-05,0.05483468249440193,5.694561719894409,15.555094242095947,3 +4371,0.0871705636382103,0.09303127974271774,0.088631272315979,0.20328524708747864,829.4078369140625,1e-05,0.06375161558389664,5.953595399856567,15.555094242095947,3 +4372,0.07688532024621964,0.05323168262839317,0.050874724984169006,0.2862820327281952,736.8637084960938,1e-05,0.050738099962472916,5.702600717544556,15.555094242095947,3 +4373,0.11897694319486618,0.09279744327068329,0.08146413415670395,0.30464741587638855,814.7632446289062,1e-05,0.06164577603340149,5.916168451309204,15.555094242095947,3 +4374,0.09152691811323166,0.06212136149406433,0.06180509552359581,0.2778765857219696,431.9371643066406,1e-05,0.05684356391429901,5.690369129180908,15.555094242095947,3 +4375,0.048190973699092865,0.07263980060815811,0.06428968906402588,0.25600960850715637,750.7987060546875,1e-05,0.05878133699297905,5.682158470153809,15.555094242095947,3 +4376,0.08109701424837112,0.06713411957025528,0.0675923302769661,0.1824759542942047,858.3959350585938,1e-05,0.04853328317403793,5.682188272476196,15.555094242095947,3 +4377,0.05754447355866432,0.24896641075611115,0.23533862829208374,0.28660255670547485,990.232666015625,1e-05,0.05383359268307686,5.689772129058838,15.555094242095947,3 +4378,0.06150660291314125,0.030257612466812134,0.02871965989470482,0.22976762056350708,651.3410034179688,1e-05,0.05998240411281586,5.690784692764282,15.555094242095947,3 +4379,0.09617675840854645,0.11580687761306763,0.11094973236322403,0.15550480782985687,929.8156127929688,1e-05,0.05721929669380188,5.851480484008789,15.555094242095947,3 +4380,0.0536472424864769,0.05895007401704788,0.06102089583873749,0.10977564007043839,935.2970581054688,1e-05,0.05601363629102707,5.677987575531006,15.555094242095947,3 +4381,0.06630539894104004,0.058932505548000336,0.05853245034813881,0.22361376881599426,606.9959106445312,1e-05,0.05190182849764824,5.690335035324097,15.555094242095947,3 +4382,0.09310560673475266,0.06263318657875061,0.059065837413072586,0.24512018263339996,859.375,1e-05,0.055391985923051834,5.689924716949463,15.555094242095947,3 +4383,0.06166858971118927,0.19222255051136017,0.18491357564926147,0.21638621389865875,984.7198486328125,1e-05,0.05644041299819946,5.688308477401733,15.555094242095947,3 +4384,0.09049092233181,0.10583534836769104,0.09935920685529709,0.17536857724189758,927.8350219726562,1e-05,0.06967224925756454,5.690735101699829,15.555094242095947,3 +4385,0.11312615126371384,0.07005496323108673,0.06560945510864258,0.24915865063667297,755.5379638671875,1e-05,0.06735283136367798,5.683542013168335,15.555094242095947,3 +4386,0.06232749670743942,0.06968135386705399,0.06283240020275116,0.1685897409915924,811.095458984375,1e-05,0.05359137803316116,5.692690849304199,15.555094242095947,3 +4387,0.06704214215278625,0.04764721915125847,0.05160229280591011,0.10801281780004501,982.9059448242188,1e-05,0.05819118767976761,5.694777011871338,15.555094242095947,3 +4388,0.08290921151638031,0.19519740343093872,0.19380377233028412,0.2366987019777298,989.3660888671875,1e-05,0.06145264580845833,5.785161018371582,15.555094242095947,3 +4389,0.10119376331567764,0.15621891617774963,0.14377343654632568,0.2000400573015213,953.2288818359375,1e-05,0.056737665086984634,5.69316291809082,15.555094242095947,3 +4390,0.07682273536920547,0.18329966068267822,0.15974631905555725,0.29835736751556396,977.07421875,1e-05,0.07247805595397949,5.74175238609314,15.555094242095947,3 +4391,0.09530576318502426,0.06684230268001556,0.06653548777103424,0.11812499910593033,986.2869873046875,1e-05,0.05348794907331467,5.688663721084595,15.555094242095947,3 +4392,0.03741064295172691,0.09387379884719849,0.08608350902795792,0.23991185426712036,851.403076171875,1e-05,0.05006108805537224,5.69487738609314,15.555094242095947,3 +4393,0.07005585730075836,0.03530334308743477,0.03682269901037216,0.08094550669193268,628.7276611328125,1e-05,0.060419220477342606,5.691387176513672,15.555094242095947,3 +4394,0.1246732547879219,0.04671449586749077,0.04907471314072609,0.24048076570034027,883.6459350585938,1e-05,0.07753396779298782,5.90981125831604,15.555094242095947,3 +4395,0.0532686822116375,0.08869253844022751,0.07969319820404053,0.24144229292869568,903.9313354492188,1e-05,0.054884202778339386,5.696152925491333,15.555094242095947,3 +4396,0.10340603440999985,0.1481432318687439,0.14274367690086365,0.2295592874288559,297.256103515625,1e-05,0.09058075398206711,5.6841206550598145,15.555094242095947,3 +4397,0.05561663582921028,0.11280404776334763,0.11370541900396347,0.1767067313194275,878.4185791015625,1e-05,0.0480031780898571,5.690125226974487,15.555094242095947,3 +4398,0.08837082982063293,0.08760537207126617,0.08153722435235977,0.21790865063667297,932.0956420898438,1e-05,0.0556047298014164,5.888352632522583,15.555094242095947,3 +4399,0.07897260785102844,0.0887320339679718,0.08697163313627243,0.17658653855323792,580.8350830078125,1e-05,0.05345103517174721,5.695473909378052,15.555094242095947,3 +4400,0.11375594884157181,0.6589879393577576,0.6667282581329346,0.19816505908966064,61.78706741333008,1e-05,0.062433622777462006,5.687252998352051,15.555094242095947,3 +4401,0.09850331395864487,0.09073032438755035,0.09008245170116425,0.12091345340013504,314.37127685546875,1e-05,0.05408237501978874,5.682258605957031,15.555094242095947,3 +4402,0.09864253550767899,0.07914719730615616,0.07312768697738647,0.2638140916824341,631.1881713867188,1e-05,0.06230743229389191,5.699144601821899,15.555094242095947,3 +4403,0.0762377381324768,0.04787678271532059,0.048201512545347214,0.136482372879982,765.50390625,1e-05,0.05413024500012398,5.682909965515137,15.555094242095947,3 +4404,0.08468736708164215,0.055371399968862534,0.04834417626261711,0.17908653616905212,906.9703979492188,1e-05,0.058511536568403244,5.691900253295898,15.555094242095947,3 +4405,0.0667557492852211,0.14084182679653168,0.1319108009338379,0.24959935247898102,966.1671142578125,1e-05,0.0665331706404686,5.68707799911499,15.555094242095947,3 +4406,0.08399654924869537,0.08450975269079208,0.08192473649978638,0.273749977350235,661.4877319335938,1e-05,0.06406252086162567,5.687363386154175,15.555094242095947,3 +4407,0.12890297174453735,0.08842266350984573,0.08602819591760635,0.19413460791110992,893.2648315429688,1e-05,0.0635683536529541,5.680739641189575,15.555094242095947,3 +4408,0.1024646908044815,0.04625018313527107,0.04416774585843086,0.17779646813869476,792.4597778320312,1e-05,0.061153843998909,5.687531232833862,15.555094242095947,3 +4409,0.1086001917719841,0.06683061271905899,0.0652633085846901,0.12583333253860474,930.7967529296875,1e-05,0.058760885149240494,5.689155101776123,15.555094242095947,3 +4410,0.09478067606687546,0.06094788387417793,0.05677984282374382,0.2579807639122009,788.4046630859375,1e-05,0.06393549591302872,5.68585205078125,15.555094242095947,3 +4411,0.09515503793954849,0.03542755916714668,0.037126000970602036,0.12579326331615448,888.3101196289062,1e-05,0.06593015044927597,5.6833508014678955,15.555094242095947,3 +4412,0.12006515264511108,0.09893859922885895,0.10187699645757675,0.20239582657814026,519.8598022460938,1e-05,0.058863457292318344,5.733175754547119,15.555094242095947,3 +4413,0.07736459374427795,0.22995994985103607,0.22980313003063202,0.22873397171497345,137.90036010742188,1e-05,0.051701176911592484,5.689209699630737,15.555094242095947,3 +4414,0.0933220386505127,0.20703640580177307,0.21226108074188232,0.1356169879436493,161.1498260498047,1e-05,0.06416644155979156,5.688082218170166,15.555094242095947,3 +4415,0.05797059088945389,0.12930788099765778,0.13058674335479736,0.2346714586019516,940.287353515625,1e-05,0.06320986896753311,5.682762145996094,15.555094242095947,3 +4416,0.07773629575967789,0.0688871219754219,0.06585292518138885,0.2549999952316284,604.3388061523438,1e-05,0.06579144299030304,5.691699028015137,15.555094242095947,3 +4417,0.14188966155052185,0.0773511528968811,0.08038115501403809,0.2242548018693924,676.6055297851562,1e-05,0.05462606996297836,5.693861484527588,15.555094242095947,3 +4418,0.11613429337739944,0.18976114690303802,0.17220014333724976,0.26733171939849854,984.7198486328125,1e-05,0.06086787208914757,5.683647155761719,15.555094242095947,3 +4419,0.1319391280412674,0.09737095236778259,0.09659827500581741,0.28418266773223877,421.0875244140625,1e-05,0.06824639439582825,5.687090873718262,15.555094242095947,3 +4420,0.10369114577770233,0.07899180054664612,0.0768931657075882,0.15166665613651276,865.6211547851562,1e-05,0.07842209935188293,5.895639181137085,15.555094242095947,3 +4421,0.06019272282719612,0.04721842706203461,0.04961628094315529,0.2333253175020218,872.5845947265625,1e-05,0.06921418011188507,5.700464487075806,15.555094242095947,3 +4422,0.0840630829334259,0.0806209146976471,0.0731314942240715,0.230705127120018,625.0,1e-05,0.06797455996274948,5.69317364692688,15.555094242095947,3 +4423,0.09559740126132965,0.05881229788064957,0.05990324914455414,0.17471954226493835,606.9959106445312,1e-05,0.06101863086223602,5.695215463638306,15.555094242095947,3 +4424,0.0902721956372261,0.07854750007390976,0.07560425996780396,0.20896634459495544,638.4540405273438,1e-05,0.06588195264339447,5.695851564407349,15.555094242095947,3 +4425,0.07542435824871063,0.11659448593854904,0.11325299739837646,0.167732372879982,965.6505737304688,1e-05,0.05080664902925491,5.703701496124268,15.555094242095947,3 +4426,0.11459170281887054,0.11716444790363312,0.11514453589916229,0.1363862156867981,282.50775146484375,1e-05,0.06961888819932938,5.694698333740234,15.555094242095947,3 +4427,0.1020270511507988,0.08018284291028976,0.07634823024272919,0.17512018978595734,496.98797607421875,1e-05,0.0749884769320488,5.681035041809082,15.555094242095947,3 +4428,0.0865374207496643,0.0973082184791565,0.1107221320271492,0.2209695428609848,993.8524169921875,1e-05,0.09647484123706818,5.690591812133789,15.555094242095947,3 +4429,0.09848099946975708,0.08027804642915726,0.07450217753648758,0.24254806339740753,957.9439697265625,1e-05,0.05503254756331444,5.684232950210571,15.555094242095947,3 +4430,0.08038758486509323,0.0815570056438446,0.08091206848621368,0.18252402544021606,679.7445678710938,1e-05,0.09681575000286102,5.683241844177246,15.555094242095947,3 +4431,0.06831907480955124,0.11287962645292282,0.1062166839838028,0.25247594714164734,981.5291137695312,1e-05,0.06453050673007965,5.9166295528411865,15.555094242095947,3 +4432,0.06610453128814697,0.09640365839004517,0.09121177345514297,0.2432532012462616,862.2828979492188,1e-05,0.06317034363746643,5.867230176925659,15.555094242095947,3 +4433,0.09197686612606049,0.059831660240888596,0.06013622507452965,0.12764422595500946,854.930419921875,1e-05,0.05620349571108818,5.702202081680298,15.555094242095947,3 +4434,0.05242711678147316,0.06945569068193436,0.06930890679359436,0.2405528724193573,784.2772827148438,1e-05,0.057057324796915054,5.700415134429932,15.555094242095947,3 +4435,0.1199200302362442,0.09852149337530136,0.09868030995130539,0.14947114884853363,618.6868286132812,1e-05,0.06435855478048325,5.697283506393433,15.555094242095947,3 +4436,0.13544511795043945,0.07226429134607315,0.07011645287275314,0.251153826713562,596.2343139648438,1e-05,0.07130075991153717,5.6898720264434814,15.555094242095947,3 +4437,0.08097172528505325,0.3849582374095917,0.2952478229999542,0.2397916615009308,994.4806518554688,1e-05,0.07160691916942596,5.726545810699463,15.555094242095947,3 +4438,0.09334273636341095,0.06340914964675903,0.062125783413648605,0.24900640547275543,902.7777709960938,1e-05,0.06831885874271393,5.6956541538238525,15.555094242095947,3 +4439,0.08346355706453323,0.10145166516304016,0.09427332133054733,0.24607370793819427,711.2069091796875,1e-05,0.08777035027742386,5.689987659454346,15.555094242095947,3 +4440,0.1268913447856903,0.1730733960866928,0.1736299693584442,0.09142627567052841,176.11683654785156,1e-05,0.0515299029648304,5.712714195251465,15.555094242095947,3 +4441,0.05743174999952316,0.06263583898544312,0.05721650272607803,0.23835736513137817,643.2039184570312,1e-05,0.0657293051481247,5.886314630508423,15.555094242095947,3 +4442,0.061690568923950195,0.08415165543556213,0.08319315314292908,0.09600160270929337,409.94622802734375,1e-05,0.055896878242492676,5.8116278648376465,15.555094242095947,3 +4443,0.05754648894071579,0.05052044615149498,0.05060700699687004,0.09937499463558197,677.6557006835938,1e-05,0.06044984608888626,5.679425239562988,15.555094242095947,3 +4444,0.08583949506282806,0.060852594673633575,0.058797433972358704,0.20426280796527863,872.5845947265625,1e-05,0.0525873601436615,5.863541126251221,15.555094242095947,3 +4445,0.08598993718624115,0.12424779683351517,0.12252827733755112,0.23936697840690613,980.6033935546875,1e-05,0.05772331357002258,5.701967239379883,15.555094242095947,3 +4446,0.07484639436006546,0.12107756733894348,0.11107693612575531,0.2912740409374237,958.2166748046875,1e-05,0.07127195596694946,5.696239948272705,15.555094242095947,3 +4447,0.08826053887605667,0.06181688606739044,0.06254275143146515,0.1960977464914322,679.7445678710938,1e-05,0.06336073577404022,5.704604864120483,15.555094242095947,3 +4448,0.04401472210884094,0.08043163269758224,0.07804203778505325,0.16331730782985687,873.947021484375,1e-05,0.06920496374368668,5.700415849685669,15.555094242095947,3 +4449,0.11379101127386093,0.14831437170505524,0.13408619165420532,0.24972756206989288,964.0897216796875,1e-05,0.059527963399887085,5.703393220901489,15.555094242095947,3 +4450,0.06616045534610748,0.09074029326438904,0.09051983058452606,0.15555287897586823,923.1171264648438,1e-05,0.06063716113567352,5.703768253326416,15.555094242095947,3 +4451,0.09466951340436935,0.0950813814997673,0.0860775038599968,0.24542467296123505,847.8120727539062,1e-05,0.07157591730356216,5.684247255325317,15.555094242095947,3 +4452,0.09418506920337677,0.10281441360712051,0.09765906631946564,0.24249999225139618,900.4474487304688,1e-05,0.053531888872385025,5.94674825668335,15.555094242095947,3 +4453,0.08135547488927841,0.05668257921934128,0.05468809977173805,0.2923397421836853,804.208251953125,1e-05,0.048131197690963745,5.701504468917847,15.555094242095947,3 +4454,0.103178471326828,0.3286167085170746,0.32728689908981323,0.24510416388511658,92.59259796142578,1e-05,0.058135028928518295,5.699744462966919,15.555094242095947,3 +4455,0.114161416888237,0.0605773851275444,0.058817487210035324,0.10798076540231705,512.9716796875,1e-05,0.056998152285814285,5.692712068557739,15.555094242095947,3 +4456,0.06923884153366089,0.05494534596800804,0.04984819144010544,0.257339745759964,734.3234252929688,1e-05,0.05836418271064758,5.699383020401001,15.555094242095947,3 +4457,0.11025826632976532,0.10017642378807068,0.09887830913066864,0.19284453988075256,743.5170288085938,1e-05,0.07582149654626846,5.7064080238342285,15.555094242095947,3 +4458,0.054669205099344254,0.08833764493465424,0.0817633643746376,0.20845352113246918,668.0632934570312,1e-05,0.07554881274700165,5.702134609222412,15.555094242095947,3 +4459,0.08977735042572021,0.16464127600193024,0.14819426834583282,0.2647515833377838,972.4690551757812,1e-05,0.061730679124593735,5.69352126121521,15.555094242095947,3 +4460,0.07855012267827988,0.0432024709880352,0.041363462805747986,0.1254006326198578,793.128662109375,1e-05,0.09697508811950684,5.692917585372925,15.555094242095947,3 +4461,0.08188898116350174,0.10967133194208145,0.10557746887207031,0.25652241706848145,941.5103759765625,1e-05,0.06617558002471924,5.698988199234009,15.555094242095947,3 +4462,0.07591596245765686,0.07461292296648026,0.06733589619398117,0.2108413428068161,834.44140625,1e-05,0.06139714643359184,5.699448108673096,15.555094242095947,3 +4463,0.05883951857686043,0.10743024945259094,0.09841236472129822,0.24994389712810516,942.4212036132812,1e-05,0.0718998834490776,5.694350004196167,15.555094242095947,3 +4464,0.09433910995721817,0.09494078904390335,0.08501587808132172,0.2604887783527374,868.4371337890625,1e-05,0.10469818860292435,5.69280743598938,15.555094242095947,3 +4465,0.08867812156677246,0.07992377132177353,0.07617058604955673,0.21051281690597534,890.8045654296875,1e-05,0.05872510373592377,5.695231199264526,15.555094242095947,3 +4466,0.11457416415214539,0.1967727243900299,0.20159310102462769,0.14153845608234406,161.1498260498047,1e-05,0.0626574382185936,5.689366817474365,15.555094242095947,3 +4467,0.10345234721899033,0.06130801886320114,0.06022730469703674,0.13308493793010712,809.2384033203125,1e-05,0.06243821978569031,5.688496351242065,15.555094242095947,3 +4468,0.08798284083604813,0.06730261445045471,0.06815750151872635,0.12166666239500046,770.7055053710938,1e-05,0.060223232954740524,5.687409400939941,15.555094242095947,3 +4469,0.04187566787004471,0.05779047682881355,0.051654152572155,0.23604966700077057,952.9466552734375,1e-05,0.057534847408533096,5.698090553283691,15.555094242095947,3 +4470,0.0797758400440216,0.06306567043066025,0.061134982854127884,0.24502402544021606,612.2449340820312,1e-05,0.060314424335956573,5.676558256149292,15.555094242095947,3 +4471,0.04521224647760391,0.03519967570900917,0.03392615541815758,0.2197115272283554,480.2955627441406,1e-05,0.05232854560017586,5.689083099365234,15.555094242095947,3 +4472,0.08561673760414124,0.06649405509233475,0.06502595543861389,0.20537659525871277,638.4540405273438,1e-05,0.0552171990275383,5.691068887710571,15.555094242095947,3 +4473,0.1060546264052391,0.059855371713638306,0.053430408239364624,0.19960735738277435,722.12841796875,1e-05,0.06432957947254181,5.946489572525024,15.555094242095947,3 +4474,0.08665605634450912,0.054691851139068604,0.054954055696725845,0.2585737109184265,791.1160888671875,1e-05,0.061097078025341034,5.6884074211120605,15.555094242095947,3 +4475,0.15253105759620667,0.16909681260585785,0.15893657505512238,0.23044069111347198,300.1519775390625,1e-05,0.07118719816207886,5.680984735488892,15.555094242095947,3 +4476,0.0942111685872078,0.1416558027267456,0.1353408545255661,0.17020031809806824,934.6619262695312,1e-05,0.056682150810956955,5.6864893436431885,15.555094242095947,3 +4477,0.06579989194869995,0.06429432332515717,0.06420144438743591,0.27475160360336304,954.9102783203125,1e-05,0.06640953570604324,5.692073583602905,15.555094242095947,3 +4478,0.1270434558391571,0.07994578778743744,0.08041772991418839,0.18685095012187958,448.71795654296875,1e-05,0.055785831063985825,5.69413685798645,15.555094242095947,3 +4479,0.0662153884768486,0.0758407786488533,0.06865395605564117,0.2158573567867279,900.0560302734375,1e-05,0.061705332249403,5.693311452865601,15.555094242095947,3 +4480,0.11485666781663895,0.061727702617645264,0.05948014557361603,0.25988781452178955,670.22265625,1e-05,0.04707496240735054,5.703843593597412,15.555094242095947,3 +4481,0.07362182438373566,0.09369584172964096,0.08467353880405426,0.22842146456241608,918.259033203125,1e-05,0.0545322448015213,6.866808652877808,15.555094242095947,3 +4482,0.05978497117757797,0.07397649437189102,0.06862807273864746,0.08677884191274643,937.5,1e-05,0.06337544322013855,5.689687967300415,15.555094242095947,3 +4483,0.07279795408248901,0.1257101595401764,0.11774379014968872,0.21236377954483032,856.9182739257812,1e-05,0.053645309060811996,5.915307283401489,15.555094242095947,3 +4484,0.07406268268823624,0.04873666539788246,0.05351101979613304,0.20258814096450806,905.8369750976562,1e-05,0.05752379447221756,5.795501232147217,15.555094242095947,3 +4485,0.10995647311210632,0.048914894461631775,0.04608311504125595,0.13719551265239716,776.5151977539062,1e-05,0.059970103204250336,5.690256595611572,15.555094242095947,3 +4486,0.07062782347202301,0.05222133547067642,0.05095186457037926,0.13461537659168243,580.8350830078125,1e-05,0.051565948873758316,5.680411100387573,15.555094242095947,3 +4487,0.11111725121736526,0.25373247265815735,0.24966242909431458,0.247411847114563,208.3333282470703,1e-05,0.04960146173834801,5.694674730300903,15.555094242095947,3 +4488,0.10774173587560654,0.10730744153261185,0.10523147881031036,0.23026441037654877,822.50341796875,1e-05,0.07479558140039444,5.690952301025391,15.555094242095947,3 +4489,0.09394144266843796,0.7648363709449768,0.8155535459518433,0.1216266006231308,14.822135925292969,1e-05,0.05447761341929436,5.6989099979400635,15.555094242095947,3 +4490,0.11728516966104507,0.08854697644710541,0.09024863690137863,0.14213140308856964,987.8356323242188,1e-05,0.08433929085731506,5.684086799621582,15.555094242095947,3 +4491,0.04655061662197113,0.04950375482439995,0.05183470621705055,0.2440384477376938,861.80126953125,1e-05,0.06177865341305733,5.691336393356323,15.555094242095947,3 +4492,0.08095978200435638,0.11354485899209976,0.11309255659580231,0.24850159883499146,452.8061218261719,1e-05,0.06228330731391907,5.69792914390564,15.555094242095947,3 +4493,0.05474396422505379,0.07700249552726746,0.0723779946565628,0.26517626643180847,898.4814453125,1e-05,0.05937658250331879,5.683328866958618,15.555094242095947,3 +4494,0.06788955628871918,0.06737977266311646,0.06741633266210556,0.2539342939853668,647.8805541992188,1e-05,0.058079805225133896,5.8898351192474365,15.555094242095947,3 +4495,0.13653193414211273,0.07466503232717514,0.0717092901468277,0.25427883863449097,967.4503784179688,1e-05,0.07068894803524017,5.684902906417847,15.555094242095947,3 +4496,0.06717214733362198,0.06100955232977867,0.06295646727085114,0.2597435712814331,594.86376953125,1e-05,0.05447208508849144,5.726202726364136,15.555094242095947,3 +4497,0.1231699213385582,0.08784998953342438,0.08476012945175171,0.2548317313194275,930.7967529296875,1e-05,0.059040967375040054,5.68725848197937,15.555094242095947,3 +4498,0.08255758136510849,0.057853616774082184,0.055695392191410065,0.15666666626930237,940.287353515625,1e-05,0.06344714760780334,5.68525242805481,15.555094242095947,3 +4499,0.06653984636068344,0.06942489743232727,0.06700475513935089,0.23923876881599426,516.4320068359375,1e-05,0.0716051235795021,5.691835880279541,15.555094242095947,3 +4500,0.12233186513185501,0.15720677375793457,0.14988583326339722,0.19360576570034027,994.0623168945312,1e-05,0.058429963886737823,5.686845541000366,15.555094242095947,3 +4501,0.07340876758098602,0.0899585485458374,0.08789799362421036,0.2323397397994995,752.3885498046875,1e-05,0.054895322769880295,5.806572675704956,15.555094242095947,3 +4502,0.03948262333869934,0.04612019285559654,0.045736636966466904,0.24632211029529572,806.7376098632812,1e-05,0.05400858074426651,5.7069079875946045,15.555094242095947,3 +4503,0.07938680052757263,0.025395721197128296,0.025015540421009064,0.1516105681657791,727.4247436523438,1e-05,0.04467473924160004,5.711113452911377,15.555094242095947,3 +4504,0.07160778343677521,0.5968490242958069,0.6065016388893127,0.1747596114873886,34.046695709228516,1e-05,0.06380550563335419,5.911609411239624,15.555094242095947,3 +4505,0.1267324835062027,0.08789266645908356,0.0822892114520073,0.15588942170143127,598.9583129882812,1e-05,0.05482051894068718,5.917956352233887,15.555094242095947,3 +4506,0.0883733481168747,0.06667806953191757,0.06803876906633377,0.2555849254131317,617.4088745117188,1e-05,0.08029695600271225,5.686252117156982,15.555094242095947,3 +4507,0.053841281682252884,0.08475365489721298,0.08613686263561249,0.20661857724189758,955.7438354492188,1e-05,0.057313233613967896,6.074046611785889,15.555094242095947,3 +4508,0.08956707268953323,0.12473148107528687,0.12559105455875397,0.20382210612297058,228.7581787109375,1e-05,0.06975877285003662,5.684171438217163,15.555094242095947,3 +4509,0.06281386315822601,0.07306070625782013,0.06690721958875656,0.2202964723110199,901.616455078125,1e-05,0.06401510536670685,5.686347007751465,15.555094242095947,3 +4510,0.06943725049495697,0.06346156448125839,0.06481315940618515,0.2250320464372635,886.2048950195312,1e-05,0.05429461970925331,5.687556982040405,15.555094242095947,3 +4511,0.08101010322570801,0.04496176168322563,0.04560193046927452,0.08869390934705734,903.5476684570312,1e-05,0.08587270975112915,5.6832170486450195,15.555094242095947,3 +4512,0.04530796781182289,0.09120992571115494,0.09094848483800888,0.1815144121646881,705.574951171875,1e-05,0.06149618327617645,5.686471700668335,15.555094242095947,3 +4513,0.07989314943552017,0.0607420988380909,0.0611380860209465,0.25690704584121704,896.8926391601562,1e-05,0.04944372922182083,5.681776285171509,15.555094242095947,3 +4514,0.09321548789739609,0.13416939973831177,0.12855273485183716,0.2075721025466919,882.3529052734375,1e-05,0.06493192911148071,5.688801288604736,15.555094242095947,3 +4515,0.11859060823917389,0.1366056203842163,0.1218138039112091,0.26405447721481323,938.4346313476562,1e-05,0.06951939314603806,5.682273864746094,15.555094242095947,3 +4516,0.08644330501556396,0.20314137637615204,0.18424630165100098,0.2541506290435791,990.6640014648438,1e-05,0.05290189012885094,5.683033227920532,15.555094242095947,3 +4517,0.0867014154791832,0.11554812639951706,0.1105719730257988,0.23692306876182556,976.8355712890625,1e-05,0.05574957653880119,5.68097186088562,15.555094242095947,3 +4518,0.1045573353767395,0.15227098762989044,0.14098598062992096,0.24282851815223694,973.4513549804688,1e-05,0.0688849538564682,5.897312641143799,15.555094242095947,3 +4519,0.07634418457746506,0.11999053508043289,0.11401133239269257,0.23377403616905212,991.7354736328125,1e-05,0.1333058625459671,5.681350946426392,15.555094242095947,3 +4520,0.07259251177310944,0.12167346477508545,0.10957841575145721,0.2456570416688919,920.358642578125,1e-05,0.05805441364645958,5.688265085220337,15.555094242095947,3 +4521,0.08300597965717316,0.06280987709760666,0.06372856348752975,0.20334935188293457,949.8078002929688,1e-05,0.07610778510570526,5.683129787445068,15.555094242095947,3 +4522,0.051925111562013626,0.12842702865600586,0.13099974393844604,0.157700315117836,991.9489135742188,1e-05,0.0750771015882492,5.823392391204834,15.555094242095947,3 +4523,0.0802922174334526,0.6399340033531189,0.635233461856842,0.21687498688697815,43.43629455566406,1e-05,0.06699038296937943,5.700544834136963,15.555094242095947,3 +4524,0.043709464371204376,0.15036381781101227,0.1489538997411728,0.2708573639392853,989.3660888671875,1e-05,0.056967686861753464,5.693103313446045,15.555094242095947,3 +4525,0.07005535811185837,0.12775054574012756,0.12077741324901581,0.23404645919799805,960.9158325195312,1e-05,0.08085937052965164,5.697611570358276,15.555094242095947,3 +4526,0.04914683848619461,0.09430480748414993,0.09465675801038742,0.23887819051742554,965.3915405273438,1e-05,0.06448753923177719,5.886133432388306,15.555094242095947,3 +4527,0.09360571950674057,0.1456788331270218,0.13488352298736572,0.2428765892982483,965.6505737304688,1e-05,0.061002910137176514,5.686132431030273,15.555094242095947,3 +4528,0.09921285510063171,0.13787394762039185,0.14345858991146088,0.20838941633701324,552.4553833007812,1e-05,0.05704716220498085,6.027102947235107,15.555094242095947,3 +4529,0.088353231549263,0.05475471913814545,0.04939388856291771,0.17338941991329193,923.458740234375,1e-05,0.06640425324440002,5.692364931106567,15.555094242095947,3 +4530,0.08440187573432922,0.08093173056840897,0.07715752720832825,0.18416665494441986,860.34912109375,1e-05,0.0527782179415226,5.684915065765381,15.555094242095947,3 +4531,0.07303030788898468,0.07624340802431107,0.08047693222761154,0.24705928564071655,980.37109375,1e-05,0.05770517885684967,5.678718328475952,15.555094242095947,3 +4532,0.11773756891489029,0.10682826489210129,0.09735949337482452,0.300352543592453,894.0774536132812,1e-05,0.04892207682132721,5.689038991928101,15.555094242095947,3 +4533,0.11818491667509079,0.06739381700754166,0.06538038700819016,0.25120192766189575,660.3773803710938,1e-05,0.06253410130739212,5.6888587474823,15.555094242095947,3 +4534,0.08765330165624619,0.076104536652565,0.07192101329565048,0.11658653616905212,935.9296264648438,1e-05,0.06742751598358154,5.68986439704895,15.555094242095947,3 +4535,0.1238064393401146,0.05520574748516083,0.05602581053972244,0.1587499976158142,905.8369750976562,1e-05,0.05772983655333519,5.687761545181274,15.555094242095947,3 +4536,0.08666941523551941,0.1814493089914322,0.17835791409015656,0.26903843879699707,208.3333282470703,1e-05,0.056067243218421936,5.815087556838989,15.555094242095947,3 +4537,0.0545327365398407,0.12147431075572968,0.11005745083093643,0.20608171820640564,993.4319458007812,1e-05,0.05714304372668266,5.688279151916504,15.555094242095947,3 +4538,0.08098118007183075,0.20994313061237335,0.21330787241458893,0.2456650584936142,168.68511962890625,1e-05,0.059628505259752274,5.735960245132446,15.555094242095947,3 +4539,0.07231253385543823,0.15315261483192444,0.14564330875873566,0.23641826212406158,979.4371948242188,1e-05,0.05257289111614227,5.692213535308838,15.555094242095947,3 +4540,0.09742407500743866,0.08439408242702484,0.08077722787857056,0.08692307025194168,843.0989990234375,1e-05,0.06786704063415527,5.6886560916900635,15.555094242095947,3 +4541,0.1303480863571167,0.06390704214572906,0.06060132756829262,0.21984775364398956,748.3948974609375,1e-05,0.06187325343489647,5.686196565628052,15.555094242095947,3 +4542,0.09628293663263321,0.11444377154111862,0.11067982017993927,0.2880047857761383,617.4088745117188,1e-05,0.06900083273649216,5.698003768920898,15.555094242095947,3 +4543,0.10241959989070892,0.02939525432884693,0.028657734394073486,0.27804484963417053,593.4874267578125,1e-05,0.046562109142541885,5.693423271179199,15.555094242095947,3 +4544,0.07227430492639542,0.0807003304362297,0.0720328688621521,0.24319711327552795,914.3394165039062,1e-05,0.08222301304340363,5.696171283721924,15.555094242095947,3 +4545,0.03796803206205368,0.06848784536123276,0.0665983110666275,0.29711538553237915,866.0933227539062,1e-05,0.053687743842601776,5.684972763061523,15.555094242095947,3 +4546,0.05720888078212738,0.05940615385770798,0.05937368422746658,0.2566586434841156,878.4185791015625,1e-05,0.06308358907699585,5.8929619789123535,15.555094242095947,3 +4547,0.08785209059715271,0.05673800781369209,0.055782485753297806,0.24338941276073456,862.7633056640625,1e-05,0.06954357773065567,5.9345457553863525,15.555094242095947,3 +4548,0.11969196051359177,0.13757717609405518,0.13078199326992035,0.2323397397994995,959.8422241210938,1e-05,0.059957824647426605,5.7421135902404785,15.555094242095947,3 +4549,0.05551009252667427,0.08017212897539139,0.08399508893489838,0.23580127954483032,905.0772094726562,1e-05,0.0572536438703537,5.703065633773804,15.555094242095947,3 +4550,0.04745753854513168,0.11864947527647018,0.12437596917152405,0.2063141018152237,896.0928344726562,1e-05,0.05239454284310341,5.69404411315918,15.555094242095947,3 +4551,0.1170293390750885,0.14801791310310364,0.14769433438777924,0.19228364527225494,462.8463439941406,1e-05,0.0738804042339325,5.694291353225708,15.555094242095947,3 +4552,0.09177399426698685,0.08526317030191422,0.08118323236703873,0.2636938989162445,507.7196960449219,1e-05,0.05708875134587288,5.703142166137695,15.555094242095947,3 +4553,0.10116102546453476,0.06758701801300049,0.06201496347784996,0.21559293568134308,845.7308959960938,1e-05,0.05057943984866142,5.6906445026397705,15.555094242095947,3 +4554,0.1095346063375473,0.08364487439393997,0.08285117894411087,0.2852964699268341,651.3410034179688,1e-05,0.058919508010149,5.699165105819702,15.555094242095947,3 +4555,0.06768637895584106,0.08766238391399384,0.08381165564060211,0.20702724158763885,942.7236938476562,1e-05,0.05796436965465546,5.690019130706787,15.555094242095947,3 +4556,0.11813749372959137,0.10413822531700134,0.09994454681873322,0.2065064013004303,947.775634765625,1e-05,0.059853773564100266,5.693752765655518,15.555094242095947,3 +4557,0.08995479345321655,0.5239049196243286,0.5254067778587341,0.10670672357082367,57.25191116333008,1e-05,0.0642898827791214,5.712834358215332,15.555094242095947,3 +4558,0.0867297351360321,0.18240728974342346,0.18098300695419312,0.2419070452451706,235.38963317871094,1e-05,0.06432770192623138,5.691805839538574,15.555094242095947,3 +4559,0.11524972319602966,0.25328147411346436,0.25787627696990967,0.26469549536705017,70.75472259521484,1e-05,0.05141965299844742,5.930710792541504,15.555094242095947,3 +4560,0.060150373727083206,0.17916378378868103,0.17552968859672546,0.2109294831752777,986.2869873046875,1e-05,0.06773509085178375,5.697782754898071,15.555094242095947,3 +4561,0.10800371319055557,0.095280222594738,0.0872512236237526,0.22313299775123596,590.71728515625,1e-05,0.058775439858436584,5.693122863769531,15.555094242095947,3 +4562,0.07635675370693207,0.04902539774775505,0.04944586753845215,0.24376600980758667,779.3674926757812,1e-05,0.04992321878671646,5.6956260204315186,15.555094242095947,3 +4563,0.08688919991254807,0.07765988260507584,0.07077308744192123,0.26056089997291565,730.0333251953125,1e-05,0.055216044187545776,5.902169227600098,15.555094242095947,3 +4564,0.12197142094373703,0.03858601301908493,0.03769722208380699,0.0859455093741417,700.7908935546875,1e-05,0.05565309152007103,5.685042381286621,15.555094242095947,3 +4565,0.07351119816303253,0.07192304730415344,0.06859113276004791,0.2038862109184265,744.3366088867188,1e-05,0.07002710551023483,5.677743911743164,15.555094242095947,3 +4566,0.04792407155036926,0.05801614746451378,0.05786104500293732,0.15478365123271942,936.8737182617188,1e-05,0.0708429291844368,5.685049295425415,15.555094242095947,3 +4567,0.1301659643650055,0.07274529337882996,0.07027127593755722,0.2097756266593933,625.0,1e-05,0.06859606504440308,5.68890643119812,15.555094242095947,3 +4568,0.06909748166799545,0.09753474593162537,0.08982528746128082,0.1269391030073166,960.6482543945312,1e-05,0.07373590022325516,5.686465501785278,15.555094242095947,3 +4569,0.08059537410736084,0.06687679141759872,0.06557256728410721,0.24733172357082367,873.947021484375,1e-05,0.058701369911432266,5.735575199127197,15.555094242095947,3 +4570,0.07322067022323608,0.09902115166187286,0.09132436662912369,0.2647596001625061,871.670654296875,1e-05,0.05192939192056656,5.6867430210113525,15.555094242095947,3 +4571,0.04036034643650055,0.16199670732021332,0.1567353904247284,0.2461458295583725,991.9489135742188,1e-05,0.05135573446750641,5.686078786849976,15.555094242095947,3 +4572,0.08693012595176697,0.0665026381611824,0.06022483482956886,0.18937499821186066,843.0989990234375,1e-05,0.06266919523477554,5.689007759094238,15.555094242095947,3 +4573,0.09690679609775543,0.06963834166526794,0.06648861616849899,0.18447114527225494,821.9178466796875,1e-05,0.05210333317518234,5.681118488311768,15.555094242095947,3 +4574,0.08203747123479843,0.05902096629142761,0.05616610497236252,0.14661858975887299,801.64990234375,1e-05,0.06197548657655716,5.683438301086426,15.555094242095947,3 +4575,0.11770516633987427,0.08100489526987076,0.07708264887332916,0.198581725358963,487.8049011230469,1e-05,0.05294490233063698,5.682801246643066,15.555094242095947,3 +4576,0.09878136217594147,0.0953596904873848,0.08900953829288483,0.23384614288806915,601.6597900390625,1e-05,0.07578019052743912,5.688099145889282,15.555094242095947,3 +4577,0.10712025314569473,0.034905608743429184,0.033385440707206726,0.15033653378486633,628.7276611328125,1e-05,0.053913578391075134,5.691681146621704,15.555094242095947,3 +4578,0.08863207697868347,0.07699394971132278,0.07024648040533066,0.16885416209697723,874.8499145507812,1e-05,0.05460293963551521,5.932667970657349,15.555094242095947,3 +4579,0.08208487182855606,0.09818848967552185,0.11065545678138733,0.19323717057704926,276.479736328125,1e-05,0.05495293065905571,5.709309816360474,15.555094242095947,3 +4580,0.05616944655776024,0.10587083548307419,0.09968776255846024,0.18112178146839142,855.4293212890625,1e-05,0.06394153833389282,5.738311767578125,15.555094242095947,3 +4581,0.05828700587153435,0.07979174703359604,0.07883305102586746,0.25237980484962463,918.9618530273438,1e-05,0.05143766105175018,5.687882900238037,15.555094242095947,3 +4582,0.058368019759655,0.08356522023677826,0.08260045200586319,0.20947115123271942,849.8719482421875,1e-05,0.04686981439590454,5.688239097595215,15.555094242095947,3 +4583,0.12391559779644012,0.0432598851621151,0.04395795240998268,0.19209934771060944,729.1666870117188,1e-05,0.054848380386829376,5.686884641647339,15.555094242095947,3 +4584,0.08500584214925766,0.10039480775594711,0.08704714477062225,0.22477562725543976,921.7437133789062,1e-05,0.07033924758434296,5.915034770965576,15.555094242095947,3 +4585,0.059656865894794464,0.06193220615386963,0.062124963849782944,0.2866506278514862,699.823974609375,1e-05,0.05574575439095497,5.687705993652344,15.555094242095947,3 +4586,0.07886799424886703,0.06540920585393906,0.061881594359874725,0.22518429160118103,597.59912109375,1e-05,0.06131191924214363,5.687451362609863,15.555094242095947,3 +4587,0.044083986431360245,0.13437098264694214,0.12622377276420593,0.20740383863449097,999.7998046875,1e-05,0.08330023288726807,5.686351537704468,15.555094242095947,3 +4588,0.08461956679821014,0.0874171257019043,0.0876540020108223,0.20532852411270142,354.58453369140625,1e-05,0.057777419686317444,5.6792967319488525,15.555094242095947,3 +4589,0.10630381107330322,0.058647461235523224,0.05861688777804375,0.20479966700077057,930.4703369140625,1e-05,0.07062721997499466,5.912887096405029,15.555094242095947,3 +4590,0.07636301219463348,0.1001492589712143,0.09673134237527847,0.2629967927932739,544.5823974609375,1e-05,0.08164259046316147,5.885519027709961,15.555094242095947,3 +4591,0.07070540636777878,0.05651849880814552,0.05568644404411316,0.24358972907066345,697.8798828125,1e-05,0.06424391269683838,5.760467529296875,15.555094242095947,3 +4592,0.0740019679069519,0.08301184326410294,0.08318427205085754,0.2255048006772995,714.8972778320312,1e-05,0.06826213002204895,5.907076358795166,15.555094242095947,3 +4593,0.15198136866092682,0.06934981048107147,0.06524593383073807,0.2453846037387848,865.1477661132812,1e-05,0.09181230515241623,5.6862359046936035,15.555094242095947,3 +4594,0.09603162109851837,0.10605663061141968,0.1040651723742485,0.25497594475746155,414.4384765625,1e-05,0.06509760022163391,5.679569959640503,15.555094242095947,3 +4595,0.1201653853058815,0.14334113895893097,0.132846862077713,0.2402644157409668,963.3027954101562,1e-05,0.0586811788380146,5.68508768081665,15.555094242095947,3 +4596,0.10840068757534027,0.01673983782529831,0.016829393804073334,0.16336537897586823,880.6146240234375,1e-05,0.06801935285329819,5.688152074813843,15.555094242095947,3 +4597,0.07844121009111404,0.07421291619539261,0.07495511323213577,0.2587820291519165,913.978515625,1e-05,0.06775903701782227,5.6843366622924805,15.555094242095947,3 +4598,0.11641231924295425,0.25761547684669495,0.25337713956832886,0.06628204882144928,149.64788818359375,1e-05,0.05722518637776375,5.689153671264648,15.555094242095947,3 +4599,0.08368343859910965,0.05251032114028931,0.05426204204559326,0.23442307114601135,895.6915893554688,1e-05,0.08263904601335526,5.6936869621276855,15.555094242095947,3 +4600,0.07405266910791397,0.21483361721038818,0.20437827706336975,0.2538782060146332,995.9349365234375,1e-05,0.06597190350294113,5.736112594604492,15.555094242095947,3 +4601,0.11300230771303177,0.14508885145187378,0.13800449669361115,0.23561698198318481,251.59742736816406,1e-05,0.06174907088279724,5.699167013168335,15.555094242095947,3 +4602,0.11247485131025314,0.15294364094734192,0.1548033207654953,0.1900079995393753,336.25732421875,1e-05,0.07108805328607559,5.745855093002319,15.555094242095947,3 +4603,0.057581719011068344,0.07945051044225693,0.0793043002486229,0.23955127596855164,925.1558837890625,1e-05,0.06387744843959808,5.698884725570679,15.555094242095947,3 +4604,0.04319506883621216,0.1498599350452423,0.14744673669338226,0.15955929458141327,957.9439697265625,1e-05,0.06528569012880325,5.690322637557983,15.555094242095947,3 +4605,0.09208524227142334,0.21060872077941895,0.2124408483505249,0.21618588268756866,172.413818359375,1e-05,0.07380323112010956,5.690302848815918,15.555094242095947,3 +4606,0.06359949707984924,0.05999518930912018,0.05765971168875694,0.23827724158763885,903.5476684570312,1e-05,0.0565163679420948,5.70068883895874,15.555094242095947,3 +4607,0.0648808628320694,0.08860374987125397,0.07770731300115585,0.2614903748035431,664.7939453125,1e-05,0.059453047811985016,5.698767900466919,15.555094242095947,3 +4608,0.09230444580316544,0.1206994280219078,0.1152426153421402,0.24805288016796112,583.6886596679688,1e-05,0.07802622765302658,5.683690786361694,15.555094242095947,3 +4609,0.040403805673122406,0.08496667444705963,0.08093108981847763,0.1327323615550995,902.0044555664062,1e-05,0.04947822540998459,5.702013254165649,15.555094242095947,3 +4610,0.06557457149028778,0.11137224733829498,0.10423660278320312,0.24564102292060852,964.3510131835938,1e-05,0.06514795124530792,5.690207004547119,15.555094242095947,3 +4611,0.07896027714014053,0.03068242222070694,0.03604404255747795,0.198685884475708,381.9444580078125,1e-05,0.06149214878678322,5.689657926559448,15.555094242095947,3 +4612,0.07348020374774933,0.05237169191241264,0.051966600120067596,0.29404646158218384,590.71728515625,1e-05,0.07757792621850967,5.764745235443115,15.555094242095947,3 +4613,0.09423384070396423,0.09740371257066727,0.0893092229962349,0.23559294641017914,852.9224853515625,1e-05,0.06489182263612747,5.678036212921143,15.555094242095947,3 +4614,0.08302575349807739,0.09474778175354004,0.0915708914399147,0.23856569826602936,448.71795654296875,1e-05,0.07841116935014725,5.703392505645752,15.555094242095947,3 +4615,0.06862472742795944,0.09758736938238144,0.08794322609901428,0.2719070315361023,913.2543334960938,1e-05,0.07418355345726013,5.699400186538696,15.555094242095947,3 +4616,0.08900290727615356,0.35553061962127686,0.3745325207710266,0.13402242958545685,70.75472259521484,1e-05,0.060822244733572006,5.72052264213562,15.555094242095947,3 +4617,0.06296080350875854,0.0844041258096695,0.08209438621997833,0.24804486334323883,389.1184997558594,1e-05,0.06480567157268524,5.694869041442871,15.555094242095947,3 +4618,0.09550604224205017,0.07200281322002411,0.06956075131893158,0.23290865123271942,920.0105590820312,1e-05,0.05692380666732788,5.692375421524048,15.555094242095947,3 +4619,0.0980043113231659,0.09169673174619675,0.09591049700975418,0.24292467534542084,444.587646484375,1e-05,0.08379034698009491,5.69843316078186,15.555094242095947,3 +4620,0.09434210509061813,0.0804751068353653,0.07337801158428192,0.23935095965862274,748.3948974609375,1e-05,0.05715775862336159,5.693398475646973,15.555094242095947,3 +4621,0.1236133724451065,0.08704553544521332,0.08643361926078796,0.23249998688697815,744.3366088867188,1e-05,0.07028094679117203,5.691919565200806,15.555094242095947,3 +4622,0.061718180775642395,0.08886881172657013,0.08256582170724869,0.19479967653751373,731.7578735351562,1e-05,0.08281363546848297,5.693801403045654,15.555094242095947,3 +4623,0.1339910626411438,0.045800529420375824,0.046791814267635345,0.18589742481708527,706.521728515625,1e-05,0.0789332240819931,5.736938714981079,15.555094242095947,3 +4624,0.10061109066009521,0.047877173870801926,0.04606553912162781,0.22546473145484924,851.9107666015625,1e-05,0.06985537707805634,5.687666654586792,15.555094242095947,3 +4625,0.06723301112651825,0.0986451655626297,0.09507139772176743,0.23915062844753265,986.50927734375,1e-05,0.0601927824318409,5.682313680648804,15.555094242095947,3 +4626,0.10543914884328842,0.04982994496822357,0.04645974189043045,0.199559286236763,746.7793579101562,1e-05,0.06645126640796661,5.6927549839019775,15.555094242095947,3 +4627,0.10036177188158035,0.10145291686058044,0.11095430701971054,0.23338140547275543,997.5768432617188,1e-05,0.08276882767677307,5.685834646224976,15.555094242095947,3 +4628,0.09233901649713516,0.05804090201854706,0.06136603280901909,0.20499198138713837,928.1668090820312,1e-05,0.05441591888666153,5.69417667388916,15.555094242095947,3 +4629,0.12119196355342865,0.12839114665985107,0.12393026798963547,0.32024839520454407,653.6259765625,1e-05,0.06775582581758499,5.694917440414429,15.555094242095947,3 +4630,0.06377676129341125,0.04186470806598663,0.04227535054087639,0.2444230616092682,557.0953369140625,1e-05,0.06321104615926743,5.8135035037994385,15.555094242095947,3 +4631,0.07915934175252914,0.10506853461265564,0.09982213377952576,0.18506409227848053,982.2193603515625,1e-05,0.057428788393735886,5.697554349899292,15.555094242095947,3 +4632,0.0829254761338234,0.11556816846132278,0.10677672922611237,0.17879806458950043,868.9024658203125,1e-05,0.06607283651828766,5.694278955459595,15.555094242095947,3 +4633,0.06807351112365723,0.10109593719244003,0.09574054181575775,0.21232371032238007,957.1228637695312,1e-05,0.06526258587837219,5.764664173126221,15.555094242095947,4 +4634,0.12398114055395126,0.07609386742115021,0.07583814859390259,0.22564902901649475,626.2474975585938,1e-05,0.07043849676847458,5.689610958099365,15.555094242095947,4 +4635,0.05152922496199608,0.052021872252225876,0.05348648130893707,0.16669870913028717,901.616455078125,1e-05,0.05824890360236168,5.681606292724609,15.555094242095947,4 +4636,0.06873052567243576,0.057123567909002304,0.05645294860005379,0.25447115302085876,817.7731323242188,1e-05,0.07774220407009125,5.691756248474121,15.555094242095947,4 +4637,0.09449615329504013,0.03009934350848198,0.03307805955410004,0.11893428862094879,917.5531616210938,1e-05,0.06351859122514725,5.69181489944458,15.555094242095947,4 +4638,0.0688309296965599,0.08241426944732666,0.08309391885995865,0.12708333134651184,464.8240966796875,1e-05,0.040088146924972534,5.690096616744995,15.555094242095947,4 +4639,0.1061779335141182,0.06236257776618004,0.062456678599119186,0.2148958295583725,605.6701049804688,1e-05,0.0769563764333725,5.6880943775177,15.555094242095947,4 +4640,0.06003682687878609,0.1846778839826584,0.1786291003227234,0.20540864765644073,994.6895141601562,1e-05,0.06367792189121246,5.683594226837158,15.555094242095947,4 +4641,0.10206340998411179,0.1906033754348755,0.1810242384672165,0.21883012354373932,980.6033935546875,1e-05,0.056968845427036285,5.683475494384766,15.555094242095947,4 +4642,0.06922590732574463,0.06079721450805664,0.059292521327733994,0.1266506314277649,888.7283325195312,1e-05,0.07452645152807236,5.692027807235718,15.555094242095947,4 +4643,0.05089898779988289,0.10894517600536346,0.10140067338943481,0.22095352411270142,963.8278198242188,1e-05,0.06656796485185623,5.691221475601196,15.555094242095947,4 +4644,0.06205257028341293,0.0581626296043396,0.05585295706987381,0.2174919843673706,514.7058715820312,1e-05,0.05884569138288498,5.7874956130981445,15.555094242095947,4 +4645,0.0858011543750763,0.06102844327688217,0.05963599309325218,0.2707692086696625,892.8571166992188,1e-05,0.09564990550279617,5.6861724853515625,15.555094242095947,4 +4646,0.08933787792921066,0.12208554893732071,0.10781753063201904,0.22729165852069855,933.3839721679688,1e-05,0.0567207969725132,5.684934139251709,15.555094242095947,4 +4647,0.10149405896663666,0.042867641896009445,0.04332584887742996,0.17085736989974976,661.4877319335938,1e-05,0.07303684204816818,5.6898720264434814,15.555094242095947,4 +4648,0.10041719675064087,0.05145533010363579,0.051892250776290894,0.19894230365753174,963.5654907226562,1e-05,0.06428558379411697,5.693361043930054,15.555094242095947,4 +4649,0.1057433933019638,0.1364700347185135,0.1332341432571411,0.28437498211860657,349.42364501953125,1e-05,0.06041795387864113,5.690641641616821,15.555094242095947,4 +4650,0.09211596846580505,0.03986924886703491,0.043147094547748566,0.2667067348957062,708.4055786132812,1e-05,0.057682108134031296,5.685391902923584,15.555094242095947,4 +4651,0.07453393936157227,0.0784521996974945,0.08034315705299377,0.20934294164180756,790.4412231445312,1e-05,0.05884300544857979,5.823874235153198,15.555094242095947,4 +4652,0.08031952381134033,0.08865006268024445,0.08985748887062073,0.2108333259820938,427.6316223144531,1e-05,0.06971747428178787,6.143216848373413,15.555094242095947,4 +4653,0.1365600824356079,0.08102882653474808,0.07869882136583328,0.15467947721481323,580.8350830078125,1e-05,0.08189097046852112,5.681411981582642,15.555094242095947,4 +4654,0.10013151168823242,0.13946232199668884,0.13432538509368896,0.2337179332971573,992.7984008789062,1e-05,0.0616382472217083,5.684888124465942,15.555094242095947,4 +4655,0.07513496279716492,0.1098775863647461,0.1044609472155571,0.20713941752910614,935.6137084960938,1e-05,0.07509790360927582,5.9484782218933105,15.555094242095947,4 +4656,0.08655603975057602,0.07285988330841064,0.07164005190134048,0.21255607903003693,474.5657653808594,1e-05,0.09047415852546692,5.691274166107178,15.555094242095947,4 +4657,0.08492276072502136,0.11037035286426544,0.10730675607919693,0.1691666543483734,876.6427001953125,1e-05,0.060090743005275726,5.68735408782959,15.555094242095947,4 +4658,0.09918530285358429,0.10602308064699173,0.09902890026569366,0.23933492600917816,683.8768310546875,1e-05,0.06266079843044281,5.699734926223755,15.555094242095947,4 +4659,0.08969303965568542,0.22082597017288208,0.21775120496749878,0.29230767488479614,183.4470977783203,1e-05,0.09168042242527008,5.693446636199951,15.555094242095947,4 +4660,0.1305449903011322,0.909305989742279,0.9069822430610657,0.24724358320236206,14.822135925292969,1e-05,0.07653199136257172,5.70250129699707,15.555094242095947,4 +4661,0.09531942754983902,0.09349922835826874,0.08652449399232864,0.24371793866157532,919.3121948242188,1e-05,0.08754059672355652,5.688876152038574,15.555094242095947,4 +4662,0.05641147866845131,0.044738903641700745,0.049995195120573044,0.13220351934432983,962.7756958007812,1e-05,0.08299034088850021,5.6890459060668945,15.555094242095947,4 +4663,0.10754512250423431,0.051826246082782745,0.051180653274059296,0.2572435736656189,780.78076171875,1e-05,0.06161712482571602,5.7493674755096436,15.555094242095947,4 +4664,0.08594200015068054,0.22760584950447083,0.21543247997760773,0.17561697959899902,997.5768432617188,1e-05,0.07726775109767914,5.687415361404419,15.555094242095947,4 +4665,0.07672354578971863,0.09142056852579117,0.08717882633209229,0.1586618572473526,983.36181640625,1e-05,0.04959380626678467,5.705369472503662,15.555094242095947,4 +4666,0.06823360174894333,0.10902681201696396,0.10329354554414749,0.099342942237854,823.6697998046875,1e-05,0.06646253913640976,5.694899320602417,15.555094242095947,4 +4667,0.07701527327299118,0.16115595400333405,0.15838156640529633,0.25044068694114685,957.1228637695312,1e-05,0.0852278396487236,5.692469120025635,15.555094242095947,4 +4668,0.10387184470891953,0.23537221550941467,0.2332596480846405,0.25016024708747864,179.79454040527344,1e-05,0.07278885692358017,5.695423603057861,15.555094242095947,4 +4669,0.09025580435991287,0.1086212620139122,0.10381999611854553,0.21592146158218384,977.5501098632812,1e-05,0.07279738038778305,5.694868803024292,15.555094242095947,4 +4670,0.0918538048863411,0.09401680529117584,0.09022226184606552,0.21253204345703125,734.3234252929688,1e-05,0.0689719021320343,5.690325498580933,15.555094242095947,4 +4671,0.12645380198955536,0.11698190122842789,0.11204180121421814,0.22918269038200378,478.3950500488281,1e-05,0.05753364413976669,5.6940412521362305,15.555094242095947,4 +4672,0.09941212087869644,0.08692480623722076,0.08364422619342804,0.1879807561635971,969.4793090820312,1e-05,0.07291185110807419,5.799888849258423,15.555094242095947,4 +4673,0.04310986399650574,0.03903425112366676,0.040209654718637466,0.23325319588184357,723.90576171875,1e-05,0.05180904269218445,5.932165861129761,15.555094242095947,4 +4674,0.12041202187538147,0.14716874063014984,0.15093334019184113,0.20665062963962555,476.4851989746094,1e-05,0.06245257332921028,5.96662712097168,15.555094242095947,4 +4675,0.06704337894916534,0.06257930397987366,0.06452324241399765,0.2343749850988388,945.4190673828125,1e-05,0.05885743349790573,5.7191102504730225,15.555094242095947,4 +4676,0.0800870731472969,0.1030280664563179,0.10942614078521729,0.16873396933078766,978.2608642578125,1e-05,0.057302914559841156,5.697654485702515,15.555094242095947,4 +4677,0.06388784945011139,0.15841470658779144,0.14723365008831024,0.25419870018959045,980.6033935546875,1e-05,0.05386495217680931,5.706782102584839,15.555094242095947,4 +4678,0.07194774597883224,0.05411703884601593,0.05998575687408447,0.18494389951229095,912.5270385742188,1e-05,0.060195814818143845,5.7018537521362305,15.555094242095947,4 +4679,0.1108572781085968,0.04650941491127014,0.04291249439120293,0.24336537718772888,742.69482421875,1e-05,0.054879892617464066,5.692915201187134,15.555094242095947,4 +4680,0.0852496474981308,0.0895039513707161,0.0856560617685318,0.17957530915737152,372.1910095214844,1e-05,0.05719180777668953,5.6938207149505615,15.555094242095947,4 +4681,0.07535812258720398,0.07711101323366165,0.07302451878786087,0.2505688965320587,849.8719482421875,1e-05,0.05858662351965904,5.694455146789551,15.555094242095947,4 +4682,0.0972762405872345,0.12198492884635925,0.11145659536123276,0.2458493560552597,967.4503784179688,1e-05,0.061030931770801544,5.701556205749512,15.555094242095947,4 +4683,0.10897209495306015,0.031073246151208878,0.03241242840886116,0.13284455239772797,675.5514526367188,1e-05,0.05932442471385002,5.703732013702393,15.555094242095947,4 +4684,0.03238508477807045,0.15045402944087982,0.14281588792800903,0.246538445353508,998.7943115234375,1e-05,0.07116758078336716,5.706197738647461,15.555094242095947,4 +4685,0.03236649930477142,0.20743699371814728,0.19670678675174713,0.23202723264694214,995.3138427734375,1e-05,0.05907513573765755,5.696546792984009,15.555094242095947,4 +4686,0.10453926026821136,0.06491550803184509,0.060839299112558365,0.252427875995636,690.9660034179688,1e-05,0.07017295062541962,5.905410528182983,15.555094242095947,4 +4687,0.07094867527484894,0.10375595092773438,0.10480083525180817,0.15179486572742462,814.15625,1e-05,0.06157342344522476,5.684699296951294,15.555094242095947,4 +4688,0.06649304181337357,0.06507860124111176,0.06120457872748375,0.21349358558654785,807.9915161132812,1e-05,0.05264497920870781,5.687896251678467,15.555094242095947,4 +4689,0.0966121032834053,0.0858432799577713,0.08570068329572678,0.25447115302085876,972.4690551757812,1e-05,0.05022941529750824,5.677691698074341,15.555094242095947,4 +4690,0.08664733171463013,0.10902892053127289,0.10700789839029312,0.21811698377132416,379.5264587402344,1e-05,0.1165374144911766,5.687554836273193,15.555094242095947,4 +4691,0.0772852748632431,0.021392371505498886,0.023149432614445686,0.11141826212406158,882.3529052734375,1e-05,0.05944813787937164,5.689162731170654,15.555094242095947,4 +4692,0.07153091579675674,0.10517630726099014,0.10480605810880661,0.12379807233810425,954.0719604492188,1e-05,0.04909296706318855,5.683765888214111,15.555094242095947,4 +4693,0.07895175367593765,0.09187392145395279,0.08954761922359467,0.23413459956645966,926.165771484375,1e-05,0.06140890344977379,5.687162399291992,15.555094242095947,4 +4694,0.13726182281970978,0.08324962854385376,0.07992703467607498,0.2553926110267639,709.3425903320312,1e-05,0.07958915829658508,5.684018850326538,15.555094242095947,4 +4695,0.08577559143304825,0.0622742660343647,0.06104695796966553,0.28661057353019714,712.13427734375,1e-05,0.04716942459344864,5.692195177078247,15.555094242095947,4 +4696,0.11737444996833801,0.08335013687610626,0.0773208811879158,0.2757692337036133,873.4939575195312,1e-05,0.05920710042119026,5.72509503364563,15.555094242095947,4 +4697,0.07386758178472519,0.07021334767341614,0.0701165720820427,0.1978285163640976,777.2314453125,1e-05,0.07804827392101288,5.692755222320557,15.555094242095947,4 +4698,0.04797128215432167,0.08150951564311981,0.0795564204454422,0.1990624964237213,954.3519897460938,1e-05,0.05262628570199013,5.690057754516602,15.555094242095947,4 +4699,0.07470884174108505,0.07003477215766907,0.06392142921686172,0.19359774887561798,914.6995849609375,1e-05,0.10326457768678665,5.693718433380127,15.555094242095947,4 +4700,0.09786923974752426,0.1579223871231079,0.14755022525787354,0.250312477350235,992.7984008789062,1e-05,0.06244128942489624,5.690857648849487,15.555094242095947,4 +4701,0.0980071946978569,0.29063230752944946,0.29224127531051636,0.1307772397994995,113.63636016845703,1e-05,0.060130517929792404,5.687258958816528,15.555094242095947,4 +4702,0.123574398458004,0.09584023058414459,0.09668286144733429,0.14493589103221893,369.71832275390625,1e-05,0.07748299837112427,5.690244436264038,15.555094242095947,4 +4703,0.045808784663677216,0.10538122802972794,0.10075422376394272,0.3081570267677307,753.9683227539062,1e-05,0.07482587546110153,5.696423530578613,15.555094242095947,4 +4704,0.09940943866968155,0.4267524480819702,0.4238201677799225,0.16832531988620758,57.25191116333008,1e-05,0.05393660068511963,5.69771933555603,15.555094242095947,4 +4705,0.09538358449935913,0.1117434874176979,0.10240060836076736,0.19759614765644073,750.0000610351562,1e-05,0.0707598552107811,5.6906421184539795,15.555094242095947,4 +4706,0.12849602103233337,0.09374240785837173,0.08825252205133438,0.2361137717962265,703.6713256835938,1e-05,0.07194161415100098,5.714829921722412,15.555094242095947,4 +4707,0.08826455473899841,0.11587628722190857,0.11348892748355865,0.13385416567325592,314.37127685546875,1e-05,0.0503416545689106,5.69767689704895,15.555094242095947,4 +4708,0.05087247118353844,0.06745771318674088,0.07213407009840012,0.11790063977241516,942.4212036132812,1e-05,0.057884134352207184,5.693576335906982,15.555094242095947,4 +4709,0.10128916054964066,0.09423466771841049,0.0923476591706276,0.22361376881599426,354.58453369140625,1e-05,0.0679842010140419,5.695674896240234,15.555094242095947,4 +4710,0.07732966542243958,0.05720175430178642,0.05395621061325073,0.2776922881603241,800.3597412109375,1e-05,0.08589155226945877,5.693725109100342,15.555094242095947,4 +4711,0.09272661060094833,0.01930232159793377,0.022134508937597275,0.1500881314277649,915.4175415039062,1e-05,0.05815604329109192,5.693104982376099,15.555094242095947,4 +4712,0.0848519429564476,0.043995074927806854,0.048982173204422,0.2724038362503052,550.8948364257812,1e-05,0.056253913789987564,5.687806129455566,15.555094242095947,4 +4713,0.06624381989240646,0.06472622603178024,0.0575469546020031,0.19968749582767487,798.4103393554688,1e-05,0.06828915327787399,5.6969380378723145,15.555094242095947,4 +4714,0.060248881578445435,0.06349141895771027,0.06104093790054321,0.28166666626930237,618.6868286132812,1e-05,0.048855677247047424,5.692452430725098,15.555094242095947,4 +4715,0.111009880900383,0.1250709891319275,0.11668635159730911,0.2216586470603943,983.1340942382812,1e-05,0.06937553733587265,5.917186498641968,15.555094242095947,4 +4716,0.07742952555418015,0.09001525491476059,0.08306477218866348,0.2707291543483734,790.4412231445312,1e-05,0.056104354560375214,5.675112962722778,15.555094242095947,4 +4717,0.0989505797624588,0.07084251195192337,0.06991906464099884,0.13333332538604736,792.4597778320312,1e-05,0.0746583342552185,5.698634386062622,15.555094242095947,4 +4718,0.07911138981580734,0.2860625088214874,0.255997896194458,0.2254166603088379,995.10595703125,1e-05,0.07309652119874954,5.692394256591797,15.555094242095947,4 +4719,0.12672124803066254,0.08182045817375183,0.07701641321182251,0.2292628139257431,533.2568969726562,1e-05,0.08705932646989822,5.695141792297363,15.555094242095947,4 +4720,0.08797803521156311,0.07673952728509903,0.07662595808506012,0.24926280975341797,456.8528137207031,1e-05,0.06296055018901825,5.692583322525024,15.555094242095947,4 +4721,0.10064947605133057,0.08545088022947311,0.07913567870855331,0.2168269157409668,909.9564819335938,1e-05,0.05540997162461281,5.688337326049805,15.555094242095947,4 +4722,0.09122946858406067,0.08546502888202667,0.08327601850032806,0.23782852292060852,953.5103759765625,1e-05,0.060907673090696335,5.684630632400513,15.555094242095947,4 +4723,0.07011623680591583,0.08257754147052765,0.08368311077356339,0.2421073615550995,836.0927734375,1e-05,0.06340231746435165,5.689995050430298,15.555094242095947,4 +4724,0.11286085844039917,0.059459395706653595,0.056596726179122925,0.14290063083171844,674.4935913085938,1e-05,0.06387436389923096,5.690374851226807,15.555094242095947,4 +4725,0.09004304558038712,0.10284838080406189,0.09850829839706421,0.2809374928474426,901.616455078125,1e-05,0.0659056007862091,5.694174289703369,15.555094242095947,4 +4726,0.07892924547195435,0.13597767055034637,0.1345881223678589,0.20839743316173553,288.4615478515625,1e-05,0.05447101965546608,5.789031267166138,15.555094242095947,4 +4727,0.05570530146360397,0.1236218512058258,0.11786587536334991,0.19395031034946442,979.6713256835938,1e-05,0.08556193858385086,5.6872313022613525,15.555094242095947,4 +4728,0.07554332911968231,0.06621840596199036,0.06634841859340668,0.19729967415332794,458.8607482910156,1e-05,0.06254149973392487,5.807124376296997,15.555094242095947,4 +4729,0.07247054576873779,0.23535630106925964,0.20598165690898895,0.2274439036846161,990.232666015625,1e-05,0.061579879373311996,5.693561792373657,15.555094242095947,4 +4730,0.1340893805027008,0.21507593989372253,0.21396096050739288,0.20044870674610138,190.67796325683594,1e-05,0.09138317406177521,5.693072080612183,15.555094242095947,4 +4731,0.13330131769180298,0.23159165680408478,0.22932513058185577,0.2543429434299469,183.4470977783203,1e-05,0.07249846309423447,5.694745779037476,15.555094242095947,4 +4732,0.05549296364188194,0.09519235789775848,0.0884617418050766,0.2000560760498047,943.62744140625,1e-05,0.06624726206064224,5.68558144569397,15.555094242095947,4 +4733,0.08462540805339813,0.16941440105438232,0.15500269830226898,0.26028844714164734,980.8355712890625,1e-05,0.06643150001764297,5.692319631576538,15.555094242095947,4 +4734,0.05654626712203026,0.032191939651966095,0.03429584950208664,0.09260416030883789,910.6948852539062,1e-05,0.0579136461019516,5.68343186378479,15.555094242095947,4 +4735,0.07465681433677673,0.14938673377037048,0.1351853311061859,0.25427883863449097,991.52197265625,1e-05,0.06001133844256401,5.685365200042725,15.555094242095947,4 +4736,0.14803771674633026,0.06043119356036186,0.05577361583709717,0.18612179160118103,932.0956420898438,1e-05,0.06015721708536148,5.6881325244903564,15.555094242095947,4 +4737,0.07369128614664078,0.08466120809316635,0.08351224660873413,0.20229165256023407,870.7523803710938,1e-05,0.07209264487028122,5.690574645996094,15.555094242095947,4 +4738,0.07604492455720901,0.11933466792106628,0.11559664458036423,0.22036857903003693,900.8379516601562,1e-05,0.05965714156627655,5.684887170791626,15.555094242095947,4 +4739,0.06423120200634003,0.06285605579614639,0.06483358889818192,0.1949278712272644,871.670654296875,1e-05,0.06414204835891724,5.6892991065979,15.555094242095947,4 +4740,0.07670217007398605,0.04905901104211807,0.04837895184755325,0.13983973860740662,741.8699340820312,1e-05,0.05717628076672554,5.684913158416748,15.555094242095947,4 +4741,0.0606805756688118,0.11602699756622314,0.1172463595867157,0.19555287063121796,991.0935668945312,1e-05,0.0559365414083004,5.693343877792358,15.555094242095947,4 +4742,0.07457222789525986,0.06853596121072769,0.0663282573223114,0.2524919807910919,958.4887084960938,1e-05,0.07004611939191818,5.689128160476685,15.555094242095947,4 +4743,0.055551160126924515,0.09168212860822678,0.08596368134021759,0.20542466640472412,955.7438354492188,1e-05,0.05593448504805565,5.668107748031616,15.555094242095947,4 +4744,0.06814071536064148,0.08405975997447968,0.0895281657576561,0.2562499940395355,396.1748962402344,1e-05,0.06143968552350998,5.676822900772095,15.555094242095947,4 +4745,0.08432827889919281,0.1108386293053627,0.10884042084217072,0.18697915971279144,925.1558837890625,1e-05,0.06411436200141907,5.682054281234741,15.555094242095947,4 +4746,0.08606826514005661,0.09903711825609207,0.09871231764554977,0.28844550251960754,448.71795654296875,1e-05,0.06521964818239212,5.691781759262085,15.555094242095947,4 +4747,0.0786798745393753,0.09844671934843063,0.09345421195030212,0.27444711327552795,895.6915893554688,1e-05,0.07037395238876343,5.836364269256592,15.555094242095947,4 +4748,0.12766501307487488,0.46583661437034607,0.4638462960720062,0.27022436261177063,79.58802795410156,1e-05,0.05884656310081482,5.700525999069214,15.555094242095947,4 +4749,0.11001965403556824,0.1293550431728363,0.12431495636701584,0.20132210850715637,936.8737182617188,1e-05,0.07279038429260254,5.91148829460144,15.555094242095947,4 +4750,0.07729179412126541,0.034502655267715454,0.03811314329504967,0.12919871509075165,590.71728515625,1e-05,0.06242092326283455,5.685544729232788,15.555094242095947,4 +4751,0.07787685841321945,0.07787185907363892,0.08189819008111954,0.19506409764289856,633.6292114257812,1e-05,0.056683249771595,5.688542604446411,15.555094242095947,4 +4752,0.09133963286876678,0.08281300961971283,0.0788903757929802,0.1884695440530777,429.7900695800781,1e-05,0.05662822723388672,5.687649250030518,15.555094242095947,4 +4753,0.144527867436409,0.05575984716415405,0.054443370550870895,0.16713140904903412,625.0,1e-05,0.061951808631420135,5.686321020126343,15.555094242095947,4 +4754,0.09680260717868805,0.07361724227666855,0.0718691498041153,0.2175881266593933,792.4597778320312,1e-05,0.07020696997642517,5.682509422302246,15.555094242095947,4 +4755,0.05294245481491089,0.092332623898983,0.0861438438296318,0.2197115272283554,927.1693725585938,1e-05,0.05780189484357834,5.682737112045288,15.555094242095947,4 +4756,0.08527921885251999,0.06429094076156616,0.06613057106733322,0.15443909168243408,759.419189453125,1e-05,0.06815675646066666,5.6855785846710205,15.555094242095947,4 +4757,0.08597169816493988,0.08305789530277252,0.07982531934976578,0.2553125023841858,961.4497680664062,1e-05,0.050297871232032776,5.687081336975098,15.555094242095947,4 +4758,0.0913843959569931,0.10062263160943985,0.09204728901386261,0.31302082538604736,937.1871948242188,1e-05,0.06195394694805145,5.6767261028289795,15.555094242095947,4 +4759,0.08261316269636154,0.04606533795595169,0.04412209987640381,0.23445512354373932,826.5582275390625,1e-05,0.05979480966925621,5.7017822265625,15.555094242095947,4 +4760,0.0913965106010437,0.058639779686927795,0.05919625982642174,0.2464262694120407,922.431884765625,1e-05,0.06079529970884323,5.734755754470825,15.555094242095947,4 +4761,0.05755338445305824,0.05910645052790642,0.06302844732999802,0.1947355717420578,816.57421875,1e-05,0.06488117575645447,5.698735475540161,15.555094242095947,4 +4762,0.05093268305063248,0.08818591386079788,0.09143150597810745,0.13934294879436493,691.9642944335938,1e-05,0.06059512123465538,5.699835538864136,15.555094242095947,4 +4763,0.10290969908237457,0.04903491958975792,0.05242808535695076,0.20499198138713837,665.8878784179688,1e-05,0.06747166812419891,5.692445278167725,15.555094242095947,4 +4764,0.06669296324253082,0.10681251436471939,0.10860074311494827,0.1351442188024521,966.4247436523438,1e-05,0.05671178549528122,5.697042942047119,15.555094242095947,4 +4765,0.09568192809820175,0.08489668369293213,0.0784926638007164,0.2286778688430786,727.4247436523438,1e-05,0.060288380831480026,5.684953927993774,15.555094242095947,4 +4766,0.12678109109401703,0.11207210272550583,0.10720624029636383,0.1725480705499649,766.25390625,1e-05,0.04797854647040367,5.6933674812316895,15.555094242095947,4 +4767,0.1069880798459053,0.20469354093074799,0.19884337484836578,0.1946474313735962,996.5530395507812,1e-05,0.07585852593183517,5.69005560874939,15.555094242095947,4 +4768,0.10671026259660721,0.062292952090501785,0.06709545850753784,0.23391024768352509,780.78076171875,1e-05,0.0800464004278183,5.910078525543213,15.555094242095947,4 +4769,0.09231799840927124,0.08431492000818253,0.08538772165775299,0.187972754240036,864.6732177734375,1e-05,0.04980828985571861,5.685273885726929,15.555094242095947,4 +4770,0.03910314291715622,0.06123971939086914,0.056470852345228195,0.24510416388511658,866.0933227539062,1e-05,0.06284365057945251,5.678791284561157,15.555094242095947,4 +4771,0.07873838394880295,0.05877324193716049,0.06268300116062164,0.18109774589538574,878.85986328125,1e-05,0.06427062302827835,5.901418209075928,15.555094242095947,4 +4772,0.12010324001312256,0.10551762580871582,0.10364821553230286,0.2254166603088379,322.7003173828125,1e-05,0.07581929862499237,5.679179668426514,15.555094242095947,4 +4773,0.10825010389089584,0.09994066506624222,0.09198050945997238,0.23107370734214783,866.0933227539062,1e-05,0.046335916966199875,5.681809902191162,15.555094242095947,4 +4774,0.08924821019172668,0.11016979068517685,0.09990819543600082,0.20094551146030426,895.6915893554688,1e-05,0.06067118048667908,5.689713001251221,15.555094242095947,4 +4775,0.10838433355093002,0.05299697071313858,0.05613718181848526,0.19544069468975067,743.5170288085938,1e-05,0.08191944658756256,5.682130336761475,15.555094242095947,4 +4776,0.10000723600387573,0.0713934525847435,0.07572370022535324,0.17328524589538574,450.76727294921875,1e-05,0.0583929643034935,5.686197996139526,15.555094242095947,4 +4777,0.05901607871055603,0.10582197457551956,0.09997226297855377,0.103012815117836,955.7438354492188,1e-05,0.07754499465227127,5.6826794147491455,15.555094242095947,4 +4778,0.07429774850606918,0.05506780743598938,0.0555097833275795,0.24670672416687012,909.21484375,1e-05,0.06936584413051605,5.682748556137085,15.555094242095947,4 +4779,0.05174426734447479,0.08398065716028214,0.07780041545629501,0.24571312963962555,950.6705322265625,1e-05,0.07132842391729355,5.674889802932739,15.555094242095947,4 +4780,0.0869758129119873,0.05404707416892052,0.0532049760222435,0.10916665941476822,736.8637084960938,1e-05,0.10647384077310562,5.7602219581604,15.555094242095947,4 +4781,0.07099824398756027,0.06970717012882233,0.06399822235107422,0.24994389712810516,818.9655151367188,1e-05,0.06923280656337738,5.914208173751831,15.555094242095947,4 +4782,0.0977264791727066,0.1050252690911293,0.09962092339992523,0.24520832300186157,705.574951171875,1e-05,0.06959893554449081,5.68862247467041,15.555094242095947,4 +4783,0.09260775148868561,0.11661363393068314,0.11870252341032028,0.22361376881599426,303.0303039550781,1e-05,0.0842941626906395,5.692844390869141,15.555094242095947,4 +4784,0.10627682507038116,0.18237319588661194,0.16585475206375122,0.2747756242752075,986.50927734375,1e-05,0.06930562853813171,5.700792074203491,15.555094242095947,4 +4785,0.10977626591920853,0.035628847777843475,0.04097616299986839,0.2139262706041336,491.5048522949219,1e-05,0.07536999136209488,5.691710472106934,15.555094242095947,4 +4786,0.13066142797470093,0.21289755403995514,0.2084130346775055,0.22989583015441895,276.479736328125,1e-05,0.07170338928699493,5.696255207061768,15.555094242095947,4 +4787,0.11665032058954239,0.11087457090616226,0.10544861853122711,0.21341344714164734,427.6316223144531,1e-05,0.06123178452253342,5.694304704666138,15.555094242095947,4 +4788,0.09779241681098938,0.1404692381620407,0.13781727850437164,0.29681891202926636,425.4617614746094,1e-05,0.06405959278345108,5.690172910690308,15.555094242095947,4 +4789,0.057058077305555344,0.11981774866580963,0.11687401682138443,0.21483974158763885,311.56158447265625,1e-05,0.08542794734239578,5.929063081741333,15.555094242095947,4 +4790,0.15649861097335815,0.07735490053892136,0.07833573967218399,0.26520031690597534,631.1881713867188,1e-05,0.08764693886041641,5.684691667556763,15.555094242095947,4 +4791,0.09207317233085632,0.07505723088979721,0.07252578437328339,0.25881409645080566,507.7196960449219,1e-05,0.07046870142221451,5.942173480987549,15.555094242095947,4 +4792,0.10178801417350769,0.14573189616203308,0.14360706508159637,0.14820511639118195,251.59742736816406,1e-05,0.07481424510478973,5.713343858718872,15.555094242095947,4 +4793,0.11446287482976913,0.08417994529008865,0.08699072897434235,0.24399839341640472,942.1181640625,1e-05,0.07474459707736969,5.676131010055542,15.555094242095947,4 +4794,0.07330788671970367,0.04451936110854149,0.041928406804800034,0.20366986095905304,745.1535034179688,1e-05,0.10368150472640991,5.686045408248901,15.555094242095947,4 +4795,0.07934222370386124,0.1022593155503273,0.09965948015451431,0.2045672982931137,968.974853515625,1e-05,0.05109693109989166,5.686206579208374,15.555094242095947,4 +4796,0.07332684099674225,0.0225777979940176,0.02531832456588745,0.14040865004062653,740.2120361328125,1e-05,0.07912454009056091,5.683507919311523,15.555094242095947,4 +4797,0.044713884592056274,0.048022691160440445,0.04828310385346413,0.2641025483608246,831.0991821289062,1e-05,0.07383421808481216,5.684308290481567,15.555094242095947,4 +4798,0.08656036853790283,0.09334266930818558,0.08841114491224289,0.17092947661876678,936.2449951171875,1e-05,0.06306210160255432,5.683326482772827,15.555094242095947,4 +4799,0.07071840763092041,0.0654614120721817,0.06333041191101074,0.19442306458950043,767.0015869140625,1e-05,0.060776446014642715,5.691018342971802,15.555094242095947,4 +4800,0.07046826928853989,0.10472510010004044,0.09556165337562561,0.2611618638038635,953.7914428710938,1e-05,0.07911408692598343,5.678952693939209,15.555094242095947,4 +4801,0.06835310161113739,0.06530425697565079,0.05735700577497482,0.22928684949874878,861.318359375,1e-05,0.05720797926187515,5.685025215148926,15.555094242095947,4 +4802,0.0803789496421814,0.03723515197634697,0.03720445558428764,0.2161378115415573,864.6732177734375,1e-05,0.059896521270275116,5.687762975692749,15.555094242095947,4 +4803,0.0815560519695282,0.12495390325784683,0.12195444852113724,0.23240384459495544,507.7196960449219,1e-05,0.09228015691041946,5.809463977813721,15.555094242095947,4 +4804,0.07884354144334793,0.10031245648860931,0.09693965315818787,0.21462339162826538,643.2039184570312,1e-05,0.062225062400102615,5.688148498535156,15.555094242095947,4 +4805,0.07099737226963043,0.05934825912117958,0.05477800965309143,0.2643910050392151,870.2915649414062,1e-05,0.06490962952375412,5.6936070919036865,15.555094242095947,4 +4806,0.06762649118900299,0.05679013952612877,0.061085544526576996,0.10129807144403458,943.3267822265625,1e-05,0.06433048099279404,5.693685293197632,15.555094242095947,4 +4807,0.07147547602653503,0.06780164688825607,0.06595240533351898,0.19343748688697815,716.7235717773438,1e-05,0.06942731887102127,5.690278768539429,15.555094242095947,4 +4808,0.11553595960140228,0.12137471139431,0.11994168162345886,0.1932852566242218,999.3985595703125,1e-05,0.05230164900422096,5.691989421844482,15.555094242095947,4 +4809,0.06039510294795036,0.08177938312292099,0.07222866266965866,0.2058413326740265,911.0628662109375,1e-05,0.052056629210710526,5.69175386428833,15.555094242095947,4 +4810,0.07417894899845123,0.1847771853208542,0.1765182912349701,0.2446874976158142,994.0623168945312,1e-05,0.06306342780590057,5.972360849380493,15.555094242095947,4 +4811,0.09575898200273514,0.11292222887277603,0.10652071237564087,0.2136458307504654,561.674072265625,1e-05,0.07374390214681625,5.687238931655884,15.555094242095947,4 +4812,0.09428331255912781,0.16475974023342133,0.1640550196170807,0.23164261877536774,225.4098358154297,1e-05,0.06650402396917343,5.678401708602905,15.555094242095947,4 +4813,0.10168759524822235,0.03699546307325363,0.036874108016490936,0.12679485976696014,660.3773803710938,1e-05,0.05654849857091904,5.706401109695435,15.555094242095947,4 +4814,0.07955527305603027,0.051552895456552505,0.04711771383881569,0.25381410121917725,701.75439453125,1e-05,0.06934361159801483,5.708477973937988,15.555094242095947,4 +4815,0.05858241021633148,0.2189827561378479,0.21415551006793976,0.303621768951416,973.6957397460938,1e-05,0.07044478505849838,5.700220346450806,15.555094242095947,4 +4816,0.09071201086044312,0.05593195930123329,0.055519141256809235,0.1816185861825943,776.5151977539062,1e-05,0.06949668377637863,5.70182991027832,15.555094242095947,4 +4817,0.09556598216295242,0.12163635343313217,0.11456562578678131,0.1980047971010208,966.4247436523438,1e-05,0.07117222249507904,5.748816967010498,15.555094242095947,4 +4818,0.08739577978849411,0.09662506729364395,0.09307252615690231,0.2941987216472626,902.0044555664062,1e-05,0.06171608716249466,5.6822755336761475,15.555094242095947,4 +4819,0.1046203225851059,0.1291269063949585,0.11294780671596527,0.233028843998909,979.2027587890625,1e-05,0.05593491345643997,5.691708564758301,15.555094242095947,4 +4820,0.048006050288677216,0.07504629343748093,0.0683196634054184,0.15544870495796204,726.5493774414062,1e-05,0.06546949595212936,5.933366298675537,15.555094242095947,4 +4821,0.10123316943645477,0.11052755266427994,0.10916965454816818,0.1500801295042038,354.58453369140625,1e-05,0.056841593235731125,5.701703071594238,15.555094242095947,4 +4822,0.05749158933758736,0.06332997977733612,0.061030518263578415,0.237748384475708,898.0855712890625,1e-05,0.05599747225642204,5.696107864379883,15.555094242095947,4 +4823,0.04323302581906319,0.061614759266376495,0.05786387622356415,0.2084214687347412,763.2398681640625,1e-05,0.06183290854096413,5.934337139129639,15.555094242095947,4 +4824,0.07113434374332428,0.053168781101703644,0.05325222760438919,0.21376602351665497,743.5170288085938,1e-05,0.07300673425197601,5.681382656097412,15.555094242095947,4 +4825,0.1022767648100853,0.0870613381266594,0.08346319943666458,0.2590785026550293,472.6368408203125,1e-05,0.07927566766738892,5.6887664794921875,15.555094242095947,4 +4826,0.11107225716114044,0.17716899514198303,0.18190595507621765,0.13914261758327484,261.0759582519531,1e-05,0.04312881454825401,5.6926023960113525,15.555094242095947,4 +4827,0.11840882897377014,0.8039835095405579,0.7962948083877563,0.17941506206989288,29.296875,1e-05,0.057983916252851486,5.930983781814575,15.555094242095947,4 +4828,0.0819598138332367,0.047954026609659195,0.045253314077854156,0.18767628073692322,852.9224853515625,1e-05,0.06616232544183731,5.6975109577178955,15.555094242095947,4 +4829,0.06112455949187279,0.12072093784809113,0.11860689520835876,0.20826922357082367,959.5725708007812,1e-05,0.06112424656748772,5.688398361206055,15.555094242095947,4 +4830,0.1021048054099083,0.06567622721195221,0.06280330568552017,0.2614663243293762,604.3388061523438,1e-05,0.058488063514232635,5.691357612609863,15.555094242095947,4 +4831,0.07039973139762878,0.09190431237220764,0.09001199156045914,0.14947114884853363,823.0874633789062,1e-05,0.09009996801614761,5.8931708335876465,15.555094242095947,4 +4832,0.07938440889120102,0.05953780561685562,0.0642109215259552,0.2317788302898407,934.3434448242188,1e-05,0.0711633712053299,5.6875598430633545,15.555094242095947,4 +4833,0.05849699303507805,0.08704441785812378,0.08001477271318436,0.1599999964237213,927.1693725585938,1e-05,0.06244109198451042,5.69052267074585,15.555094242095947,4 +4834,0.08564457297325134,0.14348582923412323,0.14153355360031128,0.23559294641017914,270.376220703125,1e-05,0.053465407341718674,5.6991870403289795,15.555094242095947,4 +4835,0.0889970064163208,0.09862183034420013,0.09728432446718216,0.21729165315628052,319.94049072265625,1e-05,0.05308976396918297,5.681551456451416,15.555094242095947,4 +4836,0.10371378064155579,0.08941837400197983,0.08456650376319885,0.2609134614467621,460.8586120605469,1e-05,0.057276904582977295,5.692886590957642,15.555094242095947,4 +4837,0.08349107950925827,0.07205493003129959,0.0684589147567749,0.20489582419395447,799.0620727539062,1e-05,0.053333770483732224,5.686842918395996,15.555094242095947,4 +4838,0.10988078266382217,0.07922002673149109,0.07496199011802673,0.1231730729341507,849.8719482421875,1e-05,0.0718977302312851,5.772232532501221,15.555094242095947,4 +4839,0.1255878508090973,0.07844756543636322,0.0728517398238182,0.3081490397453308,542.9864501953125,1e-05,0.04983869194984436,5.692569017410278,15.555094242095947,4 +4840,0.110244020819664,0.06169820576906204,0.05764461308717728,0.20048075914382935,903.5476684570312,1e-05,0.054484039545059204,5.685653209686279,15.555094242095947,4 +4841,0.06036916375160217,0.0763886421918869,0.07354413717985153,0.2307131290435791,908.4699096679688,1e-05,0.07436033338308334,5.946115016937256,15.555094242095947,4 +4842,0.11685004830360413,0.05967380478978157,0.0558260940015316,0.2194390892982483,675.5514526367188,1e-05,0.06618987768888474,5.6851348876953125,15.555094242095947,4 +4843,0.12034013867378235,0.08749740570783615,0.08318772912025452,0.23474358022212982,460.8586120605469,1e-05,0.04944926127791405,5.6986987590789795,15.555094242095947,4 +4844,0.10245092213153839,0.06253126263618469,0.05894571542739868,0.18126602470874786,566.1925659179688,1e-05,0.06727322190999985,5.687936782836914,15.555094242095947,4 +4845,0.08089560270309448,0.15534231066703796,0.14346995949745178,0.23604966700077057,971.4794311523438,1e-05,0.06749606132507324,5.686431884765625,15.555094242095947,4 +4846,0.05815970525145531,0.06886561959981918,0.06560488045215607,0.08962339162826538,580.8350830078125,1e-05,0.05351201072335243,5.689060211181641,15.555094242095947,4 +4847,0.09633643925189972,0.6223940253257751,0.622028648853302,0.23135416209697723,38.75969314575195,1e-05,0.05429202318191528,5.6923041343688965,15.555094242095947,4 +4848,0.07301085442304611,0.08082076162099838,0.07657191902399063,0.24408653378486633,965.6505737304688,1e-05,0.05583677813410759,5.6857075691223145,15.555094242095947,4 +4849,0.11274126917123795,0.0425315722823143,0.045604825019836426,0.24699518084526062,757.0978393554688,1e-05,0.05202888324856758,5.690826654434204,15.555094242095947,4 +4850,0.08200189471244812,0.10979695618152618,0.10816112160682678,0.22876602411270142,267.29559326171875,1e-05,0.0675574541091919,5.6836724281311035,15.555094242095947,4 +4851,0.09740108996629715,0.03775721415877342,0.037684787064790726,0.20338140428066254,558.6282348632812,1e-05,0.07668790966272354,5.689140558242798,15.555094242095947,4 +4852,0.11073409020900726,0.1235291138291359,0.1179356724023819,0.2324599325656891,925.1558837890625,1e-05,0.05887431278824806,5.900765657424927,15.555094242095947,4 +4853,0.059166308492422104,0.04513707756996155,0.04225478693842888,0.190769225358963,831.0991821289062,1e-05,0.06393036991357803,5.708331108093262,15.555094242095947,4 +4854,0.06948845088481903,0.6388466954231262,0.6558754444122314,0.08232371509075165,34.046695709228516,1e-05,0.0621819794178009,5.697234153747559,15.555094242095947,4 +4855,0.045907795429229736,0.06562628597021103,0.05838779732584953,0.19552083313465118,765.50390625,1e-05,0.04621877521276474,5.692784309387207,15.555094242095947,4 +4856,0.06940850615501404,0.06357599794864655,0.062510646879673,0.27569711208343506,826.5582275390625,1e-05,0.05639614909887314,5.694615602493286,15.555094242095947,4 +4857,0.059296488761901855,0.07536517828702927,0.0725056454539299,0.25392627716064453,927.5025634765625,1e-05,0.044901326298713684,5.690000295639038,15.555094242095947,4 +4858,0.06047593429684639,0.10234946757555008,0.0954577773809433,0.08898236602544785,979.9048461914062,1e-05,0.05198032781481743,5.690231800079346,15.555094242095947,4 +4859,0.07121500372886658,0.1014024168252945,0.09939156472682953,0.24713140726089478,985.1694946289062,1e-05,0.06333635002374649,5.684653282165527,15.555094242095947,4 +4860,0.10830574482679367,0.07583745568990707,0.06773283332586288,0.23710736632347107,925.1558837890625,1e-05,0.056976959109306335,5.685675859451294,15.555094242095947,4 +4861,0.11135248094797134,0.048670779913663864,0.050346922129392624,0.22603364288806915,560.154541015625,1e-05,0.05572153255343437,5.689980983734131,15.555094242095947,4 +4862,0.05789861083030701,0.04681973159313202,0.048977330327034,0.19109775125980377,663.6961059570312,1e-05,0.04953094199299812,5.697503566741943,15.555094242095947,4 +4863,0.10641728341579437,0.07134182751178741,0.06779319792985916,0.2790144085884094,750.7987060546875,1e-05,0.05533101037144661,5.69413948059082,15.555094242095947,4 +4864,0.07666698098182678,0.1911897361278534,0.16895097494125366,0.23304486274719238,990.232666015625,1e-05,0.05948023125529289,5.689296245574951,15.555094242095947,4 +4865,0.059990208595991135,0.1727362424135208,0.15819916129112244,0.22668267786502838,986.064208984375,1e-05,0.059217747300863266,5.68771767616272,15.555094242095947,4 +4866,0.08802579343318939,0.24691689014434814,0.24476505815982819,0.1745913326740265,153.50877380371094,1e-05,0.05252871662378311,5.683726072311401,15.555094242095947,4 +4867,0.06474092602729797,0.13841231167316437,0.12365967035293579,0.30320510268211365,981.5291137695312,1e-05,0.04518633708357811,5.6934895515441895,15.555094242095947,4 +4868,0.06641799956560135,0.08704821765422821,0.08171767741441727,0.18250800669193268,959.8422241210938,1e-05,0.06299719214439392,5.692425727844238,15.555094242095947,4 +4869,0.05790189281105995,0.1149577721953392,0.1160399541258812,0.25254806876182556,992.58642578125,1e-05,0.06078319624066353,5.685210466384888,15.555094242095947,4 +4870,0.1224164366722107,0.0949191078543663,0.08497815579175949,0.2389182597398758,794.4606323242188,1e-05,0.05418103560805321,5.687603235244751,15.555094242095947,4 +4871,0.07162447273731232,0.07118591666221619,0.07297195494174957,0.2955048084259033,959.5725708007812,1e-05,0.07449832558631897,5.699805498123169,15.555094242095947,4 +4872,0.03819285333156586,0.08498308062553406,0.07901157438755035,0.16996794939041138,805.4765625,1e-05,0.07051832228899002,5.688249111175537,15.555094242095947,4 +4873,0.07674603909254074,0.05496584624052048,0.057486359030008316,0.20450319349765778,941.20556640625,1e-05,0.0702466368675232,5.942332744598389,15.555094242095947,4 +4874,0.07046056538820267,0.05121852084994316,0.050367530435323715,0.2311057597398758,774.3531494140625,1e-05,0.0562419556081295,5.682947397232056,15.555094242095947,4 +4875,0.08172128349542618,0.22033679485321045,0.21351104974746704,0.23374198377132416,994.89794921875,1e-05,0.04579780250787735,5.6845996379852295,15.555094242095947,4 +4876,0.06582824140787125,0.05314924195408821,0.04944448173046112,0.2624439001083374,848.8447265625,1e-05,0.07397191971540451,5.68766450881958,15.555094242095947,4 +4877,0.07613697648048401,0.12086249887943268,0.10857091099023819,0.24616184830665588,894.4823608398438,1e-05,0.056857138872146606,5.678567409515381,15.555094242095947,4 +4878,0.08574368059635162,0.09128336608409882,0.08674456179141998,0.2153685837984085,976.3572998046875,1e-05,0.051924560219049454,5.69527006149292,15.555094242095947,4 +4879,0.06217364966869354,0.05626976490020752,0.05476880818605423,0.19023236632347107,754.75439453125,1e-05,0.05234873667359352,5.696083307266235,15.555094242095947,4 +4880,0.06903355568647385,0.08829956501722336,0.08399111777544022,0.25015223026275635,975.15380859375,1e-05,0.06223499774932861,5.68527364730835,15.555094242095947,4 +4881,0.11599905043840408,0.03309822082519531,0.03186792507767677,0.17923076450824738,816.57421875,1e-05,0.05549567565321922,5.679429054260254,15.555094242095947,4 +4882,0.0709698498249054,0.06688056886196136,0.062078382819890976,0.2311939001083374,802.9328002929688,1e-05,0.05471229553222656,5.686183929443359,15.555094242095947,4 +4883,0.06519374996423721,0.10990939289331436,0.10861742496490479,0.21495191752910614,881.919921875,1e-05,0.0636933445930481,5.693793058395386,15.555094242095947,4 +4884,0.09175712615251541,0.1265469342470169,0.11419358104467392,0.23421473801136017,937.8121948242188,1e-05,0.06423474103212357,5.800809383392334,15.555094242095947,4 +4885,0.09720434248447418,0.6400764584541321,0.676213800907135,0.16999998688697815,38.75969314575195,1e-05,0.06957542896270752,5.84040379524231,15.555094242095947,4 +4886,0.07331492751836777,0.056750595569610596,0.05247075483202934,0.22913460433483124,790.4412231445312,1e-05,0.055622875690460205,5.6904401779174805,15.555094242095947,4 +4887,0.11600042879581451,0.053620852530002594,0.05240854248404503,0.22278043627738953,847.8120727539062,1e-05,0.05496211349964142,5.690860033035278,15.555094242095947,4 +4888,0.06999734044075012,0.07930300384759903,0.076886385679245,0.20010416209697723,718.5374145507812,1e-05,0.06600815057754517,5.682274103164673,15.555094242095947,4 +4889,0.10611163824796677,0.07225050777196884,0.06888613104820251,0.24764421582221985,627.4900512695312,1e-05,0.048721957951784134,5.689475774765015,15.555094242095947,4 +4890,0.10847077518701553,0.13464364409446716,0.1283637434244156,0.1937580108642578,917.5531616210938,1e-05,0.049888815730810165,5.685761451721191,15.555094242095947,4 +4891,0.06632736325263977,0.16407838463783264,0.15745796263217926,0.3029807507991791,965.1322021484375,1e-05,0.05429307743906975,5.686389446258545,15.555094242095947,4 +4892,0.11443912237882614,0.13087087869644165,0.13453680276870728,0.13596954941749573,440.41455078125,1e-05,0.05187348276376724,5.691269159317017,15.555094242095947,4 +4893,0.14725662767887115,0.10835137218236923,0.10297824442386627,0.18722756206989288,898.4814453125,1e-05,0.07163736969232559,5.6951072216033936,15.555094242095947,4 +4894,0.11100102961063385,0.19738934934139252,0.17962214350700378,0.2829967737197876,983.1340942382812,1e-05,0.05202293023467064,5.9225380420684814,15.555094242095947,4 +4895,0.09545649588108063,0.10771892219781876,0.11093469709157944,0.24410255253314972,322.7003173828125,1e-05,0.07236916571855545,5.68372368812561,15.555094242095947,4 +4896,0.09879332780838013,0.3191259205341339,0.3174343407154083,0.1695673018693924,109.48905944824219,1e-05,0.05584338307380676,5.691710472106934,15.555094242095947,4 +4897,0.11847814917564392,0.08158311247825623,0.07643052190542221,0.2887499928474426,616.125732421875,1e-05,0.06720709055662155,5.6932666301727295,15.555094242095947,4 +4898,0.07708965986967087,0.05274743214249611,0.05355702340602875,0.1792147308588028,959.0316162109375,1e-05,0.07560393214225769,5.996489763259888,15.555094242095947,4 +4899,0.06091340258717537,0.05518994480371475,0.05237649008631706,0.22544871270656586,785.6611938476562,1e-05,0.05255838856101036,5.680882930755615,15.555094242095947,4 +4900,0.10226286202669144,0.5592300295829773,0.6014662981033325,0.2366987019777298,52.6819953918457,1e-05,0.11264650523662567,5.676563262939453,15.555094242095947,4 +4901,0.08873734623193741,0.07046768814325333,0.06861355155706406,0.23856569826602936,572.1257934570312,1e-05,0.05725057050585747,5.679617643356323,15.555094242095947,4 +4902,0.07830437272787094,0.08069773018360138,0.08008833974599838,0.1452564001083374,526.620361328125,1e-05,0.06128744035959244,5.686906814575195,15.555094242095947,4 +4903,0.07769949734210968,0.04457224905490875,0.04274020344018936,0.10508813709020615,676.6055297851562,1e-05,0.08453042805194855,5.6846022605896,15.555094242095947,4 +4904,0.06827152520418167,0.08057808876037598,0.07270407676696777,0.27734774351119995,844.1558227539062,1e-05,0.04866999387741089,5.684569835662842,15.555094242095947,4 +4905,0.10822182893753052,0.07750056684017181,0.0721701979637146,0.20693108439445496,809.2384033203125,1e-05,0.06896021962165833,5.682853698730469,15.555094242095947,4 +4906,0.11990275979042053,0.13638469576835632,0.13565365970134735,0.19298876821994781,344.2029113769531,1e-05,0.06674177199602127,5.8519511222839355,15.555094242095947,4 +4907,0.11694090068340302,0.15327005088329315,0.14562414586544037,0.24109774827957153,979.9048461914062,1e-05,0.07249638438224792,5.690382480621338,15.555094242095947,4 +4908,0.08841327577829361,0.13498587906360626,0.11937866359949112,0.21741986274719238,979.9048461914062,1e-05,0.07467851787805557,5.882081985473633,15.555094242095947,4 +4909,0.1273011714220047,0.05819272622466087,0.05730029568076134,0.2677724361419678,472.6368408203125,1e-05,0.06651969999074936,5.677221298217773,15.555094242095947,4 +4910,0.07241636514663696,0.08698340505361557,0.08077137172222137,0.15979166328907013,941.20556640625,1e-05,0.04041655361652374,5.679056882858276,15.555094242095947,4 +4911,0.0800035297870636,0.16195358335971832,0.1526157110929489,0.30609774589538574,964.61181640625,1e-05,0.0520123615860939,5.680426836013794,15.555094242095947,4 +4912,0.058577775955200195,0.08681491017341614,0.08266330510377884,0.22460736334323883,998.9959716796875,1e-05,0.05141984671354294,5.789198637008667,15.555094242095947,4 +4913,0.062051862478256226,0.0600639209151268,0.05988983064889908,0.24505607783794403,698.8536376953125,1e-05,0.05600745230913162,5.689476728439331,15.555094242095947,4 +4914,0.06646553426980972,0.08237375319004059,0.09022962301969528,0.1899999976158142,953.2288818359375,1e-05,0.07569705694913864,5.6822593212127686,15.555094242095947,4 +4915,0.09461507946252823,0.07715148478746414,0.07617015391588211,0.26681089401245117,454.8346252441406,1e-05,0.050410933792591095,5.681813955307007,15.555094242095947,4 +4916,0.08493997156620026,0.07715613394975662,0.07500382512807846,0.15787659585475922,653.6259765625,1e-05,0.06336569786071777,5.686737537384033,15.555094242095947,4 +4917,0.12077619135379791,0.23517566919326782,0.2358037531375885,0.27668267488479614,161.1498260498047,1e-05,0.05912929028272629,5.678074836730957,15.555094242095947,4 +4918,0.10432691872119904,0.11874382197856903,0.11887508630752563,0.236298069357872,294.342529296875,1e-05,0.05518267676234245,5.690558910369873,15.555094242095947,4 +4919,0.06839586794376373,0.11376077681779861,0.10861264914274216,0.2176041603088379,869.8297119140625,1e-05,0.05427941679954529,5.690229654312134,15.555094242095947,4 +4920,0.07885327190160751,0.14442060887813568,0.13164854049682617,0.21360576152801514,971.23095703125,1e-05,0.05187200754880905,5.680474281311035,15.555094242095947,4 +4921,0.11393647640943527,0.10164589434862137,0.09450984746217728,0.1728525608778,978.7327270507812,1e-05,0.06620553880929947,5.687295913696289,15.555094242095947,4 +4922,0.07953954488039017,0.0768783912062645,0.07753774523735046,0.2625240385532379,968.974853515625,1e-05,0.06074529513716698,5.679876089096069,15.555094242095947,4 +4923,0.07516542822122574,0.06949116289615631,0.0681459978222847,0.2570192217826843,405.4053955078125,1e-05,0.0821753516793251,5.684020519256592,15.555094242095947,4 +4924,0.07226058095693588,0.08283594995737076,0.08222402632236481,0.2337099313735962,958.7605590820312,1e-05,0.049447327852249146,5.682193994522095,15.555094242095947,4 +4925,0.12851525843143463,0.08711404353380203,0.07815950363874435,0.20995992422103882,927.5025634765625,1e-05,0.07507160305976868,5.6830127239227295,15.555094242095947,4 +4926,0.06947731971740723,0.04166976734995842,0.04094674065709114,0.09151441603899002,859.375,1e-05,0.05933999642729759,5.878805875778198,15.555094242095947,4 +4927,0.0765952616930008,0.08316464722156525,0.079713836312294,0.2690064013004303,947.775634765625,1e-05,0.055173926055431366,5.691924810409546,15.555094242095947,4 +4928,0.06270832568407059,0.09705813229084015,0.09226044267416,0.18651442229747772,966.6818237304688,1e-05,0.056586310267448425,5.685785293579102,15.555094242095947,4 +4929,0.09002555906772614,0.15450061857700348,0.14137767255306244,0.23973557353019714,941.8146362304688,1e-05,0.06313992291688919,5.690792083740234,15.555094242095947,4 +4930,0.07618379592895508,0.08194264769554138,0.07564865797758102,0.20239582657814026,719.4397583007812,1e-05,0.05240967497229576,5.689895153045654,15.555094242095947,4 +4931,0.058711327612400055,0.09238249063491821,0.08971771597862244,0.22722755372524261,960.3799438476562,1e-05,0.06565992534160614,5.688434362411499,15.555094242095947,4 +4932,0.05492393672466278,0.13485944271087646,0.12295109033584595,0.24685095250606537,935.9296264648438,1e-05,0.07024235278367996,5.691525220870972,15.555094242095947,4 +4933,0.07913929969072342,0.055396877229213715,0.05112022906541824,0.21821312606334686,883.2159423828125,1e-05,0.047519177198410034,5.800968647003174,15.555094242095947,4 +4934,0.09463036805391312,0.11278635263442993,0.11312229186296463,0.27300480008125305,916.1324462890625,1e-05,0.09458073228597641,5.691281795501709,15.555094242095947,4 +4935,0.08753730356693268,0.37381771206855774,0.3902668356895447,0.1936858892440796,61.78706741333008,1e-05,0.060559093952178955,5.709964275360107,15.555094242095947,4 +4936,0.07540559768676758,0.11318469047546387,0.10864127427339554,0.27298876643180847,737.7049560546875,1e-05,0.06497922539710999,5.898439884185791,15.555094242095947,4 +4937,0.07841488718986511,0.07631327956914902,0.0731641948223114,0.30387818813323975,689.9642333984375,1e-05,0.07187339663505554,5.70154070854187,15.555094242095947,4 +4938,0.0837547704577446,0.18498842418193817,0.1778976321220398,0.15555287897586823,991.9489135742188,1e-05,0.07140830904245377,6.06316065788269,15.555094242095947,4 +4939,0.09191574156284332,0.07097899913787842,0.06982992589473724,0.23531249165534973,476.4851989746094,1e-05,0.05463666096329689,5.679646253585815,15.555094242095947,4 +4940,0.07715369015932083,0.06458024680614471,0.06127075105905533,0.21249999105930328,939.9801635742188,1e-05,0.07507460564374924,5.6835527420043945,15.555094242095947,4 +4941,0.09792210161685944,0.08123652637004852,0.08054652810096741,0.23683492839336395,854.4303588867188,1e-05,0.07752752304077148,5.690706014633179,15.555094242095947,4 +4942,0.06834550946950912,0.10170390456914902,0.09706227481365204,0.25458332896232605,934.0242309570312,1e-05,0.052201688289642334,5.688514471054077,15.555094242095947,4 +4943,0.12494336813688278,0.06053449958562851,0.059065185487270355,0.24763621389865875,730.8970947265625,1e-05,0.060858432203531265,5.919607639312744,15.555094242095947,4 +4944,0.07840489596128464,0.05826582759618759,0.05762253701686859,0.21641024947166443,909.21484375,1e-05,0.0837957039475441,5.682423114776611,15.555094242095947,4 +4945,0.054635822772979736,0.0403265617787838,0.0427900105714798,0.23560896515846252,694.9378051757812,1e-05,0.052075307816267014,5.680720090866089,15.555094242095947,4 +4946,0.07081257551908493,0.08016673475503922,0.07707720994949341,0.2183733880519867,735.1730346679688,1e-05,0.057636797428131104,5.688067436218262,15.555094242095947,4 +4947,0.08775565028190613,0.12798191606998444,0.13068218529224396,0.24803684651851654,322.7003173828125,1e-05,0.09503830224275589,5.683199167251587,15.555094242095947,4 +4948,0.12162980437278748,0.15985934436321259,0.1551516205072403,0.20499999821186066,986.50927734375,1e-05,0.06590601801872253,5.69364070892334,15.555094242095947,4 +4949,0.08822906762361526,0.06470199674367905,0.06521858274936676,0.18285255134105682,793.795654296875,1e-05,0.07764620333909988,5.80330491065979,15.555094242095947,4 +4950,0.1276022046804428,0.07343646883964539,0.06750965118408203,0.2153685837984085,707.4652709960938,1e-05,0.075843445956707,5.693583250045776,15.555094242095947,4 +4951,0.06496817618608475,0.09125393629074097,0.08966334909200668,0.25026440620422363,989.3660888671875,1e-05,0.07677562534809113,5.693234920501709,15.555094242095947,4 +4952,0.07704031467437744,0.0874292403459549,0.07887407392263412,0.23753204941749573,769.9692993164062,1e-05,0.07532937824726105,5.6946961879730225,15.555094242095947,4 +4953,0.0848817527294159,0.1585455983877182,0.15037404000759125,0.166490375995636,996.7586059570312,1e-05,0.06388702988624573,5.68512749671936,15.555094242095947,4 +4954,0.0872843936085701,0.05552610754966736,0.05264372006058693,0.22857370972633362,888.3101196289062,1e-05,0.06845717132091522,5.690042734146118,15.555094242095947,4 +4955,0.0701591894030571,0.29651394486427307,0.24984155595302582,0.23053684830665588,994.0623168945312,1e-05,0.059294071048498154,5.690817594528198,15.555094242095947,4 +4956,0.05441928654909134,0.10967765003442764,0.10439688712358475,0.21832531690597534,377.094970703125,1e-05,0.05263683572411537,5.691764831542969,15.555094242095947,4 +4957,0.07220057398080826,0.04679850861430168,0.0485042929649353,0.2818108797073364,738.5433959960938,1e-05,0.06346689909696579,5.913578271865845,15.555094242095947,4 +4958,0.08313027769327164,0.04550322890281677,0.04701004922389984,0.1414823681116104,914.3394165039062,1e-05,0.06055855005979538,5.695666313171387,15.555094242095947,4 +4959,0.10318688303232193,0.14205488562583923,0.14225012063980103,0.2596474289894104,285.49383544921875,1e-05,0.06921558082103729,5.93245792388916,15.555094242095947,4 +4960,0.09381385892629623,0.09550346434116364,0.08780897408723831,0.294286847114563,911.4300537109375,1e-05,0.06496728211641312,5.687617540359497,15.555094242095947,4 +4961,0.08661259710788727,0.06391051411628723,0.057496290653944016,0.2451842874288559,744.3366088867188,1e-05,0.06372353434562683,5.6859450340271,15.555094242095947,4 +4962,0.08812275528907776,0.05401119589805603,0.05208749324083328,0.1632051169872284,696.9026489257812,1e-05,0.05955168977379799,5.691458463668823,15.555094242095947,4 +4963,0.06204758584499359,0.1150989830493927,0.10464737564325333,0.2552163302898407,897.2911987304688,1e-05,0.067454993724823,5.691253900527954,15.555094242095947,4 +4964,0.10765555500984192,0.06313293427228928,0.06113060191273689,0.24944710731506348,646.7181396484375,1e-05,0.08695869892835617,5.687737226486206,15.555094242095947,4 +4965,0.07517494261264801,0.056608736515045166,0.0532960407435894,0.06628204882144928,789.0855712890625,1e-05,0.06388318538665771,5.6938416957855225,15.555094242095947,4 +4966,0.09227949380874634,0.10495875775814056,0.10661572217941284,0.24416665732860565,498.798095703125,1e-05,0.06486854702234268,5.684510946273804,15.555094242095947,4 +4967,0.09657257050275803,0.056516531854867935,0.055084969848394394,0.2416105717420578,816.57421875,1e-05,0.0695817619562149,5.680306673049927,15.555094242095947,4 +4968,0.1087503582239151,0.0780121237039566,0.07896158844232559,0.24408653378486633,738.5433959960938,1e-05,0.0673149973154068,5.95665979385376,15.555094242095947,4 +4969,0.04843165725469589,0.12373429536819458,0.11896177381277084,0.19306890666484833,972.7151489257812,1e-05,0.06721658259630203,5.701959609985352,15.555094242095947,4 +4970,0.09951967000961304,0.049377188086509705,0.04782961308956146,0.2565865218639374,836.0927734375,1e-05,0.08301620930433273,5.67714786529541,15.555094242095947,4 +4971,0.09617772698402405,0.07646112143993378,0.08009602874517441,0.18794870376586914,391.4835205078125,1e-05,0.05798216909170151,5.872521638870239,15.555094242095947,4 +4972,0.08702363073825836,0.0509282723069191,0.05130909010767937,0.24346153438091278,686.9369506835938,1e-05,0.0605938546359539,5.689707279205322,15.555094242095947,4 +4973,0.06601911038160324,0.07453151047229767,0.0824040025472641,0.1875881403684616,288.4615478515625,1e-05,0.07015493512153625,5.711945056915283,15.555094242095947,4 +4974,0.09250731766223907,0.025525685399770737,0.027942867949604988,0.22035256028175354,753.9683227539062,1e-05,0.0658213198184967,5.712273836135864,15.555094242095947,4 +4975,0.0762607604265213,0.07502945512533188,0.08012408763170242,0.2632131278514862,225.4098358154297,1e-05,0.09049202501773834,5.942969799041748,15.555094242095947,4 +4976,0.12905621528625488,0.1357211172580719,0.1306128054857254,0.24465544521808624,398.5013732910156,1e-05,0.05933018773794174,5.697659254074097,15.555094242095947,4 +4977,0.09107743948698044,0.07979702204465866,0.07352174818515778,0.255328506231308,933.0629272460938,1e-05,0.08319114148616791,5.685760974884033,15.555094242095947,4 +4978,0.10152913630008698,0.0753634050488472,0.07248785346746445,0.20180287957191467,434.0730895996094,1e-05,0.07744394987821579,5.892965078353882,15.555094242095947,4 +4979,0.12368278205394745,0.030684195458889008,0.029283780604600906,0.24996793270111084,745.9677734375,1e-05,0.0694151520729065,5.684572696685791,15.555094242095947,4 +4980,0.0791521891951561,0.07666613906621933,0.07276605069637299,0.2968910038471222,900.8379516601562,1e-05,0.08143036812543869,5.695058345794678,15.555094242095947,4 +4981,0.06970001757144928,0.10742027312517166,0.09920685738325119,0.26016825437545776,823.0874633789062,1e-05,0.06639063358306885,5.680144548416138,15.555094242095947,4 +4982,0.10617145150899887,0.05141284316778183,0.04854677617549896,0.238621786236763,767.0015869140625,1e-05,0.07102757692337036,5.681199789047241,15.555094242095947,4 +4983,0.09949640184640884,0.06596563011407852,0.06850070506334305,0.18784454464912415,694.9378051757812,1e-05,0.0853000208735466,5.6877686977386475,15.555094242095947,4 +4984,0.05413787439465523,0.06172531470656395,0.05884195864200592,0.2221153825521469,859.8626708984375,1e-05,0.05774921178817749,5.686969518661499,15.555094242095947,4 +4985,0.07816852629184723,0.15360453724861145,0.1492789089679718,0.174775630235672,957.39697265625,1e-05,0.060819078236818314,5.6765501499176025,15.555094242095947,4 +4986,0.08700325340032578,0.09999457746744156,0.09718827903270721,0.19296473264694214,675.5514526367188,1e-05,0.0832194834947586,5.688764810562134,15.555094242095947,4 +4987,0.07982447743415833,0.10785536468029022,0.1041986495256424,0.25369390845298767,923.1171264648438,1e-05,0.058468617498874664,5.691917419433594,15.555094242095947,4 +4988,0.05568230152130127,0.19223102927207947,0.18284504115581512,0.2590464651584625,986.731201171875,1e-05,0.057319894433021545,5.683986186981201,15.555094242095947,4 +4989,0.05536976456642151,0.06573030352592468,0.059245575219392776,0.2645753026008606,867.0343017578125,1e-05,0.06840294599533081,5.887151002883911,15.555094242095947,4 +4990,0.07715882360935211,0.050960954278707504,0.05642302334308624,0.24935095012187958,458.8607482910156,1e-05,0.06812883913516998,5.690626859664917,15.555094242095947,4 +4991,0.06505520641803741,0.06129424273967743,0.05821431055665016,0.2485496699810028,900.8379516601562,1e-05,0.06723827123641968,5.697798252105713,15.555094242095947,4 +4992,0.08748655021190643,0.1413639485836029,0.1342475861310959,0.25286057591438293,978.0244140625,1e-05,0.05066945403814316,5.711756467819214,15.555094242095947,4 +4993,0.08444520086050034,0.06377921253442764,0.05914708971977234,0.23711538314819336,824.2506713867188,1e-05,0.10525155067443848,5.696396827697754,15.555094242095947,4 +4994,0.06851962208747864,0.1276051253080368,0.12155731767416,0.18137018382549286,963.3027954101562,1e-05,0.06593796610832214,5.690003395080566,15.555094242095947,4 +4995,0.10079975426197052,0.07738400995731354,0.0718575194478035,0.1847035139799118,852.9224853515625,1e-05,0.07087396830320358,5.677901744842529,15.555094242095947,4 +4996,0.05442573502659798,0.11124039441347122,0.1276751607656479,0.23301281034946442,987.615478515625,1e-05,0.07451370358467102,5.680185794830322,15.555094242095947,4 +4997,0.05893932282924652,0.052629414945840836,0.05066888779401779,0.24963140487670898,933.7044067382812,1e-05,0.05075585097074509,5.68612813949585,15.555094242095947,4 +4998,0.09938428550958633,0.15510927140712738,0.15469640493392944,0.2279246747493744,973.9398803710938,1e-05,0.0638013482093811,5.676359415054321,15.555094242095947,4 +4999,0.0539759062230587,0.07103860378265381,0.06700575351715088,0.26453524827957153,868.9024658203125,1e-05,0.08540359139442444,5.682402849197388,15.555094242095947,4 +5000,0.05573238432407379,0.054212577641010284,0.0533192977309227,0.2597195506095886,669.14501953125,1e-05,0.0563221201300621,5.708069324493408,15.555094242095947,4 diff --git a/backup_2026-09-14/runs/skyreels__arope_5k/val_log.csv b/backup_2026-09-14/runs/skyreels__arope_5k/val_log.csv new file mode 100644 index 0000000000000000000000000000000000000000..ed8988f469e1c1295769bd1fcc61855dd5ebd1ba --- /dev/null +++ b/backup_2026-09-14/runs/skyreels__arope_5k/val_log.csv @@ -0,0 +1,31 @@ +step,timestep,loss_w,mse,n +500,201.34228515625,0.18494481407105923,0.18754119239747524,16 +500,500.59954833984375,0.07667585415765643,0.07670211256481707,16 +500,799.7118530273438,0.06552583328448236,0.06456623692065477,16 +1000,201.34228515625,0.17979799769818783,0.18230619095265865,16 +1000,500.59954833984375,0.07477202476002276,0.0747635941952467,16 +1000,799.7118530273438,0.06349922786466777,0.06238035927526653,16 +1500,201.34228515625,0.17810296453535557,0.18059337604790926,16 +1500,500.59954833984375,0.07411855505779386,0.07408908451907337,16 +1500,799.7118530273438,0.06263780733570457,0.061493468238040805,16 +2000,201.34228515625,0.1763073648326099,0.17875252338126302,16 +2000,500.59954833984375,0.07324588135816157,0.07319124788045883,16 +2000,799.7118530273438,0.06184968072921038,0.060682685347273946,16 +2500,201.34228515625,0.1754116052761674,0.17782909981906414,16 +2500,500.59954833984375,0.07276489189825952,0.07269364246167243,16 +2500,799.7118530273438,0.06120750680565834,0.06003235885873437,16 +3000,201.34228515625,0.1748553402721882,0.17725271871313453,16 +3000,500.59954833984375,0.07249781885184348,0.07242110301740468,16 +3000,799.7118530273438,0.06070719729177654,0.05951656890101731,16 +3500,201.34228515625,0.17440708121284842,0.17678688932210207,16 +3500,500.59954833984375,0.07236316567286849,0.07227008766494691,16 +3500,799.7118530273438,0.060708775417879224,0.05951341358013451,16 +4000,201.34228515625,0.17404319066554308,0.17642318177968264,16 +4000,500.59954833984375,0.07199099170975387,0.07190308743156493,16 +4000,799.7118530273438,0.059999587247148156,0.058790427166968584,16 +4500,201.34228515625,0.17343326937407255,0.17578862328082323,16 +4500,500.59954833984375,0.07170777069404721,0.07161247543990612,16 +4500,799.7118530273438,0.059797340305522084,0.05859141144901514,16 +5000,201.34228515625,0.17339435406029224,0.17575429379940033,16 +5000,500.59954833984375,0.07161104655824602,0.0715156605001539,16 +5000,799.7118530273438,0.05950371013022959,0.05833609844557941,16